-- Logs begin at Sat 2022-10-29 02:03:05 UTC, end at Sat 2022-10-29 04:29:23 UTC. -- Oct 29 02:34:57.768252 n-d-862967-2 systemd[1]: Starting Devstack devstack@n-api.service... Oct 29 02:34:57.777919 n-d-862967-2 devstack@n-api.service[111303]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 29 02:34:57.780728 n-d-862967-2 devstack@n-api.service[111303]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 29 02:34:57 2022] *** Oct 29 02:34:57.780728 n-d-862967-2 devstack@n-api.service[111303]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 29 02:34:57.780728 n-d-862967-2 devstack@n-api.service[111303]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 29 02:34:57.780728 n-d-862967-2 devstack@n-api.service[111303]: nodename: n-d-862967-2 Oct 29 02:34:57.780728 n-d-862967-2 devstack@n-api.service[111303]: machine: x86_64 Oct 29 02:34:57.780728 n-d-862967-2 devstack@n-api.service[111303]: clock source: unix Oct 29 02:34:57.780728 n-d-862967-2 devstack@n-api.service[111303]: pcre jit disabled Oct 29 02:34:57.780728 n-d-862967-2 devstack@n-api.service[111303]: detected number of CPU cores: 4 Oct 29 02:34:57.780728 n-d-862967-2 devstack@n-api.service[111303]: current working directory: / Oct 29 02:34:57.780728 n-d-862967-2 devstack@n-api.service[111303]: detected binary path: /usr/bin/uwsgi-core Oct 29 02:34:57.780728 n-d-862967-2 devstack@n-api.service[111303]: your processes number limit is 47680 Oct 29 02:34:57.780728 n-d-862967-2 devstack@n-api.service[111303]: your memory page size is 4096 bytes Oct 29 02:34:57.780728 n-d-862967-2 devstack@n-api.service[111303]: detected max file descriptor number: 2048 Oct 29 02:34:57.780728 n-d-862967-2 devstack@n-api.service[111303]: lock engine: pthread robust mutexes Oct 29 02:34:57.781693 n-d-862967-2 devstack@n-api.service[111303]: thunder lock: enabled Oct 29 02:34:57.781693 n-d-862967-2 devstack@n-api.service[111303]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 29 02:34:57.781693 n-d-862967-2 devstack@n-api.service[111303]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 29 02:34:57.823131 n-d-862967-2 devstack@n-api.service[111303]: Python main interpreter initialized at 0x561fb38da9c0 Oct 29 02:34:57.823131 n-d-862967-2 devstack@n-api.service[111303]: python threads support enabled Oct 29 02:34:57.823131 n-d-862967-2 devstack@n-api.service[111303]: your server socket listen backlog is limited to 100 connections Oct 29 02:34:57.823131 n-d-862967-2 devstack@n-api.service[111303]: your mercy for graceful operations on workers is 90 seconds Oct 29 02:34:57.823483 n-d-862967-2 devstack@n-api.service[111303]: mapped 403077 bytes (393 KB) for 2 cores Oct 29 02:34:57.823483 n-d-862967-2 devstack@n-api.service[111303]: *** Operational MODE: preforking *** Oct 29 02:34:57.823830 n-d-862967-2 devstack@n-api.service[111303]: *** uWSGI is running in multiple interpreter mode *** Oct 29 02:34:57.823830 n-d-862967-2 devstack@n-api.service[111303]: spawned uWSGI master process (pid: 111303) Oct 29 02:34:57.824020 n-d-862967-2 systemd[1]: Started Devstack devstack@n-api.service. Oct 29 02:34:57.832715 n-d-862967-2 devstack@n-api.service[111303]: spawned uWSGI worker 1 (pid: 111304, cores: 1) Oct 29 02:34:57.832715 n-d-862967-2 devstack@n-api.service[111303]: spawned uWSGI worker 2 (pid: 111305, cores: 1) Oct 29 02:34:57.832715 n-d-862967-2 devstack@n-api.service[111303]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 29 02:34:58.476214 n-d-862967-2 devstack@n-api.service[111304]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 29 02:34:58.477101 n-d-862967-2 devstack@n-api.service[111305]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 29 02:34:59.527726 n-d-862967-2 devstack@n-api.service[111305]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 02:34:59.527726 n-d-862967-2 devstack@n-api.service[111305]: from cryptography.utils import int_from_bytes Oct 29 02:34:59.528417 n-d-862967-2 devstack@n-api.service[111305]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 02:34:59.528417 n-d-862967-2 devstack@n-api.service[111305]: from cryptography.utils import int_from_bytes Oct 29 02:34:59.531457 n-d-862967-2 devstack@n-api.service[111304]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 02:34:59.531457 n-d-862967-2 devstack@n-api.service[111304]: from cryptography.utils import int_from_bytes Oct 29 02:34:59.531910 n-d-862967-2 devstack@n-api.service[111304]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 02:34:59.531910 n-d-862967-2 devstack@n-api.service[111304]: from cryptography.utils import int_from_bytes Oct 29 02:35:01.959767 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 02:35:01.960362 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 02:35:01.960503 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 02:35:01.960911 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 02:35:01.961108 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 02:35:01.961487 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 02:35:01.961569 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 02:35:01.961649 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.961803 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.961890 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 02:35:01.962147 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.962281 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 02:35:01.962444 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.962539 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 02:35:01.962844 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.962997 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.963146 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.963289 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.963468 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.963566 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.963772 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.963883 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.964095 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.964198 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.964338 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.964433 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.964681 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.964772 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.965002 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862967-2 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.965093 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.965324 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.965432 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.965597 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.965686 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.965912 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.966023 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.966222 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.966403 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862967-2 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.966486 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.966578 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.966825 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.966916 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.967124 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.967228 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.967440 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.967608 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.968002 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.968002 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.968158 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.968317 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.968404 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.968642 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.968865 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.968980 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.969157 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.969276 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.969439 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.969581 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.969748 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.969895 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.970079 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.970197 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.970391 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.970514 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.970699 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.970799 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.971019 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.971197 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862967-2 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.971325 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.971510 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.971645 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.971817 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.971955 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.972122 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.972349 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862967-2 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.972550 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.972770 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.972877 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.973084 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.973189 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.973394 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.973480 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.973750 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.973893 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.974054 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.974140 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.974380 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.974474 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.974696 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.974823 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.975008 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.975095 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.975315 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.975400 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.975616 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.975701 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.975917 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.976011 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.976226 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.976353 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.976553 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.976646 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.976857 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.976961 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.977152 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.977255 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.977397 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.977492 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.977700 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.977797 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.978017 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.978120 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.978355 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.978442 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.978603 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.978690 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.978903 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.979008 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.979146 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.979248 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.979460 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.979650 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.979806 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.979958 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.980095 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.980228 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.980359 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.980502 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.980650 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.980753 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.980931 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.981027 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.981240 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.981336 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.981538 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.981624 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.981839 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.981933 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.982141 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.982240 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.982443 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.982528 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.982747 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.982845 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.983049 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.983145 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.983349 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.983433 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.983664 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.983750 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.983974 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.984063 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.984290 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.984375 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.984618 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.984708 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.984950 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.985094 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.985256 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.985341 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.985559 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.985645 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.985865 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.985952 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.986177 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.986279 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.986479 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.986565 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.986781 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.986868 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.987083 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.987170 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.987397 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.987493 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.987700 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.987784 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.988008 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.988115 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.988251 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.988428 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.988576 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.988781 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.988871 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.989113 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.989201 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.989418 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.989517 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.989664 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.989753 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.989963 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.990053 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.990268 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.990356 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.990589 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.990677 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.990895 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.990980 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.991193 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.991279 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.991494 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.991581 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.991792 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.991960 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.992089 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.992173 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.992389 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.992474 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.992713 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.992810 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.993014 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.993101 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.993313 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.993406 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.993614 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.993707 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.993977 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.994066 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.994277 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.994362 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.994584 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.994680 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.994884 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.994970 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.995184 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.995269 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.995499 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.995602 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.995802 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.995889 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.996103 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.996197 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.996406 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.996506 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.996727 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.996813 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.997028 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.997113 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.997337 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.997441 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.997639 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.997724 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.997939 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.998025 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.998243 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.998344 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.998535 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.998681 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.998916 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.999001 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.999133 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.999233 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.999437 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.999542 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.999749 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:01.999841 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.000027 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.000122 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.000324 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.000409 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.000639 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.000729 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.000939 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.001027 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.001233 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.001318 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.001529 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.001615 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.001818 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.001912 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.002117 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.002201 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.002417 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.002511 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.002715 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.002801 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.003011 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.003096 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.003307 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.003400 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.003620 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.003707 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.003949 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.004042 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.004273 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.004369 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.004636 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.004756 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.004945 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.005030 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.005268 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:35:02.005363 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.005906 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.005997 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.006217 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.006303 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.006522 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.006615 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.006829 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.006921 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.007146 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.007232 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.007451 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.007538 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.007755 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.007840 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.008058 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.008154 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.008370 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.008463 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.008701 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.008802 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.009024 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.009120 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.009331 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.009432 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.009663 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.009748 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.009977 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.010070 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.010278 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.010365 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.010589 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.010674 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.010908 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.011001 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.011219 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.011313 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.011522 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.011608 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.011831 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.011926 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.012150 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.012236 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.012470 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.012580 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.012811 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.012983 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.013122 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.013208 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.013423 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.013518 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.013724 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.013819 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.014025 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.014117 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.014367 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.014453 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.014673 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.014766 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.014978 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.015065 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.015286 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.015379 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.015590 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.015677 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.015905 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.015990 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.016209 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.016295 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.016566 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.016659 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.016834 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.016920 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.017136 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.017222 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.017439 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.017527 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.017752 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.017837 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.018058 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.018142 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.018366 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.018461 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.018669 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.018756 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.018973 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.019067 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.019280 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.019364 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.019588 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.019718 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.019895 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.020071 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.020202 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.020353 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.020502 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.020692 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.020819 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.021009 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.021106 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.021321 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.021407 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.021637 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.021725 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.021950 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.022037 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.022260 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.022346 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.022567 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.022661 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.022872 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.022960 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.023183 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.023276 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.023485 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.023579 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.023790 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.023876 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.024093 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.024178 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.024399 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.024497 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.024730 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.024831 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.025036 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.025153 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.025387 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.025488 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.025706 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.025793 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.026012 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.026105 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.026312 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.026407 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.026630 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.026761 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.026934 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.027020 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.027235 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.027322 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.027543 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.027628 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.027849 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.027937 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.028153 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.028238 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.028457 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.028579 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.028788 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.028885 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.029094 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.029180 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.029403 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.029498 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.029709 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.029839 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.030020 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.030146 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.030332 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.030418 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.030633 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.030728 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.030951 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.031038 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.031261 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.031346 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.031570 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.031662 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.031872 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.031965 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.032177 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.032263 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.032475 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.032594 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.032810 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.032896 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.033111 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.033200 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.033416 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.033520 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.033714 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.033801 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.034011 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.034097 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.034312 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.034400 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.034611 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.034698 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.034907 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.035000 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.035226 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.035314 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.035529 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.035622 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.035827 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.035913 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.036125 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.036212 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.036422 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.036507 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.036779 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.036867 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.037078 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.037166 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.037401 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.037486 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.037702 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.037798 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.038005 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.038091 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.038308 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.038394 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.038625 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.038730 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.038931 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.039018 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.039234 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.039328 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.039541 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.039637 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.039847 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.039979 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.040153 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.040281 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.040468 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.040589 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.040820 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.040907 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.041134 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.041228 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.041442 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.041530 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.041751 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.041836 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.042054 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.042139 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.042367 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.042454 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.042667 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.042754 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.042976 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.043062 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.043283 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.043369 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.043605 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.043702 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.043911 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.043997 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.044224 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.044309 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.044561 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.044651 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.044853 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.044939 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.045156 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.045243 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.045459 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.045546 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.045764 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.045859 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.046069 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.046155 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.046383 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.046471 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.046688 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.046783 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.046999 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.047088 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.047301 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.047395 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.047605 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.047703 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.047907 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.048036 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.048219 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.048309 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.048533 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.048649 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.048848 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.048946 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.049149 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.049234 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.049471 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.049559 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.049772 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.049865 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.050079 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.050165 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.050378 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.050463 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.050685 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.050769 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.050988 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.051113 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.051290 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.051447 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.051589 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.051759 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.051888 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.052069 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.052193 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.052388 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.052500 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.052802 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.052891 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.053114 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.053210 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.053411 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.053494 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.053716 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.053809 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.054015 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.054114 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.054318 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.054403 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.054613 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.054706 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.054917 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.055003 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.055230 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.055328 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.055532 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.055617 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.055844 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.055930 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.056154 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.056249 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.056500 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.056655 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.056824 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.056937 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.057140 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.057254 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.057446 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.057567 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.057745 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.057857 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.058043 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.058165 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.058339 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.058461 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.058671 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.058781 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.058972 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.059090 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.059264 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.059386 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.061753 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.061886 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.061886 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.062045 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.062136 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.062228 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.062310 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.062388 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.062388 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.062529 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.062617 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.062697 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.062837 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.062923 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.063002 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.063079 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.063171 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.063252 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.063331 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.063409 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.063487 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.063565 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.063698 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.063786 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.063867 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.063945 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.064023 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.064101 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.064188 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.064257 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.064329 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.064407 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.064481 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.064584 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.064655 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.064733 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.064899 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.065001 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.065211 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.065306 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.065554 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.065778 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.065872 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.066107 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.066207 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.066416 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.066570 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.066777 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.066931 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.067072 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.067184 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.067398 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.067575 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.067726 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.068033 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.068125 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.068342 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.068431 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.068658 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.068766 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.068967 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.069068 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.069264 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.069370 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.069563 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.069666 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.069864 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.069952 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.070241 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.070337 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.070468 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.070560 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.070754 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.070846 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.071058 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.071145 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.071357 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.071444 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.071654 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.071740 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.071969 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.072055 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.072272 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.072358 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.072596 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.072688 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.072894 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.072980 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.073198 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.073285 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.073494 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.073580 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.073813 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.073906 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.074112 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.074199 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.074417 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.074511 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.074711 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.074800 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.075007 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.075094 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.075320 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.075405 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.075622 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.075711 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.075939 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.076077 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.076244 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.076332 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.076565 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.076659 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.076869 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.076958 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.077170 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.077257 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.077487 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.077582 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.077786 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.077881 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.078084 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.078180 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.078381 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.078468 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.078685 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.078772 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.078993 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.079088 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.079291 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.079378 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.079595 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.079681 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.079898 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.079993 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.080200 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.080303 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.080502 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.080612 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.080820 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.080917 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.081120 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.081208 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.081417 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.081504 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.081725 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.081812 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.082024 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.082132 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.082321 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.082441 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.082617 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.082749 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.082918 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.083051 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.083220 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.083358 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.083517 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.083660 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.083822 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.083980 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.084116 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.084265 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.084428 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.084586 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.084749 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.084890 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.085047 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.085210 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.085343 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.085496 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.085644 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.085797 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.085948 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.086103 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.086242 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.086402 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.086559 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.086714 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.086863 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.087014 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.087160 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.087308 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.087458 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.087702 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.087796 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.088019 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.088107 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.088329 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.088415 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.088652 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.088759 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.088976 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.089064 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.089304 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.089437 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.089581 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.089677 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.089880 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.090023 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.090188 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.090283 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.090492 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.090626 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.090789 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.090875 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.091091 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.091179 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.091385 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.091484 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.091680 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.091767 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.091974 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.092061 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.092270 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.092357 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.092586 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.092677 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.092890 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.092984 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.093191 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.093280 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.093485 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.093570 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.093781 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.093875 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.094077 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.094173 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.094371 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.094457 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.094673 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.094761 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.094973 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.095061 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.095297 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.095385 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.095602 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.095698 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.095904 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.095992 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.096204 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.096292 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.096504 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.096624 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.096834 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.096919 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.097135 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.097229 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.097447 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.097543 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.097750 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.097891 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.098055 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.098207 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.098352 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.098526 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.098650 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.098840 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.098965 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.099152 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.099253 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.099693 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.099790 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.099870 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.099965 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.100053 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.100146 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.100364 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.100452 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.100700 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.100800 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.101004 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.101144 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.101306 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.101393 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.101626 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.101712 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.101933 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.102031 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.102235 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.102321 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.102537 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.102623 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.102842 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.102937 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.103147 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.103233 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.103473 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.103561 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.103779 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.103866 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.104077 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.104171 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.104383 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.104469 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.104707 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.104795 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.105006 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.105092 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.105318 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.105406 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.105622 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.105717 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.105919 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.106005 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.106220 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.106319 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.106518 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.106611 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.106821 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.106913 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.107118 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.107213 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.107422 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.107542 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.107725 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.107848 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.108048 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.108148 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.108358 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.108445 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.108687 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.108781 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.108997 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.109096 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.109299 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.109385 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.109607 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.109692 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.109909 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.110005 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.110314 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.110399 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.110619 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.110705 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.110925 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.111015 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.111227 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.111311 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.111525 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.111611 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.111824 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.111919 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.112126 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.112212 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.112432 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.112542 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.112754 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.112840 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.113051 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.113253 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.113340 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.113590 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.113685 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.113903 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.114033 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.114213 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.114308 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.114519 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.114633 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.114821 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.114939 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.115135 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.115220 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.115463 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.115630 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.115797 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.115934 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.116105 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.116238 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.116408 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.116580 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.116766 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.116899 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.117066 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.117216 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.117386 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.117522 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.117800 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.117909 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.118111 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.118200 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.118414 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.118501 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.118729 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.118846 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.119083 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.119173 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.119389 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.119489 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.119686 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.119782 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.120001 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.120088 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.120318 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.120413 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.120652 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.120753 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.120968 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.121056 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.121305 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.121400 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.121623 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.121718 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.121944 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.122049 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.122254 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.122344 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.122564 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.122650 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.122858 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.122951 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.123156 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.123244 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.123458 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.123552 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.123754 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.123841 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.124051 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.124139 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.124373 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.124460 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.124696 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.124793 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.125001 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.125111 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.125306 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.125430 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.125607 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.125753 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.125903 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.126058 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.126200 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.126362 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.126518 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.126669 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.126816 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.126970 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.127133 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.127271 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.127438 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.127590 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.127751 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.127890 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.128063 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.128201 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.128360 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.128509 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.128698 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.128943 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.129065 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.129252 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.129350 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.129557 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.129651 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.129852 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.129938 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.130163 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.130257 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.130466 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.130555 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.131091 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.131177 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.131411 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.131512 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.131729 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.131899 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.132031 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.132118 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.132348 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.132509 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.132676 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.132764 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.132979 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.133066 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.133279 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.133368 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.133579 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.133666 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.133893 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.133979 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.134196 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.134284 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.134514 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.134604 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.134817 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.134913 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.135116 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.135204 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.135413 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.135509 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.135709 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.135796 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.136010 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.136099 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.136305 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.136391 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.136624 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.136727 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.136922 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.137010 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.137239 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.137327 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.137537 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.137638 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.137852 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.137943 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.138152 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.138239 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.138752 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.138863 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.138946 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.139026 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.139112 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.139193 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.139322 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.139473 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.139621 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.139733 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.139917 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.140013 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.140216 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.140317 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.140572 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.140674 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.140851 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.140939 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.141158 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.141245 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.141464 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.141550 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.141764 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.141851 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.142065 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.142154 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.142365 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.142452 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.142671 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.142764 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.142974 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.143062 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.143280 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.143368 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.143591 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.143688 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.143899 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.143985 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.144211 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.144427 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.144658 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.144769 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.144975 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.145065 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.145301 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.145390 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.145615 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.145712 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.145929 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.146015 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.146243 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.146328 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.146548 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.146642 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.146851 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.146936 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.147156 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.147250 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.147461 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.147550 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.147783 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.147988 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.148100 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.148320 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.148419 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.148660 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.148761 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.148977 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.149071 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.149289 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.149391 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.149608 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.149695 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.149929 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.150072 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.150329 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.150421 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.150643 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.150742 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.150943 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.151030 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.151251 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.151339 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.151560 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.151646 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.151866 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.151962 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.152174 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.152268 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.152480 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.152603 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.152828 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.152928 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.153135 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.153222 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.153438 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.153533 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.153741 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.153843 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.154046 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.154133 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.154359 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.154446 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.154677 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.154764 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.155004 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.155090 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.155317 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.155411 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.155624 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.155712 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.155928 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.156016 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.156234 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.156321 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.156576 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.156763 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.156874 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.157075 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.157173 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.157404 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.157493 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.157726 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.157813 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.158046 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.158133 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.158360 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.158448 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.158674 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.158762 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.158997 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.159083 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.159294 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.159380 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.159591 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.159678 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.159896 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.159991 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.160197 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.160405 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.160491 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.160743 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.160831 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.161079 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.161178 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.161404 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.161492 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.161717 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.161802 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.162020 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.162108 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.162339 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.162544 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.162665 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.162890 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.162986 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.163201 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.163288 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.163521 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.163607 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.163842 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.163968 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.164142 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.164231 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.164443 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.164568 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.164779 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.164866 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.165080 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.165166 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.165381 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.165467 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.165706 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.165795 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.166015 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.166234 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.166321 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.166578 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.166674 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.166889 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.166974 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.167195 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.167281 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.167493 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.167588 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.167795 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.167881 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.168091 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.168178 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.168411 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.168499 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.168735 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.168823 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.169033 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.169119 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.169335 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.169423 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.169640 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.169727 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.169939 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.170024 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.170237 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.170323 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.170535 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.170623 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.170833 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.170929 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.171131 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.171216 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.171426 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.171510 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.171724 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.171866 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.172019 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.172105 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.172321 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.172408 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.172646 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.172749 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.172951 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.173037 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.173259 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.173345 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.173560 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.173661 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.173858 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.173944 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.174157 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.174242 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.174460 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.174548 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.174766 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.174887 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.175069 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.175155 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.175370 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.175455 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.175677 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.175764 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.176016 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.176174 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.176327 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.176560 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.176867 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.176953 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.177174 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.177261 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.177496 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.177586 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.177796 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.177891 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.178100 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.178197 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.178414 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.178500 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.178717 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.178802 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.179022 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.179118 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.179334 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.179420 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.179635 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.179728 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.179943 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.180039 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.180247 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.180333 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.180570 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.180823 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.180910 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.181159 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.181255 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.181508 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.181641 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.181813 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.181983 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.182154 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.182281 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.182458 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.182591 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.182761 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.182897 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.183062 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.183202 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.183366 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.183525 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.183664 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.183835 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.183969 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.184149 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.184313 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.184456 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.184651 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.184796 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.184963 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.185107 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.185278 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.185427 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.185585 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.185733 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.185889 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.186045 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.186191 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.186355 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.186495 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.186662 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.186797 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.186969 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.187105 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.187277 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.187428 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.187584 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.187733 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.187891 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.188029 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.188201 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.188551 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.188729 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.188872 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.189047 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.189189 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.189369 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.189503 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.189692 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.189816 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.190003 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.190167 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.190324 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.190411 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.190646 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.190733 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.190955 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.191051 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.191270 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.191357 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.191576 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.191697 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.191903 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.192032 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.192201 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.192287 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.192558 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.192883 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.192985 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.193187 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.193281 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.193487 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.193582 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.193787 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.193883 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.194090 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.194177 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.194407 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.194502 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.194708 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.194804 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.195007 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.195136 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.195308 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.195396 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.195611 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.195707 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.195906 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.195994 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.196203 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.196298 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.196500 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.196619 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.196823 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.196911 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.197151 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.197239 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.197450 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.197539 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.197747 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.197834 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.198044 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.198130 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.198340 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.198428 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.198634 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.198766 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.198928 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.199024 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.199228 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.199316 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.199525 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.199612 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.199821 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.199917 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.200117 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.200203 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.200415 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.200767 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.200767 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.200932 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.201039 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.201133 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.201338 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.201425 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.201639 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.201734 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.201939 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.202035 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.202236 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.202325 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.202676 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.202781 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.202911 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.202999 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.203223 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.203311 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.203522 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.203610 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.203822 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.203909 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.204122 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.204210 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.204422 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.204511 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.204745 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.204833 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.205047 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.205132 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.205350 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.205454 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.205653 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.205741 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.205953 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.206049 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.206254 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.206342 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.206574 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.206661 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.206889 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.206987 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.207185 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.207271 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.207503 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.207590 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.207809 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.207909 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.208115 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.208202 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.208418 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.208504 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.208743 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.208849 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.209056 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.209142 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.209357 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.209445 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.209660 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.209749 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.210011 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.210106 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.210262 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.210348 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.210566 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.210654 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.210874 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.210961 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.211177 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.211263 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.211481 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.211570 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.211789 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.211934 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.212096 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.212197 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.212404 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.212499 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.212780 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.212870 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.213109 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.213217 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.213420 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.213507 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.213727 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.213814 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.214050 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.214226 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.214324 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.214416 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.214636 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.214732 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.214951 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.215074 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.215263 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.215350 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.215571 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.215659 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.215885 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.215982 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.216120 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 02:35:02.216206 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.216505 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.216859 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.217166 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.217489 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.217812 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.218152 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.218463 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.218802 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.219127 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.219438 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.219747 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.220050 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:35:02.220289 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 02:35:02.368393 n-d-862967-2 devstack@n-api.service[111305]: INFO dbcounter [None req-686da878-8c07-4e70-9ee8-dcae78b23f1b None None] Registered counter for database nova_api Oct 29 02:35:02.373585 n-d-862967-2 devstack@n-api.service[111304]: INFO dbcounter [None req-27e64151-53ea-4bfc-bddb-2688e4d5361b None None] Registered counter for database nova_api Oct 29 02:35:02.389905 n-d-862967-2 devstack@n-api.service[111305]: DEBUG oslo_db.sqlalchemy.engines [None req-686da878-8c07-4e70-9ee8-dcae78b23f1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:35:02.394956 n-d-862967-2 devstack@n-api.service[111304]: DEBUG oslo_db.sqlalchemy.engines [None req-27e64151-53ea-4bfc-bddb-2688e4d5361b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:35:02.398224 n-d-862967-2 devstack@n-api.service[111305]: DEBUG dbcounter [-] [111305] Writer thread running {{(pid=111305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:35:02.402004 n-d-862967-2 devstack@n-api.service[111304]: DEBUG dbcounter [-] [111304] Writer thread running {{(pid=111304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:35:02.453844 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.context [None req-686da878-8c07-4e70-9ee8-dcae78b23f1b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5270c754-82e2-4d8e-a02e-4533aa854f76(cell1) {{(pid=111305) load_cells /opt/stack/nova/nova/context.py:464}} Oct 29 02:35:02.457329 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.context [None req-27e64151-53ea-4bfc-bddb-2688e4d5361b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5270c754-82e2-4d8e-a02e-4533aa854f76(cell1) {{(pid=111304) load_cells /opt/stack/nova/nova/context.py:464}} Oct 29 02:35:02.457723 n-d-862967-2 devstack@n-api.service[111305]: DEBUG oslo_concurrency.lockutils [None req-686da878-8c07-4e70-9ee8-dcae78b23f1b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:35:02.458188 n-d-862967-2 devstack@n-api.service[111305]: DEBUG oslo_concurrency.lockutils [None req-686da878-8c07-4e70-9ee8-dcae78b23f1b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:35:02.459776 n-d-862967-2 devstack@n-api.service[111305]: DEBUG oslo_concurrency.lockutils [None req-686da878-8c07-4e70-9ee8-dcae78b23f1b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:35:02.460594 n-d-862967-2 devstack@n-api.service[111305]: DEBUG oslo_concurrency.lockutils [None req-686da878-8c07-4e70-9ee8-dcae78b23f1b None None] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:35:02.460969 n-d-862967-2 devstack@n-api.service[111305]: DEBUG oslo_concurrency.lockutils [None req-686da878-8c07-4e70-9ee8-dcae78b23f1b None None] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:35:02.461187 n-d-862967-2 devstack@n-api.service[111304]: DEBUG oslo_concurrency.lockutils [None req-27e64151-53ea-4bfc-bddb-2688e4d5361b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:35:02.461650 n-d-862967-2 devstack@n-api.service[111304]: DEBUG oslo_concurrency.lockutils [None req-27e64151-53ea-4bfc-bddb-2688e4d5361b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:35:02.462976 n-d-862967-2 devstack@n-api.service[111305]: DEBUG oslo_concurrency.lockutils [None req-686da878-8c07-4e70-9ee8-dcae78b23f1b None None] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:35:02.463276 n-d-862967-2 devstack@n-api.service[111304]: DEBUG oslo_concurrency.lockutils [None req-27e64151-53ea-4bfc-bddb-2688e4d5361b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:35:02.463981 n-d-862967-2 devstack@n-api.service[111304]: DEBUG oslo_concurrency.lockutils [None req-27e64151-53ea-4bfc-bddb-2688e4d5361b None None] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:35:02.464420 n-d-862967-2 devstack@n-api.service[111304]: DEBUG oslo_concurrency.lockutils [None req-27e64151-53ea-4bfc-bddb-2688e4d5361b None None] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:35:02.465011 n-d-862967-2 devstack@n-api.service[111305]: INFO dbcounter [None req-686da878-8c07-4e70-9ee8-dcae78b23f1b None None] Registered counter for database nova_cell0 Oct 29 02:35:02.466430 n-d-862967-2 devstack@n-api.service[111304]: DEBUG oslo_concurrency.lockutils [None req-27e64151-53ea-4bfc-bddb-2688e4d5361b None None] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:35:02.468433 n-d-862967-2 devstack@n-api.service[111304]: INFO dbcounter [None req-27e64151-53ea-4bfc-bddb-2688e4d5361b None None] Registered counter for database nova_cell0 Oct 29 02:35:02.469078 n-d-862967-2 devstack@n-api.service[111305]: INFO dbcounter [None req-686da878-8c07-4e70-9ee8-dcae78b23f1b None None] Registered counter for database nova_cell1 Oct 29 02:35:02.472881 n-d-862967-2 devstack@n-api.service[111304]: INFO dbcounter [None req-27e64151-53ea-4bfc-bddb-2688e4d5361b None None] Registered counter for database nova_cell1 Oct 29 02:35:02.478018 n-d-862967-2 devstack@n-api.service[111305]: DEBUG oslo_db.sqlalchemy.engines [None req-686da878-8c07-4e70-9ee8-dcae78b23f1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:35:02.479225 n-d-862967-2 devstack@n-api.service[111305]: DEBUG oslo_db.sqlalchemy.engines [None req-686da878-8c07-4e70-9ee8-dcae78b23f1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:35:02.480545 n-d-862967-2 devstack@n-api.service[111304]: DEBUG oslo_db.sqlalchemy.engines [None req-27e64151-53ea-4bfc-bddb-2688e4d5361b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:35:02.484262 n-d-862967-2 devstack@n-api.service[111304]: DEBUG oslo_db.sqlalchemy.engines [None req-27e64151-53ea-4bfc-bddb-2688e4d5361b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:35:02.486094 n-d-862967-2 devstack@n-api.service[111305]: DEBUG dbcounter [-] [111305] Writer thread running {{(pid=111305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:35:02.486348 n-d-862967-2 devstack@n-api.service[111304]: DEBUG dbcounter [-] [111304] Writer thread running {{(pid=111304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:35:02.487568 n-d-862967-2 devstack@n-api.service[111305]: DEBUG dbcounter [-] [111305] Writer thread running {{(pid=111305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:35:02.622658 n-d-862967-2 devstack@n-api.service[111304]: DEBUG dbcounter [-] [111304] Writer thread running {{(pid=111304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:35:02.631789 n-d-862967-2 devstack@n-api.service[111304]: INFO dbcounter [None req-27e64151-53ea-4bfc-bddb-2688e4d5361b None None] Registered counter for database nova_cell0 Oct 29 02:35:02.632144 n-d-862967-2 devstack@n-api.service[111305]: INFO dbcounter [None req-686da878-8c07-4e70-9ee8-dcae78b23f1b None None] Registered counter for database nova_cell0 Oct 29 02:35:02.638974 n-d-862967-2 devstack@n-api.service[111304]: DEBUG oslo_db.sqlalchemy.engines [None req-27e64151-53ea-4bfc-bddb-2688e4d5361b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:35:02.642813 n-d-862967-2 devstack@n-api.service[111305]: DEBUG oslo_db.sqlalchemy.engines [None req-686da878-8c07-4e70-9ee8-dcae78b23f1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:35:02.644404 n-d-862967-2 devstack@n-api.service[111304]: DEBUG dbcounter [-] [111304] Writer thread running {{(pid=111304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:35:02.648195 n-d-862967-2 devstack@n-api.service[111305]: DEBUG dbcounter [-] [111305] Writer thread running {{(pid=111305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:35:02.972750 n-d-862967-2 devstack@n-api.service[111304]: WARNING keystonemiddleware.auth_token [None req-27e64151-53ea-4bfc-bddb-2688e4d5361b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 02:35:02.978341 n-d-862967-2 devstack@n-api.service[111305]: WARNING keystonemiddleware.auth_token [None req-686da878-8c07-4e70-9ee8-dcae78b23f1b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 02:35:02.979986 n-d-862967-2 devstack@n-api.service[111304]: WARNING keystonemiddleware.auth_token [None req-27e64151-53ea-4bfc-bddb-2688e4d5361b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 02:35:02.985582 n-d-862967-2 devstack@n-api.service[111305]: WARNING keystonemiddleware.auth_token [None req-686da878-8c07-4e70-9ee8-dcae78b23f1b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 02:35:03.314633 n-d-862967-2 devstack@n-api.service[111304]: WARNING keystonemiddleware.auth_token [None req-27e64151-53ea-4bfc-bddb-2688e4d5361b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 02:35:03.320634 n-d-862967-2 devstack@n-api.service[111304]: WARNING keystonemiddleware.auth_token [None req-27e64151-53ea-4bfc-bddb-2688e4d5361b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 02:35:03.322270 n-d-862967-2 devstack@n-api.service[111305]: WARNING keystonemiddleware.auth_token [None req-686da878-8c07-4e70-9ee8-dcae78b23f1b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 02:35:03.325971 n-d-862967-2 devstack@n-api.service[111304]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561fb38da9c0 pid: 111304 (default app) Oct 29 02:35:03.328010 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-27e64151-53ea-4bfc-bddb-2688e4d5361b None None] Calling method '>' {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:35:03.328192 n-d-862967-2 devstack@n-api.service[111305]: WARNING keystonemiddleware.auth_token [None req-686da878-8c07-4e70-9ee8-dcae78b23f1b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 02:35:03.329217 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-27e64151-53ea-4bfc-bddb-2688e4d5361b None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001723 Oct 29 02:35:03.329629 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Sat Oct 29 02:35:03 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:35:03.333481 n-d-862967-2 devstack@n-api.service[111305]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561fb38da9c0 pid: 111305 (default app) Oct 29 02:36:25.027706 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-27e64151-53ea-4bfc-bddb-2688e4d5361b None None] Calling method '>' {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:36:25.028753 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-27e64151-53ea-4bfc-bddb-2688e4d5361b None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Oct 29 02:36:25.029328 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 2/2] 10.222.0.46 () {54 vars in 931 bytes} [Sat Oct 29 02:36:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:36:25.041397 n-d-862967-2 devstack@n-api.service[111305]: DEBUG dbcounter [-] [111305] Writing DB stats nova_api:SELECT=3 {{(pid=111305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:25.042513 n-d-862967-2 devstack@n-api.service[111305]: DEBUG dbcounter [-] [111305] Writing DB stats nova_cell0:SELECT=3 {{(pid=111305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:25.043515 n-d-862967-2 devstack@n-api.service[111305]: DEBUG dbcounter [-] [111305] Writing DB stats nova_cell1:SELECT=3 {{(pid=111305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:25.044247 n-d-862967-2 devstack@n-api.service[111305]: DEBUG dbcounter [-] [111305] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:25.921333 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-871f090b-e0ed-4d86-9289-d82b9e34cafd admin admin] Calling method '>' {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:36:25.953811 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-871f090b-e0ed-4d86-9289-d82b9e34cafd admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.917661 Oct 29 02:36:25.954681 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 1/3] 10.222.0.46 () {60 vars in 1292 bytes} [Sat Oct 29 02:36:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:36:28.541270 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-27e64151-53ea-4bfc-bddb-2688e4d5361b None None] Calling method '>' {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:36:28.542246 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-27e64151-53ea-4bfc-bddb-2688e4d5361b None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Oct 29 02:36:28.542803 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 3/4] 10.222.0.46 () {54 vars in 931 bytes} [Sat Oct 29 02:36:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:36:28.987999 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-d353aa37-cd72-4f77-805c-456f11740393 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "swap": 0, "id": "c1", "os-flavor-access:is_public": true, "ram": 256, "vcpus": 1, "disk": 1}} {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:29.035920 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-d353aa37-cd72-4f77-805c-456f11740393 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.486940 Oct 29 02:36:29.036326 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 2/5] 10.222.0.46 () {64 vars in 1283 bytes} [Sat Oct 29 02:36:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 02:36:29.051367 n-d-862967-2 devstack@n-api.service[111304]: DEBUG dbcounter [-] [111304] Writing DB stats nova_api:SELECT=3 {{(pid=111304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:29.052449 n-d-862967-2 devstack@n-api.service[111304]: DEBUG dbcounter [-] [111304] Writing DB stats nova_cell0:SELECT=3 {{(pid=111304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:29.054425 n-d-862967-2 devstack@n-api.service[111304]: DEBUG dbcounter [-] [111304] Writing DB stats nova_cell1:SELECT=3 {{(pid=111304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:29.055169 n-d-862967-2 devstack@n-api.service[111304]: DEBUG dbcounter [-] [111304] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:29.264417 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-d7c03b4f-ec99-4d46-9d14-d6c1d7b25ef4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:29.333412 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-d7c03b4f-ec99-4d46-9d14-d6c1d7b25ef4 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287988 Oct 29 02:36:29.333976 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 4/6] 10.222.0.46 () {64 vars in 1336 bytes} [Sat Oct 29 02:36:29 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:36:31.951767 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-d353aa37-cd72-4f77-805c-456f11740393 admin admin] Calling method '>' {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:36:31.953599 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-d353aa37-cd72-4f77-805c-456f11740393 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002375 Oct 29 02:36:31.954236 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 3/7] 10.222.0.46 () {54 vars in 931 bytes} [Sat Oct 29 02:36:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:36:32.743591 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-c864a8c7-14ab-4496-9773-01479853f659 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "name": "ds512M", "vcpus": 1}} {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:32.801023 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-c864a8c7-14ab-4496-9773-01479853f659 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.840391 Oct 29 02:36:32.802167 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 5/8] 10.222.0.46 () {64 vars in 1283 bytes} [Sat Oct 29 02:36:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 02:36:32.814686 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-c8f16ff4-7e20-4751-ae0d-72c50e45b278 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:32.864379 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-c8f16ff4-7e20-4751-ae0d-72c50e45b278 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052900 Oct 29 02:36:32.864830 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 4/9] 10.222.0.46 () {64 vars in 1336 bytes} [Sat Oct 29 02:36:32 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:36:35.768301 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-c864a8c7-14ab-4496-9773-01479853f659 admin admin] Calling method '>' {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:36:35.768301 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-c864a8c7-14ab-4496-9773-01479853f659 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002049 Oct 29 02:36:35.768301 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 6/10] 10.222.0.46 () {54 vars in 931 bytes} [Sat Oct 29 02:36:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:36:36.288393 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-e556c1a8-c494-49cd-a4bd-d5e0f2b35191 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "os-flavor-access:is_public": true, "name": "ds1G", "vcpus": 1, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "d2"}} {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:36.308420 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-e556c1a8-c494-49cd-a4bd-d5e0f2b35191 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.531959 Oct 29 02:36:36.309332 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 5/11] 10.222.0.46 () {64 vars in 1283 bytes} [Sat Oct 29 02:36:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:36:36.321484 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-4324a593-898a-444b-be40-2e7da9b615aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:36.354495 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-4324a593-898a-444b-be40-2e7da9b615aa admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036815 Oct 29 02:36:36.355133 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 7/12] 10.222.0.46 () {64 vars in 1336 bytes} [Sat Oct 29 02:36:36 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:36:38.970333 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-e556c1a8-c494-49cd-a4bd-d5e0f2b35191 admin admin] Calling method '>' {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:36:38.971370 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-e556c1a8-c494-49cd-a4bd-d5e0f2b35191 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Oct 29 02:36:38.972008 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 6/13] 10.222.0.46 () {54 vars in 931 bytes} [Sat Oct 29 02:36:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:36:39.420015 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-d9eb879f-a6c5-495f-8759-5e8e8b4ea44a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "vcpus": 2, "id": "d3", "disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:39.442410 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-d9eb879f-a6c5-495f-8759-5e8e8b4ea44a admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.463728 Oct 29 02:36:39.443376 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 8/14] 10.222.0.46 () {64 vars in 1283 bytes} [Sat Oct 29 02:36:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 02:36:39.455204 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-c4a27be2-7d50-483b-99ef-b5abfb3f4d57 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:39.482794 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-c4a27be2-7d50-483b-99ef-b5abfb3f4d57 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031308 Oct 29 02:36:39.483394 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 7/15] 10.222.0.46 () {64 vars in 1336 bytes} [Sat Oct 29 02:36:39 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:36:42.197945 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-d9eb879f-a6c5-495f-8759-5e8e8b4ea44a admin admin] Calling method '>' {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:36:42.199540 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-d9eb879f-a6c5-495f-8759-5e8e8b4ea44a admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002056 Oct 29 02:36:42.199934 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 9/16] 10.222.0.46 () {54 vars in 931 bytes} [Sat Oct 29 02:36:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:36:42.668841 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-9e83b02b-51ad-472c-9274-a37d57963aa6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds4G", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "rxtx_factor": 1.0, "disk": 20, "id": "d4", "swap": 0}} {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:42.692931 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-9e83b02b-51ad-472c-9274-a37d57963aa6 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.486787 Oct 29 02:36:42.706007 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-2b444531-6b30-4253-99a9-065a6988bc9c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:42.711351 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 8/17] 10.222.0.46 () {64 vars in 1283 bytes} [Sat Oct 29 02:36:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:36:42.735844 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-2b444531-6b30-4253-99a9-065a6988bc9c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033701 Oct 29 02:36:42.750566 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 10/18] 10.222.0.46 () {64 vars in 1336 bytes} [Sat Oct 29 02:36:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:36:45.367671 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-9e83b02b-51ad-472c-9274-a37d57963aa6 admin admin] Calling method '>' {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:36:45.369070 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-9e83b02b-51ad-472c-9274-a37d57963aa6 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001850 Oct 29 02:36:45.369630 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 9/19] 10.222.0.46 () {54 vars in 931 bytes} [Sat Oct 29 02:36:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:36:45.794977 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-48eae412-3dfb-47f8-a76d-bdf7b30df6bd admin admin] Calling method '>' {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:36:45.819813 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-48eae412-3dfb-47f8-a76d-bdf7b30df6bd admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.444115 Oct 29 02:36:45.820370 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 11/20] 10.222.0.46 () {60 vars in 1292 bytes} [Sat Oct 29 02:36:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:36:48.524445 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-9e83b02b-51ad-472c-9274-a37d57963aa6 admin admin] Calling method '>' {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:36:48.525785 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-9e83b02b-51ad-472c-9274-a37d57963aa6 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001879 Oct 29 02:36:48.526253 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 10/21] 10.222.0.46 () {54 vars in 931 bytes} [Sat Oct 29 02:36:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:36:48.969241 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-6aebf32b-a77a-4b6a-b0ff-f43f76612402 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "1", "name": "m1.tiny", "vcpus": 1, "ram": 512}} {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:48.994149 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-6aebf32b-a77a-4b6a-b0ff-f43f76612402 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.460617 Oct 29 02:36:48.994743 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 12/22] 10.222.0.46 () {64 vars in 1283 bytes} [Sat Oct 29 02:36:48 2022] POST /compute/v2.1/flavors => generated 402 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:36:49.010582 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-9e54f2a7-7335-4a54-9cf3-41c94d3ad85d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:49.047998 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-9e54f2a7-7335-4a54-9cf3-41c94d3ad85d admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042358 Oct 29 02:36:49.048763 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 11/23] 10.222.0.46 () {64 vars in 1333 bytes} [Sat Oct 29 02:36:49 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:36:52.091533 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-6aebf32b-a77a-4b6a-b0ff-f43f76612402 admin admin] Calling method '>' {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:36:52.092700 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-6aebf32b-a77a-4b6a-b0ff-f43f76612402 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001779 Oct 29 02:36:52.093199 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 13/24] 10.222.0.46 () {54 vars in 931 bytes} [Sat Oct 29 02:36:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:36:52.561231 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-4a1f0f98-15e5-4ca3-bf1f-e48277414975 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "vcpus": 1, "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "disk": 20, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:52.583115 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-4a1f0f98-15e5-4ca3-bf1f-e48277414975 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.483011 Oct 29 02:36:52.583688 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 12/25] 10.222.0.46 () {64 vars in 1283 bytes} [Sat Oct 29 02:36:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 02:36:52.595794 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-c4f2644b-5532-48e9-bc12-982b508fa027 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:52.622547 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-c4f2644b-5532-48e9-bc12-982b508fa027 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030333 Oct 29 02:36:52.623286 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 14/26] 10.222.0.46 () {64 vars in 1333 bytes} [Sat Oct 29 02:36:52 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:36:55.392540 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-4a1f0f98-15e5-4ca3-bf1f-e48277414975 admin admin] Calling method '>' {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:36:55.393546 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-4a1f0f98-15e5-4ca3-bf1f-e48277414975 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Oct 29 02:36:55.393941 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 13/27] 10.222.0.46 () {54 vars in 931 bytes} [Sat Oct 29 02:36:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:36:55.767415 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-7cedd3a3-dbc3-40f6-b1fd-69ae2839b3a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 2, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "3", "disk": 40, "swap": 0}} {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:55.788769 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-7cedd3a3-dbc3-40f6-b1fd-69ae2839b3a4 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.388427 Oct 29 02:36:55.789712 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 15/28] 10.222.0.46 () {64 vars in 1283 bytes} [Sat Oct 29 02:36:55 2022] POST /compute/v2.1/flavors => generated 406 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 02:36:55.802266 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-3b411511-864e-4825-9a0a-0aca596327b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:55.807683 n-d-862967-2 devstack@n-api.service[111305]: DEBUG dbcounter [-] [111305] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=111305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:55.831065 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-3b411511-864e-4825-9a0a-0aca596327b9 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032637 Oct 29 02:36:55.831752 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 14/29] 10.222.0.46 () {64 vars in 1333 bytes} [Sat Oct 29 02:36:55 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:36:58.480035 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-7cedd3a3-dbc3-40f6-b1fd-69ae2839b3a4 admin admin] Calling method '>' {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:36:58.481696 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-7cedd3a3-dbc3-40f6-b1fd-69ae2839b3a4 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002117 Oct 29 02:36:58.484669 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 16/30] 10.222.0.46 () {54 vars in 931 bytes} [Sat Oct 29 02:36:58 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:36:58.913296 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-4f5a8abc-1746-4516-a84f-7353697b07c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "4", "name": "m1.large", "ram": 8192, "swap": 0}} {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:58.932479 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-4f5a8abc-1746-4516-a84f-7353697b07c0 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.444225 Oct 29 02:36:58.933046 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 15/31] 10.222.0.46 () {64 vars in 1283 bytes} [Sat Oct 29 02:36:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:36:58.947415 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-f7ea6b7f-7ac5-4069-84c9-d3c898ffd255 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:36:58.971422 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-f7ea6b7f-7ac5-4069-84c9-d3c898ffd255 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027741 Oct 29 02:36:58.972012 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 17/32] 10.222.0.46 () {64 vars in 1333 bytes} [Sat Oct 29 02:36:58 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:37:01.546039 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-4f5a8abc-1746-4516-a84f-7353697b07c0 admin admin] Calling method '>' {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:01.547048 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-4f5a8abc-1746-4516-a84f-7353697b07c0 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Oct 29 02:37:01.547653 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 16/33] 10.222.0.46 () {54 vars in 931 bytes} [Sat Oct 29 02:37:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:37:01.968407 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-9cb8d622-5896-4927-a8d2-8e5ba10c7bd5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "swap": 0, "vcpus": 8, "id": "5", "disk": 160}} {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:37:01.975212 n-d-862967-2 devstack@n-api.service[111304]: DEBUG dbcounter [-] [111304] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=111304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:01.990321 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-9cb8d622-5896-4927-a8d2-8e5ba10c7bd5 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.436473 Oct 29 02:37:01.991190 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 18/34] 10.222.0.46 () {64 vars in 1283 bytes} [Sat Oct 29 02:37:01 2022] POST /compute/v2.1/flavors => generated 408 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:37:02.003563 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-f2801021-fcb8-4fbd-b438-bbae33c4a5a5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:37:02.030734 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-f2801021-fcb8-4fbd-b438-bbae33c4a5a5 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030827 Oct 29 02:37:02.031446 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 17/35] 10.222.0.46 () {64 vars in 1333 bytes} [Sat Oct 29 02:37:01 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:37:24.448244 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-9cb8d622-5896-4927-a8d2-8e5ba10c7bd5 admin admin] Calling method '>' {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:24.449884 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-9cb8d622-5896-4927-a8d2-8e5ba10c7bd5 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002286 Oct 29 02:37:24.450557 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 19/36] 10.222.0.46 () {54 vars in 931 bytes} [Sat Oct 29 02:37:24 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:37:24.464610 n-d-862967-2 devstack@n-api.service[111305]: DEBUG dbcounter [-] [111305] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=111305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:24.886012 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-de162127-aacb-4b2f-8910-2932a0ffcde5 admin admin] Calling method '>' {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:24.904179 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-de162127-aacb-4b2f-8910-2932a0ffcde5 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.444090 Oct 29 02:37:24.904741 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 18/37] 10.222.0.46 () {60 vars in 1292 bytes} [Sat Oct 29 02:37:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:37:26.215450 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-9cb8d622-5896-4927-a8d2-8e5ba10c7bd5 admin admin] Calling method '>' {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:26.216448 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-9cb8d622-5896-4927-a8d2-8e5ba10c7bd5 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Oct 29 02:37:26.216875 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 20/38] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Oct 29 02:37:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:37:26.787655 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-4a4d33bd-9b5b-44a0-8af6-91dedc14e8ed admin admin] Calling method '>' {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:26.793201 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.wsgi [None req-4a4d33bd-9b5b-44a0-8af6-91dedc14e8ed admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 29 02:37:26.796474 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-4a4d33bd-9b5b-44a0-8af6-91dedc14e8ed admin admin] Request method failure captured: Oct 29 02:37:26.796474 n-d-862967-2 devstack@n-api.service[111305]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 29 02:37:26.796474 n-d-862967-2 devstack@n-api.service[111305]: Accept: application/json Oct 29 02:37:26.796474 n-d-862967-2 devstack@n-api.service[111305]: Accept-Encoding: gzip, deflate Oct 29 02:37:26.796474 n-d-862967-2 devstack@n-api.service[111305]: Connection: keep-alive Oct 29 02:37:26.796474 n-d-862967-2 devstack@n-api.service[111305]: Content-Length: 0 Oct 29 02:37:26.796474 n-d-862967-2 devstack@n-api.service[111305]: Host: 10.222.0.46 Oct 29 02:37:26.796474 n-d-862967-2 devstack@n-api.service[111305]: Openstack-Api-Version: compute 2.92 Oct 29 02:37:26.796474 n-d-862967-2 devstack@n-api.service[111305]: Openstack-System-Scope: None Oct 29 02:37:26.796474 n-d-862967-2 devstack@n-api.service[111305]: User-Agent: python-novaclient Oct 29 02:37:26.796474 n-d-862967-2 devstack@n-api.service[111305]: X-Auth-Token: gAAAAABjXJHmBKiPHuthbBEJDY0YrTLjB8ot9DXMEV-N-WiqkHJc8wb-ajkEK5r0KOqi0mLjXj7Vtf370UuJp3WNRgwLr5GzM-txGBc1KXsv5gowQTVq5jXOJA56gB-1hAO3zuQmNc8v2FnN5X2EwTMT90tiigBjiHrgMafhBLtCcY0Wuoej9uc Oct 29 02:37:26.796474 n-d-862967-2 devstack@n-api.service[111305]: X-Domain-Id: None Oct 29 02:37:26.796474 n-d-862967-2 devstack@n-api.service[111305]: X-Domain-Name: None Oct 29 02:37:26.796474 n-d-862967-2 devstack@n-api.service[111305]: X-Identity-Status: Confirmed Oct 29 02:37:26.796474 n-d-862967-2 devstack@n-api.service[111305]: X-Is-Admin-Project: True Oct 29 02:37:26.796474 n-d-862967-2 devstack@n-api.service[111305]: X-Openstack-Nova-Api-Version: 2.92 Oct 29 02:37:26.796474 n-d-862967-2 devstack@n-api.service[111305]: X-Project-Domain-Id: default Oct 29 02:37:26.796474 n-d-862967-2 devstack@n-api.service[111305]: X-Project-Domain-Name: Default Oct 29 02:37:26.796474 n-d-862967-2 devstack@n-api.service[111305]: X-Project-Id: 7cca6f477293404e8f5e065633b5e81b Oct 29 02:37:26.796474 n-d-862967-2 devstack@n-api.service[111305]: X-Project-Name: admin Oct 29 02:37:26.796474 n-d-862967-2 devstack@n-api.service[111305]: X-Role: admin,reader,member Oct 29 02:37:26.796474 n-d-862967-2 devstack@n-api.service[111305]: X-Roles: admin,reader,member Oct 29 02:37:26.798113 n-d-862967-2 devstack@n-api.service[111305]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca6f477293404e8f5e065633b5e81b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca6f477293404e8f5e065633b5e81b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7cca6f477293404e8f5e065633b5e81b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7cca6f477293404e8f5e065633b5e81b"}]}] Oct 29 02:37:26.798113 n-d-862967-2 devstack@n-api.service[111305]: X-Tenant: admin Oct 29 02:37:26.798113 n-d-862967-2 devstack@n-api.service[111305]: X-Tenant-Id: 7cca6f477293404e8f5e065633b5e81b Oct 29 02:37:26.798113 n-d-862967-2 devstack@n-api.service[111305]: X-Tenant-Name: admin Oct 29 02:37:26.798113 n-d-862967-2 devstack@n-api.service[111305]: X-User: admin Oct 29 02:37:26.798113 n-d-862967-2 devstack@n-api.service[111305]: X-User-Domain-Id: default Oct 29 02:37:26.798113 n-d-862967-2 devstack@n-api.service[111305]: X-User-Domain-Name: Default Oct 29 02:37:26.798113 n-d-862967-2 devstack@n-api.service[111305]: X-User-Id: 11050229edd44999974e424bdd1866fa Oct 29 02:37:26.798113 n-d-862967-2 devstack@n-api.service[111305]: X-User-Name: admin Oct 29 02:37:26.798113 n-d-862967-2 devstack@n-api.service[111305]: method: > Oct 29 02:37:26.798113 n-d-862967-2 devstack@n-api.service[111305]: exception: Flavor 42 could not be found. Oct 29 02:37:26.798113 n-d-862967-2 devstack@n-api.service[111305]: action_args: {'id': '42'} Oct 29 02:37:26.798113 n-d-862967-2 devstack@n-api.service[111305]: {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:37:26.798113 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:26.799055 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 29 02:37:26.799055 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 29 02:37:26.799055 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 02:37:26.799055 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 02:37:26.799055 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:37:26.799055 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:37:26.799055 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 02:37:26.799055 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 02:37:26.799055 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 02:37:26.799055 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:37:26.799055 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 02:37:26.799055 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 02:37:26.799055 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 29 02:37:26.799055 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi Oct 29 02:37:26.799055 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:37:26.799055 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi Oct 29 02:37:26.799055 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:26.799055 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:37:26.799055 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:37:26.800361 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:37:26.800361 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:37:26.800361 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:37:26.800361 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:37:26.800361 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 29 02:37:26.800361 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:37:26.800361 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 29 02:37:26.800361 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi Oct 29 02:37:26.800361 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:37:26.800361 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi Oct 29 02:37:26.800361 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:26.800361 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:37:26.800361 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:37:26.800361 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:37:26.800361 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:37:26.800361 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 29 02:37:26.800361 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi Oct 29 02:37:26.800361 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-4a4d33bd-9b5b-44a0-8af6-91dedc14e8ed admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:37:26.801648 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-4a4d33bd-9b5b-44a0-8af6-91dedc14e8ed admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.417030 Oct 29 02:37:26.801648 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 19/39] 10.222.0.46 () {60 vars in 1190 bytes} [Sat Oct 29 02:37:26 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 418 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 02:37:26.811167 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-df8d4bbd-6845-4c50-a376-851cc60482f3 admin admin] Calling method '>' {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:26.834095 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-df8d4bbd-6845-4c50-a376-851cc60482f3 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028997 Oct 29 02:37:26.834647 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 21/40] 10.222.0.46 () {60 vars in 1210 bytes} [Sat Oct 29 02:37:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:37:26.853713 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-6ccc021a-f6f5-4aaf-8903-9ef8f78ebc8e admin admin] Calling method '>' {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:26.882755 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-6ccc021a-f6f5-4aaf-8903-9ef8f78ebc8e admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.036379 Oct 29 02:37:26.883284 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 20/41] 10.222.0.46 () {60 vars in 1210 bytes} [Sat Oct 29 02:37:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:37:26.892985 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-108e3d1e-1677-4a39-ac0e-ededc127f5a4 admin admin] Calling method '>' {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:26.898447 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.wsgi [None req-108e3d1e-1677-4a39-ac0e-ededc127f5a4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 29 02:37:26.901807 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-108e3d1e-1677-4a39-ac0e-ededc127f5a4 admin admin] Request method failure captured: Oct 29 02:37:26.901807 n-d-862967-2 devstack@n-api.service[111304]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 29 02:37:26.901807 n-d-862967-2 devstack@n-api.service[111304]: Accept: application/json Oct 29 02:37:26.901807 n-d-862967-2 devstack@n-api.service[111304]: Accept-Encoding: gzip, deflate Oct 29 02:37:26.901807 n-d-862967-2 devstack@n-api.service[111304]: Connection: keep-alive Oct 29 02:37:26.901807 n-d-862967-2 devstack@n-api.service[111304]: Content-Length: 0 Oct 29 02:37:26.901807 n-d-862967-2 devstack@n-api.service[111304]: Host: 10.222.0.46 Oct 29 02:37:26.901807 n-d-862967-2 devstack@n-api.service[111304]: Openstack-Api-Version: compute 2.92 Oct 29 02:37:26.901807 n-d-862967-2 devstack@n-api.service[111304]: Openstack-System-Scope: None Oct 29 02:37:26.901807 n-d-862967-2 devstack@n-api.service[111304]: User-Agent: python-novaclient Oct 29 02:37:26.901807 n-d-862967-2 devstack@n-api.service[111304]: X-Auth-Token: gAAAAABjXJHmBKiPHuthbBEJDY0YrTLjB8ot9DXMEV-N-WiqkHJc8wb-ajkEK5r0KOqi0mLjXj7Vtf370UuJp3WNRgwLr5GzM-txGBc1KXsv5gowQTVq5jXOJA56gB-1hAO3zuQmNc8v2FnN5X2EwTMT90tiigBjiHrgMafhBLtCcY0Wuoej9uc Oct 29 02:37:26.901807 n-d-862967-2 devstack@n-api.service[111304]: X-Domain-Id: None Oct 29 02:37:26.901807 n-d-862967-2 devstack@n-api.service[111304]: X-Domain-Name: None Oct 29 02:37:26.901807 n-d-862967-2 devstack@n-api.service[111304]: X-Identity-Status: Confirmed Oct 29 02:37:26.901807 n-d-862967-2 devstack@n-api.service[111304]: X-Is-Admin-Project: True Oct 29 02:37:26.901807 n-d-862967-2 devstack@n-api.service[111304]: X-Openstack-Nova-Api-Version: 2.92 Oct 29 02:37:26.901807 n-d-862967-2 devstack@n-api.service[111304]: X-Project-Domain-Id: default Oct 29 02:37:26.901807 n-d-862967-2 devstack@n-api.service[111304]: X-Project-Domain-Name: Default Oct 29 02:37:26.901807 n-d-862967-2 devstack@n-api.service[111304]: X-Project-Id: 7cca6f477293404e8f5e065633b5e81b Oct 29 02:37:26.901807 n-d-862967-2 devstack@n-api.service[111304]: X-Project-Name: admin Oct 29 02:37:26.901807 n-d-862967-2 devstack@n-api.service[111304]: X-Role: admin,reader,member Oct 29 02:37:26.901807 n-d-862967-2 devstack@n-api.service[111304]: X-Roles: admin,reader,member Oct 29 02:37:26.903400 n-d-862967-2 devstack@n-api.service[111304]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca6f477293404e8f5e065633b5e81b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca6f477293404e8f5e065633b5e81b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7cca6f477293404e8f5e065633b5e81b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7cca6f477293404e8f5e065633b5e81b"}]}] Oct 29 02:37:26.903400 n-d-862967-2 devstack@n-api.service[111304]: X-Tenant: admin Oct 29 02:37:26.903400 n-d-862967-2 devstack@n-api.service[111304]: X-Tenant-Id: 7cca6f477293404e8f5e065633b5e81b Oct 29 02:37:26.903400 n-d-862967-2 devstack@n-api.service[111304]: X-Tenant-Name: admin Oct 29 02:37:26.903400 n-d-862967-2 devstack@n-api.service[111304]: X-User: admin Oct 29 02:37:26.903400 n-d-862967-2 devstack@n-api.service[111304]: X-User-Domain-Id: default Oct 29 02:37:26.903400 n-d-862967-2 devstack@n-api.service[111304]: X-User-Domain-Name: Default Oct 29 02:37:26.903400 n-d-862967-2 devstack@n-api.service[111304]: X-User-Id: 11050229edd44999974e424bdd1866fa Oct 29 02:37:26.903400 n-d-862967-2 devstack@n-api.service[111304]: X-User-Name: admin Oct 29 02:37:26.903400 n-d-862967-2 devstack@n-api.service[111304]: method: > Oct 29 02:37:26.903400 n-d-862967-2 devstack@n-api.service[111304]: exception: Flavor 42 could not be found. Oct 29 02:37:26.903400 n-d-862967-2 devstack@n-api.service[111304]: action_args: {'id': '42'} Oct 29 02:37:26.903400 n-d-862967-2 devstack@n-api.service[111304]: {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:37:26.903400 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:26.904345 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 29 02:37:26.904345 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 29 02:37:26.904345 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 02:37:26.904345 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 02:37:26.904345 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:37:26.904345 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:37:26.904345 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 02:37:26.904345 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 02:37:26.904345 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 02:37:26.904345 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:37:26.904345 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 02:37:26.904345 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 02:37:26.904345 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 29 02:37:26.904345 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi Oct 29 02:37:26.904345 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:37:26.904345 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi Oct 29 02:37:26.904345 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:26.904345 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:37:26.904345 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:37:26.905697 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:37:26.905697 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:37:26.905697 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:37:26.905697 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:37:26.905697 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 29 02:37:26.905697 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:37:26.905697 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 29 02:37:26.905697 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi Oct 29 02:37:26.905697 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:37:26.905697 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi Oct 29 02:37:26.905697 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:26.905697 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:37:26.905697 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:37:26.905697 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:37:26.905697 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:37:26.905697 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 29 02:37:26.905697 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi Oct 29 02:37:26.905697 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-108e3d1e-1677-4a39-ac0e-ededc127f5a4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:37:26.906926 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-108e3d1e-1677-4a39-ac0e-ededc127f5a4 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013778 Oct 29 02:37:26.906926 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 22/42] 10.222.0.46 () {60 vars in 1190 bytes} [Sat Oct 29 02:37:26 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 29 02:37:28.137632 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-6ccc021a-f6f5-4aaf-8903-9ef8f78ebc8e admin admin] Calling method '>' {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:28.138636 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-6ccc021a-f6f5-4aaf-8903-9ef8f78ebc8e admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Oct 29 02:37:28.139057 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 21/43] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Oct 29 02:37:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:37:28.678655 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-303c46e5-ef73-4277-801d-691e5cce8266 admin admin] Calling method '>' {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:28.683953 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.wsgi [None req-303c46e5-ef73-4277-801d-691e5cce8266 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 29 02:37:28.685482 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-303c46e5-ef73-4277-801d-691e5cce8266 admin admin] Request method failure captured: Oct 29 02:37:28.685482 n-d-862967-2 devstack@n-api.service[111304]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 29 02:37:28.685482 n-d-862967-2 devstack@n-api.service[111304]: Accept: application/json Oct 29 02:37:28.685482 n-d-862967-2 devstack@n-api.service[111304]: Accept-Encoding: gzip, deflate Oct 29 02:37:28.685482 n-d-862967-2 devstack@n-api.service[111304]: Connection: keep-alive Oct 29 02:37:28.685482 n-d-862967-2 devstack@n-api.service[111304]: Content-Length: 0 Oct 29 02:37:28.685482 n-d-862967-2 devstack@n-api.service[111304]: Host: 10.222.0.46 Oct 29 02:37:28.685482 n-d-862967-2 devstack@n-api.service[111304]: Openstack-Api-Version: compute 2.92 Oct 29 02:37:28.685482 n-d-862967-2 devstack@n-api.service[111304]: Openstack-System-Scope: None Oct 29 02:37:28.685482 n-d-862967-2 devstack@n-api.service[111304]: User-Agent: python-novaclient Oct 29 02:37:28.685482 n-d-862967-2 devstack@n-api.service[111304]: X-Auth-Token: gAAAAABjXJHo5eLgGfqvO2IeyvDWlClKfqjJSBYCwfF9I_4WkF6HON7pAH4WXW43E_338I-Tfs2EZdXsTpsq7VNSwocSVSm_pSce64PzednT6CHgEyglvx8mH5bPt2rcP25lLS3lgwcm9ModxPByGwRvUYNNA0K306ewOokrwkFNB0laLea5F7k Oct 29 02:37:28.685482 n-d-862967-2 devstack@n-api.service[111304]: X-Domain-Id: None Oct 29 02:37:28.685482 n-d-862967-2 devstack@n-api.service[111304]: X-Domain-Name: None Oct 29 02:37:28.685482 n-d-862967-2 devstack@n-api.service[111304]: X-Identity-Status: Confirmed Oct 29 02:37:28.685482 n-d-862967-2 devstack@n-api.service[111304]: X-Is-Admin-Project: True Oct 29 02:37:28.685482 n-d-862967-2 devstack@n-api.service[111304]: X-Openstack-Nova-Api-Version: 2.92 Oct 29 02:37:28.685482 n-d-862967-2 devstack@n-api.service[111304]: X-Project-Domain-Id: default Oct 29 02:37:28.685482 n-d-862967-2 devstack@n-api.service[111304]: X-Project-Domain-Name: Default Oct 29 02:37:28.685482 n-d-862967-2 devstack@n-api.service[111304]: X-Project-Id: 7cca6f477293404e8f5e065633b5e81b Oct 29 02:37:28.685482 n-d-862967-2 devstack@n-api.service[111304]: X-Project-Name: admin Oct 29 02:37:28.685482 n-d-862967-2 devstack@n-api.service[111304]: X-Role: admin,reader,member Oct 29 02:37:28.685482 n-d-862967-2 devstack@n-api.service[111304]: X-Roles: admin,reader,member Oct 29 02:37:28.687010 n-d-862967-2 devstack@n-api.service[111304]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca6f477293404e8f5e065633b5e81b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca6f477293404e8f5e065633b5e81b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7cca6f477293404e8f5e065633b5e81b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7cca6f477293404e8f5e065633b5e81b"}]}] Oct 29 02:37:28.687010 n-d-862967-2 devstack@n-api.service[111304]: X-Tenant: admin Oct 29 02:37:28.687010 n-d-862967-2 devstack@n-api.service[111304]: X-Tenant-Id: 7cca6f477293404e8f5e065633b5e81b Oct 29 02:37:28.687010 n-d-862967-2 devstack@n-api.service[111304]: X-Tenant-Name: admin Oct 29 02:37:28.687010 n-d-862967-2 devstack@n-api.service[111304]: X-User: admin Oct 29 02:37:28.687010 n-d-862967-2 devstack@n-api.service[111304]: X-User-Domain-Id: default Oct 29 02:37:28.687010 n-d-862967-2 devstack@n-api.service[111304]: X-User-Domain-Name: Default Oct 29 02:37:28.687010 n-d-862967-2 devstack@n-api.service[111304]: X-User-Id: 11050229edd44999974e424bdd1866fa Oct 29 02:37:28.687010 n-d-862967-2 devstack@n-api.service[111304]: X-User-Name: admin Oct 29 02:37:28.687010 n-d-862967-2 devstack@n-api.service[111304]: method: > Oct 29 02:37:28.687010 n-d-862967-2 devstack@n-api.service[111304]: exception: Flavor 84 could not be found. Oct 29 02:37:28.687010 n-d-862967-2 devstack@n-api.service[111304]: action_args: {'id': '84'} Oct 29 02:37:28.687010 n-d-862967-2 devstack@n-api.service[111304]: {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:37:28.687010 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:28.687932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 29 02:37:28.687932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 29 02:37:28.687932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 02:37:28.687932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 02:37:28.687932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:37:28.687932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:37:28.687932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 02:37:28.687932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 02:37:28.687932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 02:37:28.687932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:37:28.687932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 02:37:28.687932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 02:37:28.687932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 29 02:37:28.687932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi Oct 29 02:37:28.687932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:37:28.687932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi Oct 29 02:37:28.687932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:28.687932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:37:28.687932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:37:28.689337 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:37:28.689337 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:37:28.689337 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:37:28.689337 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:37:28.689337 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 29 02:37:28.689337 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:37:28.689337 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 29 02:37:28.689337 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi Oct 29 02:37:28.689337 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:37:28.689337 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi Oct 29 02:37:28.689337 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:28.689337 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:37:28.689337 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:37:28.689337 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:37:28.689337 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:37:28.689337 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 29 02:37:28.689337 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi Oct 29 02:37:28.689337 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-303c46e5-ef73-4277-801d-691e5cce8266 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:37:28.690593 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-303c46e5-ef73-4277-801d-691e5cce8266 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.412647 Oct 29 02:37:28.690593 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 23/44] 10.222.0.46 () {60 vars in 1190 bytes} [Sat Oct 29 02:37:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 414 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 02:37:28.699430 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-2d3e4dc5-bc96-401d-85a8-9a5e694312e5 admin admin] Calling method '>' {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:28.715554 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-2d3e4dc5-bc96-401d-85a8-9a5e694312e5 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021790 Oct 29 02:37:28.716098 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 22/45] 10.222.0.46 () {60 vars in 1210 bytes} [Sat Oct 29 02:37:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:37:28.725593 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-a5d1c6c5-3a35-4835-85b1-36341df05606 admin admin] Calling method '>' {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:28.741432 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-a5d1c6c5-3a35-4835-85b1-36341df05606 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019380 Oct 29 02:37:28.741959 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1210 bytes} [Sat Oct 29 02:37:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:37:28.751342 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-fafa9545-0091-46e8-9bd6-75347d1899cb admin admin] Calling method '>' {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:28.756811 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.wsgi [None req-fafa9545-0091-46e8-9bd6-75347d1899cb admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 29 02:37:28.758317 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-fafa9545-0091-46e8-9bd6-75347d1899cb admin admin] Request method failure captured: Oct 29 02:37:28.758317 n-d-862967-2 devstack@n-api.service[111305]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 29 02:37:28.758317 n-d-862967-2 devstack@n-api.service[111305]: Accept: application/json Oct 29 02:37:28.758317 n-d-862967-2 devstack@n-api.service[111305]: Accept-Encoding: gzip, deflate Oct 29 02:37:28.758317 n-d-862967-2 devstack@n-api.service[111305]: Connection: keep-alive Oct 29 02:37:28.758317 n-d-862967-2 devstack@n-api.service[111305]: Content-Length: 0 Oct 29 02:37:28.758317 n-d-862967-2 devstack@n-api.service[111305]: Host: 10.222.0.46 Oct 29 02:37:28.758317 n-d-862967-2 devstack@n-api.service[111305]: Openstack-Api-Version: compute 2.92 Oct 29 02:37:28.758317 n-d-862967-2 devstack@n-api.service[111305]: Openstack-System-Scope: None Oct 29 02:37:28.758317 n-d-862967-2 devstack@n-api.service[111305]: User-Agent: python-novaclient Oct 29 02:37:28.758317 n-d-862967-2 devstack@n-api.service[111305]: X-Auth-Token: gAAAAABjXJHo5eLgGfqvO2IeyvDWlClKfqjJSBYCwfF9I_4WkF6HON7pAH4WXW43E_338I-Tfs2EZdXsTpsq7VNSwocSVSm_pSce64PzednT6CHgEyglvx8mH5bPt2rcP25lLS3lgwcm9ModxPByGwRvUYNNA0K306ewOokrwkFNB0laLea5F7k Oct 29 02:37:28.758317 n-d-862967-2 devstack@n-api.service[111305]: X-Domain-Id: None Oct 29 02:37:28.758317 n-d-862967-2 devstack@n-api.service[111305]: X-Domain-Name: None Oct 29 02:37:28.758317 n-d-862967-2 devstack@n-api.service[111305]: X-Identity-Status: Confirmed Oct 29 02:37:28.758317 n-d-862967-2 devstack@n-api.service[111305]: X-Is-Admin-Project: True Oct 29 02:37:28.758317 n-d-862967-2 devstack@n-api.service[111305]: X-Openstack-Nova-Api-Version: 2.92 Oct 29 02:37:28.758317 n-d-862967-2 devstack@n-api.service[111305]: X-Project-Domain-Id: default Oct 29 02:37:28.758317 n-d-862967-2 devstack@n-api.service[111305]: X-Project-Domain-Name: Default Oct 29 02:37:28.758317 n-d-862967-2 devstack@n-api.service[111305]: X-Project-Id: 7cca6f477293404e8f5e065633b5e81b Oct 29 02:37:28.758317 n-d-862967-2 devstack@n-api.service[111305]: X-Project-Name: admin Oct 29 02:37:28.758317 n-d-862967-2 devstack@n-api.service[111305]: X-Role: admin,reader,member Oct 29 02:37:28.758317 n-d-862967-2 devstack@n-api.service[111305]: X-Roles: admin,reader,member Oct 29 02:37:28.759713 n-d-862967-2 devstack@n-api.service[111305]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca6f477293404e8f5e065633b5e81b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca6f477293404e8f5e065633b5e81b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7cca6f477293404e8f5e065633b5e81b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7cca6f477293404e8f5e065633b5e81b"}]}] Oct 29 02:37:28.759713 n-d-862967-2 devstack@n-api.service[111305]: X-Tenant: admin Oct 29 02:37:28.759713 n-d-862967-2 devstack@n-api.service[111305]: X-Tenant-Id: 7cca6f477293404e8f5e065633b5e81b Oct 29 02:37:28.759713 n-d-862967-2 devstack@n-api.service[111305]: X-Tenant-Name: admin Oct 29 02:37:28.759713 n-d-862967-2 devstack@n-api.service[111305]: X-User: admin Oct 29 02:37:28.759713 n-d-862967-2 devstack@n-api.service[111305]: X-User-Domain-Id: default Oct 29 02:37:28.759713 n-d-862967-2 devstack@n-api.service[111305]: X-User-Domain-Name: Default Oct 29 02:37:28.759713 n-d-862967-2 devstack@n-api.service[111305]: X-User-Id: 11050229edd44999974e424bdd1866fa Oct 29 02:37:28.759713 n-d-862967-2 devstack@n-api.service[111305]: X-User-Name: admin Oct 29 02:37:28.759713 n-d-862967-2 devstack@n-api.service[111305]: method: > Oct 29 02:37:28.759713 n-d-862967-2 devstack@n-api.service[111305]: exception: Flavor 84 could not be found. Oct 29 02:37:28.759713 n-d-862967-2 devstack@n-api.service[111305]: action_args: {'id': '84'} Oct 29 02:37:28.759713 n-d-862967-2 devstack@n-api.service[111305]: {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:37:28.759713 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:28.761378 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 29 02:37:28.761378 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 29 02:37:28.761378 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 02:37:28.761378 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 02:37:28.761378 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:37:28.761378 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:37:28.761378 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 02:37:28.761378 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 02:37:28.761378 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 02:37:28.761378 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:37:28.761378 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 02:37:28.761378 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 02:37:28.761378 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 29 02:37:28.761378 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi Oct 29 02:37:28.761378 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:37:28.761378 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi Oct 29 02:37:28.761378 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:28.761378 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:37:28.761378 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:37:28.762730 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:37:28.762730 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:37:28.762730 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:37:28.762730 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:37:28.762730 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 29 02:37:28.762730 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:37:28.762730 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 29 02:37:28.762730 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi Oct 29 02:37:28.762730 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:37:28.762730 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi Oct 29 02:37:28.762730 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:28.762730 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:37:28.762730 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:37:28.762730 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:37:28.762730 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:37:28.762730 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 29 02:37:28.762730 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi Oct 29 02:37:28.762730 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-fafa9545-0091-46e8-9bd6-75347d1899cb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:37:28.763954 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-fafa9545-0091-46e8-9bd6-75347d1899cb admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011973 Oct 29 02:37:28.763954 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 23/47] 10.222.0.46 () {60 vars in 1190 bytes} [Sat Oct 29 02:37:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 02:37:29.984598 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-a5d1c6c5-3a35-4835-85b1-36341df05606 admin admin] Calling method '>' {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:29.985588 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-a5d1c6c5-3a35-4835-85b1-36341df05606 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 29 02:37:29.985962 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 25/48] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Oct 29 02:37:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:37:30.551177 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-fec91484-5884-470a-810a-fc81245713b9 admin admin] Calling method '>' {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:30.559611 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.wsgi [None req-fec91484-5884-470a-810a-fc81245713b9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 29 02:37:30.561521 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-fec91484-5884-470a-810a-fc81245713b9 admin admin] Request method failure captured: Oct 29 02:37:30.561521 n-d-862967-2 devstack@n-api.service[111305]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 29 02:37:30.561521 n-d-862967-2 devstack@n-api.service[111305]: Accept: application/json Oct 29 02:37:30.561521 n-d-862967-2 devstack@n-api.service[111305]: Accept-Encoding: gzip, deflate Oct 29 02:37:30.561521 n-d-862967-2 devstack@n-api.service[111305]: Connection: keep-alive Oct 29 02:37:30.561521 n-d-862967-2 devstack@n-api.service[111305]: Content-Length: 0 Oct 29 02:37:30.561521 n-d-862967-2 devstack@n-api.service[111305]: Host: 10.222.0.46 Oct 29 02:37:30.561521 n-d-862967-2 devstack@n-api.service[111305]: Openstack-Api-Version: compute 2.92 Oct 29 02:37:30.561521 n-d-862967-2 devstack@n-api.service[111305]: Openstack-System-Scope: None Oct 29 02:37:30.561521 n-d-862967-2 devstack@n-api.service[111305]: User-Agent: python-novaclient Oct 29 02:37:30.561521 n-d-862967-2 devstack@n-api.service[111305]: X-Auth-Token: gAAAAABjXJHp7Syc6gYl-kqk8seaxxH2EQx2D3mJBvMzGzpAzReSSUu1hSrQT2LI6m1AxWKXz_XWh55EMWP2Rc5-u6NhaIWReage06CZKHvAyWBv6XgCzQvPGTkjYxzyLVBRUotjNYaOgcsGflKSPkNEOwYFuWtxYnRlY4i6woAi9Hkm9ZPF01Y Oct 29 02:37:30.561521 n-d-862967-2 devstack@n-api.service[111305]: X-Domain-Id: None Oct 29 02:37:30.561521 n-d-862967-2 devstack@n-api.service[111305]: X-Domain-Name: None Oct 29 02:37:30.561521 n-d-862967-2 devstack@n-api.service[111305]: X-Identity-Status: Confirmed Oct 29 02:37:30.561521 n-d-862967-2 devstack@n-api.service[111305]: X-Is-Admin-Project: True Oct 29 02:37:30.561521 n-d-862967-2 devstack@n-api.service[111305]: X-Openstack-Nova-Api-Version: 2.92 Oct 29 02:37:30.561521 n-d-862967-2 devstack@n-api.service[111305]: X-Project-Domain-Id: default Oct 29 02:37:30.561521 n-d-862967-2 devstack@n-api.service[111305]: X-Project-Domain-Name: Default Oct 29 02:37:30.561521 n-d-862967-2 devstack@n-api.service[111305]: X-Project-Id: 7cca6f477293404e8f5e065633b5e81b Oct 29 02:37:30.561521 n-d-862967-2 devstack@n-api.service[111305]: X-Project-Name: admin Oct 29 02:37:30.561521 n-d-862967-2 devstack@n-api.service[111305]: X-Role: admin,reader,member Oct 29 02:37:30.561521 n-d-862967-2 devstack@n-api.service[111305]: X-Roles: admin,reader,member Oct 29 02:37:30.563137 n-d-862967-2 devstack@n-api.service[111305]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca6f477293404e8f5e065633b5e81b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca6f477293404e8f5e065633b5e81b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7cca6f477293404e8f5e065633b5e81b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7cca6f477293404e8f5e065633b5e81b"}]}] Oct 29 02:37:30.563137 n-d-862967-2 devstack@n-api.service[111305]: X-Tenant: admin Oct 29 02:37:30.563137 n-d-862967-2 devstack@n-api.service[111305]: X-Tenant-Id: 7cca6f477293404e8f5e065633b5e81b Oct 29 02:37:30.563137 n-d-862967-2 devstack@n-api.service[111305]: X-Tenant-Name: admin Oct 29 02:37:30.563137 n-d-862967-2 devstack@n-api.service[111305]: X-User: admin Oct 29 02:37:30.563137 n-d-862967-2 devstack@n-api.service[111305]: X-User-Domain-Id: default Oct 29 02:37:30.563137 n-d-862967-2 devstack@n-api.service[111305]: X-User-Domain-Name: Default Oct 29 02:37:30.563137 n-d-862967-2 devstack@n-api.service[111305]: X-User-Id: 11050229edd44999974e424bdd1866fa Oct 29 02:37:30.563137 n-d-862967-2 devstack@n-api.service[111305]: X-User-Name: admin Oct 29 02:37:30.563137 n-d-862967-2 devstack@n-api.service[111305]: method: > Oct 29 02:37:30.563137 n-d-862967-2 devstack@n-api.service[111305]: exception: Flavor 451 could not be found. Oct 29 02:37:30.563137 n-d-862967-2 devstack@n-api.service[111305]: action_args: {'id': '451'} Oct 29 02:37:30.563137 n-d-862967-2 devstack@n-api.service[111305]: {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:37:30.563137 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:30.564289 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 29 02:37:30.564289 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 29 02:37:30.564289 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 02:37:30.564289 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 02:37:30.564289 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:37:30.564289 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:37:30.564289 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 02:37:30.564289 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 02:37:30.564289 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 02:37:30.564289 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:37:30.564289 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 02:37:30.564289 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 02:37:30.564289 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 29 02:37:30.564289 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi Oct 29 02:37:30.564289 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:37:30.564289 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi Oct 29 02:37:30.564289 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:30.564289 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:37:30.564289 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:37:30.565750 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:37:30.565750 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:37:30.565750 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:37:30.565750 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:37:30.565750 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 29 02:37:30.565750 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:37:30.565750 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 29 02:37:30.565750 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi Oct 29 02:37:30.565750 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:37:30.565750 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi Oct 29 02:37:30.565750 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:30.565750 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:37:30.565750 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:37:30.565750 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:37:30.565750 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:37:30.565750 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 29 02:37:30.565750 n-d-862967-2 devstack@n-api.service[111305]: ERROR nova.api.openstack.wsgi Oct 29 02:37:30.565750 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-fec91484-5884-470a-810a-fc81245713b9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:37:30.566997 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-fec91484-5884-470a-810a-fc81245713b9 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.441509 Oct 29 02:37:30.566997 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 24/49] 10.222.0.46 () {60 vars in 1193 bytes} [Sat Oct 29 02:37:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 443 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 02:37:30.574035 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-bc6a98b2-7e35-444c-9a52-80c285bd6160 admin admin] Calling method '>' {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:30.589236 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-bc6a98b2-7e35-444c-9a52-80c285bd6160 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019580 Oct 29 02:37:30.589744 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 26/50] 10.222.0.46 () {60 vars in 1210 bytes} [Sat Oct 29 02:37:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:37:30.599211 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-8588e534-7cd1-45f1-acb1-c742061cf5e7 admin admin] Calling method '>' {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:30.614641 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-8588e534-7cd1-45f1-acb1-c742061cf5e7 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018880 Oct 29 02:37:30.615194 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 25/51] 10.222.0.46 () {60 vars in 1210 bytes} [Sat Oct 29 02:37:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:37:30.624436 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-7fa8d784-c81d-44ee-909d-ad741c6279e8 admin admin] Calling method '>' {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:30.629569 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.wsgi [None req-7fa8d784-c81d-44ee-909d-ad741c6279e8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 29 02:37:30.631064 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-7fa8d784-c81d-44ee-909d-ad741c6279e8 admin admin] Request method failure captured: Oct 29 02:37:30.631064 n-d-862967-2 devstack@n-api.service[111304]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 29 02:37:30.631064 n-d-862967-2 devstack@n-api.service[111304]: Accept: application/json Oct 29 02:37:30.631064 n-d-862967-2 devstack@n-api.service[111304]: Accept-Encoding: gzip, deflate Oct 29 02:37:30.631064 n-d-862967-2 devstack@n-api.service[111304]: Connection: keep-alive Oct 29 02:37:30.631064 n-d-862967-2 devstack@n-api.service[111304]: Content-Length: 0 Oct 29 02:37:30.631064 n-d-862967-2 devstack@n-api.service[111304]: Host: 10.222.0.46 Oct 29 02:37:30.631064 n-d-862967-2 devstack@n-api.service[111304]: Openstack-Api-Version: compute 2.92 Oct 29 02:37:30.631064 n-d-862967-2 devstack@n-api.service[111304]: Openstack-System-Scope: None Oct 29 02:37:30.631064 n-d-862967-2 devstack@n-api.service[111304]: User-Agent: python-novaclient Oct 29 02:37:30.631064 n-d-862967-2 devstack@n-api.service[111304]: X-Auth-Token: gAAAAABjXJHp7Syc6gYl-kqk8seaxxH2EQx2D3mJBvMzGzpAzReSSUu1hSrQT2LI6m1AxWKXz_XWh55EMWP2Rc5-u6NhaIWReage06CZKHvAyWBv6XgCzQvPGTkjYxzyLVBRUotjNYaOgcsGflKSPkNEOwYFuWtxYnRlY4i6woAi9Hkm9ZPF01Y Oct 29 02:37:30.631064 n-d-862967-2 devstack@n-api.service[111304]: X-Domain-Id: None Oct 29 02:37:30.631064 n-d-862967-2 devstack@n-api.service[111304]: X-Domain-Name: None Oct 29 02:37:30.631064 n-d-862967-2 devstack@n-api.service[111304]: X-Identity-Status: Confirmed Oct 29 02:37:30.631064 n-d-862967-2 devstack@n-api.service[111304]: X-Is-Admin-Project: True Oct 29 02:37:30.631064 n-d-862967-2 devstack@n-api.service[111304]: X-Openstack-Nova-Api-Version: 2.92 Oct 29 02:37:30.631064 n-d-862967-2 devstack@n-api.service[111304]: X-Project-Domain-Id: default Oct 29 02:37:30.631064 n-d-862967-2 devstack@n-api.service[111304]: X-Project-Domain-Name: Default Oct 29 02:37:30.631064 n-d-862967-2 devstack@n-api.service[111304]: X-Project-Id: 7cca6f477293404e8f5e065633b5e81b Oct 29 02:37:30.631064 n-d-862967-2 devstack@n-api.service[111304]: X-Project-Name: admin Oct 29 02:37:30.631064 n-d-862967-2 devstack@n-api.service[111304]: X-Role: admin,reader,member Oct 29 02:37:30.631064 n-d-862967-2 devstack@n-api.service[111304]: X-Roles: admin,reader,member Oct 29 02:37:30.633018 n-d-862967-2 devstack@n-api.service[111304]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca6f477293404e8f5e065633b5e81b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7cca6f477293404e8f5e065633b5e81b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7cca6f477293404e8f5e065633b5e81b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7cca6f477293404e8f5e065633b5e81b"}]}] Oct 29 02:37:30.633018 n-d-862967-2 devstack@n-api.service[111304]: X-Tenant: admin Oct 29 02:37:30.633018 n-d-862967-2 devstack@n-api.service[111304]: X-Tenant-Id: 7cca6f477293404e8f5e065633b5e81b Oct 29 02:37:30.633018 n-d-862967-2 devstack@n-api.service[111304]: X-Tenant-Name: admin Oct 29 02:37:30.633018 n-d-862967-2 devstack@n-api.service[111304]: X-User: admin Oct 29 02:37:30.633018 n-d-862967-2 devstack@n-api.service[111304]: X-User-Domain-Id: default Oct 29 02:37:30.633018 n-d-862967-2 devstack@n-api.service[111304]: X-User-Domain-Name: Default Oct 29 02:37:30.633018 n-d-862967-2 devstack@n-api.service[111304]: X-User-Id: 11050229edd44999974e424bdd1866fa Oct 29 02:37:30.633018 n-d-862967-2 devstack@n-api.service[111304]: X-User-Name: admin Oct 29 02:37:30.633018 n-d-862967-2 devstack@n-api.service[111304]: method: > Oct 29 02:37:30.633018 n-d-862967-2 devstack@n-api.service[111304]: exception: Flavor 451 could not be found. Oct 29 02:37:30.633018 n-d-862967-2 devstack@n-api.service[111304]: action_args: {'id': '451'} Oct 29 02:37:30.633018 n-d-862967-2 devstack@n-api.service[111304]: {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:37:30.633018 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:30.633932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 29 02:37:30.633932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 29 02:37:30.633932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 02:37:30.633932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 02:37:30.633932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:37:30.633932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:37:30.633932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 02:37:30.633932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 02:37:30.633932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 02:37:30.633932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:37:30.633932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 02:37:30.633932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 02:37:30.633932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 29 02:37:30.633932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi Oct 29 02:37:30.633932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:37:30.633932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi Oct 29 02:37:30.633932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:30.633932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:37:30.633932 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:37:30.635025 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:37:30.635025 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:37:30.635025 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:37:30.635025 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:37:30.635025 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 29 02:37:30.635025 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:37:30.635025 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 29 02:37:30.635025 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi Oct 29 02:37:30.635025 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:37:30.635025 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi Oct 29 02:37:30.635025 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:37:30.635025 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:37:30.635025 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:37:30.635025 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:37:30.635025 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:37:30.635025 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 29 02:37:30.635025 n-d-862967-2 devstack@n-api.service[111304]: ERROR nova.api.openstack.wsgi Oct 29 02:37:30.635025 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-7fa8d784-c81d-44ee-909d-ad741c6279e8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:37:30.636041 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-7fa8d784-c81d-44ee-909d-ad741c6279e8 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011892 Oct 29 02:37:30.636041 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 27/52] 10.222.0.46 () {60 vars in 1193 bytes} [Sat Oct 29 02:37:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 02:37:31.884479 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-8588e534-7cd1-45f1-acb1-c742061cf5e7 admin admin] Calling method '>' {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:31.886102 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-8588e534-7cd1-45f1-acb1-c742061cf5e7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002196 Oct 29 02:37:31.886661 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 26/53] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Oct 29 02:37:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:37:32.464462 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-3cb282b3-3b4f-42cb-9053-a67c1dc81e03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:37:32.486065 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-3cb282b3-3b4f-42cb-9053-a67c1dc81e03 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.457233 Oct 29 02:37:32.486605 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 28/54] 10.222.0.46 () {64 vars in 1235 bytes} [Sat Oct 29 02:37:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:37:33.707809 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-8588e534-7cd1-45f1-acb1-c742061cf5e7 admin admin] Calling method '>' {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:33.708827 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-8588e534-7cd1-45f1-acb1-c742061cf5e7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Oct 29 02:37:33.709220 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 27/55] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Oct 29 02:37:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:37:34.257737 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-befbd742-1dd0-4491-9c0e-623b530b4ada admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:37:34.279253 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-befbd742-1dd0-4491-9c0e-623b530b4ada admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.433560 Oct 29 02:37:34.279841 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 29/56] 10.222.0.46 () {64 vars in 1235 bytes} [Sat Oct 29 02:37:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:37:35.507891 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-8588e534-7cd1-45f1-acb1-c742061cf5e7 admin admin] Calling method '>' {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:35.508938 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-8588e534-7cd1-45f1-acb1-c742061cf5e7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Oct 29 02:37:35.509332 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 28/57] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Oct 29 02:37:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:37:36.066227 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-366262dd-f345-482b-b5fa-659a04877dc0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:37:36.085983 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-366262dd-f345-482b-b5fa-659a04877dc0 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.440689 Oct 29 02:37:36.086529 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 30/58] 10.222.0.46 () {64 vars in 1235 bytes} [Sat Oct 29 02:37:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:37:37.278500 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-8588e534-7cd1-45f1-acb1-c742061cf5e7 admin admin] Calling method '>' {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:37.279504 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-8588e534-7cd1-45f1-acb1-c742061cf5e7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Oct 29 02:37:37.279890 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 29/59] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Oct 29 02:37:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:37:37.842411 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-a4284ac5-f769-4a6e-9834-89fc79514cc1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:37:37.863052 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-a4284ac5-f769-4a6e-9834-89fc79514cc1 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.448502 Oct 29 02:37:37.863595 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 31/60] 10.222.0.46 () {64 vars in 1235 bytes} [Sat Oct 29 02:37:37 2022] POST /compute/v2.1/flavors => generated 409 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:37:39.071403 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-8588e534-7cd1-45f1-acb1-c742061cf5e7 admin admin] Calling method '>' {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:39.072448 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-8588e534-7cd1-45f1-acb1-c742061cf5e7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 29 02:37:39.072858 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 30/61] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Oct 29 02:37:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:37:39.646877 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-a9fccd66-6f6f-4c5d-93e6-bdd7741a7216 admin admin] Calling method '>' {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:37:39.667321 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-a9fccd66-6f6f-4c5d-93e6-bdd7741a7216 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.459135 Oct 29 02:37:39.667866 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 32/62] 10.222.0.46 () {60 vars in 1202 bytes} [Sat Oct 29 02:37:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:38:36.549758 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-8588e534-7cd1-45f1-acb1-c742061cf5e7 admin admin] Calling method '>' {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:38:36.551073 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-8588e534-7cd1-45f1-acb1-c742061cf5e7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002068 Oct 29 02:38:36.551669 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 31/63] 10.222.0.46 () {54 vars in 931 bytes} [Sat Oct 29 02:38:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:38:36.565653 n-d-862967-2 devstack@n-api.service[111304]: DEBUG dbcounter [-] [111304] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=111304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:38:37.001514 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-2e1e4a61-9736-47b2-b8f2-707426827d1e admin admin] Calling method '>' {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:38:37.022007 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-2e1e4a61-9736-47b2-b8f2-707426827d1e admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.461063 Oct 29 02:38:37.022537 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 33/64] 10.222.0.46 () {60 vars in 1292 bytes} [Sat Oct 29 02:38:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:38:37.044224 n-d-862967-2 devstack@n-api.service[111305]: DEBUG dbcounter [-] [111305] Writing DB stats nova_api:SELECT=14 {{(pid=111305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:38:37.048110 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-5c3e6ac5-13d1-44c1-934d-4e60fd748c7d admin admin] Calling method '>' {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:38:37.055734 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-5c3e6ac5-13d1-44c1-934d-4e60fd748c7d admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012958 Oct 29 02:38:37.056250 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 32/65] 10.222.0.46 () {60 vars in 1283 bytes} [Sat Oct 29 02:38:37 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:38:37.068736 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-f33b6902-625f-4ecc-a875-2c255cc46372 admin admin] Calling method '>' {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:38:37.076201 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-f33b6902-625f-4ecc-a875-2c255cc46372 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011125 Oct 29 02:38:37.076742 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 34/66] 10.222.0.46 () {60 vars in 1286 bytes} [Sat Oct 29 02:38:37 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:38:37.088648 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-8bf976f5-9965-4bd4-b4ed-e85179b27d61 admin admin] Calling method '>' {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:38:37.096156 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-8bf976f5-9965-4bd4-b4ed-e85179b27d61 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011179 Oct 29 02:38:37.096674 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 33/67] 10.222.0.46 () {60 vars in 1286 bytes} [Sat Oct 29 02:38:37 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:38:37.107982 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-acecb6e7-20ea-464c-bfa7-534aa93b7136 admin admin] Calling method '>' {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:38:37.115327 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-acecb6e7-20ea-464c-bfa7-534aa93b7136 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010873 Oct 29 02:38:37.115836 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 35/68] 10.222.0.46 () {60 vars in 1283 bytes} [Sat Oct 29 02:38:37 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:43:48.969033 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-8bf976f5-9965-4bd4-b4ed-e85179b27d61 admin admin] Calling method '>' {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:43:48.970043 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-8bf976f5-9965-4bd4-b4ed-e85179b27d61 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Oct 29 02:43:48.970438 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 34/69] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Oct 29 02:43:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:43:49.112997 n-d-862967-2 devstack@n-api.service[111304]: DEBUG dbcounter [-] [111304] Writing DB stats nova_api:SELECT=6 {{(pid=111304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:43:49.267879 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-4564b1bb-2f9b-49de-a645-b6e0bcefa2c5 admin admin] Calling method '>' {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:43:49.272978 n-d-862967-2 devstack@n-api.service[111304]: DEBUG oslo_concurrency.lockutils [None req-4564b1bb-2f9b-49de-a645-b6e0bcefa2c5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:43:49.273448 n-d-862967-2 devstack@n-api.service[111304]: DEBUG oslo_concurrency.lockutils [None req-4564b1bb-2f9b-49de-a645-b6e0bcefa2c5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:43:49.273870 n-d-862967-2 devstack@n-api.service[111304]: DEBUG oslo_concurrency.lockutils [None req-4564b1bb-2f9b-49de-a645-b6e0bcefa2c5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:43:49.274575 n-d-862967-2 devstack@n-api.service[111304]: DEBUG oslo_concurrency.lockutils [None req-4564b1bb-2f9b-49de-a645-b6e0bcefa2c5 admin admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:43:49.275037 n-d-862967-2 devstack@n-api.service[111304]: DEBUG oslo_concurrency.lockutils [None req-4564b1bb-2f9b-49de-a645-b6e0bcefa2c5 admin admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:43:49.275442 n-d-862967-2 devstack@n-api.service[111304]: DEBUG oslo_concurrency.lockutils [None req-4564b1bb-2f9b-49de-a645-b6e0bcefa2c5 admin admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:43:49.313092 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-4564b1bb-2f9b-49de-a645-b6e0bcefa2c5 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.202097 Oct 29 02:43:49.313653 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 36/70] 10.222.0.46 () {60 vars in 1193 bytes} [Sat Oct 29 02:43:49 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:43:50.378974 n-d-862967-2 devstack@n-api.service[111305]: DEBUG nova.api.openstack.wsgi [None req-8bf976f5-9965-4bd4-b4ed-e85179b27d61 admin admin] Calling method '>' {{(pid=111305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:43:50.380302 n-d-862967-2 devstack@n-api.service[111305]: INFO nova.api.openstack.requestlog [None req-8bf976f5-9965-4bd4-b4ed-e85179b27d61 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001749 Oct 29 02:43:50.380726 n-d-862967-2 devstack@n-api.service[111305]: [pid: 111305|app: 0|req: 35/71] 10.222.0.46 () {56 vars in 1074 bytes} [Sat Oct 29 02:43:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:43:50.577572 n-d-862967-2 devstack@n-api.service[111304]: DEBUG nova.api.openstack.wsgi [None req-c56a096a-bf3d-4a3b-89d8-54b3dd50b193 admin admin] Calling method '>' {{(pid=111304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:43:50.581012 n-d-862967-2 devstack@n-api.service[111304]: DEBUG oslo_concurrency.lockutils [None req-c56a096a-bf3d-4a3b-89d8-54b3dd50b193 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:43:50.581487 n-d-862967-2 devstack@n-api.service[111304]: DEBUG oslo_concurrency.lockutils [None req-c56a096a-bf3d-4a3b-89d8-54b3dd50b193 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:43:50.581904 n-d-862967-2 devstack@n-api.service[111304]: DEBUG oslo_concurrency.lockutils [None req-c56a096a-bf3d-4a3b-89d8-54b3dd50b193 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:43:50.582610 n-d-862967-2 devstack@n-api.service[111304]: DEBUG oslo_concurrency.lockutils [None req-c56a096a-bf3d-4a3b-89d8-54b3dd50b193 admin admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:43:50.583048 n-d-862967-2 devstack@n-api.service[111304]: DEBUG oslo_concurrency.lockutils [None req-c56a096a-bf3d-4a3b-89d8-54b3dd50b193 admin admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:43:50.583459 n-d-862967-2 devstack@n-api.service[111304]: DEBUG oslo_concurrency.lockutils [None req-c56a096a-bf3d-4a3b-89d8-54b3dd50b193 admin admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:43:50.605976 n-d-862967-2 devstack@n-api.service[111304]: INFO nova.api.openstack.requestlog [None req-c56a096a-bf3d-4a3b-89d8-54b3dd50b193 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.087264 Oct 29 02:43:50.606501 n-d-862967-2 devstack@n-api.service[111304]: [pid: 111304|app: 0|req: 37/72] 10.222.0.46 () {60 vars in 1193 bytes} [Sat Oct 29 02:43:50 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:44:36.801720 n-d-862967-2 devstack@n-api.service[111303]: Sat Oct 29 02:44:36 2022 - graceful shutdown triggered... Oct 29 02:44:36.801766 n-d-862967-2 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 29 02:44:36.802852 n-d-862967-2 devstack@n-api.service[111304]: Gracefully killing worker 1 (pid: 111304)... Oct 29 02:44:36.803258 n-d-862967-2 devstack@n-api.service[111305]: Gracefully killing worker 2 (pid: 111305)... Oct 29 02:44:36.932851 n-d-862967-2 devstack@n-api.service[111305]: DEBUG dbcounter [-] [111305] Writing DB stats nova_api:SELECT=4 {{(pid=111305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:44:37.804112 n-d-862967-2 devstack@n-api.service[111303]: worker 1 buried after 1 seconds Oct 29 02:44:37.804112 n-d-862967-2 devstack@n-api.service[111303]: worker 2 buried after 1 seconds Oct 29 02:44:37.804112 n-d-862967-2 devstack@n-api.service[111303]: goodbye to uWSGI. Oct 29 02:44:37.806618 n-d-862967-2 systemd[1]: devstack@n-api.service: Succeeded. Oct 29 02:44:37.807984 n-d-862967-2 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 29 02:44:37.813181 n-d-862967-2 systemd[1]: Starting Devstack devstack@n-api.service... Oct 29 02:44:37.836971 n-d-862967-2 devstack@n-api.service[127114]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 29 02:44:37.855002 n-d-862967-2 devstack@n-api.service[127114]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 29 02:44:37 2022] *** Oct 29 02:44:37.855002 n-d-862967-2 devstack@n-api.service[127114]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 29 02:44:37.855002 n-d-862967-2 devstack@n-api.service[127114]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 29 02:44:37.855002 n-d-862967-2 devstack@n-api.service[127114]: nodename: n-d-862967-2 Oct 29 02:44:37.855002 n-d-862967-2 devstack@n-api.service[127114]: machine: x86_64 Oct 29 02:44:37.855002 n-d-862967-2 devstack@n-api.service[127114]: clock source: unix Oct 29 02:44:37.855002 n-d-862967-2 devstack@n-api.service[127114]: pcre jit disabled Oct 29 02:44:37.855002 n-d-862967-2 devstack@n-api.service[127114]: detected number of CPU cores: 4 Oct 29 02:44:37.855002 n-d-862967-2 devstack@n-api.service[127114]: current working directory: / Oct 29 02:44:37.855002 n-d-862967-2 devstack@n-api.service[127114]: detected binary path: /usr/bin/uwsgi-core Oct 29 02:44:37.855002 n-d-862967-2 devstack@n-api.service[127114]: your processes number limit is 47680 Oct 29 02:44:37.855002 n-d-862967-2 devstack@n-api.service[127114]: your memory page size is 4096 bytes Oct 29 02:44:37.855002 n-d-862967-2 devstack@n-api.service[127114]: detected max file descriptor number: 2048 Oct 29 02:44:37.855002 n-d-862967-2 devstack@n-api.service[127114]: lock engine: pthread robust mutexes Oct 29 02:44:37.856141 n-d-862967-2 devstack@n-api.service[127114]: thunder lock: enabled Oct 29 02:44:37.856141 n-d-862967-2 devstack@n-api.service[127114]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 29 02:44:37.856141 n-d-862967-2 devstack@n-api.service[127114]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 29 02:44:37.895453 n-d-862967-2 devstack@n-api.service[127114]: Python main interpreter initialized at 0x55d4a4f399c0 Oct 29 02:44:37.895453 n-d-862967-2 devstack@n-api.service[127114]: python threads support enabled Oct 29 02:44:37.895453 n-d-862967-2 devstack@n-api.service[127114]: your server socket listen backlog is limited to 100 connections Oct 29 02:44:37.895453 n-d-862967-2 devstack@n-api.service[127114]: your mercy for graceful operations on workers is 90 seconds Oct 29 02:44:37.895922 n-d-862967-2 devstack@n-api.service[127114]: mapped 403077 bytes (393 KB) for 2 cores Oct 29 02:44:37.895922 n-d-862967-2 devstack@n-api.service[127114]: *** Operational MODE: preforking *** Oct 29 02:44:37.896157 n-d-862967-2 devstack@n-api.service[127114]: *** uWSGI is running in multiple interpreter mode *** Oct 29 02:44:37.896157 n-d-862967-2 devstack@n-api.service[127114]: spawned uWSGI master process (pid: 127114) Oct 29 02:44:37.896368 n-d-862967-2 systemd[1]: Started Devstack devstack@n-api.service. Oct 29 02:44:37.896978 n-d-862967-2 devstack@n-api.service[127114]: spawned uWSGI worker 1 (pid: 127124, cores: 1) Oct 29 02:44:37.897343 n-d-862967-2 devstack@n-api.service[127114]: spawned uWSGI worker 2 (pid: 127125, cores: 1) Oct 29 02:44:37.897611 n-d-862967-2 devstack@n-api.service[127114]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 29 02:44:38.552750 n-d-862967-2 devstack@n-api.service[127125]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 29 02:44:38.553438 n-d-862967-2 devstack@n-api.service[127124]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 29 02:44:39.795551 n-d-862967-2 devstack@n-api.service[127124]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 02:44:39.795551 n-d-862967-2 devstack@n-api.service[127124]: from cryptography.utils import int_from_bytes Oct 29 02:44:39.796281 n-d-862967-2 devstack@n-api.service[127125]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 02:44:39.796281 n-d-862967-2 devstack@n-api.service[127125]: from cryptography.utils import int_from_bytes Oct 29 02:44:39.796281 n-d-862967-2 devstack@n-api.service[127125]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 02:44:39.796281 n-d-862967-2 devstack@n-api.service[127125]: from cryptography.utils import int_from_bytes Oct 29 02:44:39.796843 n-d-862967-2 devstack@n-api.service[127124]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 02:44:39.796843 n-d-862967-2 devstack@n-api.service[127124]: from cryptography.utils import int_from_bytes Oct 29 02:44:42.256082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 02:44:42.256901 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 02:44:42.256901 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 02:44:42.257261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 02:44:42.257513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 02:44:42.257656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 02:44:42.258035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 02:44:42.258126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.258201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.258366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 02:44:42.258536 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.258730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 02:44:42.258888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.258986 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 02:44:42.259062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.259368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.259509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.259695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.259834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.260004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.260153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.260308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.260450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.260594 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.260693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.260870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.260969 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.261188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862967-2 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.261381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.261478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.261562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.261800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.261902 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.262098 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.262203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.262404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.262505 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.262700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.262802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-862967-2 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.263010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.263130 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.263300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.263462 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.263625 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.263785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.263939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.264227 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.264344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.264540 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.264640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.264848 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.264961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.265177 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.265346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.265503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.265653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.265768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.265986 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.266118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.266275 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.266384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.266606 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.266770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.266917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.267053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.267201 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.267361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862967-2 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.267505 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.267658 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.267789 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.267925 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.268107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.268214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.268413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.268620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.268831 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-862967-2 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.268923 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.269150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.269243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.269460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.269563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.269769 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.269876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.270108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.270210 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.270425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.270517 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.270735 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.270843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.271045 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.271139 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.271357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.271448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.271652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.271753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.271954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.272047 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.272256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.272354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.272612 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.272720 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.272910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.273011 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.273205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.273297 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.273450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.273556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.273749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.273841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.274061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.274167 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.274373 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.274480 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.274670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.274768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.274917 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.275010 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.275160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.275265 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.275465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.275587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.275775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.275884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.276073 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.276176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.276352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.276445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.276641 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.276748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.276949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.277054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.277246 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.277353 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.277543 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.277697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.277846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.277977 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.278124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.278263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.278422 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.278530 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.278720 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.278826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.279027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.279170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.279325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.279422 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.279614 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.279721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.279925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.280046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.280241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.280357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.280577 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.280687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.280870 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.280987 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.281183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.281322 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.281481 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.281627 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.281791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.281887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.282094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.282199 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.282390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.282496 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.282687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.282789 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.282990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.283122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.283297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.283429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.283619 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.283765 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.283912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.284004 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.284157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.284259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.284453 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.284596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.284774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.284914 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.285085 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.285215 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.285384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.285493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.285671 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.285764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.285965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.286066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.286256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.286358 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.286555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.286698 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.286854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.286947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.287208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.287355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.287496 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.287587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.287835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.287943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.288189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.288285 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.288421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.288601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.288692 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.288789 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.288959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.289053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.289309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.289414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.289563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.289663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.289869 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.289970 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.290171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.290270 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.290470 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.290572 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.290769 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.290909 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.291058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.291196 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.291365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.291471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.291662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.291764 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.291960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.292052 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.292260 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.292359 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.292572 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.292680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.292874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.292968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.293179 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.293284 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.293476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.293568 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.293775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.293868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.294082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.294183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.294374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.294466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.294672 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.294770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.294976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.295077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.295279 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.295369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.295577 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.295729 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.295876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.296017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.296158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.296257 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.296454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.296603 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.296775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.296874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.297070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.297161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.297366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.297458 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.297654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.297746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.297951 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.298043 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.298254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.298354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.298552 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.298644 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.298852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.298947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.299146 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.299247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.299455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.299556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.299767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.299858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.300071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.300172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.300375 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.300467 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.300705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.300811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.301021 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:44:42.301123 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.301353 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.301455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.301733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.301844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.301969 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.302069 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.302277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.302377 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.302595 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.302688 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.302908 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.303069 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.303204 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.303298 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.303509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.303610 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.303872 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.303965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.304185 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.304276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.304492 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.304640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.304826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.304933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.305131 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.305231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.305443 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.305542 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.305750 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.305857 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.306060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.306156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.306372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.306470 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.306683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.306784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.306989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.307083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.307297 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.307389 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.307613 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.307713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.307939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.308032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.308253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.308345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.308583 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.308691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.308889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.308980 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.309194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.309285 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.309525 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.309678 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.309827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.309920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.310138 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.310229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.310443 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.310535 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.310757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.310857 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.311063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.311169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.311375 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.311466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.311681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.311799 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.311984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.312127 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.312290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.312381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.312618 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.312726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.312922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.313097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.313233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.313324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.313543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.313637 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.313853 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.313953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.314160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.314252 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.314465 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.314562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.314775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.315081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.315213 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.315386 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.315510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.315690 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.315822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.315988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.316105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.316284 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.316403 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.316604 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.316745 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.316908 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.317034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.317204 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.317322 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.317516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.317648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.317836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.317953 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.318135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.318253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.318477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.318615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.318728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.318845 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.319109 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.319232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.319365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.319483 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.319687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.319812 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.319930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.320048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.321141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.321478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.321644 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.321756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.321889 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.322019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.322123 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.322255 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.322344 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.322416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.322498 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.322570 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.322570 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.322721 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.322804 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.322883 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.322974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.323110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.323202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.323332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.323420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.323535 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.323635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.323803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.323902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.324127 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.324226 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.324433 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.324572 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.324767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.324865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.325083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.325180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.325395 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.325507 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.325704 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.325813 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.326015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.326110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.326356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.326515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.326620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.326716 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.326964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.327115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.327239 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.327351 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.327570 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.327710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.327844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.327947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.328173 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.328333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.328437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.328588 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.328755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.328859 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.329052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.329154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.329352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.329497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.329649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.329794 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.330032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.330138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.330225 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.330309 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.330533 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.330625 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.330834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.330936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.331210 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.331361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.331452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.331581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.331702 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.331813 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.332003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.332150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.332304 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.332438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.332648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.332785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.332957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.333100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.333259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.333362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.333562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.333653 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.333865 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.333958 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.334176 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.334335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.334787 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.334876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.334999 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.335085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.335169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.335263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.335467 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.335559 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.335785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.335932 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.336091 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.336233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.336402 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.336504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.336727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.336829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.337035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.337141 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.337338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.337438 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.337646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.337738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.337941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.338033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.338250 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.338344 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.338566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.338665 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.338881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.338974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.339186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.339277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.339499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.339599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.339801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.339894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.340109 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.340202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.340408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.340515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.340744 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.340837 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.341051 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.341193 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.341348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.341546 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.341645 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.341740 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.341939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.342040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.342288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.342410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.342546 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.342861 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.343165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.343326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.343483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.343665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.343824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.343976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.344121 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.344263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.344406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.344599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.344758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.344903 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.345053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.345219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.345384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.345528 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.345680 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.345831 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.345974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.346124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.346278 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.346431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.346688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.346986 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.347128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.347266 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.347370 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.347586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.347688 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.347896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.347989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.348200 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.348302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.348506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.348680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.348807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.348918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.349117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.349245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.349419 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.349544 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.349740 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.349855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.350046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.350165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.350351 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.350452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.350688 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.350782 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.351002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.351103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.351312 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.351410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.351621 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.351764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.351924 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.352017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.352218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.352308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.352545 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.352660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.352849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.353154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.353287 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.353405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.353516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.353714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.353833 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.354040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.354158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.354342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.354460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.354638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.354734 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.354947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.355050 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.355261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.355362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.355563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.355665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.355877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.355977 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.356182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.356284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.356486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.356642 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.356822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.356934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.357128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.357236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.357431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.357531 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.357734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.357826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.358037 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.358140 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.358340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.358440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.358641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.358734 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.358954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.359059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.359254 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.359345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.359556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.359647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.359861 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.359954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.360161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.360254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.360462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.360626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.360795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.360888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.361105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.361372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.361508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.361701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.361849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.362006 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.362105 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.362316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.362416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.362619 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.362710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.362925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.363030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.363234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.363344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.363535 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.363636 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.363841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.363942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.364157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.364290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.364457 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.364760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.364894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.365064 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.365249 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.365391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.365491 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.365707 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.365807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.366014 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.366114 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.366408 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.366509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.366711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.366853 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.367011 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.367105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.367310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.367414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.367606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.367700 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.367904 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.368004 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.368213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.368315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.368509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.368658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.368834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.368930 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.369130 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.369237 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.369441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.369532 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.369739 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.369840 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.370036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.370139 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.370333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.370434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.370628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.370730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.370929 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.371097 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.371234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.371338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.371546 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.371650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.371848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.371983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.372157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.372257 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.372457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.372607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.372788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.372890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.373108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.373209 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.373407 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.373510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.373706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.373799 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.374002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.374094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.378808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.378990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.379136 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.379254 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.379377 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.379499 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.379612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.380067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.380374 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.380510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.380649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.380769 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.380877 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.381006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.381119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.381229 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.381338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.381447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.381555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.381679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.381825 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.381937 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.382053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.382172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.382284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.382499 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.382639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.382777 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.382919 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.383058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.383199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.383330 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.383457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.383584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.383710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.383845 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.383988 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.384117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.384250 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.384380 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.384478 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.384633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.384633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.384792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.384792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.384945 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.385017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.385088 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.385167 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.385240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.385311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.385390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.385462 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.385542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.385542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.385680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.385680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.385820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.385820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.385820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.385820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.385820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.385820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.386226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.386300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.386384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.386457 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.386527 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.386597 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.386675 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.386753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.386838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.386919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.386919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.387048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.387119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.387199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.387280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.387353 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.387431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.387503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.387723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.387815 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.388022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.388105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.388316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.388397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.388880 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.389016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.389138 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.389256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.389374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.389483 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.389611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.389731 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.389849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.389959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.390094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.390232 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.390435 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.390532 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.390733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.390858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.391084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.391188 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.391382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.391486 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.391693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.391776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.392008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.392099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.392316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.392412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.392643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.392771 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.392950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.393054 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.393258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.393429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.393570 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.393707 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.393841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.393983 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.394119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.394288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.394427 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.394593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.394732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.394898 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.395030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.395199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.395333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.395543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.395683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.395848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.395942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.396174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.396268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.396492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.396641 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.396897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.397073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.397279 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.397421 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.397646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.397754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.397955 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.398056 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.398261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.398354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.398569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.398661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.398874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.399005 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.399183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.399279 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.399491 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.399618 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.399796 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.399933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.400106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.400240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.400408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.400737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.400869 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.401041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.401178 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.401341 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.401443 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.401659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.401760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.401962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.402061 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.402260 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.402362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.402562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.402655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.402863 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.402954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.403169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.403297 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.403470 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.403594 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.403919 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.404169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.404349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.404486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.404643 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.404819 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.405021 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.405146 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.405553 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.405681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.405819 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.405947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.406075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.406243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.406346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.406558 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.406658 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.406870 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.407013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.407181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.407325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.407488 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.407631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.407815 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.407938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.408125 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.408227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.408430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.408543 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.408832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.408925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.409150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.409251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.409450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.409550 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.409748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.409870 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.410050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.410368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.410722 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.410836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.410970 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.411072 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.411327 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.411424 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.411634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.411739 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.411948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.412126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.412273 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.412455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.412620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.412714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.412956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.413149 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.413253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.413342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.413613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.413763 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.413909 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.414021 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.414231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.414426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.414527 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.414623 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.414830 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.414969 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.415147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.415299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.415458 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.415595 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.415724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.415835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.416049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.416237 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.416353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.416458 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.416651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.416750 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.416968 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.417078 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.417267 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.417362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.417578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.417673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.417983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.418094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.418293 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.418395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.418595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.418699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.418906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.419008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.419226 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.419322 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.419524 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.419627 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.419817 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.419921 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.420125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.420220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.420420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.420516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.420748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.420864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.421062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.421158 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.421362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.421458 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.421663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.421768 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.421966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.422067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.422264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.422359 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.422544 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.422648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.422838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.422937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.423153 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.423302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.423448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.423542 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.423765 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.423868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.424072 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.424165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.424386 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.424544 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.424726 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.424878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.425025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.425192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.425342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.425512 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.425642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.425836 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.425954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.426139 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.426248 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.426444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.426538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.426754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.426854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.427059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.427152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.427364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.427457 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.427684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.427775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.428036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.428128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.428342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.428444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.428772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.428905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.429102 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.429424 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.429733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.429865 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.430054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.430170 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.430374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.430493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.430674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.430798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.430972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.431098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.431331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.431447 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.431636 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.431753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.431936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.432060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.432237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.432353 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.432616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.432743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.433016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.433328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.433635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.433929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.434023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.434234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.434333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.434560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.434661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.434867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.434957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.435187 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.435288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.435513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.435638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.435829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.435954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.436134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.436237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.436461 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.436610 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.436913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.437020 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.437241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.437350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.437554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.437988 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.437988 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.438158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.438243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.438324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.438473 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.438582 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.438979 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.439127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.439127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.439360 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.439479 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.439596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.439713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.439834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.440000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.440101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.440312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.440412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.440649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.440760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.440956 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.441056 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.441269 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.441368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.441581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.441673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.441895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.441987 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.442220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.442463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.442555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.442794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.442901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.443113 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.443248 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.443414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.443507 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.443759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.443859 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.444073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.444182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.444423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.444514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.444762 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.444856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.445072 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.445163 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.445382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.445490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.445694 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.445793 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.446008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.446147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.446325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.446428 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.446641 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.446732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.446956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.447048 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.447271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.447413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.447580 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.447672 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.447891 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.447982 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.448203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.448295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.448571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.448679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.448895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.449103 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.449204 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.449432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.449534 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.449746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.449837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.450058 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.450163 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.450372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.450464 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.450681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.450778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.450991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.451090 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.451299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.451390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.451604 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.451703 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.451909 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.452002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.452214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.452305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.452540 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.452634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.452861 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.452964 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.453191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.453282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.453525 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.453640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.453845 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.453937 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.454159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.454251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.454470 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.454575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.454784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.454982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.455292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.455407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.455624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.455735 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.455939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.456068 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.456260 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.456707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.457046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.457347 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.457460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.457671 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.457772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.457972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.458086 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.458272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.458378 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.458579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.458682 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.458883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.459029 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.459184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.459286 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.459506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.459607 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.459794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.459965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.460172 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.460501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.460623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.460906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.461221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.461767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.462119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.462436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.462761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.463084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.463399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.463701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.464021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.464322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.464649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.464964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.465067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.465271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.465366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.465569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.465664 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.465866 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.465985 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.466597 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.466700 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.466784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.466784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.466997 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.467086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.467166 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.467382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.467822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.467914 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.467914 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.468556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.468709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.468811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.468903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.468903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.469117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.469384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.469479 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.469704 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.469804 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.470005 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.470099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.470310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.470413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.470605 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.470699 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.470907 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.471016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.471205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.471308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.471510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.471604 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.471854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.471948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.472156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.472256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.472454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.472681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.472849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.473008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.473162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.473318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.473504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.473671 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.473911 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.474073 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.474223 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.474388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.474615 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.474825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.474825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.475122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.475270 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.475425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.475610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.475768 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.475925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.476072 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.476227 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.476814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.476988 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.477145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.477302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.477456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.477615 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.477771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.477934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.478082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.478229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.478560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.478717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.478864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.479021 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.479215 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.479368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.479524 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.479691 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.479857 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.480015 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.480162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.480320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.480470 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.480470 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.480808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.480965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.481113 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.481261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.481407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.481554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.481726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.482450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.482617 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.482767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.482917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.483072 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.483232 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.483543 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.483697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.483844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.484087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.484241 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.484405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.484746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.484910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.485068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.485217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.485375 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.485522 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.485677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.485833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.485982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.486129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.486285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.486442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.487019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.487170 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.487334 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.487492 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.487649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.487797 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.487949 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.488105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.488254 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.490985 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.491214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.491388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.491543 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.491708 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.491858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.492021 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.492178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.492335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.492492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.492667 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.492827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.492986 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.493141 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.493141 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.493424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.493584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.493732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.493889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.494038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.494277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.494438 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.494588 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.494773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.495002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.495157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.495312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.495312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.495594 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.495766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.495766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.496048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.496202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.496348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.496495 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.497114 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.497276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.497434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.497583 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.497732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.497897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.498061 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.498217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.498365 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.498520 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.498963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.499137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.499137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.499428 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.499587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.499742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.499901 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.500059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.500214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.500410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.501136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.501330 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.501683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.501842 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.502000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.502149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.502297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.502453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.502679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.502831 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.502987 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.503158 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.503306 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.503452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.503608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.503757 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.503907 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.504070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.504218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.504449 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.504640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.505176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.505329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.505329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.505643 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.505806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.506007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.506211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.506369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.506517 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.506680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.507310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.507463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.507613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.507760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.507940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.508181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.508358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.508514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.508704 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.508863 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.509123 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.509389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.509545 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.509706 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.509866 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.510023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.510173 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.510335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.510504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.510652 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.510808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.510956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.511103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.511265 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.511421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.511421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.511725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.511873 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.512020 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.512177 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.512334 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.512492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.512693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.512989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.512989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.513300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.513468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.514287 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.514466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.514705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.514869 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.514869 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.514869 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.514869 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.514869 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.514869 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.514869 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.514869 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.516127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.516273 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.516428 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.516657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.516811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.516811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.517593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.517770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.517927 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.518091 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.518249 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.518397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.518544 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.518692 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.518838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.518999 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.519174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.519434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.519683 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.519838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.520012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.520171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.520326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.520474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.520644 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.520806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.520978 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.521134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.521134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.521134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.521134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.521134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127124) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 02:44:42.522231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.522231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.522231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.522231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.522231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.522231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.522231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.522231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.523626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.523626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.523626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.523626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.525157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.525157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.525157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.525157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.526022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.526022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.526022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.526490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.526641 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.526878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.527765 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.527765 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.528100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.528249 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.528583 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.528910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.529204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.530035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.530035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.530347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.530582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.531008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.531484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.532470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.532948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.533319 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.533926 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.534162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.534335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.534621 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.534964 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.535267 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.535583 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.536088 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.536415 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.536766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.537100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.537490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.538107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.538292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.538565 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.538927 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.539248 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.539601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.539934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.540353 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.540569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.540880 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:44:42.541127 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 02:44:42.576592 n-d-862967-2 devstack@n-api.service[127124]: INFO dbcounter [None req-6ad2f3a7-6398-4356-a66a-c21b61d6e600 None None] Registered counter for database nova_api Oct 29 02:44:42.599724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_db.sqlalchemy.engines [None req-6ad2f3a7-6398-4356-a66a-c21b61d6e600 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:44:42.606738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writer thread running {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:44:42.620240 n-d-862967-2 devstack@n-api.service[127125]: INFO dbcounter [None req-d1e80406-52a6-4c5c-843f-135aa975670b None None] Registered counter for database nova_api Oct 29 02:44:42.641152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_db.sqlalchemy.engines [None req-d1e80406-52a6-4c5c-843f-135aa975670b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:44:42.649402 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writer thread running {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:44:42.663227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.context [None req-6ad2f3a7-6398-4356-a66a-c21b61d6e600 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5270c754-82e2-4d8e-a02e-4533aa854f76(cell1) {{(pid=127124) load_cells /opt/stack/nova/nova/context.py:464}} Oct 29 02:44:42.667331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ad2f3a7-6398-4356-a66a-c21b61d6e600 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:44:42.667817 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ad2f3a7-6398-4356-a66a-c21b61d6e600 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:44:42.669419 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ad2f3a7-6398-4356-a66a-c21b61d6e600 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:44:42.670276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ad2f3a7-6398-4356-a66a-c21b61d6e600 None None] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:44:42.670715 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ad2f3a7-6398-4356-a66a-c21b61d6e600 None None] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:44:42.672759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ad2f3a7-6398-4356-a66a-c21b61d6e600 None None] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:44:42.674779 n-d-862967-2 devstack@n-api.service[127124]: INFO dbcounter [None req-6ad2f3a7-6398-4356-a66a-c21b61d6e600 None None] Registered counter for database nova_cell0 Oct 29 02:44:42.679235 n-d-862967-2 devstack@n-api.service[127124]: INFO dbcounter [None req-6ad2f3a7-6398-4356-a66a-c21b61d6e600 None None] Registered counter for database nova_cell1 Oct 29 02:44:42.693651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_db.sqlalchemy.engines [None req-6ad2f3a7-6398-4356-a66a-c21b61d6e600 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:44:42.693651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writer thread running {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:44:42.693651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_db.sqlalchemy.engines [None req-6ad2f3a7-6398-4356-a66a-c21b61d6e600 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:44:42.707022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.context [None req-d1e80406-52a6-4c5c-843f-135aa975670b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5270c754-82e2-4d8e-a02e-4533aa854f76(cell1) {{(pid=127125) load_cells /opt/stack/nova/nova/context.py:464}} Oct 29 02:44:42.711383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1e80406-52a6-4c5c-843f-135aa975670b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:44:42.711862 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1e80406-52a6-4c5c-843f-135aa975670b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:44:42.713627 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1e80406-52a6-4c5c-843f-135aa975670b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:44:42.714378 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1e80406-52a6-4c5c-843f-135aa975670b None None] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:44:42.714820 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1e80406-52a6-4c5c-843f-135aa975670b None None] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:44:42.716866 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1e80406-52a6-4c5c-843f-135aa975670b None None] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:44:42.718907 n-d-862967-2 devstack@n-api.service[127125]: INFO dbcounter [None req-d1e80406-52a6-4c5c-843f-135aa975670b None None] Registered counter for database nova_cell0 Oct 29 02:44:42.723540 n-d-862967-2 devstack@n-api.service[127125]: INFO dbcounter [None req-d1e80406-52a6-4c5c-843f-135aa975670b None None] Registered counter for database nova_cell1 Oct 29 02:44:42.732758 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_db.sqlalchemy.engines [None req-d1e80406-52a6-4c5c-843f-135aa975670b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:44:42.734124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_db.sqlalchemy.engines [None req-d1e80406-52a6-4c5c-843f-135aa975670b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:44:42.741609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writer thread running {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:44:42.741976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writer thread running {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:44:42.831312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writer thread running {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:44:42.840386 n-d-862967-2 devstack@n-api.service[127124]: INFO dbcounter [None req-6ad2f3a7-6398-4356-a66a-c21b61d6e600 None None] Registered counter for database nova_cell0 Oct 29 02:44:42.847842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_db.sqlalchemy.engines [None req-6ad2f3a7-6398-4356-a66a-c21b61d6e600 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127124) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:44:42.853193 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writer thread running {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:44:42.887376 n-d-862967-2 devstack@n-api.service[127125]: INFO dbcounter [None req-d1e80406-52a6-4c5c-843f-135aa975670b None None] Registered counter for database nova_cell0 Oct 29 02:44:42.896571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_db.sqlalchemy.engines [None req-d1e80406-52a6-4c5c-843f-135aa975670b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:44:42.901962 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writer thread running {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:44:43.165373 n-d-862967-2 devstack@n-api.service[127124]: WARNING keystonemiddleware.auth_token [None req-6ad2f3a7-6398-4356-a66a-c21b61d6e600 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 02:44:43.172614 n-d-862967-2 devstack@n-api.service[127124]: WARNING keystonemiddleware.auth_token [None req-6ad2f3a7-6398-4356-a66a-c21b61d6e600 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 02:44:43.225973 n-d-862967-2 devstack@n-api.service[127125]: WARNING keystonemiddleware.auth_token [None req-d1e80406-52a6-4c5c-843f-135aa975670b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 02:44:43.233378 n-d-862967-2 devstack@n-api.service[127125]: WARNING keystonemiddleware.auth_token [None req-d1e80406-52a6-4c5c-843f-135aa975670b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 02:44:43.508482 n-d-862967-2 devstack@n-api.service[127124]: WARNING keystonemiddleware.auth_token [None req-6ad2f3a7-6398-4356-a66a-c21b61d6e600 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 02:44:43.514468 n-d-862967-2 devstack@n-api.service[127124]: WARNING keystonemiddleware.auth_token [None req-6ad2f3a7-6398-4356-a66a-c21b61d6e600 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 02:44:43.519783 n-d-862967-2 devstack@n-api.service[127124]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d4a4f399c0 pid: 127124 (default app) Oct 29 02:44:43.580353 n-d-862967-2 devstack@n-api.service[127125]: WARNING keystonemiddleware.auth_token [None req-d1e80406-52a6-4c5c-843f-135aa975670b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 02:44:43.586429 n-d-862967-2 devstack@n-api.service[127125]: WARNING keystonemiddleware.auth_token [None req-d1e80406-52a6-4c5c-843f-135aa975670b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 02:44:43.591795 n-d-862967-2 devstack@n-api.service[127125]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d4a4f399c0 pid: 127125 (default app) Oct 29 02:45:23.119299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:23.120164 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:23.121153 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:23.122446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:23.226377 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:23.227786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:23.228504 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:23.229562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:24.245597 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ffb80196-e132-41d9-bb19-ca0202a3e2a8 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:24.250374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffb80196-e132-41d9-bb19-ca0202a3e2a8 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:24.250971 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffb80196-e132-41d9-bb19-ca0202a3e2a8 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:24.251405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffb80196-e132-41d9-bb19-ca0202a3e2a8 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:24.252147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffb80196-e132-41d9-bb19-ca0202a3e2a8 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:24.252621 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffb80196-e132-41d9-bb19-ca0202a3e2a8 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:24.253082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffb80196-e132-41d9-bb19-ca0202a3e2a8 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:24.312650 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ffb80196-e132-41d9-bb19-ca0202a3e2a8 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 1.198814 Oct 29 02:45:24.324877 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2ccbc12b-4cf8-4058-a5d0-2d1dc1000f26 tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Calling method '.version_select at 0x7ff0598dfee0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:24.328679 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1/1] 10.222.0.46 () {58 vars in 1176 bytes} [Sat Oct 29 02:45:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:24.328907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2ccbc12b-4cf8-4058-a5d0-2d1dc1000f26 tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:24.329393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2ccbc12b-4cf8-4058-a5d0-2d1dc1000f26 tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:24.329834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2ccbc12b-4cf8-4058-a5d0-2d1dc1000f26 tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:24.330567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2ccbc12b-4cf8-4058-a5d0-2d1dc1000f26 tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:24.331020 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2ccbc12b-4cf8-4058-a5d0-2d1dc1000f26 tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:24.331444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2ccbc12b-4cf8-4058-a5d0-2d1dc1000f26 tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:24.338287 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b4857973-35a0-4d4f-8767-92f6f993a1e4 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-711469851"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:24.364675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.aggregate [None req-b4857973-35a0-4d4f-8767-92f6f993a1e4 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Generated uuid 175d8d37-d3b0-4d2a-bf5e-c6864d6c67b2 for aggregate {{(pid=127124) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:45:24.379817 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2ccbc12b-4cf8-4058-a5d0-2d1dc1000f26 tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 1.155887 Oct 29 02:45:24.380801 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1/2] 10.222.0.46 () {58 vars in 1128 bytes} [Sat Oct 29 02:45:23 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:24.438955 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b4857973-35a0-4d4f-8767-92f6f993a1e4 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.106077 Oct 29 02:45:24.439910 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2/3] 10.222.0.46 () {60 vars in 1164 bytes} [Sat Oct 29 02:45:24 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:24.452161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-da6b1959-54ca-4d44-8498-b8bfe0e43c30 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862967-2"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:24.475775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da6b1959-54ca-4d44-8498-b8bfe0e43c30 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:24.476365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da6b1959-54ca-4d44-8498-b8bfe0e43c30 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:24.476927 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da6b1959-54ca-4d44-8498-b8bfe0e43c30 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:24.865491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2f5093c3-d43b-420b-a404-7692f7dc01a7 tempest-HostsAdminNegativeTestJSON-1728032266 tempest-HostsAdminNegativeTestJSON-1728032266-project] Calling method '.version_select at 0x7ff059907f70>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:24.869358 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2f5093c3-d43b-420b-a404-7692f7dc01a7 tempest-HostsAdminNegativeTestJSON-1728032266 tempest-HostsAdminNegativeTestJSON-1728032266-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '079e1ea67f74422f87fa6d4dca1ffb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af26d4d1a9c4bc8a4b720f57b92ef24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:24.874318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2f5093c3-d43b-420b-a404-7692f7dc01a7 tempest-HostsAdminNegativeTestJSON-1728032266 tempest-HostsAdminNegativeTestJSON-1728032266-project] Request method failure captured: Oct 29 02:45:24.874318 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 29 02:45:24.874318 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:45:24.874318 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:45:24.874318 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:45:24.874318 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:45:24.874318 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:45:24.874318 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:45:24.874318 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:45:24.874318 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:24.874318 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPBl-ExwX8xTLpQyx2nVzGX_EXitH8s-ZSb1ZocTW__G5Nd909lEq2IJ_DN2GX3Wsn8_n4pmnDqN0pP5YQCBTR-hPwtB_H68G8yyG7lVbxCRAX7PkWbM9GC9y2LHVW9Ay9yr0KnkQHz7MXG49f15JxSjFhmubyOgCakeY1dK6dZafY Oct 29 02:45:24.874318 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:45:24.874318 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:45:24.874318 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:45:24.874318 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:45:24.874318 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:45:24.874318 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:45:24.874318 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 4af26d4d1a9c4bc8a4b720f57b92ef24 Oct 29 02:45:24.874318 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1728032266 Oct 29 02:45:24.874318 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:45:24.874318 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:45:24.875726 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4af26d4d1a9c4bc8a4b720f57b92ef24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4af26d4d1a9c4bc8a4b720f57b92ef24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4af26d4d1a9c4bc8a4b720f57b92ef24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4af26d4d1a9c4bc8a4b720f57b92ef24"}]}] Oct 29 02:45:24.875726 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1728032266 Oct 29 02:45:24.875726 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 4af26d4d1a9c4bc8a4b720f57b92ef24 Oct 29 02:45:24.875726 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1728032266 Oct 29 02:45:24.875726 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-HostsAdminNegativeTestJSON-1728032266-project Oct 29 02:45:24.875726 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:45:24.875726 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:45:24.875726 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 079e1ea67f74422f87fa6d4dca1ffb49 Oct 29 02:45:24.875726 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1728032266-project Oct 29 02:45:24.875726 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:45:24.875726 n-d-862967-2 devstack@n-api.service[127125]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 29 02:45:24.875726 n-d-862967-2 devstack@n-api.service[127125]: action_args: {} Oct 29 02:45:24.875726 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:24.876621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:24.876621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:24.876621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:24.876621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:24.876621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:24.876621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:24.876621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:24.876621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 02:45:24.876621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:45:24.876621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:24.876621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:24.876621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 29 02:45:24.876621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 29 02:45:24.876621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:24.876621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:24.876621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:24.876621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:24.876621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:24.876621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:24.877836 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:24.877836 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:24.877836 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:24.877836 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:24.877836 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:24.877836 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:24.877836 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:24.877836 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:24.877836 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 29 02:45:24.877836 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:24.877836 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:24.877836 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:24.877836 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:24.877836 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:24.877836 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:24.877836 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:24.877836 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:24.877836 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 29 02:45:24.877836 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:24.878999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2f5093c3-d43b-420b-a404-7692f7dc01a7 tempest-HostsAdminNegativeTestJSON-1728032266 tempest-HostsAdminNegativeTestJSON-1728032266-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:24.878999 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2f5093c3-d43b-420b-a404-7692f7dc01a7 tempest-HostsAdminNegativeTestJSON-1728032266 tempest-HostsAdminNegativeTestJSON-1728032266-project] 10.222.0.46 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.486081 Oct 29 02:45:24.878999 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2/4] 10.222.0.46 () {58 vars in 1128 bytes} [Sat Oct 29 02:45:24 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 487 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:45:25.064412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-96704af9-4e3a-4cf6-bc90-a70835e872ae tempest-FlavorsExtraSpecsTestJSON-1788838186 tempest-FlavorsExtraSpecsTestJSON-1788838186-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-935216199", "ram": 512, "vcpus": 1, "disk": 10, "id": 1904671799, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:25.123483 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-96704af9-4e3a-4cf6-bc90-a70835e872ae tempest-FlavorsExtraSpecsTestJSON-1788838186 tempest-FlavorsExtraSpecsTestJSON-1788838186-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.245670 Oct 29 02:45:25.124362 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3/5] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:45:24 2022] POST /compute/v2.1/flavors => generated 415 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:25.154816 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-da6b1959-54ca-4d44-8498-b8bfe0e43c30 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 241 microversion: 2.1 time: 0.706832 Oct 29 02:45:25.155960 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3/6] 10.222.0.46 () {60 vars in 1191 bytes} [Sat Oct 29 02:45:24 2022] POST /compute/v2.1/os-aggregates/1/action => generated 241 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:45:25.258613 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8ec1b8d0-e3e1-4acf-a821-374d24f60ae1 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Calling method '.version_select at 0x7ff059907c10>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:25.265274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8ec1b8d0-e3e1-4acf-a821-374d24f60ae1 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5270c754-82e2-4d8e-a02e-4533aa854f76(cell1) {{(pid=127125) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 29 02:45:25.266134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ec1b8d0-e3e1-4acf-a821-374d24f60ae1 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:25.266742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ec1b8d0-e3e1-4acf-a821-374d24f60ae1 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:25.267343 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ec1b8d0-e3e1-4acf-a821-374d24f60ae1 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:25.292847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ec1b8d0-e3e1-4acf-a821-374d24f60ae1 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:25.293323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ec1b8d0-e3e1-4acf-a821-374d24f60ae1 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:25.293745 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ec1b8d0-e3e1-4acf-a821-374d24f60ae1 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:25.305601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ec1b8d0-e3e1-4acf-a821-374d24f60ae1 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:25.306070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ec1b8d0-e3e1-4acf-a821-374d24f60ae1 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:25.306492 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ec1b8d0-e3e1-4acf-a821-374d24f60ae1 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:25.312416 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8ec1b8d0-e3e1-4acf-a821-374d24f60ae1 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.187424 Oct 29 02:45:25.313011 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 4/7] 10.222.0.46 () {58 vars in 1167 bytes} [Sat Oct 29 02:45:25 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:25.370277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8c730d81-4baf-4510-9c3e-700a462f76be tempest-KeyPairsV210TestJSON-1183118616 tempest-KeyPairsV210TestJSON-1183118616-project-admin] Action: 'create', calling method: .version_select at 0x7ff058efb940>, body: {"keypair": {"name": "tempest-keypair-185457367", "type": "ssh", "user_id": "0227efa03cd84ddca63321ce11bfd94f", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9rxV83y7U71R2KAsMcsZqUe8AD/jadvz9ppsymrcpMZmniOUoUaM/84FHZXn4ha8JCxtNYFhrH7D7INX7KA5UsNCNPqKydAjgI0WMcZUw3EOqDrep+0jZV60nNxskjZg=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:25.403778 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-8c730d81-4baf-4510-9c3e-700a462f76be tempest-KeyPairsV210TestJSON-1183118616 tempest-KeyPairsV210TestJSON-1183118616-project-admin] Getting quotas for project 3536e64781cf4117a470208de44ecf0d. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:45:25.409964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-8c730d81-4baf-4510-9c3e-700a462f76be tempest-KeyPairsV210TestJSON-1183118616 tempest-KeyPairsV210TestJSON-1183118616-project-admin] Getting quotas for user bc4b5adba2da44ee8fbe262ddd111bf4 and project 3536e64781cf4117a470208de44ecf0d. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:45:25.439740 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8c730d81-4baf-4510-9c3e-700a462f76be tempest-KeyPairsV210TestJSON-1183118616 tempest-KeyPairsV210TestJSON-1183118616-project-admin] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.282417 Oct 29 02:45:25.440935 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 4/8] 10.222.0.46 () {62 vars in 1200 bytes} [Sat Oct 29 02:45:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 284 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 02:45:25.483591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-45bcb1b2-d0f8-4d64-8de4-4ef5c0484363 tempest-AZAdminNegativeTestJSON-1334978051 tempest-AZAdminNegativeTestJSON-1334978051-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:25.486157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-45bcb1b2-d0f8-4d64-8de4-4ef5c0484363 tempest-AZAdminNegativeTestJSON-1334978051 tempest-AZAdminNegativeTestJSON-1334978051-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'd0d833ab11b040028138b6f326401fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42bfc71355394cbba096b76b51e3821f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:25.488137 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-45bcb1b2-d0f8-4d64-8de4-4ef5c0484363 tempest-AZAdminNegativeTestJSON-1334978051 tempest-AZAdminNegativeTestJSON-1334978051-project] Request method failure captured: Oct 29 02:45:25.488137 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 29 02:45:25.488137 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:45:25.488137 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:45:25.488137 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:45:25.488137 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:45:25.488137 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:45:25.488137 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:45:25.488137 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:45:25.488137 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:25.488137 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPCnRGBuCFguQsg6YmJ17nNheThujq907cSNTJBIAYmvegk___qYKUGzbXzVF6e_6DutboQlHGdXjckSWRkYm4-_AVLJjk2-cAc8-W1WwHvY__qItLIvFynK96-0NcCoD79Ge1WhJNEFwH2k2rPO4zuRat3mGS8wdfX2kv8lCvUFGI Oct 29 02:45:25.488137 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:45:25.488137 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:45:25.488137 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:45:25.488137 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:45:25.488137 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:45:25.488137 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:45:25.488137 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 42bfc71355394cbba096b76b51e3821f Oct 29 02:45:25.488137 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1334978051 Oct 29 02:45:25.488137 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:45:25.488137 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:45:25.489357 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/42bfc71355394cbba096b76b51e3821f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/42bfc71355394cbba096b76b51e3821f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_42bfc71355394cbba096b76b51e3821f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/42bfc71355394cbba096b76b51e3821f"}]}] Oct 29 02:45:25.489357 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-AZAdminNegativeTestJSON-1334978051 Oct 29 02:45:25.489357 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 42bfc71355394cbba096b76b51e3821f Oct 29 02:45:25.489357 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1334978051 Oct 29 02:45:25.489357 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-AZAdminNegativeTestJSON-1334978051-project Oct 29 02:45:25.489357 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:45:25.489357 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:45:25.489357 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: d0d833ab11b040028138b6f326401fe7 Oct 29 02:45:25.489357 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-AZAdminNegativeTestJSON-1334978051-project Oct 29 02:45:25.489357 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:45:25.489357 n-d-862967-2 devstack@n-api.service[127125]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 29 02:45:25.489357 n-d-862967-2 devstack@n-api.service[127125]: action_args: {} Oct 29 02:45:25.490025 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:25.490025 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:25.490025 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:25.490025 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:25.490025 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:25.490025 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:25.490025 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:25.490025 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:25.490025 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 29 02:45:25.490025 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 29 02:45:25.490025 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:25.490025 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:25.490025 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:25.490025 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:25.490025 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:25.490025 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:25.490025 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:25.490025 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:25.490025 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:25.494868 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:25.494868 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:25.494868 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:25.494868 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:25.494868 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:25.494868 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 29 02:45:25.494868 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:25.494868 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:25.494868 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:25.494868 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:25.494868 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:25.494868 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:25.494868 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:25.494868 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:25.494868 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 29 02:45:25.494868 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:25.494868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-45bcb1b2-d0f8-4d64-8de4-4ef5c0484363 tempest-AZAdminNegativeTestJSON-1334978051 tempest-AZAdminNegativeTestJSON-1334978051-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:25.495681 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-45bcb1b2-d0f8-4d64-8de4-4ef5c0484363 tempest-AZAdminNegativeTestJSON-1334978051 tempest-AZAdminNegativeTestJSON-1334978051-project] 10.222.0.46 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.175610 Oct 29 02:45:25.495681 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 5/9] 10.222.0.46 () {58 vars in 1185 bytes} [Sat Oct 29 02:45:25 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 176 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:45:25.495681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dcebb5c7-9d5f-4204-9381-59684a2ce389 tempest-HostsAdminNegativeTestJSON-1728032266 tempest-HostsAdminNegativeTestJSON-1728032266-project] Calling method '.version_select at 0x7ff0597b28b0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:25.497150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dcebb5c7-9d5f-4204-9381-59684a2ce389 tempest-HostsAdminNegativeTestJSON-1728032266 tempest-HostsAdminNegativeTestJSON-1728032266-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '079e1ea67f74422f87fa6d4dca1ffb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af26d4d1a9c4bc8a4b720f57b92ef24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:25.498887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dcebb5c7-9d5f-4204-9381-59684a2ce389 tempest-HostsAdminNegativeTestJSON-1728032266 tempest-HostsAdminNegativeTestJSON-1728032266-project] Request method failure captured: Oct 29 02:45:25.498887 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/os-hosts/n-d-862967-2/reboot HTTP/1.1 Oct 29 02:45:25.498887 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:45:25.498887 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:45:25.498887 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:45:25.498887 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:45:25.498887 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:45:25.498887 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:45:25.498887 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:45:25.498887 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:25.498887 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPBl-ExwX8xTLpQyx2nVzGX_EXitH8s-ZSb1ZocTW__G5Nd909lEq2IJ_DN2GX3Wsn8_n4pmnDqN0pP5YQCBTR-hPwtB_H68G8yyG7lVbxCRAX7PkWbM9GC9y2LHVW9Ay9yr0KnkQHz7MXG49f15JxSjFhmubyOgCakeY1dK6dZafY Oct 29 02:45:25.498887 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:45:25.498887 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:45:25.498887 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:45:25.498887 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:45:25.498887 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:45:25.498887 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:45:25.498887 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 4af26d4d1a9c4bc8a4b720f57b92ef24 Oct 29 02:45:25.498887 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1728032266 Oct 29 02:45:25.498887 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:45:25.498887 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:45:25.499947 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4af26d4d1a9c4bc8a4b720f57b92ef24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4af26d4d1a9c4bc8a4b720f57b92ef24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4af26d4d1a9c4bc8a4b720f57b92ef24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4af26d4d1a9c4bc8a4b720f57b92ef24"}]}] Oct 29 02:45:25.499947 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1728032266 Oct 29 02:45:25.499947 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 4af26d4d1a9c4bc8a4b720f57b92ef24 Oct 29 02:45:25.499947 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1728032266 Oct 29 02:45:25.499947 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-HostsAdminNegativeTestJSON-1728032266-project Oct 29 02:45:25.499947 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:45:25.499947 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:45:25.499947 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 079e1ea67f74422f87fa6d4dca1ffb49 Oct 29 02:45:25.499947 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1728032266-project Oct 29 02:45:25.499947 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:45:25.499947 n-d-862967-2 devstack@n-api.service[127125]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 29 02:45:25.499947 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'n-d-862967-2'} Oct 29 02:45:25.499947 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:25.500672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:25.500672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:25.500672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:25.500672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:25.500672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:25.500672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:25.500672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:25.500672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:25.500672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:25.500672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 29 02:45:25.500672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 29 02:45:25.500672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:25.500672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:25.500672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:25.500672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:25.500672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:25.500672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:25.500672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:25.500672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:25.502603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:25.502603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:25.502603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:25.502603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:25.502603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:25.502603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:25.502603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 29 02:45:25.502603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:25.502603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:25.502603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:25.502603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:25.502603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:25.502603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:25.502603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:25.502603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:25.502603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 29 02:45:25.502603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:25.507155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dcebb5c7-9d5f-4204-9381-59684a2ce389 tempest-HostsAdminNegativeTestJSON-1728032266 tempest-HostsAdminNegativeTestJSON-1728032266-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:25.507155 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dcebb5c7-9d5f-4204-9381-59684a2ce389 tempest-HostsAdminNegativeTestJSON-1728032266 tempest-HostsAdminNegativeTestJSON-1728032266-project] 10.222.0.46 "GET /compute/v2.1/os-hosts/n-d-862967-2/reboot" status: 403 len: 111 microversion: 2.1 time: 0.009307 Oct 29 02:45:25.507155 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 6/10] 10.222.0.46 () {58 vars in 1188 bytes} [Sat Oct 29 02:45:25 2022] GET /compute/v2.1/os-hosts/n-d-862967-2/reboot => generated 111 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:45:25.507155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cb364c7f-aa31-4c95-aef2-b05e834823f3 tempest-FlavorsExtraSpecsTestJSON-1788838186 tempest-FlavorsExtraSpecsTestJSON-1788838186-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:25.551448 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cb364c7f-aa31-4c95-aef2-b05e834823f3 tempest-FlavorsExtraSpecsTestJSON-1788838186 tempest-FlavorsExtraSpecsTestJSON-1788838186-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/1904671799/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.049351 Oct 29 02:45:25.552078 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 7/11] 10.222.0.46 () {60 vars in 1224 bytes} [Sat Oct 29 02:45:25 2022] POST /compute/v2.1/flavors/1904671799/os-extra_specs => generated 66 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:45:25.557946 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f6491f8f-dd7b-4638-89b4-bc2f9da65cf8 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862967-2"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:25.590461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6491f8f-dd7b-4638-89b4-bc2f9da65cf8 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:25.591041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6491f8f-dd7b-4638-89b4-bc2f9da65cf8 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:25.591468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6491f8f-dd7b-4638-89b4-bc2f9da65cf8 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:25.634825 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-f6491f8f-dd7b-4638-89b4-bc2f9da65cf8 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h2-862967-2. Oct 29 02:45:25.648911 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f6491f8f-dd7b-4638-89b4-bc2f9da65cf8 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Request method failure captured: Oct 29 02:45:25.648911 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Oct 29 02:45:25.648911 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:45:25.648911 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:45:25.648911 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:45:25.648911 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 39 Oct 29 02:45:25.648911 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:45:25.648911 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:45:25.648911 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:45:25.648911 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:25.648911 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPDJHoPSph0mXghkoG6vy4vKHJZH77qG9bcMyfjywW6JAS8osJl8LD8SzWcW3koajwzuX4iwzga21FerzbBBWNrHdMQBc-wAAbh_cJ6gnTF2ky66Su9Wl91yHCdV0dWk_S6JUOv40VKsJnvyQvn6xLjRa5B_88CFdht5Iv6AmL3EHU Oct 29 02:45:25.648911 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:45:25.648911 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:45:25.648911 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:45:25.648911 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:45:25.648911 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:45:25.648911 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:45:25.648911 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: f8795036569b4371b4373c011fce41f8 Oct 29 02:45:25.648911 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-895326194 Oct 29 02:45:25.648911 n-d-862967-2 devstack@n-api.service[127125]: X-Role: admin,reader,member Oct 29 02:45:25.648911 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: admin,reader,member Oct 29 02:45:25.649891 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f8795036569b4371b4373c011fce41f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f8795036569b4371b4373c011fce41f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f8795036569b4371b4373c011fce41f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f8795036569b4371b4373c011fce41f8"}]}] Oct 29 02:45:25.649891 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-895326194 Oct 29 02:45:25.649891 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: f8795036569b4371b4373c011fce41f8 Oct 29 02:45:25.649891 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-895326194 Oct 29 02:45:25.649891 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin Oct 29 02:45:25.649891 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:45:25.649891 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:45:25.649891 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 809ed92fc1114568bd929eab1819af1f Oct 29 02:45:25.649891 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin Oct 29 02:45:25.649891 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:45:25.649891 n-d-862967-2 devstack@n-api.service[127125]: {"add_host": {"host": "n-h2-862967-2"}} Oct 29 02:45:25.649891 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:45:25.649891 n-d-862967-2 devstack@n-api.service[127125]: exception: Aggregate 1 already has host n-h2-862967-2. Oct 29 02:45:25.650561 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h2-862967-2'}}} Oct 29 02:45:25.650561 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:25.650561 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:25.650561 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 02:45:25.650561 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 29 02:45:25.650561 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 02:45:25.650561 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 29 02:45:25.650561 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 02:45:25.650561 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 29 02:45:25.650561 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 02:45:25.650561 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 29 02:45:25.650561 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 02:45:25.650561 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 02:45:25.650561 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 02:45:25.650561 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result.read() Oct 29 02:45:25.650561 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 02:45:25.650561 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 29 02:45:25.650561 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 02:45:25.650561 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 29 02:45:25.651411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 02:45:25.651411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 29 02:45:25.651411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 02:45:25.651411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 29 02:45:25.651411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-862967-2-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 29 02:45:25.651411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:25.651411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 29 02:45:25.651411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:25.651411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:25.651411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 29 02:45:25.651411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 29 02:45:25.651411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 29 02:45:25.651411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi session.flush() Oct 29 02:45:25.651411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 29 02:45:25.651411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 29 02:45:25.651411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 29 02:45:25.651411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 29 02:45:25.651411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 29 02:45:25.651411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 29 02:45:25.652253 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 02:45:25.652253 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception Oct 29 02:45:25.652253 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 29 02:45:25.652253 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 29 02:45:25.652253 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 29 02:45:25.652253 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 29 02:45:25.652253 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 29 02:45:25.652253 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 29 02:45:25.652253 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 29 02:45:25.652253 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 29 02:45:25.652253 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 29 02:45:25.652253 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 29 02:45:25.652253 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 29 02:45:25.652253 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 29 02:45:25.652253 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 29 02:45:25.652253 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 29 02:45:25.652253 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 29 02:45:25.652253 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 29 02:45:25.654187 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 29 02:45:25.654187 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 29 02:45:25.654187 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 29 02:45:25.654187 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 29 02:45:25.654187 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 02:45:25.654187 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception Oct 29 02:45:25.654187 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 02:45:25.654187 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 29 02:45:25.654187 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 02:45:25.654187 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 29 02:45:25.654187 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 02:45:25.654187 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 29 02:45:25.654187 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 02:45:25.654187 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 29 02:45:25.654187 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 02:45:25.654187 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 02:45:25.654187 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 02:45:25.654187 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result.read() Oct 29 02:45:25.657423 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 02:45:25.657423 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 29 02:45:25.657423 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 02:45:25.657423 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 29 02:45:25.657423 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 02:45:25.657423 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 29 02:45:25.657423 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 02:45:25.657423 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 29 02:45:25.657423 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-862967-2-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 29 02:45:25.657423 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 29 02:45:25.657423 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 29, 2, 45, 25, 620916), 'updated_at': None, 'host': 'n-h2-862967-2', 'aggregate_id': 1}] Oct 29 02:45:25.657423 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 29 02:45:25.657423 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:25.657423 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:25.657423 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:25.657423 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:25.657423 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 29 02:45:25.660325 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 29 02:45:25.660325 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 02:45:25.660325 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 02:45:25.660325 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:25.660325 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:25.660325 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:25.660325 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:25.660325 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 02:45:25.660325 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 02:45:25.660325 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 29 02:45:25.660325 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 29 02:45:25.660325 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 29 02:45:25.660325 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 29 02:45:25.660325 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 29 02:45:25.660325 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 29 02:45:25.660325 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 29 02:45:25.660325 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 29 02:45:25.660325 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h2-862967-2. Oct 29 02:45:25.660325 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:25.660325 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:25.663223 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:25.663223 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:25.663223 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:25.663223 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:25.663223 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:25.663223 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:25.663223 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:25.663223 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:25.663223 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:45:25.663223 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:45:25.663223 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 29 02:45:25.663223 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 29 02:45:25.663223 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h2-862967-2. Oct 29 02:45:25.663223 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:25.663223 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:25.663223 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:25.663223 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:25.663223 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:25.663223 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:25.663223 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:45:25.663223 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:45:25.664470 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h2-862967-2. Oct 29 02:45:25.664470 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:25.664470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f6491f8f-dd7b-4638-89b4-bc2f9da65cf8 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Returning 409 to user: Aggregate 1 already has host n-h2-862967-2. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:25.664470 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f6491f8f-dd7b-4638-89b4-bc2f9da65cf8 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.097251 Oct 29 02:45:25.664470 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 8/12] 10.222.0.46 () {60 vars in 1191 bytes} [Sat Oct 29 02:45:25 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 29 02:45:25.664470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3ae241eb-01c0-4bf8-b7bb-4d577ad21a3c tempest-KeyPairsV210TestJSON-1183118616 tempest-KeyPairsV210TestJSON-1183118616-project-admin] Action: 'create', calling method: .version_select at 0x7ff059407790>, body: {"keypair": {"name": "tempest-keypair-49661410", "type": "ssh", "user_id": "0227efa03cd84ddca63321ce11bfd94f", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6LV+3RBWvTb7cIZHQ1JXjjGRrDn4G6dUp4R7mdeTeKVGksvKd3W28uU5+akONON8sbKCXA6wCE/wT5ZkgRD6CGRy1BCSIzWIso4yID1ooLpqLcjgEtzXeLVN7IdG17Rg=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:25.665887 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e24d25b1-0cf3-4756-bc6f-45edb74133a2 tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] Calling method '.version_select at 0x7ff058efb700>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:25.679874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e24d25b1-0cf3-4756-bc6f-45edb74133a2 tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5270c754-82e2-4d8e-a02e-4533aa854f76(cell1) {{(pid=127124) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 29 02:45:25.682531 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e24d25b1-0cf3-4756-bc6f-45edb74133a2 tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:25.683548 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e24d25b1-0cf3-4756-bc6f-45edb74133a2 tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:25.684862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e24d25b1-0cf3-4756-bc6f-45edb74133a2 tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:25.686306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-3ae241eb-01c0-4bf8-b7bb-4d577ad21a3c tempest-KeyPairsV210TestJSON-1183118616 tempest-KeyPairsV210TestJSON-1183118616-project-admin] Getting quotas for project 3536e64781cf4117a470208de44ecf0d. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:45:25.692753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-3ae241eb-01c0-4bf8-b7bb-4d577ad21a3c tempest-KeyPairsV210TestJSON-1183118616 tempest-KeyPairsV210TestJSON-1183118616-project-admin] Getting quotas for user bc4b5adba2da44ee8fbe262ddd111bf4 and project 3536e64781cf4117a470208de44ecf0d. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:45:25.707695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e24d25b1-0cf3-4756-bc6f-45edb74133a2 tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:25.708258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e24d25b1-0cf3-4756-bc6f-45edb74133a2 tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:25.708800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e24d25b1-0cf3-4756-bc6f-45edb74133a2 tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:25.723251 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3ae241eb-01c0-4bf8-b7bb-4d577ad21a3c tempest-KeyPairsV210TestJSON-1183118616 tempest-KeyPairsV210TestJSON-1183118616-project-admin] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.10 time: 0.070549 Oct 29 02:45:25.724427 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 9/13] 10.222.0.46 () {62 vars in 1200 bytes} [Sat Oct 29 02:45:25 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 72 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 02:45:25.730464 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e24d25b1-0cf3-4756-bc6f-45edb74133a2 tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:25.730967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e24d25b1-0cf3-4756-bc6f-45edb74133a2 tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:25.731519 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e24d25b1-0cf3-4756-bc6f-45edb74133a2 tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:25.734389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b337c3eb-810e-47e2-af78-5c61052089ca tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Calling method '.version_select at 0x7ff059407b80>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:25.738509 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e24d25b1-0cf3-4756-bc6f-45edb74133a2 tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.296390 Oct 29 02:45:25.739380 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 5/14] 10.222.0.46 () {60 vars in 1208 bytes} [Sat Oct 29 02:45:25 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:45:25.753913 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-b337c3eb-810e-47e2-af78-5c61052089ca tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:25.757439 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b337c3eb-810e-47e2-af78-5c61052089ca tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Request method failure captured: Oct 29 02:45:25.757439 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 29 02:45:25.757439 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:45:25.757439 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:45:25.757439 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:45:25.757439 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:45:25.757439 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:45:25.757439 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:45:25.757439 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:45:25.757439 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:25.757439 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPDm0uoGzDsRMbiTCCbJMsZN5sNVS468zWYI7Ql364JskaX6rWoxcF932SmDC3iY2rFC6YqPKZu2YSnfn7wEPAdb6UGKNsBQtvt04uKRJvPKUFYAkpZwgMXW9B_7rEY-R6vW66M1OwSg1mwEEcTvuQe5QYU7tvq6huS69fhhPlrTho Oct 29 02:45:25.757439 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:45:25.757439 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:45:25.757439 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:45:25.757439 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:45:25.757439 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:45:25.757439 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:45:25.757439 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 417b13514e5f4d9d9026f3cf50f8e297 Oct 29 02:45:25.757439 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1719796590 Oct 29 02:45:25.757439 n-d-862967-2 devstack@n-api.service[127125]: X-Role: admin,reader,member Oct 29 02:45:25.757439 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: admin,reader,member Oct 29 02:45:25.758745 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/417b13514e5f4d9d9026f3cf50f8e297"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/417b13514e5f4d9d9026f3cf50f8e297"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_417b13514e5f4d9d9026f3cf50f8e297"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/417b13514e5f4d9d9026f3cf50f8e297"}]}] Oct 29 02:45:25.758745 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1719796590 Oct 29 02:45:25.758745 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 417b13514e5f4d9d9026f3cf50f8e297 Oct 29 02:45:25.758745 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1719796590 Oct 29 02:45:25.758745 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-HostsAdminNegativeTestJSON-1719796590-project-admin Oct 29 02:45:25.758745 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:45:25.758745 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:45:25.758745 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 2872d2389a594af9850442a8d962a952 Oct 29 02:45:25.758745 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1719796590-project-admin Oct 29 02:45:25.758745 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:45:25.758745 n-d-862967-2 devstack@n-api.service[127125]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:25.758745 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'nonexistent_hostname'} Oct 29 02:45:25.758745 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:25.759483 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:25.759483 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 29 02:45:25.759483 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 29 02:45:25.759483 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 02:45:25.759483 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 02:45:25.759483 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:25.759483 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:25.759483 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:25.759483 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:25.759483 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 02:45:25.759483 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 02:45:25.759483 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 29 02:45:25.759483 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 29 02:45:25.759483 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:45:25.759483 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:45:25.759483 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 29 02:45:25.759483 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 29 02:45:25.759483 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:45:25.759483 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:45:25.760360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 29 02:45:25.760360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 29 02:45:25.760360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:25.760360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:25.760360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:25.760360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:25.760360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:25.760360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:25.760360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:25.760360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:25.760360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:25.760360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:25.760360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:25.760360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:25.760360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:25.760360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 29 02:45:25.760360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 29 02:45:25.760360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 29 02:45:25.760360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:45:25.761475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:25.761475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:25.761475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:25.761475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:25.761475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:25.761475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:25.761475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:25.761475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:45:25.761475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:45:25.761475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:25.761475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:25.761475 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b337c3eb-810e-47e2-af78-5c61052089ca tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:25.761475 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b337c3eb-810e-47e2-af78-5c61052089ca tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.033892 Oct 29 02:45:25.761475 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 10/15] 10.222.0.46 () {58 vars in 1212 bytes} [Sat Oct 29 02:45:25 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:45:25.765411 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6c681cd4-f1ea-4ca5-b9f9-8d6b3e5c99e1 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862967-2"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:25.776323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c681cd4-f1ea-4ca5-b9f9-8d6b3e5c99e1 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:25.776861 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c681cd4-f1ea-4ca5-b9f9-8d6b3e5c99e1 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:25.777267 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c681cd4-f1ea-4ca5-b9f9-8d6b3e5c99e1 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:25.978079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fa438bbf-050c-4c2b-be79-ada77d8cdeb0 tempest-FlavorsExtraSpecsTestJSON-1200387888 tempest-FlavorsExtraSpecsTestJSON-1200387888-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:26.004021 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fa438bbf-050c-4c2b-be79-ada77d8cdeb0 tempest-FlavorsExtraSpecsTestJSON-1200387888 tempest-FlavorsExtraSpecsTestJSON-1200387888-project] 10.222.0.46 "GET /compute/v2.1/flavors/1904671799/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.263002 Oct 29 02:45:26.004826 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 6/16] 10.222.0.46 () {58 vars in 1203 bytes} [Sat Oct 29 02:45:25 2022] GET /compute/v2.1/flavors/1904671799/os-extra_specs => generated 66 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:45:26.010853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-38c51269-b1ce-4d83-9204-a1b0e3a97503 tempest-KeyPairsV210TestJSON-1183118616 tempest-KeyPairsV210TestJSON-1183118616-project-admin] Calling method '.version_select at 0x7ff058e5cd30>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:26.023305 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-38c51269-b1ce-4d83-9204-a1b0e3a97503 tempest-KeyPairsV210TestJSON-1183118616 tempest-KeyPairsV210TestJSON-1183118616-project-admin] 10.222.0.46 "GET /compute/v2.1/os-keypairs/tempest-keypair-185457367?user_id=0227efa03cd84ddca63321ce11bfd94f" status: 200 len: 511 microversion: 2.10 time: 0.016912 Oct 29 02:45:26.024642 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 7/17] 10.222.0.46 () {60 vars in 1337 bytes} [Sat Oct 29 02:45:26 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-185457367?user_id=0227efa03cd84ddca63321ce11bfd94f => generated 511 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:45:26.032367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f683c657-7ed7-48df-bff0-e8595fc20789 tempest-HostsAdminNegativeTestJSON-1728032266 tempest-HostsAdminNegativeTestJSON-1728032266-project] Calling method '.version_select at 0x7ff058e20af0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:26.034926 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f683c657-7ed7-48df-bff0-e8595fc20789 tempest-HostsAdminNegativeTestJSON-1728032266 tempest-HostsAdminNegativeTestJSON-1728032266-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '079e1ea67f74422f87fa6d4dca1ffb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af26d4d1a9c4bc8a4b720f57b92ef24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:26.038799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f683c657-7ed7-48df-bff0-e8595fc20789 tempest-HostsAdminNegativeTestJSON-1728032266 tempest-HostsAdminNegativeTestJSON-1728032266-project] Request method failure captured: Oct 29 02:45:26.038799 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/os-hosts/n-d-862967-2 HTTP/1.1 Oct 29 02:45:26.038799 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:45:26.038799 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:45:26.038799 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:45:26.038799 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:45:26.038799 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:45:26.038799 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:45:26.038799 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:45:26.038799 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:26.038799 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPBl-ExwX8xTLpQyx2nVzGX_EXitH8s-ZSb1ZocTW__G5Nd909lEq2IJ_DN2GX3Wsn8_n4pmnDqN0pP5YQCBTR-hPwtB_H68G8yyG7lVbxCRAX7PkWbM9GC9y2LHVW9Ay9yr0KnkQHz7MXG49f15JxSjFhmubyOgCakeY1dK6dZafY Oct 29 02:45:26.038799 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:45:26.038799 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:45:26.038799 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:45:26.038799 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:45:26.038799 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:45:26.038799 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:45:26.038799 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 4af26d4d1a9c4bc8a4b720f57b92ef24 Oct 29 02:45:26.038799 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1728032266 Oct 29 02:45:26.038799 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:45:26.038799 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:45:26.039842 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4af26d4d1a9c4bc8a4b720f57b92ef24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4af26d4d1a9c4bc8a4b720f57b92ef24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4af26d4d1a9c4bc8a4b720f57b92ef24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4af26d4d1a9c4bc8a4b720f57b92ef24"}]}] Oct 29 02:45:26.039842 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1728032266 Oct 29 02:45:26.039842 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 4af26d4d1a9c4bc8a4b720f57b92ef24 Oct 29 02:45:26.039842 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1728032266 Oct 29 02:45:26.039842 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-HostsAdminNegativeTestJSON-1728032266-project Oct 29 02:45:26.039842 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:45:26.039842 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:45:26.039842 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 079e1ea67f74422f87fa6d4dca1ffb49 Oct 29 02:45:26.039842 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1728032266-project Oct 29 02:45:26.039842 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:45:26.039842 n-d-862967-2 devstack@n-api.service[127124]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 29 02:45:26.039842 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'n-d-862967-2'} Oct 29 02:45:26.039842 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:26.040566 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:26.040566 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:26.040566 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:26.040566 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:26.040566 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:26.040566 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:26.040566 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:26.040566 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:26.040566 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:26.040566 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 29 02:45:26.040566 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 29 02:45:26.040566 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:26.040566 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:26.040566 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:26.040566 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:26.040566 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:26.040566 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:26.040566 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:26.040566 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:26.041424 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:26.041424 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:26.041424 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:26.041424 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:26.041424 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:26.041424 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:26.041424 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 29 02:45:26.041424 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.041424 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:26.041424 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.041424 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:26.041424 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:26.041424 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:26.041424 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:26.041424 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:26.041424 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 29 02:45:26.041424 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.042195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f683c657-7ed7-48df-bff0-e8595fc20789 tempest-HostsAdminNegativeTestJSON-1728032266 tempest-HostsAdminNegativeTestJSON-1728032266-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:26.042195 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f683c657-7ed7-48df-bff0-e8595fc20789 tempest-HostsAdminNegativeTestJSON-1728032266 tempest-HostsAdminNegativeTestJSON-1728032266-project] 10.222.0.46 "GET /compute/v2.1/os-hosts/n-d-862967-2" status: 403 len: 109 microversion: 2.1 time: 0.014415 Oct 29 02:45:26.042195 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 8/18] 10.222.0.46 () {58 vars in 1167 bytes} [Sat Oct 29 02:45:26 2022] GET /compute/v2.1/os-hosts/n-d-862967-2 => generated 109 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:45:26.045721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c43dcbd4-9dd4-4a34-bf5d-6aa17ed3f3a7 tempest-FlavorsExtraSpecsTestJSON-1788838186 tempest-FlavorsExtraSpecsTestJSON-1788838186-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:26.099255 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c43dcbd4-9dd4-4a34-bf5d-6aa17ed3f3a7 tempest-FlavorsExtraSpecsTestJSON-1788838186 tempest-FlavorsExtraSpecsTestJSON-1788838186-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/1904671799/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.056789 Oct 29 02:45:26.104799 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 9/19] 10.222.0.46 () {60 vars in 1224 bytes} [Sat Oct 29 02:45:26 2022] POST /compute/v2.1/flavors/1904671799/os-extra_specs => generated 66 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:45:26.113081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-06ead23f-d405-45c9-bd93-149940f1c29f tempest-KeyPairsV210TestJSON-1183118616 tempest-KeyPairsV210TestJSON-1183118616-project-admin] Action: 'create', calling method: .version_select at 0x7ff058e56310>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-164956475", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXgDJHpSEFl2sn/mTG449ZT8VV67tDPsL+1galD3YAyXjcnlbla92rHCI78e/VvJt0qJ43K7BeMx6OM81SH9jSVemfLu2zLCZFWYANj39l3fPJ14K21xFOOe3nCNhrjzQ=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:26.132758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-06ead23f-d405-45c9-bd93-149940f1c29f tempest-KeyPairsV210TestJSON-1183118616 tempest-KeyPairsV210TestJSON-1183118616-project-admin] Getting quotas for project 3536e64781cf4117a470208de44ecf0d. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:45:26.137221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-06ead23f-d405-45c9-bd93-149940f1c29f tempest-KeyPairsV210TestJSON-1183118616 tempest-KeyPairsV210TestJSON-1183118616-project-admin] Getting quotas for user bc4b5adba2da44ee8fbe262ddd111bf4 and project 3536e64781cf4117a470208de44ecf0d. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:45:26.170970 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-06ead23f-d405-45c9-bd93-149940f1c29f tempest-KeyPairsV210TestJSON-1183118616 tempest-KeyPairsV210TestJSON-1183118616-project-admin] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.068950 Oct 29 02:45:26.172739 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 10/20] 10.222.0.46 () {62 vars in 1200 bytes} [Sat Oct 29 02:45:26 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 71 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 02:45:26.179026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6c961786-6380-4285-986a-258eef6516b5 tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Calling method '.version_select at 0x7ff058e5caf0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:26.188900 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-6c961786-6380-4285-986a-258eef6516b5 tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:26.192764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6c961786-6380-4285-986a-258eef6516b5 tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Request method failure captured: Oct 29 02:45:26.192764 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 29 02:45:26.192764 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:45:26.192764 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:45:26.192764 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:45:26.192764 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:45:26.192764 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:45:26.192764 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:45:26.192764 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:45:26.192764 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:26.192764 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPDm0uoGzDsRMbiTCCbJMsZN5sNVS468zWYI7Ql364JskaX6rWoxcF932SmDC3iY2rFC6YqPKZu2YSnfn7wEPAdb6UGKNsBQtvt04uKRJvPKUFYAkpZwgMXW9B_7rEY-R6vW66M1OwSg1mwEEcTvuQe5QYU7tvq6huS69fhhPlrTho Oct 29 02:45:26.192764 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:45:26.192764 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:45:26.192764 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:45:26.192764 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:45:26.192764 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:45:26.192764 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:45:26.192764 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 417b13514e5f4d9d9026f3cf50f8e297 Oct 29 02:45:26.192764 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1719796590 Oct 29 02:45:26.192764 n-d-862967-2 devstack@n-api.service[127124]: X-Role: admin,reader,member Oct 29 02:45:26.192764 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: admin,reader,member Oct 29 02:45:26.194246 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/417b13514e5f4d9d9026f3cf50f8e297"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/417b13514e5f4d9d9026f3cf50f8e297"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_417b13514e5f4d9d9026f3cf50f8e297"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/417b13514e5f4d9d9026f3cf50f8e297"}]}] Oct 29 02:45:26.194246 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1719796590 Oct 29 02:45:26.194246 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 417b13514e5f4d9d9026f3cf50f8e297 Oct 29 02:45:26.194246 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1719796590 Oct 29 02:45:26.194246 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-HostsAdminNegativeTestJSON-1719796590-project-admin Oct 29 02:45:26.194246 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:45:26.194246 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:45:26.194246 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 2872d2389a594af9850442a8d962a952 Oct 29 02:45:26.194246 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1719796590-project-admin Oct 29 02:45:26.194246 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:45:26.194246 n-d-862967-2 devstack@n-api.service[127124]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:26.194246 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'nonexistent_hostname'} Oct 29 02:45:26.194246 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:26.195150 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:26.195150 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 29 02:45:26.195150 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 29 02:45:26.195150 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:45:26.195150 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:45:26.195150 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 29 02:45:26.195150 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 29 02:45:26.195150 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:45:26.195150 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:45:26.195150 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 29 02:45:26.195150 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 29 02:45:26.195150 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:26.195150 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.195150 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:26.195150 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.195150 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:26.195150 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:26.195150 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:26.195150 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:26.196221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:26.196221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:26.196221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:26.196221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:26.196221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:26.196221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 29 02:45:26.196221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:45:26.196221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:26.196221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.196221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:26.196221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.196221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:26.196221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:26.196221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:26.196221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:45:26.196221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:45:26.196221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:26.196221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.198162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6c961786-6380-4285-986a-258eef6516b5 tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:26.199318 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6c961786-6380-4285-986a-258eef6516b5 tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.025359 Oct 29 02:45:26.200406 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 11/21] 10.222.0.46 () {58 vars in 1191 bytes} [Sat Oct 29 02:45:26 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:45:26.207241 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4d4ce285-d816-4f78-b625-4fc8d5ba2abe tempest-FlavorsExtraSpecsTestJSON-1200387888 tempest-FlavorsExtraSpecsTestJSON-1200387888-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:26.218395 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4d4ce285-d816-4f78-b625-4fc8d5ba2abe tempest-FlavorsExtraSpecsTestJSON-1200387888 tempest-FlavorsExtraSpecsTestJSON-1200387888-project] 10.222.0.46 "GET /compute/v2.1/flavors/1904671799/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.016241 Oct 29 02:45:26.226816 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 12/22] 10.222.0.46 () {58 vars in 1245 bytes} [Sat Oct 29 02:45:26 2022] GET /compute/v2.1/flavors/1904671799/os-extra_specs/hw:numa_nodes => generated 22 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:45:26.232661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6aede66d-f263-456c-a30b-86f19c7e756e tempest-KeyPairsV210TestJSON-1183118616 tempest-KeyPairsV210TestJSON-1183118616-project-admin] Calling method '.version_select at 0x7ff058e29040>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:26.236903 n-d-862967-2 devstack@n-api.service[127124]: WARNING oslo_db.sqlalchemy.utils [None req-6aede66d-f263-456c-a30b-86f19c7e756e tempest-KeyPairsV210TestJSON-1183118616 tempest-KeyPairsV210TestJSON-1183118616-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 29 02:45:26.246176 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6aede66d-f263-456c-a30b-86f19c7e756e tempest-KeyPairsV210TestJSON-1183118616 tempest-KeyPairsV210TestJSON-1183118616-project-admin] 10.222.0.46 "GET /compute/v2.1/os-keypairs?user_id=0227efa03cd84ddca63321ce11bfd94f" status: 200 len: 723 microversion: 2.10 time: 0.017870 Oct 29 02:45:26.247402 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 13/23] 10.222.0.46 () {60 vars in 1259 bytes} [Sat Oct 29 02:45:26 2022] GET /compute/v2.1/os-keypairs?user_id=0227efa03cd84ddca63321ce11bfd94f => generated 723 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:45:26.255145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-309fe780-eb8c-47c1-980b-7e61c4f7592e tempest-HostsAdminNegativeTestJSON-1728032266 tempest-HostsAdminNegativeTestJSON-1728032266-project] Calling method '.version_select at 0x7ff058d600d0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:26.260504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-309fe780-eb8c-47c1-980b-7e61c4f7592e tempest-HostsAdminNegativeTestJSON-1728032266 tempest-HostsAdminNegativeTestJSON-1728032266-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '079e1ea67f74422f87fa6d4dca1ffb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af26d4d1a9c4bc8a4b720f57b92ef24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:26.262528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-309fe780-eb8c-47c1-980b-7e61c4f7592e tempest-HostsAdminNegativeTestJSON-1728032266 tempest-HostsAdminNegativeTestJSON-1728032266-project] Request method failure captured: Oct 29 02:45:26.262528 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/os-hosts/n-d-862967-2/shutdown HTTP/1.1 Oct 29 02:45:26.262528 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:45:26.262528 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:45:26.262528 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:45:26.262528 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:45:26.262528 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:45:26.262528 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:45:26.262528 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:45:26.262528 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:26.262528 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPBl-ExwX8xTLpQyx2nVzGX_EXitH8s-ZSb1ZocTW__G5Nd909lEq2IJ_DN2GX3Wsn8_n4pmnDqN0pP5YQCBTR-hPwtB_H68G8yyG7lVbxCRAX7PkWbM9GC9y2LHVW9Ay9yr0KnkQHz7MXG49f15JxSjFhmubyOgCakeY1dK6dZafY Oct 29 02:45:26.262528 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:45:26.262528 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:45:26.262528 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:45:26.262528 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:45:26.262528 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:45:26.262528 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:45:26.262528 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 4af26d4d1a9c4bc8a4b720f57b92ef24 Oct 29 02:45:26.262528 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1728032266 Oct 29 02:45:26.262528 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:45:26.262528 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:45:26.263743 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4af26d4d1a9c4bc8a4b720f57b92ef24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4af26d4d1a9c4bc8a4b720f57b92ef24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4af26d4d1a9c4bc8a4b720f57b92ef24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4af26d4d1a9c4bc8a4b720f57b92ef24"}]}] Oct 29 02:45:26.263743 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1728032266 Oct 29 02:45:26.263743 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 4af26d4d1a9c4bc8a4b720f57b92ef24 Oct 29 02:45:26.263743 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1728032266 Oct 29 02:45:26.263743 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-HostsAdminNegativeTestJSON-1728032266-project Oct 29 02:45:26.263743 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:45:26.263743 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:45:26.263743 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 079e1ea67f74422f87fa6d4dca1ffb49 Oct 29 02:45:26.263743 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1728032266-project Oct 29 02:45:26.263743 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:45:26.263743 n-d-862967-2 devstack@n-api.service[127124]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 29 02:45:26.263743 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'n-d-862967-2'} Oct 29 02:45:26.263743 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:26.264472 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:26.264472 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:26.264472 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:26.264472 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:26.264472 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:26.264472 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:26.264472 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:26.264472 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:26.264472 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:26.264472 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 29 02:45:26.264472 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 29 02:45:26.264472 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:26.264472 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:26.264472 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:26.264472 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:26.264472 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:26.264472 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:26.264472 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:26.264472 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:26.265552 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:26.265552 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:26.265552 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:26.265552 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:26.265552 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:26.265552 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:26.265552 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 29 02:45:26.265552 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.265552 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:26.265552 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.265552 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:26.265552 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:26.265552 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:26.265552 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:26.265552 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:26.265552 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 29 02:45:26.265552 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.267113 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-309fe780-eb8c-47c1-980b-7e61c4f7592e tempest-HostsAdminNegativeTestJSON-1728032266 tempest-HostsAdminNegativeTestJSON-1728032266-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:26.268135 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-309fe780-eb8c-47c1-980b-7e61c4f7592e tempest-HostsAdminNegativeTestJSON-1728032266 tempest-HostsAdminNegativeTestJSON-1728032266-project] 10.222.0.46 "GET /compute/v2.1/os-hosts/n-d-862967-2/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.019599 Oct 29 02:45:26.269386 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 14/24] 10.222.0.46 () {58 vars in 1194 bytes} [Sat Oct 29 02:45:26 2022] GET /compute/v2.1/os-hosts/n-d-862967-2/shutdown => generated 113 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:45:26.275594 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-edee4cb9-217c-4e40-861b-3311e428317c tempest-FlavorsExtraSpecsTestJSON-1788838186 tempest-FlavorsExtraSpecsTestJSON-1788838186-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:26.308702 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-edee4cb9-217c-4e40-861b-3311e428317c tempest-FlavorsExtraSpecsTestJSON-1788838186 tempest-FlavorsExtraSpecsTestJSON-1788838186-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/1904671799/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.037981 Oct 29 02:45:26.310775 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 15/25] 10.222.0.46 () {60 vars in 1224 bytes} [Sat Oct 29 02:45:26 2022] POST /compute/v2.1/flavors/1904671799/os-extra_specs => generated 66 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:45:26.320209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-105a871a-fdc8-44ae-942d-41e474932087 tempest-KeyPairsV210TestJSON-1183118616 tempest-KeyPairsV210TestJSON-1183118616-project-admin] Calling method '.version_select at 0x7ff058d60700>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:26.347002 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-105a871a-fdc8-44ae-942d-41e474932087 tempest-KeyPairsV210TestJSON-1183118616 tempest-KeyPairsV210TestJSON-1183118616-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-164956475" status: 204 len: 0 microversion: 2.10 time: 0.034688 Oct 29 02:45:26.347760 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 16/26] 10.222.0.46 () {60 vars in 1322 bytes} [Sat Oct 29 02:45:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-164956475 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 02:45:26.352459 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6bbfb871-a8b4-4f98-9397-0b2ef93b537f tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Calling method '.version_select at 0x7ff058d73040>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:26.365778 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-6bbfb871-a8b4-4f98-9397-0b2ef93b537f tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:26.386790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6bbfb871-a8b4-4f98-9397-0b2ef93b537f tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Request method failure captured: Oct 29 02:45:26.386790 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 29 02:45:26.386790 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:45:26.386790 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:45:26.386790 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:45:26.386790 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:45:26.386790 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:45:26.386790 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:45:26.386790 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:45:26.386790 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:26.386790 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPDm0uoGzDsRMbiTCCbJMsZN5sNVS468zWYI7Ql364JskaX6rWoxcF932SmDC3iY2rFC6YqPKZu2YSnfn7wEPAdb6UGKNsBQtvt04uKRJvPKUFYAkpZwgMXW9B_7rEY-R6vW66M1OwSg1mwEEcTvuQe5QYU7tvq6huS69fhhPlrTho Oct 29 02:45:26.386790 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:45:26.386790 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:45:26.386790 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:45:26.386790 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:45:26.386790 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:45:26.386790 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:45:26.386790 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 417b13514e5f4d9d9026f3cf50f8e297 Oct 29 02:45:26.386790 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1719796590 Oct 29 02:45:26.386790 n-d-862967-2 devstack@n-api.service[127124]: X-Role: admin,reader,member Oct 29 02:45:26.386790 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: admin,reader,member Oct 29 02:45:26.388453 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/417b13514e5f4d9d9026f3cf50f8e297"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/417b13514e5f4d9d9026f3cf50f8e297"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_417b13514e5f4d9d9026f3cf50f8e297"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/417b13514e5f4d9d9026f3cf50f8e297"}]}] Oct 29 02:45:26.388453 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1719796590 Oct 29 02:45:26.388453 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 417b13514e5f4d9d9026f3cf50f8e297 Oct 29 02:45:26.388453 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1719796590 Oct 29 02:45:26.388453 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-HostsAdminNegativeTestJSON-1719796590-project-admin Oct 29 02:45:26.388453 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:45:26.388453 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:45:26.388453 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 2872d2389a594af9850442a8d962a952 Oct 29 02:45:26.388453 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1719796590-project-admin Oct 29 02:45:26.388453 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:45:26.388453 n-d-862967-2 devstack@n-api.service[127124]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:26.388453 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'nonexistent_hostname'} Oct 29 02:45:26.388453 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:26.389263 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:26.389263 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 29 02:45:26.389263 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 29 02:45:26.389263 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 02:45:26.389263 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 02:45:26.389263 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:26.389263 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:26.389263 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:26.389263 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:26.389263 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 02:45:26.389263 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 02:45:26.389263 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 29 02:45:26.389263 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 29 02:45:26.389263 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:45:26.389263 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:45:26.389263 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 29 02:45:26.389263 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 29 02:45:26.389263 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:45:26.389263 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:45:26.390323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 29 02:45:26.390323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 29 02:45:26.390323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:26.390323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.390323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:26.390323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.390323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:26.390323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:26.390323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:26.390323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:26.390323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:26.390323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:26.390323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:26.390323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:26.390323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:26.390323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 29 02:45:26.390323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 29 02:45:26.390323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 29 02:45:26.390323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:45:26.395815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:26.395815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.395815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:26.395815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.395815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:26.395815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:26.395815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:26.395815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:45:26.395815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:45:26.395815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:26.395815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.395815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6bbfb871-a8b4-4f98-9397-0b2ef93b537f tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:26.395815 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6bbfb871-a8b4-4f98-9397-0b2ef93b537f tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.041678 Oct 29 02:45:26.395815 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 17/27] 10.222.0.46 () {58 vars in 1218 bytes} [Sat Oct 29 02:45:26 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:45:26.399630 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-14ba89d4-e8d3-4da8-97fe-0d8756fa6575 tempest-FlavorsExtraSpecsTestJSON-1788838186 tempest-FlavorsExtraSpecsTestJSON-1788838186-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:26.408353 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-14ba89d4-e8d3-4da8-97fe-0d8756fa6575 tempest-FlavorsExtraSpecsTestJSON-1788838186 tempest-FlavorsExtraSpecsTestJSON-1788838186-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/1904671799/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.015708 Oct 29 02:45:26.408978 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 18/28] 10.222.0.46 () {58 vars in 1203 bytes} [Sat Oct 29 02:45:26 2022] GET /compute/v2.1/flavors/1904671799/os-extra_specs => generated 66 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:45:26.414814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-87119421-484c-48ff-aad1-162724dae054 tempest-KeyPairsV210TestJSON-1183118616 tempest-KeyPairsV210TestJSON-1183118616-project-admin] Calling method '.version_select at 0x7ff058c9aca0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:26.453688 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-87119421-484c-48ff-aad1-162724dae054 tempest-KeyPairsV210TestJSON-1183118616 tempest-KeyPairsV210TestJSON-1183118616-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-49661410?user_id=0227efa03cd84ddca63321ce11bfd94f" status: 204 len: 0 microversion: 2.10 time: 0.041817 Oct 29 02:45:26.454946 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 19/29] 10.222.0.46 () {60 vars in 1337 bytes} [Sat Oct 29 02:45:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-49661410?user_id=0227efa03cd84ddca63321ce11bfd94f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 02:45:26.461737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-05878116-74f1-4896-97e7-3a04aa485408 tempest-HostsAdminNegativeTestJSON-1728032266 tempest-HostsAdminNegativeTestJSON-1728032266-project] Calling method '.version_select at 0x7ff058d61700>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:26.467159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-05878116-74f1-4896-97e7-3a04aa485408 tempest-HostsAdminNegativeTestJSON-1728032266 tempest-HostsAdminNegativeTestJSON-1728032266-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '079e1ea67f74422f87fa6d4dca1ffb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af26d4d1a9c4bc8a4b720f57b92ef24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:26.473088 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-05878116-74f1-4896-97e7-3a04aa485408 tempest-HostsAdminNegativeTestJSON-1728032266 tempest-HostsAdminNegativeTestJSON-1728032266-project] Request method failure captured: Oct 29 02:45:26.473088 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/os-hosts/n-d-862967-2/startup HTTP/1.1 Oct 29 02:45:26.473088 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:45:26.473088 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:45:26.473088 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:45:26.473088 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:45:26.473088 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:45:26.473088 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:45:26.473088 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:45:26.473088 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:26.473088 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPBl-ExwX8xTLpQyx2nVzGX_EXitH8s-ZSb1ZocTW__G5Nd909lEq2IJ_DN2GX3Wsn8_n4pmnDqN0pP5YQCBTR-hPwtB_H68G8yyG7lVbxCRAX7PkWbM9GC9y2LHVW9Ay9yr0KnkQHz7MXG49f15JxSjFhmubyOgCakeY1dK6dZafY Oct 29 02:45:26.473088 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:45:26.473088 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:45:26.473088 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:45:26.473088 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:45:26.473088 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:45:26.473088 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:45:26.473088 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 4af26d4d1a9c4bc8a4b720f57b92ef24 Oct 29 02:45:26.473088 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1728032266 Oct 29 02:45:26.473088 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:45:26.473088 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:45:26.474435 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4af26d4d1a9c4bc8a4b720f57b92ef24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4af26d4d1a9c4bc8a4b720f57b92ef24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4af26d4d1a9c4bc8a4b720f57b92ef24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4af26d4d1a9c4bc8a4b720f57b92ef24"}]}] Oct 29 02:45:26.474435 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1728032266 Oct 29 02:45:26.474435 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 4af26d4d1a9c4bc8a4b720f57b92ef24 Oct 29 02:45:26.474435 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1728032266 Oct 29 02:45:26.474435 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-HostsAdminNegativeTestJSON-1728032266-project Oct 29 02:45:26.474435 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:45:26.474435 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:45:26.474435 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 079e1ea67f74422f87fa6d4dca1ffb49 Oct 29 02:45:26.474435 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1728032266-project Oct 29 02:45:26.474435 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:45:26.474435 n-d-862967-2 devstack@n-api.service[127124]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 29 02:45:26.474435 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'n-d-862967-2'} Oct 29 02:45:26.474435 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:26.475306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:26.475306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:26.475306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:26.475306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:26.475306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:26.475306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:26.475306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:26.475306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:26.475306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:26.475306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 29 02:45:26.475306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 29 02:45:26.475306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:26.475306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:26.475306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:26.475306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:26.475306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:26.475306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:26.475306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:26.475306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:26.476409 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:26.476409 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:26.476409 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:26.476409 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:26.476409 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:26.476409 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:26.476409 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 29 02:45:26.476409 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.476409 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:26.476409 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.476409 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:26.476409 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:26.476409 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:26.476409 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:26.476409 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:26.476409 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 29 02:45:26.476409 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.478447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-05878116-74f1-4896-97e7-3a04aa485408 tempest-HostsAdminNegativeTestJSON-1728032266 tempest-HostsAdminNegativeTestJSON-1728032266-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:26.478447 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-05878116-74f1-4896-97e7-3a04aa485408 tempest-HostsAdminNegativeTestJSON-1728032266 tempest-HostsAdminNegativeTestJSON-1728032266-project] 10.222.0.46 "GET /compute/v2.1/os-hosts/n-d-862967-2/startup" status: 403 len: 110 microversion: 2.1 time: 0.018595 Oct 29 02:45:26.482550 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 20/30] 10.222.0.46 () {58 vars in 1191 bytes} [Sat Oct 29 02:45:26 2022] GET /compute/v2.1/os-hosts/n-d-862967-2/startup => generated 110 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:45:26.488993 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cad11ae2-72e4-450b-8794-cb3de4b85c87 tempest-FlavorsExtraSpecsTestJSON-1788838186 tempest-FlavorsExtraSpecsTestJSON-1788838186-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:26.535383 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6c681cd4-f1ea-4ca5-b9f9-8d6b3e5c99e1 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 226 microversion: 2.1 time: 0.773834 Oct 29 02:45:26.537032 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 11/31] 10.222.0.46 () {60 vars in 1191 bytes} [Sat Oct 29 02:45:25 2022] POST /compute/v2.1/os-aggregates/1/action => generated 226 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:26.543383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e4f6ffe1-283e-4694-b245-1c20c4d4b3f5 tempest-KeyPairsV210TestJSON-1183118616 tempest-KeyPairsV210TestJSON-1183118616-project-admin] Calling method '.version_select at 0x7ff05937e040>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:26.549469 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cad11ae2-72e4-450b-8794-cb3de4b85c87 tempest-FlavorsExtraSpecsTestJSON-1788838186 tempest-FlavorsExtraSpecsTestJSON-1788838186-project-admin] 10.222.0.46 "PUT /compute/v2.1/flavors/1904671799/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.064948 Oct 29 02:45:26.550066 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 21/32] 10.222.0.46 () {60 vars in 1265 bytes} [Sat Oct 29 02:45:26 2022] PUT /compute/v2.1/flavors/1904671799/os-extra_specs/hw:numa_nodes => generated 22 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:45:26.555103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7488ecc0-71b0-40ff-b872-ae79c2fbf275 tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Calling method '.version_select at 0x7ff058c9f8b0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:26.559291 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4,nova_api:SAVEPOINT=6,nova_api:RELEASE=6,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:26.569375 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e4f6ffe1-283e-4694-b245-1c20c4d4b3f5 tempest-KeyPairsV210TestJSON-1183118616 tempest-KeyPairsV210TestJSON-1183118616-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-185457367?user_id=0227efa03cd84ddca63321ce11bfd94f" status: 204 len: 0 microversion: 2.10 time: 0.030464 Oct 29 02:45:26.570378 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-7488ecc0-71b0-40ff-b872-ae79c2fbf275 tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:26.570634 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 12/33] 10.222.0.46 () {60 vars in 1340 bytes} [Sat Oct 29 02:45:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-185457367?user_id=0227efa03cd84ddca63321ce11bfd94f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 02:45:26.573995 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7488ecc0-71b0-40ff-b872-ae79c2fbf275 tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Request method failure captured: Oct 29 02:45:26.573995 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 29 02:45:26.573995 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:45:26.573995 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:45:26.573995 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:45:26.573995 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:45:26.573995 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:45:26.573995 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:45:26.573995 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:45:26.573995 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:26.573995 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPDm0uoGzDsRMbiTCCbJMsZN5sNVS468zWYI7Ql364JskaX6rWoxcF932SmDC3iY2rFC6YqPKZu2YSnfn7wEPAdb6UGKNsBQtvt04uKRJvPKUFYAkpZwgMXW9B_7rEY-R6vW66M1OwSg1mwEEcTvuQe5QYU7tvq6huS69fhhPlrTho Oct 29 02:45:26.573995 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:45:26.573995 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:45:26.573995 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:45:26.573995 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:45:26.573995 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:45:26.573995 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:45:26.573995 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 417b13514e5f4d9d9026f3cf50f8e297 Oct 29 02:45:26.573995 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1719796590 Oct 29 02:45:26.573995 n-d-862967-2 devstack@n-api.service[127124]: X-Role: admin,reader,member Oct 29 02:45:26.573995 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: admin,reader,member Oct 29 02:45:26.575273 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/417b13514e5f4d9d9026f3cf50f8e297"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/417b13514e5f4d9d9026f3cf50f8e297"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_417b13514e5f4d9d9026f3cf50f8e297"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/417b13514e5f4d9d9026f3cf50f8e297"}]}] Oct 29 02:45:26.575273 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1719796590 Oct 29 02:45:26.575273 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 417b13514e5f4d9d9026f3cf50f8e297 Oct 29 02:45:26.575273 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1719796590 Oct 29 02:45:26.575273 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-HostsAdminNegativeTestJSON-1719796590-project-admin Oct 29 02:45:26.575273 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:45:26.575273 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:45:26.575273 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 2872d2389a594af9850442a8d962a952 Oct 29 02:45:26.575273 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1719796590-project-admin Oct 29 02:45:26.575273 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:45:26.575273 n-d-862967-2 devstack@n-api.service[127124]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:26.575273 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'nonexistent_hostname'} Oct 29 02:45:26.575273 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:26.576081 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:26.576081 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 29 02:45:26.576081 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 29 02:45:26.576081 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 02:45:26.576081 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 02:45:26.576081 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:26.576081 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:26.576081 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:26.576081 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:26.576081 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 02:45:26.576081 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 02:45:26.576081 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 29 02:45:26.576081 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 29 02:45:26.576081 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:45:26.576081 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:45:26.576081 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 29 02:45:26.576081 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 29 02:45:26.576081 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:45:26.576081 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:45:26.577069 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 29 02:45:26.577069 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 29 02:45:26.577069 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:26.577069 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.577069 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:26.577069 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.577069 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:26.577069 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:26.577069 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:26.577069 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:26.577069 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:26.577069 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:26.577069 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:26.577069 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:26.577069 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:26.577069 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 29 02:45:26.577069 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 29 02:45:26.577069 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 29 02:45:26.577069 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:45:26.578020 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:26.578020 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.578020 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:26.578020 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.578020 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:26.578020 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:26.578020 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:26.578020 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:45:26.578020 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:45:26.578020 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:26.578020 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.578543 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7488ecc0-71b0-40ff-b872-ae79c2fbf275 tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:26.579242 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7488ecc0-71b0-40ff-b872-ae79c2fbf275 tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.027856 Oct 29 02:45:26.580670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-be3b2977-9f51-48e2-bf94-3a4c02c65df9 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:26.581249 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 22/34] 10.222.0.46 () {58 vars in 1215 bytes} [Sat Oct 29 02:45:26 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:45:26.589711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0b00f542-08e9-4864-806b-1f919a9df198 tempest-FlavorsExtraSpecsTestJSON-1788838186 tempest-FlavorsExtraSpecsTestJSON-1788838186-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:26.599015 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0b00f542-08e9-4864-806b-1f919a9df198 tempest-FlavorsExtraSpecsTestJSON-1788838186 tempest-FlavorsExtraSpecsTestJSON-1788838186-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/1904671799/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.015151 Oct 29 02:45:26.599581 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 23/35] 10.222.0.46 () {58 vars in 1203 bytes} [Sat Oct 29 02:45:26 2022] GET /compute/v2.1/flavors/1904671799/os-extra_specs => generated 66 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:45:26.604850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eb915f52-6fdc-4ace-8bb4-05883fc5d1bf tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Action: 'update', calling method: .version_select at 0x7ff058c9a820>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:26.612233 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-be3b2977-9f51-48e2-bf94-3a4c02c65df9 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.040247 Oct 29 02:45:26.613298 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 13/36] 10.222.0.46 () {58 vars in 1152 bytes} [Sat Oct 29 02:45:26 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:45:26.613597 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eb915f52-6fdc-4ace-8bb4-05883fc5d1bf tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Request method failure captured: Oct 29 02:45:26.613597 n-d-862967-2 devstack@n-api.service[127124]: request: PUT /compute/v2.1/os-hosts/n-d-862967-2 HTTP/1.1 Oct 29 02:45:26.613597 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:45:26.613597 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:45:26.613597 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:45:26.613597 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 51 Oct 29 02:45:26.613597 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:45:26.613597 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:45:26.613597 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:45:26.613597 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:26.613597 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPDm0uoGzDsRMbiTCCbJMsZN5sNVS468zWYI7Ql364JskaX6rWoxcF932SmDC3iY2rFC6YqPKZu2YSnfn7wEPAdb6UGKNsBQtvt04uKRJvPKUFYAkpZwgMXW9B_7rEY-R6vW66M1OwSg1mwEEcTvuQe5QYU7tvq6huS69fhhPlrTho Oct 29 02:45:26.613597 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:45:26.613597 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:45:26.613597 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:45:26.613597 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:45:26.613597 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:45:26.613597 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:45:26.613597 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 417b13514e5f4d9d9026f3cf50f8e297 Oct 29 02:45:26.613597 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1719796590 Oct 29 02:45:26.613597 n-d-862967-2 devstack@n-api.service[127124]: X-Role: admin,reader,member Oct 29 02:45:26.613597 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: admin,reader,member Oct 29 02:45:26.614673 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/417b13514e5f4d9d9026f3cf50f8e297"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/417b13514e5f4d9d9026f3cf50f8e297"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_417b13514e5f4d9d9026f3cf50f8e297"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/417b13514e5f4d9d9026f3cf50f8e297"}]}] Oct 29 02:45:26.614673 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1719796590 Oct 29 02:45:26.614673 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 417b13514e5f4d9d9026f3cf50f8e297 Oct 29 02:45:26.614673 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1719796590 Oct 29 02:45:26.614673 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-HostsAdminNegativeTestJSON-1719796590-project-admin Oct 29 02:45:26.614673 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:45:26.614673 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:45:26.614673 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 2872d2389a594af9850442a8d962a952 Oct 29 02:45:26.614673 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1719796590-project-admin Oct 29 02:45:26.614673 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:45:26.614673 n-d-862967-2 devstack@n-api.service[127124]: {"status": "enable", "maintenance_mode": "invalid"} Oct 29 02:45:26.614673 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:45:26.614673 n-d-862967-2 devstack@n-api.service[127124]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 02:45:26.615294 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'n-d-862967-2', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 29 02:45:26.615294 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:26.615294 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:26.615294 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:45:26.615294 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:45:26.615294 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:45:26.615294 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:45:26.615294 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 02:45:26.615294 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.615294 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 29 02:45:26.615294 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 29 02:45:26.615294 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'disable', Oct 29 02:45:26.615294 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'Enable', Oct 29 02:45:26.615294 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'Disable', Oct 29 02:45:26.615294 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 29 02:45:26.615294 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 29 02:45:26.615294 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 29 02:45:26.615294 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.615294 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi On instance: Oct 29 02:45:26.615294 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'invalid' Oct 29 02:45:26.615294 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.615294 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:26.615294 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.615294 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:26.615294 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:26.616491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:26.616491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:26.616491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:26.616491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:26.616491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:26.616491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:26.616491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:26.616491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:45:26.616491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:45:26.616491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:45:26.616491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:45:26.616491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:45:26.616491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:45:26.616491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 02:45:26.616491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.616491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:26.616491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.616491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:26.616491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:26.617510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:26.617510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:45:26.617510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:45:26.617510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 02:45:26.617510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.617510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eb915f52-6fdc-4ace-8bb4-05883fc5d1bf tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:26.617510 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eb915f52-6fdc-4ace-8bb4-05883fc5d1bf tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-hosts/n-d-862967-2" status: 400 len: 199 microversion: 2.1 time: 0.014217 Oct 29 02:45:26.617510 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 24/37] 10.222.0.46 () {60 vars in 1187 bytes} [Sat Oct 29 02:45:26 2022] PUT /compute/v2.1/os-hosts/n-d-862967-2 => generated 199 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:45:26.623409 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-30af914a-1e0e-4988-9803-7fc61c7a8727 tempest-FlavorsExtraSpecsTestJSON-1788838186 tempest-FlavorsExtraSpecsTestJSON-1788838186-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:26.660785 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-30af914a-1e0e-4988-9803-7fc61c7a8727 tempest-FlavorsExtraSpecsTestJSON-1788838186 tempest-FlavorsExtraSpecsTestJSON-1788838186-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1904671799/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.043917 Oct 29 02:45:26.664654 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 25/38] 10.222.0.46 () {58 vars in 1248 bytes} [Sat Oct 29 02:45:26 2022] DELETE /compute/v2.1/flavors/1904671799/os-extra_specs/hw:numa_nodes => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:45:26.667150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3ae4274c-4903-41cb-839a-396a3b1be80e tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1876015334"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:26.670828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.aggregate [None req-3ae4274c-4903-41cb-839a-396a3b1be80e tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Generated uuid 9f5c81a8-2fa2-416c-8ad1-aaa4d37a9329 for aggregate {{(pid=127124) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:45:26.700460 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3ae4274c-4903-41cb-839a-396a3b1be80e tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.037334 Oct 29 02:45:26.701086 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 26/39] 10.222.0.46 () {60 vars in 1164 bytes} [Sat Oct 29 02:45:26 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:26.705609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0e2b409a-95f7-40b2-8285-fbb870824450 tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Action: 'update', calling method: .version_select at 0x7ff058c9a1f0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:26.709741 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0e2b409a-95f7-40b2-8285-fbb870824450 tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Request method failure captured: Oct 29 02:45:26.709741 n-d-862967-2 devstack@n-api.service[127124]: request: PUT /compute/v2.1/os-hosts/n-d-862967-2 HTTP/1.1 Oct 29 02:45:26.709741 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:45:26.709741 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:45:26.709741 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:45:26.709741 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 51 Oct 29 02:45:26.709741 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:45:26.709741 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:45:26.709741 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:45:26.709741 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:26.709741 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPDm0uoGzDsRMbiTCCbJMsZN5sNVS468zWYI7Ql364JskaX6rWoxcF932SmDC3iY2rFC6YqPKZu2YSnfn7wEPAdb6UGKNsBQtvt04uKRJvPKUFYAkpZwgMXW9B_7rEY-R6vW66M1OwSg1mwEEcTvuQe5QYU7tvq6huS69fhhPlrTho Oct 29 02:45:26.709741 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:45:26.709741 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:45:26.709741 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:45:26.709741 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:45:26.709741 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:45:26.709741 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:45:26.709741 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 417b13514e5f4d9d9026f3cf50f8e297 Oct 29 02:45:26.709741 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1719796590 Oct 29 02:45:26.709741 n-d-862967-2 devstack@n-api.service[127124]: X-Role: admin,reader,member Oct 29 02:45:26.709741 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: admin,reader,member Oct 29 02:45:26.711192 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/417b13514e5f4d9d9026f3cf50f8e297"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/417b13514e5f4d9d9026f3cf50f8e297"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_417b13514e5f4d9d9026f3cf50f8e297"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/417b13514e5f4d9d9026f3cf50f8e297"}]}] Oct 29 02:45:26.711192 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1719796590 Oct 29 02:45:26.711192 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 417b13514e5f4d9d9026f3cf50f8e297 Oct 29 02:45:26.711192 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1719796590 Oct 29 02:45:26.711192 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-HostsAdminNegativeTestJSON-1719796590-project-admin Oct 29 02:45:26.711192 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:45:26.711192 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:45:26.711192 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 2872d2389a594af9850442a8d962a952 Oct 29 02:45:26.711192 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1719796590-project-admin Oct 29 02:45:26.711192 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:45:26.711192 n-d-862967-2 devstack@n-api.service[127124]: {"status": "invalid", "maintenance_mode": "enable"} Oct 29 02:45:26.711192 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:45:26.711192 n-d-862967-2 devstack@n-api.service[127124]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 02:45:26.711822 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'n-d-862967-2', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 29 02:45:26.711822 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:26.711822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:26.711822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:45:26.711822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:45:26.711822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:45:26.711822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:45:26.711822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 02:45:26.711822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.711822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 29 02:45:26.711822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 29 02:45:26.711822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'disable', Oct 29 02:45:26.711822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'Enable', Oct 29 02:45:26.711822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'Disable', Oct 29 02:45:26.711822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 29 02:45:26.711822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 29 02:45:26.711822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 29 02:45:26.711822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.711822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi On instance: Oct 29 02:45:26.711822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'invalid' Oct 29 02:45:26.711822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.711822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:26.711822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.711822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:26.711822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:26.713007 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:26.713007 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:26.713007 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:26.713007 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:26.713007 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:26.713007 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:26.713007 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:26.713007 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:45:26.713007 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:45:26.713007 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:45:26.713007 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:45:26.713007 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:45:26.713007 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:45:26.713007 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 02:45:26.713007 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.713007 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:26.713007 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.713007 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:26.713007 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:26.713876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:26.713876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:45:26.713876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:45:26.713876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 29 02:45:26.713876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:26.715691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0e2b409a-95f7-40b2-8285-fbb870824450 tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:26.716729 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0e2b409a-95f7-40b2-8285-fbb870824450 tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-hosts/n-d-862967-2" status: 400 len: 189 microversion: 2.1 time: 0.014540 Oct 29 02:45:26.717760 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 27/40] 10.222.0.46 () {60 vars in 1187 bytes} [Sat Oct 29 02:45:26 2022] PUT /compute/v2.1/os-hosts/n-d-862967-2 => generated 189 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:45:26.723431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5389ee97-969c-43e1-b302-4620c9e424f3 tempest-FlavorsExtraSpecsTestJSON-1788838186 tempest-FlavorsExtraSpecsTestJSON-1788838186-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:26.752648 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5389ee97-969c-43e1-b302-4620c9e424f3 tempest-FlavorsExtraSpecsTestJSON-1788838186 tempest-FlavorsExtraSpecsTestJSON-1788838186-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1904671799/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.032911 Oct 29 02:45:26.752648 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 28/41] 10.222.0.46 () {58 vars in 1248 bytes} [Sat Oct 29 02:45:26 2022] DELETE /compute/v2.1/flavors/1904671799/os-extra_specs/hw:cpu_policy => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:45:26.757601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e2622d9a-6863-45b8-aa33-bcba7003c381 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1815932381", "name": "tempest-test_aggregate-320835727"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:26.783634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.aggregate [None req-e2622d9a-6863-45b8-aa33-bcba7003c381 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Generated uuid ba56c35a-5251-40e8-85d9-ed6a08a7f06c for aggregate {{(pid=127124) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:45:26.819848 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e2622d9a-6863-45b8-aa33-bcba7003c381 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.065815 Oct 29 02:45:26.821602 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 29/42] 10.222.0.46 () {60 vars in 1165 bytes} [Sat Oct 29 02:45:26 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:26.997273 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8b3526f8-cbd0-4b38-a80a-6f2fbacbb538 tempest-FlavorsV255TestJSON-79294214 tempest-FlavorsV255TestJSON-79294214-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-500176859", "id": 1324995378, "os-flavor-access:is_public": "True"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:27.017756 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8b3526f8-cbd0-4b38-a80a-6f2fbacbb538 tempest-FlavorsV255TestJSON-79294214 tempest-FlavorsV255TestJSON-79294214-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.403322 Oct 29 02:45:27.019166 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 14/43] 10.222.0.46 () {62 vars in 1188 bytes} [Sat Oct 29 02:45:26 2022] POST /compute/v2.1/flavors => generated 448 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:45:27.025097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-70e63503-4305-48bd-915e-70803093e43f tempest-HostsAdminNegativeTestJSON-1728032266 tempest-HostsAdminNegativeTestJSON-1728032266-project] Action: 'update', calling method: .version_select at 0x7ff05933ac10>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:27.028874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-70e63503-4305-48bd-915e-70803093e43f tempest-HostsAdminNegativeTestJSON-1728032266 tempest-HostsAdminNegativeTestJSON-1728032266-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '079e1ea67f74422f87fa6d4dca1ffb49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4af26d4d1a9c4bc8a4b720f57b92ef24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:27.030815 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-70e63503-4305-48bd-915e-70803093e43f tempest-HostsAdminNegativeTestJSON-1728032266 tempest-HostsAdminNegativeTestJSON-1728032266-project] Request method failure captured: Oct 29 02:45:27.030815 n-d-862967-2 devstack@n-api.service[127125]: request: PUT /compute/v2.1/os-hosts/n-d-862967-2 HTTP/1.1 Oct 29 02:45:27.030815 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:45:27.030815 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:45:27.030815 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:45:27.030815 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 50 Oct 29 02:45:27.030815 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:45:27.030815 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:45:27.030815 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:45:27.030815 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:27.030815 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPBl-ExwX8xTLpQyx2nVzGX_EXitH8s-ZSb1ZocTW__G5Nd909lEq2IJ_DN2GX3Wsn8_n4pmnDqN0pP5YQCBTR-hPwtB_H68G8yyG7lVbxCRAX7PkWbM9GC9y2LHVW9Ay9yr0KnkQHz7MXG49f15JxSjFhmubyOgCakeY1dK6dZafY Oct 29 02:45:27.030815 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:45:27.030815 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:45:27.030815 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:45:27.030815 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:45:27.030815 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:45:27.030815 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:45:27.030815 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 4af26d4d1a9c4bc8a4b720f57b92ef24 Oct 29 02:45:27.030815 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1728032266 Oct 29 02:45:27.030815 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:45:27.030815 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:45:27.031884 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4af26d4d1a9c4bc8a4b720f57b92ef24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4af26d4d1a9c4bc8a4b720f57b92ef24"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4af26d4d1a9c4bc8a4b720f57b92ef24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4af26d4d1a9c4bc8a4b720f57b92ef24"}]}] Oct 29 02:45:27.031884 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1728032266 Oct 29 02:45:27.031884 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 4af26d4d1a9c4bc8a4b720f57b92ef24 Oct 29 02:45:27.031884 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1728032266 Oct 29 02:45:27.031884 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-HostsAdminNegativeTestJSON-1728032266-project Oct 29 02:45:27.031884 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:45:27.031884 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:45:27.031884 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 079e1ea67f74422f87fa6d4dca1ffb49 Oct 29 02:45:27.031884 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1728032266-project Oct 29 02:45:27.031884 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:45:27.031884 n-d-862967-2 devstack@n-api.service[127125]: {"status": "enable", "maintenance_mode": "enable"} Oct 29 02:45:27.031884 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:45:27.031884 n-d-862967-2 devstack@n-api.service[127125]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 29 02:45:27.031884 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'n-d-862967-2', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 29 02:45:27.032583 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:27.032583 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:27.032583 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:27.032583 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:27.032583 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:27.032583 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:27.032583 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:27.032583 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:27.032583 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:27.032583 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:27.032583 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:45:27.032583 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:45:27.032583 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 29 02:45:27.032583 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 29 02:45:27.032583 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:27.032583 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:27.032583 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:27.032583 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:27.032583 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:27.032583 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:27.033548 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:27.033548 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:27.033548 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:27.033548 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:27.033548 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:27.033548 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:27.033548 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:27.033548 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:27.033548 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 29 02:45:27.033548 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.033548 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:27.033548 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.033548 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:27.033548 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:27.033548 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:27.033548 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:27.033548 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:27.033548 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 29 02:45:27.033548 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.037027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-70e63503-4305-48bd-915e-70803093e43f tempest-HostsAdminNegativeTestJSON-1728032266 tempest-HostsAdminNegativeTestJSON-1728032266-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:27.038267 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-70e63503-4305-48bd-915e-70803093e43f tempest-HostsAdminNegativeTestJSON-1728032266 tempest-HostsAdminNegativeTestJSON-1728032266-project] 10.222.0.46 "PUT /compute/v2.1/os-hosts/n-d-862967-2" status: 403 len: 111 microversion: 2.1 time: 0.017377 Oct 29 02:45:27.039367 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 15/44] 10.222.0.46 () {60 vars in 1187 bytes} [Sat Oct 29 02:45:27 2022] PUT /compute/v2.1/os-hosts/n-d-862967-2 => generated 111 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:45:27.045940 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a0ef0344-740f-4674-ba0e-d5f97d3cec79 tempest-FlavorsExtraSpecsTestJSON-1788838186 tempest-FlavorsExtraSpecsTestJSON-1788838186-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:27.056293 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a0ef0344-740f-4674-ba0e-d5f97d3cec79 tempest-FlavorsExtraSpecsTestJSON-1788838186 tempest-FlavorsExtraSpecsTestJSON-1788838186-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/1904671799/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015318 Oct 29 02:45:27.058242 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 16/45] 10.222.0.46 () {58 vars in 1203 bytes} [Sat Oct 29 02:45:27 2022] GET /compute/v2.1/flavors/1904671799/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:45:27.066151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9f34a015-3208-45c3-9d2c-9794a5ecc559 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:27.094775 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9f34a015-3208-45c3-9d2c-9794a5ecc559 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates" status: 200 len: 516 microversion: 2.1 time: 0.035115 Oct 29 02:45:27.096096 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 17/46] 10.222.0.46 () {58 vars in 1143 bytes} [Sat Oct 29 02:45:27 2022] GET /compute/v2.1/os-aggregates => generated 516 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:27.210875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-89974f49-f33d-438d-9373-25a6b4d7fb47 tempest-AggregatesAdminNegativeTestJSON-403218376 tempest-AggregatesAdminNegativeTestJSON-403218376-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862967-2"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:27.215865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-89974f49-f33d-438d-9373-25a6b4d7fb47 tempest-AggregatesAdminNegativeTestJSON-403218376 tempest-AggregatesAdminNegativeTestJSON-403218376-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'c961002e41414df5bc0221bdf7fb280d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ad7859f394422abaadf6deb81a9752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:27.219319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-89974f49-f33d-438d-9373-25a6b4d7fb47 tempest-AggregatesAdminNegativeTestJSON-403218376 tempest-AggregatesAdminNegativeTestJSON-403218376-project] Request method failure captured: Oct 29 02:45:27.219319 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 29 02:45:27.219319 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:45:27.219319 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:45:27.219319 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:45:27.219319 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 39 Oct 29 02:45:27.219319 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:45:27.219319 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:45:27.219319 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:45:27.219319 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:27.219319 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPB4S28dCyzCv4-q84mlKV6urxO7FgUHDpfMiQ23jOywiUnnPNu2GINhuCL6wOTXKxEqfuJYpESJZ3BJQovv7mJcPNwUXVNK4Av02PFsHAJUh4IFybm1TuH0tqZlJKM_OfSNtwKiroZ1G-Q0ulSwfszrxP5r6SZgL8HRZGYEXe_k90 Oct 29 02:45:27.219319 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:45:27.219319 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:45:27.219319 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:45:27.219319 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:45:27.219319 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:45:27.219319 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:45:27.219319 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: e4ad7859f394422abaadf6deb81a9752 Oct 29 02:45:27.219319 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-403218376 Oct 29 02:45:27.219319 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:45:27.219319 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:45:27.220366 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e4ad7859f394422abaadf6deb81a9752"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e4ad7859f394422abaadf6deb81a9752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e4ad7859f394422abaadf6deb81a9752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e4ad7859f394422abaadf6deb81a9752"}]}] Oct 29 02:45:27.220366 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-403218376 Oct 29 02:45:27.220366 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: e4ad7859f394422abaadf6deb81a9752 Oct 29 02:45:27.220366 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-403218376 Oct 29 02:45:27.220366 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-AggregatesAdminNegativeTestJSON-403218376-project Oct 29 02:45:27.220366 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:45:27.220366 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:45:27.220366 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: c961002e41414df5bc0221bdf7fb280d Oct 29 02:45:27.220366 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-403218376-project Oct 29 02:45:27.220366 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:45:27.220366 n-d-862967-2 devstack@n-api.service[127124]: {"add_host": {"host": "n-h2-862967-2"}} Oct 29 02:45:27.220366 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:45:27.220366 n-d-862967-2 devstack@n-api.service[127124]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 29 02:45:27.221608 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-862967-2'}}} Oct 29 02:45:27.221608 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:27.221608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:27.221608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:27.221608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:27.221608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:27.221608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:27.221608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:27.221608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:27.221608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:45:27.221608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:45:27.221608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 29 02:45:27.221608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 29 02:45:27.221608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:27.221608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:27.221608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:27.221608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:27.221608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:27.221608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:27.222549 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:27.222549 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:27.222549 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:27.222549 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:27.222549 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:27.222549 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:27.222549 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:27.222549 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:27.222549 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 29 02:45:27.222549 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.222549 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:27.222549 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.222549 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:27.222549 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:27.222549 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:27.222549 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:27.222549 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:27.222549 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 29 02:45:27.222549 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.224448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-89974f49-f33d-438d-9373-25a6b4d7fb47 tempest-AggregatesAdminNegativeTestJSON-403218376 tempest-AggregatesAdminNegativeTestJSON-403218376-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:27.224448 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-89974f49-f33d-438d-9373-25a6b4d7fb47 tempest-AggregatesAdminNegativeTestJSON-403218376 tempest-AggregatesAdminNegativeTestJSON-403218376-project] 10.222.0.46 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.398727 Oct 29 02:45:27.224448 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 30/47] 10.222.0.46 () {60 vars in 1191 bytes} [Sat Oct 29 02:45:26 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 401 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:45:27.228007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3f3818fc-fddb-49cf-acf6-2af547fc4b81 tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Action: 'update', calling method: .version_select at 0x7ff058c9a550>, body: {"status": null, "maintenance_mode": null} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:27.231736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3f3818fc-fddb-49cf-acf6-2af547fc4b81 tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Request method failure captured: Oct 29 02:45:27.231736 n-d-862967-2 devstack@n-api.service[127124]: request: PUT /compute/v2.1/os-hosts/n-d-862967-2 HTTP/1.1 Oct 29 02:45:27.231736 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:45:27.231736 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:45:27.231736 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:45:27.231736 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 42 Oct 29 02:45:27.231736 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:45:27.231736 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:45:27.231736 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:45:27.231736 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:27.231736 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPDm0uoGzDsRMbiTCCbJMsZN5sNVS468zWYI7Ql364JskaX6rWoxcF932SmDC3iY2rFC6YqPKZu2YSnfn7wEPAdb6UGKNsBQtvt04uKRJvPKUFYAkpZwgMXW9B_7rEY-R6vW66M1OwSg1mwEEcTvuQe5QYU7tvq6huS69fhhPlrTho Oct 29 02:45:27.231736 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:45:27.231736 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:45:27.231736 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:45:27.231736 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:45:27.231736 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:45:27.231736 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:45:27.231736 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 417b13514e5f4d9d9026f3cf50f8e297 Oct 29 02:45:27.231736 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1719796590 Oct 29 02:45:27.231736 n-d-862967-2 devstack@n-api.service[127124]: X-Role: admin,reader,member Oct 29 02:45:27.231736 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: admin,reader,member Oct 29 02:45:27.232788 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/417b13514e5f4d9d9026f3cf50f8e297"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/417b13514e5f4d9d9026f3cf50f8e297"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_417b13514e5f4d9d9026f3cf50f8e297"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/417b13514e5f4d9d9026f3cf50f8e297"}]}] Oct 29 02:45:27.232788 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1719796590 Oct 29 02:45:27.232788 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 417b13514e5f4d9d9026f3cf50f8e297 Oct 29 02:45:27.232788 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1719796590 Oct 29 02:45:27.232788 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-HostsAdminNegativeTestJSON-1719796590-project-admin Oct 29 02:45:27.232788 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:45:27.232788 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:45:27.232788 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 2872d2389a594af9850442a8d962a952 Oct 29 02:45:27.232788 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1719796590-project-admin Oct 29 02:45:27.232788 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:45:27.232788 n-d-862967-2 devstack@n-api.service[127124]: {"status": null, "maintenance_mode": null} Oct 29 02:45:27.232788 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:45:27.232788 n-d-862967-2 devstack@n-api.service[127124]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 29 02:45:27.232788 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'n-d-862967-2', 'body': {'status': None, 'maintenance_mode': None}} Oct 29 02:45:27.233501 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:27.233501 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:27.233501 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:45:27.233501 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:45:27.233501 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:45:27.233501 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:45:27.233501 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 29 02:45:27.233501 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.233501 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 29 02:45:27.233501 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 29 02:45:27.233501 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'disable', Oct 29 02:45:27.233501 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'Enable', Oct 29 02:45:27.233501 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'Disable', Oct 29 02:45:27.233501 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 29 02:45:27.233501 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 29 02:45:27.233501 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 29 02:45:27.233501 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.233501 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi On instance: Oct 29 02:45:27.233501 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi None Oct 29 02:45:27.233501 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.233501 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:27.233501 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.233501 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:27.233501 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:27.233501 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:27.234946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:27.234946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:27.234946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:27.234946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:27.234946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:27.234946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:27.234946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:45:27.234946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:45:27.234946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:45:27.234946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:45:27.234946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:45:27.234946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:45:27.234946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 29 02:45:27.234946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.234946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:27.234946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.234946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:27.234946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:27.234946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:27.238296 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:45:27.238296 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:45:27.238296 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 29 02:45:27.238296 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.238296 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3f3818fc-fddb-49cf-acf6-2af547fc4b81 tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:27.238296 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3f3818fc-fddb-49cf-acf6-2af547fc4b81 tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-hosts/n-d-862967-2" status: 400 len: 127 microversion: 2.1 time: 0.009529 Oct 29 02:45:27.238296 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 31/48] 10.222.0.46 () {60 vars in 1187 bytes} [Sat Oct 29 02:45:27 2022] PUT /compute/v2.1/os-hosts/n-d-862967-2 => generated 127 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:45:27.238844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-df68e519-dd39-4220-8e54-8fb337b07872 tempest-FlavorsExtraSpecsTestJSON-1788838186 tempest-FlavorsExtraSpecsTestJSON-1788838186-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:27.267923 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-df68e519-dd39-4220-8e54-8fb337b07872 tempest-FlavorsExtraSpecsTestJSON-1788838186 tempest-FlavorsExtraSpecsTestJSON-1788838186-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1904671799" status: 202 len: 0 microversion: 2.1 time: 0.032961 Oct 29 02:45:27.268661 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 32/49] 10.222.0.46 () {58 vars in 1161 bytes} [Sat Oct 29 02:45:27 2022] DELETE /compute/v2.1/flavors/1904671799 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:45:27.273375 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-15d26b7f-b514-4707-932a-9e0a669499cf tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862967-2"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:27.283789 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-15d26b7f-b514-4707-932a-9e0a669499cf tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:27.284281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-15d26b7f-b514-4707-932a-9e0a669499cf tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:27.284752 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-15d26b7f-b514-4707-932a-9e0a669499cf tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:27.359600 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8da35785-4a02-4afd-9c96-8ec5fe4e0e9a tempest-FlavorsV255TestJSON-1465436890 tempest-FlavorsV255TestJSON-1465436890-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:27.385364 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8da35785-4a02-4afd-9c96-8ec5fe4e0e9a tempest-FlavorsV255TestJSON-1465436890 tempest-FlavorsV255TestJSON-1465436890-project] 10.222.0.46 "GET /compute/v2.1/flavors/1324995378" status: 200 len: 448 microversion: 2.55 time: 0.287948 Oct 29 02:45:27.386678 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 18/50] 10.222.0.46 () {60 vars in 1199 bytes} [Sat Oct 29 02:45:27 2022] GET /compute/v2.1/flavors/1324995378 => generated 448 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:45:27.392032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b074dbcb-a891-4695-bd26-e49ef14d6ae3 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:27.450482 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b074dbcb-a891-4695-bd26-e49ef14d6ae3 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.059749 Oct 29 02:45:27.450482 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 19/51] 10.222.0.46 () {58 vars in 1152 bytes} [Sat Oct 29 02:45:27 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:45:27.455629 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dbd0b631-0fc1-4131-968e-170324b98e0b tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Action: 'update', calling method: .version_select at 0x7ff05937ec10>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:27.459953 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.hosts [None req-dbd0b631-0fc1-4131-968e-170324b98e0b tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Enabling host nonexistent_hostname. Oct 29 02:45:27.474278 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-dbd0b631-0fc1-4131-968e-170324b98e0b tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:27.477319 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dbd0b631-0fc1-4131-968e-170324b98e0b tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Request method failure captured: Oct 29 02:45:27.477319 n-d-862967-2 devstack@n-api.service[127125]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 29 02:45:27.477319 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:45:27.477319 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:45:27.477319 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:45:27.477319 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 50 Oct 29 02:45:27.477319 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:45:27.477319 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:45:27.477319 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:45:27.477319 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:27.477319 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPDm0uoGzDsRMbiTCCbJMsZN5sNVS468zWYI7Ql364JskaX6rWoxcF932SmDC3iY2rFC6YqPKZu2YSnfn7wEPAdb6UGKNsBQtvt04uKRJvPKUFYAkpZwgMXW9B_7rEY-R6vW66M1OwSg1mwEEcTvuQe5QYU7tvq6huS69fhhPlrTho Oct 29 02:45:27.477319 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:45:27.477319 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:45:27.477319 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:45:27.477319 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:45:27.477319 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:45:27.477319 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:45:27.477319 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 417b13514e5f4d9d9026f3cf50f8e297 Oct 29 02:45:27.477319 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1719796590 Oct 29 02:45:27.477319 n-d-862967-2 devstack@n-api.service[127125]: X-Role: admin,reader,member Oct 29 02:45:27.477319 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: admin,reader,member Oct 29 02:45:27.478636 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/417b13514e5f4d9d9026f3cf50f8e297"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/417b13514e5f4d9d9026f3cf50f8e297"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_417b13514e5f4d9d9026f3cf50f8e297"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/417b13514e5f4d9d9026f3cf50f8e297"}]}] Oct 29 02:45:27.478636 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1719796590 Oct 29 02:45:27.478636 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 417b13514e5f4d9d9026f3cf50f8e297 Oct 29 02:45:27.478636 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1719796590 Oct 29 02:45:27.478636 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-HostsAdminNegativeTestJSON-1719796590-project-admin Oct 29 02:45:27.478636 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:45:27.478636 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:45:27.478636 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 2872d2389a594af9850442a8d962a952 Oct 29 02:45:27.478636 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1719796590-project-admin Oct 29 02:45:27.478636 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:45:27.478636 n-d-862967-2 devstack@n-api.service[127125]: {"status": "enable", "maintenance_mode": "enable"} Oct 29 02:45:27.478636 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:45:27.478636 n-d-862967-2 devstack@n-api.service[127125]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:27.478636 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 29 02:45:27.479454 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:27.479454 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:27.479454 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 29 02:45:27.479454 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 29 02:45:27.479454 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 02:45:27.479454 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 02:45:27.479454 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:27.479454 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:27.479454 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:27.479454 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:27.479454 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 02:45:27.479454 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 02:45:27.479454 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 29 02:45:27.479454 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 29 02:45:27.479454 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:45:27.479454 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:45:27.479454 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 29 02:45:27.479454 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 29 02:45:27.480515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:45:27.480515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:45:27.480515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 29 02:45:27.480515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 29 02:45:27.480515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:27.480515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.480515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:27.480515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.480515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:27.480515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:27.480515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:27.480515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:27.480515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:27.480515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:45:27.480515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:45:27.480515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:27.480515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:27.480515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:45:27.480515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:45:27.480515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 29 02:45:27.481843 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 29 02:45:27.481843 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 29 02:45:27.481843 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:45:27.481843 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:27.481843 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.481843 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:27.481843 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.481843 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:27.481843 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:27.481843 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:27.481843 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:45:27.481843 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:45:27.481843 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 29 02:45:27.481843 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.481843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dbd0b631-0fc1-4131-968e-170324b98e0b tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:27.483533 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dbd0b631-0fc1-4131-968e-170324b98e0b tempest-HostsAdminNegativeTestJSON-1719796590 tempest-HostsAdminNegativeTestJSON-1719796590-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.033936 Oct 29 02:45:27.484196 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 20/52] 10.222.0.46 () {60 vars in 1211 bytes} [Sat Oct 29 02:45:27 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:45:27.490018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bf019c9b-f26e-4464-9b74-60608542f927 tempest-FlavorsExtraSpecsTestJSON-1788838186 tempest-FlavorsExtraSpecsTestJSON-1788838186-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:27.496026 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-15d26b7f-b514-4707-932a-9e0a669499cf tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 314 microversion: 2.1 time: 0.226305 Oct 29 02:45:27.510760 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 33/53] 10.222.0.46 () {60 vars in 1191 bytes} [Sat Oct 29 02:45:27 2022] POST /compute/v2.1/os-aggregates/3/action => generated 314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:27.521774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-26a716c2-8e9a-477f-b7b4-2856894d913b tempest-FlavorsV255TestJSON-79294214 tempest-FlavorsV255TestJSON-79294214-project-admin] Action: 'update', calling method: .version_select at 0x7ff059cb4b80>, body: {"flavor": {"description": "new"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:27.548035 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bf019c9b-f26e-4464-9b74-60608542f927 tempest-FlavorsExtraSpecsTestJSON-1788838186 tempest-FlavorsExtraSpecsTestJSON-1788838186-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.062428 Oct 29 02:45:27.553196 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 21/54] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:27 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:27.558255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dbe22be2-3313-4548-b28e-274171e53b13 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1166487391"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:27.563002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.aggregate [None req-dbe22be2-3313-4548-b28e-274171e53b13 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Generated uuid ebdb9db9-5867-482d-adb1-eadb8141c6df for aggregate {{(pid=127125) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:45:27.573643 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-26a716c2-8e9a-477f-b7b4-2856894d913b tempest-FlavorsV255TestJSON-79294214 tempest-FlavorsV255TestJSON-79294214-project-admin] 10.222.0.46 "PUT /compute/v2.1/flavors/1324995378" status: 200 len: 449 microversion: 2.55 time: 0.062292 Oct 29 02:45:27.582827 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 34/55] 10.222.0.46 () {62 vars in 1219 bytes} [Sat Oct 29 02:45:27 2022] PUT /compute/v2.1/flavors/1324995378 => generated 449 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:45:27.589811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-92af9bfe-72fe-4242-99bb-3f58f4b01462 tempest-FlavorsV255TestJSON-1465436890 tempest-FlavorsV255TestJSON-1465436890-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:27.620935 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dbe22be2-3313-4548-b28e-274171e53b13 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.066494 Oct 29 02:45:27.622822 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 22/56] 10.222.0.46 () {60 vars in 1164 bytes} [Sat Oct 29 02:45:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:27.634496 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-92af9bfe-72fe-4242-99bb-3f58f4b01462 tempest-FlavorsV255TestJSON-1465436890 tempest-FlavorsV255TestJSON-1465436890-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5724 microversion: 2.55 time: 0.049256 Oct 29 02:45:27.639958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d263f0f0-a3d8-41cc-8dff-00eb2ccb67d9 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1301316956"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:27.640669 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 35/57] 10.222.0.46 () {60 vars in 1187 bytes} [Sat Oct 29 02:45:27 2022] GET /compute/v2.1/flavors/detail => generated 5724 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:45:27.660563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8b0832ca-0787-49dd-b4b1-3dafb00b54c1 tempest-FlavorsV255TestJSON-1465436890 tempest-FlavorsV255TestJSON-1465436890-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:27.661997 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d263f0f0-a3d8-41cc-8dff-00eb2ccb67d9 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:27.662611 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d263f0f0-a3d8-41cc-8dff-00eb2ccb67d9 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:27.668166 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d263f0f0-a3d8-41cc-8dff-00eb2ccb67d9 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:27.681932 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d263f0f0-a3d8-41cc-8dff-00eb2ccb67d9 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:27.682414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d263f0f0-a3d8-41cc-8dff-00eb2ccb67d9 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:27.682894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d263f0f0-a3d8-41cc-8dff-00eb2ccb67d9 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:27.689122 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8b0832ca-0787-49dd-b4b1-3dafb00b54c1 tempest-FlavorsV255TestJSON-1465436890 tempest-FlavorsV255TestJSON-1465436890-project] 10.222.0.46 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.55 time: 0.035162 Oct 29 02:45:27.690026 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 36/58] 10.222.0.46 () {60 vars in 1166 bytes} [Sat Oct 29 02:45:27 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:45:27.694027 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-d263f0f0-a3d8-41cc-8dff-00eb2ccb67d9 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1301316956 could not be found. Oct 29 02:45:27.696260 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d263f0f0-a3d8-41cc-8dff-00eb2ccb67d9 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Request method failure captured: Oct 29 02:45:27.696260 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Oct 29 02:45:27.696260 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:45:27.696260 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:45:27.696260 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:45:27.696260 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 58 Oct 29 02:45:27.696260 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:45:27.696260 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:45:27.696260 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:45:27.696260 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:27.696260 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPDJHoPSph0mXghkoG6vy4vKHJZH77qG9bcMyfjywW6JAS8osJl8LD8SzWcW3koajwzuX4iwzga21FerzbBBWNrHdMQBc-wAAbh_cJ6gnTF2ky66Su9Wl91yHCdV0dWk_S6JUOv40VKsJnvyQvn6xLjRa5B_88CFdht5Iv6AmL3EHU Oct 29 02:45:27.696260 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:45:27.696260 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:45:27.696260 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:45:27.696260 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:45:27.696260 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:45:27.696260 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:45:27.696260 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: f8795036569b4371b4373c011fce41f8 Oct 29 02:45:27.696260 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-895326194 Oct 29 02:45:27.696260 n-d-862967-2 devstack@n-api.service[127125]: X-Role: admin,reader,member Oct 29 02:45:27.696260 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: admin,reader,member Oct 29 02:45:27.697380 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f8795036569b4371b4373c011fce41f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f8795036569b4371b4373c011fce41f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f8795036569b4371b4373c011fce41f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f8795036569b4371b4373c011fce41f8"}]}] Oct 29 02:45:27.697380 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-895326194 Oct 29 02:45:27.697380 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: f8795036569b4371b4373c011fce41f8 Oct 29 02:45:27.697380 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-895326194 Oct 29 02:45:27.697380 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin Oct 29 02:45:27.697380 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:45:27.697380 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:45:27.697380 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 809ed92fc1114568bd929eab1819af1f Oct 29 02:45:27.697380 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin Oct 29 02:45:27.697380 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:45:27.697380 n-d-862967-2 devstack@n-api.service[127125]: {"add_host": {"host": "tempest-nonexist_host-1301316956"}} Oct 29 02:45:27.697380 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:45:27.697380 n-d-862967-2 devstack@n-api.service[127125]: exception: Compute host tempest-nonexist_host-1301316956 could not be found. Oct 29 02:45:27.697999 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-1301316956'}}} Oct 29 02:45:27.697999 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:27.697999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:27.697999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 29 02:45:27.697999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 29 02:45:27.697999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:45:27.697999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:45:27.697999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 29 02:45:27.697999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 29 02:45:27.697999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:45:27.697999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:45:27.697999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 29 02:45:27.697999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 29 02:45:27.697999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1301316956' is not mapped to any cell Oct 29 02:45:27.697999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.697999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:27.697999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.697999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:27.697999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 29 02:45:27.698981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 29 02:45:27.698981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 29 02:45:27.698981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 29 02:45:27.698981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 29 02:45:27.698981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.698981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:27.698981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.698981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:27.698981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 29 02:45:27.698981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 29 02:45:27.698981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 02:45:27.698981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 02:45:27.698981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:27.698981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:27.698981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:27.698981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:27.698981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 02:45:27.698981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 02:45:27.698981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 29 02:45:27.698981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 29 02:45:27.699903 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 29 02:45:27.699903 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 29 02:45:27.699903 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1301316956 could not be found. Oct 29 02:45:27.699903 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.699903 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:27.699903 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.699903 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:27.699903 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:27.699903 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:27.699903 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:27.699903 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:27.699903 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:27.699903 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:27.699903 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:45:27.699903 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:45:27.699903 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 29 02:45:27.699903 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:45:27.699903 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1301316956 could not be found. Oct 29 02:45:27.699903 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.699903 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:27.699903 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.700924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:27.700924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:27.700924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:27.700924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:45:27.700924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:45:27.700924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1301316956 could not be found. Oct 29 02:45:27.700924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.700924 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d263f0f0-a3d8-41cc-8dff-00eb2ccb67d9 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1301316956 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:27.700924 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d263f0f0-a3d8-41cc-8dff-00eb2ccb67d9 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.066177 Oct 29 02:45:27.702443 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 23/59] 10.222.0.46 () {60 vars in 1191 bytes} [Sat Oct 29 02:45:27 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:45:27.708878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-af79f221-3b6b-4028-b347-590f0efba66f tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:27.740854 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-af79f221-3b6b-4028-b347-590f0efba66f tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.036454 Oct 29 02:45:27.744651 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 24/60] 10.222.0.46 () {58 vars in 1152 bytes} [Sat Oct 29 02:45:27 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:45:27.755184 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9532a540-9d9c-4009-a5ba-83563c8be6a7 tempest-FlavorsV255TestJSON-79294214 tempest-FlavorsV255TestJSON-79294214-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:27.775241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=7,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=10 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:27.786108 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9532a540-9d9c-4009-a5ba-83563c8be6a7 tempest-FlavorsV255TestJSON-79294214 tempest-FlavorsV255TestJSON-79294214-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1324995378" status: 202 len: 0 microversion: 2.55 time: 0.040303 Oct 29 02:45:27.786712 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 25/61] 10.222.0.46 () {60 vars in 1202 bytes} [Sat Oct 29 02:45:27 2022] DELETE /compute/v2.1/flavors/1324995378 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:45:27.794957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3881f8cf-1ce0-4252-8ff8-b604d8ffcc61 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:27.799493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3881f8cf-1ce0-4252-8ff8-b604d8ffcc61 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Request method failure captured: Oct 29 02:45:27.799493 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 29 02:45:27.799493 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:45:27.799493 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:45:27.799493 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:45:27.799493 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 283 Oct 29 02:45:27.799493 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:45:27.799493 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:45:27.799493 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:45:27.799493 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:27.799493 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPDJHoPSph0mXghkoG6vy4vKHJZH77qG9bcMyfjywW6JAS8osJl8LD8SzWcW3koajwzuX4iwzga21FerzbBBWNrHdMQBc-wAAbh_cJ6gnTF2ky66Su9Wl91yHCdV0dWk_S6JUOv40VKsJnvyQvn6xLjRa5B_88CFdht5Iv6AmL3EHU Oct 29 02:45:27.799493 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:45:27.799493 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:45:27.799493 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:45:27.799493 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:45:27.799493 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:45:27.799493 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:45:27.799493 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: f8795036569b4371b4373c011fce41f8 Oct 29 02:45:27.799493 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-895326194 Oct 29 02:45:27.799493 n-d-862967-2 devstack@n-api.service[127125]: X-Role: admin,reader,member Oct 29 02:45:27.799493 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: admin,reader,member Oct 29 02:45:27.801135 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f8795036569b4371b4373c011fce41f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f8795036569b4371b4373c011fce41f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f8795036569b4371b4373c011fce41f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f8795036569b4371b4373c011fce41f8"}]}] Oct 29 02:45:27.801135 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-895326194 Oct 29 02:45:27.801135 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: f8795036569b4371b4373c011fce41f8 Oct 29 02:45:27.801135 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-895326194 Oct 29 02:45:27.801135 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin Oct 29 02:45:27.801135 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:45:27.801135 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:45:27.801135 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 809ed92fc1114568bd929eab1819af1f Oct 29 02:45:27.801135 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin Oct 29 02:45:27.801135 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:45:27.801654 n-d-862967-2 devstack@n-api.service[127125]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 29 02:45:27.801654 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:45:27.801654 n-d-862967-2 devstack@n-api.service[127125]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 02:45:27.801654 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 29 02:45:27.801654 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:27.801654 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:27.801654 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:45:27.801654 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:45:27.801654 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:45:27.801654 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:45:27.802160 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 02:45:27.802160 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.802160 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 29 02:45:27.802160 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 02:45:27.802160 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.802160 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 29 02:45:27.802160 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 29 02:45:27.802160 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.802160 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:27.802160 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.802160 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:27.802160 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:27.802160 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:27.802160 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:27.802160 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:27.802160 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:27.802160 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:27.802953 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:45:27.802953 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:45:27.802953 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:45:27.802953 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:45:27.802953 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:45:27.802953 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:45:27.802953 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:45:27.802953 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:45:27.802953 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 02:45:27.802953 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.802953 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:27.802953 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.802953 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:27.802953 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:27.802953 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:27.803736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:45:27.803736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:45:27.803736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 02:45:27.803736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.803736 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3881f8cf-1ce0-4252-8ff8-b604d8ffcc61 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:27.804003 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3881f8cf-1ce0-4252-8ff8-b604d8ffcc61 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.009636 Oct 29 02:45:27.804003 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 26/62] 10.222.0.46 () {60 vars in 1165 bytes} [Sat Oct 29 02:45:27 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:45:27.808563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9a8cc490-8308-4ea5-9c33-5f4f1e1f8bb5 tempest-FlavorsV255TestJSON-79294214 tempest-FlavorsV255TestJSON-79294214-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:27.836630 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9a8cc490-8308-4ea5-9c33-5f4f1e1f8bb5 tempest-FlavorsV255TestJSON-79294214 tempest-FlavorsV255TestJSON-79294214-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.034169 Oct 29 02:45:27.840679 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 27/63] 10.222.0.46 () {60 vars in 1187 bytes} [Sat Oct 29 02:45:27 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:45:27.846612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3351fd26-3f18-4c49-932c-ae879057f972 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:27.852545 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3351fd26-3f18-4c49-932c-ae879057f972 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Request method failure captured: Oct 29 02:45:27.852545 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 29 02:45:27.852545 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:45:27.852545 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:45:27.852545 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:45:27.852545 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 27 Oct 29 02:45:27.852545 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:45:27.852545 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:45:27.852545 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:45:27.852545 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:27.852545 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPDJHoPSph0mXghkoG6vy4vKHJZH77qG9bcMyfjywW6JAS8osJl8LD8SzWcW3koajwzuX4iwzga21FerzbBBWNrHdMQBc-wAAbh_cJ6gnTF2ky66Su9Wl91yHCdV0dWk_S6JUOv40VKsJnvyQvn6xLjRa5B_88CFdht5Iv6AmL3EHU Oct 29 02:45:27.852545 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:45:27.852545 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:45:27.852545 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:45:27.852545 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:45:27.852545 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:45:27.852545 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:45:27.852545 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: f8795036569b4371b4373c011fce41f8 Oct 29 02:45:27.852545 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-895326194 Oct 29 02:45:27.852545 n-d-862967-2 devstack@n-api.service[127125]: X-Role: admin,reader,member Oct 29 02:45:27.852545 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: admin,reader,member Oct 29 02:45:27.853991 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f8795036569b4371b4373c011fce41f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f8795036569b4371b4373c011fce41f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f8795036569b4371b4373c011fce41f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f8795036569b4371b4373c011fce41f8"}]}] Oct 29 02:45:27.853991 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-895326194 Oct 29 02:45:27.853991 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: f8795036569b4371b4373c011fce41f8 Oct 29 02:45:27.853991 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-895326194 Oct 29 02:45:27.853991 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin Oct 29 02:45:27.853991 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:45:27.853991 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:45:27.853991 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 809ed92fc1114568bd929eab1819af1f Oct 29 02:45:27.853991 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin Oct 29 02:45:27.853991 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:45:27.853991 n-d-862967-2 devstack@n-api.service[127125]: {"aggregate": {"name": ""}} Oct 29 02:45:27.853991 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:45:27.853991 n-d-862967-2 devstack@n-api.service[127125]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 29 02:45:27.854706 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 29 02:45:27.854706 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:27.854706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:27.854706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:45:27.854706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:45:27.854706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:45:27.854706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:45:27.854706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 29 02:45:27.854706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.854706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 29 02:45:27.854706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 02:45:27.854706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.854706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 29 02:45:27.854706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi '' Oct 29 02:45:27.854706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.854706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:27.854706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.854706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:27.854706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:27.854706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:27.854706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:27.854706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:27.854706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:27.855994 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:27.855994 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:45:27.855994 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:45:27.855994 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:45:27.855994 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:45:27.855994 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:45:27.855994 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:45:27.855994 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:45:27.855994 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:45:27.855994 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 29 02:45:27.855994 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.855994 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:27.855994 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.855994 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:27.855994 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:27.855994 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:27.855994 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:45:27.855994 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:45:27.855994 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 29 02:45:27.855994 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.857102 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3351fd26-3f18-4c49-932c-ae879057f972 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:27.857102 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3351fd26-3f18-4c49-932c-ae879057f972 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.013958 Oct 29 02:45:27.857102 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 28/64] 10.222.0.46 () {60 vars in 1164 bytes} [Sat Oct 29 02:45:27 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:45:27.867507 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ba7b2229-b140-4249-8a56-94016068dd45 tempest-AggregatesAdminNegativeTestJSON-403218376 tempest-AggregatesAdminNegativeTestJSON-403218376-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-712046477"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:27.871006 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ba7b2229-b140-4249-8a56-94016068dd45 tempest-AggregatesAdminNegativeTestJSON-403218376 tempest-AggregatesAdminNegativeTestJSON-403218376-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'c961002e41414df5bc0221bdf7fb280d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ad7859f394422abaadf6deb81a9752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:27.872714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ba7b2229-b140-4249-8a56-94016068dd45 tempest-AggregatesAdminNegativeTestJSON-403218376 tempest-AggregatesAdminNegativeTestJSON-403218376-project] Request method failure captured: Oct 29 02:45:27.872714 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 29 02:45:27.872714 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:45:27.872714 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:45:27.872714 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:45:27.872714 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 59 Oct 29 02:45:27.872714 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:45:27.872714 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:45:27.872714 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:45:27.872714 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:27.872714 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPB4S28dCyzCv4-q84mlKV6urxO7FgUHDpfMiQ23jOywiUnnPNu2GINhuCL6wOTXKxEqfuJYpESJZ3BJQovv7mJcPNwUXVNK4Av02PFsHAJUh4IFybm1TuH0tqZlJKM_OfSNtwKiroZ1G-Q0ulSwfszrxP5r6SZgL8HRZGYEXe_k90 Oct 29 02:45:27.872714 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:45:27.872714 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:45:27.872714 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:45:27.872714 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:45:27.872714 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:45:27.872714 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:45:27.872714 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: e4ad7859f394422abaadf6deb81a9752 Oct 29 02:45:27.872714 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-403218376 Oct 29 02:45:27.872714 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:45:27.872714 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:45:27.874050 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e4ad7859f394422abaadf6deb81a9752"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e4ad7859f394422abaadf6deb81a9752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e4ad7859f394422abaadf6deb81a9752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e4ad7859f394422abaadf6deb81a9752"}]}] Oct 29 02:45:27.874050 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-403218376 Oct 29 02:45:27.874050 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: e4ad7859f394422abaadf6deb81a9752 Oct 29 02:45:27.874050 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-403218376 Oct 29 02:45:27.874050 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-AggregatesAdminNegativeTestJSON-403218376-project Oct 29 02:45:27.874050 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:45:27.874050 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:45:27.874050 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: c961002e41414df5bc0221bdf7fb280d Oct 29 02:45:27.874050 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-403218376-project Oct 29 02:45:27.874050 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:45:27.874050 n-d-862967-2 devstack@n-api.service[127125]: {"aggregate": {"name": "tempest-test_aggregate-712046477"}} Oct 29 02:45:27.874050 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:45:27.874050 n-d-862967-2 devstack@n-api.service[127125]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 29 02:45:27.874830 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-712046477'}}} Oct 29 02:45:27.874830 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:27.874830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:27.874830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:27.874830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:27.874830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:27.874830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:27.874830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:27.874830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:27.874830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:45:27.874830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:45:27.874830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:45:27.874830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:45:27.874830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 29 02:45:27.874830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 29 02:45:27.874830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:27.874830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:27.874830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:27.874830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:27.875712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:27.875712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:27.875712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:27.875712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:27.875712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:27.875712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:27.875712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:27.875712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:27.875712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:27.875712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:27.875712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 29 02:45:27.875712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.875712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:27.875712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.875712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:27.875712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:27.875712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:27.875712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:27.875712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:27.875712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 29 02:45:27.876688 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.876688 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ba7b2229-b140-4249-8a56-94016068dd45 tempest-AggregatesAdminNegativeTestJSON-403218376 tempest-AggregatesAdminNegativeTestJSON-403218376-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:27.876688 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ba7b2229-b140-4249-8a56-94016068dd45 tempest-AggregatesAdminNegativeTestJSON-403218376 tempest-AggregatesAdminNegativeTestJSON-403218376-project] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.011946 Oct 29 02:45:27.876688 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 29/65] 10.222.0.46 () {60 vars in 1164 bytes} [Sat Oct 29 02:45:27 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:45:27.884751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-551f3ca1-4538-4121-b8aa-5da83f3de421 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1202178281"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:27.888180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.aggregate [None req-551f3ca1-4538-4121-b8aa-5da83f3de421 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Generated uuid c4a6097b-ffbf-4ac7-aaa0-639eb23e743a for aggregate {{(pid=127125) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:45:27.919108 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-551f3ca1-4538-4121-b8aa-5da83f3de421 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.037497 Oct 29 02:45:27.919757 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 30/66] 10.222.0.46 () {60 vars in 1164 bytes} [Sat Oct 29 02:45:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:45:27.931832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1a08a2ed-711c-4998-86d2-19a3e26e71e6 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1202178281"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:27.935169 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.aggregate [None req-1a08a2ed-711c-4998-86d2-19a3e26e71e6 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Generated uuid b936f37b-5bfc-4d49-aee5-a92e946af4ec for aggregate {{(pid=127125) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:45:27.944493 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-1a08a2ed-711c-4998-86d2-19a3e26e71e6 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1202178281 already exists. Oct 29 02:45:27.946498 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1a08a2ed-711c-4998-86d2-19a3e26e71e6 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Request method failure captured: Oct 29 02:45:27.946498 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 29 02:45:27.946498 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:45:27.946498 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:45:27.946498 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:45:27.946498 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 60 Oct 29 02:45:27.946498 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:45:27.946498 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:45:27.946498 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:45:27.946498 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:27.946498 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPDJHoPSph0mXghkoG6vy4vKHJZH77qG9bcMyfjywW6JAS8osJl8LD8SzWcW3koajwzuX4iwzga21FerzbBBWNrHdMQBc-wAAbh_cJ6gnTF2ky66Su9Wl91yHCdV0dWk_S6JUOv40VKsJnvyQvn6xLjRa5B_88CFdht5Iv6AmL3EHU Oct 29 02:45:27.946498 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:45:27.946498 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:45:27.946498 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:45:27.946498 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:45:27.946498 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:45:27.946498 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:45:27.946498 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: f8795036569b4371b4373c011fce41f8 Oct 29 02:45:27.946498 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-895326194 Oct 29 02:45:27.946498 n-d-862967-2 devstack@n-api.service[127125]: X-Role: admin,reader,member Oct 29 02:45:27.946498 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: admin,reader,member Oct 29 02:45:27.947554 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f8795036569b4371b4373c011fce41f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f8795036569b4371b4373c011fce41f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f8795036569b4371b4373c011fce41f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f8795036569b4371b4373c011fce41f8"}]}] Oct 29 02:45:27.947554 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-895326194 Oct 29 02:45:27.947554 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: f8795036569b4371b4373c011fce41f8 Oct 29 02:45:27.947554 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-895326194 Oct 29 02:45:27.947554 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin Oct 29 02:45:27.947554 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:45:27.947554 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:45:27.947554 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 809ed92fc1114568bd929eab1819af1f Oct 29 02:45:27.947554 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin Oct 29 02:45:27.947554 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:45:27.947554 n-d-862967-2 devstack@n-api.service[127125]: {"aggregate": {"name": "tempest-test_aggregate-1202178281"}} Oct 29 02:45:27.947554 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:45:27.947554 n-d-862967-2 devstack@n-api.service[127125]: exception: Aggregate tempest-test_aggregate-1202178281 already exists. Oct 29 02:45:27.948179 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1202178281'}}} Oct 29 02:45:27.948179 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:27.948179 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:27.948179 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 29 02:45:27.948179 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 29 02:45:27.948179 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 02:45:27.948179 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 02:45:27.948179 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:27.948179 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:27.948179 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:27.948179 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:27.948179 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 02:45:27.948179 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 02:45:27.948179 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 29 02:45:27.948179 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 29 02:45:27.948179 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 29 02:45:27.948179 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 29 02:45:27.948179 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 29 02:45:27.948179 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 29 02:45:27.949170 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:45:27.949170 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:45:27.949170 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 29 02:45:27.949170 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 29 02:45:27.949170 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1202178281 already exists. Oct 29 02:45:27.949170 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.949170 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:27.949170 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.949170 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:27.949170 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:27.949170 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:27.949170 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:27.949170 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:27.949170 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:27.949170 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:27.949170 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:45:27.949170 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:45:27.949170 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:45:27.949170 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:45:27.949170 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 29 02:45:27.950116 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 29 02:45:27.950116 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1202178281 already exists. Oct 29 02:45:27.950116 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.950116 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:27.950116 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.950116 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:27.950116 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:27.950116 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:27.950116 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:45:27.950116 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:45:27.950116 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1202178281 already exists. Oct 29 02:45:27.950116 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:27.950116 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1a08a2ed-711c-4998-86d2-19a3e26e71e6 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1202178281 already exists. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:27.950116 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1a08a2ed-711c-4998-86d2-19a3e26e71e6 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.020240 Oct 29 02:45:27.950889 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 31/67] 10.222.0.46 () {60 vars in 1164 bytes} [Sat Oct 29 02:45:27 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 21 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:45:27.956879 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4f843459-19b3-4d05-b44f-aee8043b1650 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:27.984124 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4f843459-19b3-4d05-b44f-aee8043b1650 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.030866 Oct 29 02:45:27.989438 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 32/68] 10.222.0.46 () {58 vars in 1152 bytes} [Sat Oct 29 02:45:27 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 29 02:45:27.994712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a7dd0729-eabc-48d5-b82b-0350f0127ade tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1375877428"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:27.999235 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.aggregate [None req-a7dd0729-eabc-48d5-b82b-0350f0127ade tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Generated uuid 05d9a7e5-550a-48c2-8c5c-003a971be814 for aggregate {{(pid=127125) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:45:28.026214 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a7dd0729-eabc-48d5-b82b-0350f0127ade tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.035155 Oct 29 02:45:28.026806 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 33/69] 10.222.0.46 () {60 vars in 1164 bytes} [Sat Oct 29 02:45:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:28.038255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a6948fa1-e044-44b8-8a44-af537cd5819c tempest-AggregatesAdminNegativeTestJSON-403218376 tempest-AggregatesAdminNegativeTestJSON-403218376-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:28.040000 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a6948fa1-e044-44b8-8a44-af537cd5819c tempest-AggregatesAdminNegativeTestJSON-403218376 tempest-AggregatesAdminNegativeTestJSON-403218376-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'c961002e41414df5bc0221bdf7fb280d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ad7859f394422abaadf6deb81a9752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:28.041790 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a6948fa1-e044-44b8-8a44-af537cd5819c tempest-AggregatesAdminNegativeTestJSON-403218376 tempest-AggregatesAdminNegativeTestJSON-403218376-project] Request method failure captured: Oct 29 02:45:28.041790 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 29 02:45:28.041790 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:45:28.041790 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:45:28.041790 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:45:28.041790 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:45:28.041790 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:45:28.041790 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:45:28.041790 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:45:28.041790 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:28.041790 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPB4S28dCyzCv4-q84mlKV6urxO7FgUHDpfMiQ23jOywiUnnPNu2GINhuCL6wOTXKxEqfuJYpESJZ3BJQovv7mJcPNwUXVNK4Av02PFsHAJUh4IFybm1TuH0tqZlJKM_OfSNtwKiroZ1G-Q0ulSwfszrxP5r6SZgL8HRZGYEXe_k90 Oct 29 02:45:28.041790 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:45:28.041790 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:45:28.041790 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:45:28.041790 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:45:28.041790 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:45:28.041790 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:45:28.041790 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: e4ad7859f394422abaadf6deb81a9752 Oct 29 02:45:28.041790 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-403218376 Oct 29 02:45:28.041790 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:45:28.041790 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:45:28.043119 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e4ad7859f394422abaadf6deb81a9752"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e4ad7859f394422abaadf6deb81a9752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e4ad7859f394422abaadf6deb81a9752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e4ad7859f394422abaadf6deb81a9752"}]}] Oct 29 02:45:28.043119 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-403218376 Oct 29 02:45:28.043119 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: e4ad7859f394422abaadf6deb81a9752 Oct 29 02:45:28.043119 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-403218376 Oct 29 02:45:28.043119 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-AggregatesAdminNegativeTestJSON-403218376-project Oct 29 02:45:28.043119 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:45:28.043119 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:45:28.043119 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: c961002e41414df5bc0221bdf7fb280d Oct 29 02:45:28.043119 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-403218376-project Oct 29 02:45:28.043119 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:45:28.043119 n-d-862967-2 devstack@n-api.service[127125]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 29 02:45:28.043119 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '6'} Oct 29 02:45:28.043901 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:28.043901 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:28.043901 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:28.043901 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:28.043901 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:28.043901 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:28.043901 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:28.043901 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:28.043901 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 29 02:45:28.043901 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 29 02:45:28.043901 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:28.043901 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:28.043901 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:28.043901 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:28.043901 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:28.043901 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:28.043901 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:28.043901 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:28.043901 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:28.045040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:28.045040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:28.045040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:28.045040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:28.045040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:28.045040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 29 02:45:28.045040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:28.045040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:28.045040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:28.045040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:28.045040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:28.045040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:28.045040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:28.045040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:28.045040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 29 02:45:28.045040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:28.045040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a6948fa1-e044-44b8-8a44-af537cd5819c tempest-AggregatesAdminNegativeTestJSON-403218376 tempest-AggregatesAdminNegativeTestJSON-403218376-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:28.046078 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a6948fa1-e044-44b8-8a44-af537cd5819c tempest-AggregatesAdminNegativeTestJSON-403218376 tempest-AggregatesAdminNegativeTestJSON-403218376-project] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.008867 Oct 29 02:45:28.046078 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 34/70] 10.222.0.46 () {58 vars in 1152 bytes} [Sat Oct 29 02:45:28 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:45:28.053162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-42ad42c2-449f-44e5-a77f-b3dac9be9bed tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:28.079972 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-42ad42c2-449f-44e5-a77f-b3dac9be9bed tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.031716 Oct 29 02:45:28.080609 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 35/71] 10.222.0.46 () {58 vars in 1152 bytes} [Sat Oct 29 02:45:28 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 29 02:45:28.090889 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-31d9adfc-bd39-4247-b32a-e70950149ae7 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:28.102622 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-31d9adfc-bd39-4247-b32a-e70950149ae7 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 29 02:45:28.104708 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-31d9adfc-bd39-4247-b32a-e70950149ae7 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Request method failure captured: Oct 29 02:45:28.104708 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 29 02:45:28.104708 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:45:28.104708 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:45:28.104708 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:45:28.104708 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:45:28.104708 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:45:28.104708 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:45:28.104708 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:45:28.104708 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:28.104708 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPDJHoPSph0mXghkoG6vy4vKHJZH77qG9bcMyfjywW6JAS8osJl8LD8SzWcW3koajwzuX4iwzga21FerzbBBWNrHdMQBc-wAAbh_cJ6gnTF2ky66Su9Wl91yHCdV0dWk_S6JUOv40VKsJnvyQvn6xLjRa5B_88CFdht5Iv6AmL3EHU Oct 29 02:45:28.104708 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:45:28.104708 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:45:28.104708 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:45:28.104708 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:45:28.104708 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:45:28.104708 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:45:28.104708 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: f8795036569b4371b4373c011fce41f8 Oct 29 02:45:28.104708 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-895326194 Oct 29 02:45:28.104708 n-d-862967-2 devstack@n-api.service[127125]: X-Role: admin,reader,member Oct 29 02:45:28.104708 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: admin,reader,member Oct 29 02:45:28.106027 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f8795036569b4371b4373c011fce41f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f8795036569b4371b4373c011fce41f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f8795036569b4371b4373c011fce41f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f8795036569b4371b4373c011fce41f8"}]}] Oct 29 02:45:28.106027 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-895326194 Oct 29 02:45:28.106027 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: f8795036569b4371b4373c011fce41f8 Oct 29 02:45:28.106027 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-895326194 Oct 29 02:45:28.106027 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin Oct 29 02:45:28.106027 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:45:28.106027 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:45:28.106027 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 809ed92fc1114568bd929eab1819af1f Oct 29 02:45:28.106027 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin Oct 29 02:45:28.106027 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:45:28.106027 n-d-862967-2 devstack@n-api.service[127125]: exception: Aggregate -1 could not be found. Oct 29 02:45:28.106027 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '-1'} Oct 29 02:45:28.106738 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:28.106738 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:28.106738 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 29 02:45:28.106738 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 29 02:45:28.106738 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 02:45:28.106738 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 02:45:28.106738 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:28.106738 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:28.106738 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:28.106738 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:28.106738 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 02:45:28.106738 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 02:45:28.106738 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 29 02:45:28.106738 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 29 02:45:28.106738 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:45:28.106738 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:45:28.106738 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 29 02:45:28.106738 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 29 02:45:28.106738 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:45:28.107623 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:45:28.107623 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 29 02:45:28.107623 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 29 02:45:28.107623 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 29 02:45:28.107623 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:28.107623 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:28.107623 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:28.107623 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:28.107623 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:28.107623 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:28.107623 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:28.107623 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:28.107623 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:28.107623 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:28.107623 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 29 02:45:28.107623 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:45:28.107623 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 29 02:45:28.107623 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:28.107623 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:28.107623 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:28.107623 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:28.108643 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:28.108643 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:28.108643 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:45:28.108643 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:45:28.108643 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 29 02:45:28.108643 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:28.108643 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-31d9adfc-bd39-4247-b32a-e70950149ae7 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:28.108643 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-31d9adfc-bd39-4247-b32a-e70950149ae7 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.020034 Oct 29 02:45:28.108643 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 36/72] 10.222.0.46 () {58 vars in 1155 bytes} [Sat Oct 29 02:45:28 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 29 02:45:28.115825 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-28037391-b9e5-4fce-b9d9-9caace3631d7 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2011796440"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:28.123289 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-79d0e076-beeb-4f70-b446-f513f9611b8e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1260720080", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "availability_zone": "tempest-test_az-1815932381"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:28.131797 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.aggregate [None req-28037391-b9e5-4fce-b9d9-9caace3631d7 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Generated uuid 736233b1-e21a-4891-8703-605e21c53001 for aggregate {{(pid=127125) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:45:28.135419 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79d0e076-beeb-4f70-b446-f513f9611b8e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:28.136117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79d0e076-beeb-4f70-b446-f513f9611b8e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:28.136963 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79d0e076-beeb-4f70-b446-f513f9611b8e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:28.137770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79d0e076-beeb-4f70-b446-f513f9611b8e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:28.138286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79d0e076-beeb-4f70-b446-f513f9611b8e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:28.139145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79d0e076-beeb-4f70-b446-f513f9611b8e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:28.162608 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-28037391-b9e5-4fce-b9d9-9caace3631d7 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.050380 Oct 29 02:45:28.164577 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 37/73] 10.222.0.46 () {60 vars in 1164 bytes} [Sat Oct 29 02:45:28 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:45:28.176894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a12b530c-d317-4d75-8be3-c10cdec2d24a tempest-AggregatesAdminNegativeTestJSON-403218376 tempest-AggregatesAdminNegativeTestJSON-403218376-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:28.178931 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a12b530c-d317-4d75-8be3-c10cdec2d24a tempest-AggregatesAdminNegativeTestJSON-403218376 tempest-AggregatesAdminNegativeTestJSON-403218376-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'c961002e41414df5bc0221bdf7fb280d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ad7859f394422abaadf6deb81a9752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:28.180510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a12b530c-d317-4d75-8be3-c10cdec2d24a tempest-AggregatesAdminNegativeTestJSON-403218376 tempest-AggregatesAdminNegativeTestJSON-403218376-project] Request method failure captured: Oct 29 02:45:28.180510 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 29 02:45:28.180510 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:45:28.180510 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:45:28.180510 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:45:28.180510 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:45:28.180510 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:45:28.180510 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:45:28.180510 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:45:28.180510 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:28.180510 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPB4S28dCyzCv4-q84mlKV6urxO7FgUHDpfMiQ23jOywiUnnPNu2GINhuCL6wOTXKxEqfuJYpESJZ3BJQovv7mJcPNwUXVNK4Av02PFsHAJUh4IFybm1TuH0tqZlJKM_OfSNtwKiroZ1G-Q0ulSwfszrxP5r6SZgL8HRZGYEXe_k90 Oct 29 02:45:28.180510 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:45:28.180510 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:45:28.180510 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:45:28.180510 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:45:28.180510 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:45:28.180510 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:45:28.180510 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: e4ad7859f394422abaadf6deb81a9752 Oct 29 02:45:28.180510 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-403218376 Oct 29 02:45:28.180510 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:45:28.180510 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:45:28.181585 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e4ad7859f394422abaadf6deb81a9752"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e4ad7859f394422abaadf6deb81a9752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e4ad7859f394422abaadf6deb81a9752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e4ad7859f394422abaadf6deb81a9752"}]}] Oct 29 02:45:28.181585 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-403218376 Oct 29 02:45:28.181585 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: e4ad7859f394422abaadf6deb81a9752 Oct 29 02:45:28.181585 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-403218376 Oct 29 02:45:28.181585 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-AggregatesAdminNegativeTestJSON-403218376-project Oct 29 02:45:28.181585 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:45:28.181585 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:45:28.181585 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: c961002e41414df5bc0221bdf7fb280d Oct 29 02:45:28.181585 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-403218376-project Oct 29 02:45:28.181585 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:45:28.181585 n-d-862967-2 devstack@n-api.service[127125]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 29 02:45:28.181585 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '7'} Oct 29 02:45:28.182231 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:28.182231 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:28.182231 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:28.182231 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:28.182231 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:28.182231 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:28.182231 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:28.182231 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:28.182231 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 29 02:45:28.182231 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 29 02:45:28.182231 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:28.182231 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:28.182231 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:28.182231 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:28.182231 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:28.182231 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:28.182231 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:28.182231 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:28.182231 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:28.183120 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:28.183120 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:28.183120 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:28.183120 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:28.183120 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:28.183120 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 29 02:45:28.183120 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:28.183120 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:28.183120 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:28.183120 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:28.183120 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:28.183120 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:28.183120 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:28.183120 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:28.183120 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 29 02:45:28.183120 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:28.183120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a12b530c-d317-4d75-8be3-c10cdec2d24a tempest-AggregatesAdminNegativeTestJSON-403218376 tempest-AggregatesAdminNegativeTestJSON-403218376-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:28.183922 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a12b530c-d317-4d75-8be3-c10cdec2d24a tempest-AggregatesAdminNegativeTestJSON-403218376 tempest-AggregatesAdminNegativeTestJSON-403218376-project] 10.222.0.46 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.010534 Oct 29 02:45:28.183922 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 38/74] 10.222.0.46 () {58 vars in 1149 bytes} [Sat Oct 29 02:45:28 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:45:28.193255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2a5559d0-0f38-46db-a07a-313b8ccdab9f tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:28.216563 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2a5559d0-0f38-46db-a07a-313b8ccdab9f tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.028537 Oct 29 02:45:28.217415 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 39/75] 10.222.0.46 () {58 vars in 1152 bytes} [Sat Oct 29 02:45:28 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:45:28.227441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7a0d47ff-a14e-43a8-b987-dd85fe5cd160 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:28.234766 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-7a0d47ff-a14e-43a8-b987-dd85fe5cd160 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 29 02:45:28.236416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7a0d47ff-a14e-43a8-b987-dd85fe5cd160 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Request method failure captured: Oct 29 02:45:28.236416 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 29 02:45:28.236416 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:45:28.236416 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:45:28.236416 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:45:28.236416 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:45:28.236416 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:45:28.236416 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:45:28.236416 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:45:28.236416 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:28.236416 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPDJHoPSph0mXghkoG6vy4vKHJZH77qG9bcMyfjywW6JAS8osJl8LD8SzWcW3koajwzuX4iwzga21FerzbBBWNrHdMQBc-wAAbh_cJ6gnTF2ky66Su9Wl91yHCdV0dWk_S6JUOv40VKsJnvyQvn6xLjRa5B_88CFdht5Iv6AmL3EHU Oct 29 02:45:28.236416 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:45:28.236416 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:45:28.236416 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:45:28.236416 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:45:28.236416 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:45:28.236416 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:45:28.236416 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: f8795036569b4371b4373c011fce41f8 Oct 29 02:45:28.236416 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-895326194 Oct 29 02:45:28.236416 n-d-862967-2 devstack@n-api.service[127125]: X-Role: admin,reader,member Oct 29 02:45:28.236416 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: admin,reader,member Oct 29 02:45:28.237704 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f8795036569b4371b4373c011fce41f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f8795036569b4371b4373c011fce41f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f8795036569b4371b4373c011fce41f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f8795036569b4371b4373c011fce41f8"}]}] Oct 29 02:45:28.237704 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-895326194 Oct 29 02:45:28.237704 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: f8795036569b4371b4373c011fce41f8 Oct 29 02:45:28.237704 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-895326194 Oct 29 02:45:28.237704 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin Oct 29 02:45:28.237704 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:45:28.237704 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:45:28.237704 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 809ed92fc1114568bd929eab1819af1f Oct 29 02:45:28.237704 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin Oct 29 02:45:28.237704 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:45:28.237704 n-d-862967-2 devstack@n-api.service[127125]: exception: Aggregate -1 could not be found. Oct 29 02:45:28.237704 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '-1'} Oct 29 02:45:28.238522 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:28.238522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:28.238522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 29 02:45:28.238522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 29 02:45:28.238522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 29 02:45:28.238522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 29 02:45:28.238522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:45:28.238522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:45:28.238522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 29 02:45:28.238522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 29 02:45:28.238522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:45:28.238522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:45:28.238522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 29 02:45:28.238522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 29 02:45:28.238522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 29 02:45:28.238522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:28.238522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:28.238522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:28.238522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:28.238522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:28.239754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:28.239754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:28.239754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:28.239754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:28.239754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:28.239754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 29 02:45:28.239754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:45:28.239754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 29 02:45:28.239754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:28.239754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:28.239754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:28.239754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:28.239754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:28.239754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:28.239754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:45:28.239754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:45:28.239754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 29 02:45:28.239754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:28.240828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7a0d47ff-a14e-43a8-b987-dd85fe5cd160 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:28.240828 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7a0d47ff-a14e-43a8-b987-dd85fe5cd160 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.014726 Oct 29 02:45:28.242918 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 40/76] 10.222.0.46 () {58 vars in 1152 bytes} [Sat Oct 29 02:45:28 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 29 02:45:28.249486 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bb9eab69-8612-4ea3-8c6b-1935f83cfe6c tempest-AggregatesAdminNegativeTestJSON-403218376 tempest-AggregatesAdminNegativeTestJSON-403218376-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:28.251006 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bb9eab69-8612-4ea3-8c6b-1935f83cfe6c tempest-AggregatesAdminNegativeTestJSON-403218376 tempest-AggregatesAdminNegativeTestJSON-403218376-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'c961002e41414df5bc0221bdf7fb280d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ad7859f394422abaadf6deb81a9752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:28.252547 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bb9eab69-8612-4ea3-8c6b-1935f83cfe6c tempest-AggregatesAdminNegativeTestJSON-403218376 tempest-AggregatesAdminNegativeTestJSON-403218376-project] Request method failure captured: Oct 29 02:45:28.252547 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 29 02:45:28.252547 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:45:28.252547 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:45:28.252547 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:45:28.252547 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:45:28.252547 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:45:28.252547 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:45:28.252547 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:45:28.252547 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:28.252547 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPB4S28dCyzCv4-q84mlKV6urxO7FgUHDpfMiQ23jOywiUnnPNu2GINhuCL6wOTXKxEqfuJYpESJZ3BJQovv7mJcPNwUXVNK4Av02PFsHAJUh4IFybm1TuH0tqZlJKM_OfSNtwKiroZ1G-Q0ulSwfszrxP5r6SZgL8HRZGYEXe_k90 Oct 29 02:45:28.252547 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:45:28.252547 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:45:28.252547 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:45:28.252547 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:45:28.252547 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:45:28.252547 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:45:28.252547 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: e4ad7859f394422abaadf6deb81a9752 Oct 29 02:45:28.252547 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-403218376 Oct 29 02:45:28.252547 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:45:28.252547 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:45:28.253832 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e4ad7859f394422abaadf6deb81a9752"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e4ad7859f394422abaadf6deb81a9752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e4ad7859f394422abaadf6deb81a9752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e4ad7859f394422abaadf6deb81a9752"}]}] Oct 29 02:45:28.253832 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-403218376 Oct 29 02:45:28.253832 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: e4ad7859f394422abaadf6deb81a9752 Oct 29 02:45:28.253832 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-403218376 Oct 29 02:45:28.253832 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-AggregatesAdminNegativeTestJSON-403218376-project Oct 29 02:45:28.253832 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:45:28.253832 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:45:28.253832 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: c961002e41414df5bc0221bdf7fb280d Oct 29 02:45:28.253832 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-403218376-project Oct 29 02:45:28.253832 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:45:28.253832 n-d-862967-2 devstack@n-api.service[127125]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 29 02:45:28.253832 n-d-862967-2 devstack@n-api.service[127125]: action_args: {} Oct 29 02:45:28.254574 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:28.254574 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:28.254574 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:28.254574 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:28.254574 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:28.254574 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:28.254574 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:28.254574 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:28.254574 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 29 02:45:28.254574 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 29 02:45:28.254574 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:28.254574 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:28.254574 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:28.254574 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:28.254574 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:28.254574 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:28.254574 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:28.254574 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:28.254574 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:28.256586 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:28.256586 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:28.256586 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:28.256586 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:28.256586 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:28.256586 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 29 02:45:28.256586 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:28.256586 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:28.256586 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:28.256586 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:28.256586 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:28.256586 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:28.256586 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:28.256586 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:28.256586 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 29 02:45:28.256586 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:28.256586 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bb9eab69-8612-4ea3-8c6b-1935f83cfe6c tempest-AggregatesAdminNegativeTestJSON-403218376 tempest-AggregatesAdminNegativeTestJSON-403218376-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:28.259001 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bb9eab69-8612-4ea3-8c6b-1935f83cfe6c tempest-AggregatesAdminNegativeTestJSON-403218376 tempest-AggregatesAdminNegativeTestJSON-403218376-project] 10.222.0.46 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.010124 Oct 29 02:45:28.259001 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 41/77] 10.222.0.46 () {58 vars in 1143 bytes} [Sat Oct 29 02:45:28 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:45:29.203957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-79d0e076-beeb-4f70-b446-f513f9611b8e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] validate_networks() for None {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:45:29.508739 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-79d0e076-beeb-4f70-b446-f513f9611b8e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:45:29.509167 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-79d0e076-beeb-4f70-b446-f513f9611b8e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:45:29.509784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-79d0e076-beeb-4f70-b446-f513f9611b8e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:45:29.510187 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-79d0e076-beeb-4f70-b446-f513f9611b8e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:45:29.510596 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-79d0e076-beeb-4f70-b446-f513f9611b8e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:45:29.520960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79d0e076-beeb-4f70-b446-f513f9611b8e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:29.521399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79d0e076-beeb-4f70-b446-f513f9611b8e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:29.522052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79d0e076-beeb-4f70-b446-f513f9611b8e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:29.522919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79d0e076-beeb-4f70-b446-f513f9611b8e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:29.523370 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79d0e076-beeb-4f70-b446-f513f9611b8e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:29.523788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79d0e076-beeb-4f70-b446-f513f9611b8e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:29.547628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-79d0e076-beeb-4f70-b446-f513f9611b8e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Getting quotas for project 22f1de1bd2764e2994a4f1caaef0ad4d. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:45:29.551510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-79d0e076-beeb-4f70-b446-f513f9611b8e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Getting quotas for user 6eb72790532b484583be089c38656f74 and project 22f1de1bd2764e2994a4f1caaef0ad4d. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:45:29.565208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-79d0e076-beeb-4f70-b446-f513f9611b8e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:45:29.568101 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-79d0e076-beeb-4f70-b446-f513f9611b8e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] [instance: 20072a0e-36ce-4bc7-b83e-7d88340ab50c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:45:29.629342 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-79d0e076-beeb-4f70-b446-f513f9611b8e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.935247 Oct 29 02:45:29.636424 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 37/78] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:45:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:45:29.642329 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5fd6b54e-c8b8-4338-b0c2-6ec03c008f1b tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:29.643150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5fd6b54e-c8b8-4338-b0c2-6ec03c008f1b tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] [instance: 20072a0e-36ce-4bc7-b83e-7d88340ab50c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:30.840756 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5fd6b54e-c8b8-4338-b0c2-6ec03c008f1b tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb72790532b484583be089c38656f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f1de1bd2764e2994a4f1caaef0ad4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:30.856939 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5fd6b54e-c8b8-4338-b0c2-6ec03c008f1b tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] 10.222.0.46 "GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c" status: 200 len: 1243 microversion: 2.1 time: 1.218802 Oct 29 02:45:30.873270 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 42/79] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:29 2022] GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c => generated 1243 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:45:31.881404 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-77de6796-1c65-455f-a544-7fbc130aa0cf tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:31.882965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-77de6796-1c65-455f-a544-7fbc130aa0cf tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] [instance: 20072a0e-36ce-4bc7-b83e-7d88340ab50c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:31.899490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77de6796-1c65-455f-a544-7fbc130aa0cf tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:31.900346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77de6796-1c65-455f-a544-7fbc130aa0cf tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:31.901009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77de6796-1c65-455f-a544-7fbc130aa0cf tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:31.901838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77de6796-1c65-455f-a544-7fbc130aa0cf tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:31.902372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77de6796-1c65-455f-a544-7fbc130aa0cf tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:31.902897 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77de6796-1c65-455f-a544-7fbc130aa0cf tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:32.152151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-77de6796-1c65-455f-a544-7fbc130aa0cf tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb72790532b484583be089c38656f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f1de1bd2764e2994a4f1caaef0ad4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:32.166080 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-77de6796-1c65-455f-a544-7fbc130aa0cf tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] 10.222.0.46 "GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c" status: 200 len: 1297 microversion: 2.1 time: 0.290031 Oct 29 02:45:32.166664 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 43/80] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:31 2022] GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c => generated 1297 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:32.284849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-900b0315-2b60-4087-b5b2-4666601e1f44 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1421241025", "id": 1771535457, "os-flavor-access:is_public": "True"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:32.320121 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-900b0315-2b60-4087-b5b2-4666601e1f44 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.489935 Oct 29 02:45:32.332044 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 38/81] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:45:31 2022] POST /compute/v2.1/flavors => generated 430 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:32.337433 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0d53fa08-b264-4f95-aff5-e060ec59ab22 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:32.370244 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0d53fa08-b264-4f95-aff5-e060ec59ab22 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1771535457" status: 202 len: 0 microversion: 2.1 time: 0.038065 Oct 29 02:45:32.371371 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 44/82] 10.222.0.46 () {58 vars in 1161 bytes} [Sat Oct 29 02:45:32 2022] DELETE /compute/v2.1/flavors/1771535457 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:45:32.382451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f1841836-a21f-49de-af65-b42a08e1999e tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:32.450873 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f1841836-a21f-49de-af65-b42a08e1999e tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.073750 Oct 29 02:45:32.451370 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 39/83] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:32.474166 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9a3bdc7b-c5e7-4284-affb-3dd578c7879d tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1773832519", "id": 749325076, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:32.504197 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9a3bdc7b-c5e7-4284-affb-3dd578c7879d tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.033754 Oct 29 02:45:32.505955 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 45/84] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:45:32 2022] POST /compute/v2.1/flavors => generated 414 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:32.518644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8a762014-1a16-4bbd-aa37-28259e4a6b01 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:32.546483 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8a762014-1a16-4bbd-aa37-28259e4a6b01 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.032327 Oct 29 02:45:32.547954 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 40/85] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:32 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:32.566522 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e562f05b-08de-4864-96e8-9dbbc05e4e20 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:32.589407 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e562f05b-08de-4864-96e8-9dbbc05e4e20 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/749325076" status: 202 len: 0 microversion: 2.1 time: 0.026341 Oct 29 02:45:32.590881 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 46/86] 10.222.0.46 () {58 vars in 1158 bytes} [Sat Oct 29 02:45:32 2022] DELETE /compute/v2.1/flavors/749325076 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:45:32.599267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1368ef3d-5e29-42bf-ab13-25d5d580a95a tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:32.620392 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1368ef3d-5e29-42bf-ab13-25d5d580a95a tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025262 Oct 29 02:45:32.621720 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 41/87] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:45:32.642015 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3be77b4e-715e-4d62-9af5-47a3100178f7 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-902315096", "id": 2088948292, "os-flavor-access:is_public": "True"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:32.674146 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3be77b4e-715e-4d62-9af5-47a3100178f7 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.036406 Oct 29 02:45:32.679280 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 47/88] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:45:32 2022] POST /compute/v2.1/flavors => generated 428 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:32.691229 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eb67132f-967a-4ab8-91b0-feb4b7841ace tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:32.740509 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eb67132f-967a-4ab8-91b0-feb4b7841ace tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/2088948292" status: 202 len: 0 microversion: 2.1 time: 0.052796 Oct 29 02:45:32.741312 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 42/89] 10.222.0.46 () {58 vars in 1161 bytes} [Sat Oct 29 02:45:32 2022] DELETE /compute/v2.1/flavors/2088948292 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:45:32.750764 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bc15a474-ddd1-4ae9-b38b-5dff555d7e2a tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:32.787644 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bc15a474-ddd1-4ae9-b38b-5dff555d7e2a tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041456 Oct 29 02:45:32.789021 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 48/90] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:45:32.811945 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-165520db-2db0-41d7-bc9f-7fdb14360fee tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-123534167", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:32.824550 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=80,nova_api:SAVEPOINT=1,nova_api:RELEASE=1,nova_api:DELETE=8,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:32.857820 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-165520db-2db0-41d7-bc9f-7fdb14360fee tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.049656 Oct 29 02:45:32.869874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d7f59064-37ae-4450-b39e-63c5fd0f5c03 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:32.874717 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 43/91] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:45:32 2022] POST /compute/v2.1/flavors => generated 506 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:32.895764 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d7f59064-37ae-4450-b39e-63c5fd0f5c03 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/650db8fe-0278-4344-8155-7dc81cea5a67" status: 202 len: 0 microversion: 2.1 time: 0.028829 Oct 29 02:45:32.898906 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 49/92] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:45:32 2022] DELETE /compute/v2.1/flavors/650db8fe-0278-4344-8155-7dc81cea5a67 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:45:32.913044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9d55398e-552a-4f80-91b4-cc163002aa99 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:32.948087 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9d55398e-552a-4f80-91b4-cc163002aa99 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043428 Oct 29 02:45:32.965071 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 44/93] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:32.974396 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7637a5b2-7ef5-4fc4-95c4-c5405933401b tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1854379265", "id": "fa2a125c-1df8-41df-b703-a5e02082c9c5", "os-flavor-access:is_public": "True"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:33.011027 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7637a5b2-7ef5-4fc4-95c4-c5405933401b tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.043068 Oct 29 02:45:33.024920 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 50/94] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:45:32 2022] POST /compute/v2.1/flavors => generated 507 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:33.027324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2dfda0a0-b7e9-4b28-89a1-07e6c118fdf1 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:33.069521 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2dfda0a0-b7e9-4b28-89a1-07e6c118fdf1 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/fa2a125c-1df8-41df-b703-a5e02082c9c5" status: 202 len: 0 microversion: 2.1 time: 0.046721 Oct 29 02:45:33.070594 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 45/95] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:45:33 2022] DELETE /compute/v2.1/flavors/fa2a125c-1df8-41df-b703-a5e02082c9c5 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:45:33.092959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b895b7df-b68e-4640-811d-466b1de42349 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:33.118835 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b895b7df-b68e-4640-811d-466b1de42349 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036226 Oct 29 02:45:33.135673 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 51/96] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:33.139294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3e986d9c-4371-4da1-9414-1a20184309dd tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1126810965", "id": 1125627459, "os-flavor-access:is_public": "True"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:33.171480 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3e986d9c-4371-4da1-9414-1a20184309dd tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.036158 Oct 29 02:45:33.172206 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 46/97] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:45:33 2022] POST /compute/v2.1/flavors => generated 414 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:33.185436 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a07e67bb-5c69-423d-840a-790a06250bce tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:33.191002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3b8b7e37-1f7b-4bc5-a9a4-a41492a63a65 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:33.191623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3b8b7e37-1f7b-4bc5-a9a4-a41492a63a65 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] [instance: 20072a0e-36ce-4bc7-b83e-7d88340ab50c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:33.192364 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a07e67bb-5c69-423d-840a-790a06250bce tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/1125627459" status: 200 len: 414 microversion: 2.1 time: 0.011535 Oct 29 02:45:33.213699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b8b7e37-1f7b-4bc5-a9a4-a41492a63a65 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:33.213870 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 52/98] 10.222.0.46 () {58 vars in 1158 bytes} [Sat Oct 29 02:45:33 2022] GET /compute/v2.1/flavors/1125627459 => generated 414 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:33.216383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b8b7e37-1f7b-4bc5-a9a4-a41492a63a65 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:33.216920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b8b7e37-1f7b-4bc5-a9a4-a41492a63a65 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:33.217985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b8b7e37-1f7b-4bc5-a9a4-a41492a63a65 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:33.220741 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b8b7e37-1f7b-4bc5-a9a4-a41492a63a65 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:33.221362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b8b7e37-1f7b-4bc5-a9a4-a41492a63a65 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:33.608819 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3b8b7e37-1f7b-4bc5-a9a4-a41492a63a65 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb72790532b484583be089c38656f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f1de1bd2764e2994a4f1caaef0ad4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:33.640578 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3b8b7e37-1f7b-4bc5-a9a4-a41492a63a65 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] 10.222.0.46 "GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c" status: 200 len: 1297 microversion: 2.1 time: 0.454054 Oct 29 02:45:33.668064 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 47/99] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:33 2022] GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c => generated 1297 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:34.041011 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6b72a7ab-c1de-4029-a90a-119ea276d325 tempest-FlavorsAdminTestJSON-909275346 tempest-FlavorsAdminTestJSON-909275346-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:34.173265 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6b72a7ab-c1de-4029-a90a-119ea276d325 tempest-FlavorsAdminTestJSON-909275346 tempest-FlavorsAdminTestJSON-909275346-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.957978 Oct 29 02:45:34.185708 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 53/100] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:33 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:34.198610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-782c51f9-a665-450f-9d9c-c566b2ba5585 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:34.264716 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-782c51f9-a665-450f-9d9c-c566b2ba5585 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1125627459" status: 202 len: 0 microversion: 2.1 time: 0.066252 Oct 29 02:45:34.268647 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 48/101] 10.222.0.46 () {58 vars in 1161 bytes} [Sat Oct 29 02:45:34 2022] DELETE /compute/v2.1/flavors/1125627459 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:45:34.277946 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7a825ba2-0dcd-4f0c-8922-48d7d09f5482 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:34.345684 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7a825ba2-0dcd-4f0c-8922-48d7d09f5482 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072560 Oct 29 02:45:34.346300 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 54/102] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:34.368491 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b9dc48b9-c18e-475f-9b8d-e8e1d5f80c21 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-380415223", "id": 1871050355, "os-flavor-access:is_public": "False"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:34.427012 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b9dc48b9-c18e-475f-9b8d-e8e1d5f80c21 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.062582 Oct 29 02:45:34.440325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ca4db304-33d3-4458-b698-44d65cbb3d29 tempest-FlavorsAdminTestJSON-909275346 tempest-FlavorsAdminTestJSON-909275346-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "1871050355"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:34.446595 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 49/103] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:45:34 2022] POST /compute/v2.1/flavors => generated 429 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:34.465437 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-ca4db304-33d3-4458-b698-44d65cbb3d29 tempest-FlavorsAdminTestJSON-909275346 tempest-FlavorsAdminTestJSON-909275346-project] HTTP exception thrown: Flavor 1871050355 could not be found. Oct 29 02:45:34.486842 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ca4db304-33d3-4458-b698-44d65cbb3d29 tempest-FlavorsAdminTestJSON-909275346 tempest-FlavorsAdminTestJSON-909275346-project] Request method failure captured: Oct 29 02:45:34.486842 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:45:34.486842 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:45:34.486842 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:45:34.486842 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:45:34.486842 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 107 Oct 29 02:45:34.486842 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:45:34.486842 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:45:34.486842 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:45:34.486842 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:34.486842 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPJ1Iog2gy90yk2m7kGH--v1ejqg0VW1d2GdQnyIEMENnv7Mt3noWPksskfh-3-gSNcE3UmiAu3z3guNljFFCKUyv9srzd7-_K57mfPWTCs0UnV5_PLvNEh0ex7ccXC5-gkf1YWRxoENRFfDC2lRErZubc-VNj7GGI8Li7K94RmQr8 Oct 29 02:45:34.486842 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:45:34.486842 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:45:34.486842 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:45:34.486842 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:45:34.486842 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:45:34.486842 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:45:34.486842 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 88539ea587514709b80ec95bbd73b9ea Oct 29 02:45:34.486842 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-FlavorsAdminTestJSON-909275346 Oct 29 02:45:34.486842 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:45:34.486842 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:45:34.488872 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/88539ea587514709b80ec95bbd73b9ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/88539ea587514709b80ec95bbd73b9ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_88539ea587514709b80ec95bbd73b9ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/88539ea587514709b80ec95bbd73b9ea"}]}] Oct 29 02:45:34.488872 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-FlavorsAdminTestJSON-909275346 Oct 29 02:45:34.488872 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 88539ea587514709b80ec95bbd73b9ea Oct 29 02:45:34.488872 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-909275346 Oct 29 02:45:34.488872 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-FlavorsAdminTestJSON-909275346-project Oct 29 02:45:34.488872 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:45:34.488872 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:45:34.488872 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 57f8cacae5a3402da3d8b089f70d6966 Oct 29 02:45:34.488872 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-FlavorsAdminTestJSON-909275346-project Oct 29 02:45:34.488872 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:45:34.488872 n-d-862967-2 devstack@n-api.service[127125]: {"server": {"name": "test", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "1871050355"}} Oct 29 02:45:34.488872 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:45:34.488872 n-d-862967-2 devstack@n-api.service[127125]: exception: Flavor 1871050355 could not be found. Oct 29 02:45:34.490741 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'cd315600-df67-41c1-95d3-95a5145fc39a', 'flavorRef': '1871050355'}}} Oct 29 02:45:34.490741 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:34.490741 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:34.490741 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 29 02:45:34.490741 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 29 02:45:34.490741 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 02:45:34.490741 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 02:45:34.490741 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:45:34.490741 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:45:34.490741 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 02:45:34.490741 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 02:45:34.490741 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 02:45:34.490741 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:34.490741 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 02:45:34.490741 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 02:45:34.490741 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1871050355 could not be found. Oct 29 02:45:34.490741 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:34.490741 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:34.490741 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:34.490741 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:34.492375 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:34.492375 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:34.492375 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:34.492375 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:34.492375 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:34.492375 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:34.492375 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:45:34.492375 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:45:34.492375 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:45:34.492375 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:45:34.492375 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:45:34.492375 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:45:34.492375 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 02:45:34.492375 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 29 02:45:34.492375 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 29 02:45:34.492375 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1871050355 could not be found. Oct 29 02:45:34.492375 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:34.492375 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:34.492375 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:34.492375 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:34.492375 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:34.493773 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:34.493773 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:45:34.493773 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:45:34.493773 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1871050355 could not be found. Oct 29 02:45:34.493773 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:34.493773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ca4db304-33d3-4458-b698-44d65cbb3d29 tempest-FlavorsAdminTestJSON-909275346 tempest-FlavorsAdminTestJSON-909275346-project] Returning 400 to user: Flavor 1871050355 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:34.493773 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ca4db304-33d3-4458-b698-44d65cbb3d29 tempest-FlavorsAdminTestJSON-909275346 tempest-FlavorsAdminTestJSON-909275346-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.052097 Oct 29 02:45:34.495887 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 55/104] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:45:34 2022] POST /compute/v2.1/servers => generated 81 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:34.502514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-40ca37cb-cf67-4d78-b606-307b01a3eff9 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:34.543625 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-40ca37cb-cf67-4d78-b606-307b01a3eff9 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1871050355" status: 202 len: 0 microversion: 2.1 time: 0.044988 Oct 29 02:45:34.559979 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cea6c8fc-576e-4f52-8b5d-ba6684fd0a08 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:34.564771 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 50/105] 10.222.0.46 () {58 vars in 1161 bytes} [Sat Oct 29 02:45:34 2022] DELETE /compute/v2.1/flavors/1871050355 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:45:34.614195 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cea6c8fc-576e-4f52-8b5d-ba6684fd0a08 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036542 Oct 29 02:45:34.615624 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 56/106] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:45:34.637834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c6d56ffe-94f5-4e37-a15c-71df42c073d3 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1194444942", "id": 738800709, "os-flavor-access:is_public": "False"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:34.663752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-028a88ff-d95d-46d0-beb8-feae8e318359 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:34.664469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-028a88ff-d95d-46d0-beb8-feae8e318359 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] [instance: 20072a0e-36ce-4bc7-b83e-7d88340ab50c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:34.673077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-028a88ff-d95d-46d0-beb8-feae8e318359 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:34.679750 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c6d56ffe-94f5-4e37-a15c-71df42c073d3 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.046068 Oct 29 02:45:34.681051 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-028a88ff-d95d-46d0-beb8-feae8e318359 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:34.681965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-028a88ff-d95d-46d0-beb8-feae8e318359 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:34.686153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-028a88ff-d95d-46d0-beb8-feae8e318359 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:34.689137 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-028a88ff-d95d-46d0-beb8-feae8e318359 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:34.690146 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 51/107] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:45:34 2022] POST /compute/v2.1/flavors => generated 412 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:34.690817 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-028a88ff-d95d-46d0-beb8-feae8e318359 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:34.713720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-71d4b622-bdc1-479e-9448-8d4be2d210a6 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-683892490", "id": 1666992907, "os-flavor-access:is_public": "True"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:34.760584 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-71d4b622-bdc1-479e-9448-8d4be2d210a6 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.061780 Oct 29 02:45:34.766936 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 52/108] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:45:34 2022] POST /compute/v2.1/flavors => generated 413 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:34.783718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-09c2f324-30ec-44ff-b4a3-92f05c00f771 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:34.817098 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-09c2f324-30ec-44ff-b4a3-92f05c00f771 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.038578 Oct 29 02:45:34.818384 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 53/109] 10.222.0.46 () {58 vars in 1169 bytes} [Sat Oct 29 02:45:34 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:34.853712 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-09eb0c25-0948-4559-968c-b9ee11ad387e tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:34.881183 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-09eb0c25-0948-4559-968c-b9ee11ad387e tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.048150 Oct 29 02:45:34.881932 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 54/110] 10.222.0.46 () {58 vars in 1177 bytes} [Sat Oct 29 02:45:34 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:34.920584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3b90cc13-0413-48d2-b7bf-89570359abfb tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:34.945222 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3b90cc13-0413-48d2-b7bf-89570359abfb tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.034592 Oct 29 02:45:34.946324 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 55/111] 10.222.0.46 () {58 vars in 1171 bytes} [Sat Oct 29 02:45:34 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:34.959445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9f78a989-e891-4c01-a77d-de7ea9f5240e tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:34.980007 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9f78a989-e891-4c01-a77d-de7ea9f5240e tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.023742 Oct 29 02:45:34.981126 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 56/112] 10.222.0.46 () {58 vars in 1169 bytes} [Sat Oct 29 02:45:34 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:45:34.998004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f4705c53-3818-4c71-981a-13990b77d5b7 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:35.035131 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f4705c53-3818-4c71-981a-13990b77d5b7 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.041920 Oct 29 02:45:35.051401 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 57/113] 10.222.0.46 () {58 vars in 1169 bytes} [Sat Oct 29 02:45:34 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:35.078206 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-de932427-98c7-4386-8447-5f2e3fc0e8fb tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:35.102022 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-de932427-98c7-4386-8447-5f2e3fc0e8fb tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.027926 Oct 29 02:45:35.117021 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 58/114] 10.222.0.46 () {58 vars in 1175 bytes} [Sat Oct 29 02:45:35 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:45:35.123764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-696a2576-046a-4db2-a06d-f1237d9fdad3 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:35.146088 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-696a2576-046a-4db2-a06d-f1237d9fdad3 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.026827 Oct 29 02:45:35.157526 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 59/115] 10.222.0.46 () {58 vars in 1173 bytes} [Sat Oct 29 02:45:35 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:45:35.166751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a55bc66d-b0d8-48e1-9594-a6d6a0acd680 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:35.190608 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a55bc66d-b0d8-48e1-9594-a6d6a0acd680 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.027623 Oct 29 02:45:35.201008 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 60/116] 10.222.0.46 () {58 vars in 1169 bytes} [Sat Oct 29 02:45:35 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:45:35.211638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eabbef3c-47e7-4e5e-afb0-8c066aebe4df tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:35.239847 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eabbef3c-47e7-4e5e-afb0-8c066aebe4df tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1666992907" status: 202 len: 0 microversion: 2.1 time: 0.031595 Oct 29 02:45:35.240772 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 61/117] 10.222.0.46 () {58 vars in 1161 bytes} [Sat Oct 29 02:45:35 2022] DELETE /compute/v2.1/flavors/1666992907 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 02:45:35.267249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-159eca8b-34d7-4fac-81ff-9e144e7dd0a1 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:35.316506 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-159eca8b-34d7-4fac-81ff-9e144e7dd0a1 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.070818 Oct 29 02:45:35.317120 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 62/118] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:45:35.343230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ef74bd98-9ebb-4fab-8347-dd633ea495b7 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:35.375587 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ef74bd98-9ebb-4fab-8347-dd633ea495b7 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/738800709" status: 202 len: 0 microversion: 2.1 time: 0.032994 Oct 29 02:45:35.376589 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 63/119] 10.222.0.46 () {58 vars in 1158 bytes} [Sat Oct 29 02:45:35 2022] DELETE /compute/v2.1/flavors/738800709 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:45:35.385256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9e5b8243-56d1-4c90-8a71-4d01abd20566 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:35.443050 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9e5b8243-56d1-4c90-8a71-4d01abd20566 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061545 Oct 29 02:45:35.449302 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 64/120] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:45:35.584752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-028a88ff-d95d-46d0-beb8-feae8e318359 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb72790532b484583be089c38656f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f1de1bd2764e2994a4f1caaef0ad4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:35.600288 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-028a88ff-d95d-46d0-beb8-feae8e318359 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] 10.222.0.46 "GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c" status: 200 len: 1339 microversion: 2.1 time: 0.940646 Oct 29 02:45:35.603239 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 57/121] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:34 2022] GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c => generated 1339 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:45:35.621213 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1ff82c45-d3ab-4032-b2ea-842240d95c87 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1384317856", "id": 1343859141, "os-flavor-access:is_public": "False"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:35.681152 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1ff82c45-d3ab-4032-b2ea-842240d95c87 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.076140 Oct 29 02:45:35.685883 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 58/122] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:45:35 2022] POST /compute/v2.1/flavors => generated 415 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:35.706165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d948c4d9-614f-44ee-a96f-529c0d2d6b45 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:35.729951 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:DELETE=16,nova_api:SELECT=77,nova_api:INSERT=7 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:35.775064 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d948c4d9-614f-44ee-a96f-529c0d2d6b45 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.084877 Oct 29 02:45:35.775710 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 59/123] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:35.805100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d948c4d9-614f-44ee-a96f-529c0d2d6b45 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:35.806187 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d948c4d9-614f-44ee-a96f-529c0d2d6b45 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "GET /compute//" status: 200 len: 377 microversion: - time: 0.029637 Oct 29 02:45:35.806564 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 60/124] 10.222.0.46 () {56 vars in 886 bytes} [Sat Oct 29 02:45:35 2022] GET /compute/ => generated 377 bytes in 30 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 29 02:45:35.827361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-082aa958-d793-4afa-b372-a972fa291f09 tempest-FlavorsAdminTestJSON-909275346 tempest-FlavorsAdminTestJSON-909275346-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:35.886356 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-082aa958-d793-4afa-b372-a972fa291f09 tempest-FlavorsAdminTestJSON-909275346 tempest-FlavorsAdminTestJSON-909275346-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064103 Oct 29 02:45:35.887716 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 61/125] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:35.918910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8add8be2-03aa-4675-ae3c-45dc870ebc09 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:35.983231 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8add8be2-03aa-4675-ae3c-45dc870ebc09 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1343859141" status: 202 len: 0 microversion: 2.1 time: 0.075291 Oct 29 02:45:35.984706 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 62/126] 10.222.0.46 () {58 vars in 1161 bytes} [Sat Oct 29 02:45:35 2022] DELETE /compute/v2.1/flavors/1343859141 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:45:35.999444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e7057fca-401e-4f92-889c-694a886a8715 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:36.063818 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e7057fca-401e-4f92-889c-694a886a8715 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.074665 Oct 29 02:45:36.084019 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 63/127] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:36.105285 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fa7dfb95-85fd-47df-a7ed-6f1852397191 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1199105399", "id": 1398153849, "os-flavor-access:is_public": "True"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:36.168776 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fa7dfb95-85fd-47df-a7ed-6f1852397191 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.054951 Oct 29 02:45:36.170171 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 64/128] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:45:36 2022] POST /compute/v2.1/flavors => generated 414 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:36.183924 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0de47655-4ab1-48c2-be49-64bf9e707924 tempest-FlavorsAdminTestJSON-909275346 tempest-FlavorsAdminTestJSON-909275346-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:36.262369 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0de47655-4ab1-48c2-be49-64bf9e707924 tempest-FlavorsAdminTestJSON-909275346 tempest-FlavorsAdminTestJSON-909275346-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.082892 Oct 29 02:45:36.277375 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-06ffe16f-28b9-4581-a111-b3af2ad0fb0a tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Calling method '.version_select at 0x7ff058b2c4c0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:36.280308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06ffe16f-28b9-4581-a111-b3af2ad0fb0a tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:36.280986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06ffe16f-28b9-4581-a111-b3af2ad0fb0a tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:36.281439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06ffe16f-28b9-4581-a111-b3af2ad0fb0a tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:36.287801 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 65/129] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:36 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:45:36.319449 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-39ee4f30-fa9a-4cff-ba43-7f5d992cbf7d tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:36.364019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06ffe16f-28b9-4581-a111-b3af2ad0fb0a tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:36.364516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06ffe16f-28b9-4581-a111-b3af2ad0fb0a tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:36.371309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06ffe16f-28b9-4581-a111-b3af2ad0fb0a tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:36.378147 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-39ee4f30-fa9a-4cff-ba43-7f5d992cbf7d tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1398153849" status: 202 len: 0 microversion: 2.1 time: 0.072863 Oct 29 02:45:36.386407 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 66/130] 10.222.0.46 () {58 vars in 1161 bytes} [Sat Oct 29 02:45:36 2022] DELETE /compute/v2.1/flavors/1398153849 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 02:45:36.396180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-db947fe8-c96c-4ae0-b232-9f3fcbdc1cc9 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:36.419994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06ffe16f-28b9-4581-a111-b3af2ad0fb0a tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:36.424888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06ffe16f-28b9-4581-a111-b3af2ad0fb0a tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:36.425584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06ffe16f-28b9-4581-a111-b3af2ad0fb0a tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:36.448965 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-06ffe16f-28b9-4581-a111-b3af2ad0fb0a tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.992938 Oct 29 02:45:36.461884 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 65/131] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:36.476631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6845f124-4394-4917-b8d8-9121eac0def3 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Calling method '.version_select at 0x7ff058a93280>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:36.490319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6845f124-4394-4917-b8d8-9121eac0def3 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:36.491210 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6845f124-4394-4917-b8d8-9121eac0def3 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:36.495456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6845f124-4394-4917-b8d8-9121eac0def3 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:36.500435 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-db947fe8-c96c-4ae0-b232-9f3fcbdc1cc9 tempest-FlavorsAdminTestJSON-113078841 tempest-FlavorsAdminTestJSON-113078841-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.108102 Oct 29 02:45:36.501485 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 67/132] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:36.541115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6845f124-4394-4917-b8d8-9121eac0def3 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:36.543661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6845f124-4394-4917-b8d8-9121eac0def3 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:36.553198 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6845f124-4394-4917-b8d8-9121eac0def3 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:36.582553 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6845f124-4394-4917-b8d8-9121eac0def3 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:36.584200 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6845f124-4394-4917-b8d8-9121eac0def3 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:36.589206 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6845f124-4394-4917-b8d8-9121eac0def3 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:36.613479 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6845f124-4394-4917-b8d8-9121eac0def3 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.141274 Oct 29 02:45:36.614127 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 66/133] 10.222.0.46 () {58 vars in 1167 bytes} [Sat Oct 29 02:45:36 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:45:36.630038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b705a618-68c7-4d52-81c6-f5cd1e78dc6a tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:36.633154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b705a618-68c7-4d52-81c6-f5cd1e78dc6a tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] [instance: 20072a0e-36ce-4bc7-b83e-7d88340ab50c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:36.643812 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b705a618-68c7-4d52-81c6-f5cd1e78dc6a tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:36.649964 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b705a618-68c7-4d52-81c6-f5cd1e78dc6a tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:36.650781 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b705a618-68c7-4d52-81c6-f5cd1e78dc6a tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:36.651679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b705a618-68c7-4d52-81c6-f5cd1e78dc6a tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:36.655511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b705a618-68c7-4d52-81c6-f5cd1e78dc6a tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:36.657155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b705a618-68c7-4d52-81c6-f5cd1e78dc6a tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:36.892693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b705a618-68c7-4d52-81c6-f5cd1e78dc6a tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb72790532b484583be089c38656f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f1de1bd2764e2994a4f1caaef0ad4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:36.903727 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b705a618-68c7-4d52-81c6-f5cd1e78dc6a tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] 10.222.0.46 "GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c" status: 200 len: 1339 microversion: 2.1 time: 0.275777 Oct 29 02:45:36.907213 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 68/134] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:36 2022] GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c => generated 1339 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:36.919146 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-73d09321-9df1-43be-8b56-4fb894577855 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Calling method '.version_select at 0x7ff0589cae50>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:36.922556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73d09321-9df1-43be-8b56-4fb894577855 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:36.923612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73d09321-9df1-43be-8b56-4fb894577855 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:36.924270 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73d09321-9df1-43be-8b56-4fb894577855 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:36.965260 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73d09321-9df1-43be-8b56-4fb894577855 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:36.966301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73d09321-9df1-43be-8b56-4fb894577855 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:36.968623 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73d09321-9df1-43be-8b56-4fb894577855 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:36.997713 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73d09321-9df1-43be-8b56-4fb894577855 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:37.001184 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73d09321-9df1-43be-8b56-4fb894577855 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:37.002512 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73d09321-9df1-43be-8b56-4fb894577855 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:37.017997 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-73d09321-9df1-43be-8b56-4fb894577855 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.109178 Oct 29 02:45:37.019335 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 69/135] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:37.032832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e4a317eb-5eec-4211-92c0-22660ac8516a tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Calling method '.version_select at 0x7ff0589b2e50>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:37.037614 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e4a317eb-5eec-4211-92c0-22660ac8516a tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:37.041300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e4a317eb-5eec-4211-92c0-22660ac8516a tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:37.044251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e4a317eb-5eec-4211-92c0-22660ac8516a tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:37.096316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e4a317eb-5eec-4211-92c0-22660ac8516a tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:37.097212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e4a317eb-5eec-4211-92c0-22660ac8516a tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:37.097847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e4a317eb-5eec-4211-92c0-22660ac8516a tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:37.117859 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e4a317eb-5eec-4211-92c0-22660ac8516a tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.091484 Oct 29 02:45:37.121711 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 70/136] 10.222.0.46 () {58 vars in 1152 bytes} [Sat Oct 29 02:45:37 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:45:37.137849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2b09c504-5127-45fc-8ec2-e5105a28f640 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Calling method '.version_select at 0x7ff0589b2a60>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:37.139950 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b09c504-5127-45fc-8ec2-e5105a28f640 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:37.140685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b09c504-5127-45fc-8ec2-e5105a28f640 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:37.141343 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b09c504-5127-45fc-8ec2-e5105a28f640 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:37.190351 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2b09c504-5127-45fc-8ec2-e5105a28f640 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.056107 Oct 29 02:45:37.194617 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 71/137] 10.222.0.46 () {58 vars in 1179 bytes} [Sat Oct 29 02:45:37 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:37.210538 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6f4e78b2-d959-421d-b96f-8deef49c5438 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Calling method '.version_select at 0x7ff0589b2dc0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:37.212695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f4e78b2-d959-421d-b96f-8deef49c5438 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:37.213428 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f4e78b2-d959-421d-b96f-8deef49c5438 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:37.214096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f4e78b2-d959-421d-b96f-8deef49c5438 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:37.296477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f4e78b2-d959-421d-b96f-8deef49c5438 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:37.298807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f4e78b2-d959-421d-b96f-8deef49c5438 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:37.302961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f4e78b2-d959-421d-b96f-8deef49c5438 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:37.375287 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f4e78b2-d959-421d-b96f-8deef49c5438 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:37.377522 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f4e78b2-d959-421d-b96f-8deef49c5438 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:37.378200 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f4e78b2-d959-421d-b96f-8deef49c5438 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:37.405918 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6f4e78b2-d959-421d-b96f-8deef49c5438 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.203098 Oct 29 02:45:37.423224 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 72/138] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:45:37.440134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e291c934-11e8-4586-9ba6-483d0d4a45ec tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Calling method '.version_select at 0x7ff0589cab80>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:37.453756 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e291c934-11e8-4586-9ba6-483d0d4a45ec tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:37.456350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e291c934-11e8-4586-9ba6-483d0d4a45ec tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:37.457623 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e291c934-11e8-4586-9ba6-483d0d4a45ec tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:37.491600 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e291c934-11e8-4586-9ba6-483d0d4a45ec tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:37.497329 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e291c934-11e8-4586-9ba6-483d0d4a45ec tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:37.498138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e291c934-11e8-4586-9ba6-483d0d4a45ec tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:37.516476 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e291c934-11e8-4586-9ba6-483d0d4a45ec tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.090328 Oct 29 02:45:37.518711 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 73/139] 10.222.0.46 () {58 vars in 1152 bytes} [Sat Oct 29 02:45:37 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:37.542815 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-61f0fda1-d624-4cd8-949b-3eefdd1132fa tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Calling method '.version_select at 0x7ff05897aee0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:37.549168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61f0fda1-d624-4cd8-949b-3eefdd1132fa tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:37.550525 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61f0fda1-d624-4cd8-949b-3eefdd1132fa tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:37.551140 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61f0fda1-d624-4cd8-949b-3eefdd1132fa tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:37.580671 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61f0fda1-d624-4cd8-949b-3eefdd1132fa tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:37.581535 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61f0fda1-d624-4cd8-949b-3eefdd1132fa tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:37.581882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61f0fda1-d624-4cd8-949b-3eefdd1132fa tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:37.589485 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-61f0fda1-d624-4cd8-949b-3eefdd1132fa tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.058852 Oct 29 02:45:37.600877 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 74/140] 10.222.0.46 () {58 vars in 1152 bytes} [Sat Oct 29 02:45:37 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:37.616342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-01f06dd8-e903-4314-9f2b-81b64f1a0fe0 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Calling method '.version_select at 0x7ff05897ac10>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:37.622746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01f06dd8-e903-4314-9f2b-81b64f1a0fe0 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:37.624786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01f06dd8-e903-4314-9f2b-81b64f1a0fe0 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:37.625526 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01f06dd8-e903-4314-9f2b-81b64f1a0fe0 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:37.627889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-73629520-6b57-452b-b506-1d452974db39 tempest-FlavorsV261TestJSON-755548182 tempest-FlavorsV261TestJSON-755548182-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1574256134", "id": 631170761, "os-flavor-access:is_public": "True"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:37.659798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01f06dd8-e903-4314-9f2b-81b64f1a0fe0 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:37.660467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01f06dd8-e903-4314-9f2b-81b64f1a0fe0 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:37.660954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01f06dd8-e903-4314-9f2b-81b64f1a0fe0 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:37.671086 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-73629520-6b57-452b-b506-1d452974db39 tempest-FlavorsV261TestJSON-755548182 tempest-FlavorsV261TestJSON-755548182-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 1.037860 Oct 29 02:45:37.674963 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 67/141] 10.222.0.46 () {62 vars in 1188 bytes} [Sat Oct 29 02:45:36 2022] POST /compute/v2.1/flavors => generated 465 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:45:37.686534 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:37.701164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01f06dd8-e903-4314-9f2b-81b64f1a0fe0 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:37.701683 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01f06dd8-e903-4314-9f2b-81b64f1a0fe0 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:37.702867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01f06dd8-e903-4314-9f2b-81b64f1a0fe0 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:37.716918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01f06dd8-e903-4314-9f2b-81b64f1a0fe0 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=127125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 02:45:37.717126 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01f06dd8-e903-4314-9f2b-81b64f1a0fe0 tempest-HypervisorAdminTestJSON-1927547572 tempest-HypervisorAdminTestJSON-1927547572-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=127125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 02:45:37.719663 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9fb7cf9e-3e06-45fa-b515-5420c0385f10 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:37.720142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9fb7cf9e-3e06-45fa-b515-5420c0385f10 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:37.720579 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9fb7cf9e-3e06-45fa-b515-5420c0385f10 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:37.723970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9fb7cf9e-3e06-45fa-b515-5420c0385f10 None None] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:37.724478 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9fb7cf9e-3e06-45fa-b515-5420c0385f10 None None] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:37.724981 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9fb7cf9e-3e06-45fa-b515-5420c0385f10 None None] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:37.762056 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.compute.rpcapi [None req-9fb7cf9e-3e06-45fa-b515-5420c0385f10 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 29 02:45:37.768712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9fb7cf9e-3e06-45fa-b515-5420c0385f10 None None] Releasing lock "compute-rpcapi-router" {{(pid=127125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 02:45:37.852473 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9fb7cf9e-3e06-45fa-b515-5420c0385f10 None None] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.249753 Oct 29 02:45:37.860903 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 75/142] 10.222.0.46 () {58 vars in 1173 bytes} [Sat Oct 29 02:45:37 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:37.949134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6ac270b8-326e-4fff-84c8-cde7e8da7b24 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:37.950144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6ac270b8-326e-4fff-84c8-cde7e8da7b24 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] [instance: 20072a0e-36ce-4bc7-b83e-7d88340ab50c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:37.951352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d10ba5e2-5732-4799-97f2-e08bbb3f4985 tempest-FlavorsV261TestJSON-1483677547 tempest-FlavorsV261TestJSON-1483677547-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:37.963944 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d10ba5e2-5732-4799-97f2-e08bbb3f4985 tempest-FlavorsV261TestJSON-1483677547 tempest-FlavorsV261TestJSON-1483677547-project] 10.222.0.46 "GET /compute/v2.1/flavors/631170761" status: 200 len: 465 microversion: 2.61 time: 0.281728 Oct 29 02:45:37.970215 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 68/143] 10.222.0.46 () {60 vars in 1196 bytes} [Sat Oct 29 02:45:37 2022] GET /compute/v2.1/flavors/631170761 => generated 465 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 02:45:37.989123 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e7e5f748-270d-4c46-8203-6970e5305ee8 tempest-FlavorsV261TestJSON-755548182 tempest-FlavorsV261TestJSON-755548182-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:37.992464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ac270b8-326e-4fff-84c8-cde7e8da7b24 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:37.994666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ac270b8-326e-4fff-84c8-cde7e8da7b24 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:37.996257 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ac270b8-326e-4fff-84c8-cde7e8da7b24 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:37.999665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ac270b8-326e-4fff-84c8-cde7e8da7b24 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:38.002542 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ac270b8-326e-4fff-84c8-cde7e8da7b24 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:38.003006 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ac270b8-326e-4fff-84c8-cde7e8da7b24 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:38.080736 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e7e5f748-270d-4c46-8203-6970e5305ee8 tempest-FlavorsV261TestJSON-755548182 tempest-FlavorsV261TestJSON-755548182-project-admin] 10.222.0.46 "PUT /compute/v2.1/flavors/631170761" status: 200 len: 466 microversion: 2.61 time: 0.097728 Oct 29 02:45:38.087862 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 69/144] 10.222.0.46 () {62 vars in 1216 bytes} [Sat Oct 29 02:45:37 2022] PUT /compute/v2.1/flavors/631170761 => generated 466 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:45:38.095476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-81a8c186-30ca-4142-8e0f-4370c6ffa737 tempest-FlavorsV261TestJSON-1483677547 tempest-FlavorsV261TestJSON-1483677547-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:38.128880 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=15,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:38.174030 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-81a8c186-30ca-4142-8e0f-4370c6ffa737 tempest-FlavorsV261TestJSON-1483677547 tempest-FlavorsV261TestJSON-1483677547-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 6247 microversion: 2.61 time: 0.082334 Oct 29 02:45:38.175941 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 70/145] 10.222.0.46 () {60 vars in 1187 bytes} [Sat Oct 29 02:45:38 2022] GET /compute/v2.1/flavors/detail => generated 6247 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:45:38.203216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6206dd89-61d9-49c0-b0be-af2365f7e13a tempest-FlavorsV261TestJSON-1483677547 tempest-FlavorsV261TestJSON-1483677547-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:38.247077 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6206dd89-61d9-49c0-b0be-af2365f7e13a tempest-FlavorsV261TestJSON-1483677547 tempest-FlavorsV261TestJSON-1483677547-project] 10.222.0.46 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.61 time: 0.044154 Oct 29 02:45:38.249560 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 71/146] 10.222.0.46 () {60 vars in 1166 bytes} [Sat Oct 29 02:45:38 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:45:38.378504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-a774bbf2-de7a-4120-891c-6ae88d5b749b req-ba5c05f1-5275-4e40-a4b1-b1e6bd99afa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20072a0e-36ce-4bc7-b83e-7d88340ab50c", "tag": "9c7abf8e-be92-4c31-a036-be7c42399521"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:38.418142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a774bbf2-de7a-4120-891c-6ae88d5b749b req-ba5c05f1-5275-4e40-a4b1-b1e6bd99afa1 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:38.418657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a774bbf2-de7a-4120-891c-6ae88d5b749b req-ba5c05f1-5275-4e40-a4b1-b1e6bd99afa1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:38.426989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a774bbf2-de7a-4120-891c-6ae88d5b749b req-ba5c05f1-5275-4e40-a4b1-b1e6bd99afa1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:38.491929 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-a774bbf2-de7a-4120-891c-6ae88d5b749b req-ba5c05f1-5275-4e40-a4b1-b1e6bd99afa1 service nova] Creating event network-changed:9c7abf8e-be92-4c31-a036-be7c42399521 for instance 20072a0e-36ce-4bc7-b83e-7d88340ab50c on n-h2-862967-2 Oct 29 02:45:38.497951 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a774bbf2-de7a-4120-891c-6ae88d5b749b req-ba5c05f1-5275-4e40-a4b1-b1e6bd99afa1 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 02:45:38.498471 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a774bbf2-de7a-4120-891c-6ae88d5b749b req-ba5c05f1-5275-4e40-a4b1-b1e6bd99afa1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 02:45:38.499872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae069ae1-a134-4096-9d6f-89cf05758ceb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:38.500388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae069ae1-a134-4096-9d6f-89cf05758ceb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:38.501009 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae069ae1-a134-4096-9d6f-89cf05758ceb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:38.501777 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae069ae1-a134-4096-9d6f-89cf05758ceb None None] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:38.502300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae069ae1-a134-4096-9d6f-89cf05758ceb None None] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:38.502830 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae069ae1-a134-4096-9d6f-89cf05758ceb None None] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:38.525275 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.compute.rpcapi [None req-ae069ae1-a134-4096-9d6f-89cf05758ceb None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 29 02:45:38.526172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae069ae1-a134-4096-9d6f-89cf05758ceb None None] Releasing lock "compute-rpcapi-router" {{(pid=127124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 02:45:38.562804 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ae069ae1-a134-4096-9d6f-89cf05758ceb None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.311213 Oct 29 02:45:38.563841 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 72/147] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:38.580083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7f9a4bd9-7cd4-4782-b30f-d42aed741ef0 tempest-FlavorsV261TestJSON-755548182 tempest-FlavorsV261TestJSON-755548182-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:38.619313 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7f9a4bd9-7cd4-4782-b30f-d42aed741ef0 tempest-FlavorsV261TestJSON-755548182 tempest-FlavorsV261TestJSON-755548182-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/631170761" status: 202 len: 0 microversion: 2.61 time: 0.051364 Oct 29 02:45:38.620458 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 73/148] 10.222.0.46 () {60 vars in 1199 bytes} [Sat Oct 29 02:45:38 2022] DELETE /compute/v2.1/flavors/631170761 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:45:38.629702 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3eadad11-af14-47ca-a948-fa0c4d0f0574 tempest-FlavorsV261TestJSON-755548182 tempest-FlavorsV261TestJSON-755548182-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:38.660168 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3eadad11-af14-47ca-a948-fa0c4d0f0574 tempest-FlavorsV261TestJSON-755548182 tempest-FlavorsV261TestJSON-755548182-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.035142 Oct 29 02:45:38.674285 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 74/149] 10.222.0.46 () {60 vars in 1187 bytes} [Sat Oct 29 02:45:38 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:45:38.912637 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6ac270b8-326e-4fff-84c8-cde7e8da7b24 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb72790532b484583be089c38656f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f1de1bd2764e2994a4f1caaef0ad4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:38.923998 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6ac270b8-326e-4fff-84c8-cde7e8da7b24 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] 10.222.0.46 "GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c" status: 200 len: 1339 microversion: 2.1 time: 0.997939 Oct 29 02:45:38.930268 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 76/150] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:37 2022] GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c => generated 1339 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:39.962935 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f422d954-5461-4d8a-a68b-8a68dde51d03 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:39.966075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f422d954-5461-4d8a-a68b-8a68dde51d03 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] [instance: 20072a0e-36ce-4bc7-b83e-7d88340ab50c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:39.971282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=14 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:39.995003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f422d954-5461-4d8a-a68b-8a68dde51d03 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:39.999091 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f422d954-5461-4d8a-a68b-8a68dde51d03 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:40.000102 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f422d954-5461-4d8a-a68b-8a68dde51d03 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:40.001620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f422d954-5461-4d8a-a68b-8a68dde51d03 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:40.002592 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f422d954-5461-4d8a-a68b-8a68dde51d03 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:40.004900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f422d954-5461-4d8a-a68b-8a68dde51d03 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:40.898449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f422d954-5461-4d8a-a68b-8a68dde51d03 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb72790532b484583be089c38656f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f1de1bd2764e2994a4f1caaef0ad4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:40.909863 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f422d954-5461-4d8a-a68b-8a68dde51d03 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] 10.222.0.46 "GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c" status: 200 len: 1339 microversion: 2.1 time: 0.956919 Oct 29 02:45:40.914723 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 75/151] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:39 2022] GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c => generated 1339 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:41.943435 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f363fd31-ccc8-43d9-8dcf-8c486a487735 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:41.945396 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f363fd31-ccc8-43d9-8dcf-8c486a487735 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] [instance: 20072a0e-36ce-4bc7-b83e-7d88340ab50c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:41.949459 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:41.969001 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f363fd31-ccc8-43d9-8dcf-8c486a487735 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:41.971599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f363fd31-ccc8-43d9-8dcf-8c486a487735 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:41.973284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f363fd31-ccc8-43d9-8dcf-8c486a487735 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:41.976506 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f363fd31-ccc8-43d9-8dcf-8c486a487735 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:41.979012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f363fd31-ccc8-43d9-8dcf-8c486a487735 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:41.981291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f363fd31-ccc8-43d9-8dcf-8c486a487735 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:42.595655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f363fd31-ccc8-43d9-8dcf-8c486a487735 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb72790532b484583be089c38656f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f1de1bd2764e2994a4f1caaef0ad4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:42.614178 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f363fd31-ccc8-43d9-8dcf-8c486a487735 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] 10.222.0.46 "GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c" status: 200 len: 1339 microversion: 2.1 time: 0.673231 Oct 29 02:45:42.615648 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 77/152] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:41 2022] GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c => generated 1339 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:43.641567 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-238d7d07-49f0-45af-964f-142b5c3b4c42 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:43.642184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-238d7d07-49f0-45af-964f-142b5c3b4c42 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] [instance: 20072a0e-36ce-4bc7-b83e-7d88340ab50c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:43.652642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-238d7d07-49f0-45af-964f-142b5c3b4c42 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:43.655579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-238d7d07-49f0-45af-964f-142b5c3b4c42 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:43.657360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-238d7d07-49f0-45af-964f-142b5c3b4c42 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:43.659190 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-238d7d07-49f0-45af-964f-142b5c3b4c42 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:43.660318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-238d7d07-49f0-45af-964f-142b5c3b4c42 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:43.667768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-238d7d07-49f0-45af-964f-142b5c3b4c42 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:43.954402 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-238d7d07-49f0-45af-964f-142b5c3b4c42 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb72790532b484583be089c38656f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f1de1bd2764e2994a4f1caaef0ad4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:43.971923 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-238d7d07-49f0-45af-964f-142b5c3b4c42 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] 10.222.0.46 "GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c" status: 200 len: 1339 microversion: 2.1 time: 0.335101 Oct 29 02:45:43.975894 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 76/153] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:43 2022] GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c => generated 1339 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:45.002089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-681c5f2d-7797-43f1-8b3c-b8e3044dadf2 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:45.002710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-681c5f2d-7797-43f1-8b3c-b8e3044dadf2 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] [instance: 20072a0e-36ce-4bc7-b83e-7d88340ab50c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:45.010099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-681c5f2d-7797-43f1-8b3c-b8e3044dadf2 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:45.010899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-681c5f2d-7797-43f1-8b3c-b8e3044dadf2 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:45.011520 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-681c5f2d-7797-43f1-8b3c-b8e3044dadf2 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:45.012473 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-681c5f2d-7797-43f1-8b3c-b8e3044dadf2 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:45.013610 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-681c5f2d-7797-43f1-8b3c-b8e3044dadf2 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:45.014285 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-681c5f2d-7797-43f1-8b3c-b8e3044dadf2 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:45.197547 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-681c5f2d-7797-43f1-8b3c-b8e3044dadf2 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb72790532b484583be089c38656f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f1de1bd2764e2994a4f1caaef0ad4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:45.207805 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-681c5f2d-7797-43f1-8b3c-b8e3044dadf2 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] 10.222.0.46 "GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c" status: 200 len: 1339 microversion: 2.1 time: 0.209735 Oct 29 02:45:45.209124 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 78/154] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:44 2022] GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c => generated 1339 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:46.233255 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9e786427-8664-4949-a042-1fd2a1fb3284 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:46.235266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9e786427-8664-4949-a042-1fd2a1fb3284 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] [instance: 20072a0e-36ce-4bc7-b83e-7d88340ab50c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:46.242298 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e786427-8664-4949-a042-1fd2a1fb3284 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:46.243071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e786427-8664-4949-a042-1fd2a1fb3284 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:46.243722 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e786427-8664-4949-a042-1fd2a1fb3284 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:46.244688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e786427-8664-4949-a042-1fd2a1fb3284 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:46.245385 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e786427-8664-4949-a042-1fd2a1fb3284 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:46.246512 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e786427-8664-4949-a042-1fd2a1fb3284 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:46.754835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9e786427-8664-4949-a042-1fd2a1fb3284 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb72790532b484583be089c38656f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f1de1bd2764e2994a4f1caaef0ad4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:46.772922 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9e786427-8664-4949-a042-1fd2a1fb3284 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] 10.222.0.46 "GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c" status: 200 len: 1339 microversion: 2.1 time: 0.544256 Oct 29 02:45:46.775161 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 77/155] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:46 2022] GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c => generated 1339 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:47.201570 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8f74f1a9-0f84-493e-99b1-dead8269b753 tempest-InstanceUsageAuditLogNegativeTestJSON-1485927220 tempest-InstanceUsageAuditLogNegativeTestJSON-1485927220-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:47.204795 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-8f74f1a9-0f84-493e-99b1-dead8269b753 tempest-InstanceUsageAuditLogNegativeTestJSON-1485927220 tempest-InstanceUsageAuditLogNegativeTestJSON-1485927220-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 29 02:45:47.215698 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8f74f1a9-0f84-493e-99b1-dead8269b753 tempest-InstanceUsageAuditLogNegativeTestJSON-1485927220 tempest-InstanceUsageAuditLogNegativeTestJSON-1485927220-project-admin] Request method failure captured: Oct 29 02:45:47.215698 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 29 02:45:47.215698 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:45:47.215698 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:45:47.215698 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:45:47.215698 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:45:47.215698 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:45:47.215698 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:45:47.215698 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:45:47.215698 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:47.215698 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPanAfNw7kZCZ8YbG-pR5F3B5veOjnEPrrfFVGp_X-Q58K3ABZCftDtgtPlLvEdrizEkece0dMiEYQGOq1fNRsrEysb0q3Eikjz3R4xgdAQ7b_D8MSD1m7zLUxnv3bo-fmMcmEztl7PderjBmU1ejFUqnh4kjwdPLbBQQrDEngw9K8 Oct 29 02:45:47.215698 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:45:47.215698 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:45:47.215698 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:45:47.215698 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:45:47.215698 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:45:47.215698 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:45:47.215698 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 36f00c67b58144aaa314e7f3ccc0eea1 Oct 29 02:45:47.215698 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1485927220 Oct 29 02:45:47.215698 n-d-862967-2 devstack@n-api.service[127125]: X-Role: admin,reader,member Oct 29 02:45:47.215698 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: admin,reader,member Oct 29 02:45:47.216997 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/36f00c67b58144aaa314e7f3ccc0eea1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/36f00c67b58144aaa314e7f3ccc0eea1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_36f00c67b58144aaa314e7f3ccc0eea1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/36f00c67b58144aaa314e7f3ccc0eea1"}]}] Oct 29 02:45:47.216997 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1485927220 Oct 29 02:45:47.216997 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 36f00c67b58144aaa314e7f3ccc0eea1 Oct 29 02:45:47.216997 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1485927220 Oct 29 02:45:47.216997 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1485927220-project-admin Oct 29 02:45:47.216997 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:45:47.216997 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:45:47.216997 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: c096c1251dec4e4095fc3ec431d71cdc Oct 29 02:45:47.216997 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1485927220-project-admin Oct 29 02:45:47.216997 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:45:47.216997 n-d-862967-2 devstack@n-api.service[127125]: exception: Invalid timestamp for date invalid_time Oct 29 02:45:47.217790 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'invalid_time'} Oct 29 02:45:47.217790 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:47.217790 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:47.217790 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 29 02:45:47.217790 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 29 02:45:47.217790 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 29 02:45:47.217790 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 29 02:45:47.217790 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 29 02:45:47.217790 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 29 02:45:47.217790 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 29 02:45:47.217790 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:47.217790 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:47.217790 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:47.217790 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:47.217790 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:47.217790 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:47.217790 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:47.217790 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:47.217790 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:47.217790 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:47.218854 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 29 02:45:47.218854 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 29 02:45:47.218854 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 29 02:45:47.218854 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:47.218854 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:47.218854 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:47.218854 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:47.218854 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:47.218854 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:47.218854 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:45:47.218854 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:45:47.218854 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 29 02:45:47.218854 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:45:47.220899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8f74f1a9-0f84-493e-99b1-dead8269b753 tempest-InstanceUsageAuditLogNegativeTestJSON-1485927220 tempest-InstanceUsageAuditLogNegativeTestJSON-1485927220-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:47.221962 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8f74f1a9-0f84-493e-99b1-dead8269b753 tempest-InstanceUsageAuditLogNegativeTestJSON-1485927220 tempest-InstanceUsageAuditLogNegativeTestJSON-1485927220-project-admin] 10.222.0.46 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.582099 Oct 29 02:45:47.222996 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 79/156] 10.222.0.46 () {58 vars in 1224 bytes} [Sat Oct 29 02:45:46 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 584 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:47.759666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:47.769051 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-02518fb9-11f5-43cc-aac3-19cc053b17a2 tempest-InstanceUsageAuditLogNegativeTestJSON-1164894772 tempest-InstanceUsageAuditLogNegativeTestJSON-1164894772-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:47.771582 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-02518fb9-11f5-43cc-aac3-19cc053b17a2 tempest-InstanceUsageAuditLogNegativeTestJSON-1164894772 tempest-InstanceUsageAuditLogNegativeTestJSON-1164894772-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'f9a071b89f7048c38a5ad0d546f52e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a8dea6233401a95eca3c1de9a9baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:47.773720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-02518fb9-11f5-43cc-aac3-19cc053b17a2 tempest-InstanceUsageAuditLogNegativeTestJSON-1164894772 tempest-InstanceUsageAuditLogNegativeTestJSON-1164894772-project] Request method failure captured: Oct 29 02:45:47.773720 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 29 02:45:47.773720 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:45:47.773720 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:45:47.773720 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:45:47.773720 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:45:47.773720 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:45:47.773720 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:45:47.773720 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:45:47.773720 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:47.773720 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPYe10p2O3PVrfCq5Xafk8edhgNecd0TNhy5jvaWw_CFgwwhG6A-ZU-_FZZgP2pJI1xnKdBdzIsVrbBSZArw5q0yh9j2WBcLhzjQILwdDoMxz51YmLx3r8T299vhPBroSJe7e80AryVqO8kif4TW51JUjDyXzNauq5fbeVXxFdqkIA Oct 29 02:45:47.773720 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:45:47.773720 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:45:47.773720 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:45:47.773720 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:45:47.773720 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:45:47.773720 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:45:47.773720 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 019a8dea6233401a95eca3c1de9a9baa Oct 29 02:45:47.773720 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1164894772 Oct 29 02:45:47.773720 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:45:47.773720 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:45:47.774833 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/019a8dea6233401a95eca3c1de9a9baa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/019a8dea6233401a95eca3c1de9a9baa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_019a8dea6233401a95eca3c1de9a9baa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/019a8dea6233401a95eca3c1de9a9baa"}]}] Oct 29 02:45:47.774833 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1164894772 Oct 29 02:45:47.774833 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 019a8dea6233401a95eca3c1de9a9baa Oct 29 02:45:47.774833 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1164894772 Oct 29 02:45:47.774833 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1164894772-project Oct 29 02:45:47.774833 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:45:47.774833 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:45:47.774833 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: f9a071b89f7048c38a5ad0d546f52e7a Oct 29 02:45:47.774833 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1164894772-project Oct 29 02:45:47.774833 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:45:47.775382 n-d-862967-2 devstack@n-api.service[127124]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 29 02:45:47.775382 n-d-862967-2 devstack@n-api.service[127124]: action_args: {} Oct 29 02:45:47.775382 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:47.775382 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:47.775382 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:47.775382 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:47.775382 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:47.775382 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:47.775382 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:47.775382 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:47.775382 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 29 02:45:47.775382 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 29 02:45:47.775382 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:47.775382 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:47.775382 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:47.775382 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:47.775382 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:47.775382 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:47.775382 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:47.775382 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:47.776383 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:47.776383 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:47.776383 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:47.776383 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:47.776383 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:47.776383 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:47.776383 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 29 02:45:47.776383 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:47.776383 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:47.776383 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:47.776383 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:47.776383 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:47.776383 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:47.776383 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:47.776383 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:47.776383 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 29 02:45:47.776383 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:47.778770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-02518fb9-11f5-43cc-aac3-19cc053b17a2 tempest-InstanceUsageAuditLogNegativeTestJSON-1164894772 tempest-InstanceUsageAuditLogNegativeTestJSON-1164894772-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:47.779919 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-02518fb9-11f5-43cc-aac3-19cc053b17a2 tempest-InstanceUsageAuditLogNegativeTestJSON-1164894772 tempest-InstanceUsageAuditLogNegativeTestJSON-1164894772-project] 10.222.0.46 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.551481 Oct 29 02:45:47.781044 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 78/157] 10.222.0.46 () {58 vars in 1185 bytes} [Sat Oct 29 02:45:47 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 553 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:45:47.790644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f20f8bf6-1f86-4307-a528-e2ed46093c56 tempest-InstanceUsageAuditLogNegativeTestJSON-1164894772 tempest-InstanceUsageAuditLogNegativeTestJSON-1164894772-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:47.793097 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f20f8bf6-1f86-4307-a528-e2ed46093c56 tempest-InstanceUsageAuditLogNegativeTestJSON-1164894772 tempest-InstanceUsageAuditLogNegativeTestJSON-1164894772-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'f9a071b89f7048c38a5ad0d546f52e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019a8dea6233401a95eca3c1de9a9baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:47.794995 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f20f8bf6-1f86-4307-a528-e2ed46093c56 tempest-InstanceUsageAuditLogNegativeTestJSON-1164894772 tempest-InstanceUsageAuditLogNegativeTestJSON-1164894772-project] Request method failure captured: Oct 29 02:45:47.794995 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-29%2002:45:47 HTTP/1.1 Oct 29 02:45:47.794995 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:45:47.794995 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:45:47.794995 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:45:47.794995 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:45:47.794995 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:45:47.794995 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:45:47.794995 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:45:47.794995 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:45:47.794995 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPYe10p2O3PVrfCq5Xafk8edhgNecd0TNhy5jvaWw_CFgwwhG6A-ZU-_FZZgP2pJI1xnKdBdzIsVrbBSZArw5q0yh9j2WBcLhzjQILwdDoMxz51YmLx3r8T299vhPBroSJe7e80AryVqO8kif4TW51JUjDyXzNauq5fbeVXxFdqkIA Oct 29 02:45:47.794995 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:45:47.794995 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:45:47.794995 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:45:47.794995 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:45:47.794995 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:45:47.794995 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:45:47.794995 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 019a8dea6233401a95eca3c1de9a9baa Oct 29 02:45:47.794995 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1164894772 Oct 29 02:45:47.794995 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:45:47.794995 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:45:47.796128 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/019a8dea6233401a95eca3c1de9a9baa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/019a8dea6233401a95eca3c1de9a9baa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_019a8dea6233401a95eca3c1de9a9baa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/019a8dea6233401a95eca3c1de9a9baa"}]}] Oct 29 02:45:47.796128 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1164894772 Oct 29 02:45:47.796128 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 019a8dea6233401a95eca3c1de9a9baa Oct 29 02:45:47.796128 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1164894772 Oct 29 02:45:47.796128 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1164894772-project Oct 29 02:45:47.796128 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:45:47.796128 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:45:47.796128 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: f9a071b89f7048c38a5ad0d546f52e7a Oct 29 02:45:47.796128 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1164894772-project Oct 29 02:45:47.796128 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:45:47.796666 n-d-862967-2 devstack@n-api.service[127124]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 29 02:45:47.796666 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '2022-10-29 02:45:47'} Oct 29 02:45:47.796666 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:45:47.796666 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:47.796666 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:47.796666 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:47.796666 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:45:47.796666 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:45:47.796666 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:45:47.796666 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:45:47.796666 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 29 02:45:47.796666 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 29 02:45:47.796666 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:45:47.796666 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:45:47.796666 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:45:47.796666 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:45:47.796666 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:45:47.796666 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:45:47.796666 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:45:47.796666 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:45:47.798518 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:45:47.798518 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:45:47.798518 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:45:47.798518 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:45:47.798518 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:45:47.798518 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:45:47.798518 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 29 02:45:47.798518 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:47.798518 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:45:47.798518 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:47.798518 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:45:47.798518 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:45:47.798518 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:45:47.798518 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:45:47.798518 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:45:47.798518 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 29 02:45:47.798518 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:45:47.800662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f20f8bf6-1f86-4307-a528-e2ed46093c56 tempest-InstanceUsageAuditLogNegativeTestJSON-1164894772 tempest-InstanceUsageAuditLogNegativeTestJSON-1164894772-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:45:47.802176 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f20f8bf6-1f86-4307-a528-e2ed46093c56 tempest-InstanceUsageAuditLogNegativeTestJSON-1164894772 tempest-InstanceUsageAuditLogNegativeTestJSON-1164894772-project] 10.222.0.46 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-29 02:45:47" status: 403 len: 128 microversion: 2.1 time: 0.017017 Oct 29 02:45:47.804078 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 79/158] 10.222.0.46 () {58 vars in 1251 bytes} [Sat Oct 29 02:45:47 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-29%2002%3A45%3A47 => generated 128 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:45:47.814067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-01f00a32-9635-484c-94cf-0d0b5862bd7d tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:47.814906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-01f00a32-9635-484c-94cf-0d0b5862bd7d tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] [instance: 20072a0e-36ce-4bc7-b83e-7d88340ab50c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:47.822855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-01f00a32-9635-484c-94cf-0d0b5862bd7d tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:47.823615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-01f00a32-9635-484c-94cf-0d0b5862bd7d tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:47.824237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-01f00a32-9635-484c-94cf-0d0b5862bd7d tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:47.825338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-01f00a32-9635-484c-94cf-0d0b5862bd7d tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:47.826134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-01f00a32-9635-484c-94cf-0d0b5862bd7d tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:47.826759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-01f00a32-9635-484c-94cf-0d0b5862bd7d tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:48.004186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b4d8bc7c-26e2-48f1-a9f2-3f63ff126c4b tempest-FlavorsAccessTestJSON-595562037 tempest-FlavorsAccessTestJSON-595562037-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1066083864", "id": 2138805324, "os-flavor-access:is_public": "False"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:48.056281 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b4d8bc7c-26e2-48f1-a9f2-3f63ff126c4b tempest-FlavorsAccessTestJSON-595562037 tempest-FlavorsAccessTestJSON-595562037-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.348408 Oct 29 02:45:48.058234 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 80/159] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:45:47 2022] POST /compute/v2.1/flavors => generated 431 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:48.114991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-01f00a32-9635-484c-94cf-0d0b5862bd7d tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb72790532b484583be089c38656f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f1de1bd2764e2994a4f1caaef0ad4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:48.127317 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-01f00a32-9635-484c-94cf-0d0b5862bd7d tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] 10.222.0.46 "GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c" status: 200 len: 1339 microversion: 2.1 time: 0.321285 Oct 29 02:45:48.145563 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 80/160] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:47 2022] GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c => generated 1339 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:48.154749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ea56addc-3c20-4b9f-9371-c128c0ca4d60 tempest-FlavorsAccessTestJSON-595562037 tempest-FlavorsAccessTestJSON-595562037-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b6766f515a7541608d96481960e95ce3"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:48.442798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e5854437-f74b-40ba-9e27-9ad89ed57bc4 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-383740581", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:48.522605 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=8 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:48.531561 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-e5854437-f74b-40ba-9e27-9ad89ed57bc4 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] validate_networks() for None {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:45:48.739990 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ea56addc-3c20-4b9f-9371-c128c0ca4d60 tempest-FlavorsAccessTestJSON-595562037 tempest-FlavorsAccessTestJSON-595562037-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/2138805324/action" status: 200 len: 97 microversion: 2.1 time: 0.592480 Oct 29 02:45:48.742714 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 81/161] 10.222.0.46 () {60 vars in 1200 bytes} [Sat Oct 29 02:45:48 2022] POST /compute/v2.1/flavors/2138805324/action => generated 97 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:45:48.940513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c1c4a5cc-c59b-4092-bd20-48a8a71834c0 tempest-FlavorsAccessTestJSON-691829476 tempest-FlavorsAccessTestJSON-691829476-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:48.963493 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c1c4a5cc-c59b-4092-bd20-48a8a71834c0 tempest-FlavorsAccessTestJSON-691829476 tempest-FlavorsAccessTestJSON-691829476-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5412 microversion: 2.1 time: 0.214547 Oct 29 02:45:48.964312 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 82/162] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:48 2022] GET /compute/v2.1/flavors/detail => generated 5412 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:45:49.025344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b7e6827b-5e46-4d41-a173-90f146d01da9 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Calling method '.version_select at 0x7ff058a93790>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:49.027405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7e6827b-5e46-4d41-a173-90f146d01da9 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:49.028010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7e6827b-5e46-4d41-a173-90f146d01da9 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:49.028563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7e6827b-5e46-4d41-a173-90f146d01da9 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:49.043828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7e6827b-5e46-4d41-a173-90f146d01da9 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:49.044751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7e6827b-5e46-4d41-a173-90f146d01da9 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:49.045281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7e6827b-5e46-4d41-a173-90f146d01da9 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:49.056808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7e6827b-5e46-4d41-a173-90f146d01da9 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:49.057434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7e6827b-5e46-4d41-a173-90f146d01da9 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:49.062991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7e6827b-5e46-4d41-a173-90f146d01da9 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:49.070366 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b7e6827b-5e46-4d41-a173-90f146d01da9 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.104648 Oct 29 02:45:49.071889 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 83/163] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:48 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:49.078501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-846a761a-0b29-4c5b-b944-d8106ffa951f tempest-FlavorsAccessTestJSON-595562037 tempest-FlavorsAccessTestJSON-595562037-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b6766f515a7541608d96481960e95ce3"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:49.147082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-e5854437-f74b-40ba-9e27-9ad89ed57bc4 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:45:49.147878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-e5854437-f74b-40ba-9e27-9ad89ed57bc4 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:45:49.148691 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-e5854437-f74b-40ba-9e27-9ad89ed57bc4 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:45:49.149667 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-e5854437-f74b-40ba-9e27-9ad89ed57bc4 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:45:49.150240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-e5854437-f74b-40ba-9e27-9ad89ed57bc4 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:45:49.164208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5854437-f74b-40ba-9e27-9ad89ed57bc4 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:49.165043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5854437-f74b-40ba-9e27-9ad89ed57bc4 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:49.165654 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5854437-f74b-40ba-9e27-9ad89ed57bc4 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:49.166549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5854437-f74b-40ba-9e27-9ad89ed57bc4 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:49.167154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5854437-f74b-40ba-9e27-9ad89ed57bc4 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:49.167385 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-846a761a-0b29-4c5b-b944-d8106ffa951f tempest-FlavorsAccessTestJSON-595562037 tempest-FlavorsAccessTestJSON-595562037-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/2138805324/action" status: 200 len: 21 microversion: 2.1 time: 0.093935 Oct 29 02:45:49.168116 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5854437-f74b-40ba-9e27-9ad89ed57bc4 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:49.173359 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 84/164] 10.222.0.46 () {60 vars in 1200 bytes} [Sat Oct 29 02:45:49 2022] POST /compute/v2.1/flavors/2138805324/action => generated 21 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:45:49.179835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2856e49d-9ec7-466b-883f-831d2a88db61 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Calling method '.version_select at 0x7ff058afbf70>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:49.182088 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2856e49d-9ec7-466b-883f-831d2a88db61 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:49.182769 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2856e49d-9ec7-466b-883f-831d2a88db61 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:49.184067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2856e49d-9ec7-466b-883f-831d2a88db61 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:49.207452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2856e49d-9ec7-466b-883f-831d2a88db61 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:49.208208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2856e49d-9ec7-466b-883f-831d2a88db61 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:49.208861 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2856e49d-9ec7-466b-883f-831d2a88db61 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:49.210947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-e5854437-f74b-40ba-9e27-9ad89ed57bc4 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Getting quotas for project 687ff1c168124c6aa2bae831ffa0ad47. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:45:49.215910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-e5854437-f74b-40ba-9e27-9ad89ed57bc4 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Getting quotas for user c6b28aab121f44d09e44615e410350c8 and project 687ff1c168124c6aa2bae831ffa0ad47. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:45:49.230674 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e5854437-f74b-40ba-9e27-9ad89ed57bc4 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:45:49.248511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2856e49d-9ec7-466b-883f-831d2a88db61 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:49.249348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2856e49d-9ec7-466b-883f-831d2a88db61 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:49.249950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2856e49d-9ec7-466b-883f-831d2a88db61 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:49.250541 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e5854437-f74b-40ba-9e27-9ad89ed57bc4 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: c4180915-07c1-4365-976f-3b32fef4fc7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:45:49.264172 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2856e49d-9ec7-466b-883f-831d2a88db61 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/n-h2-862967-2/servers" status: 200 len: 196 microversion: 2.1 time: 0.089282 Oct 29 02:45:49.265245 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 85/165] 10.222.0.46 () {58 vars in 1212 bytes} [Sat Oct 29 02:45:49 2022] GET /compute/v2.1/os-hypervisors/n-h2-862967-2/servers => generated 196 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:49.271327 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-818a9ba5-c5ad-4d0b-ac81-49d648569ca9 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:49.272357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-818a9ba5-c5ad-4d0b-ac81-49d648569ca9 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] [instance: 20072a0e-36ce-4bc7-b83e-7d88340ab50c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:49.296638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-818a9ba5-c5ad-4d0b-ac81-49d648569ca9 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:49.297394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-818a9ba5-c5ad-4d0b-ac81-49d648569ca9 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:49.298016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-818a9ba5-c5ad-4d0b-ac81-49d648569ca9 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:49.298918 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-818a9ba5-c5ad-4d0b-ac81-49d648569ca9 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:49.299524 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-818a9ba5-c5ad-4d0b-ac81-49d648569ca9 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:49.300091 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-818a9ba5-c5ad-4d0b-ac81-49d648569ca9 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:49.404320 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e5854437-f74b-40ba-9e27-9ad89ed57bc4 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.344457 Oct 29 02:45:49.405979 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 81/166] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:45:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:45:49.416309 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5776ed6d-b1f7-426b-aa98-598c7e4735de tempest-FlavorsAccessTestJSON-691829476 tempest-FlavorsAccessTestJSON-691829476-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:49.456785 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5776ed6d-b1f7-426b-aa98-598c7e4735de tempest-FlavorsAccessTestJSON-691829476 tempest-FlavorsAccessTestJSON-691829476-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049320 Oct 29 02:45:49.460410 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 82/167] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:49.466599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2f70bcd6-df5b-481f-9846-7f96befafff2 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Calling method '.version_select at 0x7ff0588c4310>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:49.469002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f70bcd6-df5b-481f-9846-7f96befafff2 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:49.472609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f70bcd6-df5b-481f-9846-7f96befafff2 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:49.473354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f70bcd6-df5b-481f-9846-7f96befafff2 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:49.513396 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f70bcd6-df5b-481f-9846-7f96befafff2 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:49.514776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f70bcd6-df5b-481f-9846-7f96befafff2 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:49.518307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f70bcd6-df5b-481f-9846-7f96befafff2 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:49.546711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f70bcd6-df5b-481f-9846-7f96befafff2 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:49.547272 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f70bcd6-df5b-481f-9846-7f96befafff2 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:49.547719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f70bcd6-df5b-481f-9846-7f96befafff2 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:49.575338 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2f70bcd6-df5b-481f-9846-7f96befafff2 tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.113420 Oct 29 02:45:49.575955 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 83/168] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:49 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:49.597789 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7f0e9434-8441-4573-9095-b851b0efb137 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:49.598436 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7f0e9434-8441-4573-9095-b851b0efb137 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: c4180915-07c1-4365-976f-3b32fef4fc7c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:49.689761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7f0e9434-8441-4573-9095-b851b0efb137 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:49.704773 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7f0e9434-8441-4573-9095-b851b0efb137 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c" status: 200 len: 1221 microversion: 2.1 time: 0.127584 Oct 29 02:45:49.716836 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 84/169] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:49 2022] GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c => generated 1221 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:49.722361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-839e0d82-9d14-4010-ad67-205de292d2f3 tempest-FlavorsAccessTestJSON-595562037 tempest-FlavorsAccessTestJSON-595562037-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:49.767136 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-839e0d82-9d14-4010-ad67-205de292d2f3 tempest-FlavorsAccessTestJSON-595562037 tempest-FlavorsAccessTestJSON-595562037-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/2138805324" status: 202 len: 0 microversion: 2.1 time: 0.059973 Oct 29 02:45:49.768679 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 85/170] 10.222.0.46 () {58 vars in 1161 bytes} [Sat Oct 29 02:45:49 2022] DELETE /compute/v2.1/flavors/2138805324 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:45:49.776165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-78e95d4a-bf99-4e2e-9816-ddacd78bd99b tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Calling method '.version_select at 0x7ff0588c8ca0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:49.780640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78e95d4a-bf99-4e2e-9816-ddacd78bd99b tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:49.783844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78e95d4a-bf99-4e2e-9816-ddacd78bd99b tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:49.784470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78e95d4a-bf99-4e2e-9816-ddacd78bd99b tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:49.809537 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78e95d4a-bf99-4e2e-9816-ddacd78bd99b tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:49.810335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78e95d4a-bf99-4e2e-9816-ddacd78bd99b tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:49.811017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78e95d4a-bf99-4e2e-9816-ddacd78bd99b tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:49.820338 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-78e95d4a-bf99-4e2e-9816-ddacd78bd99b tempest-HypervisorAdminUnderV252Test-1051888671 tempest-HypervisorAdminUnderV252Test-1051888671-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/n-h2-862967-2/search" status: 200 len: 104 microversion: 2.1 time: 0.049626 Oct 29 02:45:49.827592 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 86/171] 10.222.0.46 () {58 vars in 1209 bytes} [Sat Oct 29 02:45:49 2022] GET /compute/v2.1/os-hypervisors/n-h2-862967-2/search => generated 104 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:49.839346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-01d55f69-036c-4cb4-ad82-8568a526687c tempest-FlavorsAccessTestJSON-595562037 tempest-FlavorsAccessTestJSON-595562037-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:49.865655 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-01d55f69-036c-4cb4-ad82-8568a526687c tempest-FlavorsAccessTestJSON-595562037 tempest-FlavorsAccessTestJSON-595562037-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032902 Oct 29 02:45:49.866489 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 87/172] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:49.887572 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5f655da5-28fd-4691-a176-58baeebdda3a tempest-FlavorsAccessTestJSON-595562037 tempest-FlavorsAccessTestJSON-595562037-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1366330943", "id": 2048207804, "os-flavor-access:is_public": "False"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:49.912864 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5f655da5-28fd-4691-a176-58baeebdda3a tempest-FlavorsAccessTestJSON-595562037 tempest-FlavorsAccessTestJSON-595562037-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.030173 Oct 29 02:45:49.920499 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-818a9ba5-c5ad-4d0b-ac81-49d648569ca9 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb72790532b484583be089c38656f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f1de1bd2764e2994a4f1caaef0ad4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:49.925109 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 88/173] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:45:49 2022] POST /compute/v2.1/flavors => generated 431 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:49.930796 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-818a9ba5-c5ad-4d0b-ac81-49d648569ca9 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] 10.222.0.46 "GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c" status: 200 len: 1339 microversion: 2.1 time: 0.664334 Oct 29 02:45:49.932100 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 86/174] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:49 2022] GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c => generated 1339 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:49.934229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8ec3d963-74f6-45f0-9362-a33daf3dab6f tempest-FlavorsAccessTestJSON-595562037 tempest-FlavorsAccessTestJSON-595562037-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:49.963719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=9,nova_api:INSERT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:49.967835 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8ec3d963-74f6-45f0-9362-a33daf3dab6f tempest-FlavorsAccessTestJSON-595562037 tempest-FlavorsAccessTestJSON-595562037-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/2048207804/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.039190 Oct 29 02:45:49.970166 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 89/175] 10.222.0.46 () {58 vars in 1209 bytes} [Sat Oct 29 02:45:49 2022] GET /compute/v2.1/flavors/2048207804/os-flavor-access => generated 21 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:45:49.981595 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f68c371f-38a2-4f7e-aef0-1ec0e410fb97 tempest-FlavorsAccessTestJSON-595562037 tempest-FlavorsAccessTestJSON-595562037-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:50.022547 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f68c371f-38a2-4f7e-aef0-1ec0e410fb97 tempest-FlavorsAccessTestJSON-595562037 tempest-FlavorsAccessTestJSON-595562037-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/2048207804" status: 202 len: 0 microversion: 2.1 time: 0.047435 Oct 29 02:45:50.023177 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 87/176] 10.222.0.46 () {58 vars in 1161 bytes} [Sat Oct 29 02:45:49 2022] DELETE /compute/v2.1/flavors/2048207804 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 02:45:50.033508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-79fd377b-a35d-4332-b2e6-200f0320785b tempest-FlavorsAccessTestJSON-595562037 tempest-FlavorsAccessTestJSON-595562037-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:50.106222 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-79fd377b-a35d-4332-b2e6-200f0320785b tempest-FlavorsAccessTestJSON-595562037 tempest-FlavorsAccessTestJSON-595562037-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.077957 Oct 29 02:45:50.111289 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 90/177] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:45:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:50.731490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-44af2490-9c55-4092-89a9-667fdbf72a34 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:50.732387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-44af2490-9c55-4092-89a9-667fdbf72a34 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: c4180915-07c1-4365-976f-3b32fef4fc7c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:50.869472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-44af2490-9c55-4092-89a9-667fdbf72a34 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:50.900642 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-44af2490-9c55-4092-89a9-667fdbf72a34 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c" status: 200 len: 1221 microversion: 2.1 time: 0.174289 Oct 29 02:45:50.904418 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 88/178] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:50 2022] GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c => generated 1221 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:45:50.954611 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c0264749-c42c-49ba-b8d7-ac9ee2d15a9b tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:50.955326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c0264749-c42c-49ba-b8d7-ac9ee2d15a9b tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] [instance: 20072a0e-36ce-4bc7-b83e-7d88340ab50c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:50.974875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0264749-c42c-49ba-b8d7-ac9ee2d15a9b tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:50.980490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0264749-c42c-49ba-b8d7-ac9ee2d15a9b tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:50.983237 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0264749-c42c-49ba-b8d7-ac9ee2d15a9b tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:50.985552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0264749-c42c-49ba-b8d7-ac9ee2d15a9b tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:50.987511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0264749-c42c-49ba-b8d7-ac9ee2d15a9b tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:50.990295 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0264749-c42c-49ba-b8d7-ac9ee2d15a9b tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:51.057120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:51.801380 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c0264749-c42c-49ba-b8d7-ac9ee2d15a9b tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb72790532b484583be089c38656f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f1de1bd2764e2994a4f1caaef0ad4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:51.811078 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c0264749-c42c-49ba-b8d7-ac9ee2d15a9b tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] 10.222.0.46 "GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c" status: 200 len: 1339 microversion: 2.1 time: 0.861218 Oct 29 02:45:51.814168 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 91/179] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:50 2022] GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c => generated 1339 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:51.929347 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-66cf3392-decc-4164-b3d3-ae83d13b49c9 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:51.930679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-66cf3392-decc-4164-b3d3-ae83d13b49c9 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: c4180915-07c1-4365-976f-3b32fef4fc7c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:51.945428 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66cf3392-decc-4164-b3d3-ae83d13b49c9 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:51.946691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66cf3392-decc-4164-b3d3-ae83d13b49c9 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:51.949345 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66cf3392-decc-4164-b3d3-ae83d13b49c9 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:51.951514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66cf3392-decc-4164-b3d3-ae83d13b49c9 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:51.952156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66cf3392-decc-4164-b3d3-ae83d13b49c9 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:51.953759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66cf3392-decc-4164-b3d3-ae83d13b49c9 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:52.214255 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-66cf3392-decc-4164-b3d3-ae83d13b49c9 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:52.226314 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-66cf3392-decc-4164-b3d3-ae83d13b49c9 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c" status: 200 len: 1273 microversion: 2.1 time: 0.303401 Oct 29 02:45:52.230951 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 89/180] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:51 2022] GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c => generated 1273 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:52.882083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e0f50ba4-0600-43a4-817a-bea003e90e52 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:52.884458 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e0f50ba4-0600-43a4-817a-bea003e90e52 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] [instance: 20072a0e-36ce-4bc7-b83e-7d88340ab50c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:52.902858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0f50ba4-0600-43a4-817a-bea003e90e52 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:52.905026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0f50ba4-0600-43a4-817a-bea003e90e52 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:52.906905 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0f50ba4-0600-43a4-817a-bea003e90e52 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:52.911843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0f50ba4-0600-43a4-817a-bea003e90e52 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:52.912406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0f50ba4-0600-43a4-817a-bea003e90e52 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:52.912879 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0f50ba4-0600-43a4-817a-bea003e90e52 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:53.253388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6de1ff9f-1ca8-4f7a-b01f-e59f16b09f95 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:53.255941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6de1ff9f-1ca8-4f7a-b01f-e59f16b09f95 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: c4180915-07c1-4365-976f-3b32fef4fc7c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:53.271350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6de1ff9f-1ca8-4f7a-b01f-e59f16b09f95 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:53.277114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6de1ff9f-1ca8-4f7a-b01f-e59f16b09f95 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:53.279761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6de1ff9f-1ca8-4f7a-b01f-e59f16b09f95 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:53.281586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6de1ff9f-1ca8-4f7a-b01f-e59f16b09f95 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:53.282227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6de1ff9f-1ca8-4f7a-b01f-e59f16b09f95 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:53.282966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6de1ff9f-1ca8-4f7a-b01f-e59f16b09f95 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:53.362367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=93 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:53.565249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6de1ff9f-1ca8-4f7a-b01f-e59f16b09f95 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:53.573625 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6de1ff9f-1ca8-4f7a-b01f-e59f16b09f95 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c" status: 200 len: 1279 microversion: 2.1 time: 0.325302 Oct 29 02:45:53.574204 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 90/181] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:53 2022] GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c => generated 1279 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:53.580174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e0f50ba4-0600-43a4-817a-bea003e90e52 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb72790532b484583be089c38656f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f1de1bd2764e2994a4f1caaef0ad4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:53.588559 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e0f50ba4-0600-43a4-817a-bea003e90e52 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] 10.222.0.46 "GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c" status: 200 len: 1339 microversion: 2.1 time: 0.753494 Oct 29 02:45:53.593339 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 92/182] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:52 2022] GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c => generated 1339 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:54.603436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d7cd0cf2-d5b3-456d-b98a-e72dfb9b3772 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:54.604265 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d7cd0cf2-d5b3-456d-b98a-e72dfb9b3772 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: c4180915-07c1-4365-976f-3b32fef4fc7c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:54.617605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d8cf1a0a-addf-454a-bf65-0650bb00c04c tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:54.620830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d8cf1a0a-addf-454a-bf65-0650bb00c04c tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] [instance: 20072a0e-36ce-4bc7-b83e-7d88340ab50c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:54.629968 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7cd0cf2-d5b3-456d-b98a-e72dfb9b3772 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:54.633519 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7cd0cf2-d5b3-456d-b98a-e72dfb9b3772 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:54.634252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7cd0cf2-d5b3-456d-b98a-e72dfb9b3772 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:54.635013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7cd0cf2-d5b3-456d-b98a-e72dfb9b3772 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:54.635477 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7cd0cf2-d5b3-456d-b98a-e72dfb9b3772 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:54.635894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7cd0cf2-d5b3-456d-b98a-e72dfb9b3772 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:54.640487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8cf1a0a-addf-454a-bf65-0650bb00c04c tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:54.643938 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8cf1a0a-addf-454a-bf65-0650bb00c04c tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:54.645277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8cf1a0a-addf-454a-bf65-0650bb00c04c tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:54.647811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8cf1a0a-addf-454a-bf65-0650bb00c04c tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:54.648439 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8cf1a0a-addf-454a-bf65-0650bb00c04c tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:54.649716 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8cf1a0a-addf-454a-bf65-0650bb00c04c tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:54.916156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d8cf1a0a-addf-454a-bf65-0650bb00c04c tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb72790532b484583be089c38656f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f1de1bd2764e2994a4f1caaef0ad4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:54.932084 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d8cf1a0a-addf-454a-bf65-0650bb00c04c tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] 10.222.0.46 "GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c" status: 200 len: 1339 microversion: 2.1 time: 0.318366 Oct 29 02:45:54.933481 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 93/183] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:54 2022] GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c => generated 1339 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:45:54.993693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d7cd0cf2-d5b3-456d-b98a-e72dfb9b3772 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:55.005032 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d7cd0cf2-d5b3-456d-b98a-e72dfb9b3772 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c" status: 200 len: 1321 microversion: 2.1 time: 0.406605 Oct 29 02:45:55.023786 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 91/184] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:54 2022] GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c => generated 1321 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:55.425087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3af96b04-e907-427e-a9e3-222261aa276d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1132032047", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "bc545f16-a7b3-4024-a8d4-95a9643831d5"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:55.448655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-3adbf105-33ce-43cd-a321-b45c77bb9804 req-502022cf-13c0-48cf-9950-5875a914cba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20072a0e-36ce-4bc7-b83e-7d88340ab50c", "name": "network-vif-plugged", "status": "completed", "tag": "9c7abf8e-be92-4c31-a036-be7c42399521"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:55.493270 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3adbf105-33ce-43cd-a321-b45c77bb9804 req-502022cf-13c0-48cf-9950-5875a914cba1 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:55.493881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3adbf105-33ce-43cd-a321-b45c77bb9804 req-502022cf-13c0-48cf-9950-5875a914cba1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:55.494315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3adbf105-33ce-43cd-a321-b45c77bb9804 req-502022cf-13c0-48cf-9950-5875a914cba1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:55.560783 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-3adbf105-33ce-43cd-a321-b45c77bb9804 req-502022cf-13c0-48cf-9950-5875a914cba1 service nova] Creating event network-vif-plugged:9c7abf8e-be92-4c31-a036-be7c42399521 for instance 20072a0e-36ce-4bc7-b83e-7d88340ab50c on n-h2-862967-2 Oct 29 02:45:55.565465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-3af96b04-e907-427e-a9e3-222261aa276d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] validate_networks() for [('bc545f16-a7b3-4024-a8d4-95a9643831d5', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:45:55.566384 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-3adbf105-33ce-43cd-a321-b45c77bb9804 req-502022cf-13c0-48cf-9950-5875a914cba1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.631361 Oct 29 02:45:55.567413 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 94/185] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:45:55.959656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ff150056-a135-48fc-a5dd-e66bfdc54e29 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:55.963051 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ff150056-a135-48fc-a5dd-e66bfdc54e29 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] [instance: 20072a0e-36ce-4bc7-b83e-7d88340ab50c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:55.979936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff150056-a135-48fc-a5dd-e66bfdc54e29 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:55.981418 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff150056-a135-48fc-a5dd-e66bfdc54e29 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:55.984044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff150056-a135-48fc-a5dd-e66bfdc54e29 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:55.988107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff150056-a135-48fc-a5dd-e66bfdc54e29 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:55.989780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff150056-a135-48fc-a5dd-e66bfdc54e29 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:55.991349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff150056-a135-48fc-a5dd-e66bfdc54e29 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:56.324961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ff150056-a135-48fc-a5dd-e66bfdc54e29 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb72790532b484583be089c38656f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f1de1bd2764e2994a4f1caaef0ad4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:56.345026 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ff150056-a135-48fc-a5dd-e66bfdc54e29 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] 10.222.0.46 "GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c" status: 200 len: 1339 microversion: 2.1 time: 0.392199 Oct 29 02:45:56.347349 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 95/186] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:55 2022] GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c => generated 1339 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:45:56.359866 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0a0eb116-6c01-46cd-9eca-839bea7360d8 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:56.362966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0a0eb116-6c01-46cd-9eca-839bea7360d8 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: c4180915-07c1-4365-976f-3b32fef4fc7c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:56.379669 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a0eb116-6c01-46cd-9eca-839bea7360d8 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:56.382588 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a0eb116-6c01-46cd-9eca-839bea7360d8 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:56.384078 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a0eb116-6c01-46cd-9eca-839bea7360d8 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:56.386225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a0eb116-6c01-46cd-9eca-839bea7360d8 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:56.387373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a0eb116-6c01-46cd-9eca-839bea7360d8 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:56.390911 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a0eb116-6c01-46cd-9eca-839bea7360d8 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:56.879045 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0a0eb116-6c01-46cd-9eca-839bea7360d8 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:56.912024 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0a0eb116-6c01-46cd-9eca-839bea7360d8 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c" status: 200 len: 1321 microversion: 2.1 time: 0.563290 Oct 29 02:45:56.925878 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 96/187] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:56 2022] GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c => generated 1321 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:57.227356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-3af96b04-e907-427e-a9e3-222261aa276d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:45:57.227356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-3af96b04-e907-427e-a9e3-222261aa276d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:45:57.227998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-3af96b04-e907-427e-a9e3-222261aa276d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:45:57.228339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-3af96b04-e907-427e-a9e3-222261aa276d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:45:57.229159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-3af96b04-e907-427e-a9e3-222261aa276d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:45:57.267959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3af96b04-e907-427e-a9e3-222261aa276d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:57.269382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3af96b04-e907-427e-a9e3-222261aa276d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:57.270320 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3af96b04-e907-427e-a9e3-222261aa276d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:57.272187 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3af96b04-e907-427e-a9e3-222261aa276d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:57.273399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3af96b04-e907-427e-a9e3-222261aa276d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:57.283181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3af96b04-e907-427e-a9e3-222261aa276d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:57.319734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-3af96b04-e907-427e-a9e3-222261aa276d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Getting quotas for project f86634862bd64e0f9f00972e4ce0982b. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:45:57.328383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-3af96b04-e907-427e-a9e3-222261aa276d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Getting quotas for user 067d53567ea944b1b69ee7f461aa0c16 and project f86634862bd64e0f9f00972e4ce0982b. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:45:57.345756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3af96b04-e907-427e-a9e3-222261aa276d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:45:57.350701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3af96b04-e907-427e-a9e3-222261aa276d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:45:57.436562 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3af96b04-e907-427e-a9e3-222261aa276d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.323124 Oct 29 02:45:57.437564 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 92/188] 10.222.0.46 () {62 vars in 1188 bytes} [Sat Oct 29 02:45:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2325 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 02:45:57.442912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5a16e847-064d-4a3a-997d-e6676528afeb tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:57.444112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5a16e847-064d-4a3a-997d-e6676528afeb tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] [instance: 20072a0e-36ce-4bc7-b83e-7d88340ab50c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:57.451299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a16e847-064d-4a3a-997d-e6676528afeb tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:57.451947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a16e847-064d-4a3a-997d-e6676528afeb tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:57.452551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a16e847-064d-4a3a-997d-e6676528afeb tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:57.453417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a16e847-064d-4a3a-997d-e6676528afeb tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:57.454020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a16e847-064d-4a3a-997d-e6676528afeb tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:57.454440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a16e847-064d-4a3a-997d-e6676528afeb tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:57.475094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-59b43efa-ee86-4d3f-a264-40d31d154fe6 tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] Action: 'update', calling method: .version_select at 0x7ff0587f3790>, body: {"quota_set": {"ram": "5120"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:57.690200 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5a16e847-064d-4a3a-997d-e6676528afeb tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb72790532b484583be089c38656f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f1de1bd2764e2994a4f1caaef0ad4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:57.701863 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5a16e847-064d-4a3a-997d-e6676528afeb tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] 10.222.0.46 "GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c" status: 200 len: 1339 microversion: 2.1 time: 0.262903 Oct 29 02:45:57.702453 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 93/189] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:57 2022] GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c => generated 1339 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:57.709509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dd6cad32-e884-4351-9cd0-1c6f1df2e221 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:57.710132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dd6cad32-e884-4351-9cd0-1c6f1df2e221 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:57.799678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dd6cad32-e884-4351-9cd0-1c6f1df2e221 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:57.826143 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dd6cad32-e884-4351-9cd0-1c6f1df2e221 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:57.827668 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dd6cad32-e884-4351-9cd0-1c6f1df2e221 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:57.828919 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dd6cad32-e884-4351-9cd0-1c6f1df2e221 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 200 len: 1262 microversion: 2.25 time: 0.125408 Oct 29 02:45:57.830020 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 94/190] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:45:57 2022] GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 1262 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:45:57.942356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9c5f0424-3000-4809-bbc1-19ee9d95c65e tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:57.943381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9c5f0424-3000-4809-bbc1-19ee9d95c65e tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: c4180915-07c1-4365-976f-3b32fef4fc7c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:57.958245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c5f0424-3000-4809-bbc1-19ee9d95c65e tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:57.959212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c5f0424-3000-4809-bbc1-19ee9d95c65e tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:57.959751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c5f0424-3000-4809-bbc1-19ee9d95c65e tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:57.960760 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c5f0424-3000-4809-bbc1-19ee9d95c65e tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:57.961590 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c5f0424-3000-4809-bbc1-19ee9d95c65e tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:57.962301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c5f0424-3000-4809-bbc1-19ee9d95c65e tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:58.140465 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59b43efa-ee86-4d3f-a264-40d31d154fe6 tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:58.141533 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59b43efa-ee86-4d3f-a264-40d31d154fe6 tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:58.141971 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59b43efa-ee86-4d3f-a264-40d31d154fe6 tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:58.143214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59b43efa-ee86-4d3f-a264-40d31d154fe6 tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:58.143678 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59b43efa-ee86-4d3f-a264-40d31d154fe6 tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:58.144099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59b43efa-ee86-4d3f-a264-40d31d154fe6 tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:58.210319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9c5f0424-3000-4809-bbc1-19ee9d95c65e tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:58.225397 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9c5f0424-3000-4809-bbc1-19ee9d95c65e tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c" status: 200 len: 1321 microversion: 2.1 time: 0.288841 Oct 29 02:45:58.227291 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 95/191] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:57 2022] GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c => generated 1321 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:45:58.521729 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-59b43efa-ee86-4d3f-a264-40d31d154fe6 tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/0802392b4b4d4f439e07e6af2ba215ef" status: 200 len: 240 microversion: 2.36 time: 1.593956 Oct 29 02:45:58.526642 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 97/192] 10.222.0.46 () {62 vars in 1303 bytes} [Sat Oct 29 02:45:56 2022] PUT /compute/v2.1/os-quota-sets/0802392b4b4d4f439e07e6af2ba215ef => generated 240 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:45:58.539354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f9013ff8-7494-4e89-9d05-f1ba899f2620 tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] Calling method '.version_select at 0x7ff058b2c3a0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:59.049267 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-91f09a58-4af7-4fba-a39f-be4c8665ce18 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Calling method '.version_select at 0x7ff0587deb80>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:59.055051 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91f09a58-4af7-4fba-a39f-be4c8665ce18 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:59.056035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91f09a58-4af7-4fba-a39f-be4c8665ce18 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:59.060267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9013ff8-7494-4e89-9d05-f1ba899f2620 tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:59.060822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9013ff8-7494-4e89-9d05-f1ba899f2620 tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:59.061250 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9013ff8-7494-4e89-9d05-f1ba899f2620 tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:59.061644 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91f09a58-4af7-4fba-a39f-be4c8665ce18 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:59.068848 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9013ff8-7494-4e89-9d05-f1ba899f2620 tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:59.069339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9013ff8-7494-4e89-9d05-f1ba899f2620 tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:59.069848 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9013ff8-7494-4e89-9d05-f1ba899f2620 tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:59.098580 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91f09a58-4af7-4fba-a39f-be4c8665ce18 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:59.099068 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91f09a58-4af7-4fba-a39f-be4c8665ce18 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:59.099493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91f09a58-4af7-4fba-a39f-be4c8665ce18 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:59.119186 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f9013ff8-7494-4e89-9d05-f1ba899f2620 tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/0802392b4b4d4f439e07e6af2ba215ef/detail" status: 200 len: 672 microversion: 2.36 time: 0.582642 Oct 29 02:45:59.125217 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 96/193] 10.222.0.46 () {60 vars in 1304 bytes} [Sat Oct 29 02:45:58 2022] GET /compute/v2.1/os-quota-sets/0802392b4b4d4f439e07e6af2ba215ef/detail => generated 672 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:45:59.146126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-25a35c5b-9903-430b-8bf7-bfeff8737a44 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:59.146791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-25a35c5b-9903-430b-8bf7-bfeff8737a44 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] [instance: 20072a0e-36ce-4bc7-b83e-7d88340ab50c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:59.163420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25a35c5b-9903-430b-8bf7-bfeff8737a44 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:59.163912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25a35c5b-9903-430b-8bf7-bfeff8737a44 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:59.164344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25a35c5b-9903-430b-8bf7-bfeff8737a44 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:59.167267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25a35c5b-9903-430b-8bf7-bfeff8737a44 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:59.172661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25a35c5b-9903-430b-8bf7-bfeff8737a44 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:59.173453 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25a35c5b-9903-430b-8bf7-bfeff8737a44 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:59.202490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91f09a58-4af7-4fba-a39f-be4c8665ce18 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:59.203237 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91f09a58-4af7-4fba-a39f-be4c8665ce18 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:59.203955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91f09a58-4af7-4fba-a39f-be4c8665ce18 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:59.233847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91f09a58-4af7-4fba-a39f-be4c8665ce18 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:59.234605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91f09a58-4af7-4fba-a39f-be4c8665ce18 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:59.237246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91f09a58-4af7-4fba-a39f-be4c8665ce18 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:59.267901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91f09a58-4af7-4fba-a39f-be4c8665ce18 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:59.268808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91f09a58-4af7-4fba-a39f-be4c8665ce18 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:59.269675 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91f09a58-4af7-4fba-a39f-be4c8665ce18 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:59.279898 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-91f09a58-4af7-4fba-a39f-be4c8665ce18 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1836 microversion: 2.53 time: 0.591817 Oct 29 02:45:59.294662 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 98/194] 10.222.0.46 () {60 vars in 1243 bytes} [Sat Oct 29 02:45:58 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1836 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:45:59.302958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d10622ae-3a89-4a9a-b380-3e436247b945 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:59.304774 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d10622ae-3a89-4a9a-b380-3e436247b945 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:59.312349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d10622ae-3a89-4a9a-b380-3e436247b945 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:59.313256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d10622ae-3a89-4a9a-b380-3e436247b945 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:59.314033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d10622ae-3a89-4a9a-b380-3e436247b945 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:59.315402 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d10622ae-3a89-4a9a-b380-3e436247b945 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:59.316021 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d10622ae-3a89-4a9a-b380-3e436247b945 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:59.316647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d10622ae-3a89-4a9a-b380-3e436247b945 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:59.411407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d10622ae-3a89-4a9a-b380-3e436247b945 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:59.428830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d10622ae-3a89-4a9a-b380-3e436247b945 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:59.433256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d10622ae-3a89-4a9a-b380-3e436247b945 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:59.434494 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d10622ae-3a89-4a9a-b380-3e436247b945 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 200 len: 1344 microversion: 2.25 time: 0.138561 Oct 29 02:45:59.435121 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 99/195] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:45:59 2022] GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 1344 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:45:59.449580 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9e280135-ce77-49a6-afb2-982135eb8df1 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:59.451260 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9e280135-ce77-49a6-afb2-982135eb8df1 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: c4180915-07c1-4365-976f-3b32fef4fc7c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:59.467738 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e280135-ce77-49a6-afb2-982135eb8df1 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:59.468267 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e280135-ce77-49a6-afb2-982135eb8df1 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:59.468769 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e280135-ce77-49a6-afb2-982135eb8df1 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:59.469695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e280135-ce77-49a6-afb2-982135eb8df1 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:59.470329 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e280135-ce77-49a6-afb2-982135eb8df1 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:59.470918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e280135-ce77-49a6-afb2-982135eb8df1 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:59.620256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-25a35c5b-9903-430b-8bf7-bfeff8737a44 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb72790532b484583be089c38656f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f1de1bd2764e2994a4f1caaef0ad4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:59.639428 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-25a35c5b-9903-430b-8bf7-bfeff8737a44 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] 10.222.0.46 "GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c" status: 200 len: 1489 microversion: 2.1 time: 0.512947 Oct 29 02:45:59.639897 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 97/196] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:59 2022] GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c => generated 1489 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:59.652757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a7eb550b-f1f3-4ff9-b51f-ebc4c5c4e7d9 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Calling method '.version_select at 0x7ff058aebee0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:59.652757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7eb550b-f1f3-4ff9-b51f-ebc4c5c4e7d9 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:59.653452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7eb550b-f1f3-4ff9-b51f-ebc4c5c4e7d9 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:59.654084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7eb550b-f1f3-4ff9-b51f-ebc4c5c4e7d9 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:59.693357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7eb550b-f1f3-4ff9-b51f-ebc4c5c4e7d9 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:59.693913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7eb550b-f1f3-4ff9-b51f-ebc4c5c4e7d9 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:59.694484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7eb550b-f1f3-4ff9-b51f-ebc4c5c4e7d9 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:59.701846 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9e280135-ce77-49a6-afb2-982135eb8df1 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:45:59.712202 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9e280135-ce77-49a6-afb2-982135eb8df1 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c" status: 200 len: 1321 microversion: 2.1 time: 0.274899 Oct 29 02:45:59.713132 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 100/197] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:59 2022] GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:45:59.718544 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9848a629-db37-4ee8-8e2a-5c4bb6800949 tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] Action: 'update', calling method: .version_select at 0x7ff0587de550>, body: {"quota_set": {"ram": "2048"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:45:59.741531 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7eb550b-f1f3-4ff9-b51f-ebc4c5c4e7d9 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:59.742120 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7eb550b-f1f3-4ff9-b51f-ebc4c5c4e7d9 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:59.742763 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7eb550b-f1f3-4ff9-b51f-ebc4c5c4e7d9 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:59.756243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=7,nova_api:INSERT=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:59.758067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7eb550b-f1f3-4ff9-b51f-ebc4c5c4e7d9 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:59.758825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7eb550b-f1f3-4ff9-b51f-ebc4c5c4e7d9 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:59.759575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7eb550b-f1f3-4ff9-b51f-ebc4c5c4e7d9 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:59.797357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7eb550b-f1f3-4ff9-b51f-ebc4c5c4e7d9 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:59.797879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7eb550b-f1f3-4ff9-b51f-ebc4c5c4e7d9 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:59.798377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7eb550b-f1f3-4ff9-b51f-ebc4c5c4e7d9 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:59.810270 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a7eb550b-f1f3-4ff9-b51f-ebc4c5c4e7d9 tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 528 microversion: 2.53 time: 0.169023 Oct 29 02:45:59.825825 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 98/198] 10.222.0.46 () {60 vars in 1222 bytes} [Sat Oct 29 02:45:59 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 528 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:45:59.835841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-19220c7a-07de-4401-88cc-dfccd75cb7ae tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:45:59.837318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-19220c7a-07de-4401-88cc-dfccd75cb7ae tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] [instance: 20072a0e-36ce-4bc7-b83e-7d88340ab50c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:45:59.845324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-19220c7a-07de-4401-88cc-dfccd75cb7ae tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:59.846322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-19220c7a-07de-4401-88cc-dfccd75cb7ae tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:59.846950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-19220c7a-07de-4401-88cc-dfccd75cb7ae tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:45:59.847932 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-19220c7a-07de-4401-88cc-dfccd75cb7ae tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:45:59.848574 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-19220c7a-07de-4401-88cc-dfccd75cb7ae tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:45:59.849189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-19220c7a-07de-4401-88cc-dfccd75cb7ae tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:00.109102 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9848a629-db37-4ee8-8e2a-5c4bb6800949 tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:00.109614 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9848a629-db37-4ee8-8e2a-5c4bb6800949 tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:00.110052 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9848a629-db37-4ee8-8e2a-5c4bb6800949 tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:00.110781 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9848a629-db37-4ee8-8e2a-5c4bb6800949 tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:00.111231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9848a629-db37-4ee8-8e2a-5c4bb6800949 tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:00.111647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9848a629-db37-4ee8-8e2a-5c4bb6800949 tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:00.150009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9848a629-db37-4ee8-8e2a-5c4bb6800949 tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:00.150665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9848a629-db37-4ee8-8e2a-5c4bb6800949 tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:00.151157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9848a629-db37-4ee8-8e2a-5c4bb6800949 tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:00.151881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9848a629-db37-4ee8-8e2a-5c4bb6800949 tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:00.152863 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9848a629-db37-4ee8-8e2a-5c4bb6800949 tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:00.152863 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9848a629-db37-4ee8-8e2a-5c4bb6800949 tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:00.219432 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9848a629-db37-4ee8-8e2a-5c4bb6800949 tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/0802392b4b4d4f439e07e6af2ba215ef?user_id=595cb1707b474c9ba205d28f3b143f0e" status: 200 len: 240 microversion: 2.36 time: 0.505037 Oct 29 02:46:00.226978 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 101/199] 10.222.0.46 () {62 vars in 1384 bytes} [Sat Oct 29 02:45:59 2022] PUT /compute/v2.1/os-quota-sets/0802392b4b4d4f439e07e6af2ba215ef?user_id=595cb1707b474c9ba205d28f3b143f0e => generated 240 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:46:00.226978 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2fff8f3c-f829-4f72-9a9f-6acbd1de822b tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Calling method '.version_select at 0x7ff0587a68b0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:00.230508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fff8f3c-f829-4f72-9a9f-6acbd1de822b tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:00.230508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fff8f3c-f829-4f72-9a9f-6acbd1de822b tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:00.230756 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fff8f3c-f829-4f72-9a9f-6acbd1de822b tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:00.247385 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fff8f3c-f829-4f72-9a9f-6acbd1de822b tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:00.247900 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fff8f3c-f829-4f72-9a9f-6acbd1de822b tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:00.248495 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fff8f3c-f829-4f72-9a9f-6acbd1de822b tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:00.256365 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2fff8f3c-f829-4f72-9a9f-6acbd1de822b tempest-HypervisorAdminV253TestBase-168536882 tempest-HypervisorAdminV253TestBase-168536882-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/bd4d1929-291e-48b1-b33e-c7b381ce9470" status: 200 len: 792 microversion: 2.53 time: 0.034358 Oct 29 02:46:00.268425 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 102/200] 10.222.0.46 () {60 vars in 1298 bytes} [Sat Oct 29 02:46:00 2022] GET /compute/v2.1/os-hypervisors/bd4d1929-291e-48b1-b33e-c7b381ce9470 => generated 792 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:46:00.513872 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-18f4d4a5-0e23-4b94-a5f1-7102f88aaea1 tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1770431042", "id": 640174150, "os-flavor-access:is_public": "False"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:00.548823 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-18f4d4a5-0e23-4b94-a5f1-7102f88aaea1 tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.290564 Oct 29 02:46:00.558900 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 103/201] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:46:00 2022] POST /compute/v2.1/flavors => generated 436 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:00.564054 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b540503a-8a68-48aa-9067-0f5e0f9635cb tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] Calling method '.version_select at 0x7ff0587a6820>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:00.641081 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-19220c7a-07de-4401-88cc-dfccd75cb7ae tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c" status: 200 len: 1640 microversion: 2.1 time: 0.813579 Oct 29 02:46:00.644975 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 99/202] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:45:59 2022] GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c => generated 1640 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:00.649749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-973b57ab-91fd-4258-9bd6-d0f47bc3010a req-bd1a3d09-99c0-47f6-92a1-bef0fe66ee7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4180915-07c1-4365-976f-3b32fef4fc7c", "tag": "9ca84854-6604-4318-97df-c5aa881aa09a"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:00.669822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-973b57ab-91fd-4258-9bd6-d0f47bc3010a req-bd1a3d09-99c0-47f6-92a1-bef0fe66ee7b service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:00.670306 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-973b57ab-91fd-4258-9bd6-d0f47bc3010a req-bd1a3d09-99c0-47f6-92a1-bef0fe66ee7b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:00.670739 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-973b57ab-91fd-4258-9bd6-d0f47bc3010a req-bd1a3d09-99c0-47f6-92a1-bef0fe66ee7b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:00.697222 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-973b57ab-91fd-4258-9bd6-d0f47bc3010a req-bd1a3d09-99c0-47f6-92a1-bef0fe66ee7b service nova] Creating event network-changed:9ca84854-6604-4318-97df-c5aa881aa09a for instance c4180915-07c1-4365-976f-3b32fef4fc7c on n-h1-862967-2 Oct 29 02:46:00.702928 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-973b57ab-91fd-4258-9bd6-d0f47bc3010a req-bd1a3d09-99c0-47f6-92a1-bef0fe66ee7b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056533 Oct 29 02:46:00.703968 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 100/203] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:00.709994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-200c3441-03f8-4fc5-ae08-48c2ba7cf648 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:00.710765 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-200c3441-03f8-4fc5-ae08-48c2ba7cf648 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:00.717455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-200c3441-03f8-4fc5-ae08-48c2ba7cf648 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:00.718063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-200c3441-03f8-4fc5-ae08-48c2ba7cf648 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:00.718509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-200c3441-03f8-4fc5-ae08-48c2ba7cf648 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:00.719232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-200c3441-03f8-4fc5-ae08-48c2ba7cf648 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:00.719756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-200c3441-03f8-4fc5-ae08-48c2ba7cf648 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:00.720098 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-200c3441-03f8-4fc5-ae08-48c2ba7cf648 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:00.851487 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b540503a-8a68-48aa-9067-0f5e0f9635cb tempest-QuotasAdminTestV236-1079226077 tempest-QuotasAdminTestV236-1079226077-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/0802392b4b4d4f439e07e6af2ba215ef?user_id=595cb1707b474c9ba205d28f3b143f0e" status: 200 len: 282 microversion: 2.36 time: 0.291073 Oct 29 02:46:00.853039 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 104/204] 10.222.0.46 () {60 vars in 1364 bytes} [Sat Oct 29 02:46:00 2022] GET /compute/v2.1/os-quota-sets/0802392b4b4d4f439e07e6af2ba215ef?user_id=595cb1707b474c9ba205d28f3b143f0e => generated 282 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:46:00.857919 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-38d47c1f-176e-4d52-9f41-9f86eb5eda96 tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "43c93feda63a4a7a876b61eeaf875bc1"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:00.892312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-200c3441-03f8-4fc5-ae08-48c2ba7cf648 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:00.912601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-200c3441-03f8-4fc5-ae08-48c2ba7cf648 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:00.922633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-200c3441-03f8-4fc5-ae08-48c2ba7cf648 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:00.924356 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-200c3441-03f8-4fc5-ae08-48c2ba7cf648 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 200 len: 1342 microversion: 2.25 time: 0.219033 Oct 29 02:46:00.925757 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 101/205] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:00 2022] GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 1342 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:00.942086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-21227f2d-6ea9-4d0f-9d49-85ec0a18b1f0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:00.943115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-21227f2d-6ea9-4d0f-9d49-85ec0a18b1f0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] [instance: 20072a0e-36ce-4bc7-b83e-7d88340ab50c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:00.959152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-21227f2d-6ea9-4d0f-9d49-85ec0a18b1f0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:00.960270 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-21227f2d-6ea9-4d0f-9d49-85ec0a18b1f0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:00.961047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-21227f2d-6ea9-4d0f-9d49-85ec0a18b1f0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:00.962146 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-21227f2d-6ea9-4d0f-9d49-85ec0a18b1f0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:00.963679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-21227f2d-6ea9-4d0f-9d49-85ec0a18b1f0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:00.964464 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-21227f2d-6ea9-4d0f-9d49-85ec0a18b1f0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:00.997771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-21227f2d-6ea9-4d0f-9d49-85ec0a18b1f0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] [instance: 20072a0e-36ce-4bc7-b83e-7d88340ab50c] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:46:01.094278 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-38d47c1f-176e-4d52-9f41-9f86eb5eda96 tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/640174150/action" status: 200 len: 96 microversion: 2.1 time: 0.239837 Oct 29 02:46:01.094877 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 105/206] 10.222.0.46 () {60 vars in 1197 bytes} [Sat Oct 29 02:46:00 2022] POST /compute/v2.1/flavors/640174150/action => generated 96 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:46:01.109082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fd1b6326-ddff-4902-b620-be2a0537e71d tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:01.110580 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fd1b6326-ddff-4902-b620-be2a0537e71d tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: c4180915-07c1-4365-976f-3b32fef4fc7c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:01.119408 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd1b6326-ddff-4902-b620-be2a0537e71d tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:01.120148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd1b6326-ddff-4902-b620-be2a0537e71d tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:01.120919 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd1b6326-ddff-4902-b620-be2a0537e71d tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:01.122139 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd1b6326-ddff-4902-b620-be2a0537e71d tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:01.123181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd1b6326-ddff-4902-b620-be2a0537e71d tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:01.123939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd1b6326-ddff-4902-b620-be2a0537e71d tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:01.266653 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-21227f2d-6ea9-4d0f-9d49-85ec0a18b1f0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] 10.222.0.46 "DELETE /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c" status: 204 len: 0 microversion: 2.1 time: 0.334444 Oct 29 02:46:01.268141 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 102/207] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:46:00 2022] DELETE /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:46:01.277729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dd8eeebc-1889-4d6e-b7ce-ac581ae7e1cb tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "43c93feda63a4a7a876b61eeaf875bc1"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:01.316095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fd1b6326-ddff-4902-b620-be2a0537e71d tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:01.327389 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fd1b6326-ddff-4902-b620-be2a0537e71d tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c" status: 200 len: 1321 microversion: 2.1 time: 0.230569 Oct 29 02:46:01.328474 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 106/208] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:01 2022] GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:01.337636 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-97aa0179-6959-43fa-b34d-c019d62cf48d tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:01.344080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-97aa0179-6959-43fa-b34d-c019d62cf48d tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] [instance: 20072a0e-36ce-4bc7-b83e-7d88340ab50c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:01.351218 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-97aa0179-6959-43fa-b34d-c019d62cf48d tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:01.352002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-97aa0179-6959-43fa-b34d-c019d62cf48d tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:01.352992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-97aa0179-6959-43fa-b34d-c019d62cf48d tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:01.353848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-97aa0179-6959-43fa-b34d-c019d62cf48d tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:01.354574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-97aa0179-6959-43fa-b34d-c019d62cf48d tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:01.355144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-97aa0179-6959-43fa-b34d-c019d62cf48d tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:01.523976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-97aa0179-6959-43fa-b34d-c019d62cf48d tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb72790532b484583be089c38656f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f1de1bd2764e2994a4f1caaef0ad4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:01.533841 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-97aa0179-6959-43fa-b34d-c019d62cf48d tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] 10.222.0.46 "GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c" status: 200 len: 1495 microversion: 2.1 time: 0.204142 Oct 29 02:46:01.534437 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 107/209] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:01 2022] GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c => generated 1495 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:01.842143 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-dd8eeebc-1889-4d6e-b7ce-ac581ae7e1cb tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] HTTP exception thrown: Flavor access already exists for flavor 31 and project 43c93feda63a4a7a876b61eeaf875bc1 combination. Oct 29 02:46:01.861417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dd8eeebc-1889-4d6e-b7ce-ac581ae7e1cb tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] Request method failure captured: Oct 29 02:46:01.861417 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/flavors/640174150/action HTTP/1.1 Oct 29 02:46:01.861417 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:46:01.861417 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:46:01.861417 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:46:01.861417 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 67 Oct 29 02:46:01.861417 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:46:01.861417 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:46:01.861417 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:46:01.861417 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:01.861417 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPnBMUSbGXQdBYOBAuL5p2GlKGHnzDbfTE1bzSjn-mpbx45Wln7W4dX4vLEiW5lDIj1ICR1kzyTxuDFMTgmy4-hgoOlWR-oaiLR-ZXYa_OW8XFAyrWUDzw91XqvULpXDOkrAsCZPqzOV1MBaI7ngLNXlWcIOndifJVJkQNkIyMY1xs Oct 29 02:46:01.861417 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:46:01.861417 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:46:01.861417 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:46:01.861417 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:46:01.861417 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:46:01.861417 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:46:01.861417 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: f7b6ef72336240dc828605976b961aa7 Oct 29 02:46:01.861417 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-538260373 Oct 29 02:46:01.861417 n-d-862967-2 devstack@n-api.service[127124]: X-Role: admin,reader,member Oct 29 02:46:01.861417 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: admin,reader,member Oct 29 02:46:01.862625 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f7b6ef72336240dc828605976b961aa7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f7b6ef72336240dc828605976b961aa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f7b6ef72336240dc828605976b961aa7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f7b6ef72336240dc828605976b961aa7"}]}] Oct 29 02:46:01.862625 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-538260373 Oct 29 02:46:01.862625 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: f7b6ef72336240dc828605976b961aa7 Oct 29 02:46:01.862625 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-538260373 Oct 29 02:46:01.862625 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin Oct 29 02:46:01.862625 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:46:01.862625 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:46:01.862625 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 2c9da3d483604609ae0a6421d8c6732b Oct 29 02:46:01.862625 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin Oct 29 02:46:01.862625 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:46:01.862625 n-d-862967-2 devstack@n-api.service[127124]: {"addTenantAccess": {"tenant": "43c93feda63a4a7a876b61eeaf875bc1"}} Oct 29 02:46:01.862625 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:46:01.863310 n-d-862967-2 devstack@n-api.service[127124]: exception: Flavor access already exists for flavor 31 and project 43c93feda63a4a7a876b61eeaf875bc1 combination. Oct 29 02:46:01.863310 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '640174150', 'body': {'addTenantAccess': {'tenant': '43c93feda63a4a7a876b61eeaf875bc1'}}} Oct 29 02:46:01.863310 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:01.863310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:01.863310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 02:46:01.863310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 29 02:46:01.863310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 02:46:01.863310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 29 02:46:01.863310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 02:46:01.863310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 29 02:46:01.863310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 02:46:01.863310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 29 02:46:01.863310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 02:46:01.863310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 02:46:01.863310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 02:46:01.863310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result.read() Oct 29 02:46:01.863310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 02:46:01.863310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 29 02:46:01.864303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 02:46:01.864303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 29 02:46:01.864303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 02:46:01.864303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 29 02:46:01.864303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 02:46:01.864303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 29 02:46:01.864303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '31-43c93feda63a4a7a876b61eeaf875bc1' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 29 02:46:01.864303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:01.864303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 29 02:46:01.864303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:01.864303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:01.864303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 29 02:46:01.864303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 29 02:46:01.864303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 29 02:46:01.864303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi session.flush() Oct 29 02:46:01.864303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 29 02:46:01.864303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 29 02:46:01.864303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 29 02:46:01.864303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 29 02:46:01.865417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 29 02:46:01.865417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 29 02:46:01.865417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 02:46:01.865417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception Oct 29 02:46:01.865417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 29 02:46:01.865417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 29 02:46:01.865417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 29 02:46:01.865417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 29 02:46:01.865417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 29 02:46:01.865417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 29 02:46:01.865417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 29 02:46:01.865417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 29 02:46:01.865417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 29 02:46:01.865417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 29 02:46:01.865417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 29 02:46:01.865417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 29 02:46:01.865417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 29 02:46:01.865417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 29 02:46:01.866350 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 29 02:46:01.866350 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 29 02:46:01.866350 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 29 02:46:01.866350 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 29 02:46:01.866350 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 29 02:46:01.866350 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 29 02:46:01.866350 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 02:46:01.866350 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception Oct 29 02:46:01.866350 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 02:46:01.866350 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 29 02:46:01.866350 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 02:46:01.866350 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 29 02:46:01.866350 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 02:46:01.866350 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 29 02:46:01.866350 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 02:46:01.866350 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 29 02:46:01.866350 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 02:46:01.866350 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 02:46:01.867253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 02:46:01.867253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result.read() Oct 29 02:46:01.867253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 02:46:01.867253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 29 02:46:01.867253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 02:46:01.867253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 29 02:46:01.867253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 02:46:01.867253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 29 02:46:01.867253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 02:46:01.867253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 29 02:46:01.867253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '31-43c93feda63a4a7a876b61eeaf875bc1' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 29 02:46:01.867253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 29 02:46:01.867253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 29, 2, 46, 1, 837061), 'updated_at': None, 'flavor_id': 31, 'project_id': '43c93feda63a4a7a876b61eeaf875bc1'}] Oct 29 02:46:01.867253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 29 02:46:01.867253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:01.867253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:01.867253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:01.869415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:01.869415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 29 02:46:01.869415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 29 02:46:01.869415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 29 02:46:01.869415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 29 02:46:01.869415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 29 02:46:01.869415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 29 02:46:01.869415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 29 02:46:01.869415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 29 02:46:01.869415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 29 02:46:01.869415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 29 02:46:01.869415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:46:01.869415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:46:01.869415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 29 02:46:01.869415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 29 02:46:01.869415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 31 and project 43c93feda63a4a7a876b61eeaf875bc1 combination. Oct 29 02:46:01.869415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:01.869415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:01.869415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:01.871661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:01.871661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:01.871661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:01.871661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:01.871661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:01.871661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:01.871661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:01.871661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:46:01.871661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:01.871661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 29 02:46:01.871661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 29 02:46:01.871661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 31 and project 43c93feda63a4a7a876b61eeaf875bc1 combination. Oct 29 02:46:01.871661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:01.871661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:01.871661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:01.871661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:01.871661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:01.871661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:01.871661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:01.871661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:01.876086 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 31 and project 43c93feda63a4a7a876b61eeaf875bc1 combination. Oct 29 02:46:01.876086 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:01.876086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dd8eeebc-1889-4d6e-b7ce-ac581ae7e1cb tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] Returning 409 to user: Flavor access already exists for flavor 31 and project 43c93feda63a4a7a876b61eeaf875bc1 combination. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:01.876086 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dd8eeebc-1889-4d6e-b7ce-ac581ae7e1cb tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/640174150/action" status: 409 len: 152 microversion: 2.1 time: 0.593393 Oct 29 02:46:01.876086 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 103/210] 10.222.0.46 () {60 vars in 1197 bytes} [Sat Oct 29 02:46:01 2022] POST /compute/v2.1/flavors/640174150/action => generated 152 bytes in 598 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:46:01.876974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3f22dc82-f887-47c1-8e84-b455ca8ed9de tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "43c93feda63a4a7a876b61eeaf875bc1"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:01.951965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-89292f97-8238-458a-9f04-b16d588c2b8a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:01.952928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-89292f97-8238-458a-9f04-b16d588c2b8a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:01.961037 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89292f97-8238-458a-9f04-b16d588c2b8a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:01.961839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89292f97-8238-458a-9f04-b16d588c2b8a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:01.962475 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89292f97-8238-458a-9f04-b16d588c2b8a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:01.963416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89292f97-8238-458a-9f04-b16d588c2b8a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:01.964134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89292f97-8238-458a-9f04-b16d588c2b8a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:01.967988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89292f97-8238-458a-9f04-b16d588c2b8a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:02.146213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-89292f97-8238-458a-9f04-b16d588c2b8a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:02.154755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-89292f97-8238-458a-9f04-b16d588c2b8a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:02.156197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-89292f97-8238-458a-9f04-b16d588c2b8a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:02.157339 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-89292f97-8238-458a-9f04-b16d588c2b8a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 200 len: 1384 microversion: 2.25 time: 0.210777 Oct 29 02:46:02.158165 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 104/211] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:01 2022] GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 1384 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:46:02.173895 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3f22dc82-f887-47c1-8e84-b455ca8ed9de tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/640174150/action" status: 200 len: 21 microversion: 2.1 time: 0.305849 Oct 29 02:46:02.174518 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 108/212] 10.222.0.46 () {60 vars in 1197 bytes} [Sat Oct 29 02:46:01 2022] POST /compute/v2.1/flavors/640174150/action => generated 21 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:46:02.185509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e220632d-e098-4425-a110-a747ca4b8615 tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:02.205632 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e220632d-e098-4425-a110-a747ca4b8615 tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/640174150" status: 202 len: 0 microversion: 2.1 time: 0.023856 Oct 29 02:46:02.206248 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 105/213] 10.222.0.46 () {58 vars in 1158 bytes} [Sat Oct 29 02:46:02 2022] DELETE /compute/v2.1/flavors/640174150 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 02:46:02.214924 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-86ed79a0-98a4-4aed-83c6-546535c6ac76 tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:02.236770 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-86ed79a0-98a4-4aed-83c6-546535c6ac76 tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025657 Oct 29 02:46:02.249317 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 109/214] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:46:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:02.259753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c14b918a-d53c-4650-8581-a7013b21a30b tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-213055731", "id": 49999156, "os-flavor-access:is_public": "True"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:02.280496 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c14b918a-d53c-4650-8581-a7013b21a30b tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.024649 Oct 29 02:46:02.284821 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 106/215] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:46:02 2022] POST /compute/v2.1/flavors => generated 431 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:02.300632 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b18c55f8-d1b4-4a45-b2f6-3f38944ae531 tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:02.309890 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-b18c55f8-d1b4-4a45-b2f6-3f38944ae531 tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 29 02:46:02.312112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b18c55f8-d1b4-4a45-b2f6-3f38944ae531 tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] Request method failure captured: Oct 29 02:46:02.312112 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/flavors/49999156/os-flavor-access HTTP/1.1 Oct 29 02:46:02.312112 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:46:02.312112 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:46:02.312112 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:46:02.312112 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:46:02.312112 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:46:02.312112 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:46:02.312112 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:46:02.312112 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:02.312112 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPnBMUSbGXQdBYOBAuL5p2GlKGHnzDbfTE1bzSjn-mpbx45Wln7W4dX4vLEiW5lDIj1ICR1kzyTxuDFMTgmy4-hgoOlWR-oaiLR-ZXYa_OW8XFAyrWUDzw91XqvULpXDOkrAsCZPqzOV1MBaI7ngLNXlWcIOndifJVJkQNkIyMY1xs Oct 29 02:46:02.312112 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:46:02.312112 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:46:02.312112 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:46:02.312112 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:46:02.312112 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:46:02.312112 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:46:02.312112 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: f7b6ef72336240dc828605976b961aa7 Oct 29 02:46:02.312112 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-538260373 Oct 29 02:46:02.312112 n-d-862967-2 devstack@n-api.service[127125]: X-Role: admin,reader,member Oct 29 02:46:02.312112 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: admin,reader,member Oct 29 02:46:02.313328 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f7b6ef72336240dc828605976b961aa7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f7b6ef72336240dc828605976b961aa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f7b6ef72336240dc828605976b961aa7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f7b6ef72336240dc828605976b961aa7"}]}] Oct 29 02:46:02.313328 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-538260373 Oct 29 02:46:02.313328 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: f7b6ef72336240dc828605976b961aa7 Oct 29 02:46:02.313328 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-538260373 Oct 29 02:46:02.313328 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin Oct 29 02:46:02.313328 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:46:02.313328 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:46:02.313328 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 2c9da3d483604609ae0a6421d8c6732b Oct 29 02:46:02.313328 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin Oct 29 02:46:02.313328 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:46:02.313328 n-d-862967-2 devstack@n-api.service[127125]: exception: Access list not available for public flavors. Oct 29 02:46:02.313328 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'flavor_id': '49999156'} Oct 29 02:46:02.313984 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:02.313984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:02.313984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:02.313984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:02.313984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:02.313984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:02.313984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:02.313984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:02.313984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 29 02:46:02.313984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 02:46:02.313984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 29 02:46:02.313984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:02.313984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:02.313984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:02.313984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:02.313984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:02.313984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:02.313984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:02.313984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:02.313984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 29 02:46:02.313984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:02.316379 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b18c55f8-d1b4-4a45-b2f6-3f38944ae531 tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:02.317540 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b18c55f8-d1b4-4a45-b2f6-3f38944ae531 tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/49999156/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.022507 Oct 29 02:46:02.318644 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 110/216] 10.222.0.46 () {58 vars in 1203 bytes} [Sat Oct 29 02:46:02 2022] GET /compute/v2.1/flavors/49999156/os-flavor-access => generated 91 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:46:02.327712 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-967dbc29-de8c-4d0f-bccc-2f2f4dddaf5d tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:02.349139 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-967dbc29-de8c-4d0f-bccc-2f2f4dddaf5d tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/49999156" status: 202 len: 0 microversion: 2.1 time: 0.025598 Oct 29 02:46:02.349777 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 107/217] 10.222.0.46 () {58 vars in 1155 bytes} [Sat Oct 29 02:46:02 2022] DELETE /compute/v2.1/flavors/49999156 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:46:02.357911 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2fc62b1a-7dce-4eba-a28c-1ba47c396960 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:02.359808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2fc62b1a-7dce-4eba-a28c-1ba47c396960 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: c4180915-07c1-4365-976f-3b32fef4fc7c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:02.362494 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cae04194-1b1d-41fa-98fb-838f818f9046 tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:02.380059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fc62b1a-7dce-4eba-a28c-1ba47c396960 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:02.381214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fc62b1a-7dce-4eba-a28c-1ba47c396960 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:02.381885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fc62b1a-7dce-4eba-a28c-1ba47c396960 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:02.383572 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fc62b1a-7dce-4eba-a28c-1ba47c396960 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:02.386330 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fc62b1a-7dce-4eba-a28c-1ba47c396960 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:02.387039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fc62b1a-7dce-4eba-a28c-1ba47c396960 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:02.397612 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cae04194-1b1d-41fa-98fb-838f818f9046 tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042837 Oct 29 02:46:02.413171 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 108/218] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:46:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:02.425944 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b4d8dd5e-018b-4395-a129-2b35c8526b6c tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-225287878", "id": 1886519347, "os-flavor-access:is_public": "False"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:02.447309 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b4d8dd5e-018b-4395-a129-2b35c8526b6c tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.025082 Oct 29 02:46:02.448155 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 109/219] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:46:02 2022] POST /compute/v2.1/flavors => generated 438 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:02.655362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2fc62b1a-7dce-4eba-a28c-1ba47c396960 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:02.669586 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2fc62b1a-7dce-4eba-a28c-1ba47c396960 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c" status: 200 len: 1321 microversion: 2.1 time: 0.321157 Oct 29 02:46:02.670367 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 111/220] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:02 2022] GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c => generated 1321 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:02.674730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-65a9b61e-84e8-4aa3-9142-ed880736bbc0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:02.675332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-65a9b61e-84e8-4aa3-9142-ed880736bbc0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] [instance: 20072a0e-36ce-4bc7-b83e-7d88340ab50c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:02.688540 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:02.713380 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65a9b61e-84e8-4aa3-9142-ed880736bbc0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:02.714206 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65a9b61e-84e8-4aa3-9142-ed880736bbc0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:02.716799 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65a9b61e-84e8-4aa3-9142-ed880736bbc0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:02.722152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65a9b61e-84e8-4aa3-9142-ed880736bbc0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:02.722862 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65a9b61e-84e8-4aa3-9142-ed880736bbc0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:02.723635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65a9b61e-84e8-4aa3-9142-ed880736bbc0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:02.763985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9971dc87-bf72-4e40-9777-c809e2d955f2 tempest-FlavorsAccessNegativeTestJSON-1299565285 tempest-FlavorsAccessNegativeTestJSON-1299565285-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "43c93feda63a4a7a876b61eeaf875bc1"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:02.768326 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9971dc87-bf72-4e40-9777-c809e2d955f2 tempest-FlavorsAccessNegativeTestJSON-1299565285 tempest-FlavorsAccessNegativeTestJSON-1299565285-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '8bf01df5edac412ca2f12b00837e44f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c93feda63a4a7a876b61eeaf875bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:02.769844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9971dc87-bf72-4e40-9777-c809e2d955f2 tempest-FlavorsAccessNegativeTestJSON-1299565285 tempest-FlavorsAccessNegativeTestJSON-1299565285-project] Request method failure captured: Oct 29 02:46:02.769844 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/flavors/1886519347/action HTTP/1.1 Oct 29 02:46:02.769844 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:46:02.769844 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:46:02.769844 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:46:02.769844 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 67 Oct 29 02:46:02.769844 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:46:02.769844 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:46:02.769844 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:46:02.769844 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:02.769844 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPldJP9THhSQSM2sMKykqgVdGLKd1FjQUxSnxoLLbw6i1yYdoEWPKvHW7vkfgz4z_b0nq0qW-9OssucaGIxeAGIccpLriuCEnrKOWS4YPVQkb5nKTWzrSeDCVCIYIS-Xejm6LGIcotKE5ajwmVsEU6pmmMVaCNjb9im3QRIKlOJc7I Oct 29 02:46:02.769844 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:46:02.769844 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:46:02.769844 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:46:02.769844 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:46:02.769844 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:46:02.769844 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:46:02.769844 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 43c93feda63a4a7a876b61eeaf875bc1 Oct 29 02:46:02.769844 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1299565285 Oct 29 02:46:02.769844 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:46:02.769844 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:46:02.771228 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c93feda63a4a7a876b61eeaf875bc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c93feda63a4a7a876b61eeaf875bc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_43c93feda63a4a7a876b61eeaf875bc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/43c93feda63a4a7a876b61eeaf875bc1"}]}] Oct 29 02:46:02.771228 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1299565285 Oct 29 02:46:02.771228 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 43c93feda63a4a7a876b61eeaf875bc1 Oct 29 02:46:02.771228 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1299565285 Oct 29 02:46:02.771228 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-FlavorsAccessNegativeTestJSON-1299565285-project Oct 29 02:46:02.771228 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:46:02.771228 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:46:02.771228 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 8bf01df5edac412ca2f12b00837e44f2 Oct 29 02:46:02.771228 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1299565285-project Oct 29 02:46:02.771228 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:46:02.771228 n-d-862967-2 devstack@n-api.service[127124]: {"addTenantAccess": {"tenant": "43c93feda63a4a7a876b61eeaf875bc1"}} Oct 29 02:46:02.771228 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:46:02.772198 n-d-862967-2 devstack@n-api.service[127124]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 29 02:46:02.772198 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '1886519347', 'body': {'addTenantAccess': {'tenant': '43c93feda63a4a7a876b61eeaf875bc1'}}} Oct 29 02:46:02.772198 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:02.772198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:02.772198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:02.772198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:02.772198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:02.772198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:02.772198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:02.772198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:02.772198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:46:02.772198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:02.772198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 29 02:46:02.772198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 29 02:46:02.772198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:46:02.772198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:46:02.772198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:46:02.772198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:46:02.772198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:46:02.773460 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:46:02.773460 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:46:02.773460 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:46:02.773460 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:46:02.773460 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:46:02.773460 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:46:02.773460 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:46:02.773460 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:46:02.773460 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:46:02.773460 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 29 02:46:02.773460 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:02.773460 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:02.773460 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:02.773460 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:02.773460 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:02.773460 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:02.773460 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:46:02.773460 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:46:02.773460 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 29 02:46:02.773460 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:02.775586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9971dc87-bf72-4e40-9777-c809e2d955f2 tempest-FlavorsAccessNegativeTestJSON-1299565285 tempest-FlavorsAccessNegativeTestJSON-1299565285-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:02.775586 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9971dc87-bf72-4e40-9777-c809e2d955f2 tempest-FlavorsAccessNegativeTestJSON-1299565285 tempest-FlavorsAccessNegativeTestJSON-1299565285-project] 10.222.0.46 "POST /compute/v2.1/flavors/1886519347/action" status: 403 len: 130 microversion: 2.1 time: 0.312423 Oct 29 02:46:02.776810 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 110/221] 10.222.0.46 () {60 vars in 1200 bytes} [Sat Oct 29 02:46:02 2022] POST /compute/v2.1/flavors/1886519347/action => generated 130 bytes in 318 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:46:02.785923 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-289c5e99-54c1-426c-b8ae-07beffe7e297 tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:02.822692 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-289c5e99-54c1-426c-b8ae-07beffe7e297 tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1886519347" status: 202 len: 0 microversion: 2.1 time: 0.041727 Oct 29 02:46:02.823743 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 111/222] 10.222.0.46 () {58 vars in 1161 bytes} [Sat Oct 29 02:46:02 2022] DELETE /compute/v2.1/flavors/1886519347 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:46:02.847568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ad2c1805-d7f7-4e5f-b56e-afc24ddf9cf6 tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:02.874669 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ad2c1805-d7f7-4e5f-b56e-afc24ddf9cf6 tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032768 Oct 29 02:46:02.876489 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 112/223] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:46:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:02.909590 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4873589e-199b-47d5-83a7-d7c92c595aec tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1147819292", "id": 1782623500, "os-flavor-access:is_public": "False"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:02.963473 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4873589e-199b-47d5-83a7-d7c92c595aec tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.063314 Oct 29 02:46:02.966007 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 113/224] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:46:02 2022] POST /compute/v2.1/flavors => generated 439 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:02.983402 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c554f5d5-0d09-42f4-bf0e-b22732a872af tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "43c93feda63a4a7a876b61eeaf875bc1"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:03.119438 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-65a9b61e-84e8-4aa3-9142-ed880736bbc0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb72790532b484583be089c38656f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f1de1bd2764e2994a4f1caaef0ad4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:03.132755 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-65a9b61e-84e8-4aa3-9142-ed880736bbc0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] 10.222.0.46 "GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c" status: 200 len: 1495 microversion: 2.1 time: 0.461452 Oct 29 02:46:03.133663 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 112/225] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:02 2022] GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c => generated 1495 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:03.182186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d6a27d71-b906-4780-a32c-fd9c86ec14e4 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:03.182798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d6a27d71-b906-4780-a32c-fd9c86ec14e4 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:03.194796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6a27d71-b906-4780-a32c-fd9c86ec14e4 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:03.196871 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6a27d71-b906-4780-a32c-fd9c86ec14e4 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:03.198245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6a27d71-b906-4780-a32c-fd9c86ec14e4 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:03.200972 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6a27d71-b906-4780-a32c-fd9c86ec14e4 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:03.201634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6a27d71-b906-4780-a32c-fd9c86ec14e4 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:03.203772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6a27d71-b906-4780-a32c-fd9c86ec14e4 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:03.444114 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d6a27d71-b906-4780-a32c-fd9c86ec14e4 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:03.453743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d6a27d71-b906-4780-a32c-fd9c86ec14e4 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:03.455193 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d6a27d71-b906-4780-a32c-fd9c86ec14e4 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:03.456344 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d6a27d71-b906-4780-a32c-fd9c86ec14e4 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 200 len: 1384 microversion: 2.25 time: 0.278270 Oct 29 02:46:03.456949 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 113/226] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:03 2022] GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 1384 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:46:03.674364 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c554f5d5-0d09-42f4-bf0e-b22732a872af tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/1782623500/action" status: 200 len: 97 microversion: 2.1 time: 0.699000 Oct 29 02:46:03.677181 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 114/227] 10.222.0.46 () {60 vars in 1200 bytes} [Sat Oct 29 02:46:02 2022] POST /compute/v2.1/flavors/1782623500/action => generated 97 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 02:46:03.691676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fbdf769b-5494-4bf0-911b-81f14a5bd93d tempest-FlavorsAccessNegativeTestJSON-1299565285 tempest-FlavorsAccessNegativeTestJSON-1299565285-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "43c93feda63a4a7a876b61eeaf875bc1"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:03.703893 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-728745ec-6096-4645-9b89-a844dcc0cccb tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:03.709158 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fbdf769b-5494-4bf0-911b-81f14a5bd93d tempest-FlavorsAccessNegativeTestJSON-1299565285 tempest-FlavorsAccessNegativeTestJSON-1299565285-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '8bf01df5edac412ca2f12b00837e44f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43c93feda63a4a7a876b61eeaf875bc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:03.712039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fbdf769b-5494-4bf0-911b-81f14a5bd93d tempest-FlavorsAccessNegativeTestJSON-1299565285 tempest-FlavorsAccessNegativeTestJSON-1299565285-project] Request method failure captured: Oct 29 02:46:03.712039 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/flavors/1782623500/action HTTP/1.1 Oct 29 02:46:03.712039 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:46:03.712039 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:46:03.712039 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:46:03.712039 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 70 Oct 29 02:46:03.712039 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:46:03.712039 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:46:03.712039 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:46:03.712039 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:03.712039 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPldJP9THhSQSM2sMKykqgVdGLKd1FjQUxSnxoLLbw6i1yYdoEWPKvHW7vkfgz4z_b0nq0qW-9OssucaGIxeAGIccpLriuCEnrKOWS4YPVQkb5nKTWzrSeDCVCIYIS-Xejm6LGIcotKE5ajwmVsEU6pmmMVaCNjb9im3QRIKlOJc7I Oct 29 02:46:03.712039 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:46:03.712039 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:46:03.712039 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:46:03.712039 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:46:03.712039 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:46:03.712039 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:46:03.712039 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 43c93feda63a4a7a876b61eeaf875bc1 Oct 29 02:46:03.712039 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1299565285 Oct 29 02:46:03.712039 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:46:03.712039 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:46:03.713427 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c93feda63a4a7a876b61eeaf875bc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43c93feda63a4a7a876b61eeaf875bc1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_43c93feda63a4a7a876b61eeaf875bc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/43c93feda63a4a7a876b61eeaf875bc1"}]}] Oct 29 02:46:03.713427 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1299565285 Oct 29 02:46:03.713427 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 43c93feda63a4a7a876b61eeaf875bc1 Oct 29 02:46:03.713427 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1299565285 Oct 29 02:46:03.713427 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-FlavorsAccessNegativeTestJSON-1299565285-project Oct 29 02:46:03.713427 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:46:03.713427 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:46:03.713427 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 8bf01df5edac412ca2f12b00837e44f2 Oct 29 02:46:03.713427 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1299565285-project Oct 29 02:46:03.713427 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:46:03.713427 n-d-862967-2 devstack@n-api.service[127125]: {"removeTenantAccess": {"tenant": "43c93feda63a4a7a876b61eeaf875bc1"}} Oct 29 02:46:03.713427 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:46:03.714189 n-d-862967-2 devstack@n-api.service[127125]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 29 02:46:03.714189 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '1782623500', 'body': {'removeTenantAccess': {'tenant': '43c93feda63a4a7a876b61eeaf875bc1'}}} Oct 29 02:46:03.714189 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:03.714189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:03.714189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:03.714189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:03.714189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:03.714189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:03.714189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:03.714189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:03.714189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:46:03.714189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:03.714189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 29 02:46:03.714189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi context.can( Oct 29 02:46:03.714189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:46:03.714189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:46:03.714189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:46:03.714189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:46:03.714189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:46:03.714189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:46:03.715426 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:46:03.715426 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:46:03.715426 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:46:03.715426 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:46:03.715426 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:46:03.715426 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:46:03.715426 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:46:03.715426 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:46:03.715426 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 29 02:46:03.715426 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:03.715426 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:03.715426 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:03.715426 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:03.715426 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:03.715426 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:03.715426 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:46:03.715426 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:46:03.715426 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 29 02:46:03.715426 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:03.720191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-728745ec-6096-4645-9b89-a844dcc0cccb tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: c4180915-07c1-4365-976f-3b32fef4fc7c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:03.725334 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fbdf769b-5494-4bf0-911b-81f14a5bd93d tempest-FlavorsAccessNegativeTestJSON-1299565285 tempest-FlavorsAccessNegativeTestJSON-1299565285-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:03.726867 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fbdf769b-5494-4bf0-911b-81f14a5bd93d tempest-FlavorsAccessNegativeTestJSON-1299565285 tempest-FlavorsAccessNegativeTestJSON-1299565285-project] 10.222.0.46 "POST /compute/v2.1/flavors/1782623500/action" status: 403 len: 133 microversion: 2.1 time: 0.043007 Oct 29 02:46:03.727810 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 114/228] 10.222.0.46 () {60 vars in 1200 bytes} [Sat Oct 29 02:46:03 2022] POST /compute/v2.1/flavors/1782623500/action => generated 133 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:03.739119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a7bc43b2-d582-4bad-96f0-769f05cb22b4 tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "43c93feda63a4a7a876b61eeaf875bc1"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:03.742954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-728745ec-6096-4645-9b89-a844dcc0cccb tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:03.745018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-728745ec-6096-4645-9b89-a844dcc0cccb tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:03.746104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-728745ec-6096-4645-9b89-a844dcc0cccb tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:03.747471 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-728745ec-6096-4645-9b89-a844dcc0cccb tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:03.749436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-728745ec-6096-4645-9b89-a844dcc0cccb tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:03.750362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-728745ec-6096-4645-9b89-a844dcc0cccb tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:04.369261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-728745ec-6096-4645-9b89-a844dcc0cccb tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:04.396222 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-728745ec-6096-4645-9b89-a844dcc0cccb tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c" status: 200 len: 1321 microversion: 2.1 time: 0.696935 Oct 29 02:46:04.398369 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 115/229] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:03 2022] GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c => generated 1321 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:04.407841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-0bda3733-2667-4598-a5da-d91085875eb3 req-c78e688c-6b65-4f20-871e-0274f2ec0769 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed", "tag": "ca4ed483-67be-4b3f-884e-48df58de6a0e"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:04.429560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-0bda3733-2667-4598-a5da-d91085875eb3 req-c78e688c-6b65-4f20-871e-0274f2ec0769 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:04.430875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-0bda3733-2667-4598-a5da-d91085875eb3 req-c78e688c-6b65-4f20-871e-0274f2ec0769 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:04.431870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-0bda3733-2667-4598-a5da-d91085875eb3 req-c78e688c-6b65-4f20-871e-0274f2ec0769 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:04.488873 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-0bda3733-2667-4598-a5da-d91085875eb3 req-c78e688c-6b65-4f20-871e-0274f2ec0769 service nova] Creating event network-changed:ca4ed483-67be-4b3f-884e-48df58de6a0e for instance 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed on n-h2-862967-2 Oct 29 02:46:04.501481 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-0bda3733-2667-4598-a5da-d91085875eb3 req-c78e688c-6b65-4f20-871e-0274f2ec0769 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100537 Oct 29 02:46:04.503133 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 116/230] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:04.527427 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d31a83a1-f682-4118-a3ba-4210920b19f8 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:04.532224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d31a83a1-f682-4118-a3ba-4210920b19f8 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] [instance: 20072a0e-36ce-4bc7-b83e-7d88340ab50c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:04.560694 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d31a83a1-f682-4118-a3ba-4210920b19f8 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:04.564821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d31a83a1-f682-4118-a3ba-4210920b19f8 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:04.565528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d31a83a1-f682-4118-a3ba-4210920b19f8 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:04.570261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d31a83a1-f682-4118-a3ba-4210920b19f8 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:04.578442 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d31a83a1-f682-4118-a3ba-4210920b19f8 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:04.579309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d31a83a1-f682-4118-a3ba-4210920b19f8 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:04.594796 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a7bc43b2-d582-4bad-96f0-769f05cb22b4 tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/1782623500/action" status: 200 len: 21 microversion: 2.1 time: 0.862056 Oct 29 02:46:04.601939 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 115/231] 10.222.0.46 () {60 vars in 1200 bytes} [Sat Oct 29 02:46:03 2022] POST /compute/v2.1/flavors/1782623500/action => generated 21 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 02:46:04.618106 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4cb8fa4e-c21a-4fee-813e-648bd669cfb3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:04.619289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4cb8fa4e-c21a-4fee-813e-648bd669cfb3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:04.634119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cb8fa4e-c21a-4fee-813e-648bd669cfb3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:04.634604 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cb8fa4e-c21a-4fee-813e-648bd669cfb3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:04.635031 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cb8fa4e-c21a-4fee-813e-648bd669cfb3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:04.635867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cb8fa4e-c21a-4fee-813e-648bd669cfb3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:04.649745 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cb8fa4e-c21a-4fee-813e-648bd669cfb3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:04.650186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cb8fa4e-c21a-4fee-813e-648bd669cfb3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:04.682500 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d31a83a1-f682-4118-a3ba-4210920b19f8 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:04.683227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d31a83a1-f682-4118-a3ba-4210920b19f8 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:04.684099 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d31a83a1-f682-4118-a3ba-4210920b19f8 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:04.685835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-d31a83a1-f682-4118-a3ba-4210920b19f8 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lazy-loading 'fault' on Instance uuid 20072a0e-36ce-4bc7-b83e-7d88340ab50c {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:04.711272 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:04.781979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d31a83a1-f682-4118-a3ba-4210920b19f8 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb72790532b484583be089c38656f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22f1de1bd2764e2994a4f1caaef0ad4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:04.790739 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d31a83a1-f682-4118-a3ba-4210920b19f8 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] 10.222.0.46 "GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c" status: 200 len: 1329 microversion: 2.1 time: 0.285735 Oct 29 02:46:04.791332 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 117/232] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:04 2022] GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c => generated 1329 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:04.797422 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bd950e58-98b7-4eb4-be08-9f89ac74ccb1 tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:04.841281 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bd950e58-98b7-4eb4-be08-9f89ac74ccb1 tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1782623500" status: 202 len: 0 microversion: 2.1 time: 0.047549 Oct 29 02:46:04.842401 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 118/233] 10.222.0.46 () {58 vars in 1161 bytes} [Sat Oct 29 02:46:04 2022] DELETE /compute/v2.1/flavors/1782623500 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:46:04.920723 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4cb8fa4e-c21a-4fee-813e-648bd669cfb3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:04.933018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4cb8fa4e-c21a-4fee-813e-648bd669cfb3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:04.935318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4cb8fa4e-c21a-4fee-813e-648bd669cfb3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:04.936445 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4cb8fa4e-c21a-4fee-813e-648bd669cfb3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 200 len: 1384 microversion: 2.25 time: 0.334250 Oct 29 02:46:04.940892 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 116/234] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:04 2022] GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 1384 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:04.945967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5807ca6b-1f11-4fd6-8288-0e730678dfef tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:04.972583 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5807ca6b-1f11-4fd6-8288-0e730678dfef tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030501 Oct 29 02:46:04.973196 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 117/235] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:46:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:05.047376 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-f6bdf112-8c43-409c-ab33-d4c28925e8a5 req-a76df9c4-a9b0-4f0d-9155-205b2e5f4f19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20072a0e-36ce-4bc7-b83e-7d88340ab50c", "name": "network-vif-deleted", "tag": "9c7abf8e-be92-4c31-a036-be7c42399521"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:05.081814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f6bdf112-8c43-409c-ab33-d4c28925e8a5 req-a76df9c4-a9b0-4f0d-9155-205b2e5f4f19 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:05.082565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f6bdf112-8c43-409c-ab33-d4c28925e8a5 req-a76df9c4-a9b0-4f0d-9155-205b2e5f4f19 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:05.083066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f6bdf112-8c43-409c-ab33-d4c28925e8a5 req-a76df9c4-a9b0-4f0d-9155-205b2e5f4f19 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:05.098239 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:05.101140 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-f6bdf112-8c43-409c-ab33-d4c28925e8a5 req-a76df9c4-a9b0-4f0d-9155-205b2e5f4f19 service nova] Creating event network-vif-deleted:9c7abf8e-be92-4c31-a036-be7c42399521 for instance 20072a0e-36ce-4bc7-b83e-7d88340ab50c on n-h2-862967-2 Oct 29 02:46:05.108350 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-f6bdf112-8c43-409c-ab33-d4c28925e8a5 req-a76df9c4-a9b0-4f0d-9155-205b2e5f4f19 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.263572 Oct 29 02:46:05.109747 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 119/236] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:05.118091 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-851f60d2-6e99-4ea0-abcf-fc265b95074f tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-520651755", "id": 975512400, "os-flavor-access:is_public": "False"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:05.134124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-201dd692-37b4-4cd2-a794-f5a2239d298a tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-28574624", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:05.166474 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-851f60d2-6e99-4ea0-abcf-fc265b95074f tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.054133 Oct 29 02:46:05.175782 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 120/237] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:46:05 2022] POST /compute/v2.1/flavors => generated 435 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:05.183239 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-91e61fa2-0cbe-4cde-8560-d5059240ee34 tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2ffa1dbaa7b740aeb7040c932931c108"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:05.209527 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-201dd692-37b4-4cd2-a794-f5a2239d298a tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] validate_networks() for None {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:46:05.451565 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-91e61fa2-0cbe-4cde-8560-d5059240ee34 tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] HTTP exception thrown: Flavor access not found for 35 / 2ffa1dbaa7b740aeb7040c932931c108 combination. Oct 29 02:46:05.453397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-91e61fa2-0cbe-4cde-8560-d5059240ee34 tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] Request method failure captured: Oct 29 02:46:05.453397 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/flavors/975512400/action HTTP/1.1 Oct 29 02:46:05.453397 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:46:05.453397 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:46:05.453397 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:46:05.453397 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 70 Oct 29 02:46:05.453397 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:46:05.453397 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:46:05.453397 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:46:05.453397 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:05.453397 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPnBMUSbGXQdBYOBAuL5p2GlKGHnzDbfTE1bzSjn-mpbx45Wln7W4dX4vLEiW5lDIj1ICR1kzyTxuDFMTgmy4-hgoOlWR-oaiLR-ZXYa_OW8XFAyrWUDzw91XqvULpXDOkrAsCZPqzOV1MBaI7ngLNXlWcIOndifJVJkQNkIyMY1xs Oct 29 02:46:05.453397 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:46:05.453397 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:46:05.453397 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:46:05.453397 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:46:05.453397 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:46:05.453397 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:46:05.453397 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: f7b6ef72336240dc828605976b961aa7 Oct 29 02:46:05.453397 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-538260373 Oct 29 02:46:05.453397 n-d-862967-2 devstack@n-api.service[127124]: X-Role: admin,reader,member Oct 29 02:46:05.453397 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: admin,reader,member Oct 29 02:46:05.455499 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f7b6ef72336240dc828605976b961aa7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f7b6ef72336240dc828605976b961aa7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f7b6ef72336240dc828605976b961aa7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f7b6ef72336240dc828605976b961aa7"}]}] Oct 29 02:46:05.455499 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-538260373 Oct 29 02:46:05.455499 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: f7b6ef72336240dc828605976b961aa7 Oct 29 02:46:05.455499 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-538260373 Oct 29 02:46:05.455499 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin Oct 29 02:46:05.455499 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:46:05.455499 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:46:05.455499 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 2c9da3d483604609ae0a6421d8c6732b Oct 29 02:46:05.455499 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin Oct 29 02:46:05.455499 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:46:05.455499 n-d-862967-2 devstack@n-api.service[127124]: {"removeTenantAccess": {"tenant": "2ffa1dbaa7b740aeb7040c932931c108"}} Oct 29 02:46:05.455499 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:46:05.457276 n-d-862967-2 devstack@n-api.service[127124]: exception: Flavor access not found for 35 / 2ffa1dbaa7b740aeb7040c932931c108 combination. Oct 29 02:46:05.457276 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '975512400', 'body': {'removeTenantAccess': {'tenant': '2ffa1dbaa7b740aeb7040c932931c108'}}} Oct 29 02:46:05.457276 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:05.457276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:05.457276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 29 02:46:05.457276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 29 02:46:05.457276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 29 02:46:05.457276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 29 02:46:05.457276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 29 02:46:05.457276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 29 02:46:05.457276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 29 02:46:05.457276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 29 02:46:05.457276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 29 02:46:05.457276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 29 02:46:05.457276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:46:05.457276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:46:05.457276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 29 02:46:05.457276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 29 02:46:05.458268 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 35 / 2ffa1dbaa7b740aeb7040c932931c108 combination. Oct 29 02:46:05.458268 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:05.458268 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:05.458268 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:05.458268 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:05.458268 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:05.458268 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:05.458268 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:05.458268 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:05.458268 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:05.458268 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:05.458268 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:46:05.458268 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:05.458268 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 29 02:46:05.458268 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:05.458268 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 35 / 2ffa1dbaa7b740aeb7040c932931c108 combination. Oct 29 02:46:05.458268 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:05.458268 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:05.458268 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:05.458268 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:05.461449 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:05.461449 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:05.461449 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:05.461449 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:05.461449 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 35 / 2ffa1dbaa7b740aeb7040c932931c108 combination. Oct 29 02:46:05.461449 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:05.461449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-91e61fa2-0cbe-4cde-8560-d5059240ee34 tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] Returning 404 to user: Flavor access not found for 35 / 2ffa1dbaa7b740aeb7040c932931c108 combination. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:05.461449 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-91e61fa2-0cbe-4cde-8560-d5059240ee34 tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/975512400/action" status: 404 len: 124 microversion: 2.1 time: 0.277950 Oct 29 02:46:05.461997 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-201dd692-37b4-4cd2-a794-f5a2239d298a tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:46:05.461997 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-201dd692-37b4-4cd2-a794-f5a2239d298a tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:46:05.461997 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-201dd692-37b4-4cd2-a794-f5a2239d298a tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:46:05.461997 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-201dd692-37b4-4cd2-a794-f5a2239d298a tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:46:05.461997 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-201dd692-37b4-4cd2-a794-f5a2239d298a tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:46:05.462359 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 121/238] 10.222.0.46 () {60 vars in 1197 bytes} [Sat Oct 29 02:46:05 2022] POST /compute/v2.1/flavors/975512400/action => generated 124 bytes in 282 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:05.465168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6018e3e2-3388-4f0d-82ca-ddc05b2c872e tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:05.465873 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6018e3e2-3388-4f0d-82ca-ddc05b2c872e tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: c4180915-07c1-4365-976f-3b32fef4fc7c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:05.472406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6018e3e2-3388-4f0d-82ca-ddc05b2c872e tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:05.472937 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6018e3e2-3388-4f0d-82ca-ddc05b2c872e tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:05.473512 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6018e3e2-3388-4f0d-82ca-ddc05b2c872e tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:05.473640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-201dd692-37b4-4cd2-a794-f5a2239d298a tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:05.474024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-201dd692-37b4-4cd2-a794-f5a2239d298a tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:05.474219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6018e3e2-3388-4f0d-82ca-ddc05b2c872e tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:05.474582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-201dd692-37b4-4cd2-a794-f5a2239d298a tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:05.474724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6018e3e2-3388-4f0d-82ca-ddc05b2c872e tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:05.475116 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6018e3e2-3388-4f0d-82ca-ddc05b2c872e tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:05.475938 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-201dd692-37b4-4cd2-a794-f5a2239d298a tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:05.476795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-201dd692-37b4-4cd2-a794-f5a2239d298a tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:05.477497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-201dd692-37b4-4cd2-a794-f5a2239d298a tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:05.505070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-201dd692-37b4-4cd2-a794-f5a2239d298a tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Getting quotas for project 89eadfa2b6054a58846e342008ab17da. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:46:05.509882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-201dd692-37b4-4cd2-a794-f5a2239d298a tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Getting quotas for user f70ed858998a418b9948f5dc574e4ad7 and project 89eadfa2b6054a58846e342008ab17da. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:46:05.524358 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-201dd692-37b4-4cd2-a794-f5a2239d298a tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:46:05.527044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-201dd692-37b4-4cd2-a794-f5a2239d298a tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] [instance: 59d3322c-0cf9-4251-8af6-7afbd4d249e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:46:05.583331 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-201dd692-37b4-4cd2-a794-f5a2239d298a tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605443 Oct 29 02:46:05.590055 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 118/239] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:46:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:46:05.590055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-14132ba0-a385-408c-a595-bacae50a1401 tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:05.609650 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-14132ba0-a385-408c-a595-bacae50a1401 tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/975512400" status: 202 len: 0 microversion: 2.1 time: 0.023046 Oct 29 02:46:05.610375 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 119/240] 10.222.0.46 () {58 vars in 1158 bytes} [Sat Oct 29 02:46:05 2022] DELETE /compute/v2.1/flavors/975512400 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:46:05.621816 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-69a40f75-6e03-4621-b274-b7ade21030a9 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:05.623801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-69a40f75-6e03-4621-b274-b7ade21030a9 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] [instance: 59d3322c-0cf9-4251-8af6-7afbd4d249e5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:05.648117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6018e3e2-3388-4f0d-82ca-ddc05b2c872e tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:05.657666 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6018e3e2-3388-4f0d-82ca-ddc05b2c872e tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c" status: 200 len: 1321 microversion: 2.1 time: 0.197098 Oct 29 02:46:05.658943 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 122/241] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:05 2022] GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:05.663719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0bb802c9-c970-4b3a-b753-cda0d1ed346b tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:05.690092 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0bb802c9-c970-4b3a-b753-cda0d1ed346b tempest-FlavorsAccessNegativeTestJSON-538260373 tempest-FlavorsAccessNegativeTestJSON-538260373-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029789 Oct 29 02:46:05.701593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-69a40f75-6e03-4621-b274-b7ade21030a9 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ed858998a418b9948f5dc574e4ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89eadfa2b6054a58846e342008ab17da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:05.705231 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 123/242] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:46:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:05.708509 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-69a40f75-6e03-4621-b274-b7ade21030a9 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] 10.222.0.46 "GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5" status: 200 len: 1221 microversion: 2.1 time: 0.097349 Oct 29 02:46:05.709131 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 120/243] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:05 2022] GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5 => generated 1221 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:05.815234 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-81ec294a-d8c7-46f5-bc89-5a1436af1ee0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:05.816011 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-81ec294a-d8c7-46f5-bc89-5a1436af1ee0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] [instance: 20072a0e-36ce-4bc7-b83e-7d88340ab50c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:05.823701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81ec294a-d8c7-46f5-bc89-5a1436af1ee0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:05.824408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81ec294a-d8c7-46f5-bc89-5a1436af1ee0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:05.825004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81ec294a-d8c7-46f5-bc89-5a1436af1ee0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:05.826604 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81ec294a-d8c7-46f5-bc89-5a1436af1ee0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:05.827159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81ec294a-d8c7-46f5-bc89-5a1436af1ee0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:05.827913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81ec294a-d8c7-46f5-bc89-5a1436af1ee0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:05.844858 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-81ec294a-d8c7-46f5-bc89-5a1436af1ee0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] HTTP exception thrown: Instance 20072a0e-36ce-4bc7-b83e-7d88340ab50c could not be found. Oct 29 02:46:05.848169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-81ec294a-d8c7-46f5-bc89-5a1436af1ee0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Request method failure captured: Oct 29 02:46:05.848169 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c HTTP/1.1 Oct 29 02:46:05.848169 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:46:05.848169 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:46:05.848169 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:46:05.848169 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:46:05.848169 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:46:05.848169 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:46:05.848169 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:46:05.848169 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:05.848169 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPCeKefrAzj7tM6bIHrSdfnJm34XqT7S5RWcGU-mzW_YnzV0meFXxidu-NcdG0FfFKi_dzUWHbPAYdh-9qWozX0oNpiDKGJ2OeppyRGFT0Z885VHdtq-twAK-zWbnR9Il7jG9-QH_dIdWVdeWVPjoEg95gEcsrDzLa6M_-zQYmpYh8 Oct 29 02:46:05.848169 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:46:05.848169 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:46:05.848169 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:46:05.848169 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:46:05.848169 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:46:05.848169 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:46:05.848169 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 22f1de1bd2764e2994a4f1caaef0ad4d Oct 29 02:46:05.848169 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-AggregatesAdminTestJSON-734538025 Oct 29 02:46:05.848169 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:46:05.848169 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:46:05.849427 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/22f1de1bd2764e2994a4f1caaef0ad4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/22f1de1bd2764e2994a4f1caaef0ad4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_22f1de1bd2764e2994a4f1caaef0ad4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/22f1de1bd2764e2994a4f1caaef0ad4d"}]}] Oct 29 02:46:05.849427 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-AggregatesAdminTestJSON-734538025 Oct 29 02:46:05.849427 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 22f1de1bd2764e2994a4f1caaef0ad4d Oct 29 02:46:05.849427 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-734538025 Oct 29 02:46:05.849427 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-AggregatesAdminTestJSON-734538025-project Oct 29 02:46:05.849427 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:46:05.849427 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:46:05.849427 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 6eb72790532b484583be089c38656f74 Oct 29 02:46:05.849427 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-AggregatesAdminTestJSON-734538025-project Oct 29 02:46:05.849427 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:46:05.849427 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 20072a0e-36ce-4bc7-b83e-7d88340ab50c could not be found. Oct 29 02:46:05.849427 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '20072a0e-36ce-4bc7-b83e-7d88340ab50c'} Oct 29 02:46:05.850138 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:05.850138 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:05.850138 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:46:05.850138 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:46:05.850138 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:46:05.850138 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:46:05.850138 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:46:05.850138 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:46:05.850138 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:46:05.850138 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:46:05.850138 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20072a0e-36ce-4bc7-b83e-7d88340ab50c could not be found. Oct 29 02:46:05.850138 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:05.850138 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:05.850138 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:05.850138 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:05.850138 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:05.850138 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:05.850138 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:05.850138 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:05.850138 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:05.851175 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:05.851175 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:46:05.851175 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:46:05.851175 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:46:05.851175 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:46:05.851175 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:46:05.851175 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:05.851175 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20072a0e-36ce-4bc7-b83e-7d88340ab50c could not be found. Oct 29 02:46:05.851175 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:05.851175 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:05.851175 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:05.851175 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:05.851175 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:05.851175 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:05.851175 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:05.851175 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:05.851175 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20072a0e-36ce-4bc7-b83e-7d88340ab50c could not be found. Oct 29 02:46:05.851175 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:05.853193 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-81ec294a-d8c7-46f5-bc89-5a1436af1ee0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Returning 404 to user: Instance 20072a0e-36ce-4bc7-b83e-7d88340ab50c could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:05.854382 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-81ec294a-d8c7-46f5-bc89-5a1436af1ee0 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] 10.222.0.46 "GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c" status: 404 len: 111 microversion: 2.1 time: 0.044044 Oct 29 02:46:05.855282 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 124/244] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:05 2022] GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:05.866826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b226e4c9-b4c2-4d84-b720-083d35f12fc4 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862967-2"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:05.885637 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b226e4c9-b4c2-4d84-b720-083d35f12fc4 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:05.886742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b226e4c9-b4c2-4d84-b720-083d35f12fc4 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:05.887401 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b226e4c9-b4c2-4d84-b720-083d35f12fc4 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:05.969596 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5dae8c50-043b-4563-998a-2740997f6538 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:05.970315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5dae8c50-043b-4563-998a-2740997f6538 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:05.984457 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5dae8c50-043b-4563-998a-2740997f6538 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:05.985032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5dae8c50-043b-4563-998a-2740997f6538 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:05.985601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5dae8c50-043b-4563-998a-2740997f6538 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:05.986314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5dae8c50-043b-4563-998a-2740997f6538 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:05.988237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5dae8c50-043b-4563-998a-2740997f6538 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:05.989439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5dae8c50-043b-4563-998a-2740997f6538 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:06.081363 n-d-862967-2 devstack@n-api.service[127125]: WARNING nova.scheduler.client.report [None req-b226e4c9-b4c2-4d84-b720-083d35f12fc4 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] [req-5c41ea74-ae02-46f5-aab7-5fa37a77390f] Failed to update aggregates to [] for resource provider with UUID bd4d1929-291e-48b1-b33e-c7b381ce9470. Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Resource provider's generation already changed. Please update the generation and try again. ", "request_id": "req-5c41ea74-ae02-46f5-aab7-5fa37a77390f"}]} Oct 29 02:46:06.290118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5dae8c50-043b-4563-998a-2740997f6538 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:06.309223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5dae8c50-043b-4563-998a-2740997f6538 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:06.314892 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5dae8c50-043b-4563-998a-2740997f6538 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:06.318774 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5dae8c50-043b-4563-998a-2740997f6538 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 200 len: 1384 microversion: 2.25 time: 0.356435 Oct 29 02:46:06.322493 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 125/245] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:05 2022] GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 1384 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:46:06.340965 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b226e4c9-b4c2-4d84-b720-083d35f12fc4 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 299 microversion: 2.1 time: 0.462139 Oct 29 02:46:06.344001 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 121/246] 10.222.0.46 () {60 vars in 1191 bytes} [Sat Oct 29 02:46:05 2022] POST /compute/v2.1/os-aggregates/3/action => generated 299 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:46:06.355795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-359cab98-d4c0-4409-965d-39df5644fb8c tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:06.364714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=13 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:06.386028 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-359cab98-d4c0-4409-965d-39df5644fb8c tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.034643 Oct 29 02:46:06.392365 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 126/247] 10.222.0.46 () {58 vars in 1152 bytes} [Sat Oct 29 02:46:06 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:46:06.397838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-14af7e25-07f3-475d-9f78-d8abdd0f007a tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1735349776"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:06.401963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.aggregate [None req-14af7e25-07f3-475d-9f78-d8abdd0f007a tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] Generated uuid b54035e7-5468-4383-a678-8a4d9ed5c0f0 for aggregate {{(pid=127125) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:46:06.445292 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-14af7e25-07f3-475d-9f78-d8abdd0f007a tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.051793 Oct 29 02:46:06.453159 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 122/248] 10.222.0.46 () {62 vars in 1205 bytes} [Sat Oct 29 02:46:06 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:46:06.458817 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-084ae643-91c3-48d5-8c49-227b4aa7f0c7 tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1646750575"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:06.516602 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-a00ec264-9cb6-4a3d-afab-7e0b7319e1b4 req-5643703f-2e84-4847-a997-6513fd7edb30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4180915-07c1-4365-976f-3b32fef4fc7c", "name": "network-vif-plugged", "status": "completed", "tag": "9ca84854-6604-4318-97df-c5aa881aa09a"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:06.542712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a00ec264-9cb6-4a3d-afab-7e0b7319e1b4 req-5643703f-2e84-4847-a997-6513fd7edb30 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:06.543182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a00ec264-9cb6-4a3d-afab-7e0b7319e1b4 req-5643703f-2e84-4847-a997-6513fd7edb30 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:06.543784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a00ec264-9cb6-4a3d-afab-7e0b7319e1b4 req-5643703f-2e84-4847-a997-6513fd7edb30 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:06.572749 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-a00ec264-9cb6-4a3d-afab-7e0b7319e1b4 req-5643703f-2e84-4847-a997-6513fd7edb30 service nova] Creating event network-vif-plugged:9ca84854-6604-4318-97df-c5aa881aa09a for instance c4180915-07c1-4365-976f-3b32fef4fc7c on n-h1-862967-2 Oct 29 02:46:06.589699 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-a00ec264-9cb6-4a3d-afab-7e0b7319e1b4 req-5643703f-2e84-4847-a997-6513fd7edb30 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079373 Oct 29 02:46:06.593218 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 123/249] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:46:06.685585 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-166edad9-94ae-4633-ae4b-e34bc13eb28a tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:06.686312 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-166edad9-94ae-4633-ae4b-e34bc13eb28a tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: c4180915-07c1-4365-976f-3b32fef4fc7c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:06.702950 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-166edad9-94ae-4633-ae4b-e34bc13eb28a tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:06.703682 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-166edad9-94ae-4633-ae4b-e34bc13eb28a tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:06.704868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-166edad9-94ae-4633-ae4b-e34bc13eb28a tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:06.705807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-166edad9-94ae-4633-ae4b-e34bc13eb28a tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:06.706461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-166edad9-94ae-4633-ae4b-e34bc13eb28a tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:06.707047 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-166edad9-94ae-4633-ae4b-e34bc13eb28a tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:06.744559 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-084ae643-91c3-48d5-8c49-227b4aa7f0c7 tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-aggregates/8" status: 200 len: 299 microversion: 2.41 time: 0.290140 Oct 29 02:46:06.749239 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 127/250] 10.222.0.46 () {62 vars in 1210 bytes} [Sat Oct 29 02:46:06 2022] PUT /compute/v2.1/os-aggregates/8 => generated 299 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:46:06.781708 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a25325ed-cabc-4f8c-8cbc-c72a2af28b19 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:06.782757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a25325ed-cabc-4f8c-8cbc-c72a2af28b19 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] [instance: 59d3322c-0cf9-4251-8af6-7afbd4d249e5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:06.815888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a25325ed-cabc-4f8c-8cbc-c72a2af28b19 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:06.817135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a25325ed-cabc-4f8c-8cbc-c72a2af28b19 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:06.817951 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a25325ed-cabc-4f8c-8cbc-c72a2af28b19 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:06.820134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a25325ed-cabc-4f8c-8cbc-c72a2af28b19 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:06.821360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a25325ed-cabc-4f8c-8cbc-c72a2af28b19 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:06.822144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a25325ed-cabc-4f8c-8cbc-c72a2af28b19 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:06.942394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a25325ed-cabc-4f8c-8cbc-c72a2af28b19 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ed858998a418b9948f5dc574e4ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89eadfa2b6054a58846e342008ab17da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:06.953680 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a25325ed-cabc-4f8c-8cbc-c72a2af28b19 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] 10.222.0.46 "GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5" status: 200 len: 1273 microversion: 2.1 time: 0.201380 Oct 29 02:46:06.958901 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 128/251] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:06 2022] GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5 => generated 1273 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:06.973164 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4b2eca1d-71d9-4593-9538-e5af1e63c43e tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:06.992127 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4b2eca1d-71d9-4593-9538-e5af1e63c43e tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 299 microversion: 2.41 time: 0.023296 Oct 29 02:46:06.994819 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 129/252] 10.222.0.46 () {60 vars in 1190 bytes} [Sat Oct 29 02:46:06 2022] GET /compute/v2.1/os-aggregates/8 => generated 299 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:46:07.011182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-27346c92-6d0b-4c92-adf5-eb7c2f7bd3de tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862967-2"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:07.025624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27346c92-6d0b-4c92-adf5-eb7c2f7bd3de tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:07.026367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27346c92-6d0b-4c92-adf5-eb7c2f7bd3de tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:07.027184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27346c92-6d0b-4c92-adf5-eb7c2f7bd3de tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:07.029906 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-166edad9-94ae-4633-ae4b-e34bc13eb28a tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:07.038735 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-166edad9-94ae-4633-ae4b-e34bc13eb28a tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c" status: 200 len: 1321 microversion: 2.1 time: 0.358924 Oct 29 02:46:07.039482 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 124/253] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:06 2022] GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c => generated 1321 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:07.189021 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-27346c92-6d0b-4c92-adf5-eb7c2f7bd3de tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 314 microversion: 2.41 time: 0.185004 Oct 29 02:46:07.198357 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 130/254] 10.222.0.46 () {62 vars in 1232 bytes} [Sat Oct 29 02:46:07 2022] POST /compute/v2.1/os-aggregates/8/action => generated 314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:46:07.203647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-619b3138-5c72-4628-a38b-193f6c0d9a5e tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862967-2"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:07.224292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-619b3138-5c72-4628-a38b-193f6c0d9a5e tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:07.224869 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-619b3138-5c72-4628-a38b-193f6c0d9a5e tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:07.225306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-619b3138-5c72-4628-a38b-193f6c0d9a5e tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:07.347758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c4b45277-b0d9-4a67-b0f8-ef566eedee5a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:07.348578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c4b45277-b0d9-4a67-b0f8-ef566eedee5a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:07.356891 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c4b45277-b0d9-4a67-b0f8-ef566eedee5a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:07.357226 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c4b45277-b0d9-4a67-b0f8-ef566eedee5a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:07.360253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c4b45277-b0d9-4a67-b0f8-ef566eedee5a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:07.361188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c4b45277-b0d9-4a67-b0f8-ef566eedee5a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:07.361798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c4b45277-b0d9-4a67-b0f8-ef566eedee5a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:07.362367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c4b45277-b0d9-4a67-b0f8-ef566eedee5a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:07.450532 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-619b3138-5c72-4628-a38b-193f6c0d9a5e tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 299 microversion: 2.41 time: 0.251866 Oct 29 02:46:07.451478 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 125/255] 10.222.0.46 () {62 vars in 1232 bytes} [Sat Oct 29 02:46:07 2022] POST /compute/v2.1/os-aggregates/8/action => generated 299 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 02:46:07.654747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c4b45277-b0d9-4a67-b0f8-ef566eedee5a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:07.675515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c4b45277-b0d9-4a67-b0f8-ef566eedee5a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:07.681105 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c4b45277-b0d9-4a67-b0f8-ef566eedee5a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:07.685946 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c4b45277-b0d9-4a67-b0f8-ef566eedee5a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 200 len: 1362 microversion: 2.25 time: 0.339394 Oct 29 02:46:07.688026 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 131/256] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:07 2022] GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 1362 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:07.700157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b84baa07-5213-40f9-9f32-e26a19f0cee7 tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:07.744736 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b84baa07-5213-40f9-9f32-e26a19f0cee7 tempest-AggregatesAdminTestV241-1416021644 tempest-AggregatesAdminTestV241-1416021644-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.41 time: 0.053847 Oct 29 02:46:07.745768 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 132/257] 10.222.0.46 () {60 vars in 1193 bytes} [Sat Oct 29 02:46:07 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:07.799645 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-36104902-143d-416c-bbea-4066081ec61d tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-577587595"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:07.805507 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.aggregate [None req-36104902-143d-416c-bbea-4066081ec61d tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Generated uuid dc76402a-881d-425f-a6a4-c690fcc56949 for aggregate {{(pid=127124) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:46:07.867743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-52aa2226-63db-47e6-9006-cfd046d6a19a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-906476762", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:07.881136 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-36104902-143d-416c-bbea-4066081ec61d tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.077895 Oct 29 02:46:07.882254 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 133/258] 10.222.0.46 () {60 vars in 1164 bytes} [Sat Oct 29 02:46:07 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:46:07.896641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-46cbe5c0-a4be-4ae6-92f9-036301583e14 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862967-2"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:07.913251 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46cbe5c0-a4be-4ae6-92f9-036301583e14 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:07.913879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46cbe5c0-a4be-4ae6-92f9-036301583e14 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:07.914472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46cbe5c0-a4be-4ae6-92f9-036301583e14 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:07.974260 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-52aa2226-63db-47e6-9006-cfd046d6a19a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] validate_networks() for None {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:46:08.140548 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-46cbe5c0-a4be-4ae6-92f9-036301583e14 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.248748 Oct 29 02:46:08.141427 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 134/259] 10.222.0.46 () {60 vars in 1191 bytes} [Sat Oct 29 02:46:07 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:46:08.152572 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-191af6cb-d1f1-4c8a-8f85-e13dee0b7cf2 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:08.155594 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-191af6cb-d1f1-4c8a-8f85-e13dee0b7cf2 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] [instance: 59d3322c-0cf9-4251-8af6-7afbd4d249e5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:08.169295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-191af6cb-d1f1-4c8a-8f85-e13dee0b7cf2 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:08.170212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-191af6cb-d1f1-4c8a-8f85-e13dee0b7cf2 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:08.170741 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-191af6cb-d1f1-4c8a-8f85-e13dee0b7cf2 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:08.171489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-191af6cb-d1f1-4c8a-8f85-e13dee0b7cf2 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:08.171950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-191af6cb-d1f1-4c8a-8f85-e13dee0b7cf2 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:08.172377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-191af6cb-d1f1-4c8a-8f85-e13dee0b7cf2 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:08.327052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-191af6cb-d1f1-4c8a-8f85-e13dee0b7cf2 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ed858998a418b9948f5dc574e4ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89eadfa2b6054a58846e342008ab17da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:08.337100 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-191af6cb-d1f1-4c8a-8f85-e13dee0b7cf2 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] 10.222.0.46 "GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5" status: 200 len: 1279 microversion: 2.1 time: 0.194268 Oct 29 02:46:08.338110 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 135/260] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:08 2022] GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5 => generated 1279 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:08.347437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4b8ad12d-fe9c-4483-b1a9-425e2758b33b tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:08.348863 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4b8ad12d-fe9c-4483-b1a9-425e2758b33b tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: c4180915-07c1-4365-976f-3b32fef4fc7c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:08.361773 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b8ad12d-fe9c-4483-b1a9-425e2758b33b tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:08.362264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b8ad12d-fe9c-4483-b1a9-425e2758b33b tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:08.362698 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b8ad12d-fe9c-4483-b1a9-425e2758b33b tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:08.363417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b8ad12d-fe9c-4483-b1a9-425e2758b33b tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:08.363880 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b8ad12d-fe9c-4483-b1a9-425e2758b33b tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:08.364294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b8ad12d-fe9c-4483-b1a9-425e2758b33b tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:08.574875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4b8ad12d-fe9c-4483-b1a9-425e2758b33b tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:08.585275 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4b8ad12d-fe9c-4483-b1a9-425e2758b33b tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c" status: 200 len: 1321 microversion: 2.1 time: 0.245975 Oct 29 02:46:08.585853 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 136/261] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:08 2022] GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:08.600613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a4c7888d-cf3f-4b0f-8dd0-a5419fd188c0 tempest-AggregatesAdminNegativeTestJSON-403218376 tempest-AggregatesAdminNegativeTestJSON-403218376-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862967-2"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:08.605423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a4c7888d-cf3f-4b0f-8dd0-a5419fd188c0 tempest-AggregatesAdminNegativeTestJSON-403218376 tempest-AggregatesAdminNegativeTestJSON-403218376-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'c961002e41414df5bc0221bdf7fb280d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4ad7859f394422abaadf6deb81a9752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:08.607654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a4c7888d-cf3f-4b0f-8dd0-a5419fd188c0 tempest-AggregatesAdminNegativeTestJSON-403218376 tempest-AggregatesAdminNegativeTestJSON-403218376-project] Request method failure captured: Oct 29 02:46:08.607654 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Oct 29 02:46:08.607654 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:46:08.607654 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:46:08.607654 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:46:08.607654 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 42 Oct 29 02:46:08.607654 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:46:08.607654 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:46:08.607654 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:46:08.607654 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:08.607654 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPB4S28dCyzCv4-q84mlKV6urxO7FgUHDpfMiQ23jOywiUnnPNu2GINhuCL6wOTXKxEqfuJYpESJZ3BJQovv7mJcPNwUXVNK4Av02PFsHAJUh4IFybm1TuH0tqZlJKM_OfSNtwKiroZ1G-Q0ulSwfszrxP5r6SZgL8HRZGYEXe_k90 Oct 29 02:46:08.607654 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:46:08.607654 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:46:08.607654 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:46:08.607654 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:46:08.607654 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:46:08.607654 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:46:08.607654 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: e4ad7859f394422abaadf6deb81a9752 Oct 29 02:46:08.607654 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-403218376 Oct 29 02:46:08.607654 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:46:08.607654 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:46:08.609113 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e4ad7859f394422abaadf6deb81a9752"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e4ad7859f394422abaadf6deb81a9752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e4ad7859f394422abaadf6deb81a9752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e4ad7859f394422abaadf6deb81a9752"}]}] Oct 29 02:46:08.609113 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-403218376 Oct 29 02:46:08.609113 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: e4ad7859f394422abaadf6deb81a9752 Oct 29 02:46:08.609113 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-403218376 Oct 29 02:46:08.609113 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-AggregatesAdminNegativeTestJSON-403218376-project Oct 29 02:46:08.609113 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:46:08.609113 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:46:08.609113 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: c961002e41414df5bc0221bdf7fb280d Oct 29 02:46:08.609113 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-403218376-project Oct 29 02:46:08.609113 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:46:08.609113 n-d-862967-2 devstack@n-api.service[127124]: {"remove_host": {"host": "n-h2-862967-2"}} Oct 29 02:46:08.609113 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:46:08.609113 n-d-862967-2 devstack@n-api.service[127124]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 29 02:46:08.610025 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '9', 'body': {'remove_host': {'host': 'n-h2-862967-2'}}} Oct 29 02:46:08.610025 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:08.610025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:08.610025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:08.610025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:08.610025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:08.610025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:08.610025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:08.610025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:08.610025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:46:08.610025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:08.610025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 29 02:46:08.610025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 29 02:46:08.610025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:46:08.610025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:46:08.610025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:46:08.610025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:46:08.610025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:46:08.610025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:46:08.611223 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:46:08.611223 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:46:08.611223 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:46:08.611223 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:46:08.611223 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:46:08.611223 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:46:08.611223 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:46:08.611223 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:46:08.611223 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 29 02:46:08.611223 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:08.611223 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:08.611223 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:08.611223 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:08.611223 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:08.611223 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:08.611223 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:46:08.611223 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:46:08.611223 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 29 02:46:08.611223 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:08.613856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a4c7888d-cf3f-4b0f-8dd0-a5419fd188c0 tempest-AggregatesAdminNegativeTestJSON-403218376 tempest-AggregatesAdminNegativeTestJSON-403218376-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:08.621022 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a4c7888d-cf3f-4b0f-8dd0-a5419fd188c0 tempest-AggregatesAdminNegativeTestJSON-403218376 tempest-AggregatesAdminNegativeTestJSON-403218376-project] 10.222.0.46 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 121 microversion: 2.1 time: 0.024458 Oct 29 02:46:08.621600 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 137/262] 10.222.0.46 () {60 vars in 1191 bytes} [Sat Oct 29 02:46:08 2022] POST /compute/v2.1/os-aggregates/9/action => generated 121 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:08.629973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bd494f54-ccc4-4930-9f8a-3f6590c10d2d tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862967-2"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:08.642958 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd494f54-ccc4-4930-9f8a-3f6590c10d2d tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:08.643811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd494f54-ccc4-4930-9f8a-3f6590c10d2d tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:08.644351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd494f54-ccc4-4930-9f8a-3f6590c10d2d tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:08.690473 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-52aa2226-63db-47e6-9006-cfd046d6a19a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:46:08.690938 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-52aa2226-63db-47e6-9006-cfd046d6a19a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:46:08.691498 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-52aa2226-63db-47e6-9006-cfd046d6a19a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:46:08.692033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-52aa2226-63db-47e6-9006-cfd046d6a19a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:46:08.692510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-52aa2226-63db-47e6-9006-cfd046d6a19a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:46:08.733526 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52aa2226-63db-47e6-9006-cfd046d6a19a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:08.735089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52aa2226-63db-47e6-9006-cfd046d6a19a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:08.735765 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52aa2226-63db-47e6-9006-cfd046d6a19a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:08.737201 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52aa2226-63db-47e6-9006-cfd046d6a19a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:08.737951 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52aa2226-63db-47e6-9006-cfd046d6a19a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:08.739056 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52aa2226-63db-47e6-9006-cfd046d6a19a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:08.788323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-52aa2226-63db-47e6-9006-cfd046d6a19a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for project dcc6da8e69e041e19023a53a23e33393. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:46:08.794974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-52aa2226-63db-47e6-9006-cfd046d6a19a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for user 509ce04aeb3847f084629201bd7ae5d6 and project dcc6da8e69e041e19023a53a23e33393. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:46:08.821129 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bd494f54-ccc4-4930-9f8a-3f6590c10d2d tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.194951 Oct 29 02:46:08.824264 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 138/263] 10.222.0.46 () {60 vars in 1191 bytes} [Sat Oct 29 02:46:08 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:08.862120 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a2e42a3c-0bea-4abf-b8b0-a45e8bc337b8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:08.862985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a2e42a3c-0bea-4abf-b8b0-a45e8bc337b8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:08.874273 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-52aa2226-63db-47e6-9006-cfd046d6a19a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:46:08.878322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2e42a3c-0bea-4abf-b8b0-a45e8bc337b8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:08.880494 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2e42a3c-0bea-4abf-b8b0-a45e8bc337b8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:08.881714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2e42a3c-0bea-4abf-b8b0-a45e8bc337b8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:08.883998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2e42a3c-0bea-4abf-b8b0-a45e8bc337b8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:08.884768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2e42a3c-0bea-4abf-b8b0-a45e8bc337b8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:08.886806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-52aa2226-63db-47e6-9006-cfd046d6a19a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: b65a6807-c8ad-44d0-93d7-931037ca8afd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:46:08.887077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2e42a3c-0bea-4abf-b8b0-a45e8bc337b8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:09.018705 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-52aa2226-63db-47e6-9006-cfd046d6a19a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.565958 Oct 29 02:46:09.019334 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 126/264] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:46:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:46:09.032347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5c99252b-612c-494d-8721-0df214a34af0 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:09.060412 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=12 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:09.085573 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:09.123795 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5c99252b-612c-494d-8721-0df214a34af0 tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.098909 Oct 29 02:46:09.126165 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 127/265] 10.222.0.46 () {58 vars in 1152 bytes} [Sat Oct 29 02:46:09 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:46:09.139348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-559f8bf7-e2a7-4780-b0cc-fa8468b64e90 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:09.144066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-559f8bf7-e2a7-4780-b0cc-fa8468b64e90 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: b65a6807-c8ad-44d0-93d7-931037ca8afd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:09.310951 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-559f8bf7-e2a7-4780-b0cc-fa8468b64e90 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:09.319192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a2e42a3c-0bea-4abf-b8b0-a45e8bc337b8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:09.320413 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-559f8bf7-e2a7-4780-b0cc-fa8468b64e90 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/b65a6807-c8ad-44d0-93d7-931037ca8afd" status: 200 len: 1216 microversion: 2.1 time: 0.191747 Oct 29 02:46:09.321037 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 128/266] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:09 2022] GET /compute/v2.1/servers/b65a6807-c8ad-44d0-93d7-931037ca8afd => generated 1216 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:09.337359 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a2e42a3c-0bea-4abf-b8b0-a45e8bc337b8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:09.344208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cf1187af-663f-4926-9481-41c50ac2207d tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1272355391"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:09.348190 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.aggregate [None req-cf1187af-663f-4926-9481-41c50ac2207d tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Generated uuid 798994d6-bd4c-4ab9-ac94-8310fa6d42aa for aggregate {{(pid=127125) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:46:09.348977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a2e42a3c-0bea-4abf-b8b0-a45e8bc337b8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:09.350862 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a2e42a3c-0bea-4abf-b8b0-a45e8bc337b8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 200 len: 1362 microversion: 2.25 time: 0.524672 Oct 29 02:46:09.352470 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 139/267] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:08 2022] GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 1362 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:09.364571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ed9afb35-4f51-453b-9266-c5d9548cbf40 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1434591605"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:09.395042 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.aggregate [None req-ed9afb35-4f51-453b-9266-c5d9548cbf40 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Generated uuid c459ad18-8a9e-4765-8b71-c4046e938a36 for aggregate {{(pid=127124) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:46:09.400735 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cf1187af-663f-4926-9481-41c50ac2207d tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.060722 Oct 29 02:46:09.406179 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 129/268] 10.222.0.46 () {60 vars in 1164 bytes} [Sat Oct 29 02:46:09 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:09.411088 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f7668f3d-e414-435a-9d0a-fc61b1a6c995 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:09.411723 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f7668f3d-e414-435a-9d0a-fc61b1a6c995 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] [instance: 59d3322c-0cf9-4251-8af6-7afbd4d249e5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:09.431695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f7668f3d-e414-435a-9d0a-fc61b1a6c995 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:09.432290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f7668f3d-e414-435a-9d0a-fc61b1a6c995 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:09.432875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f7668f3d-e414-435a-9d0a-fc61b1a6c995 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:09.433638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f7668f3d-e414-435a-9d0a-fc61b1a6c995 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:09.434193 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f7668f3d-e414-435a-9d0a-fc61b1a6c995 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:09.434685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f7668f3d-e414-435a-9d0a-fc61b1a6c995 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:09.460255 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ed9afb35-4f51-453b-9266-c5d9548cbf40 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.105343 Oct 29 02:46:09.462962 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 140/269] 10.222.0.46 () {60 vars in 1164 bytes} [Sat Oct 29 02:46:09 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:09.497005 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-46c028a5-ec5b-4901-8a1a-498b4685762d tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:09.536116 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46c028a5-ec5b-4901-8a1a-498b4685762d tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:09.540817 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46c028a5-ec5b-4901-8a1a-498b4685762d tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:09.541570 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46c028a5-ec5b-4901-8a1a-498b4685762d tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:09.576062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46c028a5-ec5b-4901-8a1a-498b4685762d tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:09.577678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46c028a5-ec5b-4901-8a1a-498b4685762d tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:09.579406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46c028a5-ec5b-4901-8a1a-498b4685762d tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:09.600982 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.compute.aggregates [None req-46c028a5-ec5b-4901-8a1a-498b4685762d tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Failed to remove host nonexist_host from aggregate 10. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 29 02:46:09.602712 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-46c028a5-ec5b-4901-8a1a-498b4685762d tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 10 Oct 29 02:46:09.608399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-46c028a5-ec5b-4901-8a1a-498b4685762d tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Request method failure captured: Oct 29 02:46:09.608399 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Oct 29 02:46:09.608399 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:46:09.608399 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:46:09.608399 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:46:09.608399 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 42 Oct 29 02:46:09.608399 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:46:09.608399 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:46:09.608399 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:46:09.608399 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:09.608399 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPDJHoPSph0mXghkoG6vy4vKHJZH77qG9bcMyfjywW6JAS8osJl8LD8SzWcW3koajwzuX4iwzga21FerzbBBWNrHdMQBc-wAAbh_cJ6gnTF2ky66Su9Wl91yHCdV0dWk_S6JUOv40VKsJnvyQvn6xLjRa5B_88CFdht5Iv6AmL3EHU Oct 29 02:46:09.608399 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:46:09.608399 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:46:09.608399 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:46:09.608399 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:46:09.608399 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:46:09.608399 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:46:09.608399 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: f8795036569b4371b4373c011fce41f8 Oct 29 02:46:09.608399 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-895326194 Oct 29 02:46:09.608399 n-d-862967-2 devstack@n-api.service[127124]: X-Role: admin,reader,member Oct 29 02:46:09.608399 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: admin,reader,member Oct 29 02:46:09.609583 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f8795036569b4371b4373c011fce41f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f8795036569b4371b4373c011fce41f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f8795036569b4371b4373c011fce41f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f8795036569b4371b4373c011fce41f8"}]}] Oct 29 02:46:09.609583 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-895326194 Oct 29 02:46:09.609583 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: f8795036569b4371b4373c011fce41f8 Oct 29 02:46:09.609583 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-895326194 Oct 29 02:46:09.609583 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin Oct 29 02:46:09.609583 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:46:09.609583 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:46:09.609583 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 809ed92fc1114568bd929eab1819af1f Oct 29 02:46:09.609583 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin Oct 29 02:46:09.609583 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:46:09.609583 n-d-862967-2 devstack@n-api.service[127124]: {"remove_host": {"host": "nonexist_host"}} Oct 29 02:46:09.609583 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:46:09.609583 n-d-862967-2 devstack@n-api.service[127124]: exception: Cannot remove host nonexist_host in aggregate 10 Oct 29 02:46:09.610273 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '10', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 29 02:46:09.610273 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:09.610273 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:09.610273 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 29 02:46:09.610273 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 29 02:46:09.610273 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:46:09.610273 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:46:09.610273 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 29 02:46:09.610273 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 29 02:46:09.610273 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:46:09.610273 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:46:09.610273 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 29 02:46:09.610273 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 29 02:46:09.610273 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 29 02:46:09.610273 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:09.610273 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:09.610273 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:09.610273 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:09.610273 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 29 02:46:09.610273 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 29 02:46:09.611310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 29 02:46:09.611310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 29 02:46:09.611310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 29 02:46:09.611310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:09.611310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:09.611310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:09.611310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:09.611310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 29 02:46:09.611310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 29 02:46:09.611310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 02:46:09.611310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 02:46:09.611310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:46:09.611310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:46:09.611310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:46:09.611310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:46:09.611310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 02:46:09.611310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 02:46:09.611310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 29 02:46:09.611310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 29 02:46:09.611310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 29 02:46:09.614313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 29 02:46:09.614313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 29 02:46:09.614313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:09.614313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:09.614313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:09.614313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:09.614313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:09.614313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:09.614313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:09.614313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:09.614313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:09.614313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:09.614313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:46:09.614313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:09.614313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 29 02:46:09.614313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 02:46:09.614313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 10 Oct 29 02:46:09.614313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:09.614313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:09.614313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:09.614313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:09.617520 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:09.617520 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:09.617520 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:09.617520 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:09.617520 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 10 Oct 29 02:46:09.617520 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:09.619207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-46c028a5-ec5b-4901-8a1a-498b4685762d tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 10 {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:09.620671 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-46c028a5-ec5b-4901-8a1a-498b4685762d tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/10/action" status: 404 len: 94 microversion: 2.1 time: 0.141483 Oct 29 02:46:09.621886 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 141/270] 10.222.0.46 () {60 vars in 1194 bytes} [Sat Oct 29 02:46:09 2022] POST /compute/v2.1/os-aggregates/10/action => generated 94 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:46:09.627720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8b6d250a-7335-4d6e-bc26-c29443045850 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862967-2"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:09.642033 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b6d250a-7335-4d6e-bc26-c29443045850 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:09.642717 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b6d250a-7335-4d6e-bc26-c29443045850 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:09.643447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b6d250a-7335-4d6e-bc26-c29443045850 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:09.915669 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8b6d250a-7335-4d6e-bc26-c29443045850 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.291667 Oct 29 02:46:09.916637 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 142/271] 10.222.0.46 () {60 vars in 1194 bytes} [Sat Oct 29 02:46:09 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:09.921623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-117f7288-5b81-4aa0-9bf9-30c71d1d4a98 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:09.926308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-117f7288-5b81-4aa0-9bf9-30c71d1d4a98 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: c4180915-07c1-4365-976f-3b32fef4fc7c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:09.950348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-117f7288-5b81-4aa0-9bf9-30c71d1d4a98 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:09.957486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-117f7288-5b81-4aa0-9bf9-30c71d1d4a98 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:09.958380 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-117f7288-5b81-4aa0-9bf9-30c71d1d4a98 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:09.959402 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-117f7288-5b81-4aa0-9bf9-30c71d1d4a98 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:09.959983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-117f7288-5b81-4aa0-9bf9-30c71d1d4a98 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:09.960508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-117f7288-5b81-4aa0-9bf9-30c71d1d4a98 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:10.180013 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f7668f3d-e414-435a-9d0a-fc61b1a6c995 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ed858998a418b9948f5dc574e4ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89eadfa2b6054a58846e342008ab17da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:10.208011 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f7668f3d-e414-435a-9d0a-fc61b1a6c995 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] 10.222.0.46 "GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5" status: 200 len: 1321 microversion: 2.1 time: 0.800582 Oct 29 02:46:10.212287 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 130/272] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:09 2022] GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5 => generated 1321 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:10.242665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5de7ddce-7f4f-4747-9e07-522b0c051c2e tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:10.273543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=8,nova_api:INSERT=8 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:10.313707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-117f7288-5b81-4aa0-9bf9-30c71d1d4a98 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:10.324456 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-117f7288-5b81-4aa0-9bf9-30c71d1d4a98 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c" status: 200 len: 1471 microversion: 2.1 time: 0.406664 Oct 29 02:46:10.325964 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 143/273] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:09 2022] GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c => generated 1471 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:10.334923 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-779b0be5-2bee-4b40-984a-1ed70f31c3ce tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:10.346648 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-779b0be5-2bee-4b40-984a-1ed70f31c3ce tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/11" status: 200 len: 243 microversion: 2.1 time: 0.018964 Oct 29 02:46:10.347579 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 144/274] 10.222.0.46 () {58 vars in 1152 bytes} [Sat Oct 29 02:46:10 2022] GET /compute/v2.1/os-aggregates/11 => generated 243 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:10.353516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-18fdc991-777e-41ae-bdad-891d1c76a899 req-560182bb-ac41-40dc-920b-66873adc6f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed", "name": "network-vif-plugged", "status": "completed", "tag": "ca4ed483-67be-4b3f-884e-48df58de6a0e"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:10.365528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-18fdc991-777e-41ae-bdad-891d1c76a899 req-560182bb-ac41-40dc-920b-66873adc6f41 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:10.367729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-18fdc991-777e-41ae-bdad-891d1c76a899 req-560182bb-ac41-40dc-920b-66873adc6f41 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:10.368538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-18fdc991-777e-41ae-bdad-891d1c76a899 req-560182bb-ac41-40dc-920b-66873adc6f41 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:10.382486 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-18fdc991-777e-41ae-bdad-891d1c76a899 req-560182bb-ac41-40dc-920b-66873adc6f41 service nova] Creating event network-vif-plugged:ca4ed483-67be-4b3f-884e-48df58de6a0e for instance 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed on n-h2-862967-2 Oct 29 02:46:10.384508 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5de7ddce-7f4f-4747-9e07-522b0c051c2e tempest-AggregatesAdminNegativeTestJSON-895326194 tempest-AggregatesAdminNegativeTestJSON-895326194-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.169275 Oct 29 02:46:10.385803 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 131/275] 10.222.0.46 () {58 vars in 1155 bytes} [Sat Oct 29 02:46:10 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:46:10.394324 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-18fdc991-777e-41ae-bdad-891d1c76a899 req-560182bb-ac41-40dc-920b-66873adc6f41 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044642 Oct 29 02:46:10.396325 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 145/276] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:10.404150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dc3c615d-be9d-433b-96b9-d12a562177d8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:10.405250 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dc3c615d-be9d-433b-96b9-d12a562177d8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: b65a6807-c8ad-44d0-93d7-931037ca8afd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:10.418811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc3c615d-be9d-433b-96b9-d12a562177d8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:10.420152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc3c615d-be9d-433b-96b9-d12a562177d8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:10.420778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc3c615d-be9d-433b-96b9-d12a562177d8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:10.421849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc3c615d-be9d-433b-96b9-d12a562177d8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:10.422811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc3c615d-be9d-433b-96b9-d12a562177d8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:10.423478 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc3c615d-be9d-433b-96b9-d12a562177d8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:10.567215 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dc3c615d-be9d-433b-96b9-d12a562177d8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:10.578829 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dc3c615d-be9d-433b-96b9-d12a562177d8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/b65a6807-c8ad-44d0-93d7-931037ca8afd" status: 200 len: 1268 microversion: 2.1 time: 0.190837 Oct 29 02:46:10.580834 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 132/277] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:10 2022] GET /compute/v2.1/servers/b65a6807-c8ad-44d0-93d7-931037ca8afd => generated 1268 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:10.616995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-449b1bac-8d5c-4ca0-8e4f-86fd9f94a453 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862967-2"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:10.648384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-449b1bac-8d5c-4ca0-8e4f-86fd9f94a453 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:10.653787 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-449b1bac-8d5c-4ca0-8e4f-86fd9f94a453 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:10.654503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-449b1bac-8d5c-4ca0-8e4f-86fd9f94a453 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:10.985434 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-449b1bac-8d5c-4ca0-8e4f-86fd9f94a453 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.402650 Oct 29 02:46:10.993406 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 133/278] 10.222.0.46 () {60 vars in 1194 bytes} [Sat Oct 29 02:46:10 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:10.994757 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5e9e933c-684f-456c-ab59-626750d5b8a6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:10.995655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5e9e933c-684f-456c-ab59-626750d5b8a6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:11.004965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e9e933c-684f-456c-ab59-626750d5b8a6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:11.005588 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e9e933c-684f-456c-ab59-626750d5b8a6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:11.006620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e9e933c-684f-456c-ab59-626750d5b8a6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:11.008468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e9e933c-684f-456c-ab59-626750d5b8a6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:11.009164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e9e933c-684f-456c-ab59-626750d5b8a6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:11.009881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e9e933c-684f-456c-ab59-626750d5b8a6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:11.125829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9101f047-9387-4a8a-a752-1ce89be05200 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:11.126477 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9101f047-9387-4a8a-a752-1ce89be05200 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] [instance: 4edca91c-feb3-4e38-9f23-43499888ed21] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:11.135871 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-9101f047-9387-4a8a-a752-1ce89be05200 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] HTTP exception thrown: Instance 4edca91c-feb3-4e38-9f23-43499888ed21 could not be found. Oct 29 02:46:11.142491 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9101f047-9387-4a8a-a752-1ce89be05200 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Request method failure captured: Oct 29 02:46:11.142491 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers/4edca91c-feb3-4e38-9f23-43499888ed21/action HTTP/1.1 Oct 29 02:46:11.142491 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:46:11.142491 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:46:11.142491 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:46:11.142491 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 15 Oct 29 02:46:11.142491 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:46:11.142491 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:46:11.142491 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:46:11.142491 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:11.142491 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPbU7OQUl7VOp0tcplOyHR8kKwQApRnIhoHO1sn8lpi0eUVKbi2DZkmroo3Lbt3M9TGxTLe1C7txOomXOGFWlLNyM07k9U4bMrnKUX06_jy0E672wylVHo4ZWYi1Y3yVSzgQBKQt1ZkNqxoa7AbzJF8ndF7AHmztstx2MHbb9qHQLA Oct 29 02:46:11.142491 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:46:11.142491 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:46:11.142491 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:46:11.142491 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:46:11.142491 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:46:11.142491 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:46:11.142491 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: d954806aa68841e6a76ac40ac99d67ff Oct 29 02:46:11.142491 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-386500486 Oct 29 02:46:11.142491 n-d-862967-2 devstack@n-api.service[127124]: X-Role: admin,reader,member Oct 29 02:46:11.142491 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: admin,reader,member Oct 29 02:46:11.143713 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d954806aa68841e6a76ac40ac99d67ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d954806aa68841e6a76ac40ac99d67ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d954806aa68841e6a76ac40ac99d67ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d954806aa68841e6a76ac40ac99d67ff"}]}] Oct 29 02:46:11.143713 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersAdminNegativeTestJSON-386500486 Oct 29 02:46:11.143713 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: d954806aa68841e6a76ac40ac99d67ff Oct 29 02:46:11.143713 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-386500486 Oct 29 02:46:11.143713 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersAdminNegativeTestJSON-386500486-project-admin Oct 29 02:46:11.143713 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:46:11.143713 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:46:11.143713 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 3a3d02ad5c324be6861e6b6545bfe5d3 Oct 29 02:46:11.143713 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersAdminNegativeTestJSON-386500486-project-admin Oct 29 02:46:11.143713 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:46:11.143713 n-d-862967-2 devstack@n-api.service[127124]: {"migrate": {}} Oct 29 02:46:11.143713 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:46:11.143713 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 4edca91c-feb3-4e38-9f23-43499888ed21 could not be found. Oct 29 02:46:11.144439 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '4edca91c-feb3-4e38-9f23-43499888ed21', 'body': {'migrate': {}}} Oct 29 02:46:11.144439 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:11.144439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:11.144439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:46:11.144439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:46:11.144439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:46:11.144439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:46:11.144439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 02:46:11.144439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 02:46:11.144439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4edca91c-feb3-4e38-9f23-43499888ed21 could not be found. Oct 29 02:46:11.144439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:11.144439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:11.144439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:11.144439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:11.144439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:11.144439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:11.144439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:11.144439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:11.144439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:11.144439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:11.145651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:46:11.145651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:11.145651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 29 02:46:11.145651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 29 02:46:11.145651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:46:11.145651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:11.145651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4edca91c-feb3-4e38-9f23-43499888ed21 could not be found. Oct 29 02:46:11.145651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:11.145651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:11.145651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:11.145651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:11.145651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:11.145651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:11.145651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:11.145651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:11.145651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4edca91c-feb3-4e38-9f23-43499888ed21 could not be found. Oct 29 02:46:11.145651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:11.148674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9101f047-9387-4a8a-a752-1ce89be05200 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Returning 404 to user: Instance 4edca91c-feb3-4e38-9f23-43499888ed21 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:11.150601 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9101f047-9387-4a8a-a752-1ce89be05200 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/4edca91c-feb3-4e38-9f23-43499888ed21/action" status: 404 len: 111 microversion: 2.1 time: 0.750814 Oct 29 02:46:11.152945 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 146/279] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:46:10 2022] POST /compute/v2.1/servers/4edca91c-feb3-4e38-9f23-43499888ed21/action => generated 111 bytes in 755 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:11.170702 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-220ffeef-4dde-47ec-93a3-77b798d13f51 req-af0c9ee2-1165-46c4-a916-d33d26752ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59d3322c-0cf9-4251-8af6-7afbd4d249e5", "tag": "fab8f890-e688-45b0-9679-3fcfe3b21ed1"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:11.188170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-220ffeef-4dde-47ec-93a3-77b798d13f51 req-af0c9ee2-1165-46c4-a916-d33d26752ea0 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:11.191256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-220ffeef-4dde-47ec-93a3-77b798d13f51 req-af0c9ee2-1165-46c4-a916-d33d26752ea0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:11.192558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-220ffeef-4dde-47ec-93a3-77b798d13f51 req-af0c9ee2-1165-46c4-a916-d33d26752ea0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:11.215022 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-220ffeef-4dde-47ec-93a3-77b798d13f51 req-af0c9ee2-1165-46c4-a916-d33d26752ea0 service nova] Creating event network-changed:fab8f890-e688-45b0-9679-3fcfe3b21ed1 for instance 59d3322c-0cf9-4251-8af6-7afbd4d249e5 on n-h2-862967-2 Oct 29 02:46:11.239870 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-220ffeef-4dde-47ec-93a3-77b798d13f51 req-af0c9ee2-1165-46c4-a916-d33d26752ea0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083956 Oct 29 02:46:11.242374 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 147/280] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:11.251507 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-715d93b6-6dca-4e9c-8114-41f484123c4e tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:11.339128 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-715d93b6-6dca-4e9c-8114-41f484123c4e tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.092995 Oct 29 02:46:11.342359 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 148/281] 10.222.0.46 () {58 vars in 1155 bytes} [Sat Oct 29 02:46:11 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:46:11.358437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5c8abf33-e47b-45f7-9934-2e536a5c2e0e tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:11.366727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5c8abf33-e47b-45f7-9934-2e536a5c2e0e tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] [instance: 59d3322c-0cf9-4251-8af6-7afbd4d249e5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:11.385137 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5e9e933c-684f-456c-ab59-626750d5b8a6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:11.391224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c8abf33-e47b-45f7-9934-2e536a5c2e0e tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:11.391720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c8abf33-e47b-45f7-9934-2e536a5c2e0e tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:11.393693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5e9e933c-684f-456c-ab59-626750d5b8a6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:11.395087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c8abf33-e47b-45f7-9934-2e536a5c2e0e tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:11.395228 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5e9e933c-684f-456c-ab59-626750d5b8a6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:11.396271 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5e9e933c-684f-456c-ab59-626750d5b8a6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 200 len: 1362 microversion: 2.25 time: 0.408025 Oct 29 02:46:11.397625 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c8abf33-e47b-45f7-9934-2e536a5c2e0e tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:11.399459 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c8abf33-e47b-45f7-9934-2e536a5c2e0e tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:11.401050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c8abf33-e47b-45f7-9934-2e536a5c2e0e tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:11.421444 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 134/282] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:10 2022] GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 1362 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:11.427176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-61bbafdb-3e57-45df-846b-f412666baa5b tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-567260652"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:11.430777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.aggregate [None req-61bbafdb-3e57-45df-846b-f412666baa5b tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Generated uuid 8339dd60-a7de-4b10-b42c-3c37acdfc8ce for aggregate {{(pid=127125) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:46:11.460498 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-61bbafdb-3e57-45df-846b-f412666baa5b tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.037617 Oct 29 02:46:11.462299 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 135/283] 10.222.0.46 () {60 vars in 1164 bytes} [Sat Oct 29 02:46:11 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:11.478676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3300322f-d5f4-4774-854f-52f815f892ba tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-823190501", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:11.593252 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-3300322f-d5f4-4774-854f-52f815f892ba tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] validate_networks() for None {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:46:11.930628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5c8abf33-e47b-45f7-9934-2e536a5c2e0e tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ed858998a418b9948f5dc574e4ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89eadfa2b6054a58846e342008ab17da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:11.943879 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5c8abf33-e47b-45f7-9934-2e536a5c2e0e tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] 10.222.0.46 "GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5" status: 200 len: 1321 microversion: 2.1 time: 0.599802 Oct 29 02:46:11.962308 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 149/284] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:11 2022] GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5 => generated 1321 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:11.962308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-87b570fd-09ca-45e9-93aa-8a8eebca7bc6 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862967-2"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:11.973410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87b570fd-09ca-45e9-93aa-8a8eebca7bc6 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:11.973906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87b570fd-09ca-45e9-93aa-8a8eebca7bc6 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:11.974338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87b570fd-09ca-45e9-93aa-8a8eebca7bc6 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:12.014673 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=7,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:12.208444 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-87b570fd-09ca-45e9-93aa-8a8eebca7bc6 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 242 microversion: 2.1 time: 0.258063 Oct 29 02:46:12.209799 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 150/285] 10.222.0.46 () {60 vars in 1194 bytes} [Sat Oct 29 02:46:11 2022] POST /compute/v2.1/os-aggregates/12/action => generated 242 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:12.221188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b9cdb30d-948b-44f2-af44-4440e798dfca tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:12.221996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b9cdb30d-948b-44f2-af44-4440e798dfca tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: b65a6807-c8ad-44d0-93d7-931037ca8afd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:12.251166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b9cdb30d-948b-44f2-af44-4440e798dfca tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:12.254944 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b9cdb30d-948b-44f2-af44-4440e798dfca tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:12.255711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b9cdb30d-948b-44f2-af44-4440e798dfca tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:12.262053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b9cdb30d-948b-44f2-af44-4440e798dfca tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:12.262919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b9cdb30d-948b-44f2-af44-4440e798dfca tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:12.264180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b9cdb30d-948b-44f2-af44-4440e798dfca tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:12.410990 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-3300322f-d5f4-4774-854f-52f815f892ba tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:46:12.412961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-3300322f-d5f4-4774-854f-52f815f892ba tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:46:12.425961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-3300322f-d5f4-4774-854f-52f815f892ba tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:46:12.429009 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b9cdb30d-948b-44f2-af44-4440e798dfca tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:12.435868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-3300322f-d5f4-4774-854f-52f815f892ba tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:46:12.436888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-3300322f-d5f4-4774-854f-52f815f892ba tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:46:12.442520 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b9cdb30d-948b-44f2-af44-4440e798dfca tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/b65a6807-c8ad-44d0-93d7-931037ca8afd" status: 200 len: 1274 microversion: 2.1 time: 0.231299 Oct 29 02:46:12.444905 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 151/286] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:12 2022] GET /compute/v2.1/servers/b65a6807-c8ad-44d0-93d7-931037ca8afd => generated 1274 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:12.451496 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9d32b5d1-0f48-4982-beb1-cc889d4dfc07 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:12.483845 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9d32b5d1-0f48-4982-beb1-cc889d4dfc07 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.035275 Oct 29 02:46:12.489163 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 152/287] 10.222.0.46 () {58 vars in 1143 bytes} [Sat Oct 29 02:46:12 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:12.494299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=49 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:12.500865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-17242f19-1953-4396-ad8b-cb6df5d1e0e0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:12.501247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3300322f-d5f4-4774-854f-52f815f892ba tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:12.502085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3300322f-d5f4-4774-854f-52f815f892ba tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:12.502840 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3300322f-d5f4-4774-854f-52f815f892ba tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:12.504919 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3300322f-d5f4-4774-854f-52f815f892ba tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:12.506322 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3300322f-d5f4-4774-854f-52f815f892ba tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:12.507487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3300322f-d5f4-4774-854f-52f815f892ba tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:12.509095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-17242f19-1953-4396-ad8b-cb6df5d1e0e0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:12.522952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17242f19-1953-4396-ad8b-cb6df5d1e0e0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:12.523443 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17242f19-1953-4396-ad8b-cb6df5d1e0e0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:12.523877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17242f19-1953-4396-ad8b-cb6df5d1e0e0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:12.524763 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17242f19-1953-4396-ad8b-cb6df5d1e0e0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:12.525220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17242f19-1953-4396-ad8b-cb6df5d1e0e0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:12.525631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17242f19-1953-4396-ad8b-cb6df5d1e0e0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:12.555228 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-3300322f-d5f4-4774-854f-52f815f892ba tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Getting quotas for project 687ff1c168124c6aa2bae831ffa0ad47. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:46:12.563942 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-3300322f-d5f4-4774-854f-52f815f892ba tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Getting quotas for user c6b28aab121f44d09e44615e410350c8 and project 687ff1c168124c6aa2bae831ffa0ad47. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:46:12.586508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3300322f-d5f4-4774-854f-52f815f892ba tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:46:12.590575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3300322f-d5f4-4774-854f-52f815f892ba tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: f4ce1c31-a9f8-4312-b7ac-09c736eb8bff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:46:12.697405 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3300322f-d5f4-4774-854f-52f815f892ba tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.217913 Oct 29 02:46:12.698771 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 136/288] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:46:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:46:12.708659 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-40da6f9e-c6e0-48db-abe3-042c52890254 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862967-2"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:12.722144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40da6f9e-c6e0-48db-abe3-042c52890254 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:12.722760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40da6f9e-c6e0-48db-abe3-042c52890254 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:12.723288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40da6f9e-c6e0-48db-abe3-042c52890254 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:12.781922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-17242f19-1953-4396-ad8b-cb6df5d1e0e0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:12.796997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-17242f19-1953-4396-ad8b-cb6df5d1e0e0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:12.798564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-17242f19-1953-4396-ad8b-cb6df5d1e0e0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:12.799772 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-17242f19-1953-4396-ad8b-cb6df5d1e0e0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 200 len: 1558 microversion: 2.25 time: 0.305980 Oct 29 02:46:12.808984 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 153/289] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:12 2022] GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 1558 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:12.821926 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-574d8b38-a304-4080-aa86-a6aab36313ca tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:12.822566 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-574d8b38-a304-4080-aa86-a6aab36313ca tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: f4ce1c31-a9f8-4312-b7ac-09c736eb8bff] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:12.931245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-574d8b38-a304-4080-aa86-a6aab36313ca tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:12.941338 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-574d8b38-a304-4080-aa86-a6aab36313ca tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff" status: 200 len: 1221 microversion: 2.1 time: 0.131083 Oct 29 02:46:12.941926 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 154/290] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:12 2022] GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff => generated 1221 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:13.000171 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-40da6f9e-c6e0-48db-abe3-042c52890254 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 227 microversion: 2.1 time: 0.300103 Oct 29 02:46:13.002483 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 137/291] 10.222.0.46 () {60 vars in 1194 bytes} [Sat Oct 29 02:46:12 2022] POST /compute/v2.1/os-aggregates/12/action => generated 227 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:13.009966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-29c04daa-eab7-4328-b25c-3d0de574aeb7 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:13.011149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-29c04daa-eab7-4328-b25c-3d0de574aeb7 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] [instance: 59d3322c-0cf9-4251-8af6-7afbd4d249e5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:13.024468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29c04daa-eab7-4328-b25c-3d0de574aeb7 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:13.025649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29c04daa-eab7-4328-b25c-3d0de574aeb7 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:13.026191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29c04daa-eab7-4328-b25c-3d0de574aeb7 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:13.027219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29c04daa-eab7-4328-b25c-3d0de574aeb7 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:13.027829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29c04daa-eab7-4328-b25c-3d0de574aeb7 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:13.028694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29c04daa-eab7-4328-b25c-3d0de574aeb7 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:13.427474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-29c04daa-eab7-4328-b25c-3d0de574aeb7 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ed858998a418b9948f5dc574e4ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89eadfa2b6054a58846e342008ab17da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:13.451004 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-29c04daa-eab7-4328-b25c-3d0de574aeb7 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] 10.222.0.46 "GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5" status: 200 len: 1321 microversion: 2.1 time: 0.440269 Oct 29 02:46:13.451004 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 138/292] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:13 2022] GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5 => generated 1321 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:13.451004 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a3120b21-67c9-4c8d-b11f-679e7831a22b tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:13.511766 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a3120b21-67c9-4c8d-b11f-679e7831a22b tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.065031 Oct 29 02:46:13.516757 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 139/293] 10.222.0.46 () {58 vars in 1155 bytes} [Sat Oct 29 02:46:13 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:46:13.525081 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b255a4aa-2007-4ca9-b51e-27d36de222d4 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:13.529243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b255a4aa-2007-4ca9-b51e-27d36de222d4 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: b65a6807-c8ad-44d0-93d7-931037ca8afd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:13.548866 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b255a4aa-2007-4ca9-b51e-27d36de222d4 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:13.550170 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b255a4aa-2007-4ca9-b51e-27d36de222d4 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:13.552214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b255a4aa-2007-4ca9-b51e-27d36de222d4 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:13.553424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b255a4aa-2007-4ca9-b51e-27d36de222d4 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:13.554281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b255a4aa-2007-4ca9-b51e-27d36de222d4 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:13.556347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b255a4aa-2007-4ca9-b51e-27d36de222d4 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:13.613493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-848c6856-9d22-4ad9-82a1-23a446f070e2 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:13.620803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-848c6856-9d22-4ad9-82a1-23a446f070e2 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:13.647182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-848c6856-9d22-4ad9-82a1-23a446f070e2 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:13.650814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-848c6856-9d22-4ad9-82a1-23a446f070e2 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:13.651975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-848c6856-9d22-4ad9-82a1-23a446f070e2 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:13.653738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-848c6856-9d22-4ad9-82a1-23a446f070e2 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:13.656770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-848c6856-9d22-4ad9-82a1-23a446f070e2 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:13.657524 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-848c6856-9d22-4ad9-82a1-23a446f070e2 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.043608 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b255a4aa-2007-4ca9-b51e-27d36de222d4 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:14.076635 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b255a4aa-2007-4ca9-b51e-27d36de222d4 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/b65a6807-c8ad-44d0-93d7-931037ca8afd" status: 200 len: 1316 microversion: 2.1 time: 0.558349 Oct 29 02:46:14.078365 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 140/294] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:13 2022] GET /compute/v2.1/servers/b65a6807-c8ad-44d0-93d7-931037ca8afd => generated 1316 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:14.094965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-55ac78b3-27d4-4af3-8f87-797e8206af25 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1420488489"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:14.106697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.aggregate [None req-55ac78b3-27d4-4af3-8f87-797e8206af25 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Generated uuid 7f80e07c-18de-4075-b3b3-e7b09523f1a1 for aggregate {{(pid=127125) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:46:14.125507 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=100 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:14.140347 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-848c6856-9d22-4ad9-82a1-23a446f070e2 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lazy-loading 'services' on Instance uuid 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:14.175774 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-55ac78b3-27d4-4af3-8f87-797e8206af25 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.095243 Oct 29 02:46:14.188447 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 141/295] 10.222.0.46 () {60 vars in 1164 bytes} [Sat Oct 29 02:46:14 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:14.198183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fa765052-1e62-4cd6-ac74-de2827a3cd28 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:14.199131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fa765052-1e62-4cd6-ac74-de2827a3cd28 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: f4ce1c31-a9f8-4312-b7ac-09c736eb8bff] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:14.208463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa765052-1e62-4cd6-ac74-de2827a3cd28 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.209364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa765052-1e62-4cd6-ac74-de2827a3cd28 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.210277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa765052-1e62-4cd6-ac74-de2827a3cd28 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.211462 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa765052-1e62-4cd6-ac74-de2827a3cd28 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.212214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa765052-1e62-4cd6-ac74-de2827a3cd28 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.213249 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa765052-1e62-4cd6-ac74-de2827a3cd28 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.296853 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-848c6856-9d22-4ad9-82a1-23a446f070e2 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 200 len: 2051 microversion: 2.25 time: 1.352134 Oct 29 02:46:14.298689 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 155/296] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:12 2022] GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 2051 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:14.328908 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7fc0d11d-e8d6-463e-9a03-34b7057c141b tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862967-2"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:14.361379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7fc0d11d-e8d6-463e-9a03-34b7057c141b tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.362959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7fc0d11d-e8d6-463e-9a03-34b7057c141b tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.364039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7fc0d11d-e8d6-463e-9a03-34b7057c141b tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.479444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fa765052-1e62-4cd6-ac74-de2827a3cd28 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:14.506736 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fa765052-1e62-4cd6-ac74-de2827a3cd28 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff" status: 200 len: 1217 microversion: 2.1 time: 0.312455 Oct 29 02:46:14.508929 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 142/297] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:14 2022] GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff => generated 1217 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:14.525828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7029c500-f252-4d3e-bdf9-3adf8a381963 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:14.526462 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7029c500-f252-4d3e-bdf9-3adf8a381963 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:14.542845 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7029c500-f252-4d3e-bdf9-3adf8a381963 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.543592 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7029c500-f252-4d3e-bdf9-3adf8a381963 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.544214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7029c500-f252-4d3e-bdf9-3adf8a381963 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.545215 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7029c500-f252-4d3e-bdf9-3adf8a381963 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.546690 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7029c500-f252-4d3e-bdf9-3adf8a381963 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.551111 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7029c500-f252-4d3e-bdf9-3adf8a381963 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.630189 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7fc0d11d-e8d6-463e-9a03-34b7057c141b tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.314263 Oct 29 02:46:14.633999 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 156/298] 10.222.0.46 () {60 vars in 1194 bytes} [Sat Oct 29 02:46:14 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:14.645628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2f322199-6ddf-42b9-a9c2-d8dfc10c1f82 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:14.648938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2f322199-6ddf-42b9-a9c2-d8dfc10c1f82 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] [instance: 59d3322c-0cf9-4251-8af6-7afbd4d249e5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:14.664988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f322199-6ddf-42b9-a9c2-d8dfc10c1f82 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.668460 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f322199-6ddf-42b9-a9c2-d8dfc10c1f82 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.669231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f322199-6ddf-42b9-a9c2-d8dfc10c1f82 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:14.672975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f322199-6ddf-42b9-a9c2-d8dfc10c1f82 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:14.673648 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f322199-6ddf-42b9-a9c2-d8dfc10c1f82 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:14.674372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f322199-6ddf-42b9-a9c2-d8dfc10c1f82 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:15.026916 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-7029c500-f252-4d3e-bdf9-3adf8a381963 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lazy-loading 'services' on Instance uuid 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:15.150208 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7029c500-f252-4d3e-bdf9-3adf8a381963 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 200 len: 2051 microversion: 2.25 time: 0.637594 Oct 29 02:46:15.155120 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 143/299] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:14 2022] GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 2051 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:15.163034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-5424cec1-29b7-43e0-b230-7148f2b55d47 req-6e92a65d-30d0-4e18-9762-8b6ee5f73d13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b65a6807-c8ad-44d0-93d7-931037ca8afd", "tag": "bf521964-3ec5-4c49-a9de-c97ddd2ce980"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:15.188820 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-5424cec1-29b7-43e0-b230-7148f2b55d47 req-6e92a65d-30d0-4e18-9762-8b6ee5f73d13 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:15.189533 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-5424cec1-29b7-43e0-b230-7148f2b55d47 req-6e92a65d-30d0-4e18-9762-8b6ee5f73d13 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:15.190342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-5424cec1-29b7-43e0-b230-7148f2b55d47 req-6e92a65d-30d0-4e18-9762-8b6ee5f73d13 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:15.207580 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-5424cec1-29b7-43e0-b230-7148f2b55d47 req-6e92a65d-30d0-4e18-9762-8b6ee5f73d13 service nova] Creating event network-changed:bf521964-3ec5-4c49-a9de-c97ddd2ce980 for instance b65a6807-c8ad-44d0-93d7-931037ca8afd on n-h1-862967-2 Oct 29 02:46:15.214097 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-5424cec1-29b7-43e0-b230-7148f2b55d47 req-6e92a65d-30d0-4e18-9762-8b6ee5f73d13 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057321 Oct 29 02:46:15.215027 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 144/300] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:15.332615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2f322199-6ddf-42b9-a9c2-d8dfc10c1f82 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ed858998a418b9948f5dc574e4ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89eadfa2b6054a58846e342008ab17da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:15.345026 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2f322199-6ddf-42b9-a9c2-d8dfc10c1f82 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] 10.222.0.46 "GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5" status: 200 len: 1321 microversion: 2.1 time: 0.709246 Oct 29 02:46:15.346915 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 157/301] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:14 2022] GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5 => generated 1321 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:15.360581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8fc8b73e-b693-45f7-b559-6021ed6d0e42 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862967-2"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:15.407868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fc8b73e-b693-45f7-b559-6021ed6d0e42 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:15.411231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fc8b73e-b693-45f7-b559-6021ed6d0e42 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:15.413337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fc8b73e-b693-45f7-b559-6021ed6d0e42 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:15.687211 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8fc8b73e-b693-45f7-b559-6021ed6d0e42 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 228 microversion: 2.1 time: 0.337339 Oct 29 02:46:15.688858 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 158/302] 10.222.0.46 () {60 vars in 1194 bytes} [Sat Oct 29 02:46:15 2022] POST /compute/v2.1/os-aggregates/13/action => generated 228 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:15.695099 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5c56d62a-5ab0-47e2-b3ef-6ac006aae191 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:15.696081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5c56d62a-5ab0-47e2-b3ef-6ac006aae191 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: b65a6807-c8ad-44d0-93d7-931037ca8afd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:15.703218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c56d62a-5ab0-47e2-b3ef-6ac006aae191 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:15.703929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c56d62a-5ab0-47e2-b3ef-6ac006aae191 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:15.704792 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c56d62a-5ab0-47e2-b3ef-6ac006aae191 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:15.710271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c56d62a-5ab0-47e2-b3ef-6ac006aae191 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:15.710913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c56d62a-5ab0-47e2-b3ef-6ac006aae191 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:15.711486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c56d62a-5ab0-47e2-b3ef-6ac006aae191 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:15.847955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-04fc1abf-6373-4e36-a8af-36b9a1c2ba4e tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Calling method '.version_select at 0x7ff058876280>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:15.853414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04fc1abf-6373-4e36-a8af-36b9a1c2ba4e tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:15.854349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04fc1abf-6373-4e36-a8af-36b9a1c2ba4e tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:15.857516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04fc1abf-6373-4e36-a8af-36b9a1c2ba4e tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:15.858529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04fc1abf-6373-4e36-a8af-36b9a1c2ba4e tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:15.859143 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04fc1abf-6373-4e36-a8af-36b9a1c2ba4e tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:15.859903 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04fc1abf-6373-4e36-a8af-36b9a1c2ba4e tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:15.898331 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-04fc1abf-6373-4e36-a8af-36b9a1c2ba4e tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.681393 Oct 29 02:46:15.899736 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 145/303] 10.222.0.46 () {58 vars in 1128 bytes} [Sat Oct 29 02:46:15 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:15.907737 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3450cae1-cf34-4f46-8809-1fef54e15bc5 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:15.914798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3450cae1-cf34-4f46-8809-1fef54e15bc5 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:15.915656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3450cae1-cf34-4f46-8809-1fef54e15bc5 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:15.916476 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3450cae1-cf34-4f46-8809-1fef54e15bc5 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:15.917500 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3450cae1-cf34-4f46-8809-1fef54e15bc5 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:15.918151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3450cae1-cf34-4f46-8809-1fef54e15bc5 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:15.918766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3450cae1-cf34-4f46-8809-1fef54e15bc5 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:15.965683 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3450cae1-cf34-4f46-8809-1fef54e15bc5 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.063506 Oct 29 02:46:15.966763 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 146/304] 10.222.0.46 () {60 vars in 1217 bytes} [Sat Oct 29 02:46:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:46:15.972990 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-69f965c3-e70e-42b0-9810-ad577a1409ea tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:15.973959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-69f965c3-e70e-42b0-9810-ad577a1409ea tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: f4ce1c31-a9f8-4312-b7ac-09c736eb8bff] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:15.980748 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-69f965c3-e70e-42b0-9810-ad577a1409ea tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:15.981574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-69f965c3-e70e-42b0-9810-ad577a1409ea tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:15.982429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-69f965c3-e70e-42b0-9810-ad577a1409ea tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:15.983283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-69f965c3-e70e-42b0-9810-ad577a1409ea tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:15.983876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-69f965c3-e70e-42b0-9810-ad577a1409ea tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:15.984439 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-69f965c3-e70e-42b0-9810-ad577a1409ea tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:16.086182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-69f965c3-e70e-42b0-9810-ad577a1409ea tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:16.095836 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-69f965c3-e70e-42b0-9810-ad577a1409ea tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff" status: 200 len: 1279 microversion: 2.1 time: 0.126688 Oct 29 02:46:16.109748 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 147/305] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:15 2022] GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff => generated 1279 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:16.115852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5c56d62a-5ab0-47e2-b3ef-6ac006aae191 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:16.118310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-818ccaec-7140-4028-b674-00b3b1a9f347 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:16.126497 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5c56d62a-5ab0-47e2-b3ef-6ac006aae191 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/b65a6807-c8ad-44d0-93d7-931037ca8afd" status: 200 len: 1316 microversion: 2.1 time: 0.436275 Oct 29 02:46:16.127079 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 159/306] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:15 2022] GET /compute/v2.1/servers/b65a6807-c8ad-44d0-93d7-931037ca8afd => generated 1316 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:16.133078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-20652cf2-8bcb-4532-b59c-a3c612280f53 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Calling method '.version_select at 0x7ff058748820>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:16.142417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20652cf2-8bcb-4532-b59c-a3c612280f53 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:16.142947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20652cf2-8bcb-4532-b59c-a3c612280f53 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:16.143637 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20652cf2-8bcb-4532-b59c-a3c612280f53 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:16.152515 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-818ccaec-7140-4028-b674-00b3b1a9f347 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.041331 Oct 29 02:46:16.153531 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 148/307] 10.222.0.46 () {58 vars in 1155 bytes} [Sat Oct 29 02:46:16 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:46:16.158714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20652cf2-8bcb-4532-b59c-a3c612280f53 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:16.159544 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-64639e52-b085-48c5-b41b-be195d505c6c tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862967-2", "block_migration": "auto"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:16.161363 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20652cf2-8bcb-4532-b59c-a3c612280f53 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:16.162066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20652cf2-8bcb-4532-b59c-a3c612280f53 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:16.163419 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-64639e52-b085-48c5-b41b-be195d505c6c tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:16.170837 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64639e52-b085-48c5-b41b-be195d505c6c tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:16.171700 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64639e52-b085-48c5-b41b-be195d505c6c tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:16.172316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64639e52-b085-48c5-b41b-be195d505c6c tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:16.173221 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64639e52-b085-48c5-b41b-be195d505c6c tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:16.173902 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64639e52-b085-48c5-b41b-be195d505c6c tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:16.174526 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64639e52-b085-48c5-b41b-be195d505c6c tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:16.216336 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-20652cf2-8bcb-4532-b59c-a3c612280f53 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.088192 Oct 29 02:46:16.219432 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 160/308] 10.222.0.46 () {58 vars in 1139 bytes} [Sat Oct 29 02:46:16 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:16.473747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4e57df54-0075-4748-b107-e2d5fdb6c53d tempest-AZAdminV2TestJSON-1218663936 tempest-AZAdminV2TestJSON-1218663936-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:16.475713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e57df54-0075-4748-b107-e2d5fdb6c53d tempest-AZAdminV2TestJSON-1218663936 tempest-AZAdminV2TestJSON-1218663936-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:16.476405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e57df54-0075-4748-b107-e2d5fdb6c53d tempest-AZAdminV2TestJSON-1218663936 tempest-AZAdminV2TestJSON-1218663936-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:16.477134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e57df54-0075-4748-b107-e2d5fdb6c53d tempest-AZAdminV2TestJSON-1218663936 tempest-AZAdminV2TestJSON-1218663936-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:16.477910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e57df54-0075-4748-b107-e2d5fdb6c53d tempest-AZAdminV2TestJSON-1218663936 tempest-AZAdminV2TestJSON-1218663936-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:16.478739 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e57df54-0075-4748-b107-e2d5fdb6c53d tempest-AZAdminV2TestJSON-1218663936 tempest-AZAdminV2TestJSON-1218663936-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:16.479464 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e57df54-0075-4748-b107-e2d5fdb6c53d tempest-AZAdminV2TestJSON-1218663936 tempest-AZAdminV2TestJSON-1218663936-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:16.509710 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4e57df54-0075-4748-b107-e2d5fdb6c53d tempest-AZAdminV2TestJSON-1218663936 tempest-AZAdminV2TestJSON-1218663936-project-admin] 10.222.0.46 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.283494 Oct 29 02:46:16.517810 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 161/309] 10.222.0.46 () {58 vars in 1164 bytes} [Sat Oct 29 02:46:16 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:46:16.525771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-013e974a-cda8-4f7a-ad34-618e2565aeb0 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1755577521"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:16.529701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.aggregate [None req-013e974a-cda8-4f7a-ad34-618e2565aeb0 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Generated uuid 05718459-7491-4e73-83be-74e7576e0e10 for aggregate {{(pid=127124) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:46:16.554104 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-013e974a-cda8-4f7a-ad34-618e2565aeb0 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.033933 Oct 29 02:46:16.555917 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 162/310] 10.222.0.46 () {60 vars in 1164 bytes} [Sat Oct 29 02:46:16 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:16.568232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-60f46f89-466f-483d-b797-e95e894008ca tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Calling method '.version_select at 0x7ff0586b24c0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:16.571907 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60f46f89-466f-483d-b797-e95e894008ca tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:16.572296 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60f46f89-466f-483d-b797-e95e894008ca tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:16.572757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60f46f89-466f-483d-b797-e95e894008ca tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:16.573504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60f46f89-466f-483d-b797-e95e894008ca tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:16.576726 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60f46f89-466f-483d-b797-e95e894008ca tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:16.577609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60f46f89-466f-483d-b797-e95e894008ca tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:16.610764 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-60f46f89-466f-483d-b797-e95e894008ca tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.053449 Oct 29 02:46:16.612073 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 163/311] 10.222.0.46 () {58 vars in 1145 bytes} [Sat Oct 29 02:46:16 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:46:16.618218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5d2b1ad3-2204-4347-a656-05423cf649ae tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:16.619801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5d2b1ad3-2204-4347-a656-05423cf649ae tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] [instance: 59d3322c-0cf9-4251-8af6-7afbd4d249e5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:16.632038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5d2b1ad3-2204-4347-a656-05423cf649ae tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:16.633072 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5d2b1ad3-2204-4347-a656-05423cf649ae tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:16.633633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5d2b1ad3-2204-4347-a656-05423cf649ae tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:16.638588 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5d2b1ad3-2204-4347-a656-05423cf649ae tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:16.639391 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5d2b1ad3-2204-4347-a656-05423cf649ae tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:16.640746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5d2b1ad3-2204-4347-a656-05423cf649ae tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:16.692304 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-64639e52-b085-48c5-b41b-be195d505c6c tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lazy-loading 'flavor' on Instance uuid 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:16.765974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-64639e52-b085-48c5-b41b-be195d505c6c tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Going to try to live migrate instance to n-h1-862967-2 {{(pid=127125) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 02:46:16.833267 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:17.034465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5d2b1ad3-2204-4347-a656-05423cf649ae tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ed858998a418b9948f5dc574e4ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89eadfa2b6054a58846e342008ab17da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:17.045845 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5d2b1ad3-2204-4347-a656-05423cf649ae tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] 10.222.0.46 "GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5" status: 200 len: 1321 microversion: 2.1 time: 0.432204 Oct 29 02:46:17.046447 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 164/312] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:16 2022] GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5 => generated 1321 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:17.068700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a04729b8-b327-4799-bbb3-5e7c45354044 tempest-AZAdminV2TestJSON-1218663936 tempest-AZAdminV2TestJSON-1218663936-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:17.074810 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a04729b8-b327-4799-bbb3-5e7c45354044 tempest-AZAdminV2TestJSON-1218663936 tempest-AZAdminV2TestJSON-1218663936-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:17.080825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a04729b8-b327-4799-bbb3-5e7c45354044 tempest-AZAdminV2TestJSON-1218663936 tempest-AZAdminV2TestJSON-1218663936-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:17.081333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a04729b8-b327-4799-bbb3-5e7c45354044 tempest-AZAdminV2TestJSON-1218663936 tempest-AZAdminV2TestJSON-1218663936-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:17.083988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a04729b8-b327-4799-bbb3-5e7c45354044 tempest-AZAdminV2TestJSON-1218663936 tempest-AZAdminV2TestJSON-1218663936-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:17.084463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a04729b8-b327-4799-bbb3-5e7c45354044 tempest-AZAdminV2TestJSON-1218663936 tempest-AZAdminV2TestJSON-1218663936-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:17.084926 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a04729b8-b327-4799-bbb3-5e7c45354044 tempest-AZAdminV2TestJSON-1218663936 tempest-AZAdminV2TestJSON-1218663936-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:17.131379 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a04729b8-b327-4799-bbb3-5e7c45354044 tempest-AZAdminV2TestJSON-1218663936 tempest-AZAdminV2TestJSON-1218663936-project-admin] 10.222.0.46 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.082630 Oct 29 02:46:17.133002 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 165/313] 10.222.0.46 () {58 vars in 1185 bytes} [Sat Oct 29 02:46:17 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:17.138883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e29883c3-c1e7-4cbd-9ac9-25d975972110 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:17.200117 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e29883c3-c1e7-4cbd-9ac9-25d975972110 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.065418 Oct 29 02:46:17.200995 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 166/314] 10.222.0.46 () {58 vars in 1155 bytes} [Sat Oct 29 02:46:17 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:46:17.211559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d4da47bc-2a49-44cd-82f6-825bf873ca68 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Calling method '.version_select at 0x7ff0586b2040>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:17.216321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4da47bc-2a49-44cd-82f6-825bf873ca68 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:17.217212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4da47bc-2a49-44cd-82f6-825bf873ca68 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:17.219000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4da47bc-2a49-44cd-82f6-825bf873ca68 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:17.220116 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4da47bc-2a49-44cd-82f6-825bf873ca68 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:17.220976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4da47bc-2a49-44cd-82f6-825bf873ca68 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:17.221704 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4da47bc-2a49-44cd-82f6-825bf873ca68 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:17.264322 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d4da47bc-2a49-44cd-82f6-825bf873ca68 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.061740 Oct 29 02:46:17.265399 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 167/315] 10.222.0.46 () {58 vars in 1128 bytes} [Sat Oct 29 02:46:17 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:17.290032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-665b3496-e478-44c7-9338-b62bcbad7e61 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:17.293716 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-665b3496-e478-44c7-9338-b62bcbad7e61 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: f4ce1c31-a9f8-4312-b7ac-09c736eb8bff] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:17.309710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-665b3496-e478-44c7-9338-b62bcbad7e61 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:17.311849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-665b3496-e478-44c7-9338-b62bcbad7e61 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:17.314369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-665b3496-e478-44c7-9338-b62bcbad7e61 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:17.315533 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-665b3496-e478-44c7-9338-b62bcbad7e61 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:17.319208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-665b3496-e478-44c7-9338-b62bcbad7e61 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:17.320484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-665b3496-e478-44c7-9338-b62bcbad7e61 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:17.731368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-665b3496-e478-44c7-9338-b62bcbad7e61 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:17.741612 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-665b3496-e478-44c7-9338-b62bcbad7e61 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff" status: 200 len: 1321 microversion: 2.1 time: 0.474713 Oct 29 02:46:17.742954 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 168/316] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:17 2022] GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff => generated 1321 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:17.749552 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3ff0a0f7-c793-4dbb-949f-fb9f28b5260e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:17.752051 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3ff0a0f7-c793-4dbb-949f-fb9f28b5260e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: b65a6807-c8ad-44d0-93d7-931037ca8afd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:17.759362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ff0a0f7-c793-4dbb-949f-fb9f28b5260e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:17.759954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ff0a0f7-c793-4dbb-949f-fb9f28b5260e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:17.760464 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ff0a0f7-c793-4dbb-949f-fb9f28b5260e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:17.761450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ff0a0f7-c793-4dbb-949f-fb9f28b5260e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:17.762452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ff0a0f7-c793-4dbb-949f-fb9f28b5260e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:17.763210 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ff0a0f7-c793-4dbb-949f-fb9f28b5260e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:18.102595 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3ff0a0f7-c793-4dbb-949f-fb9f28b5260e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:18.112948 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3ff0a0f7-c793-4dbb-949f-fb9f28b5260e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/b65a6807-c8ad-44d0-93d7-931037ca8afd" status: 200 len: 1316 microversion: 2.1 time: 0.368597 Oct 29 02:46:18.113565 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 169/317] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:17 2022] GET /compute/v2.1/servers/b65a6807-c8ad-44d0-93d7-931037ca8afd => generated 1316 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:18.131334 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a62cfc82-5f0c-4d35-8feb-5aeda4a19f0b tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:18.139962 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-a62cfc82-5f0c-4d35-8feb-5aeda4a19f0b tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 29 02:46:18.148042 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a62cfc82-5f0c-4d35-8feb-5aeda4a19f0b tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Request method failure captured: Oct 29 02:46:18.148042 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 29 02:46:18.148042 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:46:18.148042 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:46:18.148042 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:46:18.148042 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:46:18.148042 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:46:18.148042 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:46:18.148042 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:46:18.148042 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:18.148042 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPEXLh9w46zUo82nUzog3AQBsoTvm25GdLOR_5-NkdhifaeFzLSeQ_bv9iUI0Aimze23K6RipsXDChGTKFzMJOG-QeLqHnn4hPMvixonYXSXq8vm33pi6LlQ_EGqxRZLVXGHtxW6Hev7Oj-c8iuBdLQ21qEdSobDQhF-66OAx8lBgg Oct 29 02:46:18.148042 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:46:18.148042 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:46:18.148042 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:46:18.148042 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:46:18.148042 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:46:18.148042 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:46:18.148042 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: e7054093f8c94b4b8ef9eca6097e6c52 Oct 29 02:46:18.148042 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-AggregatesAdminTestJSON-2117528276 Oct 29 02:46:18.148042 n-d-862967-2 devstack@n-api.service[127124]: X-Role: admin,reader,member Oct 29 02:46:18.148042 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: admin,reader,member Oct 29 02:46:18.149566 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e7054093f8c94b4b8ef9eca6097e6c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e7054093f8c94b4b8ef9eca6097e6c52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e7054093f8c94b4b8ef9eca6097e6c52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e7054093f8c94b4b8ef9eca6097e6c52"}]}] Oct 29 02:46:18.149566 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-AggregatesAdminTestJSON-2117528276 Oct 29 02:46:18.149566 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: e7054093f8c94b4b8ef9eca6097e6c52 Oct 29 02:46:18.149566 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2117528276 Oct 29 02:46:18.149566 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-AggregatesAdminTestJSON-2117528276-project-admin Oct 29 02:46:18.149566 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:46:18.149566 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:46:18.149566 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 2493e114b4944ba796bb02a327b2d03b Oct 29 02:46:18.149566 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-AggregatesAdminTestJSON-2117528276-project-admin Oct 29 02:46:18.149566 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:46:18.149566 n-d-862967-2 devstack@n-api.service[127124]: exception: Aggregate 14 could not be found. Oct 29 02:46:18.149566 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '14'} Oct 29 02:46:18.149566 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:18.150334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:18.150334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 29 02:46:18.150334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 29 02:46:18.150334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 29 02:46:18.150334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 29 02:46:18.150334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:46:18.150334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:46:18.150334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 29 02:46:18.150334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 29 02:46:18.150334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:46:18.150334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:46:18.150334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 29 02:46:18.150334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 29 02:46:18.150334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 29 02:46:18.150334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:18.150334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:18.150334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:18.150334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:18.150334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:18.151387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:18.151387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:18.151387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:18.151387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:18.151387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:18.151387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 29 02:46:18.151387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:18.151387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 29 02:46:18.151387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:18.151387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:18.151387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:18.151387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:18.151387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:18.151387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:18.151387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:18.151387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:18.151387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 29 02:46:18.151387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:18.153895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a62cfc82-5f0c-4d35-8feb-5aeda4a19f0b tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:18.157738 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a62cfc82-5f0c-4d35-8feb-5aeda4a19f0b tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.030981 Oct 29 02:46:18.158595 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 170/318] 10.222.0.46 () {58 vars in 1152 bytes} [Sat Oct 29 02:46:18 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:46:18.572259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bf6bf4c4-ba05-4d26-aed9-4a6dceff0f91 tempest-FlavorMetadataValidation-1335901994 tempest-FlavorMetadataValidation-1335901994-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1380560723", "id": 2071682080, "os-flavor-access:is_public": "True"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:18.603254 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bf6bf4c4-ba05-4d26-aed9-4a6dceff0f91 tempest-FlavorMetadataValidation-1335901994 tempest-FlavorMetadataValidation-1335901994-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.443271 Oct 29 02:46:18.604293 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 171/319] 10.222.0.46 () {62 vars in 1188 bytes} [Sat Oct 29 02:46:18 2022] POST /compute/v2.1/flavors => generated 471 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:46:18.620040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b4010d1c-3c63-4b5a-96fd-a3c4c217f6b8 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Calling method '.version_select at 0x7ff05866cc10>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:18.625524 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4010d1c-3c63-4b5a-96fd-a3c4c217f6b8 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:18.626444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4010d1c-3c63-4b5a-96fd-a3c4c217f6b8 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:18.627060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4010d1c-3c63-4b5a-96fd-a3c4c217f6b8 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:18.628218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4010d1c-3c63-4b5a-96fd-a3c4c217f6b8 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:18.629221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4010d1c-3c63-4b5a-96fd-a3c4c217f6b8 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:18.629991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4010d1c-3c63-4b5a-96fd-a3c4c217f6b8 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:18.661379 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b4010d1c-3c63-4b5a-96fd-a3c4c217f6b8 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.044420 Oct 29 02:46:18.670378 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 172/320] 10.222.0.46 () {58 vars in 1155 bytes} [Sat Oct 29 02:46:18 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:18.676627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-8a0611e5-d0c0-4805-adb1-86575db98b61 req-468bd704-c65a-49f4-83db-18b91a0d9ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d3322c-0cf9-4251-8af6-7afbd4d249e5", "name": "network-vif-plugged", "status": "completed", "tag": "fab8f890-e688-45b0-9679-3fcfe3b21ed1"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:18.693461 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8a0611e5-d0c0-4805-adb1-86575db98b61 req-468bd704-c65a-49f4-83db-18b91a0d9ac5 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:18.694194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8a0611e5-d0c0-4805-adb1-86575db98b61 req-468bd704-c65a-49f4-83db-18b91a0d9ac5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:18.694642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8a0611e5-d0c0-4805-adb1-86575db98b61 req-468bd704-c65a-49f4-83db-18b91a0d9ac5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:18.708933 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-8a0611e5-d0c0-4805-adb1-86575db98b61 req-468bd704-c65a-49f4-83db-18b91a0d9ac5 service nova] Creating event network-vif-plugged:fab8f890-e688-45b0-9679-3fcfe3b21ed1 for instance 59d3322c-0cf9-4251-8af6-7afbd4d249e5 on n-h2-862967-2 Oct 29 02:46:18.714445 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-8a0611e5-d0c0-4805-adb1-86575db98b61 req-468bd704-c65a-49f4-83db-18b91a0d9ac5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042527 Oct 29 02:46:18.715541 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 173/321] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:18.722829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-83cd5805-7d05-4948-87b9-408ead0d3a08 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:18.737795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-83cd5805-7d05-4948-87b9-408ead0d3a08 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] [instance: 59d3322c-0cf9-4251-8af6-7afbd4d249e5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:18.746665 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83cd5805-7d05-4948-87b9-408ead0d3a08 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:18.747663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83cd5805-7d05-4948-87b9-408ead0d3a08 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:18.749063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83cd5805-7d05-4948-87b9-408ead0d3a08 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:18.749971 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83cd5805-7d05-4948-87b9-408ead0d3a08 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:18.750654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83cd5805-7d05-4948-87b9-408ead0d3a08 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:18.751285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83cd5805-7d05-4948-87b9-408ead0d3a08 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:19.411819 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-83cd5805-7d05-4948-87b9-408ead0d3a08 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ed858998a418b9948f5dc574e4ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89eadfa2b6054a58846e342008ab17da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:19.421834 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-83cd5805-7d05-4948-87b9-408ead0d3a08 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] 10.222.0.46 "GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5" status: 200 len: 1321 microversion: 2.1 time: 0.704568 Oct 29 02:46:19.422667 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 174/322] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:18 2022] GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5 => generated 1321 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:19.427367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7a7ad740-29a5-43e6-945c-abf8a864c6b8 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:19.447395 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-7a7ad740-29a5-43e6-945c-abf8a864c6b8 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 29 02:46:19.449802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7a7ad740-29a5-43e6-945c-abf8a864c6b8 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Request method failure captured: Oct 29 02:46:19.449802 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 29 02:46:19.449802 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:46:19.449802 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:46:19.449802 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:46:19.449802 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:46:19.449802 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:46:19.449802 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:46:19.449802 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:46:19.449802 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:19.449802 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPEXLh9w46zUo82nUzog3AQBsoTvm25GdLOR_5-NkdhifaeFzLSeQ_bv9iUI0Aimze23K6RipsXDChGTKFzMJOG-QeLqHnn4hPMvixonYXSXq8vm33pi6LlQ_EGqxRZLVXGHtxW6Hev7Oj-c8iuBdLQ21qEdSobDQhF-66OAx8lBgg Oct 29 02:46:19.449802 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:46:19.449802 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:46:19.449802 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:46:19.449802 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:46:19.449802 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:46:19.449802 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:46:19.449802 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: e7054093f8c94b4b8ef9eca6097e6c52 Oct 29 02:46:19.449802 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-AggregatesAdminTestJSON-2117528276 Oct 29 02:46:19.449802 n-d-862967-2 devstack@n-api.service[127124]: X-Role: admin,reader,member Oct 29 02:46:19.449802 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: admin,reader,member Oct 29 02:46:19.451786 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e7054093f8c94b4b8ef9eca6097e6c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e7054093f8c94b4b8ef9eca6097e6c52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e7054093f8c94b4b8ef9eca6097e6c52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e7054093f8c94b4b8ef9eca6097e6c52"}]}] Oct 29 02:46:19.451786 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-AggregatesAdminTestJSON-2117528276 Oct 29 02:46:19.451786 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: e7054093f8c94b4b8ef9eca6097e6c52 Oct 29 02:46:19.451786 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2117528276 Oct 29 02:46:19.451786 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-AggregatesAdminTestJSON-2117528276-project-admin Oct 29 02:46:19.451786 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:46:19.451786 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:46:19.451786 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 2493e114b4944ba796bb02a327b2d03b Oct 29 02:46:19.451786 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-AggregatesAdminTestJSON-2117528276-project-admin Oct 29 02:46:19.451786 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:46:19.451786 n-d-862967-2 devstack@n-api.service[127124]: exception: Aggregate 14 could not be found. Oct 29 02:46:19.451786 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '14'} Oct 29 02:46:19.451786 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:19.453352 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:19.453352 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 29 02:46:19.453352 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 29 02:46:19.453352 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 02:46:19.453352 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 02:46:19.453352 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:46:19.453352 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:46:19.453352 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:46:19.453352 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:46:19.453352 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 02:46:19.453352 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 02:46:19.453352 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 29 02:46:19.453352 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 29 02:46:19.453352 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:46:19.453352 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:46:19.453352 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 29 02:46:19.453352 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 29 02:46:19.453352 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:46:19.453352 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:46:19.455387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 29 02:46:19.455387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 29 02:46:19.455387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 29 02:46:19.455387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:19.455387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:19.455387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:19.455387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:19.455387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:19.455387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:19.455387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:19.455387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:19.455387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:19.455387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:19.455387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 29 02:46:19.455387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:19.455387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 29 02:46:19.455387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:19.455387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:19.455387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:19.455387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:19.455387 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:19.460286 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:19.460286 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:19.460286 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:19.460286 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 29 02:46:19.460286 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:19.460286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7a7ad740-29a5-43e6-945c-abf8a864c6b8 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:19.460286 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7a7ad740-29a5-43e6-945c-abf8a864c6b8 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.027387 Oct 29 02:46:19.460286 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 175/323] 10.222.0.46 () {58 vars in 1155 bytes} [Sat Oct 29 02:46:19 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:46:19.460286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1d78a754-926f-42a9-bb94-a6717c249646 tempest-FlavorMetadataValidation-1335901994 tempest-FlavorMetadataValidation-1335901994-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:19.633516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:19.645930 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1d78a754-926f-42a9-bb94-a6717c249646 tempest-FlavorMetadataValidation-1335901994 tempest-FlavorMetadataValidation-1335901994-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/2071682080/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.192796 Oct 29 02:46:19.651578 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 176/324] 10.222.0.46 () {62 vars in 1265 bytes} [Sat Oct 29 02:46:19 2022] POST /compute/v2.1/flavors/2071682080/os-extra_specs => generated 62 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:19.656914 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-606315fa-93da-4831-9b11-04259e7120cd tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Calling method '.version_select at 0x7ff0586354c0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:19.661055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-606315fa-93da-4831-9b11-04259e7120cd tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:19.661692 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-606315fa-93da-4831-9b11-04259e7120cd tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:19.662304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-606315fa-93da-4831-9b11-04259e7120cd tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:19.663186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-606315fa-93da-4831-9b11-04259e7120cd tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:19.663788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-606315fa-93da-4831-9b11-04259e7120cd tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:19.664549 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-606315fa-93da-4831-9b11-04259e7120cd tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:19.698159 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-606315fa-93da-4831-9b11-04259e7120cd tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.049321 Oct 29 02:46:19.699121 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 177/325] 10.222.0.46 () {58 vars in 1128 bytes} [Sat Oct 29 02:46:19 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:19.709291 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bc12a7e1-1df1-4657-acb3-2846ca02883b tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:19.709915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bc12a7e1-1df1-4657-acb3-2846ca02883b tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: f4ce1c31-a9f8-4312-b7ac-09c736eb8bff] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:19.716379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc12a7e1-1df1-4657-acb3-2846ca02883b tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:19.716905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc12a7e1-1df1-4657-acb3-2846ca02883b tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:19.717342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc12a7e1-1df1-4657-acb3-2846ca02883b tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:19.718087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc12a7e1-1df1-4657-acb3-2846ca02883b tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:19.718546 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc12a7e1-1df1-4657-acb3-2846ca02883b tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:19.718975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc12a7e1-1df1-4657-acb3-2846ca02883b tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:20.243728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bc12a7e1-1df1-4657-acb3-2846ca02883b tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:20.262583 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bc12a7e1-1df1-4657-acb3-2846ca02883b tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff" status: 200 len: 1321 microversion: 2.1 time: 0.561865 Oct 29 02:46:20.283993 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 178/326] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:19 2022] GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff => generated 1321 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:20.305447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-35ae9a7f-46b5-4c9d-bf4b-0950fbf5da83 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:20.306615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-35ae9a7f-46b5-4c9d-bf4b-0950fbf5da83 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: b65a6807-c8ad-44d0-93d7-931037ca8afd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:20.320510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35ae9a7f-46b5-4c9d-bf4b-0950fbf5da83 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:20.322899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35ae9a7f-46b5-4c9d-bf4b-0950fbf5da83 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:20.324422 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35ae9a7f-46b5-4c9d-bf4b-0950fbf5da83 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:20.326125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35ae9a7f-46b5-4c9d-bf4b-0950fbf5da83 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:20.327139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35ae9a7f-46b5-4c9d-bf4b-0950fbf5da83 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:20.329151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35ae9a7f-46b5-4c9d-bf4b-0950fbf5da83 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:20.358453 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-64639e52-b085-48c5-b41b-be195d505c6c tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed/action" status: 202 len: 0 microversion: 2.25 time: 4.203511 Oct 29 02:46:20.359716 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 149/327] 10.222.0.46 () {62 vars in 1319 bytes} [Sat Oct 29 02:46:16 2022] POST /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed/action => generated 0 bytes in 4205 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:46:20.367245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6aa5c663-ce1e-4c72-a3e9-457c878b3ad4 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-582641309", "name": "tempest-test_aggregate-1970830763"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:20.394132 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.aggregate [None req-6aa5c663-ce1e-4c72-a3e9-457c878b3ad4 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Generated uuid b72549bc-a174-42cd-801e-69288b108d9c for aggregate {{(pid=127125) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:46:20.489726 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6aa5c663-ce1e-4c72-a3e9-457c878b3ad4 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.128195 Oct 29 02:46:20.493224 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 150/328] 10.222.0.46 () {60 vars in 1165 bytes} [Sat Oct 29 02:46:20 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:20.509245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-35f27958-0162-4198-a6a3-e612f046d07c tempest-FlavorMetadataValidation-1335901994 tempest-FlavorMetadataValidation-1335901994-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:20.559909 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=10,nova_api:INSERT=7 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:20.565206 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-35f27958-0162-4198-a6a3-e612f046d07c tempest-FlavorMetadataValidation-1335901994 tempest-FlavorMetadataValidation-1335901994-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/2071682080" status: 202 len: 0 microversion: 2.86 time: 0.070040 Oct 29 02:46:20.566078 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 151/329] 10.222.0.46 () {60 vars in 1202 bytes} [Sat Oct 29 02:46:20 2022] DELETE /compute/v2.1/flavors/2071682080 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:46:20.575699 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-872d769e-55a6-4143-aeee-802d3803243a tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Calling method '.version_select at 0x7ff05851a790>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:20.584937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-872d769e-55a6-4143-aeee-802d3803243a tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:20.585679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-872d769e-55a6-4143-aeee-802d3803243a tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:20.586284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-872d769e-55a6-4143-aeee-802d3803243a tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:20.602075 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-872d769e-55a6-4143-aeee-802d3803243a tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:20.602726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-872d769e-55a6-4143-aeee-802d3803243a tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:20.603354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-872d769e-55a6-4143-aeee-802d3803243a tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:20.626782 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-872d769e-55a6-4143-aeee-802d3803243a tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts/n-h2-862967-2" status: 200 len: 729 microversion: 2.1 time: 0.059340 Oct 29 02:46:20.627704 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 152/330] 10.222.0.46 () {58 vars in 1170 bytes} [Sat Oct 29 02:46:20 2022] GET /compute/v2.1/os-hosts/n-h2-862967-2 => generated 729 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:20.638539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-30ecc15d-86e5-4819-8d7e-318aa3c84aee req-36f8d6c2-250a-4ee1-9895-4d9a510f50ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4ce1c31-a9f8-4312-b7ac-09c736eb8bff", "tag": "52c3ac9d-fa0e-4f9e-9473-a653ab543c14"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:20.651498 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-30ecc15d-86e5-4819-8d7e-318aa3c84aee req-36f8d6c2-250a-4ee1-9895-4d9a510f50ac service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:20.652258 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-30ecc15d-86e5-4819-8d7e-318aa3c84aee req-36f8d6c2-250a-4ee1-9895-4d9a510f50ac service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:20.652867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-30ecc15d-86e5-4819-8d7e-318aa3c84aee req-36f8d6c2-250a-4ee1-9895-4d9a510f50ac service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:20.665358 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-30ecc15d-86e5-4819-8d7e-318aa3c84aee req-36f8d6c2-250a-4ee1-9895-4d9a510f50ac service nova] Creating event network-changed:52c3ac9d-fa0e-4f9e-9473-a653ab543c14 for instance f4ce1c31-a9f8-4312-b7ac-09c736eb8bff on n-h2-862967-2 Oct 29 02:46:20.673540 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-30ecc15d-86e5-4819-8d7e-318aa3c84aee req-36f8d6c2-250a-4ee1-9895-4d9a510f50ac service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038680 Oct 29 02:46:20.674833 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 153/331] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:20.681650 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cdc1f90a-4334-4810-8eaf-416832f849fa tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:20.682639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cdc1f90a-4334-4810-8eaf-416832f849fa tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:20.691056 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdc1f90a-4334-4810-8eaf-416832f849fa tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:20.691791 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdc1f90a-4334-4810-8eaf-416832f849fa tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:20.692762 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdc1f90a-4334-4810-8eaf-416832f849fa tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:20.693929 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdc1f90a-4334-4810-8eaf-416832f849fa tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:20.694542 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdc1f90a-4334-4810-8eaf-416832f849fa tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:20.695102 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdc1f90a-4334-4810-8eaf-416832f849fa tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:20.745549 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-35ae9a7f-46b5-4c9d-bf4b-0950fbf5da83 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:20.765792 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-35ae9a7f-46b5-4c9d-bf4b-0950fbf5da83 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/b65a6807-c8ad-44d0-93d7-931037ca8afd" status: 200 len: 1316 microversion: 2.1 time: 0.477967 Oct 29 02:46:20.770809 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 179/332] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:20 2022] GET /compute/v2.1/servers/b65a6807-c8ad-44d0-93d7-931037ca8afd => generated 1316 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:20.784553 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ff0a1643-c859-4362-bd21-4f046eac3db2 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:20.787993 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ff0a1643-c859-4362-bd21-4f046eac3db2 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] [instance: 59d3322c-0cf9-4251-8af6-7afbd4d249e5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:20.803778 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff0a1643-c859-4362-bd21-4f046eac3db2 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:20.812794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff0a1643-c859-4362-bd21-4f046eac3db2 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:20.814163 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff0a1643-c859-4362-bd21-4f046eac3db2 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:20.815666 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff0a1643-c859-4362-bd21-4f046eac3db2 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:20.822152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff0a1643-c859-4362-bd21-4f046eac3db2 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:20.823286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff0a1643-c859-4362-bd21-4f046eac3db2 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:20.937646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cdc1f90a-4334-4810-8eaf-416832f849fa tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:20.946482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cdc1f90a-4334-4810-8eaf-416832f849fa tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:20.947925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cdc1f90a-4334-4810-8eaf-416832f849fa tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:20.949196 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cdc1f90a-4334-4810-8eaf-416832f849fa tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 200 len: 1568 microversion: 2.25 time: 0.272654 Oct 29 02:46:20.949880 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 154/333] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:20 2022] GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 1568 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:20.954676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1f44a17d-3bde-4c83-a045-1b150ed26394 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:20.992669 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1f44a17d-3bde-4c83-a045-1b150ed26394 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.041410 Oct 29 02:46:20.993269 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 155/334] 10.222.0.46 () {58 vars in 1155 bytes} [Sat Oct 29 02:46:20 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:46:20.997982 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-771552ce-78f7-43ed-b6bf-6731d87063c7 tempest-FlavorMetadataValidation-1335901994 tempest-FlavorMetadataValidation-1335901994-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:21.021703 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-771552ce-78f7-43ed-b6bf-6731d87063c7 tempest-FlavorMetadataValidation-1335901994 tempest-FlavorMetadataValidation-1335901994-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.027031 Oct 29 02:46:21.022683 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 156/335] 10.222.0.46 () {60 vars in 1187 bytes} [Sat Oct 29 02:46:20 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:21.031942 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-486aea99-a38b-4b92-aaf5-7df5bf495a23 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Calling method '.version_select at 0x7ff058507af0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:21.042428 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-486aea99-a38b-4b92-aaf5-7df5bf495a23 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:21.043633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-486aea99-a38b-4b92-aaf5-7df5bf495a23 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:21.044559 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-486aea99-a38b-4b92-aaf5-7df5bf495a23 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:21.064957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-486aea99-a38b-4b92-aaf5-7df5bf495a23 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:21.065741 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-486aea99-a38b-4b92-aaf5-7df5bf495a23 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:21.066351 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-486aea99-a38b-4b92-aaf5-7df5bf495a23 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:21.090687 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-486aea99-a38b-4b92-aaf5-7df5bf495a23 tempest-HostsAdminTestJSON-629616100 tempest-HostsAdminTestJSON-629616100-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hosts/n-h1-862967-2" status: 200 len: 598 microversion: 2.1 time: 0.066548 Oct 29 02:46:21.091504 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 157/336] 10.222.0.46 () {58 vars in 1170 bytes} [Sat Oct 29 02:46:21 2022] GET /compute/v2.1/os-hosts/n-h1-862967-2 => generated 598 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:21.096144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-ed89b41c-6cc7-4563-96d8-5dbed6f9a1ce req-d5e99b23-e438-414f-b01e-9cde72572dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b65a6807-c8ad-44d0-93d7-931037ca8afd", "name": "network-vif-plugged", "status": "completed", "tag": "bf521964-3ec5-4c49-a9de-c97ddd2ce980"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:21.106512 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ed89b41c-6cc7-4563-96d8-5dbed6f9a1ce req-d5e99b23-e438-414f-b01e-9cde72572dd2 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:21.106980 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ed89b41c-6cc7-4563-96d8-5dbed6f9a1ce req-d5e99b23-e438-414f-b01e-9cde72572dd2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:21.107401 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ed89b41c-6cc7-4563-96d8-5dbed6f9a1ce req-d5e99b23-e438-414f-b01e-9cde72572dd2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:21.127846 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-ed89b41c-6cc7-4563-96d8-5dbed6f9a1ce req-d5e99b23-e438-414f-b01e-9cde72572dd2 service nova] Creating event network-vif-plugged:bf521964-3ec5-4c49-a9de-c97ddd2ce980 for instance b65a6807-c8ad-44d0-93d7-931037ca8afd on n-h1-862967-2 Oct 29 02:46:21.133949 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-ed89b41c-6cc7-4563-96d8-5dbed6f9a1ce req-d5e99b23-e438-414f-b01e-9cde72572dd2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040744 Oct 29 02:46:21.135221 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 158/337] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:21.141637 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e20c9d8c-0030-4f4f-9b6f-18194036852d tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:21.150715 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-e20c9d8c-0030-4f4f-9b6f-18194036852d tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] HTTP exception thrown: Aggregate 15 could not be found. Oct 29 02:46:21.152991 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e20c9d8c-0030-4f4f-9b6f-18194036852d tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Request method failure captured: Oct 29 02:46:21.152991 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 29 02:46:21.152991 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:46:21.152991 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:46:21.152991 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:46:21.152991 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:46:21.152991 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:46:21.152991 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:46:21.152991 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:46:21.152991 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:21.152991 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPEXLh9w46zUo82nUzog3AQBsoTvm25GdLOR_5-NkdhifaeFzLSeQ_bv9iUI0Aimze23K6RipsXDChGTKFzMJOG-QeLqHnn4hPMvixonYXSXq8vm33pi6LlQ_EGqxRZLVXGHtxW6Hev7Oj-c8iuBdLQ21qEdSobDQhF-66OAx8lBgg Oct 29 02:46:21.152991 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:46:21.152991 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:46:21.152991 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:46:21.152991 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:46:21.152991 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:46:21.152991 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:46:21.152991 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: e7054093f8c94b4b8ef9eca6097e6c52 Oct 29 02:46:21.152991 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-AggregatesAdminTestJSON-2117528276 Oct 29 02:46:21.152991 n-d-862967-2 devstack@n-api.service[127125]: X-Role: admin,reader,member Oct 29 02:46:21.152991 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: admin,reader,member Oct 29 02:46:21.154181 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e7054093f8c94b4b8ef9eca6097e6c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e7054093f8c94b4b8ef9eca6097e6c52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e7054093f8c94b4b8ef9eca6097e6c52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e7054093f8c94b4b8ef9eca6097e6c52"}]}] Oct 29 02:46:21.154181 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-AggregatesAdminTestJSON-2117528276 Oct 29 02:46:21.154181 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: e7054093f8c94b4b8ef9eca6097e6c52 Oct 29 02:46:21.154181 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2117528276 Oct 29 02:46:21.154181 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-AggregatesAdminTestJSON-2117528276-project-admin Oct 29 02:46:21.154181 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:46:21.154181 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:46:21.154181 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 2493e114b4944ba796bb02a327b2d03b Oct 29 02:46:21.154181 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-AggregatesAdminTestJSON-2117528276-project-admin Oct 29 02:46:21.154181 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:46:21.154181 n-d-862967-2 devstack@n-api.service[127125]: exception: Aggregate 15 could not be found. Oct 29 02:46:21.154181 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '15'} Oct 29 02:46:21.154181 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:21.154881 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:21.154881 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 29 02:46:21.154881 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 29 02:46:21.154881 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 29 02:46:21.154881 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 29 02:46:21.154881 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:46:21.154881 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:46:21.154881 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 29 02:46:21.154881 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 29 02:46:21.154881 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:46:21.154881 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:46:21.154881 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 29 02:46:21.154881 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 29 02:46:21.154881 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 15 could not be found. Oct 29 02:46:21.154881 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:21.154881 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:21.154881 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:21.154881 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:21.154881 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:21.155866 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:21.155866 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:21.155866 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:21.155866 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:21.155866 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:21.155866 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 29 02:46:21.155866 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:21.155866 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 15 could not be found. Oct 29 02:46:21.155866 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:21.155866 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:21.155866 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:21.155866 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:21.155866 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:21.155866 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:21.155866 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:21.155866 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:21.155866 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 15 could not be found. Oct 29 02:46:21.155866 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:21.158809 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e20c9d8c-0030-4f4f-9b6f-18194036852d tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Returning 404 to user: Aggregate 15 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:21.159900 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e20c9d8c-0030-4f4f-9b6f-18194036852d tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/15" status: 404 len: 78 microversion: 2.1 time: 0.023378 Oct 29 02:46:21.161100 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 159/338] 10.222.0.46 () {58 vars in 1152 bytes} [Sat Oct 29 02:46:21 2022] GET /compute/v2.1/os-aggregates/15 => generated 78 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:46:21.172711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1c92f4c9-3b3d-4e5a-a6c2-4500c7ea2296 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:21.189366 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-1c92f4c9-3b3d-4e5a-a6c2-4500c7ea2296 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] HTTP exception thrown: Aggregate 15 could not be found. Oct 29 02:46:21.191389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1c92f4c9-3b3d-4e5a-a6c2-4500c7ea2296 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Request method failure captured: Oct 29 02:46:21.191389 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 29 02:46:21.191389 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:46:21.191389 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:46:21.191389 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:46:21.191389 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:46:21.191389 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:46:21.191389 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:46:21.191389 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:46:21.191389 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:21.191389 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPEXLh9w46zUo82nUzog3AQBsoTvm25GdLOR_5-NkdhifaeFzLSeQ_bv9iUI0Aimze23K6RipsXDChGTKFzMJOG-QeLqHnn4hPMvixonYXSXq8vm33pi6LlQ_EGqxRZLVXGHtxW6Hev7Oj-c8iuBdLQ21qEdSobDQhF-66OAx8lBgg Oct 29 02:46:21.191389 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:46:21.191389 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:46:21.191389 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:46:21.191389 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:46:21.191389 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:46:21.191389 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:46:21.191389 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: e7054093f8c94b4b8ef9eca6097e6c52 Oct 29 02:46:21.191389 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-AggregatesAdminTestJSON-2117528276 Oct 29 02:46:21.191389 n-d-862967-2 devstack@n-api.service[127125]: X-Role: admin,reader,member Oct 29 02:46:21.191389 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: admin,reader,member Oct 29 02:46:21.192595 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e7054093f8c94b4b8ef9eca6097e6c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e7054093f8c94b4b8ef9eca6097e6c52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e7054093f8c94b4b8ef9eca6097e6c52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e7054093f8c94b4b8ef9eca6097e6c52"}]}] Oct 29 02:46:21.192595 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-AggregatesAdminTestJSON-2117528276 Oct 29 02:46:21.192595 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: e7054093f8c94b4b8ef9eca6097e6c52 Oct 29 02:46:21.192595 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2117528276 Oct 29 02:46:21.192595 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-AggregatesAdminTestJSON-2117528276-project-admin Oct 29 02:46:21.192595 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:46:21.192595 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:46:21.192595 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 2493e114b4944ba796bb02a327b2d03b Oct 29 02:46:21.192595 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-AggregatesAdminTestJSON-2117528276-project-admin Oct 29 02:46:21.192595 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:46:21.192595 n-d-862967-2 devstack@n-api.service[127125]: exception: Aggregate 15 could not be found. Oct 29 02:46:21.192595 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '15'} Oct 29 02:46:21.192595 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:21.193481 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:21.193481 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 29 02:46:21.193481 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 29 02:46:21.193481 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 02:46:21.193481 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 02:46:21.193481 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:46:21.193481 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:46:21.193481 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:46:21.193481 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:46:21.193481 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 02:46:21.193481 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 02:46:21.193481 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 29 02:46:21.193481 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 29 02:46:21.193481 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:46:21.193481 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:46:21.193481 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 29 02:46:21.193481 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 29 02:46:21.193481 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:46:21.193481 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:46:21.194510 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 29 02:46:21.194510 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 29 02:46:21.194510 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 15 could not be found. Oct 29 02:46:21.194510 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:21.194510 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:21.194510 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:21.194510 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:21.194510 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:21.194510 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:21.194510 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:21.194510 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:21.194510 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:21.194510 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:21.194510 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 29 02:46:21.194510 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:21.194510 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 15 could not be found. Oct 29 02:46:21.194510 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:21.194510 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:21.194510 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:21.194510 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:21.194510 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:21.195594 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:21.195594 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:21.195594 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:21.195594 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 15 could not be found. Oct 29 02:46:21.195594 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:21.197486 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1c92f4c9-3b3d-4e5a-a6c2-4500c7ea2296 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Returning 404 to user: Aggregate 15 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:21.198534 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1c92f4c9-3b3d-4e5a-a6c2-4500c7ea2296 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/15" status: 404 len: 78 microversion: 2.1 time: 0.031809 Oct 29 02:46:21.200090 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 160/339] 10.222.0.46 () {58 vars in 1155 bytes} [Sat Oct 29 02:46:21 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 29 02:46:21.216411 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e9da526c-e6dd-447a-9836-4bbf83345b71 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1281196707"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:21.221243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.aggregate [None req-e9da526c-e6dd-447a-9836-4bbf83345b71 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Generated uuid dbc98b14-f1e8-4403-a940-cadaf8faf223 for aggregate {{(pid=127125) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:46:21.249574 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e9da526c-e6dd-447a-9836-4bbf83345b71 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.037160 Oct 29 02:46:21.251205 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 161/340] 10.222.0.46 () {60 vars in 1164 bytes} [Sat Oct 29 02:46:21 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:46:21.276096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fcc8d986-0401-4b10-b0c3-cc7783f9332a tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:21.301220 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fcc8d986-0401-4b10-b0c3-cc7783f9332a tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 228 microversion: 2.1 time: 0.032097 Oct 29 02:46:21.316887 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 162/341] 10.222.0.46 () {58 vars in 1152 bytes} [Sat Oct 29 02:46:21 2022] GET /compute/v2.1/os-aggregates/16 => generated 228 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:21.337397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4b26805f-5053-47a9-8a55-e86edd77e286 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:21.339288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4b26805f-5053-47a9-8a55-e86edd77e286 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: f4ce1c31-a9f8-4312-b7ac-09c736eb8bff] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:21.351084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b26805f-5053-47a9-8a55-e86edd77e286 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:21.352362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b26805f-5053-47a9-8a55-e86edd77e286 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:21.353411 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b26805f-5053-47a9-8a55-e86edd77e286 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:21.355326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b26805f-5053-47a9-8a55-e86edd77e286 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:21.356430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b26805f-5053-47a9-8a55-e86edd77e286 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:21.357457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b26805f-5053-47a9-8a55-e86edd77e286 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:21.511587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ff0a1643-c859-4362-bd21-4f046eac3db2 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ed858998a418b9948f5dc574e4ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89eadfa2b6054a58846e342008ab17da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:21.527416 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ff0a1643-c859-4362-bd21-4f046eac3db2 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] 10.222.0.46 "GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5" status: 200 len: 1471 microversion: 2.1 time: 0.750977 Oct 29 02:46:21.540563 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 180/342] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:20 2022] GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5 => generated 1471 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:21.551525 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e304ac8c-31bc-44f9-bb74-fccdc94d19fa tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:21.605560 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e304ac8c-31bc-44f9-bb74-fccdc94d19fa tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 266 microversion: 2.1 time: 0.071402 Oct 29 02:46:21.608888 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 181/343] 10.222.0.46 () {60 vars in 1194 bytes} [Sat Oct 29 02:46:21 2022] POST /compute/v2.1/os-aggregates/16/action => generated 266 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:21.617486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d11efa4f-7652-4073-b416-8d4fa9347a6c tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:21.618409 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d11efa4f-7652-4073-b416-8d4fa9347a6c tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] [instance: 59d3322c-0cf9-4251-8af6-7afbd4d249e5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:21.630128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d11efa4f-7652-4073-b416-8d4fa9347a6c tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:21.631625 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d11efa4f-7652-4073-b416-8d4fa9347a6c tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:21.632126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d11efa4f-7652-4073-b416-8d4fa9347a6c tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:21.632894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d11efa4f-7652-4073-b416-8d4fa9347a6c tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:21.633427 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d11efa4f-7652-4073-b416-8d4fa9347a6c tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:21.633848 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d11efa4f-7652-4073-b416-8d4fa9347a6c tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:21.665501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d11efa4f-7652-4073-b416-8d4fa9347a6c tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'f70ed858998a418b9948f5dc574e4ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89eadfa2b6054a58846e342008ab17da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:21.667740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d11efa4f-7652-4073-b416-8d4fa9347a6c tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Request method failure captured: Oct 29 02:46:21.667740 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5/diagnostics HTTP/1.1 Oct 29 02:46:21.667740 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:46:21.667740 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:46:21.667740 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:46:21.667740 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:46:21.667740 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:46:21.667740 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:46:21.667740 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:46:21.667740 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:21.667740 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPr_DhIeL4Zc4_bqerLLTr7RmHGuZAMkjx5Rwl4deTViNPQuiYpHDIXtzCYEg2OlVGVdlhEr1u3YVWDmaMPgamHUJyYXLIAcCQO-g2xwp871StLSzxHlqnsWhd1gx4RZWa-qp0kEDl3KzKdGjhSk8RDGRTFEpDLCTjHMxnIBduDe1E Oct 29 02:46:21.667740 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:46:21.667740 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:46:21.667740 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:46:21.667740 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:46:21.667740 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:46:21.667740 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:46:21.667740 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 89eadfa2b6054a58846e342008ab17da Oct 29 02:46:21.667740 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-254290537 Oct 29 02:46:21.667740 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:46:21.667740 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:46:21.669703 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/89eadfa2b6054a58846e342008ab17da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/89eadfa2b6054a58846e342008ab17da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_89eadfa2b6054a58846e342008ab17da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/89eadfa2b6054a58846e342008ab17da"}]}] Oct 29 02:46:21.669703 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-254290537 Oct 29 02:46:21.669703 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 89eadfa2b6054a58846e342008ab17da Oct 29 02:46:21.669703 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-254290537 Oct 29 02:46:21.669703 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServerDiagnosticsNegativeTest-254290537-project Oct 29 02:46:21.669703 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:46:21.669703 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:46:21.669703 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: f70ed858998a418b9948f5dc574e4ad7 Oct 29 02:46:21.669703 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-254290537-project Oct 29 02:46:21.669703 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:46:21.669703 n-d-862967-2 devstack@n-api.service[127124]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 29 02:46:21.670418 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'server_id': '59d3322c-0cf9-4251-8af6-7afbd4d249e5'} Oct 29 02:46:21.670418 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:21.670418 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:21.670418 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:21.670418 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:21.670418 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:21.670418 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:21.670418 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:21.670418 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:21.670418 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 29 02:46:21.670418 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 29 02:46:21.670418 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:46:21.670418 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:46:21.670418 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:46:21.670418 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:46:21.670418 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:46:21.670418 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:46:21.670418 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:46:21.670418 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:46:21.670418 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:46:21.671878 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:46:21.671878 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:46:21.671878 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:46:21.671878 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:46:21.671878 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:46:21.671878 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 29 02:46:21.671878 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:21.671878 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:21.671878 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:21.671878 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:21.671878 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:21.671878 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:21.671878 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:46:21.671878 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:46:21.671878 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 29 02:46:21.671878 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:21.671878 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d11efa4f-7652-4073-b416-8d4fa9347a6c tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:21.672856 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d11efa4f-7652-4073-b416-8d4fa9347a6c tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] 10.222.0.46 "GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.058264 Oct 29 02:46:21.672856 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 182/344] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:46:21 2022] GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5/diagnostics => generated 117 bytes in 59 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:21.681674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1c49b9a6-780c-448c-9baa-6a127d798dd9 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:21.691689 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1c49b9a6-780c-448c-9baa-6a127d798dd9 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 242 microversion: 2.1 time: 0.020526 Oct 29 02:46:21.692740 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 183/345] 10.222.0.46 () {58 vars in 1152 bytes} [Sat Oct 29 02:46:21 2022] GET /compute/v2.1/os-aggregates/16 => generated 242 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:21.700443 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0da6b54b-48b4-484e-8a5f-fa15a202cb8d tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:21.701119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0da6b54b-48b4-484e-8a5f-fa15a202cb8d tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] [instance: 59d3322c-0cf9-4251-8af6-7afbd4d249e5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:21.707980 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0da6b54b-48b4-484e-8a5f-fa15a202cb8d tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:21.708673 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0da6b54b-48b4-484e-8a5f-fa15a202cb8d tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:21.709400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0da6b54b-48b4-484e-8a5f-fa15a202cb8d tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:21.710201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0da6b54b-48b4-484e-8a5f-fa15a202cb8d tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:21.710785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0da6b54b-48b4-484e-8a5f-fa15a202cb8d tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:21.711258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0da6b54b-48b4-484e-8a5f-fa15a202cb8d tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:21.745054 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4b26805f-5053-47a9-8a55-e86edd77e286 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:21.753810 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0da6b54b-48b4-484e-8a5f-fa15a202cb8d tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] [instance: 59d3322c-0cf9-4251-8af6-7afbd4d249e5] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:46:21.787456 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4b26805f-5053-47a9-8a55-e86edd77e286 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff" status: 200 len: 1321 microversion: 2.1 time: 0.468486 Oct 29 02:46:21.808564 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 163/346] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:21 2022] GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff => generated 1321 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:21.818245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9d64b2e7-19d7-40a7-bca4-444e30db9918 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:21.853061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:21.864316 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9d64b2e7-19d7-40a7-bca4-444e30db9918 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.058579 Oct 29 02:46:21.866719 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 164/347] 10.222.0.46 () {58 vars in 1155 bytes} [Sat Oct 29 02:46:21 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:46:21.873472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-067ccb5b-3480-4289-979c-fbec56a73a6e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:21.875112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-067ccb5b-3480-4289-979c-fbec56a73a6e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: b65a6807-c8ad-44d0-93d7-931037ca8afd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:21.883555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-067ccb5b-3480-4289-979c-fbec56a73a6e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:21.884290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-067ccb5b-3480-4289-979c-fbec56a73a6e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:21.885155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-067ccb5b-3480-4289-979c-fbec56a73a6e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:21.886012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-067ccb5b-3480-4289-979c-fbec56a73a6e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:21.886597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-067ccb5b-3480-4289-979c-fbec56a73a6e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:21.887083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-067ccb5b-3480-4289-979c-fbec56a73a6e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:21.905555 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0da6b54b-48b4-484e-8a5f-fa15a202cb8d tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] 10.222.0.46 "DELETE /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5" status: 204 len: 0 microversion: 2.1 time: 0.210556 Oct 29 02:46:21.906150 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 184/348] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:46:21 2022] DELETE /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:46:21.915569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-43cbe950-f3c5-4133-80a6-d00eaf9f86b4 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-333538012", "availability_zone": "tempest-test_az-631709230"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:21.951825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.aggregate [None req-43cbe950-f3c5-4133-80a6-d00eaf9f86b4 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Generated uuid 2fc7714f-b667-4766-844a-d29c80151664 for aggregate {{(pid=127124) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:46:22.003008 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-43cbe950-f3c5-4133-80a6-d00eaf9f86b4 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.091084 Oct 29 02:46:22.005114 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 185/349] 10.222.0.46 () {60 vars in 1165 bytes} [Sat Oct 29 02:46:21 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:22.013242 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e8a1878e-38a2-4098-87ef-02441dc3d459 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:22.015007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e8a1878e-38a2-4098-87ef-02441dc3d459 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] [instance: 59d3322c-0cf9-4251-8af6-7afbd4d249e5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:22.025841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8a1878e-38a2-4098-87ef-02441dc3d459 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:22.026337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8a1878e-38a2-4098-87ef-02441dc3d459 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:22.026989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8a1878e-38a2-4098-87ef-02441dc3d459 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:22.027847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8a1878e-38a2-4098-87ef-02441dc3d459 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:22.028468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8a1878e-38a2-4098-87ef-02441dc3d459 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:22.028938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8a1878e-38a2-4098-87ef-02441dc3d459 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:22.086648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-067ccb5b-3480-4289-979c-fbec56a73a6e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:22.094409 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-067ccb5b-3480-4289-979c-fbec56a73a6e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/b65a6807-c8ad-44d0-93d7-931037ca8afd" status: 200 len: 1316 microversion: 2.1 time: 0.226604 Oct 29 02:46:22.095204 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 165/350] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:21 2022] GET /compute/v2.1/servers/b65a6807-c8ad-44d0-93d7-931037ca8afd => generated 1316 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:22.113649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5127b204-a7ae-4252-9c03-25340e086d38 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:22.114323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5127b204-a7ae-4252-9c03-25340e086d38 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:22.120938 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5127b204-a7ae-4252-9c03-25340e086d38 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:22.121518 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5127b204-a7ae-4252-9c03-25340e086d38 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:22.122009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5127b204-a7ae-4252-9c03-25340e086d38 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:22.122715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5127b204-a7ae-4252-9c03-25340e086d38 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:22.123165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5127b204-a7ae-4252-9c03-25340e086d38 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:22.123590 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5127b204-a7ae-4252-9c03-25340e086d38 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:22.341676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5127b204-a7ae-4252-9c03-25340e086d38 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:22.355784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5127b204-a7ae-4252-9c03-25340e086d38 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:22.357963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5127b204-a7ae-4252-9c03-25340e086d38 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:22.360491 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5127b204-a7ae-4252-9c03-25340e086d38 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 200 len: 1568 microversion: 2.25 time: 0.251695 Oct 29 02:46:22.362974 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 166/351] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:22 2022] GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 1568 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:22.370738 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-753e8bd4-8c94-40fa-89b9-498e2cade5b9 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-333538012_new", "availability_zone": "tempest-test_az-631709230_new"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:22.513168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e8a1878e-38a2-4098-87ef-02441dc3d459 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ed858998a418b9948f5dc574e4ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89eadfa2b6054a58846e342008ab17da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:22.513660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-753e8bd4-8c94-40fa-89b9-498e2cade5b9 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:22.513991 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-753e8bd4-8c94-40fa-89b9-498e2cade5b9 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:22.514523 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-753e8bd4-8c94-40fa-89b9-498e2cade5b9 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:22.527453 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e8a1878e-38a2-4098-87ef-02441dc3d459 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] 10.222.0.46 "GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5" status: 200 len: 1477 microversion: 2.1 time: 0.519315 Oct 29 02:46:22.528893 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 186/352] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:22 2022] GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5 => generated 1477 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:22.578911 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-753e8bd4-8c94-40fa-89b9-498e2cade5b9 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 334 microversion: 2.1 time: 0.213942 Oct 29 02:46:22.586273 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 167/353] 10.222.0.46 () {60 vars in 1173 bytes} [Sat Oct 29 02:46:22 2022] PUT /compute/v2.1/os-aggregates/17 => generated 334 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:22.596558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-81b08afe-b146-4808-b8cd-faf09c506e76 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:22.611654 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-81b08afe-b146-4808-b8cd-faf09c506e76 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates" status: 200 len: 337 microversion: 2.1 time: 0.023641 Oct 29 02:46:22.626345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=5 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:22.633976 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 187/354] 10.222.0.46 () {58 vars in 1143 bytes} [Sat Oct 29 02:46:22 2022] GET /compute/v2.1/os-aggregates => generated 337 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:22.635476 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6e3e4cf4-ac9d-43e4-b118-70e68d4e4fda tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:22.687667 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6e3e4cf4-ac9d-43e4-b118-70e68d4e4fda tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.059328 Oct 29 02:46:22.694390 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 168/355] 10.222.0.46 () {58 vars in 1155 bytes} [Sat Oct 29 02:46:22 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:46:22.702480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-226dfa48-a12d-4777-a1f8-5f0e863d9bc0 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-221190887"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:22.709807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.aggregate [None req-226dfa48-a12d-4777-a1f8-5f0e863d9bc0 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Generated uuid 7323ea07-805f-4ae6-a2ba-d01ddcfa1a63 for aggregate {{(pid=127124) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 02:46:22.759802 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-226dfa48-a12d-4777-a1f8-5f0e863d9bc0 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.062605 Oct 29 02:46:22.765423 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 188/356] 10.222.0.46 () {60 vars in 1164 bytes} [Sat Oct 29 02:46:22 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:22.781210 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5ebf1cf4-0719-479a-af8e-b24de5e4362f tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:22.810825 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5ebf1cf4-0719-479a-af8e-b24de5e4362f tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.036804 Oct 29 02:46:22.811812 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 169/357] 10.222.0.46 () {58 vars in 1143 bytes} [Sat Oct 29 02:46:22 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:22.839332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cbea62dc-dada-4c9c-8c16-2b664be8d708 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:22.853237 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7fc15ace-524f-4864-bf0e-899ad93df2d8 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:22.857000 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7fc15ace-524f-4864-bf0e-899ad93df2d8 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: f4ce1c31-a9f8-4312-b7ac-09c736eb8bff] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:22.883139 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fc15ace-524f-4864-bf0e-899ad93df2d8 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:22.883976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fc15ace-524f-4864-bf0e-899ad93df2d8 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:22.897762 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fc15ace-524f-4864-bf0e-899ad93df2d8 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:22.899973 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fc15ace-524f-4864-bf0e-899ad93df2d8 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:22.901017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fc15ace-524f-4864-bf0e-899ad93df2d8 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:22.902031 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fc15ace-524f-4864-bf0e-899ad93df2d8 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:22.912691 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cbea62dc-dada-4c9c-8c16-2b664be8d708 tempest-AggregatesAdminTestJSON-2117528276 tempest-AggregatesAdminTestJSON-2117528276-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.089719 Oct 29 02:46:22.918365 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 189/358] 10.222.0.46 () {58 vars in 1155 bytes} [Sat Oct 29 02:46:22 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 02:46:22.954413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b4b534c2-94aa-459c-96b8-44b302245354 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:22.955470 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b4b534c2-94aa-459c-96b8-44b302245354 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] [instance: 20072a0e-36ce-4bc7-b83e-7d88340ab50c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:22.969919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:22.998039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4b534c2-94aa-459c-96b8-44b302245354 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:23.000660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4b534c2-94aa-459c-96b8-44b302245354 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:23.001281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4b534c2-94aa-459c-96b8-44b302245354 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:23.002435 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4b534c2-94aa-459c-96b8-44b302245354 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:23.012953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4b534c2-94aa-459c-96b8-44b302245354 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:23.014225 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4b534c2-94aa-459c-96b8-44b302245354 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:23.049402 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-b4b534c2-94aa-459c-96b8-44b302245354 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] HTTP exception thrown: Instance 20072a0e-36ce-4bc7-b83e-7d88340ab50c could not be found. Oct 29 02:46:23.051880 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b4b534c2-94aa-459c-96b8-44b302245354 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Request method failure captured: Oct 29 02:46:23.051880 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c HTTP/1.1 Oct 29 02:46:23.051880 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:46:23.051880 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:46:23.051880 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:46:23.051880 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:46:23.051880 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:46:23.051880 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:46:23.051880 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:46:23.051880 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:23.051880 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPCeKefrAzj7tM6bIHrSdfnJm34XqT7S5RWcGU-mzW_YnzV0meFXxidu-NcdG0FfFKi_dzUWHbPAYdh-9qWozX0oNpiDKGJ2OeppyRGFT0Z885VHdtq-twAK-zWbnR9Il7jG9-QH_dIdWVdeWVPjoEg95gEcsrDzLa6M_-zQYmpYh8 Oct 29 02:46:23.051880 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:46:23.051880 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:46:23.051880 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:46:23.051880 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:46:23.051880 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:46:23.051880 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:46:23.051880 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 22f1de1bd2764e2994a4f1caaef0ad4d Oct 29 02:46:23.051880 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-AggregatesAdminTestJSON-734538025 Oct 29 02:46:23.051880 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:46:23.051880 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:46:23.054332 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/22f1de1bd2764e2994a4f1caaef0ad4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/22f1de1bd2764e2994a4f1caaef0ad4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_22f1de1bd2764e2994a4f1caaef0ad4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/22f1de1bd2764e2994a4f1caaef0ad4d"}]}] Oct 29 02:46:23.054332 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-AggregatesAdminTestJSON-734538025 Oct 29 02:46:23.054332 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 22f1de1bd2764e2994a4f1caaef0ad4d Oct 29 02:46:23.054332 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-734538025 Oct 29 02:46:23.054332 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-AggregatesAdminTestJSON-734538025-project Oct 29 02:46:23.054332 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:46:23.054332 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:46:23.054332 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 6eb72790532b484583be089c38656f74 Oct 29 02:46:23.054332 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-AggregatesAdminTestJSON-734538025-project Oct 29 02:46:23.054332 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:46:23.054332 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 20072a0e-36ce-4bc7-b83e-7d88340ab50c could not be found. Oct 29 02:46:23.054332 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '20072a0e-36ce-4bc7-b83e-7d88340ab50c'} Oct 29 02:46:23.055623 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:23.055623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:23.055623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:46:23.055623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:46:23.055623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:46:23.055623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:46:23.055623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:46:23.055623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:46:23.055623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:46:23.055623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:46:23.055623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20072a0e-36ce-4bc7-b83e-7d88340ab50c could not be found. Oct 29 02:46:23.055623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:23.055623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:23.055623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:23.055623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:23.055623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:23.055623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:23.055623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:23.055623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:23.055623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:23.058432 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:23.058432 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:46:23.058432 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:46:23.058432 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:46:23.058432 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:46:23.058432 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:46:23.058432 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:46:23.058432 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:46:23.058432 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:23.058432 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20072a0e-36ce-4bc7-b83e-7d88340ab50c could not be found. Oct 29 02:46:23.058432 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:23.058432 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:23.058432 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:23.058432 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:23.058432 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:23.058432 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:23.058432 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:23.058432 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:23.058432 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20072a0e-36ce-4bc7-b83e-7d88340ab50c could not be found. Oct 29 02:46:23.058432 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:23.063413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b4b534c2-94aa-459c-96b8-44b302245354 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Returning 404 to user: Instance 20072a0e-36ce-4bc7-b83e-7d88340ab50c could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:23.064694 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b4b534c2-94aa-459c-96b8-44b302245354 tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] 10.222.0.46 "DELETE /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c" status: 404 len: 111 microversion: 2.1 time: 0.137538 Oct 29 02:46:23.065784 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 190/359] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:46:22 2022] DELETE /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:23.085229 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3be4e8a1-1120-49a9-980a-22759326da1e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:23.086212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3be4e8a1-1120-49a9-980a-22759326da1e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] [instance: 20072a0e-36ce-4bc7-b83e-7d88340ab50c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:23.096684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3be4e8a1-1120-49a9-980a-22759326da1e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:23.097503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3be4e8a1-1120-49a9-980a-22759326da1e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:23.098277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3be4e8a1-1120-49a9-980a-22759326da1e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:23.099779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3be4e8a1-1120-49a9-980a-22759326da1e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:23.100471 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3be4e8a1-1120-49a9-980a-22759326da1e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:23.101281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3be4e8a1-1120-49a9-980a-22759326da1e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:23.123196 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-3be4e8a1-1120-49a9-980a-22759326da1e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] HTTP exception thrown: Instance 20072a0e-36ce-4bc7-b83e-7d88340ab50c could not be found. Oct 29 02:46:23.125349 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3be4e8a1-1120-49a9-980a-22759326da1e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Request method failure captured: Oct 29 02:46:23.125349 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c HTTP/1.1 Oct 29 02:46:23.125349 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:46:23.125349 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:46:23.125349 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:46:23.125349 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:46:23.125349 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:46:23.125349 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:46:23.125349 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:46:23.125349 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:23.125349 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPCeKefrAzj7tM6bIHrSdfnJm34XqT7S5RWcGU-mzW_YnzV0meFXxidu-NcdG0FfFKi_dzUWHbPAYdh-9qWozX0oNpiDKGJ2OeppyRGFT0Z885VHdtq-twAK-zWbnR9Il7jG9-QH_dIdWVdeWVPjoEg95gEcsrDzLa6M_-zQYmpYh8 Oct 29 02:46:23.125349 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:46:23.125349 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:46:23.125349 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:46:23.125349 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:46:23.125349 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:46:23.125349 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:46:23.125349 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 22f1de1bd2764e2994a4f1caaef0ad4d Oct 29 02:46:23.125349 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-AggregatesAdminTestJSON-734538025 Oct 29 02:46:23.125349 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:46:23.125349 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:46:23.126534 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/22f1de1bd2764e2994a4f1caaef0ad4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/22f1de1bd2764e2994a4f1caaef0ad4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_22f1de1bd2764e2994a4f1caaef0ad4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/22f1de1bd2764e2994a4f1caaef0ad4d"}]}] Oct 29 02:46:23.126534 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-AggregatesAdminTestJSON-734538025 Oct 29 02:46:23.126534 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 22f1de1bd2764e2994a4f1caaef0ad4d Oct 29 02:46:23.126534 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-734538025 Oct 29 02:46:23.126534 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-AggregatesAdminTestJSON-734538025-project Oct 29 02:46:23.126534 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:46:23.126534 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:46:23.126534 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 6eb72790532b484583be089c38656f74 Oct 29 02:46:23.126534 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-AggregatesAdminTestJSON-734538025-project Oct 29 02:46:23.126534 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:46:23.126534 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 20072a0e-36ce-4bc7-b83e-7d88340ab50c could not be found. Oct 29 02:46:23.126534 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '20072a0e-36ce-4bc7-b83e-7d88340ab50c'} Oct 29 02:46:23.127177 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:23.127177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:23.127177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:46:23.127177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:46:23.127177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:46:23.127177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:46:23.127177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:46:23.127177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:46:23.127177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:46:23.127177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:46:23.127177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20072a0e-36ce-4bc7-b83e-7d88340ab50c could not be found. Oct 29 02:46:23.127177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:23.127177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:23.127177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:23.127177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:23.127177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:23.127177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:23.127177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:23.127177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:23.127177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:23.128284 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:23.128284 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:46:23.128284 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:46:23.128284 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:46:23.128284 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:46:23.128284 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:46:23.128284 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:23.128284 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20072a0e-36ce-4bc7-b83e-7d88340ab50c could not be found. Oct 29 02:46:23.128284 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:23.128284 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:23.128284 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:23.128284 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:23.128284 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:23.128284 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:23.128284 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:23.128284 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:23.128284 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20072a0e-36ce-4bc7-b83e-7d88340ab50c could not be found. Oct 29 02:46:23.128284 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:23.131436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3be4e8a1-1120-49a9-980a-22759326da1e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] Returning 404 to user: Instance 20072a0e-36ce-4bc7-b83e-7d88340ab50c could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:23.132649 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3be4e8a1-1120-49a9-980a-22759326da1e tempest-AggregatesAdminTestJSON-734538025 tempest-AggregatesAdminTestJSON-734538025-project] 10.222.0.46 "GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c" status: 404 len: 111 microversion: 2.1 time: 0.061380 Oct 29 02:46:23.133751 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 191/360] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:23 2022] GET /compute/v2.1/servers/20072a0e-36ce-4bc7-b83e-7d88340ab50c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:46:23.139418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-97b00577-93d9-4e5a-aee0-e855a1d935e7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:23.141276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-97b00577-93d9-4e5a-aee0-e855a1d935e7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: b65a6807-c8ad-44d0-93d7-931037ca8afd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:23.158084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-97b00577-93d9-4e5a-aee0-e855a1d935e7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:23.158787 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-97b00577-93d9-4e5a-aee0-e855a1d935e7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:23.160092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-97b00577-93d9-4e5a-aee0-e855a1d935e7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:23.163181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-97b00577-93d9-4e5a-aee0-e855a1d935e7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:23.163954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-97b00577-93d9-4e5a-aee0-e855a1d935e7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:23.164785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-97b00577-93d9-4e5a-aee0-e855a1d935e7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:23.309924 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7fc15ace-524f-4864-bf0e-899ad93df2d8 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:23.331200 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7fc15ace-524f-4864-bf0e-899ad93df2d8 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff" status: 200 len: 1321 microversion: 2.1 time: 0.493769 Oct 29 02:46:23.334436 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 170/361] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:22 2022] GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff => generated 1321 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:23.391966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d1e062be-8885-4d9f-a5a0-e2d788d3ae0d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:23.392806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d1e062be-8885-4d9f-a5a0-e2d788d3ae0d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:23.404247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1e062be-8885-4d9f-a5a0-e2d788d3ae0d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:23.406254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1e062be-8885-4d9f-a5a0-e2d788d3ae0d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:23.406721 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1e062be-8885-4d9f-a5a0-e2d788d3ae0d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:23.409748 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1e062be-8885-4d9f-a5a0-e2d788d3ae0d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:23.410238 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1e062be-8885-4d9f-a5a0-e2d788d3ae0d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:23.410677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1e062be-8885-4d9f-a5a0-e2d788d3ae0d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:23.791214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d1e062be-8885-4d9f-a5a0-e2d788d3ae0d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:23.809677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d1e062be-8885-4d9f-a5a0-e2d788d3ae0d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:23.812563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d1e062be-8885-4d9f-a5a0-e2d788d3ae0d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:23.814977 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d1e062be-8885-4d9f-a5a0-e2d788d3ae0d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 200 len: 1568 microversion: 2.25 time: 0.425547 Oct 29 02:46:23.831140 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 171/362] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:23 2022] GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 1568 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:46:23.832288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-34ab1aa0-6711-4b68-ab44-13e3ca3fd3b1 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:23.833136 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-34ab1aa0-6711-4b68-ab44-13e3ca3fd3b1 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] [instance: 59d3322c-0cf9-4251-8af6-7afbd4d249e5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:23.851352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34ab1aa0-6711-4b68-ab44-13e3ca3fd3b1 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:23.857343 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34ab1aa0-6711-4b68-ab44-13e3ca3fd3b1 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:23.858085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34ab1aa0-6711-4b68-ab44-13e3ca3fd3b1 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:23.860382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34ab1aa0-6711-4b68-ab44-13e3ca3fd3b1 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:23.862326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34ab1aa0-6711-4b68-ab44-13e3ca3fd3b1 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:23.862665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34ab1aa0-6711-4b68-ab44-13e3ca3fd3b1 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:24.102601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-97b00577-93d9-4e5a-aee0-e855a1d935e7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:24.112517 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-97b00577-93d9-4e5a-aee0-e855a1d935e7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/b65a6807-c8ad-44d0-93d7-931037ca8afd" status: 200 len: 1466 microversion: 2.1 time: 0.977273 Oct 29 02:46:24.113120 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 192/363] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:23 2022] GET /compute/v2.1/servers/b65a6807-c8ad-44d0-93d7-931037ca8afd => generated 1466 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:24.314441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-34ab1aa0-6711-4b68-ab44-13e3ca3fd3b1 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ed858998a418b9948f5dc574e4ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89eadfa2b6054a58846e342008ab17da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:24.341512 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-34ab1aa0-6711-4b68-ab44-13e3ca3fd3b1 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] 10.222.0.46 "GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5" status: 200 len: 1477 microversion: 2.1 time: 0.520950 Oct 29 02:46:24.345408 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 172/364] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:23 2022] GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5 => generated 1477 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:24.367883 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0326b02d-6355-4492-8131-44a55add9a48 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:24.370524 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0326b02d-6355-4492-8131-44a55add9a48 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: f4ce1c31-a9f8-4312-b7ac-09c736eb8bff] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:24.403761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0326b02d-6355-4492-8131-44a55add9a48 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:24.406191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0326b02d-6355-4492-8131-44a55add9a48 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:24.407818 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0326b02d-6355-4492-8131-44a55add9a48 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:24.411231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0326b02d-6355-4492-8131-44a55add9a48 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:24.412898 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0326b02d-6355-4492-8131-44a55add9a48 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:24.413357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0326b02d-6355-4492-8131-44a55add9a48 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:24.826984 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0326b02d-6355-4492-8131-44a55add9a48 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:24.836696 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0326b02d-6355-4492-8131-44a55add9a48 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff" status: 200 len: 1321 microversion: 2.1 time: 0.482874 Oct 29 02:46:24.839489 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 173/365] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:24 2022] GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff => generated 1321 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:24.864331 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f4dcc6b5-2191-4ed0-955a-98b1dd7ae1bb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:24.866337 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f4dcc6b5-2191-4ed0-955a-98b1dd7ae1bb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:24.879647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4dcc6b5-2191-4ed0-955a-98b1dd7ae1bb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:24.880211 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4dcc6b5-2191-4ed0-955a-98b1dd7ae1bb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:24.880696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4dcc6b5-2191-4ed0-955a-98b1dd7ae1bb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:24.882104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4dcc6b5-2191-4ed0-955a-98b1dd7ae1bb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:24.883542 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4dcc6b5-2191-4ed0-955a-98b1dd7ae1bb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:24.883985 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4dcc6b5-2191-4ed0-955a-98b1dd7ae1bb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:25.026099 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-09ba0638-811e-4df5-834c-84a0648f6d62 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:25.031041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-09ba0638-811e-4df5-834c-84a0648f6d62 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] [instance: b65a6807-c8ad-44d0-93d7-931037ca8afd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:25.048293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09ba0638-811e-4df5-834c-84a0648f6d62 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:25.048850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09ba0638-811e-4df5-834c-84a0648f6d62 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:25.054397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09ba0638-811e-4df5-834c-84a0648f6d62 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:25.056900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09ba0638-811e-4df5-834c-84a0648f6d62 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:25.057467 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09ba0638-811e-4df5-834c-84a0648f6d62 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:25.060091 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09ba0638-811e-4df5-834c-84a0648f6d62 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:25.187234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f4dcc6b5-2191-4ed0-955a-98b1dd7ae1bb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:25.199402 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f4dcc6b5-2191-4ed0-955a-98b1dd7ae1bb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:25.201920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f4dcc6b5-2191-4ed0-955a-98b1dd7ae1bb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:25.204087 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f4dcc6b5-2191-4ed0-955a-98b1dd7ae1bb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 200 len: 1568 microversion: 2.25 time: 0.362900 Oct 29 02:46:25.206743 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 174/366] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:24 2022] GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 1568 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:25.375094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3529e847-202c-4ab5-8043-3d88d645e3d0 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:25.376687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3529e847-202c-4ab5-8043-3d88d645e3d0 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] [instance: 59d3322c-0cf9-4251-8af6-7afbd4d249e5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:25.399295 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3529e847-202c-4ab5-8043-3d88d645e3d0 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:25.400739 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3529e847-202c-4ab5-8043-3d88d645e3d0 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:25.401626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3529e847-202c-4ab5-8043-3d88d645e3d0 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:25.403469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3529e847-202c-4ab5-8043-3d88d645e3d0 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:25.404726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3529e847-202c-4ab5-8043-3d88d645e3d0 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:25.405447 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3529e847-202c-4ab5-8043-3d88d645e3d0 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:25.710766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3529e847-202c-4ab5-8043-3d88d645e3d0 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ed858998a418b9948f5dc574e4ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89eadfa2b6054a58846e342008ab17da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:25.732762 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3529e847-202c-4ab5-8043-3d88d645e3d0 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] 10.222.0.46 "GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5" status: 200 len: 1477 microversion: 2.1 time: 0.365934 Oct 29 02:46:25.735247 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 175/367] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:25 2022] GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5 => generated 1477 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:25.870764 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6397273f-4801-43ba-b35f-ad4d3fac68a8 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:25.871454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6397273f-4801-43ba-b35f-ad4d3fac68a8 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: f4ce1c31-a9f8-4312-b7ac-09c736eb8bff] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:25.880184 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6397273f-4801-43ba-b35f-ad4d3fac68a8 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:25.881300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6397273f-4801-43ba-b35f-ad4d3fac68a8 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:25.882153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6397273f-4801-43ba-b35f-ad4d3fac68a8 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:25.883192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6397273f-4801-43ba-b35f-ad4d3fac68a8 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:25.884282 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6397273f-4801-43ba-b35f-ad4d3fac68a8 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:25.885031 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6397273f-4801-43ba-b35f-ad4d3fac68a8 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:25.946640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=19 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:26.138809 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6397273f-4801-43ba-b35f-ad4d3fac68a8 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:26.150559 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6397273f-4801-43ba-b35f-ad4d3fac68a8 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff" status: 200 len: 1321 microversion: 2.1 time: 0.284241 Oct 29 02:46:26.152047 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 176/368] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:25 2022] GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff => generated 1321 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:26.233987 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-98a4e997-980b-479d-88db-260689cc334b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:26.234866 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-98a4e997-980b-479d-88db-260689cc334b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:26.244587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98a4e997-980b-479d-88db-260689cc334b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:26.245333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98a4e997-980b-479d-88db-260689cc334b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:26.247280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98a4e997-980b-479d-88db-260689cc334b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:26.250097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98a4e997-980b-479d-88db-260689cc334b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:26.250917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98a4e997-980b-479d-88db-260689cc334b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:26.251571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98a4e997-980b-479d-88db-260689cc334b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:26.657013 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-98a4e997-980b-479d-88db-260689cc334b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:26.676978 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-98a4e997-980b-479d-88db-260689cc334b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:26.682928 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-98a4e997-980b-479d-88db-260689cc334b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:26.688300 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-98a4e997-980b-479d-88db-260689cc334b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 200 len: 1568 microversion: 2.25 time: 0.456671 Oct 29 02:46:26.691648 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 177/369] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:26 2022] GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 1568 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:46:26.719820 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-6b1647b3-ada8-426a-b20c-855877e142ed req-c760fe03-4883-486f-abaf-c4ea35e33517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed", "name": "network-vif-unplugged", "status": "completed", "tag": "ca4ed483-67be-4b3f-884e-48df58de6a0e"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:26.756591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6b1647b3-ada8-426a-b20c-855877e142ed req-c760fe03-4883-486f-abaf-c4ea35e33517 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:26.758635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6b1647b3-ada8-426a-b20c-855877e142ed req-c760fe03-4883-486f-abaf-c4ea35e33517 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:26.759254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6b1647b3-ada8-426a-b20c-855877e142ed req-c760fe03-4883-486f-abaf-c4ea35e33517 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:26.782242 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-6b1647b3-ada8-426a-b20c-855877e142ed req-c760fe03-4883-486f-abaf-c4ea35e33517 service nova] Creating event network-vif-unplugged:ca4ed483-67be-4b3f-884e-48df58de6a0e for instance 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed on n-h2-862967-2 Oct 29 02:46:26.802412 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-6b1647b3-ada8-426a-b20c-855877e142ed req-c760fe03-4883-486f-abaf-c4ea35e33517 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107839 Oct 29 02:46:26.803090 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 178/370] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:26.814666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8f82d36b-09a9-4c60-bad1-c8c63d71f5b4 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:26.815377 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8f82d36b-09a9-4c60-bad1-c8c63d71f5b4 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] [instance: 59d3322c-0cf9-4251-8af6-7afbd4d249e5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:26.828890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f82d36b-09a9-4c60-bad1-c8c63d71f5b4 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:26.830554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f82d36b-09a9-4c60-bad1-c8c63d71f5b4 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:26.831503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f82d36b-09a9-4c60-bad1-c8c63d71f5b4 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:26.833487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f82d36b-09a9-4c60-bad1-c8c63d71f5b4 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:26.835297 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f82d36b-09a9-4c60-bad1-c8c63d71f5b4 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:26.836347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f82d36b-09a9-4c60-bad1-c8c63d71f5b4 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:26.847539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:27.178814 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-09ba0638-811e-4df5-834c-84a0648f6d62 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/b65a6807-c8ad-44d0-93d7-931037ca8afd" status: 200 len: 1617 microversion: 2.1 time: 3.029448 Oct 29 02:46:27.186316 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 193/371] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:24 2022] GET /compute/v2.1/servers/b65a6807-c8ad-44d0-93d7-931037ca8afd => generated 1617 bytes in 3042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:27.209203 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-46c7562f-d5bd-431b-bf58-f7bcef4a5718 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:27.214252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-46c7562f-d5bd-431b-bf58-f7bcef4a5718 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: f4ce1c31-a9f8-4312-b7ac-09c736eb8bff] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:27.232443 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46c7562f-d5bd-431b-bf58-f7bcef4a5718 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:27.239821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46c7562f-d5bd-431b-bf58-f7bcef4a5718 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:27.244234 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46c7562f-d5bd-431b-bf58-f7bcef4a5718 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:27.251353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46c7562f-d5bd-431b-bf58-f7bcef4a5718 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:27.253369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46c7562f-d5bd-431b-bf58-f7bcef4a5718 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:27.255471 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46c7562f-d5bd-431b-bf58-f7bcef4a5718 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:27.284143 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8f82d36b-09a9-4c60-bad1-c8c63d71f5b4 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ed858998a418b9948f5dc574e4ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89eadfa2b6054a58846e342008ab17da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:27.321711 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8f82d36b-09a9-4c60-bad1-c8c63d71f5b4 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] 10.222.0.46 "GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5" status: 200 len: 1477 microversion: 2.1 time: 0.517148 Oct 29 02:46:27.323396 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 179/372] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:26 2022] GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5 => generated 1477 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:27.338034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c42ffaa3-318c-4e2b-9018-18c8e9171321 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Action: 'create', calling method: .version_select at 0x7ff0585234c0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-682796421", "policies": ["affinity"]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:27.351801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=7,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:27.396974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-c42ffaa3-318c-4e2b-9018-18c8e9171321 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for project dcc6da8e69e041e19023a53a23e33393. Resources: {'server_groups'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:46:27.407348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-c42ffaa3-318c-4e2b-9018-18c8e9171321 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for user 509ce04aeb3847f084629201bd7ae5d6 and project dcc6da8e69e041e19023a53a23e33393. Resources: {'server_groups'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:46:27.535023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-c42ffaa3-318c-4e2b-9018-18c8e9171321 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for project dcc6da8e69e041e19023a53a23e33393. Resources: {'server_groups'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:46:27.553127 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-c42ffaa3-318c-4e2b-9018-18c8e9171321 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for user 509ce04aeb3847f084629201bd7ae5d6 and project dcc6da8e69e041e19023a53a23e33393. Resources: {'server_groups'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:46:27.604614 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c42ffaa3-318c-4e2b-9018-18c8e9171321 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.276170 Oct 29 02:46:27.606687 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 180/373] 10.222.0.46 () {60 vars in 1174 bytes} [Sat Oct 29 02:46:27 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:27.745122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a3d28aa8-420a-4c8e-8130-d87084efee06 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:27.748347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a3d28aa8-420a-4c8e-8130-d87084efee06 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:27.766461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3d28aa8-420a-4c8e-8130-d87084efee06 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:27.766979 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3d28aa8-420a-4c8e-8130-d87084efee06 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:27.767426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3d28aa8-420a-4c8e-8130-d87084efee06 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:27.770220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3d28aa8-420a-4c8e-8130-d87084efee06 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:27.770696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3d28aa8-420a-4c8e-8130-d87084efee06 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:27.772271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3d28aa8-420a-4c8e-8130-d87084efee06 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:28.116894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a3d28aa8-420a-4c8e-8130-d87084efee06 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:28.134392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a3d28aa8-420a-4c8e-8130-d87084efee06 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:28.135860 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a3d28aa8-420a-4c8e-8130-d87084efee06 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:28.137108 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a3d28aa8-420a-4c8e-8130-d87084efee06 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 200 len: 1568 microversion: 2.25 time: 0.400650 Oct 29 02:46:28.139287 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 181/374] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:27 2022] GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 1568 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:28.483233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-46c7562f-d5bd-431b-bf58-f7bcef4a5718 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:28.491980 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-46c7562f-d5bd-431b-bf58-f7bcef4a5718 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff" status: 200 len: 1321 microversion: 2.1 time: 1.303670 Oct 29 02:46:28.511656 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 194/375] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:27 2022] GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff => generated 1321 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:28.519777 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-73f56813-e6e7-4b69-9fb8-8ce8fb61597b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-601563019", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "de548a53-9d1f-4349-8654-a81238773ac6"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:28.621513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-73f56813-e6e7-4b69-9fb8-8ce8fb61597b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] validate_networks() for None {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:46:28.710681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f704bd5a-4030-4b5b-95c8-2c1af799142f tempest-InstanceUsageAuditLogTestJSON-270723516 tempest-InstanceUsageAuditLogTestJSON-270723516-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:28.759578 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f704bd5a-4030-4b5b-95c8-2c1af799142f tempest-InstanceUsageAuditLogTestJSON-270723516 tempest-InstanceUsageAuditLogTestJSON-270723516-project-admin] 10.222.0.46 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-29 02:46:27" status: 200 len: 318 microversion: 2.1 time: 0.618653 Oct 29 02:46:28.760390 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 182/376] 10.222.0.46 () {58 vars in 1251 bytes} [Sat Oct 29 02:46:28 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-29%2002%3A46%3A27 => generated 318 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:28.766643 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b8171f98-9352-48c6-9df0-162b2ecb47fb tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:28.767551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b8171f98-9352-48c6-9df0-162b2ecb47fb tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] [instance: 59d3322c-0cf9-4251-8af6-7afbd4d249e5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:28.778616 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8171f98-9352-48c6-9df0-162b2ecb47fb tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:28.779303 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8171f98-9352-48c6-9df0-162b2ecb47fb tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:28.780003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8171f98-9352-48c6-9df0-162b2ecb47fb tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:28.781516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8171f98-9352-48c6-9df0-162b2ecb47fb tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:28.782123 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8171f98-9352-48c6-9df0-162b2ecb47fb tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:28.782690 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8171f98-9352-48c6-9df0-162b2ecb47fb tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:28.823891 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8171f98-9352-48c6-9df0-162b2ecb47fb tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:28.825085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8171f98-9352-48c6-9df0-162b2ecb47fb tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:28.825787 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8171f98-9352-48c6-9df0-162b2ecb47fb tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:28.826609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-b8171f98-9352-48c6-9df0-162b2ecb47fb tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lazy-loading 'fault' on Instance uuid 59d3322c-0cf9-4251-8af6-7afbd4d249e5 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:28.908586 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b8171f98-9352-48c6-9df0-162b2ecb47fb tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f70ed858998a418b9948f5dc574e4ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89eadfa2b6054a58846e342008ab17da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:28.919829 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b8171f98-9352-48c6-9df0-162b2ecb47fb tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] 10.222.0.46 "GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5" status: 200 len: 1311 microversion: 2.1 time: 0.157866 Oct 29 02:46:28.924746 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 183/377] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:28 2022] GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5 => generated 1311 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:28.932794 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ef740f1d-cf6b-4ba6-a928-6e519a95f227 tempest-InstanceUsageAuditLogTestJSON-270723516 tempest-InstanceUsageAuditLogTestJSON-270723516-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:28.956944 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ef740f1d-cf6b-4ba6-a928-6e519a95f227 tempest-InstanceUsageAuditLogTestJSON-270723516 tempest-InstanceUsageAuditLogTestJSON-270723516-project-admin] 10.222.0.46 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.030008 Oct 29 02:46:28.957895 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 184/378] 10.222.0.46 () {58 vars in 1185 bytes} [Sat Oct 29 02:46:28 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:28.963739 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-0212173d-76d5-437f-b2b3-f64bc9ecd411 req-aab190b7-82fa-4036-b45f-0740d8c02c5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d3322c-0cf9-4251-8af6-7afbd4d249e5", "name": "network-vif-deleted", "tag": "fab8f890-e688-45b0-9679-3fcfe3b21ed1"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:28.993531 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0212173d-76d5-437f-b2b3-f64bc9ecd411 req-aab190b7-82fa-4036-b45f-0740d8c02c5e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:28.997903 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0212173d-76d5-437f-b2b3-f64bc9ecd411 req-aab190b7-82fa-4036-b45f-0740d8c02c5e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:29.004683 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0212173d-76d5-437f-b2b3-f64bc9ecd411 req-aab190b7-82fa-4036-b45f-0740d8c02c5e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:29.033454 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-0212173d-76d5-437f-b2b3-f64bc9ecd411 req-aab190b7-82fa-4036-b45f-0740d8c02c5e service nova] Creating event network-vif-deleted:fab8f890-e688-45b0-9679-3fcfe3b21ed1 for instance 59d3322c-0cf9-4251-8af6-7afbd4d249e5 on n-h2-862967-2 Oct 29 02:46:29.040149 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-0212173d-76d5-437f-b2b3-f64bc9ecd411 req-aab190b7-82fa-4036-b45f-0740d8c02c5e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080131 Oct 29 02:46:29.041770 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 185/379] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:29.174886 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b0d6d172-4771-4b8e-8a68-f1eb7be11e38 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:29.176227 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b0d6d172-4771-4b8e-8a68-f1eb7be11e38 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:29.190420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b0d6d172-4771-4b8e-8a68-f1eb7be11e38 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:29.190904 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b0d6d172-4771-4b8e-8a68-f1eb7be11e38 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:29.195147 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b0d6d172-4771-4b8e-8a68-f1eb7be11e38 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:29.198510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b0d6d172-4771-4b8e-8a68-f1eb7be11e38 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:29.199308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b0d6d172-4771-4b8e-8a68-f1eb7be11e38 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:29.199961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b0d6d172-4771-4b8e-8a68-f1eb7be11e38 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:29.508958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b0d6d172-4771-4b8e-8a68-f1eb7be11e38 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:29.533939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b0d6d172-4771-4b8e-8a68-f1eb7be11e38 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:29.537175 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b0d6d172-4771-4b8e-8a68-f1eb7be11e38 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:29.540672 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b0d6d172-4771-4b8e-8a68-f1eb7be11e38 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 200 len: 1568 microversion: 2.25 time: 0.370484 Oct 29 02:46:29.542071 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 186/380] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:29 2022] GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 1568 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:46:29.571546 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-faf459b0-581f-4fca-b6d9-eeaaaa19e5e9 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:29.572777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-faf459b0-581f-4fca-b6d9-eeaaaa19e5e9 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: f4ce1c31-a9f8-4312-b7ac-09c736eb8bff] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:29.583901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-faf459b0-581f-4fca-b6d9-eeaaaa19e5e9 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:29.585122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-faf459b0-581f-4fca-b6d9-eeaaaa19e5e9 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:29.585958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-faf459b0-581f-4fca-b6d9-eeaaaa19e5e9 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:29.587860 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-faf459b0-581f-4fca-b6d9-eeaaaa19e5e9 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:29.589210 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-faf459b0-581f-4fca-b6d9-eeaaaa19e5e9 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:29.590208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-faf459b0-581f-4fca-b6d9-eeaaaa19e5e9 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:29.621833 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-73f56813-e6e7-4b69-9fb8-8ce8fb61597b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:46:29.622350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-73f56813-e6e7-4b69-9fb8-8ce8fb61597b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:46:29.622706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-73f56813-e6e7-4b69-9fb8-8ce8fb61597b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:46:29.623397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-73f56813-e6e7-4b69-9fb8-8ce8fb61597b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:46:29.624663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-73f56813-e6e7-4b69-9fb8-8ce8fb61597b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:46:29.671686 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=16 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:29.689006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73f56813-e6e7-4b69-9fb8-8ce8fb61597b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:29.689490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73f56813-e6e7-4b69-9fb8-8ce8fb61597b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:29.690899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73f56813-e6e7-4b69-9fb8-8ce8fb61597b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:29.695536 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73f56813-e6e7-4b69-9fb8-8ce8fb61597b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:29.696341 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73f56813-e6e7-4b69-9fb8-8ce8fb61597b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:29.697042 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73f56813-e6e7-4b69-9fb8-8ce8fb61597b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:29.717313 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-73f56813-e6e7-4b69-9fb8-8ce8fb61597b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for project dcc6da8e69e041e19023a53a23e33393. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:46:29.723402 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-73f56813-e6e7-4b69-9fb8-8ce8fb61597b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for user 509ce04aeb3847f084629201bd7ae5d6 and project dcc6da8e69e041e19023a53a23e33393. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:46:29.739966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-73f56813-e6e7-4b69-9fb8-8ce8fb61597b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Going to run 2 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:46:29.743295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-73f56813-e6e7-4b69-9fb8-8ce8fb61597b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 6c325f03-e675-4cd8-928e-a09523951d3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:46:29.794981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-73f56813-e6e7-4b69-9fb8-8ce8fb61597b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=127124) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 29 02:46:29.853425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-faf459b0-581f-4fca-b6d9-eeaaaa19e5e9 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:29.861545 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-73f56813-e6e7-4b69-9fb8-8ce8fb61597b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for project dcc6da8e69e041e19023a53a23e33393. Resources: {'server_group_members'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:46:29.863142 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-faf459b0-581f-4fca-b6d9-eeaaaa19e5e9 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff" status: 200 len: 1321 microversion: 2.1 time: 0.304433 Oct 29 02:46:29.864558 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 187/381] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:29 2022] GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff => generated 1321 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:29.885761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-73f56813-e6e7-4b69-9fb8-8ce8fb61597b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for user 509ce04aeb3847f084629201bd7ae5d6 and project dcc6da8e69e041e19023a53a23e33393. Resources: {'server_group_members'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:46:29.921026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:INSERT=8,nova_api:RELEASE=1,nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:29.954940 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-88cb8fbd-8dbc-41bb-99c3-8a68ba82a2e3 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:29.959246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-88cb8fbd-8dbc-41bb-99c3-8a68ba82a2e3 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] [instance: 59d3322c-0cf9-4251-8af6-7afbd4d249e5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:29.961775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-73f56813-e6e7-4b69-9fb8-8ce8fb61597b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for project dcc6da8e69e041e19023a53a23e33393. Resources: {'server_group_members'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:46:29.967709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-73f56813-e6e7-4b69-9fb8-8ce8fb61597b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for user 509ce04aeb3847f084629201bd7ae5d6 and project dcc6da8e69e041e19023a53a23e33393. Resources: {'server_group_members'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:46:29.981371 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88cb8fbd-8dbc-41bb-99c3-8a68ba82a2e3 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:29.982929 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88cb8fbd-8dbc-41bb-99c3-8a68ba82a2e3 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:29.985120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88cb8fbd-8dbc-41bb-99c3-8a68ba82a2e3 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:29.986073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88cb8fbd-8dbc-41bb-99c3-8a68ba82a2e3 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:29.986876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88cb8fbd-8dbc-41bb-99c3-8a68ba82a2e3 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:29.989281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88cb8fbd-8dbc-41bb-99c3-8a68ba82a2e3 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:29.993554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-73f56813-e6e7-4b69-9fb8-8ce8fb61597b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 7bfceda7-a17c-40a9-afcc-767b96d5ac7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=6c325f03-e675-4cd8-928e-a09523951d3d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:46:30.030941 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-88cb8fbd-8dbc-41bb-99c3-8a68ba82a2e3 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] HTTP exception thrown: Instance 59d3322c-0cf9-4251-8af6-7afbd4d249e5 could not be found. Oct 29 02:46:30.037653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-88cb8fbd-8dbc-41bb-99c3-8a68ba82a2e3 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Request method failure captured: Oct 29 02:46:30.037653 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5 HTTP/1.1 Oct 29 02:46:30.037653 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:46:30.037653 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:46:30.037653 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:46:30.037653 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:46:30.037653 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:46:30.037653 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:46:30.037653 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:46:30.037653 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:30.037653 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPr_DhIeL4Zc4_bqerLLTr7RmHGuZAMkjx5Rwl4deTViNPQuiYpHDIXtzCYEg2OlVGVdlhEr1u3YVWDmaMPgamHUJyYXLIAcCQO-g2xwp871StLSzxHlqnsWhd1gx4RZWa-qp0kEDl3KzKdGjhSk8RDGRTFEpDLCTjHMxnIBduDe1E Oct 29 02:46:30.037653 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:46:30.037653 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:46:30.037653 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:46:30.037653 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:46:30.037653 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:46:30.037653 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:46:30.037653 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 89eadfa2b6054a58846e342008ab17da Oct 29 02:46:30.037653 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-254290537 Oct 29 02:46:30.037653 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:46:30.037653 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:46:30.039176 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/89eadfa2b6054a58846e342008ab17da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/89eadfa2b6054a58846e342008ab17da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_89eadfa2b6054a58846e342008ab17da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/89eadfa2b6054a58846e342008ab17da"}]}] Oct 29 02:46:30.039176 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-254290537 Oct 29 02:46:30.039176 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 89eadfa2b6054a58846e342008ab17da Oct 29 02:46:30.039176 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-254290537 Oct 29 02:46:30.039176 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerDiagnosticsNegativeTest-254290537-project Oct 29 02:46:30.039176 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:46:30.039176 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:46:30.039176 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: f70ed858998a418b9948f5dc574e4ad7 Oct 29 02:46:30.039176 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-254290537-project Oct 29 02:46:30.039176 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:46:30.039176 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 59d3322c-0cf9-4251-8af6-7afbd4d249e5 could not be found. Oct 29 02:46:30.039176 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '59d3322c-0cf9-4251-8af6-7afbd4d249e5'} Oct 29 02:46:30.039973 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:30.039973 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:30.039973 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:46:30.039973 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:46:30.039973 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:46:30.039973 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:46:30.039973 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:46:30.039973 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:46:30.039973 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:46:30.039973 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:46:30.039973 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59d3322c-0cf9-4251-8af6-7afbd4d249e5 could not be found. Oct 29 02:46:30.039973 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:30.039973 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:30.039973 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:30.039973 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:30.039973 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:30.039973 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:30.039973 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:30.039973 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:30.039973 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:30.041264 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:30.041264 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:46:30.041264 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:46:30.041264 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:46:30.041264 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:46:30.041264 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:46:30.041264 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:30.041264 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59d3322c-0cf9-4251-8af6-7afbd4d249e5 could not be found. Oct 29 02:46:30.041264 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:30.041264 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:30.041264 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:30.041264 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:30.041264 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:30.041264 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:30.041264 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:30.041264 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:30.041264 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59d3322c-0cf9-4251-8af6-7afbd4d249e5 could not be found. Oct 29 02:46:30.041264 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:30.045297 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-88cb8fbd-8dbc-41bb-99c3-8a68ba82a2e3 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] Returning 404 to user: Instance 59d3322c-0cf9-4251-8af6-7afbd4d249e5 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:30.046929 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-88cb8fbd-8dbc-41bb-99c3-8a68ba82a2e3 tempest-ServerDiagnosticsNegativeTest-254290537 tempest-ServerDiagnosticsNegativeTest-254290537-project] 10.222.0.46 "GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5" status: 404 len: 111 microversion: 2.1 time: 0.102452 Oct 29 02:46:30.055883 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 188/382] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:29 2022] GET /compute/v2.1/servers/59d3322c-0cf9-4251-8af6-7afbd4d249e5 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:30.150247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-73f56813-e6e7-4b69-9fb8-8ce8fb61597b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for project dcc6da8e69e041e19023a53a23e33393. Resources: {'server_group_members'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:46:30.163219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-73f56813-e6e7-4b69-9fb8-8ce8fb61597b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for user 509ce04aeb3847f084629201bd7ae5d6 and project dcc6da8e69e041e19023a53a23e33393. Resources: {'server_group_members'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:46:30.226213 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-12cced2e-ee74-4f47-a128-17e8cbf225dd req-380410db-eb2f-49c5-8812-6e9c09b2c6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4ce1c31-a9f8-4312-b7ac-09c736eb8bff", "name": "network-vif-plugged", "status": "completed", "tag": "52c3ac9d-fa0e-4f9e-9473-a653ab543c14"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:30.246568 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-12cced2e-ee74-4f47-a128-17e8cbf225dd req-380410db-eb2f-49c5-8812-6e9c09b2c6b0 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:30.248259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-12cced2e-ee74-4f47-a128-17e8cbf225dd req-380410db-eb2f-49c5-8812-6e9c09b2c6b0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:30.248784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-12cced2e-ee74-4f47-a128-17e8cbf225dd req-380410db-eb2f-49c5-8812-6e9c09b2c6b0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:30.284151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-73f56813-e6e7-4b69-9fb8-8ce8fb61597b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for project dcc6da8e69e041e19023a53a23e33393. Resources: {'server_group_members'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:46:30.284960 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-12cced2e-ee74-4f47-a128-17e8cbf225dd req-380410db-eb2f-49c5-8812-6e9c09b2c6b0 service nova] Creating event network-vif-plugged:52c3ac9d-fa0e-4f9e-9473-a653ab543c14 for instance f4ce1c31-a9f8-4312-b7ac-09c736eb8bff on n-h2-862967-2 Oct 29 02:46:30.301443 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-73f56813-e6e7-4b69-9fb8-8ce8fb61597b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for user 509ce04aeb3847f084629201bd7ae5d6 and project dcc6da8e69e041e19023a53a23e33393. Resources: {'server_group_members'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:46:30.304116 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-12cced2e-ee74-4f47-a128-17e8cbf225dd req-380410db-eb2f-49c5-8812-6e9c09b2c6b0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077601 Oct 29 02:46:30.306223 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 189/383] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:46:30.413459 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-73f56813-e6e7-4b69-9fb8-8ce8fb61597b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.900308 Oct 29 02:46:30.419459 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 195/384] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:46:28 2022] POST /compute/v2.1/servers => generated 32 bytes in 1907 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 29 02:46:30.426968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-134f48d0-0047-4d24-888b-33a20035cea1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:30.448030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-134f48d0-0047-4d24-888b-33a20035cea1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:30.448617 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-134f48d0-0047-4d24-888b-33a20035cea1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Searching by: {'deleted': False, 'project_id': 'dcc6da8e69e041e19023a53a23e33393'} {{(pid=127125) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:46:30.510245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-134f48d0-0047-4d24-888b-33a20035cea1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:30.510731 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-134f48d0-0047-4d24-888b-33a20035cea1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:30.511167 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-134f48d0-0047-4d24-888b-33a20035cea1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:30.513994 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-134f48d0-0047-4d24-888b-33a20035cea1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:30.516152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-134f48d0-0047-4d24-888b-33a20035cea1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:30.516660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-134f48d0-0047-4d24-888b-33a20035cea1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:30.587095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b57cfb2a-0615-49d8-9754-9bd3af8229c2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:30.590746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b57cfb2a-0615-49d8-9754-9bd3af8229c2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:30.636985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b57cfb2a-0615-49d8-9754-9bd3af8229c2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:30.654179 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b57cfb2a-0615-49d8-9754-9bd3af8229c2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:30.655115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b57cfb2a-0615-49d8-9754-9bd3af8229c2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:30.656334 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b57cfb2a-0615-49d8-9754-9bd3af8229c2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:30.657143 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b57cfb2a-0615-49d8-9754-9bd3af8229c2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:30.657861 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b57cfb2a-0615-49d8-9754-9bd3af8229c2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:30.991371 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.multi_cell_list [None req-134f48d0-0047-4d24-888b-33a20035cea1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=127125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 02:46:31.261660 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-134f48d0-0047-4d24-888b-33a20035cea1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 1001 microversion: 2.1 time: 0.842107 Oct 29 02:46:31.273352 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 190/385] 10.222.0.46 () {58 vars in 1125 bytes} [Sat Oct 29 02:46:30 2022] GET /compute/v2.1/servers => generated 1001 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:31.301926 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ef3d44c5-3371-4c78-a127-54d4bdce3685 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:31.304988 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ef3d44c5-3371-4c78-a127-54d4bdce3685 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: f4ce1c31-a9f8-4312-b7ac-09c736eb8bff] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:31.336084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef3d44c5-3371-4c78-a127-54d4bdce3685 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:31.338879 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef3d44c5-3371-4c78-a127-54d4bdce3685 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:31.340271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef3d44c5-3371-4c78-a127-54d4bdce3685 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:31.342912 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef3d44c5-3371-4c78-a127-54d4bdce3685 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:31.346448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef3d44c5-3371-4c78-a127-54d4bdce3685 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:31.350131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef3d44c5-3371-4c78-a127-54d4bdce3685 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:31.667544 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b57cfb2a-0615-49d8-9754-9bd3af8229c2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:31.676409 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b57cfb2a-0615-49d8-9754-9bd3af8229c2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:31.682251 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b57cfb2a-0615-49d8-9754-9bd3af8229c2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:31.684970 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b57cfb2a-0615-49d8-9754-9bd3af8229c2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 200 len: 1568 microversion: 2.25 time: 1.112478 Oct 29 02:46:31.686122 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 196/386] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:30 2022] GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 1568 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:31.878634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ef3d44c5-3371-4c78-a127-54d4bdce3685 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:31.903235 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ef3d44c5-3371-4c78-a127-54d4bdce3685 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff" status: 200 len: 1321 microversion: 2.1 time: 0.626148 Oct 29 02:46:31.918407 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 191/387] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:31 2022] GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff => generated 1321 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:31.957900 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5e6a111b-848a-4c8d-b7f3-93e62678daa6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:31.958762 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5e6a111b-848a-4c8d-b7f3-93e62678daa6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 7bfceda7-a17c-40a9-afcc-767b96d5ac7b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:32.110692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5e6a111b-848a-4c8d-b7f3-93e62678daa6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:32.162963 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5e6a111b-848a-4c8d-b7f3-93e62678daa6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b" status: 200 len: 1218 microversion: 2.1 time: 0.237190 Oct 29 02:46:32.168617 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 192/388] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:31 2022] GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b => generated 1218 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:32.606022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4fef6fc5-6f0e-4f09-b5a8-938ccb669d97 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1677868311", "ram": 512, "vcpus": 1, "disk": 10, "id": 2075554938, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:32.642047 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4fef6fc5-6f0e-4f09-b5a8-938ccb669d97 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.954046 Oct 29 02:46:32.645948 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 197/389] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:46:31 2022] POST /compute/v2.1/flavors => generated 416 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:32.652208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-36ffe038-8c1c-4ff4-95f7-a43b35fc1ec6 req-35443850-6d62-4ab7-9c49-2d537af88e1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed", "tag": "ca4ed483-67be-4b3f-884e-48df58de6a0e"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:32.666849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-36ffe038-8c1c-4ff4-95f7-a43b35fc1ec6 req-35443850-6d62-4ab7-9c49-2d537af88e1d service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:32.667813 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-36ffe038-8c1c-4ff4-95f7-a43b35fc1ec6 req-35443850-6d62-4ab7-9c49-2d537af88e1d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:32.669588 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-36ffe038-8c1c-4ff4-95f7-a43b35fc1ec6 req-35443850-6d62-4ab7-9c49-2d537af88e1d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:32.695245 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-36ffe038-8c1c-4ff4-95f7-a43b35fc1ec6 req-35443850-6d62-4ab7-9c49-2d537af88e1d service nova] Creating event network-changed:ca4ed483-67be-4b3f-884e-48df58de6a0e for instance 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed on n-h2-862967-2 Oct 29 02:46:32.702676 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-36ffe038-8c1c-4ff4-95f7-a43b35fc1ec6 req-35443850-6d62-4ab7-9c49-2d537af88e1d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054185 Oct 29 02:46:32.708166 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 198/390] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:32.959498 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7fb8935e-68a5-4ca0-ab1d-12ff1be331eb tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Calling method '.version_select at 0x7ff0583589d0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:32.971292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fb8935e-68a5-4ca0-ab1d-12ff1be331eb tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:32.975628 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fb8935e-68a5-4ca0-ab1d-12ff1be331eb tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:32.977202 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fb8935e-68a5-4ca0-ab1d-12ff1be331eb tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:33.050447 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fb8935e-68a5-4ca0-ab1d-12ff1be331eb tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:33.053070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fb8935e-68a5-4ca0-ab1d-12ff1be331eb tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:33.053449 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fb8935e-68a5-4ca0-ab1d-12ff1be331eb tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:33.085280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fb8935e-68a5-4ca0-ab1d-12ff1be331eb tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:33.086513 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fb8935e-68a5-4ca0-ab1d-12ff1be331eb tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:33.087576 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fb8935e-68a5-4ca0-ab1d-12ff1be331eb tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:33.097897 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7fb8935e-68a5-4ca0-ab1d-12ff1be331eb tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.923744 Oct 29 02:46:33.099452 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 193/391] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:46:32 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:33.107070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-52bd6f38-13ab-479b-b4e2-6b8d6f4a59d6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:33.110268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-52bd6f38-13ab-479b-b4e2-6b8d6f4a59d6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:33.130250 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52bd6f38-13ab-479b-b4e2-6b8d6f4a59d6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:33.133526 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52bd6f38-13ab-479b-b4e2-6b8d6f4a59d6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:33.133526 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52bd6f38-13ab-479b-b4e2-6b8d6f4a59d6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:33.133832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52bd6f38-13ab-479b-b4e2-6b8d6f4a59d6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:33.134585 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52bd6f38-13ab-479b-b4e2-6b8d6f4a59d6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:33.137421 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52bd6f38-13ab-479b-b4e2-6b8d6f4a59d6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:33.309162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d30db305-5e2a-47a1-b1ba-03cbb2635c7a tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:33.326037 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-d30db305-5e2a-47a1-b1ba-03cbb2635c7a tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801-project] HTTP exception thrown: Flavor 2075554938 has no extra specs with key hw:cpu_thread_policy. Oct 29 02:46:33.328050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d30db305-5e2a-47a1-b1ba-03cbb2635c7a tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801-project] Request method failure captured: Oct 29 02:46:33.328050 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/flavors/2075554938/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 29 02:46:33.328050 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:46:33.328050 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:46:33.328050 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:46:33.328050 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:46:33.328050 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:46:33.328050 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:46:33.328050 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:46:33.328050 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:33.328050 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJQE1g9wWKs3mv-XM8Ib4TYCwOv1oXPEoJL8Gi-KmfJjpt0D3nQqf_Il_ulRPlPArVxlfuhm3KjerutGLKd9axD9VGoj0fQ15tAhb6eXGr7onYUfWbvVksLhRMXdKuNxvDHSjnD32g5yF0UnlUBV8JiW1E6w-an4uUP_rsiRsmLomX8 Oct 29 02:46:33.328050 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:46:33.328050 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:46:33.328050 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:46:33.328050 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:46:33.328050 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:46:33.328050 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:46:33.328050 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: d27260df950a4fbfa0ad248f01701a6c Oct 29 02:46:33.328050 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 Oct 29 02:46:33.328050 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:46:33.328050 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:46:33.329506 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d27260df950a4fbfa0ad248f01701a6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d27260df950a4fbfa0ad248f01701a6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d27260df950a4fbfa0ad248f01701a6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d27260df950a4fbfa0ad248f01701a6c"}]}] Oct 29 02:46:33.329506 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 Oct 29 02:46:33.329506 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: d27260df950a4fbfa0ad248f01701a6c Oct 29 02:46:33.329506 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 Oct 29 02:46:33.329506 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801-project Oct 29 02:46:33.329506 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:46:33.329506 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:46:33.329506 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: bddb0685f87c48d784e7ac12cbe823db Oct 29 02:46:33.329506 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801-project Oct 29 02:46:33.329506 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:46:33.329506 n-d-862967-2 devstack@n-api.service[127124]: exception: Flavor 2075554938 has no extra specs with key hw:cpu_thread_policy. Oct 29 02:46:33.330128 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'flavor_id': '2075554938', 'id': 'hw:cpu_thread_policy'} Oct 29 02:46:33.330128 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:33.330128 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:33.330128 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 29 02:46:33.330128 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 29 02:46:33.330128 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 29 02:46:33.330128 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:33.330128 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:33.330128 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:33.330128 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:33.330128 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:33.330128 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:33.330128 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:33.330128 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:33.330128 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:33.330128 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:33.330128 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 29 02:46:33.330128 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 02:46:33.330128 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2075554938 has no extra specs with key hw:cpu_thread_policy. Oct 29 02:46:33.330128 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:33.330128 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:33.330128 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:33.331375 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:33.331375 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:33.331375 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:33.331375 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:33.331375 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:33.331375 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2075554938 has no extra specs with key hw:cpu_thread_policy. Oct 29 02:46:33.331375 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:33.341624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d30db305-5e2a-47a1-b1ba-03cbb2635c7a tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801-project] Returning 404 to user: Flavor 2075554938 has no extra specs with key hw:cpu_thread_policy. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:33.343118 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d30db305-5e2a-47a1-b1ba-03cbb2635c7a tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801-project] 10.222.0.46 "GET /compute/v2.1/flavors/2075554938/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.632674 Oct 29 02:46:33.350889 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 199/392] 10.222.0.46 () {58 vars in 1266 bytes} [Sat Oct 29 02:46:32 2022] GET /compute/v2.1/flavors/2075554938/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 642 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:33.358175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-55e354c7-1456-48ce-97ff-c3a1993bb94b tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:33.360277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-55e354c7-1456-48ce-97ff-c3a1993bb94b tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: f4ce1c31-a9f8-4312-b7ac-09c736eb8bff] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:33.376305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55e354c7-1456-48ce-97ff-c3a1993bb94b tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:33.378227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55e354c7-1456-48ce-97ff-c3a1993bb94b tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:33.381492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55e354c7-1456-48ce-97ff-c3a1993bb94b tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:33.383669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55e354c7-1456-48ce-97ff-c3a1993bb94b tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:33.385319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55e354c7-1456-48ce-97ff-c3a1993bb94b tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:33.386761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55e354c7-1456-48ce-97ff-c3a1993bb94b tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:33.467325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-52bd6f38-13ab-479b-b4e2-6b8d6f4a59d6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:33.510593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-52bd6f38-13ab-479b-b4e2-6b8d6f4a59d6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:33.513214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-52bd6f38-13ab-479b-b4e2-6b8d6f4a59d6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:33.523423 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-52bd6f38-13ab-479b-b4e2-6b8d6f4a59d6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 200 len: 1568 microversion: 2.25 time: 0.422521 Oct 29 02:46:33.525276 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 194/393] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:33 2022] GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 1568 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:33.994719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-55e354c7-1456-48ce-97ff-c3a1993bb94b tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:34.002552 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-55e354c7-1456-48ce-97ff-c3a1993bb94b tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff" status: 200 len: 1471 microversion: 2.1 time: 0.650057 Oct 29 02:46:34.011468 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 200/394] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:33 2022] GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff => generated 1471 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:34.020615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ee18cf6b-4769-4e7c-98db-ed934be2895b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:34.022015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ee18cf6b-4769-4e7c-98db-ed934be2895b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 7bfceda7-a17c-40a9-afcc-767b96d5ac7b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:34.034038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee18cf6b-4769-4e7c-98db-ed934be2895b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:34.034695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee18cf6b-4769-4e7c-98db-ed934be2895b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:34.035378 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee18cf6b-4769-4e7c-98db-ed934be2895b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:34.036098 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee18cf6b-4769-4e7c-98db-ed934be2895b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:34.036565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee18cf6b-4769-4e7c-98db-ed934be2895b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:34.041290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee18cf6b-4769-4e7c-98db-ed934be2895b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:34.155655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ee18cf6b-4769-4e7c-98db-ed934be2895b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:34.179149 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ee18cf6b-4769-4e7c-98db-ed934be2895b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b" status: 200 len: 1270 microversion: 2.1 time: 0.166378 Oct 29 02:46:34.179747 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 201/395] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:34 2022] GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:34.185001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7cdf1a06-c992-458a-99cc-d5dfcfe8f798 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:34.188361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7cdf1a06-c992-458a-99cc-d5dfcfe8f798 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'bddb0685f87c48d784e7ac12cbe823db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27260df950a4fbfa0ad248f01701a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:34.196107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7cdf1a06-c992-458a-99cc-d5dfcfe8f798 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801-project] Request method failure captured: Oct 29 02:46:34.196107 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/flavors/2075554938/os-extra_specs HTTP/1.1 Oct 29 02:46:34.196107 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:46:34.196107 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:46:34.196107 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:46:34.196107 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 66 Oct 29 02:46:34.196107 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:46:34.196107 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:46:34.196107 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:46:34.196107 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:34.196107 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJQE1g9wWKs3mv-XM8Ib4TYCwOv1oXPEoJL8Gi-KmfJjpt0D3nQqf_Il_ulRPlPArVxlfuhm3KjerutGLKd9axD9VGoj0fQ15tAhb6eXGr7onYUfWbvVksLhRMXdKuNxvDHSjnD32g5yF0UnlUBV8JiW1E6w-an4uUP_rsiRsmLomX8 Oct 29 02:46:34.196107 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:46:34.196107 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:46:34.196107 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:46:34.196107 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:46:34.196107 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:46:34.196107 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:46:34.196107 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: d27260df950a4fbfa0ad248f01701a6c Oct 29 02:46:34.196107 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 Oct 29 02:46:34.196107 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:46:34.196107 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:46:34.198153 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d27260df950a4fbfa0ad248f01701a6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d27260df950a4fbfa0ad248f01701a6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d27260df950a4fbfa0ad248f01701a6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d27260df950a4fbfa0ad248f01701a6c"}]}] Oct 29 02:46:34.198153 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 Oct 29 02:46:34.198153 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: d27260df950a4fbfa0ad248f01701a6c Oct 29 02:46:34.198153 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 Oct 29 02:46:34.198153 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801-project Oct 29 02:46:34.198153 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:46:34.198153 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:46:34.198153 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: bddb0685f87c48d784e7ac12cbe823db Oct 29 02:46:34.198153 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801-project Oct 29 02:46:34.198153 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:46:34.198153 n-d-862967-2 devstack@n-api.service[127124]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 29 02:46:34.198153 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:46:34.201849 n-d-862967-2 devstack@n-api.service[127124]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 29 02:46:34.201849 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'flavor_id': '2075554938', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 29 02:46:34.201849 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:34.201849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:34.201849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:34.201849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:34.201849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:34.201849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:34.201849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:34.201849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:34.201849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:46:34.201849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:34.201849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 29 02:46:34.201849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 29 02:46:34.201849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:46:34.201849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:46:34.201849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:46:34.201849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:46:34.201849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:46:34.207833 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:46:34.207833 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:46:34.207833 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:46:34.207833 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:46:34.207833 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:46:34.207833 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:46:34.207833 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:46:34.207833 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:46:34.207833 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:46:34.207833 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 29 02:46:34.207833 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:34.207833 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:34.207833 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:34.207833 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:34.207833 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:34.207833 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:34.207833 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:46:34.207833 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:46:34.207833 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 29 02:46:34.207833 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:34.214749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7cdf1a06-c992-458a-99cc-d5dfcfe8f798 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:34.214749 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7cdf1a06-c992-458a-99cc-d5dfcfe8f798 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801-project] 10.222.0.46 "POST /compute/v2.1/flavors/2075554938/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.016735 Oct 29 02:46:34.214749 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 202/396] 10.222.0.46 () {60 vars in 1224 bytes} [Sat Oct 29 02:46:34 2022] POST /compute/v2.1/flavors/2075554938/os-extra_specs => generated 124 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:34.214749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-82d5b80b-5c34-4ddd-9fe9-82a973df75bf tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:34.214749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-82d5b80b-5c34-4ddd-9fe9-82a973df75bf tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] [instance: f4ce1c31-a9f8-4312-b7ac-09c736eb8bff] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:34.232216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82d5b80b-5c34-4ddd-9fe9-82a973df75bf tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:34.241737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82d5b80b-5c34-4ddd-9fe9-82a973df75bf tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:34.242479 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82d5b80b-5c34-4ddd-9fe9-82a973df75bf tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:34.243348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82d5b80b-5c34-4ddd-9fe9-82a973df75bf tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:34.243908 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82d5b80b-5c34-4ddd-9fe9-82a973df75bf tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:34.244431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82d5b80b-5c34-4ddd-9fe9-82a973df75bf tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:34.245479 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c61a9d33-ccee-4783-9ec4-587dfad13131 tempest-HypervisorAdminNegativeUnderV252Test-1354090398 tempest-HypervisorAdminNegativeUnderV252Test-1354090398-project] Calling method '.version_select at 0x7ff058331310>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:34.255091 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c61a9d33-ccee-4783-9ec4-587dfad13131 tempest-HypervisorAdminNegativeUnderV252Test-1354090398 tempest-HypervisorAdminNegativeUnderV252Test-1354090398-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '6b3c5470b050456b88c1fb88dfd5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e1529c462b4d3aa8d4261cb0b8c1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:34.266223 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c61a9d33-ccee-4783-9ec4-587dfad13131 tempest-HypervisorAdminNegativeUnderV252Test-1354090398 tempest-HypervisorAdminNegativeUnderV252Test-1354090398-project] Request method failure captured: Oct 29 02:46:34.266223 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/os-hypervisors/n-h2-862967-2/search HTTP/1.1 Oct 29 02:46:34.266223 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:46:34.266223 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:46:34.266223 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:46:34.266223 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:46:34.266223 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:46:34.266223 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:46:34.266223 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:46:34.266223 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:34.266223 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJQEMq7svsRl9PHVDGa87o7zVvxH7WVQJld_GEIbyBcmXaUqSodLoBBhKFGy_wWVPlSflSYWoQHFzGLeJ5KFsYyx3mgzfy-6qWDhnjh86OHxH7axCZm0kAN9SIlkxvq7lVGi6qmwX7zdIyu3CTjNJdxkUxkT1EIBIezp0nVQd3j4z-Q Oct 29 02:46:34.266223 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:46:34.266223 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:46:34.266223 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:46:34.266223 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:46:34.266223 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:46:34.266223 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:46:34.266223 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: a4e1529c462b4d3aa8d4261cb0b8c1f8 Oct 29 02:46:34.266223 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1354090398 Oct 29 02:46:34.266223 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:46:34.266223 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:46:34.267848 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a4e1529c462b4d3aa8d4261cb0b8c1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a4e1529c462b4d3aa8d4261cb0b8c1f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a4e1529c462b4d3aa8d4261cb0b8c1f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a4e1529c462b4d3aa8d4261cb0b8c1f8"}]}] Oct 29 02:46:34.267848 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1354090398 Oct 29 02:46:34.267848 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: a4e1529c462b4d3aa8d4261cb0b8c1f8 Oct 29 02:46:34.267848 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1354090398 Oct 29 02:46:34.267848 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1354090398-project Oct 29 02:46:34.267848 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:46:34.267848 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:46:34.267848 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 6b3c5470b050456b88c1fb88dfd5f681 Oct 29 02:46:34.267848 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1354090398-project Oct 29 02:46:34.267848 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:46:34.267848 n-d-862967-2 devstack@n-api.service[127125]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 29 02:46:34.267848 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'n-h2-862967-2'} Oct 29 02:46:34.269177 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:34.269177 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:34.269177 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:34.269177 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:34.269177 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:34.269177 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:34.269177 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:46:34.269177 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:46:34.269177 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:34.269177 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:34.269177 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 29 02:46:34.269177 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 29 02:46:34.269177 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:46:34.269177 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:46:34.269177 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:46:34.269177 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:46:34.269177 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:46:34.269177 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:46:34.269177 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:46:34.271505 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:46:34.271505 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:46:34.271505 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:46:34.271505 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:46:34.271505 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:46:34.271505 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:46:34.271505 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:46:34.271505 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 29 02:46:34.271505 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:34.271505 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:34.271505 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:34.271505 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:34.271505 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:34.271505 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:34.271505 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:46:34.271505 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:46:34.271505 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 29 02:46:34.271505 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:34.291475 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c61a9d33-ccee-4783-9ec4-587dfad13131 tempest-HypervisorAdminNegativeUnderV252Test-1354090398 tempest-HypervisorAdminNegativeUnderV252Test-1354090398-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:34.292805 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c61a9d33-ccee-4783-9ec4-587dfad13131 tempest-HypervisorAdminNegativeUnderV252Test-1354090398 tempest-HypervisorAdminNegativeUnderV252Test-1354090398-project] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/n-h2-862967-2/search" status: 403 len: 117 microversion: 2.1 time: 0.760140 Oct 29 02:46:34.303441 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 195/397] 10.222.0.46 () {58 vars in 1209 bytes} [Sat Oct 29 02:46:33 2022] GET /compute/v2.1/os-hypervisors/n-h2-862967-2/search => generated 117 bytes in 777 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:34.316286 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2911aee7-c743-4c19-8dbd-0e81725a77d6 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:34.401110 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-82d5b80b-5c34-4ddd-9fe9-82a973df75bf tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Lazy-loading 'flavor' on Instance uuid f4ce1c31-a9f8-4312-b7ac-09c736eb8bff {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:34.410454 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2911aee7-c743-4c19-8dbd-0e81725a77d6 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/2075554938/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.104219 Oct 29 02:46:34.420151 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 196/398] 10.222.0.46 () {60 vars in 1224 bytes} [Sat Oct 29 02:46:34 2022] POST /compute/v2.1/flavors/2075554938/os-extra_specs => generated 66 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:46:34.427944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4a27204f-fc7c-4174-956c-b94fb12dbe5c tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Calling method '.version_select at 0x7ff058331280>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:34.429977 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a27204f-fc7c-4174-956c-b94fb12dbe5c tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:34.433908 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a27204f-fc7c-4174-956c-b94fb12dbe5c tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:34.434413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a27204f-fc7c-4174-956c-b94fb12dbe5c tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:34.450522 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-4a27204f-fc7c-4174-956c-b94fb12dbe5c tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 29 02:46:34.459689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4a27204f-fc7c-4174-956c-b94fb12dbe5c tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Request method failure captured: Oct 29 02:46:34.459689 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 29 02:46:34.459689 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:46:34.459689 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:46:34.459689 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:46:34.459689 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:46:34.459689 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:46:34.459689 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:46:34.459689 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:46:34.459689 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:34.459689 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJQHBzCXMDtNW0B8X4qI30AWUAUtCEQh9Vsd50rIcVV2z6ZKT2lCKMEEoWPvE6Zzb5pdy-yxuE8NnL5PIavwhpjhWdovWgxmBJ36wbWHq71k3hs1PYVx3dEgP21aoPjAbZ29QLJjSJSeq5C4n6Z5bJTfa78HCq_UXTPphPOSaP_sduA Oct 29 02:46:34.459689 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:46:34.459689 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:46:34.459689 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:46:34.459689 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:46:34.459689 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:46:34.459689 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:46:34.459689 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 230bdec89739462f9d16ff2d6f86738a Oct 29 02:46:34.459689 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-664120058 Oct 29 02:46:34.459689 n-d-862967-2 devstack@n-api.service[127125]: X-Role: admin,reader,member Oct 29 02:46:34.459689 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: admin,reader,member Oct 29 02:46:34.461006 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/230bdec89739462f9d16ff2d6f86738a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/230bdec89739462f9d16ff2d6f86738a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_230bdec89739462f9d16ff2d6f86738a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/230bdec89739462f9d16ff2d6f86738a"}]}] Oct 29 02:46:34.461006 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-664120058 Oct 29 02:46:34.461006 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 230bdec89739462f9d16ff2d6f86738a Oct 29 02:46:34.461006 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-664120058 Oct 29 02:46:34.461006 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin Oct 29 02:46:34.461006 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:46:34.461006 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:46:34.461006 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: f3d9a0eae0484d05bf1a6af80b713433 Oct 29 02:46:34.461006 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin Oct 29 02:46:34.461006 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:46:34.461006 n-d-862967-2 devstack@n-api.service[127125]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 29 02:46:34.461006 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 29 02:46:34.461672 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:34.461672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:34.461672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:34.461672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:34.461672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:34.461672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:34.461672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:46:34.461672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:46:34.461672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:34.461672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:34.461672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 29 02:46:34.461672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 29 02:46:34.461672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 29 02:46:34.461672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 02:46:34.461672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 29 02:46:34.461672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:34.461672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:34.461672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:34.461672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:34.461672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:34.462740 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:34.462740 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:34.462740 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:34.462740 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 29 02:46:34.462740 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:34.464856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4a27204f-fc7c-4174-956c-b94fb12dbe5c tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:34.465994 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4a27204f-fc7c-4174-956c-b94fb12dbe5c tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.044764 Oct 29 02:46:34.468927 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 197/399] 10.222.0.46 () {58 vars in 1251 bytes} [Sat Oct 29 02:46:34 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:34.479486 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a822ee00-4bb5-45bf-81d9-22aabf3452b1 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:34.486380 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a822ee00-4bb5-45bf-81d9-22aabf3452b1 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'bddb0685f87c48d784e7ac12cbe823db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27260df950a4fbfa0ad248f01701a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:34.493925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a822ee00-4bb5-45bf-81d9-22aabf3452b1 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801-project] Request method failure captured: Oct 29 02:46:34.493925 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/flavors/2075554938/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 29 02:46:34.493925 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:46:34.493925 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:46:34.493925 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:46:34.493925 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:46:34.493925 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:46:34.493925 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:46:34.493925 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:46:34.493925 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:34.493925 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJQE1g9wWKs3mv-XM8Ib4TYCwOv1oXPEoJL8Gi-KmfJjpt0D3nQqf_Il_ulRPlPArVxlfuhm3KjerutGLKd9axD9VGoj0fQ15tAhb6eXGr7onYUfWbvVksLhRMXdKuNxvDHSjnD32g5yF0UnlUBV8JiW1E6w-an4uUP_rsiRsmLomX8 Oct 29 02:46:34.493925 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:46:34.493925 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:46:34.493925 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:46:34.493925 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:46:34.493925 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:46:34.493925 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:46:34.493925 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: d27260df950a4fbfa0ad248f01701a6c Oct 29 02:46:34.493925 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 Oct 29 02:46:34.493925 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:46:34.493925 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:46:34.495276 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d27260df950a4fbfa0ad248f01701a6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d27260df950a4fbfa0ad248f01701a6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d27260df950a4fbfa0ad248f01701a6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d27260df950a4fbfa0ad248f01701a6c"}]}] Oct 29 02:46:34.495276 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 Oct 29 02:46:34.495276 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: d27260df950a4fbfa0ad248f01701a6c Oct 29 02:46:34.495276 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 Oct 29 02:46:34.495276 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801-project Oct 29 02:46:34.495276 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:46:34.495276 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:46:34.495276 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: bddb0685f87c48d784e7ac12cbe823db Oct 29 02:46:34.495276 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801-project Oct 29 02:46:34.495276 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:46:34.495276 n-d-862967-2 devstack@n-api.service[127125]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 29 02:46:34.495974 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'flavor_id': '2075554938', 'id': 'hw:numa_nodes'} Oct 29 02:46:34.495974 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:34.495974 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:34.495974 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:34.495974 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:34.495974 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:34.495974 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:34.495974 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:34.495974 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:34.495974 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 29 02:46:34.495974 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 29 02:46:34.495974 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:46:34.495974 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:46:34.495974 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:46:34.495974 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:46:34.495974 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:46:34.495974 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:46:34.495974 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:46:34.495974 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:46:34.495974 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:46:34.497055 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:46:34.497055 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:46:34.497055 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:46:34.497055 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:46:34.497055 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:46:34.497055 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 29 02:46:34.497055 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:34.497055 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:34.497055 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:34.497055 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:34.497055 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:34.497055 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:34.497055 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:46:34.497055 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:46:34.497055 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 29 02:46:34.497055 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:34.501986 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a822ee00-4bb5-45bf-81d9-22aabf3452b1 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:34.505515 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a822ee00-4bb5-45bf-81d9-22aabf3452b1 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801-project] 10.222.0.46 "DELETE /compute/v2.1/flavors/2075554938/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.034035 Oct 29 02:46:34.517443 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 198/400] 10.222.0.46 () {58 vars in 1248 bytes} [Sat Oct 29 02:46:34 2022] DELETE /compute/v2.1/flavors/2075554938/os-extra_specs/hw:numa_nodes => generated 124 bytes in 48 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:34.532668 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-254b49a8-ddc3-4c2f-93eb-5213c2d88247 tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Calling method '.version_select at 0x7ff05851ad30>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:34.539554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-254b49a8-ddc3-4c2f-93eb-5213c2d88247 tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:34.540171 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-254b49a8-ddc3-4c2f-93eb-5213c2d88247 tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:34.541817 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-254b49a8-ddc3-4c2f-93eb-5213c2d88247 tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:34.584423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-254b49a8-ddc3-4c2f-93eb-5213c2d88247 tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:34.592726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-254b49a8-ddc3-4c2f-93eb-5213c2d88247 tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:34.596403 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-254b49a8-ddc3-4c2f-93eb-5213c2d88247 tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:34.625944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-254b49a8-ddc3-4c2f-93eb-5213c2d88247 tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:34.626726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-254b49a8-ddc3-4c2f-93eb-5213c2d88247 tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:34.627624 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-254b49a8-ddc3-4c2f-93eb-5213c2d88247 tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:34.648709 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-254b49a8-ddc3-4c2f-93eb-5213c2d88247 tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.127991 Oct 29 02:46:34.650654 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 199/401] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:46:34 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:34.662568 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ec026820-48f2-45d7-bdd0-5f740ae7d61e tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:34.704407 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-82d5b80b-5c34-4ddd-9fe9-82a973df75bf tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff/action" status: 202 len: 0 microversion: 2.1 time: 0.504931 Oct 29 02:46:34.705100 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 203/402] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:46:34 2022] POST /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:46:34.725269 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ec026820-48f2-45d7-bdd0-5f740ae7d61e tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors/2075554938/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.071315 Oct 29 02:46:34.727999 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dd1f5451-e5dd-428d-b1b9-e4b728eeed4b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:34.730299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dd1f5451-e5dd-428d-b1b9-e4b728eeed4b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:34.732651 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 200/403] 10.222.0.46 () {60 vars in 1224 bytes} [Sat Oct 29 02:46:34 2022] POST /compute/v2.1/flavors/2075554938/os-extra_specs => generated 66 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:46:34.743099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-975a59cf-6f2a-4f24-ab01-9aa6868dc35d tempest-HypervisorAdminNegativeUnderV252Test-1354090398 tempest-HypervisorAdminNegativeUnderV252Test-1354090398-project] Calling method '.version_select at 0x7ff05834d940>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:34.751328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-975a59cf-6f2a-4f24-ab01-9aa6868dc35d tempest-HypervisorAdminNegativeUnderV252Test-1354090398 tempest-HypervisorAdminNegativeUnderV252Test-1354090398-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '6b3c5470b050456b88c1fb88dfd5f681', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4e1529c462b4d3aa8d4261cb0b8c1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:34.752725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd1f5451-e5dd-428d-b1b9-e4b728eeed4b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:34.757573 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd1f5451-e5dd-428d-b1b9-e4b728eeed4b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:34.758033 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd1f5451-e5dd-428d-b1b9-e4b728eeed4b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:34.759875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-975a59cf-6f2a-4f24-ab01-9aa6868dc35d tempest-HypervisorAdminNegativeUnderV252Test-1354090398 tempest-HypervisorAdminNegativeUnderV252Test-1354090398-project] Request method failure captured: Oct 29 02:46:34.759875 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 29 02:46:34.759875 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:46:34.759875 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:46:34.759875 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:46:34.759875 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:46:34.759875 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:46:34.759875 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:46:34.759875 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:46:34.759875 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:34.759875 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJQEMq7svsRl9PHVDGa87o7zVvxH7WVQJld_GEIbyBcmXaUqSodLoBBhKFGy_wWVPlSflSYWoQHFzGLeJ5KFsYyx3mgzfy-6qWDhnjh86OHxH7axCZm0kAN9SIlkxvq7lVGi6qmwX7zdIyu3CTjNJdxkUxkT1EIBIezp0nVQd3j4z-Q Oct 29 02:46:34.759875 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:46:34.759875 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:46:34.759875 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:46:34.759875 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:46:34.759875 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:46:34.759875 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:46:34.759875 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: a4e1529c462b4d3aa8d4261cb0b8c1f8 Oct 29 02:46:34.759875 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1354090398 Oct 29 02:46:34.759875 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:46:34.759875 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:46:34.761367 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a4e1529c462b4d3aa8d4261cb0b8c1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a4e1529c462b4d3aa8d4261cb0b8c1f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a4e1529c462b4d3aa8d4261cb0b8c1f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a4e1529c462b4d3aa8d4261cb0b8c1f8"}]}] Oct 29 02:46:34.761367 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1354090398 Oct 29 02:46:34.761367 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: a4e1529c462b4d3aa8d4261cb0b8c1f8 Oct 29 02:46:34.761367 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1354090398 Oct 29 02:46:34.761367 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1354090398-project Oct 29 02:46:34.761367 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:46:34.761367 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:46:34.761367 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 6b3c5470b050456b88c1fb88dfd5f681 Oct 29 02:46:34.761367 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1354090398-project Oct 29 02:46:34.761367 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:46:34.761367 n-d-862967-2 devstack@n-api.service[127125]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 29 02:46:34.761367 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '1'} Oct 29 02:46:34.762158 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:34.762158 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:34.762158 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:34.762158 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:34.762158 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:34.762158 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:34.762158 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:46:34.762158 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:46:34.762158 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:34.762158 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:34.762158 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 29 02:46:34.762158 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 29 02:46:34.762158 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:46:34.762158 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:46:34.762158 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:46:34.762158 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:46:34.762158 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:46:34.762158 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:46:34.762158 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:46:34.763356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:46:34.763356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:46:34.763356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:46:34.763356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:46:34.763356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:46:34.763356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:46:34.763356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:46:34.763356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 29 02:46:34.763356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:34.763356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:34.763356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:34.763356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:34.763356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:34.763356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:34.763356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:46:34.763356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:46:34.763356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 29 02:46:34.763356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:34.765411 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-975a59cf-6f2a-4f24-ab01-9aa6868dc35d tempest-HypervisorAdminNegativeUnderV252Test-1354090398 tempest-HypervisorAdminNegativeUnderV252Test-1354090398-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:34.766238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd1f5451-e5dd-428d-b1b9-e4b728eeed4b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:34.767380 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-975a59cf-6f2a-4f24-ab01-9aa6868dc35d tempest-HypervisorAdminNegativeUnderV252Test-1354090398 tempest-HypervisorAdminNegativeUnderV252Test-1354090398-project] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.032523 Oct 29 02:46:34.768564 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 201/404] 10.222.0.46 () {58 vars in 1176 bytes} [Sat Oct 29 02:46:34 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:34.769417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd1f5451-e5dd-428d-b1b9-e4b728eeed4b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:34.769869 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd1f5451-e5dd-428d-b1b9-e4b728eeed4b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:34.790510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4adec4cb-08b1-4667-95e3-d7b50ea764e8 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:34.795622 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4adec4cb-08b1-4667-95e3-d7b50ea764e8 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] [instance: f4ce1c31-a9f8-4312-b7ac-09c736eb8bff] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:34.815093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4adec4cb-08b1-4667-95e3-d7b50ea764e8 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:34.818449 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4adec4cb-08b1-4667-95e3-d7b50ea764e8 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:34.819373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4adec4cb-08b1-4667-95e3-d7b50ea764e8 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:34.820487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4adec4cb-08b1-4667-95e3-d7b50ea764e8 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:34.822864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4adec4cb-08b1-4667-95e3-d7b50ea764e8 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:34.823490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4adec4cb-08b1-4667-95e3-d7b50ea764e8 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:35.792256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dd1f5451-e5dd-428d-b1b9-e4b728eeed4b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:35.810736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dd1f5451-e5dd-428d-b1b9-e4b728eeed4b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:35.814165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dd1f5451-e5dd-428d-b1b9-e4b728eeed4b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:35.815865 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dd1f5451-e5dd-428d-b1b9-e4b728eeed4b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 200 len: 1568 microversion: 2.25 time: 1.104754 Oct 29 02:46:35.818372 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 204/405] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:34 2022] GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 1568 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:35.828309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d90f3372-8a8f-4bb6-8dd3-16a23ca1d871 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:35.832554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d90f3372-8a8f-4bb6-8dd3-16a23ca1d871 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'bddb0685f87c48d784e7ac12cbe823db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd27260df950a4fbfa0ad248f01701a6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:35.834720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d90f3372-8a8f-4bb6-8dd3-16a23ca1d871 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801-project] Request method failure captured: Oct 29 02:46:35.834720 n-d-862967-2 devstack@n-api.service[127124]: request: PUT /compute/v2.1/flavors/2075554938/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 29 02:46:35.834720 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:46:35.834720 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:46:35.834720 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:46:35.834720 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 22 Oct 29 02:46:35.834720 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:46:35.834720 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:46:35.834720 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:46:35.834720 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:35.834720 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJQE1g9wWKs3mv-XM8Ib4TYCwOv1oXPEoJL8Gi-KmfJjpt0D3nQqf_Il_ulRPlPArVxlfuhm3KjerutGLKd9axD9VGoj0fQ15tAhb6eXGr7onYUfWbvVksLhRMXdKuNxvDHSjnD32g5yF0UnlUBV8JiW1E6w-an4uUP_rsiRsmLomX8 Oct 29 02:46:35.834720 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:46:35.834720 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:46:35.834720 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:46:35.834720 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:46:35.834720 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:46:35.834720 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:46:35.834720 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: d27260df950a4fbfa0ad248f01701a6c Oct 29 02:46:35.834720 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 Oct 29 02:46:35.834720 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:46:35.834720 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:46:35.835869 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d27260df950a4fbfa0ad248f01701a6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d27260df950a4fbfa0ad248f01701a6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d27260df950a4fbfa0ad248f01701a6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d27260df950a4fbfa0ad248f01701a6c"}]}] Oct 29 02:46:35.835869 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 Oct 29 02:46:35.835869 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: d27260df950a4fbfa0ad248f01701a6c Oct 29 02:46:35.835869 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 Oct 29 02:46:35.835869 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801-project Oct 29 02:46:35.835869 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:46:35.835869 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:46:35.835869 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: bddb0685f87c48d784e7ac12cbe823db Oct 29 02:46:35.835869 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801-project Oct 29 02:46:35.835869 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:46:35.835869 n-d-862967-2 devstack@n-api.service[127124]: {"hw:numa_nodes": "1"} Oct 29 02:46:35.835869 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:46:35.835869 n-d-862967-2 devstack@n-api.service[127124]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 29 02:46:35.836649 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'flavor_id': '2075554938', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 29 02:46:35.836649 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:35.836649 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:35.836649 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:35.836649 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:35.836649 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:35.836649 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:35.836649 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:35.836649 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:35.836649 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:46:35.836649 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:35.836649 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 29 02:46:35.836649 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 29 02:46:35.836649 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:46:35.836649 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:46:35.836649 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:46:35.836649 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:46:35.836649 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:46:35.836649 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:46:35.837713 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:46:35.837713 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:46:35.837713 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:46:35.837713 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:46:35.837713 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:46:35.837713 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:46:35.837713 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:46:35.837713 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:46:35.837713 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 29 02:46:35.837713 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:35.837713 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:35.837713 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:35.837713 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:35.837713 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:35.837713 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:35.837713 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:46:35.837713 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:46:35.837713 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 29 02:46:35.837713 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:35.841241 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d90f3372-8a8f-4bb6-8dd3-16a23ca1d871 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:35.842316 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d90f3372-8a8f-4bb6-8dd3-16a23ca1d871 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801 tempest-FlavorsExtraSpecsNegativeTestJSON-1253177801-project] 10.222.0.46 "PUT /compute/v2.1/flavors/2075554938/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.022483 Oct 29 02:46:35.842646 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4adec4cb-08b1-4667-95e3-d7b50ea764e8 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff" status: 200 len: 1630 microversion: 2.1 time: 1.071717 Oct 29 02:46:35.843364 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 202/406] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:34 2022] GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff => generated 1630 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:35.843691 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 205/407] 10.222.0.46 () {60 vars in 1265 bytes} [Sat Oct 29 02:46:35 2022] PUT /compute/v2.1/flavors/2075554938/os-extra_specs/hw:numa_nodes => generated 124 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:35.853699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ba6014c1-c568-4bf6-89d0-f54ccd37ca09 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:35.854983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ba6014c1-c568-4bf6-89d0-f54ccd37ca09 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 7bfceda7-a17c-40a9-afcc-767b96d5ac7b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:35.867010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba6014c1-c568-4bf6-89d0-f54ccd37ca09 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:35.868081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba6014c1-c568-4bf6-89d0-f54ccd37ca09 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:35.868868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba6014c1-c568-4bf6-89d0-f54ccd37ca09 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:35.870405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8d56c1c3-fd0d-40c8-ac9d-63ef9784380a tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Calling method '.version_select at 0x7ff058331dc0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:35.871352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba6014c1-c568-4bf6-89d0-f54ccd37ca09 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:35.872075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba6014c1-c568-4bf6-89d0-f54ccd37ca09 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:35.872382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d56c1c3-fd0d-40c8-ac9d-63ef9784380a tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:35.874429 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba6014c1-c568-4bf6-89d0-f54ccd37ca09 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:35.876517 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d56c1c3-fd0d-40c8-ac9d-63ef9784380a tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:35.877021 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d56c1c3-fd0d-40c8-ac9d-63ef9784380a tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:35.888011 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-8d56c1c3-fd0d-40c8-ac9d-63ef9784380a tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] HTTP exception thrown: No hypervisor matching '65e3fabf-812b-4521-9c77-632ae37313e1' could be found. Oct 29 02:46:35.889837 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8d56c1c3-fd0d-40c8-ac9d-63ef9784380a tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Request method failure captured: Oct 29 02:46:35.889837 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/os-hypervisors/65e3fabf-812b-4521-9c77-632ae37313e1/servers HTTP/1.1 Oct 29 02:46:35.889837 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:46:35.889837 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:46:35.889837 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:46:35.889837 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:46:35.889837 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:46:35.889837 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:46:35.889837 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:46:35.889837 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:35.889837 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJQHBzCXMDtNW0B8X4qI30AWUAUtCEQh9Vsd50rIcVV2z6ZKT2lCKMEEoWPvE6Zzb5pdy-yxuE8NnL5PIavwhpjhWdovWgxmBJ36wbWHq71k3hs1PYVx3dEgP21aoPjAbZ29QLJjSJSeq5C4n6Z5bJTfa78HCq_UXTPphPOSaP_sduA Oct 29 02:46:35.889837 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:46:35.889837 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:46:35.889837 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:46:35.889837 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:46:35.889837 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:46:35.889837 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:46:35.889837 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 230bdec89739462f9d16ff2d6f86738a Oct 29 02:46:35.889837 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-664120058 Oct 29 02:46:35.889837 n-d-862967-2 devstack@n-api.service[127125]: X-Role: admin,reader,member Oct 29 02:46:35.889837 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: admin,reader,member Oct 29 02:46:35.891348 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/230bdec89739462f9d16ff2d6f86738a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/230bdec89739462f9d16ff2d6f86738a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_230bdec89739462f9d16ff2d6f86738a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/230bdec89739462f9d16ff2d6f86738a"}]}] Oct 29 02:46:35.891348 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-664120058 Oct 29 02:46:35.891348 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 230bdec89739462f9d16ff2d6f86738a Oct 29 02:46:35.891348 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-664120058 Oct 29 02:46:35.891348 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin Oct 29 02:46:35.891348 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:46:35.891348 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:46:35.891348 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: f3d9a0eae0484d05bf1a6af80b713433 Oct 29 02:46:35.891348 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin Oct 29 02:46:35.891348 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:46:35.891348 n-d-862967-2 devstack@n-api.service[127125]: exception: No hypervisor matching '65e3fabf-812b-4521-9c77-632ae37313e1' could be found. Oct 29 02:46:35.891348 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '65e3fabf-812b-4521-9c77-632ae37313e1'} Oct 29 02:46:35.892159 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:35.892159 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:35.892159 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:35.892159 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:35.892159 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:35.892159 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:35.892159 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:46:35.892159 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:46:35.892159 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:35.892159 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:35.892159 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 29 02:46:35.892159 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 29 02:46:35.892159 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 29 02:46:35.892159 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 02:46:35.892159 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '65e3fabf-812b-4521-9c77-632ae37313e1' could be found. Oct 29 02:46:35.892159 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:35.892159 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:35.892159 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:35.892159 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:35.893545 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:35.893545 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:35.893545 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:35.893545 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:35.893545 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '65e3fabf-812b-4521-9c77-632ae37313e1' could be found. Oct 29 02:46:35.893545 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:35.894825 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8d56c1c3-fd0d-40c8-ac9d-63ef9784380a tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] Returning 404 to user: No hypervisor matching '65e3fabf-812b-4521-9c77-632ae37313e1' could be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:35.895849 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8d56c1c3-fd0d-40c8-ac9d-63ef9784380a tempest-HypervisorAdminNegativeUnderV252Test-664120058 tempest-HypervisorAdminNegativeUnderV252Test-664120058-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/65e3fabf-812b-4521-9c77-632ae37313e1/servers" status: 404 len: 123 microversion: 2.1 time: 0.036954 Oct 29 02:46:35.907558 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 203/408] 10.222.0.46 () {58 vars in 1281 bytes} [Sat Oct 29 02:46:35 2022] GET /compute/v2.1/os-hypervisors/65e3fabf-812b-4521-9c77-632ae37313e1/servers => generated 123 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:35.912903 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a57ec07b-0af8-40e6-9a23-2d880a6a29f9 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:35.922783 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-a57ec07b-0af8-40e6-9a23-2d880a6a29f9 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944-project-admin] HTTP exception thrown: Flavor 2075554938 has no extra specs with key hw:cpu_thread_policy. Oct 29 02:46:35.924595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a57ec07b-0af8-40e6-9a23-2d880a6a29f9 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944-project-admin] Request method failure captured: Oct 29 02:46:35.924595 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/flavors/2075554938/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 29 02:46:35.924595 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:46:35.924595 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:46:35.924595 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:46:35.924595 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:46:35.924595 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:46:35.924595 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:46:35.924595 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:46:35.924595 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:35.924595 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJQG1P6FQ3VOvM4psq5AZJguBsFAkMkYWsLNtpTArxLdo4D4Ker4jGNv5ClqHiF0eIrQW6bTBPksig2ovI_QvlhCilVmISWy3wfvczzeBA-QV-6yqkpEGJKgq-C_U7B9byp-_IOLmXBXTBUQWLr-aNvF1V9Tyr9STULytfzFpV5dJm8 Oct 29 02:46:35.924595 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:46:35.924595 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:46:35.924595 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:46:35.924595 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:46:35.924595 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:46:35.924595 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:46:35.924595 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 01ffb9f4efdf4d3db080049c1d9a385b Oct 29 02:46:35.924595 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 Oct 29 02:46:35.924595 n-d-862967-2 devstack@n-api.service[127125]: X-Role: admin,reader,member Oct 29 02:46:35.924595 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: admin,reader,member Oct 29 02:46:35.925997 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/01ffb9f4efdf4d3db080049c1d9a385b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/01ffb9f4efdf4d3db080049c1d9a385b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_01ffb9f4efdf4d3db080049c1d9a385b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/01ffb9f4efdf4d3db080049c1d9a385b"}]}] Oct 29 02:46:35.925997 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 Oct 29 02:46:35.925997 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 01ffb9f4efdf4d3db080049c1d9a385b Oct 29 02:46:35.925997 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 Oct 29 02:46:35.925997 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-769459944-project-admin Oct 29 02:46:35.925997 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:46:35.925997 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:46:35.925997 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 4cca3cd03fd246d2ab1471a5004aed80 Oct 29 02:46:35.925997 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-769459944-project-admin Oct 29 02:46:35.925997 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:46:35.925997 n-d-862967-2 devstack@n-api.service[127125]: exception: Flavor 2075554938 has no extra specs with key hw:cpu_thread_policy. Oct 29 02:46:35.926684 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'flavor_id': '2075554938', 'id': 'hw:cpu_thread_policy'} Oct 29 02:46:35.926684 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:35.926684 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:35.926684 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 29 02:46:35.926684 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 29 02:46:35.926684 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 29 02:46:35.926684 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:35.926684 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:35.926684 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:35.926684 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:35.926684 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:35.926684 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:35.926684 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:35.926684 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:35.926684 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:35.926684 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:35.926684 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 29 02:46:35.926684 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 02:46:35.926684 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2075554938 has no extra specs with key hw:cpu_thread_policy. Oct 29 02:46:35.926684 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:35.926684 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:35.926684 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:35.928057 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:35.928057 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:35.928057 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:35.928057 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:35.928057 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:35.928057 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2075554938 has no extra specs with key hw:cpu_thread_policy. Oct 29 02:46:35.928057 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:35.932567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a57ec07b-0af8-40e6-9a23-2d880a6a29f9 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944-project-admin] Returning 404 to user: Flavor 2075554938 has no extra specs with key hw:cpu_thread_policy. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:35.933693 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a57ec07b-0af8-40e6-9a23-2d880a6a29f9 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/2075554938/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.024885 Oct 29 02:46:35.939104 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 204/409] 10.222.0.46 () {58 vars in 1269 bytes} [Sat Oct 29 02:46:35 2022] DELETE /compute/v2.1/flavors/2075554938/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:35.946099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d5873ada-ec7b-437d-b3a4-1b5a45f93104 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:35.949697 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-d5873ada-ec7b-437d-b3a4-1b5a45f93104 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 29 02:46:35.951226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d5873ada-ec7b-437d-b3a4-1b5a45f93104 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944-project-admin] Request method failure captured: Oct 29 02:46:35.951226 n-d-862967-2 devstack@n-api.service[127125]: request: PUT /compute/v2.1/flavors/2075554938/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 29 02:46:35.951226 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:46:35.951226 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:46:35.951226 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:46:35.951226 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 27 Oct 29 02:46:35.951226 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:46:35.951226 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:46:35.951226 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:46:35.951226 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:35.951226 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJQG1P6FQ3VOvM4psq5AZJguBsFAkMkYWsLNtpTArxLdo4D4Ker4jGNv5ClqHiF0eIrQW6bTBPksig2ovI_QvlhCilVmISWy3wfvczzeBA-QV-6yqkpEGJKgq-C_U7B9byp-_IOLmXBXTBUQWLr-aNvF1V9Tyr9STULytfzFpV5dJm8 Oct 29 02:46:35.951226 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:46:35.951226 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:46:35.951226 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:46:35.951226 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:46:35.951226 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:46:35.951226 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:46:35.951226 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 01ffb9f4efdf4d3db080049c1d9a385b Oct 29 02:46:35.951226 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 Oct 29 02:46:35.951226 n-d-862967-2 devstack@n-api.service[127125]: X-Role: admin,reader,member Oct 29 02:46:35.951226 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: admin,reader,member Oct 29 02:46:35.952650 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/01ffb9f4efdf4d3db080049c1d9a385b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/01ffb9f4efdf4d3db080049c1d9a385b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_01ffb9f4efdf4d3db080049c1d9a385b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/01ffb9f4efdf4d3db080049c1d9a385b"}]}] Oct 29 02:46:35.952650 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 Oct 29 02:46:35.952650 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 01ffb9f4efdf4d3db080049c1d9a385b Oct 29 02:46:35.952650 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 Oct 29 02:46:35.952650 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-769459944-project-admin Oct 29 02:46:35.952650 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:46:35.952650 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:46:35.952650 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 4cca3cd03fd246d2ab1471a5004aed80 Oct 29 02:46:35.952650 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-769459944-project-admin Oct 29 02:46:35.952650 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:46:35.952650 n-d-862967-2 devstack@n-api.service[127125]: {"hw:cpu_policy": "shared"} Oct 29 02:46:35.952650 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:46:35.952650 n-d-862967-2 devstack@n-api.service[127125]: exception: Request body and URI mismatch Oct 29 02:46:35.953524 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'flavor_id': '2075554938', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 29 02:46:35.953524 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:35.953524 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:35.953524 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:35.953524 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:35.953524 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:35.953524 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:35.953524 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:35.953524 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:35.953524 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:46:35.953524 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:35.953524 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 29 02:46:35.953524 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 29 02:46:35.953524 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 29 02:46:35.953524 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:35.953524 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:35.953524 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:35.953524 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:35.953524 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:35.953524 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:35.955034 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:35.955034 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:35.955034 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 29 02:46:35.955034 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:35.956312 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d5873ada-ec7b-437d-b3a4-1b5a45f93104 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:35.957423 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d5873ada-ec7b-437d-b3a4-1b5a45f93104 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944-project-admin] 10.222.0.46 "PUT /compute/v2.1/flavors/2075554938/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.017082 Oct 29 02:46:35.962758 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 205/410] 10.222.0.46 () {60 vars in 1265 bytes} [Sat Oct 29 02:46:35 2022] PUT /compute/v2.1/flavors/2075554938/os-extra_specs/hw:numa_nodes => generated 73 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:35.968173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-db20ff6d-8a4b-4387-9afb-c51ba437568e tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:35.974846 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-db20ff6d-8a4b-4387-9afb-c51ba437568e tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944-project-admin] Request method failure captured: Oct 29 02:46:35.974846 n-d-862967-2 devstack@n-api.service[127125]: request: PUT /compute/v2.1/flavors/2075554938/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 29 02:46:35.974846 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:46:35.974846 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:46:35.974846 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:46:35.974846 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 49 Oct 29 02:46:35.974846 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:46:35.974846 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:46:35.974846 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:46:35.974846 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:35.974846 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJQG1P6FQ3VOvM4psq5AZJguBsFAkMkYWsLNtpTArxLdo4D4Ker4jGNv5ClqHiF0eIrQW6bTBPksig2ovI_QvlhCilVmISWy3wfvczzeBA-QV-6yqkpEGJKgq-C_U7B9byp-_IOLmXBXTBUQWLr-aNvF1V9Tyr9STULytfzFpV5dJm8 Oct 29 02:46:35.974846 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:46:35.974846 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:46:35.974846 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:46:35.974846 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:46:35.974846 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:46:35.974846 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:46:35.974846 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 01ffb9f4efdf4d3db080049c1d9a385b Oct 29 02:46:35.974846 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 Oct 29 02:46:35.974846 n-d-862967-2 devstack@n-api.service[127125]: X-Role: admin,reader,member Oct 29 02:46:35.974846 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: admin,reader,member Oct 29 02:46:35.977278 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/01ffb9f4efdf4d3db080049c1d9a385b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/01ffb9f4efdf4d3db080049c1d9a385b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_01ffb9f4efdf4d3db080049c1d9a385b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/01ffb9f4efdf4d3db080049c1d9a385b"}]}] Oct 29 02:46:35.977278 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 Oct 29 02:46:35.977278 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 01ffb9f4efdf4d3db080049c1d9a385b Oct 29 02:46:35.977278 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 Oct 29 02:46:35.977278 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-769459944-project-admin Oct 29 02:46:35.977278 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:46:35.977278 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:46:35.977278 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 4cca3cd03fd246d2ab1471a5004aed80 Oct 29 02:46:35.977278 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-769459944-project-admin Oct 29 02:46:35.977278 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:46:35.977278 n-d-862967-2 devstack@n-api.service[127125]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 29 02:46:35.977278 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:46:35.978502 n-d-862967-2 devstack@n-api.service[127125]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 29 02:46:35.978502 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'flavor_id': '2075554938', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 29 02:46:35.978502 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:35.978502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:35.978502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:46:35.978502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:46:35.978502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:46:35.978502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:46:35.978502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 29 02:46:35.978502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:35.978502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 29 02:46:35.978502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 02:46:35.978502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 29 02:46:35.978502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 29 02:46:35.978502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 02:46:35.978502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 29 02:46:35.978502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 29 02:46:35.978502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 02:46:35.978502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:35.978502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi On instance: Oct 29 02:46:35.978502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 29 02:46:35.978502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:35.980260 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:35.980260 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:35.980260 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:35.980260 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:35.980260 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:35.980260 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:35.980260 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:35.980260 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:35.980260 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:35.980260 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:46:35.980260 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:46:35.980260 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:46:35.980260 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:46:35.980260 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:46:35.980260 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:46:35.980260 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 29 02:46:35.980260 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:35.980260 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:35.980260 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:35.980260 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:35.981721 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:35.981721 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:35.981721 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:46:35.981721 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:46:35.981721 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 29 02:46:35.981721 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:35.983139 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-db20ff6d-8a4b-4387-9afb-c51ba437568e tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:35.984505 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-db20ff6d-8a4b-4387-9afb-c51ba437568e tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944-project-admin] 10.222.0.46 "PUT /compute/v2.1/flavors/2075554938/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.020529 Oct 29 02:46:35.989521 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 206/411] 10.222.0.46 () {60 vars in 1265 bytes} [Sat Oct 29 02:46:35 2022] PUT /compute/v2.1/flavors/2075554938/os-extra_specs/hw:numa_nodes => generated 117 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:46:35.996033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f5f84cae-ab8f-4495-8daa-c3de89466e27 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:36.018532 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:36.032948 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f5f84cae-ab8f-4495-8daa-c3de89466e27 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/2075554938" status: 202 len: 0 microversion: 2.1 time: 0.040964 Oct 29 02:46:36.035889 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 207/412] 10.222.0.46 () {58 vars in 1161 bytes} [Sat Oct 29 02:46:35 2022] DELETE /compute/v2.1/flavors/2075554938 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:46:36.058713 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f8981828-7fcf-4fbe-9b33-3bfa7774197a tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:36.109695 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f8981828-7fcf-4fbe-9b33-3bfa7774197a tempest-FlavorsExtraSpecsNegativeTestJSON-769459944 tempest-FlavorsExtraSpecsNegativeTestJSON-769459944-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.069330 Oct 29 02:46:36.111013 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 208/413] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:46:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:36.161425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ba6014c1-c568-4bf6-89d0-f54ccd37ca09 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:36.169603 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ba6014c1-c568-4bf6-89d0-f54ccd37ca09 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b" status: 200 len: 1276 microversion: 2.1 time: 0.324383 Oct 29 02:46:36.189203 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 206/414] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:35 2022] GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b => generated 1276 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:36.855456 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e1a1573d-e9b4-4a3e-9a67-658cfa207ea6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:36.856550 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e1a1573d-e9b4-4a3e-9a67-658cfa207ea6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:36.871523 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9fbc9ab7-4ce3-469d-96b9-d539ccbabce2 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:36.872456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9fbc9ab7-4ce3-469d-96b9-d539ccbabce2 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] [instance: f4ce1c31-a9f8-4312-b7ac-09c736eb8bff] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:36.891592 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fbc9ab7-4ce3-469d-96b9-d539ccbabce2 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:36.895455 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1a1573d-e9b4-4a3e-9a67-658cfa207ea6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:36.897838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fbc9ab7-4ce3-469d-96b9-d539ccbabce2 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:36.900929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fbc9ab7-4ce3-469d-96b9-d539ccbabce2 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:36.901785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1a1573d-e9b4-4a3e-9a67-658cfa207ea6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:36.902884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fbc9ab7-4ce3-469d-96b9-d539ccbabce2 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:36.904007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1a1573d-e9b4-4a3e-9a67-658cfa207ea6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:36.908169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fbc9ab7-4ce3-469d-96b9-d539ccbabce2 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:36.910523 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1a1573d-e9b4-4a3e-9a67-658cfa207ea6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:36.911285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fbc9ab7-4ce3-469d-96b9-d539ccbabce2 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:36.913990 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1a1573d-e9b4-4a3e-9a67-658cfa207ea6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:36.919631 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1a1573d-e9b4-4a3e-9a67-658cfa207ea6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:37.670913 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9fbc9ab7-4ce3-469d-96b9-d539ccbabce2 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff" status: 200 len: 1613 microversion: 2.1 time: 0.801094 Oct 29 02:46:37.690485 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 207/415] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:36 2022] GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff => generated 1613 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:37.701434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e1a1573d-e9b4-4a3e-9a67-658cfa207ea6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:37.708003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-29a6a56d-ed63-4385-839b-fb36a4abb8e5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:37.712115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e1a1573d-e9b4-4a3e-9a67-658cfa207ea6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:37.713281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-29a6a56d-ed63-4385-839b-fb36a4abb8e5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 7bfceda7-a17c-40a9-afcc-767b96d5ac7b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:37.726486 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e1a1573d-e9b4-4a3e-9a67-658cfa207ea6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:37.727696 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e1a1573d-e9b4-4a3e-9a67-658cfa207ea6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 200 len: 1568 microversion: 2.25 time: 0.881026 Oct 29 02:46:37.728248 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 209/416] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:36 2022] GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 1568 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:46:37.736662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-29a6a56d-ed63-4385-839b-fb36a4abb8e5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:37.737661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-29a6a56d-ed63-4385-839b-fb36a4abb8e5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:37.738981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-29a6a56d-ed63-4385-839b-fb36a4abb8e5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:37.740935 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-29a6a56d-ed63-4385-839b-fb36a4abb8e5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:37.741773 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-29a6a56d-ed63-4385-839b-fb36a4abb8e5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:37.744364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-50aa77b1-543b-44a7-8bde-2d2626b26f93 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:37.745049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-29a6a56d-ed63-4385-839b-fb36a4abb8e5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:37.751223 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-50aa77b1-543b-44a7-8bde-2d2626b26f93 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] [instance: f4ce1c31-a9f8-4312-b7ac-09c736eb8bff] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:37.766367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50aa77b1-543b-44a7-8bde-2d2626b26f93 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:37.766856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50aa77b1-543b-44a7-8bde-2d2626b26f93 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:37.768421 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50aa77b1-543b-44a7-8bde-2d2626b26f93 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:37.769803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50aa77b1-543b-44a7-8bde-2d2626b26f93 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:37.772032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50aa77b1-543b-44a7-8bde-2d2626b26f93 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:37.772646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50aa77b1-543b-44a7-8bde-2d2626b26f93 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:37.925148 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-29a6a56d-ed63-4385-839b-fb36a4abb8e5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:37.937256 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-29a6a56d-ed63-4385-839b-fb36a4abb8e5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b" status: 200 len: 1276 microversion: 2.1 time: 0.243568 Oct 29 02:46:37.948958 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 208/417] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:37 2022] GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b => generated 1276 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:37.967073 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-50aa77b1-543b-44a7-8bde-2d2626b26f93 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] HTTP exception thrown: Cannot 'migrate' instance f4ce1c31-a9f8-4312-b7ac-09c736eb8bff while it is in vm_state suspended Oct 29 02:46:37.968384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-50aa77b1-543b-44a7-8bde-2d2626b26f93 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Request method failure captured: Oct 29 02:46:37.968384 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff/action HTTP/1.1 Oct 29 02:46:37.968384 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:46:37.968384 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:46:37.968384 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:46:37.968384 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 15 Oct 29 02:46:37.968384 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:46:37.968384 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:46:37.968384 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:46:37.968384 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:37.968384 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPbU7OQUl7VOp0tcplOyHR8kKwQApRnIhoHO1sn8lpi0eUVKbi2DZkmroo3Lbt3M9TGxTLe1C7txOomXOGFWlLNyM07k9U4bMrnKUX06_jy0E672wylVHo4ZWYi1Y3yVSzgQBKQt1ZkNqxoa7AbzJF8ndF7AHmztstx2MHbb9qHQLA Oct 29 02:46:37.968384 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:46:37.968384 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:46:37.968384 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:46:37.968384 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:46:37.968384 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:46:37.968384 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:46:37.968384 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: d954806aa68841e6a76ac40ac99d67ff Oct 29 02:46:37.968384 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-386500486 Oct 29 02:46:37.968384 n-d-862967-2 devstack@n-api.service[127125]: X-Role: admin,reader,member Oct 29 02:46:37.968384 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: admin,reader,member Oct 29 02:46:37.969591 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d954806aa68841e6a76ac40ac99d67ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d954806aa68841e6a76ac40ac99d67ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d954806aa68841e6a76ac40ac99d67ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d954806aa68841e6a76ac40ac99d67ff"}]}] Oct 29 02:46:37.969591 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersAdminNegativeTestJSON-386500486 Oct 29 02:46:37.969591 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: d954806aa68841e6a76ac40ac99d67ff Oct 29 02:46:37.969591 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-386500486 Oct 29 02:46:37.969591 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersAdminNegativeTestJSON-386500486-project-admin Oct 29 02:46:37.969591 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:46:37.969591 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:46:37.969591 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 3a3d02ad5c324be6861e6b6545bfe5d3 Oct 29 02:46:37.969591 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersAdminNegativeTestJSON-386500486-project-admin Oct 29 02:46:37.969591 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:46:37.969591 n-d-862967-2 devstack@n-api.service[127125]: {"migrate": {}} Oct 29 02:46:37.969591 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:46:37.969591 n-d-862967-2 devstack@n-api.service[127125]: exception: Cannot 'migrate' instance f4ce1c31-a9f8-4312-b7ac-09c736eb8bff while it is in vm_state suspended Oct 29 02:46:37.970299 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'f4ce1c31-a9f8-4312-b7ac-09c736eb8bff', 'body': {'migrate': {}}} Oct 29 02:46:37.970299 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:37.970299 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:37.970299 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 29 02:46:37.970299 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 29 02:46:37.970299 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 29 02:46:37.970299 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 02:46:37.970299 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 02:46:37.970299 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 02:46:37.970299 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 02:46:37.970299 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 02:46:37.970299 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 02:46:37.970299 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 02:46:37.970299 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 02:46:37.970299 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 02:46:37.970299 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f4ce1c31-a9f8-4312-b7ac-09c736eb8bff in vm_state suspended. Cannot resize while the instance is in this state. Oct 29 02:46:37.970299 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:37.970299 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:37.970299 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:37.970299 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:37.971404 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:37.971404 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:37.971404 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:37.971404 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:37.971404 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:37.971404 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:37.971404 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:46:37.971404 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:37.971404 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 29 02:46:37.971404 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 02:46:37.971404 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 02:46:37.971404 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 02:46:37.971404 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance f4ce1c31-a9f8-4312-b7ac-09c736eb8bff while it is in vm_state suspended Oct 29 02:46:37.971404 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:37.971404 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:37.971404 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:37.971404 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:37.971404 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:37.971404 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:37.972428 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:37.972428 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:37.972428 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance f4ce1c31-a9f8-4312-b7ac-09c736eb8bff while it is in vm_state suspended Oct 29 02:46:37.972428 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:37.982552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-50aa77b1-543b-44a7-8bde-2d2626b26f93 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Returning 409 to user: Cannot 'migrate' instance f4ce1c31-a9f8-4312-b7ac-09c736eb8bff while it is in vm_state suspended {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:37.983895 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-50aa77b1-543b-44a7-8bde-2d2626b26f93 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff/action" status: 409 len: 148 microversion: 2.1 time: 0.254275 Oct 29 02:46:37.985455 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 210/418] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:46:37 2022] POST /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff/action => generated 148 bytes in 256 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:46:37.998783 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-30eb0068-5703-4758-9426-8688b6ddf364 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:38.003488 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-30eb0068-5703-4758-9426-8688b6ddf364 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Request method failure captured: Oct 29 02:46:38.003488 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c/action HTTP/1.1 Oct 29 02:46:38.003488 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:46:38.003488 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:46:38.003488 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:46:38.003488 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 39 Oct 29 02:46:38.003488 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:46:38.003488 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:46:38.003488 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:46:38.003488 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:38.003488 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPbU7OQUl7VOp0tcplOyHR8kKwQApRnIhoHO1sn8lpi0eUVKbi2DZkmroo3Lbt3M9TGxTLe1C7txOomXOGFWlLNyM07k9U4bMrnKUX06_jy0E672wylVHo4ZWYi1Y3yVSzgQBKQt1ZkNqxoa7AbzJF8ndF7AHmztstx2MHbb9qHQLA Oct 29 02:46:38.003488 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:46:38.003488 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:46:38.003488 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:46:38.003488 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:46:38.003488 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:46:38.003488 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:46:38.003488 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: d954806aa68841e6a76ac40ac99d67ff Oct 29 02:46:38.003488 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-386500486 Oct 29 02:46:38.003488 n-d-862967-2 devstack@n-api.service[127124]: X-Role: admin,reader,member Oct 29 02:46:38.003488 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: admin,reader,member Oct 29 02:46:38.005346 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d954806aa68841e6a76ac40ac99d67ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d954806aa68841e6a76ac40ac99d67ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d954806aa68841e6a76ac40ac99d67ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d954806aa68841e6a76ac40ac99d67ff"}]}] Oct 29 02:46:38.005346 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersAdminNegativeTestJSON-386500486 Oct 29 02:46:38.005346 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: d954806aa68841e6a76ac40ac99d67ff Oct 29 02:46:38.005346 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-386500486 Oct 29 02:46:38.005346 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersAdminNegativeTestJSON-386500486-project-admin Oct 29 02:46:38.005346 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:46:38.005346 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:46:38.005346 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 3a3d02ad5c324be6861e6b6545bfe5d3 Oct 29 02:46:38.005346 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersAdminNegativeTestJSON-386500486-project-admin Oct 29 02:46:38.005346 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:46:38.005346 n-d-862967-2 devstack@n-api.service[127124]: {"os-resetState": {"state": "invalid"}} Oct 29 02:46:38.005346 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:46:38.009495 n-d-862967-2 devstack@n-api.service[127124]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 29 02:46:38.009495 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'c4180915-07c1-4365-976f-3b32fef4fc7c', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 29 02:46:38.009495 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:38.009495 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:38.009495 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:46:38.009495 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:46:38.009495 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:46:38.009495 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:46:38.009495 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 29 02:46:38.009495 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:38.009495 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 29 02:46:38.009495 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 29 02:46:38.009495 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:38.009495 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 29 02:46:38.009495 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'invalid' Oct 29 02:46:38.009495 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:38.009495 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:38.009495 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:38.009495 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:38.009495 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:38.009495 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:38.009495 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:38.017876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:38.017876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:38.017876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:38.017876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:46:38.017876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:46:38.017876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:46:38.017876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:46:38.017876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:46:38.017876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:46:38.017876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 29 02:46:38.017876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:38.017876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:38.017876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:38.017876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:38.017876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:38.017876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:38.017876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:46:38.017876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:46:38.017876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 29 02:46:38.024124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:38.024124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-30eb0068-5703-4758-9426-8688b6ddf364 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:38.024124 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-30eb0068-5703-4758-9426-8688b6ddf364 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c/action" status: 400 len: 144 microversion: 2.1 time: 0.013468 Oct 29 02:46:38.024124 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 209/419] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:46:37 2022] POST /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c/action => generated 144 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 02:46:38.025466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-29098bf8-231a-49d9-bb3f-b73f8ac33a9f tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:38.025466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-29098bf8-231a-49d9-bb3f-b73f8ac33a9f tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Request method failure captured: Oct 29 02:46:38.025466 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c/action HTTP/1.1 Oct 29 02:46:38.025466 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:46:38.025466 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:46:38.025466 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:46:38.025466 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 31 Oct 29 02:46:38.025466 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:46:38.025466 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:46:38.025466 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:46:38.025466 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:38.025466 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPbU7OQUl7VOp0tcplOyHR8kKwQApRnIhoHO1sn8lpi0eUVKbi2DZkmroo3Lbt3M9TGxTLe1C7txOomXOGFWlLNyM07k9U4bMrnKUX06_jy0E672wylVHo4ZWYi1Y3yVSzgQBKQt1ZkNqxoa7AbzJF8ndF7AHmztstx2MHbb9qHQLA Oct 29 02:46:38.025466 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:46:38.025466 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:46:38.025466 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:46:38.025466 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:46:38.025466 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:46:38.025466 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:46:38.025466 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: d954806aa68841e6a76ac40ac99d67ff Oct 29 02:46:38.025466 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-386500486 Oct 29 02:46:38.025466 n-d-862967-2 devstack@n-api.service[127125]: X-Role: admin,reader,member Oct 29 02:46:38.025466 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: admin,reader,member Oct 29 02:46:38.030541 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d954806aa68841e6a76ac40ac99d67ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d954806aa68841e6a76ac40ac99d67ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d954806aa68841e6a76ac40ac99d67ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d954806aa68841e6a76ac40ac99d67ff"}]}] Oct 29 02:46:38.030541 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersAdminNegativeTestJSON-386500486 Oct 29 02:46:38.030541 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: d954806aa68841e6a76ac40ac99d67ff Oct 29 02:46:38.030541 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-386500486 Oct 29 02:46:38.030541 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersAdminNegativeTestJSON-386500486-project-admin Oct 29 02:46:38.030541 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:46:38.030541 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:46:38.030541 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 3a3d02ad5c324be6861e6b6545bfe5d3 Oct 29 02:46:38.030541 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersAdminNegativeTestJSON-386500486-project-admin Oct 29 02:46:38.030541 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:46:38.030541 n-d-862967-2 devstack@n-api.service[127125]: {"os-resetState": {"state": 1}} Oct 29 02:46:38.030541 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:46:38.030541 n-d-862967-2 devstack@n-api.service[127125]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 29 02:46:38.035466 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'c4180915-07c1-4365-976f-3b32fef4fc7c', 'body': {'os-resetState': {'state': 1}}} Oct 29 02:46:38.035466 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:38.035466 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:38.035466 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:46:38.035466 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:46:38.035466 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:46:38.035466 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:46:38.035466 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 29 02:46:38.035466 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:38.035466 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 29 02:46:38.035466 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 29 02:46:38.035466 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:38.035466 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 29 02:46:38.035466 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 1 Oct 29 02:46:38.035466 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:38.035466 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:38.035466 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:38.035466 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:38.035466 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:38.035466 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:38.035466 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:38.035466 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:38.041058 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:38.041058 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:38.041058 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:46:38.041058 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:46:38.041058 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:46:38.041058 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:46:38.041058 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:46:38.041058 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:46:38.041058 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 29 02:46:38.041058 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:38.041058 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:38.041058 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:38.041058 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:38.041058 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:38.041058 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:38.041058 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:46:38.041058 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:46:38.041058 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 29 02:46:38.041058 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:38.042082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-29098bf8-231a-49d9-bb3f-b73f8ac33a9f tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:38.042082 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-29098bf8-231a-49d9-bb3f-b73f8ac33a9f tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c/action" status: 400 len: 120 microversion: 2.1 time: 0.009385 Oct 29 02:46:38.042082 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 211/420] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:46:38 2022] POST /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c/action => generated 120 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 02:46:38.042260 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c5fcfe73-be81-43db-9aaf-8e4ab11ce289 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:38.042260 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c5fcfe73-be81-43db-9aaf-8e4ab11ce289 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Failed to fetch instance by id 999 {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 29 02:46:38.042260 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-c5fcfe73-be81-43db-9aaf-8e4ab11ce289 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 29 02:46:38.042260 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c5fcfe73-be81-43db-9aaf-8e4ab11ce289 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Request method failure captured: Oct 29 02:46:38.042260 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 29 02:46:38.042260 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:46:38.042260 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:46:38.042260 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:46:38.042260 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 37 Oct 29 02:46:38.042260 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:46:38.042260 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:46:38.042260 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:46:38.042260 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:38.042260 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPbU7OQUl7VOp0tcplOyHR8kKwQApRnIhoHO1sn8lpi0eUVKbi2DZkmroo3Lbt3M9TGxTLe1C7txOomXOGFWlLNyM07k9U4bMrnKUX06_jy0E672wylVHo4ZWYi1Y3yVSzgQBKQt1ZkNqxoa7AbzJF8ndF7AHmztstx2MHbb9qHQLA Oct 29 02:46:38.042260 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:46:38.042260 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:46:38.042260 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:46:38.042260 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:46:38.043266 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:46:38.043266 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:46:38.043266 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: d954806aa68841e6a76ac40ac99d67ff Oct 29 02:46:38.043266 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-386500486 Oct 29 02:46:38.043266 n-d-862967-2 devstack@n-api.service[127124]: X-Role: admin,reader,member Oct 29 02:46:38.043266 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: admin,reader,member Oct 29 02:46:38.043266 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d954806aa68841e6a76ac40ac99d67ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d954806aa68841e6a76ac40ac99d67ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d954806aa68841e6a76ac40ac99d67ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d954806aa68841e6a76ac40ac99d67ff"}]}] Oct 29 02:46:38.043266 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersAdminNegativeTestJSON-386500486 Oct 29 02:46:38.043266 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: d954806aa68841e6a76ac40ac99d67ff Oct 29 02:46:38.043266 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-386500486 Oct 29 02:46:38.043266 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersAdminNegativeTestJSON-386500486-project-admin Oct 29 02:46:38.043266 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:46:38.043266 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:46:38.043266 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 3a3d02ad5c324be6861e6b6545bfe5d3 Oct 29 02:46:38.043266 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersAdminNegativeTestJSON-386500486-project-admin Oct 29 02:46:38.043266 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:46:38.043266 n-d-862967-2 devstack@n-api.service[127124]: {"os-resetState": {"state": "error"}} Oct 29 02:46:38.044506 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:46:38.044506 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 999 could not be found. Oct 29 02:46:38.044506 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 29 02:46:38.044506 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:38.044506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:38.044506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:46:38.044506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:46:38.044506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 29 02:46:38.044506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 29 02:46:38.044506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 29 02:46:38.044506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:38.044506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:38.044506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:38.044506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:38.044506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:38.044506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:38.044506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:38.044506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:38.044506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:38.044506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:38.044506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:46:38.045673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:46:38.045673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 29 02:46:38.045673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 29 02:46:38.045673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:46:38.045673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:38.045673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 29 02:46:38.045673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:38.045673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:38.045673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:38.045673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:38.045673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:38.045673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:38.045673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:38.045673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:38.045673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 29 02:46:38.045673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:46:38.045673 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c5fcfe73-be81-43db-9aaf-8e4ab11ce289 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:38.047615 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c5fcfe73-be81-43db-9aaf-8e4ab11ce289 tempest-ServersAdminNegativeTestJSON-386500486 tempest-ServersAdminNegativeTestJSON-386500486-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.015794 Oct 29 02:46:38.054147 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 210/421] 10.222.0.46 () {60 vars in 1179 bytes} [Sat Oct 29 02:46:38 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:46:38.062560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e5a15ac7-549f-4208-b30b-f9ea3271d96a tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:38.062560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e5a15ac7-549f-4208-b30b-f9ea3271d96a tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: f4ce1c31-a9f8-4312-b7ac-09c736eb8bff] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:38.097687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5a15ac7-549f-4208-b30b-f9ea3271d96a tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:38.099307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5a15ac7-549f-4208-b30b-f9ea3271d96a tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:38.099922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5a15ac7-549f-4208-b30b-f9ea3271d96a tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:38.100806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5a15ac7-549f-4208-b30b-f9ea3271d96a tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:38.101350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5a15ac7-549f-4208-b30b-f9ea3271d96a tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:38.104170 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5a15ac7-549f-4208-b30b-f9ea3271d96a tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:38.200225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e5a15ac7-549f-4208-b30b-f9ea3271d96a tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: f4ce1c31-a9f8-4312-b7ac-09c736eb8bff] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:46:38.406514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:38.528096 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e5a15ac7-549f-4208-b30b-f9ea3271d96a tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff" status: 204 len: 0 microversion: 2.1 time: 0.472576 Oct 29 02:46:38.529754 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 212/422] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:46:38 2022] DELETE /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:46:38.543760 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9ac457c4-c614-4bce-baef-02e80a80ab86 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:38.545610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9ac457c4-c614-4bce-baef-02e80a80ab86 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: f4ce1c31-a9f8-4312-b7ac-09c736eb8bff] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:38.558016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ac457c4-c614-4bce-baef-02e80a80ab86 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:38.576044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ac457c4-c614-4bce-baef-02e80a80ab86 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:38.576785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ac457c4-c614-4bce-baef-02e80a80ab86 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:38.578659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ac457c4-c614-4bce-baef-02e80a80ab86 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:38.579683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ac457c4-c614-4bce-baef-02e80a80ab86 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:38.580620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ac457c4-c614-4bce-baef-02e80a80ab86 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:38.772872 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-431ce05c-c308-4d21-92b5-518da4524520 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:38.773845 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-431ce05c-c308-4d21-92b5-518da4524520 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:38.785868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-431ce05c-c308-4d21-92b5-518da4524520 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:38.786597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-431ce05c-c308-4d21-92b5-518da4524520 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:38.787281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-431ce05c-c308-4d21-92b5-518da4524520 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:38.790538 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-431ce05c-c308-4d21-92b5-518da4524520 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:38.791323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-431ce05c-c308-4d21-92b5-518da4524520 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:38.791939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-431ce05c-c308-4d21-92b5-518da4524520 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:39.047773 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9ac457c4-c614-4bce-baef-02e80a80ab86 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:39.061004 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9ac457c4-c614-4bce-baef-02e80a80ab86 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff" status: 200 len: 1468 microversion: 2.1 time: 0.524335 Oct 29 02:46:39.068600 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 211/423] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:38 2022] GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff => generated 1468 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:39.077799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-851dfc1b-1caa-476c-a7f1-b2483273ed65 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:39.083146 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-851dfc1b-1caa-476c-a7f1-b2483273ed65 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 7bfceda7-a17c-40a9-afcc-767b96d5ac7b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:39.101016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-851dfc1b-1caa-476c-a7f1-b2483273ed65 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:39.101515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-851dfc1b-1caa-476c-a7f1-b2483273ed65 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:39.101953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-851dfc1b-1caa-476c-a7f1-b2483273ed65 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:39.102689 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-851dfc1b-1caa-476c-a7f1-b2483273ed65 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:39.103108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-851dfc1b-1caa-476c-a7f1-b2483273ed65 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:39.103528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-851dfc1b-1caa-476c-a7f1-b2483273ed65 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:39.160404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:39.372363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-431ce05c-c308-4d21-92b5-518da4524520 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:39.391544 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-431ce05c-c308-4d21-92b5-518da4524520 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:39.393939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-431ce05c-c308-4d21-92b5-518da4524520 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:39.395642 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-431ce05c-c308-4d21-92b5-518da4524520 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 200 len: 1568 microversion: 2.25 time: 0.627190 Oct 29 02:46:39.413265 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 213/424] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:38 2022] GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 1568 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:46:39.709452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:40.084290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-851dfc1b-1caa-476c-a7f1-b2483273ed65 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:40.098142 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-851dfc1b-1caa-476c-a7f1-b2483273ed65 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b" status: 200 len: 1318 microversion: 2.1 time: 1.024420 Oct 29 02:46:40.103045 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 212/425] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:39 2022] GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b => generated 1318 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:40.107124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5c08bc62-f02a-4370-adf4-92d3b6faf801 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:40.109830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5c08bc62-f02a-4370-adf4-92d3b6faf801 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: f4ce1c31-a9f8-4312-b7ac-09c736eb8bff] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:40.133140 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c08bc62-f02a-4370-adf4-92d3b6faf801 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:40.134434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c08bc62-f02a-4370-adf4-92d3b6faf801 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:40.135442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c08bc62-f02a-4370-adf4-92d3b6faf801 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:40.137677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c08bc62-f02a-4370-adf4-92d3b6faf801 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:40.138573 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c08bc62-f02a-4370-adf4-92d3b6faf801 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:40.140839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c08bc62-f02a-4370-adf4-92d3b6faf801 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:40.357977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=22 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:40.721391 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-25a01691-4ad4-44a4-be6a-d5b680cc744d tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1108055437", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": "none"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:40.751018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:40.832114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-25a01691-4ad4-44a4-be6a-d5b680cc744d tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:46:40.832854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-25a01691-4ad4-44a4-be6a-d5b680cc744d tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:46:40.833514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-25a01691-4ad4-44a4-be6a-d5b680cc744d tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:46:40.834541 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-25a01691-4ad4-44a4-be6a-d5b680cc744d tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:46:40.835267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-25a01691-4ad4-44a4-be6a-d5b680cc744d tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:46:40.863158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25a01691-4ad4-44a4-be6a-d5b680cc744d tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:40.864413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25a01691-4ad4-44a4-be6a-d5b680cc744d tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:40.865918 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25a01691-4ad4-44a4-be6a-d5b680cc744d tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:40.867209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25a01691-4ad4-44a4-be6a-d5b680cc744d tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:40.868190 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25a01691-4ad4-44a4-be6a-d5b680cc744d tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:40.868998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25a01691-4ad4-44a4-be6a-d5b680cc744d tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:40.906642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-25a01691-4ad4-44a4-be6a-d5b680cc744d tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Getting quotas for project c69bfcc0806c4fff8413b502ef25c1d8. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:46:40.915348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-25a01691-4ad4-44a4-be6a-d5b680cc744d tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Getting quotas for user 484ec82616bb4f29b86a8bc34e8b47d2 and project c69bfcc0806c4fff8413b502ef25c1d8. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:46:40.944267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-25a01691-4ad4-44a4-be6a-d5b680cc744d tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:46:40.953244 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-25a01691-4ad4-44a4-be6a-d5b680cc744d tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:46:40.964971 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5c08bc62-f02a-4370-adf4-92d3b6faf801 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:40.975157 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5c08bc62-f02a-4370-adf4-92d3b6faf801 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff" status: 200 len: 1468 microversion: 2.1 time: 0.878438 Oct 29 02:46:40.980556 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 214/426] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:40 2022] GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff => generated 1468 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:40.989460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4dc85315-fa5a-4857-853f-12a693c31402 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:40.992887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4dc85315-fa5a-4857-853f-12a693c31402 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:41.010382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4dc85315-fa5a-4857-853f-12a693c31402 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:41.011195 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4dc85315-fa5a-4857-853f-12a693c31402 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:41.012960 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4dc85315-fa5a-4857-853f-12a693c31402 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:41.014208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4dc85315-fa5a-4857-853f-12a693c31402 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:41.015965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4dc85315-fa5a-4857-853f-12a693c31402 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:41.017043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4dc85315-fa5a-4857-853f-12a693c31402 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:41.220883 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-25a01691-4ad4-44a4-be6a-d5b680cc744d tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.868235 Oct 29 02:46:41.234193 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 213/427] 10.222.0.46 () {62 vars in 1188 bytes} [Sat Oct 29 02:46:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 29 02:46:41.254876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4876f5e7-8f95-4f64-a885-f3f381fe7fda tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:41.257208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4876f5e7-8f95-4f64-a885-f3f381fe7fda tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 7bfceda7-a17c-40a9-afcc-767b96d5ac7b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:41.283711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4876f5e7-8f95-4f64-a885-f3f381fe7fda tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:41.286972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4876f5e7-8f95-4f64-a885-f3f381fe7fda tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:41.288171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4876f5e7-8f95-4f64-a885-f3f381fe7fda tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:41.297215 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4876f5e7-8f95-4f64-a885-f3f381fe7fda tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:41.301169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4876f5e7-8f95-4f64-a885-f3f381fe7fda tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:41.302026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4876f5e7-8f95-4f64-a885-f3f381fe7fda tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:41.660977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4876f5e7-8f95-4f64-a885-f3f381fe7fda tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:41.671702 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4876f5e7-8f95-4f64-a885-f3f381fe7fda tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b" status: 200 len: 1318 microversion: 2.1 time: 0.434723 Oct 29 02:46:41.676025 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 214/428] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:41 2022] GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b => generated 1318 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:41.699124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3470153b-68b1-4566-8330-ffc21d7ec993 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:41.702056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3470153b-68b1-4566-8330-ffc21d7ec993 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:42.125858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=18 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:42.306651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3470153b-68b1-4566-8330-ffc21d7ec993 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:42.342695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3470153b-68b1-4566-8330-ffc21d7ec993 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:42.346040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3470153b-68b1-4566-8330-ffc21d7ec993 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:42.384850 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3470153b-68b1-4566-8330-ffc21d7ec993 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "PUT /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1359 microversion: 2.75 time: 0.678390 Oct 29 02:46:42.432758 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 215/429] 10.222.0.46 () {62 vars in 1297 bytes} [Sat Oct 29 02:46:41 2022] PUT /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1359 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:42.450677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7213cef3-4105-46fa-9473-6558e57a5e5f tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:42.451296 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7213cef3-4105-46fa-9473-6558e57a5e5f tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: f4ce1c31-a9f8-4312-b7ac-09c736eb8bff] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:42.453745 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=91 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:42.461756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7213cef3-4105-46fa-9473-6558e57a5e5f tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:42.467010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7213cef3-4105-46fa-9473-6558e57a5e5f tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:42.468218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7213cef3-4105-46fa-9473-6558e57a5e5f tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:42.473142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7213cef3-4105-46fa-9473-6558e57a5e5f tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:42.473655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7213cef3-4105-46fa-9473-6558e57a5e5f tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:42.474207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7213cef3-4105-46fa-9473-6558e57a5e5f tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:42.529307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4dc85315-fa5a-4857-853f-12a693c31402 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:42.574987 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4dc85315-fa5a-4857-853f-12a693c31402 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:42.576595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4dc85315-fa5a-4857-853f-12a693c31402 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:42.579735 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4dc85315-fa5a-4857-853f-12a693c31402 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 200 len: 1568 microversion: 2.25 time: 1.597872 Oct 29 02:46:42.601032 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 215/430] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:40 2022] GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 1568 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:42.612834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-461a7854-a4d9-47a9-a529-5ebda9ab97d1 req-eab5ad64-227d-4ef6-9332-84ad3b03b4cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c325f03-e675-4cd8-928e-a09523951d3d", "tag": "d7415e85-b26b-458a-89a7-2771cf318df7"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:42.637485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-461a7854-a4d9-47a9-a529-5ebda9ab97d1 req-eab5ad64-227d-4ef6-9332-84ad3b03b4cb service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:42.642780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-461a7854-a4d9-47a9-a529-5ebda9ab97d1 req-eab5ad64-227d-4ef6-9332-84ad3b03b4cb service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:42.643530 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-461a7854-a4d9-47a9-a529-5ebda9ab97d1 req-eab5ad64-227d-4ef6-9332-84ad3b03b4cb service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:42.671512 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-461a7854-a4d9-47a9-a529-5ebda9ab97d1 req-eab5ad64-227d-4ef6-9332-84ad3b03b4cb service nova] Creating event network-changed:d7415e85-b26b-458a-89a7-2771cf318df7 for instance 6c325f03-e675-4cd8-928e-a09523951d3d on n-h2-862967-2 Oct 29 02:46:42.693794 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-461a7854-a4d9-47a9-a529-5ebda9ab97d1 req-eab5ad64-227d-4ef6-9332-84ad3b03b4cb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079852 Oct 29 02:46:42.697208 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 216/431] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:42.710450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5244464b-d5db-47ca-b538-169c8d73aaf8 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:42.711490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5244464b-d5db-47ca-b538-169c8d73aaf8 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:42.731865 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5244464b-d5db-47ca-b538-169c8d73aaf8 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:42.732368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5244464b-d5db-47ca-b538-169c8d73aaf8 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:42.732884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5244464b-d5db-47ca-b538-169c8d73aaf8 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:42.738648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5244464b-d5db-47ca-b538-169c8d73aaf8 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:42.747405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5244464b-d5db-47ca-b538-169c8d73aaf8 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:42.748290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5244464b-d5db-47ca-b538-169c8d73aaf8 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:43.147168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5244464b-d5db-47ca-b538-169c8d73aaf8 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:43.168808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5244464b-d5db-47ca-b538-169c8d73aaf8 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:43.179027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5244464b-d5db-47ca-b538-169c8d73aaf8 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:43.213366 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5244464b-d5db-47ca-b538-169c8d73aaf8 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1355 microversion: 2.75 time: 0.511793 Oct 29 02:46:43.225021 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 217/432] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:42 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1355 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:43.234398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cdb62c2a-98d0-48d5-8d7b-7556d0170820 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:43.235484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cdb62c2a-98d0-48d5-8d7b-7556d0170820 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 7bfceda7-a17c-40a9-afcc-767b96d5ac7b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:43.247651 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdb62c2a-98d0-48d5-8d7b-7556d0170820 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:43.248337 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdb62c2a-98d0-48d5-8d7b-7556d0170820 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:43.249659 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdb62c2a-98d0-48d5-8d7b-7556d0170820 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:43.250611 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdb62c2a-98d0-48d5-8d7b-7556d0170820 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:43.251255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdb62c2a-98d0-48d5-8d7b-7556d0170820 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:43.251709 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdb62c2a-98d0-48d5-8d7b-7556d0170820 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:43.971939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cdb62c2a-98d0-48d5-8d7b-7556d0170820 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:43.982666 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cdb62c2a-98d0-48d5-8d7b-7556d0170820 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b" status: 200 len: 1318 microversion: 2.1 time: 0.765453 Oct 29 02:46:43.988560 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 218/433] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:43 2022] GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b => generated 1318 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:43.993817 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-86bcde9e-7c58-4d5b-88b3-c21fdadd4349 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:43.994432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-86bcde9e-7c58-4d5b-88b3-c21fdadd4349 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:44.016949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86bcde9e-7c58-4d5b-88b3-c21fdadd4349 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:44.020156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86bcde9e-7c58-4d5b-88b3-c21fdadd4349 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:44.024122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86bcde9e-7c58-4d5b-88b3-c21fdadd4349 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:44.031996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86bcde9e-7c58-4d5b-88b3-c21fdadd4349 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:44.033022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86bcde9e-7c58-4d5b-88b3-c21fdadd4349 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:44.036026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86bcde9e-7c58-4d5b-88b3-c21fdadd4349 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:44.121832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7213cef3-4105-46fa-9473-6558e57a5e5f tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:44.141682 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7213cef3-4105-46fa-9473-6558e57a5e5f tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff" status: 200 len: 1468 microversion: 2.1 time: 1.707567 Oct 29 02:46:44.142493 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 216/434] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:42 2022] GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff => generated 1468 bytes in 1709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:44.161312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-9e073479-f01c-4c50-917a-6e9b1e7aa0bf req-7fd121bd-f101-4b67-8e77-705235afa71e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4ce1c31-a9f8-4312-b7ac-09c736eb8bff", "name": "network-vif-deleted", "tag": "52c3ac9d-fa0e-4f9e-9473-a653ab543c14"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:44.193491 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9e073479-f01c-4c50-917a-6e9b1e7aa0bf req-7fd121bd-f101-4b67-8e77-705235afa71e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:44.195405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9e073479-f01c-4c50-917a-6e9b1e7aa0bf req-7fd121bd-f101-4b67-8e77-705235afa71e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:44.198127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9e073479-f01c-4c50-917a-6e9b1e7aa0bf req-7fd121bd-f101-4b67-8e77-705235afa71e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:44.238054 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-9e073479-f01c-4c50-917a-6e9b1e7aa0bf req-7fd121bd-f101-4b67-8e77-705235afa71e service nova] Creating event network-vif-deleted:52c3ac9d-fa0e-4f9e-9473-a653ab543c14 for instance f4ce1c31-a9f8-4312-b7ac-09c736eb8bff on n-h2-862967-2 Oct 29 02:46:44.252603 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-9e073479-f01c-4c50-917a-6e9b1e7aa0bf req-7fd121bd-f101-4b67-8e77-705235afa71e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107543 Oct 29 02:46:44.255705 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 217/435] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:44.269447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-79bd030d-3c35-4dc1-b102-0818f1d94c1a tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:44.270412 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-79bd030d-3c35-4dc1-b102-0818f1d94c1a tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:44.278791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79bd030d-3c35-4dc1-b102-0818f1d94c1a tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:44.280095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79bd030d-3c35-4dc1-b102-0818f1d94c1a tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:44.280833 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79bd030d-3c35-4dc1-b102-0818f1d94c1a tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:44.281993 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79bd030d-3c35-4dc1-b102-0818f1d94c1a tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:44.282836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79bd030d-3c35-4dc1-b102-0818f1d94c1a tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:44.283854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79bd030d-3c35-4dc1-b102-0818f1d94c1a tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:44.652287 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-79bd030d-3c35-4dc1-b102-0818f1d94c1a tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:44.675167 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-79bd030d-3c35-4dc1-b102-0818f1d94c1a tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:44.688194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-79bd030d-3c35-4dc1-b102-0818f1d94c1a tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:44.708162 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-79bd030d-3c35-4dc1-b102-0818f1d94c1a tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1419 microversion: 2.75 time: 0.448074 Oct 29 02:46:44.720955 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 218/436] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:44 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1419 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:44.954057 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-86bcde9e-7c58-4d5b-88b3-c21fdadd4349 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:44.980122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-86bcde9e-7c58-4d5b-88b3-c21fdadd4349 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:44.987992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-86bcde9e-7c58-4d5b-88b3-c21fdadd4349 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:44.997269 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-86bcde9e-7c58-4d5b-88b3-c21fdadd4349 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 200 len: 1558 microversion: 2.25 time: 1.007211 Oct 29 02:46:45.005947 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 219/437] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:43 2022] GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 1558 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:45.012046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-18e8ded9-18a4-4488-9ee9-9c82270426c4 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:45.013750 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-18e8ded9-18a4-4488-9ee9-9c82270426c4 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 7bfceda7-a17c-40a9-afcc-767b96d5ac7b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:45.034255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5936eeed-b3dd-4a28-bef8-cf6fdd39c8f9 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Calling method '.version_select at 0x7ff0581ebca0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:45.035408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-18e8ded9-18a4-4488-9ee9-9c82270426c4 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:45.037665 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-18e8ded9-18a4-4488-9ee9-9c82270426c4 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:45.038376 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-18e8ded9-18a4-4488-9ee9-9c82270426c4 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:45.041595 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-18e8ded9-18a4-4488-9ee9-9c82270426c4 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:45.049633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-18e8ded9-18a4-4488-9ee9-9c82270426c4 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:45.052751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-18e8ded9-18a4-4488-9ee9-9c82270426c4 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:45.059459 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5936eeed-b3dd-4a28-bef8-cf6fdd39c8f9 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:45.059961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5936eeed-b3dd-4a28-bef8-cf6fdd39c8f9 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:45.060394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5936eeed-b3dd-4a28-bef8-cf6fdd39c8f9 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:45.105857 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5936eeed-b3dd-4a28-bef8-cf6fdd39c8f9 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 680 microversion: 2.25 time: 0.085873 Oct 29 02:46:45.106471 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 220/438] 10.222.0.46 () {60 vars in 1184 bytes} [Sat Oct 29 02:46:45 2022] GET /compute/v2.1/os-migrations => generated 680 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:46:45.144692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5cff2aff-2ab8-4d2b-acab-31db8b1afdf2 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:45.146297 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5cff2aff-2ab8-4d2b-acab-31db8b1afdf2 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:45.165953 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5cff2aff-2ab8-4d2b-acab-31db8b1afdf2 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:45.166640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5cff2aff-2ab8-4d2b-acab-31db8b1afdf2 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:45.167300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5cff2aff-2ab8-4d2b-acab-31db8b1afdf2 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:45.171328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5cff2aff-2ab8-4d2b-acab-31db8b1afdf2 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:45.175408 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5cff2aff-2ab8-4d2b-acab-31db8b1afdf2 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:45.177107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5cff2aff-2ab8-4d2b-acab-31db8b1afdf2 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:45.642180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-18e8ded9-18a4-4488-9ee9-9c82270426c4 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:45.668027 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-18e8ded9-18a4-4488-9ee9-9c82270426c4 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b" status: 200 len: 1318 microversion: 2.1 time: 0.652980 Oct 29 02:46:45.669126 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 219/439] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:45 2022] GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b => generated 1318 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:45.679058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-92015e49-ee42-452f-8489-a8e81938c6a7 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:45.680268 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-92015e49-ee42-452f-8489-a8e81938c6a7 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: f4ce1c31-a9f8-4312-b7ac-09c736eb8bff] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:45.698957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92015e49-ee42-452f-8489-a8e81938c6a7 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:45.699553 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92015e49-ee42-452f-8489-a8e81938c6a7 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:45.699994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92015e49-ee42-452f-8489-a8e81938c6a7 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:45.700966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92015e49-ee42-452f-8489-a8e81938c6a7 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:45.701374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92015e49-ee42-452f-8489-a8e81938c6a7 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:45.701790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92015e49-ee42-452f-8489-a8e81938c6a7 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:45.860159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92015e49-ee42-452f-8489-a8e81938c6a7 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:45.864749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92015e49-ee42-452f-8489-a8e81938c6a7 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:45.866062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92015e49-ee42-452f-8489-a8e81938c6a7 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:45.870737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-92015e49-ee42-452f-8489-a8e81938c6a7 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lazy-loading 'fault' on Instance uuid f4ce1c31-a9f8-4312-b7ac-09c736eb8bff {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:46.160576 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-5cff2aff-2ab8-4d2b-acab-31db8b1afdf2 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lazy-loading 'services' on Instance uuid 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:46:46.210075 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5cff2aff-2ab8-4d2b-acab-31db8b1afdf2 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 200 len: 2051 microversion: 2.25 time: 1.086178 Oct 29 02:46:46.212107 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 221/440] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:45 2022] GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 2051 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:46.232516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9c56fb10-b894-4c9f-9028-2d47bfd1b629 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:46.240678 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9c56fb10-b894-4c9f-9028-2d47bfd1b629 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:46.267984 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c56fb10-b894-4c9f-9028-2d47bfd1b629 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:46.281850 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c56fb10-b894-4c9f-9028-2d47bfd1b629 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:46.282353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-92015e49-ee42-452f-8489-a8e81938c6a7 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:46.284007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c56fb10-b894-4c9f-9028-2d47bfd1b629 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:46.284793 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c56fb10-b894-4c9f-9028-2d47bfd1b629 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:46.285260 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c56fb10-b894-4c9f-9028-2d47bfd1b629 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:46.285689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c56fb10-b894-4c9f-9028-2d47bfd1b629 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:46.300756 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-92015e49-ee42-452f-8489-a8e81938c6a7 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff" status: 200 len: 1311 microversion: 2.1 time: 0.627617 Oct 29 02:46:46.303036 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 220/441] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:45 2022] GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff => generated 1311 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:46.457534 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9c56fb10-b894-4c9f-9028-2d47bfd1b629 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:46.468169 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9c56fb10-b894-4c9f-9028-2d47bfd1b629 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:46.470140 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9c56fb10-b894-4c9f-9028-2d47bfd1b629 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:46.477791 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9c56fb10-b894-4c9f-9028-2d47bfd1b629 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1417 microversion: 2.75 time: 0.259288 Oct 29 02:46:46.478973 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 222/442] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:46 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1417 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:46.642005 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-679a4844-3931-4bd7-9fd8-4c58cbbf3116 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1579639962", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "bc545f16-a7b3-4024-a8d4-95a9643831d5"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:46.701575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-65f696ab-af72-4a2d-a5d8-e947545effe8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:46.702255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-65f696ab-af72-4a2d-a5d8-e947545effe8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 7bfceda7-a17c-40a9-afcc-767b96d5ac7b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:46.716158 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65f696ab-af72-4a2d-a5d8-e947545effe8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:46.716721 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65f696ab-af72-4a2d-a5d8-e947545effe8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:46.717118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65f696ab-af72-4a2d-a5d8-e947545effe8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:46.721081 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65f696ab-af72-4a2d-a5d8-e947545effe8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:46.722728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65f696ab-af72-4a2d-a5d8-e947545effe8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:46.724885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65f696ab-af72-4a2d-a5d8-e947545effe8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:46.769286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-679a4844-3931-4bd7-9fd8-4c58cbbf3116 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] validate_networks() for [('bc545f16-a7b3-4024-a8d4-95a9643831d5', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:46:47.821175 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-65f696ab-af72-4a2d-a5d8-e947545effe8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:47.829902 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-65f696ab-af72-4a2d-a5d8-e947545effe8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b" status: 200 len: 1318 microversion: 2.1 time: 1.134885 Oct 29 02:46:47.832680 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 223/443] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:46 2022] GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b => generated 1318 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:46:47.841923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-57c13286-6c46-45d3-9fd2-0284f3d7f925 req-448ac536-8d35-46ee-89e7-c661a6587649 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bfceda7-a17c-40a9-afcc-767b96d5ac7b", "tag": "99bb1159-a8fd-4f60-8e3d-a0322363f20d"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:47.856794 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-57c13286-6c46-45d3-9fd2-0284f3d7f925 req-448ac536-8d35-46ee-89e7-c661a6587649 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:47.857585 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-57c13286-6c46-45d3-9fd2-0284f3d7f925 req-448ac536-8d35-46ee-89e7-c661a6587649 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:47.858262 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-57c13286-6c46-45d3-9fd2-0284f3d7f925 req-448ac536-8d35-46ee-89e7-c661a6587649 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:47.877258 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-57c13286-6c46-45d3-9fd2-0284f3d7f925 req-448ac536-8d35-46ee-89e7-c661a6587649 service nova] Creating event network-changed:99bb1159-a8fd-4f60-8e3d-a0322363f20d for instance 7bfceda7-a17c-40a9-afcc-767b96d5ac7b on n-h2-862967-2 Oct 29 02:46:47.885601 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-57c13286-6c46-45d3-9fd2-0284f3d7f925 req-448ac536-8d35-46ee-89e7-c661a6587649 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050349 Oct 29 02:46:47.887292 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 224/444] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:47.895890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bb1378b0-d34e-4cfa-8311-9860fef14819 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:47.897311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bb1378b0-d34e-4cfa-8311-9860fef14819 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: f4ce1c31-a9f8-4312-b7ac-09c736eb8bff] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:47.904269 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb1378b0-d34e-4cfa-8311-9860fef14819 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:47.905101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb1378b0-d34e-4cfa-8311-9860fef14819 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:47.905786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb1378b0-d34e-4cfa-8311-9860fef14819 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:47.906767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb1378b0-d34e-4cfa-8311-9860fef14819 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:47.907487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb1378b0-d34e-4cfa-8311-9860fef14819 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:47.908107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb1378b0-d34e-4cfa-8311-9860fef14819 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:47.925096 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-bb1378b0-d34e-4cfa-8311-9860fef14819 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] HTTP exception thrown: Instance f4ce1c31-a9f8-4312-b7ac-09c736eb8bff could not be found. Oct 29 02:46:47.927872 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bb1378b0-d34e-4cfa-8311-9860fef14819 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Request method failure captured: Oct 29 02:46:47.927872 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff HTTP/1.1 Oct 29 02:46:47.927872 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:46:47.927872 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:46:47.927872 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:46:47.927872 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:46:47.927872 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:46:47.927872 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:46:47.927872 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:46:47.927872 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:47.927872 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPZ0sd6i9OeboiijGp4CHofeJN-QO3pDGvnVi3Kn9t94fgJmUdj_itAgL2NRqGwzqZEtBYk2ACD3FCCVUbIclx7H0_Wmr7OekO2JZTG3_tRQnJvoF1hm7-NdSf7HrAggX3aDKJgGODE5QeTG35tylpUWiIRE3c7AzGeW3THO3YcTwI Oct 29 02:46:47.927872 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:46:47.927872 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:46:47.927872 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:46:47.927872 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:46:47.927872 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:46:47.927872 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:46:47.927872 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 687ff1c168124c6aa2bae831ffa0ad47 Oct 29 02:46:47.927872 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2049914252 Oct 29 02:46:47.927872 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:46:47.927872 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:46:47.929242 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/687ff1c168124c6aa2bae831ffa0ad47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/687ff1c168124c6aa2bae831ffa0ad47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_687ff1c168124c6aa2bae831ffa0ad47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/687ff1c168124c6aa2bae831ffa0ad47"}]}] Oct 29 02:46:47.929242 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2049914252 Oct 29 02:46:47.929242 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 687ff1c168124c6aa2bae831ffa0ad47 Oct 29 02:46:47.929242 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2049914252 Oct 29 02:46:47.929242 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersAdminNegativeTestJSON-2049914252-project Oct 29 02:46:47.929242 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:46:47.929242 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:46:47.929242 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: c6b28aab121f44d09e44615e410350c8 Oct 29 02:46:47.929242 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2049914252-project Oct 29 02:46:47.929242 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:46:47.929242 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance f4ce1c31-a9f8-4312-b7ac-09c736eb8bff could not be found. Oct 29 02:46:47.929242 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'f4ce1c31-a9f8-4312-b7ac-09c736eb8bff'} Oct 29 02:46:47.929983 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:47.929983 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:47.929983 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:46:47.929983 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:46:47.929983 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:46:47.929983 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:46:47.929983 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:46:47.929983 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:46:47.929983 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:46:47.929983 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:46:47.929983 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4ce1c31-a9f8-4312-b7ac-09c736eb8bff could not be found. Oct 29 02:46:47.929983 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:47.929983 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:47.929983 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:47.929983 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:47.929983 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:47.929983 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:47.929983 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:47.929983 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:47.929983 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:47.931189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:47.931189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:46:47.931189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:46:47.931189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:46:47.931189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:46:47.931189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:46:47.931189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:47.931189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4ce1c31-a9f8-4312-b7ac-09c736eb8bff could not be found. Oct 29 02:46:47.931189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:47.931189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:47.931189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:47.931189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:47.931189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:47.931189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:47.931189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:47.931189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:47.931189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4ce1c31-a9f8-4312-b7ac-09c736eb8bff could not be found. Oct 29 02:46:47.931189 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:47.932307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bb1378b0-d34e-4cfa-8311-9860fef14819 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Returning 404 to user: Instance f4ce1c31-a9f8-4312-b7ac-09c736eb8bff could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:47.932307 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bb1378b0-d34e-4cfa-8311-9860fef14819 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff" status: 404 len: 111 microversion: 2.1 time: 0.040801 Oct 29 02:46:47.933943 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 225/445] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:47 2022] GET /compute/v2.1/servers/f4ce1c31-a9f8-4312-b7ac-09c736eb8bff => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:47.940291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6fd69236-7208-43f4-b200-3e9736fbe00c tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:47.941142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6fd69236-7208-43f4-b200-3e9736fbe00c tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:47.948610 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6fd69236-7208-43f4-b200-3e9736fbe00c tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:47.949204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6fd69236-7208-43f4-b200-3e9736fbe00c tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:47.949722 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6fd69236-7208-43f4-b200-3e9736fbe00c tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:47.950504 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6fd69236-7208-43f4-b200-3e9736fbe00c tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:47.951031 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6fd69236-7208-43f4-b200-3e9736fbe00c tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:47.951530 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6fd69236-7208-43f4-b200-3e9736fbe00c tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:48.040454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6fd69236-7208-43f4-b200-3e9736fbe00c tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:48.062277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6fd69236-7208-43f4-b200-3e9736fbe00c tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:48.063719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6fd69236-7208-43f4-b200-3e9736fbe00c tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:48.079468 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6fd69236-7208-43f4-b200-3e9736fbe00c tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1438 microversion: 2.75 time: 0.144270 Oct 29 02:46:48.084911 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 226/446] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:47 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1438 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:48.433824 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fc47e14c-1cb9-45ea-abf3-9df4423404e1 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1334111798", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:48.494772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-679a4844-3931-4bd7-9fd8-4c58cbbf3116 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:46:48.495794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-679a4844-3931-4bd7-9fd8-4c58cbbf3116 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:46:48.495960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-679a4844-3931-4bd7-9fd8-4c58cbbf3116 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:46:48.496321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-679a4844-3931-4bd7-9fd8-4c58cbbf3116 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:46:48.497065 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-679a4844-3931-4bd7-9fd8-4c58cbbf3116 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:46:48.519589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-679a4844-3931-4bd7-9fd8-4c58cbbf3116 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:48.522355 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-679a4844-3931-4bd7-9fd8-4c58cbbf3116 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:48.522972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-679a4844-3931-4bd7-9fd8-4c58cbbf3116 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:48.526952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-679a4844-3931-4bd7-9fd8-4c58cbbf3116 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:48.530794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-679a4844-3931-4bd7-9fd8-4c58cbbf3116 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:48.531707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-679a4844-3931-4bd7-9fd8-4c58cbbf3116 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:48.599144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-fc47e14c-1cb9-45ea-abf3-9df4423404e1 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] validate_networks() for None {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:46:48.605118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-679a4844-3931-4bd7-9fd8-4c58cbbf3116 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Getting quotas for project f86634862bd64e0f9f00972e4ce0982b. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:46:48.619318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-679a4844-3931-4bd7-9fd8-4c58cbbf3116 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Getting quotas for user 067d53567ea944b1b69ee7f461aa0c16 and project f86634862bd64e0f9f00972e4ce0982b. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:46:48.647430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-679a4844-3931-4bd7-9fd8-4c58cbbf3116 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:46:48.655585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-679a4844-3931-4bd7-9fd8-4c58cbbf3116 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:46:48.769178 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-679a4844-3931-4bd7-9fd8-4c58cbbf3116 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.135375 Oct 29 02:46:48.776776 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 221/447] 10.222.0.46 () {62 vars in 1188 bytes} [Sat Oct 29 02:46:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2144 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 29 02:46:48.783084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ef239728-b401-4ffc-a98f-8ef1d627ea92 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:48.783584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ef239728-b401-4ffc-a98f-8ef1d627ea92 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: c4180915-07c1-4365-976f-3b32fef4fc7c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:48.799026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef239728-b401-4ffc-a98f-8ef1d627ea92 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:48.799812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef239728-b401-4ffc-a98f-8ef1d627ea92 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:48.800445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef239728-b401-4ffc-a98f-8ef1d627ea92 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:48.801337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef239728-b401-4ffc-a98f-8ef1d627ea92 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:48.801936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef239728-b401-4ffc-a98f-8ef1d627ea92 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:48.802596 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef239728-b401-4ffc-a98f-8ef1d627ea92 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:48.855150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ef239728-b401-4ffc-a98f-8ef1d627ea92 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: c4180915-07c1-4365-976f-3b32fef4fc7c] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:46:49.095322 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ef239728-b401-4ffc-a98f-8ef1d627ea92 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c" status: 204 len: 0 microversion: 2.1 time: 0.317111 Oct 29 02:46:49.100227 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 222/448] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:46:48 2022] DELETE /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:46:49.109048 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e30acb58-0fb4-4712-834f-ab43d3a0ffe4 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:49.118415 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e30acb58-0fb4-4712-834f-ab43d3a0ffe4 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:49.135032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e30acb58-0fb4-4712-834f-ab43d3a0ffe4 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:49.135541 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e30acb58-0fb4-4712-834f-ab43d3a0ffe4 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:49.135971 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e30acb58-0fb4-4712-834f-ab43d3a0ffe4 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:49.139076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e30acb58-0fb4-4712-834f-ab43d3a0ffe4 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:49.139583 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e30acb58-0fb4-4712-834f-ab43d3a0ffe4 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:49.140012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e30acb58-0fb4-4712-834f-ab43d3a0ffe4 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:49.329924 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e30acb58-0fb4-4712-834f-ab43d3a0ffe4 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:46:49.330504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e30acb58-0fb4-4712-834f-ab43d3a0ffe4 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:46:49.332924 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e30acb58-0fb4-4712-834f-ab43d3a0ffe4 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:46:49.333658 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e30acb58-0fb4-4712-834f-ab43d3a0ffe4 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:46:49.336614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e30acb58-0fb4-4712-834f-ab43d3a0ffe4 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:46:49.495904 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e30acb58-0fb4-4712-834f-ab43d3a0ffe4 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:49.507788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e30acb58-0fb4-4712-834f-ab43d3a0ffe4 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:49.508697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e30acb58-0fb4-4712-834f-ab43d3a0ffe4 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:49.509608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e30acb58-0fb4-4712-834f-ab43d3a0ffe4 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:49.511719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e30acb58-0fb4-4712-834f-ab43d3a0ffe4 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:49.512610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e30acb58-0fb4-4712-834f-ab43d3a0ffe4 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:49.513685 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e30acb58-0fb4-4712-834f-ab43d3a0ffe4 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:49.575678 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-fc47e14c-1cb9-45ea-abf3-9df4423404e1 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:46:49.576324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-fc47e14c-1cb9-45ea-abf3-9df4423404e1 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:46:49.577169 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-fc47e14c-1cb9-45ea-abf3-9df4423404e1 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:46:49.577588 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-fc47e14c-1cb9-45ea-abf3-9df4423404e1 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:46:49.577993 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-fc47e14c-1cb9-45ea-abf3-9df4423404e1 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:46:49.604176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc47e14c-1cb9-45ea-abf3-9df4423404e1 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:49.605114 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc47e14c-1cb9-45ea-abf3-9df4423404e1 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:49.605719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc47e14c-1cb9-45ea-abf3-9df4423404e1 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:49.606936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc47e14c-1cb9-45ea-abf3-9df4423404e1 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:49.607561 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc47e14c-1cb9-45ea-abf3-9df4423404e1 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:49.608305 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc47e14c-1cb9-45ea-abf3-9df4423404e1 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:49.662848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-fc47e14c-1cb9-45ea-abf3-9df4423404e1 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Getting quotas for project 28feebf0d93c499aa8ed33fe4e12e3d5. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:46:49.677454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-fc47e14c-1cb9-45ea-abf3-9df4423404e1 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Getting quotas for user 0660da2ef33845f9a7784dea223dda62 and project 28feebf0d93c499aa8ed33fe4e12e3d5. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:46:49.713892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fc47e14c-1cb9-45ea-abf3-9df4423404e1 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:46:49.718230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fc47e14c-1cb9-45ea-abf3-9df4423404e1 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: d6f7b0a6-5397-4688-b938-15d013e11ad5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:46:49.799200 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e30acb58-0fb4-4712-834f-ab43d3a0ffe4 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:49.810306 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e30acb58-0fb4-4712-834f-ab43d3a0ffe4 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:49.813630 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e30acb58-0fb4-4712-834f-ab43d3a0ffe4 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:49.821547 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e30acb58-0fb4-4712-834f-ab43d3a0ffe4 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "POST /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb/action" status: 202 len: 1495 microversion: 2.75 time: 0.722783 Oct 29 02:46:49.838567 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 223/449] 10.222.0.46 () {62 vars in 1319 bytes} [Sat Oct 29 02:46:49 2022] POST /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb/action => generated 1495 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 29 02:46:49.858579 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fc47e14c-1cb9-45ea-abf3-9df4423404e1 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.772399 Oct 29 02:46:49.858821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bca58ae1-3b58-4e11-ad84-1a5851219043 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:49.859250 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 227/450] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:46:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:46:49.859410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bca58ae1-3b58-4e11-ad84-1a5851219043 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:49.869280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bca58ae1-3b58-4e11-ad84-1a5851219043 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:49.870113 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bca58ae1-3b58-4e11-ad84-1a5851219043 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:49.870719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bca58ae1-3b58-4e11-ad84-1a5851219043 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:49.871892 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bca58ae1-3b58-4e11-ad84-1a5851219043 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:49.872772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bca58ae1-3b58-4e11-ad84-1a5851219043 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:49.873701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bca58ae1-3b58-4e11-ad84-1a5851219043 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:49.892299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cab0e7fd-6bcf-4af4-a8c5-802b06c0dd72 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:49.893226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cab0e7fd-6bcf-4af4-a8c5-802b06c0dd72 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 7bfceda7-a17c-40a9-afcc-767b96d5ac7b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:49.925630 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cab0e7fd-6bcf-4af4-a8c5-802b06c0dd72 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:49.926416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cab0e7fd-6bcf-4af4-a8c5-802b06c0dd72 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:49.927117 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cab0e7fd-6bcf-4af4-a8c5-802b06c0dd72 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:49.940657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cab0e7fd-6bcf-4af4-a8c5-802b06c0dd72 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:49.941501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cab0e7fd-6bcf-4af4-a8c5-802b06c0dd72 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:49.942144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cab0e7fd-6bcf-4af4-a8c5-802b06c0dd72 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:50.144397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bca58ae1-3b58-4e11-ad84-1a5851219043 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:50.158192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bca58ae1-3b58-4e11-ad84-1a5851219043 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:50.160348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bca58ae1-3b58-4e11-ad84-1a5851219043 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:50.164612 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bca58ae1-3b58-4e11-ad84-1a5851219043 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 1266 microversion: 2.25 time: 0.324723 Oct 29 02:46:50.165528 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 224/451] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:49 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 1266 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:50.173072 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ac7e8f4f-ddb6-461a-bd0a-bbfafdb2171a tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:50.179010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ac7e8f4f-ddb6-461a-bd0a-bbfafdb2171a tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: c4180915-07c1-4365-976f-3b32fef4fc7c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:50.194915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ac7e8f4f-ddb6-461a-bd0a-bbfafdb2171a tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:50.195581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ac7e8f4f-ddb6-461a-bd0a-bbfafdb2171a tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:50.197170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ac7e8f4f-ddb6-461a-bd0a-bbfafdb2171a tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:50.199239 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ac7e8f4f-ddb6-461a-bd0a-bbfafdb2171a tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:50.199916 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ac7e8f4f-ddb6-461a-bd0a-bbfafdb2171a tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:50.202562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ac7e8f4f-ddb6-461a-bd0a-bbfafdb2171a tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:50.249321 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cab0e7fd-6bcf-4af4-a8c5-802b06c0dd72 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:50.274604 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cab0e7fd-6bcf-4af4-a8c5-802b06c0dd72 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b" status: 200 len: 1318 microversion: 2.1 time: 0.374806 Oct 29 02:46:50.288953 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 228/452] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:49 2022] GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b => generated 1318 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:50.306498 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-70524717-5dd3-4be5-b21d-8e367fef9809 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:50.307506 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-70524717-5dd3-4be5-b21d-8e367fef9809 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:50.325329 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70524717-5dd3-4be5-b21d-8e367fef9809 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:50.330510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70524717-5dd3-4be5-b21d-8e367fef9809 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:50.331149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70524717-5dd3-4be5-b21d-8e367fef9809 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:50.332036 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70524717-5dd3-4be5-b21d-8e367fef9809 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:50.332778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70524717-5dd3-4be5-b21d-8e367fef9809 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:50.333349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70524717-5dd3-4be5-b21d-8e367fef9809 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:50.515133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-70524717-5dd3-4be5-b21d-8e367fef9809 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:50.534313 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-70524717-5dd3-4be5-b21d-8e367fef9809 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:50.546001 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-70524717-5dd3-4be5-b21d-8e367fef9809 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:50.561827 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-70524717-5dd3-4be5-b21d-8e367fef9809 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1447 microversion: 2.75 time: 0.261257 Oct 29 02:46:50.566405 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 229/453] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:50 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1447 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:50.576414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9fb0023c-06ea-4edd-9e30-5759781f94b8 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:50.577091 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9fb0023c-06ea-4edd-9e30-5759781f94b8 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: d6f7b0a6-5397-4688-b938-15d013e11ad5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:50.820577 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9fb0023c-06ea-4edd-9e30-5759781f94b8 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:50.830358 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9fb0023c-06ea-4edd-9e30-5759781f94b8 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5" status: 200 len: 1219 microversion: 2.1 time: 0.260762 Oct 29 02:46:50.833695 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 230/454] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:50 2022] GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5 => generated 1219 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:51.199062 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3592dd65-836b-4dd7-98bc-c223afdad6d4 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:51.200128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3592dd65-836b-4dd7-98bc-c223afdad6d4 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:51.213073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3592dd65-836b-4dd7-98bc-c223afdad6d4 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:51.220307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3592dd65-836b-4dd7-98bc-c223afdad6d4 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:51.221119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3592dd65-836b-4dd7-98bc-c223afdad6d4 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:51.229315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3592dd65-836b-4dd7-98bc-c223afdad6d4 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:51.230337 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3592dd65-836b-4dd7-98bc-c223afdad6d4 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:51.231214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3592dd65-836b-4dd7-98bc-c223afdad6d4 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:51.461206 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ac7e8f4f-ddb6-461a-bd0a-bbfafdb2171a tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:51.475180 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ac7e8f4f-ddb6-461a-bd0a-bbfafdb2171a tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c" status: 200 len: 1477 microversion: 2.1 time: 1.305805 Oct 29 02:46:51.491040 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 225/455] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:50 2022] GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c => generated 1477 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:51.504230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bff6af46-08a4-4468-bc4a-7bf2a217ca76 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:51.505938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bff6af46-08a4-4468-bc4a-7bf2a217ca76 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 7bfceda7-a17c-40a9-afcc-767b96d5ac7b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:51.517888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bff6af46-08a4-4468-bc4a-7bf2a217ca76 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:51.518700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bff6af46-08a4-4468-bc4a-7bf2a217ca76 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:51.519339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bff6af46-08a4-4468-bc4a-7bf2a217ca76 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:51.520664 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bff6af46-08a4-4468-bc4a-7bf2a217ca76 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:51.521590 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bff6af46-08a4-4468-bc4a-7bf2a217ca76 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:51.522277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bff6af46-08a4-4468-bc4a-7bf2a217ca76 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:51.572586 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3592dd65-836b-4dd7-98bc-c223afdad6d4 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:51.586950 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3592dd65-836b-4dd7-98bc-c223afdad6d4 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:51.599895 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3592dd65-836b-4dd7-98bc-c223afdad6d4 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:51.602054 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3592dd65-836b-4dd7-98bc-c223afdad6d4 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 1332 microversion: 2.25 time: 0.407358 Oct 29 02:46:51.603666 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 231/456] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:51 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 1332 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:51.610631 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-21120060-8b79-4231-8a3f-5ad8fdf1410d tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:51.611762 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-21120060-8b79-4231-8a3f-5ad8fdf1410d tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:51.620812 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-21120060-8b79-4231-8a3f-5ad8fdf1410d tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:51.621561 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-21120060-8b79-4231-8a3f-5ad8fdf1410d tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:51.622244 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-21120060-8b79-4231-8a3f-5ad8fdf1410d tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:51.623205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-21120060-8b79-4231-8a3f-5ad8fdf1410d tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:51.623855 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-21120060-8b79-4231-8a3f-5ad8fdf1410d tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:51.624539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-21120060-8b79-4231-8a3f-5ad8fdf1410d tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:51.797694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-21120060-8b79-4231-8a3f-5ad8fdf1410d tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:51.819191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:51.825774 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-21120060-8b79-4231-8a3f-5ad8fdf1410d tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:51.826726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-21120060-8b79-4231-8a3f-5ad8fdf1410d tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:51.843996 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-21120060-8b79-4231-8a3f-5ad8fdf1410d tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1447 microversion: 2.75 time: 0.234961 Oct 29 02:46:51.846758 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 232/457] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:51 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1447 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:51.868598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-81b36adf-9c3f-4846-ba5a-088c3cca06e7 req-e6c08afd-d2e7-429b-b512-26b64f847d1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c325f03-e675-4cd8-928e-a09523951d3d", "name": "network-vif-plugged", "status": "completed", "tag": "d7415e85-b26b-458a-89a7-2771cf318df7"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:51.892926 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-81b36adf-9c3f-4846-ba5a-088c3cca06e7 req-e6c08afd-d2e7-429b-b512-26b64f847d1b service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:51.894890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-81b36adf-9c3f-4846-ba5a-088c3cca06e7 req-e6c08afd-d2e7-429b-b512-26b64f847d1b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:51.895575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-81b36adf-9c3f-4846-ba5a-088c3cca06e7 req-e6c08afd-d2e7-429b-b512-26b64f847d1b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:51.915356 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-81b36adf-9c3f-4846-ba5a-088c3cca06e7 req-e6c08afd-d2e7-429b-b512-26b64f847d1b service nova] Creating event network-vif-plugged:d7415e85-b26b-458a-89a7-2771cf318df7 for instance 6c325f03-e675-4cd8-928e-a09523951d3d on n-h2-862967-2 Oct 29 02:46:51.925539 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-81b36adf-9c3f-4846-ba5a-088c3cca06e7 req-e6c08afd-d2e7-429b-b512-26b64f847d1b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076813 Oct 29 02:46:51.927319 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 233/458] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:51.937511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7517836b-da27-4875-bfcc-662ab9deced2 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:51.939495 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7517836b-da27-4875-bfcc-662ab9deced2 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: d6f7b0a6-5397-4688-b938-15d013e11ad5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:51.950740 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7517836b-da27-4875-bfcc-662ab9deced2 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:51.952745 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7517836b-da27-4875-bfcc-662ab9deced2 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:51.953437 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7517836b-da27-4875-bfcc-662ab9deced2 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:51.954544 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7517836b-da27-4875-bfcc-662ab9deced2 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:51.955369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7517836b-da27-4875-bfcc-662ab9deced2 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:51.957039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7517836b-da27-4875-bfcc-662ab9deced2 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:52.198996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7517836b-da27-4875-bfcc-662ab9deced2 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:52.214883 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7517836b-da27-4875-bfcc-662ab9deced2 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5" status: 200 len: 1271 microversion: 2.1 time: 0.284693 Oct 29 02:46:52.217648 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bff6af46-08a4-4468-bc4a-7bf2a217ca76 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:52.226669 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bff6af46-08a4-4468-bc4a-7bf2a217ca76 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b" status: 200 len: 1318 microversion: 2.1 time: 0.734400 Oct 29 02:46:52.238637 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 234/459] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:51 2022] GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5 => generated 1271 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:52.245166 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 226/460] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:51 2022] GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b => generated 1318 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:52.504739 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7540debd-65e6-4644-afe8-1153d5cc77dc tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:52.507191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7540debd-65e6-4644-afe8-1153d5cc77dc tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: c4180915-07c1-4365-976f-3b32fef4fc7c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:52.530349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7540debd-65e6-4644-afe8-1153d5cc77dc tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:52.531152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7540debd-65e6-4644-afe8-1153d5cc77dc tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:52.531850 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7540debd-65e6-4644-afe8-1153d5cc77dc tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:52.532995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7540debd-65e6-4644-afe8-1153d5cc77dc tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:52.533703 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7540debd-65e6-4644-afe8-1153d5cc77dc tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:52.534384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7540debd-65e6-4644-afe8-1153d5cc77dc tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:52.636497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e6e5ebc6-6fb2-4365-a117-6362972a9fd1 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:52.637738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e6e5ebc6-6fb2-4365-a117-6362972a9fd1 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:52.648328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6e5ebc6-6fb2-4365-a117-6362972a9fd1 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:52.650968 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6e5ebc6-6fb2-4365-a117-6362972a9fd1 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:52.651442 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6e5ebc6-6fb2-4365-a117-6362972a9fd1 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:52.653951 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6e5ebc6-6fb2-4365-a117-6362972a9fd1 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:52.654462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6e5ebc6-6fb2-4365-a117-6362972a9fd1 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:52.654903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6e5ebc6-6fb2-4365-a117-6362972a9fd1 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:53.069292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e6e5ebc6-6fb2-4365-a117-6362972a9fd1 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:53.075986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:53.082731 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e6e5ebc6-6fb2-4365-a117-6362972a9fd1 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:53.084663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e6e5ebc6-6fb2-4365-a117-6362972a9fd1 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:53.086226 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e6e5ebc6-6fb2-4365-a117-6362972a9fd1 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 1320 microversion: 2.25 time: 0.456196 Oct 29 02:46:53.087378 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 227/461] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:52 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 1320 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:46:53.093295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-97ddb71b-d140-4f5d-bf0b-8415ee0e9439 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:53.094205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-97ddb71b-d140-4f5d-bf0b-8415ee0e9439 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:53.104514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-97ddb71b-d140-4f5d-bf0b-8415ee0e9439 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:53.107153 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-97ddb71b-d140-4f5d-bf0b-8415ee0e9439 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:53.109022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-97ddb71b-d140-4f5d-bf0b-8415ee0e9439 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:53.110964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-97ddb71b-d140-4f5d-bf0b-8415ee0e9439 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:53.111879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-97ddb71b-d140-4f5d-bf0b-8415ee0e9439 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:53.113920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-97ddb71b-d140-4f5d-bf0b-8415ee0e9439 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:53.391024 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-97ddb71b-d140-4f5d-bf0b-8415ee0e9439 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:53.482697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7540debd-65e6-4644-afe8-1153d5cc77dc tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:53.490798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-97ddb71b-d140-4f5d-bf0b-8415ee0e9439 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:53.492899 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7540debd-65e6-4644-afe8-1153d5cc77dc tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c" status: 200 len: 1477 microversion: 2.1 time: 0.992315 Oct 29 02:46:53.493291 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-97ddb71b-d140-4f5d-bf0b-8415ee0e9439 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:53.501322 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 235/462] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:52 2022] GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c => generated 1477 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:53.511441 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-97ddb71b-d140-4f5d-bf0b-8415ee0e9439 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1447 microversion: 2.75 time: 0.416986 Oct 29 02:46:53.526184 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 228/463] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:53 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1447 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:53.537764 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9e0a1cd8-07e2-4163-80c6-8065972dace3 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:53.545497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9e0a1cd8-07e2-4163-80c6-8065972dace3 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: d6f7b0a6-5397-4688-b938-15d013e11ad5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:53.549179 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ae2cd399-9789-4c4e-84ae-664939242966 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:53.552069 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ae2cd399-9789-4c4e-84ae-664939242966 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 7bfceda7-a17c-40a9-afcc-767b96d5ac7b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:53.559104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e0a1cd8-07e2-4163-80c6-8065972dace3 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:53.559593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e0a1cd8-07e2-4163-80c6-8065972dace3 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:53.564171 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e0a1cd8-07e2-4163-80c6-8065972dace3 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:53.567193 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e0a1cd8-07e2-4163-80c6-8065972dace3 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:53.568321 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e0a1cd8-07e2-4163-80c6-8065972dace3 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:53.569286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae2cd399-9789-4c4e-84ae-664939242966 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:53.570209 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e0a1cd8-07e2-4163-80c6-8065972dace3 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:53.570985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae2cd399-9789-4c4e-84ae-664939242966 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:53.573121 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae2cd399-9789-4c4e-84ae-664939242966 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:53.574481 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae2cd399-9789-4c4e-84ae-664939242966 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:53.577261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae2cd399-9789-4c4e-84ae-664939242966 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:53.580398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae2cd399-9789-4c4e-84ae-664939242966 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:53.699431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9e0a1cd8-07e2-4163-80c6-8065972dace3 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:53.714995 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9e0a1cd8-07e2-4163-80c6-8065972dace3 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5" status: 200 len: 1277 microversion: 2.1 time: 0.207297 Oct 29 02:46:53.722499 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 236/464] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:53 2022] GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5 => generated 1277 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:54.124126 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-911eaa21-4498-4063-b62b-ee3b3bc6a476 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:54.124861 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-911eaa21-4498-4063-b62b-ee3b3bc6a476 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:54.138488 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-911eaa21-4498-4063-b62b-ee3b3bc6a476 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:54.138993 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-911eaa21-4498-4063-b62b-ee3b3bc6a476 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:54.139409 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-911eaa21-4498-4063-b62b-ee3b3bc6a476 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:54.143687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-911eaa21-4498-4063-b62b-ee3b3bc6a476 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:54.145026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-911eaa21-4498-4063-b62b-ee3b3bc6a476 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:54.148844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-911eaa21-4498-4063-b62b-ee3b3bc6a476 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:54.322847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-911eaa21-4498-4063-b62b-ee3b3bc6a476 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:54.359426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-911eaa21-4498-4063-b62b-ee3b3bc6a476 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:54.363347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-911eaa21-4498-4063-b62b-ee3b3bc6a476 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:54.367677 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-911eaa21-4498-4063-b62b-ee3b3bc6a476 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 1320 microversion: 2.25 time: 0.247350 Oct 29 02:46:54.369117 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 237/465] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:54 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 1320 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:46:54.470669 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-eb582b75-01d6-4d05-9e4b-56ee3a9d5c9c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1361366746", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "1bffd244-e23c-4a00-9a5f-56919f435fec"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:54.554865 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-eb582b75-01d6-4d05-9e4b-56ee3a9d5c9c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] validate_networks() for [('1bffd244-e23c-4a00-9a5f-56919f435fec', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:46:55.404216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ae2cd399-9789-4c4e-84ae-664939242966 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:55.446888 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ae2cd399-9789-4c4e-84ae-664939242966 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b" status: 200 len: 1318 microversion: 2.1 time: 1.903889 Oct 29 02:46:55.450623 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 229/466] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:53 2022] GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b => generated 1318 bytes in 1924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:55.480398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b4a4a0ce-509d-4e0a-8fc8-1ed181371328 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:55.481601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b4a4a0ce-509d-4e0a-8fc8-1ed181371328 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: c4180915-07c1-4365-976f-3b32fef4fc7c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:55.500222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4a4a0ce-509d-4e0a-8fc8-1ed181371328 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:55.504619 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4a4a0ce-509d-4e0a-8fc8-1ed181371328 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:55.505563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4a4a0ce-509d-4e0a-8fc8-1ed181371328 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:55.507232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4a4a0ce-509d-4e0a-8fc8-1ed181371328 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:55.508042 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4a4a0ce-509d-4e0a-8fc8-1ed181371328 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:55.509728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4a4a0ce-509d-4e0a-8fc8-1ed181371328 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:55.954075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b4a4a0ce-509d-4e0a-8fc8-1ed181371328 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6b28aab121f44d09e44615e410350c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '687ff1c168124c6aa2bae831ffa0ad47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:55.968812 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b4a4a0ce-509d-4e0a-8fc8-1ed181371328 tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c" status: 200 len: 1306 microversion: 2.1 time: 0.516316 Oct 29 02:46:55.977004 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 230/467] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:55 2022] GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c => generated 1306 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:55.994688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a74f7603-5662-43a0-88f0-e482909bf832 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:56.002261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a74f7603-5662-43a0-88f0-e482909bf832 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:56.018739 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a74f7603-5662-43a0-88f0-e482909bf832 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:56.024737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a74f7603-5662-43a0-88f0-e482909bf832 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:56.026898 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a74f7603-5662-43a0-88f0-e482909bf832 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:56.031867 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a74f7603-5662-43a0-88f0-e482909bf832 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:56.034853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a74f7603-5662-43a0-88f0-e482909bf832 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:56.039250 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a74f7603-5662-43a0-88f0-e482909bf832 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:56.357529 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a74f7603-5662-43a0-88f0-e482909bf832 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:56.374913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a74f7603-5662-43a0-88f0-e482909bf832 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:56.376911 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a74f7603-5662-43a0-88f0-e482909bf832 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:56.392683 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a74f7603-5662-43a0-88f0-e482909bf832 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1447 microversion: 2.75 time: 0.411293 Oct 29 02:46:56.393702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-eb582b75-01d6-4d05-9e4b-56ee3a9d5c9c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:46:56.394709 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-eb582b75-01d6-4d05-9e4b-56ee3a9d5c9c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:46:56.394968 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 231/468] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:55 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1447 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:56.395552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-eb582b75-01d6-4d05-9e4b-56ee3a9d5c9c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:46:56.396302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-eb582b75-01d6-4d05-9e4b-56ee3a9d5c9c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:46:56.397428 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-eb582b75-01d6-4d05-9e4b-56ee3a9d5c9c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:46:56.415478 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb582b75-01d6-4d05-9e4b-56ee3a9d5c9c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:56.416229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb582b75-01d6-4d05-9e4b-56ee3a9d5c9c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:56.420026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb582b75-01d6-4d05-9e4b-56ee3a9d5c9c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:56.428629 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb582b75-01d6-4d05-9e4b-56ee3a9d5c9c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:56.429719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb582b75-01d6-4d05-9e4b-56ee3a9d5c9c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:56.430352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb582b75-01d6-4d05-9e4b-56ee3a9d5c9c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:56.439319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-30b82ea0-400f-4529-a4f4-be953fbe876b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:56.440854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-30b82ea0-400f-4529-a4f4-be953fbe876b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: d6f7b0a6-5397-4688-b938-15d013e11ad5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:56.461424 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30b82ea0-400f-4529-a4f4-be953fbe876b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:56.467918 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30b82ea0-400f-4529-a4f4-be953fbe876b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:56.468843 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30b82ea0-400f-4529-a4f4-be953fbe876b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:56.473686 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30b82ea0-400f-4529-a4f4-be953fbe876b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:56.480362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30b82ea0-400f-4529-a4f4-be953fbe876b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:56.481114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30b82ea0-400f-4529-a4f4-be953fbe876b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:56.495686 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:56.534432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-eb582b75-01d6-4d05-9e4b-56ee3a9d5c9c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Getting quotas for project 94814dc564d04e688714ac064c7d1b3b. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:46:56.560661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-eb582b75-01d6-4d05-9e4b-56ee3a9d5c9c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Getting quotas for user 6862cd2470624f01a8bc1d371aa03962 and project 94814dc564d04e688714ac064c7d1b3b. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:46:56.617509 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-eb582b75-01d6-4d05-9e4b-56ee3a9d5c9c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:46:56.624019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-eb582b75-01d6-4d05-9e4b-56ee3a9d5c9c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:46:56.778723 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-eb582b75-01d6-4d05-9e4b-56ee3a9d5c9c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.408106 Oct 29 02:46:56.785530 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 238/469] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:46:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2411 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:46:56.789664 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-b176e482-884d-4284-97a4-64bb6811cfbb req-e3171083-0c57-43ac-a98f-b660d994a559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4180915-07c1-4365-976f-3b32fef4fc7c", "name": "network-vif-deleted", "tag": "9ca84854-6604-4318-97df-c5aa881aa09a"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:56.854940 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b176e482-884d-4284-97a4-64bb6811cfbb req-e3171083-0c57-43ac-a98f-b660d994a559 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:56.861403 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b176e482-884d-4284-97a4-64bb6811cfbb req-e3171083-0c57-43ac-a98f-b660d994a559 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:56.870330 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b176e482-884d-4284-97a4-64bb6811cfbb req-e3171083-0c57-43ac-a98f-b660d994a559 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:56.926632 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-b176e482-884d-4284-97a4-64bb6811cfbb req-e3171083-0c57-43ac-a98f-b660d994a559 service nova] Creating event network-vif-deleted:9ca84854-6604-4318-97df-c5aa881aa09a for instance c4180915-07c1-4365-976f-3b32fef4fc7c on n-h1-862967-2 Oct 29 02:46:56.947910 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-b176e482-884d-4284-97a4-64bb6811cfbb req-e3171083-0c57-43ac-a98f-b660d994a559 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165408 Oct 29 02:46:56.949302 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 239/470] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:56.956964 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-219edb18-a62f-4a90-a0a6-e2ad5a4b5cc2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:56.961501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-219edb18-a62f-4a90-a0a6-e2ad5a4b5cc2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:56.980285 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-219edb18-a62f-4a90-a0a6-e2ad5a4b5cc2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:56.985461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-219edb18-a62f-4a90-a0a6-e2ad5a4b5cc2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:56.986456 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-219edb18-a62f-4a90-a0a6-e2ad5a4b5cc2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:56.987597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-219edb18-a62f-4a90-a0a6-e2ad5a4b5cc2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:56.991674 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-219edb18-a62f-4a90-a0a6-e2ad5a4b5cc2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:56.994807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-219edb18-a62f-4a90-a0a6-e2ad5a4b5cc2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:57.790111 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-219edb18-a62f-4a90-a0a6-e2ad5a4b5cc2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:57.821468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-219edb18-a62f-4a90-a0a6-e2ad5a4b5cc2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:57.823814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-219edb18-a62f-4a90-a0a6-e2ad5a4b5cc2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:57.827096 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-219edb18-a62f-4a90-a0a6-e2ad5a4b5cc2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 1362 microversion: 2.25 time: 0.874774 Oct 29 02:46:57.853246 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 240/471] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:56 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 1362 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:57.861868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-a8549d0a-2d3c-46db-9839-409a25db043c req-4b04c4bf-e9ee-456c-8a7b-f1c4119559d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bfceda7-a17c-40a9-afcc-767b96d5ac7b", "name": "network-vif-plugged", "status": "completed", "tag": "99bb1159-a8fd-4f60-8e3d-a0322363f20d"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:57.909698 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a8549d0a-2d3c-46db-9839-409a25db043c req-4b04c4bf-e9ee-456c-8a7b-f1c4119559d9 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:57.913373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a8549d0a-2d3c-46db-9839-409a25db043c req-4b04c4bf-e9ee-456c-8a7b-f1c4119559d9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:57.914054 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a8549d0a-2d3c-46db-9839-409a25db043c req-4b04c4bf-e9ee-456c-8a7b-f1c4119559d9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:57.961957 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-a8549d0a-2d3c-46db-9839-409a25db043c req-4b04c4bf-e9ee-456c-8a7b-f1c4119559d9 service nova] Creating event network-vif-plugged:99bb1159-a8fd-4f60-8e3d-a0322363f20d for instance 7bfceda7-a17c-40a9-afcc-767b96d5ac7b on n-h2-862967-2 Oct 29 02:46:57.983107 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-a8549d0a-2d3c-46db-9839-409a25db043c req-4b04c4bf-e9ee-456c-8a7b-f1c4119559d9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124595 Oct 29 02:46:57.985289 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 241/472] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:58.010216 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5f6c79e3-3b0d-4d59-b9eb-60740bcb599a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:58.020611 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5f6c79e3-3b0d-4d59-b9eb-60740bcb599a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 7bfceda7-a17c-40a9-afcc-767b96d5ac7b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:58.044818 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f6c79e3-3b0d-4d59-b9eb-60740bcb599a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:58.045940 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f6c79e3-3b0d-4d59-b9eb-60740bcb599a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:58.051108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f6c79e3-3b0d-4d59-b9eb-60740bcb599a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:58.053704 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f6c79e3-3b0d-4d59-b9eb-60740bcb599a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:58.054382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f6c79e3-3b0d-4d59-b9eb-60740bcb599a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:58.054976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f6c79e3-3b0d-4d59-b9eb-60740bcb599a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:58.498465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-30b82ea0-400f-4529-a4f4-be953fbe876b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:58.519320 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-30b82ea0-400f-4529-a4f4-be953fbe876b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5" status: 200 len: 1319 microversion: 2.1 time: 2.108810 Oct 29 02:46:58.523692 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 232/473] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:56 2022] GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5 => generated 1319 bytes in 2128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:58.537733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-165ac1fb-750e-4513-ad2d-02731e914345 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:58.545688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-165ac1fb-750e-4513-ad2d-02731e914345 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:58.556728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:58.560802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-165ac1fb-750e-4513-ad2d-02731e914345 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:58.561544 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-165ac1fb-750e-4513-ad2d-02731e914345 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:58.562192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-165ac1fb-750e-4513-ad2d-02731e914345 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:58.563173 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-165ac1fb-750e-4513-ad2d-02731e914345 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:58.563797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-165ac1fb-750e-4513-ad2d-02731e914345 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:58.564382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-165ac1fb-750e-4513-ad2d-02731e914345 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:58.640342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=14 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:58.871109 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5f6c79e3-3b0d-4d59-b9eb-60740bcb599a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:58.897866 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-165ac1fb-750e-4513-ad2d-02731e914345 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:58.904827 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5f6c79e3-3b0d-4d59-b9eb-60740bcb599a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b" status: 200 len: 1318 microversion: 2.1 time: 0.910271 Oct 29 02:46:58.908782 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 242/474] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:57 2022] GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b => generated 1318 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:58.925840 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-165ac1fb-750e-4513-ad2d-02731e914345 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 200 len: 1221 microversion: 2.1 time: 0.394547 Oct 29 02:46:58.927075 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 233/475] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:58 2022] GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 1221 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:46:58.934489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-735d1c9b-ead4-4236-b83c-ef8acd0498fb tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:58.937396 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3845106f-5a62-4f2b-b352-1f79345568ff tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:58.938186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-735d1c9b-ead4-4236-b83c-ef8acd0498fb tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:58.939543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3845106f-5a62-4f2b-b352-1f79345568ff tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] [instance: c4180915-07c1-4365-976f-3b32fef4fc7c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:58.950518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-735d1c9b-ead4-4236-b83c-ef8acd0498fb tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:58.953207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-735d1c9b-ead4-4236-b83c-ef8acd0498fb tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:58.953895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-735d1c9b-ead4-4236-b83c-ef8acd0498fb tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:58.960848 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-735d1c9b-ead4-4236-b83c-ef8acd0498fb tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:58.961736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-735d1c9b-ead4-4236-b83c-ef8acd0498fb tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:58.963006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-735d1c9b-ead4-4236-b83c-ef8acd0498fb tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:58.970187 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3845106f-5a62-4f2b-b352-1f79345568ff tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:58.971126 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3845106f-5a62-4f2b-b352-1f79345568ff tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:58.972712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3845106f-5a62-4f2b-b352-1f79345568ff tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:58.974970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3845106f-5a62-4f2b-b352-1f79345568ff tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:58.977524 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3845106f-5a62-4f2b-b352-1f79345568ff tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:58.982686 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3845106f-5a62-4f2b-b352-1f79345568ff tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:59.033250 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-3845106f-5a62-4f2b-b352-1f79345568ff tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] HTTP exception thrown: Instance c4180915-07c1-4365-976f-3b32fef4fc7c could not be found. Oct 29 02:46:59.044937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3845106f-5a62-4f2b-b352-1f79345568ff tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Request method failure captured: Oct 29 02:46:59.044937 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c HTTP/1.1 Oct 29 02:46:59.044937 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:46:59.044937 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:46:59.044937 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:46:59.044937 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:46:59.044937 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:46:59.044937 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:46:59.044937 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:46:59.044937 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:46:59.044937 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPZ0sd6i9OeboiijGp4CHofeJN-QO3pDGvnVi3Kn9t94fgJmUdj_itAgL2NRqGwzqZEtBYk2ACD3FCCVUbIclx7H0_Wmr7OekO2JZTG3_tRQnJvoF1hm7-NdSf7HrAggX3aDKJgGODE5QeTG35tylpUWiIRE3c7AzGeW3THO3YcTwI Oct 29 02:46:59.044937 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:46:59.044937 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:46:59.044937 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:46:59.044937 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:46:59.044937 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:46:59.044937 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:46:59.044937 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 687ff1c168124c6aa2bae831ffa0ad47 Oct 29 02:46:59.044937 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2049914252 Oct 29 02:46:59.044937 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:46:59.044937 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:46:59.046253 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/687ff1c168124c6aa2bae831ffa0ad47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/687ff1c168124c6aa2bae831ffa0ad47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_687ff1c168124c6aa2bae831ffa0ad47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/687ff1c168124c6aa2bae831ffa0ad47"}]}] Oct 29 02:46:59.046253 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2049914252 Oct 29 02:46:59.046253 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 687ff1c168124c6aa2bae831ffa0ad47 Oct 29 02:46:59.046253 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2049914252 Oct 29 02:46:59.046253 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersAdminNegativeTestJSON-2049914252-project Oct 29 02:46:59.046253 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:46:59.046253 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:46:59.046253 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: c6b28aab121f44d09e44615e410350c8 Oct 29 02:46:59.046253 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2049914252-project Oct 29 02:46:59.046253 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:46:59.046253 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance c4180915-07c1-4365-976f-3b32fef4fc7c could not be found. Oct 29 02:46:59.046253 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'c4180915-07c1-4365-976f-3b32fef4fc7c'} Oct 29 02:46:59.046922 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:46:59.046922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:59.046922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:46:59.046922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:46:59.046922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:46:59.046922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:46:59.046922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:46:59.046922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:46:59.046922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:46:59.046922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:46:59.046922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4180915-07c1-4365-976f-3b32fef4fc7c could not be found. Oct 29 02:46:59.046922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:59.046922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:59.046922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:59.046922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:59.046922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:59.046922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:59.046922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:46:59.046922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:46:59.046922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:46:59.048542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:46:59.048542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:46:59.048542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:46:59.048542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:46:59.048542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:46:59.048542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:46:59.048542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:46:59.048542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4180915-07c1-4365-976f-3b32fef4fc7c could not be found. Oct 29 02:46:59.048542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:59.048542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:46:59.048542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:59.048542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:46:59.048542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:46:59.048542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:46:59.048542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:46:59.048542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:46:59.048542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4180915-07c1-4365-976f-3b32fef4fc7c could not be found. Oct 29 02:46:59.048542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:46:59.049568 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3845106f-5a62-4f2b-b352-1f79345568ff tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] Returning 404 to user: Instance c4180915-07c1-4365-976f-3b32fef4fc7c could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:46:59.049568 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3845106f-5a62-4f2b-b352-1f79345568ff tempest-ServersAdminNegativeTestJSON-2049914252 tempest-ServersAdminNegativeTestJSON-2049914252-project] 10.222.0.46 "GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c" status: 404 len: 111 microversion: 2.1 time: 0.135227 Oct 29 02:46:59.053670 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 243/476] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:58 2022] GET /compute/v2.1/servers/c4180915-07c1-4365-976f-3b32fef4fc7c => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:46:59.087875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-3515d2ad-1813-4386-86df-439ba9ca1c58 req-dfba9baa-48ca-485b-8740-51e47739e5f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6f7b0a6-5397-4688-b938-15d013e11ad5", "tag": "2fc9c9aa-b3b6-4946-a801-fbe2d963340c"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:46:59.111638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3515d2ad-1813-4386-86df-439ba9ca1c58 req-dfba9baa-48ca-485b-8740-51e47739e5f5 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:59.117838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3515d2ad-1813-4386-86df-439ba9ca1c58 req-dfba9baa-48ca-485b-8740-51e47739e5f5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:59.118928 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3515d2ad-1813-4386-86df-439ba9ca1c58 req-dfba9baa-48ca-485b-8740-51e47739e5f5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:59.142047 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-3515d2ad-1813-4386-86df-439ba9ca1c58 req-dfba9baa-48ca-485b-8740-51e47739e5f5 service nova] Creating event network-changed:2fc9c9aa-b3b6-4946-a801-fbe2d963340c for instance d6f7b0a6-5397-4688-b938-15d013e11ad5 on n-h2-862967-2 Oct 29 02:46:59.162771 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-3515d2ad-1813-4386-86df-439ba9ca1c58 req-dfba9baa-48ca-485b-8740-51e47739e5f5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104932 Oct 29 02:46:59.163622 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 244/477] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:46:59.174523 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a546ed7a-368e-4e87-bbf9-050f31b386cd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:59.177206 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a546ed7a-368e-4e87-bbf9-050f31b386cd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:59.193562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a546ed7a-368e-4e87-bbf9-050f31b386cd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:59.194384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a546ed7a-368e-4e87-bbf9-050f31b386cd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:59.195338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a546ed7a-368e-4e87-bbf9-050f31b386cd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:59.196641 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a546ed7a-368e-4e87-bbf9-050f31b386cd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:59.197389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a546ed7a-368e-4e87-bbf9-050f31b386cd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:59.214792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a546ed7a-368e-4e87-bbf9-050f31b386cd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:59.587169 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a546ed7a-368e-4e87-bbf9-050f31b386cd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:59.604276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a546ed7a-368e-4e87-bbf9-050f31b386cd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:59.609286 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a546ed7a-368e-4e87-bbf9-050f31b386cd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:59.610931 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a546ed7a-368e-4e87-bbf9-050f31b386cd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 1362 microversion: 2.25 time: 0.445688 Oct 29 02:46:59.630320 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 245/478] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:59 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 1362 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:59.636940 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-aa915be4-cd66-423d-9ecf-1ea0009fcbda tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:59.637753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-aa915be4-cd66-423d-9ecf-1ea0009fcbda tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: d6f7b0a6-5397-4688-b938-15d013e11ad5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:59.649427 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-735d1c9b-ead4-4236-b83c-ef8acd0498fb tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:59.667608 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa915be4-cd66-423d-9ecf-1ea0009fcbda tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:59.668355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa915be4-cd66-423d-9ecf-1ea0009fcbda tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:59.672291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa915be4-cd66-423d-9ecf-1ea0009fcbda tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:59.676484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa915be4-cd66-423d-9ecf-1ea0009fcbda tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:59.678350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-735d1c9b-ead4-4236-b83c-ef8acd0498fb tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:59.679456 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa915be4-cd66-423d-9ecf-1ea0009fcbda tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:59.680383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa915be4-cd66-423d-9ecf-1ea0009fcbda tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:59.680982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-735d1c9b-ead4-4236-b83c-ef8acd0498fb tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:46:59.705377 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-735d1c9b-ead4-4236-b83c-ef8acd0498fb tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1447 microversion: 2.75 time: 0.776533 Oct 29 02:46:59.709729 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 234/479] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:46:58 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1447 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:46:59.935568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b7ca463b-4c62-4092-a888-ff2fc2b3b9f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:46:59.936473 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b7ca463b-4c62-4092-a888-ff2fc2b3b9f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 7bfceda7-a17c-40a9-afcc-767b96d5ac7b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:46:59.955604 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7ca463b-4c62-4092-a888-ff2fc2b3b9f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:59.956842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7ca463b-4c62-4092-a888-ff2fc2b3b9f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:59.957593 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7ca463b-4c62-4092-a888-ff2fc2b3b9f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:46:59.958767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7ca463b-4c62-4092-a888-ff2fc2b3b9f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:46:59.959576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7ca463b-4c62-4092-a888-ff2fc2b3b9f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:46:59.960828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7ca463b-4c62-4092-a888-ff2fc2b3b9f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:00.278733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-aa915be4-cd66-423d-9ecf-1ea0009fcbda tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:00.294593 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-aa915be4-cd66-423d-9ecf-1ea0009fcbda tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5" status: 200 len: 1319 microversion: 2.1 time: 0.662885 Oct 29 02:47:00.295217 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 246/480] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:59 2022] GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5 => generated 1319 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:00.312703 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9cef3ddc-b752-4366-bd3e-2bed703e8068 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:00.313340 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9cef3ddc-b752-4366-bd3e-2bed703e8068 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:00.319887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cef3ddc-b752-4366-bd3e-2bed703e8068 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:00.320389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cef3ddc-b752-4366-bd3e-2bed703e8068 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:00.336887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cef3ddc-b752-4366-bd3e-2bed703e8068 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:00.337732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cef3ddc-b752-4366-bd3e-2bed703e8068 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:00.348980 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cef3ddc-b752-4366-bd3e-2bed703e8068 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:00.349747 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cef3ddc-b752-4366-bd3e-2bed703e8068 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:00.521602 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9cef3ddc-b752-4366-bd3e-2bed703e8068 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:00.530945 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9cef3ddc-b752-4366-bd3e-2bed703e8068 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 200 len: 1283 microversion: 2.1 time: 0.234644 Oct 29 02:47:00.537933 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 247/481] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:00 2022] GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 1283 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:00.643620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c637c525-b6c0-41ae-94b7-6c790251518c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:00.644690 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c637c525-b6c0-41ae-94b7-6c790251518c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:00.657423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c637c525-b6c0-41ae-94b7-6c790251518c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:00.659671 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c637c525-b6c0-41ae-94b7-6c790251518c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:00.660191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c637c525-b6c0-41ae-94b7-6c790251518c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:00.661006 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c637c525-b6c0-41ae-94b7-6c790251518c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:00.662207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c637c525-b6c0-41ae-94b7-6c790251518c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:00.664481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c637c525-b6c0-41ae-94b7-6c790251518c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:00.938928 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c637c525-b6c0-41ae-94b7-6c790251518c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:00.948278 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c637c525-b6c0-41ae-94b7-6c790251518c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:00.950714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c637c525-b6c0-41ae-94b7-6c790251518c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:00.952337 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c637c525-b6c0-41ae-94b7-6c790251518c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 1362 microversion: 2.25 time: 0.313780 Oct 29 02:47:00.953131 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 248/482] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:00 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 1362 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:47:00.958585 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-82048862-8ea8-4817-bebe-9fbfe94bc647 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:00.959523 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-82048862-8ea8-4817-bebe-9fbfe94bc647 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:00.965909 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-82048862-8ea8-4817-bebe-9fbfe94bc647 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:00.966574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-82048862-8ea8-4817-bebe-9fbfe94bc647 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:00.967171 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-82048862-8ea8-4817-bebe-9fbfe94bc647 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:00.968053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-82048862-8ea8-4817-bebe-9fbfe94bc647 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:00.968777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-82048862-8ea8-4817-bebe-9fbfe94bc647 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:00.969346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-82048862-8ea8-4817-bebe-9fbfe94bc647 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:01.063158 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-82048862-8ea8-4817-bebe-9fbfe94bc647 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:01.073890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-82048862-8ea8-4817-bebe-9fbfe94bc647 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:01.078812 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-82048862-8ea8-4817-bebe-9fbfe94bc647 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:01.090344 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-82048862-8ea8-4817-bebe-9fbfe94bc647 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1447 microversion: 2.75 time: 0.135611 Oct 29 02:47:01.101042 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 249/483] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:00 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1447 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:01.108621 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b7ca463b-4c62-4092-a888-ff2fc2b3b9f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:01.119800 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b7ca463b-4c62-4092-a888-ff2fc2b3b9f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b" status: 200 len: 1318 microversion: 2.1 time: 1.191399 Oct 29 02:47:01.120756 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 235/484] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:46:59 2022] GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b => generated 1318 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:47:01.321979 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4dc64626-d809-427a-9e4a-515bd7635d84 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:01.328092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4dc64626-d809-427a-9e4a-515bd7635d84 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: d6f7b0a6-5397-4688-b938-15d013e11ad5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:01.338309 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4dc64626-d809-427a-9e4a-515bd7635d84 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:01.339150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4dc64626-d809-427a-9e4a-515bd7635d84 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:01.339788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4dc64626-d809-427a-9e4a-515bd7635d84 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:01.340839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4dc64626-d809-427a-9e4a-515bd7635d84 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:01.341471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4dc64626-d809-427a-9e4a-515bd7635d84 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:01.342065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4dc64626-d809-427a-9e4a-515bd7635d84 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:01.559934 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a515c820-18a5-43cf-9a36-f9c26786b313 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:01.560894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a515c820-18a5-43cf-9a36-f9c26786b313 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:01.567752 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a515c820-18a5-43cf-9a36-f9c26786b313 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:01.568662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a515c820-18a5-43cf-9a36-f9c26786b313 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:01.569298 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a515c820-18a5-43cf-9a36-f9c26786b313 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:01.570374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a515c820-18a5-43cf-9a36-f9c26786b313 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:01.571065 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a515c820-18a5-43cf-9a36-f9c26786b313 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:01.571734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a515c820-18a5-43cf-9a36-f9c26786b313 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:01.722344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a515c820-18a5-43cf-9a36-f9c26786b313 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:01.734743 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a515c820-18a5-43cf-9a36-f9c26786b313 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 200 len: 1283 microversion: 2.1 time: 0.178695 Oct 29 02:47:01.737254 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 236/485] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:01 2022] GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 1283 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:47:01.980336 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b3aa01bd-4a4f-484d-ab0d-f446653005e9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:01.981414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b3aa01bd-4a4f-484d-ab0d-f446653005e9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:01.993871 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3aa01bd-4a4f-484d-ab0d-f446653005e9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:01.996543 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3aa01bd-4a4f-484d-ab0d-f446653005e9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:01.998405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3aa01bd-4a4f-484d-ab0d-f446653005e9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:02.000389 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3aa01bd-4a4f-484d-ab0d-f446653005e9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:02.002305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3aa01bd-4a4f-484d-ab0d-f446653005e9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:02.003800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3aa01bd-4a4f-484d-ab0d-f446653005e9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:02.051132 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4dc64626-d809-427a-9e4a-515bd7635d84 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:02.069613 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4dc64626-d809-427a-9e4a-515bd7635d84 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5" status: 200 len: 1319 microversion: 2.1 time: 0.751801 Oct 29 02:47:02.082666 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 250/486] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:01 2022] GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5 => generated 1319 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:02.119545 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-407eaf85-5079-4b83-8bb5-db842df59ae8 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:02.120615 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-407eaf85-5079-4b83-8bb5-db842df59ae8 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:02.128432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-407eaf85-5079-4b83-8bb5-db842df59ae8 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:02.130571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-407eaf85-5079-4b83-8bb5-db842df59ae8 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:02.131839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-407eaf85-5079-4b83-8bb5-db842df59ae8 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:02.133523 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-407eaf85-5079-4b83-8bb5-db842df59ae8 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:02.134200 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-407eaf85-5079-4b83-8bb5-db842df59ae8 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:02.134824 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-407eaf85-5079-4b83-8bb5-db842df59ae8 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:02.278954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-407eaf85-5079-4b83-8bb5-db842df59ae8 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:02.298319 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-407eaf85-5079-4b83-8bb5-db842df59ae8 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:02.300777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-407eaf85-5079-4b83-8bb5-db842df59ae8 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:02.306596 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-407eaf85-5079-4b83-8bb5-db842df59ae8 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1447 microversion: 2.75 time: 0.191072 Oct 29 02:47:02.307184 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 251/487] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:02 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1447 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:47:02.319217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ce1b1965-c8e4-44a5-ae6b-3544ba1e9da8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:02.320826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ce1b1965-c8e4-44a5-ae6b-3544ba1e9da8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 7bfceda7-a17c-40a9-afcc-767b96d5ac7b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:02.338804 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce1b1965-c8e4-44a5-ae6b-3544ba1e9da8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:02.340939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce1b1965-c8e4-44a5-ae6b-3544ba1e9da8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:02.341546 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce1b1965-c8e4-44a5-ae6b-3544ba1e9da8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:02.342423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce1b1965-c8e4-44a5-ae6b-3544ba1e9da8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:02.343070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce1b1965-c8e4-44a5-ae6b-3544ba1e9da8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:02.346448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce1b1965-c8e4-44a5-ae6b-3544ba1e9da8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:02.894906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b3aa01bd-4a4f-484d-ab0d-f446653005e9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:02.937904 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b3aa01bd-4a4f-484d-ab0d-f446653005e9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:02.951862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b3aa01bd-4a4f-484d-ab0d-f446653005e9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:02.955570 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b3aa01bd-4a4f-484d-ab0d-f446653005e9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 1362 microversion: 2.25 time: 0.982138 Oct 29 02:47:02.969484 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 237/488] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:01 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 1362 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:03.001446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6a9594d0-71c0-4d11-b180-33ae8a2463db tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:03.002852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6a9594d0-71c0-4d11-b180-33ae8a2463db tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:03.013572 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a9594d0-71c0-4d11-b180-33ae8a2463db tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:03.015132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a9594d0-71c0-4d11-b180-33ae8a2463db tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:03.016445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a9594d0-71c0-4d11-b180-33ae8a2463db tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:03.018226 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a9594d0-71c0-4d11-b180-33ae8a2463db tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:03.019516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a9594d0-71c0-4d11-b180-33ae8a2463db tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:03.020606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a9594d0-71c0-4d11-b180-33ae8a2463db tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:03.041041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ce1b1965-c8e4-44a5-ae6b-3544ba1e9da8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:03.065610 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ce1b1965-c8e4-44a5-ae6b-3544ba1e9da8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b" status: 200 len: 1468 microversion: 2.1 time: 0.755250 Oct 29 02:47:03.066652 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 252/489] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:02 2022] GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b => generated 1468 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:03.078601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-d22b9bb5-b109-4358-87db-5e8fb166f94a req-ac5873f9-9337-4a91-ab67-3ebf71a5e65e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a0ec4a8-4cf9-4596-bc31-797c86447aa0", "tag": "69a0c6be-941f-492e-8d52-cd37b1ae25aa"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:03.109988 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d22b9bb5-b109-4358-87db-5e8fb166f94a req-ac5873f9-9337-4a91-ab67-3ebf71a5e65e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:03.110721 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d22b9bb5-b109-4358-87db-5e8fb166f94a req-ac5873f9-9337-4a91-ab67-3ebf71a5e65e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:03.112103 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d22b9bb5-b109-4358-87db-5e8fb166f94a req-ac5873f9-9337-4a91-ab67-3ebf71a5e65e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:03.127855 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-d22b9bb5-b109-4358-87db-5e8fb166f94a req-ac5873f9-9337-4a91-ab67-3ebf71a5e65e service nova] Creating event network-changed:69a0c6be-941f-492e-8d52-cd37b1ae25aa for instance 0a0ec4a8-4cf9-4596-bc31-797c86447aa0 on n-h2-862967-2 Oct 29 02:47:03.135635 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-d22b9bb5-b109-4358-87db-5e8fb166f94a req-ac5873f9-9337-4a91-ab67-3ebf71a5e65e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066160 Oct 29 02:47:03.136949 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 253/490] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:03.144141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ab1f51d7-a5f6-415d-84d7-f9e53e6e9e76 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:03.145161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ab1f51d7-a5f6-415d-84d7-f9e53e6e9e76 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 6c325f03-e675-4cd8-928e-a09523951d3d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:03.153098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab1f51d7-a5f6-415d-84d7-f9e53e6e9e76 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:03.153973 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab1f51d7-a5f6-415d-84d7-f9e53e6e9e76 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:03.154561 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab1f51d7-a5f6-415d-84d7-f9e53e6e9e76 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:03.155417 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab1f51d7-a5f6-415d-84d7-f9e53e6e9e76 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:03.156012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab1f51d7-a5f6-415d-84d7-f9e53e6e9e76 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:03.156711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab1f51d7-a5f6-415d-84d7-f9e53e6e9e76 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:03.162077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:03.173303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6a9594d0-71c0-4d11-b180-33ae8a2463db tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:03.187496 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6a9594d0-71c0-4d11-b180-33ae8a2463db tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 200 len: 1283 microversion: 2.1 time: 0.214673 Oct 29 02:47:03.188121 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 238/491] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:02 2022] GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 1283 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:03.198990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fe094a66-62c0-4aeb-be1a-2f3c6f8efe0b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:03.208280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fe094a66-62c0-4aeb-be1a-2f3c6f8efe0b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: d6f7b0a6-5397-4688-b938-15d013e11ad5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:03.222667 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fe094a66-62c0-4aeb-be1a-2f3c6f8efe0b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:03.223703 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fe094a66-62c0-4aeb-be1a-2f3c6f8efe0b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:03.224432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fe094a66-62c0-4aeb-be1a-2f3c6f8efe0b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:03.225323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fe094a66-62c0-4aeb-be1a-2f3c6f8efe0b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:03.225955 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fe094a66-62c0-4aeb-be1a-2f3c6f8efe0b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:03.226525 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fe094a66-62c0-4aeb-be1a-2f3c6f8efe0b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:03.454028 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ab1f51d7-a5f6-415d-84d7-f9e53e6e9e76 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:03.469996 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ab1f51d7-a5f6-415d-84d7-f9e53e6e9e76 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/6c325f03-e675-4cd8-928e-a09523951d3d" status: 200 len: 1468 microversion: 2.1 time: 0.330797 Oct 29 02:47:03.471663 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 254/492] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:03 2022] GET /compute/v2.1/servers/6c325f03-e675-4cd8-928e-a09523951d3d => generated 1468 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:03.483099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-082e9e64-0be3-4da3-a369-b8c6445bd56b tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:03.484750 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-082e9e64-0be3-4da3-a369-b8c6445bd56b tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:03.501353 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-082e9e64-0be3-4da3-a369-b8c6445bd56b tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:03.503717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-082e9e64-0be3-4da3-a369-b8c6445bd56b tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:03.504177 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-082e9e64-0be3-4da3-a369-b8c6445bd56b tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:03.504955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-082e9e64-0be3-4da3-a369-b8c6445bd56b tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:03.505455 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-082e9e64-0be3-4da3-a369-b8c6445bd56b tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:03.512998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-082e9e64-0be3-4da3-a369-b8c6445bd56b tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:04.182957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-082e9e64-0be3-4da3-a369-b8c6445bd56b tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:04.205176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-082e9e64-0be3-4da3-a369-b8c6445bd56b tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:04.214892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-082e9e64-0be3-4da3-a369-b8c6445bd56b tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:04.232876 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-082e9e64-0be3-4da3-a369-b8c6445bd56b tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1447 microversion: 2.75 time: 0.759589 Oct 29 02:47:04.242045 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 255/493] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:03 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1447 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:04.244598 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fe094a66-62c0-4aeb-be1a-2f3c6f8efe0b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:04.250126 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6bddd811-3dd7-4ce7-a251-f2632e72e41b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:04.264601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6bddd811-3dd7-4ce7-a251-f2632e72e41b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:04.271533 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6bddd811-3dd7-4ce7-a251-f2632e72e41b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Searching by: {'reservation_id': 'r-luou4wve', 'deleted': False, 'project_id': 'dcc6da8e69e041e19023a53a23e33393'} {{(pid=127125) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:47:04.286472 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fe094a66-62c0-4aeb-be1a-2f3c6f8efe0b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5" status: 200 len: 1319 microversion: 2.1 time: 1.089755 Oct 29 02:47:04.309066 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 239/494] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:03 2022] GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5 => generated 1319 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:04.318257 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a760850a-4079-4ca8-a0e4-a50c484efc2d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:04.319775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a760850a-4079-4ca8-a0e4-a50c484efc2d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:04.330322 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bddd811-3dd7-4ce7-a251-f2632e72e41b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:04.331201 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bddd811-3dd7-4ce7-a251-f2632e72e41b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:04.331911 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bddd811-3dd7-4ce7-a251-f2632e72e41b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:04.333344 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bddd811-3dd7-4ce7-a251-f2632e72e41b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:04.333479 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a760850a-4079-4ca8-a0e4-a50c484efc2d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:04.334221 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bddd811-3dd7-4ce7-a251-f2632e72e41b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:04.335565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a760850a-4079-4ca8-a0e4-a50c484efc2d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:04.337036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a760850a-4079-4ca8-a0e4-a50c484efc2d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:04.337963 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a760850a-4079-4ca8-a0e4-a50c484efc2d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:04.338813 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a760850a-4079-4ca8-a0e4-a50c484efc2d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:04.339806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a760850a-4079-4ca8-a0e4-a50c484efc2d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:04.353717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bddd811-3dd7-4ce7-a251-f2632e72e41b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:04.710851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.multi_cell_list [None req-6bddd811-3dd7-4ce7-a251-f2632e72e41b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 02:47:04.913705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6bddd811-3dd7-4ce7-a251-f2632e72e41b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:04.941220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bddd811-3dd7-4ce7-a251-f2632e72e41b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:04.941976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bddd811-3dd7-4ce7-a251-f2632e72e41b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:04.942599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bddd811-3dd7-4ce7-a251-f2632e72e41b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:04.951874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a760850a-4079-4ca8-a0e4-a50c484efc2d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:04.985013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a760850a-4079-4ca8-a0e4-a50c484efc2d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:04.988154 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a760850a-4079-4ca8-a0e4-a50c484efc2d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:04.989368 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a760850a-4079-4ca8-a0e4-a50c484efc2d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 1362 microversion: 2.25 time: 0.678173 Oct 29 02:47:04.989981 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 240/495] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:04 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 1362 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:05.013016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0a3614c0-8ab7-40c1-90e2-3705c868c44b tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:05.035154 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0a3614c0-8ab7-40c1-90e2-3705c868c44b tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:05.069058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0a3614c0-8ab7-40c1-90e2-3705c868c44b tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:05.082314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0a3614c0-8ab7-40c1-90e2-3705c868c44b tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:05.082981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0a3614c0-8ab7-40c1-90e2-3705c868c44b tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:05.084266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0a3614c0-8ab7-40c1-90e2-3705c868c44b tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:05.084818 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0a3614c0-8ab7-40c1-90e2-3705c868c44b tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:05.085262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0a3614c0-8ab7-40c1-90e2-3705c868c44b tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:05.441343 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6bddd811-3dd7-4ce7-a251-f2632e72e41b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/detail?reservation_id=r-luou4wve" status: 200 len: 2929 microversion: 2.1 time: 1.197443 Oct 29 02:47:05.443438 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 256/496] 10.222.0.46 () {58 vars in 1197 bytes} [Sat Oct 29 02:47:04 2022] GET /compute/v2.1/servers/detail?reservation_id=r-luou4wve => generated 2929 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:05.638517 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0a3614c0-8ab7-40c1-90e2-3705c868c44b tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:05.650979 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0a3614c0-8ab7-40c1-90e2-3705c868c44b tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 200 len: 1325 microversion: 2.1 time: 0.659887 Oct 29 02:47:05.653204 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 241/497] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:04 2022] GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 1325 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:05.669387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d0eb9b87-8a36-4173-8c50-d81ddbe211b3 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:05.670241 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d0eb9b87-8a36-4173-8c50-d81ddbe211b3 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:05.683322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0eb9b87-8a36-4173-8c50-d81ddbe211b3 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:05.688231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0eb9b87-8a36-4173-8c50-d81ddbe211b3 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:05.689062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0eb9b87-8a36-4173-8c50-d81ddbe211b3 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:05.691027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0eb9b87-8a36-4173-8c50-d81ddbe211b3 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:05.693763 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0eb9b87-8a36-4173-8c50-d81ddbe211b3 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:05.696074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0eb9b87-8a36-4173-8c50-d81ddbe211b3 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:05.815493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4ccad3b9-7c1f-45a5-aff4-13b4ba55a592 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:05.827893 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4ccad3b9-7c1f-45a5-aff4-13b4ba55a592 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.382731 Oct 29 02:47:05.829096 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 257/498] 10.222.0.46 () {58 vars in 1137 bytes} [Sat Oct 29 02:47:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:05.836256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f6e876be-7ef7-4859-8443-fbf97ed4e8c9 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:05.837406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f6e876be-7ef7-4859-8443-fbf97ed4e8c9 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: d6f7b0a6-5397-4688-b938-15d013e11ad5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:05.846320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6e876be-7ef7-4859-8443-fbf97ed4e8c9 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:05.847085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6e876be-7ef7-4859-8443-fbf97ed4e8c9 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:05.847753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6e876be-7ef7-4859-8443-fbf97ed4e8c9 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:05.849295 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6e876be-7ef7-4859-8443-fbf97ed4e8c9 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:05.850187 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6e876be-7ef7-4859-8443-fbf97ed4e8c9 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:05.850918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6e876be-7ef7-4859-8443-fbf97ed4e8c9 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:05.920235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d0eb9b87-8a36-4173-8c50-d81ddbe211b3 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:05.943927 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d0eb9b87-8a36-4173-8c50-d81ddbe211b3 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:05.949669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d0eb9b87-8a36-4173-8c50-d81ddbe211b3 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:05.957510 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d0eb9b87-8a36-4173-8c50-d81ddbe211b3 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1447 microversion: 2.75 time: 0.301681 Oct 29 02:47:05.958820 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 242/499] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:05 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1447 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:05.985105 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-44cd5e2c-c8a0-43aa-94d5-1ede7080c44f tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:06.035849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.compute.server_groups [None req-44cd5e2c-c8a0-43aa-94d5-1ede7080c44f tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Querying cell 5270c754-82e2-4d8e-a02e-4533aa854f76(cell1) for 2 instances {{(pid=127124) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 29 02:47:06.036908 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-44cd5e2c-c8a0-43aa-94d5-1ede7080c44f tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:06.038849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-44cd5e2c-c8a0-43aa-94d5-1ede7080c44f tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:06.044784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-44cd5e2c-c8a0-43aa-94d5-1ede7080c44f tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:06.137416 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-44cd5e2c-c8a0-43aa-94d5-1ede7080c44f tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups/de548a53-9d1f-4349-8654-a81238773ac6" status: 200 len: 265 microversion: 2.1 time: 0.177293 Oct 29 02:47:06.138026 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 243/500] 10.222.0.46 () {58 vars in 1263 bytes} [Sat Oct 29 02:47:05 2022] GET /compute/v2.1/os-server-groups/de548a53-9d1f-4349-8654-a81238773ac6 => generated 265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:06.147628 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f6e876be-7ef7-4859-8443-fbf97ed4e8c9 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:06.169445 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f6e876be-7ef7-4859-8443-fbf97ed4e8c9 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5" status: 200 len: 1319 microversion: 2.1 time: 0.330901 Oct 29 02:47:06.171671 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 258/501] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:05 2022] GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5 => generated 1319 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:06.266330 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cca19bad-7b54-4f73-8bba-9c8224b93e3e tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:06.270196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cca19bad-7b54-4f73-8bba-9c8224b93e3e tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:06.270696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cca19bad-7b54-4f73-8bba-9c8224b93e3e tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:06.271194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cca19bad-7b54-4f73-8bba-9c8224b93e3e tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:06.271938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cca19bad-7b54-4f73-8bba-9c8224b93e3e tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:06.272394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cca19bad-7b54-4f73-8bba-9c8224b93e3e tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:06.282814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cca19bad-7b54-4f73-8bba-9c8224b93e3e tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:06.378054 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cca19bad-7b54-4f73-8bba-9c8224b93e3e tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.226687 Oct 29 02:47:06.387018 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 244/502] 10.222.0.46 () {58 vars in 1137 bytes} [Sat Oct 29 02:47:06 2022] GET /compute/v2.1/os-services => generated 944 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:06.392632 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a6b45910-8850-4505-908d-92863a5051c2 tempest-ServersWithSpecificFlavorTestJSON-1817225689 tempest-ServersWithSpecificFlavorTestJSON-1817225689-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1192735212", "id": 1100006644, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:06.394555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8779d648-457e-40c2-bf97-a429d6c14c0d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:06.408613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8779d648-457e-40c2-bf97-a429d6c14c0d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:06.411174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:06.427230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8779d648-457e-40c2-bf97-a429d6c14c0d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:06.434146 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a6b45910-8850-4505-908d-92863a5051c2 tempest-ServersWithSpecificFlavorTestJSON-1817225689 tempest-ServersWithSpecificFlavorTestJSON-1817225689-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.260885 Oct 29 02:47:06.435210 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8779d648-457e-40c2-bf97-a429d6c14c0d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:06.435868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8779d648-457e-40c2-bf97-a429d6c14c0d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:06.436939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8779d648-457e-40c2-bf97-a429d6c14c0d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:06.437590 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8779d648-457e-40c2-bf97-a429d6c14c0d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:06.438779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8779d648-457e-40c2-bf97-a429d6c14c0d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:06.443404 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 259/503] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:47:06 2022] POST /compute/v2.1/flavors => generated 425 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:06.479077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dbaddff6-aef7-4fb0-9239-2cf6ab455df5 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:06.480092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dbaddff6-aef7-4fb0-9239-2cf6ab455df5 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] [instance: 7bfceda7-a17c-40a9-afcc-767b96d5ac7b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:06.494294 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbaddff6-aef7-4fb0-9239-2cf6ab455df5 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:06.495298 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbaddff6-aef7-4fb0-9239-2cf6ab455df5 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:06.496005 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbaddff6-aef7-4fb0-9239-2cf6ab455df5 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:06.499434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbaddff6-aef7-4fb0-9239-2cf6ab455df5 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:06.499913 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbaddff6-aef7-4fb0-9239-2cf6ab455df5 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:06.500485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbaddff6-aef7-4fb0-9239-2cf6ab455df5 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:06.517446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=100 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:06.801428 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dbaddff6-aef7-4fb0-9239-2cf6ab455df5 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b" status: 200 len: 1619 microversion: 2.1 time: 0.356878 Oct 29 02:47:06.818347 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 260/504] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:06 2022] GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b => generated 1619 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:06.830082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-963d5976-e110-4415-9f86-848f9f7ef6b8 tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:06.834205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-963d5976-e110-4415-9f86-848f9f7ef6b8 tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:06.834762 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-963d5976-e110-4415-9f86-848f9f7ef6b8 tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:06.835214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-963d5976-e110-4415-9f86-848f9f7ef6b8 tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:06.835971 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-963d5976-e110-4415-9f86-848f9f7ef6b8 tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:06.836418 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-963d5976-e110-4415-9f86-848f9f7ef6b8 tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:06.837565 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-963d5976-e110-4415-9f86-848f9f7ef6b8 tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:06.871531 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-963d5976-e110-4415-9f86-848f9f7ef6b8 tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?host=n-d-862967-2" status: 200 len: 578 microversion: 2.1 time: 0.051593 Oct 29 02:47:06.872928 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 261/505] 10.222.0.46 () {58 vars in 1172 bytes} [Sat Oct 29 02:47:06 2022] GET /compute/v2.1/os-services?host=n-d-862967-2 => generated 578 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:06.884128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-cabfa36c-3bf4-403b-9a5c-34916f0f7406 req-124cdea9-f3a2-4334-a3b2-7430f4cd8fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1cfd9d1-24b9-4d99-851e-609ece042e43", "tag": "b6508838-de98-4696-9b82-10686564ee22"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:06.918835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-cabfa36c-3bf4-403b-9a5c-34916f0f7406 req-124cdea9-f3a2-4334-a3b2-7430f4cd8fc9 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:06.921918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-cabfa36c-3bf4-403b-9a5c-34916f0f7406 req-124cdea9-f3a2-4334-a3b2-7430f4cd8fc9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:06.923074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-cabfa36c-3bf4-403b-9a5c-34916f0f7406 req-124cdea9-f3a2-4334-a3b2-7430f4cd8fc9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:06.952150 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-cabfa36c-3bf4-403b-9a5c-34916f0f7406 req-124cdea9-f3a2-4334-a3b2-7430f4cd8fc9 service nova] Creating event network-changed:b6508838-de98-4696-9b82-10686564ee22 for instance a1cfd9d1-24b9-4d99-851e-609ece042e43 on n-h1-862967-2 Oct 29 02:47:06.960962 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-cabfa36c-3bf4-403b-9a5c-34916f0f7406 req-124cdea9-f3a2-4334-a3b2-7430f4cd8fc9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086427 Oct 29 02:47:06.962366 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 262/506] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:06.968321 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c0585c85-839f-4f8e-9232-1cedb3bb04b3 tempest-ServersWithSpecificFlavorTestJSON-1817225689 tempest-ServersWithSpecificFlavorTestJSON-1817225689-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:06.984115 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c0585c85-839f-4f8e-9232-1cedb3bb04b3 tempest-ServersWithSpecificFlavorTestJSON-1817225689 tempest-ServersWithSpecificFlavorTestJSON-1817225689-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.020399 Oct 29 02:47:06.989593 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 263/507] 10.222.0.46 () {58 vars in 1182 bytes} [Sat Oct 29 02:47:06 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:47:07.001023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5ecfa071-4c12-4c19-a90a-6f57dc8ccc9f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:07.001510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5ecfa071-4c12-4c19-a90a-6f57dc8ccc9f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:07.022319 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ecfa071-4c12-4c19-a90a-6f57dc8ccc9f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:07.022541 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8779d648-457e-40c2-bf97-a429d6c14c0d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:07.026320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ecfa071-4c12-4c19-a90a-6f57dc8ccc9f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:07.027039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ecfa071-4c12-4c19-a90a-6f57dc8ccc9f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:07.028007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ecfa071-4c12-4c19-a90a-6f57dc8ccc9f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:07.028680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ecfa071-4c12-4c19-a90a-6f57dc8ccc9f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:07.032158 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ecfa071-4c12-4c19-a90a-6f57dc8ccc9f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:07.033791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8779d648-457e-40c2-bf97-a429d6c14c0d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:07.038228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8779d648-457e-40c2-bf97-a429d6c14c0d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:07.042070 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8779d648-457e-40c2-bf97-a429d6c14c0d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 1362 microversion: 2.25 time: 0.651684 Oct 29 02:47:07.045164 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 245/508] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:06 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 1362 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:07.056857 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-15367671-3a61-4d2e-9f0b-9ac1059accc8 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:07.065372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-15367671-3a61-4d2e-9f0b-9ac1059accc8 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] [instance: 6c325f03-e675-4cd8-928e-a09523951d3d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:07.081913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-15367671-3a61-4d2e-9f0b-9ac1059accc8 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:07.082820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-15367671-3a61-4d2e-9f0b-9ac1059accc8 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:07.083599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-15367671-3a61-4d2e-9f0b-9ac1059accc8 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:07.087301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-15367671-3a61-4d2e-9f0b-9ac1059accc8 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:07.088277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-15367671-3a61-4d2e-9f0b-9ac1059accc8 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:07.089500 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-15367671-3a61-4d2e-9f0b-9ac1059accc8 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:07.327382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5ecfa071-4c12-4c19-a90a-6f57dc8ccc9f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:07.338880 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5ecfa071-4c12-4c19-a90a-6f57dc8ccc9f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 200 len: 1325 microversion: 2.1 time: 0.346740 Oct 29 02:47:07.342881 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 264/509] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:06 2022] GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 1325 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:07.374222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-44b7b7bb-410b-4c56-92ee-f47c5a619cc7 tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:07.380293 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44b7b7bb-410b-4c56-92ee-f47c5a619cc7 tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:07.381908 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44b7b7bb-410b-4c56-92ee-f47c5a619cc7 tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:07.382563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44b7b7bb-410b-4c56-92ee-f47c5a619cc7 tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:07.386801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44b7b7bb-410b-4c56-92ee-f47c5a619cc7 tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:07.387795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44b7b7bb-410b-4c56-92ee-f47c5a619cc7 tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:07.388430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44b7b7bb-410b-4c56-92ee-f47c5a619cc7 tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:07.438619 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-15367671-3a61-4d2e-9f0b-9ac1059accc8 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/6c325f03-e675-4cd8-928e-a09523951d3d" status: 200 len: 1619 microversion: 2.1 time: 0.392086 Oct 29 02:47:07.439221 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 246/510] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:07 2022] GET /compute/v2.1/servers/6c325f03-e675-4cd8-928e-a09523951d3d => generated 1619 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:07.466725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1e6d8bf1-56a2-496c-a4b8-a4f62a555c53 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:07.468456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1e6d8bf1-56a2-496c-a4b8-a4f62a555c53 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:07.477215 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-44b7b7bb-410b-4c56-92ee-f47c5a619cc7 tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.106891 Oct 29 02:47:07.477215 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 265/511] 10.222.0.46 () {58 vars in 1176 bytes} [Sat Oct 29 02:47:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:07.482008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-785dc8b8-c2ad-44ba-8efe-8e54fa15eab4 tempest-ServersWithSpecificFlavorTestJSON-1817225689 tempest-ServersWithSpecificFlavorTestJSON-1817225689-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1949653845", "id": 1011831797, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:07.489667 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e6d8bf1-56a2-496c-a4b8-a4f62a555c53 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:07.490245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e6d8bf1-56a2-496c-a4b8-a4f62a555c53 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:07.490681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e6d8bf1-56a2-496c-a4b8-a4f62a555c53 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:07.498861 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e6d8bf1-56a2-496c-a4b8-a4f62a555c53 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:07.499366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e6d8bf1-56a2-496c-a4b8-a4f62a555c53 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:07.499822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e6d8bf1-56a2-496c-a4b8-a4f62a555c53 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:07.516170 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-785dc8b8-c2ad-44ba-8efe-8e54fa15eab4 tempest-ServersWithSpecificFlavorTestJSON-1817225689 tempest-ServersWithSpecificFlavorTestJSON-1817225689-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.034204 Oct 29 02:47:07.519849 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 266/512] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:47:07 2022] POST /compute/v2.1/flavors => generated 425 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:07.536371 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2fe7ef78-b14c-4bbb-8f8a-f8d8735c8639 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:07.537246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2fe7ef78-b14c-4bbb-8f8a-f8d8735c8639 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: d6f7b0a6-5397-4688-b938-15d013e11ad5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:07.553764 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fe7ef78-b14c-4bbb-8f8a-f8d8735c8639 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:07.554255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fe7ef78-b14c-4bbb-8f8a-f8d8735c8639 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:07.554689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fe7ef78-b14c-4bbb-8f8a-f8d8735c8639 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:07.555405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fe7ef78-b14c-4bbb-8f8a-f8d8735c8639 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:07.555847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fe7ef78-b14c-4bbb-8f8a-f8d8735c8639 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:07.556687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fe7ef78-b14c-4bbb-8f8a-f8d8735c8639 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:07.694328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1e6d8bf1-56a2-496c-a4b8-a4f62a555c53 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:07.703383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1e6d8bf1-56a2-496c-a4b8-a4f62a555c53 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:07.705159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1e6d8bf1-56a2-496c-a4b8-a4f62a555c53 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:07.713256 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1e6d8bf1-56a2-496c-a4b8-a4f62a555c53 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1447 microversion: 2.75 time: 0.268920 Oct 29 02:47:07.719251 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 247/513] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:07 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1447 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:07.725208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-4fa68940-a283-4584-99df-e6142d4dc88f req-a73dfd72-7b4d-494f-a6a8-68161ab1c215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f7b0a6-5397-4688-b938-15d013e11ad5", "name": "network-vif-plugged", "status": "completed", "tag": "2fc9c9aa-b3b6-4946-a801-fbe2d963340c"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:07.745636 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4fa68940-a283-4584-99df-e6142d4dc88f req-a73dfd72-7b4d-494f-a6a8-68161ab1c215 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:07.746506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4fa68940-a283-4584-99df-e6142d4dc88f req-a73dfd72-7b4d-494f-a6a8-68161ab1c215 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:07.747350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4fa68940-a283-4584-99df-e6142d4dc88f req-a73dfd72-7b4d-494f-a6a8-68161ab1c215 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:07.759954 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-4fa68940-a283-4584-99df-e6142d4dc88f req-a73dfd72-7b4d-494f-a6a8-68161ab1c215 service nova] Creating event network-vif-plugged:2fc9c9aa-b3b6-4946-a801-fbe2d963340c for instance d6f7b0a6-5397-4688-b938-15d013e11ad5 on n-h2-862967-2 Oct 29 02:47:07.766628 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-4fa68940-a283-4584-99df-e6142d4dc88f req-a73dfd72-7b4d-494f-a6a8-68161ab1c215 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045749 Oct 29 02:47:07.767254 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 248/514] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:07.780741 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7804d7ec-9f07-42bb-ba32-84305b20e37e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Action: 'create', calling method: .version_select at 0x7ff058531f70>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1110986771", "policies": ["anti-affinity"]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:07.807960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-7804d7ec-9f07-42bb-ba32-84305b20e37e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for project dcc6da8e69e041e19023a53a23e33393. Resources: {'server_groups'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:07.818204 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-7804d7ec-9f07-42bb-ba32-84305b20e37e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for user 509ce04aeb3847f084629201bd7ae5d6 and project dcc6da8e69e041e19023a53a23e33393. Resources: {'server_groups'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:07.918076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-7804d7ec-9f07-42bb-ba32-84305b20e37e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for project dcc6da8e69e041e19023a53a23e33393. Resources: {'server_groups'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:07.922699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-7804d7ec-9f07-42bb-ba32-84305b20e37e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for user 509ce04aeb3847f084629201bd7ae5d6 and project dcc6da8e69e041e19023a53a23e33393. Resources: {'server_groups'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:07.958810 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7804d7ec-9f07-42bb-ba32-84305b20e37e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.184607 Oct 29 02:47:07.971244 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 249/515] 10.222.0.46 () {60 vars in 1174 bytes} [Sat Oct 29 02:47:07 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:07.983250 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d670d506-d246-43a0-b766-19f215cc817c tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:07.992021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d670d506-d246-43a0-b766-19f215cc817c tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:07.993669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d670d506-d246-43a0-b766-19f215cc817c tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:07.994217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d670d506-d246-43a0-b766-19f215cc817c tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:07.996385 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d670d506-d246-43a0-b766-19f215cc817c tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:07.997093 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d670d506-d246-43a0-b766-19f215cc817c tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:07.999731 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d670d506-d246-43a0-b766-19f215cc817c tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:08.090403 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d670d506-d246-43a0-b766-19f215cc817c tempest-ServicesAdminTestJSON-1553594978 tempest-ServicesAdminTestJSON-1553594978-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.117678 Oct 29 02:47:08.091384 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 250/516] 10.222.0.46 () {58 vars in 1137 bytes} [Sat Oct 29 02:47:07 2022] GET /compute/v2.1/os-services => generated 944 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:08.100981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b215d219-79d3-4939-b15d-2c9e569454f5 tempest-ServersWithSpecificFlavorTestJSON-1817225689 tempest-ServersWithSpecificFlavorTestJSON-1817225689-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:08.110409 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b215d219-79d3-4939-b15d-2c9e569454f5 tempest-ServersWithSpecificFlavorTestJSON-1817225689 tempest-ServersWithSpecificFlavorTestJSON-1817225689-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017564 Oct 29 02:47:08.111970 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 251/517] 10.222.0.46 () {58 vars in 1182 bytes} [Sat Oct 29 02:47:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:47:08.118488 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-340adf85-e7ae-45f2-961a-2db597f6f435 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:08.120359 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-340adf85-e7ae-45f2-961a-2db597f6f435 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:08.129840 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-340adf85-e7ae-45f2-961a-2db597f6f435 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:08.131003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-340adf85-e7ae-45f2-961a-2db597f6f435 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:08.132116 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-340adf85-e7ae-45f2-961a-2db597f6f435 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:08.133196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-340adf85-e7ae-45f2-961a-2db597f6f435 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:08.133854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-340adf85-e7ae-45f2-961a-2db597f6f435 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:08.134482 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-340adf85-e7ae-45f2-961a-2db597f6f435 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:08.330994 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2fe7ef78-b14c-4bbb-8f8a-f8d8735c8639 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:08.345132 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2fe7ef78-b14c-4bbb-8f8a-f8d8735c8639 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5" status: 200 len: 1319 microversion: 2.1 time: 0.823699 Oct 29 02:47:08.347157 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 267/518] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:07 2022] GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5 => generated 1319 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:08.353269 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-53e71569-3d8a-4675-99e9-df82664fc4bf tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Action: 'create', calling method: .version_select at 0x7ff058331430>, body: {"keypair": {"name": "tempest-keypair-1611755857", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSAciJEyCfF4/3S/weRyMrF/SJrVdkfedePmT2ObzD1RrEAOL5t3KL4WuSl7pEcSIjD37wshVq4d6PwQ89Eccy/D8BmvkKnv0Mp7lYT3Jz3GSX/qclgvmKzx8FBZR1NHA=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:08.392276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-53e71569-3d8a-4675-99e9-df82664fc4bf tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Getting quotas for project 4ce4605ee60c4bbdb3ec64e735ed73a6. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:08.398338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-53e71569-3d8a-4675-99e9-df82664fc4bf tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Getting quotas for user 5e562fcf734e45ce92536806eaec5750 and project 4ce4605ee60c4bbdb3ec64e735ed73a6. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:08.418477 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-340adf85-e7ae-45f2-961a-2db597f6f435 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:08.432390 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-53e71569-3d8a-4675-99e9-df82664fc4bf tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.083544 Oct 29 02:47:08.433481 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 268/519] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 02:47:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:08.433872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-340adf85-e7ae-45f2-961a-2db597f6f435 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:08.437138 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-340adf85-e7ae-45f2-961a-2db597f6f435 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:08.438641 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-340adf85-e7ae-45f2-961a-2db597f6f435 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 1362 microversion: 2.25 time: 0.325428 Oct 29 02:47:08.439732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d94392c3-e02c-4729-8290-cc255ea999ea tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-536358", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "428b6e58-cae1-4349-bcd4-52aed500cadf"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:08.461755 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 252/520] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:08 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 1362 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:08.485973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-28a76021-a6e8-4e28-b4de-ef743c8dd6bb tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:08.488967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-28a76021-a6e8-4e28-b4de-ef743c8dd6bb tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:08.508685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-d94392c3-e02c-4729-8290-cc255ea999ea tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] validate_networks() for None {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:47:08.512104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-28a76021-a6e8-4e28-b4de-ef743c8dd6bb tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:08.516972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-28a76021-a6e8-4e28-b4de-ef743c8dd6bb tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:08.517804 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-28a76021-a6e8-4e28-b4de-ef743c8dd6bb tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:08.518802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-28a76021-a6e8-4e28-b4de-ef743c8dd6bb tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:08.527577 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-28a76021-a6e8-4e28-b4de-ef743c8dd6bb tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:08.528331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-28a76021-a6e8-4e28-b4de-ef743c8dd6bb tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:08.894105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-d94392c3-e02c-4729-8290-cc255ea999ea tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:47:08.895707 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-d94392c3-e02c-4729-8290-cc255ea999ea tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:47:08.896658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-d94392c3-e02c-4729-8290-cc255ea999ea tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:47:08.897766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-d94392c3-e02c-4729-8290-cc255ea999ea tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:47:08.899379 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-d94392c3-e02c-4729-8290-cc255ea999ea tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:47:08.903668 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:08.946387 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d94392c3-e02c-4729-8290-cc255ea999ea tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:08.946889 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d94392c3-e02c-4729-8290-cc255ea999ea tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:08.947316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d94392c3-e02c-4729-8290-cc255ea999ea tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:08.948158 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d94392c3-e02c-4729-8290-cc255ea999ea tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:08.948644 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d94392c3-e02c-4729-8290-cc255ea999ea tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:08.949070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d94392c3-e02c-4729-8290-cc255ea999ea tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:08.951150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-28a76021-a6e8-4e28-b4de-ef743c8dd6bb tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:08.963272 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-28a76021-a6e8-4e28-b4de-ef743c8dd6bb tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 200 len: 1325 microversion: 2.1 time: 0.499933 Oct 29 02:47:08.967995 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 253/521] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:08 2022] GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 1325 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:08.982829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4774db2b-0709-41d5-984d-8376c878138a tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:08.983610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4774db2b-0709-41d5-984d-8376c878138a tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:08.999621 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-d94392c3-e02c-4729-8290-cc255ea999ea tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for project dcc6da8e69e041e19023a53a23e33393. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:09.005836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4774db2b-0709-41d5-984d-8376c878138a tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:09.006308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-d94392c3-e02c-4729-8290-cc255ea999ea tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for user 509ce04aeb3847f084629201bd7ae5d6 and project dcc6da8e69e041e19023a53a23e33393. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:09.008902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4774db2b-0709-41d5-984d-8376c878138a tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:09.010027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4774db2b-0709-41d5-984d-8376c878138a tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:09.012323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4774db2b-0709-41d5-984d-8376c878138a tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:09.015720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4774db2b-0709-41d5-984d-8376c878138a tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:09.016436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4774db2b-0709-41d5-984d-8376c878138a tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:09.023991 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d94392c3-e02c-4729-8290-cc255ea999ea tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Going to run 2 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:47:09.028867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d94392c3-e02c-4729-8290-cc255ea999ea tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 03261ebe-4be4-4e74-bd8d-ff4a5ae066b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:47:09.097191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-d94392c3-e02c-4729-8290-cc255ea999ea tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=127125) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 29 02:47:09.137858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-d94392c3-e02c-4729-8290-cc255ea999ea tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for project dcc6da8e69e041e19023a53a23e33393. Resources: {'server_group_members'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:09.143199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-d94392c3-e02c-4729-8290-cc255ea999ea tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for user 509ce04aeb3847f084629201bd7ae5d6 and project dcc6da8e69e041e19023a53a23e33393. Resources: {'server_group_members'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:09.212311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-d94392c3-e02c-4729-8290-cc255ea999ea tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for project dcc6da8e69e041e19023a53a23e33393. Resources: {'server_group_members'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:09.224346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-d94392c3-e02c-4729-8290-cc255ea999ea tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for user 509ce04aeb3847f084629201bd7ae5d6 and project dcc6da8e69e041e19023a53a23e33393. Resources: {'server_group_members'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:09.251746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d94392c3-e02c-4729-8290-cc255ea999ea tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: d09276cf-e95a-47be-90e8-befb018ee5ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=03261ebe-4be4-4e74-bd8d-ff4a5ae066b1,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:47:09.258541 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4774db2b-0709-41d5-984d-8376c878138a tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:09.276794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4774db2b-0709-41d5-984d-8376c878138a tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:09.286368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4774db2b-0709-41d5-984d-8376c878138a tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:09.311013 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4774db2b-0709-41d5-984d-8376c878138a tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1447 microversion: 2.75 time: 0.341787 Oct 29 02:47:09.314627 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 254/522] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:08 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1447 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:09.352073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-d94392c3-e02c-4729-8290-cc255ea999ea tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for project dcc6da8e69e041e19023a53a23e33393. Resources: {'server_group_members'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:09.357874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-d94392c3-e02c-4729-8290-cc255ea999ea tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for user 509ce04aeb3847f084629201bd7ae5d6 and project dcc6da8e69e041e19023a53a23e33393. Resources: {'server_group_members'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:09.380403 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c012559b-7462-493c-ae5e-8f8de61bab29 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:09.381447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c012559b-7462-493c-ae5e-8f8de61bab29 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: d6f7b0a6-5397-4688-b938-15d013e11ad5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:09.415074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c012559b-7462-493c-ae5e-8f8de61bab29 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:09.419187 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c012559b-7462-493c-ae5e-8f8de61bab29 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:09.420816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c012559b-7462-493c-ae5e-8f8de61bab29 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:09.423609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c012559b-7462-493c-ae5e-8f8de61bab29 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:09.424600 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c012559b-7462-493c-ae5e-8f8de61bab29 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:09.426188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c012559b-7462-493c-ae5e-8f8de61bab29 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:09.437804 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-d94392c3-e02c-4729-8290-cc255ea999ea tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for project dcc6da8e69e041e19023a53a23e33393. Resources: {'server_group_members'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:09.447724 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-d94392c3-e02c-4729-8290-cc255ea999ea tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for user 509ce04aeb3847f084629201bd7ae5d6 and project dcc6da8e69e041e19023a53a23e33393. Resources: {'server_group_members'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:09.529804 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d94392c3-e02c-4729-8290-cc255ea999ea tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.094655 Oct 29 02:47:09.530826 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 269/523] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:47:08 2022] POST /compute/v2.1/servers => generated 32 bytes in 1096 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 29 02:47:09.536810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-caa27ec2-1e5a-48fa-a78e-a70c8125ffc6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:09.537430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-caa27ec2-1e5a-48fa-a78e-a70c8125ffc6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:09.544074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-caa27ec2-1e5a-48fa-a78e-a70c8125ffc6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:09.544685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-caa27ec2-1e5a-48fa-a78e-a70c8125ffc6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:09.545196 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-caa27ec2-1e5a-48fa-a78e-a70c8125ffc6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:09.545911 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-caa27ec2-1e5a-48fa-a78e-a70c8125ffc6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:09.546410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-caa27ec2-1e5a-48fa-a78e-a70c8125ffc6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:09.546828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-caa27ec2-1e5a-48fa-a78e-a70c8125ffc6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:09.936473 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c012559b-7462-493c-ae5e-8f8de61bab29 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:09.949804 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c012559b-7462-493c-ae5e-8f8de61bab29 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5" status: 200 len: 1468 microversion: 2.1 time: 0.582705 Oct 29 02:47:09.953216 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 255/524] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:09 2022] GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5 => generated 1468 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:47:09.961259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-caa27ec2-1e5a-48fa-a78e-a70c8125ffc6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:09.977869 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-caa27ec2-1e5a-48fa-a78e-a70c8125ffc6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:09.979091 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eda0ec1e-5100-4115-bb5b-3ab405f9444d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:09.983341 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-caa27ec2-1e5a-48fa-a78e-a70c8125ffc6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:09.985153 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-caa27ec2-1e5a-48fa-a78e-a70c8125ffc6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 1362 microversion: 2.25 time: 0.453221 Oct 29 02:47:09.988937 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 270/525] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:09 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 1362 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:09.999896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-eda0ec1e-5100-4115-bb5b-3ab405f9444d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:10.007554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-eda0ec1e-5100-4115-bb5b-3ab405f9444d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Searching by: {'deleted': False, 'project_id': 'dcc6da8e69e041e19023a53a23e33393'} {{(pid=127124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:47:10.049669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eda0ec1e-5100-4115-bb5b-3ab405f9444d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:10.053623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eda0ec1e-5100-4115-bb5b-3ab405f9444d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:10.054363 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eda0ec1e-5100-4115-bb5b-3ab405f9444d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:10.056318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eda0ec1e-5100-4115-bb5b-3ab405f9444d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:10.057619 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eda0ec1e-5100-4115-bb5b-3ab405f9444d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:10.060753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eda0ec1e-5100-4115-bb5b-3ab405f9444d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:10.271663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.multi_cell_list [None req-eda0ec1e-5100-4115-bb5b-3ab405f9444d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=127124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 02:47:10.521136 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eda0ec1e-5100-4115-bb5b-3ab405f9444d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 1655 microversion: 2.1 time: 0.566180 Oct 29 02:47:10.522288 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 256/526] 10.222.0.46 () {58 vars in 1125 bytes} [Sat Oct 29 02:47:09 2022] GET /compute/v2.1/servers => generated 1655 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:10.541192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8fb44b1f-286b-4081-b5c4-1a900a51f595 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:10.551063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8fb44b1f-286b-4081-b5c4-1a900a51f595 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:10.572601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fb44b1f-286b-4081-b5c4-1a900a51f595 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:10.573404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fb44b1f-286b-4081-b5c4-1a900a51f595 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:10.574016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fb44b1f-286b-4081-b5c4-1a900a51f595 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:10.575060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fb44b1f-286b-4081-b5c4-1a900a51f595 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:10.575661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fb44b1f-286b-4081-b5c4-1a900a51f595 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:10.576405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fb44b1f-286b-4081-b5c4-1a900a51f595 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:10.633233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f594ccc5-773e-4b19-a94f-0861f889ee41 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1820823710", "block_migration": true, "disk_over_commit": false}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:10.637589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f594ccc5-773e-4b19-a94f-0861f889ee41 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] [instance: d6f7b0a6-5397-4688-b938-15d013e11ad5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:10.654833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f594ccc5-773e-4b19-a94f-0861f889ee41 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:10.655339 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f594ccc5-773e-4b19-a94f-0861f889ee41 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:10.655831 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f594ccc5-773e-4b19-a94f-0861f889ee41 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:10.660305 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f594ccc5-773e-4b19-a94f-0861f889ee41 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:10.662811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f594ccc5-773e-4b19-a94f-0861f889ee41 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:10.667896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f594ccc5-773e-4b19-a94f-0861f889ee41 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:10.749777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-f594ccc5-773e-4b19-a94f-0861f889ee41 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Lazy-loading 'flavor' on Instance uuid d6f7b0a6-5397-4688-b938-15d013e11ad5 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:10.786442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f594ccc5-773e-4b19-a94f-0861f889ee41 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] [instance: d6f7b0a6-5397-4688-b938-15d013e11ad5] Going to try to live migrate instance to tempest-host-1820823710 {{(pid=127125) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 02:47:10.803560 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-f594ccc5-773e-4b19-a94f-0861f889ee41 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] HTTP exception thrown: Compute host tempest-host-1820823710 could not be found. Oct 29 02:47:10.814188 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f594ccc5-773e-4b19-a94f-0861f889ee41 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Request method failure captured: Oct 29 02:47:10.814188 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5/action HTTP/1.1 Oct 29 02:47:10.814188 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:47:10.814188 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:47:10.814188 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:47:10.814188 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 107 Oct 29 02:47:10.814188 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:47:10.814188 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:47:10.814188 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:47:10.814188 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:47:10.814188 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJQXvf5Gib4E7KyEci5pFWjmYY5z0yLAaYSeBFQHaxpUA6SLaaa__OmAOErXuiVwH6tknXmxGnUEAEC313Y2ketNbSxqdJDddop5Ll1ctX7XW8IFQgu5FJmgdtDqlGhgbGNBUKyp6GDalaNXBvK3sPt8p2JdXHpb5bcDc4wU-cCvK7s Oct 29 02:47:10.814188 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:47:10.814188 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:47:10.814188 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:47:10.814188 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:47:10.814188 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:47:10.814188 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:47:10.814188 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 75b0783e21594c4ba2f893d12b7b2114 Oct 29 02:47:10.814188 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-LiveMigrationNegativeTest-546326446 Oct 29 02:47:10.814188 n-d-862967-2 devstack@n-api.service[127125]: X-Role: admin,reader,member Oct 29 02:47:10.814188 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: admin,reader,member Oct 29 02:47:10.815772 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/75b0783e21594c4ba2f893d12b7b2114"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/75b0783e21594c4ba2f893d12b7b2114"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_75b0783e21594c4ba2f893d12b7b2114"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/75b0783e21594c4ba2f893d12b7b2114"}]}] Oct 29 02:47:10.815772 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-LiveMigrationNegativeTest-546326446 Oct 29 02:47:10.815772 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 75b0783e21594c4ba2f893d12b7b2114 Oct 29 02:47:10.815772 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-546326446 Oct 29 02:47:10.815772 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-LiveMigrationNegativeTest-546326446-project-admin Oct 29 02:47:10.815772 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:47:10.815772 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:47:10.815772 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 7c2347bc1dc54404b89c2c8887b9c91b Oct 29 02:47:10.815772 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-LiveMigrationNegativeTest-546326446-project-admin Oct 29 02:47:10.815772 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:47:10.815772 n-d-862967-2 devstack@n-api.service[127125]: {"os-migrateLive": {"host": "tempest-host-1820823710", "block_migration": true, "disk_over_commit": false}} Oct 29 02:47:10.815772 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:47:10.816716 n-d-862967-2 devstack@n-api.service[127125]: exception: Compute host tempest-host-1820823710 could not be found. Oct 29 02:47:10.816716 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'd6f7b0a6-5397-4688-b938-15d013e11ad5', 'body': {'os-migrateLive': {'host': 'tempest-host-1820823710', 'block_migration': True, 'disk_over_commit': False}}} Oct 29 02:47:10.816716 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:47:10.816716 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:47:10.816716 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 29 02:47:10.816716 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 29 02:47:10.816716 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 29 02:47:10.816716 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 02:47:10.816716 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 02:47:10.816716 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 02:47:10.816716 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 29 02:47:10.816716 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 02:47:10.816716 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 02:47:10.816716 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 02:47:10.816716 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 29 02:47:10.816716 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 02:47:10.816716 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 29 02:47:10.816716 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 02:47:10.816716 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 02:47:10.818294 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 02:47:10.818294 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 29 02:47:10.818294 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 02:47:10.818294 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 29 02:47:10.818294 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 29 02:47:10.818294 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:47:10.818294 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:47:10.818294 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 29 02:47:10.818294 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 29 02:47:10.818294 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 29 02:47:10.818294 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:47:10.818294 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 29 02:47:10.818294 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 29 02:47:10.818294 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 29 02:47:10.818294 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 29 02:47:10.818294 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 29 02:47:10.818294 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 29 02:47:10.818294 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1820823710 could not be found. Oct 29 02:47:10.818294 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:47:10.819646 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:47:10.819646 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:47:10.819646 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:47:10.819646 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:47:10.819646 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:47:10.819646 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:47:10.819646 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:47:10.819646 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:47:10.819646 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:47:10.819646 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:47:10.819646 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:47:10.819646 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:47:10.819646 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:47:10.819646 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:47:10.819646 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:47:10.819646 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 29 02:47:10.819646 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 29 02:47:10.819646 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 29 02:47:10.819646 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1820823710 could not be found. Oct 29 02:47:10.819646 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:47:10.821096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:47:10.821096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:47:10.821096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:47:10.821096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:47:10.821096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:47:10.821096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:47:10.821096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:47:10.821096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1820823710 could not be found. Oct 29 02:47:10.821096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:47:10.824969 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f594ccc5-773e-4b19-a94f-0861f889ee41 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Returning 400 to user: Compute host tempest-host-1820823710 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:47:10.827642 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f594ccc5-773e-4b19-a94f-0861f889ee41 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5/action" status: 400 len: 100 microversion: 2.1 time: 0.837216 Oct 29 02:47:10.829716 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 271/527] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Oct 29 02:47:09 2022] POST /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5/action => generated 100 bytes in 840 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:47:10.844184 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6cfeb536-fb90-4f5c-ae78-f09ccf646cb5 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:10.846682 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6cfeb536-fb90-4f5c-ae78-f09ccf646cb5 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:10.867684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6cfeb536-fb90-4f5c-ae78-f09ccf646cb5 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:10.868577 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6cfeb536-fb90-4f5c-ae78-f09ccf646cb5 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:10.869371 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6cfeb536-fb90-4f5c-ae78-f09ccf646cb5 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:10.870310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6cfeb536-fb90-4f5c-ae78-f09ccf646cb5 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:10.871011 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6cfeb536-fb90-4f5c-ae78-f09ccf646cb5 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:10.871593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6cfeb536-fb90-4f5c-ae78-f09ccf646cb5 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:10.983525 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6cfeb536-fb90-4f5c-ae78-f09ccf646cb5 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:11.003120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6cfeb536-fb90-4f5c-ae78-f09ccf646cb5 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:11.008652 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6cfeb536-fb90-4f5c-ae78-f09ccf646cb5 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:11.026293 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6cfeb536-fb90-4f5c-ae78-f09ccf646cb5 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1447 microversion: 2.75 time: 0.194569 Oct 29 02:47:11.027835 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 272/528] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:10 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1447 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:11.053767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d1588f05-4fc9-46f4-986f-ec93acd0565d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:11.059808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d1588f05-4fc9-46f4-986f-ec93acd0565d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: d09276cf-e95a-47be-90e8-befb018ee5ab] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:11.081912 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1588f05-4fc9-46f4-986f-ec93acd0565d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:11.083347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1588f05-4fc9-46f4-986f-ec93acd0565d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:11.084407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1588f05-4fc9-46f4-986f-ec93acd0565d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:11.085894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1588f05-4fc9-46f4-986f-ec93acd0565d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:11.087199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1588f05-4fc9-46f4-986f-ec93acd0565d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:11.088398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1588f05-4fc9-46f4-986f-ec93acd0565d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:11.319408 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d1588f05-4fc9-46f4-986f-ec93acd0565d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:11.330155 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d1588f05-4fc9-46f4-986f-ec93acd0565d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab" status: 200 len: 1211 microversion: 2.1 time: 0.299958 Oct 29 02:47:11.354566 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8fb44b1f-286b-4081-b5c4-1a900a51f595 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:11.355067 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 273/529] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:11 2022] GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab => generated 1211 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:11.362349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-de1bb1e2-02be-4a3c-91ab-f97c65b5f65a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:11.365489 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-de1bb1e2-02be-4a3c-91ab-f97c65b5f65a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: d6f7b0a6-5397-4688-b938-15d013e11ad5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:11.372627 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8fb44b1f-286b-4081-b5c4-1a900a51f595 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 200 len: 1325 microversion: 2.1 time: 0.839961 Oct 29 02:47:11.379403 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 257/530] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:10 2022] GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 1325 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:11.389412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-de1bb1e2-02be-4a3c-91ab-f97c65b5f65a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:11.389971 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-de1bb1e2-02be-4a3c-91ab-f97c65b5f65a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:11.390596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-de1bb1e2-02be-4a3c-91ab-f97c65b5f65a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:11.391677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-de1bb1e2-02be-4a3c-91ab-f97c65b5f65a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:11.392648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-de1bb1e2-02be-4a3c-91ab-f97c65b5f65a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:11.392648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-de1bb1e2-02be-4a3c-91ab-f97c65b5f65a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:11.399169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f1d49725-861c-4ace-ab2a-622cf4f73c79 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:11.401102 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f1d49725-861c-4ace-ab2a-622cf4f73c79 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:11.419423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f1d49725-861c-4ace-ab2a-622cf4f73c79 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:11.420396 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f1d49725-861c-4ace-ab2a-622cf4f73c79 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:11.421177 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f1d49725-861c-4ace-ab2a-622cf4f73c79 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:11.425337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f1d49725-861c-4ace-ab2a-622cf4f73c79 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:11.426239 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f1d49725-861c-4ace-ab2a-622cf4f73c79 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:11.430962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f1d49725-861c-4ace-ab2a-622cf4f73c79 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:11.717424 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f1d49725-861c-4ace-ab2a-622cf4f73c79 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:11.730235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f1d49725-861c-4ace-ab2a-622cf4f73c79 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:11.732044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f1d49725-861c-4ace-ab2a-622cf4f73c79 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:11.733549 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f1d49725-861c-4ace-ab2a-622cf4f73c79 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 1362 microversion: 2.25 time: 0.351901 Oct 29 02:47:11.734665 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 258/531] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:11 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 1362 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:11.765920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-de1bb1e2-02be-4a3c-91ab-f97c65b5f65a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:11.802714 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-de1bb1e2-02be-4a3c-91ab-f97c65b5f65a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5" status: 200 len: 1468 microversion: 2.1 time: 0.445223 Oct 29 02:47:11.816246 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 274/532] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:11 2022] GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5 => generated 1468 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:12.078541 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e906bb89-3744-4ac5-a9dd-cc0fc4cca921 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:12.079453 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e906bb89-3744-4ac5-a9dd-cc0fc4cca921 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:12.090365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e906bb89-3744-4ac5-a9dd-cc0fc4cca921 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:12.093981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e906bb89-3744-4ac5-a9dd-cc0fc4cca921 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:12.098359 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e906bb89-3744-4ac5-a9dd-cc0fc4cca921 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:12.100335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e906bb89-3744-4ac5-a9dd-cc0fc4cca921 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:12.106126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e906bb89-3744-4ac5-a9dd-cc0fc4cca921 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:12.106654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e906bb89-3744-4ac5-a9dd-cc0fc4cca921 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:12.190564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0fdfcc4d-85f9-45ee-a6cd-c37a0d395f67 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1848110589", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:12.291653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-0fdfcc4d-85f9-45ee-a6cd-c37a0d395f67 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] validate_networks() for None {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:47:12.735700 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-0fdfcc4d-85f9-45ee-a6cd-c37a0d395f67 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:47:12.736589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-0fdfcc4d-85f9-45ee-a6cd-c37a0d395f67 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:47:12.737719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-0fdfcc4d-85f9-45ee-a6cd-c37a0d395f67 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:47:12.739441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-0fdfcc4d-85f9-45ee-a6cd-c37a0d395f67 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:47:12.740348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-0fdfcc4d-85f9-45ee-a6cd-c37a0d395f67 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:47:12.750891 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=43 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:12.754440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fdfcc4d-85f9-45ee-a6cd-c37a0d395f67 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:12.755274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fdfcc4d-85f9-45ee-a6cd-c37a0d395f67 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:12.756008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fdfcc4d-85f9-45ee-a6cd-c37a0d395f67 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:12.757328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fdfcc4d-85f9-45ee-a6cd-c37a0d395f67 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:12.758085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fdfcc4d-85f9-45ee-a6cd-c37a0d395f67 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:12.758859 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fdfcc4d-85f9-45ee-a6cd-c37a0d395f67 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:12.774267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e906bb89-3744-4ac5-a9dd-cc0fc4cca921 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:12.775351 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=13 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:12.786971 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e906bb89-3744-4ac5-a9dd-cc0fc4cca921 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:12.789854 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-0fdfcc4d-85f9-45ee-a6cd-c37a0d395f67 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Getting quotas for project 28feebf0d93c499aa8ed33fe4e12e3d5. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:12.794465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e906bb89-3744-4ac5-a9dd-cc0fc4cca921 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:12.796075 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-0fdfcc4d-85f9-45ee-a6cd-c37a0d395f67 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Getting quotas for user 0660da2ef33845f9a7784dea223dda62 and project 28feebf0d93c499aa8ed33fe4e12e3d5. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:12.809543 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e906bb89-3744-4ac5-a9dd-cc0fc4cca921 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1447 microversion: 2.75 time: 0.751885 Oct 29 02:47:12.814034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0fdfcc4d-85f9-45ee-a6cd-c37a0d395f67 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:47:12.815031 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 259/533] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:12 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1447 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:12.822142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0fdfcc4d-85f9-45ee-a6cd-c37a0d395f67 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: 4c912c93-9d84-4d95-8dc3-103233acff10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:47:12.831530 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-38f71e4f-ad36-498a-bcc4-5a2963ced517 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:12.832559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-38f71e4f-ad36-498a-bcc4-5a2963ced517 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: d09276cf-e95a-47be-90e8-befb018ee5ab] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:12.839102 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38f71e4f-ad36-498a-bcc4-5a2963ced517 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:12.839509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38f71e4f-ad36-498a-bcc4-5a2963ced517 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:12.839944 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38f71e4f-ad36-498a-bcc4-5a2963ced517 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:12.840719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38f71e4f-ad36-498a-bcc4-5a2963ced517 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:12.841204 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38f71e4f-ad36-498a-bcc4-5a2963ced517 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:12.841644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38f71e4f-ad36-498a-bcc4-5a2963ced517 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:12.922096 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0fdfcc4d-85f9-45ee-a6cd-c37a0d395f67 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.735677 Oct 29 02:47:12.923192 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 275/534] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:47:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:47:12.928791 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c5766bfa-9be4-4c8d-ad15-3e568e3a4c6f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:12.930754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c5766bfa-9be4-4c8d-ad15-3e568e3a4c6f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:12.957768 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5766bfa-9be4-4c8d-ad15-3e568e3a4c6f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:12.962008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5766bfa-9be4-4c8d-ad15-3e568e3a4c6f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:12.963791 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5766bfa-9be4-4c8d-ad15-3e568e3a4c6f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:12.964702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5766bfa-9be4-4c8d-ad15-3e568e3a4c6f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:12.965351 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5766bfa-9be4-4c8d-ad15-3e568e3a4c6f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:12.965965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5766bfa-9be4-4c8d-ad15-3e568e3a4c6f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:13.168482 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-38f71e4f-ad36-498a-bcc4-5a2963ced517 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:13.176847 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-38f71e4f-ad36-498a-bcc4-5a2963ced517 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab" status: 200 len: 1273 microversion: 2.1 time: 0.360363 Oct 29 02:47:13.184646 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 260/535] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:12 2022] GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab => generated 1273 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:13.206311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-00ccca69-474d-4aff-9518-a6986c7bffea tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:13.207128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-00ccca69-474d-4aff-9518-a6986c7bffea tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:13.216414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00ccca69-474d-4aff-9518-a6986c7bffea tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:13.217131 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00ccca69-474d-4aff-9518-a6986c7bffea tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:13.218994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00ccca69-474d-4aff-9518-a6986c7bffea tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:13.219896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00ccca69-474d-4aff-9518-a6986c7bffea tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:13.220543 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00ccca69-474d-4aff-9518-a6986c7bffea tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:13.221135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00ccca69-474d-4aff-9518-a6986c7bffea tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:13.283023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c5766bfa-9be4-4c8d-ad15-3e568e3a4c6f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:13.292434 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c5766bfa-9be4-4c8d-ad15-3e568e3a4c6f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 200 len: 1325 microversion: 2.1 time: 0.367822 Oct 29 02:47:13.293719 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 276/536] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:12 2022] GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 1325 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:13.300483 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-514ba11a-9649-448e-838f-a1b59a1cd3f6 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1688070130", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "1011831797", "adminPass": "***", "networks": [{"uuid": "63e498c5-2a14-4eaa-b7a9-934319184aed"}], "security_groups": [{"name": "tempest-securitygroup--648704240"}], "key_name": "tempest-keypair-1611755857", "user_data": "}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:13.328619 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:13.472859 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-514ba11a-9649-448e-838f-a1b59a1cd3f6 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] validate_networks() for [('63e498c5-2a14-4eaa-b7a9-934319184aed', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:47:14.124969 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-00ccca69-474d-4aff-9518-a6986c7bffea tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:14.140430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-00ccca69-474d-4aff-9518-a6986c7bffea tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:14.144918 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-00ccca69-474d-4aff-9518-a6986c7bffea tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:14.149844 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-00ccca69-474d-4aff-9518-a6986c7bffea tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 1362 microversion: 2.25 time: 0.961421 Oct 29 02:47:14.151451 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 261/537] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:13 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 1362 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:14.159149 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c46dff15-a3d6-46df-bf4f-71309e5a72db tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:14.160337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c46dff15-a3d6-46df-bf4f-71309e5a72db tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: 4c912c93-9d84-4d95-8dc3-103233acff10] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:14.166502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-514ba11a-9649-448e-838f-a1b59a1cd3f6 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:47:14.167043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-514ba11a-9649-448e-838f-a1b59a1cd3f6 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:47:14.167375 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-514ba11a-9649-448e-838f-a1b59a1cd3f6 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:47:14.167850 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-514ba11a-9649-448e-838f-a1b59a1cd3f6 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:47:14.169050 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-514ba11a-9649-448e-838f-a1b59a1cd3f6 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:47:14.171663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c46dff15-a3d6-46df-bf4f-71309e5a72db tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:14.172393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c46dff15-a3d6-46df-bf4f-71309e5a72db tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:14.173126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c46dff15-a3d6-46df-bf4f-71309e5a72db tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:14.174486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c46dff15-a3d6-46df-bf4f-71309e5a72db tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:14.176662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c46dff15-a3d6-46df-bf4f-71309e5a72db tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:14.177439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c46dff15-a3d6-46df-bf4f-71309e5a72db tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:14.178929 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-514ba11a-9649-448e-838f-a1b59a1cd3f6 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:14.179424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-514ba11a-9649-448e-838f-a1b59a1cd3f6 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:14.179854 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-514ba11a-9649-448e-838f-a1b59a1cd3f6 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:14.180615 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-514ba11a-9649-448e-838f-a1b59a1cd3f6 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:14.181131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-514ba11a-9649-448e-838f-a1b59a1cd3f6 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:14.181789 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-514ba11a-9649-448e-838f-a1b59a1cd3f6 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:14.204061 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-514ba11a-9649-448e-838f-a1b59a1cd3f6 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Getting quotas for project 4ce4605ee60c4bbdb3ec64e735ed73a6. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:14.209179 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-514ba11a-9649-448e-838f-a1b59a1cd3f6 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Getting quotas for user 5e562fcf734e45ce92536806eaec5750 and project 4ce4605ee60c4bbdb3ec64e735ed73a6. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:14.224169 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-514ba11a-9649-448e-838f-a1b59a1cd3f6 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:47:14.237058 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-514ba11a-9649-448e-838f-a1b59a1cd3f6 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: aff333bb-fff4-4b3e-a3f9-a567b7786a62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:47:14.336426 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-514ba11a-9649-448e-838f-a1b59a1cd3f6 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.040965 Oct 29 02:47:14.337286 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 277/538] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:47:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:47:14.351340 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d1903dbb-7ff5-4b65-96f7-f383a214ceeb tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:14.352039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d1903dbb-7ff5-4b65-96f7-f383a214ceeb tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:14.364558 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1903dbb-7ff5-4b65-96f7-f383a214ceeb tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:14.368886 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1903dbb-7ff5-4b65-96f7-f383a214ceeb tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:14.369357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1903dbb-7ff5-4b65-96f7-f383a214ceeb tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:14.370116 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1903dbb-7ff5-4b65-96f7-f383a214ceeb tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:14.370579 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1903dbb-7ff5-4b65-96f7-f383a214ceeb tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:14.371003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1903dbb-7ff5-4b65-96f7-f383a214ceeb tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:14.423268 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c46dff15-a3d6-46df-bf4f-71309e5a72db tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:14.435105 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c46dff15-a3d6-46df-bf4f-71309e5a72db tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10" status: 200 len: 1223 microversion: 2.1 time: 0.282301 Oct 29 02:47:14.441161 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 262/539] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:14 2022] GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10 => generated 1223 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:14.458132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-658d0e96-1ff6-4829-bae1-1b935c5f9370 req-d4cd8abb-a9e0-43e0-a678-30913b0b504e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0ec4a8-4cf9-4596-bc31-797c86447aa0", "name": "network-vif-plugged", "status": "completed", "tag": "69a0c6be-941f-492e-8d52-cd37b1ae25aa"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:14.482826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-658d0e96-1ff6-4829-bae1-1b935c5f9370 req-d4cd8abb-a9e0-43e0-a678-30913b0b504e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:14.483368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-658d0e96-1ff6-4829-bae1-1b935c5f9370 req-d4cd8abb-a9e0-43e0-a678-30913b0b504e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:14.483808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-658d0e96-1ff6-4829-bae1-1b935c5f9370 req-d4cd8abb-a9e0-43e0-a678-30913b0b504e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:14.518154 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-658d0e96-1ff6-4829-bae1-1b935c5f9370 req-d4cd8abb-a9e0-43e0-a678-30913b0b504e service nova] Creating event network-vif-plugged:69a0c6be-941f-492e-8d52-cd37b1ae25aa for instance 0a0ec4a8-4cf9-4596-bc31-797c86447aa0 on n-h2-862967-2 Oct 29 02:47:14.539565 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-658d0e96-1ff6-4829-bae1-1b935c5f9370 req-d4cd8abb-a9e0-43e0-a678-30913b0b504e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094075 Oct 29 02:47:14.544126 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 263/540] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:14.569207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d1903dbb-7ff5-4b65-96f7-f383a214ceeb tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:14.571890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:14.581714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d1903dbb-7ff5-4b65-96f7-f383a214ceeb tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:14.582742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bd53a05f-2f8e-4b31-b2fd-17e0575f039b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:14.588774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bd53a05f-2f8e-4b31-b2fd-17e0575f039b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: d09276cf-e95a-47be-90e8-befb018ee5ab] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:14.589843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d1903dbb-7ff5-4b65-96f7-f383a214ceeb tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:14.632453 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d1903dbb-7ff5-4b65-96f7-f383a214ceeb tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1447 microversion: 2.75 time: 0.280454 Oct 29 02:47:14.635867 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd53a05f-2f8e-4b31-b2fd-17e0575f039b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:14.636507 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd53a05f-2f8e-4b31-b2fd-17e0575f039b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:14.637920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd53a05f-2f8e-4b31-b2fd-17e0575f039b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:14.648903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd53a05f-2f8e-4b31-b2fd-17e0575f039b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:14.650262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd53a05f-2f8e-4b31-b2fd-17e0575f039b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:14.653480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd53a05f-2f8e-4b31-b2fd-17e0575f039b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:14.683736 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 278/541] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:14 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1447 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:14.710528 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4b8592f9-4ba4-466a-8f3e-110879d29f9f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:14.711555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4b8592f9-4ba4-466a-8f3e-110879d29f9f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:14.727057 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b8592f9-4ba4-466a-8f3e-110879d29f9f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:14.735904 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b8592f9-4ba4-466a-8f3e-110879d29f9f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:14.736633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b8592f9-4ba4-466a-8f3e-110879d29f9f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:14.737685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b8592f9-4ba4-466a-8f3e-110879d29f9f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:14.738603 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b8592f9-4ba4-466a-8f3e-110879d29f9f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:14.740432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b8592f9-4ba4-466a-8f3e-110879d29f9f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:15.051293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bd53a05f-2f8e-4b31-b2fd-17e0575f039b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:15.073148 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bd53a05f-2f8e-4b31-b2fd-17e0575f039b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab" status: 200 len: 1273 microversion: 2.1 time: 0.522355 Oct 29 02:47:15.080844 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 264/542] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:14 2022] GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab => generated 1273 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:15.087003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4b8592f9-4ba4-466a-8f3e-110879d29f9f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:15.094826 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4b8592f9-4ba4-466a-8f3e-110879d29f9f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 200 len: 1325 microversion: 2.1 time: 0.409517 Oct 29 02:47:15.103029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-517e8b88-0ccd-4ee0-8296-0950b9019c77 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:15.103895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-517e8b88-0ccd-4ee0-8296-0950b9019c77 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: aff333bb-fff4-4b3e-a3f9-a567b7786a62] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:15.112930 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 279/543] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:14 2022] GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 1325 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:15.187077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b025735f-ef6e-4993-9f24-89d96e508a17 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:15.188682 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b025735f-ef6e-4993-9f24-89d96e508a17 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:15.200067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b025735f-ef6e-4993-9f24-89d96e508a17 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:15.207136 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b025735f-ef6e-4993-9f24-89d96e508a17 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:15.212230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b025735f-ef6e-4993-9f24-89d96e508a17 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:15.213330 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b025735f-ef6e-4993-9f24-89d96e508a17 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:15.214162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b025735f-ef6e-4993-9f24-89d96e508a17 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:15.218889 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b025735f-ef6e-4993-9f24-89d96e508a17 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:15.509746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-517e8b88-0ccd-4ee0-8296-0950b9019c77 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:15.545794 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-517e8b88-0ccd-4ee0-8296-0950b9019c77 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62" status: 200 len: 1265 microversion: 2.1 time: 0.470419 Oct 29 02:47:15.552866 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 265/544] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:15 2022] GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62 => generated 1265 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:15.552866 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e9b41e02-8d4c-402e-b1b4-1043bbb19d00 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:15.552866 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e9b41e02-8d4c-402e-b1b4-1043bbb19d00 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: 4c912c93-9d84-4d95-8dc3-103233acff10] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:15.580089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9b41e02-8d4c-402e-b1b4-1043bbb19d00 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:15.581044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9b41e02-8d4c-402e-b1b4-1043bbb19d00 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:15.581788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9b41e02-8d4c-402e-b1b4-1043bbb19d00 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:15.587109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9b41e02-8d4c-402e-b1b4-1043bbb19d00 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:15.587775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9b41e02-8d4c-402e-b1b4-1043bbb19d00 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:15.588280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9b41e02-8d4c-402e-b1b4-1043bbb19d00 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:15.742562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b025735f-ef6e-4993-9f24-89d96e508a17 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:15.759050 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b025735f-ef6e-4993-9f24-89d96e508a17 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:15.763011 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b025735f-ef6e-4993-9f24-89d96e508a17 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:15.764825 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b025735f-ef6e-4993-9f24-89d96e508a17 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 1362 microversion: 2.25 time: 0.588397 Oct 29 02:47:15.778369 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 280/545] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:15 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 1362 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:15.796088 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6811e1a0-4d6a-4e22-9031-c6c0bc4bf07f tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:15.797108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6811e1a0-4d6a-4e22-9031-c6c0bc4bf07f tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:15.804900 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6811e1a0-4d6a-4e22-9031-c6c0bc4bf07f tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:15.805726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6811e1a0-4d6a-4e22-9031-c6c0bc4bf07f tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:15.806439 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6811e1a0-4d6a-4e22-9031-c6c0bc4bf07f tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:15.807453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6811e1a0-4d6a-4e22-9031-c6c0bc4bf07f tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:15.808506 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6811e1a0-4d6a-4e22-9031-c6c0bc4bf07f tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:15.809333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6811e1a0-4d6a-4e22-9031-c6c0bc4bf07f tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:16.006983 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6811e1a0-4d6a-4e22-9031-c6c0bc4bf07f tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:16.023412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6811e1a0-4d6a-4e22-9031-c6c0bc4bf07f tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:16.025289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6811e1a0-4d6a-4e22-9031-c6c0bc4bf07f tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:16.062537 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6811e1a0-4d6a-4e22-9031-c6c0bc4bf07f tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1447 microversion: 2.75 time: 0.282457 Oct 29 02:47:16.063907 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 281/546] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:15 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1447 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:16.100491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8ba98afd-29c3-436f-b815-720caff7f5c7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:16.101269 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8ba98afd-29c3-436f-b815-720caff7f5c7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: d09276cf-e95a-47be-90e8-befb018ee5ab] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:16.125784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ba98afd-29c3-436f-b815-720caff7f5c7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:16.126439 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ba98afd-29c3-436f-b815-720caff7f5c7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:16.127067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ba98afd-29c3-436f-b815-720caff7f5c7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:16.128234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ba98afd-29c3-436f-b815-720caff7f5c7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:16.128886 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ba98afd-29c3-436f-b815-720caff7f5c7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:16.129472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ba98afd-29c3-436f-b815-720caff7f5c7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:16.137905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e9b41e02-8d4c-402e-b1b4-1043bbb19d00 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:16.143896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=100 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:16.162305 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e9b41e02-8d4c-402e-b1b4-1043bbb19d00 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10" status: 200 len: 1277 microversion: 2.1 time: 0.614207 Oct 29 02:47:16.167180 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 266/547] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:15 2022] GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10 => generated 1277 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:16.177487 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9723eede-589b-44d1-8283-0880b992b902 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:16.192131 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9723eede-589b-44d1-8283-0880b992b902 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:16.223629 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9723eede-589b-44d1-8283-0880b992b902 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:16.224189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9723eede-589b-44d1-8283-0880b992b902 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:16.224661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9723eede-589b-44d1-8283-0880b992b902 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:16.234411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9723eede-589b-44d1-8283-0880b992b902 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:16.235174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9723eede-589b-44d1-8283-0880b992b902 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:16.236116 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9723eede-589b-44d1-8283-0880b992b902 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:16.424665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8ba98afd-29c3-436f-b815-720caff7f5c7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:16.437395 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8ba98afd-29c3-436f-b815-720caff7f5c7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab" status: 200 len: 1273 microversion: 2.1 time: 0.341675 Oct 29 02:47:16.438930 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 282/548] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:16 2022] GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab => generated 1273 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:47:16.588279 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d9f7c51a-008e-48b8-a841-aed8a8dd43ab tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:16.589428 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d9f7c51a-008e-48b8-a841-aed8a8dd43ab tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: aff333bb-fff4-4b3e-a3f9-a567b7786a62] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:16.602531 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d9f7c51a-008e-48b8-a841-aed8a8dd43ab tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:16.603329 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d9f7c51a-008e-48b8-a841-aed8a8dd43ab tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:16.603952 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d9f7c51a-008e-48b8-a841-aed8a8dd43ab tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:16.604905 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d9f7c51a-008e-48b8-a841-aed8a8dd43ab tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:16.617325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d9f7c51a-008e-48b8-a841-aed8a8dd43ab tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:16.617885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d9f7c51a-008e-48b8-a841-aed8a8dd43ab tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:16.694861 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9723eede-589b-44d1-8283-0880b992b902 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:16.712636 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9723eede-589b-44d1-8283-0880b992b902 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 200 len: 1325 microversion: 2.1 time: 0.537493 Oct 29 02:47:16.714577 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 267/549] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:16 2022] GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 1325 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:16.738534 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-d11e572c-7422-4663-9200-29a6772f7f9f req-6af2dc5e-15f4-45ef-9d6d-bcf2f923f31f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1cfd9d1-24b9-4d99-851e-609ece042e43", "name": "network-vif-plugged", "status": "completed", "tag": "b6508838-de98-4696-9b82-10686564ee22"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:16.762160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d11e572c-7422-4663-9200-29a6772f7f9f req-6af2dc5e-15f4-45ef-9d6d-bcf2f923f31f service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:16.762932 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d11e572c-7422-4663-9200-29a6772f7f9f req-6af2dc5e-15f4-45ef-9d6d-bcf2f923f31f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:16.763544 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d11e572c-7422-4663-9200-29a6772f7f9f req-6af2dc5e-15f4-45ef-9d6d-bcf2f923f31f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:16.790373 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-d11e572c-7422-4663-9200-29a6772f7f9f req-6af2dc5e-15f4-45ef-9d6d-bcf2f923f31f service nova] Creating event network-vif-plugged:b6508838-de98-4696-9b82-10686564ee22 for instance a1cfd9d1-24b9-4d99-851e-609ece042e43 on n-h1-862967-2 Oct 29 02:47:16.795717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d9f7c51a-008e-48b8-a841-aed8a8dd43ab tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:16.800360 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-d11e572c-7422-4663-9200-29a6772f7f9f req-6af2dc5e-15f4-45ef-9d6d-bcf2f923f31f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082771 Oct 29 02:47:16.801832 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 268/550] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:16.808835 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d9f7c51a-008e-48b8-a841-aed8a8dd43ab tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62" status: 200 len: 1317 microversion: 2.1 time: 0.225774 Oct 29 02:47:16.810434 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 283/551] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:16 2022] GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62 => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:16.822729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4f494f7e-5fce-4eac-a50d-9912189972a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:16.824836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4f494f7e-5fce-4eac-a50d-9912189972a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:16.835913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f494f7e-5fce-4eac-a50d-9912189972a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:16.838718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f494f7e-5fce-4eac-a50d-9912189972a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:16.839528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f494f7e-5fce-4eac-a50d-9912189972a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:16.840562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f494f7e-5fce-4eac-a50d-9912189972a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:16.847518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f494f7e-5fce-4eac-a50d-9912189972a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:16.848299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f494f7e-5fce-4eac-a50d-9912189972a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:17.091909 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6d7964d3-e10d-40df-a4d4-6bb4648c6644 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:17.092995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6d7964d3-e10d-40df-a4d4-6bb4648c6644 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:17.114605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d7964d3-e10d-40df-a4d4-6bb4648c6644 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:17.115162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d7964d3-e10d-40df-a4d4-6bb4648c6644 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:17.115612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d7964d3-e10d-40df-a4d4-6bb4648c6644 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:17.116366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d7964d3-e10d-40df-a4d4-6bb4648c6644 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:17.116882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d7964d3-e10d-40df-a4d4-6bb4648c6644 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:17.117315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d7964d3-e10d-40df-a4d4-6bb4648c6644 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:17.322179 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4f494f7e-5fce-4eac-a50d-9912189972a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:17.342898 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4f494f7e-5fce-4eac-a50d-9912189972a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:17.350705 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4f494f7e-5fce-4eac-a50d-9912189972a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:17.352306 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4f494f7e-5fce-4eac-a50d-9912189972a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 1558 microversion: 2.25 time: 0.548495 Oct 29 02:47:17.371382 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 269/552] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:16 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 1558 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:17.385719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0356f57f-a3b5-4a23-ac0b-112acd97ee75 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:17.392651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0356f57f-a3b5-4a23-ac0b-112acd97ee75 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: 4c912c93-9d84-4d95-8dc3-103233acff10] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:17.410216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0356f57f-a3b5-4a23-ac0b-112acd97ee75 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:17.411447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0356f57f-a3b5-4a23-ac0b-112acd97ee75 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:17.415753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0356f57f-a3b5-4a23-ac0b-112acd97ee75 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:17.418462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0356f57f-a3b5-4a23-ac0b-112acd97ee75 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:17.419790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0356f57f-a3b5-4a23-ac0b-112acd97ee75 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:17.421834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0356f57f-a3b5-4a23-ac0b-112acd97ee75 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:17.685364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6d7964d3-e10d-40df-a4d4-6bb4648c6644 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:17.703250 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6d7964d3-e10d-40df-a4d4-6bb4648c6644 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:17.709115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6d7964d3-e10d-40df-a4d4-6bb4648c6644 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:17.732354 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6d7964d3-e10d-40df-a4d4-6bb4648c6644 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1447 microversion: 2.75 time: 0.644728 Oct 29 02:47:17.735325 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 284/553] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:17 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1447 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:47:17.776224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bbc02ec3-e125-4903-9ade-ebf78be716e6 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:17.780083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bbc02ec3-e125-4903-9ade-ebf78be716e6 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:17.810346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bbc02ec3-e125-4903-9ade-ebf78be716e6 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:17.810995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bbc02ec3-e125-4903-9ade-ebf78be716e6 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:17.811445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bbc02ec3-e125-4903-9ade-ebf78be716e6 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:17.819992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bbc02ec3-e125-4903-9ade-ebf78be716e6 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:17.823779 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bbc02ec3-e125-4903-9ade-ebf78be716e6 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:17.825988 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bbc02ec3-e125-4903-9ade-ebf78be716e6 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:17.870508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0356f57f-a3b5-4a23-ac0b-112acd97ee75 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:17.888684 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0356f57f-a3b5-4a23-ac0b-112acd97ee75 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10" status: 200 len: 1277 microversion: 2.1 time: 0.510074 Oct 29 02:47:17.900760 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 270/554] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:17 2022] GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10 => generated 1277 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:17.908232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ea7a68b3-0829-49b9-9111-a80c9bc300eb tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:17.917181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ea7a68b3-0829-49b9-9111-a80c9bc300eb tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: d09276cf-e95a-47be-90e8-befb018ee5ab] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:17.939927 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea7a68b3-0829-49b9-9111-a80c9bc300eb tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:17.940806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea7a68b3-0829-49b9-9111-a80c9bc300eb tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:17.941708 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea7a68b3-0829-49b9-9111-a80c9bc300eb tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:17.946165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea7a68b3-0829-49b9-9111-a80c9bc300eb tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:17.946806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea7a68b3-0829-49b9-9111-a80c9bc300eb tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:17.947269 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea7a68b3-0829-49b9-9111-a80c9bc300eb tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:18.419847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ea7a68b3-0829-49b9-9111-a80c9bc300eb tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:18.439338 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ea7a68b3-0829-49b9-9111-a80c9bc300eb tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab" status: 200 len: 1315 microversion: 2.1 time: 0.537116 Oct 29 02:47:18.444578 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 271/555] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:17 2022] GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:18.445135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e6d9a43d-c88b-4e1e-a426-6f70e9e1022f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:18.445747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e6d9a43d-c88b-4e1e-a426-6f70e9e1022f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:18.454446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6d9a43d-c88b-4e1e-a426-6f70e9e1022f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:18.454941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6d9a43d-c88b-4e1e-a426-6f70e9e1022f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:18.455372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6d9a43d-c88b-4e1e-a426-6f70e9e1022f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:18.456067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6d9a43d-c88b-4e1e-a426-6f70e9e1022f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:18.461255 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6d9a43d-c88b-4e1e-a426-6f70e9e1022f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:18.461972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6d9a43d-c88b-4e1e-a426-6f70e9e1022f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:18.740291 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e6d9a43d-c88b-4e1e-a426-6f70e9e1022f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:18.760369 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e6d9a43d-c88b-4e1e-a426-6f70e9e1022f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 200 len: 1325 microversion: 2.1 time: 0.318898 Oct 29 02:47:18.761742 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 272/556] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:18 2022] GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 1325 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:18.767013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5fd1aaee-f21c-4466-becf-5f5453fc02d3 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:18.768002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5fd1aaee-f21c-4466-becf-5f5453fc02d3 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: aff333bb-fff4-4b3e-a3f9-a567b7786a62] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:18.776725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fd1aaee-f21c-4466-becf-5f5453fc02d3 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:18.778050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fd1aaee-f21c-4466-becf-5f5453fc02d3 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:18.778906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fd1aaee-f21c-4466-becf-5f5453fc02d3 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:18.781331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fd1aaee-f21c-4466-becf-5f5453fc02d3 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:18.782769 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fd1aaee-f21c-4466-becf-5f5453fc02d3 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:18.783446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fd1aaee-f21c-4466-becf-5f5453fc02d3 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:18.874697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5fd1aaee-f21c-4466-becf-5f5453fc02d3 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:18.887825 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5fd1aaee-f21c-4466-becf-5f5453fc02d3 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62" status: 200 len: 1323 microversion: 2.1 time: 0.124038 Oct 29 02:47:18.888875 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 273/557] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:18 2022] GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62 => generated 1323 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:18.896201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3577038c-bb26-45b7-aed1-d3854ce1b320 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:18.897371 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3577038c-bb26-45b7-aed1-d3854ce1b320 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:18.907214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3577038c-bb26-45b7-aed1-d3854ce1b320 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:18.907965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3577038c-bb26-45b7-aed1-d3854ce1b320 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:18.908718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3577038c-bb26-45b7-aed1-d3854ce1b320 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:18.912039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3577038c-bb26-45b7-aed1-d3854ce1b320 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:18.913589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3577038c-bb26-45b7-aed1-d3854ce1b320 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:18.914303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3577038c-bb26-45b7-aed1-d3854ce1b320 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:18.916181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-bbc02ec3-e125-4903-9ade-ebf78be716e6 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lazy-loading 'services' on Instance uuid 0a0ec4a8-4cf9-4596-bc31-797c86447aa0 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:18.955217 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bbc02ec3-e125-4903-9ade-ebf78be716e6 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 2051 microversion: 2.25 time: 1.214468 Oct 29 02:47:18.956130 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 285/558] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:17 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 2051 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:18.968676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-58a28917-4868-4fb5-b89a-167f4fb35120 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:18.969480 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-58a28917-4868-4fb5-b89a-167f4fb35120 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: 4c912c93-9d84-4d95-8dc3-103233acff10] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:18.979801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58a28917-4868-4fb5-b89a-167f4fb35120 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:18.980569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58a28917-4868-4fb5-b89a-167f4fb35120 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:18.982208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58a28917-4868-4fb5-b89a-167f4fb35120 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:18.982954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58a28917-4868-4fb5-b89a-167f4fb35120 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:18.983453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58a28917-4868-4fb5-b89a-167f4fb35120 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:18.984572 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58a28917-4868-4fb5-b89a-167f4fb35120 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:19.035376 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3577038c-bb26-45b7-aed1-d3854ce1b320 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:19.060021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3577038c-bb26-45b7-aed1-d3854ce1b320 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:19.061683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3577038c-bb26-45b7-aed1-d3854ce1b320 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:19.072254 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3577038c-bb26-45b7-aed1-d3854ce1b320 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1453 microversion: 2.75 time: 0.180848 Oct 29 02:47:19.076225 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 274/559] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:18 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1453 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:19.088511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f2b82c1e-9dff-44d4-a5b1-d7cf5e411648 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:19.089940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f2b82c1e-9dff-44d4-a5b1-d7cf5e411648 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:19.097889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2b82c1e-9dff-44d4-a5b1-d7cf5e411648 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:19.098558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2b82c1e-9dff-44d4-a5b1-d7cf5e411648 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:19.099334 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2b82c1e-9dff-44d4-a5b1-d7cf5e411648 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:19.100043 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2b82c1e-9dff-44d4-a5b1-d7cf5e411648 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:19.100492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2b82c1e-9dff-44d4-a5b1-d7cf5e411648 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:19.100936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2b82c1e-9dff-44d4-a5b1-d7cf5e411648 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:19.248634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-f2b82c1e-9dff-44d4-a5b1-d7cf5e411648 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lazy-loading 'services' on Instance uuid 0a0ec4a8-4cf9-4596-bc31-797c86447aa0 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:19.264189 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f2b82c1e-9dff-44d4-a5b1-d7cf5e411648 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 2051 microversion: 2.25 time: 0.185822 Oct 29 02:47:19.265014 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 275/560] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:19 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 2051 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:19.289741 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1491c555-f19e-4e35-b189-ff940ba6db2e tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:19.293447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1491c555-f19e-4e35-b189-ff940ba6db2e tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:19.294078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1491c555-f19e-4e35-b189-ff940ba6db2e tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:19.294547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1491c555-f19e-4e35-b189-ff940ba6db2e tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:19.295318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1491c555-f19e-4e35-b189-ff940ba6db2e tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:19.295718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1491c555-f19e-4e35-b189-ff940ba6db2e tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:19.296128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1491c555-f19e-4e35-b189-ff940ba6db2e tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:19.313836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:19.326856 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1491c555-f19e-4e35-b189-ff940ba6db2e tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.041684 Oct 29 02:47:19.346569 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 276/561] 10.222.0.46 () {60 vars in 1217 bytes} [Sat Oct 29 02:47:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:47:19.351868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-377ca1d1-d2e2-40a5-b93b-4ca74fd96c0a tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:19.352401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-377ca1d1-d2e2-40a5-b93b-4ca74fd96c0a tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:19.373127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-377ca1d1-d2e2-40a5-b93b-4ca74fd96c0a tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:19.373586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-377ca1d1-d2e2-40a5-b93b-4ca74fd96c0a tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:19.374053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-377ca1d1-d2e2-40a5-b93b-4ca74fd96c0a tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:19.374898 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-377ca1d1-d2e2-40a5-b93b-4ca74fd96c0a tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:19.375346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-377ca1d1-d2e2-40a5-b93b-4ca74fd96c0a tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:19.375774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-377ca1d1-d2e2-40a5-b93b-4ca74fd96c0a tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:19.413030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-58a28917-4868-4fb5-b89a-167f4fb35120 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:19.425899 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-58a28917-4868-4fb5-b89a-167f4fb35120 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10" status: 200 len: 1277 microversion: 2.1 time: 0.468024 Oct 29 02:47:19.444233 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 286/562] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:18 2022] GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10 => generated 1277 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:19.468735 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fd0b7c54-febd-4f1e-bb26-028fdd35814e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:19.469350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fd0b7c54-febd-4f1e-bb26-028fdd35814e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: d09276cf-e95a-47be-90e8-befb018ee5ab] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:19.479508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd0b7c54-febd-4f1e-bb26-028fdd35814e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:19.479994 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd0b7c54-febd-4f1e-bb26-028fdd35814e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:19.480423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd0b7c54-febd-4f1e-bb26-028fdd35814e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:19.481157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd0b7c54-febd-4f1e-bb26-028fdd35814e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:19.485803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd0b7c54-febd-4f1e-bb26-028fdd35814e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:19.486534 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd0b7c54-febd-4f1e-bb26-028fdd35814e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:19.540187 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-377ca1d1-d2e2-40a5-b93b-4ca74fd96c0a tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0/action" status: 202 len: 0 microversion: 2.25 time: 0.185031 Oct 29 02:47:19.550420 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 277/563] 10.222.0.46 () {62 vars in 1319 bytes} [Sat Oct 29 02:47:19 2022] POST /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:47:19.561624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3a8a8a96-44b3-4edd-9b0f-0c3f2dfc51c5 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:19.562735 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3a8a8a96-44b3-4edd-9b0f-0c3f2dfc51c5 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:19.570787 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a8a8a96-44b3-4edd-9b0f-0c3f2dfc51c5 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:19.571653 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a8a8a96-44b3-4edd-9b0f-0c3f2dfc51c5 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:19.572294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a8a8a96-44b3-4edd-9b0f-0c3f2dfc51c5 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:19.573240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a8a8a96-44b3-4edd-9b0f-0c3f2dfc51c5 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:19.574601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a8a8a96-44b3-4edd-9b0f-0c3f2dfc51c5 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:19.575254 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a8a8a96-44b3-4edd-9b0f-0c3f2dfc51c5 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:20.017877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-3a8a8a96-44b3-4edd-9b0f-0c3f2dfc51c5 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lazy-loading 'services' on Instance uuid 0a0ec4a8-4cf9-4596-bc31-797c86447aa0 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:20.049005 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3a8a8a96-44b3-4edd-9b0f-0c3f2dfc51c5 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 2056 microversion: 2.25 time: 0.496317 Oct 29 02:47:20.049863 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 278/564] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:19 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 2056 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:20.074774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a2dc04a9-d3c5-4546-b78c-73733a3052cf tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:20.075646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a2dc04a9-d3c5-4546-b78c-73733a3052cf tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:20.091417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2dc04a9-d3c5-4546-b78c-73733a3052cf tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:20.097413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2dc04a9-d3c5-4546-b78c-73733a3052cf tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:20.098198 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2dc04a9-d3c5-4546-b78c-73733a3052cf tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:20.099208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2dc04a9-d3c5-4546-b78c-73733a3052cf tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:20.101338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2dc04a9-d3c5-4546-b78c-73733a3052cf tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:20.102343 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2dc04a9-d3c5-4546-b78c-73733a3052cf tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:20.556073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fd0b7c54-febd-4f1e-bb26-028fdd35814e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:20.565393 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fd0b7c54-febd-4f1e-bb26-028fdd35814e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab" status: 200 len: 1315 microversion: 2.1 time: 1.101479 Oct 29 02:47:20.566575 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 287/565] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:19 2022] GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab => generated 1315 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:47:20.572933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f60538dd-359b-4147-8b3c-aa283cb7b134 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:20.573719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f60538dd-359b-4147-8b3c-aa283cb7b134 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: aff333bb-fff4-4b3e-a3f9-a567b7786a62] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:20.580749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f60538dd-359b-4147-8b3c-aa283cb7b134 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:20.581480 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f60538dd-359b-4147-8b3c-aa283cb7b134 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:20.582060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f60538dd-359b-4147-8b3c-aa283cb7b134 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:20.582931 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f60538dd-359b-4147-8b3c-aa283cb7b134 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:20.583578 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f60538dd-359b-4147-8b3c-aa283cb7b134 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:20.584152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f60538dd-359b-4147-8b3c-aa283cb7b134 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:20.833814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a2dc04a9-d3c5-4546-b78c-73733a3052cf tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:20.846642 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a2dc04a9-d3c5-4546-b78c-73733a3052cf tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 200 len: 1325 microversion: 2.1 time: 0.795205 Oct 29 02:47:20.859731 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 279/566] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:20 2022] GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 1325 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:20.876286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d655951a-2ec5-4bf6-a0d0-163d9faa484f tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:20.877292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d655951a-2ec5-4bf6-a0d0-163d9faa484f tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:20.887019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d655951a-2ec5-4bf6-a0d0-163d9faa484f tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:20.888015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d655951a-2ec5-4bf6-a0d0-163d9faa484f tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:20.888783 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d655951a-2ec5-4bf6-a0d0-163d9faa484f tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:20.890227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d655951a-2ec5-4bf6-a0d0-163d9faa484f tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:20.892426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d655951a-2ec5-4bf6-a0d0-163d9faa484f tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:20.909521 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d655951a-2ec5-4bf6-a0d0-163d9faa484f tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:20.922107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f60538dd-359b-4147-8b3c-aa283cb7b134 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:20.945758 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f60538dd-359b-4147-8b3c-aa283cb7b134 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62" status: 200 len: 1323 microversion: 2.1 time: 0.369671 Oct 29 02:47:20.951196 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 288/567] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:20 2022] GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62 => generated 1323 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:20.969264 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a9d74ef6-56c8-4844-ba12-59ff5abf8c3f tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:20.969894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a9d74ef6-56c8-4844-ba12-59ff5abf8c3f tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: 4c912c93-9d84-4d95-8dc3-103233acff10] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:20.994964 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9d74ef6-56c8-4844-ba12-59ff5abf8c3f tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:20.995458 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9d74ef6-56c8-4844-ba12-59ff5abf8c3f tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:21.001239 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9d74ef6-56c8-4844-ba12-59ff5abf8c3f tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:21.002708 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9d74ef6-56c8-4844-ba12-59ff5abf8c3f tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:21.003216 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9d74ef6-56c8-4844-ba12-59ff5abf8c3f tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:21.003641 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9d74ef6-56c8-4844-ba12-59ff5abf8c3f tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:21.187387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d655951a-2ec5-4bf6-a0d0-163d9faa484f tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:21.204395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d655951a-2ec5-4bf6-a0d0-163d9faa484f tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:21.219534 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d655951a-2ec5-4bf6-a0d0-163d9faa484f tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:21.226089 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d655951a-2ec5-4bf6-a0d0-163d9faa484f tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1453 microversion: 2.75 time: 0.364744 Oct 29 02:47:21.226680 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 280/568] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:20 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1453 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:21.241513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-466e2d50-fbf3-49f4-aa67-1c9a78836777 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:21.242731 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-466e2d50-fbf3-49f4-aa67-1c9a78836777 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:21.252635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-466e2d50-fbf3-49f4-aa67-1c9a78836777 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:21.253139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-466e2d50-fbf3-49f4-aa67-1c9a78836777 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:21.253755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-466e2d50-fbf3-49f4-aa67-1c9a78836777 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:21.254882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-466e2d50-fbf3-49f4-aa67-1c9a78836777 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:21.255401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-466e2d50-fbf3-49f4-aa67-1c9a78836777 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:21.255906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-466e2d50-fbf3-49f4-aa67-1c9a78836777 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:22.066118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a9d74ef6-56c8-4844-ba12-59ff5abf8c3f tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:22.074393 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a9d74ef6-56c8-4844-ba12-59ff5abf8c3f tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10" status: 200 len: 1319 microversion: 2.1 time: 1.121850 Oct 29 02:47:22.077945 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 289/569] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:20 2022] GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10 => generated 1319 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:22.089186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-466e2d50-fbf3-49f4-aa67-1c9a78836777 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lazy-loading 'services' on Instance uuid 0a0ec4a8-4cf9-4596-bc31-797c86447aa0 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:22.089838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-472d856b-5d28-408f-87e2-076330afc80c req-e723cd94-cee7-404c-9ecd-ec8e49c76200 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d09276cf-e95a-47be-90e8-befb018ee5ab", "tag": "f141616b-7c4f-401f-aa06-bf21863f5f3d"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:22.110248 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-466e2d50-fbf3-49f4-aa67-1c9a78836777 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 2036 microversion: 2.25 time: 0.882151 Oct 29 02:47:22.111689 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 281/570] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:21 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 2036 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:22.117413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b378bc0e-df29-47b4-9002-b0ea78a2a24f tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:22.118232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b378bc0e-df29-47b4-9002-b0ea78a2a24f tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: d09276cf-e95a-47be-90e8-befb018ee5ab] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:22.124756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b378bc0e-df29-47b4-9002-b0ea78a2a24f tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:22.126058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b378bc0e-df29-47b4-9002-b0ea78a2a24f tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:22.126647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b378bc0e-df29-47b4-9002-b0ea78a2a24f tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:22.127582 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b378bc0e-df29-47b4-9002-b0ea78a2a24f tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:22.138559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b378bc0e-df29-47b4-9002-b0ea78a2a24f tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:22.139257 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b378bc0e-df29-47b4-9002-b0ea78a2a24f tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:22.140400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-472d856b-5d28-408f-87e2-076330afc80c req-e723cd94-cee7-404c-9ecd-ec8e49c76200 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:22.145391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-472d856b-5d28-408f-87e2-076330afc80c req-e723cd94-cee7-404c-9ecd-ec8e49c76200 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:22.147183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-472d856b-5d28-408f-87e2-076330afc80c req-e723cd94-cee7-404c-9ecd-ec8e49c76200 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:22.170442 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-472d856b-5d28-408f-87e2-076330afc80c req-e723cd94-cee7-404c-9ecd-ec8e49c76200 service nova] Creating event network-changed:f141616b-7c4f-401f-aa06-bf21863f5f3d for instance d09276cf-e95a-47be-90e8-befb018ee5ab on n-h2-862967-2 Oct 29 02:47:22.181432 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-472d856b-5d28-408f-87e2-076330afc80c req-e723cd94-cee7-404c-9ecd-ec8e49c76200 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100011 Oct 29 02:47:22.182584 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 290/571] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:22.187896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0a498072-a0de-4445-bd9a-0c69bbf5e0c2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:22.188899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0a498072-a0de-4445-bd9a-0c69bbf5e0c2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:22.196308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a498072-a0de-4445-bd9a-0c69bbf5e0c2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:22.197019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a498072-a0de-4445-bd9a-0c69bbf5e0c2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:22.197657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a498072-a0de-4445-bd9a-0c69bbf5e0c2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:22.198530 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a498072-a0de-4445-bd9a-0c69bbf5e0c2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:22.199132 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a498072-a0de-4445-bd9a-0c69bbf5e0c2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:22.199723 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a498072-a0de-4445-bd9a-0c69bbf5e0c2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:22.686657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0a498072-a0de-4445-bd9a-0c69bbf5e0c2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:22.696281 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0a498072-a0de-4445-bd9a-0c69bbf5e0c2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 200 len: 1521 microversion: 2.1 time: 0.512261 Oct 29 02:47:22.697841 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 291/572] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:22 2022] GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 1521 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:22.703178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b378bc0e-df29-47b4-9002-b0ea78a2a24f tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:22.705507 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:22.716039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2fc4d483-c0b6-42da-b3ff-62f27b7f0129 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:22.716688 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2fc4d483-c0b6-42da-b3ff-62f27b7f0129 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: aff333bb-fff4-4b3e-a3f9-a567b7786a62] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:22.721366 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b378bc0e-df29-47b4-9002-b0ea78a2a24f tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab" status: 200 len: 1315 microversion: 2.1 time: 0.607621 Oct 29 02:47:22.731858 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 282/573] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:22 2022] GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab => generated 1315 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:22.732032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fc4d483-c0b6-42da-b3ff-62f27b7f0129 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:22.732032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fc4d483-c0b6-42da-b3ff-62f27b7f0129 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:22.732032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fc4d483-c0b6-42da-b3ff-62f27b7f0129 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:22.732032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fc4d483-c0b6-42da-b3ff-62f27b7f0129 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:22.732366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fc4d483-c0b6-42da-b3ff-62f27b7f0129 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:22.732366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fc4d483-c0b6-42da-b3ff-62f27b7f0129 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:22.738108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3843093c-c609-481f-a321-1d7b9a28f8e7 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-862967-2", "block_migration": "auto"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:22.742159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3843093c-c609-481f-a321-1d7b9a28f8e7 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:22.751718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3843093c-c609-481f-a321-1d7b9a28f8e7 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:22.752416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3843093c-c609-481f-a321-1d7b9a28f8e7 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:22.753060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3843093c-c609-481f-a321-1d7b9a28f8e7 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:22.753870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3843093c-c609-481f-a321-1d7b9a28f8e7 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:22.754461 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3843093c-c609-481f-a321-1d7b9a28f8e7 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:22.754901 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3843093c-c609-481f-a321-1d7b9a28f8e7 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:22.878691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-3843093c-c609-481f-a321-1d7b9a28f8e7 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lazy-loading 'flavor' on Instance uuid 0a0ec4a8-4cf9-4596-bc31-797c86447aa0 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:22.896057 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3843093c-c609-481f-a321-1d7b9a28f8e7 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Going to try to live migrate instance to n-h1-862967-2 {{(pid=127124) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 02:47:23.781197 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2fc4d483-c0b6-42da-b3ff-62f27b7f0129 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:23.789987 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2fc4d483-c0b6-42da-b3ff-62f27b7f0129 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62" status: 200 len: 1390 microversion: 2.1 time: 1.089493 Oct 29 02:47:23.790586 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 292/574] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:22 2022] GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62 => generated 1390 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:23.795197 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9b33cd7e-c27d-42d2-b5de-c38d461d9388 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:23.795844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9b33cd7e-c27d-42d2-b5de-c38d461d9388 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:23.803308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b33cd7e-c27d-42d2-b5de-c38d461d9388 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:23.804026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b33cd7e-c27d-42d2-b5de-c38d461d9388 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:23.804718 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b33cd7e-c27d-42d2-b5de-c38d461d9388 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:23.805608 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b33cd7e-c27d-42d2-b5de-c38d461d9388 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:23.806246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b33cd7e-c27d-42d2-b5de-c38d461d9388 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:23.806857 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b33cd7e-c27d-42d2-b5de-c38d461d9388 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:23.951184 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9b33cd7e-c27d-42d2-b5de-c38d461d9388 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:23.960047 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9b33cd7e-c27d-42d2-b5de-c38d461d9388 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:23.961542 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9b33cd7e-c27d-42d2-b5de-c38d461d9388 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:23.967001 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9b33cd7e-c27d-42d2-b5de-c38d461d9388 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1438 microversion: 2.75 time: 0.175427 Oct 29 02:47:23.967796 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 293/575] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:23 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1438 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:23.972653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e573c35c-3cb7-4169-a4c7-9607ba765b59 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:23.973267 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e573c35c-3cb7-4169-a4c7-9607ba765b59 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:23.979381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e573c35c-3cb7-4169-a4c7-9607ba765b59 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:23.979875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e573c35c-3cb7-4169-a4c7-9607ba765b59 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:23.980548 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e573c35c-3cb7-4169-a4c7-9607ba765b59 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:23.981284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e573c35c-3cb7-4169-a4c7-9607ba765b59 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:23.982301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e573c35c-3cb7-4169-a4c7-9607ba765b59 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:23.982749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e573c35c-3cb7-4169-a4c7-9607ba765b59 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:24.197631 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:24.218671 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=11 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:24.629317 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e573c35c-3cb7-4169-a4c7-9607ba765b59 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:24.639772 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e573c35c-3cb7-4169-a4c7-9607ba765b59 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 200 len: 1521 microversion: 2.1 time: 0.670719 Oct 29 02:47:24.640630 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 294/576] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:23 2022] GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 1521 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:24.645318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-19f30c7d-8bd8-43ad-a91e-863d1e457678 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:24.645920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-19f30c7d-8bd8-43ad-a91e-863d1e457678 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: 4c912c93-9d84-4d95-8dc3-103233acff10] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:24.655703 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19f30c7d-8bd8-43ad-a91e-863d1e457678 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:24.656184 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19f30c7d-8bd8-43ad-a91e-863d1e457678 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:24.656655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19f30c7d-8bd8-43ad-a91e-863d1e457678 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:24.657657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19f30c7d-8bd8-43ad-a91e-863d1e457678 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:24.658412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19f30c7d-8bd8-43ad-a91e-863d1e457678 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:24.659137 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19f30c7d-8bd8-43ad-a91e-863d1e457678 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:25.152477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-19f30c7d-8bd8-43ad-a91e-863d1e457678 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:25.159859 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:25.164295 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-19f30c7d-8bd8-43ad-a91e-863d1e457678 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10" status: 200 len: 1319 microversion: 2.1 time: 0.522381 Oct 29 02:47:25.164742 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 295/577] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:24 2022] GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10 => generated 1319 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:25.170240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b9d95fe7-9186-4c2f-9d4e-12c172d33630 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:25.171297 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b9d95fe7-9186-4c2f-9d4e-12c172d33630 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: d09276cf-e95a-47be-90e8-befb018ee5ab] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:25.178007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9d95fe7-9186-4c2f-9d4e-12c172d33630 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:25.178759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9d95fe7-9186-4c2f-9d4e-12c172d33630 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:25.179371 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9d95fe7-9186-4c2f-9d4e-12c172d33630 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:25.180262 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9d95fe7-9186-4c2f-9d4e-12c172d33630 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:25.180981 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9d95fe7-9186-4c2f-9d4e-12c172d33630 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:25.181682 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9d95fe7-9186-4c2f-9d4e-12c172d33630 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:25.522099 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=10 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:25.543863 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3843093c-c609-481f-a321-1d7b9a28f8e7 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0/action" status: 202 len: 0 microversion: 2.25 time: 2.820373 Oct 29 02:47:25.544684 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 283/578] 10.222.0.46 () {62 vars in 1319 bytes} [Sat Oct 29 02:47:22 2022] POST /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0/action => generated 0 bytes in 2822 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:47:25.754901 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6d7d4196-76ad-41f2-bf57-8a4892832c4f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:25.758269 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6d7d4196-76ad-41f2-bf57-8a4892832c4f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:25.765317 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d7d4196-76ad-41f2-bf57-8a4892832c4f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:25.765778 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d7d4196-76ad-41f2-bf57-8a4892832c4f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:25.766407 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d7d4196-76ad-41f2-bf57-8a4892832c4f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:25.767292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d7d4196-76ad-41f2-bf57-8a4892832c4f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:25.767764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d7d4196-76ad-41f2-bf57-8a4892832c4f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:25.768160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d7d4196-76ad-41f2-bf57-8a4892832c4f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:25.856631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-6d7d4196-76ad-41f2-bf57-8a4892832c4f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:47:25.857637 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-6d7d4196-76ad-41f2-bf57-8a4892832c4f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:47:25.858353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-6d7d4196-76ad-41f2-bf57-8a4892832c4f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:47:25.858998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-6d7d4196-76ad-41f2-bf57-8a4892832c4f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:47:25.859631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-6d7d4196-76ad-41f2-bf57-8a4892832c4f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:47:25.889741 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b9d95fe7-9186-4c2f-9d4e-12c172d33630 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:25.903642 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b9d95fe7-9186-4c2f-9d4e-12c172d33630 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab" status: 200 len: 1315 microversion: 2.1 time: 0.737539 Oct 29 02:47:25.916711 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 296/579] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:25 2022] GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab => generated 1315 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:25.925997 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-1d5fb39b-b23d-480d-ad70-a54e11c2e906 req-170d4347-4a1f-4ce8-bcfe-c5b31ef67cbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03261ebe-4be4-4e74-bd8d-ff4a5ae066b1", "tag": "6c5bf628-34cf-4bf8-9ee2-dc88993acfd7"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:25.940995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-1d5fb39b-b23d-480d-ad70-a54e11c2e906 req-170d4347-4a1f-4ce8-bcfe-c5b31ef67cbd service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:25.941887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-1d5fb39b-b23d-480d-ad70-a54e11c2e906 req-170d4347-4a1f-4ce8-bcfe-c5b31ef67cbd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:25.942605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-1d5fb39b-b23d-480d-ad70-a54e11c2e906 req-170d4347-4a1f-4ce8-bcfe-c5b31ef67cbd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:25.944471 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6d7d4196-76ad-41f2-bf57-8a4892832c4f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:25.956366 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-1d5fb39b-b23d-480d-ad70-a54e11c2e906 req-170d4347-4a1f-4ce8-bcfe-c5b31ef67cbd service nova] Creating event network-changed:6c5bf628-34cf-4bf8-9ee2-dc88993acfd7 for instance 03261ebe-4be4-4e74-bd8d-ff4a5ae066b1 on n-h1-862967-2 Oct 29 02:47:25.959663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d7d4196-76ad-41f2-bf57-8a4892832c4f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:25.962526 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d7d4196-76ad-41f2-bf57-8a4892832c4f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:25.963050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d7d4196-76ad-41f2-bf57-8a4892832c4f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:25.963870 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-1d5fb39b-b23d-480d-ad70-a54e11c2e906 req-170d4347-4a1f-4ce8-bcfe-c5b31ef67cbd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050250 Oct 29 02:47:25.964990 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 297/580] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:25.965620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d7d4196-76ad-41f2-bf57-8a4892832c4f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:25.966276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d7d4196-76ad-41f2-bf57-8a4892832c4f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:25.970079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d7d4196-76ad-41f2-bf57-8a4892832c4f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:25.972602 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-29e0af10-c392-45a0-807d-71a51937d349 req-21a233ed-08f6-44bb-ba91-b86ae333d34f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c912c93-9d84-4d95-8dc3-103233acff10", "tag": "61e4fdfe-2003-4ace-8ee7-d890adeedffa"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:26.009571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-29e0af10-c392-45a0-807d-71a51937d349 req-21a233ed-08f6-44bb-ba91-b86ae333d34f service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:26.011040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-29e0af10-c392-45a0-807d-71a51937d349 req-21a233ed-08f6-44bb-ba91-b86ae333d34f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:26.013131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-29e0af10-c392-45a0-807d-71a51937d349 req-21a233ed-08f6-44bb-ba91-b86ae333d34f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:26.035346 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-29e0af10-c392-45a0-807d-71a51937d349 req-21a233ed-08f6-44bb-ba91-b86ae333d34f service nova] Creating event network-changed:61e4fdfe-2003-4ace-8ee7-d890adeedffa for instance 4c912c93-9d84-4d95-8dc3-103233acff10 on n-h1-862967-2 Oct 29 02:47:26.042667 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-29e0af10-c392-45a0-807d-71a51937d349 req-21a233ed-08f6-44bb-ba91-b86ae333d34f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075050 Oct 29 02:47:26.044117 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 298/581] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:26.061746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d6613c31-eb12-4422-8956-4cba1ff83176 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1174375202", "metadata": {"": ""}}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:26.103479 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d6613c31-eb12-4422-8956-4cba1ff83176 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Request method failure captured: Oct 29 02:47:26.103479 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43/action HTTP/1.1 Oct 29 02:47:26.103479 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:47:26.103479 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:47:26.103479 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:47:26.103479 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 107 Oct 29 02:47:26.103479 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:47:26.103479 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:47:26.103479 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:47:26.103479 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:47:26.103479 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJQe_uEcQU7TWvWTWyYHk2tBfhyW3anQlq9IlbMuIEkf7vn933sPmCKARJnxQpZiUZK1LvxWi4oqgPbQrdfUsgmfgxV95FnHLrMyZSrDr2oYF-e8DjjcOj7SOyLBpFsBspJHWMF4bxtFDAQHeniPMEGa1F2s-2gEJ_CIW5xBvV79ZDc Oct 29 02:47:26.103479 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:47:26.103479 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:47:26.103479 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:47:26.103479 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:47:26.103479 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:47:26.103479 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:47:26.103479 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 94814dc564d04e688714ac064c7d1b3b Oct 29 02:47:26.103479 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:47:26.103479 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:47:26.103479 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:47:26.105954 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/94814dc564d04e688714ac064c7d1b3b"}]}] Oct 29 02:47:26.105954 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:47:26.105954 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 94814dc564d04e688714ac064c7d1b3b Oct 29 02:47:26.105954 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:47:26.105954 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ImagesOneServerNegativeTestJSON-13999867-project Oct 29 02:47:26.105954 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:47:26.105954 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:47:26.105954 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 6862cd2470624f01a8bc1d371aa03962 Oct 29 02:47:26.105954 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-13999867-project Oct 29 02:47:26.105954 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:47:26.105954 n-d-862967-2 devstack@n-api.service[127125]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1174375202", "metadata": {"": ""}}} Oct 29 02:47:26.105954 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:47:26.107203 n-d-862967-2 devstack@n-api.service[127125]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:47:26.107203 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'a1cfd9d1-24b9-4d99-851e-609ece042e43', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1174375202', 'metadata': {'': ''}}}} Oct 29 02:47:26.107203 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:47:26.107203 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:47:26.107203 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:47:26.107203 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:47:26.107203 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:47:26.107203 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:47:26.107203 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:47:26.107203 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:47:26.107203 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 29 02:47:26.107203 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 02:47:26.107203 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 02:47:26.107203 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 29 02:47:26.107203 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 02:47:26.107203 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:47:26.107203 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 29 02:47:26.107203 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi {'': ''} Oct 29 02:47:26.107203 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:47:26.107203 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:47:26.107203 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:47:26.111023 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:47:26.111023 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:47:26.111023 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:47:26.111023 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:47:26.111023 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:47:26.111023 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:47:26.111023 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:47:26.111023 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:47:26.111023 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:47:26.111023 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:47:26.111023 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:47:26.111023 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:47:26.111023 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:47:26.111023 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:47:26.111023 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:47:26.111023 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:47:26.111023 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:47:26.111023 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:47:26.111023 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:47:26.111023 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:47:26.117558 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:47:26.117558 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:47:26.117558 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:47:26.117558 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:47:26.117558 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:47:26.117558 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:47:26.120721 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d6613c31-eb12-4422-8956-4cba1ff83176 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:47:26.124739 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d6613c31-eb12-4422-8956-4cba1ff83176 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "POST /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43/action" status: 400 len: 170 microversion: 2.1 time: 0.079099 Oct 29 02:47:26.136829 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 299/582] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Oct 29 02:47:26 2022] POST /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43/action => generated 170 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:47:26.143932 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5d6950f4-4146-4b5e-8e96-a6baf9065a87 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:26.144886 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5d6950f4-4146-4b5e-8e96-a6baf9065a87 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: aff333bb-fff4-4b3e-a3f9-a567b7786a62] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:26.153779 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d6950f4-4146-4b5e-8e96-a6baf9065a87 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:26.155823 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d6950f4-4146-4b5e-8e96-a6baf9065a87 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:26.156461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d6950f4-4146-4b5e-8e96-a6baf9065a87 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:26.157395 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d6950f4-4146-4b5e-8e96-a6baf9065a87 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:26.158002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d6950f4-4146-4b5e-8e96-a6baf9065a87 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:26.158598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d6950f4-4146-4b5e-8e96-a6baf9065a87 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:26.344138 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-6d7d4196-76ad-41f2-bf57-8a4892832c4f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lazy-loading 'services' on Instance uuid 0766d417-a358-4ad6-9af4-75f7d61f82eb {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:26.435839 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6d7d4196-76ad-41f2-bf57-8a4892832c4f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb/action" status: 202 len: 1942 microversion: 2.75 time: 0.889745 Oct 29 02:47:26.443319 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 284/583] 10.222.0.46 () {62 vars in 1319 bytes} [Sat Oct 29 02:47:25 2022] POST /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb/action => generated 1942 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 29 02:47:26.454390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-61915f54-790f-41af-8358-392d206f8d50 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:26.458416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-61915f54-790f-41af-8358-392d206f8d50 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:26.510621 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-61915f54-790f-41af-8358-392d206f8d50 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:26.511542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-61915f54-790f-41af-8358-392d206f8d50 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:26.512022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-61915f54-790f-41af-8358-392d206f8d50 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:26.513172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-61915f54-790f-41af-8358-392d206f8d50 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:26.513628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-61915f54-790f-41af-8358-392d206f8d50 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:26.515301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-61915f54-790f-41af-8358-392d206f8d50 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:26.730205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-61915f54-790f-41af-8358-392d206f8d50 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:26.749938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-61915f54-790f-41af-8358-392d206f8d50 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:26.754826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-61915f54-790f-41af-8358-392d206f8d50 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:26.759189 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-61915f54-790f-41af-8358-392d206f8d50 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 1568 microversion: 2.25 time: 0.314748 Oct 29 02:47:26.760064 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 285/584] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:26 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 1568 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:26.772646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f2ae70b1-c745-48be-87e7-86fc9ed2f4d7 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:26.773691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f2ae70b1-c745-48be-87e7-86fc9ed2f4d7 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:26.786149 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2ae70b1-c745-48be-87e7-86fc9ed2f4d7 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:26.787084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2ae70b1-c745-48be-87e7-86fc9ed2f4d7 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:26.787772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2ae70b1-c745-48be-87e7-86fc9ed2f4d7 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:26.788900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2ae70b1-c745-48be-87e7-86fc9ed2f4d7 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:26.789564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2ae70b1-c745-48be-87e7-86fc9ed2f4d7 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:26.790260 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2ae70b1-c745-48be-87e7-86fc9ed2f4d7 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:26.850199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5d6950f4-4146-4b5e-8e96-a6baf9065a87 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:26.861556 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5d6950f4-4146-4b5e-8e96-a6baf9065a87 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62" status: 200 len: 1390 microversion: 2.1 time: 0.723366 Oct 29 02:47:26.862802 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 300/585] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:26 2022] GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62 => generated 1390 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:26.869670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-741fbf6f-13c7-422a-8d6f-77caec2f147d tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:26.870653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-741fbf6f-13c7-422a-8d6f-77caec2f147d tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: 4c912c93-9d84-4d95-8dc3-103233acff10] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:26.881622 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-741fbf6f-13c7-422a-8d6f-77caec2f147d tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:26.882812 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-741fbf6f-13c7-422a-8d6f-77caec2f147d tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:26.884153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-741fbf6f-13c7-422a-8d6f-77caec2f147d tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:26.886644 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-741fbf6f-13c7-422a-8d6f-77caec2f147d tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:26.887250 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-741fbf6f-13c7-422a-8d6f-77caec2f147d tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:26.887849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-741fbf6f-13c7-422a-8d6f-77caec2f147d tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:26.977202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f2ae70b1-c745-48be-87e7-86fc9ed2f4d7 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:26.986629 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f2ae70b1-c745-48be-87e7-86fc9ed2f4d7 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 200 len: 1521 microversion: 2.1 time: 0.223118 Oct 29 02:47:26.987350 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 286/586] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:26 2022] GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:27.005563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a0cd881a-7ef5-47db-b6d4-ba837f6812ce tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:27.006578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a0cd881a-7ef5-47db-b6d4-ba837f6812ce tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:27.013319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a0cd881a-7ef5-47db-b6d4-ba837f6812ce tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:27.013814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a0cd881a-7ef5-47db-b6d4-ba837f6812ce tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:27.014884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a0cd881a-7ef5-47db-b6d4-ba837f6812ce tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:27.015607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a0cd881a-7ef5-47db-b6d4-ba837f6812ce tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:27.016068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a0cd881a-7ef5-47db-b6d4-ba837f6812ce tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:27.016499 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a0cd881a-7ef5-47db-b6d4-ba837f6812ce tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:27.098217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-a0cd881a-7ef5-47db-b6d4-ba837f6812ce tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lazy-loading 'services' on Instance uuid 0766d417-a358-4ad6-9af4-75f7d61f82eb {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:27.117561 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a0cd881a-7ef5-47db-b6d4-ba837f6812ce tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1929 microversion: 2.75 time: 0.128904 Oct 29 02:47:27.133925 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 287/587] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:26 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1929 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:27.133925 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8656369b-4844-4497-a36e-ad8a94e9ccb7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:27.133925 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8656369b-4844-4497-a36e-ad8a94e9ccb7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: d09276cf-e95a-47be-90e8-befb018ee5ab] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:27.142332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8656369b-4844-4497-a36e-ad8a94e9ccb7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:27.142774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8656369b-4844-4497-a36e-ad8a94e9ccb7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:27.143214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8656369b-4844-4497-a36e-ad8a94e9ccb7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:27.144339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8656369b-4844-4497-a36e-ad8a94e9ccb7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:27.144339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8656369b-4844-4497-a36e-ad8a94e9ccb7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:27.145635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8656369b-4844-4497-a36e-ad8a94e9ccb7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:27.301284 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8656369b-4844-4497-a36e-ad8a94e9ccb7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:27.310737 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8656369b-4844-4497-a36e-ad8a94e9ccb7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab" status: 200 len: 1315 microversion: 2.1 time: 0.191523 Oct 29 02:47:27.311326 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 288/588] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:27 2022] GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:27.316585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8f778c29-e963-4787-b085-d3771f9f0a81 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:27.317618 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8f778c29-e963-4787-b085-d3771f9f0a81 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:27.325617 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8f778c29-e963-4787-b085-d3771f9f0a81 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:27.326395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8f778c29-e963-4787-b085-d3771f9f0a81 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:27.327033 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8f778c29-e963-4787-b085-d3771f9f0a81 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:27.328301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8f778c29-e963-4787-b085-d3771f9f0a81 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:27.328983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8f778c29-e963-4787-b085-d3771f9f0a81 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:27.329593 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8f778c29-e963-4787-b085-d3771f9f0a81 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:27.485903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8f778c29-e963-4787-b085-d3771f9f0a81 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:27.496833 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8f778c29-e963-4787-b085-d3771f9f0a81 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 200 len: 1521 microversion: 2.1 time: 0.183857 Oct 29 02:47:27.497610 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 289/589] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:27 2022] GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:27.520203 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2c12ec44-fb19-4ecc-8a7c-4cbe54548652 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1487176263", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:27.525154 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2c12ec44-fb19-4ecc-8a7c-4cbe54548652 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Request method failure captured: Oct 29 02:47:27.525154 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43/action HTTP/1.1 Oct 29 02:47:27.525154 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:47:27.525154 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:47:27.525154 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:47:27.525154 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 619 Oct 29 02:47:27.525154 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:47:27.525154 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:47:27.525154 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:47:27.525154 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:47:27.525154 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJQe_uEcQU7TWvWTWyYHk2tBfhyW3anQlq9IlbMuIEkf7vn933sPmCKARJnxQpZiUZK1LvxWi4oqgPbQrdfUsgmfgxV95FnHLrMyZSrDr2oYF-e8DjjcOj7SOyLBpFsBspJHWMF4bxtFDAQHeniPMEGa1F2s-2gEJ_CIW5xBvV79ZDc Oct 29 02:47:27.525154 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:47:27.525154 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:47:27.525154 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:47:27.525154 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:47:27.525154 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:47:27.525154 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:47:27.525154 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 94814dc564d04e688714ac064c7d1b3b Oct 29 02:47:27.525154 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:47:27.525154 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:47:27.525154 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:47:27.526409 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/94814dc564d04e688714ac064c7d1b3b"}]}] Oct 29 02:47:27.526409 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:47:27.526409 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 94814dc564d04e688714ac064c7d1b3b Oct 29 02:47:27.526409 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:47:27.526409 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ImagesOneServerNegativeTestJSON-13999867-project Oct 29 02:47:27.526409 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:47:27.526409 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:47:27.526409 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 6862cd2470624f01a8bc1d371aa03962 Oct 29 02:47:27.526409 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-13999867-project Oct 29 02:47:27.526409 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:47:27.527000 n-d-862967-2 devstack@n-api.service[127124]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1487176263", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 29 02:47:27.527000 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:47:27.527000 n-d-862967-2 devstack@n-api.service[127124]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:47:27.527216 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'a1cfd9d1-24b9-4d99-851e-609ece042e43', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1487176263', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 29 02:47:27.527216 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:47:27.527216 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:47:27.527216 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:47:27.527216 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:47:27.527216 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:47:27.527216 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:47:27.527216 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:47:27.527216 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:47:27.527216 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 29 02:47:27.527216 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 02:47:27.529265 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 02:47:27.529265 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 29 02:47:27.529265 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 02:47:27.529265 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:47:27.529265 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 29 02:47:27.529265 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 29 02:47:27.529265 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:47:27.529265 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:47:27.529265 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:47:27.529265 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:47:27.529265 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:47:27.529265 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:47:27.529265 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:47:27.529265 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:47:27.529265 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:47:27.529265 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:47:27.529265 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:47:27.530650 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:47:27.530650 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:47:27.530650 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:47:27.530650 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:47:27.530650 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:47:27.530650 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:47:27.530650 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:47:27.530650 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:47:27.530650 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:47:27.530650 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:47:27.530650 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:47:27.530650 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:47:27.532188 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:47:27.532188 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:47:27.532188 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:47:27.532188 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:47:27.532188 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:47:27.532188 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:47:27.533036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2c12ec44-fb19-4ecc-8a7c-4cbe54548652 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:47:27.533036 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2c12ec44-fb19-4ecc-8a7c-4cbe54548652 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "POST /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43/action" status: 400 len: 938 microversion: 2.1 time: 0.010740 Oct 29 02:47:27.533036 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 290/590] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Oct 29 02:47:27 2022] POST /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43/action => generated 938 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:47:27.535417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-90b9fb85-6546-406f-9707-b71ffd9fa46b tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:27.536139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-90b9fb85-6546-406f-9707-b71ffd9fa46b tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:27.545364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-90b9fb85-6546-406f-9707-b71ffd9fa46b tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:27.545855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-90b9fb85-6546-406f-9707-b71ffd9fa46b tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:27.546288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-90b9fb85-6546-406f-9707-b71ffd9fa46b tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:27.546997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-90b9fb85-6546-406f-9707-b71ffd9fa46b tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:27.547448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-90b9fb85-6546-406f-9707-b71ffd9fa46b tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:27.547870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-90b9fb85-6546-406f-9707-b71ffd9fa46b tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:27.606726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-741fbf6f-13c7-422a-8d6f-77caec2f147d tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:27.618389 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-741fbf6f-13c7-422a-8d6f-77caec2f147d tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10" status: 200 len: 1319 microversion: 2.1 time: 0.754318 Oct 29 02:47:27.623861 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 301/591] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:26 2022] GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10 => generated 1319 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:27.786103 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-327d595d-fe10-4ed8-a2b7-ce1d935ba875 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:27.787230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-327d595d-fe10-4ed8-a2b7-ce1d935ba875 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:27.799056 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-327d595d-fe10-4ed8-a2b7-ce1d935ba875 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:27.800429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-327d595d-fe10-4ed8-a2b7-ce1d935ba875 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:27.802021 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-327d595d-fe10-4ed8-a2b7-ce1d935ba875 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:27.805066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-327d595d-fe10-4ed8-a2b7-ce1d935ba875 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:27.806230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-327d595d-fe10-4ed8-a2b7-ce1d935ba875 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:27.806922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-327d595d-fe10-4ed8-a2b7-ce1d935ba875 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:28.188208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-327d595d-fe10-4ed8-a2b7-ce1d935ba875 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:28.209542 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-327d595d-fe10-4ed8-a2b7-ce1d935ba875 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:28.217927 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-327d595d-fe10-4ed8-a2b7-ce1d935ba875 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:28.223435 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-327d595d-fe10-4ed8-a2b7-ce1d935ba875 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 1568 microversion: 2.25 time: 0.440098 Oct 29 02:47:28.225393 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 302/592] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:27 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 1568 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:47:28.242369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-efb81ac1-a2f2-4a42-ab59-d37481ff3964 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:28.246183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-efb81ac1-a2f2-4a42-ab59-d37481ff3964 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: aff333bb-fff4-4b3e-a3f9-a567b7786a62] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:28.259277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efb81ac1-a2f2-4a42-ab59-d37481ff3964 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:28.263200 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efb81ac1-a2f2-4a42-ab59-d37481ff3964 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:28.267771 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efb81ac1-a2f2-4a42-ab59-d37481ff3964 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:28.269616 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efb81ac1-a2f2-4a42-ab59-d37481ff3964 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:28.270367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efb81ac1-a2f2-4a42-ab59-d37481ff3964 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:28.271320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efb81ac1-a2f2-4a42-ab59-d37481ff3964 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:28.609200 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-efb81ac1-a2f2-4a42-ab59-d37481ff3964 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:28.618169 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-efb81ac1-a2f2-4a42-ab59-d37481ff3964 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62" status: 200 len: 1390 microversion: 2.1 time: 0.390387 Oct 29 02:47:28.618752 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 303/593] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:28 2022] GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62 => generated 1390 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:28.633009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-a41c25d1-053a-4c7f-bb67-1aa3983c8984 req-19de868e-1c95-4299-a333-8d21faa2e99a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aff333bb-fff4-4b3e-a3f9-a567b7786a62", "tag": "00a9c6e8-5769-4bcd-a23e-c0242f3e6acd"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:28.662209 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a41c25d1-053a-4c7f-bb67-1aa3983c8984 req-19de868e-1c95-4299-a333-8d21faa2e99a service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:28.662699 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a41c25d1-053a-4c7f-bb67-1aa3983c8984 req-19de868e-1c95-4299-a333-8d21faa2e99a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:28.663269 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a41c25d1-053a-4c7f-bb67-1aa3983c8984 req-19de868e-1c95-4299-a333-8d21faa2e99a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:28.687614 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-a41c25d1-053a-4c7f-bb67-1aa3983c8984 req-19de868e-1c95-4299-a333-8d21faa2e99a service nova] Creating event network-changed:00a9c6e8-5769-4bcd-a23e-c0242f3e6acd for instance aff333bb-fff4-4b3e-a3f9-a567b7786a62 on n-h2-862967-2 Oct 29 02:47:28.702809 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-a41c25d1-053a-4c7f-bb67-1aa3983c8984 req-19de868e-1c95-4299-a333-8d21faa2e99a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079612 Oct 29 02:47:28.709757 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 304/594] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:28.729220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7989867f-4a21-4b5e-a6f7-67cf1a89ba0b tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:28.730173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7989867f-4a21-4b5e-a6f7-67cf1a89ba0b tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:28.736958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7989867f-4a21-4b5e-a6f7-67cf1a89ba0b tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:28.738534 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7989867f-4a21-4b5e-a6f7-67cf1a89ba0b tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:28.739361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7989867f-4a21-4b5e-a6f7-67cf1a89ba0b tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:28.741584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7989867f-4a21-4b5e-a6f7-67cf1a89ba0b tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:28.743684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7989867f-4a21-4b5e-a6f7-67cf1a89ba0b tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:28.744356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7989867f-4a21-4b5e-a6f7-67cf1a89ba0b tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:29.041914 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-7989867f-4a21-4b5e-a6f7-67cf1a89ba0b tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lazy-loading 'services' on Instance uuid 0766d417-a358-4ad6-9af4-75f7d61f82eb {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:29.104014 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7989867f-4a21-4b5e-a6f7-67cf1a89ba0b tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1929 microversion: 2.75 time: 0.392552 Oct 29 02:47:29.109408 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 305/595] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:28 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1929 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:29.120712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-79358bd2-0232-416a-925f-467f7216bab9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:29.121672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-79358bd2-0232-416a-925f-467f7216bab9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: d09276cf-e95a-47be-90e8-befb018ee5ab] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:29.144276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-79358bd2-0232-416a-925f-467f7216bab9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:29.147397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-79358bd2-0232-416a-925f-467f7216bab9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:29.150263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-79358bd2-0232-416a-925f-467f7216bab9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:29.151282 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-79358bd2-0232-416a-925f-467f7216bab9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:29.151950 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-79358bd2-0232-416a-925f-467f7216bab9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:29.152606 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-79358bd2-0232-416a-925f-467f7216bab9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:29.307871 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=8 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:29.577844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-90b9fb85-6546-406f-9707-b71ffd9fa46b tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:29.592271 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-90b9fb85-6546-406f-9707-b71ffd9fa46b tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 200 len: 1521 microversion: 2.1 time: 2.059330 Oct 29 02:47:29.592915 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 291/596] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:27 2022] GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 1521 bytes in 2062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:29.616684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-32c9e3ca-765e-472a-ba8d-8257415c0e4a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:29.621896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-32c9e3ca-765e-472a-ba8d-8257415c0e4a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: 4c912c93-9d84-4d95-8dc3-103233acff10] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:29.636778 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32c9e3ca-765e-472a-ba8d-8257415c0e4a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:29.637286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32c9e3ca-765e-472a-ba8d-8257415c0e4a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:29.637726 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32c9e3ca-765e-472a-ba8d-8257415c0e4a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:29.638966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32c9e3ca-765e-472a-ba8d-8257415c0e4a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:29.639422 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32c9e3ca-765e-472a-ba8d-8257415c0e4a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:29.639844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32c9e3ca-765e-472a-ba8d-8257415c0e4a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:29.905405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-79358bd2-0232-416a-925f-467f7216bab9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:29.919416 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-79358bd2-0232-416a-925f-467f7216bab9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab" status: 200 len: 1315 microversion: 2.1 time: 0.808564 Oct 29 02:47:29.920023 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 306/597] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:29 2022] GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab => generated 1315 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:29.944398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f47612d3-431b-4f64-84d9-316925afc7e0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:29.966998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f47612d3-431b-4f64-84d9-316925afc7e0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:29.977488 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f47612d3-431b-4f64-84d9-316925afc7e0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:29.978916 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f47612d3-431b-4f64-84d9-316925afc7e0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:29.983666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f47612d3-431b-4f64-84d9-316925afc7e0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:29.984785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f47612d3-431b-4f64-84d9-316925afc7e0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:29.985844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f47612d3-431b-4f64-84d9-316925afc7e0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:29.986493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f47612d3-431b-4f64-84d9-316925afc7e0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:30.261183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-32c9e3ca-765e-472a-ba8d-8257415c0e4a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:30.274308 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-32c9e3ca-765e-472a-ba8d-8257415c0e4a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10" status: 200 len: 1319 microversion: 2.1 time: 0.667718 Oct 29 02:47:30.279008 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 292/598] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:29 2022] GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10 => generated 1319 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:30.296109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-c7844f0c-02ff-4a6f-b9e1-454cf25ee4aa req-73fd4c20-7917-49f2-af0d-9fb893af719c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03261ebe-4be4-4e74-bd8d-ff4a5ae066b1", "name": "network-vif-plugged", "status": "completed", "tag": "6c5bf628-34cf-4bf8-9ee2-dc88993acfd7"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:30.315193 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c7844f0c-02ff-4a6f-b9e1-454cf25ee4aa req-73fd4c20-7917-49f2-af0d-9fb893af719c service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:30.316399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c7844f0c-02ff-4a6f-b9e1-454cf25ee4aa req-73fd4c20-7917-49f2-af0d-9fb893af719c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:30.317219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c7844f0c-02ff-4a6f-b9e1-454cf25ee4aa req-73fd4c20-7917-49f2-af0d-9fb893af719c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:30.344485 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-c7844f0c-02ff-4a6f-b9e1-454cf25ee4aa req-73fd4c20-7917-49f2-af0d-9fb893af719c service nova] Creating event network-vif-plugged:6c5bf628-34cf-4bf8-9ee2-dc88993acfd7 for instance 03261ebe-4be4-4e74-bd8d-ff4a5ae066b1 on n-h1-862967-2 Oct 29 02:47:30.354938 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-c7844f0c-02ff-4a6f-b9e1-454cf25ee4aa req-73fd4c20-7917-49f2-af0d-9fb893af719c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072552 Oct 29 02:47:30.356372 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 293/599] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:30.362727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9b319f7a-f22f-43f1-b89f-01a2938a123c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:30.364005 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9b319f7a-f22f-43f1-b89f-01a2938a123c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:30.371474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b319f7a-f22f-43f1-b89f-01a2938a123c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:30.372391 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b319f7a-f22f-43f1-b89f-01a2938a123c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:30.373090 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b319f7a-f22f-43f1-b89f-01a2938a123c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:30.374409 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b319f7a-f22f-43f1-b89f-01a2938a123c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:30.375096 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b319f7a-f22f-43f1-b89f-01a2938a123c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:30.375736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b319f7a-f22f-43f1-b89f-01a2938a123c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:30.732300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f47612d3-431b-4f64-84d9-316925afc7e0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:30.747842 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f47612d3-431b-4f64-84d9-316925afc7e0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:30.752473 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f47612d3-431b-4f64-84d9-316925afc7e0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:30.754406 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f47612d3-431b-4f64-84d9-316925afc7e0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 1568 microversion: 2.25 time: 0.823377 Oct 29 02:47:30.757912 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 307/600] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:29 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 1568 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:30.765742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b9a9be1c-2dfb-4d18-8bb4-03a8bd2d0d17 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:30.768948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b9a9be1c-2dfb-4d18-8bb4-03a8bd2d0d17 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: aff333bb-fff4-4b3e-a3f9-a567b7786a62] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:30.775601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9a9be1c-2dfb-4d18-8bb4-03a8bd2d0d17 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:30.776358 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9a9be1c-2dfb-4d18-8bb4-03a8bd2d0d17 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:30.776970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9a9be1c-2dfb-4d18-8bb4-03a8bd2d0d17 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:30.779163 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9a9be1c-2dfb-4d18-8bb4-03a8bd2d0d17 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:30.779839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9a9be1c-2dfb-4d18-8bb4-03a8bd2d0d17 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:30.780412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9a9be1c-2dfb-4d18-8bb4-03a8bd2d0d17 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:30.815600 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9b319f7a-f22f-43f1-b89f-01a2938a123c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:30.823847 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9b319f7a-f22f-43f1-b89f-01a2938a123c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 200 len: 1521 microversion: 2.1 time: 0.465998 Oct 29 02:47:30.837051 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 294/601] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:30 2022] GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 1521 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:30.847049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1c12e47c-20d8-440b-8698-b607b5435610 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:30.847916 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1c12e47c-20d8-440b-8698-b607b5435610 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:30.855478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c12e47c-20d8-440b-8698-b607b5435610 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:30.856238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c12e47c-20d8-440b-8698-b607b5435610 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:30.856716 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c12e47c-20d8-440b-8698-b607b5435610 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:30.857728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c12e47c-20d8-440b-8698-b607b5435610 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:30.858338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c12e47c-20d8-440b-8698-b607b5435610 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:30.858921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c12e47c-20d8-440b-8698-b607b5435610 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:30.979523 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-1c12e47c-20d8-440b-8698-b607b5435610 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lazy-loading 'services' on Instance uuid 0766d417-a358-4ad6-9af4-75f7d61f82eb {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:30.982516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:31.016784 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1c12e47c-20d8-440b-8698-b607b5435610 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1929 microversion: 2.75 time: 0.178162 Oct 29 02:47:31.031547 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 295/602] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:30 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1929 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:31.064299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-2bf030e0-87a1-46eb-addc-ab0ebdc9083d req-e3643bfb-eea0-43ea-b2ca-1403d48d9b2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0ec4a8-4cf9-4596-bc31-797c86447aa0", "name": "network-vif-unplugged", "status": "completed", "tag": "69a0c6be-941f-492e-8d52-cd37b1ae25aa"}, {"name": "network-changed", "server_uuid": "0a0ec4a8-4cf9-4596-bc31-797c86447aa0", "tag": "69a0c6be-941f-492e-8d52-cd37b1ae25aa"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:31.098224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-2bf030e0-87a1-46eb-addc-ab0ebdc9083d req-e3643bfb-eea0-43ea-b2ca-1403d48d9b2f service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:31.101037 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-2bf030e0-87a1-46eb-addc-ab0ebdc9083d req-e3643bfb-eea0-43ea-b2ca-1403d48d9b2f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:31.104387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-2bf030e0-87a1-46eb-addc-ab0ebdc9083d req-e3643bfb-eea0-43ea-b2ca-1403d48d9b2f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:31.126612 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-2bf030e0-87a1-46eb-addc-ab0ebdc9083d req-e3643bfb-eea0-43ea-b2ca-1403d48d9b2f service nova] Creating event network-vif-unplugged:69a0c6be-941f-492e-8d52-cd37b1ae25aa for instance 0a0ec4a8-4cf9-4596-bc31-797c86447aa0 on n-h2-862967-2 Oct 29 02:47:31.127371 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-2bf030e0-87a1-46eb-addc-ab0ebdc9083d req-e3643bfb-eea0-43ea-b2ca-1403d48d9b2f service nova] Creating event network-changed:69a0c6be-941f-492e-8d52-cd37b1ae25aa for instance 0a0ec4a8-4cf9-4596-bc31-797c86447aa0 on n-h2-862967-2 Oct 29 02:47:31.138458 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-2bf030e0-87a1-46eb-addc-ab0ebdc9083d req-e3643bfb-eea0-43ea-b2ca-1403d48d9b2f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.105022 Oct 29 02:47:31.139566 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 296/603] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:31.147056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-609b97cb-9350-40e1-9aa6-67fe89a6e5ac tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:31.153951 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-609b97cb-9350-40e1-9aa6-67fe89a6e5ac tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Request method failure captured: Oct 29 02:47:31.153951 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43/action HTTP/1.1 Oct 29 02:47:31.153951 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:47:31.153951 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:47:31.153951 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:47:31.153951 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 285 Oct 29 02:47:31.153951 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:47:31.153951 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:47:31.153951 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:47:31.153951 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:47:31.153951 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJQe_uEcQU7TWvWTWyYHk2tBfhyW3anQlq9IlbMuIEkf7vn933sPmCKARJnxQpZiUZK1LvxWi4oqgPbQrdfUsgmfgxV95FnHLrMyZSrDr2oYF-e8DjjcOj7SOyLBpFsBspJHWMF4bxtFDAQHeniPMEGa1F2s-2gEJ_CIW5xBvV79ZDc Oct 29 02:47:31.153951 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:47:31.153951 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:47:31.153951 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:47:31.153951 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:47:31.153951 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:47:31.153951 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:47:31.153951 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 94814dc564d04e688714ac064c7d1b3b Oct 29 02:47:31.153951 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:47:31.153951 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:47:31.153951 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:47:31.155582 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/94814dc564d04e688714ac064c7d1b3b"}]}] Oct 29 02:47:31.155582 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:47:31.155582 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 94814dc564d04e688714ac064c7d1b3b Oct 29 02:47:31.155582 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:47:31.155582 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ImagesOneServerNegativeTestJSON-13999867-project Oct 29 02:47:31.155582 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:47:31.155582 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:47:31.155582 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 6862cd2470624f01a8bc1d371aa03962 Oct 29 02:47:31.155582 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-13999867-project Oct 29 02:47:31.155582 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:47:31.155582 n-d-862967-2 devstack@n-api.service[127124]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 29 02:47:31.156381 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:47:31.156381 n-d-862967-2 devstack@n-api.service[127124]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 02:47:31.156381 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'a1cfd9d1-24b9-4d99-851e-609ece042e43', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 29 02:47:31.156381 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:47:31.156381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:47:31.156381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:47:31.156381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:47:31.156381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:47:31.156381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:47:31.156381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 02:47:31.157139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:47:31.157139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 29 02:47:31.157139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 02:47:31.157139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:47:31.157139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 29 02:47:31.157139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 29 02:47:31.157139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:47:31.157139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:47:31.157139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:47:31.157139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:47:31.157139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:47:31.157139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:47:31.157139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:47:31.157139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:47:31.157139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:47:31.157139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:47:31.157139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:47:31.157139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:47:31.157139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:47:31.157139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:47:31.158484 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:47:31.158484 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:47:31.158484 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:47:31.158484 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:47:31.158484 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 02:47:31.158484 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:47:31.158484 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:47:31.158484 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:47:31.158484 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:47:31.158484 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:47:31.158484 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:47:31.158484 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:47:31.158484 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:47:31.159359 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 02:47:31.159359 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:47:31.162077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-609b97cb-9350-40e1-9aa6-67fe89a6e5ac tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:47:31.162948 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-609b97cb-9350-40e1-9aa6-67fe89a6e5ac tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "POST /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43/action" status: 400 len: 619 microversion: 2.1 time: 0.022396 Oct 29 02:47:31.163570 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 297/604] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Oct 29 02:47:31 2022] POST /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43/action => generated 619 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:47:31.182758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-32cb6f94-9a40-4657-b3b7-3f050b35c8f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:31.183511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-32cb6f94-9a40-4657-b3b7-3f050b35c8f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: d09276cf-e95a-47be-90e8-befb018ee5ab] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:31.210995 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32cb6f94-9a40-4657-b3b7-3f050b35c8f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:31.211502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32cb6f94-9a40-4657-b3b7-3f050b35c8f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:31.211946 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32cb6f94-9a40-4657-b3b7-3f050b35c8f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:31.212823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32cb6f94-9a40-4657-b3b7-3f050b35c8f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:31.213295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32cb6f94-9a40-4657-b3b7-3f050b35c8f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:31.213839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32cb6f94-9a40-4657-b3b7-3f050b35c8f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:31.579805 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b9a9be1c-2dfb-4d18-8bb4-03a8bd2d0d17 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:31.596107 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b9a9be1c-2dfb-4d18-8bb4-03a8bd2d0d17 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62" status: 200 len: 1390 microversion: 2.1 time: 0.833674 Oct 29 02:47:31.610077 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 308/605] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:30 2022] GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62 => generated 1390 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:31.621886 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-33937982-eb05-4d4e-b219-d1d8dd83fa55 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:31.622856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-33937982-eb05-4d4e-b219-d1d8dd83fa55 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:31.633747 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33937982-eb05-4d4e-b219-d1d8dd83fa55 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:31.634435 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33937982-eb05-4d4e-b219-d1d8dd83fa55 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:31.635770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33937982-eb05-4d4e-b219-d1d8dd83fa55 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:31.636784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33937982-eb05-4d4e-b219-d1d8dd83fa55 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:31.637445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33937982-eb05-4d4e-b219-d1d8dd83fa55 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:31.638071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33937982-eb05-4d4e-b219-d1d8dd83fa55 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:31.951076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-33937982-eb05-4d4e-b219-d1d8dd83fa55 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:31.972346 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-33937982-eb05-4d4e-b219-d1d8dd83fa55 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 200 len: 1521 microversion: 2.1 time: 0.356050 Oct 29 02:47:31.973383 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 309/606] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:31 2022] GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:31.980027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d52a8a28-51c1-47a9-968f-970d7bf6ed89 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:31.980911 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d52a8a28-51c1-47a9-968f-970d7bf6ed89 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: 4c912c93-9d84-4d95-8dc3-103233acff10] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:31.987730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d52a8a28-51c1-47a9-968f-970d7bf6ed89 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:31.988664 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d52a8a28-51c1-47a9-968f-970d7bf6ed89 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:31.989491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d52a8a28-51c1-47a9-968f-970d7bf6ed89 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:31.990474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d52a8a28-51c1-47a9-968f-970d7bf6ed89 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:31.991302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d52a8a28-51c1-47a9-968f-970d7bf6ed89 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:31.991976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d52a8a28-51c1-47a9-968f-970d7bf6ed89 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:32.223125 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d52a8a28-51c1-47a9-968f-970d7bf6ed89 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:32.233432 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d52a8a28-51c1-47a9-968f-970d7bf6ed89 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10" status: 200 len: 1319 microversion: 2.1 time: 0.258637 Oct 29 02:47:32.234914 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 310/607] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:31 2022] GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:32.240230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fc44a692-b7b9-4512-8dd8-40f988bca003 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:32.241041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fc44a692-b7b9-4512-8dd8-40f988bca003 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:32.247536 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc44a692-b7b9-4512-8dd8-40f988bca003 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:32.248248 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc44a692-b7b9-4512-8dd8-40f988bca003 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:32.248864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc44a692-b7b9-4512-8dd8-40f988bca003 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:32.249767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc44a692-b7b9-4512-8dd8-40f988bca003 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:32.250679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc44a692-b7b9-4512-8dd8-40f988bca003 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:32.251256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc44a692-b7b9-4512-8dd8-40f988bca003 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:32.267805 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-32cb6f94-9a40-4657-b3b7-3f050b35c8f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:32.280334 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-32cb6f94-9a40-4657-b3b7-3f050b35c8f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab" status: 200 len: 1315 microversion: 2.1 time: 1.107206 Oct 29 02:47:32.281694 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 298/608] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:31 2022] GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab => generated 1315 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:32.297818 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4602e27e-08a6-4736-8744-236a244240ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:32.299426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4602e27e-08a6-4736-8744-236a244240ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:32.314076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4602e27e-08a6-4736-8744-236a244240ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:32.315471 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4602e27e-08a6-4736-8744-236a244240ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:32.319662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4602e27e-08a6-4736-8744-236a244240ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:32.320725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4602e27e-08a6-4736-8744-236a244240ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:32.321393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4602e27e-08a6-4736-8744-236a244240ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:32.322064 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4602e27e-08a6-4736-8744-236a244240ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:32.466455 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fc44a692-b7b9-4512-8dd8-40f988bca003 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:32.477112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fc44a692-b7b9-4512-8dd8-40f988bca003 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:32.479834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fc44a692-b7b9-4512-8dd8-40f988bca003 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:32.481493 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fc44a692-b7b9-4512-8dd8-40f988bca003 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 1568 microversion: 2.25 time: 0.245248 Oct 29 02:47:32.495853 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 311/609] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:32 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 1568 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:32.506005 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c7452e4e-4d80-4cfe-b376-3a4935058159 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:32.506670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c7452e4e-4d80-4cfe-b376-3a4935058159 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:32.527804 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7452e4e-4d80-4cfe-b376-3a4935058159 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:32.530471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7452e4e-4d80-4cfe-b376-3a4935058159 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:32.530969 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7452e4e-4d80-4cfe-b376-3a4935058159 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:32.531706 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7452e4e-4d80-4cfe-b376-3a4935058159 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:32.532172 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7452e4e-4d80-4cfe-b376-3a4935058159 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:32.534279 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7452e4e-4d80-4cfe-b376-3a4935058159 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:32.620692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-c7452e4e-4d80-4cfe-b376-3a4935058159 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lazy-loading 'services' on Instance uuid 0766d417-a358-4ad6-9af4-75f7d61f82eb {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:32.644055 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c7452e4e-4d80-4cfe-b376-3a4935058159 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1929 microversion: 2.75 time: 0.147149 Oct 29 02:47:32.645317 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 312/610] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:32 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1929 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:32.650733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-820616b0-fe8f-4442-a94e-e61adfb50878 req-8985606a-b3e0-4989-88bd-702db35e30f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09276cf-e95a-47be-90e8-befb018ee5ab", "name": "network-vif-plugged", "status": "completed", "tag": "f141616b-7c4f-401f-aa06-bf21863f5f3d"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:32.662126 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-820616b0-fe8f-4442-a94e-e61adfb50878 req-8985606a-b3e0-4989-88bd-702db35e30f2 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:32.663109 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-820616b0-fe8f-4442-a94e-e61adfb50878 req-8985606a-b3e0-4989-88bd-702db35e30f2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:32.663868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-820616b0-fe8f-4442-a94e-e61adfb50878 req-8985606a-b3e0-4989-88bd-702db35e30f2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:32.689589 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-820616b0-fe8f-4442-a94e-e61adfb50878 req-8985606a-b3e0-4989-88bd-702db35e30f2 service nova] Creating event network-vif-plugged:f141616b-7c4f-401f-aa06-bf21863f5f3d for instance d09276cf-e95a-47be-90e8-befb018ee5ab on n-h2-862967-2 Oct 29 02:47:32.695745 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-820616b0-fe8f-4442-a94e-e61adfb50878 req-8985606a-b3e0-4989-88bd-702db35e30f2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048161 Oct 29 02:47:32.697837 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 313/611] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:32.704759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-965c76bd-f5ec-4b75-bb99-8ca402437487 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:32.717347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-965c76bd-f5ec-4b75-bb99-8ca402437487 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: aff333bb-fff4-4b3e-a3f9-a567b7786a62] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:32.725575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:32.727416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-965c76bd-f5ec-4b75-bb99-8ca402437487 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:32.728161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-965c76bd-f5ec-4b75-bb99-8ca402437487 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:32.729514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-965c76bd-f5ec-4b75-bb99-8ca402437487 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:32.730815 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-965c76bd-f5ec-4b75-bb99-8ca402437487 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:32.731433 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-965c76bd-f5ec-4b75-bb99-8ca402437487 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:32.732706 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-965c76bd-f5ec-4b75-bb99-8ca402437487 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:32.748231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4602e27e-08a6-4736-8744-236a244240ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:32.757612 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4602e27e-08a6-4736-8744-236a244240ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 200 len: 1521 microversion: 2.1 time: 0.474516 Oct 29 02:47:32.763644 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 299/612] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:32 2022] GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 1521 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:32.787793 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b03e29c6-6a3e-42e9-a521-e5f90e442ba0 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-987275480"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:32.790559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b03e29c6-6a3e-42e9-a521-e5f90e442ba0 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:32.806482 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b03e29c6-6a3e-42e9-a521-e5f90e442ba0 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:32.808109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b03e29c6-6a3e-42e9-a521-e5f90e442ba0 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:32.828426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b03e29c6-6a3e-42e9-a521-e5f90e442ba0 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:32.829524 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b03e29c6-6a3e-42e9-a521-e5f90e442ba0 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:32.830009 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b03e29c6-6a3e-42e9-a521-e5f90e442ba0 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:32.833256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b03e29c6-6a3e-42e9-a521-e5f90e442ba0 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:33.247480 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b03e29c6-6a3e-42e9-a521-e5f90e442ba0 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "POST /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43/action" status: 202 len: 0 microversion: 2.1 time: 0.462955 Oct 29 02:47:33.249050 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 300/613] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:47:32 2022] POST /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 29 02:47:33.266922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6f541c27-d76f-49ba-9467-143035779e6d tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:33.268261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6f541c27-d76f-49ba-9467-143035779e6d tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: 4c912c93-9d84-4d95-8dc3-103233acff10] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:33.296341 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f541c27-d76f-49ba-9467-143035779e6d tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:33.298618 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f541c27-d76f-49ba-9467-143035779e6d tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:33.300768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f541c27-d76f-49ba-9467-143035779e6d tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:33.302170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f541c27-d76f-49ba-9467-143035779e6d tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:33.303024 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f541c27-d76f-49ba-9467-143035779e6d tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:33.303749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f541c27-d76f-49ba-9467-143035779e6d tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:33.366500 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-965c76bd-f5ec-4b75-bb99-8ca402437487 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:33.379194 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-965c76bd-f5ec-4b75-bb99-8ca402437487 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62" status: 200 len: 1390 microversion: 2.1 time: 0.679527 Oct 29 02:47:33.390647 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 314/614] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:32 2022] GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62 => generated 1390 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:33.396692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-247ef45c-fd80-4adb-b1ad-5f2a04e767e5 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2001555635"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:33.413594 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-247ef45c-fd80-4adb-b1ad-5f2a04e767e5 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:33.423253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-247ef45c-fd80-4adb-b1ad-5f2a04e767e5 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:33.432501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-247ef45c-fd80-4adb-b1ad-5f2a04e767e5 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:33.433253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-247ef45c-fd80-4adb-b1ad-5f2a04e767e5 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:33.434210 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-247ef45c-fd80-4adb-b1ad-5f2a04e767e5 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:33.434843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-247ef45c-fd80-4adb-b1ad-5f2a04e767e5 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:33.435453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-247ef45c-fd80-4adb-b1ad-5f2a04e767e5 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:33.476819 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6f541c27-d76f-49ba-9467-143035779e6d tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:33.486640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:33.489718 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6f541c27-d76f-49ba-9467-143035779e6d tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10" status: 200 len: 1319 microversion: 2.1 time: 0.233671 Oct 29 02:47:33.505775 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 301/615] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:33 2022] GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:33.515393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0e55520c-b1f0-4510-91d6-69b6fdc00d63 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:33.516455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0e55520c-b1f0-4510-91d6-69b6fdc00d63 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: d09276cf-e95a-47be-90e8-befb018ee5ab] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:33.523396 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0e55520c-b1f0-4510-91d6-69b6fdc00d63 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:33.524791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0e55520c-b1f0-4510-91d6-69b6fdc00d63 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:33.526447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0e55520c-b1f0-4510-91d6-69b6fdc00d63 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:33.527094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0e55520c-b1f0-4510-91d6-69b6fdc00d63 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:33.527756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0e55520c-b1f0-4510-91d6-69b6fdc00d63 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:33.528344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0e55520c-b1f0-4510-91d6-69b6fdc00d63 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:33.566585 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-247ef45c-fd80-4adb-b1ad-5f2a04e767e5 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] HTTP exception thrown: Cannot 'createImage' instance a1cfd9d1-24b9-4d99-851e-609ece042e43 while it is in task_state image_snapshot Oct 29 02:47:33.583393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-247ef45c-fd80-4adb-b1ad-5f2a04e767e5 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Request method failure captured: Oct 29 02:47:33.583393 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43/action HTTP/1.1 Oct 29 02:47:33.583393 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:47:33.583393 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:47:33.583393 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:47:33.583393 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 85 Oct 29 02:47:33.583393 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:47:33.583393 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:47:33.583393 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:47:33.583393 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:47:33.583393 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJQe_uEcQU7TWvWTWyYHk2tBfhyW3anQlq9IlbMuIEkf7vn933sPmCKARJnxQpZiUZK1LvxWi4oqgPbQrdfUsgmfgxV95FnHLrMyZSrDr2oYF-e8DjjcOj7SOyLBpFsBspJHWMF4bxtFDAQHeniPMEGa1F2s-2gEJ_CIW5xBvV79ZDc Oct 29 02:47:33.583393 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:47:33.583393 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:47:33.583393 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:47:33.583393 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:47:33.583393 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:47:33.583393 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:47:33.583393 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 94814dc564d04e688714ac064c7d1b3b Oct 29 02:47:33.583393 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:47:33.583393 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:47:33.583393 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:47:33.584990 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/94814dc564d04e688714ac064c7d1b3b"}]}] Oct 29 02:47:33.584990 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:47:33.584990 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 94814dc564d04e688714ac064c7d1b3b Oct 29 02:47:33.584990 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:47:33.584990 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ImagesOneServerNegativeTestJSON-13999867-project Oct 29 02:47:33.584990 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:47:33.584990 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:47:33.584990 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 6862cd2470624f01a8bc1d371aa03962 Oct 29 02:47:33.584990 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-13999867-project Oct 29 02:47:33.584990 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:47:33.584990 n-d-862967-2 devstack@n-api.service[127125]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2001555635"}} Oct 29 02:47:33.584990 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:47:33.585742 n-d-862967-2 devstack@n-api.service[127125]: exception: Cannot 'createImage' instance a1cfd9d1-24b9-4d99-851e-609ece042e43 while it is in task_state image_snapshot Oct 29 02:47:33.585742 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'a1cfd9d1-24b9-4d99-851e-609ece042e43', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2001555635'}}} Oct 29 02:47:33.585742 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:47:33.585742 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:47:33.585742 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 29 02:47:33.585742 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 29 02:47:33.585742 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 29 02:47:33.585742 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 02:47:33.585742 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a1cfd9d1-24b9-4d99-851e-609ece042e43 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Oct 29 02:47:33.585742 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:47:33.585742 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:47:33.585742 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:47:33.585742 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:47:33.585742 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:47:33.585742 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:47:33.585742 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:47:33.585742 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:47:33.585742 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:47:33.585742 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:47:33.587188 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:47:33.587188 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:47:33.587188 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:47:33.587188 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:47:33.587188 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 29 02:47:33.587188 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 02:47:33.587188 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 02:47:33.587188 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 02:47:33.587188 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance a1cfd9d1-24b9-4d99-851e-609ece042e43 while it is in task_state image_snapshot Oct 29 02:47:33.587188 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:47:33.587188 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:47:33.587188 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:47:33.587188 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:47:33.587188 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:47:33.587188 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:47:33.587188 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:47:33.587188 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:47:33.587188 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance a1cfd9d1-24b9-4d99-851e-609ece042e43 while it is in task_state image_snapshot Oct 29 02:47:33.587188 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:47:33.590191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-247ef45c-fd80-4adb-b1ad-5f2a04e767e5 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Returning 409 to user: Cannot 'createImage' instance a1cfd9d1-24b9-4d99-851e-609ece042e43 while it is in task_state image_snapshot {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:47:33.590191 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-247ef45c-fd80-4adb-b1ad-5f2a04e767e5 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "POST /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43/action" status: 409 len: 159 microversion: 2.1 time: 0.193664 Oct 29 02:47:33.590966 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 315/616] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:47:33 2022] POST /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43/action => generated 159 bytes in 199 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:47:33.596502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4bae18d7-0fa4-48e6-9f96-fe49a421e49d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:33.597389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4bae18d7-0fa4-48e6-9f96-fe49a421e49d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:33.604240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bae18d7-0fa4-48e6-9f96-fe49a421e49d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:33.605059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bae18d7-0fa4-48e6-9f96-fe49a421e49d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:33.605680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bae18d7-0fa4-48e6-9f96-fe49a421e49d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:33.606592 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bae18d7-0fa4-48e6-9f96-fe49a421e49d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:33.607217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bae18d7-0fa4-48e6-9f96-fe49a421e49d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:33.607917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bae18d7-0fa4-48e6-9f96-fe49a421e49d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:33.736306 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0e55520c-b1f0-4510-91d6-69b6fdc00d63 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:33.751480 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0e55520c-b1f0-4510-91d6-69b6fdc00d63 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab" status: 200 len: 1315 microversion: 2.1 time: 0.242171 Oct 29 02:47:33.770933 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 302/617] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:33 2022] GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:33.776171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2be9a2a0-3700-4faa-af8c-9db942ec4fe7 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '.version_select at 0x7ff0581be940>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:34.039134 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2be9a2a0-3700-4faa-af8c-9db942ec4fe7 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "DELETE /compute/v2.1/images/8274cf20-ed26-404a-a18d-6eaacdd497bc" status: 204 len: 0 microversion: 2.1 time: 0.266890 Oct 29 02:47:34.039869 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 303/618] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:33 2022] DELETE /compute/v2.1/images/8274cf20-ed26-404a-a18d-6eaacdd497bc => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:47:34.046008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-47e1c1c1-5dec-4f47-aa88-2a9d7894ae21 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:34.046881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-47e1c1c1-5dec-4f47-aa88-2a9d7894ae21 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:34.065324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47e1c1c1-5dec-4f47-aa88-2a9d7894ae21 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:34.065898 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47e1c1c1-5dec-4f47-aa88-2a9d7894ae21 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:34.066389 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47e1c1c1-5dec-4f47-aa88-2a9d7894ae21 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:34.077359 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47e1c1c1-5dec-4f47-aa88-2a9d7894ae21 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:34.078592 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47e1c1c1-5dec-4f47-aa88-2a9d7894ae21 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:34.079649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47e1c1c1-5dec-4f47-aa88-2a9d7894ae21 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:34.119282 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4bae18d7-0fa4-48e6-9f96-fe49a421e49d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:34.129316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4bae18d7-0fa4-48e6-9f96-fe49a421e49d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:34.135203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4bae18d7-0fa4-48e6-9f96-fe49a421e49d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:34.136434 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4bae18d7-0fa4-48e6-9f96-fe49a421e49d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 1568 microversion: 2.25 time: 0.544266 Oct 29 02:47:34.143283 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 316/619] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:33 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 1568 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:34.151588 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f8dc1048-f6cb-4042-a82b-053f3f447a76 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:34.153383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f8dc1048-f6cb-4042-a82b-053f3f447a76 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:34.169566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f8dc1048-f6cb-4042-a82b-053f3f447a76 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:34.170311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f8dc1048-f6cb-4042-a82b-053f3f447a76 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:34.170943 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f8dc1048-f6cb-4042-a82b-053f3f447a76 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:34.174002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f8dc1048-f6cb-4042-a82b-053f3f447a76 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:34.175362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f8dc1048-f6cb-4042-a82b-053f3f447a76 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:34.176012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f8dc1048-f6cb-4042-a82b-053f3f447a76 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:34.249824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-47e1c1c1-5dec-4f47-aa88-2a9d7894ae21 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lazy-loading 'services' on Instance uuid 0766d417-a358-4ad6-9af4-75f7d61f82eb {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:34.292413 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-47e1c1c1-5dec-4f47-aa88-2a9d7894ae21 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1929 microversion: 2.75 time: 0.250438 Oct 29 02:47:34.309984 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 304/620] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:34 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1929 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:34.421047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-de82a868-1cc3-4880-b20c-353dfcb9b0b0 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:34.422134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-de82a868-1cc3-4880-b20c-353dfcb9b0b0 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: aff333bb-fff4-4b3e-a3f9-a567b7786a62] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:34.450874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-de82a868-1cc3-4880-b20c-353dfcb9b0b0 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:34.453058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-de82a868-1cc3-4880-b20c-353dfcb9b0b0 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:34.454035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-de82a868-1cc3-4880-b20c-353dfcb9b0b0 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:34.457743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-de82a868-1cc3-4880-b20c-353dfcb9b0b0 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:34.461624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-de82a868-1cc3-4880-b20c-353dfcb9b0b0 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:34.464643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-de82a868-1cc3-4880-b20c-353dfcb9b0b0 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:34.558957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f8dc1048-f6cb-4042-a82b-053f3f447a76 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:34.567263 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f8dc1048-f6cb-4042-a82b-053f3f447a76 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 200 len: 1533 microversion: 2.1 time: 0.421723 Oct 29 02:47:34.573013 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 317/621] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:34 2022] GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 1533 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:34.607711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ed5baf20-7f61-4515-b170-22fe98e67428 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:34.608599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ed5baf20-7f61-4515-b170-22fe98e67428 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: 4c912c93-9d84-4d95-8dc3-103233acff10] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:34.626338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed5baf20-7f61-4515-b170-22fe98e67428 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:34.632319 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed5baf20-7f61-4515-b170-22fe98e67428 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:34.633265 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed5baf20-7f61-4515-b170-22fe98e67428 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:34.634593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed5baf20-7f61-4515-b170-22fe98e67428 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:34.637086 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed5baf20-7f61-4515-b170-22fe98e67428 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:34.637904 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed5baf20-7f61-4515-b170-22fe98e67428 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:34.888674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-de82a868-1cc3-4880-b20c-353dfcb9b0b0 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:34.924276 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-de82a868-1cc3-4880-b20c-353dfcb9b0b0 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62" status: 200 len: 1390 microversion: 2.1 time: 0.509396 Oct 29 02:47:34.936671 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 305/622] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:34 2022] GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62 => generated 1390 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:34.946743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1502cec4-86db-40f2-bfad-49849062a1c5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:34.946976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1502cec4-86db-40f2-bfad-49849062a1c5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: d09276cf-e95a-47be-90e8-befb018ee5ab] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:34.954063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1502cec4-86db-40f2-bfad-49849062a1c5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:34.954641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1502cec4-86db-40f2-bfad-49849062a1c5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:34.955227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1502cec4-86db-40f2-bfad-49849062a1c5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:34.956769 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1502cec4-86db-40f2-bfad-49849062a1c5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:34.957198 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1502cec4-86db-40f2-bfad-49849062a1c5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:34.957746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1502cec4-86db-40f2-bfad-49849062a1c5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:35.056421 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ed5baf20-7f61-4515-b170-22fe98e67428 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:35.068635 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ed5baf20-7f61-4515-b170-22fe98e67428 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10" status: 200 len: 1319 microversion: 2.1 time: 0.493299 Oct 29 02:47:35.070011 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 318/623] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:34 2022] GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10 => generated 1319 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:35.168859 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-aaf940a4-720c-4fdb-b6f3-2c9cc772c557 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:35.170666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-aaf940a4-720c-4fdb-b6f3-2c9cc772c557 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:35.177482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aaf940a4-720c-4fdb-b6f3-2c9cc772c557 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:35.178376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aaf940a4-720c-4fdb-b6f3-2c9cc772c557 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:35.179028 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aaf940a4-720c-4fdb-b6f3-2c9cc772c557 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:35.180001 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aaf940a4-720c-4fdb-b6f3-2c9cc772c557 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:35.180695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aaf940a4-720c-4fdb-b6f3-2c9cc772c557 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:35.181345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aaf940a4-720c-4fdb-b6f3-2c9cc772c557 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:35.419237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1502cec4-86db-40f2-bfad-49849062a1c5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:35.433257 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1502cec4-86db-40f2-bfad-49849062a1c5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab" status: 200 len: 1464 microversion: 2.1 time: 0.500652 Oct 29 02:47:35.435105 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 306/624] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:34 2022] GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab => generated 1464 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:35.450252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eb31ba1b-879f-4bd3-a0ee-42c43fb06399 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:35.451729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-eb31ba1b-879f-4bd3-a0ee-42c43fb06399 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:35.472943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb31ba1b-879f-4bd3-a0ee-42c43fb06399 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:35.473736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb31ba1b-879f-4bd3-a0ee-42c43fb06399 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:35.474320 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb31ba1b-879f-4bd3-a0ee-42c43fb06399 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:35.475159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb31ba1b-879f-4bd3-a0ee-42c43fb06399 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:35.475685 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb31ba1b-879f-4bd3-a0ee-42c43fb06399 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:35.476362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb31ba1b-879f-4bd3-a0ee-42c43fb06399 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:35.906432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-eb31ba1b-879f-4bd3-a0ee-42c43fb06399 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lazy-loading 'services' on Instance uuid 0766d417-a358-4ad6-9af4-75f7d61f82eb {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:35.933217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-aaf940a4-720c-4fdb-b6f3-2c9cc772c557 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:35.942198 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-aaf940a4-720c-4fdb-b6f3-2c9cc772c557 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:35.950030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-aaf940a4-720c-4fdb-b6f3-2c9cc772c557 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:35.956658 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-aaf940a4-720c-4fdb-b6f3-2c9cc772c557 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 1568 microversion: 2.25 time: 0.791761 Oct 29 02:47:35.959791 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 319/625] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:35 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 1568 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:35.960436 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eb31ba1b-879f-4bd3-a0ee-42c43fb06399 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1929 microversion: 2.75 time: 0.523820 Oct 29 02:47:35.975054 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 307/626] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:35 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1929 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:35.985461 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-06477f85-0675-4b41-af8e-0cf3f8df302a tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:35.988507 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-06477f85-0675-4b41-af8e-0cf3f8df302a tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:35.988785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cbc4a581-63a4-442e-b6d4-22912bdf13e1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:35.989994 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cbc4a581-63a4-442e-b6d4-22912bdf13e1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 03261ebe-4be4-4e74-bd8d-ff4a5ae066b1] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:36.009246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbc4a581-63a4-442e-b6d4-22912bdf13e1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:36.012071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06477f85-0675-4b41-af8e-0cf3f8df302a tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:36.012317 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbc4a581-63a4-442e-b6d4-22912bdf13e1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:36.012611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06477f85-0675-4b41-af8e-0cf3f8df302a tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:36.013257 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbc4a581-63a4-442e-b6d4-22912bdf13e1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:36.013585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06477f85-0675-4b41-af8e-0cf3f8df302a tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:36.014325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06477f85-0675-4b41-af8e-0cf3f8df302a tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:36.015183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06477f85-0675-4b41-af8e-0cf3f8df302a tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:36.017262 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbc4a581-63a4-442e-b6d4-22912bdf13e1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:36.018274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbc4a581-63a4-442e-b6d4-22912bdf13e1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:36.018799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06477f85-0675-4b41-af8e-0cf3f8df302a tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:36.020576 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbc4a581-63a4-442e-b6d4-22912bdf13e1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:36.303964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-06477f85-0675-4b41-af8e-0cf3f8df302a tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:36.314376 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-06477f85-0675-4b41-af8e-0cf3f8df302a tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 200 len: 1539 microversion: 2.1 time: 0.351990 Oct 29 02:47:36.315125 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 308/627] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:35 2022] GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 1539 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:36.331376 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-594a6557-8411-4a0a-9326-09c937c6faa4 req-2143d1b2-fbf7-40f5-bfd7-34db7ead670a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c912c93-9d84-4d95-8dc3-103233acff10", "name": "network-vif-plugged", "status": "completed", "tag": "61e4fdfe-2003-4ace-8ee7-d890adeedffa"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:36.338092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cbc4a581-63a4-442e-b6d4-22912bdf13e1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:36.359849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-594a6557-8411-4a0a-9326-09c937c6faa4 req-2143d1b2-fbf7-40f5-bfd7-34db7ead670a service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:36.359849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-594a6557-8411-4a0a-9326-09c937c6faa4 req-2143d1b2-fbf7-40f5-bfd7-34db7ead670a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:36.360517 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-594a6557-8411-4a0a-9326-09c937c6faa4 req-2143d1b2-fbf7-40f5-bfd7-34db7ead670a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:36.391599 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-594a6557-8411-4a0a-9326-09c937c6faa4 req-2143d1b2-fbf7-40f5-bfd7-34db7ead670a service nova] Creating event network-vif-plugged:61e4fdfe-2003-4ace-8ee7-d890adeedffa for instance 4c912c93-9d84-4d95-8dc3-103233acff10 on n-h1-862967-2 Oct 29 02:47:36.397695 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cbc4a581-63a4-442e-b6d4-22912bdf13e1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/03261ebe-4be4-4e74-bd8d-ff4a5ae066b1" status: 200 len: 1464 microversion: 2.1 time: 0.433724 Oct 29 02:47:36.400328 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 320/628] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:35 2022] GET /compute/v2.1/servers/03261ebe-4be4-4e74-bd8d-ff4a5ae066b1 => generated 1464 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:36.409281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-72763157-38f5-459f-88ca-4ac845b64905 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:36.410175 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-72763157-38f5-459f-88ca-4ac845b64905 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: aff333bb-fff4-4b3e-a3f9-a567b7786a62] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:36.420232 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-72763157-38f5-459f-88ca-4ac845b64905 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:36.421521 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-72763157-38f5-459f-88ca-4ac845b64905 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:36.422249 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-594a6557-8411-4a0a-9326-09c937c6faa4 req-2143d1b2-fbf7-40f5-bfd7-34db7ead670a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098398 Oct 29 02:47:36.423246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-72763157-38f5-459f-88ca-4ac845b64905 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:36.433613 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-72763157-38f5-459f-88ca-4ac845b64905 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:36.434593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-72763157-38f5-459f-88ca-4ac845b64905 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:36.435243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-72763157-38f5-459f-88ca-4ac845b64905 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:36.439745 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 309/629] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:36.462337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c9b2d2a1-3aee-47c2-84b2-0a85ce5e6e1d tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:36.464413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c9b2d2a1-3aee-47c2-84b2-0a85ce5e6e1d tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: 4c912c93-9d84-4d95-8dc3-103233acff10] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:36.492272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9b2d2a1-3aee-47c2-84b2-0a85ce5e6e1d tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:36.493745 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9b2d2a1-3aee-47c2-84b2-0a85ce5e6e1d tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:36.495611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9b2d2a1-3aee-47c2-84b2-0a85ce5e6e1d tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:36.498308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9b2d2a1-3aee-47c2-84b2-0a85ce5e6e1d tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:36.503018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9b2d2a1-3aee-47c2-84b2-0a85ce5e6e1d tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:36.503836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9b2d2a1-3aee-47c2-84b2-0a85ce5e6e1d tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:36.920768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c9b2d2a1-3aee-47c2-84b2-0a85ce5e6e1d tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:36.933009 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c9b2d2a1-3aee-47c2-84b2-0a85ce5e6e1d tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10" status: 200 len: 1319 microversion: 2.1 time: 0.487706 Oct 29 02:47:36.933941 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 310/630] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:36 2022] GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10 => generated 1319 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:36.946447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-35e1c3d8-9cc6-4e02-9388-805f6abcddba tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:36.957959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-35e1c3d8-9cc6-4e02-9388-805f6abcddba tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:36.960893 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-35e1c3d8-9cc6-4e02-9388-805f6abcddba tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Searching by: {'reservation_id': 'r-v0v8eeo1', 'deleted': False, 'project_id': 'dcc6da8e69e041e19023a53a23e33393'} {{(pid=127124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:47:36.981873 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35e1c3d8-9cc6-4e02-9388-805f6abcddba tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:36.982954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35e1c3d8-9cc6-4e02-9388-805f6abcddba tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:36.984069 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35e1c3d8-9cc6-4e02-9388-805f6abcddba tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:36.985553 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35e1c3d8-9cc6-4e02-9388-805f6abcddba tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:36.986162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35e1c3d8-9cc6-4e02-9388-805f6abcddba tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:36.986737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35e1c3d8-9cc6-4e02-9388-805f6abcddba tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:37.083140 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-72763157-38f5-459f-88ca-4ac845b64905 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:37.095194 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-72763157-38f5-459f-88ca-4ac845b64905 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62" status: 200 len: 1390 microversion: 2.1 time: 0.693147 Oct 29 02:47:37.098227 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 321/631] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:36 2022] GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62 => generated 1390 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:37.106681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-28dc2945-144e-4257-b09f-a588999af95e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:37.107997 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-28dc2945-144e-4257-b09f-a588999af95e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:37.129401 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28dc2945-144e-4257-b09f-a588999af95e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:37.130411 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28dc2945-144e-4257-b09f-a588999af95e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:37.131265 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28dc2945-144e-4257-b09f-a588999af95e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:37.132546 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28dc2945-144e-4257-b09f-a588999af95e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:37.133254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28dc2945-144e-4257-b09f-a588999af95e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:37.136042 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28dc2945-144e-4257-b09f-a588999af95e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:37.198942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.multi_cell_list [None req-35e1c3d8-9cc6-4e02-9388-805f6abcddba tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 02:47:37.293211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-35e1c3d8-9cc6-4e02-9388-805f6abcddba tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:37.308826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35e1c3d8-9cc6-4e02-9388-805f6abcddba tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:37.309456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35e1c3d8-9cc6-4e02-9388-805f6abcddba tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:37.310012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35e1c3d8-9cc6-4e02-9388-805f6abcddba tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:37.569335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-28dc2945-144e-4257-b09f-a588999af95e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:37.588943 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-28dc2945-144e-4257-b09f-a588999af95e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:37.590614 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-28dc2945-144e-4257-b09f-a588999af95e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:37.591817 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-28dc2945-144e-4257-b09f-a588999af95e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 1568 microversion: 2.25 time: 0.492314 Oct 29 02:47:37.592385 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 322/632] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:37 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 1568 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:37.608752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a49b0add-4682-4c9c-90c2-a58880f195c1 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:37.609738 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a49b0add-4682-4c9c-90c2-a58880f195c1 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:37.617548 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a49b0add-4682-4c9c-90c2-a58880f195c1 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:37.618346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a49b0add-4682-4c9c-90c2-a58880f195c1 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:37.618927 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a49b0add-4682-4c9c-90c2-a58880f195c1 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:37.619885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a49b0add-4682-4c9c-90c2-a58880f195c1 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:37.620477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a49b0add-4682-4c9c-90c2-a58880f195c1 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:37.621065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a49b0add-4682-4c9c-90c2-a58880f195c1 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:37.646012 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-35e1c3d8-9cc6-4e02-9388-805f6abcddba tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/detail?reservation_id=r-v0v8eeo1" status: 200 len: 2921 microversion: 2.1 time: 0.710474 Oct 29 02:47:37.647753 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 311/633] 10.222.0.46 () {58 vars in 1197 bytes} [Sat Oct 29 02:47:36 2022] GET /compute/v2.1/servers/detail?reservation_id=r-v0v8eeo1 => generated 2921 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:37.654848 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1294c9aa-003e-405f-86c9-c2d2c4d21316 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:37.655499 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1294c9aa-003e-405f-86c9-c2d2c4d21316 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:37.664318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1294c9aa-003e-405f-86c9-c2d2c4d21316 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:37.665324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1294c9aa-003e-405f-86c9-c2d2c4d21316 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:37.665445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1294c9aa-003e-405f-86c9-c2d2c4d21316 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:37.666803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1294c9aa-003e-405f-86c9-c2d2c4d21316 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:37.667927 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1294c9aa-003e-405f-86c9-c2d2c4d21316 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:37.668365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1294c9aa-003e-405f-86c9-c2d2c4d21316 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:37.799991 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-a49b0add-4682-4c9c-90c2-a58880f195c1 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lazy-loading 'services' on Instance uuid 0766d417-a358-4ad6-9af4-75f7d61f82eb {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:37.841714 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a49b0add-4682-4c9c-90c2-a58880f195c1 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1929 microversion: 2.75 time: 0.236804 Oct 29 02:47:37.859168 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 323/634] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:37 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1929 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:37.871368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5a10e1d6-97b5-49e7-9e34-87f0915054c1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:37.911587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.compute.server_groups [None req-5a10e1d6-97b5-49e7-9e34-87f0915054c1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Querying cell 5270c754-82e2-4d8e-a02e-4533aa854f76(cell1) for 2 instances {{(pid=127125) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 29 02:47:37.923505 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a10e1d6-97b5-49e7-9e34-87f0915054c1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:37.924090 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a10e1d6-97b5-49e7-9e34-87f0915054c1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:37.924809 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a10e1d6-97b5-49e7-9e34-87f0915054c1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:37.977128 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5a10e1d6-97b5-49e7-9e34-87f0915054c1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups/428b6e58-cae1-4349-bcd4-52aed500cadf" status: 200 len: 271 microversion: 2.1 time: 0.109364 Oct 29 02:47:37.978569 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 324/635] 10.222.0.46 () {58 vars in 1263 bytes} [Sat Oct 29 02:47:37 2022] GET /compute/v2.1/os-server-groups/428b6e58-cae1-4349-bcd4-52aed500cadf => generated 271 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:37.996300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-27c187f6-6c12-464c-9d90-378a47dd9e94 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:37.997195 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-27c187f6-6c12-464c-9d90-378a47dd9e94 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: 4c912c93-9d84-4d95-8dc3-103233acff10] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:38.004033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27c187f6-6c12-464c-9d90-378a47dd9e94 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:38.004676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27c187f6-6c12-464c-9d90-378a47dd9e94 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:38.005264 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27c187f6-6c12-464c-9d90-378a47dd9e94 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:38.006092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27c187f6-6c12-464c-9d90-378a47dd9e94 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:38.006770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27c187f6-6c12-464c-9d90-378a47dd9e94 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:38.007852 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27c187f6-6c12-464c-9d90-378a47dd9e94 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:38.236999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-27c187f6-6c12-464c-9d90-378a47dd9e94 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:38.263196 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-27c187f6-6c12-464c-9d90-378a47dd9e94 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10" status: 200 len: 1319 microversion: 2.1 time: 0.281479 Oct 29 02:47:38.266054 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 325/636] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:37 2022] GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10 => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:38.276668 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-08fbde8f-17f1-4cc4-9434-acd7069e9230 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:38.278195 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-08fbde8f-17f1-4cc4-9434-acd7069e9230 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] [instance: 03261ebe-4be4-4e74-bd8d-ff4a5ae066b1] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:38.292086 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08fbde8f-17f1-4cc4-9434-acd7069e9230 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:38.293486 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08fbde8f-17f1-4cc4-9434-acd7069e9230 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:38.294568 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08fbde8f-17f1-4cc4-9434-acd7069e9230 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:38.295783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08fbde8f-17f1-4cc4-9434-acd7069e9230 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:38.298875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08fbde8f-17f1-4cc4-9434-acd7069e9230 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:38.300016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08fbde8f-17f1-4cc4-9434-acd7069e9230 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:38.350404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1294c9aa-003e-405f-86c9-c2d2c4d21316 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:38.372088 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1294c9aa-003e-405f-86c9-c2d2c4d21316 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 200 len: 1521 microversion: 2.1 time: 0.722836 Oct 29 02:47:38.373287 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 312/637] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:37 2022] GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 1521 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:38.378146 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1ff1414e-b5f7-4897-b883-847a7f15d48f tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:38.378980 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1ff1414e-b5f7-4897-b883-847a7f15d48f tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: aff333bb-fff4-4b3e-a3f9-a567b7786a62] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:38.393578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ff1414e-b5f7-4897-b883-847a7f15d48f tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:38.394068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ff1414e-b5f7-4897-b883-847a7f15d48f tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:38.394511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ff1414e-b5f7-4897-b883-847a7f15d48f tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:38.395204 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ff1414e-b5f7-4897-b883-847a7f15d48f tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:38.395649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ff1414e-b5f7-4897-b883-847a7f15d48f tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:38.403685 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ff1414e-b5f7-4897-b883-847a7f15d48f tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:38.461170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:38.555293 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-08fbde8f-17f1-4cc4-9434-acd7069e9230 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/03261ebe-4be4-4e74-bd8d-ff4a5ae066b1" status: 200 len: 1615 microversion: 2.1 time: 0.285100 Oct 29 02:47:38.557418 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 326/638] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:38 2022] GET /compute/v2.1/servers/03261ebe-4be4-4e74-bd8d-ff4a5ae066b1 => generated 1615 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:38.569452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0644154c-9634-4a35-aa7c-c46e83a343ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:38.571997 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0644154c-9634-4a35-aa7c-c46e83a343ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:38.590901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0644154c-9634-4a35-aa7c-c46e83a343ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:38.591681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0644154c-9634-4a35-aa7c-c46e83a343ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:38.592130 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0644154c-9634-4a35-aa7c-c46e83a343ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:38.592947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0644154c-9634-4a35-aa7c-c46e83a343ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:38.593401 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0644154c-9634-4a35-aa7c-c46e83a343ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:38.595381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0644154c-9634-4a35-aa7c-c46e83a343ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:38.660567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0644154c-9634-4a35-aa7c-c46e83a343ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:47:38.857084 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0644154c-9634-4a35-aa7c-c46e83a343ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 204 len: 0 microversion: 2.1 time: 0.296842 Oct 29 02:47:38.858901 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 327/639] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:47:38 2022] DELETE /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:47:38.873445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3aa69981-8e30-488d-bbfb-4938712a6965 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:38.874551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3aa69981-8e30-488d-bbfb-4938712a6965 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] [instance: d09276cf-e95a-47be-90e8-befb018ee5ab] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:38.884724 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3aa69981-8e30-488d-bbfb-4938712a6965 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:38.885463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3aa69981-8e30-488d-bbfb-4938712a6965 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:38.886263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3aa69981-8e30-488d-bbfb-4938712a6965 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:38.887263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3aa69981-8e30-488d-bbfb-4938712a6965 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:38.888034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3aa69981-8e30-488d-bbfb-4938712a6965 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:38.888718 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3aa69981-8e30-488d-bbfb-4938712a6965 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:39.071906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1ff1414e-b5f7-4897-b883-847a7f15d48f tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:39.082824 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1ff1414e-b5f7-4897-b883-847a7f15d48f tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62" status: 200 len: 1390 microversion: 2.1 time: 0.708197 Oct 29 02:47:39.085879 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 313/640] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:38 2022] GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62 => generated 1390 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:39.096709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1a588b7b-b8f1-4e42-9dfd-0dc3608fd54b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:39.097333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1a588b7b-b8f1-4e42-9dfd-0dc3608fd54b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:39.111149 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1a588b7b-b8f1-4e42-9dfd-0dc3608fd54b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:39.113286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1a588b7b-b8f1-4e42-9dfd-0dc3608fd54b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:39.114320 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1a588b7b-b8f1-4e42-9dfd-0dc3608fd54b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:39.117628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1a588b7b-b8f1-4e42-9dfd-0dc3608fd54b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:39.118296 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1a588b7b-b8f1-4e42-9dfd-0dc3608fd54b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:39.118877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1a588b7b-b8f1-4e42-9dfd-0dc3608fd54b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:39.119755 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3aa69981-8e30-488d-bbfb-4938712a6965 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab" status: 200 len: 1615 microversion: 2.1 time: 0.256701 Oct 29 02:47:39.120913 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 328/641] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:38 2022] GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab => generated 1615 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:39.126885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-e8a0ee4b-d3f1-4b2e-9d2c-ed8bc86200f1 req-459e23a0-998d-4e95-b479-99765f9fa70c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aff333bb-fff4-4b3e-a3f9-a567b7786a62", "name": "network-vif-plugged", "status": "completed", "tag": "00a9c6e8-5769-4bcd-a23e-c0242f3e6acd"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:39.141896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e8a0ee4b-d3f1-4b2e-9d2c-ed8bc86200f1 req-459e23a0-998d-4e95-b479-99765f9fa70c service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:39.142617 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e8a0ee4b-d3f1-4b2e-9d2c-ed8bc86200f1 req-459e23a0-998d-4e95-b479-99765f9fa70c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:39.143183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e8a0ee4b-d3f1-4b2e-9d2c-ed8bc86200f1 req-459e23a0-998d-4e95-b479-99765f9fa70c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:39.177650 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-e8a0ee4b-d3f1-4b2e-9d2c-ed8bc86200f1 req-459e23a0-998d-4e95-b479-99765f9fa70c service nova] Creating event network-vif-plugged:00a9c6e8-5769-4bcd-a23e-c0242f3e6acd for instance aff333bb-fff4-4b3e-a3f9-a567b7786a62 on n-h2-862967-2 Oct 29 02:47:39.189748 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-e8a0ee4b-d3f1-4b2e-9d2c-ed8bc86200f1 req-459e23a0-998d-4e95-b479-99765f9fa70c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067147 Oct 29 02:47:39.190402 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 329/642] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:39.217814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2115a048-ffb5-4b6c-ba01-e58cf2d53761 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:39.222145 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2115a048-ffb5-4b6c-ba01-e58cf2d53761 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:39.253660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2115a048-ffb5-4b6c-ba01-e58cf2d53761 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:39.254150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2115a048-ffb5-4b6c-ba01-e58cf2d53761 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:39.263526 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2115a048-ffb5-4b6c-ba01-e58cf2d53761 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:39.264626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2115a048-ffb5-4b6c-ba01-e58cf2d53761 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:39.265289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2115a048-ffb5-4b6c-ba01-e58cf2d53761 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:39.266649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2115a048-ffb5-4b6c-ba01-e58cf2d53761 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:39.563529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2115a048-ffb5-4b6c-ba01-e58cf2d53761 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:39.576922 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2115a048-ffb5-4b6c-ba01-e58cf2d53761 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 200 len: 1527 microversion: 2.1 time: 0.385247 Oct 29 02:47:39.591604 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 330/643] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:39 2022] GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 1527 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:39.603352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6186fa68-798e-4efa-a73c-39cba70751ce tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:39.608655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6186fa68-798e-4efa-a73c-39cba70751ce tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:39.617578 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6186fa68-798e-4efa-a73c-39cba70751ce tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:39.618340 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6186fa68-798e-4efa-a73c-39cba70751ce tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:39.618962 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6186fa68-798e-4efa-a73c-39cba70751ce tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:39.620041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6186fa68-798e-4efa-a73c-39cba70751ce tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:39.620717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6186fa68-798e-4efa-a73c-39cba70751ce tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:39.621475 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6186fa68-798e-4efa-a73c-39cba70751ce tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:39.625105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:39.726161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-6186fa68-798e-4efa-a73c-39cba70751ce tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lazy-loading 'services' on Instance uuid 0766d417-a358-4ad6-9af4-75f7d61f82eb {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:39.750568 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6186fa68-798e-4efa-a73c-39cba70751ce tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1929 microversion: 2.75 time: 0.156865 Oct 29 02:47:39.764553 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 331/644] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:39 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1929 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:39.764553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0fdcbb52-21e9-4ef8-8eac-0f1f01e7aa42 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:39.764553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0fdcbb52-21e9-4ef8-8eac-0f1f01e7aa42 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: 4c912c93-9d84-4d95-8dc3-103233acff10] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:39.765431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fdcbb52-21e9-4ef8-8eac-0f1f01e7aa42 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:39.765926 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fdcbb52-21e9-4ef8-8eac-0f1f01e7aa42 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:39.766358 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fdcbb52-21e9-4ef8-8eac-0f1f01e7aa42 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:39.767099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fdcbb52-21e9-4ef8-8eac-0f1f01e7aa42 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:39.767546 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fdcbb52-21e9-4ef8-8eac-0f1f01e7aa42 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:39.767970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fdcbb52-21e9-4ef8-8eac-0f1f01e7aa42 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:39.906633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1a588b7b-b8f1-4e42-9dfd-0dc3608fd54b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:39.922771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1a588b7b-b8f1-4e42-9dfd-0dc3608fd54b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:39.929978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1a588b7b-b8f1-4e42-9dfd-0dc3608fd54b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:39.931246 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1a588b7b-b8f1-4e42-9dfd-0dc3608fd54b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 1568 microversion: 2.25 time: 0.844333 Oct 29 02:47:39.949275 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 314/645] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:39 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 1568 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:39.955849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7954f242-f8bb-4a6a-a18b-5c62f483b12a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1489103570", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "b65a6807-c8ad-44d0-93d7-931037ca8afd"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:39.967574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0fdcbb52-21e9-4ef8-8eac-0f1f01e7aa42 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:39.984153 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0fdcbb52-21e9-4ef8-8eac-0f1f01e7aa42 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10" status: 200 len: 1469 microversion: 2.1 time: 0.231197 Oct 29 02:47:40.008111 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 332/646] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:39 2022] GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10 => generated 1469 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:40.017408 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a989d349-9275-4019-aa01-71f1f9b9fe68 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:40.017954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a989d349-9275-4019-aa01-71f1f9b9fe68 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] [instance: 4c912c93-9d84-4d95-8dc3-103233acff10] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:40.031708 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a989d349-9275-4019-aa01-71f1f9b9fe68 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:40.033035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a989d349-9275-4019-aa01-71f1f9b9fe68 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:40.033632 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a989d349-9275-4019-aa01-71f1f9b9fe68 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:40.034644 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a989d349-9275-4019-aa01-71f1f9b9fe68 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:40.036090 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a989d349-9275-4019-aa01-71f1f9b9fe68 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:40.036596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a989d349-9275-4019-aa01-71f1f9b9fe68 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:40.039895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-7954f242-f8bb-4a6a-a18b-5c62f483b12a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] validate_networks() for None {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:47:40.090618 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-a989d349-9275-4019-aa01-71f1f9b9fe68 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Lazy-loading 'flavor' on Instance uuid 4c912c93-9d84-4d95-8dc3-103233acff10 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:40.187255 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a989d349-9275-4019-aa01-71f1f9b9fe68 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10/action" status: 202 len: 0 microversion: 2.1 time: 0.173723 Oct 29 02:47:40.189382 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 333/647] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:47:40 2022] POST /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 02:47:40.198382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-47afb7d6-36be-4665-b1bc-7c91ae4d668b tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:40.199154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-47afb7d6-36be-4665-b1bc-7c91ae4d668b tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: aff333bb-fff4-4b3e-a3f9-a567b7786a62] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:40.207123 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47afb7d6-36be-4665-b1bc-7c91ae4d668b tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:40.207633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47afb7d6-36be-4665-b1bc-7c91ae4d668b tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:40.208549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47afb7d6-36be-4665-b1bc-7c91ae4d668b tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:40.209291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47afb7d6-36be-4665-b1bc-7c91ae4d668b tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:40.209881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47afb7d6-36be-4665-b1bc-7c91ae4d668b tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:40.210474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47afb7d6-36be-4665-b1bc-7c91ae4d668b tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:40.562427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-47afb7d6-36be-4665-b1bc-7c91ae4d668b tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:40.587590 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-47afb7d6-36be-4665-b1bc-7c91ae4d668b tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62" status: 200 len: 1390 microversion: 2.1 time: 0.396325 Oct 29 02:47:40.602119 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 334/648] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:40 2022] GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62 => generated 1390 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:40.617373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-eb50d817-313a-4071-985b-83b94aed883c tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:40.618503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-eb50d817-313a-4071-985b-83b94aed883c tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: 4c912c93-9d84-4d95-8dc3-103233acff10] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:40.636562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb50d817-313a-4071-985b-83b94aed883c tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:40.637484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb50d817-313a-4071-985b-83b94aed883c tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:40.638314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb50d817-313a-4071-985b-83b94aed883c tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:40.639604 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb50d817-313a-4071-985b-83b94aed883c tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:40.640639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb50d817-313a-4071-985b-83b94aed883c tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:40.641415 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb50d817-313a-4071-985b-83b94aed883c tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:40.680792 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-7954f242-f8bb-4a6a-a18b-5c62f483b12a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:47:40.681406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-7954f242-f8bb-4a6a-a18b-5c62f483b12a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:47:40.681742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-7954f242-f8bb-4a6a-a18b-5c62f483b12a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:47:40.682159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-7954f242-f8bb-4a6a-a18b-5c62f483b12a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:47:40.682740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-7954f242-f8bb-4a6a-a18b-5c62f483b12a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:47:40.701125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7954f242-f8bb-4a6a-a18b-5c62f483b12a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:40.701935 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7954f242-f8bb-4a6a-a18b-5c62f483b12a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:40.702586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7954f242-f8bb-4a6a-a18b-5c62f483b12a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:40.703786 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7954f242-f8bb-4a6a-a18b-5c62f483b12a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:40.704446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7954f242-f8bb-4a6a-a18b-5c62f483b12a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:40.705093 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7954f242-f8bb-4a6a-a18b-5c62f483b12a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:40.751319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-7954f242-f8bb-4a6a-a18b-5c62f483b12a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for project dcc6da8e69e041e19023a53a23e33393. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:40.758821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=100 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:40.760582 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-7954f242-f8bb-4a6a-a18b-5c62f483b12a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for user 509ce04aeb3847f084629201bd7ae5d6 and project dcc6da8e69e041e19023a53a23e33393. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:40.777844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7954f242-f8bb-4a6a-a18b-5c62f483b12a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:47:40.780882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7954f242-f8bb-4a6a-a18b-5c62f483b12a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: f8fd44ee-f170-4aba-b86d-4d096a720561] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:47:40.917143 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7954f242-f8bb-4a6a-a18b-5c62f483b12a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.966470 Oct 29 02:47:40.919948 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 315/649] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:47:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:47:40.925954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bef0fb9b-8aeb-4b26-9101-ce59891c8a1f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:40.926946 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bef0fb9b-8aeb-4b26-9101-ce59891c8a1f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:40.940980 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bef0fb9b-8aeb-4b26-9101-ce59891c8a1f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:40.941785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bef0fb9b-8aeb-4b26-9101-ce59891c8a1f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:40.942400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bef0fb9b-8aeb-4b26-9101-ce59891c8a1f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:40.943409 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bef0fb9b-8aeb-4b26-9101-ce59891c8a1f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:40.944948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bef0fb9b-8aeb-4b26-9101-ce59891c8a1f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:40.945602 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bef0fb9b-8aeb-4b26-9101-ce59891c8a1f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:41.330208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-eb50d817-313a-4071-985b-83b94aed883c tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:41.339948 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-eb50d817-313a-4071-985b-83b94aed883c tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10" status: 200 len: 1477 microversion: 2.1 time: 0.736169 Oct 29 02:47:41.340557 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 335/650] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:40 2022] GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10 => generated 1477 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:41.387360 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6dcbc52b-ff01-4a87-807b-4288b48515de tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:41.389815 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6dcbc52b-ff01-4a87-807b-4288b48515de tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:41.417648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6dcbc52b-ff01-4a87-807b-4288b48515de tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:41.418478 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6dcbc52b-ff01-4a87-807b-4288b48515de tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:41.419104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6dcbc52b-ff01-4a87-807b-4288b48515de tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:41.419998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6dcbc52b-ff01-4a87-807b-4288b48515de tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:41.421260 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6dcbc52b-ff01-4a87-807b-4288b48515de tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:41.421865 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6dcbc52b-ff01-4a87-807b-4288b48515de tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:41.555791 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-6dcbc52b-ff01-4a87-807b-4288b48515de tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lazy-loading 'services' on Instance uuid 0766d417-a358-4ad6-9af4-75f7d61f82eb {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:41.606656 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6dcbc52b-ff01-4a87-807b-4288b48515de tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1929 microversion: 2.75 time: 0.243549 Oct 29 02:47:41.622766 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 336/651] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:41 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1929 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:41.626880 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bef0fb9b-8aeb-4b26-9101-ce59891c8a1f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:41.641323 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bef0fb9b-8aeb-4b26-9101-ce59891c8a1f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 200 len: 1527 microversion: 2.1 time: 0.719945 Oct 29 02:47:41.642342 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 316/652] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:40 2022] GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 1527 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:41.645042 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b70a5371-7f81-475e-ab5e-0fbc366de6c2 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:41.645962 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b70a5371-7f81-475e-ab5e-0fbc366de6c2 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: f8fd44ee-f170-4aba-b86d-4d096a720561] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:41.652797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d36bcd12-c1e4-4424-ac31-51017237262b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:41.655782 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d36bcd12-c1e4-4424-ac31-51017237262b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:41.664076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b70a5371-7f81-475e-ab5e-0fbc366de6c2 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:41.664325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b70a5371-7f81-475e-ab5e-0fbc366de6c2 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:41.664727 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b70a5371-7f81-475e-ab5e-0fbc366de6c2 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:41.665431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b70a5371-7f81-475e-ab5e-0fbc366de6c2 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:41.665954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b70a5371-7f81-475e-ab5e-0fbc366de6c2 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:41.666377 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b70a5371-7f81-475e-ab5e-0fbc366de6c2 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:41.676495 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d36bcd12-c1e4-4424-ac31-51017237262b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:41.681246 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d36bcd12-c1e4-4424-ac31-51017237262b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:41.682558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d36bcd12-c1e4-4424-ac31-51017237262b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:41.683384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d36bcd12-c1e4-4424-ac31-51017237262b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:41.683932 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d36bcd12-c1e4-4424-ac31-51017237262b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:41.686030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d36bcd12-c1e4-4424-ac31-51017237262b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:41.852551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b70a5371-7f81-475e-ab5e-0fbc366de6c2 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:41.883809 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b70a5371-7f81-475e-ab5e-0fbc366de6c2 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561" status: 200 len: 1221 microversion: 2.1 time: 0.255792 Oct 29 02:47:41.887127 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 337/653] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:41 2022] GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561 => generated 1221 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:41.896825 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a420887a-54f3-4e11-a4c4-88d90d360f3e tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:41.898117 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a420887a-54f3-4e11-a4c4-88d90d360f3e tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: aff333bb-fff4-4b3e-a3f9-a567b7786a62] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:41.914539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a420887a-54f3-4e11-a4c4-88d90d360f3e tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:41.915868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a420887a-54f3-4e11-a4c4-88d90d360f3e tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:41.916554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a420887a-54f3-4e11-a4c4-88d90d360f3e tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:41.918052 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a420887a-54f3-4e11-a4c4-88d90d360f3e tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:41.919558 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a420887a-54f3-4e11-a4c4-88d90d360f3e tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:41.920286 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a420887a-54f3-4e11-a4c4-88d90d360f3e tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:42.240696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a420887a-54f3-4e11-a4c4-88d90d360f3e tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:42.253759 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a420887a-54f3-4e11-a4c4-88d90d360f3e tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62" status: 200 len: 1587 microversion: 2.1 time: 0.364811 Oct 29 02:47:42.266474 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 338/654] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:41 2022] GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62 => generated 1587 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:42.278018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-c4bf2f54-3e8d-455c-bd50-13db6dda317f req-654afe9e-955b-4ea8-8ab5-6d455d2105e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1cfd9d1-24b9-4d99-851e-609ece042e43", "name": "network-vif-plugged", "status": "completed", "tag": "b6508838-de98-4696-9b82-10686564ee22"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:42.300572 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c4bf2f54-3e8d-455c-bd50-13db6dda317f req-654afe9e-955b-4ea8-8ab5-6d455d2105e6 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:42.301034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c4bf2f54-3e8d-455c-bd50-13db6dda317f req-654afe9e-955b-4ea8-8ab5-6d455d2105e6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:42.303970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c4bf2f54-3e8d-455c-bd50-13db6dda317f req-654afe9e-955b-4ea8-8ab5-6d455d2105e6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:42.320007 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-c4bf2f54-3e8d-455c-bd50-13db6dda317f req-654afe9e-955b-4ea8-8ab5-6d455d2105e6 service nova] Creating event network-vif-plugged:b6508838-de98-4696-9b82-10686564ee22 for instance a1cfd9d1-24b9-4d99-851e-609ece042e43 on n-h1-862967-2 Oct 29 02:47:42.326608 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-c4bf2f54-3e8d-455c-bd50-13db6dda317f req-654afe9e-955b-4ea8-8ab5-6d455d2105e6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057491 Oct 29 02:47:42.328145 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 339/655] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:42.335483 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6674b535-ace8-4f6f-a683-1fb82abe9971 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:42.336071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6674b535-ace8-4f6f-a683-1fb82abe9971 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: aff333bb-fff4-4b3e-a3f9-a567b7786a62] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:42.342672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6674b535-ace8-4f6f-a683-1fb82abe9971 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:42.343375 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6674b535-ace8-4f6f-a683-1fb82abe9971 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:42.343962 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6674b535-ace8-4f6f-a683-1fb82abe9971 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:42.347831 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6674b535-ace8-4f6f-a683-1fb82abe9971 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:42.348572 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6674b535-ace8-4f6f-a683-1fb82abe9971 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:42.349104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6674b535-ace8-4f6f-a683-1fb82abe9971 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:42.496776 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6674b535-ace8-4f6f-a683-1fb82abe9971 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.166975 Oct 29 02:47:42.506348 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 340/656] 10.222.0.46 () {58 vars in 1275 bytes} [Sat Oct 29 02:47:42 2022] GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:42.513354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f1057fea-7ac3-4c3a-bbaf-c123bf2a326b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:42.516044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f1057fea-7ac3-4c3a-bbaf-c123bf2a326b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: 4c912c93-9d84-4d95-8dc3-103233acff10] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:42.533634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1057fea-7ac3-4c3a-bbaf-c123bf2a326b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:42.534503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1057fea-7ac3-4c3a-bbaf-c123bf2a326b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:42.535182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1057fea-7ac3-4c3a-bbaf-c123bf2a326b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:42.536427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1057fea-7ac3-4c3a-bbaf-c123bf2a326b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:42.537186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1057fea-7ac3-4c3a-bbaf-c123bf2a326b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:42.546702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1057fea-7ac3-4c3a-bbaf-c123bf2a326b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:42.730080 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d36bcd12-c1e4-4424-ac31-51017237262b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:42.753199 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d36bcd12-c1e4-4424-ac31-51017237262b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:42.754964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d36bcd12-c1e4-4424-ac31-51017237262b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:42.770618 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d36bcd12-c1e4-4424-ac31-51017237262b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 1543 microversion: 2.25 time: 1.114605 Oct 29 02:47:42.772100 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 317/657] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:41 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 1543 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:42.777816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7ef033ff-c028-4726-975c-5db00d4d0e0d tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:42.778690 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7ef033ff-c028-4726-975c-5db00d4d0e0d tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:42.790536 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ef033ff-c028-4726-975c-5db00d4d0e0d tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:42.795186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ef033ff-c028-4726-975c-5db00d4d0e0d tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:42.795831 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ef033ff-c028-4726-975c-5db00d4d0e0d tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:42.796801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ef033ff-c028-4726-975c-5db00d4d0e0d tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:42.797408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ef033ff-c028-4726-975c-5db00d4d0e0d tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:42.798006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ef033ff-c028-4726-975c-5db00d4d0e0d tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:43.063801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-7ef033ff-c028-4726-975c-5db00d4d0e0d tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lazy-loading 'services' on Instance uuid 0766d417-a358-4ad6-9af4-75f7d61f82eb {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:43.116141 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7ef033ff-c028-4726-975c-5db00d4d0e0d tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1929 microversion: 2.75 time: 0.340095 Oct 29 02:47:43.116920 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 318/658] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:42 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1929 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:43.154054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5a8098b7-9d37-4d71-81d9-a3fe004bf8ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:43.162678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5a8098b7-9d37-4d71-81d9-a3fe004bf8ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:43.181698 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a8098b7-9d37-4d71-81d9-a3fe004bf8ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:43.182569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a8098b7-9d37-4d71-81d9-a3fe004bf8ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:43.183435 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a8098b7-9d37-4d71-81d9-a3fe004bf8ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:43.186925 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a8098b7-9d37-4d71-81d9-a3fe004bf8ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:43.187990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a8098b7-9d37-4d71-81d9-a3fe004bf8ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:43.199788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a8098b7-9d37-4d71-81d9-a3fe004bf8ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:43.252176 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a8098b7-9d37-4d71-81d9-a3fe004bf8ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:43.253132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a8098b7-9d37-4d71-81d9-a3fe004bf8ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:43.253816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a8098b7-9d37-4d71-81d9-a3fe004bf8ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:43.254455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-5a8098b7-9d37-4d71-81d9-a3fe004bf8ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lazy-loading 'fault' on Instance uuid a1cfd9d1-24b9-4d99-851e-609ece042e43 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:43.333205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5a8098b7-9d37-4d71-81d9-a3fe004bf8ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:43.356847 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5a8098b7-9d37-4d71-81d9-a3fe004bf8ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 200 len: 1315 microversion: 2.1 time: 0.225178 Oct 29 02:47:43.368654 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 319/659] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:43 2022] GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:43.375842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2da87399-8a24-47e7-9560-697966bd5c86 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Calling method '.version_select at 0x7ff0582c2dc0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:43.391089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2da87399-8a24-47e7-9560-697966bd5c86 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:43.393828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2da87399-8a24-47e7-9560-697966bd5c86 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:43.394479 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2da87399-8a24-47e7-9560-697966bd5c86 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:43.453936 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2da87399-8a24-47e7-9560-697966bd5c86 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 1100 microversion: 2.25 time: 0.083805 Oct 29 02:47:43.455100 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 320/660] 10.222.0.46 () {60 vars in 1184 bytes} [Sat Oct 29 02:47:43 2022] GET /compute/v2.1/os-migrations => generated 1100 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:43.474181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-09a80c32-8abb-4123-b9c7-2274b10453d8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:43.477608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-09a80c32-8abb-4123-b9c7-2274b10453d8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: f8fd44ee-f170-4aba-b86d-4d096a720561] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:43.492502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09a80c32-8abb-4123-b9c7-2274b10453d8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:43.509505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09a80c32-8abb-4123-b9c7-2274b10453d8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:43.510270 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09a80c32-8abb-4123-b9c7-2274b10453d8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:43.511258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09a80c32-8abb-4123-b9c7-2274b10453d8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:43.521634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09a80c32-8abb-4123-b9c7-2274b10453d8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:43.522449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09a80c32-8abb-4123-b9c7-2274b10453d8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:43.748134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-09a80c32-8abb-4123-b9c7-2274b10453d8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:43.760991 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-09a80c32-8abb-4123-b9c7-2274b10453d8 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561" status: 200 len: 1275 microversion: 2.1 time: 0.304341 Oct 29 02:47:43.761613 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 321/661] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:43 2022] GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561 => generated 1275 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:43.779498 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-69557569-5ad8-442e-996e-ce12896bd6b2 req-43cf58ff-1c7f-4ddc-af34-44a569cf7887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1cfd9d1-24b9-4d99-851e-609ece042e43", "name": "network-vif-deleted", "tag": "b6508838-de98-4696-9b82-10686564ee22"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:43.804576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-69557569-5ad8-442e-996e-ce12896bd6b2 req-43cf58ff-1c7f-4ddc-af34-44a569cf7887 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:43.805033 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-69557569-5ad8-442e-996e-ce12896bd6b2 req-43cf58ff-1c7f-4ddc-af34-44a569cf7887 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:43.805488 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-69557569-5ad8-442e-996e-ce12896bd6b2 req-43cf58ff-1c7f-4ddc-af34-44a569cf7887 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:43.824959 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-69557569-5ad8-442e-996e-ce12896bd6b2 req-43cf58ff-1c7f-4ddc-af34-44a569cf7887 service nova] Creating event network-vif-deleted:b6508838-de98-4696-9b82-10686564ee22 for instance a1cfd9d1-24b9-4d99-851e-609ece042e43 on n-h1-862967-2 Oct 29 02:47:43.841978 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-69557569-5ad8-442e-996e-ce12896bd6b2 req-43cf58ff-1c7f-4ddc-af34-44a569cf7887 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077859 Oct 29 02:47:43.842712 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 322/662] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:43.867055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f18e082b-c342-40fb-9d1f-7a6166ea04c1 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:43.868468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f18e082b-c342-40fb-9d1f-7a6166ea04c1 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:43.878069 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f18e082b-c342-40fb-9d1f-7a6166ea04c1 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:43.879103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f18e082b-c342-40fb-9d1f-7a6166ea04c1 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:43.879753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f18e082b-c342-40fb-9d1f-7a6166ea04c1 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:43.880785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f18e082b-c342-40fb-9d1f-7a6166ea04c1 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:43.881450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f18e082b-c342-40fb-9d1f-7a6166ea04c1 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:43.882734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f18e082b-c342-40fb-9d1f-7a6166ea04c1 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:44.359093 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-f18e082b-c342-40fb-9d1f-7a6166ea04c1 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lazy-loading 'services' on Instance uuid 0a0ec4a8-4cf9-4596-bc31-797c86447aa0 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:44.420667 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f18e082b-c342-40fb-9d1f-7a6166ea04c1 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 2036 microversion: 2.25 time: 0.559889 Oct 29 02:47:44.440798 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 323/663] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:43 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 2036 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:44.440798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e9af251e-e8a6-47d9-b616-806bea735cf8 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:44.457821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e9af251e-e8a6-47d9-b616-806bea735cf8 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:44.474256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9af251e-e8a6-47d9-b616-806bea735cf8 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:44.474895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9af251e-e8a6-47d9-b616-806bea735cf8 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:44.475352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9af251e-e8a6-47d9-b616-806bea735cf8 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:44.476124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9af251e-e8a6-47d9-b616-806bea735cf8 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:44.482466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9af251e-e8a6-47d9-b616-806bea735cf8 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:44.482973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9af251e-e8a6-47d9-b616-806bea735cf8 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:44.771845 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-e9af251e-e8a6-47d9-b616-806bea735cf8 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lazy-loading 'services' on Instance uuid 0766d417-a358-4ad6-9af4-75f7d61f82eb {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:44.807985 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e9af251e-e8a6-47d9-b616-806bea735cf8 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1929 microversion: 2.75 time: 0.378652 Oct 29 02:47:44.808614 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 324/664] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:44 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1929 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:44.813202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a8f37c99-d329-4a24-b7e4-456c77d24b96 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:44.813812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a8f37c99-d329-4a24-b7e4-456c77d24b96 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:44.825929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8f37c99-d329-4a24-b7e4-456c77d24b96 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:44.826416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8f37c99-d329-4a24-b7e4-456c77d24b96 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:44.826850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8f37c99-d329-4a24-b7e4-456c77d24b96 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:44.827558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8f37c99-d329-4a24-b7e4-456c77d24b96 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:44.828012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8f37c99-d329-4a24-b7e4-456c77d24b96 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:44.828436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8f37c99-d329-4a24-b7e4-456c77d24b96 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:44.844753 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-a8f37c99-d329-4a24-b7e4-456c77d24b96 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] HTTP exception thrown: Instance a1cfd9d1-24b9-4d99-851e-609ece042e43 could not be found. Oct 29 02:47:44.862962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a8f37c99-d329-4a24-b7e4-456c77d24b96 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Request method failure captured: Oct 29 02:47:44.862962 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 HTTP/1.1 Oct 29 02:47:44.862962 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:47:44.862962 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:47:44.862962 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:47:44.862962 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:47:44.862962 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:47:44.862962 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:47:44.862962 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:47:44.862962 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:47:44.862962 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJQe_uEcQU7TWvWTWyYHk2tBfhyW3anQlq9IlbMuIEkf7vn933sPmCKARJnxQpZiUZK1LvxWi4oqgPbQrdfUsgmfgxV95FnHLrMyZSrDr2oYF-e8DjjcOj7SOyLBpFsBspJHWMF4bxtFDAQHeniPMEGa1F2s-2gEJ_CIW5xBvV79ZDc Oct 29 02:47:44.862962 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:47:44.862962 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:47:44.862962 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:47:44.862962 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:47:44.862962 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:47:44.862962 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:47:44.862962 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 94814dc564d04e688714ac064c7d1b3b Oct 29 02:47:44.862962 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:47:44.862962 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:47:44.862962 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:47:44.865323 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/94814dc564d04e688714ac064c7d1b3b"}]}] Oct 29 02:47:44.865323 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:47:44.865323 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 94814dc564d04e688714ac064c7d1b3b Oct 29 02:47:44.865323 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:47:44.865323 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ImagesOneServerNegativeTestJSON-13999867-project Oct 29 02:47:44.865323 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:47:44.865323 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:47:44.865323 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 6862cd2470624f01a8bc1d371aa03962 Oct 29 02:47:44.865323 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-13999867-project Oct 29 02:47:44.865323 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:47:44.865323 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance a1cfd9d1-24b9-4d99-851e-609ece042e43 could not be found. Oct 29 02:47:44.865323 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'a1cfd9d1-24b9-4d99-851e-609ece042e43'} Oct 29 02:47:44.866457 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:47:44.866457 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:47:44.866457 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:47:44.866457 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:47:44.866457 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:47:44.866457 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:47:44.866457 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:47:44.866457 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:47:44.866457 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:47:44.866457 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:47:44.866457 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1cfd9d1-24b9-4d99-851e-609ece042e43 could not be found. Oct 29 02:47:44.866457 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:47:44.866457 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:47:44.866457 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:47:44.866457 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:47:44.866457 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:47:44.866457 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:47:44.866457 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:47:44.866457 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:47:44.866457 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:47:44.867779 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:47:44.867779 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:47:44.867779 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:47:44.867779 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:47:44.867779 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:47:44.867779 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:47:44.867779 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:47:44.867779 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1cfd9d1-24b9-4d99-851e-609ece042e43 could not be found. Oct 29 02:47:44.867779 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:47:44.867779 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:47:44.867779 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:47:44.867779 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:47:44.867779 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:47:44.867779 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:47:44.867779 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:47:44.867779 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:47:44.867779 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1cfd9d1-24b9-4d99-851e-609ece042e43 could not be found. Oct 29 02:47:44.867779 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:47:44.870928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a8f37c99-d329-4a24-b7e4-456c77d24b96 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Returning 404 to user: Instance a1cfd9d1-24b9-4d99-851e-609ece042e43 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:47:44.871424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f1057fea-7ac3-4c3a-bbaf-c123bf2a326b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:44.872751 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a8f37c99-d329-4a24-b7e4-456c77d24b96 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 404 len: 111 microversion: 2.1 time: 0.062945 Oct 29 02:47:44.874027 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 325/665] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:44 2022] GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:47:44.879378 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-027f44a1-1878-4e3c-9034-bae0d956543b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Action: 'create', calling method: .version_select at 0x7ff05827c940>, body: {"keypair": {"name": "tempest-keypair-151434447", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEbkFbml0ghbBNGYwTsBEYN/cYDn3+peDjk/v10Ytta2jfltnTaayL67q4gQh3e/ce4V6Wn/UnrEqhCbspVCfv4GRmrR+W3PbUbt6rG/lXJWGK2tkoNXw9OHSAW/QR6Eg=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:44.891523 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f1057fea-7ac3-4c3a-bbaf-c123bf2a326b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10" status: 200 len: 1460 microversion: 2.1 time: 2.383104 Oct 29 02:47:44.897957 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 341/666] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:42 2022] GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10 => generated 1460 bytes in 2391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:44.905583 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fa09a1f1-274d-4b8f-ba33-a8e2167b2793 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:44.906199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fa09a1f1-274d-4b8f-ba33-a8e2167b2793 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: f8fd44ee-f170-4aba-b86d-4d096a720561] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:44.912930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-027f44a1-1878-4e3c-9034-bae0d956543b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Getting quotas for project f86634862bd64e0f9f00972e4ce0982b. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:44.918139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-027f44a1-1878-4e3c-9034-bae0d956543b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Getting quotas for user 067d53567ea944b1b69ee7f461aa0c16 and project f86634862bd64e0f9f00972e4ce0982b. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:44.934110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa09a1f1-274d-4b8f-ba33-a8e2167b2793 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:44.936415 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa09a1f1-274d-4b8f-ba33-a8e2167b2793 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:44.937245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa09a1f1-274d-4b8f-ba33-a8e2167b2793 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:44.940686 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa09a1f1-274d-4b8f-ba33-a8e2167b2793 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:44.941433 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa09a1f1-274d-4b8f-ba33-a8e2167b2793 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:44.942190 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa09a1f1-274d-4b8f-ba33-a8e2167b2793 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:44.957198 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-027f44a1-1878-4e3c-9034-bae0d956543b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.081688 Oct 29 02:47:44.958139 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 326/667] 10.222.0.46 () {62 vars in 1200 bytes} [Sat Oct 29 02:47:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 83 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 02:47:44.969202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a2df0b14-b5cf-4ce2-a0af-db19aeac2a94 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Action: 'create', calling method: .version_select at 0x7ff05809a280>, body: {"keypair": {"name": "tempest-keypair-602620058", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZ3mN9ltt+WPaEnyIkA9kkbJmAPOFJaEGn13EcPSC4+DBRWGFQ+rOJH0T0alSLlAVMliON2nf/iQvRUe/kba1OzKrxA00I0qwT7RuHb94nLnBUVtCbJ6kYFVtOHMWvJ8A=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:45.025323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-a2df0b14-b5cf-4ce2-a0af-db19aeac2a94 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Getting quotas for project 94814dc564d04e688714ac064c7d1b3b. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:45.035539 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-a2df0b14-b5cf-4ce2-a0af-db19aeac2a94 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Getting quotas for user 6862cd2470624f01a8bc1d371aa03962 and project 94814dc564d04e688714ac064c7d1b3b. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:45.092454 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a2df0b14-b5cf-4ce2-a0af-db19aeac2a94 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.132272 Oct 29 02:47:45.094697 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 327/668] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 02:47:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:45.101390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-69f097f2-0759-4e25-87e0-65896c4f53e7 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:45.103112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-69f097f2-0759-4e25-87e0-65896c4f53e7 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] [instance: 4c912c93-9d84-4d95-8dc3-103233acff10] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:45.113728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69f097f2-0759-4e25-87e0-65896c4f53e7 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:45.114612 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69f097f2-0759-4e25-87e0-65896c4f53e7 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:45.115244 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69f097f2-0759-4e25-87e0-65896c4f53e7 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:45.116602 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69f097f2-0759-4e25-87e0-65896c4f53e7 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:45.117278 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69f097f2-0759-4e25-87e0-65896c4f53e7 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:45.117924 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69f097f2-0759-4e25-87e0-65896c4f53e7 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:45.195897 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fa09a1f1-274d-4b8f-ba33-a8e2167b2793 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:45.205989 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fa09a1f1-274d-4b8f-ba33-a8e2167b2793 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561" status: 200 len: 1275 microversion: 2.1 time: 0.306227 Oct 29 02:47:45.223502 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 342/669] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:44 2022] GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561 => generated 1275 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:45.840942 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-78c7100a-d5c1-494d-8ec1-12a838930643 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:45.841655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-78c7100a-d5c1-494d-8ec1-12a838930643 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:45.874545 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78c7100a-d5c1-494d-8ec1-12a838930643 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:45.876725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78c7100a-d5c1-494d-8ec1-12a838930643 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:45.878096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78c7100a-d5c1-494d-8ec1-12a838930643 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:45.879100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78c7100a-d5c1-494d-8ec1-12a838930643 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:45.879726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78c7100a-d5c1-494d-8ec1-12a838930643 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:45.880629 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78c7100a-d5c1-494d-8ec1-12a838930643 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:46.156793 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-78c7100a-d5c1-494d-8ec1-12a838930643 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lazy-loading 'services' on Instance uuid 0766d417-a358-4ad6-9af4-75f7d61f82eb {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:46.242562 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-69f097f2-0759-4e25-87e0-65896c4f53e7 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10" status: 200 len: 1611 microversion: 2.1 time: 1.145505 Oct 29 02:47:46.243811 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 328/670] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:45 2022] GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10 => generated 1611 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:46.258853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eaf0e1f2-811b-452a-868e-fc4876147cde tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:46.260437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-eaf0e1f2-811b-452a-868e-fc4876147cde tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: f8fd44ee-f170-4aba-b86d-4d096a720561] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:46.277213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaf0e1f2-811b-452a-868e-fc4876147cde tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:46.277713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaf0e1f2-811b-452a-868e-fc4876147cde tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:46.278253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaf0e1f2-811b-452a-868e-fc4876147cde tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:46.283971 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaf0e1f2-811b-452a-868e-fc4876147cde tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:46.284561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaf0e1f2-811b-452a-868e-fc4876147cde tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:46.285061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaf0e1f2-811b-452a-868e-fc4876147cde tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:46.290646 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-78c7100a-d5c1-494d-8ec1-12a838930643 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1929 microversion: 2.75 time: 0.451993 Oct 29 02:47:46.292989 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 343/671] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:45 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1929 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:47:46.323010 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e31345d4-46e7-4a1c-ac73-47fb5852c513 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:46.365126 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e31345d4-46e7-4a1c-ac73-47fb5852c513 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:46.375649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e31345d4-46e7-4a1c-ac73-47fb5852c513 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:46.376331 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e31345d4-46e7-4a1c-ac73-47fb5852c513 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:46.376930 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e31345d4-46e7-4a1c-ac73-47fb5852c513 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:46.377391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e31345d4-46e7-4a1c-ac73-47fb5852c513 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:46.377813 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e31345d4-46e7-4a1c-ac73-47fb5852c513 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:46.423959 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e31345d4-46e7-4a1c-ac73-47fb5852c513 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.120445 Oct 29 02:47:46.425390 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 344/672] 10.222.0.46 () {58 vars in 1176 bytes} [Sat Oct 29 02:47:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:46.441082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c537946e-9dc6-4b38-8ab8-9c95617bf80a tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:46.442749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c537946e-9dc6-4b38-8ab8-9c95617bf80a tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: aff333bb-fff4-4b3e-a3f9-a567b7786a62] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:46.453418 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c537946e-9dc6-4b38-8ab8-9c95617bf80a tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:46.453989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c537946e-9dc6-4b38-8ab8-9c95617bf80a tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:46.454650 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c537946e-9dc6-4b38-8ab8-9c95617bf80a tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:46.456392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c537946e-9dc6-4b38-8ab8-9c95617bf80a tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:46.457203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c537946e-9dc6-4b38-8ab8-9c95617bf80a tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:46.458108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c537946e-9dc6-4b38-8ab8-9c95617bf80a tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:46.563631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-eaf0e1f2-811b-452a-868e-fc4876147cde tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:46.579074 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eaf0e1f2-811b-452a-868e-fc4876147cde tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561" status: 200 len: 1275 microversion: 2.1 time: 0.329384 Oct 29 02:47:46.580141 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 329/673] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:46 2022] GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561 => generated 1275 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:46.590323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4f60d0d7-313f-43ce-8833-057df3998496 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862967-2", "block_migration": true, "disk_over_commit": false}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:46.593019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4f60d0d7-313f-43ce-8833-057df3998496 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] [instance: 4c912c93-9d84-4d95-8dc3-103233acff10] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:46.613977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f60d0d7-313f-43ce-8833-057df3998496 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:46.614632 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f60d0d7-313f-43ce-8833-057df3998496 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:46.615111 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f60d0d7-313f-43ce-8833-057df3998496 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:46.616729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f60d0d7-313f-43ce-8833-057df3998496 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:46.617219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f60d0d7-313f-43ce-8833-057df3998496 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:46.617660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f60d0d7-313f-43ce-8833-057df3998496 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:46.657622 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-4f60d0d7-313f-43ce-8833-057df3998496 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Lazy-loading 'flavor' on Instance uuid 4c912c93-9d84-4d95-8dc3-103233acff10 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:46.673928 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-4f60d0d7-313f-43ce-8833-057df3998496 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 4c912c93-9d84-4d95-8dc3-103233acff10 while it is in vm_state suspended Oct 29 02:47:46.684993 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4f60d0d7-313f-43ce-8833-057df3998496 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Request method failure captured: Oct 29 02:47:46.684993 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10/action HTTP/1.1 Oct 29 02:47:46.684993 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:47:46.684993 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:47:46.684993 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:47:46.684993 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 97 Oct 29 02:47:46.684993 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:47:46.684993 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:47:46.684993 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:47:46.684993 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:47:46.684993 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJQXvf5Gib4E7KyEci5pFWjmYY5z0yLAaYSeBFQHaxpUA6SLaaa__OmAOErXuiVwH6tknXmxGnUEAEC313Y2ketNbSxqdJDddop5Ll1ctX7XW8IFQgu5FJmgdtDqlGhgbGNBUKyp6GDalaNXBvK3sPt8p2JdXHpb5bcDc4wU-cCvK7s Oct 29 02:47:46.684993 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:47:46.684993 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:47:46.684993 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:47:46.684993 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:47:46.684993 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:47:46.684993 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:47:46.684993 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 75b0783e21594c4ba2f893d12b7b2114 Oct 29 02:47:46.684993 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-LiveMigrationNegativeTest-546326446 Oct 29 02:47:46.684993 n-d-862967-2 devstack@n-api.service[127124]: X-Role: admin,reader,member Oct 29 02:47:46.684993 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: admin,reader,member Oct 29 02:47:46.686845 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/75b0783e21594c4ba2f893d12b7b2114"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/75b0783e21594c4ba2f893d12b7b2114"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_75b0783e21594c4ba2f893d12b7b2114"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/75b0783e21594c4ba2f893d12b7b2114"}]}] Oct 29 02:47:46.686845 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-LiveMigrationNegativeTest-546326446 Oct 29 02:47:46.686845 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 75b0783e21594c4ba2f893d12b7b2114 Oct 29 02:47:46.686845 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-546326446 Oct 29 02:47:46.686845 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-LiveMigrationNegativeTest-546326446-project-admin Oct 29 02:47:46.686845 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:47:46.686845 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:47:46.686845 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 7c2347bc1dc54404b89c2c8887b9c91b Oct 29 02:47:46.686845 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-LiveMigrationNegativeTest-546326446-project-admin Oct 29 02:47:46.686845 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:47:46.686845 n-d-862967-2 devstack@n-api.service[127124]: {"os-migrateLive": {"host": "n-h2-862967-2", "block_migration": true, "disk_over_commit": false}} Oct 29 02:47:46.686845 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:47:46.687710 n-d-862967-2 devstack@n-api.service[127124]: exception: Cannot 'os-migrateLive' instance 4c912c93-9d84-4d95-8dc3-103233acff10 while it is in vm_state suspended Oct 29 02:47:46.687710 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '4c912c93-9d84-4d95-8dc3-103233acff10', 'body': {'os-migrateLive': {'host': 'n-h2-862967-2', 'block_migration': True, 'disk_over_commit': False}}} Oct 29 02:47:46.687710 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:47:46.687710 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:47:46.687710 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 29 02:47:46.687710 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 29 02:47:46.687710 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 29 02:47:46.687710 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 02:47:46.687710 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 02:47:46.687710 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 02:47:46.687710 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 29 02:47:46.687710 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 02:47:46.687710 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 02:47:46.687710 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 02:47:46.687710 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 29 02:47:46.687710 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 02:47:46.687710 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 29 02:47:46.687710 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 02:47:46.689165 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 02:47:46.689165 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 02:47:46.689165 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 02:47:46.689165 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 02:47:46.689165 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4c912c93-9d84-4d95-8dc3-103233acff10 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 29 02:47:46.689165 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:47:46.689165 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:47:46.689165 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:47:46.689165 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:47:46.689165 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:47:46.689165 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:47:46.689165 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:47:46.689165 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:47:46.689165 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:47:46.689165 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:47:46.689165 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:47:46.689165 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:47:46.689165 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:47:46.689165 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:47:46.689165 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:47:46.690619 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:47:46.690619 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 29 02:47:46.690619 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 29 02:47:46.690619 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 02:47:46.690619 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 02:47:46.690619 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 02:47:46.690619 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 4c912c93-9d84-4d95-8dc3-103233acff10 while it is in vm_state suspended Oct 29 02:47:46.690619 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:47:46.690619 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:47:46.690619 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:47:46.690619 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:47:46.690619 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:47:46.690619 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:47:46.690619 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:47:46.690619 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:47:46.690619 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 4c912c93-9d84-4d95-8dc3-103233acff10 while it is in vm_state suspended Oct 29 02:47:46.690619 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:47:46.694445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4f60d0d7-313f-43ce-8833-057df3998496 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 4c912c93-9d84-4d95-8dc3-103233acff10 while it is in vm_state suspended {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:47:46.697566 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4f60d0d7-313f-43ce-8833-057df3998496 tempest-LiveMigrationNegativeTest-546326446 tempest-LiveMigrationNegativeTest-546326446-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10/action" status: 409 len: 155 microversion: 2.1 time: 0.115229 Oct 29 02:47:46.701334 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 330/674] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:47:46 2022] POST /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10/action => generated 155 bytes in 121 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:47:46.706689 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-c985d26d-0e3f-439c-9e07-afae5d79512d req-9d822354-ef3a-434f-a5e1-c6c4e5d04e30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aff333bb-fff4-4b3e-a3f9-a567b7786a62", "tag": "00a9c6e8-5769-4bcd-a23e-c0242f3e6acd"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:46.729791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c985d26d-0e3f-439c-9e07-afae5d79512d req-9d822354-ef3a-434f-a5e1-c6c4e5d04e30 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:46.730683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c985d26d-0e3f-439c-9e07-afae5d79512d req-9d822354-ef3a-434f-a5e1-c6c4e5d04e30 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:46.731367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c985d26d-0e3f-439c-9e07-afae5d79512d req-9d822354-ef3a-434f-a5e1-c6c4e5d04e30 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:46.751683 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-c985d26d-0e3f-439c-9e07-afae5d79512d req-9d822354-ef3a-434f-a5e1-c6c4e5d04e30 service nova] Creating event network-changed:00a9c6e8-5769-4bcd-a23e-c0242f3e6acd for instance aff333bb-fff4-4b3e-a3f9-a567b7786a62 on n-h2-862967-2 Oct 29 02:47:46.761105 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-c985d26d-0e3f-439c-9e07-afae5d79512d req-9d822354-ef3a-434f-a5e1-c6c4e5d04e30 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058038 Oct 29 02:47:46.762340 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 331/675] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:46.769981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-39f8ef25-f2bb-4e03-9cf7-530476caa7a5 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:46.776362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-39f8ef25-f2bb-4e03-9cf7-530476caa7a5 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: 4c912c93-9d84-4d95-8dc3-103233acff10] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:46.787354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39f8ef25-f2bb-4e03-9cf7-530476caa7a5 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:46.788226 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39f8ef25-f2bb-4e03-9cf7-530476caa7a5 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:46.788912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39f8ef25-f2bb-4e03-9cf7-530476caa7a5 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:46.789910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39f8ef25-f2bb-4e03-9cf7-530476caa7a5 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:46.790675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39f8ef25-f2bb-4e03-9cf7-530476caa7a5 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:46.791353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39f8ef25-f2bb-4e03-9cf7-530476caa7a5 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:46.830711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-39f8ef25-f2bb-4e03-9cf7-530476caa7a5 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: 4c912c93-9d84-4d95-8dc3-103233acff10] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:47:46.884046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:46.978841 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-39f8ef25-f2bb-4e03-9cf7-530476caa7a5 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10" status: 204 len: 0 microversion: 2.1 time: 0.212535 Oct 29 02:47:46.986974 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 332/676] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:47:46 2022] DELETE /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:47:46.996746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5691b7b1-afcc-439c-a824-f3731438dfbf tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:46.997847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5691b7b1-afcc-439c-a824-f3731438dfbf tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: 4c912c93-9d84-4d95-8dc3-103233acff10] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:47.008014 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5691b7b1-afcc-439c-a824-f3731438dfbf tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:47.008789 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5691b7b1-afcc-439c-a824-f3731438dfbf tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:47.009365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5691b7b1-afcc-439c-a824-f3731438dfbf tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:47.010259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5691b7b1-afcc-439c-a824-f3731438dfbf tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:47.010912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5691b7b1-afcc-439c-a824-f3731438dfbf tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:47.011697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5691b7b1-afcc-439c-a824-f3731438dfbf tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:47.233902 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c537946e-9dc6-4b38-8ab8-9c95617bf80a tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:47.244508 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c537946e-9dc6-4b38-8ab8-9c95617bf80a tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62" status: 200 len: 1587 microversion: 2.1 time: 0.807240 Oct 29 02:47:47.245802 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 345/677] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:46 2022] GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62 => generated 1587 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:47.326612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9d1891a7-6e0d-481c-ba5a-18a723d0e898 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:47.327022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9d1891a7-6e0d-481c-ba5a-18a723d0e898 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:47.340019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d1891a7-6e0d-481c-ba5a-18a723d0e898 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:47.340688 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d1891a7-6e0d-481c-ba5a-18a723d0e898 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:47.341225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d1891a7-6e0d-481c-ba5a-18a723d0e898 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:47.342073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d1891a7-6e0d-481c-ba5a-18a723d0e898 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:47.342626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d1891a7-6e0d-481c-ba5a-18a723d0e898 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:47.343199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d1891a7-6e0d-481c-ba5a-18a723d0e898 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:47.526676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:47.545029 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-9d1891a7-6e0d-481c-ba5a-18a723d0e898 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lazy-loading 'services' on Instance uuid 0766d417-a358-4ad6-9af4-75f7d61f82eb {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:47.577435 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9d1891a7-6e0d-481c-ba5a-18a723d0e898 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1929 microversion: 2.75 time: 0.255102 Oct 29 02:47:47.584455 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 346/678] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:47 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1929 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:47:47.620464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-704a9f7f-b53b-4e97-bec3-b2cacb1b9a61 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:47.629892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-704a9f7f-b53b-4e97-bec3-b2cacb1b9a61 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: f8fd44ee-f170-4aba-b86d-4d096a720561] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:47.652204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-704a9f7f-b53b-4e97-bec3-b2cacb1b9a61 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:47.657608 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-704a9f7f-b53b-4e97-bec3-b2cacb1b9a61 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:47.660469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-704a9f7f-b53b-4e97-bec3-b2cacb1b9a61 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:47.661795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-704a9f7f-b53b-4e97-bec3-b2cacb1b9a61 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:47.662739 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-704a9f7f-b53b-4e97-bec3-b2cacb1b9a61 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:47.663718 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-704a9f7f-b53b-4e97-bec3-b2cacb1b9a61 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:47.744155 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5691b7b1-afcc-439c-a824-f3731438dfbf tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:47.758108 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5691b7b1-afcc-439c-a824-f3731438dfbf tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10" status: 200 len: 1466 microversion: 2.1 time: 0.764330 Oct 29 02:47:47.784885 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 333/679] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:46 2022] GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10 => generated 1466 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:48.619841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5dbed5f7-38a3-405a-a4e8-1ee8ed85e665 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:48.620459 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5dbed5f7-38a3-405a-a4e8-1ee8ed85e665 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:48.633198 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5dbed5f7-38a3-405a-a4e8-1ee8ed85e665 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:48.633689 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5dbed5f7-38a3-405a-a4e8-1ee8ed85e665 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:48.634123 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5dbed5f7-38a3-405a-a4e8-1ee8ed85e665 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:48.635006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5dbed5f7-38a3-405a-a4e8-1ee8ed85e665 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:48.635462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5dbed5f7-38a3-405a-a4e8-1ee8ed85e665 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:48.635886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5dbed5f7-38a3-405a-a4e8-1ee8ed85e665 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:48.834412 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-5dbed5f7-38a3-405a-a4e8-1ee8ed85e665 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lazy-loading 'services' on Instance uuid 0766d417-a358-4ad6-9af4-75f7d61f82eb {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:48.891363 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5dbed5f7-38a3-405a-a4e8-1ee8ed85e665 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1929 microversion: 2.75 time: 0.275676 Oct 29 02:47:48.896832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-704a9f7f-b53b-4e97-bec3-b2cacb1b9a61 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:48.912650 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-704a9f7f-b53b-4e97-bec3-b2cacb1b9a61 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561" status: 200 len: 1317 microversion: 2.1 time: 1.304281 Oct 29 02:47:48.912925 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 334/680] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:48 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1929 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:48.944683 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 347/681] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:47 2022] GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561 => generated 1317 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:48.951871 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-87b6f3cd-32aa-4a4b-b572-f71f8970a753 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:48.956119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-87b6f3cd-32aa-4a4b-b572-f71f8970a753 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: 4c912c93-9d84-4d95-8dc3-103233acff10] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:48.980473 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87b6f3cd-32aa-4a4b-b572-f71f8970a753 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:48.984014 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87b6f3cd-32aa-4a4b-b572-f71f8970a753 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:48.993357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87b6f3cd-32aa-4a4b-b572-f71f8970a753 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:48.994771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87b6f3cd-32aa-4a4b-b572-f71f8970a753 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:48.995488 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87b6f3cd-32aa-4a4b-b572-f71f8970a753 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:48.996198 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87b6f3cd-32aa-4a4b-b572-f71f8970a753 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:49.949911 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2b1debc7-04fb-4853-be03-eac4004911ab tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:49.952169 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2b1debc7-04fb-4853-be03-eac4004911ab tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: f8fd44ee-f170-4aba-b86d-4d096a720561] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:49.971608 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b1debc7-04fb-4853-be03-eac4004911ab tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:49.974257 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b1debc7-04fb-4853-be03-eac4004911ab tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:49.975566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b1debc7-04fb-4853-be03-eac4004911ab tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:49.979104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b1debc7-04fb-4853-be03-eac4004911ab tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:49.979605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b1debc7-04fb-4853-be03-eac4004911ab tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:49.980744 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b1debc7-04fb-4853-be03-eac4004911ab tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:50.419106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-87b6f3cd-32aa-4a4b-b572-f71f8970a753 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:50.448094 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-87b6f3cd-32aa-4a4b-b572-f71f8970a753 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10" status: 200 len: 1466 microversion: 2.1 time: 1.533259 Oct 29 02:47:50.464556 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 335/682] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:48 2022] GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10 => generated 1466 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:50.473146 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f18420cc-ac88-4db2-81a0-1bba74fb5497 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:50.479304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f18420cc-ac88-4db2-81a0-1bba74fb5497 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:50.506846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f18420cc-ac88-4db2-81a0-1bba74fb5497 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:50.514770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f18420cc-ac88-4db2-81a0-1bba74fb5497 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:50.515503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f18420cc-ac88-4db2-81a0-1bba74fb5497 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:50.520258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f18420cc-ac88-4db2-81a0-1bba74fb5497 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:50.521219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f18420cc-ac88-4db2-81a0-1bba74fb5497 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:50.521903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f18420cc-ac88-4db2-81a0-1bba74fb5497 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:50.745485 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:50.821458 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2b1debc7-04fb-4853-be03-eac4004911ab tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:50.852156 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2b1debc7-04fb-4853-be03-eac4004911ab tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561" status: 200 len: 1317 microversion: 2.1 time: 0.908664 Oct 29 02:47:50.866446 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 348/683] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:49 2022] GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561 => generated 1317 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:50.883990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-f18420cc-ac88-4db2-81a0-1bba74fb5497 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lazy-loading 'services' on Instance uuid 0766d417-a358-4ad6-9af4-75f7d61f82eb {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:50.904193 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-4b7b142f-a22e-4a9f-a0af-a32f30b78eaf req-6f043f20-8ffa-49ec-ac65-7f670c7b017f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c912c93-9d84-4d95-8dc3-103233acff10", "name": "network-vif-deleted", "tag": "61e4fdfe-2003-4ace-8ee7-d890adeedffa"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:50.929834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4b7b142f-a22e-4a9f-a0af-a32f30b78eaf req-6f043f20-8ffa-49ec-ac65-7f670c7b017f service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:50.930711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4b7b142f-a22e-4a9f-a0af-a32f30b78eaf req-6f043f20-8ffa-49ec-ac65-7f670c7b017f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:50.931378 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4b7b142f-a22e-4a9f-a0af-a32f30b78eaf req-6f043f20-8ffa-49ec-ac65-7f670c7b017f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:50.990553 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-4b7b142f-a22e-4a9f-a0af-a32f30b78eaf req-6f043f20-8ffa-49ec-ac65-7f670c7b017f service nova] Creating event network-vif-deleted:61e4fdfe-2003-4ace-8ee7-d890adeedffa for instance 4c912c93-9d84-4d95-8dc3-103233acff10 on n-h1-862967-2 Oct 29 02:47:51.004832 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f18420cc-ac88-4db2-81a0-1bba74fb5497 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1929 microversion: 2.75 time: 0.549976 Oct 29 02:47:51.015868 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-4b7b142f-a22e-4a9f-a0af-a32f30b78eaf req-6f043f20-8ffa-49ec-ac65-7f670c7b017f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133126 Oct 29 02:47:51.019215 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 336/684] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:50 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1929 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:51.023747 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 349/685] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:51.548820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5f323638-290d-42b2-80a1-176f7dde65ba tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:51.553754 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5f323638-290d-42b2-80a1-176f7dde65ba tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: 4c912c93-9d84-4d95-8dc3-103233acff10] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:51.620872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f323638-290d-42b2-80a1-176f7dde65ba tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:51.622202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f323638-290d-42b2-80a1-176f7dde65ba tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:51.625200 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f323638-290d-42b2-80a1-176f7dde65ba tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:51.627023 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f323638-290d-42b2-80a1-176f7dde65ba tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:51.631746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f323638-290d-42b2-80a1-176f7dde65ba tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:51.634015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f323638-290d-42b2-80a1-176f7dde65ba tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:51.721558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f323638-290d-42b2-80a1-176f7dde65ba tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:51.722266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f323638-290d-42b2-80a1-176f7dde65ba tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:51.722986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f323638-290d-42b2-80a1-176f7dde65ba tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:51.726429 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-5f323638-290d-42b2-80a1-176f7dde65ba tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lazy-loading 'fault' on Instance uuid 4c912c93-9d84-4d95-8dc3-103233acff10 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:51.785472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5f323638-290d-42b2-80a1-176f7dde65ba tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:51.802308 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5f323638-290d-42b2-80a1-176f7dde65ba tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10" status: 200 len: 1309 microversion: 2.1 time: 0.324487 Oct 29 02:47:51.836374 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 337/686] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:51 2022] GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10 => generated 1309 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:51.909774 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-afcdfed2-b50d-489f-9a02-1ccfa9b03fdc tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:51.911886 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-afcdfed2-b50d-489f-9a02-1ccfa9b03fdc tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: f8fd44ee-f170-4aba-b86d-4d096a720561] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:51.927293 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-afcdfed2-b50d-489f-9a02-1ccfa9b03fdc tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:51.928028 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-afcdfed2-b50d-489f-9a02-1ccfa9b03fdc tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:51.928476 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-afcdfed2-b50d-489f-9a02-1ccfa9b03fdc tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:51.936341 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-afcdfed2-b50d-489f-9a02-1ccfa9b03fdc tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:51.937556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-afcdfed2-b50d-489f-9a02-1ccfa9b03fdc tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:51.938146 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-afcdfed2-b50d-489f-9a02-1ccfa9b03fdc tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:52.050429 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1b95b2d3-8e1a-48d2-a43b-3eef433cb7b7 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:52.051316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1b95b2d3-8e1a-48d2-a43b-3eef433cb7b7 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:52.072587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b95b2d3-8e1a-48d2-a43b-3eef433cb7b7 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:52.073529 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b95b2d3-8e1a-48d2-a43b-3eef433cb7b7 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:52.074133 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b95b2d3-8e1a-48d2-a43b-3eef433cb7b7 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:52.076667 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b95b2d3-8e1a-48d2-a43b-3eef433cb7b7 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:52.077458 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b95b2d3-8e1a-48d2-a43b-3eef433cb7b7 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:52.078218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b95b2d3-8e1a-48d2-a43b-3eef433cb7b7 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:52.184050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-1b95b2d3-8e1a-48d2-a43b-3eef433cb7b7 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lazy-loading 'services' on Instance uuid 0766d417-a358-4ad6-9af4-75f7d61f82eb {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:52.206398 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1b95b2d3-8e1a-48d2-a43b-3eef433cb7b7 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1929 microversion: 2.75 time: 0.160561 Oct 29 02:47:52.220898 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 338/687] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:52 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1929 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:52.399886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-4e2e453e-cc8e-45a1-b384-288ef5aa8b36 req-24735d29-fc99-4867-8a42-412b2543278a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8fd44ee-f170-4aba-b86d-4d096a720561", "tag": "d45a8e22-aaac-49fa-a1ee-680ef4e8eec9"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:52.427215 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4e2e453e-cc8e-45a1-b384-288ef5aa8b36 req-24735d29-fc99-4867-8a42-412b2543278a service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:52.437781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4e2e453e-cc8e-45a1-b384-288ef5aa8b36 req-24735d29-fc99-4867-8a42-412b2543278a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:52.437781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4e2e453e-cc8e-45a1-b384-288ef5aa8b36 req-24735d29-fc99-4867-8a42-412b2543278a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:52.451126 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-4e2e453e-cc8e-45a1-b384-288ef5aa8b36 req-24735d29-fc99-4867-8a42-412b2543278a service nova] Creating event network-changed:d45a8e22-aaac-49fa-a1ee-680ef4e8eec9 for instance f8fd44ee-f170-4aba-b86d-4d096a720561 on n-h2-862967-2 Oct 29 02:47:52.458253 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-4e2e453e-cc8e-45a1-b384-288ef5aa8b36 req-24735d29-fc99-4867-8a42-412b2543278a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062485 Oct 29 02:47:52.465384 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 339/688] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:47:52.853475 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d15a8c95-dd78-4135-92d4-5d5efdfb704b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:52.854586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d15a8c95-dd78-4135-92d4-5d5efdfb704b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: 4c912c93-9d84-4d95-8dc3-103233acff10] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:52.886147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d15a8c95-dd78-4135-92d4-5d5efdfb704b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:52.904606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d15a8c95-dd78-4135-92d4-5d5efdfb704b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:52.905510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d15a8c95-dd78-4135-92d4-5d5efdfb704b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:52.908245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d15a8c95-dd78-4135-92d4-5d5efdfb704b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:52.915920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d15a8c95-dd78-4135-92d4-5d5efdfb704b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:52.916920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d15a8c95-dd78-4135-92d4-5d5efdfb704b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:52.980492 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-d15a8c95-dd78-4135-92d4-5d5efdfb704b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] HTTP exception thrown: Instance 4c912c93-9d84-4d95-8dc3-103233acff10 could not be found. Oct 29 02:47:52.983918 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d15a8c95-dd78-4135-92d4-5d5efdfb704b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Request method failure captured: Oct 29 02:47:52.983918 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10 HTTP/1.1 Oct 29 02:47:52.983918 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:47:52.983918 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:47:52.983918 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:47:52.983918 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:47:52.983918 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:47:52.983918 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:47:52.983918 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:47:52.983918 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:47:52.983918 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJQWQ3-qwexeq1n_yAVuy8OGy-NAxfEr9jPW-KYcmB5E24_3eeGcZTu_Gj-XRE-VNKJ-haOznIyneQ5JhBoDjL0yf3FupijKXrgThjvJhjNxP4YdrqSXHBX80FZx8dWOYj2iHI50jB70YwhLcfGG1nFj0p7dDW8Y-w8XyDNwSX-uabQ Oct 29 02:47:52.983918 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:47:52.983918 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:47:52.983918 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:47:52.983918 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:47:52.983918 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:47:52.983918 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:47:52.983918 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 28feebf0d93c499aa8ed33fe4e12e3d5 Oct 29 02:47:52.983918 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-LiveMigrationNegativeTest-1511233699 Oct 29 02:47:52.983918 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:47:52.983918 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:47:52.986727 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/28feebf0d93c499aa8ed33fe4e12e3d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/28feebf0d93c499aa8ed33fe4e12e3d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_28feebf0d93c499aa8ed33fe4e12e3d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/28feebf0d93c499aa8ed33fe4e12e3d5"}]}] Oct 29 02:47:52.986727 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-LiveMigrationNegativeTest-1511233699 Oct 29 02:47:52.986727 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 28feebf0d93c499aa8ed33fe4e12e3d5 Oct 29 02:47:52.986727 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1511233699 Oct 29 02:47:52.986727 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-LiveMigrationNegativeTest-1511233699-project Oct 29 02:47:52.986727 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:47:52.986727 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:47:52.986727 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 0660da2ef33845f9a7784dea223dda62 Oct 29 02:47:52.986727 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-LiveMigrationNegativeTest-1511233699-project Oct 29 02:47:52.986727 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:47:52.986727 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 4c912c93-9d84-4d95-8dc3-103233acff10 could not be found. Oct 29 02:47:52.986727 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '4c912c93-9d84-4d95-8dc3-103233acff10'} Oct 29 02:47:52.990777 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:47:52.990777 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:47:52.990777 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:47:52.990777 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:47:52.990777 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:47:52.990777 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:47:52.990777 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:47:52.990777 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:47:52.990777 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:47:52.990777 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:47:52.990777 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c912c93-9d84-4d95-8dc3-103233acff10 could not be found. Oct 29 02:47:52.990777 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:47:52.990777 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:47:52.990777 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:47:52.990777 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:47:52.990777 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:47:52.990777 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:47:52.990777 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:47:52.990777 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:47:52.990777 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:47:52.992217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:47:52.992217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:47:52.992217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:47:52.992217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:47:52.992217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:47:52.992217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:47:52.992217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:47:52.992217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c912c93-9d84-4d95-8dc3-103233acff10 could not be found. Oct 29 02:47:52.992217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:47:52.992217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:47:52.992217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:47:52.992217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:47:52.992217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:47:52.992217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:47:52.992217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:47:52.992217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:47:52.992217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c912c93-9d84-4d95-8dc3-103233acff10 could not be found. Oct 29 02:47:52.992217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:47:52.993458 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d15a8c95-dd78-4135-92d4-5d5efdfb704b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Returning 404 to user: Instance 4c912c93-9d84-4d95-8dc3-103233acff10 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:47:53.002451 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d15a8c95-dd78-4135-92d4-5d5efdfb704b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10" status: 404 len: 111 microversion: 2.1 time: 0.161535 Oct 29 02:47:53.004355 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 340/689] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:52 2022] GET /compute/v2.1/servers/4c912c93-9d84-4d95-8dc3-103233acff10 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:47:53.013295 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-afcdfed2-b50d-489f-9a02-1ccfa9b03fdc tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:53.022115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2f346bf8-54ab-432e-ab8a-edd5e0705016 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:53.022800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2f346bf8-54ab-432e-ab8a-edd5e0705016 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: d6f7b0a6-5397-4688-b938-15d013e11ad5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:53.024188 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-afcdfed2-b50d-489f-9a02-1ccfa9b03fdc tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561" status: 200 len: 1317 microversion: 2.1 time: 1.121794 Oct 29 02:47:53.025400 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 350/690] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:51 2022] GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561 => generated 1317 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:53.067977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f346bf8-54ab-432e-ab8a-edd5e0705016 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:53.070545 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f346bf8-54ab-432e-ab8a-edd5e0705016 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:53.072917 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f346bf8-54ab-432e-ab8a-edd5e0705016 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:53.076704 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f346bf8-54ab-432e-ab8a-edd5e0705016 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:53.079037 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f346bf8-54ab-432e-ab8a-edd5e0705016 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:53.082440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f346bf8-54ab-432e-ab8a-edd5e0705016 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:53.182513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2f346bf8-54ab-432e-ab8a-edd5e0705016 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: d6f7b0a6-5397-4688-b938-15d013e11ad5] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:47:53.237759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d5af916a-b306-4a79-a257-b7eac53cefb0 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:53.238894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d5af916a-b306-4a79-a257-b7eac53cefb0 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:53.250672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5af916a-b306-4a79-a257-b7eac53cefb0 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:53.251181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5af916a-b306-4a79-a257-b7eac53cefb0 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:53.251741 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5af916a-b306-4a79-a257-b7eac53cefb0 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:53.252658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5af916a-b306-4a79-a257-b7eac53cefb0 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:53.253136 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5af916a-b306-4a79-a257-b7eac53cefb0 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:53.253719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5af916a-b306-4a79-a257-b7eac53cefb0 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:53.353942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:53.405134 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2f346bf8-54ab-432e-ab8a-edd5e0705016 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5" status: 204 len: 0 microversion: 2.1 time: 0.396280 Oct 29 02:47:53.411724 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 341/691] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:47:53 2022] DELETE /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:47:53.420619 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-11ca9241-c161-4331-9e97-73ba3c6e54a8 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:53.427564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-11ca9241-c161-4331-9e97-73ba3c6e54a8 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: d6f7b0a6-5397-4688-b938-15d013e11ad5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:53.440609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11ca9241-c161-4331-9e97-73ba3c6e54a8 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:53.443767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11ca9241-c161-4331-9e97-73ba3c6e54a8 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:53.444860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11ca9241-c161-4331-9e97-73ba3c6e54a8 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:53.446506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11ca9241-c161-4331-9e97-73ba3c6e54a8 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:53.448118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11ca9241-c161-4331-9e97-73ba3c6e54a8 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:53.454192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11ca9241-c161-4331-9e97-73ba3c6e54a8 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:53.770277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-11ca9241-c161-4331-9e97-73ba3c6e54a8 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:53.807536 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-11ca9241-c161-4331-9e97-73ba3c6e54a8 tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5" status: 200 len: 1474 microversion: 2.1 time: 0.393850 Oct 29 02:47:53.814576 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 342/692] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:53 2022] GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5 => generated 1474 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:53.860173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-d5af916a-b306-4a79-a257-b7eac53cefb0 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lazy-loading 'services' on Instance uuid 0766d417-a358-4ad6-9af4-75f7d61f82eb {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:53.918251 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d5af916a-b306-4a79-a257-b7eac53cefb0 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1929 microversion: 2.75 time: 0.684056 Oct 29 02:47:53.943690 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 351/693] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:53 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1929 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:54.086518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8283f017-25c6-42fa-ae64-1be5e98ac7d1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:54.088394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8283f017-25c6-42fa-ae64-1be5e98ac7d1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: f8fd44ee-f170-4aba-b86d-4d096a720561] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:54.129560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8283f017-25c6-42fa-ae64-1be5e98ac7d1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:54.131925 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8283f017-25c6-42fa-ae64-1be5e98ac7d1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:54.133077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8283f017-25c6-42fa-ae64-1be5e98ac7d1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:54.134813 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8283f017-25c6-42fa-ae64-1be5e98ac7d1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:54.135634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8283f017-25c6-42fa-ae64-1be5e98ac7d1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:54.136380 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8283f017-25c6-42fa-ae64-1be5e98ac7d1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:54.442611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8283f017-25c6-42fa-ae64-1be5e98ac7d1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:54.456282 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8283f017-25c6-42fa-ae64-1be5e98ac7d1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561" status: 200 len: 1317 microversion: 2.1 time: 0.385307 Oct 29 02:47:54.459204 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 343/694] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:54 2022] GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561 => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:54.652917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ec07d471-7fad-4d6f-a6ab-98de606639e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2131545391", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:54.819953 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-ec07d471-7fad-4d6f-a6ab-98de606639e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] validate_networks() for [('1bffd244-e23c-4a00-9a5f-56919f435fec', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:47:54.835784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-feaac965-b3dc-4114-baf1-f442811ae9a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2034272383", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "bc545f16-a7b3-4024-a8d4-95a9643831d5"}], "security_groups": [{"name": "tempest-securitygroup--1992616911"}], "key_name": "tempest-keypair-151434447", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:55.048133 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=16 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:55.530871 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-ec07d471-7fad-4d6f-a6ab-98de606639e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:47:55.531736 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-ec07d471-7fad-4d6f-a6ab-98de606639e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:47:55.532382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-ec07d471-7fad-4d6f-a6ab-98de606639e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:47:55.533000 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-ec07d471-7fad-4d6f-a6ab-98de606639e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:47:55.533567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-ec07d471-7fad-4d6f-a6ab-98de606639e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:47:55.536576 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:55.552659 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec07d471-7fad-4d6f-a6ab-98de606639e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:55.553454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec07d471-7fad-4d6f-a6ab-98de606639e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:55.554101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec07d471-7fad-4d6f-a6ab-98de606639e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:55.554987 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec07d471-7fad-4d6f-a6ab-98de606639e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:55.555588 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec07d471-7fad-4d6f-a6ab-98de606639e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:55.556662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec07d471-7fad-4d6f-a6ab-98de606639e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:55.582149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-ec07d471-7fad-4d6f-a6ab-98de606639e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Getting quotas for project 94814dc564d04e688714ac064c7d1b3b. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:55.587526 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-ec07d471-7fad-4d6f-a6ab-98de606639e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Getting quotas for user 6862cd2470624f01a8bc1d371aa03962 and project 94814dc564d04e688714ac064c7d1b3b. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:55.602893 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ec07d471-7fad-4d6f-a6ab-98de606639e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:47:55.605768 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ec07d471-7fad-4d6f-a6ab-98de606639e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e0095403-2e07-4041-b6e1-5064132dff18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:47:55.689285 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ec07d471-7fad-4d6f-a6ab-98de606639e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.040850 Oct 29 02:47:55.691436 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 352/695] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:47:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 1045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:47:55.703501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ea646324-fe2f-4393-b460-14ebaa385afc tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:55.717257 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ea646324-fe2f-4393-b460-14ebaa385afc tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: d6f7b0a6-5397-4688-b938-15d013e11ad5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:55.735844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea646324-fe2f-4393-b460-14ebaa385afc tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:55.736569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea646324-fe2f-4393-b460-14ebaa385afc tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:55.737361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea646324-fe2f-4393-b460-14ebaa385afc tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:55.738230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea646324-fe2f-4393-b460-14ebaa385afc tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:55.742441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea646324-fe2f-4393-b460-14ebaa385afc tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:55.743420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea646324-fe2f-4393-b460-14ebaa385afc tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:55.960995 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-feaac965-b3dc-4114-baf1-f442811ae9a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] validate_networks() for [('bc545f16-a7b3-4024-a8d4-95a9643831d5', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:47:56.103159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ea646324-fe2f-4393-b460-14ebaa385afc tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:56.120136 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ea646324-fe2f-4393-b460-14ebaa385afc tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5" status: 200 len: 1474 microversion: 2.1 time: 0.425113 Oct 29 02:47:56.131483 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 353/696] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:55 2022] GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5 => generated 1474 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:56.145007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8c6e7fae-1490-40e5-b3e8-53997ec1224d tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:56.145409 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8c6e7fae-1490-40e5-b3e8-53997ec1224d tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:56.156436 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c6e7fae-1490-40e5-b3e8-53997ec1224d tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:56.157075 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c6e7fae-1490-40e5-b3e8-53997ec1224d tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:56.157643 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c6e7fae-1490-40e5-b3e8-53997ec1224d tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:56.158441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c6e7fae-1490-40e5-b3e8-53997ec1224d tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:56.158984 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c6e7fae-1490-40e5-b3e8-53997ec1224d tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:56.161856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c6e7fae-1490-40e5-b3e8-53997ec1224d tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:56.295207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-8c6e7fae-1490-40e5-b3e8-53997ec1224d tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lazy-loading 'services' on Instance uuid 0766d417-a358-4ad6-9af4-75f7d61f82eb {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:56.347223 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8c6e7fae-1490-40e5-b3e8-53997ec1224d tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1929 microversion: 2.75 time: 0.211272 Oct 29 02:47:56.348038 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 354/697] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:56 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1929 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:56.362495 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-24fbadd0-990d-4bcb-8c10-7578446f860c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:56.367952 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-24fbadd0-990d-4bcb-8c10-7578446f860c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: f8fd44ee-f170-4aba-b86d-4d096a720561] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:56.386814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24fbadd0-990d-4bcb-8c10-7578446f860c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:56.389120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24fbadd0-990d-4bcb-8c10-7578446f860c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:56.389675 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24fbadd0-990d-4bcb-8c10-7578446f860c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:56.391059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24fbadd0-990d-4bcb-8c10-7578446f860c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:56.391880 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24fbadd0-990d-4bcb-8c10-7578446f860c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:56.392916 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24fbadd0-990d-4bcb-8c10-7578446f860c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:56.672963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-24fbadd0-990d-4bcb-8c10-7578446f860c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:56.693254 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-24fbadd0-990d-4bcb-8c10-7578446f860c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561" status: 200 len: 1317 microversion: 2.1 time: 0.341347 Oct 29 02:47:56.702519 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 355/698] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:56 2022] GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561 => generated 1317 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:56.715679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9dd09b48-abd9-4bc7-863b-c545fa0dea3e tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:56.716715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9dd09b48-abd9-4bc7-863b-c545fa0dea3e tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e0095403-2e07-4041-b6e1-5064132dff18] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:57.037169 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9dd09b48-abd9-4bc7-863b-c545fa0dea3e tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:57.058519 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9dd09b48-abd9-4bc7-863b-c545fa0dea3e tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18" status: 200 len: 1225 microversion: 2.1 time: 0.359841 Oct 29 02:47:57.081985 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 356/699] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:56 2022] GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18 => generated 1225 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:57.163593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0b222ee7-7097-4d3e-8816-ce4da2c3845b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:57.176714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0b222ee7-7097-4d3e-8816-ce4da2c3845b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: d6f7b0a6-5397-4688-b938-15d013e11ad5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:57.203617 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b222ee7-7097-4d3e-8816-ce4da2c3845b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:57.205292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b222ee7-7097-4d3e-8816-ce4da2c3845b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:57.205292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b222ee7-7097-4d3e-8816-ce4da2c3845b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:57.206474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b222ee7-7097-4d3e-8816-ce4da2c3845b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:57.207294 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b222ee7-7097-4d3e-8816-ce4da2c3845b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:57.208055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b222ee7-7097-4d3e-8816-ce4da2c3845b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:57.910009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0b222ee7-7097-4d3e-8816-ce4da2c3845b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:57.942379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-feaac965-b3dc-4114-baf1-f442811ae9a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:47:57.943322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-feaac965-b3dc-4114-baf1-f442811ae9a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:47:57.944498 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-feaac965-b3dc-4114-baf1-f442811ae9a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:47:57.945281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-feaac965-b3dc-4114-baf1-f442811ae9a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:47:57.946010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-feaac965-b3dc-4114-baf1-f442811ae9a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:47:57.948883 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0b222ee7-7097-4d3e-8816-ce4da2c3845b tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5" status: 200 len: 1474 microversion: 2.1 time: 0.795452 Oct 29 02:47:57.960283 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 357/700] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:57 2022] GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5 => generated 1474 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:57.973675 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-45f4e578-249c-4291-bb22-5db1d538e434 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:57.975229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-45f4e578-249c-4291-bb22-5db1d538e434 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:58.003241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45f4e578-249c-4291-bb22-5db1d538e434 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:58.006081 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45f4e578-249c-4291-bb22-5db1d538e434 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:58.006751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45f4e578-249c-4291-bb22-5db1d538e434 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:58.008002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45f4e578-249c-4291-bb22-5db1d538e434 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:58.008680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45f4e578-249c-4291-bb22-5db1d538e434 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:58.010022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45f4e578-249c-4291-bb22-5db1d538e434 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:58.015626 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-feaac965-b3dc-4114-baf1-f442811ae9a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:58.022624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-feaac965-b3dc-4114-baf1-f442811ae9a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:58.023412 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-feaac965-b3dc-4114-baf1-f442811ae9a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:58.025227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-feaac965-b3dc-4114-baf1-f442811ae9a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:58.025890 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-feaac965-b3dc-4114-baf1-f442811ae9a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:58.026532 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-feaac965-b3dc-4114-baf1-f442811ae9a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:58.103561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-feaac965-b3dc-4114-baf1-f442811ae9a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Getting quotas for project f86634862bd64e0f9f00972e4ce0982b. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:47:58.132295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-feaac965-b3dc-4114-baf1-f442811ae9a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Getting quotas for user 067d53567ea944b1b69ee7f461aa0c16 and project f86634862bd64e0f9f00972e4ce0982b. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:47:58.164706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-feaac965-b3dc-4114-baf1-f442811ae9a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:47:58.172207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-feaac965-b3dc-4114-baf1-f442811ae9a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:47:58.310368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-45f4e578-249c-4291-bb22-5db1d538e434 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lazy-loading 'services' on Instance uuid 0766d417-a358-4ad6-9af4-75f7d61f82eb {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:58.341089 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-feaac965-b3dc-4114-baf1-f442811ae9a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 3.511679 Oct 29 02:47:58.342608 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 344/701] 10.222.0.46 () {62 vars in 1188 bytes} [Sat Oct 29 02:47:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 3514 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 02:47:58.355767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bf95fa3f-dce2-4842-8e81-7a29f70e83cb tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:58.359251 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bf95fa3f-dce2-4842-8e81-7a29f70e83cb tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: f8fd44ee-f170-4aba-b86d-4d096a720561] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:58.375966 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-45f4e578-249c-4291-bb22-5db1d538e434 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1929 microversion: 2.75 time: 0.413258 Oct 29 02:47:58.381566 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 358/702] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:57 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1929 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:58.397328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-8f5dca42-b87b-4901-bed5-cab6df38b01f req-d5b90857-8980-4b9b-98a5-5ee64713c1ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f7b0a6-5397-4688-b938-15d013e11ad5", "name": "network-vif-deleted", "tag": "2fc9c9aa-b3b6-4946-a801-fbe2d963340c"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:58.414322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf95fa3f-dce2-4842-8e81-7a29f70e83cb tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:58.414972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf95fa3f-dce2-4842-8e81-7a29f70e83cb tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:58.415539 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf95fa3f-dce2-4842-8e81-7a29f70e83cb tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:58.428680 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf95fa3f-dce2-4842-8e81-7a29f70e83cb tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:58.429766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf95fa3f-dce2-4842-8e81-7a29f70e83cb tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:58.430593 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf95fa3f-dce2-4842-8e81-7a29f70e83cb tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:58.442452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8f5dca42-b87b-4901-bed5-cab6df38b01f req-d5b90857-8980-4b9b-98a5-5ee64713c1ee service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:58.443481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8f5dca42-b87b-4901-bed5-cab6df38b01f req-d5b90857-8980-4b9b-98a5-5ee64713c1ee service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:58.444697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8f5dca42-b87b-4901-bed5-cab6df38b01f req-d5b90857-8980-4b9b-98a5-5ee64713c1ee service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:58.476360 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-8f5dca42-b87b-4901-bed5-cab6df38b01f req-d5b90857-8980-4b9b-98a5-5ee64713c1ee service nova] Creating event network-vif-deleted:2fc9c9aa-b3b6-4946-a801-fbe2d963340c for instance d6f7b0a6-5397-4688-b938-15d013e11ad5 on n-h2-862967-2 Oct 29 02:47:58.490421 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-8f5dca42-b87b-4901-bed5-cab6df38b01f req-d5b90857-8980-4b9b-98a5-5ee64713c1ee service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105725 Oct 29 02:47:58.498255 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 359/703] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:58.865474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c60f4c9b-15a5-4c71-a218-d897d0c46fed tempest-QuotaClassesAdminTestJSON-1381593178 tempest-QuotaClassesAdminTestJSON-1381593178-project-admin] Calling method '.version_select at 0x7ff058741af0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:58.909261 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c60f4c9b-15a5-4c71-a218-d897d0c46fed tempest-QuotaClassesAdminTestJSON-1381593178 tempest-QuotaClassesAdminTestJSON-1381593178-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.409419 Oct 29 02:47:58.910821 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 360/704] 10.222.0.46 () {58 vars in 1185 bytes} [Sat Oct 29 02:47:58 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:58.929405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-effdf5b4-bc1e-4266-978c-08dc1b2bb289 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:58.930506 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-effdf5b4-bc1e-4266-978c-08dc1b2bb289 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e0095403-2e07-4041-b6e1-5064132dff18] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:58.963723 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-effdf5b4-bc1e-4266-978c-08dc1b2bb289 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:58.964506 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-effdf5b4-bc1e-4266-978c-08dc1b2bb289 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:58.967640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-effdf5b4-bc1e-4266-978c-08dc1b2bb289 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:58.968441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-effdf5b4-bc1e-4266-978c-08dc1b2bb289 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:58.970511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-effdf5b4-bc1e-4266-978c-08dc1b2bb289 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:58.971301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-effdf5b4-bc1e-4266-978c-08dc1b2bb289 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:58.987296 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bf95fa3f-dce2-4842-8e81-7a29f70e83cb tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:59.018137 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bf95fa3f-dce2-4842-8e81-7a29f70e83cb tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561" status: 200 len: 1317 microversion: 2.1 time: 0.670982 Oct 29 02:47:59.028828 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 345/705] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:58 2022] GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561 => generated 1317 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:59.054752 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dfc3f183-beee-443a-835d-bf2719e3e01f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:59.055686 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dfc3f183-beee-443a-835d-bf2719e3e01f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:59.190072 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dfc3f183-beee-443a-835d-bf2719e3e01f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:59.197720 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-effdf5b4-bc1e-4266-978c-08dc1b2bb289 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:59.199138 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dfc3f183-beee-443a-835d-bf2719e3e01f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:59.201411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dfc3f183-beee-443a-835d-bf2719e3e01f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:59.202725 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dfc3f183-beee-443a-835d-bf2719e3e01f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1285 microversion: 2.25 time: 0.169930 Oct 29 02:47:59.212821 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-effdf5b4-bc1e-4266-978c-08dc1b2bb289 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18" status: 200 len: 1277 microversion: 2.1 time: 0.293776 Oct 29 02:47:59.213278 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 346/706] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:59 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1285 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:59.217856 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 361/707] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:58 2022] GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18 => generated 1277 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:59.221973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d3f16650-13a8-418a-a6f0-efd67d1c74d1 tempest-QuotaClassesAdminTestJSON-1381593178 tempest-QuotaClassesAdminTestJSON-1381593178-project-admin] Action: 'update', calling method: .version_select at 0x7ff05809a820>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:47:59.233356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b4841e79-fccf-487c-9ed5-4248e003e92a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:59.234510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b4841e79-fccf-487c-9ed5-4248e003e92a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: d6f7b0a6-5397-4688-b938-15d013e11ad5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:59.247408 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4841e79-fccf-487c-9ed5-4248e003e92a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:59.248814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4841e79-fccf-487c-9ed5-4248e003e92a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:59.249287 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4841e79-fccf-487c-9ed5-4248e003e92a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:59.250151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4841e79-fccf-487c-9ed5-4248e003e92a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:59.250683 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4841e79-fccf-487c-9ed5-4248e003e92a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:59.251033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4841e79-fccf-487c-9ed5-4248e003e92a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:59.289055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4841e79-fccf-487c-9ed5-4248e003e92a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:59.289055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4841e79-fccf-487c-9ed5-4248e003e92a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:59.290738 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4841e79-fccf-487c-9ed5-4248e003e92a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:59.291681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-b4841e79-fccf-487c-9ed5-4248e003e92a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lazy-loading 'fault' on Instance uuid d6f7b0a6-5397-4688-b938-15d013e11ad5 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:59.359319 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b4841e79-fccf-487c-9ed5-4248e003e92a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0660da2ef33845f9a7784dea223dda62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28feebf0d93c499aa8ed33fe4e12e3d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:47:59.382195 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b4841e79-fccf-487c-9ed5-4248e003e92a tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5" status: 200 len: 1309 microversion: 2.1 time: 0.162560 Oct 29 02:47:59.385109 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 362/708] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:47:59 2022] GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5 => generated 1309 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:47:59.447027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fbd559c3-e53c-44ff-8cbd-79b8b6cb6998 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:59.448835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fbd559c3-e53c-44ff-8cbd-79b8b6cb6998 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:47:59.468607 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fbd559c3-e53c-44ff-8cbd-79b8b6cb6998 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:59.469883 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fbd559c3-e53c-44ff-8cbd-79b8b6cb6998 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:59.485767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fbd559c3-e53c-44ff-8cbd-79b8b6cb6998 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:59.487286 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fbd559c3-e53c-44ff-8cbd-79b8b6cb6998 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:47:59.489174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fbd559c3-e53c-44ff-8cbd-79b8b6cb6998 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:47:59.493268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fbd559c3-e53c-44ff-8cbd-79b8b6cb6998 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:47:59.793226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-fbd559c3-e53c-44ff-8cbd-79b8b6cb6998 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lazy-loading 'services' on Instance uuid 0766d417-a358-4ad6-9af4-75f7d61f82eb {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:47:59.860969 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fbd559c3-e53c-44ff-8cbd-79b8b6cb6998 tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1935 microversion: 2.75 time: 0.420132 Oct 29 02:47:59.862891 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 363/709] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:47:59 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1935 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:47:59.949573 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d3f16650-13a8-418a-a6f0-efd67d1c74d1 tempest-QuotaClassesAdminTestJSON-1381593178 tempest-QuotaClassesAdminTestJSON-1381593178-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.734268 Oct 29 02:47:59.960932 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 347/710] 10.222.0.46 () {60 vars in 1206 bytes} [Sat Oct 29 02:47:59 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:47:59.967546 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-33a03b5f-fd0e-478f-abf9-8e9b0ddf5a5f tempest-QuotaClassesAdminTestJSON-1381593178 tempest-QuotaClassesAdminTestJSON-1381593178-project-admin] Calling method '.version_select at 0x7ff0586d7af0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:47:59.986904 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-33a03b5f-fd0e-478f-abf9-8e9b0ddf5a5f tempest-QuotaClassesAdminTestJSON-1381593178 tempest-QuotaClassesAdminTestJSON-1381593178-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.023040 Oct 29 02:47:59.988042 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 364/711] 10.222.0.46 () {58 vars in 1185 bytes} [Sat Oct 29 02:47:59 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:48:00.017062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9492145c-915e-41c2-bace-5dd7ac3720b5 tempest-QuotaClassesAdminTestJSON-1381593178 tempest-QuotaClassesAdminTestJSON-1381593178-project-admin] Action: 'update', calling method: .version_select at 0x7ff05809aa60>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:00.053257 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=16,nova_api:INSERT=15 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:00.062490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-613c8c72-42c9-486c-84a1-4adb82b8c8b4 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:00.062490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-613c8c72-42c9-486c-84a1-4adb82b8c8b4 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: f8fd44ee-f170-4aba-b86d-4d096a720561] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:00.097298 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-613c8c72-42c9-486c-84a1-4adb82b8c8b4 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:00.101413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-613c8c72-42c9-486c-84a1-4adb82b8c8b4 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:00.102415 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-613c8c72-42c9-486c-84a1-4adb82b8c8b4 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:00.107681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-613c8c72-42c9-486c-84a1-4adb82b8c8b4 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:00.109786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-613c8c72-42c9-486c-84a1-4adb82b8c8b4 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:00.111227 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-613c8c72-42c9-486c-84a1-4adb82b8c8b4 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:00.185023 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9492145c-915e-41c2-bace-5dd7ac3720b5 tempest-QuotaClassesAdminTestJSON-1381593178 tempest-QuotaClassesAdminTestJSON-1381593178-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.175001 Oct 29 02:48:00.186453 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 348/712] 10.222.0.46 () {60 vars in 1206 bytes} [Sat Oct 29 02:48:00 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:00.247781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4c3aac86-e829-4a27-95e1-696b78ad669f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:00.250008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4c3aac86-e829-4a27-95e1-696b78ad669f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:00.269469 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c3aac86-e829-4a27-95e1-696b78ad669f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:00.270158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c3aac86-e829-4a27-95e1-696b78ad669f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:00.270811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c3aac86-e829-4a27-95e1-696b78ad669f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:00.272619 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c3aac86-e829-4a27-95e1-696b78ad669f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:00.273685 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c3aac86-e829-4a27-95e1-696b78ad669f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:00.275867 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c3aac86-e829-4a27-95e1-696b78ad669f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:00.362431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-613c8c72-42c9-486c-84a1-4adb82b8c8b4 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:00.401651 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-613c8c72-42c9-486c-84a1-4adb82b8c8b4 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561" status: 200 len: 1317 microversion: 2.1 time: 0.350554 Oct 29 02:48:00.403442 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 365/713] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:00 2022] GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561 => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:00.415879 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-92d6a072-0ae7-4b3b-a3ab-bbcd56552a4d tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:00.417554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-92d6a072-0ae7-4b3b-a3ab-bbcd56552a4d tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e0095403-2e07-4041-b6e1-5064132dff18] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:00.441299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4c3aac86-e829-4a27-95e1-696b78ad669f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:00.446352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92d6a072-0ae7-4b3b-a3ab-bbcd56552a4d tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:00.447157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92d6a072-0ae7-4b3b-a3ab-bbcd56552a4d tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:00.448102 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92d6a072-0ae7-4b3b-a3ab-bbcd56552a4d tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:00.449709 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92d6a072-0ae7-4b3b-a3ab-bbcd56552a4d tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:00.454012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92d6a072-0ae7-4b3b-a3ab-bbcd56552a4d tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:00.454761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92d6a072-0ae7-4b3b-a3ab-bbcd56552a4d tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:00.464480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4c3aac86-e829-4a27-95e1-696b78ad669f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:00.470048 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4c3aac86-e829-4a27-95e1-696b78ad669f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:00.492278 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4c3aac86-e829-4a27-95e1-696b78ad669f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1281 microversion: 2.25 time: 0.255114 Oct 29 02:48:00.495367 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 349/714] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:00 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1281 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:00.514065 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3740e7bb-b3ff-466b-ac34-f7b2d2384d4e tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:00.514355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:00.518807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3740e7bb-b3ff-466b-ac34-f7b2d2384d4e tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] [instance: d6f7b0a6-5397-4688-b938-15d013e11ad5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:00.548596 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3740e7bb-b3ff-466b-ac34-f7b2d2384d4e tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:00.549518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3740e7bb-b3ff-466b-ac34-f7b2d2384d4e tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:00.550197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3740e7bb-b3ff-466b-ac34-f7b2d2384d4e tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:00.551629 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3740e7bb-b3ff-466b-ac34-f7b2d2384d4e tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:00.552347 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3740e7bb-b3ff-466b-ac34-f7b2d2384d4e tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:00.553333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3740e7bb-b3ff-466b-ac34-f7b2d2384d4e tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:00.591174 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-3740e7bb-b3ff-466b-ac34-f7b2d2384d4e tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] HTTP exception thrown: Instance d6f7b0a6-5397-4688-b938-15d013e11ad5 could not be found. Oct 29 02:48:00.595628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3740e7bb-b3ff-466b-ac34-f7b2d2384d4e tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Request method failure captured: Oct 29 02:48:00.595628 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5 HTTP/1.1 Oct 29 02:48:00.595628 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:48:00.595628 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:48:00.595628 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:48:00.595628 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:48:00.595628 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:48:00.595628 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:48:00.595628 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:48:00.595628 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:48:00.595628 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJQWQ3-qwexeq1n_yAVuy8OGy-NAxfEr9jPW-KYcmB5E24_3eeGcZTu_Gj-XRE-VNKJ-haOznIyneQ5JhBoDjL0yf3FupijKXrgThjvJhjNxP4YdrqSXHBX80FZx8dWOYj2iHI50jB70YwhLcfGG1nFj0p7dDW8Y-w8XyDNwSX-uabQ Oct 29 02:48:00.595628 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:48:00.595628 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:48:00.595628 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:48:00.595628 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:48:00.595628 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:48:00.595628 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:48:00.595628 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 28feebf0d93c499aa8ed33fe4e12e3d5 Oct 29 02:48:00.595628 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-LiveMigrationNegativeTest-1511233699 Oct 29 02:48:00.595628 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:48:00.595628 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:48:00.598592 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/28feebf0d93c499aa8ed33fe4e12e3d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/28feebf0d93c499aa8ed33fe4e12e3d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_28feebf0d93c499aa8ed33fe4e12e3d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/28feebf0d93c499aa8ed33fe4e12e3d5"}]}] Oct 29 02:48:00.598592 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-LiveMigrationNegativeTest-1511233699 Oct 29 02:48:00.598592 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 28feebf0d93c499aa8ed33fe4e12e3d5 Oct 29 02:48:00.598592 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1511233699 Oct 29 02:48:00.598592 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-LiveMigrationNegativeTest-1511233699-project Oct 29 02:48:00.598592 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:48:00.598592 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:48:00.598592 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 0660da2ef33845f9a7784dea223dda62 Oct 29 02:48:00.598592 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-LiveMigrationNegativeTest-1511233699-project Oct 29 02:48:00.598592 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:48:00.598592 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance d6f7b0a6-5397-4688-b938-15d013e11ad5 could not be found. Oct 29 02:48:00.598592 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'd6f7b0a6-5397-4688-b938-15d013e11ad5'} Oct 29 02:48:00.600264 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:48:00.600264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:00.600264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:48:00.600264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:48:00.600264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:48:00.600264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:48:00.600264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:48:00.600264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:48:00.600264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:48:00.600264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:48:00.600264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6f7b0a6-5397-4688-b938-15d013e11ad5 could not be found. Oct 29 02:48:00.600264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:48:00.600264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:00.600264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:48:00.600264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:00.600264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:00.600264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:00.600264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:48:00.600264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:48:00.600264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:48:00.604306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:48:00.604306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:48:00.604306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:48:00.604306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:48:00.604306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:48:00.604306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:48:00.604306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:48:00.604306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6f7b0a6-5397-4688-b938-15d013e11ad5 could not be found. Oct 29 02:48:00.604306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:48:00.604306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:00.604306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:48:00.604306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:00.604306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:00.604306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:00.604306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:48:00.604306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:48:00.604306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6f7b0a6-5397-4688-b938-15d013e11ad5 could not be found. Oct 29 02:48:00.604306 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:48:00.610553 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3740e7bb-b3ff-466b-ac34-f7b2d2384d4e tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] Returning 404 to user: Instance d6f7b0a6-5397-4688-b938-15d013e11ad5 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:48:00.612409 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3740e7bb-b3ff-466b-ac34-f7b2d2384d4e tempest-LiveMigrationNegativeTest-1511233699 tempest-LiveMigrationNegativeTest-1511233699-project] 10.222.0.46 "GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5" status: 404 len: 111 microversion: 2.1 time: 0.113545 Oct 29 02:48:00.614235 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 350/715] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:00 2022] GET /compute/v2.1/servers/d6f7b0a6-5397-4688-b938-15d013e11ad5 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:48:00.666413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-92d6a072-0ae7-4b3b-a3ab-bbcd56552a4d tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:00.674951 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-92d6a072-0ae7-4b3b-a3ab-bbcd56552a4d tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18" status: 200 len: 1277 microversion: 2.1 time: 0.267131 Oct 29 02:48:00.676050 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 366/716] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:00 2022] GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18 => generated 1277 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:00.824414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-fa8d8079-86e5-4d9e-9671-f473f02165d0 req-ace9473e-3cd7-48e8-971d-3f82255d2fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8fd44ee-f170-4aba-b86d-4d096a720561", "name": "network-vif-plugged", "status": "completed", "tag": "d45a8e22-aaac-49fa-a1ee-680ef4e8eec9"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:00.884453 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-fa8d8079-86e5-4d9e-9671-f473f02165d0 req-ace9473e-3cd7-48e8-971d-3f82255d2fc1 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:00.885854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-fa8d8079-86e5-4d9e-9671-f473f02165d0 req-ace9473e-3cd7-48e8-971d-3f82255d2fc1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:00.889127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-fa8d8079-86e5-4d9e-9671-f473f02165d0 req-ace9473e-3cd7-48e8-971d-3f82255d2fc1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:00.914878 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-fa8d8079-86e5-4d9e-9671-f473f02165d0 req-ace9473e-3cd7-48e8-971d-3f82255d2fc1 service nova] Creating event network-vif-plugged:d45a8e22-aaac-49fa-a1ee-680ef4e8eec9 for instance f8fd44ee-f170-4aba-b86d-4d096a720561 on n-h2-862967-2 Oct 29 02:48:00.921113 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-fa8d8079-86e5-4d9e-9671-f473f02165d0 req-ace9473e-3cd7-48e8-971d-3f82255d2fc1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103487 Oct 29 02:48:00.922391 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 351/717] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:00.944627 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3f04c1c2-9ed7-4614-a68d-0f5d6807b41f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:00.955609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3f04c1c2-9ed7-4614-a68d-0f5d6807b41f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:00.991282 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3f04c1c2-9ed7-4614-a68d-0f5d6807b41f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:00.996073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3f04c1c2-9ed7-4614-a68d-0f5d6807b41f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:00.997591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3f04c1c2-9ed7-4614-a68d-0f5d6807b41f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:00.999759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3f04c1c2-9ed7-4614-a68d-0f5d6807b41f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:01.002247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3f04c1c2-9ed7-4614-a68d-0f5d6807b41f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:01.002976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3f04c1c2-9ed7-4614-a68d-0f5d6807b41f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:01.179178 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-3f04c1c2-9ed7-4614-a68d-0f5d6807b41f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lazy-loading 'services' on Instance uuid 0766d417-a358-4ad6-9af4-75f7d61f82eb {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:48:01.272163 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3f04c1c2-9ed7-4614-a68d-0f5d6807b41f tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1935 microversion: 2.75 time: 0.351007 Oct 29 02:48:01.275669 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 367/718] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:00 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1935 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:01.440569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e64e53d8-1137-4a40-bea3-da5c78891b3b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:01.441315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e64e53d8-1137-4a40-bea3-da5c78891b3b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: f8fd44ee-f170-4aba-b86d-4d096a720561] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:01.455242 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e64e53d8-1137-4a40-bea3-da5c78891b3b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:01.473978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e64e53d8-1137-4a40-bea3-da5c78891b3b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:01.476005 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e64e53d8-1137-4a40-bea3-da5c78891b3b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:01.478350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e64e53d8-1137-4a40-bea3-da5c78891b3b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:01.479561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e64e53d8-1137-4a40-bea3-da5c78891b3b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:01.483967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e64e53d8-1137-4a40-bea3-da5c78891b3b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:01.490965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:01.563843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-92503929-0f97-4b0a-a9c1-468f04114208 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:01.564711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-92503929-0f97-4b0a-a9c1-468f04114208 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:01.589517 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92503929-0f97-4b0a-a9c1-468f04114208 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:01.590183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92503929-0f97-4b0a-a9c1-468f04114208 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:01.590761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92503929-0f97-4b0a-a9c1-468f04114208 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:01.594007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92503929-0f97-4b0a-a9c1-468f04114208 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:01.597960 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92503929-0f97-4b0a-a9c1-468f04114208 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:01.604656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92503929-0f97-4b0a-a9c1-468f04114208 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:01.716797 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-92503929-0f97-4b0a-a9c1-468f04114208 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:01.728847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-92503929-0f97-4b0a-a9c1-468f04114208 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:01.731640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-92503929-0f97-4b0a-a9c1-468f04114208 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:01.733764 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-92503929-0f97-4b0a-a9c1-468f04114208 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1281 microversion: 2.25 time: 0.180998 Oct 29 02:48:01.744010 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 368/719] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:01 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1281 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:48:01.761036 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7af7e76e-7a1a-4294-9b43-f52be1abf82e tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:01.762160 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7af7e76e-7a1a-4294-9b43-f52be1abf82e tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e0095403-2e07-4041-b6e1-5064132dff18] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:01.770281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7af7e76e-7a1a-4294-9b43-f52be1abf82e tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:01.771333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7af7e76e-7a1a-4294-9b43-f52be1abf82e tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:01.772030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7af7e76e-7a1a-4294-9b43-f52be1abf82e tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:01.773001 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7af7e76e-7a1a-4294-9b43-f52be1abf82e tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:01.773676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7af7e76e-7a1a-4294-9b43-f52be1abf82e tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:01.775154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7af7e76e-7a1a-4294-9b43-f52be1abf82e tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:01.949441 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e64e53d8-1137-4a40-bea3-da5c78891b3b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:01.959864 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e64e53d8-1137-4a40-bea3-da5c78891b3b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561" status: 200 len: 1317 microversion: 2.1 time: 0.524119 Oct 29 02:48:01.969797 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 352/720] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:01 2022] GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561 => generated 1317 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:01.972715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7af7e76e-7a1a-4294-9b43-f52be1abf82e tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:02.003178 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7af7e76e-7a1a-4294-9b43-f52be1abf82e tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18" status: 200 len: 1295 microversion: 2.1 time: 0.256998 Oct 29 02:48:02.012622 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 369/721] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:01 2022] GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18 => generated 1295 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:02.336952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dfb4cdb7-4ec3-472b-a9e1-1634fdaf2fef tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:02.337888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dfb4cdb7-4ec3-472b-a9e1-1634fdaf2fef tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:02.347901 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfb4cdb7-4ec3-472b-a9e1-1634fdaf2fef tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:02.349777 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfb4cdb7-4ec3-472b-a9e1-1634fdaf2fef tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:02.350429 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfb4cdb7-4ec3-472b-a9e1-1634fdaf2fef tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:02.351172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfb4cdb7-4ec3-472b-a9e1-1634fdaf2fef tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:02.351635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfb4cdb7-4ec3-472b-a9e1-1634fdaf2fef tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:02.353237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfb4cdb7-4ec3-472b-a9e1-1634fdaf2fef tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:02.614676 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-dfb4cdb7-4ec3-472b-a9e1-1634fdaf2fef tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] Lazy-loading 'services' on Instance uuid 0766d417-a358-4ad6-9af4-75f7d61f82eb {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:48:02.665159 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dfb4cdb7-4ec3-472b-a9e1-1634fdaf2fef tempest-ServersAdmin275Test-1766755518 tempest-ServersAdmin275Test-1766755518-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1920 microversion: 2.75 time: 0.331342 Oct 29 02:48:02.681952 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 353/722] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:02 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1920 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:02.727849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dbc23df4-a33a-444f-b594-be1cfdeff071 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:02.729548 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dbc23df4-a33a-444f-b594-be1cfdeff071 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:02.750407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbc23df4-a33a-444f-b594-be1cfdeff071 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:02.752505 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbc23df4-a33a-444f-b594-be1cfdeff071 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:02.753313 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbc23df4-a33a-444f-b594-be1cfdeff071 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:02.754358 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbc23df4-a33a-444f-b594-be1cfdeff071 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:02.755139 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbc23df4-a33a-444f-b594-be1cfdeff071 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:02.755867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbc23df4-a33a-444f-b594-be1cfdeff071 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:02.773791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ea31a0ee-68b2-4a8e-85e8-ccb3e226f29a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:02.775614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ea31a0ee-68b2-4a8e-85e8-ccb3e226f29a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:02.797901 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea31a0ee-68b2-4a8e-85e8-ccb3e226f29a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:02.801016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea31a0ee-68b2-4a8e-85e8-ccb3e226f29a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:02.805789 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea31a0ee-68b2-4a8e-85e8-ccb3e226f29a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:02.809835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea31a0ee-68b2-4a8e-85e8-ccb3e226f29a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:02.810754 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea31a0ee-68b2-4a8e-85e8-ccb3e226f29a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:02.811217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea31a0ee-68b2-4a8e-85e8-ccb3e226f29a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:02.820948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dbc23df4-a33a-444f-b594-be1cfdeff071 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:48:03.077038 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dbc23df4-a33a-444f-b594-be1cfdeff071 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 204 len: 0 microversion: 2.75 time: 0.352041 Oct 29 02:48:03.081880 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 370/723] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Oct 29 02:48:02 2022] DELETE /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 02:48:03.095083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-27de0ab7-ff4b-4788-821d-9eb349bb0c55 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:03.096651 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-27de0ab7-ff4b-4788-821d-9eb349bb0c55 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: f8fd44ee-f170-4aba-b86d-4d096a720561] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:03.108663 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27de0ab7-ff4b-4788-821d-9eb349bb0c55 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:03.110077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27de0ab7-ff4b-4788-821d-9eb349bb0c55 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:03.111092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27de0ab7-ff4b-4788-821d-9eb349bb0c55 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:03.112828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27de0ab7-ff4b-4788-821d-9eb349bb0c55 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:03.114018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27de0ab7-ff4b-4788-821d-9eb349bb0c55 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:03.115081 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27de0ab7-ff4b-4788-821d-9eb349bb0c55 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:03.296638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ea31a0ee-68b2-4a8e-85e8-ccb3e226f29a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:03.311818 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ea31a0ee-68b2-4a8e-85e8-ccb3e226f29a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:03.329725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ea31a0ee-68b2-4a8e-85e8-ccb3e226f29a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:03.331884 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ea31a0ee-68b2-4a8e-85e8-ccb3e226f29a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1345 microversion: 2.25 time: 0.566918 Oct 29 02:48:03.333068 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 354/724] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:02 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1345 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:48:03.351075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7c54f665-1fa2-42ab-b44e-84a321a25c01 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:03.352036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7c54f665-1fa2-42ab-b44e-84a321a25c01 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e0095403-2e07-4041-b6e1-5064132dff18] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:03.367807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c54f665-1fa2-42ab-b44e-84a321a25c01 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:03.368465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c54f665-1fa2-42ab-b44e-84a321a25c01 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:03.369090 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c54f665-1fa2-42ab-b44e-84a321a25c01 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:03.370125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c54f665-1fa2-42ab-b44e-84a321a25c01 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:03.371719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c54f665-1fa2-42ab-b44e-84a321a25c01 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:03.372434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c54f665-1fa2-42ab-b44e-84a321a25c01 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:03.531609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7c54f665-1fa2-42ab-b44e-84a321a25c01 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:03.559182 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7c54f665-1fa2-42ab-b44e-84a321a25c01 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18" status: 200 len: 1283 microversion: 2.1 time: 0.224351 Oct 29 02:48:03.560006 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 355/725] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:03 2022] GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18 => generated 1283 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:03.576414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-70889c2f-74dc-42dd-9564-7aa73f6deee0 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:03.577307 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-70889c2f-74dc-42dd-9564-7aa73f6deee0 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:03.585903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70889c2f-74dc-42dd-9564-7aa73f6deee0 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:03.587227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70889c2f-74dc-42dd-9564-7aa73f6deee0 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:03.588113 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70889c2f-74dc-42dd-9564-7aa73f6deee0 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:03.589361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70889c2f-74dc-42dd-9564-7aa73f6deee0 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:03.590057 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70889c2f-74dc-42dd-9564-7aa73f6deee0 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:03.590696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70889c2f-74dc-42dd-9564-7aa73f6deee0 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:03.788776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-70889c2f-74dc-42dd-9564-7aa73f6deee0 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:03.876382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-27de0ab7-ff4b-4788-821d-9eb349bb0c55 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:03.895399 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-27de0ab7-ff4b-4788-821d-9eb349bb0c55 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561" status: 200 len: 1466 microversion: 2.1 time: 0.810577 Oct 29 02:48:03.895765 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-70889c2f-74dc-42dd-9564-7aa73f6deee0 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:03.906516 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 371/726] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:03 2022] GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561 => generated 1466 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:03.906702 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-70889c2f-74dc-42dd-9564-7aa73f6deee0 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:03.932984 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-70889c2f-74dc-42dd-9564-7aa73f6deee0 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1444 microversion: 2.75 time: 0.370615 Oct 29 02:48:03.934250 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-46e2b394-8241-48f1-b460-ec7bb7e04741 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:03.935174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-46e2b394-8241-48f1-b460-ec7bb7e04741 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] [instance: f8fd44ee-f170-4aba-b86d-4d096a720561] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:03.935339 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 356/727] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:03 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1444 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:03.945984 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46e2b394-8241-48f1-b460-ec7bb7e04741 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:03.946825 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46e2b394-8241-48f1-b460-ec7bb7e04741 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:03.947279 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46e2b394-8241-48f1-b460-ec7bb7e04741 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:03.948110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46e2b394-8241-48f1-b460-ec7bb7e04741 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:03.949053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46e2b394-8241-48f1-b460-ec7bb7e04741 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:03.949974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46e2b394-8241-48f1-b460-ec7bb7e04741 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:04.181407 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-46e2b394-8241-48f1-b460-ec7bb7e04741 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561" status: 200 len: 1617 microversion: 2.1 time: 0.250814 Oct 29 02:48:04.182410 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 372/728] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:03 2022] GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561 => generated 1617 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:04.374411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fbef9e3a-ae05-4e83-b334-3faf45201e41 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:04.375509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fbef9e3a-ae05-4e83-b334-3faf45201e41 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:04.388998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbef9e3a-ae05-4e83-b334-3faf45201e41 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:04.390083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbef9e3a-ae05-4e83-b334-3faf45201e41 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:04.390693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbef9e3a-ae05-4e83-b334-3faf45201e41 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:04.391784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbef9e3a-ae05-4e83-b334-3faf45201e41 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:04.392570 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbef9e3a-ae05-4e83-b334-3faf45201e41 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:04.393603 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbef9e3a-ae05-4e83-b334-3faf45201e41 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:04.498054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fbef9e3a-ae05-4e83-b334-3faf45201e41 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:04.508434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fbef9e3a-ae05-4e83-b334-3faf45201e41 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:04.511347 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fbef9e3a-ae05-4e83-b334-3faf45201e41 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:04.512765 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fbef9e3a-ae05-4e83-b334-3faf45201e41 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1343 microversion: 2.25 time: 0.148087 Oct 29 02:48:04.526094 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 357/729] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:04 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1343 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:04.547176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cc4b135e-ef41-4a6a-bff2-70048bc46813 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1009251982", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["b65a6807-c8ad-44d0-93d7-931037ca8afd"]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:04.611377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e7af7cb7-c230-48b8-a7d9-fabc0718afa0 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:04.612515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e7af7cb7-c230-48b8-a7d9-fabc0718afa0 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e0095403-2e07-4041-b6e1-5064132dff18] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:04.626233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7af7cb7-c230-48b8-a7d9-fabc0718afa0 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:04.627513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7af7cb7-c230-48b8-a7d9-fabc0718afa0 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:04.627992 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7af7cb7-c230-48b8-a7d9-fabc0718afa0 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:04.629216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7af7cb7-c230-48b8-a7d9-fabc0718afa0 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:04.630076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7af7cb7-c230-48b8-a7d9-fabc0718afa0 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:04.630825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7af7cb7-c230-48b8-a7d9-fabc0718afa0 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:04.647291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-cc4b135e-ef41-4a6a-bff2-70048bc46813 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] validate_networks() for None {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:48:05.116859 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-cc4b135e-ef41-4a6a-bff2-70048bc46813 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:48:05.117549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-cc4b135e-ef41-4a6a-bff2-70048bc46813 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:48:05.118230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-cc4b135e-ef41-4a6a-bff2-70048bc46813 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:48:05.118839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-cc4b135e-ef41-4a6a-bff2-70048bc46813 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:48:05.119463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-cc4b135e-ef41-4a6a-bff2-70048bc46813 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:48:05.134549 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e7af7cb7-c230-48b8-a7d9-fabc0718afa0 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:05.139287 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc4b135e-ef41-4a6a-bff2-70048bc46813 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:05.153968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc4b135e-ef41-4a6a-bff2-70048bc46813 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:05.154827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc4b135e-ef41-4a6a-bff2-70048bc46813 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:05.155921 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e7af7cb7-c230-48b8-a7d9-fabc0718afa0 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18" status: 200 len: 1325 microversion: 2.1 time: 0.551900 Oct 29 02:48:05.157663 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 358/730] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:04 2022] GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18 => generated 1325 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:05.158260 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc4b135e-ef41-4a6a-bff2-70048bc46813 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:05.160442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc4b135e-ef41-4a6a-bff2-70048bc46813 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:05.161153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc4b135e-ef41-4a6a-bff2-70048bc46813 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:05.184825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-04421945-df0a-4268-ab6a-ae32bb5a8339 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:05.186426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-04421945-df0a-4268-ab6a-ae32bb5a8339 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:05.209384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-04421945-df0a-4268-ab6a-ae32bb5a8339 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:05.212055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-04421945-df0a-4268-ab6a-ae32bb5a8339 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:05.216167 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-04421945-df0a-4268-ab6a-ae32bb5a8339 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:05.217844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-04421945-df0a-4268-ab6a-ae32bb5a8339 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:05.223585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-04421945-df0a-4268-ab6a-ae32bb5a8339 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:05.224604 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-04421945-df0a-4268-ab6a-ae32bb5a8339 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:05.242733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-cc4b135e-ef41-4a6a-bff2-70048bc46813 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for project dcc6da8e69e041e19023a53a23e33393. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:48:05.251263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-cc4b135e-ef41-4a6a-bff2-70048bc46813 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for user 509ce04aeb3847f084629201bd7ae5d6 and project dcc6da8e69e041e19023a53a23e33393. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:48:05.294431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cc4b135e-ef41-4a6a-bff2-70048bc46813 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:48:05.297717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cc4b135e-ef41-4a6a-bff2-70048bc46813 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: e739833b-0b44-40c0-880d-59223a63b7b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:48:05.388460 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cc4b135e-ef41-4a6a-bff2-70048bc46813 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.846306 Oct 29 02:48:05.391232 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 373/731] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:48:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:48:05.410506 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-332e8c1a-c3d6-40fd-8a68-565b5e913419 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:05.413150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-332e8c1a-c3d6-40fd-8a68-565b5e913419 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: e739833b-0b44-40c0-880d-59223a63b7b8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:05.456889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-04421945-df0a-4268-ab6a-ae32bb5a8339 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:05.472303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-04421945-df0a-4268-ab6a-ae32bb5a8339 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:05.474680 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-04421945-df0a-4268-ab6a-ae32bb5a8339 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:05.506044 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-04421945-df0a-4268-ab6a-ae32bb5a8339 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1444 microversion: 2.75 time: 0.346156 Oct 29 02:48:05.516160 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 359/732] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:05 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1444 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:05.541311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cf7364bd-5f41-4a64-8400-1d73fb2cd953 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:05.542273 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cf7364bd-5f41-4a64-8400-1d73fb2cd953 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:05.550811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf7364bd-5f41-4a64-8400-1d73fb2cd953 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:05.551501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf7364bd-5f41-4a64-8400-1d73fb2cd953 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:05.552557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf7364bd-5f41-4a64-8400-1d73fb2cd953 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:05.553462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf7364bd-5f41-4a64-8400-1d73fb2cd953 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:05.554075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf7364bd-5f41-4a64-8400-1d73fb2cd953 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:05.554662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf7364bd-5f41-4a64-8400-1d73fb2cd953 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:05.686740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cf7364bd-5f41-4a64-8400-1d73fb2cd953 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:05.700955 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cf7364bd-5f41-4a64-8400-1d73fb2cd953 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:05.703232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cf7364bd-5f41-4a64-8400-1d73fb2cd953 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:05.711722 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cf7364bd-5f41-4a64-8400-1d73fb2cd953 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1343 microversion: 2.25 time: 0.174780 Oct 29 02:48:05.715393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-332e8c1a-c3d6-40fd-8a68-565b5e913419 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:05.716301 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 360/733] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:05 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1343 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:48:05.736837 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-332e8c1a-c3d6-40fd-8a68-565b5e913419 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8" status: 200 len: 1217 microversion: 2.1 time: 0.336866 Oct 29 02:48:05.741158 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 374/734] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:05 2022] GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8 => generated 1217 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:06.197437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-73907a28-20a0-4e89-96bd-97ddaa2d723e tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:06.198232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-73907a28-20a0-4e89-96bd-97ddaa2d723e tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e0095403-2e07-4041-b6e1-5064132dff18] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:06.212778 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73907a28-20a0-4e89-96bd-97ddaa2d723e tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:06.215554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73907a28-20a0-4e89-96bd-97ddaa2d723e tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:06.218523 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73907a28-20a0-4e89-96bd-97ddaa2d723e tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:06.219526 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73907a28-20a0-4e89-96bd-97ddaa2d723e tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:06.220407 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73907a28-20a0-4e89-96bd-97ddaa2d723e tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:06.222375 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73907a28-20a0-4e89-96bd-97ddaa2d723e tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:06.544181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-39ec0eac-1af4-4ec6-b086-32df681476b0 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:06.545125 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-39ec0eac-1af4-4ec6-b086-32df681476b0 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:06.585315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39ec0eac-1af4-4ec6-b086-32df681476b0 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:06.595811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39ec0eac-1af4-4ec6-b086-32df681476b0 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:06.596720 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39ec0eac-1af4-4ec6-b086-32df681476b0 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:06.598033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39ec0eac-1af4-4ec6-b086-32df681476b0 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:06.613535 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39ec0eac-1af4-4ec6-b086-32df681476b0 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:06.621014 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39ec0eac-1af4-4ec6-b086-32df681476b0 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:06.740706 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39ec0eac-1af4-4ec6-b086-32df681476b0 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:06.741888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39ec0eac-1af4-4ec6-b086-32df681476b0 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:06.743179 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39ec0eac-1af4-4ec6-b086-32df681476b0 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:06.754873 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-39ec0eac-1af4-4ec6-b086-32df681476b0 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lazy-loading 'fault' on Instance uuid 0766d417-a358-4ad6-9af4-75f7d61f82eb {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:48:06.842975 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-39ec0eac-1af4-4ec6-b086-32df681476b0 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:06.863122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-39ec0eac-1af4-4ec6-b086-32df681476b0 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:06.866711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-39ec0eac-1af4-4ec6-b086-32df681476b0 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '484ec82616bb4f29b86a8bc34e8b47d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69bfcc0806c4fff8413b502ef25c1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:06.880016 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-39ec0eac-1af4-4ec6-b086-32df681476b0 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 200 len: 1449 microversion: 2.75 time: 0.339359 Oct 29 02:48:06.881735 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 375/735] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:06 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 1449 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:48:06.890787 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9ad19cde-9d59-4110-bd31-8f338a973e7e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:06.891413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9ad19cde-9d59-4110-bd31-8f338a973e7e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:06.904065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ad19cde-9d59-4110-bd31-8f338a973e7e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:06.905773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ad19cde-9d59-4110-bd31-8f338a973e7e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:06.906293 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ad19cde-9d59-4110-bd31-8f338a973e7e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:06.908118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ad19cde-9d59-4110-bd31-8f338a973e7e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:06.908975 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ad19cde-9d59-4110-bd31-8f338a973e7e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:06.909979 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ad19cde-9d59-4110-bd31-8f338a973e7e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:07.110797 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9ad19cde-9d59-4110-bd31-8f338a973e7e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:07.124627 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9ad19cde-9d59-4110-bd31-8f338a973e7e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:07.127204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9ad19cde-9d59-4110-bd31-8f338a973e7e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:07.130922 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9ad19cde-9d59-4110-bd31-8f338a973e7e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1343 microversion: 2.25 time: 0.247107 Oct 29 02:48:07.134053 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 376/736] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:06 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1343 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:07.146906 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-db15a107-26ec-455b-8f39-84ad679b2d53 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:07.147691 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-db15a107-26ec-455b-8f39-84ad679b2d53 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: e739833b-0b44-40c0-880d-59223a63b7b8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:07.177952 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:07.190453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db15a107-26ec-455b-8f39-84ad679b2d53 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:07.191347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db15a107-26ec-455b-8f39-84ad679b2d53 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:07.192087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db15a107-26ec-455b-8f39-84ad679b2d53 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:07.194153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db15a107-26ec-455b-8f39-84ad679b2d53 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:07.194348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db15a107-26ec-455b-8f39-84ad679b2d53 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:07.205634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db15a107-26ec-455b-8f39-84ad679b2d53 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:07.363107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-db15a107-26ec-455b-8f39-84ad679b2d53 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:07.388385 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-db15a107-26ec-455b-8f39-84ad679b2d53 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8" status: 200 len: 1221 microversion: 2.1 time: 0.252675 Oct 29 02:48:07.392851 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 377/737] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:07 2022] GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8 => generated 1221 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:07.474597 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-73907a28-20a0-4e89-96bd-97ddaa2d723e tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:07.488985 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-73907a28-20a0-4e89-96bd-97ddaa2d723e tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18" status: 200 len: 1325 microversion: 2.1 time: 1.296297 Oct 29 02:48:07.490083 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 361/738] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:06 2022] GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18 => generated 1325 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:07.913423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4497b6f5-72eb-4af6-b0f1-b3f637953496 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:07.914202 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4497b6f5-72eb-4af6-b0f1-b3f637953496 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] [instance: 0766d417-a358-4ad6-9af4-75f7d61f82eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:07.926476 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4497b6f5-72eb-4af6-b0f1-b3f637953496 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:07.931157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4497b6f5-72eb-4af6-b0f1-b3f637953496 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:07.931765 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4497b6f5-72eb-4af6-b0f1-b3f637953496 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:07.932925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4497b6f5-72eb-4af6-b0f1-b3f637953496 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:07.933491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4497b6f5-72eb-4af6-b0f1-b3f637953496 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:07.934011 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4497b6f5-72eb-4af6-b0f1-b3f637953496 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:07.968382 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-4497b6f5-72eb-4af6-b0f1-b3f637953496 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] HTTP exception thrown: Instance 0766d417-a358-4ad6-9af4-75f7d61f82eb could not be found. Oct 29 02:48:07.979272 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4497b6f5-72eb-4af6-b0f1-b3f637953496 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Request method failure captured: Oct 29 02:48:07.979272 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb HTTP/1.1 Oct 29 02:48:07.979272 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:48:07.979272 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:48:07.979272 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:48:07.979272 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:48:07.979272 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:48:07.979272 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:48:07.979272 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:48:07.979272 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:48:07.979272 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJQNwmi_ZNHOaSEzKv9I0K-gh09-Lozo6qOwigTUjT6gyesctUUv4hABQzNNrcPQn7E9aavYKSy6t8KveZCmdNqgglPA0gl8ZC-qd_vxMhR_dspz4FIef-3lg9LFDR1j6nYzsBVK55wxarjDCRqiGKG6j3ZRqNtwJOqdsiCBhNet6P8 Oct 29 02:48:07.979272 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:48:07.979272 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:48:07.979272 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:48:07.979272 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:48:07.979272 n-d-862967-2 devstack@n-api.service[127125]: X-Openstack-Nova-Api-Version: 2.75 Oct 29 02:48:07.979272 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:48:07.979272 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:48:07.979272 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: c69bfcc0806c4fff8413b502ef25c1d8 Oct 29 02:48:07.979272 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersAdmin275Test-1573659461 Oct 29 02:48:07.979272 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:48:07.979272 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:48:07.981963 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c69bfcc0806c4fff8413b502ef25c1d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c69bfcc0806c4fff8413b502ef25c1d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c69bfcc0806c4fff8413b502ef25c1d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c69bfcc0806c4fff8413b502ef25c1d8"}]}] Oct 29 02:48:07.981963 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersAdmin275Test-1573659461 Oct 29 02:48:07.981963 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: c69bfcc0806c4fff8413b502ef25c1d8 Oct 29 02:48:07.981963 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersAdmin275Test-1573659461 Oct 29 02:48:07.981963 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersAdmin275Test-1573659461-project Oct 29 02:48:07.981963 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:48:07.981963 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:48:07.981963 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 484ec82616bb4f29b86a8bc34e8b47d2 Oct 29 02:48:07.981963 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersAdmin275Test-1573659461-project Oct 29 02:48:07.981963 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:48:07.981963 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 0766d417-a358-4ad6-9af4-75f7d61f82eb could not be found. Oct 29 02:48:07.981963 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '0766d417-a358-4ad6-9af4-75f7d61f82eb'} Oct 29 02:48:07.982733 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:48:07.982733 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:07.982733 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:48:07.982733 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:48:07.982733 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:48:07.982733 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:48:07.982733 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:48:07.982733 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:48:07.982733 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:48:07.982733 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:48:07.982733 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0766d417-a358-4ad6-9af4-75f7d61f82eb could not be found. Oct 29 02:48:07.982733 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:48:07.982733 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:07.982733 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:48:07.982733 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:07.982733 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:07.982733 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:07.982733 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:48:07.982733 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:48:07.982733 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:48:07.984242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:48:07.984242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:48:07.984242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:48:07.984242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:48:07.984242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:48:07.984242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:48:07.984242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:48:07.984242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0766d417-a358-4ad6-9af4-75f7d61f82eb could not be found. Oct 29 02:48:07.984242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:48:07.984242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:07.984242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:48:07.984242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:07.984242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:07.984242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:07.984242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:48:07.984242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:48:07.984242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0766d417-a358-4ad6-9af4-75f7d61f82eb could not be found. Oct 29 02:48:07.984242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:48:07.989742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4497b6f5-72eb-4af6-b0f1-b3f637953496 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] Returning 404 to user: Instance 0766d417-a358-4ad6-9af4-75f7d61f82eb could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:48:07.992761 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4497b6f5-72eb-4af6-b0f1-b3f637953496 tempest-ServersAdmin275Test-1573659461 tempest-ServersAdmin275Test-1573659461-project] 10.222.0.46 "GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb" status: 404 len: 111 microversion: 2.75 time: 0.082529 Oct 29 02:48:07.994367 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 378/739] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:07 2022] GET /compute/v2.1/servers/0766d417-a358-4ad6-9af4-75f7d61f82eb => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 29 02:48:08.102988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:08.169819 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fecdd398-cdd9-4425-b4a3-b7d5c34079e2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:08.170431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fecdd398-cdd9-4425-b4a3-b7d5c34079e2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:08.190078 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fecdd398-cdd9-4425-b4a3-b7d5c34079e2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:08.190407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fecdd398-cdd9-4425-b4a3-b7d5c34079e2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:08.191189 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fecdd398-cdd9-4425-b4a3-b7d5c34079e2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:08.194652 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fecdd398-cdd9-4425-b4a3-b7d5c34079e2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:08.195446 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fecdd398-cdd9-4425-b4a3-b7d5c34079e2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:08.196201 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fecdd398-cdd9-4425-b4a3-b7d5c34079e2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:08.767771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3cb428d6-e9b0-4817-ac19-938a0c27348c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-330436152", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": "none"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:08.878396 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fecdd398-cdd9-4425-b4a3-b7d5c34079e2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:08.948562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fecdd398-cdd9-4425-b4a3-b7d5c34079e2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:08.968032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fecdd398-cdd9-4425-b4a3-b7d5c34079e2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:08.972871 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fecdd398-cdd9-4425-b4a3-b7d5c34079e2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1411 microversion: 2.25 time: 0.805170 Oct 29 02:48:08.983002 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 379/740] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:08 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1411 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:48:09.005632 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-85e876c5-cc5d-46a9-a1a7-eec4e398c32c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:09.007033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-85e876c5-cc5d-46a9-a1a7-eec4e398c32c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: e739833b-0b44-40c0-880d-59223a63b7b8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:09.035187 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85e876c5-cc5d-46a9-a1a7-eec4e398c32c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:09.050563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85e876c5-cc5d-46a9-a1a7-eec4e398c32c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:09.053105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85e876c5-cc5d-46a9-a1a7-eec4e398c32c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:09.055105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85e876c5-cc5d-46a9-a1a7-eec4e398c32c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:09.056503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85e876c5-cc5d-46a9-a1a7-eec4e398c32c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:09.060706 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85e876c5-cc5d-46a9-a1a7-eec4e398c32c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:09.070273 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-3cb428d6-e9b0-4817-ac19-938a0c27348c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:48:09.070962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-3cb428d6-e9b0-4817-ac19-938a0c27348c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:48:09.071953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-3cb428d6-e9b0-4817-ac19-938a0c27348c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:48:09.073129 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-3cb428d6-e9b0-4817-ac19-938a0c27348c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:48:09.073691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-3cb428d6-e9b0-4817-ac19-938a0c27348c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:48:09.096362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3cb428d6-e9b0-4817-ac19-938a0c27348c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:09.098628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3cb428d6-e9b0-4817-ac19-938a0c27348c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:09.100434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3cb428d6-e9b0-4817-ac19-938a0c27348c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:09.105208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3cb428d6-e9b0-4817-ac19-938a0c27348c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:09.105906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3cb428d6-e9b0-4817-ac19-938a0c27348c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:09.106504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3cb428d6-e9b0-4817-ac19-938a0c27348c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:09.147644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-3cb428d6-e9b0-4817-ac19-938a0c27348c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Getting quotas for project be4c45269d374fb1bc6354b0f95e229b. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:48:09.161209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-3cb428d6-e9b0-4817-ac19-938a0c27348c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Getting quotas for user 938533fc5a724b5196e44c8336bd009a and project be4c45269d374fb1bc6354b0f95e229b. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:48:09.194855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3cb428d6-e9b0-4817-ac19-938a0c27348c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:48:09.197634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3cb428d6-e9b0-4817-ac19-938a0c27348c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:48:09.359404 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3cb428d6-e9b0-4817-ac19-938a0c27348c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 1.262844 Oct 29 02:48:09.372203 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 362/741] 10.222.0.46 () {62 vars in 1188 bytes} [Sat Oct 29 02:48:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1275 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 02:48:09.385694 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-78a8bc22-bfad-4f7a-a3e4-4496c89d79d3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:09.391440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-78a8bc22-bfad-4f7a-a3e4-4496c89d79d3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e0095403-2e07-4041-b6e1-5064132dff18] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:09.410354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-85e876c5-cc5d-46a9-a1a7-eec4e398c32c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:09.419131 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78a8bc22-bfad-4f7a-a3e4-4496c89d79d3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:09.420401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78a8bc22-bfad-4f7a-a3e4-4496c89d79d3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:09.435293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78a8bc22-bfad-4f7a-a3e4-4496c89d79d3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:09.445739 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-85e876c5-cc5d-46a9-a1a7-eec4e398c32c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8" status: 200 len: 1287 microversion: 2.1 time: 0.457422 Oct 29 02:48:09.446085 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78a8bc22-bfad-4f7a-a3e4-4496c89d79d3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:09.446568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78a8bc22-bfad-4f7a-a3e4-4496c89d79d3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:09.447001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78a8bc22-bfad-4f7a-a3e4-4496c89d79d3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:09.448263 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 380/742] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:08 2022] GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8 => generated 1287 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:09.472104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-67d5e5b4-375b-488b-b5b2-b0af649e55f5 req-98608c8c-1a32-4d53-9ede-7123a746cc5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0095403-2e07-4041-b6e1-5064132dff18", "tag": "eee2dab9-9536-4e00-80d1-6a3c62c66656"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:09.517427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-67d5e5b4-375b-488b-b5b2-b0af649e55f5 req-98608c8c-1a32-4d53-9ede-7123a746cc5d service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:09.519723 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-67d5e5b4-375b-488b-b5b2-b0af649e55f5 req-98608c8c-1a32-4d53-9ede-7123a746cc5d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:09.524286 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-67d5e5b4-375b-488b-b5b2-b0af649e55f5 req-98608c8c-1a32-4d53-9ede-7123a746cc5d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:09.578979 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-67d5e5b4-375b-488b-b5b2-b0af649e55f5 req-98608c8c-1a32-4d53-9ede-7123a746cc5d service nova] Creating event network-changed:eee2dab9-9536-4e00-80d1-6a3c62c66656 for instance e0095403-2e07-4041-b6e1-5064132dff18 on n-h1-862967-2 Oct 29 02:48:09.591882 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-67d5e5b4-375b-488b-b5b2-b0af649e55f5 req-98608c8c-1a32-4d53-9ede-7123a746cc5d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141644 Oct 29 02:48:09.598494 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 381/743] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:09.617716 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-da9150ed-51ba-4919-9ddf-ad060994cb7b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:09.618583 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-da9150ed-51ba-4919-9ddf-ad060994cb7b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:09.903426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-da9150ed-51ba-4919-9ddf-ad060994cb7b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:09.922432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-da9150ed-51ba-4919-9ddf-ad060994cb7b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:09.931031 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-da9150ed-51ba-4919-9ddf-ad060994cb7b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:09.947308 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-da9150ed-51ba-4919-9ddf-ad060994cb7b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1452 microversion: 2.91 time: 0.343904 Oct 29 02:48:09.977189 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 382/744] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:09 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1452 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:10.035661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-de8c9c40-f7b5-4c32-a1ec-1545e34ba1bb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:10.038221 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-de8c9c40-f7b5-4c32-a1ec-1545e34ba1bb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:10.066873 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-de8c9c40-f7b5-4c32-a1ec-1545e34ba1bb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:10.075470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-de8c9c40-f7b5-4c32-a1ec-1545e34ba1bb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:10.079107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-de8c9c40-f7b5-4c32-a1ec-1545e34ba1bb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:10.080780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-de8c9c40-f7b5-4c32-a1ec-1545e34ba1bb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:10.081844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-de8c9c40-f7b5-4c32-a1ec-1545e34ba1bb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:10.082841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-de8c9c40-f7b5-4c32-a1ec-1545e34ba1bb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:10.527907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-de8c9c40-f7b5-4c32-a1ec-1545e34ba1bb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:10.542255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-de8c9c40-f7b5-4c32-a1ec-1545e34ba1bb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:10.543937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-de8c9c40-f7b5-4c32-a1ec-1545e34ba1bb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:10.545857 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-de8c9c40-f7b5-4c32-a1ec-1545e34ba1bb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1411 microversion: 2.25 time: 0.518005 Oct 29 02:48:10.549232 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 383/745] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:10 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1411 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:10.560344 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e93dc641-1170-481e-8753-adace8a34186 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:10.562528 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e93dc641-1170-481e-8753-adace8a34186 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: e739833b-0b44-40c0-880d-59223a63b7b8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:10.582006 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e93dc641-1170-481e-8753-adace8a34186 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:10.582748 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e93dc641-1170-481e-8753-adace8a34186 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:10.583598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e93dc641-1170-481e-8753-adace8a34186 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:10.586775 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e93dc641-1170-481e-8753-adace8a34186 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:10.587745 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e93dc641-1170-481e-8753-adace8a34186 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:10.588352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e93dc641-1170-481e-8753-adace8a34186 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:10.793588 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e93dc641-1170-481e-8753-adace8a34186 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:10.796406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:10.820465 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e93dc641-1170-481e-8753-adace8a34186 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8" status: 200 len: 1275 microversion: 2.1 time: 0.268315 Oct 29 02:48:10.824087 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 384/746] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:10 2022] GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8 => generated 1275 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:11.225894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-56c01b1a-b781-471a-868f-562638dbef22 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-884321103", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:11.358085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-56c01b1a-b781-471a-868f-562638dbef22 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] validate_networks() for None {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:48:11.670301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-78a8bc22-bfad-4f7a-a3e4-4496c89d79d3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:11.710457 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-78a8bc22-bfad-4f7a-a3e4-4496c89d79d3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18" status: 200 len: 1325 microversion: 2.1 time: 2.336721 Oct 29 02:48:11.713511 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 363/747] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:09 2022] GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18 => generated 1325 bytes in 2340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:11.725515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3f7b2150-aac2-416d-ae06-2b0113c8dad2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:11.726447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3f7b2150-aac2-416d-ae06-2b0113c8dad2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:11.744207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f7b2150-aac2-416d-ae06-2b0113c8dad2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:11.745346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f7b2150-aac2-416d-ae06-2b0113c8dad2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:11.746047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f7b2150-aac2-416d-ae06-2b0113c8dad2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:11.747785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f7b2150-aac2-416d-ae06-2b0113c8dad2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:11.748424 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f7b2150-aac2-416d-ae06-2b0113c8dad2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:11.749071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f7b2150-aac2-416d-ae06-2b0113c8dad2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:12.029466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3f7b2150-aac2-416d-ae06-2b0113c8dad2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:12.049463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3f7b2150-aac2-416d-ae06-2b0113c8dad2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:12.055564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3f7b2150-aac2-416d-ae06-2b0113c8dad2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:12.070525 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3f7b2150-aac2-416d-ae06-2b0113c8dad2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1504 microversion: 2.91 time: 0.354120 Oct 29 02:48:12.086723 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 364/748] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:11 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1504 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:12.115576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1b692d8b-8a09-4919-817e-7c62d7cd60a8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:12.116817 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1b692d8b-8a09-4919-817e-7c62d7cd60a8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:12.142515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b692d8b-8a09-4919-817e-7c62d7cd60a8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:12.150092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b692d8b-8a09-4919-817e-7c62d7cd60a8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:12.152563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b692d8b-8a09-4919-817e-7c62d7cd60a8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:12.155329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b692d8b-8a09-4919-817e-7c62d7cd60a8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:12.171351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b692d8b-8a09-4919-817e-7c62d7cd60a8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:12.177520 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b692d8b-8a09-4919-817e-7c62d7cd60a8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:12.683675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1b692d8b-8a09-4919-817e-7c62d7cd60a8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:12.693064 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1b692d8b-8a09-4919-817e-7c62d7cd60a8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:12.700394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1b692d8b-8a09-4919-817e-7c62d7cd60a8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:12.701672 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1b692d8b-8a09-4919-817e-7c62d7cd60a8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1411 microversion: 2.25 time: 0.613675 Oct 29 02:48:12.702506 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 365/749] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:12 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1411 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:12.716625 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6ffc7860-42a7-4e9d-84c6-8e009dd473ec tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:12.717245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6ffc7860-42a7-4e9d-84c6-8e009dd473ec tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: e739833b-0b44-40c0-880d-59223a63b7b8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:12.754525 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ffc7860-42a7-4e9d-84c6-8e009dd473ec tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:12.755360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ffc7860-42a7-4e9d-84c6-8e009dd473ec tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:12.756087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ffc7860-42a7-4e9d-84c6-8e009dd473ec tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:12.762106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ffc7860-42a7-4e9d-84c6-8e009dd473ec tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:12.763173 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ffc7860-42a7-4e9d-84c6-8e009dd473ec tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:12.763878 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ffc7860-42a7-4e9d-84c6-8e009dd473ec tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:12.972245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-56c01b1a-b781-471a-868f-562638dbef22 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:48:12.974123 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-56c01b1a-b781-471a-868f-562638dbef22 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:48:12.975020 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-56c01b1a-b781-471a-868f-562638dbef22 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:48:12.975978 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-56c01b1a-b781-471a-868f-562638dbef22 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:48:12.976841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-56c01b1a-b781-471a-868f-562638dbef22 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:48:12.991729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6ffc7860-42a7-4e9d-84c6-8e009dd473ec tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:13.003763 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6ffc7860-42a7-4e9d-84c6-8e009dd473ec tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8" status: 200 len: 1317 microversion: 2.1 time: 0.287646 Oct 29 02:48:13.004683 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 366/750] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:12 2022] GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8 => generated 1317 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:13.008055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-56c01b1a-b781-471a-868f-562638dbef22 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:13.010801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-56c01b1a-b781-471a-868f-562638dbef22 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:13.011774 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-56c01b1a-b781-471a-868f-562638dbef22 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:13.013213 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-56c01b1a-b781-471a-868f-562638dbef22 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:13.014178 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-56c01b1a-b781-471a-868f-562638dbef22 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:13.015078 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-56c01b1a-b781-471a-868f-562638dbef22 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:13.024212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-314a3440-5e57-4fa5-8988-78a432523d5e req-2a1429e9-377a-4e44-9629-c94e108fc83f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "694141ac-c96c-409b-9eb2-831a3ccb5a68", "tag": "0c4a3365-7206-4763-be5c-6b7899359935"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:13.063795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-314a3440-5e57-4fa5-8988-78a432523d5e req-2a1429e9-377a-4e44-9629-c94e108fc83f service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:13.064594 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-314a3440-5e57-4fa5-8988-78a432523d5e req-2a1429e9-377a-4e44-9629-c94e108fc83f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:13.065183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-314a3440-5e57-4fa5-8988-78a432523d5e req-2a1429e9-377a-4e44-9629-c94e108fc83f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:13.082522 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-56c01b1a-b781-471a-868f-562638dbef22 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Getting quotas for project 24ee44ab29014be1bff1c5a18c53c2e2. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:48:13.090365 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-314a3440-5e57-4fa5-8988-78a432523d5e req-2a1429e9-377a-4e44-9629-c94e108fc83f service nova] Creating event network-changed:0c4a3365-7206-4763-be5c-6b7899359935 for instance 694141ac-c96c-409b-9eb2-831a3ccb5a68 on n-h1-862967-2 Oct 29 02:48:13.099437 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-56c01b1a-b781-471a-868f-562638dbef22 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Getting quotas for user 8a6ba7c1ab324fe583f5ad27474cafc2 and project 24ee44ab29014be1bff1c5a18c53c2e2. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:48:13.101166 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-314a3440-5e57-4fa5-8988-78a432523d5e req-2a1429e9-377a-4e44-9629-c94e108fc83f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093973 Oct 29 02:48:13.118471 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 367/751] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:13.124179 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-87616e4d-2bb1-4e0a-85f3-590feb62d766 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:13.132471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-56c01b1a-b781-471a-868f-562638dbef22 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:48:13.136844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-56c01b1a-b781-471a-868f-562638dbef22 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:48:13.137282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-87616e4d-2bb1-4e0a-85f3-590feb62d766 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e0095403-2e07-4041-b6e1-5064132dff18] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:13.162526 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87616e4d-2bb1-4e0a-85f3-590feb62d766 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:13.163039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87616e4d-2bb1-4e0a-85f3-590feb62d766 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:13.163643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87616e4d-2bb1-4e0a-85f3-590feb62d766 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:13.164899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87616e4d-2bb1-4e0a-85f3-590feb62d766 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:13.165728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87616e4d-2bb1-4e0a-85f3-590feb62d766 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:13.166483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87616e4d-2bb1-4e0a-85f3-590feb62d766 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:13.201574 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-56c01b1a-b781-471a-868f-562638dbef22 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.312087 Oct 29 02:48:13.204119 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 385/752] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:48:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:48:13.220206 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b34580a0-b003-44bb-b494-af3a5ec81967 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:13.222570 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b34580a0-b003-44bb-b494-af3a5ec81967 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:13.237065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b34580a0-b003-44bb-b494-af3a5ec81967 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:13.241949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b34580a0-b003-44bb-b494-af3a5ec81967 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:13.243288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b34580a0-b003-44bb-b494-af3a5ec81967 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:13.244717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b34580a0-b003-44bb-b494-af3a5ec81967 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:13.246310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b34580a0-b003-44bb-b494-af3a5ec81967 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:13.246932 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b34580a0-b003-44bb-b494-af3a5ec81967 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:13.590579 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b34580a0-b003-44bb-b494-af3a5ec81967 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:13.623118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b34580a0-b003-44bb-b494-af3a5ec81967 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:13.636207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b34580a0-b003-44bb-b494-af3a5ec81967 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:13.654684 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b34580a0-b003-44bb-b494-af3a5ec81967 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1510 microversion: 2.91 time: 0.448703 Oct 29 02:48:13.668576 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 386/753] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:13 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1510 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:13.687008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-27002104-0608-4fe4-84ae-ecad3279fdbc tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1321249911", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:13.922135 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-27002104-0608-4fe4-84ae-ecad3279fdbc tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] validate_networks() for None {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:48:14.240384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-87616e4d-2bb1-4e0a-85f3-590feb62d766 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:14.261685 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-87616e4d-2bb1-4e0a-85f3-590feb62d766 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18" status: 200 len: 1325 microversion: 2.1 time: 1.137447 Oct 29 02:48:14.262619 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 368/754] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:13 2022] GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18 => generated 1325 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:14.281109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-87646334-e8f9-4914-9b56-6479182b41b0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:14.282147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-87646334-e8f9-4914-9b56-6479182b41b0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:14.292008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87646334-e8f9-4914-9b56-6479182b41b0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:14.295230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87646334-e8f9-4914-9b56-6479182b41b0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:14.297062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87646334-e8f9-4914-9b56-6479182b41b0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:14.300131 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87646334-e8f9-4914-9b56-6479182b41b0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:14.300824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87646334-e8f9-4914-9b56-6479182b41b0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:14.305435 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87646334-e8f9-4914-9b56-6479182b41b0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:14.532467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-27002104-0608-4fe4-84ae-ecad3279fdbc tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:48:14.533335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-27002104-0608-4fe4-84ae-ecad3279fdbc tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:48:14.533506 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-27002104-0608-4fe4-84ae-ecad3279fdbc tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:48:14.533884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-27002104-0608-4fe4-84ae-ecad3279fdbc tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:48:14.534301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-27002104-0608-4fe4-84ae-ecad3279fdbc tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:48:14.555188 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27002104-0608-4fe4-84ae-ecad3279fdbc tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:14.556315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27002104-0608-4fe4-84ae-ecad3279fdbc tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:14.559811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27002104-0608-4fe4-84ae-ecad3279fdbc tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:14.561058 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27002104-0608-4fe4-84ae-ecad3279fdbc tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:14.564049 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27002104-0608-4fe4-84ae-ecad3279fdbc tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:14.568655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27002104-0608-4fe4-84ae-ecad3279fdbc tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:14.589832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=9 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:14.633855 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-27002104-0608-4fe4-84ae-ecad3279fdbc tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Getting quotas for project 24ee44ab29014be1bff1c5a18c53c2e2. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:48:14.652822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-27002104-0608-4fe4-84ae-ecad3279fdbc tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Getting quotas for user 8a6ba7c1ab324fe583f5ad27474cafc2 and project 24ee44ab29014be1bff1c5a18c53c2e2. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:48:14.772473 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-27002104-0608-4fe4-84ae-ecad3279fdbc tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:48:14.775347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-27002104-0608-4fe4-84ae-ecad3279fdbc tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 34d62a74-da30-4154-adfe-289eb2ad7564] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:48:14.900651 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-27002104-0608-4fe4-84ae-ecad3279fdbc tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.234401 Oct 29 02:48:14.901950 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 387/755] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:48:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:48:14.907835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6be0a05e-ab9d-43e8-80f3-fb2d60e2bd91 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:14.909416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6be0a05e-ab9d-43e8-80f3-fb2d60e2bd91 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: e739833b-0b44-40c0-880d-59223a63b7b8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:14.925079 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6be0a05e-ab9d-43e8-80f3-fb2d60e2bd91 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:14.926060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6be0a05e-ab9d-43e8-80f3-fb2d60e2bd91 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:14.927071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6be0a05e-ab9d-43e8-80f3-fb2d60e2bd91 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:14.928549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6be0a05e-ab9d-43e8-80f3-fb2d60e2bd91 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:14.929353 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6be0a05e-ab9d-43e8-80f3-fb2d60e2bd91 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:14.930156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6be0a05e-ab9d-43e8-80f3-fb2d60e2bd91 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:15.485222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-87646334-e8f9-4914-9b56-6479182b41b0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:15.491086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=100 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:15.546315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-87646334-e8f9-4914-9b56-6479182b41b0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:15.556497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-87646334-e8f9-4914-9b56-6479182b41b0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:15.557759 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-87646334-e8f9-4914-9b56-6479182b41b0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1411 microversion: 2.25 time: 1.293615 Oct 29 02:48:15.590500 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 369/756] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:14 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1411 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:15.628235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4d4766f7-90e3-4c53-b1e8-8483ca74f674 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:15.628908 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4d4766f7-90e3-4c53-b1e8-8483ca74f674 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:15.674964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d4766f7-90e3-4c53-b1e8-8483ca74f674 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:15.677470 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d4766f7-90e3-4c53-b1e8-8483ca74f674 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:15.679557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d4766f7-90e3-4c53-b1e8-8483ca74f674 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:15.684435 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d4766f7-90e3-4c53-b1e8-8483ca74f674 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:15.686417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d4766f7-90e3-4c53-b1e8-8483ca74f674 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:15.688391 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d4766f7-90e3-4c53-b1e8-8483ca74f674 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:15.961089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6be0a05e-ab9d-43e8-80f3-fb2d60e2bd91 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:15.992868 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6be0a05e-ab9d-43e8-80f3-fb2d60e2bd91 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8" status: 200 len: 1317 microversion: 2.1 time: 1.086879 Oct 29 02:48:15.994366 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 388/757] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:14 2022] GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8 => generated 1317 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:16.013890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-1a7952a0-2eb8-45a9-b91a-fea230391cb1 req-bbd21526-93c9-4c8a-af51-54aaf475a8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e739833b-0b44-40c0-880d-59223a63b7b8", "tag": "f56fd42b-c41b-49bf-8b75-57b4f3ebc5c4"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:16.051024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-1a7952a0-2eb8-45a9-b91a-fea230391cb1 req-bbd21526-93c9-4c8a-af51-54aaf475a8b6 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:16.051905 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-1a7952a0-2eb8-45a9-b91a-fea230391cb1 req-bbd21526-93c9-4c8a-af51-54aaf475a8b6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:16.052600 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-1a7952a0-2eb8-45a9-b91a-fea230391cb1 req-bbd21526-93c9-4c8a-af51-54aaf475a8b6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:16.096292 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-1a7952a0-2eb8-45a9-b91a-fea230391cb1 req-bbd21526-93c9-4c8a-af51-54aaf475a8b6 service nova] Creating event network-changed:f56fd42b-c41b-49bf-8b75-57b4f3ebc5c4 for instance e739833b-0b44-40c0-880d-59223a63b7b8 on n-h2-862967-2 Oct 29 02:48:16.113221 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-1a7952a0-2eb8-45a9-b91a-fea230391cb1 req-bbd21526-93c9-4c8a-af51-54aaf475a8b6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116019 Oct 29 02:48:16.114879 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 389/758] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:16.126960 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0c261263-f150-423c-bb34-b0779f54f940 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:16.128476 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0c261263-f150-423c-bb34-b0779f54f940 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 34d62a74-da30-4154-adfe-289eb2ad7564] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:16.190985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4d4766f7-90e3-4c53-b1e8-8483ca74f674 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:16.215750 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4d4766f7-90e3-4c53-b1e8-8483ca74f674 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:16.218824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4d4766f7-90e3-4c53-b1e8-8483ca74f674 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:16.237993 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4d4766f7-90e3-4c53-b1e8-8483ca74f674 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1510 microversion: 2.91 time: 0.638963 Oct 29 02:48:16.261479 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 370/759] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:15 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1510 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:16.274946 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d2e96442-4304-435a-9bec-4156ed3fc32a tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:16.275918 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d2e96442-4304-435a-9bec-4156ed3fc32a tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e0095403-2e07-4041-b6e1-5064132dff18] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:16.293369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d2e96442-4304-435a-9bec-4156ed3fc32a tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:16.294172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d2e96442-4304-435a-9bec-4156ed3fc32a tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:16.294812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d2e96442-4304-435a-9bec-4156ed3fc32a tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:16.298283 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d2e96442-4304-435a-9bec-4156ed3fc32a tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:16.299011 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d2e96442-4304-435a-9bec-4156ed3fc32a tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:16.299627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d2e96442-4304-435a-9bec-4156ed3fc32a tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:16.416806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0c261263-f150-423c-bb34-b0779f54f940 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:16.432553 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0c261263-f150-423c-bb34-b0779f54f940 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564" status: 200 len: 1214 microversion: 2.1 time: 0.314315 Oct 29 02:48:16.440681 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 390/760] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:16 2022] GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564 => generated 1214 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:16.622383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f83182c6-ed34-4216-922d-b6ae9cc4f421 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:16.629168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f83182c6-ed34-4216-922d-b6ae9cc4f421 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:16.682917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f83182c6-ed34-4216-922d-b6ae9cc4f421 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:16.695296 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f83182c6-ed34-4216-922d-b6ae9cc4f421 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:16.696358 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f83182c6-ed34-4216-922d-b6ae9cc4f421 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:16.712549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f83182c6-ed34-4216-922d-b6ae9cc4f421 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:16.719034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f83182c6-ed34-4216-922d-b6ae9cc4f421 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:16.722384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f83182c6-ed34-4216-922d-b6ae9cc4f421 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:17.227429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f83182c6-ed34-4216-922d-b6ae9cc4f421 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:17.239195 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f83182c6-ed34-4216-922d-b6ae9cc4f421 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:17.241705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f83182c6-ed34-4216-922d-b6ae9cc4f421 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:17.242779 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f83182c6-ed34-4216-922d-b6ae9cc4f421 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1411 microversion: 2.25 time: 0.636745 Oct 29 02:48:17.244726 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 391/761] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:16 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1411 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:17.251801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d1cdf58e-766b-4f89-aee8-11e08f6abe5c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:17.252661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d1cdf58e-766b-4f89-aee8-11e08f6abe5c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: e739833b-0b44-40c0-880d-59223a63b7b8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:17.273825 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1cdf58e-766b-4f89-aee8-11e08f6abe5c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:17.274413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1cdf58e-766b-4f89-aee8-11e08f6abe5c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:17.275236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1cdf58e-766b-4f89-aee8-11e08f6abe5c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:17.275969 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1cdf58e-766b-4f89-aee8-11e08f6abe5c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:17.276431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1cdf58e-766b-4f89-aee8-11e08f6abe5c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:17.276900 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1cdf58e-766b-4f89-aee8-11e08f6abe5c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:17.538463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d1cdf58e-766b-4f89-aee8-11e08f6abe5c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:17.547076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d2e96442-4304-435a-9bec-4156ed3fc32a tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:17.554745 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d1cdf58e-766b-4f89-aee8-11e08f6abe5c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8" status: 200 len: 1317 microversion: 2.1 time: 0.308368 Oct 29 02:48:17.561022 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 392/762] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:17 2022] GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8 => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:17.564202 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d2e96442-4304-435a-9bec-4156ed3fc32a tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18" status: 200 len: 1325 microversion: 2.1 time: 1.301207 Oct 29 02:48:17.565214 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 371/763] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:16 2022] GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18 => generated 1325 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:17.584222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-891f5c98-6b65-4985-8e0c-e4fb3465ef34 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:17.585240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dd16918d-1811-4605-a152-f426b5fc5104 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:17.585847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-891f5c98-6b65-4985-8e0c-e4fb3465ef34 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 34d62a74-da30-4154-adfe-289eb2ad7564] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:17.588654 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dd16918d-1811-4605-a152-f426b5fc5104 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:17.607653 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-891f5c98-6b65-4985-8e0c-e4fb3465ef34 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:17.608763 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-891f5c98-6b65-4985-8e0c-e4fb3465ef34 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:17.610929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-891f5c98-6b65-4985-8e0c-e4fb3465ef34 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:17.613853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-891f5c98-6b65-4985-8e0c-e4fb3465ef34 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:17.614727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-891f5c98-6b65-4985-8e0c-e4fb3465ef34 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:17.617218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-891f5c98-6b65-4985-8e0c-e4fb3465ef34 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:17.618161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd16918d-1811-4605-a152-f426b5fc5104 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:17.620040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd16918d-1811-4605-a152-f426b5fc5104 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:17.620731 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd16918d-1811-4605-a152-f426b5fc5104 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:17.622937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd16918d-1811-4605-a152-f426b5fc5104 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:17.625630 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd16918d-1811-4605-a152-f426b5fc5104 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:17.629566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd16918d-1811-4605-a152-f426b5fc5104 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:17.810070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-891f5c98-6b65-4985-8e0c-e4fb3465ef34 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:17.838838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dd16918d-1811-4605-a152-f426b5fc5104 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:17.840164 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-891f5c98-6b65-4985-8e0c-e4fb3465ef34 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564" status: 200 len: 1266 microversion: 2.1 time: 0.269874 Oct 29 02:48:17.857929 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 372/764] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:17 2022] GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564 => generated 1266 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:17.871869 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dd16918d-1811-4605-a152-f426b5fc5104 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:17.877050 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dd16918d-1811-4605-a152-f426b5fc5104 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:17.887734 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dd16918d-1811-4605-a152-f426b5fc5104 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1531 microversion: 2.91 time: 0.324638 Oct 29 02:48:17.894120 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 393/765] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:17 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1531 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:18.048074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-01c02fef-46e4-4878-bee9-c7e33473fb82 req-70f9b607-64b9-4531-93be-3dfd7ac6e58c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0095403-2e07-4041-b6e1-5064132dff18", "name": "network-vif-plugged", "status": "completed", "tag": "eee2dab9-9536-4e00-80d1-6a3c62c66656"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:18.105663 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-01c02fef-46e4-4878-bee9-c7e33473fb82 req-70f9b607-64b9-4531-93be-3dfd7ac6e58c service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:18.107103 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-01c02fef-46e4-4878-bee9-c7e33473fb82 req-70f9b607-64b9-4531-93be-3dfd7ac6e58c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:18.108790 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-01c02fef-46e4-4878-bee9-c7e33473fb82 req-70f9b607-64b9-4531-93be-3dfd7ac6e58c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:18.134923 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-01c02fef-46e4-4878-bee9-c7e33473fb82 req-70f9b607-64b9-4531-93be-3dfd7ac6e58c service nova] Creating event network-vif-plugged:eee2dab9-9536-4e00-80d1-6a3c62c66656 for instance e0095403-2e07-4041-b6e1-5064132dff18 on n-h1-862967-2 Oct 29 02:48:18.155246 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-01c02fef-46e4-4878-bee9-c7e33473fb82 req-70f9b607-64b9-4531-93be-3dfd7ac6e58c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113568 Oct 29 02:48:18.157952 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 394/766] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:18.283579 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-63be73e3-adae-4ef8-b7cb-2a4f4a775e0c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:18.284318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-63be73e3-adae-4ef8-b7cb-2a4f4a775e0c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:18.313311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63be73e3-adae-4ef8-b7cb-2a4f4a775e0c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:18.313844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63be73e3-adae-4ef8-b7cb-2a4f4a775e0c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:18.314299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63be73e3-adae-4ef8-b7cb-2a4f4a775e0c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:18.315035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63be73e3-adae-4ef8-b7cb-2a4f4a775e0c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:18.315497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63be73e3-adae-4ef8-b7cb-2a4f4a775e0c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:18.315940 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63be73e3-adae-4ef8-b7cb-2a4f4a775e0c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:18.510479 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-303de983-21ef-4141-abc4-98fb2d306f83 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:18.511335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-303de983-21ef-4141-abc4-98fb2d306f83 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:18.536021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-303de983-21ef-4141-abc4-98fb2d306f83 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:18.536940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-303de983-21ef-4141-abc4-98fb2d306f83 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:18.537809 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-303de983-21ef-4141-abc4-98fb2d306f83 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:18.544369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-303de983-21ef-4141-abc4-98fb2d306f83 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:18.545690 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-303de983-21ef-4141-abc4-98fb2d306f83 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:18.546666 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-303de983-21ef-4141-abc4-98fb2d306f83 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:18.916143 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-303de983-21ef-4141-abc4-98fb2d306f83 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lazy-loading 'services' on Instance uuid 0d377f50-7426-425c-a1fe-c63f8d0f1186 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:48:19.041107 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-303de983-21ef-4141-abc4-98fb2d306f83 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1936 microversion: 2.91 time: 1.110909 Oct 29 02:48:19.046233 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 373/767] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:17 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1936 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:19.102107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7dfe2f5a-6fcb-41af-829a-0558633ae436 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:19.103621 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7dfe2f5a-6fcb-41af-829a-0558633ae436 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e0095403-2e07-4041-b6e1-5064132dff18] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:19.124207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:19.142715 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7dfe2f5a-6fcb-41af-829a-0558633ae436 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:19.144402 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7dfe2f5a-6fcb-41af-829a-0558633ae436 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:19.147108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7dfe2f5a-6fcb-41af-829a-0558633ae436 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:19.152049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7dfe2f5a-6fcb-41af-829a-0558633ae436 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:19.156957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7dfe2f5a-6fcb-41af-829a-0558633ae436 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:19.158648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-63be73e3-adae-4ef8-b7cb-2a4f4a775e0c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:19.160139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7dfe2f5a-6fcb-41af-829a-0558633ae436 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:19.181354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-63be73e3-adae-4ef8-b7cb-2a4f4a775e0c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:19.186869 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-63be73e3-adae-4ef8-b7cb-2a4f4a775e0c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:19.190173 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-63be73e3-adae-4ef8-b7cb-2a4f4a775e0c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1411 microversion: 2.25 time: 0.910640 Oct 29 02:48:19.192043 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 395/768] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:18 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1411 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:19.205561 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d834fdee-e83b-41ae-b7f0-262def7705ce tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:19.207380 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d834fdee-e83b-41ae-b7f0-262def7705ce tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: e739833b-0b44-40c0-880d-59223a63b7b8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:19.225820 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d834fdee-e83b-41ae-b7f0-262def7705ce tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:19.227510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d834fdee-e83b-41ae-b7f0-262def7705ce tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:19.229292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d834fdee-e83b-41ae-b7f0-262def7705ce tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:19.231015 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d834fdee-e83b-41ae-b7f0-262def7705ce tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:19.232165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d834fdee-e83b-41ae-b7f0-262def7705ce tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:19.233540 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d834fdee-e83b-41ae-b7f0-262def7705ce tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:19.270881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=54,nova_cell0:UPDATE=12 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:19.972016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d834fdee-e83b-41ae-b7f0-262def7705ce tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:19.996563 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d834fdee-e83b-41ae-b7f0-262def7705ce tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8" status: 200 len: 1317 microversion: 2.1 time: 0.800264 Oct 29 02:48:19.999029 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 396/769] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:19 2022] GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8 => generated 1317 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:20.039036 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-822d392f-b148-441d-8c03-baeb44e37a88 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:20.040797 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-822d392f-b148-441d-8c03-baeb44e37a88 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 34d62a74-da30-4154-adfe-289eb2ad7564] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:20.067685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-822d392f-b148-441d-8c03-baeb44e37a88 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:20.072482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-822d392f-b148-441d-8c03-baeb44e37a88 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:20.073788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-822d392f-b148-441d-8c03-baeb44e37a88 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:20.075514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-822d392f-b148-441d-8c03-baeb44e37a88 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:20.081977 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-822d392f-b148-441d-8c03-baeb44e37a88 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:20.082763 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-822d392f-b148-441d-8c03-baeb44e37a88 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:20.279640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7dfe2f5a-6fcb-41af-829a-0558633ae436 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:20.292130 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-822d392f-b148-441d-8c03-baeb44e37a88 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:20.308426 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7dfe2f5a-6fcb-41af-829a-0558633ae436 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18" status: 200 len: 1325 microversion: 2.1 time: 1.259293 Oct 29 02:48:20.310279 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 374/770] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:19 2022] GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18 => generated 1325 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:20.316702 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f0709c30-5dc9-43ca-821c-3a4fb1069cc7 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:20.320054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f0709c30-5dc9-43ca-821c-3a4fb1069cc7 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:20.325569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=9,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:20.354975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0709c30-5dc9-43ca-821c-3a4fb1069cc7 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:20.358239 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0709c30-5dc9-43ca-821c-3a4fb1069cc7 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:20.360673 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-822d392f-b148-441d-8c03-baeb44e37a88 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564" status: 200 len: 1266 microversion: 2.1 time: 0.342537 Oct 29 02:48:20.362123 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 397/771] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:20 2022] GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564 => generated 1266 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:20.362899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0709c30-5dc9-43ca-821c-3a4fb1069cc7 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:20.365793 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0709c30-5dc9-43ca-821c-3a4fb1069cc7 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:20.366682 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0709c30-5dc9-43ca-821c-3a4fb1069cc7 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:20.367677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0709c30-5dc9-43ca-821c-3a4fb1069cc7 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:20.380242 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a1871b97-57f3-477d-8f19-f0bced1a2179 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:20.385434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a1871b97-57f3-477d-8f19-f0bced1a2179 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:20.410320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1871b97-57f3-477d-8f19-f0bced1a2179 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:20.411828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1871b97-57f3-477d-8f19-f0bced1a2179 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:20.414945 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1871b97-57f3-477d-8f19-f0bced1a2179 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:20.415818 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1871b97-57f3-477d-8f19-f0bced1a2179 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:20.416291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1871b97-57f3-477d-8f19-f0bced1a2179 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:20.416777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1871b97-57f3-477d-8f19-f0bced1a2179 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:20.655361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-f0709c30-5dc9-43ca-821c-3a4fb1069cc7 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lazy-loading 'services' on Instance uuid 0d377f50-7426-425c-a1fe-c63f8d0f1186 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:48:20.718334 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f0709c30-5dc9-43ca-821c-3a4fb1069cc7 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1936 microversion: 2.91 time: 0.403682 Oct 29 02:48:20.719381 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 375/772] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:20 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1936 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:20.735937 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f72d0b89-dae5-4f06-b8b5-713cca2c1052 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:20.736979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f72d0b89-dae5-4f06-b8b5-713cca2c1052 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: aff333bb-fff4-4b3e-a3f9-a567b7786a62] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:20.755211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f72d0b89-dae5-4f06-b8b5-713cca2c1052 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:20.756209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f72d0b89-dae5-4f06-b8b5-713cca2c1052 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:20.757340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f72d0b89-dae5-4f06-b8b5-713cca2c1052 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:20.759868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f72d0b89-dae5-4f06-b8b5-713cca2c1052 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:20.761131 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f72d0b89-dae5-4f06-b8b5-713cca2c1052 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:20.762256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f72d0b89-dae5-4f06-b8b5-713cca2c1052 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:20.827109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f72d0b89-dae5-4f06-b8b5-713cca2c1052 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: aff333bb-fff4-4b3e-a3f9-a567b7786a62] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:48:21.120291 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f72d0b89-dae5-4f06-b8b5-713cca2c1052 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "DELETE /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62" status: 204 len: 0 microversion: 2.1 time: 0.395912 Oct 29 02:48:21.121701 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 376/773] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:48:20 2022] DELETE /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:48:21.129203 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8e183748-50a0-461b-b0b2-a1e56a77cdba tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:21.137018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8e183748-50a0-461b-b0b2-a1e56a77cdba tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:21.149500 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8e183748-50a0-461b-b0b2-a1e56a77cdba tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:21.156487 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8e183748-50a0-461b-b0b2-a1e56a77cdba tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:21.161741 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8e183748-50a0-461b-b0b2-a1e56a77cdba tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:21.166588 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8e183748-50a0-461b-b0b2-a1e56a77cdba tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:21.167620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8e183748-50a0-461b-b0b2-a1e56a77cdba tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:21.296399 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8e183748-50a0-461b-b0b2-a1e56a77cdba tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.171913 Oct 29 02:48:21.302219 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 377/774] 10.222.0.46 () {60 vars in 1217 bytes} [Sat Oct 29 02:48:21 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:48:21.320915 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a1871b97-57f3-477d-8f19-f0bced1a2179 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:21.322171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4c27e52d-5e1e-46f4-9381-511528274818 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:21.323976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4c27e52d-5e1e-46f4-9381-511528274818 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: e739833b-0b44-40c0-880d-59223a63b7b8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:21.339903 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a1871b97-57f3-477d-8f19-f0bced1a2179 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:21.342728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a1871b97-57f3-477d-8f19-f0bced1a2179 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:21.345007 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a1871b97-57f3-477d-8f19-f0bced1a2179 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1411 microversion: 2.25 time: 0.979899 Oct 29 02:48:21.345921 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 398/775] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:20 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1411 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:21.351640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c27e52d-5e1e-46f4-9381-511528274818 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:21.358545 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-18bd55b0-3558-4cf5-bc56-200ec8109c0e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:21.359363 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c27e52d-5e1e-46f4-9381-511528274818 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:21.360324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-18bd55b0-3558-4cf5-bc56-200ec8109c0e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:21.362935 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c27e52d-5e1e-46f4-9381-511528274818 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:21.364590 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c27e52d-5e1e-46f4-9381-511528274818 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:21.367190 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c27e52d-5e1e-46f4-9381-511528274818 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:21.371659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c27e52d-5e1e-46f4-9381-511528274818 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:21.377361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18bd55b0-3558-4cf5-bc56-200ec8109c0e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:21.379451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18bd55b0-3558-4cf5-bc56-200ec8109c0e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:21.380676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18bd55b0-3558-4cf5-bc56-200ec8109c0e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:21.383297 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18bd55b0-3558-4cf5-bc56-200ec8109c0e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:21.385334 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18bd55b0-3558-4cf5-bc56-200ec8109c0e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:21.386440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18bd55b0-3558-4cf5-bc56-200ec8109c0e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:21.482555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-18bd55b0-3558-4cf5-bc56-200ec8109c0e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lazy-loading 'flavor' on Instance uuid 0d377f50-7426-425c-a1fe-c63f8d0f1186 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:48:21.961828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4c27e52d-5e1e-46f4-9381-511528274818 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:21.974921 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4c27e52d-5e1e-46f4-9381-511528274818 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8" status: 200 len: 1317 microversion: 2.1 time: 0.670526 Oct 29 02:48:21.980733 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 378/776] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:21 2022] GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8 => generated 1317 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:21.992004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e7e0ba8b-84a1-4dfd-9cc9-be0b11e888ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:22.002723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e7e0ba8b-84a1-4dfd-9cc9-be0b11e888ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e0095403-2e07-4041-b6e1-5064132dff18] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:22.020083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7e0ba8b-84a1-4dfd-9cc9-be0b11e888ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:22.021181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7e0ba8b-84a1-4dfd-9cc9-be0b11e888ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:22.021542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7e0ba8b-84a1-4dfd-9cc9-be0b11e888ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:22.022253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7e0ba8b-84a1-4dfd-9cc9-be0b11e888ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:22.022697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7e0ba8b-84a1-4dfd-9cc9-be0b11e888ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:22.023285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7e0ba8b-84a1-4dfd-9cc9-be0b11e888ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:22.217664 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-18bd55b0-3558-4cf5-bc56-200ec8109c0e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "POST /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186/action" status: 202 len: 0 microversion: 2.91 time: 0.868853 Oct 29 02:48:22.251370 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 399/777] 10.222.0.46 () {62 vars in 1319 bytes} [Sat Oct 29 02:48:21 2022] POST /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186/action => generated 0 bytes in 901 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:48:22.274222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a501aa73-bcf4-42e0-b396-3ad7e4eec933 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:22.278616 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a501aa73-bcf4-42e0-b396-3ad7e4eec933 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 34d62a74-da30-4154-adfe-289eb2ad7564] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:22.314902 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a501aa73-bcf4-42e0-b396-3ad7e4eec933 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:22.316380 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a501aa73-bcf4-42e0-b396-3ad7e4eec933 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:22.319328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a501aa73-bcf4-42e0-b396-3ad7e4eec933 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:22.322018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a501aa73-bcf4-42e0-b396-3ad7e4eec933 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:22.325631 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a501aa73-bcf4-42e0-b396-3ad7e4eec933 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:22.330231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a501aa73-bcf4-42e0-b396-3ad7e4eec933 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:22.594577 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a501aa73-bcf4-42e0-b396-3ad7e4eec933 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:22.617304 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a501aa73-bcf4-42e0-b396-3ad7e4eec933 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564" status: 200 len: 1272 microversion: 2.1 time: 0.352692 Oct 29 02:48:22.619030 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 400/778] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:22 2022] GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564 => generated 1272 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:22.650530 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b01581ea-0475-4329-9bd5-33e6624edaf2 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-2057725550", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "1100006644", "adminPass": "***", "networks": [{"uuid": "63e498c5-2a14-4eaa-b7a9-934319184aed"}], "security_groups": [{"name": "tempest-securitygroup--648704240"}], "key_name": "tempest-keypair-1611755857", "user_data": "}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:23.139193 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-b01581ea-0475-4329-9bd5-33e6624edaf2 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] validate_networks() for [('63e498c5-2a14-4eaa-b7a9-934319184aed', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:48:23.346252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e7e0ba8b-84a1-4dfd-9cc9-be0b11e888ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:23.358589 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e7e0ba8b-84a1-4dfd-9cc9-be0b11e888ad tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18" status: 200 len: 1521 microversion: 2.1 time: 1.373225 Oct 29 02:48:23.359055 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 379/779] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:21 2022] GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18 => generated 1521 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:23.389384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0b2e6c59-c020-466d-9812-57f21608a4d8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:23.392964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0b2e6c59-c020-466d-9812-57f21608a4d8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:23.428258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b2e6c59-c020-466d-9812-57f21608a4d8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:23.429526 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b2e6c59-c020-466d-9812-57f21608a4d8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:23.430596 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b2e6c59-c020-466d-9812-57f21608a4d8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:23.432253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b2e6c59-c020-466d-9812-57f21608a4d8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:23.433721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b2e6c59-c020-466d-9812-57f21608a4d8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:23.436077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b2e6c59-c020-466d-9812-57f21608a4d8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:23.730626 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0b2e6c59-c020-466d-9812-57f21608a4d8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:23.765832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0b2e6c59-c020-466d-9812-57f21608a4d8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:23.783335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0b2e6c59-c020-466d-9812-57f21608a4d8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:23.808474 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0b2e6c59-c020-466d-9812-57f21608a4d8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1537 microversion: 2.91 time: 0.444119 Oct 29 02:48:23.819444 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 380/780] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:23 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1537 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:23.841140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-17a1e7f9-e0ab-446b-b214-8a9309216c49 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:23.842559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-17a1e7f9-e0ab-446b-b214-8a9309216c49 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:23.855202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17a1e7f9-e0ab-446b-b214-8a9309216c49 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:23.856147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17a1e7f9-e0ab-446b-b214-8a9309216c49 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:23.857157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17a1e7f9-e0ab-446b-b214-8a9309216c49 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:23.858906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17a1e7f9-e0ab-446b-b214-8a9309216c49 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:23.861077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17a1e7f9-e0ab-446b-b214-8a9309216c49 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:23.862138 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17a1e7f9-e0ab-446b-b214-8a9309216c49 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:24.203557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-17a1e7f9-e0ab-446b-b214-8a9309216c49 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:24.215708 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-17a1e7f9-e0ab-446b-b214-8a9309216c49 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:24.221035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-17a1e7f9-e0ab-446b-b214-8a9309216c49 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:24.224365 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-17a1e7f9-e0ab-446b-b214-8a9309216c49 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1411 microversion: 2.25 time: 0.403145 Oct 29 02:48:24.228975 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 381/781] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:23 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1411 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:24.246637 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a9b97521-8fad-474d-a130-8a6b5f4fb9f6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:24.248176 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a9b97521-8fad-474d-a130-8a6b5f4fb9f6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: e739833b-0b44-40c0-880d-59223a63b7b8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:24.279367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9b97521-8fad-474d-a130-8a6b5f4fb9f6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:24.280715 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9b97521-8fad-474d-a130-8a6b5f4fb9f6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:24.281902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9b97521-8fad-474d-a130-8a6b5f4fb9f6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:24.288573 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9b97521-8fad-474d-a130-8a6b5f4fb9f6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:24.289748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9b97521-8fad-474d-a130-8a6b5f4fb9f6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:24.292361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9b97521-8fad-474d-a130-8a6b5f4fb9f6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:24.604071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:25.010624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a9b97521-8fad-474d-a130-8a6b5f4fb9f6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:25.018612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-b01581ea-0475-4329-9bd5-33e6624edaf2 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:48:25.019345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-b01581ea-0475-4329-9bd5-33e6624edaf2 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:48:25.020391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-b01581ea-0475-4329-9bd5-33e6624edaf2 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:48:25.021828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-b01581ea-0475-4329-9bd5-33e6624edaf2 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:48:25.022876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-b01581ea-0475-4329-9bd5-33e6624edaf2 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:48:25.024737 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a9b97521-8fad-474d-a130-8a6b5f4fb9f6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8" status: 200 len: 1317 microversion: 2.1 time: 0.793355 Oct 29 02:48:25.027804 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 382/782] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:24 2022] GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8 => generated 1317 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:25.039943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c98f7e0b-d01d-4de3-933a-5b921e85fb17 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:25.041855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c98f7e0b-d01d-4de3-933a-5b921e85fb17 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e0095403-2e07-4041-b6e1-5064132dff18] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:25.057625 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=37 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:25.060209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c98f7e0b-d01d-4de3-933a-5b921e85fb17 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:25.061869 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c98f7e0b-d01d-4de3-933a-5b921e85fb17 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:25.064047 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b01581ea-0475-4329-9bd5-33e6624edaf2 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:25.065210 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b01581ea-0475-4329-9bd5-33e6624edaf2 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:25.066230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b01581ea-0475-4329-9bd5-33e6624edaf2 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:25.066478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c98f7e0b-d01d-4de3-933a-5b921e85fb17 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:25.069183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c98f7e0b-d01d-4de3-933a-5b921e85fb17 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:25.070007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c98f7e0b-d01d-4de3-933a-5b921e85fb17 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:25.070638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c98f7e0b-d01d-4de3-933a-5b921e85fb17 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:25.075921 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b01581ea-0475-4329-9bd5-33e6624edaf2 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:25.077425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b01581ea-0475-4329-9bd5-33e6624edaf2 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:25.078479 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b01581ea-0475-4329-9bd5-33e6624edaf2 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:25.156914 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-b01581ea-0475-4329-9bd5-33e6624edaf2 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Getting quotas for project 4ce4605ee60c4bbdb3ec64e735ed73a6. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:48:25.172191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-b01581ea-0475-4329-9bd5-33e6624edaf2 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Getting quotas for user 5e562fcf734e45ce92536806eaec5750 and project 4ce4605ee60c4bbdb3ec64e735ed73a6. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:48:25.216955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b01581ea-0475-4329-9bd5-33e6624edaf2 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:48:25.230243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b01581ea-0475-4329-9bd5-33e6624edaf2 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: 20602fbc-9893-433b-b711-3de8a31a4608] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:48:25.374555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:25.452710 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b01581ea-0475-4329-9bd5-33e6624edaf2 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.831393 Oct 29 02:48:25.454690 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 401/783] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:48:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 2835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:48:25.463726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8f740bf7-d346-47f7-b0f0-267135fcce81 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:25.465382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8f740bf7-d346-47f7-b0f0-267135fcce81 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 34d62a74-da30-4154-adfe-289eb2ad7564] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:25.472557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c98f7e0b-d01d-4de3-933a-5b921e85fb17 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:25.481895 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c98f7e0b-d01d-4de3-933a-5b921e85fb17 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18" status: 200 len: 1521 microversion: 2.1 time: 0.452765 Oct 29 02:48:25.482117 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f740bf7-d346-47f7-b0f0-267135fcce81 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:25.482922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f740bf7-d346-47f7-b0f0-267135fcce81 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:25.483687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f740bf7-d346-47f7-b0f0-267135fcce81 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:25.484943 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f740bf7-d346-47f7-b0f0-267135fcce81 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:25.485714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f740bf7-d346-47f7-b0f0-267135fcce81 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:25.486469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f740bf7-d346-47f7-b0f0-267135fcce81 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:25.489864 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 383/784] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:25 2022] GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18 => generated 1521 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:25.501466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-06d19cee-2485-4bb8-9326-25d5759ec8e8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:25.506407 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-06d19cee-2485-4bb8-9326-25d5759ec8e8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:25.521763 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06d19cee-2485-4bb8-9326-25d5759ec8e8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:25.522302 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06d19cee-2485-4bb8-9326-25d5759ec8e8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:25.522828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06d19cee-2485-4bb8-9326-25d5759ec8e8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:25.527078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06d19cee-2485-4bb8-9326-25d5759ec8e8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:25.527857 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06d19cee-2485-4bb8-9326-25d5759ec8e8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:25.528576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06d19cee-2485-4bb8-9326-25d5759ec8e8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:26.053023 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-06d19cee-2485-4bb8-9326-25d5759ec8e8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:26.060563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:26.073383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-06d19cee-2485-4bb8-9326-25d5759ec8e8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:26.077616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-06d19cee-2485-4bb8-9326-25d5759ec8e8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:26.094124 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-06d19cee-2485-4bb8-9326-25d5759ec8e8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1537 microversion: 2.91 time: 0.602933 Oct 29 02:48:26.096415 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 384/785] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:25 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1537 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:26.105814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-6970384a-276f-4c5b-b475-392df0da7d53 req-89e2036d-2bbc-4e39-850a-a1d4cdaf696c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "403f0ce5-3db7-4b5b-b809-9a5f4280b685", "tag": "a71c4667-d218-4c4c-bab3-ff8606f16efe"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:26.137900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-6970384a-276f-4c5b-b475-392df0da7d53 req-89e2036d-2bbc-4e39-850a-a1d4cdaf696c service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:26.138562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-6970384a-276f-4c5b-b475-392df0da7d53 req-89e2036d-2bbc-4e39-850a-a1d4cdaf696c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:26.139232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-6970384a-276f-4c5b-b475-392df0da7d53 req-89e2036d-2bbc-4e39-850a-a1d4cdaf696c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:26.164486 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-6970384a-276f-4c5b-b475-392df0da7d53 req-89e2036d-2bbc-4e39-850a-a1d4cdaf696c service nova] Creating event network-changed:a71c4667-d218-4c4c-bab3-ff8606f16efe for instance 403f0ce5-3db7-4b5b-b809-9a5f4280b685 on n-h1-862967-2 Oct 29 02:48:26.185292 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-6970384a-276f-4c5b-b475-392df0da7d53 req-89e2036d-2bbc-4e39-850a-a1d4cdaf696c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087143 Oct 29 02:48:26.186873 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 385/786] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:26.198357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0094ff57-1c0e-4d62-b29e-0c25c13ed341 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:26.199974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0094ff57-1c0e-4d62-b29e-0c25c13ed341 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:26.211697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0094ff57-1c0e-4d62-b29e-0c25c13ed341 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:26.212480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0094ff57-1c0e-4d62-b29e-0c25c13ed341 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:26.213115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0094ff57-1c0e-4d62-b29e-0c25c13ed341 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:26.214179 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0094ff57-1c0e-4d62-b29e-0c25c13ed341 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:26.230254 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0094ff57-1c0e-4d62-b29e-0c25c13ed341 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:26.231058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0094ff57-1c0e-4d62-b29e-0c25c13ed341 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:26.590292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8f740bf7-d346-47f7-b0f0-267135fcce81 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:26.610655 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8f740bf7-d346-47f7-b0f0-267135fcce81 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564" status: 200 len: 1314 microversion: 2.1 time: 1.153871 Oct 29 02:48:26.620778 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 402/787] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:25 2022] GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564 => generated 1314 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:26.631077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2e2ebfda-a740-4a8e-8220-161d2fd0eff0 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:26.645834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2e2ebfda-a740-4a8e-8220-161d2fd0eff0 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: 20602fbc-9893-433b-b711-3de8a31a4608] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:26.798607 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2e2ebfda-a740-4a8e-8220-161d2fd0eff0 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:26.819377 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2e2ebfda-a740-4a8e-8220-161d2fd0eff0 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608" status: 200 len: 1265 microversion: 2.1 time: 0.195721 Oct 29 02:48:26.824363 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 403/788] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:26 2022] GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:26.846506 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-df1302ff-b6fa-4ec3-8da0-7e768103f4bd tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1184603664"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:26.849967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-df1302ff-b6fa-4ec3-8da0-7e768103f4bd tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e0095403-2e07-4041-b6e1-5064132dff18] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:26.890450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df1302ff-b6fa-4ec3-8da0-7e768103f4bd tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:26.894181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df1302ff-b6fa-4ec3-8da0-7e768103f4bd tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:26.897162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df1302ff-b6fa-4ec3-8da0-7e768103f4bd tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:26.901133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df1302ff-b6fa-4ec3-8da0-7e768103f4bd tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:26.908653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df1302ff-b6fa-4ec3-8da0-7e768103f4bd tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:26.911199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df1302ff-b6fa-4ec3-8da0-7e768103f4bd tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:27.068559 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:27.881986 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-df1302ff-b6fa-4ec3-8da0-7e768103f4bd tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "POST /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18/action" status: 202 len: 0 microversion: 2.1 time: 1.054766 Oct 29 02:48:27.883565 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 404/789] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:48:26 2022] POST /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18/action => generated 0 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 02:48:27.914306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-efa04d1a-91b1-4046-b0c7-c45664ad51eb tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:27.917826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-efa04d1a-91b1-4046-b0c7-c45664ad51eb tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: e739833b-0b44-40c0-880d-59223a63b7b8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:27.950116 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efa04d1a-91b1-4046-b0c7-c45664ad51eb tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:27.952930 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efa04d1a-91b1-4046-b0c7-c45664ad51eb tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:27.956805 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efa04d1a-91b1-4046-b0c7-c45664ad51eb tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:27.958153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efa04d1a-91b1-4046-b0c7-c45664ad51eb tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:27.961116 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efa04d1a-91b1-4046-b0c7-c45664ad51eb tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:27.963246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efa04d1a-91b1-4046-b0c7-c45664ad51eb tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:28.240707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0094ff57-1c0e-4d62-b29e-0c25c13ed341 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:28.269199 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0094ff57-1c0e-4d62-b29e-0c25c13ed341 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:28.283049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0094ff57-1c0e-4d62-b29e-0c25c13ed341 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:28.294255 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0094ff57-1c0e-4d62-b29e-0c25c13ed341 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1411 microversion: 2.25 time: 2.095351 Oct 29 02:48:28.318645 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 386/790] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:26 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1411 bytes in 2131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:28.345471 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-8ab4cea6-9e00-48d2-af69-51adadeff10a req-366a3027-0fea-430b-9f30-78c2006b3878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "694141ac-c96c-409b-9eb2-831a3ccb5a68", "name": "network-vif-plugged", "status": "completed", "tag": "0c4a3365-7206-4763-be5c-6b7899359935"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:28.365380 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8ab4cea6-9e00-48d2-af69-51adadeff10a req-366a3027-0fea-430b-9f30-78c2006b3878 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:28.366277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8ab4cea6-9e00-48d2-af69-51adadeff10a req-366a3027-0fea-430b-9f30-78c2006b3878 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:28.366982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8ab4cea6-9e00-48d2-af69-51adadeff10a req-366a3027-0fea-430b-9f30-78c2006b3878 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:28.391392 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-8ab4cea6-9e00-48d2-af69-51adadeff10a req-366a3027-0fea-430b-9f30-78c2006b3878 service nova] Creating event network-vif-plugged:0c4a3365-7206-4763-be5c-6b7899359935 for instance 694141ac-c96c-409b-9eb2-831a3ccb5a68 on n-h1-862967-2 Oct 29 02:48:28.401763 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-8ab4cea6-9e00-48d2-af69-51adadeff10a req-366a3027-0fea-430b-9f30-78c2006b3878 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073269 Oct 29 02:48:28.403348 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 387/791] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:28.429229 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fd23533c-b70c-4e99-97c4-03567fc848a8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:28.430034 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fd23533c-b70c-4e99-97c4-03567fc848a8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:28.450447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd23533c-b70c-4e99-97c4-03567fc848a8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:28.450814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd23533c-b70c-4e99-97c4-03567fc848a8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:28.451251 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd23533c-b70c-4e99-97c4-03567fc848a8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:28.451973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd23533c-b70c-4e99-97c4-03567fc848a8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:28.452426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd23533c-b70c-4e99-97c4-03567fc848a8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:28.454000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd23533c-b70c-4e99-97c4-03567fc848a8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:28.825099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-efa04d1a-91b1-4046-b0c7-c45664ad51eb tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:28.833692 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-efa04d1a-91b1-4046-b0c7-c45664ad51eb tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8" status: 200 len: 1317 microversion: 2.1 time: 0.946859 Oct 29 02:48:28.851312 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 405/792] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:27 2022] GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8 => generated 1317 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:28.858148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1901342f-88d9-4514-8742-d0b83e38bd4e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:28.866448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1901342f-88d9-4514-8742-d0b83e38bd4e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 34d62a74-da30-4154-adfe-289eb2ad7564] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:28.877840 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1901342f-88d9-4514-8742-d0b83e38bd4e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:28.887035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1901342f-88d9-4514-8742-d0b83e38bd4e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:28.889096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1901342f-88d9-4514-8742-d0b83e38bd4e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:28.890055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1901342f-88d9-4514-8742-d0b83e38bd4e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:28.894623 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1901342f-88d9-4514-8742-d0b83e38bd4e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:28.894623 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1901342f-88d9-4514-8742-d0b83e38bd4e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:28.939091 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fd23533c-b70c-4e99-97c4-03567fc848a8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:28.957322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fd23533c-b70c-4e99-97c4-03567fc848a8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:28.969131 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fd23533c-b70c-4e99-97c4-03567fc848a8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:28.991007 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fd23533c-b70c-4e99-97c4-03567fc848a8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1537 microversion: 2.91 time: 0.585205 Oct 29 02:48:28.995498 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 388/793] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:28 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1537 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:29.022131 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1b89b2ae-ab0e-4819-83da-3dbd24940daf tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:29.022811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1b89b2ae-ab0e-4819-83da-3dbd24940daf tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: 20602fbc-9893-433b-b711-3de8a31a4608] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:29.060928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b89b2ae-ab0e-4819-83da-3dbd24940daf tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:29.063942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b89b2ae-ab0e-4819-83da-3dbd24940daf tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:29.065189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b89b2ae-ab0e-4819-83da-3dbd24940daf tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:29.066899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b89b2ae-ab0e-4819-83da-3dbd24940daf tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:29.068028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b89b2ae-ab0e-4819-83da-3dbd24940daf tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:29.068812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b89b2ae-ab0e-4819-83da-3dbd24940daf tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:29.494292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1b89b2ae-ab0e-4819-83da-3dbd24940daf tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:29.536822 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1b89b2ae-ab0e-4819-83da-3dbd24940daf tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608" status: 200 len: 1335 microversion: 2.1 time: 0.530200 Oct 29 02:48:29.538913 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1901342f-88d9-4514-8742-d0b83e38bd4e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:29.544711 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 389/794] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:28 2022] GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608 => generated 1335 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:29.555665 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-66d83760-e1ef-4bbe-bddc-88f9ca55d809 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '.version_select at 0x7ff0580c29d0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:29.559764 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1901342f-88d9-4514-8742-d0b83e38bd4e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564" status: 200 len: 1314 microversion: 2.1 time: 0.706971 Oct 29 02:48:29.560956 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 406/795] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:28 2022] GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564 => generated 1314 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:29.603088 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-70d650d8-6efc-4381-b2f2-bc327edbe7e8 req-811cc9d6-2315-4c96-8ba4-e03dfcbd2c31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34d62a74-da30-4154-adfe-289eb2ad7564", "tag": "56c5251b-c2b7-4702-8b66-f7e375331456"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:29.620907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-70d650d8-6efc-4381-b2f2-bc327edbe7e8 req-811cc9d6-2315-4c96-8ba4-e03dfcbd2c31 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:29.622224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-70d650d8-6efc-4381-b2f2-bc327edbe7e8 req-811cc9d6-2315-4c96-8ba4-e03dfcbd2c31 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:29.623180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-70d650d8-6efc-4381-b2f2-bc327edbe7e8 req-811cc9d6-2315-4c96-8ba4-e03dfcbd2c31 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:29.644781 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-70d650d8-6efc-4381-b2f2-bc327edbe7e8 req-811cc9d6-2315-4c96-8ba4-e03dfcbd2c31 service nova] Creating event network-changed:56c5251b-c2b7-4702-8b66-f7e375331456 for instance 34d62a74-da30-4154-adfe-289eb2ad7564 on n-h2-862967-2 Oct 29 02:48:29.658239 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-70d650d8-6efc-4381-b2f2-bc327edbe7e8 req-811cc9d6-2315-4c96-8ba4-e03dfcbd2c31 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062603 Oct 29 02:48:29.659958 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 407/796] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:29.669124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e9e523b9-4a6e-4b2e-a069-2f517015514d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:29.670835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e9e523b9-4a6e-4b2e-a069-2f517015514d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:29.693848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e9e523b9-4a6e-4b2e-a069-2f517015514d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:29.694866 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e9e523b9-4a6e-4b2e-a069-2f517015514d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:29.695520 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e9e523b9-4a6e-4b2e-a069-2f517015514d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:29.696462 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e9e523b9-4a6e-4b2e-a069-2f517015514d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:29.697460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e9e523b9-4a6e-4b2e-a069-2f517015514d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:29.698405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e9e523b9-4a6e-4b2e-a069-2f517015514d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:29.896379 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-66d83760-e1ef-4bbe-bddc-88f9ca55d809 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "DELETE /compute/v2.1/images/eba7fafd-4061-4dde-a3df-3a27da6b7b02" status: 204 len: 0 microversion: 2.1 time: 0.350380 Oct 29 02:48:29.902301 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 390/797] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:29 2022] DELETE /compute/v2.1/images/eba7fafd-4061-4dde-a3df-3a27da6b7b02 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:48:29.919501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2efc79c5-3dd2-409b-ad07-502ae5131bd9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:29.930937 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2efc79c5-3dd2-409b-ad07-502ae5131bd9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: e739833b-0b44-40c0-880d-59223a63b7b8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:29.941184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2efc79c5-3dd2-409b-ad07-502ae5131bd9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:29.942257 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2efc79c5-3dd2-409b-ad07-502ae5131bd9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:29.943114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2efc79c5-3dd2-409b-ad07-502ae5131bd9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:29.944343 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2efc79c5-3dd2-409b-ad07-502ae5131bd9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:29.945283 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2efc79c5-3dd2-409b-ad07-502ae5131bd9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:29.948634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2efc79c5-3dd2-409b-ad07-502ae5131bd9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:30.483304 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e9e523b9-4a6e-4b2e-a069-2f517015514d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:30.525444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e9e523b9-4a6e-4b2e-a069-2f517015514d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:30.528649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e9e523b9-4a6e-4b2e-a069-2f517015514d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:30.532914 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e9e523b9-4a6e-4b2e-a069-2f517015514d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1411 microversion: 2.25 time: 0.870449 Oct 29 02:48:30.542554 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 408/798] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:29 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1411 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:30.550835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-14937db2-1059-452b-8882-de9d2e53ff37 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '.version_select at 0x7ff053ea3280>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:30.606283 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-14937db2-1059-452b-8882-de9d2e53ff37 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] HTTP exception thrown: Image not found. Oct 29 02:48:30.631536 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-14937db2-1059-452b-8882-de9d2e53ff37 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Request method failure captured: Oct 29 02:48:30.631536 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/images/eba7fafd-4061-4dde-a3df-3a27da6b7b02 HTTP/1.1 Oct 29 02:48:30.631536 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:48:30.631536 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:48:30.631536 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:48:30.631536 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:48:30.631536 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:48:30.631536 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:48:30.631536 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:48:30.631536 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:48:30.631536 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJQe_uEcQU7TWvWTWyYHk2tBfhyW3anQlq9IlbMuIEkf7vn933sPmCKARJnxQpZiUZK1LvxWi4oqgPbQrdfUsgmfgxV95FnHLrMyZSrDr2oYF-e8DjjcOj7SOyLBpFsBspJHWMF4bxtFDAQHeniPMEGa1F2s-2gEJ_CIW5xBvV79ZDc Oct 29 02:48:30.631536 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:48:30.631536 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:48:30.631536 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:48:30.631536 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:48:30.631536 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:48:30.631536 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:48:30.631536 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 94814dc564d04e688714ac064c7d1b3b Oct 29 02:48:30.631536 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:48:30.631536 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:48:30.631536 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:48:30.634506 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/94814dc564d04e688714ac064c7d1b3b"}]}] Oct 29 02:48:30.634506 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:48:30.634506 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 94814dc564d04e688714ac064c7d1b3b Oct 29 02:48:30.634506 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:48:30.634506 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ImagesOneServerNegativeTestJSON-13999867-project Oct 29 02:48:30.634506 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:48:30.634506 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:48:30.634506 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 6862cd2470624f01a8bc1d371aa03962 Oct 29 02:48:30.634506 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-13999867-project Oct 29 02:48:30.634506 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:48:30.634506 n-d-862967-2 devstack@n-api.service[127125]: exception: Image not found. Oct 29 02:48:30.634506 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'eba7fafd-4061-4dde-a3df-3a27da6b7b02'} Oct 29 02:48:30.634506 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:48:30.636028 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:30.636028 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:48:30.636028 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:48:30.636028 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:48:30.636028 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:48:30.636028 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:48:30.636028 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:48:30.636028 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:48:30.636028 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:48:30.636028 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:48:30.636028 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:48:30.636028 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:48:30.636028 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:48:30.636028 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:48:30.636028 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:48:30.636028 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:48:30.636028 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:48:30.636028 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID eba7fafd-4061-4dde-a3df-3a27da6b7b02 Oct 29 02:48:30.638243 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:48:30.638243 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:30.638243 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:48:30.638243 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:30.638243 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 29 02:48:30.638243 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 29 02:48:30.638243 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 02:48:30.638243 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 02:48:30.638243 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 02:48:30.638243 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 02:48:30.638243 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 02:48:30.638243 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 02:48:30.638243 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:48:30.638243 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:48:30.638243 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:48:30.638243 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:48:30.638243 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:48:30.638243 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:48:30.638243 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:48:30.638243 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:48:30.644628 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:48:30.644628 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:48:30.644628 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:48:30.644628 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:48:30.644628 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:48:30.644628 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:48:30.644628 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:48:30.644628 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:48:30.644628 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image eba7fafd-4061-4dde-a3df-3a27da6b7b02 could not be found. Oct 29 02:48:30.644628 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:48:30.644628 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:30.644628 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:48:30.644628 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:30.644628 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:30.644628 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:30.644628 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:48:30.644628 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:48:30.644628 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:48:30.644628 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:48:30.648013 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:48:30.648013 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:48:30.648013 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 29 02:48:30.648013 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 02:48:30.648013 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:48:30.648013 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:48:30.648013 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:30.648013 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:48:30.648013 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:30.648013 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:30.648013 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:30.648013 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:48:30.648013 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:48:30.648013 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:48:30.648013 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:48:30.648013 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-14937db2-1059-452b-8882-de9d2e53ff37 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Returning 404 to user: Image not found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:48:30.650845 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-14937db2-1059-452b-8882-de9d2e53ff37 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/images/eba7fafd-4061-4dde-a3df-3a27da6b7b02" status: 404 len: 62 microversion: 2.1 time: 0.099946 Oct 29 02:48:30.652117 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 409/799] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:30 2022] GET /compute/v2.1/images/eba7fafd-4061-4dde-a3df-3a27da6b7b02 => generated 62 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:48:30.660767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ae4e4d25-1112-4f1e-853c-381f0b02873a tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:30.662457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ae4e4d25-1112-4f1e-853c-381f0b02873a tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:30.691508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae4e4d25-1112-4f1e-853c-381f0b02873a tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:30.692457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae4e4d25-1112-4f1e-853c-381f0b02873a tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:30.693272 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae4e4d25-1112-4f1e-853c-381f0b02873a tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:30.695391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae4e4d25-1112-4f1e-853c-381f0b02873a tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:30.696605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae4e4d25-1112-4f1e-853c-381f0b02873a tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:30.697712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae4e4d25-1112-4f1e-853c-381f0b02873a tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:30.904261 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ae4e4d25-1112-4f1e-853c-381f0b02873a tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:30.922991 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ae4e4d25-1112-4f1e-853c-381f0b02873a tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:30.932167 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ae4e4d25-1112-4f1e-853c-381f0b02873a tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:30.952920 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ae4e4d25-1112-4f1e-853c-381f0b02873a tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1537 microversion: 2.91 time: 0.298640 Oct 29 02:48:30.956786 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 410/800] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:30 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1537 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:30.970884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-9c268828-cda6-48c2-8de5-c6152a1ef84e req-35a55f63-1482-4d55-8e33-df6824e39af2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e739833b-0b44-40c0-880d-59223a63b7b8", "name": "network-vif-plugged", "status": "completed", "tag": "f56fd42b-c41b-49bf-8b75-57b4f3ebc5c4"}, {"server_uuid": "aff333bb-fff4-4b3e-a3f9-a567b7786a62", "name": "network-vif-unplugged", "status": "completed", "tag": "00a9c6e8-5769-4bcd-a23e-c0242f3e6acd"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:30.991667 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9c268828-cda6-48c2-8de5-c6152a1ef84e req-35a55f63-1482-4d55-8e33-df6824e39af2 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:31.002335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9c268828-cda6-48c2-8de5-c6152a1ef84e req-35a55f63-1482-4d55-8e33-df6824e39af2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:31.005687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9c268828-cda6-48c2-8de5-c6152a1ef84e req-35a55f63-1482-4d55-8e33-df6824e39af2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:31.054403 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-9c268828-cda6-48c2-8de5-c6152a1ef84e req-35a55f63-1482-4d55-8e33-df6824e39af2 service nova] Creating event network-vif-plugged:f56fd42b-c41b-49bf-8b75-57b4f3ebc5c4 for instance e739833b-0b44-40c0-880d-59223a63b7b8 on n-h2-862967-2 Oct 29 02:48:31.055440 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-9c268828-cda6-48c2-8de5-c6152a1ef84e req-35a55f63-1482-4d55-8e33-df6824e39af2 service nova] Creating event network-vif-unplugged:00a9c6e8-5769-4bcd-a23e-c0242f3e6acd for instance aff333bb-fff4-4b3e-a3f9-a567b7786a62 on n-h2-862967-2 Oct 29 02:48:31.070479 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-9c268828-cda6-48c2-8de5-c6152a1ef84e req-35a55f63-1482-4d55-8e33-df6824e39af2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.111321 Oct 29 02:48:31.080367 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 411/801] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:31.093130 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ceb32027-3579-495d-894f-ec15899864b0 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:31.097254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ceb32027-3579-495d-894f-ec15899864b0 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: 20602fbc-9893-433b-b711-3de8a31a4608] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:31.109879 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ceb32027-3579-495d-894f-ec15899864b0 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:31.111291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ceb32027-3579-495d-894f-ec15899864b0 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:31.112374 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ceb32027-3579-495d-894f-ec15899864b0 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:31.113656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ceb32027-3579-495d-894f-ec15899864b0 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:31.114366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ceb32027-3579-495d-894f-ec15899864b0 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:31.115094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ceb32027-3579-495d-894f-ec15899864b0 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:31.210954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:31.299743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2efc79c5-3dd2-409b-ad07-502ae5131bd9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:31.311301 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2efc79c5-3dd2-409b-ad07-502ae5131bd9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8" status: 200 len: 1317 microversion: 2.1 time: 1.406388 Oct 29 02:48:31.314769 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 391/802] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:29 2022] GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8 => generated 1317 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:31.323432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e13d6c7f-8d55-4c6e-a6ba-68bb02fc0c89 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:31.324776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e13d6c7f-8d55-4c6e-a6ba-68bb02fc0c89 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 34d62a74-da30-4154-adfe-289eb2ad7564] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:31.335092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ceb32027-3579-495d-894f-ec15899864b0 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:31.343999 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e13d6c7f-8d55-4c6e-a6ba-68bb02fc0c89 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:31.345258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e13d6c7f-8d55-4c6e-a6ba-68bb02fc0c89 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:31.346076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e13d6c7f-8d55-4c6e-a6ba-68bb02fc0c89 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:31.349313 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e13d6c7f-8d55-4c6e-a6ba-68bb02fc0c89 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:31.350247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e13d6c7f-8d55-4c6e-a6ba-68bb02fc0c89 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:31.351882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e13d6c7f-8d55-4c6e-a6ba-68bb02fc0c89 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:31.368071 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ceb32027-3579-495d-894f-ec15899864b0 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608" status: 200 len: 1323 microversion: 2.1 time: 0.282769 Oct 29 02:48:31.381258 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 412/803] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:31 2022] GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608 => generated 1323 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:31.411520 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-232d5fe3-3dda-45ab-9f40-320cbc6582a2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:31.413051 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-232d5fe3-3dda-45ab-9f40-320cbc6582a2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e0095403-2e07-4041-b6e1-5064132dff18] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:31.425450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-232d5fe3-3dda-45ab-9f40-320cbc6582a2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:31.427461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-232d5fe3-3dda-45ab-9f40-320cbc6582a2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:31.429832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-232d5fe3-3dda-45ab-9f40-320cbc6582a2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:31.430942 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-232d5fe3-3dda-45ab-9f40-320cbc6582a2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:31.431745 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-232d5fe3-3dda-45ab-9f40-320cbc6582a2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:31.432740 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-232d5fe3-3dda-45ab-9f40-320cbc6582a2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:31.711586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e13d6c7f-8d55-4c6e-a6ba-68bb02fc0c89 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:31.746100 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e13d6c7f-8d55-4c6e-a6ba-68bb02fc0c89 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564" status: 200 len: 1314 microversion: 2.1 time: 0.429748 Oct 29 02:48:31.753770 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 392/804] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:31 2022] GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564 => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:31.776598 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-e497aaff-3dbe-455f-bfc0-de936b8dfcdd req-c9adfa1a-3b02-4a4e-85a8-1d1e6fdb85fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aff333bb-fff4-4b3e-a3f9-a567b7786a62", "name": "network-vif-deleted", "tag": "00a9c6e8-5769-4bcd-a23e-c0242f3e6acd"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:31.808562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-232d5fe3-3dda-45ab-9f40-320cbc6582a2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:31.841669 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-232d5fe3-3dda-45ab-9f40-320cbc6582a2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18" status: 200 len: 1539 microversion: 2.1 time: 0.457700 Oct 29 02:48:31.849652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e497aaff-3dbe-455f-bfc0-de936b8dfcdd req-c9adfa1a-3b02-4a4e-85a8-1d1e6fdb85fc service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:31.850344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e497aaff-3dbe-455f-bfc0-de936b8dfcdd req-c9adfa1a-3b02-4a4e-85a8-1d1e6fdb85fc service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:31.850859 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 413/805] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:31 2022] GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18 => generated 1539 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:31.858961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e497aaff-3dbe-455f-bfc0-de936b8dfcdd req-c9adfa1a-3b02-4a4e-85a8-1d1e6fdb85fc service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:31.881755 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1af6fe34-e5e0-4d67-83da-c4e7cbfcc191 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:31.882486 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1af6fe34-e5e0-4d67-83da-c4e7cbfcc191 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:31.915443 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1af6fe34-e5e0-4d67-83da-c4e7cbfcc191 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:31.917323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1af6fe34-e5e0-4d67-83da-c4e7cbfcc191 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:31.918136 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-e497aaff-3dbe-455f-bfc0-de936b8dfcdd req-c9adfa1a-3b02-4a4e-85a8-1d1e6fdb85fc service nova] Creating event network-vif-deleted:00a9c6e8-5769-4bcd-a23e-c0242f3e6acd for instance aff333bb-fff4-4b3e-a3f9-a567b7786a62 on n-h2-862967-2 Oct 29 02:48:31.919602 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1af6fe34-e5e0-4d67-83da-c4e7cbfcc191 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:31.920460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1af6fe34-e5e0-4d67-83da-c4e7cbfcc191 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:31.920932 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1af6fe34-e5e0-4d67-83da-c4e7cbfcc191 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:31.923695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1af6fe34-e5e0-4d67-83da-c4e7cbfcc191 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:31.932464 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-e497aaff-3dbe-455f-bfc0-de936b8dfcdd req-c9adfa1a-3b02-4a4e-85a8-1d1e6fdb85fc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176379 Oct 29 02:48:31.936598 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 393/806] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:32.003197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b74fcbe5-80c1-467c-b7fc-2a3b235217b1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:32.004127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b74fcbe5-80c1-467c-b7fc-2a3b235217b1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:32.023360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b74fcbe5-80c1-467c-b7fc-2a3b235217b1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:32.023886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b74fcbe5-80c1-467c-b7fc-2a3b235217b1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:32.024556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b74fcbe5-80c1-467c-b7fc-2a3b235217b1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:32.025338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b74fcbe5-80c1-467c-b7fc-2a3b235217b1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:32.025854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b74fcbe5-80c1-467c-b7fc-2a3b235217b1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:32.026231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b74fcbe5-80c1-467c-b7fc-2a3b235217b1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:32.814175 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1af6fe34-e5e0-4d67-83da-c4e7cbfcc191 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:32.831994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b74fcbe5-80c1-467c-b7fc-2a3b235217b1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:32.869526 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b74fcbe5-80c1-467c-b7fc-2a3b235217b1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:32.874446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b74fcbe5-80c1-467c-b7fc-2a3b235217b1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:32.879960 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1af6fe34-e5e0-4d67-83da-c4e7cbfcc191 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:32.885768 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1af6fe34-e5e0-4d67-83da-c4e7cbfcc191 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:32.890962 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b74fcbe5-80c1-467c-b7fc-2a3b235217b1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1537 microversion: 2.91 time: 0.895288 Oct 29 02:48:32.894725 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 394/807] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:31 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1537 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:48:32.895811 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1af6fe34-e5e0-4d67-83da-c4e7cbfcc191 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1411 microversion: 2.25 time: 1.038478 Oct 29 02:48:32.912642 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 414/808] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:31 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1411 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:32.912642 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3125e6a6-4e21-44fc-8767-ed4a8734fffa tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:32.912642 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3125e6a6-4e21-44fc-8767-ed4a8734fffa tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: 20602fbc-9893-433b-b711-3de8a31a4608] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:32.923902 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3125e6a6-4e21-44fc-8767-ed4a8734fffa tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:32.927248 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3125e6a6-4e21-44fc-8767-ed4a8734fffa tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:32.928119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3125e6a6-4e21-44fc-8767-ed4a8734fffa tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:32.930083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3125e6a6-4e21-44fc-8767-ed4a8734fffa tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:32.932033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3125e6a6-4e21-44fc-8767-ed4a8734fffa tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:32.933927 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3125e6a6-4e21-44fc-8767-ed4a8734fffa tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:32.939644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-83bb78fb-d124-43f6-b4a0-6302118b737a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:32.945701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-83bb78fb-d124-43f6-b4a0-6302118b737a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: e739833b-0b44-40c0-880d-59223a63b7b8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:32.967678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83bb78fb-d124-43f6-b4a0-6302118b737a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:32.972383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83bb78fb-d124-43f6-b4a0-6302118b737a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:32.977427 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83bb78fb-d124-43f6-b4a0-6302118b737a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:32.979058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83bb78fb-d124-43f6-b4a0-6302118b737a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:32.980112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83bb78fb-d124-43f6-b4a0-6302118b737a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:32.984449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83bb78fb-d124-43f6-b4a0-6302118b737a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:33.687754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3125e6a6-4e21-44fc-8767-ed4a8734fffa tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:33.700787 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3125e6a6-4e21-44fc-8767-ed4a8734fffa tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608" status: 200 len: 1390 microversion: 2.1 time: 0.799814 Oct 29 02:48:33.704725 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 415/809] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:32 2022] GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608 => generated 1390 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:33.715529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ab79bdaa-64d3-4dd3-a1e9-91a20ecbf67e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:33.717127 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ab79bdaa-64d3-4dd3-a1e9-91a20ecbf67e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 34d62a74-da30-4154-adfe-289eb2ad7564] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:33.734937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab79bdaa-64d3-4dd3-a1e9-91a20ecbf67e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:33.737279 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab79bdaa-64d3-4dd3-a1e9-91a20ecbf67e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:33.738488 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab79bdaa-64d3-4dd3-a1e9-91a20ecbf67e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:33.740380 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab79bdaa-64d3-4dd3-a1e9-91a20ecbf67e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:33.741780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab79bdaa-64d3-4dd3-a1e9-91a20ecbf67e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:33.743045 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab79bdaa-64d3-4dd3-a1e9-91a20ecbf67e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:34.035039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-83bb78fb-d124-43f6-b4a0-6302118b737a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:34.044194 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-83bb78fb-d124-43f6-b4a0-6302118b737a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8" status: 200 len: 1317 microversion: 2.1 time: 1.147865 Oct 29 02:48:34.044684 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 395/810] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:32 2022] GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8 => generated 1317 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:34.067094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f167c913-c942-481f-843a-f24594815434 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:34.068330 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f167c913-c942-481f-843a-f24594815434 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e0095403-2e07-4041-b6e1-5064132dff18] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:34.088309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f167c913-c942-481f-843a-f24594815434 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:34.096786 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f167c913-c942-481f-843a-f24594815434 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:34.097617 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f167c913-c942-481f-843a-f24594815434 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:34.098805 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f167c913-c942-481f-843a-f24594815434 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:34.099736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f167c913-c942-481f-843a-f24594815434 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:34.100340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f167c913-c942-481f-843a-f24594815434 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:34.207676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ab79bdaa-64d3-4dd3-a1e9-91a20ecbf67e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:34.207676 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ab79bdaa-64d3-4dd3-a1e9-91a20ecbf67e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564" status: 200 len: 1314 microversion: 2.1 time: 0.466805 Oct 29 02:48:34.207676 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 416/811] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:33 2022] GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564 => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:34.228553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b8631725-1948-4680-9699-df0e87d6d639 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:34.229796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b8631725-1948-4680-9699-df0e87d6d639 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:34.288264 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8631725-1948-4680-9699-df0e87d6d639 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:34.291184 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8631725-1948-4680-9699-df0e87d6d639 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:34.301390 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8631725-1948-4680-9699-df0e87d6d639 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:34.302819 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8631725-1948-4680-9699-df0e87d6d639 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:34.303782 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8631725-1948-4680-9699-df0e87d6d639 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:34.304705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8631725-1948-4680-9699-df0e87d6d639 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:35.125372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:35.143212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b8631725-1948-4680-9699-df0e87d6d639 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:35.158380 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f167c913-c942-481f-843a-f24594815434 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:35.167621 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f167c913-c942-481f-843a-f24594815434 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18" status: 200 len: 1521 microversion: 2.1 time: 1.121845 Oct 29 02:48:35.176729 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 396/812] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:34 2022] GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18 => generated 1521 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:35.182741 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a0d1f0a8-5558-4697-be9e-1581ac6d653e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:35.183301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b8631725-1948-4680-9699-df0e87d6d639 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:35.186479 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b8631725-1948-4680-9699-df0e87d6d639 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:35.187561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a0d1f0a8-5558-4697-be9e-1581ac6d653e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:35.203116 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a0d1f0a8-5558-4697-be9e-1581ac6d653e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:35.203936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a0d1f0a8-5558-4697-be9e-1581ac6d653e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:35.204576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a0d1f0a8-5558-4697-be9e-1581ac6d653e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:35.206173 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a0d1f0a8-5558-4697-be9e-1581ac6d653e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:35.206827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a0d1f0a8-5558-4697-be9e-1581ac6d653e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:35.209559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a0d1f0a8-5558-4697-be9e-1581ac6d653e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:35.218268 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b8631725-1948-4680-9699-df0e87d6d639 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1608 microversion: 2.25 time: 0.997198 Oct 29 02:48:35.270753 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 417/813] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:34 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1608 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:35.280906 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7a3c6e13-5661-4deb-b663-a773899f7028 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:35.282531 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7a3c6e13-5661-4deb-b663-a773899f7028 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: 20602fbc-9893-433b-b711-3de8a31a4608] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:35.295674 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a3c6e13-5661-4deb-b663-a773899f7028 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:35.297131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a3c6e13-5661-4deb-b663-a773899f7028 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:35.298255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a3c6e13-5661-4deb-b663-a773899f7028 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:35.299788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a3c6e13-5661-4deb-b663-a773899f7028 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:35.301008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a3c6e13-5661-4deb-b663-a773899f7028 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:35.302174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a3c6e13-5661-4deb-b663-a773899f7028 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:35.443862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a0d1f0a8-5558-4697-be9e-1581ac6d653e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:35.458536 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a0d1f0a8-5558-4697-be9e-1581ac6d653e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:35.460134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a0d1f0a8-5558-4697-be9e-1581ac6d653e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:35.478031 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a0d1f0a8-5558-4697-be9e-1581ac6d653e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1537 microversion: 2.91 time: 0.299315 Oct 29 02:48:35.478829 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 397/814] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:35 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1537 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:35.489479 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-bc27eff1-8d0b-4b85-a694-d6c8929e0533 req-8a3f954f-82c6-424f-bb7a-15e19b3fdf00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20602fbc-9893-433b-b711-3de8a31a4608", "tag": "d24e5257-2899-45fe-ad6a-690bf6e3cd60"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:35.511060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-bc27eff1-8d0b-4b85-a694-d6c8929e0533 req-8a3f954f-82c6-424f-bb7a-15e19b3fdf00 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:35.514553 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-bc27eff1-8d0b-4b85-a694-d6c8929e0533 req-8a3f954f-82c6-424f-bb7a-15e19b3fdf00 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:35.515132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-bc27eff1-8d0b-4b85-a694-d6c8929e0533 req-8a3f954f-82c6-424f-bb7a-15e19b3fdf00 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:35.540294 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-bc27eff1-8d0b-4b85-a694-d6c8929e0533 req-8a3f954f-82c6-424f-bb7a-15e19b3fdf00 service nova] Creating event network-changed:d24e5257-2899-45fe-ad6a-690bf6e3cd60 for instance 20602fbc-9893-433b-b711-3de8a31a4608 on n-h2-862967-2 Oct 29 02:48:35.553210 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-bc27eff1-8d0b-4b85-a694-d6c8929e0533 req-8a3f954f-82c6-424f-bb7a-15e19b3fdf00 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070874 Oct 29 02:48:35.556012 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 398/815] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:35.563674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4d3f9655-e479-4fed-9fa2-0bf7615f3e47 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:35.570921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4d3f9655-e479-4fed-9fa2-0bf7615f3e47 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: e739833b-0b44-40c0-880d-59223a63b7b8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:35.585408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d3f9655-e479-4fed-9fa2-0bf7615f3e47 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:35.590834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d3f9655-e479-4fed-9fa2-0bf7615f3e47 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:35.591659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d3f9655-e479-4fed-9fa2-0bf7615f3e47 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:35.594303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d3f9655-e479-4fed-9fa2-0bf7615f3e47 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:35.595068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d3f9655-e479-4fed-9fa2-0bf7615f3e47 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:35.596610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d3f9655-e479-4fed-9fa2-0bf7615f3e47 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:36.016852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4d3f9655-e479-4fed-9fa2-0bf7615f3e47 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:36.033637 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4d3f9655-e479-4fed-9fa2-0bf7615f3e47 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8" status: 200 len: 1467 microversion: 2.1 time: 0.475963 Oct 29 02:48:36.034305 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 399/816] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:35 2022] GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8 => generated 1467 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:36.066526 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4f16d94c-6fe5-449c-bf54-598290c61049 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:36.067050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4f16d94c-6fe5-449c-bf54-598290c61049 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e0095403-2e07-4041-b6e1-5064132dff18] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:36.102887 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f16d94c-6fe5-449c-bf54-598290c61049 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:36.103411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f16d94c-6fe5-449c-bf54-598290c61049 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:36.103882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f16d94c-6fe5-449c-bf54-598290c61049 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:36.107916 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f16d94c-6fe5-449c-bf54-598290c61049 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:36.108853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f16d94c-6fe5-449c-bf54-598290c61049 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:36.109094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f16d94c-6fe5-449c-bf54-598290c61049 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:36.156413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7a3c6e13-5661-4deb-b663-a773899f7028 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:36.184260 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7a3c6e13-5661-4deb-b663-a773899f7028 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608" status: 200 len: 1390 microversion: 2.1 time: 0.911075 Oct 29 02:48:36.187696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4f16d94c-6fe5-449c-bf54-598290c61049 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e0095403-2e07-4041-b6e1-5064132dff18] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:48:36.191714 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 418/817] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:35 2022] GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608 => generated 1390 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:36.211045 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-20816e34-3af7-4a5c-8dc4-9155e1911c20 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:36.216298 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-20816e34-3af7-4a5c-8dc4-9155e1911c20 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 34d62a74-da30-4154-adfe-289eb2ad7564] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:36.232178 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20816e34-3af7-4a5c-8dc4-9155e1911c20 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:36.234467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20816e34-3af7-4a5c-8dc4-9155e1911c20 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:36.235366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20816e34-3af7-4a5c-8dc4-9155e1911c20 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:36.236712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20816e34-3af7-4a5c-8dc4-9155e1911c20 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:36.237645 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20816e34-3af7-4a5c-8dc4-9155e1911c20 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:36.238526 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20816e34-3af7-4a5c-8dc4-9155e1911c20 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:36.561909 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4f16d94c-6fe5-449c-bf54-598290c61049 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18" status: 204 len: 0 microversion: 2.1 time: 0.509656 Oct 29 02:48:36.583724 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 400/818] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:48:36 2022] DELETE /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:48:36.608107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ea83f2b0-c6fd-4b62-ace3-313241e10241 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:36.613498 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ea83f2b0-c6fd-4b62-ace3-313241e10241 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:36.653310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea83f2b0-c6fd-4b62-ace3-313241e10241 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:36.661171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea83f2b0-c6fd-4b62-ace3-313241e10241 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:36.664084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea83f2b0-c6fd-4b62-ace3-313241e10241 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:36.665166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea83f2b0-c6fd-4b62-ace3-313241e10241 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:36.667718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea83f2b0-c6fd-4b62-ace3-313241e10241 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:36.668454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea83f2b0-c6fd-4b62-ace3-313241e10241 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:36.805568 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=7 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:36.941120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-20816e34-3af7-4a5c-8dc4-9155e1911c20 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:36.957430 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-20816e34-3af7-4a5c-8dc4-9155e1911c20 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564" status: 200 len: 1314 microversion: 2.1 time: 0.762365 Oct 29 02:48:36.961903 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 419/819] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:36 2022] GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564 => generated 1314 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:36.980333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-962c9b36-8182-4001-b6b7-71bcda2771ad req-485a5f88-3473-4908-8980-3e184ad3dff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0095403-2e07-4041-b6e1-5064132dff18", "name": "network-vif-plugged", "status": "completed", "tag": "eee2dab9-9536-4e00-80d1-6a3c62c66656"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:37.014074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-962c9b36-8182-4001-b6b7-71bcda2771ad req-485a5f88-3473-4908-8980-3e184ad3dff8 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:37.016920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-962c9b36-8182-4001-b6b7-71bcda2771ad req-485a5f88-3473-4908-8980-3e184ad3dff8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:37.017514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-962c9b36-8182-4001-b6b7-71bcda2771ad req-485a5f88-3473-4908-8980-3e184ad3dff8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:37.036683 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ea83f2b0-c6fd-4b62-ace3-313241e10241 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.450449 Oct 29 02:48:37.037918 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 401/820] 10.222.0.46 () {60 vars in 1316 bytes} [Sat Oct 29 02:48:36 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68/os-interface => generated 285 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:48:37.066855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b9b27dd6-2573-44a9-91de-ffc516161584 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:37.070816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b9b27dd6-2573-44a9-91de-ffc516161584 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] [instance: e739833b-0b44-40c0-880d-59223a63b7b8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:37.086432 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-962c9b36-8182-4001-b6b7-71bcda2771ad req-485a5f88-3473-4908-8980-3e184ad3dff8 service nova] Creating event network-vif-plugged:eee2dab9-9536-4e00-80d1-6a3c62c66656 for instance e0095403-2e07-4041-b6e1-5064132dff18 on n-h1-862967-2 Oct 29 02:48:37.094041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b9b27dd6-2573-44a9-91de-ffc516161584 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:37.096480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b9b27dd6-2573-44a9-91de-ffc516161584 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:37.097244 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b9b27dd6-2573-44a9-91de-ffc516161584 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:37.099772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b9b27dd6-2573-44a9-91de-ffc516161584 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:37.103312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b9b27dd6-2573-44a9-91de-ffc516161584 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:37.104432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b9b27dd6-2573-44a9-91de-ffc516161584 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:37.107648 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-962c9b36-8182-4001-b6b7-71bcda2771ad req-485a5f88-3473-4908-8980-3e184ad3dff8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138083 Oct 29 02:48:37.109821 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 420/821] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:37.123712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0656da55-fad0-4a57-9801-818ab71c3e0f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:37.129647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0656da55-fad0-4a57-9801-818ab71c3e0f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:37.147006 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0656da55-fad0-4a57-9801-818ab71c3e0f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:37.147741 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0656da55-fad0-4a57-9801-818ab71c3e0f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:37.148902 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0656da55-fad0-4a57-9801-818ab71c3e0f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:37.150013 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0656da55-fad0-4a57-9801-818ab71c3e0f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:37.153742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0656da55-fad0-4a57-9801-818ab71c3e0f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:37.154467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0656da55-fad0-4a57-9801-818ab71c3e0f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:37.336584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0656da55-fad0-4a57-9801-818ab71c3e0f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:37.363425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0656da55-fad0-4a57-9801-818ab71c3e0f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:37.372473 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0656da55-fad0-4a57-9801-818ab71c3e0f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:37.395544 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0656da55-fad0-4a57-9801-818ab71c3e0f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1537 microversion: 2.91 time: 0.284077 Oct 29 02:48:37.406176 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 421/822] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:37 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1537 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:37.412071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1e4dc23f-7036-4ef2-aa31-db31db0b8543 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:37.413217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1e4dc23f-7036-4ef2-aa31-db31db0b8543 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e0095403-2e07-4041-b6e1-5064132dff18] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:37.430018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e4dc23f-7036-4ef2-aa31-db31db0b8543 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:37.430697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e4dc23f-7036-4ef2-aa31-db31db0b8543 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:37.431229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e4dc23f-7036-4ef2-aa31-db31db0b8543 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:37.432059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e4dc23f-7036-4ef2-aa31-db31db0b8543 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:37.432648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e4dc23f-7036-4ef2-aa31-db31db0b8543 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:37.433169 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e4dc23f-7036-4ef2-aa31-db31db0b8543 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:37.585801 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b9b27dd6-2573-44a9-91de-ffc516161584 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8" status: 200 len: 1618 microversion: 2.1 time: 0.544197 Oct 29 02:48:37.587881 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 402/823] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:37 2022] GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8 => generated 1618 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:37.943133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1e4dc23f-7036-4ef2-aa31-db31db0b8543 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:37.957342 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1e4dc23f-7036-4ef2-aa31-db31db0b8543 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18" status: 200 len: 1527 microversion: 2.1 time: 0.554830 Oct 29 02:48:37.959654 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 422/824] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:37 2022] GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18 => generated 1527 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:37.997546 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-80d23ebb-f0d4-4a13-abe4-c7b57a130b80 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:37.998295 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-80d23ebb-f0d4-4a13-abe4-c7b57a130b80 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: 20602fbc-9893-433b-b711-3de8a31a4608] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:38.007631 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-80d23ebb-f0d4-4a13-abe4-c7b57a130b80 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:38.011013 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-80d23ebb-f0d4-4a13-abe4-c7b57a130b80 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:38.013204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-80d23ebb-f0d4-4a13-abe4-c7b57a130b80 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:38.014294 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-80d23ebb-f0d4-4a13-abe4-c7b57a130b80 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:38.017136 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-80d23ebb-f0d4-4a13-abe4-c7b57a130b80 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:38.019859 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-80d23ebb-f0d4-4a13-abe4-c7b57a130b80 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:38.044346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:38.104815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-12347ed6-fa09-4e6e-b481-971313e73e9a tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Action: 'create', calling method: .version_select at 0x7ff058013af0>, body: {"keypair": {"name": "tempest-keypair-1385407257", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4eg+lOP+8n5Li4lyhtQ95kvvpixy1xwukfeJ/8N6hBCJqXVhxBO4KO72RDv3+a7Fb37KvT7ck5atluxhxOK7IAhfmiAmZ6BWd1c/ZdxKuoEG3oM0o0X07IyUrgbnstEw=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:38.170679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-12347ed6-fa09-4e6e-b481-971313e73e9a tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Getting quotas for project 859a70e4fa3141bb8b667b1be8e9594b. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:48:38.189230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-12347ed6-fa09-4e6e-b481-971313e73e9a tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Getting quotas for user e823b4fb116c48ea92c2d3da58e10f5a and project 859a70e4fa3141bb8b667b1be8e9594b. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:48:38.254432 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-12347ed6-fa09-4e6e-b481-971313e73e9a tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.662954 Oct 29 02:48:38.259377 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 403/825] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 02:48:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:38.269429 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c366aff2-a796-4678-8643-a21a1006a3d6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-941706450", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "b65a6807-c8ad-44d0-93d7-931037ca8afd"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:38.427028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-c366aff2-a796-4678-8643-a21a1006a3d6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] validate_networks() for None {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:48:38.467442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-80d23ebb-f0d4-4a13-abe4-c7b57a130b80 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:38.496723 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-80d23ebb-f0d4-4a13-abe4-c7b57a130b80 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608" status: 200 len: 1390 microversion: 2.1 time: 0.519084 Oct 29 02:48:38.533636 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 423/826] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:37 2022] GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608 => generated 1390 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:38.539318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-46c7043f-94ce-457f-86f9-10205d7a7ff9 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:38.540376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-46c7043f-94ce-457f-86f9-10205d7a7ff9 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 34d62a74-da30-4154-adfe-289eb2ad7564] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:38.558860 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46c7043f-94ce-457f-86f9-10205d7a7ff9 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:38.562164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46c7043f-94ce-457f-86f9-10205d7a7ff9 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:38.566403 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46c7043f-94ce-457f-86f9-10205d7a7ff9 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:38.575430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46c7043f-94ce-457f-86f9-10205d7a7ff9 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:38.576574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46c7043f-94ce-457f-86f9-10205d7a7ff9 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:38.577499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46c7043f-94ce-457f-86f9-10205d7a7ff9 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:39.146719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-c366aff2-a796-4678-8643-a21a1006a3d6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:48:39.147745 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-c366aff2-a796-4678-8643-a21a1006a3d6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:48:39.148516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-c366aff2-a796-4678-8643-a21a1006a3d6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:48:39.149262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-c366aff2-a796-4678-8643-a21a1006a3d6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:48:39.149925 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-c366aff2-a796-4678-8643-a21a1006a3d6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:48:39.162365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c366aff2-a796-4678-8643-a21a1006a3d6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:39.165398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c366aff2-a796-4678-8643-a21a1006a3d6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:39.166332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c366aff2-a796-4678-8643-a21a1006a3d6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:39.167627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c366aff2-a796-4678-8643-a21a1006a3d6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:39.168467 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c366aff2-a796-4678-8643-a21a1006a3d6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:39.169576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c366aff2-a796-4678-8643-a21a1006a3d6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:39.197609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-c366aff2-a796-4678-8643-a21a1006a3d6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for project dcc6da8e69e041e19023a53a23e33393. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:48:39.207282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-c366aff2-a796-4678-8643-a21a1006a3d6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Getting quotas for user 509ce04aeb3847f084629201bd7ae5d6 and project dcc6da8e69e041e19023a53a23e33393. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:48:39.211578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:39.234218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c366aff2-a796-4678-8643-a21a1006a3d6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:48:39.239014 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c366aff2-a796-4678-8643-a21a1006a3d6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:48:39.334589 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c366aff2-a796-4678-8643-a21a1006a3d6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.073414 Oct 29 02:48:39.336156 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 404/827] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:48:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:48:39.355279 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cb2ae233-5dc2-4e2a-9728-39fe5b360758 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:39.357795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cb2ae233-5dc2-4e2a-9728-39fe5b360758 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:39.384282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cb2ae233-5dc2-4e2a-9728-39fe5b360758 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:39.385067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cb2ae233-5dc2-4e2a-9728-39fe5b360758 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:39.387557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cb2ae233-5dc2-4e2a-9728-39fe5b360758 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:39.393120 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cb2ae233-5dc2-4e2a-9728-39fe5b360758 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:39.398748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cb2ae233-5dc2-4e2a-9728-39fe5b360758 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:39.399614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cb2ae233-5dc2-4e2a-9728-39fe5b360758 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:39.456874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:39.476720 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-46c7043f-94ce-457f-86f9-10205d7a7ff9 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:39.509961 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-46c7043f-94ce-457f-86f9-10205d7a7ff9 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564" status: 200 len: 1314 microversion: 2.1 time: 0.967792 Oct 29 02:48:39.526238 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 424/828] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:38 2022] GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564 => generated 1314 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:39.542157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-abadb20a-2d06-4ae5-87d5-532b4e533edb tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:39.543103 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-abadb20a-2d06-4ae5-87d5-532b4e533edb tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e0095403-2e07-4041-b6e1-5064132dff18] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:39.551300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-abadb20a-2d06-4ae5-87d5-532b4e533edb tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:39.551832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-abadb20a-2d06-4ae5-87d5-532b4e533edb tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:39.552353 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-abadb20a-2d06-4ae5-87d5-532b4e533edb tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:39.553254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-abadb20a-2d06-4ae5-87d5-532b4e533edb tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:39.553914 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-abadb20a-2d06-4ae5-87d5-532b4e533edb tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:39.554134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-abadb20a-2d06-4ae5-87d5-532b4e533edb tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:39.570679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cb2ae233-5dc2-4e2a-9728-39fe5b360758 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:39.582696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cb2ae233-5dc2-4e2a-9728-39fe5b360758 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:39.585634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cb2ae233-5dc2-4e2a-9728-39fe5b360758 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:39.607110 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cb2ae233-5dc2-4e2a-9728-39fe5b360758 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1537 microversion: 2.91 time: 0.268748 Oct 29 02:48:39.608121 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 405/829] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:39 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1537 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:39.727307 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-309eef3e-6581-4087-87d8-3f5a30431a3e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2051685432", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "c9c7c955-06f7-476b-b584-0d9678a745fd"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:39.772578 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-abadb20a-2d06-4ae5-87d5-532b4e533edb tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:39.799788 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-abadb20a-2d06-4ae5-87d5-532b4e533edb tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18" status: 200 len: 1485 microversion: 2.1 time: 0.264928 Oct 29 02:48:39.811518 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 425/830] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:39 2022] GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18 => generated 1485 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:39.842775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-309eef3e-6581-4087-87d8-3f5a30431a3e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] validate_networks() for [('c9c7c955-06f7-476b-b584-0d9678a745fd', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:48:39.848155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-2205df26-403e-4112-8da1-850da56be10f req-3d2b957e-1469-438b-a929-b92511442ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0095403-2e07-4041-b6e1-5064132dff18", "name": "network-vif-unplugged", "status": "completed", "tag": "eee2dab9-9536-4e00-80d1-6a3c62c66656"}, {"server_uuid": "403f0ce5-3db7-4b5b-b809-9a5f4280b685", "name": "network-vif-plugged", "status": "completed", "tag": "a71c4667-d218-4c4c-bab3-ff8606f16efe"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:39.872929 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2205df26-403e-4112-8da1-850da56be10f req-3d2b957e-1469-438b-a929-b92511442ecb service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:39.873853 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2205df26-403e-4112-8da1-850da56be10f req-3d2b957e-1469-438b-a929-b92511442ecb service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:39.874849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2205df26-403e-4112-8da1-850da56be10f req-3d2b957e-1469-438b-a929-b92511442ecb service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:39.899183 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-2205df26-403e-4112-8da1-850da56be10f req-3d2b957e-1469-438b-a929-b92511442ecb service nova] Creating event network-vif-unplugged:eee2dab9-9536-4e00-80d1-6a3c62c66656 for instance e0095403-2e07-4041-b6e1-5064132dff18 on n-h1-862967-2 Oct 29 02:48:39.899882 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-2205df26-403e-4112-8da1-850da56be10f req-3d2b957e-1469-438b-a929-b92511442ecb service nova] Creating event network-vif-plugged:a71c4667-d218-4c4c-bab3-ff8606f16efe for instance 403f0ce5-3db7-4b5b-b809-9a5f4280b685 on n-h1-862967-2 Oct 29 02:48:39.907812 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-2205df26-403e-4112-8da1-850da56be10f req-3d2b957e-1469-438b-a929-b92511442ecb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.100709 Oct 29 02:48:39.914036 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 426/831] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:39.934782 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0906bcbb-0356-45d3-aeb6-effee6af0af9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:39.939323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0906bcbb-0356-45d3-aeb6-effee6af0af9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:40.269723 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0906bcbb-0356-45d3-aeb6-effee6af0af9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:40.280803 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0906bcbb-0356-45d3-aeb6-effee6af0af9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22" status: 200 len: 1216 microversion: 2.1 time: 0.364215 Oct 29 02:48:40.287068 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 427/832] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:39 2022] GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22 => generated 1216 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:40.292361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6e10132a-2ff5-47a3-ae1d-5088e97668d2 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:40.296673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6e10132a-2ff5-47a3-ae1d-5088e97668d2 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: 20602fbc-9893-433b-b711-3de8a31a4608] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:40.319549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e10132a-2ff5-47a3-ae1d-5088e97668d2 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:40.320389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e10132a-2ff5-47a3-ae1d-5088e97668d2 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:40.321057 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e10132a-2ff5-47a3-ae1d-5088e97668d2 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:40.323633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e10132a-2ff5-47a3-ae1d-5088e97668d2 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:40.324394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e10132a-2ff5-47a3-ae1d-5088e97668d2 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:40.326259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e10132a-2ff5-47a3-ae1d-5088e97668d2 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:40.967690 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6e10132a-2ff5-47a3-ae1d-5088e97668d2 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:40.986666 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6e10132a-2ff5-47a3-ae1d-5088e97668d2 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608" status: 200 len: 1390 microversion: 2.1 time: 0.697809 Oct 29 02:48:40.987783 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 428/833] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:40 2022] GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608 => generated 1390 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:40.999525 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-2a0bb855-92c1-4ee6-8edc-819315a6d18e req-f3120ee9-144b-4365-b093-87f53c931ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0095403-2e07-4041-b6e1-5064132dff18", "name": "network-vif-deleted", "tag": "eee2dab9-9536-4e00-80d1-6a3c62c66656"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:41.021961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2a0bb855-92c1-4ee6-8edc-819315a6d18e req-f3120ee9-144b-4365-b093-87f53c931ea0 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:41.022814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2a0bb855-92c1-4ee6-8edc-819315a6d18e req-f3120ee9-144b-4365-b093-87f53c931ea0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:41.026813 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2a0bb855-92c1-4ee6-8edc-819315a6d18e req-f3120ee9-144b-4365-b093-87f53c931ea0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:41.049878 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-2a0bb855-92c1-4ee6-8edc-819315a6d18e req-f3120ee9-144b-4365-b093-87f53c931ea0 service nova] Creating event network-vif-deleted:eee2dab9-9536-4e00-80d1-6a3c62c66656 for instance e0095403-2e07-4041-b6e1-5064132dff18 on n-h1-862967-2 Oct 29 02:48:41.074654 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-2a0bb855-92c1-4ee6-8edc-819315a6d18e req-f3120ee9-144b-4365-b093-87f53c931ea0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083488 Oct 29 02:48:41.075683 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 429/834] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:41.087548 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c8b3f1de-1464-4426-8e07-6341720d7520 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:41.089217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c8b3f1de-1464-4426-8e07-6341720d7520 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 34d62a74-da30-4154-adfe-289eb2ad7564] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:41.099885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8b3f1de-1464-4426-8e07-6341720d7520 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:41.101170 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8b3f1de-1464-4426-8e07-6341720d7520 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:41.101805 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8b3f1de-1464-4426-8e07-6341720d7520 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:41.102899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8b3f1de-1464-4426-8e07-6341720d7520 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:41.103537 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8b3f1de-1464-4426-8e07-6341720d7520 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:41.105236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8b3f1de-1464-4426-8e07-6341720d7520 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:41.334040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-309eef3e-6581-4087-87d8-3f5a30431a3e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:48:41.335933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-309eef3e-6581-4087-87d8-3f5a30431a3e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:48:41.336801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-309eef3e-6581-4087-87d8-3f5a30431a3e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:48:41.337873 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-309eef3e-6581-4087-87d8-3f5a30431a3e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:48:41.339230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-309eef3e-6581-4087-87d8-3f5a30431a3e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:48:41.363726 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-309eef3e-6581-4087-87d8-3f5a30431a3e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:41.365296 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-309eef3e-6581-4087-87d8-3f5a30431a3e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:41.366352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-309eef3e-6581-4087-87d8-3f5a30431a3e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:41.367882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-309eef3e-6581-4087-87d8-3f5a30431a3e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:41.370002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-309eef3e-6581-4087-87d8-3f5a30431a3e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:41.371352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-309eef3e-6581-4087-87d8-3f5a30431a3e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:41.434629 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-309eef3e-6581-4087-87d8-3f5a30431a3e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Getting quotas for project fd611070fee0435f8bdda9c3ba5d62fc. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:48:41.445678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-309eef3e-6581-4087-87d8-3f5a30431a3e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Getting quotas for user 15a2e59fd0b244eea041651e4d79de9b and project fd611070fee0435f8bdda9c3ba5d62fc. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:48:41.470053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-309eef3e-6581-4087-87d8-3f5a30431a3e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:48:41.473438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-309eef3e-6581-4087-87d8-3f5a30431a3e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:48:41.584636 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c8b3f1de-1464-4426-8e07-6341720d7520 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:41.599470 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c8b3f1de-1464-4426-8e07-6341720d7520 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564" status: 200 len: 1314 microversion: 2.1 time: 0.522001 Oct 29 02:48:41.619262 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 430/835] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:41 2022] GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564 => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:41.633958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-75f9e40d-ed71-4133-92b6-55018dcf421f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:41.641200 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-309eef3e-6581-4087-87d8-3f5a30431a3e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.025393 Oct 29 02:48:41.641618 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-75f9e40d-ed71-4133-92b6-55018dcf421f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:41.644629 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 406/836] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:48:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:48:41.659177 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-67c3e4cd-24de-4ffb-af32-56b79b3647e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:41.661088 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-67c3e4cd-24de-4ffb-af32-56b79b3647e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e0095403-2e07-4041-b6e1-5064132dff18] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:41.664199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75f9e40d-ed71-4133-92b6-55018dcf421f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:41.665208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75f9e40d-ed71-4133-92b6-55018dcf421f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:41.666374 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75f9e40d-ed71-4133-92b6-55018dcf421f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:41.671833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75f9e40d-ed71-4133-92b6-55018dcf421f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:41.672908 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75f9e40d-ed71-4133-92b6-55018dcf421f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:41.673544 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75f9e40d-ed71-4133-92b6-55018dcf421f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:41.675174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67c3e4cd-24de-4ffb-af32-56b79b3647e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:41.675997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67c3e4cd-24de-4ffb-af32-56b79b3647e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:41.676743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67c3e4cd-24de-4ffb-af32-56b79b3647e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:41.677802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67c3e4cd-24de-4ffb-af32-56b79b3647e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:41.679184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67c3e4cd-24de-4ffb-af32-56b79b3647e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:41.680231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67c3e4cd-24de-4ffb-af32-56b79b3647e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:41.752839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67c3e4cd-24de-4ffb-af32-56b79b3647e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:41.753449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67c3e4cd-24de-4ffb-af32-56b79b3647e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:41.753800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67c3e4cd-24de-4ffb-af32-56b79b3647e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:41.754241 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-67c3e4cd-24de-4ffb-af32-56b79b3647e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lazy-loading 'fault' on Instance uuid e0095403-2e07-4041-b6e1-5064132dff18 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:48:41.914658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-75f9e40d-ed71-4133-92b6-55018dcf421f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:41.942934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-75f9e40d-ed71-4133-92b6-55018dcf421f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:41.949361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-75f9e40d-ed71-4133-92b6-55018dcf421f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:41.971889 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-75f9e40d-ed71-4133-92b6-55018dcf421f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1537 microversion: 2.91 time: 0.351141 Oct 29 02:48:41.973395 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 431/837] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:41 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1537 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:42.020314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-45d51230-74a9-48e7-b96d-2c0cd87acb9c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:42.029949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-45d51230-74a9-48e7-b96d-2c0cd87acb9c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:42.068259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45d51230-74a9-48e7-b96d-2c0cd87acb9c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:42.069466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45d51230-74a9-48e7-b96d-2c0cd87acb9c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:42.078646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45d51230-74a9-48e7-b96d-2c0cd87acb9c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:42.080261 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45d51230-74a9-48e7-b96d-2c0cd87acb9c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:42.081472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45d51230-74a9-48e7-b96d-2c0cd87acb9c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:42.085589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45d51230-74a9-48e7-b96d-2c0cd87acb9c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:42.258398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-67c3e4cd-24de-4ffb-af32-56b79b3647e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:42.269131 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-67c3e4cd-24de-4ffb-af32-56b79b3647e3 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18" status: 200 len: 1315 microversion: 2.1 time: 0.620882 Oct 29 02:48:42.292182 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 407/838] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:41 2022] GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18 => generated 1315 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:42.304805 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-82a75a8e-5648-4fb5-8495-88fb66e4d0c8 req-2910c2c0-0737-4492-9a8f-1a95772c1921 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "694141ac-c96c-409b-9eb2-831a3ccb5a68", "tag": "0c4a3365-7206-4763-be5c-6b7899359935"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:42.323360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-82a75a8e-5648-4fb5-8495-88fb66e4d0c8 req-2910c2c0-0737-4492-9a8f-1a95772c1921 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:42.325518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-82a75a8e-5648-4fb5-8495-88fb66e4d0c8 req-2910c2c0-0737-4492-9a8f-1a95772c1921 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:42.326138 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-82a75a8e-5648-4fb5-8495-88fb66e4d0c8 req-2910c2c0-0737-4492-9a8f-1a95772c1921 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:42.344885 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-82a75a8e-5648-4fb5-8495-88fb66e4d0c8 req-2910c2c0-0737-4492-9a8f-1a95772c1921 service nova] Creating event network-changed:0c4a3365-7206-4763-be5c-6b7899359935 for instance 694141ac-c96c-409b-9eb2-831a3ccb5a68 on n-h1-862967-2 Oct 29 02:48:42.354868 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-82a75a8e-5648-4fb5-8495-88fb66e4d0c8 req-2910c2c0-0737-4492-9a8f-1a95772c1921 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059117 Oct 29 02:48:42.355949 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 408/839] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:42.358919 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-45d51230-74a9-48e7-b96d-2c0cd87acb9c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:42.361503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-24158ff4-ec82-4e75-828f-1b704824a63d tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:42.363889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-24158ff4-ec82-4e75-828f-1b704824a63d tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:42.417036 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-45d51230-74a9-48e7-b96d-2c0cd87acb9c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22" status: 200 len: 1268 microversion: 2.1 time: 0.425448 Oct 29 02:48:42.427414 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 432/840] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:41 2022] GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22 => generated 1268 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:42.442757 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-002abcac-8184-4a16-82b5-56d3423661bf req-404989f3-635a-40b9-8e6a-1bd31b7a746b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d62a74-da30-4154-adfe-289eb2ad7564", "name": "network-vif-plugged", "status": "completed", "tag": "56c5251b-c2b7-4702-8b66-f7e375331456"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:42.466888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-002abcac-8184-4a16-82b5-56d3423661bf req-404989f3-635a-40b9-8e6a-1bd31b7a746b service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:42.467518 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-002abcac-8184-4a16-82b5-56d3423661bf req-404989f3-635a-40b9-8e6a-1bd31b7a746b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:42.468046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-002abcac-8184-4a16-82b5-56d3423661bf req-404989f3-635a-40b9-8e6a-1bd31b7a746b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:42.508616 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-002abcac-8184-4a16-82b5-56d3423661bf req-404989f3-635a-40b9-8e6a-1bd31b7a746b service nova] Creating event network-vif-plugged:56c5251b-c2b7-4702-8b66-f7e375331456 for instance 34d62a74-da30-4154-adfe-289eb2ad7564 on n-h2-862967-2 Oct 29 02:48:42.525640 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-002abcac-8184-4a16-82b5-56d3423661bf req-404989f3-635a-40b9-8e6a-1bd31b7a746b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096235 Oct 29 02:48:42.528366 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 433/841] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:42.535757 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c39d8908-520e-487f-b664-a3f0559e12ed tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:42.536782 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c39d8908-520e-487f-b664-a3f0559e12ed tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: 20602fbc-9893-433b-b711-3de8a31a4608] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:42.544624 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c39d8908-520e-487f-b664-a3f0559e12ed tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:42.545167 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c39d8908-520e-487f-b664-a3f0559e12ed tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:42.546062 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c39d8908-520e-487f-b664-a3f0559e12ed tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:42.547683 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c39d8908-520e-487f-b664-a3f0559e12ed tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:42.548266 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c39d8908-520e-487f-b664-a3f0559e12ed tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:42.548870 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c39d8908-520e-487f-b664-a3f0559e12ed tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:42.570053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-24158ff4-ec82-4e75-828f-1b704824a63d tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:42.584988 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-24158ff4-ec82-4e75-828f-1b704824a63d tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a" status: 200 len: 1224 microversion: 2.1 time: 0.227431 Oct 29 02:48:42.585956 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 409/842] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:42 2022] GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a => generated 1224 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:42.632176 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c0e9b1af-0a35-41b4-9d9f-fa7a2545d498 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:42.632799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c0e9b1af-0a35-41b4-9d9f-fa7a2545d498 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 34d62a74-da30-4154-adfe-289eb2ad7564] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:42.646794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0e9b1af-0a35-41b4-9d9f-fa7a2545d498 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:42.652227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0e9b1af-0a35-41b4-9d9f-fa7a2545d498 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:42.653020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0e9b1af-0a35-41b4-9d9f-fa7a2545d498 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:42.655601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0e9b1af-0a35-41b4-9d9f-fa7a2545d498 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:42.661842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0e9b1af-0a35-41b4-9d9f-fa7a2545d498 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:42.662364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0e9b1af-0a35-41b4-9d9f-fa7a2545d498 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:42.891219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c39d8908-520e-487f-b664-a3f0559e12ed tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:42.908355 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c39d8908-520e-487f-b664-a3f0559e12ed tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608" status: 200 len: 1390 microversion: 2.1 time: 0.376503 Oct 29 02:48:42.910297 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 434/843] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:42 2022] GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608 => generated 1390 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:43.029327 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-75192d69-c367-4e9c-a843-6d0ba8cf69cd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:43.032221 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-75192d69-c367-4e9c-a843-6d0ba8cf69cd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:43.044018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75192d69-c367-4e9c-a843-6d0ba8cf69cd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:43.045178 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75192d69-c367-4e9c-a843-6d0ba8cf69cd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:43.045913 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75192d69-c367-4e9c-a843-6d0ba8cf69cd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:43.047177 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75192d69-c367-4e9c-a843-6d0ba8cf69cd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:43.048236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75192d69-c367-4e9c-a843-6d0ba8cf69cd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:43.049129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75192d69-c367-4e9c-a843-6d0ba8cf69cd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:43.278767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-75192d69-c367-4e9c-a843-6d0ba8cf69cd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:43.282463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c0e9b1af-0a35-41b4-9d9f-fa7a2545d498 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:43.306328 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c0e9b1af-0a35-41b4-9d9f-fa7a2545d498 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564" status: 200 len: 1314 microversion: 2.1 time: 0.677823 Oct 29 02:48:43.311365 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-75192d69-c367-4e9c-a843-6d0ba8cf69cd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:43.311795 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 410/844] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:42 2022] GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564 => generated 1314 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:43.316693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-75192d69-c367-4e9c-a843-6d0ba8cf69cd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:43.337159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b424d2ee-9f0c-4789-9d8f-3935349cc087 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:43.338952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b424d2ee-9f0c-4789-9d8f-3935349cc087 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e0095403-2e07-4041-b6e1-5064132dff18] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:43.344871 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-75192d69-c367-4e9c-a843-6d0ba8cf69cd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1537 microversion: 2.91 time: 0.323466 Oct 29 02:48:43.359145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b424d2ee-9f0c-4789-9d8f-3935349cc087 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:43.360463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b424d2ee-9f0c-4789-9d8f-3935349cc087 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:43.361190 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b424d2ee-9f0c-4789-9d8f-3935349cc087 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:43.362136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b424d2ee-9f0c-4789-9d8f-3935349cc087 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:43.362798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b424d2ee-9f0c-4789-9d8f-3935349cc087 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:43.363432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b424d2ee-9f0c-4789-9d8f-3935349cc087 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:43.367156 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 435/845] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:43 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1537 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:43.410478 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-b424d2ee-9f0c-4789-9d8f-3935349cc087 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] HTTP exception thrown: Instance e0095403-2e07-4041-b6e1-5064132dff18 could not be found. Oct 29 02:48:43.413255 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b424d2ee-9f0c-4789-9d8f-3935349cc087 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Request method failure captured: Oct 29 02:48:43.413255 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18 HTTP/1.1 Oct 29 02:48:43.413255 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:48:43.413255 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:48:43.413255 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:48:43.413255 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:48:43.413255 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:48:43.413255 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:48:43.413255 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:48:43.413255 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:48:43.413255 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJQe_uEcQU7TWvWTWyYHk2tBfhyW3anQlq9IlbMuIEkf7vn933sPmCKARJnxQpZiUZK1LvxWi4oqgPbQrdfUsgmfgxV95FnHLrMyZSrDr2oYF-e8DjjcOj7SOyLBpFsBspJHWMF4bxtFDAQHeniPMEGa1F2s-2gEJ_CIW5xBvV79ZDc Oct 29 02:48:43.413255 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:48:43.413255 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:48:43.413255 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:48:43.413255 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:48:43.413255 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:48:43.413255 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:48:43.413255 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 94814dc564d04e688714ac064c7d1b3b Oct 29 02:48:43.413255 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:48:43.413255 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:48:43.413255 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:48:43.414819 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/94814dc564d04e688714ac064c7d1b3b"}]}] Oct 29 02:48:43.414819 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:48:43.414819 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 94814dc564d04e688714ac064c7d1b3b Oct 29 02:48:43.414819 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:48:43.414819 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ImagesOneServerNegativeTestJSON-13999867-project Oct 29 02:48:43.414819 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:48:43.414819 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:48:43.414819 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 6862cd2470624f01a8bc1d371aa03962 Oct 29 02:48:43.414819 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-13999867-project Oct 29 02:48:43.414819 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:48:43.414819 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance e0095403-2e07-4041-b6e1-5064132dff18 could not be found. Oct 29 02:48:43.414819 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'e0095403-2e07-4041-b6e1-5064132dff18'} Oct 29 02:48:43.415876 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:48:43.415876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:43.415876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:48:43.415876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:48:43.415876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:48:43.415876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:48:43.415876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:48:43.415876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:48:43.415876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:48:43.415876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:48:43.415876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0095403-2e07-4041-b6e1-5064132dff18 could not be found. Oct 29 02:48:43.415876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:48:43.415876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:43.415876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:48:43.415876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:43.415876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:43.415876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:43.415876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:48:43.415876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:48:43.415876 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:48:43.417583 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:48:43.417583 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:48:43.417583 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:48:43.417583 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:48:43.417583 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:48:43.417583 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:48:43.417583 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:48:43.417583 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0095403-2e07-4041-b6e1-5064132dff18 could not be found. Oct 29 02:48:43.417583 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:48:43.417583 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:48:43.417583 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:48:43.417583 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:48:43.417583 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:48:43.417583 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:48:43.417583 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:48:43.417583 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:48:43.417583 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0095403-2e07-4041-b6e1-5064132dff18 could not be found. Oct 29 02:48:43.417583 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:48:43.420153 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b424d2ee-9f0c-4789-9d8f-3935349cc087 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Returning 404 to user: Instance e0095403-2e07-4041-b6e1-5064132dff18 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:48:43.425998 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b424d2ee-9f0c-4789-9d8f-3935349cc087 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18" status: 404 len: 111 microversion: 2.1 time: 0.112176 Oct 29 02:48:43.431612 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 411/846] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:43 2022] GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:48:43.465455 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3860841f-035f-4484-ad38-a6246d6b50b6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:43.466722 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3860841f-035f-4484-ad38-a6246d6b50b6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:43.482377 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3860841f-035f-4484-ad38-a6246d6b50b6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:43.483701 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3860841f-035f-4484-ad38-a6246d6b50b6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:43.485674 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3860841f-035f-4484-ad38-a6246d6b50b6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:43.487783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3860841f-035f-4484-ad38-a6246d6b50b6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:43.489324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3860841f-035f-4484-ad38-a6246d6b50b6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:43.490393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3860841f-035f-4484-ad38-a6246d6b50b6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:43.615430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ba8f4cf3-96ef-441f-9bdf-06297f29dc69 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:43.616487 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ba8f4cf3-96ef-441f-9bdf-06297f29dc69 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:43.639566 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba8f4cf3-96ef-441f-9bdf-06297f29dc69 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:43.645804 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba8f4cf3-96ef-441f-9bdf-06297f29dc69 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:43.648200 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba8f4cf3-96ef-441f-9bdf-06297f29dc69 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:43.649491 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba8f4cf3-96ef-441f-9bdf-06297f29dc69 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:43.653528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba8f4cf3-96ef-441f-9bdf-06297f29dc69 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:43.654621 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba8f4cf3-96ef-441f-9bdf-06297f29dc69 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:43.714521 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3860841f-035f-4484-ad38-a6246d6b50b6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:43.735455 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3860841f-035f-4484-ad38-a6246d6b50b6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22" status: 200 len: 1286 microversion: 2.1 time: 0.278021 Oct 29 02:48:43.736410 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 436/847] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:43 2022] GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22 => generated 1286 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:43.748196 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-14a1d3d2-7efb-4a00-b75d-a49636ceb1fc tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1206669116", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:43.883016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-14a1d3d2-7efb-4a00-b75d-a49636ceb1fc tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] validate_networks() for [('1bffd244-e23c-4a00-9a5f-56919f435fec', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:48:43.895359 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ba8f4cf3-96ef-441f-9bdf-06297f29dc69 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:43.909459 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ba8f4cf3-96ef-441f-9bdf-06297f29dc69 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a" status: 200 len: 1276 microversion: 2.1 time: 0.296633 Oct 29 02:48:43.925738 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 412/848] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:43 2022] GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a => generated 1276 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:43.939663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-599fa3c4-f5a6-489d-98f7-4be712d18599 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:43.940281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-599fa3c4-f5a6-489d-98f7-4be712d18599 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: 20602fbc-9893-433b-b711-3de8a31a4608] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:43.958595 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-599fa3c4-f5a6-489d-98f7-4be712d18599 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:43.959075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-599fa3c4-f5a6-489d-98f7-4be712d18599 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:43.959700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-599fa3c4-f5a6-489d-98f7-4be712d18599 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:43.960928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-599fa3c4-f5a6-489d-98f7-4be712d18599 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:43.961542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-599fa3c4-f5a6-489d-98f7-4be712d18599 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:43.962129 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-599fa3c4-f5a6-489d-98f7-4be712d18599 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:44.749718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-599fa3c4-f5a6-489d-98f7-4be712d18599 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:44.766474 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-599fa3c4-f5a6-489d-98f7-4be712d18599 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608" status: 200 len: 1390 microversion: 2.1 time: 0.829182 Oct 29 02:48:44.771701 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 413/849] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:43 2022] GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608 => generated 1390 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:44.782389 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-996df9ec-34d2-441f-8345-0e24183403cd tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:44.787199 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-996df9ec-34d2-441f-8345-0e24183403cd tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 34d62a74-da30-4154-adfe-289eb2ad7564] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:44.796717 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-996df9ec-34d2-441f-8345-0e24183403cd tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:44.797719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-996df9ec-34d2-441f-8345-0e24183403cd tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:44.798252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-996df9ec-34d2-441f-8345-0e24183403cd tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:44.799710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-996df9ec-34d2-441f-8345-0e24183403cd tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:44.808303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-996df9ec-34d2-441f-8345-0e24183403cd tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:44.813798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-996df9ec-34d2-441f-8345-0e24183403cd tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:45.109334 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-14a1d3d2-7efb-4a00-b75d-a49636ceb1fc tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:48:45.109939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-14a1d3d2-7efb-4a00-b75d-a49636ceb1fc tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:48:45.111028 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-14a1d3d2-7efb-4a00-b75d-a49636ceb1fc tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:48:45.111958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-14a1d3d2-7efb-4a00-b75d-a49636ceb1fc tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:48:45.113080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-14a1d3d2-7efb-4a00-b75d-a49636ceb1fc tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:48:45.149945 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14a1d3d2-7efb-4a00-b75d-a49636ceb1fc tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:45.150828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14a1d3d2-7efb-4a00-b75d-a49636ceb1fc tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:45.151649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14a1d3d2-7efb-4a00-b75d-a49636ceb1fc tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:45.153918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14a1d3d2-7efb-4a00-b75d-a49636ceb1fc tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:45.155729 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14a1d3d2-7efb-4a00-b75d-a49636ceb1fc tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:45.157122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14a1d3d2-7efb-4a00-b75d-a49636ceb1fc tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:45.188280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-14a1d3d2-7efb-4a00-b75d-a49636ceb1fc tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Getting quotas for project 94814dc564d04e688714ac064c7d1b3b. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:48:45.195733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-14a1d3d2-7efb-4a00-b75d-a49636ceb1fc tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Getting quotas for user 6862cd2470624f01a8bc1d371aa03962 and project 94814dc564d04e688714ac064c7d1b3b. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:48:45.214586 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-14a1d3d2-7efb-4a00-b75d-a49636ceb1fc tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:48:45.218597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-14a1d3d2-7efb-4a00-b75d-a49636ceb1fc tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e8dc7205-039c-480e-946f-8c396fe60b2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:48:45.286000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-996df9ec-34d2-441f-8345-0e24183403cd tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:45.316630 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-996df9ec-34d2-441f-8345-0e24183403cd tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564" status: 200 len: 1464 microversion: 2.1 time: 0.542355 Oct 29 02:48:45.317283 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 414/850] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:44 2022] GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564 => generated 1464 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:45.336384 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-14a1d3d2-7efb-4a00-b75d-a49636ceb1fc tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.598406 Oct 29 02:48:45.340413 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 437/851] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:48:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 1603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:48:45.342438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-28972627-c86e-4e4c-930a-83615bb4c0cd tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-999195163", "imageRef": "8f215834-2b45-425c-91d4-0e66481c8f29", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b29fb9db-bf8f-4128-9e0d-d05f288e1348"}], "security_groups": [{"name": "tempest-securitygroup--1833556410"}], "key_name": "tempest-keypair-1385407257", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:45.364563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-45f6cb86-b345-4709-91c4-528b0dfacc28 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:45.366322 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-45f6cb86-b345-4709-91c4-528b0dfacc28 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:45.384969 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=94 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:45.388265 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45f6cb86-b345-4709-91c4-528b0dfacc28 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:45.389091 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45f6cb86-b345-4709-91c4-528b0dfacc28 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:45.389700 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45f6cb86-b345-4709-91c4-528b0dfacc28 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:45.390597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45f6cb86-b345-4709-91c4-528b0dfacc28 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:45.391211 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45f6cb86-b345-4709-91c4-528b0dfacc28 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:45.391795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45f6cb86-b345-4709-91c4-528b0dfacc28 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:45.529635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-45f6cb86-b345-4709-91c4-528b0dfacc28 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:45.549890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-45f6cb86-b345-4709-91c4-528b0dfacc28 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:45.552657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-45f6cb86-b345-4709-91c4-528b0dfacc28 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:45.561976 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-45f6cb86-b345-4709-91c4-528b0dfacc28 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1537 microversion: 2.91 time: 0.216904 Oct 29 02:48:45.563612 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 438/852] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:45 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1537 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:45.572135 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4d80c858-d5e0-436e-acd5-24bb61782f61 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:45.573309 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4d80c858-d5e0-436e-acd5-24bb61782f61 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:45.582696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d80c858-d5e0-436e-acd5-24bb61782f61 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:45.583589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d80c858-d5e0-436e-acd5-24bb61782f61 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:45.584071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d80c858-d5e0-436e-acd5-24bb61782f61 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:45.585081 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d80c858-d5e0-436e-acd5-24bb61782f61 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:45.585714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d80c858-d5e0-436e-acd5-24bb61782f61 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:45.586556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d80c858-d5e0-436e-acd5-24bb61782f61 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:45.669198 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-28972627-c86e-4e4c-930a-83615bb4c0cd tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] validate_networks() for [('b29fb9db-bf8f-4128-9e0d-d05f288e1348', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:48:45.677744 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4d80c858-d5e0-436e-acd5-24bb61782f61 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:45.692105 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4d80c858-d5e0-436e-acd5-24bb61782f61 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22" status: 200 len: 1274 microversion: 2.1 time: 0.126637 Oct 29 02:48:45.693264 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 439/853] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:45 2022] GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22 => generated 1274 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:45.699467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9cd66e6a-8edb-4d00-9e7e-bc074526eb07 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:45.700436 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9cd66e6a-8edb-4d00-9e7e-bc074526eb07 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:45.708913 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cd66e6a-8edb-4d00-9e7e-bc074526eb07 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:45.709518 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cd66e6a-8edb-4d00-9e7e-bc074526eb07 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:45.710108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cd66e6a-8edb-4d00-9e7e-bc074526eb07 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:45.712338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cd66e6a-8edb-4d00-9e7e-bc074526eb07 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:45.712958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cd66e6a-8edb-4d00-9e7e-bc074526eb07 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:45.713791 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cd66e6a-8edb-4d00-9e7e-bc074526eb07 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:45.920937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9cd66e6a-8edb-4d00-9e7e-bc074526eb07 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:45.948098 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9cd66e6a-8edb-4d00-9e7e-bc074526eb07 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a" status: 200 len: 1282 microversion: 2.1 time: 0.250469 Oct 29 02:48:45.949232 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 440/854] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:45 2022] GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a => generated 1282 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:45.972936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-be576c8d-9ae5-413c-bfa7-70b87a0a873d req-9b7c8da8-c4b7-4919-961f-5fe6dfdb85dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20602fbc-9893-433b-b711-3de8a31a4608", "name": "network-vif-plugged", "status": "completed", "tag": "d24e5257-2899-45fe-ad6a-690bf6e3cd60"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:46.007750 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-be576c8d-9ae5-413c-bfa7-70b87a0a873d req-9b7c8da8-c4b7-4919-961f-5fe6dfdb85dc service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:46.008966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-be576c8d-9ae5-413c-bfa7-70b87a0a873d req-9b7c8da8-c4b7-4919-961f-5fe6dfdb85dc service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:46.009717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-be576c8d-9ae5-413c-bfa7-70b87a0a873d req-9b7c8da8-c4b7-4919-961f-5fe6dfdb85dc service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:46.056272 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-be576c8d-9ae5-413c-bfa7-70b87a0a873d req-9b7c8da8-c4b7-4919-961f-5fe6dfdb85dc service nova] Creating event network-vif-plugged:d24e5257-2899-45fe-ad6a-690bf6e3cd60 for instance 20602fbc-9893-433b-b711-3de8a31a4608 on n-h2-862967-2 Oct 29 02:48:46.066938 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-be576c8d-9ae5-413c-bfa7-70b87a0a873d req-9b7c8da8-c4b7-4919-961f-5fe6dfdb85dc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111943 Oct 29 02:48:46.069067 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 441/855] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:46.076123 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a689ba6c-311f-44f4-bfdb-e6efd2c90e67 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:46.078702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a689ba6c-311f-44f4-bfdb-e6efd2c90e67 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:46.100778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a689ba6c-311f-44f4-bfdb-e6efd2c90e67 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:46.101468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a689ba6c-311f-44f4-bfdb-e6efd2c90e67 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:46.102004 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a689ba6c-311f-44f4-bfdb-e6efd2c90e67 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:46.103003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a689ba6c-311f-44f4-bfdb-e6efd2c90e67 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:46.103617 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a689ba6c-311f-44f4-bfdb-e6efd2c90e67 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:46.104137 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a689ba6c-311f-44f4-bfdb-e6efd2c90e67 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:46.806012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a689ba6c-311f-44f4-bfdb-e6efd2c90e67 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:46.822428 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a689ba6c-311f-44f4-bfdb-e6efd2c90e67 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1463 microversion: 2.1 time: 0.750265 Oct 29 02:48:46.823192 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 442/856] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:46 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1463 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:46.840308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fb30a299-05e8-42a2-844d-5b593c4167af tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:46.840995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fb30a299-05e8-42a2-844d-5b593c4167af tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e8dc7205-039c-480e-946f-8c396fe60b2e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:46.858863 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb30a299-05e8-42a2-844d-5b593c4167af tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:46.860326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb30a299-05e8-42a2-844d-5b593c4167af tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:46.861997 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb30a299-05e8-42a2-844d-5b593c4167af tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:46.865645 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb30a299-05e8-42a2-844d-5b593c4167af tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:46.867449 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb30a299-05e8-42a2-844d-5b593c4167af tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:46.869011 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb30a299-05e8-42a2-844d-5b593c4167af tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:47.099540 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fb30a299-05e8-42a2-844d-5b593c4167af tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:47.120934 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fb30a299-05e8-42a2-844d-5b593c4167af tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e" status: 200 len: 1221 microversion: 2.1 time: 0.292251 Oct 29 02:48:47.123014 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 443/857] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:46 2022] GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e => generated 1221 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:47.141572 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ee596359-3e40-4830-8758-5f3bcc9355d6 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:47.143282 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ee596359-3e40-4830-8758-5f3bcc9355d6 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: 20602fbc-9893-433b-b711-3de8a31a4608] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:47.175633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee596359-3e40-4830-8758-5f3bcc9355d6 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:47.176405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee596359-3e40-4830-8758-5f3bcc9355d6 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:47.195150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee596359-3e40-4830-8758-5f3bcc9355d6 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:47.195936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee596359-3e40-4830-8758-5f3bcc9355d6 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:47.196388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee596359-3e40-4830-8758-5f3bcc9355d6 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:47.197885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee596359-3e40-4830-8758-5f3bcc9355d6 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:47.201904 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:47.476908 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-28972627-c86e-4e4c-930a-83615bb4c0cd tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:48:47.477481 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-28972627-c86e-4e4c-930a-83615bb4c0cd tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:48:47.477795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-28972627-c86e-4e4c-930a-83615bb4c0cd tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:48:47.478258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-28972627-c86e-4e4c-930a-83615bb4c0cd tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:48:47.478671 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-28972627-c86e-4e4c-930a-83615bb4c0cd tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:48:47.491809 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-28972627-c86e-4e4c-930a-83615bb4c0cd tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:47.492335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-28972627-c86e-4e4c-930a-83615bb4c0cd tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:47.493537 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-28972627-c86e-4e4c-930a-83615bb4c0cd tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:47.494429 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-28972627-c86e-4e4c-930a-83615bb4c0cd tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:47.494926 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-28972627-c86e-4e4c-930a-83615bb4c0cd tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:47.496429 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-28972627-c86e-4e4c-930a-83615bb4c0cd tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:47.522007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-28972627-c86e-4e4c-930a-83615bb4c0cd tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Getting quotas for project 859a70e4fa3141bb8b667b1be8e9594b. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:48:47.529674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-28972627-c86e-4e4c-930a-83615bb4c0cd tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Getting quotas for user e823b4fb116c48ea92c2d3da58e10f5a and project 859a70e4fa3141bb8b667b1be8e9594b. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:48:47.556329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-28972627-c86e-4e4c-930a-83615bb4c0cd tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:48:47.561075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-28972627-c86e-4e4c-930a-83615bb4c0cd tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f215834-2b45-425c-91d4-0e66481c8f29',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:48:47.671847 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-28972627-c86e-4e4c-930a-83615bb4c0cd tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.351613 Oct 29 02:48:47.674191 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 415/858] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:48:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 2355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:48:47.683518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d57fc9f1-de94-4afe-b7d4-bad64b087f17 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:47.685647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d57fc9f1-de94-4afe-b7d4-bad64b087f17 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:47.703899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d57fc9f1-de94-4afe-b7d4-bad64b087f17 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:47.705102 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d57fc9f1-de94-4afe-b7d4-bad64b087f17 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:47.705793 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d57fc9f1-de94-4afe-b7d4-bad64b087f17 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:47.714478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d57fc9f1-de94-4afe-b7d4-bad64b087f17 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:47.721612 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d57fc9f1-de94-4afe-b7d4-bad64b087f17 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:47.722388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d57fc9f1-de94-4afe-b7d4-bad64b087f17 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:47.845171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d57fc9f1-de94-4afe-b7d4-bad64b087f17 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:47.874729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d57fc9f1-de94-4afe-b7d4-bad64b087f17 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:47.877588 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d57fc9f1-de94-4afe-b7d4-bad64b087f17 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:47.893210 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d57fc9f1-de94-4afe-b7d4-bad64b087f17 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1537 microversion: 2.91 time: 0.217183 Oct 29 02:48:47.902863 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 416/859] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:47 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1537 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:47.918168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c79cf159-7e81-4214-bed2-a04cfd95ab56 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:47.919272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c79cf159-7e81-4214-bed2-a04cfd95ab56 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:47.940957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c79cf159-7e81-4214-bed2-a04cfd95ab56 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:47.942020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c79cf159-7e81-4214-bed2-a04cfd95ab56 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:47.943459 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c79cf159-7e81-4214-bed2-a04cfd95ab56 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:47.944768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c79cf159-7e81-4214-bed2-a04cfd95ab56 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:47.948196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c79cf159-7e81-4214-bed2-a04cfd95ab56 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:47.948965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c79cf159-7e81-4214-bed2-a04cfd95ab56 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:48.587682 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c79cf159-7e81-4214-bed2-a04cfd95ab56 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:48.599428 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c79cf159-7e81-4214-bed2-a04cfd95ab56 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22" status: 200 len: 1316 microversion: 2.1 time: 0.694450 Oct 29 02:48:48.605486 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 417/860] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:47 2022] GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22 => generated 1316 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:48.616462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-02557f21-c1b7-46bc-b61c-54a24c67ffd4 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:48.618341 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-02557f21-c1b7-46bc-b61c-54a24c67ffd4 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:48.623478 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ee596359-3e40-4830-8758-5f3bcc9355d6 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:48.645058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02557f21-c1b7-46bc-b61c-54a24c67ffd4 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:48.648046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02557f21-c1b7-46bc-b61c-54a24c67ffd4 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:48.651996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02557f21-c1b7-46bc-b61c-54a24c67ffd4 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:48.657734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02557f21-c1b7-46bc-b61c-54a24c67ffd4 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:48.658482 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02557f21-c1b7-46bc-b61c-54a24c67ffd4 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:48.659090 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02557f21-c1b7-46bc-b61c-54a24c67ffd4 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:48.663973 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ee596359-3e40-4830-8758-5f3bcc9355d6 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608" status: 200 len: 1390 microversion: 2.1 time: 1.536662 Oct 29 02:48:48.676359 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 444/861] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:47 2022] GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608 => generated 1390 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:48.690027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cc08ab6c-d20a-4cb5-b173-b4e613bbf327 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-584719757", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "403f0ce5-3db7-4b5b-b809-9a5f4280b685"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:48.903925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-cc08ab6c-d20a-4cb5-b173-b4e613bbf327 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] validate_networks() for None {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:48:49.000072 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-02557f21-c1b7-46bc-b61c-54a24c67ffd4 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:49.026196 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-02557f21-c1b7-46bc-b61c-54a24c67ffd4 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a" status: 200 len: 1324 microversion: 2.1 time: 0.418250 Oct 29 02:48:49.030770 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 418/862] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:48 2022] GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a => generated 1324 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:49.045393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-990fbf98-aef2-4971-83e9-ea4537f5c7ef tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:49.047833 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-990fbf98-aef2-4971-83e9-ea4537f5c7ef tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:49.080652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-990fbf98-aef2-4971-83e9-ea4537f5c7ef tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:49.081982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-990fbf98-aef2-4971-83e9-ea4537f5c7ef tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:49.083217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-990fbf98-aef2-4971-83e9-ea4537f5c7ef tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:49.084361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-990fbf98-aef2-4971-83e9-ea4537f5c7ef tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:49.085307 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-990fbf98-aef2-4971-83e9-ea4537f5c7ef tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:49.086191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-990fbf98-aef2-4971-83e9-ea4537f5c7ef tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:49.240395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-990fbf98-aef2-4971-83e9-ea4537f5c7ef tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e823b4fb116c48ea92c2d3da58e10f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a70e4fa3141bb8b667b1be8e9594b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:49.269209 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-990fbf98-aef2-4971-83e9-ea4537f5c7ef tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54" status: 200 len: 1249 microversion: 2.1 time: 0.223221 Oct 29 02:48:49.289154 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 419/863] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:49 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 => generated 1249 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:49.299657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0df42040-7040-4c13-baf3-aff712cd2014 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:49.300103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0df42040-7040-4c13-baf3-aff712cd2014 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e8dc7205-039c-480e-946f-8c396fe60b2e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:49.317449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0df42040-7040-4c13-baf3-aff712cd2014 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:49.318015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0df42040-7040-4c13-baf3-aff712cd2014 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:49.318476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0df42040-7040-4c13-baf3-aff712cd2014 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:49.341952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0df42040-7040-4c13-baf3-aff712cd2014 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:49.345371 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0df42040-7040-4c13-baf3-aff712cd2014 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:49.345824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0df42040-7040-4c13-baf3-aff712cd2014 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:49.506977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0df42040-7040-4c13-baf3-aff712cd2014 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:49.517321 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0df42040-7040-4c13-baf3-aff712cd2014 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e" status: 200 len: 1283 microversion: 2.1 time: 0.226554 Oct 29 02:48:49.518796 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 420/864] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:49 2022] GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e => generated 1283 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:49.525457 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f86acb16-c2fa-4070-b844-1c8677a3ffc6 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:49.526335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f86acb16-c2fa-4070-b844-1c8677a3ffc6 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:49.540625 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f86acb16-c2fa-4070-b844-1c8677a3ffc6 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:49.541352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f86acb16-c2fa-4070-b844-1c8677a3ffc6 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:49.542059 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f86acb16-c2fa-4070-b844-1c8677a3ffc6 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:49.543131 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f86acb16-c2fa-4070-b844-1c8677a3ffc6 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:49.543576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f86acb16-c2fa-4070-b844-1c8677a3ffc6 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:49.544369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f86acb16-c2fa-4070-b844-1c8677a3ffc6 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:49.681425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f86acb16-c2fa-4070-b844-1c8677a3ffc6 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:49.702133 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f86acb16-c2fa-4070-b844-1c8677a3ffc6 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:49.705911 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f86acb16-c2fa-4070-b844-1c8677a3ffc6 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:49.717472 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f86acb16-c2fa-4070-b844-1c8677a3ffc6 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1537 microversion: 2.91 time: 0.196677 Oct 29 02:48:49.719312 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 421/865] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:49 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1537 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:49.727595 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-360fd4de-7e68-41e9-91dc-a7395f1988bd req-44e55623-250e-4d6d-a371-d8ca40346fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22", "tag": "90346241-9871-4e97-831a-37c4a0cd6c78"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:49.739823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-360fd4de-7e68-41e9-91dc-a7395f1988bd req-44e55623-250e-4d6d-a371-d8ca40346fc7 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:49.741086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-360fd4de-7e68-41e9-91dc-a7395f1988bd req-44e55623-250e-4d6d-a371-d8ca40346fc7 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:49.742082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-360fd4de-7e68-41e9-91dc-a7395f1988bd req-44e55623-250e-4d6d-a371-d8ca40346fc7 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:49.764803 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-360fd4de-7e68-41e9-91dc-a7395f1988bd req-44e55623-250e-4d6d-a371-d8ca40346fc7 service nova] Creating event network-changed:90346241-9871-4e97-831a-37c4a0cd6c78 for instance 61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22 on n-h1-862967-2 Oct 29 02:48:49.774413 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-360fd4de-7e68-41e9-91dc-a7395f1988bd req-44e55623-250e-4d6d-a371-d8ca40346fc7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052346 Oct 29 02:48:49.775614 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 422/866] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:49.789385 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cf34f333-9844-43c1-a89b-eae5a19f2897 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:49.790747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cf34f333-9844-43c1-a89b-eae5a19f2897 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:49.797571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf34f333-9844-43c1-a89b-eae5a19f2897 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:49.798061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf34f333-9844-43c1-a89b-eae5a19f2897 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:49.798501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf34f333-9844-43c1-a89b-eae5a19f2897 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:49.799410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf34f333-9844-43c1-a89b-eae5a19f2897 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:49.799871 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf34f333-9844-43c1-a89b-eae5a19f2897 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:49.800297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf34f333-9844-43c1-a89b-eae5a19f2897 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:49.854647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-cc08ab6c-d20a-4cb5-b173-b4e613bbf327 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:48:49.855432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-cc08ab6c-d20a-4cb5-b173-b4e613bbf327 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:48:49.855613 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-cc08ab6c-d20a-4cb5-b173-b4e613bbf327 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:48:49.855884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-cc08ab6c-d20a-4cb5-b173-b4e613bbf327 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:48:49.856483 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-cc08ab6c-d20a-4cb5-b173-b4e613bbf327 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:48:49.881757 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc08ab6c-d20a-4cb5-b173-b4e613bbf327 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:49.882710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc08ab6c-d20a-4cb5-b173-b4e613bbf327 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:49.884253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc08ab6c-d20a-4cb5-b173-b4e613bbf327 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:49.886147 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc08ab6c-d20a-4cb5-b173-b4e613bbf327 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:49.887684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc08ab6c-d20a-4cb5-b173-b4e613bbf327 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:49.888974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc08ab6c-d20a-4cb5-b173-b4e613bbf327 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:49.924060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-cc08ab6c-d20a-4cb5-b173-b4e613bbf327 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Getting quotas for project 24ee44ab29014be1bff1c5a18c53c2e2. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:48:49.931913 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-cc08ab6c-d20a-4cb5-b173-b4e613bbf327 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Getting quotas for user 8a6ba7c1ab324fe583f5ad27474cafc2 and project 24ee44ab29014be1bff1c5a18c53c2e2. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:48:49.954316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cc08ab6c-d20a-4cb5-b173-b4e613bbf327 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:48:49.957066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cc08ab6c-d20a-4cb5-b173-b4e613bbf327 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: cdd44464-a057-4ebc-bf1e-ae14f5655133] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:48:50.061901 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cc08ab6c-d20a-4cb5-b173-b4e613bbf327 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.383592 Oct 29 02:48:50.062575 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 445/867] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:48:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:48:50.080464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0265193f-c7e4-403c-bb78-b74e4db37384 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:50.081117 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0265193f-c7e4-403c-bb78-b74e4db37384 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: 20602fbc-9893-433b-b711-3de8a31a4608] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:50.097578 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0265193f-c7e4-403c-bb78-b74e4db37384 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:50.098950 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0265193f-c7e4-403c-bb78-b74e4db37384 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:50.101026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0265193f-c7e4-403c-bb78-b74e4db37384 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:50.103656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0265193f-c7e4-403c-bb78-b74e4db37384 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:50.105089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0265193f-c7e4-403c-bb78-b74e4db37384 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:50.106509 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0265193f-c7e4-403c-bb78-b74e4db37384 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:50.176218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cf34f333-9844-43c1-a89b-eae5a19f2897 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:50.192350 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cf34f333-9844-43c1-a89b-eae5a19f2897 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22" status: 200 len: 1316 microversion: 2.1 time: 0.414833 Oct 29 02:48:50.193779 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 423/868] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:49 2022] GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22 => generated 1316 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:50.209378 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6cd80b3b-8084-4fe5-8074-2100cd9fed55 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:50.211438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6cd80b3b-8084-4fe5-8074-2100cd9fed55 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:50.224000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cd80b3b-8084-4fe5-8074-2100cd9fed55 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:50.225167 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cd80b3b-8084-4fe5-8074-2100cd9fed55 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:50.226076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cd80b3b-8084-4fe5-8074-2100cd9fed55 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:50.227861 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cd80b3b-8084-4fe5-8074-2100cd9fed55 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:50.229212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cd80b3b-8084-4fe5-8074-2100cd9fed55 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:50.229995 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cd80b3b-8084-4fe5-8074-2100cd9fed55 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:50.481797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6cd80b3b-8084-4fe5-8074-2100cd9fed55 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:50.492348 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6cd80b3b-8084-4fe5-8074-2100cd9fed55 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a" status: 200 len: 1324 microversion: 2.1 time: 0.296473 Oct 29 02:48:50.493389 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 424/869] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:50 2022] GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a => generated 1324 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:50.499720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e185ba58-0266-479d-8ede-84e0e28924e4 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:50.500872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e185ba58-0266-479d-8ede-84e0e28924e4 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: cdd44464-a057-4ebc-bf1e-ae14f5655133] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:50.539071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0265193f-c7e4-403c-bb78-b74e4db37384 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:50.568264 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0265193f-c7e4-403c-bb78-b74e4db37384 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608" status: 200 len: 1587 microversion: 2.1 time: 0.495099 Oct 29 02:48:50.570299 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 446/870] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:50 2022] GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608 => generated 1587 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:50.578905 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-5d4738c9-6606-404a-b00a-14796cfb1920 req-04e03239-ec79-4e2c-9996-02fda64fa52a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3380e407-b7cb-4775-b5ed-17ef51c3764a", "tag": "d045507b-53ea-4e4f-9def-029bda6114ff"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:50.594836 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-5d4738c9-6606-404a-b00a-14796cfb1920 req-04e03239-ec79-4e2c-9996-02fda64fa52a service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:50.595950 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-5d4738c9-6606-404a-b00a-14796cfb1920 req-04e03239-ec79-4e2c-9996-02fda64fa52a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:50.596960 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-5d4738c9-6606-404a-b00a-14796cfb1920 req-04e03239-ec79-4e2c-9996-02fda64fa52a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:50.600331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e185ba58-0266-479d-8ede-84e0e28924e4 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:50.613370 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e185ba58-0266-479d-8ede-84e0e28924e4 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133" status: 200 len: 1213 microversion: 2.1 time: 0.117915 Oct 29 02:48:50.615499 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-5d4738c9-6606-404a-b00a-14796cfb1920 req-04e03239-ec79-4e2c-9996-02fda64fa52a service nova] Creating event network-changed:d045507b-53ea-4e4f-9def-029bda6114ff for instance 3380e407-b7cb-4775-b5ed-17ef51c3764a on n-h1-862967-2 Oct 29 02:48:50.615930 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 425/871] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:50 2022] GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133 => generated 1213 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:50.625526 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8bf27c91-e60c-4746-bae4-5c62f582935d tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:50.626664 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8bf27c91-e60c-4746-bae4-5c62f582935d tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:50.636561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bf27c91-e60c-4746-bae4-5c62f582935d tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:50.637883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bf27c91-e60c-4746-bae4-5c62f582935d tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:50.638867 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bf27c91-e60c-4746-bae4-5c62f582935d tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:50.641489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bf27c91-e60c-4746-bae4-5c62f582935d tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:50.642373 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bf27c91-e60c-4746-bae4-5c62f582935d tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:50.643548 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bf27c91-e60c-4746-bae4-5c62f582935d tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:50.648270 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-5d4738c9-6606-404a-b00a-14796cfb1920 req-04e03239-ec79-4e2c-9996-02fda64fa52a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073075 Oct 29 02:48:50.650441 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 447/872] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:50.662147 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-91872ad9-a78a-4a1e-854f-19734d021f17 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:50.663455 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-91872ad9-a78a-4a1e-854f-19734d021f17 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e8dc7205-039c-480e-946f-8c396fe60b2e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:50.677755 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91872ad9-a78a-4a1e-854f-19734d021f17 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:50.679141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91872ad9-a78a-4a1e-854f-19734d021f17 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:50.680499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91872ad9-a78a-4a1e-854f-19734d021f17 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:50.681831 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91872ad9-a78a-4a1e-854f-19734d021f17 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:50.683004 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91872ad9-a78a-4a1e-854f-19734d021f17 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:50.684200 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91872ad9-a78a-4a1e-854f-19734d021f17 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:50.761850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8bf27c91-e60c-4746-bae4-5c62f582935d tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e823b4fb116c48ea92c2d3da58e10f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a70e4fa3141bb8b667b1be8e9594b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:50.770597 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8bf27c91-e60c-4746-bae4-5c62f582935d tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54" status: 200 len: 1297 microversion: 2.1 time: 0.152863 Oct 29 02:48:50.771504 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 426/873] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:50 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 => generated 1297 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:50.791655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-06fc1c72-78ca-4788-a4b9-59c218e75b94 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:50.792183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-06fc1c72-78ca-4788-a4b9-59c218e75b94 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: 20602fbc-9893-433b-b711-3de8a31a4608] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:50.798645 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06fc1c72-78ca-4788-a4b9-59c218e75b94 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:50.799140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06fc1c72-78ca-4788-a4b9-59c218e75b94 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:50.799567 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06fc1c72-78ca-4788-a4b9-59c218e75b94 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:50.800271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06fc1c72-78ca-4788-a4b9-59c218e75b94 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:50.800760 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06fc1c72-78ca-4788-a4b9-59c218e75b94 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:50.801188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06fc1c72-78ca-4788-a4b9-59c218e75b94 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:50.804249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=100 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:50.914013 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-06fc1c72-78ca-4788-a4b9-59c218e75b94 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127547 Oct 29 02:48:50.917124 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 427/874] 10.222.0.46 () {58 vars in 1275 bytes} [Sat Oct 29 02:48:50 2022] GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:50.925289 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1cca6ea6-2676-4e06-bcfa-d312f5e18f48 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:50.926185 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1cca6ea6-2676-4e06-bcfa-d312f5e18f48 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:50.938951 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cca6ea6-2676-4e06-bcfa-d312f5e18f48 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:50.939722 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cca6ea6-2676-4e06-bcfa-d312f5e18f48 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:50.940460 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cca6ea6-2676-4e06-bcfa-d312f5e18f48 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:50.942551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cca6ea6-2676-4e06-bcfa-d312f5e18f48 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:50.943312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cca6ea6-2676-4e06-bcfa-d312f5e18f48 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:50.944150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cca6ea6-2676-4e06-bcfa-d312f5e18f48 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:51.001733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-91872ad9-a78a-4a1e-854f-19734d021f17 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:51.011704 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-91872ad9-a78a-4a1e-854f-19734d021f17 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e" status: 200 len: 1325 microversion: 2.1 time: 0.358907 Oct 29 02:48:51.014486 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 448/875] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:50 2022] GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e => generated 1325 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:51.101506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1cca6ea6-2676-4e06-bcfa-d312f5e18f48 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:51.123950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1cca6ea6-2676-4e06-bcfa-d312f5e18f48 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:51.126878 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1cca6ea6-2676-4e06-bcfa-d312f5e18f48 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:51.135569 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1cca6ea6-2676-4e06-bcfa-d312f5e18f48 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1537 microversion: 2.91 time: 0.216513 Oct 29 02:48:51.137382 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 428/876] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:50 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1537 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:51.220686 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c7175db8-0dce-4439-9552-52f13bbd4f1c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:51.222153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c7175db8-0dce-4439-9552-52f13bbd4f1c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:51.233903 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7175db8-0dce-4439-9552-52f13bbd4f1c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:51.234803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7175db8-0dce-4439-9552-52f13bbd4f1c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:51.235824 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7175db8-0dce-4439-9552-52f13bbd4f1c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:51.237620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7175db8-0dce-4439-9552-52f13bbd4f1c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:51.238419 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7175db8-0dce-4439-9552-52f13bbd4f1c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:51.239206 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7175db8-0dce-4439-9552-52f13bbd4f1c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:51.528301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8d6e7667-8004-4dc9-8d72-bd27d0d83792 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:51.535650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8d6e7667-8004-4dc9-8d72-bd27d0d83792 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:51.560912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:51.569677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d6e7667-8004-4dc9-8d72-bd27d0d83792 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:51.574095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d6e7667-8004-4dc9-8d72-bd27d0d83792 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:51.588114 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c7175db8-0dce-4439-9552-52f13bbd4f1c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:51.599536 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d6e7667-8004-4dc9-8d72-bd27d0d83792 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:51.602167 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d6e7667-8004-4dc9-8d72-bd27d0d83792 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:51.602843 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d6e7667-8004-4dc9-8d72-bd27d0d83792 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:51.603509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d6e7667-8004-4dc9-8d72-bd27d0d83792 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:51.616788 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c7175db8-0dce-4439-9552-52f13bbd4f1c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22" status: 200 len: 1316 microversion: 2.1 time: 0.403950 Oct 29 02:48:51.632899 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 449/877] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:51 2022] GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22 => generated 1316 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:51.640563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-732ac00c-5657-4c68-9393-21a925ace611 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:51.641460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-732ac00c-5657-4c68-9393-21a925ace611 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: cdd44464-a057-4ebc-bf1e-ae14f5655133] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:51.654131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-732ac00c-5657-4c68-9393-21a925ace611 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:51.654920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-732ac00c-5657-4c68-9393-21a925ace611 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:51.655510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-732ac00c-5657-4c68-9393-21a925ace611 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:51.661597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-732ac00c-5657-4c68-9393-21a925ace611 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:51.662479 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-732ac00c-5657-4c68-9393-21a925ace611 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:51.663118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-732ac00c-5657-4c68-9393-21a925ace611 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:51.829126 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-732ac00c-5657-4c68-9393-21a925ace611 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:51.851721 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-732ac00c-5657-4c68-9393-21a925ace611 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133" status: 200 len: 1209 microversion: 2.1 time: 0.214739 Oct 29 02:48:51.852972 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 450/878] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:51 2022] GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133 => generated 1209 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:48:51.863277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-822c871d-8da4-4634-a00f-99c181ff6076 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:51.877812 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-822c871d-8da4-4634-a00f-99c181ff6076 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:51.894466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-822c871d-8da4-4634-a00f-99c181ff6076 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:51.894987 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-822c871d-8da4-4634-a00f-99c181ff6076 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:51.895654 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-822c871d-8da4-4634-a00f-99c181ff6076 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:51.896730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-822c871d-8da4-4634-a00f-99c181ff6076 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:51.897619 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-822c871d-8da4-4634-a00f-99c181ff6076 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:51.898416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-822c871d-8da4-4634-a00f-99c181ff6076 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:52.142418 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-822c871d-8da4-4634-a00f-99c181ff6076 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e823b4fb116c48ea92c2d3da58e10f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a70e4fa3141bb8b667b1be8e9594b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:52.170932 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-822c871d-8da4-4634-a00f-99c181ff6076 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54" status: 200 len: 1303 microversion: 2.1 time: 0.312289 Oct 29 02:48:52.175565 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 451/879] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:51 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 => generated 1303 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:52.194700 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d408c675-c410-475b-bea8-e5e7a6de988c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:52.197975 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d408c675-c410-475b-bea8-e5e7a6de988c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e8dc7205-039c-480e-946f-8c396fe60b2e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:52.227300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d408c675-c410-475b-bea8-e5e7a6de988c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:52.230993 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d408c675-c410-475b-bea8-e5e7a6de988c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:52.232672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d408c675-c410-475b-bea8-e5e7a6de988c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:52.234179 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d408c675-c410-475b-bea8-e5e7a6de988c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:52.236413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d408c675-c410-475b-bea8-e5e7a6de988c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:52.237717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d408c675-c410-475b-bea8-e5e7a6de988c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:52.475466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8d6e7667-8004-4dc9-8d72-bd27d0d83792 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:52.495386 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8d6e7667-8004-4dc9-8d72-bd27d0d83792 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a" status: 200 len: 1324 microversion: 2.1 time: 0.976804 Oct 29 02:48:52.496035 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 429/880] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:51 2022] GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a => generated 1324 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:52.520466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-79574e41-fd86-4ce8-9cac-21cbc8a0142b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:52.520466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-79574e41-fd86-4ce8-9cac-21cbc8a0142b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:52.524363 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79574e41-fd86-4ce8-9cac-21cbc8a0142b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:52.524897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79574e41-fd86-4ce8-9cac-21cbc8a0142b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:52.525341 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79574e41-fd86-4ce8-9cac-21cbc8a0142b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:52.526079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79574e41-fd86-4ce8-9cac-21cbc8a0142b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:52.526556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79574e41-fd86-4ce8-9cac-21cbc8a0142b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:52.527005 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79574e41-fd86-4ce8-9cac-21cbc8a0142b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:53.392070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d408c675-c410-475b-bea8-e5e7a6de988c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:53.427285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-79574e41-fd86-4ce8-9cac-21cbc8a0142b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:53.428433 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d408c675-c410-475b-bea8-e5e7a6de988c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e" status: 200 len: 1325 microversion: 2.1 time: 1.247742 Oct 29 02:48:53.439194 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 452/881] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:52 2022] GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e => generated 1325 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:53.456749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-79574e41-fd86-4ce8-9cac-21cbc8a0142b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:53.476511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-79574e41-fd86-4ce8-9cac-21cbc8a0142b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:53.495442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5e958054-ef1d-4f45-ab53-90c51c62b717 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:53.497221 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5e958054-ef1d-4f45-ab53-90c51c62b717 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:53.515722 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-79574e41-fd86-4ce8-9cac-21cbc8a0142b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1537 microversion: 2.91 time: 1.014374 Oct 29 02:48:53.529082 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 430/882] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:52 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1537 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:53.529704 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e958054-ef1d-4f45-ab53-90c51c62b717 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:53.535320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e958054-ef1d-4f45-ab53-90c51c62b717 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:53.539440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e958054-ef1d-4f45-ab53-90c51c62b717 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:53.541285 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e958054-ef1d-4f45-ab53-90c51c62b717 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:53.548145 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e958054-ef1d-4f45-ab53-90c51c62b717 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:53.552682 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e958054-ef1d-4f45-ab53-90c51c62b717 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:53.555188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d3382959-8706-468e-954b-962b2b3bdba6 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:53.555863 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d3382959-8706-468e-954b-962b2b3bdba6 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: cdd44464-a057-4ebc-bf1e-ae14f5655133] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:53.592860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3382959-8706-468e-954b-962b2b3bdba6 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:53.593159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3382959-8706-468e-954b-962b2b3bdba6 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:53.593839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3382959-8706-468e-954b-962b2b3bdba6 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:53.594833 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3382959-8706-468e-954b-962b2b3bdba6 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:53.601221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3382959-8706-468e-954b-962b2b3bdba6 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:53.602014 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3382959-8706-468e-954b-962b2b3bdba6 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:54.051270 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d3382959-8706-468e-954b-962b2b3bdba6 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:54.080977 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d3382959-8706-468e-954b-962b2b3bdba6 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133" status: 200 len: 1283 microversion: 2.1 time: 0.549762 Oct 29 02:48:54.097079 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 431/883] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:53 2022] GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133 => generated 1283 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:54.118142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-039a7363-16ff-4ee2-93cf-cf92c942dba7 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:54.119500 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-039a7363-16ff-4ee2-93cf-cf92c942dba7 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:54.146154 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-039a7363-16ff-4ee2-93cf-cf92c942dba7 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:54.147257 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-039a7363-16ff-4ee2-93cf-cf92c942dba7 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:54.151809 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-039a7363-16ff-4ee2-93cf-cf92c942dba7 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:54.153555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-039a7363-16ff-4ee2-93cf-cf92c942dba7 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:54.155182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-039a7363-16ff-4ee2-93cf-cf92c942dba7 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:54.158893 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-039a7363-16ff-4ee2-93cf-cf92c942dba7 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:54.369620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5e958054-ef1d-4f45-ab53-90c51c62b717 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:54.387857 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5e958054-ef1d-4f45-ab53-90c51c62b717 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22" status: 200 len: 1316 microversion: 2.1 time: 0.937943 Oct 29 02:48:54.388902 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 453/884] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:53 2022] GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22 => generated 1316 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:54.397786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fcde9f35-0eab-4950-876b-43ba87939f36 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:54.398477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fcde9f35-0eab-4950-876b-43ba87939f36 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:54.427176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fcde9f35-0eab-4950-876b-43ba87939f36 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:54.427691 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fcde9f35-0eab-4950-876b-43ba87939f36 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:54.432822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fcde9f35-0eab-4950-876b-43ba87939f36 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:54.433786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fcde9f35-0eab-4950-876b-43ba87939f36 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:54.434314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fcde9f35-0eab-4950-876b-43ba87939f36 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:54.443074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-039a7363-16ff-4ee2-93cf-cf92c942dba7 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e823b4fb116c48ea92c2d3da58e10f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a70e4fa3141bb8b667b1be8e9594b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:54.447763 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fcde9f35-0eab-4950-876b-43ba87939f36 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:54.453648 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-039a7363-16ff-4ee2-93cf-cf92c942dba7 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54" status: 200 len: 1303 microversion: 2.1 time: 0.347255 Oct 29 02:48:54.478596 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 432/885] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:54 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 => generated 1303 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:54.503876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-43977984-c6bb-4fa3-b7df-072633b5f915 req-252dde34-20bb-4a27-a185-50e5751bcbce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8dc7205-039c-480e-946f-8c396fe60b2e", "tag": "41fc280a-31f7-477c-bbd8-91c57d67e2eb"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:54.544302 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-43977984-c6bb-4fa3-b7df-072633b5f915 req-252dde34-20bb-4a27-a185-50e5751bcbce service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:54.553428 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-43977984-c6bb-4fa3-b7df-072633b5f915 req-252dde34-20bb-4a27-a185-50e5751bcbce service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:54.561417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-43977984-c6bb-4fa3-b7df-072633b5f915 req-252dde34-20bb-4a27-a185-50e5751bcbce service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:54.587475 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-43977984-c6bb-4fa3-b7df-072633b5f915 req-252dde34-20bb-4a27-a185-50e5751bcbce service nova] Creating event network-changed:41fc280a-31f7-477c-bbd8-91c57d67e2eb for instance e8dc7205-039c-480e-946f-8c396fe60b2e on n-h2-862967-2 Oct 29 02:48:54.600903 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-43977984-c6bb-4fa3-b7df-072633b5f915 req-252dde34-20bb-4a27-a185-50e5751bcbce service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113604 Oct 29 02:48:54.602055 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 433/886] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:54.613040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-05355964-4a6d-4de4-bc24-0a0745ed51ff tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:54.625128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-05355964-4a6d-4de4-bc24-0a0745ed51ff tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e8dc7205-039c-480e-946f-8c396fe60b2e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:54.633709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05355964-4a6d-4de4-bc24-0a0745ed51ff tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:54.634366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05355964-4a6d-4de4-bc24-0a0745ed51ff tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:54.635133 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05355964-4a6d-4de4-bc24-0a0745ed51ff tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:54.636925 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05355964-4a6d-4de4-bc24-0a0745ed51ff tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:54.640941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05355964-4a6d-4de4-bc24-0a0745ed51ff tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:54.641720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05355964-4a6d-4de4-bc24-0a0745ed51ff tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:55.461041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fcde9f35-0eab-4950-876b-43ba87939f36 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:55.492493 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fcde9f35-0eab-4950-876b-43ba87939f36 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a" status: 200 len: 1324 microversion: 2.1 time: 1.100275 Oct 29 02:48:55.497827 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 454/887] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:54 2022] GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a => generated 1324 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:55.506618 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-efe03d26-66a5-47d9-8570-a933f99e8855 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:55.509387 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-efe03d26-66a5-47d9-8570-a933f99e8855 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:55.534427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efe03d26-66a5-47d9-8570-a933f99e8855 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:55.535207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efe03d26-66a5-47d9-8570-a933f99e8855 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:55.541713 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efe03d26-66a5-47d9-8570-a933f99e8855 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:55.543402 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efe03d26-66a5-47d9-8570-a933f99e8855 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:55.544055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efe03d26-66a5-47d9-8570-a933f99e8855 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:55.544961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efe03d26-66a5-47d9-8570-a933f99e8855 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:55.827459 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-05355964-4a6d-4de4-bc24-0a0745ed51ff tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:55.848302 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-05355964-4a6d-4de4-bc24-0a0745ed51ff tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e" status: 200 len: 1325 microversion: 2.1 time: 1.244606 Oct 29 02:48:55.849037 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 434/888] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:54 2022] GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e => generated 1325 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:55.869437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-6ac2197e-533c-4518-ac38-79f3710a173a req-78b28b42-e8ff-4f1b-b576-515e4513d00e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22", "name": "network-vif-plugged", "status": "completed", "tag": "90346241-9871-4e97-831a-37c4a0cd6c78"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:48:55.879937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-efe03d26-66a5-47d9-8570-a933f99e8855 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:55.894394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-efe03d26-66a5-47d9-8570-a933f99e8855 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:55.898319 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-efe03d26-66a5-47d9-8570-a933f99e8855 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:55.919115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-6ac2197e-533c-4518-ac38-79f3710a173a req-78b28b42-e8ff-4f1b-b576-515e4513d00e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:55.921752 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-6ac2197e-533c-4518-ac38-79f3710a173a req-78b28b42-e8ff-4f1b-b576-515e4513d00e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:55.923201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-6ac2197e-533c-4518-ac38-79f3710a173a req-78b28b42-e8ff-4f1b-b576-515e4513d00e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:55.940427 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-efe03d26-66a5-47d9-8570-a933f99e8855 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1553 microversion: 2.91 time: 0.441117 Oct 29 02:48:55.945410 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 455/889] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:55 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1553 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:55.954157 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-6ac2197e-533c-4518-ac38-79f3710a173a req-78b28b42-e8ff-4f1b-b576-515e4513d00e service nova] Creating event network-vif-plugged:90346241-9871-4e97-831a-37c4a0cd6c78 for instance 61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22 on n-h1-862967-2 Oct 29 02:48:55.969908 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-6ac2197e-533c-4518-ac38-79f3710a173a req-78b28b42-e8ff-4f1b-b576-515e4513d00e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113086 Oct 29 02:48:55.975192 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 435/890] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:48:55.977183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-888c7638-4baa-4558-9fe5-75bbca0b8fdc tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:55.977827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-888c7638-4baa-4558-9fe5-75bbca0b8fdc tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: cdd44464-a057-4ebc-bf1e-ae14f5655133] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:55.984638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fcc9718e-12a3-4d62-afbf-a23eb2b60483 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:55.994971 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fcc9718e-12a3-4d62-afbf-a23eb2b60483 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:56.020379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fcc9718e-12a3-4d62-afbf-a23eb2b60483 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:56.021790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fcc9718e-12a3-4d62-afbf-a23eb2b60483 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:56.026945 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fcc9718e-12a3-4d62-afbf-a23eb2b60483 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:56.028757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fcc9718e-12a3-4d62-afbf-a23eb2b60483 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:56.031605 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fcc9718e-12a3-4d62-afbf-a23eb2b60483 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:56.032593 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fcc9718e-12a3-4d62-afbf-a23eb2b60483 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:56.040002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-888c7638-4baa-4558-9fe5-75bbca0b8fdc tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:56.040767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-888c7638-4baa-4558-9fe5-75bbca0b8fdc tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:56.041398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-888c7638-4baa-4558-9fe5-75bbca0b8fdc tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:56.041969 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-888c7638-4baa-4558-9fe5-75bbca0b8fdc tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:56.042432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-888c7638-4baa-4558-9fe5-75bbca0b8fdc tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:56.042846 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-888c7638-4baa-4558-9fe5-75bbca0b8fdc tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:56.244846 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-888c7638-4baa-4558-9fe5-75bbca0b8fdc tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:56.262391 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-888c7638-4baa-4558-9fe5-75bbca0b8fdc tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133" status: 200 len: 1271 microversion: 2.1 time: 0.310376 Oct 29 02:48:56.268172 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 456/891] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:55 2022] GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133 => generated 1271 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:56.279382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-28ffecef-81c6-4fb9-b74e-1cc65b18bb7d tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:56.284701 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-28ffecef-81c6-4fb9-b74e-1cc65b18bb7d tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:56.301704 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28ffecef-81c6-4fb9-b74e-1cc65b18bb7d tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:56.302535 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28ffecef-81c6-4fb9-b74e-1cc65b18bb7d tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:56.303308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28ffecef-81c6-4fb9-b74e-1cc65b18bb7d tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:56.309015 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28ffecef-81c6-4fb9-b74e-1cc65b18bb7d tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:56.310322 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28ffecef-81c6-4fb9-b74e-1cc65b18bb7d tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:56.313673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28ffecef-81c6-4fb9-b74e-1cc65b18bb7d tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:57.020486 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-28ffecef-81c6-4fb9-b74e-1cc65b18bb7d tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e823b4fb116c48ea92c2d3da58e10f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a70e4fa3141bb8b667b1be8e9594b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:57.052573 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-28ffecef-81c6-4fb9-b74e-1cc65b18bb7d tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54" status: 200 len: 1371 microversion: 2.1 time: 0.780696 Oct 29 02:48:57.053324 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 457/892] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:56 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 => generated 1371 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:57.089913 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d12930b7-adbd-4dc9-b2ee-dd62cb0ca9ad tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:57.095381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d12930b7-adbd-4dc9-b2ee-dd62cb0ca9ad tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:57.119085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d12930b7-adbd-4dc9-b2ee-dd62cb0ca9ad tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:57.128592 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d12930b7-adbd-4dc9-b2ee-dd62cb0ca9ad tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:57.129516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d12930b7-adbd-4dc9-b2ee-dd62cb0ca9ad tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:57.138536 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d12930b7-adbd-4dc9-b2ee-dd62cb0ca9ad tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:57.139519 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d12930b7-adbd-4dc9-b2ee-dd62cb0ca9ad tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:57.140234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d12930b7-adbd-4dc9-b2ee-dd62cb0ca9ad tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:57.511127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:57.625827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fcc9718e-12a3-4d62-afbf-a23eb2b60483 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:57.648157 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fcc9718e-12a3-4d62-afbf-a23eb2b60483 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22" status: 200 len: 1316 microversion: 2.1 time: 1.671149 Oct 29 02:48:57.668916 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 436/893] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:55 2022] GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22 => generated 1316 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:57.677566 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ea6b7ca2-a206-4c66-af4b-fafe72ec4f37 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:57.681875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ea6b7ca2-a206-4c66-af4b-fafe72ec4f37 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e8dc7205-039c-480e-946f-8c396fe60b2e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:57.719870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea6b7ca2-a206-4c66-af4b-fafe72ec4f37 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:57.723564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea6b7ca2-a206-4c66-af4b-fafe72ec4f37 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:57.730267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea6b7ca2-a206-4c66-af4b-fafe72ec4f37 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:57.731725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea6b7ca2-a206-4c66-af4b-fafe72ec4f37 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:57.738685 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea6b7ca2-a206-4c66-af4b-fafe72ec4f37 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:57.748763 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea6b7ca2-a206-4c66-af4b-fafe72ec4f37 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:58.287619 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d12930b7-adbd-4dc9-b2ee-dd62cb0ca9ad tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:58.313818 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d12930b7-adbd-4dc9-b2ee-dd62cb0ca9ad tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a" status: 200 len: 1324 microversion: 2.1 time: 1.259120 Oct 29 02:48:58.324983 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 458/894] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:57 2022] GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a => generated 1324 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:58.347425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7ec27f7d-07d5-485a-ae95-0152a700ef08 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:58.351801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7ec27f7d-07d5-485a-ae95-0152a700ef08 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:58.384499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ec27f7d-07d5-485a-ae95-0152a700ef08 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:58.393187 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ec27f7d-07d5-485a-ae95-0152a700ef08 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:58.400715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ec27f7d-07d5-485a-ae95-0152a700ef08 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:58.404222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ec27f7d-07d5-485a-ae95-0152a700ef08 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:58.405024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ec27f7d-07d5-485a-ae95-0152a700ef08 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:58.412413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ec27f7d-07d5-485a-ae95-0152a700ef08 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:58.580102 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7ec27f7d-07d5-485a-ae95-0152a700ef08 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:58.597653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7ec27f7d-07d5-485a-ae95-0152a700ef08 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:58.610410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7ec27f7d-07d5-485a-ae95-0152a700ef08 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:58.629022 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7ec27f7d-07d5-485a-ae95-0152a700ef08 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1553 microversion: 2.91 time: 0.297127 Oct 29 02:48:58.630125 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 459/895] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:48:58 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1553 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:48:58.647123 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4aff2b3a-2aaf-4b4a-a0e8-a18b5ac0e630 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:58.660603 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4aff2b3a-2aaf-4b4a-a0e8-a18b5ac0e630 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: cdd44464-a057-4ebc-bf1e-ae14f5655133] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:58.704613 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4aff2b3a-2aaf-4b4a-a0e8-a18b5ac0e630 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:58.706862 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4aff2b3a-2aaf-4b4a-a0e8-a18b5ac0e630 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:58.710203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4aff2b3a-2aaf-4b4a-a0e8-a18b5ac0e630 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:58.715962 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4aff2b3a-2aaf-4b4a-a0e8-a18b5ac0e630 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:58.718154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4aff2b3a-2aaf-4b4a-a0e8-a18b5ac0e630 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:58.721626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4aff2b3a-2aaf-4b4a-a0e8-a18b5ac0e630 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:59.179993 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ea6b7ca2-a206-4c66-af4b-fafe72ec4f37 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:59.215082 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ea6b7ca2-a206-4c66-af4b-fafe72ec4f37 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e" status: 200 len: 1325 microversion: 2.1 time: 1.557021 Oct 29 02:48:59.229290 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 437/896] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:57 2022] GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e => generated 1325 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:59.247943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7d3adc6b-2ce6-4231-a4d7-d7dceaa35886 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:48:59.251358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7d3adc6b-2ce6-4231-a4d7-d7dceaa35886 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: 20602fbc-9893-433b-b711-3de8a31a4608] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:48:59.278703 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7d3adc6b-2ce6-4231-a4d7-d7dceaa35886 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:59.280366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7d3adc6b-2ce6-4231-a4d7-d7dceaa35886 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:59.281432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7d3adc6b-2ce6-4231-a4d7-d7dceaa35886 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:59.283000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7d3adc6b-2ce6-4231-a4d7-d7dceaa35886 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:48:59.290298 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7d3adc6b-2ce6-4231-a4d7-d7dceaa35886 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:48:59.291590 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7d3adc6b-2ce6-4231-a4d7-d7dceaa35886 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:48:59.906477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:59.941422 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7d3adc6b-2ce6-4231-a4d7-d7dceaa35886 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:48:59.947340 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=14 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:59.967857 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7d3adc6b-2ce6-4231-a4d7-d7dceaa35886 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608" status: 200 len: 1587 microversion: 2.1 time: 0.735425 Oct 29 02:48:59.967857 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 438/897] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:59 2022] GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608 => generated 1587 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:48:59.990376 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-2493af7e-3db0-4411-925a-cd3f9dee5117 req-f7def4e7-1cf6-410e-82f0-defca4ea26f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20602fbc-9893-433b-b711-3de8a31a4608", "tag": "d24e5257-2899-45fe-ad6a-690bf6e3cd60"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:00.040564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-2493af7e-3db0-4411-925a-cd3f9dee5117 req-f7def4e7-1cf6-410e-82f0-defca4ea26f5 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:00.054310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-2493af7e-3db0-4411-925a-cd3f9dee5117 req-f7def4e7-1cf6-410e-82f0-defca4ea26f5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:00.054310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-2493af7e-3db0-4411-925a-cd3f9dee5117 req-f7def4e7-1cf6-410e-82f0-defca4ea26f5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:00.095876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4aff2b3a-2aaf-4b4a-a0e8-a18b5ac0e630 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:00.107784 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-2493af7e-3db0-4411-925a-cd3f9dee5117 req-f7def4e7-1cf6-410e-82f0-defca4ea26f5 service nova] Creating event network-changed:d24e5257-2899-45fe-ad6a-690bf6e3cd60 for instance 20602fbc-9893-433b-b711-3de8a31a4608 on n-h2-862967-2 Oct 29 02:49:00.114423 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4aff2b3a-2aaf-4b4a-a0e8-a18b5ac0e630 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133" status: 200 len: 1313 microversion: 2.1 time: 1.479011 Oct 29 02:49:00.117210 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 460/898] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:48:58 2022] GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133 => generated 1313 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:00.135493 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-2493af7e-3db0-4411-925a-cd3f9dee5117 req-f7def4e7-1cf6-410e-82f0-defca4ea26f5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166704 Oct 29 02:49:00.139372 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 439/899] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:00.139868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b557dbc7-6d74-426a-a2bb-0783db7f0175 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:00.149034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b557dbc7-6d74-426a-a2bb-0783db7f0175 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:00.159882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d1cd66d3-8c7e-4f33-b021-f307685f3542 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:00.176457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b557dbc7-6d74-426a-a2bb-0783db7f0175 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:00.177290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b557dbc7-6d74-426a-a2bb-0783db7f0175 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:00.177747 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b557dbc7-6d74-426a-a2bb-0783db7f0175 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:00.183337 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b557dbc7-6d74-426a-a2bb-0783db7f0175 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:00.186117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d1cd66d3-8c7e-4f33-b021-f307685f3542 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:00.198430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b557dbc7-6d74-426a-a2bb-0783db7f0175 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:00.198430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b557dbc7-6d74-426a-a2bb-0783db7f0175 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:00.207310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1cd66d3-8c7e-4f33-b021-f307685f3542 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:00.215785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1cd66d3-8c7e-4f33-b021-f307685f3542 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:00.216637 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1cd66d3-8c7e-4f33-b021-f307685f3542 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:00.222059 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1cd66d3-8c7e-4f33-b021-f307685f3542 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:00.222910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1cd66d3-8c7e-4f33-b021-f307685f3542 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:00.223609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1cd66d3-8c7e-4f33-b021-f307685f3542 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:00.604907 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=26 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:00.696128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b557dbc7-6d74-426a-a2bb-0783db7f0175 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e823b4fb116c48ea92c2d3da58e10f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a70e4fa3141bb8b667b1be8e9594b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:00.714116 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b557dbc7-6d74-426a-a2bb-0783db7f0175 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54" status: 200 len: 1371 microversion: 2.1 time: 0.595181 Oct 29 02:49:00.728986 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 461/900] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:00 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 => generated 1371 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:00.736661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-124b8ebb-5564-4693-bf93-5eb9e1599662 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:00.738132 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-124b8ebb-5564-4693-bf93-5eb9e1599662 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:00.757632 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-124b8ebb-5564-4693-bf93-5eb9e1599662 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:00.759029 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-124b8ebb-5564-4693-bf93-5eb9e1599662 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:00.759838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-124b8ebb-5564-4693-bf93-5eb9e1599662 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:00.765965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-124b8ebb-5564-4693-bf93-5eb9e1599662 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:00.772686 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-124b8ebb-5564-4693-bf93-5eb9e1599662 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:00.773430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-124b8ebb-5564-4693-bf93-5eb9e1599662 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:00.852463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:01.006595 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d1cd66d3-8c7e-4f33-b021-f307685f3542 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:01.019305 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d1cd66d3-8c7e-4f33-b021-f307685f3542 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22" status: 200 len: 1466 microversion: 2.1 time: 0.878360 Oct 29 02:49:01.019912 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 440/901] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:00 2022] GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22 => generated 1466 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:01.036062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-06b0741b-6479-489f-9692-039fcabba163 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:01.042705 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-06b0741b-6479-489f-9692-039fcabba163 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:01.074587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06b0741b-6479-489f-9692-039fcabba163 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:01.080245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06b0741b-6479-489f-9692-039fcabba163 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:01.083276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06b0741b-6479-489f-9692-039fcabba163 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:01.084433 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06b0741b-6479-489f-9692-039fcabba163 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:01.086763 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06b0741b-6479-489f-9692-039fcabba163 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:01.087732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06b0741b-6479-489f-9692-039fcabba163 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:01.354751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-06b0741b-6479-489f-9692-039fcabba163 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:01.367790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-06b0741b-6479-489f-9692-039fcabba163 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:01.375893 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-06b0741b-6479-489f-9692-039fcabba163 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:01.392417 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-06b0741b-6479-489f-9692-039fcabba163 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1553 microversion: 2.91 time: 0.368413 Oct 29 02:49:01.393684 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 441/902] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:01 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1553 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:01.398942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-297f4d48-123b-4506-89e8-364a7f0afa68 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:01.404069 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-297f4d48-123b-4506-89e8-364a7f0afa68 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e8dc7205-039c-480e-946f-8c396fe60b2e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:01.412350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-297f4d48-123b-4506-89e8-364a7f0afa68 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:01.413986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-297f4d48-123b-4506-89e8-364a7f0afa68 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:01.414946 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-297f4d48-123b-4506-89e8-364a7f0afa68 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:01.416395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-297f4d48-123b-4506-89e8-364a7f0afa68 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:01.417481 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-297f4d48-123b-4506-89e8-364a7f0afa68 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:01.420612 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-297f4d48-123b-4506-89e8-364a7f0afa68 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:01.507699 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-124b8ebb-5564-4693-bf93-5eb9e1599662 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:01.546226 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-124b8ebb-5564-4693-bf93-5eb9e1599662 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a" status: 200 len: 1324 microversion: 2.1 time: 0.815357 Oct 29 02:49:01.553497 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 462/903] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:00 2022] GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a => generated 1324 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:01.567554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-15afda27-5500-43cf-a969-f2de97bf5837 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:01.574220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-15afda27-5500-43cf-a969-f2de97bf5837 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] [instance: 61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:01.617221 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-15afda27-5500-43cf-a969-f2de97bf5837 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:01.619253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-15afda27-5500-43cf-a969-f2de97bf5837 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:01.623237 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-15afda27-5500-43cf-a969-f2de97bf5837 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:01.627982 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-15afda27-5500-43cf-a969-f2de97bf5837 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:01.628739 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-15afda27-5500-43cf-a969-f2de97bf5837 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:01.629351 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-15afda27-5500-43cf-a969-f2de97bf5837 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:02.009714 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-15afda27-5500-43cf-a969-f2de97bf5837 tempest-ServersOnMultiNodesTest-706822108 tempest-ServersOnMultiNodesTest-706822108-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22" status: 200 len: 1617 microversion: 2.1 time: 0.454085 Oct 29 02:49:02.011141 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 463/904] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:01 2022] GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22 => generated 1617 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:02.019171 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cdf09d35-45bd-437d-82c7-a352cf39131b tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:02.020673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cdf09d35-45bd-437d-82c7-a352cf39131b tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: cdd44464-a057-4ebc-bf1e-ae14f5655133] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:02.037074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdf09d35-45bd-437d-82c7-a352cf39131b tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:02.038345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdf09d35-45bd-437d-82c7-a352cf39131b tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:02.039225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdf09d35-45bd-437d-82c7-a352cf39131b tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:02.041062 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdf09d35-45bd-437d-82c7-a352cf39131b tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:02.042209 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdf09d35-45bd-437d-82c7-a352cf39131b tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:02.043148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdf09d35-45bd-437d-82c7-a352cf39131b tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:02.390736 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cdf09d35-45bd-437d-82c7-a352cf39131b tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:02.401917 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cdf09d35-45bd-437d-82c7-a352cf39131b tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133" status: 200 len: 1313 microversion: 2.1 time: 0.389274 Oct 29 02:49:02.405640 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 464/905] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:02 2022] GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133 => generated 1313 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:02.424866 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ad6c058a-f166-4234-9739-0511d66d82df tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:02.426106 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ad6c058a-f166-4234-9739-0511d66d82df tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:02.441362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad6c058a-f166-4234-9739-0511d66d82df tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:02.443306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad6c058a-f166-4234-9739-0511d66d82df tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:02.446218 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad6c058a-f166-4234-9739-0511d66d82df tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:02.451635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad6c058a-f166-4234-9739-0511d66d82df tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:02.461429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad6c058a-f166-4234-9739-0511d66d82df tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:02.463323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad6c058a-f166-4234-9739-0511d66d82df tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:02.555941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-297f4d48-123b-4506-89e8-364a7f0afa68 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:02.571396 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-297f4d48-123b-4506-89e8-364a7f0afa68 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e" status: 200 len: 1325 microversion: 2.1 time: 1.176257 Oct 29 02:49:02.574634 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 442/906] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:01 2022] GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e => generated 1325 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:02.595446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-82ae66e4-b332-42b2-9972-4db60d76a70e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:02.596848 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-82ae66e4-b332-42b2-9972-4db60d76a70e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:02.624515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82ae66e4-b332-42b2-9972-4db60d76a70e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:02.625077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82ae66e4-b332-42b2-9972-4db60d76a70e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:02.625585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82ae66e4-b332-42b2-9972-4db60d76a70e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:02.626515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82ae66e4-b332-42b2-9972-4db60d76a70e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:02.631350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82ae66e4-b332-42b2-9972-4db60d76a70e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:02.632118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82ae66e4-b332-42b2-9972-4db60d76a70e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:02.747765 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-82ae66e4-b332-42b2-9972-4db60d76a70e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:49:02.897885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ad6c058a-f166-4234-9739-0511d66d82df tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e823b4fb116c48ea92c2d3da58e10f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a70e4fa3141bb8b667b1be8e9594b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:02.914393 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ad6c058a-f166-4234-9739-0511d66d82df tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54" status: 200 len: 1371 microversion: 2.1 time: 0.504182 Oct 29 02:49:02.916743 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 465/907] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:02 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 => generated 1371 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:02.937392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-6b68b46f-a92e-4d70-95fa-e63810283be2 req-52447a29-1108-4351-8abe-26f1e8593585 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdd44464-a057-4ebc-bf1e-ae14f5655133", "tag": "61faf7f2-1384-4049-9c66-7da84c4010cc"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:02.974043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6b68b46f-a92e-4d70-95fa-e63810283be2 req-52447a29-1108-4351-8abe-26f1e8593585 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:02.981025 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6b68b46f-a92e-4d70-95fa-e63810283be2 req-52447a29-1108-4351-8abe-26f1e8593585 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:02.982340 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6b68b46f-a92e-4d70-95fa-e63810283be2 req-52447a29-1108-4351-8abe-26f1e8593585 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:02.987350 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-82ae66e4-b332-42b2-9972-4db60d76a70e tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "DELETE /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22" status: 204 len: 0 microversion: 2.1 time: 0.403615 Oct 29 02:49:02.992882 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 443/908] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:49:02 2022] DELETE /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:49:03.010907 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c0f52275-dfa2-46f0-9e33-44f739c5f89d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:03.017682 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c0f52275-dfa2-46f0-9e33-44f739c5f89d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:03.026360 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-6b68b46f-a92e-4d70-95fa-e63810283be2 req-52447a29-1108-4351-8abe-26f1e8593585 service nova] Creating event network-changed:61faf7f2-1384-4049-9c66-7da84c4010cc for instance cdd44464-a057-4ebc-bf1e-ae14f5655133 on n-h1-862967-2 Oct 29 02:49:03.027224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0f52275-dfa2-46f0-9e33-44f739c5f89d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:03.027718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0f52275-dfa2-46f0-9e33-44f739c5f89d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:03.028150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0f52275-dfa2-46f0-9e33-44f739c5f89d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:03.028889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0f52275-dfa2-46f0-9e33-44f739c5f89d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:03.029338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0f52275-dfa2-46f0-9e33-44f739c5f89d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:03.035008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0f52275-dfa2-46f0-9e33-44f739c5f89d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:03.046829 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-6b68b46f-a92e-4d70-95fa-e63810283be2 req-52447a29-1108-4351-8abe-26f1e8593585 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125769 Oct 29 02:49:03.054022 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 466/909] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:03.069753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:03.089577 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c83e8bde-950b-4acc-88b5-8b1117b17077 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:03.091413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c83e8bde-950b-4acc-88b5-8b1117b17077 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:03.099869 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c83e8bde-950b-4acc-88b5-8b1117b17077 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:03.100767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c83e8bde-950b-4acc-88b5-8b1117b17077 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:03.101470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c83e8bde-950b-4acc-88b5-8b1117b17077 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:03.102605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c83e8bde-950b-4acc-88b5-8b1117b17077 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:03.103288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c83e8bde-950b-4acc-88b5-8b1117b17077 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:03.103919 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c83e8bde-950b-4acc-88b5-8b1117b17077 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:03.198119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c0f52275-dfa2-46f0-9e33-44f739c5f89d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:03.212328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c0f52275-dfa2-46f0-9e33-44f739c5f89d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:03.213908 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c0f52275-dfa2-46f0-9e33-44f739c5f89d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:03.224616 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c0f52275-dfa2-46f0-9e33-44f739c5f89d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1553 microversion: 2.91 time: 0.229578 Oct 29 02:49:03.232621 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 444/910] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:02 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1553 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:03.240814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-2aceb34e-26d6-4354-a3c1-1b5c05a015d6 req-d8ba78fd-0037-4b10-bb64-55d6283726d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e14d80ff-4e71-4822-917c-ee46b9c7be54", "tag": "c7e34011-b5a8-480b-8c27-6a70268c0206"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:03.261336 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-2aceb34e-26d6-4354-a3c1-1b5c05a015d6 req-d8ba78fd-0037-4b10-bb64-55d6283726d0 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:03.265132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-2aceb34e-26d6-4354-a3c1-1b5c05a015d6 req-d8ba78fd-0037-4b10-bb64-55d6283726d0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:03.270003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-2aceb34e-26d6-4354-a3c1-1b5c05a015d6 req-d8ba78fd-0037-4b10-bb64-55d6283726d0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:03.303314 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-2aceb34e-26d6-4354-a3c1-1b5c05a015d6 req-d8ba78fd-0037-4b10-bb64-55d6283726d0 service nova] Creating event network-changed:c7e34011-b5a8-480b-8c27-6a70268c0206 for instance e14d80ff-4e71-4822-917c-ee46b9c7be54 on n-h1-862967-2 Oct 29 02:49:03.316690 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-2aceb34e-26d6-4354-a3c1-1b5c05a015d6 req-d8ba78fd-0037-4b10-bb64-55d6283726d0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086228 Oct 29 02:49:03.319033 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 445/911] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:03.332274 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b8d83c86-a5b4-44d3-bdef-a8aa3d5b73b1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:03.333970 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b8d83c86-a5b4-44d3-bdef-a8aa3d5b73b1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:03.357416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b8d83c86-a5b4-44d3-bdef-a8aa3d5b73b1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:03.358225 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b8d83c86-a5b4-44d3-bdef-a8aa3d5b73b1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:03.360761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b8d83c86-a5b4-44d3-bdef-a8aa3d5b73b1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:03.363689 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b8d83c86-a5b4-44d3-bdef-a8aa3d5b73b1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:03.364424 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b8d83c86-a5b4-44d3-bdef-a8aa3d5b73b1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:03.365051 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b8d83c86-a5b4-44d3-bdef-a8aa3d5b73b1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:03.675421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b8d83c86-a5b4-44d3-bdef-a8aa3d5b73b1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:03.688773 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b8d83c86-a5b4-44d3-bdef-a8aa3d5b73b1 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22" status: 200 len: 1472 microversion: 2.1 time: 0.367035 Oct 29 02:49:03.691091 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 446/912] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:03 2022] GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22 => generated 1472 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:03.695165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ac98a29d-f495-4535-9048-9b9ebc984294 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:03.696144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ac98a29d-f495-4535-9048-9b9ebc984294 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: cdd44464-a057-4ebc-bf1e-ae14f5655133] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:03.722980 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ac98a29d-f495-4535-9048-9b9ebc984294 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:03.722980 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ac98a29d-f495-4535-9048-9b9ebc984294 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:03.722980 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ac98a29d-f495-4535-9048-9b9ebc984294 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:03.722980 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ac98a29d-f495-4535-9048-9b9ebc984294 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:03.724274 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ac98a29d-f495-4535-9048-9b9ebc984294 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:03.724274 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ac98a29d-f495-4535-9048-9b9ebc984294 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:03.909639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c83e8bde-950b-4acc-88b5-8b1117b17077 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:03.918526 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c83e8bde-950b-4acc-88b5-8b1117b17077 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a" status: 200 len: 1324 microversion: 2.1 time: 0.861853 Oct 29 02:49:03.932647 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 467/913] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:03 2022] GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a => generated 1324 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:03.939730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-33f61f9e-266f-4f03-975c-4c35777a6e57 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:03.941642 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-33f61f9e-266f-4f03-975c-4c35777a6e57 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e8dc7205-039c-480e-946f-8c396fe60b2e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:03.949373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33f61f9e-266f-4f03-975c-4c35777a6e57 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:03.950255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33f61f9e-266f-4f03-975c-4c35777a6e57 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:03.950920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33f61f9e-266f-4f03-975c-4c35777a6e57 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:03.951854 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33f61f9e-266f-4f03-975c-4c35777a6e57 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:03.952701 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33f61f9e-266f-4f03-975c-4c35777a6e57 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:03.953345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33f61f9e-266f-4f03-975c-4c35777a6e57 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:04.092798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ac98a29d-f495-4535-9048-9b9ebc984294 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:04.108585 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ac98a29d-f495-4535-9048-9b9ebc984294 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133" status: 200 len: 1313 microversion: 2.1 time: 0.417126 Oct 29 02:49:04.110354 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 447/914] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:03 2022] GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133 => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:04.120501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b3a35391-ead9-4c2a-9676-58cb9cb72559 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:04.121877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b3a35391-ead9-4c2a-9676-58cb9cb72559 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:04.140786 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3a35391-ead9-4c2a-9676-58cb9cb72559 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:04.141420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3a35391-ead9-4c2a-9676-58cb9cb72559 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:04.142137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3a35391-ead9-4c2a-9676-58cb9cb72559 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:04.143201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3a35391-ead9-4c2a-9676-58cb9cb72559 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:04.143858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3a35391-ead9-4c2a-9676-58cb9cb72559 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:04.144348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3a35391-ead9-4c2a-9676-58cb9cb72559 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:04.273483 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-33f61f9e-266f-4f03-975c-4c35777a6e57 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:04.287230 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-33f61f9e-266f-4f03-975c-4c35777a6e57 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e" status: 200 len: 1325 microversion: 2.1 time: 0.353791 Oct 29 02:49:04.288921 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 468/915] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:03 2022] GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e => generated 1325 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:04.300193 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-acdf8952-1ffe-4d3f-b118-b7a51e6aab6d req-82d86be8-0c2f-4499-849a-2772522a1c69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8dc7205-039c-480e-946f-8c396fe60b2e", "name": "network-vif-plugged", "status": "completed", "tag": "41fc280a-31f7-477c-bbd8-91c57d67e2eb"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:04.325666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-acdf8952-1ffe-4d3f-b118-b7a51e6aab6d req-82d86be8-0c2f-4499-849a-2772522a1c69 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:04.325666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-acdf8952-1ffe-4d3f-b118-b7a51e6aab6d req-82d86be8-0c2f-4499-849a-2772522a1c69 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:04.325666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-acdf8952-1ffe-4d3f-b118-b7a51e6aab6d req-82d86be8-0c2f-4499-849a-2772522a1c69 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:04.360699 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-acdf8952-1ffe-4d3f-b118-b7a51e6aab6d req-82d86be8-0c2f-4499-849a-2772522a1c69 service nova] Creating event network-vif-plugged:41fc280a-31f7-477c-bbd8-91c57d67e2eb for instance e8dc7205-039c-480e-946f-8c396fe60b2e on n-h2-862967-2 Oct 29 02:49:04.368486 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-acdf8952-1ffe-4d3f-b118-b7a51e6aab6d req-82d86be8-0c2f-4499-849a-2772522a1c69 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076133 Oct 29 02:49:04.371834 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 469/916] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:04.385783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c8a8b135-224a-461e-8237-eec4f97bf21f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:04.387001 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c8a8b135-224a-461e-8237-eec4f97bf21f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:04.428256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8a8b135-224a-461e-8237-eec4f97bf21f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:04.429093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8a8b135-224a-461e-8237-eec4f97bf21f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:04.429772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8a8b135-224a-461e-8237-eec4f97bf21f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:04.431200 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8a8b135-224a-461e-8237-eec4f97bf21f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:04.432142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8a8b135-224a-461e-8237-eec4f97bf21f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:04.433023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8a8b135-224a-461e-8237-eec4f97bf21f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:04.500191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b3a35391-ead9-4c2a-9676-58cb9cb72559 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e823b4fb116c48ea92c2d3da58e10f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a70e4fa3141bb8b667b1be8e9594b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:04.519574 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b3a35391-ead9-4c2a-9676-58cb9cb72559 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54" status: 200 len: 1371 microversion: 2.1 time: 0.407242 Oct 29 02:49:04.542256 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 448/917] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:04 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 => generated 1371 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:04.622494 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c8a8b135-224a-461e-8237-eec4f97bf21f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:04.634951 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c8a8b135-224a-461e-8237-eec4f97bf21f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:04.641285 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c8a8b135-224a-461e-8237-eec4f97bf21f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:04.654260 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c8a8b135-224a-461e-8237-eec4f97bf21f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1553 microversion: 2.91 time: 0.280686 Oct 29 02:49:04.669100 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 470/918] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:04 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1553 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:04.736330 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-23412388-dcef-4264-9d83-9a87b2a099ef tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:04.744550 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-23412388-dcef-4264-9d83-9a87b2a099ef tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:04.757602 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23412388-dcef-4264-9d83-9a87b2a099ef tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:04.758267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23412388-dcef-4264-9d83-9a87b2a099ef tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:04.759022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23412388-dcef-4264-9d83-9a87b2a099ef tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:04.770784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23412388-dcef-4264-9d83-9a87b2a099ef tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:04.771743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23412388-dcef-4264-9d83-9a87b2a099ef tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:04.772311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23412388-dcef-4264-9d83-9a87b2a099ef tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:04.962254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5ef0ca35-1963-4983-906f-b45e8aa34e37 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:04.963692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5ef0ca35-1963-4983-906f-b45e8aa34e37 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:04.991312 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ef0ca35-1963-4983-906f-b45e8aa34e37 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:05.004017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ef0ca35-1963-4983-906f-b45e8aa34e37 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:05.006131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ef0ca35-1963-4983-906f-b45e8aa34e37 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:05.021529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ef0ca35-1963-4983-906f-b45e8aa34e37 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:05.029520 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ef0ca35-1963-4983-906f-b45e8aa34e37 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:05.031079 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ef0ca35-1963-4983-906f-b45e8aa34e37 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:05.066675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-23412388-dcef-4264-9d83-9a87b2a099ef tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:05.091514 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-23412388-dcef-4264-9d83-9a87b2a099ef tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22" status: 200 len: 1472 microversion: 2.1 time: 0.363951 Oct 29 02:49:05.093034 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 449/919] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:04 2022] GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22 => generated 1472 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:49:05.157008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fed98a32-d7b9-4812-b33f-6eb5935eba65 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:05.161515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fed98a32-d7b9-4812-b33f-6eb5935eba65 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: cdd44464-a057-4ebc-bf1e-ae14f5655133] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:05.190475 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fed98a32-d7b9-4812-b33f-6eb5935eba65 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:05.190964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fed98a32-d7b9-4812-b33f-6eb5935eba65 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:05.191418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fed98a32-d7b9-4812-b33f-6eb5935eba65 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:05.201511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fed98a32-d7b9-4812-b33f-6eb5935eba65 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:05.202238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fed98a32-d7b9-4812-b33f-6eb5935eba65 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:05.202693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fed98a32-d7b9-4812-b33f-6eb5935eba65 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:05.610274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5ef0ca35-1963-4983-906f-b45e8aa34e37 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:05.640132 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5ef0ca35-1963-4983-906f-b45e8aa34e37 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a" status: 200 len: 1324 microversion: 2.1 time: 0.687258 Oct 29 02:49:05.644894 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 471/920] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:04 2022] GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a => generated 1324 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:05.649975 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-847f4030-6d16-4ce1-a1cc-7c49a46de22c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:05.650596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-847f4030-6d16-4ce1-a1cc-7c49a46de22c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e8dc7205-039c-480e-946f-8c396fe60b2e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:05.670230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-847f4030-6d16-4ce1-a1cc-7c49a46de22c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:05.671550 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-847f4030-6d16-4ce1-a1cc-7c49a46de22c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:05.672080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-847f4030-6d16-4ce1-a1cc-7c49a46de22c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:05.672890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-847f4030-6d16-4ce1-a1cc-7c49a46de22c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:05.673458 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-847f4030-6d16-4ce1-a1cc-7c49a46de22c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:05.677249 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-847f4030-6d16-4ce1-a1cc-7c49a46de22c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:05.975181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-847f4030-6d16-4ce1-a1cc-7c49a46de22c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:05.991862 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-847f4030-6d16-4ce1-a1cc-7c49a46de22c tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e" status: 200 len: 1325 microversion: 2.1 time: 0.345699 Oct 29 02:49:05.992799 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 472/921] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:05 2022] GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e => generated 1325 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:05.997652 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0b1f28f6-809c-4827-ac04-d989fec31557 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:05.998285 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0b1f28f6-809c-4827-ac04-d989fec31557 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:06.022488 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b1f28f6-809c-4827-ac04-d989fec31557 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:06.023023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b1f28f6-809c-4827-ac04-d989fec31557 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:06.023460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b1f28f6-809c-4827-ac04-d989fec31557 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:06.024243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b1f28f6-809c-4827-ac04-d989fec31557 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:06.024749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b1f28f6-809c-4827-ac04-d989fec31557 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:06.025221 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b1f28f6-809c-4827-ac04-d989fec31557 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:06.044943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fed98a32-d7b9-4812-b33f-6eb5935eba65 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:06.067664 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fed98a32-d7b9-4812-b33f-6eb5935eba65 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133" status: 200 len: 1313 microversion: 2.1 time: 0.921960 Oct 29 02:49:06.071191 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 450/922] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:05 2022] GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133 => generated 1313 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:06.098266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fa7c67b4-e394-4431-921f-d1d2f9489e61 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:06.100940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fa7c67b4-e394-4431-921f-d1d2f9489e61 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:06.130361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fa7c67b4-e394-4431-921f-d1d2f9489e61 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:06.131288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fa7c67b4-e394-4431-921f-d1d2f9489e61 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:06.132983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fa7c67b4-e394-4431-921f-d1d2f9489e61 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:06.139710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fa7c67b4-e394-4431-921f-d1d2f9489e61 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:06.139710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fa7c67b4-e394-4431-921f-d1d2f9489e61 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:06.141864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fa7c67b4-e394-4431-921f-d1d2f9489e61 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:06.286300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fa7c67b4-e394-4431-921f-d1d2f9489e61 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:06.302787 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fa7c67b4-e394-4431-921f-d1d2f9489e61 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:06.311255 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fa7c67b4-e394-4431-921f-d1d2f9489e61 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:06.324309 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fa7c67b4-e394-4431-921f-d1d2f9489e61 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1553 microversion: 2.91 time: 0.251213 Oct 29 02:49:06.327021 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0b1f28f6-809c-4827-ac04-d989fec31557 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e823b4fb116c48ea92c2d3da58e10f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a70e4fa3141bb8b667b1be8e9594b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:06.335937 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0b1f28f6-809c-4827-ac04-d989fec31557 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54" status: 200 len: 1371 microversion: 2.1 time: 0.341971 Oct 29 02:49:06.337369 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 451/923] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:06 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1553 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:06.343684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-73704149-6772-4e45-b0dd-f0ae0dbdedba tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:06.344294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-73704149-6772-4e45-b0dd-f0ae0dbdedba tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:06.352186 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 473/924] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:05 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 => generated 1371 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:06.361437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73704149-6772-4e45-b0dd-f0ae0dbdedba tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:06.361937 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73704149-6772-4e45-b0dd-f0ae0dbdedba tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:06.362409 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73704149-6772-4e45-b0dd-f0ae0dbdedba tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:06.363790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73704149-6772-4e45-b0dd-f0ae0dbdedba tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:06.364670 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73704149-6772-4e45-b0dd-f0ae0dbdedba tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:06.365231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73704149-6772-4e45-b0dd-f0ae0dbdedba tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:06.387533 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-8e1c4ff5-441b-4186-8c19-9246c961b1ad req-bbbbb3d5-e0d9-42b2-b8b9-38e7fcfa22c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3380e407-b7cb-4775-b5ed-17ef51c3764a", "name": "network-vif-plugged", "status": "completed", "tag": "d045507b-53ea-4e4f-9def-029bda6114ff"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:06.407476 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8e1c4ff5-441b-4186-8c19-9246c961b1ad req-bbbbb3d5-e0d9-42b2-b8b9-38e7fcfa22c0 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:06.407476 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8e1c4ff5-441b-4186-8c19-9246c961b1ad req-bbbbb3d5-e0d9-42b2-b8b9-38e7fcfa22c0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:06.407476 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8e1c4ff5-441b-4186-8c19-9246c961b1ad req-bbbbb3d5-e0d9-42b2-b8b9-38e7fcfa22c0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:06.429138 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-8e1c4ff5-441b-4186-8c19-9246c961b1ad req-bbbbb3d5-e0d9-42b2-b8b9-38e7fcfa22c0 service nova] Creating event network-vif-plugged:d045507b-53ea-4e4f-9def-029bda6114ff for instance 3380e407-b7cb-4775-b5ed-17ef51c3764a on n-h1-862967-2 Oct 29 02:49:06.435113 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-8e1c4ff5-441b-4186-8c19-9246c961b1ad req-bbbbb3d5-e0d9-42b2-b8b9-38e7fcfa22c0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051808 Oct 29 02:49:06.436180 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 474/925] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:06.581387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-73704149-6772-4e45-b0dd-f0ae0dbdedba tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:06.594086 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-73704149-6772-4e45-b0dd-f0ae0dbdedba tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22" status: 200 len: 1472 microversion: 2.1 time: 0.254735 Oct 29 02:49:06.610921 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 452/926] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:06 2022] GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22 => generated 1472 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:06.685179 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-80990a41-aed1-4cbe-9198-353ed4f9b7ab tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:06.686520 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-80990a41-aed1-4cbe-9198-353ed4f9b7ab tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:06.694727 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-80990a41-aed1-4cbe-9198-353ed4f9b7ab tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:06.695591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-80990a41-aed1-4cbe-9198-353ed4f9b7ab tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:06.696283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-80990a41-aed1-4cbe-9198-353ed4f9b7ab tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:06.697432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-80990a41-aed1-4cbe-9198-353ed4f9b7ab tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:06.698429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-80990a41-aed1-4cbe-9198-353ed4f9b7ab tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:06.699261 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-80990a41-aed1-4cbe-9198-353ed4f9b7ab tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:07.025899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-22d94280-06a9-415a-8eec-ca83baec15df tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:07.027657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-22d94280-06a9-415a-8eec-ca83baec15df tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e8dc7205-039c-480e-946f-8c396fe60b2e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:07.054939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22d94280-06a9-415a-8eec-ca83baec15df tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:07.057085 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22d94280-06a9-415a-8eec-ca83baec15df tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:07.061613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22d94280-06a9-415a-8eec-ca83baec15df tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:07.066302 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22d94280-06a9-415a-8eec-ca83baec15df tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:07.067351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22d94280-06a9-415a-8eec-ca83baec15df tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:07.069337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22d94280-06a9-415a-8eec-ca83baec15df tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:07.113656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-80990a41-aed1-4cbe-9198-353ed4f9b7ab tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:07.123301 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-80990a41-aed1-4cbe-9198-353ed4f9b7ab tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a" status: 200 len: 1324 microversion: 2.1 time: 0.443295 Oct 29 02:49:07.147309 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 475/927] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:06 2022] GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a => generated 1324 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:07.165004 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-92ec236f-38a7-4154-a283-daff8c9923ea req-f7f240ba-7b6d-45c5-85a8-9f1159063787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22", "name": "network-vif-deleted", "tag": "90346241-9871-4e97-831a-37c4a0cd6c78"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:07.206335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-92ec236f-38a7-4154-a283-daff8c9923ea req-f7f240ba-7b6d-45c5-85a8-9f1159063787 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:07.206796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-92ec236f-38a7-4154-a283-daff8c9923ea req-f7f240ba-7b6d-45c5-85a8-9f1159063787 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:07.207248 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-92ec236f-38a7-4154-a283-daff8c9923ea req-f7f240ba-7b6d-45c5-85a8-9f1159063787 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:07.312844 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-92ec236f-38a7-4154-a283-daff8c9923ea req-f7f240ba-7b6d-45c5-85a8-9f1159063787 service nova] Creating event network-vif-deleted:90346241-9871-4e97-831a-37c4a0cd6c78 for instance 61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22 on n-h1-862967-2 Oct 29 02:49:07.366424 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-92ec236f-38a7-4154-a283-daff8c9923ea req-f7f240ba-7b6d-45c5-85a8-9f1159063787 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211511 Oct 29 02:49:07.378562 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 476/928] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:07.416803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c28f3169-28fe-4164-8e03-cb10ab4d1b5f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:07.421475 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c28f3169-28fe-4164-8e03-cb10ab4d1b5f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: cdd44464-a057-4ebc-bf1e-ae14f5655133] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:07.428843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:07.481697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c28f3169-28fe-4164-8e03-cb10ab4d1b5f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:07.485781 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c28f3169-28fe-4164-8e03-cb10ab4d1b5f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:07.486884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c28f3169-28fe-4164-8e03-cb10ab4d1b5f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:07.498546 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c28f3169-28fe-4164-8e03-cb10ab4d1b5f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:07.506805 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c28f3169-28fe-4164-8e03-cb10ab4d1b5f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:07.509610 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c28f3169-28fe-4164-8e03-cb10ab4d1b5f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:08.225719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c28f3169-28fe-4164-8e03-cb10ab4d1b5f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:08.255812 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c28f3169-28fe-4164-8e03-cb10ab4d1b5f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133" status: 200 len: 1313 microversion: 2.1 time: 0.862723 Oct 29 02:49:08.265650 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 477/929] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:07 2022] GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133 => generated 1313 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:08.271586 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e061de25-dd3e-43e6-a8cf-274c0d203f2a tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:08.277788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e061de25-dd3e-43e6-a8cf-274c0d203f2a tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:08.304973 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e061de25-dd3e-43e6-a8cf-274c0d203f2a tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:08.306255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e061de25-dd3e-43e6-a8cf-274c0d203f2a tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:08.307039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e061de25-dd3e-43e6-a8cf-274c0d203f2a tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:08.312689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e061de25-dd3e-43e6-a8cf-274c0d203f2a tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:08.314149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e061de25-dd3e-43e6-a8cf-274c0d203f2a tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:08.315103 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e061de25-dd3e-43e6-a8cf-274c0d203f2a tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:08.380428 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-22d94280-06a9-415a-8eec-ca83baec15df tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:08.404401 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-22d94280-06a9-415a-8eec-ca83baec15df tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e" status: 200 len: 1521 microversion: 2.1 time: 1.385810 Oct 29 02:49:08.407997 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 453/930] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:07 2022] GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e => generated 1521 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:08.430803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-75d3d93d-72ac-4625-b3de-a164208e2fe4 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:08.431430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-75d3d93d-72ac-4625-b3de-a164208e2fe4 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:08.445843 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-75d3d93d-72ac-4625-b3de-a164208e2fe4 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:08.446602 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-75d3d93d-72ac-4625-b3de-a164208e2fe4 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:08.447065 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-75d3d93d-72ac-4625-b3de-a164208e2fe4 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:08.447749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-75d3d93d-72ac-4625-b3de-a164208e2fe4 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:08.448203 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-75d3d93d-72ac-4625-b3de-a164208e2fe4 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:08.448655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-75d3d93d-72ac-4625-b3de-a164208e2fe4 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:08.611690 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-75d3d93d-72ac-4625-b3de-a164208e2fe4 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:08.627697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-75d3d93d-72ac-4625-b3de-a164208e2fe4 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:08.632602 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-75d3d93d-72ac-4625-b3de-a164208e2fe4 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:08.675815 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-75d3d93d-72ac-4625-b3de-a164208e2fe4 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1553 microversion: 2.91 time: 0.226681 Oct 29 02:49:08.693884 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 454/931] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:08 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1553 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:08.724748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fd0fb3db-18d1-4d52-b503-13a813fe4416 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:08.726155 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fd0fb3db-18d1-4d52-b503-13a813fe4416 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:08.738159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd0fb3db-18d1-4d52-b503-13a813fe4416 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:08.739266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd0fb3db-18d1-4d52-b503-13a813fe4416 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:08.740039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd0fb3db-18d1-4d52-b503-13a813fe4416 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:08.741329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd0fb3db-18d1-4d52-b503-13a813fe4416 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:08.742133 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd0fb3db-18d1-4d52-b503-13a813fe4416 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:08.742898 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd0fb3db-18d1-4d52-b503-13a813fe4416 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:08.795527 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e061de25-dd3e-43e6-a8cf-274c0d203f2a tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e823b4fb116c48ea92c2d3da58e10f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a70e4fa3141bb8b667b1be8e9594b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:08.808984 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e061de25-dd3e-43e6-a8cf-274c0d203f2a tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54" status: 200 len: 1371 microversion: 2.1 time: 0.541168 Oct 29 02:49:08.827633 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 478/932] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:08 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 => generated 1371 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:08.829241 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd0fb3db-18d1-4d52-b503-13a813fe4416 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:08.829739 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd0fb3db-18d1-4d52-b503-13a813fe4416 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:08.830181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd0fb3db-18d1-4d52-b503-13a813fe4416 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:08.830665 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-fd0fb3db-18d1-4d52-b503-13a813fe4416 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lazy-loading 'fault' on Instance uuid 61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:49:08.840268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-224a20c5-2618-4afa-8799-1e32111038ec tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:08.841646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-224a20c5-2618-4afa-8799-1e32111038ec tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:08.857597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-224a20c5-2618-4afa-8799-1e32111038ec tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:08.858151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-224a20c5-2618-4afa-8799-1e32111038ec tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:08.858581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-224a20c5-2618-4afa-8799-1e32111038ec tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:08.859307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-224a20c5-2618-4afa-8799-1e32111038ec tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:08.859753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-224a20c5-2618-4afa-8799-1e32111038ec tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:08.860171 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-224a20c5-2618-4afa-8799-1e32111038ec tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:08.907801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fd0fb3db-18d1-4d52-b503-13a813fe4416 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:08.917289 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fd0fb3db-18d1-4d52-b503-13a813fe4416 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22" status: 200 len: 1306 microversion: 2.1 time: 0.221787 Oct 29 02:49:08.933209 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 455/933] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:08 2022] GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22 => generated 1306 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:08.940903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8066abd9-df11-480c-a47f-a926486db73b tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:08.941411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8066abd9-df11-480c-a47f-a926486db73b tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e8dc7205-039c-480e-946f-8c396fe60b2e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:08.948358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8066abd9-df11-480c-a47f-a926486db73b tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:08.948957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8066abd9-df11-480c-a47f-a926486db73b tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:08.949430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8066abd9-df11-480c-a47f-a926486db73b tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:08.950199 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8066abd9-df11-480c-a47f-a926486db73b tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:08.950692 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8066abd9-df11-480c-a47f-a926486db73b tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:08.951147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8066abd9-df11-480c-a47f-a926486db73b tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:09.033021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8066abd9-df11-480c-a47f-a926486db73b tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e8dc7205-039c-480e-946f-8c396fe60b2e] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:49:09.164092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-224a20c5-2618-4afa-8799-1e32111038ec tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:09.204652 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-224a20c5-2618-4afa-8799-1e32111038ec tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a" status: 200 len: 1324 microversion: 2.1 time: 0.371074 Oct 29 02:49:09.206915 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 479/934] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:08 2022] GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a => generated 1324 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:09.250989 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8066abd9-df11-480c-a47f-a926486db73b tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e" status: 204 len: 0 microversion: 2.1 time: 0.315629 Oct 29 02:49:09.260758 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 456/935] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:49:08 2022] DELETE /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:49:09.268742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-05e46429-ec5c-4785-b977-4217a499bb7f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:09.280705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-05e46429-ec5c-4785-b977-4217a499bb7f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e8dc7205-039c-480e-946f-8c396fe60b2e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:09.317669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-49964bf2-5551-428a-8311-bcec22a7fba1 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:09.318530 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05e46429-ec5c-4785-b977-4217a499bb7f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:09.319916 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05e46429-ec5c-4785-b977-4217a499bb7f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:09.321298 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05e46429-ec5c-4785-b977-4217a499bb7f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:09.322023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05e46429-ec5c-4785-b977-4217a499bb7f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:09.322702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05e46429-ec5c-4785-b977-4217a499bb7f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:09.323446 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05e46429-ec5c-4785-b977-4217a499bb7f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:09.334042 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-49964bf2-5551-428a-8311-bcec22a7fba1 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: cdd44464-a057-4ebc-bf1e-ae14f5655133] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:09.367903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-49964bf2-5551-428a-8311-bcec22a7fba1 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:09.372096 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-49964bf2-5551-428a-8311-bcec22a7fba1 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:09.375271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-49964bf2-5551-428a-8311-bcec22a7fba1 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:09.376581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-49964bf2-5551-428a-8311-bcec22a7fba1 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:09.383083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-49964bf2-5551-428a-8311-bcec22a7fba1 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:09.384312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-49964bf2-5551-428a-8311-bcec22a7fba1 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:09.995894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-49964bf2-5551-428a-8311-bcec22a7fba1 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:10.035888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-05e46429-ec5c-4785-b977-4217a499bb7f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:10.044620 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-49964bf2-5551-428a-8311-bcec22a7fba1 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133" status: 200 len: 1313 microversion: 2.1 time: 0.719524 Oct 29 02:49:10.052639 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 457/936] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:09 2022] GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133 => generated 1313 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:10.098000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-185bb9ea-0916-4821-bd9a-3621b2dd2106 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:10.116553 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-05e46429-ec5c-4785-b977-4217a499bb7f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e" status: 200 len: 1527 microversion: 2.1 time: 0.853719 Oct 29 02:49:10.123495 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-185bb9ea-0916-4821-bd9a-3621b2dd2106 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:10.140557 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 480/937] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:09 2022] GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e => generated 1527 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:10.151577 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0a1f0f8c-10ea-48b2-b560-df10142dccbe tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:10.157773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0a1f0f8c-10ea-48b2-b560-df10142dccbe tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:10.162731 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-185bb9ea-0916-4821-bd9a-3621b2dd2106 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:10.163379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-185bb9ea-0916-4821-bd9a-3621b2dd2106 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:10.170176 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-185bb9ea-0916-4821-bd9a-3621b2dd2106 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:10.173731 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-185bb9ea-0916-4821-bd9a-3621b2dd2106 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:10.174507 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-185bb9ea-0916-4821-bd9a-3621b2dd2106 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:10.185762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-185bb9ea-0916-4821-bd9a-3621b2dd2106 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:10.194349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a1f0f8c-10ea-48b2-b560-df10142dccbe tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:10.197427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a1f0f8c-10ea-48b2-b560-df10142dccbe tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:10.197970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a1f0f8c-10ea-48b2-b560-df10142dccbe tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:10.198753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a1f0f8c-10ea-48b2-b560-df10142dccbe tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:10.203166 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a1f0f8c-10ea-48b2-b560-df10142dccbe tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:10.203775 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a1f0f8c-10ea-48b2-b560-df10142dccbe tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:10.258048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:10.463390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-185bb9ea-0916-4821-bd9a-3621b2dd2106 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:10.474917 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-185bb9ea-0916-4821-bd9a-3621b2dd2106 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:10.487848 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-185bb9ea-0916-4821-bd9a-3621b2dd2106 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:10.499358 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-185bb9ea-0916-4821-bd9a-3621b2dd2106 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1553 microversion: 2.91 time: 0.444940 Oct 29 02:49:10.521427 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 458/938] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:10 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1553 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:10.557604 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-79e543a1-894a-4c5a-9ba8-5dda044848c3 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:10.558293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-79e543a1-894a-4c5a-9ba8-5dda044848c3 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:10.577827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79e543a1-894a-4c5a-9ba8-5dda044848c3 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:10.583254 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79e543a1-894a-4c5a-9ba8-5dda044848c3 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:10.584077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79e543a1-894a-4c5a-9ba8-5dda044848c3 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:10.586483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79e543a1-894a-4c5a-9ba8-5dda044848c3 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:10.589595 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79e543a1-894a-4c5a-9ba8-5dda044848c3 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:10.590212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79e543a1-894a-4c5a-9ba8-5dda044848c3 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:10.652741 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-79e543a1-894a-4c5a-9ba8-5dda044848c3 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] HTTP exception thrown: Instance 61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22 could not be found. Oct 29 02:49:10.659288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-79e543a1-894a-4c5a-9ba8-5dda044848c3 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Request method failure captured: Oct 29 02:49:10.659288 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22 HTTP/1.1 Oct 29 02:49:10.659288 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:49:10.659288 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:49:10.659288 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:49:10.659288 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:49:10.659288 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:49:10.659288 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:49:10.659288 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:49:10.659288 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:10.659288 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPtIMVuxUQ5sESBGcpDIyg0JlWGhaenNyoF1KsslH7tI-Ide1t1Qc6YWBoCicDg4iK9BWmVgzBvHQx10NYcQWd4V883MefaFkAV2l76Vzo9g4yJTR39I57-5iCCl5el4McwVe4d-eqtN30on7NVpVe0PpaW9_bFKynEcnhRDBRUQ1A Oct 29 02:49:10.659288 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:49:10.659288 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:49:10.659288 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:49:10.659288 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:49:10.659288 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:49:10.659288 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:49:10.659288 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: dcc6da8e69e041e19023a53a23e33393 Oct 29 02:49:10.659288 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersOnMultiNodesTest-354009816 Oct 29 02:49:10.659288 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:49:10.659288 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:49:10.661476 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dcc6da8e69e041e19023a53a23e33393"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dcc6da8e69e041e19023a53a23e33393"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_dcc6da8e69e041e19023a53a23e33393"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/dcc6da8e69e041e19023a53a23e33393"}]}] Oct 29 02:49:10.661476 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersOnMultiNodesTest-354009816 Oct 29 02:49:10.661476 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: dcc6da8e69e041e19023a53a23e33393 Oct 29 02:49:10.661476 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-354009816 Oct 29 02:49:10.661476 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersOnMultiNodesTest-354009816-project Oct 29 02:49:10.661476 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:49:10.661476 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:49:10.661476 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 509ce04aeb3847f084629201bd7ae5d6 Oct 29 02:49:10.661476 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersOnMultiNodesTest-354009816-project Oct 29 02:49:10.661476 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:49:10.661476 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22 could not be found. Oct 29 02:49:10.661476 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22'} Oct 29 02:49:10.663051 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:10.663051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:10.663051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:49:10.663051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:49:10.663051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:49:10.663051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:49:10.663051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:49:10.663051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:49:10.663051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:49:10.663051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:49:10.663051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22 could not be found. Oct 29 02:49:10.663051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:10.663051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:10.663051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:10.663051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:10.663051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:10.663051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:10.663051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:10.663051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:10.663051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:10.666145 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:10.666145 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:49:10.666145 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:49:10.666145 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:49:10.666145 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:49:10.666145 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:49:10.666145 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:49:10.666145 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22 could not be found. Oct 29 02:49:10.666145 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:10.666145 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:10.666145 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:10.666145 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:10.666145 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:10.666145 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:10.666145 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:10.666145 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:10.666145 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22 could not be found. Oct 29 02:49:10.666145 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:10.668693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-79e543a1-894a-4c5a-9ba8-5dda044848c3 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Returning 404 to user: Instance 61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:10.668693 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-79e543a1-894a-4c5a-9ba8-5dda044848c3 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22" status: 404 len: 111 microversion: 2.1 time: 0.142521 Oct 29 02:49:10.670052 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 459/939] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:10 2022] GET /compute/v2.1/servers/61fdacc8-f7f9-4fcd-bef8-fe2ade17ad22 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:10.681945 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9ffc57bc-4568-4ef3-ba2d-edcf3f2d87e6 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:10.682778 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9ffc57bc-4568-4ef3-ba2d-edcf3f2d87e6 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:10.700426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ffc57bc-4568-4ef3-ba2d-edcf3f2d87e6 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:10.702664 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ffc57bc-4568-4ef3-ba2d-edcf3f2d87e6 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:10.706966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ffc57bc-4568-4ef3-ba2d-edcf3f2d87e6 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:10.708816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ffc57bc-4568-4ef3-ba2d-edcf3f2d87e6 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:10.709564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ffc57bc-4568-4ef3-ba2d-edcf3f2d87e6 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:10.710140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ffc57bc-4568-4ef3-ba2d-edcf3f2d87e6 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:10.763189 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0a1f0f8c-10ea-48b2-b560-df10142dccbe tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e823b4fb116c48ea92c2d3da58e10f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a70e4fa3141bb8b667b1be8e9594b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:10.776720 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0a1f0f8c-10ea-48b2-b560-df10142dccbe tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54" status: 200 len: 1371 microversion: 2.1 time: 0.647316 Oct 29 02:49:10.792551 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 481/940] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:10 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 => generated 1371 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:10.792551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-06066a04-19db-4759-a45c-3d406e4c59b9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:10.792551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-06066a04-19db-4759-a45c-3d406e4c59b9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: e739833b-0b44-40c0-880d-59223a63b7b8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:10.792960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:10.794312 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06066a04-19db-4759-a45c-3d406e4c59b9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:10.794834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06066a04-19db-4759-a45c-3d406e4c59b9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:10.795292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06066a04-19db-4759-a45c-3d406e4c59b9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:10.796003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06066a04-19db-4759-a45c-3d406e4c59b9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:10.796455 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06066a04-19db-4759-a45c-3d406e4c59b9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:10.796908 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06066a04-19db-4759-a45c-3d406e4c59b9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:10.833109 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-06066a04-19db-4759-a45c-3d406e4c59b9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: e739833b-0b44-40c0-880d-59223a63b7b8] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:49:10.961635 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-06066a04-19db-4759-a45c-3d406e4c59b9 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8" status: 204 len: 0 microversion: 2.1 time: 0.178271 Oct 29 02:49:10.968026 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 482/941] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:49:10 2022] DELETE /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:49:10.980450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9a98a5da-ea40-42b2-a170-feb3977a64db tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:10.981307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9a98a5da-ea40-42b2-a170-feb3977a64db tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: e739833b-0b44-40c0-880d-59223a63b7b8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:10.991282 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a98a5da-ea40-42b2-a170-feb3977a64db tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:10.991887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a98a5da-ea40-42b2-a170-feb3977a64db tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:10.992377 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a98a5da-ea40-42b2-a170-feb3977a64db tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:10.993401 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a98a5da-ea40-42b2-a170-feb3977a64db tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:10.996263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a98a5da-ea40-42b2-a170-feb3977a64db tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:10.997090 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a98a5da-ea40-42b2-a170-feb3977a64db tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:11.331149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9a98a5da-ea40-42b2-a170-feb3977a64db tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:11.351215 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9a98a5da-ea40-42b2-a170-feb3977a64db tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8" status: 200 len: 1473 microversion: 2.1 time: 0.379157 Oct 29 02:49:11.364303 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 483/942] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:10 2022] GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8 => generated 1473 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:11.379783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6b364c6e-b99a-45f9-b188-5264146a288d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:11.380958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6b364c6e-b99a-45f9-b188-5264146a288d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: cdd44464-a057-4ebc-bf1e-ae14f5655133] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:11.394982 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b364c6e-b99a-45f9-b188-5264146a288d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:11.401021 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b364c6e-b99a-45f9-b188-5264146a288d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:11.403161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b364c6e-b99a-45f9-b188-5264146a288d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:11.405499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b364c6e-b99a-45f9-b188-5264146a288d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:11.406312 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b364c6e-b99a-45f9-b188-5264146a288d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:11.406871 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b364c6e-b99a-45f9-b188-5264146a288d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:11.471942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9ffc57bc-4568-4ef3-ba2d-edcf3f2d87e6 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:11.503012 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9ffc57bc-4568-4ef3-ba2d-edcf3f2d87e6 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a" status: 200 len: 1519 microversion: 2.1 time: 0.830621 Oct 29 02:49:11.509793 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 460/943] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:10 2022] GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a => generated 1519 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:11.539218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-46e38dec-2a9d-4653-afee-952941e60c98 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:11.541338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-46e38dec-2a9d-4653-afee-952941e60c98 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e8dc7205-039c-480e-946f-8c396fe60b2e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:11.579070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46e38dec-2a9d-4653-afee-952941e60c98 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:11.579696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46e38dec-2a9d-4653-afee-952941e60c98 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:11.580495 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46e38dec-2a9d-4653-afee-952941e60c98 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:11.593512 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46e38dec-2a9d-4653-afee-952941e60c98 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:11.593512 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46e38dec-2a9d-4653-afee-952941e60c98 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:11.593512 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46e38dec-2a9d-4653-afee-952941e60c98 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:11.837225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6b364c6e-b99a-45f9-b188-5264146a288d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:11.852779 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6b364c6e-b99a-45f9-b188-5264146a288d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133" status: 200 len: 1313 microversion: 2.1 time: 0.485690 Oct 29 02:49:11.854099 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 484/944] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:11 2022] GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133 => generated 1313 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:11.861810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d154ddff-7273-49d5-b2cc-66164d2b45cc tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Action: 'create', calling method: .version_select at 0x7ff053d6fee0>, body: {"pool": null} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:11.982564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-46e38dec-2a9d-4653-afee-952941e60c98 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:12.000435 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-46e38dec-2a9d-4653-afee-952941e60c98 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e" status: 200 len: 1527 microversion: 2.1 time: 0.488969 Oct 29 02:49:12.012656 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 461/945] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:11 2022] GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e => generated 1527 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:12.012656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fbddeef0-fbfb-4d5e-8e36-43a7db96176c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:12.012656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fbddeef0-fbfb-4d5e-8e36-43a7db96176c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:12.031053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbddeef0-fbfb-4d5e-8e36-43a7db96176c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:12.031578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbddeef0-fbfb-4d5e-8e36-43a7db96176c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:12.035408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbddeef0-fbfb-4d5e-8e36-43a7db96176c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:12.035408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbddeef0-fbfb-4d5e-8e36-43a7db96176c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:12.038285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbddeef0-fbfb-4d5e-8e36-43a7db96176c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:12.038285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbddeef0-fbfb-4d5e-8e36-43a7db96176c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:12.145452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fbddeef0-fbfb-4d5e-8e36-43a7db96176c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:12.155691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fbddeef0-fbfb-4d5e-8e36-43a7db96176c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:12.164208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fbddeef0-fbfb-4d5e-8e36-43a7db96176c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:12.180242 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fbddeef0-fbfb-4d5e-8e36-43a7db96176c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1553 microversion: 2.91 time: 0.176512 Oct 29 02:49:12.181404 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 462/946] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:12 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1553 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:12.191939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-d368bee7-6d10-41ef-8f5f-528d7e6d8dd5 req-ff93c5c2-2904-423c-b851-cb3ae4bac3fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd44464-a057-4ebc-bf1e-ae14f5655133", "name": "network-vif-plugged", "status": "completed", "tag": "61faf7f2-1384-4049-9c66-7da84c4010cc"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:12.211292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d368bee7-6d10-41ef-8f5f-528d7e6d8dd5 req-ff93c5c2-2904-423c-b851-cb3ae4bac3fb service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:12.211855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d368bee7-6d10-41ef-8f5f-528d7e6d8dd5 req-ff93c5c2-2904-423c-b851-cb3ae4bac3fb service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:12.212510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d368bee7-6d10-41ef-8f5f-528d7e6d8dd5 req-ff93c5c2-2904-423c-b851-cb3ae4bac3fb service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:12.260117 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-d368bee7-6d10-41ef-8f5f-528d7e6d8dd5 req-ff93c5c2-2904-423c-b851-cb3ae4bac3fb service nova] Creating event network-vif-plugged:61faf7f2-1384-4049-9c66-7da84c4010cc for instance cdd44464-a057-4ebc-bf1e-ae14f5655133 on n-h1-862967-2 Oct 29 02:49:12.274619 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-d368bee7-6d10-41ef-8f5f-528d7e6d8dd5 req-ff93c5c2-2904-423c-b851-cb3ae4bac3fb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091620 Oct 29 02:49:12.275472 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 463/947] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:12.286700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0ec6e3cd-521f-4e8a-a1f5-f86ec9fecd15 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:12.287342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0ec6e3cd-521f-4e8a-a1f5-f86ec9fecd15 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:12.302201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ec6e3cd-521f-4e8a-a1f5-f86ec9fecd15 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:12.302703 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ec6e3cd-521f-4e8a-a1f5-f86ec9fecd15 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:12.303145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ec6e3cd-521f-4e8a-a1f5-f86ec9fecd15 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:12.303876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ec6e3cd-521f-4e8a-a1f5-f86ec9fecd15 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:12.305730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ec6e3cd-521f-4e8a-a1f5-f86ec9fecd15 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:12.306170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ec6e3cd-521f-4e8a-a1f5-f86ec9fecd15 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:12.864665 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0ec6e3cd-521f-4e8a-a1f5-f86ec9fecd15 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e823b4fb116c48ea92c2d3da58e10f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a70e4fa3141bb8b667b1be8e9594b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:12.879435 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0ec6e3cd-521f-4e8a-a1f5-f86ec9fecd15 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54" status: 200 len: 1371 microversion: 2.1 time: 0.594961 Oct 29 02:49:12.890829 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 464/948] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:12 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 => generated 1371 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:12.911233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-81d8a20d-e386-4eaa-9b49-f44ec797dd6d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:12.912180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-81d8a20d-e386-4eaa-9b49-f44ec797dd6d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: e739833b-0b44-40c0-880d-59223a63b7b8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:12.928652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:12.931762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81d8a20d-e386-4eaa-9b49-f44ec797dd6d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:12.932329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81d8a20d-e386-4eaa-9b49-f44ec797dd6d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:12.932929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81d8a20d-e386-4eaa-9b49-f44ec797dd6d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:12.933918 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81d8a20d-e386-4eaa-9b49-f44ec797dd6d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:12.934624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81d8a20d-e386-4eaa-9b49-f44ec797dd6d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:12.934983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81d8a20d-e386-4eaa-9b49-f44ec797dd6d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:13.244348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-81d8a20d-e386-4eaa-9b49-f44ec797dd6d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:13.255131 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-81d8a20d-e386-4eaa-9b49-f44ec797dd6d tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8" status: 200 len: 1473 microversion: 2.1 time: 0.362808 Oct 29 02:49:13.255744 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 465/949] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:12 2022] GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8 => generated 1473 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:13.262383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-78732428-0146-4a87-968c-4aaa19b1e6a2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:13.263535 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-78732428-0146-4a87-968c-4aaa19b1e6a2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: cdd44464-a057-4ebc-bf1e-ae14f5655133] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:13.276819 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78732428-0146-4a87-968c-4aaa19b1e6a2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:13.280014 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78732428-0146-4a87-968c-4aaa19b1e6a2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:13.292985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78732428-0146-4a87-968c-4aaa19b1e6a2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:13.295808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78732428-0146-4a87-968c-4aaa19b1e6a2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:13.299361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78732428-0146-4a87-968c-4aaa19b1e6a2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:13.299987 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78732428-0146-4a87-968c-4aaa19b1e6a2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:13.733965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-78732428-0146-4a87-968c-4aaa19b1e6a2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:13.747212 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-78732428-0146-4a87-968c-4aaa19b1e6a2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133" status: 200 len: 1313 microversion: 2.1 time: 0.486528 Oct 29 02:49:13.767815 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 466/950] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:13 2022] GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133 => generated 1313 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:13.776083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ed2c7915-7426-436e-89b4-6b1c2529c599 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:13.777169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ed2c7915-7426-436e-89b4-6b1c2529c599 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e8dc7205-039c-480e-946f-8c396fe60b2e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:13.832683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed2c7915-7426-436e-89b4-6b1c2529c599 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:13.841219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed2c7915-7426-436e-89b4-6b1c2529c599 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:13.843764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed2c7915-7426-436e-89b4-6b1c2529c599 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:13.846313 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed2c7915-7426-436e-89b4-6b1c2529c599 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:13.847820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed2c7915-7426-436e-89b4-6b1c2529c599 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:13.849105 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed2c7915-7426-436e-89b4-6b1c2529c599 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:13.992350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ed2c7915-7426-436e-89b4-6b1c2529c599 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:14.006058 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ed2c7915-7426-436e-89b4-6b1c2529c599 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e" status: 200 len: 1485 microversion: 2.1 time: 0.236103 Oct 29 02:49:14.007591 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 467/951] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:13 2022] GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e => generated 1485 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:14.015437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f2d8783e-365b-474e-8acb-9bffb8e001fd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:14.016712 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f2d8783e-365b-474e-8acb-9bffb8e001fd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:14.038978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2d8783e-365b-474e-8acb-9bffb8e001fd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:14.039763 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2d8783e-365b-474e-8acb-9bffb8e001fd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:14.040478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2d8783e-365b-474e-8acb-9bffb8e001fd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:14.041410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2d8783e-365b-474e-8acb-9bffb8e001fd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:14.042019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2d8783e-365b-474e-8acb-9bffb8e001fd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:14.042705 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2d8783e-365b-474e-8acb-9bffb8e001fd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:14.266478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f2d8783e-365b-474e-8acb-9bffb8e001fd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:14.284032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f2d8783e-365b-474e-8acb-9bffb8e001fd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:14.288649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f2d8783e-365b-474e-8acb-9bffb8e001fd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:14.311976 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f2d8783e-365b-474e-8acb-9bffb8e001fd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1535 microversion: 2.91 time: 0.302751 Oct 29 02:49:14.317218 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 468/952] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:14 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1535 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:14.332958 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2bedb3f0-07c3-4dad-ba91-827b7ea6bffd tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:14.334041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2bedb3f0-07c3-4dad-ba91-827b7ea6bffd tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:14.346730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2bedb3f0-07c3-4dad-ba91-827b7ea6bffd tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:14.348685 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2bedb3f0-07c3-4dad-ba91-827b7ea6bffd tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:14.351392 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2bedb3f0-07c3-4dad-ba91-827b7ea6bffd tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:14.354071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2bedb3f0-07c3-4dad-ba91-827b7ea6bffd tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:14.354652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2bedb3f0-07c3-4dad-ba91-827b7ea6bffd tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:14.355190 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2bedb3f0-07c3-4dad-ba91-827b7ea6bffd tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:14.611991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-2bedb3f0-07c3-4dad-ba91-827b7ea6bffd tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lazy-loading 'services' on Instance uuid 694141ac-c96c-409b-9eb2-831a3ccb5a68 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:49:14.627852 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2bedb3f0-07c3-4dad-ba91-827b7ea6bffd tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 2346 microversion: 2.25 time: 0.309322 Oct 29 02:49:14.629365 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 469/953] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:14 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 2346 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:14.634140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-bf31432a-3ff0-4bba-8e1c-e1f18f06176f req-d4583b9b-276c-46e3-96ed-16d102be7d80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8dc7205-039c-480e-946f-8c396fe60b2e", "name": "network-vif-deleted", "tag": "41fc280a-31f7-477c-bbd8-91c57d67e2eb"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:14.644228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-bf31432a-3ff0-4bba-8e1c-e1f18f06176f req-d4583b9b-276c-46e3-96ed-16d102be7d80 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:14.644755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-bf31432a-3ff0-4bba-8e1c-e1f18f06176f req-d4583b9b-276c-46e3-96ed-16d102be7d80 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:14.645221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-bf31432a-3ff0-4bba-8e1c-e1f18f06176f req-d4583b9b-276c-46e3-96ed-16d102be7d80 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:14.662759 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-bf31432a-3ff0-4bba-8e1c-e1f18f06176f req-d4583b9b-276c-46e3-96ed-16d102be7d80 service nova] Creating event network-vif-deleted:41fc280a-31f7-477c-bbd8-91c57d67e2eb for instance e8dc7205-039c-480e-946f-8c396fe60b2e on n-h2-862967-2 Oct 29 02:49:14.668018 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-bf31432a-3ff0-4bba-8e1c-e1f18f06176f req-d4583b9b-276c-46e3-96ed-16d102be7d80 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037978 Oct 29 02:49:14.668984 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 470/954] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:14.674499 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-227f660b-344a-48b4-af56-7e08381c54ed tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:14.675169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-227f660b-344a-48b4-af56-7e08381c54ed tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:14.682403 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-227f660b-344a-48b4-af56-7e08381c54ed tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:14.682881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-227f660b-344a-48b4-af56-7e08381c54ed tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:14.683337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-227f660b-344a-48b4-af56-7e08381c54ed tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:14.684181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-227f660b-344a-48b4-af56-7e08381c54ed tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:14.684596 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-227f660b-344a-48b4-af56-7e08381c54ed tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:14.685031 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-227f660b-344a-48b4-af56-7e08381c54ed tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:14.838972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-227f660b-344a-48b4-af56-7e08381c54ed tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e823b4fb116c48ea92c2d3da58e10f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a70e4fa3141bb8b667b1be8e9594b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:14.849434 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-227f660b-344a-48b4-af56-7e08381c54ed tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54" status: 200 len: 1371 microversion: 2.1 time: 0.179059 Oct 29 02:49:14.863220 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 471/955] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:14 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:14.869876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-923254d4-1770-430e-9268-db66d6b4bb99 req-8ac36fbd-9d7d-465e-b57b-a80bae8fb5ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e739833b-0b44-40c0-880d-59223a63b7b8", "name": "network-vif-deleted", "tag": "f56fd42b-c41b-49bf-8b75-57b4f3ebc5c4"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:14.885587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-923254d4-1770-430e-9268-db66d6b4bb99 req-8ac36fbd-9d7d-465e-b57b-a80bae8fb5ab service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:14.886393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-923254d4-1770-430e-9268-db66d6b4bb99 req-8ac36fbd-9d7d-465e-b57b-a80bae8fb5ab service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:14.886812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-923254d4-1770-430e-9268-db66d6b4bb99 req-8ac36fbd-9d7d-465e-b57b-a80bae8fb5ab service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:14.900302 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-923254d4-1770-430e-9268-db66d6b4bb99 req-8ac36fbd-9d7d-465e-b57b-a80bae8fb5ab service nova] Creating event network-vif-deleted:f56fd42b-c41b-49bf-8b75-57b4f3ebc5c4 for instance e739833b-0b44-40c0-880d-59223a63b7b8 on n-h2-862967-2 Oct 29 02:49:14.906008 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-923254d4-1770-430e-9268-db66d6b4bb99 req-8ac36fbd-9d7d-465e-b57b-a80bae8fb5ab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042189 Oct 29 02:49:14.906999 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 472/956] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:14.912657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-442890fb-eb4b-4eaa-9bf4-db0c603283f7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:14.913721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-442890fb-eb4b-4eaa-9bf4-db0c603283f7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: e739833b-0b44-40c0-880d-59223a63b7b8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:14.920688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-442890fb-eb4b-4eaa-9bf4-db0c603283f7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:14.921180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-442890fb-eb4b-4eaa-9bf4-db0c603283f7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:14.921614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-442890fb-eb4b-4eaa-9bf4-db0c603283f7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:14.922350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-442890fb-eb4b-4eaa-9bf4-db0c603283f7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:14.922953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-442890fb-eb4b-4eaa-9bf4-db0c603283f7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:14.923381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-442890fb-eb4b-4eaa-9bf4-db0c603283f7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:14.964004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-442890fb-eb4b-4eaa-9bf4-db0c603283f7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:14.964487 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-442890fb-eb4b-4eaa-9bf4-db0c603283f7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:14.965145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-442890fb-eb4b-4eaa-9bf4-db0c603283f7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:14.965599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-442890fb-eb4b-4eaa-9bf4-db0c603283f7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lazy-loading 'fault' on Instance uuid e739833b-0b44-40c0-880d-59223a63b7b8 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:49:15.016399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-442890fb-eb4b-4eaa-9bf4-db0c603283f7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:15.035481 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-442890fb-eb4b-4eaa-9bf4-db0c603283f7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8" status: 200 len: 1307 microversion: 2.1 time: 0.127130 Oct 29 02:49:15.036058 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 473/957] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:14 2022] GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8 => generated 1307 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:15.040846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a2d5a4d0-876e-4a6b-9d02-752ff651c694 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:15.044669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2d5a4d0-876e-4a6b-9d02-752ff651c694 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:15.045048 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2d5a4d0-876e-4a6b-9d02-752ff651c694 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:15.045481 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2d5a4d0-876e-4a6b-9d02-752ff651c694 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:15.046400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2d5a4d0-876e-4a6b-9d02-752ff651c694 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:15.047006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2d5a4d0-876e-4a6b-9d02-752ff651c694 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:15.047432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2d5a4d0-876e-4a6b-9d02-752ff651c694 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:15.074305 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a2d5a4d0-876e-4a6b-9d02-752ff651c694 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.036939 Oct 29 02:49:15.079743 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 474/958] 10.222.0.46 () {60 vars in 1217 bytes} [Sat Oct 29 02:49:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:49:15.081333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-49801559-0db8-4f2d-8107-ef4b0ef5673c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:15.081333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-49801559-0db8-4f2d-8107-ef4b0ef5673c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: cdd44464-a057-4ebc-bf1e-ae14f5655133] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:15.086218 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d154ddff-7273-49d5-b2cc-66164d2b45cc tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.230010 Oct 29 02:49:15.087267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-49801559-0db8-4f2d-8107-ef4b0ef5673c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:15.087787 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-49801559-0db8-4f2d-8107-ef4b0ef5673c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:15.088223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-49801559-0db8-4f2d-8107-ef4b0ef5673c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:15.088944 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-49801559-0db8-4f2d-8107-ef4b0ef5673c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:15.089405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-49801559-0db8-4f2d-8107-ef4b0ef5673c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:15.089832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-49801559-0db8-4f2d-8107-ef4b0ef5673c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:15.093016 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 485/959] 10.222.0.46 () {60 vars in 1170 bytes} [Sat Oct 29 02:49:11 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:15.101431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a79752ce-9a2b-4810-bddf-95fc5fe5ad73 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:15.102277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a79752ce-9a2b-4810-bddf-95fc5fe5ad73 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e8dc7205-039c-480e-946f-8c396fe60b2e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:15.110954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a79752ce-9a2b-4810-bddf-95fc5fe5ad73 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:15.111715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a79752ce-9a2b-4810-bddf-95fc5fe5ad73 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:15.112626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a79752ce-9a2b-4810-bddf-95fc5fe5ad73 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:15.114072 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a79752ce-9a2b-4810-bddf-95fc5fe5ad73 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:15.114401 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a79752ce-9a2b-4810-bddf-95fc5fe5ad73 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:15.114828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a79752ce-9a2b-4810-bddf-95fc5fe5ad73 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:15.163306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a79752ce-9a2b-4810-bddf-95fc5fe5ad73 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:15.163959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a79752ce-9a2b-4810-bddf-95fc5fe5ad73 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:15.165296 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a79752ce-9a2b-4810-bddf-95fc5fe5ad73 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:15.165854 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-a79752ce-9a2b-4810-bddf-95fc5fe5ad73 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lazy-loading 'fault' on Instance uuid e8dc7205-039c-480e-946f-8c396fe60b2e {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:49:15.209950 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a79752ce-9a2b-4810-bddf-95fc5fe5ad73 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:15.217905 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a79752ce-9a2b-4810-bddf-95fc5fe5ad73 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e" status: 200 len: 1315 microversion: 2.1 time: 0.123682 Oct 29 02:49:15.218485 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 486/960] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:15 2022] GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e => generated 1315 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:15.232725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a7301b54-111e-4a95-b628-04df423607db tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2024541305", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "c9c7c955-06f7-476b-b584-0d9678a745fd"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:15.234449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-49801559-0db8-4f2d-8107-ef4b0ef5673c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:15.243561 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-49801559-0db8-4f2d-8107-ef4b0ef5673c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133" status: 200 len: 1313 microversion: 2.1 time: 0.167571 Oct 29 02:49:15.244857 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 475/961] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:15 2022] GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:15.280212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-a7301b54-111e-4a95-b628-04df423607db tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] validate_networks() for [('c9c7c955-06f7-476b-b584-0d9678a745fd', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:49:15.362079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6ba709ab-7d6c-4a2c-acda-d6327788b476 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:15.362959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6ba709ab-7d6c-4a2c-acda-d6327788b476 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:15.372631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ba709ab-7d6c-4a2c-acda-d6327788b476 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:15.373112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ba709ab-7d6c-4a2c-acda-d6327788b476 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:15.373550 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ba709ab-7d6c-4a2c-acda-d6327788b476 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:15.374252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ba709ab-7d6c-4a2c-acda-d6327788b476 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:15.374702 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ba709ab-7d6c-4a2c-acda-d6327788b476 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:15.375123 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ba709ab-7d6c-4a2c-acda-d6327788b476 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:15.448259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6ba709ab-7d6c-4a2c-acda-d6327788b476 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:15.458081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6ba709ab-7d6c-4a2c-acda-d6327788b476 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:15.459515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6ba709ab-7d6c-4a2c-acda-d6327788b476 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:15.465129 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6ba709ab-7d6c-4a2c-acda-d6327788b476 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1535 microversion: 2.91 time: 0.107135 Oct 29 02:49:15.465716 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 476/962] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:15 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1535 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:49:15.707292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-a7301b54-111e-4a95-b628-04df423607db tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:49:15.707905 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-a7301b54-111e-4a95-b628-04df423607db tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:49:15.708766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-a7301b54-111e-4a95-b628-04df423607db tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:49:15.709203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-a7301b54-111e-4a95-b628-04df423607db tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:49:15.709611 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-a7301b54-111e-4a95-b628-04df423607db tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:49:15.722879 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7301b54-111e-4a95-b628-04df423607db tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:15.723658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7301b54-111e-4a95-b628-04df423607db tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:15.724259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7301b54-111e-4a95-b628-04df423607db tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:15.725426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7301b54-111e-4a95-b628-04df423607db tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:15.726273 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7301b54-111e-4a95-b628-04df423607db tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:15.727021 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7301b54-111e-4a95-b628-04df423607db tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:15.749573 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-a7301b54-111e-4a95-b628-04df423607db tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Getting quotas for project fd611070fee0435f8bdda9c3ba5d62fc. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:49:15.756107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-a7301b54-111e-4a95-b628-04df423607db tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Getting quotas for user 15a2e59fd0b244eea041651e4d79de9b and project fd611070fee0435f8bdda9c3ba5d62fc. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:49:15.771557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a7301b54-111e-4a95-b628-04df423607db tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:49:15.774068 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a7301b54-111e-4a95-b628-04df423607db tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:49:15.832571 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a7301b54-111e-4a95-b628-04df423607db tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612084 Oct 29 02:49:15.839815 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 487/963] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:49:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:49:15.847818 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a5dfa1e3-7057-4857-bc9c-b8acfc030ec5 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:15.848569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a5dfa1e3-7057-4857-bc9c-b8acfc030ec5 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:15.882046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9ed41622-68ea-49f8-9d7e-0d053137c3de tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:15.882784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9ed41622-68ea-49f8-9d7e-0d053137c3de tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:15.899064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ed41622-68ea-49f8-9d7e-0d053137c3de tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:15.899570 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ed41622-68ea-49f8-9d7e-0d053137c3de tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:15.900010 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ed41622-68ea-49f8-9d7e-0d053137c3de tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:15.900829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ed41622-68ea-49f8-9d7e-0d053137c3de tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:15.901285 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ed41622-68ea-49f8-9d7e-0d053137c3de tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:15.901712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ed41622-68ea-49f8-9d7e-0d053137c3de tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:15.926730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a5dfa1e3-7057-4857-bc9c-b8acfc030ec5 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:15.948565 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a5dfa1e3-7057-4857-bc9c-b8acfc030ec5 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88" status: 200 len: 1224 microversion: 2.1 time: 0.107403 Oct 29 02:49:15.950569 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 477/964] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:15 2022] GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88 => generated 1224 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:49:16.062703 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-11c1e04e-68b4-467e-a746-59dfd00a5610 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:16.063941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-11c1e04e-68b4-467e-a746-59dfd00a5610 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: e739833b-0b44-40c0-880d-59223a63b7b8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:16.078847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11c1e04e-68b4-467e-a746-59dfd00a5610 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:16.080196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11c1e04e-68b4-467e-a746-59dfd00a5610 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:16.082444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11c1e04e-68b4-467e-a746-59dfd00a5610 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:16.083438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11c1e04e-68b4-467e-a746-59dfd00a5610 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:16.085432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11c1e04e-68b4-467e-a746-59dfd00a5610 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:16.086720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11c1e04e-68b4-467e-a746-59dfd00a5610 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:16.196817 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11c1e04e-68b4-467e-a746-59dfd00a5610 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:16.198338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11c1e04e-68b4-467e-a746-59dfd00a5610 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:16.199714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11c1e04e-68b4-467e-a746-59dfd00a5610 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:16.201788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-11c1e04e-68b4-467e-a746-59dfd00a5610 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lazy-loading 'fault' on Instance uuid e739833b-0b44-40c0-880d-59223a63b7b8 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:49:16.223701 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9ed41622-68ea-49f8-9d7e-0d053137c3de tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e823b4fb116c48ea92c2d3da58e10f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a70e4fa3141bb8b667b1be8e9594b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:16.232760 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9ed41622-68ea-49f8-9d7e-0d053137c3de tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54" status: 200 len: 1371 microversion: 2.1 time: 0.355530 Oct 29 02:49:16.236771 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 488/965] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:15 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 => generated 1371 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:49:16.249504 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d910a021-95f3-4806-bb4e-8e11ee516785 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:16.252899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d910a021-95f3-4806-bb4e-8e11ee516785 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e8dc7205-039c-480e-946f-8c396fe60b2e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:16.264697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d910a021-95f3-4806-bb4e-8e11ee516785 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:16.266304 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d910a021-95f3-4806-bb4e-8e11ee516785 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:16.267474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d910a021-95f3-4806-bb4e-8e11ee516785 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:16.268324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d910a021-95f3-4806-bb4e-8e11ee516785 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:16.269092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d910a021-95f3-4806-bb4e-8e11ee516785 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:16.269845 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d910a021-95f3-4806-bb4e-8e11ee516785 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:16.316354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d910a021-95f3-4806-bb4e-8e11ee516785 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:16.317338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d910a021-95f3-4806-bb4e-8e11ee516785 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:16.318028 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d910a021-95f3-4806-bb4e-8e11ee516785 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:16.318850 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-d910a021-95f3-4806-bb4e-8e11ee516785 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lazy-loading 'fault' on Instance uuid e8dc7205-039c-480e-946f-8c396fe60b2e {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:49:16.374701 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d910a021-95f3-4806-bb4e-8e11ee516785 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6862cd2470624f01a8bc1d371aa03962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94814dc564d04e688714ac064c7d1b3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:16.389973 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d910a021-95f3-4806-bb4e-8e11ee516785 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e" status: 200 len: 1315 microversion: 2.1 time: 0.149734 Oct 29 02:49:16.390868 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 489/966] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:16 2022] GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:16.411835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c65f9a3a-0be3-410f-bdfd-e6373328a322 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:16.412593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c65f9a3a-0be3-410f-bdfd-e6373328a322 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: cdd44464-a057-4ebc-bf1e-ae14f5655133] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:16.419568 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c65f9a3a-0be3-410f-bdfd-e6373328a322 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:16.420057 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c65f9a3a-0be3-410f-bdfd-e6373328a322 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:16.420922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c65f9a3a-0be3-410f-bdfd-e6373328a322 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:16.421651 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c65f9a3a-0be3-410f-bdfd-e6373328a322 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:16.422653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c65f9a3a-0be3-410f-bdfd-e6373328a322 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:16.423355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c65f9a3a-0be3-410f-bdfd-e6373328a322 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:16.616346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c65f9a3a-0be3-410f-bdfd-e6373328a322 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:16.618073 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-11c1e04e-68b4-467e-a746-59dfd00a5610 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:16.631048 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-11c1e04e-68b4-467e-a746-59dfd00a5610 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8" status: 200 len: 1307 microversion: 2.1 time: 0.573516 Oct 29 02:49:16.632204 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 478/967] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:16 2022] GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8 => generated 1307 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:16.634818 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c65f9a3a-0be3-410f-bdfd-e6373328a322 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133" status: 200 len: 1313 microversion: 2.1 time: 0.227812 Oct 29 02:49:16.635619 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 490/968] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:16 2022] GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:16.661549 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ba3d5c53-f807-4490-a9b7-d7eaac8242d7 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:16.664551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ba3d5c53-f807-4490-a9b7-d7eaac8242d7 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:16.671610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba3d5c53-f807-4490-a9b7-d7eaac8242d7 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:16.672484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba3d5c53-f807-4490-a9b7-d7eaac8242d7 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:16.673303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba3d5c53-f807-4490-a9b7-d7eaac8242d7 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:16.674315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba3d5c53-f807-4490-a9b7-d7eaac8242d7 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:16.675006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba3d5c53-f807-4490-a9b7-d7eaac8242d7 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:16.675588 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba3d5c53-f807-4490-a9b7-d7eaac8242d7 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:16.756989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ba3d5c53-f807-4490-a9b7-d7eaac8242d7 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:16.760057 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=100 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:16.772381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ba3d5c53-f807-4490-a9b7-d7eaac8242d7 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:16.774155 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ba3d5c53-f807-4490-a9b7-d7eaac8242d7 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:16.782297 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ba3d5c53-f807-4490-a9b7-d7eaac8242d7 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1538 microversion: 2.91 time: 0.148768 Oct 29 02:49:16.796933 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 479/969] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:16 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1538 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:16.816159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-df2a8195-0244-48d1-9527-a4d8ba440d56 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-862967-2"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:16.820107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-df2a8195-0244-48d1-9527-a4d8ba440d56 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:16.838842 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df2a8195-0244-48d1-9527-a4d8ba440d56 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:16.839334 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df2a8195-0244-48d1-9527-a4d8ba440d56 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:16.839761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df2a8195-0244-48d1-9527-a4d8ba440d56 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:16.842038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df2a8195-0244-48d1-9527-a4d8ba440d56 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:16.842497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df2a8195-0244-48d1-9527-a4d8ba440d56 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:16.842920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df2a8195-0244-48d1-9527-a4d8ba440d56 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:16.899006 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-df2a8195-0244-48d1-9527-a4d8ba440d56 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-862967-2". {{(pid=127125) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 29 02:49:16.976317 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f0ca2448-468d-495c-a536-a998b8eda43a tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:16.976977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f0ca2448-468d-495c-a536-a998b8eda43a tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:16.983322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0ca2448-468d-495c-a536-a998b8eda43a tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:16.983806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0ca2448-468d-495c-a536-a998b8eda43a tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:16.984236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0ca2448-468d-495c-a536-a998b8eda43a tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:16.984971 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0ca2448-468d-495c-a536-a998b8eda43a tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:16.985419 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0ca2448-468d-495c-a536-a998b8eda43a tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:16.985838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0ca2448-468d-495c-a536-a998b8eda43a tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:16.991336 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-df2a8195-0244-48d1-9527-a4d8ba440d56 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186/action" status: 202 len: 0 microversion: 2.91 time: 0.182499 Oct 29 02:49:16.992505 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 491/970] 10.222.0.46 () {62 vars in 1319 bytes} [Sat Oct 29 02:49:16 2022] POST /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:49:17.007076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-91384731-5b5a-4179-b7e9-9df5a7302bb1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:17.007726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-91384731-5b5a-4179-b7e9-9df5a7302bb1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:17.017525 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91384731-5b5a-4179-b7e9-9df5a7302bb1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:17.018421 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91384731-5b5a-4179-b7e9-9df5a7302bb1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:17.019184 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91384731-5b5a-4179-b7e9-9df5a7302bb1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:17.021021 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91384731-5b5a-4179-b7e9-9df5a7302bb1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:17.022122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91384731-5b5a-4179-b7e9-9df5a7302bb1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:17.022852 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91384731-5b5a-4179-b7e9-9df5a7302bb1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:17.074027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f0ca2448-468d-495c-a536-a998b8eda43a tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:17.085733 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f0ca2448-468d-495c-a536-a998b8eda43a tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88" status: 200 len: 1220 microversion: 2.1 time: 0.113207 Oct 29 02:49:17.087024 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 480/971] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:16 2022] GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88 => generated 1220 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:17.115431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-91384731-5b5a-4179-b7e9-9df5a7302bb1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:17.124656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-91384731-5b5a-4179-b7e9-9df5a7302bb1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:17.126000 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-91384731-5b5a-4179-b7e9-9df5a7302bb1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:17.131980 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-91384731-5b5a-4179-b7e9-9df5a7302bb1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1546 microversion: 2.91 time: 0.133877 Oct 29 02:49:17.132614 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 492/972] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:16 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1546 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:49:17.259026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-95952979-a79e-483c-9f8c-2da3b6ba7c38 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:17.259897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-95952979-a79e-483c-9f8c-2da3b6ba7c38 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:17.266950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95952979-a79e-483c-9f8c-2da3b6ba7c38 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:17.267721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95952979-a79e-483c-9f8c-2da3b6ba7c38 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:17.268313 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95952979-a79e-483c-9f8c-2da3b6ba7c38 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:17.269312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95952979-a79e-483c-9f8c-2da3b6ba7c38 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:17.269973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95952979-a79e-483c-9f8c-2da3b6ba7c38 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:17.270662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95952979-a79e-483c-9f8c-2da3b6ba7c38 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:17.417074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-442de572-5350-4243-97dd-b9714beedefd tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:17.417697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-442de572-5350-4243-97dd-b9714beedefd tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e8dc7205-039c-480e-946f-8c396fe60b2e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:17.459605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-442de572-5350-4243-97dd-b9714beedefd tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:17.460352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-442de572-5350-4243-97dd-b9714beedefd tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:17.461133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-442de572-5350-4243-97dd-b9714beedefd tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:17.464714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-442de572-5350-4243-97dd-b9714beedefd tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:17.465451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-442de572-5350-4243-97dd-b9714beedefd tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:17.466053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-442de572-5350-4243-97dd-b9714beedefd tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:17.506469 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-442de572-5350-4243-97dd-b9714beedefd tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] HTTP exception thrown: Instance e8dc7205-039c-480e-946f-8c396fe60b2e could not be found. Oct 29 02:49:17.509058 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-442de572-5350-4243-97dd-b9714beedefd tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Request method failure captured: Oct 29 02:49:17.509058 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e HTTP/1.1 Oct 29 02:49:17.509058 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:49:17.509058 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:49:17.509058 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:49:17.509058 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:49:17.509058 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:49:17.509058 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:49:17.509058 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:49:17.509058 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:17.509058 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJQe_uEcQU7TWvWTWyYHk2tBfhyW3anQlq9IlbMuIEkf7vn933sPmCKARJnxQpZiUZK1LvxWi4oqgPbQrdfUsgmfgxV95FnHLrMyZSrDr2oYF-e8DjjcOj7SOyLBpFsBspJHWMF4bxtFDAQHeniPMEGa1F2s-2gEJ_CIW5xBvV79ZDc Oct 29 02:49:17.509058 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:49:17.509058 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:49:17.509058 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:49:17.509058 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:49:17.509058 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:49:17.509058 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:49:17.509058 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 94814dc564d04e688714ac064c7d1b3b Oct 29 02:49:17.509058 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:49:17.509058 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:49:17.509058 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:49:17.510625 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/94814dc564d04e688714ac064c7d1b3b"}]}] Oct 29 02:49:17.510625 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:49:17.510625 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 94814dc564d04e688714ac064c7d1b3b Oct 29 02:49:17.510625 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:49:17.510625 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ImagesOneServerNegativeTestJSON-13999867-project Oct 29 02:49:17.510625 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:49:17.510625 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:49:17.510625 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 6862cd2470624f01a8bc1d371aa03962 Oct 29 02:49:17.510625 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-13999867-project Oct 29 02:49:17.510625 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:49:17.510625 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance e8dc7205-039c-480e-946f-8c396fe60b2e could not be found. Oct 29 02:49:17.510625 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'e8dc7205-039c-480e-946f-8c396fe60b2e'} Oct 29 02:49:17.511539 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:17.511539 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:17.511539 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:49:17.511539 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:49:17.511539 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:49:17.511539 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:49:17.511539 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:49:17.511539 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:49:17.511539 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:49:17.511539 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:49:17.511539 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8dc7205-039c-480e-946f-8c396fe60b2e could not be found. Oct 29 02:49:17.511539 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.511539 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:17.511539 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.511539 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:17.511539 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:17.511539 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:17.511539 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:17.511539 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:17.511539 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:17.513767 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:17.513767 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:49:17.513767 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:49:17.513767 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:49:17.513767 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:49:17.513767 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:49:17.513767 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:49:17.513767 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8dc7205-039c-480e-946f-8c396fe60b2e could not be found. Oct 29 02:49:17.513767 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.513767 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:17.513767 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.513767 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:17.513767 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:17.513767 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:17.513767 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:17.513767 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:17.513767 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8dc7205-039c-480e-946f-8c396fe60b2e could not be found. Oct 29 02:49:17.513767 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.515255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-442de572-5350-4243-97dd-b9714beedefd tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Returning 404 to user: Instance e8dc7205-039c-480e-946f-8c396fe60b2e could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:17.515255 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-442de572-5350-4243-97dd-b9714beedefd tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e" status: 404 len: 111 microversion: 2.1 time: 0.101022 Oct 29 02:49:17.515255 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 493/973] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:17 2022] GET /compute/v2.1/servers/e8dc7205-039c-480e-946f-8c396fe60b2e => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:17.529298 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3a5eba2b-3e2c-4fe9-8ac6-530d8df3d73f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '.version_select at 0x7ff053d4aa60>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:17.584219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-95952979-a79e-483c-9f8c-2da3b6ba7c38 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e823b4fb116c48ea92c2d3da58e10f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a70e4fa3141bb8b667b1be8e9594b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:17.595151 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-95952979-a79e-483c-9f8c-2da3b6ba7c38 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54" status: 200 len: 1371 microversion: 2.1 time: 0.339947 Oct 29 02:49:17.611739 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 481/974] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:17 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 => generated 1371 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:17.615356 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-3a5eba2b-3e2c-4fe9-8ac6-530d8df3d73f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] HTTP exception thrown: Image not found. Oct 29 02:49:17.617231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3a5eba2b-3e2c-4fe9-8ac6-530d8df3d73f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Request method failure captured: Oct 29 02:49:17.617231 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/images/eba7fafd-4061-4dde-a3df-3a27da6b7b02 HTTP/1.1 Oct 29 02:49:17.617231 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:49:17.617231 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:49:17.617231 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:49:17.617231 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:49:17.617231 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:49:17.617231 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:49:17.617231 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:49:17.617231 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:17.617231 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJQe_uEcQU7TWvWTWyYHk2tBfhyW3anQlq9IlbMuIEkf7vn933sPmCKARJnxQpZiUZK1LvxWi4oqgPbQrdfUsgmfgxV95FnHLrMyZSrDr2oYF-e8DjjcOj7SOyLBpFsBspJHWMF4bxtFDAQHeniPMEGa1F2s-2gEJ_CIW5xBvV79ZDc Oct 29 02:49:17.617231 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:49:17.617231 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:49:17.617231 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:49:17.617231 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:49:17.617231 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:49:17.617231 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:49:17.617231 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 94814dc564d04e688714ac064c7d1b3b Oct 29 02:49:17.617231 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:49:17.617231 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:49:17.617231 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:49:17.619916 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/94814dc564d04e688714ac064c7d1b3b"}]}] Oct 29 02:49:17.619916 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:49:17.619916 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 94814dc564d04e688714ac064c7d1b3b Oct 29 02:49:17.619916 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:49:17.619916 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ImagesOneServerNegativeTestJSON-13999867-project Oct 29 02:49:17.619916 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:49:17.619916 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:49:17.619916 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 6862cd2470624f01a8bc1d371aa03962 Oct 29 02:49:17.619916 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-13999867-project Oct 29 02:49:17.619916 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:49:17.619916 n-d-862967-2 devstack@n-api.service[127125]: exception: Image not found. Oct 29 02:49:17.619916 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'eba7fafd-4061-4dde-a3df-3a27da6b7b02'} Oct 29 02:49:17.619916 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:17.621599 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:17.621599 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 02:49:17.621599 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 02:49:17.621599 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:49:17.621599 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:49:17.621599 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:49:17.621599 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:49:17.621599 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 02:49:17.621599 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 02:49:17.621599 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 02:49:17.621599 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 02:49:17.621599 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:49:17.621599 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:49:17.621599 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:49:17.621599 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:49:17.621599 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image eba7fafd-4061-4dde-a3df-3a27da6b7b02 to delete Oct 29 02:49:17.621599 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.621599 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:17.621599 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.623080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:17.623080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 02:49:17.623080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 02:49:17.623080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 02:49:17.623080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 02:49:17.623080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 02:49:17.623080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 02:49:17.623080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image eba7fafd-4061-4dde-a3df-3a27da6b7b02 could not be found. Oct 29 02:49:17.623080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.623080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:17.623080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.623080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:17.623080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:17.623080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:17.623080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:17.623080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:17.623080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:49:17.623080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:49:17.623080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:17.623080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:17.624268 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 02:49:17.624268 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 02:49:17.624268 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:49:17.624268 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.624268 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:17.624268 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.624268 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:17.624268 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:17.624268 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:17.624268 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:17.624268 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:17.624268 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:49:17.624268 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.624268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3a5eba2b-3e2c-4fe9-8ac6-530d8df3d73f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Returning 404 to user: Image not found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:17.624268 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3a5eba2b-3e2c-4fe9-8ac6-530d8df3d73f tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "DELETE /compute/v2.1/images/eba7fafd-4061-4dde-a3df-3a27da6b7b02" status: 404 len: 62 microversion: 2.1 time: 0.095416 Oct 29 02:49:17.627134 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 494/975] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:17 2022] DELETE /compute/v2.1/images/eba7fafd-4061-4dde-a3df-3a27da6b7b02 => generated 62 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:49:17.628144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cc746fdb-79db-4a4b-92dd-11fce0cfaefe tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:17.628453 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cc746fdb-79db-4a4b-92dd-11fce0cfaefe tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e0095403-2e07-4041-b6e1-5064132dff18] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:17.642628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc746fdb-79db-4a4b-92dd-11fce0cfaefe tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:17.643135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc746fdb-79db-4a4b-92dd-11fce0cfaefe tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:17.643644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc746fdb-79db-4a4b-92dd-11fce0cfaefe tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:17.644497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc746fdb-79db-4a4b-92dd-11fce0cfaefe tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:17.644846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc746fdb-79db-4a4b-92dd-11fce0cfaefe tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:17.645312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc746fdb-79db-4a4b-92dd-11fce0cfaefe tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:17.654727 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-36cb4b04-2491-4793-b356-a1713e5c9e41 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:17.655274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-36cb4b04-2491-4793-b356-a1713e5c9e41 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: e739833b-0b44-40c0-880d-59223a63b7b8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:17.669339 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36cb4b04-2491-4793-b356-a1713e5c9e41 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:17.669785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36cb4b04-2491-4793-b356-a1713e5c9e41 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:17.670228 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36cb4b04-2491-4793-b356-a1713e5c9e41 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:17.670946 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36cb4b04-2491-4793-b356-a1713e5c9e41 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:17.671463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36cb4b04-2491-4793-b356-a1713e5c9e41 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:17.673950 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36cb4b04-2491-4793-b356-a1713e5c9e41 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:17.696566 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-36cb4b04-2491-4793-b356-a1713e5c9e41 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] HTTP exception thrown: Instance e739833b-0b44-40c0-880d-59223a63b7b8 could not be found. Oct 29 02:49:17.698116 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-36cb4b04-2491-4793-b356-a1713e5c9e41 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Request method failure captured: Oct 29 02:49:17.698116 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8 HTTP/1.1 Oct 29 02:49:17.698116 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:49:17.698116 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:49:17.698116 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:49:17.698116 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:49:17.698116 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:49:17.698116 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:49:17.698116 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:49:17.698116 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:17.698116 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPtIMVuxUQ5sESBGcpDIyg0JlWGhaenNyoF1KsslH7tI-Ide1t1Qc6YWBoCicDg4iK9BWmVgzBvHQx10NYcQWd4V883MefaFkAV2l76Vzo9g4yJTR39I57-5iCCl5el4McwVe4d-eqtN30on7NVpVe0PpaW9_bFKynEcnhRDBRUQ1A Oct 29 02:49:17.698116 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:49:17.698116 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:49:17.698116 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:49:17.698116 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:49:17.698116 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:49:17.698116 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:49:17.698116 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: dcc6da8e69e041e19023a53a23e33393 Oct 29 02:49:17.698116 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersOnMultiNodesTest-354009816 Oct 29 02:49:17.698116 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:49:17.698116 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:49:17.699556 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dcc6da8e69e041e19023a53a23e33393"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dcc6da8e69e041e19023a53a23e33393"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_dcc6da8e69e041e19023a53a23e33393"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/dcc6da8e69e041e19023a53a23e33393"}]}] Oct 29 02:49:17.699556 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersOnMultiNodesTest-354009816 Oct 29 02:49:17.699556 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: dcc6da8e69e041e19023a53a23e33393 Oct 29 02:49:17.699556 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-354009816 Oct 29 02:49:17.699556 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersOnMultiNodesTest-354009816-project Oct 29 02:49:17.699556 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:49:17.699556 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:49:17.699556 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 509ce04aeb3847f084629201bd7ae5d6 Oct 29 02:49:17.699556 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersOnMultiNodesTest-354009816-project Oct 29 02:49:17.699556 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:49:17.699556 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance e739833b-0b44-40c0-880d-59223a63b7b8 could not be found. Oct 29 02:49:17.699556 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'e739833b-0b44-40c0-880d-59223a63b7b8'} Oct 29 02:49:17.700259 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:17.700259 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:17.700259 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:49:17.700259 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:49:17.700259 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:49:17.700259 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:49:17.700259 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:49:17.700259 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:49:17.700259 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:49:17.700259 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:49:17.700259 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e739833b-0b44-40c0-880d-59223a63b7b8 could not be found. Oct 29 02:49:17.700259 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.700259 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:17.700259 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.700259 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:17.700259 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:17.700259 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:17.700259 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:17.700259 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:17.700259 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:17.701448 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:17.701448 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:49:17.701448 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:49:17.701448 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:49:17.701448 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:49:17.701448 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:49:17.701448 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:49:17.701448 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e739833b-0b44-40c0-880d-59223a63b7b8 could not be found. Oct 29 02:49:17.701448 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.701448 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:17.701448 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.701448 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:17.701448 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:17.701448 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:17.701448 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:17.701448 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:17.701448 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e739833b-0b44-40c0-880d-59223a63b7b8 could not be found. Oct 29 02:49:17.701448 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.703838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-36cb4b04-2491-4793-b356-a1713e5c9e41 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Returning 404 to user: Instance e739833b-0b44-40c0-880d-59223a63b7b8 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:17.705360 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-cc746fdb-79db-4a4b-92dd-11fce0cfaefe tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] HTTP exception thrown: Instance e0095403-2e07-4041-b6e1-5064132dff18 could not be found. Oct 29 02:49:17.707264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cc746fdb-79db-4a4b-92dd-11fce0cfaefe tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Request method failure captured: Oct 29 02:49:17.707264 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18 HTTP/1.1 Oct 29 02:49:17.707264 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:49:17.707264 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:49:17.707264 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:49:17.707264 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:49:17.707264 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:49:17.707264 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:49:17.707264 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:49:17.707264 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:17.707264 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJQe_uEcQU7TWvWTWyYHk2tBfhyW3anQlq9IlbMuIEkf7vn933sPmCKARJnxQpZiUZK1LvxWi4oqgPbQrdfUsgmfgxV95FnHLrMyZSrDr2oYF-e8DjjcOj7SOyLBpFsBspJHWMF4bxtFDAQHeniPMEGa1F2s-2gEJ_CIW5xBvV79ZDc Oct 29 02:49:17.707264 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:49:17.707264 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:49:17.707264 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:49:17.707264 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:49:17.707264 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:49:17.707264 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:49:17.707264 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 94814dc564d04e688714ac064c7d1b3b Oct 29 02:49:17.707264 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:49:17.707264 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:49:17.707264 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:49:17.708854 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/94814dc564d04e688714ac064c7d1b3b"}]}] Oct 29 02:49:17.708854 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:49:17.708854 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 94814dc564d04e688714ac064c7d1b3b Oct 29 02:49:17.708854 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:49:17.708854 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ImagesOneServerNegativeTestJSON-13999867-project Oct 29 02:49:17.708854 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:49:17.708854 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:49:17.708854 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 6862cd2470624f01a8bc1d371aa03962 Oct 29 02:49:17.708854 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-13999867-project Oct 29 02:49:17.708854 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:49:17.708854 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance e0095403-2e07-4041-b6e1-5064132dff18 could not be found. Oct 29 02:49:17.708854 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'e0095403-2e07-4041-b6e1-5064132dff18'} Oct 29 02:49:17.709662 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:17.709662 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:17.709662 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:49:17.709662 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:49:17.709662 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:49:17.709662 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:49:17.709662 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:49:17.709662 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:49:17.709662 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:49:17.709662 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:49:17.709662 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0095403-2e07-4041-b6e1-5064132dff18 could not be found. Oct 29 02:49:17.709662 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.709662 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:17.709662 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.709662 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:17.709662 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:17.709662 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:17.709662 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:17.709662 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:17.709662 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:17.710829 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:17.710829 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:49:17.710829 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:49:17.710829 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:49:17.710829 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:49:17.710829 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:49:17.710829 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:49:17.710829 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:49:17.710829 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:49:17.710829 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0095403-2e07-4041-b6e1-5064132dff18 could not be found. Oct 29 02:49:17.710829 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.710829 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:17.710829 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.710829 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:17.710829 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:17.710829 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:17.710829 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:17.710829 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:17.710829 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0095403-2e07-4041-b6e1-5064132dff18 could not be found. Oct 29 02:49:17.710829 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.712933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cc746fdb-79db-4a4b-92dd-11fce0cfaefe tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Returning 404 to user: Instance e0095403-2e07-4041-b6e1-5064132dff18 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:17.713802 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cc746fdb-79db-4a4b-92dd-11fce0cfaefe tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18" status: 404 len: 111 microversion: 2.1 time: 0.090140 Oct 29 02:49:17.714572 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 482/976] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:49:17 2022] DELETE /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:17.720144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c5d79112-e632-49c7-a33d-ece3d96e79b3 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:17.721358 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-36cb4b04-2491-4793-b356-a1713e5c9e41 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8" status: 404 len: 111 microversion: 2.1 time: 0.070903 Oct 29 02:49:17.723074 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 495/977] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:17 2022] GET /compute/v2.1/servers/e739833b-0b44-40c0-880d-59223a63b7b8 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:17.724653 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c5d79112-e632-49c7-a33d-ece3d96e79b3 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: cdd44464-a057-4ebc-bf1e-ae14f5655133] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:17.732942 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e51104f9-9440-4b52-aeed-850151640ef2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:17.736933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e51104f9-9440-4b52-aeed-850151640ef2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: e0095403-2e07-4041-b6e1-5064132dff18] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:17.737960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5d79112-e632-49c7-a33d-ece3d96e79b3 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:17.739066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5d79112-e632-49c7-a33d-ece3d96e79b3 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:17.742128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5d79112-e632-49c7-a33d-ece3d96e79b3 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:17.744578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5d79112-e632-49c7-a33d-ece3d96e79b3 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:17.744578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5d79112-e632-49c7-a33d-ece3d96e79b3 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:17.744578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5d79112-e632-49c7-a33d-ece3d96e79b3 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:17.752066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e51104f9-9440-4b52-aeed-850151640ef2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:17.752581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e51104f9-9440-4b52-aeed-850151640ef2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:17.759433 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e51104f9-9440-4b52-aeed-850151640ef2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:17.761313 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e51104f9-9440-4b52-aeed-850151640ef2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:17.762261 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e51104f9-9440-4b52-aeed-850151640ef2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:17.764995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e51104f9-9440-4b52-aeed-850151640ef2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:17.794190 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-e51104f9-9440-4b52-aeed-850151640ef2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] HTTP exception thrown: Instance e0095403-2e07-4041-b6e1-5064132dff18 could not be found. Oct 29 02:49:17.799063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e51104f9-9440-4b52-aeed-850151640ef2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Request method failure captured: Oct 29 02:49:17.799063 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18 HTTP/1.1 Oct 29 02:49:17.799063 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:49:17.799063 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:49:17.799063 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:49:17.799063 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:49:17.799063 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:49:17.799063 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:49:17.799063 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:49:17.799063 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:17.799063 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJQe_uEcQU7TWvWTWyYHk2tBfhyW3anQlq9IlbMuIEkf7vn933sPmCKARJnxQpZiUZK1LvxWi4oqgPbQrdfUsgmfgxV95FnHLrMyZSrDr2oYF-e8DjjcOj7SOyLBpFsBspJHWMF4bxtFDAQHeniPMEGa1F2s-2gEJ_CIW5xBvV79ZDc Oct 29 02:49:17.799063 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:49:17.799063 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:49:17.799063 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:49:17.799063 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:49:17.799063 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:49:17.799063 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:49:17.799063 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 94814dc564d04e688714ac064c7d1b3b Oct 29 02:49:17.799063 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:49:17.799063 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:49:17.799063 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:49:17.800693 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/94814dc564d04e688714ac064c7d1b3b"}]}] Oct 29 02:49:17.800693 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:49:17.800693 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 94814dc564d04e688714ac064c7d1b3b Oct 29 02:49:17.800693 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:49:17.800693 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ImagesOneServerNegativeTestJSON-13999867-project Oct 29 02:49:17.800693 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:49:17.800693 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:49:17.800693 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 6862cd2470624f01a8bc1d371aa03962 Oct 29 02:49:17.800693 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-13999867-project Oct 29 02:49:17.800693 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:49:17.800693 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance e0095403-2e07-4041-b6e1-5064132dff18 could not be found. Oct 29 02:49:17.800693 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'e0095403-2e07-4041-b6e1-5064132dff18'} Oct 29 02:49:17.801593 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:17.801593 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:17.801593 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:49:17.801593 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:49:17.801593 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:49:17.801593 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:49:17.801593 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:49:17.801593 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:49:17.801593 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:49:17.801593 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:49:17.801593 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0095403-2e07-4041-b6e1-5064132dff18 could not be found. Oct 29 02:49:17.801593 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.801593 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:17.801593 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.801593 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:17.801593 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:17.801593 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:17.801593 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:17.801593 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:17.801593 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:17.802984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:17.802984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:49:17.802984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:49:17.802984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:49:17.802984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:49:17.802984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:49:17.802984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:49:17.802984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0095403-2e07-4041-b6e1-5064132dff18 could not be found. Oct 29 02:49:17.802984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.802984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:17.802984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.802984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:17.802984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:17.802984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:17.802984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:17.802984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:17.802984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0095403-2e07-4041-b6e1-5064132dff18 could not be found. Oct 29 02:49:17.802984 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:17.805508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e51104f9-9440-4b52-aeed-850151640ef2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Returning 404 to user: Instance e0095403-2e07-4041-b6e1-5064132dff18 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:17.808871 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e51104f9-9440-4b52-aeed-850151640ef2 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18" status: 404 len: 111 microversion: 2.1 time: 0.084562 Oct 29 02:49:17.811890 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 496/978] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:17 2022] GET /compute/v2.1/servers/e0095403-2e07-4041-b6e1-5064132dff18 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:17.822882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-edf30789-7a1d-4e26-95ab-d69ccd2d2cc5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:17.829252 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-edf30789-7a1d-4e26-95ab-d69ccd2d2cc5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: f8fd44ee-f170-4aba-b86d-4d096a720561] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:17.843664 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-edf30789-7a1d-4e26-95ab-d69ccd2d2cc5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:17.844557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-edf30789-7a1d-4e26-95ab-d69ccd2d2cc5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:17.845466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-edf30789-7a1d-4e26-95ab-d69ccd2d2cc5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:17.845743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-edf30789-7a1d-4e26-95ab-d69ccd2d2cc5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:17.846202 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-edf30789-7a1d-4e26-95ab-d69ccd2d2cc5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:17.846772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-edf30789-7a1d-4e26-95ab-d69ccd2d2cc5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:17.897446 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-edf30789-7a1d-4e26-95ab-d69ccd2d2cc5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: f8fd44ee-f170-4aba-b86d-4d096a720561] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:49:17.949066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c5d79112-e632-49c7-a33d-ece3d96e79b3 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:17.962937 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c5d79112-e632-49c7-a33d-ece3d96e79b3 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133" status: 200 len: 1463 microversion: 2.1 time: 0.246773 Oct 29 02:49:17.967576 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:17.977703 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 483/979] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:17 2022] GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133 => generated 1463 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:17.991966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-52d979fd-f745-474e-be37-b209b09bff01 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '.version_select at 0x7ff053fe6940>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:18.031342 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-52d979fd-f745-474e-be37-b209b09bff01 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-602620058" status: 202 len: 0 microversion: 2.1 time: 0.052330 Oct 29 02:49:18.031951 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 484/980] 10.222.0.46 () {58 vars in 1218 bytes} [Sat Oct 29 02:49:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-602620058 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:18.056291 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-edf30789-7a1d-4e26-95ab-d69ccd2d2cc5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561" status: 204 len: 0 microversion: 2.1 time: 0.242700 Oct 29 02:49:18.068615 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 497/981] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:49:17 2022] DELETE /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:49:18.085713 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bbee517c-b665-46e0-ab13-00b3144a3890 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:18.094745 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bbee517c-b665-46e0-ab13-00b3144a3890 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: f8fd44ee-f170-4aba-b86d-4d096a720561] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:18.102878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bbee517c-b665-46e0-ab13-00b3144a3890 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:18.103554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bbee517c-b665-46e0-ab13-00b3144a3890 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:18.104169 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bbee517c-b665-46e0-ab13-00b3144a3890 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:18.105064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bbee517c-b665-46e0-ab13-00b3144a3890 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:18.105672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bbee517c-b665-46e0-ab13-00b3144a3890 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:18.106585 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bbee517c-b665-46e0-ab13-00b3144a3890 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:18.228574 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-77a753bf-e2b1-4bf0-8f15-d1f7005332c7 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:18.234361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-77a753bf-e2b1-4bf0-8f15-d1f7005332c7 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Searching by: {'deleted': False, 'project_id': 'ce3aa0b46e6d45bb9270b5eff86e8386'} {{(pid=127124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:49:18.261707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-77a753bf-e2b1-4bf0-8f15-d1f7005332c7 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:18.262201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-77a753bf-e2b1-4bf0-8f15-d1f7005332c7 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:18.262641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-77a753bf-e2b1-4bf0-8f15-d1f7005332c7 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:18.264899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-77a753bf-e2b1-4bf0-8f15-d1f7005332c7 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:18.265951 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-77a753bf-e2b1-4bf0-8f15-d1f7005332c7 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:18.266353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-77a753bf-e2b1-4bf0-8f15-d1f7005332c7 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:18.319267 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bbee517c-b665-46e0-ab13-00b3144a3890 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:18.342954 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bbee517c-b665-46e0-ab13-00b3144a3890 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561" status: 200 len: 1472 microversion: 2.1 time: 0.266558 Oct 29 02:49:18.343796 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 498/982] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:18 2022] GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561 => generated 1472 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:18.355095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0a9ef823-e707-40fb-8f89-6dd80842e54b tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:18.357249 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0a9ef823-e707-40fb-8f89-6dd80842e54b tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:18.377640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a9ef823-e707-40fb-8f89-6dd80842e54b tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:18.378139 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a9ef823-e707-40fb-8f89-6dd80842e54b tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:18.378569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a9ef823-e707-40fb-8f89-6dd80842e54b tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:18.387200 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a9ef823-e707-40fb-8f89-6dd80842e54b tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:18.388148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a9ef823-e707-40fb-8f89-6dd80842e54b tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:18.388640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a9ef823-e707-40fb-8f89-6dd80842e54b tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:18.418404 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-77a753bf-e2b1-4bf0-8f15-d1f7005332c7 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.385172 Oct 29 02:49:18.422182 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 485/983] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:49:18 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:49:18.427792 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d11a1181-bb0e-4429-b87e-47e1d60f5f8d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:18.428912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d11a1181-bb0e-4429-b87e-47e1d60f5f8d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:18.435946 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d11a1181-bb0e-4429-b87e-47e1d60f5f8d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:18.436706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d11a1181-bb0e-4429-b87e-47e1d60f5f8d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:18.438364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d11a1181-bb0e-4429-b87e-47e1d60f5f8d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:18.439445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d11a1181-bb0e-4429-b87e-47e1d60f5f8d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:18.440139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d11a1181-bb0e-4429-b87e-47e1d60f5f8d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:18.440679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d11a1181-bb0e-4429-b87e-47e1d60f5f8d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:18.501204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0a9ef823-e707-40fb-8f89-6dd80842e54b tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:18.515477 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0a9ef823-e707-40fb-8f89-6dd80842e54b tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88" status: 200 len: 1276 microversion: 2.1 time: 0.169172 Oct 29 02:49:18.516672 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 499/984] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:18 2022] GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88 => generated 1276 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:18.525939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6a8af2b8-a902-476d-8b88-8603daeb057c tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:18.526977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d11a1181-bb0e-4429-b87e-47e1d60f5f8d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:18.538102 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d11a1181-bb0e-4429-b87e-47e1d60f5f8d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:18.538315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6a8af2b8-a902-476d-8b88-8603daeb057c tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Searching by: {'deleted': False} {{(pid=127125) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:49:18.539550 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d11a1181-bb0e-4429-b87e-47e1d60f5f8d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:18.545467 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d11a1181-bb0e-4429-b87e-47e1d60f5f8d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1486 microversion: 2.91 time: 0.122003 Oct 29 02:49:18.546349 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 486/985] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:18 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1486 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:18.548033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a8af2b8-a902-476d-8b88-8603daeb057c tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:18.549542 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a8af2b8-a902-476d-8b88-8603daeb057c tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:18.550089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a8af2b8-a902-476d-8b88-8603daeb057c tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:18.551116 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a8af2b8-a902-476d-8b88-8603daeb057c tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:18.551871 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a8af2b8-a902-476d-8b88-8603daeb057c tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:18.552489 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a8af2b8-a902-476d-8b88-8603daeb057c tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:18.619607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7f2bb6de-0dbc-4fe8-a74c-3496ade37780 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:18.620214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7f2bb6de-0dbc-4fe8-a74c-3496ade37780 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:18.630549 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f2bb6de-0dbc-4fe8-a74c-3496ade37780 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:18.631032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f2bb6de-0dbc-4fe8-a74c-3496ade37780 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:18.631842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f2bb6de-0dbc-4fe8-a74c-3496ade37780 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:18.632738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f2bb6de-0dbc-4fe8-a74c-3496ade37780 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:18.633353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f2bb6de-0dbc-4fe8-a74c-3496ade37780 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:18.634271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f2bb6de-0dbc-4fe8-a74c-3496ade37780 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:18.674293 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.multi_cell_list [None req-6a8af2b8-a902-476d-8b88-8603daeb057c tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Listed batch of 17 results from cell out of 1000 limit. Returned 17 total so far. {{(pid=127125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 02:49:18.755953 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a8af2b8-a902-476d-8b88-8603daeb057c tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:18.756440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a8af2b8-a902-476d-8b88-8603daeb057c tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:18.756910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a8af2b8-a902-476d-8b88-8603daeb057c tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:18.778205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7f2bb6de-0dbc-4fe8-a74c-3496ade37780 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e823b4fb116c48ea92c2d3da58e10f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a70e4fa3141bb8b667b1be8e9594b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:18.787202 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7f2bb6de-0dbc-4fe8-a74c-3496ade37780 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54" status: 200 len: 1371 microversion: 2.1 time: 0.171446 Oct 29 02:49:18.787957 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 487/986] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:18 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:18.969109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4d65c366-4432-4958-8f9c-963f71f19440 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '.version_select at 0x7ff058065f70>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:19.001009 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-4d65c366-4432-4958-8f9c-963f71f19440 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] HTTP exception thrown: Image not found. Oct 29 02:49:19.004580 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4d65c366-4432-4958-8f9c-963f71f19440 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Request method failure captured: Oct 29 02:49:19.004580 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/images/8274cf20-ed26-404a-a18d-6eaacdd497bc HTTP/1.1 Oct 29 02:49:19.004580 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:49:19.004580 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:49:19.004580 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:49:19.004580 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:49:19.004580 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:49:19.004580 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:49:19.004580 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:49:19.004580 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:19.004580 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJQe_uEcQU7TWvWTWyYHk2tBfhyW3anQlq9IlbMuIEkf7vn933sPmCKARJnxQpZiUZK1LvxWi4oqgPbQrdfUsgmfgxV95FnHLrMyZSrDr2oYF-e8DjjcOj7SOyLBpFsBspJHWMF4bxtFDAQHeniPMEGa1F2s-2gEJ_CIW5xBvV79ZDc Oct 29 02:49:19.004580 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:49:19.004580 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:49:19.004580 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:49:19.004580 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:49:19.004580 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:49:19.004580 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:49:19.004580 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 94814dc564d04e688714ac064c7d1b3b Oct 29 02:49:19.004580 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:49:19.004580 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:49:19.004580 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:49:19.005900 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/94814dc564d04e688714ac064c7d1b3b"}]}] Oct 29 02:49:19.005900 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:49:19.005900 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 94814dc564d04e688714ac064c7d1b3b Oct 29 02:49:19.005900 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:49:19.005900 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ImagesOneServerNegativeTestJSON-13999867-project Oct 29 02:49:19.005900 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:49:19.005900 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:49:19.005900 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 6862cd2470624f01a8bc1d371aa03962 Oct 29 02:49:19.005900 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-13999867-project Oct 29 02:49:19.005900 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:49:19.005900 n-d-862967-2 devstack@n-api.service[127124]: exception: Image not found. Oct 29 02:49:19.005900 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '8274cf20-ed26-404a-a18d-6eaacdd497bc'} Oct 29 02:49:19.005900 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:19.006751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:19.006751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 02:49:19.006751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 02:49:19.006751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:49:19.006751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:49:19.006751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:49:19.006751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:49:19.006751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 02:49:19.006751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 02:49:19.006751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 02:49:19.006751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 02:49:19.006751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:49:19.006751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:49:19.006751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:49:19.006751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:49:19.006751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8274cf20-ed26-404a-a18d-6eaacdd497bc to delete Oct 29 02:49:19.006751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:19.006751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:19.006751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:19.008251 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:19.008251 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 02:49:19.008251 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 02:49:19.008251 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 02:49:19.008251 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 02:49:19.008251 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 02:49:19.008251 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 02:49:19.008251 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8274cf20-ed26-404a-a18d-6eaacdd497bc could not be found. Oct 29 02:49:19.008251 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:19.008251 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:19.008251 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:19.008251 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:19.008251 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:19.008251 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:19.008251 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:19.008251 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:19.008251 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:49:19.008251 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:49:19.008251 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:19.008251 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:19.009784 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 02:49:19.009784 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 02:49:19.009784 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:49:19.009784 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:19.009784 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:19.009784 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:19.009784 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:19.009784 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:19.009784 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:19.009784 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:19.009784 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:19.009784 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:49:19.009784 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:19.009784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4d65c366-4432-4958-8f9c-963f71f19440 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Returning 404 to user: Image not found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:19.009784 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4d65c366-4432-4958-8f9c-963f71f19440 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "DELETE /compute/v2.1/images/8274cf20-ed26-404a-a18d-6eaacdd497bc" status: 404 len: 62 microversion: 2.1 time: 0.040789 Oct 29 02:49:19.011696 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 488/987] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:18 2022] DELETE /compute/v2.1/images/8274cf20-ed26-404a-a18d-6eaacdd497bc => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:49:19.015707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-22ae6d54-3d86-4d48-a4b3-5ce98b9904d5 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:19.016395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-22ae6d54-3d86-4d48-a4b3-5ce98b9904d5 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:19.027484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22ae6d54-3d86-4d48-a4b3-5ce98b9904d5 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:19.027980 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22ae6d54-3d86-4d48-a4b3-5ce98b9904d5 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:19.028415 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22ae6d54-3d86-4d48-a4b3-5ce98b9904d5 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:19.029152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22ae6d54-3d86-4d48-a4b3-5ce98b9904d5 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:19.029608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22ae6d54-3d86-4d48-a4b3-5ce98b9904d5 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:19.030031 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22ae6d54-3d86-4d48-a4b3-5ce98b9904d5 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:19.043573 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-22ae6d54-3d86-4d48-a4b3-5ce98b9904d5 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] HTTP exception thrown: Instance a1cfd9d1-24b9-4d99-851e-609ece042e43 could not be found. Oct 29 02:49:19.045571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-22ae6d54-3d86-4d48-a4b3-5ce98b9904d5 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Request method failure captured: Oct 29 02:49:19.045571 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 HTTP/1.1 Oct 29 02:49:19.045571 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:49:19.045571 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:49:19.045571 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:49:19.045571 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:49:19.045571 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:49:19.045571 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:49:19.045571 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:49:19.045571 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:19.045571 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJQe_uEcQU7TWvWTWyYHk2tBfhyW3anQlq9IlbMuIEkf7vn933sPmCKARJnxQpZiUZK1LvxWi4oqgPbQrdfUsgmfgxV95FnHLrMyZSrDr2oYF-e8DjjcOj7SOyLBpFsBspJHWMF4bxtFDAQHeniPMEGa1F2s-2gEJ_CIW5xBvV79ZDc Oct 29 02:49:19.045571 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:49:19.045571 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:49:19.045571 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:49:19.045571 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:49:19.045571 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:49:19.045571 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:49:19.045571 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 94814dc564d04e688714ac064c7d1b3b Oct 29 02:49:19.045571 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:49:19.045571 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:49:19.045571 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:49:19.046984 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/94814dc564d04e688714ac064c7d1b3b"}]}] Oct 29 02:49:19.046984 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:49:19.046984 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 94814dc564d04e688714ac064c7d1b3b Oct 29 02:49:19.046984 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:49:19.046984 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ImagesOneServerNegativeTestJSON-13999867-project Oct 29 02:49:19.046984 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:49:19.046984 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:49:19.046984 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 6862cd2470624f01a8bc1d371aa03962 Oct 29 02:49:19.046984 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-13999867-project Oct 29 02:49:19.046984 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:49:19.046984 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance a1cfd9d1-24b9-4d99-851e-609ece042e43 could not be found. Oct 29 02:49:19.046984 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'a1cfd9d1-24b9-4d99-851e-609ece042e43'} Oct 29 02:49:19.048324 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:19.048324 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:19.048324 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:49:19.048324 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:49:19.048324 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:49:19.048324 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:49:19.048324 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:49:19.048324 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:49:19.048324 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:49:19.048324 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:49:19.048324 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1cfd9d1-24b9-4d99-851e-609ece042e43 could not be found. Oct 29 02:49:19.048324 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:19.048324 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:19.048324 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:19.048324 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:19.048324 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:19.048324 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:19.048324 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:19.048324 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:19.048324 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:19.050730 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:19.050730 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:49:19.050730 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:49:19.050730 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:49:19.050730 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:49:19.050730 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:49:19.050730 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:49:19.050730 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:49:19.050730 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:49:19.050730 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1cfd9d1-24b9-4d99-851e-609ece042e43 could not be found. Oct 29 02:49:19.050730 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:19.050730 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:19.050730 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:19.050730 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:19.050730 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:19.050730 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:19.050730 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:19.050730 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:19.050730 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1cfd9d1-24b9-4d99-851e-609ece042e43 could not be found. Oct 29 02:49:19.050730 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:19.053715 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-22ae6d54-3d86-4d48-a4b3-5ce98b9904d5 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Returning 404 to user: Instance a1cfd9d1-24b9-4d99-851e-609ece042e43 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:19.053715 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-22ae6d54-3d86-4d48-a4b3-5ce98b9904d5 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 404 len: 111 microversion: 2.1 time: 0.035632 Oct 29 02:49:19.053715 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 489/988] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:49:19 2022] DELETE /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:49:19.056378 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0397d6ca-26a8-4b91-988d-3f2c9cea5382 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:19.057092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0397d6ca-26a8-4b91-988d-3f2c9cea5382 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] [instance: a1cfd9d1-24b9-4d99-851e-609ece042e43] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:19.063262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0397d6ca-26a8-4b91-988d-3f2c9cea5382 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:19.063745 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0397d6ca-26a8-4b91-988d-3f2c9cea5382 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:19.064175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0397d6ca-26a8-4b91-988d-3f2c9cea5382 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:19.064978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0397d6ca-26a8-4b91-988d-3f2c9cea5382 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:19.065363 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0397d6ca-26a8-4b91-988d-3f2c9cea5382 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:19.065785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0397d6ca-26a8-4b91-988d-3f2c9cea5382 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:19.080500 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-0397d6ca-26a8-4b91-988d-3f2c9cea5382 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] HTTP exception thrown: Instance a1cfd9d1-24b9-4d99-851e-609ece042e43 could not be found. Oct 29 02:49:19.082061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0397d6ca-26a8-4b91-988d-3f2c9cea5382 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Request method failure captured: Oct 29 02:49:19.082061 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 HTTP/1.1 Oct 29 02:49:19.082061 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:49:19.082061 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:49:19.082061 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:49:19.082061 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:49:19.082061 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:49:19.082061 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:49:19.082061 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:49:19.082061 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:19.082061 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJQe_uEcQU7TWvWTWyYHk2tBfhyW3anQlq9IlbMuIEkf7vn933sPmCKARJnxQpZiUZK1LvxWi4oqgPbQrdfUsgmfgxV95FnHLrMyZSrDr2oYF-e8DjjcOj7SOyLBpFsBspJHWMF4bxtFDAQHeniPMEGa1F2s-2gEJ_CIW5xBvV79ZDc Oct 29 02:49:19.082061 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:49:19.082061 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:49:19.082061 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:49:19.082061 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:49:19.082061 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:49:19.082061 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:49:19.082061 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 94814dc564d04e688714ac064c7d1b3b Oct 29 02:49:19.082061 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:49:19.082061 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:49:19.082061 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:49:19.083463 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_94814dc564d04e688714ac064c7d1b3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/94814dc564d04e688714ac064c7d1b3b"}]}] Oct 29 02:49:19.083463 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:49:19.083463 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 94814dc564d04e688714ac064c7d1b3b Oct 29 02:49:19.083463 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-13999867 Oct 29 02:49:19.083463 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ImagesOneServerNegativeTestJSON-13999867-project Oct 29 02:49:19.083463 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:49:19.083463 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:49:19.083463 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 6862cd2470624f01a8bc1d371aa03962 Oct 29 02:49:19.083463 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-13999867-project Oct 29 02:49:19.083463 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:49:19.083463 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance a1cfd9d1-24b9-4d99-851e-609ece042e43 could not be found. Oct 29 02:49:19.083463 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'a1cfd9d1-24b9-4d99-851e-609ece042e43'} Oct 29 02:49:19.084220 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:19.084220 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:19.084220 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:49:19.084220 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:49:19.084220 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:49:19.084220 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:49:19.084220 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:49:19.084220 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:49:19.084220 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:49:19.084220 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:49:19.084220 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1cfd9d1-24b9-4d99-851e-609ece042e43 could not be found. Oct 29 02:49:19.084220 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:19.084220 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:19.084220 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:19.084220 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:19.084220 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:19.084220 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:19.084220 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:19.084220 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:19.084220 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:19.085479 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:19.085479 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:49:19.085479 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:49:19.085479 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:49:19.085479 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:49:19.085479 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:49:19.085479 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:49:19.085479 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1cfd9d1-24b9-4d99-851e-609ece042e43 could not be found. Oct 29 02:49:19.085479 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:19.085479 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:19.085479 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:19.085479 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:19.085479 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:19.085479 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:19.085479 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:19.085479 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:19.085479 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1cfd9d1-24b9-4d99-851e-609ece042e43 could not be found. Oct 29 02:49:19.085479 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:19.087449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0397d6ca-26a8-4b91-988d-3f2c9cea5382 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] Returning 404 to user: Instance a1cfd9d1-24b9-4d99-851e-609ece042e43 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:19.087449 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0397d6ca-26a8-4b91-988d-3f2c9cea5382 tempest-ImagesOneServerNegativeTestJSON-13999867 tempest-ImagesOneServerNegativeTestJSON-13999867-project] 10.222.0.46 "GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43" status: 404 len: 111 microversion: 2.1 time: 0.030881 Oct 29 02:49:19.087717 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 490/989] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:19 2022] GET /compute/v2.1/servers/a1cfd9d1-24b9-4d99-851e-609ece042e43 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:49:19.148455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bd4fcb5f-4a10-4ba3-9d47-00cded5a7539 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98520b47-ad7c-49a1-82b1-afa4864ac603", "device": "/dev/xvdb"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:19.151545 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bd4fcb5f-4a10-4ba3-9d47-00cded5a7539 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:19.158878 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd4fcb5f-4a10-4ba3-9d47-00cded5a7539 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:19.159699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd4fcb5f-4a10-4ba3-9d47-00cded5a7539 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:19.160304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd4fcb5f-4a10-4ba3-9d47-00cded5a7539 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:19.161135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd4fcb5f-4a10-4ba3-9d47-00cded5a7539 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:19.161637 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd4fcb5f-4a10-4ba3-9d47-00cded5a7539 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:19.162063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd4fcb5f-4a10-4ba3-9d47-00cded5a7539 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:19.175865 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6a8af2b8-a902-476d-8b88-8603daeb057c tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 27421 microversion: 2.1 time: 0.657185 Oct 29 02:49:19.187365 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 500/990] 10.222.0.46 () {58 vars in 1171 bytes} [Sat Oct 29 02:49:18 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 27421 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:49:19.225421 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-36520d4b-dc88-4f7f-a22b-ea19a2b295b4 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:19.230486 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-36520d4b-dc88-4f7f-a22b-ea19a2b295b4 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Searching by: {'deleted': False, 'project_id': 'ce3aa0b46e6d45bb9270b5eff86e8386'} {{(pid=127125) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:49:19.235413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36520d4b-dc88-4f7f-a22b-ea19a2b295b4 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:19.235961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36520d4b-dc88-4f7f-a22b-ea19a2b295b4 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:19.236806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36520d4b-dc88-4f7f-a22b-ea19a2b295b4 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:19.237980 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36520d4b-dc88-4f7f-a22b-ea19a2b295b4 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:19.239247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36520d4b-dc88-4f7f-a22b-ea19a2b295b4 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:19.239920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36520d4b-dc88-4f7f-a22b-ea19a2b295b4 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:19.357017 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-36520d4b-dc88-4f7f-a22b-ea19a2b295b4 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/detail?tenant_id=24ee44ab29014be1bff1c5a18c53c2e2" status: 200 len: 15 microversion: 2.1 time: 0.135182 Oct 29 02:49:19.357818 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 501/991] 10.222.0.46 () {58 vars in 1231 bytes} [Sat Oct 29 02:49:19 2022] GET /compute/v2.1/servers/detail?tenant_id=24ee44ab29014be1bff1c5a18c53c2e2 => generated 15 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 02:49:19.380178 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-00932079-f869-45aa-902c-59a6f548b1b3 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:19.380906 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-00932079-f869-45aa-902c-59a6f548b1b3 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: f8fd44ee-f170-4aba-b86d-4d096a720561] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:19.389169 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00932079-f869-45aa-902c-59a6f548b1b3 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:19.389663 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00932079-f869-45aa-902c-59a6f548b1b3 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:19.390102 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00932079-f869-45aa-902c-59a6f548b1b3 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:19.390835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00932079-f869-45aa-902c-59a6f548b1b3 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:19.391333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00932079-f869-45aa-902c-59a6f548b1b3 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:19.391795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00932079-f869-45aa-902c-59a6f548b1b3 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:19.555185 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-00932079-f869-45aa-902c-59a6f548b1b3 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:19.563600 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-00932079-f869-45aa-902c-59a6f548b1b3 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561" status: 200 len: 1472 microversion: 2.1 time: 0.187897 Oct 29 02:49:19.577095 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 502/992] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:19 2022] GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561 => generated 1472 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:19.585400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ad208fd1-6db3-4349-9eed-00263f4374aa tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:19.591882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ad208fd1-6db3-4349-9eed-00263f4374aa tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Searching by: {'tenant_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'deleted': False} {{(pid=127125) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:49:19.608330 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad208fd1-6db3-4349-9eed-00263f4374aa tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:19.608832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad208fd1-6db3-4349-9eed-00263f4374aa tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:19.609236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad208fd1-6db3-4349-9eed-00263f4374aa tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:19.609955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad208fd1-6db3-4349-9eed-00263f4374aa tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:19.610398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad208fd1-6db3-4349-9eed-00263f4374aa tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:19.610815 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad208fd1-6db3-4349-9eed-00263f4374aa tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:19.644761 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bd4fcb5f-4a10-4ba3-9d47-00cded5a7539 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "POST /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.500269 Oct 29 02:49:19.645493 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 491/993] 10.222.0.46 () {62 vars in 1364 bytes} [Sat Oct 29 02:49:19 2022] POST /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68/os-volume_attachments => generated 194 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 02:49:19.681736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1842af87-78f8-4ef7-9395-e9dd7f569e37 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:19.683664 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1842af87-78f8-4ef7-9395-e9dd7f569e37 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:19.689995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.multi_cell_list [None req-ad208fd1-6db3-4349-9eed-00263f4374aa tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 02:49:19.699832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1842af87-78f8-4ef7-9395-e9dd7f569e37 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:19.702804 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1842af87-78f8-4ef7-9395-e9dd7f569e37 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:19.705263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1842af87-78f8-4ef7-9395-e9dd7f569e37 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:19.708979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1842af87-78f8-4ef7-9395-e9dd7f569e37 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:19.709649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1842af87-78f8-4ef7-9395-e9dd7f569e37 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:19.712153 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1842af87-78f8-4ef7-9395-e9dd7f569e37 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:19.798041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad208fd1-6db3-4349-9eed-00263f4374aa tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:19.798531 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad208fd1-6db3-4349-9eed-00263f4374aa tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:19.798993 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad208fd1-6db3-4349-9eed-00263f4374aa tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:19.891311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1842af87-78f8-4ef7-9395-e9dd7f569e37 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:19.899608 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1842af87-78f8-4ef7-9395-e9dd7f569e37 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88" status: 200 len: 1276 microversion: 2.1 time: 0.227299 Oct 29 02:49:19.900405 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 492/994] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:19 2022] GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88 => generated 1276 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:19.918518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-162bcba7-3472-419c-b606-7949d5610f83 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:19.919431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-162bcba7-3472-419c-b606-7949d5610f83 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:19.924932 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-162bcba7-3472-419c-b606-7949d5610f83 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:19.925656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-162bcba7-3472-419c-b606-7949d5610f83 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:19.926082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-162bcba7-3472-419c-b606-7949d5610f83 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:19.926811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-162bcba7-3472-419c-b606-7949d5610f83 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:19.927264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-162bcba7-3472-419c-b606-7949d5610f83 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:19.927682 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-162bcba7-3472-419c-b606-7949d5610f83 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:19.929002 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ad208fd1-6db3-4349-9eed-00263f4374aa tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=24ee44ab29014be1bff1c5a18c53c2e2" status: 200 len: 4826 microversion: 2.1 time: 0.350691 Oct 29 02:49:19.929908 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 503/995] 10.222.0.46 () {58 vars in 1257 bytes} [Sat Oct 29 02:49:19 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=24ee44ab29014be1bff1c5a18c53c2e2 => generated 4826 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:19.934078 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-c8f45218-8120-45c5-89a0-5cadba0cb3ff req-6010b5e8-4406-407a-a4c4-19248ef4014c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e14d80ff-4e71-4822-917c-ee46b9c7be54", "name": "network-vif-plugged", "status": "completed", "tag": "c7e34011-b5a8-480b-8c27-6a70268c0206"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:19.947790 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c8f45218-8120-45c5-89a0-5cadba0cb3ff req-6010b5e8-4406-407a-a4c4-19248ef4014c service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:19.948269 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c8f45218-8120-45c5-89a0-5cadba0cb3ff req-6010b5e8-4406-407a-a4c4-19248ef4014c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:19.948735 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c8f45218-8120-45c5-89a0-5cadba0cb3ff req-6010b5e8-4406-407a-a4c4-19248ef4014c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:19.970851 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-c8f45218-8120-45c5-89a0-5cadba0cb3ff req-6010b5e8-4406-407a-a4c4-19248ef4014c service nova] Creating event network-vif-plugged:c7e34011-b5a8-480b-8c27-6a70268c0206 for instance e14d80ff-4e71-4822-917c-ee46b9c7be54 on n-h1-862967-2 Oct 29 02:49:19.981181 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-c8f45218-8120-45c5-89a0-5cadba0cb3ff req-6010b5e8-4406-407a-a4c4-19248ef4014c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050286 Oct 29 02:49:19.983382 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 504/996] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:19.993185 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-486bccc9-a226-4d27-8a40-497668bea2c8 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:19.994012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-486bccc9-a226-4d27-8a40-497668bea2c8 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:20.017096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-486bccc9-a226-4d27-8a40-497668bea2c8 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:20.017603 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-486bccc9-a226-4d27-8a40-497668bea2c8 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:20.018215 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-486bccc9-a226-4d27-8a40-497668bea2c8 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:20.018881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-486bccc9-a226-4d27-8a40-497668bea2c8 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:20.020373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-486bccc9-a226-4d27-8a40-497668bea2c8 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:20.020373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-486bccc9-a226-4d27-8a40-497668bea2c8 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:20.080595 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-162bcba7-3472-419c-b606-7949d5610f83 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:20.089955 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-162bcba7-3472-419c-b606-7949d5610f83 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:20.091381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-162bcba7-3472-419c-b606-7949d5610f83 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:20.107692 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-162bcba7-3472-419c-b606-7949d5610f83 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1488 microversion: 2.91 time: 0.194887 Oct 29 02:49:20.110319 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 493/997] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:19 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1488 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:20.117558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2b9873c3-8749-46d5-834f-b307a1f73495 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:20.125544 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2b9873c3-8749-46d5-834f-b307a1f73495 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Searching by: {'tenant_id': 'ce3aa0b46e6d45bb9270b5eff86e8386', 'deleted': False} {{(pid=127124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:49:20.132476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2b9873c3-8749-46d5-834f-b307a1f73495 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:20.133372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2b9873c3-8749-46d5-834f-b307a1f73495 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:20.134455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2b9873c3-8749-46d5-834f-b307a1f73495 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:20.135423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2b9873c3-8749-46d5-834f-b307a1f73495 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:20.136115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2b9873c3-8749-46d5-834f-b307a1f73495 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:20.137131 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2b9873c3-8749-46d5-834f-b307a1f73495 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:20.176024 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2b9873c3-8749-46d5-834f-b307a1f73495 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ce3aa0b46e6d45bb9270b5eff86e8386" status: 200 len: 15 microversion: 2.1 time: 0.064228 Oct 29 02:49:20.177211 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 494/998] 10.222.0.46 () {58 vars in 1257 bytes} [Sat Oct 29 02:49:20 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ce3aa0b46e6d45bb9270b5eff86e8386 => generated 15 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:49:20.195629 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-486bccc9-a226-4d27-8a40-497668bea2c8 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e823b4fb116c48ea92c2d3da58e10f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a70e4fa3141bb8b667b1be8e9594b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:20.202886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0ebb34f0-ed5c-482a-b533-b515c6997a47 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:20.204894 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-486bccc9-a226-4d27-8a40-497668bea2c8 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54" status: 200 len: 1371 microversion: 2.1 time: 0.218185 Oct 29 02:49:20.205476 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 505/999] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:19 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 => generated 1371 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:20.209574 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0ebb34f0-ed5c-482a-b533-b515c6997a47 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.012707 Oct 29 02:49:20.210615 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 495/1000] 10.222.0.46 () {58 vars in 1189 bytes} [Sat Oct 29 02:49:20 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:49:20.231728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ae9a7de7-a434-4727-bedb-1583592d9c8d tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:20.234379 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ae9a7de7-a434-4727-bedb-1583592d9c8d tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:20.240749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae9a7de7-a434-4727-bedb-1583592d9c8d tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:20.241229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae9a7de7-a434-4727-bedb-1583592d9c8d tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:20.241657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae9a7de7-a434-4727-bedb-1583592d9c8d tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:20.242350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae9a7de7-a434-4727-bedb-1583592d9c8d tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:20.242779 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae9a7de7-a434-4727-bedb-1583592d9c8d tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:20.243207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae9a7de7-a434-4727-bedb-1583592d9c8d tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:20.613396 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c7eae343-754b-475d-ad6f-7e6340471b50 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:20.617634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c7eae343-754b-475d-ad6f-7e6340471b50 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: f8fd44ee-f170-4aba-b86d-4d096a720561] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:20.629738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c7eae343-754b-475d-ad6f-7e6340471b50 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:20.630156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c7eae343-754b-475d-ad6f-7e6340471b50 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:20.630601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c7eae343-754b-475d-ad6f-7e6340471b50 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:20.631326 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c7eae343-754b-475d-ad6f-7e6340471b50 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:20.631783 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c7eae343-754b-475d-ad6f-7e6340471b50 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:20.632213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c7eae343-754b-475d-ad6f-7e6340471b50 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:20.674095 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ae9a7de7-a434-4727-bedb-1583592d9c8d tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685/action" status: 202 len: 0 microversion: 2.1 time: 0.445940 Oct 29 02:49:20.674785 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 506/1001] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:49:20 2022] POST /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685/action => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:20.699419 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1c5eb555-9a5f-43bb-b706-94fabd7da7bb tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:20.704543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1c5eb555-9a5f-43bb-b706-94fabd7da7bb tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:20.717686 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1c5eb555-9a5f-43bb-b706-94fabd7da7bb tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2'} {{(pid=127125) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:49:20.720748 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:20.724240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c5eb555-9a5f-43bb-b706-94fabd7da7bb tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:20.724787 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c5eb555-9a5f-43bb-b706-94fabd7da7bb tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:20.725232 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c5eb555-9a5f-43bb-b706-94fabd7da7bb tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:20.734208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c5eb555-9a5f-43bb-b706-94fabd7da7bb tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:20.734711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c5eb555-9a5f-43bb-b706-94fabd7da7bb tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:20.735216 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c5eb555-9a5f-43bb-b706-94fabd7da7bb tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:20.928118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c7eae343-754b-475d-ad6f-7e6340471b50 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:20.945953 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c7eae343-754b-475d-ad6f-7e6340471b50 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561" status: 200 len: 1430 microversion: 2.1 time: 0.353205 Oct 29 02:49:20.964564 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 496/1002] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:20 2022] GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561 => generated 1430 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:20.964564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e8506f96-3259-459c-a7e9-96a7b43c6b0d tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:20.964564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e8506f96-3259-459c-a7e9-96a7b43c6b0d tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:20.974975 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.multi_cell_list [None req-1c5eb555-9a5f-43bb-b706-94fabd7da7bb tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 02:49:20.976946 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8506f96-3259-459c-a7e9-96a7b43c6b0d tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:20.977569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8506f96-3259-459c-a7e9-96a7b43c6b0d tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:20.978116 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8506f96-3259-459c-a7e9-96a7b43c6b0d tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:20.978971 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8506f96-3259-459c-a7e9-96a7b43c6b0d tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:20.979572 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8506f96-3259-459c-a7e9-96a7b43c6b0d tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:20.981056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8506f96-3259-459c-a7e9-96a7b43c6b0d tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:21.153010 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1c5eb555-9a5f-43bb-b706-94fabd7da7bb tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.470286 Oct 29 02:49:21.155138 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 507/1003] 10.222.0.46 () {58 vars in 1150 bytes} [Sat Oct 29 02:49:20 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:21.160715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-4e5f038f-cd52-49c3-bd6e-dbc1aad99f42 req-e2692bbf-a547-43f9-8e1a-7e8aaee799a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8fd44ee-f170-4aba-b86d-4d096a720561", "name": "network-vif-deleted", "tag": "d45a8e22-aaac-49fa-a1ee-680ef4e8eec9"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:21.178949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4e5f038f-cd52-49c3-bd6e-dbc1aad99f42 req-e2692bbf-a547-43f9-8e1a-7e8aaee799a0 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:21.180891 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4e5f038f-cd52-49c3-bd6e-dbc1aad99f42 req-e2692bbf-a547-43f9-8e1a-7e8aaee799a0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:21.182363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4e5f038f-cd52-49c3-bd6e-dbc1aad99f42 req-e2692bbf-a547-43f9-8e1a-7e8aaee799a0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:21.208469 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e8506f96-3259-459c-a7e9-96a7b43c6b0d tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:21.219103 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e8506f96-3259-459c-a7e9-96a7b43c6b0d tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88" status: 200 len: 1282 microversion: 2.1 time: 0.267861 Oct 29 02:49:21.233623 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-4e5f038f-cd52-49c3-bd6e-dbc1aad99f42 req-e2692bbf-a547-43f9-8e1a-7e8aaee799a0 service nova] Creating event network-vif-deleted:d45a8e22-aaac-49fa-a1ee-680ef4e8eec9 for instance f8fd44ee-f170-4aba-b86d-4d096a720561 on n-h2-862967-2 Oct 29 02:49:21.233623 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-4e5f038f-cd52-49c3-bd6e-dbc1aad99f42 req-e2692bbf-a547-43f9-8e1a-7e8aaee799a0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074114 Oct 29 02:49:21.234838 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 497/1004] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:20 2022] GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88 => generated 1282 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:21.238403 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 508/1005] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:21.242247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-938c864f-edd2-4a94-843c-0e4c72fa975b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:21.243230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-938c864f-edd2-4a94-843c-0e4c72fa975b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:21.251703 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-938c864f-edd2-4a94-843c-0e4c72fa975b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:21.252279 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-938c864f-edd2-4a94-843c-0e4c72fa975b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:21.252893 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-938c864f-edd2-4a94-843c-0e4c72fa975b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:21.253687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-938c864f-edd2-4a94-843c-0e4c72fa975b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:21.254241 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-938c864f-edd2-4a94-843c-0e4c72fa975b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:21.255294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-938c864f-edd2-4a94-843c-0e4c72fa975b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:21.261126 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1cf3e0ad-9480-40e0-8eca-054cca08b749 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:21.264020 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1cf3e0ad-9480-40e0-8eca-054cca08b749 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:21.280424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cf3e0ad-9480-40e0-8eca-054cca08b749 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:21.280896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cf3e0ad-9480-40e0-8eca-054cca08b749 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:21.281339 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cf3e0ad-9480-40e0-8eca-054cca08b749 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:21.282068 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cf3e0ad-9480-40e0-8eca-054cca08b749 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:21.282530 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cf3e0ad-9480-40e0-8eca-054cca08b749 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:21.282959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cf3e0ad-9480-40e0-8eca-054cca08b749 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:21.433172 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1cf3e0ad-9480-40e0-8eca-054cca08b749 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685/action" status: 202 len: 0 microversion: 2.1 time: 0.192897 Oct 29 02:49:21.436696 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 509/1006] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:49:21 2022] POST /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:21.439618 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-938c864f-edd2-4a94-843c-0e4c72fa975b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:21.444815 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-20e176b4-d44f-4de7-b0ec-d2beee5e28d3 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:21.445334 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-20e176b4-d44f-4de7-b0ec-d2beee5e28d3 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:21.451735 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-938c864f-edd2-4a94-843c-0e4c72fa975b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:21.460176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20e176b4-d44f-4de7-b0ec-d2beee5e28d3 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:21.465359 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20e176b4-d44f-4de7-b0ec-d2beee5e28d3 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:21.465822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20e176b4-d44f-4de7-b0ec-d2beee5e28d3 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:21.466583 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20e176b4-d44f-4de7-b0ec-d2beee5e28d3 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:21.467065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20e176b4-d44f-4de7-b0ec-d2beee5e28d3 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:21.467484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20e176b4-d44f-4de7-b0ec-d2beee5e28d3 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:21.472635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-938c864f-edd2-4a94-843c-0e4c72fa975b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:21.484222 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-938c864f-edd2-4a94-843c-0e4c72fa975b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.247921 Oct 29 02:49:21.496555 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 498/1007] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:21 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:21.496555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-abdc5a9e-4448-4ce6-99dd-66884a179db3 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:21.496555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-abdc5a9e-4448-4ce6-99dd-66884a179db3 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:21.539423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abdc5a9e-4448-4ce6-99dd-66884a179db3 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:21.539943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abdc5a9e-4448-4ce6-99dd-66884a179db3 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:21.540696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abdc5a9e-4448-4ce6-99dd-66884a179db3 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:21.543854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abdc5a9e-4448-4ce6-99dd-66884a179db3 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:21.544325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abdc5a9e-4448-4ce6-99dd-66884a179db3 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:21.544860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abdc5a9e-4448-4ce6-99dd-66884a179db3 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:22.033586 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-20e176b4-d44f-4de7-b0ec-d2beee5e28d3 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e823b4fb116c48ea92c2d3da58e10f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a70e4fa3141bb8b667b1be8e9594b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:22.051246 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-20e176b4-d44f-4de7-b0ec-d2beee5e28d3 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54" status: 200 len: 1371 microversion: 2.1 time: 0.615686 Oct 29 02:49:22.070309 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 510/1008] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:21 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 => generated 1371 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:22.082415 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-62f915e0-a1f1-4316-addf-502508b73f56 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:22.083562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-62f915e0-a1f1-4316-addf-502508b73f56 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: f8fd44ee-f170-4aba-b86d-4d096a720561] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:22.108965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62f915e0-a1f1-4316-addf-502508b73f56 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:22.109753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62f915e0-a1f1-4316-addf-502508b73f56 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:22.117581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62f915e0-a1f1-4316-addf-502508b73f56 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:22.119212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62f915e0-a1f1-4316-addf-502508b73f56 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:22.119992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62f915e0-a1f1-4316-addf-502508b73f56 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:22.120837 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62f915e0-a1f1-4316-addf-502508b73f56 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:22.185803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:22.207510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62f915e0-a1f1-4316-addf-502508b73f56 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:22.210264 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62f915e0-a1f1-4316-addf-502508b73f56 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:22.213529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62f915e0-a1f1-4316-addf-502508b73f56 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:22.214152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-62f915e0-a1f1-4316-addf-502508b73f56 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lazy-loading 'fault' on Instance uuid f8fd44ee-f170-4aba-b86d-4d096a720561 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:49:22.279299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-62f915e0-a1f1-4316-addf-502508b73f56 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:22.289539 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-62f915e0-a1f1-4316-addf-502508b73f56 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561" status: 200 len: 1307 microversion: 2.1 time: 0.217602 Oct 29 02:49:22.294881 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 511/1009] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:22 2022] GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561 => generated 1307 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:22.303393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-51614bed-b838-4173-9c5a-35fed55e92b8 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:22.307230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-51614bed-b838-4173-9c5a-35fed55e92b8 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:22.319737 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-51614bed-b838-4173-9c5a-35fed55e92b8 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:22.320631 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-51614bed-b838-4173-9c5a-35fed55e92b8 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:22.321293 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-51614bed-b838-4173-9c5a-35fed55e92b8 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:22.323624 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-51614bed-b838-4173-9c5a-35fed55e92b8 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:22.326065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-51614bed-b838-4173-9c5a-35fed55e92b8 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:22.326764 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-51614bed-b838-4173-9c5a-35fed55e92b8 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:22.470934 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-abdc5a9e-4448-4ce6-99dd-66884a179db3 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1614 microversion: 2.1 time: 0.984366 Oct 29 02:49:22.472678 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 499/1010] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:21 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1614 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:22.496287 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-87656e25-3114-4fbf-8fa5-21c8392b1324 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:22.497154 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-87656e25-3114-4fbf-8fa5-21c8392b1324 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:22.503764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87656e25-3114-4fbf-8fa5-21c8392b1324 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:22.504546 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87656e25-3114-4fbf-8fa5-21c8392b1324 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:22.505382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87656e25-3114-4fbf-8fa5-21c8392b1324 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:22.506308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87656e25-3114-4fbf-8fa5-21c8392b1324 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:22.506973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87656e25-3114-4fbf-8fa5-21c8392b1324 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:22.507575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87656e25-3114-4fbf-8fa5-21c8392b1324 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:22.558620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-51614bed-b838-4173-9c5a-35fed55e92b8 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:22.571129 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-51614bed-b838-4173-9c5a-35fed55e92b8 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88" status: 200 len: 1282 microversion: 2.1 time: 0.274460 Oct 29 02:49:22.585689 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 512/1011] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:22 2022] GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88 => generated 1282 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:22.594639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-aaba9c8c-56c6-4a97-a2ee-fdc4999e1201 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:22.595510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-aaba9c8c-56c6-4a97-a2ee-fdc4999e1201 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:22.602125 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aaba9c8c-56c6-4a97-a2ee-fdc4999e1201 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:22.602870 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aaba9c8c-56c6-4a97-a2ee-fdc4999e1201 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:22.603480 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aaba9c8c-56c6-4a97-a2ee-fdc4999e1201 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:22.604184 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aaba9c8c-56c6-4a97-a2ee-fdc4999e1201 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:22.604667 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aaba9c8c-56c6-4a97-a2ee-fdc4999e1201 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:22.605151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aaba9c8c-56c6-4a97-a2ee-fdc4999e1201 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:22.796071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-aaba9c8c-56c6-4a97-a2ee-fdc4999e1201 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:22.808035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-aaba9c8c-56c6-4a97-a2ee-fdc4999e1201 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:22.814346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-aaba9c8c-56c6-4a97-a2ee-fdc4999e1201 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:22.842098 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-aaba9c8c-56c6-4a97-a2ee-fdc4999e1201 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.250410 Oct 29 02:49:22.843142 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 513/1012] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:22 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:23.088755 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a206ba8a-cb44-4042-be4f-0f779e0d9fd4 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:23.089663 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a206ba8a-cb44-4042-be4f-0f779e0d9fd4 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:23.127067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a206ba8a-cb44-4042-be4f-0f779e0d9fd4 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:23.128629 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a206ba8a-cb44-4042-be4f-0f779e0d9fd4 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:23.134231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a206ba8a-cb44-4042-be4f-0f779e0d9fd4 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:23.142150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a206ba8a-cb44-4042-be4f-0f779e0d9fd4 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:23.142741 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a206ba8a-cb44-4042-be4f-0f779e0d9fd4 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:23.145214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a206ba8a-cb44-4042-be4f-0f779e0d9fd4 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:23.518789 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-87656e25-3114-4fbf-8fa5-21c8392b1324 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1614 microversion: 2.1 time: 1.026288 Oct 29 02:49:23.539831 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 500/1013] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:22 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1614 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:49:23.547111 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-befa3a2c-2f2a-46a0-9907-bf756804c913 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:23.547729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-befa3a2c-2f2a-46a0-9907-bf756804c913 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: f8fd44ee-f170-4aba-b86d-4d096a720561] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:23.567146 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-befa3a2c-2f2a-46a0-9907-bf756804c913 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:23.567606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-befa3a2c-2f2a-46a0-9907-bf756804c913 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:23.568038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-befa3a2c-2f2a-46a0-9907-bf756804c913 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:23.583699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-befa3a2c-2f2a-46a0-9907-bf756804c913 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:23.583983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-befa3a2c-2f2a-46a0-9907-bf756804c913 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:23.584625 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-befa3a2c-2f2a-46a0-9907-bf756804c913 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:23.603491 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-befa3a2c-2f2a-46a0-9907-bf756804c913 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] HTTP exception thrown: Instance f8fd44ee-f170-4aba-b86d-4d096a720561 could not be found. Oct 29 02:49:23.605569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-befa3a2c-2f2a-46a0-9907-bf756804c913 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Request method failure captured: Oct 29 02:49:23.605569 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561 HTTP/1.1 Oct 29 02:49:23.605569 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:49:23.605569 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:49:23.605569 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:49:23.605569 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:49:23.605569 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:49:23.605569 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:49:23.605569 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:49:23.605569 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:23.605569 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPtIMVuxUQ5sESBGcpDIyg0JlWGhaenNyoF1KsslH7tI-Ide1t1Qc6YWBoCicDg4iK9BWmVgzBvHQx10NYcQWd4V883MefaFkAV2l76Vzo9g4yJTR39I57-5iCCl5el4McwVe4d-eqtN30on7NVpVe0PpaW9_bFKynEcnhRDBRUQ1A Oct 29 02:49:23.605569 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:49:23.605569 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:49:23.605569 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:49:23.605569 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:49:23.605569 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:49:23.605569 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:49:23.605569 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: dcc6da8e69e041e19023a53a23e33393 Oct 29 02:49:23.605569 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersOnMultiNodesTest-354009816 Oct 29 02:49:23.605569 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:49:23.605569 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:49:23.606889 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dcc6da8e69e041e19023a53a23e33393"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dcc6da8e69e041e19023a53a23e33393"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_dcc6da8e69e041e19023a53a23e33393"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/dcc6da8e69e041e19023a53a23e33393"}]}] Oct 29 02:49:23.606889 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersOnMultiNodesTest-354009816 Oct 29 02:49:23.606889 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: dcc6da8e69e041e19023a53a23e33393 Oct 29 02:49:23.606889 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-354009816 Oct 29 02:49:23.606889 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersOnMultiNodesTest-354009816-project Oct 29 02:49:23.606889 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:49:23.606889 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:49:23.606889 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 509ce04aeb3847f084629201bd7ae5d6 Oct 29 02:49:23.606889 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersOnMultiNodesTest-354009816-project Oct 29 02:49:23.606889 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:49:23.606889 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance f8fd44ee-f170-4aba-b86d-4d096a720561 could not be found. Oct 29 02:49:23.606889 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'f8fd44ee-f170-4aba-b86d-4d096a720561'} Oct 29 02:49:23.607603 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:23.607603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:23.607603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:49:23.607603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:49:23.607603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:49:23.607603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:49:23.607603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:49:23.607603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:49:23.607603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:49:23.607603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:49:23.607603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8fd44ee-f170-4aba-b86d-4d096a720561 could not be found. Oct 29 02:49:23.607603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:23.607603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:23.607603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:23.607603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:23.607603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:23.607603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:23.607603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:23.607603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:23.607603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:23.608841 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:23.608841 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:49:23.608841 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:49:23.608841 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:49:23.608841 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:49:23.608841 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:49:23.608841 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:49:23.608841 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8fd44ee-f170-4aba-b86d-4d096a720561 could not be found. Oct 29 02:49:23.608841 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:23.608841 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:23.608841 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:23.608841 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:23.608841 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:23.608841 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:23.608841 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:23.608841 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:23.608841 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8fd44ee-f170-4aba-b86d-4d096a720561 could not be found. Oct 29 02:49:23.608841 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:23.612626 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-befa3a2c-2f2a-46a0-9907-bf756804c913 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Returning 404 to user: Instance f8fd44ee-f170-4aba-b86d-4d096a720561 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:23.613911 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-befa3a2c-2f2a-46a0-9907-bf756804c913 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561" status: 404 len: 111 microversion: 2.1 time: 0.072966 Oct 29 02:49:23.614656 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 501/1014] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:23 2022] GET /compute/v2.1/servers/f8fd44ee-f170-4aba-b86d-4d096a720561 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:23.619720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-465ff75a-cba4-47da-8966-419fcd7f125c tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:23.627018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-465ff75a-cba4-47da-8966-419fcd7f125c tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Searching by: {'host': 'n-h1-862967-2', 'deleted': False} {{(pid=127124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:49:23.632441 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-465ff75a-cba4-47da-8966-419fcd7f125c tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:23.633210 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-465ff75a-cba4-47da-8966-419fcd7f125c tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:23.634290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-465ff75a-cba4-47da-8966-419fcd7f125c tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:23.635205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-465ff75a-cba4-47da-8966-419fcd7f125c tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:23.635838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-465ff75a-cba4-47da-8966-419fcd7f125c tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:23.636464 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-465ff75a-cba4-47da-8966-419fcd7f125c tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:23.888006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:23.927195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.multi_cell_list [None req-465ff75a-cba4-47da-8966-419fcd7f125c tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Listed batch of 9 results from cell out of 1000 limit. Returned 9 total so far. {{(pid=127124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 02:49:24.201587 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-465ff75a-cba4-47da-8966-419fcd7f125c tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] 10.222.0.46 "GET /compute/v2.1/servers?host=n-h1-862967-2&all_tenants=1" status: 200 len: 2991 microversion: 2.1 time: 0.585331 Oct 29 02:49:24.204456 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 502/1015] 10.222.0.46 () {58 vars in 1190 bytes} [Sat Oct 29 02:49:23 2022] GET /compute/v2.1/servers?host=n-h1-862967-2&all_tenants=1 => generated 2991 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:24.217872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7c6bca0a-c268-49e3-b3d5-0c87631e0742 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:24.218763 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7c6bca0a-c268-49e3-b3d5-0c87631e0742 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:24.226700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c6bca0a-c268-49e3-b3d5-0c87631e0742 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:24.227377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c6bca0a-c268-49e3-b3d5-0c87631e0742 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:24.227974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c6bca0a-c268-49e3-b3d5-0c87631e0742 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:24.228891 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c6bca0a-c268-49e3-b3d5-0c87631e0742 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:24.229503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c6bca0a-c268-49e3-b3d5-0c87631e0742 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:24.230079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c6bca0a-c268-49e3-b3d5-0c87631e0742 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:24.625284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a206ba8a-cb44-4042-be4f-0f779e0d9fd4 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e823b4fb116c48ea92c2d3da58e10f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a70e4fa3141bb8b667b1be8e9594b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:24.656217 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a206ba8a-cb44-4042-be4f-0f779e0d9fd4 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54" status: 200 len: 1558 microversion: 2.1 time: 1.574008 Oct 29 02:49:24.661342 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 514/1016] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:23 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 => generated 1558 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:24.677532 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-911daf5c-8410-4c5c-8337-b6f2c86abc4c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:24.680778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-911daf5c-8410-4c5c-8337-b6f2c86abc4c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 03261ebe-4be4-4e74-bd8d-ff4a5ae066b1] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:24.696560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-911daf5c-8410-4c5c-8337-b6f2c86abc4c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:24.698660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-911daf5c-8410-4c5c-8337-b6f2c86abc4c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:24.700914 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-911daf5c-8410-4c5c-8337-b6f2c86abc4c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:24.702813 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-911daf5c-8410-4c5c-8337-b6f2c86abc4c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:24.706428 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-911daf5c-8410-4c5c-8337-b6f2c86abc4c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:24.709668 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-911daf5c-8410-4c5c-8337-b6f2c86abc4c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:24.729841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7c6bca0a-c268-49e3-b3d5-0c87631e0742 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:24.742678 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7c6bca0a-c268-49e3-b3d5-0c87631e0742 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88" status: 200 len: 1324 microversion: 2.1 time: 0.533241 Oct 29 02:49:24.743763 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 503/1017] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:24 2022] GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88 => generated 1324 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:24.756646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-150ee2ab-950f-441e-94a4-982c601bae4e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:24.757669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-150ee2ab-950f-441e-94a4-982c601bae4e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:24.765185 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:24.770608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-150ee2ab-950f-441e-94a4-982c601bae4e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:24.773241 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-150ee2ab-950f-441e-94a4-982c601bae4e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:24.774552 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-150ee2ab-950f-441e-94a4-982c601bae4e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:24.775916 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-150ee2ab-950f-441e-94a4-982c601bae4e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:24.776772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-150ee2ab-950f-441e-94a4-982c601bae4e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:24.780276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-150ee2ab-950f-441e-94a4-982c601bae4e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:24.859236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-911daf5c-8410-4c5c-8337-b6f2c86abc4c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 03261ebe-4be4-4e74-bd8d-ff4a5ae066b1] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:49:25.126259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-150ee2ab-950f-441e-94a4-982c601bae4e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:25.141132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-150ee2ab-950f-441e-94a4-982c601bae4e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:25.162378 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-150ee2ab-950f-441e-94a4-982c601bae4e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:25.182433 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-150ee2ab-950f-441e-94a4-982c601bae4e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.430060 Oct 29 02:49:25.187659 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 504/1018] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:24 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:25.217199 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-23dac3f5-d3c7-4cb0-9e6f-4b28cee6fec3 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:25.228342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-23dac3f5-d3c7-4cb0-9e6f-4b28cee6fec3 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=127124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:49:25.265732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23dac3f5-d3c7-4cb0-9e6f-4b28cee6fec3 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:25.268560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23dac3f5-d3c7-4cb0-9e6f-4b28cee6fec3 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:25.271632 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23dac3f5-d3c7-4cb0-9e6f-4b28cee6fec3 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:25.276108 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-911daf5c-8410-4c5c-8337-b6f2c86abc4c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "DELETE /compute/v2.1/servers/03261ebe-4be4-4e74-bd8d-ff4a5ae066b1" status: 204 len: 0 microversion: 2.1 time: 0.612760 Oct 29 02:49:25.276952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23dac3f5-d3c7-4cb0-9e6f-4b28cee6fec3 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:25.277663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23dac3f5-d3c7-4cb0-9e6f-4b28cee6fec3 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:25.281964 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 515/1019] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:49:24 2022] DELETE /compute/v2.1/servers/03261ebe-4be4-4e74-bd8d-ff4a5ae066b1 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:49:25.283857 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23dac3f5-d3c7-4cb0-9e6f-4b28cee6fec3 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:25.302591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a2e3d956-162f-466d-b3b0-abb9c66fbe25 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:25.305079 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a2e3d956-162f-466d-b3b0-abb9c66fbe25 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:25.329767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2e3d956-162f-466d-b3b0-abb9c66fbe25 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:25.330519 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2e3d956-162f-466d-b3b0-abb9c66fbe25 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:25.331136 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2e3d956-162f-466d-b3b0-abb9c66fbe25 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:25.332035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2e3d956-162f-466d-b3b0-abb9c66fbe25 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:25.332715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2e3d956-162f-466d-b3b0-abb9c66fbe25 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:25.333299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2e3d956-162f-466d-b3b0-abb9c66fbe25 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:25.398181 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-23dac3f5-d3c7-4cb0-9e6f-4b28cee6fec3 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] 10.222.0.46 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.196525 Oct 29 02:49:25.401977 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 505/1020] 10.222.0.46 () {58 vars in 1196 bytes} [Sat Oct 29 02:49:25 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:49:25.421709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-b26266de-c3f2-4f67-85a5-aef49d83518c req-21da8b31-630c-4463-b82d-63c8c6d0e7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "095efcbf-4088-49c1-9cb8-7d6b3f27af88", "tag": "185ed48c-c067-469d-825c-1ba39e43a77e"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:25.446862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b26266de-c3f2-4f67-85a5-aef49d83518c req-21da8b31-630c-4463-b82d-63c8c6d0e7d6 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:25.447722 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b26266de-c3f2-4f67-85a5-aef49d83518c req-21da8b31-630c-4463-b82d-63c8c6d0e7d6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:25.448347 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b26266de-c3f2-4f67-85a5-aef49d83518c req-21da8b31-630c-4463-b82d-63c8c6d0e7d6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:25.477525 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-b26266de-c3f2-4f67-85a5-aef49d83518c req-21da8b31-630c-4463-b82d-63c8c6d0e7d6 service nova] Creating event network-changed:185ed48c-c067-469d-825c-1ba39e43a77e for instance 095efcbf-4088-49c1-9cb8-7d6b3f27af88 on n-h2-862967-2 Oct 29 02:49:25.489700 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-b26266de-c3f2-4f67-85a5-aef49d83518c req-21da8b31-630c-4463-b82d-63c8c6d0e7d6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079127 Oct 29 02:49:25.491283 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 506/1021] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:25.507730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-43691255-f5df-4bb0-a976-640ffd1d8ee6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:25.511191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-43691255-f5df-4bb0-a976-640ffd1d8ee6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: d09276cf-e95a-47be-90e8-befb018ee5ab] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:25.543124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-43691255-f5df-4bb0-a976-640ffd1d8ee6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:25.543971 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-43691255-f5df-4bb0-a976-640ffd1d8ee6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:25.548174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-43691255-f5df-4bb0-a976-640ffd1d8ee6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:25.552755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-43691255-f5df-4bb0-a976-640ffd1d8ee6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:25.554071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-43691255-f5df-4bb0-a976-640ffd1d8ee6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:25.557973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-43691255-f5df-4bb0-a976-640ffd1d8ee6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:25.617379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-43691255-f5df-4bb0-a976-640ffd1d8ee6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: d09276cf-e95a-47be-90e8-befb018ee5ab] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:49:25.651521 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a2e3d956-162f-466d-b3b0-abb9c66fbe25 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.367424 Oct 29 02:49:25.668324 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 516/1022] 10.222.0.46 () {58 vars in 1275 bytes} [Sat Oct 29 02:49:25 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54/os-interface => generated 285 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:25.673494 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-edc873f7-17a2-435a-9066-97a1525aa592 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:25.685046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-edc873f7-17a2-435a-9066-97a1525aa592 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:25.706933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-edc873f7-17a2-435a-9066-97a1525aa592 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:25.710095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-edc873f7-17a2-435a-9066-97a1525aa592 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:25.710650 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-edc873f7-17a2-435a-9066-97a1525aa592 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:25.711402 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-edc873f7-17a2-435a-9066-97a1525aa592 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:25.711865 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-edc873f7-17a2-435a-9066-97a1525aa592 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:25.712284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-edc873f7-17a2-435a-9066-97a1525aa592 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:25.900169 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-43691255-f5df-4bb0-a976-640ffd1d8ee6 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab" status: 204 len: 0 microversion: 2.1 time: 0.405997 Oct 29 02:49:25.905189 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 507/1023] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:49:25 2022] DELETE /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:49:25.911180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-67d743c2-823a-4ab2-ba06-838bedd58673 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:25.922473 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-edc873f7-17a2-435a-9066-97a1525aa592 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685/action" status: 202 len: 0 microversion: 2.1 time: 0.256141 Oct 29 02:49:25.928091 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-67d743c2-823a-4ab2-ba06-838bedd58673 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:25.928448 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 517/1024] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:49:25 2022] POST /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:25.948746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bc61e1aa-9c1f-4698-b523-6c314b02202f tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:25.949180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:25.949393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bc61e1aa-9c1f-4698-b523-6c314b02202f tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 03261ebe-4be4-4e74-bd8d-ff4a5ae066b1] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:25.957613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67d743c2-823a-4ab2-ba06-838bedd58673 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:25.958099 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67d743c2-823a-4ab2-ba06-838bedd58673 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:25.958781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67d743c2-823a-4ab2-ba06-838bedd58673 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:25.959578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67d743c2-823a-4ab2-ba06-838bedd58673 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:25.960037 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67d743c2-823a-4ab2-ba06-838bedd58673 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:25.960667 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67d743c2-823a-4ab2-ba06-838bedd58673 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:25.977573 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc61e1aa-9c1f-4698-b523-6c314b02202f tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:25.978402 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc61e1aa-9c1f-4698-b523-6c314b02202f tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:25.978846 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc61e1aa-9c1f-4698-b523-6c314b02202f tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:25.979809 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc61e1aa-9c1f-4698-b523-6c314b02202f tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:25.980571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc61e1aa-9c1f-4698-b523-6c314b02202f tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:25.990988 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc61e1aa-9c1f-4698-b523-6c314b02202f tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:26.392507 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-67d743c2-823a-4ab2-ba06-838bedd58673 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:26.403067 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-67d743c2-823a-4ab2-ba06-838bedd58673 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88" status: 200 len: 1324 microversion: 2.1 time: 0.496199 Oct 29 02:49:26.404897 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 508/1025] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:25 2022] GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88 => generated 1324 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:26.417907 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d5230644-a9b7-4ac6-9738-dcfec8915c90 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:26.424745 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d5230644-a9b7-4ac6-9738-dcfec8915c90 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:26.441899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5230644-a9b7-4ac6-9738-dcfec8915c90 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:26.442370 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5230644-a9b7-4ac6-9738-dcfec8915c90 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:26.442804 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5230644-a9b7-4ac6-9738-dcfec8915c90 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:26.444090 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5230644-a9b7-4ac6-9738-dcfec8915c90 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:26.444738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5230644-a9b7-4ac6-9738-dcfec8915c90 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:26.445355 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5230644-a9b7-4ac6-9738-dcfec8915c90 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:26.530333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bc61e1aa-9c1f-4698-b523-6c314b02202f tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:26.573803 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bc61e1aa-9c1f-4698-b523-6c314b02202f tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/03261ebe-4be4-4e74-bd8d-ff4a5ae066b1" status: 200 len: 1470 microversion: 2.1 time: 0.642290 Oct 29 02:49:26.577884 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 518/1026] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:25 2022] GET /compute/v2.1/servers/03261ebe-4be4-4e74-bd8d-ff4a5ae066b1 => generated 1470 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:26.605723 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-651cd257-6d55-4766-9838-0d5d71d8c55f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:26.612718 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-651cd257-6d55-4766-9838-0d5d71d8c55f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:26.654229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-651cd257-6d55-4766-9838-0d5d71d8c55f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:26.655156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-651cd257-6d55-4766-9838-0d5d71d8c55f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:26.655156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-651cd257-6d55-4766-9838-0d5d71d8c55f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:26.655863 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-651cd257-6d55-4766-9838-0d5d71d8c55f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:26.656314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-651cd257-6d55-4766-9838-0d5d71d8c55f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:26.656751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-651cd257-6d55-4766-9838-0d5d71d8c55f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:26.681040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-d5230644-a9b7-4ac6-9738-dcfec8915c90 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:49:26.683330 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-d5230644-a9b7-4ac6-9738-dcfec8915c90 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:49:26.683836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-d5230644-a9b7-4ac6-9738-dcfec8915c90 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:49:26.684251 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-d5230644-a9b7-4ac6-9738-dcfec8915c90 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:49:26.686341 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-d5230644-a9b7-4ac6-9738-dcfec8915c90 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:49:26.809920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d5230644-a9b7-4ac6-9738-dcfec8915c90 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:26.823269 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5230644-a9b7-4ac6-9738-dcfec8915c90 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:26.823695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5230644-a9b7-4ac6-9738-dcfec8915c90 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:26.824138 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5230644-a9b7-4ac6-9738-dcfec8915c90 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:26.824919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5230644-a9b7-4ac6-9738-dcfec8915c90 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:26.825514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5230644-a9b7-4ac6-9738-dcfec8915c90 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:26.827765 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5230644-a9b7-4ac6-9738-dcfec8915c90 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:26.836596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-651cd257-6d55-4766-9838-0d5d71d8c55f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:26.847681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-651cd257-6d55-4766-9838-0d5d71d8c55f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:26.855324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-651cd257-6d55-4766-9838-0d5d71d8c55f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:26.874262 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-651cd257-6d55-4766-9838-0d5d71d8c55f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.294762 Oct 29 02:49:26.875518 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 519/1027] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:26 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:26.880877 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d5230644-a9b7-4ac6-9738-dcfec8915c90 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "POST /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685/action" status: 202 len: 1067 microversion: 2.1 time: 0.474760 Oct 29 02:49:26.882207 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 509/1028] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:49:26 2022] POST /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685/action => generated 1067 bytes in 477 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 29 02:49:26.907197 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5f5013bc-1515-42c2-8459-cfc4aa2e8c98 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:26.907826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5f5013bc-1515-42c2-8459-cfc4aa2e8c98 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:26.924661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f5013bc-1515-42c2-8459-cfc4aa2e8c98 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:26.926143 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f5013bc-1515-42c2-8459-cfc4aa2e8c98 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:26.926626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f5013bc-1515-42c2-8459-cfc4aa2e8c98 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:26.927608 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f5013bc-1515-42c2-8459-cfc4aa2e8c98 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:26.928230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f5013bc-1515-42c2-8459-cfc4aa2e8c98 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:26.928833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f5013bc-1515-42c2-8459-cfc4aa2e8c98 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:27.293680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5f5013bc-1515-42c2-8459-cfc4aa2e8c98 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:27.302127 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5f5013bc-1515-42c2-8459-cfc4aa2e8c98 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1471 microversion: 2.1 time: 0.400529 Oct 29 02:49:27.316879 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 520/1029] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:26 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1471 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:27.429669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b68f34c1-69b0-4d33-a616-f4af18fda907 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:27.430979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b68f34c1-69b0-4d33-a616-f4af18fda907 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:27.453180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b68f34c1-69b0-4d33-a616-f4af18fda907 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:27.453980 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b68f34c1-69b0-4d33-a616-f4af18fda907 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:27.454506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b68f34c1-69b0-4d33-a616-f4af18fda907 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:27.455415 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b68f34c1-69b0-4d33-a616-f4af18fda907 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:27.455943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b68f34c1-69b0-4d33-a616-f4af18fda907 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:27.456590 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b68f34c1-69b0-4d33-a616-f4af18fda907 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:27.601583 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6bf6beb8-104c-4a05-b457-1b7626c0e205 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:27.602202 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6bf6beb8-104c-4a05-b457-1b7626c0e205 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 03261ebe-4be4-4e74-bd8d-ff4a5ae066b1] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:27.608589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bf6beb8-104c-4a05-b457-1b7626c0e205 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:27.609326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bf6beb8-104c-4a05-b457-1b7626c0e205 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:27.609908 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bf6beb8-104c-4a05-b457-1b7626c0e205 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:27.610803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bf6beb8-104c-4a05-b457-1b7626c0e205 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:27.611409 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bf6beb8-104c-4a05-b457-1b7626c0e205 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:27.621421 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bf6beb8-104c-4a05-b457-1b7626c0e205 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:27.992783 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b68f34c1-69b0-4d33-a616-f4af18fda907 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:28.001220 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b68f34c1-69b0-4d33-a616-f4af18fda907 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88" status: 200 len: 1324 microversion: 2.1 time: 0.575296 Oct 29 02:49:28.013631 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 510/1030] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:27 2022] GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88 => generated 1324 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:28.018988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d47d2678-7689-4739-aa0e-1f273e4f9ed5 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:28.019602 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d47d2678-7689-4739-aa0e-1f273e4f9ed5 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:28.031705 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d47d2678-7689-4739-aa0e-1f273e4f9ed5 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:28.032241 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d47d2678-7689-4739-aa0e-1f273e4f9ed5 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:28.032718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d47d2678-7689-4739-aa0e-1f273e4f9ed5 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:28.033521 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d47d2678-7689-4739-aa0e-1f273e4f9ed5 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:28.034141 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d47d2678-7689-4739-aa0e-1f273e4f9ed5 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:28.034465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d47d2678-7689-4739-aa0e-1f273e4f9ed5 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:28.163456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d47d2678-7689-4739-aa0e-1f273e4f9ed5 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:28.177437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d47d2678-7689-4739-aa0e-1f273e4f9ed5 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:28.179177 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d47d2678-7689-4739-aa0e-1f273e4f9ed5 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:28.190553 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d47d2678-7689-4739-aa0e-1f273e4f9ed5 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.175525 Oct 29 02:49:28.194520 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 511/1031] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:28 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:28.253133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6bf6beb8-104c-4a05-b457-1b7626c0e205 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:28.300430 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6bf6beb8-104c-4a05-b457-1b7626c0e205 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/03261ebe-4be4-4e74-bd8d-ff4a5ae066b1" status: 200 len: 1470 microversion: 2.1 time: 0.680315 Oct 29 02:49:28.302258 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 521/1032] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:27 2022] GET /compute/v2.1/servers/03261ebe-4be4-4e74-bd8d-ff4a5ae066b1 => generated 1470 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:49:28.327112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2450fa5d-150c-4d4a-b269-317b5e698e57 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:28.327939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2450fa5d-150c-4d4a-b269-317b5e698e57 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:28.343028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2450fa5d-150c-4d4a-b269-317b5e698e57 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:28.344901 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2450fa5d-150c-4d4a-b269-317b5e698e57 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:28.347046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2450fa5d-150c-4d4a-b269-317b5e698e57 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:28.349219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2450fa5d-150c-4d4a-b269-317b5e698e57 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:28.351593 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2450fa5d-150c-4d4a-b269-317b5e698e57 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:28.353400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2450fa5d-150c-4d4a-b269-317b5e698e57 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:28.617721 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-3a8db2ed-48c7-48a8-a0c0-5e68a3ed2bb6 req-b8af9b41-8d20-4979-896e-a87288e6c70d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e14d80ff-4e71-4822-917c-ee46b9c7be54", "tag": "c7e34011-b5a8-480b-8c27-6a70268c0206"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:28.656181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3a8db2ed-48c7-48a8-a0c0-5e68a3ed2bb6 req-b8af9b41-8d20-4979-896e-a87288e6c70d service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:28.657714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3a8db2ed-48c7-48a8-a0c0-5e68a3ed2bb6 req-b8af9b41-8d20-4979-896e-a87288e6c70d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:28.658553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3a8db2ed-48c7-48a8-a0c0-5e68a3ed2bb6 req-b8af9b41-8d20-4979-896e-a87288e6c70d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:28.692597 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-3a8db2ed-48c7-48a8-a0c0-5e68a3ed2bb6 req-b8af9b41-8d20-4979-896e-a87288e6c70d service nova] Creating event network-changed:c7e34011-b5a8-480b-8c27-6a70268c0206 for instance e14d80ff-4e71-4822-917c-ee46b9c7be54 on n-h1-862967-2 Oct 29 02:49:28.706158 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-3a8db2ed-48c7-48a8-a0c0-5e68a3ed2bb6 req-b8af9b41-8d20-4979-896e-a87288e6c70d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092828 Oct 29 02:49:28.710063 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 522/1033] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:29.040801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ecb6b08d-18ef-472c-96f0-c4011789b4de tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:29.054382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ecb6b08d-18ef-472c-96f0-c4011789b4de tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:29.072425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecb6b08d-18ef-472c-96f0-c4011789b4de tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:29.085939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecb6b08d-18ef-472c-96f0-c4011789b4de tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:29.086783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecb6b08d-18ef-472c-96f0-c4011789b4de tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:29.087753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecb6b08d-18ef-472c-96f0-c4011789b4de tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:29.089519 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecb6b08d-18ef-472c-96f0-c4011789b4de tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:29.092083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecb6b08d-18ef-472c-96f0-c4011789b4de tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:29.603660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2450fa5d-150c-4d4a-b269-317b5e698e57 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:29.626398 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2450fa5d-150c-4d4a-b269-317b5e698e57 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1471 microversion: 2.1 time: 1.303636 Oct 29 02:49:29.635343 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 512/1034] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:28 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1471 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:29.656232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-059418f5-e255-49e4-bf67-09a43a1eba64 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:29.656972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-059418f5-e255-49e4-bf67-09a43a1eba64 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:29.692764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-059418f5-e255-49e4-bf67-09a43a1eba64 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:29.693313 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-059418f5-e255-49e4-bf67-09a43a1eba64 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:29.693752 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-059418f5-e255-49e4-bf67-09a43a1eba64 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:29.694472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-059418f5-e255-49e4-bf67-09a43a1eba64 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:29.695010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-059418f5-e255-49e4-bf67-09a43a1eba64 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:29.695511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-059418f5-e255-49e4-bf67-09a43a1eba64 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:29.783118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=10 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:30.231763 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-059418f5-e255-49e4-bf67-09a43a1eba64 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:30.245898 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-059418f5-e255-49e4-bf67-09a43a1eba64 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:30.256758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-059418f5-e255-49e4-bf67-09a43a1eba64 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:30.274613 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-059418f5-e255-49e4-bf67-09a43a1eba64 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.636595 Oct 29 02:49:30.292738 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 513/1035] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:29 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:30.310350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9651de59-1f0b-44a9-b388-9685015e917c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:30.310987 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9651de59-1f0b-44a9-b388-9685015e917c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 03261ebe-4be4-4e74-bd8d-ff4a5ae066b1] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:30.333700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9651de59-1f0b-44a9-b388-9685015e917c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:30.334390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9651de59-1f0b-44a9-b388-9685015e917c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:30.341151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9651de59-1f0b-44a9-b388-9685015e917c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:30.342557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9651de59-1f0b-44a9-b388-9685015e917c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:30.354884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9651de59-1f0b-44a9-b388-9685015e917c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:30.356479 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9651de59-1f0b-44a9-b388-9685015e917c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:30.432504 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ecb6b08d-18ef-472c-96f0-c4011789b4de tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:30.441847 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ecb6b08d-18ef-472c-96f0-c4011789b4de tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88" status: 200 len: 1324 microversion: 2.1 time: 1.407373 Oct 29 02:49:30.442644 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 523/1036] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:29 2022] GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88 => generated 1324 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:30.478466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-5b18c5f7-371b-4f80-88f7-65b5c8439295 req-cb48cdda-05cc-4af2-895a-0074656fec07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03261ebe-4be4-4e74-bd8d-ff4a5ae066b1", "name": "network-vif-deleted", "tag": "6c5bf628-34cf-4bf8-9ee2-dc88993acfd7"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:30.543618 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-5b18c5f7-371b-4f80-88f7-65b5c8439295 req-cb48cdda-05cc-4af2-895a-0074656fec07 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:30.548153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-5b18c5f7-371b-4f80-88f7-65b5c8439295 req-cb48cdda-05cc-4af2-895a-0074656fec07 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:30.549223 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-5b18c5f7-371b-4f80-88f7-65b5c8439295 req-cb48cdda-05cc-4af2-895a-0074656fec07 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:30.594732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9651de59-1f0b-44a9-b388-9685015e917c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:30.604258 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-5b18c5f7-371b-4f80-88f7-65b5c8439295 req-cb48cdda-05cc-4af2-895a-0074656fec07 service nova] Creating event network-vif-deleted:6c5bf628-34cf-4bf8-9ee2-dc88993acfd7 for instance 03261ebe-4be4-4e74-bd8d-ff4a5ae066b1 on n-h1-862967-2 Oct 29 02:49:30.617061 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9651de59-1f0b-44a9-b388-9685015e917c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/03261ebe-4be4-4e74-bd8d-ff4a5ae066b1" status: 200 len: 1428 microversion: 2.1 time: 0.320826 Oct 29 02:49:30.619046 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 514/1037] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:30 2022] GET /compute/v2.1/servers/03261ebe-4be4-4e74-bd8d-ff4a5ae066b1 => generated 1428 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:30.621254 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-5b18c5f7-371b-4f80-88f7-65b5c8439295 req-cb48cdda-05cc-4af2-895a-0074656fec07 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168725 Oct 29 02:49:30.624683 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 524/1038] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:30.668852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-370ed4d4-e789-4378-8258-e97122b44d4e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:30.669694 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-370ed4d4-e789-4378-8258-e97122b44d4e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:30.679491 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-370ed4d4-e789-4378-8258-e97122b44d4e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:30.681299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-370ed4d4-e789-4378-8258-e97122b44d4e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:30.681815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-370ed4d4-e789-4378-8258-e97122b44d4e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:30.683172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-370ed4d4-e789-4378-8258-e97122b44d4e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:30.684911 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-370ed4d4-e789-4378-8258-e97122b44d4e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:30.688251 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-370ed4d4-e789-4378-8258-e97122b44d4e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:30.978377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-370ed4d4-e789-4378-8258-e97122b44d4e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:30.992860 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-370ed4d4-e789-4378-8258-e97122b44d4e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1471 microversion: 2.1 time: 0.327317 Oct 29 02:49:31.018608 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 515/1039] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:30 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1471 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:31.313239 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-08794ead-c753-43a8-9b34-2c1424156caf tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:31.314033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-08794ead-c753-43a8-9b34-2c1424156caf tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:31.316374 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=10 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:31.339133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08794ead-c753-43a8-9b34-2c1424156caf tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:31.339133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08794ead-c753-43a8-9b34-2c1424156caf tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:31.339133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08794ead-c753-43a8-9b34-2c1424156caf tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:31.339133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08794ead-c753-43a8-9b34-2c1424156caf tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:31.339514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08794ead-c753-43a8-9b34-2c1424156caf tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:31.339514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08794ead-c753-43a8-9b34-2c1424156caf tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:31.469156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a071c1f7-b211-45da-aa73-7cd4ded4fb85 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:31.469729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a071c1f7-b211-45da-aa73-7cd4ded4fb85 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:31.482927 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a071c1f7-b211-45da-aa73-7cd4ded4fb85 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:31.483804 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a071c1f7-b211-45da-aa73-7cd4ded4fb85 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:31.484674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a071c1f7-b211-45da-aa73-7cd4ded4fb85 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:31.486461 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a071c1f7-b211-45da-aa73-7cd4ded4fb85 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:31.487278 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a071c1f7-b211-45da-aa73-7cd4ded4fb85 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:31.488035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a071c1f7-b211-45da-aa73-7cd4ded4fb85 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:31.495545 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:31.561844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-08794ead-c753-43a8-9b34-2c1424156caf tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:31.580909 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-08794ead-c753-43a8-9b34-2c1424156caf tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:31.584568 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-08794ead-c753-43a8-9b34-2c1424156caf tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:31.603499 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-08794ead-c753-43a8-9b34-2c1424156caf tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.295432 Oct 29 02:49:31.605204 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 525/1040] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:31 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:31.826413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a071c1f7-b211-45da-aa73-7cd4ded4fb85 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:31.839380 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a071c1f7-b211-45da-aa73-7cd4ded4fb85 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88" status: 200 len: 1324 microversion: 2.1 time: 0.374321 Oct 29 02:49:31.842955 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 516/1041] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:31 2022] GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88 => generated 1324 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:49:31.863025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eb8abcb0-2065-4044-b9a8-46d73c376461 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:31.863653 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-eb8abcb0-2065-4044-b9a8-46d73c376461 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 03261ebe-4be4-4e74-bd8d-ff4a5ae066b1] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:31.898677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb8abcb0-2065-4044-b9a8-46d73c376461 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:31.901353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb8abcb0-2065-4044-b9a8-46d73c376461 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:31.902087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb8abcb0-2065-4044-b9a8-46d73c376461 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:31.906554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb8abcb0-2065-4044-b9a8-46d73c376461 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:31.907103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb8abcb0-2065-4044-b9a8-46d73c376461 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:31.907555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb8abcb0-2065-4044-b9a8-46d73c376461 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:31.918641 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c8a1f9b7-4d6c-4176-b36c-b76788fa0059 tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] Action: 'create', calling method: .version_select at 0x7ff053e445e0>, body: {"keypair": {"name": "tempest-keypair-1817899537", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMI5hoUAqjA5DqhaktCLKQwbktE+4J4l07IgjkOERaRCob1hYLNFLx75Rf4LVPG6dicLM2FdtcwAuWVTO0NkwW0TICmeR1u8zAoXUpVbAmRTWqjjn7u6ua7FTPaNk7IrnA=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:31.937970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-c8a1f9b7-4d6c-4176-b36c-b76788fa0059 tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] Getting quotas for project 366c745c9ad8456dbe0b84d40b26b0be. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:49:31.945219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-c8a1f9b7-4d6c-4176-b36c-b76788fa0059 tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] Getting quotas for user 864d60fb205d4fe5b7d237665f7fb24f and project 366c745c9ad8456dbe0b84d40b26b0be. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:49:31.946364 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-eb8abcb0-2065-4044-b9a8-46d73c376461 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] HTTP exception thrown: Instance 03261ebe-4be4-4e74-bd8d-ff4a5ae066b1 could not be found. Oct 29 02:49:31.948081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eb8abcb0-2065-4044-b9a8-46d73c376461 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Request method failure captured: Oct 29 02:49:31.948081 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/03261ebe-4be4-4e74-bd8d-ff4a5ae066b1 HTTP/1.1 Oct 29 02:49:31.948081 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:49:31.948081 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:49:31.948081 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:49:31.948081 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:49:31.948081 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:49:31.948081 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:49:31.948081 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:49:31.948081 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:31.948081 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPtIMVuxUQ5sESBGcpDIyg0JlWGhaenNyoF1KsslH7tI-Ide1t1Qc6YWBoCicDg4iK9BWmVgzBvHQx10NYcQWd4V883MefaFkAV2l76Vzo9g4yJTR39I57-5iCCl5el4McwVe4d-eqtN30on7NVpVe0PpaW9_bFKynEcnhRDBRUQ1A Oct 29 02:49:31.948081 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:49:31.948081 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:49:31.948081 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:49:31.948081 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:49:31.948081 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:49:31.948081 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:49:31.948081 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: dcc6da8e69e041e19023a53a23e33393 Oct 29 02:49:31.948081 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersOnMultiNodesTest-354009816 Oct 29 02:49:31.948081 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:49:31.948081 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:49:31.949695 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dcc6da8e69e041e19023a53a23e33393"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dcc6da8e69e041e19023a53a23e33393"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_dcc6da8e69e041e19023a53a23e33393"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/dcc6da8e69e041e19023a53a23e33393"}]}] Oct 29 02:49:31.949695 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersOnMultiNodesTest-354009816 Oct 29 02:49:31.949695 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: dcc6da8e69e041e19023a53a23e33393 Oct 29 02:49:31.949695 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-354009816 Oct 29 02:49:31.949695 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersOnMultiNodesTest-354009816-project Oct 29 02:49:31.949695 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:49:31.949695 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:49:31.949695 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 509ce04aeb3847f084629201bd7ae5d6 Oct 29 02:49:31.949695 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersOnMultiNodesTest-354009816-project Oct 29 02:49:31.949695 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:49:31.949695 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 03261ebe-4be4-4e74-bd8d-ff4a5ae066b1 could not be found. Oct 29 02:49:31.949695 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '03261ebe-4be4-4e74-bd8d-ff4a5ae066b1'} Oct 29 02:49:31.951146 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:31.951146 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:31.951146 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:49:31.951146 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:49:31.951146 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:49:31.951146 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:49:31.951146 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:49:31.951146 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:49:31.951146 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:49:31.951146 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:49:31.951146 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03261ebe-4be4-4e74-bd8d-ff4a5ae066b1 could not be found. Oct 29 02:49:31.951146 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:31.951146 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:31.951146 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:31.951146 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:31.951146 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:31.951146 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:31.951146 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:31.951146 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:31.951146 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:31.952670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:31.952670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:49:31.952670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:49:31.952670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:49:31.952670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:49:31.952670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:49:31.952670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:49:31.952670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03261ebe-4be4-4e74-bd8d-ff4a5ae066b1 could not be found. Oct 29 02:49:31.952670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:31.952670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:31.952670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:31.952670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:31.952670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:31.952670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:31.952670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:31.952670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:31.952670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03261ebe-4be4-4e74-bd8d-ff4a5ae066b1 could not be found. Oct 29 02:49:31.952670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:31.964431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eb8abcb0-2065-4044-b9a8-46d73c376461 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Returning 404 to user: Instance 03261ebe-4be4-4e74-bd8d-ff4a5ae066b1 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:31.965602 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eb8abcb0-2065-4044-b9a8-46d73c376461 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/03261ebe-4be4-4e74-bd8d-ff4a5ae066b1" status: 404 len: 111 microversion: 2.1 time: 0.120847 Oct 29 02:49:31.969548 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 517/1042] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:31 2022] GET /compute/v2.1/servers/03261ebe-4be4-4e74-bd8d-ff4a5ae066b1 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:32.008348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fc9bc43b-ae00-4a85-b6b6-9986056e96db tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:32.009350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fc9bc43b-ae00-4a85-b6b6-9986056e96db tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: d09276cf-e95a-47be-90e8-befb018ee5ab] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:32.017329 n-d-862967-2 devstack@n-api.service[127125]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c8a1f9b7-4d6c-4176-b36c-b76788fa0059 tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] [6eee867f-424a-42b4-a30e-df10028d97ed] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 02:49:32.030679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc9bc43b-ae00-4a85-b6b6-9986056e96db tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:32.031159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc9bc43b-ae00-4a85-b6b6-9986056e96db tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:32.035898 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc9bc43b-ae00-4a85-b6b6-9986056e96db tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:32.036686 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc9bc43b-ae00-4a85-b6b6-9986056e96db tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:32.037161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc9bc43b-ae00-4a85-b6b6-9986056e96db tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:32.037897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc9bc43b-ae00-4a85-b6b6-9986056e96db tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:32.179228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fc9bc43b-ae00-4a85-b6b6-9986056e96db tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:32.188168 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fc9bc43b-ae00-4a85-b6b6-9986056e96db tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab" status: 200 len: 1300 microversion: 2.1 time: 0.214539 Oct 29 02:49:32.189255 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 518/1043] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:31 2022] GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab => generated 1300 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:49:32.194200 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3cbd0f11-0e78-4319-86ab-50289a0a9f03 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:32.194903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3cbd0f11-0e78-4319-86ab-50289a0a9f03 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:32.201473 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3cbd0f11-0e78-4319-86ab-50289a0a9f03 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:32.202048 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3cbd0f11-0e78-4319-86ab-50289a0a9f03 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:32.202638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3cbd0f11-0e78-4319-86ab-50289a0a9f03 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:32.203425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3cbd0f11-0e78-4319-86ab-50289a0a9f03 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:32.203938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3cbd0f11-0e78-4319-86ab-50289a0a9f03 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:32.204450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3cbd0f11-0e78-4319-86ab-50289a0a9f03 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:32.681833 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3cbd0f11-0e78-4319-86ab-50289a0a9f03 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:32.705770 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3cbd0f11-0e78-4319-86ab-50289a0a9f03 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1471 microversion: 2.1 time: 0.514361 Oct 29 02:49:32.708462 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 519/1044] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:32 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1471 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:32.722528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e05b5308-fae2-4101-a306-0499fbbc2f9d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:32.723567 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e05b5308-fae2-4101-a306-0499fbbc2f9d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:32.746009 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e05b5308-fae2-4101-a306-0499fbbc2f9d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:32.749519 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e05b5308-fae2-4101-a306-0499fbbc2f9d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:32.751950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e05b5308-fae2-4101-a306-0499fbbc2f9d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:32.752746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e05b5308-fae2-4101-a306-0499fbbc2f9d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:32.754124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e05b5308-fae2-4101-a306-0499fbbc2f9d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:32.754124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e05b5308-fae2-4101-a306-0499fbbc2f9d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:32.891500 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e05b5308-fae2-4101-a306-0499fbbc2f9d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:32.903483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e05b5308-fae2-4101-a306-0499fbbc2f9d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:32.905439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e05b5308-fae2-4101-a306-0499fbbc2f9d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:32.912477 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e05b5308-fae2-4101-a306-0499fbbc2f9d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.202219 Oct 29 02:49:32.928975 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 520/1045] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:32 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:32.938758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-58473a46-db33-4309-a8e8-69eff53010f9 req-fb72fb53-ef72-436c-9376-d9ca467ed718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09276cf-e95a-47be-90e8-befb018ee5ab", "name": "network-vif-deleted", "tag": "f141616b-7c4f-401f-aa06-bf21863f5f3d"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:32.949616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-58473a46-db33-4309-a8e8-69eff53010f9 req-fb72fb53-ef72-436c-9376-d9ca467ed718 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:32.950138 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-58473a46-db33-4309-a8e8-69eff53010f9 req-fb72fb53-ef72-436c-9376-d9ca467ed718 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:32.950569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-58473a46-db33-4309-a8e8-69eff53010f9 req-fb72fb53-ef72-436c-9376-d9ca467ed718 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:32.971674 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-58473a46-db33-4309-a8e8-69eff53010f9 req-fb72fb53-ef72-436c-9376-d9ca467ed718 service nova] Creating event network-vif-deleted:f141616b-7c4f-401f-aa06-bf21863f5f3d for instance d09276cf-e95a-47be-90e8-befb018ee5ab on n-h2-862967-2 Oct 29 02:49:32.977327 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-58473a46-db33-4309-a8e8-69eff53010f9 req-fb72fb53-ef72-436c-9376-d9ca467ed718 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046806 Oct 29 02:49:32.978164 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 521/1046] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:32.984234 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1327371b-b5b7-45e5-b6bc-a70d4fcaddd4 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:32.984990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1327371b-b5b7-45e5-b6bc-a70d4fcaddd4 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: 20602fbc-9893-433b-b711-3de8a31a4608] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:32.992565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1327371b-b5b7-45e5-b6bc-a70d4fcaddd4 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:32.993123 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1327371b-b5b7-45e5-b6bc-a70d4fcaddd4 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:32.993681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1327371b-b5b7-45e5-b6bc-a70d4fcaddd4 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:32.994472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1327371b-b5b7-45e5-b6bc-a70d4fcaddd4 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:32.995002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1327371b-b5b7-45e5-b6bc-a70d4fcaddd4 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:32.995607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1327371b-b5b7-45e5-b6bc-a70d4fcaddd4 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:33.025127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1327371b-b5b7-45e5-b6bc-a70d4fcaddd4 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: 20602fbc-9893-433b-b711-3de8a31a4608] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:49:33.026094 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [None req-c8a1f9b7-4d6c-4176-b36c-b76788fa0059 tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] [6eee867f-424a-42b4-a30e-df10028d97ed] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 34698. Oct 29 02:49:33.052490 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c8a1f9b7-4d6c-4176-b36c-b76788fa0059 tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.434720 Oct 29 02:49:33.053665 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 526/1047] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 02:49:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:33.058597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-094bdf77-b59f-477b-87df-73823fdb369d tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:33.065119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-094bdf77-b59f-477b-87df-73823fdb369d tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:33.091226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-094bdf77-b59f-477b-87df-73823fdb369d tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:33.092112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-094bdf77-b59f-477b-87df-73823fdb369d tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:33.092812 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-094bdf77-b59f-477b-87df-73823fdb369d tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:33.096198 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-094bdf77-b59f-477b-87df-73823fdb369d tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:33.097003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-094bdf77-b59f-477b-87df-73823fdb369d tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:33.097650 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-094bdf77-b59f-477b-87df-73823fdb369d tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:33.157619 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1327371b-b5b7-45e5-b6bc-a70d4fcaddd4 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "DELETE /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608" status: 204 len: 0 microversion: 2.1 time: 0.177779 Oct 29 02:49:33.157963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:33.161417 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 522/1048] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:49:32 2022] DELETE /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:49:33.166385 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-27b73808-8531-4110-81a2-a46592d10434 tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] Calling method '.version_select at 0x7ff053f84310>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:33.192687 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-27b73808-8531-4110-81a2-a46592d10434 tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs/tempest-keypair-1817899537" status: 200 len: 497 microversion: 2.1 time: 0.031636 Oct 29 02:49:33.193379 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 523/1049] 10.222.0.46 () {58 vars in 1218 bytes} [Sat Oct 29 02:49:33 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1817899537 => generated 497 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:33.215061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f7b077f6-922b-4d02-af82-ed1dbeeb3a16 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:33.219209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f7b077f6-922b-4d02-af82-ed1dbeeb3a16 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: 20602fbc-9893-433b-b711-3de8a31a4608] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:33.231357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7b077f6-922b-4d02-af82-ed1dbeeb3a16 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:33.231889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7b077f6-922b-4d02-af82-ed1dbeeb3a16 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:33.232327 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7b077f6-922b-4d02-af82-ed1dbeeb3a16 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:33.233085 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7b077f6-922b-4d02-af82-ed1dbeeb3a16 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:33.236066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7b077f6-922b-4d02-af82-ed1dbeeb3a16 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:33.236066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7b077f6-922b-4d02-af82-ed1dbeeb3a16 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:33.424173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-094bdf77-b59f-477b-87df-73823fdb369d tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:33.435813 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-094bdf77-b59f-477b-87df-73823fdb369d tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88" status: 200 len: 1324 microversion: 2.1 time: 0.380409 Oct 29 02:49:33.446691 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 527/1050] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:33 2022] GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88 => generated 1324 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:33.457204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-763e5477-9230-48ae-9d71-9316e48936c1 tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] Calling method '.version_select at 0x7ff053ec45e0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:33.533694 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-763e5477-9230-48ae-9d71-9316e48936c1 tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1817899537" status: 202 len: 0 microversion: 2.1 time: 0.082366 Oct 29 02:49:33.544325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f7b077f6-922b-4d02-af82-ed1dbeeb3a16 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:33.546093 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 528/1051] 10.222.0.46 () {58 vars in 1221 bytes} [Sat Oct 29 02:49:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1817899537 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:33.559211 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f7b077f6-922b-4d02-af82-ed1dbeeb3a16 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608" status: 200 len: 1712 microversion: 2.1 time: 0.355173 Oct 29 02:49:33.560341 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a7a9b799-0426-4136-85bc-bb1a9be231fd tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:33.562134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a7a9b799-0426-4136-85bc-bb1a9be231fd tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: d09276cf-e95a-47be-90e8-befb018ee5ab] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:33.579115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7a9b799-0426-4136-85bc-bb1a9be231fd tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:33.580293 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7a9b799-0426-4136-85bc-bb1a9be231fd tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:33.581198 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7a9b799-0426-4136-85bc-bb1a9be231fd tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:33.582897 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 524/1052] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:33 2022] GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608 => generated 1712 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:33.583806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7a9b799-0426-4136-85bc-bb1a9be231fd tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:33.586134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7a9b799-0426-4136-85bc-bb1a9be231fd tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:33.587461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7a9b799-0426-4136-85bc-bb1a9be231fd tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:33.592588 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-57b93eab-39b1-4769-9ae5-2e7dac867571 tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] Action: 'create', calling method: .version_select at 0x7ff053e8b9d0>, body: {"keypair": {"name": "tempest-keypair-1446215783", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6m5wEd8dgqloWny656wae4R8mZYZnTVC6r2E+3C4oWLB4oJty6KF1VPrAVtFJzwQPY8V99NNB7fcqifhxmNQ4MlNNfhea+bLvQ+laTBv8cDMpv5INdIccDyWfL/riwjg=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:33.616412 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-57b93eab-39b1-4769-9ae5-2e7dac867571 tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] Getting quotas for project 366c745c9ad8456dbe0b84d40b26b0be. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:49:33.622270 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-57b93eab-39b1-4769-9ae5-2e7dac867571 tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] Getting quotas for user 864d60fb205d4fe5b7d237665f7fb24f and project 366c745c9ad8456dbe0b84d40b26b0be. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:49:33.644775 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7a9b799-0426-4136-85bc-bb1a9be231fd tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:33.645803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7a9b799-0426-4136-85bc-bb1a9be231fd tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:33.646596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7a9b799-0426-4136-85bc-bb1a9be231fd tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:33.647571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-a7a9b799-0426-4136-85bc-bb1a9be231fd tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lazy-loading 'fault' on Instance uuid d09276cf-e95a-47be-90e8-befb018ee5ab {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:49:33.651702 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-57b93eab-39b1-4769-9ae5-2e7dac867571 tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065839 Oct 29 02:49:33.658064 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 525/1053] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 02:49:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:33.667896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ea19651b-fa2b-4413-9a34-6f36cfcf0cd6 tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] Calling method '.version_select at 0x7ff053d700d0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:33.710278 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ea19651b-fa2b-4413-9a34-6f36cfcf0cd6 tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1446215783" status: 202 len: 0 microversion: 2.1 time: 0.047644 Oct 29 02:49:33.712739 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 526/1054] 10.222.0.46 () {58 vars in 1221 bytes} [Sat Oct 29 02:49:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1446215783 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:33.726330 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0a3e9ffd-c766-43ce-8ee8-f590045166e7 tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] Action: 'create', calling method: .version_select at 0x7ff053d42160>, body: {"keypair": {"name": "tempest-keypair-1330919694", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:33.730753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a7a9b799-0426-4136-85bc-bb1a9be231fd tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:33.737492 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a7a9b799-0426-4136-85bc-bb1a9be231fd tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab" status: 200 len: 1305 microversion: 2.1 time: 0.189957 Oct 29 02:49:33.749183 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 529/1055] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:33 2022] GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab => generated 1305 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:33.759640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f03d0f53-f005-4b15-bfeb-2b19c5b1085f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:33.760254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f03d0f53-f005-4b15-bfeb-2b19c5b1085f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:33.763927 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-0a3e9ffd-c766-43ce-8ee8-f590045166e7 tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] Getting quotas for project 366c745c9ad8456dbe0b84d40b26b0be. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:49:33.766316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f03d0f53-f005-4b15-bfeb-2b19c5b1085f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:33.766807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f03d0f53-f005-4b15-bfeb-2b19c5b1085f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:33.767233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f03d0f53-f005-4b15-bfeb-2b19c5b1085f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:33.767945 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f03d0f53-f005-4b15-bfeb-2b19c5b1085f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:33.768412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f03d0f53-f005-4b15-bfeb-2b19c5b1085f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:33.768916 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f03d0f53-f005-4b15-bfeb-2b19c5b1085f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:33.771065 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-0a3e9ffd-c766-43ce-8ee8-f590045166e7 tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] Getting quotas for user 864d60fb205d4fe5b7d237665f7fb24f and project 366c745c9ad8456dbe0b84d40b26b0be. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:49:33.806181 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0a3e9ffd-c766-43ce-8ee8-f590045166e7 tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.087934 Oct 29 02:49:33.809956 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 527/1056] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 02:49:33 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:33.820584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5ba8e96c-2014-4f11-b1a4-43663c6b6e47 tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] Calling method '.version_select at 0x7ff053d42280>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:33.854243 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5ba8e96c-2014-4f11-b1a4-43663c6b6e47 tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1330919694" status: 202 len: 0 microversion: 2.1 time: 0.036275 Oct 29 02:49:33.855151 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 528/1057] 10.222.0.46 () {58 vars in 1221 bytes} [Sat Oct 29 02:49:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1330919694 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 02:49:33.871446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0af24db6-ac9e-46e0-aeda-fb6a636f3afc tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] Action: 'create', calling method: .version_select at 0x7ff053d70430>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1460088696", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7/yF72rvlRjXYxK3yKpy1DZgzKRvpO3U6w2kMncO5XX8oS/6OTMBDKuNYo1GUS45O843/43q9vV87HGf/vU6N8OuaAznZI9iKWvjYY+Pqu1djGxFubt41n7/T/QanB3w=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:33.888548 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:33.896293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-0af24db6-ac9e-46e0-aeda-fb6a636f3afc tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] Getting quotas for project 366c745c9ad8456dbe0b84d40b26b0be. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:49:33.914160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-0af24db6-ac9e-46e0-aeda-fb6a636f3afc tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] Getting quotas for user 864d60fb205d4fe5b7d237665f7fb24f and project 366c745c9ad8456dbe0b84d40b26b0be. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:49:33.947107 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0af24db6-ac9e-46e0-aeda-fb6a636f3afc tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.083893 Oct 29 02:49:33.948210 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 529/1058] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 02:49:33 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:33.975185 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-78e40b05-25ed-49f1-a62e-d30ffec4744f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:33.975323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f03d0f53-f005-4b15-bfeb-2b19c5b1085f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:33.975803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-78e40b05-25ed-49f1-a62e-d30ffec4744f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:33.982328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78e40b05-25ed-49f1-a62e-d30ffec4744f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:33.982861 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78e40b05-25ed-49f1-a62e-d30ffec4744f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:33.983289 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78e40b05-25ed-49f1-a62e-d30ffec4744f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:33.984052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78e40b05-25ed-49f1-a62e-d30ffec4744f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:33.984515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78e40b05-25ed-49f1-a62e-d30ffec4744f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:33.985000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78e40b05-25ed-49f1-a62e-d30ffec4744f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:33.985756 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f03d0f53-f005-4b15-bfeb-2b19c5b1085f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1471 microversion: 2.1 time: 0.234767 Oct 29 02:49:33.987520 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 530/1059] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:33 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1471 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:33.993173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6bd986d4-5a5c-4baa-84e7-494a116c5262 tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] Action: 'create', calling method: .version_select at 0x7ff053e8cdc0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1804217115", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAlr3bVkg1eXjWntXx40HAswoMYGI7/dROqxvZ9v3RWgBuxPhg7jGkImNLFJGj7i+mjSIU/Yqcf7PFfGVWPr5H7m1TcgG/90hJQ3MPVYSzxvN4uBnaQNOHboM3Cbq5j9g=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:34.032099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-6bd986d4-5a5c-4baa-84e7-494a116c5262 tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] Getting quotas for project 366c745c9ad8456dbe0b84d40b26b0be. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:49:34.042427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-6bd986d4-5a5c-4baa-84e7-494a116c5262 tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] Getting quotas for user 864d60fb205d4fe5b7d237665f7fb24f and project 366c745c9ad8456dbe0b84d40b26b0be. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:49:34.071650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-78e40b05-25ed-49f1-a62e-d30ffec4744f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:34.081569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-78e40b05-25ed-49f1-a62e-d30ffec4744f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:34.084725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-78e40b05-25ed-49f1-a62e-d30ffec4744f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:34.090117 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-78e40b05-25ed-49f1-a62e-d30ffec4744f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.140514 Oct 29 02:49:34.090838 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 530/1060] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:33 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:34.107740 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6bd986d4-5a5c-4baa-84e7-494a116c5262 tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.118686 Oct 29 02:49:34.116410 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 531/1061] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 02:49:33 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:34.122016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4a3b169d-618e-4665-a91f-c981e7de435c tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] Action: 'create', calling method: .version_select at 0x7ff053d70c10>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1556267150", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJbhu1So70R5QvxowAPyE9HBEg6TnrfCfvzO2woA4UNr7X1aunb5dyeqhe5OY2K3ybhUWAOHn/FL4JZelryeegYO+rM6U0fuwZ5G00PKsfwyFbg9/ATfByZ+3o9YzHZQg=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:34.140047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-4a3b169d-618e-4665-a91f-c981e7de435c tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] Getting quotas for project 366c745c9ad8456dbe0b84d40b26b0be. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:49:34.146569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-4a3b169d-618e-4665-a91f-c981e7de435c tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] Getting quotas for user 864d60fb205d4fe5b7d237665f7fb24f and project 366c745c9ad8456dbe0b84d40b26b0be. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:49:34.187741 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4a3b169d-618e-4665-a91f-c981e7de435c tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.069596 Oct 29 02:49:34.193981 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 531/1062] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 02:49:34 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:49:34.199421 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4e3ced76-981c-4735-9317-77022923dbf2 tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] Calling method '.version_select at 0x7ff053d4a310>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:34.203764 n-d-862967-2 devstack@n-api.service[127125]: WARNING oslo_db.sqlalchemy.utils [None req-4e3ced76-981c-4735-9317-77022923dbf2 tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 29 02:49:34.212926 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4e3ced76-981c-4735-9317-77022923dbf2 tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs" status: 200 len: 1094 microversion: 2.1 time: 0.017329 Oct 29 02:49:34.213517 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 532/1063] 10.222.0.46 () {58 vars in 1137 bytes} [Sat Oct 29 02:49:34 2022] GET /compute/v2.1/os-keypairs => generated 1094 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:49:34.226391 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1c41c9c7-0731-4803-b136-e863bf8bc9ef tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] Calling method '.version_select at 0x7ff053ea91f0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:34.247563 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1c41c9c7-0731-4803-b136-e863bf8bc9ef tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1556267150" status: 202 len: 0 microversion: 2.1 time: 0.025439 Oct 29 02:49:34.248996 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 532/1064] 10.222.0.46 () {58 vars in 1278 bytes} [Sat Oct 29 02:49:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1556267150 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:34.257377 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d060d35a-e8e8-49a2-a16b-d53d524228fa tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] Calling method '.version_select at 0x7ff053e203a0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:34.281144 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d060d35a-e8e8-49a2-a16b-d53d524228fa tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1804217115" status: 202 len: 0 microversion: 2.1 time: 0.027652 Oct 29 02:49:34.281743 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 533/1065] 10.222.0.46 () {58 vars in 1278 bytes} [Sat Oct 29 02:49:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1804217115 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:34.290938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b7491c7a-e941-4c8f-9d0e-d3408bd55c8c tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] Calling method '.version_select at 0x7ff053d723a0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:34.314590 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b7491c7a-e941-4c8f-9d0e-d3408bd55c8c tempest-KeyPairsV2TestJSON-1059936865 tempest-KeyPairsV2TestJSON-1059936865-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1460088696" status: 202 len: 0 microversion: 2.1 time: 0.027905 Oct 29 02:49:34.315802 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 533/1066] 10.222.0.46 () {58 vars in 1278 bytes} [Sat Oct 29 02:49:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1460088696 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 02:49:34.459791 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5768dd9a-60da-4f92-975f-cf40ad3dbe79 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:34.460405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5768dd9a-60da-4f92-975f-cf40ad3dbe79 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:34.475296 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5768dd9a-60da-4f92-975f-cf40ad3dbe79 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:34.475765 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5768dd9a-60da-4f92-975f-cf40ad3dbe79 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:34.484758 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5768dd9a-60da-4f92-975f-cf40ad3dbe79 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:34.485923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5768dd9a-60da-4f92-975f-cf40ad3dbe79 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:34.486668 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5768dd9a-60da-4f92-975f-cf40ad3dbe79 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:34.487120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5768dd9a-60da-4f92-975f-cf40ad3dbe79 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:34.562677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-a216f1a0-d81b-4fe7-98ec-2dd87fa32551 req-45bd5c3b-ff56-43b2-a555-ab4beb8a433c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "095efcbf-4088-49c1-9cb8-7d6b3f27af88", "name": "network-vif-plugged", "status": "completed", "tag": "185ed48c-c067-469d-825c-1ba39e43a77e"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:34.597917 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a216f1a0-d81b-4fe7-98ec-2dd87fa32551 req-45bd5c3b-ff56-43b2-a555-ab4beb8a433c service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:34.601081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a216f1a0-d81b-4fe7-98ec-2dd87fa32551 req-45bd5c3b-ff56-43b2-a555-ab4beb8a433c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:34.601081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a216f1a0-d81b-4fe7-98ec-2dd87fa32551 req-45bd5c3b-ff56-43b2-a555-ab4beb8a433c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:34.629713 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-a216f1a0-d81b-4fe7-98ec-2dd87fa32551 req-45bd5c3b-ff56-43b2-a555-ab4beb8a433c service nova] Creating event network-vif-plugged:185ed48c-c067-469d-825c-1ba39e43a77e for instance 095efcbf-4088-49c1-9cb8-7d6b3f27af88 on n-h2-862967-2 Oct 29 02:49:34.637105 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-a216f1a0-d81b-4fe7-98ec-2dd87fa32551 req-45bd5c3b-ff56-43b2-a555-ab4beb8a433c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077560 Oct 29 02:49:34.640960 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 534/1067] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:34.647802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c3b76acc-e2e2-4f80-9e91-0ed1db64edfb tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:34.652928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c3b76acc-e2e2-4f80-9e91-0ed1db64edfb tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: 20602fbc-9893-433b-b711-3de8a31a4608] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:34.661419 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3b76acc-e2e2-4f80-9e91-0ed1db64edfb tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:34.663983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3b76acc-e2e2-4f80-9e91-0ed1db64edfb tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:34.666696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3b76acc-e2e2-4f80-9e91-0ed1db64edfb tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:34.677886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3b76acc-e2e2-4f80-9e91-0ed1db64edfb tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:34.678579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3b76acc-e2e2-4f80-9e91-0ed1db64edfb tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:34.679112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3b76acc-e2e2-4f80-9e91-0ed1db64edfb tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:34.773518 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5768dd9a-60da-4f92-975f-cf40ad3dbe79 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:34.787948 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5768dd9a-60da-4f92-975f-cf40ad3dbe79 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88" status: 200 len: 1324 microversion: 2.1 time: 0.332278 Oct 29 02:49:34.789120 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 534/1068] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:34 2022] GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88 => generated 1324 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:34.794993 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-01a85fa2-d8e2-454c-be05-6d60829e10f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:34.796019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-01a85fa2-d8e2-454c-be05-6d60829e10f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: d09276cf-e95a-47be-90e8-befb018ee5ab] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:34.807765 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01a85fa2-d8e2-454c-be05-6d60829e10f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:34.809187 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01a85fa2-d8e2-454c-be05-6d60829e10f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:34.809730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01a85fa2-d8e2-454c-be05-6d60829e10f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:34.810559 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01a85fa2-d8e2-454c-be05-6d60829e10f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:34.811116 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01a85fa2-d8e2-454c-be05-6d60829e10f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:34.811737 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01a85fa2-d8e2-454c-be05-6d60829e10f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:34.866101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01a85fa2-d8e2-454c-be05-6d60829e10f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:34.866738 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01a85fa2-d8e2-454c-be05-6d60829e10f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:34.867093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01a85fa2-d8e2-454c-be05-6d60829e10f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:34.867633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-01a85fa2-d8e2-454c-be05-6d60829e10f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lazy-loading 'fault' on Instance uuid d09276cf-e95a-47be-90e8-befb018ee5ab {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:49:34.920332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c3b76acc-e2e2-4f80-9e91-0ed1db64edfb tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:34.930035 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c3b76acc-e2e2-4f80-9e91-0ed1db64edfb tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608" status: 200 len: 1712 microversion: 2.1 time: 0.287578 Oct 29 02:49:34.932577 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 535/1069] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:34 2022] GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608 => generated 1712 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:34.943736 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-01a85fa2-d8e2-454c-be05-6d60829e10f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:34.955587 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-01a85fa2-d8e2-454c-be05-6d60829e10f5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab" status: 200 len: 1305 microversion: 2.1 time: 0.164673 Oct 29 02:49:34.956982 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 535/1070] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:34 2022] GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab => generated 1305 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:35.010864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-66149dc5-365a-4bb7-8e0e-d37945460162 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:35.011620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-66149dc5-365a-4bb7-8e0e-d37945460162 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:35.021392 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66149dc5-365a-4bb7-8e0e-d37945460162 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:35.021967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66149dc5-365a-4bb7-8e0e-d37945460162 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:35.022517 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66149dc5-365a-4bb7-8e0e-d37945460162 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:35.023365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66149dc5-365a-4bb7-8e0e-d37945460162 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:35.024122 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66149dc5-365a-4bb7-8e0e-d37945460162 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:35.024919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66149dc5-365a-4bb7-8e0e-d37945460162 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:35.121559 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f6a8694a-d5d7-49e8-8720-3978ad2d84f7 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:35.122870 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f6a8694a-d5d7-49e8-8720-3978ad2d84f7 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:35.127038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:35.142260 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6a8694a-d5d7-49e8-8720-3978ad2d84f7 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:35.142769 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6a8694a-d5d7-49e8-8720-3978ad2d84f7 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:35.143203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6a8694a-d5d7-49e8-8720-3978ad2d84f7 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:35.143918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6a8694a-d5d7-49e8-8720-3978ad2d84f7 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:35.144430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6a8694a-d5d7-49e8-8720-3978ad2d84f7 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:35.144937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6a8694a-d5d7-49e8-8720-3978ad2d84f7 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:35.250719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-66149dc5-365a-4bb7-8e0e-d37945460162 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:35.265225 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-66149dc5-365a-4bb7-8e0e-d37945460162 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1471 microversion: 2.1 time: 0.259319 Oct 29 02:49:35.292728 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 536/1071] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:35 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1471 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:35.338937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f6a8694a-d5d7-49e8-8720-3978ad2d84f7 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:35.350155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f6a8694a-d5d7-49e8-8720-3978ad2d84f7 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:35.352037 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f6a8694a-d5d7-49e8-8720-3978ad2d84f7 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:35.358972 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f6a8694a-d5d7-49e8-8720-3978ad2d84f7 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.243221 Oct 29 02:49:35.360370 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 536/1072] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:35 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:49:35.812104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d4c13c93-edbe-45d8-8fec-1bdf8e9cd822 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:35.812923 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d4c13c93-edbe-45d8-8fec-1bdf8e9cd822 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:35.814970 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=10 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:35.824104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4c13c93-edbe-45d8-8fec-1bdf8e9cd822 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:35.829188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4c13c93-edbe-45d8-8fec-1bdf8e9cd822 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:35.829831 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4c13c93-edbe-45d8-8fec-1bdf8e9cd822 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:35.830573 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4c13c93-edbe-45d8-8fec-1bdf8e9cd822 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:35.831024 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4c13c93-edbe-45d8-8fec-1bdf8e9cd822 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:35.831445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4c13c93-edbe-45d8-8fec-1bdf8e9cd822 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:35.959587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4bfe6daf-2dae-44fd-a157-721416a48aeb tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:35.960215 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4bfe6daf-2dae-44fd-a157-721416a48aeb tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: 20602fbc-9893-433b-b711-3de8a31a4608] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:35.979106 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bfe6daf-2dae-44fd-a157-721416a48aeb tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:35.981430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bfe6daf-2dae-44fd-a157-721416a48aeb tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:35.982104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bfe6daf-2dae-44fd-a157-721416a48aeb tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:35.984662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bfe6daf-2dae-44fd-a157-721416a48aeb tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:35.985278 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bfe6daf-2dae-44fd-a157-721416a48aeb tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:35.985923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bfe6daf-2dae-44fd-a157-721416a48aeb tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:36.058182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d4c13c93-edbe-45d8-8fec-1bdf8e9cd822 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:36.071600 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d4c13c93-edbe-45d8-8fec-1bdf8e9cd822 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88" status: 200 len: 1324 microversion: 2.1 time: 0.263382 Oct 29 02:49:36.073016 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 537/1073] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:35 2022] GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88 => generated 1324 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:36.078473 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b4f4752c-2a55-44b3-9542-afdac7b8adac tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:36.079094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b4f4752c-2a55-44b3-9542-afdac7b8adac tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: d09276cf-e95a-47be-90e8-befb018ee5ab] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:36.086893 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4f4752c-2a55-44b3-9542-afdac7b8adac tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:36.087419 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4f4752c-2a55-44b3-9542-afdac7b8adac tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:36.087938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4f4752c-2a55-44b3-9542-afdac7b8adac tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:36.088817 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4f4752c-2a55-44b3-9542-afdac7b8adac tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:36.089413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4f4752c-2a55-44b3-9542-afdac7b8adac tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:36.089872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4f4752c-2a55-44b3-9542-afdac7b8adac tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:36.139140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4f4752c-2a55-44b3-9542-afdac7b8adac tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:36.139807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4f4752c-2a55-44b3-9542-afdac7b8adac tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:36.140410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4f4752c-2a55-44b3-9542-afdac7b8adac tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:36.140917 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-b4f4752c-2a55-44b3-9542-afdac7b8adac tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lazy-loading 'fault' on Instance uuid d09276cf-e95a-47be-90e8-befb018ee5ab {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:49:36.206656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b4f4752c-2a55-44b3-9542-afdac7b8adac tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:36.215774 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b4f4752c-2a55-44b3-9542-afdac7b8adac tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab" status: 200 len: 1305 microversion: 2.1 time: 0.141475 Oct 29 02:49:36.216609 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 538/1074] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:36 2022] GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab => generated 1305 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:36.255647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4bfe6daf-2dae-44fd-a157-721416a48aeb tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:36.266607 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4bfe6daf-2dae-44fd-a157-721416a48aeb tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608" status: 200 len: 1712 microversion: 2.1 time: 0.310917 Oct 29 02:49:36.269096 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 537/1075] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:35 2022] GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608 => generated 1712 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:49:36.302474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-383d4608-5a0c-4a45-a940-4c6416f8ea70 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:36.303240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-383d4608-5a0c-4a45-a940-4c6416f8ea70 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:36.310386 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-383d4608-5a0c-4a45-a940-4c6416f8ea70 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:36.310874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-383d4608-5a0c-4a45-a940-4c6416f8ea70 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:36.311305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-383d4608-5a0c-4a45-a940-4c6416f8ea70 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:36.312079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-383d4608-5a0c-4a45-a940-4c6416f8ea70 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:36.312550 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-383d4608-5a0c-4a45-a940-4c6416f8ea70 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:36.312990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-383d4608-5a0c-4a45-a940-4c6416f8ea70 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:36.389744 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c83980b8-e88e-4444-86a9-aeb17eb7b0fd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:36.390354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c83980b8-e88e-4444-86a9-aeb17eb7b0fd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:36.397306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c83980b8-e88e-4444-86a9-aeb17eb7b0fd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:36.398015 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c83980b8-e88e-4444-86a9-aeb17eb7b0fd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:36.398726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c83980b8-e88e-4444-86a9-aeb17eb7b0fd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:36.399607 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c83980b8-e88e-4444-86a9-aeb17eb7b0fd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:36.400056 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c83980b8-e88e-4444-86a9-aeb17eb7b0fd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:36.400471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c83980b8-e88e-4444-86a9-aeb17eb7b0fd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:36.459967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-383d4608-5a0c-4a45-a940-4c6416f8ea70 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:36.468092 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-383d4608-5a0c-4a45-a940-4c6416f8ea70 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1471 microversion: 2.1 time: 0.170729 Oct 29 02:49:36.468702 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 539/1076] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:36 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1471 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:36.476863 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c83980b8-e88e-4444-86a9-aeb17eb7b0fd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:36.485428 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c83980b8-e88e-4444-86a9-aeb17eb7b0fd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:36.487067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c83980b8-e88e-4444-86a9-aeb17eb7b0fd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:36.493114 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c83980b8-e88e-4444-86a9-aeb17eb7b0fd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.107624 Oct 29 02:49:36.493797 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 538/1077] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:36 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:37.099952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e9fdad25-2f47-4f1a-b646-e656603204ab tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:37.100635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e9fdad25-2f47-4f1a-b646-e656603204ab tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:37.107017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9fdad25-2f47-4f1a-b646-e656603204ab tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:37.107510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9fdad25-2f47-4f1a-b646-e656603204ab tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:37.107945 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9fdad25-2f47-4f1a-b646-e656603204ab tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:37.108709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9fdad25-2f47-4f1a-b646-e656603204ab tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:37.109163 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9fdad25-2f47-4f1a-b646-e656603204ab tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:37.109770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9fdad25-2f47-4f1a-b646-e656603204ab tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:37.239639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7da5dfc2-0b21-419a-a9ef-445bcffbcc52 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:37.240583 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7da5dfc2-0b21-419a-a9ef-445bcffbcc52 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: d09276cf-e95a-47be-90e8-befb018ee5ab] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:37.248660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7da5dfc2-0b21-419a-a9ef-445bcffbcc52 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:37.249479 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7da5dfc2-0b21-419a-a9ef-445bcffbcc52 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:37.249968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7da5dfc2-0b21-419a-a9ef-445bcffbcc52 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:37.250896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7da5dfc2-0b21-419a-a9ef-445bcffbcc52 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:37.251443 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7da5dfc2-0b21-419a-a9ef-445bcffbcc52 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:37.251917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7da5dfc2-0b21-419a-a9ef-445bcffbcc52 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:37.285957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e9fdad25-2f47-4f1a-b646-e656603204ab tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:37.288705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7da5dfc2-0b21-419a-a9ef-445bcffbcc52 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:37.289835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7da5dfc2-0b21-419a-a9ef-445bcffbcc52 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:37.290697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7da5dfc2-0b21-419a-a9ef-445bcffbcc52 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:37.291404 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-7da5dfc2-0b21-419a-a9ef-445bcffbcc52 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lazy-loading 'fault' on Instance uuid d09276cf-e95a-47be-90e8-befb018ee5ab {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:49:37.300807 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e9fdad25-2f47-4f1a-b646-e656603204ab tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88" status: 200 len: 1324 microversion: 2.1 time: 0.206007 Oct 29 02:49:37.302353 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 540/1078] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:37 2022] GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88 => generated 1324 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:37.307673 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-da61f6cf-4190-4109-bb70-2d4cc6c68e00 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:37.308998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-da61f6cf-4190-4109-bb70-2d4cc6c68e00 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: 20602fbc-9893-433b-b711-3de8a31a4608] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:37.317574 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da61f6cf-4190-4109-bb70-2d4cc6c68e00 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:37.318697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da61f6cf-4190-4109-bb70-2d4cc6c68e00 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:37.319809 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da61f6cf-4190-4109-bb70-2d4cc6c68e00 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:37.320827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da61f6cf-4190-4109-bb70-2d4cc6c68e00 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:37.321811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da61f6cf-4190-4109-bb70-2d4cc6c68e00 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:37.322341 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da61f6cf-4190-4109-bb70-2d4cc6c68e00 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:37.338959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7da5dfc2-0b21-419a-a9ef-445bcffbcc52 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:37.347587 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7da5dfc2-0b21-419a-a9ef-445bcffbcc52 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab" status: 200 len: 1305 microversion: 2.1 time: 0.111870 Oct 29 02:49:37.361087 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 539/1079] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:37 2022] GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab => generated 1305 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:49:37.492051 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4d3907c0-4a57-469b-add1-cb0d89d9d683 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:37.492887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4d3907c0-4a57-469b-add1-cb0d89d9d683 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:37.499885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d3907c0-4a57-469b-add1-cb0d89d9d683 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:37.500488 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d3907c0-4a57-469b-add1-cb0d89d9d683 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:37.501052 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d3907c0-4a57-469b-add1-cb0d89d9d683 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:37.502079 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d3907c0-4a57-469b-add1-cb0d89d9d683 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:37.502788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d3907c0-4a57-469b-add1-cb0d89d9d683 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:37.503433 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d3907c0-4a57-469b-add1-cb0d89d9d683 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:37.669989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4d3907c0-4a57-469b-add1-cb0d89d9d683 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:37.679793 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4d3907c0-4a57-469b-add1-cb0d89d9d683 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1471 microversion: 2.1 time: 0.192248 Oct 29 02:49:37.686256 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 540/1080] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:37 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1471 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:49:37.693512 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9954cf26-3ee9-48fa-aa4e-86fad5595817 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:37.694749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9954cf26-3ee9-48fa-aa4e-86fad5595817 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:37.706976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9954cf26-3ee9-48fa-aa4e-86fad5595817 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:37.708161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9954cf26-3ee9-48fa-aa4e-86fad5595817 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:37.709002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9954cf26-3ee9-48fa-aa4e-86fad5595817 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:37.710103 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9954cf26-3ee9-48fa-aa4e-86fad5595817 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:37.710810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9954cf26-3ee9-48fa-aa4e-86fad5595817 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:37.711470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9954cf26-3ee9-48fa-aa4e-86fad5595817 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:37.790241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9954cf26-3ee9-48fa-aa4e-86fad5595817 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:37.800857 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9954cf26-3ee9-48fa-aa4e-86fad5595817 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:37.802637 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9954cf26-3ee9-48fa-aa4e-86fad5595817 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:37.808639 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9954cf26-3ee9-48fa-aa4e-86fad5595817 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.122807 Oct 29 02:49:37.809620 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 541/1081] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:37 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:37.956829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-da61f6cf-4190-4109-bb70-2d4cc6c68e00 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:37.993173 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:38.007628 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-da61f6cf-4190-4109-bb70-2d4cc6c68e00 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608" status: 200 len: 1712 microversion: 2.1 time: 0.702617 Oct 29 02:49:38.008936 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 541/1082] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:37 2022] GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608 => generated 1712 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:38.051803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-be65f069-b24f-4685-ab76-0c5a961ea964 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:38.052491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-be65f069-b24f-4685-ab76-0c5a961ea964 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:38.058804 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be65f069-b24f-4685-ab76-0c5a961ea964 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:38.059435 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be65f069-b24f-4685-ab76-0c5a961ea964 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:38.059926 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be65f069-b24f-4685-ab76-0c5a961ea964 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:38.060750 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be65f069-b24f-4685-ab76-0c5a961ea964 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:38.061265 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be65f069-b24f-4685-ab76-0c5a961ea964 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:38.062163 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be65f069-b24f-4685-ab76-0c5a961ea964 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:38.212406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-be65f069-b24f-4685-ab76-0c5a961ea964 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lazy-loading 'services' on Instance uuid 694141ac-c96c-409b-9eb2-831a3ccb5a68 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:49:38.227107 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-be65f069-b24f-4685-ab76-0c5a961ea964 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 2424 microversion: 2.25 time: 0.179076 Oct 29 02:49:38.228076 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 542/1083] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:38 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 2424 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:38.261949 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b69ac950-7d90-4e9d-8e0a-bfc05c4c6cea tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862967-2", "block_migration": "auto"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:38.264991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b69ac950-7d90-4e9d-8e0a-bfc05c4c6cea tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:38.282335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b69ac950-7d90-4e9d-8e0a-bfc05c4c6cea tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:38.282833 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b69ac950-7d90-4e9d-8e0a-bfc05c4c6cea tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:38.283269 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b69ac950-7d90-4e9d-8e0a-bfc05c4c6cea tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:38.283980 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b69ac950-7d90-4e9d-8e0a-bfc05c4c6cea tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:38.284621 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b69ac950-7d90-4e9d-8e0a-bfc05c4c6cea tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:38.285061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b69ac950-7d90-4e9d-8e0a-bfc05c4c6cea tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:38.317320 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-b69ac950-7d90-4e9d-8e0a-bfc05c4c6cea tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lazy-loading 'flavor' on Instance uuid 694141ac-c96c-409b-9eb2-831a3ccb5a68 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:49:38.325370 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b5794a3d-4d63-40b5-becb-6260c775f257 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:38.326358 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b5794a3d-4d63-40b5-becb-6260c775f257 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:38.329896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b69ac950-7d90-4e9d-8e0a-bfc05c4c6cea tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Going to try to live migrate instance to n-h2-862967-2 {{(pid=127124) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 02:49:38.334674 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5794a3d-4d63-40b5-becb-6260c775f257 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:38.335169 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5794a3d-4d63-40b5-becb-6260c775f257 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:38.335638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5794a3d-4d63-40b5-becb-6260c775f257 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:38.339491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5794a3d-4d63-40b5-becb-6260c775f257 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:38.340044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5794a3d-4d63-40b5-becb-6260c775f257 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:38.340406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5794a3d-4d63-40b5-becb-6260c775f257 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:38.528348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b5794a3d-4d63-40b5-becb-6260c775f257 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:38.536872 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b5794a3d-4d63-40b5-becb-6260c775f257 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88" status: 200 len: 1324 microversion: 2.1 time: 0.216727 Oct 29 02:49:38.537473 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 543/1084] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:38 2022] GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88 => generated 1324 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:49:38.558256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-28d02919-eb18-4133-87b6-1bf15f5936de tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:38.558466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-28d02919-eb18-4133-87b6-1bf15f5936de tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: d09276cf-e95a-47be-90e8-befb018ee5ab] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:38.564630 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28d02919-eb18-4133-87b6-1bf15f5936de tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:38.565132 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28d02919-eb18-4133-87b6-1bf15f5936de tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:38.565570 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28d02919-eb18-4133-87b6-1bf15f5936de tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:38.566283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28d02919-eb18-4133-87b6-1bf15f5936de tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:38.566741 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28d02919-eb18-4133-87b6-1bf15f5936de tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:38.568564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28d02919-eb18-4133-87b6-1bf15f5936de tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:38.614011 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28d02919-eb18-4133-87b6-1bf15f5936de tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:38.614501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28d02919-eb18-4133-87b6-1bf15f5936de tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:38.614933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28d02919-eb18-4133-87b6-1bf15f5936de tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:38.615385 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-28d02919-eb18-4133-87b6-1bf15f5936de tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lazy-loading 'fault' on Instance uuid d09276cf-e95a-47be-90e8-befb018ee5ab {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:49:38.679013 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-28d02919-eb18-4133-87b6-1bf15f5936de tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:38.690743 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-28d02919-eb18-4133-87b6-1bf15f5936de tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab" status: 200 len: 1305 microversion: 2.1 time: 0.136594 Oct 29 02:49:38.692080 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 544/1085] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:38 2022] GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab => generated 1305 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:38.712956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ac2e4101-d4a2-4c5a-8399-3f0a6426f322 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:38.713724 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ac2e4101-d4a2-4c5a-8399-3f0a6426f322 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:38.720249 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ac2e4101-d4a2-4c5a-8399-3f0a6426f322 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:38.720918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ac2e4101-d4a2-4c5a-8399-3f0a6426f322 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:38.722374 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ac2e4101-d4a2-4c5a-8399-3f0a6426f322 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:38.722592 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ac2e4101-d4a2-4c5a-8399-3f0a6426f322 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:38.723056 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ac2e4101-d4a2-4c5a-8399-3f0a6426f322 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:38.723548 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ac2e4101-d4a2-4c5a-8399-3f0a6426f322 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:39.002022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ac2e4101-d4a2-4c5a-8399-3f0a6426f322 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:39.026775 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ac2e4101-d4a2-4c5a-8399-3f0a6426f322 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1471 microversion: 2.1 time: 0.318216 Oct 29 02:49:39.031351 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 545/1086] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:38 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1471 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:39.060158 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5ed16c59-ded1-4d76-8dfc-37912f9a85a1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:39.063418 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5ed16c59-ded1-4d76-8dfc-37912f9a85a1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:39.085079 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ed16c59-ded1-4d76-8dfc-37912f9a85a1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:39.086529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ed16c59-ded1-4d76-8dfc-37912f9a85a1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:39.087326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ed16c59-ded1-4d76-8dfc-37912f9a85a1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:39.088399 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ed16c59-ded1-4d76-8dfc-37912f9a85a1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:39.088914 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ed16c59-ded1-4d76-8dfc-37912f9a85a1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:39.093528 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ed16c59-ded1-4d76-8dfc-37912f9a85a1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:39.105584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:39.197777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5ed16c59-ded1-4d76-8dfc-37912f9a85a1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:39.210146 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5ed16c59-ded1-4d76-8dfc-37912f9a85a1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:39.213275 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5ed16c59-ded1-4d76-8dfc-37912f9a85a1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:39.226659 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5ed16c59-ded1-4d76-8dfc-37912f9a85a1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.189960 Oct 29 02:49:39.240552 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 546/1087] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:39 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:39.252855 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-06f2d0a8-9b0c-43a1-be84-37eabffbdacc tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:39.252855 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-06f2d0a8-9b0c-43a1-be84-37eabffbdacc tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: 20602fbc-9893-433b-b711-3de8a31a4608] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:39.271000 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06f2d0a8-9b0c-43a1-be84-37eabffbdacc tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:39.271908 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06f2d0a8-9b0c-43a1-be84-37eabffbdacc tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:39.273793 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06f2d0a8-9b0c-43a1-be84-37eabffbdacc tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:39.275481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06f2d0a8-9b0c-43a1-be84-37eabffbdacc tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:39.276278 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06f2d0a8-9b0c-43a1-be84-37eabffbdacc tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:39.277422 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06f2d0a8-9b0c-43a1-be84-37eabffbdacc tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:39.789518 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-06f2d0a8-9b0c-43a1-be84-37eabffbdacc tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:39.799969 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-06f2d0a8-9b0c-43a1-be84-37eabffbdacc tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608" status: 200 len: 1712 microversion: 2.1 time: 0.560259 Oct 29 02:49:39.801050 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 547/1088] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:39 2022] GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608 => generated 1712 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:39.807848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-980b0725-9f16-46e3-bf93-b2fcc624c5e9 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:39.808753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-980b0725-9f16-46e3-bf93-b2fcc624c5e9 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:39.818092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-980b0725-9f16-46e3-bf93-b2fcc624c5e9 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:39.818868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-980b0725-9f16-46e3-bf93-b2fcc624c5e9 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:39.819528 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-980b0725-9f16-46e3-bf93-b2fcc624c5e9 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:39.820718 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-980b0725-9f16-46e3-bf93-b2fcc624c5e9 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:39.821520 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-980b0725-9f16-46e3-bf93-b2fcc624c5e9 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:39.822234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-980b0725-9f16-46e3-bf93-b2fcc624c5e9 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:40.130014 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-980b0725-9f16-46e3-bf93-b2fcc624c5e9 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:40.144072 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-980b0725-9f16-46e3-bf93-b2fcc624c5e9 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88" status: 200 len: 1324 microversion: 2.1 time: 0.341588 Oct 29 02:49:40.144927 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 548/1089] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:39 2022] GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88 => generated 1324 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:40.153137 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-476e9818-8b8b-4565-9b18-7686ff328cb7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:40.154128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-476e9818-8b8b-4565-9b18-7686ff328cb7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: d09276cf-e95a-47be-90e8-befb018ee5ab] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:40.161073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-476e9818-8b8b-4565-9b18-7686ff328cb7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:40.161920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-476e9818-8b8b-4565-9b18-7686ff328cb7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:40.162559 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-476e9818-8b8b-4565-9b18-7686ff328cb7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:40.163549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-476e9818-8b8b-4565-9b18-7686ff328cb7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:40.164212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-476e9818-8b8b-4565-9b18-7686ff328cb7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:40.165059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-476e9818-8b8b-4565-9b18-7686ff328cb7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:40.180235 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-476e9818-8b8b-4565-9b18-7686ff328cb7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] HTTP exception thrown: Instance d09276cf-e95a-47be-90e8-befb018ee5ab could not be found. Oct 29 02:49:40.182368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-476e9818-8b8b-4565-9b18-7686ff328cb7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Request method failure captured: Oct 29 02:49:40.182368 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab HTTP/1.1 Oct 29 02:49:40.182368 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:49:40.182368 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:49:40.182368 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:49:40.182368 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:49:40.182368 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:49:40.182368 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:49:40.182368 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:49:40.182368 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:40.182368 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPtIMVuxUQ5sESBGcpDIyg0JlWGhaenNyoF1KsslH7tI-Ide1t1Qc6YWBoCicDg4iK9BWmVgzBvHQx10NYcQWd4V883MefaFkAV2l76Vzo9g4yJTR39I57-5iCCl5el4McwVe4d-eqtN30on7NVpVe0PpaW9_bFKynEcnhRDBRUQ1A Oct 29 02:49:40.182368 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:49:40.182368 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:49:40.182368 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:49:40.182368 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:49:40.182368 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:49:40.182368 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:49:40.182368 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: dcc6da8e69e041e19023a53a23e33393 Oct 29 02:49:40.182368 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersOnMultiNodesTest-354009816 Oct 29 02:49:40.182368 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:49:40.182368 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:49:40.183774 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dcc6da8e69e041e19023a53a23e33393"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dcc6da8e69e041e19023a53a23e33393"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_dcc6da8e69e041e19023a53a23e33393"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/dcc6da8e69e041e19023a53a23e33393"}]}] Oct 29 02:49:40.183774 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersOnMultiNodesTest-354009816 Oct 29 02:49:40.183774 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: dcc6da8e69e041e19023a53a23e33393 Oct 29 02:49:40.183774 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-354009816 Oct 29 02:49:40.183774 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersOnMultiNodesTest-354009816-project Oct 29 02:49:40.183774 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:49:40.183774 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:49:40.183774 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 509ce04aeb3847f084629201bd7ae5d6 Oct 29 02:49:40.183774 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersOnMultiNodesTest-354009816-project Oct 29 02:49:40.183774 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:49:40.183774 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance d09276cf-e95a-47be-90e8-befb018ee5ab could not be found. Oct 29 02:49:40.183774 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'd09276cf-e95a-47be-90e8-befb018ee5ab'} Oct 29 02:49:40.184560 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:40.184560 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:40.184560 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:49:40.184560 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:49:40.184560 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:49:40.184560 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:49:40.184560 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:49:40.184560 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:49:40.184560 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:49:40.184560 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:49:40.184560 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d09276cf-e95a-47be-90e8-befb018ee5ab could not be found. Oct 29 02:49:40.184560 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:40.184560 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:40.184560 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:40.184560 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:40.184560 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:40.184560 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:40.184560 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:40.184560 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:40.184560 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:40.185898 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:40.185898 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:49:40.185898 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:49:40.185898 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:49:40.185898 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:49:40.185898 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:49:40.185898 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:49:40.185898 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d09276cf-e95a-47be-90e8-befb018ee5ab could not be found. Oct 29 02:49:40.185898 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:40.185898 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:40.185898 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:40.185898 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:40.185898 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:40.185898 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:40.185898 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:40.185898 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:40.185898 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d09276cf-e95a-47be-90e8-befb018ee5ab could not be found. Oct 29 02:49:40.185898 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:40.188897 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-476e9818-8b8b-4565-9b18-7686ff328cb7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Returning 404 to user: Instance d09276cf-e95a-47be-90e8-befb018ee5ab could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:40.189997 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-476e9818-8b8b-4565-9b18-7686ff328cb7 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab" status: 404 len: 111 microversion: 2.1 time: 0.043693 Oct 29 02:49:40.191108 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 549/1090] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:40 2022] GET /compute/v2.1/servers/d09276cf-e95a-47be-90e8-befb018ee5ab => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:40.196596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-450d3ad4-3f87-4802-ade4-f9797d3cfe36 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:40.197377 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-450d3ad4-3f87-4802-ade4-f9797d3cfe36 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:40.204260 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-450d3ad4-3f87-4802-ade4-f9797d3cfe36 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:40.204816 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-450d3ad4-3f87-4802-ade4-f9797d3cfe36 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:40.205491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-450d3ad4-3f87-4802-ade4-f9797d3cfe36 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:40.206652 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-450d3ad4-3f87-4802-ade4-f9797d3cfe36 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:40.207225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-450d3ad4-3f87-4802-ade4-f9797d3cfe36 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:40.207938 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-450d3ad4-3f87-4802-ade4-f9797d3cfe36 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:40.411407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-450d3ad4-3f87-4802-ade4-f9797d3cfe36 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:40.420287 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-450d3ad4-3f87-4802-ade4-f9797d3cfe36 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1477 microversion: 2.1 time: 0.227764 Oct 29 02:49:40.425224 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 550/1091] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:40 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1477 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:40.444815 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a393e401-c1f5-4d29-94da-3acd9cdc107c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:40.489640 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a393e401-c1f5-4d29-94da-3acd9cdc107c tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/428b6e58-cae1-4349-bcd4-52aed500cadf" status: 204 len: 0 microversion: 2.1 time: 0.063071 Oct 29 02:49:40.490775 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 551/1092] 10.222.0.46 () {58 vars in 1266 bytes} [Sat Oct 29 02:49:40 2022] DELETE /compute/v2.1/os-server-groups/428b6e58-cae1-4349-bcd4-52aed500cadf => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:49:40.500471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-95f36e65-1f52-45df-a583-68b311def933 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:40.501563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-95f36e65-1f52-45df-a583-68b311def933 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:40.511916 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95f36e65-1f52-45df-a583-68b311def933 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:40.512844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95f36e65-1f52-45df-a583-68b311def933 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:40.513590 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95f36e65-1f52-45df-a583-68b311def933 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:40.514766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95f36e65-1f52-45df-a583-68b311def933 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:40.515380 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95f36e65-1f52-45df-a583-68b311def933 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:40.515957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95f36e65-1f52-45df-a583-68b311def933 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:40.629210 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-95f36e65-1f52-45df-a583-68b311def933 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:40.640331 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-95f36e65-1f52-45df-a583-68b311def933 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:40.645740 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-95f36e65-1f52-45df-a583-68b311def933 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:40.658158 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-95f36e65-1f52-45df-a583-68b311def933 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.166822 Oct 29 02:49:40.658759 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 552/1093] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:40 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:40.672726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-efc267ab-432b-48c5-872c-79d403f35b88 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:40.681605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-efc267ab-432b-48c5-872c-79d403f35b88 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 6c325f03-e675-4cd8-928e-a09523951d3d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:40.687043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efc267ab-432b-48c5-872c-79d403f35b88 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:40.689200 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efc267ab-432b-48c5-872c-79d403f35b88 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:40.693349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efc267ab-432b-48c5-872c-79d403f35b88 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:40.694744 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efc267ab-432b-48c5-872c-79d403f35b88 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:40.696341 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efc267ab-432b-48c5-872c-79d403f35b88 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:40.698025 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efc267ab-432b-48c5-872c-79d403f35b88 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:40.756726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-efc267ab-432b-48c5-872c-79d403f35b88 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 6c325f03-e675-4cd8-928e-a09523951d3d] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:49:40.955679 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-efc267ab-432b-48c5-872c-79d403f35b88 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6c325f03-e675-4cd8-928e-a09523951d3d" status: 204 len: 0 microversion: 2.1 time: 0.295473 Oct 29 02:49:40.956396 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 553/1094] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:49:40 2022] DELETE /compute/v2.1/servers/6c325f03-e675-4cd8-928e-a09523951d3d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:49:40.970664 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-da242617-14b7-4590-8c4f-af48cfa702b3 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:40.971648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-da242617-14b7-4590-8c4f-af48cfa702b3 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: 20602fbc-9893-433b-b711-3de8a31a4608] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:41.001029 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da242617-14b7-4590-8c4f-af48cfa702b3 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:41.001642 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da242617-14b7-4590-8c4f-af48cfa702b3 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:41.006431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da242617-14b7-4590-8c4f-af48cfa702b3 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:41.010272 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da242617-14b7-4590-8c4f-af48cfa702b3 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:41.015900 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da242617-14b7-4590-8c4f-af48cfa702b3 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:41.016716 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da242617-14b7-4590-8c4f-af48cfa702b3 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:41.155831 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-da242617-14b7-4590-8c4f-af48cfa702b3 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:41.165346 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-da242617-14b7-4590-8c4f-af48cfa702b3 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608" status: 200 len: 1645 microversion: 2.1 time: 0.207605 Oct 29 02:49:41.171816 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 554/1095] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:40 2022] GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608 => generated 1645 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:41.179100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-f7ceb31f-4eda-4585-a147-1e7532c1acd3 req-3487e068-1253-4482-abae-234ef5c152e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20602fbc-9893-433b-b711-3de8a31a4608", "name": "network-vif-deleted", "tag": "d24e5257-2899-45fe-ad6a-690bf6e3cd60"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:41.192300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f7ceb31f-4eda-4585-a147-1e7532c1acd3 req-3487e068-1253-4482-abae-234ef5c152e2 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:41.192874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f7ceb31f-4eda-4585-a147-1e7532c1acd3 req-3487e068-1253-4482-abae-234ef5c152e2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:41.193310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f7ceb31f-4eda-4585-a147-1e7532c1acd3 req-3487e068-1253-4482-abae-234ef5c152e2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:41.209771 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-f7ceb31f-4eda-4585-a147-1e7532c1acd3 req-3487e068-1253-4482-abae-234ef5c152e2 service nova] Creating event network-vif-deleted:d24e5257-2899-45fe-ad6a-690bf6e3cd60 for instance 20602fbc-9893-433b-b711-3de8a31a4608 on n-h2-862967-2 Oct 29 02:49:41.220355 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-f7ceb31f-4eda-4585-a147-1e7532c1acd3 req-3487e068-1253-4482-abae-234ef5c152e2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047242 Oct 29 02:49:41.225489 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 555/1096] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:41.245067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8cbd9b74-5872-452d-85c6-78bd4064f040 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:41.246483 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8cbd9b74-5872-452d-85c6-78bd4064f040 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 7bfceda7-a17c-40a9-afcc-767b96d5ac7b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:41.269024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8cbd9b74-5872-452d-85c6-78bd4064f040 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:41.275575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8cbd9b74-5872-452d-85c6-78bd4064f040 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:41.276310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8cbd9b74-5872-452d-85c6-78bd4064f040 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:41.277539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8cbd9b74-5872-452d-85c6-78bd4064f040 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:41.278314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8cbd9b74-5872-452d-85c6-78bd4064f040 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:41.278802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8cbd9b74-5872-452d-85c6-78bd4064f040 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:41.334182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8cbd9b74-5872-452d-85c6-78bd4064f040 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 7bfceda7-a17c-40a9-afcc-767b96d5ac7b] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:49:41.597189 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8cbd9b74-5872-452d-85c6-78bd4064f040 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b" status: 204 len: 0 microversion: 2.1 time: 0.369373 Oct 29 02:49:41.601754 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 556/1097] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:49:41 2022] DELETE /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:49:41.607720 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6ecdafdb-30e9-4c10-87d8-0dcd32c09eac tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:41.608719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6ecdafdb-30e9-4c10-87d8-0dcd32c09eac tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:41.628141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ecdafdb-30e9-4c10-87d8-0dcd32c09eac tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:41.628678 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ecdafdb-30e9-4c10-87d8-0dcd32c09eac tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:41.629301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ecdafdb-30e9-4c10-87d8-0dcd32c09eac tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:41.630242 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ecdafdb-30e9-4c10-87d8-0dcd32c09eac tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:41.630844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ecdafdb-30e9-4c10-87d8-0dcd32c09eac tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:41.631407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ecdafdb-30e9-4c10-87d8-0dcd32c09eac tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:41.711385 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b69ac950-7d90-4e9d-8e0a-bfc05c4c6cea tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68/action" status: 202 len: 0 microversion: 2.25 time: 3.456169 Oct 29 02:49:41.713388 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 542/1098] 10.222.0.46 () {62 vars in 1319 bytes} [Sat Oct 29 02:49:38 2022] POST /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68/action => generated 0 bytes in 3460 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:49:41.723356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1d2d64b7-f91e-4158-bc9b-390dd2c4bb22 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:41.726571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1d2d64b7-f91e-4158-bc9b-390dd2c4bb22 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:41.739753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d2d64b7-f91e-4158-bc9b-390dd2c4bb22 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:41.740948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d2d64b7-f91e-4158-bc9b-390dd2c4bb22 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:41.741808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d2d64b7-f91e-4158-bc9b-390dd2c4bb22 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:41.742940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d2d64b7-f91e-4158-bc9b-390dd2c4bb22 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:41.744559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d2d64b7-f91e-4158-bc9b-390dd2c4bb22 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:41.745342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d2d64b7-f91e-4158-bc9b-390dd2c4bb22 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:41.951502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6ecdafdb-30e9-4c10-87d8-0dcd32c09eac tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:41.963739 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6ecdafdb-30e9-4c10-87d8-0dcd32c09eac tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88" status: 200 len: 1519 microversion: 2.1 time: 0.360277 Oct 29 02:49:41.964460 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 557/1099] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:41 2022] GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88 => generated 1519 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:41.987472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-61ea2419-c452-4df0-af6c-9a333708709a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:41.988114 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-61ea2419-c452-4df0-af6c-9a333708709a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 6c325f03-e675-4cd8-928e-a09523951d3d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:41.995197 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61ea2419-c452-4df0-af6c-9a333708709a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:41.995641 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61ea2419-c452-4df0-af6c-9a333708709a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:41.996162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61ea2419-c452-4df0-af6c-9a333708709a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:41.996901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61ea2419-c452-4df0-af6c-9a333708709a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:41.997351 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61ea2419-c452-4df0-af6c-9a333708709a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:41.997774 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61ea2419-c452-4df0-af6c-9a333708709a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:42.205036 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-61ea2419-c452-4df0-af6c-9a333708709a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:42.215957 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-61ea2419-c452-4df0-af6c-9a333708709a tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/6c325f03-e675-4cd8-928e-a09523951d3d" status: 200 len: 1474 microversion: 2.1 time: 0.233215 Oct 29 02:49:42.220598 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 558/1100] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:41 2022] GET /compute/v2.1/servers/6c325f03-e675-4cd8-928e-a09523951d3d => generated 1474 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:42.222554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a4f1f00f-caa0-4ccc-9293-203e29830d6c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:42.222672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a4f1f00f-caa0-4ccc-9293-203e29830d6c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:42.229068 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a4f1f00f-caa0-4ccc-9293-203e29830d6c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:42.229553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a4f1f00f-caa0-4ccc-9293-203e29830d6c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:42.229976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a4f1f00f-caa0-4ccc-9293-203e29830d6c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:42.230673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a4f1f00f-caa0-4ccc-9293-203e29830d6c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:42.231306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a4f1f00f-caa0-4ccc-9293-203e29830d6c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:42.231732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a4f1f00f-caa0-4ccc-9293-203e29830d6c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:42.286260 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1d2d64b7-f91e-4158-bc9b-390dd2c4bb22 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:42.300407 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1d2d64b7-f91e-4158-bc9b-390dd2c4bb22 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1477 microversion: 2.1 time: 0.585385 Oct 29 02:49:42.313445 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 543/1101] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:41 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1477 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:42.326341 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a4c0b01e-532e-4ae1-ad66-db425a2b54c2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:42.326711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a4f1f00f-caa0-4ccc-9293-203e29830d6c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:42.336295 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a4f1f00f-caa0-4ccc-9293-203e29830d6c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:42.337999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a4f1f00f-caa0-4ccc-9293-203e29830d6c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:42.339416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a4c0b01e-532e-4ae1-ad66-db425a2b54c2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:42.344356 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a4f1f00f-caa0-4ccc-9293-203e29830d6c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1531 microversion: 2.91 time: 0.126148 Oct 29 02:49:42.344996 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 559/1102] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:42 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1531 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:42.358046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-124799f7-fffb-45a4-9d6e-6d9db8172c64 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Action: 'action', calling method: .version_select at 0x7ff059b6caf0>, body: {"addFloatingIp": {"address": "172.25.7.224"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:42.358046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-124799f7-fffb-45a4-9d6e-6d9db8172c64 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:42.359168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-124799f7-fffb-45a4-9d6e-6d9db8172c64 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:42.359963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-124799f7-fffb-45a4-9d6e-6d9db8172c64 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:42.365469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-124799f7-fffb-45a4-9d6e-6d9db8172c64 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:42.365469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-124799f7-fffb-45a4-9d6e-6d9db8172c64 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:42.365469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-124799f7-fffb-45a4-9d6e-6d9db8172c64 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:42.365469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-124799f7-fffb-45a4-9d6e-6d9db8172c64 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:42.377047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a4c0b01e-532e-4ae1-ad66-db425a2b54c2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:42.378290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a4c0b01e-532e-4ae1-ad66-db425a2b54c2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:42.378961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a4c0b01e-532e-4ae1-ad66-db425a2b54c2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:42.381498 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a4c0b01e-532e-4ae1-ad66-db425a2b54c2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:42.382235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a4c0b01e-532e-4ae1-ad66-db425a2b54c2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:42.383328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a4c0b01e-532e-4ae1-ad66-db425a2b54c2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:42.465894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-124799f7-fffb-45a4-9d6e-6d9db8172c64 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "refresh_cache-3380e407-b7cb-4775-b5ed-17ef51c3764a" {{(pid=127125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 02:49:42.466410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-124799f7-fffb-45a4-9d6e-6d9db8172c64 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquired lock "refresh_cache-3380e407-b7cb-4775-b5ed-17ef51c3764a" {{(pid=127125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 02:49:43.110097 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a4c0b01e-532e-4ae1-ad66-db425a2b54c2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:43.121931 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a4c0b01e-532e-4ae1-ad66-db425a2b54c2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:43.126767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a4c0b01e-532e-4ae1-ad66-db425a2b54c2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:43.128487 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a4c0b01e-532e-4ae1-ad66-db425a2b54c2 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1815 microversion: 2.25 time: 0.813572 Oct 29 02:49:43.140014 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 544/1103] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:42 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1815 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:43.148705 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-97618fe9-def2-42d7-af53-81cb6baf118d tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:43.149687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-97618fe9-def2-42d7-af53-81cb6baf118d tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: 20602fbc-9893-433b-b711-3de8a31a4608] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:43.162258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-97618fe9-def2-42d7-af53-81cb6baf118d tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:43.163224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-97618fe9-def2-42d7-af53-81cb6baf118d tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:43.163910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-97618fe9-def2-42d7-af53-81cb6baf118d tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:43.164767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-97618fe9-def2-42d7-af53-81cb6baf118d tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:43.165713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-97618fe9-def2-42d7-af53-81cb6baf118d tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:43.167532 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-97618fe9-def2-42d7-af53-81cb6baf118d tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:43.362585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-97618fe9-def2-42d7-af53-81cb6baf118d tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e562fcf734e45ce92536806eaec5750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce4605ee60c4bbdb3ec64e735ed73a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:43.374518 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-97618fe9-def2-42d7-af53-81cb6baf118d tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608" status: 200 len: 1350 microversion: 2.1 time: 0.233183 Oct 29 02:49:43.375122 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 545/1104] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:43 2022] GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608 => generated 1350 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:43.393428 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4220ad67-0ad7-4c87-8460-79bc131e7b4e tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:43.394339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4220ad67-0ad7-4c87-8460-79bc131e7b4e tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:43.417754 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4220ad67-0ad7-4c87-8460-79bc131e7b4e tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:43.418559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4220ad67-0ad7-4c87-8460-79bc131e7b4e tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:43.419276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4220ad67-0ad7-4c87-8460-79bc131e7b4e tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:43.420667 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4220ad67-0ad7-4c87-8460-79bc131e7b4e tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:43.441472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4220ad67-0ad7-4c87-8460-79bc131e7b4e tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:43.442276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4220ad67-0ad7-4c87-8460-79bc131e7b4e tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:43.638637 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-4220ad67-0ad7-4c87-8460-79bc131e7b4e tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lazy-loading 'services' on Instance uuid 0d377f50-7426-425c-a1fe-c63f8d0f1186 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:49:43.670851 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4220ad67-0ad7-4c87-8460-79bc131e7b4e tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1936 microversion: 2.91 time: 0.292235 Oct 29 02:49:43.671450 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 546/1105] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:43 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1936 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:43.677434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2e278d8c-aa04-445e-afbb-8791662ced65 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:43.678057 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2e278d8c-aa04-445e-afbb-8791662ced65 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 6c325f03-e675-4cd8-928e-a09523951d3d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:43.695405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e278d8c-aa04-445e-afbb-8791662ced65 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:43.698276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e278d8c-aa04-445e-afbb-8791662ced65 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:43.700906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e278d8c-aa04-445e-afbb-8791662ced65 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:43.701899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e278d8c-aa04-445e-afbb-8791662ced65 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:43.704401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e278d8c-aa04-445e-afbb-8791662ced65 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:43.706636 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e278d8c-aa04-445e-afbb-8791662ced65 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:44.042135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2e278d8c-aa04-445e-afbb-8791662ced65 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:44.052038 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2e278d8c-aa04-445e-afbb-8791662ced65 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/6c325f03-e675-4cd8-928e-a09523951d3d" status: 200 len: 1474 microversion: 2.1 time: 0.378252 Oct 29 02:49:44.052938 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=8 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:44.060941 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 547/1106] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:43 2022] GET /compute/v2.1/servers/6c325f03-e675-4cd8-928e-a09523951d3d => generated 1474 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:44.090723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a2055fea-0f9e-4962-bbeb-3b5597e8e5ee tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:44.091506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a2055fea-0f9e-4962-bbeb-3b5597e8e5ee tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:44.135648 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2055fea-0f9e-4962-bbeb-3b5597e8e5ee tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:44.138708 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2055fea-0f9e-4962-bbeb-3b5597e8e5ee tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:44.139234 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2055fea-0f9e-4962-bbeb-3b5597e8e5ee tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:44.139899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2055fea-0f9e-4962-bbeb-3b5597e8e5ee tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:44.140353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2055fea-0f9e-4962-bbeb-3b5597e8e5ee tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:44.140792 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2055fea-0f9e-4962-bbeb-3b5597e8e5ee tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:44.154729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=16 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:44.514570 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a2055fea-0f9e-4962-bbeb-3b5597e8e5ee tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:44.522239 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a2055fea-0f9e-4962-bbeb-3b5597e8e5ee tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1477 microversion: 2.1 time: 0.459102 Oct 29 02:49:44.523487 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 548/1107] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:44 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1477 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:44.528674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-27d46e0a-e51b-47d2-a910-9d6d6cb9e120 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:44.529799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-27d46e0a-e51b-47d2-a910-9d6d6cb9e120 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:44.539915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27d46e0a-e51b-47d2-a910-9d6d6cb9e120 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:44.541306 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27d46e0a-e51b-47d2-a910-9d6d6cb9e120 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:44.545274 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27d46e0a-e51b-47d2-a910-9d6d6cb9e120 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:44.546979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27d46e0a-e51b-47d2-a910-9d6d6cb9e120 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:44.548151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27d46e0a-e51b-47d2-a910-9d6d6cb9e120 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:44.549020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27d46e0a-e51b-47d2-a910-9d6d6cb9e120 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:44.591011 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-27d46e0a-e51b-47d2-a910-9d6d6cb9e120 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lazy-loading 'flavor' on Instance uuid 0d377f50-7426-425c-a1fe-c63f8d0f1186 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:49:44.970272 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-27d46e0a-e51b-47d2-a910-9d6d6cb9e120 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "POST /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186/action" status: 202 len: 0 microversion: 2.91 time: 0.431109 Oct 29 02:49:44.973813 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 549/1108] 10.222.0.46 () {62 vars in 1319 bytes} [Sat Oct 29 02:49:44 2022] POST /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:49:44.987066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d3297eb9-295d-4f43-9c2a-435631924ae9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:44.989230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d3297eb9-295d-4f43-9c2a-435631924ae9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:45.017860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3297eb9-295d-4f43-9c2a-435631924ae9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:45.018720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3297eb9-295d-4f43-9c2a-435631924ae9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:45.019612 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3297eb9-295d-4f43-9c2a-435631924ae9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:45.021976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3297eb9-295d-4f43-9c2a-435631924ae9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:45.022861 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3297eb9-295d-4f43-9c2a-435631924ae9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:45.023747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3297eb9-295d-4f43-9c2a-435631924ae9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:45.258305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d3297eb9-295d-4f43-9c2a-435631924ae9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:45.269351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d3297eb9-295d-4f43-9c2a-435631924ae9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:45.271101 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d3297eb9-295d-4f43-9c2a-435631924ae9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:45.272559 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d3297eb9-295d-4f43-9c2a-435631924ae9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1815 microversion: 2.25 time: 0.295324 Oct 29 02:49:45.273122 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 550/1109] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:44 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1815 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:45.532559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-51a8ae0c-e386-4953-b167-9bbf968c046c tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Action: 'create', calling method: .version_select at 0x7ff053d45790>, body: {"keypair": {"name": "tempest-keypair-2114399205", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkkRcUsZJLqvhPuSh9IK6m5ARN8tXaH7VvLvef9FCdCwNaQMMyx6DqM1+W/krJHlLRCuXRsIA0uxmfQPqtiH2VT6ELzooa7dnMlJfs5b+r8sXXRzwyI8pnWODQgmyiVoA=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:45.563996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-51a8ae0c-e386-4953-b167-9bbf968c046c tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Getting quotas for project 520485bb54544a3389cec22317db2d13. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:49:45.572139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-51a8ae0c-e386-4953-b167-9bbf968c046c tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Getting quotas for user e2955d25314a42259483d8ccbfd7ee54 and project 520485bb54544a3389cec22317db2d13. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:49:45.605724 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-51a8ae0c-e386-4953-b167-9bbf968c046c tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.331036 Oct 29 02:49:45.606731 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 551/1110] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 02:49:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:45.613752 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-b9d749fb-cad6-4f7f-83c6-58626df7ed8b req-5b64e0cf-0733-492a-a721-db632afdba1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403f0ce5-3db7-4b5b-b809-9a5f4280b685", "name": "network-vif-unplugged", "status": "completed", "tag": "a71c4667-d218-4c4c-bab3-ff8606f16efe"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:45.626446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b9d749fb-cad6-4f7f-83c6-58626df7ed8b req-5b64e0cf-0733-492a-a721-db632afdba1f service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:45.627259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b9d749fb-cad6-4f7f-83c6-58626df7ed8b req-5b64e0cf-0733-492a-a721-db632afdba1f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:45.627892 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b9d749fb-cad6-4f7f-83c6-58626df7ed8b req-5b64e0cf-0733-492a-a721-db632afdba1f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:45.646708 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-b9d749fb-cad6-4f7f-83c6-58626df7ed8b req-5b64e0cf-0733-492a-a721-db632afdba1f service nova] Creating event network-vif-unplugged:a71c4667-d218-4c4c-bab3-ff8606f16efe for instance 403f0ce5-3db7-4b5b-b809-9a5f4280b685 on n-h1-862967-2 Oct 29 02:49:45.658603 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-b9d749fb-cad6-4f7f-83c6-58626df7ed8b req-5b64e0cf-0733-492a-a721-db632afdba1f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049986 Oct 29 02:49:45.659237 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 552/1111] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:45.670350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f377a6d8-b7a2-46bc-ab82-d2bf363d3555 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:45.671080 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f377a6d8-b7a2-46bc-ab82-d2bf363d3555 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: 20602fbc-9893-433b-b711-3de8a31a4608] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:45.678884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-124799f7-fffb-45a4-9d6e-6d9db8172c64 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Building network info cache for instance {{(pid=127125) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 02:49:45.680219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f377a6d8-b7a2-46bc-ab82-d2bf363d3555 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:45.680940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f377a6d8-b7a2-46bc-ab82-d2bf363d3555 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:45.681553 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f377a6d8-b7a2-46bc-ab82-d2bf363d3555 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:45.682445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f377a6d8-b7a2-46bc-ab82-d2bf363d3555 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:45.683077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f377a6d8-b7a2-46bc-ab82-d2bf363d3555 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:45.683683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f377a6d8-b7a2-46bc-ab82-d2bf363d3555 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:45.698632 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-f377a6d8-b7a2-46bc-ab82-d2bf363d3555 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] HTTP exception thrown: Instance 20602fbc-9893-433b-b711-3de8a31a4608 could not be found. Oct 29 02:49:45.700617 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f377a6d8-b7a2-46bc-ab82-d2bf363d3555 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Request method failure captured: Oct 29 02:49:45.700617 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608 HTTP/1.1 Oct 29 02:49:45.700617 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:49:45.700617 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:49:45.700617 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:49:45.700617 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:49:45.700617 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:49:45.700617 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:49:45.700617 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:49:45.700617 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:45.700617 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJQNCipo6WIEEDkIOIcg6ss0TyPZW0MTrbur_OGoa5LUOwz4me7FXab5TGO0MpDaR1jlmUm6g2HnM0r50nFTGz1NrZm3bt-2txTdhzE4iZfa63rrdhrzmjUuji3x-W7wQc_CJFsC46XyziPFeg08y3ITGIfiy96RBNVeqC9QxB1gY3k Oct 29 02:49:45.700617 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:49:45.700617 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:49:45.700617 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:49:45.700617 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:49:45.700617 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:49:45.700617 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:49:45.700617 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 4ce4605ee60c4bbdb3ec64e735ed73a6 Oct 29 02:49:45.700617 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-823878115 Oct 29 02:49:45.700617 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:49:45.700617 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:49:45.702253 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4ce4605ee60c4bbdb3ec64e735ed73a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4ce4605ee60c4bbdb3ec64e735ed73a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4ce4605ee60c4bbdb3ec64e735ed73a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4ce4605ee60c4bbdb3ec64e735ed73a6"}]}] Oct 29 02:49:45.702253 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-823878115 Oct 29 02:49:45.702253 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 4ce4605ee60c4bbdb3ec64e735ed73a6 Oct 29 02:49:45.702253 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-823878115 Oct 29 02:49:45.702253 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersWithSpecificFlavorTestJSON-823878115-project Oct 29 02:49:45.702253 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:49:45.702253 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:49:45.702253 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 5e562fcf734e45ce92536806eaec5750 Oct 29 02:49:45.702253 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-823878115-project Oct 29 02:49:45.702253 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:49:45.702253 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 20602fbc-9893-433b-b711-3de8a31a4608 could not be found. Oct 29 02:49:45.702253 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '20602fbc-9893-433b-b711-3de8a31a4608'} Oct 29 02:49:45.703193 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:45.703193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:45.703193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:49:45.703193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:49:45.703193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:49:45.703193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:49:45.703193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:49:45.703193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:49:45.703193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:49:45.703193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:49:45.703193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20602fbc-9893-433b-b711-3de8a31a4608 could not be found. Oct 29 02:49:45.703193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:45.703193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:45.703193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:45.703193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:45.703193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:45.703193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:45.703193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:45.703193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:45.703193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:45.704725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:45.704725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:49:45.704725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:49:45.704725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:49:45.704725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:49:45.704725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:49:45.704725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:49:45.704725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20602fbc-9893-433b-b711-3de8a31a4608 could not be found. Oct 29 02:49:45.704725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:45.704725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:45.704725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:45.704725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:45.704725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:45.704725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:45.704725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:45.704725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:45.704725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20602fbc-9893-433b-b711-3de8a31a4608 could not be found. Oct 29 02:49:45.704725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:45.707706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f377a6d8-b7a2-46bc-ab82-d2bf363d3555 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Returning 404 to user: Instance 20602fbc-9893-433b-b711-3de8a31a4608 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:45.708906 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f377a6d8-b7a2-46bc-ab82-d2bf363d3555 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608" status: 404 len: 111 microversion: 2.1 time: 0.048563 Oct 29 02:49:45.709659 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 553/1112] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:45 2022] GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:45.714446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-fc271316-1146-43e7-8f8b-efa8fc0eb89b req-f335873c-aa68-4f88-a20c-eb38d3a11188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bfceda7-a17c-40a9-afcc-767b96d5ac7b", "name": "network-vif-deleted", "tag": "99bb1159-a8fd-4f60-8e3d-a0322363f20d"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:45.726784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-fc271316-1146-43e7-8f8b-efa8fc0eb89b req-f335873c-aa68-4f88-a20c-eb38d3a11188 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:45.727643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-fc271316-1146-43e7-8f8b-efa8fc0eb89b req-f335873c-aa68-4f88-a20c-eb38d3a11188 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:45.728251 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-fc271316-1146-43e7-8f8b-efa8fc0eb89b req-f335873c-aa68-4f88-a20c-eb38d3a11188 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:45.763268 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-fc271316-1146-43e7-8f8b-efa8fc0eb89b req-f335873c-aa68-4f88-a20c-eb38d3a11188 service nova] Creating event network-vif-deleted:99bb1159-a8fd-4f60-8e3d-a0322363f20d for instance 7bfceda7-a17c-40a9-afcc-767b96d5ac7b on n-h2-862967-2 Oct 29 02:49:45.790131 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-fc271316-1146-43e7-8f8b-efa8fc0eb89b req-f335873c-aa68-4f88-a20c-eb38d3a11188 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077107 Oct 29 02:49:45.792088 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 554/1113] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:45.802842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ef648192-10d6-4804-b7f8-7c026acb53b8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:45.806607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ef648192-10d6-4804-b7f8-7c026acb53b8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:45.831735 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef648192-10d6-4804-b7f8-7c026acb53b8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:45.832677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef648192-10d6-4804-b7f8-7c026acb53b8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:45.833280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef648192-10d6-4804-b7f8-7c026acb53b8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:45.834149 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef648192-10d6-4804-b7f8-7c026acb53b8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:45.835969 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef648192-10d6-4804-b7f8-7c026acb53b8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:45.836587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef648192-10d6-4804-b7f8-7c026acb53b8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:45.978766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ef648192-10d6-4804-b7f8-7c026acb53b8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:45.996938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ef648192-10d6-4804-b7f8-7c026acb53b8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:46.007505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ef648192-10d6-4804-b7f8-7c026acb53b8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:46.042416 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ef648192-10d6-4804-b7f8-7c026acb53b8 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1537 microversion: 2.91 time: 0.244785 Oct 29 02:49:46.044582 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 555/1114] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:45 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1537 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:46.065666 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-89edd2d1-83fc-41b7-8938-e4328cf99335 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:46.066889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-89edd2d1-83fc-41b7-8938-e4328cf99335 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 6c325f03-e675-4cd8-928e-a09523951d3d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:46.088449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89edd2d1-83fc-41b7-8938-e4328cf99335 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:46.089405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89edd2d1-83fc-41b7-8938-e4328cf99335 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:46.090124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89edd2d1-83fc-41b7-8938-e4328cf99335 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:46.091237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89edd2d1-83fc-41b7-8938-e4328cf99335 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:46.092697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89edd2d1-83fc-41b7-8938-e4328cf99335 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:46.093415 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89edd2d1-83fc-41b7-8938-e4328cf99335 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:46.160905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89edd2d1-83fc-41b7-8938-e4328cf99335 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:46.161794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89edd2d1-83fc-41b7-8938-e4328cf99335 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:46.162529 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89edd2d1-83fc-41b7-8938-e4328cf99335 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:46.163478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-89edd2d1-83fc-41b7-8938-e4328cf99335 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lazy-loading 'fault' on Instance uuid 6c325f03-e675-4cd8-928e-a09523951d3d {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:49:46.285242 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-89edd2d1-83fc-41b7-8938-e4328cf99335 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:46.289558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:46.319644 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-89edd2d1-83fc-41b7-8938-e4328cf99335 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/6c325f03-e675-4cd8-928e-a09523951d3d" status: 200 len: 1308 microversion: 2.1 time: 0.273566 Oct 29 02:49:46.325129 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 556/1115] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:46 2022] GET /compute/v2.1/servers/6c325f03-e675-4cd8-928e-a09523951d3d => generated 1308 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:46.337739 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-98d5de04-618d-4c6a-b2c1-ff95f82d2f7b req-265a1ed6-320e-47ac-8e8c-20ca12cbdcd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c325f03-e675-4cd8-928e-a09523951d3d", "name": "network-vif-deleted", "tag": "d7415e85-b26b-458a-89a7-2771cf318df7"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:46.368246 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:46.381670 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-98d5de04-618d-4c6a-b2c1-ff95f82d2f7b req-265a1ed6-320e-47ac-8e8c-20ca12cbdcd0 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:46.382286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-98d5de04-618d-4c6a-b2c1-ff95f82d2f7b req-265a1ed6-320e-47ac-8e8c-20ca12cbdcd0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:46.382798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-98d5de04-618d-4c6a-b2c1-ff95f82d2f7b req-265a1ed6-320e-47ac-8e8c-20ca12cbdcd0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:46.433047 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-98d5de04-618d-4c6a-b2c1-ff95f82d2f7b req-265a1ed6-320e-47ac-8e8c-20ca12cbdcd0 service nova] Creating event network-vif-deleted:d7415e85-b26b-458a-89a7-2771cf318df7 for instance 6c325f03-e675-4cd8-928e-a09523951d3d on n-h2-862967-2 Oct 29 02:49:46.455717 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-98d5de04-618d-4c6a-b2c1-ff95f82d2f7b req-265a1ed6-320e-47ac-8e8c-20ca12cbdcd0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127731 Oct 29 02:49:46.458828 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 557/1116] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:46.484630 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d6736467-5e72-4d81-8256-a00ccd731013 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:46.485551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d6736467-5e72-4d81-8256-a00ccd731013 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:46.506103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6736467-5e72-4d81-8256-a00ccd731013 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:46.506694 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6736467-5e72-4d81-8256-a00ccd731013 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:46.510502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6736467-5e72-4d81-8256-a00ccd731013 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:46.511615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6736467-5e72-4d81-8256-a00ccd731013 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:46.516247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6736467-5e72-4d81-8256-a00ccd731013 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:46.517075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6736467-5e72-4d81-8256-a00ccd731013 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:46.917679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-124799f7-fffb-45a4-9d6e-6d9db8172c64 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Updating instance_info_cache with network_info: [{"id": "d045507b-53ea-4e4f-9def-029bda6114ff", "address": "fa:16:3e:6e:25:30", "network": {"id": "c9c7c955-06f7-476b-b584-0d9678a745fd", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-713225838-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fd611070fee0435f8bdda9c3ba5d62fc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd045507b-53", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127125) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 02:49:46.949168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-124799f7-fffb-45a4-9d6e-6d9db8172c64 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Releasing lock "refresh_cache-3380e407-b7cb-4775-b5ed-17ef51c3764a" {{(pid=127125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 02:49:46.952286 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-124799f7-fffb-45a4-9d6e-6d9db8172c64 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "POST /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a/action" status: 202 len: 0 microversion: 2.1 time: 4.604674 Oct 29 02:49:46.957441 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 560/1117] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:49:42 2022] POST /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a/action => generated 0 bytes in 4611 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 02:49:46.974211 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-59d3ada0-b055-4670-a2b8-1ed32920e750 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:46.992747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d6736467-5e72-4d81-8256-a00ccd731013 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:46.997784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-59d3ada0-b055-4670-a2b8-1ed32920e750 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: aff333bb-fff4-4b3e-a3f9-a567b7786a62] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:47.008441 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d6736467-5e72-4d81-8256-a00ccd731013 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1477 microversion: 2.1 time: 0.547560 Oct 29 02:49:47.022137 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 558/1118] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:46 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1477 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:47.022795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59d3ada0-b055-4670-a2b8-1ed32920e750 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:47.024452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59d3ada0-b055-4670-a2b8-1ed32920e750 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:47.024936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59d3ada0-b055-4670-a2b8-1ed32920e750 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:47.025829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59d3ada0-b055-4670-a2b8-1ed32920e750 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:47.026296 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59d3ada0-b055-4670-a2b8-1ed32920e750 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:47.026779 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59d3ada0-b055-4670-a2b8-1ed32920e750 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:47.034043 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d1935e70-fe21-4a27-8943-994697af6747 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:47.034802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d1935e70-fe21-4a27-8943-994697af6747 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:47.042016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1935e70-fe21-4a27-8943-994697af6747 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:47.042670 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1935e70-fe21-4a27-8943-994697af6747 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:47.043208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1935e70-fe21-4a27-8943-994697af6747 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:47.044275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1935e70-fe21-4a27-8943-994697af6747 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:47.044930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1935e70-fe21-4a27-8943-994697af6747 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:47.045599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1935e70-fe21-4a27-8943-994697af6747 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:47.066998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:47.069236 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-59d3ada0-b055-4670-a2b8-1ed32920e750 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] HTTP exception thrown: Instance aff333bb-fff4-4b3e-a3f9-a567b7786a62 could not be found. Oct 29 02:49:47.071398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-59d3ada0-b055-4670-a2b8-1ed32920e750 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Request method failure captured: Oct 29 02:49:47.071398 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62 HTTP/1.1 Oct 29 02:49:47.071398 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:49:47.071398 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:49:47.071398 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:49:47.071398 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:49:47.071398 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:49:47.071398 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:49:47.071398 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:49:47.071398 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:47.071398 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJQNCipo6WIEEDkIOIcg6ss0TyPZW0MTrbur_OGoa5LUOwz4me7FXab5TGO0MpDaR1jlmUm6g2HnM0r50nFTGz1NrZm3bt-2txTdhzE4iZfa63rrdhrzmjUuji3x-W7wQc_CJFsC46XyziPFeg08y3ITGIfiy96RBNVeqC9QxB1gY3k Oct 29 02:49:47.071398 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:49:47.071398 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:49:47.071398 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:49:47.071398 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:49:47.071398 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:49:47.071398 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:49:47.071398 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 4ce4605ee60c4bbdb3ec64e735ed73a6 Oct 29 02:49:47.071398 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-823878115 Oct 29 02:49:47.071398 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:49:47.071398 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:49:47.072968 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4ce4605ee60c4bbdb3ec64e735ed73a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4ce4605ee60c4bbdb3ec64e735ed73a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4ce4605ee60c4bbdb3ec64e735ed73a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4ce4605ee60c4bbdb3ec64e735ed73a6"}]}] Oct 29 02:49:47.072968 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-823878115 Oct 29 02:49:47.072968 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 4ce4605ee60c4bbdb3ec64e735ed73a6 Oct 29 02:49:47.072968 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-823878115 Oct 29 02:49:47.072968 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersWithSpecificFlavorTestJSON-823878115-project Oct 29 02:49:47.072968 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:49:47.072968 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:49:47.072968 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 5e562fcf734e45ce92536806eaec5750 Oct 29 02:49:47.072968 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-823878115-project Oct 29 02:49:47.072968 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:49:47.072968 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance aff333bb-fff4-4b3e-a3f9-a567b7786a62 could not be found. Oct 29 02:49:47.072968 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'aff333bb-fff4-4b3e-a3f9-a567b7786a62'} Oct 29 02:49:47.073723 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:47.073723 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:47.073723 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:49:47.073723 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:49:47.073723 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:49:47.073723 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:49:47.073723 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:49:47.073723 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:49:47.073723 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:49:47.073723 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:49:47.073723 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aff333bb-fff4-4b3e-a3f9-a567b7786a62 could not be found. Oct 29 02:49:47.073723 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:47.073723 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:47.073723 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:47.073723 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:47.073723 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:47.073723 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:47.073723 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:47.073723 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:47.073723 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:47.075029 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:47.075029 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:49:47.075029 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:49:47.075029 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:49:47.075029 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:49:47.075029 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:49:47.075029 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:49:47.075029 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:49:47.075029 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:49:47.075029 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aff333bb-fff4-4b3e-a3f9-a567b7786a62 could not be found. Oct 29 02:49:47.075029 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:47.075029 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:47.075029 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:47.075029 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:47.075029 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:47.075029 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:47.075029 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:47.075029 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:47.075029 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aff333bb-fff4-4b3e-a3f9-a567b7786a62 could not be found. Oct 29 02:49:47.075029 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:49:47.078702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-59d3ada0-b055-4670-a2b8-1ed32920e750 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Returning 404 to user: Instance aff333bb-fff4-4b3e-a3f9-a567b7786a62 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:47.079807 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-59d3ada0-b055-4670-a2b8-1ed32920e750 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "DELETE /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62" status: 404 len: 111 microversion: 2.1 time: 0.119971 Oct 29 02:49:47.080962 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 561/1119] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:49:46 2022] DELETE /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:47.089518 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b8a2601b-4ba5-4693-b363-0fb31b3052d6 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.224"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:47.092410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b8a2601b-4ba5-4693-b363-0fb31b3052d6 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:47.100697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8a2601b-4ba5-4693-b363-0fb31b3052d6 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:47.101558 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8a2601b-4ba5-4693-b363-0fb31b3052d6 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:47.102169 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8a2601b-4ba5-4693-b363-0fb31b3052d6 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:47.103097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8a2601b-4ba5-4693-b363-0fb31b3052d6 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:47.103731 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8a2601b-4ba5-4693-b363-0fb31b3052d6 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:47.104394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8a2601b-4ba5-4693-b363-0fb31b3052d6 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:47.141769 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8a2601b-4ba5-4693-b363-0fb31b3052d6 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "refresh_cache-095efcbf-4088-49c1-9cb8-7d6b3f27af88" {{(pid=127125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 02:49:47.142442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8a2601b-4ba5-4693-b363-0fb31b3052d6 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquired lock "refresh_cache-095efcbf-4088-49c1-9cb8-7d6b3f27af88" {{(pid=127125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 02:49:47.272337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d1935e70-fe21-4a27-8943-994697af6747 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:47.327233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d1935e70-fe21-4a27-8943-994697af6747 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:47.329244 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d1935e70-fe21-4a27-8943-994697af6747 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:47.331730 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d1935e70-fe21-4a27-8943-994697af6747 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1815 microversion: 2.25 time: 0.307775 Oct 29 02:49:47.332317 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 559/1120] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:47 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1815 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:47.338427 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5e928122-84ef-4a86-a1fb-87a7ba3bfb70 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:47.339255 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5e928122-84ef-4a86-a1fb-87a7ba3bfb70 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:47.349863 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e928122-84ef-4a86-a1fb-87a7ba3bfb70 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:47.350361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e928122-84ef-4a86-a1fb-87a7ba3bfb70 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:47.350797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e928122-84ef-4a86-a1fb-87a7ba3bfb70 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:47.351504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e928122-84ef-4a86-a1fb-87a7ba3bfb70 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:47.351954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e928122-84ef-4a86-a1fb-87a7ba3bfb70 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:47.352377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e928122-84ef-4a86-a1fb-87a7ba3bfb70 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:47.438474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5e928122-84ef-4a86-a1fb-87a7ba3bfb70 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:47.448261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5e928122-84ef-4a86-a1fb-87a7ba3bfb70 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:47.449786 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5e928122-84ef-4a86-a1fb-87a7ba3bfb70 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:47.456394 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5e928122-84ef-4a86-a1fb-87a7ba3bfb70 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1537 microversion: 2.91 time: 0.122607 Oct 29 02:49:47.457556 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 560/1121] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:47 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1537 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:47.462750 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-db2fb09f-4bde-4994-8234-5c203959983e tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:47.463607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-db2fb09f-4bde-4994-8234-5c203959983e tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: aff333bb-fff4-4b3e-a3f9-a567b7786a62] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:47.475084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db2fb09f-4bde-4994-8234-5c203959983e tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:47.475835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db2fb09f-4bde-4994-8234-5c203959983e tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:47.476472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db2fb09f-4bde-4994-8234-5c203959983e tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:47.477411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db2fb09f-4bde-4994-8234-5c203959983e tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:47.478039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db2fb09f-4bde-4994-8234-5c203959983e tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:47.481522 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db2fb09f-4bde-4994-8234-5c203959983e tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:47.500969 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-db2fb09f-4bde-4994-8234-5c203959983e tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] HTTP exception thrown: Instance aff333bb-fff4-4b3e-a3f9-a567b7786a62 could not be found. Oct 29 02:49:47.502833 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-db2fb09f-4bde-4994-8234-5c203959983e tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Request method failure captured: Oct 29 02:49:47.502833 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62 HTTP/1.1 Oct 29 02:49:47.502833 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:49:47.502833 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:49:47.502833 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:49:47.502833 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:49:47.502833 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:49:47.502833 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:49:47.502833 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:49:47.502833 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:47.502833 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJQNCipo6WIEEDkIOIcg6ss0TyPZW0MTrbur_OGoa5LUOwz4me7FXab5TGO0MpDaR1jlmUm6g2HnM0r50nFTGz1NrZm3bt-2txTdhzE4iZfa63rrdhrzmjUuji3x-W7wQc_CJFsC46XyziPFeg08y3ITGIfiy96RBNVeqC9QxB1gY3k Oct 29 02:49:47.502833 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:49:47.502833 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:49:47.502833 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:49:47.502833 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:49:47.502833 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:49:47.502833 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:49:47.502833 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 4ce4605ee60c4bbdb3ec64e735ed73a6 Oct 29 02:49:47.502833 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-823878115 Oct 29 02:49:47.502833 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:49:47.502833 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:49:47.504468 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4ce4605ee60c4bbdb3ec64e735ed73a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4ce4605ee60c4bbdb3ec64e735ed73a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4ce4605ee60c4bbdb3ec64e735ed73a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4ce4605ee60c4bbdb3ec64e735ed73a6"}]}] Oct 29 02:49:47.504468 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-823878115 Oct 29 02:49:47.504468 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 4ce4605ee60c4bbdb3ec64e735ed73a6 Oct 29 02:49:47.504468 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-823878115 Oct 29 02:49:47.504468 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersWithSpecificFlavorTestJSON-823878115-project Oct 29 02:49:47.504468 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:49:47.504468 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:49:47.504468 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 5e562fcf734e45ce92536806eaec5750 Oct 29 02:49:47.504468 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-823878115-project Oct 29 02:49:47.504468 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:49:47.504468 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance aff333bb-fff4-4b3e-a3f9-a567b7786a62 could not be found. Oct 29 02:49:47.504468 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'aff333bb-fff4-4b3e-a3f9-a567b7786a62'} Oct 29 02:49:47.505391 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:47.505391 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:47.505391 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:49:47.505391 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:49:47.505391 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:49:47.505391 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:49:47.505391 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:49:47.505391 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:49:47.505391 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:49:47.505391 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:49:47.505391 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aff333bb-fff4-4b3e-a3f9-a567b7786a62 could not be found. Oct 29 02:49:47.505391 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:47.505391 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:47.505391 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:47.505391 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:47.505391 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:47.505391 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:47.505391 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:47.505391 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:47.505391 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:47.506835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:47.506835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:49:47.506835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:49:47.506835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:49:47.506835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:49:47.506835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:49:47.506835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:49:47.506835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aff333bb-fff4-4b3e-a3f9-a567b7786a62 could not be found. Oct 29 02:49:47.506835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:47.506835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:47.506835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:47.506835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:47.506835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:47.506835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:47.506835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:47.506835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:47.506835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aff333bb-fff4-4b3e-a3f9-a567b7786a62 could not be found. Oct 29 02:49:47.506835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:47.508021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-db2fb09f-4bde-4994-8234-5c203959983e tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Returning 404 to user: Instance aff333bb-fff4-4b3e-a3f9-a567b7786a62 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:47.508021 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-db2fb09f-4bde-4994-8234-5c203959983e tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62" status: 404 len: 111 microversion: 2.1 time: 0.045561 Oct 29 02:49:47.509691 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 561/1122] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:47 2022] GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:47.515419 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-94e86b62-c40f-4f5b-9f86-38574c16410b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:47.516054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-94e86b62-c40f-4f5b-9f86-38574c16410b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 6c325f03-e675-4cd8-928e-a09523951d3d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:47.531644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-94e86b62-c40f-4f5b-9f86-38574c16410b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:47.537219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-94e86b62-c40f-4f5b-9f86-38574c16410b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:47.538034 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-94e86b62-c40f-4f5b-9f86-38574c16410b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:47.538571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-94e86b62-c40f-4f5b-9f86-38574c16410b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:47.539039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-94e86b62-c40f-4f5b-9f86-38574c16410b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:47.539554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-94e86b62-c40f-4f5b-9f86-38574c16410b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:47.563878 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-94e86b62-c40f-4f5b-9f86-38574c16410b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] HTTP exception thrown: Instance 6c325f03-e675-4cd8-928e-a09523951d3d could not be found. Oct 29 02:49:47.577820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-94e86b62-c40f-4f5b-9f86-38574c16410b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Request method failure captured: Oct 29 02:49:47.577820 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/6c325f03-e675-4cd8-928e-a09523951d3d HTTP/1.1 Oct 29 02:49:47.577820 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:49:47.577820 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:49:47.577820 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:49:47.577820 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:49:47.577820 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:49:47.577820 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:49:47.577820 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:49:47.577820 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:47.577820 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPtIMVuxUQ5sESBGcpDIyg0JlWGhaenNyoF1KsslH7tI-Ide1t1Qc6YWBoCicDg4iK9BWmVgzBvHQx10NYcQWd4V883MefaFkAV2l76Vzo9g4yJTR39I57-5iCCl5el4McwVe4d-eqtN30on7NVpVe0PpaW9_bFKynEcnhRDBRUQ1A Oct 29 02:49:47.577820 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:49:47.577820 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:49:47.577820 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:49:47.577820 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:49:47.577820 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:49:47.577820 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:49:47.577820 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: dcc6da8e69e041e19023a53a23e33393 Oct 29 02:49:47.577820 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersOnMultiNodesTest-354009816 Oct 29 02:49:47.577820 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:49:47.577820 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:49:47.579502 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dcc6da8e69e041e19023a53a23e33393"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dcc6da8e69e041e19023a53a23e33393"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_dcc6da8e69e041e19023a53a23e33393"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/dcc6da8e69e041e19023a53a23e33393"}]}] Oct 29 02:49:47.579502 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersOnMultiNodesTest-354009816 Oct 29 02:49:47.579502 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: dcc6da8e69e041e19023a53a23e33393 Oct 29 02:49:47.579502 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-354009816 Oct 29 02:49:47.579502 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersOnMultiNodesTest-354009816-project Oct 29 02:49:47.579502 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:49:47.579502 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:49:47.579502 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 509ce04aeb3847f084629201bd7ae5d6 Oct 29 02:49:47.579502 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersOnMultiNodesTest-354009816-project Oct 29 02:49:47.579502 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:49:47.579502 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 6c325f03-e675-4cd8-928e-a09523951d3d could not be found. Oct 29 02:49:47.579502 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '6c325f03-e675-4cd8-928e-a09523951d3d'} Oct 29 02:49:47.580506 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:47.580506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:47.580506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:49:47.580506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:49:47.580506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:49:47.580506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:49:47.580506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:49:47.580506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:49:47.580506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:49:47.580506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:49:47.580506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c325f03-e675-4cd8-928e-a09523951d3d could not be found. Oct 29 02:49:47.580506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:47.580506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:47.580506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:47.580506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:47.580506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:47.580506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:47.580506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:47.580506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:47.580506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:47.582005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:47.582005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:49:47.582005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:49:47.582005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:49:47.582005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:49:47.582005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:49:47.582005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:49:47.582005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c325f03-e675-4cd8-928e-a09523951d3d could not be found. Oct 29 02:49:47.582005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:47.582005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:47.582005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:47.582005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:47.582005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:47.582005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:47.582005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:47.582005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:47.582005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c325f03-e675-4cd8-928e-a09523951d3d could not be found. Oct 29 02:49:47.582005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:47.583769 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-94e86b62-c40f-4f5b-9f86-38574c16410b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Returning 404 to user: Instance 6c325f03-e675-4cd8-928e-a09523951d3d could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:47.583769 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-94e86b62-c40f-4f5b-9f86-38574c16410b tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/6c325f03-e675-4cd8-928e-a09523951d3d" status: 404 len: 111 microversion: 2.1 time: 0.068685 Oct 29 02:49:47.583769 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 562/1123] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:47 2022] GET /compute/v2.1/servers/6c325f03-e675-4cd8-928e-a09523951d3d => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:47.588437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-21ad3328-6cb2-41b9-99bf-ae6437281014 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '.version_select at 0x7ff053d71af0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:47.633961 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-21ad3328-6cb2-41b9-99bf-ae6437281014 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1611755857" status: 202 len: 0 microversion: 2.1 time: 0.049267 Oct 29 02:49:47.634869 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 563/1124] 10.222.0.46 () {58 vars in 1221 bytes} [Sat Oct 29 02:49:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1611755857 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:47.640057 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1def9f0e-5e69-4545-887e-b5576b135e58 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:47.640723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1def9f0e-5e69-4545-887e-b5576b135e58 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: 7bfceda7-a17c-40a9-afcc-767b96d5ac7b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:47.654836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1def9f0e-5e69-4545-887e-b5576b135e58 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:47.655348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1def9f0e-5e69-4545-887e-b5576b135e58 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:47.655773 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1def9f0e-5e69-4545-887e-b5576b135e58 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:47.656775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1def9f0e-5e69-4545-887e-b5576b135e58 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:47.657432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1def9f0e-5e69-4545-887e-b5576b135e58 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:47.658021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1def9f0e-5e69-4545-887e-b5576b135e58 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:47.690044 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-1def9f0e-5e69-4545-887e-b5576b135e58 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] HTTP exception thrown: Instance 7bfceda7-a17c-40a9-afcc-767b96d5ac7b could not be found. Oct 29 02:49:47.692048 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1def9f0e-5e69-4545-887e-b5576b135e58 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Request method failure captured: Oct 29 02:49:47.692048 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b HTTP/1.1 Oct 29 02:49:47.692048 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:49:47.692048 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:49:47.692048 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:49:47.692048 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:49:47.692048 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:49:47.692048 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:49:47.692048 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:49:47.692048 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:47.692048 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPtIMVuxUQ5sESBGcpDIyg0JlWGhaenNyoF1KsslH7tI-Ide1t1Qc6YWBoCicDg4iK9BWmVgzBvHQx10NYcQWd4V883MefaFkAV2l76Vzo9g4yJTR39I57-5iCCl5el4McwVe4d-eqtN30on7NVpVe0PpaW9_bFKynEcnhRDBRUQ1A Oct 29 02:49:47.692048 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:49:47.692048 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:49:47.692048 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:49:47.692048 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:49:47.692048 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:49:47.692048 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:49:47.692048 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: dcc6da8e69e041e19023a53a23e33393 Oct 29 02:49:47.692048 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersOnMultiNodesTest-354009816 Oct 29 02:49:47.692048 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:49:47.692048 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:49:47.693432 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dcc6da8e69e041e19023a53a23e33393"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dcc6da8e69e041e19023a53a23e33393"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_dcc6da8e69e041e19023a53a23e33393"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/dcc6da8e69e041e19023a53a23e33393"}]}] Oct 29 02:49:47.693432 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersOnMultiNodesTest-354009816 Oct 29 02:49:47.693432 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: dcc6da8e69e041e19023a53a23e33393 Oct 29 02:49:47.693432 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-354009816 Oct 29 02:49:47.693432 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersOnMultiNodesTest-354009816-project Oct 29 02:49:47.693432 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:49:47.693432 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:49:47.693432 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 509ce04aeb3847f084629201bd7ae5d6 Oct 29 02:49:47.693432 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersOnMultiNodesTest-354009816-project Oct 29 02:49:47.693432 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:49:47.693432 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 7bfceda7-a17c-40a9-afcc-767b96d5ac7b could not be found. Oct 29 02:49:47.693432 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '7bfceda7-a17c-40a9-afcc-767b96d5ac7b'} Oct 29 02:49:47.694183 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:47.694183 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:47.694183 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:49:47.694183 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:49:47.694183 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:49:47.694183 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:49:47.694183 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:49:47.694183 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:49:47.694183 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:49:47.694183 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:49:47.694183 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bfceda7-a17c-40a9-afcc-767b96d5ac7b could not be found. Oct 29 02:49:47.694183 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:47.694183 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:47.694183 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:47.694183 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:47.694183 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:47.694183 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:47.694183 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:47.694183 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:47.694183 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:47.695356 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:47.695356 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:49:47.695356 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:49:47.695356 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:49:47.695356 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:49:47.695356 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:49:47.695356 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:49:47.695356 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bfceda7-a17c-40a9-afcc-767b96d5ac7b could not be found. Oct 29 02:49:47.695356 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:47.695356 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:47.695356 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:47.695356 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:47.695356 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:47.695356 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:47.695356 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:47.695356 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:47.695356 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bfceda7-a17c-40a9-afcc-767b96d5ac7b could not be found. Oct 29 02:49:47.695356 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:47.698250 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1def9f0e-5e69-4545-887e-b5576b135e58 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Returning 404 to user: Instance 7bfceda7-a17c-40a9-afcc-767b96d5ac7b could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:47.699440 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1def9f0e-5e69-4545-887e-b5576b135e58 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b" status: 404 len: 111 microversion: 2.1 time: 0.063631 Oct 29 02:49:47.703588 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 564/1125] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:47 2022] GET /compute/v2.1/servers/7bfceda7-a17c-40a9-afcc-767b96d5ac7b => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:47.715294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4e014061-487b-4e24-8eb3-b12fbe5589b5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:47.755850 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4e014061-487b-4e24-8eb3-b12fbe5589b5 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/de548a53-9d1f-4349-8654-a81238773ac6" status: 204 len: 0 microversion: 2.1 time: 0.050661 Oct 29 02:49:47.762076 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 565/1126] 10.222.0.46 () {58 vars in 1266 bytes} [Sat Oct 29 02:49:47 2022] DELETE /compute/v2.1/os-server-groups/de548a53-9d1f-4349-8654-a81238773ac6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:49:47.769602 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3edd6995-27a8-4889-aef3-7eafcaa5f760 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:47.770480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3edd6995-27a8-4889-aef3-7eafcaa5f760 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: b65a6807-c8ad-44d0-93d7-931037ca8afd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:47.778377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3edd6995-27a8-4889-aef3-7eafcaa5f760 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:47.779252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3edd6995-27a8-4889-aef3-7eafcaa5f760 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:47.779904 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3edd6995-27a8-4889-aef3-7eafcaa5f760 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:47.780974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3edd6995-27a8-4889-aef3-7eafcaa5f760 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:47.782334 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3edd6995-27a8-4889-aef3-7eafcaa5f760 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:47.783003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3edd6995-27a8-4889-aef3-7eafcaa5f760 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:47.836761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3edd6995-27a8-4889-aef3-7eafcaa5f760 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: b65a6807-c8ad-44d0-93d7-931037ca8afd] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:49:48.040867 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3edd6995-27a8-4889-aef3-7eafcaa5f760 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b65a6807-c8ad-44d0-93d7-931037ca8afd" status: 204 len: 0 microversion: 2.1 time: 0.276465 Oct 29 02:49:48.044233 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 566/1127] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:49:47 2022] DELETE /compute/v2.1/servers/b65a6807-c8ad-44d0-93d7-931037ca8afd => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:49:48.063613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9cb86fe8-115d-4063-9c1f-6aba28aed8fb tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:48.069344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9cb86fe8-115d-4063-9c1f-6aba28aed8fb tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:48.097810 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9cb86fe8-115d-4063-9c1f-6aba28aed8fb tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:48.099782 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9cb86fe8-115d-4063-9c1f-6aba28aed8fb tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:48.102503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9cb86fe8-115d-4063-9c1f-6aba28aed8fb tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:48.104234 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9cb86fe8-115d-4063-9c1f-6aba28aed8fb tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:48.107347 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9cb86fe8-115d-4063-9c1f-6aba28aed8fb tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:48.108023 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9cb86fe8-115d-4063-9c1f-6aba28aed8fb tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:48.355754 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9cb86fe8-115d-4063-9c1f-6aba28aed8fb tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:48.364935 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9cb86fe8-115d-4063-9c1f-6aba28aed8fb tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1477 microversion: 2.1 time: 0.317399 Oct 29 02:49:48.366784 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 567/1128] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:48 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1477 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:48.372182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-858020eb-2967-4d17-918a-304fbdede281 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:48.372835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-858020eb-2967-4d17-918a-304fbdede281 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: b65a6807-c8ad-44d0-93d7-931037ca8afd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:48.380947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-858020eb-2967-4d17-918a-304fbdede281 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:48.381444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-858020eb-2967-4d17-918a-304fbdede281 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:48.381944 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-858020eb-2967-4d17-918a-304fbdede281 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:48.382944 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-858020eb-2967-4d17-918a-304fbdede281 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:48.383409 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-858020eb-2967-4d17-918a-304fbdede281 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:48.383827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-858020eb-2967-4d17-918a-304fbdede281 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:48.577432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-858020eb-2967-4d17-918a-304fbdede281 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:48.587638 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-858020eb-2967-4d17-918a-304fbdede281 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/b65a6807-c8ad-44d0-93d7-931037ca8afd" status: 200 len: 1472 microversion: 2.1 time: 0.219726 Oct 29 02:49:48.605625 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 568/1129] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:48 2022] GET /compute/v2.1/servers/b65a6807-c8ad-44d0-93d7-931037ca8afd => generated 1472 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:48.611835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6661c54b-adac-4b61-a2ee-445892e6a833 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:48.612941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6661c54b-adac-4b61-a2ee-445892e6a833 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:48.620280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6661c54b-adac-4b61-a2ee-445892e6a833 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:48.621058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6661c54b-adac-4b61-a2ee-445892e6a833 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:48.621650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6661c54b-adac-4b61-a2ee-445892e6a833 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:48.622644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6661c54b-adac-4b61-a2ee-445892e6a833 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:48.623381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6661c54b-adac-4b61-a2ee-445892e6a833 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:48.623975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6661c54b-adac-4b61-a2ee-445892e6a833 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:48.967309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6661c54b-adac-4b61-a2ee-445892e6a833 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:48.981802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6661c54b-adac-4b61-a2ee-445892e6a833 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:48.987743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6661c54b-adac-4b61-a2ee-445892e6a833 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:48.994856 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6661c54b-adac-4b61-a2ee-445892e6a833 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1815 microversion: 2.25 time: 0.382577 Oct 29 02:49:49.016082 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 569/1130] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:48 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1815 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:49.021142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-90082782-dd2a-4222-8006-08022895a5dc req-2d503752-110b-45e2-a2b3-06eafcec27b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403f0ce5-3db7-4b5b-b809-9a5f4280b685", "name": "network-vif-plugged", "status": "completed", "tag": "a71c4667-d218-4c4c-bab3-ff8606f16efe"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:49.038216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-90082782-dd2a-4222-8006-08022895a5dc req-2d503752-110b-45e2-a2b3-06eafcec27b6 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:49.038675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-90082782-dd2a-4222-8006-08022895a5dc req-2d503752-110b-45e2-a2b3-06eafcec27b6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:49.040126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-90082782-dd2a-4222-8006-08022895a5dc req-2d503752-110b-45e2-a2b3-06eafcec27b6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:49.057358 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-90082782-dd2a-4222-8006-08022895a5dc req-2d503752-110b-45e2-a2b3-06eafcec27b6 service nova] Creating event network-vif-plugged:a71c4667-d218-4c4c-bab3-ff8606f16efe for instance 403f0ce5-3db7-4b5b-b809-9a5f4280b685 on n-h1-862967-2 Oct 29 02:49:49.067764 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-90082782-dd2a-4222-8006-08022895a5dc req-2d503752-110b-45e2-a2b3-06eafcec27b6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049483 Oct 29 02:49:49.069413 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 570/1131] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:49.083624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-123b61e8-a12c-42e8-9990-8b9e75bb30ed tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:49.087362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-123b61e8-a12c-42e8-9990-8b9e75bb30ed tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:49.101558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-123b61e8-a12c-42e8-9990-8b9e75bb30ed tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:49.102053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-123b61e8-a12c-42e8-9990-8b9e75bb30ed tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:49.107491 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-123b61e8-a12c-42e8-9990-8b9e75bb30ed tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:49.110685 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-123b61e8-a12c-42e8-9990-8b9e75bb30ed tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:49.111217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-123b61e8-a12c-42e8-9990-8b9e75bb30ed tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:49.111673 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-123b61e8-a12c-42e8-9990-8b9e75bb30ed tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:49.209399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-123b61e8-a12c-42e8-9990-8b9e75bb30ed tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:49.230383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-123b61e8-a12c-42e8-9990-8b9e75bb30ed tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:49.235034 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-123b61e8-a12c-42e8-9990-8b9e75bb30ed tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:49.250824 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-123b61e8-a12c-42e8-9990-8b9e75bb30ed tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1537 microversion: 2.91 time: 0.179739 Oct 29 02:49:49.252143 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 571/1132] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:49 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1537 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:49.257053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-82e12298-1882-469b-8155-b0cd59affc30 req-762e56b5-5f86-48ad-ae38-226be629add9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3380e407-b7cb-4775-b5ed-17ef51c3764a", "tag": "d045507b-53ea-4e4f-9def-029bda6114ff"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:49.267789 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-82e12298-1882-469b-8155-b0cd59affc30 req-762e56b5-5f86-48ad-ae38-226be629add9 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:49.268437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-82e12298-1882-469b-8155-b0cd59affc30 req-762e56b5-5f86-48ad-ae38-226be629add9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:49.269021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-82e12298-1882-469b-8155-b0cd59affc30 req-762e56b5-5f86-48ad-ae38-226be629add9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:49.296808 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-82e12298-1882-469b-8155-b0cd59affc30 req-762e56b5-5f86-48ad-ae38-226be629add9 service nova] Creating event network-changed:d045507b-53ea-4e4f-9def-029bda6114ff for instance 3380e407-b7cb-4775-b5ed-17ef51c3764a on n-h1-862967-2 Oct 29 02:49:49.305480 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-82e12298-1882-469b-8155-b0cd59affc30 req-762e56b5-5f86-48ad-ae38-226be629add9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050726 Oct 29 02:49:49.306431 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 572/1133] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:49.406272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-33e11172-ff22-4275-9554-10622b5e0241 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:49.407097 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-33e11172-ff22-4275-9554-10622b5e0241 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:49.414721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33e11172-ff22-4275-9554-10622b5e0241 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:49.416019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33e11172-ff22-4275-9554-10622b5e0241 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:49.416562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33e11172-ff22-4275-9554-10622b5e0241 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:49.417362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33e11172-ff22-4275-9554-10622b5e0241 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:49.417902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33e11172-ff22-4275-9554-10622b5e0241 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:49.418392 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33e11172-ff22-4275-9554-10622b5e0241 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:49.677067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-33e11172-ff22-4275-9554-10622b5e0241 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:49.692845 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-33e11172-ff22-4275-9554-10622b5e0241 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1477 microversion: 2.1 time: 0.304064 Oct 29 02:49:49.705262 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 573/1134] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:49 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1477 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:49.733005 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b39c1884-173e-4faa-8409-463a8a1f9d04 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:49.734914 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b39c1884-173e-4faa-8409-463a8a1f9d04 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: b65a6807-c8ad-44d0-93d7-931037ca8afd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:49.751241 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b39c1884-173e-4faa-8409-463a8a1f9d04 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:49.752409 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b39c1884-173e-4faa-8409-463a8a1f9d04 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:49.753396 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b39c1884-173e-4faa-8409-463a8a1f9d04 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:49.754951 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b39c1884-173e-4faa-8409-463a8a1f9d04 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:49.756002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b39c1884-173e-4faa-8409-463a8a1f9d04 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:49.757749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b39c1884-173e-4faa-8409-463a8a1f9d04 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:50.086930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b39c1884-173e-4faa-8409-463a8a1f9d04 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509ce04aeb3847f084629201bd7ae5d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc6da8e69e041e19023a53a23e33393', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:50.096221 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b39c1884-173e-4faa-8409-463a8a1f9d04 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/b65a6807-c8ad-44d0-93d7-931037ca8afd" status: 200 len: 1472 microversion: 2.1 time: 0.389400 Oct 29 02:49:50.102122 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 574/1135] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:49 2022] GET /compute/v2.1/servers/b65a6807-c8ad-44d0-93d7-931037ca8afd => generated 1472 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:50.107770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-69cfb3e1-4fba-4bf2-a703-c4b29934c7c4 tempest-ServersWithSpecificFlavorTestJSON-1817225689 tempest-ServersWithSpecificFlavorTestJSON-1817225689-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:50.158098 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-69cfb3e1-4fba-4bf2-a703-c4b29934c7c4 tempest-ServersWithSpecificFlavorTestJSON-1817225689 tempest-ServersWithSpecificFlavorTestJSON-1817225689-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1011831797" status: 202 len: 0 microversion: 2.1 time: 0.054410 Oct 29 02:49:50.159316 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 575/1136] 10.222.0.46 () {58 vars in 1161 bytes} [Sat Oct 29 02:49:50 2022] DELETE /compute/v2.1/flavors/1011831797 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:50.170622 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7f040576-17b0-4c54-a966-e76d843e96c7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:50.172298 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7f040576-17b0-4c54-a966-e76d843e96c7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:50.187120 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f040576-17b0-4c54-a966-e76d843e96c7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:50.187930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f040576-17b0-4c54-a966-e76d843e96c7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:50.188560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f040576-17b0-4c54-a966-e76d843e96c7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:50.189824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f040576-17b0-4c54-a966-e76d843e96c7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:50.190438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f040576-17b0-4c54-a966-e76d843e96c7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:50.191020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f040576-17b0-4c54-a966-e76d843e96c7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:50.496040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7f040576-17b0-4c54-a966-e76d843e96c7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:50.513793 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7f040576-17b0-4c54-a966-e76d843e96c7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:50.516456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7f040576-17b0-4c54-a966-e76d843e96c7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:50.518169 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7f040576-17b0-4c54-a966-e76d843e96c7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1815 microversion: 2.25 time: 0.357586 Oct 29 02:49:50.519103 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 576/1137] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:50 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1815 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:50.525543 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-77c00190-3e85-4f60-bbab-370d3a9ce659 tempest-ServersWithSpecificFlavorTestJSON-1817225689 tempest-ServersWithSpecificFlavorTestJSON-1817225689-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:50.551893 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-77c00190-3e85-4f60-bbab-370d3a9ce659 tempest-ServersWithSpecificFlavorTestJSON-1817225689 tempest-ServersWithSpecificFlavorTestJSON-1817225689-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.031266 Oct 29 02:49:50.552507 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 577/1138] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:49:50 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:50.557378 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f991ba53-42bd-427e-80f3-6be885df9a12 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:50.557997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f991ba53-42bd-427e-80f3-6be885df9a12 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:50.564282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f991ba53-42bd-427e-80f3-6be885df9a12 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:50.564870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f991ba53-42bd-427e-80f3-6be885df9a12 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:50.565317 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f991ba53-42bd-427e-80f3-6be885df9a12 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:50.566685 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f991ba53-42bd-427e-80f3-6be885df9a12 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:50.566982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f991ba53-42bd-427e-80f3-6be885df9a12 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:50.567426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f991ba53-42bd-427e-80f3-6be885df9a12 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:50.746120 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f991ba53-42bd-427e-80f3-6be885df9a12 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:50.758758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f991ba53-42bd-427e-80f3-6be885df9a12 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:50.762316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f991ba53-42bd-427e-80f3-6be885df9a12 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:50.771133 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f991ba53-42bd-427e-80f3-6be885df9a12 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1537 microversion: 2.91 time: 0.216563 Oct 29 02:49:50.773732 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 578/1139] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:50 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1537 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:50.779983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7cc6d073-29e2-4e17-9f72-73e9bcef3352 tempest-ServersWithSpecificFlavorTestJSON-1817225689 tempest-ServersWithSpecificFlavorTestJSON-1817225689-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:50.806578 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7cc6d073-29e2-4e17-9f72-73e9bcef3352 tempest-ServersWithSpecificFlavorTestJSON-1817225689 tempest-ServersWithSpecificFlavorTestJSON-1817225689-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1100006644" status: 202 len: 0 microversion: 2.1 time: 0.031345 Oct 29 02:49:50.811360 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 579/1140] 10.222.0.46 () {58 vars in 1161 bytes} [Sat Oct 29 02:49:50 2022] DELETE /compute/v2.1/flavors/1100006644 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:49:50.819828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-299e0e30-3806-4fb8-a278-4c5b89e4aa72 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "fc1b50db-9437-45f0-8c34-914a3a511412"}], "security_groups": [{"name": "tempest-securitygroup--510313716"}], "key_name": "tempest-keypair-2114399205", "user_data": "}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:50.959089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-299e0e30-3806-4fb8-a278-4c5b89e4aa72 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] validate_networks() for [('fc1b50db-9437-45f0-8c34-914a3a511412', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:49:51.645670 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-299e0e30-3806-4fb8-a278-4c5b89e4aa72 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:49:51.646225 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-299e0e30-3806-4fb8-a278-4c5b89e4aa72 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:49:51.646761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-299e0e30-3806-4fb8-a278-4c5b89e4aa72 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:49:51.647076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-299e0e30-3806-4fb8-a278-4c5b89e4aa72 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:49:51.647581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-299e0e30-3806-4fb8-a278-4c5b89e4aa72 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:49:51.657793 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-299e0e30-3806-4fb8-a278-4c5b89e4aa72 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:51.658329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-299e0e30-3806-4fb8-a278-4c5b89e4aa72 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:51.658762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-299e0e30-3806-4fb8-a278-4c5b89e4aa72 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:51.659488 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-299e0e30-3806-4fb8-a278-4c5b89e4aa72 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:51.659936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-299e0e30-3806-4fb8-a278-4c5b89e4aa72 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:51.660558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-299e0e30-3806-4fb8-a278-4c5b89e4aa72 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:51.679664 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-299e0e30-3806-4fb8-a278-4c5b89e4aa72 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Getting quotas for project 520485bb54544a3389cec22317db2d13. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:49:51.685391 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-299e0e30-3806-4fb8-a278-4c5b89e4aa72 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Getting quotas for user e2955d25314a42259483d8ccbfd7ee54 and project 520485bb54544a3389cec22317db2d13. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:49:51.700390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-299e0e30-3806-4fb8-a278-4c5b89e4aa72 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:49:51.703310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-299e0e30-3806-4fb8-a278-4c5b89e4aa72 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] [instance: de40ca11-d29b-4457-ad27-807bfb1acc65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:49:51.758540 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-299e0e30-3806-4fb8-a278-4c5b89e4aa72 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.947146 Oct 29 02:49:51.759722 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 580/1141] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:49:50 2022] POST /compute/v2.1/servers => generated 408 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:49:51.764740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8686b46d-fb68-4ebe-8fb9-69ffac2c463a tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:51.765356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8686b46d-fb68-4ebe-8fb9-69ffac2c463a tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:51.774726 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8686b46d-fb68-4ebe-8fb9-69ffac2c463a tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:51.775480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8686b46d-fb68-4ebe-8fb9-69ffac2c463a tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:51.776141 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8686b46d-fb68-4ebe-8fb9-69ffac2c463a tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:51.777275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8686b46d-fb68-4ebe-8fb9-69ffac2c463a tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:51.777968 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8686b46d-fb68-4ebe-8fb9-69ffac2c463a tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:51.778612 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8686b46d-fb68-4ebe-8fb9-69ffac2c463a tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:51.817620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:52.065701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8686b46d-fb68-4ebe-8fb9-69ffac2c463a tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:52.081245 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8686b46d-fb68-4ebe-8fb9-69ffac2c463a tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1463 microversion: 2.1 time: 0.320343 Oct 29 02:49:52.097681 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 581/1142] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:51 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1463 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:52.109892 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-9b717714-4fba-4c7b-a452-5f8df57cd9a0 req-78ab119f-189a-41dc-9aa8-260ed8108476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b65a6807-c8ad-44d0-93d7-931037ca8afd", "name": "network-vif-deleted", "tag": "bf521964-3ec5-4c49-a9de-c97ddd2ce980"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:52.130426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9b717714-4fba-4c7b-a452-5f8df57cd9a0 req-78ab119f-189a-41dc-9aa8-260ed8108476 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:52.132162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9b717714-4fba-4c7b-a452-5f8df57cd9a0 req-78ab119f-189a-41dc-9aa8-260ed8108476 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:52.133088 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9b717714-4fba-4c7b-a452-5f8df57cd9a0 req-78ab119f-189a-41dc-9aa8-260ed8108476 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:52.187475 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-9b717714-4fba-4c7b-a452-5f8df57cd9a0 req-78ab119f-189a-41dc-9aa8-260ed8108476 service nova] Creating event network-vif-deleted:bf521964-3ec5-4c49-a9de-c97ddd2ce980 for instance b65a6807-c8ad-44d0-93d7-931037ca8afd on n-h1-862967-2 Oct 29 02:49:52.204179 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-9b717714-4fba-4c7b-a452-5f8df57cd9a0 req-78ab119f-189a-41dc-9aa8-260ed8108476 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103145 Oct 29 02:49:52.207067 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 582/1143] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:52.220338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6e2c4152-fb0a-46b4-8e6d-aa1625def28d tempest-ServersWithSpecificFlavorTestJSON-1817225689 tempest-ServersWithSpecificFlavorTestJSON-1817225689-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:52.260343 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6e2c4152-fb0a-46b4-8e6d-aa1625def28d tempest-ServersWithSpecificFlavorTestJSON-1817225689 tempest-ServersWithSpecificFlavorTestJSON-1817225689-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044118 Oct 29 02:49:52.273867 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 583/1144] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:49:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:52.287385 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8480ccbb-2890-40d4-ae8b-2fd37d5fef73 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:52.287961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8480ccbb-2890-40d4-ae8b-2fd37d5fef73 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] [instance: b65a6807-c8ad-44d0-93d7-931037ca8afd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:52.296389 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=10,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:52.305709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8480ccbb-2890-40d4-ae8b-2fd37d5fef73 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:52.306213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8480ccbb-2890-40d4-ae8b-2fd37d5fef73 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:52.306654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8480ccbb-2890-40d4-ae8b-2fd37d5fef73 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:52.307375 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8480ccbb-2890-40d4-ae8b-2fd37d5fef73 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:52.307830 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8480ccbb-2890-40d4-ae8b-2fd37d5fef73 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:52.308335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8480ccbb-2890-40d4-ae8b-2fd37d5fef73 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:52.333938 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-8480ccbb-2890-40d4-ae8b-2fd37d5fef73 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] HTTP exception thrown: Instance b65a6807-c8ad-44d0-93d7-931037ca8afd could not be found. Oct 29 02:49:52.335915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8480ccbb-2890-40d4-ae8b-2fd37d5fef73 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Request method failure captured: Oct 29 02:49:52.335915 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/b65a6807-c8ad-44d0-93d7-931037ca8afd HTTP/1.1 Oct 29 02:49:52.335915 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:49:52.335915 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:49:52.335915 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:49:52.335915 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:49:52.335915 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:49:52.335915 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:49:52.335915 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:49:52.335915 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:52.335915 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPtIMVuxUQ5sESBGcpDIyg0JlWGhaenNyoF1KsslH7tI-Ide1t1Qc6YWBoCicDg4iK9BWmVgzBvHQx10NYcQWd4V883MefaFkAV2l76Vzo9g4yJTR39I57-5iCCl5el4McwVe4d-eqtN30on7NVpVe0PpaW9_bFKynEcnhRDBRUQ1A Oct 29 02:49:52.335915 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:49:52.335915 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:49:52.335915 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:49:52.335915 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:49:52.335915 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:49:52.335915 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:49:52.335915 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: dcc6da8e69e041e19023a53a23e33393 Oct 29 02:49:52.335915 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersOnMultiNodesTest-354009816 Oct 29 02:49:52.335915 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:49:52.335915 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:49:52.339113 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dcc6da8e69e041e19023a53a23e33393"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dcc6da8e69e041e19023a53a23e33393"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_dcc6da8e69e041e19023a53a23e33393"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/dcc6da8e69e041e19023a53a23e33393"}]}] Oct 29 02:49:52.339113 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersOnMultiNodesTest-354009816 Oct 29 02:49:52.339113 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: dcc6da8e69e041e19023a53a23e33393 Oct 29 02:49:52.339113 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-354009816 Oct 29 02:49:52.339113 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersOnMultiNodesTest-354009816-project Oct 29 02:49:52.339113 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:49:52.339113 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:49:52.339113 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 509ce04aeb3847f084629201bd7ae5d6 Oct 29 02:49:52.339113 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersOnMultiNodesTest-354009816-project Oct 29 02:49:52.339113 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:49:52.339113 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance b65a6807-c8ad-44d0-93d7-931037ca8afd could not be found. Oct 29 02:49:52.339113 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'b65a6807-c8ad-44d0-93d7-931037ca8afd'} Oct 29 02:49:52.340803 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:52.340803 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:52.340803 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:49:52.340803 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:49:52.340803 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:49:52.340803 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:49:52.340803 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:49:52.340803 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:49:52.340803 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:49:52.340803 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:49:52.340803 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b65a6807-c8ad-44d0-93d7-931037ca8afd could not be found. Oct 29 02:49:52.340803 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:52.340803 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:52.340803 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:52.340803 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:52.340803 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:52.340803 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:52.340803 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:52.340803 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:52.340803 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:52.343527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:52.343527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:49:52.343527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:49:52.343527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:49:52.343527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:49:52.343527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:49:52.343527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:49:52.343527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b65a6807-c8ad-44d0-93d7-931037ca8afd could not be found. Oct 29 02:49:52.343527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:52.343527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:52.343527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:52.343527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:52.343527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:52.343527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:52.343527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:52.343527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:52.343527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b65a6807-c8ad-44d0-93d7-931037ca8afd could not be found. Oct 29 02:49:52.343527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:52.346500 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8480ccbb-2890-40d4-ae8b-2fd37d5fef73 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] Returning 404 to user: Instance b65a6807-c8ad-44d0-93d7-931037ca8afd could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:52.346500 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8480ccbb-2890-40d4-ae8b-2fd37d5fef73 tempest-ServersOnMultiNodesTest-354009816 tempest-ServersOnMultiNodesTest-354009816-project] 10.222.0.46 "GET /compute/v2.1/servers/b65a6807-c8ad-44d0-93d7-931037ca8afd" status: 404 len: 111 microversion: 2.1 time: 0.062374 Oct 29 02:49:52.346500 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 584/1145] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:52 2022] GET /compute/v2.1/servers/b65a6807-c8ad-44d0-93d7-931037ca8afd => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:52.362526 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-012bfd50-da59-420e-b599-4b3dda16f465 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:52.363198 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-012bfd50-da59-420e-b599-4b3dda16f465 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:52.371995 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-012bfd50-da59-420e-b599-4b3dda16f465 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:52.372698 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-012bfd50-da59-420e-b599-4b3dda16f465 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:52.373141 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-012bfd50-da59-420e-b599-4b3dda16f465 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:52.374046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-012bfd50-da59-420e-b599-4b3dda16f465 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:52.374607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-012bfd50-da59-420e-b599-4b3dda16f465 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:52.375027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-012bfd50-da59-420e-b599-4b3dda16f465 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:52.682435 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-012bfd50-da59-420e-b599-4b3dda16f465 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:52.697001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-012bfd50-da59-420e-b599-4b3dda16f465 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:52.698594 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-012bfd50-da59-420e-b599-4b3dda16f465 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:52.700118 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-012bfd50-da59-420e-b599-4b3dda16f465 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1815 microversion: 2.25 time: 0.350919 Oct 29 02:49:52.723907 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 585/1146] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:52 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1815 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:52.749755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-338b6f0e-cd2e-44ec-b9c4-02d36d6588a1 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:52.750852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-338b6f0e-cd2e-44ec-b9c4-02d36d6588a1 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] [instance: de40ca11-d29b-4457-ad27-807bfb1acc65] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:52.771828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-338b6f0e-cd2e-44ec-b9c4-02d36d6588a1 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:52.772515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-338b6f0e-cd2e-44ec-b9c4-02d36d6588a1 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:52.773121 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-338b6f0e-cd2e-44ec-b9c4-02d36d6588a1 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:52.774003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-338b6f0e-cd2e-44ec-b9c4-02d36d6588a1 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:52.774620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-338b6f0e-cd2e-44ec-b9c4-02d36d6588a1 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:52.775191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-338b6f0e-cd2e-44ec-b9c4-02d36d6588a1 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:52.875507 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-338b6f0e-cd2e-44ec-b9c4-02d36d6588a1 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2955d25314a42259483d8ccbfd7ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520485bb54544a3389cec22317db2d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:52.894634 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-338b6f0e-cd2e-44ec-b9c4-02d36d6588a1 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] 10.222.0.46 "GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65" status: 200 len: 1222 microversion: 2.1 time: 0.167806 Oct 29 02:49:52.895925 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 586/1147] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:52 2022] GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65 => generated 1222 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:52.904861 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-395ecbf9-6990-4381-9973-34d108efbee3 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:52.908899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-395ecbf9-6990-4381-9973-34d108efbee3 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:52.915497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-395ecbf9-6990-4381-9973-34d108efbee3 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:52.915908 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-395ecbf9-6990-4381-9973-34d108efbee3 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:52.916340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-395ecbf9-6990-4381-9973-34d108efbee3 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:52.917079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-395ecbf9-6990-4381-9973-34d108efbee3 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:52.917598 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-395ecbf9-6990-4381-9973-34d108efbee3 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:52.918025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-395ecbf9-6990-4381-9973-34d108efbee3 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:53.025772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-395ecbf9-6990-4381-9973-34d108efbee3 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:53.034561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-395ecbf9-6990-4381-9973-34d108efbee3 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:53.039142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-395ecbf9-6990-4381-9973-34d108efbee3 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:53.052593 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-395ecbf9-6990-4381-9973-34d108efbee3 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1537 microversion: 2.91 time: 0.155575 Oct 29 02:49:53.053420 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 587/1148] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:52 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1537 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:53.090273 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c8a58075-8201-4dd3-a913-5c7809dd745a tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:53.091087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c8a58075-8201-4dd3-a913-5c7809dd745a tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:53.099770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c8a58075-8201-4dd3-a913-5c7809dd745a tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:53.102986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c8a58075-8201-4dd3-a913-5c7809dd745a tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:53.104332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c8a58075-8201-4dd3-a913-5c7809dd745a tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:53.107951 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c8a58075-8201-4dd3-a913-5c7809dd745a tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:53.108957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c8a58075-8201-4dd3-a913-5c7809dd745a tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:53.109547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c8a58075-8201-4dd3-a913-5c7809dd745a tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:53.211375 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.network.neutron [None req-b8a2601b-4ba5-4693-b363-0fb31b3052d6 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] re-assign floating IP 172.25.7.224 from instance 3380e407-b7cb-4775-b5ed-17ef51c3764a Oct 29 02:49:53.324135 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-b8a2601b-4ba5-4693-b363-0fb31b3052d6 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Building network info cache for instance {{(pid=127125) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 02:49:53.376444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c8a58075-8201-4dd3-a913-5c7809dd745a tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:53.386379 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c8a58075-8201-4dd3-a913-5c7809dd745a tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1463 microversion: 2.1 time: 0.310258 Oct 29 02:49:53.400570 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 588/1149] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:53 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1463 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:53.406155 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-28f553f5-96b6-41a4-bb41-e28a00d64c24 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:53.407366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-28f553f5-96b6-41a4-bb41-e28a00d64c24 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: 20602fbc-9893-433b-b711-3de8a31a4608] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:53.430872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-28f553f5-96b6-41a4-bb41-e28a00d64c24 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:53.431368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-28f553f5-96b6-41a4-bb41-e28a00d64c24 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:53.431807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-28f553f5-96b6-41a4-bb41-e28a00d64c24 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:53.432568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-28f553f5-96b6-41a4-bb41-e28a00d64c24 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:53.433509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-28f553f5-96b6-41a4-bb41-e28a00d64c24 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:53.433509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-28f553f5-96b6-41a4-bb41-e28a00d64c24 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:53.466372 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-28f553f5-96b6-41a4-bb41-e28a00d64c24 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] HTTP exception thrown: Instance 20602fbc-9893-433b-b711-3de8a31a4608 could not be found. Oct 29 02:49:53.467963 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-28f553f5-96b6-41a4-bb41-e28a00d64c24 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Request method failure captured: Oct 29 02:49:53.467963 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608 HTTP/1.1 Oct 29 02:49:53.467963 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:49:53.467963 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:49:53.467963 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:49:53.467963 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:49:53.467963 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:49:53.467963 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:49:53.467963 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:49:53.467963 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:53.467963 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJQNCipo6WIEEDkIOIcg6ss0TyPZW0MTrbur_OGoa5LUOwz4me7FXab5TGO0MpDaR1jlmUm6g2HnM0r50nFTGz1NrZm3bt-2txTdhzE4iZfa63rrdhrzmjUuji3x-W7wQc_CJFsC46XyziPFeg08y3ITGIfiy96RBNVeqC9QxB1gY3k Oct 29 02:49:53.467963 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:49:53.467963 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:49:53.467963 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:49:53.467963 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:49:53.467963 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:49:53.467963 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:49:53.467963 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 4ce4605ee60c4bbdb3ec64e735ed73a6 Oct 29 02:49:53.467963 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-823878115 Oct 29 02:49:53.467963 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:49:53.467963 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:49:53.469290 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4ce4605ee60c4bbdb3ec64e735ed73a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4ce4605ee60c4bbdb3ec64e735ed73a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4ce4605ee60c4bbdb3ec64e735ed73a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4ce4605ee60c4bbdb3ec64e735ed73a6"}]}] Oct 29 02:49:53.469290 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-823878115 Oct 29 02:49:53.469290 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 4ce4605ee60c4bbdb3ec64e735ed73a6 Oct 29 02:49:53.469290 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-823878115 Oct 29 02:49:53.469290 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersWithSpecificFlavorTestJSON-823878115-project Oct 29 02:49:53.469290 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:49:53.469290 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:49:53.469290 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 5e562fcf734e45ce92536806eaec5750 Oct 29 02:49:53.469290 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-823878115-project Oct 29 02:49:53.469290 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:49:53.469290 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 20602fbc-9893-433b-b711-3de8a31a4608 could not be found. Oct 29 02:49:53.469290 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '20602fbc-9893-433b-b711-3de8a31a4608'} Oct 29 02:49:53.470048 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:53.470048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:53.470048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:49:53.470048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:49:53.470048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:49:53.470048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:49:53.470048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:49:53.470048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:49:53.470048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:49:53.470048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:49:53.470048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20602fbc-9893-433b-b711-3de8a31a4608 could not be found. Oct 29 02:49:53.470048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:53.470048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:53.470048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:53.470048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:53.470048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:53.470048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:53.470048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:53.470048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:53.470048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:53.473199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:53.473199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:49:53.473199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:49:53.473199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:49:53.473199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:49:53.473199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:49:53.473199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:49:53.473199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:49:53.473199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:49:53.473199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20602fbc-9893-433b-b711-3de8a31a4608 could not be found. Oct 29 02:49:53.473199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:53.473199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:53.473199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:53.473199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:53.473199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:53.473199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:53.473199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:53.473199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:53.473199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20602fbc-9893-433b-b711-3de8a31a4608 could not be found. Oct 29 02:49:53.473199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:53.475941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-28f553f5-96b6-41a4-bb41-e28a00d64c24 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Returning 404 to user: Instance 20602fbc-9893-433b-b711-3de8a31a4608 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:53.475941 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-28f553f5-96b6-41a4-bb41-e28a00d64c24 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "DELETE /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608" status: 404 len: 111 microversion: 2.1 time: 0.079787 Oct 29 02:49:53.475941 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 589/1150] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:49:53 2022] DELETE /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:53.480396 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-f4cc6bc8-158d-4899-a081-90077cd09497 req-ee928082-7658-407e-b10d-87467680122e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3380e407-b7cb-4775-b5ed-17ef51c3764a", "tag": "d045507b-53ea-4e4f-9def-029bda6114ff"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:53.502364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f4cc6bc8-158d-4899-a081-90077cd09497 req-ee928082-7658-407e-b10d-87467680122e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:53.512638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f4cc6bc8-158d-4899-a081-90077cd09497 req-ee928082-7658-407e-b10d-87467680122e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:53.513314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f4cc6bc8-158d-4899-a081-90077cd09497 req-ee928082-7658-407e-b10d-87467680122e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:53.531195 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-f4cc6bc8-158d-4899-a081-90077cd09497 req-ee928082-7658-407e-b10d-87467680122e service nova] Creating event network-changed:d045507b-53ea-4e4f-9def-029bda6114ff for instance 3380e407-b7cb-4775-b5ed-17ef51c3764a on n-h1-862967-2 Oct 29 02:49:53.536643 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-f4cc6bc8-158d-4899-a081-90077cd09497 req-ee928082-7658-407e-b10d-87467680122e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059762 Oct 29 02:49:53.537931 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 590/1151] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:53.544854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-051da965-c326-43dc-930b-4104e0774d74 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:53.547963 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-051da965-c326-43dc-930b-4104e0774d74 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:53.556812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-051da965-c326-43dc-930b-4104e0774d74 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:53.557462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-051da965-c326-43dc-930b-4104e0774d74 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:53.557959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-051da965-c326-43dc-930b-4104e0774d74 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:53.559559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-051da965-c326-43dc-930b-4104e0774d74 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:53.560247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-051da965-c326-43dc-930b-4104e0774d74 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:53.560992 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-051da965-c326-43dc-930b-4104e0774d74 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:53.692474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-051da965-c326-43dc-930b-4104e0774d74 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:49:53.693521 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-051da965-c326-43dc-930b-4104e0774d74 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:49:53.696490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-051da965-c326-43dc-930b-4104e0774d74 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:49:53.697170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-051da965-c326-43dc-930b-4104e0774d74 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:49:53.697813 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-051da965-c326-43dc-930b-4104e0774d74 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:49:53.848997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-051da965-c326-43dc-930b-4104e0774d74 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:53.878986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-051da965-c326-43dc-930b-4104e0774d74 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:53.880973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-051da965-c326-43dc-930b-4104e0774d74 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:53.883146 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-051da965-c326-43dc-930b-4104e0774d74 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:53.886723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-051da965-c326-43dc-930b-4104e0774d74 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:53.887831 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-051da965-c326-43dc-930b-4104e0774d74 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:53.889028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-051da965-c326-43dc-930b-4104e0774d74 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:53.949508 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-051da965-c326-43dc-930b-4104e0774d74 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "POST /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685/action" status: 202 len: 1067 microversion: 2.1 time: 0.410159 Oct 29 02:49:53.964798 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 591/1152] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:49:53 2022] POST /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685/action => generated 1067 bytes in 426 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 29 02:49:53.970489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-09287a36-2175-40ad-a875-39b3808c5465 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:53.971246 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-09287a36-2175-40ad-a875-39b3808c5465 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: 20602fbc-9893-433b-b711-3de8a31a4608] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:53.979175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09287a36-2175-40ad-a875-39b3808c5465 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:53.980054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09287a36-2175-40ad-a875-39b3808c5465 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:53.980778 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09287a36-2175-40ad-a875-39b3808c5465 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:53.981732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09287a36-2175-40ad-a875-39b3808c5465 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:53.982418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09287a36-2175-40ad-a875-39b3808c5465 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:53.983091 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09287a36-2175-40ad-a875-39b3808c5465 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:54.021175 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-09287a36-2175-40ad-a875-39b3808c5465 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] HTTP exception thrown: Instance 20602fbc-9893-433b-b711-3de8a31a4608 could not be found. Oct 29 02:49:54.023845 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-09287a36-2175-40ad-a875-39b3808c5465 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Request method failure captured: Oct 29 02:49:54.023845 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608 HTTP/1.1 Oct 29 02:49:54.023845 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:49:54.023845 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:49:54.023845 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:49:54.023845 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:49:54.023845 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:49:54.023845 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:49:54.023845 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:49:54.023845 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:54.023845 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJQNCipo6WIEEDkIOIcg6ss0TyPZW0MTrbur_OGoa5LUOwz4me7FXab5TGO0MpDaR1jlmUm6g2HnM0r50nFTGz1NrZm3bt-2txTdhzE4iZfa63rrdhrzmjUuji3x-W7wQc_CJFsC46XyziPFeg08y3ITGIfiy96RBNVeqC9QxB1gY3k Oct 29 02:49:54.023845 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:49:54.023845 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:49:54.023845 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:49:54.023845 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:49:54.023845 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:49:54.023845 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:49:54.023845 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 4ce4605ee60c4bbdb3ec64e735ed73a6 Oct 29 02:49:54.023845 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-823878115 Oct 29 02:49:54.023845 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:49:54.023845 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:49:54.026083 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4ce4605ee60c4bbdb3ec64e735ed73a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4ce4605ee60c4bbdb3ec64e735ed73a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4ce4605ee60c4bbdb3ec64e735ed73a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4ce4605ee60c4bbdb3ec64e735ed73a6"}]}] Oct 29 02:49:54.026083 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-823878115 Oct 29 02:49:54.026083 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 4ce4605ee60c4bbdb3ec64e735ed73a6 Oct 29 02:49:54.026083 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-823878115 Oct 29 02:49:54.026083 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersWithSpecificFlavorTestJSON-823878115-project Oct 29 02:49:54.026083 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:49:54.026083 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:49:54.026083 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 5e562fcf734e45ce92536806eaec5750 Oct 29 02:49:54.026083 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-823878115-project Oct 29 02:49:54.026083 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:49:54.026083 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 20602fbc-9893-433b-b711-3de8a31a4608 could not be found. Oct 29 02:49:54.026083 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '20602fbc-9893-433b-b711-3de8a31a4608'} Oct 29 02:49:54.027036 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:54.027036 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:54.027036 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:49:54.027036 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:49:54.027036 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:49:54.027036 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:49:54.027036 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:49:54.027036 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:49:54.027036 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:49:54.027036 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:49:54.027036 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20602fbc-9893-433b-b711-3de8a31a4608 could not be found. Oct 29 02:49:54.027036 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:54.027036 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:54.027036 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:54.027036 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:54.027036 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:54.027036 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:54.027036 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:54.027036 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:54.027036 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:54.028593 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:54.028593 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:49:54.028593 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:49:54.028593 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:49:54.028593 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:49:54.028593 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:49:54.028593 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:49:54.028593 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20602fbc-9893-433b-b711-3de8a31a4608 could not be found. Oct 29 02:49:54.028593 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:54.028593 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:54.028593 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:54.028593 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:54.028593 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:54.028593 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:54.028593 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:54.028593 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:54.028593 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20602fbc-9893-433b-b711-3de8a31a4608 could not be found. Oct 29 02:49:54.028593 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:54.029887 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-09287a36-2175-40ad-a875-39b3808c5465 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Returning 404 to user: Instance 20602fbc-9893-433b-b711-3de8a31a4608 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:54.029887 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-09287a36-2175-40ad-a875-39b3808c5465 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608" status: 404 len: 111 microversion: 2.1 time: 0.060988 Oct 29 02:49:54.037418 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 592/1153] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:53 2022] GET /compute/v2.1/servers/20602fbc-9893-433b-b711-3de8a31a4608 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:54.045442 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c2ad13d2-e4a9-40fa-b221-27a18a5782ca tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:54.046083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c2ad13d2-e4a9-40fa-b221-27a18a5782ca tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:54.053677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c2ad13d2-e4a9-40fa-b221-27a18a5782ca tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:54.054761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c2ad13d2-e4a9-40fa-b221-27a18a5782ca tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:54.055463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c2ad13d2-e4a9-40fa-b221-27a18a5782ca tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:54.057411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c2ad13d2-e4a9-40fa-b221-27a18a5782ca tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:54.058407 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c2ad13d2-e4a9-40fa-b221-27a18a5782ca tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:54.059108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c2ad13d2-e4a9-40fa-b221-27a18a5782ca tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:54.350757 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-b8a2601b-4ba5-4693-b363-0fb31b3052d6 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Updating instance_info_cache with network_info: [{"id": "d045507b-53ea-4e4f-9def-029bda6114ff", "address": "fa:16:3e:6e:25:30", "network": {"id": "c9c7c955-06f7-476b-b584-0d9678a745fd", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-713225838-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fd611070fee0435f8bdda9c3ba5d62fc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd045507b-53", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127125) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 02:49:54.367186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-b8a2601b-4ba5-4693-b363-0fb31b3052d6 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] Building network info cache for instance {{(pid=127125) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 02:49:54.446326 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c2ad13d2-e4a9-40fa-b221-27a18a5782ca tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:54.455966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c2ad13d2-e4a9-40fa-b221-27a18a5782ca tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:54.462006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c2ad13d2-e4a9-40fa-b221-27a18a5782ca tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:54.464616 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c2ad13d2-e4a9-40fa-b221-27a18a5782ca tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1815 microversion: 2.25 time: 0.425806 Oct 29 02:49:54.485037 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 593/1154] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:54 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1815 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:54.490833 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-98344323-3494-4cd1-b8b3-3307f1535a8a tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:54.491720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-98344323-3494-4cd1-b8b3-3307f1535a8a tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] [instance: de40ca11-d29b-4457-ad27-807bfb1acc65] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:54.498863 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-98344323-3494-4cd1-b8b3-3307f1535a8a tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:54.499638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-98344323-3494-4cd1-b8b3-3307f1535a8a tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:54.500232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-98344323-3494-4cd1-b8b3-3307f1535a8a tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:54.501169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-98344323-3494-4cd1-b8b3-3307f1535a8a tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:54.501774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-98344323-3494-4cd1-b8b3-3307f1535a8a tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:54.502367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-98344323-3494-4cd1-b8b3-3307f1535a8a tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:54.638558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-98344323-3494-4cd1-b8b3-3307f1535a8a tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2955d25314a42259483d8ccbfd7ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520485bb54544a3389cec22317db2d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:54.652088 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-98344323-3494-4cd1-b8b3-3307f1535a8a tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] 10.222.0.46 "GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65" status: 200 len: 1284 microversion: 2.1 time: 0.165493 Oct 29 02:49:54.655575 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 594/1155] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:54 2022] GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65 => generated 1284 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:54.668893 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d1edb9dd-7170-4654-97dc-e1b26da17a40 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:54.669523 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d1edb9dd-7170-4654-97dc-e1b26da17a40 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:54.687382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1edb9dd-7170-4654-97dc-e1b26da17a40 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:54.688206 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1edb9dd-7170-4654-97dc-e1b26da17a40 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:54.690455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1edb9dd-7170-4654-97dc-e1b26da17a40 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:54.691356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1edb9dd-7170-4654-97dc-e1b26da17a40 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:54.693043 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1edb9dd-7170-4654-97dc-e1b26da17a40 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:54.695950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1edb9dd-7170-4654-97dc-e1b26da17a40 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:55.046207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d1edb9dd-7170-4654-97dc-e1b26da17a40 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:55.055387 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d1edb9dd-7170-4654-97dc-e1b26da17a40 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1472 microversion: 2.1 time: 0.398470 Oct 29 02:49:55.061607 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 595/1156] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:54 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1472 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:55.084017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-54934d84-0eb2-4161-8250-1ba51faa008f tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:55.085393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-54934d84-0eb2-4161-8250-1ba51faa008f tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: aff333bb-fff4-4b3e-a3f9-a567b7786a62] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:55.094877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-54934d84-0eb2-4161-8250-1ba51faa008f tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:55.095585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-54934d84-0eb2-4161-8250-1ba51faa008f tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:55.096375 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-54934d84-0eb2-4161-8250-1ba51faa008f tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:55.097356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-54934d84-0eb2-4161-8250-1ba51faa008f tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:55.097956 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-54934d84-0eb2-4161-8250-1ba51faa008f tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:55.099313 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-54934d84-0eb2-4161-8250-1ba51faa008f tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:55.125421 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-54934d84-0eb2-4161-8250-1ba51faa008f tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] HTTP exception thrown: Instance aff333bb-fff4-4b3e-a3f9-a567b7786a62 could not be found. Oct 29 02:49:55.127925 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-54934d84-0eb2-4161-8250-1ba51faa008f tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Request method failure captured: Oct 29 02:49:55.127925 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62 HTTP/1.1 Oct 29 02:49:55.127925 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:49:55.127925 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:49:55.127925 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:49:55.127925 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:49:55.127925 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:49:55.127925 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:49:55.127925 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:49:55.127925 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:55.127925 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJQNCipo6WIEEDkIOIcg6ss0TyPZW0MTrbur_OGoa5LUOwz4me7FXab5TGO0MpDaR1jlmUm6g2HnM0r50nFTGz1NrZm3bt-2txTdhzE4iZfa63rrdhrzmjUuji3x-W7wQc_CJFsC46XyziPFeg08y3ITGIfiy96RBNVeqC9QxB1gY3k Oct 29 02:49:55.127925 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:49:55.127925 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:49:55.127925 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:49:55.127925 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:49:55.127925 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:49:55.127925 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:49:55.127925 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 4ce4605ee60c4bbdb3ec64e735ed73a6 Oct 29 02:49:55.127925 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-823878115 Oct 29 02:49:55.127925 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:49:55.127925 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:49:55.129677 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4ce4605ee60c4bbdb3ec64e735ed73a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4ce4605ee60c4bbdb3ec64e735ed73a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4ce4605ee60c4bbdb3ec64e735ed73a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4ce4605ee60c4bbdb3ec64e735ed73a6"}]}] Oct 29 02:49:55.129677 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-823878115 Oct 29 02:49:55.129677 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 4ce4605ee60c4bbdb3ec64e735ed73a6 Oct 29 02:49:55.129677 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-823878115 Oct 29 02:49:55.129677 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersWithSpecificFlavorTestJSON-823878115-project Oct 29 02:49:55.129677 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:49:55.129677 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:49:55.129677 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 5e562fcf734e45ce92536806eaec5750 Oct 29 02:49:55.129677 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-823878115-project Oct 29 02:49:55.129677 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:49:55.129677 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance aff333bb-fff4-4b3e-a3f9-a567b7786a62 could not be found. Oct 29 02:49:55.129677 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'aff333bb-fff4-4b3e-a3f9-a567b7786a62'} Oct 29 02:49:55.130683 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:55.130683 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:55.130683 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:49:55.130683 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:49:55.130683 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:49:55.130683 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:49:55.130683 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:49:55.130683 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:49:55.130683 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:49:55.130683 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:49:55.130683 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aff333bb-fff4-4b3e-a3f9-a567b7786a62 could not be found. Oct 29 02:49:55.130683 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:55.130683 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:55.130683 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:55.130683 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:55.130683 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:55.130683 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:55.130683 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:55.130683 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:55.130683 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:55.132260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:55.132260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:49:55.132260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:49:55.132260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:49:55.132260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:49:55.132260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:49:55.132260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:49:55.132260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:49:55.132260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:49:55.132260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aff333bb-fff4-4b3e-a3f9-a567b7786a62 could not be found. Oct 29 02:49:55.132260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:55.132260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:55.132260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:55.132260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:55.132260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:55.132260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:55.132260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:55.132260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:55.132260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aff333bb-fff4-4b3e-a3f9-a567b7786a62 could not be found. Oct 29 02:49:55.132260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:55.135615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-54934d84-0eb2-4161-8250-1ba51faa008f tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Returning 404 to user: Instance aff333bb-fff4-4b3e-a3f9-a567b7786a62 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:55.137084 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-54934d84-0eb2-4161-8250-1ba51faa008f tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "DELETE /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62" status: 404 len: 111 microversion: 2.1 time: 0.074079 Oct 29 02:49:55.138180 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 596/1157] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:49:55 2022] DELETE /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:55.144018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-36fb6a57-84a1-4ee7-a68a-4b89455d51ef tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:55.146858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-36fb6a57-84a1-4ee7-a68a-4b89455d51ef tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:55.156031 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36fb6a57-84a1-4ee7-a68a-4b89455d51ef tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:55.156995 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36fb6a57-84a1-4ee7-a68a-4b89455d51ef tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:55.157650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36fb6a57-84a1-4ee7-a68a-4b89455d51ef tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:55.158613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36fb6a57-84a1-4ee7-a68a-4b89455d51ef tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:55.159236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36fb6a57-84a1-4ee7-a68a-4b89455d51ef tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:55.159901 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36fb6a57-84a1-4ee7-a68a-4b89455d51ef tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:55.330673 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-36fb6a57-84a1-4ee7-a68a-4b89455d51ef tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:55.345347 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-36fb6a57-84a1-4ee7-a68a-4b89455d51ef tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:55.358272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-36fb6a57-84a1-4ee7-a68a-4b89455d51ef tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:55.377223 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-36fb6a57-84a1-4ee7-a68a-4b89455d51ef tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1537 microversion: 2.91 time: 0.237713 Oct 29 02:49:55.389973 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 597/1158] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:55 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1537 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:55.408674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-670a601e-479d-4cbd-bc9e-9051237db4b4 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:55.412760 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-670a601e-479d-4cbd-bc9e-9051237db4b4 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] [instance: aff333bb-fff4-4b3e-a3f9-a567b7786a62] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:55.459896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-670a601e-479d-4cbd-bc9e-9051237db4b4 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:55.466931 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-670a601e-479d-4cbd-bc9e-9051237db4b4 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:55.472117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-670a601e-479d-4cbd-bc9e-9051237db4b4 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:55.478141 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-670a601e-479d-4cbd-bc9e-9051237db4b4 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:55.481617 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-670a601e-479d-4cbd-bc9e-9051237db4b4 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:55.485008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-670a601e-479d-4cbd-bc9e-9051237db4b4 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:55.534758 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-670a601e-479d-4cbd-bc9e-9051237db4b4 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] HTTP exception thrown: Instance aff333bb-fff4-4b3e-a3f9-a567b7786a62 could not be found. Oct 29 02:49:55.537314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-670a601e-479d-4cbd-bc9e-9051237db4b4 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Request method failure captured: Oct 29 02:49:55.537314 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62 HTTP/1.1 Oct 29 02:49:55.537314 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:49:55.537314 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:49:55.537314 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:49:55.537314 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:49:55.537314 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:49:55.537314 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:49:55.537314 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:49:55.537314 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:55.537314 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJQNCipo6WIEEDkIOIcg6ss0TyPZW0MTrbur_OGoa5LUOwz4me7FXab5TGO0MpDaR1jlmUm6g2HnM0r50nFTGz1NrZm3bt-2txTdhzE4iZfa63rrdhrzmjUuji3x-W7wQc_CJFsC46XyziPFeg08y3ITGIfiy96RBNVeqC9QxB1gY3k Oct 29 02:49:55.537314 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:49:55.537314 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:49:55.537314 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:49:55.537314 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:49:55.537314 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:49:55.537314 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:49:55.537314 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 4ce4605ee60c4bbdb3ec64e735ed73a6 Oct 29 02:49:55.537314 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-823878115 Oct 29 02:49:55.537314 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:49:55.537314 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:49:55.539096 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4ce4605ee60c4bbdb3ec64e735ed73a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4ce4605ee60c4bbdb3ec64e735ed73a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4ce4605ee60c4bbdb3ec64e735ed73a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4ce4605ee60c4bbdb3ec64e735ed73a6"}]}] Oct 29 02:49:55.539096 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-823878115 Oct 29 02:49:55.539096 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 4ce4605ee60c4bbdb3ec64e735ed73a6 Oct 29 02:49:55.539096 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-823878115 Oct 29 02:49:55.539096 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersWithSpecificFlavorTestJSON-823878115-project Oct 29 02:49:55.539096 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:49:55.539096 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:49:55.539096 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 5e562fcf734e45ce92536806eaec5750 Oct 29 02:49:55.539096 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-823878115-project Oct 29 02:49:55.539096 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:49:55.539096 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance aff333bb-fff4-4b3e-a3f9-a567b7786a62 could not be found. Oct 29 02:49:55.539096 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'aff333bb-fff4-4b3e-a3f9-a567b7786a62'} Oct 29 02:49:55.539820 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:55.539820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:55.539820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:49:55.539820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:49:55.539820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:49:55.539820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:49:55.539820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:49:55.539820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:49:55.539820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:49:55.539820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:49:55.539820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aff333bb-fff4-4b3e-a3f9-a567b7786a62 could not be found. Oct 29 02:49:55.539820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:55.539820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:55.539820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:55.539820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:55.539820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:55.539820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:55.539820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:55.539820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:55.539820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:55.541139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:55.541139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:49:55.541139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:49:55.541139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:49:55.541139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:49:55.541139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:49:55.541139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:49:55.541139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aff333bb-fff4-4b3e-a3f9-a567b7786a62 could not be found. Oct 29 02:49:55.541139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:55.541139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:55.541139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:55.541139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:55.541139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:55.541139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:55.541139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:55.541139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:55.541139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aff333bb-fff4-4b3e-a3f9-a567b7786a62 could not be found. Oct 29 02:49:55.541139 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:55.545395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-670a601e-479d-4cbd-bc9e-9051237db4b4 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] Returning 404 to user: Instance aff333bb-fff4-4b3e-a3f9-a567b7786a62 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:55.547032 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-670a601e-479d-4cbd-bc9e-9051237db4b4 tempest-ServersWithSpecificFlavorTestJSON-823878115 tempest-ServersWithSpecificFlavorTestJSON-823878115-project] 10.222.0.46 "GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62" status: 404 len: 111 microversion: 2.1 time: 0.152883 Oct 29 02:49:55.548015 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 598/1159] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:55 2022] GET /compute/v2.1/servers/aff333bb-fff4-4b3e-a3f9-a567b7786a62 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:55.556031 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c491aae5-c5e5-4c93-bbc0-39096ab6370d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:55.557181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c491aae5-c5e5-4c93-bbc0-39096ab6370d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:55.564718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c491aae5-c5e5-4c93-bbc0-39096ab6370d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:55.565957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c491aae5-c5e5-4c93-bbc0-39096ab6370d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:55.566643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c491aae5-c5e5-4c93-bbc0-39096ab6370d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:55.567639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c491aae5-c5e5-4c93-bbc0-39096ab6370d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:55.568315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c491aae5-c5e5-4c93-bbc0-39096ab6370d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:55.569201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c491aae5-c5e5-4c93-bbc0-39096ab6370d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:55.781692 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c491aae5-c5e5-4c93-bbc0-39096ab6370d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:55.800215 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c491aae5-c5e5-4c93-bbc0-39096ab6370d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:55.801951 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c491aae5-c5e5-4c93-bbc0-39096ab6370d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:55.803089 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c491aae5-c5e5-4c93-bbc0-39096ab6370d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1815 microversion: 2.25 time: 0.253274 Oct 29 02:49:55.803688 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 599/1160] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:55 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1815 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:55.810298 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-8b045823-25aa-4b20-ab26-9a99e0c2718d req-4339bfec-8584-4362-90c5-0131e59fad1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "095efcbf-4088-49c1-9cb8-7d6b3f27af88", "tag": "185ed48c-c067-469d-825c-1ba39e43a77e"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:55.836747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8b045823-25aa-4b20-ab26-9a99e0c2718d req-4339bfec-8584-4362-90c5-0131e59fad1a service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:55.837776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8b045823-25aa-4b20-ab26-9a99e0c2718d req-4339bfec-8584-4362-90c5-0131e59fad1a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:55.838400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8b045823-25aa-4b20-ab26-9a99e0c2718d req-4339bfec-8584-4362-90c5-0131e59fad1a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:55.864453 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-8b045823-25aa-4b20-ab26-9a99e0c2718d req-4339bfec-8584-4362-90c5-0131e59fad1a service nova] Creating event network-changed:185ed48c-c067-469d-825c-1ba39e43a77e for instance 095efcbf-4088-49c1-9cb8-7d6b3f27af88 on n-h2-862967-2 Oct 29 02:49:55.878877 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-8b045823-25aa-4b20-ab26-9a99e0c2718d req-4339bfec-8584-4362-90c5-0131e59fad1a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073663 Oct 29 02:49:55.880034 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 600/1161] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:55.888593 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5e896eed-89ad-4af7-b599-b7a74ca13738 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:55.891782 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5e896eed-89ad-4af7-b599-b7a74ca13738 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] [instance: de40ca11-d29b-4457-ad27-807bfb1acc65] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:55.904855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e896eed-89ad-4af7-b599-b7a74ca13738 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:55.905660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e896eed-89ad-4af7-b599-b7a74ca13738 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:55.908139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e896eed-89ad-4af7-b599-b7a74ca13738 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:55.909151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e896eed-89ad-4af7-b599-b7a74ca13738 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:55.912179 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e896eed-89ad-4af7-b599-b7a74ca13738 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:55.912663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e896eed-89ad-4af7-b599-b7a74ca13738 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:56.038913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5e896eed-89ad-4af7-b599-b7a74ca13738 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2955d25314a42259483d8ccbfd7ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520485bb54544a3389cec22317db2d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:56.050045 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5e896eed-89ad-4af7-b599-b7a74ca13738 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] 10.222.0.46 "GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65" status: 200 len: 1284 microversion: 2.1 time: 0.168527 Oct 29 02:49:56.051003 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 601/1162] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:55 2022] GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65 => generated 1284 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:56.087630 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-57b8c4d8-3066-460f-8d02-a59ce1472207 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:56.088686 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-57b8c4d8-3066-460f-8d02-a59ce1472207 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:56.101274 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-57b8c4d8-3066-460f-8d02-a59ce1472207 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:56.102109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-57b8c4d8-3066-460f-8d02-a59ce1472207 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:56.104163 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-57b8c4d8-3066-460f-8d02-a59ce1472207 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:56.105365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-57b8c4d8-3066-460f-8d02-a59ce1472207 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:56.107770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-57b8c4d8-3066-460f-8d02-a59ce1472207 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:56.109767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-57b8c4d8-3066-460f-8d02-a59ce1472207 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:56.162496 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:56.398819 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-b8a2601b-4ba5-4693-b363-0fb31b3052d6 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] Updating instance_info_cache with network_info: [{"id": "185ed48c-c067-469d-825c-1ba39e43a77e", "address": "fa:16:3e:2e:fb:f3", "network": {"id": "c9c7c955-06f7-476b-b584-0d9678a745fd", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-713225838-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fd611070fee0435f8bdda9c3ba5d62fc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap185ed48c-c0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127125) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 02:49:56.435212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8a2601b-4ba5-4693-b363-0fb31b3052d6 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Releasing lock "refresh_cache-095efcbf-4088-49c1-9cb8-7d6b3f27af88" {{(pid=127125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 02:49:56.436372 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b8a2601b-4ba5-4693-b363-0fb31b3052d6 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "POST /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88/action" status: 202 len: 0 microversion: 2.1 time: 9.354026 Oct 29 02:49:56.438466 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 562/1163] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:49:47 2022] POST /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88/action => generated 0 bytes in 9357 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 02:49:56.458242 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-47924f31-b5cc-4c27-980e-d73d068bb52d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:56.458955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-47924f31-b5cc-4c27-980e-d73d068bb52d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:56.475044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47924f31-b5cc-4c27-980e-d73d068bb52d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:56.475552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47924f31-b5cc-4c27-980e-d73d068bb52d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:56.479585 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47924f31-b5cc-4c27-980e-d73d068bb52d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:56.480372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47924f31-b5cc-4c27-980e-d73d068bb52d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:56.480885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47924f31-b5cc-4c27-980e-d73d068bb52d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:56.481321 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47924f31-b5cc-4c27-980e-d73d068bb52d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:56.666808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-57b8c4d8-3066-460f-8d02-a59ce1472207 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:56.702285 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-57b8c4d8-3066-460f-8d02-a59ce1472207 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1472 microversion: 2.1 time: 0.618694 Oct 29 02:49:56.708251 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 602/1164] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:56 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1472 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:56.750651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bfa701f5-a785-4fcd-a504-429addd50386 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Action: 'action', calling method: .version_select at 0x7ff059b6dc10>, body: {"removeFloatingIp": {"address": "172.25.7.224"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:57.191522 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-47924f31-b5cc-4c27-980e-d73d068bb52d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:57.235540 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-47924f31-b5cc-4c27-980e-d73d068bb52d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:57.246478 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-47924f31-b5cc-4c27-980e-d73d068bb52d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:57.263736 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-47924f31-b5cc-4c27-980e-d73d068bb52d tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1537 microversion: 2.91 time: 0.822783 Oct 29 02:49:57.266614 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 563/1165] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:56 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1537 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:57.275943 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-088049be-a0b4-4a33-8d39-f0a5497aa3cf tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:57.276905 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-088049be-a0b4-4a33-8d39-f0a5497aa3cf tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:57.294709 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-088049be-a0b4-4a33-8d39-f0a5497aa3cf tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:57.298806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-088049be-a0b4-4a33-8d39-f0a5497aa3cf tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:57.299476 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-088049be-a0b4-4a33-8d39-f0a5497aa3cf tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:57.301515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-088049be-a0b4-4a33-8d39-f0a5497aa3cf tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:57.302241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-088049be-a0b4-4a33-8d39-f0a5497aa3cf tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:57.303039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-088049be-a0b4-4a33-8d39-f0a5497aa3cf tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:57.456941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bfa701f5-a785-4fcd-a504-429addd50386 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:57.467379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bfa701f5-a785-4fcd-a504-429addd50386 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:57.475902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bfa701f5-a785-4fcd-a504-429addd50386 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:57.476463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bfa701f5-a785-4fcd-a504-429addd50386 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:57.477572 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bfa701f5-a785-4fcd-a504-429addd50386 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:57.478595 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bfa701f5-a785-4fcd-a504-429addd50386 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:57.479034 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bfa701f5-a785-4fcd-a504-429addd50386 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:57.815854 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-088049be-a0b4-4a33-8d39-f0a5497aa3cf tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:57.832232 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-088049be-a0b4-4a33-8d39-f0a5497aa3cf tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:57.837086 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-088049be-a0b4-4a33-8d39-f0a5497aa3cf tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:57.840489 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-088049be-a0b4-4a33-8d39-f0a5497aa3cf tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1815 microversion: 2.25 time: 0.572373 Oct 29 02:49:57.842117 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 564/1166] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:57 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1815 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:57.848909 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-42de131a-5d0d-41c4-a6b3-8cf40a1029b1 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:57.849706 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-42de131a-5d0d-41c4-a6b3-8cf40a1029b1 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] [instance: de40ca11-d29b-4457-ad27-807bfb1acc65] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:57.858341 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-42de131a-5d0d-41c4-a6b3-8cf40a1029b1 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:57.859618 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-42de131a-5d0d-41c4-a6b3-8cf40a1029b1 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:57.859769 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-42de131a-5d0d-41c4-a6b3-8cf40a1029b1 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:57.860664 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-42de131a-5d0d-41c4-a6b3-8cf40a1029b1 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:57.862598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-42de131a-5d0d-41c4-a6b3-8cf40a1029b1 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:57.863547 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-42de131a-5d0d-41c4-a6b3-8cf40a1029b1 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:57.907458 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-bfa701f5-a785-4fcd-a504-429addd50386 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] HTTP exception thrown: Floating IP 172.25.7.224 is not associated with instance 3380e407-b7cb-4775-b5ed-17ef51c3764a. Oct 29 02:49:57.916488 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bfa701f5-a785-4fcd-a504-429addd50386 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Request method failure captured: Oct 29 02:49:57.916488 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a/action HTTP/1.1 Oct 29 02:49:57.916488 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:49:57.916488 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:49:57.916488 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:49:57.916488 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 49 Oct 29 02:49:57.916488 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:49:57.916488 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:49:57.916488 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:49:57.916488 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:49:57.916488 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJSGLrxUA0l_U9RD0bxMcuRANQY2pcWkvaC3uKgKmf86ETjckHfL5zo6rqaOSK0vvpP1bIvw2PthIlVQ6Lf0l421arEtGZ1z-vV2jnaC7TT-ZnIV0qdU_cC1sK7PCIpH-JLsNZM6IBzY35ix_U8GYfp5_0ZV_NgvzYsYrfG8EdiLpvE Oct 29 02:49:57.916488 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:49:57.916488 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:49:57.916488 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:49:57.916488 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:49:57.916488 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:49:57.916488 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:49:57.916488 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: fd611070fee0435f8bdda9c3ba5d62fc Oct 29 02:49:57.916488 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1732592755 Oct 29 02:49:57.916488 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:49:57.916488 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:49:57.918124 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fd611070fee0435f8bdda9c3ba5d62fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fd611070fee0435f8bdda9c3ba5d62fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fd611070fee0435f8bdda9c3ba5d62fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fd611070fee0435f8bdda9c3ba5d62fc"}]}] Oct 29 02:49:57.918124 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1732592755 Oct 29 02:49:57.918124 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: fd611070fee0435f8bdda9c3ba5d62fc Oct 29 02:49:57.918124 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1732592755 Oct 29 02:49:57.918124 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-FloatingIPsAssociationTestJSON-1732592755-project Oct 29 02:49:57.918124 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:49:57.918124 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:49:57.918124 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 15a2e59fd0b244eea041651e4d79de9b Oct 29 02:49:57.918124 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1732592755-project Oct 29 02:49:57.918124 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:49:57.918124 n-d-862967-2 devstack@n-api.service[127124]: {"removeFloatingIp": {"address": "172.25.7.224"}} Oct 29 02:49:57.918124 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:49:57.918124 n-d-862967-2 devstack@n-api.service[127124]: exception: Floating IP 172.25.7.224 is not associated with instance 3380e407-b7cb-4775-b5ed-17ef51c3764a. Oct 29 02:49:57.919283 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '3380e407-b7cb-4775-b5ed-17ef51c3764a', 'body': {'removeFloatingIp': {'address': '172.25.7.224'}}} Oct 29 02:49:57.919283 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:49:57.919283 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:57.919283 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:57.919283 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:57.919283 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:49:57.919283 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:49:57.919283 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:49:57.919283 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:49:57.919283 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:49:57.919283 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:49:57.919283 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:49:57.919283 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:49:57.919283 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 29 02:49:57.919283 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 02:49:57.919283 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.7.224 is not associated with instance 3380e407-b7cb-4775-b5ed-17ef51c3764a. Oct 29 02:49:57.919283 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:57.919283 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:49:57.919283 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:57.919283 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:49:57.921547 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:49:57.921547 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:49:57.921547 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:49:57.921547 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:49:57.921547 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.7.224 is not associated with instance 3380e407-b7cb-4775-b5ed-17ef51c3764a. Oct 29 02:49:57.921547 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:49:57.921547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bfa701f5-a785-4fcd-a504-429addd50386 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Returning 409 to user: Floating IP 172.25.7.224 is not associated with instance 3380e407-b7cb-4775-b5ed-17ef51c3764a. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:49:57.921547 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bfa701f5-a785-4fcd-a504-429addd50386 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "POST /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a/action" status: 409 len: 146 microversion: 2.1 time: 1.206514 Oct 29 02:49:57.921547 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 603/1167] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:49:56 2022] POST /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a/action => generated 146 bytes in 1208 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:49:57.929939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6a3a87a2-e615-4357-84e8-b8b6a2587d58 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:57.930984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6a3a87a2-e615-4357-84e8-b8b6a2587d58 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:57.941046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a3a87a2-e615-4357-84e8-b8b6a2587d58 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:57.941918 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a3a87a2-e615-4357-84e8-b8b6a2587d58 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:57.942620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a3a87a2-e615-4357-84e8-b8b6a2587d58 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:57.943633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a3a87a2-e615-4357-84e8-b8b6a2587d58 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:57.944399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a3a87a2-e615-4357-84e8-b8b6a2587d58 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:57.945075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a3a87a2-e615-4357-84e8-b8b6a2587d58 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:58.247863 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6a3a87a2-e615-4357-84e8-b8b6a2587d58 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:58.270162 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6a3a87a2-e615-4357-84e8-b8b6a2587d58 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1472 microversion: 2.1 time: 0.348839 Oct 29 02:49:58.288656 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 604/1168] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:57 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1472 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:58.303033 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b7a7d23c-614a-4e79-8c6a-5b76ff1af238 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.224"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:58.489662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-42de131a-5d0d-41c4-a6b3-8cf40a1029b1 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2955d25314a42259483d8ccbfd7ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520485bb54544a3389cec22317db2d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:58.514064 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-42de131a-5d0d-41c4-a6b3-8cf40a1029b1 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] 10.222.0.46 "GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65" status: 200 len: 1351 microversion: 2.1 time: 0.669233 Oct 29 02:49:58.517052 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 565/1169] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:57 2022] GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65 => generated 1351 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:49:58.539799 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1e62c8f9-06db-4db2-8cfd-ea1d322b5417 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:58.540753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1e62c8f9-06db-4db2-8cfd-ea1d322b5417 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:58.544686 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b7a7d23c-614a-4e79-8c6a-5b76ff1af238 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:58.549515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e62c8f9-06db-4db2-8cfd-ea1d322b5417 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:58.550437 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e62c8f9-06db-4db2-8cfd-ea1d322b5417 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:58.551071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e62c8f9-06db-4db2-8cfd-ea1d322b5417 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:58.552063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e62c8f9-06db-4db2-8cfd-ea1d322b5417 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:58.552189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7a7d23c-614a-4e79-8c6a-5b76ff1af238 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:58.552764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7a7d23c-614a-4e79-8c6a-5b76ff1af238 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:58.553118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e62c8f9-06db-4db2-8cfd-ea1d322b5417 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:58.553380 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7a7d23c-614a-4e79-8c6a-5b76ff1af238 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:58.553885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e62c8f9-06db-4db2-8cfd-ea1d322b5417 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:58.555031 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7a7d23c-614a-4e79-8c6a-5b76ff1af238 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:58.558140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7a7d23c-614a-4e79-8c6a-5b76ff1af238 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:58.559061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7a7d23c-614a-4e79-8c6a-5b76ff1af238 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:58.744467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1e62c8f9-06db-4db2-8cfd-ea1d322b5417 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:58.755712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1e62c8f9-06db-4db2-8cfd-ea1d322b5417 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:58.757704 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1e62c8f9-06db-4db2-8cfd-ea1d322b5417 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:58.766772 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1e62c8f9-06db-4db2-8cfd-ea1d322b5417 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1537 microversion: 2.91 time: 0.247851 Oct 29 02:49:58.780560 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 566/1170] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:58 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1537 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:58.780560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-84cfa872-ba4f-4f2d-8e55-843b1bfee7bc req-381c7e8b-641c-4831-a8c0-e42d1dfd89a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de40ca11-d29b-4457-ad27-807bfb1acc65", "tag": "fab97166-f957-42ca-8a7d-d580455a03ba"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:49:58.793743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:58.814342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-84cfa872-ba4f-4f2d-8e55-843b1bfee7bc req-381c7e8b-641c-4831-a8c0-e42d1dfd89a8 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:58.816067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-84cfa872-ba4f-4f2d-8e55-843b1bfee7bc req-381c7e8b-641c-4831-a8c0-e42d1dfd89a8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:58.817544 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-84cfa872-ba4f-4f2d-8e55-843b1bfee7bc req-381c7e8b-641c-4831-a8c0-e42d1dfd89a8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:58.838033 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-84cfa872-ba4f-4f2d-8e55-843b1bfee7bc req-381c7e8b-641c-4831-a8c0-e42d1dfd89a8 service nova] Creating event network-changed:fab97166-f957-42ca-8a7d-d580455a03ba for instance de40ca11-d29b-4457-ad27-807bfb1acc65 on n-h1-862967-2 Oct 29 02:49:58.845964 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-84cfa872-ba4f-4f2d-8e55-843b1bfee7bc req-381c7e8b-641c-4831-a8c0-e42d1dfd89a8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075882 Oct 29 02:49:58.848586 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 567/1171] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:49:58.901508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f699b7fc-4af1-4151-8172-d0467b9b125a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:58.902569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f699b7fc-4af1-4151-8172-d0467b9b125a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:58.921559 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f699b7fc-4af1-4151-8172-d0467b9b125a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:58.922057 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f699b7fc-4af1-4151-8172-d0467b9b125a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:58.922497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f699b7fc-4af1-4151-8172-d0467b9b125a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:58.923218 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f699b7fc-4af1-4151-8172-d0467b9b125a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:58.923899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f699b7fc-4af1-4151-8172-d0467b9b125a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:58.924338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f699b7fc-4af1-4151-8172-d0467b9b125a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:58.974546 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7a7d23c-614a-4e79-8c6a-5b76ff1af238 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "refresh_cache-095efcbf-4088-49c1-9cb8-7d6b3f27af88" {{(pid=127124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 02:49:58.975317 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7a7d23c-614a-4e79-8c6a-5b76ff1af238 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquired lock "refresh_cache-095efcbf-4088-49c1-9cb8-7d6b3f27af88" {{(pid=127124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 02:49:59.427281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f699b7fc-4af1-4151-8172-d0467b9b125a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:59.445370 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f699b7fc-4af1-4151-8172-d0467b9b125a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:59.447170 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f699b7fc-4af1-4151-8172-d0467b9b125a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:49:59.448760 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f699b7fc-4af1-4151-8172-d0467b9b125a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1815 microversion: 2.25 time: 0.561319 Oct 29 02:49:59.449972 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 568/1172] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:49:58 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1815 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:49:59.455991 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e502a084-020c-489e-9b7d-ce3069dcc12a tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:49:59.457006 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e502a084-020c-489e-9b7d-ce3069dcc12a tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:49:59.466149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e502a084-020c-489e-9b7d-ce3069dcc12a tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:59.466733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e502a084-020c-489e-9b7d-ce3069dcc12a tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:59.467377 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e502a084-020c-489e-9b7d-ce3069dcc12a tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:59.468167 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e502a084-020c-489e-9b7d-ce3069dcc12a tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:49:59.468726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e502a084-020c-489e-9b7d-ce3069dcc12a tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:49:59.469280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e502a084-020c-489e-9b7d-ce3069dcc12a tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:49:59.991079 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e502a084-020c-489e-9b7d-ce3069dcc12a tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:00.018660 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e502a084-020c-489e-9b7d-ce3069dcc12a tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1472 microversion: 2.1 time: 0.567186 Oct 29 02:50:00.039924 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 569/1173] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:49:59 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1472 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:00.053362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3995d5e1-4af8-430c-870f-68602002e103 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:00.066640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3995d5e1-4af8-430c-870f-68602002e103 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] [instance: de40ca11-d29b-4457-ad27-807bfb1acc65] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:00.082835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3995d5e1-4af8-430c-870f-68602002e103 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:00.083343 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3995d5e1-4af8-430c-870f-68602002e103 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:00.083828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3995d5e1-4af8-430c-870f-68602002e103 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:00.084619 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3995d5e1-4af8-430c-870f-68602002e103 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:00.085147 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3995d5e1-4af8-430c-870f-68602002e103 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:00.085541 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3995d5e1-4af8-430c-870f-68602002e103 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:00.236393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-b7a7d23c-614a-4e79-8c6a-5b76ff1af238 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] Building network info cache for instance {{(pid=127124) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 02:50:00.487064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3995d5e1-4af8-430c-870f-68602002e103 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2955d25314a42259483d8ccbfd7ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520485bb54544a3389cec22317db2d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:00.504316 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3995d5e1-4af8-430c-870f-68602002e103 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] 10.222.0.46 "GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65" status: 200 len: 1351 microversion: 2.1 time: 0.461418 Oct 29 02:50:00.505103 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 570/1174] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:00 2022] GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65 => generated 1351 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:00.510398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8f1be62e-4328-480b-8339-dbd96c820565 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:00.516697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8f1be62e-4328-480b-8339-dbd96c820565 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:00.525826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f1be62e-4328-480b-8339-dbd96c820565 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:00.532733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f1be62e-4328-480b-8339-dbd96c820565 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:00.534006 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f1be62e-4328-480b-8339-dbd96c820565 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:00.535020 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f1be62e-4328-480b-8339-dbd96c820565 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:00.535783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f1be62e-4328-480b-8339-dbd96c820565 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:00.536488 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f1be62e-4328-480b-8339-dbd96c820565 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:01.195400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8f1be62e-4328-480b-8339-dbd96c820565 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:01.205818 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8f1be62e-4328-480b-8339-dbd96c820565 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:01.207594 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8f1be62e-4328-480b-8339-dbd96c820565 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:01.231199 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8f1be62e-4328-480b-8339-dbd96c820565 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1537 microversion: 2.91 time: 0.724428 Oct 29 02:50:01.233167 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 571/1175] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:00 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1537 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:01.246584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-532b40b9-efca-4f58-bc0e-a4b3a27475f7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:01.250096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-532b40b9-efca-4f58-bc0e-a4b3a27475f7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:01.266086 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-532b40b9-efca-4f58-bc0e-a4b3a27475f7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:01.266586 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-532b40b9-efca-4f58-bc0e-a4b3a27475f7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:01.267021 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-532b40b9-efca-4f58-bc0e-a4b3a27475f7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:01.267740 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-532b40b9-efca-4f58-bc0e-a4b3a27475f7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:01.268191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-532b40b9-efca-4f58-bc0e-a4b3a27475f7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:01.268660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-532b40b9-efca-4f58-bc0e-a4b3a27475f7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:01.668128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:01.695633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=10 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:01.716814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-532b40b9-efca-4f58-bc0e-a4b3a27475f7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:01.770370 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-532b40b9-efca-4f58-bc0e-a4b3a27475f7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:01.774709 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-532b40b9-efca-4f58-bc0e-a4b3a27475f7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:01.782495 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-532b40b9-efca-4f58-bc0e-a4b3a27475f7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1815 microversion: 2.25 time: 0.547257 Oct 29 02:50:01.784275 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 572/1176] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:01 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1815 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:01.818379 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-25c2ec3a-d3e7-4abb-bb36-f6f95df1582e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:01.824947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-25c2ec3a-d3e7-4abb-bb36-f6f95df1582e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:01.840383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-25c2ec3a-d3e7-4abb-bb36-f6f95df1582e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:01.841508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-25c2ec3a-d3e7-4abb-bb36-f6f95df1582e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:01.842629 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-25c2ec3a-d3e7-4abb-bb36-f6f95df1582e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:01.844329 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-25c2ec3a-d3e7-4abb-bb36-f6f95df1582e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:01.845531 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-25c2ec3a-d3e7-4abb-bb36-f6f95df1582e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:01.848575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-25c2ec3a-d3e7-4abb-bb36-f6f95df1582e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:02.119191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-b7a7d23c-614a-4e79-8c6a-5b76ff1af238 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] Updating instance_info_cache with network_info: [{"id": "185ed48c-c067-469d-825c-1ba39e43a77e", "address": "fa:16:3e:2e:fb:f3", "network": {"id": "c9c7c955-06f7-476b-b584-0d9678a745fd", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-713225838-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fd611070fee0435f8bdda9c3ba5d62fc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap185ed48c-c0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127124) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 02:50:02.146049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7a7d23c-614a-4e79-8c6a-5b76ff1af238 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Releasing lock "refresh_cache-095efcbf-4088-49c1-9cb8-7d6b3f27af88" {{(pid=127124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 02:50:02.147385 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b7a7d23c-614a-4e79-8c6a-5b76ff1af238 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "POST /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88/action" status: 202 len: 0 microversion: 2.1 time: 3.852963 Oct 29 02:50:02.157690 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 605/1177] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:49:58 2022] POST /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88/action => generated 0 bytes in 3868 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 02:50:02.174823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-74ab1f4b-3ec7-48b0-aa1f-e44075bf380f req-3dec4bb2-51d0-4b65-aa34-1a401ebc1f21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "095efcbf-4088-49c1-9cb8-7d6b3f27af88", "tag": "185ed48c-c067-469d-825c-1ba39e43a77e"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:02.193260 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-74ab1f4b-3ec7-48b0-aa1f-e44075bf380f req-3dec4bb2-51d0-4b65-aa34-1a401ebc1f21 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:02.195382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-74ab1f4b-3ec7-48b0-aa1f-e44075bf380f req-3dec4bb2-51d0-4b65-aa34-1a401ebc1f21 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:02.196028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-74ab1f4b-3ec7-48b0-aa1f-e44075bf380f req-3dec4bb2-51d0-4b65-aa34-1a401ebc1f21 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:02.217077 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-74ab1f4b-3ec7-48b0-aa1f-e44075bf380f req-3dec4bb2-51d0-4b65-aa34-1a401ebc1f21 service nova] Creating event network-changed:185ed48c-c067-469d-825c-1ba39e43a77e for instance 095efcbf-4088-49c1-9cb8-7d6b3f27af88 on n-h2-862967-2 Oct 29 02:50:02.226537 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-74ab1f4b-3ec7-48b0-aa1f-e44075bf380f req-3dec4bb2-51d0-4b65-aa34-1a401ebc1f21 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064827 Oct 29 02:50:02.229723 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 606/1178] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:02.251094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-280dec15-fa6c-423e-bb58-878a349e14b2 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:02.253079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-280dec15-fa6c-423e-bb58-878a349e14b2 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] [instance: de40ca11-d29b-4457-ad27-807bfb1acc65] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:02.274758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-280dec15-fa6c-423e-bb58-878a349e14b2 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:02.276001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-280dec15-fa6c-423e-bb58-878a349e14b2 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:02.277807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-280dec15-fa6c-423e-bb58-878a349e14b2 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:02.279428 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-280dec15-fa6c-423e-bb58-878a349e14b2 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:02.280388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-280dec15-fa6c-423e-bb58-878a349e14b2 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:02.284959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-280dec15-fa6c-423e-bb58-878a349e14b2 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:02.963852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-280dec15-fa6c-423e-bb58-878a349e14b2 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2955d25314a42259483d8ccbfd7ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520485bb54544a3389cec22317db2d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:02.975377 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-280dec15-fa6c-423e-bb58-878a349e14b2 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] 10.222.0.46 "GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65" status: 200 len: 1351 microversion: 2.1 time: 0.742300 Oct 29 02:50:02.976472 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 607/1179] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:02 2022] GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65 => generated 1351 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:02.998780 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3d94acea-200c-4201-97e9-a27ee991fbd9 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:03.000103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3d94acea-200c-4201-97e9-a27ee991fbd9 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:03.008733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d94acea-200c-4201-97e9-a27ee991fbd9 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:03.010455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d94acea-200c-4201-97e9-a27ee991fbd9 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:03.011083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d94acea-200c-4201-97e9-a27ee991fbd9 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:03.012248 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d94acea-200c-4201-97e9-a27ee991fbd9 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:03.012909 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d94acea-200c-4201-97e9-a27ee991fbd9 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:03.013498 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d94acea-200c-4201-97e9-a27ee991fbd9 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:03.048239 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3d94acea-200c-4201-97e9-a27ee991fbd9 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:50:03.185274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-25c2ec3a-d3e7-4abb-bb36-f6f95df1582e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:03.232588 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3d94acea-200c-4201-97e9-a27ee991fbd9 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "DELETE /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88" status: 204 len: 0 microversion: 2.1 time: 0.239633 Oct 29 02:50:03.241013 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 608/1180] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:50:02 2022] DELETE /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:50:03.248310 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-25c2ec3a-d3e7-4abb-bb36-f6f95df1582e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1472 microversion: 2.1 time: 1.446641 Oct 29 02:50:03.259127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-42ba5452-9b78-4ed7-ac04-3d230fa7d73a tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:03.260551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-42ba5452-9b78-4ed7-ac04-3d230fa7d73a tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:03.269122 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 573/1181] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:01 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1472 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:03.275144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-42ba5452-9b78-4ed7-ac04-3d230fa7d73a tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:03.276491 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-42ba5452-9b78-4ed7-ac04-3d230fa7d73a tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:03.277186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-42ba5452-9b78-4ed7-ac04-3d230fa7d73a tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:03.278250 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-42ba5452-9b78-4ed7-ac04-3d230fa7d73a tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:03.278779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-42ba5452-9b78-4ed7-ac04-3d230fa7d73a tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:03.279271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-42ba5452-9b78-4ed7-ac04-3d230fa7d73a tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:03.286705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bb9e57fc-6a46-45d1-b476-f5e8c49f264d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:03.287991 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bb9e57fc-6a46-45d1-b476-f5e8c49f264d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:03.298374 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb9e57fc-6a46-45d1-b476-f5e8c49f264d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:03.299142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb9e57fc-6a46-45d1-b476-f5e8c49f264d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:03.300056 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb9e57fc-6a46-45d1-b476-f5e8c49f264d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:03.301486 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb9e57fc-6a46-45d1-b476-f5e8c49f264d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:03.302472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb9e57fc-6a46-45d1-b476-f5e8c49f264d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:03.303466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb9e57fc-6a46-45d1-b476-f5e8c49f264d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:03.395830 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-42ba5452-9b78-4ed7-ac04-3d230fa7d73a tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:03.409864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-42ba5452-9b78-4ed7-ac04-3d230fa7d73a tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:03.412657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-42ba5452-9b78-4ed7-ac04-3d230fa7d73a tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:03.422172 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-42ba5452-9b78-4ed7-ac04-3d230fa7d73a tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1553 microversion: 2.91 time: 0.185419 Oct 29 02:50:03.422172 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 609/1182] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:03 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1553 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:03.429864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ce7e1685-1c23-4633-88f3-dae564eb7f08 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Action: 'action', calling method: .version_select at 0x7ff059b6daf0>, body: {"addFloatingIp": {"address": "172.25.7.224"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:03.434229 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ce7e1685-1c23-4633-88f3-dae564eb7f08 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:03.441727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce7e1685-1c23-4633-88f3-dae564eb7f08 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:03.442427 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce7e1685-1c23-4633-88f3-dae564eb7f08 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:03.442762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce7e1685-1c23-4633-88f3-dae564eb7f08 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:03.443502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce7e1685-1c23-4633-88f3-dae564eb7f08 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:03.443955 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce7e1685-1c23-4633-88f3-dae564eb7f08 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:03.444388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce7e1685-1c23-4633-88f3-dae564eb7f08 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:03.485818 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce7e1685-1c23-4633-88f3-dae564eb7f08 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "refresh_cache-3380e407-b7cb-4775-b5ed-17ef51c3764a" {{(pid=127124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 02:50:03.485818 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce7e1685-1c23-4633-88f3-dae564eb7f08 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquired lock "refresh_cache-3380e407-b7cb-4775-b5ed-17ef51c3764a" {{(pid=127124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 02:50:03.853481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bb9e57fc-6a46-45d1-b476-f5e8c49f264d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:03.867866 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bb9e57fc-6a46-45d1-b476-f5e8c49f264d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:03.871199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bb9e57fc-6a46-45d1-b476-f5e8c49f264d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:03.879424 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bb9e57fc-6a46-45d1-b476-f5e8c49f264d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1815 microversion: 2.25 time: 0.606767 Oct 29 02:50:03.880485 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 574/1183] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:03 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1815 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:03.928107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-61b6a192-a8b7-476d-9547-2d86b6e99b28 req-2f518be4-830c-4c60-ae6b-d5ebfc4f3670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "694141ac-c96c-409b-9eb2-831a3ccb5a68", "name": "network-vif-unplugged", "status": "completed", "tag": "0c4a3365-7206-4763-be5c-6b7899359935"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:03.950728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-61b6a192-a8b7-476d-9547-2d86b6e99b28 req-2f518be4-830c-4c60-ae6b-d5ebfc4f3670 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:03.951726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-61b6a192-a8b7-476d-9547-2d86b6e99b28 req-2f518be4-830c-4c60-ae6b-d5ebfc4f3670 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:03.953509 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-61b6a192-a8b7-476d-9547-2d86b6e99b28 req-2f518be4-830c-4c60-ae6b-d5ebfc4f3670 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:03.982503 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-61b6a192-a8b7-476d-9547-2d86b6e99b28 req-2f518be4-830c-4c60-ae6b-d5ebfc4f3670 service nova] Creating event network-vif-unplugged:0c4a3365-7206-4763-be5c-6b7899359935 for instance 694141ac-c96c-409b-9eb2-831a3ccb5a68 on n-h1-862967-2 Oct 29 02:50:03.991486 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-61b6a192-a8b7-476d-9547-2d86b6e99b28 req-2f518be4-830c-4c60-ae6b-d5ebfc4f3670 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074134 Oct 29 02:50:03.993596 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 575/1184] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:04.007345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-15a104ad-f620-4598-9149-f2e6efc0ed6d tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:04.008054 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-15a104ad-f620-4598-9149-f2e6efc0ed6d tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] [instance: de40ca11-d29b-4457-ad27-807bfb1acc65] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:04.019963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-15a104ad-f620-4598-9149-f2e6efc0ed6d tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:04.020505 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-15a104ad-f620-4598-9149-f2e6efc0ed6d tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:04.020982 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-15a104ad-f620-4598-9149-f2e6efc0ed6d tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:04.021717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-15a104ad-f620-4598-9149-f2e6efc0ed6d tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:04.022511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-15a104ad-f620-4598-9149-f2e6efc0ed6d tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:04.023251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-15a104ad-f620-4598-9149-f2e6efc0ed6d tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:04.572948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-15a104ad-f620-4598-9149-f2e6efc0ed6d tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2955d25314a42259483d8ccbfd7ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520485bb54544a3389cec22317db2d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:04.599998 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-15a104ad-f620-4598-9149-f2e6efc0ed6d tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] 10.222.0.46 "GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65" status: 200 len: 1351 microversion: 2.1 time: 0.593652 Oct 29 02:50:04.617585 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 576/1185] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:04 2022] GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65 => generated 1351 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:04.646822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-91331553-ecdd-4c9d-b032-c5697006f870 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:04.647949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-91331553-ecdd-4c9d-b032-c5697006f870 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:04.667644 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91331553-ecdd-4c9d-b032-c5697006f870 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:04.668407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91331553-ecdd-4c9d-b032-c5697006f870 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:04.669281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91331553-ecdd-4c9d-b032-c5697006f870 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:04.670561 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91331553-ecdd-4c9d-b032-c5697006f870 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:04.673582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91331553-ecdd-4c9d-b032-c5697006f870 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:04.674901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91331553-ecdd-4c9d-b032-c5697006f870 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:04.714714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:05.860640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-ce7e1685-1c23-4633-88f3-dae564eb7f08 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Building network info cache for instance {{(pid=127124) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 02:50:06.478529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-91331553-ecdd-4c9d-b032-c5697006f870 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:06.492247 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-91331553-ecdd-4c9d-b032-c5697006f870 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1472 microversion: 2.1 time: 1.872984 Oct 29 02:50:06.508651 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 577/1186] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:04 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1472 bytes in 1890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:06.522422 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-03cc5e85-bfff-4a5c-ab98-6adcaa5d4600 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:06.523039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-03cc5e85-bfff-4a5c-ab98-6adcaa5d4600 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:06.534907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03cc5e85-bfff-4a5c-ab98-6adcaa5d4600 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:06.535410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03cc5e85-bfff-4a5c-ab98-6adcaa5d4600 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:06.536913 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03cc5e85-bfff-4a5c-ab98-6adcaa5d4600 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:06.539403 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03cc5e85-bfff-4a5c-ab98-6adcaa5d4600 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:06.539894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03cc5e85-bfff-4a5c-ab98-6adcaa5d4600 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:06.540368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03cc5e85-bfff-4a5c-ab98-6adcaa5d4600 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:06.709635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-03cc5e85-bfff-4a5c-ab98-6adcaa5d4600 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:06.726189 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-03cc5e85-bfff-4a5c-ab98-6adcaa5d4600 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:06.728455 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-03cc5e85-bfff-4a5c-ab98-6adcaa5d4600 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:06.742150 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-03cc5e85-bfff-4a5c-ab98-6adcaa5d4600 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1553 microversion: 2.91 time: 0.232016 Oct 29 02:50:06.743150 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 578/1187] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:06 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1553 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:06.754117 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d507432e-7f9d-4142-8fc6-6fab5f66bb1b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:06.757577 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d507432e-7f9d-4142-8fc6-6fab5f66bb1b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:06.774352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d507432e-7f9d-4142-8fc6-6fab5f66bb1b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:06.775112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d507432e-7f9d-4142-8fc6-6fab5f66bb1b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:06.775712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d507432e-7f9d-4142-8fc6-6fab5f66bb1b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:06.776646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d507432e-7f9d-4142-8fc6-6fab5f66bb1b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:06.783210 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d507432e-7f9d-4142-8fc6-6fab5f66bb1b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:06.783956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d507432e-7f9d-4142-8fc6-6fab5f66bb1b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:07.805601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d507432e-7f9d-4142-8fc6-6fab5f66bb1b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:07.816411 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d507432e-7f9d-4142-8fc6-6fab5f66bb1b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:07.826874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d507432e-7f9d-4142-8fc6-6fab5f66bb1b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:07.832303 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d507432e-7f9d-4142-8fc6-6fab5f66bb1b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1815 microversion: 2.25 time: 1.082848 Oct 29 02:50:07.846178 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 579/1188] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:06 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1815 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:07.867505 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-b6f1c4ba-a669-4d89-860b-cab549ee15bd req-b987579d-2401-4429-9596-063ac28b6cab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de40ca11-d29b-4457-ad27-807bfb1acc65", "name": "network-vif-plugged", "status": "completed", "tag": "fab97166-f957-42ca-8a7d-d580455a03ba"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:07.880611 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b6f1c4ba-a669-4d89-860b-cab549ee15bd req-b987579d-2401-4429-9596-063ac28b6cab service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:07.881098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b6f1c4ba-a669-4d89-860b-cab549ee15bd req-b987579d-2401-4429-9596-063ac28b6cab service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:07.882068 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b6f1c4ba-a669-4d89-860b-cab549ee15bd req-b987579d-2401-4429-9596-063ac28b6cab service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:07.900035 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-b6f1c4ba-a669-4d89-860b-cab549ee15bd req-b987579d-2401-4429-9596-063ac28b6cab service nova] Creating event network-vif-plugged:fab97166-f957-42ca-8a7d-d580455a03ba for instance de40ca11-d29b-4457-ad27-807bfb1acc65 on n-h1-862967-2 Oct 29 02:50:07.906547 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-b6f1c4ba-a669-4d89-860b-cab549ee15bd req-b987579d-2401-4429-9596-063ac28b6cab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056668 Oct 29 02:50:07.907818 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 580/1189] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:07.913698 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ed1916e3-2eab-41fb-a1bb-69ee0a414d88 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:07.914815 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ed1916e3-2eab-41fb-a1bb-69ee0a414d88 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] [instance: de40ca11-d29b-4457-ad27-807bfb1acc65] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:07.922378 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed1916e3-2eab-41fb-a1bb-69ee0a414d88 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:07.923171 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed1916e3-2eab-41fb-a1bb-69ee0a414d88 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:07.923791 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed1916e3-2eab-41fb-a1bb-69ee0a414d88 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:07.924716 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed1916e3-2eab-41fb-a1bb-69ee0a414d88 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:07.925534 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed1916e3-2eab-41fb-a1bb-69ee0a414d88 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:07.926147 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed1916e3-2eab-41fb-a1bb-69ee0a414d88 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:08.680559 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ed1916e3-2eab-41fb-a1bb-69ee0a414d88 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2955d25314a42259483d8ccbfd7ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520485bb54544a3389cec22317db2d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:08.703384 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ed1916e3-2eab-41fb-a1bb-69ee0a414d88 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] 10.222.0.46 "GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65" status: 200 len: 1351 microversion: 2.1 time: 0.793323 Oct 29 02:50:08.712593 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 581/1190] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:07 2022] GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65 => generated 1351 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:08.727221 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-69f1ccd4-ebba-430a-84bc-444877ff728d req-d9896603-660c-4da1-9109-9fc27aa6db41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3380e407-b7cb-4775-b5ed-17ef51c3764a", "tag": "d045507b-53ea-4e4f-9def-029bda6114ff"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:08.760549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-69f1ccd4-ebba-430a-84bc-444877ff728d req-d9896603-660c-4da1-9109-9fc27aa6db41 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:08.765104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-69f1ccd4-ebba-430a-84bc-444877ff728d req-d9896603-660c-4da1-9109-9fc27aa6db41 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:08.766163 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-69f1ccd4-ebba-430a-84bc-444877ff728d req-d9896603-660c-4da1-9109-9fc27aa6db41 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:08.811983 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-69f1ccd4-ebba-430a-84bc-444877ff728d req-d9896603-660c-4da1-9109-9fc27aa6db41 service nova] Creating event network-changed:d045507b-53ea-4e4f-9def-029bda6114ff for instance 3380e407-b7cb-4775-b5ed-17ef51c3764a on n-h1-862967-2 Oct 29 02:50:08.828827 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-69f1ccd4-ebba-430a-84bc-444877ff728d req-d9896603-660c-4da1-9109-9fc27aa6db41 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113628 Oct 29 02:50:08.832353 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 582/1191] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:08.849030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dbb2dfdd-8340-4e62-8b42-80cdfa6d694e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:08.858628 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dbb2dfdd-8340-4e62-8b42-80cdfa6d694e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:08.890489 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbb2dfdd-8340-4e62-8b42-80cdfa6d694e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:08.891713 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbb2dfdd-8340-4e62-8b42-80cdfa6d694e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:08.892757 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbb2dfdd-8340-4e62-8b42-80cdfa6d694e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:08.894230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbb2dfdd-8340-4e62-8b42-80cdfa6d694e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:08.901222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbb2dfdd-8340-4e62-8b42-80cdfa6d694e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:08.902383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbb2dfdd-8340-4e62-8b42-80cdfa6d694e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:08.974644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-ce7e1685-1c23-4633-88f3-dae564eb7f08 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Updating instance_info_cache with network_info: [{"id": "d045507b-53ea-4e4f-9def-029bda6114ff", "address": "fa:16:3e:6e:25:30", "network": {"id": "c9c7c955-06f7-476b-b584-0d9678a745fd", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-713225838-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fd611070fee0435f8bdda9c3ba5d62fc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd045507b-53", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127124) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 02:50:09.037631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce7e1685-1c23-4633-88f3-dae564eb7f08 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Releasing lock "refresh_cache-3380e407-b7cb-4775-b5ed-17ef51c3764a" {{(pid=127124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 02:50:09.039273 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ce7e1685-1c23-4633-88f3-dae564eb7f08 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "POST /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a/action" status: 202 len: 0 microversion: 2.1 time: 5.616056 Oct 29 02:50:09.040779 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 610/1192] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:50:03 2022] POST /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a/action => generated 0 bytes in 5619 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 02:50:09.058080 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2ff4b451-7bdb-450f-a855-e913810d1125 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:09.059557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2ff4b451-7bdb-450f-a855-e913810d1125 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:09.088629 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2ff4b451-7bdb-450f-a855-e913810d1125 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:09.093555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2ff4b451-7bdb-450f-a855-e913810d1125 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:09.094565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2ff4b451-7bdb-450f-a855-e913810d1125 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:09.095760 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2ff4b451-7bdb-450f-a855-e913810d1125 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:09.098017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2ff4b451-7bdb-450f-a855-e913810d1125 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:09.098919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2ff4b451-7bdb-450f-a855-e913810d1125 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:09.216899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2ff4b451-7bdb-450f-a855-e913810d1125 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:09.227070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2ff4b451-7bdb-450f-a855-e913810d1125 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:09.232478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2ff4b451-7bdb-450f-a855-e913810d1125 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:09.246630 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2ff4b451-7bdb-450f-a855-e913810d1125 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1553 microversion: 2.91 time: 0.203739 Oct 29 02:50:09.247510 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 611/1193] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:09 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1553 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:09.288388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-8f220c9e-8269-4926-ba50-6e740e9a6b8f req-aa13cbde-a7d9-4ff4-8134-e8293036f86b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "694141ac-c96c-409b-9eb2-831a3ccb5a68", "tag": "0c4a3365-7206-4763-be5c-6b7899359935"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:09.319667 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8f220c9e-8269-4926-ba50-6e740e9a6b8f req-aa13cbde-a7d9-4ff4-8134-e8293036f86b service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:09.320338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8f220c9e-8269-4926-ba50-6e740e9a6b8f req-aa13cbde-a7d9-4ff4-8134-e8293036f86b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:09.322147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8f220c9e-8269-4926-ba50-6e740e9a6b8f req-aa13cbde-a7d9-4ff4-8134-e8293036f86b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:09.358154 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-8f220c9e-8269-4926-ba50-6e740e9a6b8f req-aa13cbde-a7d9-4ff4-8134-e8293036f86b service nova] Creating event network-changed:0c4a3365-7206-4763-be5c-6b7899359935 for instance 694141ac-c96c-409b-9eb2-831a3ccb5a68 on n-h1-862967-2 Oct 29 02:50:09.373981 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dbb2dfdd-8340-4e62-8b42-80cdfa6d694e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:09.377495 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-8f220c9e-8269-4926-ba50-6e740e9a6b8f req-aa13cbde-a7d9-4ff4-8134-e8293036f86b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093252 Oct 29 02:50:09.378718 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 612/1194] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:09.396207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a7090bea-c128-41fb-a7d4-483203dfa29f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:09.399688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a7090bea-c128-41fb-a7d4-483203dfa29f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:09.402380 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dbb2dfdd-8340-4e62-8b42-80cdfa6d694e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1472 microversion: 2.1 time: 0.567712 Oct 29 02:50:09.408253 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 583/1195] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:08 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1472 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:09.423254 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7090bea-c128-41fb-a7d4-483203dfa29f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:09.423949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f1b05252-bab8-4f7a-95dc-09f3a224c65c tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '.version_select at 0x7ff0588c4940>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:09.424236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7090bea-c128-41fb-a7d4-483203dfa29f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:09.424863 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7090bea-c128-41fb-a7d4-483203dfa29f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:09.425949 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7090bea-c128-41fb-a7d4-483203dfa29f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:09.426655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7090bea-c128-41fb-a7d4-483203dfa29f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:09.427409 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7090bea-c128-41fb-a7d4-483203dfa29f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:09.949762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a7090bea-c128-41fb-a7d4-483203dfa29f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:09.960996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a7090bea-c128-41fb-a7d4-483203dfa29f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:09.970800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a7090bea-c128-41fb-a7d4-483203dfa29f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:09.979473 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a7090bea-c128-41fb-a7d4-483203dfa29f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1815 microversion: 2.25 time: 0.598969 Oct 29 02:50:09.985074 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 613/1196] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:09 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1815 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:09.993307 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-19eb9347-200d-4207-be50-2fbed25a23b2 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:10.004730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-19eb9347-200d-4207-be50-2fbed25a23b2 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] [instance: de40ca11-d29b-4457-ad27-807bfb1acc65] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:10.013637 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-19eb9347-200d-4207-be50-2fbed25a23b2 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:10.014132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-19eb9347-200d-4207-be50-2fbed25a23b2 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:10.014549 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-19eb9347-200d-4207-be50-2fbed25a23b2 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:10.015484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-19eb9347-200d-4207-be50-2fbed25a23b2 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:10.015939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-19eb9347-200d-4207-be50-2fbed25a23b2 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:10.026097 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-19eb9347-200d-4207-be50-2fbed25a23b2 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:10.841822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-19eb9347-200d-4207-be50-2fbed25a23b2 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2955d25314a42259483d8ccbfd7ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520485bb54544a3389cec22317db2d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:10.862942 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-19eb9347-200d-4207-be50-2fbed25a23b2 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] 10.222.0.46 "GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65" status: 200 len: 1351 microversion: 2.1 time: 0.875545 Oct 29 02:50:10.865950 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 614/1197] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:09 2022] GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65 => generated 1351 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:10.888621 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-00d07c15-6846-4666-b00f-527c397de00b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:10.889577 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-00d07c15-6846-4666-b00f-527c397de00b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:10.911401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00d07c15-6846-4666-b00f-527c397de00b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:10.918007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00d07c15-6846-4666-b00f-527c397de00b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:10.918755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00d07c15-6846-4666-b00f-527c397de00b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:10.922744 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00d07c15-6846-4666-b00f-527c397de00b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:10.923363 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00d07c15-6846-4666-b00f-527c397de00b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:10.923876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00d07c15-6846-4666-b00f-527c397de00b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:10.962357 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f1b05252-bab8-4f7a-95dc-09f3a224c65c tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips/7c004ddb-40e4-485e-9fa5-cc286ecbbb8f" status: 200 len: 184 microversion: 2.1 time: 1.552848 Oct 29 02:50:10.970342 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 584/1198] 10.222.0.46 () {58 vars in 1260 bytes} [Sat Oct 29 02:50:09 2022] GET /compute/v2.1/os-floating-ips/7c004ddb-40e4-485e-9fa5-cc286ecbbb8f => generated 184 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:10.978378 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-85994d7b-3420-48cf-9cf5-2a92519a207f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:10.979416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-85994d7b-3420-48cf-9cf5-2a92519a207f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:11.011160 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85994d7b-3420-48cf-9cf5-2a92519a207f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:11.011902 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85994d7b-3420-48cf-9cf5-2a92519a207f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:11.027569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85994d7b-3420-48cf-9cf5-2a92519a207f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:11.028685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85994d7b-3420-48cf-9cf5-2a92519a207f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:11.029190 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85994d7b-3420-48cf-9cf5-2a92519a207f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:11.029640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85994d7b-3420-48cf-9cf5-2a92519a207f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:11.076053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-00d07c15-6846-4666-b00f-527c397de00b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:11.112304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-00d07c15-6846-4666-b00f-527c397de00b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:11.119400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-00d07c15-6846-4666-b00f-527c397de00b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:11.153994 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-00d07c15-6846-4666-b00f-527c397de00b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1553 microversion: 2.91 time: 0.281435 Oct 29 02:50:11.160237 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 615/1199] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:10 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1553 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:11.186645 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-1da03d4c-2b1c-4247-8f27-bda5fe5d63bf req-17e68a58-9365-401b-9384-27fb82c267da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "095efcbf-4088-49c1-9cb8-7d6b3f27af88", "name": "network-vif-deleted", "tag": "185ed48c-c067-469d-825c-1ba39e43a77e"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:11.220228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1da03d4c-2b1c-4247-8f27-bda5fe5d63bf req-17e68a58-9365-401b-9384-27fb82c267da service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:11.228313 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1da03d4c-2b1c-4247-8f27-bda5fe5d63bf req-17e68a58-9365-401b-9384-27fb82c267da service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:11.231064 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1da03d4c-2b1c-4247-8f27-bda5fe5d63bf req-17e68a58-9365-401b-9384-27fb82c267da service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:11.291726 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-1da03d4c-2b1c-4247-8f27-bda5fe5d63bf req-17e68a58-9365-401b-9384-27fb82c267da service nova] Creating event network-vif-deleted:185ed48c-c067-469d-825c-1ba39e43a77e for instance 095efcbf-4088-49c1-9cb8-7d6b3f27af88 on n-h2-862967-2 Oct 29 02:50:11.333289 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-1da03d4c-2b1c-4247-8f27-bda5fe5d63bf req-17e68a58-9365-401b-9384-27fb82c267da service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170414 Oct 29 02:50:11.343001 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 616/1200] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:11.373451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1f67c859-9eb0-4397-834b-5c5f5520e340 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.224"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:11.863164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-85994d7b-3420-48cf-9cf5-2a92519a207f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:11.874123 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-85994d7b-3420-48cf-9cf5-2a92519a207f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1472 microversion: 2.1 time: 0.902239 Oct 29 02:50:11.891347 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 585/1201] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:10 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1472 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:11.915662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9b230cc4-4ed1-4418-97e7-60974f37ec73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:11.926653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9b230cc4-4ed1-4418-97e7-60974f37ec73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:11.968320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b230cc4-4ed1-4418-97e7-60974f37ec73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:11.984161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b230cc4-4ed1-4418-97e7-60974f37ec73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:11.985328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b230cc4-4ed1-4418-97e7-60974f37ec73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:11.989857 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b230cc4-4ed1-4418-97e7-60974f37ec73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:11.994300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b230cc4-4ed1-4418-97e7-60974f37ec73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:11.997462 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b230cc4-4ed1-4418-97e7-60974f37ec73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:12.405478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1f67c859-9eb0-4397-834b-5c5f5520e340 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:12.415258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1f67c859-9eb0-4397-834b-5c5f5520e340 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:12.416240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1f67c859-9eb0-4397-834b-5c5f5520e340 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:12.418282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1f67c859-9eb0-4397-834b-5c5f5520e340 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:12.422060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1f67c859-9eb0-4397-834b-5c5f5520e340 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:12.424516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1f67c859-9eb0-4397-834b-5c5f5520e340 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:12.437506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1f67c859-9eb0-4397-834b-5c5f5520e340 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:12.828851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9b230cc4-4ed1-4418-97e7-60974f37ec73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:12.843983 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9b230cc4-4ed1-4418-97e7-60974f37ec73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:12.846991 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9b230cc4-4ed1-4418-97e7-60974f37ec73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:12.855242 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9b230cc4-4ed1-4418-97e7-60974f37ec73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1815 microversion: 2.25 time: 0.960429 Oct 29 02:50:12.855964 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 586/1202] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:11 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1815 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:12.861633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c53bd12a-94b8-4b73-9e45-7509c91a8c7f tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:12.862610 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c53bd12a-94b8-4b73-9e45-7509c91a8c7f tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] [instance: de40ca11-d29b-4457-ad27-807bfb1acc65] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:12.875243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c53bd12a-94b8-4b73-9e45-7509c91a8c7f tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:12.876664 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c53bd12a-94b8-4b73-9e45-7509c91a8c7f tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:12.877168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c53bd12a-94b8-4b73-9e45-7509c91a8c7f tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:12.878125 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c53bd12a-94b8-4b73-9e45-7509c91a8c7f tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:12.878693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c53bd12a-94b8-4b73-9e45-7509c91a8c7f tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:12.879734 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c53bd12a-94b8-4b73-9e45-7509c91a8c7f tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:13.091094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1f67c859-9eb0-4397-834b-5c5f5520e340 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "refresh_cache-3380e407-b7cb-4775-b5ed-17ef51c3764a" {{(pid=127124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 02:50:13.091948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1f67c859-9eb0-4397-834b-5c5f5520e340 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquired lock "refresh_cache-3380e407-b7cb-4775-b5ed-17ef51c3764a" {{(pid=127124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 02:50:13.305639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c53bd12a-94b8-4b73-9e45-7509c91a8c7f tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2955d25314a42259483d8ccbfd7ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520485bb54544a3389cec22317db2d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:13.372503 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c53bd12a-94b8-4b73-9e45-7509c91a8c7f tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] 10.222.0.46 "GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65" status: 200 len: 1541 microversion: 2.1 time: 0.513092 Oct 29 02:50:13.374960 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 587/1203] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:12 2022] GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65 => generated 1541 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:13.382841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bb3a3e53-e199-4b07-a807-d6a5cc7ddb6e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:13.384038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bb3a3e53-e199-4b07-a807-d6a5cc7ddb6e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:13.393749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb3a3e53-e199-4b07-a807-d6a5cc7ddb6e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:13.394670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb3a3e53-e199-4b07-a807-d6a5cc7ddb6e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:13.395456 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb3a3e53-e199-4b07-a807-d6a5cc7ddb6e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:13.396214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb3a3e53-e199-4b07-a807-d6a5cc7ddb6e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:13.396754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb3a3e53-e199-4b07-a807-d6a5cc7ddb6e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:13.398221 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb3a3e53-e199-4b07-a807-d6a5cc7ddb6e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:13.587766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bb3a3e53-e199-4b07-a807-d6a5cc7ddb6e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:13.596999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bb3a3e53-e199-4b07-a807-d6a5cc7ddb6e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:13.607558 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bb3a3e53-e199-4b07-a807-d6a5cc7ddb6e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:13.614084 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bb3a3e53-e199-4b07-a807-d6a5cc7ddb6e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1553 microversion: 2.91 time: 0.237061 Oct 29 02:50:13.615465 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 588/1204] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:13 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1553 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:13.623487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a8161a3a-23e6-41c8-8d09-b989d92df67f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:13.624782 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a8161a3a-23e6-41c8-8d09-b989d92df67f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:13.648925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8161a3a-23e6-41c8-8d09-b989d92df67f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:13.650280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8161a3a-23e6-41c8-8d09-b989d92df67f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:13.651731 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8161a3a-23e6-41c8-8d09-b989d92df67f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:13.653247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8161a3a-23e6-41c8-8d09-b989d92df67f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:13.654325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8161a3a-23e6-41c8-8d09-b989d92df67f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:13.655318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8161a3a-23e6-41c8-8d09-b989d92df67f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:14.346041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a8161a3a-23e6-41c8-8d09-b989d92df67f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:14.371745 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a8161a3a-23e6-41c8-8d09-b989d92df67f tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1472 microversion: 2.1 time: 0.749968 Oct 29 02:50:14.375596 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 589/1205] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:13 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1472 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:14.410792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-245072fd-c357-402d-a519-d0f66c3ff1d4 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:14.449686 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-245072fd-c357-402d-a519-d0f66c3ff1d4 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] [instance: de40ca11-d29b-4457-ad27-807bfb1acc65] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:14.483235 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-245072fd-c357-402d-a519-d0f66c3ff1d4 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:14.484205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-245072fd-c357-402d-a519-d0f66c3ff1d4 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:14.484925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-245072fd-c357-402d-a519-d0f66c3ff1d4 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:14.486255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-245072fd-c357-402d-a519-d0f66c3ff1d4 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:14.487339 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-245072fd-c357-402d-a519-d0f66c3ff1d4 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:14.489562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-245072fd-c357-402d-a519-d0f66c3ff1d4 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:14.864275 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-245072fd-c357-402d-a519-d0f66c3ff1d4 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] 10.222.0.46 "GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.486708 Oct 29 02:50:14.866690 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 590/1206] 10.222.0.46 () {58 vars in 1275 bytes} [Sat Oct 29 02:50:14 2022] GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65/os-interface => generated 284 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:14.893695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f2d8f605-adfb-4267-8297-14052cfe5b45 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9933e750-1e03-4519-9e65-114f951bc696"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:14.903887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f2d8f605-adfb-4267-8297-14052cfe5b45 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:14.916975 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2d8f605-adfb-4267-8297-14052cfe5b45 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:14.917481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2d8f605-adfb-4267-8297-14052cfe5b45 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:14.918102 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2d8f605-adfb-4267-8297-14052cfe5b45 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:14.919266 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2d8f605-adfb-4267-8297-14052cfe5b45 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:14.920810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2d8f605-adfb-4267-8297-14052cfe5b45 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:14.921443 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2d8f605-adfb-4267-8297-14052cfe5b45 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:15.815746 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f2d8f605-adfb-4267-8297-14052cfe5b45 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "POST /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.947442 Oct 29 02:50:15.828967 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 591/1207] 10.222.0.46 () {60 vars in 1323 bytes} [Sat Oct 29 02:50:14 2022] POST /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54/os-volume_attachments => generated 194 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:15.883051 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b9471928-a749-4543-9a5c-9ebf5446aa65 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:15.889874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b9471928-a749-4543-9a5c-9ebf5446aa65 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:15.897450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-1f67c859-9eb0-4397-834b-5c5f5520e340 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Building network info cache for instance {{(pid=127124) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 02:50:15.922149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9471928-a749-4543-9a5c-9ebf5446aa65 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:15.927207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9471928-a749-4543-9a5c-9ebf5446aa65 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:15.928065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9471928-a749-4543-9a5c-9ebf5446aa65 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:15.929489 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9471928-a749-4543-9a5c-9ebf5446aa65 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:15.930306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9471928-a749-4543-9a5c-9ebf5446aa65 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:15.931044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9471928-a749-4543-9a5c-9ebf5446aa65 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:17.419562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b9471928-a749-4543-9a5c-9ebf5446aa65 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:17.451257 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b9471928-a749-4543-9a5c-9ebf5446aa65 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:17.465536 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b9471928-a749-4543-9a5c-9ebf5446aa65 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:17.468065 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b9471928-a749-4543-9a5c-9ebf5446aa65 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1815 microversion: 2.25 time: 1.636159 Oct 29 02:50:17.469240 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 592/1208] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:15 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1815 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:17.483705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-41e40523-b5fb-4ffb-aaa4-3f6c0b2e30ed tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:17.484364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-41e40523-b5fb-4ffb-aaa4-3f6c0b2e30ed tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:17.507017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41e40523-b5fb-4ffb-aaa4-3f6c0b2e30ed tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:17.507529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41e40523-b5fb-4ffb-aaa4-3f6c0b2e30ed tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:17.507974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41e40523-b5fb-4ffb-aaa4-3f6c0b2e30ed tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:17.512994 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41e40523-b5fb-4ffb-aaa4-3f6c0b2e30ed tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:17.513946 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41e40523-b5fb-4ffb-aaa4-3f6c0b2e30ed tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:17.517226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41e40523-b5fb-4ffb-aaa4-3f6c0b2e30ed tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:17.845197 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-41e40523-b5fb-4ffb-aaa4-3f6c0b2e30ed tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:17.862406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-41e40523-b5fb-4ffb-aaa4-3f6c0b2e30ed tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:17.874444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-41e40523-b5fb-4ffb-aaa4-3f6c0b2e30ed tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:17.907167 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-41e40523-b5fb-4ffb-aaa4-3f6c0b2e30ed tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1553 microversion: 2.91 time: 0.436092 Oct 29 02:50:17.908507 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 593/1209] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:17 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1553 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:17.913716 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b81524d6-49e1-4ced-a878-84f73bc7fb0d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:17.914671 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b81524d6-49e1-4ced-a878-84f73bc7fb0d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:17.930043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b81524d6-49e1-4ced-a878-84f73bc7fb0d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:17.930925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b81524d6-49e1-4ced-a878-84f73bc7fb0d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:17.931809 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b81524d6-49e1-4ced-a878-84f73bc7fb0d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:17.932836 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b81524d6-49e1-4ced-a878-84f73bc7fb0d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:17.933542 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b81524d6-49e1-4ced-a878-84f73bc7fb0d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:17.940118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b81524d6-49e1-4ced-a878-84f73bc7fb0d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:19.017747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-1f67c859-9eb0-4397-834b-5c5f5520e340 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Updating instance_info_cache with network_info: [{"id": "d045507b-53ea-4e4f-9def-029bda6114ff", "address": "fa:16:3e:6e:25:30", "network": {"id": "c9c7c955-06f7-476b-b584-0d9678a745fd", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-713225838-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fd611070fee0435f8bdda9c3ba5d62fc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd045507b-53", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127124) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 02:50:19.030068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:19.040027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1f67c859-9eb0-4397-834b-5c5f5520e340 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Releasing lock "refresh_cache-3380e407-b7cb-4775-b5ed-17ef51c3764a" {{(pid=127124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 02:50:19.045699 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1f67c859-9eb0-4397-834b-5c5f5520e340 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "POST /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a/action" status: 202 len: 0 microversion: 2.1 time: 7.698986 Oct 29 02:50:19.049889 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 617/1210] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:50:11 2022] POST /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a/action => generated 0 bytes in 7706 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 02:50:19.080316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-28b04568-7a4d-44cc-b498-50ad29edf1e2 req-8f606bda-5eff-4f9d-bf9f-2c5f240d0cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3380e407-b7cb-4775-b5ed-17ef51c3764a", "tag": "d045507b-53ea-4e4f-9def-029bda6114ff"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:19.101439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-28b04568-7a4d-44cc-b498-50ad29edf1e2 req-8f606bda-5eff-4f9d-bf9f-2c5f240d0cc1 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:19.107979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-28b04568-7a4d-44cc-b498-50ad29edf1e2 req-8f606bda-5eff-4f9d-bf9f-2c5f240d0cc1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:19.108790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-28b04568-7a4d-44cc-b498-50ad29edf1e2 req-8f606bda-5eff-4f9d-bf9f-2c5f240d0cc1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:19.136074 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-28b04568-7a4d-44cc-b498-50ad29edf1e2 req-8f606bda-5eff-4f9d-bf9f-2c5f240d0cc1 service nova] Creating event network-changed:d045507b-53ea-4e4f-9def-029bda6114ff for instance 3380e407-b7cb-4775-b5ed-17ef51c3764a on n-h1-862967-2 Oct 29 02:50:19.155410 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-28b04568-7a4d-44cc-b498-50ad29edf1e2 req-8f606bda-5eff-4f9d-bf9f-2c5f240d0cc1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103894 Oct 29 02:50:19.171600 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 618/1211] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:19.665932 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-032a0b98-2de8-445f-ae3e-ec6f05827fe2 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Action: 'create', calling method: .version_select at 0x7ff053d45dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-576380549", "description": "tempest-description-1890350549"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:19.813226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b81524d6-49e1-4ced-a878-84f73bc7fb0d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:19.855318 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b81524d6-49e1-4ced-a878-84f73bc7fb0d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1472 microversion: 2.1 time: 1.944089 Oct 29 02:50:19.857805 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 594/1212] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:17 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1472 bytes in 1948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:19.869856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f47b5f84-865c-492b-9a61-4c8985929a82 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:19.871319 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f47b5f84-865c-492b-9a61-4c8985929a82 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:19.904055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f47b5f84-865c-492b-9a61-4c8985929a82 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:19.906177 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f47b5f84-865c-492b-9a61-4c8985929a82 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:19.908030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f47b5f84-865c-492b-9a61-4c8985929a82 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:19.909708 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f47b5f84-865c-492b-9a61-4c8985929a82 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:19.910797 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f47b5f84-865c-492b-9a61-4c8985929a82 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:19.915191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f47b5f84-865c-492b-9a61-4c8985929a82 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:20.007470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:20.577294 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-032a0b98-2de8-445f-ae3e-ec6f05827fe2 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.403764 Oct 29 02:50:20.578666 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 619/1213] 10.222.0.46 () {60 vars in 1180 bytes} [Sat Oct 29 02:50:19 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:20.587882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7da4cd42-6673-4674-9648-be8d147e910c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:20.590916 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7da4cd42-6673-4674-9648-be8d147e910c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:20.620441 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7da4cd42-6673-4674-9648-be8d147e910c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:20.621323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7da4cd42-6673-4674-9648-be8d147e910c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:20.621769 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7da4cd42-6673-4674-9648-be8d147e910c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:20.622504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7da4cd42-6673-4674-9648-be8d147e910c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:20.622956 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7da4cd42-6673-4674-9648-be8d147e910c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:20.628205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7da4cd42-6673-4674-9648-be8d147e910c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:20.734363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f47b5f84-865c-492b-9a61-4c8985929a82 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:20.766765 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f47b5f84-865c-492b-9a61-4c8985929a82 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:20.792456 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f47b5f84-865c-492b-9a61-4c8985929a82 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:20.807800 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f47b5f84-865c-492b-9a61-4c8985929a82 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1815 microversion: 2.25 time: 0.947388 Oct 29 02:50:20.817745 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 595/1214] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:19 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1815 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:20.861167 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8fd34077-780c-4448-b725-569fcdd3247c tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:20.864495 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8fd34077-780c-4448-b725-569fcdd3247c tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:20.915584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8fd34077-780c-4448-b725-569fcdd3247c tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:20.917006 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8fd34077-780c-4448-b725-569fcdd3247c tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:20.920325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8fd34077-780c-4448-b725-569fcdd3247c tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:20.924058 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8fd34077-780c-4448-b725-569fcdd3247c tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:20.933761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8fd34077-780c-4448-b725-569fcdd3247c tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:20.950056 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8fd34077-780c-4448-b725-569fcdd3247c tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:21.063140 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-8fd34077-780c-4448-b725-569fcdd3247c tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] HTTP exception thrown: Instance 095efcbf-4088-49c1-9cb8-7d6b3f27af88 could not be found. Oct 29 02:50:21.082778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8fd34077-780c-4448-b725-569fcdd3247c tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Request method failure captured: Oct 29 02:50:21.082778 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88 HTTP/1.1 Oct 29 02:50:21.082778 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:50:21.082778 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:50:21.082778 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:50:21.082778 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:50:21.082778 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:50:21.082778 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:50:21.082778 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:50:21.082778 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:50:21.082778 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJSGLrxUA0l_U9RD0bxMcuRANQY2pcWkvaC3uKgKmf86ETjckHfL5zo6rqaOSK0vvpP1bIvw2PthIlVQ6Lf0l421arEtGZ1z-vV2jnaC7TT-ZnIV0qdU_cC1sK7PCIpH-JLsNZM6IBzY35ix_U8GYfp5_0ZV_NgvzYsYrfG8EdiLpvE Oct 29 02:50:21.082778 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:50:21.082778 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:50:21.082778 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:50:21.082778 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:50:21.082778 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:50:21.082778 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:50:21.082778 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: fd611070fee0435f8bdda9c3ba5d62fc Oct 29 02:50:21.082778 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1732592755 Oct 29 02:50:21.082778 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:50:21.082778 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:50:21.084816 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fd611070fee0435f8bdda9c3ba5d62fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fd611070fee0435f8bdda9c3ba5d62fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fd611070fee0435f8bdda9c3ba5d62fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fd611070fee0435f8bdda9c3ba5d62fc"}]}] Oct 29 02:50:21.084816 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1732592755 Oct 29 02:50:21.084816 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: fd611070fee0435f8bdda9c3ba5d62fc Oct 29 02:50:21.084816 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1732592755 Oct 29 02:50:21.084816 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-FloatingIPsAssociationTestJSON-1732592755-project Oct 29 02:50:21.084816 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:50:21.084816 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:50:21.084816 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 15a2e59fd0b244eea041651e4d79de9b Oct 29 02:50:21.084816 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1732592755-project Oct 29 02:50:21.084816 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:50:21.084816 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 095efcbf-4088-49c1-9cb8-7d6b3f27af88 could not be found. Oct 29 02:50:21.084816 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '095efcbf-4088-49c1-9cb8-7d6b3f27af88'} Oct 29 02:50:21.086438 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:50:21.086438 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:21.086438 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:50:21.086438 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:50:21.086438 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:50:21.086438 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:50:21.086438 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:50:21.086438 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:50:21.086438 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:50:21.086438 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:50:21.086438 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 095efcbf-4088-49c1-9cb8-7d6b3f27af88 could not be found. Oct 29 02:50:21.086438 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:21.086438 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:21.086438 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:21.086438 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:21.086438 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:21.086438 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:21.086438 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:50:21.086438 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:50:21.086438 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:50:21.088988 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:50:21.088988 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:50:21.088988 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:50:21.088988 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:50:21.088988 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:50:21.088988 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:50:21.088988 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:50:21.088988 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:50:21.088988 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:50:21.088988 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 095efcbf-4088-49c1-9cb8-7d6b3f27af88 could not be found. Oct 29 02:50:21.088988 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:21.088988 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:21.088988 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:21.088988 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:21.088988 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:21.088988 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:21.088988 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:50:21.088988 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:50:21.088988 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 095efcbf-4088-49c1-9cb8-7d6b3f27af88 could not be found. Oct 29 02:50:21.088988 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:21.091679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8fd34077-780c-4448-b725-569fcdd3247c tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Returning 404 to user: Instance 095efcbf-4088-49c1-9cb8-7d6b3f27af88 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:50:21.095728 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8fd34077-780c-4448-b725-569fcdd3247c tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "DELETE /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88" status: 404 len: 111 microversion: 2.1 time: 0.273251 Oct 29 02:50:21.096892 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 596/1215] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:50:20 2022] DELETE /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88 => generated 111 bytes in 277 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:50:21.115193 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8bb48458-f302-4176-a538-ebdc3dfcc48b tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Action: 'create', calling method: .version_select at 0x7ff053aa49d0>, body: {"security_group_rule": {"parent_group_id": "d0d44cbc-8cbe-44ea-9d65-e0625197d6fe", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:21.144345 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7da4cd42-6673-4674-9648-be8d147e910c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:21.156262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7da4cd42-6673-4674-9648-be8d147e910c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:21.158428 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7da4cd42-6673-4674-9648-be8d147e910c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:21.176419 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7da4cd42-6673-4674-9648-be8d147e910c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1553 microversion: 2.91 time: 0.596546 Oct 29 02:50:21.177330 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 620/1216] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:20 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1553 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:21.193066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3f6450bc-40fb-4a10-b5cf-dddbf0dc84c6 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:21.196351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3f6450bc-40fb-4a10-b5cf-dddbf0dc84c6 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:21.222992 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f6450bc-40fb-4a10-b5cf-dddbf0dc84c6 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:21.224289 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f6450bc-40fb-4a10-b5cf-dddbf0dc84c6 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:21.236609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f6450bc-40fb-4a10-b5cf-dddbf0dc84c6 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:21.238253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f6450bc-40fb-4a10-b5cf-dddbf0dc84c6 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:21.239391 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f6450bc-40fb-4a10-b5cf-dddbf0dc84c6 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:21.240439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f6450bc-40fb-4a10-b5cf-dddbf0dc84c6 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:22.179828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3f6450bc-40fb-4a10-b5cf-dddbf0dc84c6 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:22.194914 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3f6450bc-40fb-4a10-b5cf-dddbf0dc84c6 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1472 microversion: 2.1 time: 1.015817 Oct 29 02:50:22.202321 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 621/1217] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:21 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1472 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:22.220617 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ccdaa81b-5625-49eb-a67a-c21a0693f823 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:22.221701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ccdaa81b-5625-49eb-a67a-c21a0693f823 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 095efcbf-4088-49c1-9cb8-7d6b3f27af88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:22.225117 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8bb48458-f302-4176-a538-ebdc3dfcc48b tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.123251 Oct 29 02:50:22.232993 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 597/1218] 10.222.0.46 () {60 vars in 1195 bytes} [Sat Oct 29 02:50:21 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:22.246005 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-8e4180a8-e46d-4c17-a71e-0be3571edf45 req-6a8b6ca8-0719-43ba-a22e-7ae954bf3fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de40ca11-d29b-4457-ad27-807bfb1acc65", "tag": "fab97166-f957-42ca-8a7d-d580455a03ba"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:22.247565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ccdaa81b-5625-49eb-a67a-c21a0693f823 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:22.248840 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ccdaa81b-5625-49eb-a67a-c21a0693f823 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:22.253194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ccdaa81b-5625-49eb-a67a-c21a0693f823 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:22.254277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ccdaa81b-5625-49eb-a67a-c21a0693f823 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:22.254990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ccdaa81b-5625-49eb-a67a-c21a0693f823 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:22.255676 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ccdaa81b-5625-49eb-a67a-c21a0693f823 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:22.290550 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-ccdaa81b-5625-49eb-a67a-c21a0693f823 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] HTTP exception thrown: Instance 095efcbf-4088-49c1-9cb8-7d6b3f27af88 could not be found. Oct 29 02:50:22.295720 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8e4180a8-e46d-4c17-a71e-0be3571edf45 req-6a8b6ca8-0719-43ba-a22e-7ae954bf3fe4 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:22.298309 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8e4180a8-e46d-4c17-a71e-0be3571edf45 req-6a8b6ca8-0719-43ba-a22e-7ae954bf3fe4 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:22.298766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8e4180a8-e46d-4c17-a71e-0be3571edf45 req-6a8b6ca8-0719-43ba-a22e-7ae954bf3fe4 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:22.305382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ccdaa81b-5625-49eb-a67a-c21a0693f823 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Request method failure captured: Oct 29 02:50:22.305382 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88 HTTP/1.1 Oct 29 02:50:22.305382 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:50:22.305382 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:50:22.305382 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:50:22.305382 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:50:22.305382 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:50:22.305382 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:50:22.305382 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:50:22.305382 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:50:22.305382 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJSGLrxUA0l_U9RD0bxMcuRANQY2pcWkvaC3uKgKmf86ETjckHfL5zo6rqaOSK0vvpP1bIvw2PthIlVQ6Lf0l421arEtGZ1z-vV2jnaC7TT-ZnIV0qdU_cC1sK7PCIpH-JLsNZM6IBzY35ix_U8GYfp5_0ZV_NgvzYsYrfG8EdiLpvE Oct 29 02:50:22.305382 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:50:22.305382 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:50:22.305382 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:50:22.305382 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:50:22.305382 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:50:22.305382 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:50:22.305382 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: fd611070fee0435f8bdda9c3ba5d62fc Oct 29 02:50:22.305382 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1732592755 Oct 29 02:50:22.305382 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:50:22.305382 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:50:22.307781 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fd611070fee0435f8bdda9c3ba5d62fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fd611070fee0435f8bdda9c3ba5d62fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fd611070fee0435f8bdda9c3ba5d62fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fd611070fee0435f8bdda9c3ba5d62fc"}]}] Oct 29 02:50:22.307781 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1732592755 Oct 29 02:50:22.307781 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: fd611070fee0435f8bdda9c3ba5d62fc Oct 29 02:50:22.307781 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1732592755 Oct 29 02:50:22.307781 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-FloatingIPsAssociationTestJSON-1732592755-project Oct 29 02:50:22.307781 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:50:22.307781 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:50:22.307781 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 15a2e59fd0b244eea041651e4d79de9b Oct 29 02:50:22.307781 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1732592755-project Oct 29 02:50:22.307781 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:50:22.307781 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 095efcbf-4088-49c1-9cb8-7d6b3f27af88 could not be found. Oct 29 02:50:22.307781 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '095efcbf-4088-49c1-9cb8-7d6b3f27af88'} Oct 29 02:50:22.309221 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:50:22.309221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:22.309221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:50:22.309221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:50:22.309221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:50:22.309221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:50:22.309221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:50:22.309221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:50:22.309221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:50:22.309221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:50:22.309221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 095efcbf-4088-49c1-9cb8-7d6b3f27af88 could not be found. Oct 29 02:50:22.309221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:50:22.309221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:22.309221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:50:22.309221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:22.309221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:22.309221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:22.309221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:50:22.309221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:50:22.309221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:50:22.312005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:50:22.312005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:50:22.312005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:50:22.312005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:50:22.312005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:50:22.312005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:50:22.312005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:50:22.312005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 095efcbf-4088-49c1-9cb8-7d6b3f27af88 could not be found. Oct 29 02:50:22.312005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:50:22.312005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:22.312005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:50:22.312005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:22.312005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:22.312005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:22.312005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:50:22.312005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:50:22.312005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 095efcbf-4088-49c1-9cb8-7d6b3f27af88 could not be found. Oct 29 02:50:22.312005 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:50:22.329443 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ccdaa81b-5625-49eb-a67a-c21a0693f823 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Returning 404 to user: Instance 095efcbf-4088-49c1-9cb8-7d6b3f27af88 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:50:22.330794 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ccdaa81b-5625-49eb-a67a-c21a0693f823 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88" status: 404 len: 111 microversion: 2.1 time: 0.126727 Oct 29 02:50:22.335467 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 622/1219] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:22 2022] GET /compute/v2.1/servers/095efcbf-4088-49c1-9cb8-7d6b3f27af88 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:50:22.341583 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8e494a75-d95d-41c7-9297-57e293c94259 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:22.343054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8e494a75-d95d-41c7-9297-57e293c94259 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:22.350374 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-8e4180a8-e46d-4c17-a71e-0be3571edf45 req-6a8b6ca8-0719-43ba-a22e-7ae954bf3fe4 service nova] Creating event network-changed:fab97166-f957-42ca-8a7d-d580455a03ba for instance de40ca11-d29b-4457-ad27-807bfb1acc65 on n-h1-862967-2 Oct 29 02:50:22.352716 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:22.355181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8e494a75-d95d-41c7-9297-57e293c94259 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:22.356457 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8e494a75-d95d-41c7-9297-57e293c94259 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:22.357600 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8e494a75-d95d-41c7-9297-57e293c94259 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:22.358772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8e494a75-d95d-41c7-9297-57e293c94259 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:22.359499 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8e494a75-d95d-41c7-9297-57e293c94259 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:22.360313 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8e494a75-d95d-41c7-9297-57e293c94259 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:22.366456 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-8e4180a8-e46d-4c17-a71e-0be3571edf45 req-6a8b6ca8-0719-43ba-a22e-7ae954bf3fe4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129524 Oct 29 02:50:22.367127 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 598/1220] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:22.392944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7e0d88c8-589a-4fdd-abdb-14f6a702d39f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:22.396448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7e0d88c8-589a-4fdd-abdb-14f6a702d39f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:22.405868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e0d88c8-589a-4fdd-abdb-14f6a702d39f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:22.406703 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e0d88c8-589a-4fdd-abdb-14f6a702d39f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:22.407231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e0d88c8-589a-4fdd-abdb-14f6a702d39f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:22.407981 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e0d88c8-589a-4fdd-abdb-14f6a702d39f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:22.414831 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e0d88c8-589a-4fdd-abdb-14f6a702d39f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:22.415560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e0d88c8-589a-4fdd-abdb-14f6a702d39f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:22.871027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7e0d88c8-589a-4fdd-abdb-14f6a702d39f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:22.888912 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7e0d88c8-589a-4fdd-abdb-14f6a702d39f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:22.890851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7e0d88c8-589a-4fdd-abdb-14f6a702d39f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:22.900951 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7e0d88c8-589a-4fdd-abdb-14f6a702d39f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1553 microversion: 2.91 time: 0.512265 Oct 29 02:50:22.909933 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 599/1221] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:22 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1553 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:22.919455 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d82d0359-2c76-418e-bca3-e7267bce46aa tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Action: 'create', calling method: .version_select at 0x7ff053a5f430>, body: {"security_group_rule": {"parent_group_id": "d0d44cbc-8cbe-44ea-9d65-e0625197d6fe", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:23.195695 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-d82d0359-2c76-418e-bca3-e7267bce46aa tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] HTTP exception thrown: This rule already exists in group d0d44cbc-8cbe-44ea-9d65-e0625197d6fe Oct 29 02:50:23.210514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d82d0359-2c76-418e-bca3-e7267bce46aa tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Request method failure captured: Oct 29 02:50:23.210514 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 29 02:50:23.210514 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:50:23.210514 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:50:23.210514 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:50:23.210514 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 138 Oct 29 02:50:23.210514 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:50:23.210514 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:50:23.210514 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:50:23.210514 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:50:23.210514 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJTpMXT6yFGCJiPIXaGTiy55bi8Oh2WAx66bEPWfHBwZ5cbUEZJaFsf3ZjjdBDOCj0b442NcLFkQ16-Gg1pETfsJkhf-MqZ7LrK3jI9SUw8djbn1ngH8_EJXmd7_9Obq7AWhYW0dbNQfYZQdxjrZxw2iqU8xRfOky4OxlqZjrdwR7yc Oct 29 02:50:23.210514 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:50:23.210514 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:50:23.210514 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:50:23.210514 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:50:23.210514 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:50:23.210514 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:50:23.210514 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 4f1389aba6b24aee8650a748f4b14896 Oct 29 02:50:23.210514 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-862964077 Oct 29 02:50:23.210514 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:50:23.210514 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:50:23.211878 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4f1389aba6b24aee8650a748f4b14896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4f1389aba6b24aee8650a748f4b14896"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4f1389aba6b24aee8650a748f4b14896"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4f1389aba6b24aee8650a748f4b14896"}]}] Oct 29 02:50:23.211878 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-862964077 Oct 29 02:50:23.211878 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 4f1389aba6b24aee8650a748f4b14896 Oct 29 02:50:23.211878 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-862964077 Oct 29 02:50:23.211878 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-862964077-project Oct 29 02:50:23.211878 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:50:23.211878 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:50:23.211878 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 9c75a8e3c0ce4847bb01cfdab101d3ac Oct 29 02:50:23.211878 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-862964077-project Oct 29 02:50:23.211878 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:50:23.211878 n-d-862967-2 devstack@n-api.service[127125]: {"security_group_rule": {"parent_group_id": "d0d44cbc-8cbe-44ea-9d65-e0625197d6fe", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 29 02:50:23.211878 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:50:23.212697 n-d-862967-2 devstack@n-api.service[127125]: exception: This rule already exists in group d0d44cbc-8cbe-44ea-9d65-e0625197d6fe Oct 29 02:50:23.212697 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd0d44cbc-8cbe-44ea-9d65-e0625197d6fe', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 29 02:50:23.212697 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:50:23.212697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:23.212697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 29 02:50:23.212697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 29 02:50:23.212697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 29 02:50:23.212697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 29 02:50:23.212697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group d0d44cbc-8cbe-44ea-9d65-e0625197d6fe Oct 29 02:50:23.212697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:23.212697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:23.212697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:23.212697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:23.212697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:23.212697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:23.212697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:50:23.212697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:50:23.212697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:50:23.212697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:50:23.212697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:50:23.213910 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:50:23.213910 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 29 02:50:23.213910 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 02:50:23.213910 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group d0d44cbc-8cbe-44ea-9d65-e0625197d6fe Oct 29 02:50:23.213910 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:23.213910 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:23.213910 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:23.213910 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:23.213910 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:23.213910 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:23.213910 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:50:23.213910 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:50:23.213910 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group d0d44cbc-8cbe-44ea-9d65-e0625197d6fe Oct 29 02:50:23.213910 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:23.213910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d82d0359-2c76-418e-bca3-e7267bce46aa tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Returning 400 to user: This rule already exists in group d0d44cbc-8cbe-44ea-9d65-e0625197d6fe {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:50:23.214825 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d82d0359-2c76-418e-bca3-e7267bce46aa tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.300351 Oct 29 02:50:23.214825 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 600/1222] 10.222.0.46 () {60 vars in 1195 bytes} [Sat Oct 29 02:50:22 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 303 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:50:23.221260 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7f9e533c-cdac-4592-9c85-89120439496e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '.version_select at 0x7ff058741f70>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:23.897603 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8e494a75-d95d-41c7-9297-57e293c94259 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:23.924547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8e494a75-d95d-41c7-9297-57e293c94259 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:23.934059 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8e494a75-d95d-41c7-9297-57e293c94259 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:23.935338 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8e494a75-d95d-41c7-9297-57e293c94259 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1815 microversion: 2.25 time: 1.598480 Oct 29 02:50:23.942635 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 623/1223] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:22 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1815 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:23.974898 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8e7b85c6-30db-4e7b-b077-793d07bd73fb tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Calling method '.version_select at 0x7ff053d87700>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:25.712084 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8e7b85c6-30db-4e7b-b077-793d07bd73fb tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-group-rules/fc4f1e10-8ca1-488a-a4c6-25d5f667b638" status: 202 len: 0 microversion: 2.1 time: 1.766828 Oct 29 02:50:25.717194 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 624/1224] 10.222.0.46 () {58 vars in 1287 bytes} [Sat Oct 29 02:50:23 2022] DELETE /compute/v2.1/os-security-group-rules/fc4f1e10-8ca1-488a-a4c6-25d5f667b638 => generated 0 bytes in 1770 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:50:25.722049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-51166681-554d-4283-bdec-cf5aa047bc0d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:25.731107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-51166681-554d-4283-bdec-cf5aa047bc0d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:25.856975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51166681-554d-4283-bdec-cf5aa047bc0d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:25.856975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51166681-554d-4283-bdec-cf5aa047bc0d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:25.856975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51166681-554d-4283-bdec-cf5aa047bc0d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:25.856975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51166681-554d-4283-bdec-cf5aa047bc0d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:25.857509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51166681-554d-4283-bdec-cf5aa047bc0d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:25.857509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51166681-554d-4283-bdec-cf5aa047bc0d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:25.961460 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7f9e533c-cdac-4592-9c85-89120439496e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/7c004ddb-40e4-485e-9fa5-cc286ecbbb8f" status: 202 len: 0 microversion: 2.1 time: 2.745425 Oct 29 02:50:25.962975 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 601/1225] 10.222.0.46 () {58 vars in 1263 bytes} [Sat Oct 29 02:50:23 2022] DELETE /compute/v2.1/os-floating-ips/7c004ddb-40e4-485e-9fa5-cc286ecbbb8f => generated 0 bytes in 2749 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:50:25.980962 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2890bcdf-8722-4a83-bd2f-b9c1a7dd2dcd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:25.982011 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2890bcdf-8722-4a83-bd2f-b9c1a7dd2dcd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:25.991805 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2890bcdf-8722-4a83-bd2f-b9c1a7dd2dcd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:25.992963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2890bcdf-8722-4a83-bd2f-b9c1a7dd2dcd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:25.993854 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2890bcdf-8722-4a83-bd2f-b9c1a7dd2dcd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:25.995426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2890bcdf-8722-4a83-bd2f-b9c1a7dd2dcd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:25.996254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2890bcdf-8722-4a83-bd2f-b9c1a7dd2dcd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:25.997229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2890bcdf-8722-4a83-bd2f-b9c1a7dd2dcd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:26.099429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2890bcdf-8722-4a83-bd2f-b9c1a7dd2dcd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:26.111242 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2890bcdf-8722-4a83-bd2f-b9c1a7dd2dcd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:26.113550 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2890bcdf-8722-4a83-bd2f-b9c1a7dd2dcd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:26.120872 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2890bcdf-8722-4a83-bd2f-b9c1a7dd2dcd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1553 microversion: 2.91 time: 0.156327 Oct 29 02:50:26.122158 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 602/1226] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:25 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:26.127795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5f5617ef-0c54-4d66-ae0e-1f27a5920785 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:26.128847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5f5617ef-0c54-4d66-ae0e-1f27a5920785 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:26.139795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f5617ef-0c54-4d66-ae0e-1f27a5920785 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:26.140913 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f5617ef-0c54-4d66-ae0e-1f27a5920785 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:26.141539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f5617ef-0c54-4d66-ae0e-1f27a5920785 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:26.142573 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f5617ef-0c54-4d66-ae0e-1f27a5920785 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:26.143387 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f5617ef-0c54-4d66-ae0e-1f27a5920785 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:26.144069 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f5617ef-0c54-4d66-ae0e-1f27a5920785 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:26.490304 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5f5617ef-0c54-4d66-ae0e-1f27a5920785 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:26.513097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5f5617ef-0c54-4d66-ae0e-1f27a5920785 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:26.515956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5f5617ef-0c54-4d66-ae0e-1f27a5920785 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:26.517635 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5f5617ef-0c54-4d66-ae0e-1f27a5920785 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1815 microversion: 2.25 time: 0.393939 Oct 29 02:50:26.538653 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 603/1227] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:26 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1815 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:26.544373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-53c664f4-f449-4196-9d67-5bbe646f3296 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Action: 'create', calling method: .version_select at 0x7ff053a813a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-456353692", "description": "tempest-description-20284889"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:26.654476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-51166681-554d-4283-bdec-cf5aa047bc0d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:26.672327 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-51166681-554d-4283-bdec-cf5aa047bc0d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1472 microversion: 2.1 time: 0.957178 Oct 29 02:50:26.703020 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 625/1228] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:25 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1472 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:26.725003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6da0c58e-48be-42fd-b67a-8eb14e21ed1e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:26.730478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6da0c58e-48be-42fd-b67a-8eb14e21ed1e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:26.764449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6da0c58e-48be-42fd-b67a-8eb14e21ed1e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:26.770959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6da0c58e-48be-42fd-b67a-8eb14e21ed1e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:26.772300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6da0c58e-48be-42fd-b67a-8eb14e21ed1e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:26.774080 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6da0c58e-48be-42fd-b67a-8eb14e21ed1e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:26.780262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6da0c58e-48be-42fd-b67a-8eb14e21ed1e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:26.784769 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6da0c58e-48be-42fd-b67a-8eb14e21ed1e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:26.830268 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-53c664f4-f449-4196-9d67-5bbe646f3296 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 0.290135 Oct 29 02:50:26.831663 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 604/1229] 10.222.0.46 () {60 vars in 1180 bytes} [Sat Oct 29 02:50:26 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:26.845951 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9891befc-9092-4562-9bf2-12dac815b126 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Action: 'create', calling method: .version_select at 0x7ff053d9f310>, body: {"security_group_rule": {"parent_group_id": "341d5816-a5e1-4163-a1e7-f21bf4fff218", "ip_protocol": "tcp", "from_port": 41541674, "to_port": 22}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:26.923926 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6da0c58e-48be-42fd-b67a-8eb14e21ed1e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:50:26.936051 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-9891befc-9092-4562-9bf2-12dac815b126 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] HTTP exception thrown: Invalid port range 41541674:22. Former value cannot be greater than the later Oct 29 02:50:26.939037 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9891befc-9092-4562-9bf2-12dac815b126 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Request method failure captured: Oct 29 02:50:26.939037 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 29 02:50:26.939037 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:50:26.939037 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:50:26.939037 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:50:26.939037 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 144 Oct 29 02:50:26.939037 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:50:26.939037 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:50:26.939037 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:50:26.939037 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:50:26.939037 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJTpMXT6yFGCJiPIXaGTiy55bi8Oh2WAx66bEPWfHBwZ5cbUEZJaFsf3ZjjdBDOCj0b442NcLFkQ16-Gg1pETfsJkhf-MqZ7LrK3jI9SUw8djbn1ngH8_EJXmd7_9Obq7AWhYW0dbNQfYZQdxjrZxw2iqU8xRfOky4OxlqZjrdwR7yc Oct 29 02:50:26.939037 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:50:26.939037 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:50:26.939037 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:50:26.939037 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:50:26.939037 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:50:26.939037 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:50:26.939037 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 4f1389aba6b24aee8650a748f4b14896 Oct 29 02:50:26.939037 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-862964077 Oct 29 02:50:26.939037 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:50:26.939037 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:50:26.940843 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4f1389aba6b24aee8650a748f4b14896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4f1389aba6b24aee8650a748f4b14896"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4f1389aba6b24aee8650a748f4b14896"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4f1389aba6b24aee8650a748f4b14896"}]}] Oct 29 02:50:26.940843 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-862964077 Oct 29 02:50:26.940843 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 4f1389aba6b24aee8650a748f4b14896 Oct 29 02:50:26.940843 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-862964077 Oct 29 02:50:26.940843 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-862964077-project Oct 29 02:50:26.940843 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:50:26.940843 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:50:26.940843 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 9c75a8e3c0ce4847bb01cfdab101d3ac Oct 29 02:50:26.940843 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-862964077-project Oct 29 02:50:26.940843 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:50:26.940843 n-d-862967-2 devstack@n-api.service[127125]: {"security_group_rule": {"parent_group_id": "341d5816-a5e1-4163-a1e7-f21bf4fff218", "ip_protocol": "tcp", "from_port": 41541674, "to_port": 22}} Oct 29 02:50:26.940843 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:50:26.942078 n-d-862967-2 devstack@n-api.service[127125]: exception: Invalid port range 41541674:22. Former value cannot be greater than the later Oct 29 02:50:26.942078 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'body': {'security_group_rule': {'parent_group_id': '341d5816-a5e1-4163-a1e7-f21bf4fff218', 'ip_protocol': 'tcp', 'from_port': 41541674, 'to_port': 22}}} Oct 29 02:50:26.942078 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:50:26.942078 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:26.942078 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 29 02:50:26.942078 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 29 02:50:26.942078 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 29 02:50:26.942078 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 29 02:50:26.942078 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 29 02:50:26.942078 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 29 02:50:26.942078 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 29 02:50:26.942078 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 29 02:50:26.942078 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 41541674:22. Former value cannot be greater than the later Oct 29 02:50:26.942078 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:26.942078 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:26.942078 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:26.942078 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:26.942078 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:26.942078 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:26.943518 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:50:26.943518 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:50:26.943518 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:50:26.943518 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:50:26.943518 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:50:26.943518 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:50:26.943518 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 29 02:50:26.943518 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 02:50:26.943518 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 41541674:22. Former value cannot be greater than the later Oct 29 02:50:26.943518 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:26.943518 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:26.943518 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:26.943518 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:26.943518 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:26.943518 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:26.943518 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:50:26.943518 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:50:26.943518 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 41541674:22. Former value cannot be greater than the later Oct 29 02:50:26.943518 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:26.944666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9891befc-9092-4562-9bf2-12dac815b126 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Returning 400 to user: Invalid port range 41541674:22. Former value cannot be greater than the later {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:50:26.944666 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9891befc-9092-4562-9bf2-12dac815b126 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 121 microversion: 2.1 time: 0.099653 Oct 29 02:50:26.944666 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 605/1230] 10.222.0.46 () {60 vars in 1195 bytes} [Sat Oct 29 02:50:26 2022] POST /compute/v2.1/os-security-group-rules => generated 121 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:50:26.970040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f3a8db19-0841-46c5-8c12-30f08e344417 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Action: 'create', calling method: .version_select at 0x7ff053ef21f0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-480144717", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:26.974054 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-f3a8db19-0841-46c5-8c12-30f08e344417 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] HTTP exception thrown: Security group id should be uuid Oct 29 02:50:26.980766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f3a8db19-0841-46c5-8c12-30f08e344417 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Request method failure captured: Oct 29 02:50:26.980766 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 29 02:50:26.980766 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:50:26.980766 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:50:26.980766 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:50:26.980766 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 130 Oct 29 02:50:26.980766 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:50:26.980766 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:50:26.980766 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:50:26.980766 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:50:26.980766 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJTpMXT6yFGCJiPIXaGTiy55bi8Oh2WAx66bEPWfHBwZ5cbUEZJaFsf3ZjjdBDOCj0b442NcLFkQ16-Gg1pETfsJkhf-MqZ7LrK3jI9SUw8djbn1ngH8_EJXmd7_9Obq7AWhYW0dbNQfYZQdxjrZxw2iqU8xRfOky4OxlqZjrdwR7yc Oct 29 02:50:26.980766 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:50:26.980766 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:50:26.980766 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:50:26.980766 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:50:26.980766 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:50:26.980766 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:50:26.980766 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 4f1389aba6b24aee8650a748f4b14896 Oct 29 02:50:26.980766 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-862964077 Oct 29 02:50:26.980766 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:50:26.980766 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:50:26.985476 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4f1389aba6b24aee8650a748f4b14896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4f1389aba6b24aee8650a748f4b14896"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4f1389aba6b24aee8650a748f4b14896"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4f1389aba6b24aee8650a748f4b14896"}]}] Oct 29 02:50:26.985476 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-862964077 Oct 29 02:50:26.985476 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 4f1389aba6b24aee8650a748f4b14896 Oct 29 02:50:26.985476 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-862964077 Oct 29 02:50:26.985476 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-862964077-project Oct 29 02:50:26.985476 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:50:26.985476 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:50:26.985476 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 9c75a8e3c0ce4847bb01cfdab101d3ac Oct 29 02:50:26.985476 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-862964077-project Oct 29 02:50:26.985476 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:50:26.985476 n-d-862967-2 devstack@n-api.service[127125]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-480144717", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 29 02:50:26.985476 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:50:26.985476 n-d-862967-2 devstack@n-api.service[127125]: exception: Security group id should be uuid Oct 29 02:50:26.986528 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-480144717', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 29 02:50:26.986528 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:50:26.986528 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:26.986528 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 29 02:50:26.986528 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 29 02:50:26.986528 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 29 02:50:26.986528 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 29 02:50:26.986528 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 29 02:50:26.986528 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:26.986528 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:26.986528 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:26.986528 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:26.986528 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:26.986528 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:26.986528 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:50:26.986528 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:50:26.986528 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:50:26.986528 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:50:26.986528 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:50:26.986528 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:50:26.987947 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 29 02:50:26.987947 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 02:50:26.987947 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 29 02:50:26.987947 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:26.987947 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:26.987947 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:26.987947 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:26.987947 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:26.987947 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:26.987947 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:50:26.987947 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:50:26.987947 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 29 02:50:26.987947 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:26.991043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f3a8db19-0841-46c5-8c12-30f08e344417 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Returning 400 to user: Security group id should be uuid {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:50:26.992095 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f3a8db19-0841-46c5-8c12-30f08e344417 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.043318 Oct 29 02:50:26.997352 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 606/1231] 10.222.0.46 () {60 vars in 1195 bytes} [Sat Oct 29 02:50:26 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 02:50:27.006524 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fa6fea9d-cd3c-4eef-bacf-a54fe28633ac tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Action: 'create', calling method: .version_select at 0x7ff0588c4280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-460922138", "description": "tempest-description-1034605986"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:27.143286 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6da0c58e-48be-42fd-b67a-8eb14e21ed1e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a" status: 204 len: 0 microversion: 2.1 time: 0.436473 Oct 29 02:50:27.144145 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 626/1232] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:50:26 2022] DELETE /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:50:27.165116 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-edadc331-3a3e-4263-a0e7-350d4ebbba72 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:27.166066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-edadc331-3a3e-4263-a0e7-350d4ebbba72 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:27.188766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-edadc331-3a3e-4263-a0e7-350d4ebbba72 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:27.193130 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-edadc331-3a3e-4263-a0e7-350d4ebbba72 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:27.193606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-edadc331-3a3e-4263-a0e7-350d4ebbba72 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:27.194535 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-edadc331-3a3e-4263-a0e7-350d4ebbba72 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:27.195157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-edadc331-3a3e-4263-a0e7-350d4ebbba72 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:27.195738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-edadc331-3a3e-4263-a0e7-350d4ebbba72 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:27.593481 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-edadc331-3a3e-4263-a0e7-350d4ebbba72 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:27.602756 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-edadc331-3a3e-4263-a0e7-350d4ebbba72 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a" status: 200 len: 1525 microversion: 2.1 time: 0.448470 Oct 29 02:50:27.612836 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 627/1233] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:27 2022] GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a => generated 1525 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:27.620644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bd2d714c-e9d3-49f5-958f-9697378eac44 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:27.621289 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bd2d714c-e9d3-49f5-958f-9697378eac44 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:27.637635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd2d714c-e9d3-49f5-958f-9697378eac44 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:27.638388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd2d714c-e9d3-49f5-958f-9697378eac44 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:27.639161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd2d714c-e9d3-49f5-958f-9697378eac44 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:27.640424 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd2d714c-e9d3-49f5-958f-9697378eac44 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:27.641096 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd2d714c-e9d3-49f5-958f-9697378eac44 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:27.641532 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd2d714c-e9d3-49f5-958f-9697378eac44 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:27.808019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bd2d714c-e9d3-49f5-958f-9697378eac44 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:27.821731 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bd2d714c-e9d3-49f5-958f-9697378eac44 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:27.823804 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bd2d714c-e9d3-49f5-958f-9697378eac44 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:27.831518 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bd2d714c-e9d3-49f5-958f-9697378eac44 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1553 microversion: 2.91 time: 0.221639 Oct 29 02:50:27.832116 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 628/1234] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:27 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1553 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:27.843395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-38406bd3-3154-4429-92c7-ac1f818606de tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:27.844931 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-38406bd3-3154-4429-92c7-ac1f818606de tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:27.856895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38406bd3-3154-4429-92c7-ac1f818606de tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:27.858333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38406bd3-3154-4429-92c7-ac1f818606de tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:27.859401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38406bd3-3154-4429-92c7-ac1f818606de tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:27.860977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38406bd3-3154-4429-92c7-ac1f818606de tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:27.862430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38406bd3-3154-4429-92c7-ac1f818606de tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:27.863745 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38406bd3-3154-4429-92c7-ac1f818606de tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:28.154594 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fa6fea9d-cd3c-4eef-bacf-a54fe28633ac tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.154582 Oct 29 02:50:28.156096 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 607/1235] 10.222.0.46 () {60 vars in 1180 bytes} [Sat Oct 29 02:50:26 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:28.168112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-38406bd3-3154-4429-92c7-ac1f818606de tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:28.172433 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3e79a357-7043-44a1-8f6a-96a77affc198 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:28.184297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-38406bd3-3154-4429-92c7-ac1f818606de tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:28.186411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-38406bd3-3154-4429-92c7-ac1f818606de tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:28.190383 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-38406bd3-3154-4429-92c7-ac1f818606de tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1815 microversion: 2.25 time: 0.356788 Oct 29 02:50:28.192047 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 629/1236] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:27 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1815 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:28.196555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3e79a357-7043-44a1-8f6a-96a77affc198 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:28.204095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-058fdaf7-308f-49d1-9a13-0e74754dfbb3 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Action: 'create', calling method: .version_select at 0x7ff053d720d0>, body: {"security_group_rule": {"parent_group_id": "bbbe8e34-feba-4e51-b813-98a1aa44da93", "ip_protocol": "tempest-999-1747812550", "from_port": 22, "to_port": 22}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:28.230179 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e79a357-7043-44a1-8f6a-96a77affc198 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:28.231491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e79a357-7043-44a1-8f6a-96a77affc198 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:28.233626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e79a357-7043-44a1-8f6a-96a77affc198 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:28.237241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e79a357-7043-44a1-8f6a-96a77affc198 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:28.242011 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e79a357-7043-44a1-8f6a-96a77affc198 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:28.243624 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e79a357-7043-44a1-8f6a-96a77affc198 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:28.305866 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-058fdaf7-308f-49d1-9a13-0e74754dfbb3 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] HTTP exception thrown: Invalid IP protocol tempest-999-1747812550. Oct 29 02:50:28.308213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-058fdaf7-308f-49d1-9a13-0e74754dfbb3 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Request method failure captured: Oct 29 02:50:28.308213 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 29 02:50:28.308213 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:50:28.308213 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:50:28.308213 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:50:28.308213 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 157 Oct 29 02:50:28.308213 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:50:28.308213 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:50:28.308213 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:50:28.308213 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:50:28.308213 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJTpMXT6yFGCJiPIXaGTiy55bi8Oh2WAx66bEPWfHBwZ5cbUEZJaFsf3ZjjdBDOCj0b442NcLFkQ16-Gg1pETfsJkhf-MqZ7LrK3jI9SUw8djbn1ngH8_EJXmd7_9Obq7AWhYW0dbNQfYZQdxjrZxw2iqU8xRfOky4OxlqZjrdwR7yc Oct 29 02:50:28.308213 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:50:28.308213 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:50:28.308213 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:50:28.308213 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:50:28.308213 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:50:28.308213 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:50:28.308213 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 4f1389aba6b24aee8650a748f4b14896 Oct 29 02:50:28.308213 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-862964077 Oct 29 02:50:28.308213 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:50:28.308213 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:50:28.310656 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4f1389aba6b24aee8650a748f4b14896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4f1389aba6b24aee8650a748f4b14896"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4f1389aba6b24aee8650a748f4b14896"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4f1389aba6b24aee8650a748f4b14896"}]}] Oct 29 02:50:28.310656 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-862964077 Oct 29 02:50:28.310656 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 4f1389aba6b24aee8650a748f4b14896 Oct 29 02:50:28.310656 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-862964077 Oct 29 02:50:28.310656 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-862964077-project Oct 29 02:50:28.310656 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:50:28.310656 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:50:28.310656 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 9c75a8e3c0ce4847bb01cfdab101d3ac Oct 29 02:50:28.310656 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-862964077-project Oct 29 02:50:28.310656 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:50:28.310656 n-d-862967-2 devstack@n-api.service[127124]: {"security_group_rule": {"parent_group_id": "bbbe8e34-feba-4e51-b813-98a1aa44da93", "ip_protocol": "tempest-999-1747812550", "from_port": 22, "to_port": 22}} Oct 29 02:50:28.310656 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:50:28.311519 n-d-862967-2 devstack@n-api.service[127124]: exception: Invalid IP protocol tempest-999-1747812550. Oct 29 02:50:28.311519 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'bbbe8e34-feba-4e51-b813-98a1aa44da93', 'ip_protocol': 'tempest-999-1747812550', 'from_port': 22, 'to_port': 22}}} Oct 29 02:50:28.311519 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:50:28.311519 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:28.311519 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 29 02:50:28.311519 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 29 02:50:28.311519 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 29 02:50:28.311519 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 29 02:50:28.311519 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 29 02:50:28.311519 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 29 02:50:28.311519 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 29 02:50:28.311519 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 29 02:50:28.311519 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1747812550. Oct 29 02:50:28.311519 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:50:28.311519 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:28.311519 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:50:28.311519 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:28.311519 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:28.311519 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:28.312854 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:50:28.312854 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:50:28.312854 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:50:28.312854 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:50:28.312854 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:50:28.312854 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:50:28.312854 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 29 02:50:28.312854 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 02:50:28.312854 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1747812550. Oct 29 02:50:28.312854 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:50:28.312854 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:28.312854 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:50:28.312854 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:28.312854 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:28.312854 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:28.312854 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:50:28.312854 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:50:28.312854 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1747812550. Oct 29 02:50:28.312854 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:50:28.314306 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-058fdaf7-308f-49d1-9a13-0e74754dfbb3 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Returning 400 to user: Invalid IP protocol tempest-999-1747812550. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:50:28.314306 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-058fdaf7-308f-49d1-9a13-0e74754dfbb3 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.115868 Oct 29 02:50:28.314306 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 630/1237] 10.222.0.46 () {60 vars in 1195 bytes} [Sat Oct 29 02:50:28 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 117 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 02:50:28.319802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-434253a2-cc76-45c7-830a-3fb6ce167013 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Action: 'create', calling method: .version_select at 0x7ff053d42790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1335893582", "description": "tempest-description-1490615161"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:28.933237 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3e79a357-7043-44a1-8f6a-96a77affc198 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:28.968008 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3e79a357-7043-44a1-8f6a-96a77affc198 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1472 microversion: 2.1 time: 0.805251 Oct 29 02:50:28.971744 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 608/1238] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:28 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1472 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:28.985477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-41050159-0601-469f-9001-29526b2308dc tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:28.988576 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-41050159-0601-469f-9001-29526b2308dc tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:29.017003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=79 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:29.020031 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41050159-0601-469f-9001-29526b2308dc tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:29.022231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41050159-0601-469f-9001-29526b2308dc tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:29.023768 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41050159-0601-469f-9001-29526b2308dc tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:29.025362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41050159-0601-469f-9001-29526b2308dc tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:29.026731 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41050159-0601-469f-9001-29526b2308dc tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:29.033794 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41050159-0601-469f-9001-29526b2308dc tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:29.154223 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-434253a2-cc76-45c7-830a-3fb6ce167013 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.838102 Oct 29 02:50:29.165385 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 631/1239] 10.222.0.46 () {60 vars in 1180 bytes} [Sat Oct 29 02:50:28 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:29.175886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bf073353-82c6-4d9b-9089-a501313a3620 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:29.182162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bf073353-82c6-4d9b-9089-a501313a3620 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:29.199831 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf073353-82c6-4d9b-9089-a501313a3620 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:29.203335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf073353-82c6-4d9b-9089-a501313a3620 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:29.204658 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf073353-82c6-4d9b-9089-a501313a3620 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:29.205779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf073353-82c6-4d9b-9089-a501313a3620 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:29.207423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf073353-82c6-4d9b-9089-a501313a3620 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:29.208938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf073353-82c6-4d9b-9089-a501313a3620 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:29.340460 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bf073353-82c6-4d9b-9089-a501313a3620 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:29.357505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bf073353-82c6-4d9b-9089-a501313a3620 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:29.361038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bf073353-82c6-4d9b-9089-a501313a3620 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:29.372716 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bf073353-82c6-4d9b-9089-a501313a3620 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1553 microversion: 2.91 time: 0.205088 Oct 29 02:50:29.373407 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 632/1240] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:29 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1553 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:29.408752 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f8f918bb-c85e-41b6-938c-2a20fad6beed tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Action: 'create', calling method: .version_select at 0x7ff053d42310>, body: {"security_group_rule": {"parent_group_id": "076bca0c-b4d0-4dd6-9081-1cc2a264bdb9", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:29.595545 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-41050159-0601-469f-9001-29526b2308dc tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:29.618220 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-41050159-0601-469f-9001-29526b2308dc tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a" status: 200 len: 1525 microversion: 2.1 time: 0.644379 Oct 29 02:50:29.623295 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 609/1241] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:28 2022] GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a => generated 1525 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:29.629832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f5e436af-c10c-470f-beaa-865f9fdbf8b6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:29.636878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f5e436af-c10c-470f-beaa-865f9fdbf8b6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:29.664391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5e436af-c10c-470f-beaa-865f9fdbf8b6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:29.665430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5e436af-c10c-470f-beaa-865f9fdbf8b6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:29.666108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5e436af-c10c-470f-beaa-865f9fdbf8b6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:29.667122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5e436af-c10c-470f-beaa-865f9fdbf8b6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:29.667837 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5e436af-c10c-470f-beaa-865f9fdbf8b6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:29.668746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5e436af-c10c-470f-beaa-865f9fdbf8b6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:30.169584 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-f8f918bb-c85e-41b6-938c-2a20fad6beed tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 29 02:50:30.171799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f8f918bb-c85e-41b6-938c-2a20fad6beed tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Request method failure captured: Oct 29 02:50:30.171799 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 29 02:50:30.171799 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:50:30.171799 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:50:30.171799 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:50:30.171799 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 138 Oct 29 02:50:30.171799 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:50:30.171799 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:50:30.171799 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:50:30.171799 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:50:30.171799 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJTpMXT6yFGCJiPIXaGTiy55bi8Oh2WAx66bEPWfHBwZ5cbUEZJaFsf3ZjjdBDOCj0b442NcLFkQ16-Gg1pETfsJkhf-MqZ7LrK3jI9SUw8djbn1ngH8_EJXmd7_9Obq7AWhYW0dbNQfYZQdxjrZxw2iqU8xRfOky4OxlqZjrdwR7yc Oct 29 02:50:30.171799 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:50:30.171799 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:50:30.171799 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:50:30.171799 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:50:30.171799 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:50:30.171799 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:50:30.171799 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 4f1389aba6b24aee8650a748f4b14896 Oct 29 02:50:30.171799 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-862964077 Oct 29 02:50:30.171799 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:50:30.171799 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:50:30.173352 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4f1389aba6b24aee8650a748f4b14896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4f1389aba6b24aee8650a748f4b14896"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4f1389aba6b24aee8650a748f4b14896"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4f1389aba6b24aee8650a748f4b14896"}]}] Oct 29 02:50:30.173352 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-862964077 Oct 29 02:50:30.173352 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 4f1389aba6b24aee8650a748f4b14896 Oct 29 02:50:30.173352 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-862964077 Oct 29 02:50:30.173352 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-862964077-project Oct 29 02:50:30.173352 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:50:30.173352 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:50:30.173352 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 9c75a8e3c0ce4847bb01cfdab101d3ac Oct 29 02:50:30.173352 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-862964077-project Oct 29 02:50:30.173352 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:50:30.173352 n-d-862967-2 devstack@n-api.service[127124]: {"security_group_rule": {"parent_group_id": "076bca0c-b4d0-4dd6-9081-1cc2a264bdb9", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 29 02:50:30.173352 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:50:30.174272 n-d-862967-2 devstack@n-api.service[127124]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 29 02:50:30.174272 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'body': {'security_group_rule': {'parent_group_id': '076bca0c-b4d0-4dd6-9081-1cc2a264bdb9', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 29 02:50:30.174272 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:50:30.174272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:30.174272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 29 02:50:30.174272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 29 02:50:30.174272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 29 02:50:30.174272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 29 02:50:30.174272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 29 02:50:30.174272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 29 02:50:30.174272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 29 02:50:30.174272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 29 02:50:30.174272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 29 02:50:30.174272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:50:30.174272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:30.174272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:50:30.174272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:30.174272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:30.174272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:30.175438 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:50:30.175438 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:50:30.175438 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:50:30.175438 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:50:30.175438 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:50:30.175438 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:50:30.175438 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 29 02:50:30.175438 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 02:50:30.175438 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 29 02:50:30.175438 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:50:30.175438 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:30.175438 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:50:30.175438 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:30.175438 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:30.175438 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:30.175438 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:50:30.175438 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:50:30.175438 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 29 02:50:30.175438 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:50:30.178196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f8f918bb-c85e-41b6-938c-2a20fad6beed tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:50:30.179274 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f8f918bb-c85e-41b6-938c-2a20fad6beed tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.779665 Oct 29 02:50:30.180095 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 633/1242] 10.222.0.46 () {60 vars in 1195 bytes} [Sat Oct 29 02:50:29 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 806 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:50:30.191886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-724e0256-f8d3-4d1e-9744-a5021d7f0e2c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:30.192929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-724e0256-f8d3-4d1e-9744-a5021d7f0e2c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:30.210400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f5e436af-c10c-470f-beaa-865f9fdbf8b6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:30.215697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-724e0256-f8d3-4d1e-9744-a5021d7f0e2c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:30.221800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-724e0256-f8d3-4d1e-9744-a5021d7f0e2c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:30.222538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-724e0256-f8d3-4d1e-9744-a5021d7f0e2c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:30.223531 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-724e0256-f8d3-4d1e-9744-a5021d7f0e2c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:30.224175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-724e0256-f8d3-4d1e-9744-a5021d7f0e2c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:30.224807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-724e0256-f8d3-4d1e-9744-a5021d7f0e2c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:30.226156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f5e436af-c10c-470f-beaa-865f9fdbf8b6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:30.232863 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f5e436af-c10c-470f-beaa-865f9fdbf8b6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:30.235296 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f5e436af-c10c-470f-beaa-865f9fdbf8b6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1815 microversion: 2.25 time: 0.610209 Oct 29 02:50:30.238638 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 610/1243] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:29 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1815 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:30.252162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5da6a1e7-5551-42ed-8a8c-1964f9686211 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Action: 'create', calling method: .version_select at 0x7ff053a131f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1311519515", "description": "tempest-description-2137244271"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:30.614875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-724e0256-f8d3-4d1e-9744-a5021d7f0e2c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:30.626157 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-724e0256-f8d3-4d1e-9744-a5021d7f0e2c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1478 microversion: 2.1 time: 0.444606 Oct 29 02:50:30.644874 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 634/1244] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:30 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1478 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:30.663664 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0a4b8f1b-fbe2-4cac-a443-50f3b30fe46b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:30.664421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0a4b8f1b-fbe2-4cac-a443-50f3b30fe46b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:30.677279 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0a4b8f1b-fbe2-4cac-a443-50f3b30fe46b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:30.677482 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0a4b8f1b-fbe2-4cac-a443-50f3b30fe46b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:30.678167 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0a4b8f1b-fbe2-4cac-a443-50f3b30fe46b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:30.681452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0a4b8f1b-fbe2-4cac-a443-50f3b30fe46b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:30.682015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0a4b8f1b-fbe2-4cac-a443-50f3b30fe46b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:30.685331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0a4b8f1b-fbe2-4cac-a443-50f3b30fe46b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:30.877231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0a4b8f1b-fbe2-4cac-a443-50f3b30fe46b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:30.891863 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0a4b8f1b-fbe2-4cac-a443-50f3b30fe46b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:30.900399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0a4b8f1b-fbe2-4cac-a443-50f3b30fe46b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:30.939391 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0a4b8f1b-fbe2-4cac-a443-50f3b30fe46b tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1553 microversion: 2.91 time: 0.293161 Oct 29 02:50:30.944720 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 635/1245] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:30 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1553 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:30.955834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cce54db7-5030-4c61-beb2-8d50ec02737e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:30.961377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cce54db7-5030-4c61-beb2-8d50ec02737e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:30.962989 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5da6a1e7-5551-42ed-8a8c-1964f9686211 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.723006 Oct 29 02:50:30.972507 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 611/1246] 10.222.0.46 () {60 vars in 1180 bytes} [Sat Oct 29 02:50:30 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:30.977664 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-af0c23d4-4a88-4d79-bc96-c75d249a0648 req-ed611ac6-5156-4443-987d-a1e3b37db5d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403f0ce5-3db7-4b5b-b809-9a5f4280b685", "name": "network-vif-unplugged", "status": "completed", "tag": "a71c4667-d218-4c4c-bab3-ff8606f16efe"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:30.992906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cce54db7-5030-4c61-beb2-8d50ec02737e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:30.994354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cce54db7-5030-4c61-beb2-8d50ec02737e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:31.001131 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cce54db7-5030-4c61-beb2-8d50ec02737e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:31.002079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cce54db7-5030-4c61-beb2-8d50ec02737e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:31.002699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cce54db7-5030-4c61-beb2-8d50ec02737e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:31.003237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cce54db7-5030-4c61-beb2-8d50ec02737e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:31.041687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-af0c23d4-4a88-4d79-bc96-c75d249a0648 req-ed611ac6-5156-4443-987d-a1e3b37db5d3 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:31.042209 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-af0c23d4-4a88-4d79-bc96-c75d249a0648 req-ed611ac6-5156-4443-987d-a1e3b37db5d3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:31.046712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-af0c23d4-4a88-4d79-bc96-c75d249a0648 req-ed611ac6-5156-4443-987d-a1e3b37db5d3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:31.104150 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-af0c23d4-4a88-4d79-bc96-c75d249a0648 req-ed611ac6-5156-4443-987d-a1e3b37db5d3 service nova] Creating event network-vif-unplugged:a71c4667-d218-4c4c-bab3-ff8606f16efe for instance 403f0ce5-3db7-4b5b-b809-9a5f4280b685 on n-h1-862967-2 Oct 29 02:50:31.128908 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-af0c23d4-4a88-4d79-bc96-c75d249a0648 req-ed611ac6-5156-4443-987d-a1e3b37db5d3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.150733 Oct 29 02:50:31.132874 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 612/1247] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:31.151608 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7e11b569-2c57-45fa-a84f-540f14979b4a tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Action: 'create', calling method: .version_select at 0x7ff053e52c10>, body: {"security_group_rule": {"parent_group_id": "5db2113b-7cb0-444f-a3c7-c4cc2de99f64", "ip_protocol": "tcp", "from_port": 22, "to_port": 1766612678}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:31.363657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cce54db7-5030-4c61-beb2-8d50ec02737e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:31.376879 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cce54db7-5030-4c61-beb2-8d50ec02737e tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a" status: 200 len: 1483 microversion: 2.1 time: 0.429446 Oct 29 02:50:31.380145 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 636/1248] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:30 2022] GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a => generated 1483 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:31.394681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c60193f5-4fee-4665-9c27-8d7f7e7e524c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:31.396059 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c60193f5-4fee-4665-9c27-8d7f7e7e524c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:31.429114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c60193f5-4fee-4665-9c27-8d7f7e7e524c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:31.429716 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c60193f5-4fee-4665-9c27-8d7f7e7e524c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:31.430259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c60193f5-4fee-4665-9c27-8d7f7e7e524c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:31.431118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c60193f5-4fee-4665-9c27-8d7f7e7e524c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:31.431693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c60193f5-4fee-4665-9c27-8d7f7e7e524c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:31.432227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c60193f5-4fee-4665-9c27-8d7f7e7e524c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:31.721579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c60193f5-4fee-4665-9c27-8d7f7e7e524c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:31.733354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c60193f5-4fee-4665-9c27-8d7f7e7e524c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:31.734967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c60193f5-4fee-4665-9c27-8d7f7e7e524c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:31.736328 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c60193f5-4fee-4665-9c27-8d7f7e7e524c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1805 microversion: 2.25 time: 0.352570 Oct 29 02:50:31.737479 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 637/1249] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:31 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1805 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:31.742986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-a1f6c82b-9246-4ff7-8f1d-2c3cea3b63c8 req-c8014a48-e4c1-4757-acbb-666622d468f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3380e407-b7cb-4775-b5ed-17ef51c3764a", "name": "network-vif-deleted", "tag": "d045507b-53ea-4e4f-9def-029bda6114ff"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:31.754878 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a1f6c82b-9246-4ff7-8f1d-2c3cea3b63c8 req-c8014a48-e4c1-4757-acbb-666622d468f8 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:31.755535 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a1f6c82b-9246-4ff7-8f1d-2c3cea3b63c8 req-c8014a48-e4c1-4757-acbb-666622d468f8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:31.756009 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a1f6c82b-9246-4ff7-8f1d-2c3cea3b63c8 req-c8014a48-e4c1-4757-acbb-666622d468f8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:31.773647 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-a1f6c82b-9246-4ff7-8f1d-2c3cea3b63c8 req-c8014a48-e4c1-4757-acbb-666622d468f8 service nova] Creating event network-vif-deleted:d045507b-53ea-4e4f-9def-029bda6114ff for instance 3380e407-b7cb-4775-b5ed-17ef51c3764a on n-h1-862967-2 Oct 29 02:50:31.780114 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-a1f6c82b-9246-4ff7-8f1d-2c3cea3b63c8 req-c8014a48-e4c1-4757-acbb-666622d468f8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039782 Oct 29 02:50:31.786526 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 638/1250] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:31.798672 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9759e351-99f2-4954-91de-e3acde89b734 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:31.800381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9759e351-99f2-4954-91de-e3acde89b734 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:31.809930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9759e351-99f2-4954-91de-e3acde89b734 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:31.811697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9759e351-99f2-4954-91de-e3acde89b734 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:31.812502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9759e351-99f2-4954-91de-e3acde89b734 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:31.814023 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9759e351-99f2-4954-91de-e3acde89b734 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:31.814910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9759e351-99f2-4954-91de-e3acde89b734 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:31.815687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9759e351-99f2-4954-91de-e3acde89b734 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:31.827606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:31.967050 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-7e11b569-2c57-45fa-a84f-540f14979b4a tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] HTTP exception thrown: Invalid port range 22:1766612678. Valid TCP ports should be between 1-65535 Oct 29 02:50:31.968829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7e11b569-2c57-45fa-a84f-540f14979b4a tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Request method failure captured: Oct 29 02:50:31.968829 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 29 02:50:31.968829 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:50:31.968829 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:50:31.968829 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:50:31.968829 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 146 Oct 29 02:50:31.968829 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:50:31.968829 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:50:31.968829 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:50:31.968829 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:50:31.968829 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJTpMXT6yFGCJiPIXaGTiy55bi8Oh2WAx66bEPWfHBwZ5cbUEZJaFsf3ZjjdBDOCj0b442NcLFkQ16-Gg1pETfsJkhf-MqZ7LrK3jI9SUw8djbn1ngH8_EJXmd7_9Obq7AWhYW0dbNQfYZQdxjrZxw2iqU8xRfOky4OxlqZjrdwR7yc Oct 29 02:50:31.968829 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:50:31.968829 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:50:31.968829 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:50:31.968829 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:50:31.968829 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:50:31.968829 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:50:31.968829 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 4f1389aba6b24aee8650a748f4b14896 Oct 29 02:50:31.968829 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-862964077 Oct 29 02:50:31.968829 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:50:31.968829 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:50:31.970530 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4f1389aba6b24aee8650a748f4b14896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4f1389aba6b24aee8650a748f4b14896"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4f1389aba6b24aee8650a748f4b14896"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4f1389aba6b24aee8650a748f4b14896"}]}] Oct 29 02:50:31.970530 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-862964077 Oct 29 02:50:31.970530 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 4f1389aba6b24aee8650a748f4b14896 Oct 29 02:50:31.970530 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-862964077 Oct 29 02:50:31.970530 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-862964077-project Oct 29 02:50:31.970530 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:50:31.970530 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:50:31.970530 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 9c75a8e3c0ce4847bb01cfdab101d3ac Oct 29 02:50:31.970530 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-862964077-project Oct 29 02:50:31.970530 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:50:31.970530 n-d-862967-2 devstack@n-api.service[127125]: {"security_group_rule": {"parent_group_id": "5db2113b-7cb0-444f-a3c7-c4cc2de99f64", "ip_protocol": "tcp", "from_port": 22, "to_port": 1766612678}} Oct 29 02:50:31.970530 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:50:31.971463 n-d-862967-2 devstack@n-api.service[127125]: exception: Invalid port range 22:1766612678. Valid TCP ports should be between 1-65535 Oct 29 02:50:31.971463 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5db2113b-7cb0-444f-a3c7-c4cc2de99f64', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1766612678}}} Oct 29 02:50:31.971463 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:50:31.971463 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:31.971463 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 29 02:50:31.971463 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 29 02:50:31.971463 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 29 02:50:31.971463 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 29 02:50:31.971463 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 29 02:50:31.971463 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 29 02:50:31.971463 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 29 02:50:31.971463 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 29 02:50:31.971463 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1766612678. Valid TCP ports should be between 1-65535 Oct 29 02:50:31.971463 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:31.971463 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:31.971463 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:31.971463 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:31.971463 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:31.971463 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:31.972912 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:50:31.972912 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:50:31.972912 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:50:31.972912 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:50:31.972912 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:50:31.972912 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:50:31.972912 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 29 02:50:31.972912 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 02:50:31.972912 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1766612678. Valid TCP ports should be between 1-65535 Oct 29 02:50:31.972912 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:31.972912 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:31.972912 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:31.972912 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:31.972912 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:31.972912 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:31.972912 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:50:31.972912 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:50:31.972912 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1766612678. Valid TCP ports should be between 1-65535 Oct 29 02:50:31.972912 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:31.976361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7e11b569-2c57-45fa-a84f-540f14979b4a tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Returning 400 to user: Invalid port range 22:1766612678. Valid TCP ports should be between 1-65535 {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:50:31.977638 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7e11b569-2c57-45fa-a84f-540f14979b4a tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.843581 Oct 29 02:50:31.978754 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 613/1251] 10.222.0.46 () {60 vars in 1195 bytes} [Sat Oct 29 02:50:31 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 845 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:50:31.989249 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ae13e7e5-e736-4ad0-bcaa-a008ac14760e tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Calling method '.version_select at 0x7ff053a6bdc0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:31.993898 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae13e7e5-e736-4ad0-bcaa-a008ac14760e tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:31.996746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae13e7e5-e736-4ad0-bcaa-a008ac14760e tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:32.001268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae13e7e5-e736-4ad0-bcaa-a008ac14760e tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:32.023244 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ae13e7e5-e736-4ad0-bcaa-a008ac14760e tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 1520 microversion: 2.25 time: 0.043043 Oct 29 02:50:32.029242 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 614/1252] 10.222.0.46 () {60 vars in 1184 bytes} [Sat Oct 29 02:50:31 2022] GET /compute/v2.1/os-migrations => generated 1520 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:32.046746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ce5a6fc4-e67e-4295-b5a2-2f47d34858f6 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:32.064774 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ce5a6fc4-e67e-4295-b5a2-2f47d34858f6 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:32.082968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce5a6fc4-e67e-4295-b5a2-2f47d34858f6 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:32.095439 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce5a6fc4-e67e-4295-b5a2-2f47d34858f6 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:32.097129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce5a6fc4-e67e-4295-b5a2-2f47d34858f6 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:32.099190 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce5a6fc4-e67e-4295-b5a2-2f47d34858f6 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:32.100267 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce5a6fc4-e67e-4295-b5a2-2f47d34858f6 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:32.103126 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce5a6fc4-e67e-4295-b5a2-2f47d34858f6 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:32.135670 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9759e351-99f2-4954-91de-e3acde89b734 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:32.147304 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9759e351-99f2-4954-91de-e3acde89b734 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1478 microversion: 2.1 time: 0.357533 Oct 29 02:50:32.148476 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 639/1253] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:31 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1478 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:32.168873 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-14aea63a-163d-45f2-a58e-3ede871138a0 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Action: 'create', calling method: .version_select at 0x7ff053e0e940>, body: {"security_group_rule": {"parent_group_id": "c6a44eab-0235-419f-9ba7-bb8bd54e0a94", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:32.206824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG neutronclient.v2_0.client [None req-14aea63a-163d-45f2-a58e-3ede871138a0 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c6a44eab-0235-419f-9ba7-bb8bd54e0a94 does not exist", "detail": ""}} {{(pid=127124) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:50:32.207895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.security_group_api [None req-14aea63a-163d-45f2-a58e-3ede871138a0 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Neutron security group c6a44eab-0235-419f-9ba7-bb8bd54e0a94 not found {{(pid=127124) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 02:50:32.208652 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-14aea63a-163d-45f2-a58e-3ede871138a0 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] HTTP exception thrown: Security group c6a44eab-0235-419f-9ba7-bb8bd54e0a94 does not exist Oct 29 02:50:32.208652 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-ef81f8d3-b19c-457d-874c-fd44ececd84a'] Oct 29 02:50:32.233798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-14aea63a-163d-45f2-a58e-3ede871138a0 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Request method failure captured: Oct 29 02:50:32.233798 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 29 02:50:32.233798 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:50:32.233798 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:50:32.233798 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:50:32.233798 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 138 Oct 29 02:50:32.233798 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:50:32.233798 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:50:32.233798 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:50:32.233798 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:50:32.233798 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJTpMXT6yFGCJiPIXaGTiy55bi8Oh2WAx66bEPWfHBwZ5cbUEZJaFsf3ZjjdBDOCj0b442NcLFkQ16-Gg1pETfsJkhf-MqZ7LrK3jI9SUw8djbn1ngH8_EJXmd7_9Obq7AWhYW0dbNQfYZQdxjrZxw2iqU8xRfOky4OxlqZjrdwR7yc Oct 29 02:50:32.233798 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:50:32.233798 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:50:32.233798 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:50:32.233798 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:50:32.233798 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:50:32.233798 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:50:32.233798 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 4f1389aba6b24aee8650a748f4b14896 Oct 29 02:50:32.233798 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-862964077 Oct 29 02:50:32.233798 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:50:32.233798 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:50:32.235490 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4f1389aba6b24aee8650a748f4b14896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4f1389aba6b24aee8650a748f4b14896"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4f1389aba6b24aee8650a748f4b14896"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4f1389aba6b24aee8650a748f4b14896"}]}] Oct 29 02:50:32.235490 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-862964077 Oct 29 02:50:32.235490 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 4f1389aba6b24aee8650a748f4b14896 Oct 29 02:50:32.235490 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-862964077 Oct 29 02:50:32.235490 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-862964077-project Oct 29 02:50:32.235490 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:50:32.235490 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:50:32.235490 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 9c75a8e3c0ce4847bb01cfdab101d3ac Oct 29 02:50:32.235490 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-862964077-project Oct 29 02:50:32.235490 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:50:32.235490 n-d-862967-2 devstack@n-api.service[127124]: {"security_group_rule": {"parent_group_id": "c6a44eab-0235-419f-9ba7-bb8bd54e0a94", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 29 02:50:32.235490 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:50:32.236371 n-d-862967-2 devstack@n-api.service[127124]: exception: Security group c6a44eab-0235-419f-9ba7-bb8bd54e0a94 does not exist Oct 29 02:50:32.236371 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-ef81f8d3-b19c-457d-874c-fd44ececd84a'] Oct 29 02:50:32.236371 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c6a44eab-0235-419f-9ba7-bb8bd54e0a94', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 29 02:50:32.236371 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:50:32.236371 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:32.236371 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 02:50:32.236371 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 02:50:32.236371 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:50:32.236371 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:50:32.236371 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 02:50:32.236371 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 02:50:32.236371 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:50:32.236371 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:50:32.236371 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:50:32.236371 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:50:32.236371 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:50:32.236371 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:50:32.236371 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:50:32.236371 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:50:32.237781 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:50:32.237781 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:50:32.237781 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:50:32.237781 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:50:32.237781 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:50:32.237781 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:50:32.237781 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:50:32.237781 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:50:32.237781 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:50:32.237781 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:50:32.237781 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c6a44eab-0235-419f-9ba7-bb8bd54e0a94 does not exist Oct 29 02:50:32.237781 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ef81f8d3-b19c-457d-874c-fd44ececd84a'] Oct 29 02:50:32.237781 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:50:32.237781 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:32.237781 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:50:32.237781 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:32.237781 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 29 02:50:32.237781 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 29 02:50:32.237781 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 02:50:32.239275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 02:50:32.239275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c6a44eab-0235-419f-9ba7-bb8bd54e0a94 does not exist Oct 29 02:50:32.239275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ef81f8d3-b19c-457d-874c-fd44ececd84a'] Oct 29 02:50:32.239275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:50:32.239275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:32.239275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:50:32.239275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:32.239275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:32.239275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:32.239275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:50:32.239275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:50:32.239275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:50:32.239275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:50:32.239275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:50:32.239275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:50:32.239275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 29 02:50:32.239275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 02:50:32.239275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c6a44eab-0235-419f-9ba7-bb8bd54e0a94 does not exist Oct 29 02:50:32.239275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ef81f8d3-b19c-457d-874c-fd44ececd84a'] Oct 29 02:50:32.239275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:50:32.240846 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:32.240846 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:50:32.240846 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:32.240846 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:32.240846 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:32.240846 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:50:32.240846 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:50:32.240846 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c6a44eab-0235-419f-9ba7-bb8bd54e0a94 does not exist Oct 29 02:50:32.240846 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ef81f8d3-b19c-457d-874c-fd44ececd84a'] Oct 29 02:50:32.240846 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:50:32.243755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-14aea63a-163d-45f2-a58e-3ede871138a0 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Returning 404 to user: Security group c6a44eab-0235-419f-9ba7-bb8bd54e0a94 does not exist Oct 29 02:50:32.243755 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-ef81f8d3-b19c-457d-874c-fd44ececd84a'] {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:50:32.245194 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-14aea63a-163d-45f2-a58e-3ede871138a0 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.094521 Oct 29 02:50:32.250998 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 640/1254] 10.222.0.46 () {60 vars in 1195 bytes} [Sat Oct 29 02:50:32 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:50:32.256890 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c7a622bb-6bcf-440f-a119-886ff31af7c5 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:32.257779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c7a622bb-6bcf-440f-a119-886ff31af7c5 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:32.267839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c7a622bb-6bcf-440f-a119-886ff31af7c5 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:32.269156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c7a622bb-6bcf-440f-a119-886ff31af7c5 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:32.270015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c7a622bb-6bcf-440f-a119-886ff31af7c5 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:32.270938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c7a622bb-6bcf-440f-a119-886ff31af7c5 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:32.271557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c7a622bb-6bcf-440f-a119-886ff31af7c5 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:32.272708 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c7a622bb-6bcf-440f-a119-886ff31af7c5 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:32.311574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ce5a6fc4-e67e-4295-b5a2-2f47d34858f6 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:32.329579 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ce5a6fc4-e67e-4295-b5a2-2f47d34858f6 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:32.337637 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ce5a6fc4-e67e-4295-b5a2-2f47d34858f6 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:32.355576 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ce5a6fc4-e67e-4295-b5a2-2f47d34858f6 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1553 microversion: 2.91 time: 0.323433 Oct 29 02:50:32.357260 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 615/1255] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:32 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1553 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:32.369696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5dfe2784-0a2d-4ccb-9803-1d83ab2b43e2 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Calling method '.version_select at 0x7ff053a06550>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:32.442068 n-d-862967-2 devstack@n-api.service[127125]: DEBUG neutronclient.v2_0.client [None req-5dfe2784-0a2d-4ccb-9803-1d83ab2b43e2 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 35dd6b03-a9bc-441e-aa64-d0756355caf8 does not exist", "detail": ""}} {{(pid=127125) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:50:32.443286 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.security_group_api [None req-5dfe2784-0a2d-4ccb-9803-1d83ab2b43e2 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Neutron security group rule 35dd6b03-a9bc-441e-aa64-d0756355caf8 not found {{(pid=127125) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 29 02:50:32.444217 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-5dfe2784-0a2d-4ccb-9803-1d83ab2b43e2 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] HTTP exception thrown: Security group rule 35dd6b03-a9bc-441e-aa64-d0756355caf8 does not exist Oct 29 02:50:32.444217 n-d-862967-2 devstack@n-api.service[127125]: Neutron server returns request_ids: ['req-5eb40f39-9b39-457f-8135-dfa3663b5c8e'] Oct 29 02:50:32.457535 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5dfe2784-0a2d-4ccb-9803-1d83ab2b43e2 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Request method failure captured: Oct 29 02:50:32.457535 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/os-security-group-rules/35dd6b03-a9bc-441e-aa64-d0756355caf8 HTTP/1.1 Oct 29 02:50:32.457535 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:50:32.457535 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:50:32.457535 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:50:32.457535 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:50:32.457535 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:50:32.457535 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:50:32.457535 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:50:32.457535 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:50:32.457535 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJTpMXT6yFGCJiPIXaGTiy55bi8Oh2WAx66bEPWfHBwZ5cbUEZJaFsf3ZjjdBDOCj0b442NcLFkQ16-Gg1pETfsJkhf-MqZ7LrK3jI9SUw8djbn1ngH8_EJXmd7_9Obq7AWhYW0dbNQfYZQdxjrZxw2iqU8xRfOky4OxlqZjrdwR7yc Oct 29 02:50:32.457535 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:50:32.457535 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:50:32.457535 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:50:32.457535 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:50:32.457535 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:50:32.457535 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:50:32.457535 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 4f1389aba6b24aee8650a748f4b14896 Oct 29 02:50:32.457535 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-862964077 Oct 29 02:50:32.457535 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:50:32.457535 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:50:32.459838 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4f1389aba6b24aee8650a748f4b14896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4f1389aba6b24aee8650a748f4b14896"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4f1389aba6b24aee8650a748f4b14896"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4f1389aba6b24aee8650a748f4b14896"}]}] Oct 29 02:50:32.459838 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-862964077 Oct 29 02:50:32.459838 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 4f1389aba6b24aee8650a748f4b14896 Oct 29 02:50:32.459838 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-862964077 Oct 29 02:50:32.459838 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-862964077-project Oct 29 02:50:32.459838 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:50:32.459838 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:50:32.459838 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 9c75a8e3c0ce4847bb01cfdab101d3ac Oct 29 02:50:32.459838 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-862964077-project Oct 29 02:50:32.459838 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:50:32.459838 n-d-862967-2 devstack@n-api.service[127125]: exception: Security group rule 35dd6b03-a9bc-441e-aa64-d0756355caf8 does not exist Oct 29 02:50:32.459838 n-d-862967-2 devstack@n-api.service[127125]: Neutron server returns request_ids: ['req-5eb40f39-9b39-457f-8135-dfa3663b5c8e'] Oct 29 02:50:32.461933 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '35dd6b03-a9bc-441e-aa64-d0756355caf8'} Oct 29 02:50:32.461933 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:50:32.461933 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:32.461933 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 29 02:50:32.461933 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 29 02:50:32.461933 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:50:32.461933 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:50:32.461933 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 29 02:50:32.461933 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 29 02:50:32.461933 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:50:32.461933 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:50:32.461933 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:50:32.461933 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:50:32.461933 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:50:32.461933 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:50:32.461933 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:50:32.461933 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:50:32.461933 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:50:32.461933 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:50:32.465018 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:50:32.465018 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:50:32.465018 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:50:32.465018 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:50:32.465018 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:50:32.465018 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:50:32.465018 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:50:32.465018 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:50:32.465018 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 35dd6b03-a9bc-441e-aa64-d0756355caf8 does not exist Oct 29 02:50:32.465018 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5eb40f39-9b39-457f-8135-dfa3663b5c8e'] Oct 29 02:50:32.465018 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:32.465018 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:32.465018 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:32.465018 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:32.465018 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 29 02:50:32.465018 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 29 02:50:32.465018 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 29 02:50:32.465018 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 02:50:32.468660 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 35dd6b03-a9bc-441e-aa64-d0756355caf8 does not exist Oct 29 02:50:32.468660 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5eb40f39-9b39-457f-8135-dfa3663b5c8e'] Oct 29 02:50:32.468660 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:32.468660 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:32.468660 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:32.468660 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:32.468660 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:32.468660 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:32.468660 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:50:32.468660 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:50:32.468660 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:50:32.468660 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:50:32.468660 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:50:32.468660 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:50:32.468660 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 29 02:50:32.468660 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 02:50:32.468660 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 35dd6b03-a9bc-441e-aa64-d0756355caf8 does not exist Oct 29 02:50:32.468660 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5eb40f39-9b39-457f-8135-dfa3663b5c8e'] Oct 29 02:50:32.468660 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:32.468660 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:32.472741 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:32.472741 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:32.472741 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:32.472741 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:32.472741 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:50:32.472741 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:50:32.472741 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 35dd6b03-a9bc-441e-aa64-d0756355caf8 does not exist Oct 29 02:50:32.472741 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5eb40f39-9b39-457f-8135-dfa3663b5c8e'] Oct 29 02:50:32.472741 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:32.476748 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5dfe2784-0a2d-4ccb-9803-1d83ab2b43e2 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Returning 404 to user: Security group rule 35dd6b03-a9bc-441e-aa64-d0756355caf8 does not exist Oct 29 02:50:32.476748 n-d-862967-2 devstack@n-api.service[127125]: Neutron server returns request_ids: ['req-5eb40f39-9b39-457f-8135-dfa3663b5c8e'] {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:50:32.481590 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5dfe2784-0a2d-4ccb-9803-1d83ab2b43e2 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-group-rules/35dd6b03-a9bc-441e-aa64-d0756355caf8" status: 404 len: 199 microversion: 2.1 time: 0.119976 Oct 29 02:50:32.486318 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 616/1256] 10.222.0.46 () {58 vars in 1287 bytes} [Sat Oct 29 02:50:32 2022] DELETE /compute/v2.1/os-security-group-rules/35dd6b03-a9bc-441e-aa64-d0756355caf8 => generated 199 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:50:32.510234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ba86c8da-9e59-4e0d-9c24-0747e7a52353 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:32.511179 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ba86c8da-9e59-4e0d-9c24-0747e7a52353 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:32.530722 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba86c8da-9e59-4e0d-9c24-0747e7a52353 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:32.536075 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba86c8da-9e59-4e0d-9c24-0747e7a52353 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:32.536833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba86c8da-9e59-4e0d-9c24-0747e7a52353 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:32.540093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba86c8da-9e59-4e0d-9c24-0747e7a52353 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:32.540863 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba86c8da-9e59-4e0d-9c24-0747e7a52353 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:32.555994 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba86c8da-9e59-4e0d-9c24-0747e7a52353 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:32.644261 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba86c8da-9e59-4e0d-9c24-0747e7a52353 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:32.648969 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba86c8da-9e59-4e0d-9c24-0747e7a52353 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:32.652568 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba86c8da-9e59-4e0d-9c24-0747e7a52353 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:32.653548 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-ba86c8da-9e59-4e0d-9c24-0747e7a52353 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lazy-loading 'fault' on Instance uuid 3380e407-b7cb-4775-b5ed-17ef51c3764a {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:50:32.749778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ba86c8da-9e59-4e0d-9c24-0747e7a52353 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a2e59fd0b244eea041651e4d79de9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd611070fee0435f8bdda9c3ba5d62fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:32.765212 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ba86c8da-9e59-4e0d-9c24-0747e7a52353 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a" status: 200 len: 1314 microversion: 2.1 time: 0.271683 Oct 29 02:50:32.766914 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 617/1257] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:32 2022] GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:32.776008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-951e183d-d38f-4fc7-a14e-282411b0cdf7 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Calling method '.version_select at 0x7ff053be0ee0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:32.794815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-c7a622bb-6bcf-440f-a119-886ff31af7c5 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lazy-loading 'services' on Instance uuid 694141ac-c96c-409b-9eb2-831a3ccb5a68 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:50:32.865872 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c7a622bb-6bcf-440f-a119-886ff31af7c5 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 2424 microversion: 2.25 time: 0.611180 Oct 29 02:50:32.868180 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 641/1258] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:32 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 2424 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:32.901739 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a200ee7b-da16-42f0-85f7-15242c9a8475 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:32.901739 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a200ee7b-da16-42f0-85f7-15242c9a8475 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:32.915853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a200ee7b-da16-42f0-85f7-15242c9a8475 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:32.916365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a200ee7b-da16-42f0-85f7-15242c9a8475 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:32.919898 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a200ee7b-da16-42f0-85f7-15242c9a8475 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:32.921908 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a200ee7b-da16-42f0-85f7-15242c9a8475 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:32.922436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a200ee7b-da16-42f0-85f7-15242c9a8475 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:32.922892 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a200ee7b-da16-42f0-85f7-15242c9a8475 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:33.202757 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-951e183d-d38f-4fc7-a14e-282411b0cdf7 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/5db2113b-7cb0-444f-a3c7-c4cc2de99f64" status: 202 len: 0 microversion: 2.1 time: 0.434065 Oct 29 02:50:33.203462 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 618/1259] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:50:32 2022] DELETE /compute/v2.1/os-security-groups/5db2113b-7cb0-444f-a3c7-c4cc2de99f64 => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:50:33.208296 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c1406305-9314-4846-9497-3b260aac1a2d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:33.209034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c1406305-9314-4846-9497-3b260aac1a2d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:33.243265 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-a200ee7b-da16-42f0-85f7-15242c9a8475 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lazy-loading 'services' on Instance uuid 694141ac-c96c-409b-9eb2-831a3ccb5a68 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:50:33.281710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c1406305-9314-4846-9497-3b260aac1a2d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:33.282226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c1406305-9314-4846-9497-3b260aac1a2d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:33.282685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c1406305-9314-4846-9497-3b260aac1a2d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:33.283379 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c1406305-9314-4846-9497-3b260aac1a2d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:33.284477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c1406305-9314-4846-9497-3b260aac1a2d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:33.285439 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c1406305-9314-4846-9497-3b260aac1a2d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:33.295083 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a200ee7b-da16-42f0-85f7-15242c9a8475 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 2424 microversion: 2.25 time: 0.398857 Oct 29 02:50:33.315297 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 642/1260] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:32 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 2424 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:33.336158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-91257f15-9305-4b40-b99b-7025ddfafc60 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Calling method '.version_select at 0x7ff053e8b280>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:33.690123 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c1406305-9314-4846-9497-3b260aac1a2d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:33.711463 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c1406305-9314-4846-9497-3b260aac1a2d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1478 microversion: 2.1 time: 0.506871 Oct 29 02:50:33.716218 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 619/1261] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:33 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1478 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:33.729179 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f4ddf7dc-2cea-4f8c-b767-ec6c6087ce13 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:33.731320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f4ddf7dc-2cea-4f8c-b767-ec6c6087ce13 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:33.743432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4ddf7dc-2cea-4f8c-b767-ec6c6087ce13 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:33.744174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4ddf7dc-2cea-4f8c-b767-ec6c6087ce13 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:33.744867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4ddf7dc-2cea-4f8c-b767-ec6c6087ce13 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:33.746119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4ddf7dc-2cea-4f8c-b767-ec6c6087ce13 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:33.746778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4ddf7dc-2cea-4f8c-b767-ec6c6087ce13 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:33.747394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4ddf7dc-2cea-4f8c-b767-ec6c6087ce13 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:33.830241 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-91257f15-9305-4b40-b99b-7025ddfafc60 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/076bca0c-b4d0-4dd6-9081-1cc2a264bdb9" status: 202 len: 0 microversion: 2.1 time: 0.513498 Oct 29 02:50:33.830914 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 643/1262] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:50:33 2022] DELETE /compute/v2.1/os-security-groups/076bca0c-b4d0-4dd6-9081-1cc2a264bdb9 => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:50:33.838482 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-640cdc72-5d86-4ff9-99a3-7b65807bd642 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:33.839028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-640cdc72-5d86-4ff9-99a3-7b65807bd642 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:33.850599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-640cdc72-5d86-4ff9-99a3-7b65807bd642 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:33.853618 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-640cdc72-5d86-4ff9-99a3-7b65807bd642 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:33.867565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-640cdc72-5d86-4ff9-99a3-7b65807bd642 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:33.868450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-640cdc72-5d86-4ff9-99a3-7b65807bd642 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:33.868972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-640cdc72-5d86-4ff9-99a3-7b65807bd642 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:33.870240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-640cdc72-5d86-4ff9-99a3-7b65807bd642 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:33.901462 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f4ddf7dc-2cea-4f8c-b767-ec6c6087ce13 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:33.911651 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f4ddf7dc-2cea-4f8c-b767-ec6c6087ce13 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:33.915001 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f4ddf7dc-2cea-4f8c-b767-ec6c6087ce13 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:33.922063 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f4ddf7dc-2cea-4f8c-b767-ec6c6087ce13 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1553 microversion: 2.91 time: 0.204233 Oct 29 02:50:33.936705 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 620/1263] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:33 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1553 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:33.948082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-581f2c88-0722-428c-9ab3-69aacd6db891 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:33.949410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-581f2c88-0722-428c-9ab3-69aacd6db891 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] [instance: 3380e407-b7cb-4775-b5ed-17ef51c3764a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:33.958322 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-581f2c88-0722-428c-9ab3-69aacd6db891 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:33.958829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-581f2c88-0722-428c-9ab3-69aacd6db891 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:33.959403 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-581f2c88-0722-428c-9ab3-69aacd6db891 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:33.959994 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-581f2c88-0722-428c-9ab3-69aacd6db891 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:33.960484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-581f2c88-0722-428c-9ab3-69aacd6db891 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:33.960923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-581f2c88-0722-428c-9ab3-69aacd6db891 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:33.989099 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-581f2c88-0722-428c-9ab3-69aacd6db891 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] HTTP exception thrown: Instance 3380e407-b7cb-4775-b5ed-17ef51c3764a could not be found. Oct 29 02:50:33.990702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-581f2c88-0722-428c-9ab3-69aacd6db891 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Request method failure captured: Oct 29 02:50:33.990702 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a HTTP/1.1 Oct 29 02:50:33.990702 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:50:33.990702 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:50:33.990702 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:50:33.990702 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:50:33.990702 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:50:33.990702 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:50:33.990702 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:50:33.990702 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:50:33.990702 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJSGLrxUA0l_U9RD0bxMcuRANQY2pcWkvaC3uKgKmf86ETjckHfL5zo6rqaOSK0vvpP1bIvw2PthIlVQ6Lf0l421arEtGZ1z-vV2jnaC7TT-ZnIV0qdU_cC1sK7PCIpH-JLsNZM6IBzY35ix_U8GYfp5_0ZV_NgvzYsYrfG8EdiLpvE Oct 29 02:50:33.990702 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:50:33.990702 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:50:33.990702 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:50:33.990702 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:50:33.990702 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:50:33.990702 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:50:33.990702 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: fd611070fee0435f8bdda9c3ba5d62fc Oct 29 02:50:33.990702 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1732592755 Oct 29 02:50:33.990702 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:50:33.990702 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:50:33.992059 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fd611070fee0435f8bdda9c3ba5d62fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fd611070fee0435f8bdda9c3ba5d62fc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fd611070fee0435f8bdda9c3ba5d62fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fd611070fee0435f8bdda9c3ba5d62fc"}]}] Oct 29 02:50:33.992059 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1732592755 Oct 29 02:50:33.992059 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: fd611070fee0435f8bdda9c3ba5d62fc Oct 29 02:50:33.992059 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1732592755 Oct 29 02:50:33.992059 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-FloatingIPsAssociationTestJSON-1732592755-project Oct 29 02:50:33.992059 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:50:33.992059 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:50:33.992059 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 15a2e59fd0b244eea041651e4d79de9b Oct 29 02:50:33.992059 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1732592755-project Oct 29 02:50:33.992059 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:50:33.992059 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 3380e407-b7cb-4775-b5ed-17ef51c3764a could not be found. Oct 29 02:50:33.992059 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '3380e407-b7cb-4775-b5ed-17ef51c3764a'} Oct 29 02:50:33.993157 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:50:33.993157 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:33.993157 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:50:33.993157 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:50:33.993157 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:50:33.993157 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:50:33.993157 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:50:33.993157 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:50:33.993157 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:50:33.993157 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:50:33.993157 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3380e407-b7cb-4775-b5ed-17ef51c3764a could not be found. Oct 29 02:50:33.993157 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:33.993157 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:33.993157 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:33.993157 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:33.993157 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:33.993157 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:33.993157 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:50:33.993157 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:50:33.993157 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:50:33.994368 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:50:33.994368 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:50:33.994368 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:50:33.994368 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:50:33.994368 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:50:33.994368 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:50:33.994368 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:50:33.994368 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3380e407-b7cb-4775-b5ed-17ef51c3764a could not be found. Oct 29 02:50:33.994368 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:33.994368 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:33.994368 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:33.994368 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:33.994368 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:33.994368 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:33.994368 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:50:33.994368 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:50:33.994368 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3380e407-b7cb-4775-b5ed-17ef51c3764a could not be found. Oct 29 02:50:33.994368 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:50:33.997355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-581f2c88-0722-428c-9ab3-69aacd6db891 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] Returning 404 to user: Instance 3380e407-b7cb-4775-b5ed-17ef51c3764a could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:50:33.998459 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-581f2c88-0722-428c-9ab3-69aacd6db891 tempest-FloatingIPsAssociationTestJSON-1732592755 tempest-FloatingIPsAssociationTestJSON-1732592755-project] 10.222.0.46 "GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a" status: 404 len: 111 microversion: 2.1 time: 0.060297 Oct 29 02:50:34.014626 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 621/1264] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:33 2022] GET /compute/v2.1/servers/3380e407-b7cb-4775-b5ed-17ef51c3764a => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:50:34.024000 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-80258774-995d-4c58-94b9-d94fb5247905 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Calling method '.version_select at 0x7ff053aa41f0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:34.103125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-640cdc72-5d86-4ff9-99a3-7b65807bd642 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lazy-loading 'services' on Instance uuid 694141ac-c96c-409b-9eb2-831a3ccb5a68 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:50:34.305503 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-640cdc72-5d86-4ff9-99a3-7b65807bd642 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "DELETE /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68/os-volume_attachments/98520b47-ad7c-49a1-82b1-afa4864ac603" status: 202 len: 0 microversion: 2.25 time: 0.472546 Oct 29 02:50:34.306935 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 644/1265] 10.222.0.46 () {60 vars in 1457 bytes} [Sat Oct 29 02:50:33 2022] DELETE /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68/os-volume_attachments/98520b47-ad7c-49a1-82b1-afa4864ac603 => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:50:34.679789 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8ec2e895-6b7d-421e-8203-fb49e02cbf05 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-658641972", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:34.771077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-8ec2e895-6b7d-421e-8203-fb49e02cbf05 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] validate_networks() for None {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:50:35.057529 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-8ec2e895-6b7d-421e-8203-fb49e02cbf05 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:50:35.058222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-8ec2e895-6b7d-421e-8203-fb49e02cbf05 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:50:35.058433 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-8ec2e895-6b7d-421e-8203-fb49e02cbf05 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:50:35.058814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-8ec2e895-6b7d-421e-8203-fb49e02cbf05 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:50:35.059420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-8ec2e895-6b7d-421e-8203-fb49e02cbf05 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:50:35.073681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8ec2e895-6b7d-421e-8203-fb49e02cbf05 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:35.074623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8ec2e895-6b7d-421e-8203-fb49e02cbf05 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:35.075298 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8ec2e895-6b7d-421e-8203-fb49e02cbf05 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:35.076389 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8ec2e895-6b7d-421e-8203-fb49e02cbf05 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:35.077001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8ec2e895-6b7d-421e-8203-fb49e02cbf05 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:35.077514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8ec2e895-6b7d-421e-8203-fb49e02cbf05 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:35.103379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-8ec2e895-6b7d-421e-8203-fb49e02cbf05 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Getting quotas for project 17f19c629832452bb23bdf27e87e0a49. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:50:35.111793 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-8ec2e895-6b7d-421e-8203-fb49e02cbf05 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Getting quotas for user a33ab5d704ab43e4b83938ad17c418f3 and project 17f19c629832452bb23bdf27e87e0a49. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:50:35.128990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8ec2e895-6b7d-421e-8203-fb49e02cbf05 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:50:35.131881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8ec2e895-6b7d-421e-8203-fb49e02cbf05 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:50:35.203005 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8ec2e895-6b7d-421e-8203-fb49e02cbf05 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.894068 Oct 29 02:50:35.204364 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 645/1266] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:50:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:50:35.220454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bc180d7e-21e2-422a-ad36-c3a3d5b91018 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:35.223223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bc180d7e-21e2-422a-ad36-c3a3d5b91018 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:35.235546 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc180d7e-21e2-422a-ad36-c3a3d5b91018 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:35.236575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc180d7e-21e2-422a-ad36-c3a3d5b91018 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:35.237522 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc180d7e-21e2-422a-ad36-c3a3d5b91018 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:35.238175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc180d7e-21e2-422a-ad36-c3a3d5b91018 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:35.239052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc180d7e-21e2-422a-ad36-c3a3d5b91018 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:35.239589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc180d7e-21e2-422a-ad36-c3a3d5b91018 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:35.278947 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bc180d7e-21e2-422a-ad36-c3a3d5b91018 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.073030 Oct 29 02:50:35.280223 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 646/1267] 10.222.0.46 () {60 vars in 1343 bytes} [Sat Oct 29 02:50:35 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:50:35.283876 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-80258774-995d-4c58-94b9-d94fb5247905 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/bbbe8e34-feba-4e51-b813-98a1aa44da93" status: 202 len: 0 microversion: 2.1 time: 1.267532 Oct 29 02:50:35.286542 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 622/1268] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:50:34 2022] DELETE /compute/v2.1/os-security-groups/bbbe8e34-feba-4e51-b813-98a1aa44da93 => generated 0 bytes in 1269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:50:35.286955 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-31bb2867-7a26-4b73-af37-135f2ca6bbb7 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:35.287731 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-31bb2867-7a26-4b73-af37-135f2ca6bbb7 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:35.292889 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-16e809aa-b153-4253-85ed-99e652d7add0 req-3daa2744-2599-4bdd-95eb-9d78b5b40cbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403f0ce5-3db7-4b5b-b809-9a5f4280b685", "name": "network-vif-plugged", "status": "completed", "tag": "a71c4667-d218-4c4c-bab3-ff8606f16efe"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:35.295063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31bb2867-7a26-4b73-af37-135f2ca6bbb7 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:35.295853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31bb2867-7a26-4b73-af37-135f2ca6bbb7 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:35.296800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31bb2867-7a26-4b73-af37-135f2ca6bbb7 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:35.297762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31bb2867-7a26-4b73-af37-135f2ca6bbb7 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:35.298422 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31bb2867-7a26-4b73-af37-135f2ca6bbb7 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:35.299011 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31bb2867-7a26-4b73-af37-135f2ca6bbb7 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:35.321841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-16e809aa-b153-4253-85ed-99e652d7add0 req-3daa2744-2599-4bdd-95eb-9d78b5b40cbf service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:35.322272 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-16e809aa-b153-4253-85ed-99e652d7add0 req-3daa2744-2599-4bdd-95eb-9d78b5b40cbf service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:35.322732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-16e809aa-b153-4253-85ed-99e652d7add0 req-3daa2744-2599-4bdd-95eb-9d78b5b40cbf service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:35.356899 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-16e809aa-b153-4253-85ed-99e652d7add0 req-3daa2744-2599-4bdd-95eb-9d78b5b40cbf service nova] Creating event network-vif-plugged:a71c4667-d218-4c4c-bab3-ff8606f16efe for instance 403f0ce5-3db7-4b5b-b809-9a5f4280b685 on n-h1-862967-2 Oct 29 02:50:35.376564 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-16e809aa-b153-4253-85ed-99e652d7add0 req-3daa2744-2599-4bdd-95eb-9d78b5b40cbf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085269 Oct 29 02:50:35.382750 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 623/1269] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:35.399302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a288502b-70ff-4070-bdca-a94178650d53 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:35.401762 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a288502b-70ff-4070-bdca-a94178650d53 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:35.416336 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a288502b-70ff-4070-bdca-a94178650d53 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:35.420288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a288502b-70ff-4070-bdca-a94178650d53 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:35.422238 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a288502b-70ff-4070-bdca-a94178650d53 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:35.424603 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a288502b-70ff-4070-bdca-a94178650d53 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:35.425301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a288502b-70ff-4070-bdca-a94178650d53 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:35.427154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a288502b-70ff-4070-bdca-a94178650d53 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:35.546024 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-31bb2867-7a26-4b73-af37-135f2ca6bbb7 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:35.558922 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-31bb2867-7a26-4b73-af37-135f2ca6bbb7 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1478 microversion: 2.1 time: 0.276640 Oct 29 02:50:35.563352 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 647/1270] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:35 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1478 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:35.576652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bc42b638-e058-4895-8c8c-c7aaa45edb89 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:35.579940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bc42b638-e058-4895-8c8c-c7aaa45edb89 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:35.723843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a288502b-70ff-4070-bdca-a94178650d53 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:35.740453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a288502b-70ff-4070-bdca-a94178650d53 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:35.744694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a288502b-70ff-4070-bdca-a94178650d53 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:35.764418 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a288502b-70ff-4070-bdca-a94178650d53 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1553 microversion: 2.91 time: 0.379886 Oct 29 02:50:35.770563 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 624/1271] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:35 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1553 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:35.777292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5abf77c2-f400-4d9f-9bc2-d6a0a9060586 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Calling method '.version_select at 0x7ff053aa44c0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:35.780410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bc42b638-e058-4895-8c8c-c7aaa45edb89 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:35.788379 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bc42b638-e058-4895-8c8c-c7aaa45edb89 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf" status: 200 len: 1219 microversion: 2.1 time: 0.223340 Oct 29 02:50:35.789238 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 648/1272] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:35 2022] GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf => generated 1219 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:36.293676 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-abec5fe4-ddcc-440f-bd83-6287d2e34fee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:36.296149 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-abec5fe4-ddcc-440f-bd83-6287d2e34fee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:36.306162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abec5fe4-ddcc-440f-bd83-6287d2e34fee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:36.306811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abec5fe4-ddcc-440f-bd83-6287d2e34fee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:36.307353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abec5fe4-ddcc-440f-bd83-6287d2e34fee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:36.308853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abec5fe4-ddcc-440f-bd83-6287d2e34fee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:36.310346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abec5fe4-ddcc-440f-bd83-6287d2e34fee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:36.310941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abec5fe4-ddcc-440f-bd83-6287d2e34fee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:36.356515 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-abec5fe4-ddcc-440f-bd83-6287d2e34fee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.067061 Oct 29 02:50:36.357426 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 649/1273] 10.222.0.46 () {60 vars in 1343 bytes} [Sat Oct 29 02:50:36 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:50:36.496781 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5abf77c2-f400-4d9f-9bc2-d6a0a9060586 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/341d5816-a5e1-4163-a1e7-f21bf4fff218" status: 202 len: 0 microversion: 2.1 time: 0.724571 Oct 29 02:50:36.498004 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 625/1274] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:50:35 2022] DELETE /compute/v2.1/os-security-groups/341d5816-a5e1-4163-a1e7-f21bf4fff218 => generated 0 bytes in 727 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:50:36.508432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-823c7784-2f91-451c-a2df-518342ee6356 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] Calling method '.version_select at 0x7ff053ea9c10>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:36.590867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c79b490c-77a1-41d6-b2d9-547b75e013c1 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:36.592746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c79b490c-77a1-41d6-b2d9-547b75e013c1 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:36.607363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c79b490c-77a1-41d6-b2d9-547b75e013c1 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:36.607770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c79b490c-77a1-41d6-b2d9-547b75e013c1 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:36.608872 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c79b490c-77a1-41d6-b2d9-547b75e013c1 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:36.609024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c79b490c-77a1-41d6-b2d9-547b75e013c1 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:36.609503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c79b490c-77a1-41d6-b2d9-547b75e013c1 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:36.609937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c79b490c-77a1-41d6-b2d9-547b75e013c1 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:36.804568 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-823c7784-2f91-451c-a2df-518342ee6356 tempest-SecurityGroupRulesNegativeTestJSON-862964077 tempest-SecurityGroupRulesNegativeTestJSON-862964077-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/d0d44cbc-8cbe-44ea-9d65-e0625197d6fe" status: 202 len: 0 microversion: 2.1 time: 0.301457 Oct 29 02:50:36.814292 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 650/1275] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:50:36 2022] DELETE /compute/v2.1/os-security-groups/d0d44cbc-8cbe-44ea-9d65-e0625197d6fe => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:50:36.837353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-08788ee6-aaeb-4800-aa17-8e88de0e76c2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:36.839581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-08788ee6-aaeb-4800-aa17-8e88de0e76c2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:36.860256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-08788ee6-aaeb-4800-aa17-8e88de0e76c2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:36.861313 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-08788ee6-aaeb-4800-aa17-8e88de0e76c2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:36.863047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-08788ee6-aaeb-4800-aa17-8e88de0e76c2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:36.865467 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-08788ee6-aaeb-4800-aa17-8e88de0e76c2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:36.869049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-08788ee6-aaeb-4800-aa17-8e88de0e76c2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:36.870131 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-08788ee6-aaeb-4800-aa17-8e88de0e76c2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:36.986364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-08788ee6-aaeb-4800-aa17-8e88de0e76c2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:37.001856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-08788ee6-aaeb-4800-aa17-8e88de0e76c2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:37.003514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-08788ee6-aaeb-4800-aa17-8e88de0e76c2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:37.012318 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-08788ee6-aaeb-4800-aa17-8e88de0e76c2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1535 microversion: 2.91 time: 0.195981 Oct 29 02:50:37.013733 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 651/1276] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:36 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1535 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:37.021232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a76411ec-a473-47f7-87b1-cb096600b26b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:37.022865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a76411ec-a473-47f7-87b1-cb096600b26b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:37.042665 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a76411ec-a473-47f7-87b1-cb096600b26b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:37.047965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a76411ec-a473-47f7-87b1-cb096600b26b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:37.049699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a76411ec-a473-47f7-87b1-cb096600b26b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:37.051460 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a76411ec-a473-47f7-87b1-cb096600b26b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:37.052691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a76411ec-a473-47f7-87b1-cb096600b26b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:37.053714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a76411ec-a473-47f7-87b1-cb096600b26b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:37.149576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a76411ec-a473-47f7-87b1-cb096600b26b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:37.175073 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a76411ec-a473-47f7-87b1-cb096600b26b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf" status: 200 len: 1271 microversion: 2.1 time: 0.159611 Oct 29 02:50:37.175750 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 652/1277] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:37 2022] GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf => generated 1271 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:37.194125 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c79b490c-77a1-41d6-b2d9-547b75e013c1 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:37.202535 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c79b490c-77a1-41d6-b2d9-547b75e013c1 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1478 microversion: 2.1 time: 0.618183 Oct 29 02:50:37.203943 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 626/1278] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:36 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1478 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:37.374616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-46d5551f-c2d8-435d-a121-bf5deee510db tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:37.380912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-46d5551f-c2d8-435d-a121-bf5deee510db tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:37.393247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46d5551f-c2d8-435d-a121-bf5deee510db tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:37.394698 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46d5551f-c2d8-435d-a121-bf5deee510db tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:37.395365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46d5551f-c2d8-435d-a121-bf5deee510db tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:37.396406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46d5551f-c2d8-435d-a121-bf5deee510db tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:37.397596 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46d5551f-c2d8-435d-a121-bf5deee510db tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:37.399338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46d5551f-c2d8-435d-a121-bf5deee510db tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:37.447169 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-46d5551f-c2d8-435d-a121-bf5deee510db tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.080104 Oct 29 02:50:37.453860 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 653/1279] 10.222.0.46 () {60 vars in 1343 bytes} [Sat Oct 29 02:50:37 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:50:38.086484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2c54b70d-9464-428b-830d-68143f0472e9 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:38.088014 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2c54b70d-9464-428b-830d-68143f0472e9 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:38.095193 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2c54b70d-9464-428b-830d-68143f0472e9 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:38.097240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2c54b70d-9464-428b-830d-68143f0472e9 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:38.097891 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2c54b70d-9464-428b-830d-68143f0472e9 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:38.098863 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2c54b70d-9464-428b-830d-68143f0472e9 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:38.101218 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2c54b70d-9464-428b-830d-68143f0472e9 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:38.101972 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2c54b70d-9464-428b-830d-68143f0472e9 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:38.211840 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-52f3e37b-7158-474d-af98-7569d8db334b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:38.214095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-52f3e37b-7158-474d-af98-7569d8db334b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:38.244119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-52f3e37b-7158-474d-af98-7569d8db334b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:38.245602 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-52f3e37b-7158-474d-af98-7569d8db334b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:38.246478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-52f3e37b-7158-474d-af98-7569d8db334b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:38.247462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-52f3e37b-7158-474d-af98-7569d8db334b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:38.248137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-52f3e37b-7158-474d-af98-7569d8db334b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:38.248798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-52f3e37b-7158-474d-af98-7569d8db334b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:38.458533 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2c54b70d-9464-428b-830d-68143f0472e9 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:38.466415 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-52f3e37b-7158-474d-af98-7569d8db334b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:38.477920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2c54b70d-9464-428b-830d-68143f0472e9 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:38.482437 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2c54b70d-9464-428b-830d-68143f0472e9 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:38.501819 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2c54b70d-9464-428b-830d-68143f0472e9 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1538 microversion: 2.91 time: 0.436867 Oct 29 02:50:38.509453 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-52f3e37b-7158-474d-af98-7569d8db334b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf" status: 200 len: 1271 microversion: 2.1 time: 0.309896 Oct 29 02:50:38.510752 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 654/1280] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:38 2022] GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf => generated 1271 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:38.521786 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 627/1281] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:38 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1538 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:38.536012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-37c4be32-9e48-4407-817d-bce00c1c273c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:38.539250 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1108bddc-1c84-45ff-ba77-2abb49136be0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:38.542826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-37c4be32-9e48-4407-817d-bce00c1c273c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:38.543753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1108bddc-1c84-45ff-ba77-2abb49136be0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:38.552210 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1108bddc-1c84-45ff-ba77-2abb49136be0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:38.553226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1108bddc-1c84-45ff-ba77-2abb49136be0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:38.554022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1108bddc-1c84-45ff-ba77-2abb49136be0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:38.554958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1108bddc-1c84-45ff-ba77-2abb49136be0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:38.555611 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1108bddc-1c84-45ff-ba77-2abb49136be0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:38.556393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1108bddc-1c84-45ff-ba77-2abb49136be0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:38.575268 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37c4be32-9e48-4407-817d-bce00c1c273c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:38.582462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37c4be32-9e48-4407-817d-bce00c1c273c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:38.583390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37c4be32-9e48-4407-817d-bce00c1c273c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:38.584655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37c4be32-9e48-4407-817d-bce00c1c273c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:38.585433 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37c4be32-9e48-4407-817d-bce00c1c273c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:38.599160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37c4be32-9e48-4407-817d-bce00c1c273c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:38.619333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:38.629499 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1108bddc-1c84-45ff-ba77-2abb49136be0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.104469 Oct 29 02:50:38.631862 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 628/1282] 10.222.0.46 () {60 vars in 1343 bytes} [Sat Oct 29 02:50:38 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:50:38.641246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-085337b9-552f-4a2c-8e63-fe1959d7a5af tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-862967-2"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:38.651045 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-085337b9-552f-4a2c-8e63-fe1959d7a5af tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:38.661922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-085337b9-552f-4a2c-8e63-fe1959d7a5af tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:38.662809 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-085337b9-552f-4a2c-8e63-fe1959d7a5af tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:38.663508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-085337b9-552f-4a2c-8e63-fe1959d7a5af tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:38.664499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-085337b9-552f-4a2c-8e63-fe1959d7a5af tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:38.665291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-085337b9-552f-4a2c-8e63-fe1959d7a5af tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:38.665936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-085337b9-552f-4a2c-8e63-fe1959d7a5af tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:38.758181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-085337b9-552f-4a2c-8e63-fe1959d7a5af tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-862967-2". {{(pid=127125) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 29 02:50:38.855930 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-085337b9-552f-4a2c-8e63-fe1959d7a5af tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186/action" status: 202 len: 0 microversion: 2.91 time: 0.221583 Oct 29 02:50:38.857167 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 629/1283] 10.222.0.46 () {62 vars in 1319 bytes} [Sat Oct 29 02:50:38 2022] POST /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:50:38.871310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ab841e31-c59c-4297-bac5-67b8e6811766 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:38.872095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ab841e31-c59c-4297-bac5-67b8e6811766 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:38.879729 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab841e31-c59c-4297-bac5-67b8e6811766 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:38.880392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab841e31-c59c-4297-bac5-67b8e6811766 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:38.881005 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab841e31-c59c-4297-bac5-67b8e6811766 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:38.881838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab841e31-c59c-4297-bac5-67b8e6811766 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:38.882404 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab841e31-c59c-4297-bac5-67b8e6811766 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:38.882938 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab841e31-c59c-4297-bac5-67b8e6811766 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:38.995039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ab841e31-c59c-4297-bac5-67b8e6811766 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:39.018934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ab841e31-c59c-4297-bac5-67b8e6811766 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:39.022308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ab841e31-c59c-4297-bac5-67b8e6811766 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:39.042961 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ab841e31-c59c-4297-bac5-67b8e6811766 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1546 microversion: 2.91 time: 0.174607 Oct 29 02:50:39.044114 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 630/1284] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:38 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1546 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:39.452213 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-991d854f-f009-4d67-870f-716757baa589 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:39.454817 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-991d854f-f009-4d67-870f-716757baa589 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:39.470549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-991d854f-f009-4d67-870f-716757baa589 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:39.477346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-991d854f-f009-4d67-870f-716757baa589 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:39.478272 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-991d854f-f009-4d67-870f-716757baa589 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:39.480820 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-991d854f-f009-4d67-870f-716757baa589 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:39.488645 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-991d854f-f009-4d67-870f-716757baa589 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:39.494525 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-991d854f-f009-4d67-870f-716757baa589 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:39.564099 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-991d854f-f009-4d67-870f-716757baa589 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115768 Oct 29 02:50:39.566777 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 631/1285] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 02:50:39 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:50:39.578364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0c96159a-a1f2-4808-8ec9-7e16f6636f30 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:39.579278 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0c96159a-a1f2-4808-8ec9-7e16f6636f30 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:39.586701 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c96159a-a1f2-4808-8ec9-7e16f6636f30 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:39.587309 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c96159a-a1f2-4808-8ec9-7e16f6636f30 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:39.587910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c96159a-a1f2-4808-8ec9-7e16f6636f30 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:39.589034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c96159a-a1f2-4808-8ec9-7e16f6636f30 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:39.589708 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c96159a-a1f2-4808-8ec9-7e16f6636f30 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:39.590325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c96159a-a1f2-4808-8ec9-7e16f6636f30 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:39.712286 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0c96159a-a1f2-4808-8ec9-7e16f6636f30 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:39.745540 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0c96159a-a1f2-4808-8ec9-7e16f6636f30 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf" status: 200 len: 1277 microversion: 2.1 time: 0.176298 Oct 29 02:50:39.755375 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 632/1286] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:39 2022] GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf => generated 1277 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:39.777420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d0118b33-8fe9-44d3-b9a1-42e6eb231a7a tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:39.779147 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d0118b33-8fe9-44d3-b9a1-42e6eb231a7a tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:39.797556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0118b33-8fe9-44d3-b9a1-42e6eb231a7a tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:39.798062 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0118b33-8fe9-44d3-b9a1-42e6eb231a7a tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:39.798505 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0118b33-8fe9-44d3-b9a1-42e6eb231a7a tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:39.808316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0118b33-8fe9-44d3-b9a1-42e6eb231a7a tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:39.808316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0118b33-8fe9-44d3-b9a1-42e6eb231a7a tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:39.808316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0118b33-8fe9-44d3-b9a1-42e6eb231a7a tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:39.881152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-37c4be32-9e48-4407-817d-bce00c1c273c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:39.892692 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-37c4be32-9e48-4407-817d-bce00c1c273c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1463 microversion: 2.1 time: 1.380492 Oct 29 02:50:39.914296 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 655/1287] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:38 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1463 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:39.926633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f0ba1859-783a-43a2-bb32-708681619018 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:39.935536 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f0ba1859-783a-43a2-bb32-708681619018 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:39.955368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0ba1859-783a-43a2-bb32-708681619018 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:39.955871 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0ba1859-783a-43a2-bb32-708681619018 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:39.956307 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0ba1859-783a-43a2-bb32-708681619018 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:39.957066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0ba1859-783a-43a2-bb32-708681619018 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:39.957804 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0ba1859-783a-43a2-bb32-708681619018 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:39.958975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0ba1859-783a-43a2-bb32-708681619018 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:40.040191 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f0ba1859-783a-43a2-bb32-708681619018 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.123886 Oct 29 02:50:40.048034 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 656/1288] 10.222.0.46 () {60 vars in 1343 bytes} [Sat Oct 29 02:50:39 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:50:40.053926 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e78e8298-3d0f-4b3d-9b9a-8c08d318b450 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:40.056460 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e78e8298-3d0f-4b3d-9b9a-8c08d318b450 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:40.064454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e78e8298-3d0f-4b3d-9b9a-8c08d318b450 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:40.065281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e78e8298-3d0f-4b3d-9b9a-8c08d318b450 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:40.065884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e78e8298-3d0f-4b3d-9b9a-8c08d318b450 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:40.066855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e78e8298-3d0f-4b3d-9b9a-8c08d318b450 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:40.067478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e78e8298-3d0f-4b3d-9b9a-8c08d318b450 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:40.068470 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e78e8298-3d0f-4b3d-9b9a-8c08d318b450 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:40.180964 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-d0118b33-8fe9-44d3-b9a1-42e6eb231a7a tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lazy-loading 'services' on Instance uuid e14d80ff-4e71-4822-917c-ee46b9c7be54 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:50:40.289808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:40.297505 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e78e8298-3d0f-4b3d-9b9a-8c08d318b450 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685/action" status: 202 len: 0 microversion: 2.1 time: 0.248090 Oct 29 02:50:40.299759 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 657/1289] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:50:40 2022] POST /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:50:40.311386 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fad446a7-662e-477f-8b4d-5d2df1948787 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:40.317701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fad446a7-662e-477f-8b4d-5d2df1948787 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:40.331441 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fad446a7-662e-477f-8b4d-5d2df1948787 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:40.332315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fad446a7-662e-477f-8b4d-5d2df1948787 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:40.333793 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fad446a7-662e-477f-8b4d-5d2df1948787 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:40.335806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fad446a7-662e-477f-8b4d-5d2df1948787 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:40.336864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fad446a7-662e-477f-8b4d-5d2df1948787 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:40.337529 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fad446a7-662e-477f-8b4d-5d2df1948787 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:40.498487 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d0118b33-8fe9-44d3-b9a1-42e6eb231a7a tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54/os-volume_attachments/9933e750-1e03-4519-9e65-114f951bc696" status: 202 len: 0 microversion: 2.1 time: 0.739020 Oct 29 02:50:40.502755 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 633/1290] 10.222.0.46 () {58 vars in 1416 bytes} [Sat Oct 29 02:50:39 2022] DELETE /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54/os-volume_attachments/9933e750-1e03-4519-9e65-114f951bc696 => generated 0 bytes in 745 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:50:40.514118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fad446a7-662e-477f-8b4d-5d2df1948787 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:40.532348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1ecc955c-6d28-4326-bcbe-c13fd802415f tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:40.534007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1ecc955c-6d28-4326-bcbe-c13fd802415f tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:40.554123 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fad446a7-662e-477f-8b4d-5d2df1948787 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:40.567701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fad446a7-662e-477f-8b4d-5d2df1948787 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:40.568345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ecc955c-6d28-4326-bcbe-c13fd802415f tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:40.570154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ecc955c-6d28-4326-bcbe-c13fd802415f tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:40.570874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ecc955c-6d28-4326-bcbe-c13fd802415f tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:40.571904 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ecc955c-6d28-4326-bcbe-c13fd802415f tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:40.574171 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ecc955c-6d28-4326-bcbe-c13fd802415f tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:40.575312 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ecc955c-6d28-4326-bcbe-c13fd802415f tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:40.594123 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fad446a7-662e-477f-8b4d-5d2df1948787 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1486 microversion: 2.91 time: 0.291957 Oct 29 02:50:40.601113 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 658/1291] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:40 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1486 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:40.619407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ecc955c-6d28-4326-bcbe-c13fd802415f tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:40.620141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ecc955c-6d28-4326-bcbe-c13fd802415f tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:40.620749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ecc955c-6d28-4326-bcbe-c13fd802415f tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:40.621346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-1ecc955c-6d28-4326-bcbe-c13fd802415f tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lazy-loading 'fault' on Instance uuid 403f0ce5-3db7-4b5b-b809-9a5f4280b685 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:50:40.793463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-42669b76-c484-40e2-a897-67fc65c2a1fa tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:40.794431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-42669b76-c484-40e2-a897-67fc65c2a1fa tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:40.824468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-42669b76-c484-40e2-a897-67fc65c2a1fa tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:40.826079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-42669b76-c484-40e2-a897-67fc65c2a1fa tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:40.826628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-42669b76-c484-40e2-a897-67fc65c2a1fa tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:40.827660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-42669b76-c484-40e2-a897-67fc65c2a1fa tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:40.828226 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-42669b76-c484-40e2-a897-67fc65c2a1fa tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:40.828787 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-42669b76-c484-40e2-a897-67fc65c2a1fa tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:40.974975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-42669b76-c484-40e2-a897-67fc65c2a1fa tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:40.992506 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-42669b76-c484-40e2-a897-67fc65c2a1fa tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf" status: 200 len: 1277 microversion: 2.1 time: 0.202450 Oct 29 02:50:40.993478 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 659/1292] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:40 2022] GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf => generated 1277 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:41.056301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-24d83585-d17c-442e-8e5b-fa04e00549f3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:41.060958 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-24d83585-d17c-442e-8e5b-fa04e00549f3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:41.080575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-24d83585-d17c-442e-8e5b-fa04e00549f3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:41.085947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-24d83585-d17c-442e-8e5b-fa04e00549f3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:41.087141 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-24d83585-d17c-442e-8e5b-fa04e00549f3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:41.088903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-24d83585-d17c-442e-8e5b-fa04e00549f3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:41.096446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-24d83585-d17c-442e-8e5b-fa04e00549f3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:41.097651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-24d83585-d17c-442e-8e5b-fa04e00549f3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:41.182596 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-24d83585-d17c-442e-8e5b-fa04e00549f3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.132385 Oct 29 02:50:41.189075 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 660/1293] 10.222.0.46 () {60 vars in 1343 bytes} [Sat Oct 29 02:50:41 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:50:41.225074 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1ecc955c-6d28-4326-bcbe-c13fd802415f tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1597 microversion: 2.1 time: 0.709612 Oct 29 02:50:41.225830 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 634/1294] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:40 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1597 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:41.255817 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-406bef01-18bd-4149-ab1f-c91ec69c60b2 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:41.259060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-406bef01-18bd-4149-ab1f-c91ec69c60b2 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:41.272174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-406bef01-18bd-4149-ab1f-c91ec69c60b2 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:41.273176 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-406bef01-18bd-4149-ab1f-c91ec69c60b2 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:41.273792 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-406bef01-18bd-4149-ab1f-c91ec69c60b2 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:41.275030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-406bef01-18bd-4149-ab1f-c91ec69c60b2 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:41.276234 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-406bef01-18bd-4149-ab1f-c91ec69c60b2 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:41.276915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-406bef01-18bd-4149-ab1f-c91ec69c60b2 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:41.505669 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-406bef01-18bd-4149-ab1f-c91ec69c60b2 tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685/action" status: 202 len: 0 microversion: 2.1 time: 0.253138 Oct 29 02:50:41.519398 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 661/1295] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:50:41 2022] POST /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 02:50:41.528741 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-50946501-918d-42de-a84f-f8770a186bcc tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:41.529840 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-50946501-918d-42de-a84f-f8770a186bcc tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:41.561283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50946501-918d-42de-a84f-f8770a186bcc tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:41.568983 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50946501-918d-42de-a84f-f8770a186bcc tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:41.570095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50946501-918d-42de-a84f-f8770a186bcc tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:41.571597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50946501-918d-42de-a84f-f8770a186bcc tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:41.580863 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50946501-918d-42de-a84f-f8770a186bcc tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:41.581983 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50946501-918d-42de-a84f-f8770a186bcc tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:41.684237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-211117ac-dd99-43db-9e33-e11ba64f6f81 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:41.693244 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-211117ac-dd99-43db-9e33-e11ba64f6f81 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:41.707480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-211117ac-dd99-43db-9e33-e11ba64f6f81 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:41.708380 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-211117ac-dd99-43db-9e33-e11ba64f6f81 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:41.709087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-211117ac-dd99-43db-9e33-e11ba64f6f81 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:41.710233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-211117ac-dd99-43db-9e33-e11ba64f6f81 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:41.710904 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-211117ac-dd99-43db-9e33-e11ba64f6f81 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:41.711622 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-211117ac-dd99-43db-9e33-e11ba64f6f81 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:41.865902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-211117ac-dd99-43db-9e33-e11ba64f6f81 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:41.903555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-211117ac-dd99-43db-9e33-e11ba64f6f81 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:41.906279 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-211117ac-dd99-43db-9e33-e11ba64f6f81 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:41.923579 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-211117ac-dd99-43db-9e33-e11ba64f6f81 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.264239 Oct 29 02:50:41.930523 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 662/1296] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:41 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:42.034306 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d0f855d3-4728-4fe7-909f-1841b9e437c2 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:42.036600 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d0f855d3-4728-4fe7-909f-1841b9e437c2 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:42.046544 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:42.050840 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0f855d3-4728-4fe7-909f-1841b9e437c2 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:42.052100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0f855d3-4728-4fe7-909f-1841b9e437c2 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:42.053144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0f855d3-4728-4fe7-909f-1841b9e437c2 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:42.054751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0f855d3-4728-4fe7-909f-1841b9e437c2 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:42.055789 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0f855d3-4728-4fe7-909f-1841b9e437c2 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:42.056822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0f855d3-4728-4fe7-909f-1841b9e437c2 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:42.186298 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d0f855d3-4728-4fe7-909f-1841b9e437c2 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:42.201485 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d0f855d3-4728-4fe7-909f-1841b9e437c2 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf" status: 200 len: 1277 microversion: 2.1 time: 0.174115 Oct 29 02:50:42.203291 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 663/1297] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:42 2022] GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf => generated 1277 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:42.230645 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a1d7ecb9-65b4-475a-80ce-cb371084bd9f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:42.236068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a1d7ecb9-65b4-475a-80ce-cb371084bd9f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:42.247933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a1d7ecb9-65b4-475a-80ce-cb371084bd9f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:42.249277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a1d7ecb9-65b4-475a-80ce-cb371084bd9f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:42.250294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a1d7ecb9-65b4-475a-80ce-cb371084bd9f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:42.252625 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a1d7ecb9-65b4-475a-80ce-cb371084bd9f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:42.253726 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a1d7ecb9-65b4-475a-80ce-cb371084bd9f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:42.254779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a1d7ecb9-65b4-475a-80ce-cb371084bd9f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:42.294379 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-50946501-918d-42de-a84f-f8770a186bcc tempest-ServersAdminTestJSON-197224256 tempest-ServersAdminTestJSON-197224256-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1614 microversion: 2.1 time: 0.779616 Oct 29 02:50:42.298084 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 635/1298] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:41 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1614 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:42.326081 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9f1756f3-f4e9-4148-a7dc-5482b6fc9605 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:42.326968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9f1756f3-f4e9-4148-a7dc-5482b6fc9605 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: cdd44464-a057-4ebc-bf1e-ae14f5655133] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:42.341551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f1756f3-f4e9-4148-a7dc-5482b6fc9605 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:42.344477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f1756f3-f4e9-4148-a7dc-5482b6fc9605 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:42.345383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f1756f3-f4e9-4148-a7dc-5482b6fc9605 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:42.349673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f1756f3-f4e9-4148-a7dc-5482b6fc9605 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:42.350520 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f1756f3-f4e9-4148-a7dc-5482b6fc9605 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:42.351256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f1756f3-f4e9-4148-a7dc-5482b6fc9605 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:42.372380 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a1d7ecb9-65b4-475a-80ce-cb371084bd9f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.167230 Oct 29 02:50:42.391925 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 664/1299] 10.222.0.46 () {60 vars in 1343 bytes} [Sat Oct 29 02:50:42 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:50:42.443094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9f1756f3-f4e9-4148-a7dc-5482b6fc9605 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: cdd44464-a057-4ebc-bf1e-ae14f5655133] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:50:42.615554 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9f1756f3-f4e9-4148-a7dc-5482b6fc9605 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133" status: 204 len: 0 microversion: 2.1 time: 0.293439 Oct 29 02:50:42.619066 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 636/1300] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:50:42 2022] DELETE /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:50:42.627860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-46a4c48e-0d80-4d06-a036-597bcbbac120 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:42.640335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-46a4c48e-0d80-4d06-a036-597bcbbac120 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: cdd44464-a057-4ebc-bf1e-ae14f5655133] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:42.649361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46a4c48e-0d80-4d06-a036-597bcbbac120 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:42.650199 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46a4c48e-0d80-4d06-a036-597bcbbac120 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:42.650819 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46a4c48e-0d80-4d06-a036-597bcbbac120 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:42.651698 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46a4c48e-0d80-4d06-a036-597bcbbac120 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:42.652308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46a4c48e-0d80-4d06-a036-597bcbbac120 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:42.652927 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46a4c48e-0d80-4d06-a036-597bcbbac120 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:42.879983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-46a4c48e-0d80-4d06-a036-597bcbbac120 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:42.907375 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-46a4c48e-0d80-4d06-a036-597bcbbac120 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133" status: 200 len: 1469 microversion: 2.1 time: 0.282934 Oct 29 02:50:42.908732 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 665/1301] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:42 2022] GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133 => generated 1469 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:42.988844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c82803d5-3d59-4162-acce-64b32bccd485 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:42.990392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c82803d5-3d59-4162-acce-64b32bccd485 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:43.054299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c82803d5-3d59-4162-acce-64b32bccd485 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:43.055191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c82803d5-3d59-4162-acce-64b32bccd485 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:43.055970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c82803d5-3d59-4162-acce-64b32bccd485 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:43.064485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c82803d5-3d59-4162-acce-64b32bccd485 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:43.065407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c82803d5-3d59-4162-acce-64b32bccd485 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:43.066169 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c82803d5-3d59-4162-acce-64b32bccd485 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:43.231205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1b667907-d83c-4900-bc88-67e6d09ab8c7 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:43.232143 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1b667907-d83c-4900-bc88-67e6d09ab8c7 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:43.256453 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b667907-d83c-4900-bc88-67e6d09ab8c7 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:43.257710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b667907-d83c-4900-bc88-67e6d09ab8c7 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:43.261161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b667907-d83c-4900-bc88-67e6d09ab8c7 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:43.262871 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b667907-d83c-4900-bc88-67e6d09ab8c7 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:43.263858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b667907-d83c-4900-bc88-67e6d09ab8c7 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:43.265897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b667907-d83c-4900-bc88-67e6d09ab8c7 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:43.437626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c82803d5-3d59-4162-acce-64b32bccd485 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:43.452241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c82803d5-3d59-4162-acce-64b32bccd485 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:43.453996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c82803d5-3d59-4162-acce-64b32bccd485 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:43.472552 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c82803d5-3d59-4162-acce-64b32bccd485 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.494684 Oct 29 02:50:43.474411 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 637/1302] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:42 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:43.498284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4fd89041-cd21-4a3b-8a42-7ba3ee2f64fc tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:43.501759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4fd89041-cd21-4a3b-8a42-7ba3ee2f64fc tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:43.513580 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4fd89041-cd21-4a3b-8a42-7ba3ee2f64fc tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:43.514372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4fd89041-cd21-4a3b-8a42-7ba3ee2f64fc tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:43.515223 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4fd89041-cd21-4a3b-8a42-7ba3ee2f64fc tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:43.516131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4fd89041-cd21-4a3b-8a42-7ba3ee2f64fc tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:43.518181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4fd89041-cd21-4a3b-8a42-7ba3ee2f64fc tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:43.518795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4fd89041-cd21-4a3b-8a42-7ba3ee2f64fc tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:43.598287 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4fd89041-cd21-4a3b-8a42-7ba3ee2f64fc tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.122441 Oct 29 02:50:43.607206 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 638/1303] 10.222.0.46 () {60 vars in 1343 bytes} [Sat Oct 29 02:50:43 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68/os-volume_attachments => generated 25 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:43.944459 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0a1470e8-8e2a-4578-8556-9d109c1e873e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:43.950601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0a1470e8-8e2a-4578-8556-9d109c1e873e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: cdd44464-a057-4ebc-bf1e-ae14f5655133] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:43.965565 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a1470e8-8e2a-4578-8556-9d109c1e873e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:43.967106 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a1470e8-8e2a-4578-8556-9d109c1e873e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:43.968085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a1470e8-8e2a-4578-8556-9d109c1e873e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:43.969556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a1470e8-8e2a-4578-8556-9d109c1e873e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:43.970802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a1470e8-8e2a-4578-8556-9d109c1e873e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:43.971757 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a1470e8-8e2a-4578-8556-9d109c1e873e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:44.428376 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1b667907-d83c-4900-bc88-67e6d09ab8c7 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:44.456982 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1b667907-d83c-4900-bc88-67e6d09ab8c7 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf" status: 200 len: 1319 microversion: 2.1 time: 1.231192 Oct 29 02:50:44.472754 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 666/1304] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:43 2022] GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf => generated 1319 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:44.512958 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fc0af9a2-7dcb-410d-891b-58414fca6135 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:44.514424 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fc0af9a2-7dcb-410d-891b-58414fca6135 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:44.540670 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc0af9a2-7dcb-410d-891b-58414fca6135 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:44.542864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc0af9a2-7dcb-410d-891b-58414fca6135 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:44.544316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc0af9a2-7dcb-410d-891b-58414fca6135 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:44.548958 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc0af9a2-7dcb-410d-891b-58414fca6135 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:44.551376 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc0af9a2-7dcb-410d-891b-58414fca6135 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:44.552241 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc0af9a2-7dcb-410d-891b-58414fca6135 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:44.608003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0a1470e8-8e2a-4578-8556-9d109c1e873e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:44.622358 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0a1470e8-8e2a-4578-8556-9d109c1e873e tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133" status: 200 len: 1469 microversion: 2.1 time: 0.686645 Oct 29 02:50:44.627719 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 639/1305] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:43 2022] GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133 => generated 1469 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:45.092313 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:45.194160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fc0af9a2-7dcb-410d-891b-58414fca6135 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:45.212315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fc0af9a2-7dcb-410d-891b-58414fca6135 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:45.226286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fc0af9a2-7dcb-410d-891b-58414fca6135 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:45.257068 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fc0af9a2-7dcb-410d-891b-58414fca6135 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.751601 Oct 29 02:50:45.261768 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 667/1306] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:44 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:45.441529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-8bdb0ea8-98d8-431b-aaf6-c6c9e4aed3c2 req-3b56f630-b724-4f58-89a2-3982273bd5da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8533ddeb-4b9e-4e44-bb14-c92a8d171ecf", "tag": "0c3d35dc-ae83-4a64-89b0-ad0429ce9d5e"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:45.473362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8bdb0ea8-98d8-431b-aaf6-c6c9e4aed3c2 req-3b56f630-b724-4f58-89a2-3982273bd5da service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:45.477321 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8bdb0ea8-98d8-431b-aaf6-c6c9e4aed3c2 req-3b56f630-b724-4f58-89a2-3982273bd5da service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:45.478664 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8bdb0ea8-98d8-431b-aaf6-c6c9e4aed3c2 req-3b56f630-b724-4f58-89a2-3982273bd5da service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:45.502448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ee0cf2e2-b807-45b4-a515-332703b98de1 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:45.503800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ee0cf2e2-b807-45b4-a515-332703b98de1 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:45.517366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee0cf2e2-b807-45b4-a515-332703b98de1 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:45.521696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee0cf2e2-b807-45b4-a515-332703b98de1 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:45.526082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee0cf2e2-b807-45b4-a515-332703b98de1 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:45.529357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee0cf2e2-b807-45b4-a515-332703b98de1 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:45.530485 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-8bdb0ea8-98d8-431b-aaf6-c6c9e4aed3c2 req-3b56f630-b724-4f58-89a2-3982273bd5da service nova] Creating event network-changed:0c3d35dc-ae83-4a64-89b0-ad0429ce9d5e for instance 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf on n-h2-862967-2 Oct 29 02:50:45.538677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee0cf2e2-b807-45b4-a515-332703b98de1 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:45.541231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee0cf2e2-b807-45b4-a515-332703b98de1 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:45.564610 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-8bdb0ea8-98d8-431b-aaf6-c6c9e4aed3c2 req-3b56f630-b724-4f58-89a2-3982273bd5da service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158366 Oct 29 02:50:45.573517 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 640/1307] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:45.670325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5191a0a8-278f-44a9-a5e5-405480e527ca tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:45.671642 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5191a0a8-278f-44a9-a5e5-405480e527ca tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: cdd44464-a057-4ebc-bf1e-ae14f5655133] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:45.703703 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5191a0a8-278f-44a9-a5e5-405480e527ca tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:45.706469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5191a0a8-278f-44a9-a5e5-405480e527ca tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:45.708601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5191a0a8-278f-44a9-a5e5-405480e527ca tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:45.711169 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5191a0a8-278f-44a9-a5e5-405480e527ca tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:45.711676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5191a0a8-278f-44a9-a5e5-405480e527ca tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:45.715404 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5191a0a8-278f-44a9-a5e5-405480e527ca tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:45.785030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=8 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:46.401803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5191a0a8-278f-44a9-a5e5-405480e527ca tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:46.417696 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5191a0a8-278f-44a9-a5e5-405480e527ca tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133" status: 200 len: 1469 microversion: 2.1 time: 0.753136 Oct 29 02:50:46.421477 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 641/1308] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:45 2022] GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133 => generated 1469 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:46.434791 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5ee9afb2-7fcc-461b-9763-1580f8fd6c5e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:46.436729 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5ee9afb2-7fcc-461b-9763-1580f8fd6c5e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:46.454723 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ee9afb2-7fcc-461b-9763-1580f8fd6c5e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:46.456121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ee9afb2-7fcc-461b-9763-1580f8fd6c5e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:46.457384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ee9afb2-7fcc-461b-9763-1580f8fd6c5e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:46.460735 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ee9afb2-7fcc-461b-9763-1580f8fd6c5e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:46.461833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ee9afb2-7fcc-461b-9763-1580f8fd6c5e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:46.467661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ee9afb2-7fcc-461b-9763-1580f8fd6c5e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:46.472765 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:46.807821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ee0cf2e2-b807-45b4-a515-332703b98de1 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:46.825428 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ee0cf2e2-b807-45b4-a515-332703b98de1 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf" status: 200 len: 1319 microversion: 2.1 time: 1.322872 Oct 29 02:50:46.826665 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 668/1309] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:45 2022] GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf => generated 1319 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:46.989294 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5ee9afb2-7fcc-461b-9763-1580f8fd6c5e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:47.005152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5ee9afb2-7fcc-461b-9763-1580f8fd6c5e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:47.006875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5ee9afb2-7fcc-461b-9763-1580f8fd6c5e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:47.049167 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5ee9afb2-7fcc-461b-9763-1580f8fd6c5e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.618651 Oct 29 02:50:47.049878 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 642/1310] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:46 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:47.447976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ea6b2751-da65-4793-afd2-e18c6699c8da tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:47.449999 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ea6b2751-da65-4793-afd2-e18c6699c8da tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: cdd44464-a057-4ebc-bf1e-ae14f5655133] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:47.462774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea6b2751-da65-4793-afd2-e18c6699c8da tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:47.463764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea6b2751-da65-4793-afd2-e18c6699c8da tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:47.465124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea6b2751-da65-4793-afd2-e18c6699c8da tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:47.466900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea6b2751-da65-4793-afd2-e18c6699c8da tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:47.472114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea6b2751-da65-4793-afd2-e18c6699c8da tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:47.472747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea6b2751-da65-4793-afd2-e18c6699c8da tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:47.742954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ea6b2751-da65-4793-afd2-e18c6699c8da tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:47.775189 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ea6b2751-da65-4793-afd2-e18c6699c8da tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133" status: 200 len: 1427 microversion: 2.1 time: 0.330347 Oct 29 02:50:47.778314 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 669/1311] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:47 2022] GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133 => generated 1427 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:47.855003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c028fbd2-6c85-4b6d-8385-bef13e14b4cd tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:47.856983 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c028fbd2-6c85-4b6d-8385-bef13e14b4cd tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:47.891638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c028fbd2-6c85-4b6d-8385-bef13e14b4cd tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:47.892786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c028fbd2-6c85-4b6d-8385-bef13e14b4cd tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:47.899026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c028fbd2-6c85-4b6d-8385-bef13e14b4cd tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:47.907235 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c028fbd2-6c85-4b6d-8385-bef13e14b4cd tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:47.907887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c028fbd2-6c85-4b6d-8385-bef13e14b4cd tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:47.916159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c028fbd2-6c85-4b6d-8385-bef13e14b4cd tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:48.097218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-17d4e07b-083a-450d-9b87-80b33b624c9c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:48.097874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-17d4e07b-083a-450d-9b87-80b33b624c9c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:48.124274 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17d4e07b-083a-450d-9b87-80b33b624c9c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:48.125199 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17d4e07b-083a-450d-9b87-80b33b624c9c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:48.125897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17d4e07b-083a-450d-9b87-80b33b624c9c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:48.133828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17d4e07b-083a-450d-9b87-80b33b624c9c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:48.141378 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17d4e07b-083a-450d-9b87-80b33b624c9c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:48.142174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17d4e07b-083a-450d-9b87-80b33b624c9c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:48.491708 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-17d4e07b-083a-450d-9b87-80b33b624c9c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:48.510692 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-17d4e07b-083a-450d-9b87-80b33b624c9c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:48.523481 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-17d4e07b-083a-450d-9b87-80b33b624c9c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:48.551412 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-17d4e07b-083a-450d-9b87-80b33b624c9c tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.463814 Oct 29 02:50:48.558622 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 670/1312] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:48 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:50:48.857846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-f9295186-6f29-4c1e-a31d-4eba0973d6a2 req-f587b024-8165-4926-a785-fd5f5bfe5630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd44464-a057-4ebc-bf1e-ae14f5655133", "name": "network-vif-deleted", "tag": "61faf7f2-1384-4049-9c66-7da84c4010cc"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:48.892640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f9295186-6f29-4c1e-a31d-4eba0973d6a2 req-f587b024-8165-4926-a785-fd5f5bfe5630 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:48.904495 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f9295186-6f29-4c1e-a31d-4eba0973d6a2 req-f587b024-8165-4926-a785-fd5f5bfe5630 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:48.909485 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f9295186-6f29-4c1e-a31d-4eba0973d6a2 req-f587b024-8165-4926-a785-fd5f5bfe5630 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:48.970981 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c028fbd2-6c85-4b6d-8385-bef13e14b4cd tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:48.984926 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c028fbd2-6c85-4b6d-8385-bef13e14b4cd tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf" status: 200 len: 1319 microversion: 2.1 time: 1.136248 Oct 29 02:50:48.989380 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 643/1313] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:47 2022] GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf => generated 1319 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:48.990929 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-f9295186-6f29-4c1e-a31d-4eba0973d6a2 req-f587b024-8165-4926-a785-fd5f5bfe5630 service nova] Creating event network-vif-deleted:61faf7f2-1384-4049-9c66-7da84c4010cc for instance cdd44464-a057-4ebc-bf1e-ae14f5655133 on n-h1-862967-2 Oct 29 02:50:49.001235 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-63a96b02-dc64-40a7-a2c4-e3cc76d21781 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:49.002024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-63a96b02-dc64-40a7-a2c4-e3cc76d21781 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: cdd44464-a057-4ebc-bf1e-ae14f5655133] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:49.019362 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-f9295186-6f29-4c1e-a31d-4eba0973d6a2 req-f587b024-8165-4926-a785-fd5f5bfe5630 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.453391 Oct 29 02:50:49.020344 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 671/1314] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:49.033333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63a96b02-dc64-40a7-a2c4-e3cc76d21781 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:49.033843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63a96b02-dc64-40a7-a2c4-e3cc76d21781 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:49.043501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63a96b02-dc64-40a7-a2c4-e3cc76d21781 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:49.047508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63a96b02-dc64-40a7-a2c4-e3cc76d21781 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:49.048072 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63a96b02-dc64-40a7-a2c4-e3cc76d21781 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:49.051700 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63a96b02-dc64-40a7-a2c4-e3cc76d21781 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:49.222177 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63a96b02-dc64-40a7-a2c4-e3cc76d21781 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:49.223562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63a96b02-dc64-40a7-a2c4-e3cc76d21781 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:49.224004 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63a96b02-dc64-40a7-a2c4-e3cc76d21781 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:49.224469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-63a96b02-dc64-40a7-a2c4-e3cc76d21781 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lazy-loading 'fault' on Instance uuid cdd44464-a057-4ebc-bf1e-ae14f5655133 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:50:49.607028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6abc8645-c441-44cf-ad8c-ab12c09122c2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:49.613967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6abc8645-c441-44cf-ad8c-ab12c09122c2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:49.649570 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6abc8645-c441-44cf-ad8c-ab12c09122c2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:49.650401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6abc8645-c441-44cf-ad8c-ab12c09122c2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:49.652000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6abc8645-c441-44cf-ad8c-ab12c09122c2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:49.658425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6abc8645-c441-44cf-ad8c-ab12c09122c2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:49.659434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6abc8645-c441-44cf-ad8c-ab12c09122c2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:49.660458 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6abc8645-c441-44cf-ad8c-ab12c09122c2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:49.673484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-63a96b02-dc64-40a7-a2c4-e3cc76d21781 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:49.688746 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-63a96b02-dc64-40a7-a2c4-e3cc76d21781 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133" status: 200 len: 1303 microversion: 2.1 time: 0.695895 Oct 29 02:50:49.691888 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 644/1315] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:48 2022] GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133 => generated 1303 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:50.028762 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3837f8ae-2266-4d19-911a-a27737634900 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:50.029632 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3837f8ae-2266-4d19-911a-a27737634900 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:50.031610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6abc8645-c441-44cf-ad8c-ab12c09122c2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:50.042973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6abc8645-c441-44cf-ad8c-ab12c09122c2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:50.047496 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6abc8645-c441-44cf-ad8c-ab12c09122c2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:50.076128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3837f8ae-2266-4d19-911a-a27737634900 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:50.076569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3837f8ae-2266-4d19-911a-a27737634900 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:50.087692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3837f8ae-2266-4d19-911a-a27737634900 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:50.092630 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6abc8645-c441-44cf-ad8c-ab12c09122c2 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.493857 Oct 29 02:50:50.093123 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3837f8ae-2266-4d19-911a-a27737634900 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:50.096721 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 672/1316] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:49 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:50.097368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3837f8ae-2266-4d19-911a-a27737634900 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:50.101707 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3837f8ae-2266-4d19-911a-a27737634900 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:50.729828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0bce2fb2-98df-4d78-ad13-4f0c5da8d9ad tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:50.731247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0bce2fb2-98df-4d78-ad13-4f0c5da8d9ad tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: cdd44464-a057-4ebc-bf1e-ae14f5655133] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:50.746328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0bce2fb2-98df-4d78-ad13-4f0c5da8d9ad tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:50.749538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0bce2fb2-98df-4d78-ad13-4f0c5da8d9ad tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:50.752682 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0bce2fb2-98df-4d78-ad13-4f0c5da8d9ad tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:50.755868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0bce2fb2-98df-4d78-ad13-4f0c5da8d9ad tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:50.757426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0bce2fb2-98df-4d78-ad13-4f0c5da8d9ad tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:50.758067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0bce2fb2-98df-4d78-ad13-4f0c5da8d9ad tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:50.834472 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-0bce2fb2-98df-4d78-ad13-4f0c5da8d9ad tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] HTTP exception thrown: Instance cdd44464-a057-4ebc-bf1e-ae14f5655133 could not be found. Oct 29 02:50:50.845235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0bce2fb2-98df-4d78-ad13-4f0c5da8d9ad tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Request method failure captured: Oct 29 02:50:50.845235 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133 HTTP/1.1 Oct 29 02:50:50.845235 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:50:50.845235 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:50:50.845235 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:50:50.845235 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:50:50.845235 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:50:50.845235 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:50:50.845235 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:50:50.845235 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:50:50.845235 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJRoHCWy3eaalTzy633NKtthGuR8cipMYZT4TZduF4CgY52OX0OOpML7WqYw8-VIRxPW99b65GZIkiKdDgfKNq60yFm1GPny914hL20N63ngfutS-kJRSz6ZtVnTXUNMfN8pE5XYxJYxK52qSiGCFE4HtBfmAAy92aY_DysIm4md9Uo Oct 29 02:50:50.845235 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:50:50.845235 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:50:50.845235 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:50:50.845235 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:50:50.845235 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:50:50.845235 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:50:50.845235 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 24ee44ab29014be1bff1c5a18c53c2e2 Oct 29 02:50:50.845235 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersAdminTestJSON-1366919160 Oct 29 02:50:50.845235 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:50:50.845235 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:50:50.846971 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/24ee44ab29014be1bff1c5a18c53c2e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/24ee44ab29014be1bff1c5a18c53c2e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_24ee44ab29014be1bff1c5a18c53c2e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/24ee44ab29014be1bff1c5a18c53c2e2"}]}] Oct 29 02:50:50.846971 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersAdminTestJSON-1366919160 Oct 29 02:50:50.846971 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 24ee44ab29014be1bff1c5a18c53c2e2 Oct 29 02:50:50.846971 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersAdminTestJSON-1366919160 Oct 29 02:50:50.846971 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersAdminTestJSON-1366919160-project Oct 29 02:50:50.846971 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:50:50.846971 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:50:50.846971 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 8a6ba7c1ab324fe583f5ad27474cafc2 Oct 29 02:50:50.846971 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersAdminTestJSON-1366919160-project Oct 29 02:50:50.846971 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:50:50.846971 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance cdd44464-a057-4ebc-bf1e-ae14f5655133 could not be found. Oct 29 02:50:50.846971 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'cdd44464-a057-4ebc-bf1e-ae14f5655133'} Oct 29 02:50:50.848228 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:50:50.848228 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:50.848228 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:50:50.848228 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:50:50.848228 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:50:50.848228 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:50:50.848228 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:50:50.848228 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:50:50.848228 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:50:50.848228 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:50:50.848228 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdd44464-a057-4ebc-bf1e-ae14f5655133 could not be found. Oct 29 02:50:50.848228 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:50:50.848228 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:50.848228 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:50:50.848228 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:50.848228 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:50.848228 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:50.848228 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:50:50.848228 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:50:50.848228 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:50:50.849887 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:50:50.849887 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:50:50.849887 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:50:50.849887 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:50:50.849887 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:50:50.849887 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:50:50.849887 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:50:50.849887 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdd44464-a057-4ebc-bf1e-ae14f5655133 could not be found. Oct 29 02:50:50.849887 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:50:50.849887 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:50:50.849887 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:50:50.849887 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:50:50.849887 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:50:50.849887 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:50:50.849887 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:50:50.849887 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:50:50.849887 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdd44464-a057-4ebc-bf1e-ae14f5655133 could not be found. Oct 29 02:50:50.849887 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:50:50.855236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0bce2fb2-98df-4d78-ad13-4f0c5da8d9ad tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Returning 404 to user: Instance cdd44464-a057-4ebc-bf1e-ae14f5655133 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:50:50.862283 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0bce2fb2-98df-4d78-ad13-4f0c5da8d9ad tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133" status: 404 len: 111 microversion: 2.1 time: 0.148889 Oct 29 02:50:50.867500 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 673/1317] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:50 2022] GET /compute/v2.1/servers/cdd44464-a057-4ebc-bf1e-ae14f5655133 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:50:50.892975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c54a911d-2b84-4bcb-a1f3-67d166c4f4e2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:50.894040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c54a911d-2b84-4bcb-a1f3-67d166c4f4e2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 34d62a74-da30-4154-adfe-289eb2ad7564] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:50.918217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c54a911d-2b84-4bcb-a1f3-67d166c4f4e2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:50.921230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c54a911d-2b84-4bcb-a1f3-67d166c4f4e2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:50.927736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c54a911d-2b84-4bcb-a1f3-67d166c4f4e2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:50.930195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c54a911d-2b84-4bcb-a1f3-67d166c4f4e2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:50.930850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c54a911d-2b84-4bcb-a1f3-67d166c4f4e2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:50.933598 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c54a911d-2b84-4bcb-a1f3-67d166c4f4e2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:50.947964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:51.022081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c54a911d-2b84-4bcb-a1f3-67d166c4f4e2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 34d62a74-da30-4154-adfe-289eb2ad7564] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:50:51.150970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3837f8ae-2266-4d19-911a-a27737634900 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:51.165872 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3837f8ae-2266-4d19-911a-a27737634900 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf" status: 200 len: 1319 microversion: 2.1 time: 1.151814 Oct 29 02:50:51.173361 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 645/1318] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:50 2022] GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf => generated 1319 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:51.200218 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c9a21fa9-3d52-415b-9e89-0f89fdf4a23f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:51.207715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c9a21fa9-3d52-415b-9e89-0f89fdf4a23f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:51.242055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c9a21fa9-3d52-415b-9e89-0f89fdf4a23f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:51.248562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c9a21fa9-3d52-415b-9e89-0f89fdf4a23f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:51.254688 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c9a21fa9-3d52-415b-9e89-0f89fdf4a23f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:51.261356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c9a21fa9-3d52-415b-9e89-0f89fdf4a23f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:51.263235 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c9a21fa9-3d52-415b-9e89-0f89fdf4a23f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:51.269149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c9a21fa9-3d52-415b-9e89-0f89fdf4a23f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:51.455069 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c54a911d-2b84-4bcb-a1f3-67d166c4f4e2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "DELETE /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564" status: 204 len: 0 microversion: 2.1 time: 0.580568 Oct 29 02:50:51.463260 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 674/1319] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:50:50 2022] DELETE /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:50:51.487782 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-84ad5039-bc9c-470c-8246-77645ded0137 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:51.488884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-84ad5039-bc9c-470c-8246-77645ded0137 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 34d62a74-da30-4154-adfe-289eb2ad7564] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:51.507358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-84ad5039-bc9c-470c-8246-77645ded0137 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:51.508444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-84ad5039-bc9c-470c-8246-77645ded0137 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:51.510574 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-84ad5039-bc9c-470c-8246-77645ded0137 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:51.512600 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-84ad5039-bc9c-470c-8246-77645ded0137 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:51.514273 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-84ad5039-bc9c-470c-8246-77645ded0137 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:51.516859 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-84ad5039-bc9c-470c-8246-77645ded0137 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:51.550364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c9a21fa9-3d52-415b-9e89-0f89fdf4a23f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:51.567541 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c9a21fa9-3d52-415b-9e89-0f89fdf4a23f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:51.572608 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c9a21fa9-3d52-415b-9e89-0f89fdf4a23f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:51.586741 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c9a21fa9-3d52-415b-9e89-0f89fdf4a23f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.409459 Oct 29 02:50:51.597999 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 646/1320] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:51 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:52.203235 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3ca6cb47-c2f1-4e03-b0ba-e28301d3000d tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:52.205289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3ca6cb47-c2f1-4e03-b0ba-e28301d3000d tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:52.216658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ca6cb47-c2f1-4e03-b0ba-e28301d3000d tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:52.231345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ca6cb47-c2f1-4e03-b0ba-e28301d3000d tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:52.235879 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ca6cb47-c2f1-4e03-b0ba-e28301d3000d tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:52.237120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ca6cb47-c2f1-4e03-b0ba-e28301d3000d tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:52.237756 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ca6cb47-c2f1-4e03-b0ba-e28301d3000d tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:52.244093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ca6cb47-c2f1-4e03-b0ba-e28301d3000d tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:52.631580 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3ca6cb47-c2f1-4e03-b0ba-e28301d3000d tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:52.664164 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3ca6cb47-c2f1-4e03-b0ba-e28301d3000d tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf" status: 200 len: 1319 microversion: 2.1 time: 0.463389 Oct 29 02:50:52.669513 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 647/1321] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:52 2022] GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf => generated 1319 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:52.693120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2aa67747-b99d-4d34-8d4f-692f8c997007 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:52.694217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2aa67747-b99d-4d34-8d4f-692f8c997007 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:52.724184 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2aa67747-b99d-4d34-8d4f-692f8c997007 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:52.725141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2aa67747-b99d-4d34-8d4f-692f8c997007 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:52.725611 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2aa67747-b99d-4d34-8d4f-692f8c997007 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:52.726759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2aa67747-b99d-4d34-8d4f-692f8c997007 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:52.728514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2aa67747-b99d-4d34-8d4f-692f8c997007 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:52.731941 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2aa67747-b99d-4d34-8d4f-692f8c997007 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:52.931275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-84ad5039-bc9c-470c-8246-77645ded0137 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:52.987249 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-84ad5039-bc9c-470c-8246-77645ded0137 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564" status: 200 len: 1470 microversion: 2.1 time: 1.520330 Oct 29 02:50:52.991186 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 675/1322] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:51 2022] GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564 => generated 1470 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:53.001641 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2aa67747-b99d-4d34-8d4f-692f8c997007 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:53.022499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2aa67747-b99d-4d34-8d4f-692f8c997007 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:53.029851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2aa67747-b99d-4d34-8d4f-692f8c997007 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:53.045028 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2aa67747-b99d-4d34-8d4f-692f8c997007 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.373117 Oct 29 02:50:53.046388 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 648/1323] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:52 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:53.306303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-f589a295-8357-4c60-935a-7a5a5484686e req-462386e1-1372-4cff-9f71-602cb370ff9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8533ddeb-4b9e-4e44-bb14-c92a8d171ecf", "name": "network-vif-plugged", "status": "completed", "tag": "0c3d35dc-ae83-4a64-89b0-ad0429ce9d5e"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:53.351502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f589a295-8357-4c60-935a-7a5a5484686e req-462386e1-1372-4cff-9f71-602cb370ff9d service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:53.354559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f589a295-8357-4c60-935a-7a5a5484686e req-462386e1-1372-4cff-9f71-602cb370ff9d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:53.357907 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f589a295-8357-4c60-935a-7a5a5484686e req-462386e1-1372-4cff-9f71-602cb370ff9d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:53.411638 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-f589a295-8357-4c60-935a-7a5a5484686e req-462386e1-1372-4cff-9f71-602cb370ff9d service nova] Creating event network-vif-plugged:0c3d35dc-ae83-4a64-89b0-ad0429ce9d5e for instance 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf on n-h2-862967-2 Oct 29 02:50:53.424626 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-f589a295-8357-4c60-935a-7a5a5484686e req-462386e1-1372-4cff-9f71-602cb370ff9d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124998 Oct 29 02:50:53.435621 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 676/1324] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:53.702786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9dd07604-e811-40fd-9c20-59b5104854ee tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:53.714150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9dd07604-e811-40fd-9c20-59b5104854ee tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:53.747654 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:53.751715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9dd07604-e811-40fd-9c20-59b5104854ee tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:53.753362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9dd07604-e811-40fd-9c20-59b5104854ee tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:53.755407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9dd07604-e811-40fd-9c20-59b5104854ee tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:53.757326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9dd07604-e811-40fd-9c20-59b5104854ee tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:53.758419 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9dd07604-e811-40fd-9c20-59b5104854ee tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:53.759484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9dd07604-e811-40fd-9c20-59b5104854ee tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:54.044564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fef2e71e-607f-4e69-a4d4-99ed9448834c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:54.044564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fef2e71e-607f-4e69-a4d4-99ed9448834c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 34d62a74-da30-4154-adfe-289eb2ad7564] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:54.059693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fef2e71e-607f-4e69-a4d4-99ed9448834c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:54.060358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fef2e71e-607f-4e69-a4d4-99ed9448834c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:54.061039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fef2e71e-607f-4e69-a4d4-99ed9448834c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:54.064784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fef2e71e-607f-4e69-a4d4-99ed9448834c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:54.068148 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fef2e71e-607f-4e69-a4d4-99ed9448834c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:54.069272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fef2e71e-607f-4e69-a4d4-99ed9448834c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:54.460418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fef2e71e-607f-4e69-a4d4-99ed9448834c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:54.475731 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fef2e71e-607f-4e69-a4d4-99ed9448834c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564" status: 200 len: 1470 microversion: 2.1 time: 0.458894 Oct 29 02:50:54.477279 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 677/1325] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:54 2022] GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564 => generated 1470 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:54.483278 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-649cdb05-6d65-4e7d-94a6-18d07ede67cd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:54.484155 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-649cdb05-6d65-4e7d-94a6-18d07ede67cd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:54.493948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-649cdb05-6d65-4e7d-94a6-18d07ede67cd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:54.494723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-649cdb05-6d65-4e7d-94a6-18d07ede67cd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:54.495368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-649cdb05-6d65-4e7d-94a6-18d07ede67cd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:54.496363 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-649cdb05-6d65-4e7d-94a6-18d07ede67cd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:54.497011 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-649cdb05-6d65-4e7d-94a6-18d07ede67cd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:54.497609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-649cdb05-6d65-4e7d-94a6-18d07ede67cd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:54.678153 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-649cdb05-6d65-4e7d-94a6-18d07ede67cd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:54.695743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-649cdb05-6d65-4e7d-94a6-18d07ede67cd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:54.706075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-649cdb05-6d65-4e7d-94a6-18d07ede67cd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:54.741801 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-649cdb05-6d65-4e7d-94a6-18d07ede67cd tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.256626 Oct 29 02:50:54.747142 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 678/1326] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:54 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:54.904936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5a2be737-87f8-4953-bad6-4d0977dc1bc6 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:54.905437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5a2be737-87f8-4953-bad6-4d0977dc1bc6 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] [instance: de40ca11-d29b-4457-ad27-807bfb1acc65] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:54.918178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a2be737-87f8-4953-bad6-4d0977dc1bc6 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:54.919627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a2be737-87f8-4953-bad6-4d0977dc1bc6 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:54.921033 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a2be737-87f8-4953-bad6-4d0977dc1bc6 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:54.921940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a2be737-87f8-4953-bad6-4d0977dc1bc6 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:54.924106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a2be737-87f8-4953-bad6-4d0977dc1bc6 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:54.924732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a2be737-87f8-4953-bad6-4d0977dc1bc6 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:55.008887 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5a2be737-87f8-4953-bad6-4d0977dc1bc6 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] [instance: de40ca11-d29b-4457-ad27-807bfb1acc65] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:50:55.410869 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5a2be737-87f8-4953-bad6-4d0977dc1bc6 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] 10.222.0.46 "DELETE /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65" status: 204 len: 0 microversion: 2.1 time: 0.509013 Oct 29 02:50:55.416080 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 679/1327] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:50:54 2022] DELETE /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:50:55.434880 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3c1f5164-4b96-4e49-93ab-1cf0636fa4bc tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:55.437485 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3c1f5164-4b96-4e49-93ab-1cf0636fa4bc tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] [instance: de40ca11-d29b-4457-ad27-807bfb1acc65] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:55.462229 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c1f5164-4b96-4e49-93ab-1cf0636fa4bc tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:55.467589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c1f5164-4b96-4e49-93ab-1cf0636fa4bc tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:55.468577 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c1f5164-4b96-4e49-93ab-1cf0636fa4bc tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:55.470152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c1f5164-4b96-4e49-93ab-1cf0636fa4bc tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:55.473102 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c1f5164-4b96-4e49-93ab-1cf0636fa4bc tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:55.475261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c1f5164-4b96-4e49-93ab-1cf0636fa4bc tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:55.851600 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3c1f5164-4b96-4e49-93ab-1cf0636fa4bc tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2955d25314a42259483d8ccbfd7ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520485bb54544a3389cec22317db2d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:55.862997 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3c1f5164-4b96-4e49-93ab-1cf0636fa4bc tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] 10.222.0.46 "GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65" status: 200 len: 1666 microversion: 2.1 time: 0.441579 Oct 29 02:50:55.871023 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 680/1328] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:55 2022] GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65 => generated 1666 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:55.879145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8718b793-8849-4f76-8ed1-4843fe1b23a0 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:55.893332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8718b793-8849-4f76-8ed1-4843fe1b23a0 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 34d62a74-da30-4154-adfe-289eb2ad7564] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:55.914703 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8718b793-8849-4f76-8ed1-4843fe1b23a0 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:55.915227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8718b793-8849-4f76-8ed1-4843fe1b23a0 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:55.915669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8718b793-8849-4f76-8ed1-4843fe1b23a0 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:55.916412 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8718b793-8849-4f76-8ed1-4843fe1b23a0 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:55.920262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8718b793-8849-4f76-8ed1-4843fe1b23a0 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:55.920778 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8718b793-8849-4f76-8ed1-4843fe1b23a0 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:56.237058 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9dd07604-e811-40fd-9c20-59b5104854ee tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:56.250003 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9dd07604-e811-40fd-9c20-59b5104854ee tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf" status: 200 len: 1319 microversion: 2.1 time: 2.556113 Oct 29 02:50:56.251329 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 649/1329] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:53 2022] GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf => generated 1319 bytes in 2560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:56.258733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0a78b0d4-31fa-4af9-986b-5c343c1abd59 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:56.261584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0a78b0d4-31fa-4af9-986b-5c343c1abd59 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:56.279490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a78b0d4-31fa-4af9-986b-5c343c1abd59 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:56.280230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a78b0d4-31fa-4af9-986b-5c343c1abd59 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:56.294516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a78b0d4-31fa-4af9-986b-5c343c1abd59 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:56.295733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a78b0d4-31fa-4af9-986b-5c343c1abd59 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:56.298798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a78b0d4-31fa-4af9-986b-5c343c1abd59 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:56.300502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a78b0d4-31fa-4af9-986b-5c343c1abd59 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:56.366388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8718b793-8849-4f76-8ed1-4843fe1b23a0 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:56.384420 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8718b793-8849-4f76-8ed1-4843fe1b23a0 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564" status: 200 len: 1470 microversion: 2.1 time: 0.511616 Oct 29 02:50:56.386490 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 681/1330] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:55 2022] GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564 => generated 1470 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:56.502381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0a78b0d4-31fa-4af9-986b-5c343c1abd59 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:56.518238 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0a78b0d4-31fa-4af9-986b-5c343c1abd59 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:56.520110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0a78b0d4-31fa-4af9-986b-5c343c1abd59 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:56.529592 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0a78b0d4-31fa-4af9-986b-5c343c1abd59 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.276873 Oct 29 02:50:56.532574 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 650/1331] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:56 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:56.899697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e52e6aa1-25bb-4927-a626-1501ca9e0594 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:56.901028 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e52e6aa1-25bb-4927-a626-1501ca9e0594 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] [instance: de40ca11-d29b-4457-ad27-807bfb1acc65] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:56.916391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e52e6aa1-25bb-4927-a626-1501ca9e0594 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:56.924199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e52e6aa1-25bb-4927-a626-1501ca9e0594 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:56.925997 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e52e6aa1-25bb-4927-a626-1501ca9e0594 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:56.931208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e52e6aa1-25bb-4927-a626-1501ca9e0594 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:56.934058 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e52e6aa1-25bb-4927-a626-1501ca9e0594 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:56.936134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e52e6aa1-25bb-4927-a626-1501ca9e0594 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:57.461569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-87e9d584-3fb5-4e55-8ac9-07244faa0dc8 tempest-AZV2TestJSON-2115630819 tempest-AZV2TestJSON-2115630819-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:57.475489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87e9d584-3fb5-4e55-8ac9-07244faa0dc8 tempest-AZV2TestJSON-2115630819 tempest-AZV2TestJSON-2115630819-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:57.476424 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87e9d584-3fb5-4e55-8ac9-07244faa0dc8 tempest-AZV2TestJSON-2115630819 tempest-AZV2TestJSON-2115630819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:57.494537 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87e9d584-3fb5-4e55-8ac9-07244faa0dc8 tempest-AZV2TestJSON-2115630819 tempest-AZV2TestJSON-2115630819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:57.504611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87e9d584-3fb5-4e55-8ac9-07244faa0dc8 tempest-AZV2TestJSON-2115630819 tempest-AZV2TestJSON-2115630819-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:57.505891 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87e9d584-3fb5-4e55-8ac9-07244faa0dc8 tempest-AZV2TestJSON-2115630819 tempest-AZV2TestJSON-2115630819-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:57.509859 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87e9d584-3fb5-4e55-8ac9-07244faa0dc8 tempest-AZV2TestJSON-2115630819 tempest-AZV2TestJSON-2115630819-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:57.674421 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-87e9d584-3fb5-4e55-8ac9-07244faa0dc8 tempest-AZV2TestJSON-2115630819 tempest-AZV2TestJSON-2115630819-project] 10.222.0.46 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.023371 Oct 29 02:50:57.698084 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 682/1332] 10.222.0.46 () {58 vars in 1164 bytes} [Sat Oct 29 02:50:56 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:50:57.719641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-37d6bcf1-799e-4874-b8bb-649034af5cca tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:57.745454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-37d6bcf1-799e-4874-b8bb-649034af5cca tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:57.766210 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37d6bcf1-799e-4874-b8bb-649034af5cca tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:57.771219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37d6bcf1-799e-4874-b8bb-649034af5cca tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:57.774073 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37d6bcf1-799e-4874-b8bb-649034af5cca tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:57.775939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37d6bcf1-799e-4874-b8bb-649034af5cca tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:57.780345 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37d6bcf1-799e-4874-b8bb-649034af5cca tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:57.784193 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37d6bcf1-799e-4874-b8bb-649034af5cca tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:58.022222 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-37d6bcf1-799e-4874-b8bb-649034af5cca tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.322939 Oct 29 02:50:58.024442 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 683/1333] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 02:50:57 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54/os-volume_attachments => generated 25 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:50:58.042351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4ae6ebb6-c421-4f4a-8a7a-f5237f4737c0 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:58.046351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4ae6ebb6-c421-4f4a-8a7a-f5237f4737c0 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:58.068912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ae6ebb6-c421-4f4a-8a7a-f5237f4737c0 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:58.074784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ae6ebb6-c421-4f4a-8a7a-f5237f4737c0 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:58.076747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ae6ebb6-c421-4f4a-8a7a-f5237f4737c0 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:58.079383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ae6ebb6-c421-4f4a-8a7a-f5237f4737c0 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:58.082587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ae6ebb6-c421-4f4a-8a7a-f5237f4737c0 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:58.083339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ae6ebb6-c421-4f4a-8a7a-f5237f4737c0 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:58.429517 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e52e6aa1-25bb-4927-a626-1501ca9e0594 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2955d25314a42259483d8ccbfd7ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520485bb54544a3389cec22317db2d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:58.464430 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e52e6aa1-25bb-4927-a626-1501ca9e0594 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] 10.222.0.46 "GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65" status: 200 len: 1666 microversion: 2.1 time: 1.570220 Oct 29 02:50:58.480567 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 651/1334] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:56 2022] GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65 => generated 1666 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:50:58.501143 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-572b7eb0-0bff-4930-9ba6-83342d9eab1c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:58.502242 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-572b7eb0-0bff-4930-9ba6-83342d9eab1c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 34d62a74-da30-4154-adfe-289eb2ad7564] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:58.547518 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-572b7eb0-0bff-4930-9ba6-83342d9eab1c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:58.548042 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-572b7eb0-0bff-4930-9ba6-83342d9eab1c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:58.548490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-572b7eb0-0bff-4930-9ba6-83342d9eab1c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:58.549847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-572b7eb0-0bff-4930-9ba6-83342d9eab1c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:58.550348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-572b7eb0-0bff-4930-9ba6-83342d9eab1c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:58.553450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-572b7eb0-0bff-4930-9ba6-83342d9eab1c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:58.721954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-572b7eb0-0bff-4930-9ba6-83342d9eab1c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:58.727272 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-572b7eb0-0bff-4930-9ba6-83342d9eab1c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:58.731947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-572b7eb0-0bff-4930-9ba6-83342d9eab1c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:58.737549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-572b7eb0-0bff-4930-9ba6-83342d9eab1c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lazy-loading 'fault' on Instance uuid 34d62a74-da30-4154-adfe-289eb2ad7564 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:50:59.137235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4ae6ebb6-c421-4f4a-8a7a-f5237f4737c0 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:59.158667 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4ae6ebb6-c421-4f4a-8a7a-f5237f4737c0 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf" status: 200 len: 1469 microversion: 2.1 time: 1.127591 Oct 29 02:50:59.161713 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 684/1335] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:58 2022] GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf => generated 1469 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:59.173949 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-7b82955b-a988-4e42-bc9a-77e7b0d0ebf3 req-31de3642-aea8-43f2-b43e-733a3b92e781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d62a74-da30-4154-adfe-289eb2ad7564", "name": "network-vif-deleted", "tag": "56c5251b-c2b7-4702-8b66-f7e375331456"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:50:59.206010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7b82955b-a988-4e42-bc9a-77e7b0d0ebf3 req-31de3642-aea8-43f2-b43e-733a3b92e781 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:59.209392 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7b82955b-a988-4e42-bc9a-77e7b0d0ebf3 req-31de3642-aea8-43f2-b43e-733a3b92e781 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:59.210219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7b82955b-a988-4e42-bc9a-77e7b0d0ebf3 req-31de3642-aea8-43f2-b43e-733a3b92e781 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:59.215518 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-572b7eb0-0bff-4930-9ba6-83342d9eab1c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:59.236398 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-572b7eb0-0bff-4930-9ba6-83342d9eab1c tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564" status: 200 len: 1304 microversion: 2.1 time: 0.761036 Oct 29 02:50:59.243435 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-7b82955b-a988-4e42-bc9a-77e7b0d0ebf3 req-31de3642-aea8-43f2-b43e-733a3b92e781 service nova] Creating event network-vif-deleted:56c5251b-c2b7-4702-8b66-f7e375331456 for instance 34d62a74-da30-4154-adfe-289eb2ad7564 on n-h2-862967-2 Oct 29 02:50:59.248856 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 652/1336] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:58 2022] GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564 => generated 1304 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:50:59.259415 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-7b82955b-a988-4e42-bc9a-77e7b0d0ebf3 req-31de3642-aea8-43f2-b43e-733a3b92e781 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094835 Oct 29 02:50:59.265086 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 685/1337] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:50:59.274025 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-de9a45b9-cd7d-4168-8898-796081647150 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:59.278067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cdf68655-75c1-4986-abed-8027ee13625f tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:59.279695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-de9a45b9-cd7d-4168-8898-796081647150 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:59.301934 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cdf68655-75c1-4986-abed-8027ee13625f tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:59.324149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-de9a45b9-cd7d-4168-8898-796081647150 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:59.329676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-de9a45b9-cd7d-4168-8898-796081647150 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:59.331800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-de9a45b9-cd7d-4168-8898-796081647150 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:59.335556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cdf68655-75c1-4986-abed-8027ee13625f tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:59.337849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-de9a45b9-cd7d-4168-8898-796081647150 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:59.338891 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cdf68655-75c1-4986-abed-8027ee13625f tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:59.340998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cdf68655-75c1-4986-abed-8027ee13625f tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:59.341776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-de9a45b9-cd7d-4168-8898-796081647150 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:59.342594 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-de9a45b9-cd7d-4168-8898-796081647150 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:59.349713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cdf68655-75c1-4986-abed-8027ee13625f tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:59.353604 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cdf68655-75c1-4986-abed-8027ee13625f tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:59.355234 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cdf68655-75c1-4986-abed-8027ee13625f tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:59.498007 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cdf68655-75c1-4986-abed-8027ee13625f tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.225816 Oct 29 02:50:59.501045 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 686/1338] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 02:50:59 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54/os-volume_attachments => generated 25 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:50:59.714181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-de9a45b9-cd7d-4168-8898-796081647150 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:59.758571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-de9a45b9-cd7d-4168-8898-796081647150 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:59.769981 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-de9a45b9-cd7d-4168-8898-796081647150 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:50:59.803589 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-de9a45b9-cd7d-4168-8898-796081647150 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.549744 Oct 29 02:50:59.808317 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 653/1339] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:50:59 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:50:59.820431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fffc8d79-a42f-41b6-affd-22db232dfb9a tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:50:59.821553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fffc8d79-a42f-41b6-affd-22db232dfb9a tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] [instance: de40ca11-d29b-4457-ad27-807bfb1acc65] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:50:59.832489 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fffc8d79-a42f-41b6-affd-22db232dfb9a tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:59.834456 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fffc8d79-a42f-41b6-affd-22db232dfb9a tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:59.835595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fffc8d79-a42f-41b6-affd-22db232dfb9a tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:50:59.837060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fffc8d79-a42f-41b6-affd-22db232dfb9a tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:50:59.838022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fffc8d79-a42f-41b6-affd-22db232dfb9a tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:50:59.838922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fffc8d79-a42f-41b6-affd-22db232dfb9a tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:00.102816 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fffc8d79-a42f-41b6-affd-22db232dfb9a tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2955d25314a42259483d8ccbfd7ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520485bb54544a3389cec22317db2d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:00.120993 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fffc8d79-a42f-41b6-affd-22db232dfb9a tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] 10.222.0.46 "GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65" status: 200 len: 1599 microversion: 2.1 time: 0.310290 Oct 29 02:51:00.122350 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 654/1340] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:50:59 2022] GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65 => generated 1599 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:00.134764 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-272ad054-f964-4e82-9fbe-75d5b6ffde4e tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:00.136916 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-272ad054-f964-4e82-9fbe-75d5b6ffde4e tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:00.149716 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-272ad054-f964-4e82-9fbe-75d5b6ffde4e tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:00.153159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-272ad054-f964-4e82-9fbe-75d5b6ffde4e tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:00.155420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-272ad054-f964-4e82-9fbe-75d5b6ffde4e tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:00.156384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-272ad054-f964-4e82-9fbe-75d5b6ffde4e tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:00.157868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-272ad054-f964-4e82-9fbe-75d5b6ffde4e tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:00.159126 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-272ad054-f964-4e82-9fbe-75d5b6ffde4e tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:00.279590 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-272ad054-f964-4e82-9fbe-75d5b6ffde4e tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:51:00.321377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c1190ed6-ac42-415a-9a05-5cd10e702d16 tempest-DeleteServersAdminTestJSON-312124499 tempest-DeleteServersAdminTestJSON-312124499-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:00.322328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c1190ed6-ac42-415a-9a05-5cd10e702d16 tempest-DeleteServersAdminTestJSON-312124499 tempest-DeleteServersAdminTestJSON-312124499-project-admin] [instance: 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:00.347463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1190ed6-ac42-415a-9a05-5cd10e702d16 tempest-DeleteServersAdminTestJSON-312124499 tempest-DeleteServersAdminTestJSON-312124499-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:00.348363 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1190ed6-ac42-415a-9a05-5cd10e702d16 tempest-DeleteServersAdminTestJSON-312124499 tempest-DeleteServersAdminTestJSON-312124499-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:00.353836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1190ed6-ac42-415a-9a05-5cd10e702d16 tempest-DeleteServersAdminTestJSON-312124499 tempest-DeleteServersAdminTestJSON-312124499-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:00.356899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1190ed6-ac42-415a-9a05-5cd10e702d16 tempest-DeleteServersAdminTestJSON-312124499 tempest-DeleteServersAdminTestJSON-312124499-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:00.358025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1190ed6-ac42-415a-9a05-5cd10e702d16 tempest-DeleteServersAdminTestJSON-312124499 tempest-DeleteServersAdminTestJSON-312124499-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:00.360691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1190ed6-ac42-415a-9a05-5cd10e702d16 tempest-DeleteServersAdminTestJSON-312124499 tempest-DeleteServersAdminTestJSON-312124499-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:00.480117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c1190ed6-ac42-415a-9a05-5cd10e702d16 tempest-DeleteServersAdminTestJSON-312124499 tempest-DeleteServersAdminTestJSON-312124499-project-admin] [instance: 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:51:00.559245 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-272ad054-f964-4e82-9fbe-75d5b6ffde4e tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54" status: 204 len: 0 microversion: 2.1 time: 0.434289 Oct 29 02:51:00.560513 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 655/1341] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:51:00 2022] DELETE /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:51:00.579069 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6dcc095c-82cc-4f3d-87bb-1f55a6099e1d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:00.581451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6dcc095c-82cc-4f3d-87bb-1f55a6099e1d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 34d62a74-da30-4154-adfe-289eb2ad7564] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:00.622280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6dcc095c-82cc-4f3d-87bb-1f55a6099e1d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:00.630122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6dcc095c-82cc-4f3d-87bb-1f55a6099e1d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:00.636255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6dcc095c-82cc-4f3d-87bb-1f55a6099e1d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:00.637538 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6dcc095c-82cc-4f3d-87bb-1f55a6099e1d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:00.644858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6dcc095c-82cc-4f3d-87bb-1f55a6099e1d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:00.645314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6dcc095c-82cc-4f3d-87bb-1f55a6099e1d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:00.706281 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-6dcc095c-82cc-4f3d-87bb-1f55a6099e1d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] HTTP exception thrown: Instance 34d62a74-da30-4154-adfe-289eb2ad7564 could not be found. Oct 29 02:51:00.712179 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6dcc095c-82cc-4f3d-87bb-1f55a6099e1d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Request method failure captured: Oct 29 02:51:00.712179 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564 HTTP/1.1 Oct 29 02:51:00.712179 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:51:00.712179 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:51:00.712179 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:51:00.712179 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:51:00.712179 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:51:00.712179 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:51:00.712179 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:51:00.712179 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:00.712179 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJRoHCWy3eaalTzy633NKtthGuR8cipMYZT4TZduF4CgY52OX0OOpML7WqYw8-VIRxPW99b65GZIkiKdDgfKNq60yFm1GPny914hL20N63ngfutS-kJRSz6ZtVnTXUNMfN8pE5XYxJYxK52qSiGCFE4HtBfmAAy92aY_DysIm4md9Uo Oct 29 02:51:00.712179 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:51:00.712179 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:51:00.712179 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:51:00.712179 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:51:00.712179 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:51:00.712179 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:51:00.712179 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 24ee44ab29014be1bff1c5a18c53c2e2 Oct 29 02:51:00.712179 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersAdminTestJSON-1366919160 Oct 29 02:51:00.712179 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:51:00.712179 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:51:00.734057 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/24ee44ab29014be1bff1c5a18c53c2e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/24ee44ab29014be1bff1c5a18c53c2e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_24ee44ab29014be1bff1c5a18c53c2e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/24ee44ab29014be1bff1c5a18c53c2e2"}]}] Oct 29 02:51:00.734057 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersAdminTestJSON-1366919160 Oct 29 02:51:00.734057 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 24ee44ab29014be1bff1c5a18c53c2e2 Oct 29 02:51:00.734057 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersAdminTestJSON-1366919160 Oct 29 02:51:00.734057 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersAdminTestJSON-1366919160-project Oct 29 02:51:00.734057 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:51:00.734057 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:51:00.734057 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 8a6ba7c1ab324fe583f5ad27474cafc2 Oct 29 02:51:00.734057 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersAdminTestJSON-1366919160-project Oct 29 02:51:00.734057 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:51:00.734057 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 34d62a74-da30-4154-adfe-289eb2ad7564 could not be found. Oct 29 02:51:00.734057 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '34d62a74-da30-4154-adfe-289eb2ad7564'} Oct 29 02:51:00.748869 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:00.748869 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:00.748869 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:51:00.748869 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:51:00.748869 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:51:00.748869 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:51:00.748869 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:51:00.748869 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:51:00.748869 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:51:00.748869 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:51:00.748869 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34d62a74-da30-4154-adfe-289eb2ad7564 could not be found. Oct 29 02:51:00.748869 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:00.748869 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:00.748869 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:00.748869 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:00.748869 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:00.748869 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:00.748869 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:00.748869 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:00.748869 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:00.759710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:00.759710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:51:00.759710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:51:00.759710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:51:00.759710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:51:00.759710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:51:00.759710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:51:00.759710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34d62a74-da30-4154-adfe-289eb2ad7564 could not be found. Oct 29 02:51:00.759710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:00.759710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:00.759710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:00.759710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:00.759710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:00.759710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:00.759710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:00.759710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:00.759710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34d62a74-da30-4154-adfe-289eb2ad7564 could not be found. Oct 29 02:51:00.759710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:00.764142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6dcc095c-82cc-4f3d-87bb-1f55a6099e1d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Returning 404 to user: Instance 34d62a74-da30-4154-adfe-289eb2ad7564 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:00.764142 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6dcc095c-82cc-4f3d-87bb-1f55a6099e1d tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564" status: 404 len: 111 microversion: 2.1 time: 0.158239 Oct 29 02:51:00.764142 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 656/1342] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:00 2022] GET /compute/v2.1/servers/34d62a74-da30-4154-adfe-289eb2ad7564 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:51:00.764142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2fcd3cee-a69b-4d3d-b6c5-861fdb332817 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:00.764142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2fcd3cee-a69b-4d3d-b6c5-861fdb332817 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:00.779403 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fcd3cee-a69b-4d3d-b6c5-861fdb332817 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:00.779886 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fcd3cee-a69b-4d3d-b6c5-861fdb332817 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:00.780322 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fcd3cee-a69b-4d3d-b6c5-861fdb332817 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:00.791429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fcd3cee-a69b-4d3d-b6c5-861fdb332817 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:00.792166 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fcd3cee-a69b-4d3d-b6c5-861fdb332817 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:00.792647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fcd3cee-a69b-4d3d-b6c5-861fdb332817 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:00.797447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:00.873757 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:01.022119 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c1190ed6-ac42-415a-9a05-5cd10e702d16 tempest-DeleteServersAdminTestJSON-312124499 tempest-DeleteServersAdminTestJSON-312124499-project-admin] 10.222.0.46 "DELETE /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf" status: 204 len: 0 microversion: 2.1 time: 1.508739 Oct 29 02:51:01.025423 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 687/1343] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:50:59 2022] DELETE /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf => generated 0 bytes in 1524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:51:01.069065 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-91d80f27-3749-4d9f-854f-9ecb4a2d24e5 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:01.069756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-91d80f27-3749-4d9f-854f-9ecb4a2d24e5 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:01.082388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91d80f27-3749-4d9f-854f-9ecb4a2d24e5 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:01.083170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91d80f27-3749-4d9f-854f-9ecb4a2d24e5 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:01.083286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91d80f27-3749-4d9f-854f-9ecb4a2d24e5 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:01.084007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91d80f27-3749-4d9f-854f-9ecb4a2d24e5 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:01.084462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91d80f27-3749-4d9f-854f-9ecb4a2d24e5 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:01.084910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91d80f27-3749-4d9f-854f-9ecb4a2d24e5 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:01.151581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-91d80f27-3749-4d9f-854f-9ecb4a2d24e5 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:51:01.410793 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2fcd3cee-a69b-4d3d-b6c5-861fdb332817 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e823b4fb116c48ea92c2d3da58e10f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a70e4fa3141bb8b667b1be8e9594b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:01.419501 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-91d80f27-3749-4d9f-854f-9ecb4a2d24e5 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "DELETE /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 204 len: 0 microversion: 2.1 time: 0.385113 Oct 29 02:51:01.421112 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2fcd3cee-a69b-4d3d-b6c5-861fdb332817 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54" status: 200 len: 1682 microversion: 2.1 time: 0.697314 Oct 29 02:51:01.422780 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 657/1344] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:00 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 => generated 1682 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:01.438384 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 688/1345] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:51:01 2022] DELETE /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:51:01.451718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fc16c149-39a3-4697-8356-ceadd6f8d2f1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:01.455811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a6add4c7-7417-4b5b-b8e3-f68757a6265f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:01.458685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a6add4c7-7417-4b5b-b8e3-f68757a6265f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:01.461515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fc16c149-39a3-4697-8356-ceadd6f8d2f1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:01.474504 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6add4c7-7417-4b5b-b8e3-f68757a6265f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:01.477107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6add4c7-7417-4b5b-b8e3-f68757a6265f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:01.477801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6add4c7-7417-4b5b-b8e3-f68757a6265f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:01.479594 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6add4c7-7417-4b5b-b8e3-f68757a6265f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:01.480270 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6add4c7-7417-4b5b-b8e3-f68757a6265f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:01.481553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6add4c7-7417-4b5b-b8e3-f68757a6265f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:01.511536 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc16c149-39a3-4697-8356-ceadd6f8d2f1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:01.513699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc16c149-39a3-4697-8356-ceadd6f8d2f1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:01.515731 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc16c149-39a3-4697-8356-ceadd6f8d2f1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:01.518799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc16c149-39a3-4697-8356-ceadd6f8d2f1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:01.522759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc16c149-39a3-4697-8356-ceadd6f8d2f1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:01.524910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc16c149-39a3-4697-8356-ceadd6f8d2f1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:01.802420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fc16c149-39a3-4697-8356-ceadd6f8d2f1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:01.858144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fc16c149-39a3-4697-8356-ceadd6f8d2f1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:01.862624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fc16c149-39a3-4697-8356-ceadd6f8d2f1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:01.890630 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fc16c149-39a3-4697-8356-ceadd6f8d2f1 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.458487 Oct 29 02:51:01.908934 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 689/1346] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:01 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:01.908934 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6cfc1cdf-0233-456b-9953-d5be50499dc4 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:01.914759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6cfc1cdf-0233-456b-9953-d5be50499dc4 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] [instance: de40ca11-d29b-4457-ad27-807bfb1acc65] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:01.935439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cfc1cdf-0233-456b-9953-d5be50499dc4 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:01.938239 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cfc1cdf-0233-456b-9953-d5be50499dc4 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:01.941819 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cfc1cdf-0233-456b-9953-d5be50499dc4 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:01.954258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cfc1cdf-0233-456b-9953-d5be50499dc4 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:01.959564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cfc1cdf-0233-456b-9953-d5be50499dc4 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:01.963919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cfc1cdf-0233-456b-9953-d5be50499dc4 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:02.242870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6cfc1cdf-0233-456b-9953-d5be50499dc4 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2955d25314a42259483d8ccbfd7ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520485bb54544a3389cec22317db2d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:02.278580 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6cfc1cdf-0233-456b-9953-d5be50499dc4 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] 10.222.0.46 "GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65" status: 200 len: 1599 microversion: 2.1 time: 0.379223 Oct 29 02:51:02.304480 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 690/1347] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:01 2022] GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65 => generated 1599 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:02.332048 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-8c0a3ef8-6308-4f24-8a8b-1a9bc54b637c req-aca5614e-ca94-49dd-8100-41f07353633f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de40ca11-d29b-4457-ad27-807bfb1acc65", "name": "network-vif-deleted", "tag": "fab97166-f957-42ca-8a7d-d580455a03ba"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:02.356696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8c0a3ef8-6308-4f24-8a8b-1a9bc54b637c req-aca5614e-ca94-49dd-8100-41f07353633f service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:02.357893 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8c0a3ef8-6308-4f24-8a8b-1a9bc54b637c req-aca5614e-ca94-49dd-8100-41f07353633f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:02.358883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8c0a3ef8-6308-4f24-8a8b-1a9bc54b637c req-aca5614e-ca94-49dd-8100-41f07353633f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:02.363298 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a6add4c7-7417-4b5b-b8e3-f68757a6265f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:02.382376 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a6add4c7-7417-4b5b-b8e3-f68757a6265f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf" status: 200 len: 1475 microversion: 2.1 time: 0.933125 Oct 29 02:51:02.384295 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-8c0a3ef8-6308-4f24-8a8b-1a9bc54b637c req-aca5614e-ca94-49dd-8100-41f07353633f service nova] Creating event network-vif-deleted:fab97166-f957-42ca-8a7d-d580455a03ba for instance de40ca11-d29b-4457-ad27-807bfb1acc65 on n-h1-862967-2 Oct 29 02:51:02.386736 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 658/1348] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:01 2022] GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf => generated 1475 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:02.417104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8242f88f-c23f-48d5-8521-cc25c18ab2be tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:02.417753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8242f88f-c23f-48d5-8521-cc25c18ab2be tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:02.420080 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-8c0a3ef8-6308-4f24-8a8b-1a9bc54b637c req-aca5614e-ca94-49dd-8100-41f07353633f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102842 Oct 29 02:51:02.425019 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 691/1349] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:02.443328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8242f88f-c23f-48d5-8521-cc25c18ab2be tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:02.443833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8242f88f-c23f-48d5-8521-cc25c18ab2be tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:02.444275 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8242f88f-c23f-48d5-8521-cc25c18ab2be tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:02.445033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8242f88f-c23f-48d5-8521-cc25c18ab2be tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:02.450122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8242f88f-c23f-48d5-8521-cc25c18ab2be tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:02.450657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8242f88f-c23f-48d5-8521-cc25c18ab2be tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:02.463304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dccdb9e8-6a4d-4d90-977c-650d22d3b92c tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:02.474018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dccdb9e8-6a4d-4d90-977c-650d22d3b92c tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:02.496703 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dccdb9e8-6a4d-4d90-977c-650d22d3b92c tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:02.497944 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dccdb9e8-6a4d-4d90-977c-650d22d3b92c tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:02.499027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dccdb9e8-6a4d-4d90-977c-650d22d3b92c tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:02.500920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dccdb9e8-6a4d-4d90-977c-650d22d3b92c tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:02.502430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dccdb9e8-6a4d-4d90-977c-650d22d3b92c tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:02.504277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dccdb9e8-6a4d-4d90-977c-650d22d3b92c tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:02.955144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8242f88f-c23f-48d5-8521-cc25c18ab2be tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:02.955950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dccdb9e8-6a4d-4d90-977c-650d22d3b92c tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e823b4fb116c48ea92c2d3da58e10f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a70e4fa3141bb8b667b1be8e9594b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:02.970916 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dccdb9e8-6a4d-4d90-977c-650d22d3b92c tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54" status: 200 len: 1682 microversion: 2.1 time: 0.523878 Oct 29 02:51:02.986791 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 692/1350] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:02 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 => generated 1682 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:02.986791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8d43f6af-1193-43cf-86fd-04f613c23a45 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:02.986791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8d43f6af-1193-43cf-86fd-04f613c23a45 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:02.986791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d43f6af-1193-43cf-86fd-04f613c23a45 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:02.987294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d43f6af-1193-43cf-86fd-04f613c23a45 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:02.987294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d43f6af-1193-43cf-86fd-04f613c23a45 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:02.987294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d43f6af-1193-43cf-86fd-04f613c23a45 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:02.987962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d43f6af-1193-43cf-86fd-04f613c23a45 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:02.988725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d43f6af-1193-43cf-86fd-04f613c23a45 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:03.003205 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8242f88f-c23f-48d5-8521-cc25c18ab2be tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1469 microversion: 2.1 time: 0.613092 Oct 29 02:51:03.007916 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 659/1351] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:02 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1469 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:03.107276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8d43f6af-1193-43cf-86fd-04f613c23a45 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:03.122208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8d43f6af-1193-43cf-86fd-04f613c23a45 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:03.123951 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8d43f6af-1193-43cf-86fd-04f613c23a45 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:03.131207 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8d43f6af-1193-43cf-86fd-04f613c23a45 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.157741 Oct 29 02:51:03.132578 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 693/1352] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:02 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:03.336983 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e8d14f47-1e84-47da-bc8e-ac8da18ad370 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:03.337603 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e8d14f47-1e84-47da-bc8e-ac8da18ad370 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] [instance: de40ca11-d29b-4457-ad27-807bfb1acc65] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:03.349593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e8d14f47-1e84-47da-bc8e-ac8da18ad370 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:03.350535 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e8d14f47-1e84-47da-bc8e-ac8da18ad370 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:03.351889 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e8d14f47-1e84-47da-bc8e-ac8da18ad370 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:03.353440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e8d14f47-1e84-47da-bc8e-ac8da18ad370 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:03.356306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e8d14f47-1e84-47da-bc8e-ac8da18ad370 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:03.360099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e8d14f47-1e84-47da-bc8e-ac8da18ad370 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:03.462790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6fc83b8f-e0fe-49f1-a3cb-3b71cb942e54 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:03.465726 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6fc83b8f-e0fe-49f1-a3cb-3b71cb942e54 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:03.474310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:03.525271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6fc83b8f-e0fe-49f1-a3cb-3b71cb942e54 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:03.526163 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6fc83b8f-e0fe-49f1-a3cb-3b71cb942e54 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:03.526612 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6fc83b8f-e0fe-49f1-a3cb-3b71cb942e54 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:03.527339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6fc83b8f-e0fe-49f1-a3cb-3b71cb942e54 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:03.527794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6fc83b8f-e0fe-49f1-a3cb-3b71cb942e54 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:03.528223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6fc83b8f-e0fe-49f1-a3cb-3b71cb942e54 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:03.778959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e8d14f47-1e84-47da-bc8e-ac8da18ad370 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2955d25314a42259483d8ccbfd7ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520485bb54544a3389cec22317db2d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:03.792623 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e8d14f47-1e84-47da-bc8e-ac8da18ad370 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] 10.222.0.46 "GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65" status: 200 len: 1311 microversion: 2.1 time: 0.459942 Oct 29 02:51:03.795290 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 660/1353] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:03 2022] GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65 => generated 1311 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:03.869140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6fc83b8f-e0fe-49f1-a3cb-3b71cb942e54 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:03.910841 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6fc83b8f-e0fe-49f1-a3cb-3b71cb942e54 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf" status: 200 len: 1475 microversion: 2.1 time: 0.487896 Oct 29 02:51:03.912697 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 694/1354] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:03 2022] GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf => generated 1475 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:03.998890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a0b1fde9-2e05-4ff4-9b10-dd2305d16478 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:03.999917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a0b1fde9-2e05-4ff4-9b10-dd2305d16478 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:04.013325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a0b1fde9-2e05-4ff4-9b10-dd2305d16478 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:04.014352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a0b1fde9-2e05-4ff4-9b10-dd2305d16478 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:04.014795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a0b1fde9-2e05-4ff4-9b10-dd2305d16478 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:04.016514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a0b1fde9-2e05-4ff4-9b10-dd2305d16478 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:04.017008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a0b1fde9-2e05-4ff4-9b10-dd2305d16478 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:04.017436 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a0b1fde9-2e05-4ff4-9b10-dd2305d16478 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:04.048335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2caf4458-7cdc-4932-9ee3-8010a5adacd8 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:04.049070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2caf4458-7cdc-4932-9ee3-8010a5adacd8 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:04.058606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2caf4458-7cdc-4932-9ee3-8010a5adacd8 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:04.059103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2caf4458-7cdc-4932-9ee3-8010a5adacd8 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:04.059537 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2caf4458-7cdc-4932-9ee3-8010a5adacd8 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:04.060258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2caf4458-7cdc-4932-9ee3-8010a5adacd8 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:04.060749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2caf4458-7cdc-4932-9ee3-8010a5adacd8 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:04.061176 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2caf4458-7cdc-4932-9ee3-8010a5adacd8 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:04.403348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a0b1fde9-2e05-4ff4-9b10-dd2305d16478 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e823b4fb116c48ea92c2d3da58e10f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a70e4fa3141bb8b667b1be8e9594b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:04.419694 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a0b1fde9-2e05-4ff4-9b10-dd2305d16478 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54" status: 200 len: 1682 microversion: 2.1 time: 0.427298 Oct 29 02:51:04.429741 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 661/1355] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:03 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 => generated 1682 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:04.435588 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8f374dde-f6f7-434d-9784-69644b6faeb5 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:04.438885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8f374dde-f6f7-434d-9784-69644b6faeb5 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:04.458193 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f374dde-f6f7-434d-9784-69644b6faeb5 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:04.458960 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f374dde-f6f7-434d-9784-69644b6faeb5 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:04.459591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f374dde-f6f7-434d-9784-69644b6faeb5 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:04.460505 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f374dde-f6f7-434d-9784-69644b6faeb5 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:04.464859 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f374dde-f6f7-434d-9784-69644b6faeb5 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:04.465600 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f374dde-f6f7-434d-9784-69644b6faeb5 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:04.613845 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8f374dde-f6f7-434d-9784-69644b6faeb5 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:04.636963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8f374dde-f6f7-434d-9784-69644b6faeb5 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:04.640232 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8f374dde-f6f7-434d-9784-69644b6faeb5 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:04.655874 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8f374dde-f6f7-434d-9784-69644b6faeb5 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.224906 Oct 29 02:51:04.679489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2caf4458-7cdc-4932-9ee3-8010a5adacd8 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:04.689438 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 662/1356] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:04 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:04.698497 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2caf4458-7cdc-4932-9ee3-8010a5adacd8 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1469 microversion: 2.1 time: 0.655354 Oct 29 02:51:04.706476 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 695/1357] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:04 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1469 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:04.818721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a491755e-388c-456b-84e3-319b336c43b8 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:04.819540 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a491755e-388c-456b-84e3-319b336c43b8 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] [instance: de40ca11-d29b-4457-ad27-807bfb1acc65] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:04.830361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a491755e-388c-456b-84e3-319b336c43b8 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:04.832049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a491755e-388c-456b-84e3-319b336c43b8 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:04.839237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a491755e-388c-456b-84e3-319b336c43b8 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:04.841255 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a491755e-388c-456b-84e3-319b336c43b8 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:04.842305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a491755e-388c-456b-84e3-319b336c43b8 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:04.845602 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a491755e-388c-456b-84e3-319b336c43b8 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:04.936133 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a491755e-388c-456b-84e3-319b336c43b8 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:04.937476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a491755e-388c-456b-84e3-319b336c43b8 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:04.938559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a491755e-388c-456b-84e3-319b336c43b8 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:04.939559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-a491755e-388c-456b-84e3-319b336c43b8 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lazy-loading 'fault' on Instance uuid de40ca11-d29b-4457-ad27-807bfb1acc65 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:51:05.019116 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-58f8fe82-5759-46b5-b8cb-36e6626dc826 req-a082c370-5c7e-4ef6-8513-a55bce899201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8533ddeb-4b9e-4e44-bb14-c92a8d171ecf", "name": "network-vif-deleted", "tag": "0c3d35dc-ae83-4a64-89b0-ad0429ce9d5e"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:05.040944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-58f8fe82-5759-46b5-b8cb-36e6626dc826 req-a082c370-5c7e-4ef6-8513-a55bce899201 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:05.041774 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-58f8fe82-5759-46b5-b8cb-36e6626dc826 req-a082c370-5c7e-4ef6-8513-a55bce899201 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:05.042455 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-58f8fe82-5759-46b5-b8cb-36e6626dc826 req-a082c370-5c7e-4ef6-8513-a55bce899201 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:05.074150 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-58f8fe82-5759-46b5-b8cb-36e6626dc826 req-a082c370-5c7e-4ef6-8513-a55bce899201 service nova] Creating event network-vif-deleted:0c3d35dc-ae83-4a64-89b0-ad0429ce9d5e for instance 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf on n-h2-862967-2 Oct 29 02:51:05.088008 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-58f8fe82-5759-46b5-b8cb-36e6626dc826 req-a082c370-5c7e-4ef6-8513-a55bce899201 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.396785 Oct 29 02:51:05.088915 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 663/1358] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:05.098146 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bdb46203-7b79-4c9b-80fe-29ea8e55e171 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:05.107029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a491755e-388c-456b-84e3-319b336c43b8 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2955d25314a42259483d8ccbfd7ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520485bb54544a3389cec22317db2d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:05.108949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bdb46203-7b79-4c9b-80fe-29ea8e55e171 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:05.126055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bdb46203-7b79-4c9b-80fe-29ea8e55e171 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:05.126659 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bdb46203-7b79-4c9b-80fe-29ea8e55e171 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:05.127183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bdb46203-7b79-4c9b-80fe-29ea8e55e171 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:05.127988 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bdb46203-7b79-4c9b-80fe-29ea8e55e171 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:05.131050 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bdb46203-7b79-4c9b-80fe-29ea8e55e171 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:05.134088 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bdb46203-7b79-4c9b-80fe-29ea8e55e171 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:05.150850 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a491755e-388c-456b-84e3-319b336c43b8 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] 10.222.0.46 "GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65" status: 200 len: 1316 microversion: 2.1 time: 0.336729 Oct 29 02:51:05.175017 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 696/1359] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:04 2022] GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65 => generated 1316 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:51:05.267430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bdb46203-7b79-4c9b-80fe-29ea8e55e171 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:05.269440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bdb46203-7b79-4c9b-80fe-29ea8e55e171 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:05.271055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bdb46203-7b79-4c9b-80fe-29ea8e55e171 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:05.273288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-bdb46203-7b79-4c9b-80fe-29ea8e55e171 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lazy-loading 'fault' on Instance uuid 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:51:05.447857 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-975498b4-a324-4f43-8f1b-62fcea3403e8 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:05.448513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-975498b4-a324-4f43-8f1b-62fcea3403e8 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:05.457429 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-975498b4-a324-4f43-8f1b-62fcea3403e8 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:05.459234 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-975498b4-a324-4f43-8f1b-62fcea3403e8 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:05.459903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-975498b4-a324-4f43-8f1b-62fcea3403e8 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:05.460907 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-975498b4-a324-4f43-8f1b-62fcea3403e8 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:05.461603 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-975498b4-a324-4f43-8f1b-62fcea3403e8 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:05.462274 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-975498b4-a324-4f43-8f1b-62fcea3403e8 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:06.008265 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bdb46203-7b79-4c9b-80fe-29ea8e55e171 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:06.021484 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bdb46203-7b79-4c9b-80fe-29ea8e55e171 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf" status: 200 len: 1309 microversion: 2.1 time: 0.930661 Oct 29 02:51:06.023846 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 664/1360] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:05 2022] GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf => generated 1309 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:06.051322 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a98083cc-918c-4db9-ab74-d6ee17484e55 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:06.052106 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a98083cc-918c-4db9-ab74-d6ee17484e55 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:06.093805 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a98083cc-918c-4db9-ab74-d6ee17484e55 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:06.094314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a98083cc-918c-4db9-ab74-d6ee17484e55 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:06.094754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a98083cc-918c-4db9-ab74-d6ee17484e55 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:06.095491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a98083cc-918c-4db9-ab74-d6ee17484e55 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:06.095947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a98083cc-918c-4db9-ab74-d6ee17484e55 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:06.096387 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a98083cc-918c-4db9-ab74-d6ee17484e55 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:06.165871 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-975498b4-a324-4f43-8f1b-62fcea3403e8 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e823b4fb116c48ea92c2d3da58e10f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a70e4fa3141bb8b667b1be8e9594b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:06.177515 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-975498b4-a324-4f43-8f1b-62fcea3403e8 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54" status: 200 len: 1682 microversion: 2.1 time: 0.734033 Oct 29 02:51:06.178125 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 697/1361] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:05 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 => generated 1682 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:06.200895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-80f53916-f5cf-4e3f-8915-b93b0e264310 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:06.205060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-80f53916-f5cf-4e3f-8915-b93b0e264310 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:06.231318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80f53916-f5cf-4e3f-8915-b93b0e264310 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:06.238468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80f53916-f5cf-4e3f-8915-b93b0e264310 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:06.240581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80f53916-f5cf-4e3f-8915-b93b0e264310 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:06.241421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80f53916-f5cf-4e3f-8915-b93b0e264310 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:06.244388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80f53916-f5cf-4e3f-8915-b93b0e264310 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:06.245209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80f53916-f5cf-4e3f-8915-b93b0e264310 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:06.352485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a98083cc-918c-4db9-ab74-d6ee17484e55 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:06.362107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a98083cc-918c-4db9-ab74-d6ee17484e55 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:06.370196 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a98083cc-918c-4db9-ab74-d6ee17484e55 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:06.384461 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a98083cc-918c-4db9-ab74-d6ee17484e55 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.338406 Oct 29 02:51:06.385795 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 665/1362] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:06 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:06.395681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c59025d4-18b7-4b45-a54c-4a3965d02485 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:06.403949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c59025d4-18b7-4b45-a54c-4a3965d02485 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] [instance: de40ca11-d29b-4457-ad27-807bfb1acc65] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:06.411181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c59025d4-18b7-4b45-a54c-4a3965d02485 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:06.412027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c59025d4-18b7-4b45-a54c-4a3965d02485 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:06.412713 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c59025d4-18b7-4b45-a54c-4a3965d02485 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:06.413679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c59025d4-18b7-4b45-a54c-4a3965d02485 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:06.414359 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c59025d4-18b7-4b45-a54c-4a3965d02485 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:06.415002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c59025d4-18b7-4b45-a54c-4a3965d02485 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:06.431596 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-c59025d4-18b7-4b45-a54c-4a3965d02485 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] HTTP exception thrown: Instance de40ca11-d29b-4457-ad27-807bfb1acc65 could not be found. Oct 29 02:51:06.433950 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c59025d4-18b7-4b45-a54c-4a3965d02485 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Request method failure captured: Oct 29 02:51:06.433950 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65 HTTP/1.1 Oct 29 02:51:06.433950 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:51:06.433950 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:51:06.433950 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:51:06.433950 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:51:06.433950 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:51:06.433950 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:51:06.433950 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:51:06.433950 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:06.433950 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJTISSGxZL71IVpNRqLVklKHjP5sUliiA-qw1baY7LGkXPdg_BZfGa52fGJ4k9_925B_RXxyGLBFj91KjsTYUt5556ofbIcF7YV_utpeHLqiXkYllugdWb6FcoqQtYhzYLnAxHtv0AlvsuMzrcoJP5CjvOvDOBnhSZ8R8TGhUh8utLc Oct 29 02:51:06.433950 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:51:06.433950 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:51:06.433950 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:51:06.433950 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:51:06.433950 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:51:06.433950 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:51:06.433950 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 520485bb54544a3389cec22317db2d13 Oct 29 02:51:06.433950 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersTestFqdnHostnames-795263833 Oct 29 02:51:06.433950 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:51:06.433950 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:51:06.435298 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/520485bb54544a3389cec22317db2d13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/520485bb54544a3389cec22317db2d13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_520485bb54544a3389cec22317db2d13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/520485bb54544a3389cec22317db2d13"}]}] Oct 29 02:51:06.435298 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersTestFqdnHostnames-795263833 Oct 29 02:51:06.435298 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 520485bb54544a3389cec22317db2d13 Oct 29 02:51:06.435298 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-795263833 Oct 29 02:51:06.435298 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersTestFqdnHostnames-795263833-project Oct 29 02:51:06.435298 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:51:06.435298 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:51:06.435298 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: e2955d25314a42259483d8ccbfd7ee54 Oct 29 02:51:06.435298 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersTestFqdnHostnames-795263833-project Oct 29 02:51:06.435298 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:51:06.435298 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance de40ca11-d29b-4457-ad27-807bfb1acc65 could not be found. Oct 29 02:51:06.435298 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'de40ca11-d29b-4457-ad27-807bfb1acc65'} Oct 29 02:51:06.436093 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:06.436093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:06.436093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:51:06.436093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:51:06.436093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:51:06.436093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:51:06.436093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:51:06.436093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:51:06.436093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:51:06.436093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:51:06.436093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de40ca11-d29b-4457-ad27-807bfb1acc65 could not be found. Oct 29 02:51:06.436093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:06.436093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:06.436093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:06.436093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:06.436093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:06.436093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:06.436093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:06.436093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:06.436093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:06.437472 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:06.437472 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:51:06.437472 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:51:06.437472 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:51:06.437472 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:51:06.437472 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:51:06.437472 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:51:06.437472 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de40ca11-d29b-4457-ad27-807bfb1acc65 could not be found. Oct 29 02:51:06.437472 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:06.437472 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:06.437472 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:06.437472 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:06.437472 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:06.437472 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:06.437472 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:06.437472 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:06.437472 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de40ca11-d29b-4457-ad27-807bfb1acc65 could not be found. Oct 29 02:51:06.437472 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:06.440376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c59025d4-18b7-4b45-a54c-4a3965d02485 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Returning 404 to user: Instance de40ca11-d29b-4457-ad27-807bfb1acc65 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:06.441545 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c59025d4-18b7-4b45-a54c-4a3965d02485 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] 10.222.0.46 "GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65" status: 404 len: 111 microversion: 2.1 time: 0.053806 Oct 29 02:51:06.443522 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 666/1363] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:06 2022] GET /compute/v2.1/servers/de40ca11-d29b-4457-ad27-807bfb1acc65 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:51:06.455285 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cf239322-78e2-40b3-b792-ef4799c124b4 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] Calling method '.version_select at 0x7ff053886430>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:06.487443 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cf239322-78e2-40b3-b792-ef4799c124b4 tempest-ServersTestFqdnHostnames-795263833 tempest-ServersTestFqdnHostnames-795263833-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2114399205" status: 202 len: 0 microversion: 2.1 time: 0.039293 Oct 29 02:51:06.489051 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 667/1364] 10.222.0.46 () {58 vars in 1221 bytes} [Sat Oct 29 02:51:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2114399205 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 02:51:06.804606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-80f53916-f5cf-4e3f-8915-b93b0e264310 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a6ba7c1ab324fe583f5ad27474cafc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24ee44ab29014be1bff1c5a18c53c2e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:06.831784 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-80f53916-f5cf-4e3f-8915-b93b0e264310 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 200 len: 1469 microversion: 2.1 time: 0.643960 Oct 29 02:51:06.835913 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 698/1365] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:06 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 1469 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:07.055240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1f071588-04c4-4902-ad2d-53f5be2fd138 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:07.055878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1f071588-04c4-4902-ad2d-53f5be2fd138 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:07.076954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f071588-04c4-4902-ad2d-53f5be2fd138 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:07.077452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f071588-04c4-4902-ad2d-53f5be2fd138 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:07.079157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f071588-04c4-4902-ad2d-53f5be2fd138 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:07.081816 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f071588-04c4-4902-ad2d-53f5be2fd138 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:07.085071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f071588-04c4-4902-ad2d-53f5be2fd138 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:07.086032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f071588-04c4-4902-ad2d-53f5be2fd138 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:07.126439 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-1f071588-04c4-4902-ad2d-53f5be2fd138 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] HTTP exception thrown: Instance 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf could not be found. Oct 29 02:51:07.131989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1f071588-04c4-4902-ad2d-53f5be2fd138 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Request method failure captured: Oct 29 02:51:07.131989 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf HTTP/1.1 Oct 29 02:51:07.131989 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:51:07.131989 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:51:07.131989 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:51:07.131989 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:51:07.131989 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:51:07.131989 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:51:07.131989 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:51:07.131989 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:07.131989 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJT3d84SNWnOjYnIYF4m6-85VcrsQxn8rS3YcyXYN1J8EO0BPodOIeJ-gBjreEyAj6Ev8ctpI5p2WfJ22wMDdiwQFR3hLC6bgPAebZSFATI0C2dFpi6bEUS8hh4pTtq3gw_9cjxbDm1f1odNxqBA8yRq902Eh837c_Tx-NgCHQEeF5o Oct 29 02:51:07.131989 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:51:07.131989 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:51:07.131989 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:51:07.131989 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:51:07.131989 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:51:07.131989 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:51:07.131989 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 17f19c629832452bb23bdf27e87e0a49 Oct 29 02:51:07.131989 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1507118903 Oct 29 02:51:07.131989 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:51:07.131989 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:51:07.133761 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/17f19c629832452bb23bdf27e87e0a49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/17f19c629832452bb23bdf27e87e0a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_17f19c629832452bb23bdf27e87e0a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/17f19c629832452bb23bdf27e87e0a49"}]}] Oct 29 02:51:07.133761 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-DeleteServersAdminTestJSON-1507118903 Oct 29 02:51:07.133761 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 17f19c629832452bb23bdf27e87e0a49 Oct 29 02:51:07.133761 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1507118903 Oct 29 02:51:07.133761 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-DeleteServersAdminTestJSON-1507118903-project Oct 29 02:51:07.133761 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:51:07.133761 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:51:07.133761 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: a33ab5d704ab43e4b83938ad17c418f3 Oct 29 02:51:07.133761 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-DeleteServersAdminTestJSON-1507118903-project Oct 29 02:51:07.133761 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:51:07.133761 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf could not be found. Oct 29 02:51:07.133761 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '8533ddeb-4b9e-4e44-bb14-c92a8d171ecf'} Oct 29 02:51:07.134709 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:07.134709 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:07.134709 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:51:07.134709 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:51:07.134709 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:51:07.134709 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:51:07.134709 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:51:07.134709 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:51:07.134709 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:51:07.134709 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:51:07.134709 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf could not be found. Oct 29 02:51:07.134709 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:07.134709 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:07.134709 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:07.134709 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:07.134709 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:07.134709 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:07.134709 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:07.134709 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:07.134709 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:07.136424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:07.136424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:51:07.136424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:51:07.136424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:51:07.136424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:51:07.136424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:51:07.136424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:51:07.136424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf could not be found. Oct 29 02:51:07.136424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:07.136424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:07.136424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:07.136424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:07.136424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:07.136424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:07.136424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:07.136424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:07.136424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf could not be found. Oct 29 02:51:07.136424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:07.140941 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1f071588-04c4-4902-ad2d-53f5be2fd138 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Returning 404 to user: Instance 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:07.142268 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1f071588-04c4-4902-ad2d-53f5be2fd138 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf" status: 404 len: 111 microversion: 2.1 time: 0.094389 Oct 29 02:51:07.161411 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 668/1366] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:07 2022] GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:51:07.204542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d596e6f4-5229-4c8e-9df2-155f49eca101 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:07.205400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d596e6f4-5229-4c8e-9df2-155f49eca101 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:07.238254 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d596e6f4-5229-4c8e-9df2-155f49eca101 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:07.238854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d596e6f4-5229-4c8e-9df2-155f49eca101 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:07.239311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d596e6f4-5229-4c8e-9df2-155f49eca101 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:07.247239 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d596e6f4-5229-4c8e-9df2-155f49eca101 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:07.247794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d596e6f4-5229-4c8e-9df2-155f49eca101 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:07.248369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d596e6f4-5229-4c8e-9df2-155f49eca101 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:07.368779 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-c1bc0ef4-49a1-4479-a53b-5453adccfb5f req-abe2af1e-1f83-43e3-a3a8-33535d7c05e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "403f0ce5-3db7-4b5b-b809-9a5f4280b685", "name": "network-vif-deleted", "tag": "a71c4667-d218-4c4c-bab3-ff8606f16efe"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:07.396476 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c1bc0ef4-49a1-4479-a53b-5453adccfb5f req-abe2af1e-1f83-43e3-a3a8-33535d7c05e6 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:07.399419 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c1bc0ef4-49a1-4479-a53b-5453adccfb5f req-abe2af1e-1f83-43e3-a3a8-33535d7c05e6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:07.402003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c1bc0ef4-49a1-4479-a53b-5453adccfb5f req-abe2af1e-1f83-43e3-a3a8-33535d7c05e6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:07.446908 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-c1bc0ef4-49a1-4479-a53b-5453adccfb5f req-abe2af1e-1f83-43e3-a3a8-33535d7c05e6 service nova] Creating event network-vif-deleted:a71c4667-d218-4c4c-bab3-ff8606f16efe for instance 403f0ce5-3db7-4b5b-b809-9a5f4280b685 on n-h1-862967-2 Oct 29 02:51:07.462274 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-c1bc0ef4-49a1-4479-a53b-5453adccfb5f req-abe2af1e-1f83-43e3-a3a8-33535d7c05e6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099518 Oct 29 02:51:07.464406 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 669/1367] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:07.513214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1a7db8dc-42db-4942-8b02-b47d14091cc4 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:07.514040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1a7db8dc-42db-4942-8b02-b47d14091cc4 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:07.532630 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a7db8dc-42db-4942-8b02-b47d14091cc4 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:07.534084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a7db8dc-42db-4942-8b02-b47d14091cc4 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:07.534823 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a7db8dc-42db-4942-8b02-b47d14091cc4 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:07.536786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a7db8dc-42db-4942-8b02-b47d14091cc4 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:07.537595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a7db8dc-42db-4942-8b02-b47d14091cc4 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:07.538376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a7db8dc-42db-4942-8b02-b47d14091cc4 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:07.565476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:08.038478 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1a7db8dc-42db-4942-8b02-b47d14091cc4 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:08.066306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1a7db8dc-42db-4942-8b02-b47d14091cc4 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:08.071492 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1a7db8dc-42db-4942-8b02-b47d14091cc4 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:08.101052 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1a7db8dc-42db-4942-8b02-b47d14091cc4 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.596679 Oct 29 02:51:08.111769 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 670/1368] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:07 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:08.148247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-35757c6e-ea39-4382-ac04-a8ccebd6bdfc tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2084754736", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:08.885905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d596e6f4-5229-4c8e-9df2-155f49eca101 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e823b4fb116c48ea92c2d3da58e10f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a70e4fa3141bb8b667b1be8e9594b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:08.905692 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d596e6f4-5229-4c8e-9df2-155f49eca101 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54" status: 200 len: 1682 microversion: 2.1 time: 1.703648 Oct 29 02:51:08.908937 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 699/1369] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:07 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 => generated 1682 bytes in 1709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:08.928433 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5d19df03-baa3-486a-bcbf-a852d0f6ffd2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:08.931740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5d19df03-baa3-486a-bcbf-a852d0f6ffd2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] [instance: 403f0ce5-3db7-4b5b-b809-9a5f4280b685] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:08.949206 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5d19df03-baa3-486a-bcbf-a852d0f6ffd2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:08.951161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5d19df03-baa3-486a-bcbf-a852d0f6ffd2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:08.952568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5d19df03-baa3-486a-bcbf-a852d0f6ffd2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:08.954447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5d19df03-baa3-486a-bcbf-a852d0f6ffd2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:08.955611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5d19df03-baa3-486a-bcbf-a852d0f6ffd2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:08.956682 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5d19df03-baa3-486a-bcbf-a852d0f6ffd2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:09.008906 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-5d19df03-baa3-486a-bcbf-a852d0f6ffd2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] HTTP exception thrown: Instance 403f0ce5-3db7-4b5b-b809-9a5f4280b685 could not be found. Oct 29 02:51:09.014513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5d19df03-baa3-486a-bcbf-a852d0f6ffd2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Request method failure captured: Oct 29 02:51:09.014513 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 HTTP/1.1 Oct 29 02:51:09.014513 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:51:09.014513 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:51:09.014513 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:51:09.014513 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:51:09.014513 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:51:09.014513 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:51:09.014513 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:51:09.014513 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:09.014513 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJRoHCWy3eaalTzy633NKtthGuR8cipMYZT4TZduF4CgY52OX0OOpML7WqYw8-VIRxPW99b65GZIkiKdDgfKNq60yFm1GPny914hL20N63ngfutS-kJRSz6ZtVnTXUNMfN8pE5XYxJYxK52qSiGCFE4HtBfmAAy92aY_DysIm4md9Uo Oct 29 02:51:09.014513 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:51:09.014513 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:51:09.014513 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:51:09.014513 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:51:09.014513 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:51:09.014513 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:51:09.014513 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 24ee44ab29014be1bff1c5a18c53c2e2 Oct 29 02:51:09.014513 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersAdminTestJSON-1366919160 Oct 29 02:51:09.014513 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:51:09.014513 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:51:09.016110 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/24ee44ab29014be1bff1c5a18c53c2e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/24ee44ab29014be1bff1c5a18c53c2e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_24ee44ab29014be1bff1c5a18c53c2e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/24ee44ab29014be1bff1c5a18c53c2e2"}]}] Oct 29 02:51:09.016110 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersAdminTestJSON-1366919160 Oct 29 02:51:09.016110 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 24ee44ab29014be1bff1c5a18c53c2e2 Oct 29 02:51:09.016110 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersAdminTestJSON-1366919160 Oct 29 02:51:09.016110 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersAdminTestJSON-1366919160-project Oct 29 02:51:09.016110 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:51:09.016110 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:51:09.016110 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 8a6ba7c1ab324fe583f5ad27474cafc2 Oct 29 02:51:09.016110 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersAdminTestJSON-1366919160-project Oct 29 02:51:09.016110 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:51:09.016110 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 403f0ce5-3db7-4b5b-b809-9a5f4280b685 could not be found. Oct 29 02:51:09.016110 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '403f0ce5-3db7-4b5b-b809-9a5f4280b685'} Oct 29 02:51:09.016922 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:09.016922 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:09.016922 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:51:09.016922 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:51:09.016922 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:51:09.016922 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:51:09.016922 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:51:09.016922 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:51:09.016922 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:51:09.016922 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:51:09.016922 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 403f0ce5-3db7-4b5b-b809-9a5f4280b685 could not be found. Oct 29 02:51:09.016922 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:09.016922 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:09.016922 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:09.016922 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:09.016922 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:09.016922 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:09.016922 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:09.016922 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:09.016922 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:09.018161 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:09.018161 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:51:09.018161 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:51:09.018161 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:51:09.018161 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:51:09.018161 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:51:09.018161 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:51:09.018161 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 403f0ce5-3db7-4b5b-b809-9a5f4280b685 could not be found. Oct 29 02:51:09.018161 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:09.018161 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:09.018161 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:09.018161 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:09.018161 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:09.018161 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:09.018161 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:09.018161 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:09.018161 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 403f0ce5-3db7-4b5b-b809-9a5f4280b685 could not be found. Oct 29 02:51:09.018161 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:09.019265 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5d19df03-baa3-486a-bcbf-a852d0f6ffd2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] Returning 404 to user: Instance 403f0ce5-3db7-4b5b-b809-9a5f4280b685 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:09.019352 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5d19df03-baa3-486a-bcbf-a852d0f6ffd2 tempest-ServersAdminTestJSON-1366919160 tempest-ServersAdminTestJSON-1366919160-project] 10.222.0.46 "GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685" status: 404 len: 111 microversion: 2.1 time: 0.108629 Oct 29 02:51:09.026039 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 700/1370] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:08 2022] GET /compute/v2.1/servers/403f0ce5-3db7-4b5b-b809-9a5f4280b685 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:51:09.149169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a921ad41-8d41-4404-91ec-34cbfec30037 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:09.149795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a921ad41-8d41-4404-91ec-34cbfec30037 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:09.162973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a921ad41-8d41-4404-91ec-34cbfec30037 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:09.168832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a921ad41-8d41-4404-91ec-34cbfec30037 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:09.169295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a921ad41-8d41-4404-91ec-34cbfec30037 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:09.170064 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a921ad41-8d41-4404-91ec-34cbfec30037 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:09.170529 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a921ad41-8d41-4404-91ec-34cbfec30037 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:09.170958 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a921ad41-8d41-4404-91ec-34cbfec30037 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:09.496404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a921ad41-8d41-4404-91ec-34cbfec30037 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:09.512804 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a921ad41-8d41-4404-91ec-34cbfec30037 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:09.515800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a921ad41-8d41-4404-91ec-34cbfec30037 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:09.545422 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a921ad41-8d41-4404-91ec-34cbfec30037 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1544 microversion: 2.91 time: 0.401887 Oct 29 02:51:09.568835 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 701/1371] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:09 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1544 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:51:09.690534 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-35757c6e-ea39-4382-ac04-a8ccebd6bdfc tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] validate_networks() for None {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:51:09.930029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-73004183-fc6a-4c04-a1ca-623831e9b971 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:09.930847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-73004183-fc6a-4c04-a1ca-623831e9b971 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:09.938328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73004183-fc6a-4c04-a1ca-623831e9b971 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:09.938818 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73004183-fc6a-4c04-a1ca-623831e9b971 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:09.945259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73004183-fc6a-4c04-a1ca-623831e9b971 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:09.950191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73004183-fc6a-4c04-a1ca-623831e9b971 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:09.954919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73004183-fc6a-4c04-a1ca-623831e9b971 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:09.956367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73004183-fc6a-4c04-a1ca-623831e9b971 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:10.160131 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-73004183-fc6a-4c04-a1ca-623831e9b971 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e823b4fb116c48ea92c2d3da58e10f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a70e4fa3141bb8b667b1be8e9594b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:10.200481 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-73004183-fc6a-4c04-a1ca-623831e9b971 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54" status: 200 len: 1614 microversion: 2.1 time: 0.270736 Oct 29 02:51:10.220353 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 702/1372] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:09 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 => generated 1614 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:10.231012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-f42e2710-0e05-4608-b420-f7e5ec9064ea req-b516ffea-cf20-40fb-94cc-3d74baa53af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e14d80ff-4e71-4822-917c-ee46b9c7be54", "name": "network-vif-deleted", "tag": "c7e34011-b5a8-480b-8c27-6a70268c0206"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:10.274547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f42e2710-0e05-4608-b420-f7e5ec9064ea req-b516ffea-cf20-40fb-94cc-3d74baa53af9 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:10.275474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f42e2710-0e05-4608-b420-f7e5ec9064ea req-b516ffea-cf20-40fb-94cc-3d74baa53af9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:10.276057 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f42e2710-0e05-4608-b420-f7e5ec9064ea req-b516ffea-cf20-40fb-94cc-3d74baa53af9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:10.310919 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-f42e2710-0e05-4608-b420-f7e5ec9064ea req-b516ffea-cf20-40fb-94cc-3d74baa53af9 service nova] Creating event network-vif-deleted:c7e34011-b5a8-480b-8c27-6a70268c0206 for instance e14d80ff-4e71-4822-917c-ee46b9c7be54 on n-h1-862967-2 Oct 29 02:51:10.318289 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-f42e2710-0e05-4608-b420-f7e5ec9064ea req-b516ffea-cf20-40fb-94cc-3d74baa53af9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094300 Oct 29 02:51:10.319618 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 703/1373] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:10.603937 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-567027f2-1702-4d6e-99ab-d4c235a94937 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:10.605238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-567027f2-1702-4d6e-99ab-d4c235a94937 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:10.618421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-567027f2-1702-4d6e-99ab-d4c235a94937 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:10.618920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-567027f2-1702-4d6e-99ab-d4c235a94937 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:10.619408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-567027f2-1702-4d6e-99ab-d4c235a94937 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:10.620781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-567027f2-1702-4d6e-99ab-d4c235a94937 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:10.627230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-567027f2-1702-4d6e-99ab-d4c235a94937 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:10.641194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-567027f2-1702-4d6e-99ab-d4c235a94937 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:10.738263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:10.914861 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-567027f2-1702-4d6e-99ab-d4c235a94937 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:10.926745 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-567027f2-1702-4d6e-99ab-d4c235a94937 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:10.951070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-567027f2-1702-4d6e-99ab-d4c235a94937 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:10.975093 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-567027f2-1702-4d6e-99ab-d4c235a94937 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1531 microversion: 2.91 time: 0.376101 Oct 29 02:51:10.977815 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 704/1374] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:10 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1531 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:11.011521 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e9a41f61-8907-4cda-9cf4-475dae7c4049 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:11.012962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e9a41f61-8907-4cda-9cf4-475dae7c4049 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:11.024485 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9a41f61-8907-4cda-9cf4-475dae7c4049 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:11.026752 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9a41f61-8907-4cda-9cf4-475dae7c4049 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:11.027501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9a41f61-8907-4cda-9cf4-475dae7c4049 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:11.028929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9a41f61-8907-4cda-9cf4-475dae7c4049 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:11.029617 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9a41f61-8907-4cda-9cf4-475dae7c4049 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:11.030407 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9a41f61-8907-4cda-9cf4-475dae7c4049 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:11.224970 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-e9a41f61-8907-4cda-9cf4-475dae7c4049 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] Lazy-loading 'services' on Instance uuid 0d377f50-7426-425c-a1fe-c63f8d0f1186 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:51:11.280350 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e9a41f61-8907-4cda-9cf4-475dae7c4049 tempest-UnshelveToHostMultiNodesTest-1796040336 tempest-UnshelveToHostMultiNodesTest-1796040336-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1936 microversion: 2.91 time: 0.276963 Oct 29 02:51:11.292581 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 705/1375] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:11 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1936 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:51:11.306697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c6f9372f-bd52-4b95-a03e-a9397849f9a4 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:11.306697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c6f9372f-bd52-4b95-a03e-a9397849f9a4 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:11.328640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6f9372f-bd52-4b95-a03e-a9397849f9a4 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:11.333749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6f9372f-bd52-4b95-a03e-a9397849f9a4 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:11.333749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6f9372f-bd52-4b95-a03e-a9397849f9a4 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:11.335432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6f9372f-bd52-4b95-a03e-a9397849f9a4 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:11.335911 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6f9372f-bd52-4b95-a03e-a9397849f9a4 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:11.336352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6f9372f-bd52-4b95-a03e-a9397849f9a4 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:11.387844 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-c6f9372f-bd52-4b95-a03e-a9397849f9a4 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] HTTP exception thrown: Instance e14d80ff-4e71-4822-917c-ee46b9c7be54 could not be found. Oct 29 02:51:11.395312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c6f9372f-bd52-4b95-a03e-a9397849f9a4 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Request method failure captured: Oct 29 02:51:11.395312 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 HTTP/1.1 Oct 29 02:51:11.395312 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:51:11.395312 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:51:11.395312 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:51:11.395312 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:51:11.395312 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:51:11.395312 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:51:11.395312 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:51:11.395312 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:11.395312 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJRDFkMNWcTVAMbwqi7XOjTSBR6gQU7UJXfvsC69HTO3rlrffYppHu0isekbDpK_etiV3ircD6fBZSUKQu4f6s5VYOVABfQbG3U-2xcJXMwynE50nzib9CPZ-b6aEfxrmod28_F6mjoE-NnJZK8AOq7iy-5YSC6Iqfam8l4and4bCNc Oct 29 02:51:11.395312 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:51:11.395312 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:51:11.395312 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:51:11.395312 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:51:11.395312 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:51:11.395312 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:51:11.395312 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 859a70e4fa3141bb8b667b1be8e9594b Oct 29 02:51:11.395312 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-479936889 Oct 29 02:51:11.395312 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:51:11.395312 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:51:11.397035 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/859a70e4fa3141bb8b667b1be8e9594b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/859a70e4fa3141bb8b667b1be8e9594b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_859a70e4fa3141bb8b667b1be8e9594b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/859a70e4fa3141bb8b667b1be8e9594b"}]}] Oct 29 02:51:11.397035 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-479936889 Oct 29 02:51:11.397035 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 859a70e4fa3141bb8b667b1be8e9594b Oct 29 02:51:11.397035 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-479936889 Oct 29 02:51:11.397035 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-AttachSCSIVolumeTestJSON-479936889-project Oct 29 02:51:11.397035 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:51:11.397035 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:51:11.397035 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: e823b4fb116c48ea92c2d3da58e10f5a Oct 29 02:51:11.397035 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-479936889-project Oct 29 02:51:11.397035 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:51:11.397035 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance e14d80ff-4e71-4822-917c-ee46b9c7be54 could not be found. Oct 29 02:51:11.397035 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'e14d80ff-4e71-4822-917c-ee46b9c7be54'} Oct 29 02:51:11.397819 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:11.397819 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:11.397819 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:51:11.397819 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:51:11.397819 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:51:11.397819 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:51:11.397819 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:51:11.397819 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:51:11.397819 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:51:11.397819 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:51:11.397819 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e14d80ff-4e71-4822-917c-ee46b9c7be54 could not be found. Oct 29 02:51:11.397819 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:11.397819 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:11.397819 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:11.397819 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:11.397819 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:11.397819 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:11.397819 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:11.397819 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:11.397819 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:11.399048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:11.399048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:51:11.399048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:51:11.399048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:51:11.399048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:51:11.399048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:51:11.399048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:51:11.399048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e14d80ff-4e71-4822-917c-ee46b9c7be54 could not be found. Oct 29 02:51:11.399048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:11.399048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:11.399048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:11.399048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:11.399048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:11.399048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:11.399048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:11.399048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:11.399048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e14d80ff-4e71-4822-917c-ee46b9c7be54 could not be found. Oct 29 02:51:11.399048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:11.400616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c6f9372f-bd52-4b95-a03e-a9397849f9a4 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Returning 404 to user: Instance e14d80ff-4e71-4822-917c-ee46b9c7be54 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:11.400616 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c6f9372f-bd52-4b95-a03e-a9397849f9a4 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54" status: 404 len: 111 microversion: 2.1 time: 0.113015 Oct 29 02:51:11.406418 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 706/1376] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:11 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:51:11.421342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-12cfd578-cf8d-4c2e-9b56-9005aa910143 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:11.422251 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-12cfd578-cf8d-4c2e-9b56-9005aa910143 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:11.437736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12cfd578-cf8d-4c2e-9b56-9005aa910143 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:11.437736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12cfd578-cf8d-4c2e-9b56-9005aa910143 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:11.437736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12cfd578-cf8d-4c2e-9b56-9005aa910143 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:11.438474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12cfd578-cf8d-4c2e-9b56-9005aa910143 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:11.440989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12cfd578-cf8d-4c2e-9b56-9005aa910143 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:11.441436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12cfd578-cf8d-4c2e-9b56-9005aa910143 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:11.512160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-12cfd578-cf8d-4c2e-9b56-9005aa910143 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:51:11.677531 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-12cfd578-cf8d-4c2e-9b56-9005aa910143 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 204 len: 0 microversion: 2.91 time: 0.271498 Oct 29 02:51:11.679128 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 707/1377] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Oct 29 02:51:11 2022] DELETE /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 02:51:11.685824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9b9edd54-4369-41b8-98c8-e027060e2ffb tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '.version_select at 0x7ff053e840d0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:11.697486 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-35757c6e-ea39-4382-ac04-a8ccebd6bdfc tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:51:11.698564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-35757c6e-ea39-4382-ac04-a8ccebd6bdfc tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:51:11.699584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-35757c6e-ea39-4382-ac04-a8ccebd6bdfc tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:51:11.700320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-35757c6e-ea39-4382-ac04-a8ccebd6bdfc tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:51:11.701867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-35757c6e-ea39-4382-ac04-a8ccebd6bdfc tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:51:11.728252 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9b9edd54-4369-41b8-98c8-e027060e2ffb tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1385407257" status: 202 len: 0 microversion: 2.1 time: 0.047668 Oct 29 02:51:11.728904 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 708/1378] 10.222.0.46 () {58 vars in 1221 bytes} [Sat Oct 29 02:51:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1385407257 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:51:11.738238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dfaa143f-96fb-40cc-ac89-f91ba368903f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:11.739629 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dfaa143f-96fb-40cc-ac89-f91ba368903f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:11.751104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfaa143f-96fb-40cc-ac89-f91ba368903f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:11.751939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfaa143f-96fb-40cc-ac89-f91ba368903f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:11.752622 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfaa143f-96fb-40cc-ac89-f91ba368903f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:11.753525 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfaa143f-96fb-40cc-ac89-f91ba368903f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:11.754232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfaa143f-96fb-40cc-ac89-f91ba368903f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:11.755943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfaa143f-96fb-40cc-ac89-f91ba368903f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:11.772649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35757c6e-ea39-4382-ac04-a8ccebd6bdfc tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:11.773459 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35757c6e-ea39-4382-ac04-a8ccebd6bdfc tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:11.774194 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35757c6e-ea39-4382-ac04-a8ccebd6bdfc tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:11.775427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35757c6e-ea39-4382-ac04-a8ccebd6bdfc tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:11.776220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35757c6e-ea39-4382-ac04-a8ccebd6bdfc tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:11.787588 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35757c6e-ea39-4382-ac04-a8ccebd6bdfc tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:11.891180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-35757c6e-ea39-4382-ac04-a8ccebd6bdfc tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Getting quotas for project 17f19c629832452bb23bdf27e87e0a49. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:51:11.916202 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-35757c6e-ea39-4382-ac04-a8ccebd6bdfc tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Getting quotas for user a33ab5d704ab43e4b83938ad17c418f3 and project 17f19c629832452bb23bdf27e87e0a49. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:51:11.966201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dfaa143f-96fb-40cc-ac89-f91ba368903f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:11.979411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dfaa143f-96fb-40cc-ac89-f91ba368903f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:11.981203 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dfaa143f-96fb-40cc-ac89-f91ba368903f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:11.984369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-35757c6e-ea39-4382-ac04-a8ccebd6bdfc tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:51:11.996871 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dfaa143f-96fb-40cc-ac89-f91ba368903f tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1537 microversion: 2.91 time: 0.266536 Oct 29 02:51:12.006295 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-35757c6e-ea39-4382-ac04-a8ccebd6bdfc tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8b24cadb-50b5-47ab-8456-cabed237b2d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:51:12.008926 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 709/1379] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:11 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1537 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:12.160061 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-35757c6e-ea39-4382-ac04-a8ccebd6bdfc tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.029445 Oct 29 02:51:12.162673 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 671/1380] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:51:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 4050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:51:12.175262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-57010ac7-7c76-4493-bb41-0dd434e02a8a tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:12.176413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-57010ac7-7c76-4493-bb41-0dd434e02a8a tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8b24cadb-50b5-47ab-8456-cabed237b2d5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:12.339854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-57010ac7-7c76-4493-bb41-0dd434e02a8a tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:12.353950 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-57010ac7-7c76-4493-bb41-0dd434e02a8a tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5" status: 200 len: 1220 microversion: 2.1 time: 0.181724 Oct 29 02:51:12.355976 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 710/1381] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:12 2022] GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5 => generated 1220 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:13.041131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-19ca7283-77fe-4cd2-b9ec-e3256f3b8a90 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:13.043202 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-19ca7283-77fe-4cd2-b9ec-e3256f3b8a90 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:13.067423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19ca7283-77fe-4cd2-b9ec-e3256f3b8a90 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:13.069406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19ca7283-77fe-4cd2-b9ec-e3256f3b8a90 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:13.073370 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19ca7283-77fe-4cd2-b9ec-e3256f3b8a90 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:13.074861 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19ca7283-77fe-4cd2-b9ec-e3256f3b8a90 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:13.075898 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19ca7283-77fe-4cd2-b9ec-e3256f3b8a90 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:13.077556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19ca7283-77fe-4cd2-b9ec-e3256f3b8a90 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:13.383837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-61ca8603-66c4-453b-a18a-e70a6876932d tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:13.390788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-61ca8603-66c4-453b-a18a-e70a6876932d tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8b24cadb-50b5-47ab-8456-cabed237b2d5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:13.425076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-61ca8603-66c4-453b-a18a-e70a6876932d tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:13.425887 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-61ca8603-66c4-453b-a18a-e70a6876932d tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:13.426669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-61ca8603-66c4-453b-a18a-e70a6876932d tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:13.427922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-61ca8603-66c4-453b-a18a-e70a6876932d tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:13.443398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-61ca8603-66c4-453b-a18a-e70a6876932d tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:13.444393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-61ca8603-66c4-453b-a18a-e70a6876932d tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:13.717903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-61ca8603-66c4-453b-a18a-e70a6876932d tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:13.741585 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-61ca8603-66c4-453b-a18a-e70a6876932d tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5" status: 200 len: 1216 microversion: 2.1 time: 0.366664 Oct 29 02:51:13.747016 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 711/1382] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:13 2022] GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5 => generated 1216 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:14.076062 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-19ca7283-77fe-4cd2-b9ec-e3256f3b8a90 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:14.114657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-19ca7283-77fe-4cd2-b9ec-e3256f3b8a90 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:14.130596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-19ca7283-77fe-4cd2-b9ec-e3256f3b8a90 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:14.156468 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-19ca7283-77fe-4cd2-b9ec-e3256f3b8a90 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1537 microversion: 2.91 time: 1.132112 Oct 29 02:51:14.159376 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 672/1383] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:13 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1537 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:14.710823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7f215d8b-ceb4-4062-895e-1d6ec53434b0 tempest-FloatingIPsTestJSON-184214188 tempest-FloatingIPsTestJSON-184214188-project] Action: 'create', calling method: .version_select at 0x7ff0581be310>, body: {"pool": null} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:14.778361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6da7962d-738d-475d-8413-e046a29b361f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:14.782263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6da7962d-738d-475d-8413-e046a29b361f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8b24cadb-50b5-47ab-8456-cabed237b2d5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:14.811104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6da7962d-738d-475d-8413-e046a29b361f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:14.811505 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6da7962d-738d-475d-8413-e046a29b361f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:14.812169 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6da7962d-738d-475d-8413-e046a29b361f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:14.813367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6da7962d-738d-475d-8413-e046a29b361f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:14.815797 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6da7962d-738d-475d-8413-e046a29b361f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:14.817863 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6da7962d-738d-475d-8413-e046a29b361f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:15.179514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6da7962d-738d-475d-8413-e046a29b361f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:15.189569 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6da7962d-738d-475d-8413-e046a29b361f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5" status: 200 len: 1290 microversion: 2.1 time: 0.421240 Oct 29 02:51:15.199830 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 673/1384] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:14 2022] GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5 => generated 1290 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:15.215180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-667a2e59-c706-4106-812d-da463eb4342e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:15.220913 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-667a2e59-c706-4106-812d-da463eb4342e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:15.231497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-667a2e59-c706-4106-812d-da463eb4342e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:15.232510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-667a2e59-c706-4106-812d-da463eb4342e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:15.236391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-667a2e59-c706-4106-812d-da463eb4342e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:15.237359 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-667a2e59-c706-4106-812d-da463eb4342e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:15.239894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-667a2e59-c706-4106-812d-da463eb4342e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:15.239894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-667a2e59-c706-4106-812d-da463eb4342e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:15.368676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-667a2e59-c706-4106-812d-da463eb4342e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:15.370313 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-667a2e59-c706-4106-812d-da463eb4342e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:15.371917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-667a2e59-c706-4106-812d-da463eb4342e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:15.374670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-667a2e59-c706-4106-812d-da463eb4342e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lazy-loading 'fault' on Instance uuid 0d377f50-7426-425c-a1fe-c63f8d0f1186 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:51:15.687751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-667a2e59-c706-4106-812d-da463eb4342e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:15.704002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-667a2e59-c706-4106-812d-da463eb4342e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:15.707405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-667a2e59-c706-4106-812d-da463eb4342e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '938533fc5a724b5196e44c8336bd009a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4c45269d374fb1bc6354b0f95e229b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:15.730126 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-667a2e59-c706-4106-812d-da463eb4342e tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 200 len: 1542 microversion: 2.91 time: 0.522546 Oct 29 02:51:15.751027 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 674/1385] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:15 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 1542 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:16.230952 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-839117ad-71df-4eba-83e4-daddab98dfa2 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:16.232115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-839117ad-71df-4eba-83e4-daddab98dfa2 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8b24cadb-50b5-47ab-8456-cabed237b2d5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:16.247038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-839117ad-71df-4eba-83e4-daddab98dfa2 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:16.247602 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-839117ad-71df-4eba-83e4-daddab98dfa2 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:16.253336 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-839117ad-71df-4eba-83e4-daddab98dfa2 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:16.254370 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-839117ad-71df-4eba-83e4-daddab98dfa2 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:16.254859 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-839117ad-71df-4eba-83e4-daddab98dfa2 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:16.255289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-839117ad-71df-4eba-83e4-daddab98dfa2 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:16.449423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-839117ad-71df-4eba-83e4-daddab98dfa2 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:16.466477 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-839117ad-71df-4eba-83e4-daddab98dfa2 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5" status: 200 len: 1278 microversion: 2.1 time: 0.240121 Oct 29 02:51:16.485584 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 675/1386] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:16 2022] GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5 => generated 1278 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:51:16.764693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-38519a75-4973-4cfa-8dec-4ff6b3ef5544 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:16.766003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-38519a75-4973-4cfa-8dec-4ff6b3ef5544 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] [instance: 0d377f50-7426-425c-a1fe-c63f8d0f1186] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:16.783928 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-38519a75-4973-4cfa-8dec-4ff6b3ef5544 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:16.784444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-38519a75-4973-4cfa-8dec-4ff6b3ef5544 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:16.784921 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-38519a75-4973-4cfa-8dec-4ff6b3ef5544 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:16.785698 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-38519a75-4973-4cfa-8dec-4ff6b3ef5544 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:16.797342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-38519a75-4973-4cfa-8dec-4ff6b3ef5544 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:16.797999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-38519a75-4973-4cfa-8dec-4ff6b3ef5544 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:16.854988 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-38519a75-4973-4cfa-8dec-4ff6b3ef5544 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] HTTP exception thrown: Instance 0d377f50-7426-425c-a1fe-c63f8d0f1186 could not be found. Oct 29 02:51:16.862329 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-38519a75-4973-4cfa-8dec-4ff6b3ef5544 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Request method failure captured: Oct 29 02:51:16.862329 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 HTTP/1.1 Oct 29 02:51:16.862329 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:51:16.862329 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:51:16.862329 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:51:16.862329 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:51:16.862329 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:51:16.862329 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:51:16.862329 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:51:16.862329 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:16.862329 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJRlLaBsOqO8CAryaS-t7PgHlgICr9msJsXphLr8TG2dCe8x5ByySWmrywD3Z2tYAWungLOTDw6un_v7VoSkuIFMxe_ip-NIxiMW9pYJfUsXQgpka3VY5Y7jsnO70-BW4YzY9hwNOPccZZk_H3no1_hngZfDuwva1yNW1FudS7NXgx0 Oct 29 02:51:16.862329 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:51:16.862329 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:51:16.862329 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:51:16.862329 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:51:16.862329 n-d-862967-2 devstack@n-api.service[127125]: X-Openstack-Nova-Api-Version: 2.91 Oct 29 02:51:16.862329 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:51:16.862329 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:51:16.862329 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: be4c45269d374fb1bc6354b0f95e229b Oct 29 02:51:16.862329 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-609898212 Oct 29 02:51:16.862329 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:51:16.862329 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:51:16.863880 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/be4c45269d374fb1bc6354b0f95e229b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/be4c45269d374fb1bc6354b0f95e229b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_be4c45269d374fb1bc6354b0f95e229b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/be4c45269d374fb1bc6354b0f95e229b"}]}] Oct 29 02:51:16.863880 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-609898212 Oct 29 02:51:16.863880 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: be4c45269d374fb1bc6354b0f95e229b Oct 29 02:51:16.863880 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-609898212 Oct 29 02:51:16.863880 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-UnshelveToHostMultiNodesTest-609898212-project Oct 29 02:51:16.863880 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:51:16.863880 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:51:16.863880 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 938533fc5a724b5196e44c8336bd009a Oct 29 02:51:16.863880 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-609898212-project Oct 29 02:51:16.863880 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:51:16.863880 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 0d377f50-7426-425c-a1fe-c63f8d0f1186 could not be found. Oct 29 02:51:16.863880 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '0d377f50-7426-425c-a1fe-c63f8d0f1186'} Oct 29 02:51:16.864718 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:16.864718 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:16.864718 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:51:16.864718 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:51:16.864718 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:51:16.864718 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:51:16.864718 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:51:16.864718 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:51:16.864718 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:51:16.864718 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:51:16.864718 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d377f50-7426-425c-a1fe-c63f8d0f1186 could not be found. Oct 29 02:51:16.864718 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:16.864718 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:16.864718 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:16.864718 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:16.864718 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:16.864718 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:16.864718 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:16.864718 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:16.864718 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:16.868251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:16.868251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:51:16.868251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:51:16.868251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:51:16.868251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:51:16.868251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:51:16.868251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:51:16.868251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d377f50-7426-425c-a1fe-c63f8d0f1186 could not be found. Oct 29 02:51:16.868251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:16.868251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:16.868251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:16.868251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:16.868251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:16.868251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:16.868251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:16.868251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:16.868251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d377f50-7426-425c-a1fe-c63f8d0f1186 could not be found. Oct 29 02:51:16.868251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:16.870177 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-38519a75-4973-4cfa-8dec-4ff6b3ef5544 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] Returning 404 to user: Instance 0d377f50-7426-425c-a1fe-c63f8d0f1186 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:16.870177 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-38519a75-4973-4cfa-8dec-4ff6b3ef5544 tempest-UnshelveToHostMultiNodesTest-609898212 tempest-UnshelveToHostMultiNodesTest-609898212-project] 10.222.0.46 "GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186" status: 404 len: 111 microversion: 2.91 time: 0.104846 Oct 29 02:51:16.870177 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 676/1387] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:16 2022] GET /compute/v2.1/servers/0d377f50-7426-425c-a1fe-c63f8d0f1186 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 29 02:51:17.495578 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2d4e9a16-8478-4ce0-b893-cd9040197bf4 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:17.496278 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2d4e9a16-8478-4ce0-b893-cd9040197bf4 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8b24cadb-50b5-47ab-8456-cabed237b2d5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:17.516893 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d4e9a16-8478-4ce0-b893-cd9040197bf4 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:17.517696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d4e9a16-8478-4ce0-b893-cd9040197bf4 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:17.520098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d4e9a16-8478-4ce0-b893-cd9040197bf4 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:17.523310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d4e9a16-8478-4ce0-b893-cd9040197bf4 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:17.524761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d4e9a16-8478-4ce0-b893-cd9040197bf4 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:17.528254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d4e9a16-8478-4ce0-b893-cd9040197bf4 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:18.238824 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2d4e9a16-8478-4ce0-b893-cd9040197bf4 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:18.258138 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2d4e9a16-8478-4ce0-b893-cd9040197bf4 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5" status: 200 len: 1320 microversion: 2.1 time: 0.766639 Oct 29 02:51:18.258752 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 677/1388] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:17 2022] GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5 => generated 1320 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:51:18.515502 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-698f0b30-45b7-40ee-9c82-59dcc7ecdeef tempest-TenantUsagesNegativeTestJSON-1651131605 tempest-TenantUsagesNegativeTestJSON-1651131605-project-admin] 10.222.0.46 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-28T02%3A51%3A17.978367&end=2022-10-30T02%3A51%3A17.978367" status: 404 len: 112 microversion: - time: 0.253118 Oct 29 02:51:18.520639 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 678/1389] 10.222.0.46 () {58 vars in 1316 bytes} [Sat Oct 29 02:51:18 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-28T02%3A51%3A17.978367&end=2022-10-30T02%3A51%3A17.978367 => generated 112 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 29 02:51:18.528931 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-66819a87-7bc7-41cd-8cb4-65511c280d0a tempest-TenantUsagesNegativeTestJSON-1651131605 tempest-TenantUsagesNegativeTestJSON-1651131605-project-admin] Calling method '.version_select at 0x7ff0538b0c10>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:18.548931 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-66819a87-7bc7-41cd-8cb4-65511c280d0a tempest-TenantUsagesNegativeTestJSON-1651131605 tempest-TenantUsagesNegativeTestJSON-1651131605-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 29 02:51:18.565242 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-66819a87-7bc7-41cd-8cb4-65511c280d0a tempest-TenantUsagesNegativeTestJSON-1651131605 tempest-TenantUsagesNegativeTestJSON-1651131605-project-admin] Request method failure captured: Oct 29 02:51:18.565242 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/os-simple-tenant-usage/84a5cbaa976f43e98f1b68ac3d114951?start=2022-10-30T02%3A51%3A17.978367&end=2022-10-28T02%3A51%3A17.978367 HTTP/1.1 Oct 29 02:51:18.565242 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:51:18.565242 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:51:18.565242 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:51:18.565242 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:51:18.565242 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:51:18.565242 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:51:18.565242 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:51:18.565242 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:18.565242 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJUlqOHnwNxmvWdXGe0OMgF6tfTgB2mZGzy8cUjj5A7Ab20WsebICtCPQgB1NJnKZ3rTAVyHiPHjkcWbN33Iz7VsykvpFlLkRT1oXQYlsxVDZQRMZFGxUFZqplZ1SyDXmxqtz11Z1HlT6WLnye04plTz-HYsXWOp-kxEiyAUh-ekO-s Oct 29 02:51:18.565242 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:51:18.565242 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:51:18.565242 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:51:18.565242 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:51:18.565242 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:51:18.565242 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:51:18.565242 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 6885250065984effa7ca0dd56ed3500a Oct 29 02:51:18.565242 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1651131605 Oct 29 02:51:18.565242 n-d-862967-2 devstack@n-api.service[127125]: X-Role: admin,reader,member Oct 29 02:51:18.565242 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: admin,reader,member Oct 29 02:51:18.567073 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6885250065984effa7ca0dd56ed3500a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6885250065984effa7ca0dd56ed3500a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6885250065984effa7ca0dd56ed3500a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6885250065984effa7ca0dd56ed3500a"}]}] Oct 29 02:51:18.567073 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1651131605 Oct 29 02:51:18.567073 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 6885250065984effa7ca0dd56ed3500a Oct 29 02:51:18.567073 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1651131605 Oct 29 02:51:18.567073 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TenantUsagesNegativeTestJSON-1651131605-project-admin Oct 29 02:51:18.567073 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:51:18.567073 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:51:18.567073 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 1b9443b2aca64a76b50a610a34e597ed Oct 29 02:51:18.567073 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1651131605-project-admin Oct 29 02:51:18.567073 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:51:18.567073 n-d-862967-2 devstack@n-api.service[127125]: exception: Invalid start time. The start time cannot occur after the end time. Oct 29 02:51:18.567073 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '84a5cbaa976f43e98f1b68ac3d114951'} Oct 29 02:51:18.568031 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:18.568031 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:18.568031 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:18.568031 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:18.568031 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:18.568031 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:18.568031 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:51:18.568031 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:51:18.568031 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 02:51:18.568031 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:51:18.568031 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:18.568031 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:18.568031 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 29 02:51:18.568031 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 29 02:51:18.568031 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 29 02:51:18.568031 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 29 02:51:18.568031 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 29 02:51:18.568031 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 29 02:51:18.568031 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 29 02:51:18.569514 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:18.569514 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:18.569514 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:18.569514 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:18.569514 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:18.569514 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:18.569514 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:18.569514 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:18.569514 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 29 02:51:18.569514 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:18.571316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-66819a87-7bc7-41cd-8cb4-65511c280d0a tempest-TenantUsagesNegativeTestJSON-1651131605 tempest-TenantUsagesNegativeTestJSON-1651131605-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:18.572348 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-66819a87-7bc7-41cd-8cb4-65511c280d0a tempest-TenantUsagesNegativeTestJSON-1651131605 tempest-TenantUsagesNegativeTestJSON-1651131605-project-admin] 10.222.0.46 "GET /compute/v2.1/os-simple-tenant-usage/84a5cbaa976f43e98f1b68ac3d114951?start=2022-10-30T02%3A51%3A17.978367&end=2022-10-28T02%3A51%3A17.978367" status: 400 len: 111 microversion: 2.1 time: 0.050568 Oct 29 02:51:18.573083 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 679/1390] 10.222.0.46 () {58 vars in 1412 bytes} [Sat Oct 29 02:51:18 2022] GET /compute/v2.1/os-simple-tenant-usage/84a5cbaa976f43e98f1b68ac3d114951?start=2022-10-30T02%3A51%3A17.978367&end=2022-10-28T02%3A51%3A17.978367 => generated 111 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 02:51:18.893101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-84d164d9-b1e6-49a6-986a-46e8c89ef6e3 tempest-TenantUsagesNegativeTestJSON-1028231781 tempest-TenantUsagesNegativeTestJSON-1028231781-project] Calling method '.version_select at 0x7ff053861ee0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:18.897503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-84d164d9-b1e6-49a6-986a-46e8c89ef6e3 tempest-TenantUsagesNegativeTestJSON-1028231781 tempest-TenantUsagesNegativeTestJSON-1028231781-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '7eee9e350f7b49be94881f3d70a05f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a5cbaa976f43e98f1b68ac3d114951', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:18.909258 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-84d164d9-b1e6-49a6-986a-46e8c89ef6e3 tempest-TenantUsagesNegativeTestJSON-1028231781 tempest-TenantUsagesNegativeTestJSON-1028231781-project] Request method failure captured: Oct 29 02:51:18.909258 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-28T02%3A51%3A17.978367&end=2022-10-30T02%3A51%3A17.978367&detailed=1 HTTP/1.1 Oct 29 02:51:18.909258 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:51:18.909258 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:51:18.909258 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:51:18.909258 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:51:18.909258 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:51:18.909258 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:51:18.909258 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:51:18.909258 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:18.909258 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJUk4S2C8ufPPP_ZAplyzwdXfAN684YUTZD1kWB1i-PLUijlXUVk8nRQi4z_Mp-44OdYMFg5t2EN7Vz0hMbvQHWiErm5cy7F9dz5UYhtOvRQkrqadpJ1hTekhkgKVvIn8Nk9oM3tLlI2Lxv2THsq5C8BSNi1PsHKg67rFtljWmiG-ug Oct 29 02:51:18.909258 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:51:18.909258 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:51:18.909258 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:51:18.909258 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:51:18.909258 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:51:18.909258 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:51:18.909258 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 84a5cbaa976f43e98f1b68ac3d114951 Oct 29 02:51:18.909258 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1028231781 Oct 29 02:51:18.909258 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:51:18.909258 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:51:18.910916 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/84a5cbaa976f43e98f1b68ac3d114951"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/84a5cbaa976f43e98f1b68ac3d114951"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_84a5cbaa976f43e98f1b68ac3d114951"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/84a5cbaa976f43e98f1b68ac3d114951"}]}] Oct 29 02:51:18.910916 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1028231781 Oct 29 02:51:18.910916 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 84a5cbaa976f43e98f1b68ac3d114951 Oct 29 02:51:18.910916 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1028231781 Oct 29 02:51:18.910916 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TenantUsagesNegativeTestJSON-1028231781-project Oct 29 02:51:18.910916 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:51:18.910916 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:51:18.910916 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 7eee9e350f7b49be94881f3d70a05f83 Oct 29 02:51:18.910916 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1028231781-project Oct 29 02:51:18.910916 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:51:18.910916 n-d-862967-2 devstack@n-api.service[127125]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 29 02:51:18.910916 n-d-862967-2 devstack@n-api.service[127125]: action_args: {} Oct 29 02:51:18.910916 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:18.911860 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:18.911860 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:18.911860 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:18.911860 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:18.911860 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:18.911860 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:51:18.911860 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:51:18.911860 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 02:51:18.911860 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:51:18.911860 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:18.911860 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:18.911860 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 29 02:51:18.911860 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 29 02:51:18.911860 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 29 02:51:18.911860 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 29 02:51:18.911860 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:51:18.911860 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:51:18.911860 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:51:18.911860 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:51:18.913318 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:51:18.913318 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:51:18.913318 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:51:18.913318 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:51:18.913318 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:51:18.913318 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:51:18.913318 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:51:18.913318 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:51:18.913318 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:51:18.913318 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:51:18.913318 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 29 02:51:18.913318 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:18.913318 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:18.913318 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:18.913318 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:18.913318 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:18.913318 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:18.913318 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:51:18.913318 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:51:18.914501 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 29 02:51:18.914501 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:18.914501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-84d164d9-b1e6-49a6-986a-46e8c89ef6e3 tempest-TenantUsagesNegativeTestJSON-1028231781 tempest-TenantUsagesNegativeTestJSON-1028231781-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:18.914501 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-84d164d9-b1e6-49a6-986a-46e8c89ef6e3 tempest-TenantUsagesNegativeTestJSON-1028231781 tempest-TenantUsagesNegativeTestJSON-1028231781-project] 10.222.0.46 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-28T02%3A51%3A17.978367&end=2022-10-30T02%3A51%3A17.978367&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.329573 Oct 29 02:51:18.916919 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 680/1391] 10.222.0.46 () {58 vars in 1335 bytes} [Sat Oct 29 02:51:18 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-28T02%3A51%3A17.978367&end=2022-10-30T02%3A51%3A17.978367&detailed=1 => generated 123 bytes in 336 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:51:19.285976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-642a935e-e665-4443-bf28-fe28fbffb65f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:19.286602 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-642a935e-e665-4443-bf28-fe28fbffb65f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8b24cadb-50b5-47ab-8456-cabed237b2d5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:19.301470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:19.303707 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-642a935e-e665-4443-bf28-fe28fbffb65f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:19.304205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-642a935e-e665-4443-bf28-fe28fbffb65f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:19.304658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-642a935e-e665-4443-bf28-fe28fbffb65f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:19.309569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-642a935e-e665-4443-bf28-fe28fbffb65f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:19.310066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-642a935e-e665-4443-bf28-fe28fbffb65f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:19.310539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-642a935e-e665-4443-bf28-fe28fbffb65f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:19.419787 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:20.440235 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-642a935e-e665-4443-bf28-fe28fbffb65f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:20.455996 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-642a935e-e665-4443-bf28-fe28fbffb65f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5" status: 200 len: 1320 microversion: 2.1 time: 1.174087 Oct 29 02:51:20.458833 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 681/1392] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:19 2022] GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5 => generated 1320 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:51:21.484789 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e68cd5f4-bbe4-4cbe-af98-19777d0b3d79 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:21.486589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e68cd5f4-bbe4-4cbe-af98-19777d0b3d79 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8b24cadb-50b5-47ab-8456-cabed237b2d5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:21.497860 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e68cd5f4-bbe4-4cbe-af98-19777d0b3d79 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:21.499571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e68cd5f4-bbe4-4cbe-af98-19777d0b3d79 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:21.500858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e68cd5f4-bbe4-4cbe-af98-19777d0b3d79 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:21.504379 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e68cd5f4-bbe4-4cbe-af98-19777d0b3d79 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:21.505105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e68cd5f4-bbe4-4cbe-af98-19777d0b3d79 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:21.506805 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e68cd5f4-bbe4-4cbe-af98-19777d0b3d79 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:21.835128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:21.952093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:22.346209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:23.388227 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e68cd5f4-bbe4-4cbe-af98-19777d0b3d79 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:23.400240 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e68cd5f4-bbe4-4cbe-af98-19777d0b3d79 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5" status: 200 len: 1320 microversion: 2.1 time: 1.919358 Oct 29 02:51:23.401876 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 682/1393] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:21 2022] GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5 => generated 1320 bytes in 1922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:23.404874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:23.467298 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7f215d8b-ceb4-4062-895e-1d6ec53434b0 tempest-FloatingIPsTestJSON-184214188 tempest-FloatingIPsTestJSON-184214188-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 9.115923 Oct 29 02:51:23.468242 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 712/1394] 10.222.0.46 () {60 vars in 1170 bytes} [Sat Oct 29 02:51:14 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 9121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:23.485265 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-57713504-2340-492d-be92-a9f1fc257638 tempest-FloatingIPsTestJSON-184214188 tempest-FloatingIPsTestJSON-184214188-project] Calling method '.version_select at 0x7ff0538b0dc0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:23.926797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-e1402f39-1831-4cd2-897d-e0462274f17c req-54f81e24-77e0-4f84-801c-cd5b1a8fbad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b24cadb-50b5-47ab-8456-cabed237b2d5", "tag": "e3007c86-7dce-4a92-aa92-99e53d24fe9f"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:23.953849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:23.966865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e1402f39-1831-4cd2-897d-e0462274f17c req-54f81e24-77e0-4f84-801c-cd5b1a8fbad9 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:23.966865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e1402f39-1831-4cd2-897d-e0462274f17c req-54f81e24-77e0-4f84-801c-cd5b1a8fbad9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:23.966865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e1402f39-1831-4cd2-897d-e0462274f17c req-54f81e24-77e0-4f84-801c-cd5b1a8fbad9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:23.998232 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-e1402f39-1831-4cd2-897d-e0462274f17c req-54f81e24-77e0-4f84-801c-cd5b1a8fbad9 service nova] Creating event network-changed:e3007c86-7dce-4a92-aa92-99e53d24fe9f for instance 8b24cadb-50b5-47ab-8456-cabed237b2d5 on n-h2-862967-2 Oct 29 02:51:24.003896 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-e1402f39-1831-4cd2-897d-e0462274f17c req-54f81e24-77e0-4f84-801c-cd5b1a8fbad9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084852 Oct 29 02:51:24.004902 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 713/1395] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:24.377328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-da81f85c-65cf-44d9-a863-0d0f35999778 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:24.378173 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-da81f85c-65cf-44d9-a863-0d0f35999778 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:24.398393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da81f85c-65cf-44d9-a863-0d0f35999778 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:24.399124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da81f85c-65cf-44d9-a863-0d0f35999778 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:24.400960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da81f85c-65cf-44d9-a863-0d0f35999778 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:24.403256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da81f85c-65cf-44d9-a863-0d0f35999778 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:24.403910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da81f85c-65cf-44d9-a863-0d0f35999778 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:24.404944 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da81f85c-65cf-44d9-a863-0d0f35999778 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:24.444770 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-da81f85c-65cf-44d9-a863-0d0f35999778 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] HTTP exception thrown: Instance e14d80ff-4e71-4822-917c-ee46b9c7be54 could not be found. Oct 29 02:51:24.449378 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-da81f85c-65cf-44d9-a863-0d0f35999778 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Request method failure captured: Oct 29 02:51:24.449378 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 HTTP/1.1 Oct 29 02:51:24.449378 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:51:24.449378 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:51:24.449378 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:51:24.449378 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:51:24.449378 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:51:24.449378 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:51:24.449378 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:51:24.449378 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:24.449378 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJRDFkMNWcTVAMbwqi7XOjTSBR6gQU7UJXfvsC69HTO3rlrffYppHu0isekbDpK_etiV3ircD6fBZSUKQu4f6s5VYOVABfQbG3U-2xcJXMwynE50nzib9CPZ-b6aEfxrmod28_F6mjoE-NnJZK8AOq7iy-5YSC6Iqfam8l4and4bCNc Oct 29 02:51:24.449378 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:51:24.449378 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:51:24.449378 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:51:24.449378 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:51:24.449378 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:51:24.449378 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:51:24.449378 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 859a70e4fa3141bb8b667b1be8e9594b Oct 29 02:51:24.449378 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-479936889 Oct 29 02:51:24.449378 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:51:24.449378 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:51:24.451056 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/859a70e4fa3141bb8b667b1be8e9594b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/859a70e4fa3141bb8b667b1be8e9594b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_859a70e4fa3141bb8b667b1be8e9594b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/859a70e4fa3141bb8b667b1be8e9594b"}]}] Oct 29 02:51:24.451056 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-479936889 Oct 29 02:51:24.451056 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 859a70e4fa3141bb8b667b1be8e9594b Oct 29 02:51:24.451056 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-479936889 Oct 29 02:51:24.451056 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-AttachSCSIVolumeTestJSON-479936889-project Oct 29 02:51:24.451056 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:51:24.451056 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:51:24.451056 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: e823b4fb116c48ea92c2d3da58e10f5a Oct 29 02:51:24.451056 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-479936889-project Oct 29 02:51:24.451056 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:51:24.451056 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance e14d80ff-4e71-4822-917c-ee46b9c7be54 could not be found. Oct 29 02:51:24.451056 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'e14d80ff-4e71-4822-917c-ee46b9c7be54'} Oct 29 02:51:24.451956 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:24.451956 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:24.451956 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:51:24.451956 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:51:24.451956 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:51:24.451956 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:51:24.451956 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:51:24.451956 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:51:24.451956 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:51:24.451956 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:51:24.451956 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e14d80ff-4e71-4822-917c-ee46b9c7be54 could not be found. Oct 29 02:51:24.451956 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:24.451956 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:24.451956 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:24.451956 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:24.451956 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:24.451956 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:24.451956 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:24.451956 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:24.451956 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:24.453454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:24.453454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:51:24.453454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:51:24.453454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:51:24.453454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:51:24.453454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:51:24.453454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:51:24.453454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:51:24.453454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:51:24.453454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e14d80ff-4e71-4822-917c-ee46b9c7be54 could not be found. Oct 29 02:51:24.453454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:24.453454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:24.453454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:24.453454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:24.453454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:24.453454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:24.453454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:24.453454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:24.453454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e14d80ff-4e71-4822-917c-ee46b9c7be54 could not be found. Oct 29 02:51:24.453454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:24.457045 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-da81f85c-65cf-44d9-a863-0d0f35999778 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Returning 404 to user: Instance e14d80ff-4e71-4822-917c-ee46b9c7be54 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:24.459372 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-da81f85c-65cf-44d9-a863-0d0f35999778 tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54" status: 404 len: 111 microversion: 2.1 time: 0.090068 Oct 29 02:51:24.460419 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 714/1396] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:51:24 2022] DELETE /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:51:24.477512 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-57713504-2340-492d-be92-a9f1fc257638 tempest-FloatingIPsTestJSON-184214188 tempest-FloatingIPsTestJSON-184214188-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips/c2f090ee-63a1-4923-831c-6a1c6e0decfe" status: 200 len: 141 microversion: 2.1 time: 0.997448 Oct 29 02:51:24.485709 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 683/1397] 10.222.0.46 () {58 vars in 1260 bytes} [Sat Oct 29 02:51:23 2022] GET /compute/v2.1/os-floating-ips/c2f090ee-63a1-4923-831c-6a1c6e0decfe => generated 141 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:51:24.485916 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fab297ef-d89e-46ca-9d4c-66a614dc05af tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:24.485916 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fab297ef-d89e-46ca-9d4c-66a614dc05af tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8b24cadb-50b5-47ab-8456-cabed237b2d5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:24.494107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0d10f7e9-389a-4d4e-bb5a-d445061761db tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:24.496249 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0d10f7e9-389a-4d4e-bb5a-d445061761db tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] [instance: e14d80ff-4e71-4822-917c-ee46b9c7be54] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:24.502287 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fab297ef-d89e-46ca-9d4c-66a614dc05af tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:24.502870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fab297ef-d89e-46ca-9d4c-66a614dc05af tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:24.503376 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fab297ef-d89e-46ca-9d4c-66a614dc05af tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:24.509139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fab297ef-d89e-46ca-9d4c-66a614dc05af tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:24.510266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fab297ef-d89e-46ca-9d4c-66a614dc05af tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:24.511958 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fab297ef-d89e-46ca-9d4c-66a614dc05af tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:24.538481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0d10f7e9-389a-4d4e-bb5a-d445061761db tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:24.539755 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0d10f7e9-389a-4d4e-bb5a-d445061761db tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:24.540757 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0d10f7e9-389a-4d4e-bb5a-d445061761db tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:24.546042 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0d10f7e9-389a-4d4e-bb5a-d445061761db tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:24.546911 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0d10f7e9-389a-4d4e-bb5a-d445061761db tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:24.547601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0d10f7e9-389a-4d4e-bb5a-d445061761db tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:24.614715 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-0d10f7e9-389a-4d4e-bb5a-d445061761db tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] HTTP exception thrown: Instance e14d80ff-4e71-4822-917c-ee46b9c7be54 could not be found. Oct 29 02:51:24.624629 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0d10f7e9-389a-4d4e-bb5a-d445061761db tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Request method failure captured: Oct 29 02:51:24.624629 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 HTTP/1.1 Oct 29 02:51:24.624629 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:51:24.624629 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:51:24.624629 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:51:24.624629 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:51:24.624629 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:51:24.624629 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:51:24.624629 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:51:24.624629 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:24.624629 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJRDFkMNWcTVAMbwqi7XOjTSBR6gQU7UJXfvsC69HTO3rlrffYppHu0isekbDpK_etiV3ircD6fBZSUKQu4f6s5VYOVABfQbG3U-2xcJXMwynE50nzib9CPZ-b6aEfxrmod28_F6mjoE-NnJZK8AOq7iy-5YSC6Iqfam8l4and4bCNc Oct 29 02:51:24.624629 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:51:24.624629 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:51:24.624629 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:51:24.624629 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:51:24.624629 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:51:24.624629 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:51:24.624629 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 859a70e4fa3141bb8b667b1be8e9594b Oct 29 02:51:24.624629 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-479936889 Oct 29 02:51:24.624629 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:51:24.624629 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:51:24.626235 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/859a70e4fa3141bb8b667b1be8e9594b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/859a70e4fa3141bb8b667b1be8e9594b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_859a70e4fa3141bb8b667b1be8e9594b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/859a70e4fa3141bb8b667b1be8e9594b"}]}] Oct 29 02:51:24.626235 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-479936889 Oct 29 02:51:24.626235 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 859a70e4fa3141bb8b667b1be8e9594b Oct 29 02:51:24.626235 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-479936889 Oct 29 02:51:24.626235 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-AttachSCSIVolumeTestJSON-479936889-project Oct 29 02:51:24.626235 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:51:24.626235 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:51:24.626235 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: e823b4fb116c48ea92c2d3da58e10f5a Oct 29 02:51:24.626235 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-479936889-project Oct 29 02:51:24.626235 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:51:24.626235 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance e14d80ff-4e71-4822-917c-ee46b9c7be54 could not be found. Oct 29 02:51:24.626235 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'e14d80ff-4e71-4822-917c-ee46b9c7be54'} Oct 29 02:51:24.627042 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:24.627042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:24.627042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:51:24.627042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:51:24.627042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:51:24.627042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:51:24.627042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:51:24.627042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:51:24.627042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:51:24.627042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:51:24.627042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e14d80ff-4e71-4822-917c-ee46b9c7be54 could not be found. Oct 29 02:51:24.627042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:24.627042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:24.627042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:24.627042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:24.627042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:24.627042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:24.627042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:24.627042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:24.627042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:24.628252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:24.628252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:51:24.628252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:51:24.628252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:51:24.628252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:51:24.628252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:51:24.628252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:51:24.628252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e14d80ff-4e71-4822-917c-ee46b9c7be54 could not be found. Oct 29 02:51:24.628252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:24.628252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:24.628252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:24.628252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:24.628252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:24.628252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:24.628252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:24.628252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:24.628252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e14d80ff-4e71-4822-917c-ee46b9c7be54 could not be found. Oct 29 02:51:24.628252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:51:24.633919 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0d10f7e9-389a-4d4e-bb5a-d445061761db tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] Returning 404 to user: Instance e14d80ff-4e71-4822-917c-ee46b9c7be54 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:24.636270 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0d10f7e9-389a-4d4e-bb5a-d445061761db tempest-AttachSCSIVolumeTestJSON-479936889 tempest-AttachSCSIVolumeTestJSON-479936889-project] 10.222.0.46 "GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54" status: 404 len: 111 microversion: 2.1 time: 0.155500 Oct 29 02:51:24.646362 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 684/1398] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:24 2022] GET /compute/v2.1/servers/e14d80ff-4e71-4822-917c-ee46b9c7be54 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:51:24.659265 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9c412475-e47b-46ca-af42-129fdaffa930 tempest-FloatingIPsTestJSON-184214188 tempest-FloatingIPsTestJSON-184214188-project] Calling method '.version_select at 0x7ff053860ee0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:25.127695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fab297ef-d89e-46ca-9d4c-66a614dc05af tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:25.151820 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fab297ef-d89e-46ca-9d4c-66a614dc05af tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5" status: 200 len: 1320 microversion: 2.1 time: 0.690079 Oct 29 02:51:25.159073 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 715/1399] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:24 2022] GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5 => generated 1320 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:26.194106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f5ba95dd-da8a-4c4e-b6f8-d4e5abc8cdf6 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:26.195083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f5ba95dd-da8a-4c4e-b6f8-d4e5abc8cdf6 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8b24cadb-50b5-47ab-8456-cabed237b2d5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:26.209284 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5ba95dd-da8a-4c4e-b6f8-d4e5abc8cdf6 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:26.209960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5ba95dd-da8a-4c4e-b6f8-d4e5abc8cdf6 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:26.210421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5ba95dd-da8a-4c4e-b6f8-d4e5abc8cdf6 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:26.211185 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5ba95dd-da8a-4c4e-b6f8-d4e5abc8cdf6 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:26.211654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5ba95dd-da8a-4c4e-b6f8-d4e5abc8cdf6 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:26.212085 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5ba95dd-da8a-4c4e-b6f8-d4e5abc8cdf6 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:26.314322 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9c412475-e47b-46ca-af42-129fdaffa930 tempest-FloatingIPsTestJSON-184214188 tempest-FloatingIPsTestJSON-184214188-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 1.664730 Oct 29 02:51:26.315510 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 685/1400] 10.222.0.46 () {58 vars in 1149 bytes} [Sat Oct 29 02:51:24 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:26.329290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d1a534ba-f60a-4191-bf66-e90fddad5693 tempest-FloatingIPsTestJSON-184214188 tempest-FloatingIPsTestJSON-184214188-project] Calling method '.version_select at 0x7ff0538a69d0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:27.231657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f5ba95dd-da8a-4c4e-b6f8-d4e5abc8cdf6 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:27.272658 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f5ba95dd-da8a-4c4e-b6f8-d4e5abc8cdf6 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5" status: 200 len: 1320 microversion: 2.1 time: 1.083182 Oct 29 02:51:27.276185 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 716/1401] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:26 2022] GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5 => generated 1320 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:27.811227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2ad4d998-e014-4691-b791-1c31e7a71331 tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:27.828800 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2ad4d998-e014-4691-b791-1c31e7a71331 tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.383491 Oct 29 02:51:27.830126 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 717/1402] 10.222.0.46 () {58 vars in 1137 bytes} [Sat Oct 29 02:51:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:51:27.847381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0633dddc-2352-49ad-b67b-442ffeaccf4c tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:27.924833 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0633dddc-2352-49ad-b67b-442ffeaccf4c tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] 10.222.0.46 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.081296 Oct 29 02:51:27.926810 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 718/1403] 10.222.0.46 () {58 vars in 1125 bytes} [Sat Oct 29 02:51:27 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:27.948676 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-de44a865-bba6-47ce-8309-50b1f9e2bbc9 tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:27.977118 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-de44a865-bba6-47ce-8309-50b1f9e2bbc9 tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.039813 Oct 29 02:51:27.981705 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 719/1404] 10.222.0.46 () {58 vars in 1137 bytes} [Sat Oct 29 02:51:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:51:28.000126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-77ac4b34-1994-4aec-acf0-df62de8a69de tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:28.016718 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-77ac4b34-1994-4aec-acf0-df62de8a69de tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022164 Oct 29 02:51:28.032932 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 720/1405] 10.222.0.46 () {58 vars in 1137 bytes} [Sat Oct 29 02:51:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:51:28.050401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-178bbcc6-5577-43df-bddf-31045f9f28bf tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:28.112938 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-178bbcc6-5577-43df-bddf-31045f9f28bf tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.077789 Oct 29 02:51:28.115080 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 721/1406] 10.222.0.46 () {58 vars in 1165 bytes} [Sat Oct 29 02:51:28 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:28.134169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-24623fd7-419e-41ae-94fa-3380a21ca4f1 tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:28.144577 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-24623fd7-419e-41ae-94fa-3380a21ca4f1 tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014300 Oct 29 02:51:28.153002 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 722/1407] 10.222.0.46 () {58 vars in 1137 bytes} [Sat Oct 29 02:51:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:28.160191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e6794135-1800-44bd-9b86-71c9b1c44b64 tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:28.204108 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e6794135-1800-44bd-9b86-71c9b1c44b64 tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.048719 Oct 29 02:51:28.222703 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 723/1408] 10.222.0.46 () {58 vars in 1169 bytes} [Sat Oct 29 02:51:28 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:28.230306 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b905a190-4eb0-4d81-b057-f9786088219a tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:28.261960 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b905a190-4eb0-4d81-b057-f9786088219a tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.037089 Oct 29 02:51:28.272895 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 724/1409] 10.222.0.46 () {58 vars in 1161 bytes} [Sat Oct 29 02:51:28 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:28.297353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-117b0ffa-5700-411e-8d53-2e5e9b3f85e0 tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:28.319706 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-117b0ffa-5700-411e-8d53-2e5e9b3f85e0 tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.041474 Oct 29 02:51:28.320690 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 725/1410] 10.222.0.46 () {58 vars in 1137 bytes} [Sat Oct 29 02:51:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:28.336500 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0489d6a7-6674-4655-b40a-8cc0f5af5696 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:28.337228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0489d6a7-6674-4655-b40a-8cc0f5af5696 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8b24cadb-50b5-47ab-8456-cabed237b2d5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:28.354095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0489d6a7-6674-4655-b40a-8cc0f5af5696 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:28.354614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0489d6a7-6674-4655-b40a-8cc0f5af5696 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:28.355196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0489d6a7-6674-4655-b40a-8cc0f5af5696 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:28.356004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0489d6a7-6674-4655-b40a-8cc0f5af5696 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:28.358074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0489d6a7-6674-4655-b40a-8cc0f5af5696 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:28.358530 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0489d6a7-6674-4655-b40a-8cc0f5af5696 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:28.943108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0489d6a7-6674-4655-b40a-8cc0f5af5696 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:28.954002 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0489d6a7-6674-4655-b40a-8cc0f5af5696 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5" status: 200 len: 1320 microversion: 2.1 time: 0.632154 Oct 29 02:51:28.974623 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 726/1411] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:28 2022] GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5 => generated 1320 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:28.985260 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0af1cbd5-eb36-4937-b5e1-ff7f24f699f4 tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:29.069388 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0af1cbd5-eb36-4937-b5e1-ff7f24f699f4 tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.092996 Oct 29 02:51:29.070631 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 727/1412] 10.222.0.46 () {58 vars in 1167 bytes} [Sat Oct 29 02:51:28 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:29.076751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0d28bc5f-e1ed-4e6d-8ddb-3ecdcb66773b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2142677559", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "bc545f16-a7b3-4024-a8d4-95a9643831d5"}], "block_device_mapping_v2": [{"uuid": "52219057-5550-40e0-a6ec-66561331ded2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:29.218358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-0d28bc5f-e1ed-4e6d-8ddb-3ecdcb66773b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] validate_networks() for [('bc545f16-a7b3-4024-a8d4-95a9643831d5', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:51:29.223284 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d1a534ba-f60a-4191-bf66-e90fddad5693 tempest-FloatingIPsTestJSON-184214188 tempest-FloatingIPsTestJSON-184214188-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/c2f090ee-63a1-4923-831c-6a1c6e0decfe" status: 202 len: 0 microversion: 2.1 time: 2.897227 Oct 29 02:51:29.228779 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 686/1413] 10.222.0.46 () {58 vars in 1263 bytes} [Sat Oct 29 02:51:26 2022] DELETE /compute/v2.1/os-floating-ips/c2f090ee-63a1-4923-831c-6a1c6e0decfe => generated 0 bytes in 2904 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:51:29.235410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ef37c0a1-8cc5-4741-a303-7b13f2273a00 tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:29.254394 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ef37c0a1-8cc5-4741-a303-7b13f2273a00 tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024439 Oct 29 02:51:29.255014 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 687/1414] 10.222.0.46 () {58 vars in 1137 bytes} [Sat Oct 29 02:51:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:29.268179 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bf1fbb76-e76c-4f38-b6dd-f0323c325579 tempest-FloatingIPsTestJSON-184214188 tempest-FloatingIPsTestJSON-184214188-project] Action: 'create', calling method: .version_select at 0x7ff053861790>, body: {"pool": null} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:31.913617 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-0d28bc5f-e1ed-4e6d-8ddb-3ecdcb66773b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:51:31.915395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-0d28bc5f-e1ed-4e6d-8ddb-3ecdcb66773b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:51:31.916503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-0d28bc5f-e1ed-4e6d-8ddb-3ecdcb66773b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:51:31.917802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-0d28bc5f-e1ed-4e6d-8ddb-3ecdcb66773b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:51:31.918821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-0d28bc5f-e1ed-4e6d-8ddb-3ecdcb66773b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:51:31.951303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d28bc5f-e1ed-4e6d-8ddb-3ecdcb66773b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:31.956308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d28bc5f-e1ed-4e6d-8ddb-3ecdcb66773b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:31.957480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d28bc5f-e1ed-4e6d-8ddb-3ecdcb66773b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:31.965137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d28bc5f-e1ed-4e6d-8ddb-3ecdcb66773b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:31.966155 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d28bc5f-e1ed-4e6d-8ddb-3ecdcb66773b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:31.967095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d28bc5f-e1ed-4e6d-8ddb-3ecdcb66773b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:32.040410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-0d28bc5f-e1ed-4e6d-8ddb-3ecdcb66773b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Getting quotas for project f86634862bd64e0f9f00972e4ce0982b. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:51:32.051598 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-0d28bc5f-e1ed-4e6d-8ddb-3ecdcb66773b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Getting quotas for user 067d53567ea944b1b69ee7f461aa0c16 and project f86634862bd64e0f9f00972e4ce0982b. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:51:32.246165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0d28bc5f-e1ed-4e6d-8ddb-3ecdcb66773b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:51:32.254079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0d28bc5f-e1ed-4e6d-8ddb-3ecdcb66773b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='52219057-5550-40e0-a6ec-66561331ded2',volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:51:32.764156 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0d28bc5f-e1ed-4e6d-8ddb-3ecdcb66773b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.682200 Oct 29 02:51:32.788107 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 728/1415] 10.222.0.46 () {62 vars in 1188 bytes} [Sat Oct 29 02:51:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3716 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 02:51:32.803629 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bf9e1082-73e9-4c68-965a-24650114757c tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:32.840091 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bf9e1082-73e9-4c68-965a-24650114757c tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] 10.222.0.46 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.050354 Oct 29 02:51:32.841282 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 729/1416] 10.222.0.46 () {58 vars in 1144 bytes} [Sat Oct 29 02:51:32 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:32.848437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1bbc772a-e434-4891-bdb6-a51d2a5999ff tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:32.849265 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1bbc772a-e434-4891-bdb6-a51d2a5999ff tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8b24cadb-50b5-47ab-8456-cabed237b2d5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:32.870185 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1bbc772a-e434-4891-bdb6-a51d2a5999ff tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:32.872105 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1bbc772a-e434-4891-bdb6-a51d2a5999ff tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:32.872947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1bbc772a-e434-4891-bdb6-a51d2a5999ff tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:32.874364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1bbc772a-e434-4891-bdb6-a51d2a5999ff tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:32.875264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1bbc772a-e434-4891-bdb6-a51d2a5999ff tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:32.877688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1bbc772a-e434-4891-bdb6-a51d2a5999ff tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:33.600759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1bbc772a-e434-4891-bdb6-a51d2a5999ff tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:33.617789 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1bbc772a-e434-4891-bdb6-a51d2a5999ff tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5" status: 200 len: 1320 microversion: 2.1 time: 0.775217 Oct 29 02:51:33.618672 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 730/1417] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:32 2022] GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5 => generated 1320 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:33.972805 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-91953730-84c1-4745-a837-6ebe378ac7f0 req-4d762bb7-e10d-4e17-8254-63416a0ed50d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b24cadb-50b5-47ab-8456-cabed237b2d5", "name": "network-vif-plugged", "status": "completed", "tag": "e3007c86-7dce-4a92-aa92-99e53d24fe9f"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:34.005737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-91953730-84c1-4745-a837-6ebe378ac7f0 req-4d762bb7-e10d-4e17-8254-63416a0ed50d service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:34.015729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-91953730-84c1-4745-a837-6ebe378ac7f0 req-4d762bb7-e10d-4e17-8254-63416a0ed50d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:34.017522 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-91953730-84c1-4745-a837-6ebe378ac7f0 req-4d762bb7-e10d-4e17-8254-63416a0ed50d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:34.049285 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-91953730-84c1-4745-a837-6ebe378ac7f0 req-4d762bb7-e10d-4e17-8254-63416a0ed50d service nova] Creating event network-vif-plugged:e3007c86-7dce-4a92-aa92-99e53d24fe9f for instance 8b24cadb-50b5-47ab-8456-cabed237b2d5 on n-h2-862967-2 Oct 29 02:51:34.090831 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-91953730-84c1-4745-a837-6ebe378ac7f0 req-4d762bb7-e10d-4e17-8254-63416a0ed50d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.469849 Oct 29 02:51:34.091904 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 731/1418] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:34.109237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ad01c9a3-c9f3-4a3f-9ab6-41e7f624523b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:34.114058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ad01c9a3-c9f3-4a3f-9ab6-41e7f624523b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:34.138977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad01c9a3-c9f3-4a3f-9ab6-41e7f624523b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:34.140021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad01c9a3-c9f3-4a3f-9ab6-41e7f624523b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:34.142746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad01c9a3-c9f3-4a3f-9ab6-41e7f624523b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:34.146749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad01c9a3-c9f3-4a3f-9ab6-41e7f624523b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:34.149265 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad01c9a3-c9f3-4a3f-9ab6-41e7f624523b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:34.149922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad01c9a3-c9f3-4a3f-9ab6-41e7f624523b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:34.229686 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bf1fbb76-e76c-4f38-b6dd-f0323c325579 tempest-FloatingIPsTestJSON-184214188 tempest-FloatingIPsTestJSON-184214188-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.965714 Oct 29 02:51:34.240995 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 688/1419] 10.222.0.46 () {60 vars in 1170 bytes} [Sat Oct 29 02:51:29 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4969 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:34.255533 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-32b7644d-3fb8-4ee2-9089-93e1a93f8da8 tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:34.282593 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-32b7644d-3fb8-4ee2-9089-93e1a93f8da8 tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.038291 Oct 29 02:51:34.286620 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 689/1420] 10.222.0.46 () {58 vars in 1137 bytes} [Sat Oct 29 02:51:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:34.303398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-99ab5169-122d-427b-890b-d73c8058e72d tempest-FloatingIPsTestJSON-184214188 tempest-FloatingIPsTestJSON-184214188-project] Calling method '.version_select at 0x7ff053861670>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:34.470881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ad01c9a3-c9f3-4a3f-9ab6-41e7f624523b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:34.556989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ad01c9a3-c9f3-4a3f-9ab6-41e7f624523b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:34.575718 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=13 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:34.581018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ad01c9a3-c9f3-4a3f-9ab6-41e7f624523b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:34.586835 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ad01c9a3-c9f3-4a3f-9ab6-41e7f624523b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1233 microversion: 2.25 time: 0.491647 Oct 29 02:51:34.590379 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 732/1421] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:34 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1233 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:34.600766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fe6e7903-8858-495a-87ba-b30ebaca696b tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:34.662922 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fe6e7903-8858-495a-87ba-b30ebaca696b tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] 10.222.0.46 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.070151 Oct 29 02:51:34.666473 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 733/1422] 10.222.0.46 () {58 vars in 1148 bytes} [Sat Oct 29 02:51:34 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:34.704425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5cccbf23-270c-430f-b56b-28214dee0ec5 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:34.706728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5cccbf23-270c-430f-b56b-28214dee0ec5 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8b24cadb-50b5-47ab-8456-cabed237b2d5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:34.723444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5cccbf23-270c-430f-b56b-28214dee0ec5 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:34.724718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5cccbf23-270c-430f-b56b-28214dee0ec5 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:34.726771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5cccbf23-270c-430f-b56b-28214dee0ec5 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:34.728701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5cccbf23-270c-430f-b56b-28214dee0ec5 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:34.729755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5cccbf23-270c-430f-b56b-28214dee0ec5 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:34.732297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5cccbf23-270c-430f-b56b-28214dee0ec5 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:35.681471 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5cccbf23-270c-430f-b56b-28214dee0ec5 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:35.694561 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5cccbf23-270c-430f-b56b-28214dee0ec5 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5" status: 200 len: 1320 microversion: 2.1 time: 1.024575 Oct 29 02:51:35.695410 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 734/1423] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:34 2022] GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5 => generated 1320 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:35.757544 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-40aefd35-d453-408b-94a0-2d9d68aa1b33 tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:35.779494 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-40aefd35-d453-408b-94a0-2d9d68aa1b33 tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] 10.222.0.46 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.046380 Oct 29 02:51:35.780973 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 735/1424] 10.222.0.46 () {58 vars in 1140 bytes} [Sat Oct 29 02:51:35 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:35.786672 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-44141c3b-028b-4b1a-a1f1-0c7a2b18d8c1 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:35.797910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-44141c3b-028b-4b1a-a1f1-0c7a2b18d8c1 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:35.819802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-44141c3b-028b-4b1a-a1f1-0c7a2b18d8c1 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:35.820297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-44141c3b-028b-4b1a-a1f1-0c7a2b18d8c1 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:35.820769 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-44141c3b-028b-4b1a-a1f1-0c7a2b18d8c1 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:35.821512 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-44141c3b-028b-4b1a-a1f1-0c7a2b18d8c1 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:35.822309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-44141c3b-028b-4b1a-a1f1-0c7a2b18d8c1 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:35.823099 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-44141c3b-028b-4b1a-a1f1-0c7a2b18d8c1 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:36.070479 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-44141c3b-028b-4b1a-a1f1-0c7a2b18d8c1 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:36.100605 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-44141c3b-028b-4b1a-a1f1-0c7a2b18d8c1 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:36.102247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-44141c3b-028b-4b1a-a1f1-0c7a2b18d8c1 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:36.103443 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-44141c3b-028b-4b1a-a1f1-0c7a2b18d8c1 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1251 microversion: 2.25 time: 0.320975 Oct 29 02:51:36.104199 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 736/1425] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:35 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1251 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:36.115524 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-23d6d5e8-9729-4847-a0ec-c24141f50e83 tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:36.126351 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-23d6d5e8-9729-4847-a0ec-c24141f50e83 tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016426 Oct 29 02:51:36.127492 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 737/1426] 10.222.0.46 () {58 vars in 1137 bytes} [Sat Oct 29 02:51:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:36.146109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-aece6326-8cba-4ae5-a49b-fd0437796173 tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:36.182279 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-aece6326-8cba-4ae5-a49b-fd0437796173 tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] 10.222.0.46 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.042787 Oct 29 02:51:36.184051 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 738/1427] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:51:36 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:36.200375 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eabfaa2d-6f9c-41fc-b84a-905b37762e41 tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:36.233583 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eabfaa2d-6f9c-41fc-b84a-905b37762e41 tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038940 Oct 29 02:51:36.235255 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 739/1428] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:51:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:36.254993 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5dc88b63-770e-4acf-a86b-c29849b8d7d8 tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:36.282119 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5dc88b63-770e-4acf-a86b-c29849b8d7d8 tempest-FlavorsV2TestJSON-104022194 tempest-FlavorsV2TestJSON-104022194-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032534 Oct 29 02:51:36.283382 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 740/1429] 10.222.0.46 () {58 vars in 1137 bytes} [Sat Oct 29 02:51:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:51:36.561886 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-99ab5169-122d-427b-890b-d73c8058e72d tempest-FloatingIPsTestJSON-184214188 tempest-FloatingIPsTestJSON-184214188-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/21650bc1-2185-4d35-b24d-f6fdb07d6be8" status: 202 len: 0 microversion: 2.1 time: 2.273439 Oct 29 02:51:36.565774 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 690/1430] 10.222.0.46 () {58 vars in 1263 bytes} [Sat Oct 29 02:51:34 2022] DELETE /compute/v2.1/os-floating-ips/21650bc1-2185-4d35-b24d-f6fdb07d6be8 => generated 0 bytes in 2278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:51:36.574109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-18b2722e-b70e-4458-8c96-658c4dde51c5 tempest-FloatingIPsTestJSON-184214188 tempest-FloatingIPsTestJSON-184214188-project] Calling method '.version_select at 0x7ff058082c10>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:36.738449 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-52643518-392e-4482-9ecd-44e586da6f10 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:36.739106 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-52643518-392e-4482-9ecd-44e586da6f10 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8b24cadb-50b5-47ab-8456-cabed237b2d5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:36.759060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52643518-392e-4482-9ecd-44e586da6f10 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:36.759836 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52643518-392e-4482-9ecd-44e586da6f10 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:36.763734 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52643518-392e-4482-9ecd-44e586da6f10 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:36.766839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52643518-392e-4482-9ecd-44e586da6f10 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:36.767573 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52643518-392e-4482-9ecd-44e586da6f10 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:36.768194 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52643518-392e-4482-9ecd-44e586da6f10 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:36.836045 n-d-862967-2 devstack@n-api.service[127124]: DEBUG neutronclient.v2_0.client [None req-18b2722e-b70e-4458-8c96-658c4dde51c5 tempest-FloatingIPsTestJSON-184214188 tempest-FloatingIPsTestJSON-184214188-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 21650bc1-2185-4d35-b24d-f6fdb07d6be8 could not be found", "detail": ""}} {{(pid=127124) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:51:36.838241 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-18b2722e-b70e-4458-8c96-658c4dde51c5 tempest-FloatingIPsTestJSON-184214188 tempest-FloatingIPsTestJSON-184214188-project] HTTP exception thrown: Floating IP not found for ID 21650bc1-2185-4d35-b24d-f6fdb07d6be8 Oct 29 02:51:36.844331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-18b2722e-b70e-4458-8c96-658c4dde51c5 tempest-FloatingIPsTestJSON-184214188 tempest-FloatingIPsTestJSON-184214188-project] Request method failure captured: Oct 29 02:51:36.844331 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/os-floating-ips/21650bc1-2185-4d35-b24d-f6fdb07d6be8 HTTP/1.1 Oct 29 02:51:36.844331 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:51:36.844331 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:51:36.844331 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:51:36.844331 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:51:36.844331 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:51:36.844331 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:51:36.844331 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:51:36.844331 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:36.844331 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJUi5kKip5cQIv5lyQWmFZs64XhXIH_uTwucXNQFZzN3pLUBYYX833-C-AmlIZUNaPNBvI2j71LLt_WUBGabPkdMZXgsuxMdZUOPF8yOyvUiZDc6uEAjzYsdnxvM3mWhGw8JZaOiMhTf0xtcE3sRUSbBSqwlHOhsKWiUOOa6t1F9aPc Oct 29 02:51:36.844331 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:51:36.844331 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:51:36.844331 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:51:36.844331 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:51:36.844331 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:51:36.844331 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:51:36.844331 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: dbfa8eab8d2c4ce68268535bf035124e Oct 29 02:51:36.844331 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-FloatingIPsTestJSON-184214188 Oct 29 02:51:36.844331 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:51:36.844331 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:51:36.846174 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dbfa8eab8d2c4ce68268535bf035124e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dbfa8eab8d2c4ce68268535bf035124e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_dbfa8eab8d2c4ce68268535bf035124e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/dbfa8eab8d2c4ce68268535bf035124e"}]}] Oct 29 02:51:36.846174 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-FloatingIPsTestJSON-184214188 Oct 29 02:51:36.846174 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: dbfa8eab8d2c4ce68268535bf035124e Oct 29 02:51:36.846174 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-FloatingIPsTestJSON-184214188 Oct 29 02:51:36.846174 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-FloatingIPsTestJSON-184214188-project Oct 29 02:51:36.846174 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:51:36.846174 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:51:36.846174 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 86fe9125b5e44ae4935f8ebf6de35f79 Oct 29 02:51:36.846174 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-FloatingIPsTestJSON-184214188-project Oct 29 02:51:36.846174 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:51:36.846174 n-d-862967-2 devstack@n-api.service[127124]: exception: Floating IP not found for ID 21650bc1-2185-4d35-b24d-f6fdb07d6be8 Oct 29 02:51:36.846174 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '21650bc1-2185-4d35-b24d-f6fdb07d6be8'} Oct 29 02:51:36.846174 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:36.847096 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:36.847096 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 29 02:51:36.847096 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 29 02:51:36.847096 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:51:36.847096 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:51:36.847096 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 29 02:51:36.847096 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 29 02:51:36.847096 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:51:36.847096 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:51:36.847096 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:51:36.847096 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:51:36.847096 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:51:36.847096 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:51:36.847096 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:51:36.847096 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:51:36.847096 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:51:36.847096 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:51:36.847096 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:51:36.847096 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:51:36.848875 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:51:36.848875 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:51:36.848875 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:51:36.848875 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:51:36.848875 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:51:36.848875 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:51:36.848875 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 21650bc1-2185-4d35-b24d-f6fdb07d6be8 could not be found Oct 29 02:51:36.848875 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72afc781-80b3-4cb8-b0ee-cfeb58fdb58d'] Oct 29 02:51:36.848875 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:36.848875 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:36.848875 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:36.848875 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:36.848875 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 29 02:51:36.848875 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 29 02:51:36.848875 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 29 02:51:36.848875 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 29 02:51:36.848875 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 21650bc1-2185-4d35-b24d-f6fdb07d6be8. Oct 29 02:51:36.848875 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:36.848875 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:36.848875 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:36.850515 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:36.850515 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:36.850515 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:36.850515 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:36.850515 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:36.850515 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:51:36.850515 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:51:36.850515 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:36.850515 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:36.850515 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 29 02:51:36.850515 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 02:51:36.850515 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 21650bc1-2185-4d35-b24d-f6fdb07d6be8 Oct 29 02:51:36.850515 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:36.850515 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:36.850515 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:36.850515 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:36.850515 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:36.850515 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:36.850515 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:36.850515 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:36.852156 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 21650bc1-2185-4d35-b24d-f6fdb07d6be8 Oct 29 02:51:36.852156 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:36.852156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-18b2722e-b70e-4458-8c96-658c4dde51c5 tempest-FloatingIPsTestJSON-184214188 tempest-FloatingIPsTestJSON-184214188-project] Returning 404 to user: Floating IP not found for ID 21650bc1-2185-4d35-b24d-f6fdb07d6be8 {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:36.853508 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-18b2722e-b70e-4458-8c96-658c4dde51c5 tempest-FloatingIPsTestJSON-184214188 tempest-FloatingIPsTestJSON-184214188-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips/21650bc1-2185-4d35-b24d-f6fdb07d6be8" status: 404 len: 111 microversion: 2.1 time: 0.278953 Oct 29 02:51:36.857602 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 741/1431] 10.222.0.46 () {58 vars in 1260 bytes} [Sat Oct 29 02:51:36 2022] GET /compute/v2.1/os-floating-ips/21650bc1-2185-4d35-b24d-f6fdb07d6be8 => generated 111 bytes in 289 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:51:36.878391 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1f21bf9c-d03a-4bd5-82cd-7f60798c6409 tempest-FloatingIPsTestJSON-184214188 tempest-FloatingIPsTestJSON-184214188-project] Calling method '.version_select at 0x7ff058015b80>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:37.039253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG neutronclient.v2_0.client [None req-1f21bf9c-d03a-4bd5-82cd-7f60798c6409 tempest-FloatingIPsTestJSON-184214188 tempest-FloatingIPsTestJSON-184214188-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 21650bc1-2185-4d35-b24d-f6fdb07d6be8 could not be found", "detail": ""}} {{(pid=127124) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:51:37.040262 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-1f21bf9c-d03a-4bd5-82cd-7f60798c6409 tempest-FloatingIPsTestJSON-184214188 tempest-FloatingIPsTestJSON-184214188-project] HTTP exception thrown: Floating IP not found for ID 21650bc1-2185-4d35-b24d-f6fdb07d6be8 Oct 29 02:51:37.042792 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1f21bf9c-d03a-4bd5-82cd-7f60798c6409 tempest-FloatingIPsTestJSON-184214188 tempest-FloatingIPsTestJSON-184214188-project] Request method failure captured: Oct 29 02:51:37.042792 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/os-floating-ips/21650bc1-2185-4d35-b24d-f6fdb07d6be8 HTTP/1.1 Oct 29 02:51:37.042792 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:51:37.042792 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:51:37.042792 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:51:37.042792 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:51:37.042792 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:51:37.042792 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:51:37.042792 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:51:37.042792 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:37.042792 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJUi5kKip5cQIv5lyQWmFZs64XhXIH_uTwucXNQFZzN3pLUBYYX833-C-AmlIZUNaPNBvI2j71LLt_WUBGabPkdMZXgsuxMdZUOPF8yOyvUiZDc6uEAjzYsdnxvM3mWhGw8JZaOiMhTf0xtcE3sRUSbBSqwlHOhsKWiUOOa6t1F9aPc Oct 29 02:51:37.042792 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:51:37.042792 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:51:37.042792 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:51:37.042792 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:51:37.042792 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:51:37.042792 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:51:37.042792 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: dbfa8eab8d2c4ce68268535bf035124e Oct 29 02:51:37.042792 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-FloatingIPsTestJSON-184214188 Oct 29 02:51:37.042792 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:51:37.042792 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:51:37.044414 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dbfa8eab8d2c4ce68268535bf035124e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dbfa8eab8d2c4ce68268535bf035124e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_dbfa8eab8d2c4ce68268535bf035124e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/dbfa8eab8d2c4ce68268535bf035124e"}]}] Oct 29 02:51:37.044414 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-FloatingIPsTestJSON-184214188 Oct 29 02:51:37.044414 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: dbfa8eab8d2c4ce68268535bf035124e Oct 29 02:51:37.044414 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-FloatingIPsTestJSON-184214188 Oct 29 02:51:37.044414 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-FloatingIPsTestJSON-184214188-project Oct 29 02:51:37.044414 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:51:37.044414 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:51:37.044414 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 86fe9125b5e44ae4935f8ebf6de35f79 Oct 29 02:51:37.044414 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-FloatingIPsTestJSON-184214188-project Oct 29 02:51:37.044414 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:51:37.044414 n-d-862967-2 devstack@n-api.service[127124]: exception: Floating IP not found for ID 21650bc1-2185-4d35-b24d-f6fdb07d6be8 Oct 29 02:51:37.044414 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '21650bc1-2185-4d35-b24d-f6fdb07d6be8'} Oct 29 02:51:37.044414 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:37.045396 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:37.045396 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 29 02:51:37.045396 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 29 02:51:37.045396 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:51:37.045396 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:51:37.045396 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 29 02:51:37.045396 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 29 02:51:37.045396 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:51:37.045396 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:51:37.045396 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:51:37.045396 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:51:37.045396 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:51:37.045396 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:51:37.045396 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:51:37.045396 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:51:37.045396 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:51:37.045396 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:51:37.045396 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:51:37.045396 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:51:37.046790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:51:37.046790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:51:37.046790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:51:37.046790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:51:37.046790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:51:37.046790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:51:37.046790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 21650bc1-2185-4d35-b24d-f6fdb07d6be8 could not be found Oct 29 02:51:37.046790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e04ed96b-5f9b-4e58-957e-46b0c0e93e4f'] Oct 29 02:51:37.046790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:37.046790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:37.046790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:37.046790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:37.046790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 29 02:51:37.046790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 29 02:51:37.046790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 29 02:51:37.046790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 29 02:51:37.046790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 21650bc1-2185-4d35-b24d-f6fdb07d6be8. Oct 29 02:51:37.046790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:37.046790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:37.046790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:37.048245 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:37.048245 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:37.048245 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:37.048245 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:37.048245 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:37.048245 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:51:37.048245 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:51:37.048245 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:37.048245 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:37.048245 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 29 02:51:37.048245 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 02:51:37.048245 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 21650bc1-2185-4d35-b24d-f6fdb07d6be8 Oct 29 02:51:37.048245 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:37.048245 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:37.048245 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:37.048245 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:37.048245 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:37.048245 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:37.048245 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:37.048245 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:37.049727 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 21650bc1-2185-4d35-b24d-f6fdb07d6be8 Oct 29 02:51:37.049727 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:37.057331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1f21bf9c-d03a-4bd5-82cd-7f60798c6409 tempest-FloatingIPsTestJSON-184214188 tempest-FloatingIPsTestJSON-184214188-project] Returning 404 to user: Floating IP not found for ID 21650bc1-2185-4d35-b24d-f6fdb07d6be8 {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:37.058518 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1f21bf9c-d03a-4bd5-82cd-7f60798c6409 tempest-FloatingIPsTestJSON-184214188 tempest-FloatingIPsTestJSON-184214188-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/21650bc1-2185-4d35-b24d-f6fdb07d6be8" status: 404 len: 111 microversion: 2.1 time: 0.198675 Oct 29 02:51:37.059575 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 742/1432] 10.222.0.46 () {58 vars in 1263 bytes} [Sat Oct 29 02:51:36 2022] DELETE /compute/v2.1/os-floating-ips/21650bc1-2185-4d35-b24d-f6fdb07d6be8 => generated 111 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:51:37.129476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-88d8ee01-c8ad-4297-8cf9-e57ddeb76cfd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:37.130274 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-88d8ee01-c8ad-4297-8cf9-e57ddeb76cfd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:37.144701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88d8ee01-c8ad-4297-8cf9-e57ddeb76cfd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:37.147058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88d8ee01-c8ad-4297-8cf9-e57ddeb76cfd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:37.147758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88d8ee01-c8ad-4297-8cf9-e57ddeb76cfd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:37.150512 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88d8ee01-c8ad-4297-8cf9-e57ddeb76cfd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:37.151206 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88d8ee01-c8ad-4297-8cf9-e57ddeb76cfd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:37.152770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88d8ee01-c8ad-4297-8cf9-e57ddeb76cfd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:37.392620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-88d8ee01-c8ad-4297-8cf9-e57ddeb76cfd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:37.408628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-88d8ee01-c8ad-4297-8cf9-e57ddeb76cfd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:37.415205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-88d8ee01-c8ad-4297-8cf9-e57ddeb76cfd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:37.419179 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-88d8ee01-c8ad-4297-8cf9-e57ddeb76cfd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1251 microversion: 2.25 time: 0.292417 Oct 29 02:51:37.419888 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 743/1433] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:37 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1251 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:51:38.075581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-52643518-392e-4482-9ecd-44e586da6f10 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:38.091588 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-52643518-392e-4482-9ecd-44e586da6f10 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5" status: 200 len: 1469 microversion: 2.1 time: 1.358931 Oct 29 02:51:38.092539 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 691/1434] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:36 2022] GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5 => generated 1469 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:38.128105 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4e984ac7-2f86-4609-a9d7-774497ae0eb9 tempest-DeleteServersAdminTestJSON-312124499 tempest-DeleteServersAdminTestJSON-312124499-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:38.131332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4e984ac7-2f86-4609-a9d7-774497ae0eb9 tempest-DeleteServersAdminTestJSON-312124499 tempest-DeleteServersAdminTestJSON-312124499-project-admin] [instance: 8b24cadb-50b5-47ab-8456-cabed237b2d5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:38.149140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e984ac7-2f86-4609-a9d7-774497ae0eb9 tempest-DeleteServersAdminTestJSON-312124499 tempest-DeleteServersAdminTestJSON-312124499-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:38.149874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e984ac7-2f86-4609-a9d7-774497ae0eb9 tempest-DeleteServersAdminTestJSON-312124499 tempest-DeleteServersAdminTestJSON-312124499-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:38.150483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e984ac7-2f86-4609-a9d7-774497ae0eb9 tempest-DeleteServersAdminTestJSON-312124499 tempest-DeleteServersAdminTestJSON-312124499-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:38.152223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e984ac7-2f86-4609-a9d7-774497ae0eb9 tempest-DeleteServersAdminTestJSON-312124499 tempest-DeleteServersAdminTestJSON-312124499-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:38.152930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e984ac7-2f86-4609-a9d7-774497ae0eb9 tempest-DeleteServersAdminTestJSON-312124499 tempest-DeleteServersAdminTestJSON-312124499-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:38.155631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e984ac7-2f86-4609-a9d7-774497ae0eb9 tempest-DeleteServersAdminTestJSON-312124499 tempest-DeleteServersAdminTestJSON-312124499-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:38.359526 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4e984ac7-2f86-4609-a9d7-774497ae0eb9 tempest-DeleteServersAdminTestJSON-312124499 tempest-DeleteServersAdminTestJSON-312124499-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5/action" status: 202 len: 0 microversion: 2.1 time: 0.235269 Oct 29 02:51:38.360825 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 744/1435] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:51:38 2022] POST /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:51:38.372724 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-983c4232-28e0-45b1-ad92-4e968ad82e37 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:38.373747 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-983c4232-28e0-45b1-ad92-4e968ad82e37 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8b24cadb-50b5-47ab-8456-cabed237b2d5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:38.420252 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-983c4232-28e0-45b1-ad92-4e968ad82e37 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:38.420883 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-983c4232-28e0-45b1-ad92-4e968ad82e37 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:38.421572 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-983c4232-28e0-45b1-ad92-4e968ad82e37 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:38.422353 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-983c4232-28e0-45b1-ad92-4e968ad82e37 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:38.427415 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-983c4232-28e0-45b1-ad92-4e968ad82e37 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:38.429177 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-983c4232-28e0-45b1-ad92-4e968ad82e37 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:38.445421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8ff89629-9ff4-4899-9c10-f68b6ada36b6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:38.446310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8ff89629-9ff4-4899-9c10-f68b6ada36b6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:38.456141 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8ff89629-9ff4-4899-9c10-f68b6ada36b6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:38.459871 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8ff89629-9ff4-4899-9c10-f68b6ada36b6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:38.460715 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8ff89629-9ff4-4899-9c10-f68b6ada36b6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:38.462042 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8ff89629-9ff4-4899-9c10-f68b6ada36b6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:38.467148 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8ff89629-9ff4-4899-9c10-f68b6ada36b6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:38.468029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8ff89629-9ff4-4899-9c10-f68b6ada36b6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:38.576367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-983c4232-28e0-45b1-ad92-4e968ad82e37 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:38.583339 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-983c4232-28e0-45b1-ad92-4e968ad82e37 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:38.583916 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-983c4232-28e0-45b1-ad92-4e968ad82e37 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:38.584417 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-983c4232-28e0-45b1-ad92-4e968ad82e37 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lazy-loading 'fault' on Instance uuid 8b24cadb-50b5-47ab-8456-cabed237b2d5 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:51:38.611320 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8ff89629-9ff4-4899-9c10-f68b6ada36b6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:38.637726 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8ff89629-9ff4-4899-9c10-f68b6ada36b6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:38.642013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8ff89629-9ff4-4899-9c10-f68b6ada36b6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:38.645451 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8ff89629-9ff4-4899-9c10-f68b6ada36b6 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1251 microversion: 2.25 time: 0.203742 Oct 29 02:51:38.648066 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 745/1436] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:38 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1251 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:39.236864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-983c4232-28e0-45b1-ad92-4e968ad82e37 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:39.251083 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-983c4232-28e0-45b1-ad92-4e968ad82e37 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5" status: 200 len: 1452 microversion: 2.1 time: 0.885083 Oct 29 02:51:39.254479 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 692/1437] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:38 2022] GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5 => generated 1452 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:39.294479 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7e84b4f7-86d3-41ec-af5a-edf42d367c2f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:39.295286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7e84b4f7-86d3-41ec-af5a-edf42d367c2f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8b24cadb-50b5-47ab-8456-cabed237b2d5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:39.308824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e84b4f7-86d3-41ec-af5a-edf42d367c2f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:39.311736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e84b4f7-86d3-41ec-af5a-edf42d367c2f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:39.312273 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e84b4f7-86d3-41ec-af5a-edf42d367c2f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:39.313065 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e84b4f7-86d3-41ec-af5a-edf42d367c2f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:39.321801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e84b4f7-86d3-41ec-af5a-edf42d367c2f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:39.322633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e84b4f7-86d3-41ec-af5a-edf42d367c2f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:39.437795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7e84b4f7-86d3-41ec-af5a-edf42d367c2f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8b24cadb-50b5-47ab-8456-cabed237b2d5] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:51:39.692850 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7e84b4f7-86d3-41ec-af5a-edf42d367c2f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5" status: 204 len: 0 microversion: 2.1 time: 0.401936 Oct 29 02:51:39.697303 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-251b240a-0f37-4052-b002-32008e5f45ac tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:39.698259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-251b240a-0f37-4052-b002-32008e5f45ac tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:39.699879 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 746/1438] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:51:39 2022] DELETE /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 02:51:39.713469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-251b240a-0f37-4052-b002-32008e5f45ac tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:39.714358 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-251b240a-0f37-4052-b002-32008e5f45ac tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:39.714548 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-780a6cde-60ba-4626-a7d3-042f0db69f54 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:39.715365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-780a6cde-60ba-4626-a7d3-042f0db69f54 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8b24cadb-50b5-47ab-8456-cabed237b2d5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:39.716033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-251b240a-0f37-4052-b002-32008e5f45ac tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:39.718565 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-251b240a-0f37-4052-b002-32008e5f45ac tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:39.720551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-251b240a-0f37-4052-b002-32008e5f45ac tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:39.721206 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-251b240a-0f37-4052-b002-32008e5f45ac tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:39.741700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-780a6cde-60ba-4626-a7d3-042f0db69f54 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:39.742196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-780a6cde-60ba-4626-a7d3-042f0db69f54 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:39.742636 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-780a6cde-60ba-4626-a7d3-042f0db69f54 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:39.743357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-780a6cde-60ba-4626-a7d3-042f0db69f54 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:39.743808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-780a6cde-60ba-4626-a7d3-042f0db69f54 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:39.752736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-780a6cde-60ba-4626-a7d3-042f0db69f54 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:39.878059 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-780a6cde-60ba-4626-a7d3-042f0db69f54 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:39.878545 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-780a6cde-60ba-4626-a7d3-042f0db69f54 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:39.879194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-780a6cde-60ba-4626-a7d3-042f0db69f54 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:39.881287 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-780a6cde-60ba-4626-a7d3-042f0db69f54 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lazy-loading 'fault' on Instance uuid 8b24cadb-50b5-47ab-8456-cabed237b2d5 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:51:40.829223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-780a6cde-60ba-4626-a7d3-042f0db69f54 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:40.836708 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:40.860233 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-780a6cde-60ba-4626-a7d3-042f0db69f54 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5" status: 200 len: 1458 microversion: 2.1 time: 1.146846 Oct 29 02:51:40.862744 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 747/1439] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:39 2022] GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5 => generated 1458 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:41.462474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-251b240a-0f37-4052-b002-32008e5f45ac tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:41.483668 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-251b240a-0f37-4052-b002-32008e5f45ac tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:41.485240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-251b240a-0f37-4052-b002-32008e5f45ac tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:41.486423 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-251b240a-0f37-4052-b002-32008e5f45ac tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1293 microversion: 2.25 time: 1.793936 Oct 29 02:51:41.491931 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 693/1440] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:39 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1293 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:41.913267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-359f2d68-0c63-4b4a-9cc9-9deef198c96b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:41.916055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-359f2d68-0c63-4b4a-9cc9-9deef198c96b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8b24cadb-50b5-47ab-8456-cabed237b2d5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:41.945267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-359f2d68-0c63-4b4a-9cc9-9deef198c96b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:41.946080 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-359f2d68-0c63-4b4a-9cc9-9deef198c96b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:41.946954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-359f2d68-0c63-4b4a-9cc9-9deef198c96b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:41.948948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-359f2d68-0c63-4b4a-9cc9-9deef198c96b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:41.951128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-359f2d68-0c63-4b4a-9cc9-9deef198c96b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:41.951742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-359f2d68-0c63-4b4a-9cc9-9deef198c96b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:42.011889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:42.057099 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-359f2d68-0c63-4b4a-9cc9-9deef198c96b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:42.057972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-359f2d68-0c63-4b4a-9cc9-9deef198c96b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:42.058584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-359f2d68-0c63-4b4a-9cc9-9deef198c96b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:42.059281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-359f2d68-0c63-4b4a-9cc9-9deef198c96b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lazy-loading 'fault' on Instance uuid 8b24cadb-50b5-47ab-8456-cabed237b2d5 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:51:42.072494 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:42.789784 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-73256d6e-b136-4431-991b-19bd12d37b8f tempest-ImagesDeleteNegativeTestJSON-1794325168 tempest-ImagesDeleteNegativeTestJSON-1794325168-project] 10.222.0.46 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.349892 Oct 29 02:51:42.790633 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 694/1441] 10.222.0.46 () {58 vars in 1128 bytes} [Sat Oct 29 02:51:42 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 29 02:51:42.798933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-df94fd8b-d675-4826-b836-8d02c2766efc tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:42.800181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-df94fd8b-d675-4826-b836-8d02c2766efc tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:42.819743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df94fd8b-d675-4826-b836-8d02c2766efc tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:42.820842 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df94fd8b-d675-4826-b836-8d02c2766efc tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:42.820842 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df94fd8b-d675-4826-b836-8d02c2766efc tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:42.821461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df94fd8b-d675-4826-b836-8d02c2766efc tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:42.831148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df94fd8b-d675-4826-b836-8d02c2766efc tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:42.832989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df94fd8b-d675-4826-b836-8d02c2766efc tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:43.257450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-359f2d68-0c63-4b4a-9cc9-9deef198c96b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:43.266625 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-359f2d68-0c63-4b4a-9cc9-9deef198c96b tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5" status: 200 len: 1458 microversion: 2.1 time: 1.370116 Oct 29 02:51:43.267242 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 748/1442] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:41 2022] GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5 => generated 1458 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:43.284211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bf3fa080-62ef-4658-88ae-70d30de2a984 tempest-ImagesDeleteNegativeTestJSON-1794325168 tempest-ImagesDeleteNegativeTestJSON-1794325168-project] Calling method '.version_select at 0x7ff05809a700>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:43.332584 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-bf3fa080-62ef-4658-88ae-70d30de2a984 tempest-ImagesDeleteNegativeTestJSON-1794325168 tempest-ImagesDeleteNegativeTestJSON-1794325168-project] HTTP exception thrown: Image not found. Oct 29 02:51:43.334722 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bf3fa080-62ef-4658-88ae-70d30de2a984 tempest-ImagesDeleteNegativeTestJSON-1794325168 tempest-ImagesDeleteNegativeTestJSON-1794325168-project] Request method failure captured: Oct 29 02:51:43.334722 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 29 02:51:43.334722 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:51:43.334722 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:51:43.334722 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:51:43.334722 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:51:43.334722 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:51:43.334722 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:51:43.334722 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:51:43.334722 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:43.334722 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJU-PhthNvUHEN-WimsujwsgkSCiQUCJHZRqGjmfqQR8_jKz5S8V5m1rK5xO-D7uwb-VNfurgLMEFS4Xo2vIX6vOyIxQnK-UlDSzhE2-z3PN-GaPNk1x_-JCtHgBtlYz0QLBXXvP9RK9O8UlzuwojeMW5TcMfXW2P3ft1HOIaT62Jhs Oct 29 02:51:43.334722 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:51:43.334722 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:51:43.334722 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:51:43.334722 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:51:43.334722 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:51:43.334722 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:51:43.334722 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: f54132e8e8614d978f7f270f901a5abe Oct 29 02:51:43.334722 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1794325168 Oct 29 02:51:43.334722 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:51:43.334722 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:51:43.336369 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f54132e8e8614d978f7f270f901a5abe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f54132e8e8614d978f7f270f901a5abe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f54132e8e8614d978f7f270f901a5abe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f54132e8e8614d978f7f270f901a5abe"}]}] Oct 29 02:51:43.336369 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1794325168 Oct 29 02:51:43.336369 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: f54132e8e8614d978f7f270f901a5abe Oct 29 02:51:43.336369 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1794325168 Oct 29 02:51:43.336369 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ImagesDeleteNegativeTestJSON-1794325168-project Oct 29 02:51:43.336369 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:51:43.336369 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:51:43.336369 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 7fbbd0e33108487c99af43f0f0a3ad64 Oct 29 02:51:43.336369 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1794325168-project Oct 29 02:51:43.336369 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:51:43.336369 n-d-862967-2 devstack@n-api.service[127124]: exception: Image not found. Oct 29 02:51:43.336369 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '-1'} Oct 29 02:51:43.336369 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:43.336369 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:43.337510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 02:51:43.337510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 02:51:43.337510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:51:43.337510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:51:43.337510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:51:43.337510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:51:43.337510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 02:51:43.337510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 02:51:43.337510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 02:51:43.337510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 02:51:43.337510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:51:43.337510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:51:43.337510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:51:43.337510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:51:43.337510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 29 02:51:43.337510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.337510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:43.337510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.337510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:43.339099 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 02:51:43.339099 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 02:51:43.339099 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 02:51:43.339099 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 02:51:43.339099 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 02:51:43.339099 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 02:51:43.339099 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 29 02:51:43.339099 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.339099 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:43.339099 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.339099 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:43.339099 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:43.339099 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:43.339099 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:43.339099 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:43.339099 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:51:43.339099 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:51:43.339099 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:43.339099 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:43.339099 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 02:51:43.342857 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 02:51:43.342857 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:51:43.342857 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.342857 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:43.342857 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.342857 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:43.342857 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:43.342857 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:43.342857 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:43.342857 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:43.342857 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:51:43.342857 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.342857 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bf3fa080-62ef-4658-88ae-70d30de2a984 tempest-ImagesDeleteNegativeTestJSON-1794325168 tempest-ImagesDeleteNegativeTestJSON-1794325168-project] Returning 404 to user: Image not found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:43.342857 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bf3fa080-62ef-4658-88ae-70d30de2a984 tempest-ImagesDeleteNegativeTestJSON-1794325168 tempest-ImagesDeleteNegativeTestJSON-1794325168-project] 10.222.0.46 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.062412 Oct 29 02:51:43.342857 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 749/1443] 10.222.0.46 () {58 vars in 1134 bytes} [Sat Oct 29 02:51:43 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:51:43.352069 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ab0ec309-9f93-45d7-b928-51cca3d1b73a tempest-ImagesDeleteNegativeTestJSON-1794325168 tempest-ImagesDeleteNegativeTestJSON-1794325168-project] Calling method '.version_select at 0x7ff053ea0280>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:43.422896 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-ab0ec309-9f93-45d7-b928-51cca3d1b73a tempest-ImagesDeleteNegativeTestJSON-1794325168 tempest-ImagesDeleteNegativeTestJSON-1794325168-project] HTTP exception thrown: Image not found. Oct 29 02:51:43.424900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ab0ec309-9f93-45d7-b928-51cca3d1b73a tempest-ImagesDeleteNegativeTestJSON-1794325168 tempest-ImagesDeleteNegativeTestJSON-1794325168-project] Request method failure captured: Oct 29 02:51:43.424900 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/images/ca2ff81c-0b5a-4617-be84-61e9b5359d9j HTTP/1.1 Oct 29 02:51:43.424900 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:51:43.424900 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:51:43.424900 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:51:43.424900 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:51:43.424900 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:51:43.424900 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:51:43.424900 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:51:43.424900 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:43.424900 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJU-PhthNvUHEN-WimsujwsgkSCiQUCJHZRqGjmfqQR8_jKz5S8V5m1rK5xO-D7uwb-VNfurgLMEFS4Xo2vIX6vOyIxQnK-UlDSzhE2-z3PN-GaPNk1x_-JCtHgBtlYz0QLBXXvP9RK9O8UlzuwojeMW5TcMfXW2P3ft1HOIaT62Jhs Oct 29 02:51:43.424900 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:51:43.424900 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:51:43.424900 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:51:43.424900 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:51:43.424900 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:51:43.424900 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:51:43.424900 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: f54132e8e8614d978f7f270f901a5abe Oct 29 02:51:43.424900 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1794325168 Oct 29 02:51:43.424900 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:51:43.424900 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:51:43.426311 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f54132e8e8614d978f7f270f901a5abe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f54132e8e8614d978f7f270f901a5abe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f54132e8e8614d978f7f270f901a5abe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f54132e8e8614d978f7f270f901a5abe"}]}] Oct 29 02:51:43.426311 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1794325168 Oct 29 02:51:43.426311 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: f54132e8e8614d978f7f270f901a5abe Oct 29 02:51:43.426311 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1794325168 Oct 29 02:51:43.426311 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ImagesDeleteNegativeTestJSON-1794325168-project Oct 29 02:51:43.426311 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:51:43.426311 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:51:43.426311 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 7fbbd0e33108487c99af43f0f0a3ad64 Oct 29 02:51:43.426311 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1794325168-project Oct 29 02:51:43.426311 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:51:43.426311 n-d-862967-2 devstack@n-api.service[127124]: exception: Image not found. Oct 29 02:51:43.426311 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'ca2ff81c-0b5a-4617-be84-61e9b5359d9j'} Oct 29 02:51:43.426311 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:43.427269 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:43.427269 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 02:51:43.427269 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 02:51:43.427269 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:51:43.427269 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:51:43.427269 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:51:43.427269 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:51:43.427269 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 02:51:43.427269 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 02:51:43.427269 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 02:51:43.427269 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 02:51:43.427269 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:51:43.427269 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:51:43.427269 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:51:43.427269 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:51:43.427269 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ca2ff81c-0b5a-4617-be84-61e9b5359d9j to delete Oct 29 02:51:43.427269 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.427269 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:43.427269 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.428582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:43.428582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 02:51:43.428582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 02:51:43.428582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 02:51:43.428582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 02:51:43.428582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 02:51:43.428582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 02:51:43.428582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ca2ff81c-0b5a-4617-be84-61e9b5359d9j could not be found. Oct 29 02:51:43.428582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.428582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:43.428582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.428582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:43.428582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:43.428582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:43.428582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:43.428582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:43.428582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:51:43.428582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:51:43.428582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:43.428582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:43.429834 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 02:51:43.429834 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 02:51:43.429834 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:51:43.429834 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.429834 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:43.429834 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.429834 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:43.429834 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:43.429834 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:43.429834 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:43.429834 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:43.429834 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:51:43.429834 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.429834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ab0ec309-9f93-45d7-b928-51cca3d1b73a tempest-ImagesDeleteNegativeTestJSON-1794325168 tempest-ImagesDeleteNegativeTestJSON-1794325168-project] Returning 404 to user: Image not found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:43.429834 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ab0ec309-9f93-45d7-b928-51cca3d1b73a tempest-ImagesDeleteNegativeTestJSON-1794325168 tempest-ImagesDeleteNegativeTestJSON-1794325168-project] 10.222.0.46 "DELETE /compute/v2.1/images/ca2ff81c-0b5a-4617-be84-61e9b5359d9j" status: 404 len: 62 microversion: 2.1 time: 0.078612 Oct 29 02:51:43.430844 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 750/1444] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:43 2022] DELETE /compute/v2.1/images/ca2ff81c-0b5a-4617-be84-61e9b5359d9j => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 29 02:51:43.438822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2454d8b6-599c-4600-89b8-4c6ac0e81897 tempest-ImagesDeleteNegativeTestJSON-1794325168 tempest-ImagesDeleteNegativeTestJSON-1794325168-project] Calling method '.version_select at 0x7ff053c7ddc0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:43.462320 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-2454d8b6-599c-4600-89b8-4c6ac0e81897 tempest-ImagesDeleteNegativeTestJSON-1794325168 tempest-ImagesDeleteNegativeTestJSON-1794325168-project] HTTP exception thrown: Image not found. Oct 29 02:51:43.464583 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2454d8b6-599c-4600-89b8-4c6ac0e81897 tempest-ImagesDeleteNegativeTestJSON-1794325168 tempest-ImagesDeleteNegativeTestJSON-1794325168-project] Request method failure captured: Oct 29 02:51:43.464583 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/images/f98064e8-a6cd-4dbe-bba0-4165d438f7b51 HTTP/1.1 Oct 29 02:51:43.464583 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:51:43.464583 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:51:43.464583 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:51:43.464583 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:51:43.464583 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:51:43.464583 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:51:43.464583 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:51:43.464583 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:43.464583 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJU-PhthNvUHEN-WimsujwsgkSCiQUCJHZRqGjmfqQR8_jKz5S8V5m1rK5xO-D7uwb-VNfurgLMEFS4Xo2vIX6vOyIxQnK-UlDSzhE2-z3PN-GaPNk1x_-JCtHgBtlYz0QLBXXvP9RK9O8UlzuwojeMW5TcMfXW2P3ft1HOIaT62Jhs Oct 29 02:51:43.464583 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:51:43.464583 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:51:43.464583 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:51:43.464583 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:51:43.464583 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:51:43.464583 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:51:43.464583 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: f54132e8e8614d978f7f270f901a5abe Oct 29 02:51:43.464583 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1794325168 Oct 29 02:51:43.464583 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:51:43.464583 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:51:43.466094 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f54132e8e8614d978f7f270f901a5abe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f54132e8e8614d978f7f270f901a5abe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f54132e8e8614d978f7f270f901a5abe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f54132e8e8614d978f7f270f901a5abe"}]}] Oct 29 02:51:43.466094 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1794325168 Oct 29 02:51:43.466094 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: f54132e8e8614d978f7f270f901a5abe Oct 29 02:51:43.466094 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1794325168 Oct 29 02:51:43.466094 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ImagesDeleteNegativeTestJSON-1794325168-project Oct 29 02:51:43.466094 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:51:43.466094 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:51:43.466094 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 7fbbd0e33108487c99af43f0f0a3ad64 Oct 29 02:51:43.466094 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1794325168-project Oct 29 02:51:43.466094 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:51:43.466094 n-d-862967-2 devstack@n-api.service[127124]: exception: Image not found. Oct 29 02:51:43.466094 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'f98064e8-a6cd-4dbe-bba0-4165d438f7b51'} Oct 29 02:51:43.466094 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:43.466910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:43.466910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 02:51:43.466910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 02:51:43.466910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:51:43.466910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:51:43.466910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:51:43.466910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:51:43.466910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 02:51:43.466910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 02:51:43.466910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 02:51:43.466910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 02:51:43.466910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:51:43.466910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:51:43.466910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:51:43.466910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:51:43.466910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f98064e8-a6cd-4dbe-bba0-4165d438f7b51 to delete Oct 29 02:51:43.466910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.466910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:43.466910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.468143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:43.468143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 02:51:43.468143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 02:51:43.468143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 02:51:43.468143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 02:51:43.468143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 02:51:43.468143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 02:51:43.468143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f98064e8-a6cd-4dbe-bba0-4165d438f7b51 could not be found. Oct 29 02:51:43.468143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.468143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:43.468143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.468143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:43.468143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:43.468143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:43.468143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:43.468143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:43.468143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:51:43.468143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:51:43.468143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:43.468143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:43.469410 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 02:51:43.469410 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 02:51:43.469410 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:51:43.469410 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.469410 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:43.469410 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.469410 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:43.469410 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:43.469410 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:43.469410 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:43.469410 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:43.469410 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:51:43.469410 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.476799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2454d8b6-599c-4600-89b8-4c6ac0e81897 tempest-ImagesDeleteNegativeTestJSON-1794325168 tempest-ImagesDeleteNegativeTestJSON-1794325168-project] Returning 404 to user: Image not found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:43.506099 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2454d8b6-599c-4600-89b8-4c6ac0e81897 tempest-ImagesDeleteNegativeTestJSON-1794325168 tempest-ImagesDeleteNegativeTestJSON-1794325168-project] 10.222.0.46 "DELETE /compute/v2.1/images/f98064e8-a6cd-4dbe-bba0-4165d438f7b51" status: 404 len: 62 microversion: 2.1 time: 0.069994 Oct 29 02:51:43.507759 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 751/1445] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:51:43 2022] DELETE /compute/v2.1/images/f98064e8-a6cd-4dbe-bba0-4165d438f7b51 => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 29 02:51:43.529635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-103fea26-6704-4936-b2a9-34f85bad054e tempest-ImagesDeleteNegativeTestJSON-1794325168 tempest-ImagesDeleteNegativeTestJSON-1794325168-project] Calling method '.version_select at 0x7ff05809a940>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:43.582558 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-103fea26-6704-4936-b2a9-34f85bad054e tempest-ImagesDeleteNegativeTestJSON-1794325168 tempest-ImagesDeleteNegativeTestJSON-1794325168-project] HTTP exception thrown: Image not found. Oct 29 02:51:43.587504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-103fea26-6704-4936-b2a9-34f85bad054e tempest-ImagesDeleteNegativeTestJSON-1794325168 tempest-ImagesDeleteNegativeTestJSON-1794325168-project] Request method failure captured: Oct 29 02:51:43.587504 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/images/tempest-invalid-658020115 HTTP/1.1 Oct 29 02:51:43.587504 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:51:43.587504 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:51:43.587504 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:51:43.587504 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:51:43.587504 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:51:43.587504 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:51:43.587504 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:51:43.587504 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:43.587504 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJU-PhthNvUHEN-WimsujwsgkSCiQUCJHZRqGjmfqQR8_jKz5S8V5m1rK5xO-D7uwb-VNfurgLMEFS4Xo2vIX6vOyIxQnK-UlDSzhE2-z3PN-GaPNk1x_-JCtHgBtlYz0QLBXXvP9RK9O8UlzuwojeMW5TcMfXW2P3ft1HOIaT62Jhs Oct 29 02:51:43.587504 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:51:43.587504 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:51:43.587504 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:51:43.587504 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:51:43.587504 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:51:43.587504 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:51:43.587504 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: f54132e8e8614d978f7f270f901a5abe Oct 29 02:51:43.587504 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1794325168 Oct 29 02:51:43.587504 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:51:43.587504 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:51:43.590221 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f54132e8e8614d978f7f270f901a5abe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f54132e8e8614d978f7f270f901a5abe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f54132e8e8614d978f7f270f901a5abe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f54132e8e8614d978f7f270f901a5abe"}]}] Oct 29 02:51:43.590221 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1794325168 Oct 29 02:51:43.590221 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: f54132e8e8614d978f7f270f901a5abe Oct 29 02:51:43.590221 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1794325168 Oct 29 02:51:43.590221 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ImagesDeleteNegativeTestJSON-1794325168-project Oct 29 02:51:43.590221 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:51:43.590221 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:51:43.590221 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 7fbbd0e33108487c99af43f0f0a3ad64 Oct 29 02:51:43.590221 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1794325168-project Oct 29 02:51:43.590221 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:51:43.590221 n-d-862967-2 devstack@n-api.service[127124]: exception: Image not found. Oct 29 02:51:43.590221 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'tempest-invalid-658020115'} Oct 29 02:51:43.590221 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:43.591413 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:43.591413 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 02:51:43.591413 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 02:51:43.591413 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:51:43.591413 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:51:43.591413 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:51:43.591413 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:51:43.591413 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 02:51:43.591413 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 02:51:43.591413 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 02:51:43.591413 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 02:51:43.591413 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:51:43.591413 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:51:43.591413 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:51:43.591413 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:51:43.591413 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-658020115 to delete Oct 29 02:51:43.591413 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.591413 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:43.591413 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.595547 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:43.595547 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 02:51:43.595547 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 02:51:43.595547 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 02:51:43.595547 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 02:51:43.595547 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 02:51:43.595547 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 02:51:43.595547 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-658020115 could not be found. Oct 29 02:51:43.595547 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.595547 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:43.595547 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.595547 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:43.595547 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:43.595547 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:43.595547 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:43.595547 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:43.595547 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:51:43.595547 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:51:43.595547 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:43.595547 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:43.598820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 02:51:43.598820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 02:51:43.598820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:51:43.598820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.598820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:43.598820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.598820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:43.598820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:43.598820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:43.598820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:43.598820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:43.598820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:51:43.598820 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.607700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-103fea26-6704-4936-b2a9-34f85bad054e tempest-ImagesDeleteNegativeTestJSON-1794325168 tempest-ImagesDeleteNegativeTestJSON-1794325168-project] Returning 404 to user: Image not found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:43.610883 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-103fea26-6704-4936-b2a9-34f85bad054e tempest-ImagesDeleteNegativeTestJSON-1794325168 tempest-ImagesDeleteNegativeTestJSON-1794325168-project] 10.222.0.46 "DELETE /compute/v2.1/images/tempest-invalid-658020115" status: 404 len: 62 microversion: 2.1 time: 0.094969 Oct 29 02:51:43.617520 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 752/1446] 10.222.0.46 () {58 vars in 1203 bytes} [Sat Oct 29 02:51:43 2022] DELETE /compute/v2.1/images/tempest-invalid-658020115 => generated 62 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:51:43.639842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-afc7da97-9c69-4c22-8c99-7fc788cc3e05 tempest-ImagesDeleteNegativeTestJSON-1794325168 tempest-ImagesDeleteNegativeTestJSON-1794325168-project] Calling method '.version_select at 0x7ff058531820>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:43.702468 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-afc7da97-9c69-4c22-8c99-7fc788cc3e05 tempest-ImagesDeleteNegativeTestJSON-1794325168 tempest-ImagesDeleteNegativeTestJSON-1794325168-project] HTTP exception thrown: Image not found. Oct 29 02:51:43.704630 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-afc7da97-9c69-4c22-8c99-7fc788cc3e05 tempest-ImagesDeleteNegativeTestJSON-1794325168 tempest-ImagesDeleteNegativeTestJSON-1794325168-project] Request method failure captured: Oct 29 02:51:43.704630 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/images/7368c003-6e2f-4670-b52c-16599ff0d5e9 HTTP/1.1 Oct 29 02:51:43.704630 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:51:43.704630 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:51:43.704630 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:51:43.704630 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:51:43.704630 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:51:43.704630 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:51:43.704630 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:51:43.704630 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:43.704630 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJU-PhthNvUHEN-WimsujwsgkSCiQUCJHZRqGjmfqQR8_jKz5S8V5m1rK5xO-D7uwb-VNfurgLMEFS4Xo2vIX6vOyIxQnK-UlDSzhE2-z3PN-GaPNk1x_-JCtHgBtlYz0QLBXXvP9RK9O8UlzuwojeMW5TcMfXW2P3ft1HOIaT62Jhs Oct 29 02:51:43.704630 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:51:43.704630 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:51:43.704630 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:51:43.704630 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:51:43.704630 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:51:43.704630 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:51:43.704630 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: f54132e8e8614d978f7f270f901a5abe Oct 29 02:51:43.704630 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1794325168 Oct 29 02:51:43.704630 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:51:43.704630 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:51:43.706272 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f54132e8e8614d978f7f270f901a5abe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f54132e8e8614d978f7f270f901a5abe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f54132e8e8614d978f7f270f901a5abe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f54132e8e8614d978f7f270f901a5abe"}]}] Oct 29 02:51:43.706272 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1794325168 Oct 29 02:51:43.706272 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: f54132e8e8614d978f7f270f901a5abe Oct 29 02:51:43.706272 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1794325168 Oct 29 02:51:43.706272 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ImagesDeleteNegativeTestJSON-1794325168-project Oct 29 02:51:43.706272 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:51:43.706272 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:51:43.706272 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 7fbbd0e33108487c99af43f0f0a3ad64 Oct 29 02:51:43.706272 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1794325168-project Oct 29 02:51:43.706272 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:51:43.706272 n-d-862967-2 devstack@n-api.service[127124]: exception: Image not found. Oct 29 02:51:43.706272 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '7368c003-6e2f-4670-b52c-16599ff0d5e9'} Oct 29 02:51:43.706272 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:43.707364 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:43.707364 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 02:51:43.707364 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 02:51:43.707364 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:51:43.707364 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:51:43.707364 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:51:43.707364 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:51:43.707364 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 02:51:43.707364 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 02:51:43.707364 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 02:51:43.707364 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 02:51:43.707364 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:51:43.707364 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:51:43.707364 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:51:43.707364 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:51:43.707364 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7368c003-6e2f-4670-b52c-16599ff0d5e9 to delete Oct 29 02:51:43.707364 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.707364 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:43.707364 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.708812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:43.708812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 02:51:43.708812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 02:51:43.708812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 02:51:43.708812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 02:51:43.708812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 02:51:43.708812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 02:51:43.708812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7368c003-6e2f-4670-b52c-16599ff0d5e9 could not be found. Oct 29 02:51:43.708812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.708812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:43.708812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.708812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:43.708812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:43.708812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:43.708812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:43.708812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:43.708812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:51:43.708812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:51:43.708812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:43.708812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:43.711859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 02:51:43.711859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 02:51:43.711859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:51:43.711859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.711859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:43.711859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.711859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:43.711859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:43.711859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:43.711859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:43.711859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:43.711859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:51:43.711859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:43.714386 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-afc7da97-9c69-4c22-8c99-7fc788cc3e05 tempest-ImagesDeleteNegativeTestJSON-1794325168 tempest-ImagesDeleteNegativeTestJSON-1794325168-project] Returning 404 to user: Image not found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:43.716005 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-afc7da97-9c69-4c22-8c99-7fc788cc3e05 tempest-ImagesDeleteNegativeTestJSON-1794325168 tempest-ImagesDeleteNegativeTestJSON-1794325168-project] 10.222.0.46 "DELETE /compute/v2.1/images/7368c003-6e2f-4670-b52c-16599ff0d5e9" status: 404 len: 62 microversion: 2.1 time: 0.094123 Oct 29 02:51:43.718988 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 753/1447] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:43 2022] DELETE /compute/v2.1/images/7368c003-6e2f-4670-b52c-16599ff0d5e9 => generated 62 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:51:43.732119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-ca926c2d-3012-482e-b595-070b63831ef4 req-fc42d9f3-c31f-4217-bd2e-fe76b06c14fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36000641-20c2-4949-bcae-d11828ed67b4", "tag": "0612e19b-4219-4b23-80fd-a0d245ef44d1"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:43.766485 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ca926c2d-3012-482e-b595-070b63831ef4 req-fc42d9f3-c31f-4217-bd2e-fe76b06c14fb service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:43.771156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ca926c2d-3012-482e-b595-070b63831ef4 req-fc42d9f3-c31f-4217-bd2e-fe76b06c14fb service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:43.772638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ca926c2d-3012-482e-b595-070b63831ef4 req-fc42d9f3-c31f-4217-bd2e-fe76b06c14fb service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:43.809564 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-ca926c2d-3012-482e-b595-070b63831ef4 req-fc42d9f3-c31f-4217-bd2e-fe76b06c14fb service nova] Creating event network-changed:0612e19b-4219-4b23-80fd-a0d245ef44d1 for instance 36000641-20c2-4949-bcae-d11828ed67b4 on n-h1-862967-2 Oct 29 02:51:43.822646 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-ca926c2d-3012-482e-b595-070b63831ef4 req-fc42d9f3-c31f-4217-bd2e-fe76b06c14fb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100920 Oct 29 02:51:43.825887 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 754/1448] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:44.301321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d036b5b1-8eab-4d76-915e-93d6f6b54618 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:44.302805 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d036b5b1-8eab-4d76-915e-93d6f6b54618 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8b24cadb-50b5-47ab-8456-cabed237b2d5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:44.312753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d036b5b1-8eab-4d76-915e-93d6f6b54618 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:44.313646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d036b5b1-8eab-4d76-915e-93d6f6b54618 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:44.314333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d036b5b1-8eab-4d76-915e-93d6f6b54618 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:44.315284 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d036b5b1-8eab-4d76-915e-93d6f6b54618 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:44.316217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d036b5b1-8eab-4d76-915e-93d6f6b54618 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:44.317308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d036b5b1-8eab-4d76-915e-93d6f6b54618 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:44.411654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:44.414908 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d036b5b1-8eab-4d76-915e-93d6f6b54618 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:44.415725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d036b5b1-8eab-4d76-915e-93d6f6b54618 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:44.417217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d036b5b1-8eab-4d76-915e-93d6f6b54618 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:44.418439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-d036b5b1-8eab-4d76-915e-93d6f6b54618 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lazy-loading 'fault' on Instance uuid 8b24cadb-50b5-47ab-8456-cabed237b2d5 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:51:45.182063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d036b5b1-8eab-4d76-915e-93d6f6b54618 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:45.208117 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d036b5b1-8eab-4d76-915e-93d6f6b54618 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5" status: 200 len: 1458 microversion: 2.1 time: 0.911058 Oct 29 02:51:45.210746 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 755/1449] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:44 2022] GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5 => generated 1458 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:51:45.915428 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-df94fd8b-d675-4826-b836-8d02c2766efc tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:45.952777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-df94fd8b-d675-4826-b836-8d02c2766efc tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:45.960400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-df94fd8b-d675-4826-b836-8d02c2766efc tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:45.965009 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-df94fd8b-d675-4826-b836-8d02c2766efc tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1293 microversion: 2.25 time: 3.171499 Oct 29 02:51:45.968822 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 695/1450] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:42 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1293 bytes in 3177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:46.234998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-200a5a5d-e884-4742-94cb-070ff4ddf255 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:46.235653 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-200a5a5d-e884-4742-94cb-070ff4ddf255 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8b24cadb-50b5-47ab-8456-cabed237b2d5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:46.258224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-200a5a5d-e884-4742-94cb-070ff4ddf255 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:46.258821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-200a5a5d-e884-4742-94cb-070ff4ddf255 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:46.261720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-200a5a5d-e884-4742-94cb-070ff4ddf255 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:46.263268 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-200a5a5d-e884-4742-94cb-070ff4ddf255 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:46.265398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-200a5a5d-e884-4742-94cb-070ff4ddf255 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:46.266893 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-200a5a5d-e884-4742-94cb-070ff4ddf255 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:46.415012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-200a5a5d-e884-4742-94cb-070ff4ddf255 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:46.416352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-200a5a5d-e884-4742-94cb-070ff4ddf255 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:46.417502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-200a5a5d-e884-4742-94cb-070ff4ddf255 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:46.418738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-200a5a5d-e884-4742-94cb-070ff4ddf255 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lazy-loading 'fault' on Instance uuid 8b24cadb-50b5-47ab-8456-cabed237b2d5 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:51:46.655054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-200a5a5d-e884-4742-94cb-070ff4ddf255 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:46.720204 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-200a5a5d-e884-4742-94cb-070ff4ddf255 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5" status: 200 len: 1416 microversion: 2.1 time: 0.489888 Oct 29 02:51:46.722906 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 756/1451] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:46 2022] GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5 => generated 1416 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:51:47.025312 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-73df185f-de9e-4905-93a6-694a766f1d5e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:47.026591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-73df185f-de9e-4905-93a6-694a766f1d5e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:47.044271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73df185f-de9e-4905-93a6-694a766f1d5e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:47.052502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73df185f-de9e-4905-93a6-694a766f1d5e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:47.054370 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73df185f-de9e-4905-93a6-694a766f1d5e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:47.059471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73df185f-de9e-4905-93a6-694a766f1d5e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:47.060332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73df185f-de9e-4905-93a6-694a766f1d5e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:47.061719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73df185f-de9e-4905-93a6-694a766f1d5e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:47.753629 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f7046161-2da2-4051-bf34-55f7fa5482a6 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:47.764753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f7046161-2da2-4051-bf34-55f7fa5482a6 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8b24cadb-50b5-47ab-8456-cabed237b2d5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:47.795046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7046161-2da2-4051-bf34-55f7fa5482a6 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:47.796054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7046161-2da2-4051-bf34-55f7fa5482a6 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:47.801035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7046161-2da2-4051-bf34-55f7fa5482a6 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:47.804468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7046161-2da2-4051-bf34-55f7fa5482a6 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:47.805372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7046161-2da2-4051-bf34-55f7fa5482a6 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:47.806179 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7046161-2da2-4051-bf34-55f7fa5482a6 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:47.929885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7046161-2da2-4051-bf34-55f7fa5482a6 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:47.933351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7046161-2da2-4051-bf34-55f7fa5482a6 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:47.934863 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7046161-2da2-4051-bf34-55f7fa5482a6 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:47.936039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-f7046161-2da2-4051-bf34-55f7fa5482a6 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lazy-loading 'fault' on Instance uuid 8b24cadb-50b5-47ab-8456-cabed237b2d5 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:51:48.079958 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f7046161-2da2-4051-bf34-55f7fa5482a6 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a33ab5d704ab43e4b83938ad17c418f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17f19c629832452bb23bdf27e87e0a49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:48.137082 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f7046161-2da2-4051-bf34-55f7fa5482a6 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5" status: 200 len: 1310 microversion: 2.1 time: 0.389550 Oct 29 02:51:48.143086 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 757/1452] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:47 2022] GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5 => generated 1310 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:51:48.174447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-992a282f-a061-430b-a89d-7fe6e6924106 req-535e63b8-e01c-40f3-be32-fdbb1898ba25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b24cadb-50b5-47ab-8456-cabed237b2d5", "name": "network-vif-deleted", "tag": "e3007c86-7dce-4a92-aa92-99e53d24fe9f"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:51:48.247605 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-992a282f-a061-430b-a89d-7fe6e6924106 req-535e63b8-e01c-40f3-be32-fdbb1898ba25 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:48.250130 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-992a282f-a061-430b-a89d-7fe6e6924106 req-535e63b8-e01c-40f3-be32-fdbb1898ba25 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:48.250719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-992a282f-a061-430b-a89d-7fe6e6924106 req-535e63b8-e01c-40f3-be32-fdbb1898ba25 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:48.296317 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-992a282f-a061-430b-a89d-7fe6e6924106 req-535e63b8-e01c-40f3-be32-fdbb1898ba25 service nova] Creating event network-vif-deleted:e3007c86-7dce-4a92-aa92-99e53d24fe9f for instance 8b24cadb-50b5-47ab-8456-cabed237b2d5 on n-h2-862967-2 Oct 29 02:51:48.313356 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-992a282f-a061-430b-a89d-7fe6e6924106 req-535e63b8-e01c-40f3-be32-fdbb1898ba25 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165315 Oct 29 02:51:48.316484 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 758/1453] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:51:49.180002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-263af408-d9ce-4c98-b97b-905a43769e13 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:49.181302 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-263af408-d9ce-4c98-b97b-905a43769e13 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8b24cadb-50b5-47ab-8456-cabed237b2d5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:49.188117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-263af408-d9ce-4c98-b97b-905a43769e13 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:49.189265 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-263af408-d9ce-4c98-b97b-905a43769e13 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:49.189867 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-263af408-d9ce-4c98-b97b-905a43769e13 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:49.190831 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-263af408-d9ce-4c98-b97b-905a43769e13 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:49.191705 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-263af408-d9ce-4c98-b97b-905a43769e13 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:49.192312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-263af408-d9ce-4c98-b97b-905a43769e13 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:49.212430 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-263af408-d9ce-4c98-b97b-905a43769e13 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] HTTP exception thrown: Instance 8b24cadb-50b5-47ab-8456-cabed237b2d5 could not be found. Oct 29 02:51:49.214507 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-263af408-d9ce-4c98-b97b-905a43769e13 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Request method failure captured: Oct 29 02:51:49.214507 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5 HTTP/1.1 Oct 29 02:51:49.214507 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:51:49.214507 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:51:49.214507 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:51:49.214507 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:51:49.214507 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:51:49.214507 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:51:49.214507 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:51:49.214507 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:49.214507 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJT3d84SNWnOjYnIYF4m6-85VcrsQxn8rS3YcyXYN1J8EO0BPodOIeJ-gBjreEyAj6Ev8ctpI5p2WfJ22wMDdiwQFR3hLC6bgPAebZSFATI0C2dFpi6bEUS8hh4pTtq3gw_9cjxbDm1f1odNxqBA8yRq902Eh837c_Tx-NgCHQEeF5o Oct 29 02:51:49.214507 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:51:49.214507 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:51:49.214507 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:51:49.214507 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:51:49.214507 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:51:49.214507 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:51:49.214507 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 17f19c629832452bb23bdf27e87e0a49 Oct 29 02:51:49.214507 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1507118903 Oct 29 02:51:49.214507 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:51:49.214507 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:51:49.216189 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/17f19c629832452bb23bdf27e87e0a49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/17f19c629832452bb23bdf27e87e0a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_17f19c629832452bb23bdf27e87e0a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/17f19c629832452bb23bdf27e87e0a49"}]}] Oct 29 02:51:49.216189 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-DeleteServersAdminTestJSON-1507118903 Oct 29 02:51:49.216189 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 17f19c629832452bb23bdf27e87e0a49 Oct 29 02:51:49.216189 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1507118903 Oct 29 02:51:49.216189 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-DeleteServersAdminTestJSON-1507118903-project Oct 29 02:51:49.216189 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:51:49.216189 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:51:49.216189 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: a33ab5d704ab43e4b83938ad17c418f3 Oct 29 02:51:49.216189 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-DeleteServersAdminTestJSON-1507118903-project Oct 29 02:51:49.216189 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:51:49.216189 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 8b24cadb-50b5-47ab-8456-cabed237b2d5 could not be found. Oct 29 02:51:49.216189 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '8b24cadb-50b5-47ab-8456-cabed237b2d5'} Oct 29 02:51:49.217089 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:49.217089 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:49.217089 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:51:49.217089 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:51:49.217089 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:51:49.217089 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:51:49.217089 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:51:49.217089 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:51:49.217089 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:51:49.217089 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:51:49.217089 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b24cadb-50b5-47ab-8456-cabed237b2d5 could not be found. Oct 29 02:51:49.217089 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:49.217089 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:49.217089 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:49.217089 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:49.217089 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:49.217089 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:49.217089 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:49.217089 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:49.217089 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:49.218543 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:49.218543 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:51:49.218543 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:51:49.218543 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:51:49.218543 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:51:49.218543 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:51:49.218543 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:51:49.218543 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b24cadb-50b5-47ab-8456-cabed237b2d5 could not be found. Oct 29 02:51:49.218543 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:49.218543 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:49.218543 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:49.218543 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:49.218543 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:49.218543 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:49.218543 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:49.218543 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:49.218543 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b24cadb-50b5-47ab-8456-cabed237b2d5 could not be found. Oct 29 02:51:49.218543 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:49.225195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-263af408-d9ce-4c98-b97b-905a43769e13 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Returning 404 to user: Instance 8b24cadb-50b5-47ab-8456-cabed237b2d5 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:49.226585 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-263af408-d9ce-4c98-b97b-905a43769e13 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5" status: 404 len: 111 microversion: 2.1 time: 0.051941 Oct 29 02:51:49.227831 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 759/1454] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:49 2022] GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:51:49.245799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d5687d0b-c09d-4a9c-badc-d5ccaef0e9ef tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:49.254966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d5687d0b-c09d-4a9c-badc-d5ccaef0e9ef tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8b24cadb-50b5-47ab-8456-cabed237b2d5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:49.273174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5687d0b-c09d-4a9c-badc-d5ccaef0e9ef tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:49.277925 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5687d0b-c09d-4a9c-badc-d5ccaef0e9ef tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:49.280080 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5687d0b-c09d-4a9c-badc-d5ccaef0e9ef tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:49.282532 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5687d0b-c09d-4a9c-badc-d5ccaef0e9ef tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:49.285812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5687d0b-c09d-4a9c-badc-d5ccaef0e9ef tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:49.286624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5687d0b-c09d-4a9c-badc-d5ccaef0e9ef tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:49.342330 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-d5687d0b-c09d-4a9c-badc-d5ccaef0e9ef tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] HTTP exception thrown: Instance 8b24cadb-50b5-47ab-8456-cabed237b2d5 could not be found. Oct 29 02:51:49.346255 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d5687d0b-c09d-4a9c-badc-d5ccaef0e9ef tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Request method failure captured: Oct 29 02:51:49.346255 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5 HTTP/1.1 Oct 29 02:51:49.346255 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:51:49.346255 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:51:49.346255 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:51:49.346255 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:51:49.346255 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:51:49.346255 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:51:49.346255 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:51:49.346255 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:49.346255 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJT3d84SNWnOjYnIYF4m6-85VcrsQxn8rS3YcyXYN1J8EO0BPodOIeJ-gBjreEyAj6Ev8ctpI5p2WfJ22wMDdiwQFR3hLC6bgPAebZSFATI0C2dFpi6bEUS8hh4pTtq3gw_9cjxbDm1f1odNxqBA8yRq902Eh837c_Tx-NgCHQEeF5o Oct 29 02:51:49.346255 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:51:49.346255 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:51:49.346255 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:51:49.346255 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:51:49.346255 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:51:49.346255 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:51:49.346255 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 17f19c629832452bb23bdf27e87e0a49 Oct 29 02:51:49.346255 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1507118903 Oct 29 02:51:49.346255 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:51:49.346255 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:51:49.348978 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/17f19c629832452bb23bdf27e87e0a49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/17f19c629832452bb23bdf27e87e0a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_17f19c629832452bb23bdf27e87e0a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/17f19c629832452bb23bdf27e87e0a49"}]}] Oct 29 02:51:49.348978 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-DeleteServersAdminTestJSON-1507118903 Oct 29 02:51:49.348978 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 17f19c629832452bb23bdf27e87e0a49 Oct 29 02:51:49.348978 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1507118903 Oct 29 02:51:49.348978 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-DeleteServersAdminTestJSON-1507118903-project Oct 29 02:51:49.348978 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:51:49.348978 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:51:49.348978 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: a33ab5d704ab43e4b83938ad17c418f3 Oct 29 02:51:49.348978 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-DeleteServersAdminTestJSON-1507118903-project Oct 29 02:51:49.348978 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:51:49.348978 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 8b24cadb-50b5-47ab-8456-cabed237b2d5 could not be found. Oct 29 02:51:49.348978 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '8b24cadb-50b5-47ab-8456-cabed237b2d5'} Oct 29 02:51:49.351279 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:49.351279 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:49.351279 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:51:49.351279 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:51:49.351279 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:51:49.351279 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:51:49.351279 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:51:49.351279 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:51:49.351279 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:51:49.351279 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:51:49.351279 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b24cadb-50b5-47ab-8456-cabed237b2d5 could not be found. Oct 29 02:51:49.351279 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:49.351279 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:49.351279 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:49.351279 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:49.351279 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:49.351279 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:49.351279 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:49.351279 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:49.351279 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:49.356044 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:49.356044 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:51:49.356044 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:51:49.356044 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:51:49.356044 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:51:49.356044 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:51:49.356044 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:51:49.356044 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:51:49.356044 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:51:49.356044 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b24cadb-50b5-47ab-8456-cabed237b2d5 could not be found. Oct 29 02:51:49.356044 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:49.356044 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:49.356044 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:49.356044 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:49.356044 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:49.356044 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:49.356044 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:49.356044 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:49.356044 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b24cadb-50b5-47ab-8456-cabed237b2d5 could not be found. Oct 29 02:51:49.356044 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:49.360197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d5687d0b-c09d-4a9c-badc-d5ccaef0e9ef tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Returning 404 to user: Instance 8b24cadb-50b5-47ab-8456-cabed237b2d5 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:49.360197 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d5687d0b-c09d-4a9c-badc-d5ccaef0e9ef tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5" status: 404 len: 111 microversion: 2.1 time: 0.119096 Oct 29 02:51:49.366195 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 760/1455] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:51:49 2022] DELETE /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:51:49.373775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-05f8508f-b2e3-4856-bb15-ca57043b62b4 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:49.375267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-05f8508f-b2e3-4856-bb15-ca57043b62b4 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8b24cadb-50b5-47ab-8456-cabed237b2d5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:49.407007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05f8508f-b2e3-4856-bb15-ca57043b62b4 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:49.409959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05f8508f-b2e3-4856-bb15-ca57043b62b4 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:49.412294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05f8508f-b2e3-4856-bb15-ca57043b62b4 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:49.413756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05f8508f-b2e3-4856-bb15-ca57043b62b4 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:49.415534 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05f8508f-b2e3-4856-bb15-ca57043b62b4 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:49.417208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05f8508f-b2e3-4856-bb15-ca57043b62b4 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:49.454013 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-05f8508f-b2e3-4856-bb15-ca57043b62b4 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] HTTP exception thrown: Instance 8b24cadb-50b5-47ab-8456-cabed237b2d5 could not be found. Oct 29 02:51:49.459559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-05f8508f-b2e3-4856-bb15-ca57043b62b4 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Request method failure captured: Oct 29 02:51:49.459559 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5 HTTP/1.1 Oct 29 02:51:49.459559 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:51:49.459559 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:51:49.459559 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:51:49.459559 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:51:49.459559 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:51:49.459559 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:51:49.459559 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:51:49.459559 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:49.459559 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJT3d84SNWnOjYnIYF4m6-85VcrsQxn8rS3YcyXYN1J8EO0BPodOIeJ-gBjreEyAj6Ev8ctpI5p2WfJ22wMDdiwQFR3hLC6bgPAebZSFATI0C2dFpi6bEUS8hh4pTtq3gw_9cjxbDm1f1odNxqBA8yRq902Eh837c_Tx-NgCHQEeF5o Oct 29 02:51:49.459559 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:51:49.459559 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:51:49.459559 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:51:49.459559 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:51:49.459559 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:51:49.459559 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:51:49.459559 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 17f19c629832452bb23bdf27e87e0a49 Oct 29 02:51:49.459559 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1507118903 Oct 29 02:51:49.459559 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:51:49.459559 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:51:49.462399 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/17f19c629832452bb23bdf27e87e0a49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/17f19c629832452bb23bdf27e87e0a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_17f19c629832452bb23bdf27e87e0a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/17f19c629832452bb23bdf27e87e0a49"}]}] Oct 29 02:51:49.462399 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-DeleteServersAdminTestJSON-1507118903 Oct 29 02:51:49.462399 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 17f19c629832452bb23bdf27e87e0a49 Oct 29 02:51:49.462399 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1507118903 Oct 29 02:51:49.462399 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-DeleteServersAdminTestJSON-1507118903-project Oct 29 02:51:49.462399 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:51:49.462399 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:51:49.462399 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: a33ab5d704ab43e4b83938ad17c418f3 Oct 29 02:51:49.462399 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-DeleteServersAdminTestJSON-1507118903-project Oct 29 02:51:49.462399 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:51:49.462399 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 8b24cadb-50b5-47ab-8456-cabed237b2d5 could not be found. Oct 29 02:51:49.462399 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '8b24cadb-50b5-47ab-8456-cabed237b2d5'} Oct 29 02:51:49.464334 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:49.464334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:49.464334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:51:49.464334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:51:49.464334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:51:49.464334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:51:49.464334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:51:49.464334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:51:49.464334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:51:49.464334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:51:49.464334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b24cadb-50b5-47ab-8456-cabed237b2d5 could not be found. Oct 29 02:51:49.464334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:49.464334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:49.464334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:49.464334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:49.464334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:49.464334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:49.464334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:49.464334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:49.464334 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:49.467682 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:49.467682 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:51:49.467682 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:51:49.467682 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:51:49.467682 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:51:49.467682 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:51:49.467682 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:51:49.467682 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b24cadb-50b5-47ab-8456-cabed237b2d5 could not be found. Oct 29 02:51:49.467682 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:49.467682 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:49.467682 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:49.467682 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:49.467682 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:49.467682 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:49.467682 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:49.467682 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:49.467682 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b24cadb-50b5-47ab-8456-cabed237b2d5 could not be found. Oct 29 02:51:49.467682 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:49.472668 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-05f8508f-b2e3-4856-bb15-ca57043b62b4 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Returning 404 to user: Instance 8b24cadb-50b5-47ab-8456-cabed237b2d5 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:49.474389 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-05f8508f-b2e3-4856-bb15-ca57043b62b4 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5" status: 404 len: 111 microversion: 2.1 time: 0.106037 Oct 29 02:51:49.475622 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 761/1456] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:49 2022] GET /compute/v2.1/servers/8b24cadb-50b5-47ab-8456-cabed237b2d5 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:51:49.494124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1ba2c964-22ce-4b73-bd4d-8b9c5903c855 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:49.507798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1ba2c964-22ce-4b73-bd4d-8b9c5903c855 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:49.526421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ba2c964-22ce-4b73-bd4d-8b9c5903c855 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:49.526943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ba2c964-22ce-4b73-bd4d-8b9c5903c855 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:49.529053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ba2c964-22ce-4b73-bd4d-8b9c5903c855 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:49.533433 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ba2c964-22ce-4b73-bd4d-8b9c5903c855 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:49.537725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ba2c964-22ce-4b73-bd4d-8b9c5903c855 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:49.538558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ba2c964-22ce-4b73-bd4d-8b9c5903c855 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:49.610584 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-1ba2c964-22ce-4b73-bd4d-8b9c5903c855 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] HTTP exception thrown: Instance 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf could not be found. Oct 29 02:51:49.612212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1ba2c964-22ce-4b73-bd4d-8b9c5903c855 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Request method failure captured: Oct 29 02:51:49.612212 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf HTTP/1.1 Oct 29 02:51:49.612212 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:51:49.612212 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:51:49.612212 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:51:49.612212 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:51:49.612212 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:51:49.612212 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:51:49.612212 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:51:49.612212 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:49.612212 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJT3d84SNWnOjYnIYF4m6-85VcrsQxn8rS3YcyXYN1J8EO0BPodOIeJ-gBjreEyAj6Ev8ctpI5p2WfJ22wMDdiwQFR3hLC6bgPAebZSFATI0C2dFpi6bEUS8hh4pTtq3gw_9cjxbDm1f1odNxqBA8yRq902Eh837c_Tx-NgCHQEeF5o Oct 29 02:51:49.612212 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:51:49.612212 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:51:49.612212 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:51:49.612212 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:51:49.612212 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:51:49.612212 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:51:49.612212 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 17f19c629832452bb23bdf27e87e0a49 Oct 29 02:51:49.612212 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1507118903 Oct 29 02:51:49.612212 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:51:49.612212 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:51:49.613726 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/17f19c629832452bb23bdf27e87e0a49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/17f19c629832452bb23bdf27e87e0a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_17f19c629832452bb23bdf27e87e0a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/17f19c629832452bb23bdf27e87e0a49"}]}] Oct 29 02:51:49.613726 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-DeleteServersAdminTestJSON-1507118903 Oct 29 02:51:49.613726 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 17f19c629832452bb23bdf27e87e0a49 Oct 29 02:51:49.613726 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1507118903 Oct 29 02:51:49.613726 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-DeleteServersAdminTestJSON-1507118903-project Oct 29 02:51:49.613726 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:51:49.613726 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:51:49.613726 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: a33ab5d704ab43e4b83938ad17c418f3 Oct 29 02:51:49.613726 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-DeleteServersAdminTestJSON-1507118903-project Oct 29 02:51:49.613726 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:51:49.613726 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf could not be found. Oct 29 02:51:49.613726 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '8533ddeb-4b9e-4e44-bb14-c92a8d171ecf'} Oct 29 02:51:49.614498 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:49.614498 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:49.614498 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:51:49.614498 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:51:49.614498 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:51:49.614498 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:51:49.614498 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:51:49.614498 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:51:49.614498 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:51:49.614498 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:51:49.614498 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf could not be found. Oct 29 02:51:49.614498 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:49.614498 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:49.614498 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:49.614498 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:49.614498 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:49.614498 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:49.614498 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:49.614498 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:49.614498 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:49.615731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:49.615731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:51:49.615731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:51:49.615731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:51:49.615731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:51:49.615731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:51:49.615731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:51:49.615731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:51:49.615731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:51:49.615731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf could not be found. Oct 29 02:51:49.615731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:49.615731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:49.615731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:49.615731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:49.615731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:49.615731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:49.615731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:49.615731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:49.615731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf could not be found. Oct 29 02:51:49.615731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:49.617021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1ba2c964-22ce-4b73-bd4d-8b9c5903c855 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Returning 404 to user: Instance 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:49.617021 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1ba2c964-22ce-4b73-bd4d-8b9c5903c855 tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf" status: 404 len: 111 microversion: 2.1 time: 0.132561 Oct 29 02:51:49.620106 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 762/1457] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:51:49 2022] DELETE /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:51:49.631519 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2fc2c9ad-2ba7-47f2-8494-bdb0c8c37c4f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:49.632163 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2fc2c9ad-2ba7-47f2-8494-bdb0c8c37c4f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] [instance: 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:49.662532 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2fc2c9ad-2ba7-47f2-8494-bdb0c8c37c4f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:49.663437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2fc2c9ad-2ba7-47f2-8494-bdb0c8c37c4f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:49.664576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2fc2c9ad-2ba7-47f2-8494-bdb0c8c37c4f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:49.665641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2fc2c9ad-2ba7-47f2-8494-bdb0c8c37c4f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:49.666133 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2fc2c9ad-2ba7-47f2-8494-bdb0c8c37c4f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:49.666728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2fc2c9ad-2ba7-47f2-8494-bdb0c8c37c4f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:49.711033 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-2fc2c9ad-2ba7-47f2-8494-bdb0c8c37c4f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] HTTP exception thrown: Instance 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf could not be found. Oct 29 02:51:49.712328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2fc2c9ad-2ba7-47f2-8494-bdb0c8c37c4f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Request method failure captured: Oct 29 02:51:49.712328 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf HTTP/1.1 Oct 29 02:51:49.712328 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:51:49.712328 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:51:49.712328 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:51:49.712328 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:51:49.712328 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:51:49.712328 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:51:49.712328 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:51:49.712328 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:51:49.712328 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJT3d84SNWnOjYnIYF4m6-85VcrsQxn8rS3YcyXYN1J8EO0BPodOIeJ-gBjreEyAj6Ev8ctpI5p2WfJ22wMDdiwQFR3hLC6bgPAebZSFATI0C2dFpi6bEUS8hh4pTtq3gw_9cjxbDm1f1odNxqBA8yRq902Eh837c_Tx-NgCHQEeF5o Oct 29 02:51:49.712328 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:51:49.712328 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:51:49.712328 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:51:49.712328 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:51:49.712328 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:51:49.712328 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:51:49.712328 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 17f19c629832452bb23bdf27e87e0a49 Oct 29 02:51:49.712328 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1507118903 Oct 29 02:51:49.712328 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:51:49.712328 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:51:49.715168 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/17f19c629832452bb23bdf27e87e0a49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/17f19c629832452bb23bdf27e87e0a49"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_17f19c629832452bb23bdf27e87e0a49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/17f19c629832452bb23bdf27e87e0a49"}]}] Oct 29 02:51:49.715168 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-DeleteServersAdminTestJSON-1507118903 Oct 29 02:51:49.715168 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 17f19c629832452bb23bdf27e87e0a49 Oct 29 02:51:49.715168 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1507118903 Oct 29 02:51:49.715168 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-DeleteServersAdminTestJSON-1507118903-project Oct 29 02:51:49.715168 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:51:49.715168 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:51:49.715168 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: a33ab5d704ab43e4b83938ad17c418f3 Oct 29 02:51:49.715168 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-DeleteServersAdminTestJSON-1507118903-project Oct 29 02:51:49.715168 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:51:49.715168 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf could not be found. Oct 29 02:51:49.715168 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '8533ddeb-4b9e-4e44-bb14-c92a8d171ecf'} Oct 29 02:51:49.716742 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:51:49.716742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:49.716742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:51:49.716742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:51:49.716742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:51:49.716742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:51:49.716742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:51:49.716742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:51:49.716742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:51:49.716742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:51:49.716742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf could not be found. Oct 29 02:51:49.716742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:49.716742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:49.716742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:49.716742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:49.716742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:49.716742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:49.716742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:51:49.716742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:51:49.716742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:51:49.722699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:51:49.722699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:51:49.722699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:51:49.722699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:51:49.722699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:51:49.722699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:51:49.722699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:51:49.722699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf could not be found. Oct 29 02:51:49.722699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:49.722699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:51:49.722699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:49.722699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:51:49.722699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:51:49.722699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:51:49.722699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:51:49.722699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:51:49.722699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf could not be found. Oct 29 02:51:49.722699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:51:49.726886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2fc2c9ad-2ba7-47f2-8494-bdb0c8c37c4f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] Returning 404 to user: Instance 8533ddeb-4b9e-4e44-bb14-c92a8d171ecf could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:51:49.726886 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2fc2c9ad-2ba7-47f2-8494-bdb0c8c37c4f tempest-DeleteServersAdminTestJSON-1507118903 tempest-DeleteServersAdminTestJSON-1507118903-project] 10.222.0.46 "GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf" status: 404 len: 111 microversion: 2.1 time: 0.093108 Oct 29 02:51:49.726886 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 763/1458] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:51:49 2022] GET /compute/v2.1/servers/8533ddeb-4b9e-4e44-bb14-c92a8d171ecf => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:51:49.838448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-73df185f-de9e-4905-93a6-694a766f1d5e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:49.850657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-73df185f-de9e-4905-93a6-694a766f1d5e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:49.857888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-73df185f-de9e-4905-93a6-694a766f1d5e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:49.863504 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-73df185f-de9e-4905-93a6-694a766f1d5e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1293 microversion: 2.25 time: 2.854260 Oct 29 02:51:49.868569 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 696/1459] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:47 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1293 bytes in 2857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:50.921797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-355e3206-433f-49af-a2dc-77648507a3c5 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:50.931466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-355e3206-433f-49af-a2dc-77648507a3c5 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:50.972913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-355e3206-433f-49af-a2dc-77648507a3c5 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:50.976606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-355e3206-433f-49af-a2dc-77648507a3c5 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:50.980665 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-355e3206-433f-49af-a2dc-77648507a3c5 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:50.982447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-355e3206-433f-49af-a2dc-77648507a3c5 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:50.986136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-355e3206-433f-49af-a2dc-77648507a3c5 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:50.987967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-355e3206-433f-49af-a2dc-77648507a3c5 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:51.805472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-355e3206-433f-49af-a2dc-77648507a3c5 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:51.835804 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-355e3206-433f-49af-a2dc-77648507a3c5 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:51.845343 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-355e3206-433f-49af-a2dc-77648507a3c5 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:51.851446 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-355e3206-433f-49af-a2dc-77648507a3c5 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1281 microversion: 2.25 time: 0.948752 Oct 29 02:51:51.856923 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 764/1460] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:50 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1281 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:52.892260 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8d1736e7-7ba2-4eb3-b107-d8596f24d344 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:52.909412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8d1736e7-7ba2-4eb3-b107-d8596f24d344 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:52.923757 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=22 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:52.927233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d1736e7-7ba2-4eb3-b107-d8596f24d344 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:52.928571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d1736e7-7ba2-4eb3-b107-d8596f24d344 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:52.930712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d1736e7-7ba2-4eb3-b107-d8596f24d344 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:52.932908 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d1736e7-7ba2-4eb3-b107-d8596f24d344 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:52.936738 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d1736e7-7ba2-4eb3-b107-d8596f24d344 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:52.937904 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d1736e7-7ba2-4eb3-b107-d8596f24d344 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:54.292789 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8d1736e7-7ba2-4eb3-b107-d8596f24d344 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:54.350691 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8d1736e7-7ba2-4eb3-b107-d8596f24d344 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:54.379594 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8d1736e7-7ba2-4eb3-b107-d8596f24d344 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:54.390418 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8d1736e7-7ba2-4eb3-b107-d8596f24d344 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1281 microversion: 2.25 time: 1.497885 Oct 29 02:51:54.427733 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 697/1461] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:52 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1281 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:55.441791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-08ffd2b3-6579-454b-a47f-d49d94ac58d0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:55.442800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-08ffd2b3-6579-454b-a47f-d49d94ac58d0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:55.491396 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-08ffd2b3-6579-454b-a47f-d49d94ac58d0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:55.492466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-08ffd2b3-6579-454b-a47f-d49d94ac58d0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:55.494660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-08ffd2b3-6579-454b-a47f-d49d94ac58d0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:55.496013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-08ffd2b3-6579-454b-a47f-d49d94ac58d0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:55.496960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-08ffd2b3-6579-454b-a47f-d49d94ac58d0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:55.497796 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-08ffd2b3-6579-454b-a47f-d49d94ac58d0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:56.226735 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-08ffd2b3-6579-454b-a47f-d49d94ac58d0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:56.259766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-08ffd2b3-6579-454b-a47f-d49d94ac58d0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:56.265461 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-08ffd2b3-6579-454b-a47f-d49d94ac58d0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:56.273054 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-08ffd2b3-6579-454b-a47f-d49d94ac58d0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1281 microversion: 2.25 time: 0.836358 Oct 29 02:51:56.279558 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 765/1462] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:55 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1281 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:51:57.307174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8fb873cf-8f9c-4156-bd1c-490613c70615 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:57.308261 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8fb873cf-8f9c-4156-bd1c-490613c70615 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:57.350288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8fb873cf-8f9c-4156-bd1c-490613c70615 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:57.351381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8fb873cf-8f9c-4156-bd1c-490613c70615 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:57.352324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8fb873cf-8f9c-4156-bd1c-490613c70615 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:57.361283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8fb873cf-8f9c-4156-bd1c-490613c70615 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:57.362465 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8fb873cf-8f9c-4156-bd1c-490613c70615 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:57.365090 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8fb873cf-8f9c-4156-bd1c-490613c70615 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:58.603303 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8fb873cf-8f9c-4156-bd1c-490613c70615 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:58.635195 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8fb873cf-8f9c-4156-bd1c-490613c70615 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:58.641549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8fb873cf-8f9c-4156-bd1c-490613c70615 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:51:58.650899 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8fb873cf-8f9c-4156-bd1c-490613c70615 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1281 microversion: 2.25 time: 1.349998 Oct 29 02:51:58.672573 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 698/1463] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:57 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1281 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:51:59.695967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5d16ab79-6440-4b1f-b883-fbc96e585e03 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:51:59.698673 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5d16ab79-6440-4b1f-b883-fbc96e585e03 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:51:59.762483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5d16ab79-6440-4b1f-b883-fbc96e585e03 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:59.765350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5d16ab79-6440-4b1f-b883-fbc96e585e03 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:59.773484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5d16ab79-6440-4b1f-b883-fbc96e585e03 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:51:59.774771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5d16ab79-6440-4b1f-b883-fbc96e585e03 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:51:59.775712 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5d16ab79-6440-4b1f-b883-fbc96e585e03 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:51:59.778155 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5d16ab79-6440-4b1f-b883-fbc96e585e03 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:00.358554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5d16ab79-6440-4b1f-b883-fbc96e585e03 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:00.379043 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5d16ab79-6440-4b1f-b883-fbc96e585e03 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:00.380701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5d16ab79-6440-4b1f-b883-fbc96e585e03 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:00.382741 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5d16ab79-6440-4b1f-b883-fbc96e585e03 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1281 microversion: 2.25 time: 0.694285 Oct 29 02:52:00.387094 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 766/1464] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:51:59 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1281 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:00.915987 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f22f19b9-b1d1-4983-9204-3c27bd9808fa tempest-FloatingIPDetailsTestJSON-436725891 tempest-FloatingIPDetailsTestJSON-436725891-project] Action: 'create', calling method: .version_select at 0x7ff05385b670>, body: {"pool": null} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:01.206768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9449cbb7-79a0-4ff1-b8b6-7c810e39feb5 tempest-HypervisorAdminV228Test-1087181294 tempest-HypervisorAdminV228Test-1087181294-project-admin] Calling method '.version_select at 0x7ff0583a8c10>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:01.209649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9449cbb7-79a0-4ff1-b8b6-7c810e39feb5 tempest-HypervisorAdminV228Test-1087181294 tempest-HypervisorAdminV228Test-1087181294-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:01.210303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9449cbb7-79a0-4ff1-b8b6-7c810e39feb5 tempest-HypervisorAdminV228Test-1087181294 tempest-HypervisorAdminV228Test-1087181294-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:01.210842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9449cbb7-79a0-4ff1-b8b6-7c810e39feb5 tempest-HypervisorAdminV228Test-1087181294 tempest-HypervisorAdminV228Test-1087181294-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:01.273409 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9449cbb7-79a0-4ff1-b8b6-7c810e39feb5 tempest-HypervisorAdminV228Test-1087181294 tempest-HypervisorAdminV228Test-1087181294-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:01.275394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9449cbb7-79a0-4ff1-b8b6-7c810e39feb5 tempest-HypervisorAdminV228Test-1087181294 tempest-HypervisorAdminV228Test-1087181294-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:01.279500 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9449cbb7-79a0-4ff1-b8b6-7c810e39feb5 tempest-HypervisorAdminV228Test-1087181294 tempest-HypervisorAdminV228Test-1087181294-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:01.321642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9449cbb7-79a0-4ff1-b8b6-7c810e39feb5 tempest-HypervisorAdminV228Test-1087181294 tempest-HypervisorAdminV228Test-1087181294-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:01.322266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9449cbb7-79a0-4ff1-b8b6-7c810e39feb5 tempest-HypervisorAdminV228Test-1087181294 tempest-HypervisorAdminV228Test-1087181294-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:01.322710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9449cbb7-79a0-4ff1-b8b6-7c810e39feb5 tempest-HypervisorAdminV228Test-1087181294 tempest-HypervisorAdminV228Test-1087181294-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:01.355057 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9449cbb7-79a0-4ff1-b8b6-7c810e39feb5 tempest-HypervisorAdminV228Test-1087181294 tempest-HypervisorAdminV228Test-1087181294-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.426697 Oct 29 02:52:01.360724 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 767/1465] 10.222.0.46 () {60 vars in 1187 bytes} [Sat Oct 29 02:52:00 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 02:52:01.384834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8aa6a594-4921-470d-bbca-574aed62b2f3 tempest-HypervisorAdminV228Test-1087181294 tempest-HypervisorAdminV228Test-1087181294-project-admin] Calling method '.version_select at 0x7ff053d71e50>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:01.397285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8aa6a594-4921-470d-bbca-574aed62b2f3 tempest-HypervisorAdminV228Test-1087181294 tempest-HypervisorAdminV228Test-1087181294-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:01.404493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8aa6a594-4921-470d-bbca-574aed62b2f3 tempest-HypervisorAdminV228Test-1087181294 tempest-HypervisorAdminV228Test-1087181294-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:01.426739 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8aa6a594-4921-470d-bbca-574aed62b2f3 tempest-HypervisorAdminV228Test-1087181294 tempest-HypervisorAdminV228Test-1087181294-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:01.504536 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8aa6a594-4921-470d-bbca-574aed62b2f3 tempest-HypervisorAdminV228Test-1087181294 tempest-HypervisorAdminV228Test-1087181294-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:01.510631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8aa6a594-4921-470d-bbca-574aed62b2f3 tempest-HypervisorAdminV228Test-1087181294 tempest-HypervisorAdminV228Test-1087181294-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:01.514916 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8aa6a594-4921-470d-bbca-574aed62b2f3 tempest-HypervisorAdminV228Test-1087181294 tempest-HypervisorAdminV228Test-1087181294-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:01.536811 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8aa6a594-4921-470d-bbca-574aed62b2f3 tempest-HypervisorAdminV228Test-1087181294 tempest-HypervisorAdminV228Test-1087181294-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.171735 Oct 29 02:52:01.539614 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 768/1466] 10.222.0.46 () {60 vars in 1193 bytes} [Sat Oct 29 02:52:01 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:52:01.547868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-25ce8022-b8d0-47e6-b746-1cd8afd6af9a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:01.550504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-25ce8022-b8d0-47e6-b746-1cd8afd6af9a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:01.590367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25ce8022-b8d0-47e6-b746-1cd8afd6af9a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:01.592162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25ce8022-b8d0-47e6-b746-1cd8afd6af9a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:01.594881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25ce8022-b8d0-47e6-b746-1cd8afd6af9a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:01.600827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25ce8022-b8d0-47e6-b746-1cd8afd6af9a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:01.602235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25ce8022-b8d0-47e6-b746-1cd8afd6af9a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:01.602944 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25ce8022-b8d0-47e6-b746-1cd8afd6af9a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:02.593897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-25ce8022-b8d0-47e6-b746-1cd8afd6af9a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:02.610977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-25ce8022-b8d0-47e6-b746-1cd8afd6af9a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:02.614480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-25ce8022-b8d0-47e6-b746-1cd8afd6af9a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:02.616543 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-25ce8022-b8d0-47e6-b746-1cd8afd6af9a tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1281 microversion: 2.25 time: 1.074843 Oct 29 02:52:02.618623 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 769/1467] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:01 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1281 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:03.654743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e06fc7c1-4c47-4acb-9992-3a93898bc8ee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:03.656400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e06fc7c1-4c47-4acb-9992-3a93898bc8ee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:03.673550 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e06fc7c1-4c47-4acb-9992-3a93898bc8ee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:03.674295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e06fc7c1-4c47-4acb-9992-3a93898bc8ee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:03.674922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e06fc7c1-4c47-4acb-9992-3a93898bc8ee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:03.675883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e06fc7c1-4c47-4acb-9992-3a93898bc8ee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:03.676851 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e06fc7c1-4c47-4acb-9992-3a93898bc8ee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:03.677443 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e06fc7c1-4c47-4acb-9992-3a93898bc8ee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:05.105446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e06fc7c1-4c47-4acb-9992-3a93898bc8ee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:05.140827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e06fc7c1-4c47-4acb-9992-3a93898bc8ee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:05.144643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e06fc7c1-4c47-4acb-9992-3a93898bc8ee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:05.147441 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e06fc7c1-4c47-4acb-9992-3a93898bc8ee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1281 microversion: 2.25 time: 1.499519 Oct 29 02:52:05.148721 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 770/1468] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:03 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1281 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:05.159149 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-28b7aa25-624c-4e14-b235-ea1681e2d266 req-c803ac58-f9c6-4d6a-8463-3cdbd696e251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36000641-20c2-4949-bcae-d11828ed67b4", "name": "network-vif-plugged", "status": "completed", "tag": "0612e19b-4219-4b23-80fd-a0d245ef44d1"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:05.180344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-28b7aa25-624c-4e14-b235-ea1681e2d266 req-c803ac58-f9c6-4d6a-8463-3cdbd696e251 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:05.181740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-28b7aa25-624c-4e14-b235-ea1681e2d266 req-c803ac58-f9c6-4d6a-8463-3cdbd696e251 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:05.183103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-28b7aa25-624c-4e14-b235-ea1681e2d266 req-c803ac58-f9c6-4d6a-8463-3cdbd696e251 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:05.217789 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-28b7aa25-624c-4e14-b235-ea1681e2d266 req-c803ac58-f9c6-4d6a-8463-3cdbd696e251 service nova] Creating event network-vif-plugged:0612e19b-4219-4b23-80fd-a0d245ef44d1 for instance 36000641-20c2-4949-bcae-d11828ed67b4 on n-h1-862967-2 Oct 29 02:52:05.228987 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-28b7aa25-624c-4e14-b235-ea1681e2d266 req-c803ac58-f9c6-4d6a-8463-3cdbd696e251 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077651 Oct 29 02:52:05.230519 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 771/1469] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:06.180413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a68fd52a-ec4a-44cf-aeac-a7312a4b1b4b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:06.182104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a68fd52a-ec4a-44cf-aeac-a7312a4b1b4b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:06.196929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a68fd52a-ec4a-44cf-aeac-a7312a4b1b4b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:06.202286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a68fd52a-ec4a-44cf-aeac-a7312a4b1b4b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:06.203410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a68fd52a-ec4a-44cf-aeac-a7312a4b1b4b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:06.207122 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a68fd52a-ec4a-44cf-aeac-a7312a4b1b4b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:06.208113 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a68fd52a-ec4a-44cf-aeac-a7312a4b1b4b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:06.208787 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a68fd52a-ec4a-44cf-aeac-a7312a4b1b4b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:06.952703 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a68fd52a-ec4a-44cf-aeac-a7312a4b1b4b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:07.026442 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a68fd52a-ec4a-44cf-aeac-a7312a4b1b4b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:07.030542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a68fd52a-ec4a-44cf-aeac-a7312a4b1b4b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:07.059115 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a68fd52a-ec4a-44cf-aeac-a7312a4b1b4b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1281 microversion: 2.25 time: 0.883604 Oct 29 02:52:07.079319 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 772/1470] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:06 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1281 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:07.315250 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:08.134515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6de0c290-7573-4410-a5d8-cdea7fd97a67 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:08.134515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6de0c290-7573-4410-a5d8-cdea7fd97a67 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:08.146201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6de0c290-7573-4410-a5d8-cdea7fd97a67 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:08.146843 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6de0c290-7573-4410-a5d8-cdea7fd97a67 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:08.147161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6de0c290-7573-4410-a5d8-cdea7fd97a67 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:08.148045 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6de0c290-7573-4410-a5d8-cdea7fd97a67 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:08.148418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6de0c290-7573-4410-a5d8-cdea7fd97a67 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:08.148875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6de0c290-7573-4410-a5d8-cdea7fd97a67 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:08.628708 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=44 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:08.701961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6de0c290-7573-4410-a5d8-cdea7fd97a67 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:08.704745 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=100 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:08.720774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6de0c290-7573-4410-a5d8-cdea7fd97a67 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:08.722254 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6de0c290-7573-4410-a5d8-cdea7fd97a67 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:08.734830 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6de0c290-7573-4410-a5d8-cdea7fd97a67 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1478 microversion: 2.25 time: 0.604979 Oct 29 02:52:08.736162 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 773/1471] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:08 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1478 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:08.911872 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f22f19b9-b1d1-4983-9204-3c27bd9808fa tempest-FloatingIPDetailsTestJSON-436725891 tempest-FloatingIPDetailsTestJSON-436725891-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 8.772648 Oct 29 02:52:08.922249 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 699/1472] 10.222.0.46 () {60 vars in 1170 bytes} [Sat Oct 29 02:52:00 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 8776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:08.930223 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-39a4d2d0-f52c-4cf7-b55c-65ad9ab3f3ba tempest-FloatingIPDetailsTestJSON-436725891 tempest-FloatingIPDetailsTestJSON-436725891-project] Action: 'create', calling method: .version_select at 0x7ff05385b940>, body: {"pool": null} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:09.268904 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d7b3e4e3-48c8-499f-ba11-e3b0ee285549 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:09.270915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d7b3e4e3-48c8-499f-ba11-e3b0ee285549 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:09.300484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7b3e4e3-48c8-499f-ba11-e3b0ee285549 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:09.303911 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7b3e4e3-48c8-499f-ba11-e3b0ee285549 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:09.306247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7b3e4e3-48c8-499f-ba11-e3b0ee285549 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:09.311122 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7b3e4e3-48c8-499f-ba11-e3b0ee285549 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:09.313409 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7b3e4e3-48c8-499f-ba11-e3b0ee285549 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:09.316082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7b3e4e3-48c8-499f-ba11-e3b0ee285549 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:09.922341 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-d7b3e4e3-48c8-499f-ba11-e3b0ee285549 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lazy-loading 'services' on Instance uuid 36000641-20c2-4949-bcae-d11828ed67b4 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:52:09.982720 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d7b3e4e3-48c8-499f-ba11-e3b0ee285549 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1971 microversion: 2.25 time: 1.221409 Oct 29 02:52:09.984128 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 774/1473] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:08 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1971 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:09.993005 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-31d3c573-6ba0-44cc-af70-50d85c58c7ee tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff053db6550>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:10.104557 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-31d3c573-6ba0-44cc-af70-50d85c58c7ee tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/df7dd259-4b6c-45e5-bdb4-85f1c68b9a6e" status: 200 len: 661 microversion: 2.1 time: 0.118693 Oct 29 02:52:10.105464 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 775/1474] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:52:09 2022] GET /compute/v2.1/images/df7dd259-4b6c-45e5-bdb4-85f1c68b9a6e => generated 661 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:10.119305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d144f18c-2b31-487d-837e-9ed3e4cb29b2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-913509187", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "dbf7fe6b-1cb4-4e12-861e-da0b40558568"}, {"uuid": "5fa799b3-f736-4647-9a9b-4e3e5e3d9dd5"}, {"uuid": "dbf7fe6b-1cb4-4e12-861e-da0b40558568"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:10.198273 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-d144f18c-2b31-487d-837e-9ed3e4cb29b2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] validate_networks() for [('dbf7fe6b-1cb4-4e12-861e-da0b40558568', None, None, None, None, None), ('5fa799b3-f736-4647-9a9b-4e3e5e3d9dd5', None, None, None, None, None), ('dbf7fe6b-1cb4-4e12-861e-da0b40558568', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:52:11.760110 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-d144f18c-2b31-487d-837e-9ed3e4cb29b2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:52:11.761590 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-d144f18c-2b31-487d-837e-9ed3e4cb29b2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:52:11.764311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-d144f18c-2b31-487d-837e-9ed3e4cb29b2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:52:11.765579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-d144f18c-2b31-487d-837e-9ed3e4cb29b2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:52:11.767746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-d144f18c-2b31-487d-837e-9ed3e4cb29b2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:52:11.784207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d144f18c-2b31-487d-837e-9ed3e4cb29b2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:11.785175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d144f18c-2b31-487d-837e-9ed3e4cb29b2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:11.786228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d144f18c-2b31-487d-837e-9ed3e4cb29b2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:11.787445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d144f18c-2b31-487d-837e-9ed3e4cb29b2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:11.791088 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d144f18c-2b31-487d-837e-9ed3e4cb29b2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:11.794377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d144f18c-2b31-487d-837e-9ed3e4cb29b2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:11.823192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-d144f18c-2b31-487d-837e-9ed3e4cb29b2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Getting quotas for project 202abee8256d45b29f190731cc63609c. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:52:11.829003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-d144f18c-2b31-487d-837e-9ed3e4cb29b2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Getting quotas for user 67c50c8b6b2444a6afa86bc1d019925c and project 202abee8256d45b29f190731cc63609c. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:52:11.846118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d144f18c-2b31-487d-837e-9ed3e4cb29b2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:52:11.848991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d144f18c-2b31-487d-837e-9ed3e4cb29b2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 500595ea-1c83-4574-b6c8-2d6cc39b2231] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:52:11.951399 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d144f18c-2b31-487d-837e-9ed3e4cb29b2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.836090 Oct 29 02:52:11.960018 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 776/1475] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:52:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:52:11.966608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d6e6a371-d6bb-4905-975f-9219c862ad62 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:11.970471 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d6e6a371-d6bb-4905-975f-9219c862ad62 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:11.980642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6e6a371-d6bb-4905-975f-9219c862ad62 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:11.981678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6e6a371-d6bb-4905-975f-9219c862ad62 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:11.982360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6e6a371-d6bb-4905-975f-9219c862ad62 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:11.983832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6e6a371-d6bb-4905-975f-9219c862ad62 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:11.984554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6e6a371-d6bb-4905-975f-9219c862ad62 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:11.985224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6e6a371-d6bb-4905-975f-9219c862ad62 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:12.297251 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-d6e6a371-d6bb-4905-975f-9219c862ad62 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lazy-loading 'services' on Instance uuid 36000641-20c2-4949-bcae-d11828ed67b4 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:52:12.335500 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d6e6a371-d6bb-4905-975f-9219c862ad62 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1971 microversion: 2.25 time: 0.373569 Oct 29 02:52:12.337779 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 777/1476] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:11 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1971 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:12.379646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-895ca8bc-67cc-47ad-a11e-2f8c7200b7a0 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff058748310>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:12.504984 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-895ca8bc-67cc-47ad-a11e-2f8c7200b7a0 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/df7dd259-4b6c-45e5-bdb4-85f1c68b9a6e" status: 200 len: 661 microversion: 2.1 time: 0.160267 Oct 29 02:52:12.523650 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 778/1477] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:52:12 2022] GET /compute/v2.1/images/df7dd259-4b6c-45e5-bdb4-85f1c68b9a6e => generated 661 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:12.537724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f9d510da-d3be-4704-808f-7ab96b594d4f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:12.539180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f9d510da-d3be-4704-808f-7ab96b594d4f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 500595ea-1c83-4574-b6c8-2d6cc39b2231] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:12.655577 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f9d510da-d3be-4704-808f-7ab96b594d4f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:12.691095 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f9d510da-d3be-4704-808f-7ab96b594d4f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231" status: 200 len: 1212 microversion: 2.1 time: 0.163006 Oct 29 02:52:12.693947 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 779/1478] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:12 2022] GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231 => generated 1212 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:12.708712 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3f751809-d911-4d15-b86a-9b7633b29901 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:12.724444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f751809-d911-4d15-b86a-9b7633b29901 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:12.725857 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f751809-d911-4d15-b86a-9b7633b29901 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:12.726584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f751809-d911-4d15-b86a-9b7633b29901 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:12.730529 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f751809-d911-4d15-b86a-9b7633b29901 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:12.731258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f751809-d911-4d15-b86a-9b7633b29901 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:12.731884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f751809-d911-4d15-b86a-9b7633b29901 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:12.802276 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3f751809-d911-4d15-b86a-9b7633b29901 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.106243 Oct 29 02:52:12.804746 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 780/1479] 10.222.0.46 () {60 vars in 1217 bytes} [Sat Oct 29 02:52:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:52:12.828370 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6584dc92-6250-42a0-b59b-d3ae6834cacf tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862967-2", "block_migration": "auto"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:12.835450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6584dc92-6250-42a0-b59b-d3ae6834cacf tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:12.853718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6584dc92-6250-42a0-b59b-d3ae6834cacf tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:12.854925 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6584dc92-6250-42a0-b59b-d3ae6834cacf tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:12.855799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6584dc92-6250-42a0-b59b-d3ae6834cacf tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:12.856553 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6584dc92-6250-42a0-b59b-d3ae6834cacf tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:12.863444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6584dc92-6250-42a0-b59b-d3ae6834cacf tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:12.864953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6584dc92-6250-42a0-b59b-d3ae6834cacf tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:12.934109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-6584dc92-6250-42a0-b59b-d3ae6834cacf tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lazy-loading 'flavor' on Instance uuid 36000641-20c2-4949-bcae-d11828ed67b4 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:52:12.965237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6584dc92-6250-42a0-b59b-d3ae6834cacf tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Going to try to live migrate instance to n-h2-862967-2 {{(pid=127124) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 02:52:16.943218 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6584dc92-6250-42a0-b59b-d3ae6834cacf tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4/action" status: 202 len: 0 microversion: 2.25 time: 4.129243 Oct 29 02:52:16.944355 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 781/1480] 10.222.0.46 () {62 vars in 1319 bytes} [Sat Oct 29 02:52:12 2022] POST /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4/action => generated 0 bytes in 4131 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:52:16.956405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-27a72bcb-e18f-408c-bc83-a35c80feb756 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:16.961044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-27a72bcb-e18f-408c-bc83-a35c80feb756 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 500595ea-1c83-4574-b6c8-2d6cc39b2231] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:16.968906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:16.992197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27a72bcb-e18f-408c-bc83-a35c80feb756 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:16.994328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27a72bcb-e18f-408c-bc83-a35c80feb756 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:16.996828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27a72bcb-e18f-408c-bc83-a35c80feb756 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:16.998491 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27a72bcb-e18f-408c-bc83-a35c80feb756 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:17.000373 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27a72bcb-e18f-408c-bc83-a35c80feb756 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:17.014297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27a72bcb-e18f-408c-bc83-a35c80feb756 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:17.325067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-27a72bcb-e18f-408c-bc83-a35c80feb756 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:17.340359 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-27a72bcb-e18f-408c-bc83-a35c80feb756 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231" status: 200 len: 1270 microversion: 2.1 time: 0.390821 Oct 29 02:52:17.342458 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 782/1481] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:16 2022] GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231 => generated 1270 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:17.788586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4711c9ed-110e-45f5-89d9-051082bdcae4 tempest-HypervisorAdminNegativeTestJSON-1264988897 tempest-HypervisorAdminNegativeTestJSON-1264988897-project] Calling method '.version_select at 0x7ff053aac700>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:17.792081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4711c9ed-110e-45f5-89d9-051082bdcae4 tempest-HypervisorAdminNegativeTestJSON-1264988897 tempest-HypervisorAdminNegativeTestJSON-1264988897-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '9cd240f57fca4132a4fec655209013b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32601dc3684e4d19b8049ed1ff0d1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:17.797909 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4711c9ed-110e-45f5-89d9-051082bdcae4 tempest-HypervisorAdminNegativeTestJSON-1264988897 tempest-HypervisorAdminNegativeTestJSON-1264988897-project] Request method failure captured: Oct 29 02:52:17.797909 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 29 02:52:17.797909 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:52:17.797909 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:52:17.797909 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:52:17.797909 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:52:17.797909 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:52:17.797909 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:52:17.797909 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:52:17.797909 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:52:17.797909 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJVcVIHhcNx2Pxh35M3fb2AyCngAMCC8nY_jeeCET3YVuA1o1lnn6dBSWYpSQWsxoK8t1wKB1rjso934BK_Fjl8tR0DqaDk0fWZOQOepWVqJPzuDr9LsZ57btprjSBjn1mi-tnGKemhL-pyAvnpI3JFyMhOlemL6gpUv6fXY67l821Y Oct 29 02:52:17.797909 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:52:17.797909 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:52:17.797909 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:52:17.797909 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:52:17.797909 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:52:17.797909 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:52:17.797909 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 32601dc3684e4d19b8049ed1ff0d1fb8 Oct 29 02:52:17.797909 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1264988897 Oct 29 02:52:17.797909 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:52:17.797909 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:52:17.799691 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/32601dc3684e4d19b8049ed1ff0d1fb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/32601dc3684e4d19b8049ed1ff0d1fb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_32601dc3684e4d19b8049ed1ff0d1fb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/32601dc3684e4d19b8049ed1ff0d1fb8"}]}] Oct 29 02:52:17.799691 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1264988897 Oct 29 02:52:17.799691 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 32601dc3684e4d19b8049ed1ff0d1fb8 Oct 29 02:52:17.799691 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1264988897 Oct 29 02:52:17.799691 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-HypervisorAdminNegativeTestJSON-1264988897-project Oct 29 02:52:17.799691 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:52:17.799691 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:52:17.799691 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 9cd240f57fca4132a4fec655209013b8 Oct 29 02:52:17.799691 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1264988897-project Oct 29 02:52:17.799691 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:52:17.799691 n-d-862967-2 devstack@n-api.service[127124]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 29 02:52:17.799691 n-d-862967-2 devstack@n-api.service[127124]: action_args: {} Oct 29 02:52:17.799691 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:52:17.800906 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:17.800906 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:17.800906 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:17.800906 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:52:17.800906 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:52:17.800906 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:52:17.800906 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:52:17.800906 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:52:17.800906 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:52:17.800906 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 29 02:52:17.800906 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 29 02:52:17.800906 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 29 02:52:17.800906 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 29 02:52:17.800906 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:52:17.800906 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:52:17.800906 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:52:17.800906 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:52:17.800906 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:52:17.800906 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:52:17.802439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:52:17.802439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:52:17.802439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:52:17.802439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:52:17.802439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:52:17.802439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:52:17.802439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:52:17.802439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:52:17.802439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 29 02:52:17.802439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:17.802439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:17.802439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:17.802439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:17.802439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:17.802439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:17.802439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:52:17.802439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:52:17.802439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 29 02:52:17.802439 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:17.805997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4711c9ed-110e-45f5-89d9-051082bdcae4 tempest-HypervisorAdminNegativeTestJSON-1264988897 tempest-HypervisorAdminNegativeTestJSON-1264988897-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:52:17.808905 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4711c9ed-110e-45f5-89d9-051082bdcae4 tempest-HypervisorAdminNegativeTestJSON-1264988897 tempest-HypervisorAdminNegativeTestJSON-1264988897-project] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.461176 Oct 29 02:52:17.810298 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 783/1482] 10.222.0.46 () {58 vars in 1167 bytes} [Sat Oct 29 02:52:17 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 467 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:52:17.834167 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9bd17904-9765-4d13-b52a-fcb351ac80a9 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff053aacb80>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:17.934949 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9bd17904-9765-4d13-b52a-fcb351ac80a9 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/fdfde304-89aa-4f56-9a3c-38c9c906de34" status: 200 len: 662 microversion: 2.1 time: 0.122646 Oct 29 02:52:17.938230 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 784/1483] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:52:17 2022] GET /compute/v2.1/images/fdfde304-89aa-4f56-9a3c-38c9c906de34 => generated 662 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:17.944057 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ac9af1f5-9ea1-4f34-b416-d0e29a04cb24 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:17.945317 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ac9af1f5-9ea1-4f34-b416-d0e29a04cb24 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:17.966766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ac9af1f5-9ea1-4f34-b416-d0e29a04cb24 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:17.973375 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ac9af1f5-9ea1-4f34-b416-d0e29a04cb24 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:17.974513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ac9af1f5-9ea1-4f34-b416-d0e29a04cb24 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:17.978558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ac9af1f5-9ea1-4f34-b416-d0e29a04cb24 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:17.979329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ac9af1f5-9ea1-4f34-b416-d0e29a04cb24 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:17.981691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ac9af1f5-9ea1-4f34-b416-d0e29a04cb24 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:18.728990 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-39a4d2d0-f52c-4cf7-b55c-65ad9ab3f3ba tempest-FloatingIPDetailsTestJSON-436725891 tempest-FloatingIPDetailsTestJSON-436725891-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 9.804040 Oct 29 02:52:18.737880 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 700/1484] 10.222.0.46 () {60 vars in 1170 bytes} [Sat Oct 29 02:52:08 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 9806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:18.741392 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ac9af1f5-9ea1-4f34-b416-d0e29a04cb24 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:18.742046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bdbd6e04-134c-48c9-a1f2-a073faa33280 tempest-HypervisorAdminNegativeTestJSON-1264988897 tempest-HypervisorAdminNegativeTestJSON-1264988897-project] Calling method '.version_select at 0x7ff053af9f70>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:18.748122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bdbd6e04-134c-48c9-a1f2-a073faa33280 tempest-HypervisorAdminNegativeTestJSON-1264988897 tempest-HypervisorAdminNegativeTestJSON-1264988897-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '9cd240f57fca4132a4fec655209013b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32601dc3684e4d19b8049ed1ff0d1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:18.751174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bdbd6e04-134c-48c9-a1f2-a073faa33280 tempest-HypervisorAdminNegativeTestJSON-1264988897 tempest-HypervisorAdminNegativeTestJSON-1264988897-project] Request method failure captured: Oct 29 02:52:18.751174 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 29 02:52:18.751174 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:52:18.751174 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:52:18.751174 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:52:18.751174 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:52:18.751174 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:52:18.751174 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:52:18.751174 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:52:18.751174 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:52:18.751174 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJVcVIHhcNx2Pxh35M3fb2AyCngAMCC8nY_jeeCET3YVuA1o1lnn6dBSWYpSQWsxoK8t1wKB1rjso934BK_Fjl8tR0DqaDk0fWZOQOepWVqJPzuDr9LsZ57btprjSBjn1mi-tnGKemhL-pyAvnpI3JFyMhOlemL6gpUv6fXY67l821Y Oct 29 02:52:18.751174 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:52:18.751174 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:52:18.751174 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:52:18.751174 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:52:18.751174 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:52:18.751174 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:52:18.751174 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 32601dc3684e4d19b8049ed1ff0d1fb8 Oct 29 02:52:18.751174 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1264988897 Oct 29 02:52:18.751174 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:52:18.751174 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:52:18.753277 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/32601dc3684e4d19b8049ed1ff0d1fb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/32601dc3684e4d19b8049ed1ff0d1fb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_32601dc3684e4d19b8049ed1ff0d1fb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/32601dc3684e4d19b8049ed1ff0d1fb8"}]}] Oct 29 02:52:18.753277 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1264988897 Oct 29 02:52:18.753277 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 32601dc3684e4d19b8049ed1ff0d1fb8 Oct 29 02:52:18.753277 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1264988897 Oct 29 02:52:18.753277 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-HypervisorAdminNegativeTestJSON-1264988897-project Oct 29 02:52:18.753277 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:52:18.753277 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:52:18.753277 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 9cd240f57fca4132a4fec655209013b8 Oct 29 02:52:18.753277 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1264988897-project Oct 29 02:52:18.753277 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:52:18.753277 n-d-862967-2 devstack@n-api.service[127125]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 29 02:52:18.753277 n-d-862967-2 devstack@n-api.service[127125]: action_args: {} Oct 29 02:52:18.753277 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:52:18.754265 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:18.754265 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:18.754265 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:18.754265 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:52:18.754265 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:52:18.754265 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:52:18.754265 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:52:18.754265 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:52:18.754265 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:52:18.754265 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 29 02:52:18.754265 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 29 02:52:18.754265 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 29 02:52:18.754265 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 29 02:52:18.754265 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:52:18.754265 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:52:18.754265 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:52:18.754265 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:52:18.754265 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:52:18.754265 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:52:18.755744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:52:18.755744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:52:18.755744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:52:18.755744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:52:18.755744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:52:18.755744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:52:18.755744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:52:18.755744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:52:18.755744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 29 02:52:18.755744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:18.755744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:18.755744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:18.755744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:18.755744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:18.755744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:18.755744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:52:18.755744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:52:18.755744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 29 02:52:18.755744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:18.763702 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ac9af1f5-9ea1-4f34-b416-d0e29a04cb24 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:18.764581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bdbd6e04-134c-48c9-a1f2-a073faa33280 tempest-HypervisorAdminNegativeTestJSON-1264988897 tempest-HypervisorAdminNegativeTestJSON-1264988897-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:52:18.768116 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ac9af1f5-9ea1-4f34-b416-d0e29a04cb24 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:18.771428 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bdbd6e04-134c-48c9-a1f2-a073faa33280 tempest-HypervisorAdminNegativeTestJSON-1264988897 tempest-HypervisorAdminNegativeTestJSON-1264988897-project] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.038753 Oct 29 02:52:18.771661 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ac9af1f5-9ea1-4f34-b416-d0e29a04cb24 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1488 microversion: 2.25 time: 0.829987 Oct 29 02:52:18.772342 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 701/1485] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:52:18 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:52:18.788665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f151fef8-d1a4-499b-a041-9114acf216ea tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05385b430>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:18.789863 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 785/1486] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:17 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1488 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:18.810179 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-03cd2ba9-6d51-4eb9-a7bb-08b196ecb742 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:18.810949 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-03cd2ba9-6d51-4eb9-a7bb-08b196ecb742 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 500595ea-1c83-4574-b6c8-2d6cc39b2231] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:18.818882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03cd2ba9-6d51-4eb9-a7bb-08b196ecb742 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:18.819405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03cd2ba9-6d51-4eb9-a7bb-08b196ecb742 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:18.819972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03cd2ba9-6d51-4eb9-a7bb-08b196ecb742 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:18.821348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03cd2ba9-6d51-4eb9-a7bb-08b196ecb742 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:18.822001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03cd2ba9-6d51-4eb9-a7bb-08b196ecb742 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:18.822860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03cd2ba9-6d51-4eb9-a7bb-08b196ecb742 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:18.903047 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f151fef8-d1a4-499b-a041-9114acf216ea tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/fdfde304-89aa-4f56-9a3c-38c9c906de34" status: 200 len: 662 microversion: 2.1 time: 0.126650 Oct 29 02:52:18.908098 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 702/1487] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:52:18 2022] GET /compute/v2.1/images/fdfde304-89aa-4f56-9a3c-38c9c906de34 => generated 662 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:18.928463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5eabeef8-ca21-48b1-8f40-b40ca1eb0232 tempest-FloatingIPDetailsTestJSON-436725891 tempest-FloatingIPDetailsTestJSON-436725891-project] Action: 'create', calling method: .version_select at 0x7ff053816430>, body: {"pool": null} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:19.734538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-03cd2ba9-6d51-4eb9-a7bb-08b196ecb742 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:19.758145 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-03cd2ba9-6d51-4eb9-a7bb-08b196ecb742 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231" status: 200 len: 1312 microversion: 2.1 time: 0.966869 Oct 29 02:52:19.759396 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 786/1488] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:18 2022] GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231 => generated 1312 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:19.770042 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-00f9de2d-dbda-4bf7-ad05-aa777f0dfc26 tempest-HypervisorAdminNegativeTestJSON-1264988897 tempest-HypervisorAdminNegativeTestJSON-1264988897-project] Calling method '.version_select at 0x7ff053aacf70>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:19.783674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-00f9de2d-dbda-4bf7-ad05-aa777f0dfc26 tempest-HypervisorAdminNegativeTestJSON-1264988897 tempest-HypervisorAdminNegativeTestJSON-1264988897-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '9cd240f57fca4132a4fec655209013b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32601dc3684e4d19b8049ed1ff0d1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:19.793771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-00f9de2d-dbda-4bf7-ad05-aa777f0dfc26 tempest-HypervisorAdminNegativeTestJSON-1264988897 tempest-HypervisorAdminNegativeTestJSON-1264988897-project] Request method failure captured: Oct 29 02:52:19.793771 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 29 02:52:19.793771 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:52:19.793771 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:52:19.793771 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:52:19.793771 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:52:19.793771 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:52:19.793771 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:52:19.793771 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:52:19.793771 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:52:19.793771 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJVcVIHhcNx2Pxh35M3fb2AyCngAMCC8nY_jeeCET3YVuA1o1lnn6dBSWYpSQWsxoK8t1wKB1rjso934BK_Fjl8tR0DqaDk0fWZOQOepWVqJPzuDr9LsZ57btprjSBjn1mi-tnGKemhL-pyAvnpI3JFyMhOlemL6gpUv6fXY67l821Y Oct 29 02:52:19.793771 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:52:19.793771 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:52:19.793771 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:52:19.793771 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:52:19.793771 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:52:19.793771 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:52:19.793771 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 32601dc3684e4d19b8049ed1ff0d1fb8 Oct 29 02:52:19.793771 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1264988897 Oct 29 02:52:19.793771 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:52:19.793771 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:52:19.796086 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/32601dc3684e4d19b8049ed1ff0d1fb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/32601dc3684e4d19b8049ed1ff0d1fb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_32601dc3684e4d19b8049ed1ff0d1fb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/32601dc3684e4d19b8049ed1ff0d1fb8"}]}] Oct 29 02:52:19.796086 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1264988897 Oct 29 02:52:19.796086 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 32601dc3684e4d19b8049ed1ff0d1fb8 Oct 29 02:52:19.796086 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1264988897 Oct 29 02:52:19.796086 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-HypervisorAdminNegativeTestJSON-1264988897-project Oct 29 02:52:19.796086 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:52:19.796086 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:52:19.796086 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 9cd240f57fca4132a4fec655209013b8 Oct 29 02:52:19.796086 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1264988897-project Oct 29 02:52:19.796086 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:52:19.796086 n-d-862967-2 devstack@n-api.service[127124]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 29 02:52:19.796086 n-d-862967-2 devstack@n-api.service[127124]: action_args: {} Oct 29 02:52:19.796086 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:52:19.797152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:19.797152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:19.797152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:19.797152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:52:19.797152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:52:19.797152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:52:19.797152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:52:19.797152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:52:19.797152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:52:19.797152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 29 02:52:19.797152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 29 02:52:19.797152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:52:19.797152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:52:19.797152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:52:19.797152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:52:19.797152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:52:19.797152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:52:19.797152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:52:19.797152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:52:19.798774 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:52:19.798774 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:52:19.798774 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:52:19.798774 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:52:19.798774 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:52:19.798774 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:52:19.798774 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 29 02:52:19.798774 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:19.798774 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:19.798774 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:19.798774 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:19.798774 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:19.798774 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:19.798774 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:52:19.798774 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:52:19.798774 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 29 02:52:19.798774 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:19.805674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-00f9de2d-dbda-4bf7-ad05-aa777f0dfc26 tempest-HypervisorAdminNegativeTestJSON-1264988897 tempest-HypervisorAdminNegativeTestJSON-1264988897-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:52:19.805674 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-00f9de2d-dbda-4bf7-ad05-aa777f0dfc26 tempest-HypervisorAdminNegativeTestJSON-1264988897 tempest-HypervisorAdminNegativeTestJSON-1264988897-project] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.043512 Oct 29 02:52:19.821107 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 787/1489] 10.222.0.46 () {58 vars in 1179 bytes} [Sat Oct 29 02:52:19 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 61 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:52:20.650750 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f786780d-c71d-41ef-997f-b67fc6ef06a8 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1577467806", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "7d09e4fd-daa6-4666-b2a9-bd7f00ae0bc8"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:20.751155 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-f786780d-c71d-41ef-997f-b67fc6ef06a8 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] validate_networks() for [('7d09e4fd-daa6-4666-b2a9-bd7f00ae0bc8', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:52:21.499688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-f786780d-c71d-41ef-997f-b67fc6ef06a8 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:52:21.500511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-f786780d-c71d-41ef-997f-b67fc6ef06a8 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:52:21.501447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-f786780d-c71d-41ef-997f-b67fc6ef06a8 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:52:21.502079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-f786780d-c71d-41ef-997f-b67fc6ef06a8 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:52:21.502666 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-f786780d-c71d-41ef-997f-b67fc6ef06a8 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:52:21.516012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f786780d-c71d-41ef-997f-b67fc6ef06a8 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:21.516783 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f786780d-c71d-41ef-997f-b67fc6ef06a8 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:21.517737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f786780d-c71d-41ef-997f-b67fc6ef06a8 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:21.518867 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f786780d-c71d-41ef-997f-b67fc6ef06a8 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:21.519872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f786780d-c71d-41ef-997f-b67fc6ef06a8 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:21.520930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f786780d-c71d-41ef-997f-b67fc6ef06a8 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:21.549981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-f786780d-c71d-41ef-997f-b67fc6ef06a8 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Getting quotas for project 449eab5d48df46be8b15f1094286b0d7. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:52:21.558459 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-f786780d-c71d-41ef-997f-b67fc6ef06a8 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Getting quotas for user 2cdc8abe2dbf4479b2bd859c37bb204a and project 449eab5d48df46be8b15f1094286b0d7. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:52:21.573940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f786780d-c71d-41ef-997f-b67fc6ef06a8 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:52:21.576504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f786780d-c71d-41ef-997f-b67fc6ef06a8 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] [instance: 1a47d89b-54a0-40a2-9572-c88ee55e6b5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:52:21.689800 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f786780d-c71d-41ef-997f-b67fc6ef06a8 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.867168 Oct 29 02:52:21.695239 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 788/1490] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:52:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:52:21.913991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dba0ac0d-da5f-42f0-9b34-6b7e73931704 tempest-FlavorsV2NegativeTest-397449591 tempest-FlavorsV2NegativeTest-397449591-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:21.938672 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dba0ac0d-da5f-42f0-9b34-6b7e73931704 tempest-FlavorsV2NegativeTest-397449591 tempest-FlavorsV2NegativeTest-397449591-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.238064 Oct 29 02:52:21.946246 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 789/1491] 10.222.0.46 () {58 vars in 1137 bytes} [Sat Oct 29 02:52:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:22.330912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-560cd695-83ac-4f84-af96-b4fdc72124e8 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] Calling method '.version_select at 0x7ff053a50f70>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:22.341702 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-560cd695-83ac-4f84-af96-b4fdc72124e8 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:22.342471 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-560cd695-83ac-4f84-af96-b4fdc72124e8 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:22.343617 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-560cd695-83ac-4f84-af96-b4fdc72124e8 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:22.427452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-560cd695-83ac-4f84-af96-b4fdc72124e8 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:22.427955 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-560cd695-83ac-4f84-af96-b4fdc72124e8 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:22.428394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-560cd695-83ac-4f84-af96-b4fdc72124e8 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:22.479390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-560cd695-83ac-4f84-af96-b4fdc72124e8 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:22.480432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-560cd695-83ac-4f84-af96-b4fdc72124e8 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:22.481983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-560cd695-83ac-4f84-af96-b4fdc72124e8 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:22.496276 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-560cd695-83ac-4f84-af96-b4fdc72124e8 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.548513 Oct 29 02:52:22.501953 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 790/1492] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:52:21 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:22.553049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e4861702-ff68-4358-8ae1-54f1e1d9677f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:22.555017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e4861702-ff68-4358-8ae1-54f1e1d9677f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:22.578048 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e4861702-ff68-4358-8ae1-54f1e1d9677f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:22.579930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e4861702-ff68-4358-8ae1-54f1e1d9677f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:22.580588 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e4861702-ff68-4358-8ae1-54f1e1d9677f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:22.583945 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e4861702-ff68-4358-8ae1-54f1e1d9677f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:22.585121 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e4861702-ff68-4358-8ae1-54f1e1d9677f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:22.589278 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e4861702-ff68-4358-8ae1-54f1e1d9677f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:22.990711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e4861702-ff68-4358-8ae1-54f1e1d9677f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:23.007505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e4861702-ff68-4358-8ae1-54f1e1d9677f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:23.010607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e4861702-ff68-4358-8ae1-54f1e1d9677f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:23.014451 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e4861702-ff68-4358-8ae1-54f1e1d9677f tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1488 microversion: 2.25 time: 0.500689 Oct 29 02:52:23.036422 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 791/1493] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:22 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1488 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:23.050550 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-27884241-5e13-4c16-b718-dac5bcbde4a1 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:23.052149 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-27884241-5e13-4c16-b718-dac5bcbde4a1 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 500595ea-1c83-4574-b6c8-2d6cc39b2231] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:23.088488 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27884241-5e13-4c16-b718-dac5bcbde4a1 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:23.089016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27884241-5e13-4c16-b718-dac5bcbde4a1 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:23.091339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27884241-5e13-4c16-b718-dac5bcbde4a1 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:23.093322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27884241-5e13-4c16-b718-dac5bcbde4a1 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:23.094194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27884241-5e13-4c16-b718-dac5bcbde4a1 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:23.094721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27884241-5e13-4c16-b718-dac5bcbde4a1 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:23.485233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-27884241-5e13-4c16-b718-dac5bcbde4a1 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:23.494201 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-27884241-5e13-4c16-b718-dac5bcbde4a1 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231" status: 200 len: 1333 microversion: 2.1 time: 0.455112 Oct 29 02:52:23.496491 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 792/1494] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:23 2022] GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231 => generated 1333 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:23.507357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-470caab4-8bbc-4746-ad38-25487bc1d0ec tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff053a50430>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:23.682590 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-470caab4-8bbc-4746-ad38-25487bc1d0ec tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/dcaad93a-4b7b-4204-9231-a63bb5cfaf19" status: 200 len: 660 microversion: 2.1 time: 0.184619 Oct 29 02:52:23.696511 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 793/1495] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:52:23 2022] GET /compute/v2.1/images/dcaad93a-4b7b-4204-9231-a63bb5cfaf19 => generated 660 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:23.705627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e873e089-e611-4745-87fa-d860c4393df1 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:23.707143 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e873e089-e611-4745-87fa-d860c4393df1 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] [instance: 1a47d89b-54a0-40a2-9572-c88ee55e6b5e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:23.720172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e873e089-e611-4745-87fa-d860c4393df1 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:23.721137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e873e089-e611-4745-87fa-d860c4393df1 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:23.721829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e873e089-e611-4745-87fa-d860c4393df1 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:23.722879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e873e089-e611-4745-87fa-d860c4393df1 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:23.723582 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e873e089-e611-4745-87fa-d860c4393df1 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:23.724265 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e873e089-e611-4745-87fa-d860c4393df1 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:23.839911 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e873e089-e611-4745-87fa-d860c4393df1 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cdc8abe2dbf4479b2bd859c37bb204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449eab5d48df46be8b15f1094286b0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:23.852299 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e873e089-e611-4745-87fa-d860c4393df1 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] 10.222.0.46 "GET /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e" status: 200 len: 1268 microversion: 2.1 time: 0.154270 Oct 29 02:52:23.853704 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 794/1496] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:23 2022] GET /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:23.864827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a3e8faa9-3f9d-46be-a74c-9b1095f0a126 tempest-HypervisorAdminNegativeTestJSON-1264988897 tempest-HypervisorAdminNegativeTestJSON-1264988897-project] Calling method '.version_select at 0x7ff0586d2820>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:23.870005 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a3e8faa9-3f9d-46be-a74c-9b1095f0a126 tempest-HypervisorAdminNegativeTestJSON-1264988897 tempest-HypervisorAdminNegativeTestJSON-1264988897-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '9cd240f57fca4132a4fec655209013b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32601dc3684e4d19b8049ed1ff0d1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:23.873244 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a3e8faa9-3f9d-46be-a74c-9b1095f0a126 tempest-HypervisorAdminNegativeTestJSON-1264988897 tempest-HypervisorAdminNegativeTestJSON-1264988897-project] Request method failure captured: Oct 29 02:52:23.873244 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 29 02:52:23.873244 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:52:23.873244 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:52:23.873244 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:52:23.873244 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:52:23.873244 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:52:23.873244 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:52:23.873244 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:52:23.873244 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:52:23.873244 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJVcVIHhcNx2Pxh35M3fb2AyCngAMCC8nY_jeeCET3YVuA1o1lnn6dBSWYpSQWsxoK8t1wKB1rjso934BK_Fjl8tR0DqaDk0fWZOQOepWVqJPzuDr9LsZ57btprjSBjn1mi-tnGKemhL-pyAvnpI3JFyMhOlemL6gpUv6fXY67l821Y Oct 29 02:52:23.873244 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:52:23.873244 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:52:23.873244 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:52:23.873244 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:52:23.873244 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:52:23.873244 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:52:23.873244 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 32601dc3684e4d19b8049ed1ff0d1fb8 Oct 29 02:52:23.873244 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1264988897 Oct 29 02:52:23.873244 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:52:23.873244 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:52:23.874943 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/32601dc3684e4d19b8049ed1ff0d1fb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/32601dc3684e4d19b8049ed1ff0d1fb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_32601dc3684e4d19b8049ed1ff0d1fb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/32601dc3684e4d19b8049ed1ff0d1fb8"}]}] Oct 29 02:52:23.874943 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1264988897 Oct 29 02:52:23.874943 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 32601dc3684e4d19b8049ed1ff0d1fb8 Oct 29 02:52:23.874943 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1264988897 Oct 29 02:52:23.874943 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-HypervisorAdminNegativeTestJSON-1264988897-project Oct 29 02:52:23.874943 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:52:23.874943 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:52:23.874943 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 9cd240f57fca4132a4fec655209013b8 Oct 29 02:52:23.874943 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1264988897-project Oct 29 02:52:23.874943 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:52:23.874943 n-d-862967-2 devstack@n-api.service[127124]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 29 02:52:23.874943 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '1'} Oct 29 02:52:23.874943 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:52:23.875962 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:23.875962 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:23.875962 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:23.875962 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:52:23.875962 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:52:23.875962 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:52:23.875962 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:52:23.875962 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:52:23.875962 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:52:23.875962 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 29 02:52:23.875962 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 29 02:52:23.875962 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:52:23.875962 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:52:23.875962 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:52:23.875962 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:52:23.875962 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:52:23.875962 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:52:23.875962 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:52:23.875962 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:52:23.877706 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:52:23.877706 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:52:23.877706 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:52:23.877706 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:52:23.877706 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:52:23.877706 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:52:23.877706 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 29 02:52:23.877706 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:23.877706 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:23.877706 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:23.877706 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:23.877706 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:23.877706 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:23.877706 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:52:23.877706 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:52:23.877706 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 29 02:52:23.877706 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:23.881176 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a3e8faa9-3f9d-46be-a74c-9b1095f0a126 tempest-HypervisorAdminNegativeTestJSON-1264988897 tempest-HypervisorAdminNegativeTestJSON-1264988897-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:52:23.882250 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a3e8faa9-3f9d-46be-a74c-9b1095f0a126 tempest-HypervisorAdminNegativeTestJSON-1264988897 tempest-HypervisorAdminNegativeTestJSON-1264988897-project] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.027098 Oct 29 02:52:23.886394 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 795/1497] 10.222.0.46 () {58 vars in 1173 bytes} [Sat Oct 29 02:52:23 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:52:23.894642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-86749b6f-40de-49d9-843d-0f3318ab2bba tempest-FlavorsV2NegativeTest-397449591 tempest-FlavorsV2NegativeTest-397449591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1332166959", "imageRef": "2e12aad9-ae5c-4bc6-b66f-077dbde10efb", "flavorRef": "452"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:23.977755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-86749b6f-40de-49d9-843d-0f3318ab2bba tempest-FlavorsV2NegativeTest-397449591 tempest-FlavorsV2NegativeTest-397449591-project] validate_networks() for None {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:52:24.388986 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-86749b6f-40de-49d9-843d-0f3318ab2bba tempest-FlavorsV2NegativeTest-397449591 tempest-FlavorsV2NegativeTest-397449591-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 29 02:52:24.390728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-86749b6f-40de-49d9-843d-0f3318ab2bba tempest-FlavorsV2NegativeTest-397449591 tempest-FlavorsV2NegativeTest-397449591-project] Request method failure captured: Oct 29 02:52:24.390728 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:52:24.390728 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:52:24.390728 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:52:24.390728 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:52:24.390728 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 143 Oct 29 02:52:24.390728 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:52:24.390728 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:52:24.390728 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:52:24.390728 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:52:24.390728 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJVjWm-akjZpAFw0mmFF_oi_NejK7Y_mLkUAO-NmaAZL6vv_vbwYEdtCH0Eo1AB6bODhKGNPTqg5V-GkZk7VU6YPLWiRMWNEoJ1qC-VetpDGzCcLnBrjLRdI4yraoDMz2jjp0z4cpB5eFkV2ADromZn3amm2n_iUSLhCskVDbXv9Qs0 Oct 29 02:52:24.390728 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:52:24.390728 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:52:24.390728 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:52:24.390728 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:52:24.390728 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:52:24.390728 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:52:24.390728 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 660bfdc3580b4c2ca9ea22c1e7b120a6 Oct 29 02:52:24.390728 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-FlavorsV2NegativeTest-397449591 Oct 29 02:52:24.390728 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:52:24.390728 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:52:24.392338 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/660bfdc3580b4c2ca9ea22c1e7b120a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/660bfdc3580b4c2ca9ea22c1e7b120a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_660bfdc3580b4c2ca9ea22c1e7b120a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/660bfdc3580b4c2ca9ea22c1e7b120a6"}]}] Oct 29 02:52:24.392338 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-FlavorsV2NegativeTest-397449591 Oct 29 02:52:24.392338 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 660bfdc3580b4c2ca9ea22c1e7b120a6 Oct 29 02:52:24.392338 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-397449591 Oct 29 02:52:24.392338 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-FlavorsV2NegativeTest-397449591-project Oct 29 02:52:24.392338 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:52:24.392338 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:52:24.392338 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: eb9f194788d4438dabe8489c33cc8467 Oct 29 02:52:24.392338 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-FlavorsV2NegativeTest-397449591-project Oct 29 02:52:24.392338 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:52:24.392338 n-d-862967-2 devstack@n-api.service[127124]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1332166959", "imageRef": "2e12aad9-ae5c-4bc6-b66f-077dbde10efb", "flavorRef": "452"}} Oct 29 02:52:24.392338 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:52:24.397163 n-d-862967-2 devstack@n-api.service[127124]: exception: Flavor's memory is too small for requested image. Oct 29 02:52:24.397163 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1332166959', 'imageRef': '2e12aad9-ae5c-4bc6-b66f-077dbde10efb', 'flavorRef': '452'}}} Oct 29 02:52:24.397163 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:52:24.397163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:24.397163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 02:52:24.397163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 02:52:24.397163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 02:52:24.397163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 02:52:24.397163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 29 02:52:24.397163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 29 02:52:24.397163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 29 02:52:24.397163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 29 02:52:24.397163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 29 02:52:24.397163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 29 02:52:24.397163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 29 02:52:24.397163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 29 02:52:24.397163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 29 02:52:24.397163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:24.397163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:24.397163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:24.398859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:24.398859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:24.398859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:24.398859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:52:24.398859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:52:24.398859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:52:24.398859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:52:24.398859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:52:24.398859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:52:24.398859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:52:24.398859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:52:24.398859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:52:24.398859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:52:24.398859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 02:52:24.398859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 29 02:52:24.398859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 29 02:52:24.398859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 29 02:52:24.398859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:24.398859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:24.398859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:24.398859 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:24.401045 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:24.401045 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:24.401045 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:52:24.401045 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:52:24.401045 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 29 02:52:24.401045 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:24.401045 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-86749b6f-40de-49d9-843d-0f3318ab2bba tempest-FlavorsV2NegativeTest-397449591 tempest-FlavorsV2NegativeTest-397449591-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:52:24.401045 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-86749b6f-40de-49d9-843d-0f3318ab2bba tempest-FlavorsV2NegativeTest-397449591 tempest-FlavorsV2NegativeTest-397449591-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.504365 Oct 29 02:52:24.401045 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 796/1498] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:52:23 2022] POST /compute/v2.1/servers => generated 93 bytes in 506 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 02:52:24.402774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8a7c6fe6-aa10-46ed-9fc9-5a8a758081bd tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff053a533a0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:24.512407 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8a7c6fe6-aa10-46ed-9fc9-5a8a758081bd tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/dcaad93a-4b7b-4204-9231-a63bb5cfaf19" status: 200 len: 660 microversion: 2.1 time: 0.118288 Oct 29 02:52:24.513022 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 797/1499] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:52:24 2022] GET /compute/v2.1/images/dcaad93a-4b7b-4204-9231-a63bb5cfaf19 => generated 660 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:24.517778 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d0b1621d-72c8-4b7c-a36a-2fd710e0e259 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] Calling method '.version_select at 0x7ff0580825e0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:24.530284 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-d0b1621d-72c8-4b7c-a36a-2fd710e0e259 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] HTTP exception thrown: Hypervisor with ID 'c3efbf02-6180-4a63-93f4-554b5b508b8c' could not be found. Oct 29 02:52:24.559329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d0b1621d-72c8-4b7c-a36a-2fd710e0e259 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] Request method failure captured: Oct 29 02:52:24.559329 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/os-hypervisors/c3efbf02-6180-4a63-93f4-554b5b508b8c/uptime HTTP/1.1 Oct 29 02:52:24.559329 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:52:24.559329 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:52:24.559329 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:52:24.559329 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:52:24.559329 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:52:24.559329 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:52:24.559329 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:52:24.559329 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:52:24.559329 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJVeQytHvKHILuN2DjRsU3J4f-I6Mk9l_o1XcYTXKiFkSsEr7v98-01GYYv8IpTXA7DNw_7bicy5-TYcLaZSt3AONy4NMobA40gnsv58b7QjZl_6DEyI28TepD3kyuebSwQ7qhnFmtELgUmn3I_zX5uVEkRDwrkz88ngd-ddGXTTN_0 Oct 29 02:52:24.559329 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:52:24.559329 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:52:24.559329 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:52:24.559329 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:52:24.559329 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:52:24.559329 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:52:24.559329 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 21d821fe0c024a95bb4e13f4339ee684 Oct 29 02:52:24.559329 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-829611650 Oct 29 02:52:24.559329 n-d-862967-2 devstack@n-api.service[127124]: X-Role: admin,reader,member Oct 29 02:52:24.559329 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: admin,reader,member Oct 29 02:52:24.562557 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/21d821fe0c024a95bb4e13f4339ee684"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/21d821fe0c024a95bb4e13f4339ee684"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_21d821fe0c024a95bb4e13f4339ee684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/21d821fe0c024a95bb4e13f4339ee684"}]}] Oct 29 02:52:24.562557 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-829611650 Oct 29 02:52:24.562557 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 21d821fe0c024a95bb4e13f4339ee684 Oct 29 02:52:24.562557 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-829611650 Oct 29 02:52:24.562557 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin Oct 29 02:52:24.562557 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:52:24.562557 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:52:24.562557 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: ff5c70bb50544b69802c054b33511487 Oct 29 02:52:24.562557 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin Oct 29 02:52:24.562557 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:52:24.562557 n-d-862967-2 devstack@n-api.service[127124]: exception: Hypervisor with ID 'c3efbf02-6180-4a63-93f4-554b5b508b8c' could not be found. Oct 29 02:52:24.562557 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'c3efbf02-6180-4a63-93f4-554b5b508b8c'} Oct 29 02:52:24.564177 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:52:24.564177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:24.564177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 29 02:52:24.564177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 29 02:52:24.564177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'c3efbf02-6180-4a63-93f4-554b5b508b8c' Oct 29 02:52:24.564177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:24.564177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:24.564177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:24.564177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:24.564177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 29 02:52:24.564177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 29 02:52:24.564177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 29 02:52:24.564177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 29 02:52:24.564177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 29 02:52:24.564177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:24.564177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:24.564177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:24.564177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:24.564177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 29 02:52:24.564177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 29 02:52:24.564177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 29 02:52:24.564177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 29 02:52:24.567052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 29 02:52:24.567052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:24.567052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:24.567052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:24.567052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:24.567052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:24.567052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:24.567052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:52:24.567052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:52:24.567052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:52:24.567052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:52:24.567052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:52:24.567052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:52:24.567052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 29 02:52:24.567052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 29 02:52:24.567052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 29 02:52:24.567052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 02:52:24.567052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'c3efbf02-6180-4a63-93f4-554b5b508b8c' could not be found. Oct 29 02:52:24.567052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:24.567052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:24.567052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:24.572429 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:24.572429 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:24.572429 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:24.572429 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:52:24.572429 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:52:24.572429 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'c3efbf02-6180-4a63-93f4-554b5b508b8c' could not be found. Oct 29 02:52:24.572429 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:24.572429 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d0b1621d-72c8-4b7c-a36a-2fd710e0e259 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] Returning 404 to user: Hypervisor with ID 'c3efbf02-6180-4a63-93f4-554b5b508b8c' could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:52:24.572429 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d0b1621d-72c8-4b7c-a36a-2fd710e0e259 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/c3efbf02-6180-4a63-93f4-554b5b508b8c/uptime" status: 404 len: 123 microversion: 2.1 time: 0.054028 Oct 29 02:52:24.579009 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 798/1500] 10.222.0.46 () {58 vars in 1278 bytes} [Sat Oct 29 02:52:24 2022] GET /compute/v2.1/os-hypervisors/c3efbf02-6180-4a63-93f4-554b5b508b8c/uptime => generated 123 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:52:24.603136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c236aeef-fbb9-4b7b-bc19-ee4ba62cac58 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:24.607870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c236aeef-fbb9-4b7b-bc19-ee4ba62cac58 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:24.635387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c236aeef-fbb9-4b7b-bc19-ee4ba62cac58 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:24.640773 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c236aeef-fbb9-4b7b-bc19-ee4ba62cac58 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:24.641812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c236aeef-fbb9-4b7b-bc19-ee4ba62cac58 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:24.643609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c236aeef-fbb9-4b7b-bc19-ee4ba62cac58 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:24.650181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c236aeef-fbb9-4b7b-bc19-ee4ba62cac58 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:24.651529 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c236aeef-fbb9-4b7b-bc19-ee4ba62cac58 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:25.045204 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c236aeef-fbb9-4b7b-bc19-ee4ba62cac58 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:25.056348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c236aeef-fbb9-4b7b-bc19-ee4ba62cac58 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:25.085754 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c236aeef-fbb9-4b7b-bc19-ee4ba62cac58 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:25.088496 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c236aeef-fbb9-4b7b-bc19-ee4ba62cac58 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1488 microversion: 2.25 time: 0.506403 Oct 29 02:52:25.124329 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 799/1501] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:24 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1488 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:25.150366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f71d6675-ab91-4f04-8b90-a2f0dd14f82d tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:25.151021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f71d6675-ab91-4f04-8b90-a2f0dd14f82d tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 500595ea-1c83-4574-b6c8-2d6cc39b2231] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:25.178438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f71d6675-ab91-4f04-8b90-a2f0dd14f82d tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:25.180823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f71d6675-ab91-4f04-8b90-a2f0dd14f82d tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:25.188909 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f71d6675-ab91-4f04-8b90-a2f0dd14f82d tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:25.191577 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f71d6675-ab91-4f04-8b90-a2f0dd14f82d tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:25.192062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f71d6675-ab91-4f04-8b90-a2f0dd14f82d tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:25.193757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f71d6675-ab91-4f04-8b90-a2f0dd14f82d tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:25.485518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f71d6675-ab91-4f04-8b90-a2f0dd14f82d tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:25.503688 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f71d6675-ab91-4f04-8b90-a2f0dd14f82d tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231" status: 200 len: 1333 microversion: 2.1 time: 0.377867 Oct 29 02:52:25.511784 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 800/1502] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:25 2022] GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231 => generated 1333 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:25.517303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cf20e8d5-98c7-40ae-9590-7a2db0526de7 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] Calling method '.version_select at 0x7ff053d71820>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:25.530184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf20e8d5-98c7-40ae-9590-7a2db0526de7 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:25.530910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf20e8d5-98c7-40ae-9590-7a2db0526de7 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:25.531406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf20e8d5-98c7-40ae-9590-7a2db0526de7 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:25.597423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf20e8d5-98c7-40ae-9590-7a2db0526de7 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:25.597423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf20e8d5-98c7-40ae-9590-7a2db0526de7 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:25.597423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf20e8d5-98c7-40ae-9590-7a2db0526de7 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:25.643519 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf20e8d5-98c7-40ae-9590-7a2db0526de7 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:25.644025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf20e8d5-98c7-40ae-9590-7a2db0526de7 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:25.644551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf20e8d5-98c7-40ae-9590-7a2db0526de7 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:25.663861 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:25.674945 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cf20e8d5-98c7-40ae-9590-7a2db0526de7 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.161094 Oct 29 02:52:25.676429 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 801/1503] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:52:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:25.692944 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-30488879-5790-40d1-b296-5a7c9e87193f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1528107611", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:25.820933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-30488879-5790-40d1-b296-5a7c9e87193f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] validate_networks() for None {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:52:26.453537 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-30488879-5790-40d1-b296-5a7c9e87193f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:52:26.453957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-30488879-5790-40d1-b296-5a7c9e87193f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:52:26.454429 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-30488879-5790-40d1-b296-5a7c9e87193f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:52:26.454882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-30488879-5790-40d1-b296-5a7c9e87193f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:52:26.455293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-30488879-5790-40d1-b296-5a7c9e87193f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:52:26.493806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30488879-5790-40d1-b296-5a7c9e87193f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:26.498421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30488879-5790-40d1-b296-5a7c9e87193f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:26.500640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30488879-5790-40d1-b296-5a7c9e87193f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:26.504997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30488879-5790-40d1-b296-5a7c9e87193f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:26.505851 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30488879-5790-40d1-b296-5a7c9e87193f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:26.506459 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30488879-5790-40d1-b296-5a7c9e87193f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:26.563408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-30488879-5790-40d1-b296-5a7c9e87193f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Getting quotas for project f3b7aa3004d94c5a8cf87d5f4d006a73. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:52:26.574755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-30488879-5790-40d1-b296-5a7c9e87193f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Getting quotas for user 844dbc8e54d349ea93c632c54909a718 and project f3b7aa3004d94c5a8cf87d5f4d006a73. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:52:26.610999 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-30488879-5790-40d1-b296-5a7c9e87193f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:52:26.615811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-30488879-5790-40d1-b296-5a7c9e87193f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:52:26.788622 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-30488879-5790-40d1-b296-5a7c9e87193f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.110739 Oct 29 02:52:26.822131 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 802/1504] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:52:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:52:26.855490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-38642d66-af39-4f22-99e6-1d2cb773190b tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:26.856408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-38642d66-af39-4f22-99e6-1d2cb773190b tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] [instance: 1a47d89b-54a0-40a2-9572-c88ee55e6b5e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:26.879902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38642d66-af39-4f22-99e6-1d2cb773190b tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:26.883184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38642d66-af39-4f22-99e6-1d2cb773190b tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:26.883348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38642d66-af39-4f22-99e6-1d2cb773190b tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:26.896841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38642d66-af39-4f22-99e6-1d2cb773190b tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:26.897416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38642d66-af39-4f22-99e6-1d2cb773190b tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:26.897859 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38642d66-af39-4f22-99e6-1d2cb773190b tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:27.111146 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-38642d66-af39-4f22-99e6-1d2cb773190b tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cdc8abe2dbf4479b2bd859c37bb204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449eab5d48df46be8b15f1094286b0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:27.139447 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-38642d66-af39-4f22-99e6-1d2cb773190b tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] 10.222.0.46 "GET /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e" status: 200 len: 1274 microversion: 2.1 time: 0.313438 Oct 29 02:52:27.152840 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 803/1505] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:26 2022] GET /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e => generated 1274 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:27.177255 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f07567c5-41b8-475b-8649-b198089a5050 tempest-HypervisorAdminNegativeTestJSON-1264988897 tempest-HypervisorAdminNegativeTestJSON-1264988897-project] Calling method '.version_select at 0x7ff053a50ee0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:27.191950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f07567c5-41b8-475b-8649-b198089a5050 tempest-HypervisorAdminNegativeTestJSON-1264988897 tempest-HypervisorAdminNegativeTestJSON-1264988897-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '9cd240f57fca4132a4fec655209013b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32601dc3684e4d19b8049ed1ff0d1fb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:27.212322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f07567c5-41b8-475b-8649-b198089a5050 tempest-HypervisorAdminNegativeTestJSON-1264988897 tempest-HypervisorAdminNegativeTestJSON-1264988897-project] Request method failure captured: Oct 29 02:52:27.212322 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 29 02:52:27.212322 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:52:27.212322 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:52:27.212322 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:52:27.212322 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:52:27.212322 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:52:27.212322 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:52:27.212322 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:52:27.212322 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:52:27.212322 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJVcVIHhcNx2Pxh35M3fb2AyCngAMCC8nY_jeeCET3YVuA1o1lnn6dBSWYpSQWsxoK8t1wKB1rjso934BK_Fjl8tR0DqaDk0fWZOQOepWVqJPzuDr9LsZ57btprjSBjn1mi-tnGKemhL-pyAvnpI3JFyMhOlemL6gpUv6fXY67l821Y Oct 29 02:52:27.212322 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:52:27.212322 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:52:27.212322 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:52:27.212322 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:52:27.212322 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:52:27.212322 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:52:27.212322 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 32601dc3684e4d19b8049ed1ff0d1fb8 Oct 29 02:52:27.212322 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1264988897 Oct 29 02:52:27.212322 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:52:27.212322 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:52:27.213892 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/32601dc3684e4d19b8049ed1ff0d1fb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/32601dc3684e4d19b8049ed1ff0d1fb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_32601dc3684e4d19b8049ed1ff0d1fb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/32601dc3684e4d19b8049ed1ff0d1fb8"}]}] Oct 29 02:52:27.213892 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1264988897 Oct 29 02:52:27.213892 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 32601dc3684e4d19b8049ed1ff0d1fb8 Oct 29 02:52:27.213892 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1264988897 Oct 29 02:52:27.213892 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-HypervisorAdminNegativeTestJSON-1264988897-project Oct 29 02:52:27.213892 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:52:27.213892 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:52:27.213892 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 9cd240f57fca4132a4fec655209013b8 Oct 29 02:52:27.213892 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1264988897-project Oct 29 02:52:27.213892 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:52:27.213892 n-d-862967-2 devstack@n-api.service[127124]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 29 02:52:27.213892 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '1'} Oct 29 02:52:27.213892 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:52:27.214758 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:27.214758 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:27.214758 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:27.214758 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:52:27.214758 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:52:27.214758 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:52:27.214758 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:52:27.214758 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:52:27.214758 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:52:27.214758 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 29 02:52:27.214758 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 29 02:52:27.214758 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 29 02:52:27.214758 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 29 02:52:27.214758 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:52:27.214758 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:52:27.214758 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:52:27.214758 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:52:27.214758 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:52:27.214758 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:52:27.215969 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:52:27.215969 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:52:27.215969 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:52:27.215969 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:52:27.215969 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:52:27.215969 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:52:27.215969 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:52:27.215969 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:52:27.215969 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 29 02:52:27.215969 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:27.215969 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:27.215969 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:27.215969 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:27.215969 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:27.215969 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:27.215969 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:52:27.215969 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:52:27.215969 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 29 02:52:27.215969 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:27.217223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f07567c5-41b8-475b-8649-b198089a5050 tempest-HypervisorAdminNegativeTestJSON-1264988897 tempest-HypervisorAdminNegativeTestJSON-1264988897-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:52:27.220818 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f07567c5-41b8-475b-8649-b198089a5050 tempest-HypervisorAdminNegativeTestJSON-1264988897 tempest-HypervisorAdminNegativeTestJSON-1264988897-project] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.057255 Oct 29 02:52:27.221471 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 804/1506] 10.222.0.46 () {58 vars in 1152 bytes} [Sat Oct 29 02:52:27 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 68 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:52:27.240228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7faac215-edab-4387-9179-e3428f0340fa tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:27.240877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7faac215-edab-4387-9179-e3428f0340fa tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:27.271642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7faac215-edab-4387-9179-e3428f0340fa tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:27.272501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7faac215-edab-4387-9179-e3428f0340fa tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:27.273255 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7faac215-edab-4387-9179-e3428f0340fa tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:27.274109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7faac215-edab-4387-9179-e3428f0340fa tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:27.274579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7faac215-edab-4387-9179-e3428f0340fa tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:27.289856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7faac215-edab-4387-9179-e3428f0340fa tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:27.477170 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5eabeef8-ca21-48b1-8f40-b40ca1eb0232 tempest-FloatingIPDetailsTestJSON-436725891 tempest-FloatingIPDetailsTestJSON-436725891-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 8.564863 Oct 29 02:52:27.486173 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 703/1507] 10.222.0.46 () {60 vars in 1170 bytes} [Sat Oct 29 02:52:18 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 8569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:27.486173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0559005d-7a3e-42c0-b1d8-ff940071b874 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:27.486173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0559005d-7a3e-42c0-b1d8-ff940071b874 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 500595ea-1c83-4574-b6c8-2d6cc39b2231] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:27.518962 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0559005d-7a3e-42c0-b1d8-ff940071b874 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:27.519659 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0559005d-7a3e-42c0-b1d8-ff940071b874 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:27.525357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0559005d-7a3e-42c0-b1d8-ff940071b874 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:27.526588 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0559005d-7a3e-42c0-b1d8-ff940071b874 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:27.529059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0559005d-7a3e-42c0-b1d8-ff940071b874 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:27.530484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0559005d-7a3e-42c0-b1d8-ff940071b874 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:27.827235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7faac215-edab-4387-9179-e3428f0340fa tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:27.853350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7faac215-edab-4387-9179-e3428f0340fa tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:27.866710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7faac215-edab-4387-9179-e3428f0340fa tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:27.871060 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7faac215-edab-4387-9179-e3428f0340fa tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1488 microversion: 2.25 time: 0.646452 Oct 29 02:52:27.872097 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 805/1508] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:27 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1488 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:27.889946 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b3c5dbf4-6b39-421c-951f-d4c6a652e6c3 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1886840581", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:28.022044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-b3c5dbf4-6b39-421c-951f-d4c6a652e6c3 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] validate_networks() for None {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:52:28.650669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-b3c5dbf4-6b39-421c-951f-d4c6a652e6c3 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:52:28.651626 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-b3c5dbf4-6b39-421c-951f-d4c6a652e6c3 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:52:28.652582 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-b3c5dbf4-6b39-421c-951f-d4c6a652e6c3 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:52:28.653606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-b3c5dbf4-6b39-421c-951f-d4c6a652e6c3 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:52:28.654639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-b3c5dbf4-6b39-421c-951f-d4c6a652e6c3 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:52:28.693513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3c5dbf4-6b39-421c-951f-d4c6a652e6c3 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:28.694409 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3c5dbf4-6b39-421c-951f-d4c6a652e6c3 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:28.695109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3c5dbf4-6b39-421c-951f-d4c6a652e6c3 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:28.696964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3c5dbf4-6b39-421c-951f-d4c6a652e6c3 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:28.697716 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3c5dbf4-6b39-421c-951f-d4c6a652e6c3 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:28.698414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3c5dbf4-6b39-421c-951f-d4c6a652e6c3 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:28.787276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-b3c5dbf4-6b39-421c-951f-d4c6a652e6c3 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Getting quotas for project f3b7aa3004d94c5a8cf87d5f4d006a73. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:52:28.808931 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-b3c5dbf4-6b39-421c-951f-d4c6a652e6c3 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Getting quotas for user 844dbc8e54d349ea93c632c54909a718 and project f3b7aa3004d94c5a8cf87d5f4d006a73. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:52:28.863260 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0559005d-7a3e-42c0-b1d8-ff940071b874 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:28.899240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b3c5dbf4-6b39-421c-951f-d4c6a652e6c3 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:52:28.907719 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0559005d-7a3e-42c0-b1d8-ff940071b874 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231" status: 200 len: 1354 microversion: 2.1 time: 1.411079 Oct 29 02:52:28.911816 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 704/1509] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:27 2022] GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231 => generated 1354 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:28.916384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b3c5dbf4-6b39-421c-951f-d4c6a652e6c3 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 1123b300-f298-4071-bff4-8ddc088ee57f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:52:28.927626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-668ec146-2749-4491-a2c1-e0e59cabca18 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] Calling method '.version_select at 0x7ff0539bf280>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:28.957229 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-668ec146-2749-4491-a2c1-e0e59cabca18 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] HTTP exception thrown: Hypervisor with ID '7cbc2ec4-b122-43f4-96a8-41fa320226b4' could not be found. Oct 29 02:52:28.961731 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-668ec146-2749-4491-a2c1-e0e59cabca18 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] Request method failure captured: Oct 29 02:52:28.961731 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/os-hypervisors/7cbc2ec4-b122-43f4-96a8-41fa320226b4 HTTP/1.1 Oct 29 02:52:28.961731 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:52:28.961731 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:52:28.961731 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:52:28.961731 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:52:28.961731 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:52:28.961731 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:52:28.961731 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:52:28.961731 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:52:28.961731 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJVeQytHvKHILuN2DjRsU3J4f-I6Mk9l_o1XcYTXKiFkSsEr7v98-01GYYv8IpTXA7DNw_7bicy5-TYcLaZSt3AONy4NMobA40gnsv58b7QjZl_6DEyI28TepD3kyuebSwQ7qhnFmtELgUmn3I_zX5uVEkRDwrkz88ngd-ddGXTTN_0 Oct 29 02:52:28.961731 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:52:28.961731 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:52:28.961731 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:52:28.961731 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:52:28.961731 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:52:28.961731 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:52:28.961731 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 21d821fe0c024a95bb4e13f4339ee684 Oct 29 02:52:28.961731 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-829611650 Oct 29 02:52:28.961731 n-d-862967-2 devstack@n-api.service[127125]: X-Role: admin,reader,member Oct 29 02:52:28.961731 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: admin,reader,member Oct 29 02:52:28.964641 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/21d821fe0c024a95bb4e13f4339ee684"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/21d821fe0c024a95bb4e13f4339ee684"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_21d821fe0c024a95bb4e13f4339ee684"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/21d821fe0c024a95bb4e13f4339ee684"}]}] Oct 29 02:52:28.964641 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-829611650 Oct 29 02:52:28.964641 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 21d821fe0c024a95bb4e13f4339ee684 Oct 29 02:52:28.964641 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-829611650 Oct 29 02:52:28.964641 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin Oct 29 02:52:28.964641 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:52:28.964641 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:52:28.964641 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: ff5c70bb50544b69802c054b33511487 Oct 29 02:52:28.964641 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin Oct 29 02:52:28.964641 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:52:28.964641 n-d-862967-2 devstack@n-api.service[127125]: exception: Hypervisor with ID '7cbc2ec4-b122-43f4-96a8-41fa320226b4' could not be found. Oct 29 02:52:28.964641 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '7cbc2ec4-b122-43f4-96a8-41fa320226b4'} Oct 29 02:52:28.966353 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:52:28.966353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:28.966353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 29 02:52:28.966353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 29 02:52:28.966353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '7cbc2ec4-b122-43f4-96a8-41fa320226b4' Oct 29 02:52:28.966353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:28.966353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:28.966353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:28.966353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:28.966353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 29 02:52:28.966353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 29 02:52:28.966353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 29 02:52:28.966353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 29 02:52:28.966353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 29 02:52:28.966353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:28.966353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:28.966353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:28.966353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:28.966353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 29 02:52:28.966353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 29 02:52:28.966353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 29 02:52:28.966353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 29 02:52:28.969879 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 29 02:52:28.969879 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:28.969879 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:28.969879 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:28.969879 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:28.969879 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:28.969879 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:28.969879 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:52:28.969879 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:52:28.969879 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:52:28.969879 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:52:28.969879 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:52:28.969879 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:52:28.969879 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 29 02:52:28.969879 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 29 02:52:28.969879 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 29 02:52:28.969879 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 29 02:52:28.969879 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 29 02:52:28.969879 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 02:52:28.969879 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '7cbc2ec4-b122-43f4-96a8-41fa320226b4' could not be found. Oct 29 02:52:28.972754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:28.972754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:28.972754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:28.972754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:28.972754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:28.972754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:28.972754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:52:28.972754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:52:28.972754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '7cbc2ec4-b122-43f4-96a8-41fa320226b4' could not be found. Oct 29 02:52:28.972754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:28.984145 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-668ec146-2749-4491-a2c1-e0e59cabca18 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] Returning 404 to user: Hypervisor with ID '7cbc2ec4-b122-43f4-96a8-41fa320226b4' could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:52:28.988854 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-668ec146-2749-4491-a2c1-e0e59cabca18 tempest-HypervisorAdminNegativeTestJSON-829611650 tempest-HypervisorAdminNegativeTestJSON-829611650-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors/7cbc2ec4-b122-43f4-96a8-41fa320226b4" status: 404 len: 123 microversion: 2.1 time: 0.074754 Oct 29 02:52:28.991555 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 705/1510] 10.222.0.46 () {58 vars in 1257 bytes} [Sat Oct 29 02:52:28 2022] GET /compute/v2.1/os-hypervisors/7cbc2ec4-b122-43f4-96a8-41fa320226b4 => generated 123 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:52:29.014853 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2c29c2c4-2f12-46c9-a3cc-d18ee964e545 tempest-FloatingIPDetailsTestJSON-436725891 tempest-FloatingIPDetailsTestJSON-436725891-project] Action: 'create', calling method: .version_select at 0x7ff0538b0dc0>, body: {"pool": null} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:29.145960 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b3c5dbf4-6b39-421c-951f-d4c6a652e6c3 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.271588 Oct 29 02:52:29.153013 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 806/1511] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:52:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:52:29.196167 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a8611f6c-477f-4c16-a07d-57a099ea3f41 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:29.197204 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a8611f6c-477f-4c16-a07d-57a099ea3f41 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] [instance: 1a47d89b-54a0-40a2-9572-c88ee55e6b5e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:29.243178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8611f6c-477f-4c16-a07d-57a099ea3f41 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:29.243956 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8611f6c-477f-4c16-a07d-57a099ea3f41 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:29.256251 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8611f6c-477f-4c16-a07d-57a099ea3f41 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:29.257696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8611f6c-477f-4c16-a07d-57a099ea3f41 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:29.258464 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8611f6c-477f-4c16-a07d-57a099ea3f41 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:29.259184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8611f6c-477f-4c16-a07d-57a099ea3f41 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:31.025235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a8611f6c-477f-4c16-a07d-57a099ea3f41 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cdc8abe2dbf4479b2bd859c37bb204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449eab5d48df46be8b15f1094286b0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:31.044613 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a8611f6c-477f-4c16-a07d-57a099ea3f41 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] 10.222.0.46 "GET /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e" status: 200 len: 1316 microversion: 2.1 time: 1.888735 Oct 29 02:52:31.051155 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 807/1512] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:29 2022] GET /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e => generated 1316 bytes in 1894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:31.080829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e8305481-c77b-4482-a45f-f2c0dacc95f0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:31.086012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e8305481-c77b-4482-a45f-f2c0dacc95f0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:31.113373 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8305481-c77b-4482-a45f-f2c0dacc95f0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:31.114623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8305481-c77b-4482-a45f-f2c0dacc95f0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:31.115077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8305481-c77b-4482-a45f-f2c0dacc95f0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:31.118229 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8305481-c77b-4482-a45f-f2c0dacc95f0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:31.118724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8305481-c77b-4482-a45f-f2c0dacc95f0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:31.119161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8305481-c77b-4482-a45f-f2c0dacc95f0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:31.735557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e8305481-c77b-4482-a45f-f2c0dacc95f0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:31.748367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e8305481-c77b-4482-a45f-f2c0dacc95f0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:31.756695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e8305481-c77b-4482-a45f-f2c0dacc95f0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:31.758214 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e8305481-c77b-4482-a45f-f2c0dacc95f0 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1488 microversion: 2.25 time: 0.705879 Oct 29 02:52:31.759052 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 808/1513] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:31 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1488 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:31.776047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cb785bac-58f2-47bb-a8e9-f34e732c7c16 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:31.777421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cb785bac-58f2-47bb-a8e9-f34e732c7c16 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 1123b300-f298-4071-bff4-8ddc088ee57f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:31.792060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cb785bac-58f2-47bb-a8e9-f34e732c7c16 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:31.793046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cb785bac-58f2-47bb-a8e9-f34e732c7c16 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:31.797093 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cb785bac-58f2-47bb-a8e9-f34e732c7c16 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:31.798238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cb785bac-58f2-47bb-a8e9-f34e732c7c16 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:31.799088 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cb785bac-58f2-47bb-a8e9-f34e732c7c16 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:31.799854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cb785bac-58f2-47bb-a8e9-f34e732c7c16 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:32.026508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cb785bac-58f2-47bb-a8e9-f34e732c7c16 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844dbc8e54d349ea93c632c54909a718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b7aa3004d94c5a8cf87d5f4d006a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:32.042307 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cb785bac-58f2-47bb-a8e9-f34e732c7c16 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f" status: 200 len: 1276 microversion: 2.1 time: 0.280061 Oct 29 02:52:32.043975 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 809/1514] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:31 2022] GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f => generated 1276 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:32.051159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-599e9c6f-7ce1-4332-8d80-ce07d7a1559b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:32.052173 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-599e9c6f-7ce1-4332-8d80-ce07d7a1559b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 500595ea-1c83-4574-b6c8-2d6cc39b2231] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:32.061943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-599e9c6f-7ce1-4332-8d80-ce07d7a1559b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:32.062695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-599e9c6f-7ce1-4332-8d80-ce07d7a1559b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:32.063510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-599e9c6f-7ce1-4332-8d80-ce07d7a1559b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:32.064592 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-599e9c6f-7ce1-4332-8d80-ce07d7a1559b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:32.093036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-599e9c6f-7ce1-4332-8d80-ce07d7a1559b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:32.093841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-599e9c6f-7ce1-4332-8d80-ce07d7a1559b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:32.691923 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-599e9c6f-7ce1-4332-8d80-ce07d7a1559b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:32.715694 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-599e9c6f-7ce1-4332-8d80-ce07d7a1559b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231" status: 200 len: 1354 microversion: 2.1 time: 0.669409 Oct 29 02:52:32.716562 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 810/1515] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:32 2022] GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231 => generated 1354 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:32.733964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7a2da44a-1bdd-4dd9-adac-14b9371dc494 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:32.735416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7a2da44a-1bdd-4dd9-adac-14b9371dc494 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] [instance: 1a47d89b-54a0-40a2-9572-c88ee55e6b5e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:32.752919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7a2da44a-1bdd-4dd9-adac-14b9371dc494 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:32.753437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7a2da44a-1bdd-4dd9-adac-14b9371dc494 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:32.755296 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7a2da44a-1bdd-4dd9-adac-14b9371dc494 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:32.760150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7a2da44a-1bdd-4dd9-adac-14b9371dc494 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:32.761184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7a2da44a-1bdd-4dd9-adac-14b9371dc494 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:32.764272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7a2da44a-1bdd-4dd9-adac-14b9371dc494 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:33.299754 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7a2da44a-1bdd-4dd9-adac-14b9371dc494 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cdc8abe2dbf4479b2bd859c37bb204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449eab5d48df46be8b15f1094286b0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:33.311721 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7a2da44a-1bdd-4dd9-adac-14b9371dc494 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] 10.222.0.46 "GET /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e" status: 200 len: 1316 microversion: 2.1 time: 0.592711 Oct 29 02:52:33.329315 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 811/1516] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:32 2022] GET /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e => generated 1316 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:33.336214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-3f6449fb-7df6-4741-93de-9fb1c24422f2 req-aeb05919-ff65-49ed-81b9-a8852010709a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a47d89b-54a0-40a2-9572-c88ee55e6b5e", "tag": "c11bfad0-89c4-4755-8bc3-bd8eeacde306"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:33.348411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3f6449fb-7df6-4741-93de-9fb1c24422f2 req-aeb05919-ff65-49ed-81b9-a8852010709a service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:33.350010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3f6449fb-7df6-4741-93de-9fb1c24422f2 req-aeb05919-ff65-49ed-81b9-a8852010709a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:33.350693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3f6449fb-7df6-4741-93de-9fb1c24422f2 req-aeb05919-ff65-49ed-81b9-a8852010709a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:33.367533 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-3f6449fb-7df6-4741-93de-9fb1c24422f2 req-aeb05919-ff65-49ed-81b9-a8852010709a service nova] Creating event network-changed:c11bfad0-89c4-4755-8bc3-bd8eeacde306 for instance 1a47d89b-54a0-40a2-9572-c88ee55e6b5e on n-h2-862967-2 Oct 29 02:52:33.375415 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-3f6449fb-7df6-4741-93de-9fb1c24422f2 req-aeb05919-ff65-49ed-81b9-a8852010709a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044183 Oct 29 02:52:33.376670 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 812/1517] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:33.384777 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-641e27c1-6879-4dfa-b05a-15b93da1079b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:33.386021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-641e27c1-6879-4dfa-b05a-15b93da1079b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:33.394953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-641e27c1-6879-4dfa-b05a-15b93da1079b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:33.395919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-641e27c1-6879-4dfa-b05a-15b93da1079b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:33.396681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-641e27c1-6879-4dfa-b05a-15b93da1079b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:33.397755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-641e27c1-6879-4dfa-b05a-15b93da1079b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:33.398459 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-641e27c1-6879-4dfa-b05a-15b93da1079b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:33.399333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-641e27c1-6879-4dfa-b05a-15b93da1079b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:34.090952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-641e27c1-6879-4dfa-b05a-15b93da1079b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:34.113222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-641e27c1-6879-4dfa-b05a-15b93da1079b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:34.116165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-641e27c1-6879-4dfa-b05a-15b93da1079b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:34.117853 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-641e27c1-6879-4dfa-b05a-15b93da1079b tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1488 microversion: 2.25 time: 0.739384 Oct 29 02:52:34.122478 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 813/1518] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:33 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1488 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:34.131372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ef946687-0d2e-4119-82b5-faea2ddf0407 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:34.134750 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ef946687-0d2e-4119-82b5-faea2ddf0407 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 1123b300-f298-4071-bff4-8ddc088ee57f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:34.144704 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef946687-0d2e-4119-82b5-faea2ddf0407 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:34.145595 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef946687-0d2e-4119-82b5-faea2ddf0407 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:34.146271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef946687-0d2e-4119-82b5-faea2ddf0407 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:34.150755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef946687-0d2e-4119-82b5-faea2ddf0407 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:34.151605 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef946687-0d2e-4119-82b5-faea2ddf0407 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:34.152294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef946687-0d2e-4119-82b5-faea2ddf0407 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:34.394194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ef946687-0d2e-4119-82b5-faea2ddf0407 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844dbc8e54d349ea93c632c54909a718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b7aa3004d94c5a8cf87d5f4d006a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:34.408921 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ef946687-0d2e-4119-82b5-faea2ddf0407 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f" status: 200 len: 1276 microversion: 2.1 time: 0.284982 Oct 29 02:52:34.409592 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 814/1519] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:34 2022] GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f => generated 1276 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:34.415572 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bb730bd5-904c-45b9-b2b6-7e8e8eedb7b3 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:34.417388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bb730bd5-904c-45b9-b2b6-7e8e8eedb7b3 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 500595ea-1c83-4574-b6c8-2d6cc39b2231] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:34.426080 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb730bd5-904c-45b9-b2b6-7e8e8eedb7b3 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:34.426822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb730bd5-904c-45b9-b2b6-7e8e8eedb7b3 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:34.427506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb730bd5-904c-45b9-b2b6-7e8e8eedb7b3 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:34.428486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb730bd5-904c-45b9-b2b6-7e8e8eedb7b3 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:34.429142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb730bd5-904c-45b9-b2b6-7e8e8eedb7b3 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:34.429771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb730bd5-904c-45b9-b2b6-7e8e8eedb7b3 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:35.190248 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bb730bd5-904c-45b9-b2b6-7e8e8eedb7b3 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:35.201269 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bb730bd5-904c-45b9-b2b6-7e8e8eedb7b3 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231" status: 200 len: 1354 microversion: 2.1 time: 0.790204 Oct 29 02:52:35.203552 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 815/1520] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:34 2022] GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231 => generated 1354 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:35.221654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3b84270f-58a5-4928-ae93-1684d72e0b6e tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:35.222627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3b84270f-58a5-4928-ae93-1684d72e0b6e tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] [instance: 1a47d89b-54a0-40a2-9572-c88ee55e6b5e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:35.233865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b84270f-58a5-4928-ae93-1684d72e0b6e tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:35.236592 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b84270f-58a5-4928-ae93-1684d72e0b6e tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:35.237324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b84270f-58a5-4928-ae93-1684d72e0b6e tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:35.238531 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b84270f-58a5-4928-ae93-1684d72e0b6e tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:35.239223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b84270f-58a5-4928-ae93-1684d72e0b6e tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:35.240802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b84270f-58a5-4928-ae93-1684d72e0b6e tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:36.170836 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2c29c2c4-2f12-46c9-a3cc-d18ee964e545 tempest-FloatingIPDetailsTestJSON-436725891 tempest-FloatingIPDetailsTestJSON-436725891-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 7.174221 Oct 29 02:52:36.171592 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 706/1521] 10.222.0.46 () {60 vars in 1170 bytes} [Sat Oct 29 02:52:28 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 7176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:36.195763 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6c6247a2-1062-4450-9c58-d1b8225a3604 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:36.196795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6c6247a2-1062-4450-9c58-d1b8225a3604 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:36.225760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c6247a2-1062-4450-9c58-d1b8225a3604 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:36.226582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c6247a2-1062-4450-9c58-d1b8225a3604 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:36.227495 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c6247a2-1062-4450-9c58-d1b8225a3604 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:36.228546 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c6247a2-1062-4450-9c58-d1b8225a3604 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:36.248897 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c6247a2-1062-4450-9c58-d1b8225a3604 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:36.249657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c6247a2-1062-4450-9c58-d1b8225a3604 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:37.049145 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6c6247a2-1062-4450-9c58-d1b8225a3604 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:37.060392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6c6247a2-1062-4450-9c58-d1b8225a3604 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:37.066600 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6c6247a2-1062-4450-9c58-d1b8225a3604 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:37.082531 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6c6247a2-1062-4450-9c58-d1b8225a3604 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1488 microversion: 2.25 time: 0.895955 Oct 29 02:52:37.083652 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 707/1522] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:36 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1488 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:37.097145 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-436566f7-b945-4b21-872e-b920b4ecbd0f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:37.098166 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-436566f7-b945-4b21-872e-b920b4ecbd0f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 1123b300-f298-4071-bff4-8ddc088ee57f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:37.108885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-436566f7-b945-4b21-872e-b920b4ecbd0f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:37.110823 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-436566f7-b945-4b21-872e-b920b4ecbd0f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:37.111490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-436566f7-b945-4b21-872e-b920b4ecbd0f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:37.117182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-436566f7-b945-4b21-872e-b920b4ecbd0f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:37.117846 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-436566f7-b945-4b21-872e-b920b4ecbd0f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:37.118494 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-436566f7-b945-4b21-872e-b920b4ecbd0f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:37.168177 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3b84270f-58a5-4928-ae93-1684d72e0b6e tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cdc8abe2dbf4479b2bd859c37bb204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449eab5d48df46be8b15f1094286b0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:37.178731 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3b84270f-58a5-4928-ae93-1684d72e0b6e tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] 10.222.0.46 "GET /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e" status: 200 len: 1316 microversion: 2.1 time: 1.971849 Oct 29 02:52:37.179841 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 816/1523] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:35 2022] GET /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e => generated 1316 bytes in 1975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:37.194170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-058d9e63-ac06-48d3-bf1e-170e166d1862 req-1e7b51ba-ab90-4059-bd3a-06081abec398 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "500595ea-1c83-4574-b6c8-2d6cc39b2231", "tag": "dc16dd44-033b-41eb-86dd-bf32e0dc64a5"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:37.210373 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:37.219960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-058d9e63-ac06-48d3-bf1e-170e166d1862 req-1e7b51ba-ab90-4059-bd3a-06081abec398 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:37.230353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-058d9e63-ac06-48d3-bf1e-170e166d1862 req-1e7b51ba-ab90-4059-bd3a-06081abec398 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:37.231091 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-058d9e63-ac06-48d3-bf1e-170e166d1862 req-1e7b51ba-ab90-4059-bd3a-06081abec398 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:37.249751 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-058d9e63-ac06-48d3-bf1e-170e166d1862 req-1e7b51ba-ab90-4059-bd3a-06081abec398 service nova] Creating event network-changed:dc16dd44-033b-41eb-86dd-bf32e0dc64a5 for instance 500595ea-1c83-4574-b6c8-2d6cc39b2231 on n-h2-862967-2 Oct 29 02:52:37.255281 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-058d9e63-ac06-48d3-bf1e-170e166d1862 req-1e7b51ba-ab90-4059-bd3a-06081abec398 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074051 Oct 29 02:52:37.256105 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 817/1524] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:37.261648 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f15b558e-23f5-40bb-85a6-09fa8e7cb82d tempest-FloatingIPDetailsTestJSON-436725891 tempest-FloatingIPDetailsTestJSON-436725891-project] Calling method '.version_select at 0x7ff053a50940>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:38.184786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-436566f7-b945-4b21-872e-b920b4ecbd0f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844dbc8e54d349ea93c632c54909a718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b7aa3004d94c5a8cf87d5f4d006a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:38.205957 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-436566f7-b945-4b21-872e-b920b4ecbd0f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f" status: 200 len: 1318 microversion: 2.1 time: 1.120614 Oct 29 02:52:38.211929 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 708/1525] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:37 2022] GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f => generated 1318 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:38.230543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-186bf843-f3fb-46e8-a9fd-f0fcdbee9763 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:38.231591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-186bf843-f3fb-46e8-a9fd-f0fcdbee9763 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 500595ea-1c83-4574-b6c8-2d6cc39b2231] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:38.256449 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-186bf843-f3fb-46e8-a9fd-f0fcdbee9763 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:38.256929 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-186bf843-f3fb-46e8-a9fd-f0fcdbee9763 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:38.257363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-186bf843-f3fb-46e8-a9fd-f0fcdbee9763 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:38.258086 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-186bf843-f3fb-46e8-a9fd-f0fcdbee9763 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:38.258595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-186bf843-f3fb-46e8-a9fd-f0fcdbee9763 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:38.263948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-186bf843-f3fb-46e8-a9fd-f0fcdbee9763 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:38.299314 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f15b558e-23f5-40bb-85a6-09fa8e7cb82d tempest-FloatingIPDetailsTestJSON-436725891 tempest-FloatingIPDetailsTestJSON-436725891-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips/4769ebd2-7467-448d-8e12-feee12886fbb" status: 200 len: 141 microversion: 2.1 time: 1.041400 Oct 29 02:52:38.301587 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 818/1526] 10.222.0.46 () {58 vars in 1260 bytes} [Sat Oct 29 02:52:37 2022] GET /compute/v2.1/os-floating-ips/4769ebd2-7467-448d-8e12-feee12886fbb => generated 141 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:38.317179 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fb2652d6-ab23-44f9-9c76-73483f7eed73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:38.322867 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fb2652d6-ab23-44f9-9c76-73483f7eed73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:38.336630 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fb2652d6-ab23-44f9-9c76-73483f7eed73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:38.337128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fb2652d6-ab23-44f9-9c76-73483f7eed73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:38.337559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fb2652d6-ab23-44f9-9c76-73483f7eed73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:38.338725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fb2652d6-ab23-44f9-9c76-73483f7eed73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:38.339183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fb2652d6-ab23-44f9-9c76-73483f7eed73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:38.339605 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fb2652d6-ab23-44f9-9c76-73483f7eed73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:38.629344 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-186bf843-f3fb-46e8-a9fd-f0fcdbee9763 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:38.645247 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-186bf843-f3fb-46e8-a9fd-f0fcdbee9763 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231" status: 200 len: 1354 microversion: 2.1 time: 0.431312 Oct 29 02:52:38.646602 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 709/1527] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:38 2022] GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231 => generated 1354 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:38.682157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c16c5f25-cc3b-4259-9f27-e55f6f6d5a4d tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:38.683059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c16c5f25-cc3b-4259-9f27-e55f6f6d5a4d tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] [instance: 1a47d89b-54a0-40a2-9572-c88ee55e6b5e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:38.691618 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c16c5f25-cc3b-4259-9f27-e55f6f6d5a4d tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:38.692119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c16c5f25-cc3b-4259-9f27-e55f6f6d5a4d tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:38.692782 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c16c5f25-cc3b-4259-9f27-e55f6f6d5a4d tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:38.693689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c16c5f25-cc3b-4259-9f27-e55f6f6d5a4d tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:38.694300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c16c5f25-cc3b-4259-9f27-e55f6f6d5a4d tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:38.694874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c16c5f25-cc3b-4259-9f27-e55f6f6d5a4d tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:38.747912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=10 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:38.833445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=26 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:39.083582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c16c5f25-cc3b-4259-9f27-e55f6f6d5a4d tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cdc8abe2dbf4479b2bd859c37bb204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449eab5d48df46be8b15f1094286b0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:39.104311 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c16c5f25-cc3b-4259-9f27-e55f6f6d5a4d tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] 10.222.0.46 "GET /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e" status: 200 len: 1316 microversion: 2.1 time: 0.428569 Oct 29 02:52:39.105980 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 710/1528] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:38 2022] GET /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e => generated 1316 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:39.115458 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2446020e-2dc9-430b-8817-ed300f288b02 tempest-FloatingIPDetailsTestJSON-436725891 tempest-FloatingIPDetailsTestJSON-436725891-project] Calling method '.version_select at 0x7ff053832c10>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:39.439011 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fb2652d6-ab23-44f9-9c76-73483f7eed73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:39.461898 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fb2652d6-ab23-44f9-9c76-73483f7eed73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:39.469290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fb2652d6-ab23-44f9-9c76-73483f7eed73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:39.472873 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fb2652d6-ab23-44f9-9c76-73483f7eed73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1488 microversion: 2.25 time: 1.168955 Oct 29 02:52:39.474501 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 819/1529] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:38 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1488 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:39.844267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-708cec13-16a1-4cb4-8871-f823342e38df tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Calling method '.version_select at 0x7ff053a509d0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:39.926652 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-708cec13-16a1-4cb4-8871-f823342e38df tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/4457f82d29f34bcdbea2e4427d21db29" status: 200 len: 371 microversion: 2.1 time: 0.450268 Oct 29 02:52:39.927650 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 820/1530] 10.222.0.46 () {58 vars in 1242 bytes} [Sat Oct 29 02:52:39 2022] GET /compute/v2.1/os-quota-sets/4457f82d29f34bcdbea2e4427d21db29 => generated 371 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:39.933665 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ed2ee8f9-625f-4bae-bd6f-1cd93c076558 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:39.934695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ed2ee8f9-625f-4bae-bd6f-1cd93c076558 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 1123b300-f298-4071-bff4-8ddc088ee57f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:39.945135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed2ee8f9-625f-4bae-bd6f-1cd93c076558 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:39.946023 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed2ee8f9-625f-4bae-bd6f-1cd93c076558 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:39.946809 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed2ee8f9-625f-4bae-bd6f-1cd93c076558 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:39.947990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed2ee8f9-625f-4bae-bd6f-1cd93c076558 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:39.948620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed2ee8f9-625f-4bae-bd6f-1cd93c076558 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:39.949073 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed2ee8f9-625f-4bae-bd6f-1cd93c076558 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:40.914947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ed2ee8f9-625f-4bae-bd6f-1cd93c076558 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844dbc8e54d349ea93c632c54909a718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b7aa3004d94c5a8cf87d5f4d006a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:40.935676 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ed2ee8f9-625f-4bae-bd6f-1cd93c076558 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f" status: 200 len: 1318 microversion: 2.1 time: 1.006605 Oct 29 02:52:40.937312 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 821/1531] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:39 2022] GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f => generated 1318 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:40.944312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-1a7f7c4f-266f-448e-af78-9a822cf0a8cf req-42eecba2-f2e6-43a1-a58f-c35e6251e23d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "500595ea-1c83-4574-b6c8-2d6cc39b2231", "tag": "dfcee5d6-4375-4d8f-8e2d-e3624086cfa5"}, {"name": "network-changed", "server_uuid": "500595ea-1c83-4574-b6c8-2d6cc39b2231", "tag": "da1ef08b-d52a-458a-95fd-42a59fbff65e"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:40.956083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1a7f7c4f-266f-448e-af78-9a822cf0a8cf req-42eecba2-f2e6-43a1-a58f-c35e6251e23d service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:40.956942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1a7f7c4f-266f-448e-af78-9a822cf0a8cf req-42eecba2-f2e6-43a1-a58f-c35e6251e23d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:40.957359 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1a7f7c4f-266f-448e-af78-9a822cf0a8cf req-42eecba2-f2e6-43a1-a58f-c35e6251e23d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:40.970338 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-1a7f7c4f-266f-448e-af78-9a822cf0a8cf req-42eecba2-f2e6-43a1-a58f-c35e6251e23d service nova] Creating event network-changed:dfcee5d6-4375-4d8f-8e2d-e3624086cfa5 for instance 500595ea-1c83-4574-b6c8-2d6cc39b2231 on n-h2-862967-2 Oct 29 02:52:40.971250 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-1a7f7c4f-266f-448e-af78-9a822cf0a8cf req-42eecba2-f2e6-43a1-a58f-c35e6251e23d service nova] Creating event network-changed:da1ef08b-d52a-458a-95fd-42a59fbff65e for instance 500595ea-1c83-4574-b6c8-2d6cc39b2231 on n-h2-862967-2 Oct 29 02:52:40.977735 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-1a7f7c4f-266f-448e-af78-9a822cf0a8cf req-42eecba2-f2e6-43a1-a58f-c35e6251e23d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038766 Oct 29 02:52:40.980131 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 822/1532] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:40.988736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-08402e75-319e-479a-9f06-fb2d05589bc8 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:40.990781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-08402e75-319e-479a-9f06-fb2d05589bc8 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 500595ea-1c83-4574-b6c8-2d6cc39b2231] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:40.999404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-08402e75-319e-479a-9f06-fb2d05589bc8 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:41.000107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-08402e75-319e-479a-9f06-fb2d05589bc8 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:41.000746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-08402e75-319e-479a-9f06-fb2d05589bc8 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:41.001650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-08402e75-319e-479a-9f06-fb2d05589bc8 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:41.002367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-08402e75-319e-479a-9f06-fb2d05589bc8 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:41.003029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-08402e75-319e-479a-9f06-fb2d05589bc8 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:41.198721 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2446020e-2dc9-430b-8817-ed300f288b02 tempest-FloatingIPDetailsTestJSON-436725891 tempest-FloatingIPDetailsTestJSON-436725891-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/4769ebd2-7467-448d-8e12-feee12886fbb" status: 202 len: 0 microversion: 2.1 time: 2.090979 Oct 29 02:52:41.201506 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 711/1533] 10.222.0.46 () {58 vars in 1263 bytes} [Sat Oct 29 02:52:39 2022] DELETE /compute/v2.1/os-floating-ips/4769ebd2-7467-448d-8e12-feee12886fbb => generated 0 bytes in 2095 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:52:41.211481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-dba6bdb1-cc48-4e60-8c38-0506149e35e2 req-ddebe059-8c58-4fe9-9a75-f4805cfba494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a47d89b-54a0-40a2-9572-c88ee55e6b5e", "name": "network-vif-plugged", "status": "completed", "tag": "c11bfad0-89c4-4755-8bc3-bd8eeacde306"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:41.230167 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-dba6bdb1-cc48-4e60-8c38-0506149e35e2 req-ddebe059-8c58-4fe9-9a75-f4805cfba494 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:41.230698 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-dba6bdb1-cc48-4e60-8c38-0506149e35e2 req-ddebe059-8c58-4fe9-9a75-f4805cfba494 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:41.231498 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-dba6bdb1-cc48-4e60-8c38-0506149e35e2 req-ddebe059-8c58-4fe9-9a75-f4805cfba494 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:41.249418 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-dba6bdb1-cc48-4e60-8c38-0506149e35e2 req-ddebe059-8c58-4fe9-9a75-f4805cfba494 service nova] Creating event network-vif-plugged:c11bfad0-89c4-4755-8bc3-bd8eeacde306 for instance 1a47d89b-54a0-40a2-9572-c88ee55e6b5e on n-h2-862967-2 Oct 29 02:52:41.261009 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-dba6bdb1-cc48-4e60-8c38-0506149e35e2 req-ddebe059-8c58-4fe9-9a75-f4805cfba494 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057081 Oct 29 02:52:41.263045 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 712/1534] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:41.284255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-23c44ef7-4999-48dc-943f-4c339f048d75 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Action: 'update', calling method: .version_select at 0x7ff0538323a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:41.450383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23c44ef7-4999-48dc-943f-4c339f048d75 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:41.451291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23c44ef7-4999-48dc-943f-4c339f048d75 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:41.452173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23c44ef7-4999-48dc-943f-4c339f048d75 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:41.453129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23c44ef7-4999-48dc-943f-4c339f048d75 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:41.453842 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23c44ef7-4999-48dc-943f-4c339f048d75 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:41.454776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23c44ef7-4999-48dc-943f-4c339f048d75 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:41.557918 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-23c44ef7-4999-48dc-943f-4c339f048d75 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/4457f82d29f34bcdbea2e4427d21db29" status: 200 len: 328 microversion: 2.1 time: 0.291570 Oct 29 02:52:41.559635 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 713/1535] 10.222.0.46 () {60 vars in 1262 bytes} [Sat Oct 29 02:52:41 2022] PUT /compute/v2.1/os-quota-sets/4457f82d29f34bcdbea2e4427d21db29 => generated 328 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:41.566817 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1fcf0bc5-bb7d-49cd-8081-8f3dd2d939f7 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:41.567621 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1fcf0bc5-bb7d-49cd-8081-8f3dd2d939f7 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] [instance: 1a47d89b-54a0-40a2-9572-c88ee55e6b5e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:41.576047 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1fcf0bc5-bb7d-49cd-8081-8f3dd2d939f7 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:41.576655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1fcf0bc5-bb7d-49cd-8081-8f3dd2d939f7 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:41.577183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1fcf0bc5-bb7d-49cd-8081-8f3dd2d939f7 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:41.578104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1fcf0bc5-bb7d-49cd-8081-8f3dd2d939f7 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:41.578593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1fcf0bc5-bb7d-49cd-8081-8f3dd2d939f7 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:41.579170 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1fcf0bc5-bb7d-49cd-8081-8f3dd2d939f7 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:41.624188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-08402e75-319e-479a-9f06-fb2d05589bc8 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:41.633560 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-08402e75-319e-479a-9f06-fb2d05589bc8 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231" status: 200 len: 1354 microversion: 2.1 time: 0.651840 Oct 29 02:52:41.634903 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 823/1536] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:40 2022] GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231 => generated 1354 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:41.641387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-737480e1-cfd4-475d-bdfe-f8d5ce399c35 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:41.642624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-737480e1-cfd4-475d-bdfe-f8d5ce399c35 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:41.649389 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-737480e1-cfd4-475d-bdfe-f8d5ce399c35 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:41.650290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-737480e1-cfd4-475d-bdfe-f8d5ce399c35 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:41.651008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-737480e1-cfd4-475d-bdfe-f8d5ce399c35 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:41.651939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-737480e1-cfd4-475d-bdfe-f8d5ce399c35 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:41.652609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-737480e1-cfd4-475d-bdfe-f8d5ce399c35 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:41.653232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-737480e1-cfd4-475d-bdfe-f8d5ce399c35 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:41.906425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1fcf0bc5-bb7d-49cd-8081-8f3dd2d939f7 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cdc8abe2dbf4479b2bd859c37bb204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449eab5d48df46be8b15f1094286b0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:41.933917 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1fcf0bc5-bb7d-49cd-8081-8f3dd2d939f7 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] 10.222.0.46 "GET /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e" status: 200 len: 1316 microversion: 2.1 time: 0.369699 Oct 29 02:52:41.935445 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 714/1537] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:41 2022] GET /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e => generated 1316 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:41.950524 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-95a6627f-7a32-44c6-b3d0-79e83452edd1 tempest-FloatingIPDetailsTestJSON-436725891 tempest-FloatingIPDetailsTestJSON-436725891-project] Calling method '.version_select at 0x7ff0538fa550>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:42.149690 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-737480e1-cfd4-475d-bdfe-f8d5ce399c35 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:42.153659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=100 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:42.162969 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-737480e1-cfd4-475d-bdfe-f8d5ce399c35 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:42.174356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-737480e1-cfd4-475d-bdfe-f8d5ce399c35 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:42.176642 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-737480e1-cfd4-475d-bdfe-f8d5ce399c35 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1488 microversion: 2.25 time: 0.539871 Oct 29 02:52:42.177433 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 824/1538] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:41 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1488 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:42.193229 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-e6e49aa7-8d85-43e2-8dac-e5b2ae70ec5c req-ea714137-2b8d-430e-8ab6-0cac7a5e0519 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd", "tag": "9daf432c-ab9e-41ed-aaf7-21cb4e7d509f"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:42.212697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e6e49aa7-8d85-43e2-8dac-e5b2ae70ec5c req-ea714137-2b8d-430e-8ab6-0cac7a5e0519 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:42.221547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e6e49aa7-8d85-43e2-8dac-e5b2ae70ec5c req-ea714137-2b8d-430e-8ab6-0cac7a5e0519 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:42.222004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e6e49aa7-8d85-43e2-8dac-e5b2ae70ec5c req-ea714137-2b8d-430e-8ab6-0cac7a5e0519 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:42.251345 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-e6e49aa7-8d85-43e2-8dac-e5b2ae70ec5c req-ea714137-2b8d-430e-8ab6-0cac7a5e0519 service nova] Creating event network-changed:9daf432c-ab9e-41ed-aaf7-21cb4e7d509f for instance 0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd on n-h1-862967-2 Oct 29 02:52:42.257351 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-e6e49aa7-8d85-43e2-8dac-e5b2ae70ec5c req-ea714137-2b8d-430e-8ab6-0cac7a5e0519 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077150 Oct 29 02:52:42.258633 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 825/1539] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:42.267352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9a98b8d8-5c95-462e-b498-18f34ac05733 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:42.295472 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9a98b8d8-5c95-462e-b498-18f34ac05733 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-quota-sets/4457f82d29f34bcdbea2e4427d21db29" status: 202 len: 0 microversion: 2.1 time: 0.033565 Oct 29 02:52:42.300291 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 826/1540] 10.222.0.46 () {58 vars in 1245 bytes} [Sat Oct 29 02:52:42 2022] DELETE /compute/v2.1/os-quota-sets/4457f82d29f34bcdbea2e4427d21db29 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:52:42.309132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7e083d08-28f2-4ba4-814e-691e6e797102 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:42.311380 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7e083d08-28f2-4ba4-814e-691e6e797102 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 1123b300-f298-4071-bff4-8ddc088ee57f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:42.322170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e083d08-28f2-4ba4-814e-691e6e797102 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:42.324631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e083d08-28f2-4ba4-814e-691e6e797102 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:42.325469 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e083d08-28f2-4ba4-814e-691e6e797102 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:42.326563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e083d08-28f2-4ba4-814e-691e6e797102 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:42.327209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e083d08-28f2-4ba4-814e-691e6e797102 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:42.327855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e083d08-28f2-4ba4-814e-691e6e797102 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:42.814741 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7e083d08-28f2-4ba4-814e-691e6e797102 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844dbc8e54d349ea93c632c54909a718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b7aa3004d94c5a8cf87d5f4d006a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:42.826950 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7e083d08-28f2-4ba4-814e-691e6e797102 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f" status: 200 len: 1318 microversion: 2.1 time: 0.524536 Oct 29 02:52:42.827936 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 827/1541] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:42 2022] GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f => generated 1318 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:42.832999 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cf6b464d-a5d2-4bfd-84d6-770a746c3020 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Calling method '.version_select at 0x7ff053a7d310>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:42.985464 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cf6b464d-a5d2-4bfd-84d6-770a746c3020 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/4457f82d29f34bcdbea2e4427d21db29" status: 200 len: 371 microversion: 2.1 time: 0.156151 Oct 29 02:52:42.986464 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 828/1542] 10.222.0.46 () {58 vars in 1242 bytes} [Sat Oct 29 02:52:42 2022] GET /compute/v2.1/os-quota-sets/4457f82d29f34bcdbea2e4427d21db29 => generated 371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:42.991725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9d21e570-1f97-4931-a5bd-0730f3c4454e tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:42.992672 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9d21e570-1f97-4931-a5bd-0730f3c4454e tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 500595ea-1c83-4574-b6c8-2d6cc39b2231] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:43.017674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d21e570-1f97-4931-a5bd-0730f3c4454e tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:43.018168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d21e570-1f97-4931-a5bd-0730f3c4454e tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:43.018605 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d21e570-1f97-4931-a5bd-0730f3c4454e tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:43.027353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d21e570-1f97-4931-a5bd-0730f3c4454e tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:43.027823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d21e570-1f97-4931-a5bd-0730f3c4454e tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:43.028265 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d21e570-1f97-4931-a5bd-0730f3c4454e tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:43.068229 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-95a6627f-7a32-44c6-b3d0-79e83452edd1 tempest-FloatingIPDetailsTestJSON-436725891 tempest-FloatingIPDetailsTestJSON-436725891-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 1.131657 Oct 29 02:52:43.068844 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 715/1543] 10.222.0.46 () {58 vars in 1164 bytes} [Sat Oct 29 02:52:41 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:52:43.076564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4c62a6ff-d33d-4ede-a7d4-993762304dd3 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:43.077384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4c62a6ff-d33d-4ede-a7d4-993762304dd3 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] [instance: 1a47d89b-54a0-40a2-9572-c88ee55e6b5e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:43.096742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c62a6ff-d33d-4ede-a7d4-993762304dd3 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:43.097628 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c62a6ff-d33d-4ede-a7d4-993762304dd3 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:43.099848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c62a6ff-d33d-4ede-a7d4-993762304dd3 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:43.100827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c62a6ff-d33d-4ede-a7d4-993762304dd3 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:43.106858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c62a6ff-d33d-4ede-a7d4-993762304dd3 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:43.107638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c62a6ff-d33d-4ede-a7d4-993762304dd3 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:43.671907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4c62a6ff-d33d-4ede-a7d4-993762304dd3 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cdc8abe2dbf4479b2bd859c37bb204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449eab5d48df46be8b15f1094286b0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:43.684096 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4c62a6ff-d33d-4ede-a7d4-993762304dd3 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] 10.222.0.46 "GET /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e" status: 200 len: 1504 microversion: 2.1 time: 0.613742 Oct 29 02:52:43.685205 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 716/1544] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:43 2022] GET /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e => generated 1504 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:43.696563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-e2ad13b2-9a4a-4de8-9d44-9a3c3f7d1673 req-807eabac-7553-4121-adbb-bdf008643bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36000641-20c2-4949-bcae-d11828ed67b4", "name": "network-vif-unplugged", "status": "completed", "tag": "0612e19b-4219-4b23-80fd-a0d245ef44d1"}, {"name": "network-changed", "server_uuid": "36000641-20c2-4949-bcae-d11828ed67b4", "tag": "0612e19b-4219-4b23-80fd-a0d245ef44d1"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:43.718735 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e2ad13b2-9a4a-4de8-9d44-9a3c3f7d1673 req-807eabac-7553-4121-adbb-bdf008643bb2 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:43.719225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e2ad13b2-9a4a-4de8-9d44-9a3c3f7d1673 req-807eabac-7553-4121-adbb-bdf008643bb2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:43.719655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e2ad13b2-9a4a-4de8-9d44-9a3c3f7d1673 req-807eabac-7553-4121-adbb-bdf008643bb2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:43.747230 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-e2ad13b2-9a4a-4de8-9d44-9a3c3f7d1673 req-807eabac-7553-4121-adbb-bdf008643bb2 service nova] Creating event network-vif-unplugged:0612e19b-4219-4b23-80fd-a0d245ef44d1 for instance 36000641-20c2-4949-bcae-d11828ed67b4 on n-h1-862967-2 Oct 29 02:52:43.747735 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-e2ad13b2-9a4a-4de8-9d44-9a3c3f7d1673 req-807eabac-7553-4121-adbb-bdf008643bb2 service nova] Creating event network-changed:0612e19b-4219-4b23-80fd-a0d245ef44d1 for instance 36000641-20c2-4949-bcae-d11828ed67b4 on n-h1-862967-2 Oct 29 02:52:43.767028 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-e2ad13b2-9a4a-4de8-9d44-9a3c3f7d1673 req-807eabac-7553-4121-adbb-bdf008643bb2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.078526 Oct 29 02:52:43.768007 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 717/1545] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:43.778183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-605191e2-fd7e-4f4f-ab1e-324a18529561 tempest-FloatingIPDetailsTestJSON-436725891 tempest-FloatingIPDetailsTestJSON-436725891-project] Calling method '.version_select at 0x7ff053a229d0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:43.986899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9d21e570-1f97-4931-a5bd-0730f3c4454e tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:44.018491 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9d21e570-1f97-4931-a5bd-0730f3c4454e tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231" status: 200 len: 1354 microversion: 2.1 time: 1.030684 Oct 29 02:52:44.022343 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 829/1546] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:42 2022] GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231 => generated 1354 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:44.031382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-73cef419-72b2-4b21-8ab0-81a62f84a677 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:44.040894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-73cef419-72b2-4b21-8ab0-81a62f84a677 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:44.048588 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73cef419-72b2-4b21-8ab0-81a62f84a677 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:44.049361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73cef419-72b2-4b21-8ab0-81a62f84a677 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:44.050012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73cef419-72b2-4b21-8ab0-81a62f84a677 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:44.051239 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73cef419-72b2-4b21-8ab0-81a62f84a677 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:44.052020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73cef419-72b2-4b21-8ab0-81a62f84a677 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:44.052761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73cef419-72b2-4b21-8ab0-81a62f84a677 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:44.607713 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-605191e2-fd7e-4f4f-ab1e-324a18529561 tempest-FloatingIPDetailsTestJSON-436725891 tempest-FloatingIPDetailsTestJSON-436725891-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.838420 Oct 29 02:52:44.609960 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 718/1547] 10.222.0.46 () {58 vars in 1149 bytes} [Sat Oct 29 02:52:43 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:44.625271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e22033de-90e3-4d72-b526-0b082c28665d tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Calling method '.version_select at 0x7ff053aa4940>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:44.871266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-73cef419-72b2-4b21-8ab0-81a62f84a677 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:44.880710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-73cef419-72b2-4b21-8ab0-81a62f84a677 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:44.894865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-73cef419-72b2-4b21-8ab0-81a62f84a677 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:44.896104 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-73cef419-72b2-4b21-8ab0-81a62f84a677 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1488 microversion: 2.25 time: 0.870885 Oct 29 02:52:44.897039 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 830/1548] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:44 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1488 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:44.928661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bac5a9ea-7bae-431a-b72e-a35d22414e58 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:44.943524 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bac5a9ea-7bae-431a-b72e-a35d22414e58 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] [instance: 1a47d89b-54a0-40a2-9572-c88ee55e6b5e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:44.965547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bac5a9ea-7bae-431a-b72e-a35d22414e58 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:44.966047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bac5a9ea-7bae-431a-b72e-a35d22414e58 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:44.966483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bac5a9ea-7bae-431a-b72e-a35d22414e58 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:44.969656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bac5a9ea-7bae-431a-b72e-a35d22414e58 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:44.970361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bac5a9ea-7bae-431a-b72e-a35d22414e58 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:44.974635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bac5a9ea-7bae-431a-b72e-a35d22414e58 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:45.039881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bac5a9ea-7bae-431a-b72e-a35d22414e58 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] [instance: 1a47d89b-54a0-40a2-9572-c88ee55e6b5e] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:52:45.122783 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e22033de-90e3-4d72-b526-0b082c28665d tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/62f3371e7d5a4182a2853707861d0c60/defaults" status: 200 len: 371 microversion: 2.1 time: 0.510977 Oct 29 02:52:45.124301 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 719/1549] 10.222.0.46 () {58 vars in 1269 bytes} [Sat Oct 29 02:52:44 2022] GET /compute/v2.1/os-quota-sets/62f3371e7d5a4182a2853707861d0c60/defaults => generated 371 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:45.134759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-30555d95-d60c-4d82-84b4-229e22d30436 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:45.149165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-30555d95-d60c-4d82-84b4-229e22d30436 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 1123b300-f298-4071-bff4-8ddc088ee57f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:45.195090 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30555d95-d60c-4d82-84b4-229e22d30436 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:45.202501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30555d95-d60c-4d82-84b4-229e22d30436 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:45.203041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30555d95-d60c-4d82-84b4-229e22d30436 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:45.210714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30555d95-d60c-4d82-84b4-229e22d30436 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:45.211219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30555d95-d60c-4d82-84b4-229e22d30436 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:45.213505 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30555d95-d60c-4d82-84b4-229e22d30436 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:45.336850 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bac5a9ea-7bae-431a-b72e-a35d22414e58 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e" status: 204 len: 0 microversion: 2.1 time: 0.412503 Oct 29 02:52:45.338089 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 831/1550] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:52:44 2022] DELETE /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:52:45.350153 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-51cd1be8-cfb2-42b0-81f5-8e7d9ae0804a req-f5e45acf-de32-4591-913e-4e300b73a024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1123b300-f298-4071-bff4-8ddc088ee57f", "tag": "94ed150d-ec19-4ada-8ecf-11ff8e7dc70e"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:45.401864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-51cd1be8-cfb2-42b0-81f5-8e7d9ae0804a req-f5e45acf-de32-4591-913e-4e300b73a024 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:45.402983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-51cd1be8-cfb2-42b0-81f5-8e7d9ae0804a req-f5e45acf-de32-4591-913e-4e300b73a024 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:45.404886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-51cd1be8-cfb2-42b0-81f5-8e7d9ae0804a req-f5e45acf-de32-4591-913e-4e300b73a024 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:45.475241 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-51cd1be8-cfb2-42b0-81f5-8e7d9ae0804a req-f5e45acf-de32-4591-913e-4e300b73a024 service nova] Creating event network-changed:94ed150d-ec19-4ada-8ecf-11ff8e7dc70e for instance 1123b300-f298-4071-bff4-8ddc088ee57f on n-h1-862967-2 Oct 29 02:52:45.496985 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-51cd1be8-cfb2-42b0-81f5-8e7d9ae0804a req-f5e45acf-de32-4591-913e-4e300b73a024 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155707 Oct 29 02:52:45.499082 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 832/1551] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:45.531920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c3a9187d-970e-4da0-9ea5-34ad60baec40 tempest-FloatingIPDetailsTestJSON-436725891 tempest-FloatingIPDetailsTestJSON-436725891-project] Calling method '.version_select at 0x7ff053a2f820>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:46.470839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-30555d95-d60c-4d82-84b4-229e22d30436 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844dbc8e54d349ea93c632c54909a718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b7aa3004d94c5a8cf87d5f4d006a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:46.486834 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-30555d95-d60c-4d82-84b4-229e22d30436 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f" status: 200 len: 1318 microversion: 2.1 time: 1.360239 Oct 29 02:52:46.498551 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 720/1552] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:45 2022] GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f => generated 1318 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:46.521296 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-462c9182-5ad5-4540-aac7-1ebf237ff2ae tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:46.521931 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-462c9182-5ad5-4540-aac7-1ebf237ff2ae tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 500595ea-1c83-4574-b6c8-2d6cc39b2231] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:46.539492 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-462c9182-5ad5-4540-aac7-1ebf237ff2ae tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:46.540662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-462c9182-5ad5-4540-aac7-1ebf237ff2ae tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:46.541103 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-462c9182-5ad5-4540-aac7-1ebf237ff2ae tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:46.544890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-462c9182-5ad5-4540-aac7-1ebf237ff2ae tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:46.545455 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-462c9182-5ad5-4540-aac7-1ebf237ff2ae tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:46.545884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-462c9182-5ad5-4540-aac7-1ebf237ff2ae tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:47.515892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-462c9182-5ad5-4540-aac7-1ebf237ff2ae tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:47.527115 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-462c9182-5ad5-4540-aac7-1ebf237ff2ae tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231" status: 200 len: 1354 microversion: 2.1 time: 1.037103 Oct 29 02:52:47.530272 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 721/1553] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:46 2022] GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231 => generated 1354 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:47.551889 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-275daa8e-f15d-4a68-b013-57d3ed6ccf84 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:47.552931 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-275daa8e-f15d-4a68-b013-57d3ed6ccf84 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] [instance: 1a47d89b-54a0-40a2-9572-c88ee55e6b5e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:47.576375 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-275daa8e-f15d-4a68-b013-57d3ed6ccf84 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:47.578019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-275daa8e-f15d-4a68-b013-57d3ed6ccf84 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:47.582137 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-275daa8e-f15d-4a68-b013-57d3ed6ccf84 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:47.583014 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-275daa8e-f15d-4a68-b013-57d3ed6ccf84 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:47.583490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-275daa8e-f15d-4a68-b013-57d3ed6ccf84 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:47.583926 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-275daa8e-f15d-4a68-b013-57d3ed6ccf84 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:48.846083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-275daa8e-f15d-4a68-b013-57d3ed6ccf84 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cdc8abe2dbf4479b2bd859c37bb204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449eab5d48df46be8b15f1094286b0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:48.848538 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=65 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:48.863326 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-275daa8e-f15d-4a68-b013-57d3ed6ccf84 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] 10.222.0.46 "GET /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e" status: 200 len: 1510 microversion: 2.1 time: 1.327021 Oct 29 02:52:48.864422 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 722/1554] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:47 2022] GET /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e => generated 1510 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:48.878017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2a9702c3-3bfa-4d00-b9a5-409036f154aa tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Action: 'update', calling method: .version_select at 0x7ff053819ca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:49.151370 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a9702c3-3bfa-4d00-b9a5-409036f154aa tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:49.154640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a9702c3-3bfa-4d00-b9a5-409036f154aa tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:49.156023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a9702c3-3bfa-4d00-b9a5-409036f154aa tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:49.160680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a9702c3-3bfa-4d00-b9a5-409036f154aa tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:49.161587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a9702c3-3bfa-4d00-b9a5-409036f154aa tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:49.163224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a9702c3-3bfa-4d00-b9a5-409036f154aa tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:49.258958 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2a9702c3-3bfa-4d00-b9a5-409036f154aa tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/bbb5af4abd034709bdc7a07a64d14256" status: 200 len: 328 microversion: 2.1 time: 0.393253 Oct 29 02:52:49.265248 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 723/1555] 10.222.0.46 () {60 vars in 1262 bytes} [Sat Oct 29 02:52:48 2022] PUT /compute/v2.1/os-quota-sets/bbb5af4abd034709bdc7a07a64d14256 => generated 328 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:49.317237 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2e85d467-0682-4f83-8dd1-6fbce93030c8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:49.323213 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2e85d467-0682-4f83-8dd1-6fbce93030c8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:49.359182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e85d467-0682-4f83-8dd1-6fbce93030c8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:49.360404 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e85d467-0682-4f83-8dd1-6fbce93030c8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:49.360945 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e85d467-0682-4f83-8dd1-6fbce93030c8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:49.361899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e85d467-0682-4f83-8dd1-6fbce93030c8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:49.363501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e85d467-0682-4f83-8dd1-6fbce93030c8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:49.363987 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e85d467-0682-4f83-8dd1-6fbce93030c8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:49.627292 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c3a9187d-970e-4da0-9ea5-34ad60baec40 tempest-FloatingIPDetailsTestJSON-436725891 tempest-FloatingIPDetailsTestJSON-436725891-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/6de5e3a8-592c-4d0b-b7bd-11316ff38dfe" status: 202 len: 0 microversion: 2.1 time: 4.120385 Oct 29 02:52:49.629975 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 833/1556] 10.222.0.46 () {58 vars in 1263 bytes} [Sat Oct 29 02:52:45 2022] DELETE /compute/v2.1/os-floating-ips/6de5e3a8-592c-4d0b-b7bd-11316ff38dfe => generated 0 bytes in 4130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:52:49.640755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7fbc1021-a88a-4d70-ab81-f006f50fe695 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:49.647618 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7fbc1021-a88a-4d70-ab81-f006f50fe695 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 1123b300-f298-4071-bff4-8ddc088ee57f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:49.669600 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7fbc1021-a88a-4d70-ab81-f006f50fe695 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:49.670384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7fbc1021-a88a-4d70-ab81-f006f50fe695 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:49.671010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7fbc1021-a88a-4d70-ab81-f006f50fe695 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:49.671931 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7fbc1021-a88a-4d70-ab81-f006f50fe695 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:49.672607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7fbc1021-a88a-4d70-ab81-f006f50fe695 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:49.673266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7fbc1021-a88a-4d70-ab81-f006f50fe695 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:50.050976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2e85d467-0682-4f83-8dd1-6fbce93030c8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:50.072653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2e85d467-0682-4f83-8dd1-6fbce93030c8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:50.074722 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2e85d467-0682-4f83-8dd1-6fbce93030c8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:50.077329 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2e85d467-0682-4f83-8dd1-6fbce93030c8 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1488 microversion: 2.25 time: 0.808110 Oct 29 02:52:50.078350 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 724/1557] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:49 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1488 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:50.108927 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-53f0e564-6a97-4031-bfb6-a669e0b91fe2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:50.112662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-53f0e564-6a97-4031-bfb6-a669e0b91fe2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 500595ea-1c83-4574-b6c8-2d6cc39b2231] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:50.117462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7fbc1021-a88a-4d70-ab81-f006f50fe695 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844dbc8e54d349ea93c632c54909a718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b7aa3004d94c5a8cf87d5f4d006a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:50.126598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53f0e564-6a97-4031-bfb6-a669e0b91fe2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:50.127610 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53f0e564-6a97-4031-bfb6-a669e0b91fe2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:50.127913 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7fbc1021-a88a-4d70-ab81-f006f50fe695 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f" status: 200 len: 1318 microversion: 2.1 time: 0.495747 Oct 29 02:52:50.128607 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 834/1558] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:49 2022] GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f => generated 1318 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:50.129235 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53f0e564-6a97-4031-bfb6-a669e0b91fe2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:50.130157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53f0e564-6a97-4031-bfb6-a669e0b91fe2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:50.130813 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53f0e564-6a97-4031-bfb6-a669e0b91fe2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:50.131440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53f0e564-6a97-4031-bfb6-a669e0b91fe2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:50.135901 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-2b663543-7022-49f8-90d3-fadd27165064 req-86a32f2f-2069-4bc5-8da8-b6fead27f186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd", "name": "network-vif-plugged", "status": "completed", "tag": "9daf432c-ab9e-41ed-aaf7-21cb4e7d509f"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:50.149030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-2b663543-7022-49f8-90d3-fadd27165064 req-86a32f2f-2069-4bc5-8da8-b6fead27f186 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:50.149806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-2b663543-7022-49f8-90d3-fadd27165064 req-86a32f2f-2069-4bc5-8da8-b6fead27f186 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:50.150408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-2b663543-7022-49f8-90d3-fadd27165064 req-86a32f2f-2069-4bc5-8da8-b6fead27f186 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:50.167621 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-2b663543-7022-49f8-90d3-fadd27165064 req-86a32f2f-2069-4bc5-8da8-b6fead27f186 service nova] Creating event network-vif-plugged:9daf432c-ab9e-41ed-aaf7-21cb4e7d509f for instance 0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd on n-h1-862967-2 Oct 29 02:52:50.175252 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-2b663543-7022-49f8-90d3-fadd27165064 req-86a32f2f-2069-4bc5-8da8-b6fead27f186 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044729 Oct 29 02:52:50.176708 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 835/1559] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:50.187979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a9d41cba-4388-462d-bc1c-775d38c77686 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Calling method '.version_select at 0x7ff053a0d790>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:50.391157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9d41cba-4388-462d-bc1c-775d38c77686 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:50.391850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9d41cba-4388-462d-bc1c-775d38c77686 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:50.392630 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9d41cba-4388-462d-bc1c-775d38c77686 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:50.393596 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9d41cba-4388-462d-bc1c-775d38c77686 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:50.394339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9d41cba-4388-462d-bc1c-775d38c77686 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:50.394958 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9d41cba-4388-462d-bc1c-775d38c77686 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:50.442176 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a9d41cba-4388-462d-bc1c-775d38c77686 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/bbb5af4abd034709bdc7a07a64d14256/detail" status: 200 len: 916 microversion: 2.1 time: 0.263834 Oct 29 02:52:50.443031 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 836/1560] 10.222.0.46 () {58 vars in 1263 bytes} [Sat Oct 29 02:52:50 2022] GET /compute/v2.1/os-quota-sets/bbb5af4abd034709bdc7a07a64d14256/detail => generated 916 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:50.653161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c574a5b4-d3aa-432d-8e55-d8346f5ee7e8 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] Action: 'create', calling method: .version_select at 0x7ff0580821f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1884269400", "description": "tempest-description-815190486"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:50.822738 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-53f0e564-6a97-4031-bfb6-a669e0b91fe2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:50.909832 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-53f0e564-6a97-4031-bfb6-a669e0b91fe2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231" status: 200 len: 1354 microversion: 2.1 time: 0.825605 Oct 29 02:52:50.932266 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 725/1561] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:50 2022] GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231 => generated 1354 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:50.952561 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ae247af0-c560-4286-a975-ba528fcd7f3f tempest-FloatingIPDetailsTestJSON-436725891 tempest-FloatingIPDetailsTestJSON-436725891-project] Calling method '.version_select at 0x7ff05387aca0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:51.428142 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c574a5b4-d3aa-432d-8e55-d8346f5ee7e8 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.982830 Oct 29 02:52:51.430046 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 837/1562] 10.222.0.46 () {60 vars in 1180 bytes} [Sat Oct 29 02:52:50 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:51.442275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-46671369-2de4-4af0-bbf2-3f74db82cf02 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:51.449076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-46671369-2de4-4af0-bbf2-3f74db82cf02 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] [instance: 1a47d89b-54a0-40a2-9572-c88ee55e6b5e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:51.463110 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46671369-2de4-4af0-bbf2-3f74db82cf02 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:51.464305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46671369-2de4-4af0-bbf2-3f74db82cf02 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:51.465678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46671369-2de4-4af0-bbf2-3f74db82cf02 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:51.467940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46671369-2de4-4af0-bbf2-3f74db82cf02 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:51.469157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46671369-2de4-4af0-bbf2-3f74db82cf02 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:51.470374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46671369-2de4-4af0-bbf2-3f74db82cf02 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:51.569664 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46671369-2de4-4af0-bbf2-3f74db82cf02 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:51.570656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46671369-2de4-4af0-bbf2-3f74db82cf02 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:51.571779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46671369-2de4-4af0-bbf2-3f74db82cf02 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:51.573008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-46671369-2de4-4af0-bbf2-3f74db82cf02 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lazy-loading 'fault' on Instance uuid 1a47d89b-54a0-40a2-9572-c88ee55e6b5e {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:52:51.782707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-46671369-2de4-4af0-bbf2-3f74db82cf02 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cdc8abe2dbf4479b2bd859c37bb204a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '449eab5d48df46be8b15f1094286b0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:51.810562 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-46671369-2de4-4af0-bbf2-3f74db82cf02 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] 10.222.0.46 "GET /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e" status: 200 len: 1306 microversion: 2.1 time: 0.375362 Oct 29 02:52:51.812908 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 838/1563] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:51 2022] GET /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e => generated 1306 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:51.829865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-7456b62d-1828-41f3-a765-906d10ef3b66 req-c613caea-c5a1-46f4-a258-56b999c69230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a47d89b-54a0-40a2-9572-c88ee55e6b5e", "name": "network-vif-deleted", "tag": "c11bfad0-89c4-4755-8bc3-bd8eeacde306"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:51.868624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7456b62d-1828-41f3-a765-906d10ef3b66 req-c613caea-c5a1-46f4-a258-56b999c69230 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:51.869560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7456b62d-1828-41f3-a765-906d10ef3b66 req-c613caea-c5a1-46f4-a258-56b999c69230 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:51.870631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7456b62d-1828-41f3-a765-906d10ef3b66 req-c613caea-c5a1-46f4-a258-56b999c69230 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:51.941978 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-7456b62d-1828-41f3-a765-906d10ef3b66 req-c613caea-c5a1-46f4-a258-56b999c69230 service nova] Creating event network-vif-deleted:c11bfad0-89c4-4755-8bc3-bd8eeacde306 for instance 1a47d89b-54a0-40a2-9572-c88ee55e6b5e on n-h2-862967-2 Oct 29 02:52:51.962808 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-7456b62d-1828-41f3-a765-906d10ef3b66 req-c613caea-c5a1-46f4-a258-56b999c69230 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144742 Oct 29 02:52:51.966431 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 839/1564] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:51.980923 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1e475c29-bb65-4eb9-9689-bc2392b33b27 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Action: 'update', calling method: .version_select at 0x7ff0580821f0>, body: {"quota_set": {"ram": "2048"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:52.151290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e475c29-bb65-4eb9-9689-bc2392b33b27 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:52.155052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e475c29-bb65-4eb9-9689-bc2392b33b27 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:52.156906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e475c29-bb65-4eb9-9689-bc2392b33b27 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:52.160716 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e475c29-bb65-4eb9-9689-bc2392b33b27 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:52.161800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e475c29-bb65-4eb9-9689-bc2392b33b27 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:52.162887 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e475c29-bb65-4eb9-9689-bc2392b33b27 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:52.269484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e475c29-bb65-4eb9-9689-bc2392b33b27 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:52.270630 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e475c29-bb65-4eb9-9689-bc2392b33b27 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:52.271783 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e475c29-bb65-4eb9-9689-bc2392b33b27 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:52.274998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e475c29-bb65-4eb9-9689-bc2392b33b27 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:52.274998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e475c29-bb65-4eb9-9689-bc2392b33b27 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:52.275365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e475c29-bb65-4eb9-9689-bc2392b33b27 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:52.448555 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1e475c29-bb65-4eb9-9689-bc2392b33b27 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/bbb5af4abd034709bdc7a07a64d14256?user_id=fd3438851cc0462380d08ce02eadfd03" status: 200 len: 328 microversion: 2.1 time: 0.476524 Oct 29 02:52:52.452878 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 840/1565] 10.222.0.46 () {60 vars in 1343 bytes} [Sat Oct 29 02:52:51 2022] PUT /compute/v2.1/os-quota-sets/bbb5af4abd034709bdc7a07a64d14256?user_id=fd3438851cc0462380d08ce02eadfd03 => generated 328 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:52.467126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c894e063-6076-44d8-bc1d-e9c5bd0cba80 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:52.468673 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c894e063-6076-44d8-bc1d-e9c5bd0cba80 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:52.481548 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c894e063-6076-44d8-bc1d-e9c5bd0cba80 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:52.482575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c894e063-6076-44d8-bc1d-e9c5bd0cba80 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:52.483750 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c894e063-6076-44d8-bc1d-e9c5bd0cba80 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:52.485042 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c894e063-6076-44d8-bc1d-e9c5bd0cba80 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:52.485969 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c894e063-6076-44d8-bc1d-e9c5bd0cba80 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:52.487094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c894e063-6076-44d8-bc1d-e9c5bd0cba80 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:52.742412 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c894e063-6076-44d8-bc1d-e9c5bd0cba80 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:52.760457 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c894e063-6076-44d8-bc1d-e9c5bd0cba80 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:52.764382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c894e063-6076-44d8-bc1d-e9c5bd0cba80 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:52.766488 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c894e063-6076-44d8-bc1d-e9c5bd0cba80 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1488 microversion: 2.25 time: 0.308170 Oct 29 02:52:52.767447 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 841/1566] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:52 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1488 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:52.778770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-59f6de46-1f37-4085-b14b-57b722aa0dc7 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:52.784374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-59f6de46-1f37-4085-b14b-57b722aa0dc7 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 1123b300-f298-4071-bff4-8ddc088ee57f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:52.796373 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59f6de46-1f37-4085-b14b-57b722aa0dc7 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:52.797300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59f6de46-1f37-4085-b14b-57b722aa0dc7 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:52.798063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59f6de46-1f37-4085-b14b-57b722aa0dc7 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:52.799370 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59f6de46-1f37-4085-b14b-57b722aa0dc7 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:52.800243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59f6de46-1f37-4085-b14b-57b722aa0dc7 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:52.803368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59f6de46-1f37-4085-b14b-57b722aa0dc7 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:53.042335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-59f6de46-1f37-4085-b14b-57b722aa0dc7 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844dbc8e54d349ea93c632c54909a718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b7aa3004d94c5a8cf87d5f4d006a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:53.057744 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-59f6de46-1f37-4085-b14b-57b722aa0dc7 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f" status: 200 len: 1318 microversion: 2.1 time: 0.288794 Oct 29 02:52:53.058342 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 842/1567] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:52 2022] GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:53.079496 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d8c1586c-7123-41c1-b065-9c10a362b3df tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] Action: 'create', calling method: .version_select at 0x7ff053a50280>, body: {"security_group_rule": {"parent_group_id": "027ef978-dda6-40c1-a8cd-8f2f1bb14d25", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:53.312863 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d8c1586c-7123-41c1-b065-9c10a362b3df tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.253415 Oct 29 02:52:53.323791 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 843/1568] 10.222.0.46 () {60 vars in 1195 bytes} [Sat Oct 29 02:52:53 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:53.328733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3acfcf18-c465-48f7-9919-182510278d4f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:53.329611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3acfcf18-c465-48f7-9919-182510278d4f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 500595ea-1c83-4574-b6c8-2d6cc39b2231] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:53.337245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3acfcf18-c465-48f7-9919-182510278d4f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:53.337668 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3acfcf18-c465-48f7-9919-182510278d4f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:53.338060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3acfcf18-c465-48f7-9919-182510278d4f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:53.339042 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3acfcf18-c465-48f7-9919-182510278d4f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:53.339487 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3acfcf18-c465-48f7-9919-182510278d4f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:53.340098 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3acfcf18-c465-48f7-9919-182510278d4f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:53.507308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3acfcf18-c465-48f7-9919-182510278d4f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:53.516284 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3acfcf18-c465-48f7-9919-182510278d4f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231" status: 200 len: 1354 microversion: 2.1 time: 0.191392 Oct 29 02:52:53.517222 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 844/1569] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:53 2022] GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231 => generated 1354 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:53.537462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fcf30fd5-5c17-4baf-b2e7-ee2bd498c7ab tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Calling method '.version_select at 0x7ff053a53670>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:53.626923 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fcf30fd5-5c17-4baf-b2e7-ee2bd498c7ab tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/bbb5af4abd034709bdc7a07a64d14256?user_id=fd3438851cc0462380d08ce02eadfd03" status: 200 len: 370 microversion: 2.1 time: 0.096622 Oct 29 02:52:53.637401 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 845/1570] 10.222.0.46 () {58 vars in 1323 bytes} [Sat Oct 29 02:52:53 2022] GET /compute/v2.1/os-quota-sets/bbb5af4abd034709bdc7a07a64d14256?user_id=fd3438851cc0462380d08ce02eadfd03 => generated 370 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:53.647940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-815b3e78-1369-4ece-8d5e-5ce992404237 req-59b40eef-3603-4134-9c1b-6f9267321052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1123b300-f298-4071-bff4-8ddc088ee57f", "name": "network-vif-plugged", "status": "completed", "tag": "94ed150d-ec19-4ada-8ecf-11ff8e7dc70e"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:53.679586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-815b3e78-1369-4ece-8d5e-5ce992404237 req-59b40eef-3603-4134-9c1b-6f9267321052 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:53.679884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-815b3e78-1369-4ece-8d5e-5ce992404237 req-59b40eef-3603-4134-9c1b-6f9267321052 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:53.680322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-815b3e78-1369-4ece-8d5e-5ce992404237 req-59b40eef-3603-4134-9c1b-6f9267321052 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:53.693563 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-815b3e78-1369-4ece-8d5e-5ce992404237 req-59b40eef-3603-4134-9c1b-6f9267321052 service nova] Creating event network-vif-plugged:94ed150d-ec19-4ada-8ecf-11ff8e7dc70e for instance 1123b300-f298-4071-bff4-8ddc088ee57f on n-h1-862967-2 Oct 29 02:52:53.703610 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-815b3e78-1369-4ece-8d5e-5ce992404237 req-59b40eef-3603-4134-9c1b-6f9267321052 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061634 Oct 29 02:52:53.708746 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 846/1571] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:53.714668 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a9fe3e32-37bf-4a30-9ff0-b61edfc95db3 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:53.715393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a9fe3e32-37bf-4a30-9ff0-b61edfc95db3 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] [instance: 1a47d89b-54a0-40a2-9572-c88ee55e6b5e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:53.726327 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9fe3e32-37bf-4a30-9ff0-b61edfc95db3 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:53.727200 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9fe3e32-37bf-4a30-9ff0-b61edfc95db3 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:53.727839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9fe3e32-37bf-4a30-9ff0-b61edfc95db3 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:53.730878 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9fe3e32-37bf-4a30-9ff0-b61edfc95db3 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:53.731734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9fe3e32-37bf-4a30-9ff0-b61edfc95db3 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:53.732343 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9fe3e32-37bf-4a30-9ff0-b61edfc95db3 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:53.757952 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-a9fe3e32-37bf-4a30-9ff0-b61edfc95db3 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] HTTP exception thrown: Instance 1a47d89b-54a0-40a2-9572-c88ee55e6b5e could not be found. Oct 29 02:52:53.760846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a9fe3e32-37bf-4a30-9ff0-b61edfc95db3 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Request method failure captured: Oct 29 02:52:53.760846 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e HTTP/1.1 Oct 29 02:52:53.760846 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:52:53.760846 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:52:53.760846 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:52:53.760846 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:52:53.760846 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:52:53.760846 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:52:53.760846 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:52:53.760846 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:52:53.760846 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJViIDRXaZ-9NBUZJ_11iyUz9NJPRNFPdH0zep6fik63VjSU4mum551ysD_9EIL3kW0ojFcr8jsgEHlRrUPE5TYb9KkzDs4EygPjz99CE3t2JxLZnbzjMRl2CyYvcVkRvkHe2y2uujxe_kOoZRtvYYP70QoYUxpBFn0MIkif9sBe7Xc Oct 29 02:52:53.760846 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:52:53.760846 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:52:53.760846 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:52:53.760846 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:52:53.760846 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:52:53.760846 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:52:53.760846 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 449eab5d48df46be8b15f1094286b0d7 Oct 29 02:52:53.760846 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ImagesNegativeTestJSON-1907967757 Oct 29 02:52:53.760846 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:52:53.760846 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:52:53.763040 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/449eab5d48df46be8b15f1094286b0d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/449eab5d48df46be8b15f1094286b0d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_449eab5d48df46be8b15f1094286b0d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/449eab5d48df46be8b15f1094286b0d7"}]}] Oct 29 02:52:53.763040 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ImagesNegativeTestJSON-1907967757 Oct 29 02:52:53.763040 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 449eab5d48df46be8b15f1094286b0d7 Oct 29 02:52:53.763040 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1907967757 Oct 29 02:52:53.763040 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ImagesNegativeTestJSON-1907967757-project Oct 29 02:52:53.763040 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:52:53.763040 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:52:53.763040 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 2cdc8abe2dbf4479b2bd859c37bb204a Oct 29 02:52:53.763040 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ImagesNegativeTestJSON-1907967757-project Oct 29 02:52:53.763040 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:52:53.763040 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 1a47d89b-54a0-40a2-9572-c88ee55e6b5e could not be found. Oct 29 02:52:53.763040 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '1a47d89b-54a0-40a2-9572-c88ee55e6b5e'} Oct 29 02:52:53.764021 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:52:53.764021 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:53.764021 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:52:53.764021 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:52:53.764021 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:52:53.764021 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:52:53.764021 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:52:53.764021 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:52:53.764021 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:52:53.764021 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:52:53.764021 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a47d89b-54a0-40a2-9572-c88ee55e6b5e could not be found. Oct 29 02:52:53.764021 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:53.764021 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:53.764021 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:53.764021 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:53.764021 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:53.764021 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:53.764021 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:52:53.764021 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:52:53.764021 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:52:53.765750 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:52:53.765750 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:52:53.765750 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:52:53.765750 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:52:53.765750 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:52:53.765750 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:52:53.765750 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:52:53.765750 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a47d89b-54a0-40a2-9572-c88ee55e6b5e could not be found. Oct 29 02:52:53.765750 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:53.765750 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:53.765750 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:53.765750 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:53.765750 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:53.765750 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:53.765750 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:52:53.765750 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:52:53.765750 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a47d89b-54a0-40a2-9572-c88ee55e6b5e could not be found. Oct 29 02:52:53.765750 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:53.768967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a9fe3e32-37bf-4a30-9ff0-b61edfc95db3 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Returning 404 to user: Instance 1a47d89b-54a0-40a2-9572-c88ee55e6b5e could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:52:53.770737 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a9fe3e32-37bf-4a30-9ff0-b61edfc95db3 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] 10.222.0.46 "GET /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e" status: 404 len: 111 microversion: 2.1 time: 0.060477 Oct 29 02:52:53.772146 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 847/1572] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:53 2022] GET /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:52:53.778614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-131fbcd5-6cd4-45fe-9735-9a6e4ecccdf0 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Action: 'create', calling method: .version_select at 0x7ff053cbe820>, body: {"keypair": {"name": "tempest-keypair-542832441", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBML1oCoHukDRBwZGT5xLu06u7+Wm+bd8fMMYBzNDRcz6UCwD2kAf2A0ZHINnJ54Z8UQjc8Mgi3c3EGJ3Cn1TbVeXYc1Bd5n5UFpPNeTmOEylgGBFj3j++WzUcKP1G9ikuA=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:53.791576 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ae247af0-c560-4286-a975-ba528fcd7f3f tempest-FloatingIPDetailsTestJSON-436725891 tempest-FloatingIPDetailsTestJSON-436725891-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/f6632e92-3bc8-4c8c-b8a0-6d4024a63ba0" status: 202 len: 0 microversion: 2.1 time: 2.855077 Oct 29 02:52:53.792169 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 726/1573] 10.222.0.46 () {58 vars in 1263 bytes} [Sat Oct 29 02:52:50 2022] DELETE /compute/v2.1/os-floating-ips/f6632e92-3bc8-4c8c-b8a0-6d4024a63ba0 => generated 0 bytes in 2859 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:52:53.801949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dc38c760-8dcf-4180-8eb8-16ca9ea5087a tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] Action: 'create', calling method: .version_select at 0x7ff053886790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1599997773", "description": "tempest-description-413849294"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:53.807997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-131fbcd5-6cd4-45fe-9735-9a6e4ecccdf0 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Getting quotas for project c3b1881976f4493996c2ba4a67afc637. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:52:53.819719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:53.822880 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-131fbcd5-6cd4-45fe-9735-9a6e4ecccdf0 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Getting quotas for user 1b91e3a384214f79a0333e35e5ad3378 and project c3b1881976f4493996c2ba4a67afc637. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:52:53.868548 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-131fbcd5-6cd4-45fe-9735-9a6e4ecccdf0 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.094859 Oct 29 02:52:53.869902 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 848/1574] 10.222.0.46 () {62 vars in 1200 bytes} [Sat Oct 29 02:52:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 97 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 02:52:53.877255 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-41c81353-9640-444a-81e7-e86c71e62d4d tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1921984162", "metadata": {"image_type": "test"}}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:53.884844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-41c81353-9640-444a-81e7-e86c71e62d4d tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] [instance: 1a47d89b-54a0-40a2-9572-c88ee55e6b5e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:53.911668 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41c81353-9640-444a-81e7-e86c71e62d4d tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:53.912252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41c81353-9640-444a-81e7-e86c71e62d4d tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:53.912831 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41c81353-9640-444a-81e7-e86c71e62d4d tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:53.914183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41c81353-9640-444a-81e7-e86c71e62d4d tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:53.914800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41c81353-9640-444a-81e7-e86c71e62d4d tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:53.915657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41c81353-9640-444a-81e7-e86c71e62d4d tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:53.950030 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-41c81353-9640-444a-81e7-e86c71e62d4d tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] HTTP exception thrown: Instance 1a47d89b-54a0-40a2-9572-c88ee55e6b5e could not be found. Oct 29 02:52:53.952306 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-41c81353-9640-444a-81e7-e86c71e62d4d tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Request method failure captured: Oct 29 02:52:53.952306 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e/action HTTP/1.1 Oct 29 02:52:53.952306 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:52:53.952306 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:52:53.952306 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:52:53.952306 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 112 Oct 29 02:52:53.952306 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:52:53.952306 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:52:53.952306 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:52:53.952306 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:52:53.952306 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJViIDRXaZ-9NBUZJ_11iyUz9NJPRNFPdH0zep6fik63VjSU4mum551ysD_9EIL3kW0ojFcr8jsgEHlRrUPE5TYb9KkzDs4EygPjz99CE3t2JxLZnbzjMRl2CyYvcVkRvkHe2y2uujxe_kOoZRtvYYP70QoYUxpBFn0MIkif9sBe7Xc Oct 29 02:52:53.952306 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:52:53.952306 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:52:53.952306 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:52:53.952306 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:52:53.952306 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:52:53.952306 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:52:53.952306 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 449eab5d48df46be8b15f1094286b0d7 Oct 29 02:52:53.952306 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ImagesNegativeTestJSON-1907967757 Oct 29 02:52:53.952306 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:52:53.952306 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:52:53.953895 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/449eab5d48df46be8b15f1094286b0d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/449eab5d48df46be8b15f1094286b0d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_449eab5d48df46be8b15f1094286b0d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/449eab5d48df46be8b15f1094286b0d7"}]}] Oct 29 02:52:53.953895 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ImagesNegativeTestJSON-1907967757 Oct 29 02:52:53.953895 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 449eab5d48df46be8b15f1094286b0d7 Oct 29 02:52:53.953895 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1907967757 Oct 29 02:52:53.953895 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ImagesNegativeTestJSON-1907967757-project Oct 29 02:52:53.953895 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:52:53.953895 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:52:53.953895 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 2cdc8abe2dbf4479b2bd859c37bb204a Oct 29 02:52:53.953895 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ImagesNegativeTestJSON-1907967757-project Oct 29 02:52:53.953895 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:52:53.953895 n-d-862967-2 devstack@n-api.service[127124]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1921984162", "metadata": {"image_type": "test"}}} Oct 29 02:52:53.953895 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:52:53.954742 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 1a47d89b-54a0-40a2-9572-c88ee55e6b5e could not be found. Oct 29 02:52:53.954742 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '1a47d89b-54a0-40a2-9572-c88ee55e6b5e', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1921984162', 'metadata': {'image_type': 'test'}}}} Oct 29 02:52:53.954742 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:52:53.954742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:53.954742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:52:53.954742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:52:53.954742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:52:53.954742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:52:53.954742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:52:53.954742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:52:53.954742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:52:53.954742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:52:53.954742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a47d89b-54a0-40a2-9572-c88ee55e6b5e could not be found. Oct 29 02:52:53.954742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:53.954742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:53.954742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:53.954742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:53.954742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:53.954742 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:53.955992 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:52:53.955992 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:52:53.955992 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:52:53.955992 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:52:53.955992 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:52:53.955992 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:52:53.955992 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:52:53.955992 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:52:53.955992 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 29 02:52:53.955992 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 02:52:53.955992 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:52:53.955992 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:52:53.955992 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:52:53.955992 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:52:53.955992 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a47d89b-54a0-40a2-9572-c88ee55e6b5e could not be found. Oct 29 02:52:53.955992 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:53.955992 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:53.955992 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:53.955992 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:53.955992 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:53.957607 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:53.957607 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:52:53.957607 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:52:53.957607 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a47d89b-54a0-40a2-9572-c88ee55e6b5e could not be found. Oct 29 02:52:53.957607 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:52:53.960254 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-41c81353-9640-444a-81e7-e86c71e62d4d tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Returning 404 to user: Instance 1a47d89b-54a0-40a2-9572-c88ee55e6b5e could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:52:53.961348 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-41c81353-9640-444a-81e7-e86c71e62d4d tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] 10.222.0.46 "POST /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e/action" status: 404 len: 111 microversion: 2.1 time: 0.089799 Oct 29 02:52:53.966852 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 849/1575] 10.222.0.46 () {60 vars in 1279 bytes} [Sat Oct 29 02:52:53 2022] POST /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e/action => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:52:53.972309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ce6b78b0-64c0-43d5-8411-ed3dd2c2d9df tempest-FloatingIPDetailsTestJSON-436725891 tempest-FloatingIPDetailsTestJSON-436725891-project] Calling method '.version_select at 0x7ff0586d2820>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:54.418675 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dc38c760-8dcf-4180-8eb8-16ca9ea5087a tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.622401 Oct 29 02:52:54.420739 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 727/1576] 10.222.0.46 () {60 vars in 1180 bytes} [Sat Oct 29 02:52:53 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:54.435065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5cfae44f-a9cc-4e59-9385-1aa9069b558e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:54.435846 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5cfae44f-a9cc-4e59-9385-1aa9069b558e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:54.451005 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5cfae44f-a9cc-4e59-9385-1aa9069b558e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:54.457211 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5cfae44f-a9cc-4e59-9385-1aa9069b558e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:54.458293 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5cfae44f-a9cc-4e59-9385-1aa9069b558e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:54.460426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5cfae44f-a9cc-4e59-9385-1aa9069b558e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:54.461487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5cfae44f-a9cc-4e59-9385-1aa9069b558e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:54.462379 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5cfae44f-a9cc-4e59-9385-1aa9069b558e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:54.651820 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5cfae44f-a9cc-4e59-9385-1aa9069b558e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:54.666826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5cfae44f-a9cc-4e59-9385-1aa9069b558e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:54.669989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5cfae44f-a9cc-4e59-9385-1aa9069b558e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:54.671687 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5cfae44f-a9cc-4e59-9385-1aa9069b558e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1478 microversion: 2.25 time: 0.249322 Oct 29 02:52:54.694425 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 728/1577] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:54 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1478 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:54.708265 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c2dd94e2-7de3-4410-9885-f52c2932c6ed tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1738052686", "metadata": {"image_type": "test"}}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:54.712002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c2dd94e2-7de3-4410-9885-f52c2932c6ed tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Failed to fetch instance by id tempest-invalid-1527702861 {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 29 02:52:54.713114 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-c2dd94e2-7de3-4410-9885-f52c2932c6ed tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] HTTP exception thrown: Instance tempest-invalid-1527702861 could not be found. Oct 29 02:52:54.716240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c2dd94e2-7de3-4410-9885-f52c2932c6ed tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Request method failure captured: Oct 29 02:52:54.716240 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers/tempest-invalid-1527702861/action HTTP/1.1 Oct 29 02:52:54.716240 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:52:54.716240 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:52:54.716240 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:52:54.716240 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 112 Oct 29 02:52:54.716240 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:52:54.716240 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:52:54.716240 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:52:54.716240 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:52:54.716240 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJViIDRXaZ-9NBUZJ_11iyUz9NJPRNFPdH0zep6fik63VjSU4mum551ysD_9EIL3kW0ojFcr8jsgEHlRrUPE5TYb9KkzDs4EygPjz99CE3t2JxLZnbzjMRl2CyYvcVkRvkHe2y2uujxe_kOoZRtvYYP70QoYUxpBFn0MIkif9sBe7Xc Oct 29 02:52:54.716240 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:52:54.716240 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:52:54.716240 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:52:54.716240 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:52:54.716240 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:52:54.716240 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:52:54.716240 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 449eab5d48df46be8b15f1094286b0d7 Oct 29 02:52:54.716240 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ImagesNegativeTestJSON-1907967757 Oct 29 02:52:54.716240 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:52:54.716240 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:52:54.718070 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/449eab5d48df46be8b15f1094286b0d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/449eab5d48df46be8b15f1094286b0d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_449eab5d48df46be8b15f1094286b0d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/449eab5d48df46be8b15f1094286b0d7"}]}] Oct 29 02:52:54.718070 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ImagesNegativeTestJSON-1907967757 Oct 29 02:52:54.718070 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 449eab5d48df46be8b15f1094286b0d7 Oct 29 02:52:54.718070 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1907967757 Oct 29 02:52:54.718070 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ImagesNegativeTestJSON-1907967757-project Oct 29 02:52:54.718070 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:52:54.718070 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:52:54.718070 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 2cdc8abe2dbf4479b2bd859c37bb204a Oct 29 02:52:54.718070 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ImagesNegativeTestJSON-1907967757-project Oct 29 02:52:54.718070 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:52:54.718070 n-d-862967-2 devstack@n-api.service[127125]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1738052686", "metadata": {"image_type": "test"}}} Oct 29 02:52:54.718070 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:52:54.719042 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance tempest-invalid-1527702861 could not be found. Oct 29 02:52:54.719042 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'tempest-invalid-1527702861', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1738052686', 'metadata': {'image_type': 'test'}}}} Oct 29 02:52:54.719042 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:52:54.719042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:54.719042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:52:54.719042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:52:54.719042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 29 02:52:54.719042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 29 02:52:54.719042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1527702861 could not be found. Oct 29 02:52:54.719042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:54.719042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:54.719042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:54.719042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:54.719042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:54.719042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:54.719042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:52:54.719042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:52:54.719042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:52:54.719042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:52:54.719042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:52:54.720453 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:52:54.720453 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:52:54.720453 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:52:54.720453 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 29 02:52:54.720453 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 02:52:54.720453 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:52:54.720453 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:52:54.720453 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:52:54.720453 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:52:54.720453 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1527702861 could not be found. Oct 29 02:52:54.720453 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:54.720453 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:54.720453 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:54.720453 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:54.720453 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:54.720453 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:54.720453 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:52:54.720453 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:52:54.720453 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1527702861 could not be found. Oct 29 02:52:54.720453 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:54.723169 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c2dd94e2-7de3-4410-9885-f52c2932c6ed tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Returning 404 to user: Instance tempest-invalid-1527702861 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:52:54.723169 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c2dd94e2-7de3-4410-9885-f52c2932c6ed tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] 10.222.0.46 "POST /compute/v2.1/servers/tempest-invalid-1527702861/action" status: 404 len: 101 microversion: 2.1 time: 0.021029 Oct 29 02:52:54.723169 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 729/1578] 10.222.0.46 () {60 vars in 1249 bytes} [Sat Oct 29 02:52:54 2022] POST /compute/v2.1/servers/tempest-invalid-1527702861/action => generated 101 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:52:54.728792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-51b93242-4211-4a37-a9b8-52fcff571bb7 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:54.730269 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-51b93242-4211-4a37-a9b8-52fcff571bb7 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 1123b300-f298-4071-bff4-8ddc088ee57f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:54.738380 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-51b93242-4211-4a37-a9b8-52fcff571bb7 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:54.739198 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-51b93242-4211-4a37-a9b8-52fcff571bb7 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:54.739739 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-51b93242-4211-4a37-a9b8-52fcff571bb7 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:54.740881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-51b93242-4211-4a37-a9b8-52fcff571bb7 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:54.741644 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-51b93242-4211-4a37-a9b8-52fcff571bb7 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:54.742647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-51b93242-4211-4a37-a9b8-52fcff571bb7 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:54.993864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-51b93242-4211-4a37-a9b8-52fcff571bb7 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844dbc8e54d349ea93c632c54909a718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b7aa3004d94c5a8cf87d5f4d006a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:55.011185 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-51b93242-4211-4a37-a9b8-52fcff571bb7 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f" status: 200 len: 1318 microversion: 2.1 time: 0.291062 Oct 29 02:52:55.012822 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 730/1579] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:54 2022] GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:55.018101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ad6ca236-a1f7-4a62-8613-f42fbe95a0c5 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Calling method '.version_select at 0x7ff053a229d0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:55.393573 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ce6b78b0-64c0-43d5-8411-ed3dd2c2d9df tempest-FloatingIPDetailsTestJSON-436725891 tempest-FloatingIPDetailsTestJSON-436725891-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/9f8fd557-5f56-422e-891a-442f653ab2e1" status: 202 len: 0 microversion: 2.1 time: 1.429877 Oct 29 02:52:55.394199 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 850/1580] 10.222.0.46 () {58 vars in 1263 bytes} [Sat Oct 29 02:52:53 2022] DELETE /compute/v2.1/os-floating-ips/9f8fd557-5f56-422e-891a-442f653ab2e1 => generated 0 bytes in 1432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:52:55.400762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8cc647df-a334-4d8a-8419-d6336ee411ac tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] Action: 'create', calling method: .version_select at 0x7ff053a7aca0>, body: {"security_group_rule": {"parent_group_id": "3f3e131e-88c8-4d49-842c-2a195b54a8c5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:55.407406 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ad6ca236-a1f7-4a62-8613-f42fbe95a0c5 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/62f3371e7d5a4182a2853707861d0c60/defaults" status: 200 len: 371 microversion: 2.1 time: 0.393183 Oct 29 02:52:55.407989 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 731/1581] 10.222.0.46 () {58 vars in 1269 bytes} [Sat Oct 29 02:52:55 2022] GET /compute/v2.1/os-quota-sets/62f3371e7d5a4182a2853707861d0c60/defaults => generated 371 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:55.423009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-27edfad0-92be-4dcc-a04f-62ac62fe3c0a tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:55.425240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-27edfad0-92be-4dcc-a04f-62ac62fe3c0a tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 500595ea-1c83-4574-b6c8-2d6cc39b2231] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:55.452838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27edfad0-92be-4dcc-a04f-62ac62fe3c0a tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:55.454439 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27edfad0-92be-4dcc-a04f-62ac62fe3c0a tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:55.455272 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27edfad0-92be-4dcc-a04f-62ac62fe3c0a tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:55.456885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27edfad0-92be-4dcc-a04f-62ac62fe3c0a tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:55.458199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27edfad0-92be-4dcc-a04f-62ac62fe3c0a tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:55.460678 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27edfad0-92be-4dcc-a04f-62ac62fe3c0a tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:55.825411 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-27edfad0-92be-4dcc-a04f-62ac62fe3c0a tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:55.846379 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-27edfad0-92be-4dcc-a04f-62ac62fe3c0a tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231" status: 200 len: 1354 microversion: 2.1 time: 0.434874 Oct 29 02:52:55.851839 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 732/1582] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:55 2022] GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231 => generated 1354 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:55.861762 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e85663a7-5c5a-47e0-b0ae-a88fc0239df8 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Calling method '.version_select at 0x7ff05388b1f0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:55.870246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e85663a7-5c5a-47e0-b0ae-a88fc0239df8 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:55.872155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e85663a7-5c5a-47e0-b0ae-a88fc0239df8 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:55.873502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e85663a7-5c5a-47e0-b0ae-a88fc0239df8 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:55.903969 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e85663a7-5c5a-47e0-b0ae-a88fc0239df8 tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 1940 microversion: 2.25 time: 0.050017 Oct 29 02:52:55.944335 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 733/1583] 10.222.0.46 () {60 vars in 1184 bytes} [Sat Oct 29 02:52:55 2022] GET /compute/v2.1/os-migrations => generated 1940 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:55.954462 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5482e343-f4ec-4f41-baaa-0788f207391c tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1921089173"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:55.959989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5482e343-f4ec-4f41-baaa-0788f207391c tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 29 02:52:55.960991 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-5482e343-f4ec-4f41-baaa-0788f207391c tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 02:52:55.963148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5482e343-f4ec-4f41-baaa-0788f207391c tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Request method failure captured: Oct 29 02:52:55.963148 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 29 02:52:55.963148 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:52:55.963148 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:52:55.963148 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:52:55.963148 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 57 Oct 29 02:52:55.963148 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:52:55.963148 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:52:55.963148 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:52:55.963148 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:52:55.963148 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJViIDRXaZ-9NBUZJ_11iyUz9NJPRNFPdH0zep6fik63VjSU4mum551ysD_9EIL3kW0ojFcr8jsgEHlRrUPE5TYb9KkzDs4EygPjz99CE3t2JxLZnbzjMRl2CyYvcVkRvkHe2y2uujxe_kOoZRtvYYP70QoYUxpBFn0MIkif9sBe7Xc Oct 29 02:52:55.963148 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:52:55.963148 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:52:55.963148 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:52:55.963148 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:52:55.963148 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:52:55.963148 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:52:55.963148 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 449eab5d48df46be8b15f1094286b0d7 Oct 29 02:52:55.963148 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ImagesNegativeTestJSON-1907967757 Oct 29 02:52:55.963148 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:52:55.963148 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:52:55.965063 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/449eab5d48df46be8b15f1094286b0d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/449eab5d48df46be8b15f1094286b0d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_449eab5d48df46be8b15f1094286b0d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/449eab5d48df46be8b15f1094286b0d7"}]}] Oct 29 02:52:55.965063 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ImagesNegativeTestJSON-1907967757 Oct 29 02:52:55.965063 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 449eab5d48df46be8b15f1094286b0d7 Oct 29 02:52:55.965063 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1907967757 Oct 29 02:52:55.965063 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ImagesNegativeTestJSON-1907967757-project Oct 29 02:52:55.965063 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:52:55.965063 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:52:55.965063 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 2cdc8abe2dbf4479b2bd859c37bb204a Oct 29 02:52:55.965063 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ImagesNegativeTestJSON-1907967757-project Oct 29 02:52:55.965063 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:52:55.965063 n-d-862967-2 devstack@n-api.service[127125]: {"createImage": {"name": "tempest-test-snap-1921089173"}} Oct 29 02:52:55.965063 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:52:55.965063 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 02:52:55.966437 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1921089173'}}} Oct 29 02:52:55.966437 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:52:55.966437 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:55.966437 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:52:55.966437 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:52:55.966437 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 29 02:52:55.966437 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 29 02:52:55.966437 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 02:52:55.966437 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:55.966437 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:55.966437 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:55.966437 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:55.966437 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:55.966437 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:55.966437 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:52:55.966437 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:52:55.966437 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:52:55.966437 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:52:55.966437 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:52:55.966437 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:52:55.970422 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:52:55.970422 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:52:55.970422 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 29 02:52:55.970422 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 02:52:55.970422 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:52:55.970422 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:52:55.970422 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:52:55.970422 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:52:55.970422 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 02:52:55.970422 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:55.970422 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:55.970422 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:55.970422 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:55.970422 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:55.970422 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:55.970422 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:52:55.970422 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:52:55.970422 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 02:52:55.970422 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:55.976258 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5482e343-f4ec-4f41-baaa-0788f207391c tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:52:55.976258 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5482e343-f4ec-4f41-baaa-0788f207391c tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] 10.222.0.46 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.017135 Oct 29 02:52:55.976258 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 734/1584] 10.222.0.46 () {60 vars in 1275 bytes} [Sat Oct 29 02:52:55 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:52:55.978625 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fd3a8cd7-dd9e-4d8a-928f-82f6617b64c0 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Action: 'update', calling method: .version_select at 0x7ff0539bf550>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:56.060274 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8cc647df-a334-4d8a-8419-d6336ee411ac tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.664589 Oct 29 02:52:56.061575 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 851/1585] 10.222.0.46 () {60 vars in 1195 bytes} [Sat Oct 29 02:52:55 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:56.066530 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-d9b68a67-6c78-4e07-8bbc-ff80532721e3 req-1026423b-245b-4dca-8153-87d8f29a627b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "500595ea-1c83-4574-b6c8-2d6cc39b2231", "name": "network-vif-plugged", "status": "completed", "tag": "dfcee5d6-4375-4d8f-8e2d-e3624086cfa5"}, {"server_uuid": "500595ea-1c83-4574-b6c8-2d6cc39b2231", "name": "network-vif-plugged", "status": "completed", "tag": "dc16dd44-033b-41eb-86dd-bf32e0dc64a5"}, {"server_uuid": "500595ea-1c83-4574-b6c8-2d6cc39b2231", "name": "network-vif-plugged", "status": "completed", "tag": "da1ef08b-d52a-458a-95fd-42a59fbff65e"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:56.093626 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d9b68a67-6c78-4e07-8bbc-ff80532721e3 req-1026423b-245b-4dca-8153-87d8f29a627b service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:56.094111 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d9b68a67-6c78-4e07-8bbc-ff80532721e3 req-1026423b-245b-4dca-8153-87d8f29a627b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:56.094728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d9b68a67-6c78-4e07-8bbc-ff80532721e3 req-1026423b-245b-4dca-8153-87d8f29a627b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:56.111397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd3a8cd7-dd9e-4d8a-928f-82f6617b64c0 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:56.112161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd3a8cd7-dd9e-4d8a-928f-82f6617b64c0 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:56.112867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd3a8cd7-dd9e-4d8a-928f-82f6617b64c0 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:56.113692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd3a8cd7-dd9e-4d8a-928f-82f6617b64c0 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:56.114289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd3a8cd7-dd9e-4d8a-928f-82f6617b64c0 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:56.115002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd3a8cd7-dd9e-4d8a-928f-82f6617b64c0 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:56.124384 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-d9b68a67-6c78-4e07-8bbc-ff80532721e3 req-1026423b-245b-4dca-8153-87d8f29a627b service nova] Creating event network-vif-plugged:dfcee5d6-4375-4d8f-8e2d-e3624086cfa5 for instance 500595ea-1c83-4574-b6c8-2d6cc39b2231 on n-h2-862967-2 Oct 29 02:52:56.124936 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-d9b68a67-6c78-4e07-8bbc-ff80532721e3 req-1026423b-245b-4dca-8153-87d8f29a627b service nova] Creating event network-vif-plugged:dc16dd44-033b-41eb-86dd-bf32e0dc64a5 for instance 500595ea-1c83-4574-b6c8-2d6cc39b2231 on n-h2-862967-2 Oct 29 02:52:56.125454 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-d9b68a67-6c78-4e07-8bbc-ff80532721e3 req-1026423b-245b-4dca-8153-87d8f29a627b service nova] Creating event network-vif-plugged:da1ef08b-d52a-458a-95fd-42a59fbff65e for instance 500595ea-1c83-4574-b6c8-2d6cc39b2231 on n-h2-862967-2 Oct 29 02:52:56.140116 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-d9b68a67-6c78-4e07-8bbc-ff80532721e3 req-1026423b-245b-4dca-8153-87d8f29a627b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.077075 Oct 29 02:52:56.141974 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 852/1586] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:56.150036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-caca2d9d-08f1-4dc7-bf70-353c39eb413b tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:56.156511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-caca2d9d-08f1-4dc7-bf70-353c39eb413b tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:56.175087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-caca2d9d-08f1-4dc7-bf70-353c39eb413b tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:56.176119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-caca2d9d-08f1-4dc7-bf70-353c39eb413b tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:56.179049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-caca2d9d-08f1-4dc7-bf70-353c39eb413b tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:56.180800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-caca2d9d-08f1-4dc7-bf70-353c39eb413b tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:56.181589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-caca2d9d-08f1-4dc7-bf70-353c39eb413b tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:56.183096 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-caca2d9d-08f1-4dc7-bf70-353c39eb413b tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:56.430574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=15 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:56.481591 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-caca2d9d-08f1-4dc7-bf70-353c39eb413b tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] Lazy-loading 'services' on Instance uuid 36000641-20c2-4949-bcae-d11828ed67b4 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:52:56.493900 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fd3a8cd7-dd9e-4d8a-928f-82f6617b64c0 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/62f3371e7d5a4182a2853707861d0c60" status: 200 len: 329 microversion: 2.1 time: 0.524396 Oct 29 02:52:56.495866 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 735/1587] 10.222.0.46 () {60 vars in 1263 bytes} [Sat Oct 29 02:52:55 2022] PUT /compute/v2.1/os-quota-sets/62f3371e7d5a4182a2853707861d0c60 => generated 329 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:56.508481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-840cb0ea-306f-431b-aa9a-a72fd2cb2664 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1977789661"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:56.514748 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-caca2d9d-08f1-4dc7-bf70-353c39eb413b tempest-LiveAutoBlockMigrationV225Test-293497350 tempest-LiveAutoBlockMigrationV225Test-293497350-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1971 microversion: 2.25 time: 0.370726 Oct 29 02:52:56.515643 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 853/1588] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:56 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1971 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:56.517036 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-840cb0ea-306f-431b-aa9a-a72fd2cb2664 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 29 02:52:56.517581 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-840cb0ea-306f-431b-aa9a-a72fd2cb2664 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 02:52:56.519456 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-840cb0ea-306f-431b-aa9a-a72fd2cb2664 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Request method failure captured: Oct 29 02:52:56.519456 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 29 02:52:56.519456 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:52:56.519456 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:52:56.519456 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:52:56.519456 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 57 Oct 29 02:52:56.519456 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:52:56.519456 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:52:56.519456 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:52:56.519456 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:52:56.519456 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJViIDRXaZ-9NBUZJ_11iyUz9NJPRNFPdH0zep6fik63VjSU4mum551ysD_9EIL3kW0ojFcr8jsgEHlRrUPE5TYb9KkzDs4EygPjz99CE3t2JxLZnbzjMRl2CyYvcVkRvkHe2y2uujxe_kOoZRtvYYP70QoYUxpBFn0MIkif9sBe7Xc Oct 29 02:52:56.519456 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:52:56.519456 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:52:56.519456 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:52:56.519456 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:52:56.519456 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:52:56.519456 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:52:56.519456 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 449eab5d48df46be8b15f1094286b0d7 Oct 29 02:52:56.519456 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ImagesNegativeTestJSON-1907967757 Oct 29 02:52:56.519456 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:52:56.519456 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:52:56.521249 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/449eab5d48df46be8b15f1094286b0d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/449eab5d48df46be8b15f1094286b0d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_449eab5d48df46be8b15f1094286b0d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/449eab5d48df46be8b15f1094286b0d7"}]}] Oct 29 02:52:56.521249 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ImagesNegativeTestJSON-1907967757 Oct 29 02:52:56.521249 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 449eab5d48df46be8b15f1094286b0d7 Oct 29 02:52:56.521249 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1907967757 Oct 29 02:52:56.521249 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ImagesNegativeTestJSON-1907967757-project Oct 29 02:52:56.521249 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:52:56.521249 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:52:56.521249 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 2cdc8abe2dbf4479b2bd859c37bb204a Oct 29 02:52:56.521249 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ImagesNegativeTestJSON-1907967757-project Oct 29 02:52:56.521249 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:52:56.521249 n-d-862967-2 devstack@n-api.service[127125]: {"createImage": {"name": "tempest-test-snap-1977789661"}} Oct 29 02:52:56.521249 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:52:56.521249 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 02:52:56.522252 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1977789661'}}} Oct 29 02:52:56.522252 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:52:56.522252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:56.522252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:52:56.522252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:52:56.522252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 29 02:52:56.522252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 29 02:52:56.522252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 02:52:56.522252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:56.522252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:56.522252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:56.522252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:56.522252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:56.522252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:56.522252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:52:56.522252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:52:56.522252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:52:56.522252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:52:56.522252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:52:56.522252 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:52:56.523730 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:52:56.523730 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:52:56.523730 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 29 02:52:56.523730 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 02:52:56.523730 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:52:56.523730 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:52:56.523730 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:52:56.523730 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:52:56.523730 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 02:52:56.523730 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:56.523730 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:56.523730 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:56.523730 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:56.523730 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:56.523730 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:56.523730 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:52:56.523730 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:52:56.523730 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 29 02:52:56.523730 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:56.528714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-840cb0ea-306f-431b-aa9a-a72fd2cb2664 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:52:56.529779 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-840cb0ea-306f-431b-aa9a-a72fd2cb2664 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] 10.222.0.46 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.032750 Oct 29 02:52:56.533459 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 736/1589] 10.222.0.46 () {60 vars in 1281 bytes} [Sat Oct 29 02:52:56 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:52:56.536008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-01cb7e19-1053-4741-9e52-3fe1e6aea72e tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:56.536880 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-01cb7e19-1053-4741-9e52-3fe1e6aea72e tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 1123b300-f298-4071-bff4-8ddc088ee57f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:56.540467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bcd6ceee-940e-45f4-a0f9-f2c473fbeb44 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] Action: 'create', calling method: .version_select at 0x7ff053832ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-153749642", "description": "tempest-description-406497470"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:56.550854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-01cb7e19-1053-4741-9e52-3fe1e6aea72e tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:56.554617 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-01cb7e19-1053-4741-9e52-3fe1e6aea72e tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:56.555285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-01cb7e19-1053-4741-9e52-3fe1e6aea72e tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:56.557670 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-01cb7e19-1053-4741-9e52-3fe1e6aea72e tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:56.558909 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-01cb7e19-1053-4741-9e52-3fe1e6aea72e tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:56.560998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-01cb7e19-1053-4741-9e52-3fe1e6aea72e tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:56.567478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:56.815051 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-01cb7e19-1053-4741-9e52-3fe1e6aea72e tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844dbc8e54d349ea93c632c54909a718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b7aa3004d94c5a8cf87d5f4d006a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:56.824176 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-01cb7e19-1053-4741-9e52-3fe1e6aea72e tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f" status: 200 len: 1467 microversion: 2.1 time: 0.307800 Oct 29 02:52:56.825023 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 854/1590] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:56 2022] GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f => generated 1467 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:56.841555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-91bd034d-072b-46db-a972-bb63f4f34dc7 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Action: 'update', calling method: .version_select at 0x7ff0539d1ca0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:56.877616 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bcd6ceee-940e-45f4-a0f9-f2c473fbeb44 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.342851 Oct 29 02:52:56.878387 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 737/1591] 10.222.0.46 () {60 vars in 1180 bytes} [Sat Oct 29 02:52:56 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:56.890085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-24ee0541-6dc0-48e8-9e8d-d66962ef6a48 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:56.890590 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-24ee0541-6dc0-48e8-9e8d-d66962ef6a48 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] [instance: 1a47d89b-54a0-40a2-9572-c88ee55e6b5e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:56.898715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24ee0541-6dc0-48e8-9e8d-d66962ef6a48 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:56.899544 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24ee0541-6dc0-48e8-9e8d-d66962ef6a48 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:56.900768 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24ee0541-6dc0-48e8-9e8d-d66962ef6a48 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:56.901777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24ee0541-6dc0-48e8-9e8d-d66962ef6a48 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:56.902763 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24ee0541-6dc0-48e8-9e8d-d66962ef6a48 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:56.903430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24ee0541-6dc0-48e8-9e8d-d66962ef6a48 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:56.932663 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-24ee0541-6dc0-48e8-9e8d-d66962ef6a48 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] HTTP exception thrown: Instance 1a47d89b-54a0-40a2-9572-c88ee55e6b5e could not be found. Oct 29 02:52:56.934449 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-24ee0541-6dc0-48e8-9e8d-d66962ef6a48 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Request method failure captured: Oct 29 02:52:56.934449 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e HTTP/1.1 Oct 29 02:52:56.934449 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:52:56.934449 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:52:56.934449 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:52:56.934449 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:52:56.934449 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:52:56.934449 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:52:56.934449 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:52:56.934449 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:52:56.934449 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJViIDRXaZ-9NBUZJ_11iyUz9NJPRNFPdH0zep6fik63VjSU4mum551ysD_9EIL3kW0ojFcr8jsgEHlRrUPE5TYb9KkzDs4EygPjz99CE3t2JxLZnbzjMRl2CyYvcVkRvkHe2y2uujxe_kOoZRtvYYP70QoYUxpBFn0MIkif9sBe7Xc Oct 29 02:52:56.934449 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:52:56.934449 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:52:56.934449 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:52:56.934449 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:52:56.934449 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:52:56.934449 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:52:56.934449 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 449eab5d48df46be8b15f1094286b0d7 Oct 29 02:52:56.934449 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ImagesNegativeTestJSON-1907967757 Oct 29 02:52:56.934449 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:52:56.934449 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:52:56.936281 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/449eab5d48df46be8b15f1094286b0d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/449eab5d48df46be8b15f1094286b0d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_449eab5d48df46be8b15f1094286b0d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/449eab5d48df46be8b15f1094286b0d7"}]}] Oct 29 02:52:56.936281 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ImagesNegativeTestJSON-1907967757 Oct 29 02:52:56.936281 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 449eab5d48df46be8b15f1094286b0d7 Oct 29 02:52:56.936281 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1907967757 Oct 29 02:52:56.936281 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ImagesNegativeTestJSON-1907967757-project Oct 29 02:52:56.936281 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:52:56.936281 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:52:56.936281 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 2cdc8abe2dbf4479b2bd859c37bb204a Oct 29 02:52:56.936281 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ImagesNegativeTestJSON-1907967757-project Oct 29 02:52:56.936281 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:52:56.936281 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 1a47d89b-54a0-40a2-9572-c88ee55e6b5e could not be found. Oct 29 02:52:56.936281 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '1a47d89b-54a0-40a2-9572-c88ee55e6b5e'} Oct 29 02:52:56.937494 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:52:56.937494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:56.937494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:52:56.937494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:52:56.937494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:52:56.937494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:52:56.937494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:52:56.937494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:52:56.937494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:52:56.937494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:52:56.937494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a47d89b-54a0-40a2-9572-c88ee55e6b5e could not be found. Oct 29 02:52:56.937494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:56.937494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:56.937494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:56.937494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:56.937494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:56.937494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:56.937494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:52:56.937494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:52:56.937494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:52:56.939091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:52:56.939091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:52:56.939091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:52:56.939091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:52:56.939091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:52:56.939091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:52:56.939091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:52:56.939091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:52:56.939091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:52:56.939091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a47d89b-54a0-40a2-9572-c88ee55e6b5e could not be found. Oct 29 02:52:56.939091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:56.939091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:56.939091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:56.939091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:56.939091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:56.939091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:56.939091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:52:56.939091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:52:56.939091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a47d89b-54a0-40a2-9572-c88ee55e6b5e could not be found. Oct 29 02:52:56.939091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:56.942699 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-24ee0541-6dc0-48e8-9e8d-d66962ef6a48 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Returning 404 to user: Instance 1a47d89b-54a0-40a2-9572-c88ee55e6b5e could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:52:56.943761 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-24ee0541-6dc0-48e8-9e8d-d66962ef6a48 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e" status: 404 len: 111 microversion: 2.1 time: 0.064466 Oct 29 02:52:56.945170 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 738/1592] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:52:56 2022] DELETE /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:52:56.953411 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-37e35d5e-df74-4938-862a-6ae2a7a52c73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:56.953824 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-37e35d5e-df74-4938-862a-6ae2a7a52c73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:56.959401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91bd034d-072b-46db-a972-bb63f4f34dc7 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:56.959899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91bd034d-072b-46db-a972-bb63f4f34dc7 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:56.960339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91bd034d-072b-46db-a972-bb63f4f34dc7 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:56.962977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91bd034d-072b-46db-a972-bb63f4f34dc7 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:56.963446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91bd034d-072b-46db-a972-bb63f4f34dc7 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:56.963881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91bd034d-072b-46db-a972-bb63f4f34dc7 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:56.966703 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-37e35d5e-df74-4938-862a-6ae2a7a52c73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:56.967191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-37e35d5e-df74-4938-862a-6ae2a7a52c73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:56.967626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-37e35d5e-df74-4938-862a-6ae2a7a52c73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:56.968333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-37e35d5e-df74-4938-862a-6ae2a7a52c73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:56.968816 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-37e35d5e-df74-4938-862a-6ae2a7a52c73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:56.969239 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-37e35d5e-df74-4938-862a-6ae2a7a52c73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:57.023061 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-37e35d5e-df74-4938-862a-6ae2a7a52c73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:52:57.159338 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-37e35d5e-df74-4938-862a-6ae2a7a52c73 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "DELETE /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 204 len: 0 microversion: 2.25 time: 0.209569 Oct 29 02:52:57.166001 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 739/1593] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Oct 29 02:52:56 2022] DELETE /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 02:52:57.173218 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cd1e0ac0-5e2e-442c-a9c1-6a498e2eaf65 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:57.174408 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cd1e0ac0-5e2e-442c-a9c1-6a498e2eaf65 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:57.182131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd1e0ac0-5e2e-442c-a9c1-6a498e2eaf65 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:57.182998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd1e0ac0-5e2e-442c-a9c1-6a498e2eaf65 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:57.183676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd1e0ac0-5e2e-442c-a9c1-6a498e2eaf65 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:57.184680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd1e0ac0-5e2e-442c-a9c1-6a498e2eaf65 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:57.185356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd1e0ac0-5e2e-442c-a9c1-6a498e2eaf65 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:57.185996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd1e0ac0-5e2e-442c-a9c1-6a498e2eaf65 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:57.374387 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cd1e0ac0-5e2e-442c-a9c1-6a498e2eaf65 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844dbc8e54d349ea93c632c54909a718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b7aa3004d94c5a8cf87d5f4d006a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:57.403617 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cd1e0ac0-5e2e-442c-a9c1-6a498e2eaf65 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/servers/0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd" status: 200 len: 1468 microversion: 2.1 time: 0.227623 Oct 29 02:52:57.405699 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 740/1594] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:57 2022] GET /compute/v2.1/servers/0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd => generated 1468 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:57.419734 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e86e8375-b4e2-4703-aeb0-5b7ba5b738f9 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:57.420868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e86e8375-b4e2-4703-aeb0-5b7ba5b738f9 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 500595ea-1c83-4574-b6c8-2d6cc39b2231] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:57.454266 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e86e8375-b4e2-4703-aeb0-5b7ba5b738f9 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:57.454910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e86e8375-b4e2-4703-aeb0-5b7ba5b738f9 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:57.455439 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e86e8375-b4e2-4703-aeb0-5b7ba5b738f9 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:57.466209 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e86e8375-b4e2-4703-aeb0-5b7ba5b738f9 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:57.467779 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e86e8375-b4e2-4703-aeb0-5b7ba5b738f9 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:57.468686 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e86e8375-b4e2-4703-aeb0-5b7ba5b738f9 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:57.594114 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-91bd034d-072b-46db-a972-bb63f4f34dc7 tempest-QuotasAdminTestJSON-1179509460 tempest-QuotasAdminTestJSON-1179509460-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/62f3371e7d5a4182a2853707861d0c60" status: 200 len: 329 microversion: 2.1 time: 0.767774 Oct 29 02:52:57.595412 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 855/1595] 10.222.0.46 () {60 vars in 1263 bytes} [Sat Oct 29 02:52:56 2022] PUT /compute/v2.1/os-quota-sets/62f3371e7d5a4182a2853707861d0c60 => generated 329 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:57.632684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9aa999fb-40b5-47ed-83f8-3eaea14fdb77 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] Action: 'create', calling method: .version_select at 0x7ff053a500d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1492626375", "description": "tempest-description-7061421"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:57.657683 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e86e8375-b4e2-4703-aeb0-5b7ba5b738f9 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:57.679721 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e86e8375-b4e2-4703-aeb0-5b7ba5b738f9 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231" status: 200 len: 1354 microversion: 2.1 time: 0.264896 Oct 29 02:52:57.696557 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 741/1596] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:57 2022] GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231 => generated 1354 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:57.704545 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ed64546a-fc54-4420-920b-d13be8f8f2e9 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:57.705607 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ed64546a-fc54-4420-920b-d13be8f8f2e9 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] [instance: 1a47d89b-54a0-40a2-9572-c88ee55e6b5e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:57.712695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed64546a-fc54-4420-920b-d13be8f8f2e9 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:57.713944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed64546a-fc54-4420-920b-d13be8f8f2e9 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:57.714583 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed64546a-fc54-4420-920b-d13be8f8f2e9 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:57.716808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed64546a-fc54-4420-920b-d13be8f8f2e9 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:57.717489 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed64546a-fc54-4420-920b-d13be8f8f2e9 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:57.718464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed64546a-fc54-4420-920b-d13be8f8f2e9 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:57.734619 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-ed64546a-fc54-4420-920b-d13be8f8f2e9 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] HTTP exception thrown: Instance 1a47d89b-54a0-40a2-9572-c88ee55e6b5e could not be found. Oct 29 02:52:57.737813 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ed64546a-fc54-4420-920b-d13be8f8f2e9 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Request method failure captured: Oct 29 02:52:57.737813 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e HTTP/1.1 Oct 29 02:52:57.737813 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:52:57.737813 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:52:57.737813 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:52:57.737813 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:52:57.737813 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:52:57.737813 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:52:57.737813 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:52:57.737813 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:52:57.737813 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJViIDRXaZ-9NBUZJ_11iyUz9NJPRNFPdH0zep6fik63VjSU4mum551ysD_9EIL3kW0ojFcr8jsgEHlRrUPE5TYb9KkzDs4EygPjz99CE3t2JxLZnbzjMRl2CyYvcVkRvkHe2y2uujxe_kOoZRtvYYP70QoYUxpBFn0MIkif9sBe7Xc Oct 29 02:52:57.737813 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:52:57.737813 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:52:57.737813 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:52:57.737813 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:52:57.737813 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:52:57.737813 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:52:57.737813 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 449eab5d48df46be8b15f1094286b0d7 Oct 29 02:52:57.737813 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ImagesNegativeTestJSON-1907967757 Oct 29 02:52:57.737813 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:52:57.737813 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:52:57.739672 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/449eab5d48df46be8b15f1094286b0d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/449eab5d48df46be8b15f1094286b0d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_449eab5d48df46be8b15f1094286b0d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/449eab5d48df46be8b15f1094286b0d7"}]}] Oct 29 02:52:57.739672 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ImagesNegativeTestJSON-1907967757 Oct 29 02:52:57.739672 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 449eab5d48df46be8b15f1094286b0d7 Oct 29 02:52:57.739672 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1907967757 Oct 29 02:52:57.739672 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ImagesNegativeTestJSON-1907967757-project Oct 29 02:52:57.739672 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:52:57.739672 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:52:57.739672 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 2cdc8abe2dbf4479b2bd859c37bb204a Oct 29 02:52:57.739672 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ImagesNegativeTestJSON-1907967757-project Oct 29 02:52:57.739672 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:52:57.739672 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 1a47d89b-54a0-40a2-9572-c88ee55e6b5e could not be found. Oct 29 02:52:57.739672 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '1a47d89b-54a0-40a2-9572-c88ee55e6b5e'} Oct 29 02:52:57.740700 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:52:57.740700 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:57.740700 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:52:57.740700 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:52:57.740700 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:52:57.740700 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:52:57.740700 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:52:57.740700 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:52:57.740700 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:52:57.740700 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:52:57.740700 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a47d89b-54a0-40a2-9572-c88ee55e6b5e could not be found. Oct 29 02:52:57.740700 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:57.740700 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:57.740700 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:57.740700 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:57.740700 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:57.740700 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:57.740700 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:52:57.740700 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:52:57.740700 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:52:57.742208 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:52:57.742208 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:52:57.742208 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:52:57.742208 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:52:57.742208 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:52:57.742208 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:52:57.742208 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:52:57.742208 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a47d89b-54a0-40a2-9572-c88ee55e6b5e could not be found. Oct 29 02:52:57.742208 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:57.742208 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:52:57.742208 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:57.742208 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:52:57.742208 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:52:57.742208 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:52:57.742208 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:52:57.742208 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:52:57.742208 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a47d89b-54a0-40a2-9572-c88ee55e6b5e could not be found. Oct 29 02:52:57.742208 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:52:57.744874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ed64546a-fc54-4420-920b-d13be8f8f2e9 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] Returning 404 to user: Instance 1a47d89b-54a0-40a2-9572-c88ee55e6b5e could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:52:57.746211 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ed64546a-fc54-4420-920b-d13be8f8f2e9 tempest-ImagesNegativeTestJSON-1907967757 tempest-ImagesNegativeTestJSON-1907967757-project] 10.222.0.46 "GET /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e" status: 404 len: 111 microversion: 2.1 time: 0.055724 Oct 29 02:52:57.750585 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 742/1597] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:57 2022] GET /compute/v2.1/servers/1a47d89b-54a0-40a2-9572-c88ee55e6b5e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:52:57.760256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-205f55b2-1018-4c4d-8642-ed40fcf215f5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2052479383", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "a9586548-125a-4362-849c-fa72bed27d73"}, {"port": "da28c280-91d5-47ab-8861-0f028fe80b4b", "tag": "port-1"}, {"port": "20b9f931-71de-4cc6-b5b4-f7a9d8ff7ad9", "tag": "port-2"}, {"uuid": "8bd13a37-7d15-4b52-8873-7d3c42cb46c1", "tag": "net-1"}, {"uuid": "8bd13a37-7d15-4b52-8873-7d3c42cb46c1"}, {"uuid": "5ef61fd7-2538-4ca9-95d7-53278d33be32", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "5ef61fd7-2538-4ca9-95d7-53278d33be32", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "64dee4fe-176a-43b3-9145-ee231b07d517", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "7fdb4e9c-490b-45f4-a6fe-2c44875d398e", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "781701be-0bfe-4158-a65b-1f866d863fc5", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1782473046"}], "key_name": "tempest-keypair-542832441", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:58.011616 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9aa999fb-40b5-47ed-83f8-3eaea14fdb77 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.388518 Oct 29 02:52:58.014311 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 856/1598] 10.222.0.46 () {60 vars in 1180 bytes} [Sat Oct 29 02:52:57 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:58.019589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-37a72c0a-ff1f-4811-b599-f2f65576e562 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:58.020549 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-37a72c0a-ff1f-4811-b599-f2f65576e562 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:58.050403 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37a72c0a-ff1f-4811-b599-f2f65576e562 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:58.051311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37a72c0a-ff1f-4811-b599-f2f65576e562 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:58.053059 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37a72c0a-ff1f-4811-b599-f2f65576e562 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:58.054048 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37a72c0a-ff1f-4811-b599-f2f65576e562 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:58.064325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37a72c0a-ff1f-4811-b599-f2f65576e562 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:58.065205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37a72c0a-ff1f-4811-b599-f2f65576e562 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:58.256310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-37a72c0a-ff1f-4811-b599-f2f65576e562 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:58.266451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-37a72c0a-ff1f-4811-b599-f2f65576e562 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:58.267988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-37a72c0a-ff1f-4811-b599-f2f65576e562 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:58.269360 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-37a72c0a-ff1f-4811-b599-f2f65576e562 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1484 microversion: 2.25 time: 0.253739 Oct 29 02:52:58.284557 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 857/1599] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:52:58 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1484 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:52:58.284557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8156e4a6-f164-4240-934d-af007d83fe97 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-841837606"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:58.284557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8156e4a6-f164-4240-934d-af007d83fe97 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:58.290266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8156e4a6-f164-4240-934d-af007d83fe97 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:58.290266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8156e4a6-f164-4240-934d-af007d83fe97 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:58.290266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8156e4a6-f164-4240-934d-af007d83fe97 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:58.290266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8156e4a6-f164-4240-934d-af007d83fe97 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:58.293592 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8156e4a6-f164-4240-934d-af007d83fe97 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:58.293889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8156e4a6-f164-4240-934d-af007d83fe97 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:58.341431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-205f55b2-1018-4c4d-8642-ed40fcf215f5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] validate_networks() for [('a9586548-125a-4362-849c-fa72bed27d73', None, None, None, None, None), (None, None, 'da28c280-91d5-47ab-8861-0f028fe80b4b', None, None, None), (None, None, '20b9f931-71de-4cc6-b5b4-f7a9d8ff7ad9', None, None, None), ('8bd13a37-7d15-4b52-8873-7d3c42cb46c1', None, None, None, None, None), ('8bd13a37-7d15-4b52-8873-7d3c42cb46c1', None, None, None, None, None), ('5ef61fd7-2538-4ca9-95d7-53278d33be32', '10.2.2.100', None, None, None, None), ('5ef61fd7-2538-4ca9-95d7-53278d33be32', '10.2.2.200', None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:52:58.691856 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8156e4a6-f164-4240-934d-af007d83fe97 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "POST /compute/v2.1/servers/0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd/action" status: 202 len: 0 microversion: 2.1 time: 0.419849 Oct 29 02:52:58.692918 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 858/1600] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:52:58 2022] POST /compute/v2.1/servers/0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 02:52:58.699076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dc548b63-18bd-4e3c-8069-a7842a28aaa3 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] Action: 'create', calling method: .version_select at 0x7ff0539ad0d0>, body: {"security_group_rule": {"parent_group_id": "728a7f72-a51b-4af6-be41-ef5f68ba5671", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "4eba6cdd-454b-421f-8312-8a39eb1c5583"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:52:59.200764 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dc548b63-18bd-4e3c-8069-a7842a28aaa3 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.506502 Oct 29 02:52:59.201558 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 859/1601] 10.222.0.46 () {60 vars in 1195 bytes} [Sat Oct 29 02:52:58 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:52:59.207979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4241940f-60ea-4311-bf98-655e82d7dbc3 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff053a53ee0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:59.275876 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4241940f-60ea-4311-bf98-655e82d7dbc3 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59" status: 200 len: 1452 microversion: 2.1 time: 0.072941 Oct 29 02:52:59.277636 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 860/1602] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:52:59 2022] GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59 => generated 1452 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:59.282546 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dd2806c8-c4b5-4799-93d1-faf2de501dce tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:52:59.283527 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dd2806c8-c4b5-4799-93d1-faf2de501dce tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 500595ea-1c83-4574-b6c8-2d6cc39b2231] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:52:59.291767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd2806c8-c4b5-4799-93d1-faf2de501dce tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:59.292756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd2806c8-c4b5-4799-93d1-faf2de501dce tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:59.293431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd2806c8-c4b5-4799-93d1-faf2de501dce tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:59.294315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd2806c8-c4b5-4799-93d1-faf2de501dce tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:52:59.294590 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd2806c8-c4b5-4799-93d1-faf2de501dce tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:52:59.295444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd2806c8-c4b5-4799-93d1-faf2de501dce tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:52:59.864187 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dd2806c8-c4b5-4799-93d1-faf2de501dce tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:52:59.876332 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dd2806c8-c4b5-4799-93d1-faf2de501dce tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231" status: 200 len: 1804 microversion: 2.1 time: 0.597375 Oct 29 02:52:59.877319 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 861/1603] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:52:59 2022] GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231 => generated 1804 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:52:59.882525 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b69bd205-01b5-400c-b84f-06f12bc2503a tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] Action: 'create', calling method: .version_select at 0x7ff0539adc10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1932567513", "description": "tempest-description-295389178"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:00.129106 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b69bd205-01b5-400c-b84f-06f12bc2503a tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.249777 Oct 29 02:53:00.130936 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 862/1604] 10.222.0.46 () {60 vars in 1180 bytes} [Sat Oct 29 02:52:59 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:00.141056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-39e40398-95bd-4c10-839b-bfbf570ebebb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:00.141888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-39e40398-95bd-4c10-839b-bfbf570ebebb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:00.151862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39e40398-95bd-4c10-839b-bfbf570ebebb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:00.152857 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39e40398-95bd-4c10-839b-bfbf570ebebb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:00.153499 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39e40398-95bd-4c10-839b-bfbf570ebebb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:00.154383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39e40398-95bd-4c10-839b-bfbf570ebebb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:00.155006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39e40398-95bd-4c10-839b-bfbf570ebebb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:00.155593 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39e40398-95bd-4c10-839b-bfbf570ebebb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:00.231954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-39e40398-95bd-4c10-839b-bfbf570ebebb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:00.241301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-39e40398-95bd-4c10-839b-bfbf570ebebb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:00.243063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-39e40398-95bd-4c10-839b-bfbf570ebebb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:00.244425 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-39e40398-95bd-4c10-839b-bfbf570ebebb tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1266 microversion: 2.25 time: 0.112204 Oct 29 02:53:00.245186 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 863/1605] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:00 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1266 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:00.250258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-60d4496c-a2dc-42a4-b203-40e9087b2a0f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:00.250746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-60d4496c-a2dc-42a4-b203-40e9087b2a0f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 500595ea-1c83-4574-b6c8-2d6cc39b2231] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:00.261272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60d4496c-a2dc-42a4-b203-40e9087b2a0f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:00.262054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60d4496c-a2dc-42a4-b203-40e9087b2a0f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:00.263604 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60d4496c-a2dc-42a4-b203-40e9087b2a0f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:00.264614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60d4496c-a2dc-42a4-b203-40e9087b2a0f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:00.265243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60d4496c-a2dc-42a4-b203-40e9087b2a0f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:00.266550 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60d4496c-a2dc-42a4-b203-40e9087b2a0f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:00.331741 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-60d4496c-a2dc-42a4-b203-40e9087b2a0f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231/ips" status: 200 len: 218 microversion: 2.1 time: 0.084231 Oct 29 02:53:00.334727 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 864/1606] 10.222.0.46 () {58 vars in 1248 bytes} [Sat Oct 29 02:53:00 2022] GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231/ips => generated 218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:00.345313 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-33d2cef5-5beb-4117-bfe9-5a111f4b2ea1 req-e2c9b76f-bea0-4935-ba79-7f207f6b2d65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36000641-20c2-4949-bcae-d11828ed67b4", "name": "network-vif-deleted", "tag": "0612e19b-4219-4b23-80fd-a0d245ef44d1"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:00.367276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-33d2cef5-5beb-4117-bfe9-5a111f4b2ea1 req-e2c9b76f-bea0-4935-ba79-7f207f6b2d65 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:00.372035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-33d2cef5-5beb-4117-bfe9-5a111f4b2ea1 req-e2c9b76f-bea0-4935-ba79-7f207f6b2d65 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:00.372564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-33d2cef5-5beb-4117-bfe9-5a111f4b2ea1 req-e2c9b76f-bea0-4935-ba79-7f207f6b2d65 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:00.387374 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-33d2cef5-5beb-4117-bfe9-5a111f4b2ea1 req-e2c9b76f-bea0-4935-ba79-7f207f6b2d65 service nova] Creating event network-vif-deleted:0612e19b-4219-4b23-80fd-a0d245ef44d1 for instance 36000641-20c2-4949-bcae-d11828ed67b4 on n-h2-862967-2 Oct 29 02:53:00.393119 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-33d2cef5-5beb-4117-bfe9-5a111f4b2ea1 req-e2c9b76f-bea0-4935-ba79-7f207f6b2d65 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056616 Oct 29 02:53:00.394059 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 865/1607] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:00.400062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9073e99e-1ce1-4698-9701-785dc1b6326d tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] Action: 'create', calling method: .version_select at 0x7ff05c230af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1179099656", "description": "tempest-description-380775377"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:00.653273 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9073e99e-1ce1-4698-9701-785dc1b6326d tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.257839 Oct 29 02:53:00.654537 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 866/1608] 10.222.0.46 () {60 vars in 1180 bytes} [Sat Oct 29 02:53:00 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:00.659917 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-167594b8-f029-42e0-83e5-1b8c2b7d1e54 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c230c10>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:00.723439 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-167594b8-f029-42e0-83e5-1b8c2b7d1e54 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59" status: 200 len: 1452 microversion: 2.1 time: 0.067583 Oct 29 02:53:00.724752 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 867/1609] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:00 2022] GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59 => generated 1452 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:00.732974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9337dc66-e979-4d5f-b3d5-a563ba0d8c7b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:00.734521 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9337dc66-e979-4d5f-b3d5-a563ba0d8c7b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 500595ea-1c83-4574-b6c8-2d6cc39b2231] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:00.754346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9337dc66-e979-4d5f-b3d5-a563ba0d8c7b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:00.755629 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9337dc66-e979-4d5f-b3d5-a563ba0d8c7b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:00.756880 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9337dc66-e979-4d5f-b3d5-a563ba0d8c7b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:00.758815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9337dc66-e979-4d5f-b3d5-a563ba0d8c7b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:00.759452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9337dc66-e979-4d5f-b3d5-a563ba0d8c7b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:00.760237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9337dc66-e979-4d5f-b3d5-a563ba0d8c7b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:00.801694 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9337dc66-e979-4d5f-b3d5-a563ba0d8c7b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 500595ea-1c83-4574-b6c8-2d6cc39b2231] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:53:00.899807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=15,nova_api:UPDATE=14 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:00.907048 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9337dc66-e979-4d5f-b3d5-a563ba0d8c7b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "DELETE /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231" status: 204 len: 0 microversion: 2.1 time: 0.180580 Oct 29 02:53:00.910719 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 868/1610] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:53:00 2022] DELETE /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:53:00.927263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bc415374-ec9d-4bf3-a16a-bfaa10f2dc99 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] Action: 'create', calling method: .version_select at 0x7ff05c227310>, body: {"security_group_rule": {"parent_group_id": "b1dad807-de60-43a1-bb8f-4f8a1e5fb5d1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "cdd24da3-c325-4e76-82c0-1cc43af5e2bd"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:01.260790 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bc415374-ec9d-4bf3-a16a-bfaa10f2dc99 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.351900 Oct 29 02:53:01.261397 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 869/1611] 10.222.0.46 () {60 vars in 1195 bytes} [Sat Oct 29 02:53:00 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:01.273460 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-82891b26-bcb2-4766-9436-798c15484393 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:01.274588 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-82891b26-bcb2-4766-9436-798c15484393 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 500595ea-1c83-4574-b6c8-2d6cc39b2231] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:01.283192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82891b26-bcb2-4766-9436-798c15484393 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:01.283938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82891b26-bcb2-4766-9436-798c15484393 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:01.284565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82891b26-bcb2-4766-9436-798c15484393 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:01.285898 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82891b26-bcb2-4766-9436-798c15484393 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:01.287167 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82891b26-bcb2-4766-9436-798c15484393 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:01.287906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82891b26-bcb2-4766-9436-798c15484393 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:01.461607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-82891b26-bcb2-4766-9436-798c15484393 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:01.473023 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-82891b26-bcb2-4766-9436-798c15484393 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231" status: 200 len: 1810 microversion: 2.1 time: 0.209239 Oct 29 02:53:01.474330 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 870/1612] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:01 2022] GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231 => generated 1810 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:01.479303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-746079bd-011c-4c8c-96e6-38f42948d4ee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:01.480132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-746079bd-011c-4c8c-96e6-38f42948d4ee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:01.504513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-746079bd-011c-4c8c-96e6-38f42948d4ee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:01.505349 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-746079bd-011c-4c8c-96e6-38f42948d4ee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:01.506041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-746079bd-011c-4c8c-96e6-38f42948d4ee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:01.507143 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-746079bd-011c-4c8c-96e6-38f42948d4ee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:01.523452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-746079bd-011c-4c8c-96e6-38f42948d4ee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:01.523998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-746079bd-011c-4c8c-96e6-38f42948d4ee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:01.788823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-746079bd-011c-4c8c-96e6-38f42948d4ee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:01.798456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-746079bd-011c-4c8c-96e6-38f42948d4ee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:01.813326 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-746079bd-011c-4c8c-96e6-38f42948d4ee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:01.818164 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-746079bd-011c-4c8c-96e6-38f42948d4ee tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1266 microversion: 2.25 time: 0.342557 Oct 29 02:53:01.818772 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 871/1613] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:01 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1266 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:01.865521 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6582f349-b46a-4467-bc4a-fb93134c8225 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] Calling method '.version_select at 0x7ff053a7adc0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:02.757768 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6582f349-b46a-4467-bc4a-fb93134c8225 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/cdd24da3-c325-4e76-82c0-1cc43af5e2bd" status: 202 len: 0 microversion: 2.1 time: 0.935250 Oct 29 02:53:02.762340 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 872/1614] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:53:01 2022] DELETE /compute/v2.1/os-security-groups/cdd24da3-c325-4e76-82c0-1cc43af5e2bd => generated 0 bytes in 939 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:53:02.776320 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-66ab16fb-7542-4b6d-b800-bee01dff5c5b tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c230280>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:02.853757 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-66ab16fb-7542-4b6d-b800-bee01dff5c5b tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59" status: 200 len: 1452 microversion: 2.1 time: 0.094194 Oct 29 02:53:02.854313 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 873/1615] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:02 2022] GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59 => generated 1452 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:02.866580 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-82b0f43c-d839-49af-92cd-db81d540fb99 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:02.867208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-82b0f43c-d839-49af-92cd-db81d540fb99 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 500595ea-1c83-4574-b6c8-2d6cc39b2231] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:02.901362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82b0f43c-d839-49af-92cd-db81d540fb99 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:02.901868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82b0f43c-d839-49af-92cd-db81d540fb99 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:02.902502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82b0f43c-d839-49af-92cd-db81d540fb99 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:02.905465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82b0f43c-d839-49af-92cd-db81d540fb99 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:02.905992 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82b0f43c-d839-49af-92cd-db81d540fb99 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:02.906759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82b0f43c-d839-49af-92cd-db81d540fb99 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:03.545034 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-82b0f43c-d839-49af-92cd-db81d540fb99 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:03.591327 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-82b0f43c-d839-49af-92cd-db81d540fb99 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231" status: 200 len: 1810 microversion: 2.1 time: 0.735786 Oct 29 02:53:03.591934 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 874/1616] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:02 2022] GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231 => generated 1810 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:03.615841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4e347ada-5c39-4c76-968a-b3125c1726e9 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] Calling method '.version_select at 0x7ff05c2275e0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:03.740253 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4e347ada-5c39-4c76-968a-b3125c1726e9 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/b1dad807-de60-43a1-bb8f-4f8a1e5fb5d1" status: 200 len: 247 microversion: 2.1 time: 0.133643 Oct 29 02:53:03.740988 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 875/1617] 10.222.0.46 () {58 vars in 1269 bytes} [Sat Oct 29 02:53:03 2022] GET /compute/v2.1/os-security-groups/b1dad807-de60-43a1-bb8f-4f8a1e5fb5d1 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:03.747109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d5753b8a-f29f-4188-96ac-7e89a477b188 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:03.747869 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d5753b8a-f29f-4188-96ac-7e89a477b188 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:03.771767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5753b8a-f29f-4188-96ac-7e89a477b188 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:03.776487 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5753b8a-f29f-4188-96ac-7e89a477b188 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:03.784457 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5753b8a-f29f-4188-96ac-7e89a477b188 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:03.785485 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5753b8a-f29f-4188-96ac-7e89a477b188 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:03.787018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5753b8a-f29f-4188-96ac-7e89a477b188 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:03.787350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5753b8a-f29f-4188-96ac-7e89a477b188 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:03.919224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d5753b8a-f29f-4188-96ac-7e89a477b188 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:03.948061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d5753b8a-f29f-4188-96ac-7e89a477b188 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:03.952567 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d5753b8a-f29f-4188-96ac-7e89a477b188 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:03.961376 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d5753b8a-f29f-4188-96ac-7e89a477b188 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1266 microversion: 2.25 time: 0.219092 Oct 29 02:53:03.977054 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 876/1618] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:03 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:04.418504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-50d046e4-1eeb-43be-a94a-2025b8bea903 tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Calling method '.version_select at 0x7ff053a0d820>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:04.788219 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-50d046e4-1eeb-43be-a94a-2025b8bea903 tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/8a700da20eb643399d6628cbd3f0aec6" status: 200 len: 371 microversion: 2.1 time: 0.809655 Oct 29 02:53:04.803963 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 877/1619] 10.222.0.46 () {58 vars in 1242 bytes} [Sat Oct 29 02:53:03 2022] GET /compute/v2.1/os-quota-sets/8a700da20eb643399d6628cbd3f0aec6 => generated 371 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:04.812974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-95f516c5-64dc-435b-990b-85a5930a5658 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] Action: 'create', calling method: .version_select at 0x7ff053a0e670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1857631949", "description": "tempest-description-812962584"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:05.157569 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-95f516c5-64dc-435b-990b-85a5930a5658 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.351813 Oct 29 02:53:05.158851 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 878/1620] 10.222.0.46 () {60 vars in 1180 bytes} [Sat Oct 29 02:53:04 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:05.164485 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-154cc9e6-985e-46ad-acef-1acc4cc95efc tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff053a7ac10>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:05.280470 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-154cc9e6-985e-46ad-acef-1acc4cc95efc tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59" status: 200 len: 1452 microversion: 2.1 time: 0.119920 Oct 29 02:53:05.283698 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 879/1621] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:05 2022] GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59 => generated 1452 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:05.296729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-c7cb2e9a-b644-47b9-9936-d61fdf1ba113 req-8aede73a-39c8-4e1f-9c21-dcadbbfcb2fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd", "name": "network-vif-plugged", "status": "completed", "tag": "9daf432c-ab9e-41ed-aaf7-21cb4e7d509f"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:05.327669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c7cb2e9a-b644-47b9-9936-d61fdf1ba113 req-8aede73a-39c8-4e1f-9c21-dcadbbfcb2fe service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:05.328897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c7cb2e9a-b644-47b9-9936-d61fdf1ba113 req-8aede73a-39c8-4e1f-9c21-dcadbbfcb2fe service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:05.330382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c7cb2e9a-b644-47b9-9936-d61fdf1ba113 req-8aede73a-39c8-4e1f-9c21-dcadbbfcb2fe service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:05.355112 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-c7cb2e9a-b644-47b9-9936-d61fdf1ba113 req-8aede73a-39c8-4e1f-9c21-dcadbbfcb2fe service nova] Creating event network-vif-plugged:9daf432c-ab9e-41ed-aaf7-21cb4e7d509f for instance 0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd on n-h1-862967-2 Oct 29 02:53:05.363026 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-c7cb2e9a-b644-47b9-9936-d61fdf1ba113 req-8aede73a-39c8-4e1f-9c21-dcadbbfcb2fe service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077030 Oct 29 02:53:05.364096 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 880/1622] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:05.378247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-279c5581-060f-42fc-8fcf-572fb6fa27db tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:05.379176 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-279c5581-060f-42fc-8fcf-572fb6fa27db tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 500595ea-1c83-4574-b6c8-2d6cc39b2231] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:05.389663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-279c5581-060f-42fc-8fcf-572fb6fa27db tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:05.390406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-279c5581-060f-42fc-8fcf-572fb6fa27db tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:05.391137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-279c5581-060f-42fc-8fcf-572fb6fa27db tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:05.392276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-279c5581-060f-42fc-8fcf-572fb6fa27db tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:05.392949 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-279c5581-060f-42fc-8fcf-572fb6fa27db tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:05.393533 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-279c5581-060f-42fc-8fcf-572fb6fa27db tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:05.757198 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-279c5581-060f-42fc-8fcf-572fb6fa27db tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:05.770306 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-279c5581-060f-42fc-8fcf-572fb6fa27db tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231" status: 200 len: 1810 microversion: 2.1 time: 0.403945 Oct 29 02:53:05.771461 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 881/1623] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:05 2022] GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231 => generated 1810 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:05.786127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7a4a916d-b5da-4181-9448-50e49ed79e63 tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Action: 'update', calling method: .version_select at 0x7ff053a0e0d0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:06.127748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7a4a916d-b5da-4181-9448-50e49ed79e63 tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:06.133051 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:06.136079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7a4a916d-b5da-4181-9448-50e49ed79e63 tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:06.141594 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7a4a916d-b5da-4181-9448-50e49ed79e63 tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:06.152811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7a4a916d-b5da-4181-9448-50e49ed79e63 tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:06.153920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7a4a916d-b5da-4181-9448-50e49ed79e63 tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:06.155961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7a4a916d-b5da-4181-9448-50e49ed79e63 tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:06.354659 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7a4a916d-b5da-4181-9448-50e49ed79e63 tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/8a700da20eb643399d6628cbd3f0aec6" status: 200 len: 328 microversion: 2.1 time: 0.581343 Oct 29 02:53:06.373678 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 882/1624] 10.222.0.46 () {60 vars in 1262 bytes} [Sat Oct 29 02:53:05 2022] PUT /compute/v2.1/os-quota-sets/8a700da20eb643399d6628cbd3f0aec6 => generated 328 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:06.393541 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a1db6f6b-d14f-4452-8d30-f2971be40f7e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:06.400243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a1db6f6b-d14f-4452-8d30-f2971be40f7e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:06.420426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a1db6f6b-d14f-4452-8d30-f2971be40f7e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:06.423978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a1db6f6b-d14f-4452-8d30-f2971be40f7e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:06.424882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a1db6f6b-d14f-4452-8d30-f2971be40f7e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:06.427542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a1db6f6b-d14f-4452-8d30-f2971be40f7e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:06.428242 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a1db6f6b-d14f-4452-8d30-f2971be40f7e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:06.429189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a1db6f6b-d14f-4452-8d30-f2971be40f7e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:06.481719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=50 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:06.653815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a1db6f6b-d14f-4452-8d30-f2971be40f7e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:06.658220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:06.679756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a1db6f6b-d14f-4452-8d30-f2971be40f7e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:06.683143 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a1db6f6b-d14f-4452-8d30-f2971be40f7e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:06.693550 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a1db6f6b-d14f-4452-8d30-f2971be40f7e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 200 len: 1266 microversion: 2.25 time: 0.317842 Oct 29 02:53:06.694622 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 883/1625] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:06 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 1266 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:06.700032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c2c7bf18-8578-452e-89a8-69ea54020d25 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] Action: 'create', calling method: .version_select at 0x7ff053a0e5e0>, body: {"security_group_rule": {"parent_group_id": "0bf88e30-41b1-43a5-81ce-e91ec1dec86c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:07.172483 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c2c7bf18-8578-452e-89a8-69ea54020d25 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.475823 Oct 29 02:53:07.181865 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 884/1626] 10.222.0.46 () {60 vars in 1195 bytes} [Sat Oct 29 02:53:06 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:07.187641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7faacf12-cefc-4de7-9706-b3b131c93a30 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c227430>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:07.257663 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7faacf12-cefc-4de7-9706-b3b131c93a30 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59" status: 200 len: 1452 microversion: 2.1 time: 0.074564 Oct 29 02:53:07.258300 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 885/1627] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:07 2022] GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59 => generated 1452 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:07.724128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:07.857342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5029ea20-6a53-468a-92c9-724fef6c1d77 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1551669395", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:08.031780 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-5029ea20-6a53-468a-92c9-724fef6c1d77 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] validate_networks() for None {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:53:08.401811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-5029ea20-6a53-468a-92c9-724fef6c1d77 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:53:08.403656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-5029ea20-6a53-468a-92c9-724fef6c1d77 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:53:08.404345 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-5029ea20-6a53-468a-92c9-724fef6c1d77 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:53:08.404985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-5029ea20-6a53-468a-92c9-724fef6c1d77 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:53:08.405626 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-5029ea20-6a53-468a-92c9-724fef6c1d77 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:53:08.422880 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5029ea20-6a53-468a-92c9-724fef6c1d77 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:08.423729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5029ea20-6a53-468a-92c9-724fef6c1d77 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:08.424392 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5029ea20-6a53-468a-92c9-724fef6c1d77 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:08.425503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5029ea20-6a53-468a-92c9-724fef6c1d77 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:08.426287 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5029ea20-6a53-468a-92c9-724fef6c1d77 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:08.427218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5029ea20-6a53-468a-92c9-724fef6c1d77 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:08.450185 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-5029ea20-6a53-468a-92c9-724fef6c1d77 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Getting quotas for project 8a700da20eb643399d6628cbd3f0aec6. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:53:08.547279 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-5029ea20-6a53-468a-92c9-724fef6c1d77 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Getting quotas for user 5aff9ef607034d41b7d83a5c95defb3d and project 8a700da20eb643399d6628cbd3f0aec6. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:53:08.593396 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.utils [None req-5029ea20-6a53-468a-92c9-724fef6c1d77 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] cores quota exceeded for 8a700da20eb643399d6628cbd3f0aec6, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127124) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 29 02:53:08.598870 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-5029ea20-6a53-468a-92c9-724fef6c1d77 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 29 02:53:08.629927 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5029ea20-6a53-468a-92c9-724fef6c1d77 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Request method failure captured: Oct 29 02:53:08.629927 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:53:08.629927 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:53:08.629927 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:53:08.629927 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:53:08.629927 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 145 Oct 29 02:53:08.629927 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:53:08.629927 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:53:08.629927 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:53:08.629927 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:53:08.629927 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJWN1oP-MIutJ00GGA_JbPLm8uxWkdjkBpGLr4SvLmBukSCOYtW5qiD6KIXPUORc8DNNvn-yU1guHjx8JD4DZwxYLpSVhRTxh6F0fU7q-IwNXnPEtGbM6IUZEqFsvDUa5ZRxV5ebEHJ4vB86pdTKhRhKp9rUyXflc26rhz3BkLvbKKQ Oct 29 02:53:08.629927 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:53:08.629927 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:53:08.629927 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:53:08.629927 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:53:08.629927 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:53:08.629927 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:53:08.629927 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 8a700da20eb643399d6628cbd3f0aec6 Oct 29 02:53:08.629927 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-QuotasAdminNegativeTest-435328983 Oct 29 02:53:08.629927 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:53:08.629927 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:53:08.631827 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8a700da20eb643399d6628cbd3f0aec6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8a700da20eb643399d6628cbd3f0aec6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8a700da20eb643399d6628cbd3f0aec6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8a700da20eb643399d6628cbd3f0aec6"}]}] Oct 29 02:53:08.631827 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-QuotasAdminNegativeTest-435328983 Oct 29 02:53:08.631827 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 8a700da20eb643399d6628cbd3f0aec6 Oct 29 02:53:08.631827 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-435328983 Oct 29 02:53:08.631827 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-QuotasAdminNegativeTest-435328983-project Oct 29 02:53:08.631827 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:53:08.631827 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:53:08.631827 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 5aff9ef607034d41b7d83a5c95defb3d Oct 29 02:53:08.631827 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-QuotasAdminNegativeTest-435328983-project Oct 29 02:53:08.631827 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:53:08.631827 n-d-862967-2 devstack@n-api.service[127124]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1551669395", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452"}} Oct 29 02:53:08.631827 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:53:08.632790 n-d-862967-2 devstack@n-api.service[127124]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 29 02:53:08.632790 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1551669395', 'imageRef': 'cd315600-df67-41c1-95d3-95a5145fc39a', 'flavorRef': '452'}}} Oct 29 02:53:08.632790 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:53:08.632790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:08.632790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 29 02:53:08.632790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 29 02:53:08.632790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:53:08.632790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:53:08.632790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 29 02:53:08.632790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc Oct 29 02:53:08.632790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 29 02:53:08.632790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 29 02:53:08.632790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:53:08.632790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:53:08.632790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 29 02:53:08.632790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 29 02:53:08.632790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 29 02:53:08.632790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 29 02:53:08.634025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 29 02:53:08.634025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 29 02:53:08.634025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 29 02:53:08.634025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:08.634025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:08.634025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:08.634025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:08.634025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 02:53:08.634025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 02:53:08.634025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 02:53:08.634025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 02:53:08.634025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 29 02:53:08.634025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 29 02:53:08.634025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 29 02:53:08.634025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 29 02:53:08.634025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 29 02:53:08.634025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 29 02:53:08.634025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 29 02:53:08.634025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:08.634025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:08.634025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:08.635416 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:08.635416 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:08.635416 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:08.635416 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:53:08.635416 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:53:08.635416 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:53:08.635416 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:53:08.635416 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:53:08.635416 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:53:08.635416 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:53:08.635416 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:53:08.635416 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:53:08.635416 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:53:08.635416 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 02:53:08.635416 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 29 02:53:08.635416 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 29 02:53:08.635416 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 29 02:53:08.635416 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:08.635416 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:08.635416 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:08.635416 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:08.638310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:08.638310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:08.638310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:53:08.638310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:53:08.638310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 29 02:53:08.638310 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:08.638310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5029ea20-6a53-468a-92c9-724fef6c1d77 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:53:08.638310 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5029ea20-6a53-468a-92c9-724fef6c1d77 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.365912 Oct 29 02:53:08.640473 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 886/1628] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:53:07 2022] POST /compute/v2.1/servers => generated 111 bytes in 1381 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:53:08.648361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5032e22e-ae8c-4eb3-b079-4af8c87499cc tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:08.649402 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5032e22e-ae8c-4eb3-b079-4af8c87499cc tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 500595ea-1c83-4574-b6c8-2d6cc39b2231] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:08.669178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5032e22e-ae8c-4eb3-b079-4af8c87499cc tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:08.672864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5032e22e-ae8c-4eb3-b079-4af8c87499cc tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:08.674188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5032e22e-ae8c-4eb3-b079-4af8c87499cc tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:08.675179 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5032e22e-ae8c-4eb3-b079-4af8c87499cc tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:08.675903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5032e22e-ae8c-4eb3-b079-4af8c87499cc tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:08.676650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5032e22e-ae8c-4eb3-b079-4af8c87499cc tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:08.697978 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-205f55b2-1018-4c4d-8642-ed40fcf215f5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:53:08.698665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-205f55b2-1018-4c4d-8642-ed40fcf215f5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:53:08.699364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-205f55b2-1018-4c4d-8642-ed40fcf215f5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:53:08.700014 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-205f55b2-1018-4c4d-8642-ed40fcf215f5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:53:08.700700 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-205f55b2-1018-4c4d-8642-ed40fcf215f5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:53:08.721875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-205f55b2-1018-4c4d-8642-ed40fcf215f5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:08.722953 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-205f55b2-1018-4c4d-8642-ed40fcf215f5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:08.723613 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-205f55b2-1018-4c4d-8642-ed40fcf215f5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:08.724625 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-205f55b2-1018-4c4d-8642-ed40fcf215f5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:08.725777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-205f55b2-1018-4c4d-8642-ed40fcf215f5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:08.726574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-205f55b2-1018-4c4d-8642-ed40fcf215f5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:08.780705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-205f55b2-1018-4c4d-8642-ed40fcf215f5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Getting quotas for project c3b1881976f4493996c2ba4a67afc637. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:53:08.794469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-205f55b2-1018-4c4d-8642-ed40fcf215f5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Getting quotas for user 1b91e3a384214f79a0333e35e5ad3378 and project c3b1881976f4493996c2ba4a67afc637. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:53:08.974440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5032e22e-ae8c-4eb3-b079-4af8c87499cc tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:08.983529 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5032e22e-ae8c-4eb3-b079-4af8c87499cc tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231" status: 200 len: 1768 microversion: 2.1 time: 0.339608 Oct 29 02:53:09.004438 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 887/1629] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:08 2022] GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231 => generated 1768 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:09.012068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d7d070e8-a17b-4b76-b2b1-52f300835acd tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] Action: 'create', calling method: .version_select at 0x7ff05c24b4c0>, body: {"security_group_rule": {"parent_group_id": "0bf88e30-41b1-43a5-81ce-e91ec1dec86c", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:09.175890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-205f55b2-1018-4c4d-8642-ed40fcf215f5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:53:09.179776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-205f55b2-1018-4c4d-8642-ed40fcf215f5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='64dee4fe-176a-43b3-9145-ee231b07d517',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='7fdb4e9c-490b-45f4-a6fe-2c44875d398e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='781701be-0bfe-4158-a65b-1f866d863fc5',volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:53:09.415293 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d7d070e8-a17b-4b76-b2b1-52f300835acd tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] 10.222.0.46 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.408859 Oct 29 02:53:09.422326 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 888/1630] 10.222.0.46 () {60 vars in 1195 bytes} [Sat Oct 29 02:53:09 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:09.425855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-3ad6c1d1-db80-494b-b573-30825ee8ec21 req-99bd5f29-7de7-4000-bc08-7b120303a441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "500595ea-1c83-4574-b6c8-2d6cc39b2231", "name": "network-vif-deleted", "tag": "dfcee5d6-4375-4d8f-8e2d-e3624086cfa5"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:09.445751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3ad6c1d1-db80-494b-b573-30825ee8ec21 req-99bd5f29-7de7-4000-bc08-7b120303a441 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:09.446233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3ad6c1d1-db80-494b-b573-30825ee8ec21 req-99bd5f29-7de7-4000-bc08-7b120303a441 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:09.446660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3ad6c1d1-db80-494b-b573-30825ee8ec21 req-99bd5f29-7de7-4000-bc08-7b120303a441 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:09.491199 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-3ad6c1d1-db80-494b-b573-30825ee8ec21 req-99bd5f29-7de7-4000-bc08-7b120303a441 service nova] Creating event network-vif-deleted:dfcee5d6-4375-4d8f-8e2d-e3624086cfa5 for instance 500595ea-1c83-4574-b6c8-2d6cc39b2231 on n-h2-862967-2 Oct 29 02:53:09.501626 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-3ad6c1d1-db80-494b-b573-30825ee8ec21 req-99bd5f29-7de7-4000-bc08-7b120303a441 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083212 Oct 29 02:53:09.504645 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 889/1631] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:09.520782 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-6c52da0c-bfaf-45ff-a186-d88f3b378e2a req-c377ff56-cb5a-473b-9d51-0f83fcd4b261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "500595ea-1c83-4574-b6c8-2d6cc39b2231", "name": "network-vif-unplugged", "status": "completed", "tag": "dc16dd44-033b-41eb-86dd-bf32e0dc64a5"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:09.548340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-6c52da0c-bfaf-45ff-a186-d88f3b378e2a req-c377ff56-cb5a-473b-9d51-0f83fcd4b261 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:09.549124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-6c52da0c-bfaf-45ff-a186-d88f3b378e2a req-c377ff56-cb5a-473b-9d51-0f83fcd4b261 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:09.549784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-6c52da0c-bfaf-45ff-a186-d88f3b378e2a req-c377ff56-cb5a-473b-9d51-0f83fcd4b261 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:09.588136 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-6c52da0c-bfaf-45ff-a186-d88f3b378e2a req-c377ff56-cb5a-473b-9d51-0f83fcd4b261 service nova] Creating event network-vif-unplugged:dc16dd44-033b-41eb-86dd-bf32e0dc64a5 for instance 500595ea-1c83-4574-b6c8-2d6cc39b2231 on n-h2-862967-2 Oct 29 02:53:09.601719 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-6c52da0c-bfaf-45ff-a186-d88f3b378e2a req-c377ff56-cb5a-473b-9d51-0f83fcd4b261 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092922 Oct 29 02:53:09.613366 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 890/1632] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:09.624331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-73cebb67-a798-4494-b341-5adffdbf7ada tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:09.626261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-73cebb67-a798-4494-b341-5adffdbf7ada tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 36000641-20c2-4949-bcae-d11828ed67b4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:09.640463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73cebb67-a798-4494-b341-5adffdbf7ada tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:09.640978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73cebb67-a798-4494-b341-5adffdbf7ada tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:09.644894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73cebb67-a798-4494-b341-5adffdbf7ada tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:09.647045 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73cebb67-a798-4494-b341-5adffdbf7ada tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:09.648864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73cebb67-a798-4494-b341-5adffdbf7ada tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:09.649324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73cebb67-a798-4494-b341-5adffdbf7ada tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:09.689573 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-73cebb67-a798-4494-b341-5adffdbf7ada tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] HTTP exception thrown: Instance 36000641-20c2-4949-bcae-d11828ed67b4 could not be found. Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-73cebb67-a798-4494-b341-5adffdbf7ada tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Request method failure captured: Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 HTTP/1.1 Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPY62lZ02kminN7qHv7SG1RovI20ydDPZQv3tU5TxvLPKUoiJl_AOrRTdYppSUhrWf-y0a9Bz_57Qjo2lN_Zn__d7tPquCT-d7vLweqRqmT_i2ewZGK6bM0drOtR2PR0C_5HjpH6zHOxAYP1pWsYHXaaVsdN0RVEPjL6hMRRWt73-g Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: X-Openstack-Nova-Api-Version: 2.25 Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: f86634862bd64e0f9f00972e4ce0982b Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2000095198 Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f86634862bd64e0f9f00972e4ce0982b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f86634862bd64e0f9f00972e4ce0982b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f86634862bd64e0f9f00972e4ce0982b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f86634862bd64e0f9f00972e4ce0982b"}]}] Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2000095198 Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: f86634862bd64e0f9f00972e4ce0982b Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2000095198 Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-LiveAutoBlockMigrationV225Test-2000095198-project Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 067d53567ea944b1b69ee7f461aa0c16 Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2000095198-project Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 36000641-20c2-4949-bcae-d11828ed67b4 could not be found. Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '36000641-20c2-4949-bcae-d11828ed67b4'} Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36000641-20c2-4949-bcae-d11828ed67b4 could not be found. Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36000641-20c2-4949-bcae-d11828ed67b4 could not be found. Oct 29 02:53:09.692490 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:09.697221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:09.697221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:09.697221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:09.697221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:09.697221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:09.697221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:53:09.697221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:53:09.697221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36000641-20c2-4949-bcae-d11828ed67b4 could not be found. Oct 29 02:53:09.697221 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:09.697830 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-73cebb67-a798-4494-b341-5adffdbf7ada tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Returning 404 to user: Instance 36000641-20c2-4949-bcae-d11828ed67b4 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:53:09.698456 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-73cebb67-a798-4494-b341-5adffdbf7ada tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4" status: 404 len: 111 microversion: 2.25 time: 0.083812 Oct 29 02:53:09.699336 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 891/1633] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:09 2022] GET /compute/v2.1/servers/36000641-20c2-4949-bcae-d11828ed67b4 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:53:09.935744 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-205f55b2-1018-4c4d-8642-ed40fcf215f5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 12.182856 Oct 29 02:53:09.939857 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 743/1634] 10.222.0.46 () {62 vars in 1189 bytes} [Sat Oct 29 02:52:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 12189 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 02:53:09.956346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b493b2e5-a0ef-4a4d-a5bd-c9d7c5ec8a41 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff053832dc0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:10.065466 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b493b2e5-a0ef-4a4d-a5bd-c9d7c5ec8a41 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59" status: 200 len: 1452 microversion: 2.1 time: 0.124269 Oct 29 02:53:10.067801 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 744/1635] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:09 2022] GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59 => generated 1452 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:10.088940 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-80ad8111-b11b-4a54-a2fc-4fb6b41dc80a tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Action: 'update', calling method: .version_select at 0x7ff0589ca040>, body: {"quota_set": {"cores": 20}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:10.100470 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5727d330-2bf2-4177-af6d-8c899ba4d0a3 tempest-ImagesMetadataNegativeTestJSON-319824576 tempest-ImagesMetadataNegativeTestJSON-319824576-project] Calling method '.version_select at 0x7ff05c230b80>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:10.153414 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-5727d330-2bf2-4177-af6d-8c899ba4d0a3 tempest-ImagesMetadataNegativeTestJSON-319824576 tempest-ImagesMetadataNegativeTestJSON-319824576-project] HTTP exception thrown: Image not found. Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5727d330-2bf2-4177-af6d-8c899ba4d0a3 tempest-ImagesMetadataNegativeTestJSON-319824576 tempest-ImagesMetadataNegativeTestJSON-319824576-project] Request method failure captured: Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/images/b79db96a-82d2-4ff2-9483-db81f6ce56ec/metadata/os_distro HTTP/1.1 Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJWTcxbzvHZ706EHDC9NthMND1QZersI5uzOseVwwr_FFzZaRAqfZuyI8ZLA8B6cRRHQmhEQ7TMUkBzsUQDYSF_x82bjDi_qmE3tItXndmVkTTTCZEeGNldRMpXX7WP1J_mrpz9qAo2EfmmvYwrG6Zv1A9pwd4aGrDS5pDfOBR2GdVY Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: e7c0ab01a0404a07bf3d0d223964e93a Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-319824576 Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e7c0ab01a0404a07bf3d0d223964e93a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e7c0ab01a0404a07bf3d0d223964e93a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e7c0ab01a0404a07bf3d0d223964e93a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e7c0ab01a0404a07bf3d0d223964e93a"}]}] Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-319824576 Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: e7c0ab01a0404a07bf3d0d223964e93a Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-319824576 Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ImagesMetadataNegativeTestJSON-319824576-project Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 5209cf9b3e8344c4a4f13b5b47e0de0c Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-319824576-project Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: exception: Image not found. Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'image_id': 'b79db96a-82d2-4ff2-9483-db81f6ce56ec', 'id': 'os_distro'} Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b79db96a-82d2-4ff2-9483-db81f6ce56ec Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 02:53:10.162661 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b79db96a-82d2-4ff2-9483-db81f6ce56ec could not be found. Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5727d330-2bf2-4177-af6d-8c899ba4d0a3 tempest-ImagesMetadataNegativeTestJSON-319824576 tempest-ImagesMetadataNegativeTestJSON-319824576-project] Returning 404 to user: Image not found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:53:10.175051 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5727d330-2bf2-4177-af6d-8c899ba4d0a3 tempest-ImagesMetadataNegativeTestJSON-319824576 tempest-ImagesMetadataNegativeTestJSON-319824576-project] 10.222.0.46 "DELETE /compute/v2.1/images/b79db96a-82d2-4ff2-9483-db81f6ce56ec/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.469609 Oct 29 02:53:10.187870 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 892/1636] 10.222.0.46 () {58 vars in 1293 bytes} [Sat Oct 29 02:53:09 2022] DELETE /compute/v2.1/images/b79db96a-82d2-4ff2-9483-db81f6ce56ec/metadata/os_distro => generated 62 bytes in 484 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:53:10.216715 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-22175de1-a00d-487e-9063-80fdc455a3a2 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] Calling method '.version_select at 0x7ff05c24b160>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:10.607718 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-80ad8111-b11b-4a54-a2fc-4fb6b41dc80a tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:10.608149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-80ad8111-b11b-4a54-a2fc-4fb6b41dc80a tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:10.608639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-80ad8111-b11b-4a54-a2fc-4fb6b41dc80a tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:10.623546 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-80ad8111-b11b-4a54-a2fc-4fb6b41dc80a tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:10.624332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-80ad8111-b11b-4a54-a2fc-4fb6b41dc80a tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:10.625095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-80ad8111-b11b-4a54-a2fc-4fb6b41dc80a tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:10.657628 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-22175de1-a00d-487e-9063-80fdc455a3a2 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/0bf88e30-41b1-43a5-81ce-e91ec1dec86c" status: 200 len: 664 microversion: 2.1 time: 0.472134 Oct 29 02:53:10.673309 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 893/1637] 10.222.0.46 () {58 vars in 1269 bytes} [Sat Oct 29 02:53:10 2022] GET /compute/v2.1/os-security-groups/0bf88e30-41b1-43a5-81ce-e91ec1dec86c => generated 664 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:10.685421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ca3f7b72-16bf-4db3-8d5d-c97300972892 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:10.686232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ca3f7b72-16bf-4db3-8d5d-c97300972892 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:10.815648 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-80ad8111-b11b-4a54-a2fc-4fb6b41dc80a tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/8a700da20eb643399d6628cbd3f0aec6" status: 200 len: 329 microversion: 2.1 time: 0.746108 Oct 29 02:53:10.840361 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 745/1638] 10.222.0.46 () {60 vars in 1262 bytes} [Sat Oct 29 02:53:10 2022] PUT /compute/v2.1/os-quota-sets/8a700da20eb643399d6628cbd3f0aec6 => generated 329 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:10.845875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fdbd84bf-aafd-4718-8eec-a52626258e0b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:10.859557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fdbd84bf-aafd-4718-8eec-a52626258e0b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 500595ea-1c83-4574-b6c8-2d6cc39b2231] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:10.898526 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdbd84bf-aafd-4718-8eec-a52626258e0b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:10.899992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdbd84bf-aafd-4718-8eec-a52626258e0b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:10.901329 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdbd84bf-aafd-4718-8eec-a52626258e0b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:10.902743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdbd84bf-aafd-4718-8eec-a52626258e0b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:10.903466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdbd84bf-aafd-4718-8eec-a52626258e0b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:10.904377 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdbd84bf-aafd-4718-8eec-a52626258e0b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:10.926920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ca3f7b72-16bf-4db3-8d5d-c97300972892 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:10.929814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=77 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:10.952141 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ca3f7b72-16bf-4db3-8d5d-c97300972892 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:10.956719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ca3f7b72-16bf-4db3-8d5d-c97300972892 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:10.957948 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ca3f7b72-16bf-4db3-8d5d-c97300972892 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1285 microversion: 2.42 time: 0.283500 Oct 29 02:53:10.972547 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 894/1639] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:10 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1285 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:10.972547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7d50f1e8-a6fd-495d-b618-76a8e1ce732b tempest-ImagesMetadataNegativeTestJSON-319824576 tempest-ImagesMetadataNegativeTestJSON-319824576-project] Calling method '.version_select at 0x7ff05c227c10>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:11.016320 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-7d50f1e8-a6fd-495d-b618-76a8e1ce732b tempest-ImagesMetadataNegativeTestJSON-319824576 tempest-ImagesMetadataNegativeTestJSON-319824576-project] HTTP exception thrown: Image not found. Oct 29 02:53:11.019910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdbd84bf-aafd-4718-8eec-a52626258e0b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7d50f1e8-a6fd-495d-b618-76a8e1ce732b tempest-ImagesMetadataNegativeTestJSON-319824576 tempest-ImagesMetadataNegativeTestJSON-319824576-project] Request method failure captured: Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/images/b0b1bbda-2a70-4a80-8bf9-d4e8f050b43a/metadata/os_version HTTP/1.1 Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJWTcxbzvHZ706EHDC9NthMND1QZersI5uzOseVwwr_FFzZaRAqfZuyI8ZLA8B6cRRHQmhEQ7TMUkBzsUQDYSF_x82bjDi_qmE3tItXndmVkTTTCZEeGNldRMpXX7WP1J_mrpz9qAo2EfmmvYwrG6Zv1A9pwd4aGrDS5pDfOBR2GdVY Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: e7c0ab01a0404a07bf3d0d223964e93a Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-319824576 Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e7c0ab01a0404a07bf3d0d223964e93a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e7c0ab01a0404a07bf3d0d223964e93a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e7c0ab01a0404a07bf3d0d223964e93a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e7c0ab01a0404a07bf3d0d223964e93a"}]}] Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-319824576 Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: e7c0ab01a0404a07bf3d0d223964e93a Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-319824576 Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ImagesMetadataNegativeTestJSON-319824576-project Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 5209cf9b3e8344c4a4f13b5b47e0de0c Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-319824576-project Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: exception: Image not found. Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'image_id': 'b0b1bbda-2a70-4a80-8bf9-d4e8f050b43a', 'id': 'os_version'} Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b0b1bbda-2a70-4a80-8bf9-d4e8f050b43a Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 02:53:11.023207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b0b1bbda-2a70-4a80-8bf9-d4e8f050b43a could not be found. Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:53:11.028609 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:11.035482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdbd84bf-aafd-4718-8eec-a52626258e0b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:11.035665 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7d50f1e8-a6fd-495d-b618-76a8e1ce732b tempest-ImagesMetadataNegativeTestJSON-319824576 tempest-ImagesMetadataNegativeTestJSON-319824576-project] Returning 404 to user: Image not found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:53:11.035851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdbd84bf-aafd-4718-8eec-a52626258e0b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:11.036042 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7d50f1e8-a6fd-495d-b618-76a8e1ce732b tempest-ImagesMetadataNegativeTestJSON-319824576 tempest-ImagesMetadataNegativeTestJSON-319824576-project] 10.222.0.46 "GET /compute/v2.1/images/b0b1bbda-2a70-4a80-8bf9-d4e8f050b43a/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.063424 Oct 29 02:53:11.036227 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-fdbd84bf-aafd-4718-8eec-a52626258e0b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lazy-loading 'fault' on Instance uuid 500595ea-1c83-4574-b6c8-2d6cc39b2231 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:53:11.037570 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 895/1640] 10.222.0.46 () {58 vars in 1293 bytes} [Sat Oct 29 02:53:10 2022] GET /compute/v2.1/images/b0b1bbda-2a70-4a80-8bf9-d4e8f050b43a/metadata/os_version => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:53:11.057933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-65686a6c-5514-437b-8af2-a044a618ef58 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] Calling method '.version_select at 0x7ff05c227280>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:11.228228 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fdbd84bf-aafd-4718-8eec-a52626258e0b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:11.236758 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fdbd84bf-aafd-4718-8eec-a52626258e0b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231" status: 200 len: 1302 microversion: 2.1 time: 0.394678 Oct 29 02:53:11.241412 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 746/1641] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:10 2022] GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231 => generated 1302 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:11.265134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-78871eb8-4ac5-46ac-8fbe-7696fb01153c tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Calling method '.version_select at 0x7ff053860940>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:11.400247 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-65686a6c-5514-437b-8af2-a044a618ef58 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-group-rules/c75d8992-911b-4e8b-989a-8287399c9cf9" status: 202 len: 0 microversion: 2.1 time: 0.364181 Oct 29 02:53:11.400905 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-78871eb8-4ac5-46ac-8fbe-7696fb01153c tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/8a700da20eb643399d6628cbd3f0aec6" status: 200 len: 371 microversion: 2.1 time: 0.158088 Oct 29 02:53:11.401356 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 896/1642] 10.222.0.46 () {58 vars in 1287 bytes} [Sat Oct 29 02:53:11 2022] DELETE /compute/v2.1/os-security-group-rules/c75d8992-911b-4e8b-989a-8287399c9cf9 => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:53:11.409320 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5ae59961-ce44-40a4-86ce-ad3b48ccc5f2 tempest-ImagesMetadataNegativeTestJSON-319824576 tempest-ImagesMetadataNegativeTestJSON-319824576-project] Calling method '.version_select at 0x7ff05c1a49d0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:11.420208 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 747/1643] 10.222.0.46 () {58 vars in 1242 bytes} [Sat Oct 29 02:53:11 2022] GET /compute/v2.1/os-quota-sets/8a700da20eb643399d6628cbd3f0aec6 => generated 371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:11.436850 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-5ae59961-ce44-40a4-86ce-ad3b48ccc5f2 tempest-ImagesMetadataNegativeTestJSON-319824576 tempest-ImagesMetadataNegativeTestJSON-319824576-project] HTTP exception thrown: Image not found. Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5ae59961-ce44-40a4-86ce-ad3b48ccc5f2 tempest-ImagesMetadataNegativeTestJSON-319824576 tempest-ImagesMetadataNegativeTestJSON-319824576-project] Request method failure captured: Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/images/9708d476-403a-43ed-9f07-d079ab1e96d4/metadata HTTP/1.1 Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJWTcxbzvHZ706EHDC9NthMND1QZersI5uzOseVwwr_FFzZaRAqfZuyI8ZLA8B6cRRHQmhEQ7TMUkBzsUQDYSF_x82bjDi_qmE3tItXndmVkTTTCZEeGNldRMpXX7WP1J_mrpz9qAo2EfmmvYwrG6Zv1A9pwd4aGrDS5pDfOBR2GdVY Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: e7c0ab01a0404a07bf3d0d223964e93a Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-319824576 Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e7c0ab01a0404a07bf3d0d223964e93a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e7c0ab01a0404a07bf3d0d223964e93a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e7c0ab01a0404a07bf3d0d223964e93a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e7c0ab01a0404a07bf3d0d223964e93a"}]}] Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-319824576 Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: e7c0ab01a0404a07bf3d0d223964e93a Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-319824576 Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ImagesMetadataNegativeTestJSON-319824576-project Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 5209cf9b3e8344c4a4f13b5b47e0de0c Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-319824576-project Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: exception: Image not found. Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'image_id': '9708d476-403a-43ed-9f07-d079ab1e96d4'} Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9708d476-403a-43ed-9f07-d079ab1e96d4 Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 02:53:11.439001 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9708d476-403a-43ed-9f07-d079ab1e96d4 could not be found. Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:11.444105 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5ae59961-ce44-40a4-86ce-ad3b48ccc5f2 tempest-ImagesMetadataNegativeTestJSON-319824576 tempest-ImagesMetadataNegativeTestJSON-319824576-project] Returning 404 to user: Image not found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:53:11.447832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4ac42bcd-b70a-4485-9686-20debb4bc20a tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff0538c9670>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:11.448572 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5ae59961-ce44-40a4-86ce-ad3b48ccc5f2 tempest-ImagesMetadataNegativeTestJSON-319824576 tempest-ImagesMetadataNegativeTestJSON-319824576-project] 10.222.0.46 "GET /compute/v2.1/images/9708d476-403a-43ed-9f07-d079ab1e96d4/metadata" status: 404 len: 62 microversion: 2.1 time: 0.043581 Oct 29 02:53:11.458444 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 897/1644] 10.222.0.46 () {58 vars in 1260 bytes} [Sat Oct 29 02:53:11 2022] GET /compute/v2.1/images/9708d476-403a-43ed-9f07-d079ab1e96d4/metadata => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:53:11.471642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0eb751b1-239a-4747-9e89-0bfd23f11249 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] Calling method '.version_select at 0x7ff053c7daf0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:11.562099 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4ac42bcd-b70a-4485-9686-20debb4bc20a tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59" status: 200 len: 1452 microversion: 2.1 time: 0.140035 Oct 29 02:53:11.568507 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 748/1645] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:11 2022] GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59 => generated 1452 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:11.603432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-56f032a5-6850-43c5-bd66-58be05642d59 tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Action: 'update', calling method: .version_select at 0x7ff05385bee0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:11.796417 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-56f032a5-6850-43c5-bd66-58be05642d59 tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:11.797885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-56f032a5-6850-43c5-bd66-58be05642d59 tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:11.799262 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-56f032a5-6850-43c5-bd66-58be05642d59 tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:11.802502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-56f032a5-6850-43c5-bd66-58be05642d59 tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:11.804489 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-56f032a5-6850-43c5-bd66-58be05642d59 tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:11.807393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-56f032a5-6850-43c5-bd66-58be05642d59 tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:11.931761 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0eb751b1-239a-4747-9e89-0bfd23f11249 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/0bf88e30-41b1-43a5-81ce-e91ec1dec86c" status: 202 len: 0 microversion: 2.1 time: 0.478023 Oct 29 02:53:11.933603 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 898/1646] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:53:11 2022] DELETE /compute/v2.1/os-security-groups/0bf88e30-41b1-43a5-81ce-e91ec1dec86c => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:53:11.951098 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-baf8554a-c247-4c11-9f48-c7c5dedeaa8c tempest-ImagesMetadataNegativeTestJSON-319824576 tempest-ImagesMetadataNegativeTestJSON-319824576-project] Action: 'update_all', calling method: .version_select at 0x7ff053c7d160>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:11.980274 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-56f032a5-6850-43c5-bd66-58be05642d59 tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/8a700da20eb643399d6628cbd3f0aec6" status: 200 len: 328 microversion: 2.1 time: 0.402418 Oct 29 02:53:11.997631 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 749/1647] 10.222.0.46 () {60 vars in 1262 bytes} [Sat Oct 29 02:53:11 2022] PUT /compute/v2.1/os-quota-sets/8a700da20eb643399d6628cbd3f0aec6 => generated 328 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:12.010411 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-20ba247e-e0d4-4a8a-81f8-d116d0f0d8a8 req-32c1a0d3-7927-4cea-bd58-f9a71bded4e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "500595ea-1c83-4574-b6c8-2d6cc39b2231", "name": "network-vif-unplugged", "status": "completed", "tag": "da1ef08b-d52a-458a-95fd-42a59fbff65e"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:12.019575 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-baf8554a-c247-4c11-9f48-c7c5dedeaa8c tempest-ImagesMetadataNegativeTestJSON-319824576 tempest-ImagesMetadataNegativeTestJSON-319824576-project] HTTP exception thrown: Image not found. Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-baf8554a-c247-4c11-9f48-c7c5dedeaa8c tempest-ImagesMetadataNegativeTestJSON-319824576 tempest-ImagesMetadataNegativeTestJSON-319824576-project] Request method failure captured: Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: request: PUT /compute/v2.1/images/b83d21fc-a8ac-46dd-9c8d-7099aedf69d8/metadata HTTP/1.1 Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 57 Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJWTcxbzvHZ706EHDC9NthMND1QZersI5uzOseVwwr_FFzZaRAqfZuyI8ZLA8B6cRRHQmhEQ7TMUkBzsUQDYSF_x82bjDi_qmE3tItXndmVkTTTCZEeGNldRMpXX7WP1J_mrpz9qAo2EfmmvYwrG6Zv1A9pwd4aGrDS5pDfOBR2GdVY Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: e7c0ab01a0404a07bf3d0d223964e93a Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-319824576 Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e7c0ab01a0404a07bf3d0d223964e93a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e7c0ab01a0404a07bf3d0d223964e93a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e7c0ab01a0404a07bf3d0d223964e93a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e7c0ab01a0404a07bf3d0d223964e93a"}]}] Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-319824576 Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: e7c0ab01a0404a07bf3d0d223964e93a Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-319824576 Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ImagesMetadataNegativeTestJSON-319824576-project Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 5209cf9b3e8344c4a4f13b5b47e0de0c Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-319824576-project Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: exception: Image not found. Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'image_id': 'b83d21fc-a8ac-46dd-9c8d-7099aedf69d8', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b83d21fc-a8ac-46dd-9c8d-7099aedf69d8 Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 02:53:12.025709 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b83d21fc-a8ac-46dd-9c8d-7099aedf69d8 could not be found. Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:53:12.030299 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.038164 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-baf8554a-c247-4c11-9f48-c7c5dedeaa8c tempest-ImagesMetadataNegativeTestJSON-319824576 tempest-ImagesMetadataNegativeTestJSON-319824576-project] Returning 404 to user: Image not found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:53:12.039930 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-baf8554a-c247-4c11-9f48-c7c5dedeaa8c tempest-ImagesMetadataNegativeTestJSON-319824576 tempest-ImagesMetadataNegativeTestJSON-319824576-project] 10.222.0.46 "PUT /compute/v2.1/images/b83d21fc-a8ac-46dd-9c8d-7099aedf69d8/metadata" status: 404 len: 62 microversion: 2.1 time: 0.104434 Oct 29 02:53:12.047357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-20ba247e-e0d4-4a8a-81f8-d116d0f0d8a8 req-32c1a0d3-7927-4cea-bd58-f9a71bded4e1 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:12.047933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-20ba247e-e0d4-4a8a-81f8-d116d0f0d8a8 req-32c1a0d3-7927-4cea-bd58-f9a71bded4e1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:12.048140 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 899/1648] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Oct 29 02:53:11 2022] PUT /compute/v2.1/images/b83d21fc-a8ac-46dd-9c8d-7099aedf69d8/metadata => generated 62 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:53:12.049936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-20ba247e-e0d4-4a8a-81f8-d116d0f0d8a8 req-32c1a0d3-7927-4cea-bd58-f9a71bded4e1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:12.053356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-f40c6f9b-5da6-4ecb-a517-a543cb3766fe req-857d7425-75e4-48ae-855e-08ab4f30c957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "500595ea-1c83-4574-b6c8-2d6cc39b2231", "name": "network-vif-deleted", "tag": "dc16dd44-033b-41eb-86dd-bf32e0dc64a5"}, {"server_uuid": "500595ea-1c83-4574-b6c8-2d6cc39b2231", "name": "network-vif-deleted", "tag": "da1ef08b-d52a-458a-95fd-42a59fbff65e"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:12.085831 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-20ba247e-e0d4-4a8a-81f8-d116d0f0d8a8 req-32c1a0d3-7927-4cea-bd58-f9a71bded4e1 service nova] Creating event network-vif-unplugged:da1ef08b-d52a-458a-95fd-42a59fbff65e for instance 500595ea-1c83-4574-b6c8-2d6cc39b2231 on n-h2-862967-2 Oct 29 02:53:12.093834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f40c6f9b-5da6-4ecb-a517-a543cb3766fe req-857d7425-75e4-48ae-855e-08ab4f30c957 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:12.095730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f40c6f9b-5da6-4ecb-a517-a543cb3766fe req-857d7425-75e4-48ae-855e-08ab4f30c957 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:12.097044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f40c6f9b-5da6-4ecb-a517-a543cb3766fe req-857d7425-75e4-48ae-855e-08ab4f30c957 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:12.099890 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-20ba247e-e0d4-4a8a-81f8-d116d0f0d8a8 req-32c1a0d3-7927-4cea-bd58-f9a71bded4e1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097490 Oct 29 02:53:12.101980 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 750/1649] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:12.115245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bb77ff8d-c3a5-4b68-bd25-0c7c4f9afaaf tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] Calling method '.version_select at 0x7ff0538c91f0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:12.130988 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-f40c6f9b-5da6-4ecb-a517-a543cb3766fe req-857d7425-75e4-48ae-855e-08ab4f30c957 service nova] Creating event network-vif-deleted:dc16dd44-033b-41eb-86dd-bf32e0dc64a5 for instance 500595ea-1c83-4574-b6c8-2d6cc39b2231 on n-h2-862967-2 Oct 29 02:53:12.134888 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-f40c6f9b-5da6-4ecb-a517-a543cb3766fe req-857d7425-75e4-48ae-855e-08ab4f30c957 service nova] Creating event network-vif-deleted:da1ef08b-d52a-458a-95fd-42a59fbff65e for instance 500595ea-1c83-4574-b6c8-2d6cc39b2231 on n-h2-862967-2 Oct 29 02:53:12.148165 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-f40c6f9b-5da6-4ecb-a517-a543cb3766fe req-857d7425-75e4-48ae-855e-08ab4f30c957 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.095825 Oct 29 02:53:12.153409 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 900/1650] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:12.162342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-70a800c5-ed7b-4459-a4a4-29c6c7412fa5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:12.167931 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-70a800c5-ed7b-4459-a4a4-29c6c7412fa5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:12.314036 n-d-862967-2 devstack@n-api.service[127125]: DEBUG neutronclient.v2_0.client [None req-bb77ff8d-c3a5-4b68-bd25-0c7c4f9afaaf tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cdd24da3-c325-4e76-82c0-1cc43af5e2bd does not exist", "detail": ""}} {{(pid=127125) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:53:12.314703 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.security_group_api [None req-bb77ff8d-c3a5-4b68-bd25-0c7c4f9afaaf tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] Neutron security group cdd24da3-c325-4e76-82c0-1cc43af5e2bd not found {{(pid=127125) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 02:53:12.315224 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-bb77ff8d-c3a5-4b68-bd25-0c7c4f9afaaf tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] HTTP exception thrown: Security group cdd24da3-c325-4e76-82c0-1cc43af5e2bd does not exist Oct 29 02:53:12.315224 n-d-862967-2 devstack@n-api.service[127125]: Neutron server returns request_ids: ['req-eb8a642e-803e-4e09-a77f-a629ceb8e301'] Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bb77ff8d-c3a5-4b68-bd25-0c7c4f9afaaf tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] Request method failure captured: Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/os-security-groups/cdd24da3-c325-4e76-82c0-1cc43af5e2bd HTTP/1.1 Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJWB-I_pSAnJhNMdJ33ayuT8ntmcJuD8DAIttSl9k4kkf4ib1S8mQ9G6dEmOCLSOKrPsodhwbn6GkBbiYcaU22iAQ_krWJSyyAjy7O6WA1FyD9HRi-prHT85_y08uPnaBb5RDCvqPQqxLg2AEUh4Ne856frNQkjs-iir0izwjibo20k Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: ab61d72e89b64475b38c754499938fc7 Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1160654276 Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ab61d72e89b64475b38c754499938fc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ab61d72e89b64475b38c754499938fc7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ab61d72e89b64475b38c754499938fc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ab61d72e89b64475b38c754499938fc7"}]}] Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1160654276 Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: ab61d72e89b64475b38c754499938fc7 Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1160654276 Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-SecurityGroupRulesTestJSON-1160654276-project Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: ba7a1eb725ab448f93520f887a224adb Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1160654276-project Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: exception: Security group cdd24da3-c325-4e76-82c0-1cc43af5e2bd does not exist Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: Neutron server returns request_ids: ['req-eb8a642e-803e-4e09-a77f-a629ceb8e301'] Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'cdd24da3-c325-4e76-82c0-1cc43af5e2bd'} Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:53:12.318061 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cdd24da3-c325-4e76-82c0-1cc43af5e2bd does not exist Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb8a642e-803e-4e09-a77f-a629ceb8e301'] Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cdd24da3-c325-4e76-82c0-1cc43af5e2bd does not exist Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb8a642e-803e-4e09-a77f-a629ceb8e301'] Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cdd24da3-c325-4e76-82c0-1cc43af5e2bd does not exist Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb8a642e-803e-4e09-a77f-a629ceb8e301'] Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cdd24da3-c325-4e76-82c0-1cc43af5e2bd does not exist Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb8a642e-803e-4e09-a77f-a629ceb8e301'] Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bb77ff8d-c3a5-4b68-bd25-0c7c4f9afaaf tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] Returning 404 to user: Security group cdd24da3-c325-4e76-82c0-1cc43af5e2bd does not exist Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: Neutron server returns request_ids: ['req-eb8a642e-803e-4e09-a77f-a629ceb8e301'] {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bb77ff8d-c3a5-4b68-bd25-0c7c4f9afaaf tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/cdd24da3-c325-4e76-82c0-1cc43af5e2bd" status: 404 len: 194 microversion: 2.1 time: 0.215064 Oct 29 02:53:12.322452 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 751/1651] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:53:12 2022] DELETE /compute/v2.1/os-security-groups/cdd24da3-c325-4e76-82c0-1cc43af5e2bd => generated 194 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:53:12.329894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-22d52829-3488-4c55-888c-e2a13a25697f tempest-ImagesMetadataNegativeTestJSON-319824576 tempest-ImagesMetadataNegativeTestJSON-319824576-project] Action: 'update', calling method: .version_select at 0x7ff053860670>, body: {"meta": {"os_distro": "alt"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:12.371693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-70a800c5-ed7b-4459-a4a4-29c6c7412fa5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:12.381907 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-70a800c5-ed7b-4459-a4a4-29c6c7412fa5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:12.383394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-70a800c5-ed7b-4459-a4a4-29c6c7412fa5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:12.390938 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-70a800c5-ed7b-4459-a4a4-29c6c7412fa5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1285 microversion: 2.42 time: 0.229731 Oct 29 02:53:12.405653 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-22d52829-3488-4c55-888c-e2a13a25697f tempest-ImagesMetadataNegativeTestJSON-319824576 tempest-ImagesMetadataNegativeTestJSON-319824576-project] HTTP exception thrown: Image not found. Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-22d52829-3488-4c55-888c-e2a13a25697f tempest-ImagesMetadataNegativeTestJSON-319824576 tempest-ImagesMetadataNegativeTestJSON-319824576-project] Request method failure captured: Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: request: PUT /compute/v2.1/images/e83381e7-332d-43a5-a5e3-497ce8d7bb22/metadata/os_distro HTTP/1.1 Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 30 Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJWTcxbzvHZ706EHDC9NthMND1QZersI5uzOseVwwr_FFzZaRAqfZuyI8ZLA8B6cRRHQmhEQ7TMUkBzsUQDYSF_x82bjDi_qmE3tItXndmVkTTTCZEeGNldRMpXX7WP1J_mrpz9qAo2EfmmvYwrG6Zv1A9pwd4aGrDS5pDfOBR2GdVY Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: e7c0ab01a0404a07bf3d0d223964e93a Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-319824576 Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e7c0ab01a0404a07bf3d0d223964e93a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e7c0ab01a0404a07bf3d0d223964e93a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e7c0ab01a0404a07bf3d0d223964e93a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e7c0ab01a0404a07bf3d0d223964e93a"}]}] Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-319824576 Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: e7c0ab01a0404a07bf3d0d223964e93a Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-319824576 Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ImagesMetadataNegativeTestJSON-319824576-project Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 5209cf9b3e8344c4a4f13b5b47e0de0c Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-319824576-project Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: {"meta": {"os_distro": "alt"}} Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: exception: Image not found. Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'image_id': 'e83381e7-332d-43a5-a5e3-497ce8d7bb22', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e83381e7-332d-43a5-a5e3-497ce8d7bb22 Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 02:53:12.408703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e83381e7-332d-43a5-a5e3-497ce8d7bb22 could not be found. Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-22d52829-3488-4c55-888c-e2a13a25697f tempest-ImagesMetadataNegativeTestJSON-319824576 tempest-ImagesMetadataNegativeTestJSON-319824576-project] Returning 404 to user: Image not found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:53:12.413371 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-22d52829-3488-4c55-888c-e2a13a25697f tempest-ImagesMetadataNegativeTestJSON-319824576 tempest-ImagesMetadataNegativeTestJSON-319824576-project] 10.222.0.46 "PUT /compute/v2.1/images/e83381e7-332d-43a5-a5e3-497ce8d7bb22/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.089773 Oct 29 02:53:12.421627 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 901/1652] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:12 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1285 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:12.421724 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 752/1653] 10.222.0.46 () {60 vars in 1310 bytes} [Sat Oct 29 02:53:12 2022] PUT /compute/v2.1/images/e83381e7-332d-43a5-a5e3-497ce8d7bb22/metadata/os_distro => generated 62 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:53:12.424445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e0c58720-97e7-4814-abb8-c665e7bacbd5 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-582001395", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:12.432360 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cab41c06-5b4c-4353-a170-3e3d5e95bb5d tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:12.433205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cab41c06-5b4c-4353-a170-3e3d5e95bb5d tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 500595ea-1c83-4574-b6c8-2d6cc39b2231] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:12.468211 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cab41c06-5b4c-4353-a170-3e3d5e95bb5d tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:12.470426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cab41c06-5b4c-4353-a170-3e3d5e95bb5d tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:12.470980 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cab41c06-5b4c-4353-a170-3e3d5e95bb5d tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:12.473446 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cab41c06-5b4c-4353-a170-3e3d5e95bb5d tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:12.473923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cab41c06-5b4c-4353-a170-3e3d5e95bb5d tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:12.474396 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cab41c06-5b4c-4353-a170-3e3d5e95bb5d tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:12.537416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-e0c58720-97e7-4814-abb8-c665e7bacbd5 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] validate_networks() for None {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:53:12.565710 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-cab41c06-5b4c-4353-a170-3e3d5e95bb5d tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] HTTP exception thrown: Instance 500595ea-1c83-4574-b6c8-2d6cc39b2231 could not be found. Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cab41c06-5b4c-4353-a170-3e3d5e95bb5d tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Request method failure captured: Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231 HTTP/1.1 Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJVSn1Z6yZnpE5ZLBPheTa94vsOrIOasAiqflLAyq0ViZzIaTN-GngdXiNxVtaUNnT_1JEwPWNZDPigA96-mocavOylAwL683fKA9fknIQSAeDUTDXBmfiqBt0bCvQUYum6e-GWieq2ZcdiDDLPe4J_CpI5GfUyH_e9FdaJLUVdQHvc Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 202abee8256d45b29f190731cc63609c Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersTestMultiNic-604724171 Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/202abee8256d45b29f190731cc63609c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/202abee8256d45b29f190731cc63609c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_202abee8256d45b29f190731cc63609c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/202abee8256d45b29f190731cc63609c"}]}] Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersTestMultiNic-604724171 Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 202abee8256d45b29f190731cc63609c Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersTestMultiNic-604724171 Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersTestMultiNic-604724171-project Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 67c50c8b6b2444a6afa86bc1d019925c Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersTestMultiNic-604724171-project Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 500595ea-1c83-4574-b6c8-2d6cc39b2231 could not be found. Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '500595ea-1c83-4574-b6c8-2d6cc39b2231'} Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 500595ea-1c83-4574-b6c8-2d6cc39b2231 could not be found. Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 500595ea-1c83-4574-b6c8-2d6cc39b2231 could not be found. Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:12.568552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.573736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:12.573736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:12.573736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:12.573736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:53:12.573736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:53:12.573736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 500595ea-1c83-4574-b6c8-2d6cc39b2231 could not be found. Oct 29 02:53:12.573736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:12.573736 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cab41c06-5b4c-4353-a170-3e3d5e95bb5d tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Returning 404 to user: Instance 500595ea-1c83-4574-b6c8-2d6cc39b2231 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:53:12.573736 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cab41c06-5b4c-4353-a170-3e3d5e95bb5d tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231" status: 404 len: 111 microversion: 2.1 time: 0.150699 Oct 29 02:53:12.573736 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 753/1654] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:12 2022] GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:53:12.592119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-94f8fe90-8391-432b-a9e9-1ca8cf0f6384 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] Calling method '.version_select at 0x7ff053860700>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:13.065768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e0c58720-97e7-4814-abb8-c665e7bacbd5 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:53:13.066824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e0c58720-97e7-4814-abb8-c665e7bacbd5 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:53:13.067611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e0c58720-97e7-4814-abb8-c665e7bacbd5 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:53:13.068204 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e0c58720-97e7-4814-abb8-c665e7bacbd5 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:53:13.068841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e0c58720-97e7-4814-abb8-c665e7bacbd5 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:53:13.095689 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e0c58720-97e7-4814-abb8-c665e7bacbd5 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:13.096708 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e0c58720-97e7-4814-abb8-c665e7bacbd5 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:13.097791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e0c58720-97e7-4814-abb8-c665e7bacbd5 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:13.099267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e0c58720-97e7-4814-abb8-c665e7bacbd5 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:13.101102 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e0c58720-97e7-4814-abb8-c665e7bacbd5 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:13.105109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e0c58720-97e7-4814-abb8-c665e7bacbd5 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:13.167820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-e0c58720-97e7-4814-abb8-c665e7bacbd5 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Getting quotas for project 8a700da20eb643399d6628cbd3f0aec6. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:53:13.184172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-e0c58720-97e7-4814-abb8-c665e7bacbd5 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Getting quotas for user 5aff9ef607034d41b7d83a5c95defb3d and project 8a700da20eb643399d6628cbd3f0aec6. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:53:13.218674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.utils [None req-e0c58720-97e7-4814-abb8-c665e7bacbd5 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] instances quota exceeded for 8a700da20eb643399d6628cbd3f0aec6, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127124) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 29 02:53:13.219631 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-e0c58720-97e7-4814-abb8-c665e7bacbd5 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e0c58720-97e7-4814-abb8-c665e7bacbd5 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Request method failure captured: Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 144 Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJWN1oP-MIutJ00GGA_JbPLm8uxWkdjkBpGLr4SvLmBukSCOYtW5qiD6KIXPUORc8DNNvn-yU1guHjx8JD4DZwxYLpSVhRTxh6F0fU7q-IwNXnPEtGbM6IUZEqFsvDUa5ZRxV5ebEHJ4vB86pdTKhRhKp9rUyXflc26rhz3BkLvbKKQ Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 8a700da20eb643399d6628cbd3f0aec6 Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-QuotasAdminNegativeTest-435328983 Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8a700da20eb643399d6628cbd3f0aec6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8a700da20eb643399d6628cbd3f0aec6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8a700da20eb643399d6628cbd3f0aec6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8a700da20eb643399d6628cbd3f0aec6"}]}] Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-QuotasAdminNegativeTest-435328983 Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 8a700da20eb643399d6628cbd3f0aec6 Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-435328983 Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-QuotasAdminNegativeTest-435328983-project Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 5aff9ef607034d41b7d83a5c95defb3d Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-QuotasAdminNegativeTest-435328983-project Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-582001395", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452"}} Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-582001395', 'imageRef': 'cd315600-df67-41c1-95d3-95a5145fc39a', 'flavorRef': '452'}}} Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 02:53:13.222330 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 29 02:53:13.227117 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:13.235068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e0c58720-97e7-4814-abb8-c665e7bacbd5 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:53:13.239846 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e0c58720-97e7-4814-abb8-c665e7bacbd5 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.821609 Oct 29 02:53:13.240815 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 902/1655] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:53:12 2022] POST /compute/v2.1/servers => generated 119 bytes in 823 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:53:13.254889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-70469f20-387e-469c-b65f-acd8e8bbdc73 tempest-ImagesMetadataNegativeTestJSON-319824576 tempest-ImagesMetadataNegativeTestJSON-319824576-project] Action: 'create', calling method: .version_select at 0x7ff053c7d160>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:13.299838 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-70469f20-387e-469c-b65f-acd8e8bbdc73 tempest-ImagesMetadataNegativeTestJSON-319824576 tempest-ImagesMetadataNegativeTestJSON-319824576-project] HTTP exception thrown: Image not found. Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-70469f20-387e-469c-b65f-acd8e8bbdc73 tempest-ImagesMetadataNegativeTestJSON-319824576 tempest-ImagesMetadataNegativeTestJSON-319824576-project] Request method failure captured: Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/images/489429bd-0e70-4759-ae65-afdfd7ac99f7/metadata HTTP/1.1 Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 57 Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJWTcxbzvHZ706EHDC9NthMND1QZersI5uzOseVwwr_FFzZaRAqfZuyI8ZLA8B6cRRHQmhEQ7TMUkBzsUQDYSF_x82bjDi_qmE3tItXndmVkTTTCZEeGNldRMpXX7WP1J_mrpz9qAo2EfmmvYwrG6Zv1A9pwd4aGrDS5pDfOBR2GdVY Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: e7c0ab01a0404a07bf3d0d223964e93a Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-319824576 Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e7c0ab01a0404a07bf3d0d223964e93a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e7c0ab01a0404a07bf3d0d223964e93a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e7c0ab01a0404a07bf3d0d223964e93a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e7c0ab01a0404a07bf3d0d223964e93a"}]}] Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-319824576 Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: e7c0ab01a0404a07bf3d0d223964e93a Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-319824576 Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ImagesMetadataNegativeTestJSON-319824576-project Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 5209cf9b3e8344c4a4f13b5b47e0de0c Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-319824576-project Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: exception: Image not found. Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'image_id': '489429bd-0e70-4759-ae65-afdfd7ac99f7', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 489429bd-0e70-4759-ae65-afdfd7ac99f7 Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 02:53:13.302837 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 489429bd-0e70-4759-ae65-afdfd7ac99f7 could not be found. Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:53:13.308094 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:13.315214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-70469f20-387e-469c-b65f-acd8e8bbdc73 tempest-ImagesMetadataNegativeTestJSON-319824576 tempest-ImagesMetadataNegativeTestJSON-319824576-project] Returning 404 to user: Image not found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:53:13.315214 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-70469f20-387e-469c-b65f-acd8e8bbdc73 tempest-ImagesMetadataNegativeTestJSON-319824576 tempest-ImagesMetadataNegativeTestJSON-319824576-project] 10.222.0.46 "POST /compute/v2.1/images/489429bd-0e70-4759-ae65-afdfd7ac99f7/metadata" status: 404 len: 62 microversion: 2.1 time: 0.071337 Oct 29 02:53:13.315214 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 903/1656] 10.222.0.46 () {60 vars in 1281 bytes} [Sat Oct 29 02:53:13 2022] POST /compute/v2.1/images/489429bd-0e70-4759-ae65-afdfd7ac99f7/metadata => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:53:13.320257 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bf4f2d58-ef29-4441-bae7-d13a840b482a tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c227af0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:13.466382 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bf4f2d58-ef29-4441-bae7-d13a840b482a tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59" status: 200 len: 1452 microversion: 2.1 time: 0.145357 Oct 29 02:53:13.468013 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 904/1657] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:13 2022] GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:13.491235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0939e9bd-cae4-425d-a382-aa84ad034cbb tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Action: 'update', calling method: .version_select at 0x7ff05c227a60>, body: {"quota_set": {"instances": 10}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:13.620437 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-94f8fe90-8391-432b-a9e9-1ca8cf0f6384 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/b1dad807-de60-43a1-bb8f-4f8a1e5fb5d1" status: 202 len: 0 microversion: 2.1 time: 1.048667 Oct 29 02:53:13.621915 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 754/1658] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:53:12 2022] DELETE /compute/v2.1/os-security-groups/b1dad807-de60-43a1-bb8f-4f8a1e5fb5d1 => generated 0 bytes in 1051 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:53:13.632698 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4dce621f-28b3-460f-8751-64d7f47ccf69 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:13.643561 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4dce621f-28b3-460f-8751-64d7f47ccf69 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:13.661258 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4dce621f-28b3-460f-8751-64d7f47ccf69 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:13.673615 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4dce621f-28b3-460f-8751-64d7f47ccf69 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:13.674860 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4dce621f-28b3-460f-8751-64d7f47ccf69 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:13.676483 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4dce621f-28b3-460f-8751-64d7f47ccf69 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:13.677614 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4dce621f-28b3-460f-8751-64d7f47ccf69 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:13.678638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4dce621f-28b3-460f-8751-64d7f47ccf69 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:14.345903 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4dce621f-28b3-460f-8751-64d7f47ccf69 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:14.360892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4dce621f-28b3-460f-8751-64d7f47ccf69 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:14.368097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4dce621f-28b3-460f-8751-64d7f47ccf69 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:14.370934 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4dce621f-28b3-460f-8751-64d7f47ccf69 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1583 microversion: 2.42 time: 0.746216 Oct 29 02:53:14.374030 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 755/1659] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:13 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1583 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:14.397609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9a7c53dd-ff94-4911-8164-07cafa2a336d tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] Calling method '.version_select at 0x7ff053886790>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:14.677279 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0939e9bd-cae4-425d-a382-aa84ad034cbb tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:14.680943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0939e9bd-cae4-425d-a382-aa84ad034cbb tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:14.681571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0939e9bd-cae4-425d-a382-aa84ad034cbb tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:14.682202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0939e9bd-cae4-425d-a382-aa84ad034cbb tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:14.686023 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0939e9bd-cae4-425d-a382-aa84ad034cbb tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:14.686533 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0939e9bd-cae4-425d-a382-aa84ad034cbb tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:14.865424 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0939e9bd-cae4-425d-a382-aa84ad034cbb tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/8a700da20eb643399d6628cbd3f0aec6" status: 200 len: 329 microversion: 2.1 time: 1.396085 Oct 29 02:53:14.872230 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 905/1660] 10.222.0.46 () {60 vars in 1262 bytes} [Sat Oct 29 02:53:13 2022] PUT /compute/v2.1/os-quota-sets/8a700da20eb643399d6628cbd3f0aec6 => generated 329 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:14.896710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cb27f6db-08ff-4fd7-8de4-b510eafa2198 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c1a3550>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:14.992951 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cb27f6db-08ff-4fd7-8de4-b510eafa2198 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59" status: 200 len: 1452 microversion: 2.1 time: 0.119294 Oct 29 02:53:14.994658 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 906/1661] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:14 2022] GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59 => generated 1452 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:15.006134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fce15dc6-950a-486b-bdae-0858fc00aaa9 tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Calling method '.version_select at 0x7ff05c1a3a60>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:15.684582 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fce15dc6-950a-486b-bdae-0858fc00aaa9 tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/8a700da20eb643399d6628cbd3f0aec6" status: 200 len: 371 microversion: 2.1 time: 0.685892 Oct 29 02:53:15.688437 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 907/1662] 10.222.0.46 () {58 vars in 1242 bytes} [Sat Oct 29 02:53:14 2022] GET /compute/v2.1/os-quota-sets/8a700da20eb643399d6628cbd3f0aec6 => generated 371 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:15.693955 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8e104c2e-a4af-4138-b5ab-b8049a67e829 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:15.694929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8e104c2e-a4af-4138-b5ab-b8049a67e829 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:15.715717 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8e104c2e-a4af-4138-b5ab-b8049a67e829 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:15.715717 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8e104c2e-a4af-4138-b5ab-b8049a67e829 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:15.715717 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8e104c2e-a4af-4138-b5ab-b8049a67e829 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:15.715717 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8e104c2e-a4af-4138-b5ab-b8049a67e829 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:15.715717 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8e104c2e-a4af-4138-b5ab-b8049a67e829 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:15.716899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8e104c2e-a4af-4138-b5ab-b8049a67e829 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:16.118649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8e104c2e-a4af-4138-b5ab-b8049a67e829 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:16.135774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8e104c2e-a4af-4138-b5ab-b8049a67e829 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:16.148363 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8e104c2e-a4af-4138-b5ab-b8049a67e829 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:16.149903 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8e104c2e-a4af-4138-b5ab-b8049a67e829 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1593 microversion: 2.42 time: 0.460130 Oct 29 02:53:16.154488 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 908/1663] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:15 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1593 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:16.168742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a64d8022-8611-4cd5-a8b6-56595d867cb8 tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Action: 'update', calling method: .version_select at 0x7ff05c23eca0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:16.733002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:16.746626 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a64d8022-8611-4cd5-a8b6-56595d867cb8 tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:16.749427 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a64d8022-8611-4cd5-a8b6-56595d867cb8 tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:16.751767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a64d8022-8611-4cd5-a8b6-56595d867cb8 tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:16.752850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a64d8022-8611-4cd5-a8b6-56595d867cb8 tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:16.753332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a64d8022-8611-4cd5-a8b6-56595d867cb8 tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:16.753956 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a64d8022-8611-4cd5-a8b6-56595d867cb8 tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:16.922739 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a64d8022-8611-4cd5-a8b6-56595d867cb8 tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/8a700da20eb643399d6628cbd3f0aec6" status: 200 len: 325 microversion: 2.1 time: 0.766252 Oct 29 02:53:16.925249 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 909/1664] 10.222.0.46 () {60 vars in 1262 bytes} [Sat Oct 29 02:53:16 2022] PUT /compute/v2.1/os-quota-sets/8a700da20eb643399d6628cbd3f0aec6 => generated 325 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:16.942530 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6111ffa7-5279-4e0f-84b9-4ffc61b910f7 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c24b550>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:17.075899 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6111ffa7-5279-4e0f-84b9-4ffc61b910f7 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59" status: 200 len: 1452 microversion: 2.1 time: 0.149076 Oct 29 02:53:17.095566 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 910/1665] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:16 2022] GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59 => generated 1452 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:17.372352 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9a7c53dd-ff94-4911-8164-07cafa2a336d tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/4eba6cdd-454b-421f-8312-8a39eb1c5583" status: 202 len: 0 microversion: 2.1 time: 2.996580 Oct 29 02:53:17.377994 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 756/1666] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:53:14 2022] DELETE /compute/v2.1/os-security-groups/4eba6cdd-454b-421f-8312-8a39eb1c5583 => generated 0 bytes in 3003 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:53:17.384167 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-255d4467-f6b5-46df-8362-3f81eba4730b tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-26088086", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:17.412372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f85f47df-8daa-45d8-b028-200ae05b1fae tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-195764467", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:17.499242 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-255d4467-f6b5-46df-8362-3f81eba4730b tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] validate_networks() for None {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:53:17.538836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-f85f47df-8daa-45d8-b028-200ae05b1fae tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] validate_networks() for None {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:53:17.952487 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-f85f47df-8daa-45d8-b028-200ae05b1fae tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:53:17.953195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-f85f47df-8daa-45d8-b028-200ae05b1fae tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:53:17.953606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-f85f47df-8daa-45d8-b028-200ae05b1fae tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:53:17.954016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-f85f47df-8daa-45d8-b028-200ae05b1fae tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:53:17.954634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-f85f47df-8daa-45d8-b028-200ae05b1fae tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:53:17.966201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f85f47df-8daa-45d8-b028-200ae05b1fae tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:17.966953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f85f47df-8daa-45d8-b028-200ae05b1fae tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:17.967586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f85f47df-8daa-45d8-b028-200ae05b1fae tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:17.968514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f85f47df-8daa-45d8-b028-200ae05b1fae tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:17.969311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f85f47df-8daa-45d8-b028-200ae05b1fae tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:17.969898 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f85f47df-8daa-45d8-b028-200ae05b1fae tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:17.991053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-f85f47df-8daa-45d8-b028-200ae05b1fae tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Getting quotas for project 10f820fbde72429db671d15337913fd4. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:53:17.997274 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-f85f47df-8daa-45d8-b028-200ae05b1fae tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Getting quotas for user 71c3218be14842e1b1fd2e5c10c9092a and project 10f820fbde72429db671d15337913fd4. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:53:18.011808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f85f47df-8daa-45d8-b028-200ae05b1fae tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:53:18.014819 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f85f47df-8daa-45d8-b028-200ae05b1fae tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] [instance: c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:53:18.146103 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f85f47df-8daa-45d8-b028-200ae05b1fae tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.041201 Oct 29 02:53:18.154991 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 911/1667] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:53:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:53:18.160671 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7aeaa118-f76d-4719-8819-50de38ac90b2 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:18.161639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7aeaa118-f76d-4719-8819-50de38ac90b2 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:18.170692 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7aeaa118-f76d-4719-8819-50de38ac90b2 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:18.171631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7aeaa118-f76d-4719-8819-50de38ac90b2 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:18.172355 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7aeaa118-f76d-4719-8819-50de38ac90b2 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:18.173444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7aeaa118-f76d-4719-8819-50de38ac90b2 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:18.174420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7aeaa118-f76d-4719-8819-50de38ac90b2 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:18.175822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7aeaa118-f76d-4719-8819-50de38ac90b2 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:18.284479 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7aeaa118-f76d-4719-8819-50de38ac90b2 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:18.301337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7aeaa118-f76d-4719-8819-50de38ac90b2 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:18.303371 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7aeaa118-f76d-4719-8819-50de38ac90b2 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:18.307090 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7aeaa118-f76d-4719-8819-50de38ac90b2 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1593 microversion: 2.42 time: 0.150637 Oct 29 02:53:18.309702 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 912/1668] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:18 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1593 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:18.330328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a0b44c3c-f276-4ca2-921d-734232289964 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] Calling method '.version_select at 0x7ff05c1a90d0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:18.986936 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a0b44c3c-f276-4ca2-921d-734232289964 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/728a7f72-a51b-4af6-be41-ef5f68ba5671" status: 202 len: 0 microversion: 2.1 time: 0.675359 Oct 29 02:53:18.989630 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 913/1669] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:53:18 2022] DELETE /compute/v2.1/os-security-groups/728a7f72-a51b-4af6-be41-ef5f68ba5671 => generated 0 bytes in 679 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:53:19.005852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d51daa7c-6b74-4926-a853-02481adc7d4a tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff0539b4af0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:19.131428 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d51daa7c-6b74-4926-a853-02481adc7d4a tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59" status: 200 len: 1452 microversion: 2.1 time: 0.139811 Oct 29 02:53:19.132042 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 914/1670] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:18 2022] GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59 => generated 1452 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:19.165775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-14b6f62f-5bda-4575-86ac-8746c81e300e tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:19.166627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-14b6f62f-5bda-4575-86ac-8746c81e300e tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] [instance: c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:19.381266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-14b6f62f-5bda-4575-86ac-8746c81e300e tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c3218be14842e1b1fd2e5c10c9092a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f820fbde72429db671d15337913fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:19.389140 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-14b6f62f-5bda-4575-86ac-8746c81e300e tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc" status: 200 len: 1216 microversion: 2.1 time: 0.244089 Oct 29 02:53:19.408705 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 915/1671] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:19 2022] GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc => generated 1216 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:19.423231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-26626c30-b966-4b4d-b927-8cec38c69817 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] Calling method '.version_select at 0x7ff05c1a9ee0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:19.506858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-255d4467-f6b5-46df-8362-3f81eba4730b tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:53:19.507422 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-255d4467-f6b5-46df-8362-3f81eba4730b tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:53:19.507906 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-255d4467-f6b5-46df-8362-3f81eba4730b tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:53:19.508141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-255d4467-f6b5-46df-8362-3f81eba4730b tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:53:19.508797 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-255d4467-f6b5-46df-8362-3f81eba4730b tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:53:19.534088 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-255d4467-f6b5-46df-8362-3f81eba4730b tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:19.537247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-255d4467-f6b5-46df-8362-3f81eba4730b tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:19.541028 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-255d4467-f6b5-46df-8362-3f81eba4730b tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:19.546952 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-255d4467-f6b5-46df-8362-3f81eba4730b tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:19.565642 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-255d4467-f6b5-46df-8362-3f81eba4730b tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:19.568011 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-255d4467-f6b5-46df-8362-3f81eba4730b tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:19.637400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-255d4467-f6b5-46df-8362-3f81eba4730b tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Getting quotas for project 8a700da20eb643399d6628cbd3f0aec6. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:53:19.661283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-255d4467-f6b5-46df-8362-3f81eba4730b tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Getting quotas for user 5aff9ef607034d41b7d83a5c95defb3d and project 8a700da20eb643399d6628cbd3f0aec6. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:53:19.710526 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.utils [None req-255d4467-f6b5-46df-8362-3f81eba4730b tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] ram quota exceeded for 8a700da20eb643399d6628cbd3f0aec6, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127125) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 29 02:53:19.711380 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-255d4467-f6b5-46df-8362-3f81eba4730b tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-255d4467-f6b5-46df-8362-3f81eba4730b tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Request method failure captured: Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 143 Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJWN1oP-MIutJ00GGA_JbPLm8uxWkdjkBpGLr4SvLmBukSCOYtW5qiD6KIXPUORc8DNNvn-yU1guHjx8JD4DZwxYLpSVhRTxh6F0fU7q-IwNXnPEtGbM6IUZEqFsvDUa5ZRxV5ebEHJ4vB86pdTKhRhKp9rUyXflc26rhz3BkLvbKKQ Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 8a700da20eb643399d6628cbd3f0aec6 Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-QuotasAdminNegativeTest-435328983 Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8a700da20eb643399d6628cbd3f0aec6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8a700da20eb643399d6628cbd3f0aec6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8a700da20eb643399d6628cbd3f0aec6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8a700da20eb643399d6628cbd3f0aec6"}]}] Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-QuotasAdminNegativeTest-435328983 Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 8a700da20eb643399d6628cbd3f0aec6 Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-435328983 Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-QuotasAdminNegativeTest-435328983-project Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 5aff9ef607034d41b7d83a5c95defb3d Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-QuotasAdminNegativeTest-435328983-project Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-26088086", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452"}} Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-26088086', 'imageRef': 'cd315600-df67-41c1-95d3-95a5145fc39a', 'flavorRef': '452'}}} Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 02:53:19.739320 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 29 02:53:19.746830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:19.753565 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-255d4467-f6b5-46df-8362-3f81eba4730b tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:53:19.758814 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-255d4467-f6b5-46df-8362-3f81eba4730b tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 2.371478 Oct 29 02:53:19.762628 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 757/1672] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:53:17 2022] POST /compute/v2.1/servers => generated 110 bytes in 2384 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:53:19.784637 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0353c009-ad38-4ca8-8b0c-7f91e71d579d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:19.785439 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0353c009-ad38-4ca8-8b0c-7f91e71d579d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:19.793934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0353c009-ad38-4ca8-8b0c-7f91e71d579d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:19.795208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0353c009-ad38-4ca8-8b0c-7f91e71d579d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:19.797354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0353c009-ad38-4ca8-8b0c-7f91e71d579d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:19.800131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0353c009-ad38-4ca8-8b0c-7f91e71d579d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:19.801300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0353c009-ad38-4ca8-8b0c-7f91e71d579d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:19.803956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0353c009-ad38-4ca8-8b0c-7f91e71d579d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:19.885744 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0353c009-ad38-4ca8-8b0c-7f91e71d579d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:53:19.897783 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-26626c30-b966-4b4d-b927-8cec38c69817 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/3f3e131e-88c8-4d49-842c-2a195b54a8c5" status: 202 len: 0 microversion: 2.1 time: 0.494224 Oct 29 02:53:19.898846 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 916/1673] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:53:19 2022] DELETE /compute/v2.1/os-security-groups/3f3e131e-88c8-4d49-842c-2a195b54a8c5 => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:53:19.905157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-25369dc1-bc09-4ae4-9bed-fdafa133c501 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:19.906069 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-25369dc1-bc09-4ae4-9bed-fdafa133c501 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:19.939519 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25369dc1-bc09-4ae4-9bed-fdafa133c501 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:19.940266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25369dc1-bc09-4ae4-9bed-fdafa133c501 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:19.943460 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25369dc1-bc09-4ae4-9bed-fdafa133c501 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:19.946712 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25369dc1-bc09-4ae4-9bed-fdafa133c501 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:19.950203 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25369dc1-bc09-4ae4-9bed-fdafa133c501 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:19.951708 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25369dc1-bc09-4ae4-9bed-fdafa133c501 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:20.069153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:20.101385 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0353c009-ad38-4ca8-8b0c-7f91e71d579d tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "DELETE /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 204 len: 0 microversion: 2.25 time: 0.336622 Oct 29 02:53:20.107183 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 758/1674] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Oct 29 02:53:19 2022] DELETE /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 02:53:20.113815 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6009b059-5511-4537-98dd-576a6fe9448c tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Action: 'update', calling method: .version_select at 0x7ff0538323a0>, body: {"quota_set": {"ram": 51200}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:20.467007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-25369dc1-bc09-4ae4-9bed-fdafa133c501 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:20.501228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-25369dc1-bc09-4ae4-9bed-fdafa133c501 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:20.510847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-25369dc1-bc09-4ae4-9bed-fdafa133c501 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:20.512710 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-25369dc1-bc09-4ae4-9bed-fdafa133c501 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1661 microversion: 2.42 time: 0.612584 Oct 29 02:53:20.514718 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 917/1675] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:19 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1661 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:20.532437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fb2bc779-6cd5-4a6e-b8df-0f1c4e346b19 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] Calling method '.version_select at 0x7ff05c1b1310>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:21.129100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6009b059-5511-4537-98dd-576a6fe9448c tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:21.133081 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6009b059-5511-4537-98dd-576a6fe9448c tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:21.136898 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6009b059-5511-4537-98dd-576a6fe9448c tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:21.141934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6009b059-5511-4537-98dd-576a6fe9448c tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:21.148063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6009b059-5511-4537-98dd-576a6fe9448c tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:21.148634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6009b059-5511-4537-98dd-576a6fe9448c tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:21.375955 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6009b059-5511-4537-98dd-576a6fe9448c tempest-QuotasAdminNegativeTest-1637600883 tempest-QuotasAdminNegativeTest-1637600883-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/8a700da20eb643399d6628cbd3f0aec6" status: 200 len: 329 microversion: 2.1 time: 1.266832 Oct 29 02:53:21.405005 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 759/1676] 10.222.0.46 () {60 vars in 1262 bytes} [Sat Oct 29 02:53:20 2022] PUT /compute/v2.1/os-quota-sets/8a700da20eb643399d6628cbd3f0aec6 => generated 329 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:21.405005 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fef68c26-a924-4bf1-b9c6-6173bac6d39c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:21.405005 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fef68c26-a924-4bf1-b9c6-6173bac6d39c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:21.406493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fef68c26-a924-4bf1-b9c6-6173bac6d39c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:21.410103 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fef68c26-a924-4bf1-b9c6-6173bac6d39c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:21.410567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fef68c26-a924-4bf1-b9c6-6173bac6d39c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:21.411319 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fef68c26-a924-4bf1-b9c6-6173bac6d39c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:21.411786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fef68c26-a924-4bf1-b9c6-6173bac6d39c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:21.412209 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fef68c26-a924-4bf1-b9c6-6173bac6d39c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:22.254285 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fef68c26-a924-4bf1-b9c6-6173bac6d39c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:22.267201 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fef68c26-a924-4bf1-b9c6-6173bac6d39c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:22.272643 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fef68c26-a924-4bf1-b9c6-6173bac6d39c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:22.275565 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fef68c26-a924-4bf1-b9c6-6173bac6d39c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1733 microversion: 2.25 time: 0.894573 Oct 29 02:53:22.292934 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 760/1677] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:21 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1733 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:22.300237 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5a22caae-eba6-42cb-9874-9596d2eefb94 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff053704a60>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:22.357487 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5a22caae-eba6-42cb-9874-9596d2eefb94 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59" status: 200 len: 1452 microversion: 2.1 time: 0.063309 Oct 29 02:53:22.358371 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 761/1678] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:22 2022] GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59 => generated 1452 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:22.375907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-65ee2fbc-44cb-428c-a70e-0c4009e5f3da tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:22.377739 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-65ee2fbc-44cb-428c-a70e-0c4009e5f3da tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] [instance: c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:22.402892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65ee2fbc-44cb-428c-a70e-0c4009e5f3da tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:22.405116 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65ee2fbc-44cb-428c-a70e-0c4009e5f3da tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:22.405566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65ee2fbc-44cb-428c-a70e-0c4009e5f3da tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:22.406308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65ee2fbc-44cb-428c-a70e-0c4009e5f3da tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:22.406762 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65ee2fbc-44cb-428c-a70e-0c4009e5f3da tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:22.413087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65ee2fbc-44cb-428c-a70e-0c4009e5f3da tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:22.543148 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fb2bc779-6cd5-4a6e-b8df-0f1c4e346b19 tempest-SecurityGroupRulesTestJSON-1160654276 tempest-SecurityGroupRulesTestJSON-1160654276-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/027ef978-dda6-40c1-a8cd-8f2f1bb14d25" status: 202 len: 0 microversion: 2.1 time: 2.017845 Oct 29 02:53:22.552398 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 918/1679] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:53:20 2022] DELETE /compute/v2.1/os-security-groups/027ef978-dda6-40c1-a8cd-8f2f1bb14d25 => generated 0 bytes in 2035 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:53:22.558032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f604cb3a-72b8-46fb-9a75-779f2dc254a7 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Action: 'update', calling method: .version_select at 0x7ff05c1814c0>, body: {"quota_set": {"ram": 0}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:22.564933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f604cb3a-72b8-46fb-9a75-779f2dc254a7 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '5aff9ef607034d41b7d83a5c95defb3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a700da20eb643399d6628cbd3f0aec6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f604cb3a-72b8-46fb-9a75-779f2dc254a7 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Request method failure captured: Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: request: PUT /compute/v2.1/os-quota-sets/8a700da20eb643399d6628cbd3f0aec6 HTTP/1.1 Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 25 Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJWN1oP-MIutJ00GGA_JbPLm8uxWkdjkBpGLr4SvLmBukSCOYtW5qiD6KIXPUORc8DNNvn-yU1guHjx8JD4DZwxYLpSVhRTxh6F0fU7q-IwNXnPEtGbM6IUZEqFsvDUa5ZRxV5ebEHJ4vB86pdTKhRhKp9rUyXflc26rhz3BkLvbKKQ Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 8a700da20eb643399d6628cbd3f0aec6 Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-QuotasAdminNegativeTest-435328983 Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8a700da20eb643399d6628cbd3f0aec6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/8a700da20eb643399d6628cbd3f0aec6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_8a700da20eb643399d6628cbd3f0aec6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/8a700da20eb643399d6628cbd3f0aec6"}]}] Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-QuotasAdminNegativeTest-435328983 Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 8a700da20eb643399d6628cbd3f0aec6 Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-435328983 Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-QuotasAdminNegativeTest-435328983-project Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 5aff9ef607034d41b7d83a5c95defb3d Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-QuotasAdminNegativeTest-435328983-project Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: {"quota_set": {"ram": 0}} Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '8a700da20eb643399d6628cbd3f0aec6', 'body': {'quota_set': {'ram': 0}}} Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:53:22.575311 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:53:22.580596 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:53:22.580596 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:53:22.580596 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:53:22.580596 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:53:22.580596 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 29 02:53:22.580596 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:22.580596 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:22.580596 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:22.580596 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:22.580596 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:22.580596 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:22.580596 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:53:22.580596 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:53:22.580596 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 29 02:53:22.580596 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:22.585289 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f604cb3a-72b8-46fb-9a75-779f2dc254a7 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:53:22.587207 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f604cb3a-72b8-46fb-9a75-779f2dc254a7 tempest-QuotasAdminNegativeTest-435328983 tempest-QuotasAdminNegativeTest-435328983-project] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/8a700da20eb643399d6628cbd3f0aec6" status: 403 len: 116 microversion: 2.1 time: 0.032629 Oct 29 02:53:22.588412 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 919/1680] 10.222.0.46 () {60 vars in 1262 bytes} [Sat Oct 29 02:53:22 2022] PUT /compute/v2.1/os-quota-sets/8a700da20eb643399d6628cbd3f0aec6 => generated 116 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:53:22.595332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3c6d6b9e-ece3-4b56-93cc-1a3bf9f72d0f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:22.595645 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3c6d6b9e-ece3-4b56-93cc-1a3bf9f72d0f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:22.608103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c6d6b9e-ece3-4b56-93cc-1a3bf9f72d0f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:22.608928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c6d6b9e-ece3-4b56-93cc-1a3bf9f72d0f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:22.609614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c6d6b9e-ece3-4b56-93cc-1a3bf9f72d0f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:22.610569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c6d6b9e-ece3-4b56-93cc-1a3bf9f72d0f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:22.611299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c6d6b9e-ece3-4b56-93cc-1a3bf9f72d0f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:22.611941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c6d6b9e-ece3-4b56-93cc-1a3bf9f72d0f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:22.918795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-65ee2fbc-44cb-428c-a70e-0c4009e5f3da tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c3218be14842e1b1fd2e5c10c9092a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f820fbde72429db671d15337913fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:22.951423 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-65ee2fbc-44cb-428c-a70e-0c4009e5f3da tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc" status: 200 len: 1286 microversion: 2.1 time: 0.591536 Oct 29 02:53:22.980699 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 762/1681] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:22 2022] GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc => generated 1286 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:23.351095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6790f2f1-4763-4619-9fcf-b857b089f43c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:23.353543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6790f2f1-4763-4619-9fcf-b857b089f43c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:23.370071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6790f2f1-4763-4619-9fcf-b857b089f43c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:23.370071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6790f2f1-4763-4619-9fcf-b857b089f43c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:23.370071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6790f2f1-4763-4619-9fcf-b857b089f43c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:23.370071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6790f2f1-4763-4619-9fcf-b857b089f43c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:23.370071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6790f2f1-4763-4619-9fcf-b857b089f43c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:23.370071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6790f2f1-4763-4619-9fcf-b857b089f43c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:23.446805 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3c6d6b9e-ece3-4b56-93cc-1a3bf9f72d0f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:23.479888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3c6d6b9e-ece3-4b56-93cc-1a3bf9f72d0f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:23.489121 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3c6d6b9e-ece3-4b56-93cc-1a3bf9f72d0f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:23.496654 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3c6d6b9e-ece3-4b56-93cc-1a3bf9f72d0f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1661 microversion: 2.42 time: 0.904054 Oct 29 02:53:23.499903 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 920/1682] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:22 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1661 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:23.521016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-66d96cd0-579b-46ab-a2f9-c26f4f561a81 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c1a4e50>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:23.632266 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-66d96cd0-579b-46ab-a2f9-c26f4f561a81 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59" status: 200 len: 1452 microversion: 2.1 time: 0.129414 Oct 29 02:53:23.634634 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 921/1683] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:23 2022] GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59 => generated 1452 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:23.981985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-24c15cc5-5f68-4cca-b5aa-55163e1dc449 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:23.983315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-24c15cc5-5f68-4cca-b5aa-55163e1dc449 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] [instance: c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:24.003336 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-24c15cc5-5f68-4cca-b5aa-55163e1dc449 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:24.003889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-24c15cc5-5f68-4cca-b5aa-55163e1dc449 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:24.007635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-24c15cc5-5f68-4cca-b5aa-55163e1dc449 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:24.008501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-24c15cc5-5f68-4cca-b5aa-55163e1dc449 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:24.009009 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-24c15cc5-5f68-4cca-b5aa-55163e1dc449 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:24.009451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-24c15cc5-5f68-4cca-b5aa-55163e1dc449 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:24.160381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6790f2f1-4763-4619-9fcf-b857b089f43c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:24.175926 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6790f2f1-4763-4619-9fcf-b857b089f43c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:24.187017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6790f2f1-4763-4619-9fcf-b857b089f43c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:24.189056 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6790f2f1-4763-4619-9fcf-b857b089f43c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1665 microversion: 2.25 time: 0.863472 Oct 29 02:53:24.190863 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 763/1684] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:23 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1665 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:24.533972 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-916f6352-3789-4fe2-b77d-82bddd765abd tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:24.535784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-916f6352-3789-4fe2-b77d-82bddd765abd tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:24.580619 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-916f6352-3789-4fe2-b77d-82bddd765abd tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:24.581792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-916f6352-3789-4fe2-b77d-82bddd765abd tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:24.582784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-916f6352-3789-4fe2-b77d-82bddd765abd tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:24.584105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-916f6352-3789-4fe2-b77d-82bddd765abd tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:24.600721 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-916f6352-3789-4fe2-b77d-82bddd765abd tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:24.601679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-916f6352-3789-4fe2-b77d-82bddd765abd tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:24.919218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-24c15cc5-5f68-4cca-b5aa-55163e1dc449 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c3218be14842e1b1fd2e5c10c9092a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f820fbde72429db671d15337913fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:24.930285 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-24c15cc5-5f68-4cca-b5aa-55163e1dc449 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc" status: 200 len: 1274 microversion: 2.1 time: 0.954031 Oct 29 02:53:24.945045 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 922/1685] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:23 2022] GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc => generated 1274 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:24.952461 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1c5cdf29-4f3d-406b-ba83-ef36cf5c9056 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c1b1dc0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:25.058540 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1c5cdf29-4f3d-406b-ba83-ef36cf5c9056 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59" status: 200 len: 1452 microversion: 2.1 time: 0.100203 Oct 29 02:53:25.069767 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 923/1686] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:24 2022] GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59 => generated 1452 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:25.217727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1cf8da73-5b42-4a08-ad73-ad1af246875e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:25.218360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1cf8da73-5b42-4a08-ad73-ad1af246875e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:25.227340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cf8da73-5b42-4a08-ad73-ad1af246875e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:25.228165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cf8da73-5b42-4a08-ad73-ad1af246875e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:25.228878 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cf8da73-5b42-4a08-ad73-ad1af246875e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:25.229780 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cf8da73-5b42-4a08-ad73-ad1af246875e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:25.230404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cf8da73-5b42-4a08-ad73-ad1af246875e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:25.231001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cf8da73-5b42-4a08-ad73-ad1af246875e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:25.447673 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1cf8da73-5b42-4a08-ad73-ad1af246875e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:25.461489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1cf8da73-5b42-4a08-ad73-ad1af246875e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:25.466988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1cf8da73-5b42-4a08-ad73-ad1af246875e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:25.469077 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1cf8da73-5b42-4a08-ad73-ad1af246875e tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1665 microversion: 2.25 time: 0.255207 Oct 29 02:53:25.472017 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 924/1687] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:25 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1665 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:25.956751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-49a5e2bd-4ea7-4070-9d5e-6c42ac8043f2 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:25.958125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-49a5e2bd-4ea7-4070-9d5e-6c42ac8043f2 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] [instance: c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:25.980865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-49a5e2bd-4ea7-4070-9d5e-6c42ac8043f2 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:25.991006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-49a5e2bd-4ea7-4070-9d5e-6c42ac8043f2 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:25.994110 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-49a5e2bd-4ea7-4070-9d5e-6c42ac8043f2 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:25.999200 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-49a5e2bd-4ea7-4070-9d5e-6c42ac8043f2 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:26.006490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-49a5e2bd-4ea7-4070-9d5e-6c42ac8043f2 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:26.008835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-49a5e2bd-4ea7-4070-9d5e-6c42ac8043f2 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:26.186214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-916f6352-3789-4fe2-b77d-82bddd765abd tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:26.224858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-916f6352-3789-4fe2-b77d-82bddd765abd tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:26.227067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-916f6352-3789-4fe2-b77d-82bddd765abd tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:26.243152 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-916f6352-3789-4fe2-b77d-82bddd765abd tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1708 microversion: 2.42 time: 1.717290 Oct 29 02:53:26.264552 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 764/1688] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:24 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1708 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:53:26.270325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-61bc9036-b397-4c16-bb60-8edf26b7b78a req-5863753f-f964-4069-9c26-bd9fd5a6d470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "694141ac-c96c-409b-9eb2-831a3ccb5a68", "name": "network-vif-deleted", "tag": "0c4a3365-7206-4763-be5c-6b7899359935"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:26.304138 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-49a5e2bd-4ea7-4070-9d5e-6c42ac8043f2 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c3218be14842e1b1fd2e5c10c9092a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f820fbde72429db671d15337913fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:26.314442 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-49a5e2bd-4ea7-4070-9d5e-6c42ac8043f2 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc" status: 200 len: 1274 microversion: 2.1 time: 0.362467 Oct 29 02:53:26.315043 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 925/1689] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:25 2022] GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc => generated 1274 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:53:26.330412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-61bc9036-b397-4c16-bb60-8edf26b7b78a req-5863753f-f964-4069-9c26-bd9fd5a6d470 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:26.330930 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-61bc9036-b397-4c16-bb60-8edf26b7b78a req-5863753f-f964-4069-9c26-bd9fd5a6d470 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:26.331375 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-61bc9036-b397-4c16-bb60-8edf26b7b78a req-5863753f-f964-4069-9c26-bd9fd5a6d470 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:26.369417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bca45d0f-0b8b-408a-bf2e-3ed6b3a7cc86 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c251280>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:26.391475 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-61bc9036-b397-4c16-bb60-8edf26b7b78a req-5863753f-f964-4069-9c26-bd9fd5a6d470 service nova] Creating event network-vif-deleted:0c4a3365-7206-4763-be5c-6b7899359935 for instance 694141ac-c96c-409b-9eb2-831a3ccb5a68 on n-h2-862967-2 Oct 29 02:53:26.415570 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-61bc9036-b397-4c16-bb60-8edf26b7b78a req-5863753f-f964-4069-9c26-bd9fd5a6d470 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160927 Oct 29 02:53:26.416814 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 765/1690] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:26.504847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9334b4a8-ed1f-4a82-ba37-1e602a5535e3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:26.514502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9334b4a8-ed1f-4a82-ba37-1e602a5535e3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:26.516066 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bca45d0f-0b8b-408a-bf2e-3ed6b3a7cc86 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59" status: 200 len: 1452 microversion: 2.1 time: 0.199934 Oct 29 02:53:26.521304 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 926/1691] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:26 2022] GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59 => generated 1452 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:26.549894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9334b4a8-ed1f-4a82-ba37-1e602a5535e3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:26.552435 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9334b4a8-ed1f-4a82-ba37-1e602a5535e3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:26.553138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9334b4a8-ed1f-4a82-ba37-1e602a5535e3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:26.554256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9334b4a8-ed1f-4a82-ba37-1e602a5535e3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:26.557906 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9334b4a8-ed1f-4a82-ba37-1e602a5535e3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:26.558570 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9334b4a8-ed1f-4a82-ba37-1e602a5535e3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:26.679482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9334b4a8-ed1f-4a82-ba37-1e602a5535e3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:26.693762 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9334b4a8-ed1f-4a82-ba37-1e602a5535e3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:26.694596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9334b4a8-ed1f-4a82-ba37-1e602a5535e3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:26.695315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-9334b4a8-ed1f-4a82-ba37-1e602a5535e3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lazy-loading 'fault' on Instance uuid 694141ac-c96c-409b-9eb2-831a3ccb5a68 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:53:27.284786 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-07f541e7-7e91-44a9-8dfb-0a2c1650cba1 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:27.285816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-07f541e7-7e91-44a9-8dfb-0a2c1650cba1 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:27.295237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07f541e7-7e91-44a9-8dfb-0a2c1650cba1 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:27.301901 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07f541e7-7e91-44a9-8dfb-0a2c1650cba1 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:27.302367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07f541e7-7e91-44a9-8dfb-0a2c1650cba1 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:27.303126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07f541e7-7e91-44a9-8dfb-0a2c1650cba1 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:27.303598 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07f541e7-7e91-44a9-8dfb-0a2c1650cba1 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:27.309074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07f541e7-7e91-44a9-8dfb-0a2c1650cba1 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:27.803789 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-07f541e7-7e91-44a9-8dfb-0a2c1650cba1 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:27.826070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9334b4a8-ed1f-4a82-ba37-1e602a5535e3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:27.831118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-07f541e7-7e91-44a9-8dfb-0a2c1650cba1 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:27.835863 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-07f541e7-7e91-44a9-8dfb-0a2c1650cba1 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:27.839137 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-07f541e7-7e91-44a9-8dfb-0a2c1650cba1 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1708 microversion: 2.42 time: 0.558246 Oct 29 02:53:27.849566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9334b4a8-ed1f-4a82-ba37-1e602a5535e3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:27.853978 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9334b4a8-ed1f-4a82-ba37-1e602a5535e3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:27.854304 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 927/1692] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:27 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1708 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:53:27.864812 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9334b4a8-ed1f-4a82-ba37-1e602a5535e3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 200 len: 1375 microversion: 2.25 time: 1.367969 Oct 29 02:53:27.867146 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 766/1693] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:26 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 1375 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:27.880122 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ae6f4a7b-bf33-4617-8ebc-6ae0584ff63a tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:27.880343 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6a1e322a-05c3-4a71-933e-c0f8b5234552 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff053860ee0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:27.882020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ae6f4a7b-bf33-4617-8ebc-6ae0584ff63a tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] [instance: c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:27.901954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae6f4a7b-bf33-4617-8ebc-6ae0584ff63a tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:27.902891 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae6f4a7b-bf33-4617-8ebc-6ae0584ff63a tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:27.903597 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae6f4a7b-bf33-4617-8ebc-6ae0584ff63a tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:27.904623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae6f4a7b-bf33-4617-8ebc-6ae0584ff63a tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:27.908760 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae6f4a7b-bf33-4617-8ebc-6ae0584ff63a tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:27.909556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae6f4a7b-bf33-4617-8ebc-6ae0584ff63a tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:27.997510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=21 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:28.005539 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6a1e322a-05c3-4a71-933e-c0f8b5234552 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59" status: 200 len: 1452 microversion: 2.1 time: 0.136921 Oct 29 02:53:28.008600 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 767/1694] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:27 2022] GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59 => generated 1452 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:28.159649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ae6f4a7b-bf33-4617-8ebc-6ae0584ff63a tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c3218be14842e1b1fd2e5c10c9092a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f820fbde72429db671d15337913fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:28.172669 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ae6f4a7b-bf33-4617-8ebc-6ae0584ff63a tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc" status: 200 len: 1274 microversion: 2.1 time: 0.316899 Oct 29 02:53:28.176207 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 928/1695] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:27 2022] GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc => generated 1274 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:28.890834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ab14a50a-c8c5-4491-ae20-c837150435e9 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:28.891977 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ab14a50a-c8c5-4491-ae20-c837150435e9 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:28.897260 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d6b8557c-ef95-480c-af1c-bd586e4459dd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:28.898137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d6b8557c-ef95-480c-af1c-bd586e4459dd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 694141ac-c96c-409b-9eb2-831a3ccb5a68] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:28.907570 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6b8557c-ef95-480c-af1c-bd586e4459dd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:28.910714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6b8557c-ef95-480c-af1c-bd586e4459dd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:28.911172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6b8557c-ef95-480c-af1c-bd586e4459dd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:28.911928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6b8557c-ef95-480c-af1c-bd586e4459dd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:28.913727 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab14a50a-c8c5-4491-ae20-c837150435e9 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:28.914279 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab14a50a-c8c5-4491-ae20-c837150435e9 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:28.914719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab14a50a-c8c5-4491-ae20-c837150435e9 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:28.916742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab14a50a-c8c5-4491-ae20-c837150435e9 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:28.917434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab14a50a-c8c5-4491-ae20-c837150435e9 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:28.919324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6b8557c-ef95-480c-af1c-bd586e4459dd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:28.919779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6b8557c-ef95-480c-af1c-bd586e4459dd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:28.920975 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab14a50a-c8c5-4491-ae20-c837150435e9 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:28.962673 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-d6b8557c-ef95-480c-af1c-bd586e4459dd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] HTTP exception thrown: Instance 694141ac-c96c-409b-9eb2-831a3ccb5a68 could not be found. Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d6b8557c-ef95-480c-af1c-bd586e4459dd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Request method failure captured: Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 HTTP/1.1 Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPY62lZ02kminN7qHv7SG1RovI20ydDPZQv3tU5TxvLPKUoiJl_AOrRTdYppSUhrWf-y0a9Bz_57Qjo2lN_Zn__d7tPquCT-d7vLweqRqmT_i2ewZGK6bM0drOtR2PR0C_5HjpH6zHOxAYP1pWsYHXaaVsdN0RVEPjL6hMRRWt73-g Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: X-Openstack-Nova-Api-Version: 2.25 Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: f86634862bd64e0f9f00972e4ce0982b Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2000095198 Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f86634862bd64e0f9f00972e4ce0982b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f86634862bd64e0f9f00972e4ce0982b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f86634862bd64e0f9f00972e4ce0982b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f86634862bd64e0f9f00972e4ce0982b"}]}] Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2000095198 Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: f86634862bd64e0f9f00972e4ce0982b Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2000095198 Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-LiveAutoBlockMigrationV225Test-2000095198-project Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 067d53567ea944b1b69ee7f461aa0c16 Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2000095198-project Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 694141ac-c96c-409b-9eb2-831a3ccb5a68 could not be found. Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '694141ac-c96c-409b-9eb2-831a3ccb5a68'} Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 694141ac-c96c-409b-9eb2-831a3ccb5a68 could not be found. Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 694141ac-c96c-409b-9eb2-831a3ccb5a68 could not be found. Oct 29 02:53:28.966791 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:28.971989 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:28.971989 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:28.971989 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:28.971989 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:28.971989 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:28.971989 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:53:28.971989 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:53:28.971989 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 694141ac-c96c-409b-9eb2-831a3ccb5a68 could not be found. Oct 29 02:53:28.971989 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:28.976653 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d6b8557c-ef95-480c-af1c-bd586e4459dd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Returning 404 to user: Instance 694141ac-c96c-409b-9eb2-831a3ccb5a68 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:53:28.977779 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d6b8557c-ef95-480c-af1c-bd586e4459dd tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68" status: 404 len: 111 microversion: 2.25 time: 0.086996 Oct 29 02:53:28.981265 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 929/1696] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:28 2022] GET /compute/v2.1/servers/694141ac-c96c-409b-9eb2-831a3ccb5a68 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 29 02:53:28.993996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-aae6ec67-9cd9-48a5-85eb-e5179a5c2b88 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '.version_select at 0x7ff05c227700>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:29.034566 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-aae6ec67-9cd9-48a5-85eb-e5179a5c2b88 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-151434447" status: 204 len: 0 microversion: 2.25 time: 0.048555 Oct 29 02:53:29.036109 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 930/1697] 10.222.0.46 () {60 vars in 1259 bytes} [Sat Oct 29 02:53:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-151434447 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 29 02:53:29.049021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9e9deb4a-1820-4d21-a1ae-c58b9cd4ae8a tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c2305e0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:29.216016 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9e9deb4a-1820-4d21-a1ae-c58b9cd4ae8a tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59" status: 200 len: 1452 microversion: 2.1 time: 0.178554 Oct 29 02:53:29.216646 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 931/1698] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:29 2022] GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59 => generated 1452 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:29.225025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a6d75654-59a8-46ec-8d5d-9df3d6e05885 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:29.225985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a6d75654-59a8-46ec-8d5d-9df3d6e05885 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] [instance: c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:29.235315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6d75654-59a8-46ec-8d5d-9df3d6e05885 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:29.236233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6d75654-59a8-46ec-8d5d-9df3d6e05885 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:29.237264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6d75654-59a8-46ec-8d5d-9df3d6e05885 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:29.238469 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6d75654-59a8-46ec-8d5d-9df3d6e05885 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:29.239394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6d75654-59a8-46ec-8d5d-9df3d6e05885 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:29.240156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6d75654-59a8-46ec-8d5d-9df3d6e05885 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:29.386293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=35 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:29.539803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a6d75654-59a8-46ec-8d5d-9df3d6e05885 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c3218be14842e1b1fd2e5c10c9092a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f820fbde72429db671d15337913fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:29.552667 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a6d75654-59a8-46ec-8d5d-9df3d6e05885 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc" status: 200 len: 1274 microversion: 2.1 time: 0.332462 Oct 29 02:53:29.554678 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 932/1699] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:29 2022] GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc => generated 1274 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:30.239833 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-85e62b6b-4a40-44fe-95cf-f4bab2934d9a tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c23edc0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:30.341251 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-85e62b6b-4a40-44fe-95cf-f4bab2934d9a tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59" status: 200 len: 1452 microversion: 2.1 time: 0.101671 Oct 29 02:53:30.346770 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 933/1700] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:30 2022] GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59 => generated 1452 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:30.576430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ab14a50a-c8c5-4491-ae20-c837150435e9 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:30.584649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-921782a0-0eb7-46b5-835b-7e59ad9178a9 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:30.588200 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-921782a0-0eb7-46b5-835b-7e59ad9178a9 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] [instance: c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:30.591835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ab14a50a-c8c5-4491-ae20-c837150435e9 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:30.593343 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ab14a50a-c8c5-4491-ae20-c837150435e9 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:30.606400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-921782a0-0eb7-46b5-835b-7e59ad9178a9 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:30.609824 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ab14a50a-c8c5-4491-ae20-c837150435e9 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1755 microversion: 2.42 time: 1.734848 Oct 29 02:53:30.610761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-921782a0-0eb7-46b5-835b-7e59ad9178a9 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:30.613815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-921782a0-0eb7-46b5-835b-7e59ad9178a9 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:30.614919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-921782a0-0eb7-46b5-835b-7e59ad9178a9 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:30.615609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-921782a0-0eb7-46b5-835b-7e59ad9178a9 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:30.616980 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-921782a0-0eb7-46b5-835b-7e59ad9178a9 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:30.625500 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 768/1701] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:28 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1755 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:30.764305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-921782a0-0eb7-46b5-835b-7e59ad9178a9 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c3218be14842e1b1fd2e5c10c9092a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f820fbde72429db671d15337913fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:30.793429 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-921782a0-0eb7-46b5-835b-7e59ad9178a9 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc" status: 200 len: 1274 microversion: 2.1 time: 0.219156 Oct 29 02:53:30.816358 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 934/1702] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:30 2022] GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc => generated 1274 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:31.362939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f746076a-946a-41ea-8c56-64cae5fd8587 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff053860670>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:31.370630 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=10 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:31.382554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=38 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:31.463161 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f746076a-946a-41ea-8c56-64cae5fd8587 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59" status: 200 len: 1452 microversion: 2.1 time: 0.104412 Oct 29 02:53:31.468980 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 769/1703] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:31 2022] GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59 => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:31.643844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fda788d6-33a6-4fbe-91c0-bed22d74d92a tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:31.644597 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fda788d6-33a6-4fbe-91c0-bed22d74d92a tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:31.660352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fda788d6-33a6-4fbe-91c0-bed22d74d92a tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:31.660872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fda788d6-33a6-4fbe-91c0-bed22d74d92a tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:31.661538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fda788d6-33a6-4fbe-91c0-bed22d74d92a tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:31.662472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fda788d6-33a6-4fbe-91c0-bed22d74d92a tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:31.663084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fda788d6-33a6-4fbe-91c0-bed22d74d92a tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:31.663669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fda788d6-33a6-4fbe-91c0-bed22d74d92a tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:31.822538 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b31b5267-dcc5-45d1-b221-3c295443c2dd tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:31.824405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b31b5267-dcc5-45d1-b221-3c295443c2dd tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] [instance: c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:31.863415 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b31b5267-dcc5-45d1-b221-3c295443c2dd tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:31.870077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b31b5267-dcc5-45d1-b221-3c295443c2dd tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:31.870824 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b31b5267-dcc5-45d1-b221-3c295443c2dd tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:31.874359 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b31b5267-dcc5-45d1-b221-3c295443c2dd tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:31.875078 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b31b5267-dcc5-45d1-b221-3c295443c2dd tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:31.875710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b31b5267-dcc5-45d1-b221-3c295443c2dd tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:32.412602 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b31b5267-dcc5-45d1-b221-3c295443c2dd tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c3218be14842e1b1fd2e5c10c9092a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f820fbde72429db671d15337913fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:32.425965 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b31b5267-dcc5-45d1-b221-3c295443c2dd tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc" status: 200 len: 1274 microversion: 2.1 time: 0.609163 Oct 29 02:53:32.428385 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 770/1704] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:31 2022] GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc => generated 1274 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:32.483113 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bdeff5bd-0bff-4d7f-adf7-234d77dc6876 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff053819af0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:32.574408 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bdeff5bd-0bff-4d7f-adf7-234d77dc6876 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59" status: 200 len: 1452 microversion: 2.1 time: 0.096423 Oct 29 02:53:32.575522 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 771/1705] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:32 2022] GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59 => generated 1452 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:32.911640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fda788d6-33a6-4fbe-91c0-bed22d74d92a tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:32.940181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fda788d6-33a6-4fbe-91c0-bed22d74d92a tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:32.947379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fda788d6-33a6-4fbe-91c0-bed22d74d92a tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:32.952912 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fda788d6-33a6-4fbe-91c0-bed22d74d92a tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1755 microversion: 2.42 time: 1.310679 Oct 29 02:53:32.965096 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 935/1706] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:31 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1755 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:33.142097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-78ff0db9-9335-4349-96a9-9fe637d7e5d7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:33.142604 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-78ff0db9-9335-4349-96a9-9fe637d7e5d7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:33.182598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78ff0db9-9335-4349-96a9-9fe637d7e5d7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:33.183461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78ff0db9-9335-4349-96a9-9fe637d7e5d7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:33.183919 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78ff0db9-9335-4349-96a9-9fe637d7e5d7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:33.184720 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78ff0db9-9335-4349-96a9-9fe637d7e5d7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:33.185181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78ff0db9-9335-4349-96a9-9fe637d7e5d7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:33.185617 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78ff0db9-9335-4349-96a9-9fe637d7e5d7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:33.274846 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-78ff0db9-9335-4349-96a9-9fe637d7e5d7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:53:33.318602 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:33.462561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f8381b0f-4744-4b2d-b112-08953e182241 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:33.463188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f8381b0f-4744-4b2d-b112-08953e182241 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] [instance: c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:33.481464 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f8381b0f-4744-4b2d-b112-08953e182241 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:33.482041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f8381b0f-4744-4b2d-b112-08953e182241 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:33.488776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f8381b0f-4744-4b2d-b112-08953e182241 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:33.490842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f8381b0f-4744-4b2d-b112-08953e182241 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:33.494923 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f8381b0f-4744-4b2d-b112-08953e182241 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:33.496351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f8381b0f-4744-4b2d-b112-08953e182241 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:33.505716 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-78ff0db9-9335-4349-96a9-9fe637d7e5d7 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 204 len: 0 microversion: 2.25 time: 0.360236 Oct 29 02:53:33.505716 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 772/1707] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Oct 29 02:53:33 2022] DELETE /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 02:53:33.512731 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-731a2429-0f11-4f0a-9fce-fafe898dd7a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:33.513728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-731a2429-0f11-4f0a-9fce-fafe898dd7a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:33.586209 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-731a2429-0f11-4f0a-9fce-fafe898dd7a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:33.587054 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-731a2429-0f11-4f0a-9fce-fafe898dd7a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:33.587492 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-731a2429-0f11-4f0a-9fce-fafe898dd7a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:33.589779 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-731a2429-0f11-4f0a-9fce-fafe898dd7a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:33.590247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-731a2429-0f11-4f0a-9fce-fafe898dd7a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:33.590710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-731a2429-0f11-4f0a-9fce-fafe898dd7a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:33.635755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=100 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:34.588781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f8381b0f-4744-4b2d-b112-08953e182241 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c3218be14842e1b1fd2e5c10c9092a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f820fbde72429db671d15337913fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:34.596703 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f8381b0f-4744-4b2d-b112-08953e182241 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc" status: 200 len: 1316 microversion: 2.1 time: 1.147115 Oct 29 02:53:34.604288 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 936/1708] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:33 2022] GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc => generated 1316 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:34.619096 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-afb367a7-e5a2-4542-b021-0e2b96668f99 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c1b1ee0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:34.775597 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-afb367a7-e5a2-4542-b021-0e2b96668f99 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59" status: 200 len: 1452 microversion: 2.1 time: 0.169491 Oct 29 02:53:34.778112 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 937/1709] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:34 2022] GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59 => generated 1452 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:34.800483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6a42e4f9-1fa6-4297-bde5-17c8646a26c5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:34.801910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6a42e4f9-1fa6-4297-bde5-17c8646a26c5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:34.812905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a42e4f9-1fa6-4297-bde5-17c8646a26c5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:34.813803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a42e4f9-1fa6-4297-bde5-17c8646a26c5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:34.814396 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a42e4f9-1fa6-4297-bde5-17c8646a26c5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:34.815277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a42e4f9-1fa6-4297-bde5-17c8646a26c5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:34.815973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a42e4f9-1fa6-4297-bde5-17c8646a26c5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:34.816601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a42e4f9-1fa6-4297-bde5-17c8646a26c5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:35.775689 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6a42e4f9-1fa6-4297-bde5-17c8646a26c5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:35.794458 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6a42e4f9-1fa6-4297-bde5-17c8646a26c5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:35.805869 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6a42e4f9-1fa6-4297-bde5-17c8646a26c5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:35.807634 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6a42e4f9-1fa6-4297-bde5-17c8646a26c5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1802 microversion: 2.42 time: 1.027698 Oct 29 02:53:35.808174 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 938/1710] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:34 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1802 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:35.813122 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-879ebd5f-df35-48d0-9742-21e1f9be65c6 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:35.821554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-879ebd5f-df35-48d0-9742-21e1f9be65c6 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] [instance: c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:35.870371 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-879ebd5f-df35-48d0-9742-21e1f9be65c6 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:35.870880 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-879ebd5f-df35-48d0-9742-21e1f9be65c6 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:35.877180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-879ebd5f-df35-48d0-9742-21e1f9be65c6 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:35.884717 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-879ebd5f-df35-48d0-9742-21e1f9be65c6 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:35.885295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-879ebd5f-df35-48d0-9742-21e1f9be65c6 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:35.885744 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-879ebd5f-df35-48d0-9742-21e1f9be65c6 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:36.377387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-879ebd5f-df35-48d0-9742-21e1f9be65c6 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c3218be14842e1b1fd2e5c10c9092a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f820fbde72429db671d15337913fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:36.403825 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-879ebd5f-df35-48d0-9742-21e1f9be65c6 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc" status: 200 len: 1316 microversion: 2.1 time: 0.592002 Oct 29 02:53:36.404597 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 939/1711] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:35 2022] GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc => generated 1316 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:37.054435 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-be7a5e3f-a468-4fbd-bf22-53dad52adcd4 tempest-SecurityGroupsTestAdminJSON-1367798675 tempest-SecurityGroupsTestAdminJSON-1367798675-project] Action: 'create', calling method: .version_select at 0x7ff05c180d30>, body: {"security_group": {"name": "tempest-securitygroup-1920543808", "description": "tempest-description-2122232480"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:37.596054 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-731a2429-0f11-4f0a-9fce-fafe898dd7a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:37.618422 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-731a2429-0f11-4f0a-9fce-fafe898dd7a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:37.622826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-731a2429-0f11-4f0a-9fce-fafe898dd7a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:37.626872 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-731a2429-0f11-4f0a-9fce-fafe898dd7a9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 1549 microversion: 2.25 time: 4.119333 Oct 29 02:53:37.628552 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 773/1712] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:33 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 1549 bytes in 4122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:37.643961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e157ba53-ef44-4eca-8384-bf292608e938 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05385b5e0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:37.736553 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e157ba53-ef44-4eca-8384-bf292608e938 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59" status: 200 len: 1461 microversion: 2.1 time: 0.106122 Oct 29 02:53:37.749442 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 774/1713] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:37 2022] GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59 => generated 1461 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:37.759636 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-043ddfd8-236c-47a9-af29-0f2b3bd479e3 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:37.759636 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-043ddfd8-236c-47a9-af29-0f2b3bd479e3 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:37.781922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-043ddfd8-236c-47a9-af29-0f2b3bd479e3 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:37.782650 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-043ddfd8-236c-47a9-af29-0f2b3bd479e3 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:37.783084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-043ddfd8-236c-47a9-af29-0f2b3bd479e3 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:37.784141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-043ddfd8-236c-47a9-af29-0f2b3bd479e3 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:37.793038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-043ddfd8-236c-47a9-af29-0f2b3bd479e3 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:37.793643 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-043ddfd8-236c-47a9-af29-0f2b3bd479e3 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:38.152972 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-be7a5e3f-a468-4fbd-bf22-53dad52adcd4 tempest-SecurityGroupsTestAdminJSON-1367798675 tempest-SecurityGroupsTestAdminJSON-1367798675-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.746953 Oct 29 02:53:38.154299 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 940/1714] 10.222.0.46 () {60 vars in 1180 bytes} [Sat Oct 29 02:53:36 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:38.162954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1e88923c-dc36-42cd-a931-5613a29b4d92 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1066381413", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "bd8191c5-4cb7-4ae3-9cd9-aad8f13b2d18"}, {"uuid": "085bdb4d-a677-4168-a19d-468da81f81fb"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:38.266224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-043ddfd8-236c-47a9-af29-0f2b3bd479e3 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:38.284807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-1e88923c-dc36-42cd-a931-5613a29b4d92 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] validate_networks() for [('bd8191c5-4cb7-4ae3-9cd9-aad8f13b2d18', None, None, None, None, None), ('085bdb4d-a677-4168-a19d-468da81f81fb', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:53:38.288402 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-043ddfd8-236c-47a9-af29-0f2b3bd479e3 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:38.293754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-043ddfd8-236c-47a9-af29-0f2b3bd479e3 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:38.295321 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-043ddfd8-236c-47a9-af29-0f2b3bd479e3 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1802 microversion: 2.42 time: 0.544017 Oct 29 02:53:38.296169 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 775/1715] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:37 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1802 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:38.303350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-409fac22-e3c6-4de4-ba46-2c218a08809d tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:38.304381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-409fac22-e3c6-4de4-ba46-2c218a08809d tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] [instance: c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:38.313277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-409fac22-e3c6-4de4-ba46-2c218a08809d tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:38.314178 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-409fac22-e3c6-4de4-ba46-2c218a08809d tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:38.314864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-409fac22-e3c6-4de4-ba46-2c218a08809d tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:38.315813 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-409fac22-e3c6-4de4-ba46-2c218a08809d tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:38.316727 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-409fac22-e3c6-4de4-ba46-2c218a08809d tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:38.317387 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-409fac22-e3c6-4de4-ba46-2c218a08809d tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:39.030534 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-409fac22-e3c6-4de4-ba46-2c218a08809d tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c3218be14842e1b1fd2e5c10c9092a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f820fbde72429db671d15337913fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:39.046212 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-409fac22-e3c6-4de4-ba46-2c218a08809d tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc" status: 200 len: 1316 microversion: 2.1 time: 0.747772 Oct 29 02:53:39.046838 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 776/1716] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:38 2022] GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc => generated 1316 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:39.052345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a5122b57-9ac5-40e3-b219-7e098c92cd6f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff0538165e0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:39.137793 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a5122b57-9ac5-40e3-b219-7e098c92cd6f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59" status: 200 len: 1461 microversion: 2.1 time: 0.089443 Oct 29 02:53:39.149690 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 777/1717] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:39 2022] GET /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59 => generated 1461 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:39.159608 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b8717266-163d-4bd7-9252-d9b0a28bed84 tempest-SecurityGroupsTestAdminJSON-1367798675 tempest-SecurityGroupsTestAdminJSON-1367798675-project] Action: 'create', calling method: .version_select at 0x7ff053832940>, body: {"security_group": {"name": "tempest-securitygroup-1769194762", "description": "tempest-description-977543653"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:39.428247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-1e88923c-dc36-42cd-a931-5613a29b4d92 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:53:39.428824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-1e88923c-dc36-42cd-a931-5613a29b4d92 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:53:39.429245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-1e88923c-dc36-42cd-a931-5613a29b4d92 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:53:39.429653 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-1e88923c-dc36-42cd-a931-5613a29b4d92 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:53:39.430305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-1e88923c-dc36-42cd-a931-5613a29b4d92 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:53:39.447672 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e88923c-dc36-42cd-a931-5613a29b4d92 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:39.448035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e88923c-dc36-42cd-a931-5613a29b4d92 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:39.452731 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e88923c-dc36-42cd-a931-5613a29b4d92 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:39.457244 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e88923c-dc36-42cd-a931-5613a29b4d92 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:39.457740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e88923c-dc36-42cd-a931-5613a29b4d92 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:39.458189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e88923c-dc36-42cd-a931-5613a29b4d92 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:39.506433 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-1e88923c-dc36-42cd-a931-5613a29b4d92 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Getting quotas for project 202abee8256d45b29f190731cc63609c. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:53:39.522561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-1e88923c-dc36-42cd-a931-5613a29b4d92 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Getting quotas for user 67c50c8b6b2444a6afa86bc1d019925c and project 202abee8256d45b29f190731cc63609c. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:53:39.560191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1e88923c-dc36-42cd-a931-5613a29b4d92 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:53:39.562962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1e88923c-dc36-42cd-a931-5613a29b4d92 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 5b856917-a04b-436d-8f9f-5ce0492bc28b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:53:39.650181 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1e88923c-dc36-42cd-a931-5613a29b4d92 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.491551 Oct 29 02:53:39.652293 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 941/1718] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:53:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:53:39.665936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d344bd77-7e8e-4f5f-be56-a52aa948c3d9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:39.667408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d344bd77-7e8e-4f5f-be56-a52aa948c3d9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:39.681382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d344bd77-7e8e-4f5f-be56-a52aa948c3d9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:39.682143 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d344bd77-7e8e-4f5f-be56-a52aa948c3d9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:39.682782 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d344bd77-7e8e-4f5f-be56-a52aa948c3d9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:39.684844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d344bd77-7e8e-4f5f-be56-a52aa948c3d9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:39.686049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d344bd77-7e8e-4f5f-be56-a52aa948c3d9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:39.686691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d344bd77-7e8e-4f5f-be56-a52aa948c3d9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:39.842990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d344bd77-7e8e-4f5f-be56-a52aa948c3d9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:39.858946 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d344bd77-7e8e-4f5f-be56-a52aa948c3d9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:39.865910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d344bd77-7e8e-4f5f-be56-a52aa948c3d9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:39.873204 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d344bd77-7e8e-4f5f-be56-a52aa948c3d9 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 200 len: 1507 microversion: 2.25 time: 0.219140 Oct 29 02:53:39.874816 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 942/1719] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:39 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 1507 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:40.019465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eb71ef19-102c-40f3-ae46-6ff3fba07506 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Action: 'create', calling method: .version_select at 0x7ff05c24bca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-625739168", "description": "tempest-description-1770751157"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:40.167224 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b8717266-163d-4bd7-9252-d9b0a28bed84 tempest-SecurityGroupsTestAdminJSON-1367798675 tempest-SecurityGroupsTestAdminJSON-1367798675-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.015985 Oct 29 02:53:40.167844 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 778/1720] 10.222.0.46 () {60 vars in 1180 bytes} [Sat Oct 29 02:53:39 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:40.172776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-516249af-9b2d-4620-a01e-9123b8fdeb5c tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:40.173386 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-516249af-9b2d-4620-a01e-9123b8fdeb5c tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:40.196882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-516249af-9b2d-4620-a01e-9123b8fdeb5c tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:40.197590 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-516249af-9b2d-4620-a01e-9123b8fdeb5c tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:40.198191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-516249af-9b2d-4620-a01e-9123b8fdeb5c tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:40.199080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-516249af-9b2d-4620-a01e-9123b8fdeb5c tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:40.199685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-516249af-9b2d-4620-a01e-9123b8fdeb5c tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:40.213354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-516249af-9b2d-4620-a01e-9123b8fdeb5c tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:40.437765 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eb71ef19-102c-40f3-ae46-6ff3fba07506 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.561599 Oct 29 02:53:40.438272 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 943/1721] 10.222.0.46 () {60 vars in 1180 bytes} [Sat Oct 29 02:53:39 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:40.456024 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-ba1aec68-8ce4-4365-9bab-a7a6ba262966 req-117a2e3a-3fe3-471e-895f-d00d9cb8bc5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd", "name": "network-vif-unplugged", "status": "completed", "tag": "9daf432c-ab9e-41ed-aaf7-21cb4e7d509f"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:40.469413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ba1aec68-8ce4-4365-9bab-a7a6ba262966 req-117a2e3a-3fe3-471e-895f-d00d9cb8bc5a service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:40.470415 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ba1aec68-8ce4-4365-9bab-a7a6ba262966 req-117a2e3a-3fe3-471e-895f-d00d9cb8bc5a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:40.471209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ba1aec68-8ce4-4365-9bab-a7a6ba262966 req-117a2e3a-3fe3-471e-895f-d00d9cb8bc5a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:40.506720 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-ba1aec68-8ce4-4365-9bab-a7a6ba262966 req-117a2e3a-3fe3-471e-895f-d00d9cb8bc5a service nova] Creating event network-vif-unplugged:9daf432c-ab9e-41ed-aaf7-21cb4e7d509f for instance 0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd on n-h1-862967-2 Oct 29 02:53:40.534733 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-ba1aec68-8ce4-4365-9bab-a7a6ba262966 req-117a2e3a-3fe3-471e-895f-d00d9cb8bc5a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085713 Oct 29 02:53:40.537484 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 944/1722] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:40.549879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7b77741a-3cc4-40a9-8f21-f339301c769b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:40.552952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7b77741a-3cc4-40a9-8f21-f339301c769b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:40.572418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b77741a-3cc4-40a9-8f21-f339301c769b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:40.572997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b77741a-3cc4-40a9-8f21-f339301c769b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:40.573763 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b77741a-3cc4-40a9-8f21-f339301c769b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:40.574745 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b77741a-3cc4-40a9-8f21-f339301c769b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:40.575203 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b77741a-3cc4-40a9-8f21-f339301c769b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:40.575627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b77741a-3cc4-40a9-8f21-f339301c769b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:40.883338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-516249af-9b2d-4620-a01e-9123b8fdeb5c tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844dbc8e54d349ea93c632c54909a718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b7aa3004d94c5a8cf87d5f4d006a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:40.906288 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-516249af-9b2d-4620-a01e-9123b8fdeb5c tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/servers/0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd" status: 200 len: 1468 microversion: 2.1 time: 0.737266 Oct 29 02:53:40.913193 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 779/1723] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:40 2022] GET /compute/v2.1/servers/0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd => generated 1468 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:40.922699 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-670f64f0-ae43-486a-83bb-c97a491f4a38 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:40.924018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-670f64f0-ae43-486a-83bb-c97a491f4a38 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 5b856917-a04b-436d-8f9f-5ce0492bc28b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:40.931891 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-670f64f0-ae43-486a-83bb-c97a491f4a38 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:40.933174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-670f64f0-ae43-486a-83bb-c97a491f4a38 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:40.933889 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-670f64f0-ae43-486a-83bb-c97a491f4a38 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:40.934787 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-670f64f0-ae43-486a-83bb-c97a491f4a38 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:40.935466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-670f64f0-ae43-486a-83bb-c97a491f4a38 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:40.937107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-670f64f0-ae43-486a-83bb-c97a491f4a38 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:41.070800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7b77741a-3cc4-40a9-8f21-f339301c769b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:41.086708 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7b77741a-3cc4-40a9-8f21-f339301c769b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:41.088451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7b77741a-3cc4-40a9-8f21-f339301c769b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:41.089697 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7b77741a-3cc4-40a9-8f21-f339301c769b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1802 microversion: 2.42 time: 0.550832 Oct 29 02:53:41.095938 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 945/1724] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:40 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1802 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:41.109820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-26c14368-4592-41a4-af94-a53dc544d288 req-c490cc29-842c-4f03-8a6a-ba47422f1db4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0ec4a8-4cf9-4596-bc31-797c86447aa0", "name": "network-vif-deleted", "tag": "69a0c6be-941f-492e-8d52-cd37b1ae25aa"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:41.130349 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-26c14368-4592-41a4-af94-a53dc544d288 req-c490cc29-842c-4f03-8a6a-ba47422f1db4 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:41.130846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-26c14368-4592-41a4-af94-a53dc544d288 req-c490cc29-842c-4f03-8a6a-ba47422f1db4 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:41.131288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-26c14368-4592-41a4-af94-a53dc544d288 req-c490cc29-842c-4f03-8a6a-ba47422f1db4 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:41.156515 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-26c14368-4592-41a4-af94-a53dc544d288 req-c490cc29-842c-4f03-8a6a-ba47422f1db4 service nova] Creating event network-vif-deleted:69a0c6be-941f-492e-8d52-cd37b1ae25aa for instance 0a0ec4a8-4cf9-4596-bc31-797c86447aa0 on n-h1-862967-2 Oct 29 02:53:41.168206 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-26c14368-4592-41a4-af94-a53dc544d288 req-c490cc29-842c-4f03-8a6a-ba47422f1db4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068674 Oct 29 02:53:41.172635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-670f64f0-ae43-486a-83bb-c97a491f4a38 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:41.173102 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 946/1725] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:41.181604 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b5eaff5a-c51b-48d0-ad46-51b8630c7241 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:41.182618 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b5eaff5a-c51b-48d0-ad46-51b8630c7241 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] [instance: c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:41.190739 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5eaff5a-c51b-48d0-ad46-51b8630c7241 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:41.191561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5eaff5a-c51b-48d0-ad46-51b8630c7241 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:41.192220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5eaff5a-c51b-48d0-ad46-51b8630c7241 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:41.193198 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5eaff5a-c51b-48d0-ad46-51b8630c7241 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:41.194339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5eaff5a-c51b-48d0-ad46-51b8630c7241 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:41.195389 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5eaff5a-c51b-48d0-ad46-51b8630c7241 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:41.197477 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-670f64f0-ae43-486a-83bb-c97a491f4a38 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b" status: 200 len: 1209 microversion: 2.1 time: 0.281141 Oct 29 02:53:41.198089 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 780/1726] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:40 2022] GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b => generated 1209 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:41.376758 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dc08b2a4-9d62-4a26-aa7e-9eae782bcc2c tempest-SecurityGroupsTestAdminJSON-2066630176 tempest-SecurityGroupsTestAdminJSON-2066630176-project-admin] Action: 'create', calling method: .version_select at 0x7ff0537e2e50>, body: {"security_group": {"name": "tempest-securitygroup-1191854745", "description": "tempest-description-1667866504"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:41.445934 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b5eaff5a-c51b-48d0-ad46-51b8630c7241 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c3218be14842e1b1fd2e5c10c9092a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f820fbde72429db671d15337913fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:41.460171 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b5eaff5a-c51b-48d0-ad46-51b8630c7241 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc" status: 200 len: 1316 microversion: 2.1 time: 0.285794 Oct 29 02:53:41.461395 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 947/1727] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:41 2022] GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc => generated 1316 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:41.471161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c8cc9eba-4223-4e62-a65a-a66004fe25fe tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Action: 'create', calling method: .version_select at 0x7ff05c23edc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1991900967", "description": "tempest-description-1880165875"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:41.749641 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c8cc9eba-4223-4e62-a65a-a66004fe25fe tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.286442 Oct 29 02:53:41.750605 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 948/1728] 10.222.0.46 () {60 vars in 1180 bytes} [Sat Oct 29 02:53:41 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:41.756209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-54b824fc-f5d1-40e2-92f8-6b9c1c1d316c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:41.757141 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-54b824fc-f5d1-40e2-92f8-6b9c1c1d316c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 0a0ec4a8-4cf9-4596-bc31-797c86447aa0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:41.788120 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-54b824fc-f5d1-40e2-92f8-6b9c1c1d316c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:41.788631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-54b824fc-f5d1-40e2-92f8-6b9c1c1d316c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:41.789065 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-54b824fc-f5d1-40e2-92f8-6b9c1c1d316c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:41.796741 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-54b824fc-f5d1-40e2-92f8-6b9c1c1d316c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:41.797278 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-54b824fc-f5d1-40e2-92f8-6b9c1c1d316c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:41.797725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-54b824fc-f5d1-40e2-92f8-6b9c1c1d316c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:41.870718 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-54b824fc-f5d1-40e2-92f8-6b9c1c1d316c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] HTTP exception thrown: Instance 0a0ec4a8-4cf9-4596-bc31-797c86447aa0 could not be found. Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-54b824fc-f5d1-40e2-92f8-6b9c1c1d316c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Request method failure captured: Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 HTTP/1.1 Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJPY62lZ02kminN7qHv7SG1RovI20ydDPZQv3tU5TxvLPKUoiJl_AOrRTdYppSUhrWf-y0a9Bz_57Qjo2lN_Zn__d7tPquCT-d7vLweqRqmT_i2ewZGK6bM0drOtR2PR0C_5HjpH6zHOxAYP1pWsYHXaaVsdN0RVEPjL6hMRRWt73-g Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: X-Openstack-Nova-Api-Version: 2.25 Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: f86634862bd64e0f9f00972e4ce0982b Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2000095198 Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f86634862bd64e0f9f00972e4ce0982b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f86634862bd64e0f9f00972e4ce0982b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f86634862bd64e0f9f00972e4ce0982b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f86634862bd64e0f9f00972e4ce0982b"}]}] Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2000095198 Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: f86634862bd64e0f9f00972e4ce0982b Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2000095198 Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-LiveAutoBlockMigrationV225Test-2000095198-project Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 067d53567ea944b1b69ee7f461aa0c16 Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2000095198-project Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 0a0ec4a8-4cf9-4596-bc31-797c86447aa0 could not be found. Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '0a0ec4a8-4cf9-4596-bc31-797c86447aa0'} Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a0ec4a8-4cf9-4596-bc31-797c86447aa0 could not be found. Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a0ec4a8-4cf9-4596-bc31-797c86447aa0 could not be found. Oct 29 02:53:41.873314 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:41.879056 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:41.879056 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:41.879056 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:41.879056 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:41.879056 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:41.879056 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:53:41.879056 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:53:41.879056 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a0ec4a8-4cf9-4596-bc31-797c86447aa0 could not be found. Oct 29 02:53:41.879056 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:53:41.891849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-54b824fc-f5d1-40e2-92f8-6b9c1c1d316c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Returning 404 to user: Instance 0a0ec4a8-4cf9-4596-bc31-797c86447aa0 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:53:41.897626 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-54b824fc-f5d1-40e2-92f8-6b9c1c1d316c tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0" status: 404 len: 111 microversion: 2.25 time: 0.145615 Oct 29 02:53:41.900136 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 949/1729] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:41 2022] GET /compute/v2.1/servers/0a0ec4a8-4cf9-4596-bc31-797c86447aa0 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:53:41.909738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9843b4bf-17c6-4b15-8fbb-b78afb3f1303 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-326078508"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:41.913819 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9843b4bf-17c6-4b15-8fbb-b78afb3f1303 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 1123b300-f298-4071-bff4-8ddc088ee57f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:41.922107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9843b4bf-17c6-4b15-8fbb-b78afb3f1303 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:41.923288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9843b4bf-17c6-4b15-8fbb-b78afb3f1303 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:41.929106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9843b4bf-17c6-4b15-8fbb-b78afb3f1303 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:41.931234 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9843b4bf-17c6-4b15-8fbb-b78afb3f1303 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:41.932314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9843b4bf-17c6-4b15-8fbb-b78afb3f1303 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:41.933012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9843b4bf-17c6-4b15-8fbb-b78afb3f1303 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:42.302905 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9843b4bf-17c6-4b15-8fbb-b78afb3f1303 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "POST /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f/action" status: 202 len: 0 microversion: 2.1 time: 0.400318 Oct 29 02:53:42.315514 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 950/1730] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:53:41 2022] POST /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 02:53:42.326697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ccdeba1d-fb35-4a3d-9da0-a5abdcd55d07 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-331175689", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "4a1725e9-7e18-4e19-a3ee-ed879bb037c8"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:42.425013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-ccdeba1d-fb35-4a3d-9da0-a5abdcd55d07 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] validate_networks() for [('4a1725e9-7e18-4e19-a3ee-ed879bb037c8', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:53:43.006811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-ccdeba1d-fb35-4a3d-9da0-a5abdcd55d07 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:53:43.007494 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-ccdeba1d-fb35-4a3d-9da0-a5abdcd55d07 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:53:43.007995 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-ccdeba1d-fb35-4a3d-9da0-a5abdcd55d07 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:53:43.008505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-ccdeba1d-fb35-4a3d-9da0-a5abdcd55d07 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:53:43.009203 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-ccdeba1d-fb35-4a3d-9da0-a5abdcd55d07 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:53:43.011754 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:43.027688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ccdeba1d-fb35-4a3d-9da0-a5abdcd55d07 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:43.028354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ccdeba1d-fb35-4a3d-9da0-a5abdcd55d07 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:43.029438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ccdeba1d-fb35-4a3d-9da0-a5abdcd55d07 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:43.031025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ccdeba1d-fb35-4a3d-9da0-a5abdcd55d07 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:43.031719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ccdeba1d-fb35-4a3d-9da0-a5abdcd55d07 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:43.032401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ccdeba1d-fb35-4a3d-9da0-a5abdcd55d07 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:43.060436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-ccdeba1d-fb35-4a3d-9da0-a5abdcd55d07 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Getting quotas for project 49721a0af93a47d38613f4a588ab1e1a. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:53:43.081311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-ccdeba1d-fb35-4a3d-9da0-a5abdcd55d07 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Getting quotas for user 971f709818b74757947beafd14f546bf and project 49721a0af93a47d38613f4a588ab1e1a. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:53:43.098474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ccdeba1d-fb35-4a3d-9da0-a5abdcd55d07 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:53:43.102494 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ccdeba1d-fb35-4a3d-9da0-a5abdcd55d07 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 2d032bdd-de0f-40dc-88c6-afc41eab6770] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:53:43.258613 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ccdeba1d-fb35-4a3d-9da0-a5abdcd55d07 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.940852 Oct 29 02:53:43.262232 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 951/1731] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:53:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:53:43.269212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8d9309d1-98c0-4dca-a080-409dc3382f86 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:43.269918 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8d9309d1-98c0-4dca-a080-409dc3382f86 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:43.281512 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d9309d1-98c0-4dca-a080-409dc3382f86 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:43.282642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d9309d1-98c0-4dca-a080-409dc3382f86 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:43.283359 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d9309d1-98c0-4dca-a080-409dc3382f86 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:43.284372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d9309d1-98c0-4dca-a080-409dc3382f86 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:43.285587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d9309d1-98c0-4dca-a080-409dc3382f86 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:43.287129 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d9309d1-98c0-4dca-a080-409dc3382f86 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:43.322707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8d9309d1-98c0-4dca-a080-409dc3382f86 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:53:43.527706 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8d9309d1-98c0-4dca-a080-409dc3382f86 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "DELETE /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 204 len: 0 microversion: 2.25 time: 0.263750 Oct 29 02:53:43.528665 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 952/1732] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Oct 29 02:53:43 2022] DELETE /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 02:53:43.541155 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5b081942-b6d1-48c4-a0e6-7f4e436eaa8c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:43.541916 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5b081942-b6d1-48c4-a0e6-7f4e436eaa8c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:43.555957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b081942-b6d1-48c4-a0e6-7f4e436eaa8c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:43.557787 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b081942-b6d1-48c4-a0e6-7f4e436eaa8c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:43.560055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b081942-b6d1-48c4-a0e6-7f4e436eaa8c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:43.562257 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b081942-b6d1-48c4-a0e6-7f4e436eaa8c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:43.564160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b081942-b6d1-48c4-a0e6-7f4e436eaa8c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:43.565905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b081942-b6d1-48c4-a0e6-7f4e436eaa8c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:44.224133 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dc08b2a4-9d62-4a26-aa7e-9eae782bcc2c tempest-SecurityGroupsTestAdminJSON-2066630176 tempest-SecurityGroupsTestAdminJSON-2066630176-project-admin] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 3.024883 Oct 29 02:53:44.225741 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 781/1733] 10.222.0.46 () {60 vars in 1180 bytes} [Sat Oct 29 02:53:41 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 3027 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:44.243198 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0178c4e1-70e2-4623-9f8b-24ca7a444c99 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:44.244901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0178c4e1-70e2-4623-9f8b-24ca7a444c99 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 5b856917-a04b-436d-8f9f-5ce0492bc28b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:44.281315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0178c4e1-70e2-4623-9f8b-24ca7a444c99 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:44.281821 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0178c4e1-70e2-4623-9f8b-24ca7a444c99 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:44.289681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0178c4e1-70e2-4623-9f8b-24ca7a444c99 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:44.293325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0178c4e1-70e2-4623-9f8b-24ca7a444c99 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:44.299235 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0178c4e1-70e2-4623-9f8b-24ca7a444c99 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:44.299703 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0178c4e1-70e2-4623-9f8b-24ca7a444c99 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:44.524116 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0178c4e1-70e2-4623-9f8b-24ca7a444c99 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:44.534520 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0178c4e1-70e2-4623-9f8b-24ca7a444c99 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b" status: 200 len: 1271 microversion: 2.1 time: 0.295614 Oct 29 02:53:44.538517 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 782/1734] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:44 2022] GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b => generated 1271 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:44.546242 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6899b273-d82e-4a6b-8403-8eee8925bd1c tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff053704ee0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:44.647259 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6899b273-d82e-4a6b-8403-8eee8925bd1c tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/3588b1c1-f15e-425c-8711-d112abef0137" status: 200 len: 1452 microversion: 2.1 time: 0.107257 Oct 29 02:53:44.656281 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 783/1735] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:44 2022] GET /compute/v2.1/images/3588b1c1-f15e-425c-8711-d112abef0137 => generated 1452 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:44.668726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-041d5024-f47f-4b15-8ae2-2057568f4cfd tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:44.669423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-041d5024-f47f-4b15-8ae2-2057568f4cfd tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] [instance: c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:44.693854 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-041d5024-f47f-4b15-8ae2-2057568f4cfd tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:44.699537 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-041d5024-f47f-4b15-8ae2-2057568f4cfd tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:44.700104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-041d5024-f47f-4b15-8ae2-2057568f4cfd tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:44.701115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-041d5024-f47f-4b15-8ae2-2057568f4cfd tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:44.701770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-041d5024-f47f-4b15-8ae2-2057568f4cfd tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:44.702296 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-041d5024-f47f-4b15-8ae2-2057568f4cfd tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:45.490950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5b081942-b6d1-48c4-a0e6-7f4e436eaa8c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:45.505521 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5b081942-b6d1-48c4-a0e6-7f4e436eaa8c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:45.511333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5b081942-b6d1-48c4-a0e6-7f4e436eaa8c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:45.516442 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5b081942-b6d1-48c4-a0e6-7f4e436eaa8c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1849 microversion: 2.42 time: 1.985265 Oct 29 02:53:45.518083 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 953/1736] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:43 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1849 bytes in 1988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:45.538625 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8d2e97e8-2afd-4828-8411-96bb57dd29ec tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:45.539585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8d2e97e8-2afd-4828-8411-96bb57dd29ec tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 2d032bdd-de0f-40dc-88c6-afc41eab6770] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:45.550627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d2e97e8-2afd-4828-8411-96bb57dd29ec tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:45.551121 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d2e97e8-2afd-4828-8411-96bb57dd29ec tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:45.551558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d2e97e8-2afd-4828-8411-96bb57dd29ec tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:45.552272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d2e97e8-2afd-4828-8411-96bb57dd29ec tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:45.552774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d2e97e8-2afd-4828-8411-96bb57dd29ec tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:45.553199 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d2e97e8-2afd-4828-8411-96bb57dd29ec tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:45.630007 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 02:53:45.630592 n-d-862967-2 devstack@n-api.service[127125]: Sat Oct 29 02:53:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc (ip 10.222.0.46) !!! Oct 29 02:53:45.791616 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-041d5024-f47f-4b15-8ae2-2057568f4cfd tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c3218be14842e1b1fd2e5c10c9092a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f820fbde72429db671d15337913fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:45.803873 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-041d5024-f47f-4b15-8ae2-2057568f4cfd tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc" status: 200 len: 1316 microversion: 2.1 time: 1.146132 Oct 29 02:53:45.809182 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 784/1737] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:44 2022] GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc => generated 1316 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:45.818299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-a2f76164-61b0-4830-b746-5027333166a3 req-0fb34819-f533-4742-b953-742ea936d422 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc", "tag": "79864797-817a-49a1-9e41-46b8d629427a"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:45.854017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a2f76164-61b0-4830-b746-5027333166a3 req-0fb34819-f533-4742-b953-742ea936d422 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:45.854565 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a2f76164-61b0-4830-b746-5027333166a3 req-0fb34819-f533-4742-b953-742ea936d422 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:45.854991 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a2f76164-61b0-4830-b746-5027333166a3 req-0fb34819-f533-4742-b953-742ea936d422 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:45.866882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8d2e97e8-2afd-4828-8411-96bb57dd29ec tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971f709818b74757947beafd14f546bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49721a0af93a47d38613f4a588ab1e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:45.883682 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-a2f76164-61b0-4830-b746-5027333166a3 req-0fb34819-f533-4742-b953-742ea936d422 service nova] Creating event network-changed:79864797-817a-49a1-9e41-46b8d629427a for instance c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc on n-h2-862967-2 Oct 29 02:53:45.886357 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8d2e97e8-2afd-4828-8411-96bb57dd29ec tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770" status: 200 len: 1267 microversion: 2.1 time: 0.365391 Oct 29 02:53:45.887720 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 954/1738] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:45 2022] GET /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770 => generated 1267 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:45.894593 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0309f562-7f0b-4359-92e5-c9827f839af3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:45.895781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0309f562-7f0b-4359-92e5-c9827f839af3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:45.900189 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-a2f76164-61b0-4830-b746-5027333166a3 req-0fb34819-f533-4742-b953-742ea936d422 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089445 Oct 29 02:53:45.901163 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 785/1739] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:45.905823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0309f562-7f0b-4359-92e5-c9827f839af3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:45.906910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0309f562-7f0b-4359-92e5-c9827f839af3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:45.907609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0309f562-7f0b-4359-92e5-c9827f839af3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:45.908748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0309f562-7f0b-4359-92e5-c9827f839af3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:45.909517 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0309f562-7f0b-4359-92e5-c9827f839af3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:45.910243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0309f562-7f0b-4359-92e5-c9827f839af3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:45.928406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a4d3d756-4298-4b74-873e-d7d451bd7c0f tempest-SecurityGroupsTestAdminJSON-2066630176 tempest-SecurityGroupsTestAdminJSON-2066630176-project-admin] Action: 'create', calling method: .version_select at 0x7ff0537e2790>, body: {"security_group": {"name": "tempest-securitygroup-1257357005", "description": "tempest-description-95112516"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:46.354253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0309f562-7f0b-4359-92e5-c9827f839af3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:46.366581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0309f562-7f0b-4359-92e5-c9827f839af3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:46.369202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0309f562-7f0b-4359-92e5-c9827f839af3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '067d53567ea944b1b69ee7f461aa0c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f86634862bd64e0f9f00972e4ce0982b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:46.374781 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0309f562-7f0b-4359-92e5-c9827f839af3 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 200 len: 1564 microversion: 2.25 time: 0.484910 Oct 29 02:53:46.378787 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 955/1740] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:45 2022] GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 1564 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:46.392866 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c41ebdc8-d6d5-4c3a-87db-66d8891302bc tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:46.393950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c41ebdc8-d6d5-4c3a-87db-66d8891302bc tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 5b856917-a04b-436d-8f9f-5ce0492bc28b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:46.406966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c41ebdc8-d6d5-4c3a-87db-66d8891302bc tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:46.411893 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c41ebdc8-d6d5-4c3a-87db-66d8891302bc tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:46.413331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c41ebdc8-d6d5-4c3a-87db-66d8891302bc tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:46.414353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c41ebdc8-d6d5-4c3a-87db-66d8891302bc tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:46.415036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c41ebdc8-d6d5-4c3a-87db-66d8891302bc tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:46.416202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c41ebdc8-d6d5-4c3a-87db-66d8891302bc tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:46.673619 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c41ebdc8-d6d5-4c3a-87db-66d8891302bc tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:46.687111 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c41ebdc8-d6d5-4c3a-87db-66d8891302bc tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b" status: 200 len: 1271 microversion: 2.1 time: 0.306842 Oct 29 02:53:46.694340 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 956/1741] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:46 2022] GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b => generated 1271 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:46.699197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3dc8f7f2-782a-4ad5-ab32-331221088d94 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff053a50550>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:46.798686 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3dc8f7f2-782a-4ad5-ab32-331221088d94 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/3588b1c1-f15e-425c-8711-d112abef0137" status: 200 len: 1452 microversion: 2.1 time: 0.103186 Oct 29 02:53:46.799828 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 957/1742] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:46 2022] GET /compute/v2.1/images/3588b1c1-f15e-425c-8711-d112abef0137 => generated 1452 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:46.809293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0dacc814-e0d9-4691-9e1a-e0a26a7c7901 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:46.813201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0dacc814-e0d9-4691-9e1a-e0a26a7c7901 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:46.830475 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0dacc814-e0d9-4691-9e1a-e0a26a7c7901 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:46.833178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0dacc814-e0d9-4691-9e1a-e0a26a7c7901 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:46.836238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0dacc814-e0d9-4691-9e1a-e0a26a7c7901 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:46.838354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0dacc814-e0d9-4691-9e1a-e0a26a7c7901 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:46.843661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0dacc814-e0d9-4691-9e1a-e0a26a7c7901 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:46.843960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0dacc814-e0d9-4691-9e1a-e0a26a7c7901 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:46.877290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:47.150299 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a4d3d756-4298-4b74-873e-d7d451bd7c0f tempest-SecurityGroupsTestAdminJSON-2066630176 tempest-SecurityGroupsTestAdminJSON-2066630176-project-admin] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.246706 Oct 29 02:53:47.151504 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 786/1743] 10.222.0.46 () {60 vars in 1180 bytes} [Sat Oct 29 02:53:45 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:47.156350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dafa7cc9-d618-40e8-a692-312699f15803 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:47.157281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dafa7cc9-d618-40e8-a692-312699f15803 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] [instance: c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:47.183110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dafa7cc9-d618-40e8-a692-312699f15803 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:47.183724 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dafa7cc9-d618-40e8-a692-312699f15803 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:47.184110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dafa7cc9-d618-40e8-a692-312699f15803 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:47.186020 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dafa7cc9-d618-40e8-a692-312699f15803 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:47.186490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dafa7cc9-d618-40e8-a692-312699f15803 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:47.186930 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dafa7cc9-d618-40e8-a692-312699f15803 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:47.642883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0dacc814-e0d9-4691-9e1a-e0a26a7c7901 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:47.659742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0dacc814-e0d9-4691-9e1a-e0a26a7c7901 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:47.664987 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0dacc814-e0d9-4691-9e1a-e0a26a7c7901 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:47.666564 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0dacc814-e0d9-4691-9e1a-e0a26a7c7901 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1849 microversion: 2.42 time: 0.865445 Oct 29 02:53:47.674504 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 958/1744] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:46 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1849 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:47.680288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7cd6bd37-dabe-4af3-a4e5-37e24e3ee0b3 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:47.681171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7cd6bd37-dabe-4af3-a4e5-37e24e3ee0b3 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 2d032bdd-de0f-40dc-88c6-afc41eab6770] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:47.696685 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7cd6bd37-dabe-4af3-a4e5-37e24e3ee0b3 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:47.706847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7cd6bd37-dabe-4af3-a4e5-37e24e3ee0b3 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:47.707389 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7cd6bd37-dabe-4af3-a4e5-37e24e3ee0b3 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:47.708178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7cd6bd37-dabe-4af3-a4e5-37e24e3ee0b3 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:47.708698 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7cd6bd37-dabe-4af3-a4e5-37e24e3ee0b3 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:47.709134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7cd6bd37-dabe-4af3-a4e5-37e24e3ee0b3 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:48.201993 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7cd6bd37-dabe-4af3-a4e5-37e24e3ee0b3 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971f709818b74757947beafd14f546bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49721a0af93a47d38613f4a588ab1e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:48.231247 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7cd6bd37-dabe-4af3-a4e5-37e24e3ee0b3 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770" status: 200 len: 1315 microversion: 2.1 time: 0.552315 Oct 29 02:53:48.233317 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 959/1745] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:47 2022] GET /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770 => generated 1315 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:48.264333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-99090c77-6518-473a-9468-9117a84c02f5 req-ed505038-44ac-480a-89d5-530238469477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed", "name": "network-vif-deleted", "tag": "ca4ed483-67be-4b3f-884e-48df58de6a0e"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:48.296604 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-99090c77-6518-473a-9468-9117a84c02f5 req-ed505038-44ac-480a-89d5-530238469477 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:48.298171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-99090c77-6518-473a-9468-9117a84c02f5 req-ed505038-44ac-480a-89d5-530238469477 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:48.299578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-99090c77-6518-473a-9468-9117a84c02f5 req-ed505038-44ac-480a-89d5-530238469477 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:48.318054 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-99090c77-6518-473a-9468-9117a84c02f5 req-ed505038-44ac-480a-89d5-530238469477 service nova] Creating event network-vif-deleted:ca4ed483-67be-4b3f-884e-48df58de6a0e for instance 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed on n-h1-862967-2 Oct 29 02:53:48.336017 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-99090c77-6518-473a-9468-9117a84c02f5 req-ed505038-44ac-480a-89d5-530238469477 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097399 Oct 29 02:53:48.337286 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 960/1746] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:48.347134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-13bee382-6958-4fb2-81f8-bf314107e4b6 tempest-SecurityGroupsTestAdminJSON-2066630176 tempest-SecurityGroupsTestAdminJSON-2066630176-project-admin] Calling method '.version_select at 0x7ff053a0d790>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:49.108894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dafa7cc9-d618-40e8-a692-312699f15803 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c3218be14842e1b1fd2e5c10c9092a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f820fbde72429db671d15337913fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:49.122281 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dafa7cc9-d618-40e8-a692-312699f15803 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc" status: 200 len: 1316 microversion: 2.1 time: 1.968297 Oct 29 02:53:49.136571 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 787/1747] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:47 2022] GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc => generated 1316 bytes in 1973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:49.151630 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a5a542f4-209b-4541-9567-f05769185460 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:49.152757 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a5a542f4-209b-4541-9567-f05769185460 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] [instance: 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:49.175394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a5a542f4-209b-4541-9567-f05769185460 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:49.175907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a5a542f4-209b-4541-9567-f05769185460 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:49.176333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a5a542f4-209b-4541-9567-f05769185460 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:49.177104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a5a542f4-209b-4541-9567-f05769185460 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:49.177558 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a5a542f4-209b-4541-9567-f05769185460 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:49.181224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a5a542f4-209b-4541-9567-f05769185460 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:49.217230 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-a5a542f4-209b-4541-9567-f05769185460 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] HTTP exception thrown: Instance 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed could not be found. Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a5a542f4-209b-4541-9567-f05769185460 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Request method failure captured: Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed HTTP/1.1 Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJPY62lZ02kminN7qHv7SG1RovI20ydDPZQv3tU5TxvLPKUoiJl_AOrRTdYppSUhrWf-y0a9Bz_57Qjo2lN_Zn__d7tPquCT-d7vLweqRqmT_i2ewZGK6bM0drOtR2PR0C_5HjpH6zHOxAYP1pWsYHXaaVsdN0RVEPjL6hMRRWt73-g Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: X-Openstack-Nova-Api-Version: 2.25 Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: f86634862bd64e0f9f00972e4ce0982b Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2000095198 Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f86634862bd64e0f9f00972e4ce0982b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f86634862bd64e0f9f00972e4ce0982b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f86634862bd64e0f9f00972e4ce0982b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f86634862bd64e0f9f00972e4ce0982b"}]}] Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2000095198 Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: f86634862bd64e0f9f00972e4ce0982b Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2000095198 Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-LiveAutoBlockMigrationV225Test-2000095198-project Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 067d53567ea944b1b69ee7f461aa0c16 Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2000095198-project Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed could not be found. Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed'} Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed could not be found. Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed could not be found. Oct 29 02:53:49.226770 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:49.232042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:53:49.232042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:49.232042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:53:49.232042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:53:49.232042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:53:49.232042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:53:49.232042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:53:49.232042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed could not be found. Oct 29 02:53:49.232042 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:53:49.232042 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a5a542f4-209b-4541-9567-f05769185460 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] Returning 404 to user: Instance 26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:53:49.232042 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a5a542f4-209b-4541-9567-f05769185460 tempest-LiveAutoBlockMigrationV225Test-2000095198 tempest-LiveAutoBlockMigrationV225Test-2000095198-project] 10.222.0.46 "GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed" status: 404 len: 111 microversion: 2.25 time: 0.098640 Oct 29 02:53:49.234284 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 788/1748] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:49 2022] GET /compute/v2.1/servers/26d9b1be-7d9b-488e-bc3d-e4095fbbc4ed => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:53:49.243746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2b98d2f2-71bd-4866-b678-a5077e5bd2d0 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:49.244381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2b98d2f2-71bd-4866-b678-a5077e5bd2d0 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 5b856917-a04b-436d-8f9f-5ce0492bc28b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:49.264640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b98d2f2-71bd-4866-b678-a5077e5bd2d0 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:49.265156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b98d2f2-71bd-4866-b678-a5077e5bd2d0 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:49.265596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b98d2f2-71bd-4866-b678-a5077e5bd2d0 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:49.267586 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b98d2f2-71bd-4866-b678-a5077e5bd2d0 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:49.268088 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b98d2f2-71bd-4866-b678-a5077e5bd2d0 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:49.268542 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b98d2f2-71bd-4866-b678-a5077e5bd2d0 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:50.833691 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2b98d2f2-71bd-4866-b678-a5077e5bd2d0 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:50.849480 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2b98d2f2-71bd-4866-b678-a5077e5bd2d0 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b" status: 200 len: 1313 microversion: 2.1 time: 1.613172 Oct 29 02:53:50.852392 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 789/1749] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:49 2022] GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b => generated 1313 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:50.872733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-41b530f5-541d-498c-8c38-acbac2a1dcec tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05373e9d0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:50.972377 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-41b530f5-541d-498c-8c38-acbac2a1dcec tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/3588b1c1-f15e-425c-8711-d112abef0137" status: 200 len: 1452 microversion: 2.1 time: 0.118331 Oct 29 02:53:50.972899 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 790/1750] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:50 2022] GET /compute/v2.1/images/3588b1c1-f15e-425c-8711-d112abef0137 => generated 1452 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:50.993625 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d18df461-6b8c-4b05-8d0d-10332f907a6d tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:50.994245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d18df461-6b8c-4b05-8d0d-10332f907a6d tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:51.008205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:51.088867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d18df461-6b8c-4b05-8d0d-10332f907a6d tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:51.089364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d18df461-6b8c-4b05-8d0d-10332f907a6d tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:51.089807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d18df461-6b8c-4b05-8d0d-10332f907a6d tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:51.090520 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d18df461-6b8c-4b05-8d0d-10332f907a6d tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:51.090970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d18df461-6b8c-4b05-8d0d-10332f907a6d tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:51.098797 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d18df461-6b8c-4b05-8d0d-10332f907a6d tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:52.251279 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d18df461-6b8c-4b05-8d0d-10332f907a6d tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:52.275640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d18df461-6b8c-4b05-8d0d-10332f907a6d tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:52.279650 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d18df461-6b8c-4b05-8d0d-10332f907a6d tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:52.281292 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d18df461-6b8c-4b05-8d0d-10332f907a6d tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1849 microversion: 2.42 time: 1.294559 Oct 29 02:53:52.302561 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 791/1751] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:50 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1849 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:52.312659 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a725e3ca-a7c4-48f6-b9f1-16a095aaff27 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:52.319797 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a725e3ca-a7c4-48f6-b9f1-16a095aaff27 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 2d032bdd-de0f-40dc-88c6-afc41eab6770] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:52.328382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a725e3ca-a7c4-48f6-b9f1-16a095aaff27 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:52.332409 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a725e3ca-a7c4-48f6-b9f1-16a095aaff27 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:52.333334 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a725e3ca-a7c4-48f6-b9f1-16a095aaff27 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:52.334354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a725e3ca-a7c4-48f6-b9f1-16a095aaff27 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:52.335050 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a725e3ca-a7c4-48f6-b9f1-16a095aaff27 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:52.339872 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a725e3ca-a7c4-48f6-b9f1-16a095aaff27 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:52.795722 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a725e3ca-a7c4-48f6-b9f1-16a095aaff27 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971f709818b74757947beafd14f546bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49721a0af93a47d38613f4a588ab1e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:52.810109 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a725e3ca-a7c4-48f6-b9f1-16a095aaff27 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770" status: 200 len: 1315 microversion: 2.1 time: 0.505970 Oct 29 02:53:52.810883 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 792/1752] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:52 2022] GET /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770 => generated 1315 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:52.821248 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e10e7d12-d3fa-42ba-8107-00b4e16b6844 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:52.822145 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e10e7d12-d3fa-42ba-8107-00b4e16b6844 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] [instance: c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:52.836233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e10e7d12-d3fa-42ba-8107-00b4e16b6844 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:52.838396 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e10e7d12-d3fa-42ba-8107-00b4e16b6844 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:52.839112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e10e7d12-d3fa-42ba-8107-00b4e16b6844 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:52.840826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e10e7d12-d3fa-42ba-8107-00b4e16b6844 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:52.841954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e10e7d12-d3fa-42ba-8107-00b4e16b6844 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:52.844812 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e10e7d12-d3fa-42ba-8107-00b4e16b6844 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:53.050769 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:53.093475 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=12 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:53.430420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e10e7d12-d3fa-42ba-8107-00b4e16b6844 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c3218be14842e1b1fd2e5c10c9092a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f820fbde72429db671d15337913fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:53.444366 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e10e7d12-d3fa-42ba-8107-00b4e16b6844 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc" status: 200 len: 1316 microversion: 2.1 time: 0.631706 Oct 29 02:53:53.445633 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 793/1753] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:52 2022] GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc => generated 1316 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:53.464466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-fb4d48ac-1f69-4b14-aa15-7b6b81195423 req-71693735-150e-4f6c-bdc6-cbe7e5d60ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1123b300-f298-4071-bff4-8ddc088ee57f", "name": "network-vif-plugged", "status": "completed", "tag": "94ed150d-ec19-4ada-8ecf-11ff8e7dc70e"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:53.486186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-fb4d48ac-1f69-4b14-aa15-7b6b81195423 req-71693735-150e-4f6c-bdc6-cbe7e5d60ea6 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:53.486868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-fb4d48ac-1f69-4b14-aa15-7b6b81195423 req-71693735-150e-4f6c-bdc6-cbe7e5d60ea6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:53.487551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-fb4d48ac-1f69-4b14-aa15-7b6b81195423 req-71693735-150e-4f6c-bdc6-cbe7e5d60ea6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:53.513708 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-fb4d48ac-1f69-4b14-aa15-7b6b81195423 req-71693735-150e-4f6c-bdc6-cbe7e5d60ea6 service nova] Creating event network-vif-plugged:94ed150d-ec19-4ada-8ecf-11ff8e7dc70e for instance 1123b300-f298-4071-bff4-8ddc088ee57f on n-h1-862967-2 Oct 29 02:53:53.528333 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-fb4d48ac-1f69-4b14-aa15-7b6b81195423 req-71693735-150e-4f6c-bdc6-cbe7e5d60ea6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077947 Oct 29 02:53:53.534138 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 794/1754] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:53.545196 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-6a51d9db-d945-40d8-8a59-7721005e6088 req-27f7fdfa-569a-4b36-8f9b-8438aa4ae9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d032bdd-de0f-40dc-88c6-afc41eab6770", "tag": "79d33b3a-675b-49b7-a4c4-807ba304e4d4"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:53.563683 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6a51d9db-d945-40d8-8a59-7721005e6088 req-27f7fdfa-569a-4b36-8f9b-8438aa4ae9c2 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:53.564389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6a51d9db-d945-40d8-8a59-7721005e6088 req-27f7fdfa-569a-4b36-8f9b-8438aa4ae9c2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:53.564963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6a51d9db-d945-40d8-8a59-7721005e6088 req-27f7fdfa-569a-4b36-8f9b-8438aa4ae9c2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:53.583176 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-6a51d9db-d945-40d8-8a59-7721005e6088 req-27f7fdfa-569a-4b36-8f9b-8438aa4ae9c2 service nova] Creating event network-changed:79d33b3a-675b-49b7-a4c4-807ba304e4d4 for instance 2d032bdd-de0f-40dc-88c6-afc41eab6770 on n-h1-862967-2 Oct 29 02:53:53.592502 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-6a51d9db-d945-40d8-8a59-7721005e6088 req-27f7fdfa-569a-4b36-8f9b-8438aa4ae9c2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055595 Oct 29 02:53:53.593555 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 795/1755] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:53.614841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-8076c1e4-37d8-4d70-a7e8-d983c54cbcfc req-28db40e9-2eb2-464e-8d35-f97bdef6df67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0c20eea-c322-4d8e-bafd-3b3b01c5d142", "tag": "1a1b3e12-192b-4594-85e0-b5bcedd79e34"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:53.631977 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8076c1e4-37d8-4d70-a7e8-d983c54cbcfc req-28db40e9-2eb2-464e-8d35-f97bdef6df67 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:53.634630 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8076c1e4-37d8-4d70-a7e8-d983c54cbcfc req-28db40e9-2eb2-464e-8d35-f97bdef6df67 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:53.635718 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8076c1e4-37d8-4d70-a7e8-d983c54cbcfc req-28db40e9-2eb2-464e-8d35-f97bdef6df67 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:53.664434 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-8076c1e4-37d8-4d70-a7e8-d983c54cbcfc req-28db40e9-2eb2-464e-8d35-f97bdef6df67 service nova] Creating event network-changed:1a1b3e12-192b-4594-85e0-b5bcedd79e34 for instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 on n-h2-862967-2 Oct 29 02:53:53.671355 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-8076c1e4-37d8-4d70-a7e8-d983c54cbcfc req-28db40e9-2eb2-464e-8d35-f97bdef6df67 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075542 Oct 29 02:53:53.672582 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 796/1756] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:53.681887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3d84fc8c-5574-4bd4-8098-81c43ccbdb6b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:53.684118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3d84fc8c-5574-4bd4-8098-81c43ccbdb6b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 5b856917-a04b-436d-8f9f-5ce0492bc28b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:53.693812 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d84fc8c-5574-4bd4-8098-81c43ccbdb6b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:53.695524 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d84fc8c-5574-4bd4-8098-81c43ccbdb6b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:53.696786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d84fc8c-5574-4bd4-8098-81c43ccbdb6b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:53.697780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d84fc8c-5574-4bd4-8098-81c43ccbdb6b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:53.698443 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d84fc8c-5574-4bd4-8098-81c43ccbdb6b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:53.699228 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d84fc8c-5574-4bd4-8098-81c43ccbdb6b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:54.618835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3d84fc8c-5574-4bd4-8098-81c43ccbdb6b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:54.636099 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3d84fc8c-5574-4bd4-8098-81c43ccbdb6b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b" status: 200 len: 1334 microversion: 2.1 time: 0.960520 Oct 29 02:53:54.647608 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 797/1757] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:53 2022] GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b => generated 1334 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:54.675856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-655fec2d-1d34-4cbb-bac0-815676e082f9 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff053832ee0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:54.763619 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-655fec2d-1d34-4cbb-bac0-815676e082f9 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/3588b1c1-f15e-425c-8711-d112abef0137" status: 200 len: 1452 microversion: 2.1 time: 0.113654 Oct 29 02:53:54.765972 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 798/1758] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:54 2022] GET /compute/v2.1/images/3588b1c1-f15e-425c-8711-d112abef0137 => generated 1452 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:54.785420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-73a2efcf-87e0-4f2a-be83-5ea024d86240 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:54.786566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-73a2efcf-87e0-4f2a-be83-5ea024d86240 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:54.810519 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73a2efcf-87e0-4f2a-be83-5ea024d86240 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:54.811609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73a2efcf-87e0-4f2a-be83-5ea024d86240 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:54.815659 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73a2efcf-87e0-4f2a-be83-5ea024d86240 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:54.817693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73a2efcf-87e0-4f2a-be83-5ea024d86240 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:54.819363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73a2efcf-87e0-4f2a-be83-5ea024d86240 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:54.821555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73a2efcf-87e0-4f2a-be83-5ea024d86240 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:55.681211 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-13bee382-6958-4fb2-81f8-bf314107e4b6 tempest-SecurityGroupsTestAdminJSON-2066630176 tempest-SecurityGroupsTestAdminJSON-2066630176-project-admin] 10.222.0.46 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11506 microversion: 2.1 time: 7.340180 Oct 29 02:53:55.682119 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 961/1759] 10.222.0.46 () {58 vars in 1191 bytes} [Sat Oct 29 02:53:48 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11506 bytes in 7343 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:53:55.706627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fbf294f9-991a-4bdc-af99-48fecd04035a tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:55.708414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fbf294f9-991a-4bdc-af99-48fecd04035a tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 2d032bdd-de0f-40dc-88c6-afc41eab6770] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:55.730104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbf294f9-991a-4bdc-af99-48fecd04035a tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:55.740979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbf294f9-991a-4bdc-af99-48fecd04035a tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:55.742220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbf294f9-991a-4bdc-af99-48fecd04035a tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:55.743645 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbf294f9-991a-4bdc-af99-48fecd04035a tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:55.745977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbf294f9-991a-4bdc-af99-48fecd04035a tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:55.747640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbf294f9-991a-4bdc-af99-48fecd04035a tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:56.304220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fbf294f9-991a-4bdc-af99-48fecd04035a tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971f709818b74757947beafd14f546bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49721a0af93a47d38613f4a588ab1e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:56.315755 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fbf294f9-991a-4bdc-af99-48fecd04035a tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770" status: 200 len: 1315 microversion: 2.1 time: 0.616464 Oct 29 02:53:56.330284 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 962/1760] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:55 2022] GET /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770 => generated 1315 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:56.349235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9f087956-201b-46d2-aa04-9d1ae914dd6b tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:56.350281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9f087956-201b-46d2-aa04-9d1ae914dd6b tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] [instance: c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:56.360703 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f087956-201b-46d2-aa04-9d1ae914dd6b tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:56.365995 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f087956-201b-46d2-aa04-9d1ae914dd6b tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:56.366721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f087956-201b-46d2-aa04-9d1ae914dd6b tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:56.368172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f087956-201b-46d2-aa04-9d1ae914dd6b tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:56.371221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f087956-201b-46d2-aa04-9d1ae914dd6b tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:56.371904 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f087956-201b-46d2-aa04-9d1ae914dd6b tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:56.792274 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9f087956-201b-46d2-aa04-9d1ae914dd6b tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c3218be14842e1b1fd2e5c10c9092a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f820fbde72429db671d15337913fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:56.808005 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9f087956-201b-46d2-aa04-9d1ae914dd6b tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc" status: 200 len: 1316 microversion: 2.1 time: 0.467895 Oct 29 02:53:56.812473 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 963/1761] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:56 2022] GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc => generated 1316 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:56.825722 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-df41f427-8839-4d47-9a09-5b8b329731c1 req-dd858bf8-1b41-4c2a-b527-6df1e3e4910f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc", "name": "network-vif-plugged", "status": "completed", "tag": "79864797-817a-49a1-9e41-46b8d629427a"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:56.852345 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-df41f427-8839-4d47-9a09-5b8b329731c1 req-dd858bf8-1b41-4c2a-b527-6df1e3e4910f service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:56.853414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-df41f427-8839-4d47-9a09-5b8b329731c1 req-dd858bf8-1b41-4c2a-b527-6df1e3e4910f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:56.854081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-df41f427-8839-4d47-9a09-5b8b329731c1 req-dd858bf8-1b41-4c2a-b527-6df1e3e4910f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:56.885374 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-df41f427-8839-4d47-9a09-5b8b329731c1 req-dd858bf8-1b41-4c2a-b527-6df1e3e4910f service nova] Creating event network-vif-plugged:79864797-817a-49a1-9e41-46b8d629427a for instance c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc on n-h2-862967-2 Oct 29 02:53:56.896897 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-df41f427-8839-4d47-9a09-5b8b329731c1 req-dd858bf8-1b41-4c2a-b527-6df1e3e4910f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081411 Oct 29 02:53:56.899416 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 964/1762] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:56.928957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-455b2b82-24ea-427b-8f73-aec961a827d2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:56.931404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-455b2b82-24ea-427b-8f73-aec961a827d2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 5b856917-a04b-436d-8f9f-5ce0492bc28b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:56.944758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-455b2b82-24ea-427b-8f73-aec961a827d2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:56.947414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-455b2b82-24ea-427b-8f73-aec961a827d2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:56.950270 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-455b2b82-24ea-427b-8f73-aec961a827d2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:56.955283 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-455b2b82-24ea-427b-8f73-aec961a827d2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:56.956137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-455b2b82-24ea-427b-8f73-aec961a827d2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:56.956921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-455b2b82-24ea-427b-8f73-aec961a827d2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:57.369156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-455b2b82-24ea-427b-8f73-aec961a827d2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:57.382553 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-455b2b82-24ea-427b-8f73-aec961a827d2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b" status: 200 len: 1334 microversion: 2.1 time: 0.481383 Oct 29 02:53:57.384632 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 965/1763] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:56 2022] GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b => generated 1334 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:57.397715 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b3fc70cf-03d1-471a-8285-100362918d10 tempest-SecurityGroupsTestAdminJSON-1367798675 tempest-SecurityGroupsTestAdminJSON-1367798675-project] Calling method '.version_select at 0x7ff05c227700>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:57.689241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-73a2efcf-87e0-4f2a-be83-5ea024d86240 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:57.693156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:57.716250 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-73a2efcf-87e0-4f2a-be83-5ea024d86240 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:57.718484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-73a2efcf-87e0-4f2a-be83-5ea024d86240 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:57.721156 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-73a2efcf-87e0-4f2a-be83-5ea024d86240 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1879 microversion: 2.42 time: 2.952834 Oct 29 02:53:57.722404 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 799/1764] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:54 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1879 bytes in 2955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:53:57.738852 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-cf34763e-73a0-4ffd-814e-fbcf9b4008aa req-f2b99f46-2fab-4392-831f-5c59a755877b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0c20eea-c322-4d8e-bafd-3b3b01c5d142", "tag": "da28c280-91d5-47ab-8861-0f028fe80b4b"}, {"name": "network-changed", "server_uuid": "5b856917-a04b-436d-8f9f-5ce0492bc28b", "tag": "deb0da4d-e3f5-449d-a854-c95360500d9e"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:53:57.760900 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-cf34763e-73a0-4ffd-814e-fbcf9b4008aa req-f2b99f46-2fab-4392-831f-5c59a755877b service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:57.761702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-cf34763e-73a0-4ffd-814e-fbcf9b4008aa req-f2b99f46-2fab-4392-831f-5c59a755877b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:57.762538 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-cf34763e-73a0-4ffd-814e-fbcf9b4008aa req-f2b99f46-2fab-4392-831f-5c59a755877b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:57.785163 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-cf34763e-73a0-4ffd-814e-fbcf9b4008aa req-f2b99f46-2fab-4392-831f-5c59a755877b service nova] Creating event network-changed:da28c280-91d5-47ab-8861-0f028fe80b4b for instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 on n-h2-862967-2 Oct 29 02:53:57.787365 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-cf34763e-73a0-4ffd-814e-fbcf9b4008aa req-f2b99f46-2fab-4392-831f-5c59a755877b service nova] Creating event network-changed:deb0da4d-e3f5-449d-a854-c95360500d9e for instance 5b856917-a04b-436d-8f9f-5ce0492bc28b on n-h1-862967-2 Oct 29 02:53:57.811810 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-cf34763e-73a0-4ffd-814e-fbcf9b4008aa req-f2b99f46-2fab-4392-831f-5c59a755877b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.081701 Oct 29 02:53:57.813501 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 800/1765] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:53:57.824895 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-aafe66f3-e7d1-4b73-8bd6-b18dc4dbeab7 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05370c700>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:57.841939 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b3fc70cf-03d1-471a-8285-100362918d10 tempest-SecurityGroupsTestAdminJSON-1367798675 tempest-SecurityGroupsTestAdminJSON-1367798675-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.452573 Oct 29 02:53:57.842775 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 966/1766] 10.222.0.46 () {58 vars in 1191 bytes} [Sat Oct 29 02:53:57 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:57.856891 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e496ce72-3346-4bf4-8a4d-dd1a7f16adf5 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:57.857534 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e496ce72-3346-4bf4-8a4d-dd1a7f16adf5 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 2d032bdd-de0f-40dc-88c6-afc41eab6770] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:57.871756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e496ce72-3346-4bf4-8a4d-dd1a7f16adf5 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:57.872637 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e496ce72-3346-4bf4-8a4d-dd1a7f16adf5 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:57.873524 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e496ce72-3346-4bf4-8a4d-dd1a7f16adf5 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:57.874469 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e496ce72-3346-4bf4-8a4d-dd1a7f16adf5 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:57.875133 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e496ce72-3346-4bf4-8a4d-dd1a7f16adf5 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:57.875940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e496ce72-3346-4bf4-8a4d-dd1a7f16adf5 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:57.960840 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-aafe66f3-e7d1-4b73-8bd6-b18dc4dbeab7 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/3588b1c1-f15e-425c-8711-d112abef0137" status: 200 len: 1452 microversion: 2.1 time: 0.144405 Oct 29 02:53:57.968044 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 801/1767] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:57 2022] GET /compute/v2.1/images/3588b1c1-f15e-425c-8711-d112abef0137 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:57.988660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9f9b5295-350c-41de-b316-4dd04cf9b54d tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:57.989751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9f9b5295-350c-41de-b316-4dd04cf9b54d tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] [instance: c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:58.009418 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f9b5295-350c-41de-b316-4dd04cf9b54d tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:58.010396 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f9b5295-350c-41de-b316-4dd04cf9b54d tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:58.011066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f9b5295-350c-41de-b316-4dd04cf9b54d tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:58.012023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f9b5295-350c-41de-b316-4dd04cf9b54d tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:58.018894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f9b5295-350c-41de-b316-4dd04cf9b54d tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:58.020977 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f9b5295-350c-41de-b316-4dd04cf9b54d tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:58.797009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9f9b5295-350c-41de-b316-4dd04cf9b54d tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c3218be14842e1b1fd2e5c10c9092a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f820fbde72429db671d15337913fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:58.818966 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9f9b5295-350c-41de-b316-4dd04cf9b54d tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc" status: 200 len: 1316 microversion: 2.1 time: 0.848998 Oct 29 02:53:58.819920 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 802/1768] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:57 2022] GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc => generated 1316 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:58.840765 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d91b25e3-ca66-4bbe-84b3-ea5b14afcf10 tempest-SecurityGroupsTestAdminJSON-2066630176 tempest-SecurityGroupsTestAdminJSON-2066630176-project-admin] Calling method '.version_select at 0x7ff05370cf70>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:58.901562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e496ce72-3346-4bf4-8a4d-dd1a7f16adf5 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971f709818b74757947beafd14f546bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49721a0af93a47d38613f4a588ab1e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:58.931390 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e496ce72-3346-4bf4-8a4d-dd1a7f16adf5 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770" status: 200 len: 1315 microversion: 2.1 time: 1.086065 Oct 29 02:53:58.932608 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 967/1769] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:57 2022] GET /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770 => generated 1315 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:58.943001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3a88c97d-83cb-48b3-aa3e-b39a43348fe1 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:58.946357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3a88c97d-83cb-48b3-aa3e-b39a43348fe1 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 5b856917-a04b-436d-8f9f-5ce0492bc28b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:58.962806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a88c97d-83cb-48b3-aa3e-b39a43348fe1 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:58.965951 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a88c97d-83cb-48b3-aa3e-b39a43348fe1 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:58.966647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a88c97d-83cb-48b3-aa3e-b39a43348fe1 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:58.969853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a88c97d-83cb-48b3-aa3e-b39a43348fe1 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:58.970917 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a88c97d-83cb-48b3-aa3e-b39a43348fe1 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:58.971741 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a88c97d-83cb-48b3-aa3e-b39a43348fe1 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:59.365832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3a88c97d-83cb-48b3-aa3e-b39a43348fe1 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:53:59.380221 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3a88c97d-83cb-48b3-aa3e-b39a43348fe1 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b" status: 200 len: 1334 microversion: 2.1 time: 0.443525 Oct 29 02:53:59.395978 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 968/1770] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:53:58 2022] GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b => generated 1334 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:53:59.402839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-44586804-505c-4648-ab78-f338bdd04420 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:53:59.413468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-44586804-505c-4648-ab78-f338bdd04420 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:53:59.420320 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-44586804-505c-4648-ab78-f338bdd04420 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:59.433358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-44586804-505c-4648-ab78-f338bdd04420 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:59.434095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-44586804-505c-4648-ab78-f338bdd04420 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:59.435011 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-44586804-505c-4648-ab78-f338bdd04420 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:53:59.435630 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-44586804-505c-4648-ab78-f338bdd04420 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:53:59.436252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-44586804-505c-4648-ab78-f338bdd04420 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:53:59.979942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-44586804-505c-4648-ab78-f338bdd04420 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:00.001151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-44586804-505c-4648-ab78-f338bdd04420 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:00.003335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-44586804-505c-4648-ab78-f338bdd04420 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:00.005979 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-44586804-505c-4648-ab78-f338bdd04420 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1879 microversion: 2.42 time: 0.608833 Oct 29 02:54:00.013424 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 969/1771] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:53:59 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1879 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:00.021877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-a6786649-14e2-4bfc-83ec-2af529acdc41 req-b9cd0b1e-c2b9-492c-bd3e-b953ded0c68e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d032bdd-de0f-40dc-88c6-afc41eab6770", "name": "network-vif-plugged", "status": "completed", "tag": "79d33b3a-675b-49b7-a4c4-807ba304e4d4"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:00.042737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a6786649-14e2-4bfc-83ec-2af529acdc41 req-b9cd0b1e-c2b9-492c-bd3e-b953ded0c68e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:00.043504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a6786649-14e2-4bfc-83ec-2af529acdc41 req-b9cd0b1e-c2b9-492c-bd3e-b953ded0c68e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:00.045069 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a6786649-14e2-4bfc-83ec-2af529acdc41 req-b9cd0b1e-c2b9-492c-bd3e-b953ded0c68e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:00.071274 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-a6786649-14e2-4bfc-83ec-2af529acdc41 req-b9cd0b1e-c2b9-492c-bd3e-b953ded0c68e service nova] Creating event network-vif-plugged:79d33b3a-675b-49b7-a4c4-807ba304e4d4 for instance 2d032bdd-de0f-40dc-88c6-afc41eab6770 on n-h1-862967-2 Oct 29 02:54:00.096828 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-a6786649-14e2-4bfc-83ec-2af529acdc41 req-b9cd0b1e-c2b9-492c-bd3e-b953ded0c68e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081650 Oct 29 02:54:00.105276 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 970/1772] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:00.111727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c26d3a2d-d7f8-46aa-aad9-ed0e661da0c2 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c0f4160>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:00.250779 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c26d3a2d-d7f8-46aa-aad9-ed0e661da0c2 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/3588b1c1-f15e-425c-8711-d112abef0137" status: 200 len: 1452 microversion: 2.1 time: 0.143730 Oct 29 02:54:00.258472 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 971/1773] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:00 2022] GET /compute/v2.1/images/3588b1c1-f15e-425c-8711-d112abef0137 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:00.270905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-30adc392-e063-407d-82bf-b9e426efbea7 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:00.294942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-30adc392-e063-407d-82bf-b9e426efbea7 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] [instance: c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:00.335679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30adc392-e063-407d-82bf-b9e426efbea7 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:00.336186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30adc392-e063-407d-82bf-b9e426efbea7 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:00.336735 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30adc392-e063-407d-82bf-b9e426efbea7 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:00.337364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30adc392-e063-407d-82bf-b9e426efbea7 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:00.337812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30adc392-e063-407d-82bf-b9e426efbea7 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:00.347578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30adc392-e063-407d-82bf-b9e426efbea7 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:00.616993 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d91b25e3-ca66-4bbe-84b3-ea5b14afcf10 tempest-SecurityGroupsTestAdminJSON-2066630176 tempest-SecurityGroupsTestAdminJSON-2066630176-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/92b48f65-f5f1-4803-98f4-af0507dcf02d" status: 202 len: 0 microversion: 2.1 time: 1.783035 Oct 29 02:54:00.618550 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 803/1774] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:53:58 2022] DELETE /compute/v2.1/os-security-groups/92b48f65-f5f1-4803-98f4-af0507dcf02d => generated 0 bytes in 1798 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:54:00.625357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-893b4898-93ae-4f86-934a-8f37d9196e50 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:00.626009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-893b4898-93ae-4f86-934a-8f37d9196e50 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 2d032bdd-de0f-40dc-88c6-afc41eab6770] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:00.642106 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-893b4898-93ae-4f86-934a-8f37d9196e50 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:00.642705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-893b4898-93ae-4f86-934a-8f37d9196e50 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:00.643188 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-893b4898-93ae-4f86-934a-8f37d9196e50 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:00.643968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-893b4898-93ae-4f86-934a-8f37d9196e50 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:00.644567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-893b4898-93ae-4f86-934a-8f37d9196e50 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:00.652148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-893b4898-93ae-4f86-934a-8f37d9196e50 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:00.718817 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-30adc392-e063-407d-82bf-b9e426efbea7 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c3218be14842e1b1fd2e5c10c9092a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f820fbde72429db671d15337913fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:00.731496 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-30adc392-e063-407d-82bf-b9e426efbea7 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc" status: 200 len: 1466 microversion: 2.1 time: 0.471487 Oct 29 02:54:00.733185 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 972/1775] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:00 2022] GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc => generated 1466 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:00.750786 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-65af419d-e504-4ed2-aaab-f23c1ea5141d req-d8ed5518-61b8-4a45-85dd-3ebc4387b7d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0c20eea-c322-4d8e-bafd-3b3b01c5d142", "tag": "20b9f931-71de-4cc6-b5b4-f7a9d8ff7ad9"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:00.773135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-65af419d-e504-4ed2-aaab-f23c1ea5141d req-d8ed5518-61b8-4a45-85dd-3ebc4387b7d3 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:00.773900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-65af419d-e504-4ed2-aaab-f23c1ea5141d req-d8ed5518-61b8-4a45-85dd-3ebc4387b7d3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:00.774530 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-65af419d-e504-4ed2-aaab-f23c1ea5141d req-d8ed5518-61b8-4a45-85dd-3ebc4387b7d3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:00.807095 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-65af419d-e504-4ed2-aaab-f23c1ea5141d req-d8ed5518-61b8-4a45-85dd-3ebc4387b7d3 service nova] Creating event network-changed:20b9f931-71de-4cc6-b5b4-f7a9d8ff7ad9 for instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 on n-h2-862967-2 Oct 29 02:54:00.813960 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-65af419d-e504-4ed2-aaab-f23c1ea5141d req-d8ed5518-61b8-4a45-85dd-3ebc4387b7d3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075336 Oct 29 02:54:00.833033 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 973/1776] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:00.849373 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5b1f6d74-45e8-4576-a108-8423eaf07ad7 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:00.850398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5b1f6d74-45e8-4576-a108-8423eaf07ad7 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 5b856917-a04b-436d-8f9f-5ce0492bc28b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:00.866538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b1f6d74-45e8-4576-a108-8423eaf07ad7 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:00.867461 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b1f6d74-45e8-4576-a108-8423eaf07ad7 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:00.868233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b1f6d74-45e8-4576-a108-8423eaf07ad7 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:00.870756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b1f6d74-45e8-4576-a108-8423eaf07ad7 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:00.871817 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b1f6d74-45e8-4576-a108-8423eaf07ad7 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:00.873116 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b1f6d74-45e8-4576-a108-8423eaf07ad7 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:01.182021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5b1f6d74-45e8-4576-a108-8423eaf07ad7 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:01.194151 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5b1f6d74-45e8-4576-a108-8423eaf07ad7 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b" status: 200 len: 1334 microversion: 2.1 time: 0.359341 Oct 29 02:54:01.197501 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 974/1777] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:00 2022] GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b => generated 1334 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:01.206290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b32ad26c-36fb-4481-866c-edfd136b0fe9 tempest-SecurityGroupsTestAdminJSON-2066630176 tempest-SecurityGroupsTestAdminJSON-2066630176-project-admin] Calling method '.version_select at 0x7ff053a53ee0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:01.862908 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b32ad26c-36fb-4481-866c-edfd136b0fe9 tempest-SecurityGroupsTestAdminJSON-2066630176 tempest-SecurityGroupsTestAdminJSON-2066630176-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/6994c087-e3a1-4780-ae02-5eacc8253db4" status: 202 len: 0 microversion: 2.1 time: 0.663969 Oct 29 02:54:01.864196 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 975/1778] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:54:01 2022] DELETE /compute/v2.1/os-security-groups/6994c087-e3a1-4780-ae02-5eacc8253db4 => generated 0 bytes in 666 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:54:01.869587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7d3b4b19-01ef-4719-9bec-33aed0b38b73 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1834411025", "metadata": {"image_type": "test"}}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:01.872228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7d3b4b19-01ef-4719-9bec-33aed0b38b73 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] [instance: c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:01.883839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7d3b4b19-01ef-4719-9bec-33aed0b38b73 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:01.889633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7d3b4b19-01ef-4719-9bec-33aed0b38b73 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:01.890343 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7d3b4b19-01ef-4719-9bec-33aed0b38b73 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:01.899523 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7d3b4b19-01ef-4719-9bec-33aed0b38b73 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:01.900297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7d3b4b19-01ef-4719-9bec-33aed0b38b73 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:01.900917 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7d3b4b19-01ef-4719-9bec-33aed0b38b73 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:01.985862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-7d3b4b19-01ef-4719-9bec-33aed0b38b73 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Getting quotas for project 10f820fbde72429db671d15337913fd4. Resources: dict_keys(['metadata_items']) {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:54:01.996656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-7d3b4b19-01ef-4719-9bec-33aed0b38b73 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Getting quotas for user 71c3218be14842e1b1fd2e5c10c9092a and project 10f820fbde72429db671d15337913fd4. Resources: dict_keys(['metadata_items']) {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:54:02.260064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-893b4898-93ae-4f86-934a-8f37d9196e50 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971f709818b74757947beafd14f546bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49721a0af93a47d38613f4a588ab1e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:02.282675 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-893b4898-93ae-4f86-934a-8f37d9196e50 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770" status: 200 len: 1315 microversion: 2.1 time: 1.662418 Oct 29 02:54:02.318955 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 804/1779] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:00 2022] GET /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770 => generated 1315 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:02.337877 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-207bd2f8-a43f-457e-ae3a-8645ff3b7eb6 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:02.348038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-207bd2f8-a43f-457e-ae3a-8645ff3b7eb6 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:02.360087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-207bd2f8-a43f-457e-ae3a-8645ff3b7eb6 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:02.360980 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-207bd2f8-a43f-457e-ae3a-8645ff3b7eb6 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:02.361727 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-207bd2f8-a43f-457e-ae3a-8645ff3b7eb6 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:02.364378 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-207bd2f8-a43f-457e-ae3a-8645ff3b7eb6 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:02.366129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-207bd2f8-a43f-457e-ae3a-8645ff3b7eb6 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:02.369766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-207bd2f8-a43f-457e-ae3a-8645ff3b7eb6 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:02.440747 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7d3b4b19-01ef-4719-9bec-33aed0b38b73 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "POST /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc/action" status: 202 len: 0 microversion: 2.1 time: 0.574540 Oct 29 02:54:02.442949 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 976/1780] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:54:01 2022] POST /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc/action => generated 0 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 02:54:02.450925 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a609c523-f287-43e5-88a2-fc2e2b1fe33c tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c22d550>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:02.549993 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a609c523-f287-43e5-88a2-fc2e2b1fe33c tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/3588b1c1-f15e-425c-8711-d112abef0137" status: 200 len: 1452 microversion: 2.1 time: 0.102116 Oct 29 02:54:02.552440 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 977/1781] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:02 2022] GET /compute/v2.1/images/3588b1c1-f15e-425c-8711-d112abef0137 => generated 1452 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:02.563667 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-599ff5ba-d712-4f64-bbac-a8f4e72fbbfc tempest-SecurityGroupsTestAdminJSON-1367798675 tempest-SecurityGroupsTestAdminJSON-1367798675-project] Calling method '.version_select at 0x7ff05c23e5e0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:03.063883 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-207bd2f8-a43f-457e-ae3a-8645ff3b7eb6 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:03.089080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-207bd2f8-a43f-457e-ae3a-8645ff3b7eb6 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:03.093653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-207bd2f8-a43f-457e-ae3a-8645ff3b7eb6 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:03.097453 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-207bd2f8-a43f-457e-ae3a-8645ff3b7eb6 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1879 microversion: 2.42 time: 0.776998 Oct 29 02:54:03.099197 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 805/1782] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:02 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1879 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:03.112380 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8138bfda-c93c-4306-a7d1-61843ad7e94e tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:03.114462 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8138bfda-c93c-4306-a7d1-61843ad7e94e tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 5b856917-a04b-436d-8f9f-5ce0492bc28b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:03.138657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8138bfda-c93c-4306-a7d1-61843ad7e94e tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:03.139164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8138bfda-c93c-4306-a7d1-61843ad7e94e tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:03.139777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8138bfda-c93c-4306-a7d1-61843ad7e94e tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:03.140729 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8138bfda-c93c-4306-a7d1-61843ad7e94e tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:03.141360 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8138bfda-c93c-4306-a7d1-61843ad7e94e tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:03.153309 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8138bfda-c93c-4306-a7d1-61843ad7e94e tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:03.158551 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-599ff5ba-d712-4f64-bbac-a8f4e72fbbfc tempest-SecurityGroupsTestAdminJSON-1367798675 tempest-SecurityGroupsTestAdminJSON-1367798675-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/8c90fc60-5687-40c8-a813-65bf9d85e06e" status: 202 len: 0 microversion: 2.1 time: 0.603878 Oct 29 02:54:03.160180 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 978/1783] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:54:02 2022] DELETE /compute/v2.1/os-security-groups/8c90fc60-5687-40c8-a813-65bf9d85e06e => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:54:03.169310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ecf2f6f8-525c-4f57-a7f4-c7d3d77dd47b tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff05c24b550>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:03.245121 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ecf2f6f8-525c-4f57-a7f4-c7d3d77dd47b tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d" status: 200 len: 1424 microversion: 2.1 time: 0.083247 Oct 29 02:54:03.248995 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 979/1784] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:03 2022] GET /compute/v2.1/images/cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d => generated 1424 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:03.262718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1cc99e12-df4b-47b3-814a-8738b9e85934 tempest-SecurityGroupsTestAdminJSON-1367798675 tempest-SecurityGroupsTestAdminJSON-1367798675-project] Calling method '.version_select at 0x7ff05c23e700>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:03.663936 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1cc99e12-df4b-47b3-814a-8738b9e85934 tempest-SecurityGroupsTestAdminJSON-1367798675 tempest-SecurityGroupsTestAdminJSON-1367798675-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/dd96fba4-3eb0-472f-b70d-6688869ecb98" status: 202 len: 0 microversion: 2.1 time: 0.412252 Oct 29 02:54:03.666975 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8138bfda-c93c-4306-a7d1-61843ad7e94e tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:03.668093 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 980/1785] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:54:03 2022] DELETE /compute/v2.1/os-security-groups/dd96fba4-3eb0-472f-b70d-6688869ecb98 => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:54:03.680049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-65b7cdfc-352c-4bcf-9442-608f5d9b5356 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:03.683782 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-65b7cdfc-352c-4bcf-9442-608f5d9b5356 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 2d032bdd-de0f-40dc-88c6-afc41eab6770] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:03.689322 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8138bfda-c93c-4306-a7d1-61843ad7e94e tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b" status: 200 len: 1334 microversion: 2.1 time: 0.588815 Oct 29 02:54:03.709276 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 806/1786] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:03 2022] GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b => generated 1334 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:03.720926 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-65b7cdfc-352c-4bcf-9442-608f5d9b5356 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:03.721455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-65b7cdfc-352c-4bcf-9442-608f5d9b5356 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:03.721891 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-65b7cdfc-352c-4bcf-9442-608f5d9b5356 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:03.722606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-65b7cdfc-352c-4bcf-9442-608f5d9b5356 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:03.723054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-65b7cdfc-352c-4bcf-9442-608f5d9b5356 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:03.728097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-ceaa154b-72c0-494f-aed8-7d370fc171bb req-0880ca07-0dda-4357-b965-dd63c1a1d45f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b856917-a04b-436d-8f9f-5ce0492bc28b", "tag": "2195d2bd-e1c7-4a48-9750-1b93573c6a18"}, {"name": "network-changed", "server_uuid": "f0c20eea-c322-4d8e-bafd-3b3b01c5d142", "tag": "c76f3db4-7820-423e-9c05-70cecc3190e6"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:03.733930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-65b7cdfc-352c-4bcf-9442-608f5d9b5356 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:03.762210 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ceaa154b-72c0-494f-aed8-7d370fc171bb req-0880ca07-0dda-4357-b965-dd63c1a1d45f service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:03.763259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ceaa154b-72c0-494f-aed8-7d370fc171bb req-0880ca07-0dda-4357-b965-dd63c1a1d45f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:03.763868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ceaa154b-72c0-494f-aed8-7d370fc171bb req-0880ca07-0dda-4357-b965-dd63c1a1d45f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:03.797226 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-ceaa154b-72c0-494f-aed8-7d370fc171bb req-0880ca07-0dda-4357-b965-dd63c1a1d45f service nova] Creating event network-changed:2195d2bd-e1c7-4a48-9750-1b93573c6a18 for instance 5b856917-a04b-436d-8f9f-5ce0492bc28b on n-h1-862967-2 Oct 29 02:54:03.799214 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-ceaa154b-72c0-494f-aed8-7d370fc171bb req-0880ca07-0dda-4357-b965-dd63c1a1d45f service nova] Creating event network-changed:c76f3db4-7820-423e-9c05-70cecc3190e6 for instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 on n-h2-862967-2 Oct 29 02:54:03.824510 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-ceaa154b-72c0-494f-aed8-7d370fc171bb req-0880ca07-0dda-4357-b965-dd63c1a1d45f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.110753 Oct 29 02:54:03.826645 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 807/1787] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:03.840609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f2bde3b1-5b0c-4bec-89af-d493e4f52076 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff053725310>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:03.957430 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f2bde3b1-5b0c-4bec-89af-d493e4f52076 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/3588b1c1-f15e-425c-8711-d112abef0137" status: 200 len: 1452 microversion: 2.1 time: 0.129408 Oct 29 02:54:03.958377 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 808/1788] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:03 2022] GET /compute/v2.1/images/3588b1c1-f15e-425c-8711-d112abef0137 => generated 1452 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:04.052222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-65b7cdfc-352c-4bcf-9442-608f5d9b5356 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971f709818b74757947beafd14f546bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49721a0af93a47d38613f4a588ab1e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:04.061376 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-65b7cdfc-352c-4bcf-9442-608f5d9b5356 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770" status: 200 len: 1504 microversion: 2.1 time: 0.391856 Oct 29 02:54:04.087892 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 981/1789] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:03 2022] GET /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770 => generated 1504 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:04.094745 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dbea3b74-2f5f-481e-86df-ea937e65fdd5 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-625739168"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:04.098642 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dbea3b74-2f5f-481e-86df-ea937e65fdd5 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 2d032bdd-de0f-40dc-88c6-afc41eab6770] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:04.118822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbea3b74-2f5f-481e-86df-ea937e65fdd5 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:04.119320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbea3b74-2f5f-481e-86df-ea937e65fdd5 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:04.119747 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbea3b74-2f5f-481e-86df-ea937e65fdd5 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:04.120476 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbea3b74-2f5f-481e-86df-ea937e65fdd5 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:04.120935 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbea3b74-2f5f-481e-86df-ea937e65fdd5 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:04.121351 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbea3b74-2f5f-481e-86df-ea937e65fdd5 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:04.127740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-acd95963-826d-470b-a3b6-26c62f3c7db3 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:04.128730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-acd95963-826d-470b-a3b6-26c62f3c7db3 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:04.142271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-acd95963-826d-470b-a3b6-26c62f3c7db3 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:04.143237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-acd95963-826d-470b-a3b6-26c62f3c7db3 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:04.144684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-acd95963-826d-470b-a3b6-26c62f3c7db3 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:04.147792 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-acd95963-826d-470b-a3b6-26c62f3c7db3 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:04.151294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-acd95963-826d-470b-a3b6-26c62f3c7db3 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:04.152265 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-acd95963-826d-470b-a3b6-26c62f3c7db3 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:04.980318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-acd95963-826d-470b-a3b6-26c62f3c7db3 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:05.000634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-acd95963-826d-470b-a3b6-26c62f3c7db3 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:05.002395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-acd95963-826d-470b-a3b6-26c62f3c7db3 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:05.003939 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-acd95963-826d-470b-a3b6-26c62f3c7db3 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1879 microversion: 2.42 time: 0.880422 Oct 29 02:54:05.016990 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 982/1790] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:04 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1879 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:54:05.016990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0721bd93-f804-4689-9ed6-8b84ecb6972c tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff05c22d160>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:05.100288 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0721bd93-f804-4689-9ed6-8b84ecb6972c tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d" status: 200 len: 1424 microversion: 2.1 time: 0.094609 Oct 29 02:54:05.101029 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 983/1791] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:05 2022] GET /compute/v2.1/images/cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d => generated 1424 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:05.106004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6177072c-6a2e-4251-93e7-cd9936fd61ec tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:05.106915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6177072c-6a2e-4251-93e7-cd9936fd61ec tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 5b856917-a04b-436d-8f9f-5ce0492bc28b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:05.116838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6177072c-6a2e-4251-93e7-cd9936fd61ec tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:05.129890 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6177072c-6a2e-4251-93e7-cd9936fd61ec tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:05.130434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6177072c-6a2e-4251-93e7-cd9936fd61ec tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:05.131340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6177072c-6a2e-4251-93e7-cd9936fd61ec tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:05.131862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6177072c-6a2e-4251-93e7-cd9936fd61ec tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:05.132351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6177072c-6a2e-4251-93e7-cd9936fd61ec tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:05.181265 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:05.359096 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.network.security_group_api [None req-dbea3b74-2f5f-481e-86df-ea937e65fdd5 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Adding security group 46f36c25-d774-4eca-b1d4-ced212edf890 to port 79d33b3a-675b-49b7-a4c4-807ba304e4d4 Oct 29 02:54:06.684218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6177072c-6a2e-4251-93e7-cd9936fd61ec tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:06.693745 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6177072c-6a2e-4251-93e7-cd9936fd61ec tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b" status: 200 len: 1334 microversion: 2.1 time: 1.591339 Oct 29 02:54:06.695345 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 984/1792] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:05 2022] GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b => generated 1334 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:06.727967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c11e6fd9-54ee-4935-84d9-037c2eb7c194 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c0fb940>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:07.738929 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dbea3b74-2f5f-481e-86df-ea937e65fdd5 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "POST /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770/action" status: 202 len: 0 microversion: 2.1 time: 3.649256 Oct 29 02:54:07.743075 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 809/1793] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:54:04 2022] POST /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770/action => generated 0 bytes in 3651 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:54:07.753328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8a7da0fc-fddf-48be-bd8c-3b0cdab29a8d tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:07.754216 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8a7da0fc-fddf-48be-bd8c-3b0cdab29a8d tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:07.774776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a7da0fc-fddf-48be-bd8c-3b0cdab29a8d tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:07.781040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a7da0fc-fddf-48be-bd8c-3b0cdab29a8d tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:07.789568 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a7da0fc-fddf-48be-bd8c-3b0cdab29a8d tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:07.790628 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a7da0fc-fddf-48be-bd8c-3b0cdab29a8d tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:07.791267 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a7da0fc-fddf-48be-bd8c-3b0cdab29a8d tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:07.794230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a7da0fc-fddf-48be-bd8c-3b0cdab29a8d tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:09.716305 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8a7da0fc-fddf-48be-bd8c-3b0cdab29a8d tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:09.727279 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8a7da0fc-fddf-48be-bd8c-3b0cdab29a8d tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:09.729978 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8a7da0fc-fddf-48be-bd8c-3b0cdab29a8d tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:09.731534 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8a7da0fc-fddf-48be-bd8c-3b0cdab29a8d tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1879 microversion: 2.42 time: 1.987014 Oct 29 02:54:09.748965 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 810/1794] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:07 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1879 bytes in 2005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:09.757560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c3ece83a-1465-4997-90aa-1ed369d1acca tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff0536e4430>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:11.598443 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c11e6fd9-54ee-4935-84d9-037c2eb7c194 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/3588b1c1-f15e-425c-8711-d112abef0137" status: 200 len: 1461 microversion: 2.1 time: 4.901676 Oct 29 02:54:11.599408 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 985/1795] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:06 2022] GET /compute/v2.1/images/3588b1c1-f15e-425c-8711-d112abef0137 => generated 1461 bytes in 4903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:11.610886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-20c7c1a7-53aa-4342-b361-99eaf051d73b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:11.616962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-20c7c1a7-53aa-4342-b361-99eaf051d73b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 5b856917-a04b-436d-8f9f-5ce0492bc28b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:11.625192 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c3ece83a-1465-4997-90aa-1ed369d1acca tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d" status: 200 len: 1424 microversion: 2.1 time: 1.874664 Oct 29 02:54:11.627314 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 811/1796] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:09 2022] GET /compute/v2.1/images/cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d => generated 1424 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:11.632641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20c7c1a7-53aa-4342-b361-99eaf051d73b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:11.634567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8b3a38aa-572b-4653-a207-63dba0293ff0 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1991900967"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:11.635369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8b3a38aa-572b-4653-a207-63dba0293ff0 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 2d032bdd-de0f-40dc-88c6-afc41eab6770] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:11.641079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20c7c1a7-53aa-4342-b361-99eaf051d73b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:11.641788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20c7c1a7-53aa-4342-b361-99eaf051d73b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:11.642673 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20c7c1a7-53aa-4342-b361-99eaf051d73b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:11.643252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20c7c1a7-53aa-4342-b361-99eaf051d73b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:11.643600 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20c7c1a7-53aa-4342-b361-99eaf051d73b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:11.645534 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b3a38aa-572b-4653-a207-63dba0293ff0 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:11.646431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b3a38aa-572b-4653-a207-63dba0293ff0 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:11.647208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b3a38aa-572b-4653-a207-63dba0293ff0 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:11.648340 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b3a38aa-572b-4653-a207-63dba0293ff0 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:11.649149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b3a38aa-572b-4653-a207-63dba0293ff0 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:11.649899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b3a38aa-572b-4653-a207-63dba0293ff0 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:12.011202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-20c7c1a7-53aa-4342-b361-99eaf051d73b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:12.042043 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-20c7c1a7-53aa-4342-b361-99eaf051d73b tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b" status: 200 len: 1334 microversion: 2.1 time: 0.438751 Oct 29 02:54:12.066564 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 986/1797] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:11 2022] GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b => generated 1334 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:12.115289 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-4e71974d-ff30-45ac-9c44-75fa8ce82c03 req-95387d3b-9029-493c-b672-5618549ad42a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc", "name": "network-vif-plugged", "status": "completed", "tag": "79864797-817a-49a1-9e41-46b8d629427a"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:12.133944 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4e71974d-ff30-45ac-9c44-75fa8ce82c03 req-95387d3b-9029-493c-b672-5618549ad42a service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:12.134432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4e71974d-ff30-45ac-9c44-75fa8ce82c03 req-95387d3b-9029-493c-b672-5618549ad42a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:12.135016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4e71974d-ff30-45ac-9c44-75fa8ce82c03 req-95387d3b-9029-493c-b672-5618549ad42a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:12.158877 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-4e71974d-ff30-45ac-9c44-75fa8ce82c03 req-95387d3b-9029-493c-b672-5618549ad42a service nova] Creating event network-vif-plugged:79864797-817a-49a1-9e41-46b8d629427a for instance c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc on n-h2-862967-2 Oct 29 02:54:12.241727 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.network.security_group_api [None req-8b3a38aa-572b-4653-a207-63dba0293ff0 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Adding security group e183d567-92ac-4d25-a7d8-2671070de771 to port 79d33b3a-675b-49b7-a4c4-807ba304e4d4 Oct 29 02:54:12.297091 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-4e71974d-ff30-45ac-9c44-75fa8ce82c03 req-95387d3b-9029-493c-b672-5618549ad42a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214298 Oct 29 02:54:12.298268 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 987/1798] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:12.315066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-6253929d-3011-44c7-8196-e422818bcb06 req-f320b545-aeab-46c5-84ff-232f9c91322d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d032bdd-de0f-40dc-88c6-afc41eab6770", "tag": "79d33b3a-675b-49b7-a4c4-807ba304e4d4"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:12.367719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-6253929d-3011-44c7-8196-e422818bcb06 req-f320b545-aeab-46c5-84ff-232f9c91322d service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:12.369978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-6253929d-3011-44c7-8196-e422818bcb06 req-f320b545-aeab-46c5-84ff-232f9c91322d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:12.371495 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-6253929d-3011-44c7-8196-e422818bcb06 req-f320b545-aeab-46c5-84ff-232f9c91322d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:12.431594 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-6253929d-3011-44c7-8196-e422818bcb06 req-f320b545-aeab-46c5-84ff-232f9c91322d service nova] Creating event network-changed:79d33b3a-675b-49b7-a4c4-807ba304e4d4 for instance 2d032bdd-de0f-40dc-88c6-afc41eab6770 on n-h1-862967-2 Oct 29 02:54:12.449386 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-6253929d-3011-44c7-8196-e422818bcb06 req-f320b545-aeab-46c5-84ff-232f9c91322d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148751 Oct 29 02:54:12.451999 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 988/1799] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:12.468981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-40238aa2-20ab-4b8f-b97d-af8cfd237712 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:12.469812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-40238aa2-20ab-4b8f-b97d-af8cfd237712 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:12.488728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40238aa2-20ab-4b8f-b97d-af8cfd237712 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:12.498010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40238aa2-20ab-4b8f-b97d-af8cfd237712 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:12.499212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40238aa2-20ab-4b8f-b97d-af8cfd237712 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:12.500306 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40238aa2-20ab-4b8f-b97d-af8cfd237712 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:12.500966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40238aa2-20ab-4b8f-b97d-af8cfd237712 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:12.501572 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40238aa2-20ab-4b8f-b97d-af8cfd237712 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:13.292376 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-40238aa2-20ab-4b8f-b97d-af8cfd237712 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:13.320060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-40238aa2-20ab-4b8f-b97d-af8cfd237712 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:13.326719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-40238aa2-20ab-4b8f-b97d-af8cfd237712 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:13.330438 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-40238aa2-20ab-4b8f-b97d-af8cfd237712 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1879 microversion: 2.42 time: 0.875103 Oct 29 02:54:13.331196 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 989/1800] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:12 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1879 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:14.035865 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8b3a38aa-572b-4653-a207-63dba0293ff0 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "POST /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770/action" status: 202 len: 0 microversion: 2.1 time: 2.406570 Oct 29 02:54:14.036920 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 812/1801] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:54:11 2022] POST /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770/action => generated 0 bytes in 2409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:54:14.038507 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-772fa07f-cbec-41b0-a088-23bcf24855dd tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Action: 'update', calling method: .version_select at 0x7ff05c12c160>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:14.042444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-772fa07f-cbec-41b0-a088-23bcf24855dd tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:14.042936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-772fa07f-cbec-41b0-a088-23bcf24855dd tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:14.043375 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-772fa07f-cbec-41b0-a088-23bcf24855dd tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:14.065568 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0756c99e-926b-419e-86b6-ff778d3bb3c8 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff0537e2790>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:14.102354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-772fa07f-cbec-41b0-a088-23bcf24855dd tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:14.102842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-772fa07f-cbec-41b0-a088-23bcf24855dd tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:14.103277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-772fa07f-cbec-41b0-a088-23bcf24855dd tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:14.144714 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-772fa07f-cbec-41b0-a088-23bcf24855dd tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] HTTP exception thrown: Service f922333a-b84d-4a49-aa8e-e1d8a428e212 could not be found. Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-772fa07f-cbec-41b0-a088-23bcf24855dd tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Request method failure captured: Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: request: PUT /compute/v2.1/os-services/f922333a-b84d-4a49-aa8e-e1d8a428e212 HTTP/1.1 Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 56 Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJXSpJfHELR0wSMpJ571DOl1HsbtG_rVZkgIDszIVOIdTd1j_tYWbK0fOC-Q6oaQFpdnXtenvjti0B1O09HlgCTyn0X62Bqhh1w-1-LYlEGPJ9_Gd6tL8LSXtq8A_wS66bkNGCV8w0z7zUeLMgtPYvK3-0BnoxxdsV57_qMj1_0sR0A Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: X-Openstack-Nova-Api-Version: 2.53 Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 259be50292934c6982ce8871dd1d0de3 Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-778929873 Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: X-Role: admin,reader,member Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: admin,reader,member Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/259be50292934c6982ce8871dd1d0de3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/259be50292934c6982ce8871dd1d0de3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_259be50292934c6982ce8871dd1d0de3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/259be50292934c6982ce8871dd1d0de3"}]}] Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-778929873 Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 259be50292934c6982ce8871dd1d0de3 Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-778929873 Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: f7ed00abf2a741eca3034af7a375c078 Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: exception: Service f922333a-b84d-4a49-aa8e-e1d8a428e212 could not be found. Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'f922333a-b84d-4a49-aa8e-e1d8a428e212', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service f922333a-b84d-4a49-aa8e-e1d8a428e212 could not be found. Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:54:14.158342 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:54:14.163363 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 29 02:54:14.163363 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:54:14.163363 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service f922333a-b84d-4a49-aa8e-e1d8a428e212 could not be found. Oct 29 02:54:14.163363 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:14.163363 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:14.163363 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:14.163363 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:14.163363 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:14.163363 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:14.163363 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:54:14.163363 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:54:14.163363 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service f922333a-b84d-4a49-aa8e-e1d8a428e212 could not be found. Oct 29 02:54:14.163363 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:14.163363 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-772fa07f-cbec-41b0-a088-23bcf24855dd tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Returning 404 to user: Service f922333a-b84d-4a49-aa8e-e1d8a428e212 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:54:14.165928 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-772fa07f-cbec-41b0-a088-23bcf24855dd tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-services/f922333a-b84d-4a49-aa8e-e1d8a428e212" status: 404 len: 110 microversion: 2.53 time: 0.833572 Oct 29 02:54:14.170533 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 990/1802] 10.222.0.46 () {62 vars in 1309 bytes} [Sat Oct 29 02:54:13 2022] PUT /compute/v2.1/os-services/f922333a-b84d-4a49-aa8e-e1d8a428e212 => generated 110 bytes in 838 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:54:14.181355 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0756c99e-926b-419e-86b6-ff778d3bb3c8 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/3588b1c1-f15e-425c-8711-d112abef0137" status: 200 len: 1461 microversion: 2.1 time: 0.142829 Oct 29 02:54:14.185774 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 813/1803] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:14 2022] GET /compute/v2.1/images/3588b1c1-f15e-425c-8711-d112abef0137 => generated 1461 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:14.191622 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e10a1a6e-5055-4894-b54e-e828c19722d9 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff05c227700>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:14.212959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c8397d21-88c0-48d0-8831-67bda2c13d9f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:14.215262 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c8397d21-88c0-48d0-8831-67bda2c13d9f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 5b856917-a04b-436d-8f9f-5ce0492bc28b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:14.238118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8397d21-88c0-48d0-8831-67bda2c13d9f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:14.246440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8397d21-88c0-48d0-8831-67bda2c13d9f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:14.247225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8397d21-88c0-48d0-8831-67bda2c13d9f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:14.250458 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8397d21-88c0-48d0-8831-67bda2c13d9f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:14.253791 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8397d21-88c0-48d0-8831-67bda2c13d9f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:14.255036 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8397d21-88c0-48d0-8831-67bda2c13d9f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:14.292230 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e10a1a6e-5055-4894-b54e-e828c19722d9 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d" status: 200 len: 1424 microversion: 2.1 time: 0.117820 Oct 29 02:54:14.293151 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 991/1804] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:14 2022] GET /compute/v2.1/images/cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d => generated 1424 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:14.312097 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-da5d417f-9b6d-4f33-ae78-393ae5ba7211 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:14.312779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-da5d417f-9b6d-4f33-ae78-393ae5ba7211 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 2d032bdd-de0f-40dc-88c6-afc41eab6770] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:14.341900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:14.344136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da5d417f-9b6d-4f33-ae78-393ae5ba7211 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:14.361713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da5d417f-9b6d-4f33-ae78-393ae5ba7211 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:14.362586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da5d417f-9b6d-4f33-ae78-393ae5ba7211 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:14.363889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da5d417f-9b6d-4f33-ae78-393ae5ba7211 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:14.364577 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da5d417f-9b6d-4f33-ae78-393ae5ba7211 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:14.365228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da5d417f-9b6d-4f33-ae78-393ae5ba7211 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:14.943627 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-da5d417f-9b6d-4f33-ae78-393ae5ba7211 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.648869 Oct 29 02:54:14.945092 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 992/1805] 10.222.0.46 () {58 vars in 1293 bytes} [Sat Oct 29 02:54:14 2022] GET /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770/os-security-groups => generated 1158 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:14.952401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-023be088-50e1-4e2c-94bf-ce10b88bd273 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Action: 'update', calling method: .version_select at 0x7ff053a0d790>, body: {"status": "disabled"} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:14.966974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-023be088-50e1-4e2c-94bf-ce10b88bd273 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:14.970744 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-023be088-50e1-4e2c-94bf-ce10b88bd273 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:14.974160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-023be088-50e1-4e2c-94bf-ce10b88bd273 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:14.993659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-023be088-50e1-4e2c-94bf-ce10b88bd273 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:14.999764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-023be088-50e1-4e2c-94bf-ce10b88bd273 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:15.003278 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-023be088-50e1-4e2c-94bf-ce10b88bd273 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:15.033966 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-023be088-50e1-4e2c-94bf-ce10b88bd273 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] HTTP exception thrown: Service f922333a-b84d-4a49-aa8e-e1d8a428e212 could not be found. Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-023be088-50e1-4e2c-94bf-ce10b88bd273 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Request method failure captured: Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: request: PUT /compute/v2.1/os-services/f922333a-b84d-4a49-aa8e-e1d8a428e212 HTTP/1.1 Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 22 Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJXSpJfHELR0wSMpJ571DOl1HsbtG_rVZkgIDszIVOIdTd1j_tYWbK0fOC-Q6oaQFpdnXtenvjti0B1O09HlgCTyn0X62Bqhh1w-1-LYlEGPJ9_Gd6tL8LSXtq8A_wS66bkNGCV8w0z7zUeLMgtPYvK3-0BnoxxdsV57_qMj1_0sR0A Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: X-Openstack-Nova-Api-Version: 2.53 Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 259be50292934c6982ce8871dd1d0de3 Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-778929873 Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: X-Role: admin,reader,member Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: admin,reader,member Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/259be50292934c6982ce8871dd1d0de3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/259be50292934c6982ce8871dd1d0de3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_259be50292934c6982ce8871dd1d0de3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/259be50292934c6982ce8871dd1d0de3"}]}] Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-778929873 Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 259be50292934c6982ce8871dd1d0de3 Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-778929873 Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: f7ed00abf2a741eca3034af7a375c078 Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: {"status": "disabled"} Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: exception: Service f922333a-b84d-4a49-aa8e-e1d8a428e212 could not be found. Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'f922333a-b84d-4a49-aa8e-e1d8a428e212', 'body': {'status': 'disabled'}} Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service f922333a-b84d-4a49-aa8e-e1d8a428e212 could not be found. Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:54:15.041722 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:54:15.047333 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 29 02:54:15.047333 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:54:15.047333 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service f922333a-b84d-4a49-aa8e-e1d8a428e212 could not be found. Oct 29 02:54:15.047333 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:15.047333 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:15.047333 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:15.047333 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:15.047333 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:15.047333 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:15.047333 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:54:15.047333 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:54:15.047333 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service f922333a-b84d-4a49-aa8e-e1d8a428e212 could not be found. Oct 29 02:54:15.047333 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:15.050546 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-023be088-50e1-4e2c-94bf-ce10b88bd273 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Returning 404 to user: Service f922333a-b84d-4a49-aa8e-e1d8a428e212 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:54:15.059768 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-023be088-50e1-4e2c-94bf-ce10b88bd273 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-services/f922333a-b84d-4a49-aa8e-e1d8a428e212" status: 404 len: 110 microversion: 2.53 time: 0.107474 Oct 29 02:54:15.061985 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 993/1806] 10.222.0.46 () {62 vars in 1309 bytes} [Sat Oct 29 02:54:14 2022] PUT /compute/v2.1/os-services/f922333a-b84d-4a49-aa8e-e1d8a428e212 => generated 110 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:54:15.075563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fb3850a9-fcec-45f5-bea3-eee1a87f46ed tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:15.088943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fb3850a9-fcec-45f5-bea3-eee1a87f46ed tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 1123b300-f298-4071-bff4-8ddc088ee57f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:15.130809 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fb3850a9-fcec-45f5-bea3-eee1a87f46ed tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:15.131515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fb3850a9-fcec-45f5-bea3-eee1a87f46ed tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:15.143841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fb3850a9-fcec-45f5-bea3-eee1a87f46ed tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:15.146196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fb3850a9-fcec-45f5-bea3-eee1a87f46ed tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:15.154160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fb3850a9-fcec-45f5-bea3-eee1a87f46ed tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:15.155639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fb3850a9-fcec-45f5-bea3-eee1a87f46ed tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:15.378417 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c8397d21-88c0-48d0-8831-67bda2c13d9f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:15.387884 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c8397d21-88c0-48d0-8831-67bda2c13d9f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b" status: 200 len: 1334 microversion: 2.1 time: 1.199150 Oct 29 02:54:15.392679 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 814/1807] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:14 2022] GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b => generated 1334 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:15.404862 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-68c48ba8-67bc-477f-9320-1990d768b62b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:15.405204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-68c48ba8-67bc-477f-9320-1990d768b62b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:15.427938 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68c48ba8-67bc-477f-9320-1990d768b62b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:15.428457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68c48ba8-67bc-477f-9320-1990d768b62b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:15.432630 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68c48ba8-67bc-477f-9320-1990d768b62b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:15.433733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68c48ba8-67bc-477f-9320-1990d768b62b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:15.435214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68c48ba8-67bc-477f-9320-1990d768b62b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:15.436617 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68c48ba8-67bc-477f-9320-1990d768b62b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:15.704275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fb3850a9-fcec-45f5-bea3-eee1a87f46ed tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844dbc8e54d349ea93c632c54909a718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b7aa3004d94c5a8cf87d5f4d006a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:15.722006 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fb3850a9-fcec-45f5-bea3-eee1a87f46ed tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f" status: 200 len: 1467 microversion: 2.1 time: 0.657619 Oct 29 02:54:15.723499 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 994/1808] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:15 2022] GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f => generated 1467 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:15.737954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-8bba1fda-8e07-47a5-8a86-e29d5151ca46 req-9d505a47-73e9-431c-a211-4eafa1bb1ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0c20eea-c322-4d8e-bafd-3b3b01c5d142", "tag": "0fb3a164-1f7e-48a7-90ce-0c06851aae03"}, {"name": "network-changed", "server_uuid": "f0c20eea-c322-4d8e-bafd-3b3b01c5d142", "tag": "20f58ad8-3fa0-481e-8e36-08b604fdf588"}, {"name": "network-changed", "server_uuid": "2d032bdd-de0f-40dc-88c6-afc41eab6770", "tag": "79d33b3a-675b-49b7-a4c4-807ba304e4d4"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:15.766516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8bba1fda-8e07-47a5-8a86-e29d5151ca46 req-9d505a47-73e9-431c-a211-4eafa1bb1ad2 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:15.768134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8bba1fda-8e07-47a5-8a86-e29d5151ca46 req-9d505a47-73e9-431c-a211-4eafa1bb1ad2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:15.772435 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8bba1fda-8e07-47a5-8a86-e29d5151ca46 req-9d505a47-73e9-431c-a211-4eafa1bb1ad2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:15.817845 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-8bba1fda-8e07-47a5-8a86-e29d5151ca46 req-9d505a47-73e9-431c-a211-4eafa1bb1ad2 service nova] Creating event network-changed:0fb3a164-1f7e-48a7-90ce-0c06851aae03 for instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 on n-h2-862967-2 Oct 29 02:54:15.824352 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-8bba1fda-8e07-47a5-8a86-e29d5151ca46 req-9d505a47-73e9-431c-a211-4eafa1bb1ad2 service nova] Creating event network-changed:20f58ad8-3fa0-481e-8e36-08b604fdf588 for instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 on n-h2-862967-2 Oct 29 02:54:15.825369 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-8bba1fda-8e07-47a5-8a86-e29d5151ca46 req-9d505a47-73e9-431c-a211-4eafa1bb1ad2 service nova] Creating event network-changed:79d33b3a-675b-49b7-a4c4-807ba304e4d4 for instance 2d032bdd-de0f-40dc-88c6-afc41eab6770 on n-h1-862967-2 Oct 29 02:54:15.846452 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-8bba1fda-8e07-47a5-8a86-e29d5151ca46 req-9d505a47-73e9-431c-a211-4eafa1bb1ad2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.120235 Oct 29 02:54:15.849567 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 995/1809] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:15.861169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e9478827-7924-40b1-a196-24a078e3dd04 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Action: 'create', calling method: .version_select at 0x7ff05c1490d0>, body: {"security_group": {"name": " tempest-securitygroup -1464842918 ", "description": "tempest-description-844775582"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:16.253009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-68c48ba8-67bc-477f-9320-1990d768b62b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:16.268809 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-68c48ba8-67bc-477f-9320-1990d768b62b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:16.270716 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-68c48ba8-67bc-477f-9320-1990d768b62b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:16.277207 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-68c48ba8-67bc-477f-9320-1990d768b62b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1879 microversion: 2.42 time: 0.882377 Oct 29 02:54:16.286133 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 815/1810] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:15 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1879 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:16.301441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-437327a7-6210-4135-ae4a-ac7dc5c988cf tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Action: 'update', calling method: .version_select at 0x7ff05370c550>, body: {"status": "enabled"} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:16.310477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-437327a7-6210-4135-ae4a-ac7dc5c988cf tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:16.311400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-437327a7-6210-4135-ae4a-ac7dc5c988cf tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:16.312104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-437327a7-6210-4135-ae4a-ac7dc5c988cf tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:16.353951 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-437327a7-6210-4135-ae4a-ac7dc5c988cf tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:16.356744 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-437327a7-6210-4135-ae4a-ac7dc5c988cf tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:16.359038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-437327a7-6210-4135-ae4a-ac7dc5c988cf tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:16.372972 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-437327a7-6210-4135-ae4a-ac7dc5c988cf tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] HTTP exception thrown: Service f922333a-b84d-4a49-aa8e-e1d8a428e212 could not be found. Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-437327a7-6210-4135-ae4a-ac7dc5c988cf tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Request method failure captured: Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: request: PUT /compute/v2.1/os-services/f922333a-b84d-4a49-aa8e-e1d8a428e212 HTTP/1.1 Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 21 Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJXSpJfHELR0wSMpJ571DOl1HsbtG_rVZkgIDszIVOIdTd1j_tYWbK0fOC-Q6oaQFpdnXtenvjti0B1O09HlgCTyn0X62Bqhh1w-1-LYlEGPJ9_Gd6tL8LSXtq8A_wS66bkNGCV8w0z7zUeLMgtPYvK3-0BnoxxdsV57_qMj1_0sR0A Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: X-Openstack-Nova-Api-Version: 2.53 Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 259be50292934c6982ce8871dd1d0de3 Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-778929873 Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: X-Role: admin,reader,member Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: admin,reader,member Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/259be50292934c6982ce8871dd1d0de3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/259be50292934c6982ce8871dd1d0de3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_259be50292934c6982ce8871dd1d0de3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/259be50292934c6982ce8871dd1d0de3"}]}] Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-778929873 Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 259be50292934c6982ce8871dd1d0de3 Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-778929873 Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: f7ed00abf2a741eca3034af7a375c078 Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: {"status": "enabled"} Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: exception: Service f922333a-b84d-4a49-aa8e-e1d8a428e212 could not be found. Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'f922333a-b84d-4a49-aa8e-e1d8a428e212', 'body': {'status': 'enabled'}} Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service f922333a-b84d-4a49-aa8e-e1d8a428e212 could not be found. Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:54:16.377308 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:54:16.383785 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 29 02:54:16.383785 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:54:16.383785 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service f922333a-b84d-4a49-aa8e-e1d8a428e212 could not be found. Oct 29 02:54:16.383785 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:16.383785 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:16.383785 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:16.383785 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:16.383785 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:16.383785 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:16.383785 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:54:16.383785 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:54:16.383785 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service f922333a-b84d-4a49-aa8e-e1d8a428e212 could not be found. Oct 29 02:54:16.383785 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:16.388244 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-437327a7-6210-4135-ae4a-ac7dc5c988cf tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Returning 404 to user: Service f922333a-b84d-4a49-aa8e-e1d8a428e212 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:54:16.398598 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-437327a7-6210-4135-ae4a-ac7dc5c988cf tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-services/f922333a-b84d-4a49-aa8e-e1d8a428e212" status: 404 len: 110 microversion: 2.53 time: 0.100467 Oct 29 02:54:16.399903 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 816/1811] 10.222.0.46 () {62 vars in 1309 bytes} [Sat Oct 29 02:54:16 2022] PUT /compute/v2.1/os-services/f922333a-b84d-4a49-aa8e-e1d8a428e212 => generated 110 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:54:16.407907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7c8181f7-3993-494c-9e61-ebaf95f75431 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff053725280>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:16.505563 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7c8181f7-3993-494c-9e61-ebaf95f75431 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d" status: 200 len: 1424 microversion: 2.1 time: 0.104193 Oct 29 02:54:16.506549 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 817/1812] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:16 2022] GET /compute/v2.1/images/cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d => generated 1424 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:16.522280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ea939658-7825-4f95-b300-b8275aca23a1 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1882458455"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:16.529638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ea939658-7825-4f95-b300-b8275aca23a1 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:16.547257 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea939658-7825-4f95-b300-b8275aca23a1 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:16.547755 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea939658-7825-4f95-b300-b8275aca23a1 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:16.548215 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea939658-7825-4f95-b300-b8275aca23a1 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:16.549138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea939658-7825-4f95-b300-b8275aca23a1 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:16.549613 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea939658-7825-4f95-b300-b8275aca23a1 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:16.550074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea939658-7825-4f95-b300-b8275aca23a1 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:16.763907 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e9478827-7924-40b1-a196-24a078e3dd04 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.912502 Oct 29 02:54:16.764948 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 996/1813] 10.222.0.46 () {60 vars in 1180 bytes} [Sat Oct 29 02:54:15 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:16.770498 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-68576864-44fb-455b-94ab-b7336ae734d5 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:16.781827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68576864-44fb-455b-94ab-b7336ae734d5 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:16.783538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68576864-44fb-455b-94ab-b7336ae734d5 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:16.785308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68576864-44fb-455b-94ab-b7336ae734d5 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:16.789766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68576864-44fb-455b-94ab-b7336ae734d5 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:16.791056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68576864-44fb-455b-94ab-b7336ae734d5 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:16.793106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68576864-44fb-455b-94ab-b7336ae734d5 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:16.878556 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-68576864-44fb-455b-94ab-b7336ae734d5 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.110481 Oct 29 02:54:16.892775 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 997/1814] 10.222.0.46 () {60 vars in 1178 bytes} [Sat Oct 29 02:54:16 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:16.924484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f8edfd37-760b-42ab-b3a4-91c6321c97ab tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:16.929223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f8edfd37-760b-42ab-b3a4-91c6321c97ab tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 5b856917-a04b-436d-8f9f-5ce0492bc28b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:16.954666 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f8edfd37-760b-42ab-b3a4-91c6321c97ab tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:16.955259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f8edfd37-760b-42ab-b3a4-91c6321c97ab tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:16.955766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f8edfd37-760b-42ab-b3a4-91c6321c97ab tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:16.965098 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f8edfd37-760b-42ab-b3a4-91c6321c97ab tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:16.965703 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f8edfd37-760b-42ab-b3a4-91c6321c97ab tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:16.966203 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f8edfd37-760b-42ab-b3a4-91c6321c97ab tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:17.177138 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ea939658-7825-4f95-b300-b8275aca23a1 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "POST /compute/v2.1/servers/0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd/action" status: 202 len: 0 microversion: 2.1 time: 0.668455 Oct 29 02:54:17.177630 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 818/1815] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:54:16 2022] POST /compute/v2.1/servers/0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd/action => generated 0 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 02:54:17.209080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-575a0bf8-89be-46e7-8881-88a99ebeb68d tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '.version_select at 0x7ff0536e0670>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:17.544718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f8edfd37-760b-42ab-b3a4-91c6321c97ab tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:17.558750 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f8edfd37-760b-42ab-b3a4-91c6321c97ab tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b" status: 200 len: 1334 microversion: 2.1 time: 0.662686 Oct 29 02:54:17.562387 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 998/1816] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:16 2022] GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b => generated 1334 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:17.574816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b9db2685-90c4-4065-b64c-ae23580c78b5 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:17.593285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b9db2685-90c4-4065-b64c-ae23580c78b5 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:17.594085 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b9db2685-90c4-4065-b64c-ae23580c78b5 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:17.595371 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b9db2685-90c4-4065-b64c-ae23580c78b5 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:17.597683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b9db2685-90c4-4065-b64c-ae23580c78b5 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:17.600007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b9db2685-90c4-4065-b64c-ae23580c78b5 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:17.601506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b9db2685-90c4-4065-b64c-ae23580c78b5 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:17.651128 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b9db2685-90c4-4065-b64c-ae23580c78b5 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.087362 Oct 29 02:54:17.652048 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 999/1817] 10.222.0.46 () {60 vars in 1211 bytes} [Sat Oct 29 02:54:17 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:17.672424 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2d95f5df-76e5-4cdc-a158-8b1e030705a1 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c13da60>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:17.697106 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-575a0bf8-89be-46e7-8881-88a99ebeb68d tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/8de0e040-dfd8-47d0-9ef9-578e91d01f6b" status: 200 len: 223 microversion: 2.1 time: 0.518166 Oct 29 02:54:17.697997 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 819/1818] 10.222.0.46 () {58 vars in 1269 bytes} [Sat Oct 29 02:54:17 2022] GET /compute/v2.1/os-security-groups/8de0e040-dfd8-47d0-9ef9-578e91d01f6b => generated 223 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:17.702876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e5c93d6b-ed3e-4065-a08a-b3d141d5d767 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:17.703609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e5c93d6b-ed3e-4065-a08a-b3d141d5d767 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:17.724022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5c93d6b-ed3e-4065-a08a-b3d141d5d767 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:17.725756 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5c93d6b-ed3e-4065-a08a-b3d141d5d767 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:17.736868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5c93d6b-ed3e-4065-a08a-b3d141d5d767 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:17.738021 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5c93d6b-ed3e-4065-a08a-b3d141d5d767 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:17.741627 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5c93d6b-ed3e-4065-a08a-b3d141d5d767 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:17.744356 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2d95f5df-76e5-4cdc-a158-8b1e030705a1 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/0cfc4d93-8e9d-42c7-bc33-0e28967c8d63" status: 200 len: 1453 microversion: 2.1 time: 0.090859 Oct 29 02:54:17.745382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5c93d6b-ed3e-4065-a08a-b3d141d5d767 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:17.754348 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1000/1819] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:17 2022] GET /compute/v2.1/images/0cfc4d93-8e9d-42c7-bc33-0e28967c8d63 => generated 1453 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:17.760218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4575f1bb-1cc5-4975-bf2d-ba22f9b40505 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff05c098af0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:17.833454 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4575f1bb-1cc5-4975-bf2d-ba22f9b40505 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d" status: 200 len: 1424 microversion: 2.1 time: 0.077814 Oct 29 02:54:17.844768 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1001/1820] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:17 2022] GET /compute/v2.1/images/cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d => generated 1424 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:17.851066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-417d7d7b-01f3-42ea-b408-aedf6c3ba05f req-9b920391-eec6-4779-8ad3-c64c01b167a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b856917-a04b-436d-8f9f-5ce0492bc28b", "name": "network-vif-plugged", "status": "completed", "tag": "deb0da4d-e3f5-449d-a854-c95360500d9e"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:17.869681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-417d7d7b-01f3-42ea-b408-aedf6c3ba05f req-9b920391-eec6-4779-8ad3-c64c01b167a2 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:17.870513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-417d7d7b-01f3-42ea-b408-aedf6c3ba05f req-9b920391-eec6-4779-8ad3-c64c01b167a2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:17.871160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-417d7d7b-01f3-42ea-b408-aedf6c3ba05f req-9b920391-eec6-4779-8ad3-c64c01b167a2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:17.892948 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-417d7d7b-01f3-42ea-b408-aedf6c3ba05f req-9b920391-eec6-4779-8ad3-c64c01b167a2 service nova] Creating event network-vif-plugged:deb0da4d-e3f5-449d-a854-c95360500d9e for instance 5b856917-a04b-436d-8f9f-5ce0492bc28b on n-h1-862967-2 Oct 29 02:54:17.899859 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-417d7d7b-01f3-42ea-b408-aedf6c3ba05f req-9b920391-eec6-4779-8ad3-c64c01b167a2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053363 Oct 29 02:54:17.900815 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1002/1821] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:17.909210 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6e6f760a-3537-4e1c-b96c-861d83bb5cdf tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:17.915414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e6f760a-3537-4e1c-b96c-861d83bb5cdf tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:17.916341 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e6f760a-3537-4e1c-b96c-861d83bb5cdf tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:17.917100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e6f760a-3537-4e1c-b96c-861d83bb5cdf tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:17.919087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e6f760a-3537-4e1c-b96c-861d83bb5cdf tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:17.922493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e6f760a-3537-4e1c-b96c-861d83bb5cdf tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:17.923442 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e6f760a-3537-4e1c-b96c-861d83bb5cdf tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:17.964803 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6e6f760a-3537-4e1c-b96c-861d83bb5cdf tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.062342 Oct 29 02:54:17.966030 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1003/1822] 10.222.0.46 () {60 vars in 1178 bytes} [Sat Oct 29 02:54:17 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:17.972575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6ac90e67-b10f-46c2-bd4e-44e9dc0b86c5 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '.version_select at 0x7ff05c24b9d0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:18.411604 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e5c93d6b-ed3e-4065-a08a-b3d141d5d767 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:18.429638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e5c93d6b-ed3e-4065-a08a-b3d141d5d767 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:18.434018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e5c93d6b-ed3e-4065-a08a-b3d141d5d767 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:18.438819 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e5c93d6b-ed3e-4065-a08a-b3d141d5d767 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1879 microversion: 2.42 time: 0.737730 Oct 29 02:54:18.439793 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 820/1823] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:17 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1879 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:18.454100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-a599c38b-6fe7-4fd8-be81-92f9a12b7a5f req-b2789915-efa0-4614-a635-d1220acae169 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0c20eea-c322-4d8e-bafd-3b3b01c5d142", "tag": "a3cf680f-1b1f-4418-86d3-29bf244d0bce"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:18.474067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a599c38b-6fe7-4fd8-be81-92f9a12b7a5f req-b2789915-efa0-4614-a635-d1220acae169 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:18.474781 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a599c38b-6fe7-4fd8-be81-92f9a12b7a5f req-b2789915-efa0-4614-a635-d1220acae169 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:18.475369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a599c38b-6fe7-4fd8-be81-92f9a12b7a5f req-b2789915-efa0-4614-a635-d1220acae169 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:18.492223 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-a599c38b-6fe7-4fd8-be81-92f9a12b7a5f req-b2789915-efa0-4614-a635-d1220acae169 service nova] Creating event network-changed:a3cf680f-1b1f-4418-86d3-29bf244d0bce for instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 on n-h2-862967-2 Oct 29 02:54:18.507323 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-a599c38b-6fe7-4fd8-be81-92f9a12b7a5f req-b2789915-efa0-4614-a635-d1220acae169 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066090 Oct 29 02:54:18.507938 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 821/1824] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:18.530944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e0b80f62-7aca-4943-a4e6-ca2283dd9cf9 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:18.535161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0b80f62-7aca-4943-a4e6-ca2283dd9cf9 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:18.535649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0b80f62-7aca-4943-a4e6-ca2283dd9cf9 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:18.536084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0b80f62-7aca-4943-a4e6-ca2283dd9cf9 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:18.536836 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0b80f62-7aca-4943-a4e6-ca2283dd9cf9 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:18.559480 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0b80f62-7aca-4943-a4e6-ca2283dd9cf9 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:18.563451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0b80f62-7aca-4943-a4e6-ca2283dd9cf9 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:18.671549 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e0b80f62-7aca-4943-a4e6-ca2283dd9cf9 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?host=n-d-862967-2&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.162240 Oct 29 02:54:18.673298 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 822/1825] 10.222.0.46 () {60 vars in 1235 bytes} [Sat Oct 29 02:54:18 2022] GET /compute/v2.1/os-services?host=n-d-862967-2&binary=xxx => generated 16 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:18.680939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4932b5bf-8257-404a-bea0-8f572b693e9a tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:18.682159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4932b5bf-8257-404a-bea0-8f572b693e9a tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 5b856917-a04b-436d-8f9f-5ce0492bc28b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:18.692173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4932b5bf-8257-404a-bea0-8f572b693e9a tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:18.693382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4932b5bf-8257-404a-bea0-8f572b693e9a tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:18.694278 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4932b5bf-8257-404a-bea0-8f572b693e9a tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:18.695376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4932b5bf-8257-404a-bea0-8f572b693e9a tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:18.696194 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4932b5bf-8257-404a-bea0-8f572b693e9a tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:18.697460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4932b5bf-8257-404a-bea0-8f572b693e9a tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:19.074016 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6ac90e67-b10f-46c2-bd4e-44e9dc0b86c5 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/8de0e040-dfd8-47d0-9ef9-578e91d01f6b" status: 202 len: 0 microversion: 2.1 time: 1.106554 Oct 29 02:54:19.075345 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1004/1826] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:54:17 2022] DELETE /compute/v2.1/os-security-groups/8de0e040-dfd8-47d0-9ef9-578e91d01f6b => generated 0 bytes in 1109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:54:19.083434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1542bfc1-f8b0-4f4c-9ea4-527159da8dc1 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:19.091497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1542bfc1-f8b0-4f4c-9ea4-527159da8dc1 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:19.092212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1542bfc1-f8b0-4f4c-9ea4-527159da8dc1 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:19.092849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1542bfc1-f8b0-4f4c-9ea4-527159da8dc1 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:19.095208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1542bfc1-f8b0-4f4c-9ea4-527159da8dc1 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:19.099112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1542bfc1-f8b0-4f4c-9ea4-527159da8dc1 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:19.099784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1542bfc1-f8b0-4f4c-9ea4-527159da8dc1 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:19.206094 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1542bfc1-f8b0-4f4c-9ea4-527159da8dc1 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.128863 Oct 29 02:54:19.206962 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4932b5bf-8257-404a-bea0-8f572b693e9a tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:19.214749 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1005/1827] 10.222.0.46 () {60 vars in 1178 bytes} [Sat Oct 29 02:54:19 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:19.219144 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4932b5bf-8257-404a-bea0-8f572b693e9a tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b" status: 200 len: 1334 microversion: 2.1 time: 0.542395 Oct 29 02:54:19.220827 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 823/1828] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:18 2022] GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b => generated 1334 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:19.230764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d1901fb6-9bca-40dc-95c0-2f800fdd4a12 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c098430>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:19.238659 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b8065531-2b93-4dca-83c2-08714c5da2e1 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff053704f70>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:19.338719 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d1901fb6-9bca-40dc-95c0-2f800fdd4a12 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/0cfc4d93-8e9d-42c7-bc33-0e28967c8d63" status: 200 len: 1453 microversion: 2.1 time: 0.122193 Oct 29 02:54:19.339950 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1006/1829] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:19 2022] GET /compute/v2.1/images/0cfc4d93-8e9d-42c7-bc33-0e28967c8d63 => generated 1453 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:19.355963 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b8065531-2b93-4dca-83c2-08714c5da2e1 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d" status: 200 len: 1424 microversion: 2.1 time: 0.132781 Oct 29 02:54:19.356544 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5518c9dd-f786-4dae-9fad-e89580704dd9 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '.version_select at 0x7ff05c0949d0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:19.365760 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 824/1830] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:19 2022] GET /compute/v2.1/images/cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d => generated 1424 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:19.394576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG neutronclient.v2_0.client [None req-5518c9dd-f786-4dae-9fad-e89580704dd9 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8de0e040-dfd8-47d0-9ef9-578e91d01f6b does not exist", "detail": ""}} {{(pid=127124) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:54:19.395430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.security_group_api [None req-5518c9dd-f786-4dae-9fad-e89580704dd9 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Neutron security group 8de0e040-dfd8-47d0-9ef9-578e91d01f6b not found {{(pid=127124) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 02:54:19.396019 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-5518c9dd-f786-4dae-9fad-e89580704dd9 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] HTTP exception thrown: Security group 8de0e040-dfd8-47d0-9ef9-578e91d01f6b does not exist Oct 29 02:54:19.396019 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-1ea69119-9f16-43ae-8f1c-92b154721d3e'] Oct 29 02:54:19.398253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-264d2036-34ca-4bad-bd51-5119415e6230 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5518c9dd-f786-4dae-9fad-e89580704dd9 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Request method failure captured: Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/os-security-groups/8de0e040-dfd8-47d0-9ef9-578e91d01f6b HTTP/1.1 Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJWyvWNGvIUONB2dldB7pPioEBwKHjHetza4K1fLTtjT_TQMaaZr4Sn7Ypy_ZhXjAwE7ry_UKafzclnlLHflyUJDtnmpn--08xUkjJ2-Rign0-fn1TZL2Hdqa5rKCy6QAStHGO-9e-pn1Lh_D4FvZ1sBFzju6OJDLJ_prG4_rU83xk8 Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/49721a0af93a47d38613f4a588ab1e1a"}]}] Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 971f709818b74757947beafd14f546bf Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: exception: Security group 8de0e040-dfd8-47d0-9ef9-578e91d01f6b does not exist Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-1ea69119-9f16-43ae-8f1c-92b154721d3e'] Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '8de0e040-dfd8-47d0-9ef9-578e91d01f6b'} Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:54:19.398521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8de0e040-dfd8-47d0-9ef9-578e91d01f6b does not exist Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ea69119-9f16-43ae-8f1c-92b154721d3e'] Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8de0e040-dfd8-47d0-9ef9-578e91d01f6b does not exist Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ea69119-9f16-43ae-8f1c-92b154721d3e'] Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8de0e040-dfd8-47d0-9ef9-578e91d01f6b does not exist Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ea69119-9f16-43ae-8f1c-92b154721d3e'] Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8de0e040-dfd8-47d0-9ef9-578e91d01f6b does not exist Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ea69119-9f16-43ae-8f1c-92b154721d3e'] Oct 29 02:54:19.403793 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:19.409563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5518c9dd-f786-4dae-9fad-e89580704dd9 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Returning 404 to user: Security group 8de0e040-dfd8-47d0-9ef9-578e91d01f6b does not exist Oct 29 02:54:19.409563 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-1ea69119-9f16-43ae-8f1c-92b154721d3e'] {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:54:19.409563 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5518c9dd-f786-4dae-9fad-e89580704dd9 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/8de0e040-dfd8-47d0-9ef9-578e91d01f6b" status: 404 len: 194 microversion: 2.1 time: 0.065815 Oct 29 02:54:19.410220 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1007/1831] 10.222.0.46 () {58 vars in 1269 bytes} [Sat Oct 29 02:54:19 2022] GET /compute/v2.1/os-security-groups/8de0e040-dfd8-47d0-9ef9-578e91d01f6b => generated 194 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:54:19.413412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-264d2036-34ca-4bad-bd51-5119415e6230 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:19.415283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-264d2036-34ca-4bad-bd51-5119415e6230 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:19.415811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-264d2036-34ca-4bad-bd51-5119415e6230 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:19.416663 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-264d2036-34ca-4bad-bd51-5119415e6230 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:19.419472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-264d2036-34ca-4bad-bd51-5119415e6230 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:19.420336 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-264d2036-34ca-4bad-bd51-5119415e6230 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:19.448689 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-264d2036-34ca-4bad-bd51-5119415e6230 tempest-ServicesAdminNegativeV253TestJSON-778929873 tempest-ServicesAdminNegativeV253TestJSON-778929873-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.066203 Oct 29 02:54:19.449739 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 825/1832] 10.222.0.46 () {60 vars in 1239 bytes} [Sat Oct 29 02:54:19 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:19.454900 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e38d0a6f-182d-44ff-8289-0a02913d8f47 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Action: 'create', calling method: .version_select at 0x7ff05385b700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1026692013", "description": "tempest-description-315135471"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:19.666214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a36d8129-c993-4b9e-bc18-a7e44108354f tempest-SecurityGroupsNegativeTestJSON-389028235 tempest-SecurityGroupsNegativeTestJSON-389028235-project] Calling method '.version_select at 0x7ff053a0e0d0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:19.715982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG neutronclient.v2_0.client [None req-a36d8129-c993-4b9e-bc18-a7e44108354f tempest-SecurityGroupsNegativeTestJSON-389028235 tempest-SecurityGroupsNegativeTestJSON-389028235-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3ec87d70-fb77-453f-a6af-3642e67949ca does not exist", "detail": ""}} {{(pid=127124) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:54:19.716478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.security_group_api [None req-a36d8129-c993-4b9e-bc18-a7e44108354f tempest-SecurityGroupsNegativeTestJSON-389028235 tempest-SecurityGroupsNegativeTestJSON-389028235-project] Neutron security group 3ec87d70-fb77-453f-a6af-3642e67949ca not found {{(pid=127124) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 02:54:19.717016 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-a36d8129-c993-4b9e-bc18-a7e44108354f tempest-SecurityGroupsNegativeTestJSON-389028235 tempest-SecurityGroupsNegativeTestJSON-389028235-project] HTTP exception thrown: Security group 3ec87d70-fb77-453f-a6af-3642e67949ca does not exist Oct 29 02:54:19.717016 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-23417707-6892-4315-9e5c-15dd39e95924'] Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a36d8129-c993-4b9e-bc18-a7e44108354f tempest-SecurityGroupsNegativeTestJSON-389028235 tempest-SecurityGroupsNegativeTestJSON-389028235-project] Request method failure captured: Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/os-security-groups/3ec87d70-fb77-453f-a6af-3642e67949ca HTTP/1.1 Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJXbLvdYE73jr7R2A07XmpWk8MSPfAKC8n1LTe_ljh2U65oy_6Ndi-MC-khlL_kfKAfI_jTTL1cis2pecvZ7BTgMQxR4t0MGYMctHtlYHeB8xFJ5ah99PrdzTZpJPyGLyCGMiU2oRRLcaH1dZdgdN4Zjb0b3nSq0AlHVs71As9LU7J8 Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 61d04285884b4d1c814b322cfbbe7aeb Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-389028235 Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/61d04285884b4d1c814b322cfbbe7aeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/61d04285884b4d1c814b322cfbbe7aeb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_61d04285884b4d1c814b322cfbbe7aeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/61d04285884b4d1c814b322cfbbe7aeb"}]}] Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-389028235 Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 61d04285884b4d1c814b322cfbbe7aeb Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-389028235 Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-SecurityGroupsNegativeTestJSON-389028235-project Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 362a4f36dc8142578a6ce103e810d422 Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-389028235-project Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: exception: Security group 3ec87d70-fb77-453f-a6af-3642e67949ca does not exist Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-23417707-6892-4315-9e5c-15dd39e95924'] Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '3ec87d70-fb77-453f-a6af-3642e67949ca'} Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:54:19.718983 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3ec87d70-fb77-453f-a6af-3642e67949ca does not exist Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23417707-6892-4315-9e5c-15dd39e95924'] Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3ec87d70-fb77-453f-a6af-3642e67949ca does not exist Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23417707-6892-4315-9e5c-15dd39e95924'] Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3ec87d70-fb77-453f-a6af-3642e67949ca does not exist Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23417707-6892-4315-9e5c-15dd39e95924'] Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3ec87d70-fb77-453f-a6af-3642e67949ca does not exist Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-23417707-6892-4315-9e5c-15dd39e95924'] Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a36d8129-c993-4b9e-bc18-a7e44108354f tempest-SecurityGroupsNegativeTestJSON-389028235 tempest-SecurityGroupsNegativeTestJSON-389028235-project] Returning 404 to user: Security group 3ec87d70-fb77-453f-a6af-3642e67949ca does not exist Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-23417707-6892-4315-9e5c-15dd39e95924'] {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a36d8129-c993-4b9e-bc18-a7e44108354f tempest-SecurityGroupsNegativeTestJSON-389028235 tempest-SecurityGroupsNegativeTestJSON-389028235-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/3ec87d70-fb77-453f-a6af-3642e67949ca" status: 404 len: 194 microversion: 2.1 time: 0.308906 Oct 29 02:54:19.724568 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1008/1833] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:54:19 2022] DELETE /compute/v2.1/os-security-groups/3ec87d70-fb77-453f-a6af-3642e67949ca => generated 194 bytes in 310 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:54:19.879232 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e38d0a6f-182d-44ff-8289-0a02913d8f47 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.428022 Oct 29 02:54:19.879830 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 826/1834] 10.222.0.46 () {60 vars in 1180 bytes} [Sat Oct 29 02:54:19 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:19.885368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-344f946f-66ab-4f9e-adad-8532d2a95faf tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:19.886270 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-344f946f-66ab-4f9e-adad-8532d2a95faf tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:19.903367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-344f946f-66ab-4f9e-adad-8532d2a95faf tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:19.904197 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-344f946f-66ab-4f9e-adad-8532d2a95faf tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:19.904874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-344f946f-66ab-4f9e-adad-8532d2a95faf tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:19.906146 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-344f946f-66ab-4f9e-adad-8532d2a95faf tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:19.909703 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-344f946f-66ab-4f9e-adad-8532d2a95faf tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:19.910537 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-344f946f-66ab-4f9e-adad-8532d2a95faf tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:19.973939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-75a7d3c9-848d-43fe-b889-ffbf955384cf tempest-ServicesAdminNegativeV253TestJSON-1443704021 tempest-ServicesAdminNegativeV253TestJSON-1443704021-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:19.979756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-75a7d3c9-848d-43fe-b889-ffbf955384cf tempest-ServicesAdminNegativeV253TestJSON-1443704021 tempest-ServicesAdminNegativeV253TestJSON-1443704021-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'f38c90b1ee074c159ca659b99c5b64ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9db4bb378434434946ad86aff27273c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-75a7d3c9-848d-43fe-b889-ffbf955384cf tempest-ServicesAdminNegativeV253TestJSON-1443704021 tempest-ServicesAdminNegativeV253TestJSON-1443704021-project] Request method failure captured: Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJXR2awREnBSZLRhA-2nz-3A-tAOWZJN3ji1tg4CS184pi6w6aLzmrZHaEIPjNp-nGBD0bFdx_CcIa67kPVQAMnttCMDKKVpB3a1nkbuNL6ht6SN1uFB23gSDn2asJGKKn_mQji8YPA1WoeLDZwupdb8P-n0mJE6YxCgAp2W71pVHAE Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: X-Openstack-Nova-Api-Version: 2.53 Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: a9db4bb378434434946ad86aff27273c Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1443704021 Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a9db4bb378434434946ad86aff27273c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a9db4bb378434434946ad86aff27273c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a9db4bb378434434946ad86aff27273c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a9db4bb378434434946ad86aff27273c"}]}] Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1443704021 Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: a9db4bb378434434946ad86aff27273c Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1443704021 Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1443704021-project Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: f38c90b1ee074c159ca659b99c5b64ee Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1443704021-project Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: action_args: {} Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 02:54:19.981442 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 29 02:54:19.988852 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:19.988852 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:19.988852 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:19.988852 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:19.988852 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:19.988852 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:19.988852 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 02:54:19.988852 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 02:54:19.988852 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 29 02:54:19.988852 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:19.988852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-75a7d3c9-848d-43fe-b889-ffbf955384cf tempest-ServicesAdminNegativeV253TestJSON-1443704021 tempest-ServicesAdminNegativeV253TestJSON-1443704021-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:54:19.988852 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-75a7d3c9-848d-43fe-b889-ffbf955384cf tempest-ServicesAdminNegativeV253TestJSON-1443704021 tempest-ServicesAdminNegativeV253TestJSON-1443704021-project] 10.222.0.46 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.263609 Oct 29 02:54:19.988852 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1009/1835] 10.222.0.46 () {60 vars in 1178 bytes} [Sat Oct 29 02:54:19 2022] GET /compute/v2.1/os-services => generated 112 bytes in 265 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:54:20.009856 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bbc246ac-9760-4548-9728-4bb92bba3511 tempest-SecurityGroupsNegativeTestJSON-389028235 tempest-SecurityGroupsNegativeTestJSON-389028235-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.022430 Oct 29 02:54:20.018484 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1010/1836] 10.222.0.46 () {58 vars in 1164 bytes} [Sat Oct 29 02:54:19 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 29 02:54:20.035848 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fda82ed5-14e8-4d41-85c0-a4684bcb6337 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Action: 'create', calling method: .version_select at 0x7ff05c149820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-672826080", "description": "tempest-description-497215654"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:20.316740 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-344f946f-66ab-4f9e-adad-8532d2a95faf tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:20.332490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-344f946f-66ab-4f9e-adad-8532d2a95faf tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:20.333977 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-344f946f-66ab-4f9e-adad-8532d2a95faf tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:20.335405 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-344f946f-66ab-4f9e-adad-8532d2a95faf tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1879 microversion: 2.42 time: 0.454084 Oct 29 02:54:20.338054 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 827/1837] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:19 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1879 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:20.354459 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-2693c8d5-0736-4880-aa8a-f2eb6aa748f5 req-9b70bcc3-f476-49ef-b3d7-7297c6db0a7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b856917-a04b-436d-8f9f-5ce0492bc28b", "name": "network-vif-plugged", "status": "completed", "tag": "2195d2bd-e1c7-4a48-9750-1b93573c6a18"}, {"server_uuid": "1123b300-f298-4071-bff4-8ddc088ee57f", "name": "network-vif-unplugged", "status": "completed", "tag": "94ed150d-ec19-4ada-8ecf-11ff8e7dc70e"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:20.379216 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2693c8d5-0736-4880-aa8a-f2eb6aa748f5 req-9b70bcc3-f476-49ef-b3d7-7297c6db0a7c service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:20.384719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2693c8d5-0736-4880-aa8a-f2eb6aa748f5 req-9b70bcc3-f476-49ef-b3d7-7297c6db0a7c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:20.388025 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2693c8d5-0736-4880-aa8a-f2eb6aa748f5 req-9b70bcc3-f476-49ef-b3d7-7297c6db0a7c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:20.423673 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-2693c8d5-0736-4880-aa8a-f2eb6aa748f5 req-9b70bcc3-f476-49ef-b3d7-7297c6db0a7c service nova] Creating event network-vif-plugged:2195d2bd-e1c7-4a48-9750-1b93573c6a18 for instance 5b856917-a04b-436d-8f9f-5ce0492bc28b on n-h1-862967-2 Oct 29 02:54:20.424352 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-2693c8d5-0736-4880-aa8a-f2eb6aa748f5 req-9b70bcc3-f476-49ef-b3d7-7297c6db0a7c service nova] Creating event network-vif-unplugged:94ed150d-ec19-4ada-8ecf-11ff8e7dc70e for instance 1123b300-f298-4071-bff4-8ddc088ee57f on n-h1-862967-2 Oct 29 02:54:20.439974 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-2693c8d5-0736-4880-aa8a-f2eb6aa748f5 req-9b70bcc3-f476-49ef-b3d7-7297c6db0a7c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.099894 Oct 29 02:54:20.441057 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 828/1838] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:20.456339 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d62ddf6d-b1c0-4340-b06d-5424c24c84ca tempest-SecurityGroupsNegativeTestJSON-389028235 tempest-SecurityGroupsNegativeTestJSON-389028235-project] Calling method '.version_select at 0x7ff0536e4820>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:20.971403 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fda82ed5-14e8-4d41-85c0-a4684bcb6337 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.948289 Oct 29 02:54:20.972962 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1011/1839] 10.222.0.46 () {60 vars in 1180 bytes} [Sat Oct 29 02:54:20 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:20.979931 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c1231b28-0aa6-4b10-8348-fae7b2c29739 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:20.984010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c1231b28-0aa6-4b10-8348-fae7b2c29739 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 5b856917-a04b-436d-8f9f-5ce0492bc28b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:20.994527 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1231b28-0aa6-4b10-8348-fae7b2c29739 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:20.995465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1231b28-0aa6-4b10-8348-fae7b2c29739 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:20.996140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1231b28-0aa6-4b10-8348-fae7b2c29739 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:20.997328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1231b28-0aa6-4b10-8348-fae7b2c29739 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:20.998045 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1231b28-0aa6-4b10-8348-fae7b2c29739 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:20.998711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1231b28-0aa6-4b10-8348-fae7b2c29739 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:21.018262 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d62ddf6d-b1c0-4340-b06d-5424c24c84ca tempest-SecurityGroupsNegativeTestJSON-389028235 tempest-SecurityGroupsNegativeTestJSON-389028235-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.572418 Oct 29 02:54:21.018932 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 829/1840] 10.222.0.46 () {58 vars in 1158 bytes} [Sat Oct 29 02:54:20 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:21.037133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-34c098de-3d9c-4775-b72f-b6868eb9b061 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05385b4c0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:21.126554 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-34c098de-3d9c-4775-b72f-b6868eb9b061 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/0cfc4d93-8e9d-42c7-bc33-0e28967c8d63" status: 200 len: 1453 microversion: 2.1 time: 0.105209 Oct 29 02:54:21.135978 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 830/1841] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:21 2022] GET /compute/v2.1/images/0cfc4d93-8e9d-42c7-bc33-0e28967c8d63 => generated 1453 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:21.143850 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-40c5373e-2504-42cf-8957-fdcaa6647ee4 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff05385b700>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:21.268768 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-40c5373e-2504-42cf-8957-fdcaa6647ee4 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d" status: 200 len: 1424 microversion: 2.1 time: 0.130322 Oct 29 02:54:21.269588 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 831/1842] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:21 2022] GET /compute/v2.1/images/cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d => generated 1424 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:21.282320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-01d60d6d-52c8-4fa5-b1e9-fcf0f6ffe16b tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Action: 'create', calling method: .version_select at 0x7ff053aa4ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1178841661", "description": "tempest-description-474224023"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:21.346490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c1231b28-0aa6-4b10-8348-fae7b2c29739 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:21.358564 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c1231b28-0aa6-4b10-8348-fae7b2c29739 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b" status: 200 len: 1334 microversion: 2.1 time: 0.384065 Oct 29 02:54:21.359724 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1012/1843] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:20 2022] GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b => generated 1334 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:21.364940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-efa0a7e7-ea5e-483a-b8cb-01e9a14ac61f tempest-SecurityGroupsNegativeTestJSON-389028235 tempest-SecurityGroupsNegativeTestJSON-389028235-project] Calling method '.version_select at 0x7ff05c149ca0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:21.664416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG neutronclient.v2_0.client [None req-efa0a7e7-ea5e-483a-b8cb-01e9a14ac61f tempest-SecurityGroupsNegativeTestJSON-389028235 tempest-SecurityGroupsNegativeTestJSON-389028235-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=127124) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:54:21.665516 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-efa0a7e7-ea5e-483a-b8cb-01e9a14ac61f tempest-SecurityGroupsNegativeTestJSON-389028235 tempest-SecurityGroupsNegativeTestJSON-389028235-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 29 02:54:21.665516 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-923e0e01-52cf-4ba8-8bf6-2d7d53ad6487'] Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-efa0a7e7-ea5e-483a-b8cb-01e9a14ac61f tempest-SecurityGroupsNegativeTestJSON-389028235 tempest-SecurityGroupsNegativeTestJSON-389028235-project] Request method failure captured: Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/os-security-groups/72d9fc93-ac81-426d-bb2e-107bd094634a HTTP/1.1 Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJXbLvdYE73jr7R2A07XmpWk8MSPfAKC8n1LTe_ljh2U65oy_6Ndi-MC-khlL_kfKAfI_jTTL1cis2pecvZ7BTgMQxR4t0MGYMctHtlYHeB8xFJ5ah99PrdzTZpJPyGLyCGMiU2oRRLcaH1dZdgdN4Zjb0b3nSq0AlHVs71As9LU7J8 Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 61d04285884b4d1c814b322cfbbe7aeb Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-389028235 Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/61d04285884b4d1c814b322cfbbe7aeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/61d04285884b4d1c814b322cfbbe7aeb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_61d04285884b4d1c814b322cfbbe7aeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/61d04285884b4d1c814b322cfbbe7aeb"}]}] Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-389028235 Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 61d04285884b4d1c814b322cfbbe7aeb Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-389028235 Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-SecurityGroupsNegativeTestJSON-389028235-project Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 362a4f36dc8142578a6ce103e810d422 Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-389028235-project Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: exception: Insufficient rights for removing default security group. Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-923e0e01-52cf-4ba8-8bf6-2d7d53ad6487'] Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '72d9fc93-ac81-426d-bb2e-107bd094634a'} Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:54:21.669058 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-923e0e01-52cf-4ba8-8bf6-2d7d53ad6487'] Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-923e0e01-52cf-4ba8-8bf6-2d7d53ad6487'] Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-923e0e01-52cf-4ba8-8bf6-2d7d53ad6487'] Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-923e0e01-52cf-4ba8-8bf6-2d7d53ad6487'] Oct 29 02:54:21.674614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:21.683536 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-efa0a7e7-ea5e-483a-b8cb-01e9a14ac61f tempest-SecurityGroupsNegativeTestJSON-389028235 tempest-SecurityGroupsNegativeTestJSON-389028235-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 29 02:54:21.683536 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-923e0e01-52cf-4ba8-8bf6-2d7d53ad6487'] {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:54:21.694844 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-efa0a7e7-ea5e-483a-b8cb-01e9a14ac61f tempest-SecurityGroupsNegativeTestJSON-389028235 tempest-SecurityGroupsNegativeTestJSON-389028235-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/72d9fc93-ac81-426d-bb2e-107bd094634a" status: 400 len: 182 microversion: 2.1 time: 0.333610 Oct 29 02:54:21.695961 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1013/1844] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:54:21 2022] DELETE /compute/v2.1/os-security-groups/72d9fc93-ac81-426d-bb2e-107bd094634a => generated 182 bytes in 335 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:54:21.710234 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-513a2ce8-2a46-42ba-8692-567a9569b215 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:21.716281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-513a2ce8-2a46-42ba-8692-567a9569b215 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:21.737834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-513a2ce8-2a46-42ba-8692-567a9569b215 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:21.738336 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-513a2ce8-2a46-42ba-8692-567a9569b215 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:21.747291 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-513a2ce8-2a46-42ba-8692-567a9569b215 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:21.748095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-513a2ce8-2a46-42ba-8692-567a9569b215 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:21.754740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-513a2ce8-2a46-42ba-8692-567a9569b215 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:21.755351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-513a2ce8-2a46-42ba-8692-567a9569b215 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:22.986089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-513a2ce8-2a46-42ba-8692-567a9569b215 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:23.054540 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-513a2ce8-2a46-42ba-8692-567a9569b215 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:23.058511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-513a2ce8-2a46-42ba-8692-567a9569b215 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:23.065701 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-513a2ce8-2a46-42ba-8692-567a9569b215 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1879 microversion: 2.42 time: 1.367934 Oct 29 02:54:23.073522 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1014/1845] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:21 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1879 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:23.090903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bebaae63-59d9-4620-ad7d-014866f51393 tempest-SecurityGroupsNegativeTestJSON-389028235 tempest-SecurityGroupsNegativeTestJSON-389028235-project] Calling method '.version_select at 0x7ff05c12c790>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:23.571495 n-d-862967-2 devstack@n-api.service[127124]: DEBUG neutronclient.v2_0.client [None req-bebaae63-59d9-4620-ad7d-014866f51393 tempest-SecurityGroupsNegativeTestJSON-389028235 tempest-SecurityGroupsNegativeTestJSON-389028235-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cc31885e-889b-4f8d-885b-3e7253b91102 does not exist", "detail": ""}} {{(pid=127124) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:54:23.574732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.security_group_api [None req-bebaae63-59d9-4620-ad7d-014866f51393 tempest-SecurityGroupsNegativeTestJSON-389028235 tempest-SecurityGroupsNegativeTestJSON-389028235-project] Neutron security group cc31885e-889b-4f8d-885b-3e7253b91102 not found {{(pid=127124) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 02:54:23.575711 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-bebaae63-59d9-4620-ad7d-014866f51393 tempest-SecurityGroupsNegativeTestJSON-389028235 tempest-SecurityGroupsNegativeTestJSON-389028235-project] HTTP exception thrown: Security group cc31885e-889b-4f8d-885b-3e7253b91102 does not exist Oct 29 02:54:23.575711 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-040579fe-6e62-4eb1-b96e-b1be546eedd0'] Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bebaae63-59d9-4620-ad7d-014866f51393 tempest-SecurityGroupsNegativeTestJSON-389028235 tempest-SecurityGroupsNegativeTestJSON-389028235-project] Request method failure captured: Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/os-security-groups/cc31885e-889b-4f8d-885b-3e7253b91102 HTTP/1.1 Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJXbLvdYE73jr7R2A07XmpWk8MSPfAKC8n1LTe_ljh2U65oy_6Ndi-MC-khlL_kfKAfI_jTTL1cis2pecvZ7BTgMQxR4t0MGYMctHtlYHeB8xFJ5ah99PrdzTZpJPyGLyCGMiU2oRRLcaH1dZdgdN4Zjb0b3nSq0AlHVs71As9LU7J8 Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 61d04285884b4d1c814b322cfbbe7aeb Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-389028235 Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/61d04285884b4d1c814b322cfbbe7aeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/61d04285884b4d1c814b322cfbbe7aeb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_61d04285884b4d1c814b322cfbbe7aeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/61d04285884b4d1c814b322cfbbe7aeb"}]}] Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-389028235 Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 61d04285884b4d1c814b322cfbbe7aeb Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-389028235 Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-SecurityGroupsNegativeTestJSON-389028235-project Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 362a4f36dc8142578a6ce103e810d422 Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-389028235-project Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: exception: Security group cc31885e-889b-4f8d-885b-3e7253b91102 does not exist Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-040579fe-6e62-4eb1-b96e-b1be546eedd0'] Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'cc31885e-889b-4f8d-885b-3e7253b91102'} Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:54:23.578606 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cc31885e-889b-4f8d-885b-3e7253b91102 does not exist Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-040579fe-6e62-4eb1-b96e-b1be546eedd0'] Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cc31885e-889b-4f8d-885b-3e7253b91102 does not exist Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-040579fe-6e62-4eb1-b96e-b1be546eedd0'] Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cc31885e-889b-4f8d-885b-3e7253b91102 does not exist Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-040579fe-6e62-4eb1-b96e-b1be546eedd0'] Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cc31885e-889b-4f8d-885b-3e7253b91102 does not exist Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-040579fe-6e62-4eb1-b96e-b1be546eedd0'] Oct 29 02:54:23.583785 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:23.596353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bebaae63-59d9-4620-ad7d-014866f51393 tempest-SecurityGroupsNegativeTestJSON-389028235 tempest-SecurityGroupsNegativeTestJSON-389028235-project] Returning 404 to user: Security group cc31885e-889b-4f8d-885b-3e7253b91102 does not exist Oct 29 02:54:23.596353 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-040579fe-6e62-4eb1-b96e-b1be546eedd0'] {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:54:23.600375 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bebaae63-59d9-4620-ad7d-014866f51393 tempest-SecurityGroupsNegativeTestJSON-389028235 tempest-SecurityGroupsNegativeTestJSON-389028235-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/cc31885e-889b-4f8d-885b-3e7253b91102" status: 404 len: 194 microversion: 2.1 time: 0.524338 Oct 29 02:54:23.614532 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1015/1846] 10.222.0.46 () {58 vars in 1269 bytes} [Sat Oct 29 02:54:23 2022] GET /compute/v2.1/os-security-groups/cc31885e-889b-4f8d-885b-3e7253b91102 => generated 194 bytes in 540 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:54:23.660853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5e83ba9c-3646-438b-b326-8c9238e6dffe tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c10ef70>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:24.874336 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-01d60d6d-52c8-4fa5-b1e9-fcf0f6ffe16b tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 3.602612 Oct 29 02:54:24.875170 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 832/1847] 10.222.0.46 () {60 vars in 1180 bytes} [Sat Oct 29 02:54:21 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 3604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:24.887700 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5f0f932e-1874-4b44-95ea-03b911e7adc1 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff0536e4430>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:29.126367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=12 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:29.426773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:30.378595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=57 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:30.400344 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:31.737673 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=29 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:31.984149 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5e83ba9c-3646-438b-b326-8c9238e6dffe tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/0cfc4d93-8e9d-42c7-bc33-0e28967c8d63" status: 200 len: 1453 microversion: 2.1 time: 8.364112 Oct 29 02:54:31.987424 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1016/1848] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:23 2022] GET /compute/v2.1/images/0cfc4d93-8e9d-42c7-bc33-0e28967c8d63 => generated 1453 bytes in 8372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:32.006790 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5f0f932e-1874-4b44-95ea-03b911e7adc1 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d" status: 200 len: 1433 microversion: 2.1 time: 7.129411 Oct 29 02:54:32.019464 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e68785c8-19dc-45a8-812e-841b25f160a4 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:32.020096 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e68785c8-19dc-45a8-812e-841b25f160a4 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 5b856917-a04b-436d-8f9f-5ce0492bc28b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:32.022175 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 833/1849] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:24 2022] GET /compute/v2.1/images/cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d => generated 1433 bytes in 7146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:32.030667 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1c53a86e-49de-4211-8bd6-abd742757f01 tempest-SecurityGroupsNegativeTestJSON-389028235 tempest-SecurityGroupsNegativeTestJSON-389028235-project] Action: 'update', calling method: .version_select at 0x7ff0536e03a0>, body: {"security_group": {"name": "tempest-sg-1322611978", "description": "tempest-description-1677256780"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:32.047084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e68785c8-19dc-45a8-812e-841b25f160a4 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:32.051595 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e68785c8-19dc-45a8-812e-841b25f160a4 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:32.052238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e68785c8-19dc-45a8-812e-841b25f160a4 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:32.053594 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e68785c8-19dc-45a8-812e-841b25f160a4 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:32.054223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e68785c8-19dc-45a8-812e-841b25f160a4 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:32.055138 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e68785c8-19dc-45a8-812e-841b25f160a4 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:32.214864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG neutronclient.v2_0.client [None req-1c53a86e-49de-4211-8bd6-abd742757f01 tempest-SecurityGroupsNegativeTestJSON-389028235 tempest-SecurityGroupsNegativeTestJSON-389028235-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 42d5a271-28cc-4027-a170-a5dc5307e108 does not exist", "detail": ""}} {{(pid=127125) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:54:32.217654 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.security_group_api [None req-1c53a86e-49de-4211-8bd6-abd742757f01 tempest-SecurityGroupsNegativeTestJSON-389028235 tempest-SecurityGroupsNegativeTestJSON-389028235-project] Neutron security group 42d5a271-28cc-4027-a170-a5dc5307e108 not found {{(pid=127125) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 02:54:32.218898 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-1c53a86e-49de-4211-8bd6-abd742757f01 tempest-SecurityGroupsNegativeTestJSON-389028235 tempest-SecurityGroupsNegativeTestJSON-389028235-project] HTTP exception thrown: Security group 42d5a271-28cc-4027-a170-a5dc5307e108 does not exist Oct 29 02:54:32.218898 n-d-862967-2 devstack@n-api.service[127125]: Neutron server returns request_ids: ['req-720e1a6c-bcb3-4d0d-b137-594024361950'] Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1c53a86e-49de-4211-8bd6-abd742757f01 tempest-SecurityGroupsNegativeTestJSON-389028235 tempest-SecurityGroupsNegativeTestJSON-389028235-project] Request method failure captured: Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: request: PUT /compute/v2.1/os-security-groups/42d5a271-28cc-4027-a170-a5dc5307e108 HTTP/1.1 Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 102 Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJXbLvdYE73jr7R2A07XmpWk8MSPfAKC8n1LTe_ljh2U65oy_6Ndi-MC-khlL_kfKAfI_jTTL1cis2pecvZ7BTgMQxR4t0MGYMctHtlYHeB8xFJ5ah99PrdzTZpJPyGLyCGMiU2oRRLcaH1dZdgdN4Zjb0b3nSq0AlHVs71As9LU7J8 Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 61d04285884b4d1c814b322cfbbe7aeb Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-389028235 Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/61d04285884b4d1c814b322cfbbe7aeb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/61d04285884b4d1c814b322cfbbe7aeb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_61d04285884b4d1c814b322cfbbe7aeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/61d04285884b4d1c814b322cfbbe7aeb"}]}] Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-389028235 Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 61d04285884b4d1c814b322cfbbe7aeb Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-389028235 Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-SecurityGroupsNegativeTestJSON-389028235-project Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 362a4f36dc8142578a6ce103e810d422 Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-389028235-project Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: {"security_group": {"name": "tempest-sg-1322611978", "description": "tempest-description-1677256780"}} Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: exception: Security group 42d5a271-28cc-4027-a170-a5dc5307e108 does not exist Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: Neutron server returns request_ids: ['req-720e1a6c-bcb3-4d0d-b137-594024361950'] Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '42d5a271-28cc-4027-a170-a5dc5307e108', 'body': {'security_group': {'name': 'tempest-sg-1322611978', 'description': 'tempest-description-1677256780'}}} Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:54:32.221385 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 42d5a271-28cc-4027-a170-a5dc5307e108 does not exist Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-720e1a6c-bcb3-4d0d-b137-594024361950'] Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 42d5a271-28cc-4027-a170-a5dc5307e108 does not exist Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-720e1a6c-bcb3-4d0d-b137-594024361950'] Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 42d5a271-28cc-4027-a170-a5dc5307e108 does not exist Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-720e1a6c-bcb3-4d0d-b137-594024361950'] Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 42d5a271-28cc-4027-a170-a5dc5307e108 does not exist Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-720e1a6c-bcb3-4d0d-b137-594024361950'] Oct 29 02:54:32.226088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:32.233296 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1c53a86e-49de-4211-8bd6-abd742757f01 tempest-SecurityGroupsNegativeTestJSON-389028235 tempest-SecurityGroupsNegativeTestJSON-389028235-project] Returning 404 to user: Security group 42d5a271-28cc-4027-a170-a5dc5307e108 does not exist Oct 29 02:54:32.233296 n-d-862967-2 devstack@n-api.service[127125]: Neutron server returns request_ids: ['req-720e1a6c-bcb3-4d0d-b137-594024361950'] {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:54:32.234514 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1c53a86e-49de-4211-8bd6-abd742757f01 tempest-SecurityGroupsNegativeTestJSON-389028235 tempest-SecurityGroupsNegativeTestJSON-389028235-project] 10.222.0.46 "PUT /compute/v2.1/os-security-groups/42d5a271-28cc-4027-a170-a5dc5307e108" status: 404 len: 194 microversion: 2.1 time: 0.211308 Oct 29 02:54:32.241469 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 834/1850] 10.222.0.46 () {60 vars in 1290 bytes} [Sat Oct 29 02:54:32 2022] PUT /compute/v2.1/os-security-groups/42d5a271-28cc-4027-a170-a5dc5307e108 => generated 194 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:54:32.263955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fd48c570-eda1-468d-a083-11c109bc611b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:32.266343 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fd48c570-eda1-468d-a083-11c109bc611b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:32.275617 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd48c570-eda1-468d-a083-11c109bc611b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:32.276394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd48c570-eda1-468d-a083-11c109bc611b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:32.277112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd48c570-eda1-468d-a083-11c109bc611b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:32.278108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd48c570-eda1-468d-a083-11c109bc611b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:32.278796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd48c570-eda1-468d-a083-11c109bc611b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:32.279458 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd48c570-eda1-468d-a083-11c109bc611b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:32.649311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e68785c8-19dc-45a8-812e-841b25f160a4 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:32.670861 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e68785c8-19dc-45a8-812e-841b25f160a4 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b" status: 200 len: 1668 microversion: 2.1 time: 0.679073 Oct 29 02:54:32.674145 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1017/1851] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:31 2022] GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b => generated 1668 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:32.688426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3bceeb78-2d1a-40fa-bac3-29be0cab0b40 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '.version_select at 0x7ff05c22d550>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:32.994177 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fd48c570-eda1-468d-a083-11c109bc611b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:33.007695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fd48c570-eda1-468d-a083-11c109bc611b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:33.017950 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fd48c570-eda1-468d-a083-11c109bc611b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:33.024847 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fd48c570-eda1-468d-a083-11c109bc611b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1879 microversion: 2.42 time: 0.772422 Oct 29 02:54:33.026278 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 835/1852] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:32 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1879 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:33.038158 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-334f08d3-314d-4dfa-87dc-18ca0c4e6316 req-6bb4f903-20b3-4e5f-b079-d92ebb5edd6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd", "name": "network-vif-plugged", "status": "completed", "tag": "9daf432c-ab9e-41ed-aaf7-21cb4e7d509f"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:33.085155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-334f08d3-314d-4dfa-87dc-18ca0c4e6316 req-6bb4f903-20b3-4e5f-b079-d92ebb5edd6b service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:33.086031 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-334f08d3-314d-4dfa-87dc-18ca0c4e6316 req-6bb4f903-20b3-4e5f-b079-d92ebb5edd6b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:33.086705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-334f08d3-314d-4dfa-87dc-18ca0c4e6316 req-6bb4f903-20b3-4e5f-b079-d92ebb5edd6b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:33.153863 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-334f08d3-314d-4dfa-87dc-18ca0c4e6316 req-6bb4f903-20b3-4e5f-b079-d92ebb5edd6b service nova] Creating event network-vif-plugged:9daf432c-ab9e-41ed-aaf7-21cb4e7d509f for instance 0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd on n-h1-862967-2 Oct 29 02:54:33.170150 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-334f08d3-314d-4dfa-87dc-18ca0c4e6316 req-6bb4f903-20b3-4e5f-b079-d92ebb5edd6b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141483 Oct 29 02:54:33.171554 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 836/1853] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:33.189811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ccb298f1-06f4-4278-af69-4c0948dfd401 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff05373e4c0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:33.298396 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ccb298f1-06f4-4278-af69-4c0948dfd401 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d" status: 200 len: 1433 microversion: 2.1 time: 0.124137 Oct 29 02:54:33.308949 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 837/1854] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:33 2022] GET /compute/v2.1/images/cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d => generated 1433 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:33.314945 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ada6651e-1028-4ea6-ad51-3c5af27ccf2a tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:33.315692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ada6651e-1028-4ea6-ad51-3c5af27ccf2a tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 5b856917-a04b-436d-8f9f-5ce0492bc28b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:33.332144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ada6651e-1028-4ea6-ad51-3c5af27ccf2a tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:33.333381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ada6651e-1028-4ea6-ad51-3c5af27ccf2a tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:33.333547 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ada6651e-1028-4ea6-ad51-3c5af27ccf2a tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:33.338609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ada6651e-1028-4ea6-ad51-3c5af27ccf2a tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:33.339461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ada6651e-1028-4ea6-ad51-3c5af27ccf2a tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:33.339929 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ada6651e-1028-4ea6-ad51-3c5af27ccf2a tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:33.426768 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ada6651e-1028-4ea6-ad51-3c5af27ccf2a tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b/ips" status: 200 len: 178 microversion: 2.1 time: 0.115145 Oct 29 02:54:33.436030 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 838/1855] 10.222.0.46 () {58 vars in 1248 bytes} [Sat Oct 29 02:54:33 2022] GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b/ips => generated 178 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:33.441973 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ed1d3be1-98d2-4bad-8e3f-cd735545eb00 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05387a430>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:33.546815 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ed1d3be1-98d2-4bad-8e3f-cd735545eb00 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/0cfc4d93-8e9d-42c7-bc33-0e28967c8d63" status: 200 len: 1453 microversion: 2.1 time: 0.109198 Oct 29 02:54:33.547454 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 839/1856] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:33 2022] GET /compute/v2.1/images/0cfc4d93-8e9d-42c7-bc33-0e28967c8d63 => generated 1453 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:33.557528 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3a46404d-e02c-4f1c-a68e-b835a25fc936 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:33.571470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3a46404d-e02c-4f1c-a68e-b835a25fc936 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] [instance: c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:33.597518 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a46404d-e02c-4f1c-a68e-b835a25fc936 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:33.600878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a46404d-e02c-4f1c-a68e-b835a25fc936 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:33.601365 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a46404d-e02c-4f1c-a68e-b835a25fc936 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:33.607389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a46404d-e02c-4f1c-a68e-b835a25fc936 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:33.607927 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a46404d-e02c-4f1c-a68e-b835a25fc936 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:33.612839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a46404d-e02c-4f1c-a68e-b835a25fc936 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:34.089033 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3bceeb78-2d1a-40fa-bac3-29be0cab0b40 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 1.412347 Oct 29 02:54:34.089948 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1018/1857] 10.222.0.46 () {58 vars in 1158 bytes} [Sat Oct 29 02:54:32 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:34.098634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f996809e-88d0-48bd-b102-cae9146dc10e tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:34.099413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f996809e-88d0-48bd-b102-cae9146dc10e tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 5b856917-a04b-436d-8f9f-5ce0492bc28b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:34.131442 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f996809e-88d0-48bd-b102-cae9146dc10e tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:34.131942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f996809e-88d0-48bd-b102-cae9146dc10e tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:34.132379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f996809e-88d0-48bd-b102-cae9146dc10e tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:34.142744 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f996809e-88d0-48bd-b102-cae9146dc10e tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:34.143567 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f996809e-88d0-48bd-b102-cae9146dc10e tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:34.144379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f996809e-88d0-48bd-b102-cae9146dc10e tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:34.197814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f996809e-88d0-48bd-b102-cae9146dc10e tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 5b856917-a04b-436d-8f9f-5ce0492bc28b] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:54:34.327960 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f996809e-88d0-48bd-b102-cae9146dc10e tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b" status: 204 len: 0 microversion: 2.1 time: 0.234895 Oct 29 02:54:34.329680 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1019/1858] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:54:34 2022] DELETE /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:54:34.349243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-09e991b8-6269-4306-a89c-4ce45a0abcee tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:34.354226 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-09e991b8-6269-4306-a89c-4ce45a0abcee tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:34.362716 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09e991b8-6269-4306-a89c-4ce45a0abcee tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:34.363705 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09e991b8-6269-4306-a89c-4ce45a0abcee tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:34.364325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09e991b8-6269-4306-a89c-4ce45a0abcee tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:34.365558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09e991b8-6269-4306-a89c-4ce45a0abcee tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:34.366253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09e991b8-6269-4306-a89c-4ce45a0abcee tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:34.367335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09e991b8-6269-4306-a89c-4ce45a0abcee tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:34.869710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-09e991b8-6269-4306-a89c-4ce45a0abcee tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:34.883131 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-09e991b8-6269-4306-a89c-4ce45a0abcee tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:34.885306 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-09e991b8-6269-4306-a89c-4ce45a0abcee tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:34.889320 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-09e991b8-6269-4306-a89c-4ce45a0abcee tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1879 microversion: 2.42 time: 0.558162 Oct 29 02:54:34.893979 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1020/1859] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:34 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1879 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:34.905218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c65433ba-baf6-4392-8905-fe55a19ba045 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '.version_select at 0x7ff05c113ca0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:35.080154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3a46404d-e02c-4f1c-a68e-b835a25fc936 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c3218be14842e1b1fd2e5c10c9092a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f820fbde72429db671d15337913fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:35.102465 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3a46404d-e02c-4f1c-a68e-b835a25fc936 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc" status: 200 len: 1466 microversion: 2.1 time: 1.552215 Oct 29 02:54:35.103810 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 840/1860] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:33 2022] GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc => generated 1466 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:35.116098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e3ad4d2d-dceb-4b99-be50-e1644c94a5e0 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:35.124834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e3ad4d2d-dceb-4b99-be50-e1644c94a5e0 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 5b856917-a04b-436d-8f9f-5ce0492bc28b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:35.140391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3ad4d2d-dceb-4b99-be50-e1644c94a5e0 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:35.146018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3ad4d2d-dceb-4b99-be50-e1644c94a5e0 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:35.148552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3ad4d2d-dceb-4b99-be50-e1644c94a5e0 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:35.151418 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3ad4d2d-dceb-4b99-be50-e1644c94a5e0 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:35.155451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3ad4d2d-dceb-4b99-be50-e1644c94a5e0 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:35.156988 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3ad4d2d-dceb-4b99-be50-e1644c94a5e0 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:36.033331 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e3ad4d2d-dceb-4b99-be50-e1644c94a5e0 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:36.046544 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e3ad4d2d-dceb-4b99-be50-e1644c94a5e0 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b" status: 200 len: 1674 microversion: 2.1 time: 0.939752 Oct 29 02:54:36.054072 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 841/1861] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:35 2022] GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b => generated 1674 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:36.080855 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-16cad3f0-cacb-4a53-a57a-ec5c4daf822a tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff0537e2d30>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:36.192834 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-16cad3f0-cacb-4a53-a57a-ec5c4daf822a tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/0cfc4d93-8e9d-42c7-bc33-0e28967c8d63" status: 200 len: 1453 microversion: 2.1 time: 0.136183 Oct 29 02:54:36.201348 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 842/1862] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:36 2022] GET /compute/v2.1/images/0cfc4d93-8e9d-42c7-bc33-0e28967c8d63 => generated 1453 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:36.215079 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f7e2f653-879a-46da-bde9-f62aa15521ff tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff0536e05e0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:36.304485 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f7e2f653-879a-46da-bde9-f62aa15521ff tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/cd315600-df67-41c1-95d3-95a5145fc39a" status: 200 len: 784 microversion: 2.1 time: 0.101653 Oct 29 02:54:36.314778 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 843/1863] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:36 2022] GET /compute/v2.1/images/cd315600-df67-41c1-95d3-95a5145fc39a => generated 784 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:36.324079 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0e44a89a-ed6e-40c0-8a0a-ff5c91454d1b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:36.333888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0e44a89a-ed6e-40c0-8a0a-ff5c91454d1b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:36.357162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0e44a89a-ed6e-40c0-8a0a-ff5c91454d1b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:36.357666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0e44a89a-ed6e-40c0-8a0a-ff5c91454d1b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:36.358108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0e44a89a-ed6e-40c0-8a0a-ff5c91454d1b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:36.358828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0e44a89a-ed6e-40c0-8a0a-ff5c91454d1b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:36.369146 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0e44a89a-ed6e-40c0-8a0a-ff5c91454d1b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:36.372249 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c65433ba-baf6-4392-8905-fe55a19ba045 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/63ad752a-20e0-4f25-91e6-fa7b8271ba9c" status: 202 len: 0 microversion: 2.1 time: 1.476774 Oct 29 02:54:36.373935 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1021/1864] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:54:34 2022] DELETE /compute/v2.1/os-security-groups/63ad752a-20e0-4f25-91e6-fa7b8271ba9c => generated 0 bytes in 1479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:54:36.380240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0e44a89a-ed6e-40c0-8a0a-ff5c91454d1b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:36.380853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-596fa57c-a016-443f-9506-177ca0f69ce6 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:36.423012 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-596fa57c-a016-443f-9506-177ca0f69ce6 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.042319 Oct 29 02:54:36.424336 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1022/1865] 10.222.0.46 () {58 vars in 1137 bytes} [Sat Oct 29 02:54:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:36.434967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a87d73be-7784-4281-9e28-bda623d10d99 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '.version_select at 0x7ff05c0f49d0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:36.687754 n-d-862967-2 devstack@n-api.service[127124]: DEBUG neutronclient.v2_0.client [None req-a87d73be-7784-4281-9e28-bda623d10d99 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 63ad752a-20e0-4f25-91e6-fa7b8271ba9c does not exist", "detail": ""}} {{(pid=127124) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:54:36.689737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.security_group_api [None req-a87d73be-7784-4281-9e28-bda623d10d99 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Neutron security group 63ad752a-20e0-4f25-91e6-fa7b8271ba9c not found {{(pid=127124) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 02:54:36.690870 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-a87d73be-7784-4281-9e28-bda623d10d99 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] HTTP exception thrown: Security group 63ad752a-20e0-4f25-91e6-fa7b8271ba9c does not exist Oct 29 02:54:36.690870 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-9d72f46a-8343-4b6d-ac0b-fdd670982e57'] Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a87d73be-7784-4281-9e28-bda623d10d99 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Request method failure captured: Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/os-security-groups/63ad752a-20e0-4f25-91e6-fa7b8271ba9c HTTP/1.1 Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJWyvWNGvIUONB2dldB7pPioEBwKHjHetza4K1fLTtjT_TQMaaZr4Sn7Ypy_ZhXjAwE7ry_UKafzclnlLHflyUJDtnmpn--08xUkjJ2-Rign0-fn1TZL2Hdqa5rKCy6QAStHGO-9e-pn1Lh_D4FvZ1sBFzju6OJDLJ_prG4_rU83xk8 Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/49721a0af93a47d38613f4a588ab1e1a"}]}] Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 971f709818b74757947beafd14f546bf Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: exception: Security group 63ad752a-20e0-4f25-91e6-fa7b8271ba9c does not exist Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-9d72f46a-8343-4b6d-ac0b-fdd670982e57'] Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '63ad752a-20e0-4f25-91e6-fa7b8271ba9c'} Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:54:36.699465 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 63ad752a-20e0-4f25-91e6-fa7b8271ba9c does not exist Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d72f46a-8343-4b6d-ac0b-fdd670982e57'] Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 63ad752a-20e0-4f25-91e6-fa7b8271ba9c does not exist Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d72f46a-8343-4b6d-ac0b-fdd670982e57'] Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 63ad752a-20e0-4f25-91e6-fa7b8271ba9c does not exist Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d72f46a-8343-4b6d-ac0b-fdd670982e57'] Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 63ad752a-20e0-4f25-91e6-fa7b8271ba9c does not exist Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d72f46a-8343-4b6d-ac0b-fdd670982e57'] Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a87d73be-7784-4281-9e28-bda623d10d99 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Returning 404 to user: Security group 63ad752a-20e0-4f25-91e6-fa7b8271ba9c does not exist Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-9d72f46a-8343-4b6d-ac0b-fdd670982e57'] {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:54:36.706931 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a87d73be-7784-4281-9e28-bda623d10d99 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/63ad752a-20e0-4f25-91e6-fa7b8271ba9c" status: 404 len: 194 microversion: 2.1 time: 0.278639 Oct 29 02:54:36.712633 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1023/1866] 10.222.0.46 () {58 vars in 1269 bytes} [Sat Oct 29 02:54:36 2022] GET /compute/v2.1/os-security-groups/63ad752a-20e0-4f25-91e6-fa7b8271ba9c => generated 194 bytes in 283 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:54:36.731920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-becdac23-6b42-46ef-a198-57904773adea tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff05c227a60>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:37.445667 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0e44a89a-ed6e-40c0-8a0a-ff5c91454d1b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:37.473771 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0e44a89a-ed6e-40c0-8a0a-ff5c91454d1b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:37.481701 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0e44a89a-ed6e-40c0-8a0a-ff5c91454d1b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:37.483041 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0e44a89a-ed6e-40c0-8a0a-ff5c91454d1b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1879 microversion: 2.42 time: 1.166928 Oct 29 02:54:37.514340 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 844/1867] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:36 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1879 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:37.539396 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5a239f43-24a8-4854-9ccb-a989ad214780 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '.version_select at 0x7ff0536e0b80>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:38.255347 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5a239f43-24a8-4854-9ccb-a989ad214780 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/dfb62021-dcda-4e71-b8ea-7fc9e928946b" status: 202 len: 0 microversion: 2.1 time: 0.735965 Oct 29 02:54:38.256253 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 845/1868] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:54:37 2022] DELETE /compute/v2.1/os-security-groups/dfb62021-dcda-4e71-b8ea-7fc9e928946b => generated 0 bytes in 739 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:54:38.265328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f3b216b2-62a9-41a6-ad04-b6c221783df0 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:38.266357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f3b216b2-62a9-41a6-ad04-b6c221783df0 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 5b856917-a04b-436d-8f9f-5ce0492bc28b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:38.288244 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3b216b2-62a9-41a6-ad04-b6c221783df0 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:38.297338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3b216b2-62a9-41a6-ad04-b6c221783df0 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:38.298154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3b216b2-62a9-41a6-ad04-b6c221783df0 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:38.299103 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3b216b2-62a9-41a6-ad04-b6c221783df0 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:38.300350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3b216b2-62a9-41a6-ad04-b6c221783df0 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:38.300815 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3b216b2-62a9-41a6-ad04-b6c221783df0 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:38.616010 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-becdac23-6b42-46ef-a198-57904773adea tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "DELETE /compute/v2.1/images/cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d" status: 204 len: 0 microversion: 2.1 time: 1.903433 Oct 29 02:54:38.618976 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1024/1869] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:36 2022] DELETE /compute/v2.1/images/cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d => generated 0 bytes in 1909 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:54:38.625434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9799e82a-f6ac-4c0b-9f00-027bb3c15616 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c0a4a60>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:38.746066 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9799e82a-f6ac-4c0b-9f00-027bb3c15616 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/0cfc4d93-8e9d-42c7-bc33-0e28967c8d63" status: 200 len: 1453 microversion: 2.1 time: 0.124669 Oct 29 02:54:38.746981 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1025/1870] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:38 2022] GET /compute/v2.1/images/0cfc4d93-8e9d-42c7-bc33-0e28967c8d63 => generated 1453 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:38.754136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-b93907c4-9862-4ea3-979f-3ca7074b806c req-f37c08b9-5542-4671-9a40-1659cdbb5076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc", "name": "network-vif-unplugged", "status": "completed", "tag": "79864797-817a-49a1-9e41-46b8d629427a"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:38.801436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b93907c4-9862-4ea3-979f-3ca7074b806c req-f37c08b9-5542-4671-9a40-1659cdbb5076 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:38.806273 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b93907c4-9862-4ea3-979f-3ca7074b806c req-f37c08b9-5542-4671-9a40-1659cdbb5076 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:38.808420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b93907c4-9862-4ea3-979f-3ca7074b806c req-f37c08b9-5542-4671-9a40-1659cdbb5076 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:38.821343 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:38.858418 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-b93907c4-9862-4ea3-979f-3ca7074b806c req-f37c08b9-5542-4671-9a40-1659cdbb5076 service nova] Creating event network-vif-unplugged:79864797-817a-49a1-9e41-46b8d629427a for instance c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc on n-h2-862967-2 Oct 29 02:54:38.871208 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-b93907c4-9862-4ea3-979f-3ca7074b806c req-f37c08b9-5542-4671-9a40-1659cdbb5076 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122184 Oct 29 02:54:38.876293 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1026/1871] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:38.881129 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8c10fd35-3153-4b4c-840a-8960116b576a tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '.version_select at 0x7ff05c0a6430>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:38.957795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG neutronclient.v2_0.client [None req-8c10fd35-3153-4b4c-840a-8960116b576a tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dfb62021-dcda-4e71-b8ea-7fc9e928946b does not exist", "detail": ""}} {{(pid=127124) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:54:38.958406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.security_group_api [None req-8c10fd35-3153-4b4c-840a-8960116b576a tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Neutron security group dfb62021-dcda-4e71-b8ea-7fc9e928946b not found {{(pid=127124) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 02:54:38.958934 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-8c10fd35-3153-4b4c-840a-8960116b576a tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] HTTP exception thrown: Security group dfb62021-dcda-4e71-b8ea-7fc9e928946b does not exist Oct 29 02:54:38.958934 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-9e576b86-064e-473e-80cb-1db4108b64ad'] Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8c10fd35-3153-4b4c-840a-8960116b576a tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Request method failure captured: Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/os-security-groups/dfb62021-dcda-4e71-b8ea-7fc9e928946b HTTP/1.1 Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJWyvWNGvIUONB2dldB7pPioEBwKHjHetza4K1fLTtjT_TQMaaZr4Sn7Ypy_ZhXjAwE7ry_UKafzclnlLHflyUJDtnmpn--08xUkjJ2-Rign0-fn1TZL2Hdqa5rKCy6QAStHGO-9e-pn1Lh_D4FvZ1sBFzju6OJDLJ_prG4_rU83xk8 Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/49721a0af93a47d38613f4a588ab1e1a"}]}] Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 971f709818b74757947beafd14f546bf Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: exception: Security group dfb62021-dcda-4e71-b8ea-7fc9e928946b does not exist Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-9e576b86-064e-473e-80cb-1db4108b64ad'] Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'dfb62021-dcda-4e71-b8ea-7fc9e928946b'} Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:54:38.961002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dfb62021-dcda-4e71-b8ea-7fc9e928946b does not exist Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e576b86-064e-473e-80cb-1db4108b64ad'] Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dfb62021-dcda-4e71-b8ea-7fc9e928946b does not exist Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e576b86-064e-473e-80cb-1db4108b64ad'] Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dfb62021-dcda-4e71-b8ea-7fc9e928946b does not exist Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e576b86-064e-473e-80cb-1db4108b64ad'] Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dfb62021-dcda-4e71-b8ea-7fc9e928946b does not exist Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e576b86-064e-473e-80cb-1db4108b64ad'] Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8c10fd35-3153-4b4c-840a-8960116b576a tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Returning 404 to user: Security group dfb62021-dcda-4e71-b8ea-7fc9e928946b does not exist Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-9e576b86-064e-473e-80cb-1db4108b64ad'] {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8c10fd35-3153-4b4c-840a-8960116b576a tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/dfb62021-dcda-4e71-b8ea-7fc9e928946b" status: 404 len: 194 microversion: 2.1 time: 0.085398 Oct 29 02:54:38.966196 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1027/1872] 10.222.0.46 () {58 vars in 1269 bytes} [Sat Oct 29 02:54:38 2022] GET /compute/v2.1/os-security-groups/dfb62021-dcda-4e71-b8ea-7fc9e928946b => generated 194 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:54:38.970914 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4bbe1ac2-205c-489d-b9d4-e1f04223dc5c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:38.971585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4bbe1ac2-205c-489d-b9d4-e1f04223dc5c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:39.007282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bbe1ac2-205c-489d-b9d4-e1f04223dc5c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:39.011514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f3b216b2-62a9-41a6-ad04-b6c221783df0 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:39.013595 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bbe1ac2-205c-489d-b9d4-e1f04223dc5c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:39.014047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bbe1ac2-205c-489d-b9d4-e1f04223dc5c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:39.020680 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bbe1ac2-205c-489d-b9d4-e1f04223dc5c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:39.025839 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f3b216b2-62a9-41a6-ad04-b6c221783df0 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b" status: 200 len: 1653 microversion: 2.1 time: 0.768286 Oct 29 02:54:39.037731 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 846/1873] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:38 2022] GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b => generated 1653 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:39.047256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bbe1ac2-205c-489d-b9d4-e1f04223dc5c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:39.049596 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bbe1ac2-205c-489d-b9d4-e1f04223dc5c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:39.049849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6c4116fe-8e89-4ff5-842e-bde95416e8e7 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff0536a5af0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:39.120411 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-6c4116fe-8e89-4ff5-842e-bde95416e8e7 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] HTTP exception thrown: Image not found. Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6c4116fe-8e89-4ff5-842e-bde95416e8e7 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Request method failure captured: Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/images/cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d HTTP/1.1 Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJWc53h7hM9oU9WEEj1IEccQgR6h1ZXcmRg9Ysvo3vT7XN5rQV-c9ztTirjn-gqgcSh9Qr66wROJ6Jr8oSp1eJxAz4oQfx9CYhxJrf1fEvbPHGHUNJFwOa8qFEkUECOjJ4-hgdsKNy6XDim2xU34-IDyYPKeehx2z5xc68iUjCjH_0s Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 10f820fbde72429db671d15337913fd4 Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ImagesOneServerTestJSON-2059384949 Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/10f820fbde72429db671d15337913fd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/10f820fbde72429db671d15337913fd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_10f820fbde72429db671d15337913fd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/10f820fbde72429db671d15337913fd4"}]}] Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ImagesOneServerTestJSON-2059384949 Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 10f820fbde72429db671d15337913fd4 Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2059384949 Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ImagesOneServerTestJSON-2059384949-project Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 71c3218be14842e1b1fd2e5c10c9092a Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ImagesOneServerTestJSON-2059384949-project Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: exception: Image not found. Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d'} Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 02:54:39.134239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d could not be found. Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6c4116fe-8e89-4ff5-842e-bde95416e8e7 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Returning 404 to user: Image not found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6c4116fe-8e89-4ff5-842e-bde95416e8e7 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d" status: 404 len: 62 microversion: 2.1 time: 0.096468 Oct 29 02:54:39.142710 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 847/1874] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:39 2022] GET /compute/v2.1/images/cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d => generated 62 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:54:39.162853 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-b7d22734-45f7-4cb8-a55e-3b8063c1009a req-14684546-b118-43b5-9a89-d1e270f1e81e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b856917-a04b-436d-8f9f-5ce0492bc28b", "name": "network-vif-deleted", "tag": "2195d2bd-e1c7-4a48-9750-1b93573c6a18"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:39.195908 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b7d22734-45f7-4cb8-a55e-3b8063c1009a req-14684546-b118-43b5-9a89-d1e270f1e81e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:39.196415 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b7d22734-45f7-4cb8-a55e-3b8063c1009a req-14684546-b118-43b5-9a89-d1e270f1e81e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:39.196892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b7d22734-45f7-4cb8-a55e-3b8063c1009a req-14684546-b118-43b5-9a89-d1e270f1e81e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:39.215560 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-b7d22734-45f7-4cb8-a55e-3b8063c1009a req-14684546-b118-43b5-9a89-d1e270f1e81e service nova] Creating event network-vif-deleted:2195d2bd-e1c7-4a48-9750-1b93573c6a18 for instance 5b856917-a04b-436d-8f9f-5ce0492bc28b on n-h1-862967-2 Oct 29 02:54:39.234416 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-b7d22734-45f7-4cb8-a55e-3b8063c1009a req-14684546-b118-43b5-9a89-d1e270f1e81e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076304 Oct 29 02:54:39.236657 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 848/1875] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:39.252094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-28e3f85f-63d2-4147-8b50-58c3fe822dc4 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '.version_select at 0x7ff0536a5d30>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:39.557032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4bbe1ac2-205c-489d-b9d4-e1f04223dc5c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:39.587624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4bbe1ac2-205c-489d-b9d4-e1f04223dc5c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:39.596198 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4bbe1ac2-205c-489d-b9d4-e1f04223dc5c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:39.599943 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4bbe1ac2-205c-489d-b9d4-e1f04223dc5c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1879 microversion: 2.42 time: 0.632677 Oct 29 02:54:39.603227 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1028/1876] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:38 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1879 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:39.614690 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1bf0a379-3327-4646-a34c-63beb96c5c6d tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-144072249"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:39.623279 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1bf0a379-3327-4646-a34c-63beb96c5c6d tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] [instance: c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:39.650445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1bf0a379-3327-4646-a34c-63beb96c5c6d tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:39.651822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1bf0a379-3327-4646-a34c-63beb96c5c6d tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:39.655837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1bf0a379-3327-4646-a34c-63beb96c5c6d tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:39.659129 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1bf0a379-3327-4646-a34c-63beb96c5c6d tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:39.662321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1bf0a379-3327-4646-a34c-63beb96c5c6d tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:39.663188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1bf0a379-3327-4646-a34c-63beb96c5c6d tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:40.092506 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1bf0a379-3327-4646-a34c-63beb96c5c6d tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "POST /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc/action" status: 202 len: 0 microversion: 2.1 time: 0.487294 Oct 29 02:54:40.093874 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1029/1877] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:54:39 2022] POST /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 02:54:40.105679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-18395cd1-e434-4d87-b404-c0b37d6e96db tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c12c5e0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:40.200857 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-18395cd1-e434-4d87-b404-c0b37d6e96db tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/0cfc4d93-8e9d-42c7-bc33-0e28967c8d63" status: 200 len: 1453 microversion: 2.1 time: 0.099088 Oct 29 02:54:40.201520 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1030/1878] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:40 2022] GET /compute/v2.1/images/0cfc4d93-8e9d-42c7-bc33-0e28967c8d63 => generated 1453 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:40.254797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-26968786-fd0e-450d-9d05-b15197063212 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:40.255714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-26968786-fd0e-450d-9d05-b15197063212 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 5b856917-a04b-436d-8f9f-5ce0492bc28b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:40.281947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-26968786-fd0e-450d-9d05-b15197063212 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:40.282585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-26968786-fd0e-450d-9d05-b15197063212 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:40.288133 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-26968786-fd0e-450d-9d05-b15197063212 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:40.289243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-26968786-fd0e-450d-9d05-b15197063212 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:40.291431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-26968786-fd0e-450d-9d05-b15197063212 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:40.295011 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-26968786-fd0e-450d-9d05-b15197063212 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:40.516986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-26968786-fd0e-450d-9d05-b15197063212 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c50c8b6b2444a6afa86bc1d019925c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '202abee8256d45b29f190731cc63609c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:40.538447 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-26968786-fd0e-450d-9d05-b15197063212 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b" status: 200 len: 1298 microversion: 2.1 time: 0.313209 Oct 29 02:54:40.542464 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1031/1879] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:40 2022] GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b => generated 1298 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:40.561263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-368f47a7-b90d-425a-800d-0c3919bbda2a tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff05c094ee0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:40.693211 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-368f47a7-b90d-425a-800d-0c3919bbda2a tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499" status: 200 len: 1428 microversion: 2.1 time: 0.149045 Oct 29 02:54:40.703208 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1032/1880] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:40 2022] GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499 => generated 1428 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:40.716166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-34d94f60-f9ab-4be0-91ee-9e534214c441 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:40.719147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-34d94f60-f9ab-4be0-91ee-9e534214c441 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:40.740729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34d94f60-f9ab-4be0-91ee-9e534214c441 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:40.741237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34d94f60-f9ab-4be0-91ee-9e534214c441 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:40.741682 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34d94f60-f9ab-4be0-91ee-9e534214c441 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:40.742402 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34d94f60-f9ab-4be0-91ee-9e534214c441 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:40.755523 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34d94f60-f9ab-4be0-91ee-9e534214c441 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:40.757907 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34d94f60-f9ab-4be0-91ee-9e534214c441 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:41.260083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-34d94f60-f9ab-4be0-91ee-9e534214c441 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:41.277562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-34d94f60-f9ab-4be0-91ee-9e534214c441 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:41.287410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-34d94f60-f9ab-4be0-91ee-9e534214c441 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:41.292629 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-34d94f60-f9ab-4be0-91ee-9e534214c441 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1879 microversion: 2.42 time: 0.594225 Oct 29 02:54:41.314971 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1033/1881] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:40 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1879 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:41.322733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1563438b-66e1-476d-a307-1e42c0b43a63 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c0fba60>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:41.429580 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1563438b-66e1-476d-a307-1e42c0b43a63 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/0cfc4d93-8e9d-42c7-bc33-0e28967c8d63" status: 200 len: 1453 microversion: 2.1 time: 0.110955 Oct 29 02:54:41.431940 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1034/1882] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:41 2022] GET /compute/v2.1/images/0cfc4d93-8e9d-42c7-bc33-0e28967c8d63 => generated 1453 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:41.445768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-c2b5dce8-ddf9-41eb-97f9-9cde3910ce4f req-298b9e5d-dca1-466e-a687-e9d0ffc84f27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b856917-a04b-436d-8f9f-5ce0492bc28b", "name": "network-vif-deleted", "tag": "deb0da4d-e3f5-449d-a854-c95360500d9e"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:41.470191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c2b5dce8-ddf9-41eb-97f9-9cde3910ce4f req-298b9e5d-dca1-466e-a687-e9d0ffc84f27 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:41.471126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c2b5dce8-ddf9-41eb-97f9-9cde3910ce4f req-298b9e5d-dca1-466e-a687-e9d0ffc84f27 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:41.471984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c2b5dce8-ddf9-41eb-97f9-9cde3910ce4f req-298b9e5d-dca1-466e-a687-e9d0ffc84f27 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:41.487806 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-c2b5dce8-ddf9-41eb-97f9-9cde3910ce4f req-298b9e5d-dca1-466e-a687-e9d0ffc84f27 service nova] Creating event network-vif-deleted:deb0da4d-e3f5-449d-a854-c95360500d9e for instance 5b856917-a04b-436d-8f9f-5ce0492bc28b on n-h1-862967-2 Oct 29 02:54:41.500592 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-c2b5dce8-ddf9-41eb-97f9-9cde3910ce4f req-298b9e5d-dca1-466e-a687-e9d0ffc84f27 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066953 Oct 29 02:54:41.501757 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1035/1883] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:41.580084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e31e7cea-ed2a-4812-adfc-1802b4df9106 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:41.580990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e31e7cea-ed2a-4812-adfc-1802b4df9106 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 5b856917-a04b-436d-8f9f-5ce0492bc28b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:41.597134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e31e7cea-ed2a-4812-adfc-1802b4df9106 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:41.597657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e31e7cea-ed2a-4812-adfc-1802b4df9106 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:41.598087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e31e7cea-ed2a-4812-adfc-1802b4df9106 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:41.601335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e31e7cea-ed2a-4812-adfc-1802b4df9106 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:41.602007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e31e7cea-ed2a-4812-adfc-1802b4df9106 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:41.607870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e31e7cea-ed2a-4812-adfc-1802b4df9106 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:41.632435 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-e31e7cea-ed2a-4812-adfc-1802b4df9106 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] HTTP exception thrown: Instance 5b856917-a04b-436d-8f9f-5ce0492bc28b could not be found. Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e31e7cea-ed2a-4812-adfc-1802b4df9106 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Request method failure captured: Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b HTTP/1.1 Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJVSn1Z6yZnpE5ZLBPheTa94vsOrIOasAiqflLAyq0ViZzIaTN-GngdXiNxVtaUNnT_1JEwPWNZDPigA96-mocavOylAwL683fKA9fknIQSAeDUTDXBmfiqBt0bCvQUYum6e-GWieq2ZcdiDDLPe4J_CpI5GfUyH_e9FdaJLUVdQHvc Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 202abee8256d45b29f190731cc63609c Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersTestMultiNic-604724171 Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/202abee8256d45b29f190731cc63609c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/202abee8256d45b29f190731cc63609c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_202abee8256d45b29f190731cc63609c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/202abee8256d45b29f190731cc63609c"}]}] Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersTestMultiNic-604724171 Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 202abee8256d45b29f190731cc63609c Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersTestMultiNic-604724171 Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersTestMultiNic-604724171-project Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 67c50c8b6b2444a6afa86bc1d019925c Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersTestMultiNic-604724171-project Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 5b856917-a04b-436d-8f9f-5ce0492bc28b could not be found. Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '5b856917-a04b-436d-8f9f-5ce0492bc28b'} Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b856917-a04b-436d-8f9f-5ce0492bc28b could not be found. Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b856917-a04b-436d-8f9f-5ce0492bc28b could not be found. Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:41.634613 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:41.639840 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:41.639840 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:41.639840 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:41.639840 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:54:41.639840 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:54:41.639840 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b856917-a04b-436d-8f9f-5ce0492bc28b could not be found. Oct 29 02:54:41.639840 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:41.644162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e31e7cea-ed2a-4812-adfc-1802b4df9106 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Returning 404 to user: Instance 5b856917-a04b-436d-8f9f-5ce0492bc28b could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:54:41.645435 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e31e7cea-ed2a-4812-adfc-1802b4df9106 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b" status: 404 len: 111 microversion: 2.1 time: 0.070307 Oct 29 02:54:41.650442 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1036/1884] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:41 2022] GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:54:41.720734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-42b94ad7-4a79-497b-bf57-7b41df08fc38 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff05c23e040>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:41.800930 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-42b94ad7-4a79-497b-bf57-7b41df08fc38 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499" status: 200 len: 1428 microversion: 2.1 time: 0.085937 Oct 29 02:54:41.802460 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1037/1885] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:41 2022] GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499 => generated 1428 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:42.296750 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-28e3f85f-63d2-4147-8b50-58c3fe822dc4 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/efb97629-f4c4-4ee5-b421-bf54af2daf85" status: 202 len: 0 microversion: 2.1 time: 3.058501 Oct 29 02:54:42.297709 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 849/1886] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:54:39 2022] DELETE /compute/v2.1/os-security-groups/efb97629-f4c4-4ee5-b421-bf54af2daf85 => generated 0 bytes in 3060 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:54:42.307696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0fbac7d9-2274-4189-885c-3255e1d568ce tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '.version_select at 0x7ff053a0e0d0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:42.323827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-27a4472a-cf95-4e43-b4d8-f83a225f0a16 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:42.324602 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-27a4472a-cf95-4e43-b4d8-f83a225f0a16 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:42.334225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27a4472a-cf95-4e43-b4d8-f83a225f0a16 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:42.337499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27a4472a-cf95-4e43-b4d8-f83a225f0a16 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:42.346205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27a4472a-cf95-4e43-b4d8-f83a225f0a16 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:42.347455 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27a4472a-cf95-4e43-b4d8-f83a225f0a16 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:42.347955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27a4472a-cf95-4e43-b4d8-f83a225f0a16 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:42.348401 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27a4472a-cf95-4e43-b4d8-f83a225f0a16 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:42.466314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG neutronclient.v2_0.client [None req-0fbac7d9-2274-4189-885c-3255e1d568ce tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group efb97629-f4c4-4ee5-b421-bf54af2daf85 does not exist", "detail": ""}} {{(pid=127124) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:54:42.467425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.security_group_api [None req-0fbac7d9-2274-4189-885c-3255e1d568ce tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Neutron security group efb97629-f4c4-4ee5-b421-bf54af2daf85 not found {{(pid=127124) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 02:54:42.469122 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-0fbac7d9-2274-4189-885c-3255e1d568ce tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] HTTP exception thrown: Security group efb97629-f4c4-4ee5-b421-bf54af2daf85 does not exist Oct 29 02:54:42.469122 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-903b6a98-17c9-4cf3-946d-6d1b89a74888'] Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0fbac7d9-2274-4189-885c-3255e1d568ce tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Request method failure captured: Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/os-security-groups/efb97629-f4c4-4ee5-b421-bf54af2daf85 HTTP/1.1 Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJWyvWNGvIUONB2dldB7pPioEBwKHjHetza4K1fLTtjT_TQMaaZr4Sn7Ypy_ZhXjAwE7ry_UKafzclnlLHflyUJDtnmpn--08xUkjJ2-Rign0-fn1TZL2Hdqa5rKCy6QAStHGO-9e-pn1Lh_D4FvZ1sBFzju6OJDLJ_prG4_rU83xk8 Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/49721a0af93a47d38613f4a588ab1e1a"}]}] Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 971f709818b74757947beafd14f546bf Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: exception: Security group efb97629-f4c4-4ee5-b421-bf54af2daf85 does not exist Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-903b6a98-17c9-4cf3-946d-6d1b89a74888'] Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'efb97629-f4c4-4ee5-b421-bf54af2daf85'} Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:54:42.493242 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group efb97629-f4c4-4ee5-b421-bf54af2daf85 does not exist Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-903b6a98-17c9-4cf3-946d-6d1b89a74888'] Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group efb97629-f4c4-4ee5-b421-bf54af2daf85 does not exist Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-903b6a98-17c9-4cf3-946d-6d1b89a74888'] Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group efb97629-f4c4-4ee5-b421-bf54af2daf85 does not exist Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-903b6a98-17c9-4cf3-946d-6d1b89a74888'] Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group efb97629-f4c4-4ee5-b421-bf54af2daf85 does not exist Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-903b6a98-17c9-4cf3-946d-6d1b89a74888'] Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0fbac7d9-2274-4189-885c-3255e1d568ce tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Returning 404 to user: Security group efb97629-f4c4-4ee5-b421-bf54af2daf85 does not exist Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-903b6a98-17c9-4cf3-946d-6d1b89a74888'] {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0fbac7d9-2274-4189-885c-3255e1d568ce tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/efb97629-f4c4-4ee5-b421-bf54af2daf85" status: 404 len: 194 microversion: 2.1 time: 0.193851 Oct 29 02:54:42.498729 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1038/1887] 10.222.0.46 () {58 vars in 1269 bytes} [Sat Oct 29 02:54:42 2022] GET /compute/v2.1/os-security-groups/efb97629-f4c4-4ee5-b421-bf54af2daf85 => generated 194 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:54:42.531160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8dd58e1e-fce7-44ed-875e-35074ad742e0 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c1133a0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:42.651282 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8dd58e1e-fce7-44ed-875e-35074ad742e0 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/0cfc4d93-8e9d-42c7-bc33-0e28967c8d63" status: 200 len: 1453 microversion: 2.1 time: 0.154272 Oct 29 02:54:42.652481 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1039/1888] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:42 2022] GET /compute/v2.1/images/0cfc4d93-8e9d-42c7-bc33-0e28967c8d63 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:42.663497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a7388a64-ce58-4092-ac99-ab1c752b1280 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '.version_select at 0x7ff05c227a60>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:43.240019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-27a4472a-cf95-4e43-b4d8-f83a225f0a16 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:43.251277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-27a4472a-cf95-4e43-b4d8-f83a225f0a16 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:43.269799 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-27a4472a-cf95-4e43-b4d8-f83a225f0a16 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:43.272679 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-27a4472a-cf95-4e43-b4d8-f83a225f0a16 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1879 microversion: 2.42 time: 0.952453 Oct 29 02:54:43.274222 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 850/1889] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:42 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1879 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:54:43.299381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-905cbe2f-57cc-41b3-aebc-d08d4c7a028a tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff053812280>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:43.420206 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-905cbe2f-57cc-41b3-aebc-d08d4c7a028a tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499" status: 200 len: 1428 microversion: 2.1 time: 0.142299 Oct 29 02:54:43.421153 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 851/1890] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:43 2022] GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499 => generated 1428 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:43.675587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-41ee4927-2500-4006-b899-3674f298c333 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff0536a5c10>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:43.766650 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-41ee4927-2500-4006-b899-3674f298c333 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/0cfc4d93-8e9d-42c7-bc33-0e28967c8d63" status: 200 len: 1453 microversion: 2.1 time: 0.084419 Oct 29 02:54:43.772345 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 852/1891] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:43 2022] GET /compute/v2.1/images/0cfc4d93-8e9d-42c7-bc33-0e28967c8d63 => generated 1453 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:54:44.159453 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a7388a64-ce58-4092-ac99-ab1c752b1280 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 1.505639 Oct 29 02:54:44.160685 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1040/1892] 10.222.0.46 () {58 vars in 1158 bytes} [Sat Oct 29 02:54:42 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:44.183684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9d44baeb-be3f-4116-aad1-c87fca75b576 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Action: 'create', calling method: .version_select at 0x7ff0537255e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1104642096", "description": "tempest-description-512690239"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:44.313045 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f07bdbed-f4f5-48d7-a996-9a58666611f4 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:44.314029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f07bdbed-f4f5-48d7-a996-9a58666611f4 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:44.341540 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f07bdbed-f4f5-48d7-a996-9a58666611f4 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:44.345336 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f07bdbed-f4f5-48d7-a996-9a58666611f4 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:44.346006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f07bdbed-f4f5-48d7-a996-9a58666611f4 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:44.350512 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f07bdbed-f4f5-48d7-a996-9a58666611f4 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:44.351705 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f07bdbed-f4f5-48d7-a996-9a58666611f4 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:44.354751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f07bdbed-f4f5-48d7-a996-9a58666611f4 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:45.022295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f07bdbed-f4f5-48d7-a996-9a58666611f4 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:45.038134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f07bdbed-f4f5-48d7-a996-9a58666611f4 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:45.043643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f07bdbed-f4f5-48d7-a996-9a58666611f4 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:45.045213 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f07bdbed-f4f5-48d7-a996-9a58666611f4 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1879 microversion: 2.42 time: 0.742246 Oct 29 02:54:45.048173 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1041/1893] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:44 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1879 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:45.061141 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-afadfaaf-0e30-4da4-8d3c-97c34d1b0ddf tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff05c1138b0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:47.380388 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9d44baeb-be3f-4116-aad1-c87fca75b576 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 3.206223 Oct 29 02:54:47.381221 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 853/1894] 10.222.0.46 () {60 vars in 1180 bytes} [Sat Oct 29 02:54:44 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 3209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:47.396204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8cd47fa7-8dd8-4eab-b495-856d0ec3ecc5 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff0536e49d0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:49.309795 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-afadfaaf-0e30-4da4-8d3c-97c34d1b0ddf tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499" status: 200 len: 1428 microversion: 2.1 time: 4.257989 Oct 29 02:54:49.311132 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8cd47fa7-8dd8-4eab-b495-856d0ec3ecc5 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/0cfc4d93-8e9d-42c7-bc33-0e28967c8d63" status: 200 len: 1462 microversion: 2.1 time: 1.918586 Oct 29 02:54:49.316316 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1042/1896] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:45 2022] GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499 => generated 1428 bytes in 4267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:49.316615 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 854/1896] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:47 2022] GET /compute/v2.1/images/0cfc4d93-8e9d-42c7-bc33-0e28967c8d63 => generated 1462 bytes in 1921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:49.347084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-519c9034-542a-4cde-b492-9df26392eb8b tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Action: 'create', calling method: .version_select at 0x7ff0537e23a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1524257309", "description": "tempest-description-1230614975"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:49.352150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2b3c87fa-3d19-4ec1-97d4-9c6589a3765b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:49.352978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2b3c87fa-3d19-4ec1-97d4-9c6589a3765b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:49.398001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2b3c87fa-3d19-4ec1-97d4-9c6589a3765b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:49.403916 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2b3c87fa-3d19-4ec1-97d4-9c6589a3765b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:49.410148 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2b3c87fa-3d19-4ec1-97d4-9c6589a3765b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:49.411099 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2b3c87fa-3d19-4ec1-97d4-9c6589a3765b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:49.411638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2b3c87fa-3d19-4ec1-97d4-9c6589a3765b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:49.412117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2b3c87fa-3d19-4ec1-97d4-9c6589a3765b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:49.899825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2b3c87fa-3d19-4ec1-97d4-9c6589a3765b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:49.913935 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2b3c87fa-3d19-4ec1-97d4-9c6589a3765b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:49.916457 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2b3c87fa-3d19-4ec1-97d4-9c6589a3765b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:49.920140 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2b3c87fa-3d19-4ec1-97d4-9c6589a3765b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1879 microversion: 2.42 time: 0.601738 Oct 29 02:54:49.923755 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1043/1897] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:49 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1879 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:49.931734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6f1278c1-20c9-496e-8f6d-160ba5aba71d tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c0fb4c0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:50.001801 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6f1278c1-20c9-496e-8f6d-160ba5aba71d tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/0cfc4d93-8e9d-42c7-bc33-0e28967c8d63" status: 200 len: 1462 microversion: 2.1 time: 0.074527 Oct 29 02:54:50.002178 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1044/1898] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:49 2022] GET /compute/v2.1/images/0cfc4d93-8e9d-42c7-bc33-0e28967c8d63 => generated 1462 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:50.018410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c6fcc915-c1d8-42a4-870d-945883db4d8c tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:50.025552 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c6fcc915-c1d8-42a4-870d-945883db4d8c tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 5b856917-a04b-436d-8f9f-5ce0492bc28b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:50.044140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6fcc915-c1d8-42a4-870d-945883db4d8c tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:50.045026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6fcc915-c1d8-42a4-870d-945883db4d8c tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:50.045467 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6fcc915-c1d8-42a4-870d-945883db4d8c tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:50.046183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6fcc915-c1d8-42a4-870d-945883db4d8c tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:50.046635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6fcc915-c1d8-42a4-870d-945883db4d8c tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:50.047080 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6fcc915-c1d8-42a4-870d-945883db4d8c tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:50.079874 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-c6fcc915-c1d8-42a4-870d-945883db4d8c tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] HTTP exception thrown: Instance 5b856917-a04b-436d-8f9f-5ce0492bc28b could not be found. Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c6fcc915-c1d8-42a4-870d-945883db4d8c tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Request method failure captured: Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b HTTP/1.1 Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJVSn1Z6yZnpE5ZLBPheTa94vsOrIOasAiqflLAyq0ViZzIaTN-GngdXiNxVtaUNnT_1JEwPWNZDPigA96-mocavOylAwL683fKA9fknIQSAeDUTDXBmfiqBt0bCvQUYum6e-GWieq2ZcdiDDLPe4J_CpI5GfUyH_e9FdaJLUVdQHvc Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 202abee8256d45b29f190731cc63609c Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersTestMultiNic-604724171 Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/202abee8256d45b29f190731cc63609c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/202abee8256d45b29f190731cc63609c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_202abee8256d45b29f190731cc63609c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/202abee8256d45b29f190731cc63609c"}]}] Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersTestMultiNic-604724171 Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 202abee8256d45b29f190731cc63609c Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersTestMultiNic-604724171 Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersTestMultiNic-604724171-project Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 67c50c8b6b2444a6afa86bc1d019925c Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersTestMultiNic-604724171-project Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 5b856917-a04b-436d-8f9f-5ce0492bc28b could not be found. Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '5b856917-a04b-436d-8f9f-5ce0492bc28b'} Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b856917-a04b-436d-8f9f-5ce0492bc28b could not be found. Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:54:50.097832 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:54:50.109849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b856917-a04b-436d-8f9f-5ce0492bc28b could not be found. Oct 29 02:54:50.109849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:50.109849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:50.109849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:50.109849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:50.109849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:50.109849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:50.109849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:54:50.109849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:54:50.109849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b856917-a04b-436d-8f9f-5ce0492bc28b could not be found. Oct 29 02:54:50.109849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:50.109849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c6fcc915-c1d8-42a4-870d-945883db4d8c tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Returning 404 to user: Instance 5b856917-a04b-436d-8f9f-5ce0492bc28b could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:54:50.109849 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c6fcc915-c1d8-42a4-870d-945883db4d8c tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b" status: 404 len: 111 microversion: 2.1 time: 0.094892 Oct 29 02:54:50.109849 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1045/1899] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:54:50 2022] DELETE /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:54:50.109849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3ef82727-7ac3-497b-954a-b4636d49c0b4 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:50.109849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3ef82727-7ac3-497b-954a-b4636d49c0b4 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:50.122063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ef82727-7ac3-497b-954a-b4636d49c0b4 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:50.122554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ef82727-7ac3-497b-954a-b4636d49c0b4 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:50.122991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ef82727-7ac3-497b-954a-b4636d49c0b4 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:50.123703 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ef82727-7ac3-497b-954a-b4636d49c0b4 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:50.124272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ef82727-7ac3-497b-954a-b4636d49c0b4 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:50.124753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ef82727-7ac3-497b-954a-b4636d49c0b4 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:50.432696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3ef82727-7ac3-497b-954a-b4636d49c0b4 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844dbc8e54d349ea93c632c54909a718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b7aa3004d94c5a8cf87d5f4d006a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:50.446213 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3ef82727-7ac3-497b-954a-b4636d49c0b4 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/servers/0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd" status: 200 len: 1468 microversion: 2.1 time: 0.340791 Oct 29 02:54:50.447792 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1046/1900] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:50 2022] GET /compute/v2.1/servers/0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd => generated 1468 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:50.456951 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e061df2f-30bd-403b-86c1-e52d0fdfff4f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:50.458002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e061df2f-30bd-403b-86c1-e52d0fdfff4f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 5b856917-a04b-436d-8f9f-5ce0492bc28b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:50.471066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e061df2f-30bd-403b-86c1-e52d0fdfff4f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:50.472143 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e061df2f-30bd-403b-86c1-e52d0fdfff4f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:50.472964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e061df2f-30bd-403b-86c1-e52d0fdfff4f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:50.474017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e061df2f-30bd-403b-86c1-e52d0fdfff4f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:50.474503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e061df2f-30bd-403b-86c1-e52d0fdfff4f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:50.475292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e061df2f-30bd-403b-86c1-e52d0fdfff4f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:50.505061 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-e061df2f-30bd-403b-86c1-e52d0fdfff4f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] HTTP exception thrown: Instance 5b856917-a04b-436d-8f9f-5ce0492bc28b could not be found. Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e061df2f-30bd-403b-86c1-e52d0fdfff4f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Request method failure captured: Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b HTTP/1.1 Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJVSn1Z6yZnpE5ZLBPheTa94vsOrIOasAiqflLAyq0ViZzIaTN-GngdXiNxVtaUNnT_1JEwPWNZDPigA96-mocavOylAwL683fKA9fknIQSAeDUTDXBmfiqBt0bCvQUYum6e-GWieq2ZcdiDDLPe4J_CpI5GfUyH_e9FdaJLUVdQHvc Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 202abee8256d45b29f190731cc63609c Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersTestMultiNic-604724171 Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/202abee8256d45b29f190731cc63609c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/202abee8256d45b29f190731cc63609c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_202abee8256d45b29f190731cc63609c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/202abee8256d45b29f190731cc63609c"}]}] Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersTestMultiNic-604724171 Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 202abee8256d45b29f190731cc63609c Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersTestMultiNic-604724171 Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersTestMultiNic-604724171-project Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 67c50c8b6b2444a6afa86bc1d019925c Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersTestMultiNic-604724171-project Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 5b856917-a04b-436d-8f9f-5ce0492bc28b could not be found. Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '5b856917-a04b-436d-8f9f-5ce0492bc28b'} Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b856917-a04b-436d-8f9f-5ce0492bc28b could not be found. Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b856917-a04b-436d-8f9f-5ce0492bc28b could not be found. Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:50.508491 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:50.515082 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:50.515082 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:50.515082 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:50.515082 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:54:50.515082 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:54:50.515082 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b856917-a04b-436d-8f9f-5ce0492bc28b could not be found. Oct 29 02:54:50.515082 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:54:50.519549 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e061df2f-30bd-403b-86c1-e52d0fdfff4f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Returning 404 to user: Instance 5b856917-a04b-436d-8f9f-5ce0492bc28b could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:54:50.520889 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e061df2f-30bd-403b-86c1-e52d0fdfff4f tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b" status: 404 len: 111 microversion: 2.1 time: 0.070643 Oct 29 02:54:50.521690 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1047/1901] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:50 2022] GET /compute/v2.1/servers/5b856917-a04b-436d-8f9f-5ce0492bc28b => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:54:50.530651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-70297dec-8cad-48b5-8f65-5bcf4632d613 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff05c098dc0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:50.614107 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-70297dec-8cad-48b5-8f65-5bcf4632d613 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499" status: 200 len: 1428 microversion: 2.1 time: 0.090955 Oct 29 02:54:50.615759 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1048/1902] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:50 2022] GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499 => generated 1428 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:50.621719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-341171c6-6c25-4fb3-93d8-dbef7bad03f6 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c094f70>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:50.683161 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-519c9034-542a-4cde-b492-9df26392eb8b tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.362074 Oct 29 02:54:50.684231 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 855/1903] 10.222.0.46 () {60 vars in 1180 bytes} [Sat Oct 29 02:54:49 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:50.692250 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3035a3a0-55a5-47b5-926c-c68dc75214b2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:50.695385 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3035a3a0-55a5-47b5-926c-c68dc75214b2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 500595ea-1c83-4574-b6c8-2d6cc39b2231] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:50.716765 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3035a3a0-55a5-47b5-926c-c68dc75214b2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:50.718724 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3035a3a0-55a5-47b5-926c-c68dc75214b2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:50.719711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3035a3a0-55a5-47b5-926c-c68dc75214b2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:50.720917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3035a3a0-55a5-47b5-926c-c68dc75214b2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:50.721753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3035a3a0-55a5-47b5-926c-c68dc75214b2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:50.722687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3035a3a0-55a5-47b5-926c-c68dc75214b2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:50.745674 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-3035a3a0-55a5-47b5-926c-c68dc75214b2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] HTTP exception thrown: Instance 500595ea-1c83-4574-b6c8-2d6cc39b2231 could not be found. Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3035a3a0-55a5-47b5-926c-c68dc75214b2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Request method failure captured: Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231 HTTP/1.1 Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJVSn1Z6yZnpE5ZLBPheTa94vsOrIOasAiqflLAyq0ViZzIaTN-GngdXiNxVtaUNnT_1JEwPWNZDPigA96-mocavOylAwL683fKA9fknIQSAeDUTDXBmfiqBt0bCvQUYum6e-GWieq2ZcdiDDLPe4J_CpI5GfUyH_e9FdaJLUVdQHvc Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 202abee8256d45b29f190731cc63609c Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersTestMultiNic-604724171 Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/202abee8256d45b29f190731cc63609c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/202abee8256d45b29f190731cc63609c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_202abee8256d45b29f190731cc63609c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/202abee8256d45b29f190731cc63609c"}]}] Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersTestMultiNic-604724171 Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 202abee8256d45b29f190731cc63609c Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersTestMultiNic-604724171 Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersTestMultiNic-604724171-project Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 67c50c8b6b2444a6afa86bc1d019925c Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersTestMultiNic-604724171-project Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 500595ea-1c83-4574-b6c8-2d6cc39b2231 could not be found. Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '500595ea-1c83-4574-b6c8-2d6cc39b2231'} Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 500595ea-1c83-4574-b6c8-2d6cc39b2231 could not be found. Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:54:50.747990 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:54:50.755736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 500595ea-1c83-4574-b6c8-2d6cc39b2231 could not be found. Oct 29 02:54:50.755736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:50.755736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:50.755736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:50.755736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:50.755736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:50.755736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:50.755736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:54:50.755736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:54:50.755736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 500595ea-1c83-4574-b6c8-2d6cc39b2231 could not be found. Oct 29 02:54:50.755736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:50.759221 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3035a3a0-55a5-47b5-926c-c68dc75214b2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Returning 404 to user: Instance 500595ea-1c83-4574-b6c8-2d6cc39b2231 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:54:50.760455 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3035a3a0-55a5-47b5-926c-c68dc75214b2 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "DELETE /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231" status: 404 len: 111 microversion: 2.1 time: 0.073860 Oct 29 02:54:50.765431 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 856/1904] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:54:50 2022] DELETE /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:54:50.772828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f9d281fe-611a-425f-a66e-6cc22afb7754 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:50.774001 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f9d281fe-611a-425f-a66e-6cc22afb7754 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] [instance: 500595ea-1c83-4574-b6c8-2d6cc39b2231] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:50.783568 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9d281fe-611a-425f-a66e-6cc22afb7754 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:50.784403 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9d281fe-611a-425f-a66e-6cc22afb7754 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:50.785118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9d281fe-611a-425f-a66e-6cc22afb7754 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:50.786752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9d281fe-611a-425f-a66e-6cc22afb7754 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:50.788996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9d281fe-611a-425f-a66e-6cc22afb7754 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:50.793239 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9d281fe-611a-425f-a66e-6cc22afb7754 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:50.821379 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-f9d281fe-611a-425f-a66e-6cc22afb7754 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] HTTP exception thrown: Instance 500595ea-1c83-4574-b6c8-2d6cc39b2231 could not be found. Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f9d281fe-611a-425f-a66e-6cc22afb7754 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Request method failure captured: Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231 HTTP/1.1 Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJVSn1Z6yZnpE5ZLBPheTa94vsOrIOasAiqflLAyq0ViZzIaTN-GngdXiNxVtaUNnT_1JEwPWNZDPigA96-mocavOylAwL683fKA9fknIQSAeDUTDXBmfiqBt0bCvQUYum6e-GWieq2ZcdiDDLPe4J_CpI5GfUyH_e9FdaJLUVdQHvc Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 202abee8256d45b29f190731cc63609c Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersTestMultiNic-604724171 Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/202abee8256d45b29f190731cc63609c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/202abee8256d45b29f190731cc63609c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_202abee8256d45b29f190731cc63609c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/202abee8256d45b29f190731cc63609c"}]}] Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersTestMultiNic-604724171 Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 202abee8256d45b29f190731cc63609c Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersTestMultiNic-604724171 Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersTestMultiNic-604724171-project Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 67c50c8b6b2444a6afa86bc1d019925c Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersTestMultiNic-604724171-project Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 500595ea-1c83-4574-b6c8-2d6cc39b2231 could not be found. Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '500595ea-1c83-4574-b6c8-2d6cc39b2231'} Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 500595ea-1c83-4574-b6c8-2d6cc39b2231 could not be found. Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 500595ea-1c83-4574-b6c8-2d6cc39b2231 could not be found. Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:54:50.827131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:50.833744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:54:50.833744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:54:50.833744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:54:50.833744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:54:50.833744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:54:50.833744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 500595ea-1c83-4574-b6c8-2d6cc39b2231 could not be found. Oct 29 02:54:50.833744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:54:50.837567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f9d281fe-611a-425f-a66e-6cc22afb7754 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] Returning 404 to user: Instance 500595ea-1c83-4574-b6c8-2d6cc39b2231 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:54:50.838762 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f9d281fe-611a-425f-a66e-6cc22afb7754 tempest-ServersTestMultiNic-604724171 tempest-ServersTestMultiNic-604724171-project] 10.222.0.46 "GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231" status: 404 len: 111 microversion: 2.1 time: 0.071272 Oct 29 02:54:50.853686 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 857/1905] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:50 2022] GET /compute/v2.1/servers/500595ea-1c83-4574-b6c8-2d6cc39b2231 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:54:50.873603 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-341171c6-6c25-4fb3-93d8-dbef7bad03f6 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images?changes-since=2022-10-29T02%3A52%3A19Z" status: 200 len: 1900 microversion: 2.1 time: 0.256563 Oct 29 02:54:50.874190 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1049/1906] 10.222.0.46 () {58 vars in 1199 bytes} [Sat Oct 29 02:54:50 2022] GET /compute/v2.1/images?changes-since=2022-10-29T02%3A52%3A19Z => generated 1900 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:50.892141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-24020a74-850a-49c6-8d84-8c3dcc3834b8 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05370c550>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:50.953829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6bf0462d-c2b8-4b5e-8397-f57d71be0896 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:50.954668 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6bf0462d-c2b8-4b5e-8397-f57d71be0896 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:50.973658 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6bf0462d-c2b8-4b5e-8397-f57d71be0896 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:50.974151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6bf0462d-c2b8-4b5e-8397-f57d71be0896 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:50.978670 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6bf0462d-c2b8-4b5e-8397-f57d71be0896 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:50.980449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6bf0462d-c2b8-4b5e-8397-f57d71be0896 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:50.981620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6bf0462d-c2b8-4b5e-8397-f57d71be0896 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:50.985281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6bf0462d-c2b8-4b5e-8397-f57d71be0896 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:51.053773 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-24020a74-850a-49c6-8d84-8c3dcc3834b8 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-973963772" status: 200 len: 484 microversion: 2.1 time: 0.161982 Oct 29 02:54:51.054422 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 858/1907] 10.222.0.46 () {58 vars in 1229 bytes} [Sat Oct 29 02:54:50 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-973963772 => generated 484 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:54:51.088296 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cc6a4358-9818-4d3a-9a7b-f8c48a7ef0dd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1715039472", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "4a1725e9-7e18-4e19-a3ee-ed879bb037c8"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:51.191470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-cc6a4358-9818-4d3a-9a7b-f8c48a7ef0dd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] validate_networks() for [('4a1725e9-7e18-4e19-a3ee-ed879bb037c8', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:54:51.818583 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6bf0462d-c2b8-4b5e-8397-f57d71be0896 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:51.870552 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6bf0462d-c2b8-4b5e-8397-f57d71be0896 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:51.875636 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6bf0462d-c2b8-4b5e-8397-f57d71be0896 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:51.879751 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6bf0462d-c2b8-4b5e-8397-f57d71be0896 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1879 microversion: 2.42 time: 0.930013 Oct 29 02:54:51.896553 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1050/1908] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:50 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1879 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:51.896553 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3126991d-375c-480d-b659-030e46a93c5f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c0984c0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:52.108604 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3126991d-375c-480d-b659-030e46a93c5f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images?server=0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd" status: 200 len: 957 microversion: 2.1 time: 0.217557 Oct 29 02:54:52.112592 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1051/1909] 10.222.0.46 () {58 vars in 1209 bytes} [Sat Oct 29 02:54:51 2022] GET /compute/v2.1/images?server=0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd => generated 957 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:52.129006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1c9da8fc-f1c1-4e79-9463-7c05ebfd58a8 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff05c0a40d0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:52.231815 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1c9da8fc-f1c1-4e79-9463-7c05ebfd58a8 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499" status: 200 len: 1428 microversion: 2.1 time: 0.110979 Oct 29 02:54:52.232426 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1052/1910] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:52 2022] GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499 => generated 1428 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:52.265262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a8244228-2476-47ab-a1e2-27b6234e1d97 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c0a4a60>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:52.399694 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a8244228-2476-47ab-a1e2-27b6234e1d97 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.46%2Fcompute%2Fv2.1%2Fservers%2F1123b300-f298-4071-bff4-8ddc088ee57f" status: 200 len: 484 microversion: 2.1 time: 0.156900 Oct 29 02:54:52.404040 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1053/1911] 10.222.0.46 () {58 vars in 1317 bytes} [Sat Oct 29 02:54:52 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.46%2Fcompute%2Fv2.1%2Fservers%2F1123b300-f298-4071-bff4-8ddc088ee57f => generated 484 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:52.419183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e7094b0d-80a6-4620-86ee-bd228a79e586 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c0fb430>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:52.552388 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e7094b0d-80a6-4620-86ee-bd228a79e586 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.46%2Fcompute%2Fservers%2F1123b300-f298-4071-bff4-8ddc088ee57f" status: 200 len: 484 microversion: 2.1 time: 0.139894 Oct 29 02:54:52.555263 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1054/1912] 10.222.0.46 () {58 vars in 1303 bytes} [Sat Oct 29 02:54:52 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.46%2Fcompute%2Fservers%2F1123b300-f298-4071-bff4-8ddc088ee57f => generated 484 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:52.573449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4cdaed47-d7ab-47ab-8bc7-2b65159f7886 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c0b8c10>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:52.800062 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4cdaed47-d7ab-47ab-8bc7-2b65159f7886 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3278 microversion: 2.1 time: 0.230606 Oct 29 02:54:52.813125 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1055/1913] 10.222.0.46 () {58 vars in 1149 bytes} [Sat Oct 29 02:54:52 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3278 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:52.822151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-173a4d62-f34a-4587-b6bf-46c7e5245853 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c098ee0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:52.952173 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-173a4d62-f34a-4587-b6bf-46c7e5245853 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.133918 Oct 29 02:54:52.952799 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1056/1914] 10.222.0.46 () {58 vars in 1149 bytes} [Sat Oct 29 02:54:52 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:54:52.973570 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e06c55a9-1c62-44fe-af28-ed328d5278e8 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:52.974197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e06c55a9-1c62-44fe-af28-ed328d5278e8 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:52.998853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e06c55a9-1c62-44fe-af28-ed328d5278e8 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:52.999360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e06c55a9-1c62-44fe-af28-ed328d5278e8 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:52.999803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e06c55a9-1c62-44fe-af28-ed328d5278e8 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:53.000615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e06c55a9-1c62-44fe-af28-ed328d5278e8 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:53.001078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e06c55a9-1c62-44fe-af28-ed328d5278e8 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:53.001507 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e06c55a9-1c62-44fe-af28-ed328d5278e8 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:53.394658 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e06c55a9-1c62-44fe-af28-ed328d5278e8 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:53.416679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e06c55a9-1c62-44fe-af28-ed328d5278e8 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:53.418489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e06c55a9-1c62-44fe-af28-ed328d5278e8 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:53.420996 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e06c55a9-1c62-44fe-af28-ed328d5278e8 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1879 microversion: 2.42 time: 0.467114 Oct 29 02:54:53.423885 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1057/1915] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:52 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1879 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:53.437162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e28589c3-34a2-4581-b93c-264202686c63 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c098b80>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:53.466344 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-cc6a4358-9818-4d3a-9a7b-f8c48a7ef0dd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:54:53.467593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-cc6a4358-9818-4d3a-9a7b-f8c48a7ef0dd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:54:53.468268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-cc6a4358-9818-4d3a-9a7b-f8c48a7ef0dd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:54:53.469148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-cc6a4358-9818-4d3a-9a7b-f8c48a7ef0dd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:54:53.469780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-cc6a4358-9818-4d3a-9a7b-f8c48a7ef0dd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:54:53.512473 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc6a4358-9818-4d3a-9a7b-f8c48a7ef0dd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:53.521861 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc6a4358-9818-4d3a-9a7b-f8c48a7ef0dd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:53.525450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc6a4358-9818-4d3a-9a7b-f8c48a7ef0dd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:53.526587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc6a4358-9818-4d3a-9a7b-f8c48a7ef0dd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:53.530516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc6a4358-9818-4d3a-9a7b-f8c48a7ef0dd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:53.535662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc6a4358-9818-4d3a-9a7b-f8c48a7ef0dd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:53.612434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-cc6a4358-9818-4d3a-9a7b-f8c48a7ef0dd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Getting quotas for project 49721a0af93a47d38613f4a588ab1e1a. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:54:53.634895 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-cc6a4358-9818-4d3a-9a7b-f8c48a7ef0dd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Getting quotas for user 971f709818b74757947beafd14f546bf and project 49721a0af93a47d38613f4a588ab1e1a. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:54:53.698922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cc6a4358-9818-4d3a-9a7b-f8c48a7ef0dd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:54:53.702038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cc6a4358-9818-4d3a-9a7b-f8c48a7ef0dd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:54:53.702404 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e28589c3-34a2-4581-b93c-264202686c63 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.276632 Oct 29 02:54:53.703309 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1058/1916] 10.222.0.46 () {58 vars in 1137 bytes} [Sat Oct 29 02:54:53 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:53.714643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-44554a00-d422-405f-b56b-c2d5f72bd926 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff05c149ca0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:53.829185 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-44554a00-d422-405f-b56b-c2d5f72bd926 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499" status: 200 len: 1428 microversion: 2.1 time: 0.124257 Oct 29 02:54:53.840792 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1059/1917] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:53 2022] GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499 => generated 1428 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:53.858278 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5c29cfbc-e2b2-4fbf-acf2-d931b56e58e5 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c227a60>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:53.868543 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cc6a4358-9818-4d3a-9a7b-f8c48a7ef0dd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.784159 Oct 29 02:54:53.869965 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 859/1918] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:54:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:54:53.898121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e60faae2-9d6f-4ab5-ae2f-3b52a2a779e9 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:53.898792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e60faae2-9d6f-4ab5-ae2f-3b52a2a779e9 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:54.176503 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5c29cfbc-e2b2-4fbf-acf2-d931b56e58e5 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/detail?changes-since=2022-10-29T02%3A52%3A08Z" status: 200 len: 6325 microversion: 2.1 time: 0.322796 Oct 29 02:54:54.177117 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1060/1919] 10.222.0.46 () {58 vars in 1220 bytes} [Sat Oct 29 02:54:53 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-29T02%3A52%3A08Z => generated 6325 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:54.203906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8a2904a0-d900-4dcd-9f71-8461f15299ab tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c0b8a60>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:54.238895 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e60faae2-9d6f-4ab5-ae2f-3b52a2a779e9 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971f709818b74757947beafd14f546bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49721a0af93a47d38613f4a588ab1e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:54.278825 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e60faae2-9d6f-4ab5-ae2f-3b52a2a779e9 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1" status: 200 len: 1216 microversion: 2.1 time: 0.392343 Oct 29 02:54:54.297562 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 860/1920] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:53 2022] GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 => generated 1216 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:54.365655 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8a2904a0-d900-4dcd-9f71-8461f15299ab tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-973963772" status: 200 len: 664 microversion: 2.1 time: 0.165767 Oct 29 02:54:54.368860 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1061/1921] 10.222.0.46 () {58 vars in 1250 bytes} [Sat Oct 29 02:54:54 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-973963772 => generated 664 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:54.384459 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a7022d9f-53e7-4924-abc0-fb1f7bdafe32 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff0536acf70>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:54.451892 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-acb07d6e-645d-4455-aa8b-464e79d6ebe7 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:54.453093 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-acb07d6e-645d-4455-aa8b-464e79d6ebe7 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:54.464974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-acb07d6e-645d-4455-aa8b-464e79d6ebe7 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:54.465689 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-acb07d6e-645d-4455-aa8b-464e79d6ebe7 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:54.469213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-acb07d6e-645d-4455-aa8b-464e79d6ebe7 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:54.469968 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-acb07d6e-645d-4455-aa8b-464e79d6ebe7 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:54.470614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-acb07d6e-645d-4455-aa8b-464e79d6ebe7 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:54.471468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-acb07d6e-645d-4455-aa8b-464e79d6ebe7 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:54.562801 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a7022d9f-53e7-4924-abc0-fb1f7bdafe32 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.46%2Fcompute%2Fv2.1%2Fservers%2F1123b300-f298-4071-bff4-8ddc088ee57f" status: 200 len: 1464 microversion: 2.1 time: 0.183468 Oct 29 02:54:54.563496 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 861/1922] 10.222.0.46 () {58 vars in 1338 bytes} [Sat Oct 29 02:54:54 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.46%2Fcompute%2Fv2.1%2Fservers%2F1123b300-f298-4071-bff4-8ddc088ee57f => generated 1464 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:54.588843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d6ad1509-789a-4c5b-98af-7bcaf2ec256e tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff0536b40d0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:54.781184 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d6ad1509-789a-4c5b-98af-7bcaf2ec256e tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.46%2Fcompute%2Fservers%2F1123b300-f298-4071-bff4-8ddc088ee57f" status: 200 len: 1464 microversion: 2.1 time: 0.205132 Oct 29 02:54:54.782085 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 862/1923] 10.222.0.46 () {58 vars in 1324 bytes} [Sat Oct 29 02:54:54 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.46%2Fcompute%2Fservers%2F1123b300-f298-4071-bff4-8ddc088ee57f => generated 1464 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:55.037516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-397f9a00-d918-4b5f-a3f5-f861811073dd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-930083484", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "17f9d1fa-d455-4aad-a38d-7102e34b2edd"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:55.147358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-acb07d6e-645d-4455-aa8b-464e79d6ebe7 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:55.163342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-acb07d6e-645d-4455-aa8b-464e79d6ebe7 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:55.181226 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-acb07d6e-645d-4455-aa8b-464e79d6ebe7 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:55.182521 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-acb07d6e-645d-4455-aa8b-464e79d6ebe7 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1879 microversion: 2.42 time: 0.735108 Oct 29 02:54:55.185560 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1062/1924] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:54 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1879 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:55.193024 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-051138a7-73f0-4d6d-8883-038ecad68606 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c1b1ee0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:55.209037 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-397f9a00-d918-4b5f-a3f5-f861811073dd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] validate_networks() for [('17f9d1fa-d455-4aad-a38d-7102e34b2edd', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:54:55.461608 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-051138a7-73f0-4d6d-8883-038ecad68606 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7100 microversion: 2.1 time: 0.274509 Oct 29 02:54:55.474110 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1063/1925] 10.222.0.46 () {58 vars in 1170 bytes} [Sat Oct 29 02:54:55 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7100 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:55.496860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-30db7c1c-4965-41ba-8c16-92041b9d0a92 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff05c0a6e50>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:55.580985 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-30db7c1c-4965-41ba-8c16-92041b9d0a92 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499" status: 200 len: 1428 microversion: 2.1 time: 0.104278 Oct 29 02:54:55.584060 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1064/1926] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:55 2022] GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499 => generated 1428 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:55.611266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5a7c9871-bf26-404b-b70e-e1dfddf6a1b4 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:55.621732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5a7c9871-bf26-404b-b70e-e1dfddf6a1b4 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:55.636274 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a7c9871-bf26-404b-b70e-e1dfddf6a1b4 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:55.637519 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a7c9871-bf26-404b-b70e-e1dfddf6a1b4 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:55.639235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a7c9871-bf26-404b-b70e-e1dfddf6a1b4 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:55.640781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a7c9871-bf26-404b-b70e-e1dfddf6a1b4 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:55.644308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a7c9871-bf26-404b-b70e-e1dfddf6a1b4 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:55.653242 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a7c9871-bf26-404b-b70e-e1dfddf6a1b4 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:55.817969 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5a7c9871-bf26-404b-b70e-e1dfddf6a1b4 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971f709818b74757947beafd14f546bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49721a0af93a47d38613f4a588ab1e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:55.833401 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5a7c9871-bf26-404b-b70e-e1dfddf6a1b4 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1" status: 200 len: 1268 microversion: 2.1 time: 0.234616 Oct 29 02:54:55.841954 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1065/1927] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:55 2022] GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 => generated 1268 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:55.861607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f474c7b4-3e46-4930-966c-3b6e7fd2eb50 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c1493a0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:56.066138 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f474c7b4-3e46-4930-966c-3b6e7fd2eb50 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4369 microversion: 2.1 time: 0.214622 Oct 29 02:54:56.068108 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1066/1928] 10.222.0.46 () {58 vars in 1170 bytes} [Sat Oct 29 02:54:55 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4369 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:56.094017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0b942dcb-c093-40f3-983f-c09d79bd6c44 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c0984c0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:56.170846 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0b942dcb-c093-40f3-983f-c09d79bd6c44 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/cd315600-df67-41c1-95d3-95a5145fc39a" status: 200 len: 784 microversion: 2.1 time: 0.084118 Oct 29 02:54:56.173548 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1067/1929] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:56 2022] GET /compute/v2.1/images/cd315600-df67-41c1-95d3-95a5145fc39a => generated 784 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:56.209744 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6701eb2f-1ef2-4c47-a4d5-7ffff4fb763a tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c24b8b0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:56.319027 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6701eb2f-1ef2-4c47-a4d5-7ffff4fb763a tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.120456 Oct 29 02:54:56.323309 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1068/1930] 10.222.0.46 () {58 vars in 1158 bytes} [Sat Oct 29 02:54:56 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:56.344126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-34d5aa93-68bc-4cef-a819-07fa87216af2 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:56.350784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-34d5aa93-68bc-4cef-a819-07fa87216af2 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:56.379410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34d5aa93-68bc-4cef-a819-07fa87216af2 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:56.379989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34d5aa93-68bc-4cef-a819-07fa87216af2 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:56.380440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34d5aa93-68bc-4cef-a819-07fa87216af2 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:56.381210 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34d5aa93-68bc-4cef-a819-07fa87216af2 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:56.381662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34d5aa93-68bc-4cef-a819-07fa87216af2 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:56.382083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34d5aa93-68bc-4cef-a819-07fa87216af2 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:57.216206 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-34d5aa93-68bc-4cef-a819-07fa87216af2 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:57.255691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-34d5aa93-68bc-4cef-a819-07fa87216af2 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:57.264925 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-34d5aa93-68bc-4cef-a819-07fa87216af2 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:57.272315 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-34d5aa93-68bc-4cef-a819-07fa87216af2 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1879 microversion: 2.42 time: 0.942439 Oct 29 02:54:57.274681 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1069/1931] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:56 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1879 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:54:57.299922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1ad0f819-74f3-47af-ab11-bf24480303f1 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c227700>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:57.795493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-397f9a00-d918-4b5f-a3f5-f861811073dd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:54:57.796091 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-397f9a00-d918-4b5f-a3f5-f861811073dd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:54:57.796360 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-397f9a00-d918-4b5f-a3f5-f861811073dd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:54:57.796859 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-397f9a00-d918-4b5f-a3f5-f861811073dd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:54:57.797272 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-397f9a00-d918-4b5f-a3f5-f861811073dd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:54:57.818294 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-397f9a00-d918-4b5f-a3f5-f861811073dd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:57.818793 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-397f9a00-d918-4b5f-a3f5-f861811073dd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:57.819347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-397f9a00-d918-4b5f-a3f5-f861811073dd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:57.820624 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-397f9a00-d918-4b5f-a3f5-f861811073dd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:57.821457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-397f9a00-d918-4b5f-a3f5-f861811073dd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:57.822175 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-397f9a00-d918-4b5f-a3f5-f861811073dd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:57.897993 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-397f9a00-d918-4b5f-a3f5-f861811073dd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Getting quotas for project 3102dffa1e6843c6b5caa93b81a2fbfd. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:54:57.953991 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-397f9a00-d918-4b5f-a3f5-f861811073dd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Getting quotas for user fb6300e24201407ba4c09cb25d247b2d and project 3102dffa1e6843c6b5caa93b81a2fbfd. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:54:58.007464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-397f9a00-d918-4b5f-a3f5-f861811073dd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:54:58.024906 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-397f9a00-d918-4b5f-a3f5-f861811073dd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] [instance: 4463e53e-8eb7-45b7-ac0b-05204c79896a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:54:58.163093 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-397f9a00-d918-4b5f-a3f5-f861811073dd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.377654 Oct 29 02:54:58.170472 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 863/1932] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:54:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3387 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:54:58.177522 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-40c76623-e10c-43b8-8782-3efcd61fcd39 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff05385b550>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:59.166117 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1ad0f819-74f3-47af-ab11-bf24480303f1 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "DELETE /compute/v2.1/images/0cfc4d93-8e9d-42c7-bc33-0e28967c8d63" status: 204 len: 0 microversion: 2.1 time: 1.882870 Oct 29 02:54:59.169696 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1070/1933] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:57 2022] DELETE /compute/v2.1/images/0cfc4d93-8e9d-42c7-bc33-0e28967c8d63 => generated 0 bytes in 1889 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:54:59.175393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6b356b2e-174b-4fff-a6e9-429ee2d2968e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:59.175932 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6b356b2e-174b-4fff-a6e9-429ee2d2968e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:59.202528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b356b2e-174b-4fff-a6e9-429ee2d2968e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:59.203092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b356b2e-174b-4fff-a6e9-429ee2d2968e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:59.203542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b356b2e-174b-4fff-a6e9-429ee2d2968e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:59.211890 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b356b2e-174b-4fff-a6e9-429ee2d2968e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:59.212515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b356b2e-174b-4fff-a6e9-429ee2d2968e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:59.212994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b356b2e-174b-4fff-a6e9-429ee2d2968e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:59.250518 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-40c76623-e10c-43b8-8782-3efcd61fcd39 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499" status: 200 len: 1428 microversion: 2.1 time: 1.076756 Oct 29 02:54:59.260394 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 864/1934] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:58 2022] GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499 => generated 1428 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:59.276012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-0e208d5f-af4c-406a-8a2b-3b48bb30dd5d req-e450cab0-1441-4b88-b1c0-46ff4f11d16a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd", "name": "network-vif-unplugged", "status": "completed", "tag": "9daf432c-ab9e-41ed-aaf7-21cb4e7d509f"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:54:59.326164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0e208d5f-af4c-406a-8a2b-3b48bb30dd5d req-e450cab0-1441-4b88-b1c0-46ff4f11d16a service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:59.327034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0e208d5f-af4c-406a-8a2b-3b48bb30dd5d req-e450cab0-1441-4b88-b1c0-46ff4f11d16a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:59.327655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0e208d5f-af4c-406a-8a2b-3b48bb30dd5d req-e450cab0-1441-4b88-b1c0-46ff4f11d16a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:59.372938 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-0e208d5f-af4c-406a-8a2b-3b48bb30dd5d req-e450cab0-1441-4b88-b1c0-46ff4f11d16a service nova] Creating event network-vif-unplugged:9daf432c-ab9e-41ed-aaf7-21cb4e7d509f for instance 0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd on n-h1-862967-2 Oct 29 02:54:59.389606 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-0e208d5f-af4c-406a-8a2b-3b48bb30dd5d req-e450cab0-1441-4b88-b1c0-46ff4f11d16a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119667 Oct 29 02:54:59.398686 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 865/1935] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:54:59.405788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9455f5e2-e95f-481f-afbb-e2cb1f5261ba tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:59.428374 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9455f5e2-e95f-481f-afbb-e2cb1f5261ba tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] [instance: 4463e53e-8eb7-45b7-ac0b-05204c79896a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:59.449212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9455f5e2-e95f-481f-afbb-e2cb1f5261ba tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:59.450386 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9455f5e2-e95f-481f-afbb-e2cb1f5261ba tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:59.451339 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9455f5e2-e95f-481f-afbb-e2cb1f5261ba tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:59.452794 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9455f5e2-e95f-481f-afbb-e2cb1f5261ba tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:59.454287 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9455f5e2-e95f-481f-afbb-e2cb1f5261ba tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:59.467516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9455f5e2-e95f-481f-afbb-e2cb1f5261ba tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:59.641601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9455f5e2-e95f-481f-afbb-e2cb1f5261ba tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6300e24201407ba4c09cb25d247b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102dffa1e6843c6b5caa93b81a2fbfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:59.649849 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9455f5e2-e95f-481f-afbb-e2cb1f5261ba tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] 10.222.0.46 "GET /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a" status: 200 len: 1235 microversion: 2.1 time: 0.248148 Oct 29 02:54:59.657428 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 866/1936] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:59 2022] GET /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a => generated 1235 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:59.662812 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c7c92f6b-bd63-4083-9e2f-8b2bd0a8f707 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:54:59.666004 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c7c92f6b-bd63-4083-9e2f-8b2bd0a8f707 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:54:59.686270 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7c92f6b-bd63-4083-9e2f-8b2bd0a8f707 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:59.687226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7c92f6b-bd63-4083-9e2f-8b2bd0a8f707 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:59.689094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7c92f6b-bd63-4083-9e2f-8b2bd0a8f707 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:59.690264 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7c92f6b-bd63-4083-9e2f-8b2bd0a8f707 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:54:59.691286 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7c92f6b-bd63-4083-9e2f-8b2bd0a8f707 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:54:59.693731 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7c92f6b-bd63-4083-9e2f-8b2bd0a8f707 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:54:59.795658 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6b356b2e-174b-4fff-a6e9-429ee2d2968e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971f709818b74757947beafd14f546bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49721a0af93a47d38613f4a588ab1e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:54:59.813313 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6b356b2e-174b-4fff-a6e9-429ee2d2968e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1" status: 200 len: 1274 microversion: 2.1 time: 0.642393 Oct 29 02:54:59.817183 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1071/1937] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:59 2022] GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 => generated 1274 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:54:59.854525 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b208afa0-ed8c-477d-ab36-5770d4973233 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff05c098160>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:00.184955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c7c92f6b-bd63-4083-9e2f-8b2bd0a8f707 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:00.213711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c7c92f6b-bd63-4083-9e2f-8b2bd0a8f707 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:00.218366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c7c92f6b-bd63-4083-9e2f-8b2bd0a8f707 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:00.221964 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c7c92f6b-bd63-4083-9e2f-8b2bd0a8f707 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1879 microversion: 2.42 time: 0.563196 Oct 29 02:55:00.223056 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 867/1938] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:54:59 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1879 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:55:00.301771 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3780aceb-3f1e-4fb5-9ca0-9a328369be6f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1671427381", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "bca2d547-c353-4bb4-a9d9-94595c523fe6"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:01.283984 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b208afa0-ed8c-477d-ab36-5770d4973233 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "DELETE /compute/v2.1/images/3588b1c1-f15e-425c-8711-d112abef0137" status: 204 len: 0 microversion: 2.1 time: 1.444303 Oct 29 02:55:01.284845 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1072/1939] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:54:59 2022] DELETE /compute/v2.1/images/3588b1c1-f15e-425c-8711-d112abef0137 => generated 0 bytes in 1446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:55:01.290692 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-49b9ad19-85c8-4e90-80a0-a0496e5fbf4b tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff05c0f4e50>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:01.392995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-3780aceb-3f1e-4fb5-9ca0-9a328369be6f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] validate_networks() for [('bca2d547-c353-4bb4-a9d9-94595c523fe6', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:55:01.418484 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-49b9ad19-85c8-4e90-80a0-a0496e5fbf4b tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499" status: 200 len: 1428 microversion: 2.1 time: 0.131843 Oct 29 02:55:01.422348 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1073/1940] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:01 2022] GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499 => generated 1428 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:01.433122 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7707f7df-be05-4dff-b853-9ffd2992171d tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:01.437262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7707f7df-be05-4dff-b853-9ffd2992171d tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] [instance: 4463e53e-8eb7-45b7-ac0b-05204c79896a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:01.451328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7707f7df-be05-4dff-b853-9ffd2992171d tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:01.452339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7707f7df-be05-4dff-b853-9ffd2992171d tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:01.452830 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7707f7df-be05-4dff-b853-9ffd2992171d tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:01.453584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7707f7df-be05-4dff-b853-9ffd2992171d tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:01.454035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7707f7df-be05-4dff-b853-9ffd2992171d tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:01.454462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7707f7df-be05-4dff-b853-9ffd2992171d tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:01.733453 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7707f7df-be05-4dff-b853-9ffd2992171d tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6300e24201407ba4c09cb25d247b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102dffa1e6843c6b5caa93b81a2fbfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:01.740078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:01.746734 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7707f7df-be05-4dff-b853-9ffd2992171d tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] 10.222.0.46 "GET /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a" status: 200 len: 1289 microversion: 2.1 time: 0.322756 Oct 29 02:55:01.747329 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1074/1941] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:01 2022] GET /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a => generated 1289 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:01.764644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6257faf8-6703-43e5-85f2-3a66e581ae7d tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:01.765656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6257faf8-6703-43e5-85f2-3a66e581ae7d tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:01.774681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:01.784189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6257faf8-6703-43e5-85f2-3a66e581ae7d tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:01.785634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6257faf8-6703-43e5-85f2-3a66e581ae7d tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:01.786288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6257faf8-6703-43e5-85f2-3a66e581ae7d tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:01.787236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6257faf8-6703-43e5-85f2-3a66e581ae7d tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:01.789331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6257faf8-6703-43e5-85f2-3a66e581ae7d tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:01.790159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6257faf8-6703-43e5-85f2-3a66e581ae7d tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:02.204395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6257faf8-6703-43e5-85f2-3a66e581ae7d tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971f709818b74757947beafd14f546bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49721a0af93a47d38613f4a588ab1e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:02.231509 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6257faf8-6703-43e5-85f2-3a66e581ae7d tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1" status: 200 len: 1274 microversion: 2.1 time: 0.482868 Oct 29 02:55:02.236228 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1075/1942] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:01 2022] GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 => generated 1274 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:02.248161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bf936670-b4c0-4e4a-9474-f40b9ee235c5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:02.250753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bf936670-b4c0-4e4a-9474-f40b9ee235c5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:02.264341 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf936670-b4c0-4e4a-9474-f40b9ee235c5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:02.265420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf936670-b4c0-4e4a-9474-f40b9ee235c5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:02.266182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf936670-b4c0-4e4a-9474-f40b9ee235c5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:02.268467 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf936670-b4c0-4e4a-9474-f40b9ee235c5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:02.269995 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf936670-b4c0-4e4a-9474-f40b9ee235c5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:02.270603 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf936670-b4c0-4e4a-9474-f40b9ee235c5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:03.000064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-3780aceb-3f1e-4fb5-9ca0-9a328369be6f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:55:03.009787 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-3780aceb-3f1e-4fb5-9ca0-9a328369be6f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:55:03.018815 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-3780aceb-3f1e-4fb5-9ca0-9a328369be6f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:55:03.033803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-3780aceb-3f1e-4fb5-9ca0-9a328369be6f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:55:03.035812 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-3780aceb-3f1e-4fb5-9ca0-9a328369be6f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:55:03.054805 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:03.118907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3780aceb-3f1e-4fb5-9ca0-9a328369be6f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:03.119484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3780aceb-3f1e-4fb5-9ca0-9a328369be6f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:03.123854 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3780aceb-3f1e-4fb5-9ca0-9a328369be6f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:03.125002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3780aceb-3f1e-4fb5-9ca0-9a328369be6f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:03.127152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3780aceb-3f1e-4fb5-9ca0-9a328369be6f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:03.128004 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3780aceb-3f1e-4fb5-9ca0-9a328369be6f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:03.157784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=67 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:03.200194 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-3780aceb-3f1e-4fb5-9ca0-9a328369be6f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Getting quotas for project cb1c877c178847ad8e652dda9a20e724. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:55:03.238641 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-3780aceb-3f1e-4fb5-9ca0-9a328369be6f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Getting quotas for user 68198185a8314417b2b5d09e831ff4fd and project cb1c877c178847ad8e652dda9a20e724. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:55:03.276856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3780aceb-3f1e-4fb5-9ca0-9a328369be6f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:55:03.281089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3780aceb-3f1e-4fb5-9ca0-9a328369be6f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:55:03.426124 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3780aceb-3f1e-4fb5-9ca0-9a328369be6f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.199301 Oct 29 02:55:03.433931 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 868/1943] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:55:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:55:03.445409 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-411caad7-cb0d-4c1e-878f-a0755cd0accc tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff0536a5ee0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:03.561844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bf936670-b4c0-4e4a-9474-f40b9ee235c5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:03.592717 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bf936670-b4c0-4e4a-9474-f40b9ee235c5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:03.626694 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bf936670-b4c0-4e4a-9474-f40b9ee235c5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:03.635122 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bf936670-b4c0-4e4a-9474-f40b9ee235c5 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1879 microversion: 2.42 time: 1.391233 Oct 29 02:55:03.640741 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1076/1944] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:55:02 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1879 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:55:03.675298 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-1cbc7250-703b-43d0-b42e-29069dc31d17 req-33823937-8657-4009-85ca-d5922cb09f79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc", "name": "network-vif-plugged", "status": "completed", "tag": "79864797-817a-49a1-9e41-46b8d629427a"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:03.702924 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1cbc7250-703b-43d0-b42e-29069dc31d17 req-33823937-8657-4009-85ca-d5922cb09f79 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:03.703488 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1cbc7250-703b-43d0-b42e-29069dc31d17 req-33823937-8657-4009-85ca-d5922cb09f79 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:03.703843 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1cbc7250-703b-43d0-b42e-29069dc31d17 req-33823937-8657-4009-85ca-d5922cb09f79 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:03.767332 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-1cbc7250-703b-43d0-b42e-29069dc31d17 req-33823937-8657-4009-85ca-d5922cb09f79 service nova] Creating event network-vif-plugged:79864797-817a-49a1-9e41-46b8d629427a for instance c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc on n-h2-862967-2 Oct 29 02:55:03.786957 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-1cbc7250-703b-43d0-b42e-29069dc31d17 req-33823937-8657-4009-85ca-d5922cb09f79 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115991 Oct 29 02:55:03.788295 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1077/1945] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:03.813881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-86fcea90-b254-49e3-8e0b-f1f942a5ece4 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff05c1499d0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:04.874524 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-411caad7-cb0d-4c1e-878f-a0755cd0accc tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "DELETE /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59" status: 204 len: 0 microversion: 2.1 time: 1.439138 Oct 29 02:55:04.875797 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 869/1946] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:03 2022] DELETE /compute/v2.1/images/f1f31056-e9d4-44c4-8f05-3f6910f46e59 => generated 0 bytes in 1441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:55:04.882108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fb08b89d-22ac-446e-b316-03c1e10ac522 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:04.882762 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fb08b89d-22ac-446e-b316-03c1e10ac522 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] [instance: 4463e53e-8eb7-45b7-ac0b-05204c79896a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:04.914151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb08b89d-22ac-446e-b316-03c1e10ac522 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:04.914710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb08b89d-22ac-446e-b316-03c1e10ac522 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:04.915154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb08b89d-22ac-446e-b316-03c1e10ac522 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:04.924755 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb08b89d-22ac-446e-b316-03c1e10ac522 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:04.950806 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-86fcea90-b254-49e3-8e0b-f1f942a5ece4 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499" status: 200 len: 1428 microversion: 2.1 time: 1.160826 Oct 29 02:55:04.953078 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb08b89d-22ac-446e-b316-03c1e10ac522 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:04.953603 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb08b89d-22ac-446e-b316-03c1e10ac522 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:04.974751 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1078/1947] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:03 2022] GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499 => generated 1428 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:05.021970 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-16bb6edf-6a31-4252-92fa-22d65658b6ac tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:05.029574 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-16bb6edf-6a31-4252-92fa-22d65658b6ac tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:05.048835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-16bb6edf-6a31-4252-92fa-22d65658b6ac tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:05.052956 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-16bb6edf-6a31-4252-92fa-22d65658b6ac tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:05.057615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-16bb6edf-6a31-4252-92fa-22d65658b6ac tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:05.061377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-16bb6edf-6a31-4252-92fa-22d65658b6ac tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:05.066907 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-16bb6edf-6a31-4252-92fa-22d65658b6ac tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:05.071997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-16bb6edf-6a31-4252-92fa-22d65658b6ac tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:05.986398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fb08b89d-22ac-446e-b316-03c1e10ac522 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6300e24201407ba4c09cb25d247b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102dffa1e6843c6b5caa93b81a2fbfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:05.999954 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fb08b89d-22ac-446e-b316-03c1e10ac522 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] 10.222.0.46 "GET /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a" status: 200 len: 1331 microversion: 2.1 time: 1.122736 Oct 29 02:55:06.000975 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 870/1948] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:04 2022] GET /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a => generated 1331 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:06.014662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7f012e17-87ca-4dcf-9ad8-122dd1d9f0b0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:06.016910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7f012e17-87ca-4dcf-9ad8-122dd1d9f0b0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:06.050290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f012e17-87ca-4dcf-9ad8-122dd1d9f0b0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:06.053048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f012e17-87ca-4dcf-9ad8-122dd1d9f0b0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:06.055222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f012e17-87ca-4dcf-9ad8-122dd1d9f0b0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:06.065529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f012e17-87ca-4dcf-9ad8-122dd1d9f0b0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:06.066593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f012e17-87ca-4dcf-9ad8-122dd1d9f0b0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:06.067765 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f012e17-87ca-4dcf-9ad8-122dd1d9f0b0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:06.556550 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7f012e17-87ca-4dcf-9ad8-122dd1d9f0b0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:06.573343 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7f012e17-87ca-4dcf-9ad8-122dd1d9f0b0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878" status: 200 len: 1263 microversion: 2.1 time: 0.570961 Oct 29 02:55:06.609863 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 871/1949] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:06 2022] GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 => generated 1263 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:06.631367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7de0006e-5257-49bc-9053-93b697e96676 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:06.635354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7de0006e-5257-49bc-9053-93b697e96676 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:06.651520 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7de0006e-5257-49bc-9053-93b697e96676 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:06.652463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7de0006e-5257-49bc-9053-93b697e96676 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:06.653154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7de0006e-5257-49bc-9053-93b697e96676 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:06.654104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7de0006e-5257-49bc-9053-93b697e96676 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:06.655672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7de0006e-5257-49bc-9053-93b697e96676 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:06.657552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7de0006e-5257-49bc-9053-93b697e96676 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:06.684136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-16bb6edf-6a31-4252-92fa-22d65658b6ac tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971f709818b74757947beafd14f546bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49721a0af93a47d38613f4a588ab1e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:06.696852 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-16bb6edf-6a31-4252-92fa-22d65658b6ac tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1" status: 200 len: 1316 microversion: 2.1 time: 1.718840 Oct 29 02:55:06.698984 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1079/1950] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:04 2022] GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 => generated 1316 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:06.717246 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1ef16974-8567-4f23-ab18-f3447de6ab4d tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:06.718448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1ef16974-8567-4f23-ab18-f3447de6ab4d tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 1123b300-f298-4071-bff4-8ddc088ee57f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:06.729017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ef16974-8567-4f23-ab18-f3447de6ab4d tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:06.735993 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ef16974-8567-4f23-ab18-f3447de6ab4d tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:06.737659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ef16974-8567-4f23-ab18-f3447de6ab4d tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:06.739100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ef16974-8567-4f23-ab18-f3447de6ab4d tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:06.739754 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ef16974-8567-4f23-ab18-f3447de6ab4d tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:06.740357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ef16974-8567-4f23-ab18-f3447de6ab4d tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:06.843772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1ef16974-8567-4f23-ab18-f3447de6ab4d tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 1123b300-f298-4071-bff4-8ddc088ee57f] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:55:07.163380 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1ef16974-8567-4f23-ab18-f3447de6ab4d tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f" status: 204 len: 0 microversion: 2.1 time: 0.459935 Oct 29 02:55:07.167037 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1080/1951] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:55:06 2022] DELETE /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:55:07.187306 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-fbfc027e-c0a3-41b1-b836-997d0a7dcee7 req-65ba2d5c-1554-4a9c-a433-9dd5094ea9ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4463e53e-8eb7-45b7-ac0b-05204c79896a", "tag": "b7adebcb-9cb0-4755-83b6-d418a864b6a2"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:07.217899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-fbfc027e-c0a3-41b1-b836-997d0a7dcee7 req-65ba2d5c-1554-4a9c-a433-9dd5094ea9ea service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:07.221513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-fbfc027e-c0a3-41b1-b836-997d0a7dcee7 req-65ba2d5c-1554-4a9c-a433-9dd5094ea9ea service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:07.222184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-fbfc027e-c0a3-41b1-b836-997d0a7dcee7 req-65ba2d5c-1554-4a9c-a433-9dd5094ea9ea service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:07.267863 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-fbfc027e-c0a3-41b1-b836-997d0a7dcee7 req-65ba2d5c-1554-4a9c-a433-9dd5094ea9ea service nova] Creating event network-changed:b7adebcb-9cb0-4755-83b6-d418a864b6a2 for instance 4463e53e-8eb7-45b7-ac0b-05204c79896a on n-h2-862967-2 Oct 29 02:55:07.275514 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-fbfc027e-c0a3-41b1-b836-997d0a7dcee7 req-65ba2d5c-1554-4a9c-a433-9dd5094ea9ea service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105860 Oct 29 02:55:07.280979 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1081/1952] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:07.295355 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1fa0354c-89ed-46eb-a521-c203bee28ece tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff05c0b8550>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:07.417244 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1fa0354c-89ed-46eb-a521-c203bee28ece tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499" status: 200 len: 1428 microversion: 2.1 time: 0.129920 Oct 29 02:55:07.418471 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1082/1953] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:07 2022] GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499 => generated 1428 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:07.430018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-3c81086d-36b1-4e16-a8d2-c4997662ad39 req-dc81cd5e-279b-44e0-acfe-60d71b13bd56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c20eea-c322-4d8e-bafd-3b3b01c5d142", "name": "network-vif-plugged", "status": "completed", "tag": "0fb3a164-1f7e-48a7-90ce-0c06851aae03"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:07.471834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3c81086d-36b1-4e16-a8d2-c4997662ad39 req-dc81cd5e-279b-44e0-acfe-60d71b13bd56 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:07.472784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3c81086d-36b1-4e16-a8d2-c4997662ad39 req-dc81cd5e-279b-44e0-acfe-60d71b13bd56 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:07.473655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3c81086d-36b1-4e16-a8d2-c4997662ad39 req-dc81cd5e-279b-44e0-acfe-60d71b13bd56 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:07.515643 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-3c81086d-36b1-4e16-a8d2-c4997662ad39 req-dc81cd5e-279b-44e0-acfe-60d71b13bd56 service nova] Creating event network-vif-plugged:0fb3a164-1f7e-48a7-90ce-0c06851aae03 for instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 on n-h2-862967-2 Oct 29 02:55:07.526548 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-3c81086d-36b1-4e16-a8d2-c4997662ad39 req-dc81cd5e-279b-44e0-acfe-60d71b13bd56 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106387 Oct 29 02:55:07.532263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7de0006e-5257-49bc-9053-93b697e96676 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:07.533367 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1083/1954] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:07.542791 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7de0006e-5257-49bc-9053-93b697e96676 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:07.544228 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7de0006e-5257-49bc-9053-93b697e96676 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:07.545428 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7de0006e-5257-49bc-9053-93b697e96676 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1879 microversion: 2.42 time: 0.933999 Oct 29 02:55:07.546275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cd0a8154-680a-472b-a525-3a64c97afb7d tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:07.548347 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cd0a8154-680a-472b-a525-3a64c97afb7d tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] [instance: 4463e53e-8eb7-45b7-ac0b-05204c79896a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:07.561133 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 872/1955] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:55:06 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1879 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:55:07.572335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-069e4473-e5b0-41ee-86ae-cdaaf02d8e4f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:07.572977 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-069e4473-e5b0-41ee-86ae-cdaaf02d8e4f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 1123b300-f298-4071-bff4-8ddc088ee57f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:07.583302 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd0a8154-680a-472b-a525-3a64c97afb7d tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:07.592822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd0a8154-680a-472b-a525-3a64c97afb7d tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:07.593776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd0a8154-680a-472b-a525-3a64c97afb7d tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:07.594892 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd0a8154-680a-472b-a525-3a64c97afb7d tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:07.595522 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd0a8154-680a-472b-a525-3a64c97afb7d tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:07.596202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd0a8154-680a-472b-a525-3a64c97afb7d tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:07.606851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-069e4473-e5b0-41ee-86ae-cdaaf02d8e4f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:07.607532 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-069e4473-e5b0-41ee-86ae-cdaaf02d8e4f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:07.607971 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-069e4473-e5b0-41ee-86ae-cdaaf02d8e4f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:07.608730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-069e4473-e5b0-41ee-86ae-cdaaf02d8e4f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:07.609436 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-069e4473-e5b0-41ee-86ae-cdaaf02d8e4f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:07.609998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-069e4473-e5b0-41ee-86ae-cdaaf02d8e4f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:08.646716 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-069e4473-e5b0-41ee-86ae-cdaaf02d8e4f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844dbc8e54d349ea93c632c54909a718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b7aa3004d94c5a8cf87d5f4d006a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:08.655388 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-069e4473-e5b0-41ee-86ae-cdaaf02d8e4f tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f" status: 200 len: 1473 microversion: 2.1 time: 1.093138 Oct 29 02:55:08.667679 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 873/1956] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:07 2022] GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f => generated 1473 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:08.678146 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7a8cb1a2-ad13-4d6f-bef0-5f100961dca6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:08.680929 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7a8cb1a2-ad13-4d6f-bef0-5f100961dca6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:08.697699 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a8cb1a2-ad13-4d6f-bef0-5f100961dca6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:08.698267 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a8cb1a2-ad13-4d6f-bef0-5f100961dca6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:08.719309 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a8cb1a2-ad13-4d6f-bef0-5f100961dca6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:08.721033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a8cb1a2-ad13-4d6f-bef0-5f100961dca6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:08.723832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a8cb1a2-ad13-4d6f-bef0-5f100961dca6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:08.724567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a8cb1a2-ad13-4d6f-bef0-5f100961dca6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:09.427050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cd0a8154-680a-472b-a525-3a64c97afb7d tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6300e24201407ba4c09cb25d247b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102dffa1e6843c6b5caa93b81a2fbfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:09.446616 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cd0a8154-680a-472b-a525-3a64c97afb7d tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] 10.222.0.46 "GET /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a" status: 200 len: 1331 microversion: 2.1 time: 1.902056 Oct 29 02:55:09.447417 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1084/1957] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:07 2022] GET /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a => generated 1331 bytes in 1908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:09.454705 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-897adec5-2d7d-4f9f-946a-9a3441ada492 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:09.456223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-897adec5-2d7d-4f9f-946a-9a3441ada492 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:09.480712 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-897adec5-2d7d-4f9f-946a-9a3441ada492 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:09.487430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-897adec5-2d7d-4f9f-946a-9a3441ada492 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:09.500046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-897adec5-2d7d-4f9f-946a-9a3441ada492 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:09.502173 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-897adec5-2d7d-4f9f-946a-9a3441ada492 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:09.502883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-897adec5-2d7d-4f9f-946a-9a3441ada492 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:09.503525 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-897adec5-2d7d-4f9f-946a-9a3441ada492 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:09.620917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7a8cb1a2-ad13-4d6f-bef0-5f100961dca6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:09.645195 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7a8cb1a2-ad13-4d6f-bef0-5f100961dca6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878" status: 200 len: 1311 microversion: 2.1 time: 0.960797 Oct 29 02:55:09.660600 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 874/1958] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:08 2022] GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 => generated 1311 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:09.660600 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-41aba439-944a-4876-abcb-cc9764ad716a req-778956a5-79a8-45e0-bffc-0d48cb40bcf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1", "tag": "46f29793-230c-41a4-90a3-6f7ef9ed7a47"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:09.699684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-41aba439-944a-4876-abcb-cc9764ad716a req-778956a5-79a8-45e0-bffc-0d48cb40bcf6 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:09.701852 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-41aba439-944a-4876-abcb-cc9764ad716a req-778956a5-79a8-45e0-bffc-0d48cb40bcf6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:09.703635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-41aba439-944a-4876-abcb-cc9764ad716a req-778956a5-79a8-45e0-bffc-0d48cb40bcf6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:09.752832 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-41aba439-944a-4876-abcb-cc9764ad716a req-778956a5-79a8-45e0-bffc-0d48cb40bcf6 service nova] Creating event network-changed:46f29793-230c-41a4-90a3-6f7ef9ed7a47 for instance 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 on n-h1-862967-2 Oct 29 02:55:09.775070 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-41aba439-944a-4876-abcb-cc9764ad716a req-778956a5-79a8-45e0-bffc-0d48cb40bcf6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124802 Oct 29 02:55:09.775070 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 875/1959] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:09.794754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7de5e90b-e24e-49d3-8016-cb75e232b55a tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff0536b4280>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:09.919299 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7de5e90b-e24e-49d3-8016-cb75e232b55a tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499" status: 200 len: 1428 microversion: 2.1 time: 0.143876 Oct 29 02:55:09.921442 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 876/1960] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:09 2022] GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499 => generated 1428 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:09.932003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e903cb95-e0df-4da9-ae00-84d36c471300 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:09.945120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e903cb95-e0df-4da9-ae00-84d36c471300 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:09.971719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e903cb95-e0df-4da9-ae00-84d36c471300 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:09.972455 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e903cb95-e0df-4da9-ae00-84d36c471300 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:09.973055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e903cb95-e0df-4da9-ae00-84d36c471300 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:09.974544 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e903cb95-e0df-4da9-ae00-84d36c471300 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:09.975223 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e903cb95-e0df-4da9-ae00-84d36c471300 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:09.975794 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e903cb95-e0df-4da9-ae00-84d36c471300 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:10.188003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-897adec5-2d7d-4f9f-946a-9a3441ada492 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971f709818b74757947beafd14f546bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49721a0af93a47d38613f4a588ab1e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:10.197616 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-897adec5-2d7d-4f9f-946a-9a3441ada492 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1" status: 200 len: 1316 microversion: 2.1 time: 0.748800 Oct 29 02:55:10.205525 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1085/1961] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:09 2022] GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 => generated 1316 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:10.223679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-c9bc9f63-5971-4c83-99db-de6ff6fe746d req-08891fee-9ea4-4a76-a3f7-280ae92e6dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c20eea-c322-4d8e-bafd-3b3b01c5d142", "name": "network-vif-plugged", "status": "completed", "tag": "da28c280-91d5-47ab-8861-0f028fe80b4b"}, {"server_uuid": "f0c20eea-c322-4d8e-bafd-3b3b01c5d142", "name": "network-vif-plugged", "status": "completed", "tag": "1a1b3e12-192b-4594-85e0-b5bcedd79e34"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:10.269051 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c9bc9f63-5971-4c83-99db-de6ff6fe746d req-08891fee-9ea4-4a76-a3f7-280ae92e6dc1 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:10.276734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c9bc9f63-5971-4c83-99db-de6ff6fe746d req-08891fee-9ea4-4a76-a3f7-280ae92e6dc1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:10.284614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c9bc9f63-5971-4c83-99db-de6ff6fe746d req-08891fee-9ea4-4a76-a3f7-280ae92e6dc1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:10.362504 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-c9bc9f63-5971-4c83-99db-de6ff6fe746d req-08891fee-9ea4-4a76-a3f7-280ae92e6dc1 service nova] Creating event network-vif-plugged:da28c280-91d5-47ab-8861-0f028fe80b4b for instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 on n-h2-862967-2 Oct 29 02:55:10.370956 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-c9bc9f63-5971-4c83-99db-de6ff6fe746d req-08891fee-9ea4-4a76-a3f7-280ae92e6dc1 service nova] Creating event network-vif-plugged:1a1b3e12-192b-4594-85e0-b5bcedd79e34 for instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 on n-h2-862967-2 Oct 29 02:55:10.383415 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-c9bc9f63-5971-4c83-99db-de6ff6fe746d req-08891fee-9ea4-4a76-a3f7-280ae92e6dc1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.173468 Oct 29 02:55:10.386952 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1086/1962] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:10.402052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-949a4f78-38d9-469e-993e-c827b72b1339 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:10.402798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-949a4f78-38d9-469e-993e-c827b72b1339 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 1123b300-f298-4071-bff4-8ddc088ee57f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:10.435233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-949a4f78-38d9-469e-993e-c827b72b1339 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:10.435976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-949a4f78-38d9-469e-993e-c827b72b1339 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:10.436661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-949a4f78-38d9-469e-993e-c827b72b1339 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:10.437710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-949a4f78-38d9-469e-993e-c827b72b1339 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:10.439007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-949a4f78-38d9-469e-993e-c827b72b1339 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:10.439612 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-949a4f78-38d9-469e-993e-c827b72b1339 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:10.866427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e903cb95-e0df-4da9-ae00-84d36c471300 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:10.884308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e903cb95-e0df-4da9-ae00-84d36c471300 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:10.891920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e903cb95-e0df-4da9-ae00-84d36c471300 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:10.893204 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e903cb95-e0df-4da9-ae00-84d36c471300 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1879 microversion: 2.42 time: 0.970330 Oct 29 02:55:10.909397 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 877/1963] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:55:09 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1879 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:55:10.924327 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5f93cfd2-0d16-483c-98f8-e8e3c1d101c2 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:10.927584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5f93cfd2-0d16-483c-98f8-e8e3c1d101c2 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] [instance: 4463e53e-8eb7-45b7-ac0b-05204c79896a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:10.942513 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f93cfd2-0d16-483c-98f8-e8e3c1d101c2 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:10.946138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f93cfd2-0d16-483c-98f8-e8e3c1d101c2 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:10.948378 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f93cfd2-0d16-483c-98f8-e8e3c1d101c2 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:10.949471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f93cfd2-0d16-483c-98f8-e8e3c1d101c2 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:10.952288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f93cfd2-0d16-483c-98f8-e8e3c1d101c2 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:10.953107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f93cfd2-0d16-483c-98f8-e8e3c1d101c2 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:11.559040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5f93cfd2-0d16-483c-98f8-e8e3c1d101c2 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6300e24201407ba4c09cb25d247b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102dffa1e6843c6b5caa93b81a2fbfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:11.565486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-949a4f78-38d9-469e-993e-c827b72b1339 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844dbc8e54d349ea93c632c54909a718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b7aa3004d94c5a8cf87d5f4d006a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:11.575958 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5f93cfd2-0d16-483c-98f8-e8e3c1d101c2 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] 10.222.0.46 "GET /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a" status: 200 len: 1331 microversion: 2.1 time: 0.665027 Oct 29 02:55:11.576757 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 878/1964] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:10 2022] GET /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a => generated 1331 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:11.578097 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-949a4f78-38d9-469e-993e-c827b72b1339 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f" status: 200 len: 1473 microversion: 2.1 time: 1.189651 Oct 29 02:55:11.581864 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1087/1965] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:10 2022] GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f => generated 1473 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:11.593425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dc25ec5d-4f28-4b8f-a989-f9082b5ce49a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:11.594404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dc25ec5d-4f28-4b8f-a989-f9082b5ce49a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:11.600595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a5f19a1f-3481-4b73-bad2-a9d8ec145085 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff053832ca0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:11.610688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc25ec5d-4f28-4b8f-a989-f9082b5ce49a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:11.611526 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc25ec5d-4f28-4b8f-a989-f9082b5ce49a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:11.612797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc25ec5d-4f28-4b8f-a989-f9082b5ce49a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:11.614669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc25ec5d-4f28-4b8f-a989-f9082b5ce49a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:11.617013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc25ec5d-4f28-4b8f-a989-f9082b5ce49a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:11.620232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc25ec5d-4f28-4b8f-a989-f9082b5ce49a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:11.731744 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a5f19a1f-3481-4b73-bad2-a9d8ec145085 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499" status: 200 len: 1428 microversion: 2.1 time: 0.136041 Oct 29 02:55:11.732923 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 879/1966] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:11 2022] GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499 => generated 1428 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:11.741194 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1816dc12-24cb-4b08-b844-09172890ce09 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:11.742205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1816dc12-24cb-4b08-b844-09172890ce09 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:11.752718 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1816dc12-24cb-4b08-b844-09172890ce09 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:11.757214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1816dc12-24cb-4b08-b844-09172890ce09 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:11.758037 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1816dc12-24cb-4b08-b844-09172890ce09 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:11.759035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1816dc12-24cb-4b08-b844-09172890ce09 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:11.762387 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1816dc12-24cb-4b08-b844-09172890ce09 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:11.767541 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1816dc12-24cb-4b08-b844-09172890ce09 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:12.502723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dc25ec5d-4f28-4b8f-a989-f9082b5ce49a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:12.512509 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dc25ec5d-4f28-4b8f-a989-f9082b5ce49a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878" status: 200 len: 1311 microversion: 2.1 time: 0.929167 Oct 29 02:55:12.519606 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1088/1967] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:11 2022] GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 => generated 1311 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:12.543921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-029a5c2a-aab6-43d3-9792-96b849862620 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:12.544796 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-029a5c2a-aab6-43d3-9792-96b849862620 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:12.571186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-029a5c2a-aab6-43d3-9792-96b849862620 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:12.571796 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-029a5c2a-aab6-43d3-9792-96b849862620 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:12.581294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-029a5c2a-aab6-43d3-9792-96b849862620 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:12.583366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-029a5c2a-aab6-43d3-9792-96b849862620 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:12.587875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-029a5c2a-aab6-43d3-9792-96b849862620 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:12.588511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-029a5c2a-aab6-43d3-9792-96b849862620 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:12.823697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1816dc12-24cb-4b08-b844-09172890ce09 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971f709818b74757947beafd14f546bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49721a0af93a47d38613f4a588ab1e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:12.833125 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1816dc12-24cb-4b08-b844-09172890ce09 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1" status: 200 len: 1316 microversion: 2.1 time: 1.098641 Oct 29 02:55:12.838087 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 880/1968] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:11 2022] GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 => generated 1316 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:12.846839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-213e5e28-46ae-4839-aa84-470595c3fca8 req-66237053-f675-48db-99f5-5002e05e68c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1123b300-f298-4071-bff4-8ddc088ee57f", "name": "network-vif-deleted", "tag": "94ed150d-ec19-4ada-8ecf-11ff8e7dc70e"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:12.872213 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-213e5e28-46ae-4839-aa84-470595c3fca8 req-66237053-f675-48db-99f5-5002e05e68c6 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:12.877038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-213e5e28-46ae-4839-aa84-470595c3fca8 req-66237053-f675-48db-99f5-5002e05e68c6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:12.877926 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-213e5e28-46ae-4839-aa84-470595c3fca8 req-66237053-f675-48db-99f5-5002e05e68c6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:12.912137 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-213e5e28-46ae-4839-aa84-470595c3fca8 req-66237053-f675-48db-99f5-5002e05e68c6 service nova] Creating event network-vif-deleted:94ed150d-ec19-4ada-8ecf-11ff8e7dc70e for instance 1123b300-f298-4071-bff4-8ddc088ee57f on n-h1-862967-2 Oct 29 02:55:12.938202 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-213e5e28-46ae-4839-aa84-470595c3fca8 req-66237053-f675-48db-99f5-5002e05e68c6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089609 Oct 29 02:55:12.939384 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 881/1969] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:12.945279 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-7d2c3242-a7f4-488a-abcd-317d3820a0a1 req-2d0d9879-78eb-4563-94dd-875940ccdb02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c20eea-c322-4d8e-bafd-3b3b01c5d142", "name": "network-vif-plugged", "status": "completed", "tag": "c76f3db4-7820-423e-9c05-70cecc3190e6"}, {"server_uuid": "f0c20eea-c322-4d8e-bafd-3b3b01c5d142", "name": "network-vif-plugged", "status": "completed", "tag": "20f58ad8-3fa0-481e-8e36-08b604fdf588"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:12.968031 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7d2c3242-a7f4-488a-abcd-317d3820a0a1 req-2d0d9879-78eb-4563-94dd-875940ccdb02 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:12.971985 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7d2c3242-a7f4-488a-abcd-317d3820a0a1 req-2d0d9879-78eb-4563-94dd-875940ccdb02 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:12.977625 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7d2c3242-a7f4-488a-abcd-317d3820a0a1 req-2d0d9879-78eb-4563-94dd-875940ccdb02 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:13.006449 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-7d2c3242-a7f4-488a-abcd-317d3820a0a1 req-2d0d9879-78eb-4563-94dd-875940ccdb02 service nova] Creating event network-vif-plugged:c76f3db4-7820-423e-9c05-70cecc3190e6 for instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 on n-h2-862967-2 Oct 29 02:55:13.007250 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-7d2c3242-a7f4-488a-abcd-317d3820a0a1 req-2d0d9879-78eb-4563-94dd-875940ccdb02 service nova] Creating event network-vif-plugged:20f58ad8-3fa0-481e-8e36-08b604fdf588 for instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 on n-h2-862967-2 Oct 29 02:55:13.015358 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-7d2c3242-a7f4-488a-abcd-317d3820a0a1 req-2d0d9879-78eb-4563-94dd-875940ccdb02 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.074311 Oct 29 02:55:13.023322 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 882/1970] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:13.029668 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-20395ee7-f587-4653-9437-a17f424ec4d4 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:13.036840 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-20395ee7-f587-4653-9437-a17f424ec4d4 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 1123b300-f298-4071-bff4-8ddc088ee57f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:13.051714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-029a5c2a-aab6-43d3-9792-96b849862620 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:13.060097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20395ee7-f587-4653-9437-a17f424ec4d4 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:13.060684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20395ee7-f587-4653-9437-a17f424ec4d4 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:13.061212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20395ee7-f587-4653-9437-a17f424ec4d4 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:13.071062 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20395ee7-f587-4653-9437-a17f424ec4d4 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:13.071062 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20395ee7-f587-4653-9437-a17f424ec4d4 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:13.071062 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20395ee7-f587-4653-9437-a17f424ec4d4 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:13.072220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-029a5c2a-aab6-43d3-9792-96b849862620 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:13.074796 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-029a5c2a-aab6-43d3-9792-96b849862620 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:13.076224 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-029a5c2a-aab6-43d3-9792-96b849862620 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1879 microversion: 2.42 time: 0.555492 Oct 29 02:55:13.099178 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1089/1971] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:55:12 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1879 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:55:13.106066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e3ae9d92-9d4d-47ec-8a23-4740dda0b6c4 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:13.107031 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e3ae9d92-9d4d-47ec-8a23-4740dda0b6c4 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] [instance: 4463e53e-8eb7-45b7-ac0b-05204c79896a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:13.118854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e3ae9d92-9d4d-47ec-8a23-4740dda0b6c4 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:13.120775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e3ae9d92-9d4d-47ec-8a23-4740dda0b6c4 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:13.121373 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e3ae9d92-9d4d-47ec-8a23-4740dda0b6c4 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:13.123188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e3ae9d92-9d4d-47ec-8a23-4740dda0b6c4 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:13.124151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e3ae9d92-9d4d-47ec-8a23-4740dda0b6c4 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:13.125726 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e3ae9d92-9d4d-47ec-8a23-4740dda0b6c4 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:13.167151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:13.183416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20395ee7-f587-4653-9437-a17f424ec4d4 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:13.184148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20395ee7-f587-4653-9437-a17f424ec4d4 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:13.184759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20395ee7-f587-4653-9437-a17f424ec4d4 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:13.185351 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-20395ee7-f587-4653-9437-a17f424ec4d4 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lazy-loading 'fault' on Instance uuid 1123b300-f298-4071-bff4-8ddc088ee57f {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:55:13.263859 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=20 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:13.528215 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-20395ee7-f587-4653-9437-a17f424ec4d4 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844dbc8e54d349ea93c632c54909a718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b7aa3004d94c5a8cf87d5f4d006a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:13.539232 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-20395ee7-f587-4653-9437-a17f424ec4d4 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f" status: 200 len: 1308 microversion: 2.1 time: 0.514321 Oct 29 02:55:13.544092 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 883/1972] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:13 2022] GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f => generated 1308 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:13.549446 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dc895eae-0b21-42f6-9ac1-bd8968717c1b tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff0536b4c10>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:13.645830 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dc895eae-0b21-42f6-9ac1-bd8968717c1b tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499" status: 200 len: 1428 microversion: 2.1 time: 0.099992 Oct 29 02:55:13.654838 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 884/1973] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:13 2022] GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499 => generated 1428 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:13.667416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-78e7cf45-cbda-45a3-bf31-a6bead002c86 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:13.668254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-78e7cf45-cbda-45a3-bf31-a6bead002c86 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:13.687977 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78e7cf45-cbda-45a3-bf31-a6bead002c86 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:13.693443 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78e7cf45-cbda-45a3-bf31-a6bead002c86 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:13.693948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78e7cf45-cbda-45a3-bf31-a6bead002c86 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:13.694726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78e7cf45-cbda-45a3-bf31-a6bead002c86 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:13.695202 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78e7cf45-cbda-45a3-bf31-a6bead002c86 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:13.695636 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78e7cf45-cbda-45a3-bf31-a6bead002c86 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:14.171712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-78e7cf45-cbda-45a3-bf31-a6bead002c86 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:14.190453 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-78e7cf45-cbda-45a3-bf31-a6bead002c86 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878" status: 200 len: 1311 microversion: 2.1 time: 0.525731 Oct 29 02:55:14.214799 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 885/1974] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:13 2022] GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 => generated 1311 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:14.227263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-27adf64f-7364-4c95-a50d-0bf003e65893 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:14.229283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-27adf64f-7364-4c95-a50d-0bf003e65893 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:14.247834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27adf64f-7364-4c95-a50d-0bf003e65893 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:14.254669 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27adf64f-7364-4c95-a50d-0bf003e65893 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:14.257035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27adf64f-7364-4c95-a50d-0bf003e65893 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:14.258799 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27adf64f-7364-4c95-a50d-0bf003e65893 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:14.265742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27adf64f-7364-4c95-a50d-0bf003e65893 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:14.267153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27adf64f-7364-4c95-a50d-0bf003e65893 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:14.487812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e3ae9d92-9d4d-47ec-8a23-4740dda0b6c4 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6300e24201407ba4c09cb25d247b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102dffa1e6843c6b5caa93b81a2fbfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:14.501411 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e3ae9d92-9d4d-47ec-8a23-4740dda0b6c4 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] 10.222.0.46 "GET /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a" status: 200 len: 1331 microversion: 2.1 time: 1.400458 Oct 29 02:55:14.503278 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1090/1975] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:13 2022] GET /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a => generated 1331 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:14.517764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4e432ccc-2086-49f9-8120-b7eea9d97747 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:14.518672 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4e432ccc-2086-49f9-8120-b7eea9d97747 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:14.536384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e432ccc-2086-49f9-8120-b7eea9d97747 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:14.537368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e432ccc-2086-49f9-8120-b7eea9d97747 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:14.538001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e432ccc-2086-49f9-8120-b7eea9d97747 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:14.538869 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e432ccc-2086-49f9-8120-b7eea9d97747 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:14.539489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e432ccc-2086-49f9-8120-b7eea9d97747 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:14.540056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e432ccc-2086-49f9-8120-b7eea9d97747 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:14.921060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4e432ccc-2086-49f9-8120-b7eea9d97747 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:14.932712 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4e432ccc-2086-49f9-8120-b7eea9d97747 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:14.934203 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4e432ccc-2086-49f9-8120-b7eea9d97747 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:14.935401 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4e432ccc-2086-49f9-8120-b7eea9d97747 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1879 microversion: 2.42 time: 0.431011 Oct 29 02:55:14.941278 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1091/1976] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:55:14 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1879 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:55:14.952865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d635f297-e90f-4cbe-af0a-072595ffa600 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:14.953495 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d635f297-e90f-4cbe-af0a-072595ffa600 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 1123b300-f298-4071-bff4-8ddc088ee57f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:14.982427 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d635f297-e90f-4cbe-af0a-072595ffa600 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:14.983208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d635f297-e90f-4cbe-af0a-072595ffa600 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:14.983728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d635f297-e90f-4cbe-af0a-072595ffa600 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:14.992031 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d635f297-e90f-4cbe-af0a-072595ffa600 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:14.992780 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d635f297-e90f-4cbe-af0a-072595ffa600 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:14.993374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d635f297-e90f-4cbe-af0a-072595ffa600 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:15.015081 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-d635f297-e90f-4cbe-af0a-072595ffa600 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] HTTP exception thrown: Instance 1123b300-f298-4071-bff4-8ddc088ee57f could not be found. Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d635f297-e90f-4cbe-af0a-072595ffa600 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Request method failure captured: Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f HTTP/1.1 Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJVXODsKauKESdSabNTm4y-J8U71R5N9-LEqR_TDNry5mzPUAkMuXsKXvPAwdZM4-yRNOG_4Ew9UaiY-BY4GWCsq1kxnL4KH2UKS8UzzqsgqMkA8MDeo_tXU9G9Z_9tan-jXQ4e53wsImpjhDgxDGNVXpu3Ckzw_tYv5MN0fsjMuPlk Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: f3b7aa3004d94c5a8cf87d5f4d006a73 Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ListImageFiltersTestJSON-974859316 Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f3b7aa3004d94c5a8cf87d5f4d006a73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f3b7aa3004d94c5a8cf87d5f4d006a73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f3b7aa3004d94c5a8cf87d5f4d006a73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f3b7aa3004d94c5a8cf87d5f4d006a73"}]}] Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ListImageFiltersTestJSON-974859316 Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: f3b7aa3004d94c5a8cf87d5f4d006a73 Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-974859316 Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ListImageFiltersTestJSON-974859316-project Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 844dbc8e54d349ea93c632c54909a718 Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ListImageFiltersTestJSON-974859316-project Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 1123b300-f298-4071-bff4-8ddc088ee57f could not be found. Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '1123b300-f298-4071-bff4-8ddc088ee57f'} Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1123b300-f298-4071-bff4-8ddc088ee57f could not be found. Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1123b300-f298-4071-bff4-8ddc088ee57f could not be found. Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:15.017098 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:15.021931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:15.021931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:15.021931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:15.021931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:15.021931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:15.021931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1123b300-f298-4071-bff4-8ddc088ee57f could not be found. Oct 29 02:55:15.021931 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:15.023221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d635f297-e90f-4cbe-af0a-072595ffa600 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Returning 404 to user: Instance 1123b300-f298-4071-bff4-8ddc088ee57f could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:15.024236 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d635f297-e90f-4cbe-af0a-072595ffa600 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f" status: 404 len: 111 microversion: 2.1 time: 0.081934 Oct 29 02:55:15.025002 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1092/1977] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:14 2022] GET /compute/v2.1/servers/1123b300-f298-4071-bff4-8ddc088ee57f => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:55:15.030204 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-a971da63-db94-4c36-a292-ad301d13c7d5 req-6c5dee6e-f025-41ef-a2ba-f4d1faaee921 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42ddcbfc-a37e-4d2f-8e07-c28bfcf40878", "tag": "8c18d333-2ae5-4735-96e6-5b6ea458aef2"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:15.046388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a971da63-db94-4c36-a292-ad301d13c7d5 req-6c5dee6e-f025-41ef-a2ba-f4d1faaee921 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:15.049091 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a971da63-db94-4c36-a292-ad301d13c7d5 req-6c5dee6e-f025-41ef-a2ba-f4d1faaee921 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:15.049723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a971da63-db94-4c36-a292-ad301d13c7d5 req-6c5dee6e-f025-41ef-a2ba-f4d1faaee921 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:15.085922 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-a971da63-db94-4c36-a292-ad301d13c7d5 req-6c5dee6e-f025-41ef-a2ba-f4d1faaee921 service nova] Creating event network-changed:8c18d333-2ae5-4735-96e6-5b6ea458aef2 for instance 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 on n-h1-862967-2 Oct 29 02:55:15.101781 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-a971da63-db94-4c36-a292-ad301d13c7d5 req-6c5dee6e-f025-41ef-a2ba-f4d1faaee921 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075317 Oct 29 02:55:15.102759 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1093/1978] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:15.120776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c2141b94-5d08-4e21-91ee-1493fb53c67c tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff05c065550>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:15.181935 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c2141b94-5d08-4e21-91ee-1493fb53c67c tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499" status: 200 len: 1428 microversion: 2.1 time: 0.077621 Oct 29 02:55:15.182816 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1094/1979] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:15 2022] GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499 => generated 1428 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:15.202913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3f5f2ccb-792a-43ad-9730-a8da41ffa905 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:15.206134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3f5f2ccb-792a-43ad-9730-a8da41ffa905 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:15.216088 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-27adf64f-7364-4c95-a50d-0bf003e65893 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971f709818b74757947beafd14f546bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49721a0af93a47d38613f4a588ab1e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:15.234795 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-27adf64f-7364-4c95-a50d-0bf003e65893 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1" status: 200 len: 1316 microversion: 2.1 time: 1.010324 Oct 29 02:55:15.235885 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 886/1980] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:14 2022] GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 => generated 1316 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:15.244642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f5f2ccb-792a-43ad-9730-a8da41ffa905 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:15.244642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f5f2ccb-792a-43ad-9730-a8da41ffa905 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:15.244642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f5f2ccb-792a-43ad-9730-a8da41ffa905 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:15.244642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f5f2ccb-792a-43ad-9730-a8da41ffa905 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:15.244642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f5f2ccb-792a-43ad-9730-a8da41ffa905 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:15.244642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f5f2ccb-792a-43ad-9730-a8da41ffa905 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:15.258121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2b473b2c-a56a-43b7-9c14-d1cb0c3f9b9b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:15.264763 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2b473b2c-a56a-43b7-9c14-d1cb0c3f9b9b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:15.286862 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b473b2c-a56a-43b7-9c14-d1cb0c3f9b9b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:15.288022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b473b2c-a56a-43b7-9c14-d1cb0c3f9b9b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:15.289032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b473b2c-a56a-43b7-9c14-d1cb0c3f9b9b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:15.290299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b473b2c-a56a-43b7-9c14-d1cb0c3f9b9b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:15.290914 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b473b2c-a56a-43b7-9c14-d1cb0c3f9b9b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:15.291474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b473b2c-a56a-43b7-9c14-d1cb0c3f9b9b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:15.293779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3f5f2ccb-792a-43ad-9730-a8da41ffa905 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:55:15.379685 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:15.450614 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3f5f2ccb-792a-43ad-9730-a8da41ffa905 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd" status: 204 len: 0 microversion: 2.1 time: 0.256736 Oct 29 02:55:15.451702 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1095/1981] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:55:15 2022] DELETE /compute/v2.1/servers/0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:55:15.463538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-abffffb6-8356-4169-92ed-4a7155d6d5d5 req-17f6f4b6-2135-4b57-8ec1-7583c1bb1f19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c20eea-c322-4d8e-bafd-3b3b01c5d142", "name": "network-vif-plugged", "status": "completed", "tag": "a3cf680f-1b1f-4418-86d3-29bf244d0bce"}, {"server_uuid": "f0c20eea-c322-4d8e-bafd-3b3b01c5d142", "name": "network-vif-plugged", "status": "completed", "tag": "20b9f931-71de-4cc6-b5b4-f7a9d8ff7ad9"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:15.474078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-abffffb6-8356-4169-92ed-4a7155d6d5d5 req-17f6f4b6-2135-4b57-8ec1-7583c1bb1f19 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:15.474815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-abffffb6-8356-4169-92ed-4a7155d6d5d5 req-17f6f4b6-2135-4b57-8ec1-7583c1bb1f19 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:15.475458 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-abffffb6-8356-4169-92ed-4a7155d6d5d5 req-17f6f4b6-2135-4b57-8ec1-7583c1bb1f19 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:15.491053 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-abffffb6-8356-4169-92ed-4a7155d6d5d5 req-17f6f4b6-2135-4b57-8ec1-7583c1bb1f19 service nova] Creating event network-vif-plugged:a3cf680f-1b1f-4418-86d3-29bf244d0bce for instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 on n-h2-862967-2 Oct 29 02:55:15.492293 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-abffffb6-8356-4169-92ed-4a7155d6d5d5 req-17f6f4b6-2135-4b57-8ec1-7583c1bb1f19 service nova] Creating event network-vif-plugged:20b9f931-71de-4cc6-b5b4-f7a9d8ff7ad9 for instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 on n-h2-862967-2 Oct 29 02:55:15.498055 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-abffffb6-8356-4169-92ed-4a7155d6d5d5 req-17f6f4b6-2135-4b57-8ec1-7583c1bb1f19 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044584 Oct 29 02:55:15.499319 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1096/1982] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:15.505405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1e249353-435d-4d17-aec4-18513f6b0aa5 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:15.507385 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1e249353-435d-4d17-aec4-18513f6b0aa5 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:15.515036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e249353-435d-4d17-aec4-18513f6b0aa5 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:15.515783 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e249353-435d-4d17-aec4-18513f6b0aa5 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:15.516543 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e249353-435d-4d17-aec4-18513f6b0aa5 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:15.517417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e249353-435d-4d17-aec4-18513f6b0aa5 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:15.518036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e249353-435d-4d17-aec4-18513f6b0aa5 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:15.518640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e249353-435d-4d17-aec4-18513f6b0aa5 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:15.700634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2b473b2c-a56a-43b7-9c14-d1cb0c3f9b9b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:15.712765 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2b473b2c-a56a-43b7-9c14-d1cb0c3f9b9b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878" status: 200 len: 1311 microversion: 2.1 time: 0.466062 Oct 29 02:55:15.719813 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 887/1983] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:15 2022] GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 => generated 1311 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:15.742487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2f15b74f-622f-4d85-bddc-c893662d680a tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:15.744856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2f15b74f-622f-4d85-bddc-c893662d680a tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] [instance: 4463e53e-8eb7-45b7-ac0b-05204c79896a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:15.774884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f15b74f-622f-4d85-bddc-c893662d680a tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:15.781357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f15b74f-622f-4d85-bddc-c893662d680a tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:15.786351 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f15b74f-622f-4d85-bddc-c893662d680a tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:15.792445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f15b74f-622f-4d85-bddc-c893662d680a tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:15.796396 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f15b74f-622f-4d85-bddc-c893662d680a tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:15.797096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f15b74f-622f-4d85-bddc-c893662d680a tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:15.818128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1e249353-435d-4d17-aec4-18513f6b0aa5 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844dbc8e54d349ea93c632c54909a718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b7aa3004d94c5a8cf87d5f4d006a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:15.826596 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1e249353-435d-4d17-aec4-18513f6b0aa5 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/servers/0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd" status: 200 len: 1474 microversion: 2.1 time: 0.325775 Oct 29 02:55:15.827255 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1097/1984] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:15 2022] GET /compute/v2.1/servers/0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd => generated 1474 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:15.987928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8d2ba3fa-9990-4ecb-af95-cf96122d6130 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:15.988649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8d2ba3fa-9990-4ecb-af95-cf96122d6130 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:16.003272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d2ba3fa-9990-4ecb-af95-cf96122d6130 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:16.004290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d2ba3fa-9990-4ecb-af95-cf96122d6130 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:16.005133 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d2ba3fa-9990-4ecb-af95-cf96122d6130 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:16.011097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2f15b74f-622f-4d85-bddc-c893662d680a tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6300e24201407ba4c09cb25d247b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102dffa1e6843c6b5caa93b81a2fbfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:16.020891 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2f15b74f-622f-4d85-bddc-c893662d680a tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] 10.222.0.46 "GET /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a" status: 200 len: 1331 microversion: 2.1 time: 0.299631 Oct 29 02:55:16.023333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d2ba3fa-9990-4ecb-af95-cf96122d6130 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:16.023877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d2ba3fa-9990-4ecb-af95-cf96122d6130 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:16.024465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d2ba3fa-9990-4ecb-af95-cf96122d6130 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:16.039723 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 888/1985] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:15 2022] GET /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a => generated 1331 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:16.200189 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7fa06fcc-ee99-4ac6-917a-29951ea6cd9b tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff05373ec10>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:16.273691 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7fa06fcc-ee99-4ac6-917a-29951ea6cd9b tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499" status: 200 len: 1428 microversion: 2.1 time: 0.077169 Oct 29 02:55:16.274803 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 889/1986] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:16 2022] GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499 => generated 1428 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:16.298126 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a156de03-fd47-46f5-9a9a-d3c6040b2a40 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:16.301587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a156de03-fd47-46f5-9a9a-d3c6040b2a40 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:16.326268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a156de03-fd47-46f5-9a9a-d3c6040b2a40 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:16.327222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a156de03-fd47-46f5-9a9a-d3c6040b2a40 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:16.327857 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a156de03-fd47-46f5-9a9a-d3c6040b2a40 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:16.331273 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a156de03-fd47-46f5-9a9a-d3c6040b2a40 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:16.334115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a156de03-fd47-46f5-9a9a-d3c6040b2a40 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:16.334849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a156de03-fd47-46f5-9a9a-d3c6040b2a40 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:16.681401 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a156de03-fd47-46f5-9a9a-d3c6040b2a40 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971f709818b74757947beafd14f546bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49721a0af93a47d38613f4a588ab1e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:16.693131 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a156de03-fd47-46f5-9a9a-d3c6040b2a40 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1" status: 200 len: 1316 microversion: 2.1 time: 0.416939 Oct 29 02:55:16.695823 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 890/1987] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:16 2022] GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 => generated 1316 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:16.775219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e9678fcc-fec4-4c50-9c30-d9b3fb2be760 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:16.778798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e9678fcc-fec4-4c50-9c30-d9b3fb2be760 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:16.795440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e9678fcc-fec4-4c50-9c30-d9b3fb2be760 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:16.796884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e9678fcc-fec4-4c50-9c30-d9b3fb2be760 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:16.797551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e9678fcc-fec4-4c50-9c30-d9b3fb2be760 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:16.798464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e9678fcc-fec4-4c50-9c30-d9b3fb2be760 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:16.799115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e9678fcc-fec4-4c50-9c30-d9b3fb2be760 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:16.799763 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e9678fcc-fec4-4c50-9c30-d9b3fb2be760 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:16.802546 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8d2ba3fa-9990-4ecb-af95-cf96122d6130 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:16.830178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8d2ba3fa-9990-4ecb-af95-cf96122d6130 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:16.833739 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8d2ba3fa-9990-4ecb-af95-cf96122d6130 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:16.836956 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8d2ba3fa-9990-4ecb-af95-cf96122d6130 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1879 microversion: 2.42 time: 0.853567 Oct 29 02:55:16.838568 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1098/1988] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:55:15 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1879 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:55:16.859398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0720e90e-5929-451e-9be6-4221691d7dc8 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:16.863940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0720e90e-5929-451e-9be6-4221691d7dc8 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:16.883913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0720e90e-5929-451e-9be6-4221691d7dc8 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:16.884508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0720e90e-5929-451e-9be6-4221691d7dc8 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:16.885832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0720e90e-5929-451e-9be6-4221691d7dc8 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:16.888021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0720e90e-5929-451e-9be6-4221691d7dc8 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:16.889390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0720e90e-5929-451e-9be6-4221691d7dc8 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:16.890028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0720e90e-5929-451e-9be6-4221691d7dc8 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:17.030963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e9678fcc-fec4-4c50-9c30-d9b3fb2be760 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:17.044109 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e9678fcc-fec4-4c50-9c30-d9b3fb2be760 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878" status: 200 len: 1311 microversion: 2.1 time: 0.269943 Oct 29 02:55:17.046009 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 891/1989] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:16 2022] GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 => generated 1311 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:17.061245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d269f697-b091-4d08-b20a-27452ddfe5c7 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:17.062384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d269f697-b091-4d08-b20a-27452ddfe5c7 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] [instance: 4463e53e-8eb7-45b7-ac0b-05204c79896a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:17.075898 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d269f697-b091-4d08-b20a-27452ddfe5c7 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:17.076770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d269f697-b091-4d08-b20a-27452ddfe5c7 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:17.077542 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d269f697-b091-4d08-b20a-27452ddfe5c7 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:17.078443 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d269f697-b091-4d08-b20a-27452ddfe5c7 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:17.079073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d269f697-b091-4d08-b20a-27452ddfe5c7 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:17.079613 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d269f697-b091-4d08-b20a-27452ddfe5c7 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:17.084776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:17.266425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0720e90e-5929-451e-9be6-4221691d7dc8 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844dbc8e54d349ea93c632c54909a718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b7aa3004d94c5a8cf87d5f4d006a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:17.283938 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0720e90e-5929-451e-9be6-4221691d7dc8 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/servers/0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd" status: 200 len: 1474 microversion: 2.1 time: 0.430317 Oct 29 02:55:17.312832 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1099/1990] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:16 2022] GET /compute/v2.1/servers/0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd => generated 1474 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:17.331097 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9dc2f6cc-f106-4e60-919a-a18ec69cdf3c tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff05c098ee0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:17.402609 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9dc2f6cc-f106-4e60-919a-a18ec69cdf3c tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499" status: 200 len: 1437 microversion: 2.1 time: 0.088026 Oct 29 02:55:17.403423 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1100/1991] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:17 2022] GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499 => generated 1437 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:17.420240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1d871563-dd8c-4554-b295-42f0b3bcff24 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff05c0fb4c0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:17.475260 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1d871563-dd8c-4554-b295-42f0b3bcff24 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499" status: 200 len: 1437 microversion: 2.1 time: 0.060330 Oct 29 02:55:17.489493 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1101/1992] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:17 2022] GET /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499 => generated 1437 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:55:17.497189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3acbb02a-16d6-4c4c-a2fc-daf25c9eedba tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:17.505808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3acbb02a-16d6-4c4c-a2fc-daf25c9eedba tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] [instance: c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:17.516216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3acbb02a-16d6-4c4c-a2fc-daf25c9eedba tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:17.517144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3acbb02a-16d6-4c4c-a2fc-daf25c9eedba tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:17.517787 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3acbb02a-16d6-4c4c-a2fc-daf25c9eedba tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:17.536618 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3acbb02a-16d6-4c4c-a2fc-daf25c9eedba tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:17.537442 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3acbb02a-16d6-4c4c-a2fc-daf25c9eedba tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:17.537901 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3acbb02a-16d6-4c4c-a2fc-daf25c9eedba tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:17.595166 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d269f697-b091-4d08-b20a-27452ddfe5c7 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6300e24201407ba4c09cb25d247b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102dffa1e6843c6b5caa93b81a2fbfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:17.603224 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d269f697-b091-4d08-b20a-27452ddfe5c7 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] 10.222.0.46 "GET /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a" status: 200 len: 1331 microversion: 2.1 time: 0.555026 Oct 29 02:55:17.604172 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 892/1993] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:17 2022] GET /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a => generated 1331 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:17.723587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e1bc2a6c-dbcf-4b6c-8352-631f5ae6cf10 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:17.723587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e1bc2a6c-dbcf-4b6c-8352-631f5ae6cf10 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:17.739067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1bc2a6c-dbcf-4b6c-8352-631f5ae6cf10 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:17.739067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1bc2a6c-dbcf-4b6c-8352-631f5ae6cf10 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:17.739067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1bc2a6c-dbcf-4b6c-8352-631f5ae6cf10 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:17.739067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1bc2a6c-dbcf-4b6c-8352-631f5ae6cf10 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:17.739067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1bc2a6c-dbcf-4b6c-8352-631f5ae6cf10 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:17.739067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1bc2a6c-dbcf-4b6c-8352-631f5ae6cf10 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:18.036954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e1bc2a6c-dbcf-4b6c-8352-631f5ae6cf10 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971f709818b74757947beafd14f546bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49721a0af93a47d38613f4a588ab1e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:18.047604 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e1bc2a6c-dbcf-4b6c-8352-631f5ae6cf10 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1" status: 200 len: 1316 microversion: 2.1 time: 0.331257 Oct 29 02:55:18.050981 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 893/1994] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:17 2022] GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 => generated 1316 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:55:18.073525 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-53194219-4e27-4687-91b0-6530d10ec149 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:18.077234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-53194219-4e27-4687-91b0-6530d10ec149 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:18.088426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53194219-4e27-4687-91b0-6530d10ec149 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:18.089229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53194219-4e27-4687-91b0-6530d10ec149 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:18.089828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53194219-4e27-4687-91b0-6530d10ec149 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:18.090749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53194219-4e27-4687-91b0-6530d10ec149 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:18.091200 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53194219-4e27-4687-91b0-6530d10ec149 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:18.091765 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53194219-4e27-4687-91b0-6530d10ec149 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:18.135790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3acbb02a-16d6-4c4c-a2fc-daf25c9eedba tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c3218be14842e1b1fd2e5c10c9092a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f820fbde72429db671d15337913fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:18.165815 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3acbb02a-16d6-4c4c-a2fc-daf25c9eedba tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc" status: 200 len: 1466 microversion: 2.1 time: 0.673253 Oct 29 02:55:18.167437 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1102/1995] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:17 2022] GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc => generated 1466 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:18.175646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-0370731e-d236-44f4-8dad-6a92890dec59 req-8deaaa1e-a44f-47ea-b000-b1814db4b5d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4463e53e-8eb7-45b7-ac0b-05204c79896a", "name": "network-vif-plugged", "status": "completed", "tag": "b7adebcb-9cb0-4755-83b6-d418a864b6a2"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:18.191264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-0370731e-d236-44f4-8dad-6a92890dec59 req-8deaaa1e-a44f-47ea-b000-b1814db4b5d0 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:18.192211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-0370731e-d236-44f4-8dad-6a92890dec59 req-8deaaa1e-a44f-47ea-b000-b1814db4b5d0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:18.192836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-0370731e-d236-44f4-8dad-6a92890dec59 req-8deaaa1e-a44f-47ea-b000-b1814db4b5d0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:18.219149 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-0370731e-d236-44f4-8dad-6a92890dec59 req-8deaaa1e-a44f-47ea-b000-b1814db4b5d0 service nova] Creating event network-vif-plugged:b7adebcb-9cb0-4755-83b6-d418a864b6a2 for instance 4463e53e-8eb7-45b7-ac0b-05204c79896a on n-h2-862967-2 Oct 29 02:55:18.227083 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-0370731e-d236-44f4-8dad-6a92890dec59 req-8deaaa1e-a44f-47ea-b000-b1814db4b5d0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057896 Oct 29 02:55:18.228262 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1103/1996] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:18.238913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-40a5b8a5-dbd5-44b9-9989-6dfdf71e6c32 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:18.239873 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-40a5b8a5-dbd5-44b9-9989-6dfdf71e6c32 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:18.250697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40a5b8a5-dbd5-44b9-9989-6dfdf71e6c32 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:18.269348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40a5b8a5-dbd5-44b9-9989-6dfdf71e6c32 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:18.274414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40a5b8a5-dbd5-44b9-9989-6dfdf71e6c32 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:18.277630 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40a5b8a5-dbd5-44b9-9989-6dfdf71e6c32 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:18.278801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40a5b8a5-dbd5-44b9-9989-6dfdf71e6c32 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:18.279547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40a5b8a5-dbd5-44b9-9989-6dfdf71e6c32 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:18.483302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-53194219-4e27-4687-91b0-6530d10ec149 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:18.495589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-53194219-4e27-4687-91b0-6530d10ec149 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:18.497203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-53194219-4e27-4687-91b0-6530d10ec149 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:18.498473 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-53194219-4e27-4687-91b0-6530d10ec149 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 2834 microversion: 2.42 time: 0.446304 Oct 29 02:55:18.499118 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 894/1997] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:55:18 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 2834 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:55:18.513841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a6076583-2e67-4e70-80cf-e1ae2882847a tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff0536e05e0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:18.782036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-40a5b8a5-dbd5-44b9-9989-6dfdf71e6c32 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:18.794910 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-40a5b8a5-dbd5-44b9-9989-6dfdf71e6c32 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878" status: 200 len: 1311 microversion: 2.1 time: 0.565068 Oct 29 02:55:18.796784 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1104/1998] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:18 2022] GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 => generated 1311 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:18.801816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-355b3559-9f55-40b7-b168-b84e03167a63 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:18.809663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-355b3559-9f55-40b7-b168-b84e03167a63 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:18.827622 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-355b3559-9f55-40b7-b168-b84e03167a63 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:18.828118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-355b3559-9f55-40b7-b168-b84e03167a63 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:18.828594 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-355b3559-9f55-40b7-b168-b84e03167a63 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:18.829333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-355b3559-9f55-40b7-b168-b84e03167a63 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:18.835574 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-355b3559-9f55-40b7-b168-b84e03167a63 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:18.836273 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-355b3559-9f55-40b7-b168-b84e03167a63 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:19.628744 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a6076583-2e67-4e70-80cf-e1ae2882847a tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "DELETE /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499" status: 204 len: 0 microversion: 2.1 time: 1.126202 Oct 29 02:55:19.631005 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 895/1999] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:18 2022] DELETE /compute/v2.1/images/df26d560-29ce-4493-b1bc-574fa01dd499 => generated 0 bytes in 1131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:55:19.901772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3e0a107d-944d-4d78-b5fd-b5ac62a74354 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Action: 'create', calling method: .version_select at 0x7ff05370c550>, body: {"keypair": {"name": "tempest-keypair-1280533601", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMT+ks5wNwLVGg0n3k2+lOkWaws5V84PzBw2PaVrCRyPkolcEesOBRDLIFjppQm+5F1ZmbXcpYfecRdConRoPkQsgxev/P/JGX+eORxyvsq5OJy2ifHfa0/M7GwMds+t5g=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:19.950766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-3e0a107d-944d-4d78-b5fd-b5ac62a74354 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Getting quotas for project bb6b7f93767742aa9d35d45caf8945d3. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:55:19.968070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-3e0a107d-944d-4d78-b5fd-b5ac62a74354 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Getting quotas for user b368aa7acf3b419c8310c20f93fbe55a and project bb6b7f93767742aa9d35d45caf8945d3. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:55:20.025956 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3e0a107d-944d-4d78-b5fd-b5ac62a74354 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.392705 Oct 29 02:55:20.033410 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 896/2000] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 02:55:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:20.039348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1cd9b27c-f211-4962-8b90-85a74f718013 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:20.040178 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1cd9b27c-f211-4962-8b90-85a74f718013 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:20.047208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cd9b27c-f211-4962-8b90-85a74f718013 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:20.047929 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cd9b27c-f211-4962-8b90-85a74f718013 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:20.048497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cd9b27c-f211-4962-8b90-85a74f718013 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:20.049493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cd9b27c-f211-4962-8b90-85a74f718013 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:20.050104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cd9b27c-f211-4962-8b90-85a74f718013 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:20.050842 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cd9b27c-f211-4962-8b90-85a74f718013 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:20.296094 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1cd9b27c-f211-4962-8b90-85a74f718013 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.260863 Oct 29 02:55:20.298080 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 897/2001] 10.222.0.46 () {60 vars in 1316 bytes} [Sat Oct 29 02:55:20 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142/os-interface => generated 1829 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:55:20.302706 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-575c00af-9e9e-4140-ac3d-51c25da1b57f tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:20.303377 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-575c00af-9e9e-4140-ac3d-51c25da1b57f tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] [instance: 4463e53e-8eb7-45b7-ac0b-05204c79896a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:20.319418 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-575c00af-9e9e-4140-ac3d-51c25da1b57f tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:20.321172 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-575c00af-9e9e-4140-ac3d-51c25da1b57f tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:20.322307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-575c00af-9e9e-4140-ac3d-51c25da1b57f tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:20.325214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-575c00af-9e9e-4140-ac3d-51c25da1b57f tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:20.328306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-575c00af-9e9e-4140-ac3d-51c25da1b57f tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:20.329034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-575c00af-9e9e-4140-ac3d-51c25da1b57f tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:20.351112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-355b3559-9f55-40b7-b168-b84e03167a63 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '844dbc8e54d349ea93c632c54909a718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3b7aa3004d94c5a8cf87d5f4d006a73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:20.364687 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-355b3559-9f55-40b7-b168-b84e03167a63 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/servers/0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd" status: 200 len: 1474 microversion: 2.1 time: 1.564884 Oct 29 02:55:20.367598 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1105/2002] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:18 2022] GET /compute/v2.1/servers/0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd => generated 1474 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:20.379469 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-227ad6db-8be1-4119-9cad-60bb7037b8bb tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:20.380017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-227ad6db-8be1-4119-9cad-60bb7037b8bb tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:20.399460 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-227ad6db-8be1-4119-9cad-60bb7037b8bb tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:20.399745 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-227ad6db-8be1-4119-9cad-60bb7037b8bb tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:20.401302 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-227ad6db-8be1-4119-9cad-60bb7037b8bb tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:20.402498 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-227ad6db-8be1-4119-9cad-60bb7037b8bb tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:20.405640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-227ad6db-8be1-4119-9cad-60bb7037b8bb tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:20.407425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-227ad6db-8be1-4119-9cad-60bb7037b8bb tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:20.853952 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-575c00af-9e9e-4140-ac3d-51c25da1b57f tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6300e24201407ba4c09cb25d247b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102dffa1e6843c6b5caa93b81a2fbfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:20.898241 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-575c00af-9e9e-4140-ac3d-51c25da1b57f tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] 10.222.0.46 "GET /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a" status: 200 len: 1535 microversion: 2.1 time: 0.588574 Oct 29 02:55:20.902639 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 898/2003] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:20 2022] GET /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a => generated 1535 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:20.926649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1deb95ba-96e0-49a4-b715-70df73e35543 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '.version_select at 0x7ff0536e0a60>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:21.036338 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-1deb95ba-96e0-49a4-b715-70df73e35543 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] HTTP exception thrown: Image not found. Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1deb95ba-96e0-49a4-b715-70df73e35543 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Request method failure captured: Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/images/cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d HTTP/1.1 Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJWc53h7hM9oU9WEEj1IEccQgR6h1ZXcmRg9Ysvo3vT7XN5rQV-c9ztTirjn-gqgcSh9Qr66wROJ6Jr8oSp1eJxAz4oQfx9CYhxJrf1fEvbPHGHUNJFwOa8qFEkUECOjJ4-hgdsKNy6XDim2xU34-IDyYPKeehx2z5xc68iUjCjH_0s Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 10f820fbde72429db671d15337913fd4 Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ImagesOneServerTestJSON-2059384949 Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/10f820fbde72429db671d15337913fd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/10f820fbde72429db671d15337913fd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_10f820fbde72429db671d15337913fd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/10f820fbde72429db671d15337913fd4"}]}] Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ImagesOneServerTestJSON-2059384949 Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 10f820fbde72429db671d15337913fd4 Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2059384949 Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ImagesOneServerTestJSON-2059384949-project Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 71c3218be14842e1b1fd2e5c10c9092a Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ImagesOneServerTestJSON-2059384949-project Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: exception: Image not found. Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d'} Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d to delete Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d could not be found. Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:21.040278 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:21.043669 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:21.043669 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:21.043669 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:21.043669 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:21.043669 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:55:21.043669 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:55:21.043669 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:21.043669 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:21.043669 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 02:55:21.043669 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 02:55:21.043669 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:55:21.043669 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:21.043669 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:21.043669 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:21.043669 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:21.043669 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:21.043669 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:21.043669 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:21.043669 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:21.043669 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:55:21.043669 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:21.043669 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1deb95ba-96e0-49a4-b715-70df73e35543 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Returning 404 to user: Image not found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:21.043669 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1deb95ba-96e0-49a4-b715-70df73e35543 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "DELETE /compute/v2.1/images/cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d" status: 404 len: 62 microversion: 2.1 time: 0.136343 Oct 29 02:55:21.045896 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 899/2004] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:20 2022] DELETE /compute/v2.1/images/cb6e7b3e-1b3a-4284-8eb7-03bedb919c5d => generated 62 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:55:21.060755 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7980cc4f-3a0f-4bb2-b095-5f10d47c991b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:21.069719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7980cc4f-3a0f-4bb2-b095-5f10d47c991b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:21.099306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7980cc4f-3a0f-4bb2-b095-5f10d47c991b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:21.100186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7980cc4f-3a0f-4bb2-b095-5f10d47c991b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:21.102977 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7980cc4f-3a0f-4bb2-b095-5f10d47c991b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:21.104135 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7980cc4f-3a0f-4bb2-b095-5f10d47c991b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:21.105834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7980cc4f-3a0f-4bb2-b095-5f10d47c991b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:21.107428 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7980cc4f-3a0f-4bb2-b095-5f10d47c991b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:21.107539 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-227ad6db-8be1-4119-9cad-60bb7037b8bb tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971f709818b74757947beafd14f546bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49721a0af93a47d38613f4a588ab1e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:21.155917 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-227ad6db-8be1-4119-9cad-60bb7037b8bb tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1" status: 200 len: 1316 microversion: 2.1 time: 0.786447 Oct 29 02:55:21.175484 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1106/2005] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:20 2022] GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 => generated 1316 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:21.187910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-23d03184-15b8-49d2-95c0-80d72e71e57e req-8fdf1292-9aff-4c6f-8216-378e2e9edeea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1", "name": "network-vif-plugged", "status": "completed", "tag": "46f29793-230c-41a4-90a3-6f7ef9ed7a47"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:21.222919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-23d03184-15b8-49d2-95c0-80d72e71e57e req-8fdf1292-9aff-4c6f-8216-378e2e9edeea service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:21.224051 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-23d03184-15b8-49d2-95c0-80d72e71e57e req-8fdf1292-9aff-4c6f-8216-378e2e9edeea service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:21.224722 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-23d03184-15b8-49d2-95c0-80d72e71e57e req-8fdf1292-9aff-4c6f-8216-378e2e9edeea service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:21.557999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7980cc4f-3a0f-4bb2-b095-5f10d47c991b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:21.584769 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7980cc4f-3a0f-4bb2-b095-5f10d47c991b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878" status: 200 len: 1311 microversion: 2.1 time: 0.538071 Oct 29 02:55:21.585448 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-23d03184-15b8-49d2-95c0-80d72e71e57e req-8fdf1292-9aff-4c6f-8216-378e2e9edeea service nova] Creating event network-vif-plugged:46f29793-230c-41a4-90a3-6f7ef9ed7a47 for instance 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 on n-h1-862967-2 Oct 29 02:55:21.603109 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 900/2006] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:21 2022] GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 => generated 1311 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:21.603372 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-23d03184-15b8-49d2-95c0-80d72e71e57e req-8fdf1292-9aff-4c6f-8216-378e2e9edeea service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.421650 Oct 29 02:55:21.603466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-dbb36f0e-5c69-4e78-973e-c4c0d30f2e2f req-7480c19c-da16-4322-b10e-ff79022ddca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd", "name": "network-vif-deleted", "tag": "9daf432c-ab9e-41ed-aaf7-21cb4e7d509f"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:21.604149 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1107/2007] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:21.629920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0dddc5df-95a2-4023-81f8-6fd991430b99 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Action: 'create', calling method: .version_select at 0x7ff05c077af0>, body: {"pool": "067f6498-08a7-4612-b1a7-402ac9c9abc8"} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:21.645960 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-dbb36f0e-5c69-4e78-973e-c4c0d30f2e2f req-7480c19c-da16-4322-b10e-ff79022ddca4 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:21.647028 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-dbb36f0e-5c69-4e78-973e-c4c0d30f2e2f req-7480c19c-da16-4322-b10e-ff79022ddca4 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:21.649477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-dbb36f0e-5c69-4e78-973e-c4c0d30f2e2f req-7480c19c-da16-4322-b10e-ff79022ddca4 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:21.698058 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-dbb36f0e-5c69-4e78-973e-c4c0d30f2e2f req-7480c19c-da16-4322-b10e-ff79022ddca4 service nova] Creating event network-vif-deleted:9daf432c-ab9e-41ed-aaf7-21cb4e7d509f for instance 0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd on n-h1-862967-2 Oct 29 02:55:21.722177 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-dbb36f0e-5c69-4e78-973e-c4c0d30f2e2f req-7480c19c-da16-4322-b10e-ff79022ddca4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130421 Oct 29 02:55:21.738525 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 901/2008] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:21.765873 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-817ddcca-bee0-483b-b2a7-9514d11b8d9b tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:21.769734 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-817ddcca-bee0-483b-b2a7-9514d11b8d9b tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] [instance: c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:21.783976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-817ddcca-bee0-483b-b2a7-9514d11b8d9b tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:21.793710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-817ddcca-bee0-483b-b2a7-9514d11b8d9b tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:21.796397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-817ddcca-bee0-483b-b2a7-9514d11b8d9b tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:21.798327 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-817ddcca-bee0-483b-b2a7-9514d11b8d9b tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:21.800047 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-817ddcca-bee0-483b-b2a7-9514d11b8d9b tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:21.803176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-817ddcca-bee0-483b-b2a7-9514d11b8d9b tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:21.884164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-817ddcca-bee0-483b-b2a7-9514d11b8d9b tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] [instance: c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:55:22.136686 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-817ddcca-bee0-483b-b2a7-9514d11b8d9b tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc" status: 204 len: 0 microversion: 2.1 time: 0.394762 Oct 29 02:55:22.143201 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 902/2009] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:55:21 2022] DELETE /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:55:22.156844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-45ec50e5-fbec-4f94-9a35-67977d311ab5 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:22.157899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-45ec50e5-fbec-4f94-9a35-67977d311ab5 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] [instance: 0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:22.176400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45ec50e5-fbec-4f94-9a35-67977d311ab5 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:22.177010 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45ec50e5-fbec-4f94-9a35-67977d311ab5 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:22.181134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45ec50e5-fbec-4f94-9a35-67977d311ab5 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:22.182131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45ec50e5-fbec-4f94-9a35-67977d311ab5 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:22.182738 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45ec50e5-fbec-4f94-9a35-67977d311ab5 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:22.183220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45ec50e5-fbec-4f94-9a35-67977d311ab5 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:22.225515 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-45ec50e5-fbec-4f94-9a35-67977d311ab5 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] HTTP exception thrown: Instance 0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd could not be found. Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-45ec50e5-fbec-4f94-9a35-67977d311ab5 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Request method failure captured: Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd HTTP/1.1 Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJVXODsKauKESdSabNTm4y-J8U71R5N9-LEqR_TDNry5mzPUAkMuXsKXvPAwdZM4-yRNOG_4Ew9UaiY-BY4GWCsq1kxnL4KH2UKS8UzzqsgqMkA8MDeo_tXU9G9Z_9tan-jXQ4e53wsImpjhDgxDGNVXpu3Ckzw_tYv5MN0fsjMuPlk Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: f3b7aa3004d94c5a8cf87d5f4d006a73 Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ListImageFiltersTestJSON-974859316 Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f3b7aa3004d94c5a8cf87d5f4d006a73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f3b7aa3004d94c5a8cf87d5f4d006a73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f3b7aa3004d94c5a8cf87d5f4d006a73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f3b7aa3004d94c5a8cf87d5f4d006a73"}]}] Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ListImageFiltersTestJSON-974859316 Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: f3b7aa3004d94c5a8cf87d5f4d006a73 Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-974859316 Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ListImageFiltersTestJSON-974859316-project Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 844dbc8e54d349ea93c632c54909a718 Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ListImageFiltersTestJSON-974859316-project Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd could not be found. Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd'} Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd could not be found. Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd could not be found. Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:22.227347 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:22.230824 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:22.230824 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:22.230824 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:22.230824 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:22.230824 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:22.230824 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd could not be found. Oct 29 02:55:22.230824 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:22.230824 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-45ec50e5-fbec-4f94-9a35-67977d311ab5 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Returning 404 to user: Instance 0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:22.230824 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-45ec50e5-fbec-4f94-9a35-67977d311ab5 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "GET /compute/v2.1/servers/0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd" status: 404 len: 111 microversion: 2.1 time: 0.085196 Oct 29 02:55:22.236408 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 903/2010] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:22 2022] GET /compute/v2.1/servers/0fcf9d98-c6c9-42a9-b1c0-1ed2edf629bd => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:55:22.247856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-45d9e7ab-cc22-4472-971b-d740fd9e6db2 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:22.248591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-45d9e7ab-cc22-4472-971b-d740fd9e6db2 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] [instance: c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:22.266258 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45d9e7ab-cc22-4472-971b-d740fd9e6db2 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:22.269440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45d9e7ab-cc22-4472-971b-d740fd9e6db2 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:22.269440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45d9e7ab-cc22-4472-971b-d740fd9e6db2 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:22.272796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45d9e7ab-cc22-4472-971b-d740fd9e6db2 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:22.273657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45d9e7ab-cc22-4472-971b-d740fd9e6db2 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:22.274288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45d9e7ab-cc22-4472-971b-d740fd9e6db2 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:22.833976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-45d9e7ab-cc22-4472-971b-d740fd9e6db2 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c3218be14842e1b1fd2e5c10c9092a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f820fbde72429db671d15337913fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:22.854044 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-45d9e7ab-cc22-4472-971b-d740fd9e6db2 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc" status: 200 len: 1472 microversion: 2.1 time: 0.610762 Oct 29 02:55:22.854618 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 904/2011] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:22 2022] GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc => generated 1472 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:22.869363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a56812bd-a75a-4959-9d2d-202d2c9966e3 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:22.870678 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a56812bd-a75a-4959-9d2d-202d2c9966e3 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:22.894649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a56812bd-a75a-4959-9d2d-202d2c9966e3 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:22.895705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a56812bd-a75a-4959-9d2d-202d2c9966e3 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:22.895705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a56812bd-a75a-4959-9d2d-202d2c9966e3 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:22.896256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a56812bd-a75a-4959-9d2d-202d2c9966e3 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:22.901056 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a56812bd-a75a-4959-9d2d-202d2c9966e3 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:22.901634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a56812bd-a75a-4959-9d2d-202d2c9966e3 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:23.441016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a56812bd-a75a-4959-9d2d-202d2c9966e3 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971f709818b74757947beafd14f546bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49721a0af93a47d38613f4a588ab1e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:23.450394 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a56812bd-a75a-4959-9d2d-202d2c9966e3 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1" status: 200 len: 1316 microversion: 2.1 time: 0.594016 Oct 29 02:55:23.457805 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 905/2012] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:22 2022] GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 => generated 1316 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:23.463368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-25b3b970-b8b6-4ea7-9f6e-4022fad91524 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff053725ee0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:23.848082 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-25b3b970-b8b6-4ea7-9f6e-4022fad91524 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "DELETE /compute/v2.1/images/dcaad93a-4b7b-4204-9231-a63bb5cfaf19" status: 204 len: 0 microversion: 2.1 time: 0.388758 Oct 29 02:55:23.849129 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 906/2013] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:23 2022] DELETE /compute/v2.1/images/dcaad93a-4b7b-4204-9231-a63bb5cfaf19 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:55:23.855689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-77cf3cca-d5d1-4d8f-8304-943cab7e71d0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:23.856508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-77cf3cca-d5d1-4d8f-8304-943cab7e71d0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:23.886556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77cf3cca-d5d1-4d8f-8304-943cab7e71d0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:23.889688 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77cf3cca-d5d1-4d8f-8304-943cab7e71d0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:23.893373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77cf3cca-d5d1-4d8f-8304-943cab7e71d0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:23.895876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77cf3cca-d5d1-4d8f-8304-943cab7e71d0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:23.898898 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77cf3cca-d5d1-4d8f-8304-943cab7e71d0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:23.900153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77cf3cca-d5d1-4d8f-8304-943cab7e71d0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:25.104057 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-77cf3cca-d5d1-4d8f-8304-943cab7e71d0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:25.114566 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-77cf3cca-d5d1-4d8f-8304-943cab7e71d0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878" status: 200 len: 1311 microversion: 2.1 time: 1.263329 Oct 29 02:55:25.115891 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 907/2014] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:23 2022] GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 => generated 1311 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:25.122392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-f6fe15c3-c409-4cec-9bd3-c9f3f1067c2a req-69eeeedf-4fa9-4a4d-9dd9-13975d4c8115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc", "name": "network-vif-unplugged", "status": "completed", "tag": "79864797-817a-49a1-9e41-46b8d629427a"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:25.151935 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f6fe15c3-c409-4cec-9bd3-c9f3f1067c2a req-69eeeedf-4fa9-4a4d-9dd9-13975d4c8115 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:25.152717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f6fe15c3-c409-4cec-9bd3-c9f3f1067c2a req-69eeeedf-4fa9-4a4d-9dd9-13975d4c8115 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:25.153343 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f6fe15c3-c409-4cec-9bd3-c9f3f1067c2a req-69eeeedf-4fa9-4a4d-9dd9-13975d4c8115 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:25.188300 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-f6fe15c3-c409-4cec-9bd3-c9f3f1067c2a req-69eeeedf-4fa9-4a4d-9dd9-13975d4c8115 service nova] Creating event network-vif-unplugged:79864797-817a-49a1-9e41-46b8d629427a for instance c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc on n-h2-862967-2 Oct 29 02:55:25.199540 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-f6fe15c3-c409-4cec-9bd3-c9f3f1067c2a req-69eeeedf-4fa9-4a4d-9dd9-13975d4c8115 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082045 Oct 29 02:55:25.200807 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 908/2015] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:25.214873 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d9156261-fd41-4341-973e-6352bfc94580 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff053656310>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:25.611231 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d9156261-fd41-4341-973e-6352bfc94580 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "DELETE /compute/v2.1/images/fdfde304-89aa-4f56-9a3c-38c9c906de34" status: 204 len: 0 microversion: 2.1 time: 0.408250 Oct 29 02:55:25.612690 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 909/2016] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:25 2022] DELETE /compute/v2.1/images/fdfde304-89aa-4f56-9a3c-38c9c906de34 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:55:25.621457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-75988360-34c1-4533-b199-40bc322a1791 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:25.622813 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-75988360-34c1-4533-b199-40bc322a1791 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] [instance: c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:25.651954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75988360-34c1-4533-b199-40bc322a1791 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:25.652941 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75988360-34c1-4533-b199-40bc322a1791 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:25.653565 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75988360-34c1-4533-b199-40bc322a1791 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:25.654739 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75988360-34c1-4533-b199-40bc322a1791 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:25.659641 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75988360-34c1-4533-b199-40bc322a1791 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:25.660400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75988360-34c1-4533-b199-40bc322a1791 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:26.139767 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0dddc5df-95a2-4023-81f8-6fd991430b99 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.531941 Oct 29 02:55:26.147514 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1108/2017] 10.222.0.46 () {60 vars in 1170 bytes} [Sat Oct 29 02:55:21 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:26.147514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-21a7d8bd-9cf2-43d4-b49e-c2039087bd85 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:26.147514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-21a7d8bd-9cf2-43d4-b49e-c2039087bd85 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:26.154480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-21a7d8bd-9cf2-43d4-b49e-c2039087bd85 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:26.155085 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-21a7d8bd-9cf2-43d4-b49e-c2039087bd85 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:26.155535 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-21a7d8bd-9cf2-43d4-b49e-c2039087bd85 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:26.156379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-21a7d8bd-9cf2-43d4-b49e-c2039087bd85 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:26.157447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-21a7d8bd-9cf2-43d4-b49e-c2039087bd85 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:26.158026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-21a7d8bd-9cf2-43d4-b49e-c2039087bd85 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:26.357686 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-75988360-34c1-4533-b199-40bc322a1791 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71c3218be14842e1b1fd2e5c10c9092a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f820fbde72429db671d15337913fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:26.383812 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-75988360-34c1-4533-b199-40bc322a1791 tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc" status: 200 len: 1472 microversion: 2.1 time: 0.768986 Oct 29 02:55:26.384705 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 910/2018] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:25 2022] GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc => generated 1472 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:26.394828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c40828ce-a72b-4c34-a564-175b95898bb7 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] Calling method '.version_select at 0x7ff053656b80>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:26.467278 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-21a7d8bd-9cf2-43d4-b49e-c2039087bd85 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971f709818b74757947beafd14f546bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49721a0af93a47d38613f4a588ab1e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:26.487214 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-21a7d8bd-9cf2-43d4-b49e-c2039087bd85 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1" status: 200 len: 1504 microversion: 2.1 time: 0.339740 Oct 29 02:55:26.509329 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1109/2019] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:26 2022] GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 => generated 1504 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:26.516944 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b5e07404-9ddb-4627-bad5-e6a5a172d3ea tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:26.517801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b5e07404-9ddb-4627-bad5-e6a5a172d3ea tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:26.524851 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5e07404-9ddb-4627-bad5-e6a5a172d3ea tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:26.526250 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5e07404-9ddb-4627-bad5-e6a5a172d3ea tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:26.528554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5e07404-9ddb-4627-bad5-e6a5a172d3ea tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:26.530397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5e07404-9ddb-4627-bad5-e6a5a172d3ea tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:26.532403 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5e07404-9ddb-4627-bad5-e6a5a172d3ea tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:26.533325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5e07404-9ddb-4627-bad5-e6a5a172d3ea tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:26.935204 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c40828ce-a72b-4c34-a564-175b95898bb7 tempest-ListImageFiltersTestJSON-974859316 tempest-ListImageFiltersTestJSON-974859316-project] 10.222.0.46 "DELETE /compute/v2.1/images/df7dd259-4b6c-45e5-bdb4-85f1c68b9a6e" status: 204 len: 0 microversion: 2.1 time: 0.548926 Oct 29 02:55:26.945382 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 911/2020] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:26 2022] DELETE /compute/v2.1/images/df7dd259-4b6c-45e5-bdb4-85f1c68b9a6e => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:55:26.959680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4af24e78-082b-463f-b735-819f2fbc1b2c tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.126"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:26.975189 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4af24e78-082b-463f-b735-819f2fbc1b2c tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] [instance: 4463e53e-8eb7-45b7-ac0b-05204c79896a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:26.996578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b5e07404-9ddb-4627-bad5-e6a5a172d3ea tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:27.002343 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4af24e78-082b-463f-b735-819f2fbc1b2c tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:27.002830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4af24e78-082b-463f-b735-819f2fbc1b2c tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:27.003248 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4af24e78-082b-463f-b735-819f2fbc1b2c tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:27.008691 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b5e07404-9ddb-4627-bad5-e6a5a172d3ea tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878" status: 200 len: 1311 microversion: 2.1 time: 0.497675 Oct 29 02:55:27.010026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4af24e78-082b-463f-b735-819f2fbc1b2c tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:27.010658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4af24e78-082b-463f-b735-819f2fbc1b2c tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:27.011549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4af24e78-082b-463f-b735-819f2fbc1b2c tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:27.017565 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1110/2021] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:26 2022] GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 => generated 1311 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:27.029351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d6e89e50-e26e-4b6d-ae92-397bdabcbb79 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1104642096"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:27.036062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d6e89e50-e26e-4b6d-ae92-397bdabcbb79 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:27.059585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6e89e50-e26e-4b6d-ae92-397bdabcbb79 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:27.065950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6e89e50-e26e-4b6d-ae92-397bdabcbb79 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:27.067186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6e89e50-e26e-4b6d-ae92-397bdabcbb79 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:27.071993 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6e89e50-e26e-4b6d-ae92-397bdabcbb79 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:27.072515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6e89e50-e26e-4b6d-ae92-397bdabcbb79 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:27.072982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6e89e50-e26e-4b6d-ae92-397bdabcbb79 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:27.099730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4af24e78-082b-463f-b735-819f2fbc1b2c tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "refresh_cache-4463e53e-8eb7-45b7-ac0b-05204c79896a" {{(pid=127125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 02:55:27.100477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4af24e78-082b-463f-b735-819f2fbc1b2c tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquired lock "refresh_cache-4463e53e-8eb7-45b7-ac0b-05204c79896a" {{(pid=127125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 02:55:27.377362 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.network.security_group_api [None req-d6e89e50-e26e-4b6d-ae92-397bdabcbb79 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Adding security group 58dbda33-dfee-4dbc-b17e-75a83fc45200 to port 46f29793-230c-41a4-90a3-6f7ef9ed7a47 Oct 29 02:55:27.941804 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d6e89e50-e26e-4b6d-ae92-397bdabcbb79 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "POST /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1/action" status: 202 len: 0 microversion: 2.1 time: 0.921256 Oct 29 02:55:27.942610 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1111/2022] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:55:27 2022] POST /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1/action => generated 0 bytes in 925 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:55:27.948832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-7438a46f-b0c4-4425-ad08-a9cb4c9d9bec req-0b8fd6c6-59b0-442e-b7b2-d9e1271ca327 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0c20eea-c322-4d8e-bafd-3b3b01c5d142", "tag": "1a1b3e12-192b-4594-85e0-b5bcedd79e34"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:27.985983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7438a46f-b0c4-4425-ad08-a9cb4c9d9bec req-0b8fd6c6-59b0-442e-b7b2-d9e1271ca327 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:27.988319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7438a46f-b0c4-4425-ad08-a9cb4c9d9bec req-0b8fd6c6-59b0-442e-b7b2-d9e1271ca327 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:27.991595 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7438a46f-b0c4-4425-ad08-a9cb4c9d9bec req-0b8fd6c6-59b0-442e-b7b2-d9e1271ca327 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:28.021243 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-7438a46f-b0c4-4425-ad08-a9cb4c9d9bec req-0b8fd6c6-59b0-442e-b7b2-d9e1271ca327 service nova] Creating event network-changed:1a1b3e12-192b-4594-85e0-b5bcedd79e34 for instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 on n-h2-862967-2 Oct 29 02:55:28.036617 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-7438a46f-b0c4-4425-ad08-a9cb4c9d9bec req-0b8fd6c6-59b0-442e-b7b2-d9e1271ca327 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092211 Oct 29 02:55:28.037668 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1112/2023] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:28.379123 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-27579f7c-67ef-4401-b04d-939a6a035b84 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1720289057", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "f702c583-8fed-4e5b-aa41-66237b105591"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:28.454964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-27579f7c-67ef-4401-b04d-939a6a035b84 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] validate_networks() for [('f702c583-8fed-4e5b-aa41-66237b105591', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:55:29.449675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-27579f7c-67ef-4401-b04d-939a6a035b84 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:55:29.450260 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-27579f7c-67ef-4401-b04d-939a6a035b84 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:55:29.450721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-27579f7c-67ef-4401-b04d-939a6a035b84 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:55:29.451243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-27579f7c-67ef-4401-b04d-939a6a035b84 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:55:29.451790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-27579f7c-67ef-4401-b04d-939a6a035b84 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:55:29.473860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27579f7c-67ef-4401-b04d-939a6a035b84 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:29.474251 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27579f7c-67ef-4401-b04d-939a6a035b84 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:29.474843 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27579f7c-67ef-4401-b04d-939a6a035b84 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:29.479218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27579f7c-67ef-4401-b04d-939a6a035b84 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:29.479872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27579f7c-67ef-4401-b04d-939a6a035b84 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:29.480417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27579f7c-67ef-4401-b04d-939a6a035b84 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:29.526296 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-27579f7c-67ef-4401-b04d-939a6a035b84 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Getting quotas for project 4447208645ac446686b659cbcf434d71. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:55:29.532636 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-27579f7c-67ef-4401-b04d-939a6a035b84 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Getting quotas for user ca4d2e4223be40a7b76d6f0fa3920b1c and project 4447208645ac446686b659cbcf434d71. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:55:29.577010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-27579f7c-67ef-4401-b04d-939a6a035b84 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:55:29.580221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-27579f7c-67ef-4401-b04d-939a6a035b84 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] [instance: 6b16dc02-4eb1-41dc-abd3-47ad38c265df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:55:29.653297 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-27579f7c-67ef-4401-b04d-939a6a035b84 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.613850 Oct 29 02:55:29.654296 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1113/2024] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:55:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:55:29.670977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-06fe784d-87b8-49aa-aef7-2216386d8ff0 req-8d9bb73a-0d52-4d0a-8d66-3394f9837cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42ddcbfc-a37e-4d2f-8e07-c28bfcf40878", "name": "network-vif-plugged", "status": "completed", "tag": "8c18d333-2ae5-4735-96e6-5b6ea458aef2"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:29.704918 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-06fe784d-87b8-49aa-aef7-2216386d8ff0 req-8d9bb73a-0d52-4d0a-8d66-3394f9837cc9 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:29.705536 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-06fe784d-87b8-49aa-aef7-2216386d8ff0 req-8d9bb73a-0d52-4d0a-8d66-3394f9837cc9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:29.706159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-06fe784d-87b8-49aa-aef7-2216386d8ff0 req-8d9bb73a-0d52-4d0a-8d66-3394f9837cc9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:29.721566 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-06fe784d-87b8-49aa-aef7-2216386d8ff0 req-8d9bb73a-0d52-4d0a-8d66-3394f9837cc9 service nova] Creating event network-vif-plugged:8c18d333-2ae5-4735-96e6-5b6ea458aef2 for instance 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 on n-h1-862967-2 Oct 29 02:55:29.730089 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-06fe784d-87b8-49aa-aef7-2216386d8ff0 req-8d9bb73a-0d52-4d0a-8d66-3394f9837cc9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074227 Oct 29 02:55:29.732069 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1114/2025] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:29.739774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ca08c97d-8b4b-4c63-9eb7-558f5adc034f tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:29.741288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ca08c97d-8b4b-4c63-9eb7-558f5adc034f tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] [instance: c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:29.751193 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca08c97d-8b4b-4c63-9eb7-558f5adc034f tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:29.752231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca08c97d-8b4b-4c63-9eb7-558f5adc034f tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:29.753140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca08c97d-8b4b-4c63-9eb7-558f5adc034f tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:29.754327 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca08c97d-8b4b-4c63-9eb7-558f5adc034f tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:29.755040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca08c97d-8b4b-4c63-9eb7-558f5adc034f tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:29.755670 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca08c97d-8b4b-4c63-9eb7-558f5adc034f tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:29.782879 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-ca08c97d-8b4b-4c63-9eb7-558f5adc034f tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] HTTP exception thrown: Instance c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc could not be found. Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ca08c97d-8b4b-4c63-9eb7-558f5adc034f tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Request method failure captured: Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc HTTP/1.1 Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJWc53h7hM9oU9WEEj1IEccQgR6h1ZXcmRg9Ysvo3vT7XN5rQV-c9ztTirjn-gqgcSh9Qr66wROJ6Jr8oSp1eJxAz4oQfx9CYhxJrf1fEvbPHGHUNJFwOa8qFEkUECOjJ4-hgdsKNy6XDim2xU34-IDyYPKeehx2z5xc68iUjCjH_0s Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 10f820fbde72429db671d15337913fd4 Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ImagesOneServerTestJSON-2059384949 Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/10f820fbde72429db671d15337913fd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/10f820fbde72429db671d15337913fd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_10f820fbde72429db671d15337913fd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/10f820fbde72429db671d15337913fd4"}]}] Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ImagesOneServerTestJSON-2059384949 Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 10f820fbde72429db671d15337913fd4 Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2059384949 Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ImagesOneServerTestJSON-2059384949-project Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 71c3218be14842e1b1fd2e5c10c9092a Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ImagesOneServerTestJSON-2059384949-project Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc could not be found. Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc'} Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc could not be found. Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc could not be found. Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:29.785029 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:29.788272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:29.788272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:29.788272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:29.788272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:29.788272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:29.788272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc could not be found. Oct 29 02:55:29.788272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:29.788272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ca08c97d-8b4b-4c63-9eb7-558f5adc034f tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] Returning 404 to user: Instance c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:29.788272 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ca08c97d-8b4b-4c63-9eb7-558f5adc034f tempest-ImagesOneServerTestJSON-2059384949 tempest-ImagesOneServerTestJSON-2059384949-project] 10.222.0.46 "GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc" status: 404 len: 111 microversion: 2.1 time: 0.052828 Oct 29 02:55:29.788272 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1115/2026] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:29 2022] GET /compute/v2.1/servers/c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:55:29.795779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-64d49558-9e1b-4f41-b036-8d9f00218c4e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '.version_select at 0x7ff05c2275e0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:29.991853 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:30.062807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG neutronclient.v2_0.client [None req-64d49558-9e1b-4f41-b036-8d9f00218c4e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 58dbda33-dfee-4dbc-b17e-75a83fc45200 in use.", "detail": ""}} {{(pid=127124) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:55:30.063840 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-64d49558-9e1b-4f41-b036-8d9f00218c4e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] HTTP exception thrown: Security Group 58dbda33-dfee-4dbc-b17e-75a83fc45200 in use. Oct 29 02:55:30.063840 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-af04844b-3f78-468e-9331-bf0ab4a06a6d'] Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-64d49558-9e1b-4f41-b036-8d9f00218c4e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Request method failure captured: Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/os-security-groups/58dbda33-dfee-4dbc-b17e-75a83fc45200 HTTP/1.1 Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJWyvWNGvIUONB2dldB7pPioEBwKHjHetza4K1fLTtjT_TQMaaZr4Sn7Ypy_ZhXjAwE7ry_UKafzclnlLHflyUJDtnmpn--08xUkjJ2-Rign0-fn1TZL2Hdqa5rKCy6QAStHGO-9e-pn1Lh_D4FvZ1sBFzju6OJDLJ_prG4_rU83xk8 Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/49721a0af93a47d38613f4a588ab1e1a"}]}] Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 971f709818b74757947beafd14f546bf Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: exception: Security Group 58dbda33-dfee-4dbc-b17e-75a83fc45200 in use. Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-af04844b-3f78-468e-9331-bf0ab4a06a6d'] Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '58dbda33-dfee-4dbc-b17e-75a83fc45200'} Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:55:30.065741 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 58dbda33-dfee-4dbc-b17e-75a83fc45200 in use. Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af04844b-3f78-468e-9331-bf0ab4a06a6d'] Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 58dbda33-dfee-4dbc-b17e-75a83fc45200 in use. Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af04844b-3f78-468e-9331-bf0ab4a06a6d'] Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 58dbda33-dfee-4dbc-b17e-75a83fc45200 in use. Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af04844b-3f78-468e-9331-bf0ab4a06a6d'] Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 58dbda33-dfee-4dbc-b17e-75a83fc45200 in use. Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af04844b-3f78-468e-9331-bf0ab4a06a6d'] Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-64d49558-9e1b-4f41-b036-8d9f00218c4e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Returning 400 to user: Security Group 58dbda33-dfee-4dbc-b17e-75a83fc45200 in use. Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-af04844b-3f78-468e-9331-bf0ab4a06a6d'] {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-64d49558-9e1b-4f41-b036-8d9f00218c4e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/58dbda33-dfee-4dbc-b17e-75a83fc45200" status: 400 len: 185 microversion: 2.1 time: 0.278613 Oct 29 02:55:30.070454 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1116/2027] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:55:29 2022] DELETE /compute/v2.1/os-security-groups/58dbda33-dfee-4dbc-b17e-75a83fc45200 => generated 185 bytes in 280 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:55:30.082397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-10a10731-bdc3-4a98-bb2b-3caac00bf156 req-05cff50e-0941-4fad-90e9-af5a50c15fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1", "tag": "46f29793-230c-41a4-90a3-6f7ef9ed7a47"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:30.117327 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-10a10731-bdc3-4a98-bb2b-3caac00bf156 req-05cff50e-0941-4fad-90e9-af5a50c15fc1 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:30.117889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-10a10731-bdc3-4a98-bb2b-3caac00bf156 req-05cff50e-0941-4fad-90e9-af5a50c15fc1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:30.118723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-10a10731-bdc3-4a98-bb2b-3caac00bf156 req-05cff50e-0941-4fad-90e9-af5a50c15fc1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:30.138417 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-10a10731-bdc3-4a98-bb2b-3caac00bf156 req-05cff50e-0941-4fad-90e9-af5a50c15fc1 service nova] Creating event network-changed:46f29793-230c-41a4-90a3-6f7ef9ed7a47 for instance 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 on n-h1-862967-2 Oct 29 02:55:30.148827 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-10a10731-bdc3-4a98-bb2b-3caac00bf156 req-05cff50e-0941-4fad-90e9-af5a50c15fc1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076839 Oct 29 02:55:30.150223 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1117/2028] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:30.158151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e25f3dc8-d9cc-4926-9d1f-00a229ee98c6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:30.159145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e25f3dc8-d9cc-4926-9d1f-00a229ee98c6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:30.170677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e25f3dc8-d9cc-4926-9d1f-00a229ee98c6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:30.172764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e25f3dc8-d9cc-4926-9d1f-00a229ee98c6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:30.173433 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e25f3dc8-d9cc-4926-9d1f-00a229ee98c6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:30.175967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e25f3dc8-d9cc-4926-9d1f-00a229ee98c6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:30.178588 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e25f3dc8-d9cc-4926-9d1f-00a229ee98c6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:30.179128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e25f3dc8-d9cc-4926-9d1f-00a229ee98c6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:30.641118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e25f3dc8-d9cc-4926-9d1f-00a229ee98c6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:30.656193 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e25f3dc8-d9cc-4926-9d1f-00a229ee98c6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878" status: 200 len: 1311 microversion: 2.1 time: 0.502230 Oct 29 02:55:30.658184 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1118/2029] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:30 2022] GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 => generated 1311 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:30.669460 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9d00f63d-cda2-49df-9241-b55cdf545fe7 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1053205952", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "37dbb670-b313-49b9-9e1c-5fd28348b24e"}], "security_groups": [{"name": "tempest-securitygroup--1962342363"}], "key_name": "tempest-keypair-1280533601", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:30.684358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:30.803172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-9d00f63d-cda2-49df-9241-b55cdf545fe7 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] validate_networks() for [('37dbb670-b313-49b9-9e1c-5fd28348b24e', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:55:31.167807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-4af24e78-082b-463f-b735-819f2fbc1b2c tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] [instance: 4463e53e-8eb7-45b7-ac0b-05204c79896a] Building network info cache for instance {{(pid=127125) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 02:55:31.768840 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-9d00f63d-cda2-49df-9241-b55cdf545fe7 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Getting quotas for project bb6b7f93767742aa9d35d45caf8945d3. Resources: dict_keys(['metadata_items']) {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:55:31.780872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-9d00f63d-cda2-49df-9241-b55cdf545fe7 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Getting quotas for user b368aa7acf3b419c8310c20f93fbe55a and project bb6b7f93767742aa9d35d45caf8945d3. Resources: dict_keys(['metadata_items']) {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:55:31.828671 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-9d00f63d-cda2-49df-9241-b55cdf545fe7 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:55:31.829366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-9d00f63d-cda2-49df-9241-b55cdf545fe7 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:55:31.830025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-9d00f63d-cda2-49df-9241-b55cdf545fe7 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:55:31.830635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-9d00f63d-cda2-49df-9241-b55cdf545fe7 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:55:31.831218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-9d00f63d-cda2-49df-9241-b55cdf545fe7 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:55:31.855764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d00f63d-cda2-49df-9241-b55cdf545fe7 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:31.856952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d00f63d-cda2-49df-9241-b55cdf545fe7 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:31.857612 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d00f63d-cda2-49df-9241-b55cdf545fe7 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:31.858601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d00f63d-cda2-49df-9241-b55cdf545fe7 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:31.859418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d00f63d-cda2-49df-9241-b55cdf545fe7 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:31.860027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d00f63d-cda2-49df-9241-b55cdf545fe7 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:31.893911 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-9d00f63d-cda2-49df-9241-b55cdf545fe7 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Getting quotas for project bb6b7f93767742aa9d35d45caf8945d3. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:55:31.901876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-9d00f63d-cda2-49df-9241-b55cdf545fe7 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Getting quotas for user b368aa7acf3b419c8310c20f93fbe55a and project bb6b7f93767742aa9d35d45caf8945d3. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:55:31.918319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9d00f63d-cda2-49df-9241-b55cdf545fe7 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:55:31.921675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9d00f63d-cda2-49df-9241-b55cdf545fe7 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] [instance: aaa6d06b-b045-4be8-b37f-907221813df9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:55:32.021459 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9d00f63d-cda2-49df-9241-b55cdf545fe7 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.361943 Oct 29 02:55:32.032464 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1119/2030] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:55:30 2022] POST /compute/v2.1/servers => generated 407 bytes in 1373 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:55:32.491230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cec8ebad-a3c1-42dc-b3b0-bcbb2cd31e3d tempest-ListImagesTestJSON-652368122 tempest-ListImagesTestJSON-652368122-project] Calling method '.version_select at 0x7ff05c13ddc0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:32.559117 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cec8ebad-a3c1-42dc-b3b0-bcbb2cd31e3d tempest-ListImagesTestJSON-652368122 tempest-ListImagesTestJSON-652368122-project] 10.222.0.46 "GET /compute/v2.1/images/cd315600-df67-41c1-95d3-95a5145fc39a" status: 200 len: 784 microversion: 2.1 time: 0.521700 Oct 29 02:55:32.567876 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1120/2031] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:32 2022] GET /compute/v2.1/images/cd315600-df67-41c1-95d3-95a5145fc39a => generated 784 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:32.597766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8b1eba85-44a3-4a2c-8ee6-2153cbaa6bb3 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:32.603209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8b1eba85-44a3-4a2c-8ee6-2153cbaa6bb3 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] [instance: 6b16dc02-4eb1-41dc-abd3-47ad38c265df] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:32.627015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b1eba85-44a3-4a2c-8ee6-2153cbaa6bb3 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:32.629748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b1eba85-44a3-4a2c-8ee6-2153cbaa6bb3 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:32.630815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b1eba85-44a3-4a2c-8ee6-2153cbaa6bb3 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:32.633028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b1eba85-44a3-4a2c-8ee6-2153cbaa6bb3 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:32.634003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b1eba85-44a3-4a2c-8ee6-2153cbaa6bb3 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:32.635492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b1eba85-44a3-4a2c-8ee6-2153cbaa6bb3 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:32.929007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8b1eba85-44a3-4a2c-8ee6-2153cbaa6bb3 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4d2e4223be40a7b76d6f0fa3920b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4447208645ac446686b659cbcf434d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:32.943139 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8b1eba85-44a3-4a2c-8ee6-2153cbaa6bb3 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] 10.222.0.46 "GET /compute/v2.1/servers/6b16dc02-4eb1-41dc-abd3-47ad38c265df" status: 200 len: 1283 microversion: 2.1 time: 0.372375 Oct 29 02:55:32.949294 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1121/2032] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:32 2022] GET /compute/v2.1/servers/6b16dc02-4eb1-41dc-abd3-47ad38c265df => generated 1283 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:32.969161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-339ade8c-fbb0-4421-8f32-278459fbf6ba tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:32.978569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-339ade8c-fbb0-4421-8f32-278459fbf6ba tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:32.988441 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-339ade8c-fbb0-4421-8f32-278459fbf6ba tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:32.989070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-339ade8c-fbb0-4421-8f32-278459fbf6ba tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:32.989611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-339ade8c-fbb0-4421-8f32-278459fbf6ba tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:32.992296 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-339ade8c-fbb0-4421-8f32-278459fbf6ba tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:32.993945 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-339ade8c-fbb0-4421-8f32-278459fbf6ba tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:32.994681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-339ade8c-fbb0-4421-8f32-278459fbf6ba tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:33.148779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:33.199473 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-339ade8c-fbb0-4421-8f32-278459fbf6ba tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "POST /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1/action" status: 202 len: 0 microversion: 2.1 time: 0.248439 Oct 29 02:55:33.201573 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1122/2033] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:55:32 2022] POST /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:55:33.214472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-3e57e197-8fe4-44ba-b9a8-ef0d3ddd4c11 req-60b7967a-d99e-4b5e-b938-c02454324137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc", "name": "network-vif-deleted", "tag": "79864797-817a-49a1-9e41-46b8d629427a"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:33.232147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3e57e197-8fe4-44ba-b9a8-ef0d3ddd4c11 req-60b7967a-d99e-4b5e-b938-c02454324137 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:33.232894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3e57e197-8fe4-44ba-b9a8-ef0d3ddd4c11 req-60b7967a-d99e-4b5e-b938-c02454324137 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:33.233441 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3e57e197-8fe4-44ba-b9a8-ef0d3ddd4c11 req-60b7967a-d99e-4b5e-b938-c02454324137 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:33.251577 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-3e57e197-8fe4-44ba-b9a8-ef0d3ddd4c11 req-60b7967a-d99e-4b5e-b938-c02454324137 service nova] Creating event network-vif-deleted:79864797-817a-49a1-9e41-46b8d629427a for instance c87e8f7f-f51a-4f5b-ab6f-96dc0c9f64cc on n-h2-862967-2 Oct 29 02:55:33.267945 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-3e57e197-8fe4-44ba-b9a8-ef0d3ddd4c11 req-60b7967a-d99e-4b5e-b938-c02454324137 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064551 Oct 29 02:55:33.269227 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1123/2034] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:33.274535 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-70010f5e-50d4-4430-a6ab-c9661453698c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:33.275754 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-70010f5e-50d4-4430-a6ab-c9661453698c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:33.285642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70010f5e-50d4-4430-a6ab-c9661453698c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:33.286404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70010f5e-50d4-4430-a6ab-c9661453698c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:33.287064 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70010f5e-50d4-4430-a6ab-c9661453698c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:33.288035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70010f5e-50d4-4430-a6ab-c9661453698c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:33.293590 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70010f5e-50d4-4430-a6ab-c9661453698c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:33.294372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70010f5e-50d4-4430-a6ab-c9661453698c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:33.707870 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-4af24e78-082b-463f-b735-819f2fbc1b2c tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] [instance: 4463e53e-8eb7-45b7-ac0b-05204c79896a] Updating instance_info_cache with network_info: [{"id": "b7adebcb-9cb0-4755-83b6-d418a864b6a2", "address": "fa:16:3e:7c:74:47", "network": {"id": "17f9d1fa-d455-4aad-a38d-7102e34b2edd", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-795356436-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3102dffa1e6843c6b5caa93b81a2fbfd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb7adebcb-9c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127125) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 02:55:33.726477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4af24e78-082b-463f-b735-819f2fbc1b2c tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Releasing lock "refresh_cache-4463e53e-8eb7-45b7-ac0b-05204c79896a" {{(pid=127125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 02:55:33.729934 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4af24e78-082b-463f-b735-819f2fbc1b2c tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] 10.222.0.46 "POST /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a/action" status: 202 len: 0 microversion: 2.1 time: 6.782634 Oct 29 02:55:33.732177 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 912/2035] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:55:26 2022] POST /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a/action => generated 0 bytes in 6785 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 02:55:33.746452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3df0350d-dfdf-4ca6-bc96-df5e3f786c42 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:33.747084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3df0350d-dfdf-4ca6-bc96-df5e3f786c42 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] [instance: aaa6d06b-b045-4be8-b37f-907221813df9] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:33.761362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:33.763162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3df0350d-dfdf-4ca6-bc96-df5e3f786c42 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:33.763881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3df0350d-dfdf-4ca6-bc96-df5e3f786c42 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:33.764689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3df0350d-dfdf-4ca6-bc96-df5e3f786c42 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:33.765707 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3df0350d-dfdf-4ca6-bc96-df5e3f786c42 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:33.766332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3df0350d-dfdf-4ca6-bc96-df5e3f786c42 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:33.766942 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3df0350d-dfdf-4ca6-bc96-df5e3f786c42 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:33.905733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-70010f5e-50d4-4430-a6ab-c9661453698c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:33.916054 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-70010f5e-50d4-4430-a6ab-c9661453698c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878" status: 200 len: 1494 microversion: 2.1 time: 0.645710 Oct 29 02:55:33.916989 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1124/2036] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:33 2022] GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 => generated 1494 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:33.950962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-90717d31-c363-44ff-9a3f-356afc80604c tempest-ListImagesTestJSON-652368122 tempest-ListImagesTestJSON-652368122-project] Calling method '.version_select at 0x7ff05c0fbc10>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:34.124046 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-90717d31-c363-44ff-9a3f-356afc80604c tempest-ListImagesTestJSON-652368122 tempest-ListImagesTestJSON-652368122-project] 10.222.0.46 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.184233 Oct 29 02:55:34.127326 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1125/2037] 10.222.0.46 () {58 vars in 1122 bytes} [Sat Oct 29 02:55:33 2022] GET /compute/v2.1/images => generated 445 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:34.336290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-85941e22-a082-42ee-8e83-1cafb9ba1d53 tempest-ListImageFiltersNegativeTestJSON-1462797003 tempest-ListImageFiltersNegativeTestJSON-1462797003-project] Calling method '.version_select at 0x7ff05c0b8a60>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:34.353209 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3df0350d-dfdf-4ca6-bc96-df5e3f786c42 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b368aa7acf3b419c8310c20f93fbe55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6b7f93767742aa9d35d45caf8945d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:34.378450 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3df0350d-dfdf-4ca6-bc96-df5e3f786c42 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] 10.222.0.46 "GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9" status: 200 len: 1322 microversion: 2.1 time: 0.644547 Oct 29 02:55:34.380159 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 913/2038] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:33 2022] GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9 => generated 1322 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:34.386330 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bb10eeb5-c14b-417e-8642-20d7dedc3bae tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:34.386940 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bb10eeb5-c14b-417e-8642-20d7dedc3bae tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:34.395654 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-85941e22-a082-42ee-8e83-1cafb9ba1d53 tempest-ListImageFiltersNegativeTestJSON-1462797003 tempest-ListImageFiltersNegativeTestJSON-1462797003-project] HTTP exception thrown: Image not found. Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-85941e22-a082-42ee-8e83-1cafb9ba1d53 tempest-ListImageFiltersNegativeTestJSON-1462797003 tempest-ListImageFiltersNegativeTestJSON-1462797003-project] Request method failure captured: Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/images/5ae5ca75-410b-40db-ab1b-11ae02389fb2 HTTP/1.1 Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJYkRT8AyqVSibf42TbaUOfqSm9QpMjmHkFx10qnPUt4DXOQnT-aT2TGCATIQLA8avwjEa3u6FFEGA7likYqNd7afs_zYY6zjEomxn5SwDicDGN2aaTP0dgwNexo8D9HH-J17Y9xyhIquGhnT0O2e8Io47I0t83acBbIyBcfLa9Q29g Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: d35347fbb9484a6aabd7097730487ac4 Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1462797003 Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d35347fbb9484a6aabd7097730487ac4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d35347fbb9484a6aabd7097730487ac4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d35347fbb9484a6aabd7097730487ac4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d35347fbb9484a6aabd7097730487ac4"}]}] Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1462797003 Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: d35347fbb9484a6aabd7097730487ac4 Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1462797003 Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ListImageFiltersNegativeTestJSON-1462797003-project Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: dba02796fdf941e1a54c7841fb2a9e42 Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1462797003-project Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: exception: Image not found. Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '5ae5ca75-410b-40db-ab1b-11ae02389fb2'} Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5ae5ca75-410b-40db-ab1b-11ae02389fb2 Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 02:55:34.398564 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5ae5ca75-410b-40db-ab1b-11ae02389fb2 could not be found. Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-85941e22-a082-42ee-8e83-1cafb9ba1d53 tempest-ListImageFiltersNegativeTestJSON-1462797003 tempest-ListImageFiltersNegativeTestJSON-1462797003-project] Returning 404 to user: Image not found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-85941e22-a082-42ee-8e83-1cafb9ba1d53 tempest-ListImageFiltersNegativeTestJSON-1462797003 tempest-ListImageFiltersNegativeTestJSON-1462797003-project] 10.222.0.46 "GET /compute/v2.1/images/5ae5ca75-410b-40db-ab1b-11ae02389fb2" status: 404 len: 62 microversion: 2.1 time: 0.271625 Oct 29 02:55:34.402780 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1126/2039] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:34 2022] GET /compute/v2.1/images/5ae5ca75-410b-40db-ab1b-11ae02389fb2 => generated 62 bytes in 273 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:55:34.410656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb10eeb5-c14b-417e-8642-20d7dedc3bae tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:34.411152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb10eeb5-c14b-417e-8642-20d7dedc3bae tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:34.411582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb10eeb5-c14b-417e-8642-20d7dedc3bae tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:34.412289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb10eeb5-c14b-417e-8642-20d7dedc3bae tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:34.412794 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb10eeb5-c14b-417e-8642-20d7dedc3bae tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:34.413212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb10eeb5-c14b-417e-8642-20d7dedc3bae tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:34.418002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bf5727e3-d1c7-4541-998c-fd580d08c279 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Action: 'create', calling method: .version_select at 0x7ff05c0fbf70>, body: {"pool": "067f6498-08a7-4612-b1a7-402ac9c9abc8"} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:34.467894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:34.932559 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bb10eeb5-c14b-417e-8642-20d7dedc3bae tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971f709818b74757947beafd14f546bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49721a0af93a47d38613f4a588ab1e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:34.950901 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bb10eeb5-c14b-417e-8642-20d7dedc3bae tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1" status: 200 len: 1575 microversion: 2.1 time: 0.568899 Oct 29 02:55:34.959629 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 914/2040] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:34 2022] GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 => generated 1575 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:35.342454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2e282114-046f-492f-b147-4357cb419e34 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:35.343353 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2e282114-046f-492f-b147-4357cb419e34 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:35.352016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e282114-046f-492f-b147-4357cb419e34 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:35.352825 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e282114-046f-492f-b147-4357cb419e34 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:35.354143 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e282114-046f-492f-b147-4357cb419e34 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:35.355072 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e282114-046f-492f-b147-4357cb419e34 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:35.356138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e282114-046f-492f-b147-4357cb419e34 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:35.356742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e282114-046f-492f-b147-4357cb419e34 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:35.676986 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2e282114-046f-492f-b147-4357cb419e34 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878" status: 200 len: 1645 microversion: 2.1 time: 0.714762 Oct 29 02:55:35.679251 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 915/2041] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:34 2022] GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 => generated 1645 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:35.708063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6cdbfdd6-ccd8-4905-8bc1-086e2d7c5575 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:35.711651 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6cdbfdd6-ccd8-4905-8bc1-086e2d7c5575 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] [instance: 6b16dc02-4eb1-41dc-abd3-47ad38c265df] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:35.727905 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6cdbfdd6-ccd8-4905-8bc1-086e2d7c5575 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:35.728550 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6cdbfdd6-ccd8-4905-8bc1-086e2d7c5575 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:35.729241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6cdbfdd6-ccd8-4905-8bc1-086e2d7c5575 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:35.730191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6cdbfdd6-ccd8-4905-8bc1-086e2d7c5575 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:35.730863 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6cdbfdd6-ccd8-4905-8bc1-086e2d7c5575 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:35.731771 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6cdbfdd6-ccd8-4905-8bc1-086e2d7c5575 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:35.995430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6cdbfdd6-ccd8-4905-8bc1-086e2d7c5575 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4d2e4223be40a7b76d6f0fa3920b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4447208645ac446686b659cbcf434d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:36.004226 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6cdbfdd6-ccd8-4905-8bc1-086e2d7c5575 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] 10.222.0.46 "GET /compute/v2.1/servers/6b16dc02-4eb1-41dc-abd3-47ad38c265df" status: 200 len: 1325 microversion: 2.1 time: 0.323617 Oct 29 02:55:36.006358 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 916/2042] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:35 2022] GET /compute/v2.1/servers/6b16dc02-4eb1-41dc-abd3-47ad38c265df => generated 1325 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:36.012022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4a81ad4e-3ea8-4b5b-9cfb-893af1dd06b8 tempest-ListImagesTestJSON-652368122 tempest-ListImagesTestJSON-652368122-project] Calling method '.version_select at 0x7ff053660af0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:36.095909 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4a81ad4e-3ea8-4b5b-9cfb-893af1dd06b8 tempest-ListImagesTestJSON-652368122 tempest-ListImagesTestJSON-652368122-project] 10.222.0.46 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.088254 Oct 29 02:55:36.107453 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 917/2043] 10.222.0.46 () {58 vars in 1143 bytes} [Sat Oct 29 02:55:36 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:36.114575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-bde9d664-a01a-4b37-bd3a-8915a2aab73d req-b7f39d68-f552-4420-af72-02e36f8b0daa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4463e53e-8eb7-45b7-ac0b-05204c79896a", "tag": "b7adebcb-9cb0-4755-83b6-d418a864b6a2"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:36.496024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-bde9d664-a01a-4b37-bd3a-8915a2aab73d req-b7f39d68-f552-4420-af72-02e36f8b0daa service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:36.496552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-bde9d664-a01a-4b37-bd3a-8915a2aab73d req-b7f39d68-f552-4420-af72-02e36f8b0daa service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:36.497016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-bde9d664-a01a-4b37-bd3a-8915a2aab73d req-b7f39d68-f552-4420-af72-02e36f8b0daa service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:36.513441 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-bde9d664-a01a-4b37-bd3a-8915a2aab73d req-b7f39d68-f552-4420-af72-02e36f8b0daa service nova] Creating event network-changed:b7adebcb-9cb0-4755-83b6-d418a864b6a2 for instance 4463e53e-8eb7-45b7-ac0b-05204c79896a on n-h2-862967-2 Oct 29 02:55:36.521924 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-bde9d664-a01a-4b37-bd3a-8915a2aab73d req-b7f39d68-f552-4420-af72-02e36f8b0daa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.409083 Oct 29 02:55:36.521924 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 918/2044] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:36.529328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bb119df2-ebd2-4bd4-8bac-2c1a52644601 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:36.530300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bb119df2-ebd2-4bd4-8bac-2c1a52644601 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] [instance: aaa6d06b-b045-4be8-b37f-907221813df9] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:36.537746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb119df2-ebd2-4bd4-8bac-2c1a52644601 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:36.538237 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb119df2-ebd2-4bd4-8bac-2c1a52644601 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:36.538669 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb119df2-ebd2-4bd4-8bac-2c1a52644601 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:36.539377 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb119df2-ebd2-4bd4-8bac-2c1a52644601 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:36.540574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb119df2-ebd2-4bd4-8bac-2c1a52644601 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:36.541032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb119df2-ebd2-4bd4-8bac-2c1a52644601 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:36.985864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bb119df2-ebd2-4bd4-8bac-2c1a52644601 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b368aa7acf3b419c8310c20f93fbe55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6b7f93767742aa9d35d45caf8945d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:37.002326 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bb119df2-ebd2-4bd4-8bac-2c1a52644601 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] 10.222.0.46 "GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9" status: 200 len: 1396 microversion: 2.1 time: 0.480871 Oct 29 02:55:37.002949 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 919/2045] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:36 2022] GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9 => generated 1396 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:37.019398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-d6b72a92-1dce-4550-b9c9-545edf5f8952 req-23b94478-7272-4fa9-8682-2ddec92c04dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b16dc02-4eb1-41dc-abd3-47ad38c265df", "tag": "7d83c076-915d-4a78-9a66-a2e6e5332bb5"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:37.045308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d6b72a92-1dce-4550-b9c9-545edf5f8952 req-23b94478-7272-4fa9-8682-2ddec92c04dd service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:37.045972 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d6b72a92-1dce-4550-b9c9-545edf5f8952 req-23b94478-7272-4fa9-8682-2ddec92c04dd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:37.046416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d6b72a92-1dce-4550-b9c9-545edf5f8952 req-23b94478-7272-4fa9-8682-2ddec92c04dd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:37.071588 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-d6b72a92-1dce-4550-b9c9-545edf5f8952 req-23b94478-7272-4fa9-8682-2ddec92c04dd service nova] Creating event network-changed:7d83c076-915d-4a78-9a66-a2e6e5332bb5 for instance 6b16dc02-4eb1-41dc-abd3-47ad38c265df on n-h1-862967-2 Oct 29 02:55:37.092835 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-d6b72a92-1dce-4550-b9c9-545edf5f8952 req-23b94478-7272-4fa9-8682-2ddec92c04dd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077589 Oct 29 02:55:37.093800 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 920/2046] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:37.101690 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7af6b5dc-64c5-41ca-bc24-f4af3a20bba5 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:37.102405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7af6b5dc-64c5-41ca-bc24-f4af3a20bba5 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:37.113935 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7af6b5dc-64c5-41ca-bc24-f4af3a20bba5 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:37.115093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7af6b5dc-64c5-41ca-bc24-f4af3a20bba5 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:37.115680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7af6b5dc-64c5-41ca-bc24-f4af3a20bba5 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:37.116671 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7af6b5dc-64c5-41ca-bc24-f4af3a20bba5 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:37.117277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7af6b5dc-64c5-41ca-bc24-f4af3a20bba5 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:37.117742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7af6b5dc-64c5-41ca-bc24-f4af3a20bba5 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:37.620746 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bf5727e3-d1c7-4541-998c-fd580d08c279 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.218496 Oct 29 02:55:37.621643 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1127/2047] 10.222.0.46 () {60 vars in 1170 bytes} [Sat Oct 29 02:55:34 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:37.629421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bc4c406d-a879-4dad-8aea-47e48a376484 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:37.629640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bc4c406d-a879-4dad-8aea-47e48a376484 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:37.637527 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc4c406d-a879-4dad-8aea-47e48a376484 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:37.638113 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc4c406d-a879-4dad-8aea-47e48a376484 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:37.638607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc4c406d-a879-4dad-8aea-47e48a376484 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:37.639625 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc4c406d-a879-4dad-8aea-47e48a376484 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:37.640083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc4c406d-a879-4dad-8aea-47e48a376484 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:37.641311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc4c406d-a879-4dad-8aea-47e48a376484 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:37.808505 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7af6b5dc-64c5-41ca-bc24-f4af3a20bba5 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878" status: 200 len: 1645 microversion: 2.1 time: 0.713316 Oct 29 02:55:37.809559 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 921/2048] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:37 2022] GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 => generated 1645 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:37.814683 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0aea861e-9f18-4c1b-a069-d0e50033a298 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:37.816394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0aea861e-9f18-4c1b-a069-d0e50033a298 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] [instance: 6b16dc02-4eb1-41dc-abd3-47ad38c265df] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:37.822954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0aea861e-9f18-4c1b-a069-d0e50033a298 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:37.823970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0aea861e-9f18-4c1b-a069-d0e50033a298 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:37.824728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0aea861e-9f18-4c1b-a069-d0e50033a298 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:37.825647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0aea861e-9f18-4c1b-a069-d0e50033a298 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:37.827073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0aea861e-9f18-4c1b-a069-d0e50033a298 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:37.827717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0aea861e-9f18-4c1b-a069-d0e50033a298 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:37.925906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bc4c406d-a879-4dad-8aea-47e48a376484 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971f709818b74757947beafd14f546bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49721a0af93a47d38613f4a588ab1e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:37.936489 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bc4c406d-a879-4dad-8aea-47e48a376484 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1" status: 200 len: 1573 microversion: 2.1 time: 0.313278 Oct 29 02:55:37.937489 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1128/2049] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:37 2022] GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 => generated 1573 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:38.097334 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0aea861e-9f18-4c1b-a069-d0e50033a298 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4d2e4223be40a7b76d6f0fa3920b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4447208645ac446686b659cbcf434d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:38.126826 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0aea861e-9f18-4c1b-a069-d0e50033a298 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] 10.222.0.46 "GET /compute/v2.1/servers/6b16dc02-4eb1-41dc-abd3-47ad38c265df" status: 200 len: 1325 microversion: 2.1 time: 0.311278 Oct 29 02:55:38.127563 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 922/2050] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:37 2022] GET /compute/v2.1/servers/6b16dc02-4eb1-41dc-abd3-47ad38c265df => generated 1325 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:38.133733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8bd18d9c-a48a-43fb-ac35-66c4c3130ea3 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.32"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:38.142100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8bd18d9c-a48a-43fb-ac35-66c4c3130ea3 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] [instance: 4463e53e-8eb7-45b7-ac0b-05204c79896a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:38.144512 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b8b454bc-c93f-4143-8c1e-19aeb481ce1c tempest-MultipleCreateNegativeTestJSON-1128617669 tempest-MultipleCreateNegativeTestJSON-1128617669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1156124631", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:38.148427 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-b8b454bc-c93f-4143-8c1e-19aeb481ce1c tempest-MultipleCreateNegativeTestJSON-1128617669 tempest-MultipleCreateNegativeTestJSON-1128617669-project] HTTP exception thrown: min_count must be <= max_count Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b8b454bc-c93f-4143-8c1e-19aeb481ce1c tempest-MultipleCreateNegativeTestJSON-1128617669 tempest-MultipleCreateNegativeTestJSON-1128617669-project] Request method failure captured: Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 184 Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJYpOdp1AWAnrXdPdxftkP8dcn6TQbNyCNra1TThmbaHm-Jqz0nWbCC2NpTauLCIWgfBm1K4HBEP8tMyDMOnMf5LtHcjEVNfbxz8wCQIyWIECbHp5Vlk42HhiB-eTbTUmTM_rDes0ilD27mae5CFwNMAe9NQSDyHatDM5g3Du2rfMTg Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: bdae81cf6c874a60a8f8d314299e507b Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1128617669 Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bdae81cf6c874a60a8f8d314299e507b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bdae81cf6c874a60a8f8d314299e507b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bdae81cf6c874a60a8f8d314299e507b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bdae81cf6c874a60a8f8d314299e507b"}]}] Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1128617669 Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: bdae81cf6c874a60a8f8d314299e507b Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1128617669 Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-MultipleCreateNegativeTestJSON-1128617669-project Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: ddfab02e1c7646c0a3004398e891827d Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1128617669-project Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1156124631", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: exception: min_count must be <= max_count Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1156124631', 'imageRef': 'cd315600-df67-41c1-95d3-95a5145fc39a', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 29 02:55:38.150163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:38.153774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b8b454bc-c93f-4143-8c1e-19aeb481ce1c tempest-MultipleCreateNegativeTestJSON-1128617669 tempest-MultipleCreateNegativeTestJSON-1128617669-project] Returning 400 to user: min_count must be <= max_count {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:38.154093 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b8b454bc-c93f-4143-8c1e-19aeb481ce1c tempest-MultipleCreateNegativeTestJSON-1128617669 tempest-MultipleCreateNegativeTestJSON-1128617669-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.215235 Oct 29 02:55:38.155758 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8bd18d9c-a48a-43fb-ac35-66c4c3130ea3 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:38.160208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8bd18d9c-a48a-43fb-ac35-66c4c3130ea3 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:38.160985 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8bd18d9c-a48a-43fb-ac35-66c4c3130ea3 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:38.161920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8bd18d9c-a48a-43fb-ac35-66c4c3130ea3 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:38.162532 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8bd18d9c-a48a-43fb-ac35-66c4c3130ea3 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:38.163108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8bd18d9c-a48a-43fb-ac35-66c4c3130ea3 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:38.168206 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1129/2051] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:55:37 2022] POST /compute/v2.1/servers => generated 74 bytes in 228 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 02:55:38.186478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4ecef8ad-cfb6-410c-908a-3fded6de8729 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:38.194672 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ecef8ad-cfb6-410c-908a-3fded6de8729 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:38.198585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ecef8ad-cfb6-410c-908a-3fded6de8729 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:38.200325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ecef8ad-cfb6-410c-908a-3fded6de8729 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:38.202311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ecef8ad-cfb6-410c-908a-3fded6de8729 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:38.204140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ecef8ad-cfb6-410c-908a-3fded6de8729 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:38.204727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ecef8ad-cfb6-410c-908a-3fded6de8729 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:38.222617 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8bd18d9c-a48a-43fb-ac35-66c4c3130ea3 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "refresh_cache-4463e53e-8eb7-45b7-ac0b-05204c79896a" {{(pid=127125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 02:55:38.223368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8bd18d9c-a48a-43fb-ac35-66c4c3130ea3 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquired lock "refresh_cache-4463e53e-8eb7-45b7-ac0b-05204c79896a" {{(pid=127125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 02:55:38.249824 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4ecef8ad-cfb6-410c-908a-3fded6de8729 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.080309 Oct 29 02:55:38.250923 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1130/2052] 10.222.0.46 () {58 vars in 1176 bytes} [Sat Oct 29 02:55:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:38.256694 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-af1ed5d5-1b48-4362-bfc2-c228468a2a5c tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1524257309"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:38.257625 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-af1ed5d5-1b48-4362-bfc2-c228468a2a5c tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:38.266315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af1ed5d5-1b48-4362-bfc2-c228468a2a5c tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:38.267028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af1ed5d5-1b48-4362-bfc2-c228468a2a5c tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:38.267602 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af1ed5d5-1b48-4362-bfc2-c228468a2a5c tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:38.268630 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af1ed5d5-1b48-4362-bfc2-c228468a2a5c tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:38.269254 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af1ed5d5-1b48-4362-bfc2-c228468a2a5c tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:38.269820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af1ed5d5-1b48-4362-bfc2-c228468a2a5c tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:38.504692 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.network.security_group_api [None req-af1ed5d5-1b48-4362-bfc2-c228468a2a5c tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Adding security group b783c247-b37d-4004-bba7-453855f631fb to port 46f29793-230c-41a4-90a3-6f7ef9ed7a47 Oct 29 02:55:38.905899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG neutronclient.v2_0.client [None req-8bd18d9c-a48a-43fb-ac35-66c4c3130ea3 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.7.32 (c1d71fa7-8e42-4cbf-a3cf-03240a55f133) with port b7adebcb-9cb0-4755-83b6-d418a864b6a2 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 067f6498-08a7-4612-b1a7-402ac9c9abc8.", "detail": ""}} {{(pid=127125) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:55:38.906575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8bd18d9c-a48a-43fb-ac35-66c4c3130ea3 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Releasing lock "refresh_cache-4463e53e-8eb7-45b7-ac0b-05204c79896a" {{(pid=127125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 02:55:38.907209 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-8bd18d9c-a48a-43fb-ac35-66c4c3130ea3 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] HTTP exception thrown: Cannot associate floating IP 172.25.7.32 (c1d71fa7-8e42-4cbf-a3cf-03240a55f133) with port b7adebcb-9cb0-4755-83b6-d418a864b6a2 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 067f6498-08a7-4612-b1a7-402ac9c9abc8. Oct 29 02:55:38.907209 n-d-862967-2 devstack@n-api.service[127125]: Neutron server returns request_ids: ['req-bb73d4fd-1104-4a6e-bb9f-d795d4ed3d7f'] Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8bd18d9c-a48a-43fb-ac35-66c4c3130ea3 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Request method failure captured: Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a/action HTTP/1.1 Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 45 Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJX-JPs7IBQE92m7LM-EAhPQzBv6EQktxfFR7-_GnzBSnbrxmJP1X6vP0Pu3aKSzjMWkGQ9g4qS5R5NYauOEA4JJU6pNuqmtZxmYIJJtDUqq7kOTgE6FCmQ0meyZSeMhXTkdEi-l0Uju1ppboetFYyal8hknr4aWb8_aquLW9thCRd4 Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 3102dffa1e6843c6b5caa93b81a2fbfd Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-429327322 Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3102dffa1e6843c6b5caa93b81a2fbfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3102dffa1e6843c6b5caa93b81a2fbfd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3102dffa1e6843c6b5caa93b81a2fbfd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3102dffa1e6843c6b5caa93b81a2fbfd"}]}] Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-429327322 Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 3102dffa1e6843c6b5caa93b81a2fbfd Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-429327322 Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: fb6300e24201407ba4c09cb25d247b2d Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: {"addFloatingIp": {"address": "172.25.7.32"}} Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: exception: Cannot associate floating IP 172.25.7.32 (c1d71fa7-8e42-4cbf-a3cf-03240a55f133) with port b7adebcb-9cb0-4755-83b6-d418a864b6a2 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 067f6498-08a7-4612-b1a7-402ac9c9abc8. Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: Neutron server returns request_ids: ['req-bb73d4fd-1104-4a6e-bb9f-d795d4ed3d7f'] Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '4463e53e-8eb7-45b7-ac0b-05204c79896a', 'body': {'addFloatingIp': {'address': '172.25.7.32'}}} Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:55:38.912358 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.7.32 (c1d71fa7-8e42-4cbf-a3cf-03240a55f133) with port b7adebcb-9cb0-4755-83b6-d418a864b6a2 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 067f6498-08a7-4612-b1a7-402ac9c9abc8. Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb73d4fd-1104-4a6e-bb9f-d795d4ed3d7f'] Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.7.32 (c1d71fa7-8e42-4cbf-a3cf-03240a55f133) with port b7adebcb-9cb0-4755-83b6-d418a864b6a2 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 067f6498-08a7-4612-b1a7-402ac9c9abc8. Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb73d4fd-1104-4a6e-bb9f-d795d4ed3d7f'] Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.7.32 (c1d71fa7-8e42-4cbf-a3cf-03240a55f133) with port b7adebcb-9cb0-4755-83b6-d418a864b6a2 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 067f6498-08a7-4612-b1a7-402ac9c9abc8. Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb73d4fd-1104-4a6e-bb9f-d795d4ed3d7f'] Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.7.32 (c1d71fa7-8e42-4cbf-a3cf-03240a55f133) with port b7adebcb-9cb0-4755-83b6-d418a864b6a2 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 067f6498-08a7-4612-b1a7-402ac9c9abc8. Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb73d4fd-1104-4a6e-bb9f-d795d4ed3d7f'] Oct 29 02:55:38.916131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:38.919081 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8bd18d9c-a48a-43fb-ac35-66c4c3130ea3 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Returning 400 to user: Cannot associate floating IP 172.25.7.32 (c1d71fa7-8e42-4cbf-a3cf-03240a55f133) with port b7adebcb-9cb0-4755-83b6-d418a864b6a2 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network 067f6498-08a7-4612-b1a7-402ac9c9abc8. Oct 29 02:55:38.919081 n-d-862967-2 devstack@n-api.service[127125]: Neutron server returns request_ids: ['req-bb73d4fd-1104-4a6e-bb9f-d795d4ed3d7f'] {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:38.919081 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8bd18d9c-a48a-43fb-ac35-66c4c3130ea3 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] 10.222.0.46 "POST /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a/action" status: 400 len: 381 microversion: 2.1 time: 0.781649 Oct 29 02:55:38.919081 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 923/2053] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:55:38 2022] POST /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a/action => generated 381 bytes in 783 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:55:38.931738 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-11401d65-7483-4ff7-ad99-086464faff2c tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:38.932365 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-11401d65-7483-4ff7-ad99-086464faff2c tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] [instance: aaa6d06b-b045-4be8-b37f-907221813df9] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:38.938938 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11401d65-7483-4ff7-ad99-086464faff2c tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:38.939428 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11401d65-7483-4ff7-ad99-086464faff2c tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:38.939862 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11401d65-7483-4ff7-ad99-086464faff2c tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:38.940783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11401d65-7483-4ff7-ad99-086464faff2c tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:38.941234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11401d65-7483-4ff7-ad99-086464faff2c tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:38.941651 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11401d65-7483-4ff7-ad99-086464faff2c tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:39.012942 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-af1ed5d5-1b48-4362-bfc2-c228468a2a5c tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "POST /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1/action" status: 202 len: 0 microversion: 2.1 time: 0.760664 Oct 29 02:55:39.014234 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1131/2054] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:55:38 2022] POST /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1/action => generated 0 bytes in 763 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:55:39.019887 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7dd8e242-cecb-486b-941a-8f1320c9ac02 tempest-MultipleCreateNegativeTestJSON-1128617669 tempest-MultipleCreateNegativeTestJSON-1128617669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2003326710", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "max_count": 0}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7dd8e242-cecb-486b-941a-8f1320c9ac02 tempest-MultipleCreateNegativeTestJSON-1128617669 tempest-MultipleCreateNegativeTestJSON-1128617669-project] Request method failure captured: Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 168 Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJYpOdp1AWAnrXdPdxftkP8dcn6TQbNyCNra1TThmbaHm-Jqz0nWbCC2NpTauLCIWgfBm1K4HBEP8tMyDMOnMf5LtHcjEVNfbxz8wCQIyWIECbHp5Vlk42HhiB-eTbTUmTM_rDes0ilD27mae5CFwNMAe9NQSDyHatDM5g3Du2rfMTg Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: bdae81cf6c874a60a8f8d314299e507b Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1128617669 Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bdae81cf6c874a60a8f8d314299e507b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bdae81cf6c874a60a8f8d314299e507b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bdae81cf6c874a60a8f8d314299e507b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bdae81cf6c874a60a8f8d314299e507b"}]}] Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1128617669 Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: bdae81cf6c874a60a8f8d314299e507b Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1128617669 Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-MultipleCreateNegativeTestJSON-1128617669-project Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: ddfab02e1c7646c0a3004398e891827d Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1128617669-project Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2003326710", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "max_count": 0}} Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2003326710', 'imageRef': 'cd315600-df67-41c1-95d3-95a5145fc39a', 'flavorRef': '452', 'max_count': 0}}} Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 0 Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:55:39.026720 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:55:39.030059 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:55:39.030059 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:55:39.030059 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:55:39.030059 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:55:39.030059 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 29 02:55:39.030059 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:39.030059 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:39.030059 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:39.030059 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:39.030059 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:39.030059 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:39.030059 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:55:39.030059 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:55:39.030059 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 29 02:55:39.030059 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:39.040497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7dd8e242-cecb-486b-941a-8f1320c9ac02 tempest-MultipleCreateNegativeTestJSON-1128617669 tempest-MultipleCreateNegativeTestJSON-1128617669-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:39.041604 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7dd8e242-cecb-486b-941a-8f1320c9ac02 tempest-MultipleCreateNegativeTestJSON-1128617669 tempest-MultipleCreateNegativeTestJSON-1128617669-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.026197 Oct 29 02:55:39.042321 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1132/2055] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:55:39 2022] POST /compute/v2.1/servers => generated 130 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:55:39.048225 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e0b6923d-1481-4f3a-8876-7dcb426d7946 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862967-2", "block_migration": true, "disk_over_commit": false}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:39.054802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e0b6923d-1481-4f3a-8876-7dcb426d7946 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:39.090209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e0b6923d-1481-4f3a-8876-7dcb426d7946 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:39.090695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e0b6923d-1481-4f3a-8876-7dcb426d7946 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:39.096161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e0b6923d-1481-4f3a-8876-7dcb426d7946 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:39.097086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e0b6923d-1481-4f3a-8876-7dcb426d7946 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:39.097564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e0b6923d-1481-4f3a-8876-7dcb426d7946 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:39.097997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e0b6923d-1481-4f3a-8876-7dcb426d7946 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:39.179537 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-11401d65-7483-4ff7-ad99-086464faff2c tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b368aa7acf3b419c8310c20f93fbe55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6b7f93767742aa9d35d45caf8945d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:39.197113 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-11401d65-7483-4ff7-ad99-086464faff2c tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] 10.222.0.46 "GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9" status: 200 len: 1396 microversion: 2.1 time: 0.281245 Oct 29 02:55:39.198438 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 924/2056] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:38 2022] GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9 => generated 1396 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:39.206291 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-e0b6923d-1481-4f3a-8876-7dcb426d7946 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lazy-loading 'flavor' on Instance uuid 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:55:39.217659 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-d8f24122-965e-4470-b0c1-5c969a33f88c req-4fbf5611-4526-4dcf-bc65-63711c02215b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa6d06b-b045-4be8-b37f-907221813df9", "tag": "4c26750e-9b47-44f7-88f7-e2358512c498"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:39.219947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e0b6923d-1481-4f3a-8876-7dcb426d7946 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Going to try to live migrate instance to n-h2-862967-2 {{(pid=127124) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 02:55:39.241765 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d8f24122-965e-4470-b0c1-5c969a33f88c req-4fbf5611-4526-4dcf-bc65-63711c02215b service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:39.241765 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d8f24122-965e-4470-b0c1-5c969a33f88c req-4fbf5611-4526-4dcf-bc65-63711c02215b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:39.241765 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d8f24122-965e-4470-b0c1-5c969a33f88c req-4fbf5611-4526-4dcf-bc65-63711c02215b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:39.252637 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-d8f24122-965e-4470-b0c1-5c969a33f88c req-4fbf5611-4526-4dcf-bc65-63711c02215b service nova] Creating event network-changed:4c26750e-9b47-44f7-88f7-e2358512c498 for instance aaa6d06b-b045-4be8-b37f-907221813df9 on n-h2-862967-2 Oct 29 02:55:39.258194 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-d8f24122-965e-4470-b0c1-5c969a33f88c req-4fbf5611-4526-4dcf-bc65-63711c02215b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058073 Oct 29 02:55:39.259208 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 925/2057] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:39.267086 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a07f00f0-7523-4f63-9db5-f67d21c7eb55 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Calling method '.version_select at 0x7ff053660ca0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:40.076823 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a07f00f0-7523-4f63-9db5-f67d21c7eb55 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/c1d71fa7-8e42-4cbf-a3cf-03240a55f133" status: 202 len: 0 microversion: 2.1 time: 0.815614 Oct 29 02:55:40.077513 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 926/2058] 10.222.0.46 () {58 vars in 1263 bytes} [Sat Oct 29 02:55:39 2022] DELETE /compute/v2.1/os-floating-ips/c1d71fa7-8e42-4cbf-a3cf-03240a55f133 => generated 0 bytes in 818 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:55:40.082952 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8bfbc9d0-74a8-4a10-a8d3-80af4b56ef4e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '.version_select at 0x7ff053860ca0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:40.222621 n-d-862967-2 devstack@n-api.service[127125]: DEBUG neutronclient.v2_0.client [None req-8bfbc9d0-74a8-4a10-a8d3-80af4b56ef4e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group b783c247-b37d-4004-bba7-453855f631fb in use.", "detail": ""}} {{(pid=127125) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:55:40.223324 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-8bfbc9d0-74a8-4a10-a8d3-80af4b56ef4e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] HTTP exception thrown: Security Group b783c247-b37d-4004-bba7-453855f631fb in use. Oct 29 02:55:40.223324 n-d-862967-2 devstack@n-api.service[127125]: Neutron server returns request_ids: ['req-3fb7cfe0-0b2f-47d4-9a00-24b24bdd7c71'] Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8bfbc9d0-74a8-4a10-a8d3-80af4b56ef4e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Request method failure captured: Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/os-security-groups/b783c247-b37d-4004-bba7-453855f631fb HTTP/1.1 Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJWyvWNGvIUONB2dldB7pPioEBwKHjHetza4K1fLTtjT_TQMaaZr4Sn7Ypy_ZhXjAwE7ry_UKafzclnlLHflyUJDtnmpn--08xUkjJ2-Rign0-fn1TZL2Hdqa5rKCy6QAStHGO-9e-pn1Lh_D4FvZ1sBFzju6OJDLJ_prG4_rU83xk8 Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/49721a0af93a47d38613f4a588ab1e1a"}]}] Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 971f709818b74757947beafd14f546bf Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: exception: Security Group b783c247-b37d-4004-bba7-453855f631fb in use. Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: Neutron server returns request_ids: ['req-3fb7cfe0-0b2f-47d4-9a00-24b24bdd7c71'] Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'b783c247-b37d-4004-bba7-453855f631fb'} Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:55:40.225392 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group b783c247-b37d-4004-bba7-453855f631fb in use. Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fb7cfe0-0b2f-47d4-9a00-24b24bdd7c71'] Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group b783c247-b37d-4004-bba7-453855f631fb in use. Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fb7cfe0-0b2f-47d4-9a00-24b24bdd7c71'] Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group b783c247-b37d-4004-bba7-453855f631fb in use. Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fb7cfe0-0b2f-47d4-9a00-24b24bdd7c71'] Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group b783c247-b37d-4004-bba7-453855f631fb in use. Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fb7cfe0-0b2f-47d4-9a00-24b24bdd7c71'] Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8bfbc9d0-74a8-4a10-a8d3-80af4b56ef4e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Returning 400 to user: Security Group b783c247-b37d-4004-bba7-453855f631fb in use. Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: Neutron server returns request_ids: ['req-3fb7cfe0-0b2f-47d4-9a00-24b24bdd7c71'] {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8bfbc9d0-74a8-4a10-a8d3-80af4b56ef4e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/b783c247-b37d-4004-bba7-453855f631fb" status: 400 len: 185 microversion: 2.1 time: 0.148079 Oct 29 02:55:40.229228 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 927/2059] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:55:40 2022] DELETE /compute/v2.1/os-security-groups/b783c247-b37d-4004-bba7-453855f631fb => generated 185 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:55:40.234899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-8a61bf85-eac9-44b6-b549-736cc5181caf req-5fa16ced-ebbb-4f26-96c3-6059ce028175 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1", "tag": "46f29793-230c-41a4-90a3-6f7ef9ed7a47"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:40.245100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8a61bf85-eac9-44b6-b549-736cc5181caf req-5fa16ced-ebbb-4f26-96c3-6059ce028175 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:40.245574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8a61bf85-eac9-44b6-b549-736cc5181caf req-5fa16ced-ebbb-4f26-96c3-6059ce028175 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:40.245999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8a61bf85-eac9-44b6-b549-736cc5181caf req-5fa16ced-ebbb-4f26-96c3-6059ce028175 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:40.256374 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-8a61bf85-eac9-44b6-b549-736cc5181caf req-5fa16ced-ebbb-4f26-96c3-6059ce028175 service nova] Creating event network-changed:46f29793-230c-41a4-90a3-6f7ef9ed7a47 for instance 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 on n-h1-862967-2 Oct 29 02:55:40.261610 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-8a61bf85-eac9-44b6-b549-736cc5181caf req-5fa16ced-ebbb-4f26-96c3-6059ce028175 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032727 Oct 29 02:55:40.262302 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 928/2060] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:40.270457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d8b7dd15-d68d-4538-9823-9c8633c7fdc4 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:40.271144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d8b7dd15-d68d-4538-9823-9c8633c7fdc4 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] [instance: 6b16dc02-4eb1-41dc-abd3-47ad38c265df] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:40.277293 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8b7dd15-d68d-4538-9823-9c8633c7fdc4 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:40.277771 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8b7dd15-d68d-4538-9823-9c8633c7fdc4 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:40.278205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8b7dd15-d68d-4538-9823-9c8633c7fdc4 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:40.278925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8b7dd15-d68d-4538-9823-9c8633c7fdc4 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:40.279399 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8b7dd15-d68d-4538-9823-9c8633c7fdc4 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:40.279836 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8b7dd15-d68d-4538-9823-9c8633c7fdc4 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:40.531418 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d8b7dd15-d68d-4538-9823-9c8633c7fdc4 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4d2e4223be40a7b76d6f0fa3920b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4447208645ac446686b659cbcf434d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:40.539948 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d8b7dd15-d68d-4538-9823-9c8633c7fdc4 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] 10.222.0.46 "GET /compute/v2.1/servers/6b16dc02-4eb1-41dc-abd3-47ad38c265df" status: 200 len: 1325 microversion: 2.1 time: 0.273582 Oct 29 02:55:40.540690 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 929/2061] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:40 2022] GET /compute/v2.1/servers/6b16dc02-4eb1-41dc-abd3-47ad38c265df => generated 1325 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:40.545777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cd695ec7-24c2-4b4c-a9a9-5e7035fd8c94 tempest-MultipleCreateNegativeTestJSON-1128617669 tempest-MultipleCreateNegativeTestJSON-1128617669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1571607207", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "max_count": 2.5}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cd695ec7-24c2-4b4c-a9a9-5e7035fd8c94 tempest-MultipleCreateNegativeTestJSON-1128617669 tempest-MultipleCreateNegativeTestJSON-1128617669-project] Request method failure captured: Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 170 Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJYpOdp1AWAnrXdPdxftkP8dcn6TQbNyCNra1TThmbaHm-Jqz0nWbCC2NpTauLCIWgfBm1K4HBEP8tMyDMOnMf5LtHcjEVNfbxz8wCQIyWIECbHp5Vlk42HhiB-eTbTUmTM_rDes0ilD27mae5CFwNMAe9NQSDyHatDM5g3Du2rfMTg Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: bdae81cf6c874a60a8f8d314299e507b Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1128617669 Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bdae81cf6c874a60a8f8d314299e507b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bdae81cf6c874a60a8f8d314299e507b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bdae81cf6c874a60a8f8d314299e507b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bdae81cf6c874a60a8f8d314299e507b"}]}] Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1128617669 Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: bdae81cf6c874a60a8f8d314299e507b Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1128617669 Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-MultipleCreateNegativeTestJSON-1128617669-project Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: ddfab02e1c7646c0a3004398e891827d Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1128617669-project Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1571607207", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "max_count": 2.5}} Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1571607207', 'imageRef': 'cd315600-df67-41c1-95d3-95a5145fc39a', 'flavorRef': '452', 'max_count': 2.5}}} Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 2.5 Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:55:40.551267 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:55:40.555468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:55:40.555468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:55:40.555468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:55:40.555468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:55:40.555468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 29 02:55:40.555468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:40.555468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:40.555468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:40.555468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:40.555468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:40.555468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:40.555468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:55:40.555468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:55:40.555468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 29 02:55:40.555468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:40.557594 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cd695ec7-24c2-4b4c-a9a9-5e7035fd8c94 tempest-MultipleCreateNegativeTestJSON-1128617669 tempest-MultipleCreateNegativeTestJSON-1128617669-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:40.558687 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cd695ec7-24c2-4b4c-a9a9-5e7035fd8c94 tempest-MultipleCreateNegativeTestJSON-1128617669 tempest-MultipleCreateNegativeTestJSON-1128617669-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.016840 Oct 29 02:55:40.559661 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 930/2062] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:55:40 2022] POST /compute/v2.1/servers => generated 139 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:55:40.639608 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3118b526-06cd-405d-b190-f503497472d0 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Action: 'create', calling method: .version_select at 0x7ff0536e4e50>, body: {"keypair": {"name": "tempest-keypair-1618610804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInCbh10WG+3m02aVRBMigqz/2UYtL3jFRmGLVbXW+MJkBIrGmAcF9UH/2m+d3MqmPs/BnNDu0/y7QcPVLpKNof4YmOC3fhk3dnRnini+wTl6qFt+4HQrgkfhcAfKBAs6g=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:40.662943 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-3118b526-06cd-405d-b190-f503497472d0 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Getting quotas for project 6e573e2c7bfb4427aa38e6710b5acdb6. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:55:40.669044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-3118b526-06cd-405d-b190-f503497472d0 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Getting quotas for user 8882e08b2b214b4b93d965feb91cd13b and project 6e573e2c7bfb4427aa38e6710b5acdb6. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:55:40.707217 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3118b526-06cd-405d-b190-f503497472d0 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.146139 Oct 29 02:55:40.708483 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 931/2063] 10.222.0.46 () {62 vars in 1199 bytes} [Sat Oct 29 02:55:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 148 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 29 02:55:40.715381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0a229bd0-bc00-4f4d-b330-f21a5e8644c8 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Action: 'action', calling method: .version_select at 0x7ff059b6cc10>, body: {"removeFloatingIp": {"address": "172.25.7.126"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:41.038302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0a229bd0-bc00-4f4d-b330-f21a5e8644c8 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] [instance: 4463e53e-8eb7-45b7-ac0b-05204c79896a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:41.045769 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a229bd0-bc00-4f4d-b330-f21a5e8644c8 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:41.046383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a229bd0-bc00-4f4d-b330-f21a5e8644c8 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:41.046982 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a229bd0-bc00-4f4d-b330-f21a5e8644c8 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:41.047811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a229bd0-bc00-4f4d-b330-f21a5e8644c8 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:41.048329 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a229bd0-bc00-4f4d-b330-f21a5e8644c8 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:41.048844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a229bd0-bc00-4f4d-b330-f21a5e8644c8 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:41.367922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a229bd0-bc00-4f4d-b330-f21a5e8644c8 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "refresh_cache-4463e53e-8eb7-45b7-ac0b-05204c79896a" {{(pid=127125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 02:55:41.368555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a229bd0-bc00-4f4d-b330-f21a5e8644c8 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquired lock "refresh_cache-4463e53e-8eb7-45b7-ac0b-05204c79896a" {{(pid=127125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 02:55:41.911731 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=16 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:41.962406 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e0b6923d-1481-4f3a-8876-7dcb426d7946 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878/action" status: 202 len: 0 microversion: 2.1 time: 2.918651 Oct 29 02:55:41.963287 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1133/2064] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:55:39 2022] POST /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878/action => generated 0 bytes in 2920 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:55:41.968111 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4903d8f6-1a0b-4bac-bd60-6d75bc3f4c8b tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:41.968750 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4903d8f6-1a0b-4bac-bd60-6d75bc3f4c8b tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] [instance: aaa6d06b-b045-4be8-b37f-907221813df9] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:41.975862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4903d8f6-1a0b-4bac-bd60-6d75bc3f4c8b tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:41.976348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4903d8f6-1a0b-4bac-bd60-6d75bc3f4c8b tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:41.976969 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4903d8f6-1a0b-4bac-bd60-6d75bc3f4c8b tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:41.977670 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4903d8f6-1a0b-4bac-bd60-6d75bc3f4c8b tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:41.978297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4903d8f6-1a0b-4bac-bd60-6d75bc3f4c8b tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:41.978886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4903d8f6-1a0b-4bac-bd60-6d75bc3f4c8b tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:42.139212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4903d8f6-1a0b-4bac-bd60-6d75bc3f4c8b tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b368aa7acf3b419c8310c20f93fbe55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6b7f93767742aa9d35d45caf8945d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:42.147257 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4903d8f6-1a0b-4bac-bd60-6d75bc3f4c8b tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] 10.222.0.46 "GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9" status: 200 len: 1396 microversion: 2.1 time: 0.182855 Oct 29 02:55:42.148060 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1134/2065] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:41 2022] GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9 => generated 1396 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:42.152619 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-afae766e-fe63-4bc1-8d75-2a13538a3b00 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:42.153114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-afae766e-fe63-4bc1-8d75-2a13538a3b00 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:42.159950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-afae766e-fe63-4bc1-8d75-2a13538a3b00 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:42.160445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-afae766e-fe63-4bc1-8d75-2a13538a3b00 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:42.160904 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-afae766e-fe63-4bc1-8d75-2a13538a3b00 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:42.161800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-afae766e-fe63-4bc1-8d75-2a13538a3b00 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:42.162252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-afae766e-fe63-4bc1-8d75-2a13538a3b00 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:42.162828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-afae766e-fe63-4bc1-8d75-2a13538a3b00 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:42.191086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-afae766e-fe63-4bc1-8d75-2a13538a3b00 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:55:42.277824 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-afae766e-fe63-4bc1-8d75-2a13538a3b00 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "DELETE /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1" status: 204 len: 0 microversion: 2.1 time: 0.128228 Oct 29 02:55:42.278920 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1135/2066] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:55:42 2022] DELETE /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:55:42.285758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3c3a87b5-2279-44ec-a14b-b615536984de tempest-MultipleCreateNegativeTestJSON-1128617669 tempest-MultipleCreateNegativeTestJSON-1128617669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-976580992", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "min_count": 0}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3c3a87b5-2279-44ec-a14b-b615536984de tempest-MultipleCreateNegativeTestJSON-1128617669 tempest-MultipleCreateNegativeTestJSON-1128617669-project] Request method failure captured: Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 167 Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJYpOdp1AWAnrXdPdxftkP8dcn6TQbNyCNra1TThmbaHm-Jqz0nWbCC2NpTauLCIWgfBm1K4HBEP8tMyDMOnMf5LtHcjEVNfbxz8wCQIyWIECbHp5Vlk42HhiB-eTbTUmTM_rDes0ilD27mae5CFwNMAe9NQSDyHatDM5g3Du2rfMTg Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: bdae81cf6c874a60a8f8d314299e507b Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1128617669 Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bdae81cf6c874a60a8f8d314299e507b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bdae81cf6c874a60a8f8d314299e507b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bdae81cf6c874a60a8f8d314299e507b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bdae81cf6c874a60a8f8d314299e507b"}]}] Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1128617669 Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: bdae81cf6c874a60a8f8d314299e507b Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1128617669 Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-MultipleCreateNegativeTestJSON-1128617669-project Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: ddfab02e1c7646c0a3004398e891827d Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1128617669-project Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-976580992", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "min_count": 0}} Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-976580992', 'imageRef': 'cd315600-df67-41c1-95d3-95a5145fc39a', 'flavorRef': '452', 'min_count': 0}}} Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 0 Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:55:42.290603 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:55:42.294799 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:55:42.294799 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:55:42.294799 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:55:42.294799 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:55:42.294799 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 29 02:55:42.294799 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:42.294799 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:42.294799 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:42.294799 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:42.294799 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:42.294799 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:42.294799 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:55:42.294799 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:55:42.294799 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 29 02:55:42.294799 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:42.294799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3c3a87b5-2279-44ec-a14b-b615536984de tempest-MultipleCreateNegativeTestJSON-1128617669 tempest-MultipleCreateNegativeTestJSON-1128617669-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:42.294799 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3c3a87b5-2279-44ec-a14b-b615536984de tempest-MultipleCreateNegativeTestJSON-1128617669 tempest-MultipleCreateNegativeTestJSON-1128617669-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.011658 Oct 29 02:55:42.294799 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1136/2067] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:55:42 2022] POST /compute/v2.1/servers => generated 130 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:55:42.300560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a2ff1148-3775-4058-8743-988af3d2f6be tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Calling method '.version_select at 0x7ff05c2300d0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:42.310326 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a2ff1148-3775-4058-8743-988af3d2f6be tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs/tempest-keypair-1618610804" status: 200 len: 513 microversion: 2.2 time: 0.016801 Oct 29 02:55:42.311317 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1137/2068] 10.222.0.46 () {60 vars in 1258 bytes} [Sat Oct 29 02:55:42 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1618610804 => generated 513 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:42.316791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4a3f3809-d3d9-41de-a40a-9c09d9e70f63 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:42.317694 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4a3f3809-d3d9-41de-a40a-9c09d9e70f63 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] [instance: 6b16dc02-4eb1-41dc-abd3-47ad38c265df] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:42.323912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a3f3809-d3d9-41de-a40a-9c09d9e70f63 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:42.324737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a3f3809-d3d9-41de-a40a-9c09d9e70f63 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:42.325170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a3f3809-d3d9-41de-a40a-9c09d9e70f63 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:42.325979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a3f3809-d3d9-41de-a40a-9c09d9e70f63 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:42.326772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a3f3809-d3d9-41de-a40a-9c09d9e70f63 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:42.327218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a3f3809-d3d9-41de-a40a-9c09d9e70f63 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:42.471942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4a3f3809-d3d9-41de-a40a-9c09d9e70f63 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4d2e4223be40a7b76d6f0fa3920b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4447208645ac446686b659cbcf434d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:42.479616 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4a3f3809-d3d9-41de-a40a-9c09d9e70f63 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] 10.222.0.46 "GET /compute/v2.1/servers/6b16dc02-4eb1-41dc-abd3-47ad38c265df" status: 200 len: 1325 microversion: 2.1 time: 0.166427 Oct 29 02:55:42.480565 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1138/2069] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:42 2022] GET /compute/v2.1/servers/6b16dc02-4eb1-41dc-abd3-47ad38c265df => generated 1325 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:42.489414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-381727b5-79b4-4c94-8b56-54f52adb4221 req-5e3264b2-c1a9-4bba-a4ad-55625ae8252e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b16dc02-4eb1-41dc-abd3-47ad38c265df", "name": "network-vif-plugged", "status": "completed", "tag": "7d83c076-915d-4a78-9a66-a2e6e5332bb5"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:42.499912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-381727b5-79b4-4c94-8b56-54f52adb4221 req-5e3264b2-c1a9-4bba-a4ad-55625ae8252e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:42.500488 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-381727b5-79b4-4c94-8b56-54f52adb4221 req-5e3264b2-c1a9-4bba-a4ad-55625ae8252e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:42.501088 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-381727b5-79b4-4c94-8b56-54f52adb4221 req-5e3264b2-c1a9-4bba-a4ad-55625ae8252e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:42.514054 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-381727b5-79b4-4c94-8b56-54f52adb4221 req-5e3264b2-c1a9-4bba-a4ad-55625ae8252e service nova] Creating event network-vif-plugged:7d83c076-915d-4a78-9a66-a2e6e5332bb5 for instance 6b16dc02-4eb1-41dc-abd3-47ad38c265df on n-h1-862967-2 Oct 29 02:55:42.520019 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-381727b5-79b4-4c94-8b56-54f52adb4221 req-5e3264b2-c1a9-4bba-a4ad-55625ae8252e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038183 Oct 29 02:55:42.520657 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1139/2070] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:42.525681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dfeb2576-a55b-4c1a-93e8-6bfe8fcefbd5 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:42.526372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dfeb2576-a55b-4c1a-93e8-6bfe8fcefbd5 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:42.532820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfeb2576-a55b-4c1a-93e8-6bfe8fcefbd5 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:42.533296 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfeb2576-a55b-4c1a-93e8-6bfe8fcefbd5 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:42.533910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfeb2576-a55b-4c1a-93e8-6bfe8fcefbd5 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:42.535395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfeb2576-a55b-4c1a-93e8-6bfe8fcefbd5 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:42.535395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfeb2576-a55b-4c1a-93e8-6bfe8fcefbd5 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:42.535867 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfeb2576-a55b-4c1a-93e8-6bfe8fcefbd5 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:42.654955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-0a229bd0-bc00-4f4d-b330-f21a5e8644c8 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] [instance: 4463e53e-8eb7-45b7-ac0b-05204c79896a] Building network info cache for instance {{(pid=127125) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 02:55:42.723973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dfeb2576-a55b-4c1a-93e8-6bfe8fcefbd5 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:42.732285 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dfeb2576-a55b-4c1a-93e8-6bfe8fcefbd5 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878" status: 200 len: 1504 microversion: 2.1 time: 0.210458 Oct 29 02:55:42.733028 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1140/2071] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:42 2022] GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 => generated 1504 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:42.751467 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a2c3bd35-db3b-4a7b-92a4-5907cfc805d7 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:42.752359 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a2c3bd35-db3b-4a7b-92a4-5907cfc805d7 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:42.760306 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2c3bd35-db3b-4a7b-92a4-5907cfc805d7 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:42.761475 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2c3bd35-db3b-4a7b-92a4-5907cfc805d7 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:42.762333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2c3bd35-db3b-4a7b-92a4-5907cfc805d7 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:42.763247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2c3bd35-db3b-4a7b-92a4-5907cfc805d7 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:42.764041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2c3bd35-db3b-4a7b-92a4-5907cfc805d7 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:42.764501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2c3bd35-db3b-4a7b-92a4-5907cfc805d7 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:42.942211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a2c3bd35-db3b-4a7b-92a4-5907cfc805d7 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971f709818b74757947beafd14f546bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49721a0af93a47d38613f4a588ab1e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:42.954022 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a2c3bd35-db3b-4a7b-92a4-5907cfc805d7 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1" status: 200 len: 1648 microversion: 2.1 time: 0.219258 Oct 29 02:55:42.956457 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1141/2072] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:42 2022] GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 => generated 1648 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:42.974124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-140104a9-28fb-41aa-9501-2c11db9b9c71 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Calling method '.version_select at 0x7ff05c1a9040>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:43.005995 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-140104a9-28fb-41aa-9501-2c11db9b9c71 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1618610804" status: 204 len: 0 microversion: 2.2 time: 0.047960 Oct 29 02:55:43.006882 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1142/2073] 10.222.0.46 () {60 vars in 1261 bytes} [Sat Oct 29 02:55:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1618610804 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:55:43.017509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4c917e3b-ec81-4bdc-a9d6-094773b2e5f1 tempest-MultipleCreateNegativeTestJSON-1128617669 tempest-MultipleCreateNegativeTestJSON-1128617669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2134242204", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "min_count": 2.5}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4c917e3b-ec81-4bdc-a9d6-094773b2e5f1 tempest-MultipleCreateNegativeTestJSON-1128617669 tempest-MultipleCreateNegativeTestJSON-1128617669-project] Request method failure captured: Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 170 Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJYpOdp1AWAnrXdPdxftkP8dcn6TQbNyCNra1TThmbaHm-Jqz0nWbCC2NpTauLCIWgfBm1K4HBEP8tMyDMOnMf5LtHcjEVNfbxz8wCQIyWIECbHp5Vlk42HhiB-eTbTUmTM_rDes0ilD27mae5CFwNMAe9NQSDyHatDM5g3Du2rfMTg Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: bdae81cf6c874a60a8f8d314299e507b Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1128617669 Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bdae81cf6c874a60a8f8d314299e507b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bdae81cf6c874a60a8f8d314299e507b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bdae81cf6c874a60a8f8d314299e507b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bdae81cf6c874a60a8f8d314299e507b"}]}] Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1128617669 Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: bdae81cf6c874a60a8f8d314299e507b Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1128617669 Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-MultipleCreateNegativeTestJSON-1128617669-project Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: ddfab02e1c7646c0a3004398e891827d Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1128617669-project Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2134242204", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "min_count": 2.5}} Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2134242204', 'imageRef': 'cd315600-df67-41c1-95d3-95a5145fc39a', 'flavorRef': '452', 'min_count': 2.5}}} Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 2.5 Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:55:43.022522 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:55:43.026182 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:55:43.026182 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:55:43.026182 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:55:43.026182 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:55:43.026182 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 29 02:55:43.026182 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:43.026182 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:43.026182 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:43.026182 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:43.026182 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:43.026182 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:43.026182 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:55:43.026182 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:55:43.026182 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 29 02:55:43.026182 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:43.029168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4c917e3b-ec81-4bdc-a9d6-094773b2e5f1 tempest-MultipleCreateNegativeTestJSON-1128617669 tempest-MultipleCreateNegativeTestJSON-1128617669-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:43.030189 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4c917e3b-ec81-4bdc-a9d6-094773b2e5f1 tempest-MultipleCreateNegativeTestJSON-1128617669 tempest-MultipleCreateNegativeTestJSON-1128617669-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.022026 Oct 29 02:55:43.031472 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1143/2074] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:55:43 2022] POST /compute/v2.1/servers => generated 139 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:55:43.041007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-c0a47ff5-218a-492d-9edd-9caac789a1eb req-c46ba628-7196-43a7-90d7-26e6e2463db7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4463e53e-8eb7-45b7-ac0b-05204c79896a", "tag": "b7adebcb-9cb0-4755-83b6-d418a864b6a2"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:43.055179 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c0a47ff5-218a-492d-9edd-9caac789a1eb req-c46ba628-7196-43a7-90d7-26e6e2463db7 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:43.056106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c0a47ff5-218a-492d-9edd-9caac789a1eb req-c46ba628-7196-43a7-90d7-26e6e2463db7 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:43.056752 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c0a47ff5-218a-492d-9edd-9caac789a1eb req-c46ba628-7196-43a7-90d7-26e6e2463db7 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:43.071968 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-c0a47ff5-218a-492d-9edd-9caac789a1eb req-c46ba628-7196-43a7-90d7-26e6e2463db7 service nova] Creating event network-changed:b7adebcb-9cb0-4755-83b6-d418a864b6a2 for instance 4463e53e-8eb7-45b7-ac0b-05204c79896a on n-h2-862967-2 Oct 29 02:55:43.082119 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-c0a47ff5-218a-492d-9edd-9caac789a1eb req-c46ba628-7196-43a7-90d7-26e6e2463db7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048509 Oct 29 02:55:43.084326 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1144/2075] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:43.097773 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dba27c70-7e1c-420a-89d0-a642ad3ae095 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Action: 'create', calling method: .version_select at 0x7ff05c1b13a0>, body: {"keypair": {"name": "tempest-keypair-1871127787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJX/a7TSaeld2AAiTqVIjSOSNbmlFd6grgGpEUiT1HZwA8xXhTgeWu/xTKq96FX9U2UD/ImjJuX1dOPhwmZBluLVrbP1w+uLE6Lw3KzvPWCxIK0iAkwAmuck85ZyUQrmHw=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:43.122693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-dba27c70-7e1c-420a-89d0-a642ad3ae095 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Getting quotas for project 6e573e2c7bfb4427aa38e6710b5acdb6. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:55:43.133211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-dba27c70-7e1c-420a-89d0-a642ad3ae095 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Getting quotas for user 8882e08b2b214b4b93d965feb91cd13b and project 6e573e2c7bfb4427aa38e6710b5acdb6. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:55:43.189379 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dba27c70-7e1c-420a-89d0-a642ad3ae095 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.102781 Oct 29 02:55:43.196544 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1145/2076] 10.222.0.46 () {62 vars in 1199 bytes} [Sat Oct 29 02:55:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 105 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 29 02:55:43.196544 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-85a03ffb-e1a6-4561-a79a-9e48ee3efa87 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:43.196687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-85a03ffb-e1a6-4561-a79a-9e48ee3efa87 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] [instance: aaa6d06b-b045-4be8-b37f-907221813df9] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:43.208246 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-85a03ffb-e1a6-4561-a79a-9e48ee3efa87 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:43.208994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-85a03ffb-e1a6-4561-a79a-9e48ee3efa87 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:43.209547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-85a03ffb-e1a6-4561-a79a-9e48ee3efa87 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:43.210340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-85a03ffb-e1a6-4561-a79a-9e48ee3efa87 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:43.210913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-85a03ffb-e1a6-4561-a79a-9e48ee3efa87 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:43.212293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-85a03ffb-e1a6-4561-a79a-9e48ee3efa87 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:43.462936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-85a03ffb-e1a6-4561-a79a-9e48ee3efa87 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b368aa7acf3b419c8310c20f93fbe55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6b7f93767742aa9d35d45caf8945d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:43.475241 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-85a03ffb-e1a6-4561-a79a-9e48ee3efa87 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] 10.222.0.46 "GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9" status: 200 len: 1396 microversion: 2.1 time: 0.283412 Oct 29 02:55:43.475906 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1146/2077] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:43 2022] GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9 => generated 1396 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:43.496959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-49d051bb-0215-41a6-82ae-7a92ce3e3536 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Calling method '.version_select at 0x7ff05c0b80d0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:43.526048 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-49d051bb-0215-41a6-82ae-7a92ce3e3536 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1871127787" status: 204 len: 0 microversion: 2.2 time: 0.033421 Oct 29 02:55:43.535478 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1147/2078] 10.222.0.46 () {60 vars in 1261 bytes} [Sat Oct 29 02:55:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1871127787 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:55:43.559027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-535393e9-cd3e-479d-8f35-413da432fbe9 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:43.560224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-535393e9-cd3e-479d-8f35-413da432fbe9 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] [instance: 6b16dc02-4eb1-41dc-abd3-47ad38c265df] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:43.574714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-535393e9-cd3e-479d-8f35-413da432fbe9 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:43.575909 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-535393e9-cd3e-479d-8f35-413da432fbe9 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:43.576845 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-535393e9-cd3e-479d-8f35-413da432fbe9 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:43.577706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-535393e9-cd3e-479d-8f35-413da432fbe9 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:43.578315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-535393e9-cd3e-479d-8f35-413da432fbe9 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:43.578825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-535393e9-cd3e-479d-8f35-413da432fbe9 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:43.585134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-0a229bd0-bc00-4f4d-b330-f21a5e8644c8 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] [instance: 4463e53e-8eb7-45b7-ac0b-05204c79896a] Updating instance_info_cache with network_info: [{"id": "b7adebcb-9cb0-4755-83b6-d418a864b6a2", "address": "fa:16:3e:7c:74:47", "network": {"id": "17f9d1fa-d455-4aad-a38d-7102e34b2edd", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-795356436-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3102dffa1e6843c6b5caa93b81a2fbfd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb7adebcb-9c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127125) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 02:55:43.619231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a229bd0-bc00-4f4d-b330-f21a5e8644c8 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Releasing lock "refresh_cache-4463e53e-8eb7-45b7-ac0b-05204c79896a" {{(pid=127125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 02:55:43.622579 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0a229bd0-bc00-4f4d-b330-f21a5e8644c8 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] 10.222.0.46 "POST /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a/action" status: 202 len: 0 microversion: 2.1 time: 2.911364 Oct 29 02:55:43.623453 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 932/2079] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:55:40 2022] POST /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a/action => generated 0 bytes in 2914 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 02:55:43.634754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0c5242de-dae3-4b9b-bf20-654cc875e0ce tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Action: 'create', calling method: .version_select at 0x7ff053731160>, body: {"keypair": {"name": "tempest-keypair-1360208135", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:43.678564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-0c5242de-dae3-4b9b-bf20-654cc875e0ce tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Getting quotas for project 6e573e2c7bfb4427aa38e6710b5acdb6. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:55:43.686716 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-0c5242de-dae3-4b9b-bf20-654cc875e0ce tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Getting quotas for user 8882e08b2b214b4b93d965feb91cd13b and project 6e573e2c7bfb4427aa38e6710b5acdb6. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:55:43.723356 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0c5242de-dae3-4b9b-bf20-654cc875e0ce tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.096904 Oct 29 02:55:43.724516 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 933/2080] 10.222.0.46 () {62 vars in 1199 bytes} [Sat Oct 29 02:55:43 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 100 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 29 02:55:43.736364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2fcfb2a6-627f-44eb-888e-b32de94c00ba tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Calling method '.version_select at 0x7ff053834b80>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:44.063000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-535393e9-cd3e-479d-8f35-413da432fbe9 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4d2e4223be40a7b76d6f0fa3920b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4447208645ac446686b659cbcf434d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:44.076512 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-535393e9-cd3e-479d-8f35-413da432fbe9 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] 10.222.0.46 "GET /compute/v2.1/servers/6b16dc02-4eb1-41dc-abd3-47ad38c265df" status: 200 len: 1325 microversion: 2.1 time: 0.538920 Oct 29 02:55:44.094558 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1148/2081] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:43 2022] GET /compute/v2.1/servers/6b16dc02-4eb1-41dc-abd3-47ad38c265df => generated 1325 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:44.094558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-af9c4c33-fa4d-4b24-a0d0-0c80e6a84369 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Calling method '.version_select at 0x7ff05c0b8820>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:44.115673 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-af9c4c33-fa4d-4b24-a0d0-0c80e6a84369 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1360208135" status: 204 len: 0 microversion: 2.2 time: 0.036182 Oct 29 02:55:44.116341 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1149/2082] 10.222.0.46 () {60 vars in 1261 bytes} [Sat Oct 29 02:55:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1360208135 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:55:44.133720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-96c445f9-7577-40e6-9ec7-7e39cb0d9d8a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:44.134651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-96c445f9-7577-40e6-9ec7-7e39cb0d9d8a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:44.144470 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-96c445f9-7577-40e6-9ec7-7e39cb0d9d8a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:44.145343 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-96c445f9-7577-40e6-9ec7-7e39cb0d9d8a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:44.146434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-96c445f9-7577-40e6-9ec7-7e39cb0d9d8a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:44.147518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-96c445f9-7577-40e6-9ec7-7e39cb0d9d8a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:44.147976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-96c445f9-7577-40e6-9ec7-7e39cb0d9d8a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:44.151180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-96c445f9-7577-40e6-9ec7-7e39cb0d9d8a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:44.158127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:44.764432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-96c445f9-7577-40e6-9ec7-7e39cb0d9d8a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:44.775514 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-96c445f9-7577-40e6-9ec7-7e39cb0d9d8a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878" status: 200 len: 1504 microversion: 2.1 time: 0.648767 Oct 29 02:55:44.776631 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1150/2083] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:44 2022] GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 => generated 1504 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:44.793026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-07204efd-0df0-4aaa-81b8-caac1f90d80c tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:44.793801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-07204efd-0df0-4aaa-81b8-caac1f90d80c tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:44.802492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07204efd-0df0-4aaa-81b8-caac1f90d80c tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:44.803025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07204efd-0df0-4aaa-81b8-caac1f90d80c tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:44.803606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07204efd-0df0-4aaa-81b8-caac1f90d80c tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:44.804490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07204efd-0df0-4aaa-81b8-caac1f90d80c tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:44.805228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07204efd-0df0-4aaa-81b8-caac1f90d80c tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:44.805653 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07204efd-0df0-4aaa-81b8-caac1f90d80c tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:45.023711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-07204efd-0df0-4aaa-81b8-caac1f90d80c tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971f709818b74757947beafd14f546bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49721a0af93a47d38613f4a588ab1e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:45.034388 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-07204efd-0df0-4aaa-81b8-caac1f90d80c tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1" status: 200 len: 1648 microversion: 2.1 time: 0.256346 Oct 29 02:55:45.034989 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1151/2084] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:44 2022] GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 => generated 1648 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:45.057214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8b2b1cd5-b88a-4663-aca9-d600495788cb tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Action: 'create', calling method: .version_select at 0x7ff05c1a95e0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-580661706", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0IeOwaQLGinp1+3y7l+cYjXCGoVWc8lm8ieAyVMc3W/9Ow6CG815+OX/+IqJwfWV5PDtuudF/ehfnOnVgEsmxgqex0vAOPupIspoXzLlI90UNfyg2fKkCaCNbWrKJjJw=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:45.064266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:45.082241 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-8b2b1cd5-b88a-4663-aca9-d600495788cb tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Getting quotas for project 6e573e2c7bfb4427aa38e6710b5acdb6. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:55:45.089989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-8b2b1cd5-b88a-4663-aca9-d600495788cb tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Getting quotas for user 8882e08b2b214b4b93d965feb91cd13b and project 6e573e2c7bfb4427aa38e6710b5acdb6. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:55:45.120939 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8b2b1cd5-b88a-4663-aca9-d600495788cb tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.084717 Oct 29 02:55:45.121923 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1152/2085] 10.222.0.46 () {62 vars in 1199 bytes} [Sat Oct 29 02:55:45 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 86 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 29 02:55:45.128370 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-91cbd9eb-d7f9-4a4d-bc22-5725317805a3 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:45.130088 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-91cbd9eb-d7f9-4a4d-bc22-5725317805a3 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] [instance: aaa6d06b-b045-4be8-b37f-907221813df9] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:45.141692 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91cbd9eb-d7f9-4a4d-bc22-5725317805a3 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:45.142630 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91cbd9eb-d7f9-4a4d-bc22-5725317805a3 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:45.143233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91cbd9eb-d7f9-4a4d-bc22-5725317805a3 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:45.144575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91cbd9eb-d7f9-4a4d-bc22-5725317805a3 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:45.145247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91cbd9eb-d7f9-4a4d-bc22-5725317805a3 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:45.145829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91cbd9eb-d7f9-4a4d-bc22-5725317805a3 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:45.339531 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-91cbd9eb-d7f9-4a4d-bc22-5725317805a3 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b368aa7acf3b419c8310c20f93fbe55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6b7f93767742aa9d35d45caf8945d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:45.353718 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-91cbd9eb-d7f9-4a4d-bc22-5725317805a3 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] 10.222.0.46 "GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9" status: 200 len: 1396 microversion: 2.1 time: 0.230029 Oct 29 02:55:45.373582 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1153/2086] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:45 2022] GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9 => generated 1396 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:45.379606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-3333b325-e82f-40f8-a30c-f54a35a9732e req-2a03dd47-9cd3-4baf-b318-e987c5625f36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa6d06b-b045-4be8-b37f-907221813df9", "name": "network-vif-plugged", "status": "completed", "tag": "4c26750e-9b47-44f7-88f7-e2358512c498"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:45.394979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3333b325-e82f-40f8-a30c-f54a35a9732e req-2a03dd47-9cd3-4baf-b318-e987c5625f36 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:45.395911 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3333b325-e82f-40f8-a30c-f54a35a9732e req-2a03dd47-9cd3-4baf-b318-e987c5625f36 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:45.397442 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3333b325-e82f-40f8-a30c-f54a35a9732e req-2a03dd47-9cd3-4baf-b318-e987c5625f36 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:45.418890 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-3333b325-e82f-40f8-a30c-f54a35a9732e req-2a03dd47-9cd3-4baf-b318-e987c5625f36 service nova] Creating event network-vif-plugged:4c26750e-9b47-44f7-88f7-e2358512c498 for instance aaa6d06b-b045-4be8-b37f-907221813df9 on n-h2-862967-2 Oct 29 02:55:45.428629 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-3333b325-e82f-40f8-a30c-f54a35a9732e req-2a03dd47-9cd3-4baf-b318-e987c5625f36 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053008 Oct 29 02:55:45.429879 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1154/2087] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:45.440092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-110cd2d1-a674-40c2-9a5b-2f54c0936d4a tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:45.448173 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-110cd2d1-a674-40c2-9a5b-2f54c0936d4a tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] [instance: 6b16dc02-4eb1-41dc-abd3-47ad38c265df] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:45.461474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-110cd2d1-a674-40c2-9a5b-2f54c0936d4a tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:45.461973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-110cd2d1-a674-40c2-9a5b-2f54c0936d4a tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:45.462461 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-110cd2d1-a674-40c2-9a5b-2f54c0936d4a tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:45.463934 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-110cd2d1-a674-40c2-9a5b-2f54c0936d4a tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:45.465133 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-110cd2d1-a674-40c2-9a5b-2f54c0936d4a tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:45.465776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-110cd2d1-a674-40c2-9a5b-2f54c0936d4a tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:45.641040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-110cd2d1-a674-40c2-9a5b-2f54c0936d4a tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4d2e4223be40a7b76d6f0fa3920b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4447208645ac446686b659cbcf434d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:45.651374 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-110cd2d1-a674-40c2-9a5b-2f54c0936d4a tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] 10.222.0.46 "GET /compute/v2.1/servers/6b16dc02-4eb1-41dc-abd3-47ad38c265df" status: 200 len: 1523 microversion: 2.1 time: 0.219776 Oct 29 02:55:45.652429 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1155/2088] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:45 2022] GET /compute/v2.1/servers/6b16dc02-4eb1-41dc-abd3-47ad38c265df => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:45.657259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-aa703ddc-7c00-4cd2-995e-5824c066be85 req-d33be21e-4d6c-4df0-96f9-268e7f07b28c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42ddcbfc-a37e-4d2f-8e07-c28bfcf40878", "name": "network-vif-unplugged", "status": "completed", "tag": "8c18d333-2ae5-4735-96e6-5b6ea458aef2"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:45.679368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-aa703ddc-7c00-4cd2-995e-5824c066be85 req-d33be21e-4d6c-4df0-96f9-268e7f07b28c service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:45.679860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-aa703ddc-7c00-4cd2-995e-5824c066be85 req-d33be21e-4d6c-4df0-96f9-268e7f07b28c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:45.680299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-aa703ddc-7c00-4cd2-995e-5824c066be85 req-d33be21e-4d6c-4df0-96f9-268e7f07b28c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:45.698521 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-aa703ddc-7c00-4cd2-995e-5824c066be85 req-d33be21e-4d6c-4df0-96f9-268e7f07b28c service nova] Creating event network-vif-unplugged:8c18d333-2ae5-4735-96e6-5b6ea458aef2 for instance 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 on n-h1-862967-2 Oct 29 02:55:45.705996 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-aa703ddc-7c00-4cd2-995e-5824c066be85 req-d33be21e-4d6c-4df0-96f9-268e7f07b28c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052301 Oct 29 02:55:45.707081 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1156/2089] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:45.713700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6b7ffe88-d4bb-4ba5-af90-a76e33b730c7 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Action: 'create', calling method: .version_select at 0x7ff05c1a9dc0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-635519055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTgS1y0FA3m8OXGx1yf0MEUf11aLBT+5OQ+GRHgpoiwzISpnBU0UVO+vGFO21KS+khc/eOzA2fg4gmeeYEaf3+dOAVYPdSFyukJHetCcW4GdQ0LXZLt1Dhe/sbY7eaQpQ=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:45.750583 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-6b7ffe88-d4bb-4ba5-af90-a76e33b730c7 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Getting quotas for project 6e573e2c7bfb4427aa38e6710b5acdb6. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:55:45.790752 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-6b7ffe88-d4bb-4ba5-af90-a76e33b730c7 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Getting quotas for user 8882e08b2b214b4b93d965feb91cd13b and project 6e573e2c7bfb4427aa38e6710b5acdb6. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:55:45.799933 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2fcfb2a6-627f-44eb-888e-b32de94c00ba tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/6fc198da-d18f-4cbf-9049-20be1029b626" status: 202 len: 0 microversion: 2.1 time: 2.066988 Oct 29 02:55:45.800688 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 934/2090] 10.222.0.46 () {58 vars in 1263 bytes} [Sat Oct 29 02:55:43 2022] DELETE /compute/v2.1/os-floating-ips/6fc198da-d18f-4cbf-9049-20be1029b626 => generated 0 bytes in 2075 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:55:45.820404 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-955e8b18-68b1-4ee6-9b77-249ff73ff74b tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:45.821059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-955e8b18-68b1-4ee6-9b77-249ff73ff74b tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] [instance: 6b16dc02-4eb1-41dc-abd3-47ad38c265df] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:45.840405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-955e8b18-68b1-4ee6-9b77-249ff73ff74b tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:45.843112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-955e8b18-68b1-4ee6-9b77-249ff73ff74b tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:45.843987 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-955e8b18-68b1-4ee6-9b77-249ff73ff74b tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:45.846254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-955e8b18-68b1-4ee6-9b77-249ff73ff74b tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:45.847212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-955e8b18-68b1-4ee6-9b77-249ff73ff74b tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:45.849640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-955e8b18-68b1-4ee6-9b77-249ff73ff74b tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:45.849943 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6b7ffe88-d4bb-4ba5-af90-a76e33b730c7 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.141439 Oct 29 02:55:45.850961 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1157/2091] 10.222.0.46 () {62 vars in 1199 bytes} [Sat Oct 29 02:55:45 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 143 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 29 02:55:45.866895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c06d00e2-088a-4c18-b22a-3585b71d5edf tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:45.873349 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c06d00e2-088a-4c18-b22a-3585b71d5edf tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:45.881647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c06d00e2-088a-4c18-b22a-3585b71d5edf tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:45.882082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c06d00e2-088a-4c18-b22a-3585b71d5edf tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:45.882518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c06d00e2-088a-4c18-b22a-3585b71d5edf tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:45.889092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c06d00e2-088a-4c18-b22a-3585b71d5edf tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:45.889680 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c06d00e2-088a-4c18-b22a-3585b71d5edf tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:45.892651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c06d00e2-088a-4c18-b22a-3585b71d5edf tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:45.944340 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-955e8b18-68b1-4ee6-9b77-249ff73ff74b tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] HTTP exception thrown: Action 999 not found Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-955e8b18-68b1-4ee6-9b77-249ff73ff74b tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Request method failure captured: Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/6b16dc02-4eb1-41dc-abd3-47ad38c265df/os-instance-actions/999 HTTP/1.1 Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJYefL0yhwm02aNIBfxk6dL7Y-j-zkZISf0cZoCX6_82EwDDRrKYU_rn6r5zSOfEdJw3K8_YWNFP1vbUEI4l1nCEI5Ie7ZCKZg7ggYQn_HR8db2ateYJlrIS7_EfFCUGaMrA1revY5SfmcQowxmq4nfddovNkW3rBGz8Mb1g78gWzII Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 4447208645ac446686b659cbcf434d71 Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-712933471 Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4447208645ac446686b659cbcf434d71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4447208645ac446686b659cbcf434d71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4447208645ac446686b659cbcf434d71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4447208645ac446686b659cbcf434d71"}]}] Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-712933471 Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 4447208645ac446686b659cbcf434d71 Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-712933471 Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-InstanceActionsNegativeTestJSON-712933471-project Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: ca4d2e4223be40a7b76d6f0fa3920b1c Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-712933471-project Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: exception: Action 999 not found Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'server_id': '6b16dc02-4eb1-41dc-abd3-47ad38c265df', 'id': '999'} Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 29 02:55:45.951313 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:45.955184 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-955e8b18-68b1-4ee6-9b77-249ff73ff74b tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Returning 404 to user: Action 999 not found {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:45.955184 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-955e8b18-68b1-4ee6-9b77-249ff73ff74b tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] 10.222.0.46 "GET /compute/v2.1/servers/6b16dc02-4eb1-41dc-abd3-47ad38c265df/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.151373 Oct 29 02:55:45.959486 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 935/2092] 10.222.0.46 () {58 vars in 1308 bytes} [Sat Oct 29 02:55:45 2022] GET /compute/v2.1/servers/6b16dc02-4eb1-41dc-abd3-47ad38c265df/os-instance-actions/999 => generated 66 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:55:45.965924 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3a92613d-3e4e-4a82-bce4-f3fdc68c4b60 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3a92613d-3e4e-4a82-bce4-f3fdc68c4b60 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Request method failure captured: Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a/action HTTP/1.1 Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 34 Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJX-JPs7IBQE92m7LM-EAhPQzBv6EQktxfFR7-_GnzBSnbrxmJP1X6vP0Pu3aKSzjMWkGQ9g4qS5R5NYauOEA4JJU6pNuqmtZxmYIJJtDUqq7kOTgE6FCmQ0meyZSeMhXTkdEi-l0Uju1ppboetFYyal8hknr4aWb8_aquLW9thCRd4 Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 3102dffa1e6843c6b5caa93b81a2fbfd Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-429327322 Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3102dffa1e6843c6b5caa93b81a2fbfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3102dffa1e6843c6b5caa93b81a2fbfd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3102dffa1e6843c6b5caa93b81a2fbfd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3102dffa1e6843c6b5caa93b81a2fbfd"}]}] Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-429327322 Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 3102dffa1e6843c6b5caa93b81a2fbfd Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-429327322 Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: fb6300e24201407ba4c09cb25d247b2d Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: {"addFloatingIp": {"address": ""}} Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '4463e53e-8eb7-45b7-ac0b-05204c79896a', 'body': {'addFloatingIp': {'address': ''}}} Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi '' Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:55:45.970805 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:55:45.974506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:55:45.974506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 29 02:55:45.974506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:45.974506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:45.974506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:45.974506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:45.974506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:45.974506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:45.974506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:55:45.974506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:55:45.974506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 29 02:55:45.974506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:45.976605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3a92613d-3e4e-4a82-bce4-f3fdc68c4b60 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:45.977840 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3a92613d-3e4e-4a82-bce4-f3fdc68c4b60 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] 10.222.0.46 "POST /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a/action" status: 400 len: 142 microversion: 2.1 time: 0.016603 Oct 29 02:55:45.978583 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 936/2093] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:55:45 2022] POST /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a/action => generated 142 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:55:45.987498 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cfa93b2c-24ac-4e48-8b6d-44a566a47740 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Action: 'create', calling method: .version_select at 0x7ff053731c10>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1868725622", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMoDvWWVw+PD3k9E2zvO4UKRaP1WxYpQgJvW5PytW71PyAvvcKSlE/6G04DcYeKmq/kiuNmZ2QFiQBxulOHFq0yDzhgHFD4iS3srelaHyBGtlUGvZgQE43bxzYFpfEuxg=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:46.006264 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-cfa93b2c-24ac-4e48-8b6d-44a566a47740 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Getting quotas for project 6e573e2c7bfb4427aa38e6710b5acdb6. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:55:46.012459 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-cfa93b2c-24ac-4e48-8b6d-44a566a47740 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Getting quotas for user 8882e08b2b214b4b93d965feb91cd13b and project 6e573e2c7bfb4427aa38e6710b5acdb6. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:55:46.041372 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cfa93b2c-24ac-4e48-8b6d-44a566a47740 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.060936 Oct 29 02:55:46.042352 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 937/2094] 10.222.0.46 () {62 vars in 1199 bytes} [Sat Oct 29 02:55:45 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 63 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 29 02:55:46.053452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7878f7d7-9535-4265-8ead-6445465f6182 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Calling method '.version_select at 0x7ff05385b4c0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:46.054174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7878f7d7-9535-4265-8ead-6445465f6182 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] [instance: 7c31156f-5faf-4325-b4b7-de6c0e76f55e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:46.062629 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-7878f7d7-9535-4265-8ead-6445465f6182 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] HTTP exception thrown: Instance 7c31156f-5faf-4325-b4b7-de6c0e76f55e could not be found. Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7878f7d7-9535-4265-8ead-6445465f6182 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Request method failure captured: Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/7c31156f-5faf-4325-b4b7-de6c0e76f55e/os-instance-actions HTTP/1.1 Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJYefL0yhwm02aNIBfxk6dL7Y-j-zkZISf0cZoCX6_82EwDDRrKYU_rn6r5zSOfEdJw3K8_YWNFP1vbUEI4l1nCEI5Ie7ZCKZg7ggYQn_HR8db2ateYJlrIS7_EfFCUGaMrA1revY5SfmcQowxmq4nfddovNkW3rBGz8Mb1g78gWzII Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 4447208645ac446686b659cbcf434d71 Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-712933471 Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4447208645ac446686b659cbcf434d71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4447208645ac446686b659cbcf434d71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4447208645ac446686b659cbcf434d71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4447208645ac446686b659cbcf434d71"}]}] Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-712933471 Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 4447208645ac446686b659cbcf434d71 Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-712933471 Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-InstanceActionsNegativeTestJSON-712933471-project Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: ca4d2e4223be40a7b76d6f0fa3920b1c Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-712933471-project Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 7c31156f-5faf-4325-b4b7-de6c0e76f55e could not be found. Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'server_id': '7c31156f-5faf-4325-b4b7-de6c0e76f55e'} Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c31156f-5faf-4325-b4b7-de6c0e76f55e could not be found. Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:55:46.067118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:55:46.071164 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c31156f-5faf-4325-b4b7-de6c0e76f55e could not be found. Oct 29 02:55:46.071164 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:46.071164 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:46.071164 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:46.071164 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:46.071164 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:46.071164 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:46.071164 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:46.071164 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:46.071164 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c31156f-5faf-4325-b4b7-de6c0e76f55e could not be found. Oct 29 02:55:46.071164 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:46.073481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7878f7d7-9535-4265-8ead-6445465f6182 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Returning 404 to user: Instance 7c31156f-5faf-4325-b4b7-de6c0e76f55e could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:46.074537 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7878f7d7-9535-4265-8ead-6445465f6182 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] 10.222.0.46 "GET /compute/v2.1/servers/7c31156f-5faf-4325-b4b7-de6c0e76f55e/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.031130 Oct 29 02:55:46.075563 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 938/2095] 10.222.0.46 () {58 vars in 1296 bytes} [Sat Oct 29 02:55:46 2022] GET /compute/v2.1/servers/7c31156f-5faf-4325-b4b7-de6c0e76f55e/os-instance-actions => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:55:46.081981 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7928c5f6-7442-4b29-a026-e17aa1a0ddcd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:46.084709 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7928c5f6-7442-4b29-a026-e17aa1a0ddcd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] [instance: 4463e53e-8eb7-45b7-ac0b-05204c79896a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:46.095551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7928c5f6-7442-4b29-a026-e17aa1a0ddcd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:46.096199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7928c5f6-7442-4b29-a026-e17aa1a0ddcd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:46.096696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7928c5f6-7442-4b29-a026-e17aa1a0ddcd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:46.098463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7928c5f6-7442-4b29-a026-e17aa1a0ddcd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:46.098936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7928c5f6-7442-4b29-a026-e17aa1a0ddcd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:46.099368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7928c5f6-7442-4b29-a026-e17aa1a0ddcd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:46.133083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c06d00e2-088a-4c18-b22a-3585b71d5edf tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:46.139636 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7928c5f6-7442-4b29-a026-e17aa1a0ddcd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "refresh_cache-4463e53e-8eb7-45b7-ac0b-05204c79896a" {{(pid=127125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 02:55:46.140170 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7928c5f6-7442-4b29-a026-e17aa1a0ddcd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquired lock "refresh_cache-4463e53e-8eb7-45b7-ac0b-05204c79896a" {{(pid=127125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 02:55:46.142875 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c06d00e2-088a-4c18-b22a-3585b71d5edf tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878" status: 200 len: 1504 microversion: 2.1 time: 0.291090 Oct 29 02:55:46.143756 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1158/2096] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:45 2022] GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 => generated 1504 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:46.149000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fcd724b1-a3d2-457a-8541-97aa1e8cec16 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Calling method '.version_select at 0x7ff0539b43a0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:46.153553 n-d-862967-2 devstack@n-api.service[127124]: WARNING oslo_db.sqlalchemy.utils [None req-fcd724b1-a3d2-457a-8541-97aa1e8cec16 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 29 02:55:46.162728 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fcd724b1-a3d2-457a-8541-97aa1e8cec16 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.017799 Oct 29 02:55:46.163410 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1159/2097] 10.222.0.46 () {60 vars in 1177 bytes} [Sat Oct 29 02:55:46 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:46.168603 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8f62e159-6835-416b-acca-62c93306c7bd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:46.169400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8f62e159-6835-416b-acca-62c93306c7bd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:46.175677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8f62e159-6835-416b-acca-62c93306c7bd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:46.176311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8f62e159-6835-416b-acca-62c93306c7bd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:46.176778 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8f62e159-6835-416b-acca-62c93306c7bd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:46.178116 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8f62e159-6835-416b-acca-62c93306c7bd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:46.178568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8f62e159-6835-416b-acca-62c93306c7bd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:46.178989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8f62e159-6835-416b-acca-62c93306c7bd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:46.213859 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8f62e159-6835-416b-acca-62c93306c7bd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:46.214334 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8f62e159-6835-416b-acca-62c93306c7bd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:46.214764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8f62e159-6835-416b-acca-62c93306c7bd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:46.215205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-8f62e159-6835-416b-acca-62c93306c7bd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lazy-loading 'fault' on Instance uuid 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:55:46.263244 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8f62e159-6835-416b-acca-62c93306c7bd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971f709818b74757947beafd14f546bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49721a0af93a47d38613f4a588ab1e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:46.271577 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8f62e159-6835-416b-acca-62c93306c7bd tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1" status: 200 len: 1306 microversion: 2.1 time: 0.107199 Oct 29 02:55:46.272159 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1160/2098] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:46 2022] GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 => generated 1306 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:46.276780 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-44380956-33de-4168-83a1-287e8f88a401 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:46.277235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-44380956-33de-4168-83a1-287e8f88a401 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] [instance: 6b16dc02-4eb1-41dc-abd3-47ad38c265df] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:46.280876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7928c5f6-7442-4b29-a026-e17aa1a0ddcd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Releasing lock "refresh_cache-4463e53e-8eb7-45b7-ac0b-05204c79896a" {{(pid=127125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 02:55:46.281676 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-7928c5f6-7442-4b29-a026-e17aa1a0ddcd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] HTTP exception thrown: floating IP not found Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7928c5f6-7442-4b29-a026-e17aa1a0ddcd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Request method failure captured: Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a/action HTTP/1.1 Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 41 Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJX-JPs7IBQE92m7LM-EAhPQzBv6EQktxfFR7-_GnzBSnbrxmJP1X6vP0Pu3aKSzjMWkGQ9g4qS5R5NYauOEA4JJU6pNuqmtZxmYIJJtDUqq7kOTgE6FCmQ0meyZSeMhXTkdEi-l0Uju1ppboetFYyal8hknr4aWb8_aquLW9thCRd4 Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 3102dffa1e6843c6b5caa93b81a2fbfd Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-429327322 Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3102dffa1e6843c6b5caa93b81a2fbfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3102dffa1e6843c6b5caa93b81a2fbfd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3102dffa1e6843c6b5caa93b81a2fbfd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3102dffa1e6843c6b5caa93b81a2fbfd"}]}] Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-429327322 Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 3102dffa1e6843c6b5caa93b81a2fbfd Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-429327322 Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: fb6300e24201407ba4c09cb25d247b2d Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: exception: floating IP not found Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '4463e53e-8eb7-45b7-ac0b-05204c79896a', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 29 02:55:46.283787 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:46.288298 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:46.288298 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:46.288298 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:46.288298 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:46.288298 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:46.288298 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:46.288298 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:46.288298 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 29 02:55:46.288298 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:46.288298 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7928c5f6-7442-4b29-a026-e17aa1a0ddcd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Returning 404 to user: floating IP not found {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:46.289271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-44380956-33de-4168-83a1-287e8f88a401 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:46.289271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-44380956-33de-4168-83a1-287e8f88a401 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:46.289533 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7928c5f6-7442-4b29-a026-e17aa1a0ddcd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] 10.222.0.46 "POST /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a/action" status: 404 len: 67 microversion: 2.1 time: 0.212217 Oct 29 02:55:46.289621 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-44380956-33de-4168-83a1-287e8f88a401 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:46.289708 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 939/2099] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:55:46 2022] POST /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a/action => generated 67 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:55:46.290284 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-44380956-33de-4168-83a1-287e8f88a401 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:46.290747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-44380956-33de-4168-83a1-287e8f88a401 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:46.291172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-44380956-33de-4168-83a1-287e8f88a401 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:46.299067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-00cba0f1-b02c-4a8c-9a79-b5bf4cf4d20d tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Calling method '.version_select at 0x7ff053816160>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:46.319056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-44380956-33de-4168-83a1-287e8f88a401 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] [instance: 6b16dc02-4eb1-41dc-abd3-47ad38c265df] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:55:46.319487 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-00cba0f1-b02c-4a8c-9a79-b5bf4cf4d20d tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1868725622" status: 204 len: 0 microversion: 2.2 time: 0.024323 Oct 29 02:55:46.320143 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 940/2100] 10.222.0.46 () {60 vars in 1321 bytes} [Sat Oct 29 02:55:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1868725622 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:55:46.326474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bd0460c3-e442-48b5-8bea-103327fe66b7 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:46.376574 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-bd0460c3-e442-48b5-8bea-103327fe66b7 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bd0460c3-e442-48b5-8bea-103327fe66b7 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Request method failure captured: Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a/action HTTP/1.1 Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 44 Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJX-JPs7IBQE92m7LM-EAhPQzBv6EQktxfFR7-_GnzBSnbrxmJP1X6vP0Pu3aKSzjMWkGQ9g4qS5R5NYauOEA4JJU6pNuqmtZxmYIJJtDUqq7kOTgE6FCmQ0meyZSeMhXTkdEi-l0Uju1ppboetFYyal8hknr4aWb8_aquLW9thCRd4 Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 3102dffa1e6843c6b5caa93b81a2fbfd Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-429327322 Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3102dffa1e6843c6b5caa93b81a2fbfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3102dffa1e6843c6b5caa93b81a2fbfd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3102dffa1e6843c6b5caa93b81a2fbfd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3102dffa1e6843c6b5caa93b81a2fbfd"}]}] Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-429327322 Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 3102dffa1e6843c6b5caa93b81a2fbfd Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-429327322 Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: fb6300e24201407ba4c09cb25d247b2d Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: exception: Floating IP not found for address 0.0.0.0. Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '4463e53e-8eb7-45b7-ac0b-05204c79896a', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 29 02:55:46.379096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 29 02:55:46.386732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 29 02:55:46.386732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:46.386732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:46.386732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:46.386732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:46.386732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:46.386732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:46.386732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:46.386732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:46.386732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 29 02:55:46.386732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:46.386732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bd0460c3-e442-48b5-8bea-103327fe66b7 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:46.386732 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bd0460c3-e442-48b5-8bea-103327fe66b7 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] 10.222.0.46 "POST /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a/action" status: 404 len: 88 microversion: 2.1 time: 0.059384 Oct 29 02:55:46.386732 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 941/2101] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:55:46 2022] POST /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a/action => generated 88 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:55:46.388349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-92231515-79a3-4de1-b423-6f582bd851aa tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Calling method '.version_select at 0x7ff053731c10>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:46.410137 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-92231515-79a3-4de1-b423-6f582bd851aa tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-635519055" status: 204 len: 0 microversion: 2.2 time: 0.027625 Oct 29 02:55:46.410763 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 942/2102] 10.222.0.46 () {60 vars in 1318 bytes} [Sat Oct 29 02:55:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-635519055 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:55:46.415401 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-09ae8e29-6e88-4ac4-9317-4b43be0eaacf tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:46.416007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-09ae8e29-6e88-4ac4-9317-4b43be0eaacf tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] [instance: aaa6d06b-b045-4be8-b37f-907221813df9] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:46.418434 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-44380956-33de-4168-83a1-287e8f88a401 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6b16dc02-4eb1-41dc-abd3-47ad38c265df" status: 204 len: 0 microversion: 2.1 time: 0.144934 Oct 29 02:55:46.420598 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1161/2103] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:55:46 2022] DELETE /compute/v2.1/servers/6b16dc02-4eb1-41dc-abd3-47ad38c265df => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:55:46.423052 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09ae8e29-6e88-4ac4-9317-4b43be0eaacf tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:46.423562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09ae8e29-6e88-4ac4-9317-4b43be0eaacf tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:46.423998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09ae8e29-6e88-4ac4-9317-4b43be0eaacf tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:46.424817 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09ae8e29-6e88-4ac4-9317-4b43be0eaacf tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:46.425257 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09ae8e29-6e88-4ac4-9317-4b43be0eaacf tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:46.425671 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09ae8e29-6e88-4ac4-9317-4b43be0eaacf tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:46.431910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a3b3cea7-8c00-47fc-bb38-79eb77e752bd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:46.433606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a3b3cea7-8c00-47fc-bb38-79eb77e752bd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] [instance: 4463e53e-8eb7-45b7-ac0b-05204c79896a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:46.442489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a3b3cea7-8c00-47fc-bb38-79eb77e752bd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:46.443031 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a3b3cea7-8c00-47fc-bb38-79eb77e752bd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:46.443474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a3b3cea7-8c00-47fc-bb38-79eb77e752bd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:46.444249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a3b3cea7-8c00-47fc-bb38-79eb77e752bd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:46.444807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a3b3cea7-8c00-47fc-bb38-79eb77e752bd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:46.445937 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a3b3cea7-8c00-47fc-bb38-79eb77e752bd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:46.485322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a3b3cea7-8c00-47fc-bb38-79eb77e752bd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] [instance: 4463e53e-8eb7-45b7-ac0b-05204c79896a] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:55:46.578380 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a3b3cea7-8c00-47fc-bb38-79eb77e752bd tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a" status: 204 len: 0 microversion: 2.1 time: 0.155254 Oct 29 02:55:46.584247 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1162/2104] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:55:46 2022] DELETE /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:55:46.593062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-52fa54d5-c9c0-405b-b918-1b9b94f89a2d tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Calling method '.version_select at 0x7ff05c1b1f70>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:46.625533 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-52fa54d5-c9c0-405b-b918-1b9b94f89a2d tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-580661706" status: 204 len: 0 microversion: 2.2 time: 0.043583 Oct 29 02:55:46.626638 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1163/2105] 10.222.0.46 () {60 vars in 1318 bytes} [Sat Oct 29 02:55:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-580661706 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:55:46.640977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-80284766-568c-4e3e-97d9-994a778dbf31 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:46.641725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-80284766-568c-4e3e-97d9-994a778dbf31 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] [instance: 6b16dc02-4eb1-41dc-abd3-47ad38c265df] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:46.648969 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80284766-568c-4e3e-97d9-994a778dbf31 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:46.649677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80284766-568c-4e3e-97d9-994a778dbf31 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:46.650175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80284766-568c-4e3e-97d9-994a778dbf31 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:46.650913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80284766-568c-4e3e-97d9-994a778dbf31 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:46.651392 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80284766-568c-4e3e-97d9-994a778dbf31 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:46.651789 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80284766-568c-4e3e-97d9-994a778dbf31 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:46.658734 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-09ae8e29-6e88-4ac4-9317-4b43be0eaacf tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b368aa7acf3b419c8310c20f93fbe55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6b7f93767742aa9d35d45caf8945d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:46.667344 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-09ae8e29-6e88-4ac4-9317-4b43be0eaacf tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] 10.222.0.46 "GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9" status: 200 len: 1396 microversion: 2.1 time: 0.255573 Oct 29 02:55:46.668064 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 943/2106] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:46 2022] GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9 => generated 1396 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:46.673675 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-591bbc08-d522-435e-b165-295f688d5cc0 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:46.674379 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-591bbc08-d522-435e-b165-295f688d5cc0 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] [instance: 4463e53e-8eb7-45b7-ac0b-05204c79896a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:46.681483 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-591bbc08-d522-435e-b165-295f688d5cc0 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:46.682203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-591bbc08-d522-435e-b165-295f688d5cc0 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:46.682844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-591bbc08-d522-435e-b165-295f688d5cc0 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:46.683588 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-591bbc08-d522-435e-b165-295f688d5cc0 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:46.684127 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-591bbc08-d522-435e-b165-295f688d5cc0 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:46.684631 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-591bbc08-d522-435e-b165-295f688d5cc0 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:46.833856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-80284766-568c-4e3e-97d9-994a778dbf31 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4d2e4223be40a7b76d6f0fa3920b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4447208645ac446686b659cbcf434d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:46.846044 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-80284766-568c-4e3e-97d9-994a778dbf31 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] 10.222.0.46 "GET /compute/v2.1/servers/6b16dc02-4eb1-41dc-abd3-47ad38c265df" status: 200 len: 1529 microversion: 2.1 time: 0.216248 Oct 29 02:55:46.861858 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1164/2107] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:46 2022] GET /compute/v2.1/servers/6b16dc02-4eb1-41dc-abd3-47ad38c265df => generated 1529 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:46.873009 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8e6fd1b6-45a2-4331-82bb-87fa6b1fd9ef tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Action: 'create', calling method: .version_select at 0x7ff05c227ee0>, body: {"keypair": {"name": "tempest-keypair-995721977", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMOZcdRgfLO6f58wE1EQUJ9Dt2vLhbtJaE6ldHDjnCFB9bUxEapQLw2yWkVzTlNLPIk6Js3u2l2ptU9mRjzcJ7F6WIy8KOm2JON2U7kf27xAM1+k4Yf/7++gZCrSBc4ag=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:46.893026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-8e6fd1b6-45a2-4331-82bb-87fa6b1fd9ef tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Getting quotas for project 6e573e2c7bfb4427aa38e6710b5acdb6. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:55:46.898520 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-8e6fd1b6-45a2-4331-82bb-87fa6b1fd9ef tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Getting quotas for user 8882e08b2b214b4b93d965feb91cd13b and project 6e573e2c7bfb4427aa38e6710b5acdb6. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:55:46.900317 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-591bbc08-d522-435e-b165-295f688d5cc0 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6300e24201407ba4c09cb25d247b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102dffa1e6843c6b5caa93b81a2fbfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:46.909803 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-591bbc08-d522-435e-b165-295f688d5cc0 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] 10.222.0.46 "GET /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a" status: 200 len: 1541 microversion: 2.1 time: 0.240454 Oct 29 02:55:46.923945 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 944/2108] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:46 2022] GET /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a => generated 1541 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:46.937725 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8e6fd1b6-45a2-4331-82bb-87fa6b1fd9ef tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.074449 Oct 29 02:55:46.942973 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1165/2109] 10.222.0.46 () {62 vars in 1199 bytes} [Sat Oct 29 02:55:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 76 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 29 02:55:46.953044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e6b9f938-ee0d-4c25-8614-c136fcfdc70c tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Calling method '.version_select at 0x7ff053812c10>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:46.964744 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e6b9f938-ee0d-4c25-8614-c136fcfdc70c tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs/tempest-keypair-995721977" status: 200 len: 512 microversion: 2.2 time: 0.016809 Oct 29 02:55:46.966361 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 945/2110] 10.222.0.46 () {60 vars in 1255 bytes} [Sat Oct 29 02:55:46 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-995721977 => generated 512 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:46.981350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-079a905d-c003-4b47-a3d1-24d6d62ff3e9 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Calling method '.version_select at 0x7ff05c13d790>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:46.985687 n-d-862967-2 devstack@n-api.service[127124]: WARNING oslo_db.sqlalchemy.utils [None req-079a905d-c003-4b47-a3d1-24d6d62ff3e9 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 29 02:55:46.991065 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-079a905d-c003-4b47-a3d1-24d6d62ff3e9 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.015676 Oct 29 02:55:46.991831 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1166/2111] 10.222.0.46 () {60 vars in 1177 bytes} [Sat Oct 29 02:55:46 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:47.002309 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-726ac8f0-ab52-498f-b740-02da6749e92c tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Calling method '.version_select at 0x7ff05385b040>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:47.022236 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-726ac8f0-ab52-498f-b740-02da6749e92c tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-995721977" status: 204 len: 0 microversion: 2.2 time: 0.023704 Oct 29 02:55:47.022804 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 946/2112] 10.222.0.46 () {60 vars in 1258 bytes} [Sat Oct 29 02:55:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-995721977 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:55:47.032902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0b9cd8f2-14df-459b-8493-10aa639d378a tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Action: 'create', calling method: .version_select at 0x7ff053a0d550>, body: {"keypair": {"name": "tempest-keypair-52622265", "type": "x509"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:47.052016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-0b9cd8f2-14df-459b-8493-10aa639d378a tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Getting quotas for project 6e573e2c7bfb4427aa38e6710b5acdb6. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:55:47.057947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-0b9cd8f2-14df-459b-8493-10aa639d378a tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Getting quotas for user 8882e08b2b214b4b93d965feb91cd13b and project 6e573e2c7bfb4427aa38e6710b5acdb6. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:55:47.076779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.processutils [None req-0b9cd8f2-14df-459b-8493-10aa639d378a tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpwfhn348e/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpwfhn348e/temp.key -subj /CN=8882e08b2b214b4b93d965feb91cd13b -extensions v3_req_client {{(pid=127124) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 29 02:55:47.167478 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-10f2be46-78d4-4232-a8cb-0149d92817f2 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:47.168199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-10f2be46-78d4-4232-a8cb-0149d92817f2 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:47.176782 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-10f2be46-78d4-4232-a8cb-0149d92817f2 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:47.177327 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-10f2be46-78d4-4232-a8cb-0149d92817f2 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:47.178207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-10f2be46-78d4-4232-a8cb-0149d92817f2 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:47.178751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-10f2be46-78d4-4232-a8cb-0149d92817f2 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:47.179215 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-10f2be46-78d4-4232-a8cb-0149d92817f2 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:47.179829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-10f2be46-78d4-4232-a8cb-0149d92817f2 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:47.236611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.processutils [None req-0b9cd8f2-14df-459b-8493-10aa639d378a tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpwfhn348e/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpwfhn348e/temp.key -subj /CN=8882e08b2b214b4b93d965feb91cd13b -extensions v3_req_client" returned: 0 in 0.159s {{(pid=127124) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 29 02:55:47.238441 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.processutils [None req-0b9cd8f2-14df-459b-8493-10aa639d378a tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpwfhn348e/temp.key -password pass: {{(pid=127124) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 29 02:55:47.295892 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.processutils [None req-0b9cd8f2-14df-459b-8493-10aa639d378a tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpwfhn348e/temp.key -password pass:" returned: 0 in 0.057s {{(pid=127124) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 29 02:55:47.351511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-0b9cd8f2-14df-459b-8493-10aa639d378a tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Getting quotas for project 6e573e2c7bfb4427aa38e6710b5acdb6. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:55:47.359079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-0b9cd8f2-14df-459b-8493-10aa639d378a tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Getting quotas for user 8882e08b2b214b4b93d965feb91cd13b and project 6e573e2c7bfb4427aa38e6710b5acdb6. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:55:47.366669 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-10f2be46-78d4-4232-a8cb-0149d92817f2 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:47.375520 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-10f2be46-78d4-4232-a8cb-0149d92817f2 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878" status: 200 len: 1504 microversion: 2.1 time: 0.212017 Oct 29 02:55:47.376559 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 947/2113] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:47 2022] GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 => generated 1504 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:55:47.379468 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0b9cd8f2-14df-459b-8493-10aa639d378a tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 4691 microversion: 2.2 time: 0.350545 Oct 29 02:55:47.380800 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1167/2114] 10.222.0.46 () {62 vars in 1198 bytes} [Sat Oct 29 02:55:47 2022] POST /compute/v2.1/os-keypairs => generated 4691 bytes in 353 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Oct 29 02:55:47.381941 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4b0e9be5-a710-4592-b9b5-241e4132ea79 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:47.382521 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4b0e9be5-a710-4592-b9b5-241e4132ea79 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:47.389591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b0e9be5-a710-4592-b9b5-241e4132ea79 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:47.390527 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b0e9be5-a710-4592-b9b5-241e4132ea79 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:47.391188 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b0e9be5-a710-4592-b9b5-241e4132ea79 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:47.392168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b0e9be5-a710-4592-b9b5-241e4132ea79 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:47.392947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b0e9be5-a710-4592-b9b5-241e4132ea79 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:47.393759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b0e9be5-a710-4592-b9b5-241e4132ea79 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:47.408603 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e8df6dac-e07c-4eba-96f0-93018d5ebff8 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Calling method '.version_select at 0x7ff05c0fb670>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:47.419905 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e8df6dac-e07c-4eba-96f0-93018d5ebff8 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs/tempest-keypair-52622265" status: 200 len: 1532 microversion: 2.2 time: 0.019099 Oct 29 02:55:47.430189 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1168/2115] 10.222.0.46 () {60 vars in 1252 bytes} [Sat Oct 29 02:55:47 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-52622265 => generated 1532 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:47.433339 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b0e9be5-a710-4592-b9b5-241e4132ea79 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:47.434510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b0e9be5-a710-4592-b9b5-241e4132ea79 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:47.435138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b0e9be5-a710-4592-b9b5-241e4132ea79 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:47.435844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-4b0e9be5-a710-4592-b9b5-241e4132ea79 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lazy-loading 'fault' on Instance uuid 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:55:47.438528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-59cca8cb-6466-49d9-acc0-798c424302e0 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Calling method '.version_select at 0x7ff05c2300d0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:47.441191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:47.446589 n-d-862967-2 devstack@n-api.service[127124]: WARNING oslo_db.sqlalchemy.utils [None req-59cca8cb-6466-49d9-acc0-798c424302e0 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 29 02:55:47.450701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:47.465008 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-59cca8cb-6466-49d9-acc0-798c424302e0 tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs" status: 200 len: 1389 microversion: 2.2 time: 0.032522 Oct 29 02:55:47.465903 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1169/2116] 10.222.0.46 () {60 vars in 1177 bytes} [Sat Oct 29 02:55:47 2022] GET /compute/v2.1/os-keypairs => generated 1389 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:47.476748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4e3bc9e5-d32a-4d89-9da1-b98393a46cca tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] Calling method '.version_select at 0x7ff05c0b81f0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:47.498491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4b0e9be5-a710-4592-b9b5-241e4132ea79 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971f709818b74757947beafd14f546bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49721a0af93a47d38613f4a588ab1e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:47.507925 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4e3bc9e5-d32a-4d89-9da1-b98393a46cca tempest-KeyPairsV22TestJSON-2040474962 tempest-KeyPairsV22TestJSON-2040474962-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-52622265" status: 204 len: 0 microversion: 2.2 time: 0.035249 Oct 29 02:55:47.509949 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4b0e9be5-a710-4592-b9b5-241e4132ea79 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1" status: 200 len: 1306 microversion: 2.1 time: 0.132078 Oct 29 02:55:47.510917 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 948/2118] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:47 2022] GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 => generated 1306 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:47.511157 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1170/2118] 10.222.0.46 () {60 vars in 1255 bytes} [Sat Oct 29 02:55:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-52622265 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:55:47.690334 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-89048088-bb56-456d-b242-df4a7f0eb9aa tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:47.690920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-89048088-bb56-456d-b242-df4a7f0eb9aa tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] [instance: aaa6d06b-b045-4be8-b37f-907221813df9] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:47.707633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89048088-bb56-456d-b242-df4a7f0eb9aa tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:47.708125 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89048088-bb56-456d-b242-df4a7f0eb9aa tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:47.708580 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89048088-bb56-456d-b242-df4a7f0eb9aa tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:47.709283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89048088-bb56-456d-b242-df4a7f0eb9aa tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:47.709734 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89048088-bb56-456d-b242-df4a7f0eb9aa tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:47.710152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89048088-bb56-456d-b242-df4a7f0eb9aa tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:47.866410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-27973e74-4768-40a9-a32d-728db6e4abef req-de765d6e-410c-4e60-ab9b-72f0ab8000c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42ddcbfc-a37e-4d2f-8e07-c28bfcf40878", "tag": "8c18d333-2ae5-4735-96e6-5b6ea458aef2"}, {"server_uuid": "81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1", "name": "network-vif-deleted", "tag": "46f29793-230c-41a4-90a3-6f7ef9ed7a47"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:47.888808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-27973e74-4768-40a9-a32d-728db6e4abef req-de765d6e-410c-4e60-ab9b-72f0ab8000c3 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:47.889574 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-27973e74-4768-40a9-a32d-728db6e4abef req-de765d6e-410c-4e60-ab9b-72f0ab8000c3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:47.890326 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-27973e74-4768-40a9-a32d-728db6e4abef req-de765d6e-410c-4e60-ab9b-72f0ab8000c3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:47.893596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-89048088-bb56-456d-b242-df4a7f0eb9aa tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b368aa7acf3b419c8310c20f93fbe55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6b7f93767742aa9d35d45caf8945d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:47.906987 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-89048088-bb56-456d-b242-df4a7f0eb9aa tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] 10.222.0.46 "GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9" status: 200 len: 1396 microversion: 2.1 time: 0.219529 Oct 29 02:55:47.908167 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-27973e74-4768-40a9-a32d-728db6e4abef req-de765d6e-410c-4e60-ab9b-72f0ab8000c3 service nova] Creating event network-changed:8c18d333-2ae5-4735-96e6-5b6ea458aef2 for instance 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 on n-h1-862967-2 Oct 29 02:55:47.909173 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-27973e74-4768-40a9-a32d-728db6e4abef req-de765d6e-410c-4e60-ab9b-72f0ab8000c3 service nova] Creating event network-vif-deleted:46f29793-230c-41a4-90a3-6f7ef9ed7a47 for instance 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 on n-h1-862967-2 Oct 29 02:55:47.920672 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-27973e74-4768-40a9-a32d-728db6e4abef req-de765d6e-410c-4e60-ab9b-72f0ab8000c3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.059304 Oct 29 02:55:47.922691 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1171/2119] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:47.924774 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 949/2120] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:47 2022] GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9 => generated 1396 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:47.938733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b5d239fa-c05c-4eb9-b640-f3cfbc731a88 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:47.940019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b5d239fa-c05c-4eb9-b640-f3cfbc731a88 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] [instance: 4463e53e-8eb7-45b7-ac0b-05204c79896a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:47.945813 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f3629747-6909-4f7f-918d-55b72518c5d3 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:47.948434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f3629747-6909-4f7f-918d-55b72518c5d3 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] [instance: 6b16dc02-4eb1-41dc-abd3-47ad38c265df] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:47.948979 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5d239fa-c05c-4eb9-b640-f3cfbc731a88 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:47.950154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5d239fa-c05c-4eb9-b640-f3cfbc731a88 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:47.950832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5d239fa-c05c-4eb9-b640-f3cfbc731a88 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:47.952259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5d239fa-c05c-4eb9-b640-f3cfbc731a88 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:47.952968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5d239fa-c05c-4eb9-b640-f3cfbc731a88 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:47.953694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5d239fa-c05c-4eb9-b640-f3cfbc731a88 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:47.956769 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3629747-6909-4f7f-918d-55b72518c5d3 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:47.957328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3629747-6909-4f7f-918d-55b72518c5d3 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:47.957827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3629747-6909-4f7f-918d-55b72518c5d3 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:47.961151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3629747-6909-4f7f-918d-55b72518c5d3 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:47.961539 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3629747-6909-4f7f-918d-55b72518c5d3 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:47.962460 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3629747-6909-4f7f-918d-55b72518c5d3 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:48.223486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:48.241680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b5d239fa-c05c-4eb9-b640-f3cfbc731a88 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6300e24201407ba4c09cb25d247b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102dffa1e6843c6b5caa93b81a2fbfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:48.251760 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b5d239fa-c05c-4eb9-b640-f3cfbc731a88 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] 10.222.0.46 "GET /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a" status: 200 len: 1541 microversion: 2.1 time: 0.318250 Oct 29 02:55:48.268016 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 950/2121] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:47 2022] GET /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a => generated 1541 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:55:48.406711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f3629747-6909-4f7f-918d-55b72518c5d3 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4d2e4223be40a7b76d6f0fa3920b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4447208645ac446686b659cbcf434d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:48.408002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-45568ffa-74c9-4c7a-92a6-4100e4ade916 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:48.410191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-45568ffa-74c9-4c7a-92a6-4100e4ade916 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:48.415914 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:48.422979 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f3629747-6909-4f7f-918d-55b72518c5d3 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] 10.222.0.46 "GET /compute/v2.1/servers/6b16dc02-4eb1-41dc-abd3-47ad38c265df" status: 200 len: 1529 microversion: 2.1 time: 0.498861 Oct 29 02:55:48.424015 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1172/2122] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:47 2022] GET /compute/v2.1/servers/6b16dc02-4eb1-41dc-abd3-47ad38c265df => generated 1529 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:48.429129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45568ffa-74c9-4c7a-92a6-4100e4ade916 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:48.431014 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45568ffa-74c9-4c7a-92a6-4100e4ade916 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:48.433173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45568ffa-74c9-4c7a-92a6-4100e4ade916 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:48.434480 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45568ffa-74c9-4c7a-92a6-4100e4ade916 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:48.436816 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45568ffa-74c9-4c7a-92a6-4100e4ade916 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:48.437753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45568ffa-74c9-4c7a-92a6-4100e4ade916 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:48.533998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-472b3917-cba5-4ba2-8b37-aca9b405526e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:48.534674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-472b3917-cba5-4ba2-8b37-aca9b405526e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:48.554564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-472b3917-cba5-4ba2-8b37-aca9b405526e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:48.555081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-472b3917-cba5-4ba2-8b37-aca9b405526e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:48.555526 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-472b3917-cba5-4ba2-8b37-aca9b405526e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:48.556477 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-472b3917-cba5-4ba2-8b37-aca9b405526e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:48.557390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-472b3917-cba5-4ba2-8b37-aca9b405526e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:48.557390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-472b3917-cba5-4ba2-8b37-aca9b405526e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:48.585741 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-472b3917-cba5-4ba2-8b37-aca9b405526e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] HTTP exception thrown: Instance 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 could not be found. Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-472b3917-cba5-4ba2-8b37-aca9b405526e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Request method failure captured: Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 HTTP/1.1 Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJWyvWNGvIUONB2dldB7pPioEBwKHjHetza4K1fLTtjT_TQMaaZr4Sn7Ypy_ZhXjAwE7ry_UKafzclnlLHflyUJDtnmpn--08xUkjJ2-Rign0-fn1TZL2Hdqa5rKCy6QAStHGO-9e-pn1Lh_D4FvZ1sBFzju6OJDLJ_prG4_rU83xk8 Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/49721a0af93a47d38613f4a588ab1e1a"}]}] Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 971f709818b74757947beafd14f546bf Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 could not be found. Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1'} Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 could not be found. Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 could not be found. Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:48.587919 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:48.592365 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:48.592365 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:48.592365 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:48.592365 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:48.592365 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:48.592365 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 could not be found. Oct 29 02:55:48.592365 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:48.593528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-472b3917-cba5-4ba2-8b37-aca9b405526e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Returning 404 to user: Instance 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:48.595096 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-472b3917-cba5-4ba2-8b37-aca9b405526e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1" status: 404 len: 111 microversion: 2.1 time: 0.064859 Oct 29 02:55:48.599781 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1173/2123] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:48 2022] GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:55:48.606544 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3734cda4-fc20-4520-bba7-ecffbcf23e4e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '.version_select at 0x7ff05c1b1a60>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:48.902933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-45568ffa-74c9-4c7a-92a6-4100e4ade916 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:48.914391 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-45568ffa-74c9-4c7a-92a6-4100e4ade916 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878" status: 200 len: 1504 microversion: 2.1 time: 0.518666 Oct 29 02:55:48.915181 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 951/2124] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:48 2022] GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 => generated 1504 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:55:48.937412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b9d31497-bf78-4cec-adc2-9cd6ef2e8e54 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:48.938414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b9d31497-bf78-4cec-adc2-9cd6ef2e8e54 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] [instance: aaa6d06b-b045-4be8-b37f-907221813df9] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:48.947967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9d31497-bf78-4cec-adc2-9cd6ef2e8e54 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:48.949001 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9d31497-bf78-4cec-adc2-9cd6ef2e8e54 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:48.949470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9d31497-bf78-4cec-adc2-9cd6ef2e8e54 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:48.950201 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9d31497-bf78-4cec-adc2-9cd6ef2e8e54 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:48.950656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9d31497-bf78-4cec-adc2-9cd6ef2e8e54 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:48.951161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9d31497-bf78-4cec-adc2-9cd6ef2e8e54 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:49.281652 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b9d31497-bf78-4cec-adc2-9cd6ef2e8e54 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b368aa7acf3b419c8310c20f93fbe55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6b7f93767742aa9d35d45caf8945d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:49.293391 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b9d31497-bf78-4cec-adc2-9cd6ef2e8e54 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] 10.222.0.46 "GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9" status: 200 len: 1576 microversion: 2.1 time: 0.360497 Oct 29 02:55:49.304907 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 952/2125] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:48 2022] GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9 => generated 1576 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:49.327049 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-11a49a69-dc0c-4821-943d-edc7baf2496a tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:49.328205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-11a49a69-dc0c-4821-943d-edc7baf2496a tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] [instance: 4463e53e-8eb7-45b7-ac0b-05204c79896a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:49.338486 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11a49a69-dc0c-4821-943d-edc7baf2496a tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:49.339291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11a49a69-dc0c-4821-943d-edc7baf2496a tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:49.340010 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11a49a69-dc0c-4821-943d-edc7baf2496a tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:49.341923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11a49a69-dc0c-4821-943d-edc7baf2496a tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:49.342770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11a49a69-dc0c-4821-943d-edc7baf2496a tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:49.346902 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11a49a69-dc0c-4821-943d-edc7baf2496a tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:49.687524 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3734cda4-fc20-4520-bba7-ecffbcf23e4e tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/58dbda33-dfee-4dbc-b17e-75a83fc45200" status: 202 len: 0 microversion: 2.1 time: 1.086180 Oct 29 02:55:49.689956 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1174/2126] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:55:48 2022] DELETE /compute/v2.1/os-security-groups/58dbda33-dfee-4dbc-b17e-75a83fc45200 => generated 0 bytes in 1088 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:55:49.693896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-55807700-66b7-44f1-a6ef-ce876e8af1dc tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:49.694415 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-55807700-66b7-44f1-a6ef-ce876e8af1dc tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] [instance: aaa6d06b-b045-4be8-b37f-907221813df9] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:49.705063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-11a49a69-dc0c-4821-943d-edc7baf2496a tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6300e24201407ba4c09cb25d247b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102dffa1e6843c6b5caa93b81a2fbfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:49.710881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55807700-66b7-44f1-a6ef-ce876e8af1dc tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:49.722096 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-11a49a69-dc0c-4821-943d-edc7baf2496a tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] 10.222.0.46 "GET /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a" status: 200 len: 1541 microversion: 2.1 time: 0.413522 Oct 29 02:55:49.722759 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 953/2127] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:49 2022] GET /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a => generated 1541 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:49.727913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55807700-66b7-44f1-a6ef-ce876e8af1dc tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:49.728954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55807700-66b7-44f1-a6ef-ce876e8af1dc tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:49.731962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55807700-66b7-44f1-a6ef-ce876e8af1dc tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:49.732711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55807700-66b7-44f1-a6ef-ce876e8af1dc tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:49.733315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55807700-66b7-44f1-a6ef-ce876e8af1dc tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:49.742878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7a6120e6-62b2-44c6-b7c6-b22772337628 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:49.745529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7a6120e6-62b2-44c6-b7c6-b22772337628 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] [instance: 6b16dc02-4eb1-41dc-abd3-47ad38c265df] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:49.772562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a6120e6-62b2-44c6-b7c6-b22772337628 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:49.774658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a6120e6-62b2-44c6-b7c6-b22772337628 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:49.777442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a6120e6-62b2-44c6-b7c6-b22772337628 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:49.785299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a6120e6-62b2-44c6-b7c6-b22772337628 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:49.787134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a6120e6-62b2-44c6-b7c6-b22772337628 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:49.788306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a6120e6-62b2-44c6-b7c6-b22772337628 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:49.873012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a6120e6-62b2-44c6-b7c6-b22772337628 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:49.873737 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a6120e6-62b2-44c6-b7c6-b22772337628 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:49.874463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a6120e6-62b2-44c6-b7c6-b22772337628 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:49.875143 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-7a6120e6-62b2-44c6-b7c6-b22772337628 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lazy-loading 'fault' on Instance uuid 6b16dc02-4eb1-41dc-abd3-47ad38c265df {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:55:49.943792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7a6120e6-62b2-44c6-b7c6-b22772337628 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4d2e4223be40a7b76d6f0fa3920b1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4447208645ac446686b659cbcf434d71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:49.955817 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7a6120e6-62b2-44c6-b7c6-b22772337628 tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] 10.222.0.46 "GET /compute/v2.1/servers/6b16dc02-4eb1-41dc-abd3-47ad38c265df" status: 200 len: 1315 microversion: 2.1 time: 0.227824 Oct 29 02:55:49.966108 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-55807700-66b7-44f1-a6ef-ce876e8af1dc tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] 10.222.0.46 "GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.276542 Oct 29 02:55:49.966803 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1175/2128] 10.222.0.46 () {58 vars in 1275 bytes} [Sat Oct 29 02:55:49 2022] GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9/os-interface => generated 284 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:49.967501 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 954/2129] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:49 2022] GET /compute/v2.1/servers/6b16dc02-4eb1-41dc-abd3-47ad38c265df => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:49.977710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2d50a4c4-f80f-46b9-b057-7c5828a2c496 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:49.978539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2d50a4c4-f80f-46b9-b057-7c5828a2c496 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:49.981624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cb1ea8c7-5e89-4e93-95de-2d7a6eacbebb tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '.version_select at 0x7ff053a7dd30>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:49.986976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d50a4c4-f80f-46b9-b057-7c5828a2c496 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:49.987837 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d50a4c4-f80f-46b9-b057-7c5828a2c496 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:49.988412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d50a4c4-f80f-46b9-b057-7c5828a2c496 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:49.989311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d50a4c4-f80f-46b9-b057-7c5828a2c496 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:49.989905 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d50a4c4-f80f-46b9-b057-7c5828a2c496 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:49.991360 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d50a4c4-f80f-46b9-b057-7c5828a2c496 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:50.532853 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2d50a4c4-f80f-46b9-b057-7c5828a2c496 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:50.545245 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2d50a4c4-f80f-46b9-b057-7c5828a2c496 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878" status: 200 len: 1504 microversion: 2.1 time: 0.575605 Oct 29 02:55:50.545385 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 955/2130] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:49 2022] GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 => generated 1504 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:50.559091 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-5378ec60-695f-4055-825e-25d87588f8f5 req-f08f9af5-1957-498c-9e7d-27fd68b154d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b16dc02-4eb1-41dc-abd3-47ad38c265df", "name": "network-vif-deleted", "tag": "7d83c076-915d-4a78-9a66-a2e6e5332bb5"}, {"server_uuid": "4463e53e-8eb7-45b7-ac0b-05204c79896a", "name": "network-vif-deleted", "tag": "b7adebcb-9cb0-4755-83b6-d418a864b6a2"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:50.592324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-5378ec60-695f-4055-825e-25d87588f8f5 req-f08f9af5-1957-498c-9e7d-27fd68b154d1 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:50.592974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-5378ec60-695f-4055-825e-25d87588f8f5 req-f08f9af5-1957-498c-9e7d-27fd68b154d1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:50.593658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-5378ec60-695f-4055-825e-25d87588f8f5 req-f08f9af5-1957-498c-9e7d-27fd68b154d1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:50.621179 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-5378ec60-695f-4055-825e-25d87588f8f5 req-f08f9af5-1957-498c-9e7d-27fd68b154d1 service nova] Creating event network-vif-deleted:7d83c076-915d-4a78-9a66-a2e6e5332bb5 for instance 6b16dc02-4eb1-41dc-abd3-47ad38c265df on n-h1-862967-2 Oct 29 02:55:50.622103 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-5378ec60-695f-4055-825e-25d87588f8f5 req-f08f9af5-1957-498c-9e7d-27fd68b154d1 service nova] Creating event network-vif-deleted:b7adebcb-9cb0-4755-83b6-d418a864b6a2 for instance 4463e53e-8eb7-45b7-ac0b-05204c79896a on n-h2-862967-2 Oct 29 02:55:50.642053 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-5378ec60-695f-4055-825e-25d87588f8f5 req-f08f9af5-1957-498c-9e7d-27fd68b154d1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.086824 Oct 29 02:55:50.647305 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 956/2131] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:50.703127 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cb1ea8c7-5e89-4e93-95de-2d7a6eacbebb tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/b783c247-b37d-4004-bba7-453855f631fb" status: 202 len: 0 microversion: 2.1 time: 0.726078 Oct 29 02:55:50.704270 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1176/2132] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:55:49 2022] DELETE /compute/v2.1/os-security-groups/b783c247-b37d-4004-bba7-453855f631fb => generated 0 bytes in 737 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:55:50.716071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ca5c9edb-8880-4ff7-b1af-cfb9c6f98772 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Action: 'create', calling method: .version_select at 0x7ff05385bdc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1922130338", "description": "tempest-description-113903637"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:50.763996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-60b94143-accd-4be0-97f2-3e2e3a8f6aba tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:50.765429 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-60b94143-accd-4be0-97f2-3e2e3a8f6aba tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] [instance: 4463e53e-8eb7-45b7-ac0b-05204c79896a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:50.787701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60b94143-accd-4be0-97f2-3e2e3a8f6aba tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:50.791384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60b94143-accd-4be0-97f2-3e2e3a8f6aba tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:50.795035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60b94143-accd-4be0-97f2-3e2e3a8f6aba tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:50.815277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60b94143-accd-4be0-97f2-3e2e3a8f6aba tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:50.816674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60b94143-accd-4be0-97f2-3e2e3a8f6aba tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:50.817917 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60b94143-accd-4be0-97f2-3e2e3a8f6aba tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:50.892939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60b94143-accd-4be0-97f2-3e2e3a8f6aba tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:50.895054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60b94143-accd-4be0-97f2-3e2e3a8f6aba tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:50.895774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60b94143-accd-4be0-97f2-3e2e3a8f6aba tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:50.896782 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-60b94143-accd-4be0-97f2-3e2e3a8f6aba tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lazy-loading 'fault' on Instance uuid 4463e53e-8eb7-45b7-ac0b-05204c79896a {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:55:51.148408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-60b94143-accd-4be0-97f2-3e2e3a8f6aba tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb6300e24201407ba4c09cb25d247b2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3102dffa1e6843c6b5caa93b81a2fbfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:51.150856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:51.177644 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-60b94143-accd-4be0-97f2-3e2e3a8f6aba tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] 10.222.0.46 "GET /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a" status: 200 len: 1321 microversion: 2.1 time: 0.428492 Oct 29 02:55:51.192612 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1177/2133] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:50 2022] GET /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a => generated 1321 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:51.198683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9aecbc97-5b6c-4e21-8f9f-1daa57c4956f tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:51.199312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9aecbc97-5b6c-4e21-8f9f-1daa57c4956f tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] [instance: 6b16dc02-4eb1-41dc-abd3-47ad38c265df] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:51.206191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9aecbc97-5b6c-4e21-8f9f-1daa57c4956f tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:51.206559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9aecbc97-5b6c-4e21-8f9f-1daa57c4956f tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:51.209787 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9aecbc97-5b6c-4e21-8f9f-1daa57c4956f tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:51.209787 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9aecbc97-5b6c-4e21-8f9f-1daa57c4956f tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:51.209787 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9aecbc97-5b6c-4e21-8f9f-1daa57c4956f tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:51.209787 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9aecbc97-5b6c-4e21-8f9f-1daa57c4956f tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:51.228343 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-9aecbc97-5b6c-4e21-8f9f-1daa57c4956f tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] HTTP exception thrown: Instance 6b16dc02-4eb1-41dc-abd3-47ad38c265df could not be found. Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9aecbc97-5b6c-4e21-8f9f-1daa57c4956f tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Request method failure captured: Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/6b16dc02-4eb1-41dc-abd3-47ad38c265df HTTP/1.1 Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJYefL0yhwm02aNIBfxk6dL7Y-j-zkZISf0cZoCX6_82EwDDRrKYU_rn6r5zSOfEdJw3K8_YWNFP1vbUEI4l1nCEI5Ie7ZCKZg7ggYQn_HR8db2ateYJlrIS7_EfFCUGaMrA1revY5SfmcQowxmq4nfddovNkW3rBGz8Mb1g78gWzII Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 4447208645ac446686b659cbcf434d71 Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-712933471 Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4447208645ac446686b659cbcf434d71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4447208645ac446686b659cbcf434d71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4447208645ac446686b659cbcf434d71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4447208645ac446686b659cbcf434d71"}]}] Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-712933471 Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 4447208645ac446686b659cbcf434d71 Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-712933471 Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-InstanceActionsNegativeTestJSON-712933471-project Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: ca4d2e4223be40a7b76d6f0fa3920b1c Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-712933471-project Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 6b16dc02-4eb1-41dc-abd3-47ad38c265df could not be found. Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '6b16dc02-4eb1-41dc-abd3-47ad38c265df'} Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b16dc02-4eb1-41dc-abd3-47ad38c265df could not be found. Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b16dc02-4eb1-41dc-abd3-47ad38c265df could not be found. Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:51.230008 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:51.234710 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:51.234710 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:51.234710 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:51.234710 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:51.234710 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:51.234710 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:51.234710 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b16dc02-4eb1-41dc-abd3-47ad38c265df could not be found. Oct 29 02:55:51.234710 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:51.234710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9aecbc97-5b6c-4e21-8f9f-1daa57c4956f tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] Returning 404 to user: Instance 6b16dc02-4eb1-41dc-abd3-47ad38c265df could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:51.234710 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9aecbc97-5b6c-4e21-8f9f-1daa57c4956f tempest-InstanceActionsNegativeTestJSON-712933471 tempest-InstanceActionsNegativeTestJSON-712933471-project] 10.222.0.46 "GET /compute/v2.1/servers/6b16dc02-4eb1-41dc-abd3-47ad38c265df" status: 404 len: 111 microversion: 2.1 time: 0.037678 Oct 29 02:55:51.234710 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1178/2134] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:51 2022] GET /compute/v2.1/servers/6b16dc02-4eb1-41dc-abd3-47ad38c265df => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:55:51.412674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-81898547-0c05-49f4-98c7-a3c8d3de53a4 tempest-AbsoluteLimitsTestJSON-745932772 tempest-AbsoluteLimitsTestJSON-745932772-project] Calling method '.version_select at 0x7ff0539d1310>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:51.435652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81898547-0c05-49f4-98c7-a3c8d3de53a4 tempest-AbsoluteLimitsTestJSON-745932772 tempest-AbsoluteLimitsTestJSON-745932772-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:51.436646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81898547-0c05-49f4-98c7-a3c8d3de53a4 tempest-AbsoluteLimitsTestJSON-745932772 tempest-AbsoluteLimitsTestJSON-745932772-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:51.437286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81898547-0c05-49f4-98c7-a3c8d3de53a4 tempest-AbsoluteLimitsTestJSON-745932772 tempest-AbsoluteLimitsTestJSON-745932772-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:51.438242 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81898547-0c05-49f4-98c7-a3c8d3de53a4 tempest-AbsoluteLimitsTestJSON-745932772 tempest-AbsoluteLimitsTestJSON-745932772-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:51.439299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81898547-0c05-49f4-98c7-a3c8d3de53a4 tempest-AbsoluteLimitsTestJSON-745932772 tempest-AbsoluteLimitsTestJSON-745932772-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:51.440287 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81898547-0c05-49f4-98c7-a3c8d3de53a4 tempest-AbsoluteLimitsTestJSON-745932772 tempest-AbsoluteLimitsTestJSON-745932772-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:51.464870 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-81898547-0c05-49f4-98c7-a3c8d3de53a4 tempest-AbsoluteLimitsTestJSON-745932772 tempest-AbsoluteLimitsTestJSON-745932772-project] 10.222.0.46 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.231291 Oct 29 02:55:51.465885 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1179/2135] 10.222.0.46 () {58 vars in 1122 bytes} [Sat Oct 29 02:55:51 2022] GET /compute/v2.1/limits => generated 511 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:51.568106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4fc32b3f-1155-4d20-90d4-94a10f3b5513 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:51.569446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4fc32b3f-1155-4d20-90d4-94a10f3b5513 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:51.583325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4fc32b3f-1155-4d20-90d4-94a10f3b5513 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:51.583829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4fc32b3f-1155-4d20-90d4-94a10f3b5513 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:51.584466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4fc32b3f-1155-4d20-90d4-94a10f3b5513 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:51.585182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4fc32b3f-1155-4d20-90d4-94a10f3b5513 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:51.585644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4fc32b3f-1155-4d20-90d4-94a10f3b5513 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:51.586074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4fc32b3f-1155-4d20-90d4-94a10f3b5513 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:51.714958 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ca5c9edb-8880-4ff7-b1af-cfb9c6f98772 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.003804 Oct 29 02:55:51.716931 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 957/2136] 10.222.0.46 () {60 vars in 1180 bytes} [Sat Oct 29 02:55:50 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:51.730971 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ba2349fa-4771-4570-acff-130661ed7706 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Action: 'update', calling method: .version_select at 0x7ff053834550>, body: {"security_group": {"name": "tempest-sg-hth-486667115", "description": "tempest-description-hth-2025404220"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:52.270736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4fc32b3f-1155-4d20-90d4-94a10f3b5513 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:52.284935 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4fc32b3f-1155-4d20-90d4-94a10f3b5513 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878" status: 200 len: 1504 microversion: 2.1 time: 0.719443 Oct 29 02:55:52.285554 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1180/2137] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:51 2022] GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 => generated 1504 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:55:52.296793 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5facd980-1453-42f9-b30c-6e90b109eb04 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:52.303994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5facd980-1453-42f9-b30c-6e90b109eb04 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] [instance: 4463e53e-8eb7-45b7-ac0b-05204c79896a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:52.312814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5facd980-1453-42f9-b30c-6e90b109eb04 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:52.314208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5facd980-1453-42f9-b30c-6e90b109eb04 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:52.315480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5facd980-1453-42f9-b30c-6e90b109eb04 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:52.319711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5facd980-1453-42f9-b30c-6e90b109eb04 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:52.320397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5facd980-1453-42f9-b30c-6e90b109eb04 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:52.321552 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5facd980-1453-42f9-b30c-6e90b109eb04 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:52.343617 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-5facd980-1453-42f9-b30c-6e90b109eb04 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] HTTP exception thrown: Instance 4463e53e-8eb7-45b7-ac0b-05204c79896a could not be found. Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5facd980-1453-42f9-b30c-6e90b109eb04 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Request method failure captured: Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a HTTP/1.1 Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJX-JPs7IBQE92m7LM-EAhPQzBv6EQktxfFR7-_GnzBSnbrxmJP1X6vP0Pu3aKSzjMWkGQ9g4qS5R5NYauOEA4JJU6pNuqmtZxmYIJJtDUqq7kOTgE6FCmQ0meyZSeMhXTkdEi-l0Uju1ppboetFYyal8hknr4aWb8_aquLW9thCRd4 Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 3102dffa1e6843c6b5caa93b81a2fbfd Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-429327322 Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3102dffa1e6843c6b5caa93b81a2fbfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3102dffa1e6843c6b5caa93b81a2fbfd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3102dffa1e6843c6b5caa93b81a2fbfd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3102dffa1e6843c6b5caa93b81a2fbfd"}]}] Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-429327322 Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 3102dffa1e6843c6b5caa93b81a2fbfd Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-429327322 Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: fb6300e24201407ba4c09cb25d247b2d Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 4463e53e-8eb7-45b7-ac0b-05204c79896a could not be found. Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '4463e53e-8eb7-45b7-ac0b-05204c79896a'} Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4463e53e-8eb7-45b7-ac0b-05204c79896a could not be found. Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4463e53e-8eb7-45b7-ac0b-05204c79896a could not be found. Oct 29 02:55:52.346744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:52.351173 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:52.351173 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:52.351173 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:52.351173 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:52.351173 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:52.351173 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:52.351173 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:52.351173 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4463e53e-8eb7-45b7-ac0b-05204c79896a could not be found. Oct 29 02:55:52.351173 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:52.352647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5facd980-1453-42f9-b30c-6e90b109eb04 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] Returning 404 to user: Instance 4463e53e-8eb7-45b7-ac0b-05204c79896a could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:52.354069 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5facd980-1453-42f9-b30c-6e90b109eb04 tempest-FloatingIPsAssociationNegativeTestJSON-429327322 tempest-FloatingIPsAssociationNegativeTestJSON-429327322-project] 10.222.0.46 "GET /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a" status: 404 len: 111 microversion: 2.1 time: 0.066693 Oct 29 02:55:52.354853 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1181/2138] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:52 2022] GET /compute/v2.1/servers/4463e53e-8eb7-45b7-ac0b-05204c79896a => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:55:52.566935 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ba2349fa-4771-4570-acff-130661ed7706 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "PUT /compute/v2.1/os-security-groups/3b9f9e10-06d6-4259-8829-7fa1e0473726" status: 200 len: 217 microversion: 2.1 time: 0.839889 Oct 29 02:55:52.576742 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 958/2139] 10.222.0.46 () {60 vars in 1290 bytes} [Sat Oct 29 02:55:51 2022] PUT /compute/v2.1/os-security-groups/3b9f9e10-06d6-4259-8829-7fa1e0473726 => generated 217 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:52.582098 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4e6806c9-45b7-435c-a188-ef87b0cb0791 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '.version_select at 0x7ff053a53d30>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:52.732870 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4e6806c9-45b7-435c-a188-ef87b0cb0791 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/os-security-groups/3b9f9e10-06d6-4259-8829-7fa1e0473726" status: 200 len: 217 microversion: 2.1 time: 0.155586 Oct 29 02:55:52.746731 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1182/2140] 10.222.0.46 () {58 vars in 1269 bytes} [Sat Oct 29 02:55:52 2022] GET /compute/v2.1/os-security-groups/3b9f9e10-06d6-4259-8829-7fa1e0473726 => generated 217 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:52.747823 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-024f489a-f198-4966-b1e0-c8657e15a566 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '.version_select at 0x7ff053660430>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:53.311506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-009b059e-4905-47fa-9909-274a16c36e5f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:53.313474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-009b059e-4905-47fa-9909-274a16c36e5f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:53.323751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-009b059e-4905-47fa-9909-274a16c36e5f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:53.324578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-009b059e-4905-47fa-9909-274a16c36e5f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:53.325202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-009b059e-4905-47fa-9909-274a16c36e5f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:53.326481 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-009b059e-4905-47fa-9909-274a16c36e5f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:53.328893 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-009b059e-4905-47fa-9909-274a16c36e5f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:53.329621 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-009b059e-4905-47fa-9909-274a16c36e5f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:53.672798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-009b059e-4905-47fa-9909-274a16c36e5f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:53.685719 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-009b059e-4905-47fa-9909-274a16c36e5f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878" status: 200 len: 1504 microversion: 2.1 time: 0.380988 Oct 29 02:55:53.688713 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1183/2141] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:53 2022] GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 => generated 1504 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:54.128119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8761fa6b-004a-430b-80c2-82c4b7c683fe tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:54.128602 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8761fa6b-004a-430b-80c2-82c4b7c683fe tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] [instance: aaa6d06b-b045-4be8-b37f-907221813df9] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:54.140415 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8761fa6b-004a-430b-80c2-82c4b7c683fe tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:54.140957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8761fa6b-004a-430b-80c2-82c4b7c683fe tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:54.144430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8761fa6b-004a-430b-80c2-82c4b7c683fe tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:54.145303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8761fa6b-004a-430b-80c2-82c4b7c683fe tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:54.145826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8761fa6b-004a-430b-80c2-82c4b7c683fe tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:54.146312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8761fa6b-004a-430b-80c2-82c4b7c683fe tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:54.656671 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8761fa6b-004a-430b-80c2-82c4b7c683fe tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b368aa7acf3b419c8310c20f93fbe55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6b7f93767742aa9d35d45caf8945d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:54.671560 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8761fa6b-004a-430b-80c2-82c4b7c683fe tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] 10.222.0.46 "GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9" status: 200 len: 1576 microversion: 2.1 time: 0.547951 Oct 29 02:55:54.679977 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1184/2142] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:54 2022] GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9 => generated 1576 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:55:54.714209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b468104f-9e51-4c16-9fc8-e9cfdf656230 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:54.718399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b468104f-9e51-4c16-9fc8-e9cfdf656230 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:54.725326 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b468104f-9e51-4c16-9fc8-e9cfdf656230 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:54.726228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b468104f-9e51-4c16-9fc8-e9cfdf656230 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:54.726813 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b468104f-9e51-4c16-9fc8-e9cfdf656230 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:54.727701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b468104f-9e51-4c16-9fc8-e9cfdf656230 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:54.728319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b468104f-9e51-4c16-9fc8-e9cfdf656230 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:54.729000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b468104f-9e51-4c16-9fc8-e9cfdf656230 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:54.926726 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-024f489a-f198-4966-b1e0-c8657e15a566 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/3b9f9e10-06d6-4259-8829-7fa1e0473726" status: 202 len: 0 microversion: 2.1 time: 2.183343 Oct 29 02:55:54.927344 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 959/2143] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:55:52 2022] DELETE /compute/v2.1/os-security-groups/3b9f9e10-06d6-4259-8829-7fa1e0473726 => generated 0 bytes in 2185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:55:54.932462 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-83f303a0-4c4e-404b-9a53-5936cbfb123b req-6fc667d1-681e-41b5-962c-4dde77c0b9b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa6d06b-b045-4be8-b37f-907221813df9", "tag": "4c26750e-9b47-44f7-88f7-e2358512c498"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:54.964605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-83f303a0-4c4e-404b-9a53-5936cbfb123b req-6fc667d1-681e-41b5-962c-4dde77c0b9b0 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:54.968338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-83f303a0-4c4e-404b-9a53-5936cbfb123b req-6fc667d1-681e-41b5-962c-4dde77c0b9b0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:54.968892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-83f303a0-4c4e-404b-9a53-5936cbfb123b req-6fc667d1-681e-41b5-962c-4dde77c0b9b0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:55.014918 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-83f303a0-4c4e-404b-9a53-5936cbfb123b req-6fc667d1-681e-41b5-962c-4dde77c0b9b0 service nova] Creating event network-changed:4c26750e-9b47-44f7-88f7-e2358512c498 for instance aaa6d06b-b045-4be8-b37f-907221813df9 on n-h2-862967-2 Oct 29 02:55:55.043298 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-83f303a0-4c4e-404b-9a53-5936cbfb123b req-6fc667d1-681e-41b5-962c-4dde77c0b9b0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114401 Oct 29 02:55:55.045373 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 960/2144] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:55:55.063299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-47d59139-309f-40d5-b513-d43f408cdda0 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:55.075537 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-47d59139-309f-40d5-b513-d43f408cdda0 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:55.095976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47d59139-309f-40d5-b513-d43f408cdda0 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:55.096936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47d59139-309f-40d5-b513-d43f408cdda0 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:55.114243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47d59139-309f-40d5-b513-d43f408cdda0 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:55.116410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47d59139-309f-40d5-b513-d43f408cdda0 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:55.118730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47d59139-309f-40d5-b513-d43f408cdda0 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:55.119363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47d59139-309f-40d5-b513-d43f408cdda0 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:55.195864 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-47d59139-309f-40d5-b513-d43f408cdda0 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] HTTP exception thrown: Instance 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 could not be found. Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-47d59139-309f-40d5-b513-d43f408cdda0 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Request method failure captured: Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 HTTP/1.1 Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJWyvWNGvIUONB2dldB7pPioEBwKHjHetza4K1fLTtjT_TQMaaZr4Sn7Ypy_ZhXjAwE7ry_UKafzclnlLHflyUJDtnmpn--08xUkjJ2-Rign0-fn1TZL2Hdqa5rKCy6QAStHGO-9e-pn1Lh_D4FvZ1sBFzju6OJDLJ_prG4_rU83xk8 Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/49721a0af93a47d38613f4a588ab1e1a"}]}] Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 971f709818b74757947beafd14f546bf Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 could not be found. Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1'} Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 could not be found. Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:55:55.197934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:55:55.201476 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 could not be found. Oct 29 02:55:55.201476 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.201476 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:55.201476 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.201476 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:55.201476 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:55.201476 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:55.201476 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:55.201476 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:55.201476 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 could not be found. Oct 29 02:55:55.201476 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.201476 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-47d59139-309f-40d5-b513-d43f408cdda0 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Returning 404 to user: Instance 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:55.201476 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-47d59139-309f-40d5-b513-d43f408cdda0 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "DELETE /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1" status: 404 len: 111 microversion: 2.1 time: 0.146244 Oct 29 02:55:55.201476 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 961/2145] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:55:55 2022] DELETE /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:55:55.234573 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-600b8d3d-2bb5-4b1b-a8e7-002b49ff1021 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:55.235217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-600b8d3d-2bb5-4b1b-a8e7-002b49ff1021 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:55.258205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-600b8d3d-2bb5-4b1b-a8e7-002b49ff1021 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:55.261015 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-600b8d3d-2bb5-4b1b-a8e7-002b49ff1021 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:55.262156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-600b8d3d-2bb5-4b1b-a8e7-002b49ff1021 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:55.263037 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-600b8d3d-2bb5-4b1b-a8e7-002b49ff1021 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:55.269446 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-600b8d3d-2bb5-4b1b-a8e7-002b49ff1021 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:55.270119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-600b8d3d-2bb5-4b1b-a8e7-002b49ff1021 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:55.313354 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-600b8d3d-2bb5-4b1b-a8e7-002b49ff1021 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] HTTP exception thrown: Instance 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 could not be found. Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-600b8d3d-2bb5-4b1b-a8e7-002b49ff1021 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Request method failure captured: Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 HTTP/1.1 Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJWyvWNGvIUONB2dldB7pPioEBwKHjHetza4K1fLTtjT_TQMaaZr4Sn7Ypy_ZhXjAwE7ry_UKafzclnlLHflyUJDtnmpn--08xUkjJ2-Rign0-fn1TZL2Hdqa5rKCy6QAStHGO-9e-pn1Lh_D4FvZ1sBFzju6OJDLJ_prG4_rU83xk8 Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/49721a0af93a47d38613f4a588ab1e1a"}]}] Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 971f709818b74757947beafd14f546bf Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 could not be found. Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1'} Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 could not be found. Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 could not be found. Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:55.317827 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.322791 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:55.322791 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:55.322791 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:55.322791 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:55.322791 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:55.322791 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 could not be found. Oct 29 02:55:55.322791 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.329470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-600b8d3d-2bb5-4b1b-a8e7-002b49ff1021 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Returning 404 to user: Instance 81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:55.330654 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-600b8d3d-2bb5-4b1b-a8e7-002b49ff1021 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1" status: 404 len: 111 microversion: 2.1 time: 0.116650 Oct 29 02:55:55.331963 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 962/2146] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:55 2022] GET /compute/v2.1/servers/81c0dc43-7a2b-4a52-97d7-e9a3c230fbd1 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:55:55.340222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-59047eff-096e-400d-a808-96a5d5ea5de2 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '.version_select at 0x7ff053660430>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:55.466143 n-d-862967-2 devstack@n-api.service[127125]: DEBUG neutronclient.v2_0.client [None req-59047eff-096e-400d-a808-96a5d5ea5de2 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b783c247-b37d-4004-bba7-453855f631fb does not exist", "detail": ""}} {{(pid=127125) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:55:55.466778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.security_group_api [None req-59047eff-096e-400d-a808-96a5d5ea5de2 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Neutron security group b783c247-b37d-4004-bba7-453855f631fb not found {{(pid=127125) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 02:55:55.467296 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-59047eff-096e-400d-a808-96a5d5ea5de2 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] HTTP exception thrown: Security group b783c247-b37d-4004-bba7-453855f631fb does not exist Oct 29 02:55:55.467296 n-d-862967-2 devstack@n-api.service[127125]: Neutron server returns request_ids: ['req-453ea6d6-8abf-450d-9d76-c81992b5f4eb'] Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-59047eff-096e-400d-a808-96a5d5ea5de2 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Request method failure captured: Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/os-security-groups/b783c247-b37d-4004-bba7-453855f631fb HTTP/1.1 Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJWyvWNGvIUONB2dldB7pPioEBwKHjHetza4K1fLTtjT_TQMaaZr4Sn7Ypy_ZhXjAwE7ry_UKafzclnlLHflyUJDtnmpn--08xUkjJ2-Rign0-fn1TZL2Hdqa5rKCy6QAStHGO-9e-pn1Lh_D4FvZ1sBFzju6OJDLJ_prG4_rU83xk8 Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/49721a0af93a47d38613f4a588ab1e1a"}]}] Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 971f709818b74757947beafd14f546bf Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: exception: Security group b783c247-b37d-4004-bba7-453855f631fb does not exist Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: Neutron server returns request_ids: ['req-453ea6d6-8abf-450d-9d76-c81992b5f4eb'] Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'b783c247-b37d-4004-bba7-453855f631fb'} Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:55:55.470084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b783c247-b37d-4004-bba7-453855f631fb does not exist Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-453ea6d6-8abf-450d-9d76-c81992b5f4eb'] Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b783c247-b37d-4004-bba7-453855f631fb does not exist Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-453ea6d6-8abf-450d-9d76-c81992b5f4eb'] Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b783c247-b37d-4004-bba7-453855f631fb does not exist Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-453ea6d6-8abf-450d-9d76-c81992b5f4eb'] Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b783c247-b37d-4004-bba7-453855f631fb does not exist Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-453ea6d6-8abf-450d-9d76-c81992b5f4eb'] Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-59047eff-096e-400d-a808-96a5d5ea5de2 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Returning 404 to user: Security group b783c247-b37d-4004-bba7-453855f631fb does not exist Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: Neutron server returns request_ids: ['req-453ea6d6-8abf-450d-9d76-c81992b5f4eb'] {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-59047eff-096e-400d-a808-96a5d5ea5de2 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/b783c247-b37d-4004-bba7-453855f631fb" status: 404 len: 194 microversion: 2.1 time: 0.135244 Oct 29 02:55:55.473461 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 963/2147] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:55:55 2022] DELETE /compute/v2.1/os-security-groups/b783c247-b37d-4004-bba7-453855f631fb => generated 194 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:55:55.483679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b95a9f7e-0f97-49e2-99dd-677cbde76380 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '.version_select at 0x7ff05371a940>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:55.581048 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b468104f-9e51-4c16-9fc8-e9cfdf656230 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:55.593551 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b468104f-9e51-4c16-9fc8-e9cfdf656230 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878" status: 200 len: 1504 microversion: 2.1 time: 0.883172 Oct 29 02:55:55.597350 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1185/2148] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:54 2022] GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 => generated 1504 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:55.698082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG neutronclient.v2_0.client [None req-b95a9f7e-0f97-49e2-99dd-677cbde76380 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 58dbda33-dfee-4dbc-b17e-75a83fc45200 does not exist", "detail": ""}} {{(pid=127125) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:55:55.702205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.security_group_api [None req-b95a9f7e-0f97-49e2-99dd-677cbde76380 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Neutron security group 58dbda33-dfee-4dbc-b17e-75a83fc45200 not found {{(pid=127125) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 02:55:55.704458 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-b95a9f7e-0f97-49e2-99dd-677cbde76380 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] HTTP exception thrown: Security group 58dbda33-dfee-4dbc-b17e-75a83fc45200 does not exist Oct 29 02:55:55.704458 n-d-862967-2 devstack@n-api.service[127125]: Neutron server returns request_ids: ['req-d0671a8c-8f38-4d86-8d72-60e912996f0e'] Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b95a9f7e-0f97-49e2-99dd-677cbde76380 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Request method failure captured: Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/os-security-groups/58dbda33-dfee-4dbc-b17e-75a83fc45200 HTTP/1.1 Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJWyvWNGvIUONB2dldB7pPioEBwKHjHetza4K1fLTtjT_TQMaaZr4Sn7Ypy_ZhXjAwE7ry_UKafzclnlLHflyUJDtnmpn--08xUkjJ2-Rign0-fn1TZL2Hdqa5rKCy6QAStHGO-9e-pn1Lh_D4FvZ1sBFzju6OJDLJ_prG4_rU83xk8 Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/49721a0af93a47d38613f4a588ab1e1a"}]}] Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 971f709818b74757947beafd14f546bf Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: exception: Security group 58dbda33-dfee-4dbc-b17e-75a83fc45200 does not exist Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: Neutron server returns request_ids: ['req-d0671a8c-8f38-4d86-8d72-60e912996f0e'] Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '58dbda33-dfee-4dbc-b17e-75a83fc45200'} Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:55:55.708411 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 58dbda33-dfee-4dbc-b17e-75a83fc45200 does not exist Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0671a8c-8f38-4d86-8d72-60e912996f0e'] Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 58dbda33-dfee-4dbc-b17e-75a83fc45200 does not exist Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0671a8c-8f38-4d86-8d72-60e912996f0e'] Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 58dbda33-dfee-4dbc-b17e-75a83fc45200 does not exist Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0671a8c-8f38-4d86-8d72-60e912996f0e'] Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 58dbda33-dfee-4dbc-b17e-75a83fc45200 does not exist Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0671a8c-8f38-4d86-8d72-60e912996f0e'] Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b95a9f7e-0f97-49e2-99dd-677cbde76380 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Returning 404 to user: Security group 58dbda33-dfee-4dbc-b17e-75a83fc45200 does not exist Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: Neutron server returns request_ids: ['req-d0671a8c-8f38-4d86-8d72-60e912996f0e'] {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b95a9f7e-0f97-49e2-99dd-677cbde76380 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/58dbda33-dfee-4dbc-b17e-75a83fc45200" status: 404 len: 194 microversion: 2.1 time: 0.230413 Oct 29 02:55:55.712080 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 964/2149] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:55:55 2022] DELETE /compute/v2.1/os-security-groups/58dbda33-dfee-4dbc-b17e-75a83fc45200 => generated 194 bytes in 232 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:55:55.723183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a8dca7b4-7003-4077-9cea-34c48a9bc1db tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '.version_select at 0x7ff0539d1670>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:55.837120 n-d-862967-2 devstack@n-api.service[127124]: DEBUG neutronclient.v2_0.client [None req-a8dca7b4-7003-4077-9cea-34c48a9bc1db tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group efb97629-f4c4-4ee5-b421-bf54af2daf85 does not exist", "detail": ""}} {{(pid=127124) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:55:55.837827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.security_group_api [None req-a8dca7b4-7003-4077-9cea-34c48a9bc1db tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Neutron security group efb97629-f4c4-4ee5-b421-bf54af2daf85 not found {{(pid=127124) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 02:55:55.839139 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-a8dca7b4-7003-4077-9cea-34c48a9bc1db tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] HTTP exception thrown: Security group efb97629-f4c4-4ee5-b421-bf54af2daf85 does not exist Oct 29 02:55:55.839139 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-7450db4a-0bc3-4eb8-b4ea-99bc147e383f'] Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a8dca7b4-7003-4077-9cea-34c48a9bc1db tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Request method failure captured: Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/os-security-groups/efb97629-f4c4-4ee5-b421-bf54af2daf85 HTTP/1.1 Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJWyvWNGvIUONB2dldB7pPioEBwKHjHetza4K1fLTtjT_TQMaaZr4Sn7Ypy_ZhXjAwE7ry_UKafzclnlLHflyUJDtnmpn--08xUkjJ2-Rign0-fn1TZL2Hdqa5rKCy6QAStHGO-9e-pn1Lh_D4FvZ1sBFzju6OJDLJ_prG4_rU83xk8 Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/49721a0af93a47d38613f4a588ab1e1a"}]}] Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 971f709818b74757947beafd14f546bf Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: exception: Security group efb97629-f4c4-4ee5-b421-bf54af2daf85 does not exist Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-7450db4a-0bc3-4eb8-b4ea-99bc147e383f'] Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'efb97629-f4c4-4ee5-b421-bf54af2daf85'} Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:55:55.841282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group efb97629-f4c4-4ee5-b421-bf54af2daf85 does not exist Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7450db4a-0bc3-4eb8-b4ea-99bc147e383f'] Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group efb97629-f4c4-4ee5-b421-bf54af2daf85 does not exist Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7450db4a-0bc3-4eb8-b4ea-99bc147e383f'] Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group efb97629-f4c4-4ee5-b421-bf54af2daf85 does not exist Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7450db4a-0bc3-4eb8-b4ea-99bc147e383f'] Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group efb97629-f4c4-4ee5-b421-bf54af2daf85 does not exist Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7450db4a-0bc3-4eb8-b4ea-99bc147e383f'] Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a8dca7b4-7003-4077-9cea-34c48a9bc1db tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Returning 404 to user: Security group efb97629-f4c4-4ee5-b421-bf54af2daf85 does not exist Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-7450db4a-0bc3-4eb8-b4ea-99bc147e383f'] {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:55.846077 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a8dca7b4-7003-4077-9cea-34c48a9bc1db tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/efb97629-f4c4-4ee5-b421-bf54af2daf85" status: 404 len: 194 microversion: 2.1 time: 0.127110 Oct 29 02:55:55.851925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-45c387e6-6547-4c73-866e-99f544a1ab91 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '.version_select at 0x7ff053704700>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:55.854438 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1186/2150] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:55:55 2022] DELETE /compute/v2.1/os-security-groups/efb97629-f4c4-4ee5-b421-bf54af2daf85 => generated 194 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:55:56.021417 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=12 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:56.098068 n-d-862967-2 devstack@n-api.service[127125]: DEBUG neutronclient.v2_0.client [None req-45c387e6-6547-4c73-866e-99f544a1ab91 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dfb62021-dcda-4e71-b8ea-7fc9e928946b does not exist", "detail": ""}} {{(pid=127125) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:55:56.099121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.security_group_api [None req-45c387e6-6547-4c73-866e-99f544a1ab91 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Neutron security group dfb62021-dcda-4e71-b8ea-7fc9e928946b not found {{(pid=127125) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 02:55:56.100089 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-45c387e6-6547-4c73-866e-99f544a1ab91 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] HTTP exception thrown: Security group dfb62021-dcda-4e71-b8ea-7fc9e928946b does not exist Oct 29 02:55:56.100089 n-d-862967-2 devstack@n-api.service[127125]: Neutron server returns request_ids: ['req-003988ce-648d-4a6e-bb87-9198e1dce5d9'] Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-45c387e6-6547-4c73-866e-99f544a1ab91 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Request method failure captured: Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/os-security-groups/dfb62021-dcda-4e71-b8ea-7fc9e928946b HTTP/1.1 Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJWyvWNGvIUONB2dldB7pPioEBwKHjHetza4K1fLTtjT_TQMaaZr4Sn7Ypy_ZhXjAwE7ry_UKafzclnlLHflyUJDtnmpn--08xUkjJ2-Rign0-fn1TZL2Hdqa5rKCy6QAStHGO-9e-pn1Lh_D4FvZ1sBFzju6OJDLJ_prG4_rU83xk8 Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/49721a0af93a47d38613f4a588ab1e1a"}]}] Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 971f709818b74757947beafd14f546bf Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: exception: Security group dfb62021-dcda-4e71-b8ea-7fc9e928946b does not exist Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: Neutron server returns request_ids: ['req-003988ce-648d-4a6e-bb87-9198e1dce5d9'] Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'dfb62021-dcda-4e71-b8ea-7fc9e928946b'} Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:55:56.102424 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dfb62021-dcda-4e71-b8ea-7fc9e928946b does not exist Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-003988ce-648d-4a6e-bb87-9198e1dce5d9'] Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dfb62021-dcda-4e71-b8ea-7fc9e928946b does not exist Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-003988ce-648d-4a6e-bb87-9198e1dce5d9'] Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dfb62021-dcda-4e71-b8ea-7fc9e928946b does not exist Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-003988ce-648d-4a6e-bb87-9198e1dce5d9'] Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dfb62021-dcda-4e71-b8ea-7fc9e928946b does not exist Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-003988ce-648d-4a6e-bb87-9198e1dce5d9'] Oct 29 02:55:56.106636 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:56.113323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-45c387e6-6547-4c73-866e-99f544a1ab91 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Returning 404 to user: Security group dfb62021-dcda-4e71-b8ea-7fc9e928946b does not exist Oct 29 02:55:56.113323 n-d-862967-2 devstack@n-api.service[127125]: Neutron server returns request_ids: ['req-003988ce-648d-4a6e-bb87-9198e1dce5d9'] {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:56.114645 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-45c387e6-6547-4c73-866e-99f544a1ab91 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/dfb62021-dcda-4e71-b8ea-7fc9e928946b" status: 404 len: 194 microversion: 2.1 time: 0.266882 Oct 29 02:55:56.115514 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 965/2151] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:55:55 2022] DELETE /compute/v2.1/os-security-groups/dfb62021-dcda-4e71-b8ea-7fc9e928946b => generated 194 bytes in 268 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:55:56.125446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5242aafe-8d8b-4bac-a256-bf28a936ebb1 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '.version_select at 0x7ff053a7d280>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:56.329711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG neutronclient.v2_0.client [None req-5242aafe-8d8b-4bac-a256-bf28a936ebb1 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 63ad752a-20e0-4f25-91e6-fa7b8271ba9c does not exist", "detail": ""}} {{(pid=127124) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:55:56.330358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.security_group_api [None req-5242aafe-8d8b-4bac-a256-bf28a936ebb1 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Neutron security group 63ad752a-20e0-4f25-91e6-fa7b8271ba9c not found {{(pid=127124) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 02:55:56.330973 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-5242aafe-8d8b-4bac-a256-bf28a936ebb1 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] HTTP exception thrown: Security group 63ad752a-20e0-4f25-91e6-fa7b8271ba9c does not exist Oct 29 02:55:56.330973 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-b2155c1a-beb3-422e-8d8a-8bcf2e4fcb16'] Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5242aafe-8d8b-4bac-a256-bf28a936ebb1 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Request method failure captured: Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/os-security-groups/63ad752a-20e0-4f25-91e6-fa7b8271ba9c HTTP/1.1 Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJWyvWNGvIUONB2dldB7pPioEBwKHjHetza4K1fLTtjT_TQMaaZr4Sn7Ypy_ZhXjAwE7ry_UKafzclnlLHflyUJDtnmpn--08xUkjJ2-Rign0-fn1TZL2Hdqa5rKCy6QAStHGO-9e-pn1Lh_D4FvZ1sBFzju6OJDLJ_prG4_rU83xk8 Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/49721a0af93a47d38613f4a588ab1e1a"}]}] Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 971f709818b74757947beafd14f546bf Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: exception: Security group 63ad752a-20e0-4f25-91e6-fa7b8271ba9c does not exist Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-b2155c1a-beb3-422e-8d8a-8bcf2e4fcb16'] Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '63ad752a-20e0-4f25-91e6-fa7b8271ba9c'} Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:55:56.334052 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 63ad752a-20e0-4f25-91e6-fa7b8271ba9c does not exist Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b2155c1a-beb3-422e-8d8a-8bcf2e4fcb16'] Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 63ad752a-20e0-4f25-91e6-fa7b8271ba9c does not exist Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b2155c1a-beb3-422e-8d8a-8bcf2e4fcb16'] Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 63ad752a-20e0-4f25-91e6-fa7b8271ba9c does not exist Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b2155c1a-beb3-422e-8d8a-8bcf2e4fcb16'] Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 63ad752a-20e0-4f25-91e6-fa7b8271ba9c does not exist Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b2155c1a-beb3-422e-8d8a-8bcf2e4fcb16'] Oct 29 02:55:56.337574 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:55:56.341139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5242aafe-8d8b-4bac-a256-bf28a936ebb1 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Returning 404 to user: Security group 63ad752a-20e0-4f25-91e6-fa7b8271ba9c does not exist Oct 29 02:55:56.341139 n-d-862967-2 devstack@n-api.service[127124]: Neutron server returns request_ids: ['req-b2155c1a-beb3-422e-8d8a-8bcf2e4fcb16'] {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:56.342560 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5242aafe-8d8b-4bac-a256-bf28a936ebb1 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/63ad752a-20e0-4f25-91e6-fa7b8271ba9c" status: 404 len: 194 microversion: 2.1 time: 0.222786 Oct 29 02:55:56.344136 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1187/2152] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:55:56 2022] DELETE /compute/v2.1/os-security-groups/63ad752a-20e0-4f25-91e6-fa7b8271ba9c => generated 194 bytes in 225 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:55:56.353082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1714b0ad-8346-49b6-8081-d92284f7afad tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '.version_select at 0x7ff053812dc0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:56.541802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG neutronclient.v2_0.client [None req-1714b0ad-8346-49b6-8081-d92284f7afad tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8de0e040-dfd8-47d0-9ef9-578e91d01f6b does not exist", "detail": ""}} {{(pid=127125) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:55:56.542740 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.security_group_api [None req-1714b0ad-8346-49b6-8081-d92284f7afad tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Neutron security group 8de0e040-dfd8-47d0-9ef9-578e91d01f6b not found {{(pid=127125) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 29 02:55:56.543841 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-1714b0ad-8346-49b6-8081-d92284f7afad tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] HTTP exception thrown: Security group 8de0e040-dfd8-47d0-9ef9-578e91d01f6b does not exist Oct 29 02:55:56.543841 n-d-862967-2 devstack@n-api.service[127125]: Neutron server returns request_ids: ['req-20ab216b-445f-4f8c-8916-4bd9e65ab83d'] Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1714b0ad-8346-49b6-8081-d92284f7afad tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Request method failure captured: Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/os-security-groups/8de0e040-dfd8-47d0-9ef9-578e91d01f6b HTTP/1.1 Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJWyvWNGvIUONB2dldB7pPioEBwKHjHetza4K1fLTtjT_TQMaaZr4Sn7Ypy_ZhXjAwE7ry_UKafzclnlLHflyUJDtnmpn--08xUkjJ2-Rign0-fn1TZL2Hdqa5rKCy6QAStHGO-9e-pn1Lh_D4FvZ1sBFzju6OJDLJ_prG4_rU83xk8 Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/49721a0af93a47d38613f4a588ab1e1a"}]}] Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 971f709818b74757947beafd14f546bf Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: exception: Security group 8de0e040-dfd8-47d0-9ef9-578e91d01f6b does not exist Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: Neutron server returns request_ids: ['req-20ab216b-445f-4f8c-8916-4bd9e65ab83d'] Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '8de0e040-dfd8-47d0-9ef9-578e91d01f6b'} Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:55:56.546149 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8de0e040-dfd8-47d0-9ef9-578e91d01f6b does not exist Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-20ab216b-445f-4f8c-8916-4bd9e65ab83d'] Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8de0e040-dfd8-47d0-9ef9-578e91d01f6b does not exist Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-20ab216b-445f-4f8c-8916-4bd9e65ab83d'] Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8de0e040-dfd8-47d0-9ef9-578e91d01f6b does not exist Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-20ab216b-445f-4f8c-8916-4bd9e65ab83d'] Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8de0e040-dfd8-47d0-9ef9-578e91d01f6b does not exist Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-20ab216b-445f-4f8c-8916-4bd9e65ab83d'] Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1714b0ad-8346-49b6-8081-d92284f7afad tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Returning 404 to user: Security group 8de0e040-dfd8-47d0-9ef9-578e91d01f6b does not exist Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: Neutron server returns request_ids: ['req-20ab216b-445f-4f8c-8916-4bd9e65ab83d'] {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1714b0ad-8346-49b6-8081-d92284f7afad tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/8de0e040-dfd8-47d0-9ef9-578e91d01f6b" status: 404 len: 194 microversion: 2.1 time: 0.199682 Oct 29 02:55:56.549445 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 966/2153] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:55:56 2022] DELETE /compute/v2.1/os-security-groups/8de0e040-dfd8-47d0-9ef9-578e91d01f6b => generated 194 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:55:56.558881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5ea60eef-2ff7-4f56-873d-386052344313 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:56.559392 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5ea60eef-2ff7-4f56-873d-386052344313 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 2d032bdd-de0f-40dc-88c6-afc41eab6770] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:56.575821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ea60eef-2ff7-4f56-873d-386052344313 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:56.576325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ea60eef-2ff7-4f56-873d-386052344313 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:56.576799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ea60eef-2ff7-4f56-873d-386052344313 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:56.583608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ea60eef-2ff7-4f56-873d-386052344313 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:56.584262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ea60eef-2ff7-4f56-873d-386052344313 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:56.588110 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ea60eef-2ff7-4f56-873d-386052344313 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:56.623660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-18f0e26d-2a8c-4cfc-8724-be4cbe15c02e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:56.624578 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-18f0e26d-2a8c-4cfc-8724-be4cbe15c02e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:56.633578 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18f0e26d-2a8c-4cfc-8724-be4cbe15c02e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:56.636648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18f0e26d-2a8c-4cfc-8724-be4cbe15c02e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:56.639906 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18f0e26d-2a8c-4cfc-8724-be4cbe15c02e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:56.640893 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18f0e26d-2a8c-4cfc-8724-be4cbe15c02e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:56.641531 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18f0e26d-2a8c-4cfc-8724-be4cbe15c02e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:56.642099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18f0e26d-2a8c-4cfc-8724-be4cbe15c02e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:56.669350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5ea60eef-2ff7-4f56-873d-386052344313 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 2d032bdd-de0f-40dc-88c6-afc41eab6770] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:55:56.842214 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5ea60eef-2ff7-4f56-873d-386052344313 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770" status: 204 len: 0 microversion: 2.1 time: 0.287947 Oct 29 02:55:56.844206 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1188/2154] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:55:56 2022] DELETE /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:55:56.855808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-062048d5-8d29-41a7-a8ca-f59b4e0a2b88 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:56.857687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-062048d5-8d29-41a7-a8ca-f59b4e0a2b88 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 2d032bdd-de0f-40dc-88c6-afc41eab6770] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:56.868165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-062048d5-8d29-41a7-a8ca-f59b4e0a2b88 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:56.868985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-062048d5-8d29-41a7-a8ca-f59b4e0a2b88 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:56.870468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-062048d5-8d29-41a7-a8ca-f59b4e0a2b88 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:56.871853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-062048d5-8d29-41a7-a8ca-f59b4e0a2b88 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:56.872694 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-062048d5-8d29-41a7-a8ca-f59b4e0a2b88 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:56.873512 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-062048d5-8d29-41a7-a8ca-f59b4e0a2b88 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:57.122207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-18f0e26d-2a8c-4cfc-8724-be4cbe15c02e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:57.137802 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-18f0e26d-2a8c-4cfc-8724-be4cbe15c02e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878" status: 200 len: 1494 microversion: 2.1 time: 0.518201 Oct 29 02:55:57.144820 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 967/2155] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:56 2022] GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 => generated 1494 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:55:57.170169 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-835e47ad-fe52-4b27-ae8e-82095d3a4c1a tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Calling method '.version_select at 0x7ff0538129d0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:57.174271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-835e47ad-fe52-4b27-ae8e-82095d3a4c1a tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:57.177131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-835e47ad-fe52-4b27-ae8e-82095d3a4c1a tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:57.177826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-835e47ad-fe52-4b27-ae8e-82095d3a4c1a tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:57.192300 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-835e47ad-fe52-4b27-ae8e-82095d3a4c1a tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 398 microversion: 2.1 time: 0.026108 Oct 29 02:55:57.200100 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 968/2156] 10.222.0.46 () {58 vars in 1143 bytes} [Sat Oct 29 02:55:57 2022] GET /compute/v2.1/os-migrations => generated 398 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:55:57.214836 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c7cf2e23-aa28-449c-8b2b-9835e402205f tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:57.215543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c7cf2e23-aa28-449c-8b2b-9835e402205f tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:57.225906 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7cf2e23-aa28-449c-8b2b-9835e402205f tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:57.226874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7cf2e23-aa28-449c-8b2b-9835e402205f tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:57.227443 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7cf2e23-aa28-449c-8b2b-9835e402205f tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:57.228360 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7cf2e23-aa28-449c-8b2b-9835e402205f tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:57.229211 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7cf2e23-aa28-449c-8b2b-9835e402205f tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:57.230156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7cf2e23-aa28-449c-8b2b-9835e402205f tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:57.279731 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-062048d5-8d29-41a7-a8ca-f59b4e0a2b88 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971f709818b74757947beafd14f546bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49721a0af93a47d38613f4a588ab1e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:57.300285 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-062048d5-8d29-41a7-a8ca-f59b4e0a2b88 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770" status: 200 len: 1647 microversion: 2.1 time: 0.451471 Oct 29 02:55:57.301840 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1189/2157] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:56 2022] GET /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770 => generated 1647 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:57.621858 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c7cf2e23-aa28-449c-8b2b-9835e402205f tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878" status: 200 len: 1645 microversion: 2.1 time: 0.412865 Oct 29 02:55:57.628886 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 969/2158] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:57 2022] GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 => generated 1645 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:55:57.832314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5e197a69-44f2-4cfb-8528-c671eb7c2950 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1515887103", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "bca2d547-c353-4bb4-a9d9-94595c523fe6"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:57.961235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-5e197a69-44f2-4cfb-8528-c671eb7c2950 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] validate_networks() for [('bca2d547-c353-4bb4-a9d9-94595c523fe6', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:55:58.325150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3e305a40-9272-4dcb-b4b1-14f090bd7aae tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:55:58.326461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3e305a40-9272-4dcb-b4b1-14f090bd7aae tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 2d032bdd-de0f-40dc-88c6-afc41eab6770] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:55:58.334955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e305a40-9272-4dcb-b4b1-14f090bd7aae tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:58.335750 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e305a40-9272-4dcb-b4b1-14f090bd7aae tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:58.336394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e305a40-9272-4dcb-b4b1-14f090bd7aae tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:58.337403 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e305a40-9272-4dcb-b4b1-14f090bd7aae tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:55:58.338042 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e305a40-9272-4dcb-b4b1-14f090bd7aae tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:55:58.338713 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e305a40-9272-4dcb-b4b1-14f090bd7aae tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:55:59.171415 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3e305a40-9272-4dcb-b4b1-14f090bd7aae tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971f709818b74757947beafd14f546bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49721a0af93a47d38613f4a588ab1e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:55:59.185623 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3e305a40-9272-4dcb-b4b1-14f090bd7aae tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770" status: 200 len: 1647 microversion: 2.1 time: 0.860824 Oct 29 02:55:59.186610 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 970/2159] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:55:58 2022] GET /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770 => generated 1647 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:55:59.467620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-663c7c26-c3b2-4fd9-b9bf-580ae526fefd tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-144596747", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "98f2cc46-12b8-476e-8eb7-4a5880aa8557"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:55:59.586879 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-663c7c26-c3b2-4fd9-b9bf-580ae526fefd tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] validate_networks() for [('98f2cc46-12b8-476e-8eb7-4a5880aa8557', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:56:00.412067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-5e197a69-44f2-4cfb-8528-c671eb7c2950 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:56:00.413383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-5e197a69-44f2-4cfb-8528-c671eb7c2950 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:56:00.414088 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-5e197a69-44f2-4cfb-8528-c671eb7c2950 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:56:00.414891 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-5e197a69-44f2-4cfb-8528-c671eb7c2950 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:56:00.415783 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-5e197a69-44f2-4cfb-8528-c671eb7c2950 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:56:00.435342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e197a69-44f2-4cfb-8528-c671eb7c2950 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:00.438619 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e197a69-44f2-4cfb-8528-c671eb7c2950 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:00.439399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e197a69-44f2-4cfb-8528-c671eb7c2950 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:00.441693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e197a69-44f2-4cfb-8528-c671eb7c2950 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:00.444011 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e197a69-44f2-4cfb-8528-c671eb7c2950 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:00.445403 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e197a69-44f2-4cfb-8528-c671eb7c2950 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:00.502710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-5e197a69-44f2-4cfb-8528-c671eb7c2950 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Getting quotas for project cb1c877c178847ad8e652dda9a20e724. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:56:00.509854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-5e197a69-44f2-4cfb-8528-c671eb7c2950 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Getting quotas for user 68198185a8314417b2b5d09e831ff4fd and project cb1c877c178847ad8e652dda9a20e724. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:56:00.551825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5e197a69-44f2-4cfb-8528-c671eb7c2950 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:56:00.558446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5e197a69-44f2-4cfb-8528-c671eb7c2950 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:56:00.667460 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5e197a69-44f2-4cfb-8528-c671eb7c2950 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.839993 Oct 29 02:56:00.678846 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1190/2160] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:55:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:56:00.681338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-84b0feec-d13d-43b0-8d39-1750aa2dc0f6 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:00.686017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-84b0feec-d13d-43b0-8d39-1750aa2dc0f6 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 2d032bdd-de0f-40dc-88c6-afc41eab6770] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:00.700601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-84b0feec-d13d-43b0-8d39-1750aa2dc0f6 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:00.702697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-663c7c26-c3b2-4fd9-b9bf-580ae526fefd tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:56:00.703168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-84b0feec-d13d-43b0-8d39-1750aa2dc0f6 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:00.703263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-663c7c26-c3b2-4fd9-b9bf-580ae526fefd tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:56:00.703714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-663c7c26-c3b2-4fd9-b9bf-580ae526fefd tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:56:00.703819 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-84b0feec-d13d-43b0-8d39-1750aa2dc0f6 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:00.704120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-663c7c26-c3b2-4fd9-b9bf-580ae526fefd tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:56:00.704582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-663c7c26-c3b2-4fd9-b9bf-580ae526fefd tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:56:00.705859 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-84b0feec-d13d-43b0-8d39-1750aa2dc0f6 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:00.707542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-84b0feec-d13d-43b0-8d39-1750aa2dc0f6 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:00.709218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-84b0feec-d13d-43b0-8d39-1750aa2dc0f6 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:00.724055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-663c7c26-c3b2-4fd9-b9bf-580ae526fefd tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:00.724146 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-663c7c26-c3b2-4fd9-b9bf-580ae526fefd tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:00.724589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-663c7c26-c3b2-4fd9-b9bf-580ae526fefd tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:00.725384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-663c7c26-c3b2-4fd9-b9bf-580ae526fefd tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:00.728443 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-663c7c26-c3b2-4fd9-b9bf-580ae526fefd tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:00.730915 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-663c7c26-c3b2-4fd9-b9bf-580ae526fefd tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:00.783415 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-663c7c26-c3b2-4fd9-b9bf-580ae526fefd tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Getting quotas for project 123beb9d3a0d4ffca4f51fee4cb4bcf7. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:56:00.791537 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-663c7c26-c3b2-4fd9-b9bf-580ae526fefd tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Getting quotas for user 95968d63fb18444a98d303f0fe164b8a and project 123beb9d3a0d4ffca4f51fee4cb4bcf7. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:56:00.807184 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-663c7c26-c3b2-4fd9-b9bf-580ae526fefd tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:56:00.809816 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-663c7c26-c3b2-4fd9-b9bf-580ae526fefd tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] [instance: 01bf9f12-c87f-4056-a84e-47f00b9f30d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:56:00.921677 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-663c7c26-c3b2-4fd9-b9bf-580ae526fefd tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.708114 Oct 29 02:56:00.929738 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 971/2161] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:55:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:56:00.938080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-10dfb464-1523-4621-ac96-36e3f46d2310 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:00.940208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-10dfb464-1523-4621-ac96-36e3f46d2310 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:01.119410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-84b0feec-d13d-43b0-8d39-1750aa2dc0f6 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '971f709818b74757947beafd14f546bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49721a0af93a47d38613f4a588ab1e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:01.136446 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-84b0feec-d13d-43b0-8d39-1750aa2dc0f6 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770" status: 200 len: 1468 microversion: 2.1 time: 0.462073 Oct 29 02:56:01.137539 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1191/2162] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:00 2022] GET /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770 => generated 1468 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:01.186525 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2a4c59fc-942e-483b-b3b6-8d013f109630 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:01.187318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2a4c59fc-942e-483b-b3b6-8d013f109630 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] [instance: 01bf9f12-c87f-4056-a84e-47f00b9f30d4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:01.398761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-10dfb464-1523-4621-ac96-36e3f46d2310 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:01.411903 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-10dfb464-1523-4621-ac96-36e3f46d2310 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406" status: 200 len: 1211 microversion: 2.1 time: 0.474881 Oct 29 02:56:01.413274 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 972/2163] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:00 2022] GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 => generated 1211 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:01.459379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2a4c59fc-942e-483b-b3b6-8d013f109630 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95968d63fb18444a98d303f0fe164b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123beb9d3a0d4ffca4f51fee4cb4bcf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:01.473020 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2a4c59fc-942e-483b-b3b6-8d013f109630 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] 10.222.0.46 "GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4" status: 200 len: 1223 microversion: 2.1 time: 0.314141 Oct 29 02:56:01.475540 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1192/2164] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:01 2022] GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4 => generated 1223 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:01.629761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-7ad0bded-63c0-4a9d-bc95-03a23c2dedc4 req-ad79043b-73e4-4e37-866f-c30d1c02c36b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d032bdd-de0f-40dc-88c6-afc41eab6770", "name": "network-vif-deleted", "tag": "79d33b3a-675b-49b7-a4c4-807ba304e4d4"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:01.657604 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7ad0bded-63c0-4a9d-bc95-03a23c2dedc4 req-ad79043b-73e4-4e37-866f-c30d1c02c36b service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:01.661835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7ad0bded-63c0-4a9d-bc95-03a23c2dedc4 req-ad79043b-73e4-4e37-866f-c30d1c02c36b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:01.671405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7ad0bded-63c0-4a9d-bc95-03a23c2dedc4 req-ad79043b-73e4-4e37-866f-c30d1c02c36b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:01.739794 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-7ad0bded-63c0-4a9d-bc95-03a23c2dedc4 req-ad79043b-73e4-4e37-866f-c30d1c02c36b service nova] Creating event network-vif-deleted:79d33b3a-675b-49b7-a4c4-807ba304e4d4 for instance 2d032bdd-de0f-40dc-88c6-afc41eab6770 on n-h1-862967-2 Oct 29 02:56:01.755940 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-7ad0bded-63c0-4a9d-bc95-03a23c2dedc4 req-ad79043b-73e4-4e37-866f-c30d1c02c36b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.337292 Oct 29 02:56:01.759515 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 973/2165] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:02.164413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cf1dfded-95eb-444d-b973-bf268131798b tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:02.165359 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cf1dfded-95eb-444d-b973-bf268131798b tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] [instance: 2d032bdd-de0f-40dc-88c6-afc41eab6770] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:02.186101 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf1dfded-95eb-444d-b973-bf268131798b tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:02.187896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf1dfded-95eb-444d-b973-bf268131798b tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:02.189464 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf1dfded-95eb-444d-b973-bf268131798b tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:02.191499 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf1dfded-95eb-444d-b973-bf268131798b tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:02.193084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf1dfded-95eb-444d-b973-bf268131798b tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:02.194550 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf1dfded-95eb-444d-b973-bf268131798b tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:02.229908 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-cf1dfded-95eb-444d-b973-bf268131798b tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] HTTP exception thrown: Instance 2d032bdd-de0f-40dc-88c6-afc41eab6770 could not be found. Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cf1dfded-95eb-444d-b973-bf268131798b tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Request method failure captured: Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770 HTTP/1.1 Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJWyvWNGvIUONB2dldB7pPioEBwKHjHetza4K1fLTtjT_TQMaaZr4Sn7Ypy_ZhXjAwE7ry_UKafzclnlLHflyUJDtnmpn--08xUkjJ2-Rign0-fn1TZL2Hdqa5rKCy6QAStHGO-9e-pn1Lh_D4FvZ1sBFzju6OJDLJ_prG4_rU83xk8 Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_49721a0af93a47d38613f4a588ab1e1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/49721a0af93a47d38613f4a588ab1e1a"}]}] Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 49721a0af93a47d38613f4a588ab1e1a Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1278943166 Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 971f709818b74757947beafd14f546bf Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-SecurityGroupsTestJSON-1278943166-project Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 2d032bdd-de0f-40dc-88c6-afc41eab6770 could not be found. Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '2d032bdd-de0f-40dc-88c6-afc41eab6770'} Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d032bdd-de0f-40dc-88c6-afc41eab6770 could not be found. Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d032bdd-de0f-40dc-88c6-afc41eab6770 could not be found. Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:02.237077 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:56:02.241577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:02.241577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:02.241577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:02.241577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:56:02.241577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:56:02.241577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d032bdd-de0f-40dc-88c6-afc41eab6770 could not be found. Oct 29 02:56:02.241577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:56:02.241577 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cf1dfded-95eb-444d-b973-bf268131798b tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Returning 404 to user: Instance 2d032bdd-de0f-40dc-88c6-afc41eab6770 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:56:02.241577 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cf1dfded-95eb-444d-b973-bf268131798b tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "GET /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770" status: 404 len: 111 microversion: 2.1 time: 0.080882 Oct 29 02:56:02.242769 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1193/2166] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:02 2022] GET /compute/v2.1/servers/2d032bdd-de0f-40dc-88c6-afc41eab6770 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:56:02.250864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c0945c32-3458-4d65-a483-d806f0c60474 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '.version_select at 0x7ff053834dc0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:02.441604 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-31c8f602-a021-44ad-b2b3-19ef632f05d7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:02.442616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-31c8f602-a021-44ad-b2b3-19ef632f05d7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:02.455756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31c8f602-a021-44ad-b2b3-19ef632f05d7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:02.456252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31c8f602-a021-44ad-b2b3-19ef632f05d7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:02.459387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31c8f602-a021-44ad-b2b3-19ef632f05d7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:02.460505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31c8f602-a021-44ad-b2b3-19ef632f05d7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:02.460720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31c8f602-a021-44ad-b2b3-19ef632f05d7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:02.463168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31c8f602-a021-44ad-b2b3-19ef632f05d7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:02.615711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-31c8f602-a021-44ad-b2b3-19ef632f05d7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:02.649508 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-31c8f602-a021-44ad-b2b3-19ef632f05d7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406" status: 200 len: 1263 microversion: 2.1 time: 0.213549 Oct 29 02:56:02.663225 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1194/2167] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:02 2022] GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 => generated 1263 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:02.678093 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-38cfdfcd-96fa-4285-ba77-45b63ed1da79 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:02.679840 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-38cfdfcd-96fa-4285-ba77-45b63ed1da79 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] [instance: 01bf9f12-c87f-4056-a84e-47f00b9f30d4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:02.689480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38cfdfcd-96fa-4285-ba77-45b63ed1da79 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:02.690432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38cfdfcd-96fa-4285-ba77-45b63ed1da79 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:02.691301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38cfdfcd-96fa-4285-ba77-45b63ed1da79 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:02.692227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38cfdfcd-96fa-4285-ba77-45b63ed1da79 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:02.692889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38cfdfcd-96fa-4285-ba77-45b63ed1da79 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:02.695478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38cfdfcd-96fa-4285-ba77-45b63ed1da79 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:02.816910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-38cfdfcd-96fa-4285-ba77-45b63ed1da79 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95968d63fb18444a98d303f0fe164b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123beb9d3a0d4ffca4f51fee4cb4bcf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:02.829438 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-38cfdfcd-96fa-4285-ba77-45b63ed1da79 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] 10.222.0.46 "GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4" status: 200 len: 1219 microversion: 2.1 time: 0.163275 Oct 29 02:56:02.829767 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c0945c32-3458-4d65-a483-d806f0c60474 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/e183d567-92ac-4d25-a7d8-2671070de771" status: 202 len: 0 microversion: 2.1 time: 0.583365 Oct 29 02:56:02.831067 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1195/2168] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:02 2022] GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4 => generated 1219 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:02.833659 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 974/2169] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:56:02 2022] DELETE /compute/v2.1/os-security-groups/e183d567-92ac-4d25-a7d8-2671070de771 => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:56:02.844504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-df2e59a3-9543-44e3-8442-e664472ba8a0 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] Calling method '.version_select at 0x7ff058c9a310>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:03.681093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-96b54150-8016-40fa-9482-991425423f66 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:03.682404 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-96b54150-8016-40fa-9482-991425423f66 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:03.704051 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96b54150-8016-40fa-9482-991425423f66 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:03.704765 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96b54150-8016-40fa-9482-991425423f66 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:03.707488 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96b54150-8016-40fa-9482-991425423f66 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:03.716237 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96b54150-8016-40fa-9482-991425423f66 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:03.719556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96b54150-8016-40fa-9482-991425423f66 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:03.721160 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96b54150-8016-40fa-9482-991425423f66 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:03.997975 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-96b54150-8016-40fa-9482-991425423f66 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:04.022750 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-96b54150-8016-40fa-9482-991425423f66 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406" status: 200 len: 1269 microversion: 2.1 time: 0.347274 Oct 29 02:56:04.023281 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 975/2170] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:03 2022] GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 => generated 1269 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:04.045778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-32d5cc06-6ef3-4731-8729-b1439c890ee8 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:04.047483 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-32d5cc06-6ef3-4731-8729-b1439c890ee8 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] [instance: 01bf9f12-c87f-4056-a84e-47f00b9f30d4] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:04.054302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32d5cc06-6ef3-4731-8729-b1439c890ee8 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:04.054804 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32d5cc06-6ef3-4731-8729-b1439c890ee8 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:04.055248 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32d5cc06-6ef3-4731-8729-b1439c890ee8 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:04.055969 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32d5cc06-6ef3-4731-8729-b1439c890ee8 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:04.056424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32d5cc06-6ef3-4731-8729-b1439c890ee8 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:04.067429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32d5cc06-6ef3-4731-8729-b1439c890ee8 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:04.271240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-32d5cc06-6ef3-4731-8729-b1439c890ee8 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95968d63fb18444a98d303f0fe164b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123beb9d3a0d4ffca4f51fee4cb4bcf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:04.289851 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-32d5cc06-6ef3-4731-8729-b1439c890ee8 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] 10.222.0.46 "GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4" status: 200 len: 1281 microversion: 2.1 time: 0.248399 Oct 29 02:56:04.291028 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 976/2171] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:04 2022] GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4 => generated 1281 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:04.406468 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-df2e59a3-9543-44e3-8442-e664472ba8a0 tempest-SecurityGroupsTestJSON-1278943166 tempest-SecurityGroupsTestJSON-1278943166-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/46f36c25-d774-4eca-b1d4-ced212edf890" status: 202 len: 0 microversion: 2.1 time: 1.569924 Oct 29 02:56:04.410505 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1196/2172] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 02:56:02 2022] DELETE /compute/v2.1/os-security-groups/46f36c25-d774-4eca-b1d4-ced212edf890 => generated 0 bytes in 1571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:56:05.050363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-02aea40c-7b13-40b9-a26a-0992e81e5151 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:05.051002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-02aea40c-7b13-40b9-a26a-0992e81e5151 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:05.080713 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02aea40c-7b13-40b9-a26a-0992e81e5151 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:05.081431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02aea40c-7b13-40b9-a26a-0992e81e5151 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:05.082019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02aea40c-7b13-40b9-a26a-0992e81e5151 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:05.083080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02aea40c-7b13-40b9-a26a-0992e81e5151 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:05.083856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02aea40c-7b13-40b9-a26a-0992e81e5151 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:05.084425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02aea40c-7b13-40b9-a26a-0992e81e5151 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:05.318480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-48048302-4728-44e4-a1c2-591966a7bb99 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:05.319109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-48048302-4728-44e4-a1c2-591966a7bb99 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] [instance: 01bf9f12-c87f-4056-a84e-47f00b9f30d4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:05.341984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-48048302-4728-44e4-a1c2-591966a7bb99 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:05.342485 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-48048302-4728-44e4-a1c2-591966a7bb99 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:05.342929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-48048302-4728-44e4-a1c2-591966a7bb99 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:05.343645 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-48048302-4728-44e4-a1c2-591966a7bb99 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:05.344102 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-48048302-4728-44e4-a1c2-591966a7bb99 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:05.344540 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-48048302-4728-44e4-a1c2-591966a7bb99 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:05.661252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-48048302-4728-44e4-a1c2-591966a7bb99 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95968d63fb18444a98d303f0fe164b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123beb9d3a0d4ffca4f51fee4cb4bcf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:05.671462 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-48048302-4728-44e4-a1c2-591966a7bb99 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] 10.222.0.46 "GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4" status: 200 len: 1281 microversion: 2.1 time: 0.357684 Oct 29 02:56:05.672061 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1197/2173] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:05 2022] GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4 => generated 1281 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:06.314908 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-02aea40c-7b13-40b9-a26a-0992e81e5151 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:06.325006 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-02aea40c-7b13-40b9-a26a-0992e81e5151 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406" status: 200 len: 1311 microversion: 2.1 time: 1.278397 Oct 29 02:56:06.330356 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 977/2174] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:05 2022] GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 => generated 1311 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:06.695502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0a9f4060-37fb-4b7e-9d7c-a9dede478580 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:06.696123 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0a9f4060-37fb-4b7e-9d7c-a9dede478580 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] [instance: 01bf9f12-c87f-4056-a84e-47f00b9f30d4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:06.709498 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0a9f4060-37fb-4b7e-9d7c-a9dede478580 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:06.710402 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0a9f4060-37fb-4b7e-9d7c-a9dede478580 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:06.719853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0a9f4060-37fb-4b7e-9d7c-a9dede478580 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:06.722013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0a9f4060-37fb-4b7e-9d7c-a9dede478580 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:06.722705 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0a9f4060-37fb-4b7e-9d7c-a9dede478580 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:06.723593 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0a9f4060-37fb-4b7e-9d7c-a9dede478580 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:07.121788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0a9f4060-37fb-4b7e-9d7c-a9dede478580 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95968d63fb18444a98d303f0fe164b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123beb9d3a0d4ffca4f51fee4cb4bcf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:07.129989 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0a9f4060-37fb-4b7e-9d7c-a9dede478580 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] 10.222.0.46 "GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4" status: 200 len: 1323 microversion: 2.1 time: 0.438343 Oct 29 02:56:07.149143 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1198/2175] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:06 2022] GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4 => generated 1323 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:07.357538 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-84dcc1b7-1d01-4424-ac9c-99aaea48e0b7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:07.359593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-84dcc1b7-1d01-4424-ac9c-99aaea48e0b7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:07.368379 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-84dcc1b7-1d01-4424-ac9c-99aaea48e0b7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:07.369251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-84dcc1b7-1d01-4424-ac9c-99aaea48e0b7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:07.369923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-84dcc1b7-1d01-4424-ac9c-99aaea48e0b7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:07.371401 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-84dcc1b7-1d01-4424-ac9c-99aaea48e0b7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:07.372108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-84dcc1b7-1d01-4424-ac9c-99aaea48e0b7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:07.372748 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-84dcc1b7-1d01-4424-ac9c-99aaea48e0b7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:07.423221 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:07.511829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-f9408727-ec18-4a47-a8d7-6de24d06e35c req-704af0f3-e0b5-4022-a11c-c131aaf4af55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e6b1a61-b925-4274-bc43-1dfda057b406", "tag": "b6de9e1c-df45-4134-8fe2-03c9b87b0e66"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:07.563528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f9408727-ec18-4a47-a8d7-6de24d06e35c req-704af0f3-e0b5-4022-a11c-c131aaf4af55 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:07.565535 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f9408727-ec18-4a47-a8d7-6de24d06e35c req-704af0f3-e0b5-4022-a11c-c131aaf4af55 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:07.566555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f9408727-ec18-4a47-a8d7-6de24d06e35c req-704af0f3-e0b5-4022-a11c-c131aaf4af55 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:07.647135 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-f9408727-ec18-4a47-a8d7-6de24d06e35c req-704af0f3-e0b5-4022-a11c-c131aaf4af55 service nova] Creating event network-changed:b6de9e1c-df45-4134-8fe2-03c9b87b0e66 for instance 5e6b1a61-b925-4274-bc43-1dfda057b406 on n-h1-862967-2 Oct 29 02:56:07.670352 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-f9408727-ec18-4a47-a8d7-6de24d06e35c req-704af0f3-e0b5-4022-a11c-c131aaf4af55 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164247 Oct 29 02:56:07.673866 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1199/2176] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:08.082879 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-84dcc1b7-1d01-4424-ac9c-99aaea48e0b7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:08.095057 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-84dcc1b7-1d01-4424-ac9c-99aaea48e0b7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406" status: 200 len: 1311 microversion: 2.1 time: 0.743165 Oct 29 02:56:08.110933 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 978/2177] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:07 2022] GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 => generated 1311 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:08.159722 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-93c7e6ef-cbf9-4dd4-be8d-e88ed0c92627 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:08.161393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-93c7e6ef-cbf9-4dd4-be8d-e88ed0c92627 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] [instance: 01bf9f12-c87f-4056-a84e-47f00b9f30d4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:08.174486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93c7e6ef-cbf9-4dd4-be8d-e88ed0c92627 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:08.175947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93c7e6ef-cbf9-4dd4-be8d-e88ed0c92627 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:08.176733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93c7e6ef-cbf9-4dd4-be8d-e88ed0c92627 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:08.177699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93c7e6ef-cbf9-4dd4-be8d-e88ed0c92627 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:08.178487 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93c7e6ef-cbf9-4dd4-be8d-e88ed0c92627 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:08.179241 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93c7e6ef-cbf9-4dd4-be8d-e88ed0c92627 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:08.472959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-93c7e6ef-cbf9-4dd4-be8d-e88ed0c92627 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95968d63fb18444a98d303f0fe164b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123beb9d3a0d4ffca4f51fee4cb4bcf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:08.481487 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-93c7e6ef-cbf9-4dd4-be8d-e88ed0c92627 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] 10.222.0.46 "GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4" status: 200 len: 1323 microversion: 2.1 time: 0.326015 Oct 29 02:56:08.485775 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1200/2178] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:08 2022] GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4 => generated 1323 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:09.120292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e2245316-c47b-4568-89b3-64644034a626 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:09.120979 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e2245316-c47b-4568-89b3-64644034a626 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:09.135869 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2245316-c47b-4568-89b3-64644034a626 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:09.136652 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2245316-c47b-4568-89b3-64644034a626 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:09.137225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2245316-c47b-4568-89b3-64644034a626 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:09.142445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2245316-c47b-4568-89b3-64644034a626 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:09.143158 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2245316-c47b-4568-89b3-64644034a626 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:09.144427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2245316-c47b-4568-89b3-64644034a626 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:09.529523 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-02aa787e-9605-47ca-8f1b-e73fa4b3686a tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:09.530172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-02aa787e-9605-47ca-8f1b-e73fa4b3686a tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] [instance: 01bf9f12-c87f-4056-a84e-47f00b9f30d4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:09.548106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02aa787e-9605-47ca-8f1b-e73fa4b3686a tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:09.548946 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02aa787e-9605-47ca-8f1b-e73fa4b3686a tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:09.549554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02aa787e-9605-47ca-8f1b-e73fa4b3686a tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:09.550489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02aa787e-9605-47ca-8f1b-e73fa4b3686a tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:09.551110 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02aa787e-9605-47ca-8f1b-e73fa4b3686a tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:09.551693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02aa787e-9605-47ca-8f1b-e73fa4b3686a tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:10.118176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e2245316-c47b-4568-89b3-64644034a626 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:10.139130 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e2245316-c47b-4568-89b3-64644034a626 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406" status: 200 len: 1311 microversion: 2.1 time: 1.022713 Oct 29 02:56:10.170584 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 979/2179] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:09 2022] GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 => generated 1311 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:10.505226 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:10.544941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-02aa787e-9605-47ca-8f1b-e73fa4b3686a tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95968d63fb18444a98d303f0fe164b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123beb9d3a0d4ffca4f51fee4cb4bcf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:10.551410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:10.554012 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-02aa787e-9605-47ca-8f1b-e73fa4b3686a tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] 10.222.0.46 "GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4" status: 200 len: 1323 microversion: 2.1 time: 1.028570 Oct 29 02:56:10.555208 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1201/2180] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:09 2022] GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4 => generated 1323 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:10.851427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6f066f4c-36f2-49db-9fad-014abeeded82 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:10.852454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6f066f4c-36f2-49db-9fad-014abeeded82 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:10.866670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:10.869070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f066f4c-36f2-49db-9fad-014abeeded82 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:10.870191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f066f4c-36f2-49db-9fad-014abeeded82 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:10.870792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f066f4c-36f2-49db-9fad-014abeeded82 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:10.871656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f066f4c-36f2-49db-9fad-014abeeded82 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:10.872987 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f066f4c-36f2-49db-9fad-014abeeded82 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:10.873806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f066f4c-36f2-49db-9fad-014abeeded82 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:11.175336 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9810fcdd-35f6-43c6-9747-243297f5d0f1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:11.176766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9810fcdd-35f6-43c6-9747-243297f5d0f1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:11.187615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9810fcdd-35f6-43c6-9747-243297f5d0f1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:11.188733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9810fcdd-35f6-43c6-9747-243297f5d0f1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:11.189693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9810fcdd-35f6-43c6-9747-243297f5d0f1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:11.190935 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9810fcdd-35f6-43c6-9747-243297f5d0f1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:11.191746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9810fcdd-35f6-43c6-9747-243297f5d0f1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:11.192387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9810fcdd-35f6-43c6-9747-243297f5d0f1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:11.408963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=8 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:11.464600 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=34 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:11.478051 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9810fcdd-35f6-43c6-9747-243297f5d0f1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:11.489877 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9810fcdd-35f6-43c6-9747-243297f5d0f1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406" status: 200 len: 1311 microversion: 2.1 time: 0.320171 Oct 29 02:56:11.491350 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1202/2181] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:11 2022] GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 => generated 1311 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:11.578902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bed3d746-6add-491c-a24f-cf772499f568 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:11.582858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bed3d746-6add-491c-a24f-cf772499f568 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] [instance: 01bf9f12-c87f-4056-a84e-47f00b9f30d4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:11.607361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bed3d746-6add-491c-a24f-cf772499f568 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:11.608253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bed3d746-6add-491c-a24f-cf772499f568 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:11.610612 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bed3d746-6add-491c-a24f-cf772499f568 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:11.616974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bed3d746-6add-491c-a24f-cf772499f568 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:11.617965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bed3d746-6add-491c-a24f-cf772499f568 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:11.618583 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bed3d746-6add-491c-a24f-cf772499f568 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:11.828055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6f066f4c-36f2-49db-9fad-014abeeded82 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:11.861677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6f066f4c-36f2-49db-9fad-014abeeded82 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:11.867299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6f066f4c-36f2-49db-9fad-014abeeded82 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:11.870901 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6f066f4c-36f2-49db-9fad-014abeeded82 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 2953 microversion: 2.42 time: 1.024128 Oct 29 02:56:11.873935 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 980/2182] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:56:10 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 2953 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:56:11.902843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ccfd277f-7478-4984-a0ff-0242e0a97e49 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:11.903694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ccfd277f-7478-4984-a0ff-0242e0a97e49 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:11.914382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ccfd277f-7478-4984-a0ff-0242e0a97e49 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:11.915472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ccfd277f-7478-4984-a0ff-0242e0a97e49 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:11.917608 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ccfd277f-7478-4984-a0ff-0242e0a97e49 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:11.919127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bed3d746-6add-491c-a24f-cf772499f568 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95968d63fb18444a98d303f0fe164b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123beb9d3a0d4ffca4f51fee4cb4bcf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:11.919436 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ccfd277f-7478-4984-a0ff-0242e0a97e49 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:11.920578 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ccfd277f-7478-4984-a0ff-0242e0a97e49 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:11.921607 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ccfd277f-7478-4984-a0ff-0242e0a97e49 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:11.938390 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bed3d746-6add-491c-a24f-cf772499f568 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] 10.222.0.46 "GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4" status: 200 len: 1323 microversion: 2.1 time: 0.358937 Oct 29 02:56:11.940448 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1203/2183] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:11 2022] GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4 => generated 1323 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:12.335772 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ccfd277f-7478-4984-a0ff-0242e0a97e49 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.437021 Oct 29 02:56:12.354522 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 981/2184] 10.222.0.46 () {60 vars in 1316 bytes} [Sat Oct 29 02:56:11 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142/os-interface => generated 1829 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:56:12.518628 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6355415a-1e42-42ff-8092-5bca54a68ce0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:12.520504 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6355415a-1e42-42ff-8092-5bca54a68ce0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:12.536216 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6355415a-1e42-42ff-8092-5bca54a68ce0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:12.537168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6355415a-1e42-42ff-8092-5bca54a68ce0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:12.537818 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6355415a-1e42-42ff-8092-5bca54a68ce0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:12.538800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6355415a-1e42-42ff-8092-5bca54a68ce0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:12.539467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6355415a-1e42-42ff-8092-5bca54a68ce0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:12.540250 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6355415a-1e42-42ff-8092-5bca54a68ce0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:12.603167 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-2efb23bd-bc21-4703-b105-1f663450b8e6 req-129a396c-5cf6-49d6-8123-22ed94785f8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01bf9f12-c87f-4056-a84e-47f00b9f30d4", "tag": "cfa54a74-c354-4bed-89f1-8bbceeb1241f"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:12.633766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-2efb23bd-bc21-4703-b105-1f663450b8e6 req-129a396c-5cf6-49d6-8123-22ed94785f8f service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:12.642874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-2efb23bd-bc21-4703-b105-1f663450b8e6 req-129a396c-5cf6-49d6-8123-22ed94785f8f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:12.643558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-2efb23bd-bc21-4703-b105-1f663450b8e6 req-129a396c-5cf6-49d6-8123-22ed94785f8f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:12.666030 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-2efb23bd-bc21-4703-b105-1f663450b8e6 req-129a396c-5cf6-49d6-8123-22ed94785f8f service nova] Creating event network-changed:cfa54a74-c354-4bed-89f1-8bbceeb1241f for instance 01bf9f12-c87f-4056-a84e-47f00b9f30d4 on n-h1-862967-2 Oct 29 02:56:12.694247 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-2efb23bd-bc21-4703-b105-1f663450b8e6 req-129a396c-5cf6-49d6-8123-22ed94785f8f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.345725 Oct 29 02:56:12.698209 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1204/2185] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:12.967788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dc98e8a6-9d5b-4af9-9c09-ce3f03b76587 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:12.968904 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dc98e8a6-9d5b-4af9-9c09-ce3f03b76587 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] [instance: 01bf9f12-c87f-4056-a84e-47f00b9f30d4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:12.981483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc98e8a6-9d5b-4af9-9c09-ce3f03b76587 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:12.982282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc98e8a6-9d5b-4af9-9c09-ce3f03b76587 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:12.982913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc98e8a6-9d5b-4af9-9c09-ce3f03b76587 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:12.983806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc98e8a6-9d5b-4af9-9c09-ce3f03b76587 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:12.984419 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc98e8a6-9d5b-4af9-9c09-ce3f03b76587 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:12.985025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc98e8a6-9d5b-4af9-9c09-ce3f03b76587 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:13.013716 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6355415a-1e42-42ff-8092-5bca54a68ce0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:13.045671 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6355415a-1e42-42ff-8092-5bca54a68ce0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406" status: 200 len: 1311 microversion: 2.1 time: 0.531945 Oct 29 02:56:13.046451 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 982/2186] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:12 2022] GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 => generated 1311 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:13.412826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dc98e8a6-9d5b-4af9-9c09-ce3f03b76587 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95968d63fb18444a98d303f0fe164b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123beb9d3a0d4ffca4f51fee4cb4bcf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:13.429831 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dc98e8a6-9d5b-4af9-9c09-ce3f03b76587 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] 10.222.0.46 "GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4" status: 200 len: 1323 microversion: 2.1 time: 0.462228 Oct 29 02:56:13.431191 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1205/2187] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:12 2022] GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4 => generated 1323 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:14.071024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d38133e1-4c9d-4988-83a2-26993cc1b610 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:14.071781 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d38133e1-4c9d-4988-83a2-26993cc1b610 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:14.087103 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d38133e1-4c9d-4988-83a2-26993cc1b610 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:14.087831 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d38133e1-4c9d-4988-83a2-26993cc1b610 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:14.088481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d38133e1-4c9d-4988-83a2-26993cc1b610 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:14.089570 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d38133e1-4c9d-4988-83a2-26993cc1b610 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:14.090284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d38133e1-4c9d-4988-83a2-26993cc1b610 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:14.090914 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d38133e1-4c9d-4988-83a2-26993cc1b610 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:14.215092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7e6e8690-09e9-4172-ace0-10331d266b5a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-322412035", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "7f99e4be-cbcb-4834-96c2-e8888447d097"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:14.343289 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-7e6e8690-09e9-4172-ace0-10331d266b5a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] validate_networks() for [('7f99e4be-cbcb-4834-96c2-e8888447d097', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:56:14.505123 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d38133e1-4c9d-4988-83a2-26993cc1b610 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:14.520284 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d38133e1-4c9d-4988-83a2-26993cc1b610 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406" status: 200 len: 1311 microversion: 2.1 time: 0.452422 Oct 29 02:56:14.526125 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 983/2188] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:14 2022] GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 => generated 1311 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:14.531954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-117c7b64-34c6-4fdb-82e3-ef9491998a7d tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:14.535465 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-117c7b64-34c6-4fdb-82e3-ef9491998a7d tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] [instance: 01bf9f12-c87f-4056-a84e-47f00b9f30d4] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:14.551757 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-117c7b64-34c6-4fdb-82e3-ef9491998a7d tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:14.552451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-117c7b64-34c6-4fdb-82e3-ef9491998a7d tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:14.554147 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-117c7b64-34c6-4fdb-82e3-ef9491998a7d tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:14.556245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-117c7b64-34c6-4fdb-82e3-ef9491998a7d tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:14.556962 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-117c7b64-34c6-4fdb-82e3-ef9491998a7d tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:14.558429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-117c7b64-34c6-4fdb-82e3-ef9491998a7d tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:15.239356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-117c7b64-34c6-4fdb-82e3-ef9491998a7d tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95968d63fb18444a98d303f0fe164b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123beb9d3a0d4ffca4f51fee4cb4bcf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:15.253793 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-117c7b64-34c6-4fdb-82e3-ef9491998a7d tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] 10.222.0.46 "GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4" status: 200 len: 1323 microversion: 2.1 time: 0.725038 Oct 29 02:56:15.254787 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 984/2189] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:14 2022] GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4 => generated 1323 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:15.549865 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5c08ec89-3e8d-42e2-891a-efcf90c422f6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:15.550506 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5c08ec89-3e8d-42e2-891a-efcf90c422f6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:15.562582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c08ec89-3e8d-42e2-891a-efcf90c422f6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:15.563488 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c08ec89-3e8d-42e2-891a-efcf90c422f6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:15.563488 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c08ec89-3e8d-42e2-891a-efcf90c422f6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:15.565671 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c08ec89-3e8d-42e2-891a-efcf90c422f6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:15.566332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c08ec89-3e8d-42e2-891a-efcf90c422f6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:15.566927 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c08ec89-3e8d-42e2-891a-efcf90c422f6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:16.323630 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-7e6e8690-09e9-4172-ace0-10331d266b5a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:56:16.324720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-7e6e8690-09e9-4172-ace0-10331d266b5a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:56:16.325317 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-7e6e8690-09e9-4172-ace0-10331d266b5a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:56:16.325767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-7e6e8690-09e9-4172-ace0-10331d266b5a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:56:16.326203 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-7e6e8690-09e9-4172-ace0-10331d266b5a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:56:16.368025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e6e8690-09e9-4172-ace0-10331d266b5a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:16.377395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e6e8690-09e9-4172-ace0-10331d266b5a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:16.378031 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e6e8690-09e9-4172-ace0-10331d266b5a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:16.378883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e6e8690-09e9-4172-ace0-10331d266b5a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:16.379364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e6e8690-09e9-4172-ace0-10331d266b5a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:16.379798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e6e8690-09e9-4172-ace0-10331d266b5a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:16.444602 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-7e6e8690-09e9-4172-ace0-10331d266b5a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Getting quotas for project dae7f63d25fd42f0a2805df87595ff5f. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:56:16.463086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-7e6e8690-09e9-4172-ace0-10331d266b5a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Getting quotas for user a412bb38fb11498d9dd4a6ce6a63370d and project dae7f63d25fd42f0a2805df87595ff5f. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:56:16.479715 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:16.505338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7e6e8690-09e9-4172-ace0-10331d266b5a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:56:16.508847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7e6e8690-09e9-4172-ace0-10331d266b5a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:56:16.634357 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7e6e8690-09e9-4172-ace0-10331d266b5a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.521809 Oct 29 02:56:16.637638 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1206/2190] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:56:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:56:16.652145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b0b00e68-acd1-43ca-9986-1919c2c4c76e tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:16.654078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b0b00e68-acd1-43ca-9986-1919c2c4c76e tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] [instance: 01bf9f12-c87f-4056-a84e-47f00b9f30d4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:16.666570 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0b00e68-acd1-43ca-9986-1919c2c4c76e tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:16.667811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0b00e68-acd1-43ca-9986-1919c2c4c76e tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:16.669114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0b00e68-acd1-43ca-9986-1919c2c4c76e tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:16.670679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0b00e68-acd1-43ca-9986-1919c2c4c76e tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:16.672341 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0b00e68-acd1-43ca-9986-1919c2c4c76e tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:16.673215 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0b00e68-acd1-43ca-9986-1919c2c4c76e tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:16.733490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5c08ec89-3e8d-42e2-891a-efcf90c422f6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:16.741690 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5c08ec89-3e8d-42e2-891a-efcf90c422f6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406" status: 200 len: 1311 microversion: 2.1 time: 1.197159 Oct 29 02:56:16.751003 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 985/2191] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:15 2022] GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 => generated 1311 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:16.758595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6a152d01-3c28-486d-9d4d-68e64a12aacd tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:16.759228 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6a152d01-3c28-486d-9d4d-68e64a12aacd tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:16.927355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6a152d01-3c28-486d-9d4d-68e64a12aacd tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:16.938366 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6a152d01-3c28-486d-9d4d-68e64a12aacd tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1217 microversion: 2.1 time: 0.185671 Oct 29 02:56:16.938980 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 986/2192] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:16 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1217 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:17.095634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b0b00e68-acd1-43ca-9986-1919c2c4c76e tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95968d63fb18444a98d303f0fe164b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123beb9d3a0d4ffca4f51fee4cb4bcf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:17.116540 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b0b00e68-acd1-43ca-9986-1919c2c4c76e tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] 10.222.0.46 "GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4" status: 200 len: 1323 microversion: 2.1 time: 0.475646 Oct 29 02:56:17.119351 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1207/2193] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:16 2022] GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4 => generated 1323 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:17.778225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fae9194a-19cf-49d8-8651-6eb0ae0dd4d8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:17.778854 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fae9194a-19cf-49d8-8651-6eb0ae0dd4d8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:17.864784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fae9194a-19cf-49d8-8651-6eb0ae0dd4d8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:17.865876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fae9194a-19cf-49d8-8651-6eb0ae0dd4d8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:17.868749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fae9194a-19cf-49d8-8651-6eb0ae0dd4d8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:17.872486 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fae9194a-19cf-49d8-8651-6eb0ae0dd4d8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:17.873332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fae9194a-19cf-49d8-8651-6eb0ae0dd4d8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:17.873998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fae9194a-19cf-49d8-8651-6eb0ae0dd4d8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:17.981965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9aa077c3-0169-49f4-b5c1-d1809dc1afef tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:17.982597 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9aa077c3-0169-49f4-b5c1-d1809dc1afef tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:18.014183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9aa077c3-0169-49f4-b5c1-d1809dc1afef tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:18.016150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9aa077c3-0169-49f4-b5c1-d1809dc1afef tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:18.031344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9aa077c3-0169-49f4-b5c1-d1809dc1afef tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:18.034270 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9aa077c3-0169-49f4-b5c1-d1809dc1afef tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:18.038282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9aa077c3-0169-49f4-b5c1-d1809dc1afef tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:18.039141 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9aa077c3-0169-49f4-b5c1-d1809dc1afef tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:18.511922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9aa077c3-0169-49f4-b5c1-d1809dc1afef tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:18.523848 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9aa077c3-0169-49f4-b5c1-d1809dc1afef tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1213 microversion: 2.1 time: 0.549690 Oct 29 02:56:18.526573 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1208/2194] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:17 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1213 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:18.545360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-71cb1da6-e1b1-4ef7-9622-1f7f56102803 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:18.545947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-71cb1da6-e1b1-4ef7-9622-1f7f56102803 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] [instance: 01bf9f12-c87f-4056-a84e-47f00b9f30d4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:18.555695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-71cb1da6-e1b1-4ef7-9622-1f7f56102803 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:18.556200 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-71cb1da6-e1b1-4ef7-9622-1f7f56102803 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:18.556700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-71cb1da6-e1b1-4ef7-9622-1f7f56102803 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:18.557447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-71cb1da6-e1b1-4ef7-9622-1f7f56102803 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:18.560719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-71cb1da6-e1b1-4ef7-9622-1f7f56102803 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:18.561191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-71cb1da6-e1b1-4ef7-9622-1f7f56102803 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:18.684358 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fae9194a-19cf-49d8-8651-6eb0ae0dd4d8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:18.703647 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fae9194a-19cf-49d8-8651-6eb0ae0dd4d8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406" status: 200 len: 1311 microversion: 2.1 time: 0.931107 Oct 29 02:56:18.704260 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 987/2195] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:17 2022] GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 => generated 1311 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:18.744546 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-44fb8ff8-a0e6-49ed-877a-32238dade80b req-0b1dc38a-90aa-4416-8851-dc0c2ec53861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e6b1a61-b925-4274-bc43-1dfda057b406", "name": "network-vif-plugged", "status": "completed", "tag": "b6de9e1c-df45-4134-8fe2-03c9b87b0e66"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:18.763131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:18.765407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-44fb8ff8-a0e6-49ed-877a-32238dade80b req-0b1dc38a-90aa-4416-8851-dc0c2ec53861 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:18.766106 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-44fb8ff8-a0e6-49ed-877a-32238dade80b req-0b1dc38a-90aa-4416-8851-dc0c2ec53861 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:18.766706 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-44fb8ff8-a0e6-49ed-877a-32238dade80b req-0b1dc38a-90aa-4416-8851-dc0c2ec53861 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:18.790918 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-44fb8ff8-a0e6-49ed-877a-32238dade80b req-0b1dc38a-90aa-4416-8851-dc0c2ec53861 service nova] Creating event network-vif-plugged:b6de9e1c-df45-4134-8fe2-03c9b87b0e66 for instance 5e6b1a61-b925-4274-bc43-1dfda057b406 on n-h1-862967-2 Oct 29 02:56:18.799428 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-44fb8ff8-a0e6-49ed-877a-32238dade80b req-0b1dc38a-90aa-4416-8851-dc0c2ec53861 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063248 Oct 29 02:56:18.802760 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 988/2196] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:18.986225 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-71cb1da6-e1b1-4ef7-9622-1f7f56102803 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95968d63fb18444a98d303f0fe164b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123beb9d3a0d4ffca4f51fee4cb4bcf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:19.005180 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-71cb1da6-e1b1-4ef7-9622-1f7f56102803 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] 10.222.0.46 "GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4" status: 200 len: 1323 microversion: 2.1 time: 0.475922 Oct 29 02:56:19.020955 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1209/2197] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:18 2022] GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4 => generated 1323 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:19.385661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8511a6ed-8468-4119-87c9-e310ffe00ffc tempest-FloatingIPsNegativeTestJSON-1904702853 tempest-FloatingIPsNegativeTestJSON-1904702853-project] Calling method '.version_select at 0x7ff053812670>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:19.511684 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8511a6ed-8468-4119-87c9-e310ffe00ffc tempest-FloatingIPsNegativeTestJSON-1904702853 tempest-FloatingIPsNegativeTestJSON-1904702853-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.345776 Oct 29 02:56:19.512330 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 989/2198] 10.222.0.46 () {58 vars in 1149 bytes} [Sat Oct 29 02:56:19 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:56:19.528090 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-105f30e8-53bd-46de-a8da-3b68873e871e tempest-FloatingIPsNegativeTestJSON-1904702853 tempest-FloatingIPsNegativeTestJSON-1904702853-project] Action: 'create', calling method: .version_select at 0x7ff053a530d0>, body: {"pool": "non_exist_pool"} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:19.547681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-088ec814-f9f0-4709-8da8-c27cdbbdbe73 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:19.548425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-088ec814-f9f0-4709-8da8-c27cdbbdbe73 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:19.570411 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-088ec814-f9f0-4709-8da8-c27cdbbdbe73 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:19.570913 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-088ec814-f9f0-4709-8da8-c27cdbbdbe73 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:19.571354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-088ec814-f9f0-4709-8da8-c27cdbbdbe73 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:19.572448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-088ec814-f9f0-4709-8da8-c27cdbbdbe73 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:19.572947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-088ec814-f9f0-4709-8da8-c27cdbbdbe73 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:19.573383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-088ec814-f9f0-4709-8da8-c27cdbbdbe73 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:19.577048 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-105f30e8-53bd-46de-a8da-3b68873e871e tempest-FloatingIPsNegativeTestJSON-1904702853 tempest-FloatingIPsNegativeTestJSON-1904702853-project] HTTP exception thrown: Floating IP pool not found. Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-105f30e8-53bd-46de-a8da-3b68873e871e tempest-FloatingIPsNegativeTestJSON-1904702853 tempest-FloatingIPsNegativeTestJSON-1904702853-project] Request method failure captured: Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 26 Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJZSxCseuRfHkhbYEqw7tOCNQiTK_J2YZxdIVW3gxKVOGmZXmRy9dFn3b87lLBYncrAi-QUlzQQmNdZ_IALD19tY2NC0eh69RiKKTefpmGD2afyfxgRTVYjkj2w2ZgrgFktZiD7HafjEPumldMkatc_76tiNr05K63HcGhFT0a-VYao Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 01f81fbea6a14a8e9a1b8d755a643634 Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1904702853 Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/01f81fbea6a14a8e9a1b8d755a643634"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/01f81fbea6a14a8e9a1b8d755a643634"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_01f81fbea6a14a8e9a1b8d755a643634"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/01f81fbea6a14a8e9a1b8d755a643634"}]}] Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1904702853 Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 01f81fbea6a14a8e9a1b8d755a643634 Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1904702853 Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-FloatingIPsNegativeTestJSON-1904702853-project Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 89ac750f15f6470c9c96f744dbf4daff Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1904702853-project Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: {"pool": "non_exist_pool"} Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: exception: Floating IP pool not found. Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:56:19.579503 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:56:19.583837 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 29 02:56:19.583837 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:56:19.584871 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-105f30e8-53bd-46de-a8da-3b68873e871e tempest-FloatingIPsNegativeTestJSON-1904702853 tempest-FloatingIPsNegativeTestJSON-1904702853-project] Returning 404 to user: Floating IP pool not found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:56:19.585953 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-105f30e8-53bd-46de-a8da-3b68873e871e tempest-FloatingIPsNegativeTestJSON-1904702853 tempest-FloatingIPsNegativeTestJSON-1904702853-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.063108 Oct 29 02:56:19.592751 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1210/2199] 10.222.0.46 () {60 vars in 1170 bytes} [Sat Oct 29 02:56:19 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:56:19.600900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-61c5cf7f-43c8-4000-9230-917da11a1d63 tempest-FloatingIPsNegativeTestJSON-1904702853 tempest-FloatingIPsNegativeTestJSON-1904702853-project] Calling method '.version_select at 0x7ff053a501f0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:19.661496 n-d-862967-2 devstack@n-api.service[127124]: DEBUG neutronclient.v2_0.client [None req-61c5cf7f-43c8-4000-9230-917da11a1d63 tempest-FloatingIPsNegativeTestJSON-1904702853 tempest-FloatingIPsNegativeTestJSON-1904702853-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 348f0ac8-bc6e-4522-9fda-580ad11bf816 could not be found", "detail": ""}} {{(pid=127124) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:56:19.662472 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-61c5cf7f-43c8-4000-9230-917da11a1d63 tempest-FloatingIPsNegativeTestJSON-1904702853 tempest-FloatingIPsNegativeTestJSON-1904702853-project] HTTP exception thrown: Floating IP not found for ID 348f0ac8-bc6e-4522-9fda-580ad11bf816 Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-61c5cf7f-43c8-4000-9230-917da11a1d63 tempest-FloatingIPsNegativeTestJSON-1904702853 tempest-FloatingIPsNegativeTestJSON-1904702853-project] Request method failure captured: Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/os-floating-ips/348f0ac8-bc6e-4522-9fda-580ad11bf816 HTTP/1.1 Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJZSxCseuRfHkhbYEqw7tOCNQiTK_J2YZxdIVW3gxKVOGmZXmRy9dFn3b87lLBYncrAi-QUlzQQmNdZ_IALD19tY2NC0eh69RiKKTefpmGD2afyfxgRTVYjkj2w2ZgrgFktZiD7HafjEPumldMkatc_76tiNr05K63HcGhFT0a-VYao Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 01f81fbea6a14a8e9a1b8d755a643634 Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1904702853 Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/01f81fbea6a14a8e9a1b8d755a643634"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/01f81fbea6a14a8e9a1b8d755a643634"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_01f81fbea6a14a8e9a1b8d755a643634"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/01f81fbea6a14a8e9a1b8d755a643634"}]}] Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1904702853 Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 01f81fbea6a14a8e9a1b8d755a643634 Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1904702853 Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-FloatingIPsNegativeTestJSON-1904702853-project Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 89ac750f15f6470c9c96f744dbf4daff Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1904702853-project Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: exception: Floating IP not found for ID 348f0ac8-bc6e-4522-9fda-580ad11bf816 Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '348f0ac8-bc6e-4522-9fda-580ad11bf816'} Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 348f0ac8-bc6e-4522-9fda-580ad11bf816 could not be found Oct 29 02:56:19.672303 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2394086f-7689-4513-bc45-f0ee677bfd68'] Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 348f0ac8-bc6e-4522-9fda-580ad11bf816. Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 348f0ac8-bc6e-4522-9fda-580ad11bf816 Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 348f0ac8-bc6e-4522-9fda-580ad11bf816 Oct 29 02:56:19.678744 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:56:19.683768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-61c5cf7f-43c8-4000-9230-917da11a1d63 tempest-FloatingIPsNegativeTestJSON-1904702853 tempest-FloatingIPsNegativeTestJSON-1904702853-project] Returning 404 to user: Floating IP not found for ID 348f0ac8-bc6e-4522-9fda-580ad11bf816 {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:56:19.685506 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-61c5cf7f-43c8-4000-9230-917da11a1d63 tempest-FloatingIPsNegativeTestJSON-1904702853 tempest-FloatingIPsNegativeTestJSON-1904702853-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/348f0ac8-bc6e-4522-9fda-580ad11bf816" status: 404 len: 111 microversion: 2.1 time: 0.090873 Oct 29 02:56:19.691255 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1211/2200] 10.222.0.46 () {58 vars in 1263 bytes} [Sat Oct 29 02:56:19 2022] DELETE /compute/v2.1/os-floating-ips/348f0ac8-bc6e-4522-9fda-580ad11bf816 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:56:19.732121 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6bd00a7f-dfba-45c9-bef5-333da49ad726 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:19.732919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6bd00a7f-dfba-45c9-bef5-333da49ad726 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:19.745371 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6bd00a7f-dfba-45c9-bef5-333da49ad726 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:19.746246 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6bd00a7f-dfba-45c9-bef5-333da49ad726 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:19.751509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6bd00a7f-dfba-45c9-bef5-333da49ad726 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:19.752590 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6bd00a7f-dfba-45c9-bef5-333da49ad726 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:19.753377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6bd00a7f-dfba-45c9-bef5-333da49ad726 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:19.753972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6bd00a7f-dfba-45c9-bef5-333da49ad726 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:19.833311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-088ec814-f9f0-4709-8da8-c27cdbbdbe73 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:19.850609 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-088ec814-f9f0-4709-8da8-c27cdbbdbe73 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1275 microversion: 2.1 time: 0.306610 Oct 29 02:56:19.852664 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 990/2201] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:19 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1275 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:20.033627 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-98bbf0be-81d7-4b3f-9afa-3b688aa71735 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:20.035448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-98bbf0be-81d7-4b3f-9afa-3b688aa71735 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] [instance: 01bf9f12-c87f-4056-a84e-47f00b9f30d4] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:20.050767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98bbf0be-81d7-4b3f-9afa-3b688aa71735 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:20.052968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98bbf0be-81d7-4b3f-9afa-3b688aa71735 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:20.056950 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98bbf0be-81d7-4b3f-9afa-3b688aa71735 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:20.058280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98bbf0be-81d7-4b3f-9afa-3b688aa71735 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:20.059352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98bbf0be-81d7-4b3f-9afa-3b688aa71735 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:20.061434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98bbf0be-81d7-4b3f-9afa-3b688aa71735 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:20.129361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6bd00a7f-dfba-45c9-bef5-333da49ad726 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:20.159268 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6bd00a7f-dfba-45c9-bef5-333da49ad726 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406" status: 200 len: 1311 microversion: 2.1 time: 0.430091 Oct 29 02:56:20.194020 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1212/2202] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:19 2022] GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 => generated 1311 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:20.431971 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-98bbf0be-81d7-4b3f-9afa-3b688aa71735 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95968d63fb18444a98d303f0fe164b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123beb9d3a0d4ffca4f51fee4cb4bcf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:20.490038 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-98bbf0be-81d7-4b3f-9afa-3b688aa71735 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] 10.222.0.46 "GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4" status: 200 len: 1323 microversion: 2.1 time: 0.462249 Oct 29 02:56:20.491243 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 991/2203] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:20 2022] GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4 => generated 1323 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:20.874943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-46ce1593-264a-42cb-9b15-d42162884208 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:20.875965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-46ce1593-264a-42cb-9b15-d42162884208 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:20.898339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46ce1593-264a-42cb-9b15-d42162884208 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:20.898862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46ce1593-264a-42cb-9b15-d42162884208 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:20.899307 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46ce1593-264a-42cb-9b15-d42162884208 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:20.904248 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46ce1593-264a-42cb-9b15-d42162884208 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:20.904936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46ce1593-264a-42cb-9b15-d42162884208 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:20.905366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46ce1593-264a-42cb-9b15-d42162884208 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:21.111820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-46ce1593-264a-42cb-9b15-d42162884208 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:21.124274 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-46ce1593-264a-42cb-9b15-d42162884208 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1275 microversion: 2.1 time: 0.253180 Oct 29 02:56:21.148931 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1213/2204] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:20 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1275 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:21.204956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fad9fcfb-16b4-440d-947c-774774761ed3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:21.205752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fad9fcfb-16b4-440d-947c-774774761ed3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:21.231027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fad9fcfb-16b4-440d-947c-774774761ed3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:21.233533 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fad9fcfb-16b4-440d-947c-774774761ed3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:21.237254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fad9fcfb-16b4-440d-947c-774774761ed3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:21.238199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fad9fcfb-16b4-440d-947c-774774761ed3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:21.243069 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fad9fcfb-16b4-440d-947c-774774761ed3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:21.244642 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fad9fcfb-16b4-440d-947c-774774761ed3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:21.518113 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d87ce157-536f-40f8-bdca-6245c56efb24 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:21.519108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d87ce157-536f-40f8-bdca-6245c56efb24 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] [instance: 01bf9f12-c87f-4056-a84e-47f00b9f30d4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:21.528249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d87ce157-536f-40f8-bdca-6245c56efb24 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:21.528801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d87ce157-536f-40f8-bdca-6245c56efb24 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:21.529352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d87ce157-536f-40f8-bdca-6245c56efb24 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:21.549369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d87ce157-536f-40f8-bdca-6245c56efb24 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:21.552305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d87ce157-536f-40f8-bdca-6245c56efb24 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:21.552741 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d87ce157-536f-40f8-bdca-6245c56efb24 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:21.941483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d87ce157-536f-40f8-bdca-6245c56efb24 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95968d63fb18444a98d303f0fe164b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123beb9d3a0d4ffca4f51fee4cb4bcf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:21.953111 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d87ce157-536f-40f8-bdca-6245c56efb24 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] 10.222.0.46 "GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4" status: 200 len: 1323 microversion: 2.1 time: 0.439297 Oct 29 02:56:21.956206 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1214/2205] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:21 2022] GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4 => generated 1323 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:22.151855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-46323bee-cc63-42d4-af23-4004b782c96c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:22.153654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-46323bee-cc63-42d4-af23-4004b782c96c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:22.165651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46323bee-cc63-42d4-af23-4004b782c96c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:22.166568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46323bee-cc63-42d4-af23-4004b782c96c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:22.167240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46323bee-cc63-42d4-af23-4004b782c96c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:22.169310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46323bee-cc63-42d4-af23-4004b782c96c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:22.172487 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46323bee-cc63-42d4-af23-4004b782c96c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:22.178828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46323bee-cc63-42d4-af23-4004b782c96c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:22.444951 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fad9fcfb-16b4-440d-947c-774774761ed3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:22.456244 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-46323bee-cc63-42d4-af23-4004b782c96c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:22.465248 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fad9fcfb-16b4-440d-947c-774774761ed3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406" status: 200 len: 1494 microversion: 2.1 time: 1.264080 Oct 29 02:56:22.467172 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 992/2206] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:21 2022] GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 => generated 1494 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:22.472199 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-46323bee-cc63-42d4-af23-4004b782c96c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1317 microversion: 2.1 time: 0.324219 Oct 29 02:56:22.488569 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1215/2207] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:22 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:22.494289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ae110cc0-7d1a-446d-9401-49bf41018b3b tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:22.495173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ae110cc0-7d1a-446d-9401-49bf41018b3b tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:22.506854 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae110cc0-7d1a-446d-9401-49bf41018b3b tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:22.508253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae110cc0-7d1a-446d-9401-49bf41018b3b tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:22.508975 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae110cc0-7d1a-446d-9401-49bf41018b3b tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:22.510769 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae110cc0-7d1a-446d-9401-49bf41018b3b tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:22.511485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae110cc0-7d1a-446d-9401-49bf41018b3b tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:22.512343 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae110cc0-7d1a-446d-9401-49bf41018b3b tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:22.944963 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ae110cc0-7d1a-446d-9401-49bf41018b3b tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406" status: 200 len: 1645 microversion: 2.1 time: 0.453990 Oct 29 02:56:22.949089 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 993/2208] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:22 2022] GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 => generated 1645 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:22.957511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-b80af584-40a8-409b-b0ca-6b24bfb638bf req-d5a7ed3d-e33b-4213-9f44-7bb7389bf52e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01bf9f12-c87f-4056-a84e-47f00b9f30d4", "name": "network-vif-plugged", "status": "completed", "tag": "cfa54a74-c354-4bed-89f1-8bbceeb1241f"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:22.983773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-016cbff2-026d-47e1-bb99-a644fb6d4de5 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:22.985016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-016cbff2-026d-47e1-bb99-a644fb6d4de5 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:22.994583 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b80af584-40a8-409b-b0ca-6b24bfb638bf req-d5a7ed3d-e33b-4213-9f44-7bb7389bf52e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:22.995480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b80af584-40a8-409b-b0ca-6b24bfb638bf req-d5a7ed3d-e33b-4213-9f44-7bb7389bf52e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:22.996331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b80af584-40a8-409b-b0ca-6b24bfb638bf req-d5a7ed3d-e33b-4213-9f44-7bb7389bf52e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:22.999156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-016cbff2-026d-47e1-bb99-a644fb6d4de5 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:22.999649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-016cbff2-026d-47e1-bb99-a644fb6d4de5 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:23.000086 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-016cbff2-026d-47e1-bb99-a644fb6d4de5 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:23.000851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-016cbff2-026d-47e1-bb99-a644fb6d4de5 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:23.005713 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-016cbff2-026d-47e1-bb99-a644fb6d4de5 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:23.009583 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-016cbff2-026d-47e1-bb99-a644fb6d4de5 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:23.038463 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-b80af584-40a8-409b-b0ca-6b24bfb638bf req-d5a7ed3d-e33b-4213-9f44-7bb7389bf52e service nova] Creating event network-vif-plugged:cfa54a74-c354-4bed-89f1-8bbceeb1241f for instance 01bf9f12-c87f-4056-a84e-47f00b9f30d4 on n-h1-862967-2 Oct 29 02:56:23.088329 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-b80af584-40a8-409b-b0ca-6b24bfb638bf req-d5a7ed3d-e33b-4213-9f44-7bb7389bf52e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135330 Oct 29 02:56:23.101905 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1216/2209] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:23.127350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f9d671d6-791c-4f21-903c-24ba230481ca tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:23.128082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f9d671d6-791c-4f21-903c-24ba230481ca tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] [instance: 01bf9f12-c87f-4056-a84e-47f00b9f30d4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:23.154299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9d671d6-791c-4f21-903c-24ba230481ca tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:23.154935 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9d671d6-791c-4f21-903c-24ba230481ca tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:23.155248 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9d671d6-791c-4f21-903c-24ba230481ca tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:23.156264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9d671d6-791c-4f21-903c-24ba230481ca tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:23.156762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9d671d6-791c-4f21-903c-24ba230481ca tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:23.157197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9d671d6-791c-4f21-903c-24ba230481ca tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:23.675900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f9d671d6-791c-4f21-903c-24ba230481ca tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95968d63fb18444a98d303f0fe164b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123beb9d3a0d4ffca4f51fee4cb4bcf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:23.687045 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f9d671d6-791c-4f21-903c-24ba230481ca tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] 10.222.0.46 "GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4" status: 200 len: 1323 microversion: 2.1 time: 0.583569 Oct 29 02:56:23.701138 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1217/2210] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:23 2022] GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4 => generated 1323 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:23.979380 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-47f8c8b9-d49e-43c1-a940-96d3f0007c70 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-743406339", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "6a22f1bf-9a27-4375-9469-db16defea274"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:24.047487 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-016cbff2-026d-47e1-bb99-a644fb6d4de5 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406" status: 200 len: 1645 microversion: 2.1 time: 1.071388 Oct 29 02:56:24.051015 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 994/2211] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:22 2022] GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 => generated 1645 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:24.059003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-47f8c8b9-d49e-43c1-a940-96d3f0007c70 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] validate_networks() for [('6a22f1bf-9a27-4375-9469-db16defea274', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:56:24.060942 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-41f1fd6e-4fff-4f08-aeea-302b31aa09af tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:24.061983 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-41f1fd6e-4fff-4f08-aeea-302b31aa09af tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:24.073274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41f1fd6e-4fff-4f08-aeea-302b31aa09af tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:24.074241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41f1fd6e-4fff-4f08-aeea-302b31aa09af tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:24.079121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41f1fd6e-4fff-4f08-aeea-302b31aa09af tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:24.081490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41f1fd6e-4fff-4f08-aeea-302b31aa09af tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:24.081982 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41f1fd6e-4fff-4f08-aeea-302b31aa09af tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:24.082412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41f1fd6e-4fff-4f08-aeea-302b31aa09af tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:24.413963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-41f1fd6e-4fff-4f08-aeea-302b31aa09af tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:24.422783 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-41f1fd6e-4fff-4f08-aeea-302b31aa09af tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1317 microversion: 2.1 time: 0.369770 Oct 29 02:56:24.446709 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 995/2212] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:24 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:24.459864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fa162ada-df57-4acb-8f12-ac6b26f0f19d tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:24.465047 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa162ada-df57-4acb-8f12-ac6b26f0f19d tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:24.469304 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa162ada-df57-4acb-8f12-ac6b26f0f19d tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:24.469758 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa162ada-df57-4acb-8f12-ac6b26f0f19d tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:24.470575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa162ada-df57-4acb-8f12-ac6b26f0f19d tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:24.477788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa162ada-df57-4acb-8f12-ac6b26f0f19d tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:24.478512 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa162ada-df57-4acb-8f12-ac6b26f0f19d tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:24.537734 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fa162ada-df57-4acb-8f12-ac6b26f0f19d tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.088908 Oct 29 02:56:24.538371 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 996/2213] 10.222.0.46 () {58 vars in 1176 bytes} [Sat Oct 29 02:56:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:24.550922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c494f7b4-bb27-450d-9b03-a3546c760c7f tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:24.551834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c494f7b4-bb27-450d-9b03-a3546c760c7f tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:24.574547 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c494f7b4-bb27-450d-9b03-a3546c760c7f tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:24.575048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c494f7b4-bb27-450d-9b03-a3546c760c7f tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:24.575495 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c494f7b4-bb27-450d-9b03-a3546c760c7f tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:24.576225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c494f7b4-bb27-450d-9b03-a3546c760c7f tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:24.576694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c494f7b4-bb27-450d-9b03-a3546c760c7f tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:24.577113 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c494f7b4-bb27-450d-9b03-a3546c760c7f tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:24.708570 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:24.733520 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c494f7b4-bb27-450d-9b03-a3546c760c7f tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406/action" status: 202 len: 0 microversion: 2.1 time: 0.185938 Oct 29 02:56:24.734459 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 997/2214] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:56:24 2022] POST /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 02:56:24.743092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7fde765c-4bdc-4ecb-b54d-4f07531ce747 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:24.744274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7fde765c-4bdc-4ecb-b54d-4f07531ce747 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] [instance: 01bf9f12-c87f-4056-a84e-47f00b9f30d4] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:24.773772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fde765c-4bdc-4ecb-b54d-4f07531ce747 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:24.774452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fde765c-4bdc-4ecb-b54d-4f07531ce747 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:24.775132 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fde765c-4bdc-4ecb-b54d-4f07531ce747 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:24.775861 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fde765c-4bdc-4ecb-b54d-4f07531ce747 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:24.776318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fde765c-4bdc-4ecb-b54d-4f07531ce747 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:24.776782 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fde765c-4bdc-4ecb-b54d-4f07531ce747 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:25.153290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7fde765c-4bdc-4ecb-b54d-4f07531ce747 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95968d63fb18444a98d303f0fe164b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123beb9d3a0d4ffca4f51fee4cb4bcf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:25.165890 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7fde765c-4bdc-4ecb-b54d-4f07531ce747 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] 10.222.0.46 "GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4" status: 200 len: 1323 microversion: 2.1 time: 0.429808 Oct 29 02:56:25.190047 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 998/2215] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:24 2022] GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4 => generated 1323 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:25.194951 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2e43bd5a-6419-43f7-bc99-4f7f1956430f tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:25.195576 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2e43bd5a-6419-43f7-bc99-4f7f1956430f tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:25.201952 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e43bd5a-6419-43f7-bc99-4f7f1956430f tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:25.202705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e43bd5a-6419-43f7-bc99-4f7f1956430f tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:25.203397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e43bd5a-6419-43f7-bc99-4f7f1956430f tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:25.204300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e43bd5a-6419-43f7-bc99-4f7f1956430f tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:25.204962 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e43bd5a-6419-43f7-bc99-4f7f1956430f tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:25.205533 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e43bd5a-6419-43f7-bc99-4f7f1956430f tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:25.472721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-47f8c8b9-d49e-43c1-a940-96d3f0007c70 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:56:25.474085 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-47f8c8b9-d49e-43c1-a940-96d3f0007c70 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:56:25.474791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-47f8c8b9-d49e-43c1-a940-96d3f0007c70 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:56:25.475426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-47f8c8b9-d49e-43c1-a940-96d3f0007c70 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:56:25.475758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-47f8c8b9-d49e-43c1-a940-96d3f0007c70 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:56:25.506644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47f8c8b9-d49e-43c1-a940-96d3f0007c70 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:25.507593 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47f8c8b9-d49e-43c1-a940-96d3f0007c70 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:25.508339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47f8c8b9-d49e-43c1-a940-96d3f0007c70 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:25.510754 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2e43bd5a-6419-43f7-bc99-4f7f1956430f tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406" status: 200 len: 1630 microversion: 2.1 time: 0.318883 Oct 29 02:56:25.511482 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 999/2216] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:25 2022] GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 => generated 1630 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:25.511885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47f8c8b9-d49e-43c1-a940-96d3f0007c70 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:25.512679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47f8c8b9-d49e-43c1-a940-96d3f0007c70 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:25.513328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47f8c8b9-d49e-43c1-a940-96d3f0007c70 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:25.527068 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-26eaa445-6fa4-4486-a6df-a9c24b7988f9 req-b9226727-f55f-4f8c-a188-d82e3e20386a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c352884d-b0ee-4a54-bc72-41e39eb0839f", "tag": "a022a789-20a6-47d7-9b60-c4ab6361d88b"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:25.551277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-47f8c8b9-d49e-43c1-a940-96d3f0007c70 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Getting quotas for project fab9e02a4cb341348f0611afa2293cd0. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:56:25.557755 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-26eaa445-6fa4-4486-a6df-a9c24b7988f9 req-b9226727-f55f-4f8c-a188-d82e3e20386a service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:25.558487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-26eaa445-6fa4-4486-a6df-a9c24b7988f9 req-b9226727-f55f-4f8c-a188-d82e3e20386a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:25.559128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-26eaa445-6fa4-4486-a6df-a9c24b7988f9 req-b9226727-f55f-4f8c-a188-d82e3e20386a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:25.562992 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-47f8c8b9-d49e-43c1-a940-96d3f0007c70 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Getting quotas for user 3507c0ada3424029805469182f328379 and project fab9e02a4cb341348f0611afa2293cd0. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:56:25.588403 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-26eaa445-6fa4-4486-a6df-a9c24b7988f9 req-b9226727-f55f-4f8c-a188-d82e3e20386a service nova] Creating event network-changed:a022a789-20a6-47d7-9b60-c4ab6361d88b for instance c352884d-b0ee-4a54-bc72-41e39eb0839f on n-h2-862967-2 Oct 29 02:56:25.598495 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-26eaa445-6fa4-4486-a6df-a9c24b7988f9 req-b9226727-f55f-4f8c-a188-d82e3e20386a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084888 Oct 29 02:56:25.599677 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1000/2217] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:25.600386 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-47f8c8b9-d49e-43c1-a940-96d3f0007c70 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:56:25.604587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-47f8c8b9-d49e-43c1-a940-96d3f0007c70 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:56:25.611257 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8a1ec4c4-32d1-4489-9129-648647f26003 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:25.611978 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8a1ec4c4-32d1-4489-9129-648647f26003 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:25.626898 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a1ec4c4-32d1-4489-9129-648647f26003 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:25.627583 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a1ec4c4-32d1-4489-9129-648647f26003 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:25.628245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a1ec4c4-32d1-4489-9129-648647f26003 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:25.629060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a1ec4c4-32d1-4489-9129-648647f26003 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:25.629522 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a1ec4c4-32d1-4489-9129-648647f26003 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:25.629958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a1ec4c4-32d1-4489-9129-648647f26003 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:25.699964 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-47f8c8b9-d49e-43c1-a940-96d3f0007c70 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.008109 Oct 29 02:56:25.712069 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1218/2218] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:56:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:56:25.722037 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7676ce7e-d2b3-435e-979c-4e9bb4b11971 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862967-2", "block_migration": true, "disk_over_commit": false}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:25.732910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7676ce7e-d2b3-435e-979c-4e9bb4b11971 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:25.744760 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7676ce7e-d2b3-435e-979c-4e9bb4b11971 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:25.745942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7676ce7e-d2b3-435e-979c-4e9bb4b11971 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:25.746741 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7676ce7e-d2b3-435e-979c-4e9bb4b11971 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:25.747957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7676ce7e-d2b3-435e-979c-4e9bb4b11971 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:25.749561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7676ce7e-d2b3-435e-979c-4e9bb4b11971 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:25.750488 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7676ce7e-d2b3-435e-979c-4e9bb4b11971 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:25.796625 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-7676ce7e-d2b3-435e-979c-4e9bb4b11971 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lazy-loading 'flavor' on Instance uuid 5e6b1a61-b925-4274-bc43-1dfda057b406 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:56:25.820816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7676ce7e-d2b3-435e-979c-4e9bb4b11971 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Going to try to live migrate instance to n-h2-862967-2 {{(pid=127124) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 02:56:25.993358 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8a1ec4c4-32d1-4489-9129-648647f26003 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:26.015261 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8a1ec4c4-32d1-4489-9129-648647f26003 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1317 microversion: 2.1 time: 0.411849 Oct 29 02:56:26.016841 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1001/2219] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:25 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1317 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:26.035135 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a5e7b18b-ca89-4dbe-9d25-b8ecfd53f5bb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:26.035882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a5e7b18b-ca89-4dbe-9d25-b8ecfd53f5bb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:26.221615 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a5e7b18b-ca89-4dbe-9d25-b8ecfd53f5bb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:26.236825 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a5e7b18b-ca89-4dbe-9d25-b8ecfd53f5bb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1216 microversion: 2.1 time: 0.217928 Oct 29 02:56:26.268650 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1002/2220] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:26 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1216 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:26.281656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3bb2578e-ba30-42a0-8f9e-6928baf9cecc tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:26.283722 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3bb2578e-ba30-42a0-8f9e-6928baf9cecc tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] [instance: 01bf9f12-c87f-4056-a84e-47f00b9f30d4] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:26.302460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bb2578e-ba30-42a0-8f9e-6928baf9cecc tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:26.303358 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bb2578e-ba30-42a0-8f9e-6928baf9cecc tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:26.304155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bb2578e-ba30-42a0-8f9e-6928baf9cecc tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:26.305349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bb2578e-ba30-42a0-8f9e-6928baf9cecc tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:26.308044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bb2578e-ba30-42a0-8f9e-6928baf9cecc tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:26.309680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bb2578e-ba30-42a0-8f9e-6928baf9cecc tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:26.567485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3bb2578e-ba30-42a0-8f9e-6928baf9cecc tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95968d63fb18444a98d303f0fe164b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123beb9d3a0d4ffca4f51fee4cb4bcf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:26.586721 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3bb2578e-ba30-42a0-8f9e-6928baf9cecc tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] 10.222.0.46 "GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4" status: 200 len: 1520 microversion: 2.1 time: 0.311097 Oct 29 02:56:26.587718 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1003/2221] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:26 2022] GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4 => generated 1520 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:26.962928 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-46538db2-4069-442d-b718-719f7498025e tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2078576632", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "98f2cc46-12b8-476e-8eb7-4a5880aa8557"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-46538db2-4069-442d-b718-719f7498025e tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Request method failure captured: Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 243 Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJY-FgSv_Xsm3jQA3LhQ9367-114jkOUNqkMw4F05bLWpHAp7o-mHOgtr1vJZHhIqGRxAva8Ty00E6h5jV2C5KfzqxXrf9F-TJfmrEznAJx_kYoeciAoC4mQoJCEh6M6zMNYybXeOMEIBhGcB-gK_iPdOJ0MuaMowlc4i8BTLgn_yuM Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 123beb9d3a0d4ffca4f51fee4cb4bcf7 Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1205813730 Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}] Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1205813730 Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 123beb9d3a0d4ffca4f51fee4cb4bcf7 Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1205813730 Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerMetadataNegativeTestJSON-1205813730-project Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 95968d63fb18444a98d303f0fe164b8a Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1205813730-project Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2078576632", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "98f2cc46-12b8-476e-8eb7-4a5880aa8557"}]}} Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2078576632', 'imageRef': 'cd315600-df67-41c1-95d3-95a5145fc39a', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '98f2cc46-12b8-476e-8eb7-4a5880aa8557'}]}}} Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:56:26.973108 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:56:26.977648 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:56:26.977648 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:56:26.977648 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:56:26.977648 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:56:26.977648 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:56:26.977648 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:56:26.977648 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:56:26.977648 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:56:26.977648 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:26.977648 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:26.977648 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:26.977648 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:26.977648 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:26.977648 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:26.977648 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:56:26.977648 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:56:26.977648 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:56:26.977648 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:26.979562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-46538db2-4069-442d-b718-719f7498025e tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:56:26.985401 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-46538db2-4069-442d-b718-719f7498025e tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.026730 Oct 29 02:56:26.988331 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1004/2222] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:56:26 2022] POST /compute/v2.1/servers => generated 175 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:56:27.004299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4133c916-ebd8-4cc2-a918-a8bcb6c7ffb0 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:27.005113 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4133c916-ebd8-4cc2-a918-a8bcb6c7ffb0 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] [instance: ee54056f-88aa-4d18-b0ca-09cc54fc8356] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:27.015877 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-4133c916-ebd8-4cc2-a918-a8bcb6c7ffb0 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] HTTP exception thrown: Instance ee54056f-88aa-4d18-b0ca-09cc54fc8356 could not be found. Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4133c916-ebd8-4cc2-a918-a8bcb6c7ffb0 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Request method failure captured: Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/ee54056f-88aa-4d18-b0ca-09cc54fc8356/metadata HTTP/1.1 Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJY-FgSv_Xsm3jQA3LhQ9367-114jkOUNqkMw4F05bLWpHAp7o-mHOgtr1vJZHhIqGRxAva8Ty00E6h5jV2C5KfzqxXrf9F-TJfmrEznAJx_kYoeciAoC4mQoJCEh6M6zMNYybXeOMEIBhGcB-gK_iPdOJ0MuaMowlc4i8BTLgn_yuM Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 123beb9d3a0d4ffca4f51fee4cb4bcf7 Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1205813730 Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}] Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1205813730 Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 123beb9d3a0d4ffca4f51fee4cb4bcf7 Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1205813730 Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerMetadataNegativeTestJSON-1205813730-project Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 95968d63fb18444a98d303f0fe164b8a Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1205813730-project Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance ee54056f-88aa-4d18-b0ca-09cc54fc8356 could not be found. Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'server_id': 'ee54056f-88aa-4d18-b0ca-09cc54fc8356'} Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee54056f-88aa-4d18-b0ca-09cc54fc8356 could not be found. Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee54056f-88aa-4d18-b0ca-09cc54fc8356 could not be found. Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:27.026071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:27.030477 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:56:27.030477 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:56:27.030477 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee54056f-88aa-4d18-b0ca-09cc54fc8356 could not be found. Oct 29 02:56:27.030477 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:27.030477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4133c916-ebd8-4cc2-a918-a8bcb6c7ffb0 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Returning 404 to user: Instance ee54056f-88aa-4d18-b0ca-09cc54fc8356 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:56:27.030477 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4133c916-ebd8-4cc2-a918-a8bcb6c7ffb0 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] 10.222.0.46 "GET /compute/v2.1/servers/ee54056f-88aa-4d18-b0ca-09cc54fc8356/metadata" status: 404 len: 111 microversion: 2.1 time: 0.027812 Oct 29 02:56:27.043004 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1005/2223] 10.222.0.46 () {58 vars in 1263 bytes} [Sat Oct 29 02:56:26 2022] GET /compute/v2.1/servers/ee54056f-88aa-4d18-b0ca-09cc54fc8356/metadata => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:56:27.079583 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d7909ff3-d3bf-4442-b4b8-403dd77b984c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:27.080213 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d7909ff3-d3bf-4442-b4b8-403dd77b984c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:27.087526 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d7909ff3-d3bf-4442-b4b8-403dd77b984c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:27.089474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d7909ff3-d3bf-4442-b4b8-403dd77b984c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:27.090021 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d7909ff3-d3bf-4442-b4b8-403dd77b984c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:27.090961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d7909ff3-d3bf-4442-b4b8-403dd77b984c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:27.091831 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d7909ff3-d3bf-4442-b4b8-403dd77b984c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:27.092787 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d7909ff3-d3bf-4442-b4b8-403dd77b984c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:27.567498 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d7909ff3-d3bf-4442-b4b8-403dd77b984c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:27.595565 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d7909ff3-d3bf-4442-b4b8-403dd77b984c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1317 microversion: 2.1 time: 0.550878 Oct 29 02:56:27.602069 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1006/2224] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:27 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1317 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:27.611163 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-de11130f-9a18-4db3-b725-c2c18373b4cd tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1052291566", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "98f2cc46-12b8-476e-8eb7-4a5880aa8557"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-de11130f-9a18-4db3-b725-c2c18373b4cd tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Request method failure captured: Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 499 Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJY-FgSv_Xsm3jQA3LhQ9367-114jkOUNqkMw4F05bLWpHAp7o-mHOgtr1vJZHhIqGRxAva8Ty00E6h5jV2C5KfzqxXrf9F-TJfmrEznAJx_kYoeciAoC4mQoJCEh6M6zMNYybXeOMEIBhGcB-gK_iPdOJ0MuaMowlc4i8BTLgn_yuM Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 123beb9d3a0d4ffca4f51fee4cb4bcf7 Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1205813730 Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}] Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1205813730 Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 123beb9d3a0d4ffca4f51fee4cb4bcf7 Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1205813730 Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerMetadataNegativeTestJSON-1205813730-project Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 95968d63fb18444a98d303f0fe164b8a Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1205813730-project Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1052291566", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "98f2cc46-12b8-476e-8eb7-4a5880aa8557"}]}} Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1052291566', 'imageRef': 'cd315600-df67-41c1-95d3-95a5145fc39a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '98f2cc46-12b8-476e-8eb7-4a5880aa8557'}]}}} Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 02:56:27.635955 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:56:27.641200 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:27.646673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-de11130f-9a18-4db3-b725-c2c18373b4cd tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:56:27.651265 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-de11130f-9a18-4db3-b725-c2c18373b4cd tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.047312 Oct 29 02:56:27.662278 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1007/2225] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:56:27 2022] POST /compute/v2.1/servers => generated 687 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:56:27.677557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c5304d76-95b2-4af1-b47d-27f58d0e6b7d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:27.678953 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c5304d76-95b2-4af1-b47d-27f58d0e6b7d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:27.700502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5304d76-95b2-4af1-b47d-27f58d0e6b7d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:27.706433 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5304d76-95b2-4af1-b47d-27f58d0e6b7d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:27.710580 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5304d76-95b2-4af1-b47d-27f58d0e6b7d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:27.712247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5304d76-95b2-4af1-b47d-27f58d0e6b7d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:27.713376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5304d76-95b2-4af1-b47d-27f58d0e6b7d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:27.717595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5304d76-95b2-4af1-b47d-27f58d0e6b7d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:28.102527 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c5304d76-95b2-4af1-b47d-27f58d0e6b7d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:28.144561 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c5304d76-95b2-4af1-b47d-27f58d0e6b7d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1268 microversion: 2.1 time: 0.479966 Oct 29 02:56:28.145557 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1008/2226] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:27 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1268 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:28.181815 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-92dd0123-b4d7-431e-9b17-182b88c2ce79 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:28.197544 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-92dd0123-b4d7-431e-9b17-182b88c2ce79 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b368aa7acf3b419c8310c20f93fbe55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6b7f93767742aa9d35d45caf8945d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:28.208507 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-92dd0123-b4d7-431e-9b17-182b88c2ce79 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Searching by: {'deleted': False, 'project_id': 'bb6b7f93767742aa9d35d45caf8945d3'} {{(pid=127125) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:56:28.225984 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92dd0123-b4d7-431e-9b17-182b88c2ce79 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:28.226830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92dd0123-b4d7-431e-9b17-182b88c2ce79 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:28.227611 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92dd0123-b4d7-431e-9b17-182b88c2ce79 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:28.228935 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92dd0123-b4d7-431e-9b17-182b88c2ce79 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:28.229765 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92dd0123-b4d7-431e-9b17-182b88c2ce79 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:28.230511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92dd0123-b4d7-431e-9b17-182b88c2ce79 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:28.356498 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.multi_cell_list [None req-92dd0123-b4d7-431e-9b17-182b88c2ce79 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 02:56:28.480859 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-92dd0123-b4d7-431e-9b17-182b88c2ce79 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.329914 Oct 29 02:56:28.488670 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1009/2227] 10.222.0.46 () {58 vars in 1125 bytes} [Sat Oct 29 02:56:28 2022] GET /compute/v2.1/servers => generated 334 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:28.500009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6b1fd7f6-6a8d-4c92-99ed-359e1c0f4749 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1815497648", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "98f2cc46-12b8-476e-8eb7-4a5880aa8557"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6b1fd7f6-6a8d-4c92-99ed-359e1c0f4749 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Request method failure captured: Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 500 Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJY-FgSv_Xsm3jQA3LhQ9367-114jkOUNqkMw4F05bLWpHAp7o-mHOgtr1vJZHhIqGRxAva8Ty00E6h5jV2C5KfzqxXrf9F-TJfmrEznAJx_kYoeciAoC4mQoJCEh6M6zMNYybXeOMEIBhGcB-gK_iPdOJ0MuaMowlc4i8BTLgn_yuM Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 123beb9d3a0d4ffca4f51fee4cb4bcf7 Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1205813730 Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}] Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1205813730 Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 123beb9d3a0d4ffca4f51fee4cb4bcf7 Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1205813730 Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerMetadataNegativeTestJSON-1205813730-project Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 95968d63fb18444a98d303f0fe164b8a Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1205813730-project Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1815497648", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "98f2cc46-12b8-476e-8eb7-4a5880aa8557"}]}} Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1815497648', 'imageRef': 'cd315600-df67-41c1-95d3-95a5145fc39a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '98f2cc46-12b8-476e-8eb7-4a5880aa8557'}]}}} Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 02:56:28.508714 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:56:28.514242 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:28.523482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6b1fd7f6-6a8d-4c92-99ed-359e1c0f4749 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:56:28.526868 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6b1fd7f6-6a8d-4c92-99ed-359e1c0f4749 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.035933 Oct 29 02:56:28.528232 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1010/2228] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:56:28 2022] POST /compute/v2.1/servers => generated 689 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:56:28.544332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5630016d-1287-4426-960d-e1f564f46550 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:28.567230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5630016d-1287-4426-960d-e1f564f46550 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b368aa7acf3b419c8310c20f93fbe55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6b7f93767742aa9d35d45caf8945d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:28.575679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5630016d-1287-4426-960d-e1f564f46550 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Searching by: {'deleted': False, 'project_id': 'bb6b7f93767742aa9d35d45caf8945d3'} {{(pid=127125) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:56:28.592074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5630016d-1287-4426-960d-e1f564f46550 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:28.592860 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5630016d-1287-4426-960d-e1f564f46550 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:28.593643 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5630016d-1287-4426-960d-e1f564f46550 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:28.594960 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5630016d-1287-4426-960d-e1f564f46550 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:28.595789 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5630016d-1287-4426-960d-e1f564f46550 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:28.596576 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5630016d-1287-4426-960d-e1f564f46550 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:28.696760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.multi_cell_list [None req-5630016d-1287-4426-960d-e1f564f46550 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 02:56:28.816309 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5630016d-1287-4426-960d-e1f564f46550 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b368aa7acf3b419c8310c20f93fbe55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6b7f93767742aa9d35d45caf8945d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:28.847081 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5630016d-1287-4426-960d-e1f564f46550 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:28.847591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5630016d-1287-4426-960d-e1f564f46550 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:28.848042 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5630016d-1287-4426-960d-e1f564f46550 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:29.902245 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5630016d-1287-4426-960d-e1f564f46550 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] 10.222.0.46 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 1.371792 Oct 29 02:56:29.903955 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1011/2229] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:56:28 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:29.922744 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ddd1a7f9-8862-4d46-bfeb-f2150859cb4b tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1276511500", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "98f2cc46-12b8-476e-8eb7-4a5880aa8557"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ddd1a7f9-8862-4d46-bfeb-f2150859cb4b tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Request method failure captured: Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 754 Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJY-FgSv_Xsm3jQA3LhQ9367-114jkOUNqkMw4F05bLWpHAp7o-mHOgtr1vJZHhIqGRxAva8Ty00E6h5jV2C5KfzqxXrf9F-TJfmrEznAJx_kYoeciAoC4mQoJCEh6M6zMNYybXeOMEIBhGcB-gK_iPdOJ0MuaMowlc4i8BTLgn_yuM Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 123beb9d3a0d4ffca4f51fee4cb4bcf7 Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1205813730 Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}] Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1205813730 Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 123beb9d3a0d4ffca4f51fee4cb4bcf7 Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1205813730 Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerMetadataNegativeTestJSON-1205813730-project Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 95968d63fb18444a98d303f0fe164b8a Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1205813730-project Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1276511500", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "98f2cc46-12b8-476e-8eb7-4a5880aa8557"}]}} Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1276511500', 'imageRef': 'cd315600-df67-41c1-95d3-95a5145fc39a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '98f2cc46-12b8-476e-8eb7-4a5880aa8557'}]}}} Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:56:29.936159 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:56:29.938931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:56:29.941726 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:56:29.941726 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:29.953263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ddd1a7f9-8862-4d46-bfeb-f2150859cb4b tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:56:29.954489 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ddd1a7f9-8862-4d46-bfeb-f2150859cb4b tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.043432 Oct 29 02:56:29.955936 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1012/2230] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:56:29 2022] POST /compute/v2.1/servers => generated 1197 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 29 02:56:29.976119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-04aa962d-7d67-48a3-ae23-325eb652d150 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:29.977151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-04aa962d-7d67-48a3-ae23-325eb652d150 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:29.988345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04aa962d-7d67-48a3-ae23-325eb652d150 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:29.988915 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04aa962d-7d67-48a3-ae23-325eb652d150 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:29.989500 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04aa962d-7d67-48a3-ae23-325eb652d150 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:29.990257 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04aa962d-7d67-48a3-ae23-325eb652d150 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:29.990871 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04aa962d-7d67-48a3-ae23-325eb652d150 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:29.991295 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04aa962d-7d67-48a3-ae23-325eb652d150 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:30.470955 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7676ce7e-d2b3-435e-979c-4e9bb4b11971 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406/action" status: 202 len: 0 microversion: 2.1 time: 4.762962 Oct 29 02:56:30.472448 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1219/2231] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:56:25 2022] POST /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406/action => generated 0 bytes in 4766 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:56:30.484490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2120c156-9a81-4e2f-97c6-c02842c1923b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:30.504436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2120c156-9a81-4e2f-97c6-c02842c1923b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:30.558087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2120c156-9a81-4e2f-97c6-c02842c1923b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:30.560478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2120c156-9a81-4e2f-97c6-c02842c1923b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:30.560978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2120c156-9a81-4e2f-97c6-c02842c1923b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:30.561794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2120c156-9a81-4e2f-97c6-c02842c1923b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:30.565866 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2120c156-9a81-4e2f-97c6-c02842c1923b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:30.567226 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2120c156-9a81-4e2f-97c6-c02842c1923b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:30.642858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-04aa962d-7d67-48a3-ae23-325eb652d150 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:30.652082 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-04aa962d-7d67-48a3-ae23-325eb652d150 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1317 microversion: 2.1 time: 0.693167 Oct 29 02:56:30.655499 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1013/2232] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:29 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1317 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:30.660380 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1a28ba56-455d-41ea-806f-142f4f6fd0cd tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:30.701754 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1a28ba56-455d-41ea-806f-142f4f6fd0cd tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.044102 Oct 29 02:56:30.703842 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1014/2233] 10.222.0.46 () {58 vars in 1137 bytes} [Sat Oct 29 02:56:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:30.721789 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4c381cdb-3f46-4ac8-9bb7-dda2fffd4622 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1199705989", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "98f2cc46-12b8-476e-8eb7-4a5880aa8557"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4c381cdb-3f46-4ac8-9bb7-dda2fffd4622 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Request method failure captured: Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 1266 Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJY-FgSv_Xsm3jQA3LhQ9367-114jkOUNqkMw4F05bLWpHAp7o-mHOgtr1vJZHhIqGRxAva8Ty00E6h5jV2C5KfzqxXrf9F-TJfmrEznAJx_kYoeciAoC4mQoJCEh6M6zMNYybXeOMEIBhGcB-gK_iPdOJ0MuaMowlc4i8BTLgn_yuM Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 123beb9d3a0d4ffca4f51fee4cb4bcf7 Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1205813730 Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}] Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1205813730 Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 123beb9d3a0d4ffca4f51fee4cb4bcf7 Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1205813730 Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerMetadataNegativeTestJSON-1205813730-project Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 95968d63fb18444a98d303f0fe164b8a Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1205813730-project Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1199705989", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "98f2cc46-12b8-476e-8eb7-4a5880aa8557"}]}} Oct 29 02:56:30.727970 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:56:30.730391 n-d-862967-2 devstack@n-api.service[127125]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:56:30.730391 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1199705989', 'imageRef': 'cd315600-df67-41c1-95d3-95a5145fc39a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '98f2cc46-12b8-476e-8eb7-4a5880aa8557'}]}}} Oct 29 02:56:30.730391 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:56:30.730391 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:30.730391 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:56:30.730391 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:56:30.730391 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:56:30.730391 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:56:30.730391 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:56:30.730391 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:30.730391 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 29 02:56:30.730391 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 29 02:56:30.730391 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 29 02:56:30.730391 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 29 02:56:30.730391 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 29 02:56:30.730391 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:30.730391 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 02:56:30.731630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 29 02:56:30.731630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:30.731630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:30.731630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:30.731630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:30.731630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:30.731630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:30.731630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:56:30.731630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:56:30.731630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:56:30.731630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:56:30.731630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:56:30.731630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:56:30.731630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:56:30.731630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:56:30.731630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:56:30.731630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:56:30.731630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:56:30.731630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:56:30.731630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:56:30.731630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:30.731630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:30.731630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:30.731630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:30.731630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:30.731630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:30.731630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:56:30.731630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:56:30.734386 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 29 02:56:30.734386 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:30.734386 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4c381cdb-3f46-4ac8-9bb7-dda2fffd4622 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:56:30.734386 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4c381cdb-3f46-4ac8-9bb7-dda2fffd4622 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.013052 Oct 29 02:56:30.739622 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1015/2234] 10.222.0.46 () {60 vars in 1148 bytes} [Sat Oct 29 02:56:30 2022] POST /compute/v2.1/servers => generated 2221 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 29 02:56:30.747307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3c1eb8be-e801-43f0-a875-7de321c08065 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:30.749325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3c1eb8be-e801-43f0-a875-7de321c08065 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:30.757972 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3c1eb8be-e801-43f0-a875-7de321c08065 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:30.758872 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3c1eb8be-e801-43f0-a875-7de321c08065 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:30.759466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3c1eb8be-e801-43f0-a875-7de321c08065 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:30.760686 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3c1eb8be-e801-43f0-a875-7de321c08065 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:30.761298 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3c1eb8be-e801-43f0-a875-7de321c08065 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:30.761944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3c1eb8be-e801-43f0-a875-7de321c08065 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:31.143206 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3c1eb8be-e801-43f0-a875-7de321c08065 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:31.159184 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3c1eb8be-e801-43f0-a875-7de321c08065 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406" status: 200 len: 1504 microversion: 2.1 time: 0.418293 Oct 29 02:56:31.160167 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1016/2235] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:30 2022] GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 => generated 1504 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:31.190244 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c6badf7a-b581-42a4-95a7-634935b88295 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:31.191597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c6badf7a-b581-42a4-95a7-634935b88295 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] [instance: 53cb5685-75a0-44de-9d2f-b41cc3c14240] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:31.199035 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-c6badf7a-b581-42a4-95a7-634935b88295 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] HTTP exception thrown: Instance 53cb5685-75a0-44de-9d2f-b41cc3c14240 could not be found. Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c6badf7a-b581-42a4-95a7-634935b88295 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Request method failure captured: Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/53cb5685-75a0-44de-9d2f-b41cc3c14240/metadata/test2 HTTP/1.1 Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJY-FgSv_Xsm3jQA3LhQ9367-114jkOUNqkMw4F05bLWpHAp7o-mHOgtr1vJZHhIqGRxAva8Ty00E6h5jV2C5KfzqxXrf9F-TJfmrEznAJx_kYoeciAoC4mQoJCEh6M6zMNYybXeOMEIBhGcB-gK_iPdOJ0MuaMowlc4i8BTLgn_yuM Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 123beb9d3a0d4ffca4f51fee4cb4bcf7 Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1205813730 Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}] Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1205813730 Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 123beb9d3a0d4ffca4f51fee4cb4bcf7 Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1205813730 Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerMetadataNegativeTestJSON-1205813730-project Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 95968d63fb18444a98d303f0fe164b8a Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1205813730-project Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 53cb5685-75a0-44de-9d2f-b41cc3c14240 could not be found. Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'server_id': '53cb5685-75a0-44de-9d2f-b41cc3c14240', 'id': 'test2'} Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53cb5685-75a0-44de-9d2f-b41cc3c14240 could not be found. Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53cb5685-75a0-44de-9d2f-b41cc3c14240 could not be found. Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:31.202003 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:31.206934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:56:31.206934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:56:31.206934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53cb5685-75a0-44de-9d2f-b41cc3c14240 could not be found. Oct 29 02:56:31.206934 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:31.210293 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c6badf7a-b581-42a4-95a7-634935b88295 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Returning 404 to user: Instance 53cb5685-75a0-44de-9d2f-b41cc3c14240 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:56:31.211488 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c6badf7a-b581-42a4-95a7-634935b88295 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] 10.222.0.46 "GET /compute/v2.1/servers/53cb5685-75a0-44de-9d2f-b41cc3c14240/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.049818 Oct 29 02:56:31.212283 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1017/2236] 10.222.0.46 () {58 vars in 1281 bytes} [Sat Oct 29 02:56:31 2022] GET /compute/v2.1/servers/53cb5685-75a0-44de-9d2f-b41cc3c14240/metadata/test2 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:56:31.217890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3d614ca1-eff8-4c58-bec1-636d694e2e1b tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:31.220049 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3d614ca1-eff8-4c58-bec1-636d694e2e1b tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] [instance: aaa6d06b-b045-4be8-b37f-907221813df9] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:31.228079 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d614ca1-eff8-4c58-bec1-636d694e2e1b tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:31.230205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d614ca1-eff8-4c58-bec1-636d694e2e1b tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:31.231600 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d614ca1-eff8-4c58-bec1-636d694e2e1b tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:31.232605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d614ca1-eff8-4c58-bec1-636d694e2e1b tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:31.233323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d614ca1-eff8-4c58-bec1-636d694e2e1b tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:31.233947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d614ca1-eff8-4c58-bec1-636d694e2e1b tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:31.252982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2120c156-9a81-4e2f-97c6-c02842c1923b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:31.290701 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2120c156-9a81-4e2f-97c6-c02842c1923b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1316 microversion: 2.1 time: 0.813375 Oct 29 02:56:31.292011 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1220/2237] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:30 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1316 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:31.310322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f1adf692-1bc6-477d-9d3b-f193da00994a tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:31.311281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f1adf692-1bc6-477d-9d3b-f193da00994a tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] [instance: 01bf9f12-c87f-4056-a84e-47f00b9f30d4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:31.329802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f1adf692-1bc6-477d-9d3b-f193da00994a tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:31.332407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3d614ca1-eff8-4c58-bec1-636d694e2e1b tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] [instance: aaa6d06b-b045-4be8-b37f-907221813df9] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:56:31.332638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f1adf692-1bc6-477d-9d3b-f193da00994a tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:31.333374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f1adf692-1bc6-477d-9d3b-f193da00994a tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:31.336312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f1adf692-1bc6-477d-9d3b-f193da00994a tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:31.339712 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f1adf692-1bc6-477d-9d3b-f193da00994a tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:31.343493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f1adf692-1bc6-477d-9d3b-f193da00994a tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:31.347165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:31.469939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f1adf692-1bc6-477d-9d3b-f193da00994a tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] [instance: 01bf9f12-c87f-4056-a84e-47f00b9f30d4] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:56:31.530728 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3d614ca1-eff8-4c58-bec1-636d694e2e1b tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] 10.222.0.46 "DELETE /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9" status: 204 len: 0 microversion: 2.1 time: 0.315757 Oct 29 02:56:31.532249 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1018/2238] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:56:31 2022] DELETE /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:56:31.544752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0a0c7f9e-0296-43c4-9b57-cf51330fe7fa tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:31.548283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0a0c7f9e-0296-43c4-9b57-cf51330fe7fa tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] [instance: aaa6d06b-b045-4be8-b37f-907221813df9] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:31.561388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a0c7f9e-0296-43c4-9b57-cf51330fe7fa tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:31.562928 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a0c7f9e-0296-43c4-9b57-cf51330fe7fa tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:31.564798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a0c7f9e-0296-43c4-9b57-cf51330fe7fa tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:31.567208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a0c7f9e-0296-43c4-9b57-cf51330fe7fa tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:31.570433 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a0c7f9e-0296-43c4-9b57-cf51330fe7fa tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:31.571179 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a0c7f9e-0296-43c4-9b57-cf51330fe7fa tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:31.707535 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f1adf692-1bc6-477d-9d3b-f193da00994a tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] 10.222.0.46 "DELETE /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4" status: 204 len: 0 microversion: 2.1 time: 0.413197 Oct 29 02:56:31.709856 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1221/2239] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:56:31 2022] DELETE /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:56:31.716962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b27622bf-279f-4256-8b53-7386ad131da0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:31.718010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b27622bf-279f-4256-8b53-7386ad131da0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:31.727039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b27622bf-279f-4256-8b53-7386ad131da0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:31.727879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b27622bf-279f-4256-8b53-7386ad131da0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:31.728688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b27622bf-279f-4256-8b53-7386ad131da0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:31.729743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b27622bf-279f-4256-8b53-7386ad131da0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:31.730411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b27622bf-279f-4256-8b53-7386ad131da0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:31.731129 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b27622bf-279f-4256-8b53-7386ad131da0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:32.143900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b27622bf-279f-4256-8b53-7386ad131da0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:32.160480 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b27622bf-279f-4256-8b53-7386ad131da0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1317 microversion: 2.1 time: 0.444714 Oct 29 02:56:32.161198 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1222/2240] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:31 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1317 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:32.165986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-45d2372e-d2ef-4ee5-9e4b-d3d4a2b9cd19 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:32.166611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-45d2372e-d2ef-4ee5-9e4b-d3d4a2b9cd19 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] [instance: 01bf9f12-c87f-4056-a84e-47f00b9f30d4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:32.192728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45d2372e-d2ef-4ee5-9e4b-d3d4a2b9cd19 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:32.197428 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45d2372e-d2ef-4ee5-9e4b-d3d4a2b9cd19 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:32.198437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45d2372e-d2ef-4ee5-9e4b-d3d4a2b9cd19 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:32.199474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45d2372e-d2ef-4ee5-9e4b-d3d4a2b9cd19 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:32.203588 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45d2372e-d2ef-4ee5-9e4b-d3d4a2b9cd19 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:32.204334 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45d2372e-d2ef-4ee5-9e4b-d3d4a2b9cd19 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:32.221445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0a0c7f9e-0296-43c4-9b57-cf51330fe7fa tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b368aa7acf3b419c8310c20f93fbe55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6b7f93767742aa9d35d45caf8945d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:32.231307 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0a0c7f9e-0296-43c4-9b57-cf51330fe7fa tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] 10.222.0.46 "GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9" status: 200 len: 1701 microversion: 2.1 time: 0.694278 Oct 29 02:56:32.231945 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1019/2241] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:31 2022] GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9 => generated 1701 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:32.244387 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-d157bf09-35b0-4a37-a041-c7c37508a3fc req-46dff474-55f7-4379-9e83-a9681f64317a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c352884d-b0ee-4a54-bc72-41e39eb0839f", "name": "network-vif-plugged", "status": "completed", "tag": "a022a789-20a6-47d7-9b60-c4ab6361d88b"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:32.288406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d157bf09-35b0-4a37-a041-c7c37508a3fc req-46dff474-55f7-4379-9e83-a9681f64317a service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:32.293384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d157bf09-35b0-4a37-a041-c7c37508a3fc req-46dff474-55f7-4379-9e83-a9681f64317a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:32.293833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d157bf09-35b0-4a37-a041-c7c37508a3fc req-46dff474-55f7-4379-9e83-a9681f64317a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:32.339361 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-d157bf09-35b0-4a37-a041-c7c37508a3fc req-46dff474-55f7-4379-9e83-a9681f64317a service nova] Creating event network-vif-plugged:a022a789-20a6-47d7-9b60-c4ab6361d88b for instance c352884d-b0ee-4a54-bc72-41e39eb0839f on n-h2-862967-2 Oct 29 02:56:32.350156 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-d157bf09-35b0-4a37-a041-c7c37508a3fc req-46dff474-55f7-4379-9e83-a9681f64317a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112349 Oct 29 02:56:32.353291 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1020/2242] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:32.360105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-764a4afa-7083-47d0-a1ce-f83a48e975ba tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:32.360888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-764a4afa-7083-47d0-a1ce-f83a48e975ba tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:32.370391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-764a4afa-7083-47d0-a1ce-f83a48e975ba tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:32.373193 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-764a4afa-7083-47d0-a1ce-f83a48e975ba tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:32.374112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-764a4afa-7083-47d0-a1ce-f83a48e975ba tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:32.375629 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-764a4afa-7083-47d0-a1ce-f83a48e975ba tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:32.377974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-764a4afa-7083-47d0-a1ce-f83a48e975ba tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:32.378755 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-764a4afa-7083-47d0-a1ce-f83a48e975ba tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:32.576709 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-764a4afa-7083-47d0-a1ce-f83a48e975ba tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:32.587168 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-764a4afa-7083-47d0-a1ce-f83a48e975ba tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406" status: 200 len: 1504 microversion: 2.1 time: 0.232405 Oct 29 02:56:32.589521 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1021/2243] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:32 2022] GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 => generated 1504 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:32.613050 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-63d6c983-c305-4477-bc79-a8a3a8063dd6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:32.616295 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-63d6c983-c305-4477-bc79-a8a3a8063dd6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:32.642939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63d6c983-c305-4477-bc79-a8a3a8063dd6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:32.643516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63d6c983-c305-4477-bc79-a8a3a8063dd6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:32.644024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63d6c983-c305-4477-bc79-a8a3a8063dd6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:32.644964 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63d6c983-c305-4477-bc79-a8a3a8063dd6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:32.645503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63d6c983-c305-4477-bc79-a8a3a8063dd6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:32.648248 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63d6c983-c305-4477-bc79-a8a3a8063dd6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:32.651768 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:32.663425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-45d2372e-d2ef-4ee5-9e4b-d3d4a2b9cd19 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95968d63fb18444a98d303f0fe164b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123beb9d3a0d4ffca4f51fee4cb4bcf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:32.677095 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-45d2372e-d2ef-4ee5-9e4b-d3d4a2b9cd19 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] 10.222.0.46 "GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4" status: 200 len: 1526 microversion: 2.1 time: 0.514766 Oct 29 02:56:32.703564 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1223/2244] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:32 2022] GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4 => generated 1526 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:32.713209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-45d291e4-8434-4b74-8ad7-e014fe7bab24 req-4528e5f7-2142-4931-8fb9-c85f48d29197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d9854a1-ead6-4570-b801-13c47d0bf721", "tag": "5c797ecc-c991-49d4-a9d6-68c2398ef486"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:32.740937 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-45d291e4-8434-4b74-8ad7-e014fe7bab24 req-4528e5f7-2142-4931-8fb9-c85f48d29197 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:32.744878 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-45d291e4-8434-4b74-8ad7-e014fe7bab24 req-4528e5f7-2142-4931-8fb9-c85f48d29197 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:32.747927 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-45d291e4-8434-4b74-8ad7-e014fe7bab24 req-4528e5f7-2142-4931-8fb9-c85f48d29197 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:32.775443 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-45d291e4-8434-4b74-8ad7-e014fe7bab24 req-4528e5f7-2142-4931-8fb9-c85f48d29197 service nova] Creating event network-changed:5c797ecc-c991-49d4-a9d6-68c2398ef486 for instance 5d9854a1-ead6-4570-b801-13c47d0bf721 on n-h1-862967-2 Oct 29 02:56:32.783910 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-45d291e4-8434-4b74-8ad7-e014fe7bab24 req-4528e5f7-2142-4931-8fb9-c85f48d29197 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078708 Oct 29 02:56:32.785254 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1224/2245] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:33.017759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-63d6c983-c305-4477-bc79-a8a3a8063dd6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:33.025648 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-63d6c983-c305-4477-bc79-a8a3a8063dd6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1316 microversion: 2.1 time: 0.433901 Oct 29 02:56:33.041104 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1022/2246] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:32 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1316 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:33.193005 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6e9fcbd3-54e9-47f6-8835-891c4772416d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:33.194222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6e9fcbd3-54e9-47f6-8835-891c4772416d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:33.201977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e9fcbd3-54e9-47f6-8835-891c4772416d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:33.202473 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e9fcbd3-54e9-47f6-8835-891c4772416d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:33.202915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e9fcbd3-54e9-47f6-8835-891c4772416d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:33.207057 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e9fcbd3-54e9-47f6-8835-891c4772416d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:33.210111 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e9fcbd3-54e9-47f6-8835-891c4772416d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:33.210872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e9fcbd3-54e9-47f6-8835-891c4772416d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:33.261358 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f6bf056f-8648-4809-be4d-496a305aaa16 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:33.262903 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f6bf056f-8648-4809-be4d-496a305aaa16 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] [instance: aaa6d06b-b045-4be8-b37f-907221813df9] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:33.273283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6bf056f-8648-4809-be4d-496a305aaa16 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:33.274100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6bf056f-8648-4809-be4d-496a305aaa16 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:33.276236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6bf056f-8648-4809-be4d-496a305aaa16 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:33.278452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6bf056f-8648-4809-be4d-496a305aaa16 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:33.279179 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6bf056f-8648-4809-be4d-496a305aaa16 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:33.281108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6bf056f-8648-4809-be4d-496a305aaa16 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:33.780997 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f6bf056f-8648-4809-be4d-496a305aaa16 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b368aa7acf3b419c8310c20f93fbe55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6b7f93767742aa9d35d45caf8945d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:33.798674 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f6bf056f-8648-4809-be4d-496a305aaa16 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] 10.222.0.46 "GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9" status: 200 len: 1701 microversion: 2.1 time: 0.541770 Oct 29 02:56:33.816505 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1023/2247] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:33 2022] GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9 => generated 1701 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:33.827137 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2bcc6eb6-e3b5-4c74-b2d9-af91cb514a3f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:33.828141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2bcc6eb6-e3b5-4c74-b2d9-af91cb514a3f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:33.837407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2bcc6eb6-e3b5-4c74-b2d9-af91cb514a3f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:33.838463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2bcc6eb6-e3b5-4c74-b2d9-af91cb514a3f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:33.840406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2bcc6eb6-e3b5-4c74-b2d9-af91cb514a3f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:33.841520 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2bcc6eb6-e3b5-4c74-b2d9-af91cb514a3f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:33.842307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2bcc6eb6-e3b5-4c74-b2d9-af91cb514a3f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:33.842972 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2bcc6eb6-e3b5-4c74-b2d9-af91cb514a3f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:33.946218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6e9fcbd3-54e9-47f6-8835-891c4772416d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:33.964509 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6e9fcbd3-54e9-47f6-8835-891c4772416d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1317 microversion: 2.1 time: 0.777679 Oct 29 02:56:33.965198 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1225/2248] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:33 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1317 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:33.981914 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1791de88-fdb5-4972-b537-cb18fa53e3dc tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:33.982568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1791de88-fdb5-4972-b537-cb18fa53e3dc tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] [instance: 01bf9f12-c87f-4056-a84e-47f00b9f30d4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:33.991310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1791de88-fdb5-4972-b537-cb18fa53e3dc tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:33.991805 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1791de88-fdb5-4972-b537-cb18fa53e3dc tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:33.992247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1791de88-fdb5-4972-b537-cb18fa53e3dc tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:33.993275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1791de88-fdb5-4972-b537-cb18fa53e3dc tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:33.997332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1791de88-fdb5-4972-b537-cb18fa53e3dc tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:33.997898 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1791de88-fdb5-4972-b537-cb18fa53e3dc tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:34.079930 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2bcc6eb6-e3b5-4c74-b2d9-af91cb514a3f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:34.090660 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2bcc6eb6-e3b5-4c74-b2d9-af91cb514a3f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406" status: 200 len: 1504 microversion: 2.1 time: 0.269170 Oct 29 02:56:34.101102 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1024/2249] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:33 2022] GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 => generated 1504 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:34.111916 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-11a8d3c7-9e0a-475d-b8c1-4ea9270235d2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:34.116979 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-11a8d3c7-9e0a-475d-b8c1-4ea9270235d2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:34.123747 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11a8d3c7-9e0a-475d-b8c1-4ea9270235d2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:34.124687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11a8d3c7-9e0a-475d-b8c1-4ea9270235d2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:34.124687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11a8d3c7-9e0a-475d-b8c1-4ea9270235d2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:34.125449 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11a8d3c7-9e0a-475d-b8c1-4ea9270235d2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:34.125896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11a8d3c7-9e0a-475d-b8c1-4ea9270235d2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:34.126316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11a8d3c7-9e0a-475d-b8c1-4ea9270235d2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:34.786416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-11a8d3c7-9e0a-475d-b8c1-4ea9270235d2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:34.794908 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-11a8d3c7-9e0a-475d-b8c1-4ea9270235d2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1316 microversion: 2.1 time: 0.694422 Oct 29 02:56:34.795509 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1025/2250] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:34 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1316 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:34.827444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-180bb92b-d8d9-4c3d-91a4-253ee8d2cebb tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:34.829272 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-180bb92b-d8d9-4c3d-91a4-253ee8d2cebb tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] [instance: aaa6d06b-b045-4be8-b37f-907221813df9] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:34.836060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-180bb92b-d8d9-4c3d-91a4-253ee8d2cebb tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:34.836661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-180bb92b-d8d9-4c3d-91a4-253ee8d2cebb tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:34.837346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-180bb92b-d8d9-4c3d-91a4-253ee8d2cebb tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:34.838302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-180bb92b-d8d9-4c3d-91a4-253ee8d2cebb tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:34.838956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-180bb92b-d8d9-4c3d-91a4-253ee8d2cebb tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:34.839594 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-180bb92b-d8d9-4c3d-91a4-253ee8d2cebb tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:34.906280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1791de88-fdb5-4972-b537-cb18fa53e3dc tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95968d63fb18444a98d303f0fe164b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123beb9d3a0d4ffca4f51fee4cb4bcf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:34.925055 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1791de88-fdb5-4972-b537-cb18fa53e3dc tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] 10.222.0.46 "GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4" status: 200 len: 1526 microversion: 2.1 time: 0.954166 Oct 29 02:56:34.926416 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1226/2251] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:33 2022] GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4 => generated 1526 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:34.991766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-197a8328-7353-461c-b691-54202a7125b1 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:34.994395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-197a8328-7353-461c-b691-54202a7125b1 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:35.003997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-197a8328-7353-461c-b691-54202a7125b1 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:35.004886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-197a8328-7353-461c-b691-54202a7125b1 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:35.005592 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-197a8328-7353-461c-b691-54202a7125b1 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:35.006632 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-197a8328-7353-461c-b691-54202a7125b1 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:35.007293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-197a8328-7353-461c-b691-54202a7125b1 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:35.007920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-197a8328-7353-461c-b691-54202a7125b1 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:35.389998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-180bb92b-d8d9-4c3d-91a4-253ee8d2cebb tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b368aa7acf3b419c8310c20f93fbe55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6b7f93767742aa9d35d45caf8945d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:35.404014 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-180bb92b-d8d9-4c3d-91a4-253ee8d2cebb tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] 10.222.0.46 "GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9" status: 200 len: 1701 microversion: 2.1 time: 0.580214 Oct 29 02:56:35.404901 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1026/2252] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:34 2022] GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9 => generated 1701 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:35.421914 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-d57f1f6c-c75b-4830-8ec0-d40ae8fbee21 req-adf0a65f-3666-4432-bcd0-989acad74474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e6b1a61-b925-4274-bc43-1dfda057b406", "name": "network-vif-unplugged", "status": "completed", "tag": "b6de9e1c-df45-4134-8fe2-03c9b87b0e66"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:35.445212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d57f1f6c-c75b-4830-8ec0-d40ae8fbee21 req-adf0a65f-3666-4432-bcd0-989acad74474 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:35.446065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d57f1f6c-c75b-4830-8ec0-d40ae8fbee21 req-adf0a65f-3666-4432-bcd0-989acad74474 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:35.446686 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d57f1f6c-c75b-4830-8ec0-d40ae8fbee21 req-adf0a65f-3666-4432-bcd0-989acad74474 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:35.467102 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-d57f1f6c-c75b-4830-8ec0-d40ae8fbee21 req-adf0a65f-3666-4432-bcd0-989acad74474 service nova] Creating event network-vif-unplugged:b6de9e1c-df45-4134-8fe2-03c9b87b0e66 for instance 5e6b1a61-b925-4274-bc43-1dfda057b406 on n-h1-862967-2 Oct 29 02:56:35.510340 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-d57f1f6c-c75b-4830-8ec0-d40ae8fbee21 req-adf0a65f-3666-4432-bcd0-989acad74474 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100002 Oct 29 02:56:35.515616 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1027/2253] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:35.529538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:35.529902 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2b2629ff-37c2-4fc1-8fcf-85885a2487d3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:35.531516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2b2629ff-37c2-4fc1-8fcf-85885a2487d3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:35.552742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b2629ff-37c2-4fc1-8fcf-85885a2487d3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:35.554147 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b2629ff-37c2-4fc1-8fcf-85885a2487d3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:35.554807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b2629ff-37c2-4fc1-8fcf-85885a2487d3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:35.555698 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b2629ff-37c2-4fc1-8fcf-85885a2487d3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:35.556281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b2629ff-37c2-4fc1-8fcf-85885a2487d3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:35.556899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b2629ff-37c2-4fc1-8fcf-85885a2487d3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:35.584642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=12 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:35.832262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-197a8328-7353-461c-b691-54202a7125b1 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:35.847151 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-197a8328-7353-461c-b691-54202a7125b1 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1507 microversion: 2.1 time: 0.859280 Oct 29 02:56:35.861187 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1227/2254] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:34 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1507 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:35.876385 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-2715c7c9-bc9a-474e-be1f-f150b43d53fb req-9b82e9fe-8840-415a-9419-6fa6381094eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01bf9f12-c87f-4056-a84e-47f00b9f30d4", "name": "network-vif-deleted", "tag": "cfa54a74-c354-4bed-89f1-8bbceeb1241f"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:35.890447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-2715c7c9-bc9a-474e-be1f-f150b43d53fb req-9b82e9fe-8840-415a-9419-6fa6381094eb service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:35.891172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-2715c7c9-bc9a-474e-be1f-f150b43d53fb req-9b82e9fe-8840-415a-9419-6fa6381094eb service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:35.892032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-2715c7c9-bc9a-474e-be1f-f150b43d53fb req-9b82e9fe-8840-415a-9419-6fa6381094eb service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:35.905304 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-2715c7c9-bc9a-474e-be1f-f150b43d53fb req-9b82e9fe-8840-415a-9419-6fa6381094eb service nova] Creating event network-vif-deleted:cfa54a74-c354-4bed-89f1-8bbceeb1241f for instance 01bf9f12-c87f-4056-a84e-47f00b9f30d4 on n-h1-862967-2 Oct 29 02:56:35.911115 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-2715c7c9-bc9a-474e-be1f-f150b43d53fb req-9b82e9fe-8840-415a-9419-6fa6381094eb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048496 Oct 29 02:56:35.912427 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1228/2255] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:35.919485 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c41f6323-4dda-465a-a623-c51e06ff21de tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:35.920589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c41f6323-4dda-465a-a623-c51e06ff21de tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:35.929905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c41f6323-4dda-465a-a623-c51e06ff21de tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:35.930661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c41f6323-4dda-465a-a623-c51e06ff21de tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:35.931264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c41f6323-4dda-465a-a623-c51e06ff21de tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:35.932433 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c41f6323-4dda-465a-a623-c51e06ff21de tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:35.933272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c41f6323-4dda-465a-a623-c51e06ff21de tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:35.934307 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c41f6323-4dda-465a-a623-c51e06ff21de tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:36.413548 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c41f6323-4dda-465a-a623-c51e06ff21de tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:36.433832 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c41f6323-4dda-465a-a623-c51e06ff21de tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1316 microversion: 2.1 time: 0.518436 Oct 29 02:56:36.451628 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1229/2256] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:35 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1316 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:36.460666 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7e0df05d-becb-42c9-80b2-a47d6e3b5751 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:36.462705 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7e0df05d-becb-42c9-80b2-a47d6e3b5751 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:36.469931 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e0df05d-becb-42c9-80b2-a47d6e3b5751 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:36.470807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e0df05d-becb-42c9-80b2-a47d6e3b5751 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:36.471665 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e0df05d-becb-42c9-80b2-a47d6e3b5751 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:36.472541 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e0df05d-becb-42c9-80b2-a47d6e3b5751 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:36.473281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e0df05d-becb-42c9-80b2-a47d6e3b5751 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:36.473903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e0df05d-becb-42c9-80b2-a47d6e3b5751 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:36.532561 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2b2629ff-37c2-4fc1-8fcf-85885a2487d3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:36.547235 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2b2629ff-37c2-4fc1-8fcf-85885a2487d3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406" status: 200 len: 1504 microversion: 2.1 time: 1.029886 Oct 29 02:56:36.560093 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1028/2257] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:35 2022] GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 => generated 1504 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:36.566557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-14e9ed3b-ef97-4385-89b4-2bed6f7f3723 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:36.567169 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-14e9ed3b-ef97-4385-89b4-2bed6f7f3723 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] [instance: 01bf9f12-c87f-4056-a84e-47f00b9f30d4] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:36.589350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14e9ed3b-ef97-4385-89b4-2bed6f7f3723 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:36.592480 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14e9ed3b-ef97-4385-89b4-2bed6f7f3723 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:36.593105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14e9ed3b-ef97-4385-89b4-2bed6f7f3723 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:36.594040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14e9ed3b-ef97-4385-89b4-2bed6f7f3723 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:36.597459 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14e9ed3b-ef97-4385-89b4-2bed6f7f3723 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:36.598119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14e9ed3b-ef97-4385-89b4-2bed6f7f3723 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:36.640081 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14e9ed3b-ef97-4385-89b4-2bed6f7f3723 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:36.640862 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14e9ed3b-ef97-4385-89b4-2bed6f7f3723 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:36.641501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14e9ed3b-ef97-4385-89b4-2bed6f7f3723 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:36.642136 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-14e9ed3b-ef97-4385-89b4-2bed6f7f3723 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lazy-loading 'fault' on Instance uuid 01bf9f12-c87f-4056-a84e-47f00b9f30d4 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:56:36.737313 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-14e9ed3b-ef97-4385-89b4-2bed6f7f3723 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95968d63fb18444a98d303f0fe164b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123beb9d3a0d4ffca4f51fee4cb4bcf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:36.758308 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-14e9ed3b-ef97-4385-89b4-2bed6f7f3723 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] 10.222.0.46 "GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4" status: 200 len: 1313 microversion: 2.1 time: 0.197911 Oct 29 02:56:36.759622 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1029/2258] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:36 2022] GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:36.769790 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e5550d9c-0d5f-4934-9d3e-ad02eaf7a626 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:36.770842 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e5550d9c-0d5f-4934-9d3e-ad02eaf7a626 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] [instance: aaa6d06b-b045-4be8-b37f-907221813df9] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:36.780983 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5550d9c-0d5f-4934-9d3e-ad02eaf7a626 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:36.782783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5550d9c-0d5f-4934-9d3e-ad02eaf7a626 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:36.783464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5550d9c-0d5f-4934-9d3e-ad02eaf7a626 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:36.784955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5550d9c-0d5f-4934-9d3e-ad02eaf7a626 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:36.785628 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5550d9c-0d5f-4934-9d3e-ad02eaf7a626 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:36.786533 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5550d9c-0d5f-4934-9d3e-ad02eaf7a626 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:36.853720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7e0df05d-becb-42c9-80b2-a47d6e3b5751 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:36.863941 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7e0df05d-becb-42c9-80b2-a47d6e3b5751 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1507 microversion: 2.1 time: 0.410674 Oct 29 02:56:36.877479 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1230/2259] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:36 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1507 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:36.890613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d012384e-21cf-4cc4-87ec-fe28a8fbef9f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "OS-DCF:diskConfig": "AUTO"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:36.896882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d012384e-21cf-4cc4-87ec-fe28a8fbef9f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:36.903716 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d012384e-21cf-4cc4-87ec-fe28a8fbef9f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:36.904458 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d012384e-21cf-4cc4-87ec-fe28a8fbef9f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:36.905174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d012384e-21cf-4cc4-87ec-fe28a8fbef9f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:36.906096 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d012384e-21cf-4cc4-87ec-fe28a8fbef9f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:36.906565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d012384e-21cf-4cc4-87ec-fe28a8fbef9f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:36.906998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d012384e-21cf-4cc4-87ec-fe28a8fbef9f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:36.946773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e5550d9c-0d5f-4934-9d3e-ad02eaf7a626 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b368aa7acf3b419c8310c20f93fbe55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6b7f93767742aa9d35d45caf8945d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:36.960332 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e5550d9c-0d5f-4934-9d3e-ad02eaf7a626 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] 10.222.0.46 "GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9" status: 200 len: 1633 microversion: 2.1 time: 0.196954 Oct 29 02:56:36.961876 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1030/2260] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:36 2022] GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9 => generated 1633 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:37.040779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-d012384e-21cf-4cc4-87ec-fe28a8fbef9f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:56:37.041348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-d012384e-21cf-4cc4-87ec-fe28a8fbef9f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:56:37.042079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-d012384e-21cf-4cc4-87ec-fe28a8fbef9f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:56:37.043104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-d012384e-21cf-4cc4-87ec-fe28a8fbef9f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:56:37.043753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-d012384e-21cf-4cc4-87ec-fe28a8fbef9f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:56:37.157767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d012384e-21cf-4cc4-87ec-fe28a8fbef9f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:37.165193 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d012384e-21cf-4cc4-87ec-fe28a8fbef9f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:37.166005 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d012384e-21cf-4cc4-87ec-fe28a8fbef9f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:37.172843 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d012384e-21cf-4cc4-87ec-fe28a8fbef9f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:37.174987 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d012384e-21cf-4cc4-87ec-fe28a8fbef9f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:37.175520 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d012384e-21cf-4cc4-87ec-fe28a8fbef9f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:37.175989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d012384e-21cf-4cc4-87ec-fe28a8fbef9f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:37.217433 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d012384e-21cf-4cc4-87ec-fe28a8fbef9f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "POST /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f/action" status: 202 len: 1109 microversion: 2.1 time: 0.330710 Oct 29 02:56:37.232270 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1231/2261] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:56:36 2022] POST /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f/action => generated 1109 bytes in 333 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 29 02:56:37.239460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-50ef082b-fea7-4953-b99e-38772ea04bae tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:37.240139 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-50ef082b-fea7-4953-b99e-38772ea04bae tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:37.255076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50ef082b-fea7-4953-b99e-38772ea04bae tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:37.255572 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50ef082b-fea7-4953-b99e-38772ea04bae tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:37.258505 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50ef082b-fea7-4953-b99e-38772ea04bae tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:37.259448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50ef082b-fea7-4953-b99e-38772ea04bae tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:37.262497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50ef082b-fea7-4953-b99e-38772ea04bae tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:37.274500 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50ef082b-fea7-4953-b99e-38772ea04bae tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:37.464500 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-196b3617-96cc-435a-8aa2-6d511d5a8038 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:37.468074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-196b3617-96cc-435a-8aa2-6d511d5a8038 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:37.491814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-196b3617-96cc-435a-8aa2-6d511d5a8038 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:37.492061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-196b3617-96cc-435a-8aa2-6d511d5a8038 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:37.497317 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-196b3617-96cc-435a-8aa2-6d511d5a8038 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:37.501310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-196b3617-96cc-435a-8aa2-6d511d5a8038 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:37.503018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-196b3617-96cc-435a-8aa2-6d511d5a8038 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:37.506838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-196b3617-96cc-435a-8aa2-6d511d5a8038 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:37.677853 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-50ef082b-fea7-4953-b99e-38772ea04bae tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:37.695281 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-50ef082b-fea7-4953-b99e-38772ea04bae tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1514 microversion: 2.1 time: 0.458713 Oct 29 02:56:37.697519 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1031/2262] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:37 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1514 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:37.703782 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5c6978c6-267d-4e50-85fc-c47e86f7119b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:37.704969 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5c6978c6-267d-4e50-85fc-c47e86f7119b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:37.713732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c6978c6-267d-4e50-85fc-c47e86f7119b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:37.714228 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c6978c6-267d-4e50-85fc-c47e86f7119b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:37.714904 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c6978c6-267d-4e50-85fc-c47e86f7119b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:37.715679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c6978c6-267d-4e50-85fc-c47e86f7119b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:37.716593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c6978c6-267d-4e50-85fc-c47e86f7119b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:37.717162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c6978c6-267d-4e50-85fc-c47e86f7119b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:37.920110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5c6978c6-267d-4e50-85fc-c47e86f7119b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:37.930010 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5c6978c6-267d-4e50-85fc-c47e86f7119b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406" status: 200 len: 1504 microversion: 2.1 time: 0.230562 Oct 29 02:56:37.944551 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1032/2263] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:37 2022] GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 => generated 1504 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:37.944551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-304776e5-37c1-4690-aac3-197471cd6b46 req-2f993324-49b4-42fa-8adb-f3d9ac870897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa6d06b-b045-4be8-b37f-907221813df9", "name": "network-vif-deleted", "tag": "4c26750e-9b47-44f7-88f7-e2358512c498"}, {"name": "network-changed", "server_uuid": "5e6b1a61-b925-4274-bc43-1dfda057b406", "tag": "b6de9e1c-df45-4134-8fe2-03c9b87b0e66"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:37.953535 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-304776e5-37c1-4690-aac3-197471cd6b46 req-2f993324-49b4-42fa-8adb-f3d9ac870897 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:37.956359 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-304776e5-37c1-4690-aac3-197471cd6b46 req-2f993324-49b4-42fa-8adb-f3d9ac870897 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:37.958274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-304776e5-37c1-4690-aac3-197471cd6b46 req-2f993324-49b4-42fa-8adb-f3d9ac870897 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:38.004345 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-304776e5-37c1-4690-aac3-197471cd6b46 req-2f993324-49b4-42fa-8adb-f3d9ac870897 service nova] Creating event network-vif-deleted:4c26750e-9b47-44f7-88f7-e2358512c498 for instance aaa6d06b-b045-4be8-b37f-907221813df9 on n-h2-862967-2 Oct 29 02:56:38.010463 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-304776e5-37c1-4690-aac3-197471cd6b46 req-2f993324-49b4-42fa-8adb-f3d9ac870897 service nova] Creating event network-changed:b6de9e1c-df45-4134-8fe2-03c9b87b0e66 for instance 5e6b1a61-b925-4274-bc43-1dfda057b406 on n-h1-862967-2 Oct 29 02:56:38.027118 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-304776e5-37c1-4690-aac3-197471cd6b46 req-2f993324-49b4-42fa-8adb-f3d9ac870897 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.094662 Oct 29 02:56:38.056413 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1033/2264] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:38.074808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-57964b01-d3f8-44df-b415-bdacdaa85037 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:38.075976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-57964b01-d3f8-44df-b415-bdacdaa85037 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] [instance: 01bf9f12-c87f-4056-a84e-47f00b9f30d4] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:38.082508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-196b3617-96cc-435a-8aa2-6d511d5a8038 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:38.094547 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57964b01-d3f8-44df-b415-bdacdaa85037 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:38.095057 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-196b3617-96cc-435a-8aa2-6d511d5a8038 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1316 microversion: 2.1 time: 0.635214 Oct 29 02:56:38.095203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57964b01-d3f8-44df-b415-bdacdaa85037 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:38.095541 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57964b01-d3f8-44df-b415-bdacdaa85037 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:38.096502 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1232/2265] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:37 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1316 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:38.107196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8cf2f5af-cbdf-42a2-8247-84c1b9c386b0 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:38.110412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57964b01-d3f8-44df-b415-bdacdaa85037 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:38.111140 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57964b01-d3f8-44df-b415-bdacdaa85037 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:38.111598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57964b01-d3f8-44df-b415-bdacdaa85037 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:38.112059 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8cf2f5af-cbdf-42a2-8247-84c1b9c386b0 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] [instance: aaa6d06b-b045-4be8-b37f-907221813df9] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:38.127324 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-57964b01-d3f8-44df-b415-bdacdaa85037 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] HTTP exception thrown: Instance 01bf9f12-c87f-4056-a84e-47f00b9f30d4 could not be found. Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-57964b01-d3f8-44df-b415-bdacdaa85037 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Request method failure captured: Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4 HTTP/1.1 Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJY-FgSv_Xsm3jQA3LhQ9367-114jkOUNqkMw4F05bLWpHAp7o-mHOgtr1vJZHhIqGRxAva8Ty00E6h5jV2C5KfzqxXrf9F-TJfmrEznAJx_kYoeciAoC4mQoJCEh6M6zMNYybXeOMEIBhGcB-gK_iPdOJ0MuaMowlc4i8BTLgn_yuM Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 123beb9d3a0d4ffca4f51fee4cb4bcf7 Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1205813730 Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/123beb9d3a0d4ffca4f51fee4cb4bcf7"}]}] Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1205813730 Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 123beb9d3a0d4ffca4f51fee4cb4bcf7 Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1205813730 Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerMetadataNegativeTestJSON-1205813730-project Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 95968d63fb18444a98d303f0fe164b8a Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1205813730-project Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 01bf9f12-c87f-4056-a84e-47f00b9f30d4 could not be found. Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '01bf9f12-c87f-4056-a84e-47f00b9f30d4'} Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01bf9f12-c87f-4056-a84e-47f00b9f30d4 could not be found. Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01bf9f12-c87f-4056-a84e-47f00b9f30d4 could not be found. Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:38.128986 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:38.132654 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:38.132654 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:38.132654 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:38.132654 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:38.132654 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:56:38.132654 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:56:38.132654 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01bf9f12-c87f-4056-a84e-47f00b9f30d4 could not be found. Oct 29 02:56:38.132654 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:38.132654 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-57964b01-d3f8-44df-b415-bdacdaa85037 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] Returning 404 to user: Instance 01bf9f12-c87f-4056-a84e-47f00b9f30d4 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:56:38.132654 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-57964b01-d3f8-44df-b415-bdacdaa85037 tempest-ServerMetadataNegativeTestJSON-1205813730 tempest-ServerMetadataNegativeTestJSON-1205813730-project] 10.222.0.46 "GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4" status: 404 len: 111 microversion: 2.1 time: 0.072173 Oct 29 02:56:38.132654 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1034/2266] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:38 2022] GET /compute/v2.1/servers/01bf9f12-c87f-4056-a84e-47f00b9f30d4 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:56:38.138111 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8cf2f5af-cbdf-42a2-8247-84c1b9c386b0 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:38.138111 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8cf2f5af-cbdf-42a2-8247-84c1b9c386b0 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:38.138111 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8cf2f5af-cbdf-42a2-8247-84c1b9c386b0 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:38.138111 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8cf2f5af-cbdf-42a2-8247-84c1b9c386b0 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:38.138111 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8cf2f5af-cbdf-42a2-8247-84c1b9c386b0 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:38.138111 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8cf2f5af-cbdf-42a2-8247-84c1b9c386b0 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:38.208501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8cf2f5af-cbdf-42a2-8247-84c1b9c386b0 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:38.209117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8cf2f5af-cbdf-42a2-8247-84c1b9c386b0 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:38.209681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8cf2f5af-cbdf-42a2-8247-84c1b9c386b0 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:38.210151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-8cf2f5af-cbdf-42a2-8247-84c1b9c386b0 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lazy-loading 'fault' on Instance uuid aaa6d06b-b045-4be8-b37f-907221813df9 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:56:38.370413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8cf2f5af-cbdf-42a2-8247-84c1b9c386b0 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b368aa7acf3b419c8310c20f93fbe55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb6b7f93767742aa9d35d45caf8945d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:38.378031 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8cf2f5af-cbdf-42a2-8247-84c1b9c386b0 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] 10.222.0.46 "GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9" status: 200 len: 1360 microversion: 2.1 time: 0.278243 Oct 29 02:56:38.378623 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1233/2267] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:38 2022] GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9 => generated 1360 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:38.719314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f5ece054-1f3a-45b4-aa5a-2f8e76d7cbd8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:38.719925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f5ece054-1f3a-45b4-aa5a-2f8e76d7cbd8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:38.722586 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:38.728558 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5ece054-1f3a-45b4-aa5a-2f8e76d7cbd8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:38.729053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5ece054-1f3a-45b4-aa5a-2f8e76d7cbd8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:38.729489 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5ece054-1f3a-45b4-aa5a-2f8e76d7cbd8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:38.730232 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5ece054-1f3a-45b4-aa5a-2f8e76d7cbd8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:38.730685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5ece054-1f3a-45b4-aa5a-2f8e76d7cbd8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:38.731107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5ece054-1f3a-45b4-aa5a-2f8e76d7cbd8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:38.809533 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:38.957890 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-891c1db2-cbca-42ef-9cbc-d77b8109305e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:38.958513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-891c1db2-cbca-42ef-9cbc-d77b8109305e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:38.976155 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-891c1db2-cbca-42ef-9cbc-d77b8109305e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:38.976999 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-891c1db2-cbca-42ef-9cbc-d77b8109305e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:38.977666 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-891c1db2-cbca-42ef-9cbc-d77b8109305e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:38.978890 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-891c1db2-cbca-42ef-9cbc-d77b8109305e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:38.979522 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-891c1db2-cbca-42ef-9cbc-d77b8109305e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:38.980422 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-891c1db2-cbca-42ef-9cbc-d77b8109305e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:39.181174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f5ece054-1f3a-45b4-aa5a-2f8e76d7cbd8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:39.193826 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f5ece054-1f3a-45b4-aa5a-2f8e76d7cbd8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1514 microversion: 2.1 time: 0.478226 Oct 29 02:56:39.210919 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1035/2268] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:38 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1514 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:39.243107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-891c1db2-cbca-42ef-9cbc-d77b8109305e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:39.257611 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-891c1db2-cbca-42ef-9cbc-d77b8109305e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406" status: 200 len: 1504 microversion: 2.1 time: 0.303442 Oct 29 02:56:39.271316 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1234/2269] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:38 2022] GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 => generated 1504 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:39.276836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9c39e523-ca1a-4720-8cfe-e020f576e664 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:39.280986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9c39e523-ca1a-4720-8cfe-e020f576e664 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:39.288025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c39e523-ca1a-4720-8cfe-e020f576e664 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:39.288391 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c39e523-ca1a-4720-8cfe-e020f576e664 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:39.289113 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c39e523-ca1a-4720-8cfe-e020f576e664 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:39.290075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c39e523-ca1a-4720-8cfe-e020f576e664 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:39.290767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c39e523-ca1a-4720-8cfe-e020f576e664 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:39.291420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c39e523-ca1a-4720-8cfe-e020f576e664 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:39.297560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:39.480452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2af39583-2dae-4f88-9b70-47bff0520033 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Action: 'create', calling method: .version_select at 0x7ff053886e50>, body: {"keypair": {"name": "tempest-keypair-510192172", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBY4wccG/fNRAjsX2M4byQPTSBF5i87Hiy3VsTE42772F9TT95HkoGO06jsJLIU3miuICgDL8+DNO1kpP37ykoEOy+W+ISFifYNz0mJfx4V0lOmZnOlHl1ZDLKjS383eNg=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:39.510593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:39.539830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-2af39583-2dae-4f88-9b70-47bff0520033 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Getting quotas for project ed7f6396840c4aa6b4b7d4ee83503eac. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:56:39.555660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-2af39583-2dae-4f88-9b70-47bff0520033 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Getting quotas for user 136249f42e0e41cc9567b1b3be298574 and project ed7f6396840c4aa6b4b7d4ee83503eac. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:56:39.620920 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2af39583-2dae-4f88-9b70-47bff0520033 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.408225 Oct 29 02:56:39.630054 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1036/2270] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 02:56:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:39.661692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5f7561b2-60d8-42e1-a5e5-f4abad99962e tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:39.662909 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5f7561b2-60d8-42e1-a5e5-f4abad99962e tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] [instance: aaa6d06b-b045-4be8-b37f-907221813df9] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:39.672323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f7561b2-60d8-42e1-a5e5-f4abad99962e tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:39.674500 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f7561b2-60d8-42e1-a5e5-f4abad99962e tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:39.675530 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f7561b2-60d8-42e1-a5e5-f4abad99962e tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:39.678164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f7561b2-60d8-42e1-a5e5-f4abad99962e tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:39.679155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f7561b2-60d8-42e1-a5e5-f4abad99962e tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:39.679742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f7561b2-60d8-42e1-a5e5-f4abad99962e tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:39.724549 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-5f7561b2-60d8-42e1-a5e5-f4abad99962e tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] HTTP exception thrown: Instance aaa6d06b-b045-4be8-b37f-907221813df9 could not be found. Oct 29 02:56:39.728855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9c39e523-ca1a-4720-8cfe-e020f576e664 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5f7561b2-60d8-42e1-a5e5-f4abad99962e tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Request method failure captured: Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9 HTTP/1.1 Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJYWpzF1fA5Jn7b3csmCqmX9WqQ22kejRHe9lvVA-7IeK9Zv-8tcVbnTuPYJLGS5UBl4SBRH5OYov0LhGN41X7BLaQq2rKtpgVNhJkFVojoHxp7PO8varTG5E0VDDtjZhnxIXvpRJuUXlirhnsRMyt30Mttv9vVkF45i8Jo_7PnDZr8 Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: bb6b7f93767742aa9d35d45caf8945d3 Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersTestJSON-133627389 Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bb6b7f93767742aa9d35d45caf8945d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bb6b7f93767742aa9d35d45caf8945d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bb6b7f93767742aa9d35d45caf8945d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bb6b7f93767742aa9d35d45caf8945d3"}]}] Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersTestJSON-133627389 Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: bb6b7f93767742aa9d35d45caf8945d3 Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersTestJSON-133627389 Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersTestJSON-133627389-project Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: b368aa7acf3b419c8310c20f93fbe55a Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersTestJSON-133627389-project Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance aaa6d06b-b045-4be8-b37f-907221813df9 could not be found. Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'aaa6d06b-b045-4be8-b37f-907221813df9'} Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaa6d06b-b045-4be8-b37f-907221813df9 could not be found. Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaa6d06b-b045-4be8-b37f-907221813df9 could not be found. Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:39.729387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:39.733474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:39.733474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:39.733474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:56:39.733474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:56:39.733474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaa6d06b-b045-4be8-b37f-907221813df9 could not be found. Oct 29 02:56:39.733474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:56:39.733474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5f7561b2-60d8-42e1-a5e5-f4abad99962e tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Returning 404 to user: Instance aaa6d06b-b045-4be8-b37f-907221813df9 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:56:39.733474 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5f7561b2-60d8-42e1-a5e5-f4abad99962e tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] 10.222.0.46 "GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9" status: 404 len: 111 microversion: 2.1 time: 0.088304 Oct 29 02:56:39.733474 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1037/2271] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:39 2022] GET /compute/v2.1/servers/aaa6d06b-b045-4be8-b37f-907221813df9 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:56:39.737466 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9c39e523-ca1a-4720-8cfe-e020f576e664 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1316 microversion: 2.1 time: 0.464839 Oct 29 02:56:39.741605 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1235/2272] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:39 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1316 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:39.742792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-01fef6ba-cc46-4d08-9a57-e92ee08d3970 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] Calling method '.version_select at 0x7ff053731b80>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:39.774672 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-01fef6ba-cc46-4d08-9a57-e92ee08d3970 tempest-ServersTestJSON-133627389 tempest-ServersTestJSON-133627389-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1280533601" status: 202 len: 0 microversion: 2.1 time: 0.038306 Oct 29 02:56:39.775747 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1038/2273] 10.222.0.46 () {58 vars in 1221 bytes} [Sat Oct 29 02:56:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1280533601 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:56:40.227846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-18f7c338-57b6-44f9-b92b-a97f88be6ef9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:40.229219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-18f7c338-57b6-44f9-b92b-a97f88be6ef9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:40.241147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-18f7c338-57b6-44f9-b92b-a97f88be6ef9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:40.241889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-18f7c338-57b6-44f9-b92b-a97f88be6ef9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:40.242573 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-18f7c338-57b6-44f9-b92b-a97f88be6ef9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:40.243477 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-18f7c338-57b6-44f9-b92b-a97f88be6ef9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:40.244167 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-18f7c338-57b6-44f9-b92b-a97f88be6ef9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:40.244766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-18f7c338-57b6-44f9-b92b-a97f88be6ef9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:40.315280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2fff5695-1321-43f2-b741-67f717c44601 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:40.316237 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2fff5695-1321-43f2-b741-67f717c44601 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:40.355887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fff5695-1321-43f2-b741-67f717c44601 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:40.358325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fff5695-1321-43f2-b741-67f717c44601 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:40.360651 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fff5695-1321-43f2-b741-67f717c44601 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:40.361832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fff5695-1321-43f2-b741-67f717c44601 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:40.375348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fff5695-1321-43f2-b741-67f717c44601 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:40.377809 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fff5695-1321-43f2-b741-67f717c44601 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:40.867337 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2fff5695-1321-43f2-b741-67f717c44601 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:40.882479 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2fff5695-1321-43f2-b741-67f717c44601 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406" status: 200 len: 1504 microversion: 2.1 time: 0.582617 Oct 29 02:56:40.883079 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1039/2274] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:40 2022] GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 => generated 1504 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:40.895885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9d16694f-003a-47f8-9c2d-6a8209de4389 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:40.907654 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9d16694f-003a-47f8-9c2d-6a8209de4389 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:40.924842 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d16694f-003a-47f8-9c2d-6a8209de4389 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:40.934100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d16694f-003a-47f8-9c2d-6a8209de4389 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:40.934949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d16694f-003a-47f8-9c2d-6a8209de4389 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:40.939613 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d16694f-003a-47f8-9c2d-6a8209de4389 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:40.940354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d16694f-003a-47f8-9c2d-6a8209de4389 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:40.941067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d16694f-003a-47f8-9c2d-6a8209de4389 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:41.176954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-18f7c338-57b6-44f9-b92b-a97f88be6ef9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:41.192773 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-18f7c338-57b6-44f9-b92b-a97f88be6ef9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1514 microversion: 2.1 time: 0.972648 Oct 29 02:56:41.194382 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1236/2275] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:40 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1514 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:41.807768 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9d16694f-003a-47f8-9c2d-6a8209de4389 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:41.821521 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9d16694f-003a-47f8-9c2d-6a8209de4389 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1316 microversion: 2.1 time: 0.936219 Oct 29 02:56:41.822435 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1040/2276] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:40 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1316 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:41.907811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-31c7275b-a8d8-411a-b509-1155fa54ff59 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:41.909504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-31c7275b-a8d8-411a-b509-1155fa54ff59 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:41.917456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31c7275b-a8d8-411a-b509-1155fa54ff59 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:41.918940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31c7275b-a8d8-411a-b509-1155fa54ff59 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:41.919576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31c7275b-a8d8-411a-b509-1155fa54ff59 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:41.920471 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31c7275b-a8d8-411a-b509-1155fa54ff59 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:41.921225 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31c7275b-a8d8-411a-b509-1155fa54ff59 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:41.921795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31c7275b-a8d8-411a-b509-1155fa54ff59 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:42.218368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-93dd009a-bc62-419f-80b2-d908f8496ea6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:42.219597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-93dd009a-bc62-419f-80b2-d908f8496ea6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:42.228257 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93dd009a-bc62-419f-80b2-d908f8496ea6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:42.229329 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93dd009a-bc62-419f-80b2-d908f8496ea6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:42.231021 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93dd009a-bc62-419f-80b2-d908f8496ea6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:42.232066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93dd009a-bc62-419f-80b2-d908f8496ea6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:42.232813 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93dd009a-bc62-419f-80b2-d908f8496ea6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:42.234098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93dd009a-bc62-419f-80b2-d908f8496ea6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:42.618612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-93dd009a-bc62-419f-80b2-d908f8496ea6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:42.630498 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-93dd009a-bc62-419f-80b2-d908f8496ea6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1514 microversion: 2.1 time: 0.416137 Oct 29 02:56:42.653359 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1041/2277] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:42 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1514 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:42.762275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-31c7275b-a8d8-411a-b509-1155fa54ff59 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:42.777838 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-31c7275b-a8d8-411a-b509-1155fa54ff59 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406" status: 200 len: 1504 microversion: 2.1 time: 0.874185 Oct 29 02:56:42.779056 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1237/2278] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:41 2022] GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 => generated 1504 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:42.849985 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8d29668d-f44e-40cf-b120-7cb895c818c0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:42.851180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8d29668d-f44e-40cf-b120-7cb895c818c0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:42.874463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d29668d-f44e-40cf-b120-7cb895c818c0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:42.874957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d29668d-f44e-40cf-b120-7cb895c818c0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:42.875390 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d29668d-f44e-40cf-b120-7cb895c818c0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:42.876402 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d29668d-f44e-40cf-b120-7cb895c818c0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:42.876878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d29668d-f44e-40cf-b120-7cb895c818c0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:42.877302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d29668d-f44e-40cf-b120-7cb895c818c0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:43.622917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8d29668d-f44e-40cf-b120-7cb895c818c0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:43.637991 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8d29668d-f44e-40cf-b120-7cb895c818c0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1316 microversion: 2.1 time: 0.794357 Oct 29 02:56:43.653078 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1042/2279] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:42 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1316 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:43.661372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-21bbb3d5-27aa-4e30-ab27-d5d56d0d3f99 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:43.661990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-21bbb3d5-27aa-4e30-ab27-d5d56d0d3f99 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:43.678676 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-21bbb3d5-27aa-4e30-ab27-d5d56d0d3f99 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:43.685871 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-21bbb3d5-27aa-4e30-ab27-d5d56d0d3f99 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:43.686558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-21bbb3d5-27aa-4e30-ab27-d5d56d0d3f99 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:43.687761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-21bbb3d5-27aa-4e30-ab27-d5d56d0d3f99 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:43.688382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-21bbb3d5-27aa-4e30-ab27-d5d56d0d3f99 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:43.688993 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-21bbb3d5-27aa-4e30-ab27-d5d56d0d3f99 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:43.802612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2f0fa208-4ad0-4f21-a729-52ad8a52c514 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:43.803471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2f0fa208-4ad0-4f21-a729-52ad8a52c514 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:43.813377 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f0fa208-4ad0-4f21-a729-52ad8a52c514 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:43.817625 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f0fa208-4ad0-4f21-a729-52ad8a52c514 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:43.818293 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f0fa208-4ad0-4f21-a729-52ad8a52c514 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:43.819224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f0fa208-4ad0-4f21-a729-52ad8a52c514 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:43.821607 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f0fa208-4ad0-4f21-a729-52ad8a52c514 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:43.822216 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f0fa208-4ad0-4f21-a729-52ad8a52c514 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:43.833828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:44.265787 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-21bbb3d5-27aa-4e30-ab27-d5d56d0d3f99 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:44.278515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2f0fa208-4ad0-4f21-a729-52ad8a52c514 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:44.282219 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-21bbb3d5-27aa-4e30-ab27-d5d56d0d3f99 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1514 microversion: 2.1 time: 0.625001 Oct 29 02:56:44.283468 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1238/2280] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:43 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1514 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:44.302207 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2f0fa208-4ad0-4f21-a729-52ad8a52c514 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406" status: 200 len: 1504 microversion: 2.1 time: 0.504289 Oct 29 02:56:44.303715 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1043/2281] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:43 2022] GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 => generated 1504 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:44.675514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dc14a25c-d764-418c-ba25-0ec597df55ea tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:44.676659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dc14a25c-d764-418c-ba25-0ec597df55ea tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:44.687026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc14a25c-d764-418c-ba25-0ec597df55ea tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:44.687512 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc14a25c-d764-418c-ba25-0ec597df55ea tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:44.687953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc14a25c-d764-418c-ba25-0ec597df55ea tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:44.689151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc14a25c-d764-418c-ba25-0ec597df55ea tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:44.689861 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc14a25c-d764-418c-ba25-0ec597df55ea tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:44.690460 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc14a25c-d764-418c-ba25-0ec597df55ea tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:44.764574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c5527b8b-ddad-4be7-bb9e-f4fa522606de tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1771234447", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "fcf28aba-6bc9-49b4-88d6-8f601037867f"}], "security_groups": [{"name": "tempest-securitygroup--1073770932"}], "key_name": "tempest-keypair-510192172", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:45.136361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-c5527b8b-ddad-4be7-bb9e-f4fa522606de tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] validate_networks() for [('fcf28aba-6bc9-49b4-88d6-8f601037867f', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:56:45.560536 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dc14a25c-d764-418c-ba25-0ec597df55ea tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:45.571255 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dc14a25c-d764-418c-ba25-0ec597df55ea tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1316 microversion: 2.1 time: 0.910320 Oct 29 02:56:45.576451 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1239/2282] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:44 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1316 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:45.757012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-5d33511d-2db3-46e0-b498-e9d9e0b56110 req-bc712db8-596c-4e6b-9378-f8e2566c5ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d9854a1-ead6-4570-b801-13c47d0bf721", "name": "network-vif-plugged", "status": "completed", "tag": "5c797ecc-c991-49d4-a9d6-68c2398ef486"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:45.775496 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5d33511d-2db3-46e0-b498-e9d9e0b56110 req-bc712db8-596c-4e6b-9378-f8e2566c5ecb service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:45.776202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5d33511d-2db3-46e0-b498-e9d9e0b56110 req-bc712db8-596c-4e6b-9378-f8e2566c5ecb service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:45.776670 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5d33511d-2db3-46e0-b498-e9d9e0b56110 req-bc712db8-596c-4e6b-9378-f8e2566c5ecb service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:45.803117 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-5d33511d-2db3-46e0-b498-e9d9e0b56110 req-bc712db8-596c-4e6b-9378-f8e2566c5ecb service nova] Creating event network-vif-plugged:5c797ecc-c991-49d4-a9d6-68c2398ef486 for instance 5d9854a1-ead6-4570-b801-13c47d0bf721 on n-h1-862967-2 Oct 29 02:56:45.812722 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-5d33511d-2db3-46e0-b498-e9d9e0b56110 req-bc712db8-596c-4e6b-9378-f8e2566c5ecb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.234504 Oct 29 02:56:45.813596 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1240/2283] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:45.823930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-854dccc0-1e7c-4dd6-928c-0acd3b28fe78 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:45.835050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-854dccc0-1e7c-4dd6-928c-0acd3b28fe78 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:45.841517 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:45.843631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-854dccc0-1e7c-4dd6-928c-0acd3b28fe78 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:45.846592 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-854dccc0-1e7c-4dd6-928c-0acd3b28fe78 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:45.847332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-854dccc0-1e7c-4dd6-928c-0acd3b28fe78 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:45.848295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-854dccc0-1e7c-4dd6-928c-0acd3b28fe78 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:45.848984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-854dccc0-1e7c-4dd6-928c-0acd3b28fe78 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:45.849706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-854dccc0-1e7c-4dd6-928c-0acd3b28fe78 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:46.420445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-854dccc0-1e7c-4dd6-928c-0acd3b28fe78 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:46.454011 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-854dccc0-1e7c-4dd6-928c-0acd3b28fe78 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1514 microversion: 2.1 time: 0.638823 Oct 29 02:56:46.455121 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1241/2284] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:45 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1514 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:46.470226 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b638fde0-fb5a-40c6-bc88-0b6913e0c36c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:46.471255 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b638fde0-fb5a-40c6-bc88-0b6913e0c36c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:46.491020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b638fde0-fb5a-40c6-bc88-0b6913e0c36c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:46.492047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b638fde0-fb5a-40c6-bc88-0b6913e0c36c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:46.495466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b638fde0-fb5a-40c6-bc88-0b6913e0c36c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:46.495840 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b638fde0-fb5a-40c6-bc88-0b6913e0c36c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:46.496325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b638fde0-fb5a-40c6-bc88-0b6913e0c36c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:46.496793 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b638fde0-fb5a-40c6-bc88-0b6913e0c36c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:46.907400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b638fde0-fb5a-40c6-bc88-0b6913e0c36c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:46.917299 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b638fde0-fb5a-40c6-bc88-0b6913e0c36c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406" status: 200 len: 1479 microversion: 2.1 time: 0.460707 Oct 29 02:56:46.917868 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1242/2285] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:46 2022] GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 => generated 1479 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:46.928144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ea750838-7be5-4108-a0c6-877ded306961 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:46.928807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ea750838-7be5-4108-a0c6-877ded306961 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:46.938701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea750838-7be5-4108-a0c6-877ded306961 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:46.939245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea750838-7be5-4108-a0c6-877ded306961 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:46.940746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea750838-7be5-4108-a0c6-877ded306961 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:46.942311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea750838-7be5-4108-a0c6-877ded306961 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:46.942950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea750838-7be5-4108-a0c6-877ded306961 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:46.944130 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea750838-7be5-4108-a0c6-877ded306961 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:47.164190 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-c5527b8b-ddad-4be7-bb9e-f4fa522606de tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Getting quotas for project ed7f6396840c4aa6b4b7d4ee83503eac. Resources: dict_keys(['metadata_items']) {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:56:47.180325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-c5527b8b-ddad-4be7-bb9e-f4fa522606de tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Getting quotas for user 136249f42e0e41cc9567b1b3be298574 and project ed7f6396840c4aa6b4b7d4ee83503eac. Resources: dict_keys(['metadata_items']) {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:56:47.208082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-c5527b8b-ddad-4be7-bb9e-f4fa522606de tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:56:47.208797 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-c5527b8b-ddad-4be7-bb9e-f4fa522606de tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:56:47.209474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-c5527b8b-ddad-4be7-bb9e-f4fa522606de tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:56:47.210031 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-c5527b8b-ddad-4be7-bb9e-f4fa522606de tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:56:47.210600 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-c5527b8b-ddad-4be7-bb9e-f4fa522606de tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:56:47.239162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5527b8b-ddad-4be7-bb9e-f4fa522606de tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:47.239590 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5527b8b-ddad-4be7-bb9e-f4fa522606de tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:47.240205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5527b8b-ddad-4be7-bb9e-f4fa522606de tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:47.241411 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5527b8b-ddad-4be7-bb9e-f4fa522606de tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:47.244961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5527b8b-ddad-4be7-bb9e-f4fa522606de tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:47.245844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5527b8b-ddad-4be7-bb9e-f4fa522606de tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:47.280712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-c5527b8b-ddad-4be7-bb9e-f4fa522606de tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Getting quotas for project ed7f6396840c4aa6b4b7d4ee83503eac. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:56:47.294009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-c5527b8b-ddad-4be7-bb9e-f4fa522606de tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Getting quotas for user 136249f42e0e41cc9567b1b3be298574 and project ed7f6396840c4aa6b4b7d4ee83503eac. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:56:47.317735 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c5527b8b-ddad-4be7-bb9e-f4fa522606de tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:56:47.321128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c5527b8b-ddad-4be7-bb9e-f4fa522606de tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] [instance: 7e11f28d-9567-4c2d-adb3-d52bb16b93b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:56:47.439688 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c5527b8b-ddad-4be7-bb9e-f4fa522606de tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.682577 Oct 29 02:56:47.440372 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1044/2286] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:56:44 2022] POST /compute/v2.1/servers => generated 409 bytes in 2684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 02:56:47.449138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a3ccde15-ed46-43d7-9e93-4015d8312c05 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Calling method '.version_select at 0x7ff053816c10>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:47.468108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3ccde15-ed46-43d7-9e93-4015d8312c05 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:47.468993 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3ccde15-ed46-43d7-9e93-4015d8312c05 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:47.471068 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3ccde15-ed46-43d7-9e93-4015d8312c05 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:47.488189 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a3ccde15-ed46-43d7-9e93-4015d8312c05 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 782 microversion: 2.1 time: 0.046445 Oct 29 02:56:47.491592 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1045/2287] 10.222.0.46 () {58 vars in 1143 bytes} [Sat Oct 29 02:56:47 2022] GET /compute/v2.1/os-migrations => generated 782 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:47.506808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f79db74a-c46c-4f4b-8a74-dd8341a83273 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:47.507630 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f79db74a-c46c-4f4b-8a74-dd8341a83273 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] [instance: 7e11f28d-9567-4c2d-adb3-d52bb16b93b6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:47.627618 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ea750838-7be5-4108-a0c6-877ded306961 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:47.642989 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ea750838-7be5-4108-a0c6-877ded306961 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1316 microversion: 2.1 time: 0.724005 Oct 29 02:56:47.644219 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1243/2288] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:46 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1316 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:47.660055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-85c556f0-aece-4cd9-8a59-d506f45f5dc9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:47.670452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-85c556f0-aece-4cd9-8a59-d506f45f5dc9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:47.684720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-85c556f0-aece-4cd9-8a59-d506f45f5dc9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:47.685646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-85c556f0-aece-4cd9-8a59-d506f45f5dc9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:47.695626 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-85c556f0-aece-4cd9-8a59-d506f45f5dc9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:47.696770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-85c556f0-aece-4cd9-8a59-d506f45f5dc9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:47.697426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-85c556f0-aece-4cd9-8a59-d506f45f5dc9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:47.698037 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-85c556f0-aece-4cd9-8a59-d506f45f5dc9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:47.733085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f79db74a-c46c-4f4b-8a74-dd8341a83273 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136249f42e0e41cc9567b1b3be298574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f6396840c4aa6b4b7d4ee83503eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:47.749454 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f79db74a-c46c-4f4b-8a74-dd8341a83273 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] 10.222.0.46 "GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6" status: 200 len: 1277 microversion: 2.1 time: 0.251045 Oct 29 02:56:47.757833 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1046/2289] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:47 2022] GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6 => generated 1277 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:47.768624 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-69ebf880-3b7e-415e-9182-5e667a54e938 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:47.785729 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-69ebf880-3b7e-415e-9182-5e667a54e938 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:47.802757 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-69ebf880-3b7e-415e-9182-5e667a54e938 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:47.803390 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-69ebf880-3b7e-415e-9182-5e667a54e938 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:47.804083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-69ebf880-3b7e-415e-9182-5e667a54e938 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:47.806308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-69ebf880-3b7e-415e-9182-5e667a54e938 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:47.807269 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-69ebf880-3b7e-415e-9182-5e667a54e938 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:47.807951 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-69ebf880-3b7e-415e-9182-5e667a54e938 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:48.338500 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-69ebf880-3b7e-415e-9182-5e667a54e938 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406" status: 200 len: 1630 microversion: 2.1 time: 0.579134 Oct 29 02:56:48.344349 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1047/2290] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:47 2022] GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 => generated 1630 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:48.374313 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4f6d7663-3d40-4db4-8d5a-b27238348705 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Action: 'create', calling method: .version_select at 0x7ff053704940>, body: {"keypair": {"name": "tempest-keypair-1238694404", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtlDdQd6YCY0jdzi05PBiuLmSsH84PT7cXLpOm7VdHKRHAO6FcC8bYwX0HWvuokXss3gnPqgntThDW0/uK4WAE9p9hYmQPtPEXvGwvkMc7qZFFkWYfGi3daMhfWIdb3eQ=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:48.407234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-4f6d7663-3d40-4db4-8d5a-b27238348705 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Getting quotas for project cb1c877c178847ad8e652dda9a20e724. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:56:48.420868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-4f6d7663-3d40-4db4-8d5a-b27238348705 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Getting quotas for user 68198185a8314417b2b5d09e831ff4fd and project cb1c877c178847ad8e652dda9a20e724. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:56:48.473795 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4f6d7663-3d40-4db4-8d5a-b27238348705 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.103149 Oct 29 02:56:48.481866 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1048/2291] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 02:56:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:48.671842 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3b0b55e5-7100-437c-a5c0-27bfd055b11f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:48.672617 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3b0b55e5-7100-437c-a5c0-27bfd055b11f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:48.684939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b0b55e5-7100-437c-a5c0-27bfd055b11f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:48.685950 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b0b55e5-7100-437c-a5c0-27bfd055b11f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:48.686605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b0b55e5-7100-437c-a5c0-27bfd055b11f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:48.687570 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b0b55e5-7100-437c-a5c0-27bfd055b11f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:48.688337 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b0b55e5-7100-437c-a5c0-27bfd055b11f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:48.694414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b0b55e5-7100-437c-a5c0-27bfd055b11f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:48.750379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-85c556f0-aece-4cd9-8a59-d506f45f5dc9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:48.777631 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-85c556f0-aece-4cd9-8a59-d506f45f5dc9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1514 microversion: 2.1 time: 1.130146 Oct 29 02:56:48.781035 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1244/2292] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:47 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1514 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:48.791608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-545ada63-8eea-4919-b578-6d26a867a9e1 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:48.793952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-545ada63-8eea-4919-b578-6d26a867a9e1 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] [instance: 7e11f28d-9567-4c2d-adb3-d52bb16b93b6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:48.815743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-545ada63-8eea-4919-b578-6d26a867a9e1 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:48.817946 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-545ada63-8eea-4919-b578-6d26a867a9e1 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:48.819534 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-545ada63-8eea-4919-b578-6d26a867a9e1 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:48.820690 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-545ada63-8eea-4919-b578-6d26a867a9e1 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:48.821992 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-545ada63-8eea-4919-b578-6d26a867a9e1 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:48.824115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-545ada63-8eea-4919-b578-6d26a867a9e1 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:49.107730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-545ada63-8eea-4919-b578-6d26a867a9e1 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136249f42e0e41cc9567b1b3be298574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f6396840c4aa6b4b7d4ee83503eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:49.121930 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-545ada63-8eea-4919-b578-6d26a867a9e1 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] 10.222.0.46 "GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6" status: 200 len: 1281 microversion: 2.1 time: 0.339138 Oct 29 02:56:49.147464 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1245/2293] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:48 2022] GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6 => generated 1281 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:49.298107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3b0b55e5-7100-437c-a5c0-27bfd055b11f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:49.311859 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3b0b55e5-7100-437c-a5c0-27bfd055b11f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.644337 Oct 29 02:56:49.315520 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1049/2294] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:48 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:49.402512 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e5b88435-2c19-40a5-84a4-a125a83cd290 tempest-FloatingIPDetailsNegativeTestJSON-1275393002 tempest-FloatingIPDetailsNegativeTestJSON-1275393002-project] Calling method '.version_select at 0x7ff0581be310>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:49.608944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3e2eae13-01e1-4ead-95a1-5694dd25ef43 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-78618377", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "6a22f1bf-9a27-4375-9469-db16defea274"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:49.631197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG neutronclient.v2_0.client [None req-e5b88435-2c19-40a5-84a4-a125a83cd290 tempest-FloatingIPDetailsNegativeTestJSON-1275393002 tempest-FloatingIPDetailsNegativeTestJSON-1275393002-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 0d6388cb-62dc-46a7-8507-35e1387563c4 could not be found", "detail": ""}} {{(pid=127124) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 29 02:56:49.631999 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-e5b88435-2c19-40a5-84a4-a125a83cd290 tempest-FloatingIPDetailsNegativeTestJSON-1275393002 tempest-FloatingIPDetailsNegativeTestJSON-1275393002-project] HTTP exception thrown: Floating IP not found for ID 0d6388cb-62dc-46a7-8507-35e1387563c4 Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e5b88435-2c19-40a5-84a4-a125a83cd290 tempest-FloatingIPDetailsNegativeTestJSON-1275393002 tempest-FloatingIPDetailsNegativeTestJSON-1275393002-project] Request method failure captured: Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/os-floating-ips/0d6388cb-62dc-46a7-8507-35e1387563c4 HTTP/1.1 Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJZxWvW0O80ymi6Hole2pg2DKPMUY6OTKClGP3Jjc0ZMf8-uDGT3LaXIwqusEd180wxnqBa0H5gl0GgofE5ZXc2tn3qNkogeud9WfROl0IH10j_t612f_fXVnCy3VLMO1cyoOW0pfIjjmi9GIAj62JRG_1DUTFewInU-VBpJGVIl3bQ Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: cc947bc3c38d4790897d4b962d3ec0e8 Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1275393002 Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cc947bc3c38d4790897d4b962d3ec0e8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cc947bc3c38d4790897d4b962d3ec0e8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_cc947bc3c38d4790897d4b962d3ec0e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/cc947bc3c38d4790897d4b962d3ec0e8"}]}] Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1275393002 Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: cc947bc3c38d4790897d4b962d3ec0e8 Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1275393002 Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1275393002-project Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 00c8fe6f6c064d1d8e4cab8fe237a309 Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1275393002-project Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: exception: Floating IP not found for ID 0d6388cb-62dc-46a7-8507-35e1387563c4 Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '0d6388cb-62dc-46a7-8507-35e1387563c4'} Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 29 02:56:49.634119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 0d6388cb-62dc-46a7-8507-35e1387563c4 could not be found Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9fa6ee9-a3bb-4a67-8c9e-8a0ce02cd1aa'] Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 0d6388cb-62dc-46a7-8507-35e1387563c4. Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 0d6388cb-62dc-46a7-8507-35e1387563c4 Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 0d6388cb-62dc-46a7-8507-35e1387563c4 Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e5b88435-2c19-40a5-84a4-a125a83cd290 tempest-FloatingIPDetailsNegativeTestJSON-1275393002 tempest-FloatingIPDetailsNegativeTestJSON-1275393002-project] Returning 404 to user: Floating IP not found for ID 0d6388cb-62dc-46a7-8507-35e1387563c4 {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e5b88435-2c19-40a5-84a4-a125a83cd290 tempest-FloatingIPDetailsNegativeTestJSON-1275393002 tempest-FloatingIPDetailsNegativeTestJSON-1275393002-project] 10.222.0.46 "GET /compute/v2.1/os-floating-ips/0d6388cb-62dc-46a7-8507-35e1387563c4" status: 404 len: 111 microversion: 2.1 time: 0.374427 Oct 29 02:56:49.641445 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1246/2295] 10.222.0.46 () {58 vars in 1260 bytes} [Sat Oct 29 02:56:49 2022] GET /compute/v2.1/os-floating-ips/0d6388cb-62dc-46a7-8507-35e1387563c4 => generated 111 bytes in 376 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:56:49.741730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-3e2eae13-01e1-4ead-95a1-5694dd25ef43 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] validate_networks() for [('6a22f1bf-9a27-4375-9469-db16defea274', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:56:49.819437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d03344d7-9222-4b05-9618-30603148351c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:49.820674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d03344d7-9222-4b05-9618-30603148351c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:49.834556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d03344d7-9222-4b05-9618-30603148351c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:49.839818 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d03344d7-9222-4b05-9618-30603148351c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:49.840496 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d03344d7-9222-4b05-9618-30603148351c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:49.842232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d03344d7-9222-4b05-9618-30603148351c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:49.842854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d03344d7-9222-4b05-9618-30603148351c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:49.843502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d03344d7-9222-4b05-9618-30603148351c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:50.392212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d03344d7-9222-4b05-9618-30603148351c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:50.407701 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d03344d7-9222-4b05-9618-30603148351c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1514 microversion: 2.1 time: 0.593961 Oct 29 02:56:50.409298 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1247/2296] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:49 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1514 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:50.420558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c3c4d1b8-4d81-4c9b-b636-aa60fb65a16e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:50.421213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c3c4d1b8-4d81-4c9b-b636-aa60fb65a16e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] [instance: 7e11f28d-9567-4c2d-adb3-d52bb16b93b6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:50.434204 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3c4d1b8-4d81-4c9b-b636-aa60fb65a16e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:50.434699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3c4d1b8-4d81-4c9b-b636-aa60fb65a16e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:50.435142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3c4d1b8-4d81-4c9b-b636-aa60fb65a16e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:50.435855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3c4d1b8-4d81-4c9b-b636-aa60fb65a16e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:50.436310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3c4d1b8-4d81-4c9b-b636-aa60fb65a16e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:50.436769 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3c4d1b8-4d81-4c9b-b636-aa60fb65a16e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:50.549037 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c3c4d1b8-4d81-4c9b-b636-aa60fb65a16e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136249f42e0e41cc9567b1b3be298574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f6396840c4aa6b4b7d4ee83503eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:50.574561 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c3c4d1b8-4d81-4c9b-b636-aa60fb65a16e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] 10.222.0.46 "GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6" status: 200 len: 1335 microversion: 2.1 time: 0.163045 Oct 29 02:56:50.578305 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1248/2297] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:50 2022] GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6 => generated 1335 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:51.432658 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e67141bb-9ba9-417f-8554-84c2fb5b756f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:51.435730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e67141bb-9ba9-417f-8554-84c2fb5b756f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:51.445416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e67141bb-9ba9-417f-8554-84c2fb5b756f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:51.446466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e67141bb-9ba9-417f-8554-84c2fb5b756f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:51.447250 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e67141bb-9ba9-417f-8554-84c2fb5b756f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:51.448188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e67141bb-9ba9-417f-8554-84c2fb5b756f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:51.448888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e67141bb-9ba9-417f-8554-84c2fb5b756f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:51.449555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e67141bb-9ba9-417f-8554-84c2fb5b756f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:51.708099 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e67141bb-9ba9-417f-8554-84c2fb5b756f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:51.718987 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e67141bb-9ba9-417f-8554-84c2fb5b756f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1514 microversion: 2.1 time: 0.290825 Oct 29 02:56:51.734173 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1249/2298] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:51 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1514 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:51.749089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-07fc4f65-d26f-488b-b65a-88af2f2a334f tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:51.753117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-07fc4f65-d26f-488b-b65a-88af2f2a334f tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] [instance: 7e11f28d-9567-4c2d-adb3-d52bb16b93b6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:51.761863 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07fc4f65-d26f-488b-b65a-88af2f2a334f tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:51.762441 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07fc4f65-d26f-488b-b65a-88af2f2a334f tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:51.762878 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07fc4f65-d26f-488b-b65a-88af2f2a334f tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:51.763604 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07fc4f65-d26f-488b-b65a-88af2f2a334f tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:51.764383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07fc4f65-d26f-488b-b65a-88af2f2a334f tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:51.765020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07fc4f65-d26f-488b-b65a-88af2f2a334f tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:51.904364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-07fc4f65-d26f-488b-b65a-88af2f2a334f tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136249f42e0e41cc9567b1b3be298574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f6396840c4aa6b4b7d4ee83503eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:51.921099 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-07fc4f65-d26f-488b-b65a-88af2f2a334f tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] 10.222.0.46 "GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6" status: 200 len: 1335 microversion: 2.1 time: 0.185263 Oct 29 02:56:51.936791 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1250/2299] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:51 2022] GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6 => generated 1335 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:52.201374 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-3e2eae13-01e1-4ead-95a1-5694dd25ef43 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:56:52.202696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-3e2eae13-01e1-4ead-95a1-5694dd25ef43 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:56:52.206175 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-3e2eae13-01e1-4ead-95a1-5694dd25ef43 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:56:52.206856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-3e2eae13-01e1-4ead-95a1-5694dd25ef43 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:56:52.207489 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-3e2eae13-01e1-4ead-95a1-5694dd25ef43 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:56:52.234061 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e2eae13-01e1-4ead-95a1-5694dd25ef43 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:52.235608 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e2eae13-01e1-4ead-95a1-5694dd25ef43 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:52.237299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e2eae13-01e1-4ead-95a1-5694dd25ef43 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:52.239082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e2eae13-01e1-4ead-95a1-5694dd25ef43 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:52.240970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e2eae13-01e1-4ead-95a1-5694dd25ef43 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:52.243050 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e2eae13-01e1-4ead-95a1-5694dd25ef43 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:52.273838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2e2800b9-de07-4108-9588-d730b980bac2 tempest-QuotasTestJSON-1007940187 tempest-QuotasTestJSON-1007940187-project] Calling method '.version_select at 0x7ff05c0b8700>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:52.280694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-3e2eae13-01e1-4ead-95a1-5694dd25ef43 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Getting quotas for project fab9e02a4cb341348f0611afa2293cd0. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:56:52.288915 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-3e2eae13-01e1-4ead-95a1-5694dd25ef43 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Getting quotas for user 3507c0ada3424029805469182f328379 and project fab9e02a4cb341348f0611afa2293cd0. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:56:52.333489 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3e2eae13-01e1-4ead-95a1-5694dd25ef43 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:56:52.335437 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3e2eae13-01e1-4ead-95a1-5694dd25ef43 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 9e23df79-0a40-4417-9312-723fdb1638d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:56:52.359785 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2e2800b9-de07-4108-9588-d730b980bac2 tempest-QuotasTestJSON-1007940187 tempest-QuotasTestJSON-1007940187-project] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/522e2df4dfa041a689b144f8fdd6bbd7/defaults" status: 200 len: 371 microversion: 2.1 time: 0.335134 Oct 29 02:56:52.360386 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1251/2300] 10.222.0.46 () {58 vars in 1269 bytes} [Sat Oct 29 02:56:52 2022] GET /compute/v2.1/os-quota-sets/522e2df4dfa041a689b144f8fdd6bbd7/defaults => generated 371 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:52.375480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-30311b17-64bf-4d59-bcf0-bce68b0cd1e9 tempest-QuotasTestJSON-1007940187 tempest-QuotasTestJSON-1007940187-project] Calling method '.version_select at 0x7ff058160940>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:52.450710 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3e2eae13-01e1-4ead-95a1-5694dd25ef43 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.846514 Oct 29 02:56:52.460438 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1050/2301] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:56:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:56:52.482934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b07c9937-e08c-4a43-bba0-6725f8417793 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:52.487276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b07c9937-e08c-4a43-bba0-6725f8417793 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 9e23df79-0a40-4417-9312-723fdb1638d0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:52.558252 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-30311b17-64bf-4d59-bcf0-bce68b0cd1e9 tempest-QuotasTestJSON-1007940187 tempest-QuotasTestJSON-1007940187-project] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/522e2df4dfa041a689b144f8fdd6bbd7" status: 200 len: 371 microversion: 2.1 time: 0.188993 Oct 29 02:56:52.561377 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1252/2302] 10.222.0.46 () {58 vars in 1242 bytes} [Sat Oct 29 02:56:52 2022] GET /compute/v2.1/os-quota-sets/522e2df4dfa041a689b144f8fdd6bbd7 => generated 371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:52.579647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dd647897-3d9c-4af6-b156-12db21dbaeb8 tempest-QuotasTestJSON-1007940187 tempest-QuotasTestJSON-1007940187-project] Calling method '.version_select at 0x7ff0581603a0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:52.621465 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b07c9937-e08c-4a43-bba0-6725f8417793 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:52.632315 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b07c9937-e08c-4a43-bba0-6725f8417793 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0" status: 200 len: 1215 microversion: 2.1 time: 0.164300 Oct 29 02:56:52.634239 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1051/2303] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:52 2022] GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0 => generated 1215 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:52.699107 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dd647897-3d9c-4af6-b156-12db21dbaeb8 tempest-QuotasTestJSON-1007940187 tempest-QuotasTestJSON-1007940187-project] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/522e2df4dfa041a689b144f8fdd6bbd7/defaults" status: 200 len: 371 microversion: 2.1 time: 0.125377 Oct 29 02:56:52.702962 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1253/2304] 10.222.0.46 () {58 vars in 1269 bytes} [Sat Oct 29 02:56:52 2022] GET /compute/v2.1/os-quota-sets/522e2df4dfa041a689b144f8fdd6bbd7/defaults => generated 371 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:52.714848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1565f1f4-5458-464c-a6a0-95ec7a86681f tempest-QuotasTestJSON-1007940187 tempest-QuotasTestJSON-1007940187-project] Calling method '.version_select at 0x7ff053aa4c10>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:52.747751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-275c0075-23fc-4c71-9e50-8b0d2d7bd290 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:52.749028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-275c0075-23fc-4c71-9e50-8b0d2d7bd290 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:52.764642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-275c0075-23fc-4c71-9e50-8b0d2d7bd290 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:52.765364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-275c0075-23fc-4c71-9e50-8b0d2d7bd290 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:52.769938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-275c0075-23fc-4c71-9e50-8b0d2d7bd290 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:52.770707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-275c0075-23fc-4c71-9e50-8b0d2d7bd290 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:52.771186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-275c0075-23fc-4c71-9e50-8b0d2d7bd290 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:52.771697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-275c0075-23fc-4c71-9e50-8b0d2d7bd290 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:52.910417 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1565f1f4-5458-464c-a6a0-95ec7a86681f tempest-QuotasTestJSON-1007940187 tempest-QuotasTestJSON-1007940187-project] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/522e2df4dfa041a689b144f8fdd6bbd7" status: 200 len: 371 microversion: 2.1 time: 0.199870 Oct 29 02:56:52.913408 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1052/2305] 10.222.0.46 () {58 vars in 1242 bytes} [Sat Oct 29 02:56:52 2022] GET /compute/v2.1/os-quota-sets/522e2df4dfa041a689b144f8fdd6bbd7 => generated 371 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:52.949586 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f4eb533e-c89a-41ea-846f-7bae90603540 tempest-QuotasTestJSON-1007940187 tempest-QuotasTestJSON-1007940187-project] Calling method '.version_select at 0x7ff053a6b4c0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:53.136007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:DELETE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:53.149956 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-275c0075-23fc-4c71-9e50-8b0d2d7bd290 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:53.157543 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f4eb533e-c89a-41ea-846f-7bae90603540 tempest-QuotasTestJSON-1007940187 tempest-QuotasTestJSON-1007940187-project] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/522e2df4dfa041a689b144f8fdd6bbd7?user_id=13174327a2a743cdb220a15528419501" status: 200 len: 371 microversion: 2.1 time: 0.229397 Oct 29 02:56:53.158172 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1053/2306] 10.222.0.46 () {58 vars in 1323 bytes} [Sat Oct 29 02:56:52 2022] GET /compute/v2.1/os-quota-sets/522e2df4dfa041a689b144f8fdd6bbd7?user_id=13174327a2a743cdb220a15528419501 => generated 371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:53.166556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7d9b0373-241d-43c4-a5a5-e6899552cb55 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:53.166556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7d9b0373-241d-43c4-a5a5-e6899552cb55 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] [instance: 7e11f28d-9567-4c2d-adb3-d52bb16b93b6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:53.183653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7d9b0373-241d-43c4-a5a5-e6899552cb55 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:53.184151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7d9b0373-241d-43c4-a5a5-e6899552cb55 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:53.184611 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7d9b0373-241d-43c4-a5a5-e6899552cb55 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:53.184979 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-275c0075-23fc-4c71-9e50-8b0d2d7bd290 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1514 microversion: 2.1 time: 0.440385 Oct 29 02:56:53.185337 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7d9b0373-241d-43c4-a5a5-e6899552cb55 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:53.185784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7d9b0373-241d-43c4-a5a5-e6899552cb55 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:53.186219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7d9b0373-241d-43c4-a5a5-e6899552cb55 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:53.187174 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1254/2307] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:52 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1514 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:53.662860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-00b35790-997c-45b4-93f8-06dc959159e8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:53.663493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-00b35790-997c-45b4-93f8-06dc959159e8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 9e23df79-0a40-4417-9312-723fdb1638d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:53.679532 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00b35790-997c-45b4-93f8-06dc959159e8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:53.680074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00b35790-997c-45b4-93f8-06dc959159e8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:53.681180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00b35790-997c-45b4-93f8-06dc959159e8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:53.683568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00b35790-997c-45b4-93f8-06dc959159e8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:53.685313 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00b35790-997c-45b4-93f8-06dc959159e8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:53.686385 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00b35790-997c-45b4-93f8-06dc959159e8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:53.694464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7d9b0373-241d-43c4-a5a5-e6899552cb55 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136249f42e0e41cc9567b1b3be298574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f6396840c4aa6b4b7d4ee83503eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:53.711337 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7d9b0373-241d-43c4-a5a5-e6899552cb55 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] 10.222.0.46 "GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6" status: 200 len: 1403 microversion: 2.1 time: 0.551683 Oct 29 02:56:53.733712 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1054/2308] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:53 2022] GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6 => generated 1403 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:53.967340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-00b35790-997c-45b4-93f8-06dc959159e8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:53.988868 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-00b35790-997c-45b4-93f8-06dc959159e8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0" status: 200 len: 1211 microversion: 2.1 time: 0.318382 Oct 29 02:56:53.989616 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1255/2309] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:53 2022] GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0 => generated 1211 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:54.209147 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e4baebf2-6d4c-482a-be99-21700ac63525 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:54.210458 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e4baebf2-6d4c-482a-be99-21700ac63525 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:54.222756 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e4baebf2-6d4c-482a-be99-21700ac63525 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:54.224676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e4baebf2-6d4c-482a-be99-21700ac63525 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:54.234323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e4baebf2-6d4c-482a-be99-21700ac63525 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:54.235274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e4baebf2-6d4c-482a-be99-21700ac63525 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:54.235663 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e4baebf2-6d4c-482a-be99-21700ac63525 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:54.236094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e4baebf2-6d4c-482a-be99-21700ac63525 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:54.256744 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bb0a5a5a-8882-45e3-903c-55adff096a8a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1376788585", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "bca2d547-c353-4bb4-a9d9-94595c523fe6"}], "security_groups": [{"name": "tempest-securitygroup--1992373704"}], "key_name": "tempest-keypair-1238694404", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:54.493139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-bb0a5a5a-8882-45e3-903c-55adff096a8a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] validate_networks() for [('bca2d547-c353-4bb4-a9d9-94595c523fe6', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:56:55.284323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e4baebf2-6d4c-482a-be99-21700ac63525 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:55.295727 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e4baebf2-6d4c-482a-be99-21700ac63525 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1514 microversion: 2.1 time: 1.090443 Oct 29 02:56:55.297179 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1055/2310] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:54 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1514 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:55.302980 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-290de932-43b0-4d70-9318-feec73b3d69d tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:55.304233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-290de932-43b0-4d70-9318-feec73b3d69d tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] [instance: 7e11f28d-9567-4c2d-adb3-d52bb16b93b6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:55.311134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-290de932-43b0-4d70-9318-feec73b3d69d tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:55.311864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-290de932-43b0-4d70-9318-feec73b3d69d tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:55.312495 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-290de932-43b0-4d70-9318-feec73b3d69d tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:55.313729 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-290de932-43b0-4d70-9318-feec73b3d69d tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:55.314655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-290de932-43b0-4d70-9318-feec73b3d69d tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:55.315338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-290de932-43b0-4d70-9318-feec73b3d69d tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:55.861679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-290de932-43b0-4d70-9318-feec73b3d69d tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136249f42e0e41cc9567b1b3be298574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f6396840c4aa6b4b7d4ee83503eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:55.892849 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-290de932-43b0-4d70-9318-feec73b3d69d tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] 10.222.0.46 "GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6" status: 200 len: 1403 microversion: 2.1 time: 0.577376 Oct 29 02:56:55.895517 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1056/2311] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:55 2022] GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6 => generated 1403 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:55.924477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9f727600-183f-4462-833b-d642ef8dbad6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:55.926155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9f727600-183f-4462-833b-d642ef8dbad6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 9e23df79-0a40-4417-9312-723fdb1638d0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:55.931475 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-bb0a5a5a-8882-45e3-903c-55adff096a8a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:56:55.932292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-bb0a5a5a-8882-45e3-903c-55adff096a8a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:56:55.933045 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-bb0a5a5a-8882-45e3-903c-55adff096a8a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:56:55.933457 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-bb0a5a5a-8882-45e3-903c-55adff096a8a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:56:55.934631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-bb0a5a5a-8882-45e3-903c-55adff096a8a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:56:55.941685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f727600-183f-4462-833b-d642ef8dbad6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:55.944981 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f727600-183f-4462-833b-d642ef8dbad6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:55.947516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f727600-183f-4462-833b-d642ef8dbad6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:55.953541 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f727600-183f-4462-833b-d642ef8dbad6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:55.954021 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f727600-183f-4462-833b-d642ef8dbad6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:55.954457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f727600-183f-4462-833b-d642ef8dbad6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:55.955956 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb0a5a5a-8882-45e3-903c-55adff096a8a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:55.956472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb0a5a5a-8882-45e3-903c-55adff096a8a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:55.956945 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb0a5a5a-8882-45e3-903c-55adff096a8a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:55.957710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb0a5a5a-8882-45e3-903c-55adff096a8a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:55.958159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb0a5a5a-8882-45e3-903c-55adff096a8a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:55.958586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb0a5a5a-8882-45e3-903c-55adff096a8a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:56.006856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-bb0a5a5a-8882-45e3-903c-55adff096a8a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Getting quotas for project cb1c877c178847ad8e652dda9a20e724. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:56:56.018599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-bb0a5a5a-8882-45e3-903c-55adff096a8a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Getting quotas for user 68198185a8314417b2b5d09e831ff4fd and project cb1c877c178847ad8e652dda9a20e724. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:56:56.052165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bb0a5a5a-8882-45e3-903c-55adff096a8a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:56:56.059928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bb0a5a5a-8882-45e3-903c-55adff096a8a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:56:56.172107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9f727600-183f-4462-833b-d642ef8dbad6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:56.183948 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9f727600-183f-4462-833b-d642ef8dbad6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0" status: 200 len: 1273 microversion: 2.1 time: 0.286206 Oct 29 02:56:56.185074 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1057/2312] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:55 2022] GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0 => generated 1273 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:56.194688 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bb0a5a5a-8882-45e3-903c-55adff096a8a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.942223 Oct 29 02:56:56.205305 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1256/2313] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:56:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 02:56:56.208480 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-817968d1-3b67-4dac-b83b-aad65383c165 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:56.209481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-817968d1-3b67-4dac-b83b-aad65383c165 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:56.325013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2af2b93d-526d-480f-93de-f140289b77f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:56.326542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2af2b93d-526d-480f-93de-f140289b77f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:56.339225 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2af2b93d-526d-480f-93de-f140289b77f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:56.341431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2af2b93d-526d-480f-93de-f140289b77f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:56.341806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-817968d1-3b67-4dac-b83b-aad65383c165 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:56.342696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2af2b93d-526d-480f-93de-f140289b77f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:56.345638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2af2b93d-526d-480f-93de-f140289b77f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:56.348772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2af2b93d-526d-480f-93de-f140289b77f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:56.349766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2af2b93d-526d-480f-93de-f140289b77f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:56.358611 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-817968d1-3b67-4dac-b83b-aad65383c165 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1235 microversion: 2.1 time: 0.153071 Oct 29 02:56:56.363078 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1058/2314] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:56 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1235 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:56.427663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=100 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:56.921635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-70255c4a-bd72-468d-ab71-7e73b151a906 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:56.922508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-70255c4a-bd72-468d-ab71-7e73b151a906 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] [instance: 7e11f28d-9567-4c2d-adb3-d52bb16b93b6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:56.948582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70255c4a-bd72-468d-ab71-7e73b151a906 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:56.951271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70255c4a-bd72-468d-ab71-7e73b151a906 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:56.952791 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70255c4a-bd72-468d-ab71-7e73b151a906 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:56.953795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70255c4a-bd72-468d-ab71-7e73b151a906 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:56.955699 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70255c4a-bd72-468d-ab71-7e73b151a906 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:56.958386 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70255c4a-bd72-468d-ab71-7e73b151a906 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:57.154231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2af2b93d-526d-480f-93de-f140289b77f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:57.171865 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2af2b93d-526d-480f-93de-f140289b77f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1514 microversion: 2.1 time: 0.852136 Oct 29 02:56:57.175958 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1257/2315] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:56 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1514 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:57.190883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-a05f3784-ec74-476c-9f75-25a50fbbbfb7 req-7fcab0b9-933d-4dfa-a1c8-92db40d2d015 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e11f28d-9567-4c2d-adb3-d52bb16b93b6", "tag": "a21f1d05-4754-4e9d-9849-353c2eea93bc"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:56:57.237775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a05f3784-ec74-476c-9f75-25a50fbbbfb7 req-7fcab0b9-933d-4dfa-a1c8-92db40d2d015 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:57.239667 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a05f3784-ec74-476c-9f75-25a50fbbbfb7 req-7fcab0b9-933d-4dfa-a1c8-92db40d2d015 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:57.241191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a05f3784-ec74-476c-9f75-25a50fbbbfb7 req-7fcab0b9-933d-4dfa-a1c8-92db40d2d015 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:57.275587 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-a05f3784-ec74-476c-9f75-25a50fbbbfb7 req-7fcab0b9-933d-4dfa-a1c8-92db40d2d015 service nova] Creating event network-changed:a21f1d05-4754-4e9d-9849-353c2eea93bc for instance 7e11f28d-9567-4c2d-adb3-d52bb16b93b6 on n-h1-862967-2 Oct 29 02:56:57.290843 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-a05f3784-ec74-476c-9f75-25a50fbbbfb7 req-7fcab0b9-933d-4dfa-a1c8-92db40d2d015 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113314 Oct 29 02:56:57.292837 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1258/2316] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:56:57.299364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8c0e66b3-3845-4e10-8c23-4e25a9750008 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:57.300456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8c0e66b3-3845-4e10-8c23-4e25a9750008 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 9e23df79-0a40-4417-9312-723fdb1638d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:57.313619 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c0e66b3-3845-4e10-8c23-4e25a9750008 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:57.314589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c0e66b3-3845-4e10-8c23-4e25a9750008 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:57.315336 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c0e66b3-3845-4e10-8c23-4e25a9750008 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:57.316379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c0e66b3-3845-4e10-8c23-4e25a9750008 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:57.317159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c0e66b3-3845-4e10-8c23-4e25a9750008 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:57.317802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c0e66b3-3845-4e10-8c23-4e25a9750008 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:57.480936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8c0e66b3-3845-4e10-8c23-4e25a9750008 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:57.491893 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8c0e66b3-3845-4e10-8c23-4e25a9750008 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0" status: 200 len: 1273 microversion: 2.1 time: 0.196651 Oct 29 02:56:57.516130 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-70255c4a-bd72-468d-ab71-7e73b151a906 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136249f42e0e41cc9567b1b3be298574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f6396840c4aa6b4b7d4ee83503eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:57.519700 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1259/2317] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:57 2022] GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0 => generated 1273 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:57.525490 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-70255c4a-bd72-468d-ab71-7e73b151a906 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] 10.222.0.46 "GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6" status: 200 len: 1403 microversion: 2.1 time: 0.609296 Oct 29 02:56:57.525826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-98b75bca-e26a-42cc-b462-c57a8d9e0d0a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:57.526727 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1059/2318] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:56 2022] GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6 => generated 1403 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:56:57.537615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-98b75bca-e26a-42cc-b462-c57a8d9e0d0a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:57.550267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-98b75bca-e26a-42cc-b462-c57a8d9e0d0a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:57.551103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-98b75bca-e26a-42cc-b462-c57a8d9e0d0a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:57.551730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-98b75bca-e26a-42cc-b462-c57a8d9e0d0a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:57.552676 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-98b75bca-e26a-42cc-b462-c57a8d9e0d0a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:57.553463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-98b75bca-e26a-42cc-b462-c57a8d9e0d0a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:57.554153 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-98b75bca-e26a-42cc-b462-c57a8d9e0d0a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:57.658488 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-98b75bca-e26a-42cc-b462-c57a8d9e0d0a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:57.669749 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-98b75bca-e26a-42cc-b462-c57a8d9e0d0a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1287 microversion: 2.1 time: 0.148389 Oct 29 02:56:57.689197 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1260/2319] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:57 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1287 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:58.202535 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e51be21e-ae13-4e22-bbe0-6cc039035da2 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:58.203170 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e51be21e-ae13-4e22-bbe0-6cc039035da2 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:58.226842 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e51be21e-ae13-4e22-bbe0-6cc039035da2 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:58.227586 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e51be21e-ae13-4e22-bbe0-6cc039035da2 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:58.228046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e51be21e-ae13-4e22-bbe0-6cc039035da2 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:58.228895 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e51be21e-ae13-4e22-bbe0-6cc039035da2 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:58.230333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e51be21e-ae13-4e22-bbe0-6cc039035da2 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:58.230956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e51be21e-ae13-4e22-bbe0-6cc039035da2 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:58.517627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1cc3d09b-4727-4bf8-9c7b-7d7ed4200aee tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:58.520640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1cc3d09b-4727-4bf8-9c7b-7d7ed4200aee tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 9e23df79-0a40-4417-9312-723fdb1638d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:58.532045 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cc3d09b-4727-4bf8-9c7b-7d7ed4200aee tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:58.533257 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cc3d09b-4727-4bf8-9c7b-7d7ed4200aee tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:58.534094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cc3d09b-4727-4bf8-9c7b-7d7ed4200aee tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:58.534876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cc3d09b-4727-4bf8-9c7b-7d7ed4200aee tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:58.535533 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cc3d09b-4727-4bf8-9c7b-7d7ed4200aee tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:58.536189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cc3d09b-4727-4bf8-9c7b-7d7ed4200aee tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:58.723219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e51be21e-ae13-4e22-bbe0-6cc039035da2 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:58.739563 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e51be21e-ae13-4e22-bbe0-6cc039035da2 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1514 microversion: 2.1 time: 0.544626 Oct 29 02:56:58.741177 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1060/2320] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:58 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1514 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:58.749525 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ba5012fc-7d10-4427-abe0-0ab0824ed075 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:58.750743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ba5012fc-7d10-4427-abe0-0ab0824ed075 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] [instance: 7e11f28d-9567-4c2d-adb3-d52bb16b93b6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:58.759071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba5012fc-7d10-4427-abe0-0ab0824ed075 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:58.760114 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba5012fc-7d10-4427-abe0-0ab0824ed075 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:58.760774 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba5012fc-7d10-4427-abe0-0ab0824ed075 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:58.764497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba5012fc-7d10-4427-abe0-0ab0824ed075 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:58.765206 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba5012fc-7d10-4427-abe0-0ab0824ed075 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:58.766306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba5012fc-7d10-4427-abe0-0ab0824ed075 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:58.858190 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1cc3d09b-4727-4bf8-9c7b-7d7ed4200aee tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:58.866747 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1cc3d09b-4727-4bf8-9c7b-7d7ed4200aee tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0" status: 200 len: 1315 microversion: 2.1 time: 0.354386 Oct 29 02:56:58.871827 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1261/2321] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:58 2022] GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0 => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:58.877132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8c42d741-59b2-4583-880e-82cfd83b33cc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:58.884165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8c42d741-59b2-4583-880e-82cfd83b33cc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:58.902759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c42d741-59b2-4583-880e-82cfd83b33cc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:58.903260 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c42d741-59b2-4583-880e-82cfd83b33cc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:58.903935 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c42d741-59b2-4583-880e-82cfd83b33cc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:58.904719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c42d741-59b2-4583-880e-82cfd83b33cc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:58.910221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c42d741-59b2-4583-880e-82cfd83b33cc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:58.916968 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c42d741-59b2-4583-880e-82cfd83b33cc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:59.043245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8c42d741-59b2-4583-880e-82cfd83b33cc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:59.077588 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8c42d741-59b2-4583-880e-82cfd83b33cc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1295 microversion: 2.1 time: 0.196795 Oct 29 02:56:59.078761 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1262/2322] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:58 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1295 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:59.138140 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ba5012fc-7d10-4427-abe0-0ab0824ed075 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136249f42e0e41cc9567b1b3be298574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f6396840c4aa6b4b7d4ee83503eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:56:59.178280 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ba5012fc-7d10-4427-abe0-0ab0824ed075 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] 10.222.0.46 "GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6" status: 200 len: 1403 microversion: 2.1 time: 0.434837 Oct 29 02:56:59.179874 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1061/2323] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:58 2022] GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6 => generated 1403 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:56:59.770297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-99772e52-1cc8-4d52-9dca-812cbf89db52 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:59.773109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-99772e52-1cc8-4d52-9dca-812cbf89db52 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:59.804223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-99772e52-1cc8-4d52-9dca-812cbf89db52 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:59.805048 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-99772e52-1cc8-4d52-9dca-812cbf89db52 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:59.807052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-99772e52-1cc8-4d52-9dca-812cbf89db52 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:59.808192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-99772e52-1cc8-4d52-9dca-812cbf89db52 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:59.812664 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-99772e52-1cc8-4d52-9dca-812cbf89db52 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:59.813293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-99772e52-1cc8-4d52-9dca-812cbf89db52 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:59.899777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b4780caa-743c-4678-9dfd-c8cfe38dc833 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:56:59.908392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b4780caa-743c-4678-9dfd-c8cfe38dc833 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 9e23df79-0a40-4417-9312-723fdb1638d0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:56:59.915219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4780caa-743c-4678-9dfd-c8cfe38dc833 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:59.926348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4780caa-743c-4678-9dfd-c8cfe38dc833 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:59.926807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4780caa-743c-4678-9dfd-c8cfe38dc833 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:56:59.927589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4780caa-743c-4678-9dfd-c8cfe38dc833 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:56:59.928050 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4780caa-743c-4678-9dfd-c8cfe38dc833 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:56:59.928481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4780caa-743c-4678-9dfd-c8cfe38dc833 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:00.547441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b4780caa-743c-4678-9dfd-c8cfe38dc833 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:00.556676 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b4780caa-743c-4678-9dfd-c8cfe38dc833 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0" status: 200 len: 1315 microversion: 2.1 time: 0.664860 Oct 29 02:57:00.576549 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1062/2324] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:59 2022] GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0 => generated 1315 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:00.576549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3649015b-24e6-4a48-b6a3-aceaa5b9a1b3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:00.579071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3649015b-24e6-4a48-b6a3-aceaa5b9a1b3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:00.595396 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3649015b-24e6-4a48-b6a3-aceaa5b9a1b3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:00.596067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3649015b-24e6-4a48-b6a3-aceaa5b9a1b3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:00.596592 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3649015b-24e6-4a48-b6a3-aceaa5b9a1b3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:00.597421 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3649015b-24e6-4a48-b6a3-aceaa5b9a1b3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:00.597886 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3649015b-24e6-4a48-b6a3-aceaa5b9a1b3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:00.598355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3649015b-24e6-4a48-b6a3-aceaa5b9a1b3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:00.744902 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3649015b-24e6-4a48-b6a3-aceaa5b9a1b3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:00.755800 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3649015b-24e6-4a48-b6a3-aceaa5b9a1b3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1293 microversion: 2.1 time: 0.189199 Oct 29 02:57:00.756426 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1063/2325] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:00 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1293 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:00.762296 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bccece73-658e-4c2d-9715-c94e0303114a tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:00.763214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bccece73-658e-4c2d-9715-c94e0303114a tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] [instance: 7e11f28d-9567-4c2d-adb3-d52bb16b93b6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:00.770740 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bccece73-658e-4c2d-9715-c94e0303114a tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:00.771484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bccece73-658e-4c2d-9715-c94e0303114a tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:00.772274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bccece73-658e-4c2d-9715-c94e0303114a tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:00.773641 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bccece73-658e-4c2d-9715-c94e0303114a tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:00.774492 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bccece73-658e-4c2d-9715-c94e0303114a tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:00.774952 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bccece73-658e-4c2d-9715-c94e0303114a tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:00.940285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-99772e52-1cc8-4d52-9dca-812cbf89db52 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:00.951499 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-99772e52-1cc8-4d52-9dca-812cbf89db52 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1514 microversion: 2.1 time: 1.189660 Oct 29 02:57:00.952383 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1263/2326] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:56:59 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1514 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:00.957554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-764fd4f8-f5d9-4ed4-a722-2d680ec5d7d5 req-060c4257-13fe-4491-a74a-e8e81db03ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e23df79-0a40-4417-9312-723fdb1638d0", "tag": "3e7a6224-8674-4856-9223-20fa7e6b5ab2"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:00.972130 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-764fd4f8-f5d9-4ed4-a722-2d680ec5d7d5 req-060c4257-13fe-4491-a74a-e8e81db03ae1 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:00.972814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-764fd4f8-f5d9-4ed4-a722-2d680ec5d7d5 req-060c4257-13fe-4491-a74a-e8e81db03ae1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:00.973347 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-764fd4f8-f5d9-4ed4-a722-2d680ec5d7d5 req-060c4257-13fe-4491-a74a-e8e81db03ae1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:00.988171 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-764fd4f8-f5d9-4ed4-a722-2d680ec5d7d5 req-060c4257-13fe-4491-a74a-e8e81db03ae1 service nova] Creating event network-changed:3e7a6224-8674-4856-9223-20fa7e6b5ab2 for instance 9e23df79-0a40-4417-9312-723fdb1638d0 on n-h2-862967-2 Oct 29 02:57:00.993908 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-764fd4f8-f5d9-4ed4-a722-2d680ec5d7d5 req-060c4257-13fe-4491-a74a-e8e81db03ae1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039878 Oct 29 02:57:00.995077 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1264/2327] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:01.107442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bccece73-658e-4c2d-9715-c94e0303114a tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136249f42e0e41cc9567b1b3be298574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f6396840c4aa6b4b7d4ee83503eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:01.128084 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bccece73-658e-4c2d-9715-c94e0303114a tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] 10.222.0.46 "GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6" status: 200 len: 1403 microversion: 2.1 time: 0.370003 Oct 29 02:57:01.130461 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1064/2328] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:00 2022] GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6 => generated 1403 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:01.588846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ff40d4f6-ddc3-4aea-8c75-eb5f4bf5d82f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:01.589944 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ff40d4f6-ddc3-4aea-8c75-eb5f4bf5d82f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 9e23df79-0a40-4417-9312-723fdb1638d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:01.602237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff40d4f6-ddc3-4aea-8c75-eb5f4bf5d82f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:01.603806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff40d4f6-ddc3-4aea-8c75-eb5f4bf5d82f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:01.604259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff40d4f6-ddc3-4aea-8c75-eb5f4bf5d82f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:01.606325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff40d4f6-ddc3-4aea-8c75-eb5f4bf5d82f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:01.607032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff40d4f6-ddc3-4aea-8c75-eb5f4bf5d82f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:01.608498 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff40d4f6-ddc3-4aea-8c75-eb5f4bf5d82f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:01.782369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f460b3c3-04c1-4d58-b56a-e2ca1660410e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:01.783421 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f460b3c3-04c1-4d58-b56a-e2ca1660410e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:01.791268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f460b3c3-04c1-4d58-b56a-e2ca1660410e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:01.792049 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f460b3c3-04c1-4d58-b56a-e2ca1660410e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:01.792836 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f460b3c3-04c1-4d58-b56a-e2ca1660410e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:01.793798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f460b3c3-04c1-4d58-b56a-e2ca1660410e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:01.794582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f460b3c3-04c1-4d58-b56a-e2ca1660410e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:01.795635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f460b3c3-04c1-4d58-b56a-e2ca1660410e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:02.059569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ff40d4f6-ddc3-4aea-8c75-eb5f4bf5d82f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:02.092505 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ff40d4f6-ddc3-4aea-8c75-eb5f4bf5d82f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0" status: 200 len: 1315 microversion: 2.1 time: 0.508493 Oct 29 02:57:02.093557 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1265/2329] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:01 2022] GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0 => generated 1315 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:02.101221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6ee3e90e-e80b-45da-9330-7dba3ae55fba tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:02.107753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6ee3e90e-e80b-45da-9330-7dba3ae55fba tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:02.129024 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ee3e90e-e80b-45da-9330-7dba3ae55fba tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:02.129750 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ee3e90e-e80b-45da-9330-7dba3ae55fba tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:02.130383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ee3e90e-e80b-45da-9330-7dba3ae55fba tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:02.131112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ee3e90e-e80b-45da-9330-7dba3ae55fba tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:02.131565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ee3e90e-e80b-45da-9330-7dba3ae55fba tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:02.131985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ee3e90e-e80b-45da-9330-7dba3ae55fba tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:02.270991 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:02.648460 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6ee3e90e-e80b-45da-9330-7dba3ae55fba tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:02.668830 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6ee3e90e-e80b-45da-9330-7dba3ae55fba tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1514 microversion: 2.1 time: 0.573584 Oct 29 02:57:02.669688 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1266/2330] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:02 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1514 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:02.704907 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a6a13954-0c40-4ecd-aef5-816b7537dcc3 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:02.706136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a6a13954-0c40-4ecd-aef5-816b7537dcc3 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] [instance: 7e11f28d-9567-4c2d-adb3-d52bb16b93b6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:02.713938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6a13954-0c40-4ecd-aef5-816b7537dcc3 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:02.714436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6a13954-0c40-4ecd-aef5-816b7537dcc3 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:02.715148 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6a13954-0c40-4ecd-aef5-816b7537dcc3 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:02.716117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6a13954-0c40-4ecd-aef5-816b7537dcc3 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:02.716823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6a13954-0c40-4ecd-aef5-816b7537dcc3 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:02.717348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6a13954-0c40-4ecd-aef5-816b7537dcc3 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:02.743730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f460b3c3-04c1-4d58-b56a-e2ca1660410e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:02.753792 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f460b3c3-04c1-4d58-b56a-e2ca1660410e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1361 microversion: 2.1 time: 0.975728 Oct 29 02:57:02.757389 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1065/2331] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:01 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1361 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:02.960136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a6a13954-0c40-4ecd-aef5-816b7537dcc3 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136249f42e0e41cc9567b1b3be298574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f6396840c4aa6b4b7d4ee83503eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:02.972481 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a6a13954-0c40-4ecd-aef5-816b7537dcc3 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] 10.222.0.46 "GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6" status: 200 len: 1403 microversion: 2.1 time: 0.287908 Oct 29 02:57:02.981899 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1267/2332] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:02 2022] GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6 => generated 1403 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:03.128887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-28f20c6b-27c6-4e0e-b5b5-449ee918df86 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:03.129826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-28f20c6b-27c6-4e0e-b5b5-449ee918df86 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 9e23df79-0a40-4417-9312-723fdb1638d0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:03.155947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28f20c6b-27c6-4e0e-b5b5-449ee918df86 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:03.156957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28f20c6b-27c6-4e0e-b5b5-449ee918df86 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:03.157845 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28f20c6b-27c6-4e0e-b5b5-449ee918df86 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:03.159035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28f20c6b-27c6-4e0e-b5b5-449ee918df86 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:03.159801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28f20c6b-27c6-4e0e-b5b5-449ee918df86 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:03.160592 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28f20c6b-27c6-4e0e-b5b5-449ee918df86 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:03.707482 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-83870681-bc74-4476-b68b-1066fbde3c11 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:03.708111 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-83870681-bc74-4476-b68b-1066fbde3c11 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:03.719915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83870681-bc74-4476-b68b-1066fbde3c11 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:03.720411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83870681-bc74-4476-b68b-1066fbde3c11 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:03.720873 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83870681-bc74-4476-b68b-1066fbde3c11 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:03.721585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83870681-bc74-4476-b68b-1066fbde3c11 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:03.722967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83870681-bc74-4476-b68b-1066fbde3c11 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:03.724401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83870681-bc74-4476-b68b-1066fbde3c11 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:04.371040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-83870681-bc74-4476-b68b-1066fbde3c11 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:04.382171 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-83870681-bc74-4476-b68b-1066fbde3c11 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1514 microversion: 2.1 time: 0.684709 Oct 29 02:57:04.385013 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1268/2333] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:03 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1514 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:04.418023 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9202a100-5ec0-4054-b02b-bc9c493d5705 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:04.425583 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9202a100-5ec0-4054-b02b-bc9c493d5705 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:04.447084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9202a100-5ec0-4054-b02b-bc9c493d5705 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:04.447778 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9202a100-5ec0-4054-b02b-bc9c493d5705 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:04.448397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9202a100-5ec0-4054-b02b-bc9c493d5705 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:04.450804 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9202a100-5ec0-4054-b02b-bc9c493d5705 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:04.453264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9202a100-5ec0-4054-b02b-bc9c493d5705 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:04.454494 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9202a100-5ec0-4054-b02b-bc9c493d5705 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:04.700912 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-28f20c6b-27c6-4e0e-b5b5-449ee918df86 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:04.718818 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-28f20c6b-27c6-4e0e-b5b5-449ee918df86 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0" status: 200 len: 1315 microversion: 2.1 time: 1.596068 Oct 29 02:57:04.720381 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1066/2334] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:03 2022] GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0 => generated 1315 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:04.733083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cef46b79-c4a8-4b2f-b16c-fa6860b82eda tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:04.737839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cef46b79-c4a8-4b2f-b16c-fa6860b82eda tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] [instance: 7e11f28d-9567-4c2d-adb3-d52bb16b93b6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:04.751967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cef46b79-c4a8-4b2f-b16c-fa6860b82eda tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:04.755793 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cef46b79-c4a8-4b2f-b16c-fa6860b82eda tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:04.757031 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cef46b79-c4a8-4b2f-b16c-fa6860b82eda tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:04.761059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cef46b79-c4a8-4b2f-b16c-fa6860b82eda tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:04.761867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cef46b79-c4a8-4b2f-b16c-fa6860b82eda tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:04.762562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cef46b79-c4a8-4b2f-b16c-fa6860b82eda tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:04.941784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9202a100-5ec0-4054-b02b-bc9c493d5705 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:04.981140 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9202a100-5ec0-4054-b02b-bc9c493d5705 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1361 microversion: 2.1 time: 0.573019 Oct 29 02:57:04.983310 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1269/2335] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:04 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1361 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:04.998203 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-1ca25c1e-6cb3-4855-9c84-d692eb6debbc req-1bf44af0-5de9-498f-8011-6bffc2ce0263 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b40f7b3b-04d4-4cfa-8058-09afc05d791e", "tag": "9766e845-d03c-426b-87c8-9df2fb171e28"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:05.027855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1ca25c1e-6cb3-4855-9c84-d692eb6debbc req-1bf44af0-5de9-498f-8011-6bffc2ce0263 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:05.028344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1ca25c1e-6cb3-4855-9c84-d692eb6debbc req-1bf44af0-5de9-498f-8011-6bffc2ce0263 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:05.032891 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1ca25c1e-6cb3-4855-9c84-d692eb6debbc req-1bf44af0-5de9-498f-8011-6bffc2ce0263 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:05.090534 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-1ca25c1e-6cb3-4855-9c84-d692eb6debbc req-1bf44af0-5de9-498f-8011-6bffc2ce0263 service nova] Creating event network-changed:9766e845-d03c-426b-87c8-9df2fb171e28 for instance b40f7b3b-04d4-4cfa-8058-09afc05d791e on n-h1-862967-2 Oct 29 02:57:05.115809 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-1ca25c1e-6cb3-4855-9c84-d692eb6debbc req-1bf44af0-5de9-498f-8011-6bffc2ce0263 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130769 Oct 29 02:57:05.116435 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1270/2336] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:05.330557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-348b4768-4b8a-4379-a2eb-4e92bf5353a1 req-87eeaa80-f033-405d-95f6-963949ffdb85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e11f28d-9567-4c2d-adb3-d52bb16b93b6", "name": "network-vif-plugged", "status": "completed", "tag": "a21f1d05-4754-4e9d-9849-353c2eea93bc"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:05.361608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-348b4768-4b8a-4379-a2eb-4e92bf5353a1 req-87eeaa80-f033-405d-95f6-963949ffdb85 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:05.362436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-348b4768-4b8a-4379-a2eb-4e92bf5353a1 req-87eeaa80-f033-405d-95f6-963949ffdb85 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:05.374411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-348b4768-4b8a-4379-a2eb-4e92bf5353a1 req-87eeaa80-f033-405d-95f6-963949ffdb85 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:05.392159 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-348b4768-4b8a-4379-a2eb-4e92bf5353a1 req-87eeaa80-f033-405d-95f6-963949ffdb85 service nova] Creating event network-vif-plugged:a21f1d05-4754-4e9d-9849-353c2eea93bc for instance 7e11f28d-9567-4c2d-adb3-d52bb16b93b6 on n-h1-862967-2 Oct 29 02:57:05.399523 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-348b4768-4b8a-4379-a2eb-4e92bf5353a1 req-87eeaa80-f033-405d-95f6-963949ffdb85 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075997 Oct 29 02:57:05.401161 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1271/2337] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:57:05.418109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7c71a08e-da4b-47ed-8999-c042b7b340fc tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:05.419281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7c71a08e-da4b-47ed-8999-c042b7b340fc tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:05.430434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c71a08e-da4b-47ed-8999-c042b7b340fc tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:05.431342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c71a08e-da4b-47ed-8999-c042b7b340fc tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:05.431946 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c71a08e-da4b-47ed-8999-c042b7b340fc tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:05.433022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c71a08e-da4b-47ed-8999-c042b7b340fc tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:05.433663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c71a08e-da4b-47ed-8999-c042b7b340fc tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:05.434285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c71a08e-da4b-47ed-8999-c042b7b340fc tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:05.518155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cef46b79-c4a8-4b2f-b16c-fa6860b82eda tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136249f42e0e41cc9567b1b3be298574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f6396840c4aa6b4b7d4ee83503eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:05.523237 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:05.539751 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cef46b79-c4a8-4b2f-b16c-fa6860b82eda tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] 10.222.0.46 "GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6" status: 200 len: 1403 microversion: 2.1 time: 0.817333 Oct 29 02:57:05.541746 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1067/2338] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:04 2022] GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6 => generated 1403 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:05.742955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4f48a23c-01e6-4b45-ba20-4a746c713964 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:05.743596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4f48a23c-01e6-4b45-ba20-4a746c713964 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 9e23df79-0a40-4417-9312-723fdb1638d0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:05.754933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f48a23c-01e6-4b45-ba20-4a746c713964 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:05.755454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f48a23c-01e6-4b45-ba20-4a746c713964 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:05.755897 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f48a23c-01e6-4b45-ba20-4a746c713964 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:05.756660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f48a23c-01e6-4b45-ba20-4a746c713964 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:05.757110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f48a23c-01e6-4b45-ba20-4a746c713964 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:05.757529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f48a23c-01e6-4b45-ba20-4a746c713964 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:05.987778 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:05.999038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7c71a08e-da4b-47ed-8999-c042b7b340fc tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:06.010055 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7c71a08e-da4b-47ed-8999-c042b7b340fc tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1520 microversion: 2.1 time: 0.599804 Oct 29 02:57:06.011661 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1272/2339] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:05 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1520 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:06.038643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4e31024d-f202-489e-948b-71963c309b36 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:06.045543 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4e31024d-f202-489e-948b-71963c309b36 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:06.055091 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=8 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:06.070799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e31024d-f202-489e-948b-71963c309b36 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:06.074647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e31024d-f202-489e-948b-71963c309b36 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:06.075398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e31024d-f202-489e-948b-71963c309b36 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:06.078681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e31024d-f202-489e-948b-71963c309b36 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:06.079461 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e31024d-f202-489e-948b-71963c309b36 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:06.080159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e31024d-f202-489e-948b-71963c309b36 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:06.346756 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=36 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:06.415514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4f48a23c-01e6-4b45-ba20-4a746c713964 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:06.424922 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4f48a23c-01e6-4b45-ba20-4a746c713964 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0" status: 200 len: 1315 microversion: 2.1 time: 0.685691 Oct 29 02:57:06.426751 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1068/2340] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:05 2022] GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0 => generated 1315 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:06.499764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4e31024d-f202-489e-948b-71963c309b36 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:06.511730 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4e31024d-f202-489e-948b-71963c309b36 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1361 microversion: 2.1 time: 0.480817 Oct 29 02:57:06.513793 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1273/2341] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:06 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1361 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:06.583164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5ea84ddc-3ca3-46ea-98fa-8ece01422a5e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:06.583784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5ea84ddc-3ca3-46ea-98fa-8ece01422a5e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] [instance: 7e11f28d-9567-4c2d-adb3-d52bb16b93b6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:06.590637 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ea84ddc-3ca3-46ea-98fa-8ece01422a5e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:06.591107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ea84ddc-3ca3-46ea-98fa-8ece01422a5e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:06.591574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ea84ddc-3ca3-46ea-98fa-8ece01422a5e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:06.592302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ea84ddc-3ca3-46ea-98fa-8ece01422a5e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:06.592756 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ea84ddc-3ca3-46ea-98fa-8ece01422a5e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:06.593183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ea84ddc-3ca3-46ea-98fa-8ece01422a5e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:06.859711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5ea84ddc-3ca3-46ea-98fa-8ece01422a5e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136249f42e0e41cc9567b1b3be298574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f6396840c4aa6b4b7d4ee83503eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:06.881485 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5ea84ddc-3ca3-46ea-98fa-8ece01422a5e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] 10.222.0.46 "GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6" status: 200 len: 1403 microversion: 2.1 time: 0.301715 Oct 29 02:57:06.902781 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1069/2342] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:06 2022] GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6 => generated 1403 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:07.036172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bbdaf315-ea74-49a5-99e2-be4f01da6a5a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:07.037050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bbdaf315-ea74-49a5-99e2-be4f01da6a5a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:07.053145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbdaf315-ea74-49a5-99e2-be4f01da6a5a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:07.053665 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbdaf315-ea74-49a5-99e2-be4f01da6a5a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:07.054111 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbdaf315-ea74-49a5-99e2-be4f01da6a5a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:07.054842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbdaf315-ea74-49a5-99e2-be4f01da6a5a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:07.057786 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbdaf315-ea74-49a5-99e2-be4f01da6a5a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:07.061732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbdaf315-ea74-49a5-99e2-be4f01da6a5a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:07.421625 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-8194bfc0-6cf7-48ae-9d86-d68876e65b5c req-07da1840-c3a2-4308-9495-434f0ce95d28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e23df79-0a40-4417-9312-723fdb1638d0", "name": "network-vif-plugged", "status": "completed", "tag": "3e7a6224-8674-4856-9223-20fa7e6b5ab2"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:07.442130 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8194bfc0-6cf7-48ae-9d86-d68876e65b5c req-07da1840-c3a2-4308-9495-434f0ce95d28 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:07.443070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8194bfc0-6cf7-48ae-9d86-d68876e65b5c req-07da1840-c3a2-4308-9495-434f0ce95d28 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:07.444022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8194bfc0-6cf7-48ae-9d86-d68876e65b5c req-07da1840-c3a2-4308-9495-434f0ce95d28 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:07.462064 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-8194bfc0-6cf7-48ae-9d86-d68876e65b5c req-07da1840-c3a2-4308-9495-434f0ce95d28 service nova] Creating event network-vif-plugged:3e7a6224-8674-4856-9223-20fa7e6b5ab2 for instance 9e23df79-0a40-4417-9312-723fdb1638d0 on n-h2-862967-2 Oct 29 02:57:07.469654 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-8194bfc0-6cf7-48ae-9d86-d68876e65b5c req-07da1840-c3a2-4308-9495-434f0ce95d28 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053326 Oct 29 02:57:07.471785 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1070/2343] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:57:07.479035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-00254b03-96de-470c-82df-47f13e869f24 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:07.479988 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-00254b03-96de-470c-82df-47f13e869f24 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 9e23df79-0a40-4417-9312-723fdb1638d0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:07.488379 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00254b03-96de-470c-82df-47f13e869f24 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:07.489440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00254b03-96de-470c-82df-47f13e869f24 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:07.490093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00254b03-96de-470c-82df-47f13e869f24 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:07.493615 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00254b03-96de-470c-82df-47f13e869f24 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:07.494337 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00254b03-96de-470c-82df-47f13e869f24 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:07.495191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00254b03-96de-470c-82df-47f13e869f24 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:07.527287 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bbdaf315-ea74-49a5-99e2-be4f01da6a5a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:07.568679 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bbdaf315-ea74-49a5-99e2-be4f01da6a5a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1520 microversion: 2.1 time: 0.533991 Oct 29 02:57:07.569587 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1274/2344] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:07 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1520 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:07.587114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-38352e70-c567-4189-aedb-001126146438 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:07.597420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-38352e70-c567-4189-aedb-001126146438 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:07.617803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38352e70-c567-4189-aedb-001126146438 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:07.618513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38352e70-c567-4189-aedb-001126146438 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:07.619158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38352e70-c567-4189-aedb-001126146438 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:07.620256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38352e70-c567-4189-aedb-001126146438 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:07.620902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38352e70-c567-4189-aedb-001126146438 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:07.628390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38352e70-c567-4189-aedb-001126146438 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:08.270477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-00254b03-96de-470c-82df-47f13e869f24 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:08.284174 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-00254b03-96de-470c-82df-47f13e869f24 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0" status: 200 len: 1315 microversion: 2.1 time: 0.810456 Oct 29 02:57:08.285432 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1071/2345] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:07 2022] GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0 => generated 1315 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:08.295806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bb924564-0217-4186-80db-96157f0f3e84 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:08.298132 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bb924564-0217-4186-80db-96157f0f3e84 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] [instance: 7e11f28d-9567-4c2d-adb3-d52bb16b93b6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:08.307671 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb924564-0217-4186-80db-96157f0f3e84 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:08.308373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb924564-0217-4186-80db-96157f0f3e84 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:08.309038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb924564-0217-4186-80db-96157f0f3e84 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:08.309937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb924564-0217-4186-80db-96157f0f3e84 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:08.310576 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb924564-0217-4186-80db-96157f0f3e84 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:08.311184 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb924564-0217-4186-80db-96157f0f3e84 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:08.616273 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-38352e70-c567-4189-aedb-001126146438 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:08.632387 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-38352e70-c567-4189-aedb-001126146438 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1361 microversion: 2.1 time: 1.059909 Oct 29 02:57:08.635573 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1275/2346] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:07 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1361 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:08.647906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9fb3a6f9-dfee-4216-afb9-0a7da5d90e9d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:08.649480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9fb3a6f9-dfee-4216-afb9-0a7da5d90e9d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:08.661756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fb3a6f9-dfee-4216-afb9-0a7da5d90e9d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:08.662576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fb3a6f9-dfee-4216-afb9-0a7da5d90e9d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:08.663224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fb3a6f9-dfee-4216-afb9-0a7da5d90e9d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:08.664175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fb3a6f9-dfee-4216-afb9-0a7da5d90e9d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:08.666382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fb3a6f9-dfee-4216-afb9-0a7da5d90e9d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:08.667693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fb3a6f9-dfee-4216-afb9-0a7da5d90e9d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:08.751001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=100 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:09.168770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bb924564-0217-4186-80db-96157f0f3e84 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136249f42e0e41cc9567b1b3be298574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f6396840c4aa6b4b7d4ee83503eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:09.202639 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bb924564-0217-4186-80db-96157f0f3e84 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] 10.222.0.46 "GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6" status: 200 len: 1590 microversion: 2.1 time: 0.909814 Oct 29 02:57:09.202778 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1072/2347] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:08 2022] GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6 => generated 1590 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:09.217948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9fb3a6f9-dfee-4216-afb9-0a7da5d90e9d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:09.227350 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9fb3a6f9-dfee-4216-afb9-0a7da5d90e9d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1520 microversion: 2.1 time: 0.590005 Oct 29 02:57:09.232346 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1276/2348] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:08 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1520 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:09.248748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9e68986c-06f5-434c-b556-fc98027e39b7 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:09.249664 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9e68986c-06f5-434c-b556-fc98027e39b7 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] [instance: 7e11f28d-9567-4c2d-adb3-d52bb16b93b6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:09.266299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e68986c-06f5-434c-b556-fc98027e39b7 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:09.267395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e68986c-06f5-434c-b556-fc98027e39b7 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:09.268930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e68986c-06f5-434c-b556-fc98027e39b7 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:09.273148 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e68986c-06f5-434c-b556-fc98027e39b7 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:09.273992 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e68986c-06f5-434c-b556-fc98027e39b7 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:09.274655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e68986c-06f5-434c-b556-fc98027e39b7 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:09.464930 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9e68986c-06f5-434c-b556-fc98027e39b7 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] 10.222.0.46 "GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.230673 Oct 29 02:57:09.468185 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1277/2349] 10.222.0.46 () {58 vars in 1275 bytes} [Sat Oct 29 02:57:09 2022] GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6/os-interface => generated 284 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:09.482029 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-226ca65b-ed49-4d69-83de-29b002bc1cd0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1490326397", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "2f016d14-d67d-40f5-811c-d451a32578a4"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:09.485988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0ea5d0a7-2ca3-46a1-aaea-4781fcbaa9f4 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:09.487706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0ea5d0a7-2ca3-46a1-aaea-4781fcbaa9f4 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 9e23df79-0a40-4417-9312-723fdb1638d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:09.524011 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ea5d0a7-2ca3-46a1-aaea-4781fcbaa9f4 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:09.528129 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ea5d0a7-2ca3-46a1-aaea-4781fcbaa9f4 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:09.532467 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ea5d0a7-2ca3-46a1-aaea-4781fcbaa9f4 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:09.537430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ea5d0a7-2ca3-46a1-aaea-4781fcbaa9f4 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:09.539973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ea5d0a7-2ca3-46a1-aaea-4781fcbaa9f4 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:09.541012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ea5d0a7-2ca3-46a1-aaea-4781fcbaa9f4 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:09.587217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-226ca65b-ed49-4d69-83de-29b002bc1cd0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] validate_networks() for [('2f016d14-d67d-40f5-811c-d451a32578a4', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:57:09.983128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0ea5d0a7-2ca3-46a1-aaea-4781fcbaa9f4 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:09.993148 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0ea5d0a7-2ca3-46a1-aaea-4781fcbaa9f4 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0" status: 200 len: 1505 microversion: 2.1 time: 0.523063 Oct 29 02:57:09.999263 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1278/2350] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:09 2022] GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0 => generated 1505 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:10.012202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-f1a0da11-3775-4e30-b6a0-a58cef031836 req-037c9d36-e002-4865-82c2-77e837406cdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c352884d-b0ee-4a54-bc72-41e39eb0839f", "name": "network-vif-unplugged", "status": "completed", "tag": "a022a789-20a6-47d7-9b60-c4ab6361d88b"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:10.028465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f1a0da11-3775-4e30-b6a0-a58cef031836 req-037c9d36-e002-4865-82c2-77e837406cdd service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:10.028973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f1a0da11-3775-4e30-b6a0-a58cef031836 req-037c9d36-e002-4865-82c2-77e837406cdd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:10.033157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f1a0da11-3775-4e30-b6a0-a58cef031836 req-037c9d36-e002-4865-82c2-77e837406cdd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:10.061929 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-f1a0da11-3775-4e30-b6a0-a58cef031836 req-037c9d36-e002-4865-82c2-77e837406cdd service nova] Creating event network-vif-unplugged:a022a789-20a6-47d7-9b60-c4ab6361d88b for instance c352884d-b0ee-4a54-bc72-41e39eb0839f on n-h2-862967-2 Oct 29 02:57:10.070338 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-f1a0da11-3775-4e30-b6a0-a58cef031836 req-037c9d36-e002-4865-82c2-77e837406cdd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069767 Oct 29 02:57:10.072623 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1279/2351] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:10.086264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bf499077-2a77-4fb0-9f76-90d9bda92685 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:10.105205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bf499077-2a77-4fb0-9f76-90d9bda92685 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:10.105205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf499077-2a77-4fb0-9f76-90d9bda92685 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:10.105205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf499077-2a77-4fb0-9f76-90d9bda92685 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:10.105205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf499077-2a77-4fb0-9f76-90d9bda92685 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:10.105205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf499077-2a77-4fb0-9f76-90d9bda92685 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:10.116717 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf499077-2a77-4fb0-9f76-90d9bda92685 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:10.117412 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf499077-2a77-4fb0-9f76-90d9bda92685 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:10.684545 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bf499077-2a77-4fb0-9f76-90d9bda92685 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:10.698620 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bf499077-2a77-4fb0-9f76-90d9bda92685 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1361 microversion: 2.1 time: 0.624238 Oct 29 02:57:10.699240 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1280/2352] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:10 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1361 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:10.704123 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-aff5f2ab-5705-4d78-a012-80a6aac69710 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:10.704651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-aff5f2ab-5705-4d78-a012-80a6aac69710 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 9e23df79-0a40-4417-9312-723fdb1638d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:10.720710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aff5f2ab-5705-4d78-a012-80a6aac69710 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:10.721203 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aff5f2ab-5705-4d78-a012-80a6aac69710 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:10.721636 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aff5f2ab-5705-4d78-a012-80a6aac69710 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:10.722355 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aff5f2ab-5705-4d78-a012-80a6aac69710 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:10.722801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aff5f2ab-5705-4d78-a012-80a6aac69710 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:10.723221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aff5f2ab-5705-4d78-a012-80a6aac69710 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:10.787636 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-aff5f2ab-5705-4d78-a012-80a6aac69710 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 9e23df79-0a40-4417-9312-723fdb1638d0] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:57:10.903798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-226ca65b-ed49-4d69-83de-29b002bc1cd0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:57:10.904871 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-226ca65b-ed49-4d69-83de-29b002bc1cd0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:57:10.906136 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-226ca65b-ed49-4d69-83de-29b002bc1cd0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:57:10.906791 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-226ca65b-ed49-4d69-83de-29b002bc1cd0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:57:10.907407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-226ca65b-ed49-4d69-83de-29b002bc1cd0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:57:10.921234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-226ca65b-ed49-4d69-83de-29b002bc1cd0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:10.922139 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-226ca65b-ed49-4d69-83de-29b002bc1cd0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:10.922855 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-226ca65b-ed49-4d69-83de-29b002bc1cd0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:10.924107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-226ca65b-ed49-4d69-83de-29b002bc1cd0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:10.924761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-226ca65b-ed49-4d69-83de-29b002bc1cd0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:10.925470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-226ca65b-ed49-4d69-83de-29b002bc1cd0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:10.965262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:10.966597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-226ca65b-ed49-4d69-83de-29b002bc1cd0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Getting quotas for project b67fc8dd1f4349ca85422bd9a08d3e06. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:57:10.974226 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-aff5f2ab-5705-4d78-a012-80a6aac69710 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0" status: 204 len: 0 microversion: 2.1 time: 0.272646 Oct 29 02:57:10.979810 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1281/2353] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:57:10 2022] DELETE /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:57:10.980623 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-226ca65b-ed49-4d69-83de-29b002bc1cd0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Getting quotas for user 1ee6c4d28f304eab89014b9c46cc555a and project b67fc8dd1f4349ca85422bd9a08d3e06. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:57:10.996184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-990d3649-42c4-4646-a102-866ffa2e1511 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:10.997593 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-990d3649-42c4-4646-a102-866ffa2e1511 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:10.999523 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-226ca65b-ed49-4d69-83de-29b002bc1cd0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:57:11.005111 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-226ca65b-ed49-4d69-83de-29b002bc1cd0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 4876d09c-0ef0-4434-adb5-ca84626ca4bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:57:11.007169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-990d3649-42c4-4646-a102-866ffa2e1511 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:11.008178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-990d3649-42c4-4646-a102-866ffa2e1511 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:11.010035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-990d3649-42c4-4646-a102-866ffa2e1511 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:11.013407 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-990d3649-42c4-4646-a102-866ffa2e1511 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:11.014207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-990d3649-42c4-4646-a102-866ffa2e1511 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:11.014849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-990d3649-42c4-4646-a102-866ffa2e1511 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:11.162990 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-226ca65b-ed49-4d69-83de-29b002bc1cd0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.958847 Oct 29 02:57:11.168590 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1073/2354] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:57:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:57:11.175612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7e6e6702-befe-4e60-8c5e-d1165b779de1 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:11.176244 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7e6e6702-befe-4e60-8c5e-d1165b779de1 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 9e23df79-0a40-4417-9312-723fdb1638d0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:11.194131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e6e6702-befe-4e60-8c5e-d1165b779de1 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:11.195033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e6e6702-befe-4e60-8c5e-d1165b779de1 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:11.195633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e6e6702-befe-4e60-8c5e-d1165b779de1 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:11.196407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e6e6702-befe-4e60-8c5e-d1165b779de1 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:11.197084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e6e6702-befe-4e60-8c5e-d1165b779de1 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:11.198647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e6e6702-befe-4e60-8c5e-d1165b779de1 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:11.710560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7e6e6702-befe-4e60-8c5e-d1165b779de1 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:11.722082 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7e6e6702-befe-4e60-8c5e-d1165b779de1 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0" status: 200 len: 1511 microversion: 2.1 time: 0.550758 Oct 29 02:57:11.722923 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1074/2355] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:11 2022] GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0 => generated 1511 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:11.733376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-498e6e39-892f-46c8-9b41-66374e53ada1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:11.733902 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-498e6e39-892f-46c8-9b41-66374e53ada1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 4876d09c-0ef0-4434-adb5-ca84626ca4bb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:11.748039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-990d3649-42c4-4646-a102-866ffa2e1511 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:11.764888 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-990d3649-42c4-4646-a102-866ffa2e1511 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1520 microversion: 2.1 time: 0.781711 Oct 29 02:57:11.771504 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1282/2356] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:10 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1520 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:11.791422 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fd410d84-36f5-4f3e-a44b-f5542c812cf0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:11.798236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fd410d84-36f5-4f3e-a44b-f5542c812cf0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:11.809219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd410d84-36f5-4f3e-a44b-f5542c812cf0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:11.810047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd410d84-36f5-4f3e-a44b-f5542c812cf0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:11.810656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd410d84-36f5-4f3e-a44b-f5542c812cf0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:11.811751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd410d84-36f5-4f3e-a44b-f5542c812cf0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:11.813047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd410d84-36f5-4f3e-a44b-f5542c812cf0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:11.813947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd410d84-36f5-4f3e-a44b-f5542c812cf0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:12.293927 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-498e6e39-892f-46c8-9b41-66374e53ada1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:12.304274 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-498e6e39-892f-46c8-9b41-66374e53ada1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb" status: 200 len: 1215 microversion: 2.1 time: 0.580198 Oct 29 02:57:12.310331 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1075/2357] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:11 2022] GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb => generated 1215 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:12.751624 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5fc0b524-f22e-492d-956e-959cfe06dfd8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:12.752969 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5fc0b524-f22e-492d-956e-959cfe06dfd8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 9e23df79-0a40-4417-9312-723fdb1638d0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:12.796965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5fc0b524-f22e-492d-956e-959cfe06dfd8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:12.805150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5fc0b524-f22e-492d-956e-959cfe06dfd8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:12.806216 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5fc0b524-f22e-492d-956e-959cfe06dfd8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:12.807334 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5fc0b524-f22e-492d-956e-959cfe06dfd8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:12.808047 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5fc0b524-f22e-492d-956e-959cfe06dfd8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:12.808772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5fc0b524-f22e-492d-956e-959cfe06dfd8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:13.202828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fd410d84-36f5-4f3e-a44b-f5542c812cf0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:13.215584 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fd410d84-36f5-4f3e-a44b-f5542c812cf0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1361 microversion: 2.1 time: 1.442212 Oct 29 02:57:13.226998 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1283/2358] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:11 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1361 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:13.241725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1911cb40-04bd-4e4d-b0a5-60beb5fda886 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:13.248868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1911cb40-04bd-4e4d-b0a5-60beb5fda886 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:13.259603 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1911cb40-04bd-4e4d-b0a5-60beb5fda886 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:13.260117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1911cb40-04bd-4e4d-b0a5-60beb5fda886 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:13.260623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1911cb40-04bd-4e4d-b0a5-60beb5fda886 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:13.261353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1911cb40-04bd-4e4d-b0a5-60beb5fda886 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:13.262095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1911cb40-04bd-4e4d-b0a5-60beb5fda886 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:13.262888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1911cb40-04bd-4e4d-b0a5-60beb5fda886 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:13.323277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5fc0b524-f22e-492d-956e-959cfe06dfd8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:13.335937 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5fc0b524-f22e-492d-956e-959cfe06dfd8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0" status: 200 len: 1511 microversion: 2.1 time: 0.592113 Oct 29 02:57:13.338987 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1076/2359] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:12 2022] GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0 => generated 1511 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:13.353182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a7016ac5-39bf-43e1-ab6b-81df05bde66f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:13.354267 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a7016ac5-39bf-43e1-ab6b-81df05bde66f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 4876d09c-0ef0-4434-adb5-ca84626ca4bb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:13.366183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7016ac5-39bf-43e1-ab6b-81df05bde66f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:13.367065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7016ac5-39bf-43e1-ab6b-81df05bde66f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:13.367728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7016ac5-39bf-43e1-ab6b-81df05bde66f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:13.370443 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7016ac5-39bf-43e1-ab6b-81df05bde66f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:13.372382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7016ac5-39bf-43e1-ab6b-81df05bde66f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:13.374559 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7016ac5-39bf-43e1-ab6b-81df05bde66f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:13.632225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a7016ac5-39bf-43e1-ab6b-81df05bde66f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:13.647763 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a7016ac5-39bf-43e1-ab6b-81df05bde66f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb" status: 200 len: 1275 microversion: 2.1 time: 0.307521 Oct 29 02:57:13.655471 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1077/2360] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:13 2022] GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb => generated 1275 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:13.741516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1911cb40-04bd-4e4d-b0a5-60beb5fda886 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:13.784639 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1911cb40-04bd-4e4d-b0a5-60beb5fda886 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1520 microversion: 2.1 time: 0.532177 Oct 29 02:57:13.785523 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1284/2361] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:13 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1520 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:13.833428 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-cce7a53c-bfad-40f2-8996-318b1994cbc2 req-5f900eac-fd6d-4de0-9f6b-e378e2cb4e96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c352884d-b0ee-4a54-bc72-41e39eb0839f", "name": "network-vif-plugged", "status": "completed", "tag": "a022a789-20a6-47d7-9b60-c4ab6361d88b"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:13.860560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-cce7a53c-bfad-40f2-8996-318b1994cbc2 req-5f900eac-fd6d-4de0-9f6b-e378e2cb4e96 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:13.862568 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-cce7a53c-bfad-40f2-8996-318b1994cbc2 req-5f900eac-fd6d-4de0-9f6b-e378e2cb4e96 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:13.863274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-cce7a53c-bfad-40f2-8996-318b1994cbc2 req-5f900eac-fd6d-4de0-9f6b-e378e2cb4e96 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:13.900352 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-cce7a53c-bfad-40f2-8996-318b1994cbc2 req-5f900eac-fd6d-4de0-9f6b-e378e2cb4e96 service nova] Creating event network-vif-plugged:a022a789-20a6-47d7-9b60-c4ab6361d88b for instance c352884d-b0ee-4a54-bc72-41e39eb0839f on n-h2-862967-2 Oct 29 02:57:13.912784 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-cce7a53c-bfad-40f2-8996-318b1994cbc2 req-5f900eac-fd6d-4de0-9f6b-e378e2cb4e96 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085702 Oct 29 02:57:13.918126 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1078/2362] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:14.242394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1b41c4b2-074f-43c0-af33-c7da6b0ed415 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:14.243436 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1b41c4b2-074f-43c0-af33-c7da6b0ed415 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:14.265201 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b41c4b2-074f-43c0-af33-c7da6b0ed415 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:14.273545 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b41c4b2-074f-43c0-af33-c7da6b0ed415 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:14.279038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b41c4b2-074f-43c0-af33-c7da6b0ed415 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:14.280182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9a3a32d2-8a6f-42f3-bd9b-b79c66e6a10b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Action: 'create', calling method: .version_select at 0x7ff058afba60>, body: {"keypair": {"name": "tempest-keypair-1188994911", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhfQLnCF+N0qfOQ0oB0chswh4761hO8htyp0nMqbzBH3lPZuI/1ZKsALP8Jha/gw3g58Ke2IgAoUYAquXgsT3UsXUtm1QSQvmwbK3EbAXIYWPZG8YTPR+MHR0Vmh6wcQA=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:14.281888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b41c4b2-074f-43c0-af33-c7da6b0ed415 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:14.282380 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b41c4b2-074f-43c0-af33-c7da6b0ed415 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:14.289532 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b41c4b2-074f-43c0-af33-c7da6b0ed415 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:14.321672 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-9a3a32d2-8a6f-42f3-bd9b-b79c66e6a10b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Getting quotas for project 746258dc83c74b9ba3634afbc2716d7b. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:57:14.348278 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-9a3a32d2-8a6f-42f3-bd9b-b79c66e6a10b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Getting quotas for user 4dbcac917fc6415683ae17b220276c91 and project 746258dc83c74b9ba3634afbc2716d7b. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:57:14.417367 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9a3a32d2-8a6f-42f3-bd9b-b79c66e6a10b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.273286 Oct 29 02:57:14.418412 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1285/2363] 10.222.0.46 () {62 vars in 1200 bytes} [Sat Oct 29 02:57:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 275 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 02:57:14.429504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-30299c7d-bced-4c7f-bfef-dd35c23190c9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:14.430939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-30299c7d-bced-4c7f-bfef-dd35c23190c9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 9e23df79-0a40-4417-9312-723fdb1638d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:14.446171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30299c7d-bced-4c7f-bfef-dd35c23190c9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:14.446934 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30299c7d-bced-4c7f-bfef-dd35c23190c9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:14.447614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30299c7d-bced-4c7f-bfef-dd35c23190c9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:14.451626 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30299c7d-bced-4c7f-bfef-dd35c23190c9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:14.452767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30299c7d-bced-4c7f-bfef-dd35c23190c9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:14.453521 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30299c7d-bced-4c7f-bfef-dd35c23190c9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:14.606468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-30299c7d-bced-4c7f-bfef-dd35c23190c9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:14.618803 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-30299c7d-bced-4c7f-bfef-dd35c23190c9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0" status: 200 len: 1469 microversion: 2.1 time: 0.198968 Oct 29 02:57:14.621708 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1286/2364] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:14 2022] GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0 => generated 1469 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:14.637202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a8e3e645-9d15-478f-a8a8-8fccd4b69bbe tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:14.640402 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a8e3e645-9d15-478f-a8a8-8fccd4b69bbe tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] [instance: 7e11f28d-9567-4c2d-adb3-d52bb16b93b6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:14.654449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8e3e645-9d15-478f-a8a8-8fccd4b69bbe tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:14.656630 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8e3e645-9d15-478f-a8a8-8fccd4b69bbe tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:14.657562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8e3e645-9d15-478f-a8a8-8fccd4b69bbe tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:14.663937 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8e3e645-9d15-478f-a8a8-8fccd4b69bbe tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:14.665091 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8e3e645-9d15-478f-a8a8-8fccd4b69bbe tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:14.665654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8e3e645-9d15-478f-a8a8-8fccd4b69bbe tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:14.962541 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1b41c4b2-074f-43c0-af33-c7da6b0ed415 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:14.976470 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1b41c4b2-074f-43c0-af33-c7da6b0ed415 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1361 microversion: 2.1 time: 0.740594 Oct 29 02:57:14.979040 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1079/2365] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:14 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1361 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:14.995322 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-6c3f1a38-c6ec-4813-899a-0034be3ad2e4 req-de8d84fa-abcf-46eb-939d-64e27fde5574 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e11f28d-9567-4c2d-adb3-d52bb16b93b6", "tag": "a21f1d05-4754-4e9d-9849-353c2eea93bc"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:15.035133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6c3f1a38-c6ec-4813-899a-0034be3ad2e4 req-de8d84fa-abcf-46eb-939d-64e27fde5574 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:15.036124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6c3f1a38-c6ec-4813-899a-0034be3ad2e4 req-de8d84fa-abcf-46eb-939d-64e27fde5574 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:15.037067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6c3f1a38-c6ec-4813-899a-0034be3ad2e4 req-de8d84fa-abcf-46eb-939d-64e27fde5574 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:15.056399 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-6c3f1a38-c6ec-4813-899a-0034be3ad2e4 req-de8d84fa-abcf-46eb-939d-64e27fde5574 service nova] Creating event network-changed:a21f1d05-4754-4e9d-9849-353c2eea93bc for instance 7e11f28d-9567-4c2d-adb3-d52bb16b93b6 on n-h1-862967-2 Oct 29 02:57:15.072044 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-6c3f1a38-c6ec-4813-899a-0034be3ad2e4 req-de8d84fa-abcf-46eb-939d-64e27fde5574 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087079 Oct 29 02:57:15.080400 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1080/2366] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:15.098047 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-60b76b5a-9e36-4019-9394-370e420768c4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:15.099407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-60b76b5a-9e36-4019-9394-370e420768c4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 4876d09c-0ef0-4434-adb5-ca84626ca4bb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:15.118652 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-60b76b5a-9e36-4019-9394-370e420768c4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:15.119435 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-60b76b5a-9e36-4019-9394-370e420768c4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:15.120351 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-60b76b5a-9e36-4019-9394-370e420768c4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:15.121538 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-60b76b5a-9e36-4019-9394-370e420768c4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:15.122277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-60b76b5a-9e36-4019-9394-370e420768c4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:15.122923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-60b76b5a-9e36-4019-9394-370e420768c4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:15.285088 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-60b76b5a-9e36-4019-9394-370e420768c4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:15.305944 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-60b76b5a-9e36-4019-9394-370e420768c4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb" status: 200 len: 1273 microversion: 2.1 time: 0.223000 Oct 29 02:57:15.306748 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1081/2367] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:15 2022] GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb => generated 1273 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:15.321440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2704d9f5-9af0-4935-9b32-35211f234a55 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:15.322379 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2704d9f5-9af0-4935-9b32-35211f234a55 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:15.339628 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2704d9f5-9af0-4935-9b32-35211f234a55 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:15.340405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2704d9f5-9af0-4935-9b32-35211f234a55 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:15.341059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2704d9f5-9af0-4935-9b32-35211f234a55 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:15.341987 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2704d9f5-9af0-4935-9b32-35211f234a55 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:15.342620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2704d9f5-9af0-4935-9b32-35211f234a55 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:15.343207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2704d9f5-9af0-4935-9b32-35211f234a55 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:15.535195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a8e3e645-9d15-478f-a8a8-8fccd4b69bbe tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136249f42e0e41cc9567b1b3be298574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f6396840c4aa6b4b7d4ee83503eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:15.549622 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a8e3e645-9d15-478f-a8a8-8fccd4b69bbe tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] 10.222.0.46 "GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6" status: 200 len: 1590 microversion: 2.1 time: 0.926641 Oct 29 02:57:15.550192 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1287/2368] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:14 2022] GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6 => generated 1590 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:15.572061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-b9a43761-e588-426e-bfe8-864abf622193 req-ede10cd2-c1bb-40ff-b449-83890300ee00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e23df79-0a40-4417-9312-723fdb1638d0", "name": "network-vif-deleted", "tag": "3e7a6224-8674-4856-9223-20fa7e6b5ab2"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:15.592712 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b9a43761-e588-426e-bfe8-864abf622193 req-ede10cd2-c1bb-40ff-b449-83890300ee00 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:15.593985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b9a43761-e588-426e-bfe8-864abf622193 req-ede10cd2-c1bb-40ff-b449-83890300ee00 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:15.599481 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b9a43761-e588-426e-bfe8-864abf622193 req-ede10cd2-c1bb-40ff-b449-83890300ee00 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:15.624954 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-b9a43761-e588-426e-bfe8-864abf622193 req-ede10cd2-c1bb-40ff-b449-83890300ee00 service nova] Creating event network-vif-deleted:3e7a6224-8674-4856-9223-20fa7e6b5ab2 for instance 9e23df79-0a40-4417-9312-723fdb1638d0 on n-h2-862967-2 Oct 29 02:57:15.641930 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-b9a43761-e588-426e-bfe8-864abf622193 req-ede10cd2-c1bb-40ff-b449-83890300ee00 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075325 Oct 29 02:57:15.643677 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1288/2369] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:15.658668 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d8c2f5f2-f9e4-4503-8fec-aad9da35db87 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:15.659628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d8c2f5f2-f9e4-4503-8fec-aad9da35db87 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 9e23df79-0a40-4417-9312-723fdb1638d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:15.673684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8c2f5f2-f9e4-4503-8fec-aad9da35db87 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:15.676836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8c2f5f2-f9e4-4503-8fec-aad9da35db87 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:15.677675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8c2f5f2-f9e4-4503-8fec-aad9da35db87 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:15.678631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8c2f5f2-f9e4-4503-8fec-aad9da35db87 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:15.679277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8c2f5f2-f9e4-4503-8fec-aad9da35db87 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:15.681135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8c2f5f2-f9e4-4503-8fec-aad9da35db87 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:15.755089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8c2f5f2-f9e4-4503-8fec-aad9da35db87 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:15.755865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8c2f5f2-f9e4-4503-8fec-aad9da35db87 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:15.756611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8c2f5f2-f9e4-4503-8fec-aad9da35db87 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:15.757428 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-d8c2f5f2-f9e4-4503-8fec-aad9da35db87 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lazy-loading 'fault' on Instance uuid 9e23df79-0a40-4417-9312-723fdb1638d0 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:57:15.849077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d8c2f5f2-f9e4-4503-8fec-aad9da35db87 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:15.858330 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d8c2f5f2-f9e4-4503-8fec-aad9da35db87 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0" status: 200 len: 1305 microversion: 2.1 time: 0.212520 Oct 29 02:57:15.863390 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1289/2370] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:15 2022] GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0 => generated 1305 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:16.017249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-26984b8e-248e-4af8-86dc-10b4cf265691 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:16.023687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-26984b8e-248e-4af8-86dc-10b4cf265691 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:16.045818 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-26984b8e-248e-4af8-86dc-10b4cf265691 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:16.047109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-26984b8e-248e-4af8-86dc-10b4cf265691 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:16.049886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-26984b8e-248e-4af8-86dc-10b4cf265691 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:16.052542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-26984b8e-248e-4af8-86dc-10b4cf265691 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:16.054662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-26984b8e-248e-4af8-86dc-10b4cf265691 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:16.055497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-26984b8e-248e-4af8-86dc-10b4cf265691 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:16.148160 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2704d9f5-9af0-4935-9b32-35211f234a55 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:16.163271 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2704d9f5-9af0-4935-9b32-35211f234a55 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1520 microversion: 2.1 time: 0.845502 Oct 29 02:57:16.175139 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1082/2371] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:15 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1520 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:16.336359 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7095a4e6-ee78-43cd-b36c-eaf20fc21b68 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:16.337160 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7095a4e6-ee78-43cd-b36c-eaf20fc21b68 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 4876d09c-0ef0-4434-adb5-ca84626ca4bb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:16.360779 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7095a4e6-ee78-43cd-b36c-eaf20fc21b68 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:16.361296 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7095a4e6-ee78-43cd-b36c-eaf20fc21b68 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:16.361792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7095a4e6-ee78-43cd-b36c-eaf20fc21b68 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:16.362598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7095a4e6-ee78-43cd-b36c-eaf20fc21b68 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:16.363131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7095a4e6-ee78-43cd-b36c-eaf20fc21b68 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:16.363675 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7095a4e6-ee78-43cd-b36c-eaf20fc21b68 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:16.753692 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-26984b8e-248e-4af8-86dc-10b4cf265691 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:16.764300 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-26984b8e-248e-4af8-86dc-10b4cf265691 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1361 microversion: 2.1 time: 0.764187 Oct 29 02:57:16.780551 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1290/2372] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:15 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1361 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:16.781212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-8cf59386-0a48-4835-bb43-705b73700901 req-8efa680c-9b62-4ba4-b0ff-2cf76d2611a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b40f7b3b-04d4-4cfa-8058-09afc05d791e", "name": "network-vif-plugged", "status": "completed", "tag": "9766e845-d03c-426b-87c8-9df2fb171e28"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:16.806256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8cf59386-0a48-4835-bb43-705b73700901 req-8efa680c-9b62-4ba4-b0ff-2cf76d2611a3 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:16.807279 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8cf59386-0a48-4835-bb43-705b73700901 req-8efa680c-9b62-4ba4-b0ff-2cf76d2611a3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:16.809624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8cf59386-0a48-4835-bb43-705b73700901 req-8efa680c-9b62-4ba4-b0ff-2cf76d2611a3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:16.848663 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-8cf59386-0a48-4835-bb43-705b73700901 req-8efa680c-9b62-4ba4-b0ff-2cf76d2611a3 service nova] Creating event network-vif-plugged:9766e845-d03c-426b-87c8-9df2fb171e28 for instance b40f7b3b-04d4-4cfa-8058-09afc05d791e on n-h1-862967-2 Oct 29 02:57:16.855847 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-8cf59386-0a48-4835-bb43-705b73700901 req-8efa680c-9b62-4ba4-b0ff-2cf76d2611a3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084209 Oct 29 02:57:16.857561 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1291/2373] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:16.894966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d1b25d0e-3194-4361-9549-c8be4ce1686c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:16.896035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d1b25d0e-3194-4361-9549-c8be4ce1686c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 9e23df79-0a40-4417-9312-723fdb1638d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:16.908998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1b25d0e-3194-4361-9549-c8be4ce1686c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:16.909878 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1b25d0e-3194-4361-9549-c8be4ce1686c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:16.910549 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1b25d0e-3194-4361-9549-c8be4ce1686c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:16.912269 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1b25d0e-3194-4361-9549-c8be4ce1686c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:16.912981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1b25d0e-3194-4361-9549-c8be4ce1686c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:16.913635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1b25d0e-3194-4361-9549-c8be4ce1686c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:16.958506 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-d1b25d0e-3194-4361-9549-c8be4ce1686c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Instance 9e23df79-0a40-4417-9312-723fdb1638d0 could not be found. Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d1b25d0e-3194-4361-9549-c8be4ce1686c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0 HTTP/1.1 Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 9e23df79-0a40-4417-9312-723fdb1638d0 could not be found. Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '9e23df79-0a40-4417-9312-723fdb1638d0'} Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e23df79-0a40-4417-9312-723fdb1638d0 could not be found. Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e23df79-0a40-4417-9312-723fdb1638d0 could not be found. Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:16.960233 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:16.965056 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:16.965056 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:16.965056 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:16.965056 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:16.965056 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:16.965056 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e23df79-0a40-4417-9312-723fdb1638d0 could not be found. Oct 29 02:57:16.965056 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:16.965056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d1b25d0e-3194-4361-9549-c8be4ce1686c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 404 to user: Instance 9e23df79-0a40-4417-9312-723fdb1638d0 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:16.966781 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d1b25d0e-3194-4361-9549-c8be4ce1686c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0" status: 404 len: 111 microversion: 2.1 time: 0.079120 Oct 29 02:57:16.967392 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1292/2374] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:16 2022] GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:57:16.984042 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9e33c656-a1a9-4298-b675-bbe5ad11d7e3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:16.984934 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9e33c656-a1a9-4298-b675-bbe5ad11d7e3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:16.992564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e33c656-a1a9-4298-b675-bbe5ad11d7e3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:16.993244 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e33c656-a1a9-4298-b675-bbe5ad11d7e3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:16.993840 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e33c656-a1a9-4298-b675-bbe5ad11d7e3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:16.994785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e33c656-a1a9-4298-b675-bbe5ad11d7e3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:16.995395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e33c656-a1a9-4298-b675-bbe5ad11d7e3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:16.995962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e33c656-a1a9-4298-b675-bbe5ad11d7e3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:17.272791 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7095a4e6-ee78-43cd-b36c-eaf20fc21b68 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:17.307616 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7095a4e6-ee78-43cd-b36c-eaf20fc21b68 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb" status: 200 len: 1315 microversion: 2.1 time: 0.968997 Oct 29 02:57:17.325249 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1083/2375] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:16 2022] GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb => generated 1315 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:17.344871 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0f40160b-05dc-486f-a619-bd8d7e3e714f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:17.345776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0f40160b-05dc-486f-a619-bd8d7e3e714f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:17.358132 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f40160b-05dc-486f-a619-bd8d7e3e714f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:17.358813 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f40160b-05dc-486f-a619-bd8d7e3e714f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:17.359413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f40160b-05dc-486f-a619-bd8d7e3e714f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:17.360314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f40160b-05dc-486f-a619-bd8d7e3e714f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:17.360962 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f40160b-05dc-486f-a619-bd8d7e3e714f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:17.364236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f40160b-05dc-486f-a619-bd8d7e3e714f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:17.421735 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9e33c656-a1a9-4298-b675-bbe5ad11d7e3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:17.431073 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9e33c656-a1a9-4298-b675-bbe5ad11d7e3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.453211 Oct 29 02:57:17.431658 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1293/2376] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:16 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:17.608632 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-983d180f-ce8f-4a58-9cac-910dabd84ee2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "6a22f1bf-9a27-4375-9469-db16defea274"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-983d180f-ce8f-4a58-9cac-910dabd84ee2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 163 Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: {"server": {"name": 12345, "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "6a22f1bf-9a27-4375-9469-db16defea274"}]}} Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'cd315600-df67-41c1-95d3-95a5145fc39a', 'flavorRef': '452', 'networks': [{'uuid': '6a22f1bf-9a27-4375-9469-db16defea274'}]}}} Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 12345 Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:57:17.617757 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:57:17.624158 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:57:17.624158 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 29 02:57:17.624158 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:17.624158 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:17.624158 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:17.624158 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:17.624158 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:17.624158 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:17.624158 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:57:17.624158 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:57:17.624158 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 29 02:57:17.624158 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:17.626716 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-983d180f-ce8f-4a58-9cac-910dabd84ee2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:17.628856 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-983d180f-ce8f-4a58-9cac-910dabd84ee2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.024928 Oct 29 02:57:17.635067 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1294/2377] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:57:17 2022] POST /compute/v2.1/servers => generated 127 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:57:17.642234 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a6fd55bc-ab5e-4913-a3f2-81428aaf8336 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:17.643143 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a6fd55bc-ab5e-4913-a3f2-81428aaf8336 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:17.653637 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6fd55bc-ab5e-4913-a3f2-81428aaf8336 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:17.654442 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6fd55bc-ab5e-4913-a3f2-81428aaf8336 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:17.655694 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6fd55bc-ab5e-4913-a3f2-81428aaf8336 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:17.657115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6fd55bc-ab5e-4913-a3f2-81428aaf8336 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:17.657760 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6fd55bc-ab5e-4913-a3f2-81428aaf8336 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:17.658563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6fd55bc-ab5e-4913-a3f2-81428aaf8336 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:17.936781 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0f40160b-05dc-486f-a619-bd8d7e3e714f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:17.952578 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0f40160b-05dc-486f-a619-bd8d7e3e714f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1505 microversion: 2.1 time: 0.624889 Oct 29 02:57:17.953696 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1084/2378] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:17 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1505 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:17.961781 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bdee4f1f-f955-46a4-9a1f-e82d9286c1e7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:17.963019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bdee4f1f-f955-46a4-9a1f-e82d9286c1e7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:17.975711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bdee4f1f-f955-46a4-9a1f-e82d9286c1e7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:17.978372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bdee4f1f-f955-46a4-9a1f-e82d9286c1e7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:17.980743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bdee4f1f-f955-46a4-9a1f-e82d9286c1e7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:17.987053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bdee4f1f-f955-46a4-9a1f-e82d9286c1e7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:17.988305 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bdee4f1f-f955-46a4-9a1f-e82d9286c1e7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:17.989381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bdee4f1f-f955-46a4-9a1f-e82d9286c1e7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:18.426443 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bdee4f1f-f955-46a4-9a1f-e82d9286c1e7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:18.439891 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bdee4f1f-f955-46a4-9a1f-e82d9286c1e7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1361 microversion: 2.1 time: 0.484467 Oct 29 02:57:18.455505 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1085/2379] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:17 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1361 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:18.470120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d64b999f-a5b7-4107-8edd-561dda8d4655 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:18.471057 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d64b999f-a5b7-4107-8edd-561dda8d4655 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:18.493761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d64b999f-a5b7-4107-8edd-561dda8d4655 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:18.494460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d64b999f-a5b7-4107-8edd-561dda8d4655 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:18.495048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d64b999f-a5b7-4107-8edd-561dda8d4655 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:18.495800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d64b999f-a5b7-4107-8edd-561dda8d4655 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:18.496419 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d64b999f-a5b7-4107-8edd-561dda8d4655 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:18.496745 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d64b999f-a5b7-4107-8edd-561dda8d4655 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:18.517964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a6fd55bc-ab5e-4913-a3f2-81428aaf8336 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:18.528096 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a6fd55bc-ab5e-4913-a3f2-81428aaf8336 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.890345 Oct 29 02:57:18.555131 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1295/2380] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:17 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:18.575336 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b525dd33-8af5-44ca-bdca-40fa61ff0026 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:18.576470 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b525dd33-8af5-44ca-bdca-40fa61ff0026 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 4876d09c-0ef0-4434-adb5-ca84626ca4bb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:18.588497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b525dd33-8af5-44ca-bdca-40fa61ff0026 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:18.589461 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b525dd33-8af5-44ca-bdca-40fa61ff0026 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:18.590320 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b525dd33-8af5-44ca-bdca-40fa61ff0026 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:18.591700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b525dd33-8af5-44ca-bdca-40fa61ff0026 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:18.592766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b525dd33-8af5-44ca-bdca-40fa61ff0026 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:18.593478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b525dd33-8af5-44ca-bdca-40fa61ff0026 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:18.599115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:18.954921 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d64b999f-a5b7-4107-8edd-561dda8d4655 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:18.973522 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d64b999f-a5b7-4107-8edd-561dda8d4655 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 200 len: 1505 microversion: 2.1 time: 0.515940 Oct 29 02:57:18.976125 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1086/2381] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:18 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 1505 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:18.994327 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-685b9930-9a25-4e59-983d-aedbcbd15d41 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:18.999601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-685b9930-9a25-4e59-983d-aedbcbd15d41 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:19.017596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-685b9930-9a25-4e59-983d-aedbcbd15d41 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:19.019049 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-685b9930-9a25-4e59-983d-aedbcbd15d41 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:19.021429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-685b9930-9a25-4e59-983d-aedbcbd15d41 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:19.022664 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-685b9930-9a25-4e59-983d-aedbcbd15d41 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:19.023157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-685b9930-9a25-4e59-983d-aedbcbd15d41 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:19.023590 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-685b9930-9a25-4e59-983d-aedbcbd15d41 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:19.140660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b525dd33-8af5-44ca-bdca-40fa61ff0026 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:19.156490 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b525dd33-8af5-44ca-bdca-40fa61ff0026 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb" status: 200 len: 1315 microversion: 2.1 time: 0.598617 Oct 29 02:57:19.158312 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1296/2382] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:18 2022] GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb => generated 1315 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:19.167111 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-83bce7fa-e3c8-4ae3-8fda-929da703819d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:19.168503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-83bce7fa-e3c8-4ae3-8fda-929da703819d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:19.189443 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83bce7fa-e3c8-4ae3-8fda-929da703819d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:19.190912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83bce7fa-e3c8-4ae3-8fda-929da703819d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:19.192234 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83bce7fa-e3c8-4ae3-8fda-929da703819d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:19.194481 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83bce7fa-e3c8-4ae3-8fda-929da703819d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:19.196188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83bce7fa-e3c8-4ae3-8fda-929da703819d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:19.197746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83bce7fa-e3c8-4ae3-8fda-929da703819d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:19.272637 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-83bce7fa-e3c8-4ae3-8fda-929da703819d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:57:19.481582 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-83bce7fa-e3c8-4ae3-8fda-929da703819d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 204 len: 0 microversion: 2.1 time: 0.321352 Oct 29 02:57:19.482682 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1297/2383] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:57:19 2022] DELETE /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:57:19.487858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f6a79fd1-d6f9-46cb-b0cf-5891d36a7a2e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:19.488801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f6a79fd1-d6f9-46cb-b0cf-5891d36a7a2e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:19.495982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f6a79fd1-d6f9-46cb-b0cf-5891d36a7a2e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:19.497019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f6a79fd1-d6f9-46cb-b0cf-5891d36a7a2e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:19.497455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f6a79fd1-d6f9-46cb-b0cf-5891d36a7a2e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:19.498172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f6a79fd1-d6f9-46cb-b0cf-5891d36a7a2e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:19.498618 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f6a79fd1-d6f9-46cb-b0cf-5891d36a7a2e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:19.499827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f6a79fd1-d6f9-46cb-b0cf-5891d36a7a2e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:19.525685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-685b9930-9a25-4e59-983d-aedbcbd15d41 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:19.543419 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-685b9930-9a25-4e59-983d-aedbcbd15d41 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.565783 Oct 29 02:57:19.546427 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1087/2384] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:18 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:19.668492 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-83937e43-4bea-47db-ad24-86b190ce96cd tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1098175418", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "18fc4cb9-056a-42e1-bd8a-e4a27cb291b2"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:19.828174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-83937e43-4bea-47db-ad24-86b190ce96cd tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] validate_networks() for [('18fc4cb9-056a-42e1-bd8a-e4a27cb291b2', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:57:19.899137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f6a79fd1-d6f9-46cb-b0cf-5891d36a7a2e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:19.912889 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f6a79fd1-d6f9-46cb-b0cf-5891d36a7a2e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1544 microversion: 2.1 time: 0.428000 Oct 29 02:57:19.913515 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1298/2385] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:19 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1544 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:19.928272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-12ad9fbd-7376-4420-a0b3-dd6a0317a881 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1075960832", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "7f99e4be-cbcb-4834-96c2-e8888447d097"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:20.046683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-12ad9fbd-7376-4420-a0b3-dd6a0317a881 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] validate_networks() for [('7f99e4be-cbcb-4834-96c2-e8888447d097', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:57:20.939522 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:21.201304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-12ad9fbd-7376-4420-a0b3-dd6a0317a881 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:57:21.202140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-12ad9fbd-7376-4420-a0b3-dd6a0317a881 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:57:21.202425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-12ad9fbd-7376-4420-a0b3-dd6a0317a881 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:57:21.203051 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-12ad9fbd-7376-4420-a0b3-dd6a0317a881 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:57:21.203862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-12ad9fbd-7376-4420-a0b3-dd6a0317a881 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:57:21.234938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12ad9fbd-7376-4420-a0b3-dd6a0317a881 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:21.238320 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12ad9fbd-7376-4420-a0b3-dd6a0317a881 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:21.239327 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12ad9fbd-7376-4420-a0b3-dd6a0317a881 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:21.243803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12ad9fbd-7376-4420-a0b3-dd6a0317a881 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:21.248544 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12ad9fbd-7376-4420-a0b3-dd6a0317a881 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:21.249503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12ad9fbd-7376-4420-a0b3-dd6a0317a881 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:21.333823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-12ad9fbd-7376-4420-a0b3-dd6a0317a881 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Getting quotas for project dae7f63d25fd42f0a2805df87595ff5f. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:57:21.366084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-12ad9fbd-7376-4420-a0b3-dd6a0317a881 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Getting quotas for user a412bb38fb11498d9dd4a6ce6a63370d and project dae7f63d25fd42f0a2805df87595ff5f. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:57:21.432609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-12ad9fbd-7376-4420-a0b3-dd6a0317a881 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:57:21.435491 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-12ad9fbd-7376-4420-a0b3-dd6a0317a881 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:57:21.544026 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-12ad9fbd-7376-4420-a0b3-dd6a0317a881 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.627608 Oct 29 02:57:21.545991 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1299/2386] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:57:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:57:21.556181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eccca7cb-5f9d-417d-851e-84deaa8fca5a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:21.561592 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-eccca7cb-5f9d-417d-851e-84deaa8fca5a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:21.579578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eccca7cb-5f9d-417d-851e-84deaa8fca5a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:21.599044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eccca7cb-5f9d-417d-851e-84deaa8fca5a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:21.612647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eccca7cb-5f9d-417d-851e-84deaa8fca5a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:21.614807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eccca7cb-5f9d-417d-851e-84deaa8fca5a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:21.620658 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eccca7cb-5f9d-417d-851e-84deaa8fca5a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:21.624350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eccca7cb-5f9d-417d-851e-84deaa8fca5a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:21.882046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-83937e43-4bea-47db-ad24-86b190ce96cd tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:57:21.889865 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-83937e43-4bea-47db-ad24-86b190ce96cd tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:57:21.891397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-83937e43-4bea-47db-ad24-86b190ce96cd tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:57:21.896917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-83937e43-4bea-47db-ad24-86b190ce96cd tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:57:21.898185 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-83937e43-4bea-47db-ad24-86b190ce96cd tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:57:21.927671 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83937e43-4bea-47db-ad24-86b190ce96cd tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:21.928567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83937e43-4bea-47db-ad24-86b190ce96cd tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:21.929481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83937e43-4bea-47db-ad24-86b190ce96cd tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:21.930353 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eccca7cb-5f9d-417d-851e-84deaa8fca5a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.380847 Oct 29 02:57:21.931226 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1300/2387] 10.222.0.46 () {58 vars in 1275 bytes} [Sat Oct 29 02:57:21 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e/os-interface => generated 284 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:21.931914 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83937e43-4bea-47db-ad24-86b190ce96cd tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:21.932605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83937e43-4bea-47db-ad24-86b190ce96cd tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:21.933193 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83937e43-4bea-47db-ad24-86b190ce96cd tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:21.942831 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:21.954824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-7628b81c-63c8-4029-bb26-428eaa3036cf req-5c59b55e-afd3-4f39-9756-990b2e8138e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4876d09c-0ef0-4434-adb5-ca84626ca4bb", "tag": "7f27823d-3f2a-4395-80a4-64d9426be9ed"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:21.965853 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-83937e43-4bea-47db-ad24-86b190ce96cd tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Getting quotas for project 185d32c10dd845768f4ff70a85680358. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:57:21.973567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-83937e43-4bea-47db-ad24-86b190ce96cd tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Getting quotas for user c866f273672846eb8d7f4f2a00269666 and project 185d32c10dd845768f4ff70a85680358. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:57:21.985374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7628b81c-63c8-4029-bb26-428eaa3036cf req-5c59b55e-afd3-4f39-9756-990b2e8138e0 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:21.986563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7628b81c-63c8-4029-bb26-428eaa3036cf req-5c59b55e-afd3-4f39-9756-990b2e8138e0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:21.987243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7628b81c-63c8-4029-bb26-428eaa3036cf req-5c59b55e-afd3-4f39-9756-990b2e8138e0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:22.020317 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-83937e43-4bea-47db-ad24-86b190ce96cd tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:57:22.024089 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-7628b81c-63c8-4029-bb26-428eaa3036cf req-5c59b55e-afd3-4f39-9756-990b2e8138e0 service nova] Creating event network-changed:7f27823d-3f2a-4395-80a4-64d9426be9ed for instance 4876d09c-0ef0-4434-adb5-ca84626ca4bb on n-h2-862967-2 Oct 29 02:57:22.025766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-83937e43-4bea-47db-ad24-86b190ce96cd tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:57:22.037479 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-7628b81c-63c8-4029-bb26-428eaa3036cf req-5c59b55e-afd3-4f39-9756-990b2e8138e0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093171 Oct 29 02:57:22.043993 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1301/2388] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:22.064369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-27e7c5f8-05bc-4ad1-ba1f-bcd035c8a00e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:22.067344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-27e7c5f8-05bc-4ad1-ba1f-bcd035c8a00e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 4876d09c-0ef0-4434-adb5-ca84626ca4bb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:22.069142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:22.085986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27e7c5f8-05bc-4ad1-ba1f-bcd035c8a00e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:22.086676 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27e7c5f8-05bc-4ad1-ba1f-bcd035c8a00e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:22.091307 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27e7c5f8-05bc-4ad1-ba1f-bcd035c8a00e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:22.094966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27e7c5f8-05bc-4ad1-ba1f-bcd035c8a00e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:22.096005 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27e7c5f8-05bc-4ad1-ba1f-bcd035c8a00e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:22.098237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27e7c5f8-05bc-4ad1-ba1f-bcd035c8a00e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:22.131803 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-83937e43-4bea-47db-ad24-86b190ce96cd tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.582674 Oct 29 02:57:22.141350 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1088/2389] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:57:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:57:22.148787 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c55073a6-c061-45b8-99f7-c936fe5f563f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-710774742", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1e9a6515-d426-4dbd-8fdb-587ef2f1e1cf"}], "security_groups": [{"name": "tempest-securitygroup--819290945"}], "key_name": "tempest-keypair-1188994911", "user_data": "}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:22.848170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-27e7c5f8-05bc-4ad1-ba1f-bcd035c8a00e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:22.862575 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-27e7c5f8-05bc-4ad1-ba1f-bcd035c8a00e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb" status: 200 len: 1315 microversion: 2.1 time: 0.816527 Oct 29 02:57:22.887714 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1302/2390] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:22 2022] GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb => generated 1315 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:22.893397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0b209562-05c7-4143-9f61-71bf25b2c8e0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:22.897689 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0b209562-05c7-4143-9f61-71bf25b2c8e0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:22.910993 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b209562-05c7-4143-9f61-71bf25b2c8e0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:22.911982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b209562-05c7-4143-9f61-71bf25b2c8e0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:22.912941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b209562-05c7-4143-9f61-71bf25b2c8e0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:22.914443 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b209562-05c7-4143-9f61-71bf25b2c8e0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:22.915624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b209562-05c7-4143-9f61-71bf25b2c8e0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:22.916802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b209562-05c7-4143-9f61-71bf25b2c8e0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:22.957552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-c55073a6-c061-45b8-99f7-c936fe5f563f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] validate_networks() for [('1e9a6515-d426-4dbd-8fdb-587ef2f1e1cf', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:57:23.046236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0b209562-05c7-4143-9f61-71bf25b2c8e0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:23.059876 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0b209562-05c7-4143-9f61-71bf25b2c8e0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1222 microversion: 2.1 time: 0.169891 Oct 29 02:57:23.080865 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1303/2391] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:22 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1222 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:23.094179 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-07a42783-c21d-47be-b707-65725f3eadf6 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:23.095062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-07a42783-c21d-47be-b707-65725f3eadf6 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:23.224319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-07a42783-c21d-47be-b707-65725f3eadf6 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:23.238908 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-07a42783-c21d-47be-b707-65725f3eadf6 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8" status: 200 len: 1208 microversion: 2.1 time: 0.156088 Oct 29 02:57:23.256877 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1304/2392] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:23 2022] GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 => generated 1208 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:23.270536 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-351b86b7-6c6c-4d53-a104-43c7ac58ca35 req-f29fa2ea-14b2-4098-a4e0-636558b38478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c352884d-b0ee-4a54-bc72-41e39eb0839f", "name": "network-vif-deleted", "tag": "a022a789-20a6-47d7-9b60-c4ab6361d88b"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:23.295822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-351b86b7-6c6c-4d53-a104-43c7ac58ca35 req-f29fa2ea-14b2-4098-a4e0-636558b38478 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:23.297142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-351b86b7-6c6c-4d53-a104-43c7ac58ca35 req-f29fa2ea-14b2-4098-a4e0-636558b38478 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:23.298279 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-351b86b7-6c6c-4d53-a104-43c7ac58ca35 req-f29fa2ea-14b2-4098-a4e0-636558b38478 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:23.322132 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-351b86b7-6c6c-4d53-a104-43c7ac58ca35 req-f29fa2ea-14b2-4098-a4e0-636558b38478 service nova] Creating event network-vif-deleted:a022a789-20a6-47d7-9b60-c4ab6361d88b for instance c352884d-b0ee-4a54-bc72-41e39eb0839f on n-h2-862967-2 Oct 29 02:57:23.328864 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-351b86b7-6c6c-4d53-a104-43c7ac58ca35 req-f29fa2ea-14b2-4098-a4e0-636558b38478 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065965 Oct 29 02:57:23.329963 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1305/2393] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:23.336967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a1cfd1e8-aaea-44b7-bd98-86ec412d20cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-210396668", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "c8ac0118-1101-4f92-a97f-84802d47a65a", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "6a22f1bf-9a27-4375-9469-db16defea274"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:23.525312 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-a1cfd1e8-aaea-44b7-bd98-86ec412d20cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Block Device c8ac0118-1101-4f92-a97f-84802d47a65a is not bootable. Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a1cfd1e8-aaea-44b7-bd98-86ec412d20cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 357 Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-210396668", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "c8ac0118-1101-4f92-a97f-84802d47a65a", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "6a22f1bf-9a27-4375-9469-db16defea274"}]}} Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: exception: Block Device c8ac0118-1101-4f92-a97f-84802d47a65a is not bootable. Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-210396668', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'c8ac0118-1101-4f92-a97f-84802d47a65a'}], 'networks': [{'uuid': '6a22f1bf-9a27-4375-9469-db16defea274'}]}}} Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device c8ac0118-1101-4f92-a97f-84802d47a65a is not bootable. Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:23.538844 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:23.542738 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:23.542738 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:23.542738 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:23.542738 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 02:57:23.542738 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 29 02:57:23.542738 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 29 02:57:23.542738 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device c8ac0118-1101-4f92-a97f-84802d47a65a is not bootable. Oct 29 02:57:23.542738 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:23.542738 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:23.542738 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:23.542738 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:23.542738 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:23.542738 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:23.542738 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:23.542738 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:23.542738 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device c8ac0118-1101-4f92-a97f-84802d47a65a is not bootable. Oct 29 02:57:23.542738 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:23.542738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a1cfd1e8-aaea-44b7-bd98-86ec412d20cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 400 to user: Block Device c8ac0118-1101-4f92-a97f-84802d47a65a is not bootable. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:23.542738 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a1cfd1e8-aaea-44b7-bd98-86ec412d20cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.210567 Oct 29 02:57:23.543887 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1306/2394] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:57:23 2022] POST /compute/v2.1/servers => generated 110 bytes in 213 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:57:23.572689 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-55f33133-8339-4ac7-a593-162b70817739 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:23.581277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-55f33133-8339-4ac7-a593-162b70817739 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:23.611211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55f33133-8339-4ac7-a593-162b70817739 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:23.611968 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55f33133-8339-4ac7-a593-162b70817739 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:23.612430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55f33133-8339-4ac7-a593-162b70817739 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:23.613254 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55f33133-8339-4ac7-a593-162b70817739 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:23.613733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55f33133-8339-4ac7-a593-162b70817739 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:23.619967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55f33133-8339-4ac7-a593-162b70817739 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:24.199170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-55f33133-8339-4ac7-a593-162b70817739 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:24.236851 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-55f33133-8339-4ac7-a593-162b70817739 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.679095 Oct 29 02:57:24.240154 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1307/2395] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:23 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:24.251114 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-c55073a6-c061-45b8-99f7-c936fe5f563f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:57:24.252828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-c55073a6-c061-45b8-99f7-c936fe5f563f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:57:24.254000 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-c55073a6-c061-45b8-99f7-c936fe5f563f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:57:24.256312 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-c55073a6-c061-45b8-99f7-c936fe5f563f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:57:24.257403 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-c55073a6-c061-45b8-99f7-c936fe5f563f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:57:24.268269 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6a7734c1-18fa-40a5-8428-83dff31de5dc tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:24.291011 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6a7734c1-18fa-40a5-8428-83dff31de5dc tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 4876d09c-0ef0-4434-adb5-ca84626ca4bb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:24.327278 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a7734c1-18fa-40a5-8428-83dff31de5dc tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:24.327278 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a7734c1-18fa-40a5-8428-83dff31de5dc tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:24.327278 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a7734c1-18fa-40a5-8428-83dff31de5dc tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:24.333310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c55073a6-c061-45b8-99f7-c936fe5f563f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:24.334949 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a7734c1-18fa-40a5-8428-83dff31de5dc tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:24.336171 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c55073a6-c061-45b8-99f7-c936fe5f563f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:24.337932 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c55073a6-c061-45b8-99f7-c936fe5f563f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:24.342992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c55073a6-c061-45b8-99f7-c936fe5f563f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:24.344168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c55073a6-c061-45b8-99f7-c936fe5f563f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:24.345179 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c55073a6-c061-45b8-99f7-c936fe5f563f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:24.349155 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a7734c1-18fa-40a5-8428-83dff31de5dc tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:24.349842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a7734c1-18fa-40a5-8428-83dff31de5dc tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:24.373699 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-c55073a6-c061-45b8-99f7-c936fe5f563f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Getting quotas for project 746258dc83c74b9ba3634afbc2716d7b. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:57:24.387140 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-c55073a6-c061-45b8-99f7-c936fe5f563f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Getting quotas for user 4dbcac917fc6415683ae17b220276c91 and project 746258dc83c74b9ba3634afbc2716d7b. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:57:24.449627 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c55073a6-c061-45b8-99f7-c936fe5f563f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:57:24.457315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c55073a6-c061-45b8-99f7-c936fe5f563f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:57:24.554023 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c55073a6-c061-45b8-99f7-c936fe5f563f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.410809 Oct 29 02:57:24.563557 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1089/2396] 10.222.0.46 () {62 vars in 1188 bytes} [Sat Oct 29 02:57:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 2421 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 02:57:24.570706 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-778ceaad-f08d-400d-b785-8d5bc8e85210 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:24.571825 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-778ceaad-f08d-400d-b785-8d5bc8e85210 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:24.580314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-778ceaad-f08d-400d-b785-8d5bc8e85210 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:24.581345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-778ceaad-f08d-400d-b785-8d5bc8e85210 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:24.582021 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-778ceaad-f08d-400d-b785-8d5bc8e85210 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:24.582975 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-778ceaad-f08d-400d-b785-8d5bc8e85210 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:24.583858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-778ceaad-f08d-400d-b785-8d5bc8e85210 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:24.584694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-778ceaad-f08d-400d-b785-8d5bc8e85210 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:24.673913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6a7734c1-18fa-40a5-8428-83dff31de5dc tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:24.683321 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6a7734c1-18fa-40a5-8428-83dff31de5dc tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb" status: 200 len: 1315 microversion: 2.1 time: 0.441210 Oct 29 02:57:24.685639 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1308/2397] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:24 2022] GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:24.725720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ba4612c5-f49e-4bbe-a094-02ed29c53feb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:24.729716 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ba4612c5-f49e-4bbe-a094-02ed29c53feb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:24.768423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba4612c5-f49e-4bbe-a094-02ed29c53feb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:24.773998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba4612c5-f49e-4bbe-a094-02ed29c53feb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:24.774785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba4612c5-f49e-4bbe-a094-02ed29c53feb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:24.778107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba4612c5-f49e-4bbe-a094-02ed29c53feb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:24.780214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba4612c5-f49e-4bbe-a094-02ed29c53feb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:24.781290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba4612c5-f49e-4bbe-a094-02ed29c53feb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:24.872456 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-778ceaad-f08d-400d-b785-8d5bc8e85210 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:24.892782 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-778ceaad-f08d-400d-b785-8d5bc8e85210 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1270 microversion: 2.1 time: 0.325753 Oct 29 02:57:24.894186 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1090/2398] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:24 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1270 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:24.903655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7077ae9c-1b29-40f9-aa37-60debb06344b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:24.908921 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7077ae9c-1b29-40f9-aa37-60debb06344b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:24.918509 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7077ae9c-1b29-40f9-aa37-60debb06344b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:24.921019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7077ae9c-1b29-40f9-aa37-60debb06344b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:24.921737 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7077ae9c-1b29-40f9-aa37-60debb06344b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:24.922702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7077ae9c-1b29-40f9-aa37-60debb06344b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:24.923450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7077ae9c-1b29-40f9-aa37-60debb06344b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:24.927746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7077ae9c-1b29-40f9-aa37-60debb06344b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:25.382728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ba4612c5-f49e-4bbe-a094-02ed29c53feb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:25.413494 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ba4612c5-f49e-4bbe-a094-02ed29c53feb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.721749 Oct 29 02:57:25.416859 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1309/2399] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:24 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:25.435109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-329dc46a-8fc8-4f66-9ed3-7c76c7b7384f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:25.439532 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-329dc46a-8fc8-4f66-9ed3-7c76c7b7384f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:25.449223 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7077ae9c-1b29-40f9-aa37-60debb06344b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:25.462595 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7077ae9c-1b29-40f9-aa37-60debb06344b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8" status: 200 len: 1204 microversion: 2.1 time: 0.567098 Oct 29 02:57:25.463251 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1091/2400] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:24 2022] GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 => generated 1204 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:25.545751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-20f9c58b-6e21-4e8f-931e-e9804f30418a req-27dd7394-5745-4705-ae93-6dcaf73d9f5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b40f7b3b-04d4-4cfa-8058-09afc05d791e", "tag": "9766e845-d03c-426b-87c8-9df2fb171e28"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:25.584026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-20f9c58b-6e21-4e8f-931e-e9804f30418a req-27dd7394-5745-4705-ae93-6dcaf73d9f5f service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:25.586226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-20f9c58b-6e21-4e8f-931e-e9804f30418a req-27dd7394-5745-4705-ae93-6dcaf73d9f5f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:25.589032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-20f9c58b-6e21-4e8f-931e-e9804f30418a req-27dd7394-5745-4705-ae93-6dcaf73d9f5f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:25.629942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-329dc46a-8fc8-4f66-9ed3-7c76c7b7384f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:25.633004 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-20f9c58b-6e21-4e8f-931e-e9804f30418a req-27dd7394-5745-4705-ae93-6dcaf73d9f5f service nova] Creating event network-changed:9766e845-d03c-426b-87c8-9df2fb171e28 for instance b40f7b3b-04d4-4cfa-8058-09afc05d791e on n-h1-862967-2 Oct 29 02:57:25.640683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-329dc46a-8fc8-4f66-9ed3-7c76c7b7384f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:25.644978 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-20f9c58b-6e21-4e8f-931e-e9804f30418a req-27dd7394-5745-4705-ae93-6dcaf73d9f5f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103475 Oct 29 02:57:25.647365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-329dc46a-8fc8-4f66-9ed3-7c76c7b7384f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:25.648750 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-329dc46a-8fc8-4f66-9ed3-7c76c7b7384f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1281 microversion: 2.20 time: 0.230863 Oct 29 02:57:25.652306 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1310/2401] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:57:25 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1281 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:57:25.681967 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1092/2402] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:57:25.732744 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-de5a34f8-f2f2-4c54-8e21-5e9ab9d8dbaa tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:25.733614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-de5a34f8-f2f2-4c54-8e21-5e9ab9d8dbaa tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 4876d09c-0ef0-4434-adb5-ca84626ca4bb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:25.761682 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-de5a34f8-f2f2-4c54-8e21-5e9ab9d8dbaa tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:25.762243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-de5a34f8-f2f2-4c54-8e21-5e9ab9d8dbaa tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:25.762716 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-de5a34f8-f2f2-4c54-8e21-5e9ab9d8dbaa tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:25.763518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-de5a34f8-f2f2-4c54-8e21-5e9ab9d8dbaa tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:25.764065 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-de5a34f8-f2f2-4c54-8e21-5e9ab9d8dbaa tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:25.764798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-de5a34f8-f2f2-4c54-8e21-5e9ab9d8dbaa tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:25.933530 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-67083232-b2ad-420f-acd2-c365feb26102 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:25.934384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-67083232-b2ad-420f-acd2-c365feb26102 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:25.958504 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67083232-b2ad-420f-acd2-c365feb26102 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:25.959052 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67083232-b2ad-420f-acd2-c365feb26102 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:25.959504 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67083232-b2ad-420f-acd2-c365feb26102 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:25.960254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67083232-b2ad-420f-acd2-c365feb26102 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:25.965143 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67083232-b2ad-420f-acd2-c365feb26102 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:25.966105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67083232-b2ad-420f-acd2-c365feb26102 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:26.179204 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-de5a34f8-f2f2-4c54-8e21-5e9ab9d8dbaa tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:26.193597 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-de5a34f8-f2f2-4c54-8e21-5e9ab9d8dbaa tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb" status: 200 len: 1315 microversion: 2.1 time: 0.470292 Oct 29 02:57:26.194513 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1311/2403] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:25 2022] GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:26.382207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-67083232-b2ad-420f-acd2-c365feb26102 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:26.411182 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-67083232-b2ad-420f-acd2-c365feb26102 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1276 microversion: 2.1 time: 0.483275 Oct 29 02:57:26.421754 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1093/2404] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:25 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1276 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:26.510593 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a9a37f35-3b8e-47f5-993d-1f0743f4290e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:26.522398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a9a37f35-3b8e-47f5-993d-1f0743f4290e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:26.541414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9a37f35-3b8e-47f5-993d-1f0743f4290e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:26.557984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9a37f35-3b8e-47f5-993d-1f0743f4290e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:26.561924 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9a37f35-3b8e-47f5-993d-1f0743f4290e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:26.566549 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9a37f35-3b8e-47f5-993d-1f0743f4290e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:26.573809 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9a37f35-3b8e-47f5-993d-1f0743f4290e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:26.581054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9a37f35-3b8e-47f5-993d-1f0743f4290e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:26.690058 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cc8304f7-3cb0-487d-a8f4-c8b8643f88c9 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:26.691087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cc8304f7-3cb0-487d-a8f4-c8b8643f88c9 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:26.711857 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc8304f7-3cb0-487d-a8f4-c8b8643f88c9 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:26.712692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc8304f7-3cb0-487d-a8f4-c8b8643f88c9 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:26.713515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc8304f7-3cb0-487d-a8f4-c8b8643f88c9 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:26.714666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc8304f7-3cb0-487d-a8f4-c8b8643f88c9 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:26.715422 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc8304f7-3cb0-487d-a8f4-c8b8643f88c9 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:26.716601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc8304f7-3cb0-487d-a8f4-c8b8643f88c9 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:26.950062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a9a37f35-3b8e-47f5-993d-1f0743f4290e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:26.972361 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a9a37f35-3b8e-47f5-993d-1f0743f4290e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8" status: 200 len: 1260 microversion: 2.1 time: 0.453872 Oct 29 02:57:26.991874 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1312/2405] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:26 2022] GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 => generated 1260 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:27.096484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cc8304f7-3cb0-487d-a8f4-c8b8643f88c9 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:27.114685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cc8304f7-3cb0-487d-a8f4-c8b8643f88c9 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:27.118438 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cc8304f7-3cb0-487d-a8f4-c8b8643f88c9 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:27.120875 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cc8304f7-3cb0-487d-a8f4-c8b8643f88c9 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1285 microversion: 2.20 time: 0.437526 Oct 29 02:57:27.122586 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1094/2406] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:57:26 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1285 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:57:27.232679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4d495bfa-e3ee-42c1-9712-a9add5eb1c18 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:27.233857 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4d495bfa-e3ee-42c1-9712-a9add5eb1c18 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 4876d09c-0ef0-4434-adb5-ca84626ca4bb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:27.240469 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:27.258660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d495bfa-e3ee-42c1-9712-a9add5eb1c18 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:27.260301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d495bfa-e3ee-42c1-9712-a9add5eb1c18 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:27.260957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d495bfa-e3ee-42c1-9712-a9add5eb1c18 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:27.262049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d495bfa-e3ee-42c1-9712-a9add5eb1c18 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:27.263046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d495bfa-e3ee-42c1-9712-a9add5eb1c18 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:27.263923 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d495bfa-e3ee-42c1-9712-a9add5eb1c18 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:27.473619 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-59d95906-bd54-449d-8ee9-9274b1713846 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:27.475277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-59d95906-bd54-449d-8ee9-9274b1713846 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:27.490519 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59d95906-bd54-449d-8ee9-9274b1713846 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:27.491814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59d95906-bd54-449d-8ee9-9274b1713846 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:27.493164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59d95906-bd54-449d-8ee9-9274b1713846 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:27.495005 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59d95906-bd54-449d-8ee9-9274b1713846 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:27.496591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59d95906-bd54-449d-8ee9-9274b1713846 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:27.497602 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59d95906-bd54-449d-8ee9-9274b1713846 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:27.869235 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-59d95906-bd54-449d-8ee9-9274b1713846 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:27.894624 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-59d95906-bd54-449d-8ee9-9274b1713846 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1276 microversion: 2.1 time: 0.431213 Oct 29 02:57:27.896729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4d495bfa-e3ee-42c1-9712-a9add5eb1c18 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:27.906201 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1095/2407] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:27 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1276 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:27.930095 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4d495bfa-e3ee-42c1-9712-a9add5eb1c18 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb" status: 200 len: 1315 microversion: 2.1 time: 0.701846 Oct 29 02:57:27.954005 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1313/2408] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:27 2022] GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb => generated 1315 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:28.010649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c22301c5-05e3-4716-9118-894da1432980 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:28.014202 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c22301c5-05e3-4716-9118-894da1432980 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:28.051439 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c22301c5-05e3-4716-9118-894da1432980 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:28.052304 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c22301c5-05e3-4716-9118-894da1432980 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:28.053124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c22301c5-05e3-4716-9118-894da1432980 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:28.067420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c22301c5-05e3-4716-9118-894da1432980 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:28.068502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c22301c5-05e3-4716-9118-894da1432980 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:28.071323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c22301c5-05e3-4716-9118-894da1432980 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:28.167450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9e35c5d4-2646-4732-a43d-8c09a6c29ebc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:28.168197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9e35c5d4-2646-4732-a43d-8c09a6c29ebc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:28.185039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e35c5d4-2646-4732-a43d-8c09a6c29ebc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:28.185557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e35c5d4-2646-4732-a43d-8c09a6c29ebc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:28.186003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e35c5d4-2646-4732-a43d-8c09a6c29ebc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:28.194222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e35c5d4-2646-4732-a43d-8c09a6c29ebc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:28.196883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e35c5d4-2646-4732-a43d-8c09a6c29ebc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:28.197955 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e35c5d4-2646-4732-a43d-8c09a6c29ebc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:28.458972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9e35c5d4-2646-4732-a43d-8c09a6c29ebc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:28.481614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9e35c5d4-2646-4732-a43d-8c09a6c29ebc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:28.491145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9e35c5d4-2646-4732-a43d-8c09a6c29ebc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:28.505720 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9e35c5d4-2646-4732-a43d-8c09a6c29ebc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1333 microversion: 2.20 time: 0.334402 Oct 29 02:57:28.531050 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1314/2409] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:57:28 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1333 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:57:28.770943 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c22301c5-05e3-4716-9118-894da1432980 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:28.807649 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c22301c5-05e3-4716-9118-894da1432980 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8" status: 200 len: 1266 microversion: 2.1 time: 0.804452 Oct 29 02:57:28.812376 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1096/2410] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:28 2022] GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 => generated 1266 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:28.942782 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6e397b11-055b-46da-bde5-7c87f181c69c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:28.943556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6e397b11-055b-46da-bde5-7c87f181c69c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:28.974370 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1c0ecb0e-bcb9-454c-9c2a-a881af67cee1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:28.976564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1c0ecb0e-bcb9-454c-9c2a-a881af67cee1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 4876d09c-0ef0-4434-adb5-ca84626ca4bb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:28.978219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e397b11-055b-46da-bde5-7c87f181c69c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:28.979711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e397b11-055b-46da-bde5-7c87f181c69c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:28.982189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e397b11-055b-46da-bde5-7c87f181c69c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:28.985374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e397b11-055b-46da-bde5-7c87f181c69c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:28.986201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e397b11-055b-46da-bde5-7c87f181c69c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:28.989166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e397b11-055b-46da-bde5-7c87f181c69c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:29.015087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c0ecb0e-bcb9-454c-9c2a-a881af67cee1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:29.016015 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c0ecb0e-bcb9-454c-9c2a-a881af67cee1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:29.017038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c0ecb0e-bcb9-454c-9c2a-a881af67cee1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:29.018003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c0ecb0e-bcb9-454c-9c2a-a881af67cee1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:29.018631 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c0ecb0e-bcb9-454c-9c2a-a881af67cee1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:29.019229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c0ecb0e-bcb9-454c-9c2a-a881af67cee1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:29.500748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6e397b11-055b-46da-bde5-7c87f181c69c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:29.542769 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6e397b11-055b-46da-bde5-7c87f181c69c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1318 microversion: 2.1 time: 0.601400 Oct 29 02:57:29.547400 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1315/2411] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:28 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1318 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:29.579374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9c42674c-a51a-40e6-8cb6-1d4a6fd6da82 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:29.580417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9c42674c-a51a-40e6-8cb6-1d4a6fd6da82 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:29.588384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c42674c-a51a-40e6-8cb6-1d4a6fd6da82 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:29.588915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c42674c-a51a-40e6-8cb6-1d4a6fd6da82 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:29.589365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c42674c-a51a-40e6-8cb6-1d4a6fd6da82 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:29.592041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c42674c-a51a-40e6-8cb6-1d4a6fd6da82 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:29.592925 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c42674c-a51a-40e6-8cb6-1d4a6fd6da82 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:29.593369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c42674c-a51a-40e6-8cb6-1d4a6fd6da82 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:29.620214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:29.707856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1c0ecb0e-bcb9-454c-9c2a-a881af67cee1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:29.721145 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1c0ecb0e-bcb9-454c-9c2a-a881af67cee1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb" status: 200 len: 1315 microversion: 2.1 time: 0.763544 Oct 29 02:57:29.741573 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1097/2412] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:28 2022] GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb => generated 1315 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:29.847663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9c42674c-a51a-40e6-8cb6-1d4a6fd6da82 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:29.854907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-649c292d-0189-4d28-b41f-e998e85099b6 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:29.856304 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-649c292d-0189-4d28-b41f-e998e85099b6 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:29.883053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-649c292d-0189-4d28-b41f-e998e85099b6 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:29.895366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9c42674c-a51a-40e6-8cb6-1d4a6fd6da82 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:29.898068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9c42674c-a51a-40e6-8cb6-1d4a6fd6da82 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:29.899544 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9c42674c-a51a-40e6-8cb6-1d4a6fd6da82 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1339 microversion: 2.20 time: 0.335678 Oct 29 02:57:29.900103 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-649c292d-0189-4d28-b41f-e998e85099b6 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:29.900848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-649c292d-0189-4d28-b41f-e998e85099b6 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:29.902155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-649c292d-0189-4d28-b41f-e998e85099b6 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:29.904909 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-649c292d-0189-4d28-b41f-e998e85099b6 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:29.905500 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1316/2413] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:57:29 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1339 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:57:29.906487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-649c292d-0189-4d28-b41f-e998e85099b6 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:30.220848 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-2f394005-8a14-4ead-a4ae-5a6bdac7bcfd req-fe6a69dd-dd64-4f04-99bd-ecfb738eacbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4876d09c-0ef0-4434-adb5-ca84626ca4bb", "name": "network-vif-plugged", "status": "completed", "tag": "7f27823d-3f2a-4395-80a4-64d9426be9ed"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:30.250164 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-2f394005-8a14-4ead-a4ae-5a6bdac7bcfd req-fe6a69dd-dd64-4f04-99bd-ecfb738eacbe service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:30.253305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-2f394005-8a14-4ead-a4ae-5a6bdac7bcfd req-fe6a69dd-dd64-4f04-99bd-ecfb738eacbe service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:30.254430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-2f394005-8a14-4ead-a4ae-5a6bdac7bcfd req-fe6a69dd-dd64-4f04-99bd-ecfb738eacbe service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:30.285696 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-2f394005-8a14-4ead-a4ae-5a6bdac7bcfd req-fe6a69dd-dd64-4f04-99bd-ecfb738eacbe service nova] Creating event network-vif-plugged:7f27823d-3f2a-4395-80a4-64d9426be9ed for instance 4876d09c-0ef0-4434-adb5-ca84626ca4bb on n-h2-862967-2 Oct 29 02:57:30.305220 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-2f394005-8a14-4ead-a4ae-5a6bdac7bcfd req-fe6a69dd-dd64-4f04-99bd-ecfb738eacbe service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085142 Oct 29 02:57:30.305712 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1317/2414] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:57:30.447105 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fb914c5c-bfe7-4618-ba3d-5ff7f1271cf7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-466657355", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "cd315600-df67-41c1-95d3-95a5145fc39a", "destination_type": "local"}, {"source_type": "volume", "uuid": "d799217d-be83-4c81-ae60-cd7902943999", "destination_type": "invalid"}], "networks": [{"uuid": "6a22f1bf-9a27-4375-9469-db16defea274"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fb914c5c-bfe7-4618-ba3d-5ff7f1271cf7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 494 Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-466657355", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "cd315600-df67-41c1-95d3-95a5145fc39a", "destination_type": "local"}, {"source_type": "volume", "uuid": "d799217d-be83-4c81-ae60-cd7902943999", "destination_type": "invalid"}], "networks": [{"uuid": "6a22f1bf-9a27-4375-9469-db16defea274"}]}} Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-466657355', 'imageRef': 'cd315600-df67-41c1-95d3-95a5145fc39a', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'cd315600-df67-41c1-95d3-95a5145fc39a', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'd799217d-be83-4c81-ae60-cd7902943999', 'destination_type': 'invalid'}], 'networks': [{'uuid': '6a22f1bf-9a27-4375-9469-db16defea274'}]}}} Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'invalid' Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:30.469274 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:30.477217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:30.477217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:30.477217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:57:30.477217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:57:30.477217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:57:30.477217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:57:30.477217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:57:30.477217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:57:30.477217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 29 02:57:30.477217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:30.477217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:30.477217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:30.477217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:30.477217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:30.477217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:30.477217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:57:30.477217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:57:30.477217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 29 02:57:30.477217 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:30.477217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fb914c5c-bfe7-4618-ba3d-5ff7f1271cf7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:30.477217 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fb914c5c-bfe7-4618-ba3d-5ff7f1271cf7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.030706 Oct 29 02:57:30.480497 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1318/2415] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:57:30 2022] POST /compute/v2.1/servers => generated 155 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 02:57:30.494638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d26315c4-e0ca-40f6-9783-f6d0493be58c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:30.495931 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d26315c4-e0ca-40f6-9783-f6d0493be58c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:30.519736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d26315c4-e0ca-40f6-9783-f6d0493be58c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:30.521193 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d26315c4-e0ca-40f6-9783-f6d0493be58c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:30.522355 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d26315c4-e0ca-40f6-9783-f6d0493be58c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:30.523576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d26315c4-e0ca-40f6-9783-f6d0493be58c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:30.524419 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d26315c4-e0ca-40f6-9783-f6d0493be58c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:30.525136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d26315c4-e0ca-40f6-9783-f6d0493be58c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:30.597464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-649c292d-0189-4d28-b41f-e998e85099b6 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:30.615954 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-649c292d-0189-4d28-b41f-e998e85099b6 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8" status: 200 len: 1266 microversion: 2.1 time: 0.781281 Oct 29 02:57:30.616587 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1098/2416] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:29 2022] GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 => generated 1266 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:30.640430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b76db813-860a-402e-ae89-41713703c7a8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:30.641763 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b76db813-860a-402e-ae89-41713703c7a8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:30.651582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b76db813-860a-402e-ae89-41713703c7a8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:30.652388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b76db813-860a-402e-ae89-41713703c7a8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:30.653059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b76db813-860a-402e-ae89-41713703c7a8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:30.654001 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b76db813-860a-402e-ae89-41713703c7a8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:30.654665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b76db813-860a-402e-ae89-41713703c7a8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:30.655290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b76db813-860a-402e-ae89-41713703c7a8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:31.199779 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b76db813-860a-402e-ae89-41713703c7a8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:31.210987 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b76db813-860a-402e-ae89-41713703c7a8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1318 microversion: 2.1 time: 0.579927 Oct 29 02:57:31.234688 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1099/2417] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:30 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1318 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:31.240251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-16bd90b4-ac0a-425b-8425-c0b9774bc09d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:31.241663 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-16bd90b4-ac0a-425b-8425-c0b9774bc09d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 4876d09c-0ef0-4434-adb5-ca84626ca4bb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:31.251872 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-16bd90b4-ac0a-425b-8425-c0b9774bc09d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:31.252618 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-16bd90b4-ac0a-425b-8425-c0b9774bc09d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:31.253456 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-16bd90b4-ac0a-425b-8425-c0b9774bc09d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:31.254784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-16bd90b4-ac0a-425b-8425-c0b9774bc09d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:31.255575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-16bd90b4-ac0a-425b-8425-c0b9774bc09d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:31.256553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-16bd90b4-ac0a-425b-8425-c0b9774bc09d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:31.276819 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:31.504637 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d26315c4-e0ca-40f6-9783-f6d0493be58c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:31.549696 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d26315c4-e0ca-40f6-9783-f6d0493be58c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 1.060397 Oct 29 02:57:31.567780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-16bd90b4-ac0a-425b-8425-c0b9774bc09d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:31.573899 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1319/2418] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:30 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:31.594440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-70d970e6-f8a6-4c20-ac25-49f5db11e4f0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:31.595928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-70d970e6-f8a6-4c20-ac25-49f5db11e4f0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:31.607885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70d970e6-f8a6-4c20-ac25-49f5db11e4f0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:31.609368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70d970e6-f8a6-4c20-ac25-49f5db11e4f0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:31.610391 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70d970e6-f8a6-4c20-ac25-49f5db11e4f0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:31.611936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70d970e6-f8a6-4c20-ac25-49f5db11e4f0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:31.613010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70d970e6-f8a6-4c20-ac25-49f5db11e4f0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:31.614207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70d970e6-f8a6-4c20-ac25-49f5db11e4f0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:31.628068 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-16bd90b4-ac0a-425b-8425-c0b9774bc09d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb" status: 200 len: 1315 microversion: 2.1 time: 0.392064 Oct 29 02:57:31.629213 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1100/2419] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:31 2022] GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:31.682224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-556ac2c6-0c77-4a39-bb6c-3f7799e9e94d req-bb6be78b-0c5a-4a92-ab43-17540aaabbe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d981d040-d96a-40a5-a893-033a9d51e368", "tag": "d421fc9b-5ae4-42e7-a9d1-182d4fc1ec78"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:31.706183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-556ac2c6-0c77-4a39-bb6c-3f7799e9e94d req-bb6be78b-0c5a-4a92-ab43-17540aaabbe1 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:31.706925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-556ac2c6-0c77-4a39-bb6c-3f7799e9e94d req-bb6be78b-0c5a-4a92-ab43-17540aaabbe1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:31.707612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-556ac2c6-0c77-4a39-bb6c-3f7799e9e94d req-bb6be78b-0c5a-4a92-ab43-17540aaabbe1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:31.731038 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-556ac2c6-0c77-4a39-bb6c-3f7799e9e94d req-bb6be78b-0c5a-4a92-ab43-17540aaabbe1 service nova] Creating event network-changed:d421fc9b-5ae4-42e7-a9d1-182d4fc1ec78 for instance d981d040-d96a-40a5-a893-033a9d51e368 on n-h2-862967-2 Oct 29 02:57:31.745396 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-556ac2c6-0c77-4a39-bb6c-3f7799e9e94d req-bb6be78b-0c5a-4a92-ab43-17540aaabbe1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094426 Oct 29 02:57:31.746790 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1101/2420] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:31.757765 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a7ba6722-f0aa-42a2-8fe1-a9fc0b12e3c7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:31.760121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a7ba6722-f0aa-42a2-8fe1-a9fc0b12e3c7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:31.776425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7ba6722-f0aa-42a2-8fe1-a9fc0b12e3c7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:31.778331 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7ba6722-f0aa-42a2-8fe1-a9fc0b12e3c7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:31.779622 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7ba6722-f0aa-42a2-8fe1-a9fc0b12e3c7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:31.782725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7ba6722-f0aa-42a2-8fe1-a9fc0b12e3c7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:31.783818 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7ba6722-f0aa-42a2-8fe1-a9fc0b12e3c7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:31.785385 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7ba6722-f0aa-42a2-8fe1-a9fc0b12e3c7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:32.001158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-70d970e6-f8a6-4c20-ac25-49f5db11e4f0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:32.020310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-70d970e6-f8a6-4c20-ac25-49f5db11e4f0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:32.023324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-70d970e6-f8a6-4c20-ac25-49f5db11e4f0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:32.025923 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-70d970e6-f8a6-4c20-ac25-49f5db11e4f0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1406 microversion: 2.20 time: 0.446179 Oct 29 02:57:32.027265 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1320/2421] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:57:31 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1406 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:57:32.036902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-09d34ddc-5d7b-4437-8fed-cdac2ad9ca64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:32.038314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-09d34ddc-5d7b-4437-8fed-cdac2ad9ca64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:32.051352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09d34ddc-5d7b-4437-8fed-cdac2ad9ca64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:32.052680 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09d34ddc-5d7b-4437-8fed-cdac2ad9ca64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:32.053740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09d34ddc-5d7b-4437-8fed-cdac2ad9ca64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:32.055012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09d34ddc-5d7b-4437-8fed-cdac2ad9ca64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:32.056043 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09d34ddc-5d7b-4437-8fed-cdac2ad9ca64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:32.057136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09d34ddc-5d7b-4437-8fed-cdac2ad9ca64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:32.267138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a7ba6722-f0aa-42a2-8fe1-a9fc0b12e3c7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:32.286716 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a7ba6722-f0aa-42a2-8fe1-a9fc0b12e3c7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.536791 Oct 29 02:57:32.288428 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1102/2422] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:31 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:32.297276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3bd97ed2-276f-4f9b-b708-c9c770b7cec9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:32.298297 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3bd97ed2-276f-4f9b-b708-c9c770b7cec9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:32.328295 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bd97ed2-276f-4f9b-b708-c9c770b7cec9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:32.329244 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bd97ed2-276f-4f9b-b708-c9c770b7cec9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:32.330455 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bd97ed2-276f-4f9b-b708-c9c770b7cec9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:32.332884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bd97ed2-276f-4f9b-b708-c9c770b7cec9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:32.334271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bd97ed2-276f-4f9b-b708-c9c770b7cec9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:32.337686 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bd97ed2-276f-4f9b-b708-c9c770b7cec9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:32.568336 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-09d34ddc-5d7b-4437-8fed-cdac2ad9ca64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:32.589464 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-09d34ddc-5d7b-4437-8fed-cdac2ad9ca64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8" status: 200 len: 1308 microversion: 2.1 time: 0.560440 Oct 29 02:57:32.605026 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1321/2423] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:32 2022] GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 => generated 1308 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:32.612810 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-519b176d-094e-4e08-9927-6f8cbec3fd7b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2029595661", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "6a22f1bf-9a27-4375-9469-db16defea274"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-519b176d-094e-4e08-9927-6f8cbec3fd7b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 492 Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2029595661", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "6a22f1bf-9a27-4375-9469-db16defea274"}]}} Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2029595661', 'imageRef': 'cd315600-df67-41c1-95d3-95a5145fc39a', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '6a22f1bf-9a27-4375-9469-db16defea274'}]}}} Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.617510 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 29 02:57:32.620980 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 29 02:57:32.620980 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.620980 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:32.620980 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.620980 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:32.620980 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:32.620980 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:32.620980 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:32.620980 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:32.620980 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:32.620980 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:32.620980 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:32.620980 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:32.620980 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:57:32.620980 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:57:32.620980 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:57:32.620980 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:57:32.620980 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:57:32.620980 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:57:32.620980 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 29 02:57:32.620980 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.620980 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:32.620980 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.620980 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:32.620980 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:32.620980 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:32.620980 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:57:32.620980 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:57:32.620980 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 29 02:57:32.620980 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:32.624792 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-519b176d-094e-4e08-9927-6f8cbec3fd7b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:32.626159 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-519b176d-094e-4e08-9927-6f8cbec3fd7b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.019889 Oct 29 02:57:32.627623 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1322/2424] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:57:32 2022] POST /compute/v2.1/servers => generated 624 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:57:32.649391 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d74184d6-16cd-46d4-aa1e-57661014fb66 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:32.650557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d74184d6-16cd-46d4-aa1e-57661014fb66 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:32.661041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d74184d6-16cd-46d4-aa1e-57661014fb66 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:32.661881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d74184d6-16cd-46d4-aa1e-57661014fb66 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:32.662512 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d74184d6-16cd-46d4-aa1e-57661014fb66 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:32.663411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d74184d6-16cd-46d4-aa1e-57661014fb66 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:32.664055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d74184d6-16cd-46d4-aa1e-57661014fb66 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:32.664698 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d74184d6-16cd-46d4-aa1e-57661014fb66 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:32.800577 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3bd97ed2-276f-4f9b-b708-c9c770b7cec9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:32.808661 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3bd97ed2-276f-4f9b-b708-c9c770b7cec9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1318 microversion: 2.1 time: 0.518540 Oct 29 02:57:32.809324 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1103/2425] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:32 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1318 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:32.814162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-77b625e1-628c-47b1-82f0-190cc40c9d98 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:32.814612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-77b625e1-628c-47b1-82f0-190cc40c9d98 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 4876d09c-0ef0-4434-adb5-ca84626ca4bb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:32.826227 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77b625e1-628c-47b1-82f0-190cc40c9d98 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:32.826982 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77b625e1-628c-47b1-82f0-190cc40c9d98 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:32.827573 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77b625e1-628c-47b1-82f0-190cc40c9d98 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:32.828471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77b625e1-628c-47b1-82f0-190cc40c9d98 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:32.829371 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77b625e1-628c-47b1-82f0-190cc40c9d98 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:32.834801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77b625e1-628c-47b1-82f0-190cc40c9d98 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:33.037026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d74184d6-16cd-46d4-aa1e-57661014fb66 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:33.053805 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d74184d6-16cd-46d4-aa1e-57661014fb66 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.418485 Oct 29 02:57:33.073378 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1323/2426] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:32 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:33.084356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3e24998a-d5ef-400e-8d08-20d501990df3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:33.085398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3e24998a-d5ef-400e-8d08-20d501990df3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:33.095531 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3e24998a-d5ef-400e-8d08-20d501990df3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:33.096736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3e24998a-d5ef-400e-8d08-20d501990df3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:33.097809 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3e24998a-d5ef-400e-8d08-20d501990df3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:33.101069 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3e24998a-d5ef-400e-8d08-20d501990df3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:33.101821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3e24998a-d5ef-400e-8d08-20d501990df3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:33.102643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3e24998a-d5ef-400e-8d08-20d501990df3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:33.176026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-77b625e1-628c-47b1-82f0-190cc40c9d98 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:33.188020 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-77b625e1-628c-47b1-82f0-190cc40c9d98 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb" status: 200 len: 1503 microversion: 2.1 time: 0.377622 Oct 29 02:57:33.188640 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1104/2427] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:32 2022] GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb => generated 1503 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:33.195844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-17124887-0817-4c13-9299-67d7db34c181 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:33.196474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-17124887-0817-4c13-9299-67d7db34c181 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:33.211728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-17124887-0817-4c13-9299-67d7db34c181 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:33.212472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-17124887-0817-4c13-9299-67d7db34c181 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:33.213154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-17124887-0817-4c13-9299-67d7db34c181 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:33.214243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-17124887-0817-4c13-9299-67d7db34c181 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:33.214887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-17124887-0817-4c13-9299-67d7db34c181 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:33.215608 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-17124887-0817-4c13-9299-67d7db34c181 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:33.391383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3e24998a-d5ef-400e-8d08-20d501990df3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:33.410146 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3e24998a-d5ef-400e-8d08-20d501990df3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:33.413050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3e24998a-d5ef-400e-8d08-20d501990df3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:33.415349 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3e24998a-d5ef-400e-8d08-20d501990df3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1406 microversion: 2.20 time: 0.347297 Oct 29 02:57:33.416136 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1324/2428] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:57:33 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1406 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:57:33.425440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-05ec9428-6f2a-4170-9376-d35db03692c1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:33.426624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-05ec9428-6f2a-4170-9376-d35db03692c1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 4876d09c-0ef0-4434-adb5-ca84626ca4bb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:33.441858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05ec9428-6f2a-4170-9376-d35db03692c1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:33.443445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05ec9428-6f2a-4170-9376-d35db03692c1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:33.445148 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05ec9428-6f2a-4170-9376-d35db03692c1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:33.447112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05ec9428-6f2a-4170-9376-d35db03692c1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:33.448253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05ec9428-6f2a-4170-9376-d35db03692c1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:33.449986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05ec9428-6f2a-4170-9376-d35db03692c1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:33.493078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-05ec9428-6f2a-4170-9376-d35db03692c1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 4876d09c-0ef0-4434-adb5-ca84626ca4bb] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:57:33.578527 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-17124887-0817-4c13-9299-67d7db34c181 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:33.599555 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-17124887-0817-4c13-9299-67d7db34c181 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.408499 Oct 29 02:57:33.613978 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1105/2429] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:33 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:33.634700 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-85719398-c41b-4c5b-a954-b7e0458b26e4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:33.635298 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-85719398-c41b-4c5b-a954-b7e0458b26e4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:33.645035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85719398-c41b-4c5b-a954-b7e0458b26e4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:33.645826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85719398-c41b-4c5b-a954-b7e0458b26e4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:33.646422 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85719398-c41b-4c5b-a954-b7e0458b26e4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:33.647537 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85719398-c41b-4c5b-a954-b7e0458b26e4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:33.648222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85719398-c41b-4c5b-a954-b7e0458b26e4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:33.649833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85719398-c41b-4c5b-a954-b7e0458b26e4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:33.651210 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-05ec9428-6f2a-4170-9376-d35db03692c1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb" status: 204 len: 0 microversion: 2.1 time: 0.232557 Oct 29 02:57:33.652777 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1325/2430] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:57:33 2022] DELETE /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:57:33.677212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a5969cdb-9d91-4f13-94e7-f8ddbf3098ba tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:33.679768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a5969cdb-9d91-4f13-94e7-f8ddbf3098ba tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 4876d09c-0ef0-4434-adb5-ca84626ca4bb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:33.701694 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a5969cdb-9d91-4f13-94e7-f8ddbf3098ba tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:33.702285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a5969cdb-9d91-4f13-94e7-f8ddbf3098ba tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:33.703580 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a5969cdb-9d91-4f13-94e7-f8ddbf3098ba tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:33.705147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a5969cdb-9d91-4f13-94e7-f8ddbf3098ba tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:33.706595 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a5969cdb-9d91-4f13-94e7-f8ddbf3098ba tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:33.707766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a5969cdb-9d91-4f13-94e7-f8ddbf3098ba tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:33.891400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-85719398-c41b-4c5b-a954-b7e0458b26e4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:33.905254 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-85719398-c41b-4c5b-a954-b7e0458b26e4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8" status: 200 len: 1308 microversion: 2.1 time: 0.289896 Oct 29 02:57:33.906430 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1106/2431] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:33 2022] GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 => generated 1308 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:33.914066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-17e827e4-8993-4c41-a956-71fcd690a2f9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "6a22f1bf-9a27-4375-9469-db16defea274"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-17e827e4-8993-4c41-a956-71fcd690a2f9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 416 Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "6a22f1bf-9a27-4375-9469-db16defea274"}]}} Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'cd315600-df67-41c1-95d3-95a5145fc39a', 'flavorRef': '452', 'networks': [{'uuid': '6a22f1bf-9a27-4375-9469-db16defea274'}]}}} Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.921754 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:33.926661 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.926661 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.926661 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:33.926661 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:33.926661 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:33.926661 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:33.926661 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:33.926661 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:33.926661 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:33.926661 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:33.926661 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:57:33.926661 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:57:33.926661 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:57:33.926661 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:57:33.926661 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:57:33.926661 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:57:33.926661 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 02:57:33.926661 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.926661 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:33.926661 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.926661 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:33.926661 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:33.926661 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:33.926661 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:57:33.926661 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:57:33.926661 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 02:57:33.926661 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:33.929337 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-17e827e4-8993-4c41-a956-71fcd690a2f9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:33.930221 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-17e827e4-8993-4c41-a956-71fcd690a2f9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.022479 Oct 29 02:57:33.930828 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1107/2432] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:57:33 2022] POST /compute/v2.1/servers => generated 619 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:57:33.935572 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-f73db7af-4502-4a27-92ed-c2a63ddf5fdb req-004188a7-36f7-410e-bfa5-9b3b1b3672bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8", "tag": "88edf650-ce03-4e6a-b15e-07fe64065f45"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:33.946355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f73db7af-4502-4a27-92ed-c2a63ddf5fdb req-004188a7-36f7-410e-bfa5-9b3b1b3672bd service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:33.946826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f73db7af-4502-4a27-92ed-c2a63ddf5fdb req-004188a7-36f7-410e-bfa5-9b3b1b3672bd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:33.947314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f73db7af-4502-4a27-92ed-c2a63ddf5fdb req-004188a7-36f7-410e-bfa5-9b3b1b3672bd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:33.959127 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-f73db7af-4502-4a27-92ed-c2a63ddf5fdb req-004188a7-36f7-410e-bfa5-9b3b1b3672bd service nova] Creating event network-changed:88edf650-ce03-4e6a-b15e-07fe64065f45 for instance f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 on n-h2-862967-2 Oct 29 02:57:33.964232 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-f73db7af-4502-4a27-92ed-c2a63ddf5fdb req-004188a7-36f7-410e-bfa5-9b3b1b3672bd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032172 Oct 29 02:57:33.965237 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1108/2433] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:33.970531 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-90f43d53-0b2a-452b-a755-e639e6f1e466 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:33.971210 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-90f43d53-0b2a-452b-a755-e639e6f1e466 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:33.977781 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90f43d53-0b2a-452b-a755-e639e6f1e466 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:33.978313 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90f43d53-0b2a-452b-a755-e639e6f1e466 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:33.978741 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90f43d53-0b2a-452b-a755-e639e6f1e466 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:33.979545 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90f43d53-0b2a-452b-a755-e639e6f1e466 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:33.979988 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90f43d53-0b2a-452b-a755-e639e6f1e466 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:33.980937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90f43d53-0b2a-452b-a755-e639e6f1e466 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:33.984189 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:34.006418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a5969cdb-9d91-4f13-94e7-f8ddbf3098ba tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:34.017208 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a5969cdb-9d91-4f13-94e7-f8ddbf3098ba tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb" status: 200 len: 1509 microversion: 2.1 time: 0.356153 Oct 29 02:57:34.017208 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1326/2434] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:33 2022] GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb => generated 1509 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:34.022065 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-5013dff8-0be0-4869-8127-f489cededd88 req-8762fc86-a938-49d1-b086-6feceed8de74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ab56816-cc78-4e73-918a-4c76895fed6b", "tag": "dbe9ee0b-c11e-4edb-a1e4-5c86a11499da"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:34.035181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5013dff8-0be0-4869-8127-f489cededd88 req-8762fc86-a938-49d1-b086-6feceed8de74 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:34.036486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5013dff8-0be0-4869-8127-f489cededd88 req-8762fc86-a938-49d1-b086-6feceed8de74 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:34.036486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5013dff8-0be0-4869-8127-f489cededd88 req-8762fc86-a938-49d1-b086-6feceed8de74 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:34.048948 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-5013dff8-0be0-4869-8127-f489cededd88 req-8762fc86-a938-49d1-b086-6feceed8de74 service nova] Creating event network-changed:dbe9ee0b-c11e-4edb-a1e4-5c86a11499da for instance 1ab56816-cc78-4e73-918a-4c76895fed6b on n-h2-862967-2 Oct 29 02:57:34.057370 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-5013dff8-0be0-4869-8127-f489cededd88 req-8762fc86-a938-49d1-b086-6feceed8de74 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038364 Oct 29 02:57:34.058800 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1327/2435] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:34.068434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c0664dc9-628b-4266-94d4-d80978cb8c2b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:34.070534 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c0664dc9-628b-4266-94d4-d80978cb8c2b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:34.083637 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0664dc9-628b-4266-94d4-d80978cb8c2b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:34.089702 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0664dc9-628b-4266-94d4-d80978cb8c2b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:34.090765 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0664dc9-628b-4266-94d4-d80978cb8c2b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:34.094349 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0664dc9-628b-4266-94d4-d80978cb8c2b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:34.095700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0664dc9-628b-4266-94d4-d80978cb8c2b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:34.096816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0664dc9-628b-4266-94d4-d80978cb8c2b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:34.356780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:34.430721 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=20 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:34.431378 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c0664dc9-628b-4266-94d4-d80978cb8c2b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:34.453436 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c0664dc9-628b-4266-94d4-d80978cb8c2b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.392695 Oct 29 02:57:34.463509 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1328/2436] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:34 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:34.473090 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-80d34a4f-c437-4644-9066-2eed68e2b4e7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:34.474038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-80d34a4f-c437-4644-9066-2eed68e2b4e7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:34.483840 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80d34a4f-c437-4644-9066-2eed68e2b4e7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:34.484358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80d34a4f-c437-4644-9066-2eed68e2b4e7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:34.484825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80d34a4f-c437-4644-9066-2eed68e2b4e7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:34.485756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80d34a4f-c437-4644-9066-2eed68e2b4e7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:34.486538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80d34a4f-c437-4644-9066-2eed68e2b4e7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:34.486967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80d34a4f-c437-4644-9066-2eed68e2b4e7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:34.641170 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-90f43d53-0b2a-452b-a755-e639e6f1e466 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:34.649824 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-90f43d53-0b2a-452b-a755-e639e6f1e466 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1318 microversion: 2.1 time: 0.683329 Oct 29 02:57:34.651034 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1109/2437] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:33 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1318 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:34.656150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ad83bef0-5adf-4268-9766-34ed4744cc9f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:34.657152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ad83bef0-5adf-4268-9766-34ed4744cc9f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:34.664019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad83bef0-5adf-4268-9766-34ed4744cc9f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:34.664515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad83bef0-5adf-4268-9766-34ed4744cc9f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:34.665048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad83bef0-5adf-4268-9766-34ed4744cc9f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:34.666048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad83bef0-5adf-4268-9766-34ed4744cc9f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:34.666655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad83bef0-5adf-4268-9766-34ed4744cc9f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:34.667222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad83bef0-5adf-4268-9766-34ed4744cc9f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:34.680760 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-80d34a4f-c437-4644-9066-2eed68e2b4e7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:34.691536 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-80d34a4f-c437-4644-9066-2eed68e2b4e7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:34.693104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-80d34a4f-c437-4644-9066-2eed68e2b4e7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:34.694267 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-80d34a4f-c437-4644-9066-2eed68e2b4e7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1406 microversion: 2.20 time: 0.228696 Oct 29 02:57:34.694854 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1329/2438] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:57:34 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:57:34.822236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ad83bef0-5adf-4268-9766-34ed4744cc9f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:34.835503 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ad83bef0-5adf-4268-9766-34ed4744cc9f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.183296 Oct 29 02:57:34.836100 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1110/2439] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:34 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:34.900211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fcda8ca9-91ea-48bf-b744-ae14d6111b49 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-545363973", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": -1, "networks": [{"uuid": "6a22f1bf-9a27-4375-9469-db16defea274"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:34.912781 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-fcda8ca9-91ea-48bf-b744-ae14d6111b49 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Flavor -1 could not be found. Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fcda8ca9-91ea-48bf-b744-ae14d6111b49 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 205 Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-545363973", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": -1, "networks": [{"uuid": "6a22f1bf-9a27-4375-9469-db16defea274"}]}} Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: exception: Flavor -1 could not be found. Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-545363973', 'imageRef': 'cd315600-df67-41c1-95d3-95a5145fc39a', 'flavorRef': -1, 'networks': [{'uuid': '6a22f1bf-9a27-4375-9469-db16defea274'}]}}} Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:34.915160 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:34.919468 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:34.919468 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:34.919468 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:34.919468 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:34.919468 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 02:57:34.919468 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 29 02:57:34.919468 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 29 02:57:34.919468 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 29 02:57:34.919468 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.919468 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:34.919468 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.919468 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:34.919468 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:34.919468 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:34.919468 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:34.919468 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:34.919468 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 29 02:57:34.919468 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:34.919468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fcda8ca9-91ea-48bf-b744-ae14d6111b49 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:34.919468 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fcda8ca9-91ea-48bf-b744-ae14d6111b49 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.020514 Oct 29 02:57:34.919468 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1330/2440] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:57:34 2022] POST /compute/v2.1/servers => generated 73 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 02:57:34.928053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f3e91f29-7f9d-4af4-b002-9bc62d7cf148 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:34.928594 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f3e91f29-7f9d-4af4-b002-9bc62d7cf148 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:34.935423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3e91f29-7f9d-4af4-b002-9bc62d7cf148 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:34.936119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3e91f29-7f9d-4af4-b002-9bc62d7cf148 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:34.936722 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3e91f29-7f9d-4af4-b002-9bc62d7cf148 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:34.936925 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2dd9dbfc-c73e-4103-aa25-a5a1477b96ca tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:34.937598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3e91f29-7f9d-4af4-b002-9bc62d7cf148 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:34.938312 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3e91f29-7f9d-4af4-b002-9bc62d7cf148 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:34.938824 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3e91f29-7f9d-4af4-b002-9bc62d7cf148 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:34.939451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2dd9dbfc-c73e-4103-aa25-a5a1477b96ca tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:34.946085 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2dd9dbfc-c73e-4103-aa25-a5a1477b96ca tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:34.946655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2dd9dbfc-c73e-4103-aa25-a5a1477b96ca tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:34.947057 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2dd9dbfc-c73e-4103-aa25-a5a1477b96ca tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:34.947778 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2dd9dbfc-c73e-4103-aa25-a5a1477b96ca tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:34.948238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2dd9dbfc-c73e-4103-aa25-a5a1477b96ca tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:34.948697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2dd9dbfc-c73e-4103-aa25-a5a1477b96ca tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:35.089556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f3e91f29-7f9d-4af4-b002-9bc62d7cf148 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:35.104423 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f3e91f29-7f9d-4af4-b002-9bc62d7cf148 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.180552 Oct 29 02:57:35.104624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2dd9dbfc-c73e-4103-aa25-a5a1477b96ca tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:35.105853 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1111/2441] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:34 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:35.113141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8a2c8417-fe6c-4e60-9778-5208ac423479 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:35.113626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8a2c8417-fe6c-4e60-9778-5208ac423479 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 4876d09c-0ef0-4434-adb5-ca84626ca4bb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:35.118768 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2dd9dbfc-c73e-4103-aa25-a5a1477b96ca tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8" status: 200 len: 1308 microversion: 2.1 time: 0.187498 Oct 29 02:57:35.119649 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1331/2442] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:34 2022] GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 => generated 1308 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:35.120774 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a2c8417-fe6c-4e60-9778-5208ac423479 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:35.121269 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a2c8417-fe6c-4e60-9778-5208ac423479 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:35.121707 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a2c8417-fe6c-4e60-9778-5208ac423479 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:35.122453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a2c8417-fe6c-4e60-9778-5208ac423479 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:35.122906 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a2c8417-fe6c-4e60-9778-5208ac423479 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:35.123331 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a2c8417-fe6c-4e60-9778-5208ac423479 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:35.134731 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-27379df6-1682-4461-962b-3d093ceb79c4 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:35.135442 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-27379df6-1682-4461-962b-3d093ceb79c4 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:35.142666 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27379df6-1682-4461-962b-3d093ceb79c4 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:35.143162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27379df6-1682-4461-962b-3d093ceb79c4 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:35.143602 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27379df6-1682-4461-962b-3d093ceb79c4 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:35.144324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27379df6-1682-4461-962b-3d093ceb79c4 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:35.144810 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27379df6-1682-4461-962b-3d093ceb79c4 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:35.145247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27379df6-1682-4461-962b-3d093ceb79c4 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:35.447869 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8a2c8417-fe6c-4e60-9778-5208ac423479 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:35.461993 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8a2c8417-fe6c-4e60-9778-5208ac423479 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb" status: 200 len: 1509 microversion: 2.1 time: 0.354366 Oct 29 02:57:35.478091 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1112/2443] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:35 2022] GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb => generated 1509 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:35.601381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-27379df6-1682-4461-962b-3d093ceb79c4 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:35.612197 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-27379df6-1682-4461-962b-3d093ceb79c4 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.481911 Oct 29 02:57:35.612960 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1332/2444] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:35 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:35.678744 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1e58be1e-c874-4ca8-a3d2-97e321ad2b4f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:35.679587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1e58be1e-c874-4ca8-a3d2-97e321ad2b4f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:35.688150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e58be1e-c874-4ca8-a3d2-97e321ad2b4f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:35.688676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e58be1e-c874-4ca8-a3d2-97e321ad2b4f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:35.689116 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e58be1e-c874-4ca8-a3d2-97e321ad2b4f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:35.692845 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e58be1e-c874-4ca8-a3d2-97e321ad2b4f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:35.695858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e58be1e-c874-4ca8-a3d2-97e321ad2b4f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:35.696080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e58be1e-c874-4ca8-a3d2-97e321ad2b4f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:35.714120 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9200d08c-f114-419e-912d-3288e551c66f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1794820720", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "6a22f1bf-9a27-4375-9469-db16defea274"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9200d08c-f114-419e-912d-3288e551c66f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 173 Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1794820720", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "6a22f1bf-9a27-4375-9469-db16defea274"}]}} Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1794820720', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '6a22f1bf-9a27-4375-9469-db16defea274'}]}}} Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi -1 Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:57:35.719313 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:57:35.723732 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:57:35.723732 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:57:35.723732 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 29 02:57:35.723732 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:35.723732 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:35.723732 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:35.723732 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:35.723732 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:35.723732 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:35.723732 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:57:35.723732 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:57:35.723732 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 29 02:57:35.723732 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:35.733456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9200d08c-f114-419e-912d-3288e551c66f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:35.734338 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9200d08c-f114-419e-912d-3288e551c66f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.024495 Oct 29 02:57:35.741598 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1333/2445] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:57:35 2022] POST /compute/v2.1/servers => generated 145 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:57:35.747205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-645c6719-0bb0-4d4d-ad91-9ddfe9b7f803 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:35.753002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-645c6719-0bb0-4d4d-ad91-9ddfe9b7f803 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:35.764334 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=14 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:35.768783 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-645c6719-0bb0-4d4d-ad91-9ddfe9b7f803 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:35.776372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-645c6719-0bb0-4d4d-ad91-9ddfe9b7f803 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:35.777173 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-645c6719-0bb0-4d4d-ad91-9ddfe9b7f803 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:35.778131 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-645c6719-0bb0-4d4d-ad91-9ddfe9b7f803 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:35.778834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-645c6719-0bb0-4d4d-ad91-9ddfe9b7f803 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:35.779475 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-645c6719-0bb0-4d4d-ad91-9ddfe9b7f803 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:36.118018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1e58be1e-c874-4ca8-a3d2-97e321ad2b4f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:36.133382 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1e58be1e-c874-4ca8-a3d2-97e321ad2b4f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1318 microversion: 2.1 time: 0.458352 Oct 29 02:57:36.134865 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1113/2446] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:35 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1318 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:36.140138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-61a3c7c0-5f36-4d07-ab1b-dca86a07d2cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:36.141071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-61a3c7c0-5f36-4d07-ab1b-dca86a07d2cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:36.156310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61a3c7c0-5f36-4d07-ab1b-dca86a07d2cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:36.158246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61a3c7c0-5f36-4d07-ab1b-dca86a07d2cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:36.159057 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61a3c7c0-5f36-4d07-ab1b-dca86a07d2cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:36.160347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61a3c7c0-5f36-4d07-ab1b-dca86a07d2cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:36.161192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61a3c7c0-5f36-4d07-ab1b-dca86a07d2cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:36.162057 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61a3c7c0-5f36-4d07-ab1b-dca86a07d2cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:36.279034 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-645c6719-0bb0-4d4d-ad91-9ddfe9b7f803 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:36.287905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-645c6719-0bb0-4d4d-ad91-9ddfe9b7f803 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:36.289554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-645c6719-0bb0-4d4d-ad91-9ddfe9b7f803 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:36.291004 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-645c6719-0bb0-4d4d-ad91-9ddfe9b7f803 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1406 microversion: 2.20 time: 0.548190 Oct 29 02:57:36.305222 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1334/2447] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:57:35 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1406 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:57:36.316376 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e3882dda-8206-489f-9827-2b33753d0802 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:36.317078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e3882dda-8206-489f-9827-2b33753d0802 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:36.325745 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e3882dda-8206-489f-9827-2b33753d0802 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:36.326644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e3882dda-8206-489f-9827-2b33753d0802 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:36.327231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e3882dda-8206-489f-9827-2b33753d0802 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:36.328095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e3882dda-8206-489f-9827-2b33753d0802 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:36.328735 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e3882dda-8206-489f-9827-2b33753d0802 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:36.329940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e3882dda-8206-489f-9827-2b33753d0802 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:36.487093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-61a3c7c0-5f36-4d07-ab1b-dca86a07d2cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:36.499642 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-61a3c7c0-5f36-4d07-ab1b-dca86a07d2cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.362324 Oct 29 02:57:36.500631 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1114/2448] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:36 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:36.505771 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6026420b-4434-4f4f-8e2c-c8f3c596c9f3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:36.506593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6026420b-4434-4f4f-8e2c-c8f3c596c9f3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 4876d09c-0ef0-4434-adb5-ca84626ca4bb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:36.515112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6026420b-4434-4f4f-8e2c-c8f3c596c9f3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:36.516017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6026420b-4434-4f4f-8e2c-c8f3c596c9f3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:36.519287 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6026420b-4434-4f4f-8e2c-c8f3c596c9f3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:36.520349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6026420b-4434-4f4f-8e2c-c8f3c596c9f3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:36.520834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6026420b-4434-4f4f-8e2c-c8f3c596c9f3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:36.521679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6026420b-4434-4f4f-8e2c-c8f3c596c9f3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:36.691385 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6026420b-4434-4f4f-8e2c-c8f3c596c9f3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:36.700331 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6026420b-4434-4f4f-8e2c-c8f3c596c9f3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb" status: 200 len: 1509 microversion: 2.1 time: 0.198230 Oct 29 02:57:36.701028 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1115/2449] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:36 2022] GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb => generated 1509 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:36.705955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1e76227e-b063-42b2-8038-f3d40e10a665 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:36.706581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1e76227e-b063-42b2-8038-f3d40e10a665 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:36.713832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e76227e-b063-42b2-8038-f3d40e10a665 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:36.714328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e76227e-b063-42b2-8038-f3d40e10a665 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:36.714811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e76227e-b063-42b2-8038-f3d40e10a665 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:36.715568 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e76227e-b063-42b2-8038-f3d40e10a665 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:36.716023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e76227e-b063-42b2-8038-f3d40e10a665 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:36.716448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e76227e-b063-42b2-8038-f3d40e10a665 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:36.868971 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1e76227e-b063-42b2-8038-f3d40e10a665 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:36.877331 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1e76227e-b063-42b2-8038-f3d40e10a665 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.175220 Oct 29 02:57:36.877929 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1116/2450] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:36 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:36.940900 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0f175659-62bc-458e-a812-f443a48fcb43 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-473565615", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:36.945961 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-0f175659-62bc-458e-a812-f443a48fcb43 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0f175659-62bc-458e-a812-f443a48fcb43 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 215 Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-473565615", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-473565615', 'imageRef': 'cd315600-df67-41c1-95d3-95a5145fc39a', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:36.947694 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:36.953902 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:36.953902 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:36.953902 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:36.953902 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:36.953902 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:36.953902 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 29 02:57:36.953902 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:36.953902 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0f175659-62bc-458e-a812-f443a48fcb43 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:36.953902 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0f175659-62bc-458e-a812-f443a48fcb43 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.012553 Oct 29 02:57:36.953902 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1117/2451] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:57:36 2022] POST /compute/v2.1/servers => generated 123 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 02:57:36.959313 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3042f5e4-add5-46ad-95a7-b0f076ba5e66 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:36.960014 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3042f5e4-add5-46ad-95a7-b0f076ba5e66 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:36.967652 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3042f5e4-add5-46ad-95a7-b0f076ba5e66 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:36.968246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3042f5e4-add5-46ad-95a7-b0f076ba5e66 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:36.968780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3042f5e4-add5-46ad-95a7-b0f076ba5e66 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:36.969551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3042f5e4-add5-46ad-95a7-b0f076ba5e66 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:36.970064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3042f5e4-add5-46ad-95a7-b0f076ba5e66 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:36.970545 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3042f5e4-add5-46ad-95a7-b0f076ba5e66 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:37.001410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e3882dda-8206-489f-9827-2b33753d0802 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:37.011433 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e3882dda-8206-489f-9827-2b33753d0802 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8" status: 200 len: 1308 microversion: 2.1 time: 0.704935 Oct 29 02:57:37.012045 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1335/2452] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:36 2022] GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 => generated 1308 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:37.154019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3042f5e4-add5-46ad-95a7-b0f076ba5e66 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:37.159503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dc9517c5-217a-4939-8e0e-d7f92a67e88a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:37.159671 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dc9517c5-217a-4939-8e0e-d7f92a67e88a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:37.167832 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3042f5e4-add5-46ad-95a7-b0f076ba5e66 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.212261 Oct 29 02:57:37.177033 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1118/2453] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:36 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:37.177292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc9517c5-217a-4939-8e0e-d7f92a67e88a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:37.177292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc9517c5-217a-4939-8e0e-d7f92a67e88a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:37.177292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc9517c5-217a-4939-8e0e-d7f92a67e88a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:37.177292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc9517c5-217a-4939-8e0e-d7f92a67e88a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:37.177292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc9517c5-217a-4939-8e0e-d7f92a67e88a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:37.177292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc9517c5-217a-4939-8e0e-d7f92a67e88a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:37.177712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-41cd7efd-8d11-4737-8813-d691417302a3 req-ec763e1c-eace-44a4-851f-8c71fe79251c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4876d09c-0ef0-4434-adb5-ca84626ca4bb", "name": "network-vif-deleted", "tag": "7f27823d-3f2a-4395-80a4-64d9426be9ed"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:37.185340 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-41cd7efd-8d11-4737-8813-d691417302a3 req-ec763e1c-eace-44a4-851f-8c71fe79251c service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:37.185885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-41cd7efd-8d11-4737-8813-d691417302a3 req-ec763e1c-eace-44a4-851f-8c71fe79251c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:37.186454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-41cd7efd-8d11-4737-8813-d691417302a3 req-ec763e1c-eace-44a4-851f-8c71fe79251c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:37.203856 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-41cd7efd-8d11-4737-8813-d691417302a3 req-ec763e1c-eace-44a4-851f-8c71fe79251c service nova] Creating event network-vif-deleted:7f27823d-3f2a-4395-80a4-64d9426be9ed for instance 4876d09c-0ef0-4434-adb5-ca84626ca4bb on n-h2-862967-2 Oct 29 02:57:37.209353 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-41cd7efd-8d11-4737-8813-d691417302a3 req-ec763e1c-eace-44a4-851f-8c71fe79251c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039109 Oct 29 02:57:37.209994 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1119/2454] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:37.216423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e6e5b756-2898-408d-b577-1200ab0ed00f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:37.217252 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e6e5b756-2898-408d-b577-1200ab0ed00f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:37.224449 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6e5b756-2898-408d-b577-1200ab0ed00f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:37.225803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6e5b756-2898-408d-b577-1200ab0ed00f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:37.226915 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6e5b756-2898-408d-b577-1200ab0ed00f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:37.227615 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6e5b756-2898-408d-b577-1200ab0ed00f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:37.228073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6e5b756-2898-408d-b577-1200ab0ed00f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:37.229233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6e5b756-2898-408d-b577-1200ab0ed00f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:37.355628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dc9517c5-217a-4939-8e0e-d7f92a67e88a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:37.361108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:37.369302 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dc9517c5-217a-4939-8e0e-d7f92a67e88a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1318 microversion: 2.1 time: 0.215080 Oct 29 02:57:37.370407 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1336/2455] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:37 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:37.379486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-96619afe-b0c6-414c-9ef6-5d3036e0b05a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:37.381656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-96619afe-b0c6-414c-9ef6-5d3036e0b05a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:37.392694 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-96619afe-b0c6-414c-9ef6-5d3036e0b05a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:37.393513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-96619afe-b0c6-414c-9ef6-5d3036e0b05a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:37.394163 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-96619afe-b0c6-414c-9ef6-5d3036e0b05a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:37.395200 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-96619afe-b0c6-414c-9ef6-5d3036e0b05a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:37.395903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-96619afe-b0c6-414c-9ef6-5d3036e0b05a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:37.396760 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-96619afe-b0c6-414c-9ef6-5d3036e0b05a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:37.401941 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e6e5b756-2898-408d-b577-1200ab0ed00f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:37.410923 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e6e5b756-2898-408d-b577-1200ab0ed00f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.199406 Oct 29 02:57:37.411428 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1120/2456] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:37 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:37.486548 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-408d4a78-fb2c-49ed-a049-dbf9eac93940 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-643633150", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "key_name": "tempest-key-1264217", "networks": [{"uuid": "6a22f1bf-9a27-4375-9469-db16defea274"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:37.562946 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-408d4a78-fb2c-49ed-a049-dbf9eac93940 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] validate_networks() for [('6a22f1bf-9a27-4375-9469-db16defea274', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:57:37.760291 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-96619afe-b0c6-414c-9ef6-5d3036e0b05a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:37.771858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-96619afe-b0c6-414c-9ef6-5d3036e0b05a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:37.775940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-96619afe-b0c6-414c-9ef6-5d3036e0b05a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:37.777397 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-96619afe-b0c6-414c-9ef6-5d3036e0b05a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1406 microversion: 2.20 time: 0.405538 Oct 29 02:57:37.783417 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1337/2457] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:57:37 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1406 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:57:37.793043 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-78d2431d-d858-4da3-a4c5-823bbdffe9a7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:37.793669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-78d2431d-d858-4da3-a4c5-823bbdffe9a7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 4876d09c-0ef0-4434-adb5-ca84626ca4bb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:37.803341 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-408d4a78-fb2c-49ed-a049-dbf9eac93940 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Invalid key_name provided. Oct 29 02:57:37.805316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78d2431d-d858-4da3-a4c5-823bbdffe9a7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:37.808275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78d2431d-d858-4da3-a4c5-823bbdffe9a7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:37.808963 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78d2431d-d858-4da3-a4c5-823bbdffe9a7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:37.812007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78d2431d-d858-4da3-a4c5-823bbdffe9a7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:37.812868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78d2431d-d858-4da3-a4c5-823bbdffe9a7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:37.813458 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78d2431d-d858-4da3-a4c5-823bbdffe9a7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-408d4a78-fb2c-49ed-a049-dbf9eac93940 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 243 Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-643633150", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "key_name": "tempest-key-1264217", "networks": [{"uuid": "6a22f1bf-9a27-4375-9469-db16defea274"}]}} Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: exception: Invalid key_name provided. Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-643633150', 'imageRef': 'cd315600-df67-41c1-95d3-95a5145fc39a', 'flavorRef': '452', 'key_name': 'tempest-key-1264217', 'networks': [{'uuid': '6a22f1bf-9a27-4375-9469-db16defea274'}]}}} Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1264217 not found for user 3507c0ada3424029805469182f328379 Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:37.813849 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:37.818147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:37.818147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:37.818147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:37.818147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:37.818147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:37.818147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:37.818147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:37.818147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:37.818147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:37.818147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:37.818147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:37.818147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 02:57:37.818147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 29 02:57:37.818147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 29 02:57:37.818147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 29 02:57:37.818147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:37.818147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:37.818147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:37.818147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:37.818147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:37.818147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:37.818147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:37.818147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:37.818147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 29 02:57:37.818147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:37.818147 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-408d4a78-fb2c-49ed-a049-dbf9eac93940 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 400 to user: Invalid key_name provided. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:37.818147 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-408d4a78-fb2c-49ed-a049-dbf9eac93940 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.335585 Oct 29 02:57:37.820155 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1121/2458] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:57:37 2022] POST /compute/v2.1/servers => generated 70 bytes in 337 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 29 02:57:37.831235 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0cfdf549-dc14-4860-a769-7373aebaaee4 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:37.831871 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0cfdf549-dc14-4860-a769-7373aebaaee4 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:37.844079 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0cfdf549-dc14-4860-a769-7373aebaaee4 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:37.844751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0cfdf549-dc14-4860-a769-7373aebaaee4 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:37.845199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0cfdf549-dc14-4860-a769-7373aebaaee4 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:37.846086 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0cfdf549-dc14-4860-a769-7373aebaaee4 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:37.846639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0cfdf549-dc14-4860-a769-7373aebaaee4 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:37.847065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0cfdf549-dc14-4860-a769-7373aebaaee4 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:37.885190 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78d2431d-d858-4da3-a4c5-823bbdffe9a7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:37.886495 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78d2431d-d858-4da3-a4c5-823bbdffe9a7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:37.887534 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78d2431d-d858-4da3-a4c5-823bbdffe9a7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:37.888720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-78d2431d-d858-4da3-a4c5-823bbdffe9a7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lazy-loading 'fault' on Instance uuid 4876d09c-0ef0-4434-adb5-ca84626ca4bb {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:57:37.970613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-78d2431d-d858-4da3-a4c5-823bbdffe9a7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:37.981503 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-78d2431d-d858-4da3-a4c5-823bbdffe9a7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb" status: 200 len: 1305 microversion: 2.1 time: 0.196662 Oct 29 02:57:37.992682 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1338/2459] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:37 2022] GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb => generated 1305 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:37.992682 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-a290f8db-dbd5-4673-97ef-0e71911e95f0 req-d0e41e11-85bf-4a95-91ed-8af89bdbc997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d981d040-d96a-40a5-a893-033a9d51e368", "name": "network-vif-plugged", "status": "completed", "tag": "d421fc9b-5ae4-42e7-a9d1-182d4fc1ec78"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:38.010942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a290f8db-dbd5-4673-97ef-0e71911e95f0 req-d0e41e11-85bf-4a95-91ed-8af89bdbc997 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:38.011588 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a290f8db-dbd5-4673-97ef-0e71911e95f0 req-d0e41e11-85bf-4a95-91ed-8af89bdbc997 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:38.012043 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a290f8db-dbd5-4673-97ef-0e71911e95f0 req-d0e41e11-85bf-4a95-91ed-8af89bdbc997 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:38.029771 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-a290f8db-dbd5-4673-97ef-0e71911e95f0 req-d0e41e11-85bf-4a95-91ed-8af89bdbc997 service nova] Creating event network-vif-plugged:d421fc9b-5ae4-42e7-a9d1-182d4fc1ec78 for instance d981d040-d96a-40a5-a893-033a9d51e368 on n-h2-862967-2 Oct 29 02:57:38.037719 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-a290f8db-dbd5-4673-97ef-0e71911e95f0 req-d0e41e11-85bf-4a95-91ed-8af89bdbc997 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051473 Oct 29 02:57:38.039528 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1339/2460] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:38.045847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-467aaad2-679b-4667-9206-df13db692b87 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:38.046864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-467aaad2-679b-4667-9206-df13db692b87 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:38.053272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-467aaad2-679b-4667-9206-df13db692b87 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:38.053882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-467aaad2-679b-4667-9206-df13db692b87 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:38.054556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-467aaad2-679b-4667-9206-df13db692b87 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:38.055418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-467aaad2-679b-4667-9206-df13db692b87 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:38.056450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-467aaad2-679b-4667-9206-df13db692b87 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:38.057140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-467aaad2-679b-4667-9206-df13db692b87 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:38.075002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0cfdf549-dc14-4860-a769-7373aebaaee4 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:38.085549 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0cfdf549-dc14-4860-a769-7373aebaaee4 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.262851 Oct 29 02:57:38.086144 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1122/2461] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:37 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:38.118090 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8bef1244-180d-4d53-a874-c0d6af7c832c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:38.119013 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8bef1244-180d-4d53-a874-c0d6af7c832c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:38.127696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8bef1244-180d-4d53-a874-c0d6af7c832c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:38.128366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8bef1244-180d-4d53-a874-c0d6af7c832c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:38.128980 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8bef1244-180d-4d53-a874-c0d6af7c832c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:38.129916 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8bef1244-180d-4d53-a874-c0d6af7c832c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:38.130502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8bef1244-180d-4d53-a874-c0d6af7c832c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:38.131154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8bef1244-180d-4d53-a874-c0d6af7c832c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:38.200907 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-467aaad2-679b-4667-9206-df13db692b87 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:38.209875 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-467aaad2-679b-4667-9206-df13db692b87 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8" status: 200 len: 1308 microversion: 2.1 time: 0.168730 Oct 29 02:57:38.212814 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1340/2462] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:38 2022] GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 => generated 1308 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:38.306554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8bef1244-180d-4d53-a874-c0d6af7c832c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:38.314620 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8bef1244-180d-4d53-a874-c0d6af7c832c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.201905 Oct 29 02:57:38.315203 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1123/2463] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:38 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:38.388498 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ab6b19c0-a517-4768-9074-7a251277b7aa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2129892430", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "6a22f1bf-9a27-4375-9469-db16defea274"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:38.397848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-11dcef2b-1bcd-490f-b401-79114f4d1e71 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:38.399884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-11dcef2b-1bcd-490f-b401-79114f4d1e71 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:38.417283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11dcef2b-1bcd-490f-b401-79114f4d1e71 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:38.417910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11dcef2b-1bcd-490f-b401-79114f4d1e71 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:38.418507 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11dcef2b-1bcd-490f-b401-79114f4d1e71 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:38.419198 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11dcef2b-1bcd-490f-b401-79114f4d1e71 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:38.419711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11dcef2b-1bcd-490f-b401-79114f4d1e71 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:38.420219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11dcef2b-1bcd-490f-b401-79114f4d1e71 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:38.557081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.security_group_api [None req-ab6b19c0-a517-4768-9074-7a251277b7aa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Neutron security group does_not_exist not found {{(pid=127124) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 29 02:57:38.558062 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-ab6b19c0-a517-4768-9074-7a251277b7aa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 29 02:57:38.565849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-11dcef2b-1bcd-490f-b401-79114f4d1e71 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ab6b19c0-a517-4768-9074-7a251277b7aa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 258 Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2129892430", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "6a22f1bf-9a27-4375-9469-db16defea274"}]}} Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2129892430', 'imageRef': 'cd315600-df67-41c1-95d3-95a5145fc39a', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '6a22f1bf-9a27-4375-9469-db16defea274'}]}}} Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 29 02:57:38.568208 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:38.573192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ab6b19c0-a517-4768-9074-7a251277b7aa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:38.577910 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ab6b19c0-a517-4768-9074-7a251277b7aa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.187037 Oct 29 02:57:38.577910 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1341/2464] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:57:38 2022] POST /compute/v2.1/servers => generated 106 bytes in 189 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:57:38.578085 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-11dcef2b-1bcd-490f-b401-79114f4d1e71 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1318 microversion: 2.1 time: 0.183456 Oct 29 02:57:38.578085 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1124/2465] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:38 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:38.579873 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-56f3f16e-20d0-420b-8f46-21cfc157bf06 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:38.580493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-56f3f16e-20d0-420b-8f46-21cfc157bf06 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:38.586702 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56f3f16e-20d0-420b-8f46-21cfc157bf06 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:38.587186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56f3f16e-20d0-420b-8f46-21cfc157bf06 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:38.587687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56f3f16e-20d0-420b-8f46-21cfc157bf06 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:38.588381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56f3f16e-20d0-420b-8f46-21cfc157bf06 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:38.588883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56f3f16e-20d0-420b-8f46-21cfc157bf06 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:38.589300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56f3f16e-20d0-420b-8f46-21cfc157bf06 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:38.721250 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-56f3f16e-20d0-420b-8f46-21cfc157bf06 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:38.729072 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-56f3f16e-20d0-420b-8f46-21cfc157bf06 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.153414 Oct 29 02:57:38.729649 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1342/2466] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:38 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:38.752640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-77c3f636-09bf-424e-9e00-f50ed8cf3da0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:38.753483 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-77c3f636-09bf-424e-9e00-f50ed8cf3da0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:38.760658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77c3f636-09bf-424e-9e00-f50ed8cf3da0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:38.761956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77c3f636-09bf-424e-9e00-f50ed8cf3da0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:38.761956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77c3f636-09bf-424e-9e00-f50ed8cf3da0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:38.765148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77c3f636-09bf-424e-9e00-f50ed8cf3da0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:38.765148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77c3f636-09bf-424e-9e00-f50ed8cf3da0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:38.765148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77c3f636-09bf-424e-9e00-f50ed8cf3da0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:38.817022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7986f517-babf-4fff-8444-1035b81202a4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:38.817795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7986f517-babf-4fff-8444-1035b81202a4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:38.827777 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7986f517-babf-4fff-8444-1035b81202a4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:38.828269 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7986f517-babf-4fff-8444-1035b81202a4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:38.828744 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7986f517-babf-4fff-8444-1035b81202a4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:38.829496 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7986f517-babf-4fff-8444-1035b81202a4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:38.829953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7986f517-babf-4fff-8444-1035b81202a4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:38.830378 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7986f517-babf-4fff-8444-1035b81202a4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:38.929172 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-77c3f636-09bf-424e-9e00-f50ed8cf3da0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:38.941258 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-77c3f636-09bf-424e-9e00-f50ed8cf3da0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.192629 Oct 29 02:57:38.942163 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1125/2467] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:38 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:38.966811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-861d5918-4b4c-43a4-9725-ab1dc6e763af tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:38.967308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-861d5918-4b4c-43a4-9725-ab1dc6e763af tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: f4fe2f7f-9006-4b05-b168-0b4e47715d3c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:38.972765 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-861d5918-4b4c-43a4-9725-ab1dc6e763af tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Instance f4fe2f7f-9006-4b05-b168-0b4e47715d3c could not be found. Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-861d5918-4b4c-43a4-9725-ab1dc6e763af tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/f4fe2f7f-9006-4b05-b168-0b4e47715d3c HTTP/1.1 Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance f4fe2f7f-9006-4b05-b168-0b4e47715d3c could not be found. Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'f4fe2f7f-9006-4b05-b168-0b4e47715d3c'} Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4fe2f7f-9006-4b05-b168-0b4e47715d3c could not be found. Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4fe2f7f-9006-4b05-b168-0b4e47715d3c could not be found. Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:38.974287 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:38.978336 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:38.978336 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:38.978336 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:38.978336 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:38.978336 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:38.978336 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:38.978336 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4fe2f7f-9006-4b05-b168-0b4e47715d3c could not be found. Oct 29 02:57:38.978336 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:38.978336 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-861d5918-4b4c-43a4-9725-ab1dc6e763af tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 404 to user: Instance f4fe2f7f-9006-4b05-b168-0b4e47715d3c could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:38.978336 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-861d5918-4b4c-43a4-9725-ab1dc6e763af tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f4fe2f7f-9006-4b05-b168-0b4e47715d3c" status: 404 len: 111 microversion: 2.1 time: 0.012879 Oct 29 02:57:38.978336 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1126/2468] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:57:38 2022] DELETE /compute/v2.1/servers/f4fe2f7f-9006-4b05-b168-0b4e47715d3c => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:57:38.984179 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8a933e7e-7e03-430d-8bf6-74ded5688702 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:38.984813 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8a933e7e-7e03-430d-8bf6-74ded5688702 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:38.992041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a933e7e-7e03-430d-8bf6-74ded5688702 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:38.992553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a933e7e-7e03-430d-8bf6-74ded5688702 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:38.992992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a933e7e-7e03-430d-8bf6-74ded5688702 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:38.993715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a933e7e-7e03-430d-8bf6-74ded5688702 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:38.994165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a933e7e-7e03-430d-8bf6-74ded5688702 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:38.994585 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a933e7e-7e03-430d-8bf6-74ded5688702 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:39.005166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7986f517-babf-4fff-8444-1035b81202a4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:39.019285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7986f517-babf-4fff-8444-1035b81202a4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:39.021290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7986f517-babf-4fff-8444-1035b81202a4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:39.022691 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7986f517-babf-4fff-8444-1035b81202a4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1406 microversion: 2.20 time: 0.209825 Oct 29 02:57:39.023553 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1343/2469] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:57:38 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:57:39.032027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2324f446-43b1-4e97-bccc-eb50f9c2c30f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:39.033230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2324f446-43b1-4e97-bccc-eb50f9c2c30f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 4876d09c-0ef0-4434-adb5-ca84626ca4bb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:39.044903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2324f446-43b1-4e97-bccc-eb50f9c2c30f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:39.045803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2324f446-43b1-4e97-bccc-eb50f9c2c30f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:39.046610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2324f446-43b1-4e97-bccc-eb50f9c2c30f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:39.047895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2324f446-43b1-4e97-bccc-eb50f9c2c30f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:39.048779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2324f446-43b1-4e97-bccc-eb50f9c2c30f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:39.049582 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2324f446-43b1-4e97-bccc-eb50f9c2c30f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:39.068144 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-2324f446-43b1-4e97-bccc-eb50f9c2c30f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] HTTP exception thrown: Instance 4876d09c-0ef0-4434-adb5-ca84626ca4bb could not be found. Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2324f446-43b1-4e97-bccc-eb50f9c2c30f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Request method failure captured: Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb HTTP/1.1 Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJaEy18RgNLoRH_Cx5N19ntl_MZAWseAedf6nDvdLqq5Uv9fWq711j0XNb6BgsjwGmwVkwDsYZqRqnlQy1v9Czdk1P2JZBE7MuExsRjBvQLnTgLkLacVPY3yLp9R5pSFE5uStbCf24z3K2C9Y_7prmanNUiQJvOS6fzPpIe1j-F47IQ Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b67fc8dd1f4349ca85422bd9a08d3e06"}]}] Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-DeleteServersTestJSON-485778383 Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-DeleteServersTestJSON-485778383-project Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 1ee6c4d28f304eab89014b9c46cc555a Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-DeleteServersTestJSON-485778383-project Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 4876d09c-0ef0-4434-adb5-ca84626ca4bb could not be found. Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '4876d09c-0ef0-4434-adb5-ca84626ca4bb'} Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4876d09c-0ef0-4434-adb5-ca84626ca4bb could not be found. Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4876d09c-0ef0-4434-adb5-ca84626ca4bb could not be found. Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:39.069815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:39.074105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:39.074105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:39.074105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:39.074105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:39.074105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:39.074105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4876d09c-0ef0-4434-adb5-ca84626ca4bb could not be found. Oct 29 02:57:39.074105 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:39.074105 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2324f446-43b1-4e97-bccc-eb50f9c2c30f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Returning 404 to user: Instance 4876d09c-0ef0-4434-adb5-ca84626ca4bb could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:39.074105 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2324f446-43b1-4e97-bccc-eb50f9c2c30f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb" status: 404 len: 111 microversion: 2.1 time: 0.046485 Oct 29 02:57:39.074105 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1344/2470] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:39 2022] GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:57:39.130450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0b1b89be-c42d-4f71-8514-494bddded1de tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2055139710", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "2f016d14-d67d-40f5-811c-d451a32578a4"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:39.142341 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8a933e7e-7e03-430d-8bf6-74ded5688702 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:39.150726 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8a933e7e-7e03-430d-8bf6-74ded5688702 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.170256 Oct 29 02:57:39.151304 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1127/2471] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:38 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:39.173900 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2636e169-8b44-4a77-b9b5-a4dca4503546 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:39.174517 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2636e169-8b44-4a77-b9b5-a4dca4503546 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:39.180815 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2636e169-8b44-4a77-b9b5-a4dca4503546 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:39.181259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2636e169-8b44-4a77-b9b5-a4dca4503546 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:39.181685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2636e169-8b44-4a77-b9b5-a4dca4503546 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:39.182368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2636e169-8b44-4a77-b9b5-a4dca4503546 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:39.182820 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2636e169-8b44-4a77-b9b5-a4dca4503546 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:39.183236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2636e169-8b44-4a77-b9b5-a4dca4503546 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:39.192018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-0b1b89be-c42d-4f71-8514-494bddded1de tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] validate_networks() for [('2f016d14-d67d-40f5-811c-d451a32578a4', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:57:39.323596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2636e169-8b44-4a77-b9b5-a4dca4503546 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:39.331775 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2636e169-8b44-4a77-b9b5-a4dca4503546 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.162007 Oct 29 02:57:39.332378 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1128/2472] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:39 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:39.337098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c377c646-6674-4560-8441-b8df7d1f0ca2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:39.337821 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c377c646-6674-4560-8441-b8df7d1f0ca2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:39.348218 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c377c646-6674-4560-8441-b8df7d1f0ca2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:39.349109 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c377c646-6674-4560-8441-b8df7d1f0ca2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:39.349531 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c377c646-6674-4560-8441-b8df7d1f0ca2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:39.350273 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c377c646-6674-4560-8441-b8df7d1f0ca2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:39.351002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c377c646-6674-4560-8441-b8df7d1f0ca2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:39.351427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c377c646-6674-4560-8441-b8df7d1f0ca2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:39.367297 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:39.488258 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c377c646-6674-4560-8441-b8df7d1f0ca2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:39.497830 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c377c646-6674-4560-8441-b8df7d1f0ca2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8" status: 200 len: 1308 microversion: 2.1 time: 0.164182 Oct 29 02:57:39.498748 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1129/2473] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:39 2022] GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 => generated 1308 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:39.507347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-db5723d4-0809-469e-ba48-eb4af4cc3d47 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:39.508238 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-db5723d4-0809-469e-ba48-eb4af4cc3d47 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Failed to fetch instance by id 9223372036854775808 {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 29 02:57:39.509469 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-db5723d4-0809-469e-ba48-eb4af4cc3d47 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-db5723d4-0809-469e-ba48-eb4af4cc3d47 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 9223372036854775808 could not be found. Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '9223372036854775808'} Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:39.512537 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:39.516177 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:39.516177 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:39.516177 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:39.516177 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 29 02:57:39.516177 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:39.516177 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-db5723d4-0809-469e-ba48-eb4af4cc3d47 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:39.516177 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-db5723d4-0809-469e-ba48-eb4af4cc3d47 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.014716 Oct 29 02:57:39.520830 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1130/2474] 10.222.0.46 () {58 vars in 1188 bytes} [Sat Oct 29 02:57:39 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:57:39.525924 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fd47f4c8-13b8-4a4e-b43f-cf5ca319e30d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:39.526565 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fd47f4c8-13b8-4a4e-b43f-cf5ca319e30d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:39.529773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=94 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:39.534808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd47f4c8-13b8-4a4e-b43f-cf5ca319e30d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:39.535328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd47f4c8-13b8-4a4e-b43f-cf5ca319e30d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:39.535754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd47f4c8-13b8-4a4e-b43f-cf5ca319e30d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:39.536484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd47f4c8-13b8-4a4e-b43f-cf5ca319e30d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:39.537018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd47f4c8-13b8-4a4e-b43f-cf5ca319e30d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:39.537434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd47f4c8-13b8-4a4e-b43f-cf5ca319e30d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:39.572768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-0b1b89be-c42d-4f71-8514-494bddded1de tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:57:39.573189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-0b1b89be-c42d-4f71-8514-494bddded1de tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:57:39.573658 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-0b1b89be-c42d-4f71-8514-494bddded1de tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:57:39.574090 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-0b1b89be-c42d-4f71-8514-494bddded1de tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:57:39.574538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-0b1b89be-c42d-4f71-8514-494bddded1de tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:57:39.584407 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b1b89be-c42d-4f71-8514-494bddded1de tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:39.584966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b1b89be-c42d-4f71-8514-494bddded1de tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:39.585397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b1b89be-c42d-4f71-8514-494bddded1de tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:39.586113 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b1b89be-c42d-4f71-8514-494bddded1de tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:39.586558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b1b89be-c42d-4f71-8514-494bddded1de tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:39.586976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b1b89be-c42d-4f71-8514-494bddded1de tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:39.605104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-0b1b89be-c42d-4f71-8514-494bddded1de tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Getting quotas for project b67fc8dd1f4349ca85422bd9a08d3e06. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:57:39.611150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-0b1b89be-c42d-4f71-8514-494bddded1de tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Getting quotas for user 1ee6c4d28f304eab89014b9c46cc555a and project b67fc8dd1f4349ca85422bd9a08d3e06. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:57:39.625035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0b1b89be-c42d-4f71-8514-494bddded1de tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:57:39.627327 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0b1b89be-c42d-4f71-8514-494bddded1de tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 347ef944-7c69-4650-be60-12e2070c38ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:57:39.680043 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0b1b89be-c42d-4f71-8514-494bddded1de tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.553445 Oct 29 02:57:39.681445 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1345/2475] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:57:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 02:57:39.686180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7c5efb11-3105-40d4-a8db-cd2618cde8da tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:39.686784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7c5efb11-3105-40d4-a8db-cd2618cde8da tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:39.696362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c5efb11-3105-40d4-a8db-cd2618cde8da tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:39.697286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c5efb11-3105-40d4-a8db-cd2618cde8da tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:39.697933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c5efb11-3105-40d4-a8db-cd2618cde8da tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:39.698880 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c5efb11-3105-40d4-a8db-cd2618cde8da tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:39.699544 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c5efb11-3105-40d4-a8db-cd2618cde8da tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:39.700174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c5efb11-3105-40d4-a8db-cd2618cde8da tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:39.701607 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fd47f4c8-13b8-4a4e-b43f-cf5ca319e30d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:39.722661 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fd47f4c8-13b8-4a4e-b43f-cf5ca319e30d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.200398 Oct 29 02:57:39.736549 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1131/2476] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:39 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:39.736549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5d3ca96e-8a27-4767-8fb2-58b1f8965135 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:39.736549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5d3ca96e-8a27-4767-8fb2-58b1f8965135 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 347ef944-7c69-4650-be60-12e2070c38ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:39.825181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5d3ca96e-8a27-4767-8fb2-58b1f8965135 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:39.834092 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5d3ca96e-8a27-4767-8fb2-58b1f8965135 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad" status: 200 len: 1215 microversion: 2.1 time: 0.109726 Oct 29 02:57:39.846663 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1132/2477] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:39 2022] GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad => generated 1215 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:39.857396 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3325a1c1-b429-4efd-8a63-78ea33f2c936 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:39.858577 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3325a1c1-b429-4efd-8a63-78ea33f2c936 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:39.867536 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3325a1c1-b429-4efd-8a63-78ea33f2c936 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:39.868089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3325a1c1-b429-4efd-8a63-78ea33f2c936 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:39.868856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3325a1c1-b429-4efd-8a63-78ea33f2c936 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:39.869867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3325a1c1-b429-4efd-8a63-78ea33f2c936 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:39.870860 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3325a1c1-b429-4efd-8a63-78ea33f2c936 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:39.872556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3325a1c1-b429-4efd-8a63-78ea33f2c936 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:39.952640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7c5efb11-3105-40d4-a8db-cd2618cde8da tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:39.961164 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7c5efb11-3105-40d4-a8db-cd2618cde8da tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1318 microversion: 2.1 time: 0.278478 Oct 29 02:57:39.961796 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1346/2478] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:39 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:40.052371 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3325a1c1-b429-4efd-8a63-78ea33f2c936 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:40.066320 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2748271e-946e-479e-b4d3-947ad5e8f172 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:40.066952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2748271e-946e-479e-b4d3-947ad5e8f172 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:40.074027 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3325a1c1-b429-4efd-8a63-78ea33f2c936 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.225302 Oct 29 02:57:40.074137 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1133/2479] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:39 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:40.094659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2748271e-946e-479e-b4d3-947ad5e8f172 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:40.095304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2748271e-946e-479e-b4d3-947ad5e8f172 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:40.095826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2748271e-946e-479e-b4d3-947ad5e8f172 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:40.096664 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2748271e-946e-479e-b4d3-947ad5e8f172 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:40.097604 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2748271e-946e-479e-b4d3-947ad5e8f172 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:40.103202 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-00db53e0-9e58-489a-883a-0e09b31940c8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:40.104172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2748271e-946e-479e-b4d3-947ad5e8f172 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:40.104420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-00db53e0-9e58-489a-883a-0e09b31940c8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Failed to fetch instance by id -1 {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 29 02:57:40.105160 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-00db53e0-9e58-489a-883a-0e09b31940c8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Instance -1 could not be found. Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-00db53e0-9e58-489a-883a-0e09b31940c8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance -1 could not be found. Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '-1'} Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:40.106916 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:40.111489 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:40.111489 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:40.111489 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 29 02:57:40.111489 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:40.112481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-00db53e0-9e58-489a-883a-0e09b31940c8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 404 to user: Instance -1 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:40.113558 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-00db53e0-9e58-489a-883a-0e09b31940c8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.015164 Oct 29 02:57:40.118439 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1134/2480] 10.222.0.46 () {58 vars in 1137 bytes} [Sat Oct 29 02:57:40 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 29 02:57:40.126101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-70b583a8-738a-4d06-a7f3-71cb42c088e3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:40.126989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-70b583a8-738a-4d06-a7f3-71cb42c088e3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:40.137149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70b583a8-738a-4d06-a7f3-71cb42c088e3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:40.138683 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70b583a8-738a-4d06-a7f3-71cb42c088e3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:40.139285 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70b583a8-738a-4d06-a7f3-71cb42c088e3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:40.140282 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70b583a8-738a-4d06-a7f3-71cb42c088e3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:40.141430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70b583a8-738a-4d06-a7f3-71cb42c088e3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:40.142215 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70b583a8-738a-4d06-a7f3-71cb42c088e3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:40.329372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-70b583a8-738a-4d06-a7f3-71cb42c088e3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:40.340980 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-70b583a8-738a-4d06-a7f3-71cb42c088e3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.221070 Oct 29 02:57:40.342019 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1135/2481] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:40 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:40.342211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2748271e-946e-479e-b4d3-947ad5e8f172 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:40.351222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2748271e-946e-479e-b4d3-947ad5e8f172 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:40.353093 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2748271e-946e-479e-b4d3-947ad5e8f172 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:40.354246 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2748271e-946e-479e-b4d3-947ad5e8f172 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1406 microversion: 2.20 time: 0.292314 Oct 29 02:57:40.355295 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1347/2482] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:57:40 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1406 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:57:40.366090 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ed5a2fee-89de-4920-9d4d-20263e65c94d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:40.366714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ed5a2fee-89de-4920-9d4d-20263e65c94d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:40.374406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed5a2fee-89de-4920-9d4d-20263e65c94d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:40.374953 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed5a2fee-89de-4920-9d4d-20263e65c94d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:40.375558 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed5a2fee-89de-4920-9d4d-20263e65c94d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:40.376484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed5a2fee-89de-4920-9d4d-20263e65c94d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:40.376974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed5a2fee-89de-4920-9d4d-20263e65c94d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:40.377402 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed5a2fee-89de-4920-9d4d-20263e65c94d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:40.532310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ed5a2fee-89de-4920-9d4d-20263e65c94d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:40.537146 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8c409cb7-62c0-458f-ad56-2d1bc7565b3c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:40.538826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8c409cb7-62c0-458f-ad56-2d1bc7565b3c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:40.544229 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ed5a2fee-89de-4920-9d4d-20263e65c94d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.181955 Oct 29 02:57:40.558064 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1136/2483] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:40 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:40.569574 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c409cb7-62c0-458f-ad56-2d1bc7565b3c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:40.570416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c409cb7-62c0-458f-ad56-2d1bc7565b3c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:40.571054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c409cb7-62c0-458f-ad56-2d1bc7565b3c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:40.571456 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-feeff4c5-f2a1-4cc6-867b-080992932b21 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:40.572148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-feeff4c5-f2a1-4cc6-867b-080992932b21 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: bd6b17e1-3fc0-4aeb-a3fd-c90d13c1798f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:40.572492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c409cb7-62c0-458f-ad56-2d1bc7565b3c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:40.573171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c409cb7-62c0-458f-ad56-2d1bc7565b3c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:40.573796 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c409cb7-62c0-458f-ad56-2d1bc7565b3c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:40.579203 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-feeff4c5-f2a1-4cc6-867b-080992932b21 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Instance bd6b17e1-3fc0-4aeb-a3fd-c90d13c1798f could not be found. Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-feeff4c5-f2a1-4cc6-867b-080992932b21 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers/bd6b17e1-3fc0-4aeb-a3fd-c90d13c1798f/action HTTP/1.1 Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 19 Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: {"forceDelete": {}} Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance bd6b17e1-3fc0-4aeb-a3fd-c90d13c1798f could not be found. Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'bd6b17e1-3fc0-4aeb-a3fd-c90d13c1798f', 'body': {'forceDelete': {}}} Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd6b17e1-3fc0-4aeb-a3fd-c90d13c1798f could not be found. Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd6b17e1-3fc0-4aeb-a3fd-c90d13c1798f could not be found. Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:40.587878 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:40.592407 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:40.592407 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:40.592407 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd6b17e1-3fc0-4aeb-a3fd-c90d13c1798f could not be found. Oct 29 02:57:40.592407 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:40.592407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-feeff4c5-f2a1-4cc6-867b-080992932b21 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 404 to user: Instance bd6b17e1-3fc0-4aeb-a3fd-c90d13c1798f could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:40.592407 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-feeff4c5-f2a1-4cc6-867b-080992932b21 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers/bd6b17e1-3fc0-4aeb-a3fd-c90d13c1798f/action" status: 404 len: 111 microversion: 2.1 time: 0.024188 Oct 29 02:57:40.592407 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1137/2484] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:57:40 2022] POST /compute/v2.1/servers/bd6b17e1-3fc0-4aeb-a3fd-c90d13c1798f/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:57:40.599254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-09c58ac4-cffe-4e5f-a868-6a6e7b80c085 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:40.600800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-09c58ac4-cffe-4e5f-a868-6a6e7b80c085 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:40.611203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09c58ac4-cffe-4e5f-a868-6a6e7b80c085 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:40.611744 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09c58ac4-cffe-4e5f-a868-6a6e7b80c085 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:40.612239 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09c58ac4-cffe-4e5f-a868-6a6e7b80c085 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:40.613714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09c58ac4-cffe-4e5f-a868-6a6e7b80c085 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:40.613714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09c58ac4-cffe-4e5f-a868-6a6e7b80c085 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:40.614112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09c58ac4-cffe-4e5f-a868-6a6e7b80c085 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:40.753397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8c409cb7-62c0-458f-ad56-2d1bc7565b3c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:40.764019 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8c409cb7-62c0-458f-ad56-2d1bc7565b3c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8" status: 200 len: 1308 microversion: 2.1 time: 0.232059 Oct 29 02:57:40.768389 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1348/2485] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:40 2022] GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 => generated 1308 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:40.801577 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-09c58ac4-cffe-4e5f-a868-6a6e7b80c085 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:40.817066 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-09c58ac4-cffe-4e5f-a868-6a6e7b80c085 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.221561 Oct 29 02:57:40.822387 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1138/2486] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:40 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:40.844626 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b53937c5-71f6-474b-9473-e4326c8e46cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:40.845147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b53937c5-71f6-474b-9473-e4326c8e46cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:40.851471 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b53937c5-71f6-474b-9473-e4326c8e46cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:40.851987 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b53937c5-71f6-474b-9473-e4326c8e46cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:40.852425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b53937c5-71f6-474b-9473-e4326c8e46cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:40.853213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b53937c5-71f6-474b-9473-e4326c8e46cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:40.853667 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b53937c5-71f6-474b-9473-e4326c8e46cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:40.854089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b53937c5-71f6-474b-9473-e4326c8e46cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:40.863217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e3387aa3-df70-4cfe-8d21-909b699405b6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:40.864336 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e3387aa3-df70-4cfe-8d21-909b699405b6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 347ef944-7c69-4650-be60-12e2070c38ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:40.873605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3387aa3-df70-4cfe-8d21-909b699405b6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:40.874392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3387aa3-df70-4cfe-8d21-909b699405b6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:40.875176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3387aa3-df70-4cfe-8d21-909b699405b6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:40.876226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3387aa3-df70-4cfe-8d21-909b699405b6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:40.876928 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3387aa3-df70-4cfe-8d21-909b699405b6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:40.877551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3387aa3-df70-4cfe-8d21-909b699405b6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:40.976024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e3387aa3-df70-4cfe-8d21-909b699405b6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:40.989593 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e3387aa3-df70-4cfe-8d21-909b699405b6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad" status: 200 len: 1267 microversion: 2.1 time: 0.130805 Oct 29 02:57:40.990783 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1139/2487] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:40 2022] GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad => generated 1267 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:40.996673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d37e68d1-c677-4c87-aa1d-61506bd6fd85 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:40.997537 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d37e68d1-c677-4c87-aa1d-61506bd6fd85 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:41.005452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d37e68d1-c677-4c87-aa1d-61506bd6fd85 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:41.005944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d37e68d1-c677-4c87-aa1d-61506bd6fd85 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:41.006643 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d37e68d1-c677-4c87-aa1d-61506bd6fd85 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:41.007151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d37e68d1-c677-4c87-aa1d-61506bd6fd85 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:41.007612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d37e68d1-c677-4c87-aa1d-61506bd6fd85 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:41.008041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d37e68d1-c677-4c87-aa1d-61506bd6fd85 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:41.028961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b53937c5-71f6-474b-9473-e4326c8e46cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:41.037770 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b53937c5-71f6-474b-9473-e4326c8e46cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.197066 Oct 29 02:57:41.041352 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1349/2488] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:40 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:41.060626 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a19466fb-ecab-4f51-8fe9-e71f98058b00 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:41.063411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a19466fb-ecab-4f51-8fe9-e71f98058b00 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 81cafeed-d7b4-4ea9-8f64-de6c5304d4a4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:41.069525 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-a19466fb-ecab-4f51-8fe9-e71f98058b00 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Instance 81cafeed-d7b4-4ea9-8f64-de6c5304d4a4 could not be found. Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a19466fb-ecab-4f51-8fe9-e71f98058b00 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers/81cafeed-d7b4-4ea9-8f64-de6c5304d4a4/action HTTP/1.1 Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 39 Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: {"os-getConsoleOutput": {"length": 10}} Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 81cafeed-d7b4-4ea9-8f64-de6c5304d4a4 could not be found. Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '81cafeed-d7b4-4ea9-8f64-de6c5304d4a4', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81cafeed-d7b4-4ea9-8f64-de6c5304d4a4 could not be found. Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81cafeed-d7b4-4ea9-8f64-de6c5304d4a4 could not be found. Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:41.072815 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:41.076879 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:41.076879 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:41.076879 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:41.076879 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:41.076879 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81cafeed-d7b4-4ea9-8f64-de6c5304d4a4 could not be found. Oct 29 02:57:41.076879 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:41.076879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a19466fb-ecab-4f51-8fe9-e71f98058b00 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 404 to user: Instance 81cafeed-d7b4-4ea9-8f64-de6c5304d4a4 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:41.076879 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a19466fb-ecab-4f51-8fe9-e71f98058b00 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers/81cafeed-d7b4-4ea9-8f64-de6c5304d4a4/action" status: 404 len: 111 microversion: 2.1 time: 0.017789 Oct 29 02:57:41.076879 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1350/2489] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:57:41 2022] POST /compute/v2.1/servers/81cafeed-d7b4-4ea9-8f64-de6c5304d4a4/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:57:41.083569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7ea308af-2eea-44ca-ab8e-41173564016b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:41.084193 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7ea308af-2eea-44ca-ab8e-41173564016b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:41.092240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ea308af-2eea-44ca-ab8e-41173564016b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:41.092781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ea308af-2eea-44ca-ab8e-41173564016b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:41.093219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ea308af-2eea-44ca-ab8e-41173564016b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:41.094153 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ea308af-2eea-44ca-ab8e-41173564016b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:41.094839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ea308af-2eea-44ca-ab8e-41173564016b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:41.095432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ea308af-2eea-44ca-ab8e-41173564016b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:41.172091 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d37e68d1-c677-4c87-aa1d-61506bd6fd85 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:41.181627 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d37e68d1-c677-4c87-aa1d-61506bd6fd85 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1508 microversion: 2.1 time: 0.189467 Oct 29 02:57:41.182209 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1140/2490] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:40 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1508 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:41.206043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0ba5ca66-195f-498e-b982-60947ea4685c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:41.208187 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0ba5ca66-195f-498e-b982-60947ea4685c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:41.214727 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ba5ca66-195f-498e-b982-60947ea4685c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:41.215367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ba5ca66-195f-498e-b982-60947ea4685c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:41.215850 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ba5ca66-195f-498e-b982-60947ea4685c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:41.216790 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ba5ca66-195f-498e-b982-60947ea4685c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:41.217252 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ba5ca66-195f-498e-b982-60947ea4685c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:41.217706 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ba5ca66-195f-498e-b982-60947ea4685c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:41.259528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7ea308af-2eea-44ca-ab8e-41173564016b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:41.269131 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7ea308af-2eea-44ca-ab8e-41173564016b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.189352 Oct 29 02:57:41.270031 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1351/2491] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:41 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:41.298831 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-38812f71-3464-4b48-9ba9-9e1032e99d78 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:41.299463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-38812f71-3464-4b48-9ba9-9e1032e99d78 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:41.306116 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38812f71-3464-4b48-9ba9-9e1032e99d78 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:41.306936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38812f71-3464-4b48-9ba9-9e1032e99d78 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:41.307671 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38812f71-3464-4b48-9ba9-9e1032e99d78 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:41.308588 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38812f71-3464-4b48-9ba9-9e1032e99d78 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:41.309242 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38812f71-3464-4b48-9ba9-9e1032e99d78 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:41.309841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38812f71-3464-4b48-9ba9-9e1032e99d78 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:41.413024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0ba5ca66-195f-498e-b982-60947ea4685c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:41.423776 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0ba5ca66-195f-498e-b982-60947ea4685c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1508 microversion: 2.1 time: 0.222928 Oct 29 02:57:41.424553 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1141/2492] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:41 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1508 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:41.429537 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e972e830-2d76-4938-aff3-656044ea6017 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:41.430369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e972e830-2d76-4938-aff3-656044ea6017 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:41.436732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e972e830-2d76-4938-aff3-656044ea6017 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:41.437489 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e972e830-2d76-4938-aff3-656044ea6017 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:41.438755 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e972e830-2d76-4938-aff3-656044ea6017 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:41.439739 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e972e830-2d76-4938-aff3-656044ea6017 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:41.440610 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e972e830-2d76-4938-aff3-656044ea6017 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:41.441249 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e972e830-2d76-4938-aff3-656044ea6017 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:41.458219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-38812f71-3464-4b48-9ba9-9e1032e99d78 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:41.468108 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-38812f71-3464-4b48-9ba9-9e1032e99d78 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.173165 Oct 29 02:57:41.468909 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1352/2493] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:41 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:41.486495 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-62ff7a39-db3f-4245-bd42-6aa87c82a0df tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:41.490959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-62ff7a39-db3f-4245-bd42-6aa87c82a0df tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:41.498308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-62ff7a39-db3f-4245-bd42-6aa87c82a0df tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:41.498939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-62ff7a39-db3f-4245-bd42-6aa87c82a0df tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:41.499444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-62ff7a39-db3f-4245-bd42-6aa87c82a0df tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:41.500254 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-62ff7a39-db3f-4245-bd42-6aa87c82a0df tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:41.500804 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-62ff7a39-db3f-4245-bd42-6aa87c82a0df tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:41.501319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-62ff7a39-db3f-4245-bd42-6aa87c82a0df tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:41.569729 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-62ff7a39-db3f-4245-bd42-6aa87c82a0df tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "PUT /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1080 microversion: 2.1 time: 0.088262 Oct 29 02:57:41.570374 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1353/2494] 10.222.0.46 () {60 vars in 1256 bytes} [Sat Oct 29 02:57:41 2022] PUT /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1080 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:41.575114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e2351069-0e22-49d6-922e-68e00e41fd4f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:41.576135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e2351069-0e22-49d6-922e-68e00e41fd4f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: f2674421-5530-4bdd-a742-ee70b55f3160] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:41.582597 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-e2351069-0e22-49d6-922e-68e00e41fd4f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Instance f2674421-5530-4bdd-a742-ee70b55f3160 could not be found. Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e2351069-0e22-49d6-922e-68e00e41fd4f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/f2674421-5530-4bdd-a742-ee70b55f3160 HTTP/1.1 Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance f2674421-5530-4bdd-a742-ee70b55f3160 could not be found. Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'f2674421-5530-4bdd-a742-ee70b55f3160'} Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2674421-5530-4bdd-a742-ee70b55f3160 could not be found. Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2674421-5530-4bdd-a742-ee70b55f3160 could not be found. Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:41.584121 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:41.588143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:41.588143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:41.588143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:41.588143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2674421-5530-4bdd-a742-ee70b55f3160 could not be found. Oct 29 02:57:41.588143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:41.588143 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e2351069-0e22-49d6-922e-68e00e41fd4f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 404 to user: Instance f2674421-5530-4bdd-a742-ee70b55f3160 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:41.588143 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e2351069-0e22-49d6-922e-68e00e41fd4f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/f2674421-5530-4bdd-a742-ee70b55f3160" status: 404 len: 111 microversion: 2.1 time: 0.014584 Oct 29 02:57:41.588143 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1354/2495] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:41 2022] GET /compute/v2.1/servers/f2674421-5530-4bdd-a742-ee70b55f3160 => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:57:41.593142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3d974a61-7ce6-4af4-840f-d8d2ab779915 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:41.593906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3d974a61-7ce6-4af4-840f-d8d2ab779915 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:41.597720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:41.604447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d974a61-7ce6-4af4-840f-d8d2ab779915 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:41.605057 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d974a61-7ce6-4af4-840f-d8d2ab779915 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:41.605568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d974a61-7ce6-4af4-840f-d8d2ab779915 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:41.606612 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d974a61-7ce6-4af4-840f-d8d2ab779915 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:41.607068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d974a61-7ce6-4af4-840f-d8d2ab779915 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:41.607492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d974a61-7ce6-4af4-840f-d8d2ab779915 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:41.634829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e972e830-2d76-4938-aff3-656044ea6017 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:41.649255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e972e830-2d76-4938-aff3-656044ea6017 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:41.650990 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e972e830-2d76-4938-aff3-656044ea6017 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:41.652268 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e972e830-2d76-4938-aff3-656044ea6017 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1406 microversion: 2.20 time: 0.226500 Oct 29 02:57:41.652874 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1142/2496] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:57:41 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:57:41.672752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-134c6c66-e2ca-479b-9f45-2d9faff4acc0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:41.672752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-134c6c66-e2ca-479b-9f45-2d9faff4acc0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:41.672752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-134c6c66-e2ca-479b-9f45-2d9faff4acc0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:41.672752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-134c6c66-e2ca-479b-9f45-2d9faff4acc0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:41.672752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-134c6c66-e2ca-479b-9f45-2d9faff4acc0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:41.672752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-134c6c66-e2ca-479b-9f45-2d9faff4acc0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:41.672752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-134c6c66-e2ca-479b-9f45-2d9faff4acc0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:41.672752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-134c6c66-e2ca-479b-9f45-2d9faff4acc0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:41.771244 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3d974a61-7ce6-4af4-840f-d8d2ab779915 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:41.779826 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3d974a61-7ce6-4af4-840f-d8d2ab779915 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1506 microversion: 2.1 time: 0.191863 Oct 29 02:57:41.780488 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1355/2497] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:41 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1506 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:41.801589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-40e3e5b5-d609-44f1-a218-b5a770556a04 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:41.802414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-40e3e5b5-d609-44f1-a218-b5a770556a04 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:41.809144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40e3e5b5-d609-44f1-a218-b5a770556a04 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:41.809734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40e3e5b5-d609-44f1-a218-b5a770556a04 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:41.810171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40e3e5b5-d609-44f1-a218-b5a770556a04 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:41.810876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40e3e5b5-d609-44f1-a218-b5a770556a04 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:41.811326 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40e3e5b5-d609-44f1-a218-b5a770556a04 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:41.811750 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40e3e5b5-d609-44f1-a218-b5a770556a04 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:41.871648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-134c6c66-e2ca-479b-9f45-2d9faff4acc0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:41.887586 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-134c6c66-e2ca-479b-9f45-2d9faff4acc0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.233039 Oct 29 02:57:41.888963 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1143/2498] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:41 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:41.896751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-96fe63bd-161e-4056-ab3d-e6f2cc223298 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:41.897360 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-96fe63bd-161e-4056-ab3d-e6f2cc223298 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:41.903512 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96fe63bd-161e-4056-ab3d-e6f2cc223298 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:41.904216 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96fe63bd-161e-4056-ab3d-e6f2cc223298 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:41.904833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96fe63bd-161e-4056-ab3d-e6f2cc223298 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:41.905686 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96fe63bd-161e-4056-ab3d-e6f2cc223298 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:41.906591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96fe63bd-161e-4056-ab3d-e6f2cc223298 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:41.907167 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96fe63bd-161e-4056-ab3d-e6f2cc223298 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:41.966589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-40e3e5b5-d609-44f1-a218-b5a770556a04 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:41.974569 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-40e3e5b5-d609-44f1-a218-b5a770556a04 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8" status: 200 len: 1308 microversion: 2.1 time: 0.179383 Oct 29 02:57:41.975115 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1356/2499] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:41 2022] GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 => generated 1308 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:41.979810 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0f006e1b-8bb8-4232-8e1b-d194fd2ba8cc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:41.980421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0f006e1b-8bb8-4232-8e1b-d194fd2ba8cc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:41.989680 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f006e1b-8bb8-4232-8e1b-d194fd2ba8cc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:41.990422 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f006e1b-8bb8-4232-8e1b-d194fd2ba8cc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:41.990848 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f006e1b-8bb8-4232-8e1b-d194fd2ba8cc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:41.991761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f006e1b-8bb8-4232-8e1b-d194fd2ba8cc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:41.992218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f006e1b-8bb8-4232-8e1b-d194fd2ba8cc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:41.992687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f006e1b-8bb8-4232-8e1b-d194fd2ba8cc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:42.013540 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:42.121400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-96fe63bd-161e-4056-ab3d-e6f2cc223298 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:42.129305 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-96fe63bd-161e-4056-ab3d-e6f2cc223298 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1506 microversion: 2.1 time: 0.237747 Oct 29 02:57:42.144844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0f006e1b-8bb8-4232-8e1b-d194fd2ba8cc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:42.145672 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1144/2500] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:41 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1506 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:42.153354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-52cfa06e-72a1-4cf4-9e7e-67666ec37e55 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:42.154257 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-52cfa06e-72a1-4cf4-9e7e-67666ec37e55 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 347ef944-7c69-4650-be60-12e2070c38ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:42.154908 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0f006e1b-8bb8-4232-8e1b-d194fd2ba8cc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.178760 Oct 29 02:57:42.155645 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1357/2501] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:41 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:42.166514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52cfa06e-72a1-4cf4-9e7e-67666ec37e55 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:42.166514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52cfa06e-72a1-4cf4-9e7e-67666ec37e55 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:42.166514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52cfa06e-72a1-4cf4-9e7e-67666ec37e55 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:42.166514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52cfa06e-72a1-4cf4-9e7e-67666ec37e55 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:42.166514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52cfa06e-72a1-4cf4-9e7e-67666ec37e55 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:42.166514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52cfa06e-72a1-4cf4-9e7e-67666ec37e55 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:42.184235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-347afe6f-b08e-4765-8c92-05612d5a79f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:42.187056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-347afe6f-b08e-4765-8c92-05612d5a79f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:42.195193 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-347afe6f-b08e-4765-8c92-05612d5a79f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:42.195763 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-347afe6f-b08e-4765-8c92-05612d5a79f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:42.196306 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-347afe6f-b08e-4765-8c92-05612d5a79f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:42.197170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-347afe6f-b08e-4765-8c92-05612d5a79f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:42.197693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-347afe6f-b08e-4765-8c92-05612d5a79f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:42.198188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-347afe6f-b08e-4765-8c92-05612d5a79f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:42.309919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-347afe6f-b08e-4765-8c92-05612d5a79f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:57:42.310346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-347afe6f-b08e-4765-8c92-05612d5a79f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:57:42.310826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-347afe6f-b08e-4765-8c92-05612d5a79f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:57:42.311237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-347afe6f-b08e-4765-8c92-05612d5a79f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:57:42.311653 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-347afe6f-b08e-4765-8c92-05612d5a79f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:57:42.380024 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-347afe6f-b08e-4765-8c92-05612d5a79f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:42.387039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-347afe6f-b08e-4765-8c92-05612d5a79f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:42.387544 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-347afe6f-b08e-4765-8c92-05612d5a79f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:42.387984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-347afe6f-b08e-4765-8c92-05612d5a79f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:42.388753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-347afe6f-b08e-4765-8c92-05612d5a79f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:42.389209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-347afe6f-b08e-4765-8c92-05612d5a79f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:42.389681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-347afe6f-b08e-4765-8c92-05612d5a79f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:42.424273 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-347afe6f-b08e-4765-8c92-05612d5a79f0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "POST /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368/action" status: 202 len: 1112 microversion: 2.1 time: 0.255800 Oct 29 02:57:42.437963 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1358/2502] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:57:42 2022] POST /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368/action => generated 1112 bytes in 270 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 29 02:57:42.439695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-52cfa06e-72a1-4cf4-9e7e-67666ec37e55 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:42.446616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6d18127c-7970-4b24-bfb3-2a2f4b068ed5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1328082742", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "6a22f1bf-9a27-4375-9469-db16defea274"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:42.453735 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-52cfa06e-72a1-4cf4-9e7e-67666ec37e55 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad" status: 200 len: 1315 microversion: 2.1 time: 0.306814 Oct 29 02:57:42.454301 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1145/2503] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:42 2022] GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6d18127c-7970-4b24-bfb3-2a2f4b068ed5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 238 Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1328082742", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "6a22f1bf-9a27-4375-9469-db16defea274"}]}} Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1328082742', 'imageRef': 'cd315600-df67-41c1-95d3-95a5145fc39a', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '6a22f1bf-9a27-4375-9469-db16defea274'}]}}} Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:42.465721 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:42.473434 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:42.473434 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:42.473434 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:42.473434 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:42.473434 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:42.473434 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:42.473434 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:42.473434 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:42.473434 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:57:42.473434 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:57:42.473434 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:57:42.473434 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:57:42.473434 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:57:42.473434 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:57:42.473434 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 29 02:57:42.473434 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:42.473434 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:42.473434 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:42.473434 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:42.473434 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:42.473434 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:42.473434 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:57:42.473434 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:57:42.473434 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 29 02:57:42.473434 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:42.473434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6d18127c-7970-4b24-bfb3-2a2f4b068ed5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:42.473434 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6d18127c-7970-4b24-bfb3-2a2f4b068ed5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.025476 Oct 29 02:57:42.473434 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1359/2504] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:57:42 2022] POST /compute/v2.1/servers => generated 139 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:57:42.477295 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-da4cefbf-51df-44b6-93db-46fe22aaddd4 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:42.477295 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-da4cefbf-51df-44b6-93db-46fe22aaddd4 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:42.477592 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f0658e7f-943a-402b-91b6-ab671088e1d3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:42.477592 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f0658e7f-943a-402b-91b6-ab671088e1d3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:42.488931 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da4cefbf-51df-44b6-93db-46fe22aaddd4 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:42.489424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da4cefbf-51df-44b6-93db-46fe22aaddd4 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:42.489861 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da4cefbf-51df-44b6-93db-46fe22aaddd4 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:42.490569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da4cefbf-51df-44b6-93db-46fe22aaddd4 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:42.491034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da4cefbf-51df-44b6-93db-46fe22aaddd4 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:42.491443 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da4cefbf-51df-44b6-93db-46fe22aaddd4 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:42.494986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0658e7f-943a-402b-91b6-ab671088e1d3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:42.496851 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0658e7f-943a-402b-91b6-ab671088e1d3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:42.497174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0658e7f-943a-402b-91b6-ab671088e1d3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:42.498332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0658e7f-943a-402b-91b6-ab671088e1d3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:42.505069 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0658e7f-943a-402b-91b6-ab671088e1d3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:42.505823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0658e7f-943a-402b-91b6-ab671088e1d3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:42.709764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f0658e7f-943a-402b-91b6-ab671088e1d3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:42.719759 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f0658e7f-943a-402b-91b6-ab671088e1d3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.247346 Oct 29 02:57:42.721302 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1360/2505] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:42 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:42.747225 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-10245520-6beb-4642-bf7f-d7e4766dbf64 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:42.748252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-10245520-6beb-4642-bf7f-d7e4766dbf64 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:42.769570 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10245520-6beb-4642-bf7f-d7e4766dbf64 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:42.770490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10245520-6beb-4642-bf7f-d7e4766dbf64 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:42.771630 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10245520-6beb-4642-bf7f-d7e4766dbf64 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:42.772571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10245520-6beb-4642-bf7f-d7e4766dbf64 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:42.774021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10245520-6beb-4642-bf7f-d7e4766dbf64 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:42.774907 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10245520-6beb-4642-bf7f-d7e4766dbf64 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:42.791900 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-da4cefbf-51df-44b6-93db-46fe22aaddd4 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:42.803956 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-da4cefbf-51df-44b6-93db-46fe22aaddd4 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1517 microversion: 2.1 time: 0.334159 Oct 29 02:57:42.814757 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1146/2506] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:42 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1517 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:42.832486 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-59eef5eb-6660-4a11-8b76-b999d88bb5b7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:42.834020 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-59eef5eb-6660-4a11-8b76-b999d88bb5b7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:42.844852 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59eef5eb-6660-4a11-8b76-b999d88bb5b7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:42.845616 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59eef5eb-6660-4a11-8b76-b999d88bb5b7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:42.846178 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59eef5eb-6660-4a11-8b76-b999d88bb5b7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:42.847957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59eef5eb-6660-4a11-8b76-b999d88bb5b7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:42.849027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59eef5eb-6660-4a11-8b76-b999d88bb5b7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:42.849851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59eef5eb-6660-4a11-8b76-b999d88bb5b7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:42.931324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-10245520-6beb-4642-bf7f-d7e4766dbf64 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:42.940903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-10245520-6beb-4642-bf7f-d7e4766dbf64 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:42.943115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-10245520-6beb-4642-bf7f-d7e4766dbf64 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:42.944584 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-10245520-6beb-4642-bf7f-d7e4766dbf64 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1406 microversion: 2.20 time: 0.203098 Oct 29 02:57:42.945696 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1361/2507] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:57:42 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:57:42.965774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-7303da57-caa0-4b86-a5d2-03ac6ddd9d06 req-3e25a726-75fe-4f3d-a141-d5bf87a3c519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8", "name": "network-vif-plugged", "status": "completed", "tag": "88edf650-ce03-4e6a-b15e-07fe64065f45"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:42.976936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7303da57-caa0-4b86-a5d2-03ac6ddd9d06 req-3e25a726-75fe-4f3d-a141-d5bf87a3c519 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:42.977670 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7303da57-caa0-4b86-a5d2-03ac6ddd9d06 req-3e25a726-75fe-4f3d-a141-d5bf87a3c519 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:42.978326 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7303da57-caa0-4b86-a5d2-03ac6ddd9d06 req-3e25a726-75fe-4f3d-a141-d5bf87a3c519 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:42.993575 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-7303da57-caa0-4b86-a5d2-03ac6ddd9d06 req-3e25a726-75fe-4f3d-a141-d5bf87a3c519 service nova] Creating event network-vif-plugged:88edf650-ce03-4e6a-b15e-07fe64065f45 for instance f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 on n-h2-862967-2 Oct 29 02:57:43.000999 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-7303da57-caa0-4b86-a5d2-03ac6ddd9d06 req-3e25a726-75fe-4f3d-a141-d5bf87a3c519 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053949 Oct 29 02:57:43.002127 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1362/2508] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:43.007851 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f471bd82-3d48-480c-af03-5eb74191510b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:43.008883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f471bd82-3d48-480c-af03-5eb74191510b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:43.033002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f471bd82-3d48-480c-af03-5eb74191510b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:43.033989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f471bd82-3d48-480c-af03-5eb74191510b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:43.034705 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f471bd82-3d48-480c-af03-5eb74191510b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:43.036475 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f471bd82-3d48-480c-af03-5eb74191510b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:43.038806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f471bd82-3d48-480c-af03-5eb74191510b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:43.039682 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f471bd82-3d48-480c-af03-5eb74191510b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:43.266959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f471bd82-3d48-480c-af03-5eb74191510b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:43.275188 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f471bd82-3d48-480c-af03-5eb74191510b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8" status: 200 len: 1308 microversion: 2.1 time: 0.271506 Oct 29 02:57:43.275785 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1363/2509] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:43 2022] GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 => generated 1308 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:43.406516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-59eef5eb-6660-4a11-8b76-b999d88bb5b7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:43.414833 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-59eef5eb-6660-4a11-8b76-b999d88bb5b7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.599198 Oct 29 02:57:43.415388 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1147/2510] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:42 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:43.480801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9769676d-ee41-4089-aa87-6824f45713e4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:43.480801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9769676d-ee41-4089-aa87-6824f45713e4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 347ef944-7c69-4650-be60-12e2070c38ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:43.482092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fd8f17c1-5f65-4820-8caf-eb6fc6e22513 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1631180090", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "6a22f1bf-9a27-4375-9469-db16defea274"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fd8f17c1-5f65-4820-8caf-eb6fc6e22513 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 235 Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1631180090", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "6a22f1bf-9a27-4375-9469-db16defea274"}]}} Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1631180090', 'imageRef': 'cd315600-df67-41c1-95d3-95a5145fc39a', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '6a22f1bf-9a27-4375-9469-db16defea274'}]}}} Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:43.487589 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:43.492496 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:43.492496 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:43.492496 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:43.492496 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:43.492496 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:43.492496 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:43.492496 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:43.492496 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:43.492496 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:57:43.492496 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:57:43.492496 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:57:43.492496 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:57:43.492496 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:57:43.492496 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:57:43.492496 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 29 02:57:43.492496 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:43.492496 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:43.492496 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:43.492496 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:43.492496 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:43.492496 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:43.492496 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:57:43.492496 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:57:43.492496 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 29 02:57:43.492496 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:43.492496 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fd8f17c1-5f65-4820-8caf-eb6fc6e22513 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:43.494856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9769676d-ee41-4089-aa87-6824f45713e4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:43.494856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9769676d-ee41-4089-aa87-6824f45713e4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:43.495008 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fd8f17c1-5f65-4820-8caf-eb6fc6e22513 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.013930 Oct 29 02:57:43.495084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9769676d-ee41-4089-aa87-6824f45713e4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:43.495157 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1148/2511] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:57:43 2022] POST /compute/v2.1/servers => generated 133 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 02:57:43.495228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9769676d-ee41-4089-aa87-6824f45713e4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:43.495228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9769676d-ee41-4089-aa87-6824f45713e4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:43.495228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9769676d-ee41-4089-aa87-6824f45713e4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:43.502094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-91e89208-72f6-4173-b642-6f3f96c9f6dc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:43.502808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-91e89208-72f6-4173-b642-6f3f96c9f6dc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:43.510841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91e89208-72f6-4173-b642-6f3f96c9f6dc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:43.511860 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91e89208-72f6-4173-b642-6f3f96c9f6dc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:43.511860 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91e89208-72f6-4173-b642-6f3f96c9f6dc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:43.512740 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91e89208-72f6-4173-b642-6f3f96c9f6dc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:43.513242 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91e89208-72f6-4173-b642-6f3f96c9f6dc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:43.513669 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91e89208-72f6-4173-b642-6f3f96c9f6dc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:43.648208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9769676d-ee41-4089-aa87-6824f45713e4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:43.656142 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9769676d-ee41-4089-aa87-6824f45713e4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad" status: 200 len: 1315 microversion: 2.1 time: 0.180794 Oct 29 02:57:43.656744 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1364/2512] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:43 2022] GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:43.717599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-91e89208-72f6-4173-b642-6f3f96c9f6dc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:43.728256 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-91e89208-72f6-4173-b642-6f3f96c9f6dc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.229943 Oct 29 02:57:43.728998 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1149/2513] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:43 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:43.753349 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-f8f90281-c5cd-41e5-b937-1b8599d385ef req-6ecc8035-9952-4768-ba7d-0eb16cfe10c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "347ef944-7c69-4650-be60-12e2070c38ad", "tag": "2b3fba4f-dbe3-40df-ad6e-4fc1f8b07185"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:43.758390 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1657bc4c-f4fc-4998-8d97-80d2f66b8b15 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:43.759453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1657bc4c-f4fc-4998-8d97-80d2f66b8b15 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:43.767970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1657bc4c-f4fc-4998-8d97-80d2f66b8b15 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:43.769161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1657bc4c-f4fc-4998-8d97-80d2f66b8b15 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:43.769669 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1657bc4c-f4fc-4998-8d97-80d2f66b8b15 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:43.770621 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1657bc4c-f4fc-4998-8d97-80d2f66b8b15 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:43.771756 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1657bc4c-f4fc-4998-8d97-80d2f66b8b15 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:43.772285 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1657bc4c-f4fc-4998-8d97-80d2f66b8b15 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:43.773902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f8f90281-c5cd-41e5-b937-1b8599d385ef req-6ecc8035-9952-4768-ba7d-0eb16cfe10c3 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:43.774919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f8f90281-c5cd-41e5-b937-1b8599d385ef req-6ecc8035-9952-4768-ba7d-0eb16cfe10c3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:43.775367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f8f90281-c5cd-41e5-b937-1b8599d385ef req-6ecc8035-9952-4768-ba7d-0eb16cfe10c3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:43.788545 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-f8f90281-c5cd-41e5-b937-1b8599d385ef req-6ecc8035-9952-4768-ba7d-0eb16cfe10c3 service nova] Creating event network-changed:2b3fba4f-dbe3-40df-ad6e-4fc1f8b07185 for instance 347ef944-7c69-4650-be60-12e2070c38ad on n-h1-862967-2 Oct 29 02:57:43.795488 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-f8f90281-c5cd-41e5-b937-1b8599d385ef req-6ecc8035-9952-4768-ba7d-0eb16cfe10c3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050124 Oct 29 02:57:43.796459 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1365/2514] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:43.837266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1fc9d2d1-e86c-4e33-adfe-8067928e9b7b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:43.838191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1fc9d2d1-e86c-4e33-adfe-8067928e9b7b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:43.844734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fc9d2d1-e86c-4e33-adfe-8067928e9b7b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:43.845399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fc9d2d1-e86c-4e33-adfe-8067928e9b7b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:43.845947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fc9d2d1-e86c-4e33-adfe-8067928e9b7b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:43.846736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fc9d2d1-e86c-4e33-adfe-8067928e9b7b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:43.847281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fc9d2d1-e86c-4e33-adfe-8067928e9b7b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:43.847940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fc9d2d1-e86c-4e33-adfe-8067928e9b7b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:43.997251 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1fc9d2d1-e86c-4e33-adfe-8067928e9b7b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:44.006218 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1fc9d2d1-e86c-4e33-adfe-8067928e9b7b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1517 microversion: 2.1 time: 0.173326 Oct 29 02:57:44.007377 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1366/2515] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:43 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:44.009245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1657bc4c-f4fc-4998-8d97-80d2f66b8b15 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:44.013247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b0ccbbb8-aa98-4205-9be6-9cd1cd9d593b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:44.013870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b0ccbbb8-aa98-4205-9be6-9cd1cd9d593b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:44.019635 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1657bc4c-f4fc-4998-8d97-80d2f66b8b15 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.269024 Oct 29 02:57:44.020224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0ccbbb8-aa98-4205-9be6-9cd1cd9d593b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:44.020943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0ccbbb8-aa98-4205-9be6-9cd1cd9d593b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:44.021539 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0ccbbb8-aa98-4205-9be6-9cd1cd9d593b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:44.022498 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0ccbbb8-aa98-4205-9be6-9cd1cd9d593b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:44.023108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0ccbbb8-aa98-4205-9be6-9cd1cd9d593b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:44.023737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0ccbbb8-aa98-4205-9be6-9cd1cd9d593b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:44.028754 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1150/2516] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:43 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:44.044143 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-40b537b1-2d7c-44e3-a31f-da7fb59d6050 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:44.044797 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-40b537b1-2d7c-44e3-a31f-da7fb59d6050 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 962e29fc-4813-4531-82ee-71e8496125ff] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:44.051420 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-40b537b1-2d7c-44e3-a31f-da7fb59d6050 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Instance 962e29fc-4813-4531-82ee-71e8496125ff could not be found. Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-40b537b1-2d7c-44e3-a31f-da7fb59d6050 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers/962e29fc-4813-4531-82ee-71e8496125ff/action HTTP/1.1 Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 13 Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: {"pause": {}} Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 962e29fc-4813-4531-82ee-71e8496125ff could not be found. Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '962e29fc-4813-4531-82ee-71e8496125ff', 'body': {'pause': {}}} Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 962e29fc-4813-4531-82ee-71e8496125ff could not be found. Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 962e29fc-4813-4531-82ee-71e8496125ff could not be found. Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:44.056899 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:44.061749 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:44.061749 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:44.061749 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 962e29fc-4813-4531-82ee-71e8496125ff could not be found. Oct 29 02:57:44.061749 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:44.061749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-40b537b1-2d7c-44e3-a31f-da7fb59d6050 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 404 to user: Instance 962e29fc-4813-4531-82ee-71e8496125ff could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:44.061749 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-40b537b1-2d7c-44e3-a31f-da7fb59d6050 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers/962e29fc-4813-4531-82ee-71e8496125ff/action" status: 404 len: 111 microversion: 2.1 time: 0.018841 Oct 29 02:57:44.063224 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1151/2517] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:57:44 2022] POST /compute/v2.1/servers/962e29fc-4813-4531-82ee-71e8496125ff/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:57:44.068227 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f756dd09-441d-4d51-8bb9-26d4a513768e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:44.068952 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f756dd09-441d-4d51-8bb9-26d4a513768e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:44.082212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f756dd09-441d-4d51-8bb9-26d4a513768e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:44.082212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f756dd09-441d-4d51-8bb9-26d4a513768e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:44.082932 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f756dd09-441d-4d51-8bb9-26d4a513768e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:44.083745 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f756dd09-441d-4d51-8bb9-26d4a513768e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:44.084216 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f756dd09-441d-4d51-8bb9-26d4a513768e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:44.084686 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f756dd09-441d-4d51-8bb9-26d4a513768e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:44.089481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:44.170486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b0ccbbb8-aa98-4205-9be6-9cd1cd9d593b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:44.178973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b0ccbbb8-aa98-4205-9be6-9cd1cd9d593b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:44.180474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b0ccbbb8-aa98-4205-9be6-9cd1cd9d593b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:44.182031 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b0ccbbb8-aa98-4205-9be6-9cd1cd9d593b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1406 microversion: 2.20 time: 0.173315 Oct 29 02:57:44.182607 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1367/2518] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:57:44 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:57:44.298811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8e867c59-bca3-4268-9835-1bced50154df tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:44.299881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8e867c59-bca3-4268-9835-1bced50154df tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:44.309705 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8e867c59-bca3-4268-9835-1bced50154df tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:44.310374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8e867c59-bca3-4268-9835-1bced50154df tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:44.310903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8e867c59-bca3-4268-9835-1bced50154df tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:44.311682 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8e867c59-bca3-4268-9835-1bced50154df tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:44.312142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8e867c59-bca3-4268-9835-1bced50154df tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:44.312667 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8e867c59-bca3-4268-9835-1bced50154df tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:44.316636 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f756dd09-441d-4d51-8bb9-26d4a513768e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:44.327091 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f756dd09-441d-4d51-8bb9-26d4a513768e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.262598 Oct 29 02:57:44.328197 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1152/2519] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:44 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:44.355275 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-aad00eb3-6f1d-4dc9-bc57-a109a645a075 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:44.356125 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-aad00eb3-6f1d-4dc9-bc57-a109a645a075 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:44.367563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aad00eb3-6f1d-4dc9-bc57-a109a645a075 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:44.368631 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aad00eb3-6f1d-4dc9-bc57-a109a645a075 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:44.369427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aad00eb3-6f1d-4dc9-bc57-a109a645a075 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:44.370388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aad00eb3-6f1d-4dc9-bc57-a109a645a075 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:44.371050 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aad00eb3-6f1d-4dc9-bc57-a109a645a075 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:44.371682 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aad00eb3-6f1d-4dc9-bc57-a109a645a075 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:44.457031 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8e867c59-bca3-4268-9835-1bced50154df tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:44.467205 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8e867c59-bca3-4268-9835-1bced50154df tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8" status: 200 len: 1487 microversion: 2.1 time: 0.172531 Oct 29 02:57:44.467790 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1368/2520] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:44 2022] GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 => generated 1487 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:44.490078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-680acf03-6d6e-4a47-8f25-f5e124ec139b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:44.490614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-680acf03-6d6e-4a47-8f25-f5e124ec139b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:44.496751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-680acf03-6d6e-4a47-8f25-f5e124ec139b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:44.497222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-680acf03-6d6e-4a47-8f25-f5e124ec139b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:44.497656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-680acf03-6d6e-4a47-8f25-f5e124ec139b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:44.498348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-680acf03-6d6e-4a47-8f25-f5e124ec139b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:44.498823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-680acf03-6d6e-4a47-8f25-f5e124ec139b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:44.499245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-680acf03-6d6e-4a47-8f25-f5e124ec139b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:44.515491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-aad00eb3-6f1d-4dc9-bc57-a109a645a075 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:44.523659 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-aad00eb3-6f1d-4dc9-bc57-a109a645a075 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.172623 Oct 29 02:57:44.524310 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1153/2521] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:44 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:44.546806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4fbb915e-aa05-4fa7-9ef7-1668c1339966 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:44.547473 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4fbb915e-aa05-4fa7-9ef7-1668c1339966 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:44.553700 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4fbb915e-aa05-4fa7-9ef7-1668c1339966 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:44.554142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4fbb915e-aa05-4fa7-9ef7-1668c1339966 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:44.554632 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4fbb915e-aa05-4fa7-9ef7-1668c1339966 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:44.555412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4fbb915e-aa05-4fa7-9ef7-1668c1339966 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:44.555929 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4fbb915e-aa05-4fa7-9ef7-1668c1339966 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:44.556417 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4fbb915e-aa05-4fa7-9ef7-1668c1339966 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:44.572141 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-680acf03-6d6e-4a47-8f25-f5e124ec139b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "POST /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8/action" status: 202 len: 0 microversion: 2.1 time: 0.085901 Oct 29 02:57:44.575968 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1369/2522] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:57:44 2022] POST /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 02:57:44.581894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a8cf2758-e2d8-4673-bdd2-77d10a6ae12b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:44.582758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a8cf2758-e2d8-4673-bdd2-77d10a6ae12b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:44.591057 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8cf2758-e2d8-4673-bdd2-77d10a6ae12b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:44.591645 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8cf2758-e2d8-4673-bdd2-77d10a6ae12b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:44.592127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8cf2758-e2d8-4673-bdd2-77d10a6ae12b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:44.592888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8cf2758-e2d8-4673-bdd2-77d10a6ae12b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:44.593351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8cf2758-e2d8-4673-bdd2-77d10a6ae12b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:44.593747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8cf2758-e2d8-4673-bdd2-77d10a6ae12b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:44.646346 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4fbb915e-aa05-4fa7-9ef7-1668c1339966 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action" status: 202 len: 0 microversion: 2.1 time: 0.103563 Oct 29 02:57:44.648586 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1154/2523] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:57:44 2022] POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 02:57:44.655455 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-402ad53c-963c-4342-a3e6-9625db805461 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:44.656157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-402ad53c-963c-4342-a3e6-9625db805461 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:44.662485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-402ad53c-963c-4342-a3e6-9625db805461 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:44.662971 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-402ad53c-963c-4342-a3e6-9625db805461 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:44.663398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-402ad53c-963c-4342-a3e6-9625db805461 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:44.664274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-402ad53c-963c-4342-a3e6-9625db805461 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:44.664560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-402ad53c-963c-4342-a3e6-9625db805461 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:44.664999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-402ad53c-963c-4342-a3e6-9625db805461 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:44.740086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a8cf2758-e2d8-4673-bdd2-77d10a6ae12b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:44.749561 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a8cf2758-e2d8-4673-bdd2-77d10a6ae12b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8" status: 200 len: 1492 microversion: 2.1 time: 0.172065 Oct 29 02:57:44.750746 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1370/2524] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:44 2022] GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 => generated 1492 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:44.756689 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7fb60f20-c166-440b-a1c5-7abe6d0258b5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:44.757507 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7fb60f20-c166-440b-a1c5-7abe6d0258b5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 347ef944-7c69-4650-be60-12e2070c38ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:44.766136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7fb60f20-c166-440b-a1c5-7abe6d0258b5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:44.766675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7fb60f20-c166-440b-a1c5-7abe6d0258b5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:44.767184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7fb60f20-c166-440b-a1c5-7abe6d0258b5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:44.768114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7fb60f20-c166-440b-a1c5-7abe6d0258b5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:44.768627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7fb60f20-c166-440b-a1c5-7abe6d0258b5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:44.769399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7fb60f20-c166-440b-a1c5-7abe6d0258b5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:44.813282 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-402ad53c-963c-4342-a3e6-9625db805461 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:44.821325 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-402ad53c-963c-4342-a3e6-9625db805461 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1510 microversion: 2.1 time: 0.169756 Oct 29 02:57:44.821820 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1155/2525] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:44 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:44.904169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7fb60f20-c166-440b-a1c5-7abe6d0258b5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:44.912655 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7fb60f20-c166-440b-a1c5-7abe6d0258b5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad" status: 200 len: 1315 microversion: 2.1 time: 0.160678 Oct 29 02:57:44.913242 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1371/2526] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:44 2022] GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:45.030141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5cffefdb-cfa8-46d9-8b33-8259dc042b0a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:45.030777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5cffefdb-cfa8-46d9-8b33-8259dc042b0a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:45.033404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-5a0aa376-cc60-4fc6-8d40-f95feb6417ba req-35e25c84-a4cc-4710-8e78-73e86e39050b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ab56816-cc78-4e73-918a-4c76895fed6b", "name": "network-vif-plugged", "status": "completed", "tag": "dbe9ee0b-c11e-4edb-a1e4-5c86a11499da"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:45.037428 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5cffefdb-cfa8-46d9-8b33-8259dc042b0a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:45.037911 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5cffefdb-cfa8-46d9-8b33-8259dc042b0a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:45.038343 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5cffefdb-cfa8-46d9-8b33-8259dc042b0a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:45.039187 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5cffefdb-cfa8-46d9-8b33-8259dc042b0a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:45.039661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5cffefdb-cfa8-46d9-8b33-8259dc042b0a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:45.040198 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5cffefdb-cfa8-46d9-8b33-8259dc042b0a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:45.044414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5a0aa376-cc60-4fc6-8d40-f95feb6417ba req-35e25c84-a4cc-4710-8e78-73e86e39050b service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:45.044942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5a0aa376-cc60-4fc6-8d40-f95feb6417ba req-35e25c84-a4cc-4710-8e78-73e86e39050b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:45.045375 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5a0aa376-cc60-4fc6-8d40-f95feb6417ba req-35e25c84-a4cc-4710-8e78-73e86e39050b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:45.059485 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-5a0aa376-cc60-4fc6-8d40-f95feb6417ba req-35e25c84-a4cc-4710-8e78-73e86e39050b service nova] Creating event network-vif-plugged:dbe9ee0b-c11e-4edb-a1e4-5c86a11499da for instance 1ab56816-cc78-4e73-918a-4c76895fed6b on n-h2-862967-2 Oct 29 02:57:45.065669 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-5a0aa376-cc60-4fc6-8d40-f95feb6417ba req-35e25c84-a4cc-4710-8e78-73e86e39050b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035740 Oct 29 02:57:45.066212 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1372/2527] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:45.181407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5cffefdb-cfa8-46d9-8b33-8259dc042b0a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:45.189448 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5cffefdb-cfa8-46d9-8b33-8259dc042b0a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1517 microversion: 2.1 time: 0.163316 Oct 29 02:57:45.190032 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1156/2528] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:45 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:45.208395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2c78d4c8-2b98-4a9c-9d83-8bb96e410bb0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:45.209116 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2c78d4c8-2b98-4a9c-9d83-8bb96e410bb0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:45.215397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c78d4c8-2b98-4a9c-9d83-8bb96e410bb0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:45.215877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c78d4c8-2b98-4a9c-9d83-8bb96e410bb0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:45.216303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c78d4c8-2b98-4a9c-9d83-8bb96e410bb0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:45.217027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c78d4c8-2b98-4a9c-9d83-8bb96e410bb0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:45.217468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c78d4c8-2b98-4a9c-9d83-8bb96e410bb0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:45.217886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c78d4c8-2b98-4a9c-9d83-8bb96e410bb0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:45.351964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2c78d4c8-2b98-4a9c-9d83-8bb96e410bb0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:45.361346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2c78d4c8-2b98-4a9c-9d83-8bb96e410bb0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:45.363129 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2c78d4c8-2b98-4a9c-9d83-8bb96e410bb0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:45.364271 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2c78d4c8-2b98-4a9c-9d83-8bb96e410bb0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1406 microversion: 2.20 time: 0.160299 Oct 29 02:57:45.364838 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1373/2529] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:57:45 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:57:45.773879 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cf3de5bf-4c77-4997-9be6-4a3bf9cbecc5 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:45.774672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cf3de5bf-4c77-4997-9be6-4a3bf9cbecc5 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:45.782257 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf3de5bf-4c77-4997-9be6-4a3bf9cbecc5 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:45.782749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf3de5bf-4c77-4997-9be6-4a3bf9cbecc5 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:45.783201 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf3de5bf-4c77-4997-9be6-4a3bf9cbecc5 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:45.783922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf3de5bf-4c77-4997-9be6-4a3bf9cbecc5 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:45.784372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf3de5bf-4c77-4997-9be6-4a3bf9cbecc5 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:45.784805 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf3de5bf-4c77-4997-9be6-4a3bf9cbecc5 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:45.844506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6f67e22e-84c5-4aa4-b7ca-424363f716c9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:45.845139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6f67e22e-84c5-4aa4-b7ca-424363f716c9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:45.852255 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f67e22e-84c5-4aa4-b7ca-424363f716c9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:45.852776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f67e22e-84c5-4aa4-b7ca-424363f716c9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:45.853312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f67e22e-84c5-4aa4-b7ca-424363f716c9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:45.854010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f67e22e-84c5-4aa4-b7ca-424363f716c9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:45.854569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f67e22e-84c5-4aa4-b7ca-424363f716c9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:45.854993 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f67e22e-84c5-4aa4-b7ca-424363f716c9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:45.858174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:45.999388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6f67e22e-84c5-4aa4-b7ca-424363f716c9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:46.007472 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6f67e22e-84c5-4aa4-b7ca-424363f716c9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1490 microversion: 2.1 time: 0.166888 Oct 29 02:57:46.008248 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1374/2530] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:45 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1490 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:46.017029 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cf3de5bf-4c77-4997-9be6-4a3bf9cbecc5 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:46.026763 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cf3de5bf-4c77-4997-9be6-4a3bf9cbecc5 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8" status: 200 len: 1472 microversion: 2.1 time: 0.256028 Oct 29 02:57:46.027620 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1157/2531] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:45 2022] GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 => generated 1472 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:46.030001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0622384f-bda8-4856-a5c7-3d69829048f2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:46.030604 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0622384f-bda8-4856-a5c7-3d69829048f2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 347ef944-7c69-4650-be60-12e2070c38ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:46.032789 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8371080e-bb63-4400-94a4-66a736fdc831 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:46.033552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8371080e-bb63-4400-94a4-66a736fdc831 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:46.036813 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0622384f-bda8-4856-a5c7-3d69829048f2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:46.037297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0622384f-bda8-4856-a5c7-3d69829048f2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:46.037735 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0622384f-bda8-4856-a5c7-3d69829048f2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:46.038439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0622384f-bda8-4856-a5c7-3d69829048f2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:46.038889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0622384f-bda8-4856-a5c7-3d69829048f2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:46.039319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0622384f-bda8-4856-a5c7-3d69829048f2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:46.040560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8371080e-bb63-4400-94a4-66a736fdc831 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:46.041117 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8371080e-bb63-4400-94a4-66a736fdc831 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:46.041643 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8371080e-bb63-4400-94a4-66a736fdc831 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:46.043453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8371080e-bb63-4400-94a4-66a736fdc831 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:46.044024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8371080e-bb63-4400-94a4-66a736fdc831 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:46.046014 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8371080e-bb63-4400-94a4-66a736fdc831 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:46.078874 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-8371080e-bb63-4400-94a4-66a736fdc831 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Cannot 'pause' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state paused Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8371080e-bb63-4400-94a4-66a736fdc831 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action HTTP/1.1 Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 13 Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: {"pause": {}} Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: exception: Cannot 'pause' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state paused Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '5d9854a1-ead6-4570-b801-13c47d0bf721', 'body': {'pause': {}}} Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5d9854a1-ead6-4570-b801-13c47d0bf721 in vm_state paused. Cannot pause while the instance is in this state. Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state paused Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:46.080651 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:46.086076 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:46.086076 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:46.086076 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:46.086076 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state paused Oct 29 02:57:46.086076 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:46.086076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8371080e-bb63-4400-94a4-66a736fdc831 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 409 to user: Cannot 'pause' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state paused {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:46.086076 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8371080e-bb63-4400-94a4-66a736fdc831 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action" status: 409 len: 143 microversion: 2.1 time: 0.055493 Oct 29 02:57:46.089353 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1158/2532] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:57:46 2022] POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action => generated 143 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:57:46.094616 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-953169c7-79f3-4549-9767-79a916f5b096 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1248702391"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:46.097456 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-953169c7-79f3-4549-9767-79a916f5b096 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:46.103999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-953169c7-79f3-4549-9767-79a916f5b096 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:46.104645 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-953169c7-79f3-4549-9767-79a916f5b096 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:46.105174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-953169c7-79f3-4549-9767-79a916f5b096 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:46.106718 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-953169c7-79f3-4549-9767-79a916f5b096 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:46.107382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-953169c7-79f3-4549-9767-79a916f5b096 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:46.107916 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-953169c7-79f3-4549-9767-79a916f5b096 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:46.189411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0622384f-bda8-4856-a5c7-3d69829048f2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:46.197906 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0622384f-bda8-4856-a5c7-3d69829048f2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad" status: 200 len: 1315 microversion: 2.1 time: 0.172176 Oct 29 02:57:46.198580 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1375/2533] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:46 2022] GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:46.204426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d507d5dc-7464-4e15-b897-2bccf406e897 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:46.205258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d507d5dc-7464-4e15-b897-2bccf406e897 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:46.213552 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d507d5dc-7464-4e15-b897-2bccf406e897 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:46.214118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d507d5dc-7464-4e15-b897-2bccf406e897 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:46.214622 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d507d5dc-7464-4e15-b897-2bccf406e897 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:46.215383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d507d5dc-7464-4e15-b897-2bccf406e897 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:46.215922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d507d5dc-7464-4e15-b897-2bccf406e897 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:46.216410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d507d5dc-7464-4e15-b897-2bccf406e897 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:46.293982 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d507d5dc-7464-4e15-b897-2bccf406e897 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action" status: 202 len: 0 microversion: 2.1 time: 0.093959 Oct 29 02:57:46.298157 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1376/2534] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:57:46 2022] POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:57:46.302231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8f2cca55-8cfa-4f75-aea9-a98f38f8c622 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:46.303028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8f2cca55-8cfa-4f75-aea9-a98f38f8c622 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:46.310413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8f2cca55-8cfa-4f75-aea9-a98f38f8c622 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:46.311075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8f2cca55-8cfa-4f75-aea9-a98f38f8c622 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:46.311572 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8f2cca55-8cfa-4f75-aea9-a98f38f8c622 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:46.312404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8f2cca55-8cfa-4f75-aea9-a98f38f8c622 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:46.312947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8f2cca55-8cfa-4f75-aea9-a98f38f8c622 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:46.313896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8f2cca55-8cfa-4f75-aea9-a98f38f8c622 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:46.332489 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-953169c7-79f3-4549-9767-79a916f5b096 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "POST /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8/action" status: 202 len: 0 microversion: 2.1 time: 0.240535 Oct 29 02:57:46.333880 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1159/2535] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:57:46 2022] POST /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 02:57:46.341708 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-30bfc3fb-7199-4972-8b80-b66f55cc7f30 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:46.342754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-30bfc3fb-7199-4972-8b80-b66f55cc7f30 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:46.351568 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30bfc3fb-7199-4972-8b80-b66f55cc7f30 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:46.352435 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30bfc3fb-7199-4972-8b80-b66f55cc7f30 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:46.352981 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30bfc3fb-7199-4972-8b80-b66f55cc7f30 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:46.354044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30bfc3fb-7199-4972-8b80-b66f55cc7f30 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:46.354558 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30bfc3fb-7199-4972-8b80-b66f55cc7f30 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:46.355073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30bfc3fb-7199-4972-8b80-b66f55cc7f30 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:46.472856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8f2cca55-8cfa-4f75-aea9-a98f38f8c622 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:46.486877 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8f2cca55-8cfa-4f75-aea9-a98f38f8c622 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1517 microversion: 2.1 time: 0.188388 Oct 29 02:57:46.487308 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1377/2536] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:46 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1517 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:46.492303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-73b50321-9ec9-405f-879f-a90698399ab5 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff05827c550>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:46.541959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-30bfc3fb-7199-4972-8b80-b66f55cc7f30 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:46.558325 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-30bfc3fb-7199-4972-8b80-b66f55cc7f30 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1497 microversion: 2.1 time: 0.222424 Oct 29 02:57:46.559014 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1160/2537] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:46 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1497 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:46.560784 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-73b50321-9ec9-405f-879f-a90698399ab5 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c" status: 200 len: 1410 microversion: 2.1 time: 0.072359 Oct 29 02:57:46.561879 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1378/2538] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:57:46 2022] GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c => generated 1410 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:46.567477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6dc7854e-93cc-4a33-87a7-66a1fb2eb864 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:46.568180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6dc7854e-93cc-4a33-87a7-66a1fb2eb864 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:46.575001 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6dc7854e-93cc-4a33-87a7-66a1fb2eb864 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:46.575479 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6dc7854e-93cc-4a33-87a7-66a1fb2eb864 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:46.575904 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6dc7854e-93cc-4a33-87a7-66a1fb2eb864 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:46.576621 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6dc7854e-93cc-4a33-87a7-66a1fb2eb864 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:46.577070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6dc7854e-93cc-4a33-87a7-66a1fb2eb864 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:46.577510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6dc7854e-93cc-4a33-87a7-66a1fb2eb864 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:46.717709 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6dc7854e-93cc-4a33-87a7-66a1fb2eb864 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:46.726308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6dc7854e-93cc-4a33-87a7-66a1fb2eb864 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:46.727776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6dc7854e-93cc-4a33-87a7-66a1fb2eb864 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:46.729043 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6dc7854e-93cc-4a33-87a7-66a1fb2eb864 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1599 microversion: 2.20 time: 0.168917 Oct 29 02:57:46.729617 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1161/2539] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:57:46 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:57:46.754267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-126bec9b-fa77-4068-b281-56b28ef25b96 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:46.754885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-126bec9b-fa77-4068-b281-56b28ef25b96 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:46.761812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-126bec9b-fa77-4068-b281-56b28ef25b96 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:46.762300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-126bec9b-fa77-4068-b281-56b28ef25b96 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:46.762740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-126bec9b-fa77-4068-b281-56b28ef25b96 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:46.763446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-126bec9b-fa77-4068-b281-56b28ef25b96 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:46.763903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-126bec9b-fa77-4068-b281-56b28ef25b96 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:46.764332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-126bec9b-fa77-4068-b281-56b28ef25b96 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:46.847566 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-126bec9b-fa77-4068-b281-56b28ef25b96 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.097734 Oct 29 02:57:46.848204 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1379/2540] 10.222.0.46 () {60 vars in 1316 bytes} [Sat Oct 29 02:57:46 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:57:47.221769 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0b86eacd-2a0c-4727-a957-93e613072759 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:47.222386 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0b86eacd-2a0c-4727-a957-93e613072759 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 347ef944-7c69-4650-be60-12e2070c38ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:47.229584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b86eacd-2a0c-4727-a957-93e613072759 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:47.230097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b86eacd-2a0c-4727-a957-93e613072759 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:47.230506 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b86eacd-2a0c-4727-a957-93e613072759 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:47.231231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b86eacd-2a0c-4727-a957-93e613072759 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:47.231660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b86eacd-2a0c-4727-a957-93e613072759 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:47.232076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b86eacd-2a0c-4727-a957-93e613072759 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:47.406315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0b86eacd-2a0c-4727-a957-93e613072759 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:47.414357 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0b86eacd-2a0c-4727-a957-93e613072759 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad" status: 200 len: 1315 microversion: 2.1 time: 0.196892 Oct 29 02:57:47.414909 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1162/2541] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:47 2022] GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:47.512677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8d533001-d26b-4c0c-b83c-69447724a43b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:47.513383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8d533001-d26b-4c0c-b83c-69447724a43b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:47.519520 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d533001-d26b-4c0c-b83c-69447724a43b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:47.520070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d533001-d26b-4c0c-b83c-69447724a43b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:47.520509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d533001-d26b-4c0c-b83c-69447724a43b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:47.521222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d533001-d26b-4c0c-b83c-69447724a43b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:47.521669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d533001-d26b-4c0c-b83c-69447724a43b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:47.522089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d533001-d26b-4c0c-b83c-69447724a43b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:47.577873 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c0f07e09-af32-4373-be5e-5f6a75c6d25f tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053e44c10>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:47.625297 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c0f07e09-af32-4373-be5e-5f6a75c6d25f tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c" status: 200 len: 1410 microversion: 2.1 time: 0.051370 Oct 29 02:57:47.625851 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1163/2542] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:57:47 2022] GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c => generated 1410 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:47.630404 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-284a1c38-fa6a-4418-8b1f-923370c5537d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:47.631008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-284a1c38-fa6a-4418-8b1f-923370c5537d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:47.637611 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-284a1c38-fa6a-4418-8b1f-923370c5537d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:47.638095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-284a1c38-fa6a-4418-8b1f-923370c5537d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:47.638525 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-284a1c38-fa6a-4418-8b1f-923370c5537d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:47.639222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-284a1c38-fa6a-4418-8b1f-923370c5537d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:47.639672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-284a1c38-fa6a-4418-8b1f-923370c5537d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:47.640084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-284a1c38-fa6a-4418-8b1f-923370c5537d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:47.783071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-284a1c38-fa6a-4418-8b1f-923370c5537d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:47.793505 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-284a1c38-fa6a-4418-8b1f-923370c5537d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.166568 Oct 29 02:57:47.794310 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1164/2543] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:47 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:47.817879 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-861fc06f-29ee-49e6-95a7-81a492e6b943 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:47.818499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-861fc06f-29ee-49e6-95a7-81a492e6b943 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:47.825531 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-861fc06f-29ee-49e6-95a7-81a492e6b943 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:47.826053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-861fc06f-29ee-49e6-95a7-81a492e6b943 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:47.826489 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-861fc06f-29ee-49e6-95a7-81a492e6b943 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:47.827190 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-861fc06f-29ee-49e6-95a7-81a492e6b943 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:47.827639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-861fc06f-29ee-49e6-95a7-81a492e6b943 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:47.828059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-861fc06f-29ee-49e6-95a7-81a492e6b943 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:48.003169 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-861fc06f-29ee-49e6-95a7-81a492e6b943 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:48.013717 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-861fc06f-29ee-49e6-95a7-81a492e6b943 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.199422 Oct 29 02:57:48.014695 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1165/2544] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:47 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:48.039617 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-68dfdf61-8345-4f5b-b408-44a886d21a84 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:48.042124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-68dfdf61-8345-4f5b-b408-44a886d21a84 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 9e23df79-0a40-4417-9312-723fdb1638d0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:48.049084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68dfdf61-8345-4f5b-b408-44a886d21a84 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:48.049576 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68dfdf61-8345-4f5b-b408-44a886d21a84 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:48.050041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68dfdf61-8345-4f5b-b408-44a886d21a84 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:48.050748 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68dfdf61-8345-4f5b-b408-44a886d21a84 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:48.051194 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68dfdf61-8345-4f5b-b408-44a886d21a84 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:48.051608 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68dfdf61-8345-4f5b-b408-44a886d21a84 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:48.074380 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-68dfdf61-8345-4f5b-b408-44a886d21a84 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Instance 9e23df79-0a40-4417-9312-723fdb1638d0 could not be found. Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-68dfdf61-8345-4f5b-b408-44a886d21a84 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0/action HTTP/1.1 Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 28 Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: {"reboot": {"type": "SOFT"}} Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 9e23df79-0a40-4417-9312-723fdb1638d0 could not be found. Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '9e23df79-0a40-4417-9312-723fdb1638d0', 'body': {'reboot': {'type': 'SOFT'}}} Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e23df79-0a40-4417-9312-723fdb1638d0 could not be found. Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:48.076502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:48.081353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e23df79-0a40-4417-9312-723fdb1638d0 could not be found. Oct 29 02:57:48.081353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:48.081353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:48.081353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:48.081353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:48.081353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:48.081353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:48.081353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:48.081353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:48.081353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e23df79-0a40-4417-9312-723fdb1638d0 could not be found. Oct 29 02:57:48.081353 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:48.081353 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-68dfdf61-8345-4f5b-b408-44a886d21a84 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 404 to user: Instance 9e23df79-0a40-4417-9312-723fdb1638d0 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:48.081353 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-68dfdf61-8345-4f5b-b408-44a886d21a84 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0/action" status: 404 len: 111 microversion: 2.1 time: 0.042536 Oct 29 02:57:48.081353 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1166/2545] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:57:48 2022] POST /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:57:48.087795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8c3a8fbf-cc5b-4bb5-866e-9a53269beb69 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:48.088951 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8c3a8fbf-cc5b-4bb5-866e-9a53269beb69 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:48.094752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c3a8fbf-cc5b-4bb5-866e-9a53269beb69 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:48.095166 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c3a8fbf-cc5b-4bb5-866e-9a53269beb69 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:48.095452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8d533001-d26b-4c0c-b83c-69447724a43b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:48.095689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c3a8fbf-cc5b-4bb5-866e-9a53269beb69 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:48.096314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c3a8fbf-cc5b-4bb5-866e-9a53269beb69 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:48.096786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c3a8fbf-cc5b-4bb5-866e-9a53269beb69 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:48.097203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c3a8fbf-cc5b-4bb5-866e-9a53269beb69 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:48.103698 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8d533001-d26b-4c0c-b83c-69447724a43b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1517 microversion: 2.1 time: 0.596219 Oct 29 02:57:48.112939 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1380/2546] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:47 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1517 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:48.241800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8c3a8fbf-cc5b-4bb5-866e-9a53269beb69 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:48.251168 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8c3a8fbf-cc5b-4bb5-866e-9a53269beb69 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.167771 Oct 29 02:57:48.253517 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1167/2547] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:48 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:48.281764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fdefbcff-ab4a-471b-859a-c5c3a726fe4b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:48.283540 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fdefbcff-ab4a-471b-859a-c5c3a726fe4b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:48.300560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-e34798da-672e-4964-a5eb-a224a05781b6 req-02b5e5d9-7777-47f3-8c0f-6b3e1780f68e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ab56816-cc78-4e73-918a-4c76895fed6b", "tag": "dbe9ee0b-c11e-4edb-a1e4-5c86a11499da"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:48.307568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fdefbcff-ab4a-471b-859a-c5c3a726fe4b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:48.308074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fdefbcff-ab4a-471b-859a-c5c3a726fe4b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:48.308546 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fdefbcff-ab4a-471b-859a-c5c3a726fe4b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:48.309266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fdefbcff-ab4a-471b-859a-c5c3a726fe4b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:48.309727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fdefbcff-ab4a-471b-859a-c5c3a726fe4b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:48.310150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fdefbcff-ab4a-471b-859a-c5c3a726fe4b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:48.314938 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e34798da-672e-4964-a5eb-a224a05781b6 req-02b5e5d9-7777-47f3-8c0f-6b3e1780f68e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:48.315571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e34798da-672e-4964-a5eb-a224a05781b6 req-02b5e5d9-7777-47f3-8c0f-6b3e1780f68e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:48.316079 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e34798da-672e-4964-a5eb-a224a05781b6 req-02b5e5d9-7777-47f3-8c0f-6b3e1780f68e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:48.331194 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-e34798da-672e-4964-a5eb-a224a05781b6 req-02b5e5d9-7777-47f3-8c0f-6b3e1780f68e service nova] Creating event network-changed:dbe9ee0b-c11e-4edb-a1e4-5c86a11499da for instance 1ab56816-cc78-4e73-918a-4c76895fed6b on n-h2-862967-2 Oct 29 02:57:48.338829 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-e34798da-672e-4964-a5eb-a224a05781b6 req-02b5e5d9-7777-47f3-8c0f-6b3e1780f68e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041869 Oct 29 02:57:48.339792 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1168/2548] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:48.439551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-78cebb09-7dca-4a10-b2cb-1000fb506b87 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:48.441511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-78cebb09-7dca-4a10-b2cb-1000fb506b87 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 347ef944-7c69-4650-be60-12e2070c38ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:48.450060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78cebb09-7dca-4a10-b2cb-1000fb506b87 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:48.450807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78cebb09-7dca-4a10-b2cb-1000fb506b87 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:48.451452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78cebb09-7dca-4a10-b2cb-1000fb506b87 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:48.452445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78cebb09-7dca-4a10-b2cb-1000fb506b87 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:48.453198 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78cebb09-7dca-4a10-b2cb-1000fb506b87 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:48.453823 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78cebb09-7dca-4a10-b2cb-1000fb506b87 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:48.460420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:48.518538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fdefbcff-ab4a-471b-859a-c5c3a726fe4b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:48.530433 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fdefbcff-ab4a-471b-859a-c5c3a726fe4b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.253976 Oct 29 02:57:48.532688 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1381/2549] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:48 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:48.554319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cc8a83b4-7a71-46ab-8231-f31da2b80266 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:48.556984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cc8a83b4-7a71-46ab-8231-f31da2b80266 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: adccf1eb-c157-432a-b190-5552b9060ffa] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:48.566371 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-cc8a83b4-7a71-46ab-8231-f31da2b80266 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Instance adccf1eb-c157-432a-b190-5552b9060ffa could not be found. Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cc8a83b4-7a71-46ab-8231-f31da2b80266 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers/adccf1eb-c157-432a-b190-5552b9060ffa/action HTTP/1.1 Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 28 Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: {"reboot": {"type": "SOFT"}} Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance adccf1eb-c157-432a-b190-5552b9060ffa could not be found. Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'adccf1eb-c157-432a-b190-5552b9060ffa', 'body': {'reboot': {'type': 'SOFT'}}} Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adccf1eb-c157-432a-b190-5552b9060ffa could not be found. Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adccf1eb-c157-432a-b190-5552b9060ffa could not be found. Oct 29 02:57:48.568132 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:48.576312 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:48.576312 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:48.576312 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:48.576312 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:48.576312 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:48.576312 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:48.576312 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:48.576312 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adccf1eb-c157-432a-b190-5552b9060ffa could not be found. Oct 29 02:57:48.576312 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:48.576312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cc8a83b4-7a71-46ab-8231-f31da2b80266 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 404 to user: Instance adccf1eb-c157-432a-b190-5552b9060ffa could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:48.576312 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cc8a83b4-7a71-46ab-8231-f31da2b80266 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers/adccf1eb-c157-432a-b190-5552b9060ffa/action" status: 404 len: 111 microversion: 2.1 time: 0.020213 Oct 29 02:57:48.577406 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1382/2550] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:57:48 2022] POST /compute/v2.1/servers/adccf1eb-c157-432a-b190-5552b9060ffa/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:57:48.582264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2371f380-36c1-49db-92b0-7b21d302c4e7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:48.582884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2371f380-36c1-49db-92b0-7b21d302c4e7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:48.610477 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2371f380-36c1-49db-92b0-7b21d302c4e7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:48.611104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2371f380-36c1-49db-92b0-7b21d302c4e7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:48.611424 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2371f380-36c1-49db-92b0-7b21d302c4e7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:48.612144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2371f380-36c1-49db-92b0-7b21d302c4e7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:48.612635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2371f380-36c1-49db-92b0-7b21d302c4e7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:48.613068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2371f380-36c1-49db-92b0-7b21d302c4e7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:48.638155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-78cebb09-7dca-4a10-b2cb-1000fb506b87 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:48.652585 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-78cebb09-7dca-4a10-b2cb-1000fb506b87 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad" status: 200 len: 1315 microversion: 2.1 time: 0.218602 Oct 29 02:57:48.666649 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1169/2551] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:48 2022] GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:48.676025 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9b46686a-e9ea-41de-9935-f056c00fa9e3 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053a48e50>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:48.738765 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9b46686a-e9ea-41de-9935-f056c00fa9e3 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c" status: 200 len: 1410 microversion: 2.1 time: 0.070223 Oct 29 02:57:48.740245 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1170/2552] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:57:48 2022] GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c => generated 1410 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:48.746325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ed7d3482-3a24-49a8-8724-9f5aae6433a1 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:48.753156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ed7d3482-3a24-49a8-8724-9f5aae6433a1 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '136249f42e0e41cc9567b1b3be298574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f6396840c4aa6b4b7d4ee83503eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:48.754232 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ed7d3482-3a24-49a8-8724-9f5aae6433a1 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Searching by: {'deleted': False, 'project_id': 'ed7f6396840c4aa6b4b7d4ee83503eac'} {{(pid=127125) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:57:48.761474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed7d3482-3a24-49a8-8724-9f5aae6433a1 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:48.762355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed7d3482-3a24-49a8-8724-9f5aae6433a1 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:48.763123 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed7d3482-3a24-49a8-8724-9f5aae6433a1 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:48.764129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed7d3482-3a24-49a8-8724-9f5aae6433a1 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:48.764837 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed7d3482-3a24-49a8-8724-9f5aae6433a1 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:48.765483 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed7d3482-3a24-49a8-8724-9f5aae6433a1 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:48.794696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.multi_cell_list [None req-ed7d3482-3a24-49a8-8724-9f5aae6433a1 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 02:57:48.839403 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ed7d3482-3a24-49a8-8724-9f5aae6433a1 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.097284 Oct 29 02:57:48.841757 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1171/2553] 10.222.0.46 () {58 vars in 1125 bytes} [Sat Oct 29 02:57:48 2022] GET /compute/v2.1/servers => generated 340 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:48.856635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2371f380-36c1-49db-92b0-7b21d302c4e7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:48.857491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d1b3acef-061c-4080-9413-5dc6d4c1414c tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:48.865822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d1b3acef-061c-4080-9413-5dc6d4c1414c tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '136249f42e0e41cc9567b1b3be298574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f6396840c4aa6b4b7d4ee83503eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:48.866869 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d1b3acef-061c-4080-9413-5dc6d4c1414c tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Searching by: {'deleted': False, 'project_id': 'ed7f6396840c4aa6b4b7d4ee83503eac'} {{(pid=127125) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 02:57:48.867000 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2371f380-36c1-49db-92b0-7b21d302c4e7 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.288326 Oct 29 02:57:48.867553 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1383/2554] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:48 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:48.875098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1b3acef-061c-4080-9413-5dc6d4c1414c tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:48.875709 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1b3acef-061c-4080-9413-5dc6d4c1414c tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:48.876062 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1b3acef-061c-4080-9413-5dc6d4c1414c tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:48.876816 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1b3acef-061c-4080-9413-5dc6d4c1414c tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:48.877396 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1b3acef-061c-4080-9413-5dc6d4c1414c tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:48.879026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1b3acef-061c-4080-9413-5dc6d4c1414c tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:48.893044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-705f4204-26b5-41f4-999a-e6edd7246581 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:48.893969 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-705f4204-26b5-41f4-999a-e6edd7246581 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:48.902228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-705f4204-26b5-41f4-999a-e6edd7246581 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:48.904246 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-705f4204-26b5-41f4-999a-e6edd7246581 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:48.908307 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-705f4204-26b5-41f4-999a-e6edd7246581 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:48.909281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-705f4204-26b5-41f4-999a-e6edd7246581 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:48.909911 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-705f4204-26b5-41f4-999a-e6edd7246581 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:48.910542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-705f4204-26b5-41f4-999a-e6edd7246581 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:48.938511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.multi_cell_list [None req-d1b3acef-061c-4080-9413-5dc6d4c1414c tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 02:57:48.981374 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d1b3acef-061c-4080-9413-5dc6d4c1414c tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136249f42e0e41cc9567b1b3be298574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f6396840c4aa6b4b7d4ee83503eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:48.989493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1b3acef-061c-4080-9413-5dc6d4c1414c tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:48.990033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1b3acef-061c-4080-9413-5dc6d4c1414c tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:48.990807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1b3acef-061c-4080-9413-5dc6d4c1414c tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:49.130002 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d1b3acef-061c-4080-9413-5dc6d4c1414c tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] 10.222.0.46 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.277731 Oct 29 02:57:49.134719 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1172/2555] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 02:57:48 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:49.142451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b868a87d-ce6b-4be4-9672-49299e371848 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:49.145387 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b868a87d-ce6b-4be4-9672-49299e371848 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:49.171111 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b868a87d-ce6b-4be4-9672-49299e371848 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:49.171746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b868a87d-ce6b-4be4-9672-49299e371848 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:49.172269 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b868a87d-ce6b-4be4-9672-49299e371848 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:49.173121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b868a87d-ce6b-4be4-9672-49299e371848 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:49.173667 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b868a87d-ce6b-4be4-9672-49299e371848 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:49.174182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b868a87d-ce6b-4be4-9672-49299e371848 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:49.218973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-705f4204-26b5-41f4-999a-e6edd7246581 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:49.231485 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-705f4204-26b5-41f4-999a-e6edd7246581 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.342766 Oct 29 02:57:49.232507 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1384/2556] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:48 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:49.237598 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-358cdfac-1f21-4d57-8b36-e05caaf7260c tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:49.246727 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-358cdfac-1f21-4d57-8b36-e05caaf7260c tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012822 Oct 29 02:57:49.247655 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1385/2557] 10.222.0.46 () {58 vars in 1137 bytes} [Sat Oct 29 02:57:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:49.260423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-40c7c75a-b19f-4b9c-a4c5-4c4c541758b2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:49.270085 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-40c7c75a-b19f-4b9c-a4c5-4c4c541758b2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 9e23df79-0a40-4417-9312-723fdb1638d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:49.284479 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40c7c75a-b19f-4b9c-a4c5-4c4c541758b2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:49.285359 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40c7c75a-b19f-4b9c-a4c5-4c4c541758b2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:49.285960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40c7c75a-b19f-4b9c-a4c5-4c4c541758b2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:49.286975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40c7c75a-b19f-4b9c-a4c5-4c4c541758b2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:49.289235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40c7c75a-b19f-4b9c-a4c5-4c4c541758b2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:49.289884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40c7c75a-b19f-4b9c-a4c5-4c4c541758b2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:49.324223 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-40c7c75a-b19f-4b9c-a4c5-4c4c541758b2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Instance 9e23df79-0a40-4417-9312-723fdb1638d0 could not be found. Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-40c7c75a-b19f-4b9c-a4c5-4c4c541758b2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0/action HTTP/1.1 Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 65 Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: {"rebuild": {"imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a"}} Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 9e23df79-0a40-4417-9312-723fdb1638d0 could not be found. Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '9e23df79-0a40-4417-9312-723fdb1638d0', 'body': {'rebuild': {'imageRef': 'cd315600-df67-41c1-95d3-95a5145fc39a'}}} Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e23df79-0a40-4417-9312-723fdb1638d0 could not be found. Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 29 02:57:49.326981 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 29 02:57:49.333592 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 02:57:49.333592 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:57:49.333592 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:57:49.333592 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:49.333592 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:49.333592 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e23df79-0a40-4417-9312-723fdb1638d0 could not be found. Oct 29 02:57:49.333592 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:49.333592 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:49.333592 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:49.333592 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:49.333592 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:49.333592 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:49.333592 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:49.333592 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:49.333592 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e23df79-0a40-4417-9312-723fdb1638d0 could not be found. Oct 29 02:57:49.333592 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:49.336819 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-40c7c75a-b19f-4b9c-a4c5-4c4c541758b2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 404 to user: Instance 9e23df79-0a40-4417-9312-723fdb1638d0 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:49.338628 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-40c7c75a-b19f-4b9c-a4c5-4c4c541758b2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0/action" status: 404 len: 111 microversion: 2.1 time: 0.083897 Oct 29 02:57:49.340256 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1386/2558] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:57:49 2022] POST /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0/action => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:57:49.379180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-21c34245-b0cf-49cb-ae54-3a92591c48cc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:49.380424 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-21c34245-b0cf-49cb-ae54-3a92591c48cc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:49.409883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-21c34245-b0cf-49cb-ae54-3a92591c48cc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:49.410555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-21c34245-b0cf-49cb-ae54-3a92591c48cc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:49.413902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-21c34245-b0cf-49cb-ae54-3a92591c48cc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:49.417227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-21c34245-b0cf-49cb-ae54-3a92591c48cc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:49.419542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-21c34245-b0cf-49cb-ae54-3a92591c48cc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:49.421407 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-21c34245-b0cf-49cb-ae54-3a92591c48cc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:49.426982 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b868a87d-ce6b-4be4-9672-49299e371848 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:49.439256 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b868a87d-ce6b-4be4-9672-49299e371848 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1517 microversion: 2.1 time: 0.300638 Oct 29 02:57:49.439851 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1173/2559] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:49 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1517 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:49.596308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-21c34245-b0cf-49cb-ae54-3a92591c48cc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:49.599423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:49.621198 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:49.627301 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-21c34245-b0cf-49cb-ae54-3a92591c48cc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.278491 Oct 29 02:57:49.628425 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1387/2560] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:49 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:49.655003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-939d8041-f32b-48fe-b963-15554d5695c3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:49.655856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-939d8041-f32b-48fe-b963-15554d5695c3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:49.662461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-939d8041-f32b-48fe-b963-15554d5695c3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:49.662946 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-939d8041-f32b-48fe-b963-15554d5695c3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:49.663382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-939d8041-f32b-48fe-b963-15554d5695c3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:49.664094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-939d8041-f32b-48fe-b963-15554d5695c3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:49.664762 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-939d8041-f32b-48fe-b963-15554d5695c3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:49.665441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-939d8041-f32b-48fe-b963-15554d5695c3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:49.680728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7fe14e61-e452-42c3-996f-b59b3a8dc4e9 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:49.681430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7fe14e61-e452-42c3-996f-b59b3a8dc4e9 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 347ef944-7c69-4650-be60-12e2070c38ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:49.700179 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7fe14e61-e452-42c3-996f-b59b3a8dc4e9 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:49.701182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7fe14e61-e452-42c3-996f-b59b3a8dc4e9 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:49.701840 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7fe14e61-e452-42c3-996f-b59b3a8dc4e9 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:49.702768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7fe14e61-e452-42c3-996f-b59b3a8dc4e9 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:49.703418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7fe14e61-e452-42c3-996f-b59b3a8dc4e9 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:49.704086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7fe14e61-e452-42c3-996f-b59b3a8dc4e9 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:49.858298 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-939d8041-f32b-48fe-b963-15554d5695c3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:49.862865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7fe14e61-e452-42c3-996f-b59b3a8dc4e9 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:49.872763 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-939d8041-f32b-48fe-b963-15554d5695c3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.222933 Oct 29 02:57:49.873708 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1174/2561] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:49 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:49.875035 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7fe14e61-e452-42c3-996f-b59b3a8dc4e9 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad" status: 200 len: 1315 microversion: 2.1 time: 0.199537 Oct 29 02:57:49.876103 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1388/2562] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:49 2022] GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:49.906194 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d1bbac2b-f1c4-4cab-ab3e-4f78bf7952dc tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:49.907152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d1bbac2b-f1c4-4cab-ab3e-4f78bf7952dc tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] [instance: 7e11f28d-9567-4c2d-adb3-d52bb16b93b6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:49.913036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ce576e4a-51f4-41e4-bb5b-c59dcaed0bad tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053ea9040>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:49.914689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1bbac2b-f1c4-4cab-ab3e-4f78bf7952dc tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:49.915209 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1bbac2b-f1c4-4cab-ab3e-4f78bf7952dc tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:49.915778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1bbac2b-f1c4-4cab-ab3e-4f78bf7952dc tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:49.916493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1bbac2b-f1c4-4cab-ab3e-4f78bf7952dc tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:49.916975 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1bbac2b-f1c4-4cab-ab3e-4f78bf7952dc tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:49.917401 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1bbac2b-f1c4-4cab-ab3e-4f78bf7952dc tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:49.959790 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d1bbac2b-f1c4-4cab-ab3e-4f78bf7952dc tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] [instance: 7e11f28d-9567-4c2d-adb3-d52bb16b93b6] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:57:49.970970 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ce576e4a-51f4-41e4-bb5b-c59dcaed0bad tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c" status: 200 len: 1410 microversion: 2.1 time: 0.093517 Oct 29 02:57:49.971683 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1389/2563] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:57:49 2022] GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c => generated 1410 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:49.986837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-69888d1e-ef00-4667-8e2b-74b3ba9873c8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:49.989934 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-69888d1e-ef00-4667-8e2b-74b3ba9873c8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 93982b8e-5f19-45c9-902f-5b1429f0598e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:49.999838 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-69888d1e-ef00-4667-8e2b-74b3ba9873c8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Instance 93982b8e-5f19-45c9-902f-5b1429f0598e could not be found. Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-69888d1e-ef00-4667-8e2b-74b3ba9873c8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers/93982b8e-5f19-45c9-902f-5b1429f0598e/action HTTP/1.1 Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 65 Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: {"rebuild": {"imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a"}} Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 93982b8e-5f19-45c9-902f-5b1429f0598e could not be found. Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '93982b8e-5f19-45c9-902f-5b1429f0598e', 'body': {'rebuild': {'imageRef': 'cd315600-df67-41c1-95d3-95a5145fc39a'}}} Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93982b8e-5f19-45c9-902f-5b1429f0598e could not be found. Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 29 02:57:50.001578 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:57:50.009344 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:57:50.009344 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:50.009344 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:50.009344 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93982b8e-5f19-45c9-902f-5b1429f0598e could not be found. Oct 29 02:57:50.009344 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:50.009344 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:50.009344 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:50.009344 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:50.009344 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:50.009344 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:50.009344 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:50.009344 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:50.009344 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93982b8e-5f19-45c9-902f-5b1429f0598e could not be found. Oct 29 02:57:50.009344 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:50.009344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-69888d1e-ef00-4667-8e2b-74b3ba9873c8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 404 to user: Instance 93982b8e-5f19-45c9-902f-5b1429f0598e could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:50.009344 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-69888d1e-ef00-4667-8e2b-74b3ba9873c8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers/93982b8e-5f19-45c9-902f-5b1429f0598e/action" status: 404 len: 111 microversion: 2.1 time: 0.030128 Oct 29 02:57:50.009344 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1390/2564] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:57:49 2022] POST /compute/v2.1/servers/93982b8e-5f19-45c9-902f-5b1429f0598e/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:57:50.014834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-804ce6c3-cb32-4709-9832-c67525e84f8e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:50.015496 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-804ce6c3-cb32-4709-9832-c67525e84f8e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:50.023981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-804ce6c3-cb32-4709-9832-c67525e84f8e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:50.024489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-804ce6c3-cb32-4709-9832-c67525e84f8e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:50.025038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-804ce6c3-cb32-4709-9832-c67525e84f8e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:50.026150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-804ce6c3-cb32-4709-9832-c67525e84f8e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:50.026639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-804ce6c3-cb32-4709-9832-c67525e84f8e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:50.027240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-804ce6c3-cb32-4709-9832-c67525e84f8e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:50.134645 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d1bbac2b-f1c4-4cab-ab3e-4f78bf7952dc tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6" status: 204 len: 0 microversion: 2.1 time: 0.259016 Oct 29 02:57:50.135951 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1175/2565] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:57:49 2022] DELETE /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:57:50.140861 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-6adacaba-58bf-4d88-ae60-7d5e7d0bcb2e req-38da16b6-c12d-426f-b689-b7911709e9b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8", "name": "network-vif-plugged", "status": "completed", "tag": "88edf650-ce03-4e6a-b15e-07fe64065f45"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:50.156277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6adacaba-58bf-4d88-ae60-7d5e7d0bcb2e req-38da16b6-c12d-426f-b689-b7911709e9b2 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:50.157312 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6adacaba-58bf-4d88-ae60-7d5e7d0bcb2e req-38da16b6-c12d-426f-b689-b7911709e9b2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:50.157992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6adacaba-58bf-4d88-ae60-7d5e7d0bcb2e req-38da16b6-c12d-426f-b689-b7911709e9b2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:50.182967 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-6adacaba-58bf-4d88-ae60-7d5e7d0bcb2e req-38da16b6-c12d-426f-b689-b7911709e9b2 service nova] Creating event network-vif-plugged:88edf650-ce03-4e6a-b15e-07fe64065f45 for instance f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 on n-h2-862967-2 Oct 29 02:57:50.193141 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-6adacaba-58bf-4d88-ae60-7d5e7d0bcb2e req-38da16b6-c12d-426f-b689-b7911709e9b2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055993 Oct 29 02:57:50.194742 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1176/2566] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:50.205735 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-438fafb0-8175-418c-9274-4fa532e11b86 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:50.206621 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-438fafb0-8175-418c-9274-4fa532e11b86 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] [instance: 7e11f28d-9567-4c2d-adb3-d52bb16b93b6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:50.214394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-438fafb0-8175-418c-9274-4fa532e11b86 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:50.214920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-438fafb0-8175-418c-9274-4fa532e11b86 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:50.215454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-438fafb0-8175-418c-9274-4fa532e11b86 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:50.216265 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-438fafb0-8175-418c-9274-4fa532e11b86 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:50.217004 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-438fafb0-8175-418c-9274-4fa532e11b86 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:50.217473 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-438fafb0-8175-418c-9274-4fa532e11b86 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:50.229258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-804ce6c3-cb32-4709-9832-c67525e84f8e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:50.238375 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-804ce6c3-cb32-4709-9832-c67525e84f8e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.229238 Oct 29 02:57:50.239554 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1391/2567] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:50 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:50.270175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d703ca81-9125-4252-a79a-af44d6e2db2b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:50.270804 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d703ca81-9125-4252-a79a-af44d6e2db2b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:50.280108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d703ca81-9125-4252-a79a-af44d6e2db2b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:50.285834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d703ca81-9125-4252-a79a-af44d6e2db2b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:50.286540 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d703ca81-9125-4252-a79a-af44d6e2db2b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:50.287468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d703ca81-9125-4252-a79a-af44d6e2db2b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:50.289051 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d703ca81-9125-4252-a79a-af44d6e2db2b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:50.294493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d703ca81-9125-4252-a79a-af44d6e2db2b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:50.375528 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-438fafb0-8175-418c-9274-4fa532e11b86 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136249f42e0e41cc9567b1b3be298574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f6396840c4aa6b4b7d4ee83503eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:50.391100 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-438fafb0-8175-418c-9274-4fa532e11b86 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] 10.222.0.46 "GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6" status: 200 len: 1714 microversion: 2.1 time: 0.194573 Oct 29 02:57:50.391994 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1177/2568] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:50 2022] GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6 => generated 1714 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:50.462735 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-46359dec-9150-4221-9a1d-971da8ad944c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:50.463453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-46359dec-9150-4221-9a1d-971da8ad944c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:50.471972 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46359dec-9150-4221-9a1d-971da8ad944c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:50.472835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46359dec-9150-4221-9a1d-971da8ad944c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:50.475373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46359dec-9150-4221-9a1d-971da8ad944c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:50.476324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46359dec-9150-4221-9a1d-971da8ad944c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:50.478875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46359dec-9150-4221-9a1d-971da8ad944c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:50.479499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46359dec-9150-4221-9a1d-971da8ad944c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:50.498930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d703ca81-9125-4252-a79a-af44d6e2db2b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:50.517781 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d703ca81-9125-4252-a79a-af44d6e2db2b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.255685 Oct 29 02:57:50.519285 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1392/2569] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:50 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:50.551242 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-de5e25b2-dde9-4dec-ad3f-a0f560abf866 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:50.553362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-de5e25b2-dde9-4dec-ad3f-a0f560abf866 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: db8f82ee-5340-4774-8829-3a834a2a284a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:50.571599 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-de5e25b2-dde9-4dec-ad3f-a0f560abf866 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Instance db8f82ee-5340-4774-8829-3a834a2a284a could not be found. Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-de5e25b2-dde9-4dec-ad3f-a0f560abf866 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers/db8f82ee-5340-4774-8829-3a834a2a284a/action HTTP/1.1 Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 15 Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: {"restore": {}} Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance db8f82ee-5340-4774-8829-3a834a2a284a could not be found. Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'db8f82ee-5340-4774-8829-3a834a2a284a', 'body': {'restore': {}}} Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db8f82ee-5340-4774-8829-3a834a2a284a could not be found. Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db8f82ee-5340-4774-8829-3a834a2a284a could not be found. Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:50.581026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:50.588212 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:50.588212 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:50.588212 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db8f82ee-5340-4774-8829-3a834a2a284a could not be found. Oct 29 02:57:50.588212 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:50.590739 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-de5e25b2-dde9-4dec-ad3f-a0f560abf866 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 404 to user: Instance db8f82ee-5340-4774-8829-3a834a2a284a could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:50.592704 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-de5e25b2-dde9-4dec-ad3f-a0f560abf866 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers/db8f82ee-5340-4774-8829-3a834a2a284a/action" status: 404 len: 111 microversion: 2.1 time: 0.051822 Oct 29 02:57:50.593439 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1393/2570] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:57:50 2022] POST /compute/v2.1/servers/db8f82ee-5340-4774-8829-3a834a2a284a/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:57:50.606815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bebc12ee-13db-4c7f-9406-49913dfcb101 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:50.610891 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bebc12ee-13db-4c7f-9406-49913dfcb101 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:50.630303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bebc12ee-13db-4c7f-9406-49913dfcb101 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:50.631134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bebc12ee-13db-4c7f-9406-49913dfcb101 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:50.631885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bebc12ee-13db-4c7f-9406-49913dfcb101 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:50.632889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bebc12ee-13db-4c7f-9406-49913dfcb101 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:50.633678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bebc12ee-13db-4c7f-9406-49913dfcb101 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:50.635435 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bebc12ee-13db-4c7f-9406-49913dfcb101 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:50.688436 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-46359dec-9150-4221-9a1d-971da8ad944c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:50.699876 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-46359dec-9150-4221-9a1d-971da8ad944c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1517 microversion: 2.1 time: 0.241405 Oct 29 02:57:50.700487 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1178/2571] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:50 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1517 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:50.822347 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bebc12ee-13db-4c7f-9406-49913dfcb101 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:50.830778 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bebc12ee-13db-4c7f-9406-49913dfcb101 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.230862 Oct 29 02:57:50.831737 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1394/2572] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:50 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:50.854885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d38bc2da-87cf-4839-b0b9-883cb3cd81b6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:50.855486 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d38bc2da-87cf-4839-b0b9-883cb3cd81b6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:50.861645 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d38bc2da-87cf-4839-b0b9-883cb3cd81b6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:50.862124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d38bc2da-87cf-4839-b0b9-883cb3cd81b6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:50.862549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d38bc2da-87cf-4839-b0b9-883cb3cd81b6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:50.863245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d38bc2da-87cf-4839-b0b9-883cb3cd81b6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:50.864896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d38bc2da-87cf-4839-b0b9-883cb3cd81b6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:50.864896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d38bc2da-87cf-4839-b0b9-883cb3cd81b6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:50.897881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-45179759-0d7c-4e86-9c09-cc97e6ebdde0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:50.898898 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-45179759-0d7c-4e86-9c09-cc97e6ebdde0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 347ef944-7c69-4650-be60-12e2070c38ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:50.907042 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45179759-0d7c-4e86-9c09-cc97e6ebdde0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:50.907837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45179759-0d7c-4e86-9c09-cc97e6ebdde0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:50.908427 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45179759-0d7c-4e86-9c09-cc97e6ebdde0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:50.909467 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45179759-0d7c-4e86-9c09-cc97e6ebdde0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:50.910437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45179759-0d7c-4e86-9c09-cc97e6ebdde0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:50.911045 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45179759-0d7c-4e86-9c09-cc97e6ebdde0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:51.027996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d38bc2da-87cf-4839-b0b9-883cb3cd81b6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:51.041511 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d38bc2da-87cf-4839-b0b9-883cb3cd81b6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.191354 Oct 29 02:57:51.057021 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1179/2573] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:50 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:51.067224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-31ce85e8-f7b8-4b1b-8251-0934d8d685bb tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053e44d30>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:51.123360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-45179759-0d7c-4e86-9c09-cc97e6ebdde0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:51.123882 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-31ce85e8-f7b8-4b1b-8251-0934d8d685bb tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c" status: 200 len: 1410 microversion: 2.1 time: 0.065722 Oct 29 02:57:51.134798 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-45179759-0d7c-4e86-9c09-cc97e6ebdde0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad" status: 200 len: 1315 microversion: 2.1 time: 0.240371 Oct 29 02:57:51.135624 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1395/2574] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:50 2022] GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:51.136276 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1180/2575] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:57:51 2022] GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c => generated 1410 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:51.141252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dddd3e88-4726-499d-a9a2-ddb77f9652f5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:51.142065 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dddd3e88-4726-499d-a9a2-ddb77f9652f5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:51.149628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dddd3e88-4726-499d-a9a2-ddb77f9652f5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:51.150336 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dddd3e88-4726-499d-a9a2-ddb77f9652f5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:51.150933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dddd3e88-4726-499d-a9a2-ddb77f9652f5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:51.151810 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dddd3e88-4726-499d-a9a2-ddb77f9652f5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:51.152271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dddd3e88-4726-499d-a9a2-ddb77f9652f5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:51.152747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dddd3e88-4726-499d-a9a2-ddb77f9652f5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:51.180537 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-dddd3e88-4726-499d-a9a2-ddb77f9652f5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Cannot 'restore' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state active Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dddd3e88-4726-499d-a9a2-ddb77f9652f5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action HTTP/1.1 Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 15 Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: {"restore": {}} Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: exception: Cannot 'restore' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state active Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '5d9854a1-ead6-4570-b801-13c47d0bf721', 'body': {'restore': {}}} Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5d9854a1-ead6-4570-b801-13c47d0bf721 in vm_state active. Cannot restore while the instance is in this state. Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state active Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:51.182129 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:51.186727 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:51.186727 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:51.186727 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:51.186727 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state active Oct 29 02:57:51.186727 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:51.186727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dddd3e88-4726-499d-a9a2-ddb77f9652f5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 409 to user: Cannot 'restore' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state active {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:51.186727 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dddd3e88-4726-499d-a9a2-ddb77f9652f5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action" status: 409 len: 145 microversion: 2.1 time: 0.046526 Oct 29 02:57:51.192511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c213f46d-da8e-4a9f-a951-ebff6d432e2a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:51.193160 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c213f46d-da8e-4a9f-a951-ebff6d432e2a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:51.195348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:51.198344 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1396/2576] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:57:51 2022] POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action => generated 145 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:57:51.203377 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c213f46d-da8e-4a9f-a951-ebff6d432e2a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:51.203871 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c213f46d-da8e-4a9f-a951-ebff6d432e2a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:51.204422 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c213f46d-da8e-4a9f-a951-ebff6d432e2a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:51.205165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c213f46d-da8e-4a9f-a951-ebff6d432e2a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:51.205612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c213f46d-da8e-4a9f-a951-ebff6d432e2a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:51.206032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c213f46d-da8e-4a9f-a951-ebff6d432e2a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:51.352650 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c213f46d-da8e-4a9f-a951-ebff6d432e2a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:51.361510 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c213f46d-da8e-4a9f-a951-ebff6d432e2a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.172859 Oct 29 02:57:51.362374 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1181/2577] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:51 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:51.385594 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dad933f6-168c-4d46-a71f-7c1b80d54810 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:51.386216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dad933f6-168c-4d46-a71f-7c1b80d54810 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:51.393149 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dad933f6-168c-4d46-a71f-7c1b80d54810 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:51.393867 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dad933f6-168c-4d46-a71f-7c1b80d54810 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:51.394295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dad933f6-168c-4d46-a71f-7c1b80d54810 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:51.394997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dad933f6-168c-4d46-a71f-7c1b80d54810 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:51.395483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dad933f6-168c-4d46-a71f-7c1b80d54810 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:51.395864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dad933f6-168c-4d46-a71f-7c1b80d54810 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:51.398912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:51.414890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b8e2ec8e-794e-4a4c-b6f3-4c17e7b0ff03 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:51.415890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b8e2ec8e-794e-4a4c-b6f3-4c17e7b0ff03 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] [instance: 7e11f28d-9567-4c2d-adb3-d52bb16b93b6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:51.422594 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8e2ec8e-794e-4a4c-b6f3-4c17e7b0ff03 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:51.423071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8e2ec8e-794e-4a4c-b6f3-4c17e7b0ff03 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:51.423678 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8e2ec8e-794e-4a4c-b6f3-4c17e7b0ff03 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:51.424581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8e2ec8e-794e-4a4c-b6f3-4c17e7b0ff03 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:51.425600 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8e2ec8e-794e-4a4c-b6f3-4c17e7b0ff03 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:51.426283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8e2ec8e-794e-4a4c-b6f3-4c17e7b0ff03 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:51.612890 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dad933f6-168c-4d46-a71f-7c1b80d54810 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:51.624072 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dad933f6-168c-4d46-a71f-7c1b80d54810 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.242031 Oct 29 02:57:51.624072 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1397/2578] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:51 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:51.646967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-80ed3f5e-7f26-499e-a1d2-75f8195cb9d5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:51.648336 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-80ed3f5e-7f26-499e-a1d2-75f8195cb9d5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 732a2641-4f28-4fda-8336-dfcbd53247c2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:51.652710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b8e2ec8e-794e-4a4c-b6f3-4c17e7b0ff03 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136249f42e0e41cc9567b1b3be298574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f6396840c4aa6b4b7d4ee83503eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:51.657086 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-80ed3f5e-7f26-499e-a1d2-75f8195cb9d5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Instance 732a2641-4f28-4fda-8336-dfcbd53247c2 could not be found. Oct 29 02:57:51.667784 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b8e2ec8e-794e-4a4c-b6f3-4c17e7b0ff03 tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] 10.222.0.46 "GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6" status: 200 len: 1714 microversion: 2.1 time: 0.256386 Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-80ed3f5e-7f26-499e-a1d2-75f8195cb9d5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers/732a2641-4f28-4fda-8336-dfcbd53247c2/action HTTP/1.1 Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 14 Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: {"resume": {}} Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 732a2641-4f28-4fda-8336-dfcbd53247c2 could not be found. Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '732a2641-4f28-4fda-8336-dfcbd53247c2', 'body': {'resume': {}}} Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 732a2641-4f28-4fda-8336-dfcbd53247c2 could not be found. Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 732a2641-4f28-4fda-8336-dfcbd53247c2 could not be found. Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:51.673351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:51.681532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:51.681532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:51.681532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 732a2641-4f28-4fda-8336-dfcbd53247c2 could not be found. Oct 29 02:57:51.681532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:51.681532 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-80ed3f5e-7f26-499e-a1d2-75f8195cb9d5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 404 to user: Instance 732a2641-4f28-4fda-8336-dfcbd53247c2 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:51.681532 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-80ed3f5e-7f26-499e-a1d2-75f8195cb9d5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers/732a2641-4f28-4fda-8336-dfcbd53247c2/action" status: 404 len: 111 microversion: 2.1 time: 0.032159 Oct 29 02:57:51.681532 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1398/2579] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:57:51 2022] POST /compute/v2.1/servers/732a2641-4f28-4fda-8336-dfcbd53247c2/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 02:57:51.682010 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1182/2580] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:51 2022] GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6 => generated 1714 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:51.683807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f12a6bc3-c672-4c17-954d-ee95be42d068 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:51.684453 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f12a6bc3-c672-4c17-954d-ee95be42d068 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:51.692622 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f12a6bc3-c672-4c17-954d-ee95be42d068 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:51.693123 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f12a6bc3-c672-4c17-954d-ee95be42d068 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:51.693560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f12a6bc3-c672-4c17-954d-ee95be42d068 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:51.694784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f12a6bc3-c672-4c17-954d-ee95be42d068 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:51.695393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f12a6bc3-c672-4c17-954d-ee95be42d068 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:51.695969 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f12a6bc3-c672-4c17-954d-ee95be42d068 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:51.727185 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a3e281d7-fd00-4f9a-a71e-9702b92b738d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:51.727910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a3e281d7-fd00-4f9a-a71e-9702b92b738d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:51.739507 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3e281d7-fd00-4f9a-a71e-9702b92b738d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:51.740011 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3e281d7-fd00-4f9a-a71e-9702b92b738d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:51.740448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3e281d7-fd00-4f9a-a71e-9702b92b738d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:51.741199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3e281d7-fd00-4f9a-a71e-9702b92b738d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:51.741679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3e281d7-fd00-4f9a-a71e-9702b92b738d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:51.742088 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3e281d7-fd00-4f9a-a71e-9702b92b738d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:51.915820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f12a6bc3-c672-4c17-954d-ee95be42d068 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:51.927919 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f12a6bc3-c672-4c17-954d-ee95be42d068 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.247886 Oct 29 02:57:51.932585 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1399/2581] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:51 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:51.953170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9d0bf8b2-4b32-43f7-a1f0-ba4913632fd0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:51.953782 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9d0bf8b2-4b32-43f7-a1f0-ba4913632fd0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:51.960610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d0bf8b2-4b32-43f7-a1f0-ba4913632fd0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:51.961098 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d0bf8b2-4b32-43f7-a1f0-ba4913632fd0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:51.961530 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d0bf8b2-4b32-43f7-a1f0-ba4913632fd0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:51.962315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d0bf8b2-4b32-43f7-a1f0-ba4913632fd0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:51.962882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d0bf8b2-4b32-43f7-a1f0-ba4913632fd0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:51.963306 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d0bf8b2-4b32-43f7-a1f0-ba4913632fd0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:52.023454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a3e281d7-fd00-4f9a-a71e-9702b92b738d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:52.040375 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a3e281d7-fd00-4f9a-a71e-9702b92b738d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1517 microversion: 2.1 time: 0.317004 Oct 29 02:57:52.044168 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1183/2582] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:51 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1517 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:52.145635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fba1c06c-d1d2-4c09-8b1b-cbe26953ab22 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053a22dc0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:52.191517 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9d0bf8b2-4b32-43f7-a1f0-ba4913632fd0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:52.201832 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9d0bf8b2-4b32-43f7-a1f0-ba4913632fd0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.252944 Oct 29 02:57:52.212616 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1400/2583] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:51 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:52.212616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-320f383a-d4ee-4d81-8c15-f29c7c7c9508 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:52.212616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-320f383a-d4ee-4d81-8c15-f29c7c7c9508 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 347ef944-7c69-4650-be60-12e2070c38ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:52.224090 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-320f383a-d4ee-4d81-8c15-f29c7c7c9508 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:52.224090 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-320f383a-d4ee-4d81-8c15-f29c7c7c9508 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:52.224090 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-320f383a-d4ee-4d81-8c15-f29c7c7c9508 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:52.224090 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-320f383a-d4ee-4d81-8c15-f29c7c7c9508 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:52.224090 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-320f383a-d4ee-4d81-8c15-f29c7c7c9508 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:52.224090 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-320f383a-d4ee-4d81-8c15-f29c7c7c9508 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:52.234666 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fba1c06c-d1d2-4c09-8b1b-cbe26953ab22 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c" status: 200 len: 1410 microversion: 2.1 time: 0.094489 Oct 29 02:57:52.243663 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1184/2584] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:57:52 2022] GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c => generated 1410 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:52.247788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-cdaf7370-c2b6-4281-9682-6c521838a74b req-a323f89a-3df3-4f8f-ba23-722d37515fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "347ef944-7c69-4650-be60-12e2070c38ad", "name": "network-vif-plugged", "status": "completed", "tag": "2b3fba4f-dbe3-40df-ad6e-4fc1f8b07185"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:52.263028 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-cdaf7370-c2b6-4281-9682-6c521838a74b req-a323f89a-3df3-4f8f-ba23-722d37515fac service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:52.263558 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-cdaf7370-c2b6-4281-9682-6c521838a74b req-a323f89a-3df3-4f8f-ba23-722d37515fac service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:52.264194 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-cdaf7370-c2b6-4281-9682-6c521838a74b req-a323f89a-3df3-4f8f-ba23-722d37515fac service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:52.279183 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-cdaf7370-c2b6-4281-9682-6c521838a74b req-a323f89a-3df3-4f8f-ba23-722d37515fac service nova] Creating event network-vif-plugged:2b3fba4f-dbe3-40df-ad6e-4fc1f8b07185 for instance 347ef944-7c69-4650-be60-12e2070c38ad on n-h1-862967-2 Oct 29 02:57:52.285584 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-cdaf7370-c2b6-4281-9682-6c521838a74b req-a323f89a-3df3-4f8f-ba23-722d37515fac service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042919 Oct 29 02:57:52.286462 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1185/2585] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:52.292011 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b6f940f1-9604-4b19-8ff1-de956cc42bad tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:52.292658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b6f940f1-9604-4b19-8ff1-de956cc42bad tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:52.302778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6f940f1-9604-4b19-8ff1-de956cc42bad tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:52.303573 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6f940f1-9604-4b19-8ff1-de956cc42bad tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:52.304162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6f940f1-9604-4b19-8ff1-de956cc42bad tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:52.305451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6f940f1-9604-4b19-8ff1-de956cc42bad tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:52.306621 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6f940f1-9604-4b19-8ff1-de956cc42bad tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:52.307300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6f940f1-9604-4b19-8ff1-de956cc42bad tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:52.339479 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-b6f940f1-9604-4b19-8ff1-de956cc42bad tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Cannot 'resume' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state active Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b6f940f1-9604-4b19-8ff1-de956cc42bad tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action HTTP/1.1 Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 14 Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: {"resume": {}} Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: exception: Cannot 'resume' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state active Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '5d9854a1-ead6-4570-b801-13c47d0bf721', 'body': {'resume': {}}} Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5d9854a1-ead6-4570-b801-13c47d0bf721 in vm_state active. Cannot resume while the instance is in this state. Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state active Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:52.342027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:52.346166 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:52.346166 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:52.346166 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:52.346166 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:52.346166 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:52.346166 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state active Oct 29 02:57:52.346166 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:52.348542 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b6f940f1-9604-4b19-8ff1-de956cc42bad tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 409 to user: Cannot 'resume' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state active {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:52.349680 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b6f940f1-9604-4b19-8ff1-de956cc42bad tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action" status: 409 len: 144 microversion: 2.1 time: 0.062099 Oct 29 02:57:52.350834 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1186/2586] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:57:52 2022] POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action => generated 144 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:57:52.366543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f9ad5ddc-3a98-4fad-b439-989560090f76 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:52.367485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f9ad5ddc-3a98-4fad-b439-989560090f76 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:52.376309 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9ad5ddc-3a98-4fad-b439-989560090f76 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:52.377133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9ad5ddc-3a98-4fad-b439-989560090f76 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:52.377748 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9ad5ddc-3a98-4fad-b439-989560090f76 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:52.378874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9ad5ddc-3a98-4fad-b439-989560090f76 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:52.379489 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9ad5ddc-3a98-4fad-b439-989560090f76 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:52.380064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9ad5ddc-3a98-4fad-b439-989560090f76 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:52.597873 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-320f383a-d4ee-4d81-8c15-f29c7c7c9508 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:52.608222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f9ad5ddc-3a98-4fad-b439-989560090f76 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:52.614156 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-320f383a-d4ee-4d81-8c15-f29c7c7c9508 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad" status: 200 len: 1315 microversion: 2.1 time: 0.409982 Oct 29 02:57:52.615934 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1401/2587] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:52 2022] GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:52.616100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:52.618570 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f9ad5ddc-3a98-4fad-b439-989560090f76 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.263417 Oct 29 02:57:52.621366 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1187/2588] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:52 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:52.663199 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ece9f272-7689-48a0-a16a-a86f320769cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:52.663835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ece9f272-7689-48a0-a16a-a86f320769cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:52.673632 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ece9f272-7689-48a0-a16a-a86f320769cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:52.674417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ece9f272-7689-48a0-a16a-a86f320769cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:52.676403 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ece9f272-7689-48a0-a16a-a86f320769cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:52.678599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ece9f272-7689-48a0-a16a-a86f320769cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:52.679424 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ece9f272-7689-48a0-a16a-a86f320769cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:52.687437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ece9f272-7689-48a0-a16a-a86f320769cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:52.694372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f6691ec3-bcc0-4c26-a205-0eff76c4d40b tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:52.697895 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f6691ec3-bcc0-4c26-a205-0eff76c4d40b tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] [instance: 7e11f28d-9567-4c2d-adb3-d52bb16b93b6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:52.707590 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6691ec3-bcc0-4c26-a205-0eff76c4d40b tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:52.708375 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6691ec3-bcc0-4c26-a205-0eff76c4d40b tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:52.709864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6691ec3-bcc0-4c26-a205-0eff76c4d40b tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:52.711168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6691ec3-bcc0-4c26-a205-0eff76c4d40b tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:52.711932 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6691ec3-bcc0-4c26-a205-0eff76c4d40b tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:52.712960 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6691ec3-bcc0-4c26-a205-0eff76c4d40b tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:52.904499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f6691ec3-bcc0-4c26-a205-0eff76c4d40b tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136249f42e0e41cc9567b1b3be298574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f6396840c4aa6b4b7d4ee83503eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:52.916062 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f6691ec3-bcc0-4c26-a205-0eff76c4d40b tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] 10.222.0.46 "GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6" status: 200 len: 1646 microversion: 2.1 time: 0.226674 Oct 29 02:57:52.918736 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1188/2589] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:52 2022] GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6 => generated 1646 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:52.921904 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ece9f272-7689-48a0-a16a-a86f320769cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:52.933033 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ece9f272-7689-48a0-a16a-a86f320769cd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.284611 Oct 29 02:57:52.946497 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1402/2590] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:52 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:53.015993 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4c15e109-b099-47aa-9b7e-5a085bce2244 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "6a22f1bf-9a27-4375-9469-db16defea274"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4c15e109-b099-47aa-9b7e-5a085bce2244 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 160 Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: {"server": {"name": "", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "6a22f1bf-9a27-4375-9469-db16defea274"}]}} Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'body': {'server': {'name': '', 'imageRef': 'cd315600-df67-41c1-95d3-95a5145fc39a', 'flavorRef': '452', 'networks': [{'uuid': '6a22f1bf-9a27-4375-9469-db16defea274'}]}}} Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise error Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi '' Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 02:57:53.020479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 02:57:53.031764 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 02:57:53.031764 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 29 02:57:53.031764 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:53.031764 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:53.031764 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:53.031764 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:53.031764 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:53.031764 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:53.031764 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 02:57:53.031764 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 02:57:53.031764 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 29 02:57:53.031764 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:53.031764 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4c15e109-b099-47aa-9b7e-5a085bce2244 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:53.031764 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4c15e109-b099-47aa-9b7e-5a085bce2244 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.010410 Oct 29 02:57:53.031764 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1189/2591] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:57:53 2022] POST /compute/v2.1/servers => generated 108 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:57:53.039142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1ff576f7-f231-4bf2-b739-785ebb2f0fcf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:53.040092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1ff576f7-f231-4bf2-b739-785ebb2f0fcf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:53.047097 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ff576f7-f231-4bf2-b739-785ebb2f0fcf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:53.047670 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ff576f7-f231-4bf2-b739-785ebb2f0fcf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:53.048229 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ff576f7-f231-4bf2-b739-785ebb2f0fcf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:53.049130 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ff576f7-f231-4bf2-b739-785ebb2f0fcf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:53.049695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ff576f7-f231-4bf2-b739-785ebb2f0fcf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:53.050265 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ff576f7-f231-4bf2-b739-785ebb2f0fcf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:53.068850 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d8f0ebd1-17be-47a0-adc5-361461926f90 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:53.069618 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d8f0ebd1-17be-47a0-adc5-361461926f90 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:53.087350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8f0ebd1-17be-47a0-adc5-361461926f90 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:53.088592 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8f0ebd1-17be-47a0-adc5-361461926f90 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:53.088592 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8f0ebd1-17be-47a0-adc5-361461926f90 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:53.089517 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8f0ebd1-17be-47a0-adc5-361461926f90 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:53.095756 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8f0ebd1-17be-47a0-adc5-361461926f90 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:53.096355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8f0ebd1-17be-47a0-adc5-361461926f90 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:53.363921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1ff576f7-f231-4bf2-b739-785ebb2f0fcf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:53.373694 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1ff576f7-f231-4bf2-b739-785ebb2f0fcf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.338383 Oct 29 02:57:53.393042 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1403/2592] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:53 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:53.393042 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6c8abc7d-21ef-4067-af4e-e0a64f74a754 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053e0eb80>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:53.404346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d8f0ebd1-17be-47a0-adc5-361461926f90 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:53.416964 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d8f0ebd1-17be-47a0-adc5-361461926f90 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1517 microversion: 2.1 time: 0.352140 Oct 29 02:57:53.417887 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1190/2593] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:53 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1517 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:53.425049 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-62bc0d23-576d-4a17-a23f-0b3891bfd7f5 req-6da89957-a68f-41f3-9d91-b05bd3880ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e11f28d-9567-4c2d-adb3-d52bb16b93b6", "name": "network-vif-deleted", "tag": "a21f1d05-4754-4e9d-9849-353c2eea93bc"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:53.436097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-62bc0d23-576d-4a17-a23f-0b3891bfd7f5 req-6da89957-a68f-41f3-9d91-b05bd3880ed3 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:53.437339 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-62bc0d23-576d-4a17-a23f-0b3891bfd7f5 req-6da89957-a68f-41f3-9d91-b05bd3880ed3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:53.438517 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-62bc0d23-576d-4a17-a23f-0b3891bfd7f5 req-6da89957-a68f-41f3-9d91-b05bd3880ed3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:53.452865 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-62bc0d23-576d-4a17-a23f-0b3891bfd7f5 req-6da89957-a68f-41f3-9d91-b05bd3880ed3 service nova] Creating event network-vif-deleted:a21f1d05-4754-4e9d-9849-353c2eea93bc for instance 7e11f28d-9567-4c2d-adb3-d52bb16b93b6 on n-h1-862967-2 Oct 29 02:57:53.469588 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-62bc0d23-576d-4a17-a23f-0b3891bfd7f5 req-6da89957-a68f-41f3-9d91-b05bd3880ed3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050100 Oct 29 02:57:53.470452 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1191/2594] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:53.499151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-05dee913-15d8-45dd-8849-02c09fef9826 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:53.500379 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-05dee913-15d8-45dd-8849-02c09fef9826 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:53.526811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05dee913-15d8-45dd-8849-02c09fef9826 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:53.529262 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05dee913-15d8-45dd-8849-02c09fef9826 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:53.530647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05dee913-15d8-45dd-8849-02c09fef9826 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:53.531622 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6c8abc7d-21ef-4067-af4e-e0a64f74a754 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c" status: 200 len: 1410 microversion: 2.1 time: 0.150997 Oct 29 02:57:53.531816 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05dee913-15d8-45dd-8849-02c09fef9826 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:53.532303 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1404/2595] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:57:53 2022] GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c => generated 1410 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:53.540332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05dee913-15d8-45dd-8849-02c09fef9826 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:53.540332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05dee913-15d8-45dd-8849-02c09fef9826 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:53.638100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-86588101-743a-4feb-aff2-3958efa87e85 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:53.639394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-86588101-743a-4feb-aff2-3958efa87e85 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 347ef944-7c69-4650-be60-12e2070c38ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:53.657962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86588101-743a-4feb-aff2-3958efa87e85 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:53.658774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86588101-743a-4feb-aff2-3958efa87e85 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:53.659378 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86588101-743a-4feb-aff2-3958efa87e85 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:53.663161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86588101-743a-4feb-aff2-3958efa87e85 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:53.663821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86588101-743a-4feb-aff2-3958efa87e85 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:53.664510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86588101-743a-4feb-aff2-3958efa87e85 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:53.931129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-05dee913-15d8-45dd-8849-02c09fef9826 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:53.941237 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-05dee913-15d8-45dd-8849-02c09fef9826 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.466104 Oct 29 02:57:53.942126 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1192/2596] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:53 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:53.947835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f90c6821-1d51-44a4-bb3f-a4d3de10c53d tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:53.948456 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f90c6821-1d51-44a4-bb3f-a4d3de10c53d tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] [instance: 7e11f28d-9567-4c2d-adb3-d52bb16b93b6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:53.968291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f90c6821-1d51-44a4-bb3f-a4d3de10c53d tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:53.969335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f90c6821-1d51-44a4-bb3f-a4d3de10c53d tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:53.969854 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f90c6821-1d51-44a4-bb3f-a4d3de10c53d tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:53.970654 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f90c6821-1d51-44a4-bb3f-a4d3de10c53d tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:53.971176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f90c6821-1d51-44a4-bb3f-a4d3de10c53d tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:53.971668 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f90c6821-1d51-44a4-bb3f-a4d3de10c53d tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:54.010423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f90c6821-1d51-44a4-bb3f-a4d3de10c53d tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:54.010930 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f90c6821-1d51-44a4-bb3f-a4d3de10c53d tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:54.011427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f90c6821-1d51-44a4-bb3f-a4d3de10c53d tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:54.011944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-f90c6821-1d51-44a4-bb3f-a4d3de10c53d tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lazy-loading 'fault' on Instance uuid 7e11f28d-9567-4c2d-adb3-d52bb16b93b6 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:57:54.061722 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f90c6821-1d51-44a4-bb3f-a4d3de10c53d tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136249f42e0e41cc9567b1b3be298574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f6396840c4aa6b4b7d4ee83503eac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:54.080434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-86588101-743a-4feb-aff2-3958efa87e85 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:54.082379 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f90c6821-1d51-44a4-bb3f-a4d3de10c53d tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] 10.222.0.46 "GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6" status: 200 len: 1367 microversion: 2.1 time: 0.138903 Oct 29 02:57:54.096552 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1193/2597] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:53 2022] GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6 => generated 1367 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:54.096552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-df0211d5-4ab5-49e0-b09f-4a56fef99651 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:54.096552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-df0211d5-4ab5-49e0-b09f-4a56fef99651 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 287e405f-123b-488d-90bd-6e547251f096] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:54.105129 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-df0211d5-4ab5-49e0-b09f-4a56fef99651 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Instance 287e405f-123b-488d-90bd-6e547251f096 could not be found. Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-df0211d5-4ab5-49e0-b09f-4a56fef99651 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers/287e405f-123b-488d-90bd-6e547251f096/action HTTP/1.1 Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 14 Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: {"shelve": {}} Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 287e405f-123b-488d-90bd-6e547251f096 could not be found. Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '287e405f-123b-488d-90bd-6e547251f096', 'body': {'shelve': {}}} Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 287e405f-123b-488d-90bd-6e547251f096 could not be found. Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 287e405f-123b-488d-90bd-6e547251f096 could not be found. Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:54.107736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:54.112187 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:54.112187 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:54.112187 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 287e405f-123b-488d-90bd-6e547251f096 could not be found. Oct 29 02:57:54.112187 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:57:54.112187 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-df0211d5-4ab5-49e0-b09f-4a56fef99651 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 404 to user: Instance 287e405f-123b-488d-90bd-6e547251f096 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:54.112187 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-df0211d5-4ab5-49e0-b09f-4a56fef99651 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers/287e405f-123b-488d-90bd-6e547251f096/action" status: 404 len: 111 microversion: 2.1 time: 0.024379 Oct 29 02:57:54.112187 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1194/2598] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:57:54 2022] POST /compute/v2.1/servers/287e405f-123b-488d-90bd-6e547251f096/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:57:54.113349 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-86588101-743a-4feb-aff2-3958efa87e85 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad" status: 200 len: 1315 microversion: 2.1 time: 0.479455 Oct 29 02:57:54.119798 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1405/2599] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:53 2022] GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:54.130976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-57727ffb-2750-460b-b38b-63cfd531c5e6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:54.131891 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-57727ffb-2750-460b-b38b-63cfd531c5e6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:54.142160 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57727ffb-2750-460b-b38b-63cfd531c5e6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:54.142673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57727ffb-2750-460b-b38b-63cfd531c5e6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:54.143123 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57727ffb-2750-460b-b38b-63cfd531c5e6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:54.143884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57727ffb-2750-460b-b38b-63cfd531c5e6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:54.144376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57727ffb-2750-460b-b38b-63cfd531c5e6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:54.144840 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57727ffb-2750-460b-b38b-63cfd531c5e6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:54.329048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-57727ffb-2750-460b-b38b-63cfd531c5e6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:54.343806 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-57727ffb-2750-460b-b38b-63cfd531c5e6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.216791 Oct 29 02:57:54.344765 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1195/2600] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:54 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:54.369788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d8594c4c-396c-4c50-a6bb-f3412ec1f00a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:54.370310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d8594c4c-396c-4c50-a6bb-f3412ec1f00a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:54.377642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8594c4c-396c-4c50-a6bb-f3412ec1f00a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:54.378564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8594c4c-396c-4c50-a6bb-f3412ec1f00a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:54.379244 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8594c4c-396c-4c50-a6bb-f3412ec1f00a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:54.380203 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8594c4c-396c-4c50-a6bb-f3412ec1f00a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:54.380762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8594c4c-396c-4c50-a6bb-f3412ec1f00a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:54.381779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8594c4c-396c-4c50-a6bb-f3412ec1f00a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:54.450685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-66e4cab8-ba11-4038-8de8-07cc466ee2ae tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:54.451437 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-66e4cab8-ba11-4038-8de8-07cc466ee2ae tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:54.465432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-66e4cab8-ba11-4038-8de8-07cc466ee2ae tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:54.466988 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-66e4cab8-ba11-4038-8de8-07cc466ee2ae tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:54.467759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-66e4cab8-ba11-4038-8de8-07cc466ee2ae tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:54.468559 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-66e4cab8-ba11-4038-8de8-07cc466ee2ae tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:54.471028 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-66e4cab8-ba11-4038-8de8-07cc466ee2ae tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:54.474340 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-66e4cab8-ba11-4038-8de8-07cc466ee2ae tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:54.557585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d8594c4c-396c-4c50-a6bb-f3412ec1f00a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:54.567577 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d8594c4c-396c-4c50-a6bb-f3412ec1f00a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.202801 Oct 29 02:57:54.568921 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1406/2601] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:54 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:54.574100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a48306cb-240a-4fed-8006-f15f4c0ef4b9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff058043940>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:54.627240 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a48306cb-240a-4fed-8006-f15f4c0ef4b9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c" status: 200 len: 1410 microversion: 2.1 time: 0.055551 Oct 29 02:57:54.628443 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1407/2602] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:57:54 2022] GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c => generated 1410 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:54.634670 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c2d20213-d80f-41ca-a489-81093bcbabd8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:54.635581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c2d20213-d80f-41ca-a489-81093bcbabd8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:54.642915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=100 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:54.645456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c2d20213-d80f-41ca-a489-81093bcbabd8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:54.646190 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c2d20213-d80f-41ca-a489-81093bcbabd8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:54.646915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c2d20213-d80f-41ca-a489-81093bcbabd8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:54.648696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c2d20213-d80f-41ca-a489-81093bcbabd8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:54.649585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c2d20213-d80f-41ca-a489-81093bcbabd8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:54.649708 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c2d20213-d80f-41ca-a489-81093bcbabd8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:54.688853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-c2d20213-d80f-41ca-a489-81093bcbabd8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lazy-loading 'flavor' on Instance uuid 5d9854a1-ead6-4570-b801-13c47d0bf721 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:57:54.723818 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-66e4cab8-ba11-4038-8de8-07cc466ee2ae tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:54.737664 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-66e4cab8-ba11-4038-8de8-07cc466ee2ae tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1517 microversion: 2.1 time: 0.291806 Oct 29 02:57:54.746406 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1196/2603] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:54 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1517 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:54.979648 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c2d20213-d80f-41ca-a489-81093bcbabd8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action" status: 202 len: 0 microversion: 2.1 time: 0.349241 Oct 29 02:57:54.980274 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1408/2604] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:57:54 2022] POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:57:54.995018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d6aed6eb-80a4-416c-ac05-70e7dc96de15 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:54.995971 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d6aed6eb-80a4-416c-ac05-70e7dc96de15 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:55.007785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6aed6eb-80a4-416c-ac05-70e7dc96de15 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:55.008640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6aed6eb-80a4-416c-ac05-70e7dc96de15 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:55.013291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6aed6eb-80a4-416c-ac05-70e7dc96de15 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:55.014752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6aed6eb-80a4-416c-ac05-70e7dc96de15 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:55.020416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6aed6eb-80a4-416c-ac05-70e7dc96de15 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:55.021481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6aed6eb-80a4-416c-ac05-70e7dc96de15 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:55.112918 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7748e61d-72df-476e-ad5a-b73a8604ac3e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:55.113635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7748e61d-72df-476e-ad5a-b73a8604ac3e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] [instance: 7e11f28d-9567-4c2d-adb3-d52bb16b93b6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:55.124914 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7748e61d-72df-476e-ad5a-b73a8604ac3e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:55.125415 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7748e61d-72df-476e-ad5a-b73a8604ac3e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:55.125870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7748e61d-72df-476e-ad5a-b73a8604ac3e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:55.126573 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7748e61d-72df-476e-ad5a-b73a8604ac3e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:55.127029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7748e61d-72df-476e-ad5a-b73a8604ac3e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:55.127453 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7748e61d-72df-476e-ad5a-b73a8604ac3e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:55.174239 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-7748e61d-72df-476e-ad5a-b73a8604ac3e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] HTTP exception thrown: Instance 7e11f28d-9567-4c2d-adb3-d52bb16b93b6 could not be found. Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7748e61d-72df-476e-ad5a-b73a8604ac3e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Request method failure captured: Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6 HTTP/1.1 Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJZmVyB5hbJzrW4l5BcxJeTPhE4yQ3LcrvHWtwEy8IdFs6ADmAHFq85UVwijxifm2GCarn1F5gK11fDnijqR7zYGRKGKKAgMr6bfqN1MdbNYTtUNeEKs1dWVEeU-r2FAhV7Tm7p1IqTtxvE2GW5jb17PeLW5CaiTg-qmbbeoqtyMcyI Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: ed7f6396840c4aa6b4b7d4ee83503eac Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersTestManualDisk-1588155397 Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ed7f6396840c4aa6b4b7d4ee83503eac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ed7f6396840c4aa6b4b7d4ee83503eac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ed7f6396840c4aa6b4b7d4ee83503eac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ed7f6396840c4aa6b4b7d4ee83503eac"}]}] Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersTestManualDisk-1588155397 Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: ed7f6396840c4aa6b4b7d4ee83503eac Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersTestManualDisk-1588155397 Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersTestManualDisk-1588155397-project Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 136249f42e0e41cc9567b1b3be298574 Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersTestManualDisk-1588155397-project Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 7e11f28d-9567-4c2d-adb3-d52bb16b93b6 could not be found. Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '7e11f28d-9567-4c2d-adb3-d52bb16b93b6'} Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e11f28d-9567-4c2d-adb3-d52bb16b93b6 could not be found. Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e11f28d-9567-4c2d-adb3-d52bb16b93b6 could not be found. Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:57:55.175961 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:55.181476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:57:55.181476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:57:55.181476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:57:55.181476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:57:55.181476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:57:55.181476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e11f28d-9567-4c2d-adb3-d52bb16b93b6 could not be found. Oct 29 02:57:55.181476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:57:55.181476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7748e61d-72df-476e-ad5a-b73a8604ac3e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Returning 404 to user: Instance 7e11f28d-9567-4c2d-adb3-d52bb16b93b6 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:57:55.181476 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7748e61d-72df-476e-ad5a-b73a8604ac3e tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] 10.222.0.46 "GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6" status: 404 len: 111 microversion: 2.1 time: 0.070075 Oct 29 02:57:55.183815 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1409/2605] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:55 2022] GET /compute/v2.1/servers/7e11f28d-9567-4c2d-adb3-d52bb16b93b6 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:57:55.190237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5a189351-d212-4321-b58f-e3eea075f93b tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:55.190867 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5a189351-d212-4321-b58f-e3eea075f93b tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 347ef944-7c69-4650-be60-12e2070c38ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:55.198790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a189351-d212-4321-b58f-e3eea075f93b tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:55.199295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a189351-d212-4321-b58f-e3eea075f93b tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:55.199737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a189351-d212-4321-b58f-e3eea075f93b tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:55.200451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a189351-d212-4321-b58f-e3eea075f93b tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:55.201227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a189351-d212-4321-b58f-e3eea075f93b tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:55.201992 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a189351-d212-4321-b58f-e3eea075f93b tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:55.319705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d6aed6eb-80a4-416c-ac05-70e7dc96de15 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:55.330073 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d6aed6eb-80a4-416c-ac05-70e7dc96de15 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1511 microversion: 2.1 time: 0.343057 Oct 29 02:57:55.331390 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1197/2606] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:54 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1511 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:55.336666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-71772587-e819-4a95-882b-a7d9c99f3a7d tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] Calling method '.version_select at 0x7ff053e52430>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:55.369919 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-71772587-e819-4a95-882b-a7d9c99f3a7d tempest-ServersTestManualDisk-1588155397 tempest-ServersTestManualDisk-1588155397-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-510192172" status: 202 len: 0 microversion: 2.1 time: 0.037052 Oct 29 02:57:55.371323 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1198/2607] 10.222.0.46 () {58 vars in 1218 bytes} [Sat Oct 29 02:57:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-510192172 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:57:55.496438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5a189351-d212-4321-b58f-e3eea075f93b tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:55.511370 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5a189351-d212-4321-b58f-e3eea075f93b tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad" status: 200 len: 1503 microversion: 2.1 time: 0.326002 Oct 29 02:57:55.524668 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1410/2608] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:55 2022] GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad => generated 1503 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:55.646717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3f3d6f4b-fc84-42c0-8e84-9f8d28e2f0e8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053d9f040>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:55.746977 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3f3d6f4b-fc84-42c0-8e84-9f8d28e2f0e8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c" status: 200 len: 1410 microversion: 2.1 time: 0.107513 Oct 29 02:57:55.747552 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1199/2609] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:57:55 2022] GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c => generated 1410 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:55.764513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-abc867fc-30f8-4810-a72f-67b77172b3f5 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:55.766255 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-abc867fc-30f8-4810-a72f-67b77172b3f5 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:55.781766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abc867fc-30f8-4810-a72f-67b77172b3f5 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:55.784215 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abc867fc-30f8-4810-a72f-67b77172b3f5 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:55.785742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abc867fc-30f8-4810-a72f-67b77172b3f5 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:55.786996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abc867fc-30f8-4810-a72f-67b77172b3f5 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:55.788845 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abc867fc-30f8-4810-a72f-67b77172b3f5 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:55.789832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abc867fc-30f8-4810-a72f-67b77172b3f5 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:56.133551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-abc867fc-30f8-4810-a72f-67b77172b3f5 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:56.143047 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-abc867fc-30f8-4810-a72f-67b77172b3f5 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1517 microversion: 2.1 time: 0.384735 Oct 29 02:57:56.159259 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1411/2610] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:55 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1517 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:56.373986 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0dbe9202-e372-4d9c-93ac-01c1801c49bf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:56.374685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0dbe9202-e372-4d9c-93ac-01c1801c49bf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:56.388428 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0dbe9202-e372-4d9c-93ac-01c1801c49bf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:56.394178 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0dbe9202-e372-4d9c-93ac-01c1801c49bf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:56.394684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0dbe9202-e372-4d9c-93ac-01c1801c49bf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:56.395447 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0dbe9202-e372-4d9c-93ac-01c1801c49bf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:56.400291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0dbe9202-e372-4d9c-93ac-01c1801c49bf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:56.401928 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0dbe9202-e372-4d9c-93ac-01c1801c49bf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:56.614349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0dbe9202-e372-4d9c-93ac-01c1801c49bf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:56.629274 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0dbe9202-e372-4d9c-93ac-01c1801c49bf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1511 microversion: 2.1 time: 0.261348 Oct 29 02:57:56.630476 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1200/2611] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:56 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1511 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:56.764138 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-482e560a-6c8b-4712-b061-773d0530a271 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053cdbe50>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:56.840555 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-482e560a-6c8b-4712-b061-773d0530a271 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c" status: 200 len: 1410 microversion: 2.1 time: 0.080403 Oct 29 02:57:56.844571 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1412/2612] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:57:56 2022] GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c => generated 1410 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:57.169870 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-35e650f7-88c5-47c2-b992-dc89ce8d74ce tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:57.170947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-35e650f7-88c5-47c2-b992-dc89ce8d74ce tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:57.178350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35e650f7-88c5-47c2-b992-dc89ce8d74ce tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:57.179212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35e650f7-88c5-47c2-b992-dc89ce8d74ce tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:57.179848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35e650f7-88c5-47c2-b992-dc89ce8d74ce tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:57.180980 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35e650f7-88c5-47c2-b992-dc89ce8d74ce tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:57.181843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35e650f7-88c5-47c2-b992-dc89ce8d74ce tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:57.182472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35e650f7-88c5-47c2-b992-dc89ce8d74ce tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:57.451157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-35e650f7-88c5-47c2-b992-dc89ce8d74ce tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:57.470004 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-35e650f7-88c5-47c2-b992-dc89ce8d74ce tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1517 microversion: 2.1 time: 0.305835 Oct 29 02:57:57.470603 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1201/2613] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:57 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1517 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:57.662285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1045ee5d-6390-4dbe-b4eb-28b1bf18d7d2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:57.662899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1045ee5d-6390-4dbe-b4eb-28b1bf18d7d2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:57.670006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1045ee5d-6390-4dbe-b4eb-28b1bf18d7d2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:57.670522 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1045ee5d-6390-4dbe-b4eb-28b1bf18d7d2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:57.670920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1045ee5d-6390-4dbe-b4eb-28b1bf18d7d2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:57.671873 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1045ee5d-6390-4dbe-b4eb-28b1bf18d7d2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:57.672385 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1045ee5d-6390-4dbe-b4eb-28b1bf18d7d2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:57.673049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1045ee5d-6390-4dbe-b4eb-28b1bf18d7d2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:57.823242 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1045ee5d-6390-4dbe-b4eb-28b1bf18d7d2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:57.832482 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1045ee5d-6390-4dbe-b4eb-28b1bf18d7d2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1511 microversion: 2.1 time: 0.174001 Oct 29 02:57:57.834272 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1413/2614] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:57 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1511 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:57.860449 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ed52a02c-d7cc-4c34-b002-f1477ec485cc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff058906e50>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:57.920904 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ed52a02c-d7cc-4c34-b002-f1477ec485cc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c" status: 200 len: 1410 microversion: 2.1 time: 0.065281 Oct 29 02:57:57.933544 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1202/2615] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:57:57 2022] GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c => generated 1410 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:58.217366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bd5a6ce2-fcf9-488e-9921-2f4234977c33 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08b24639-5ebf-48bf-a358-abe240cf9e6a"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:57:58.219883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bd5a6ce2-fcf9-488e-9921-2f4234977c33 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 347ef944-7c69-4650-be60-12e2070c38ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:58.227105 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd5a6ce2-fcf9-488e-9921-2f4234977c33 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:58.228488 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd5a6ce2-fcf9-488e-9921-2f4234977c33 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:58.229894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd5a6ce2-fcf9-488e-9921-2f4234977c33 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:58.230878 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd5a6ce2-fcf9-488e-9921-2f4234977c33 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:58.231601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd5a6ce2-fcf9-488e-9921-2f4234977c33 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:58.232093 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd5a6ce2-fcf9-488e-9921-2f4234977c33 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:58.501376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3d40e153-f67e-4cd1-9e18-af8dc1c83756 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:58.502097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3d40e153-f67e-4cd1-9e18-af8dc1c83756 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:58.552841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d40e153-f67e-4cd1-9e18-af8dc1c83756 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:58.554034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d40e153-f67e-4cd1-9e18-af8dc1c83756 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:58.554759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d40e153-f67e-4cd1-9e18-af8dc1c83756 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:58.556735 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d40e153-f67e-4cd1-9e18-af8dc1c83756 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:58.558042 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d40e153-f67e-4cd1-9e18-af8dc1c83756 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:58.558863 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d40e153-f67e-4cd1-9e18-af8dc1c83756 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:58.737743 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bd5a6ce2-fcf9-488e-9921-2f4234977c33 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "POST /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.523550 Oct 29 02:57:58.740186 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1414/2616] 10.222.0.46 () {60 vars in 1323 bytes} [Sat Oct 29 02:57:58 2022] POST /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad/os-volume_attachments => generated 194 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:58.860552 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dc348af3-2a39-46f0-baaf-34b268813c29 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:58.861291 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dc348af3-2a39-46f0-baaf-34b268813c29 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:58.869525 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc348af3-2a39-46f0-baaf-34b268813c29 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:58.870979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc348af3-2a39-46f0-baaf-34b268813c29 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:58.871428 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc348af3-2a39-46f0-baaf-34b268813c29 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:58.872234 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc348af3-2a39-46f0-baaf-34b268813c29 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:58.872876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc348af3-2a39-46f0-baaf-34b268813c29 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:58.873454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc348af3-2a39-46f0-baaf-34b268813c29 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:58.876808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:58.885685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:58.904880 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3d40e153-f67e-4cd1-9e18-af8dc1c83756 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:58.917181 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3d40e153-f67e-4cd1-9e18-af8dc1c83756 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1517 microversion: 2.1 time: 0.421286 Oct 29 02:57:58.917771 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1203/2617] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:58 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1517 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:58.944480 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ae4b4965-00be-41e4-9478-cb6f07947124 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff0588fa670>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:58.980817 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:59.016338 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ae4b4965-00be-41e4-9478-cb6f07947124 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c" status: 200 len: 1410 microversion: 2.1 time: 0.077412 Oct 29 02:57:59.020310 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1204/2618] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:57:58 2022] GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c => generated 1410 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:57:59.079472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c52fbd54-7779-4d49-a3f0-f484954ee251 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:59.080373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c52fbd54-7779-4d49-a3f0-f484954ee251 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:59.094691 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c52fbd54-7779-4d49-a3f0-f484954ee251 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:59.097017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c52fbd54-7779-4d49-a3f0-f484954ee251 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:59.097902 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c52fbd54-7779-4d49-a3f0-f484954ee251 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:59.101201 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c52fbd54-7779-4d49-a3f0-f484954ee251 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:59.101842 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c52fbd54-7779-4d49-a3f0-f484954ee251 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:59.102569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c52fbd54-7779-4d49-a3f0-f484954ee251 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:59.110437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dc348af3-2a39-46f0-baaf-34b268813c29 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:57:59.122887 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dc348af3-2a39-46f0-baaf-34b268813c29 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1511 microversion: 2.1 time: 0.268244 Oct 29 02:57:59.136581 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1415/2619] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:58 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1511 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:59.391951 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c52fbd54-7779-4d49-a3f0-f484954ee251 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1813 microversion: 2.1 time: 0.316374 Oct 29 02:57:59.405657 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1205/2620] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:59 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1813 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:57:59.429263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-738ce072-05c5-4662-b5cd-6bd06732b5ab tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:59.433205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-738ce072-05c5-4662-b5cd-6bd06732b5ab tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:59.433697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-738ce072-05c5-4662-b5cd-6bd06732b5ab tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:59.434134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-738ce072-05c5-4662-b5cd-6bd06732b5ab tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:59.434870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-738ce072-05c5-4662-b5cd-6bd06732b5ab tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:59.435326 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-738ce072-05c5-4662-b5cd-6bd06732b5ab tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:59.435749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-738ce072-05c5-4662-b5cd-6bd06732b5ab tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:59.482112 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-738ce072-05c5-4662-b5cd-6bd06732b5ab tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.056532 Oct 29 02:57:59.499283 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1416/2621] 10.222.0.46 () {58 vars in 1176 bytes} [Sat Oct 29 02:57:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:57:59.948691 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-67901c4b-b208-4c50-8f6a-52747d16d262 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:57:59.950780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-67901c4b-b208-4c50-8f6a-52747d16d262 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:57:59.984067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67901c4b-b208-4c50-8f6a-52747d16d262 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:59.987792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67901c4b-b208-4c50-8f6a-52747d16d262 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:59.988657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67901c4b-b208-4c50-8f6a-52747d16d262 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:57:59.991268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67901c4b-b208-4c50-8f6a-52747d16d262 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:57:59.993115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67901c4b-b208-4c50-8f6a-52747d16d262 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:57:59.995568 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67901c4b-b208-4c50-8f6a-52747d16d262 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:00.041429 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-30a32a84-637b-41c2-a345-db8a547aceca tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053e02160>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:00.163902 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-30a32a84-637b-41c2-a345-db8a547aceca tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c" status: 200 len: 1410 microversion: 2.1 time: 0.128421 Oct 29 02:58:00.173002 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1417/2622] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:58:00 2022] GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c => generated 1410 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:00.193496 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-154f88ce-617c-4d13-b973-8d54e075ac4f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:00.194932 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-154f88ce-617c-4d13-b973-8d54e075ac4f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:00.216144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-154f88ce-617c-4d13-b973-8d54e075ac4f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:00.221532 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-154f88ce-617c-4d13-b973-8d54e075ac4f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:00.230343 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-154f88ce-617c-4d13-b973-8d54e075ac4f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:00.235578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-154f88ce-617c-4d13-b973-8d54e075ac4f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:00.238568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-154f88ce-617c-4d13-b973-8d54e075ac4f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:00.238568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-154f88ce-617c-4d13-b973-8d54e075ac4f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:00.523413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-67901c4b-b208-4c50-8f6a-52747d16d262 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:00.540239 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-67901c4b-b208-4c50-8f6a-52747d16d262 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1517 microversion: 2.1 time: 0.597436 Oct 29 02:58:00.540877 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1206/2623] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:57:59 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1517 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:00.770875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-154f88ce-617c-4d13-b973-8d54e075ac4f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:00.791895 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-154f88ce-617c-4d13-b973-8d54e075ac4f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1511 microversion: 2.1 time: 0.617482 Oct 29 02:58:00.799173 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1418/2624] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:00 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1511 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:01.188543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-92681c20-674e-4517-8d8f-abefe9e89480 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053d4aee0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:01.317621 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-92681c20-674e-4517-8d8f-abefe9e89480 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c" status: 200 len: 1410 microversion: 2.1 time: 0.131263 Oct 29 02:58:01.343032 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1207/2625] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:58:01 2022] GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c => generated 1410 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:01.570121 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-37c39f86-f1b0-4e33-b96c-05383e51002d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:01.570831 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-37c39f86-f1b0-4e33-b96c-05383e51002d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:01.595463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37c39f86-f1b0-4e33-b96c-05383e51002d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:01.595964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37c39f86-f1b0-4e33-b96c-05383e51002d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:01.596406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37c39f86-f1b0-4e33-b96c-05383e51002d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:01.597201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37c39f86-f1b0-4e33-b96c-05383e51002d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:01.597858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37c39f86-f1b0-4e33-b96c-05383e51002d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:01.598481 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37c39f86-f1b0-4e33-b96c-05383e51002d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:01.818657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0fbb7325-7dce-46ad-b554-97ff97ace0ff tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:01.819541 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0fbb7325-7dce-46ad-b554-97ff97ace0ff tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:01.829525 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-37c39f86-f1b0-4e33-b96c-05383e51002d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:01.835035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fbb7325-7dce-46ad-b554-97ff97ace0ff tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:01.836699 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fbb7325-7dce-46ad-b554-97ff97ace0ff tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:01.838098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fbb7325-7dce-46ad-b554-97ff97ace0ff tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:01.840145 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fbb7325-7dce-46ad-b554-97ff97ace0ff tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:01.840646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fbb7325-7dce-46ad-b554-97ff97ace0ff tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:01.841076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fbb7325-7dce-46ad-b554-97ff97ace0ff tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:01.841847 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-37c39f86-f1b0-4e33-b96c-05383e51002d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1517 microversion: 2.1 time: 0.275409 Oct 29 02:58:01.843277 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1419/2626] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:01 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1517 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:02.117694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0fbb7325-7dce-46ad-b554-97ff97ace0ff tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:02.136073 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0fbb7325-7dce-46ad-b554-97ff97ace0ff tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1511 microversion: 2.1 time: 0.323872 Oct 29 02:58:02.153314 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1208/2627] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:01 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1511 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:02.340811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-83685fc4-6e15-4d30-be54-4613dec465f8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff058043310>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:02.436393 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-83685fc4-6e15-4d30-be54-4613dec465f8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c" status: 200 len: 1410 microversion: 2.1 time: 0.092880 Oct 29 02:58:02.437419 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1420/2628] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:58:02 2022] GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c => generated 1410 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:02.740643 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0906e37d-e6b7-4708-9a2c-d271c1a233f6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "662a9e72-3728-431e-8534-864b20b652d3", "device": "/dev/xvdb"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:02.746412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0906e37d-e6b7-4708-9a2c-d271c1a233f6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:02.816933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0906e37d-e6b7-4708-9a2c-d271c1a233f6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:02.817379 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0906e37d-e6b7-4708-9a2c-d271c1a233f6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:02.823769 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0906e37d-e6b7-4708-9a2c-d271c1a233f6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:02.825852 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0906e37d-e6b7-4708-9a2c-d271c1a233f6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:02.829478 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0906e37d-e6b7-4708-9a2c-d271c1a233f6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:02.830177 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0906e37d-e6b7-4708-9a2c-d271c1a233f6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:02.878431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ee1bc2df-56a7-4501-a76b-e57b5c9f72c0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:02.879836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ee1bc2df-56a7-4501-a76b-e57b5c9f72c0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:02.893300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee1bc2df-56a7-4501-a76b-e57b5c9f72c0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:02.894758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee1bc2df-56a7-4501-a76b-e57b5c9f72c0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:02.897316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee1bc2df-56a7-4501-a76b-e57b5c9f72c0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:02.899449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee1bc2df-56a7-4501-a76b-e57b5c9f72c0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:02.901885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee1bc2df-56a7-4501-a76b-e57b5c9f72c0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:02.905952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee1bc2df-56a7-4501-a76b-e57b5c9f72c0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:03.213340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ee1bc2df-56a7-4501-a76b-e57b5c9f72c0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:03.237352 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ee1bc2df-56a7-4501-a76b-e57b5c9f72c0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1517 microversion: 2.1 time: 0.363673 Oct 29 02:58:03.239803 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1421/2629] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:02 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1517 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:03.249391 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-181f7144-71fe-4513-8acf-a0c34d1b79fd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:03.251766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-181f7144-71fe-4513-8acf-a0c34d1b79fd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:03.262576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-181f7144-71fe-4513-8acf-a0c34d1b79fd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:03.263637 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-181f7144-71fe-4513-8acf-a0c34d1b79fd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:03.264672 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-181f7144-71fe-4513-8acf-a0c34d1b79fd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:03.266015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-181f7144-71fe-4513-8acf-a0c34d1b79fd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:03.266626 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-181f7144-71fe-4513-8acf-a0c34d1b79fd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:03.267214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-181f7144-71fe-4513-8acf-a0c34d1b79fd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:03.346471 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0906e37d-e6b7-4708-9a2c-d271c1a233f6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "POST /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.609285 Oct 29 02:58:03.348705 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1209/2630] 10.222.0.46 () {60 vars in 1323 bytes} [Sat Oct 29 02:58:02 2022] POST /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e/os-volume_attachments => generated 194 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:58:03.465291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-50482f0d-fd4b-4c83-a56f-1c4280a96165 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053e054c0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:03.557901 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-50482f0d-fd4b-4c83-a56f-1c4280a96165 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c" status: 200 len: 1410 microversion: 2.1 time: 0.093212 Oct 29 02:58:03.558806 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1210/2631] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:58:03 2022] GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c => generated 1410 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:03.634191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-181f7144-71fe-4513-8acf-a0c34d1b79fd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:03.647518 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-181f7144-71fe-4513-8acf-a0c34d1b79fd tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1511 microversion: 2.1 time: 0.406103 Oct 29 02:58:03.648684 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1422/2632] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:03 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1511 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:04.263651 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9ccb6b23-3067-40eb-9987-2f39dd81a68d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:04.264429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9ccb6b23-3067-40eb-9987-2f39dd81a68d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:04.286713 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ccb6b23-3067-40eb-9987-2f39dd81a68d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:04.287214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ccb6b23-3067-40eb-9987-2f39dd81a68d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:04.287649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ccb6b23-3067-40eb-9987-2f39dd81a68d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:04.288374 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ccb6b23-3067-40eb-9987-2f39dd81a68d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:04.288851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ccb6b23-3067-40eb-9987-2f39dd81a68d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:04.289280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ccb6b23-3067-40eb-9987-2f39dd81a68d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:04.311434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:04.551446 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9ccb6b23-3067-40eb-9987-2f39dd81a68d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:04.566340 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9ccb6b23-3067-40eb-9987-2f39dd81a68d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1517 microversion: 2.1 time: 0.306092 Oct 29 02:58:04.580140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9b19b865-e7ad-418b-ad8f-e9e648c8f12c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053f84940>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:04.586250 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1211/2633] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:04 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1517 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:04.651726 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9b19b865-e7ad-418b-ad8f-e9e648c8f12c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c" status: 200 len: 1410 microversion: 2.1 time: 0.076012 Oct 29 02:58:04.652326 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1423/2634] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:58:04 2022] GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c => generated 1410 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:04.672398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5c9efce8-f42a-4b34-9458-9da08cd9943e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:04.678060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5c9efce8-f42a-4b34-9458-9da08cd9943e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:04.691529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c9efce8-f42a-4b34-9458-9da08cd9943e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:04.692023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c9efce8-f42a-4b34-9458-9da08cd9943e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:04.692453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c9efce8-f42a-4b34-9458-9da08cd9943e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:04.696906 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c9efce8-f42a-4b34-9458-9da08cd9943e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:04.699024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c9efce8-f42a-4b34-9458-9da08cd9943e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:04.699618 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c9efce8-f42a-4b34-9458-9da08cd9943e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:04.973124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5c9efce8-f42a-4b34-9458-9da08cd9943e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:04.983332 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5c9efce8-f42a-4b34-9458-9da08cd9943e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1511 microversion: 2.1 time: 0.315743 Oct 29 02:58:04.997014 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1212/2635] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:04 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1511 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:05.597690 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dd7fc104-ef4d-4f93-ae97-8c860355940d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:05.599265 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dd7fc104-ef4d-4f93-ae97-8c860355940d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:05.609410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd7fc104-ef4d-4f93-ae97-8c860355940d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:05.611348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd7fc104-ef4d-4f93-ae97-8c860355940d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:05.613189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd7fc104-ef4d-4f93-ae97-8c860355940d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:05.616361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd7fc104-ef4d-4f93-ae97-8c860355940d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:05.621351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd7fc104-ef4d-4f93-ae97-8c860355940d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:05.624601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd7fc104-ef4d-4f93-ae97-8c860355940d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:05.669085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-04280bcc-c9bd-41da-92bc-98a39763e8f0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053ed3700>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:05.747067 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-04280bcc-c9bd-41da-92bc-98a39763e8f0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c" status: 200 len: 1410 microversion: 2.1 time: 0.083202 Oct 29 02:58:05.747976 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1213/2636] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:58:05 2022] GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c => generated 1410 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:05.949518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dd7fc104-ef4d-4f93-ae97-8c860355940d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:05.970446 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dd7fc104-ef4d-4f93-ae97-8c860355940d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1517 microversion: 2.1 time: 0.376805 Oct 29 02:58:05.971988 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1424/2637] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:05 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1517 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:06.015539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fe35a24a-2ecc-4e07-b856-3a93ced0cfb0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:06.021566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fe35a24a-2ecc-4e07-b856-3a93ced0cfb0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:06.042449 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fe35a24a-2ecc-4e07-b856-3a93ced0cfb0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:06.043442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fe35a24a-2ecc-4e07-b856-3a93ced0cfb0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:06.044029 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fe35a24a-2ecc-4e07-b856-3a93ced0cfb0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:06.045024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fe35a24a-2ecc-4e07-b856-3a93ced0cfb0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:06.052039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fe35a24a-2ecc-4e07-b856-3a93ced0cfb0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:06.054855 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fe35a24a-2ecc-4e07-b856-3a93ced0cfb0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:06.337270 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fe35a24a-2ecc-4e07-b856-3a93ced0cfb0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:06.345444 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fe35a24a-2ecc-4e07-b856-3a93ced0cfb0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1511 microversion: 2.1 time: 0.340330 Oct 29 02:58:06.364441 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1214/2638] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:06 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1511 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:06.767121 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-34094f19-c005-46ed-ad89-5cc0bc1897c3 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053f849d0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:06.843021 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-34094f19-c005-46ed-ad89-5cc0bc1897c3 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c" status: 200 len: 1419 microversion: 2.1 time: 0.081461 Oct 29 02:58:06.856230 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1425/2639] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:58:06 2022] GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c => generated 1419 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:06.861838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3abdd9fc-d627-4060-8b90-bb052fc6517c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053e05940>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:06.930613 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3abdd9fc-d627-4060-8b90-bb052fc6517c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c" status: 200 len: 1419 microversion: 2.1 time: 0.072592 Oct 29 02:58:06.932161 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1215/2640] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:58:06 2022] GET /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c => generated 1419 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:06.950519 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4c3469bf-b3be-48b5-bab1-237698bdd8c3 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff058043040>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:06.993936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fb2fd409-7ac4-48b5-944b-d26a42818e9a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:06.994571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fb2fd409-7ac4-48b5-944b-d26a42818e9a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:07.003317 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb2fd409-7ac4-48b5-944b-d26a42818e9a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:07.005956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb2fd409-7ac4-48b5-944b-d26a42818e9a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:07.006422 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb2fd409-7ac4-48b5-944b-d26a42818e9a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:07.007168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb2fd409-7ac4-48b5-944b-d26a42818e9a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:07.007633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb2fd409-7ac4-48b5-944b-d26a42818e9a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:07.008066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb2fd409-7ac4-48b5-944b-d26a42818e9a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:07.315639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fb2fd409-7ac4-48b5-944b-d26a42818e9a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:07.325331 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fb2fd409-7ac4-48b5-944b-d26a42818e9a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1517 microversion: 2.1 time: 0.336503 Oct 29 02:58:07.329114 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1216/2641] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:06 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1517 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:07.373303 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-10d5609f-c3f1-4412-986b-3ccb24c968d8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:07.374897 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-10d5609f-c3f1-4412-986b-3ccb24c968d8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:07.391817 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-10d5609f-c3f1-4412-986b-3ccb24c968d8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:07.396232 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-10d5609f-c3f1-4412-986b-3ccb24c968d8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:07.396978 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-10d5609f-c3f1-4412-986b-3ccb24c968d8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:07.397912 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-10d5609f-c3f1-4412-986b-3ccb24c968d8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:07.399579 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-10d5609f-c3f1-4412-986b-3ccb24c968d8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:07.402817 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-10d5609f-c3f1-4412-986b-3ccb24c968d8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:07.734500 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-10d5609f-c3f1-4412-986b-3ccb24c968d8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:07.763978 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-10d5609f-c3f1-4412-986b-3ccb24c968d8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1511 microversion: 2.1 time: 0.395863 Oct 29 02:58:07.767687 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1217/2642] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:07 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1511 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:07.872661 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4c3469bf-b3be-48b5-bab1-237698bdd8c3 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "DELETE /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c" status: 204 len: 0 microversion: 2.1 time: 0.928587 Oct 29 02:58:07.873813 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1426/2643] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:06 2022] DELETE /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c => generated 0 bytes in 930 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:58:07.882377 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8a19eb36-3746-4755-a343-de489e166529 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:07.884332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8a19eb36-3746-4755-a343-de489e166529 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:07.895273 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a19eb36-3746-4755-a343-de489e166529 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:07.896302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a19eb36-3746-4755-a343-de489e166529 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:07.896971 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a19eb36-3746-4755-a343-de489e166529 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:07.898182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a19eb36-3746-4755-a343-de489e166529 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:07.899334 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a19eb36-3746-4755-a343-de489e166529 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:07.900163 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a19eb36-3746-4755-a343-de489e166529 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:07.937377 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8a19eb36-3746-4755-a343-de489e166529 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:58:08.099818 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8a19eb36-3746-4755-a343-de489e166529 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8" status: 204 len: 0 microversion: 2.1 time: 0.222239 Oct 29 02:58:08.102431 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1218/2644] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:58:07 2022] DELETE /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:58:08.271633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-138d8175-3f2c-43be-a4c3-5428fe06b463 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1886536757", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "18fc4cb9-056a-42e1-bd8a-e4a27cb291b2"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:08.363342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dfae2127-d907-42f2-9880-eb634311d7f5 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:08.366214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dfae2127-d907-42f2-9880-eb634311d7f5 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:08.374094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dfae2127-d907-42f2-9880-eb634311d7f5 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:08.374950 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dfae2127-d907-42f2-9880-eb634311d7f5 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:08.375363 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-138d8175-3f2c-43be-a4c3-5428fe06b463 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] validate_networks() for [('18fc4cb9-056a-42e1-bd8a-e4a27cb291b2', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:58:08.375778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dfae2127-d907-42f2-9880-eb634311d7f5 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:08.376677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dfae2127-d907-42f2-9880-eb634311d7f5 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:08.377283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dfae2127-d907-42f2-9880-eb634311d7f5 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:08.377855 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dfae2127-d907-42f2-9880-eb634311d7f5 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:08.664058 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dfae2127-d907-42f2-9880-eb634311d7f5 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:08.676104 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dfae2127-d907-42f2-9880-eb634311d7f5 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1517 microversion: 2.1 time: 0.323873 Oct 29 02:58:08.685551 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1219/2645] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:08 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1517 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:08.816108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-34f774c4-fbba-40b3-ae04-bcd098c27f74 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:08.817219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-34f774c4-fbba-40b3-ae04-bcd098c27f74 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:08.830769 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34f774c4-fbba-40b3-ae04-bcd098c27f74 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:08.833602 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34f774c4-fbba-40b3-ae04-bcd098c27f74 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:08.835835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34f774c4-fbba-40b3-ae04-bcd098c27f74 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:08.838071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34f774c4-fbba-40b3-ae04-bcd098c27f74 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:08.838801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34f774c4-fbba-40b3-ae04-bcd098c27f74 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:08.840943 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34f774c4-fbba-40b3-ae04-bcd098c27f74 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:08.973733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-138d8175-3f2c-43be-a4c3-5428fe06b463 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:58:08.974310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-138d8175-3f2c-43be-a4c3-5428fe06b463 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:58:08.974826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-138d8175-3f2c-43be-a4c3-5428fe06b463 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:58:08.975420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-138d8175-3f2c-43be-a4c3-5428fe06b463 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:58:08.975857 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-138d8175-3f2c-43be-a4c3-5428fe06b463 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:58:08.988634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-138d8175-3f2c-43be-a4c3-5428fe06b463 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:08.989463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-138d8175-3f2c-43be-a4c3-5428fe06b463 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:08.990277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-138d8175-3f2c-43be-a4c3-5428fe06b463 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:08.991981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-138d8175-3f2c-43be-a4c3-5428fe06b463 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:08.992698 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-138d8175-3f2c-43be-a4c3-5428fe06b463 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:08.993455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-138d8175-3f2c-43be-a4c3-5428fe06b463 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:09.025693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-138d8175-3f2c-43be-a4c3-5428fe06b463 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Getting quotas for project 185d32c10dd845768f4ff70a85680358. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:58:09.033089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-138d8175-3f2c-43be-a4c3-5428fe06b463 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Getting quotas for user c866f273672846eb8d7f4f2a00269666 and project 185d32c10dd845768f4ff70a85680358. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:58:09.052608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-138d8175-3f2c-43be-a4c3-5428fe06b463 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:58:09.081238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-138d8175-3f2c-43be-a4c3-5428fe06b463 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:58:09.166202 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-138d8175-3f2c-43be-a4c3-5428fe06b463 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.901567 Oct 29 02:58:09.168289 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1427/2646] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:58:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:58:09.188222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fbce2d59-ccdc-496e-b7fc-4ac73b1b8b70 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:09.189572 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fbce2d59-ccdc-496e-b7fc-4ac73b1b8b70 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:09.230250 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-34f774c4-fbba-40b3-ae04-bcd098c27f74 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:09.245718 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-34f774c4-fbba-40b3-ae04-bcd098c27f74 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1511 microversion: 2.1 time: 0.438294 Oct 29 02:58:09.251422 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1220/2647] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:08 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1511 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:09.272663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fbce2d59-ccdc-496e-b7fc-4ac73b1b8b70 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:09.288189 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fbce2d59-ccdc-496e-b7fc-4ac73b1b8b70 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6" status: 200 len: 1208 microversion: 2.1 time: 0.107297 Oct 29 02:58:09.288913 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1428/2648] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:09 2022] GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 => generated 1208 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:09.715255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0d6f2ff7-edc1-4f67-a0f6-58d37e6bab21 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:09.716068 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0d6f2ff7-edc1-4f67-a0f6-58d37e6bab21 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:09.736563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0d6f2ff7-edc1-4f67-a0f6-58d37e6bab21 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:09.737321 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0d6f2ff7-edc1-4f67-a0f6-58d37e6bab21 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:09.737961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0d6f2ff7-edc1-4f67-a0f6-58d37e6bab21 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:09.739968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0d6f2ff7-edc1-4f67-a0f6-58d37e6bab21 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:09.741240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0d6f2ff7-edc1-4f67-a0f6-58d37e6bab21 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:09.742101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0d6f2ff7-edc1-4f67-a0f6-58d37e6bab21 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:10.161110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0d6f2ff7-edc1-4f67-a0f6-58d37e6bab21 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:10.171185 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0d6f2ff7-edc1-4f67-a0f6-58d37e6bab21 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1517 microversion: 2.1 time: 0.462571 Oct 29 02:58:10.172209 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1221/2649] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:09 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1517 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:10.292204 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6eeddd5c-984b-43f0-9d65-4c0fedbefd03 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:10.292881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6eeddd5c-984b-43f0-9d65-4c0fedbefd03 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:10.303845 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6eeddd5c-984b-43f0-9d65-4c0fedbefd03 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:10.315308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5fb1c4cd-0776-460a-a2f0-3df9a9a6fcdc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:10.317149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5fb1c4cd-0776-460a-a2f0-3df9a9a6fcdc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:10.324388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6eeddd5c-984b-43f0-9d65-4c0fedbefd03 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:10.324747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6eeddd5c-984b-43f0-9d65-4c0fedbefd03 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:10.331575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5fb1c4cd-0776-460a-a2f0-3df9a9a6fcdc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:10.332081 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5fb1c4cd-0776-460a-a2f0-3df9a9a6fcdc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:10.332536 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5fb1c4cd-0776-460a-a2f0-3df9a9a6fcdc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:10.333266 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5fb1c4cd-0776-460a-a2f0-3df9a9a6fcdc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:10.333724 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5fb1c4cd-0776-460a-a2f0-3df9a9a6fcdc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:10.334147 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5fb1c4cd-0776-460a-a2f0-3df9a9a6fcdc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:10.335036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6eeddd5c-984b-43f0-9d65-4c0fedbefd03 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:10.337955 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6eeddd5c-984b-43f0-9d65-4c0fedbefd03 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:10.342018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6eeddd5c-984b-43f0-9d65-4c0fedbefd03 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:10.576167 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5fb1c4cd-0776-460a-a2f0-3df9a9a6fcdc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:10.591096 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5fb1c4cd-0776-460a-a2f0-3df9a9a6fcdc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6" status: 200 len: 1204 microversion: 2.1 time: 0.282480 Oct 29 02:58:10.592011 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1222/2650] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:10 2022] GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 => generated 1204 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:10.842988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6eeddd5c-984b-43f0-9d65-4c0fedbefd03 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:10.856172 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6eeddd5c-984b-43f0-9d65-4c0fedbefd03 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1511 microversion: 2.1 time: 0.568269 Oct 29 02:58:10.880637 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1429/2651] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:10 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1511 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:11.168372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-8c428d2d-a439-42b4-9a0b-d153c6a4469b req-fccb3b9f-bed3-4e3f-b05d-ed4a7f4f7ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8", "name": "network-vif-deleted", "tag": "88edf650-ce03-4e6a-b15e-07fe64065f45"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:11.202089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-122cfafd-5d9b-4525-b3ed-ebafd4f64571 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:11.210784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-122cfafd-5d9b-4525-b3ed-ebafd4f64571 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:11.213502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8c428d2d-a439-42b4-9a0b-d153c6a4469b req-fccb3b9f-bed3-4e3f-b05d-ed4a7f4f7ade service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:11.219215 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8c428d2d-a439-42b4-9a0b-d153c6a4469b req-fccb3b9f-bed3-4e3f-b05d-ed4a7f4f7ade service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:11.222419 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8c428d2d-a439-42b4-9a0b-d153c6a4469b req-fccb3b9f-bed3-4e3f-b05d-ed4a7f4f7ade service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:11.227223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-122cfafd-5d9b-4525-b3ed-ebafd4f64571 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:11.233363 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-122cfafd-5d9b-4525-b3ed-ebafd4f64571 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:11.235564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-122cfafd-5d9b-4525-b3ed-ebafd4f64571 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:11.236687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-122cfafd-5d9b-4525-b3ed-ebafd4f64571 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:11.238601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-122cfafd-5d9b-4525-b3ed-ebafd4f64571 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:11.245798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-122cfafd-5d9b-4525-b3ed-ebafd4f64571 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:11.282192 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-8c428d2d-a439-42b4-9a0b-d153c6a4469b req-fccb3b9f-bed3-4e3f-b05d-ed4a7f4f7ade service nova] Creating event network-vif-deleted:88edf650-ce03-4e6a-b15e-07fe64065f45 for instance f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 on n-h2-862967-2 Oct 29 02:58:11.324453 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-8c428d2d-a439-42b4-9a0b-d153c6a4469b req-fccb3b9f-bed3-4e3f-b05d-ed4a7f4f7ade service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161477 Oct 29 02:58:11.331308 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1223/2652] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 02:58:11.573742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-122cfafd-5d9b-4525-b3ed-ebafd4f64571 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:11.590241 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-122cfafd-5d9b-4525-b3ed-ebafd4f64571 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1517 microversion: 2.1 time: 0.393482 Oct 29 02:58:11.601370 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1430/2653] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:11 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1517 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:11.625622 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1e830150-7cf6-4767-bf3f-a4babcad835c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:11.627763 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1e830150-7cf6-4767-bf3f-a4babcad835c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:11.639185 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e830150-7cf6-4767-bf3f-a4babcad835c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:11.640358 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e830150-7cf6-4767-bf3f-a4babcad835c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:11.641318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e830150-7cf6-4767-bf3f-a4babcad835c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:11.642511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e830150-7cf6-4767-bf3f-a4babcad835c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:11.643513 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e830150-7cf6-4767-bf3f-a4babcad835c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:11.644193 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1e830150-7cf6-4767-bf3f-a4babcad835c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:11.795816 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1e830150-7cf6-4767-bf3f-a4babcad835c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:11.819781 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1e830150-7cf6-4767-bf3f-a4babcad835c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6" status: 200 len: 1266 microversion: 2.1 time: 0.200706 Oct 29 02:58:11.824942 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1224/2654] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:11 2022] GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:11.896951 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8cf83662-208e-4130-b623-554fa9daadaa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:11.901195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8cf83662-208e-4130-b623-554fa9daadaa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:11.912858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8cf83662-208e-4130-b623-554fa9daadaa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:11.914022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8cf83662-208e-4130-b623-554fa9daadaa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:11.914927 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8cf83662-208e-4130-b623-554fa9daadaa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:11.916818 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8cf83662-208e-4130-b623-554fa9daadaa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:11.918207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8cf83662-208e-4130-b623-554fa9daadaa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:11.919046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8cf83662-208e-4130-b623-554fa9daadaa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:12.222251 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8cf83662-208e-4130-b623-554fa9daadaa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:12.253959 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8cf83662-208e-4130-b623-554fa9daadaa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1511 microversion: 2.1 time: 0.368873 Oct 29 02:58:12.262104 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1431/2655] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:11 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1511 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:12.627392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d26028fa-0b71-412d-89c8-55ebe022946d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:12.629204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d26028fa-0b71-412d-89c8-55ebe022946d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:12.656928 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d26028fa-0b71-412d-89c8-55ebe022946d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:12.657667 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d26028fa-0b71-412d-89c8-55ebe022946d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:12.658321 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d26028fa-0b71-412d-89c8-55ebe022946d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:12.660570 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d26028fa-0b71-412d-89c8-55ebe022946d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:12.661276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d26028fa-0b71-412d-89c8-55ebe022946d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:12.661911 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d26028fa-0b71-412d-89c8-55ebe022946d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:12.848647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-07e6c9c1-d390-4d81-b616-acb5e9c70a70 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:12.849875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-07e6c9c1-d390-4d81-b616-acb5e9c70a70 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:12.857342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07e6c9c1-d390-4d81-b616-acb5e9c70a70 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:12.858056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07e6c9c1-d390-4d81-b616-acb5e9c70a70 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:12.858684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07e6c9c1-d390-4d81-b616-acb5e9c70a70 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:12.859543 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07e6c9c1-d390-4d81-b616-acb5e9c70a70 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:12.860181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07e6c9c1-d390-4d81-b616-acb5e9c70a70 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:12.861087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07e6c9c1-d390-4d81-b616-acb5e9c70a70 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:12.969822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-07e6c9c1-d390-4d81-b616-acb5e9c70a70 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:12.982327 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-07e6c9c1-d390-4d81-b616-acb5e9c70a70 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6" status: 200 len: 1266 microversion: 2.1 time: 0.137622 Oct 29 02:58:12.983578 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1432/2656] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:12 2022] GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:13.011256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d26028fa-0b71-412d-89c8-55ebe022946d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:13.024232 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d26028fa-0b71-412d-89c8-55ebe022946d tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1517 microversion: 2.1 time: 0.400607 Oct 29 02:58:13.032190 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1225/2657] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:12 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1517 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:13.302978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1ae11e27-8ee5-4f1c-bcc9-541d9d7be02c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:13.304342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1ae11e27-8ee5-4f1c-bcc9-541d9d7be02c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:13.320828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ae11e27-8ee5-4f1c-bcc9-541d9d7be02c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:13.321692 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ae11e27-8ee5-4f1c-bcc9-541d9d7be02c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:13.322458 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ae11e27-8ee5-4f1c-bcc9-541d9d7be02c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:13.340895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ae11e27-8ee5-4f1c-bcc9-541d9d7be02c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:13.342196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ae11e27-8ee5-4f1c-bcc9-541d9d7be02c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:13.343708 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ae11e27-8ee5-4f1c-bcc9-541d9d7be02c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:13.663260 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1ae11e27-8ee5-4f1c-bcc9-541d9d7be02c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:13.682162 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1ae11e27-8ee5-4f1c-bcc9-541d9d7be02c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1511 microversion: 2.1 time: 0.383389 Oct 29 02:58:13.689165 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1433/2658] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:13 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1511 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:14.016754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-11997698-4d5b-4066-97a6-89da34851f58 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:14.018807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-11997698-4d5b-4066-97a6-89da34851f58 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:14.030100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11997698-4d5b-4066-97a6-89da34851f58 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:14.030595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11997698-4d5b-4066-97a6-89da34851f58 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:14.031027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11997698-4d5b-4066-97a6-89da34851f58 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:14.031732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11997698-4d5b-4066-97a6-89da34851f58 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:14.032175 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11997698-4d5b-4066-97a6-89da34851f58 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:14.032623 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11997698-4d5b-4066-97a6-89da34851f58 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:14.059397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a54a4bbb-1136-41a9-954f-aeee2ca6cea3 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:14.060009 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a54a4bbb-1136-41a9-954f-aeee2ca6cea3 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:14.067269 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a54a4bbb-1136-41a9-954f-aeee2ca6cea3 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:14.067747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a54a4bbb-1136-41a9-954f-aeee2ca6cea3 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:14.068173 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a54a4bbb-1136-41a9-954f-aeee2ca6cea3 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:14.069078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a54a4bbb-1136-41a9-954f-aeee2ca6cea3 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:14.069527 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a54a4bbb-1136-41a9-954f-aeee2ca6cea3 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:14.069944 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a54a4bbb-1136-41a9-954f-aeee2ca6cea3 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:14.246300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a54a4bbb-1136-41a9-954f-aeee2ca6cea3 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:14.257758 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a54a4bbb-1136-41a9-954f-aeee2ca6cea3 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1517 microversion: 2.1 time: 0.202100 Oct 29 02:58:14.259532 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1434/2659] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:14 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1517 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:14.304204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-11997698-4d5b-4066-97a6-89da34851f58 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:14.317738 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-11997698-4d5b-4066-97a6-89da34851f58 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6" status: 200 len: 1308 microversion: 2.1 time: 0.310559 Oct 29 02:58:14.319882 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1226/2660] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:14 2022] GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 => generated 1308 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:14.721009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-8bd9376d-2eaf-4fe9-afb5-e8575d85fe54 req-81ee5622-d442-4982-975e-d76f109de012 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b7f1dd5-af84-416c-84a6-e7a0a67294e6", "tag": "6f3a9167-1c0e-4d88-92ba-1c4e6bd37758"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:14.721266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2a6dbb40-78a6-4142-a97d-65ebb8963258 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:14.721872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2a6dbb40-78a6-4142-a97d-65ebb8963258 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:14.735268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8bd9376d-2eaf-4fe9-afb5-e8575d85fe54 req-81ee5622-d442-4982-975e-d76f109de012 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:14.736016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8bd9376d-2eaf-4fe9-afb5-e8575d85fe54 req-81ee5622-d442-4982-975e-d76f109de012 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:14.736725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8bd9376d-2eaf-4fe9-afb5-e8575d85fe54 req-81ee5622-d442-4982-975e-d76f109de012 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:14.744452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2a6dbb40-78a6-4142-a97d-65ebb8963258 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:14.744982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2a6dbb40-78a6-4142-a97d-65ebb8963258 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:14.745430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2a6dbb40-78a6-4142-a97d-65ebb8963258 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:14.746154 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2a6dbb40-78a6-4142-a97d-65ebb8963258 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:14.752193 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-8bd9376d-2eaf-4fe9-afb5-e8575d85fe54 req-81ee5622-d442-4982-975e-d76f109de012 service nova] Creating event network-changed:6f3a9167-1c0e-4d88-92ba-1c4e6bd37758 for instance 7b7f1dd5-af84-416c-84a6-e7a0a67294e6 on n-h1-862967-2 Oct 29 02:58:14.759349 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-8bd9376d-2eaf-4fe9-afb5-e8575d85fe54 req-81ee5622-d442-4982-975e-d76f109de012 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050042 Oct 29 02:58:14.760696 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1227/2661] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:58:14.764675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2a6dbb40-78a6-4142-a97d-65ebb8963258 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:14.766309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2a6dbb40-78a6-4142-a97d-65ebb8963258 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:15.062626 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2a6dbb40-78a6-4142-a97d-65ebb8963258 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:15.080427 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2a6dbb40-78a6-4142-a97d-65ebb8963258 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1511 microversion: 2.1 time: 0.370424 Oct 29 02:58:15.081266 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1435/2662] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:14 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1511 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:15.285434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-650b81a0-a8d0-4bae-825f-c85a4e54153f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:15.286567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-650b81a0-a8d0-4bae-825f-c85a4e54153f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:15.293594 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-650b81a0-a8d0-4bae-825f-c85a4e54153f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:15.294188 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-650b81a0-a8d0-4bae-825f-c85a4e54153f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:15.294835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-650b81a0-a8d0-4bae-825f-c85a4e54153f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:15.295544 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-650b81a0-a8d0-4bae-825f-c85a4e54153f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:15.296153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-650b81a0-a8d0-4bae-825f-c85a4e54153f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:15.296767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-650b81a0-a8d0-4bae-825f-c85a4e54153f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:15.346656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ab07bdd8-fafa-434b-8c02-a40df698811b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:15.348035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ab07bdd8-fafa-434b-8c02-a40df698811b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:15.358930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ab07bdd8-fafa-434b-8c02-a40df698811b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:15.359677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ab07bdd8-fafa-434b-8c02-a40df698811b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:15.360417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ab07bdd8-fafa-434b-8c02-a40df698811b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:15.361372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ab07bdd8-fafa-434b-8c02-a40df698811b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:15.362113 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ab07bdd8-fafa-434b-8c02-a40df698811b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:15.362731 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ab07bdd8-fafa-434b-8c02-a40df698811b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:15.570909 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ab07bdd8-fafa-434b-8c02-a40df698811b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:15.580330 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ab07bdd8-fafa-434b-8c02-a40df698811b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6" status: 200 len: 1308 microversion: 2.1 time: 0.241678 Oct 29 02:58:15.581799 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1436/2663] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:15 2022] GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 => generated 1308 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:15.622717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-650b81a0-a8d0-4bae-825f-c85a4e54153f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:15.633211 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-650b81a0-a8d0-4bae-825f-c85a4e54153f tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1523 microversion: 2.1 time: 0.353900 Oct 29 02:58:15.634817 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1228/2664] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:15 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1523 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:16.103859 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a68dd404-3cac-4f7a-8f55-7919e1fa6bcb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:16.105368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a68dd404-3cac-4f7a-8f55-7919e1fa6bcb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:16.119335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a68dd404-3cac-4f7a-8f55-7919e1fa6bcb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:16.121589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a68dd404-3cac-4f7a-8f55-7919e1fa6bcb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:16.123194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a68dd404-3cac-4f7a-8f55-7919e1fa6bcb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:16.124277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a68dd404-3cac-4f7a-8f55-7919e1fa6bcb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:16.126325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a68dd404-3cac-4f7a-8f55-7919e1fa6bcb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:16.127402 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a68dd404-3cac-4f7a-8f55-7919e1fa6bcb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:16.353150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a68dd404-3cac-4f7a-8f55-7919e1fa6bcb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:16.365579 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a68dd404-3cac-4f7a-8f55-7919e1fa6bcb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1532 microversion: 2.1 time: 0.265960 Oct 29 02:58:16.367289 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1437/2665] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:16 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1532 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:16.604177 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1a833c51-54f0-4e5d-b6fa-9d607d94f43f tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:16.604995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1a833c51-54f0-4e5d-b6fa-9d607d94f43f tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:16.612245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a833c51-54f0-4e5d-b6fa-9d607d94f43f tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:16.613155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a833c51-54f0-4e5d-b6fa-9d607d94f43f tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:16.613837 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a833c51-54f0-4e5d-b6fa-9d607d94f43f tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:16.614776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a833c51-54f0-4e5d-b6fa-9d607d94f43f tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:16.615444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a833c51-54f0-4e5d-b6fa-9d607d94f43f tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:16.616310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a833c51-54f0-4e5d-b6fa-9d607d94f43f tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:16.657095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4bd53f65-893a-496b-a4bb-7f8de2524b98 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:16.657996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4bd53f65-893a-496b-a4bb-7f8de2524b98 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:16.667971 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bd53f65-893a-496b-a4bb-7f8de2524b98 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:16.668791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bd53f65-893a-496b-a4bb-7f8de2524b98 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:16.669430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bd53f65-893a-496b-a4bb-7f8de2524b98 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:16.670383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bd53f65-893a-496b-a4bb-7f8de2524b98 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:16.671042 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bd53f65-893a-496b-a4bb-7f8de2524b98 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:16.671700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bd53f65-893a-496b-a4bb-7f8de2524b98 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:16.981641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4bd53f65-893a-496b-a4bb-7f8de2524b98 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:16.994546 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4bd53f65-893a-496b-a4bb-7f8de2524b98 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1523 microversion: 2.1 time: 0.341394 Oct 29 02:58:16.995860 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1438/2666] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:16 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1523 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:17.073573 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1a833c51-54f0-4e5d-b6fa-9d607d94f43f tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:17.076075 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:17.084441 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1a833c51-54f0-4e5d-b6fa-9d607d94f43f tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6" status: 200 len: 1308 microversion: 2.1 time: 0.484952 Oct 29 02:58:17.108685 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1229/2667] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:16 2022] GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 => generated 1308 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:17.391697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f50e3cf7-dbb9-483d-a39c-91a34b3ff02c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:17.392338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f50e3cf7-dbb9-483d-a39c-91a34b3ff02c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:17.400936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f50e3cf7-dbb9-483d-a39c-91a34b3ff02c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:17.401779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f50e3cf7-dbb9-483d-a39c-91a34b3ff02c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:17.402449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f50e3cf7-dbb9-483d-a39c-91a34b3ff02c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:17.403449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f50e3cf7-dbb9-483d-a39c-91a34b3ff02c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:17.404128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f50e3cf7-dbb9-483d-a39c-91a34b3ff02c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:17.404868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f50e3cf7-dbb9-483d-a39c-91a34b3ff02c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:17.409343 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=100 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:17.612470 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f50e3cf7-dbb9-483d-a39c-91a34b3ff02c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:17.624170 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f50e3cf7-dbb9-483d-a39c-91a34b3ff02c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1532 microversion: 2.1 time: 0.237537 Oct 29 02:58:17.625561 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1439/2668] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:17 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1532 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:18.025204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d95ff8ae-2061-43b0-b0ce-ae6cb26ed804 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:18.026474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d95ff8ae-2061-43b0-b0ce-ae6cb26ed804 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:18.035412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d95ff8ae-2061-43b0-b0ce-ae6cb26ed804 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:18.036252 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d95ff8ae-2061-43b0-b0ce-ae6cb26ed804 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:18.036883 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d95ff8ae-2061-43b0-b0ce-ae6cb26ed804 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:18.038614 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d95ff8ae-2061-43b0-b0ce-ae6cb26ed804 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:18.039587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d95ff8ae-2061-43b0-b0ce-ae6cb26ed804 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:18.040665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d95ff8ae-2061-43b0-b0ce-ae6cb26ed804 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:18.111357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-374964ac-bd62-4907-8147-22046c57f352 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:18.111985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-374964ac-bd62-4907-8147-22046c57f352 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:18.120867 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-374964ac-bd62-4907-8147-22046c57f352 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:18.122449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-374964ac-bd62-4907-8147-22046c57f352 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:18.123246 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-374964ac-bd62-4907-8147-22046c57f352 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:18.124139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-374964ac-bd62-4907-8147-22046c57f352 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:18.124811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-374964ac-bd62-4907-8147-22046c57f352 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:18.125417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-374964ac-bd62-4907-8147-22046c57f352 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:18.373369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-374964ac-bd62-4907-8147-22046c57f352 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:18.384721 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-374964ac-bd62-4907-8147-22046c57f352 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6" status: 200 len: 1308 microversion: 2.1 time: 0.277165 Oct 29 02:58:18.389367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d95ff8ae-2061-43b0-b0ce-ae6cb26ed804 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:18.398164 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d95ff8ae-2061-43b0-b0ce-ae6cb26ed804 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1523 microversion: 2.1 time: 0.378653 Oct 29 02:58:18.399193 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1230/2669] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:18 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1523 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:18.421215 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-36d03ee0-9049-419b-b608-29bdf247732f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:18.422055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-36d03ee0-9049-419b-b608-29bdf247732f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 347ef944-7c69-4650-be60-12e2070c38ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:18.423894 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1440/2670] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:18 2022] GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 => generated 1308 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:18.429469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36d03ee0-9049-419b-b608-29bdf247732f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:18.430519 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36d03ee0-9049-419b-b608-29bdf247732f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:18.431168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36d03ee0-9049-419b-b608-29bdf247732f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:18.432143 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36d03ee0-9049-419b-b608-29bdf247732f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:18.432857 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36d03ee0-9049-419b-b608-29bdf247732f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:18.433633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36d03ee0-9049-419b-b608-29bdf247732f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:18.436443 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-4ba074a7-41dc-40c7-9ddd-1452719cd328 req-634df14c-f6b7-4c42-9e9a-2f3a0ab7ca1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d981d040-d96a-40a5-a893-033a9d51e368", "name": "network-vif-plugged", "status": "completed", "tag": "d421fc9b-5ae4-42e7-a9d1-182d4fc1ec78"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:18.452863 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4ba074a7-41dc-40c7-9ddd-1452719cd328 req-634df14c-f6b7-4c42-9e9a-2f3a0ab7ca1e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:18.454946 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4ba074a7-41dc-40c7-9ddd-1452719cd328 req-634df14c-f6b7-4c42-9e9a-2f3a0ab7ca1e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:18.455596 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4ba074a7-41dc-40c7-9ddd-1452719cd328 req-634df14c-f6b7-4c42-9e9a-2f3a0ab7ca1e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:18.474498 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-36d03ee0-9049-419b-b608-29bdf247732f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 347ef944-7c69-4650-be60-12e2070c38ad] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:58:18.474857 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-4ba074a7-41dc-40c7-9ddd-1452719cd328 req-634df14c-f6b7-4c42-9e9a-2f3a0ab7ca1e service nova] Creating event network-vif-plugged:d421fc9b-5ae4-42e7-a9d1-182d4fc1ec78 for instance d981d040-d96a-40a5-a893-033a9d51e368 on n-h2-862967-2 Oct 29 02:58:18.485472 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-4ba074a7-41dc-40c7-9ddd-1452719cd328 req-634df14c-f6b7-4c42-9e9a-2f3a0ab7ca1e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056721 Oct 29 02:58:18.486411 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1441/2671] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:58:18.601678 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-36d03ee0-9049-419b-b608-29bdf247732f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "DELETE /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad" status: 204 len: 0 microversion: 2.1 time: 0.187123 Oct 29 02:58:18.602558 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1231/2672] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:58:18 2022] DELETE /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:58:18.630147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6cdde825-ec56-44dd-97e8-c415ef234b53 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:18.633119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6cdde825-ec56-44dd-97e8-c415ef234b53 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 347ef944-7c69-4650-be60-12e2070c38ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:18.641611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cdde825-ec56-44dd-97e8-c415ef234b53 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:18.642119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cdde825-ec56-44dd-97e8-c415ef234b53 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:18.642550 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cdde825-ec56-44dd-97e8-c415ef234b53 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:18.647394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cdde825-ec56-44dd-97e8-c415ef234b53 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:18.648326 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cdde825-ec56-44dd-97e8-c415ef234b53 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:18.651270 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cdde825-ec56-44dd-97e8-c415ef234b53 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:18.657003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f953a43e-34e7-46e1-9fec-a96ebb5dba5c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:18.657856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f953a43e-34e7-46e1-9fec-a96ebb5dba5c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:18.670133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:18.672037 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f953a43e-34e7-46e1-9fec-a96ebb5dba5c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:18.672827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f953a43e-34e7-46e1-9fec-a96ebb5dba5c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:18.673482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f953a43e-34e7-46e1-9fec-a96ebb5dba5c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:18.675331 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f953a43e-34e7-46e1-9fec-a96ebb5dba5c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:18.677542 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f953a43e-34e7-46e1-9fec-a96ebb5dba5c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:18.678079 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f953a43e-34e7-46e1-9fec-a96ebb5dba5c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:19.006041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:19.093827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f953a43e-34e7-46e1-9fec-a96ebb5dba5c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:19.105282 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f953a43e-34e7-46e1-9fec-a96ebb5dba5c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1532 microversion: 2.1 time: 0.454058 Oct 29 02:58:19.106307 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1232/2673] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:18 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1532 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:19.287959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=8 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:19.386975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6cdde825-ec56-44dd-97e8-c415ef234b53 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:19.402714 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6cdde825-ec56-44dd-97e8-c415ef234b53 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad" status: 200 len: 1555 microversion: 2.1 time: 0.789824 Oct 29 02:58:19.403533 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1442/2674] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:18 2022] GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad => generated 1555 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:19.426438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-42fe519f-9199-4014-bedc-f17f69564e9a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:19.427331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-42fe519f-9199-4014-bedc-f17f69564e9a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:19.447103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-42fe519f-9199-4014-bedc-f17f69564e9a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:19.447606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-42fe519f-9199-4014-bedc-f17f69564e9a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:19.448051 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-42fe519f-9199-4014-bedc-f17f69564e9a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:19.448858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-42fe519f-9199-4014-bedc-f17f69564e9a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:19.449315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-42fe519f-9199-4014-bedc-f17f69564e9a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:19.449738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-42fe519f-9199-4014-bedc-f17f69564e9a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:19.688013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-42fe519f-9199-4014-bedc-f17f69564e9a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:19.698372 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-42fe519f-9199-4014-bedc-f17f69564e9a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1523 microversion: 2.1 time: 0.278460 Oct 29 02:58:19.716378 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1443/2675] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:19 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1523 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:19.721540 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5f237518-26bd-4e6b-a87a-a122a8cabcbc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:19.722653 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5f237518-26bd-4e6b-a87a-a122a8cabcbc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:19.729573 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f237518-26bd-4e6b-a87a-a122a8cabcbc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:19.730317 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f237518-26bd-4e6b-a87a-a122a8cabcbc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:19.731015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f237518-26bd-4e6b-a87a-a122a8cabcbc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:19.731986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f237518-26bd-4e6b-a87a-a122a8cabcbc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:19.732640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f237518-26bd-4e6b-a87a-a122a8cabcbc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:19.733218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f237518-26bd-4e6b-a87a-a122a8cabcbc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:19.807931 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bd048aea-0fb4-42ec-abed-163348631649 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:19.808744 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bd048aea-0fb4-42ec-abed-163348631649 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:19.826122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd048aea-0fb4-42ec-abed-163348631649 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:19.827137 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd048aea-0fb4-42ec-abed-163348631649 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:19.827787 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd048aea-0fb4-42ec-abed-163348631649 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:19.828918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd048aea-0fb4-42ec-abed-163348631649 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:19.829650 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd048aea-0fb4-42ec-abed-163348631649 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:19.830274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd048aea-0fb4-42ec-abed-163348631649 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:19.865397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bd048aea-0fb4-42ec-abed-163348631649 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:58:19.951934 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5f237518-26bd-4e6b-a87a-a122a8cabcbc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:19.963922 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5f237518-26bd-4e6b-a87a-a122a8cabcbc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6" status: 200 len: 1308 microversion: 2.1 time: 0.246084 Oct 29 02:58:19.964546 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1444/2676] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:19 2022] GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 => generated 1308 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:20.014743 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bd048aea-0fb4-42ec-abed-163348631649 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 204 len: 0 microversion: 2.42 time: 0.771545 Oct 29 02:58:20.016430 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1233/2677] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Oct 29 02:58:19 2022] DELETE /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 0 bytes in 774 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 29 02:58:20.025019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6e641cae-ff70-4a79-8066-404cf60b4b70 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:20.025643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6e641cae-ff70-4a79-8066-404cf60b4b70 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:20.031755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e641cae-ff70-4a79-8066-404cf60b4b70 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:20.032244 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e641cae-ff70-4a79-8066-404cf60b4b70 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:20.032930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e641cae-ff70-4a79-8066-404cf60b4b70 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:20.033657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e641cae-ff70-4a79-8066-404cf60b4b70 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:20.034107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e641cae-ff70-4a79-8066-404cf60b4b70 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:20.034709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e641cae-ff70-4a79-8066-404cf60b4b70 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:20.131653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4a9f8c58-7f57-473f-9ec8-1052ef79cd23 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:20.133087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4a9f8c58-7f57-473f-9ec8-1052ef79cd23 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:20.141190 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a9f8c58-7f57-473f-9ec8-1052ef79cd23 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:20.141942 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a9f8c58-7f57-473f-9ec8-1052ef79cd23 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:20.142573 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a9f8c58-7f57-473f-9ec8-1052ef79cd23 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:20.143599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a9f8c58-7f57-473f-9ec8-1052ef79cd23 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:20.144209 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a9f8c58-7f57-473f-9ec8-1052ef79cd23 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:20.144829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a9f8c58-7f57-473f-9ec8-1052ef79cd23 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:20.288468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6e641cae-ff70-4a79-8066-404cf60b4b70 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:20.308057 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6e641cae-ff70-4a79-8066-404cf60b4b70 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:20.310534 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6e641cae-ff70-4a79-8066-404cf60b4b70 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:20.311255 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6e641cae-ff70-4a79-8066-404cf60b4b70 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 2959 microversion: 2.42 time: 0.290398 Oct 29 02:58:20.312051 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1445/2678] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:20 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 2959 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:58:20.415353 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4a9f8c58-7f57-473f-9ec8-1052ef79cd23 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:20.427868 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4a9f8c58-7f57-473f-9ec8-1052ef79cd23 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1532 microversion: 2.1 time: 0.300471 Oct 29 02:58:20.428970 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1234/2679] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:20 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1532 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:20.430045 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-36adfddf-27f1-45d1-bce5-952a0751c648 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:20.431343 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-36adfddf-27f1-45d1-bce5-952a0751c648 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 347ef944-7c69-4650-be60-12e2070c38ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:20.440193 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36adfddf-27f1-45d1-bce5-952a0751c648 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:20.440972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36adfddf-27f1-45d1-bce5-952a0751c648 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:20.441866 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36adfddf-27f1-45d1-bce5-952a0751c648 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:20.443308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36adfddf-27f1-45d1-bce5-952a0751c648 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:20.444050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36adfddf-27f1-45d1-bce5-952a0751c648 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:20.444956 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36adfddf-27f1-45d1-bce5-952a0751c648 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:20.653063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-36adfddf-27f1-45d1-bce5-952a0751c648 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:20.664019 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-36adfddf-27f1-45d1-bce5-952a0751c648 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad" status: 200 len: 1555 microversion: 2.1 time: 0.238490 Oct 29 02:58:20.665990 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1446/2680] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:20 2022] GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad => generated 1555 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:20.736762 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f9acfe1d-39ca-48e5-8286-caf1db30571c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:20.739776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f9acfe1d-39ca-48e5-8286-caf1db30571c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:20.755354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9acfe1d-39ca-48e5-8286-caf1db30571c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:20.756398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9acfe1d-39ca-48e5-8286-caf1db30571c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:20.757651 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9acfe1d-39ca-48e5-8286-caf1db30571c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:20.761108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9acfe1d-39ca-48e5-8286-caf1db30571c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:20.764868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9acfe1d-39ca-48e5-8286-caf1db30571c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:20.766300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9acfe1d-39ca-48e5-8286-caf1db30571c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:21.010538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e02258bf-25e4-407e-9794-ec5d947b0562 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:21.012200 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e02258bf-25e4-407e-9794-ec5d947b0562 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:21.029839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e02258bf-25e4-407e-9794-ec5d947b0562 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:21.031292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e02258bf-25e4-407e-9794-ec5d947b0562 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:21.032640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e02258bf-25e4-407e-9794-ec5d947b0562 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:21.037271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e02258bf-25e4-407e-9794-ec5d947b0562 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:21.045454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e02258bf-25e4-407e-9794-ec5d947b0562 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:21.046189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e02258bf-25e4-407e-9794-ec5d947b0562 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:21.100818 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f9acfe1d-39ca-48e5-8286-caf1db30571c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:21.128911 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f9acfe1d-39ca-48e5-8286-caf1db30571c tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1523 microversion: 2.1 time: 0.407778 Oct 29 02:58:21.135041 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1235/2681] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:20 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1523 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:21.340567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-05cd16cb-ad76-4e85-bc3c-5bbf872bbd5e tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:21.341284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-05cd16cb-ad76-4e85-bc3c-5bbf872bbd5e tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:21.349999 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e02258bf-25e4-407e-9794-ec5d947b0562 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:21.353904 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05cd16cb-ad76-4e85-bc3c-5bbf872bbd5e tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:21.355861 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05cd16cb-ad76-4e85-bc3c-5bbf872bbd5e tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:21.357249 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05cd16cb-ad76-4e85-bc3c-5bbf872bbd5e tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:21.359800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05cd16cb-ad76-4e85-bc3c-5bbf872bbd5e tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:21.360360 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05cd16cb-ad76-4e85-bc3c-5bbf872bbd5e tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:21.361721 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05cd16cb-ad76-4e85-bc3c-5bbf872bbd5e tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:21.364349 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e02258bf-25e4-407e-9794-ec5d947b0562 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6" status: 200 len: 1308 microversion: 2.1 time: 0.368005 Oct 29 02:58:21.380366 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1447/2682] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:20 2022] GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 => generated 1308 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:21.451500 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6edc5485-872d-494a-b5b6-deee9c847f4c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:21.453079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6edc5485-872d-494a-b5b6-deee9c847f4c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:21.466247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6edc5485-872d-494a-b5b6-deee9c847f4c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:21.472942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6edc5485-872d-494a-b5b6-deee9c847f4c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:21.474507 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6edc5485-872d-494a-b5b6-deee9c847f4c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:21.475770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6edc5485-872d-494a-b5b6-deee9c847f4c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:21.476480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6edc5485-872d-494a-b5b6-deee9c847f4c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:21.477325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6edc5485-872d-494a-b5b6-deee9c847f4c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:21.766559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6edc5485-872d-494a-b5b6-deee9c847f4c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:21.778287 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6edc5485-872d-494a-b5b6-deee9c847f4c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1527 microversion: 2.1 time: 0.330762 Oct 29 02:58:21.779854 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1448/2683] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:21 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1527 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:21.785097 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-429eab53-6f01-43bb-8507-f46b4584be97 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:21.785951 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-429eab53-6f01-43bb-8507-f46b4584be97 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:21.796081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-429eab53-6f01-43bb-8507-f46b4584be97 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:21.796775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-429eab53-6f01-43bb-8507-f46b4584be97 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:21.797414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-429eab53-6f01-43bb-8507-f46b4584be97 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:21.798348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-429eab53-6f01-43bb-8507-f46b4584be97 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:21.799016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-429eab53-6f01-43bb-8507-f46b4584be97 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:21.799644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-429eab53-6f01-43bb-8507-f46b4584be97 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:21.956958 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-429eab53-6f01-43bb-8507-f46b4584be97 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1859 microversion: 2.1 time: 0.175643 Oct 29 02:58:21.958305 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1449/2684] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:21 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1859 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:21.963696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4934fc9e-d7c6-40bc-a25f-625cb3426d08 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:21.964365 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-05cd16cb-ad76-4e85-bc3c-5bbf872bbd5e tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:21.964954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4934fc9e-d7c6-40bc-a25f-625cb3426d08 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 347ef944-7c69-4650-be60-12e2070c38ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:21.973212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4934fc9e-d7c6-40bc-a25f-625cb3426d08 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:21.974009 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4934fc9e-d7c6-40bc-a25f-625cb3426d08 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:21.974676 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4934fc9e-d7c6-40bc-a25f-625cb3426d08 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:21.975588 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4934fc9e-d7c6-40bc-a25f-625cb3426d08 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:21.976262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4934fc9e-d7c6-40bc-a25f-625cb3426d08 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:21.977067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4934fc9e-d7c6-40bc-a25f-625cb3426d08 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:21.984482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-05cd16cb-ad76-4e85-bc3c-5bbf872bbd5e tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:21.985939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-05cd16cb-ad76-4e85-bc3c-5bbf872bbd5e tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:21.987221 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-05cd16cb-ad76-4e85-bc3c-5bbf872bbd5e tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 2959 microversion: 2.42 time: 0.650895 Oct 29 02:58:21.988292 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1236/2685] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:21 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 2959 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:58:21.996235 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-70207f0f-f401-4c92-85b4-f9c61d5cf54e tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862967-2", "block_migration": true, "disk_over_commit": false}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:21.999231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-70207f0f-f401-4c92-85b4-f9c61d5cf54e tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:22.022612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70207f0f-f401-4c92-85b4-f9c61d5cf54e tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:22.023108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70207f0f-f401-4c92-85b4-f9c61d5cf54e tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:22.023566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70207f0f-f401-4c92-85b4-f9c61d5cf54e tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:22.024455 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70207f0f-f401-4c92-85b4-f9c61d5cf54e tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:22.025137 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70207f0f-f401-4c92-85b4-f9c61d5cf54e tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:22.025708 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70207f0f-f401-4c92-85b4-f9c61d5cf54e tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:22.189876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4934fc9e-d7c6-40bc-a25f-625cb3426d08 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:22.203667 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4934fc9e-d7c6-40bc-a25f-625cb3426d08 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad" status: 200 len: 1555 microversion: 2.1 time: 0.243982 Oct 29 02:58:22.204989 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1450/2686] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:21 2022] GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad => generated 1555 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:22.217817 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3897a66e-24e1-4ba3-aba7-e6127f16dbe4 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:22.218790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3897a66e-24e1-4ba3-aba7-e6127f16dbe4 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:22.234125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3897a66e-24e1-4ba3-aba7-e6127f16dbe4 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:22.235023 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3897a66e-24e1-4ba3-aba7-e6127f16dbe4 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:22.235654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3897a66e-24e1-4ba3-aba7-e6127f16dbe4 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:22.236627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3897a66e-24e1-4ba3-aba7-e6127f16dbe4 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:22.237354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3897a66e-24e1-4ba3-aba7-e6127f16dbe4 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:22.238165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3897a66e-24e1-4ba3-aba7-e6127f16dbe4 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:22.501588 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-70207f0f-f401-4c92-85b4-f9c61d5cf54e tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lazy-loading 'flavor' on Instance uuid b40f7b3b-04d4-4cfa-8058-09afc05d791e {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:58:22.585420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-70207f0f-f401-4c92-85b4-f9c61d5cf54e tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Going to try to live migrate instance to n-h2-862967-2 {{(pid=127125) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 02:58:22.847697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3897a66e-24e1-4ba3-aba7-e6127f16dbe4 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:22.859560 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3897a66e-24e1-4ba3-aba7-e6127f16dbe4 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1523 microversion: 2.1 time: 0.653053 Oct 29 02:58:22.860160 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1451/2687] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:22 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1523 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:22.875589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3eeba80a-4d32-41a4-9925-46077b4e5481 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:22.876693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3eeba80a-4d32-41a4-9925-46077b4e5481 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:22.891997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3eeba80a-4d32-41a4-9925-46077b4e5481 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:22.893343 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3eeba80a-4d32-41a4-9925-46077b4e5481 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:22.894233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3eeba80a-4d32-41a4-9925-46077b4e5481 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:22.896726 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3eeba80a-4d32-41a4-9925-46077b4e5481 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:22.897364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3eeba80a-4d32-41a4-9925-46077b4e5481 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:22.899183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3eeba80a-4d32-41a4-9925-46077b4e5481 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:23.514387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3eeba80a-4d32-41a4-9925-46077b4e5481 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:23.558934 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3eeba80a-4d32-41a4-9925-46077b4e5481 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6" status: 200 len: 1308 microversion: 2.1 time: 0.690857 Oct 29 02:58:23.571231 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1452/2688] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:22 2022] GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 => generated 1308 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:23.594685 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-0b214f5d-862a-4f4d-8f67-3165a40bab51 req-71152aa4-0bb3-4dbc-a3f8-621a1ab407fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "347ef944-7c69-4650-be60-12e2070c38ad", "name": "network-vif-deleted", "tag": "2b3fba4f-dbe3-40df-ad6e-4fc1f8b07185"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:23.630626 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-0b214f5d-862a-4f4d-8f67-3165a40bab51 req-71152aa4-0bb3-4dbc-a3f8-621a1ab407fb service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:23.637692 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-0b214f5d-862a-4f4d-8f67-3165a40bab51 req-71152aa4-0bb3-4dbc-a3f8-621a1ab407fb service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:23.639170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-0b214f5d-862a-4f4d-8f67-3165a40bab51 req-71152aa4-0bb3-4dbc-a3f8-621a1ab407fb service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:23.721839 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-0b214f5d-862a-4f4d-8f67-3165a40bab51 req-71152aa4-0bb3-4dbc-a3f8-621a1ab407fb service nova] Creating event network-vif-deleted:2b3fba4f-dbe3-40df-ad6e-4fc1f8b07185 for instance 347ef944-7c69-4650-be60-12e2070c38ad on n-h1-862967-2 Oct 29 02:58:23.751861 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-0b214f5d-862a-4f4d-8f67-3165a40bab51 req-71152aa4-0bb3-4dbc-a3f8-621a1ab407fb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170596 Oct 29 02:58:23.758904 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1453/2689] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:58:23.808562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-70b0e987-1fe1-4e9f-8c89-56e8f23c98fb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:23.816853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-70b0e987-1fe1-4e9f-8c89-56e8f23c98fb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:23.859057 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70b0e987-1fe1-4e9f-8c89-56e8f23c98fb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:23.859811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70b0e987-1fe1-4e9f-8c89-56e8f23c98fb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:23.860349 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70b0e987-1fe1-4e9f-8c89-56e8f23c98fb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:23.861639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70b0e987-1fe1-4e9f-8c89-56e8f23c98fb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:23.869087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70b0e987-1fe1-4e9f-8c89-56e8f23c98fb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:23.869596 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70b0e987-1fe1-4e9f-8c89-56e8f23c98fb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:24.469284 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-70b0e987-1fe1-4e9f-8c89-56e8f23c98fb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:24.495773 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-70b0e987-1fe1-4e9f-8c89-56e8f23c98fb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1527 microversion: 2.1 time: 0.733675 Oct 29 02:58:24.498675 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1454/2690] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:23 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1527 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:24.515269 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-453b5f41-6285-421d-bba6-3d5bdb223c45 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:24.521978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-453b5f41-6285-421d-bba6-3d5bdb223c45 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:24.540346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:24.544851 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-453b5f41-6285-421d-bba6-3d5bdb223c45 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:24.547365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-453b5f41-6285-421d-bba6-3d5bdb223c45 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:24.551442 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-453b5f41-6285-421d-bba6-3d5bdb223c45 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:24.554538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-453b5f41-6285-421d-bba6-3d5bdb223c45 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:24.555417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-453b5f41-6285-421d-bba6-3d5bdb223c45 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:24.556123 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-453b5f41-6285-421d-bba6-3d5bdb223c45 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:25.462467 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-453b5f41-6285-421d-bba6-3d5bdb223c45 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:25.505891 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-453b5f41-6285-421d-bba6-3d5bdb223c45 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:25.517917 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-453b5f41-6285-421d-bba6-3d5bdb223c45 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:25.519748 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-453b5f41-6285-421d-bba6-3d5bdb223c45 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 2959 microversion: 2.42 time: 1.019146 Oct 29 02:58:25.528069 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1455/2691] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:24 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 2959 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:25.537582 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-73d7496c-835c-4a48-9064-22d5c59978b4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:25.540055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-73d7496c-835c-4a48-9064-22d5c59978b4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 347ef944-7c69-4650-be60-12e2070c38ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:25.586500 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73d7496c-835c-4a48-9064-22d5c59978b4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:25.591195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73d7496c-835c-4a48-9064-22d5c59978b4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:25.593653 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73d7496c-835c-4a48-9064-22d5c59978b4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:25.597301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73d7496c-835c-4a48-9064-22d5c59978b4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:25.602430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73d7496c-835c-4a48-9064-22d5c59978b4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:25.606939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73d7496c-835c-4a48-9064-22d5c59978b4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:25.818543 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-73d7496c-835c-4a48-9064-22d5c59978b4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:25.830461 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-73d7496c-835c-4a48-9064-22d5c59978b4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad" status: 200 len: 1346 microversion: 2.1 time: 0.300717 Oct 29 02:58:25.861083 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1456/2692] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:25 2022] GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad => generated 1346 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:25.861083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a19582fb-b898-49c8-b4cb-f890ebd44726 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:25.861083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a19582fb-b898-49c8-b4cb-f890ebd44726 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:25.873515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a19582fb-b898-49c8-b4cb-f890ebd44726 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:25.878450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a19582fb-b898-49c8-b4cb-f890ebd44726 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:25.879110 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a19582fb-b898-49c8-b4cb-f890ebd44726 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:25.879967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a19582fb-b898-49c8-b4cb-f890ebd44726 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:25.880740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a19582fb-b898-49c8-b4cb-f890ebd44726 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:25.881170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a19582fb-b898-49c8-b4cb-f890ebd44726 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:25.893156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=100 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:26.408438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a19582fb-b898-49c8-b4cb-f890ebd44726 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:26.431351 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a19582fb-b898-49c8-b4cb-f890ebd44726 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1508 microversion: 2.1 time: 0.585375 Oct 29 02:58:26.431959 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1457/2693] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:25 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1508 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:26.436840 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-3dd32f24-b09a-4dcb-a285-7d643d64f2b7 req-b4376c69-e720-4ca7-88ad-1bae3af2e152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d9854a1-ead6-4570-b801-13c47d0bf721", "name": "network-vif-plugged", "status": "completed", "tag": "5c797ecc-c991-49d4-a9d6-68c2398ef486"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:26.471977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3dd32f24-b09a-4dcb-a285-7d643d64f2b7 req-b4376c69-e720-4ca7-88ad-1bae3af2e152 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:26.472690 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3dd32f24-b09a-4dcb-a285-7d643d64f2b7 req-b4376c69-e720-4ca7-88ad-1bae3af2e152 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:26.472690 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3dd32f24-b09a-4dcb-a285-7d643d64f2b7 req-b4376c69-e720-4ca7-88ad-1bae3af2e152 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:26.519388 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-3dd32f24-b09a-4dcb-a285-7d643d64f2b7 req-b4376c69-e720-4ca7-88ad-1bae3af2e152 service nova] Creating event network-vif-plugged:5c797ecc-c991-49d4-a9d6-68c2398ef486 for instance 5d9854a1-ead6-4570-b801-13c47d0bf721 on n-h1-862967-2 Oct 29 02:58:26.543771 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-3dd32f24-b09a-4dcb-a285-7d643d64f2b7 req-b4376c69-e720-4ca7-88ad-1bae3af2e152 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110337 Oct 29 02:58:26.548066 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1458/2694] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:58:26.570606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a14ea396-7f79-4263-aa01-658febd60e3e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:26.571457 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a14ea396-7f79-4263-aa01-658febd60e3e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:26.589000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a14ea396-7f79-4263-aa01-658febd60e3e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:26.589826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a14ea396-7f79-4263-aa01-658febd60e3e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:26.590610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a14ea396-7f79-4263-aa01-658febd60e3e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:26.591542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a14ea396-7f79-4263-aa01-658febd60e3e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:26.592157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a14ea396-7f79-4263-aa01-658febd60e3e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:26.593355 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a14ea396-7f79-4263-aa01-658febd60e3e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:28.120382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a14ea396-7f79-4263-aa01-658febd60e3e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:28.132177 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a14ea396-7f79-4263-aa01-658febd60e3e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6" status: 200 len: 1308 microversion: 2.1 time: 1.582554 Oct 29 02:58:28.137362 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1459/2695] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:26 2022] GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 => generated 1308 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:28.150646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8d9784ff-9abc-480a-b6de-39b8ee03fc1e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:28.155346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8d9784ff-9abc-480a-b6de-39b8ee03fc1e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:28.181958 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d9784ff-9abc-480a-b6de-39b8ee03fc1e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:28.197923 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d9784ff-9abc-480a-b6de-39b8ee03fc1e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:28.201363 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d9784ff-9abc-480a-b6de-39b8ee03fc1e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:28.211944 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d9784ff-9abc-480a-b6de-39b8ee03fc1e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:28.213225 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d9784ff-9abc-480a-b6de-39b8ee03fc1e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:28.215946 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d9784ff-9abc-480a-b6de-39b8ee03fc1e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:28.301964 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8d9784ff-9abc-480a-b6de-39b8ee03fc1e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/ips" status: 200 len: 152 microversion: 2.20 time: 0.162243 Oct 29 02:58:28.312422 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1460/2696] 10.222.0.46 () {60 vars in 1289 bytes} [Sat Oct 29 02:58:28 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/ips => generated 152 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:58:28.326116 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-059c49f3-d939-4691-b140-586f3fd9d2d5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:28.327569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-059c49f3-d939-4691-b140-586f3fd9d2d5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:28.357431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-059c49f3-d939-4691-b140-586f3fd9d2d5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:28.359184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-059c49f3-d939-4691-b140-586f3fd9d2d5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:28.360230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-059c49f3-d939-4691-b140-586f3fd9d2d5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:28.368735 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-059c49f3-d939-4691-b140-586f3fd9d2d5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:28.369977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-059c49f3-d939-4691-b140-586f3fd9d2d5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:28.374765 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-059c49f3-d939-4691-b140-586f3fd9d2d5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:28.660874 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-70207f0f-f401-4c92-85b4-f9c61d5cf54e tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e/action" status: 202 len: 0 microversion: 2.1 time: 6.671089 Oct 29 02:58:28.662496 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1237/2697] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:58:21 2022] POST /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e/action => generated 0 bytes in 6674 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:58:28.694077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8a89dc79-2c11-4f49-a34d-9f79df3f062b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:28.702800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8a89dc79-2c11-4f49-a34d-9f79df3f062b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:28.720796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a89dc79-2c11-4f49-a34d-9f79df3f062b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:28.721584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a89dc79-2c11-4f49-a34d-9f79df3f062b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:28.723902 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a89dc79-2c11-4f49-a34d-9f79df3f062b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:28.731406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a89dc79-2c11-4f49-a34d-9f79df3f062b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:28.759738 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a89dc79-2c11-4f49-a34d-9f79df3f062b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:28.761956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a89dc79-2c11-4f49-a34d-9f79df3f062b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:29.194322 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8a89dc79-2c11-4f49-a34d-9f79df3f062b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:29.249938 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8a89dc79-2c11-4f49-a34d-9f79df3f062b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 200 len: 1508 microversion: 2.1 time: 0.575667 Oct 29 02:58:29.250546 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1238/2698] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:28 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 1508 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:29.309905 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-db3361fe-0a37-41fd-b5f7-1b9e70d4fa0e tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:29.315610 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-db3361fe-0a37-41fd-b5f7-1b9e70d4fa0e tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:29.363990 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db3361fe-0a37-41fd-b5f7-1b9e70d4fa0e tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:29.367432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db3361fe-0a37-41fd-b5f7-1b9e70d4fa0e tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:29.367951 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db3361fe-0a37-41fd-b5f7-1b9e70d4fa0e tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:29.368748 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db3361fe-0a37-41fd-b5f7-1b9e70d4fa0e tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:29.374096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db3361fe-0a37-41fd-b5f7-1b9e70d4fa0e tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:29.374561 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db3361fe-0a37-41fd-b5f7-1b9e70d4fa0e tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:29.438796 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-059c49f3-d939-4691-b140-586f3fd9d2d5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:29.463961 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-059c49f3-d939-4691-b140-586f3fd9d2d5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1527 microversion: 2.1 time: 1.149038 Oct 29 02:58:29.484853 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1461/2699] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:28 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1527 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:29.507966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4028570c-aab0-44d2-a97f-d0658bd7459f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:29.514941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4028570c-aab0-44d2-a97f-d0658bd7459f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 347ef944-7c69-4650-be60-12e2070c38ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:29.547866 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4028570c-aab0-44d2-a97f-d0658bd7459f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:29.554446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4028570c-aab0-44d2-a97f-d0658bd7459f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:29.558727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4028570c-aab0-44d2-a97f-d0658bd7459f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:29.559785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4028570c-aab0-44d2-a97f-d0658bd7459f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:29.569224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4028570c-aab0-44d2-a97f-d0658bd7459f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:29.573005 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4028570c-aab0-44d2-a97f-d0658bd7459f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:29.880674 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-db3361fe-0a37-41fd-b5f7-1b9e70d4fa0e tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:29.913953 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-db3361fe-0a37-41fd-b5f7-1b9e70d4fa0e tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:29.916880 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-db3361fe-0a37-41fd-b5f7-1b9e70d4fa0e tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:29.919245 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-db3361fe-0a37-41fd-b5f7-1b9e70d4fa0e tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 2938 microversion: 2.42 time: 0.630307 Oct 29 02:58:29.920252 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1239/2700] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:29 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 2938 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:29.948305 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-baa1eb89-d358-4f87-bc85-1ab631102bb6 req-08443ce3-fec6-4f92-b80e-44240ca07738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b7f1dd5-af84-416c-84a6-e7a0a67294e6", "name": "network-vif-plugged", "status": "completed", "tag": "6f3a9167-1c0e-4d88-92ba-1c4e6bd37758"}, {"server_uuid": "f0c20eea-c322-4d8e-bafd-3b3b01c5d142", "name": "network-vif-unplugged", "status": "completed", "tag": "0fb3a164-1f7e-48a7-90ce-0c06851aae03"}, {"server_uuid": "f0c20eea-c322-4d8e-bafd-3b3b01c5d142", "name": "network-vif-unplugged", "status": "completed", "tag": "20b9f931-71de-4cc6-b5b4-f7a9d8ff7ad9"}, {"server_uuid": "f0c20eea-c322-4d8e-bafd-3b3b01c5d142", "name": "network-vif-unplugged", "status": "completed", "tag": "1a1b3e12-192b-4594-85e0-b5bcedd79e34"}, {"server_uuid": "f0c20eea-c322-4d8e-bafd-3b3b01c5d142", "name": "network-vif-unplugged", "status": "completed", "tag": "c76f3db4-7820-423e-9c05-70cecc3190e6"}, {"server_uuid": "f0c20eea-c322-4d8e-bafd-3b3b01c5d142", "name": "network-vif-unplugged", "status": "completed", "tag": "20f58ad8-3fa0-481e-8e36-08b604fdf588"}, {"server_uuid": "f0c20eea-c322-4d8e-bafd-3b3b01c5d142", "name": "network-vif-unplugged", "status": "completed", "tag": "a3cf680f-1b1f-4418-86d3-29bf244d0bce"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:29.977945 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-baa1eb89-d358-4f87-bc85-1ab631102bb6 req-08443ce3-fec6-4f92-b80e-44240ca07738 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:29.993213 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-baa1eb89-d358-4f87-bc85-1ab631102bb6 req-08443ce3-fec6-4f92-b80e-44240ca07738 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:29.994007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-baa1eb89-d358-4f87-bc85-1ab631102bb6 req-08443ce3-fec6-4f92-b80e-44240ca07738 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:30.021509 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-baa1eb89-d358-4f87-bc85-1ab631102bb6 req-08443ce3-fec6-4f92-b80e-44240ca07738 service nova] Creating event network-vif-plugged:6f3a9167-1c0e-4d88-92ba-1c4e6bd37758 for instance 7b7f1dd5-af84-416c-84a6-e7a0a67294e6 on n-h1-862967-2 Oct 29 02:58:30.022864 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-baa1eb89-d358-4f87-bc85-1ab631102bb6 req-08443ce3-fec6-4f92-b80e-44240ca07738 service nova] Creating event network-vif-unplugged:0fb3a164-1f7e-48a7-90ce-0c06851aae03 for instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 on n-h2-862967-2 Oct 29 02:58:30.023660 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-baa1eb89-d358-4f87-bc85-1ab631102bb6 req-08443ce3-fec6-4f92-b80e-44240ca07738 service nova] Creating event network-vif-unplugged:20b9f931-71de-4cc6-b5b4-f7a9d8ff7ad9 for instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 on n-h2-862967-2 Oct 29 02:58:30.024421 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-baa1eb89-d358-4f87-bc85-1ab631102bb6 req-08443ce3-fec6-4f92-b80e-44240ca07738 service nova] Creating event network-vif-unplugged:1a1b3e12-192b-4594-85e0-b5bcedd79e34 for instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 on n-h2-862967-2 Oct 29 02:58:30.025191 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-baa1eb89-d358-4f87-bc85-1ab631102bb6 req-08443ce3-fec6-4f92-b80e-44240ca07738 service nova] Creating event network-vif-unplugged:c76f3db4-7820-423e-9c05-70cecc3190e6 for instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 on n-h2-862967-2 Oct 29 02:58:30.025933 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-baa1eb89-d358-4f87-bc85-1ab631102bb6 req-08443ce3-fec6-4f92-b80e-44240ca07738 service nova] Creating event network-vif-unplugged:20f58ad8-3fa0-481e-8e36-08b604fdf588 for instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 on n-h2-862967-2 Oct 29 02:58:30.026674 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-baa1eb89-d358-4f87-bc85-1ab631102bb6 req-08443ce3-fec6-4f92-b80e-44240ca07738 service nova] Creating event network-vif-unplugged:a3cf680f-1b1f-4418-86d3-29bf244d0bce for instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 on n-h2-862967-2 Oct 29 02:58:30.046788 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-baa1eb89-d358-4f87-bc85-1ab631102bb6 req-08443ce3-fec6-4f92-b80e-44240ca07738 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1221 microversion: 2.1 time: 0.109952 Oct 29 02:58:30.056911 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1240/2701] 10.222.0.46 () {64 vars in 1318 bytes} [Sat Oct 29 02:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 1221 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:30.086277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e17250a0-a5b8-488b-a47b-ac87247a30ff tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:30.095581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e17250a0-a5b8-488b-a47b-ac87247a30ff tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:30.109571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e17250a0-a5b8-488b-a47b-ac87247a30ff tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:30.113270 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e17250a0-a5b8-488b-a47b-ac87247a30ff tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:30.114100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e17250a0-a5b8-488b-a47b-ac87247a30ff tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:30.125754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e17250a0-a5b8-488b-a47b-ac87247a30ff tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:30.126724 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e17250a0-a5b8-488b-a47b-ac87247a30ff tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:30.127663 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e17250a0-a5b8-488b-a47b-ac87247a30ff tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:30.564940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4028570c-aab0-44d2-a97f-d0658bd7459f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:30.619237 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4028570c-aab0-44d2-a97f-d0658bd7459f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad" status: 200 len: 1346 microversion: 2.1 time: 1.127912 Oct 29 02:58:30.657890 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1462/2702] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:29 2022] GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad => generated 1346 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:30.658930 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e17250a0-a5b8-488b-a47b-ac87247a30ff tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:30.662014 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:30.680202 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e17250a0-a5b8-488b-a47b-ac87247a30ff tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1718 microversion: 2.1 time: 0.612138 Oct 29 02:58:30.685230 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1241/2703] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:30 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1718 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:30.703394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-57181ee3-c561-43d1-bcc6-612179728909 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:30.707106 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-57181ee3-c561-43d1-bcc6-612179728909 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:30.734663 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57181ee3-c561-43d1-bcc6-612179728909 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:30.740725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9d8b9bec-1ee3-4c93-8e1e-2a3a7c6815f0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:30.741906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9d8b9bec-1ee3-4c93-8e1e-2a3a7c6815f0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:30.743174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57181ee3-c561-43d1-bcc6-612179728909 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:30.748788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57181ee3-c561-43d1-bcc6-612179728909 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:30.751461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57181ee3-c561-43d1-bcc6-612179728909 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:30.755070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57181ee3-c561-43d1-bcc6-612179728909 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:30.755660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57181ee3-c561-43d1-bcc6-612179728909 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:30.789257 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d8b9bec-1ee3-4c93-8e1e-2a3a7c6815f0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:30.795722 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d8b9bec-1ee3-4c93-8e1e-2a3a7c6815f0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:30.796335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d8b9bec-1ee3-4c93-8e1e-2a3a7c6815f0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:30.797237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d8b9bec-1ee3-4c93-8e1e-2a3a7c6815f0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:30.801711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d8b9bec-1ee3-4c93-8e1e-2a3a7c6815f0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:30.807376 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d8b9bec-1ee3-4c93-8e1e-2a3a7c6815f0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:30.887440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-57181ee3-c561-43d1-bcc6-612179728909 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:58:31.216004 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-57181ee3-c561-43d1-bcc6-612179728909 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 204 len: 0 microversion: 2.1 time: 0.527868 Oct 29 02:58:31.236647 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1242/2704] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:58:30 2022] DELETE /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:58:31.245593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8646fff9-9603-4c2e-b607-1f466fdd1ca2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:31.265074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8646fff9-9603-4c2e-b607-1f466fdd1ca2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:31.297808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8646fff9-9603-4c2e-b607-1f466fdd1ca2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:31.299337 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8646fff9-9603-4c2e-b607-1f466fdd1ca2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:31.300045 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8646fff9-9603-4c2e-b607-1f466fdd1ca2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:31.301174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8646fff9-9603-4c2e-b607-1f466fdd1ca2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:31.301889 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8646fff9-9603-4c2e-b607-1f466fdd1ca2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:31.304795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8646fff9-9603-4c2e-b607-1f466fdd1ca2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:31.801440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9d8b9bec-1ee3-4c93-8e1e-2a3a7c6815f0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:31.821754 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9d8b9bec-1ee3-4c93-8e1e-2a3a7c6815f0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6" status: 200 len: 1308 microversion: 2.1 time: 1.161326 Oct 29 02:58:31.836823 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1463/2705] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:30 2022] GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 => generated 1308 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:31.841065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8646fff9-9603-4c2e-b607-1f466fdd1ca2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:31.853670 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8646fff9-9603-4c2e-b607-1f466fdd1ca2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1527 microversion: 2.1 time: 0.623140 Oct 29 02:58:31.855792 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-860c2dcc-ba19-4dcc-832e-41b7fdcee14f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:31.860624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-860c2dcc-ba19-4dcc-832e-41b7fdcee14f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:31.861055 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1243/2706] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:31 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1527 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:31.883239 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bfcd4fdb-bc54-4ec9-bf0b-c1ef12a35860 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1174352362", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "7f99e4be-cbcb-4834-96c2-e8888447d097"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:31.892394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-860c2dcc-ba19-4dcc-832e-41b7fdcee14f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:31.902083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-860c2dcc-ba19-4dcc-832e-41b7fdcee14f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:31.902919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-860c2dcc-ba19-4dcc-832e-41b7fdcee14f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:31.907255 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-860c2dcc-ba19-4dcc-832e-41b7fdcee14f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:31.909474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-860c2dcc-ba19-4dcc-832e-41b7fdcee14f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:31.912426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-860c2dcc-ba19-4dcc-832e-41b7fdcee14f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:33.668446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-860c2dcc-ba19-4dcc-832e-41b7fdcee14f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:33.707908 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-860c2dcc-ba19-4dcc-832e-41b7fdcee14f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:33.715546 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-860c2dcc-ba19-4dcc-832e-41b7fdcee14f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:33.721609 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-860c2dcc-ba19-4dcc-832e-41b7fdcee14f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 2917 microversion: 2.42 time: 1.892015 Oct 29 02:58:33.725875 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1464/2707] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:31 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 2917 bytes in 1900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:33.741760 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6b6a3608-89af-43ec-9765-c75f9d50c553 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:33.757203 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6b6a3608-89af-43ec-9765-c75f9d50c553 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 347ef944-7c69-4650-be60-12e2070c38ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:33.797483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b6a3608-89af-43ec-9765-c75f9d50c553 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:33.813363 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b6a3608-89af-43ec-9765-c75f9d50c553 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:33.815517 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b6a3608-89af-43ec-9765-c75f9d50c553 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:33.817644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b6a3608-89af-43ec-9765-c75f9d50c553 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:33.824199 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b6a3608-89af-43ec-9765-c75f9d50c553 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:33.825495 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b6a3608-89af-43ec-9765-c75f9d50c553 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:34.051547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6b6a3608-89af-43ec-9765-c75f9d50c553 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:34.071406 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6b6a3608-89af-43ec-9765-c75f9d50c553 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad" status: 200 len: 1346 microversion: 2.1 time: 0.343135 Oct 29 02:58:34.089696 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1465/2708] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:33 2022] GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad => generated 1346 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:34.096376 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c6b6c396-4361-4152-a670-56394cd7a06c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:34.097303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c6b6c396-4361-4152-a670-56394cd7a06c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:34.117815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6b6c396-4361-4152-a670-56394cd7a06c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:34.121154 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6b6c396-4361-4152-a670-56394cd7a06c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:34.122706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6b6c396-4361-4152-a670-56394cd7a06c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:34.122706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6b6c396-4361-4152-a670-56394cd7a06c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:34.128500 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6b6c396-4361-4152-a670-56394cd7a06c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:34.129293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6b6c396-4361-4152-a670-56394cd7a06c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:34.771421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c6b6c396-4361-4152-a670-56394cd7a06c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:34.814604 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c6b6c396-4361-4152-a670-56394cd7a06c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1718 microversion: 2.1 time: 0.716896 Oct 29 02:58:34.821062 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1466/2709] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:34 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1718 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:34.842112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4a98ca89-b25f-4e20-9b7d-cfcb235f2a24 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:34.849559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4a98ca89-b25f-4e20-9b7d-cfcb235f2a24 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:34.876816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a98ca89-b25f-4e20-9b7d-cfcb235f2a24 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:34.878325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a98ca89-b25f-4e20-9b7d-cfcb235f2a24 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:34.880310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a98ca89-b25f-4e20-9b7d-cfcb235f2a24 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:34.924539 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a98ca89-b25f-4e20-9b7d-cfcb235f2a24 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:34.925764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a98ca89-b25f-4e20-9b7d-cfcb235f2a24 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.044s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:34.927835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a98ca89-b25f-4e20-9b7d-cfcb235f2a24 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:35.354614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4a98ca89-b25f-4e20-9b7d-cfcb235f2a24 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:35.393481 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4a98ca89-b25f-4e20-9b7d-cfcb235f2a24 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6" status: 200 len: 1488 microversion: 2.1 time: 0.571139 Oct 29 02:58:35.397705 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1467/2710] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:34 2022] GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 => generated 1488 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:35.418545 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-31495810-87a2-445f-9751-c88ad2d1b219 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:35.419660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-31495810-87a2-445f-9751-c88ad2d1b219 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:35.445565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31495810-87a2-445f-9751-c88ad2d1b219 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:35.446770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31495810-87a2-445f-9751-c88ad2d1b219 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:35.451508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31495810-87a2-445f-9751-c88ad2d1b219 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:35.452698 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31495810-87a2-445f-9751-c88ad2d1b219 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:35.453681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31495810-87a2-445f-9751-c88ad2d1b219 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:35.456162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31495810-87a2-445f-9751-c88ad2d1b219 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:36.375840 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-31495810-87a2-445f-9751-c88ad2d1b219 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:36.387131 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-31495810-87a2-445f-9751-c88ad2d1b219 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1527 microversion: 2.1 time: 0.982423 Oct 29 02:58:36.389458 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1468/2711] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:35 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1527 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:36.404340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-482d9246-c566-42c3-b790-d0edffe0a414 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:36.405518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-482d9246-c566-42c3-b790-d0edffe0a414 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:36.418330 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-482d9246-c566-42c3-b790-d0edffe0a414 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:36.419108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-482d9246-c566-42c3-b790-d0edffe0a414 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:36.419776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-482d9246-c566-42c3-b790-d0edffe0a414 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:36.420828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-482d9246-c566-42c3-b790-d0edffe0a414 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:36.421825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-482d9246-c566-42c3-b790-d0edffe0a414 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:36.422472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-482d9246-c566-42c3-b790-d0edffe0a414 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:36.469662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-482d9246-c566-42c3-b790-d0edffe0a414 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lazy-loading 'flavor' on Instance uuid 1ab56816-cc78-4e73-918a-4c76895fed6b {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:58:41.846219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:41.983499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:45.331446 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-bfcd4fdb-bc54-4ec9-bf0b-c1ef12a35860 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] validate_networks() for [('7f99e4be-cbcb-4834-96c2-e8888447d097', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:58:45.465086 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-482d9246-c566-42c3-b790-d0edffe0a414 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "POST /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/action" status: 202 len: 0 microversion: 2.20 time: 9.072722 Oct 29 02:58:45.466800 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1469/2712] 10.222.0.46 () {62 vars in 1319 bytes} [Sat Oct 29 02:58:36 2022] POST /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/action => generated 0 bytes in 9075 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:58:45.495431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-9286aa52-7e44-4360-8243-9cc04720df35 req-66753ef6-6d30-4697-90a0-757a11c1d3f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d981d040-d96a-40a5-a893-033a9d51e368", "name": "network-vif-deleted", "tag": "d421fc9b-5ae4-42e7-a9d1-182d4fc1ec78"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:45.509452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9286aa52-7e44-4360-8243-9cc04720df35 req-66753ef6-6d30-4697-90a0-757a11c1d3f5 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:45.510519 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9286aa52-7e44-4360-8243-9cc04720df35 req-66753ef6-6d30-4697-90a0-757a11c1d3f5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:45.512018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9286aa52-7e44-4360-8243-9cc04720df35 req-66753ef6-6d30-4697-90a0-757a11c1d3f5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:45.527230 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-9286aa52-7e44-4360-8243-9cc04720df35 req-66753ef6-6d30-4697-90a0-757a11c1d3f5 service nova] Creating event network-vif-deleted:d421fc9b-5ae4-42e7-a9d1-182d4fc1ec78 for instance d981d040-d96a-40a5-a893-033a9d51e368 on n-h2-862967-2 Oct 29 02:58:45.540626 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-9286aa52-7e44-4360-8243-9cc04720df35 req-66753ef6-6d30-4697-90a0-757a11c1d3f5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055276 Oct 29 02:58:45.542953 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1470/2713] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:58:45.554156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-29b885d7-b1e0-495b-be3a-8c01b14b9162 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:45.556499 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-29b885d7-b1e0-495b-be3a-8c01b14b9162 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:45.568164 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-29b885d7-b1e0-495b-be3a-8c01b14b9162 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:45.568690 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-29b885d7-b1e0-495b-be3a-8c01b14b9162 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:45.569123 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-29b885d7-b1e0-495b-be3a-8c01b14b9162 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:45.569866 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-29b885d7-b1e0-495b-be3a-8c01b14b9162 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:45.570316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-29b885d7-b1e0-495b-be3a-8c01b14b9162 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:45.570736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-29b885d7-b1e0-495b-be3a-8c01b14b9162 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:45.651622 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-29b885d7-b1e0-495b-be3a-8c01b14b9162 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:45.667943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-29b885d7-b1e0-495b-be3a-8c01b14b9162 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:45.671234 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-29b885d7-b1e0-495b-be3a-8c01b14b9162 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:45.673419 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-29b885d7-b1e0-495b-be3a-8c01b14b9162 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1604 microversion: 2.42 time: 0.128533 Oct 29 02:58:45.674521 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1471/2714] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:45 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1604 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:45.679284 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-7dbccfd8-5151-45ac-ac7f-17ae4cf01476 req-db71a4ee-c7bf-4726-8c42-bee6e02a4d94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c20eea-c322-4d8e-bafd-3b3b01c5d142", "name": "network-vif-deleted", "tag": "20f58ad8-3fa0-481e-8e36-08b604fdf588"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:45.696484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7dbccfd8-5151-45ac-ac7f-17ae4cf01476 req-db71a4ee-c7bf-4726-8c42-bee6e02a4d94 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:45.697260 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7dbccfd8-5151-45ac-ac7f-17ae4cf01476 req-db71a4ee-c7bf-4726-8c42-bee6e02a4d94 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:45.697850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7dbccfd8-5151-45ac-ac7f-17ae4cf01476 req-db71a4ee-c7bf-4726-8c42-bee6e02a4d94 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:45.714686 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-7dbccfd8-5151-45ac-ac7f-17ae4cf01476 req-db71a4ee-c7bf-4726-8c42-bee6e02a4d94 service nova] Creating event network-vif-deleted:20f58ad8-3fa0-481e-8e36-08b604fdf588 for instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 on n-h2-862967-2 Oct 29 02:58:45.721797 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-7dbccfd8-5151-45ac-ac7f-17ae4cf01476 req-db71a4ee-c7bf-4726-8c42-bee6e02a4d94 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045577 Oct 29 02:58:45.728400 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1472/2715] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:58:45.736464 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cbea8c7b-737d-42a2-b959-fb62e8b6f8ac tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:45.737681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cbea8c7b-737d-42a2-b959-fb62e8b6f8ac tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 347ef944-7c69-4650-be60-12e2070c38ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:45.744888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cbea8c7b-737d-42a2-b959-fb62e8b6f8ac tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:45.745379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cbea8c7b-737d-42a2-b959-fb62e8b6f8ac tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:45.745812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cbea8c7b-737d-42a2-b959-fb62e8b6f8ac tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:45.746535 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cbea8c7b-737d-42a2-b959-fb62e8b6f8ac tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:45.746982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cbea8c7b-737d-42a2-b959-fb62e8b6f8ac tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:45.747403 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cbea8c7b-737d-42a2-b959-fb62e8b6f8ac tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:45.768186 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-cbea8c7b-737d-42a2-b959-fb62e8b6f8ac tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] HTTP exception thrown: Instance 347ef944-7c69-4650-be60-12e2070c38ad could not be found. Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cbea8c7b-737d-42a2-b959-fb62e8b6f8ac tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Request method failure captured: Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad HTTP/1.1 Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJaEy18RgNLoRH_Cx5N19ntl_MZAWseAedf6nDvdLqq5Uv9fWq711j0XNb6BgsjwGmwVkwDsYZqRqnlQy1v9Czdk1P2JZBE7MuExsRjBvQLnTgLkLacVPY3yLp9R5pSFE5uStbCf24z3K2C9Y_7prmanNUiQJvOS6fzPpIe1j-F47IQ Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b67fc8dd1f4349ca85422bd9a08d3e06"}]}] Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-DeleteServersTestJSON-485778383 Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-DeleteServersTestJSON-485778383-project Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 1ee6c4d28f304eab89014b9c46cc555a Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-DeleteServersTestJSON-485778383-project Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 347ef944-7c69-4650-be60-12e2070c38ad could not be found. Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '347ef944-7c69-4650-be60-12e2070c38ad'} Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 347ef944-7c69-4650-be60-12e2070c38ad could not be found. Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 347ef944-7c69-4650-be60-12e2070c38ad could not be found. Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:45.771476 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:58:45.779687 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:45.779687 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:45.779687 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:45.779687 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:58:45.779687 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:58:45.779687 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 347ef944-7c69-4650-be60-12e2070c38ad could not be found. Oct 29 02:58:45.779687 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:58:45.779687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cbea8c7b-737d-42a2-b959-fb62e8b6f8ac tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Returning 404 to user: Instance 347ef944-7c69-4650-be60-12e2070c38ad could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:58:45.779687 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cbea8c7b-737d-42a2-b959-fb62e8b6f8ac tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad" status: 404 len: 111 microversion: 2.1 time: 0.042753 Oct 29 02:58:45.779687 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1473/2716] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:45 2022] GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:58:45.779687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4c93ef2e-8085-4c8c-b3bc-41291076d7e1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:45.786755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c93ef2e-8085-4c8c-b3bc-41291076d7e1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:45.787248 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c93ef2e-8085-4c8c-b3bc-41291076d7e1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:45.788041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c93ef2e-8085-4c8c-b3bc-41291076d7e1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:45.879285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4c93ef2e-8085-4c8c-b3bc-41291076d7e1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Going to try to stop instance {{(pid=127124) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 02:58:45.888796 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:45.935565 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-bfcd4fdb-bc54-4ec9-bf0b-c1ef12a35860 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:58:45.936070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-bfcd4fdb-bc54-4ec9-bf0b-c1ef12a35860 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:58:45.936647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-bfcd4fdb-bc54-4ec9-bf0b-c1ef12a35860 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:58:45.937322 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-bfcd4fdb-bc54-4ec9-bf0b-c1ef12a35860 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:58:45.938254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-bfcd4fdb-bc54-4ec9-bf0b-c1ef12a35860 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:58:45.953113 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bfcd4fdb-bc54-4ec9-bf0b-c1ef12a35860 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:45.954179 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bfcd4fdb-bc54-4ec9-bf0b-c1ef12a35860 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:45.954874 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4c93ef2e-8085-4c8c-b3bc-41291076d7e1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "POST /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6/action" status: 202 len: 0 microversion: 2.1 time: 0.178819 Oct 29 02:58:45.955178 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bfcd4fdb-bc54-4ec9-bf0b-c1ef12a35860 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:45.955867 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1474/2717] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:58:45 2022] POST /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:58:45.957317 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bfcd4fdb-bc54-4ec9-bf0b-c1ef12a35860 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:45.958500 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bfcd4fdb-bc54-4ec9-bf0b-c1ef12a35860 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:45.959707 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bfcd4fdb-bc54-4ec9-bf0b-c1ef12a35860 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:45.964424 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-be90763d-7ebf-40cb-9318-ab41c4dcb2fc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:45.965448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-be90763d-7ebf-40cb-9318-ab41c4dcb2fc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:45.977656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be90763d-7ebf-40cb-9318-ab41c4dcb2fc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:45.978377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be90763d-7ebf-40cb-9318-ab41c4dcb2fc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:45.979910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be90763d-7ebf-40cb-9318-ab41c4dcb2fc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:45.981076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be90763d-7ebf-40cb-9318-ab41c4dcb2fc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:45.981552 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be90763d-7ebf-40cb-9318-ab41c4dcb2fc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:45.981975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be90763d-7ebf-40cb-9318-ab41c4dcb2fc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:45.991808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-bfcd4fdb-bc54-4ec9-bf0b-c1ef12a35860 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Getting quotas for project dae7f63d25fd42f0a2805df87595ff5f. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:58:45.999258 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-bfcd4fdb-bc54-4ec9-bf0b-c1ef12a35860 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Getting quotas for user a412bb38fb11498d9dd4a6ce6a63370d and project dae7f63d25fd42f0a2805df87595ff5f. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:58:46.015969 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bfcd4fdb-bc54-4ec9-bf0b-c1ef12a35860 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:58:46.018818 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bfcd4fdb-bc54-4ec9-bf0b-c1ef12a35860 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: 1117f077-2a55-4632-95ed-f3bd9a5f685a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:58:46.100209 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bfcd4fdb-bc54-4ec9-bf0b-c1ef12a35860 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 14.234715 Oct 29 02:58:46.101105 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1244/2718] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:58:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 14239 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:58:46.106250 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-eb4b89d8-468f-40ef-9b25-6d3af0a1013f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:46.107187 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-eb4b89d8-468f-40ef-9b25-6d3af0a1013f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:46.114093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb4b89d8-468f-40ef-9b25-6d3af0a1013f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:46.114933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb4b89d8-468f-40ef-9b25-6d3af0a1013f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:46.115627 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb4b89d8-468f-40ef-9b25-6d3af0a1013f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:46.116829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb4b89d8-468f-40ef-9b25-6d3af0a1013f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:46.117555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb4b89d8-468f-40ef-9b25-6d3af0a1013f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:46.118208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb4b89d8-468f-40ef-9b25-6d3af0a1013f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:46.232195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-be90763d-7ebf-40cb-9318-ab41c4dcb2fc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:46.244095 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-be90763d-7ebf-40cb-9318-ab41c4dcb2fc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1718 microversion: 2.1 time: 0.286505 Oct 29 02:58:46.245599 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1475/2719] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:45 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1718 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:46.250808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c3eb0570-3351-4979-ad90-e174a33332a6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:46.251862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c3eb0570-3351-4979-ad90-e174a33332a6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:46.259398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3eb0570-3351-4979-ad90-e174a33332a6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:46.259937 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3eb0570-3351-4979-ad90-e174a33332a6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:46.260506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3eb0570-3351-4979-ad90-e174a33332a6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:46.261128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3eb0570-3351-4979-ad90-e174a33332a6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:46.261582 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3eb0570-3351-4979-ad90-e174a33332a6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:46.262002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3eb0570-3351-4979-ad90-e174a33332a6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:46.514579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c3eb0570-3351-4979-ad90-e174a33332a6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:46.534787 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c3eb0570-3351-4979-ad90-e174a33332a6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:46.538257 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c3eb0570-3351-4979-ad90-e174a33332a6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:46.540221 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c3eb0570-3351-4979-ad90-e174a33332a6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1723 microversion: 2.20 time: 0.292896 Oct 29 02:58:46.540657 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1476/2720] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:46 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1723 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:46.547006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-04fc12d4-67ec-4cbe-92f1-1ff0fd41861d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:46.547633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-04fc12d4-67ec-4cbe-92f1-1ff0fd41861d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:46.556709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-04fc12d4-67ec-4cbe-92f1-1ff0fd41861d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:46.557392 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-04fc12d4-67ec-4cbe-92f1-1ff0fd41861d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:46.558603 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-04fc12d4-67ec-4cbe-92f1-1ff0fd41861d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:46.560086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-04fc12d4-67ec-4cbe-92f1-1ff0fd41861d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:46.560897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-04fc12d4-67ec-4cbe-92f1-1ff0fd41861d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:46.561340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-04fc12d4-67ec-4cbe-92f1-1ff0fd41861d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:46.637251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-eb4b89d8-468f-40ef-9b25-6d3af0a1013f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:46.650996 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-eb4b89d8-468f-40ef-9b25-6d3af0a1013f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1509 microversion: 2.1 time: 0.548527 Oct 29 02:58:46.678314 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1245/2721] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:46 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1509 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:46.690692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-598df4d0-9d3b-4633-b6bd-38bcd81bae1a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:46.691518 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-598df4d0-9d3b-4633-b6bd-38bcd81bae1a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: 1117f077-2a55-4632-95ed-f3bd9a5f685a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:46.871616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-04fc12d4-67ec-4cbe-92f1-1ff0fd41861d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:46.886167 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-04fc12d4-67ec-4cbe-92f1-1ff0fd41861d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6" status: 200 len: 1498 microversion: 2.1 time: 0.344401 Oct 29 02:58:46.887274 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1477/2722] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:46 2022] GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 => generated 1498 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:46.893551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-95709437-13bc-42b9-ad81-34e940549e13 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:46.894526 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-95709437-13bc-42b9-ad81-34e940549e13 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:46.901562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95709437-13bc-42b9-ad81-34e940549e13 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:46.902395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95709437-13bc-42b9-ad81-34e940549e13 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:46.902774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95709437-13bc-42b9-ad81-34e940549e13 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:46.903530 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95709437-13bc-42b9-ad81-34e940549e13 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:46.904002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95709437-13bc-42b9-ad81-34e940549e13 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:46.904436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95709437-13bc-42b9-ad81-34e940549e13 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:46.924176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-598df4d0-9d3b-4633-b6bd-38bcd81bae1a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:46.939233 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-598df4d0-9d3b-4633-b6bd-38bcd81bae1a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a" status: 200 len: 1218 microversion: 2.1 time: 0.253571 Oct 29 02:58:46.941743 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1246/2723] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:46 2022] GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a => generated 1218 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:47.070325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-95709437-13bc-42b9-ad81-34e940549e13 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:47.108842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-95709437-13bc-42b9-ad81-34e940549e13 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:47.113853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-95709437-13bc-42b9-ad81-34e940549e13 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:47.115615 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-95709437-13bc-42b9-ad81-34e940549e13 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1604 microversion: 2.42 time: 0.227182 Oct 29 02:58:47.119756 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1478/2724] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:46 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1604 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:47.280694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6c7c1005-c695-41fa-8274-c7c4ae0b2e6f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:47.282927 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6c7c1005-c695-41fa-8274-c7c4ae0b2e6f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:47.290681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c7c1005-c695-41fa-8274-c7c4ae0b2e6f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:47.291332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c7c1005-c695-41fa-8274-c7c4ae0b2e6f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:47.291876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c7c1005-c695-41fa-8274-c7c4ae0b2e6f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:47.292745 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c7c1005-c695-41fa-8274-c7c4ae0b2e6f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:47.293458 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c7c1005-c695-41fa-8274-c7c4ae0b2e6f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:47.294089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c7c1005-c695-41fa-8274-c7c4ae0b2e6f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:47.479356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6c7c1005-c695-41fa-8274-c7c4ae0b2e6f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:47.493257 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6c7c1005-c695-41fa-8274-c7c4ae0b2e6f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1718 microversion: 2.1 time: 0.218282 Oct 29 02:58:47.506714 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1247/2725] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:47 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1718 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:47.580485 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-043d8bde-e1d5-49d8-8c7d-55556127be02 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:47.581933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-043d8bde-e1d5-49d8-8c7d-55556127be02 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:47.597036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-043d8bde-e1d5-49d8-8c7d-55556127be02 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:47.597838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-043d8bde-e1d5-49d8-8c7d-55556127be02 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:47.598269 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-043d8bde-e1d5-49d8-8c7d-55556127be02 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:47.599065 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-043d8bde-e1d5-49d8-8c7d-55556127be02 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:47.599623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-043d8bde-e1d5-49d8-8c7d-55556127be02 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:47.600170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-043d8bde-e1d5-49d8-8c7d-55556127be02 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:47.690979 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ddafb872-e885-45a9-8fa5-3a56ecaa6ed8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:47.692205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ddafb872-e885-45a9-8fa5-3a56ecaa6ed8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:47.702760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ddafb872-e885-45a9-8fa5-3a56ecaa6ed8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:47.703265 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ddafb872-e885-45a9-8fa5-3a56ecaa6ed8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:47.703717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ddafb872-e885-45a9-8fa5-3a56ecaa6ed8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:47.704425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ddafb872-e885-45a9-8fa5-3a56ecaa6ed8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:47.704920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ddafb872-e885-45a9-8fa5-3a56ecaa6ed8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:47.705349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ddafb872-e885-45a9-8fa5-3a56ecaa6ed8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:47.781353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-043d8bde-e1d5-49d8-8c7d-55556127be02 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:47.798020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-043d8bde-e1d5-49d8-8c7d-55556127be02 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:47.800335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-043d8bde-e1d5-49d8-8c7d-55556127be02 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:47.803209 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-043d8bde-e1d5-49d8-8c7d-55556127be02 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1723 microversion: 2.20 time: 0.226897 Oct 29 02:58:47.804406 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1479/2726] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:47 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:47.810092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-8fb43d0b-8d14-4a24-a2fa-3d7962c61957 req-dba28d15-6f13-4dae-bb28-c484082eccaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c20eea-c322-4d8e-bafd-3b3b01c5d142", "name": "network-vif-deleted", "tag": "c76f3db4-7820-423e-9c05-70cecc3190e6"}, {"server_uuid": "f0c20eea-c322-4d8e-bafd-3b3b01c5d142", "name": "network-vif-deleted", "tag": "a3cf680f-1b1f-4418-86d3-29bf244d0bce"}, {"server_uuid": "f0c20eea-c322-4d8e-bafd-3b3b01c5d142", "name": "network-vif-deleted", "tag": "0fb3a164-1f7e-48a7-90ce-0c06851aae03"}, {"server_uuid": "f0c20eea-c322-4d8e-bafd-3b3b01c5d142", "name": "network-vif-deleted", "tag": "1a1b3e12-192b-4594-85e0-b5bcedd79e34"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:47.824625 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8fb43d0b-8d14-4a24-a2fa-3d7962c61957 req-dba28d15-6f13-4dae-bb28-c484082eccaf service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:47.825502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8fb43d0b-8d14-4a24-a2fa-3d7962c61957 req-dba28d15-6f13-4dae-bb28-c484082eccaf service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:47.826126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8fb43d0b-8d14-4a24-a2fa-3d7962c61957 req-dba28d15-6f13-4dae-bb28-c484082eccaf service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:47.846499 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-8fb43d0b-8d14-4a24-a2fa-3d7962c61957 req-dba28d15-6f13-4dae-bb28-c484082eccaf service nova] Creating event network-vif-deleted:c76f3db4-7820-423e-9c05-70cecc3190e6 for instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 on n-h2-862967-2 Oct 29 02:58:47.847180 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-8fb43d0b-8d14-4a24-a2fa-3d7962c61957 req-dba28d15-6f13-4dae-bb28-c484082eccaf service nova] Creating event network-vif-deleted:a3cf680f-1b1f-4418-86d3-29bf244d0bce for instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 on n-h2-862967-2 Oct 29 02:58:47.847837 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-8fb43d0b-8d14-4a24-a2fa-3d7962c61957 req-dba28d15-6f13-4dae-bb28-c484082eccaf service nova] Creating event network-vif-deleted:0fb3a164-1f7e-48a7-90ce-0c06851aae03 for instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 on n-h2-862967-2 Oct 29 02:58:47.848598 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-8fb43d0b-8d14-4a24-a2fa-3d7962c61957 req-dba28d15-6f13-4dae-bb28-c484082eccaf service nova] Creating event network-vif-deleted:1a1b3e12-192b-4594-85e0-b5bcedd79e34 for instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 on n-h2-862967-2 Oct 29 02:58:47.854698 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-8fb43d0b-8d14-4a24-a2fa-3d7962c61957 req-dba28d15-6f13-4dae-bb28-c484082eccaf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.048479 Oct 29 02:58:47.855924 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1480/2727] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:58:47.906201 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ddafb872-e885-45a9-8fa5-3a56ecaa6ed8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:47.911603 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e2d76152-b7f5-448d-9337-bca44b3bfe77 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:47.911952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e2d76152-b7f5-448d-9337-bca44b3bfe77 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:47.921524 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e2d76152-b7f5-448d-9337-bca44b3bfe77 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:47.922300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e2d76152-b7f5-448d-9337-bca44b3bfe77 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:47.922737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e2d76152-b7f5-448d-9337-bca44b3bfe77 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:47.923164 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ddafb872-e885-45a9-8fa5-3a56ecaa6ed8 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1509 microversion: 2.1 time: 0.239806 Oct 29 02:58:47.923457 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e2d76152-b7f5-448d-9337-bca44b3bfe77 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:47.930673 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e2d76152-b7f5-448d-9337-bca44b3bfe77 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:47.930894 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1248/2728] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:47 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1509 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:47.930996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e2d76152-b7f5-448d-9337-bca44b3bfe77 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:47.967752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-16eb8ef9-9523-440a-9c9f-2b5fa22778e2 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:47.968691 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-16eb8ef9-9523-440a-9c9f-2b5fa22778e2 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: 1117f077-2a55-4632-95ed-f3bd9a5f685a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:47.975162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-16eb8ef9-9523-440a-9c9f-2b5fa22778e2 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:47.975969 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-16eb8ef9-9523-440a-9c9f-2b5fa22778e2 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:47.976407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-16eb8ef9-9523-440a-9c9f-2b5fa22778e2 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:47.977317 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-16eb8ef9-9523-440a-9c9f-2b5fa22778e2 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:47.977942 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-16eb8ef9-9523-440a-9c9f-2b5fa22778e2 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:47.978376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-16eb8ef9-9523-440a-9c9f-2b5fa22778e2 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:48.053880 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-16eb8ef9-9523-440a-9c9f-2b5fa22778e2 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:48.081627 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-16eb8ef9-9523-440a-9c9f-2b5fa22778e2 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a" status: 200 len: 1270 microversion: 2.1 time: 0.117771 Oct 29 02:58:48.082809 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1249/2729] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:47 2022] GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a => generated 1270 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:48.119660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e2d76152-b7f5-448d-9337-bca44b3bfe77 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:48.134847 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e2d76152-b7f5-448d-9337-bca44b3bfe77 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6" status: 200 len: 1498 microversion: 2.1 time: 0.228715 Oct 29 02:58:48.135447 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1481/2730] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:47 2022] GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 => generated 1498 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:48.157094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-81df9625-331b-4ee5-b78e-3a9f85e6bb9f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:48.158095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-81df9625-331b-4ee5-b78e-3a9f85e6bb9f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:48.166456 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-81df9625-331b-4ee5-b78e-3a9f85e6bb9f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:48.167369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-81df9625-331b-4ee5-b78e-3a9f85e6bb9f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:48.168126 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-81df9625-331b-4ee5-b78e-3a9f85e6bb9f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:48.169420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-81df9625-331b-4ee5-b78e-3a9f85e6bb9f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:48.170286 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-81df9625-331b-4ee5-b78e-3a9f85e6bb9f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:48.170944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-81df9625-331b-4ee5-b78e-3a9f85e6bb9f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:48.259989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-81df9625-331b-4ee5-b78e-3a9f85e6bb9f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:48.271900 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-81df9625-331b-4ee5-b78e-3a9f85e6bb9f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:48.273501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-81df9625-331b-4ee5-b78e-3a9f85e6bb9f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:48.275067 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-81df9625-331b-4ee5-b78e-3a9f85e6bb9f tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1604 microversion: 2.42 time: 0.124036 Oct 29 02:58:48.275663 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1250/2731] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:48 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1604 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:48.533715 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d3128ac5-4db5-4463-8c59-eeed9f7e13fc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:48.537124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d3128ac5-4db5-4463-8c59-eeed9f7e13fc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:48.586938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3128ac5-4db5-4463-8c59-eeed9f7e13fc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:48.589845 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3128ac5-4db5-4463-8c59-eeed9f7e13fc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:48.594045 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3128ac5-4db5-4463-8c59-eeed9f7e13fc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:48.594788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-110a50e4-27db-44f5-bc95-d0a6a15acbf5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:48.597052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3128ac5-4db5-4463-8c59-eeed9f7e13fc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:48.599562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3128ac5-4db5-4463-8c59-eeed9f7e13fc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:48.602846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3128ac5-4db5-4463-8c59-eeed9f7e13fc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:48.606458 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-110a50e4-27db-44f5-bc95-d0a6a15acbf5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 347ef944-7c69-4650-be60-12e2070c38ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:48.623455 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-110a50e4-27db-44f5-bc95-d0a6a15acbf5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:48.623959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-110a50e4-27db-44f5-bc95-d0a6a15acbf5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:48.624403 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-110a50e4-27db-44f5-bc95-d0a6a15acbf5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:48.625193 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-110a50e4-27db-44f5-bc95-d0a6a15acbf5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:48.625657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-110a50e4-27db-44f5-bc95-d0a6a15acbf5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:48.626230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-110a50e4-27db-44f5-bc95-d0a6a15acbf5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:48.665955 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-110a50e4-27db-44f5-bc95-d0a6a15acbf5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] HTTP exception thrown: Instance 347ef944-7c69-4650-be60-12e2070c38ad could not be found. Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-110a50e4-27db-44f5-bc95-d0a6a15acbf5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Request method failure captured: Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad/os-volume_attachments HTTP/1.1 Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJaEy18RgNLoRH_Cx5N19ntl_MZAWseAedf6nDvdLqq5Uv9fWq711j0XNb6BgsjwGmwVkwDsYZqRqnlQy1v9Czdk1P2JZBE7MuExsRjBvQLnTgLkLacVPY3yLp9R5pSFE5uStbCf24z3K2C9Y_7prmanNUiQJvOS6fzPpIe1j-F47IQ Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b67fc8dd1f4349ca85422bd9a08d3e06"}]}] Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-DeleteServersTestJSON-485778383 Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-DeleteServersTestJSON-485778383-project Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 1ee6c4d28f304eab89014b9c46cc555a Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-DeleteServersTestJSON-485778383-project Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 347ef944-7c69-4650-be60-12e2070c38ad could not be found. Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'server_id': '347ef944-7c69-4650-be60-12e2070c38ad'} Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 347ef944-7c69-4650-be60-12e2070c38ad could not be found. Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:58:48.678783 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:58:48.687859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 347ef944-7c69-4650-be60-12e2070c38ad could not be found. Oct 29 02:58:48.687859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:58:48.687859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:48.687859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:58:48.687859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:48.687859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:48.687859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:48.687859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:58:48.687859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:58:48.687859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 347ef944-7c69-4650-be60-12e2070c38ad could not be found. Oct 29 02:58:48.687859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:58:48.687859 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-110a50e4-27db-44f5-bc95-d0a6a15acbf5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Returning 404 to user: Instance 347ef944-7c69-4650-be60-12e2070c38ad could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:58:48.687859 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-110a50e4-27db-44f5-bc95-d0a6a15acbf5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.115561 Oct 29 02:58:48.687859 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1251/2732] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 02:58:48 2022] GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad/os-volume_attachments => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:58:48.824741 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d3128ac5-4db5-4463-8c59-eeed9f7e13fc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:48.835394 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d3128ac5-4db5-4463-8c59-eeed9f7e13fc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1718 microversion: 2.1 time: 0.319741 Oct 29 02:58:48.839829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-68301001-10e5-45f8-81b4-9e8df91c283d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:48.840628 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-68301001-10e5-45f8-81b4-9e8df91c283d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:48.847118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68301001-10e5-45f8-81b4-9e8df91c283d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:48.847758 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68301001-10e5-45f8-81b4-9e8df91c283d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:48.848293 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68301001-10e5-45f8-81b4-9e8df91c283d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:48.849134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68301001-10e5-45f8-81b4-9e8df91c283d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:48.849255 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1482/2733] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:48 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1718 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:48.849757 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68301001-10e5-45f8-81b4-9e8df91c283d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:48.850272 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68301001-10e5-45f8-81b4-9e8df91c283d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:48.943192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-412ffb1c-fd88-4408-8b74-53db9a33f128 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-364799655", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "2f016d14-d67d-40f5-811c-d451a32578a4"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:49.022115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-412ffb1c-fd88-4408-8b74-53db9a33f128 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] validate_networks() for [('2f016d14-d67d-40f5-811c-d451a32578a4', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:58:49.027725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-68301001-10e5-45f8-81b4-9e8df91c283d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:49.042991 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-68301001-10e5-45f8-81b4-9e8df91c283d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:49.045751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-68301001-10e5-45f8-81b4-9e8df91c283d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:49.047542 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-68301001-10e5-45f8-81b4-9e8df91c283d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1723 microversion: 2.20 time: 0.211999 Oct 29 02:58:49.048965 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1252/2734] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:48 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:58:49.058156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-06307356-b09a-454e-aa6b-c633e4eaf9fa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:49.059538 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-06307356-b09a-454e-aa6b-c633e4eaf9fa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:49.071039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06307356-b09a-454e-aa6b-c633e4eaf9fa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:49.072390 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06307356-b09a-454e-aa6b-c633e4eaf9fa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:49.073429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06307356-b09a-454e-aa6b-c633e4eaf9fa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:49.074831 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06307356-b09a-454e-aa6b-c633e4eaf9fa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:49.075800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06307356-b09a-454e-aa6b-c633e4eaf9fa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:49.076845 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06307356-b09a-454e-aa6b-c633e4eaf9fa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:49.364736 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-06307356-b09a-454e-aa6b-c633e4eaf9fa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:49.378546 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-06307356-b09a-454e-aa6b-c633e4eaf9fa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1509 microversion: 2.1 time: 0.326057 Oct 29 02:58:49.386261 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1253/2735] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:49 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1509 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:49.396668 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-78760e55-96e7-416a-bd2e-131ba67a6fd3 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:49.398517 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-78760e55-96e7-416a-bd2e-131ba67a6fd3 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: 1117f077-2a55-4632-95ed-f3bd9a5f685a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:49.412558 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78760e55-96e7-416a-bd2e-131ba67a6fd3 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:49.413787 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78760e55-96e7-416a-bd2e-131ba67a6fd3 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:49.414809 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78760e55-96e7-416a-bd2e-131ba67a6fd3 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:49.416348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78760e55-96e7-416a-bd2e-131ba67a6fd3 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:49.417449 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78760e55-96e7-416a-bd2e-131ba67a6fd3 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:49.418622 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78760e55-96e7-416a-bd2e-131ba67a6fd3 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:49.503889 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-78760e55-96e7-416a-bd2e-131ba67a6fd3 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:49.515609 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-78760e55-96e7-416a-bd2e-131ba67a6fd3 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a" status: 200 len: 1270 microversion: 2.1 time: 0.127183 Oct 29 02:58:49.517075 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1254/2736] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:49 2022] GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a => generated 1270 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:49.523792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2aa34b2b-67d5-4c78-b993-df8c438b9f17 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:49.524864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2aa34b2b-67d5-4c78-b993-df8c438b9f17 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:49.532228 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2aa34b2b-67d5-4c78-b993-df8c438b9f17 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:49.533072 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2aa34b2b-67d5-4c78-b993-df8c438b9f17 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:49.533560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2aa34b2b-67d5-4c78-b993-df8c438b9f17 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:49.534344 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2aa34b2b-67d5-4c78-b993-df8c438b9f17 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:49.534832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2aa34b2b-67d5-4c78-b993-df8c438b9f17 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:49.535257 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2aa34b2b-67d5-4c78-b993-df8c438b9f17 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:49.608051 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-412ffb1c-fd88-4408-8b74-53db9a33f128 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:58:49.608629 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-412ffb1c-fd88-4408-8b74-53db9a33f128 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:58:49.608967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-412ffb1c-fd88-4408-8b74-53db9a33f128 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:58:49.609369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-412ffb1c-fd88-4408-8b74-53db9a33f128 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:58:49.609776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-412ffb1c-fd88-4408-8b74-53db9a33f128 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:58:49.621354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-412ffb1c-fd88-4408-8b74-53db9a33f128 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:49.622139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-412ffb1c-fd88-4408-8b74-53db9a33f128 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:49.622735 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-412ffb1c-fd88-4408-8b74-53db9a33f128 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:49.624833 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-412ffb1c-fd88-4408-8b74-53db9a33f128 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:49.625301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-412ffb1c-fd88-4408-8b74-53db9a33f128 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:49.625888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-412ffb1c-fd88-4408-8b74-53db9a33f128 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:49.671489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-412ffb1c-fd88-4408-8b74-53db9a33f128 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Getting quotas for project b67fc8dd1f4349ca85422bd9a08d3e06. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:58:49.678780 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-412ffb1c-fd88-4408-8b74-53db9a33f128 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Getting quotas for user 1ee6c4d28f304eab89014b9c46cc555a and project b67fc8dd1f4349ca85422bd9a08d3e06. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:58:49.704067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-412ffb1c-fd88-4408-8b74-53db9a33f128 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:58:49.707255 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-412ffb1c-fd88-4408-8b74-53db9a33f128 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:58:49.799710 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-412ffb1c-fd88-4408-8b74-53db9a33f128 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.860437 Oct 29 02:58:49.803310 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1483/2737] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:58:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:58:49.816776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d409e214-27e0-498b-8400-0898bccc0571 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:49.817801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d409e214-27e0-498b-8400-0898bccc0571 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:49.823524 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2aa34b2b-67d5-4c78-b993-df8c438b9f17 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:49.828505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d409e214-27e0-498b-8400-0898bccc0571 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:49.829474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d409e214-27e0-498b-8400-0898bccc0571 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:49.830064 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d409e214-27e0-498b-8400-0898bccc0571 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:49.830991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d409e214-27e0-498b-8400-0898bccc0571 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:49.832252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d409e214-27e0-498b-8400-0898bccc0571 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:49.832864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d409e214-27e0-498b-8400-0898bccc0571 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:49.846492 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2aa34b2b-67d5-4c78-b993-df8c438b9f17 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6" status: 200 len: 1498 microversion: 2.1 time: 0.327057 Oct 29 02:58:49.848449 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1255/2738] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:49 2022] GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 => generated 1498 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:49.872406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d336fef9-4bbc-4bd4-8879-6732af5bc6ef tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:49.873363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d336fef9-4bbc-4bd4-8879-6732af5bc6ef tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:49.997803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d409e214-27e0-498b-8400-0898bccc0571 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:50.017053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d409e214-27e0-498b-8400-0898bccc0571 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:50.019625 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d409e214-27e0-498b-8400-0898bccc0571 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:50.020948 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d409e214-27e0-498b-8400-0898bccc0571 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1604 microversion: 2.42 time: 0.216354 Oct 29 02:58:50.032298 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1484/2739] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:49 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1604 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:50.042025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e1ef9fd4-1823-46ce-9dd8-ded4ff08765e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:50.043114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e1ef9fd4-1823-46ce-9dd8-ded4ff08765e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:50.057783 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1ef9fd4-1823-46ce-9dd8-ded4ff08765e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:50.058532 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1ef9fd4-1823-46ce-9dd8-ded4ff08765e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:50.059152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1ef9fd4-1823-46ce-9dd8-ded4ff08765e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:50.060027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1ef9fd4-1823-46ce-9dd8-ded4ff08765e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:50.062785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1ef9fd4-1823-46ce-9dd8-ded4ff08765e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:50.063415 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1ef9fd4-1823-46ce-9dd8-ded4ff08765e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:50.142967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d336fef9-4bbc-4bd4-8879-6732af5bc6ef tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:50.161117 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d336fef9-4bbc-4bd4-8879-6732af5bc6ef tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0" status: 200 len: 1214 microversion: 2.1 time: 0.298072 Oct 29 02:58:50.161802 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1256/2740] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:49 2022] GET /compute/v2.1/servers/8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0 => generated 1214 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:50.169982 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-075c79e6-2936-4ca9-b404-ba3e77fb9681 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:50.170912 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-075c79e6-2936-4ca9-b404-ba3e77fb9681 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:50.192014 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-075c79e6-2936-4ca9-b404-ba3e77fb9681 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:50.192499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-075c79e6-2936-4ca9-b404-ba3e77fb9681 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:50.193115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-075c79e6-2936-4ca9-b404-ba3e77fb9681 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:50.194989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-075c79e6-2936-4ca9-b404-ba3e77fb9681 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:50.195459 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-075c79e6-2936-4ca9-b404-ba3e77fb9681 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:50.195893 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-075c79e6-2936-4ca9-b404-ba3e77fb9681 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:50.336602 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e1ef9fd4-1823-46ce-9dd8-ded4ff08765e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:50.365601 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e1ef9fd4-1823-46ce-9dd8-ded4ff08765e tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1718 microversion: 2.1 time: 0.328773 Oct 29 02:58:50.376643 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1485/2741] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:50 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1718 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:50.387487 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a8467b78-de96-4778-bd02-ba17505cc854 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:50.392921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a8467b78-de96-4778-bd02-ba17505cc854 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:50.428274 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a8467b78-de96-4778-bd02-ba17505cc854 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:58:50.612793 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-075c79e6-2936-4ca9-b404-ba3e77fb9681 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:50.624771 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-075c79e6-2936-4ca9-b404-ba3e77fb9681 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:50.630753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-075c79e6-2936-4ca9-b404-ba3e77fb9681 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:50.641715 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-075c79e6-2936-4ca9-b404-ba3e77fb9681 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1723 microversion: 2.20 time: 0.478184 Oct 29 02:58:50.645093 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1257/2742] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:50 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1723 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:50.669424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ecacb700-b7b5-43d6-9a7f-fb536a4486df tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:50.670142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ecacb700-b7b5-43d6-9a7f-fb536a4486df tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:50.694646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecacb700-b7b5-43d6-9a7f-fb536a4486df tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:50.696213 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecacb700-b7b5-43d6-9a7f-fb536a4486df tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:50.697152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecacb700-b7b5-43d6-9a7f-fb536a4486df tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:50.698233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecacb700-b7b5-43d6-9a7f-fb536a4486df tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:50.698887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecacb700-b7b5-43d6-9a7f-fb536a4486df tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:50.699569 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.compute.api [None req-a8467b78-de96-4778-bd02-ba17505cc854 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0] Instance Mapping does not exist while attempting local delete cleanup. Oct 29 02:58:50.700876 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a8467b78-de96-4778-bd02-ba17505cc854 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0" status: 204 len: 0 microversion: 2.1 time: 0.331264 Oct 29 02:58:50.706185 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecacb700-b7b5-43d6-9a7f-fb536a4486df tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:50.706900 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1486/2743] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:58:50 2022] DELETE /compute/v2.1/servers/8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:58:50.727266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fea8d3cb-c7f6-4bd0-9e75-760d274e95b7 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:50.728346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fea8d3cb-c7f6-4bd0-9e75-760d274e95b7 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: 1117f077-2a55-4632-95ed-f3bd9a5f685a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:50.750437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fea8d3cb-c7f6-4bd0-9e75-760d274e95b7 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:50.754810 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fea8d3cb-c7f6-4bd0-9e75-760d274e95b7 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:50.757243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fea8d3cb-c7f6-4bd0-9e75-760d274e95b7 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:50.759077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fea8d3cb-c7f6-4bd0-9e75-760d274e95b7 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:50.762408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fea8d3cb-c7f6-4bd0-9e75-760d274e95b7 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:50.764709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fea8d3cb-c7f6-4bd0-9e75-760d274e95b7 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:50.908979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fea8d3cb-c7f6-4bd0-9e75-760d274e95b7 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:50.918385 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fea8d3cb-c7f6-4bd0-9e75-760d274e95b7 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a" status: 200 len: 1276 microversion: 2.1 time: 0.205413 Oct 29 02:58:50.919556 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1487/2744] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:50 2022] GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a => generated 1276 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:50.925448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d1095ac8-5db0-42e4-90dc-7a86f30df7ac tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:50.926323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d1095ac8-5db0-42e4-90dc-7a86f30df7ac tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:50.937306 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-d1095ac8-5db0-42e4-90dc-7a86f30df7ac tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] HTTP exception thrown: Instance 8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0 could not be found. Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d1095ac8-5db0-42e4-90dc-7a86f30df7ac tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Request method failure captured: Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0 HTTP/1.1 Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJaEy18RgNLoRH_Cx5N19ntl_MZAWseAedf6nDvdLqq5Uv9fWq711j0XNb6BgsjwGmwVkwDsYZqRqnlQy1v9Czdk1P2JZBE7MuExsRjBvQLnTgLkLacVPY3yLp9R5pSFE5uStbCf24z3K2C9Y_7prmanNUiQJvOS6fzPpIe1j-F47IQ Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b67fc8dd1f4349ca85422bd9a08d3e06"}]}] Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-DeleteServersTestJSON-485778383 Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-DeleteServersTestJSON-485778383-project Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 1ee6c4d28f304eab89014b9c46cc555a Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-DeleteServersTestJSON-485778383-project Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0 could not be found. Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0'} Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0 could not be found. Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0 could not be found. Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:50.940198 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:50.945616 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:50.945616 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:58:50.945616 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:58:50.945616 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0 could not be found. Oct 29 02:58:50.945616 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:58:50.948408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d1095ac8-5db0-42e4-90dc-7a86f30df7ac tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Returning 404 to user: Instance 8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:58:50.949614 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d1095ac8-5db0-42e4-90dc-7a86f30df7ac tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0" status: 404 len: 111 microversion: 2.1 time: 0.028861 Oct 29 02:58:50.950761 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1488/2745] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:50 2022] GET /compute/v2.1/servers/8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:58:50.957790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fb3efc9e-3db7-458f-8d86-7f5e32a7ca6d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:50.958836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fb3efc9e-3db7-458f-8d86-7f5e32a7ca6d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:51.002386 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fb3efc9e-3db7-458f-8d86-7f5e32a7ca6d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:51.003060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fb3efc9e-3db7-458f-8d86-7f5e32a7ca6d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:51.003936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fb3efc9e-3db7-458f-8d86-7f5e32a7ca6d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:51.004915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fb3efc9e-3db7-458f-8d86-7f5e32a7ca6d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:51.005619 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fb3efc9e-3db7-458f-8d86-7f5e32a7ca6d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:51.006261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fb3efc9e-3db7-458f-8d86-7f5e32a7ca6d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:51.158410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ecacb700-b7b5-43d6-9a7f-fb536a4486df tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:51.178619 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ecacb700-b7b5-43d6-9a7f-fb536a4486df tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1452 microversion: 2.1 time: 0.531828 Oct 29 02:58:51.180853 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1258/2746] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:50 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1452 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:51.190780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-e970b67e-da38-4cfb-9f74-86ec0b52b8d8 req-2524aa4e-0a5a-4ef0-8944-fa71da3ba673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d9854a1-ead6-4570-b801-13c47d0bf721", "name": "network-vif-unplugged", "status": "completed", "tag": "5c797ecc-c991-49d4-a9d6-68c2398ef486"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:51.214393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e970b67e-da38-4cfb-9f74-86ec0b52b8d8 req-2524aa4e-0a5a-4ef0-8944-fa71da3ba673 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:51.217335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e970b67e-da38-4cfb-9f74-86ec0b52b8d8 req-2524aa4e-0a5a-4ef0-8944-fa71da3ba673 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:51.217654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fb3efc9e-3db7-458f-8d86-7f5e32a7ca6d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:51.220722 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e970b67e-da38-4cfb-9f74-86ec0b52b8d8 req-2524aa4e-0a5a-4ef0-8944-fa71da3ba673 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:51.235931 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fb3efc9e-3db7-458f-8d86-7f5e32a7ca6d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6" status: 200 len: 1498 microversion: 2.1 time: 0.282754 Oct 29 02:58:51.237013 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1489/2747] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:50 2022] GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 => generated 1498 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:51.244931 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e287f830-950b-4f11-bc96-c17ff5cadc4d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-895077916", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "2f016d14-d67d-40f5-811c-d451a32578a4"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:51.270356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.compute.server_external_events [req-e970b67e-da38-4cfb-9f74-86ec0b52b8d8 req-2524aa4e-0a5a-4ef0-8944-fa71da3ba673 service nova] Unable to find a host for instance 5d9854a1-ead6-4570-b801-13c47d0bf721. Dropping event network-vif-unplugged {{(pid=127125) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 29 02:58:51.274703 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-e970b67e-da38-4cfb-9f74-86ec0b52b8d8 req-2524aa4e-0a5a-4ef0-8944-fa71da3ba673 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.089693 Oct 29 02:58:51.276849 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1259/2748] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 91 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 29 02:58:51.288984 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-822dfb0d-5c89-4afb-81e6-9e2df73b0fe7 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:51.295044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-822dfb0d-5c89-4afb-81e6-9e2df73b0fe7 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:51.303661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-822dfb0d-5c89-4afb-81e6-9e2df73b0fe7 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:51.305490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-822dfb0d-5c89-4afb-81e6-9e2df73b0fe7 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:51.305490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-822dfb0d-5c89-4afb-81e6-9e2df73b0fe7 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:51.310781 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-822dfb0d-5c89-4afb-81e6-9e2df73b0fe7 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:51.310781 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-822dfb0d-5c89-4afb-81e6-9e2df73b0fe7 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:51.310781 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-822dfb0d-5c89-4afb-81e6-9e2df73b0fe7 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:51.336610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-e287f830-950b-4f11-bc96-c17ff5cadc4d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] validate_networks() for [('2f016d14-d67d-40f5-811c-d451a32578a4', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:58:51.790338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-822dfb0d-5c89-4afb-81e6-9e2df73b0fe7 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:51.812119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-822dfb0d-5c89-4afb-81e6-9e2df73b0fe7 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:51.814221 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-822dfb0d-5c89-4afb-81e6-9e2df73b0fe7 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:51.815745 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-822dfb0d-5c89-4afb-81e6-9e2df73b0fe7 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1604 microversion: 2.42 time: 0.536901 Oct 29 02:58:51.846575 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1260/2749] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:51 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1604 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:51.858489 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7ff5c6bb-e9c9-4e48-b9fd-378d520a4318 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:51.862829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7ff5c6bb-e9c9-4e48-b9fd-378d520a4318 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:51.876115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ff5c6bb-e9c9-4e48-b9fd-378d520a4318 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:51.877217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ff5c6bb-e9c9-4e48-b9fd-378d520a4318 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:51.878107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ff5c6bb-e9c9-4e48-b9fd-378d520a4318 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:51.879118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ff5c6bb-e9c9-4e48-b9fd-378d520a4318 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:51.879820 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ff5c6bb-e9c9-4e48-b9fd-378d520a4318 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:51.880472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ff5c6bb-e9c9-4e48-b9fd-378d520a4318 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:51.896950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e287f830-950b-4f11-bc96-c17ff5cadc4d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:58:51.897479 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e287f830-950b-4f11-bc96-c17ff5cadc4d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:58:51.897884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e287f830-950b-4f11-bc96-c17ff5cadc4d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:58:51.898301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e287f830-950b-4f11-bc96-c17ff5cadc4d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:58:51.898715 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e287f830-950b-4f11-bc96-c17ff5cadc4d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:58:51.916028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e287f830-950b-4f11-bc96-c17ff5cadc4d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:51.916735 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e287f830-950b-4f11-bc96-c17ff5cadc4d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:51.917319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e287f830-950b-4f11-bc96-c17ff5cadc4d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:51.918483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e287f830-950b-4f11-bc96-c17ff5cadc4d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:51.919192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e287f830-950b-4f11-bc96-c17ff5cadc4d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:51.919952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e287f830-950b-4f11-bc96-c17ff5cadc4d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:51.964335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-e287f830-950b-4f11-bc96-c17ff5cadc4d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Getting quotas for project b67fc8dd1f4349ca85422bd9a08d3e06. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:58:51.971802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:51.989376 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-e287f830-950b-4f11-bc96-c17ff5cadc4d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Getting quotas for user 1ee6c4d28f304eab89014b9c46cc555a and project b67fc8dd1f4349ca85422bd9a08d3e06. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:58:52.041695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e287f830-950b-4f11-bc96-c17ff5cadc4d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:58:52.044326 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e287f830-950b-4f11-bc96-c17ff5cadc4d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: d4cf7226-5b9f-4b20-9294-5fc3f0118ebd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:58:52.156268 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e287f830-950b-4f11-bc96-c17ff5cadc4d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.913701 Oct 29 02:58:52.164312 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1490/2750] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:58:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:58:52.170849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d1f29217-c707-4263-b49e-285614091755 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:52.171743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d1f29217-c707-4263-b49e-285614091755 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:52.183747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1f29217-c707-4263-b49e-285614091755 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:52.185739 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1f29217-c707-4263-b49e-285614091755 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:52.186611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1f29217-c707-4263-b49e-285614091755 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:52.187551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1f29217-c707-4263-b49e-285614091755 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:52.188279 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1f29217-c707-4263-b49e-285614091755 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:52.188938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1f29217-c707-4263-b49e-285614091755 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:52.247515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7ff5c6bb-e9c9-4e48-b9fd-378d520a4318 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:52.256870 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7ff5c6bb-e9c9-4e48-b9fd-378d520a4318 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1452 microversion: 2.1 time: 0.408604 Oct 29 02:58:52.270521 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1261/2751] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:51 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1452 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:52.297172 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-106c42d3-139e-4165-964a-b4e7cbfbb3b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:52.305425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-106c42d3-139e-4165-964a-b4e7cbfbb3b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:52.323851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-106c42d3-139e-4165-964a-b4e7cbfbb3b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:52.324347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-106c42d3-139e-4165-964a-b4e7cbfbb3b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:52.328214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-106c42d3-139e-4165-964a-b4e7cbfbb3b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:52.336878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-106c42d3-139e-4165-964a-b4e7cbfbb3b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:52.341731 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-106c42d3-139e-4165-964a-b4e7cbfbb3b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:52.342233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-106c42d3-139e-4165-964a-b4e7cbfbb3b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:52.429844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d1f29217-c707-4263-b49e-285614091755 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:52.442381 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d1f29217-c707-4263-b49e-285614091755 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1718 microversion: 2.1 time: 0.276333 Oct 29 02:58:52.446993 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1491/2752] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:52 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1718 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:52.459965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e2bfc39c-37ad-4593-a361-4ad52b010570 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:52.461068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e2bfc39c-37ad-4593-a361-4ad52b010570 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: 1117f077-2a55-4632-95ed-f3bd9a5f685a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:52.474503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e2bfc39c-37ad-4593-a361-4ad52b010570 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:52.475216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e2bfc39c-37ad-4593-a361-4ad52b010570 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:52.475970 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e2bfc39c-37ad-4593-a361-4ad52b010570 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:52.476765 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e2bfc39c-37ad-4593-a361-4ad52b010570 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:52.479825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e2bfc39c-37ad-4593-a361-4ad52b010570 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:52.480307 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e2bfc39c-37ad-4593-a361-4ad52b010570 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:52.679592 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-106c42d3-139e-4165-964a-b4e7cbfbb3b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:52.693469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-106c42d3-139e-4165-964a-b4e7cbfbb3b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:52.700049 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-106c42d3-139e-4165-964a-b4e7cbfbb3b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:52.701694 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-106c42d3-139e-4165-964a-b4e7cbfbb3b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1723 microversion: 2.20 time: 0.429796 Oct 29 02:58:52.705541 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1262/2753] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:52 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1723 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:52.719997 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c280b192-738a-4710-a4bd-d6449a80a876 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:52.722072 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c280b192-738a-4710-a4bd-d6449a80a876 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: d4cf7226-5b9f-4b20-9294-5fc3f0118ebd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:52.782536 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e2bfc39c-37ad-4593-a361-4ad52b010570 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:52.791917 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e2bfc39c-37ad-4593-a361-4ad52b010570 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a" status: 200 len: 1318 microversion: 2.1 time: 0.343377 Oct 29 02:58:52.805393 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1492/2754] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:52 2022] GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:52.805393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-33009d16-bedf-4dca-a39f-7950284ddd3c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:52.805393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-33009d16-bedf-4dca-a39f-7950284ddd3c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:52.813518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33009d16-bedf-4dca-a39f-7950284ddd3c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:52.814329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33009d16-bedf-4dca-a39f-7950284ddd3c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:52.815008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33009d16-bedf-4dca-a39f-7950284ddd3c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:52.816209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33009d16-bedf-4dca-a39f-7950284ddd3c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:52.817004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33009d16-bedf-4dca-a39f-7950284ddd3c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:52.817592 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33009d16-bedf-4dca-a39f-7950284ddd3c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:52.863718 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c280b192-738a-4710-a4bd-d6449a80a876 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:52.880788 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c280b192-738a-4710-a4bd-d6449a80a876 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd" status: 200 len: 1214 microversion: 2.1 time: 0.172658 Oct 29 02:58:52.882315 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1263/2755] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:52 2022] GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd => generated 1214 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:52.888403 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a3519a81-0ee5-4e59-a622-1e53b2a02568 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:52.889280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a3519a81-0ee5-4e59-a622-1e53b2a02568 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:52.896453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3519a81-0ee5-4e59-a622-1e53b2a02568 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:52.897817 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3519a81-0ee5-4e59-a622-1e53b2a02568 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:52.898451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3519a81-0ee5-4e59-a622-1e53b2a02568 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:52.899344 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3519a81-0ee5-4e59-a622-1e53b2a02568 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:52.899979 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3519a81-0ee5-4e59-a622-1e53b2a02568 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:52.900630 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3519a81-0ee5-4e59-a622-1e53b2a02568 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:52.931133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-a3519a81-0ee5-4e59-a622-1e53b2a02568 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lazy-loading 'flavor' on Instance uuid 5d9854a1-ead6-4570-b801-13c47d0bf721 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:58:52.946654 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-a3519a81-0ee5-4e59-a622-1e53b2a02568 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Cannot 'shelve' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state shelved_offloaded Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a3519a81-0ee5-4e59-a622-1e53b2a02568 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action HTTP/1.1 Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 14 Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: {"shelve": {}} Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: exception: Cannot 'shelve' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state shelved_offloaded Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '5d9854a1-ead6-4570-b801-13c47d0bf721', 'body': {'shelve': {}}} Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5d9854a1-ead6-4570-b801-13c47d0bf721 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 02:58:52.948964 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 02:58:52.953835 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state shelved_offloaded Oct 29 02:58:52.953835 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:58:52.953835 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:58:52.953835 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:58:52.953835 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:58:52.953835 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:58:52.953835 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:58:52.953835 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:58:52.953835 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:58:52.953835 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state shelved_offloaded Oct 29 02:58:52.953835 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:58:52.955845 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a3519a81-0ee5-4e59-a622-1e53b2a02568 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 409 to user: Cannot 'shelve' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state shelved_offloaded {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:58:52.956956 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a3519a81-0ee5-4e59-a622-1e53b2a02568 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action" status: 409 len: 155 microversion: 2.1 time: 0.073336 Oct 29 02:58:52.958264 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1264/2756] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:58:52 2022] POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action => generated 155 bytes in 75 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 02:58:52.963772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7ade7c73-f28e-4043-955a-af56e8079f39 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:52.964740 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7ade7c73-f28e-4043-955a-af56e8079f39 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:52.971928 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ade7c73-f28e-4043-955a-af56e8079f39 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:52.972703 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ade7c73-f28e-4043-955a-af56e8079f39 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:52.973340 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ade7c73-f28e-4043-955a-af56e8079f39 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:52.974233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ade7c73-f28e-4043-955a-af56e8079f39 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:52.974871 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ade7c73-f28e-4043-955a-af56e8079f39 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:52.975695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ade7c73-f28e-4043-955a-af56e8079f39 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:52.998367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:53.072973 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7ade7c73-f28e-4043-955a-af56e8079f39 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:53.090629 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7ade7c73-f28e-4043-955a-af56e8079f39 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:53.094304 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7ade7c73-f28e-4043-955a-af56e8079f39 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:53.097149 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-33009d16-bedf-4dca-a39f-7950284ddd3c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:53.098214 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7ade7c73-f28e-4043-955a-af56e8079f39 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1604 microversion: 2.42 time: 0.136211 Oct 29 02:58:53.099224 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1265/2757] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:52 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1604 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:53.109444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3d587334-d2f4-4196-9702-eee7d05db950 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:53.110038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3d587334-d2f4-4196-9702-eee7d05db950 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:53.132631 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d587334-d2f4-4196-9702-eee7d05db950 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:53.132631 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d587334-d2f4-4196-9702-eee7d05db950 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:53.132631 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d587334-d2f4-4196-9702-eee7d05db950 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:53.133283 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-33009d16-bedf-4dca-a39f-7950284ddd3c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6" status: 200 len: 1498 microversion: 2.1 time: 0.338141 Oct 29 02:58:53.134425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d587334-d2f4-4196-9702-eee7d05db950 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:53.135247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d587334-d2f4-4196-9702-eee7d05db950 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:53.138269 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d587334-d2f4-4196-9702-eee7d05db950 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:53.164981 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1493/2758] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:52 2022] GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 => generated 1498 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:53.188319 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3d587334-d2f4-4196-9702-eee7d05db950 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127125) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 29 02:58:53.351591 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3d587334-d2f4-4196-9702-eee7d05db950 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action" status: 202 len: 0 microversion: 2.1 time: 0.246524 Oct 29 02:58:53.353560 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1266/2759] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:58:53 2022] POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:58:53.361332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2a402331-cf82-4f1b-a80e-a153cbcba986 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:53.362017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2a402331-cf82-4f1b-a80e-a153cbcba986 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:53.390172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2a402331-cf82-4f1b-a80e-a153cbcba986 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:53.390720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2a402331-cf82-4f1b-a80e-a153cbcba986 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:53.391189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2a402331-cf82-4f1b-a80e-a153cbcba986 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:53.397955 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2a402331-cf82-4f1b-a80e-a153cbcba986 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:53.398497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2a402331-cf82-4f1b-a80e-a153cbcba986 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:53.399080 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2a402331-cf82-4f1b-a80e-a153cbcba986 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:53.441016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:53.471656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-053e1caf-0ba8-40f8-8697-110886628445 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:53.472660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-053e1caf-0ba8-40f8-8697-110886628445 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:53.481703 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-053e1caf-0ba8-40f8-8697-110886628445 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:53.482567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-053e1caf-0ba8-40f8-8697-110886628445 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:53.483390 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-053e1caf-0ba8-40f8-8697-110886628445 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:53.484354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-053e1caf-0ba8-40f8-8697-110886628445 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:53.485162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-053e1caf-0ba8-40f8-8697-110886628445 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:53.485826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-053e1caf-0ba8-40f8-8697-110886628445 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:53.703094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2a402331-cf82-4f1b-a80e-a153cbcba986 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:53.712112 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2a402331-cf82-4f1b-a80e-a153cbcba986 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1460 microversion: 2.1 time: 0.354814 Oct 29 02:58:53.714870 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1494/2760] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:53 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1460 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:53.738152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-61262dfa-3033-41b6-b79c-70424e5e58d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:53.739186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-61262dfa-3033-41b6-b79c-70424e5e58d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:53.757042 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-61262dfa-3033-41b6-b79c-70424e5e58d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:53.759938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-61262dfa-3033-41b6-b79c-70424e5e58d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:53.761467 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-61262dfa-3033-41b6-b79c-70424e5e58d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:53.762943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-61262dfa-3033-41b6-b79c-70424e5e58d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:53.768038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-61262dfa-3033-41b6-b79c-70424e5e58d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:53.769691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-61262dfa-3033-41b6-b79c-70424e5e58d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:54.042369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-61262dfa-3033-41b6-b79c-70424e5e58d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:54.052321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-61262dfa-3033-41b6-b79c-70424e5e58d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:54.062693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-61262dfa-3033-41b6-b79c-70424e5e58d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:54.065215 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-61262dfa-3033-41b6-b79c-70424e5e58d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1723 microversion: 2.20 time: 0.331761 Oct 29 02:58:54.081216 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1495/2761] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:53 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1723 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:58:54.103154 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b595feb0-1f2b-4e3e-94a3-f0cac98363fa tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:54.104045 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b595feb0-1f2b-4e3e-94a3-f0cac98363fa tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: 1117f077-2a55-4632-95ed-f3bd9a5f685a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:54.122226 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b595feb0-1f2b-4e3e-94a3-f0cac98363fa tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:54.122940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b595feb0-1f2b-4e3e-94a3-f0cac98363fa tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:54.123083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-053e1caf-0ba8-40f8-8697-110886628445 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:54.125101 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b595feb0-1f2b-4e3e-94a3-f0cac98363fa tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:54.129116 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b595feb0-1f2b-4e3e-94a3-f0cac98363fa tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:54.130160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b595feb0-1f2b-4e3e-94a3-f0cac98363fa tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:54.133251 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b595feb0-1f2b-4e3e-94a3-f0cac98363fa tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:54.140904 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-053e1caf-0ba8-40f8-8697-110886628445 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1718 microversion: 2.1 time: 0.674727 Oct 29 02:58:54.147850 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1267/2762] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:53 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1718 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:58:54.164961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-e65512e6-8ff9-44f0-b6c8-89a41f06948e req-33819957-edf5-4281-9ab9-1be638995f16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1117f077-2a55-4632-95ed-f3bd9a5f685a", "tag": "dc4993cb-362f-41b9-815f-a3711444c86e"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:54.205665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e65512e6-8ff9-44f0-b6c8-89a41f06948e req-33819957-edf5-4281-9ab9-1be638995f16 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:54.206382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e65512e6-8ff9-44f0-b6c8-89a41f06948e req-33819957-edf5-4281-9ab9-1be638995f16 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:54.208311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e65512e6-8ff9-44f0-b6c8-89a41f06948e req-33819957-edf5-4281-9ab9-1be638995f16 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:54.255471 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-e65512e6-8ff9-44f0-b6c8-89a41f06948e req-33819957-edf5-4281-9ab9-1be638995f16 service nova] Creating event network-changed:dc4993cb-362f-41b9-815f-a3711444c86e for instance 1117f077-2a55-4632-95ed-f3bd9a5f685a on n-h1-862967-2 Oct 29 02:58:54.280848 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-e65512e6-8ff9-44f0-b6c8-89a41f06948e req-33819957-edf5-4281-9ab9-1be638995f16 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131258 Oct 29 02:58:54.286512 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1268/2763] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:58:54.311059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7101bca6-99d0-4792-a38b-926a2fc08767 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:54.317639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7101bca6-99d0-4792-a38b-926a2fc08767 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: d4cf7226-5b9f-4b20-9294-5fc3f0118ebd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:54.358767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7101bca6-99d0-4792-a38b-926a2fc08767 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:54.359325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7101bca6-99d0-4792-a38b-926a2fc08767 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:54.359678 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7101bca6-99d0-4792-a38b-926a2fc08767 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:54.368755 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7101bca6-99d0-4792-a38b-926a2fc08767 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:54.370768 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7101bca6-99d0-4792-a38b-926a2fc08767 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:54.371508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7101bca6-99d0-4792-a38b-926a2fc08767 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:54.450691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b595feb0-1f2b-4e3e-94a3-f0cac98363fa tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:54.466601 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b595feb0-1f2b-4e3e-94a3-f0cac98363fa tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a" status: 200 len: 1318 microversion: 2.1 time: 0.384016 Oct 29 02:58:54.486081 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1496/2764] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:54 2022] GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:54.494170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6667bc3f-b877-4ab4-b81e-ef0e6415a36b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:54.495318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6667bc3f-b877-4ab4-b81e-ef0e6415a36b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:54.503098 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6667bc3f-b877-4ab4-b81e-ef0e6415a36b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:54.503966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6667bc3f-b877-4ab4-b81e-ef0e6415a36b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:54.504695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6667bc3f-b877-4ab4-b81e-ef0e6415a36b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:54.507323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6667bc3f-b877-4ab4-b81e-ef0e6415a36b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:54.509027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6667bc3f-b877-4ab4-b81e-ef0e6415a36b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:54.509712 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6667bc3f-b877-4ab4-b81e-ef0e6415a36b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:54.565920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7101bca6-99d0-4792-a38b-926a2fc08767 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:54.575061 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7101bca6-99d0-4792-a38b-926a2fc08767 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd" status: 200 len: 1266 microversion: 2.1 time: 0.287014 Oct 29 02:58:54.575671 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1269/2765] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:54 2022] GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd => generated 1266 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:54.586508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5992dc64-c296-4d90-a32b-b7a56982bfa2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:54.587132 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5992dc64-c296-4d90-a32b-b7a56982bfa2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:54.604669 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5992dc64-c296-4d90-a32b-b7a56982bfa2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:54.605173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5992dc64-c296-4d90-a32b-b7a56982bfa2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:54.605618 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5992dc64-c296-4d90-a32b-b7a56982bfa2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:54.606338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5992dc64-c296-4d90-a32b-b7a56982bfa2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:54.606791 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5992dc64-c296-4d90-a32b-b7a56982bfa2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:54.607220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5992dc64-c296-4d90-a32b-b7a56982bfa2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:54.620994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6667bc3f-b877-4ab4-b81e-ef0e6415a36b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:54.637040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6667bc3f-b877-4ab4-b81e-ef0e6415a36b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:54.643160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6667bc3f-b877-4ab4-b81e-ef0e6415a36b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:54.647846 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6667bc3f-b877-4ab4-b81e-ef0e6415a36b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1604 microversion: 2.42 time: 0.156941 Oct 29 02:58:54.648734 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1497/2766] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:54 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1604 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:54.744476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a6be0eb6-b2b9-4676-b645-e6105bc7044d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:54.745538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a6be0eb6-b2b9-4676-b645-e6105bc7044d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:54.760901 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6be0eb6-b2b9-4676-b645-e6105bc7044d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:54.762182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6be0eb6-b2b9-4676-b645-e6105bc7044d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:54.763259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6be0eb6-b2b9-4676-b645-e6105bc7044d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:54.765770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6be0eb6-b2b9-4676-b645-e6105bc7044d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:54.768321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6be0eb6-b2b9-4676-b645-e6105bc7044d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:54.768991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6be0eb6-b2b9-4676-b645-e6105bc7044d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:54.865395 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5992dc64-c296-4d90-a32b-b7a56982bfa2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:54.881449 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5992dc64-c296-4d90-a32b-b7a56982bfa2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6" status: 200 len: 1498 microversion: 2.1 time: 0.304683 Oct 29 02:58:54.882503 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1270/2767] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:54 2022] GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 => generated 1498 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:55.096648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e0d1e04b-4816-4dcf-b671-b4abff9e9e20 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:55.097548 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e0d1e04b-4816-4dcf-b671-b4abff9e9e20 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:55.108209 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0d1e04b-4816-4dcf-b671-b4abff9e9e20 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:55.111184 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0d1e04b-4816-4dcf-b671-b4abff9e9e20 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:55.113245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0d1e04b-4816-4dcf-b671-b4abff9e9e20 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:55.118236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0d1e04b-4816-4dcf-b671-b4abff9e9e20 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:55.119413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0d1e04b-4816-4dcf-b671-b4abff9e9e20 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:55.120073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0d1e04b-4816-4dcf-b671-b4abff9e9e20 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:55.180551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a6be0eb6-b2b9-4676-b645-e6105bc7044d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:55.191217 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a6be0eb6-b2b9-4676-b645-e6105bc7044d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1460 microversion: 2.1 time: 0.453695 Oct 29 02:58:55.196423 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1498/2768] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:54 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1460 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:55.205139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4ad3914c-ca15-4c25-8ec3-d11add2e627c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:55.215188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4ad3914c-ca15-4c25-8ec3-d11add2e627c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:55.244422 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ad3914c-ca15-4c25-8ec3-d11add2e627c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:55.244942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ad3914c-ca15-4c25-8ec3-d11add2e627c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:55.245374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ad3914c-ca15-4c25-8ec3-d11add2e627c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:55.246096 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ad3914c-ca15-4c25-8ec3-d11add2e627c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:55.246555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ad3914c-ca15-4c25-8ec3-d11add2e627c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:55.247034 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ad3914c-ca15-4c25-8ec3-d11add2e627c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:55.323277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e0d1e04b-4816-4dcf-b671-b4abff9e9e20 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:55.333513 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e0d1e04b-4816-4dcf-b671-b4abff9e9e20 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:55.334966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e0d1e04b-4816-4dcf-b671-b4abff9e9e20 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:55.337275 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e0d1e04b-4816-4dcf-b671-b4abff9e9e20 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1723 microversion: 2.20 time: 0.245209 Oct 29 02:58:55.338235 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1271/2769] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:55 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:55.495758 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7b0f95af-e1d2-46c6-b3b9-de26022bb216 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:55.497370 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7b0f95af-e1d2-46c6-b3b9-de26022bb216 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: 1117f077-2a55-4632-95ed-f3bd9a5f685a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:55.504716 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7b0f95af-e1d2-46c6-b3b9-de26022bb216 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:55.505587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7b0f95af-e1d2-46c6-b3b9-de26022bb216 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:55.506228 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7b0f95af-e1d2-46c6-b3b9-de26022bb216 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:55.507223 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7b0f95af-e1d2-46c6-b3b9-de26022bb216 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:55.507884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7b0f95af-e1d2-46c6-b3b9-de26022bb216 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:55.508866 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7b0f95af-e1d2-46c6-b3b9-de26022bb216 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:55.661806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7b0f95af-e1d2-46c6-b3b9-de26022bb216 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:55.671050 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7b0f95af-e1d2-46c6-b3b9-de26022bb216 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a" status: 200 len: 1318 microversion: 2.1 time: 0.179189 Oct 29 02:58:55.671990 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1272/2770] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:55 2022] GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:55.676834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-676876b3-7ad2-4fd1-ada2-5353863f252d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:55.677460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-676876b3-7ad2-4fd1-ada2-5353863f252d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: d4cf7226-5b9f-4b20-9294-5fc3f0118ebd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:55.691882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-676876b3-7ad2-4fd1-ada2-5353863f252d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:55.692492 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-676876b3-7ad2-4fd1-ada2-5353863f252d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:55.692952 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-676876b3-7ad2-4fd1-ada2-5353863f252d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:55.693670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-676876b3-7ad2-4fd1-ada2-5353863f252d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:55.694128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-676876b3-7ad2-4fd1-ada2-5353863f252d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:55.694666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-676876b3-7ad2-4fd1-ada2-5353863f252d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:55.766256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-676876b3-7ad2-4fd1-ada2-5353863f252d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:55.775275 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-676876b3-7ad2-4fd1-ada2-5353863f252d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd" status: 200 len: 1272 microversion: 2.1 time: 0.102094 Oct 29 02:58:55.776194 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1273/2771] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:55 2022] GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd => generated 1272 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:55.780819 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e3d21922-1095-44d9-a92c-6e3ab1471e99 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:55.781580 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e3d21922-1095-44d9-a92c-6e3ab1471e99 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:55.794283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3d21922-1095-44d9-a92c-6e3ab1471e99 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:55.794776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3d21922-1095-44d9-a92c-6e3ab1471e99 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:55.795210 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3d21922-1095-44d9-a92c-6e3ab1471e99 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:55.795928 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3d21922-1095-44d9-a92c-6e3ab1471e99 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:55.796382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3d21922-1095-44d9-a92c-6e3ab1471e99 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:55.796835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3d21922-1095-44d9-a92c-6e3ab1471e99 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:55.880025 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e3d21922-1095-44d9-a92c-6e3ab1471e99 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:55.899740 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e3d21922-1095-44d9-a92c-6e3ab1471e99 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:55.904933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e3d21922-1095-44d9-a92c-6e3ab1471e99 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:55.906548 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e3d21922-1095-44d9-a92c-6e3ab1471e99 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1604 microversion: 2.42 time: 0.129241 Oct 29 02:58:55.924635 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1274/2772] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:55 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1604 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:55.924635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2701d0fd-ce27-4023-a895-4dafc1fbad43 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:55.924635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2701d0fd-ce27-4023-a895-4dafc1fbad43 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:55.929724 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2701d0fd-ce27-4023-a895-4dafc1fbad43 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:55.930804 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2701d0fd-ce27-4023-a895-4dafc1fbad43 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:55.931251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2701d0fd-ce27-4023-a895-4dafc1fbad43 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:55.931967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2701d0fd-ce27-4023-a895-4dafc1fbad43 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:55.932418 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2701d0fd-ce27-4023-a895-4dafc1fbad43 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:55.933534 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2701d0fd-ce27-4023-a895-4dafc1fbad43 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:55.970540 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4ad3914c-ca15-4c25-8ec3-d11add2e627c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:55.980072 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4ad3914c-ca15-4c25-8ec3-d11add2e627c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1718 microversion: 2.1 time: 0.782252 Oct 29 02:58:55.980390 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:55.993393 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1499/2773] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:55 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1718 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:56.214860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-f2703db4-3035-47b8-b2c8-618761e13ad9 req-57b2fd72-eec4-4895-aaff-5116dd41d16d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b40f7b3b-04d4-4cfa-8058-09afc05d791e", "name": "network-vif-unplugged", "status": "completed", "tag": "9766e845-d03c-426b-87c8-9df2fb171e28"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:56.256755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f2703db4-3035-47b8-b2c8-618761e13ad9 req-57b2fd72-eec4-4895-aaff-5116dd41d16d service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:56.262155 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f2703db4-3035-47b8-b2c8-618761e13ad9 req-57b2fd72-eec4-4895-aaff-5116dd41d16d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:56.264083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f2703db4-3035-47b8-b2c8-618761e13ad9 req-57b2fd72-eec4-4895-aaff-5116dd41d16d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:56.305279 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-f2703db4-3035-47b8-b2c8-618761e13ad9 req-57b2fd72-eec4-4895-aaff-5116dd41d16d service nova] Creating event network-vif-unplugged:9766e845-d03c-426b-87c8-9df2fb171e28 for instance b40f7b3b-04d4-4cfa-8058-09afc05d791e on n-h1-862967-2 Oct 29 02:58:56.327030 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-f2703db4-3035-47b8-b2c8-618761e13ad9 req-57b2fd72-eec4-4895-aaff-5116dd41d16d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118939 Oct 29 02:58:56.339558 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1500/2774] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:58:56.347730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a163e8e1-f37c-48ab-8f9c-f7f2b939264d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:56.348737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a163e8e1-f37c-48ab-8f9c-f7f2b939264d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:56.362967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a163e8e1-f37c-48ab-8f9c-f7f2b939264d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:56.363948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a163e8e1-f37c-48ab-8f9c-f7f2b939264d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:56.364744 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a163e8e1-f37c-48ab-8f9c-f7f2b939264d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:56.365663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a163e8e1-f37c-48ab-8f9c-f7f2b939264d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:56.366326 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a163e8e1-f37c-48ab-8f9c-f7f2b939264d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:56.367238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a163e8e1-f37c-48ab-8f9c-f7f2b939264d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:56.411800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2701d0fd-ce27-4023-a895-4dafc1fbad43 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:56.458455 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2701d0fd-ce27-4023-a895-4dafc1fbad43 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6" status: 200 len: 1498 microversion: 2.1 time: 0.544462 Oct 29 02:58:56.459633 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1275/2775] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:55 2022] GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 => generated 1498 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:56.508048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1a0d6d8d-b344-4cd1-a7f8-ed8c04f5c95a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:56.510066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1a0d6d8d-b344-4cd1-a7f8-ed8c04f5c95a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:56.517876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a0d6d8d-b344-4cd1-a7f8-ed8c04f5c95a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:56.518965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a0d6d8d-b344-4cd1-a7f8-ed8c04f5c95a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:56.519813 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a0d6d8d-b344-4cd1-a7f8-ed8c04f5c95a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:56.521064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a0d6d8d-b344-4cd1-a7f8-ed8c04f5c95a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:56.521891 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a0d6d8d-b344-4cd1-a7f8-ed8c04f5c95a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:56.522802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a0d6d8d-b344-4cd1-a7f8-ed8c04f5c95a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:56.991028 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1a0d6d8d-b344-4cd1-a7f8-ed8c04f5c95a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:57.006238 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1a0d6d8d-b344-4cd1-a7f8-ed8c04f5c95a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:57.008958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1a0d6d8d-b344-4cd1-a7f8-ed8c04f5c95a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:57.015320 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1a0d6d8d-b344-4cd1-a7f8-ed8c04f5c95a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1723 microversion: 2.20 time: 0.515861 Oct 29 02:58:57.016280 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1276/2776] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:56 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1723 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:57.029465 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4820b167-e5b0-4aaa-9132-adfa20e343ae tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:57.030346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4820b167-e5b0-4aaa-9132-adfa20e343ae tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: 1117f077-2a55-4632-95ed-f3bd9a5f685a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:57.044228 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4820b167-e5b0-4aaa-9132-adfa20e343ae tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:57.045034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4820b167-e5b0-4aaa-9132-adfa20e343ae tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:57.048449 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4820b167-e5b0-4aaa-9132-adfa20e343ae tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:57.051166 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4820b167-e5b0-4aaa-9132-adfa20e343ae tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:57.052069 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4820b167-e5b0-4aaa-9132-adfa20e343ae tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:57.052719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4820b167-e5b0-4aaa-9132-adfa20e343ae tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:57.403548 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4820b167-e5b0-4aaa-9132-adfa20e343ae tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:57.411826 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4820b167-e5b0-4aaa-9132-adfa20e343ae tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a" status: 200 len: 1318 microversion: 2.1 time: 0.394228 Oct 29 02:58:57.415948 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1277/2777] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:57 2022] GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a => generated 1318 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:57.422851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1d212a56-8e81-4a5b-a1c6-12c77ebad277 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:57.426392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1d212a56-8e81-4a5b-a1c6-12c77ebad277 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: d4cf7226-5b9f-4b20-9294-5fc3f0118ebd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:57.446792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d212a56-8e81-4a5b-a1c6-12c77ebad277 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:57.449573 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d212a56-8e81-4a5b-a1c6-12c77ebad277 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:57.450307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d212a56-8e81-4a5b-a1c6-12c77ebad277 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:57.453342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d212a56-8e81-4a5b-a1c6-12c77ebad277 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:57.454038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d212a56-8e81-4a5b-a1c6-12c77ebad277 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:57.454683 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d212a56-8e81-4a5b-a1c6-12c77ebad277 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:57.551983 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1d212a56-8e81-4a5b-a1c6-12c77ebad277 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:57.566742 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1d212a56-8e81-4a5b-a1c6-12c77ebad277 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd" status: 200 len: 1272 microversion: 2.1 time: 0.149402 Oct 29 02:58:57.567582 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1278/2778] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:57 2022] GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd => generated 1272 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:57.590113 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5e139b7d-d21c-4fc4-aadb-838820a4dda9 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:57.591129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5e139b7d-d21c-4fc4-aadb-838820a4dda9 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:57.602725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e139b7d-d21c-4fc4-aadb-838820a4dda9 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:57.603605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e139b7d-d21c-4fc4-aadb-838820a4dda9 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:57.606498 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e139b7d-d21c-4fc4-aadb-838820a4dda9 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:57.607863 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e139b7d-d21c-4fc4-aadb-838820a4dda9 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:57.609993 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e139b7d-d21c-4fc4-aadb-838820a4dda9 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:57.611029 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e139b7d-d21c-4fc4-aadb-838820a4dda9 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:57.711195 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5e139b7d-d21c-4fc4-aadb-838820a4dda9 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:57.722233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5e139b7d-d21c-4fc4-aadb-838820a4dda9 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:57.724561 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5e139b7d-d21c-4fc4-aadb-838820a4dda9 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:57.725894 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5e139b7d-d21c-4fc4-aadb-838820a4dda9 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1604 microversion: 2.42 time: 0.140444 Oct 29 02:58:57.726486 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1279/2779] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:57 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1604 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:57.731101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1537165b-a886-46c7-a947-02a0d658ac9a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:57.731723 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1537165b-a886-46c7-a947-02a0d658ac9a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:57.738647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1537165b-a886-46c7-a947-02a0d658ac9a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:57.739139 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1537165b-a886-46c7-a947-02a0d658ac9a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:57.739737 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1537165b-a886-46c7-a947-02a0d658ac9a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:57.740445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1537165b-a886-46c7-a947-02a0d658ac9a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:57.740983 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1537165b-a886-46c7-a947-02a0d658ac9a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:57.741517 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1537165b-a886-46c7-a947-02a0d658ac9a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:57.942213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a163e8e1-f37c-48ab-8f9c-f7f2b939264d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:57.946020 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1537165b-a886-46c7-a947-02a0d658ac9a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:57.951232 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a163e8e1-f37c-48ab-8f9c-f7f2b939264d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1518 microversion: 2.1 time: 1.609423 Oct 29 02:58:57.966822 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1501/2780] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:56 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1518 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:57.966822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-46c8149f-aafe-47cc-a540-dc5ac19a3082 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:57.966822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-46c8149f-aafe-47cc-a540-dc5ac19a3082 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:57.973234 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1537165b-a886-46c7-a947-02a0d658ac9a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1718 microversion: 2.1 time: 0.245621 Oct 29 02:58:57.974075 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1280/2781] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:57 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1718 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:57.987720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46c8149f-aafe-47cc-a540-dc5ac19a3082 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:57.988877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46c8149f-aafe-47cc-a540-dc5ac19a3082 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:57.989648 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46c8149f-aafe-47cc-a540-dc5ac19a3082 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:57.990593 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46c8149f-aafe-47cc-a540-dc5ac19a3082 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:57.991646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46c8149f-aafe-47cc-a540-dc5ac19a3082 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:57.992259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46c8149f-aafe-47cc-a540-dc5ac19a3082 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:58.049100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-03f1251e-a1a3-47b6-98b6-5e69c2539ee2 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:58.050175 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-03f1251e-a1a3-47b6-98b6-5e69c2539ee2 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:58.058052 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03f1251e-a1a3-47b6-98b6-5e69c2539ee2 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:58.058824 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03f1251e-a1a3-47b6-98b6-5e69c2539ee2 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:58.059411 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03f1251e-a1a3-47b6-98b6-5e69c2539ee2 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:58.060480 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03f1251e-a1a3-47b6-98b6-5e69c2539ee2 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:58.061126 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03f1251e-a1a3-47b6-98b6-5e69c2539ee2 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:58.061736 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03f1251e-a1a3-47b6-98b6-5e69c2539ee2 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:58.227421 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-03f1251e-a1a3-47b6-98b6-5e69c2539ee2 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:58.233609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:58.239546 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-03f1251e-a1a3-47b6-98b6-5e69c2539ee2 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:58.240730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-03f1251e-a1a3-47b6-98b6-5e69c2539ee2 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:58.242213 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-03f1251e-a1a3-47b6-98b6-5e69c2539ee2 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1723 microversion: 2.20 time: 0.197441 Oct 29 02:58:58.249176 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1281/2782] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:58 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:58:58.420555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-46c8149f-aafe-47cc-a540-dc5ac19a3082 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:58.429630 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-46c8149f-aafe-47cc-a540-dc5ac19a3082 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6" status: 200 len: 1498 microversion: 2.1 time: 0.471486 Oct 29 02:58:58.430450 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1502/2783] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:57 2022] GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 => generated 1498 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:58.443397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3202c783-d6d3-4e88-816a-6aa9f88f36c5 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:58.444413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3202c783-d6d3-4e88-816a-6aa9f88f36c5 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: 1117f077-2a55-4632-95ed-f3bd9a5f685a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:58.452380 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:58.454390 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3202c783-d6d3-4e88-816a-6aa9f88f36c5 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:58.455191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3202c783-d6d3-4e88-816a-6aa9f88f36c5 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:58.456030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3202c783-d6d3-4e88-816a-6aa9f88f36c5 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:58.457017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3202c783-d6d3-4e88-816a-6aa9f88f36c5 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:58.457720 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3202c783-d6d3-4e88-816a-6aa9f88f36c5 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:58.458731 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3202c783-d6d3-4e88-816a-6aa9f88f36c5 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:58.592126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-53467eb1-db51-468d-b5c8-18ad49acbce7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:58.592796 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-53467eb1-db51-468d-b5c8-18ad49acbce7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: d4cf7226-5b9f-4b20-9294-5fc3f0118ebd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:58.604620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-53467eb1-db51-468d-b5c8-18ad49acbce7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:58.607462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-53467eb1-db51-468d-b5c8-18ad49acbce7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:58.609010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-53467eb1-db51-468d-b5c8-18ad49acbce7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:58.612354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-53467eb1-db51-468d-b5c8-18ad49acbce7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:58.613075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-53467eb1-db51-468d-b5c8-18ad49acbce7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:58.614132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-53467eb1-db51-468d-b5c8-18ad49acbce7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:58.754205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3202c783-d6d3-4e88-816a-6aa9f88f36c5 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:58.769253 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3202c783-d6d3-4e88-816a-6aa9f88f36c5 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a" status: 200 len: 1318 microversion: 2.1 time: 0.334276 Oct 29 02:58:58.770050 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1282/2784] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:58 2022] GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a => generated 1318 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:58.798374 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-35f74808-b0af-4583-a57e-c28dba562188 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:58.805144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-35f74808-b0af-4583-a57e-c28dba562188 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:58.824795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35f74808-b0af-4583-a57e-c28dba562188 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:58.831348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35f74808-b0af-4583-a57e-c28dba562188 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:58.831348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35f74808-b0af-4583-a57e-c28dba562188 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:58.831348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35f74808-b0af-4583-a57e-c28dba562188 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:58.831348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35f74808-b0af-4583-a57e-c28dba562188 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:58.831348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35f74808-b0af-4583-a57e-c28dba562188 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:58.997668 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-35f74808-b0af-4583-a57e-c28dba562188 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:59.012139 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-35f74808-b0af-4583-a57e-c28dba562188 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:59.015598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-35f74808-b0af-4583-a57e-c28dba562188 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:59.016344 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-35f74808-b0af-4583-a57e-c28dba562188 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1604 microversion: 2.42 time: 0.234739 Oct 29 02:58:59.017264 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1283/2785] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:58 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1604 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:58:59.027426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-4702bbb4-7aed-4ee9-8a5e-fda10da7ba83 req-af9b76bb-6b4d-476f-b312-85d84fe4f1b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b40f7b3b-04d4-4cfa-8058-09afc05d791e", "tag": "9766e845-d03c-426b-87c8-9df2fb171e28"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:58:59.047552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4702bbb4-7aed-4ee9-8a5e-fda10da7ba83 req-af9b76bb-6b4d-476f-b312-85d84fe4f1b3 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:59.048061 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4702bbb4-7aed-4ee9-8a5e-fda10da7ba83 req-af9b76bb-6b4d-476f-b312-85d84fe4f1b3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:59.048555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4702bbb4-7aed-4ee9-8a5e-fda10da7ba83 req-af9b76bb-6b4d-476f-b312-85d84fe4f1b3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:59.078387 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-4702bbb4-7aed-4ee9-8a5e-fda10da7ba83 req-af9b76bb-6b4d-476f-b312-85d84fe4f1b3 service nova] Creating event network-changed:9766e845-d03c-426b-87c8-9df2fb171e28 for instance b40f7b3b-04d4-4cfa-8058-09afc05d791e on n-h1-862967-2 Oct 29 02:58:59.087716 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-4702bbb4-7aed-4ee9-8a5e-fda10da7ba83 req-af9b76bb-6b4d-476f-b312-85d84fe4f1b3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069074 Oct 29 02:58:59.093318 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1284/2786] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:58:59.104099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-35ee2b29-9405-40a0-a456-1c1e3d2d689d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:59.108749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-35ee2b29-9405-40a0-a456-1c1e3d2d689d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:59.125072 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35ee2b29-9405-40a0-a456-1c1e3d2d689d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:59.127325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35ee2b29-9405-40a0-a456-1c1e3d2d689d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:59.129208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35ee2b29-9405-40a0-a456-1c1e3d2d689d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:59.130477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35ee2b29-9405-40a0-a456-1c1e3d2d689d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:59.134493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35ee2b29-9405-40a0-a456-1c1e3d2d689d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:59.135168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35ee2b29-9405-40a0-a456-1c1e3d2d689d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:59.547136 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-35ee2b29-9405-40a0-a456-1c1e3d2d689d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:59.552170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-53467eb1-db51-468d-b5c8-18ad49acbce7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:59.558873 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-35ee2b29-9405-40a0-a456-1c1e3d2d689d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1518 microversion: 2.1 time: 0.463722 Oct 29 02:58:59.574539 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-53467eb1-db51-468d-b5c8-18ad49acbce7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd" status: 200 len: 1314 microversion: 2.1 time: 0.982030 Oct 29 02:58:59.578361 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1285/2787] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:59 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1518 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:59.580419 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1503/2788] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:58 2022] GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd => generated 1314 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:59.583769 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b37e8613-d82f-4c98-b64d-fc1ccea7712a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:59.585697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5324d6e8-cf4a-4575-a5d0-7e4fa23ae11b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:59.586410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5324d6e8-cf4a-4575-a5d0-7e4fa23ae11b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:59.588329 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b37e8613-d82f-4c98-b64d-fc1ccea7712a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:59.604001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5324d6e8-cf4a-4575-a5d0-7e4fa23ae11b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:59.604497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5324d6e8-cf4a-4575-a5d0-7e4fa23ae11b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:59.605163 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5324d6e8-cf4a-4575-a5d0-7e4fa23ae11b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:59.611012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5324d6e8-cf4a-4575-a5d0-7e4fa23ae11b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:59.612056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5324d6e8-cf4a-4575-a5d0-7e4fa23ae11b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:59.612694 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5324d6e8-cf4a-4575-a5d0-7e4fa23ae11b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:59.625512 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b37e8613-d82f-4c98-b64d-fc1ccea7712a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:59.631984 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b37e8613-d82f-4c98-b64d-fc1ccea7712a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:59.634038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b37e8613-d82f-4c98-b64d-fc1ccea7712a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:59.634850 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b37e8613-d82f-4c98-b64d-fc1ccea7712a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:59.635326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b37e8613-d82f-4c98-b64d-fc1ccea7712a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:59.641808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b37e8613-d82f-4c98-b64d-fc1ccea7712a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:59.885968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b37e8613-d82f-4c98-b64d-fc1ccea7712a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:58:59.897452 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b37e8613-d82f-4c98-b64d-fc1ccea7712a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1718 microversion: 2.1 time: 0.317280 Oct 29 02:58:59.920412 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1286/2789] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:59 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1718 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:58:59.920412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cf891935-1537-436c-ad1e-6c3d10afc2c4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:58:59.920412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cf891935-1537-436c-ad1e-6c3d10afc2c4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:58:59.928922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf891935-1537-436c-ad1e-6c3d10afc2c4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:59.929807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf891935-1537-436c-ad1e-6c3d10afc2c4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:59.931093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf891935-1537-436c-ad1e-6c3d10afc2c4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:58:59.932363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf891935-1537-436c-ad1e-6c3d10afc2c4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:58:59.933153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf891935-1537-436c-ad1e-6c3d10afc2c4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:58:59.934389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf891935-1537-436c-ad1e-6c3d10afc2c4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:00.279187 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cf891935-1537-436c-ad1e-6c3d10afc2c4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:00.290987 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cf891935-1537-436c-ad1e-6c3d10afc2c4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6" status: 200 len: 1498 microversion: 2.1 time: 0.384012 Oct 29 02:59:00.292377 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1287/2790] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:58:59 2022] GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 => generated 1498 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:00.297591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-130e3119-f14b-4b3c-afbb-74e5c4caf7d9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:00.298569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-130e3119-f14b-4b3c-afbb-74e5c4caf7d9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: 1117f077-2a55-4632-95ed-f3bd9a5f685a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:00.301649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5324d6e8-cf4a-4575-a5d0-7e4fa23ae11b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:00.306037 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-130e3119-f14b-4b3c-afbb-74e5c4caf7d9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:00.306680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-130e3119-f14b-4b3c-afbb-74e5c4caf7d9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:00.307240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-130e3119-f14b-4b3c-afbb-74e5c4caf7d9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:00.308054 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-130e3119-f14b-4b3c-afbb-74e5c4caf7d9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:00.308676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-130e3119-f14b-4b3c-afbb-74e5c4caf7d9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:00.309207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-130e3119-f14b-4b3c-afbb-74e5c4caf7d9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:00.311829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5324d6e8-cf4a-4575-a5d0-7e4fa23ae11b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:00.317141 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5324d6e8-cf4a-4575-a5d0-7e4fa23ae11b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:00.320595 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5324d6e8-cf4a-4575-a5d0-7e4fa23ae11b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1723 microversion: 2.20 time: 0.739056 Oct 29 02:59:00.323757 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1504/2791] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:58:59 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1723 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:00.330608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8bd8bbc5-d4bc-47ff-9c16-f539bebcf009 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:00.331523 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8bd8bbc5-d4bc-47ff-9c16-f539bebcf009 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:00.356030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bd8bbc5-d4bc-47ff-9c16-f539bebcf009 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:00.357778 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bd8bbc5-d4bc-47ff-9c16-f539bebcf009 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:00.358483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bd8bbc5-d4bc-47ff-9c16-f539bebcf009 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:00.359716 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bd8bbc5-d4bc-47ff-9c16-f539bebcf009 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:00.361429 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bd8bbc5-d4bc-47ff-9c16-f539bebcf009 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:00.363280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bd8bbc5-d4bc-47ff-9c16-f539bebcf009 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:00.529743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-130e3119-f14b-4b3c-afbb-74e5c4caf7d9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:00.539771 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-130e3119-f14b-4b3c-afbb-74e5c4caf7d9 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a" status: 200 len: 1318 microversion: 2.1 time: 0.245980 Oct 29 02:59:00.558880 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1288/2792] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:00 2022] GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:00.595805 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a9216e7c-6344-42ff-b12b-d48ae6ecca4f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:00.596357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a9216e7c-6344-42ff-b12b-d48ae6ecca4f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:00.610472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9216e7c-6344-42ff-b12b-d48ae6ecca4f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:00.611255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9216e7c-6344-42ff-b12b-d48ae6ecca4f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:00.611834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9216e7c-6344-42ff-b12b-d48ae6ecca4f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:00.612916 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9216e7c-6344-42ff-b12b-d48ae6ecca4f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:00.613482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9216e7c-6344-42ff-b12b-d48ae6ecca4f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:00.623534 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9216e7c-6344-42ff-b12b-d48ae6ecca4f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:00.697990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8bd8bbc5-d4bc-47ff-9c16-f539bebcf009 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:00.721958 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8bd8bbc5-d4bc-47ff-9c16-f539bebcf009 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:00.726209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8bd8bbc5-d4bc-47ff-9c16-f539bebcf009 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:00.731096 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8bd8bbc5-d4bc-47ff-9c16-f539bebcf009 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1604 microversion: 2.42 time: 0.405855 Oct 29 02:59:00.733088 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1505/2793] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:00 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1604 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:00.751784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9c847aba-1023-49c5-bf86-f47d27fe4d73 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:00.753098 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9c847aba-1023-49c5-bf86-f47d27fe4d73 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: d4cf7226-5b9f-4b20-9294-5fc3f0118ebd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:00.769009 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c847aba-1023-49c5-bf86-f47d27fe4d73 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:00.769771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c847aba-1023-49c5-bf86-f47d27fe4d73 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:00.771901 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c847aba-1023-49c5-bf86-f47d27fe4d73 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:00.776400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c847aba-1023-49c5-bf86-f47d27fe4d73 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:00.777365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c847aba-1023-49c5-bf86-f47d27fe4d73 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:00.778623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c847aba-1023-49c5-bf86-f47d27fe4d73 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:01.018853 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a9216e7c-6344-42ff-b12b-d48ae6ecca4f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:01.030164 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a9216e7c-6344-42ff-b12b-d48ae6ecca4f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1518 microversion: 2.1 time: 0.448920 Oct 29 02:59:01.031895 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1289/2794] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:00 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1518 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:59:01.036847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bd9b5808-8441-4374-b024-33e0b0c6d8c3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:01.037782 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bd9b5808-8441-4374-b024-33e0b0c6d8c3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:01.044560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd9b5808-8441-4374-b024-33e0b0c6d8c3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:01.045233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd9b5808-8441-4374-b024-33e0b0c6d8c3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:01.045807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd9b5808-8441-4374-b024-33e0b0c6d8c3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:01.046652 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd9b5808-8441-4374-b024-33e0b0c6d8c3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:01.047476 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd9b5808-8441-4374-b024-33e0b0c6d8c3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:01.048043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd9b5808-8441-4374-b024-33e0b0c6d8c3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:01.417944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bd9b5808-8441-4374-b024-33e0b0c6d8c3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:01.436662 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bd9b5808-8441-4374-b024-33e0b0c6d8c3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1718 microversion: 2.1 time: 0.399203 Oct 29 02:59:01.437857 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1290/2795] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:01 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1718 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:01.448760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-d2d0db6b-2c3f-4b26-b7bb-504ea58d9e81 req-4a489eba-e158-484b-a7eb-9c209a52d8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4cf7226-5b9f-4b20-9294-5fc3f0118ebd", "tag": "2bae1914-163f-4bfb-b681-63356cae067f"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:01.472405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d2d0db6b-2c3f-4b26-b7bb-504ea58d9e81 req-4a489eba-e158-484b-a7eb-9c209a52d8f9 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:01.473796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d2d0db6b-2c3f-4b26-b7bb-504ea58d9e81 req-4a489eba-e158-484b-a7eb-9c209a52d8f9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:01.474988 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d2d0db6b-2c3f-4b26-b7bb-504ea58d9e81 req-4a489eba-e158-484b-a7eb-9c209a52d8f9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:01.506678 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-d2d0db6b-2c3f-4b26-b7bb-504ea58d9e81 req-4a489eba-e158-484b-a7eb-9c209a52d8f9 service nova] Creating event network-changed:2bae1914-163f-4bfb-b681-63356cae067f for instance d4cf7226-5b9f-4b20-9294-5fc3f0118ebd on n-h2-862967-2 Oct 29 02:59:01.520199 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-d2d0db6b-2c3f-4b26-b7bb-504ea58d9e81 req-4a489eba-e158-484b-a7eb-9c209a52d8f9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080589 Oct 29 02:59:01.523537 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1291/2796] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:01.535533 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-a1087810-5852-4400-84f9-2db844dfda94 req-1b18f114-812c-456b-b892-c7d1e95da250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1117f077-2a55-4632-95ed-f3bd9a5f685a", "name": "network-vif-plugged", "status": "completed", "tag": "dc4993cb-362f-41b9-815f-a3711444c86e"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:01.542331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9c847aba-1023-49c5-bf86-f47d27fe4d73 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:01.559099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a1087810-5852-4400-84f9-2db844dfda94 req-1b18f114-812c-456b-b892-c7d1e95da250 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:01.559747 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a1087810-5852-4400-84f9-2db844dfda94 req-1b18f114-812c-456b-b892-c7d1e95da250 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:01.561665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a1087810-5852-4400-84f9-2db844dfda94 req-1b18f114-812c-456b-b892-c7d1e95da250 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:01.568540 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9c847aba-1023-49c5-bf86-f47d27fe4d73 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd" status: 200 len: 1314 microversion: 2.1 time: 0.833405 Oct 29 02:59:01.570790 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1506/2797] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:00 2022] GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd => generated 1314 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:01.575621 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-502e3657-d6b2-4e26-aaaa-c67517bfcf82 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:01.588773 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-a1087810-5852-4400-84f9-2db844dfda94 req-1b18f114-812c-456b-b892-c7d1e95da250 service nova] Creating event network-vif-plugged:dc4993cb-362f-41b9-815f-a3711444c86e for instance 1117f077-2a55-4632-95ed-f3bd9a5f685a on n-h1-862967-2 Oct 29 02:59:01.593700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-502e3657-d6b2-4e26-aaaa-c67517bfcf82 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:01.600238 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-a1087810-5852-4400-84f9-2db844dfda94 req-1b18f114-812c-456b-b892-c7d1e95da250 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075282 Oct 29 02:59:01.601427 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1292/2798] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:01.614006 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ee1e1bda-1461-4bfd-ac6f-3ec7c1cfb1b3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:01.615399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-502e3657-d6b2-4e26-aaaa-c67517bfcf82 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:01.616274 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-502e3657-d6b2-4e26-aaaa-c67517bfcf82 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:01.616982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-502e3657-d6b2-4e26-aaaa-c67517bfcf82 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:01.617541 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ee1e1bda-1461-4bfd-ac6f-3ec7c1cfb1b3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:01.617821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-502e3657-d6b2-4e26-aaaa-c67517bfcf82 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:01.618615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-502e3657-d6b2-4e26-aaaa-c67517bfcf82 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:01.628879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-502e3657-d6b2-4e26-aaaa-c67517bfcf82 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:01.632820 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee1e1bda-1461-4bfd-ac6f-3ec7c1cfb1b3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:01.634123 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee1e1bda-1461-4bfd-ac6f-3ec7c1cfb1b3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:01.635933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee1e1bda-1461-4bfd-ac6f-3ec7c1cfb1b3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:01.636925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee1e1bda-1461-4bfd-ac6f-3ec7c1cfb1b3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:01.638355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee1e1bda-1461-4bfd-ac6f-3ec7c1cfb1b3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:01.640213 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee1e1bda-1461-4bfd-ac6f-3ec7c1cfb1b3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:01.845399 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ee1e1bda-1461-4bfd-ac6f-3ec7c1cfb1b3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:01.855469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ee1e1bda-1461-4bfd-ac6f-3ec7c1cfb1b3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:01.856679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ee1e1bda-1461-4bfd-ac6f-3ec7c1cfb1b3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:01.857956 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ee1e1bda-1461-4bfd-ac6f-3ec7c1cfb1b3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1744 microversion: 2.20 time: 0.252567 Oct 29 02:59:01.878259 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1293/2799] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:01 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1744 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:01.885287 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7a26b978-b2c4-49e1-bf5c-731256f636ce tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:01.885835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7a26b978-b2c4-49e1-bf5c-731256f636ce tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: 1117f077-2a55-4632-95ed-f3bd9a5f685a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:01.892014 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a26b978-b2c4-49e1-bf5c-731256f636ce tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:01.892493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a26b978-b2c4-49e1-bf5c-731256f636ce tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:01.892958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a26b978-b2c4-49e1-bf5c-731256f636ce tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:01.893656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a26b978-b2c4-49e1-bf5c-731256f636ce tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:01.894102 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a26b978-b2c4-49e1-bf5c-731256f636ce tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:01.894518 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a26b978-b2c4-49e1-bf5c-731256f636ce tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:01.937497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:02.020072 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=14 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:02.046954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7a26b978-b2c4-49e1-bf5c-731256f636ce tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:02.080423 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7a26b978-b2c4-49e1-bf5c-731256f636ce tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a" status: 200 len: 1318 microversion: 2.1 time: 0.197613 Oct 29 02:59:02.083475 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1294/2800] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:01 2022] GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:02.093540 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7b601f3f-40ef-44ae-809a-18879fc74864 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:02.094214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7b601f3f-40ef-44ae-809a-18879fc74864 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:02.102265 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7b601f3f-40ef-44ae-809a-18879fc74864 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:02.102759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7b601f3f-40ef-44ae-809a-18879fc74864 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:02.103231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7b601f3f-40ef-44ae-809a-18879fc74864 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:02.103962 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7b601f3f-40ef-44ae-809a-18879fc74864 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:02.104419 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7b601f3f-40ef-44ae-809a-18879fc74864 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:02.104826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7b601f3f-40ef-44ae-809a-18879fc74864 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:02.296759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7b601f3f-40ef-44ae-809a-18879fc74864 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:02.318389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7b601f3f-40ef-44ae-809a-18879fc74864 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:02.328732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7b601f3f-40ef-44ae-809a-18879fc74864 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:02.336629 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7b601f3f-40ef-44ae-809a-18879fc74864 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1604 microversion: 2.42 time: 0.250524 Oct 29 02:59:02.337603 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1295/2801] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:02 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1604 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:02.347730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-349d0e6d-9989-4912-a749-5482f5f301b2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:02.348364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-349d0e6d-9989-4912-a749-5482f5f301b2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:02.355792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-349d0e6d-9989-4912-a749-5482f5f301b2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:02.356372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-349d0e6d-9989-4912-a749-5482f5f301b2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:02.356854 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-349d0e6d-9989-4912-a749-5482f5f301b2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:02.357564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-349d0e6d-9989-4912-a749-5482f5f301b2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:02.358016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-349d0e6d-9989-4912-a749-5482f5f301b2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:02.358436 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-349d0e6d-9989-4912-a749-5482f5f301b2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:02.404085 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-502e3657-d6b2-4e26-aaaa-c67517bfcf82 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:02.426921 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-502e3657-d6b2-4e26-aaaa-c67517bfcf82 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6" status: 200 len: 1498 microversion: 2.1 time: 0.851968 Oct 29 02:59:02.427945 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1507/2802] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:01 2022] GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 => generated 1498 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:02.462243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4ef0c478-8784-488c-a950-735110fb8cb7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:02.463452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4ef0c478-8784-488c-a950-735110fb8cb7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:02.501465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ef0c478-8784-488c-a950-735110fb8cb7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:02.503814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ef0c478-8784-488c-a950-735110fb8cb7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:02.504981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ef0c478-8784-488c-a950-735110fb8cb7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:02.509077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ef0c478-8784-488c-a950-735110fb8cb7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:02.518696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ef0c478-8784-488c-a950-735110fb8cb7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:02.526978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ef0c478-8784-488c-a950-735110fb8cb7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:02.718996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-349d0e6d-9989-4912-a749-5482f5f301b2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:02.730311 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-349d0e6d-9989-4912-a749-5482f5f301b2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1518 microversion: 2.1 time: 0.391546 Oct 29 02:59:02.744547 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1296/2803] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:02 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1518 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:02.744547 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e1971ef4-d835-4017-8bf7-68c0fce101fb tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:02.744547 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e1971ef4-d835-4017-8bf7-68c0fce101fb tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: d4cf7226-5b9f-4b20-9294-5fc3f0118ebd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:02.752796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1971ef4-d835-4017-8bf7-68c0fce101fb tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:02.752796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1971ef4-d835-4017-8bf7-68c0fce101fb tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:02.752796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1971ef4-d835-4017-8bf7-68c0fce101fb tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:02.753894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1971ef4-d835-4017-8bf7-68c0fce101fb tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:02.753894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1971ef4-d835-4017-8bf7-68c0fce101fb tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:02.754330 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1971ef4-d835-4017-8bf7-68c0fce101fb tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:02.826730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4ef0c478-8784-488c-a950-735110fb8cb7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:02.842226 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4ef0c478-8784-488c-a950-735110fb8cb7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1718 microversion: 2.1 time: 0.383358 Oct 29 02:59:02.844354 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1508/2804] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:02 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1718 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:59:02.874034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=12 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:02.890876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a5ba0521-5fd7-4253-891f-fdd3dfa9cf80 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:02.891861 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a5ba0521-5fd7-4253-891f-fdd3dfa9cf80 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:02.903333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a5ba0521-5fd7-4253-891f-fdd3dfa9cf80 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:02.904060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a5ba0521-5fd7-4253-891f-fdd3dfa9cf80 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:02.904720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a5ba0521-5fd7-4253-891f-fdd3dfa9cf80 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:02.906387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a5ba0521-5fd7-4253-891f-fdd3dfa9cf80 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:02.912488 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a5ba0521-5fd7-4253-891f-fdd3dfa9cf80 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:02.913211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a5ba0521-5fd7-4253-891f-fdd3dfa9cf80 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:03.142656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e1971ef4-d835-4017-8bf7-68c0fce101fb tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:03.157582 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e1971ef4-d835-4017-8bf7-68c0fce101fb tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd" status: 200 len: 1314 microversion: 2.1 time: 0.424309 Oct 29 02:59:03.163278 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1297/2805] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:02 2022] GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:03.171656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c3ddb6cb-f747-4988-9e7b-676cb9310c19 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:03.179476 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c3ddb6cb-f747-4988-9e7b-676cb9310c19 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: 1117f077-2a55-4632-95ed-f3bd9a5f685a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:03.196127 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c3ddb6cb-f747-4988-9e7b-676cb9310c19 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:03.197654 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c3ddb6cb-f747-4988-9e7b-676cb9310c19 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:03.199171 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c3ddb6cb-f747-4988-9e7b-676cb9310c19 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:03.202478 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c3ddb6cb-f747-4988-9e7b-676cb9310c19 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:03.204271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c3ddb6cb-f747-4988-9e7b-676cb9310c19 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:03.206222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c3ddb6cb-f747-4988-9e7b-676cb9310c19 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:03.208364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a5ba0521-5fd7-4253-891f-fdd3dfa9cf80 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:03.218702 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a5ba0521-5fd7-4253-891f-fdd3dfa9cf80 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:03.220318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a5ba0521-5fd7-4253-891f-fdd3dfa9cf80 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:03.221934 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a5ba0521-5fd7-4253-891f-fdd3dfa9cf80 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1744 microversion: 2.20 time: 0.335124 Oct 29 02:59:03.234223 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1509/2806] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:02 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1744 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:03.383157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a6a7c853-b002-4c36-9a45-8d67bfdc434c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:03.384266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a6a7c853-b002-4c36-9a45-8d67bfdc434c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:03.395123 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6a7c853-b002-4c36-9a45-8d67bfdc434c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:03.395689 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6a7c853-b002-4c36-9a45-8d67bfdc434c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:03.397788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6a7c853-b002-4c36-9a45-8d67bfdc434c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:03.398659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6a7c853-b002-4c36-9a45-8d67bfdc434c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:03.401214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6a7c853-b002-4c36-9a45-8d67bfdc434c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:03.402650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6a7c853-b002-4c36-9a45-8d67bfdc434c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:03.499696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c3ddb6cb-f747-4988-9e7b-676cb9310c19 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:03.511433 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c3ddb6cb-f747-4988-9e7b-676cb9310c19 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a" status: 200 len: 1318 microversion: 2.1 time: 0.346748 Oct 29 02:59:03.516593 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1298/2807] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:03 2022] GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:03.531050 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d2bb37a8-9f5b-450a-831c-a29d2d35ea34 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:03.533694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d2bb37a8-9f5b-450a-831c-a29d2d35ea34 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:03.540846 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d2bb37a8-9f5b-450a-831c-a29d2d35ea34 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:03.541588 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d2bb37a8-9f5b-450a-831c-a29d2d35ea34 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:03.542208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d2bb37a8-9f5b-450a-831c-a29d2d35ea34 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:03.543072 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d2bb37a8-9f5b-450a-831c-a29d2d35ea34 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:03.543693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d2bb37a8-9f5b-450a-831c-a29d2d35ea34 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:03.544271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d2bb37a8-9f5b-450a-831c-a29d2d35ea34 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:03.554104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a6a7c853-b002-4c36-9a45-8d67bfdc434c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:03.568102 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a6a7c853-b002-4c36-9a45-8d67bfdc434c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:03.572514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a6a7c853-b002-4c36-9a45-8d67bfdc434c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b91e3a384214f79a0333e35e5ad3378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b1881976f4493996c2ba4a67afc637', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:03.578833 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a6a7c853-b002-4c36-9a45-8d67bfdc434c tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 200 len: 1604 microversion: 2.42 time: 0.210616 Oct 29 02:59:03.596726 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1510/2808] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:03 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 1604 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:59:03.727589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d2bb37a8-9f5b-450a-831c-a29d2d35ea34 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:03.739692 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d2bb37a8-9f5b-450a-831c-a29d2d35ea34 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6" status: 200 len: 1498 microversion: 2.1 time: 0.220490 Oct 29 02:59:03.739692 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1299/2809] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:03 2022] GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 => generated 1498 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:03.762205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3f880f31-7624-4a28-885d-e04c45b2c5d1 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:03.763124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3f880f31-7624-4a28-885d-e04c45b2c5d1 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:03.770671 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f880f31-7624-4a28-885d-e04c45b2c5d1 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:03.771467 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f880f31-7624-4a28-885d-e04c45b2c5d1 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:03.772064 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f880f31-7624-4a28-885d-e04c45b2c5d1 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:03.773146 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f880f31-7624-4a28-885d-e04c45b2c5d1 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:03.773780 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f880f31-7624-4a28-885d-e04c45b2c5d1 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:03.774352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f880f31-7624-4a28-885d-e04c45b2c5d1 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:03.871690 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a064a71e-b992-4f4a-a900-d73c8e6694f9 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:03.872390 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a064a71e-b992-4f4a-a900-d73c8e6694f9 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:03.884581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a064a71e-b992-4f4a-a900-d73c8e6694f9 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:03.885403 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a064a71e-b992-4f4a-a900-d73c8e6694f9 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:03.885922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a064a71e-b992-4f4a-a900-d73c8e6694f9 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:03.887430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a064a71e-b992-4f4a-a900-d73c8e6694f9 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:03.888007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a064a71e-b992-4f4a-a900-d73c8e6694f9 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:03.888429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a064a71e-b992-4f4a-a900-d73c8e6694f9 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:03.942177 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:04.124039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a064a71e-b992-4f4a-a900-d73c8e6694f9 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:04.133022 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a064a71e-b992-4f4a-a900-d73c8e6694f9 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1718 microversion: 2.1 time: 0.266037 Oct 29 02:59:04.135256 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1300/2810] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:03 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1718 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:04.189992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-161b1054-89f2-4ffe-aae8-951ee2d4e61d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:04.190701 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-161b1054-89f2-4ffe-aae8-951ee2d4e61d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: d4cf7226-5b9f-4b20-9294-5fc3f0118ebd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:04.203375 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-161b1054-89f2-4ffe-aae8-951ee2d4e61d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:04.204196 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-161b1054-89f2-4ffe-aae8-951ee2d4e61d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:04.205119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-161b1054-89f2-4ffe-aae8-951ee2d4e61d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:04.207345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-161b1054-89f2-4ffe-aae8-951ee2d4e61d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:04.210937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-161b1054-89f2-4ffe-aae8-951ee2d4e61d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:04.213648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-161b1054-89f2-4ffe-aae8-951ee2d4e61d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:04.374939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3f880f31-7624-4a28-885d-e04c45b2c5d1 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:04.378212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=100 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:04.399871 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3f880f31-7624-4a28-885d-e04c45b2c5d1 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1518 microversion: 2.1 time: 0.641999 Oct 29 02:59:04.402729 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1511/2811] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:03 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1518 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:04.415314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-054c9cf1-7edf-48f6-ac6c-70aad8f7cdcb tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:04.416031 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-054c9cf1-7edf-48f6-ac6c-70aad8f7cdcb tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:04.437604 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-054c9cf1-7edf-48f6-ac6c-70aad8f7cdcb tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:04.438418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-054c9cf1-7edf-48f6-ac6c-70aad8f7cdcb tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:04.440159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-054c9cf1-7edf-48f6-ac6c-70aad8f7cdcb tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:04.442104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-054c9cf1-7edf-48f6-ac6c-70aad8f7cdcb tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:04.442901 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-054c9cf1-7edf-48f6-ac6c-70aad8f7cdcb tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:04.445099 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-054c9cf1-7edf-48f6-ac6c-70aad8f7cdcb tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:04.656690 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-161b1054-89f2-4ffe-aae8-951ee2d4e61d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:04.670349 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-161b1054-89f2-4ffe-aae8-951ee2d4e61d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd" status: 200 len: 1314 microversion: 2.1 time: 0.484218 Oct 29 02:59:04.684551 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1301/2812] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:04 2022] GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:04.691693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-af57b833-183c-47ed-8255-2b67c00ec543 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:04.694188 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-af57b833-183c-47ed-8255-2b67c00ec543 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: 1117f077-2a55-4632-95ed-f3bd9a5f685a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:04.722489 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af57b833-183c-47ed-8255-2b67c00ec543 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:04.723746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af57b833-183c-47ed-8255-2b67c00ec543 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:04.725231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af57b833-183c-47ed-8255-2b67c00ec543 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:04.727986 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af57b833-183c-47ed-8255-2b67c00ec543 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:04.729059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af57b833-183c-47ed-8255-2b67c00ec543 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:04.732012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af57b833-183c-47ed-8255-2b67c00ec543 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:05.165746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-054c9cf1-7edf-48f6-ac6c-70aad8f7cdcb tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:05.175886 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-af57b833-183c-47ed-8255-2b67c00ec543 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:05.192486 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-af57b833-183c-47ed-8255-2b67c00ec543 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a" status: 200 len: 1318 microversion: 2.1 time: 0.515826 Oct 29 02:59:05.195604 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-054c9cf1-7edf-48f6-ac6c-70aad8f7cdcb tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:05.198641 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1302/2813] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:04 2022] GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a => generated 1318 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:05.212620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-054c9cf1-7edf-48f6-ac6c-70aad8f7cdcb tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:05.219420 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-054c9cf1-7edf-48f6-ac6c-70aad8f7cdcb tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1739 microversion: 2.20 time: 0.815418 Oct 29 02:59:05.221019 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1512/2814] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:04 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1739 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:05.229612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-30293a66-1a53-4e18-8ac2-1cab8e5e2a85 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:05.232138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-30293a66-1a53-4e18-8ac2-1cab8e5e2a85 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:05.246062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0d1194f6-1ad6-4f2b-a763-a4da26ef3166 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:05.252122 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0d1194f6-1ad6-4f2b-a763-a4da26ef3166 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:05.277989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30293a66-1a53-4e18-8ac2-1cab8e5e2a85 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:05.280635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30293a66-1a53-4e18-8ac2-1cab8e5e2a85 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:05.283199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30293a66-1a53-4e18-8ac2-1cab8e5e2a85 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:05.285992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30293a66-1a53-4e18-8ac2-1cab8e5e2a85 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:05.291328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30293a66-1a53-4e18-8ac2-1cab8e5e2a85 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:05.296766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30293a66-1a53-4e18-8ac2-1cab8e5e2a85 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:05.306421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d1194f6-1ad6-4f2b-a763-a4da26ef3166 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:05.307317 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d1194f6-1ad6-4f2b-a763-a4da26ef3166 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:05.308058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d1194f6-1ad6-4f2b-a763-a4da26ef3166 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:05.313640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d1194f6-1ad6-4f2b-a763-a4da26ef3166 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:05.314129 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d1194f6-1ad6-4f2b-a763-a4da26ef3166 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:05.314668 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d1194f6-1ad6-4f2b-a763-a4da26ef3166 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:05.359601 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-30293a66-1a53-4e18-8ac2-1cab8e5e2a85 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] HTTP exception thrown: Instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 could not be found. Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-30293a66-1a53-4e18-8ac2-1cab8e5e2a85 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Request method failure captured: Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 HTTP/1.1 Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJUvc3myjvggGo7UpdfHKIKk3M5yYEKrgcj6ULUK8e-vpda648NrDx-tS_mrmSwa3BZc3VUXpBkPCGYUsAfg5N1RQevF3sa7_7E0APgSrRXYau46wTqoLNIAjYOLsCDkD36On-9lKJIW4hEdn8CUiWgk1AiLijj22JTFL0Q5JNz6RIY Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: X-Openstack-Nova-Api-Version: 2.42 Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: c3b1881976f4493996c2ba4a67afc637 Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1730981164 Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c3b1881976f4493996c2ba4a67afc637"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c3b1881976f4493996c2ba4a67afc637"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c3b1881976f4493996c2ba4a67afc637"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c3b1881976f4493996c2ba4a67afc637"}]}] Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1730981164 Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: c3b1881976f4493996c2ba4a67afc637 Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1730981164 Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TaggedBootDevicesTest_v242-1730981164-project Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 1b91e3a384214f79a0333e35e5ad3378 Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1730981164-project Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 could not be found. Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'f0c20eea-c322-4d8e-bafd-3b3b01c5d142'} Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 could not be found. Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 could not be found. Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:05.367857 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:05.375216 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:05.375216 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:05.375216 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:05.375216 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:05.375216 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:59:05.375216 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:59:05.375216 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 could not be found. Oct 29 02:59:05.375216 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:05.375216 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-30293a66-1a53-4e18-8ac2-1cab8e5e2a85 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Returning 404 to user: Instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:59:05.375216 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-30293a66-1a53-4e18-8ac2-1cab8e5e2a85 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 404 len: 111 microversion: 2.42 time: 0.160935 Oct 29 02:59:05.377335 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1303/2815] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:05 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:59:05.392831 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-517e68ce-7084-4845-80a0-26a16870889f req-d684e595-d1e0-4875-96be-8b2140862f82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ab56816-cc78-4e73-918a-4c76895fed6b", "name": "network-vif-plugged", "status": "completed", "tag": "dbe9ee0b-c11e-4edb-a1e4-5c86a11499da"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:05.422830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-517e68ce-7084-4845-80a0-26a16870889f req-d684e595-d1e0-4875-96be-8b2140862f82 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:05.426146 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-517e68ce-7084-4845-80a0-26a16870889f req-d684e595-d1e0-4875-96be-8b2140862f82 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:05.430069 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-517e68ce-7084-4845-80a0-26a16870889f req-d684e595-d1e0-4875-96be-8b2140862f82 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:05.449952 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-517e68ce-7084-4845-80a0-26a16870889f req-d684e595-d1e0-4875-96be-8b2140862f82 service nova] Creating event network-vif-plugged:dbe9ee0b-c11e-4edb-a1e4-5c86a11499da for instance 1ab56816-cc78-4e73-918a-4c76895fed6b on n-h2-862967-2 Oct 29 02:59:05.459052 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-517e68ce-7084-4845-80a0-26a16870889f req-d684e595-d1e0-4875-96be-8b2140862f82 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076248 Oct 29 02:59:05.460725 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1304/2816] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:05.467030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d579cfef-4662-4cef-a356-e996c36ab37f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:05.468037 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d579cfef-4662-4cef-a356-e996c36ab37f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:05.477532 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d579cfef-4662-4cef-a356-e996c36ab37f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:05.478401 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d579cfef-4662-4cef-a356-e996c36ab37f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:05.480037 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d579cfef-4662-4cef-a356-e996c36ab37f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:05.481876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d579cfef-4662-4cef-a356-e996c36ab37f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:05.482936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d579cfef-4662-4cef-a356-e996c36ab37f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:05.483838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d579cfef-4662-4cef-a356-e996c36ab37f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:06.160219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d579cfef-4662-4cef-a356-e996c36ab37f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:06.185134 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d579cfef-4662-4cef-a356-e996c36ab37f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1718 microversion: 2.1 time: 0.714158 Oct 29 02:59:06.209988 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1305/2817] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:05 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1718 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:06.216938 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dacf5f86-bf88-463a-b494-7c1ef5357a3b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '.version_select at 0x7ff05363b4c0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:06.260540 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dacf5f86-bf88-463a-b494-7c1ef5357a3b tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-542832441" status: 204 len: 0 microversion: 2.42 time: 0.047537 Oct 29 02:59:06.261534 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1306/2818] 10.222.0.46 () {60 vars in 1259 bytes} [Sat Oct 29 02:59:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-542832441 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 02:59:06.266872 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fea3fc3d-bbd5-4806-b388-fc734839938d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:06.270067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fea3fc3d-bbd5-4806-b388-fc734839938d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:06.313259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fea3fc3d-bbd5-4806-b388-fc734839938d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:06.317491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fea3fc3d-bbd5-4806-b388-fc734839938d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:06.319129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fea3fc3d-bbd5-4806-b388-fc734839938d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:06.321955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fea3fc3d-bbd5-4806-b388-fc734839938d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:06.322684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fea3fc3d-bbd5-4806-b388-fc734839938d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:06.329775 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fea3fc3d-bbd5-4806-b388-fc734839938d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:06.631060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0d1194f6-1ad6-4f2b-a763-a4da26ef3166 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:06.644919 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0d1194f6-1ad6-4f2b-a763-a4da26ef3166 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6" status: 200 len: 1498 microversion: 2.1 time: 1.415904 Oct 29 02:59:06.645792 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1513/2819] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:05 2022] GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 => generated 1498 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:06.654654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5c69fd6a-a9c9-47c2-a65a-dcd42cd1b2ea tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:06.657383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5c69fd6a-a9c9-47c2-a65a-dcd42cd1b2ea tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: d4cf7226-5b9f-4b20-9294-5fc3f0118ebd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:06.671983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c69fd6a-a9c9-47c2-a65a-dcd42cd1b2ea tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:06.673025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c69fd6a-a9c9-47c2-a65a-dcd42cd1b2ea tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:06.673621 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c69fd6a-a9c9-47c2-a65a-dcd42cd1b2ea tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:06.674501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c69fd6a-a9c9-47c2-a65a-dcd42cd1b2ea tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:06.676364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c69fd6a-a9c9-47c2-a65a-dcd42cd1b2ea tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:06.678012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c69fd6a-a9c9-47c2-a65a-dcd42cd1b2ea tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:07.110079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5c69fd6a-a9c9-47c2-a65a-dcd42cd1b2ea tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:07.110642 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fea3fc3d-bbd5-4806-b388-fc734839938d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:07.123090 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5c69fd6a-a9c9-47c2-a65a-dcd42cd1b2ea tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd" status: 200 len: 1314 microversion: 2.1 time: 0.475828 Oct 29 02:59:07.126286 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fea3fc3d-bbd5-4806-b388-fc734839938d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1518 microversion: 2.1 time: 0.857617 Oct 29 02:59:07.126789 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1514/2820] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:06 2022] GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:07.139168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2d6ffb9e-93c5-4b98-bc7a-af4f3fe2800b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:07.140875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2d6ffb9e-93c5-4b98-bc7a-af4f3fe2800b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: 1117f077-2a55-4632-95ed-f3bd9a5f685a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:07.141472 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1307/2821] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:06 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1518 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:07.158105 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2d6ffb9e-93c5-4b98-bc7a-af4f3fe2800b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:07.159391 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2d6ffb9e-93c5-4b98-bc7a-af4f3fe2800b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:07.160065 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2d6ffb9e-93c5-4b98-bc7a-af4f3fe2800b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:07.161779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2d6ffb9e-93c5-4b98-bc7a-af4f3fe2800b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:07.162417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2d6ffb9e-93c5-4b98-bc7a-af4f3fe2800b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:07.163130 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2d6ffb9e-93c5-4b98-bc7a-af4f3fe2800b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:07.166459 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d15ecc03-fdf5-4c74-95c7-a5d277156d91 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:07.167087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d15ecc03-fdf5-4c74-95c7-a5d277156d91 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:07.185104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d15ecc03-fdf5-4c74-95c7-a5d277156d91 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:07.185600 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d15ecc03-fdf5-4c74-95c7-a5d277156d91 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:07.186054 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d15ecc03-fdf5-4c74-95c7-a5d277156d91 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:07.186788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d15ecc03-fdf5-4c74-95c7-a5d277156d91 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:07.187419 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d15ecc03-fdf5-4c74-95c7-a5d277156d91 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:07.188052 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d15ecc03-fdf5-4c74-95c7-a5d277156d91 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:07.470052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2d6ffb9e-93c5-4b98-bc7a-af4f3fe2800b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:07.485110 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2d6ffb9e-93c5-4b98-bc7a-af4f3fe2800b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a" status: 200 len: 1508 microversion: 2.1 time: 0.354268 Oct 29 02:59:07.485954 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1515/2822] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:07 2022] GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a => generated 1508 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:07.499045 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4bdf61a1-764b-4c05-8fbf-7e64c495bcf8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:07.500249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4bdf61a1-764b-4c05-8fbf-7e64c495bcf8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:07.517111 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bdf61a1-764b-4c05-8fbf-7e64c495bcf8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:07.518615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bdf61a1-764b-4c05-8fbf-7e64c495bcf8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:07.520122 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bdf61a1-764b-4c05-8fbf-7e64c495bcf8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:07.534222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bdf61a1-764b-4c05-8fbf-7e64c495bcf8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:07.537988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bdf61a1-764b-4c05-8fbf-7e64c495bcf8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:07.538884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bdf61a1-764b-4c05-8fbf-7e64c495bcf8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:07.605260 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d15ecc03-fdf5-4c74-95c7-a5d277156d91 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:07.627958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d15ecc03-fdf5-4c74-95c7-a5d277156d91 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:07.629892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d15ecc03-fdf5-4c74-95c7-a5d277156d91 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:07.631616 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d15ecc03-fdf5-4c74-95c7-a5d277156d91 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1739 microversion: 2.20 time: 0.489213 Oct 29 02:59:07.632783 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1308/2823] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:07 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1739 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:07.638243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e5f28583-c3c2-4a96-baca-490259e19cb6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:07.645685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e5f28583-c3c2-4a96-baca-490259e19cb6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: 1117f077-2a55-4632-95ed-f3bd9a5f685a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:07.669363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5f28583-c3c2-4a96-baca-490259e19cb6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:07.670742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5f28583-c3c2-4a96-baca-490259e19cb6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:07.671821 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5f28583-c3c2-4a96-baca-490259e19cb6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:07.681668 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5f28583-c3c2-4a96-baca-490259e19cb6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:07.682609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5f28583-c3c2-4a96-baca-490259e19cb6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:07.683313 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5f28583-c3c2-4a96-baca-490259e19cb6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:07.943269 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4bdf61a1-764b-4c05-8fbf-7e64c495bcf8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:07.965164 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4bdf61a1-764b-4c05-8fbf-7e64c495bcf8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1718 microversion: 2.1 time: 0.476148 Oct 29 02:59:07.969604 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1516/2824] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:07 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1718 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:07.979643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-c336f87f-0e30-487e-b7de-935cdc465a55 req-1a6c919c-5053-40fa-b96b-ba289c90217b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4cf7226-5b9f-4b20-9294-5fc3f0118ebd", "name": "network-vif-plugged", "status": "completed", "tag": "2bae1914-163f-4bfb-b681-63356cae067f"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:08.012214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c336f87f-0e30-487e-b7de-935cdc465a55 req-1a6c919c-5053-40fa-b96b-ba289c90217b service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:08.012214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c336f87f-0e30-487e-b7de-935cdc465a55 req-1a6c919c-5053-40fa-b96b-ba289c90217b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:08.012214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c336f87f-0e30-487e-b7de-935cdc465a55 req-1a6c919c-5053-40fa-b96b-ba289c90217b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:08.040295 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-c336f87f-0e30-487e-b7de-935cdc465a55 req-1a6c919c-5053-40fa-b96b-ba289c90217b service nova] Creating event network-vif-plugged:2bae1914-163f-4bfb-b681-63356cae067f for instance d4cf7226-5b9f-4b20-9294-5fc3f0118ebd on n-h2-862967-2 Oct 29 02:59:08.058304 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-c336f87f-0e30-487e-b7de-935cdc465a55 req-1a6c919c-5053-40fa-b96b-ba289c90217b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086009 Oct 29 02:59:08.058304 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1517/2825] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:08.070170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-55e8e45c-f09d-460b-8110-c81e51b39d0e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:08.079002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-55e8e45c-f09d-460b-8110-c81e51b39d0e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:08.095462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55e8e45c-f09d-460b-8110-c81e51b39d0e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:08.100049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55e8e45c-f09d-460b-8110-c81e51b39d0e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:08.101549 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55e8e45c-f09d-460b-8110-c81e51b39d0e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:08.105388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55e8e45c-f09d-460b-8110-c81e51b39d0e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:08.106328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55e8e45c-f09d-460b-8110-c81e51b39d0e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:08.106884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55e8e45c-f09d-460b-8110-c81e51b39d0e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:08.655523 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-55e8e45c-f09d-460b-8110-c81e51b39d0e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:08.671391 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-55e8e45c-f09d-460b-8110-c81e51b39d0e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6" status: 200 len: 1475 microversion: 2.1 time: 0.612388 Oct 29 02:59:08.673732 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1518/2826] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:08 2022] GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 => generated 1475 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:08.684972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-03bcb50e-2793-414c-85de-627b4afde795 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:08.689865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-03bcb50e-2793-414c-85de-627b4afde795 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:08.702310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03bcb50e-2793-414c-85de-627b4afde795 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:08.706723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03bcb50e-2793-414c-85de-627b4afde795 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:08.707430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03bcb50e-2793-414c-85de-627b4afde795 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:08.708348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03bcb50e-2793-414c-85de-627b4afde795 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:08.714361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03bcb50e-2793-414c-85de-627b4afde795 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:08.715081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03bcb50e-2793-414c-85de-627b4afde795 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:08.750962 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e5f28583-c3c2-4a96-baca-490259e19cb6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:08.766472 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e5f28583-c3c2-4a96-baca-490259e19cb6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a" status: 200 len: 1508 microversion: 2.1 time: 1.129051 Oct 29 02:59:08.767127 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1309/2827] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:07 2022] GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a => generated 1508 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:08.804042 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-beae7869-60cd-4293-bc7a-5ae718742aaa tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:08.807583 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-beae7869-60cd-4293-bc7a-5ae718742aaa tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: d4cf7226-5b9f-4b20-9294-5fc3f0118ebd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:08.829110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-beae7869-60cd-4293-bc7a-5ae718742aaa tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:08.829899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-beae7869-60cd-4293-bc7a-5ae718742aaa tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:08.830494 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-beae7869-60cd-4293-bc7a-5ae718742aaa tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:08.831375 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-beae7869-60cd-4293-bc7a-5ae718742aaa tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:08.831988 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-beae7869-60cd-4293-bc7a-5ae718742aaa tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:08.832592 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-beae7869-60cd-4293-bc7a-5ae718742aaa tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:09.229251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-beae7869-60cd-4293-bc7a-5ae718742aaa tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:09.241766 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-beae7869-60cd-4293-bc7a-5ae718742aaa tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd" status: 200 len: 1314 microversion: 2.1 time: 0.458478 Oct 29 02:59:09.244001 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1310/2828] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:08 2022] GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:09.256773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-02963c37-1d9c-47a0-a76d-09d433932b9d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:09.257666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-02963c37-1d9c-47a0-a76d-09d433932b9d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:09.286785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02963c37-1d9c-47a0-a76d-09d433932b9d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:09.287320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02963c37-1d9c-47a0-a76d-09d433932b9d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:09.289184 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02963c37-1d9c-47a0-a76d-09d433932b9d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:09.293043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02963c37-1d9c-47a0-a76d-09d433932b9d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:09.297141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02963c37-1d9c-47a0-a76d-09d433932b9d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:09.298863 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02963c37-1d9c-47a0-a76d-09d433932b9d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:09.578476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-03bcb50e-2793-414c-85de-627b4afde795 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:09.591806 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-03bcb50e-2793-414c-85de-627b4afde795 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1518 microversion: 2.1 time: 0.915114 Oct 29 02:59:09.592640 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1519/2829] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:08 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1518 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:09.599607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cf5a3311-0018-419b-8019-68a8e1507920 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1821821226"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:09.602129 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cf5a3311-0018-419b-8019-68a8e1507920 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:09.628225 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf5a3311-0018-419b-8019-68a8e1507920 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:09.628759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf5a3311-0018-419b-8019-68a8e1507920 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:09.629203 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf5a3311-0018-419b-8019-68a8e1507920 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:09.629928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf5a3311-0018-419b-8019-68a8e1507920 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:09.630414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf5a3311-0018-419b-8019-68a8e1507920 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:09.635144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf5a3311-0018-419b-8019-68a8e1507920 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:10.027264 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-02963c37-1d9c-47a0-a76d-09d433932b9d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:10.042442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-02963c37-1d9c-47a0-a76d-09d433932b9d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:10.046312 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-02963c37-1d9c-47a0-a76d-09d433932b9d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:10.049998 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-02963c37-1d9c-47a0-a76d-09d433932b9d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1739 microversion: 2.20 time: 0.803866 Oct 29 02:59:10.054541 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1311/2830] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:09 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1739 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:10.090158 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9d661200-e053-4601-9ba7-75bb5edc84c6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:10.104502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9d661200-e053-4601-9ba7-75bb5edc84c6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: 1117f077-2a55-4632-95ed-f3bd9a5f685a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:10.134796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d661200-e053-4601-9ba7-75bb5edc84c6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:10.137907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d661200-e053-4601-9ba7-75bb5edc84c6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:10.138605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d661200-e053-4601-9ba7-75bb5edc84c6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:10.139540 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d661200-e053-4601-9ba7-75bb5edc84c6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:10.140878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d661200-e053-4601-9ba7-75bb5edc84c6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:10.142250 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d661200-e053-4601-9ba7-75bb5edc84c6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:10.338857 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9d661200-e053-4601-9ba7-75bb5edc84c6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "PUT /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a" status: 200 len: 1080 microversion: 2.1 time: 0.281933 Oct 29 02:59:10.342283 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1312/2831] 10.222.0.46 () {60 vars in 1256 bytes} [Sat Oct 29 02:59:10 2022] PUT /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a => generated 1080 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:10.352691 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5f28856c-dd5e-4513-86d1-2e140a13639d tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:10.358864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5f28856c-dd5e-4513-86d1-2e140a13639d tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:10.379190 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f28856c-dd5e-4513-86d1-2e140a13639d tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:10.383039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f28856c-dd5e-4513-86d1-2e140a13639d tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:10.385569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f28856c-dd5e-4513-86d1-2e140a13639d tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:10.386534 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f28856c-dd5e-4513-86d1-2e140a13639d tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:10.392685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f28856c-dd5e-4513-86d1-2e140a13639d tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:10.399694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f28856c-dd5e-4513-86d1-2e140a13639d tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:11.565867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5f28856c-dd5e-4513-86d1-2e140a13639d tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:11.584215 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5f28856c-dd5e-4513-86d1-2e140a13639d tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1718 microversion: 2.1 time: 1.240366 Oct 29 02:59:11.612965 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1313/2832] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:10 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1718 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:11.620220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3b7e4ccf-fc86-4ae4-9db8-bb6f5711a44d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:11.624633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3b7e4ccf-fc86-4ae4-9db8-bb6f5711a44d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: d4cf7226-5b9f-4b20-9294-5fc3f0118ebd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:11.642444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b7e4ccf-fc86-4ae4-9db8-bb6f5711a44d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:11.645214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b7e4ccf-fc86-4ae4-9db8-bb6f5711a44d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:11.646389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b7e4ccf-fc86-4ae4-9db8-bb6f5711a44d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:11.647698 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b7e4ccf-fc86-4ae4-9db8-bb6f5711a44d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:11.654828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b7e4ccf-fc86-4ae4-9db8-bb6f5711a44d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:11.656006 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b7e4ccf-fc86-4ae4-9db8-bb6f5711a44d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:12.251540 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3b7e4ccf-fc86-4ae4-9db8-bb6f5711a44d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:12.271515 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3b7e4ccf-fc86-4ae4-9db8-bb6f5711a44d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd" status: 200 len: 1501 microversion: 2.1 time: 0.655405 Oct 29 02:59:12.296804 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1314/2833] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:11 2022] GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd => generated 1501 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:12.312577 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7ff1d8cf-bffd-4699-b1c6-3a20719fccd8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:12.315449 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7ff1d8cf-bffd-4699-b1c6-3a20719fccd8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: 1117f077-2a55-4632-95ed-f3bd9a5f685a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:12.345786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ff1d8cf-bffd-4699-b1c6-3a20719fccd8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:12.353578 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ff1d8cf-bffd-4699-b1c6-3a20719fccd8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:12.354702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ff1d8cf-bffd-4699-b1c6-3a20719fccd8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:12.356339 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ff1d8cf-bffd-4699-b1c6-3a20719fccd8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:12.365620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ff1d8cf-bffd-4699-b1c6-3a20719fccd8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:12.366837 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ff1d8cf-bffd-4699-b1c6-3a20719fccd8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:13.338648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7ff1d8cf-bffd-4699-b1c6-3a20719fccd8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:13.366762 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7ff1d8cf-bffd-4699-b1c6-3a20719fccd8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a" status: 200 len: 1506 microversion: 2.1 time: 1.083446 Oct 29 02:59:13.428940 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1315/2834] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:12 2022] GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a => generated 1506 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:13.437621 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a2c27792-8df4-4819-bdbd-8fee366eedf0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:13.438602 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a2c27792-8df4-4819-bdbd-8fee366eedf0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:13.458227 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2c27792-8df4-4819-bdbd-8fee366eedf0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:13.458850 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2c27792-8df4-4819-bdbd-8fee366eedf0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:13.464605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2c27792-8df4-4819-bdbd-8fee366eedf0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:13.465827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2c27792-8df4-4819-bdbd-8fee366eedf0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:13.466420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2c27792-8df4-4819-bdbd-8fee366eedf0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:13.466967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2c27792-8df4-4819-bdbd-8fee366eedf0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:14.272304 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a2c27792-8df4-4819-bdbd-8fee366eedf0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:14.299404 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a2c27792-8df4-4819-bdbd-8fee366eedf0 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1518 microversion: 2.1 time: 0.868802 Oct 29 02:59:14.300021 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1316/2835] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:13 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1518 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:14.327724 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5db980b2-33b1-4d2f-ac39-30b75dbf7cc4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:14.334896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5db980b2-33b1-4d2f-ac39-30b75dbf7cc4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:14.361348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5db980b2-33b1-4d2f-ac39-30b75dbf7cc4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:14.363032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5db980b2-33b1-4d2f-ac39-30b75dbf7cc4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:14.364086 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5db980b2-33b1-4d2f-ac39-30b75dbf7cc4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:14.365546 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5db980b2-33b1-4d2f-ac39-30b75dbf7cc4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:14.366191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5db980b2-33b1-4d2f-ac39-30b75dbf7cc4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:14.368633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5db980b2-33b1-4d2f-ac39-30b75dbf7cc4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:15.814344 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5db980b2-33b1-4d2f-ac39-30b75dbf7cc4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:15.829507 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5db980b2-33b1-4d2f-ac39-30b75dbf7cc4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:15.846841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5db980b2-33b1-4d2f-ac39-30b75dbf7cc4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:15.847368 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5db980b2-33b1-4d2f-ac39-30b75dbf7cc4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1739 microversion: 2.20 time: 1.546319 Oct 29 02:59:15.849033 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1317/2836] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:14 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1739 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:15.855756 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c62a95d2-1995-45f5-b0be-c764beed8cb8 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:15.868465 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c62a95d2-1995-45f5-b0be-c764beed8cb8 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: d4cf7226-5b9f-4b20-9294-5fc3f0118ebd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:15.901820 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c62a95d2-1995-45f5-b0be-c764beed8cb8 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:15.910146 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c62a95d2-1995-45f5-b0be-c764beed8cb8 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:15.915724 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c62a95d2-1995-45f5-b0be-c764beed8cb8 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:15.919104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c62a95d2-1995-45f5-b0be-c764beed8cb8 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:15.926772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c62a95d2-1995-45f5-b0be-c764beed8cb8 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:15.932925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c62a95d2-1995-45f5-b0be-c764beed8cb8 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:16.165962 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:16.228931 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c62a95d2-1995-45f5-b0be-c764beed8cb8 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "POST /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd/action" status: 202 len: 0 microversion: 2.1 time: 0.366669 Oct 29 02:59:16.234531 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1318/2837] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:59:15 2022] POST /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:59:16.251013 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-858b95e4-6185-4620-ba96-91037a6815c3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:16.251738 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-858b95e4-6185-4620-ba96-91037a6815c3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:16.272781 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-858b95e4-6185-4620-ba96-91037a6815c3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:16.278777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-858b95e4-6185-4620-ba96-91037a6815c3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:16.279643 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-858b95e4-6185-4620-ba96-91037a6815c3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:16.285018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-858b95e4-6185-4620-ba96-91037a6815c3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:16.286090 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-858b95e4-6185-4620-ba96-91037a6815c3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:16.287995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-858b95e4-6185-4620-ba96-91037a6815c3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:16.954981 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-858b95e4-6185-4620-ba96-91037a6815c3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:16.970472 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-858b95e4-6185-4620-ba96-91037a6815c3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1708 microversion: 2.1 time: 0.730290 Oct 29 02:59:16.971085 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1319/2838] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:16 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1708 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:17.021768 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fb4b012d-363b-4d18-b496-ba37ee441eda tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:17.022359 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fb4b012d-363b-4d18-b496-ba37ee441eda tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: 1117f077-2a55-4632-95ed-f3bd9a5f685a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:17.056138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb4b012d-363b-4d18-b496-ba37ee441eda tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:17.056773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb4b012d-363b-4d18-b496-ba37ee441eda tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:17.057155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb4b012d-363b-4d18-b496-ba37ee441eda tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:17.057892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb4b012d-363b-4d18-b496-ba37ee441eda tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:17.058372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb4b012d-363b-4d18-b496-ba37ee441eda tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:17.058790 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb4b012d-363b-4d18-b496-ba37ee441eda tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:17.146338 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cf5a3311-0018-419b-8019-68a8e1507920 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "POST /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6/action" status: 202 len: 0 microversion: 2.1 time: 7.552389 Oct 29 02:59:17.153921 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1520/2839] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:59:09 2022] POST /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6/action => generated 0 bytes in 7561 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 02:59:17.164911 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c13e3705-b59f-448c-86ae-2686c0ecad38 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:17.165967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c13e3705-b59f-448c-86ae-2686c0ecad38 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:17.173519 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c13e3705-b59f-448c-86ae-2686c0ecad38 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:17.174636 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c13e3705-b59f-448c-86ae-2686c0ecad38 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:17.175287 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c13e3705-b59f-448c-86ae-2686c0ecad38 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:17.176221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c13e3705-b59f-448c-86ae-2686c0ecad38 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:17.176898 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c13e3705-b59f-448c-86ae-2686c0ecad38 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:17.177520 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c13e3705-b59f-448c-86ae-2686c0ecad38 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:17.480889 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fb4b012d-363b-4d18-b496-ba37ee441eda tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:17.492711 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fb4b012d-363b-4d18-b496-ba37ee441eda tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a" status: 200 len: 1506 microversion: 2.1 time: 0.492069 Oct 29 02:59:17.494775 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1320/2840] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:16 2022] GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a => generated 1506 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:17.501633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ffbcd6ea-90ed-4154-9776-11eb077da45b tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:17.503278 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ffbcd6ea-90ed-4154-9776-11eb077da45b tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: d4cf7226-5b9f-4b20-9294-5fc3f0118ebd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:17.510378 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c13e3705-b59f-448c-86ae-2686c0ecad38 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:17.512711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ffbcd6ea-90ed-4154-9776-11eb077da45b tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:17.513466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ffbcd6ea-90ed-4154-9776-11eb077da45b tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:17.514326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ffbcd6ea-90ed-4154-9776-11eb077da45b tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:17.515259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ffbcd6ea-90ed-4154-9776-11eb077da45b tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:17.515921 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ffbcd6ea-90ed-4154-9776-11eb077da45b tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:17.517055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ffbcd6ea-90ed-4154-9776-11eb077da45b tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:17.522584 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c13e3705-b59f-448c-86ae-2686c0ecad38 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1518 microversion: 2.1 time: 0.366920 Oct 29 02:59:17.523195 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1521/2841] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:17 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1518 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:17.534000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f273aea1-ea75-4d3c-a754-53c1d65952ff tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:17.534000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f273aea1-ea75-4d3c-a754-53c1d65952ff tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:17.572999 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f273aea1-ea75-4d3c-a754-53c1d65952ff tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:17.574194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f273aea1-ea75-4d3c-a754-53c1d65952ff tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:17.575140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f273aea1-ea75-4d3c-a754-53c1d65952ff tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:17.576595 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f273aea1-ea75-4d3c-a754-53c1d65952ff tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:17.578298 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f273aea1-ea75-4d3c-a754-53c1d65952ff tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:17.579269 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f273aea1-ea75-4d3c-a754-53c1d65952ff tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:17.786522 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ffbcd6ea-90ed-4154-9776-11eb077da45b tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:17.803794 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ffbcd6ea-90ed-4154-9776-11eb077da45b tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd" status: 200 len: 1486 microversion: 2.1 time: 0.302785 Oct 29 02:59:17.805072 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1321/2842] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:17 2022] GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd => generated 1486 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:17.810130 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7ebc197d-ae8a-4194-9e54-d2f098af2c43 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Calling method '.version_select at 0x7ff05c21f790>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:17.823093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ebc197d-ae8a-4194-9e54-d2f098af2c43 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:17.823860 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ebc197d-ae8a-4194-9e54-d2f098af2c43 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:17.824445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ebc197d-ae8a-4194-9e54-d2f098af2c43 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:17.834727 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7ebc197d-ae8a-4194-9e54-d2f098af2c43 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 1166 microversion: 2.1 time: 0.028536 Oct 29 02:59:17.836003 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1322/2843] 10.222.0.46 () {58 vars in 1143 bytes} [Sat Oct 29 02:59:17 2022] GET /compute/v2.1/os-migrations => generated 1166 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:17.841095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4fbcce92-f011-45cc-af6f-f265d80d7d76 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff0536ac1f0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:17.882047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f273aea1-ea75-4d3c-a754-53c1d65952ff tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:17.916476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f273aea1-ea75-4d3c-a754-53c1d65952ff tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:17.924063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f273aea1-ea75-4d3c-a754-53c1d65952ff tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:17.925432 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f273aea1-ea75-4d3c-a754-53c1d65952ff tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1739 microversion: 2.20 time: 0.400370 Oct 29 02:59:17.925721 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4fbcce92-f011-45cc-af6f-f265d80d7d76 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/fc37ec03-f8ad-40d5-9407-d7dca0bdc2b9" status: 200 len: 1410 microversion: 2.1 time: 0.088403 Oct 29 02:59:17.926347 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1323/2844] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:59:17 2022] GET /compute/v2.1/images/fc37ec03-f8ad-40d5-9407-d7dca0bdc2b9 => generated 1410 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:17.928354 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1522/2845] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:17 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1739 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:17.933235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c1f5e995-00c0-4749-b9da-3cbf1db16ed8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:17.936151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c1f5e995-00c0-4749-b9da-3cbf1db16ed8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: 1117f077-2a55-4632-95ed-f3bd9a5f685a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:17.941694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-606f7a90-23ad-4857-8190-602cd15c1bbd tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Action: 'create', calling method: .version_select at 0x7ff05c233790>, body: {"keypair": {"name": "tempest-keypair-1109268866", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChE4Zh8nsD0qSfepDCXAv729RPxDMB7iScW1PFy1IzqPbvz519bT6SQ4rEP99KnZ0PEnGjdGlmmNJT+0s69knCSbftcesW5j/OZX7NkMfGtG4YXdioBksum8yf6A0IfMA=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:17.945269 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1f5e995-00c0-4749-b9da-3cbf1db16ed8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:17.946926 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1f5e995-00c0-4749-b9da-3cbf1db16ed8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:17.947664 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1f5e995-00c0-4749-b9da-3cbf1db16ed8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:17.955687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1f5e995-00c0-4749-b9da-3cbf1db16ed8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:17.956343 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1f5e995-00c0-4749-b9da-3cbf1db16ed8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:17.956844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1f5e995-00c0-4749-b9da-3cbf1db16ed8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:17.991209 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-606f7a90-23ad-4857-8190-602cd15c1bbd tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Getting quotas for project 908b0840bf614aaa9f07757baaeb950b. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:59:18.001497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-606f7a90-23ad-4857-8190-602cd15c1bbd tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Getting quotas for user f2230efa6fc74ba0ad51fc648835a035 and project 908b0840bf614aaa9f07757baaeb950b. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:59:18.098814 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-606f7a90-23ad-4857-8190-602cd15c1bbd tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.169392 Oct 29 02:59:18.100569 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1324/2846] 10.222.0.46 () {62 vars in 1200 bytes} [Sat Oct 29 02:59:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 173 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 02:59:18.120196 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2fbf5f1e-53bd-4da5-bf9b-134ea77f42fa tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:18.123071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2fbf5f1e-53bd-4da5-bf9b-134ea77f42fa tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: d4cf7226-5b9f-4b20-9294-5fc3f0118ebd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:18.146873 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c1f5e995-00c0-4749-b9da-3cbf1db16ed8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "PUT /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a" status: 200 len: 1082 microversion: 2.1 time: 0.217242 Oct 29 02:59:18.151852 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fbf5f1e-53bd-4da5-bf9b-134ea77f42fa tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:18.152418 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fbf5f1e-53bd-4da5-bf9b-134ea77f42fa tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:18.152923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fbf5f1e-53bd-4da5-bf9b-134ea77f42fa tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:18.153637 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fbf5f1e-53bd-4da5-bf9b-134ea77f42fa tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:18.154092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fbf5f1e-53bd-4da5-bf9b-134ea77f42fa tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:18.154357 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1523/2847] 10.222.0.46 () {60 vars in 1256 bytes} [Sat Oct 29 02:59:17 2022] PUT /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a => generated 1082 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:18.154510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fbf5f1e-53bd-4da5-bf9b-134ea77f42fa tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:18.171853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9fcc90f3-2158-4ca0-b860-af2bd4f39e0d tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:18.181883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9fcc90f3-2158-4ca0-b860-af2bd4f39e0d tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:18.203369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fcc90f3-2158-4ca0-b860-af2bd4f39e0d tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:18.208848 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fcc90f3-2158-4ca0-b860-af2bd4f39e0d tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:18.210016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fcc90f3-2158-4ca0-b860-af2bd4f39e0d tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:18.216582 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fcc90f3-2158-4ca0-b860-af2bd4f39e0d tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:18.217263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fcc90f3-2158-4ca0-b860-af2bd4f39e0d tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:18.217859 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fcc90f3-2158-4ca0-b860-af2bd4f39e0d tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:18.229434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2fbf5f1e-53bd-4da5-bf9b-134ea77f42fa tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: d4cf7226-5b9f-4b20-9294-5fc3f0118ebd] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:59:18.532391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:18.578166 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2fbf5f1e-53bd-4da5-bf9b-134ea77f42fa tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd" status: 204 len: 0 microversion: 2.1 time: 0.468719 Oct 29 02:59:18.585143 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1325/2848] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:59:18 2022] DELETE /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:59:18.602027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1791588c-eb0a-49a3-adc6-3da43dd2a35b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:18.605515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1791588c-eb0a-49a3-adc6-3da43dd2a35b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: 1117f077-2a55-4632-95ed-f3bd9a5f685a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:18.613162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1791588c-eb0a-49a3-adc6-3da43dd2a35b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:18.614124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1791588c-eb0a-49a3-adc6-3da43dd2a35b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:18.614785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1791588c-eb0a-49a3-adc6-3da43dd2a35b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:18.616042 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1791588c-eb0a-49a3-adc6-3da43dd2a35b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:18.616775 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1791588c-eb0a-49a3-adc6-3da43dd2a35b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:18.617416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1791588c-eb0a-49a3-adc6-3da43dd2a35b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:18.822347 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9fcc90f3-2158-4ca0-b860-af2bd4f39e0d tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1859 microversion: 2.1 time: 0.660340 Oct 29 02:59:18.826221 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1524/2849] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:18 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1859 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:18.852917 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-312d2566-6669-4dd1-9fee-48959b52fd86 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:18.856954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-312d2566-6669-4dd1-9fee-48959b52fd86 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:18.886920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-312d2566-6669-4dd1-9fee-48959b52fd86 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:18.890204 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-312d2566-6669-4dd1-9fee-48959b52fd86 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:18.891217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-312d2566-6669-4dd1-9fee-48959b52fd86 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:18.892534 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-312d2566-6669-4dd1-9fee-48959b52fd86 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:18.893369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-312d2566-6669-4dd1-9fee-48959b52fd86 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:18.894110 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-312d2566-6669-4dd1-9fee-48959b52fd86 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:18.925262 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1791588c-eb0a-49a3-adc6-3da43dd2a35b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:18.934283 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1791588c-eb0a-49a3-adc6-3da43dd2a35b tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a" status: 200 len: 1508 microversion: 2.1 time: 0.345502 Oct 29 02:59:18.948821 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1326/2850] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:18 2022] GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a => generated 1508 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:18.961469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e3f087bc-887a-4d3b-81b1-5cf9165a6b1f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:18.962327 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e3f087bc-887a-4d3b-81b1-5cf9165a6b1f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: d4cf7226-5b9f-4b20-9294-5fc3f0118ebd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:18.992369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3f087bc-887a-4d3b-81b1-5cf9165a6b1f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:18.995377 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3f087bc-887a-4d3b-81b1-5cf9165a6b1f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:18.997824 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3f087bc-887a-4d3b-81b1-5cf9165a6b1f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:19.000503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3f087bc-887a-4d3b-81b1-5cf9165a6b1f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:19.004627 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3f087bc-887a-4d3b-81b1-5cf9165a6b1f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:19.005354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3f087bc-887a-4d3b-81b1-5cf9165a6b1f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:19.301783 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-312d2566-6669-4dd1-9fee-48959b52fd86 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:19.334721 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-312d2566-6669-4dd1-9fee-48959b52fd86 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1518 microversion: 2.1 time: 0.500403 Oct 29 02:59:19.335766 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1525/2851] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:18 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1518 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:19.352747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-14e2b886-12db-49c3-8dc8-272465c0e481 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:19.353541 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-14e2b886-12db-49c3-8dc8-272465c0e481 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:19.360015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14e2b886-12db-49c3-8dc8-272465c0e481 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:19.360534 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14e2b886-12db-49c3-8dc8-272465c0e481 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:19.360994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14e2b886-12db-49c3-8dc8-272465c0e481 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:19.361717 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14e2b886-12db-49c3-8dc8-272465c0e481 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:19.362189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14e2b886-12db-49c3-8dc8-272465c0e481 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:19.362617 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14e2b886-12db-49c3-8dc8-272465c0e481 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:19.512423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e3f087bc-887a-4d3b-81b1-5cf9165a6b1f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:19.530024 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e3f087bc-887a-4d3b-81b1-5cf9165a6b1f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd" status: 200 len: 1492 microversion: 2.1 time: 0.577731 Oct 29 02:59:19.530876 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1327/2852] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:18 2022] GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd => generated 1492 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:19.536411 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2561181b-c42a-4949-8358-1cc3720bc361 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff05c221f70>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:19.610752 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2561181b-c42a-4949-8358-1cc3720bc361 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/fc37ec03-f8ad-40d5-9407-d7dca0bdc2b9" status: 200 len: 1410 microversion: 2.1 time: 0.078557 Oct 29 02:59:19.613761 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1328/2853] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:59:19 2022] GET /compute/v2.1/images/fc37ec03-f8ad-40d5-9407-d7dca0bdc2b9 => generated 1410 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:19.618400 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-14e2b886-12db-49c3-8dc8-272465c0e481 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1859 microversion: 2.1 time: 0.281105 Oct 29 02:59:19.621153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-636482f1-2159-4124-b7bf-a4877aa8af1a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:19.622026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-636482f1-2159-4124-b7bf-a4877aa8af1a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: 1117f077-2a55-4632-95ed-f3bd9a5f685a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:19.628807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-636482f1-2159-4124-b7bf-a4877aa8af1a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:19.629593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-636482f1-2159-4124-b7bf-a4877aa8af1a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:19.630161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-636482f1-2159-4124-b7bf-a4877aa8af1a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:19.631005 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-636482f1-2159-4124-b7bf-a4877aa8af1a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:19.631539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-636482f1-2159-4124-b7bf-a4877aa8af1a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:19.632195 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-636482f1-2159-4124-b7bf-a4877aa8af1a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:19.639145 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1526/2854] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:19 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1859 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:19.662578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e21240d5-98f8-4d72-9996-9487121522ca tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:19.663588 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e21240d5-98f8-4d72-9996-9487121522ca tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:19.677960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e21240d5-98f8-4d72-9996-9487121522ca tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:19.678483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e21240d5-98f8-4d72-9996-9487121522ca tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:19.678913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e21240d5-98f8-4d72-9996-9487121522ca tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:19.679803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e21240d5-98f8-4d72-9996-9487121522ca tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:19.684823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e21240d5-98f8-4d72-9996-9487121522ca tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:19.686740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e21240d5-98f8-4d72-9996-9487121522ca tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:19.697579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:19.963286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e21240d5-98f8-4d72-9996-9487121522ca tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:19.994550 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-636482f1-2159-4124-b7bf-a4877aa8af1a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:19.995518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e21240d5-98f8-4d72-9996-9487121522ca tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:19.997532 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e21240d5-98f8-4d72-9996-9487121522ca tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:20.002044 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e21240d5-98f8-4d72-9996-9487121522ca tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1739 microversion: 2.20 time: 0.361072 Oct 29 02:59:20.007748 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1527/2855] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:19 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1739 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:20.018393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-190f1497-ef0c-4efc-95f0-17c0216ed368 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:20.019256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-190f1497-ef0c-4efc-95f0-17c0216ed368 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:20.029669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-190f1497-ef0c-4efc-95f0-17c0216ed368 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:20.031046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-190f1497-ef0c-4efc-95f0-17c0216ed368 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:20.031521 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-190f1497-ef0c-4efc-95f0-17c0216ed368 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:20.032118 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-636482f1-2159-4124-b7bf-a4877aa8af1a tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a" status: 200 len: 1508 microversion: 2.1 time: 0.416616 Oct 29 02:59:20.032468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-190f1497-ef0c-4efc-95f0-17c0216ed368 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:20.033210 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-190f1497-ef0c-4efc-95f0-17c0216ed368 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:20.033648 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-190f1497-ef0c-4efc-95f0-17c0216ed368 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:20.041886 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1329/2856] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:19 2022] GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a => generated 1508 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:20.055089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a38287c7-7ede-4ce5-9750-0cf05e116c09 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:20.055589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a38287c7-7ede-4ce5-9750-0cf05e116c09 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:20.073898 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a38287c7-7ede-4ce5-9750-0cf05e116c09 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:20.077213 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a38287c7-7ede-4ce5-9750-0cf05e116c09 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:20.077898 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a38287c7-7ede-4ce5-9750-0cf05e116c09 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:20.079140 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a38287c7-7ede-4ce5-9750-0cf05e116c09 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:20.079743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a38287c7-7ede-4ce5-9750-0cf05e116c09 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:20.083270 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a38287c7-7ede-4ce5-9750-0cf05e116c09 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:20.100593 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-a38287c7-7ede-4ce5-9750-0cf05e116c09 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] HTTP exception thrown: Instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 could not be found. Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a38287c7-7ede-4ce5-9750-0cf05e116c09 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Request method failure captured: Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 HTTP/1.1 Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJUvc3myjvggGo7UpdfHKIKk3M5yYEKrgcj6ULUK8e-vpda648NrDx-tS_mrmSwa3BZc3VUXpBkPCGYUsAfg5N1RQevF3sa7_7E0APgSrRXYau46wTqoLNIAjYOLsCDkD36On-9lKJIW4hEdn8CUiWgk1AiLijj22JTFL0Q5JNz6RIY Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: X-Openstack-Nova-Api-Version: 2.42 Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: c3b1881976f4493996c2ba4a67afc637 Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1730981164 Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c3b1881976f4493996c2ba4a67afc637"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c3b1881976f4493996c2ba4a67afc637"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c3b1881976f4493996c2ba4a67afc637"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c3b1881976f4493996c2ba4a67afc637"}]}] Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1730981164 Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: c3b1881976f4493996c2ba4a67afc637 Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1730981164 Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TaggedBootDevicesTest_v242-1730981164-project Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 1b91e3a384214f79a0333e35e5ad3378 Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1730981164-project Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 could not be found. Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'f0c20eea-c322-4d8e-bafd-3b3b01c5d142'} Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 could not be found. Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:59:20.102841 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:59:20.107534 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 could not be found. Oct 29 02:59:20.107534 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:20.107534 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:20.107534 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:20.107534 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:20.107534 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:20.107534 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:20.107534 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:59:20.107534 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:59:20.107534 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 could not be found. Oct 29 02:59:20.107534 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:20.107534 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a38287c7-7ede-4ce5-9750-0cf05e116c09 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Returning 404 to user: Instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:59:20.107534 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a38287c7-7ede-4ce5-9750-0cf05e116c09 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 404 len: 111 microversion: 2.42 time: 0.059733 Oct 29 02:59:20.107534 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1330/2857] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Oct 29 02:59:20 2022] DELETE /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:59:20.113312 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-31cd19ee-0266-4918-aaf4-30b8ec80efec tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:20.113903 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-31cd19ee-0266-4918-aaf4-30b8ec80efec tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: 1117f077-2a55-4632-95ed-f3bd9a5f685a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:20.122310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-31cd19ee-0266-4918-aaf4-30b8ec80efec tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:20.123159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-31cd19ee-0266-4918-aaf4-30b8ec80efec tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:20.123895 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-31cd19ee-0266-4918-aaf4-30b8ec80efec tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:20.125208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-31cd19ee-0266-4918-aaf4-30b8ec80efec tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:20.125974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-31cd19ee-0266-4918-aaf4-30b8ec80efec tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:20.126729 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-31cd19ee-0266-4918-aaf4-30b8ec80efec tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:20.176756 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-31cd19ee-0266-4918-aaf4-30b8ec80efec tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: 1117f077-2a55-4632-95ed-f3bd9a5f685a] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:59:20.241365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-190f1497-ef0c-4efc-95f0-17c0216ed368 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lazy-loading 'services' on Instance uuid b40f7b3b-04d4-4cfa-8058-09afc05d791e {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:59:20.380991 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-190f1497-ef0c-4efc-95f0-17c0216ed368 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e/os-volume_attachments/662a9e72-3728-431e-8534-864b20b652d3" status: 202 len: 0 microversion: 2.1 time: 0.371241 Oct 29 02:59:20.393415 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-31cd19ee-0266-4918-aaf4-30b8ec80efec tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a" status: 204 len: 0 microversion: 2.1 time: 0.285865 Oct 29 02:59:20.393794 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1528/2858] 10.222.0.46 () {58 vars in 1416 bytes} [Sat Oct 29 02:59:20 2022] DELETE /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e/os-volume_attachments/662a9e72-3728-431e-8534-864b20b652d3 => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:59:20.395759 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1331/2859] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:59:20 2022] DELETE /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:59:20.411959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-87f89ac5-a2b2-4dc0-a4da-6be0cc384974 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:20.412871 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f699ae88-a521-46b4-9069-7ff655bef751 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:20.414761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f699ae88-a521-46b4-9069-7ff655bef751 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] [instance: f0c20eea-c322-4d8e-bafd-3b3b01c5d142] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:20.416683 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-87f89ac5-a2b2-4dc0-a4da-6be0cc384974 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:20.422854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f699ae88-a521-46b4-9069-7ff655bef751 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:20.423722 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f699ae88-a521-46b4-9069-7ff655bef751 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:20.423913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f699ae88-a521-46b4-9069-7ff655bef751 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:20.424472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f699ae88-a521-46b4-9069-7ff655bef751 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:20.424966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f699ae88-a521-46b4-9069-7ff655bef751 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:20.425385 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f699ae88-a521-46b4-9069-7ff655bef751 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:20.427081 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-87f89ac5-a2b2-4dc0-a4da-6be0cc384974 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:20.427216 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-87f89ac5-a2b2-4dc0-a4da-6be0cc384974 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:20.427554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-87f89ac5-a2b2-4dc0-a4da-6be0cc384974 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:20.428331 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-87f89ac5-a2b2-4dc0-a4da-6be0cc384974 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:20.429109 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-87f89ac5-a2b2-4dc0-a4da-6be0cc384974 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:20.429241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-87f89ac5-a2b2-4dc0-a4da-6be0cc384974 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:20.445625 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-f699ae88-a521-46b4-9069-7ff655bef751 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] HTTP exception thrown: Instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 could not be found. Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f699ae88-a521-46b4-9069-7ff655bef751 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Request method failure captured: Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 HTTP/1.1 Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJUvc3myjvggGo7UpdfHKIKk3M5yYEKrgcj6ULUK8e-vpda648NrDx-tS_mrmSwa3BZc3VUXpBkPCGYUsAfg5N1RQevF3sa7_7E0APgSrRXYau46wTqoLNIAjYOLsCDkD36On-9lKJIW4hEdn8CUiWgk1AiLijj22JTFL0Q5JNz6RIY Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: X-Openstack-Nova-Api-Version: 2.42 Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: c3b1881976f4493996c2ba4a67afc637 Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1730981164 Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c3b1881976f4493996c2ba4a67afc637"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c3b1881976f4493996c2ba4a67afc637"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c3b1881976f4493996c2ba4a67afc637"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c3b1881976f4493996c2ba4a67afc637"}]}] Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1730981164 Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: c3b1881976f4493996c2ba4a67afc637 Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1730981164 Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-TaggedBootDevicesTest_v242-1730981164-project Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 1b91e3a384214f79a0333e35e5ad3378 Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1730981164-project Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 could not be found. Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'f0c20eea-c322-4d8e-bafd-3b3b01c5d142'} Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 could not be found. Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 could not be found. Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:59:20.448684 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:20.458431 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:59:20.458431 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:20.458431 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:20.458431 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:20.458431 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:59:20.458431 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:59:20.458431 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 could not be found. Oct 29 02:59:20.458431 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:59:20.458431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f699ae88-a521-46b4-9069-7ff655bef751 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] Returning 404 to user: Instance f0c20eea-c322-4d8e-bafd-3b3b01c5d142 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:59:20.458431 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f699ae88-a521-46b4-9069-7ff655bef751 tempest-TaggedBootDevicesTest_v242-1730981164 tempest-TaggedBootDevicesTest_v242-1730981164-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142" status: 404 len: 111 microversion: 2.42 time: 0.046476 Oct 29 02:59:20.458431 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1529/2860] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:20 2022] GET /compute/v2.1/servers/f0c20eea-c322-4d8e-bafd-3b3b01c5d142 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 02:59:20.474012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-125c895b-1bd7-4422-891c-8b4c81d0827a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:20.487223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-125c895b-1bd7-4422-891c-8b4c81d0827a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:20.504971 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-125c895b-1bd7-4422-891c-8b4c81d0827a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:20.505912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-125c895b-1bd7-4422-891c-8b4c81d0827a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:20.509037 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-125c895b-1bd7-4422-891c-8b4c81d0827a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:20.510075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-125c895b-1bd7-4422-891c-8b4c81d0827a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:20.511663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-125c895b-1bd7-4422-891c-8b4c81d0827a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:20.512353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-125c895b-1bd7-4422-891c-8b4c81d0827a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:20.568233 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-125c895b-1bd7-4422-891c-8b4c81d0827a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114569 Oct 29 02:59:20.576615 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1530/2861] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 02:59:20 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:20.580842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5f85cb3a-77e2-4037-bf69-10d55ab9016e tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:20.581483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5f85cb3a-77e2-4037-bf69-10d55ab9016e tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: 1117f077-2a55-4632-95ed-f3bd9a5f685a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:20.594151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f85cb3a-77e2-4037-bf69-10d55ab9016e tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:20.598664 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f85cb3a-77e2-4037-bf69-10d55ab9016e tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:20.599259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f85cb3a-77e2-4037-bf69-10d55ab9016e tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:20.600168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f85cb3a-77e2-4037-bf69-10d55ab9016e tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:20.600767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f85cb3a-77e2-4037-bf69-10d55ab9016e tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:20.602641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f85cb3a-77e2-4037-bf69-10d55ab9016e tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:20.666824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5f85cb3a-77e2-4037-bf69-10d55ab9016e tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: 1117f077-2a55-4632-95ed-f3bd9a5f685a] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:59:20.763234 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.compute.api [None req-5f85cb3a-77e2-4037-bf69-10d55ab9016e tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: 1117f077-2a55-4632-95ed-f3bd9a5f685a] Instance is already in deleting state, ignoring this request Oct 29 02:59:20.764672 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5f85cb3a-77e2-4037-bf69-10d55ab9016e tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a" status: 204 len: 0 microversion: 2.1 time: 0.188521 Oct 29 02:59:20.768384 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1531/2862] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:59:20 2022] DELETE /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:59:20.772502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c5ef7476-a0a7-47bb-af51-b0a144d539b6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:20.773422 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c5ef7476-a0a7-47bb-af51-b0a144d539b6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: d4cf7226-5b9f-4b20-9294-5fc3f0118ebd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:20.781296 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5ef7476-a0a7-47bb-af51-b0a144d539b6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:20.781891 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5ef7476-a0a7-47bb-af51-b0a144d539b6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:20.782470 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5ef7476-a0a7-47bb-af51-b0a144d539b6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:20.783419 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5ef7476-a0a7-47bb-af51-b0a144d539b6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:20.783969 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5ef7476-a0a7-47bb-af51-b0a144d539b6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:20.784509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5ef7476-a0a7-47bb-af51-b0a144d539b6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:20.977458 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-87f89ac5-a2b2-4dc0-a4da-6be0cc384974 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:21.001979 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-87f89ac5-a2b2-4dc0-a4da-6be0cc384974 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1518 microversion: 2.1 time: 0.600359 Oct 29 02:59:21.004806 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1332/2863] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:20 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1518 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:21.022835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ff2c97f9-e224-46e2-a2dc-878bee7c07c8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff05c22ed30>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:21.130851 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ff2c97f9-e224-46e2-a2dc-878bee7c07c8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/fc37ec03-f8ad-40d5-9407-d7dca0bdc2b9" status: 200 len: 1410 microversion: 2.1 time: 0.121797 Oct 29 02:59:21.131653 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1333/2864] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:59:21 2022] GET /compute/v2.1/images/fc37ec03-f8ad-40d5-9407-d7dca0bdc2b9 => generated 1410 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:21.152656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8d8d7376-83d1-41c0-8ca2-581d30f1cfeb tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:21.155896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8d8d7376-83d1-41c0-8ca2-581d30f1cfeb tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: 1117f077-2a55-4632-95ed-f3bd9a5f685a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:21.188342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d8d7376-83d1-41c0-8ca2-581d30f1cfeb tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:21.209030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d8d7376-83d1-41c0-8ca2-581d30f1cfeb tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:21.213541 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c5ef7476-a0a7-47bb-af51-b0a144d539b6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:21.214078 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d8d7376-83d1-41c0-8ca2-581d30f1cfeb tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:21.219401 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d8d7376-83d1-41c0-8ca2-581d30f1cfeb tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:21.222581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d8d7376-83d1-41c0-8ca2-581d30f1cfeb tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:21.225705 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c5ef7476-a0a7-47bb-af51-b0a144d539b6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd" status: 200 len: 1492 microversion: 2.1 time: 0.459118 Oct 29 02:59:21.226744 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d8d7376-83d1-41c0-8ca2-581d30f1cfeb tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:21.229739 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1532/2865] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:20 2022] GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd => generated 1492 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:21.260476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-087c73bf-162f-4fb3-8f6c-9fc6160d01a4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:21.269749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-087c73bf-162f-4fb3-8f6c-9fc6160d01a4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:21.281584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-087c73bf-162f-4fb3-8f6c-9fc6160d01a4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:21.282382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-087c73bf-162f-4fb3-8f6c-9fc6160d01a4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:21.285470 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-087c73bf-162f-4fb3-8f6c-9fc6160d01a4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:21.286636 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-087c73bf-162f-4fb3-8f6c-9fc6160d01a4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:21.294344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-087c73bf-162f-4fb3-8f6c-9fc6160d01a4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:21.295103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-087c73bf-162f-4fb3-8f6c-9fc6160d01a4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:21.618437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-087c73bf-162f-4fb3-8f6c-9fc6160d01a4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:21.638577 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-087c73bf-162f-4fb3-8f6c-9fc6160d01a4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:21.640139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-087c73bf-162f-4fb3-8f6c-9fc6160d01a4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:21.641959 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-087c73bf-162f-4fb3-8f6c-9fc6160d01a4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1739 microversion: 2.20 time: 0.391357 Oct 29 02:59:21.644030 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1533/2866] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:21 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1739 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:21.660726 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-ca496938-bfcd-48b3-bdfc-85ad7470b4ba req-76371f77-c37a-4fc8-8ce7-161329130aae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4cf7226-5b9f-4b20-9294-5fc3f0118ebd", "name": "network-vif-deleted", "tag": "2bae1914-163f-4bfb-b681-63356cae067f"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:21.692323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ca496938-bfcd-48b3-bdfc-85ad7470b4ba req-76371f77-c37a-4fc8-8ce7-161329130aae service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:21.692833 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ca496938-bfcd-48b3-bdfc-85ad7470b4ba req-76371f77-c37a-4fc8-8ce7-161329130aae service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:21.693261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ca496938-bfcd-48b3-bdfc-85ad7470b4ba req-76371f77-c37a-4fc8-8ce7-161329130aae service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:21.728577 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-ca496938-bfcd-48b3-bdfc-85ad7470b4ba req-76371f77-c37a-4fc8-8ce7-161329130aae service nova] Creating event network-vif-deleted:2bae1914-163f-4bfb-b681-63356cae067f for instance d4cf7226-5b9f-4b20-9294-5fc3f0118ebd on n-h2-862967-2 Oct 29 02:59:21.748545 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-ca496938-bfcd-48b3-bdfc-85ad7470b4ba req-76371f77-c37a-4fc8-8ce7-161329130aae service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102747 Oct 29 02:59:21.764544 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1534/2867] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:21.773772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-83a05ef7-3363-40e3-8203-b262e01c13a6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:21.790480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-83a05ef7-3363-40e3-8203-b262e01c13a6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:21.800901 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83a05ef7-3363-40e3-8203-b262e01c13a6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:21.806108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83a05ef7-3363-40e3-8203-b262e01c13a6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:21.806741 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83a05ef7-3363-40e3-8203-b262e01c13a6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:21.807646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83a05ef7-3363-40e3-8203-b262e01c13a6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:21.808502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83a05ef7-3363-40e3-8203-b262e01c13a6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:21.809104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83a05ef7-3363-40e3-8203-b262e01c13a6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:21.877323 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-83a05ef7-3363-40e3-8203-b262e01c13a6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111428 Oct 29 02:59:21.885214 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1535/2868] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 02:59:21 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:22.004968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8d8d7376-83d1-41c0-8ca2-581d30f1cfeb tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:22.016897 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8d8d7376-83d1-41c0-8ca2-581d30f1cfeb tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a" status: 200 len: 1514 microversion: 2.1 time: 0.881468 Oct 29 02:59:22.017488 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1334/2869] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:21 2022] GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a => generated 1514 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:22.027740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ea094ce1-dbfa-46e1-a220-c6e04e874cfa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:22.028356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ea094ce1-dbfa-46e1-a220-c6e04e874cfa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:22.036342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:22.038365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea094ce1-dbfa-46e1-a220-c6e04e874cfa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:22.049915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea094ce1-dbfa-46e1-a220-c6e04e874cfa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:22.054506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea094ce1-dbfa-46e1-a220-c6e04e874cfa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:22.057503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea094ce1-dbfa-46e1-a220-c6e04e874cfa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:22.059774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea094ce1-dbfa-46e1-a220-c6e04e874cfa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:22.060547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea094ce1-dbfa-46e1-a220-c6e04e874cfa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:22.148835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3ccfc468-dba7-43a3-b90b-61b1b1712fea tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff05c22c3a0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:22.391248 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3ccfc468-dba7-43a3-b90b-61b1b1712fea tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/fc37ec03-f8ad-40d5-9407-d7dca0bdc2b9" status: 200 len: 1410 microversion: 2.1 time: 0.246518 Oct 29 02:59:22.393834 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1335/2870] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:59:22 2022] GET /compute/v2.1/images/fc37ec03-f8ad-40d5-9407-d7dca0bdc2b9 => generated 1410 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:59:22.407117 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e2a9b34d-27b8-47d3-9ecd-a5cdd387084e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:22.408551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e2a9b34d-27b8-47d3-9ecd-a5cdd387084e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: d4cf7226-5b9f-4b20-9294-5fc3f0118ebd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:22.429690 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2a9b34d-27b8-47d3-9ecd-a5cdd387084e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:22.434731 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2a9b34d-27b8-47d3-9ecd-a5cdd387084e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:22.436740 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2a9b34d-27b8-47d3-9ecd-a5cdd387084e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:22.439148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2a9b34d-27b8-47d3-9ecd-a5cdd387084e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:22.440921 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2a9b34d-27b8-47d3-9ecd-a5cdd387084e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:22.441730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2a9b34d-27b8-47d3-9ecd-a5cdd387084e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:22.483730 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-e2a9b34d-27b8-47d3-9ecd-a5cdd387084e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] HTTP exception thrown: Instance d4cf7226-5b9f-4b20-9294-5fc3f0118ebd could not be found. Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e2a9b34d-27b8-47d3-9ecd-a5cdd387084e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Request method failure captured: Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd HTTP/1.1 Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJaEy18RgNLoRH_Cx5N19ntl_MZAWseAedf6nDvdLqq5Uv9fWq711j0XNb6BgsjwGmwVkwDsYZqRqnlQy1v9Czdk1P2JZBE7MuExsRjBvQLnTgLkLacVPY3yLp9R5pSFE5uStbCf24z3K2C9Y_7prmanNUiQJvOS6fzPpIe1j-F47IQ Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b67fc8dd1f4349ca85422bd9a08d3e06"}]}] Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-DeleteServersTestJSON-485778383 Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-DeleteServersTestJSON-485778383-project Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 1ee6c4d28f304eab89014b9c46cc555a Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-DeleteServersTestJSON-485778383-project Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance d4cf7226-5b9f-4b20-9294-5fc3f0118ebd could not be found. Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'd4cf7226-5b9f-4b20-9294-5fc3f0118ebd'} Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4cf7226-5b9f-4b20-9294-5fc3f0118ebd could not be found. Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4cf7226-5b9f-4b20-9294-5fc3f0118ebd could not be found. Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:22.490239 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:22.494391 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:22.494391 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:22.494391 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:22.494391 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:59:22.494391 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:59:22.494391 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4cf7226-5b9f-4b20-9294-5fc3f0118ebd could not be found. Oct 29 02:59:22.494391 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:22.499380 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e2a9b34d-27b8-47d3-9ecd-a5cdd387084e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Returning 404 to user: Instance d4cf7226-5b9f-4b20-9294-5fc3f0118ebd could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:59:22.500842 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e2a9b34d-27b8-47d3-9ecd-a5cdd387084e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd" status: 404 len: 111 microversion: 2.1 time: 0.105258 Oct 29 02:59:22.503036 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1336/2871] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:22 2022] GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:59:22.574949 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ea094ce1-dbfa-46e1-a220-c6e04e874cfa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:22.587845 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ea094ce1-dbfa-46e1-a220-c6e04e874cfa tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1518 microversion: 2.1 time: 0.564277 Oct 29 02:59:22.589743 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1536/2872] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:22 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1518 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:22.668466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7cf2dd5e-efa9-4b47-bca0-6da137b96484 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-56100232", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "2f016d14-d67d-40f5-811c-d451a32578a4"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:22.679224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a0b732c9-a978-4467-9125-379723d93427 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:22.679950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a0b732c9-a978-4467-9125-379723d93427 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:22.697992 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a0b732c9-a978-4467-9125-379723d93427 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:22.709328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a0b732c9-a978-4467-9125-379723d93427 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:22.717657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a0b732c9-a978-4467-9125-379723d93427 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:22.719479 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a0b732c9-a978-4467-9125-379723d93427 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:22.725168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a0b732c9-a978-4467-9125-379723d93427 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:22.728497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a0b732c9-a978-4467-9125-379723d93427 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:23.878785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a0b732c9-a978-4467-9125-379723d93427 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:23.897681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a0b732c9-a978-4467-9125-379723d93427 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:23.899576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a0b732c9-a978-4467-9125-379723d93427 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:23.901280 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a0b732c9-a978-4467-9125-379723d93427 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1739 microversion: 2.20 time: 1.228355 Oct 29 02:59:23.902049 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1537/2873] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:22 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1739 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 02:59:23.920976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-48a8fe73-b2f2-4d10-96c3-8d330037d251 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:23.939267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-48a8fe73-b2f2-4d10-96c3-8d330037d251 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:23.953871 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-48a8fe73-b2f2-4d10-96c3-8d330037d251 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:23.954709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-48a8fe73-b2f2-4d10-96c3-8d330037d251 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:23.955355 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-48a8fe73-b2f2-4d10-96c3-8d330037d251 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:23.956306 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-48a8fe73-b2f2-4d10-96c3-8d330037d251 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:23.960265 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-48a8fe73-b2f2-4d10-96c3-8d330037d251 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:23.961296 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-48a8fe73-b2f2-4d10-96c3-8d330037d251 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:24.098477 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-48a8fe73-b2f2-4d10-96c3-8d330037d251 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.195016 Oct 29 02:59:24.102194 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1538/2874] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 02:59:23 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:24.117220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e1a6cf33-2df3-412a-b21b-28a400730eee tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:24.118001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e1a6cf33-2df3-412a-b21b-28a400730eee tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: 1117f077-2a55-4632-95ed-f3bd9a5f685a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:24.124567 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1a6cf33-2df3-412a-b21b-28a400730eee tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:24.130324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1a6cf33-2df3-412a-b21b-28a400730eee tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:24.130835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1a6cf33-2df3-412a-b21b-28a400730eee tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:24.131767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1a6cf33-2df3-412a-b21b-28a400730eee tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:24.132344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1a6cf33-2df3-412a-b21b-28a400730eee tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:24.132877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1a6cf33-2df3-412a-b21b-28a400730eee tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:24.185327 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1a6cf33-2df3-412a-b21b-28a400730eee tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:24.186064 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1a6cf33-2df3-412a-b21b-28a400730eee tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:24.186709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1a6cf33-2df3-412a-b21b-28a400730eee tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:24.187400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-e1a6cf33-2df3-412a-b21b-28a400730eee tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lazy-loading 'fault' on Instance uuid 1117f077-2a55-4632-95ed-f3bd9a5f685a {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:59:24.255860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e1a6cf33-2df3-412a-b21b-28a400730eee tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a412bb38fb11498d9dd4a6ce6a63370d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae7f63d25fd42f0a2805df87595ff5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:24.265356 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e1a6cf33-2df3-412a-b21b-28a400730eee tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a" status: 200 len: 1308 microversion: 2.1 time: 0.161851 Oct 29 02:59:24.266076 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1539/2875] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:24 2022] GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a => generated 1308 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:24.282067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-31f4576d-7696-4098-8692-7069316aca90 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-296567752", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "22a5169d-9935-41ad-b648-85199ad5dcbb"}, {"port": "998148a8-ddff-46d0-94b6-c27edcac4cb0", "tag": "port-1"}, {"port": "951b4e8b-0238-4e1b-b891-991e85f03a1b", "tag": "port-2"}, {"uuid": "efc4a591-5c84-4c6c-8def-a8b4831fe398", "tag": "net-1"}, {"uuid": "efc4a591-5c84-4c6c-8def-a8b4831fe398"}, {"uuid": "9fa20b5b-a24c-4ee3-9480-eed356d03d2a", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "9fa20b5b-a24c-4ee3-9480-eed356d03d2a", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "924b6d80-cce0-4962-93e7-be42f6702351", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "fb7d4cef-c0f1-4d8e-b1a3-e3c6a61bd3ba", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "b3a63ad8-09ad-451f-8165-266ea9cc7162", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1834436528"}], "key_name": "tempest-keypair-1109268866", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:27.541295 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-7cf2dd5e-efa9-4b47-bca0-6da137b96484 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] validate_networks() for [('2f016d14-d67d-40f5-811c-d451a32578a4', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:59:28.031420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:28.223045 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-31f4576d-7696-4098-8692-7069316aca90 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] validate_networks() for [('22a5169d-9935-41ad-b648-85199ad5dcbb', None, None, None, None, None), (None, None, '998148a8-ddff-46d0-94b6-c27edcac4cb0', None, None, None), (None, None, '951b4e8b-0238-4e1b-b891-991e85f03a1b', None, None, None), ('efc4a591-5c84-4c6c-8def-a8b4831fe398', None, None, None, None, None), ('efc4a591-5c84-4c6c-8def-a8b4831fe398', None, None, None, None, None), ('9fa20b5b-a24c-4ee3-9480-eed356d03d2a', '10.2.2.100', None, None, None, None), ('9fa20b5b-a24c-4ee3-9480-eed356d03d2a', '10.2.2.200', None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:59:28.331734 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-7cf2dd5e-efa9-4b47-bca0-6da137b96484 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:59:28.332410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-7cf2dd5e-efa9-4b47-bca0-6da137b96484 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:59:28.333093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-7cf2dd5e-efa9-4b47-bca0-6da137b96484 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:59:28.333704 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-7cf2dd5e-efa9-4b47-bca0-6da137b96484 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:59:28.334391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-7cf2dd5e-efa9-4b47-bca0-6da137b96484 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:59:28.357552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cf2dd5e-efa9-4b47-bca0-6da137b96484 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:28.358247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cf2dd5e-efa9-4b47-bca0-6da137b96484 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:28.359368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cf2dd5e-efa9-4b47-bca0-6da137b96484 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:28.360258 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cf2dd5e-efa9-4b47-bca0-6da137b96484 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:28.361008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cf2dd5e-efa9-4b47-bca0-6da137b96484 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:28.361604 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cf2dd5e-efa9-4b47-bca0-6da137b96484 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:28.399789 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-7cf2dd5e-efa9-4b47-bca0-6da137b96484 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Getting quotas for project b67fc8dd1f4349ca85422bd9a08d3e06. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:59:28.408226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-7cf2dd5e-efa9-4b47-bca0-6da137b96484 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Getting quotas for user 1ee6c4d28f304eab89014b9c46cc555a and project b67fc8dd1f4349ca85422bd9a08d3e06. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:59:28.422677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7cf2dd5e-efa9-4b47-bca0-6da137b96484 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:59:28.425340 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7cf2dd5e-efa9-4b47-bca0-6da137b96484 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:59:28.479330 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7cf2dd5e-efa9-4b47-bca0-6da137b96484 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.816769 Oct 29 02:59:28.481363 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1337/2876] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:59:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 5819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:59:28.487685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-be423393-a38b-4840-95ac-28bcbc2bbb18 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053634700>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:28.575133 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-be423393-a38b-4840-95ac-28bcbc2bbb18 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/fc37ec03-f8ad-40d5-9407-d7dca0bdc2b9" status: 200 len: 1410 microversion: 2.1 time: 0.092152 Oct 29 02:59:28.578987 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1338/2877] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:59:28 2022] GET /compute/v2.1/images/fc37ec03-f8ad-40d5-9407-d7dca0bdc2b9 => generated 1410 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:28.598584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-efff9156-28a0-4b0b-af0c-353ca69838d5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:28.611873 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-efff9156-28a0-4b0b-af0c-353ca69838d5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:28.628307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efff9156-28a0-4b0b-af0c-353ca69838d5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:28.629117 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efff9156-28a0-4b0b-af0c-353ca69838d5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:28.629728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efff9156-28a0-4b0b-af0c-353ca69838d5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:28.630795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efff9156-28a0-4b0b-af0c-353ca69838d5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:28.633640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efff9156-28a0-4b0b-af0c-353ca69838d5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:28.634814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efff9156-28a0-4b0b-af0c-353ca69838d5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:28.916481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-efff9156-28a0-4b0b-af0c-353ca69838d5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:28.961417 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:28.968311 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-efff9156-28a0-4b0b-af0c-353ca69838d5 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1518 microversion: 2.1 time: 0.386702 Oct 29 02:59:28.969018 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1339/2878] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:28 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1518 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:28.974699 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-0d3c893f-4e8c-41e8-a51f-2d4336286714 req-676a4dd5-2c6e-48df-abbe-0720dc4237bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1117f077-2a55-4632-95ed-f3bd9a5f685a", "name": "network-vif-deleted", "tag": "dc4993cb-362f-41b9-815f-a3711444c86e"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:29.002143 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0d3c893f-4e8c-41e8-a51f-2d4336286714 req-676a4dd5-2c6e-48df-abbe-0720dc4237bb service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:29.002760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0d3c893f-4e8c-41e8-a51f-2d4336286714 req-676a4dd5-2c6e-48df-abbe-0720dc4237bb service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:29.005971 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0d3c893f-4e8c-41e8-a51f-2d4336286714 req-676a4dd5-2c6e-48df-abbe-0720dc4237bb service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:29.056847 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-0d3c893f-4e8c-41e8-a51f-2d4336286714 req-676a4dd5-2c6e-48df-abbe-0720dc4237bb service nova] Creating event network-vif-deleted:dc4993cb-362f-41b9-815f-a3711444c86e for instance 1117f077-2a55-4632-95ed-f3bd9a5f685a on n-h1-862967-2 Oct 29 02:59:29.082861 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-0d3c893f-4e8c-41e8-a51f-2d4336286714 req-676a4dd5-2c6e-48df-abbe-0720dc4237bb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112440 Oct 29 02:59:29.088771 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1340/2879] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:29.099508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-19029738-b036-45fa-90b5-a994ca9d8903 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:29.100301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-19029738-b036-45fa-90b5-a994ca9d8903 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:29.117405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19029738-b036-45fa-90b5-a994ca9d8903 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:29.117915 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19029738-b036-45fa-90b5-a994ca9d8903 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:29.118349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19029738-b036-45fa-90b5-a994ca9d8903 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:29.119066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19029738-b036-45fa-90b5-a994ca9d8903 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:29.119512 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19029738-b036-45fa-90b5-a994ca9d8903 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:29.119935 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19029738-b036-45fa-90b5-a994ca9d8903 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:29.582334 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-19029738-b036-45fa-90b5-a994ca9d8903 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:29.594834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-19029738-b036-45fa-90b5-a994ca9d8903 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:29.596481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-19029738-b036-45fa-90b5-a994ca9d8903 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:29.597794 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-19029738-b036-45fa-90b5-a994ca9d8903 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1721 microversion: 2.20 time: 0.507477 Oct 29 02:59:29.598379 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1341/2880] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:29 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1721 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:29.611417 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d53b4400-de75-428e-bb36-b3f563efce67 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:29.628982 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d53b4400-de75-428e-bb36-b3f563efce67 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:29.639349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d53b4400-de75-428e-bb36-b3f563efce67 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:29.640191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d53b4400-de75-428e-bb36-b3f563efce67 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:29.642976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d53b4400-de75-428e-bb36-b3f563efce67 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:29.647983 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d53b4400-de75-428e-bb36-b3f563efce67 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:29.653885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d53b4400-de75-428e-bb36-b3f563efce67 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:29.654546 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d53b4400-de75-428e-bb36-b3f563efce67 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:29.764699 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d53b4400-de75-428e-bb36-b3f563efce67 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156864 Oct 29 02:59:29.774291 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1342/2881] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 02:59:29 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:29.778671 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-41efa0ea-da53-462f-9aea-282916f52db0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:29.781195 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-41efa0ea-da53-462f-9aea-282916f52db0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: 1117f077-2a55-4632-95ed-f3bd9a5f685a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:29.795492 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41efa0ea-da53-462f-9aea-282916f52db0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:29.796249 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41efa0ea-da53-462f-9aea-282916f52db0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:29.796874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41efa0ea-da53-462f-9aea-282916f52db0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:29.797775 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41efa0ea-da53-462f-9aea-282916f52db0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:29.798474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41efa0ea-da53-462f-9aea-282916f52db0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:29.798993 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41efa0ea-da53-462f-9aea-282916f52db0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:29.817863 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-41efa0ea-da53-462f-9aea-282916f52db0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] HTTP exception thrown: Instance 1117f077-2a55-4632-95ed-f3bd9a5f685a could not be found. Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-41efa0ea-da53-462f-9aea-282916f52db0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Request method failure captured: Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a HTTP/1.1 Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJZNDfL5173akTrhTOjEl6vGha0LjFohuD85hfN10t8l71F9qDMqNPEA_KyuIWEbYGMMY4ihj6zfzXy5Aw6DwnpuAn-ZhKgfc-UloJEb-ZzJzp9bVw4mkE4wOcDI-HVjU6zzaR_-PQROmZALkFCOHHxtRrAobBaMJsjrAYMhUeefkyc Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: dae7f63d25fd42f0a2805df87595ff5f Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1274860787 Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dae7f63d25fd42f0a2805df87595ff5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dae7f63d25fd42f0a2805df87595ff5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_dae7f63d25fd42f0a2805df87595ff5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/dae7f63d25fd42f0a2805df87595ff5f"}]}] Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerDiskConfigTestJSON-1274860787 Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: dae7f63d25fd42f0a2805df87595ff5f Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1274860787 Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerDiskConfigTestJSON-1274860787-project Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: a412bb38fb11498d9dd4a6ce6a63370d Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerDiskConfigTestJSON-1274860787-project Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 1117f077-2a55-4632-95ed-f3bd9a5f685a could not be found. Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '1117f077-2a55-4632-95ed-f3bd9a5f685a'} Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1117f077-2a55-4632-95ed-f3bd9a5f685a could not be found. Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1117f077-2a55-4632-95ed-f3bd9a5f685a could not be found. Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:29.819896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:29.830453 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:29.830453 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:29.830453 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:29.830453 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:59:29.830453 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:59:29.830453 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1117f077-2a55-4632-95ed-f3bd9a5f685a could not be found. Oct 29 02:59:29.830453 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:29.830453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-41efa0ea-da53-462f-9aea-282916f52db0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Returning 404 to user: Instance 1117f077-2a55-4632-95ed-f3bd9a5f685a could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:59:29.830453 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-41efa0ea-da53-462f-9aea-282916f52db0 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a" status: 404 len: 111 microversion: 2.1 time: 0.053455 Oct 29 02:59:29.830453 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1343/2882] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:29 2022] GET /compute/v2.1/servers/1117f077-2a55-4632-95ed-f3bd9a5f685a => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:59:29.830453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-b53d0747-68ab-42dc-a2b6-9b60a6130ef8 req-b0bc03c0-3f0a-41ef-a3cf-6ff03e81e23a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b7f1dd5-af84-416c-84a6-e7a0a67294e6", "name": "network-vif-plugged", "status": "completed", "tag": "6f3a9167-1c0e-4d88-92ba-1c4e6bd37758"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:29.841224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b53d0747-68ab-42dc-a2b6-9b60a6130ef8 req-b0bc03c0-3f0a-41ef-a3cf-6ff03e81e23a service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:29.841788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b53d0747-68ab-42dc-a2b6-9b60a6130ef8 req-b0bc03c0-3f0a-41ef-a3cf-6ff03e81e23a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:29.842288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b53d0747-68ab-42dc-a2b6-9b60a6130ef8 req-b0bc03c0-3f0a-41ef-a3cf-6ff03e81e23a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:29.875190 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-b53d0747-68ab-42dc-a2b6-9b60a6130ef8 req-b0bc03c0-3f0a-41ef-a3cf-6ff03e81e23a service nova] Creating event network-vif-plugged:6f3a9167-1c0e-4d88-92ba-1c4e6bd37758 for instance 7b7f1dd5-af84-416c-84a6-e7a0a67294e6 on n-h1-862967-2 Oct 29 02:59:29.898178 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-b53d0747-68ab-42dc-a2b6-9b60a6130ef8 req-b0bc03c0-3f0a-41ef-a3cf-6ff03e81e23a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073598 Oct 29 02:59:29.899483 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1344/2883] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:29.910554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4d90637e-5caa-4c9d-98a9-d503cf9b38b5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:29.914511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4d90637e-5caa-4c9d-98a9-d503cf9b38b5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:29.930023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d90637e-5caa-4c9d-98a9-d503cf9b38b5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:29.930661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d90637e-5caa-4c9d-98a9-d503cf9b38b5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:29.933253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d90637e-5caa-4c9d-98a9-d503cf9b38b5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:29.935856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d90637e-5caa-4c9d-98a9-d503cf9b38b5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:29.937662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d90637e-5caa-4c9d-98a9-d503cf9b38b5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:29.940211 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d90637e-5caa-4c9d-98a9-d503cf9b38b5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:30.048771 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4d90637e-5caa-4c9d-98a9-d503cf9b38b5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:30.058330 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4d90637e-5caa-4c9d-98a9-d503cf9b38b5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 200 len: 1265 microversion: 2.1 time: 0.157074 Oct 29 02:59:30.060117 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1345/2884] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:29 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:30.079255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-456964d6-17ce-446a-9a12-96a40b6f70ff tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff05c24b310>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:30.204599 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-456964d6-17ce-446a-9a12-96a40b6f70ff tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/fc37ec03-f8ad-40d5-9407-d7dca0bdc2b9" status: 200 len: 1410 microversion: 2.1 time: 0.143290 Oct 29 02:59:30.215599 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1346/2885] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:59:30 2022] GET /compute/v2.1/images/fc37ec03-f8ad-40d5-9407-d7dca0bdc2b9 => generated 1410 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:30.229190 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ecfb1d8b-a20b-4922-b447-feb8c8b6c2e6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:30.229985 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ecfb1d8b-a20b-4922-b447-feb8c8b6c2e6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:30.236904 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecfb1d8b-a20b-4922-b447-feb8c8b6c2e6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:30.237619 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecfb1d8b-a20b-4922-b447-feb8c8b6c2e6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:30.238218 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecfb1d8b-a20b-4922-b447-feb8c8b6c2e6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:30.239085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecfb1d8b-a20b-4922-b447-feb8c8b6c2e6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:30.239682 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecfb1d8b-a20b-4922-b447-feb8c8b6c2e6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:30.240308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecfb1d8b-a20b-4922-b447-feb8c8b6c2e6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:30.256979 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-ecfb1d8b-a20b-4922-b447-feb8c8b6c2e6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] HTTP exception thrown: Instance d981d040-d96a-40a5-a893-033a9d51e368 could not be found. Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ecfb1d8b-a20b-4922-b447-feb8c8b6c2e6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Request method failure captured: Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 HTTP/1.1 Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJZNDfL5173akTrhTOjEl6vGha0LjFohuD85hfN10t8l71F9qDMqNPEA_KyuIWEbYGMMY4ihj6zfzXy5Aw6DwnpuAn-ZhKgfc-UloJEb-ZzJzp9bVw4mkE4wOcDI-HVjU6zzaR_-PQROmZALkFCOHHxtRrAobBaMJsjrAYMhUeefkyc Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: dae7f63d25fd42f0a2805df87595ff5f Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1274860787 Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dae7f63d25fd42f0a2805df87595ff5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dae7f63d25fd42f0a2805df87595ff5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_dae7f63d25fd42f0a2805df87595ff5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/dae7f63d25fd42f0a2805df87595ff5f"}]}] Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerDiskConfigTestJSON-1274860787 Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: dae7f63d25fd42f0a2805df87595ff5f Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1274860787 Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerDiskConfigTestJSON-1274860787-project Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: a412bb38fb11498d9dd4a6ce6a63370d Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerDiskConfigTestJSON-1274860787-project Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance d981d040-d96a-40a5-a893-033a9d51e368 could not be found. Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'd981d040-d96a-40a5-a893-033a9d51e368'} Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d981d040-d96a-40a5-a893-033a9d51e368 could not be found. Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:59:30.259241 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:59:30.263063 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d981d040-d96a-40a5-a893-033a9d51e368 could not be found. Oct 29 02:59:30.263063 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:30.263063 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:30.263063 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:30.263063 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:30.263063 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:30.263063 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:30.263063 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:59:30.263063 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:59:30.263063 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d981d040-d96a-40a5-a893-033a9d51e368 could not be found. Oct 29 02:59:30.263063 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:30.263063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ecfb1d8b-a20b-4922-b447-feb8c8b6c2e6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Returning 404 to user: Instance d981d040-d96a-40a5-a893-033a9d51e368 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:59:30.264724 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ecfb1d8b-a20b-4922-b447-feb8c8b6c2e6 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 404 len: 111 microversion: 2.1 time: 0.046262 Oct 29 02:59:30.273112 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1347/2886] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:59:30 2022] DELETE /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:59:30.279412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-84c56820-552a-4847-beae-6b412e492710 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:30.280280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-84c56820-552a-4847-beae-6b412e492710 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:30.287186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-84c56820-552a-4847-beae-6b412e492710 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:30.288002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-84c56820-552a-4847-beae-6b412e492710 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:30.289550 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-84c56820-552a-4847-beae-6b412e492710 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:30.290674 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-84c56820-552a-4847-beae-6b412e492710 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:30.291389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-84c56820-552a-4847-beae-6b412e492710 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:30.292498 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-84c56820-552a-4847-beae-6b412e492710 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:30.655824 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-84c56820-552a-4847-beae-6b412e492710 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:30.680684 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-84c56820-552a-4847-beae-6b412e492710 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1518 microversion: 2.1 time: 0.405366 Oct 29 02:59:30.681697 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1348/2887] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:30 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1518 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:30.686971 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f79943c9-bf05-47c5-ae50-886b5c47f3c8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:30.687735 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f79943c9-bf05-47c5-ae50-886b5c47f3c8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: d981d040-d96a-40a5-a893-033a9d51e368] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:30.696971 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f79943c9-bf05-47c5-ae50-886b5c47f3c8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:30.702603 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f79943c9-bf05-47c5-ae50-886b5c47f3c8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:30.704918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f79943c9-bf05-47c5-ae50-886b5c47f3c8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:30.706349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f79943c9-bf05-47c5-ae50-886b5c47f3c8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:30.707139 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f79943c9-bf05-47c5-ae50-886b5c47f3c8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:30.707521 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f79943c9-bf05-47c5-ae50-886b5c47f3c8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:30.750311 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-f79943c9-bf05-47c5-ae50-886b5c47f3c8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] HTTP exception thrown: Instance d981d040-d96a-40a5-a893-033a9d51e368 could not be found. Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f79943c9-bf05-47c5-ae50-886b5c47f3c8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Request method failure captured: Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 HTTP/1.1 Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJZNDfL5173akTrhTOjEl6vGha0LjFohuD85hfN10t8l71F9qDMqNPEA_KyuIWEbYGMMY4ihj6zfzXy5Aw6DwnpuAn-ZhKgfc-UloJEb-ZzJzp9bVw4mkE4wOcDI-HVjU6zzaR_-PQROmZALkFCOHHxtRrAobBaMJsjrAYMhUeefkyc Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: dae7f63d25fd42f0a2805df87595ff5f Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1274860787 Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dae7f63d25fd42f0a2805df87595ff5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dae7f63d25fd42f0a2805df87595ff5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_dae7f63d25fd42f0a2805df87595ff5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/dae7f63d25fd42f0a2805df87595ff5f"}]}] Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerDiskConfigTestJSON-1274860787 Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: dae7f63d25fd42f0a2805df87595ff5f Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1274860787 Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerDiskConfigTestJSON-1274860787-project Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: a412bb38fb11498d9dd4a6ce6a63370d Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerDiskConfigTestJSON-1274860787-project Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance d981d040-d96a-40a5-a893-033a9d51e368 could not be found. Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'd981d040-d96a-40a5-a893-033a9d51e368'} Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d981d040-d96a-40a5-a893-033a9d51e368 could not be found. Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d981d040-d96a-40a5-a893-033a9d51e368 could not be found. Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:30.751631 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:30.760350 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:30.760350 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:30.760350 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:30.760350 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:59:30.760350 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:59:30.760350 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d981d040-d96a-40a5-a893-033a9d51e368 could not be found. Oct 29 02:59:30.760350 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:30.760350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f79943c9-bf05-47c5-ae50-886b5c47f3c8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Returning 404 to user: Instance d981d040-d96a-40a5-a893-033a9d51e368 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:59:30.760350 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f79943c9-bf05-47c5-ae50-886b5c47f3c8 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368" status: 404 len: 111 microversion: 2.1 time: 0.070370 Oct 29 02:59:30.760350 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1349/2888] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:30 2022] GET /compute/v2.1/servers/d981d040-d96a-40a5-a893-033a9d51e368 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:59:30.762441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a9ac52c9-dc73-4617-b022-7a5b0214c84e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:30.762441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a9ac52c9-dc73-4617-b022-7a5b0214c84e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:30.772087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9ac52c9-dc73-4617-b022-7a5b0214c84e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:30.772694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9ac52c9-dc73-4617-b022-7a5b0214c84e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:30.773139 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9ac52c9-dc73-4617-b022-7a5b0214c84e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:30.773853 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9ac52c9-dc73-4617-b022-7a5b0214c84e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:30.774313 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9ac52c9-dc73-4617-b022-7a5b0214c84e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:30.774738 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9ac52c9-dc73-4617-b022-7a5b0214c84e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:31.015287 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a9ac52c9-dc73-4617-b022-7a5b0214c84e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:31.026552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a9ac52c9-dc73-4617-b022-7a5b0214c84e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:31.028307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a9ac52c9-dc73-4617-b022-7a5b0214c84e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:31.032741 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a9ac52c9-dc73-4617-b022-7a5b0214c84e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1721 microversion: 2.20 time: 0.277629 Oct 29 02:59:31.034246 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1350/2889] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:30 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1721 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:31.039525 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8fdf4c50-fdb7-43b0-a0a2-def3c3446184 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:31.040223 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8fdf4c50-fdb7-43b0-a0a2-def3c3446184 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:31.052901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8fdf4c50-fdb7-43b0-a0a2-def3c3446184 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:31.055254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8fdf4c50-fdb7-43b0-a0a2-def3c3446184 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:31.056013 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8fdf4c50-fdb7-43b0-a0a2-def3c3446184 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:31.057267 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8fdf4c50-fdb7-43b0-a0a2-def3c3446184 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:31.057854 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8fdf4c50-fdb7-43b0-a0a2-def3c3446184 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:31.058150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8fdf4c50-fdb7-43b0-a0a2-def3c3446184 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:31.086016 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-8fdf4c50-fdb7-43b0-a0a2-def3c3446184 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] HTTP exception thrown: Instance c352884d-b0ee-4a54-bc72-41e39eb0839f could not be found. Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8fdf4c50-fdb7-43b0-a0a2-def3c3446184 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Request method failure captured: Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f HTTP/1.1 Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJZNDfL5173akTrhTOjEl6vGha0LjFohuD85hfN10t8l71F9qDMqNPEA_KyuIWEbYGMMY4ihj6zfzXy5Aw6DwnpuAn-ZhKgfc-UloJEb-ZzJzp9bVw4mkE4wOcDI-HVjU6zzaR_-PQROmZALkFCOHHxtRrAobBaMJsjrAYMhUeefkyc Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: dae7f63d25fd42f0a2805df87595ff5f Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1274860787 Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dae7f63d25fd42f0a2805df87595ff5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dae7f63d25fd42f0a2805df87595ff5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_dae7f63d25fd42f0a2805df87595ff5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/dae7f63d25fd42f0a2805df87595ff5f"}]}] Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerDiskConfigTestJSON-1274860787 Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: dae7f63d25fd42f0a2805df87595ff5f Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1274860787 Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerDiskConfigTestJSON-1274860787-project Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: a412bb38fb11498d9dd4a6ce6a63370d Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerDiskConfigTestJSON-1274860787-project Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance c352884d-b0ee-4a54-bc72-41e39eb0839f could not be found. Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'c352884d-b0ee-4a54-bc72-41e39eb0839f'} Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c352884d-b0ee-4a54-bc72-41e39eb0839f could not be found. Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:59:31.087922 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:59:31.092482 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c352884d-b0ee-4a54-bc72-41e39eb0839f could not be found. Oct 29 02:59:31.092482 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:31.092482 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:31.092482 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:31.092482 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:31.092482 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:31.092482 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:31.092482 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:59:31.092482 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:59:31.092482 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c352884d-b0ee-4a54-bc72-41e39eb0839f could not be found. Oct 29 02:59:31.092482 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:31.095575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8fdf4c50-fdb7-43b0-a0a2-def3c3446184 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Returning 404 to user: Instance c352884d-b0ee-4a54-bc72-41e39eb0839f could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:59:31.096652 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8fdf4c50-fdb7-43b0-a0a2-def3c3446184 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 404 len: 111 microversion: 2.1 time: 0.061245 Oct 29 02:59:31.097697 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1351/2890] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:59:31 2022] DELETE /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:59:31.103116 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2f9f667f-4539-462d-8cab-59106e2064a2 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:31.106274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2f9f667f-4539-462d-8cab-59106e2064a2 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:31.116874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f9f667f-4539-462d-8cab-59106e2064a2 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:31.117625 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f9f667f-4539-462d-8cab-59106e2064a2 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:31.118236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f9f667f-4539-462d-8cab-59106e2064a2 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:31.119181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f9f667f-4539-462d-8cab-59106e2064a2 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:31.120350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f9f667f-4539-462d-8cab-59106e2064a2 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:31.121022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f9f667f-4539-462d-8cab-59106e2064a2 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:31.157610 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2f9f667f-4539-462d-8cab-59106e2064a2 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058652 Oct 29 02:59:31.158783 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1352/2891] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 02:59:31 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:31.163585 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e3aa8489-695c-4960-8af8-885b0314e024 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:31.164441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e3aa8489-695c-4960-8af8-885b0314e024 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:31.171464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3aa8489-695c-4960-8af8-885b0314e024 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:31.172236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3aa8489-695c-4960-8af8-885b0314e024 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:31.172947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3aa8489-695c-4960-8af8-885b0314e024 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:31.173923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3aa8489-695c-4960-8af8-885b0314e024 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:31.174609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3aa8489-695c-4960-8af8-885b0314e024 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:31.175236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3aa8489-695c-4960-8af8-885b0314e024 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:31.258354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e3aa8489-695c-4960-8af8-885b0314e024 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:31.268138 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e3aa8489-695c-4960-8af8-885b0314e024 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 200 len: 1265 microversion: 2.1 time: 0.107619 Oct 29 02:59:31.268868 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1353/2892] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:31 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 1265 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:31.289424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2d8d2342-7f77-4ac5-b827-9ab105682218 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:31.291239 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2d8d2342-7f77-4ac5-b827-9ab105682218 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] [instance: c352884d-b0ee-4a54-bc72-41e39eb0839f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:31.298638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d8d2342-7f77-4ac5-b827-9ab105682218 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:31.299482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d8d2342-7f77-4ac5-b827-9ab105682218 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:31.300117 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d8d2342-7f77-4ac5-b827-9ab105682218 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:31.301287 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d8d2342-7f77-4ac5-b827-9ab105682218 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:31.302517 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d8d2342-7f77-4ac5-b827-9ab105682218 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:31.303376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d8d2342-7f77-4ac5-b827-9ab105682218 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:31.331982 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-2d8d2342-7f77-4ac5-b827-9ab105682218 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] HTTP exception thrown: Instance c352884d-b0ee-4a54-bc72-41e39eb0839f could not be found. Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2d8d2342-7f77-4ac5-b827-9ab105682218 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Request method failure captured: Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f HTTP/1.1 Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJZNDfL5173akTrhTOjEl6vGha0LjFohuD85hfN10t8l71F9qDMqNPEA_KyuIWEbYGMMY4ihj6zfzXy5Aw6DwnpuAn-ZhKgfc-UloJEb-ZzJzp9bVw4mkE4wOcDI-HVjU6zzaR_-PQROmZALkFCOHHxtRrAobBaMJsjrAYMhUeefkyc Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: dae7f63d25fd42f0a2805df87595ff5f Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1274860787 Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dae7f63d25fd42f0a2805df87595ff5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dae7f63d25fd42f0a2805df87595ff5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_dae7f63d25fd42f0a2805df87595ff5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/dae7f63d25fd42f0a2805df87595ff5f"}]}] Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerDiskConfigTestJSON-1274860787 Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: dae7f63d25fd42f0a2805df87595ff5f Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1274860787 Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerDiskConfigTestJSON-1274860787-project Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: a412bb38fb11498d9dd4a6ce6a63370d Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerDiskConfigTestJSON-1274860787-project Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance c352884d-b0ee-4a54-bc72-41e39eb0839f could not be found. Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'c352884d-b0ee-4a54-bc72-41e39eb0839f'} Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c352884d-b0ee-4a54-bc72-41e39eb0839f could not be found. Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c352884d-b0ee-4a54-bc72-41e39eb0839f could not be found. Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:31.335823 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:31.340376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:31.340376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:31.340376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:31.340376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:59:31.340376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:59:31.340376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c352884d-b0ee-4a54-bc72-41e39eb0839f could not be found. Oct 29 02:59:31.340376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:31.340376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2d8d2342-7f77-4ac5-b827-9ab105682218 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] Returning 404 to user: Instance c352884d-b0ee-4a54-bc72-41e39eb0839f could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:59:31.340376 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2d8d2342-7f77-4ac5-b827-9ab105682218 tempest-ServerDiskConfigTestJSON-1274860787 tempest-ServerDiskConfigTestJSON-1274860787-project] 10.222.0.46 "GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f" status: 404 len: 111 microversion: 2.1 time: 0.059901 Oct 29 02:59:31.344804 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1354/2893] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:31 2022] GET /compute/v2.1/servers/c352884d-b0ee-4a54-bc72-41e39eb0839f => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:59:31.349839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6ae26b2c-58ce-44a5-b61b-3dad1fbcfe1d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff05363b5e0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:31.461325 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6ae26b2c-58ce-44a5-b61b-3dad1fbcfe1d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/fc37ec03-f8ad-40d5-9407-d7dca0bdc2b9" status: 200 len: 1410 microversion: 2.1 time: 0.115325 Oct 29 02:59:31.469902 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1355/2894] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:59:31 2022] GET /compute/v2.1/images/fc37ec03-f8ad-40d5-9407-d7dca0bdc2b9 => generated 1410 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:31.717767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ef1e35a1-7be2-4d11-b291-95bbff6f4dac tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:31.718759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ef1e35a1-7be2-4d11-b291-95bbff6f4dac tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:31.733934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef1e35a1-7be2-4d11-b291-95bbff6f4dac tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:31.736367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef1e35a1-7be2-4d11-b291-95bbff6f4dac tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:31.736882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef1e35a1-7be2-4d11-b291-95bbff6f4dac tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:31.737635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef1e35a1-7be2-4d11-b291-95bbff6f4dac tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:31.738096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef1e35a1-7be2-4d11-b291-95bbff6f4dac tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:31.738515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef1e35a1-7be2-4d11-b291-95bbff6f4dac tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:32.578108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ef1e35a1-7be2-4d11-b291-95bbff6f4dac tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:32.601196 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ef1e35a1-7be2-4d11-b291-95bbff6f4dac tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1518 microversion: 2.1 time: 0.886761 Oct 29 02:59:32.602511 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1356/2895] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:31 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1518 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 02:59:32.610313 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-c1b1c6c4-70a4-4346-b53b-0fc9b5bef16f req-480e736c-1b07-43a2-a3a1-c88770cd5bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d9854a1-ead6-4570-b801-13c47d0bf721", "name": "network-vif-plugged", "status": "completed", "tag": "5c797ecc-c991-49d4-a9d6-68c2398ef486"}, {"server_uuid": "1ab56816-cc78-4e73-918a-4c76895fed6b", "name": "network-vif-unplugged", "status": "completed", "tag": "dbe9ee0b-c11e-4edb-a1e4-5c86a11499da"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:32.656271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c1b1c6c4-70a4-4346-b53b-0fc9b5bef16f req-480e736c-1b07-43a2-a3a1-c88770cd5bf8 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:32.657501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c1b1c6c4-70a4-4346-b53b-0fc9b5bef16f req-480e736c-1b07-43a2-a3a1-c88770cd5bf8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:32.661513 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c1b1c6c4-70a4-4346-b53b-0fc9b5bef16f req-480e736c-1b07-43a2-a3a1-c88770cd5bf8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:32.723158 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-c1b1c6c4-70a4-4346-b53b-0fc9b5bef16f req-480e736c-1b07-43a2-a3a1-c88770cd5bf8 service nova] Creating event network-vif-plugged:5c797ecc-c991-49d4-a9d6-68c2398ef486 for instance 5d9854a1-ead6-4570-b801-13c47d0bf721 on n-h1-862967-2 Oct 29 02:59:32.724250 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-c1b1c6c4-70a4-4346-b53b-0fc9b5bef16f req-480e736c-1b07-43a2-a3a1-c88770cd5bf8 service nova] Creating event network-vif-unplugged:dbe9ee0b-c11e-4edb-a1e4-5c86a11499da for instance 1ab56816-cc78-4e73-918a-4c76895fed6b on n-h2-862967-2 Oct 29 02:59:32.765009 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-c1b1c6c4-70a4-4346-b53b-0fc9b5bef16f req-480e736c-1b07-43a2-a3a1-c88770cd5bf8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.158046 Oct 29 02:59:32.768046 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1357/2896] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:32.788546 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f4089720-d31f-4371-b88c-7157edbf4866 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:32.797879 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f4089720-d31f-4371-b88c-7157edbf4866 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:32.829167 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4089720-d31f-4371-b88c-7157edbf4866 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:32.830503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4089720-d31f-4371-b88c-7157edbf4866 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:32.833683 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4089720-d31f-4371-b88c-7157edbf4866 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:32.835460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4089720-d31f-4371-b88c-7157edbf4866 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:32.836670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4089720-d31f-4371-b88c-7157edbf4866 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:32.837514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4089720-d31f-4371-b88c-7157edbf4866 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:33.661168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f4089720-d31f-4371-b88c-7157edbf4866 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:33.674392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f4089720-d31f-4371-b88c-7157edbf4866 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:33.676110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f4089720-d31f-4371-b88c-7157edbf4866 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:33.683244 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f4089720-d31f-4371-b88c-7157edbf4866 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1724 microversion: 2.20 time: 0.911366 Oct 29 02:59:33.684083 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1358/2897] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:32 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1724 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:33.713114 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-08971add-f4be-4516-a5f2-00601603de4f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:33.717988 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-08971add-f4be-4516-a5f2-00601603de4f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:33.727450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08971add-f4be-4516-a5f2-00601603de4f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:33.728822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08971add-f4be-4516-a5f2-00601603de4f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:33.729421 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08971add-f4be-4516-a5f2-00601603de4f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:33.730792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08971add-f4be-4516-a5f2-00601603de4f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:33.732638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08971add-f4be-4516-a5f2-00601603de4f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:33.733520 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08971add-f4be-4516-a5f2-00601603de4f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:33.779049 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-08971add-f4be-4516-a5f2-00601603de4f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093639 Oct 29 02:59:33.788392 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1359/2898] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 02:59:33 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e/os-volume_attachments => generated 25 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 02:59:33.793578 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e3d76acd-9cc2-464e-884d-81c4a702a223 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:33.794324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e3d76acd-9cc2-464e-884d-81c4a702a223 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:33.803483 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3d76acd-9cc2-464e-884d-81c4a702a223 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:33.804485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3d76acd-9cc2-464e-884d-81c4a702a223 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:33.805032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3d76acd-9cc2-464e-884d-81c4a702a223 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:33.806850 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3d76acd-9cc2-464e-884d-81c4a702a223 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:33.807424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3d76acd-9cc2-464e-884d-81c4a702a223 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:33.809469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3d76acd-9cc2-464e-884d-81c4a702a223 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:34.013349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e3d76acd-9cc2-464e-884d-81c4a702a223 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:34.025496 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e3d76acd-9cc2-464e-884d-81c4a702a223 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 200 len: 1271 microversion: 2.1 time: 0.235838 Oct 29 02:59:34.026112 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1360/2899] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:33 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 1271 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:34.047856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c22dde6c-234c-46df-88ff-f47928e0f3dc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff05c253dc0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:34.151400 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c22dde6c-234c-46df-88ff-f47928e0f3dc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/fc37ec03-f8ad-40d5-9407-d7dca0bdc2b9" status: 200 len: 1410 microversion: 2.1 time: 0.107284 Oct 29 02:59:34.160730 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1361/2900] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:59:34 2022] GET /compute/v2.1/images/fc37ec03-f8ad-40d5-9407-d7dca0bdc2b9 => generated 1410 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:34.166122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cfa7a892-c6ab-4b7e-9ae8-3d3a2cb0c286 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:34.166961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cfa7a892-c6ab-4b7e-9ae8-3d3a2cb0c286 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:34.175206 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cfa7a892-c6ab-4b7e-9ae8-3d3a2cb0c286 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:34.175809 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cfa7a892-c6ab-4b7e-9ae8-3d3a2cb0c286 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:34.176444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cfa7a892-c6ab-4b7e-9ae8-3d3a2cb0c286 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:34.177262 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cfa7a892-c6ab-4b7e-9ae8-3d3a2cb0c286 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:34.177919 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cfa7a892-c6ab-4b7e-9ae8-3d3a2cb0c286 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:34.178436 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cfa7a892-c6ab-4b7e-9ae8-3d3a2cb0c286 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:34.201868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-31f4576d-7696-4098-8692-7069316aca90 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:59:34.202758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-31f4576d-7696-4098-8692-7069316aca90 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:59:34.208729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-31f4576d-7696-4098-8692-7069316aca90 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:59:34.209257 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-31f4576d-7696-4098-8692-7069316aca90 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:59:34.209677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-31f4576d-7696-4098-8692-7069316aca90 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:59:34.269487 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31f4576d-7696-4098-8692-7069316aca90 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:34.271071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31f4576d-7696-4098-8692-7069316aca90 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:34.273174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31f4576d-7696-4098-8692-7069316aca90 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:34.277107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31f4576d-7696-4098-8692-7069316aca90 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:34.278077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31f4576d-7696-4098-8692-7069316aca90 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:34.278707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31f4576d-7696-4098-8692-7069316aca90 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:34.281158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:34.341816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-31f4576d-7696-4098-8692-7069316aca90 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Getting quotas for project 908b0840bf614aaa9f07757baaeb950b. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:59:34.351883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-31f4576d-7696-4098-8692-7069316aca90 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Getting quotas for user f2230efa6fc74ba0ad51fc648835a035 and project 908b0840bf614aaa9f07757baaeb950b. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:59:34.719578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-31f4576d-7696-4098-8692-7069316aca90 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:59:34.723274 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-31f4576d-7696-4098-8692-7069316aca90 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='924b6d80-cce0-4962-93e7-be42f6702351',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='fb7d4cef-c0f1-4d8e-b1a3-e3c6a61bd3ba',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b3a63ad8-09ad-451f-8165-266ea9cc7162',volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:59:35.014718 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cfa7a892-c6ab-4b7e-9ae8-3d3a2cb0c286 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:35.029608 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cfa7a892-c6ab-4b7e-9ae8-3d3a2cb0c286 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1518 microversion: 2.1 time: 0.867233 Oct 29 02:59:35.034623 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1362/2901] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:34 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1518 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:35.055481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6c660788-58f6-4ba7-8fff-f1a8cf20216c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccb40ed0-dec7-4c1d-a55f-81974e56352b"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:35.059548 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6c660788-58f6-4ba7-8fff-f1a8cf20216c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:35.148595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c660788-58f6-4ba7-8fff-f1a8cf20216c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:35.149648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c660788-58f6-4ba7-8fff-f1a8cf20216c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:35.151099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c660788-58f6-4ba7-8fff-f1a8cf20216c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:35.158564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c660788-58f6-4ba7-8fff-f1a8cf20216c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:35.162810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c660788-58f6-4ba7-8fff-f1a8cf20216c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:35.163562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c660788-58f6-4ba7-8fff-f1a8cf20216c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:35.552570 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-31f4576d-7696-4098-8692-7069316aca90 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 11.274473 Oct 29 02:59:35.553622 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1540/2902] 10.222.0.46 () {62 vars in 1189 bytes} [Sat Oct 29 02:59:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 11287 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 02:59:35.561405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-70c73811-46aa-4c58-96e1-27facf05d36f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:35.562062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-70c73811-46aa-4c58-96e1-27facf05d36f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:35.578638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70c73811-46aa-4c58-96e1-27facf05d36f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:35.579148 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70c73811-46aa-4c58-96e1-27facf05d36f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:35.579595 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70c73811-46aa-4c58-96e1-27facf05d36f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:35.580446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70c73811-46aa-4c58-96e1-27facf05d36f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:35.585521 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70c73811-46aa-4c58-96e1-27facf05d36f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:35.587849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70c73811-46aa-4c58-96e1-27facf05d36f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:35.852294 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:36.068100 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6c660788-58f6-4ba7-8fff-f1a8cf20216c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "POST /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.031396 Oct 29 02:59:36.070941 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1363/2903] 10.222.0.46 () {62 vars in 1364 bytes} [Sat Oct 29 02:59:35 2022] POST /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/os-volume_attachments => generated 188 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 02:59:36.082794 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c33ecbb9-b999-419e-861f-634985b66baa tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff05c24bee0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:36.978235 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c33ecbb9-b999-419e-861f-634985b66baa tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/fc37ec03-f8ad-40d5-9407-d7dca0bdc2b9" status: 200 len: 1410 microversion: 2.1 time: 0.905983 Oct 29 02:59:36.993251 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1364/2904] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:59:36 2022] GET /compute/v2.1/images/fc37ec03-f8ad-40d5-9407-d7dca0bdc2b9 => generated 1410 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:37.015907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4596089e-926f-462f-a45d-74779788fd17 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:37.022024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4596089e-926f-462f-a45d-74779788fd17 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:37.430515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4596089e-926f-462f-a45d-74779788fd17 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:37.448944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4596089e-926f-462f-a45d-74779788fd17 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:37.460162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4596089e-926f-462f-a45d-74779788fd17 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:37.461512 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4596089e-926f-462f-a45d-74779788fd17 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1285 microversion: 2.32 time: 0.475990 Oct 29 02:59:37.469681 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1365/2905] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:36 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1285 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:37.481662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1ede2f34-2ff1-4a1a-b428-a1b1d5519886 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:37.489271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1ede2f34-2ff1-4a1a-b428-a1b1d5519886 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:37.516207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ede2f34-2ff1-4a1a-b428-a1b1d5519886 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:37.519095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ede2f34-2ff1-4a1a-b428-a1b1d5519886 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:37.522548 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ede2f34-2ff1-4a1a-b428-a1b1d5519886 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:37.524244 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ede2f34-2ff1-4a1a-b428-a1b1d5519886 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:37.525895 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ede2f34-2ff1-4a1a-b428-a1b1d5519886 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:37.531121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ede2f34-2ff1-4a1a-b428-a1b1d5519886 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:38.096788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-70c73811-46aa-4c58-96e1-27facf05d36f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:38.114794 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-70c73811-46aa-4c58-96e1-27facf05d36f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 200 len: 1313 microversion: 2.1 time: 2.560255 Oct 29 02:59:38.117745 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1541/2906] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:35 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 1313 bytes in 2564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:38.132588 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eaa9c54f-dbe3-4c64-830d-f584eac7b57e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:38.136565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-eaa9c54f-dbe3-4c64-830d-f584eac7b57e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:38.164873 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaa9c54f-dbe3-4c64-830d-f584eac7b57e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:38.167477 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaa9c54f-dbe3-4c64-830d-f584eac7b57e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:38.168231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaa9c54f-dbe3-4c64-830d-f584eac7b57e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:38.169601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaa9c54f-dbe3-4c64-830d-f584eac7b57e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:38.176083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaa9c54f-dbe3-4c64-830d-f584eac7b57e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:38.177021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaa9c54f-dbe3-4c64-830d-f584eac7b57e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:38.283504 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1ede2f34-2ff1-4a1a-b428-a1b1d5519886 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:38.293511 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1ede2f34-2ff1-4a1a-b428-a1b1d5519886 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.822605 Oct 29 02:59:38.302133 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1366/2907] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:37 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:38.307490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-950a17d6-d093-4608-a5b6-6c42e49f23f4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff05c253c10>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:38.330447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-eaa9c54f-dbe3-4c64-830d-f584eac7b57e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127124) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 29 02:59:38.386042 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:38.510785 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eaa9c54f-dbe3-4c64-830d-f584eac7b57e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "POST /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/action" status: 202 len: 0 microversion: 2.20 time: 0.385534 Oct 29 02:59:38.513436 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1542/2908] 10.222.0.46 () {62 vars in 1319 bytes} [Sat Oct 29 02:59:38 2022] POST /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:59:38.530649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a529c7de-a701-4ae5-86bb-a26177fd94c9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:38.542013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a529c7de-a701-4ae5-86bb-a26177fd94c9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:38.558514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a529c7de-a701-4ae5-86bb-a26177fd94c9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:38.559151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a529c7de-a701-4ae5-86bb-a26177fd94c9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:38.559757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a529c7de-a701-4ae5-86bb-a26177fd94c9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:38.571949 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a529c7de-a701-4ae5-86bb-a26177fd94c9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:38.573483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a529c7de-a701-4ae5-86bb-a26177fd94c9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:38.574916 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a529c7de-a701-4ae5-86bb-a26177fd94c9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:39.109221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a529c7de-a701-4ae5-86bb-a26177fd94c9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:39.131067 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a529c7de-a701-4ae5-86bb-a26177fd94c9 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.616116 Oct 29 02:59:39.132015 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1543/2909] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:38 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:39.138058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-51dab60f-803b-41b0-8cd7-40390e4dfa7d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:39.150239 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-51dab60f-803b-41b0-8cd7-40390e4dfa7d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:39.191192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51dab60f-803b-41b0-8cd7-40390e4dfa7d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:39.197399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51dab60f-803b-41b0-8cd7-40390e4dfa7d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:39.198114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51dab60f-803b-41b0-8cd7-40390e4dfa7d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:39.199122 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51dab60f-803b-41b0-8cd7-40390e4dfa7d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:39.199897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51dab60f-803b-41b0-8cd7-40390e4dfa7d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:39.200477 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51dab60f-803b-41b0-8cd7-40390e4dfa7d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:39.620558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-51dab60f-803b-41b0-8cd7-40390e4dfa7d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:39.648992 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-51dab60f-803b-41b0-8cd7-40390e4dfa7d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:39.650721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-51dab60f-803b-41b0-8cd7-40390e4dfa7d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:39.651933 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-51dab60f-803b-41b0-8cd7-40390e4dfa7d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1575 microversion: 2.32 time: 0.518810 Oct 29 02:59:39.664886 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1544/2910] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:39 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1575 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:39.665553 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b45e1ced-696d-4508-bf04-a2708d908038 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:39.676687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b45e1ced-696d-4508-bf04-a2708d908038 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:39.704178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b45e1ced-696d-4508-bf04-a2708d908038 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:39.705317 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b45e1ced-696d-4508-bf04-a2708d908038 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:39.705558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b45e1ced-696d-4508-bf04-a2708d908038 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:39.721672 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b45e1ced-696d-4508-bf04-a2708d908038 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:39.722584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b45e1ced-696d-4508-bf04-a2708d908038 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:39.723107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b45e1ced-696d-4508-bf04-a2708d908038 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:40.869360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b45e1ced-696d-4508-bf04-a2708d908038 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:40.878998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b45e1ced-696d-4508-bf04-a2708d908038 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:40.893041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b45e1ced-696d-4508-bf04-a2708d908038 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:40.900452 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b45e1ced-696d-4508-bf04-a2708d908038 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1750 microversion: 2.20 time: 1.240473 Oct 29 02:59:40.902825 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1545/2911] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:39 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1750 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:40.908375 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9b1c071d-7fb3-410e-bec3-d39644afb0c4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:40.914642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9b1c071d-7fb3-410e-bec3-d39644afb0c4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:40.927711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b1c071d-7fb3-410e-bec3-d39644afb0c4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:40.934481 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b1c071d-7fb3-410e-bec3-d39644afb0c4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:40.938396 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b1c071d-7fb3-410e-bec3-d39644afb0c4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:40.939382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b1c071d-7fb3-410e-bec3-d39644afb0c4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:40.940015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b1c071d-7fb3-410e-bec3-d39644afb0c4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:40.940656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b1c071d-7fb3-410e-bec3-d39644afb0c4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:42.212889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9b1c071d-7fb3-410e-bec3-d39644afb0c4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:42.222046 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9b1c071d-7fb3-410e-bec3-d39644afb0c4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 200 len: 1313 microversion: 2.1 time: 1.317139 Oct 29 02:59:42.239327 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1546/2912] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:40 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 1313 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:42.250671 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ce242670-1762-4cdc-8f95-3a1b9ee6404f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:42.259950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ce242670-1762-4cdc-8f95-3a1b9ee6404f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:42.271025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce242670-1762-4cdc-8f95-3a1b9ee6404f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:42.271542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce242670-1762-4cdc-8f95-3a1b9ee6404f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:42.272420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce242670-1762-4cdc-8f95-3a1b9ee6404f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:42.272699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce242670-1762-4cdc-8f95-3a1b9ee6404f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:42.273150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce242670-1762-4cdc-8f95-3a1b9ee6404f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:42.273569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce242670-1762-4cdc-8f95-3a1b9ee6404f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:42.884911 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ce242670-1762-4cdc-8f95-3a1b9ee6404f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:42.901872 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ce242670-1762-4cdc-8f95-3a1b9ee6404f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.650649 Oct 29 02:59:42.905550 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1547/2913] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:42 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:42.915024 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-c6c98303-134c-4484-b581-34229fc2d415 req-85240271-6468-4f92-ae53-de765eb5a2f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e395101-378a-4976-b087-38ce3f22b912", "tag": "8bb3b984-0aee-4027-aa60-42e7d9894d32"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:42.953866 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c6c98303-134c-4484-b581-34229fc2d415 req-85240271-6468-4f92-ae53-de765eb5a2f0 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:42.957399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c6c98303-134c-4484-b581-34229fc2d415 req-85240271-6468-4f92-ae53-de765eb5a2f0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:42.959919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c6c98303-134c-4484-b581-34229fc2d415 req-85240271-6468-4f92-ae53-de765eb5a2f0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:43.006588 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-c6c98303-134c-4484-b581-34229fc2d415 req-85240271-6468-4f92-ae53-de765eb5a2f0 service nova] Creating event network-changed:8bb3b984-0aee-4027-aa60-42e7d9894d32 for instance 6e395101-378a-4976-b087-38ce3f22b912 on n-h2-862967-2 Oct 29 02:59:43.033261 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-c6c98303-134c-4484-b581-34229fc2d415 req-85240271-6468-4f92-ae53-de765eb5a2f0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122966 Oct 29 02:59:43.037153 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1548/2914] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:43.063060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-04b065c9-ced0-4b41-b10b-9b6066e1e87d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:43.073623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-04b065c9-ced0-4b41-b10b-9b6066e1e87d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:43.096580 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-04b065c9-ced0-4b41-b10b-9b6066e1e87d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:43.097267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-04b065c9-ced0-4b41-b10b-9b6066e1e87d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:43.097875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-04b065c9-ced0-4b41-b10b-9b6066e1e87d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:43.098934 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-04b065c9-ced0-4b41-b10b-9b6066e1e87d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:43.099589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-04b065c9-ced0-4b41-b10b-9b6066e1e87d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:43.100308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-04b065c9-ced0-4b41-b10b-9b6066e1e87d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:43.381995 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-04b065c9-ced0-4b41-b10b-9b6066e1e87d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:43.416994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-04b065c9-ced0-4b41-b10b-9b6066e1e87d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:43.418875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-04b065c9-ced0-4b41-b10b-9b6066e1e87d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:43.420373 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-04b065c9-ced0-4b41-b10b-9b6066e1e87d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1593 microversion: 2.32 time: 0.379507 Oct 29 02:59:43.422329 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1549/2915] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:43 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1593 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:43.429546 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-828ea8f2-e1d8-4765-9d46-5d1ee1365090 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:43.430733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-828ea8f2-e1d8-4765-9d46-5d1ee1365090 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:43.445483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-828ea8f2-e1d8-4765-9d46-5d1ee1365090 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:43.446432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-828ea8f2-e1d8-4765-9d46-5d1ee1365090 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:43.447267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-828ea8f2-e1d8-4765-9d46-5d1ee1365090 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:43.448254 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-828ea8f2-e1d8-4765-9d46-5d1ee1365090 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:43.449379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-828ea8f2-e1d8-4765-9d46-5d1ee1365090 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:43.450339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-828ea8f2-e1d8-4765-9d46-5d1ee1365090 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:44.205188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-828ea8f2-e1d8-4765-9d46-5d1ee1365090 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:44.215574 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-828ea8f2-e1d8-4765-9d46-5d1ee1365090 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:44.227418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-828ea8f2-e1d8-4765-9d46-5d1ee1365090 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:44.229227 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-828ea8f2-e1d8-4765-9d46-5d1ee1365090 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1750 microversion: 2.20 time: 0.805612 Oct 29 02:59:44.230425 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1550/2916] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:43 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1750 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:44.239930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e8186e04-781c-49ef-8ea5-26935bd3c0d3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:44.254209 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-e8186e04-781c-49ef-8ea5-26935bd3c0d3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Instance f10d2956-e8f0-476d-aa84-b9c8dde22a3a has no mapping to a cell. Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e8186e04-781c-49ef-8ea5-26935bd3c0d3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers/f10d2956-e8f0-476d-aa84-b9c8dde22a3a/action HTTP/1.1 Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 15 Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: {"os-stop": {}} Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance f10d2956-e8f0-476d-aa84-b9c8dde22a3a has no mapping to a cell. Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'f10d2956-e8f0-476d-aa84-b9c8dde22a3a', 'body': {'os-stop': {}}} Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance f10d2956-e8f0-476d-aa84-b9c8dde22a3a has no mapping to a cell. Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:59:44.262788 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f10d2956-e8f0-476d-aa84-b9c8dde22a3a has no mapping to a cell. Oct 29 02:59:44.266809 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:59:44.266809 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:44.266809 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:59:44.266809 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:44.266809 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:44.266809 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:44.266809 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:59:44.266809 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:59:44.266809 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f10d2956-e8f0-476d-aa84-b9c8dde22a3a has no mapping to a cell. Oct 29 02:59:44.266809 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 02:59:44.269220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e8186e04-781c-49ef-8ea5-26935bd3c0d3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 404 to user: Instance f10d2956-e8f0-476d-aa84-b9c8dde22a3a has no mapping to a cell. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:59:44.270356 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e8186e04-781c-49ef-8ea5-26935bd3c0d3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers/f10d2956-e8f0-476d-aa84-b9c8dde22a3a/action" status: 404 len: 117 microversion: 2.1 time: 0.038762 Oct 29 02:59:44.271522 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1551/2917] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:59:44 2022] POST /compute/v2.1/servers/f10d2956-e8f0-476d-aa84-b9c8dde22a3a/action => generated 117 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:59:44.279330 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3db559cb-2ac4-433e-b35d-5ab456e2e006 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:44.292572 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3db559cb-2ac4-433e-b35d-5ab456e2e006 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:44.307362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3db559cb-2ac4-433e-b35d-5ab456e2e006 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:44.307854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3db559cb-2ac4-433e-b35d-5ab456e2e006 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:44.308301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3db559cb-2ac4-433e-b35d-5ab456e2e006 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:44.310686 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3db559cb-2ac4-433e-b35d-5ab456e2e006 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:44.311159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3db559cb-2ac4-433e-b35d-5ab456e2e006 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:44.311597 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3db559cb-2ac4-433e-b35d-5ab456e2e006 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:44.315478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:44.365243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:44.968197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3db559cb-2ac4-433e-b35d-5ab456e2e006 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:44.988064 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3db559cb-2ac4-433e-b35d-5ab456e2e006 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 200 len: 1313 microversion: 2.1 time: 0.715122 Oct 29 02:59:44.992655 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1552/2918] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:44 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 1313 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:45.017975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-461e6604-4805-418d-b9d5-5ef43ea66f31 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:45.025792 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-461e6604-4805-418d-b9d5-5ef43ea66f31 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:45.058653 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-461e6604-4805-418d-b9d5-5ef43ea66f31 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:45.061465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-461e6604-4805-418d-b9d5-5ef43ea66f31 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:45.062216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-461e6604-4805-418d-b9d5-5ef43ea66f31 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:45.063207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-461e6604-4805-418d-b9d5-5ef43ea66f31 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:45.068162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-461e6604-4805-418d-b9d5-5ef43ea66f31 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:45.068985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-461e6604-4805-418d-b9d5-5ef43ea66f31 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:45.633786 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-461e6604-4805-418d-b9d5-5ef43ea66f31 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:45.643053 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-461e6604-4805-418d-b9d5-5ef43ea66f31 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.645099 Oct 29 02:59:45.649250 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1553/2919] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:44 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:45.663219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b7d81c2d-4fe2-4fe9-88d6-e5479ed4e970 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:45.678035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b7d81c2d-4fe2-4fe9-88d6-e5479ed4e970 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:45.698066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7d81c2d-4fe2-4fe9-88d6-e5479ed4e970 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:45.701877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7d81c2d-4fe2-4fe9-88d6-e5479ed4e970 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:45.704715 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7d81c2d-4fe2-4fe9-88d6-e5479ed4e970 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:45.708723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7d81c2d-4fe2-4fe9-88d6-e5479ed4e970 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:45.712145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7d81c2d-4fe2-4fe9-88d6-e5479ed4e970 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:45.712896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7d81c2d-4fe2-4fe9-88d6-e5479ed4e970 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:46.505089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b7d81c2d-4fe2-4fe9-88d6-e5479ed4e970 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:46.542115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b7d81c2d-4fe2-4fe9-88d6-e5479ed4e970 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:46.544470 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b7d81c2d-4fe2-4fe9-88d6-e5479ed4e970 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:46.546410 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b7d81c2d-4fe2-4fe9-88d6-e5479ed4e970 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1661 microversion: 2.32 time: 0.891217 Oct 29 02:59:46.551413 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1554/2920] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:45 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1661 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:46.582644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-aa8f2b65-05b1-4e2d-abef-24e3a558f524 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:46.583445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-aa8f2b65-05b1-4e2d-abef-24e3a558f524 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:46.624471 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aa8f2b65-05b1-4e2d-abef-24e3a558f524 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:46.625021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aa8f2b65-05b1-4e2d-abef-24e3a558f524 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:46.627233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aa8f2b65-05b1-4e2d-abef-24e3a558f524 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:46.628040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aa8f2b65-05b1-4e2d-abef-24e3a558f524 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:46.628551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aa8f2b65-05b1-4e2d-abef-24e3a558f524 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:46.631730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aa8f2b65-05b1-4e2d-abef-24e3a558f524 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:47.325456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-aa8f2b65-05b1-4e2d-abef-24e3a558f524 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:47.341810 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-aa8f2b65-05b1-4e2d-abef-24e3a558f524 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:47.344991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-aa8f2b65-05b1-4e2d-abef-24e3a558f524 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:47.349017 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-aa8f2b65-05b1-4e2d-abef-24e3a558f524 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1750 microversion: 2.20 time: 0.795554 Oct 29 02:59:47.351372 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1555/2921] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:46 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1750 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:47.361586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9eb86bcc-e3d6-4025-8666-2596614caaef tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:47.362850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9eb86bcc-e3d6-4025-8666-2596614caaef tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:47.379083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9eb86bcc-e3d6-4025-8666-2596614caaef tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:47.381874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9eb86bcc-e3d6-4025-8666-2596614caaef tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:47.382771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9eb86bcc-e3d6-4025-8666-2596614caaef tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:47.386551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9eb86bcc-e3d6-4025-8666-2596614caaef tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:47.388632 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9eb86bcc-e3d6-4025-8666-2596614caaef tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:47.389604 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9eb86bcc-e3d6-4025-8666-2596614caaef tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:47.439460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=8 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:47.515977 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:48.288858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=11,nova_cell1:UPDATE=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:48.357915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9eb86bcc-e3d6-4025-8666-2596614caaef tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:48.370135 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9eb86bcc-e3d6-4025-8666-2596614caaef tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 1.017307 Oct 29 02:59:48.433435 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1556/2922] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:47 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:48.456774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c42a01ec-ce74-401f-9b7f-e10faf79f781 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:48.463337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c42a01ec-ce74-401f-9b7f-e10faf79f781 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:48.496511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c42a01ec-ce74-401f-9b7f-e10faf79f781 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:48.508661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c42a01ec-ce74-401f-9b7f-e10faf79f781 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:48.513505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c42a01ec-ce74-401f-9b7f-e10faf79f781 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:48.516413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c42a01ec-ce74-401f-9b7f-e10faf79f781 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:48.525566 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c42a01ec-ce74-401f-9b7f-e10faf79f781 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:48.526404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c42a01ec-ce74-401f-9b7f-e10faf79f781 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:50.076393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c42a01ec-ce74-401f-9b7f-e10faf79f781 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:50.084994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:50.090676 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c42a01ec-ce74-401f-9b7f-e10faf79f781 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 200 len: 1313 microversion: 2.1 time: 1.655577 Oct 29 02:59:50.120607 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1557/2923] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:48 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 1313 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:50.462440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3735d3af-48c4-4722-b940-14e632b66158 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1618626768", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "8755c484-cfa7-4ffa-89ff-0a55c5aa7338"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:50.555259 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-950a17d6-d093-4608-a5b6-6c42e49f23f4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/fc37ec03-f8ad-40d5-9407-d7dca0bdc2b9" status: 200 len: 1419 microversion: 2.1 time: 12.251847 Oct 29 02:59:50.556882 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1367/2924] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:59:38 2022] GET /compute/v2.1/images/fc37ec03-f8ad-40d5-9407-d7dca0bdc2b9 => generated 1419 bytes in 12254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:50.563772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1ddfc484-5b2a-4679-8aa6-89db552ab073 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:50.564753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1ddfc484-5b2a-4679-8aa6-89db552ab073 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:50.584645 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ddfc484-5b2a-4679-8aa6-89db552ab073 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:50.585242 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ddfc484-5b2a-4679-8aa6-89db552ab073 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:50.585695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ddfc484-5b2a-4679-8aa6-89db552ab073 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:50.586451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ddfc484-5b2a-4679-8aa6-89db552ab073 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:50.590256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ddfc484-5b2a-4679-8aa6-89db552ab073 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:50.590995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ddfc484-5b2a-4679-8aa6-89db552ab073 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:50.726018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-3735d3af-48c4-4722-b940-14e632b66158 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] validate_networks() for [('8755c484-cfa7-4ffa-89ff-0a55c5aa7338', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:59:51.684929 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1ddfc484-5b2a-4679-8aa6-89db552ab073 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:51.702461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1ddfc484-5b2a-4679-8aa6-89db552ab073 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:51.712876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1ddfc484-5b2a-4679-8aa6-89db552ab073 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:51.721965 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1ddfc484-5b2a-4679-8aa6-89db552ab073 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1708 microversion: 2.32 time: 1.157207 Oct 29 02:59:51.722637 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1368/2925] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:50 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1708 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:51.760851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-689c1d77-aabc-4a11-ad90-bc927ffff58d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:51.761919 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-689c1d77-aabc-4a11-ad90-bc927ffff58d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:51.795938 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-689c1d77-aabc-4a11-ad90-bc927ffff58d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:51.798817 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-689c1d77-aabc-4a11-ad90-bc927ffff58d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:51.800421 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-689c1d77-aabc-4a11-ad90-bc927ffff58d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:51.807603 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-689c1d77-aabc-4a11-ad90-bc927ffff58d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:51.809173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-689c1d77-aabc-4a11-ad90-bc927ffff58d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:51.809816 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-689c1d77-aabc-4a11-ad90-bc927ffff58d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:52.147965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-689c1d77-aabc-4a11-ad90-bc927ffff58d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:52.188022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-689c1d77-aabc-4a11-ad90-bc927ffff58d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:52.201068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-3735d3af-48c4-4722-b940-14e632b66158 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:59:52.202599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-3735d3af-48c4-4722-b940-14e632b66158 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:59:52.203321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-3735d3af-48c4-4722-b940-14e632b66158 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:59:52.204395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-3735d3af-48c4-4722-b940-14e632b66158 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:59:52.205055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-3735d3af-48c4-4722-b940-14e632b66158 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:59:52.209683 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-689c1d77-aabc-4a11-ad90-bc927ffff58d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:52.211687 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-689c1d77-aabc-4a11-ad90-bc927ffff58d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1750 microversion: 2.20 time: 0.465445 Oct 29 02:59:52.215049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:52.228896 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1369/2926] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:51 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1750 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:52.247591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9252c20c-8307-4c17-998d-19961db78c9d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:52.249672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9252c20c-8307-4c17-998d-19961db78c9d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 97e0c6e6-ba86-47b4-8418-b24bf4909977] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:52.269749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3735d3af-48c4-4722-b940-14e632b66158 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:52.270009 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-9252c20c-8307-4c17-998d-19961db78c9d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Instance 97e0c6e6-ba86-47b4-8418-b24bf4909977 could not be found. Oct 29 02:59:52.270666 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3735d3af-48c4-4722-b940-14e632b66158 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:52.271335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3735d3af-48c4-4722-b940-14e632b66158 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:52.272273 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3735d3af-48c4-4722-b940-14e632b66158 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:52.273198 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3735d3af-48c4-4722-b940-14e632b66158 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:52.275127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3735d3af-48c4-4722-b940-14e632b66158 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9252c20c-8307-4c17-998d-19961db78c9d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers/97e0c6e6-ba86-47b4-8418-b24bf4909977/action HTTP/1.1 Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 15 Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: {"suspend": {}} Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 97e0c6e6-ba86-47b4-8418-b24bf4909977 could not be found. Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '97e0c6e6-ba86-47b4-8418-b24bf4909977', 'body': {'suspend': {}}} Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97e0c6e6-ba86-47b4-8418-b24bf4909977 could not be found. Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97e0c6e6-ba86-47b4-8418-b24bf4909977 could not be found. Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 02:59:52.287931 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 02:59:52.293736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 02:59:52.293736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 02:59:52.293736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97e0c6e6-ba86-47b4-8418-b24bf4909977 could not be found. Oct 29 02:59:52.293736 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 02:59:52.295387 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9252c20c-8307-4c17-998d-19961db78c9d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 404 to user: Instance 97e0c6e6-ba86-47b4-8418-b24bf4909977 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 02:59:52.295387 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9252c20c-8307-4c17-998d-19961db78c9d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers/97e0c6e6-ba86-47b4-8418-b24bf4909977/action" status: 404 len: 111 microversion: 2.1 time: 0.073309 Oct 29 02:59:52.297344 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1370/2927] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:59:52 2022] POST /compute/v2.1/servers/97e0c6e6-ba86-47b4-8418-b24bf4909977/action => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 02:59:52.318407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-d949e2c0-50ee-4dc9-af18-05bd9f7b2e61 req-63062b52-84aa-4f35-871c-73ac9abf6957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e395101-378a-4976-b087-38ce3f22b912", "name": "network-vif-plugged", "status": "completed", "tag": "8bb3b984-0aee-4027-aa60-42e7d9894d32"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:52.334890 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-3735d3af-48c4-4722-b940-14e632b66158 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Getting quotas for project 875f8af161b647758adaebd94449c8c1. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:59:52.350416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-3735d3af-48c4-4722-b940-14e632b66158 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Getting quotas for user faa94d1a6a984ed7b4a150aa9229d033 and project 875f8af161b647758adaebd94449c8c1. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:59:52.369518 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d949e2c0-50ee-4dc9-af18-05bd9f7b2e61 req-63062b52-84aa-4f35-871c-73ac9abf6957 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:52.372344 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d949e2c0-50ee-4dc9-af18-05bd9f7b2e61 req-63062b52-84aa-4f35-871c-73ac9abf6957 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:52.373037 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d949e2c0-50ee-4dc9-af18-05bd9f7b2e61 req-63062b52-84aa-4f35-871c-73ac9abf6957 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:52.390455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3735d3af-48c4-4722-b940-14e632b66158 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:59:52.393730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3735d3af-48c4-4722-b940-14e632b66158 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:59:52.422404 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-d949e2c0-50ee-4dc9-af18-05bd9f7b2e61 req-63062b52-84aa-4f35-871c-73ac9abf6957 service nova] Creating event network-vif-plugged:8bb3b984-0aee-4027-aa60-42e7d9894d32 for instance 6e395101-378a-4976-b087-38ce3f22b912 on n-h2-862967-2 Oct 29 02:59:52.442908 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-d949e2c0-50ee-4dc9-af18-05bd9f7b2e61 req-63062b52-84aa-4f35-871c-73ac9abf6957 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143608 Oct 29 02:59:52.457890 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1371/2928] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:52.482339 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cba6dfbc-ea8b-4257-808c-3dd6197be4ef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff05c1e4160>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:52.569226 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3735d3af-48c4-4722-b940-14e632b66158 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.431036 Oct 29 02:59:52.570590 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1558/2929] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:59:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:59:52.575705 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a9cb52ca-4ec0-4955-8800-0fc9aac1ffe0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:52.576729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a9cb52ca-4ec0-4955-8800-0fc9aac1ffe0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:52.584365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9cb52ca-4ec0-4955-8800-0fc9aac1ffe0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:52.586238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9cb52ca-4ec0-4955-8800-0fc9aac1ffe0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:52.586903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9cb52ca-4ec0-4955-8800-0fc9aac1ffe0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:52.587869 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9cb52ca-4ec0-4955-8800-0fc9aac1ffe0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:52.588597 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9cb52ca-4ec0-4955-8800-0fc9aac1ffe0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:52.589891 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9cb52ca-4ec0-4955-8800-0fc9aac1ffe0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:52.716159 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cba6dfbc-ea8b-4257-808c-3dd6197be4ef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/fc37ec03-f8ad-40d5-9407-d7dca0bdc2b9" status: 200 len: 1419 microversion: 2.1 time: 0.255017 Oct 29 02:59:52.716913 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1372/2930] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 02:59:52 2022] GET /compute/v2.1/images/fc37ec03-f8ad-40d5-9407-d7dca0bdc2b9 => generated 1419 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:52.741837 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b4052fe7-a1a1-47cb-ab78-3692c3607a74 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:52.746004 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b4052fe7-a1a1-47cb-ab78-3692c3607a74 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:52.774506 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4052fe7-a1a1-47cb-ab78-3692c3607a74 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:52.774974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4052fe7-a1a1-47cb-ab78-3692c3607a74 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:52.776939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4052fe7-a1a1-47cb-ab78-3692c3607a74 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:52.777696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4052fe7-a1a1-47cb-ab78-3692c3607a74 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:52.778153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4052fe7-a1a1-47cb-ab78-3692c3607a74 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:52.780788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4052fe7-a1a1-47cb-ab78-3692c3607a74 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:53.272669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a9cb52ca-4ec0-4955-8800-0fc9aac1ffe0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:53.287062 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a9cb52ca-4ec0-4955-8800-0fc9aac1ffe0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 200 len: 1313 microversion: 2.1 time: 0.714044 Oct 29 02:59:53.288070 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1559/2931] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:52 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 1313 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:53.297376 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ccc52c3e-0f21-49e4-a749-80fe461160a8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff05bfd8310>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:53.375259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b4052fe7-a1a1-47cb-ab78-3692c3607a74 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:53.390126 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b4052fe7-a1a1-47cb-ab78-3692c3607a74 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.670990 Oct 29 02:59:53.401042 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1373/2932] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:52 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:53.449425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c3646761-773c-431d-8781-b9e7db1830db tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:53.452810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c3646761-773c-431d-8781-b9e7db1830db tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:53.482538 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c3646761-773c-431d-8781-b9e7db1830db tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:53.483036 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c3646761-773c-431d-8781-b9e7db1830db tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:53.483478 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c3646761-773c-431d-8781-b9e7db1830db tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:53.484196 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c3646761-773c-431d-8781-b9e7db1830db tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:53.499165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c3646761-773c-431d-8781-b9e7db1830db tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:53.500097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c3646761-773c-431d-8781-b9e7db1830db tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:54.761399 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c3646761-773c-431d-8781-b9e7db1830db tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:54.793073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c3646761-773c-431d-8781-b9e7db1830db tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:54.801082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c3646761-773c-431d-8781-b9e7db1830db tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:54.810159 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c3646761-773c-431d-8781-b9e7db1830db tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1802 microversion: 2.32 time: 1.405458 Oct 29 02:59:54.814216 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1374/2933] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:53 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1802 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:54.840497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4f5295b4-35eb-4944-8482-ebf67e397c92 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-961471672", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "8755c484-cfa7-4ffa-89ff-0a55c5aa7338"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:54.960262 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ccc52c3e-0f21-49e4-a749-80fe461160a8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "DELETE /compute/v2.1/images/fc37ec03-f8ad-40d5-9407-d7dca0bdc2b9" status: 204 len: 0 microversion: 2.1 time: 1.670600 Oct 29 02:59:54.961381 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1560/2934] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:53 2022] DELETE /compute/v2.1/images/fc37ec03-f8ad-40d5-9407-d7dca0bdc2b9 => generated 0 bytes in 1673 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:59:54.973275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0b93732a-4a00-4c1e-ad7b-b589f8f994b5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:54.973977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0b93732a-4a00-4c1e-ad7b-b589f8f994b5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:55.019853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b93732a-4a00-4c1e-ad7b-b589f8f994b5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:55.020434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b93732a-4a00-4c1e-ad7b-b589f8f994b5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:55.026040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b93732a-4a00-4c1e-ad7b-b589f8f994b5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:55.028938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b93732a-4a00-4c1e-ad7b-b589f8f994b5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:55.032824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b93732a-4a00-4c1e-ad7b-b589f8f994b5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:55.034475 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b93732a-4a00-4c1e-ad7b-b589f8f994b5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:55.128585 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-4f5295b4-35eb-4944-8482-ebf67e397c92 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] validate_networks() for [('8755c484-cfa7-4ffa-89ff-0a55c5aa7338', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:59:56.534396 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0b93732a-4a00-4c1e-ad7b-b589f8f994b5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:56.553599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0b93732a-4a00-4c1e-ad7b-b589f8f994b5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:56.563083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0b93732a-4a00-4c1e-ad7b-b589f8f994b5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:56.564670 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0b93732a-4a00-4c1e-ad7b-b589f8f994b5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1752 microversion: 2.20 time: 1.601564 Oct 29 02:59:56.579176 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1561/2935] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:54 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1752 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:56.579176 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-942339f8-642e-4d4f-ad63-973ea4b94150 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:56.579176 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-942339f8-642e-4d4f-ad63-973ea4b94150 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:56.596301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-942339f8-642e-4d4f-ad63-973ea4b94150 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:56.597646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-942339f8-642e-4d4f-ad63-973ea4b94150 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:56.601723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-942339f8-642e-4d4f-ad63-973ea4b94150 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:56.608559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-942339f8-642e-4d4f-ad63-973ea4b94150 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:56.609295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-942339f8-642e-4d4f-ad63-973ea4b94150 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:56.609867 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-942339f8-642e-4d4f-ad63-973ea4b94150 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:57.158823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-942339f8-642e-4d4f-ad63-973ea4b94150 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:57.187964 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-942339f8-642e-4d4f-ad63-973ea4b94150 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.618298 Oct 29 02:59:57.208105 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1562/2936] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:56 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:57.208105 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1e275dc9-ed9e-45ac-8e80-8477fcb87e31 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:57.208105 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1e275dc9-ed9e-45ac-8e80-8477fcb87e31 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:57.235140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e275dc9-ed9e-45ac-8e80-8477fcb87e31 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:57.242496 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e275dc9-ed9e-45ac-8e80-8477fcb87e31 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:57.248916 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e275dc9-ed9e-45ac-8e80-8477fcb87e31 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:57.255177 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e275dc9-ed9e-45ac-8e80-8477fcb87e31 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:57.256206 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e275dc9-ed9e-45ac-8e80-8477fcb87e31 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:57.262758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e275dc9-ed9e-45ac-8e80-8477fcb87e31 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:57.721215 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1e275dc9-ed9e-45ac-8e80-8477fcb87e31 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:57.731904 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1e275dc9-ed9e-45ac-8e80-8477fcb87e31 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 200 len: 1501 microversion: 2.1 time: 0.535618 Oct 29 02:59:57.732517 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1563/2937] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 02:59:57 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 1501 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 02:59:57.748707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4ab87e80-f8ef-4d25-b7ea-db873a7fb5ad tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:57.749217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4ab87e80-f8ef-4d25-b7ea-db873a7fb5ad tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:57.770890 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ab87e80-f8ef-4d25-b7ea-db873a7fb5ad tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:57.771454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ab87e80-f8ef-4d25-b7ea-db873a7fb5ad tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:57.771895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ab87e80-f8ef-4d25-b7ea-db873a7fb5ad tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:57.772655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ab87e80-f8ef-4d25-b7ea-db873a7fb5ad tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:57.773111 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ab87e80-f8ef-4d25-b7ea-db873a7fb5ad tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:57.773537 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ab87e80-f8ef-4d25-b7ea-db873a7fb5ad tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:57.820452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4ab87e80-f8ef-4d25-b7ea-db873a7fb5ad tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 02:59:58.011309 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4ab87e80-f8ef-4d25-b7ea-db873a7fb5ad tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6" status: 204 len: 0 microversion: 2.1 time: 0.276871 Oct 29 02:59:58.012322 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1564/2938] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 02:59:57 2022] DELETE /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 02:59:58.032945 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9e23a0fc-1364-48e6-a18b-dcf51ab7e92f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:58.033801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9e23a0fc-1364-48e6-a18b-dcf51ab7e92f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:58.046558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e23a0fc-1364-48e6-a18b-dcf51ab7e92f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:58.047323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e23a0fc-1364-48e6-a18b-dcf51ab7e92f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:58.048027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e23a0fc-1364-48e6-a18b-dcf51ab7e92f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:58.049157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e23a0fc-1364-48e6-a18b-dcf51ab7e92f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:58.056876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e23a0fc-1364-48e6-a18b-dcf51ab7e92f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:58.057600 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e23a0fc-1364-48e6-a18b-dcf51ab7e92f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:58.158094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-4f5295b4-35eb-4944-8482-ebf67e397c92 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 02:59:58.158885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-4f5295b4-35eb-4944-8482-ebf67e397c92 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 02:59:58.159361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-4f5295b4-35eb-4944-8482-ebf67e397c92 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 02:59:58.159771 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-4f5295b4-35eb-4944-8482-ebf67e397c92 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 02:59:58.160189 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-4f5295b4-35eb-4944-8482-ebf67e397c92 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 02:59:58.190433 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f5295b4-35eb-4944-8482-ebf67e397c92 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:58.197434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f5295b4-35eb-4944-8482-ebf67e397c92 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:58.198185 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f5295b4-35eb-4944-8482-ebf67e397c92 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:58.200463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f5295b4-35eb-4944-8482-ebf67e397c92 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:58.203710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f5295b4-35eb-4944-8482-ebf67e397c92 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:58.204462 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f5295b4-35eb-4944-8482-ebf67e397c92 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:58.284839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-4f5295b4-35eb-4944-8482-ebf67e397c92 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Getting quotas for project 875f8af161b647758adaebd94449c8c1. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 02:59:58.303999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-4f5295b4-35eb-4944-8482-ebf67e397c92 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Getting quotas for user faa94d1a6a984ed7b4a150aa9229d033 and project 875f8af161b647758adaebd94449c8c1. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 02:59:58.344470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4f5295b4-35eb-4944-8482-ebf67e397c92 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 02:59:58.350292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4f5295b4-35eb-4944-8482-ebf67e397c92 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 02:59:58.454108 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4f5295b4-35eb-4944-8482-ebf67e397c92 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.637325 Oct 29 02:59:58.456282 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1375/2939] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:59:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 02:59:58.467228 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-e78b0819-757a-4b6a-ae2d-c07fc20c9817 req-76e004a1-7811-4b35-a71c-995fb7ff90a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b7f1dd5-af84-416c-84a6-e7a0a67294e6", "name": "network-vif-unplugged", "status": "completed", "tag": "6f3a9167-1c0e-4d88-92ba-1c4e6bd37758"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:58.530934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e78b0819-757a-4b6a-ae2d-c07fc20c9817 req-76e004a1-7811-4b35-a71c-995fb7ff90a1 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:58.534046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e78b0819-757a-4b6a-ae2d-c07fc20c9817 req-76e004a1-7811-4b35-a71c-995fb7ff90a1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:58.536138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e78b0819-757a-4b6a-ae2d-c07fc20c9817 req-76e004a1-7811-4b35-a71c-995fb7ff90a1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:58.562975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9e23a0fc-1364-48e6-a18b-dcf51ab7e92f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:58.564057 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-e78b0819-757a-4b6a-ae2d-c07fc20c9817 req-76e004a1-7811-4b35-a71c-995fb7ff90a1 service nova] Creating event network-vif-unplugged:6f3a9167-1c0e-4d88-92ba-1c4e6bd37758 for instance 7b7f1dd5-af84-416c-84a6-e7a0a67294e6 on n-h1-862967-2 Oct 29 02:59:58.570088 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-e78b0819-757a-4b6a-ae2d-c07fc20c9817 req-76e004a1-7811-4b35-a71c-995fb7ff90a1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111751 Oct 29 02:59:58.581910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9e23a0fc-1364-48e6-a18b-dcf51ab7e92f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:58.583828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9e23a0fc-1364-48e6-a18b-dcf51ab7e92f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:58.585116 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9e23a0fc-1364-48e6-a18b-dcf51ab7e92f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1849 microversion: 2.32 time: 0.571146 Oct 29 02:59:58.585746 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1376/2940] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 02:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 02:59:58.592040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c3e58da7-0ba0-4e4b-bd58-c3bff1d41619 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:58.593170 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c3e58da7-0ba0-4e4b-bd58-c3bff1d41619 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:58.594025 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1565/2941] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:58 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1849 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:58.599191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0fabbbed-6733-4f24-995f-cbd8b7a837f9 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 02:59:58.599808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0fabbbed-6733-4f24-995f-cbd8b7a837f9 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:58.602593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c3e58da7-0ba0-4e4b-bd58-c3bff1d41619 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:58.609665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c3e58da7-0ba0-4e4b-bd58-c3bff1d41619 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:58.611834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c3e58da7-0ba0-4e4b-bd58-c3bff1d41619 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:58.612867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c3e58da7-0ba0-4e4b-bd58-c3bff1d41619 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:58.613556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c3e58da7-0ba0-4e4b-bd58-c3bff1d41619 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:58.614234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c3e58da7-0ba0-4e4b-bd58-c3bff1d41619 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:58.616098 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0fabbbed-6733-4f24-995f-cbd8b7a837f9 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:58.616628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0fabbbed-6733-4f24-995f-cbd8b7a837f9 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:58.617074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0fabbbed-6733-4f24-995f-cbd8b7a837f9 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:58.617798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0fabbbed-6733-4f24-995f-cbd8b7a837f9 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:58.628654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0fabbbed-6733-4f24-995f-cbd8b7a837f9 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:58.629364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0fabbbed-6733-4f24-995f-cbd8b7a837f9 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:58.682851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-c3e58da7-0ba0-4e4b-bd58-c3bff1d41619 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lazy-loading 'flavor' on Instance uuid 5d9854a1-ead6-4570-b801-13c47d0bf721 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:59:58.873365 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c3e58da7-0ba0-4e4b-bd58-c3bff1d41619 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action" status: 202 len: 0 microversion: 2.1 time: 0.273751 Oct 29 02:59:58.880848 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1377/2942] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:59:58 2022] POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:59:58.895806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-062d6e24-372c-4a1f-b4dd-b0172f659981 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:58.896978 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-062d6e24-372c-4a1f-b4dd-b0172f659981 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 02:59:58.946220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-062d6e24-372c-4a1f-b4dd-b0172f659981 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:58.951739 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-062d6e24-372c-4a1f-b4dd-b0172f659981 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:58.952449 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-062d6e24-372c-4a1f-b4dd-b0172f659981 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:58.953373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-062d6e24-372c-4a1f-b4dd-b0172f659981 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 02:59:58.954100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-062d6e24-372c-4a1f-b4dd-b0172f659981 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 02:59:58.955017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-062d6e24-372c-4a1f-b4dd-b0172f659981 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 02:59:59.023705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-062d6e24-372c-4a1f-b4dd-b0172f659981 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lazy-loading 'flavor' on Instance uuid 6e395101-378a-4976-b087-38ce3f22b912 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 02:59:59.292325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0fabbbed-6733-4f24-995f-cbd8b7a837f9 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:59.313913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0fabbbed-6733-4f24-995f-cbd8b7a837f9 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:59.323250 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0fabbbed-6733-4f24-995f-cbd8b7a837f9 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 02:59:59.325352 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0fabbbed-6733-4f24-995f-cbd8b7a837f9 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1752 microversion: 2.20 time: 0.730082 Oct 29 02:59:59.350587 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1566/2943] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 02:59:58 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1752 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 02:59:59.361625 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4d991600-35b0-4679-86e7-63ddba91d2d9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-551372947", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "18fc4cb9-056a-42e1-bd8a-e4a27cb291b2"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:59.494257 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-062d6e24-372c-4a1f-b4dd-b0172f659981 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "POST /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912/action" status: 202 len: 0 microversion: 2.1 time: 0.609209 Oct 29 02:59:59.495285 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1378/2944] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 02:59:58 2022] POST /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912/action => generated 0 bytes in 614 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 02:59:59.531592 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-53ef3a34-1fd0-4f46-91ef-33183bd47bcf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-942052062", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "451", "networks": [{"uuid": "8755c484-cfa7-4ffa-89ff-0a55c5aa7338"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 02:59:59.562598 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-4d991600-35b0-4679-86e7-63ddba91d2d9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] validate_networks() for [('18fc4cb9-056a-42e1-bd8a-e4a27cb291b2', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 02:59:59.654742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-53ef3a34-1fd0-4f46-91ef-33183bd47bcf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] validate_networks() for [('8755c484-cfa7-4ffa-89ff-0a55c5aa7338', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:00:01.238768 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-53ef3a34-1fd0-4f46-91ef-33183bd47bcf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:00:01.240688 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-53ef3a34-1fd0-4f46-91ef-33183bd47bcf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:00:01.241675 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-53ef3a34-1fd0-4f46-91ef-33183bd47bcf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:00:01.242434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-53ef3a34-1fd0-4f46-91ef-33183bd47bcf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:00:01.243234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-53ef3a34-1fd0-4f46-91ef-33183bd47bcf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:00:01.278221 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53ef3a34-1fd0-4f46-91ef-33183bd47bcf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:01.281716 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53ef3a34-1fd0-4f46-91ef-33183bd47bcf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:01.283895 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53ef3a34-1fd0-4f46-91ef-33183bd47bcf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:01.286415 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53ef3a34-1fd0-4f46-91ef-33183bd47bcf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:01.287008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53ef3a34-1fd0-4f46-91ef-33183bd47bcf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:01.288400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53ef3a34-1fd0-4f46-91ef-33183bd47bcf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:01.330239 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-53ef3a34-1fd0-4f46-91ef-33183bd47bcf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Getting quotas for project 875f8af161b647758adaebd94449c8c1. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:00:01.337982 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-53ef3a34-1fd0-4f46-91ef-33183bd47bcf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Getting quotas for user faa94d1a6a984ed7b4a150aa9229d033 and project 875f8af161b647758adaebd94449c8c1. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:00:01.359081 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-53ef3a34-1fd0-4f46-91ef-33183bd47bcf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:00:01.363416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-53ef3a34-1fd0-4f46-91ef-33183bd47bcf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 96a9fe4a-52f5-4b1f-955e-f991357b1813] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:00:01.444825 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-53ef3a34-1fd0-4f46-91ef-33183bd47bcf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.948076 Oct 29 03:00:01.451345 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1379/2945] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:59:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:00:01.460937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-059a87ce-caac-40df-996d-7221878d3adb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:01.461839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-059a87ce-caac-40df-996d-7221878d3adb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:01.481261 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-059a87ce-caac-40df-996d-7221878d3adb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:01.482000 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-059a87ce-caac-40df-996d-7221878d3adb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:01.482455 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-059a87ce-caac-40df-996d-7221878d3adb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:01.483382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-059a87ce-caac-40df-996d-7221878d3adb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:01.483944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-059a87ce-caac-40df-996d-7221878d3adb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:01.484385 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-059a87ce-caac-40df-996d-7221878d3adb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:01.752129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-059a87ce-caac-40df-996d-7221878d3adb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:01.765815 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-059a87ce-caac-40df-996d-7221878d3adb tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1496 microversion: 2.1 time: 0.313235 Oct 29 03:00:01.766731 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1380/2946] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:01 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1496 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:01.777119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-59713408-e55e-47ef-9401-73711c39bb55 req-0bb58187-8ae0-4181-bbb2-22680c39a568 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c72534eb-1844-4208-b625-ea8b5ece8108", "tag": "c7d91e7c-5b11-484a-b555-6a407dc903e3"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:01.802904 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-59713408-e55e-47ef-9401-73711c39bb55 req-0bb58187-8ae0-4181-bbb2-22680c39a568 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:01.803444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-59713408-e55e-47ef-9401-73711c39bb55 req-0bb58187-8ae0-4181-bbb2-22680c39a568 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:01.804290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-59713408-e55e-47ef-9401-73711c39bb55 req-0bb58187-8ae0-4181-bbb2-22680c39a568 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:01.830622 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-59713408-e55e-47ef-9401-73711c39bb55 req-0bb58187-8ae0-4181-bbb2-22680c39a568 service nova] Creating event network-changed:c7d91e7c-5b11-484a-b555-6a407dc903e3 for instance c72534eb-1844-4208-b625-ea8b5ece8108 on n-h1-862967-2 Oct 29 03:00:01.838561 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-59713408-e55e-47ef-9401-73711c39bb55 req-0bb58187-8ae0-4181-bbb2-22680c39a568 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070505 Oct 29 03:00:01.841970 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1381/2947] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:01.858494 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ff37f42b-d939-4d6e-abd3-d17415b18087 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:01.859310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ff37f42b-d939-4d6e-abd3-d17415b18087 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:01.875892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff37f42b-d939-4d6e-abd3-d17415b18087 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:01.878419 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff37f42b-d939-4d6e-abd3-d17415b18087 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:01.878868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff37f42b-d939-4d6e-abd3-d17415b18087 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:01.879768 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff37f42b-d939-4d6e-abd3-d17415b18087 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:01.880266 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff37f42b-d939-4d6e-abd3-d17415b18087 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:01.880733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff37f42b-d939-4d6e-abd3-d17415b18087 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:02.309740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:02.379244 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:02.928557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ff37f42b-d939-4d6e-abd3-d17415b18087 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:02.945411 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ff37f42b-d939-4d6e-abd3-d17415b18087 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 200 len: 1507 microversion: 2.1 time: 1.102142 Oct 29 03:00:02.946438 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1382/2948] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:01 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 1507 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:02.951361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d18def0b-8c3b-4e0b-892e-b0b3f7118b39 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:02.951982 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d18def0b-8c3b-4e0b-892e-b0b3f7118b39 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:02.969187 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d18def0b-8c3b-4e0b-892e-b0b3f7118b39 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:02.969681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d18def0b-8c3b-4e0b-892e-b0b3f7118b39 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:02.970118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d18def0b-8c3b-4e0b-892e-b0b3f7118b39 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:02.970830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d18def0b-8c3b-4e0b-892e-b0b3f7118b39 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:02.971289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d18def0b-8c3b-4e0b-892e-b0b3f7118b39 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:02.971712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d18def0b-8c3b-4e0b-892e-b0b3f7118b39 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:03.234940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-4d991600-35b0-4679-86e7-63ddba91d2d9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:00:03.235521 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-4d991600-35b0-4679-86e7-63ddba91d2d9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:00:03.236732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-4d991600-35b0-4679-86e7-63ddba91d2d9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:00:03.237511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-4d991600-35b0-4679-86e7-63ddba91d2d9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:00:03.238119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-4d991600-35b0-4679-86e7-63ddba91d2d9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:00:03.257454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d991600-35b0-4679-86e7-63ddba91d2d9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:03.258794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d991600-35b0-4679-86e7-63ddba91d2d9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:03.260116 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d991600-35b0-4679-86e7-63ddba91d2d9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:03.270009 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d991600-35b0-4679-86e7-63ddba91d2d9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:03.270009 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d991600-35b0-4679-86e7-63ddba91d2d9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:03.270009 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d991600-35b0-4679-86e7-63ddba91d2d9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:03.296943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-4d991600-35b0-4679-86e7-63ddba91d2d9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Getting quotas for project 185d32c10dd845768f4ff70a85680358. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:00:03.305580 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-4d991600-35b0-4679-86e7-63ddba91d2d9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Getting quotas for user c866f273672846eb8d7f4f2a00269666 and project 185d32c10dd845768f4ff70a85680358. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:00:03.323428 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4d991600-35b0-4679-86e7-63ddba91d2d9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:00:03.328488 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4d991600-35b0-4679-86e7-63ddba91d2d9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:00:03.466110 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4d991600-35b0-4679-86e7-63ddba91d2d9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.109798 Oct 29 03:00:03.476246 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1567/2949] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 02:59:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 4125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:00:03.491957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-62eb96b4-63d5-40a2-96f5-753630317e88 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:03.510010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-62eb96b4-63d5-40a2-96f5-753630317e88 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:03.534501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-62eb96b4-63d5-40a2-96f5-753630317e88 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:03.537182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-62eb96b4-63d5-40a2-96f5-753630317e88 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:03.540162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-62eb96b4-63d5-40a2-96f5-753630317e88 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:03.541484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-62eb96b4-63d5-40a2-96f5-753630317e88 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:03.542368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-62eb96b4-63d5-40a2-96f5-753630317e88 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:03.544265 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-62eb96b4-63d5-40a2-96f5-753630317e88 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:03.913343 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d18def0b-8c3b-4e0b-892e-b0b3f7118b39 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:03.949535 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d18def0b-8c3b-4e0b-892e-b0b3f7118b39 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:03.951032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d18def0b-8c3b-4e0b-892e-b0b3f7118b39 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:03.952305 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d18def0b-8c3b-4e0b-892e-b0b3f7118b39 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1870 microversion: 2.32 time: 1.004808 Oct 29 03:00:03.964985 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1383/2950] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:02 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1870 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:03.979940 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-14544a0a-8384-4f7d-959e-8740d4e46c70 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:03.983795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-14544a0a-8384-4f7d-959e-8740d4e46c70 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 96a9fe4a-52f5-4b1f-955e-f991357b1813] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:04.010617 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14544a0a-8384-4f7d-959e-8740d4e46c70 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:04.011193 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14544a0a-8384-4f7d-959e-8740d4e46c70 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:04.011956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14544a0a-8384-4f7d-959e-8740d4e46c70 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:04.012563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14544a0a-8384-4f7d-959e-8740d4e46c70 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:04.013039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14544a0a-8384-4f7d-959e-8740d4e46c70 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:04.013477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14544a0a-8384-4f7d-959e-8740d4e46c70 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:04.172019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-62eb96b4-63d5-40a2-96f5-753630317e88 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:04.188130 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-62eb96b4-63d5-40a2-96f5-753630317e88 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:04.193301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-62eb96b4-63d5-40a2-96f5-753630317e88 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:04.198004 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-62eb96b4-63d5-40a2-96f5-753630317e88 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1752 microversion: 2.20 time: 0.720499 Oct 29 03:00:04.200175 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1568/2951] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:03 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1752 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:04.205321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f6932295-caa0-4229-981e-d6f3a41ae9bf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:04.211050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f6932295-caa0-4229-981e-d6f3a41ae9bf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:04.224759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f6932295-caa0-4229-981e-d6f3a41ae9bf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:04.227713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f6932295-caa0-4229-981e-d6f3a41ae9bf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:04.229445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f6932295-caa0-4229-981e-d6f3a41ae9bf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:04.230466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f6932295-caa0-4229-981e-d6f3a41ae9bf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:04.232235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f6932295-caa0-4229-981e-d6f3a41ae9bf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:04.234974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f6932295-caa0-4229-981e-d6f3a41ae9bf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:04.292096 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-f6932295-caa0-4229-981e-d6f3a41ae9bf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lazy-loading 'flavor' on Instance uuid 5d9854a1-ead6-4570-b801-13c47d0bf721 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:00:04.325410 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-f6932295-caa0-4229-981e-d6f3a41ae9bf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Cannot 'suspend' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state suspended Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f6932295-caa0-4229-981e-d6f3a41ae9bf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action HTTP/1.1 Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 15 Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: {"suspend": {}} Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: exception: Cannot 'suspend' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state suspended Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '5d9854a1-ead6-4570-b801-13c47d0bf721', 'body': {'suspend': {}}} Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5d9854a1-ead6-4570-b801-13c47d0bf721 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 29 03:00:04.331725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 03:00:04.336592 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 03:00:04.336592 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 03:00:04.336592 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state suspended Oct 29 03:00:04.336592 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:04.336592 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:04.336592 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:04.336592 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:04.336592 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:04.336592 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:04.336592 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:00:04.336592 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:00:04.336592 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state suspended Oct 29 03:00:04.336592 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:04.338360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f6932295-caa0-4229-981e-d6f3a41ae9bf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 409 to user: Cannot 'suspend' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state suspended {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:04.339584 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f6932295-caa0-4229-981e-d6f3a41ae9bf tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action" status: 409 len: 148 microversion: 2.1 time: 0.138242 Oct 29 03:00:04.343258 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1569/2952] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:00:04 2022] POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action => generated 148 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:00:04.357196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-a605af9b-cd08-473e-b735-be52a8e14747 req-5d65b3f7-1dfa-4d43-9211-ca0a8924048a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32ae03c4-2aee-40c8-9fc9-215ed9eaaf92", "tag": "47657226-9a10-4275-8b35-5a770e9075d9"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:04.387713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a605af9b-cd08-473e-b735-be52a8e14747 req-5d65b3f7-1dfa-4d43-9211-ca0a8924048a service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:04.390513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a605af9b-cd08-473e-b735-be52a8e14747 req-5d65b3f7-1dfa-4d43-9211-ca0a8924048a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:04.391139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a605af9b-cd08-473e-b735-be52a8e14747 req-5d65b3f7-1dfa-4d43-9211-ca0a8924048a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:04.397820 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-14544a0a-8384-4f7d-959e-8740d4e46c70 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:04.407360 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-14544a0a-8384-4f7d-959e-8740d4e46c70 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813" status: 200 len: 1278 microversion: 2.1 time: 0.440867 Oct 29 03:00:04.424559 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1384/2953] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:03 2022] GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813 => generated 1278 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:04.440868 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-a605af9b-cd08-473e-b735-be52a8e14747 req-5d65b3f7-1dfa-4d43-9211-ca0a8924048a service nova] Creating event network-changed:47657226-9a10-4275-8b35-5a770e9075d9 for instance 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 on n-h1-862967-2 Oct 29 03:00:04.450615 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-a605af9b-cd08-473e-b735-be52a8e14747 req-5d65b3f7-1dfa-4d43-9211-ca0a8924048a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105583 Oct 29 03:00:04.451199 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1570/2954] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:04.452651 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c3405734-0464-4d98-a1e8-1f80c9cd8123 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:04.453429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c3405734-0464-4d98-a1e8-1f80c9cd8123 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:04.469431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1fd86efb-7067-4a6e-b433-1e33023dbaa5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:04.470122 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1fd86efb-7067-4a6e-b433-1e33023dbaa5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:04.498414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fd86efb-7067-4a6e-b433-1e33023dbaa5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:04.500936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fd86efb-7067-4a6e-b433-1e33023dbaa5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:04.502562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fd86efb-7067-4a6e-b433-1e33023dbaa5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:04.505799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fd86efb-7067-4a6e-b433-1e33023dbaa5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:04.509298 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fd86efb-7067-4a6e-b433-1e33023dbaa5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:04.513811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fd86efb-7067-4a6e-b433-1e33023dbaa5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:04.961984 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c3405734-0464-4d98-a1e8-1f80c9cd8123 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:04.969975 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c3405734-0464-4d98-a1e8-1f80c9cd8123 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81" status: 200 len: 1207 microversion: 2.1 time: 0.552300 Oct 29 03:00:04.994518 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1385/2955] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:04 2022] GET /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 => generated 1207 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:05.012749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-cf74f4be-8709-4233-868a-0330ed864154 req-c6a3debf-75c7-47ca-a249-297d45546b45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b7f1dd5-af84-416c-84a6-e7a0a67294e6", "name": "network-vif-deleted", "tag": "6f3a9167-1c0e-4d88-92ba-1c4e6bd37758"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:05.037442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-cf74f4be-8709-4233-868a-0330ed864154 req-c6a3debf-75c7-47ca-a249-297d45546b45 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:05.038012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-cf74f4be-8709-4233-868a-0330ed864154 req-c6a3debf-75c7-47ca-a249-297d45546b45 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:05.038701 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-cf74f4be-8709-4233-868a-0330ed864154 req-c6a3debf-75c7-47ca-a249-297d45546b45 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:05.059664 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-cf74f4be-8709-4233-868a-0330ed864154 req-c6a3debf-75c7-47ca-a249-297d45546b45 service nova] Creating event network-vif-deleted:6f3a9167-1c0e-4d88-92ba-1c4e6bd37758 for instance 7b7f1dd5-af84-416c-84a6-e7a0a67294e6 on n-h1-862967-2 Oct 29 03:00:05.074500 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-cf74f4be-8709-4233-868a-0330ed864154 req-c6a3debf-75c7-47ca-a249-297d45546b45 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077856 Oct 29 03:00:05.075823 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1386/2956] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:05.081878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-919bc00c-294f-4ff0-94fa-10278148fab3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:05.089753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-919bc00c-294f-4ff0-94fa-10278148fab3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:05.104063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-919bc00c-294f-4ff0-94fa-10278148fab3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:05.109287 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-919bc00c-294f-4ff0-94fa-10278148fab3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:05.110001 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-919bc00c-294f-4ff0-94fa-10278148fab3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:05.110915 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-919bc00c-294f-4ff0-94fa-10278148fab3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:05.111533 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-919bc00c-294f-4ff0-94fa-10278148fab3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:05.112115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-919bc00c-294f-4ff0-94fa-10278148fab3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:05.235757 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:05.288861 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-919bc00c-294f-4ff0-94fa-10278148fab3 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action" status: 202 len: 0 microversion: 2.1 time: 0.210813 Oct 29 03:00:05.291160 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1387/2957] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:00:05 2022] POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:00:05.325005 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5facbd66-90dd-47a3-82e0-ba1e5ea352f7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:05.331725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5facbd66-90dd-47a3-82e0-ba1e5ea352f7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:05.351244 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5facbd66-90dd-47a3-82e0-ba1e5ea352f7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:05.352696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5facbd66-90dd-47a3-82e0-ba1e5ea352f7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:05.353850 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5facbd66-90dd-47a3-82e0-ba1e5ea352f7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:05.356466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5facbd66-90dd-47a3-82e0-ba1e5ea352f7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:05.357701 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5facbd66-90dd-47a3-82e0-ba1e5ea352f7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:05.359102 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5facbd66-90dd-47a3-82e0-ba1e5ea352f7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:05.382070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1fd86efb-7067-4a6e-b433-1e33023dbaa5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:05.416375 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1fd86efb-7067-4a6e-b433-1e33023dbaa5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 200 len: 1507 microversion: 2.1 time: 0.949673 Oct 29 03:00:05.437709 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1571/2958] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:04 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 1507 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:05.444443 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-84709721-fb17-47a3-870b-74c63f69cda5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:05.445367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-84709721-fb17-47a3-870b-74c63f69cda5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:05.453817 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-84709721-fb17-47a3-870b-74c63f69cda5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:05.455137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-84709721-fb17-47a3-870b-74c63f69cda5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:05.455785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-84709721-fb17-47a3-870b-74c63f69cda5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:05.456713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-84709721-fb17-47a3-870b-74c63f69cda5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:05.457354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-84709721-fb17-47a3-870b-74c63f69cda5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:05.458406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-84709721-fb17-47a3-870b-74c63f69cda5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:05.964861 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5facbd66-90dd-47a3-82e0-ba1e5ea352f7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:05.998065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5facbd66-90dd-47a3-82e0-ba1e5ea352f7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:05.999531 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5facbd66-90dd-47a3-82e0-ba1e5ea352f7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:06.000779 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5facbd66-90dd-47a3-82e0-ba1e5ea352f7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1870 microversion: 2.32 time: 0.707544 Oct 29 03:00:06.006323 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1388/2959] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:05 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1870 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:06.021860 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4d9319a4-e55d-4cd3-b5d2-4f1a85ce9e5e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:06.023174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4d9319a4-e55d-4cd3-b5d2-4f1a85ce9e5e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:06.041418 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d9319a4-e55d-4cd3-b5d2-4f1a85ce9e5e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:06.041918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d9319a4-e55d-4cd3-b5d2-4f1a85ce9e5e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:06.043063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d9319a4-e55d-4cd3-b5d2-4f1a85ce9e5e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:06.043063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d9319a4-e55d-4cd3-b5d2-4f1a85ce9e5e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:06.043492 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d9319a4-e55d-4cd3-b5d2-4f1a85ce9e5e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:06.043890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d9319a4-e55d-4cd3-b5d2-4f1a85ce9e5e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:06.125001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-84709721-fb17-47a3-870b-74c63f69cda5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:06.156003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-84709721-fb17-47a3-870b-74c63f69cda5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:06.162764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-84709721-fb17-47a3-870b-74c63f69cda5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:06.176180 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-84709721-fb17-47a3-870b-74c63f69cda5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1752 microversion: 2.20 time: 0.736437 Oct 29 03:00:06.179075 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1572/2960] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:05 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1752 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:06.191369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cf287c8d-504b-48d3-94ba-dca21b49b4bb tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:06.192321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cf287c8d-504b-48d3-94ba-dca21b49b4bb tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 96a9fe4a-52f5-4b1f-955e-f991357b1813] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:06.208675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf287c8d-504b-48d3-94ba-dca21b49b4bb tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:06.210650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf287c8d-504b-48d3-94ba-dca21b49b4bb tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:06.212586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf287c8d-504b-48d3-94ba-dca21b49b4bb tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:06.213501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf287c8d-504b-48d3-94ba-dca21b49b4bb tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:06.214908 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf287c8d-504b-48d3-94ba-dca21b49b4bb tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:06.215495 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf287c8d-504b-48d3-94ba-dca21b49b4bb tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:06.525031 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cf287c8d-504b-48d3-94ba-dca21b49b4bb tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:06.534004 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cf287c8d-504b-48d3-94ba-dca21b49b4bb tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813" status: 200 len: 1278 microversion: 2.1 time: 0.353024 Oct 29 03:00:06.534136 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1573/2961] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:06 2022] GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813 => generated 1278 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:06.549006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-34a28054-5ea2-43a9-b4c9-b1dca16d3e91 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:06.549641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-34a28054-5ea2-43a9-b4c9-b1dca16d3e91 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:06.562160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34a28054-5ea2-43a9-b4c9-b1dca16d3e91 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:06.562675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34a28054-5ea2-43a9-b4c9-b1dca16d3e91 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:06.563113 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34a28054-5ea2-43a9-b4c9-b1dca16d3e91 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:06.563841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34a28054-5ea2-43a9-b4c9-b1dca16d3e91 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:06.564295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34a28054-5ea2-43a9-b4c9-b1dca16d3e91 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:06.564754 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34a28054-5ea2-43a9-b4c9-b1dca16d3e91 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:07.039736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-34a28054-5ea2-43a9-b4c9-b1dca16d3e91 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:07.051400 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-34a28054-5ea2-43a9-b4c9-b1dca16d3e91 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81" status: 200 len: 1265 microversion: 2.1 time: 0.516113 Oct 29 03:00:07.068606 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1574/2962] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:06 2022] GET /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 => generated 1265 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:07.073858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0c1e0496-61c6-4d55-9cbd-66fc7f0dc3d6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:07.074655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0c1e0496-61c6-4d55-9cbd-66fc7f0dc3d6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:07.085246 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0c1e0496-61c6-4d55-9cbd-66fc7f0dc3d6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:07.086367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0c1e0496-61c6-4d55-9cbd-66fc7f0dc3d6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:07.087252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0c1e0496-61c6-4d55-9cbd-66fc7f0dc3d6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:07.088665 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0c1e0496-61c6-4d55-9cbd-66fc7f0dc3d6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:07.089877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0c1e0496-61c6-4d55-9cbd-66fc7f0dc3d6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:07.090820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0c1e0496-61c6-4d55-9cbd-66fc7f0dc3d6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:07.265065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4d9319a4-e55d-4cd3-b5d2-4f1a85ce9e5e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:07.292409 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4d9319a4-e55d-4cd3-b5d2-4f1a85ce9e5e tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1502 microversion: 2.1 time: 1.284417 Oct 29 03:00:07.306049 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1389/2963] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:06 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1502 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:07.332745 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-92da6066-b902-4dc9-a672-9777d419151e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:07.334498 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-92da6066-b902-4dc9-a672-9777d419151e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:07.354844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92da6066-b902-4dc9-a672-9777d419151e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:07.365850 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92da6066-b902-4dc9-a672-9777d419151e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:07.366816 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92da6066-b902-4dc9-a672-9777d419151e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:07.368488 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92da6066-b902-4dc9-a672-9777d419151e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:07.369443 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92da6066-b902-4dc9-a672-9777d419151e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:07.370343 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92da6066-b902-4dc9-a672-9777d419151e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:07.990176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-92da6066-b902-4dc9-a672-9777d419151e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:08.021814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-92da6066-b902-4dc9-a672-9777d419151e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:08.032796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-92da6066-b902-4dc9-a672-9777d419151e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:08.034399 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-92da6066-b902-4dc9-a672-9777d419151e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1891 microversion: 2.32 time: 0.726491 Oct 29 03:00:08.035021 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1390/2964] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:07 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1891 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:08.055321 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d8bfb5d3-387f-4a78-8c97-624c77f76268 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:08.059387 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d8bfb5d3-387f-4a78-8c97-624c77f76268 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:08.073137 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8bfb5d3-387f-4a78-8c97-624c77f76268 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:08.079237 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8bfb5d3-387f-4a78-8c97-624c77f76268 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:08.079864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8bfb5d3-387f-4a78-8c97-624c77f76268 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:08.080786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8bfb5d3-387f-4a78-8c97-624c77f76268 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:08.081391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8bfb5d3-387f-4a78-8c97-624c77f76268 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:08.081967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8bfb5d3-387f-4a78-8c97-624c77f76268 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:08.204660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0c1e0496-61c6-4d55-9cbd-66fc7f0dc3d6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:08.209628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:08.221513 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0c1e0496-61c6-4d55-9cbd-66fc7f0dc3d6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 200 len: 1507 microversion: 2.1 time: 1.151404 Oct 29 03:00:08.226689 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1575/2965] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:07 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 1507 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:08.233108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-f3da2094-f165-477f-ab8f-afa4bb9d2df9 req-10757d02-e588-4864-9011-c83cbe9334e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c72534eb-1844-4208-b625-ea8b5ece8108", "tag": "998148a8-ddff-46d0-94b6-c27edcac4cb0"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:08.243965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f3da2094-f165-477f-ab8f-afa4bb9d2df9 req-10757d02-e588-4864-9011-c83cbe9334e1 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:08.244444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f3da2094-f165-477f-ab8f-afa4bb9d2df9 req-10757d02-e588-4864-9011-c83cbe9334e1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:08.245094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f3da2094-f165-477f-ab8f-afa4bb9d2df9 req-10757d02-e588-4864-9011-c83cbe9334e1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:08.261193 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-f3da2094-f165-477f-ab8f-afa4bb9d2df9 req-10757d02-e588-4864-9011-c83cbe9334e1 service nova] Creating event network-changed:998148a8-ddff-46d0-94b6-c27edcac4cb0 for instance c72534eb-1844-4208-b625-ea8b5ece8108 on n-h1-862967-2 Oct 29 03:00:08.268200 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-f3da2094-f165-477f-ab8f-afa4bb9d2df9 req-10757d02-e588-4864-9011-c83cbe9334e1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040122 Oct 29 03:00:08.268862 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1576/2966] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:08.284959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2901511e-32ae-4fee-b3b4-e931d3ddfdc4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:08.286451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2901511e-32ae-4fee-b3b4-e931d3ddfdc4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 96a9fe4a-52f5-4b1f-955e-f991357b1813] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:08.298291 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2901511e-32ae-4fee-b3b4-e931d3ddfdc4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:08.299091 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2901511e-32ae-4fee-b3b4-e931d3ddfdc4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:08.299684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2901511e-32ae-4fee-b3b4-e931d3ddfdc4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:08.302709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2901511e-32ae-4fee-b3b4-e931d3ddfdc4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:08.305266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2901511e-32ae-4fee-b3b4-e931d3ddfdc4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:08.305916 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2901511e-32ae-4fee-b3b4-e931d3ddfdc4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:08.970916 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d8bfb5d3-387f-4a78-8c97-624c77f76268 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:08.987512 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d8bfb5d3-387f-4a78-8c97-624c77f76268 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:08.989938 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d8bfb5d3-387f-4a78-8c97-624c77f76268 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:08.991167 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d8bfb5d3-387f-4a78-8c97-624c77f76268 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1752 microversion: 2.20 time: 0.953041 Oct 29 03:00:08.996763 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1391/2967] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:08 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1752 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:09.008967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d8f4b3a9-21e0-422b-95bb-15dda2cd6681 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:09.009884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d8f4b3a9-21e0-422b-95bb-15dda2cd6681 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:09.031331 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8f4b3a9-21e0-422b-95bb-15dda2cd6681 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:09.032079 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8f4b3a9-21e0-422b-95bb-15dda2cd6681 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:09.035331 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8f4b3a9-21e0-422b-95bb-15dda2cd6681 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:09.036796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8f4b3a9-21e0-422b-95bb-15dda2cd6681 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:09.037460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8f4b3a9-21e0-422b-95bb-15dda2cd6681 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:09.038087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8f4b3a9-21e0-422b-95bb-15dda2cd6681 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:09.174495 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2901511e-32ae-4fee-b3b4-e931d3ddfdc4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:09.193460 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2901511e-32ae-4fee-b3b4-e931d3ddfdc4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813" status: 200 len: 1320 microversion: 2.1 time: 0.923327 Oct 29 03:00:09.202383 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1577/2968] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:08 2022] GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813 => generated 1320 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:09.219734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-437cedfa-90a7-429e-b139-345244eba2ed tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:09.221282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-437cedfa-90a7-429e-b139-345244eba2ed tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:09.250945 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-437cedfa-90a7-429e-b139-345244eba2ed tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:09.253264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-437cedfa-90a7-429e-b139-345244eba2ed tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:09.254251 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-437cedfa-90a7-429e-b139-345244eba2ed tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:09.256083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-437cedfa-90a7-429e-b139-345244eba2ed tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:09.259079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-437cedfa-90a7-429e-b139-345244eba2ed tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:09.259961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-437cedfa-90a7-429e-b139-345244eba2ed tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:09.550604 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d8f4b3a9-21e0-422b-95bb-15dda2cd6681 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:09.563556 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d8f4b3a9-21e0-422b-95bb-15dda2cd6681 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81" status: 200 len: 1265 microversion: 2.1 time: 0.563816 Oct 29 03:00:09.564545 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1392/2969] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:08 2022] GET /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 => generated 1265 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:09.577085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-dadac175-282c-4778-aec2-84a953c0a4b2 req-1bec9ba7-9ac7-4ad0-b539-65b7045785f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c72534eb-1844-4208-b625-ea8b5ece8108", "tag": "951b4e8b-0238-4e1b-b891-991e85f03a1b"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:09.599090 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-dadac175-282c-4778-aec2-84a953c0a4b2 req-1bec9ba7-9ac7-4ad0-b539-65b7045785f4 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:09.599469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-dadac175-282c-4778-aec2-84a953c0a4b2 req-1bec9ba7-9ac7-4ad0-b539-65b7045785f4 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:09.599903 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-dadac175-282c-4778-aec2-84a953c0a4b2 req-1bec9ba7-9ac7-4ad0-b539-65b7045785f4 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:09.615571 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-dadac175-282c-4778-aec2-84a953c0a4b2 req-1bec9ba7-9ac7-4ad0-b539-65b7045785f4 service nova] Creating event network-changed:951b4e8b-0238-4e1b-b891-991e85f03a1b for instance c72534eb-1844-4208-b625-ea8b5ece8108 on n-h1-862967-2 Oct 29 03:00:09.621847 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-dadac175-282c-4778-aec2-84a953c0a4b2 req-1bec9ba7-9ac7-4ad0-b539-65b7045785f4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054353 Oct 29 03:00:09.622838 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1393/2970] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:09.668414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5a6f3bb4-0796-416d-83ea-97195cac6d7a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:09.669917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5a6f3bb4-0796-416d-83ea-97195cac6d7a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:09.684040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a6f3bb4-0796-416d-83ea-97195cac6d7a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:09.684759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a6f3bb4-0796-416d-83ea-97195cac6d7a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:09.693382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a6f3bb4-0796-416d-83ea-97195cac6d7a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:09.698482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a6f3bb4-0796-416d-83ea-97195cac6d7a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:09.703623 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a6f3bb4-0796-416d-83ea-97195cac6d7a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:09.704263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a6f3bb4-0796-416d-83ea-97195cac6d7a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:10.173699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-437cedfa-90a7-429e-b139-345244eba2ed tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:10.181882 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-437cedfa-90a7-429e-b139-345244eba2ed tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1502 microversion: 2.1 time: 0.978124 Oct 29 03:00:10.182473 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1578/2971] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:09 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1502 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:10.208605 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7325bd2b-2373-4e1a-8f17-309e59a4427e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:10.212166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7325bd2b-2373-4e1a-8f17-309e59a4427e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:10.230980 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7325bd2b-2373-4e1a-8f17-309e59a4427e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:10.231512 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7325bd2b-2373-4e1a-8f17-309e59a4427e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:10.237056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7325bd2b-2373-4e1a-8f17-309e59a4427e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:10.237864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7325bd2b-2373-4e1a-8f17-309e59a4427e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:10.238345 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7325bd2b-2373-4e1a-8f17-309e59a4427e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:10.238872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7325bd2b-2373-4e1a-8f17-309e59a4427e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:11.020403 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7325bd2b-2373-4e1a-8f17-309e59a4427e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:11.037420 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7325bd2b-2373-4e1a-8f17-309e59a4427e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 200 len: 1507 microversion: 2.1 time: 0.841592 Oct 29 03:00:11.037981 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1579/2972] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:10 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 1507 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:11.043342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bb3d2460-7c27-4afa-8827-6578433ee2a7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:11.047407 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bb3d2460-7c27-4afa-8827-6578433ee2a7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:11.068492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb3d2460-7c27-4afa-8827-6578433ee2a7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:11.069259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb3d2460-7c27-4afa-8827-6578433ee2a7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:11.087725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb3d2460-7c27-4afa-8827-6578433ee2a7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:11.088981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb3d2460-7c27-4afa-8827-6578433ee2a7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:11.089618 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb3d2460-7c27-4afa-8827-6578433ee2a7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:11.090211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb3d2460-7c27-4afa-8827-6578433ee2a7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:11.312648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:11.905646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bb3d2460-7c27-4afa-8827-6578433ee2a7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:11.916232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bb3d2460-7c27-4afa-8827-6578433ee2a7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:11.925680 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bb3d2460-7c27-4afa-8827-6578433ee2a7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:11.927319 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bb3d2460-7c27-4afa-8827-6578433ee2a7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1808 microversion: 2.20 time: 0.888184 Oct 29 03:00:11.929303 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1580/2973] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:11 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1808 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:11.941984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0fe29403-c6eb-4df3-bcd9-b2c91d920ad9 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:11.943161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0fe29403-c6eb-4df3-bcd9-b2c91d920ad9 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 96a9fe4a-52f5-4b1f-955e-f991357b1813] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:11.962647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0fe29403-c6eb-4df3-bcd9-b2c91d920ad9 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:11.963458 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0fe29403-c6eb-4df3-bcd9-b2c91d920ad9 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:11.964068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0fe29403-c6eb-4df3-bcd9-b2c91d920ad9 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:11.965018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0fe29403-c6eb-4df3-bcd9-b2c91d920ad9 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:11.965659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0fe29403-c6eb-4df3-bcd9-b2c91d920ad9 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:11.966249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0fe29403-c6eb-4df3-bcd9-b2c91d920ad9 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:12.118572 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5a6f3bb4-0796-416d-83ea-97195cac6d7a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:12.147233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5a6f3bb4-0796-416d-83ea-97195cac6d7a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:12.168172 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5a6f3bb4-0796-416d-83ea-97195cac6d7a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:12.171096 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5a6f3bb4-0796-416d-83ea-97195cac6d7a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1891 microversion: 2.32 time: 2.546628 Oct 29 03:00:12.172619 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1394/2974] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:09 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1891 bytes in 2549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:12.193667 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7ffb4746-d52e-402e-b929-dcebcab309e1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:12.196329 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7ffb4746-d52e-402e-b929-dcebcab309e1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:12.219810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ffb4746-d52e-402e-b929-dcebcab309e1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:12.220729 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ffb4746-d52e-402e-b929-dcebcab309e1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:12.221517 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ffb4746-d52e-402e-b929-dcebcab309e1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:12.222895 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ffb4746-d52e-402e-b929-dcebcab309e1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:12.223916 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ffb4746-d52e-402e-b929-dcebcab309e1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:12.224727 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ffb4746-d52e-402e-b929-dcebcab309e1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:12.486717 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0fe29403-c6eb-4df3-bcd9-b2c91d920ad9 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:12.497656 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0fe29403-c6eb-4df3-bcd9-b2c91d920ad9 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813" status: 200 len: 1320 microversion: 2.1 time: 0.565679 Oct 29 03:00:12.509912 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1581/2975] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:11 2022] GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813 => generated 1320 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:12.520421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ace6dbb9-91a9-431f-91cd-521fe78c4393 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:12.521860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ace6dbb9-91a9-431f-91cd-521fe78c4393 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:12.535560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ace6dbb9-91a9-431f-91cd-521fe78c4393 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:12.536327 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ace6dbb9-91a9-431f-91cd-521fe78c4393 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:12.537089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ace6dbb9-91a9-431f-91cd-521fe78c4393 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:12.538071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ace6dbb9-91a9-431f-91cd-521fe78c4393 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:12.538753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ace6dbb9-91a9-431f-91cd-521fe78c4393 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:12.539453 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ace6dbb9-91a9-431f-91cd-521fe78c4393 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:13.015342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7ffb4746-d52e-402e-b929-dcebcab309e1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:13.044619 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7ffb4746-d52e-402e-b929-dcebcab309e1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81" status: 200 len: 1307 microversion: 2.1 time: 0.869505 Oct 29 03:00:13.045675 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1395/2976] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:12 2022] GET /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 => generated 1307 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:13.065852 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-188d9a35-c7bb-4951-90da-2a4a428657c5 req-2ead7158-a9d7-4f23-9909-63f132de6f42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32ae03c4-2aee-40c8-9fc9-215ed9eaaf92", "name": "network-vif-plugged", "status": "completed", "tag": "47657226-9a10-4275-8b35-5a770e9075d9"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:13.098058 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-188d9a35-c7bb-4951-90da-2a4a428657c5 req-2ead7158-a9d7-4f23-9909-63f132de6f42 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:13.111561 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-188d9a35-c7bb-4951-90da-2a4a428657c5 req-2ead7158-a9d7-4f23-9909-63f132de6f42 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:13.112608 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-188d9a35-c7bb-4951-90da-2a4a428657c5 req-2ead7158-a9d7-4f23-9909-63f132de6f42 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:13.154551 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-188d9a35-c7bb-4951-90da-2a4a428657c5 req-2ead7158-a9d7-4f23-9909-63f132de6f42 service nova] Creating event network-vif-plugged:47657226-9a10-4275-8b35-5a770e9075d9 for instance 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 on n-h1-862967-2 Oct 29 03:00:13.160589 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-188d9a35-c7bb-4951-90da-2a4a428657c5 req-2ead7158-a9d7-4f23-9909-63f132de6f42 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108574 Oct 29 03:00:13.162239 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1396/2977] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:13.168715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c8e6bf9e-c7bd-4822-86c5-a2484556a9a6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:13.169709 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c8e6bf9e-c7bd-4822-86c5-a2484556a9a6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:13.177027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8e6bf9e-c7bd-4822-86c5-a2484556a9a6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:13.178104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8e6bf9e-c7bd-4822-86c5-a2484556a9a6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:13.178737 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8e6bf9e-c7bd-4822-86c5-a2484556a9a6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:13.179684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8e6bf9e-c7bd-4822-86c5-a2484556a9a6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:13.180351 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8e6bf9e-c7bd-4822-86c5-a2484556a9a6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:13.181024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8e6bf9e-c7bd-4822-86c5-a2484556a9a6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:13.283928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:13.318491 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:13.671301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c8e6bf9e-c7bd-4822-86c5-a2484556a9a6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:13.680071 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c8e6bf9e-c7bd-4822-86c5-a2484556a9a6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 200 len: 1507 microversion: 2.1 time: 0.516348 Oct 29 03:00:13.680697 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1397/2978] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:13 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 1507 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:13.698107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-c41f2edc-e62e-4beb-bff1-779155d93f21 req-11c7c9d3-cfbc-46a9-8468-f1ec421b6a51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96a9fe4a-52f5-4b1f-955e-f991357b1813", "tag": "76c5f041-ee64-4474-8579-cca40e817df4"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:13.724124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c41f2edc-e62e-4beb-bff1-779155d93f21 req-11c7c9d3-cfbc-46a9-8468-f1ec421b6a51 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:13.725030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c41f2edc-e62e-4beb-bff1-779155d93f21 req-11c7c9d3-cfbc-46a9-8468-f1ec421b6a51 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:13.725626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c41f2edc-e62e-4beb-bff1-779155d93f21 req-11c7c9d3-cfbc-46a9-8468-f1ec421b6a51 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:13.748751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ace6dbb9-91a9-431f-91cd-521fe78c4393 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:13.752000 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-c41f2edc-e62e-4beb-bff1-779155d93f21 req-11c7c9d3-cfbc-46a9-8468-f1ec421b6a51 service nova] Creating event network-changed:76c5f041-ee64-4474-8579-cca40e817df4 for instance 96a9fe4a-52f5-4b1f-955e-f991357b1813 on n-h1-862967-2 Oct 29 03:00:13.757158 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ace6dbb9-91a9-431f-91cd-521fe78c4393 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 1.240935 Oct 29 03:00:13.757751 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1582/2979] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:12 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:13.771707 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-c41f2edc-e62e-4beb-bff1-779155d93f21 req-11c7c9d3-cfbc-46a9-8468-f1ec421b6a51 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078040 Oct 29 03:00:13.773513 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1398/2980] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:13.781769 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-72eec478-e55c-4482-9245-4b1a1d5c1dbd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:13.791305 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-72eec478-e55c-4482-9245-4b1a1d5c1dbd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:13.791877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-156e7bab-f93d-466f-9580-262595f5d225 req-ee4db941-6cf0-48e8-b50e-6a546385ba81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a", "tag": "faae8e87-aa37-4d42-93da-4b5b661b44e5"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:13.805432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-72eec478-e55c-4482-9245-4b1a1d5c1dbd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:13.810357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-72eec478-e55c-4482-9245-4b1a1d5c1dbd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:13.811228 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-72eec478-e55c-4482-9245-4b1a1d5c1dbd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:13.813585 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-72eec478-e55c-4482-9245-4b1a1d5c1dbd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:13.816821 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-72eec478-e55c-4482-9245-4b1a1d5c1dbd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:13.817574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-72eec478-e55c-4482-9245-4b1a1d5c1dbd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:13.829810 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-156e7bab-f93d-466f-9580-262595f5d225 req-ee4db941-6cf0-48e8-b50e-6a546385ba81 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:13.830221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-156e7bab-f93d-466f-9580-262595f5d225 req-ee4db941-6cf0-48e8-b50e-6a546385ba81 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:13.830657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-156e7bab-f93d-466f-9580-262595f5d225 req-ee4db941-6cf0-48e8-b50e-6a546385ba81 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:13.858619 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-156e7bab-f93d-466f-9580-262595f5d225 req-ee4db941-6cf0-48e8-b50e-6a546385ba81 service nova] Creating event network-changed:faae8e87-aa37-4d42-93da-4b5b661b44e5 for instance 4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a on n-h2-862967-2 Oct 29 03:00:13.874758 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-156e7bab-f93d-466f-9580-262595f5d225 req-ee4db941-6cf0-48e8-b50e-6a546385ba81 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104439 Oct 29 03:00:13.875389 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1583/2981] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:13.883803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3e82ab7d-01c9-48c1-9b7d-a6916c810f69 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:13.884619 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3e82ab7d-01c9-48c1-9b7d-a6916c810f69 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:13.910405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3e82ab7d-01c9-48c1-9b7d-a6916c810f69 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:13.912548 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3e82ab7d-01c9-48c1-9b7d-a6916c810f69 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:13.914980 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3e82ab7d-01c9-48c1-9b7d-a6916c810f69 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:13.916114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3e82ab7d-01c9-48c1-9b7d-a6916c810f69 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:13.918381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3e82ab7d-01c9-48c1-9b7d-a6916c810f69 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:13.919027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3e82ab7d-01c9-48c1-9b7d-a6916c810f69 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:14.551015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3e82ab7d-01c9-48c1-9b7d-a6916c810f69 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:14.606342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3e82ab7d-01c9-48c1-9b7d-a6916c810f69 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:14.617441 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3e82ab7d-01c9-48c1-9b7d-a6916c810f69 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:14.618875 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3e82ab7d-01c9-48c1-9b7d-a6916c810f69 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1891 microversion: 2.32 time: 0.742293 Oct 29 03:00:14.626014 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1584/2982] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:13 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1891 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:14.635303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-432b225b-4626-45a7-8208-eef5013f88ed tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:14.636093 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-432b225b-4626-45a7-8208-eef5013f88ed tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 96a9fe4a-52f5-4b1f-955e-f991357b1813] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:14.636218 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-72eec478-e55c-4482-9245-4b1a1d5c1dbd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:14.652439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-432b225b-4626-45a7-8208-eef5013f88ed tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:14.653187 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-432b225b-4626-45a7-8208-eef5013f88ed tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:14.653875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-432b225b-4626-45a7-8208-eef5013f88ed tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:14.654553 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-432b225b-4626-45a7-8208-eef5013f88ed tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:14.655202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-432b225b-4626-45a7-8208-eef5013f88ed tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:14.662855 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-72eec478-e55c-4482-9245-4b1a1d5c1dbd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:14.663821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-432b225b-4626-45a7-8208-eef5013f88ed tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:14.665985 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-72eec478-e55c-4482-9245-4b1a1d5c1dbd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:14.668474 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-72eec478-e55c-4482-9245-4b1a1d5c1dbd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1808 microversion: 2.20 time: 0.893554 Oct 29 03:00:14.718281 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1399/2983] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:13 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1808 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:14.724095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b3f1ba19-a1c9-484f-8f02-42d96159b990 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:14.725343 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b3f1ba19-a1c9-484f-8f02-42d96159b990 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:14.733958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3f1ba19-a1c9-484f-8f02-42d96159b990 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:14.735155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3f1ba19-a1c9-484f-8f02-42d96159b990 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:14.736290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3f1ba19-a1c9-484f-8f02-42d96159b990 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:14.737996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3f1ba19-a1c9-484f-8f02-42d96159b990 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:14.739013 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3f1ba19-a1c9-484f-8f02-42d96159b990 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:14.740275 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3f1ba19-a1c9-484f-8f02-42d96159b990 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:14.969759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=14 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:15.166287 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-432b225b-4626-45a7-8208-eef5013f88ed tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:15.189291 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-432b225b-4626-45a7-8208-eef5013f88ed tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813" status: 200 len: 1320 microversion: 2.1 time: 0.558871 Oct 29 03:00:15.200652 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1585/2984] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:14 2022] GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813 => generated 1320 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:15.205756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9095534e-8ae7-46bf-9fa0-3b7407a070be tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:15.206373 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9095534e-8ae7-46bf-9fa0-3b7407a070be tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:15.219672 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9095534e-8ae7-46bf-9fa0-3b7407a070be tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:15.220657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9095534e-8ae7-46bf-9fa0-3b7407a070be tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:15.221277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9095534e-8ae7-46bf-9fa0-3b7407a070be tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:15.222013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9095534e-8ae7-46bf-9fa0-3b7407a070be tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:15.222625 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9095534e-8ae7-46bf-9fa0-3b7407a070be tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:15.223138 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9095534e-8ae7-46bf-9fa0-3b7407a070be tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:15.251143 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b3f1ba19-a1c9-484f-8f02-42d96159b990 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:15.262738 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b3f1ba19-a1c9-484f-8f02-42d96159b990 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.542953 Oct 29 03:00:15.270047 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1400/2985] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:14 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:15.283438 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7f19b0e0-c59e-4779-bdc6-0cf9aed50c73 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-728565607", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "bca2d547-c353-4bb4-a9d9-94595c523fe6"}], "block_device_mapping_v2": [{"uuid": "9739f24d-4560-45eb-92c9-535dee9a01d9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:15.388259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-7f19b0e0-c59e-4779-bdc6-0cf9aed50c73 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] validate_networks() for [('bca2d547-c353-4bb4-a9d9-94595c523fe6', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:00:15.778565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9095534e-8ae7-46bf-9fa0-3b7407a070be tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:15.793725 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9095534e-8ae7-46bf-9fa0-3b7407a070be tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81" status: 200 len: 1307 microversion: 2.1 time: 0.591816 Oct 29 03:00:15.799510 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1586/2986] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:15 2022] GET /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 => generated 1307 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:15.809655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-da241ce1-5d2b-43d2-9917-de1f3c053a50 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:15.810948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-da241ce1-5d2b-43d2-9917-de1f3c053a50 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:15.837839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da241ce1-5d2b-43d2-9917-de1f3c053a50 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:15.840828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da241ce1-5d2b-43d2-9917-de1f3c053a50 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:15.842007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da241ce1-5d2b-43d2-9917-de1f3c053a50 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:15.843573 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da241ce1-5d2b-43d2-9917-de1f3c053a50 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:15.844213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da241ce1-5d2b-43d2-9917-de1f3c053a50 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:15.845016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da241ce1-5d2b-43d2-9917-de1f3c053a50 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:16.752673 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-da241ce1-5d2b-43d2-9917-de1f3c053a50 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:16.778379 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-da241ce1-5d2b-43d2-9917-de1f3c053a50 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 200 len: 1507 microversion: 2.1 time: 0.974120 Oct 29 03:00:16.812174 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1587/2987] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:15 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 1507 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:16.827050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c8a46455-39cf-41e1-862b-8e3a69e98938 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:16.828213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c8a46455-39cf-41e1-862b-8e3a69e98938 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 64ddcc27-6199-4c71-b146-9de979843bbb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:16.845043 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-c8a46455-39cf-41e1-862b-8e3a69e98938 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Instance 64ddcc27-6199-4c71-b146-9de979843bbb could not be found. Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c8a46455-39cf-41e1-862b-8e3a69e98938 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers/64ddcc27-6199-4c71-b146-9de979843bbb/action HTTP/1.1 Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 15 Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: {"unpause": {}} Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 64ddcc27-6199-4c71-b146-9de979843bbb could not be found. Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '64ddcc27-6199-4c71-b146-9de979843bbb', 'body': {'unpause': {}}} Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64ddcc27-6199-4c71-b146-9de979843bbb could not be found. Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64ddcc27-6199-4c71-b146-9de979843bbb could not be found. Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:16.848978 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:16.857207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:00:16.857207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:00:16.857207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64ddcc27-6199-4c71-b146-9de979843bbb could not be found. Oct 29 03:00:16.857207 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:16.863795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c8a46455-39cf-41e1-862b-8e3a69e98938 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 404 to user: Instance 64ddcc27-6199-4c71-b146-9de979843bbb could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:16.867576 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c8a46455-39cf-41e1-862b-8e3a69e98938 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers/64ddcc27-6199-4c71-b146-9de979843bbb/action" status: 404 len: 111 microversion: 2.1 time: 0.051101 Oct 29 03:00:16.874835 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1588/2988] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:00:16 2022] POST /compute/v2.1/servers/64ddcc27-6199-4c71-b146-9de979843bbb/action => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:00:16.885411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-146711fe-87b4-4980-871c-4178e8906379 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:16.886557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-146711fe-87b4-4980-871c-4178e8906379 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:16.899844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-146711fe-87b4-4980-871c-4178e8906379 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:16.901334 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-146711fe-87b4-4980-871c-4178e8906379 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:16.902513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-146711fe-87b4-4980-871c-4178e8906379 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:16.903687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-146711fe-87b4-4980-871c-4178e8906379 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:16.904762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-146711fe-87b4-4980-871c-4178e8906379 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:16.905900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-146711fe-87b4-4980-871c-4178e8906379 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:17.048984 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-7f19b0e0-c59e-4779-bdc6-0cf9aed50c73 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:00:17.049752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-7f19b0e0-c59e-4779-bdc6-0cf9aed50c73 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:00:17.052758 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-7f19b0e0-c59e-4779-bdc6-0cf9aed50c73 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:00:17.053465 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-7f19b0e0-c59e-4779-bdc6-0cf9aed50c73 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:00:17.054338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-7f19b0e0-c59e-4779-bdc6-0cf9aed50c73 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:00:17.102254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f19b0e0-c59e-4779-bdc6-0cf9aed50c73 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:17.105606 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f19b0e0-c59e-4779-bdc6-0cf9aed50c73 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:17.106300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f19b0e0-c59e-4779-bdc6-0cf9aed50c73 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:17.109832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f19b0e0-c59e-4779-bdc6-0cf9aed50c73 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:17.110549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f19b0e0-c59e-4779-bdc6-0cf9aed50c73 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:17.111149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f19b0e0-c59e-4779-bdc6-0cf9aed50c73 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:17.142647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:17.157775 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-7f19b0e0-c59e-4779-bdc6-0cf9aed50c73 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Getting quotas for project cb1c877c178847ad8e652dda9a20e724. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:00:17.174166 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-7f19b0e0-c59e-4779-bdc6-0cf9aed50c73 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Getting quotas for user 68198185a8314417b2b5d09e831ff4fd and project cb1c877c178847ad8e652dda9a20e724. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:00:17.349183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7f19b0e0-c59e-4779-bdc6-0cf9aed50c73 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:00:17.351333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7f19b0e0-c59e-4779-bdc6-0cf9aed50c73 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9739f24d-4560-45eb-92c9-535dee9a01d9',volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:00:17.611151 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7f19b0e0-c59e-4779-bdc6-0cf9aed50c73 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.338775 Oct 29 03:00:17.619562 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1401/2989] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:00:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:00:17.625246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-93766eb3-6534-4a82-8a77-ab57013b4a69 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:17.626604 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-93766eb3-6534-4a82-8a77-ab57013b4a69 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:17.635116 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93766eb3-6534-4a82-8a77-ab57013b4a69 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:17.635910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93766eb3-6534-4a82-8a77-ab57013b4a69 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:17.646893 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93766eb3-6534-4a82-8a77-ab57013b4a69 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:17.648642 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93766eb3-6534-4a82-8a77-ab57013b4a69 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:17.650552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93766eb3-6534-4a82-8a77-ab57013b4a69 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:17.651017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93766eb3-6534-4a82-8a77-ab57013b4a69 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:17.732954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-146711fe-87b4-4980-871c-4178e8906379 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:17.752236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-146711fe-87b4-4980-871c-4178e8906379 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:17.753810 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-146711fe-87b4-4980-871c-4178e8906379 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:17.765748 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-146711fe-87b4-4980-871c-4178e8906379 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1891 microversion: 2.32 time: 0.878834 Oct 29 03:00:17.766616 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1589/2990] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:16 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1891 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:17.788316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-e6e490f0-983e-4987-939e-d8a438bf34be req-dd1a5edb-e699-4e89-9436-11c78dde0ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c72534eb-1844-4208-b625-ea8b5ece8108", "tag": "3feb2664-749f-4176-9acc-3d1f17ebbb83"}, {"name": "network-changed", "server_uuid": "1ab56816-cc78-4e73-918a-4c76895fed6b", "tag": "dbe9ee0b-c11e-4edb-a1e4-5c86a11499da"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:17.802705 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e6e490f0-983e-4987-939e-d8a438bf34be req-dd1a5edb-e699-4e89-9436-11c78dde0ed7 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:17.803490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e6e490f0-983e-4987-939e-d8a438bf34be req-dd1a5edb-e699-4e89-9436-11c78dde0ed7 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:17.804077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e6e490f0-983e-4987-939e-d8a438bf34be req-dd1a5edb-e699-4e89-9436-11c78dde0ed7 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:17.820025 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-e6e490f0-983e-4987-939e-d8a438bf34be req-dd1a5edb-e699-4e89-9436-11c78dde0ed7 service nova] Creating event network-changed:3feb2664-749f-4176-9acc-3d1f17ebbb83 for instance c72534eb-1844-4208-b625-ea8b5ece8108 on n-h1-862967-2 Oct 29 03:00:17.821735 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-e6e490f0-983e-4987-939e-d8a438bf34be req-dd1a5edb-e699-4e89-9436-11c78dde0ed7 service nova] Creating event network-changed:dbe9ee0b-c11e-4edb-a1e4-5c86a11499da for instance 1ab56816-cc78-4e73-918a-4c76895fed6b on n-h1-862967-2 Oct 29 03:00:17.831621 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-e6e490f0-983e-4987-939e-d8a438bf34be req-dd1a5edb-e699-4e89-9436-11c78dde0ed7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.047923 Oct 29 03:00:17.832917 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1590/2991] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:17.838521 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eedba209-b959-4ad1-bd20-5553bb2eb702 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:17.840364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-eedba209-b959-4ad1-bd20-5553bb2eb702 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 96a9fe4a-52f5-4b1f-955e-f991357b1813] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:17.847672 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eedba209-b959-4ad1-bd20-5553bb2eb702 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:17.848432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eedba209-b959-4ad1-bd20-5553bb2eb702 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:17.849639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eedba209-b959-4ad1-bd20-5553bb2eb702 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:17.850996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eedba209-b959-4ad1-bd20-5553bb2eb702 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:17.851616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eedba209-b959-4ad1-bd20-5553bb2eb702 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:17.852210 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eedba209-b959-4ad1-bd20-5553bb2eb702 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:18.721723 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-93766eb3-6534-4a82-8a77-ab57013b4a69 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:18.754715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-93766eb3-6534-4a82-8a77-ab57013b4a69 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:18.774293 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-93766eb3-6534-4a82-8a77-ab57013b4a69 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:18.782143 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-93766eb3-6534-4a82-8a77-ab57013b4a69 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1808 microversion: 2.20 time: 1.160922 Oct 29 03:00:18.782933 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1402/2992] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:17 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1808 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:18.803048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-d6203e4d-2bff-4764-b104-515bbd5aa714 req-ecaef565-8f7e-49db-a6b2-5920a4f14c37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dfcfa12-5d6b-4eda-973a-3be37b2f8a81", "tag": "4e35aeb0-0116-4e55-9d8d-f325c7156e3c"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:18.847683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-eedba209-b959-4ad1-bd20-5553bb2eb702 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:18.861273 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d6203e4d-2bff-4764-b104-515bbd5aa714 req-ecaef565-8f7e-49db-a6b2-5920a4f14c37 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:18.870832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d6203e4d-2bff-4764-b104-515bbd5aa714 req-ecaef565-8f7e-49db-a6b2-5920a4f14c37 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:18.874410 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eedba209-b959-4ad1-bd20-5553bb2eb702 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813" status: 200 len: 1320 microversion: 2.1 time: 1.039720 Oct 29 03:00:18.875367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d6203e4d-2bff-4764-b104-515bbd5aa714 req-ecaef565-8f7e-49db-a6b2-5920a4f14c37 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:18.886632 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1591/2993] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:17 2022] GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813 => generated 1320 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:18.921618 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-56340b1c-f684-48ba-958c-5f42b4204a2e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:18.931551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-56340b1c-f684-48ba-958c-5f42b4204a2e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:18.957245 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-d6203e4d-2bff-4764-b104-515bbd5aa714 req-ecaef565-8f7e-49db-a6b2-5920a4f14c37 service nova] Creating event network-changed:4e35aeb0-0116-4e55-9d8d-f325c7156e3c for instance 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 on n-h2-862967-2 Oct 29 03:00:18.976465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56340b1c-f684-48ba-958c-5f42b4204a2e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:18.987614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56340b1c-f684-48ba-958c-5f42b4204a2e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:18.991326 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56340b1c-f684-48ba-958c-5f42b4204a2e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:18.993157 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-d6203e4d-2bff-4764-b104-515bbd5aa714 req-ecaef565-8f7e-49db-a6b2-5920a4f14c37 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208825 Oct 29 03:00:18.994294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56340b1c-f684-48ba-958c-5f42b4204a2e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:18.996356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56340b1c-f684-48ba-958c-5f42b4204a2e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:18.997372 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1403/2994] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:18.998162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56340b1c-f684-48ba-958c-5f42b4204a2e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:19.021391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-41d51be9-1a6f-4090-a949-aa876d2a805c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:19.031614 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-41d51be9-1a6f-4090-a949-aa876d2a805c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:19.097142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41d51be9-1a6f-4090-a949-aa876d2a805c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:19.099536 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41d51be9-1a6f-4090-a949-aa876d2a805c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:19.103366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41d51be9-1a6f-4090-a949-aa876d2a805c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:19.104998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41d51be9-1a6f-4090-a949-aa876d2a805c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:19.110781 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41d51be9-1a6f-4090-a949-aa876d2a805c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:19.111926 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41d51be9-1a6f-4090-a949-aa876d2a805c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:19.662066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-56340b1c-f684-48ba-958c-5f42b4204a2e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:19.687404 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-56340b1c-f684-48ba-958c-5f42b4204a2e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81" status: 200 len: 1307 microversion: 2.1 time: 0.797656 Oct 29 03:00:19.688256 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1592/2995] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:18 2022] GET /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 => generated 1307 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:19.693282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-91099bab-7d38-403c-b873-e7d952e0e25b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:19.694513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-91099bab-7d38-403c-b873-e7d952e0e25b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:19.714200 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:19.716823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91099bab-7d38-403c-b873-e7d952e0e25b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:19.728158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91099bab-7d38-403c-b873-e7d952e0e25b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:19.729006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91099bab-7d38-403c-b873-e7d952e0e25b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:19.730129 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91099bab-7d38-403c-b873-e7d952e0e25b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:19.730859 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91099bab-7d38-403c-b873-e7d952e0e25b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:19.731554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91099bab-7d38-403c-b873-e7d952e0e25b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:19.827261 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-41d51be9-1a6f-4090-a949-aa876d2a805c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:19.869505 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-41d51be9-1a6f-4090-a949-aa876d2a805c tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.861741 Oct 29 03:00:19.876663 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1404/2996] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:19 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:19.901395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-91099bab-7d38-403c-b873-e7d952e0e25b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:19.918803 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-91099bab-7d38-403c-b873-e7d952e0e25b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1150 microversion: 2.1 time: 0.229235 Oct 29 03:00:19.919041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-def81241-ee0c-419b-bcec-022cda530483 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:19.921749 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1593/2997] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:19 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1150 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:19.934955 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2228ad8f-1b7a-491b-a108-7d8a843c72c4 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:19.935936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-def81241-ee0c-419b-bcec-022cda530483 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:19.942221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2228ad8f-1b7a-491b-a108-7d8a843c72c4 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:19.943180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-def81241-ee0c-419b-bcec-022cda530483 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:19.943956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-def81241-ee0c-419b-bcec-022cda530483 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:19.944644 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-def81241-ee0c-419b-bcec-022cda530483 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:19.945579 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-def81241-ee0c-419b-bcec-022cda530483 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:19.946433 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-def81241-ee0c-419b-bcec-022cda530483 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:19.947140 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-def81241-ee0c-419b-bcec-022cda530483 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:19.964058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2228ad8f-1b7a-491b-a108-7d8a843c72c4 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:19.971525 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2228ad8f-1b7a-491b-a108-7d8a843c72c4 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:19.973344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2228ad8f-1b7a-491b-a108-7d8a843c72c4 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:19.975474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2228ad8f-1b7a-491b-a108-7d8a843c72c4 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:19.981091 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2228ad8f-1b7a-491b-a108-7d8a843c72c4 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:19.985497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2228ad8f-1b7a-491b-a108-7d8a843c72c4 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:20.854315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2228ad8f-1b7a-491b-a108-7d8a843c72c4 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:20.897954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2228ad8f-1b7a-491b-a108-7d8a843c72c4 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:20.902939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2228ad8f-1b7a-491b-a108-7d8a843c72c4 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:20.904936 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2228ad8f-1b7a-491b-a108-7d8a843c72c4 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1891 microversion: 2.32 time: 0.981954 Oct 29 03:00:20.915123 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1594/2998] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:19 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1891 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:20.922709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bf2ef342-9245-4c79-9595-7f04a84612ae tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:20.923643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bf2ef342-9245-4c79-9595-7f04a84612ae tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:20.938632 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf2ef342-9245-4c79-9595-7f04a84612ae tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:20.944231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf2ef342-9245-4c79-9595-7f04a84612ae tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:20.944987 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf2ef342-9245-4c79-9595-7f04a84612ae tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:20.945982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf2ef342-9245-4c79-9595-7f04a84612ae tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:20.947070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf2ef342-9245-4c79-9595-7f04a84612ae tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:20.947833 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf2ef342-9245-4c79-9595-7f04a84612ae tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:21.009602 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=100 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:21.542059 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bf2ef342-9245-4c79-9595-7f04a84612ae tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:21.562495 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bf2ef342-9245-4c79-9595-7f04a84612ae tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:21.567994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bf2ef342-9245-4c79-9595-7f04a84612ae tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:21.575331 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bf2ef342-9245-4c79-9595-7f04a84612ae tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1808 microversion: 2.20 time: 0.657010 Oct 29 03:00:21.584646 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1595/2999] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:20 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1808 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:21.589483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4518b253-e136-4af2-b90a-7a875c03d290 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:21.591796 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4518b253-e136-4af2-b90a-7a875c03d290 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 96a9fe4a-52f5-4b1f-955e-f991357b1813] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:21.606314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4518b253-e136-4af2-b90a-7a875c03d290 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:21.608448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4518b253-e136-4af2-b90a-7a875c03d290 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:21.609499 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4518b253-e136-4af2-b90a-7a875c03d290 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:21.610478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4518b253-e136-4af2-b90a-7a875c03d290 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:21.611377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4518b253-e136-4af2-b90a-7a875c03d290 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:21.611858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4518b253-e136-4af2-b90a-7a875c03d290 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:22.146108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4518b253-e136-4af2-b90a-7a875c03d290 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:22.168084 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4518b253-e136-4af2-b90a-7a875c03d290 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813" status: 200 len: 1320 microversion: 2.1 time: 0.586632 Oct 29 03:00:22.171869 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1596/3000] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:21 2022] GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813 => generated 1320 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:22.190168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-14500102-38bb-4143-98ef-6aaf1b91c268 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:22.191667 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-14500102-38bb-4143-98ef-6aaf1b91c268 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:22.213718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14500102-38bb-4143-98ef-6aaf1b91c268 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:22.217924 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14500102-38bb-4143-98ef-6aaf1b91c268 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:22.219041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14500102-38bb-4143-98ef-6aaf1b91c268 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:22.227652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14500102-38bb-4143-98ef-6aaf1b91c268 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:22.228743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14500102-38bb-4143-98ef-6aaf1b91c268 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:22.231087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14500102-38bb-4143-98ef-6aaf1b91c268 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:22.346965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-def81241-ee0c-419b-bcec-022cda530483 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:22.370492 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-def81241-ee0c-419b-bcec-022cda530483 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 200 len: 1507 microversion: 2.1 time: 2.466463 Oct 29 03:00:22.377515 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1405/3001] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:19 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 1507 bytes in 2474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:22.397673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-88fd64fb-fb30-4f69-8a29-da87acde6f38 req-18b5b89a-21cb-47fa-ab06-56d679145ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96a9fe4a-52f5-4b1f-955e-f991357b1813", "name": "network-vif-plugged", "status": "completed", "tag": "76c5f041-ee64-4474-8579-cca40e817df4"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:22.433134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-88fd64fb-fb30-4f69-8a29-da87acde6f38 req-18b5b89a-21cb-47fa-ab06-56d679145ff8 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:22.433616 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-88fd64fb-fb30-4f69-8a29-da87acde6f38 req-18b5b89a-21cb-47fa-ab06-56d679145ff8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:22.434045 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-88fd64fb-fb30-4f69-8a29-da87acde6f38 req-18b5b89a-21cb-47fa-ab06-56d679145ff8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:22.474600 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-88fd64fb-fb30-4f69-8a29-da87acde6f38 req-18b5b89a-21cb-47fa-ab06-56d679145ff8 service nova] Creating event network-vif-plugged:76c5f041-ee64-4474-8579-cca40e817df4 for instance 96a9fe4a-52f5-4b1f-955e-f991357b1813 on n-h1-862967-2 Oct 29 03:00:22.495311 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-88fd64fb-fb30-4f69-8a29-da87acde6f38 req-18b5b89a-21cb-47fa-ab06-56d679145ff8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104851 Oct 29 03:00:22.497944 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1406/3002] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:22.515768 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-b50305bb-885a-4a13-b06b-7a96144a6f49 req-de9aee1c-344c-47ef-8624-e587e7ef7365 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c72534eb-1844-4208-b625-ea8b5ece8108", "tag": "5c3d2712-9ad6-4627-8b5c-ca13b6071e0e"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:22.553555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b50305bb-885a-4a13-b06b-7a96144a6f49 req-de9aee1c-344c-47ef-8624-e587e7ef7365 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:22.556870 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b50305bb-885a-4a13-b06b-7a96144a6f49 req-de9aee1c-344c-47ef-8624-e587e7ef7365 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:22.557771 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b50305bb-885a-4a13-b06b-7a96144a6f49 req-de9aee1c-344c-47ef-8624-e587e7ef7365 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:22.605597 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-b50305bb-885a-4a13-b06b-7a96144a6f49 req-de9aee1c-344c-47ef-8624-e587e7ef7365 service nova] Creating event network-changed:5c3d2712-9ad6-4627-8b5c-ca13b6071e0e for instance c72534eb-1844-4208-b625-ea8b5ece8108 on n-h1-862967-2 Oct 29 03:00:22.621975 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-b50305bb-885a-4a13-b06b-7a96144a6f49 req-de9aee1c-344c-47ef-8624-e587e7ef7365 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114321 Oct 29 03:00:22.623332 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1407/3003] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:22.631407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-75a06ccf-9fb3-4b55-ba1e-4566ab849df7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:22.633144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-75a06ccf-9fb3-4b55-ba1e-4566ab849df7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:22.643277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75a06ccf-9fb3-4b55-ba1e-4566ab849df7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:22.644537 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75a06ccf-9fb3-4b55-ba1e-4566ab849df7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:22.645208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75a06ccf-9fb3-4b55-ba1e-4566ab849df7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:22.646283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75a06ccf-9fb3-4b55-ba1e-4566ab849df7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:22.648241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75a06ccf-9fb3-4b55-ba1e-4566ab849df7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:22.648947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75a06ccf-9fb3-4b55-ba1e-4566ab849df7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:22.655923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:22.958278 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-14500102-38bb-4143-98ef-6aaf1b91c268 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:22.972817 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-14500102-38bb-4143-98ef-6aaf1b91c268 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.791619 Oct 29 03:00:23.003381 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1597/3004] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:22 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:23.009100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3ce0fcd3-ea26-4a60-8e78-8a91a50168df tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:23.009558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3ce0fcd3-ea26-4a60-8e78-8a91a50168df tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:23.045023 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ce0fcd3-ea26-4a60-8e78-8a91a50168df tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:23.046086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ce0fcd3-ea26-4a60-8e78-8a91a50168df tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:23.046954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ce0fcd3-ea26-4a60-8e78-8a91a50168df tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:23.048193 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ce0fcd3-ea26-4a60-8e78-8a91a50168df tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:23.049547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ce0fcd3-ea26-4a60-8e78-8a91a50168df tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:23.050525 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ce0fcd3-ea26-4a60-8e78-8a91a50168df tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:23.243580 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3ce0fcd3-ea26-4a60-8e78-8a91a50168df tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:23.260016 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3ce0fcd3-ea26-4a60-8e78-8a91a50168df tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1168 microversion: 2.1 time: 0.255236 Oct 29 03:00:23.280844 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1598/3005] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:23 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1168 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:23.287662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-89f27be4-595f-4b1c-b81b-732c68a63789 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:23.289138 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-89f27be4-595f-4b1c-b81b-732c68a63789 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:23.300668 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89f27be4-595f-4b1c-b81b-732c68a63789 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:23.302097 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89f27be4-595f-4b1c-b81b-732c68a63789 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:23.302832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89f27be4-595f-4b1c-b81b-732c68a63789 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:23.303762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89f27be4-595f-4b1c-b81b-732c68a63789 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:23.304712 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89f27be4-595f-4b1c-b81b-732c68a63789 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:23.305528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89f27be4-595f-4b1c-b81b-732c68a63789 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:23.530967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-75a06ccf-9fb3-4b55-ba1e-4566ab849df7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:23.553349 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-75a06ccf-9fb3-4b55-ba1e-4566ab849df7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81" status: 200 len: 1307 microversion: 2.1 time: 0.926256 Oct 29 03:00:23.589717 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1408/3006] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:22 2022] GET /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 => generated 1307 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:23.605722 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-82d17fca-3dab-45cf-89e0-f07f8962d2dd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:23.606794 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-82d17fca-3dab-45cf-89e0-f07f8962d2dd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:23.620888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-82d17fca-3dab-45cf-89e0-f07f8962d2dd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:23.622755 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-82d17fca-3dab-45cf-89e0-f07f8962d2dd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:23.624420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-82d17fca-3dab-45cf-89e0-f07f8962d2dd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:23.626389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-82d17fca-3dab-45cf-89e0-f07f8962d2dd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:23.627241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-82d17fca-3dab-45cf-89e0-f07f8962d2dd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:23.629048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-82d17fca-3dab-45cf-89e0-f07f8962d2dd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:23.814410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-89f27be4-595f-4b1c-b81b-732c68a63789 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:23.824154 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-89f27be4-595f-4b1c-b81b-732c68a63789 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:23.825651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-89f27be4-595f-4b1c-b81b-732c68a63789 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:23.826852 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-89f27be4-595f-4b1c-b81b-732c68a63789 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1879 microversion: 2.32 time: 0.544389 Oct 29 03:00:23.841580 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1599/3007] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:23 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1879 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:23.873346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ca19e23a-9cb3-4461-a32f-8b07b32fb28a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:23.876154 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ca19e23a-9cb3-4461-a32f-8b07b32fb28a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:23.894277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca19e23a-9cb3-4461-a32f-8b07b32fb28a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:23.907963 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca19e23a-9cb3-4461-a32f-8b07b32fb28a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:23.908448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca19e23a-9cb3-4461-a32f-8b07b32fb28a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:23.910348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca19e23a-9cb3-4461-a32f-8b07b32fb28a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:23.910856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca19e23a-9cb3-4461-a32f-8b07b32fb28a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:23.913974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca19e23a-9cb3-4461-a32f-8b07b32fb28a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:23.993325 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-ca19e23a-9cb3-4461-a32f-8b07b32fb28a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Cannot 'unpause' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state active Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ca19e23a-9cb3-4461-a32f-8b07b32fb28a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action HTTP/1.1 Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 15 Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: {"unpause": {}} Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: exception: Cannot 'unpause' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state active Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '5d9854a1-ead6-4570-b801-13c47d0bf721', 'body': {'unpause': {}}} Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5d9854a1-ead6-4570-b801-13c47d0bf721 in vm_state active. Cannot unpause while the instance is in this state. Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state active Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:23.997247 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:24.001629 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:24.001629 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:00:24.001629 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:00:24.001629 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state active Oct 29 03:00:24.001629 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:24.004884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ca19e23a-9cb3-4461-a32f-8b07b32fb28a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 409 to user: Cannot 'unpause' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state active {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:24.006790 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ca19e23a-9cb3-4461-a32f-8b07b32fb28a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action" status: 409 len: 145 microversion: 2.1 time: 0.163547 Oct 29 03:00:24.012410 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1600/3008] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:00:23 2022] POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action => generated 145 bytes in 170 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:00:24.025210 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-12a25449-6a7c-49ac-ab81-1aa1e4bf4379 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:24.026444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-12a25449-6a7c-49ac-ab81-1aa1e4bf4379 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 96a9fe4a-52f5-4b1f-955e-f991357b1813] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:24.036012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12a25449-6a7c-49ac-ab81-1aa1e4bf4379 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:24.037176 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12a25449-6a7c-49ac-ab81-1aa1e4bf4379 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:24.039162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12a25449-6a7c-49ac-ab81-1aa1e4bf4379 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:24.040347 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12a25449-6a7c-49ac-ab81-1aa1e4bf4379 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:24.041048 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12a25449-6a7c-49ac-ab81-1aa1e4bf4379 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:24.041695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12a25449-6a7c-49ac-ab81-1aa1e4bf4379 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:24.076112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-82d17fca-3dab-45cf-89e0-f07f8962d2dd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:24.087262 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-82d17fca-3dab-45cf-89e0-f07f8962d2dd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:24.088764 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-82d17fca-3dab-45cf-89e0-f07f8962d2dd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:24.089979 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-82d17fca-3dab-45cf-89e0-f07f8962d2dd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1808 microversion: 2.20 time: 0.497305 Oct 29 03:00:24.090564 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1409/3009] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:23 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1808 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:24.119998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b81de9c3-3d0c-4ad3-907e-a22ab971939a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:24.139912 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b81de9c3-3d0c-4ad3-907e-a22ab971939a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:24.165646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b81de9c3-3d0c-4ad3-907e-a22ab971939a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:24.166161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b81de9c3-3d0c-4ad3-907e-a22ab971939a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:24.166592 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b81de9c3-3d0c-4ad3-907e-a22ab971939a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:24.175944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b81de9c3-3d0c-4ad3-907e-a22ab971939a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:24.176848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b81de9c3-3d0c-4ad3-907e-a22ab971939a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:24.177813 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b81de9c3-3d0c-4ad3-907e-a22ab971939a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:24.439633 n-d-862967-2 devstack@n-api.service[127124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:00:24.440267 n-d-862967-2 devstack@n-api.service[127124]: Sat Oct 29 03:00:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813 (ip 10.222.0.46) !!! Oct 29 03:00:24.717913 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b81de9c3-3d0c-4ad3-907e-a22ab971939a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:24.727482 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b81de9c3-3d0c-4ad3-907e-a22ab971939a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 200 len: 1507 microversion: 2.1 time: 0.614393 Oct 29 03:00:24.733489 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1410/3010] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:24 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 1507 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:24.739912 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-58be6a33-3fdf-4cb6-b62f-dedf42e58604 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:24.750947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-58be6a33-3fdf-4cb6-b62f-dedf42e58604 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:24.767082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58be6a33-3fdf-4cb6-b62f-dedf42e58604 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:24.767955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58be6a33-3fdf-4cb6-b62f-dedf42e58604 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:24.768603 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58be6a33-3fdf-4cb6-b62f-dedf42e58604 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:24.769512 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58be6a33-3fdf-4cb6-b62f-dedf42e58604 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:24.770175 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58be6a33-3fdf-4cb6-b62f-dedf42e58604 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:24.770771 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58be6a33-3fdf-4cb6-b62f-dedf42e58604 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:25.200913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-12a25449-6a7c-49ac-ab81-1aa1e4bf4379 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:25.226522 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-12a25449-6a7c-49ac-ab81-1aa1e4bf4379 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813" status: 200 len: 1320 microversion: 2.1 time: 1.211825 Oct 29 03:00:25.231965 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1601/3011] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:24 2022] GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813 => generated 1320 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:25.237835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7197ff6d-658e-45be-9fdb-4b86612709c1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:25.243095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7197ff6d-658e-45be-9fdb-4b86612709c1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:25.261115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-58be6a33-3fdf-4cb6-b62f-dedf42e58604 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:25.271400 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-58be6a33-3fdf-4cb6-b62f-dedf42e58604 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.535787 Oct 29 03:00:25.276105 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1411/3012] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:24 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:25.287445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-efe80a69-6db7-4fc4-b2e6-e74689367ad0 req-d7f1966b-f698-48ac-8d67-6caea0778508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a", "name": "network-vif-plugged", "status": "completed", "tag": "faae8e87-aa37-4d42-93da-4b5b661b44e5"}, {"server_uuid": "8dfcfa12-5d6b-4eda-973a-3be37b2f8a81", "name": "network-vif-plugged", "status": "completed", "tag": "4e35aeb0-0116-4e55-9d8d-f325c7156e3c"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:25.300254 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7197ff6d-658e-45be-9fdb-4b86612709c1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:25.306173 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7197ff6d-658e-45be-9fdb-4b86612709c1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:25.309622 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7197ff6d-658e-45be-9fdb-4b86612709c1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:25.311282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7197ff6d-658e-45be-9fdb-4b86612709c1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:25.315368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-efe80a69-6db7-4fc4-b2e6-e74689367ad0 req-d7f1966b-f698-48ac-8d67-6caea0778508 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:25.315924 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7197ff6d-658e-45be-9fdb-4b86612709c1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:25.317284 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7197ff6d-658e-45be-9fdb-4b86612709c1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:25.325637 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-efe80a69-6db7-4fc4-b2e6-e74689367ad0 req-d7f1966b-f698-48ac-8d67-6caea0778508 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:25.326430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-efe80a69-6db7-4fc4-b2e6-e74689367ad0 req-d7f1966b-f698-48ac-8d67-6caea0778508 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:25.363391 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-efe80a69-6db7-4fc4-b2e6-e74689367ad0 req-d7f1966b-f698-48ac-8d67-6caea0778508 service nova] Creating event network-vif-plugged:faae8e87-aa37-4d42-93da-4b5b661b44e5 for instance 4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a on n-h2-862967-2 Oct 29 03:00:25.365086 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-efe80a69-6db7-4fc4-b2e6-e74689367ad0 req-d7f1966b-f698-48ac-8d67-6caea0778508 service nova] Creating event network-vif-plugged:4e35aeb0-0116-4e55-9d8d-f325c7156e3c for instance 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 on n-h2-862967-2 Oct 29 03:00:25.377752 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-efe80a69-6db7-4fc4-b2e6-e74689367ad0 req-d7f1966b-f698-48ac-8d67-6caea0778508 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.097485 Oct 29 03:00:25.378813 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1412/3013] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:25.384657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dc5685f2-ade2-4500-8c33-244f1e21f3bd tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:25.385425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dc5685f2-ade2-4500-8c33-244f1e21f3bd tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:25.394100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc5685f2-ade2-4500-8c33-244f1e21f3bd tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:25.394591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc5685f2-ade2-4500-8c33-244f1e21f3bd tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:25.395149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc5685f2-ade2-4500-8c33-244f1e21f3bd tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:25.395908 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc5685f2-ade2-4500-8c33-244f1e21f3bd tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:25.396576 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc5685f2-ade2-4500-8c33-244f1e21f3bd tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:25.397177 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc5685f2-ade2-4500-8c33-244f1e21f3bd tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:25.833901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dc5685f2-ade2-4500-8c33-244f1e21f3bd tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:25.843656 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dc5685f2-ade2-4500-8c33-244f1e21f3bd tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81" status: 200 len: 1307 microversion: 2.1 time: 0.463402 Oct 29 03:00:25.849594 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1413/3014] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:25 2022] GET /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 => generated 1307 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:25.861612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-2bade199-2062-43d1-8f5a-c3d595dc3b21 req-f4df2427-946a-4b4f-ab57-af055d42389a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c72534eb-1844-4208-b625-ea8b5ece8108", "tag": "4c67f638-2ba1-48d4-80b9-c0539cebe183"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:25.879335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2bade199-2062-43d1-8f5a-c3d595dc3b21 req-f4df2427-946a-4b4f-ab57-af055d42389a service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:25.884292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2bade199-2062-43d1-8f5a-c3d595dc3b21 req-f4df2427-946a-4b4f-ab57-af055d42389a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:25.885051 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2bade199-2062-43d1-8f5a-c3d595dc3b21 req-f4df2427-946a-4b4f-ab57-af055d42389a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:25.960790 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-2bade199-2062-43d1-8f5a-c3d595dc3b21 req-f4df2427-946a-4b4f-ab57-af055d42389a service nova] Creating event network-changed:4c67f638-2ba1-48d4-80b9-c0539cebe183 for instance c72534eb-1844-4208-b625-ea8b5ece8108 on n-h1-862967-2 Oct 29 03:00:25.977245 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-2bade199-2062-43d1-8f5a-c3d595dc3b21 req-f4df2427-946a-4b4f-ab57-af055d42389a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125800 Oct 29 03:00:25.978292 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1414/3015] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:26.018996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bd06e2a4-a3e7-4e8c-9cd0-b21ab39a49cb tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:26.022598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bd06e2a4-a3e7-4e8c-9cd0-b21ab39a49cb tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:26.058714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd06e2a4-a3e7-4e8c-9cd0-b21ab39a49cb tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:26.059564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd06e2a4-a3e7-4e8c-9cd0-b21ab39a49cb tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:26.060312 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd06e2a4-a3e7-4e8c-9cd0-b21ab39a49cb tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:26.067463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd06e2a4-a3e7-4e8c-9cd0-b21ab39a49cb tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:26.068328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd06e2a4-a3e7-4e8c-9cd0-b21ab39a49cb tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:26.069123 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd06e2a4-a3e7-4e8c-9cd0-b21ab39a49cb tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:26.239051 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7197ff6d-658e-45be-9fdb-4b86612709c1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:26.256131 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7197ff6d-658e-45be-9fdb-4b86612709c1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1210 microversion: 2.1 time: 1.021322 Oct 29 03:00:26.258949 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1602/3016] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:25 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1210 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:26.275090 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-945b75e5-0877-4d1e-b29a-27ee753ce6c3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:26.276305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-945b75e5-0877-4d1e-b29a-27ee753ce6c3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:26.294159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-945b75e5-0877-4d1e-b29a-27ee753ce6c3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:26.296246 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-945b75e5-0877-4d1e-b29a-27ee753ce6c3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:26.297893 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-945b75e5-0877-4d1e-b29a-27ee753ce6c3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:26.298971 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-945b75e5-0877-4d1e-b29a-27ee753ce6c3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:26.301543 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-945b75e5-0877-4d1e-b29a-27ee753ce6c3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:26.302229 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-945b75e5-0877-4d1e-b29a-27ee753ce6c3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:26.571118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bd06e2a4-a3e7-4e8c-9cd0-b21ab39a49cb tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:26.588498 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bd06e2a4-a3e7-4e8c-9cd0-b21ab39a49cb tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:26.593844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bd06e2a4-a3e7-4e8c-9cd0-b21ab39a49cb tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:26.594390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-945b75e5-0877-4d1e-b29a-27ee753ce6c3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:26.595655 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bd06e2a4-a3e7-4e8c-9cd0-b21ab39a49cb tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1879 microversion: 2.32 time: 0.598484 Oct 29 03:00:26.598681 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1415/3017] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:25 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1879 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:26.611779 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a6bc4d44-4757-4338-88e1-66614e23097d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:26.612748 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a6bc4d44-4757-4338-88e1-66614e23097d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:26.618666 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-945b75e5-0877-4d1e-b29a-27ee753ce6c3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:26.626614 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6bc4d44-4757-4338-88e1-66614e23097d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:26.626862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-945b75e5-0877-4d1e-b29a-27ee753ce6c3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:26.631188 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-945b75e5-0877-4d1e-b29a-27ee753ce6c3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1808 microversion: 2.20 time: 0.369015 Oct 29 03:00:26.631635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6bc4d44-4757-4338-88e1-66614e23097d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:26.632348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6bc4d44-4757-4338-88e1-66614e23097d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:26.633706 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6bc4d44-4757-4338-88e1-66614e23097d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:26.634544 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1603/3018] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:26 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1808 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:26.635462 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6bc4d44-4757-4338-88e1-66614e23097d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:26.637354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6bc4d44-4757-4338-88e1-66614e23097d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:26.659545 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e9b939d3-5071-484f-be59-9e6c15f81325 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:26.661785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e9b939d3-5071-484f-be59-9e6c15f81325 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:26.680000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9b939d3-5071-484f-be59-9e6c15f81325 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:26.684105 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9b939d3-5071-484f-be59-9e6c15f81325 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:26.686168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9b939d3-5071-484f-be59-9e6c15f81325 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:26.703232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9b939d3-5071-484f-be59-9e6c15f81325 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:26.706102 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9b939d3-5071-484f-be59-9e6c15f81325 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:26.706773 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9b939d3-5071-484f-be59-9e6c15f81325 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:27.125456 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a6bc4d44-4757-4338-88e1-66614e23097d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:27.139974 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a6bc4d44-4757-4338-88e1-66614e23097d tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.539649 Oct 29 03:00:27.146801 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1416/3019] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:26 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:27.152125 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-64cb90b3-e0dd-4b18-b97d-39af4247a9c2 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:27.158554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-64cb90b3-e0dd-4b18-b97d-39af4247a9c2 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 96a9fe4a-52f5-4b1f-955e-f991357b1813] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:27.160352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e9b939d3-5071-484f-be59-9e6c15f81325 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:27.178955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:27.181561 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e9b939d3-5071-484f-be59-9e6c15f81325 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 200 len: 1507 microversion: 2.1 time: 0.536772 Oct 29 03:00:27.181882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64cb90b3-e0dd-4b18-b97d-39af4247a9c2 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:27.183292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64cb90b3-e0dd-4b18-b97d-39af4247a9c2 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:27.184007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64cb90b3-e0dd-4b18-b97d-39af4247a9c2 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:27.185767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64cb90b3-e0dd-4b18-b97d-39af4247a9c2 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:27.186497 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1604/3020] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:26 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 1507 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:27.188289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64cb90b3-e0dd-4b18-b97d-39af4247a9c2 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:27.189563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64cb90b3-e0dd-4b18-b97d-39af4247a9c2 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:27.195585 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:27.204133 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4d1f0666-1313-4752-893d-8e50d610fa0f tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:27.204794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4d1f0666-1313-4752-893d-8e50d610fa0f tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:27.263510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d1f0666-1313-4752-893d-8e50d610fa0f tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:27.279012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d1f0666-1313-4752-893d-8e50d610fa0f tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:27.288642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d1f0666-1313-4752-893d-8e50d610fa0f tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:27.294918 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d1f0666-1313-4752-893d-8e50d610fa0f tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:27.295737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d1f0666-1313-4752-893d-8e50d610fa0f tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:27.296448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d1f0666-1313-4752-893d-8e50d610fa0f tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:28.114335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4d1f0666-1313-4752-893d-8e50d610fa0f tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:28.136951 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4d1f0666-1313-4752-893d-8e50d610fa0f tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81" status: 200 len: 1307 microversion: 2.1 time: 0.946208 Oct 29 03:00:28.137770 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1605/3021] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:27 2022] GET /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 => generated 1307 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:28.142970 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3d048ddc-d41c-4e83-8c95-ab79f9d41c35 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:28.143782 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3d048ddc-d41c-4e83-8c95-ab79f9d41c35 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: b9b038b7-cba9-4282-b914-5728e1841675] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:28.149827 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-3d048ddc-d41c-4e83-8c95-ab79f9d41c35 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Instance b9b038b7-cba9-4282-b914-5728e1841675 could not be found. Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3d048ddc-d41c-4e83-8c95-ab79f9d41c35 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers/b9b038b7-cba9-4282-b914-5728e1841675/action HTTP/1.1 Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 18 Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: {"unshelve": null} Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance b9b038b7-cba9-4282-b914-5728e1841675 could not be found. Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'b9b038b7-cba9-4282-b914-5728e1841675', 'body': {'unshelve': None}} Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9b038b7-cba9-4282-b914-5728e1841675 could not be found. Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9b038b7-cba9-4282-b914-5728e1841675 could not be found. Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:28.153101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:28.157412 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:28.157412 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:28.157412 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:28.157412 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:28.157412 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:00:28.157412 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:00:28.157412 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9b038b7-cba9-4282-b914-5728e1841675 could not be found. Oct 29 03:00:28.157412 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:28.158917 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3d048ddc-d41c-4e83-8c95-ab79f9d41c35 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 404 to user: Instance b9b038b7-cba9-4282-b914-5728e1841675 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:28.159949 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3d048ddc-d41c-4e83-8c95-ab79f9d41c35 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers/b9b038b7-cba9-4282-b914-5728e1841675/action" status: 404 len: 111 microversion: 2.1 time: 0.021094 Oct 29 03:00:28.164372 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1606/3022] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:00:28 2022] POST /compute/v2.1/servers/b9b038b7-cba9-4282-b914-5728e1841675/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:00:28.170252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5075a1b3-dea9-494f-a7a7-b1ec40461091 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:28.171153 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5075a1b3-dea9-494f-a7a7-b1ec40461091 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:28.180738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5075a1b3-dea9-494f-a7a7-b1ec40461091 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:28.181628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5075a1b3-dea9-494f-a7a7-b1ec40461091 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:28.182277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5075a1b3-dea9-494f-a7a7-b1ec40461091 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:28.183365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5075a1b3-dea9-494f-a7a7-b1ec40461091 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:28.183529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-64cb90b3-e0dd-4b18-b97d-39af4247a9c2 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:28.184978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5075a1b3-dea9-494f-a7a7-b1ec40461091 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:28.186117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5075a1b3-dea9-494f-a7a7-b1ec40461091 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:28.216092 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-64cb90b3-e0dd-4b18-b97d-39af4247a9c2 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813" status: 200 len: 1512 microversion: 2.1 time: 1.067524 Oct 29 03:00:28.221833 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1417/3023] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:27 2022] GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813 => generated 1512 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:28.240204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e2a93129-d293-4868-8812-d2b02cd9ec1f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:28.242004 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e2a93129-d293-4868-8812-d2b02cd9ec1f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:28.265243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2a93129-d293-4868-8812-d2b02cd9ec1f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:28.266460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2a93129-d293-4868-8812-d2b02cd9ec1f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:28.267468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2a93129-d293-4868-8812-d2b02cd9ec1f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:28.269098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2a93129-d293-4868-8812-d2b02cd9ec1f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:28.278107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2a93129-d293-4868-8812-d2b02cd9ec1f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:28.279303 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2a93129-d293-4868-8812-d2b02cd9ec1f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:28.512753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5075a1b3-dea9-494f-a7a7-b1ec40461091 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:28.540019 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5075a1b3-dea9-494f-a7a7-b1ec40461091 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1210 microversion: 2.1 time: 0.373442 Oct 29 03:00:28.543565 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1607/3024] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:28 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1210 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:28.558508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9b12da75-640f-4d52-af24-b2668b1e2cdb tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:28.559984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9b12da75-640f-4d52-af24-b2668b1e2cdb tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:28.581812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b12da75-640f-4d52-af24-b2668b1e2cdb tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:28.583419 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b12da75-640f-4d52-af24-b2668b1e2cdb tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:28.584500 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b12da75-640f-4d52-af24-b2668b1e2cdb tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:28.586997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b12da75-640f-4d52-af24-b2668b1e2cdb tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:28.588514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b12da75-640f-4d52-af24-b2668b1e2cdb tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:28.590625 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b12da75-640f-4d52-af24-b2668b1e2cdb tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:29.395281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9b12da75-640f-4d52-af24-b2668b1e2cdb tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:29.439945 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9b12da75-640f-4d52-af24-b2668b1e2cdb tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:29.455482 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9b12da75-640f-4d52-af24-b2668b1e2cdb tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:29.463975 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9b12da75-640f-4d52-af24-b2668b1e2cdb tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1808 microversion: 2.20 time: 0.917494 Oct 29 03:00:29.469126 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1608/3025] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:28 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1808 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:29.493083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cf8df5ee-22d6-4a81-b03e-56b1d1598a56 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:29.499378 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cf8df5ee-22d6-4a81-b03e-56b1d1598a56 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:29.525929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf8df5ee-22d6-4a81-b03e-56b1d1598a56 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:29.531439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf8df5ee-22d6-4a81-b03e-56b1d1598a56 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:29.532937 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf8df5ee-22d6-4a81-b03e-56b1d1598a56 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:29.537560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf8df5ee-22d6-4a81-b03e-56b1d1598a56 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:29.540563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf8df5ee-22d6-4a81-b03e-56b1d1598a56 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:29.541982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf8df5ee-22d6-4a81-b03e-56b1d1598a56 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:29.798779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cf8df5ee-22d6-4a81-b03e-56b1d1598a56 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:29.810205 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cf8df5ee-22d6-4a81-b03e-56b1d1598a56 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.336353 Oct 29 03:00:29.830613 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1609/3026] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:29 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:29.836339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-41983066-f1bc-40ab-92e3-b48d91397fca tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:29.837198 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-41983066-f1bc-40ab-92e3-b48d91397fca tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:29.845830 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41983066-f1bc-40ab-92e3-b48d91397fca tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:29.846962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41983066-f1bc-40ab-92e3-b48d91397fca tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:29.846962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41983066-f1bc-40ab-92e3-b48d91397fca tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:29.847476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41983066-f1bc-40ab-92e3-b48d91397fca tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:29.847958 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41983066-f1bc-40ab-92e3-b48d91397fca tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:29.848551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41983066-f1bc-40ab-92e3-b48d91397fca tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:29.884721 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e2a93129-d293-4868-8812-d2b02cd9ec1f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:29.898509 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e2a93129-d293-4868-8812-d2b02cd9ec1f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:29.906898 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e2a93129-d293-4868-8812-d2b02cd9ec1f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:29.914422 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e2a93129-d293-4868-8812-d2b02cd9ec1f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1879 microversion: 2.32 time: 1.685730 Oct 29 03:00:29.915790 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1418/3027] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:28 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1879 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:29.923340 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-14e377bd-8969-4546-862f-03c7b76b5fb4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:29.927501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-14e377bd-8969-4546-862f-03c7b76b5fb4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:29.942973 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14e377bd-8969-4546-862f-03c7b76b5fb4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:29.943829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14e377bd-8969-4546-862f-03c7b76b5fb4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:29.945682 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14e377bd-8969-4546-862f-03c7b76b5fb4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:29.946729 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14e377bd-8969-4546-862f-03c7b76b5fb4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:29.949125 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14e377bd-8969-4546-862f-03c7b76b5fb4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:29.949841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14e377bd-8969-4546-862f-03c7b76b5fb4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:30.157441 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-41983066-f1bc-40ab-92e3-b48d91397fca tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:30.183586 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-41983066-f1bc-40ab-92e3-b48d91397fca tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 200 len: 1507 microversion: 2.1 time: 0.351570 Oct 29 03:00:30.186190 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1610/3028] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:29 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 1507 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:30.194713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-72d4f8e0-8390-48c2-b5cb-2cbd57ed99ff req-9933522e-ca0d-4bf4-acb9-8793c886f298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c72534eb-1844-4208-b625-ea8b5ece8108", "tag": "3febcbca-e08c-4130-ae81-3ac6a9c05e2b"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:30.212294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-72d4f8e0-8390-48c2-b5cb-2cbd57ed99ff req-9933522e-ca0d-4bf4-acb9-8793c886f298 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:30.213017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-72d4f8e0-8390-48c2-b5cb-2cbd57ed99ff req-9933522e-ca0d-4bf4-acb9-8793c886f298 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:30.213457 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-72d4f8e0-8390-48c2-b5cb-2cbd57ed99ff req-9933522e-ca0d-4bf4-acb9-8793c886f298 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:30.264938 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-72d4f8e0-8390-48c2-b5cb-2cbd57ed99ff req-9933522e-ca0d-4bf4-acb9-8793c886f298 service nova] Creating event network-changed:3febcbca-e08c-4130-ae81-3ac6a9c05e2b for instance c72534eb-1844-4208-b625-ea8b5ece8108 on n-h1-862967-2 Oct 29 03:00:30.279944 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-72d4f8e0-8390-48c2-b5cb-2cbd57ed99ff req-9933522e-ca0d-4bf4-acb9-8793c886f298 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091784 Oct 29 03:00:30.281388 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1611/3029] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:30.290173 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e23a9d5a-a5d5-460e-8f8d-53a36d7ec430 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:30.291318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e23a9d5a-a5d5-460e-8f8d-53a36d7ec430 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:30.304074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e23a9d5a-a5d5-460e-8f8d-53a36d7ec430 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:30.304906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e23a9d5a-a5d5-460e-8f8d-53a36d7ec430 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:30.305604 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e23a9d5a-a5d5-460e-8f8d-53a36d7ec430 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:30.306759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e23a9d5a-a5d5-460e-8f8d-53a36d7ec430 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:30.307476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e23a9d5a-a5d5-460e-8f8d-53a36d7ec430 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:30.308145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e23a9d5a-a5d5-460e-8f8d-53a36d7ec430 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:30.717977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e23a9d5a-a5d5-460e-8f8d-53a36d7ec430 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:30.740872 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e23a9d5a-a5d5-460e-8f8d-53a36d7ec430 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81" status: 200 len: 1486 microversion: 2.1 time: 0.457417 Oct 29 03:00:30.742475 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1612/3030] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:30 2022] GET /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 => generated 1486 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:30.750927 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5c4dee2b-d726-4222-ac25-ca515c3fbddc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:30.752841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5c4dee2b-d726-4222-ac25-ca515c3fbddc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:30.765908 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c4dee2b-d726-4222-ac25-ca515c3fbddc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:30.766442 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c4dee2b-d726-4222-ac25-ca515c3fbddc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:30.766888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c4dee2b-d726-4222-ac25-ca515c3fbddc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:30.767610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c4dee2b-d726-4222-ac25-ca515c3fbddc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:30.768294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c4dee2b-d726-4222-ac25-ca515c3fbddc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:30.768789 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c4dee2b-d726-4222-ac25-ca515c3fbddc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:31.021370 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-14e377bd-8969-4546-862f-03c7b76b5fb4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:31.047464 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-14e377bd-8969-4546-862f-03c7b76b5fb4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92" status: 200 len: 1512 microversion: 2.1 time: 1.129885 Oct 29 03:00:31.048490 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1419/3031] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:29 2022] GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 => generated 1512 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:31.061807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8eff8400-a13e-45dd-9f76-2eba145bf651 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:31.062496 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8eff8400-a13e-45dd-9f76-2eba145bf651 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:31.075649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5c4dee2b-d726-4222-ac25-ca515c3fbddc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:31.085541 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5c4dee2b-d726-4222-ac25-ca515c3fbddc tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1210 microversion: 2.1 time: 0.341385 Oct 29 03:00:31.094287 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1613/3032] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:30 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1210 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:31.099968 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6501d89e-2360-4f87-af2c-2d2c9e7cf96e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:31.100623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6501d89e-2360-4f87-af2c-2d2c9e7cf96e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:31.117399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6501d89e-2360-4f87-af2c-2d2c9e7cf96e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:31.118039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8eff8400-a13e-45dd-9f76-2eba145bf651 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:31.118209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6501d89e-2360-4f87-af2c-2d2c9e7cf96e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:31.118607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6501d89e-2360-4f87-af2c-2d2c9e7cf96e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:31.119064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8eff8400-a13e-45dd-9f76-2eba145bf651 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:31.119333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6501d89e-2360-4f87-af2c-2d2c9e7cf96e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:31.119920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6501d89e-2360-4f87-af2c-2d2c9e7cf96e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:31.120330 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8eff8400-a13e-45dd-9f76-2eba145bf651 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:31.120464 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6501d89e-2360-4f87-af2c-2d2c9e7cf96e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:31.121536 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8eff8400-a13e-45dd-9f76-2eba145bf651 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:31.122333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8eff8400-a13e-45dd-9f76-2eba145bf651 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:31.123006 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8eff8400-a13e-45dd-9f76-2eba145bf651 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:31.177895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=100 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:31.478084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6501d89e-2360-4f87-af2c-2d2c9e7cf96e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:31.502058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6501d89e-2360-4f87-af2c-2d2c9e7cf96e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:31.505254 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6501d89e-2360-4f87-af2c-2d2c9e7cf96e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:31.510853 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6501d89e-2360-4f87-af2c-2d2c9e7cf96e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1808 microversion: 2.20 time: 0.415365 Oct 29 03:00:31.513120 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1614/3033] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:31 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1808 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:31.536490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a712223f-9abb-4578-a23c-509afaa8cde4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:31.551404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a712223f-9abb-4578-a23c-509afaa8cde4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:31.559581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a712223f-9abb-4578-a23c-509afaa8cde4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:31.560495 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a712223f-9abb-4578-a23c-509afaa8cde4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:31.561132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a712223f-9abb-4578-a23c-509afaa8cde4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:31.562201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a712223f-9abb-4578-a23c-509afaa8cde4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:31.562815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a712223f-9abb-4578-a23c-509afaa8cde4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:31.563538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a712223f-9abb-4578-a23c-509afaa8cde4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:31.602074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-a712223f-9abb-4578-a23c-509afaa8cde4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lazy-loading 'flavor' on Instance uuid 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:00:31.786283 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a712223f-9abb-4578-a23c-509afaa8cde4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "POST /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81/action" status: 202 len: 0 microversion: 2.1 time: 0.251951 Oct 29 03:00:31.801205 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1615/3034] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:00:31 2022] POST /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:00:31.815130 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-17ad878d-150d-4386-9d52-38c00b7e3440 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:31.817126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-17ad878d-150d-4386-9d52-38c00b7e3440 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:31.836250 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17ad878d-150d-4386-9d52-38c00b7e3440 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:31.837241 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17ad878d-150d-4386-9d52-38c00b7e3440 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:31.837930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17ad878d-150d-4386-9d52-38c00b7e3440 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:31.838969 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17ad878d-150d-4386-9d52-38c00b7e3440 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:31.839876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17ad878d-150d-4386-9d52-38c00b7e3440 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:31.840677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17ad878d-150d-4386-9d52-38c00b7e3440 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:32.034379 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8eff8400-a13e-45dd-9f76-2eba145bf651 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:32.046355 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8eff8400-a13e-45dd-9f76-2eba145bf651 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.996615 Oct 29 03:00:32.055815 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1420/3035] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:31 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:32.089780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9e1b8cb0-7ecd-4364-9b2f-4c7fd8c7b1c8 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:32.090731 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9e1b8cb0-7ecd-4364-9b2f-4c7fd8c7b1c8 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:32.102619 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e1b8cb0-7ecd-4364-9b2f-4c7fd8c7b1c8 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:32.103242 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e1b8cb0-7ecd-4364-9b2f-4c7fd8c7b1c8 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:32.103711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e1b8cb0-7ecd-4364-9b2f-4c7fd8c7b1c8 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:32.106783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e1b8cb0-7ecd-4364-9b2f-4c7fd8c7b1c8 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:32.107549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e1b8cb0-7ecd-4364-9b2f-4c7fd8c7b1c8 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:32.108634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e1b8cb0-7ecd-4364-9b2f-4c7fd8c7b1c8 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:32.492895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-17ad878d-150d-4386-9d52-38c00b7e3440 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:32.510930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-17ad878d-150d-4386-9d52-38c00b7e3440 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:32.514115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-17ad878d-150d-4386-9d52-38c00b7e3440 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:32.515718 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-17ad878d-150d-4386-9d52-38c00b7e3440 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1879 microversion: 2.32 time: 0.709816 Oct 29 03:00:32.517371 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1616/3036] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:31 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1879 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:32.526142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-aaf82005-fa6e-4b5c-8389-380b88034d10 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:32.527558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-aaf82005-fa6e-4b5c-8389-380b88034d10 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:32.539969 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aaf82005-fa6e-4b5c-8389-380b88034d10 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:32.540836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aaf82005-fa6e-4b5c-8389-380b88034d10 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:32.541798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aaf82005-fa6e-4b5c-8389-380b88034d10 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:32.543273 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aaf82005-fa6e-4b5c-8389-380b88034d10 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:32.544344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aaf82005-fa6e-4b5c-8389-380b88034d10 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:32.545302 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aaf82005-fa6e-4b5c-8389-380b88034d10 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:32.780691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-aaf82005-fa6e-4b5c-8389-380b88034d10 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:32.797253 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-aaf82005-fa6e-4b5c-8389-380b88034d10 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 200 len: 1523 microversion: 2.1 time: 0.277628 Oct 29 03:00:32.812554 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1617/3037] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:32 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 1523 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:32.824721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cf92661e-5d80-4d8e-a226-0836476cef64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:32.825779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cf92661e-5d80-4d8e-a226-0836476cef64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:32.841124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf92661e-5d80-4d8e-a226-0836476cef64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:32.841628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf92661e-5d80-4d8e-a226-0836476cef64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:32.845643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf92661e-5d80-4d8e-a226-0836476cef64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:32.848139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf92661e-5d80-4d8e-a226-0836476cef64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:32.848139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf92661e-5d80-4d8e-a226-0836476cef64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:32.848608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf92661e-5d80-4d8e-a226-0836476cef64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:33.125438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cf92661e-5d80-4d8e-a226-0836476cef64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:33.136555 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cf92661e-5d80-4d8e-a226-0836476cef64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81" status: 200 len: 1477 microversion: 2.1 time: 0.330233 Oct 29 03:00:33.150490 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1618/3038] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:32 2022] GET /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 => generated 1477 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:33.173499 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a0393fc5-09dd-49fe-b09b-37c339424b3f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:33.174322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a0393fc5-09dd-49fe-b09b-37c339424b3f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:33.180558 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9e1b8cb0-7ecd-4364-9b2f-4c7fd8c7b1c8 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:33.186080 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a0393fc5-09dd-49fe-b09b-37c339424b3f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:33.187140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a0393fc5-09dd-49fe-b09b-37c339424b3f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:33.188199 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a0393fc5-09dd-49fe-b09b-37c339424b3f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:33.189787 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a0393fc5-09dd-49fe-b09b-37c339424b3f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:33.196022 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9e1b8cb0-7ecd-4364-9b2f-4c7fd8c7b1c8 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a" status: 200 len: 1511 microversion: 2.1 time: 1.138035 Oct 29 03:00:33.197869 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1421/3039] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:32 2022] GET /compute/v2.1/servers/4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a => generated 1511 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:33.198986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a0393fc5-09dd-49fe-b09b-37c339424b3f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:33.200876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a0393fc5-09dd-49fe-b09b-37c339424b3f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:33.223338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7389e469-52eb-4cf5-b939-62ed6ecd01f8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:33.223967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7389e469-52eb-4cf5-b939-62ed6ecd01f8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:33.235810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7389e469-52eb-4cf5-b939-62ed6ecd01f8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:33.236493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7389e469-52eb-4cf5-b939-62ed6ecd01f8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:33.238659 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7389e469-52eb-4cf5-b939-62ed6ecd01f8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:33.239881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7389e469-52eb-4cf5-b939-62ed6ecd01f8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:33.240516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7389e469-52eb-4cf5-b939-62ed6ecd01f8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:33.241147 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7389e469-52eb-4cf5-b939-62ed6ecd01f8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:33.243234 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-a0393fc5-09dd-49fe-b09b-37c339424b3f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Cannot 'unshelve' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state active Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a0393fc5-09dd-49fe-b09b-37c339424b3f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action HTTP/1.1 Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 18 Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: {"unshelve": null} Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: exception: Cannot 'unshelve' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state active Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '5d9854a1-ead6-4570-b801-13c47d0bf721', 'body': {'unshelve': None}} Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5d9854a1-ead6-4570-b801-13c47d0bf721 in vm_state active. Cannot unshelve while the instance is in this state. Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 03:00:33.248200 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 03:00:33.253118 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state active Oct 29 03:00:33.253118 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:33.253118 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:33.253118 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:33.253118 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:33.253118 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:33.253118 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:33.253118 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:00:33.253118 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:00:33.253118 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state active Oct 29 03:00:33.253118 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:33.254520 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a0393fc5-09dd-49fe-b09b-37c339424b3f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 409 to user: Cannot 'unshelve' instance 5d9854a1-ead6-4570-b801-13c47d0bf721 while it is in vm_state active {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:33.256504 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a0393fc5-09dd-49fe-b09b-37c339424b3f tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action" status: 409 len: 146 microversion: 2.1 time: 0.104182 Oct 29 03:00:33.259197 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1619/3040] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:00:33 2022] POST /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721/action => generated 146 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:00:33.268566 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-81b6a3c9-c5ff-4514-997c-51b531d79abb req-453c7f86-4658-4dbf-a35c-f782b8859ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a79a761-e10f-4a8d-8e33-a21c08c81184", "tag": "bf31d1ed-88f4-45a8-b01b-b6122fb270a1"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:33.282411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-81b6a3c9-c5ff-4514-997c-51b531d79abb req-453c7f86-4658-4dbf-a35c-f782b8859ce9 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:33.283168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-81b6a3c9-c5ff-4514-997c-51b531d79abb req-453c7f86-4658-4dbf-a35c-f782b8859ce9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:33.283710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-81b6a3c9-c5ff-4514-997c-51b531d79abb req-453c7f86-4658-4dbf-a35c-f782b8859ce9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:33.307002 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-81b6a3c9-c5ff-4514-997c-51b531d79abb req-453c7f86-4658-4dbf-a35c-f782b8859ce9 service nova] Creating event network-changed:bf31d1ed-88f4-45a8-b01b-b6122fb270a1 for instance 6a79a761-e10f-4a8d-8e33-a21c08c81184 on n-h1-862967-2 Oct 29 03:00:33.321549 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-81b6a3c9-c5ff-4514-997c-51b531d79abb req-453c7f86-4658-4dbf-a35c-f782b8859ce9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059896 Oct 29 03:00:33.326679 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1620/3041] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:33.333800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-43d37647-26f3-45b4-a502-d5ff5d7205a0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:33.345643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-43d37647-26f3-45b4-a502-d5ff5d7205a0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:33.366098 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-43d37647-26f3-45b4-a502-d5ff5d7205a0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:33.367056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-43d37647-26f3-45b4-a502-d5ff5d7205a0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:33.376751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-43d37647-26f3-45b4-a502-d5ff5d7205a0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:33.377800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-43d37647-26f3-45b4-a502-d5ff5d7205a0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:33.378476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-43d37647-26f3-45b4-a502-d5ff5d7205a0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:33.379067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-43d37647-26f3-45b4-a502-d5ff5d7205a0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:33.694151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7389e469-52eb-4cf5-b939-62ed6ecd01f8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:33.723065 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7389e469-52eb-4cf5-b939-62ed6ecd01f8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1210 microversion: 2.1 time: 0.521207 Oct 29 03:00:33.733325 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1422/3042] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:33 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1210 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:33.754002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8b0d2926-f302-4fb0-9621-8c91dcc04f18 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1163336239"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:33.757069 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8b0d2926-f302-4fb0-9621-8c91dcc04f18 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:33.763952 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b0d2926-f302-4fb0-9621-8c91dcc04f18 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:33.764899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b0d2926-f302-4fb0-9621-8c91dcc04f18 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:33.765526 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b0d2926-f302-4fb0-9621-8c91dcc04f18 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:33.766478 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b0d2926-f302-4fb0-9621-8c91dcc04f18 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:33.767122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b0d2926-f302-4fb0-9621-8c91dcc04f18 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:33.767750 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b0d2926-f302-4fb0-9621-8c91dcc04f18 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:33.833380 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-43d37647-26f3-45b4-a502-d5ff5d7205a0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:33.848805 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-43d37647-26f3-45b4-a502-d5ff5d7205a0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:33.854540 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-43d37647-26f3-45b4-a502-d5ff5d7205a0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:33.858809 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-43d37647-26f3-45b4-a502-d5ff5d7205a0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1808 microversion: 2.20 time: 0.528678 Oct 29 03:00:33.860103 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1621/3043] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:33 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1808 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:33.869445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-957d1919-f401-4633-9bc8-18d4c9999765 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:33.876594 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-957d1919-f401-4633-9bc8-18d4c9999765 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:33.877549 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-957d1919-f401-4633-9bc8-18d4c9999765 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '875f8af161b647758adaebd94449c8c1'} {{(pid=127124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:00:33.902754 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-957d1919-f401-4633-9bc8-18d4c9999765 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:33.903445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-957d1919-f401-4633-9bc8-18d4c9999765 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:33.904329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-957d1919-f401-4633-9bc8-18d4c9999765 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:33.906837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-957d1919-f401-4633-9bc8-18d4c9999765 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:33.907573 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-957d1919-f401-4633-9bc8-18d4c9999765 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:33.908064 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-957d1919-f401-4633-9bc8-18d4c9999765 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:34.177266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.multi_cell_list [None req-957d1919-f401-4633-9bc8-18d4c9999765 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:00:34.549613 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8b0d2926-f302-4fb0-9621-8c91dcc04f18 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "POST /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81/action" status: 202 len: 0 microversion: 2.1 time: 0.798941 Oct 29 03:00:34.550720 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1423/3044] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:00:33 2022] POST /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81/action => generated 0 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 03:00:34.584070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-22fdf224-edd1-4bf7-a1a9-7a7f0e36732a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:34.594102 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-22fdf224-edd1-4bf7-a1a9-7a7f0e36732a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:34.619012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22fdf224-edd1-4bf7-a1a9-7a7f0e36732a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:34.625349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22fdf224-edd1-4bf7-a1a9-7a7f0e36732a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:34.634974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22fdf224-edd1-4bf7-a1a9-7a7f0e36732a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:34.637063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22fdf224-edd1-4bf7-a1a9-7a7f0e36732a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:34.647392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22fdf224-edd1-4bf7-a1a9-7a7f0e36732a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:34.648926 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22fdf224-edd1-4bf7-a1a9-7a7f0e36732a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:35.091246 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-957d1919-f401-4633-9bc8-18d4c9999765 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:35.105321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-957d1919-f401-4633-9bc8-18d4c9999765 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:35.105844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-957d1919-f401-4633-9bc8-18d4c9999765 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:35.106264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-957d1919-f401-4633-9bc8-18d4c9999765 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:35.398161 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-957d1919-f401-4633-9bc8-18d4c9999765 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 1.536178 Oct 29 03:00:35.412786 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1622/3045] 10.222.0.46 () {58 vars in 1167 bytes} [Sat Oct 29 03:00:33 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:35.412786 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-db101a24-0143-497d-9741-1abe84163032 req-e2abb2e5-459a-456a-bcfc-e77dd83865e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e395101-378a-4976-b087-38ce3f22b912", "name": "network-vif-plugged", "status": "completed", "tag": "8bb3b984-0aee-4027-aa60-42e7d9894d32"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:35.425420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-db101a24-0143-497d-9741-1abe84163032 req-e2abb2e5-459a-456a-bcfc-e77dd83865e8 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:35.425420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-db101a24-0143-497d-9741-1abe84163032 req-e2abb2e5-459a-456a-bcfc-e77dd83865e8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:35.425420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-db101a24-0143-497d-9741-1abe84163032 req-e2abb2e5-459a-456a-bcfc-e77dd83865e8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:35.450256 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-db101a24-0143-497d-9741-1abe84163032 req-e2abb2e5-459a-456a-bcfc-e77dd83865e8 service nova] Creating event network-vif-plugged:8bb3b984-0aee-4027-aa60-42e7d9894d32 for instance 6e395101-378a-4976-b087-38ce3f22b912 on n-h2-862967-2 Oct 29 03:00:35.458080 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-db101a24-0143-497d-9741-1abe84163032 req-e2abb2e5-459a-456a-bcfc-e77dd83865e8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058251 Oct 29 03:00:35.464400 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1623/3046] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:35.478611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-26ffab5f-3621-4b5f-872b-8726f8c24927 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:35.479324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-26ffab5f-3621-4b5f-872b-8726f8c24927 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:35.488159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-26ffab5f-3621-4b5f-872b-8726f8c24927 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:35.488716 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-26ffab5f-3621-4b5f-872b-8726f8c24927 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:35.489153 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-26ffab5f-3621-4b5f-872b-8726f8c24927 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:35.489868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-26ffab5f-3621-4b5f-872b-8726f8c24927 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:35.490321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-26ffab5f-3621-4b5f-872b-8726f8c24927 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:35.490742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-26ffab5f-3621-4b5f-872b-8726f8c24927 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:35.549699 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-22fdf224-edd1-4bf7-a1a9-7a7f0e36732a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:35.553670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:35.561175 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-22fdf224-edd1-4bf7-a1a9-7a7f0e36732a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 1.005153 Oct 29 03:00:35.571668 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1424/3047] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:34 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:35.599423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b35f004c-2877-4547-aba3-04c0630930d0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:35.600455 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b35f004c-2877-4547-aba3-04c0630930d0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:35.625016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b35f004c-2877-4547-aba3-04c0630930d0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:35.625206 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b35f004c-2877-4547-aba3-04c0630930d0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:35.625642 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b35f004c-2877-4547-aba3-04c0630930d0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:35.626353 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b35f004c-2877-4547-aba3-04c0630930d0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:35.626838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b35f004c-2877-4547-aba3-04c0630930d0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:35.627216 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b35f004c-2877-4547-aba3-04c0630930d0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:36.171841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-26ffab5f-3621-4b5f-872b-8726f8c24927 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:36.186375 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-26ffab5f-3621-4b5f-872b-8726f8c24927 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:36.188030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-26ffab5f-3621-4b5f-872b-8726f8c24927 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:36.191641 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-26ffab5f-3621-4b5f-872b-8726f8c24927 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1879 microversion: 2.32 time: 0.723369 Oct 29 03:00:36.205525 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1624/3048] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:35 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1879 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:36.221934 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c4a14ce8-4ba7-4449-80fc-768119c6aae1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff0533eb4c0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:36.334426 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c4a14ce8-4ba7-4449-80fc-768119c6aae1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/917b954f-5d5f-42d2-9717-2d38cda5517c" status: 200 len: 1436 microversion: 2.1 time: 0.126942 Oct 29 03:00:36.348239 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1625/3049] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:00:36 2022] GET /compute/v2.1/images/917b954f-5d5f-42d2-9717-2d38cda5517c => generated 1436 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:36.356474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-45142ad9-03c5-46f5-aa94-245e0e51f518 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:36.357399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-45142ad9-03c5-46f5-aa94-245e0e51f518 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:36.365074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45142ad9-03c5-46f5-aa94-245e0e51f518 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:36.365883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45142ad9-03c5-46f5-aa94-245e0e51f518 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:36.367364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45142ad9-03c5-46f5-aa94-245e0e51f518 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:36.368327 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45142ad9-03c5-46f5-aa94-245e0e51f518 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:36.368983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45142ad9-03c5-46f5-aa94-245e0e51f518 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:36.369581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45142ad9-03c5-46f5-aa94-245e0e51f518 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:36.698699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-45142ad9-03c5-46f5-aa94-245e0e51f518 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:36.714472 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-45142ad9-03c5-46f5-aa94-245e0e51f518 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1198 microversion: 2.1 time: 0.363721 Oct 29 03:00:36.716287 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1626/3050] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:36 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1198 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:36.721493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-88a31d4a-444d-4838-8ddf-bb66e1adf984 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:36.722076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b35f004c-2877-4547-aba3-04c0630930d0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:36.723048 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-88a31d4a-444d-4838-8ddf-bb66e1adf984 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:36.730816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88a31d4a-444d-4838-8ddf-bb66e1adf984 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:36.731600 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88a31d4a-444d-4838-8ddf-bb66e1adf984 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:36.732217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88a31d4a-444d-4838-8ddf-bb66e1adf984 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:36.733168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88a31d4a-444d-4838-8ddf-bb66e1adf984 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:36.733816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88a31d4a-444d-4838-8ddf-bb66e1adf984 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:36.734414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88a31d4a-444d-4838-8ddf-bb66e1adf984 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:36.747474 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b35f004c-2877-4547-aba3-04c0630930d0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 200 len: 1523 microversion: 2.1 time: 1.172139 Oct 29 03:00:36.754278 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1425/3051] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:35 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 1523 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:36.780388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9299ae0f-97ae-4ed4-b708-ceba02b124fe tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:36.791755 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9299ae0f-97ae-4ed4-b708-ceba02b124fe tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:36.793012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9299ae0f-97ae-4ed4-b708-ceba02b124fe tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1618626768', 'deleted': False, 'project_id': '875f8af161b647758adaebd94449c8c1'} {{(pid=127125) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:00:36.801151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9299ae0f-97ae-4ed4-b708-ceba02b124fe tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:36.801917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9299ae0f-97ae-4ed4-b708-ceba02b124fe tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:36.802529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9299ae0f-97ae-4ed4-b708-ceba02b124fe tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:36.803437 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9299ae0f-97ae-4ed4-b708-ceba02b124fe tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:36.804065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9299ae0f-97ae-4ed4-b708-ceba02b124fe tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:36.804719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9299ae0f-97ae-4ed4-b708-ceba02b124fe tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:37.018223 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.multi_cell_list [None req-9299ae0f-97ae-4ed4-b708-ceba02b124fe tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:00:37.081959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-88a31d4a-444d-4838-8ddf-bb66e1adf984 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:37.100973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-88a31d4a-444d-4838-8ddf-bb66e1adf984 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:37.103984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-88a31d4a-444d-4838-8ddf-bb66e1adf984 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:37.117782 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-88a31d4a-444d-4838-8ddf-bb66e1adf984 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1808 microversion: 2.20 time: 0.400042 Oct 29 03:00:37.125611 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1627/3052] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:36 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1808 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:37.131678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ebd5a23f-f33b-4474-99fd-1a87fc102348 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:37.137441 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ebd5a23f-f33b-4474-99fd-1a87fc102348 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:37.157102 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebd5a23f-f33b-4474-99fd-1a87fc102348 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:37.157826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebd5a23f-f33b-4474-99fd-1a87fc102348 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:37.158286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebd5a23f-f33b-4474-99fd-1a87fc102348 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:37.159563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebd5a23f-f33b-4474-99fd-1a87fc102348 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:37.160188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebd5a23f-f33b-4474-99fd-1a87fc102348 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:37.168563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebd5a23f-f33b-4474-99fd-1a87fc102348 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:37.222848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9299ae0f-97ae-4ed4-b708-ceba02b124fe tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:37.238562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9299ae0f-97ae-4ed4-b708-ceba02b124fe tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:37.239319 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9299ae0f-97ae-4ed4-b708-ceba02b124fe tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:37.240059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9299ae0f-97ae-4ed4-b708-ceba02b124fe tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:37.493275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ebd5a23f-f33b-4474-99fd-1a87fc102348 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:37.503897 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ebd5a23f-f33b-4474-99fd-1a87fc102348 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.376215 Oct 29 03:00:37.516568 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1628/3053] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:37 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:37.516568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-49886d27-82e4-4309-a4ff-8ef1a4313ae0 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:37.516568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-49886d27-82e4-4309-a4ff-8ef1a4313ae0 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:37.525471 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-49886d27-82e4-4309-a4ff-8ef1a4313ae0 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:37.525471 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-49886d27-82e4-4309-a4ff-8ef1a4313ae0 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:37.525471 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-49886d27-82e4-4309-a4ff-8ef1a4313ae0 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:37.525471 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-49886d27-82e4-4309-a4ff-8ef1a4313ae0 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:37.525471 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-49886d27-82e4-4309-a4ff-8ef1a4313ae0 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:37.525471 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-49886d27-82e4-4309-a4ff-8ef1a4313ae0 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:37.829658 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9299ae0f-97ae-4ed4-b708-ceba02b124fe tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1618626768" status: 200 len: 1515 microversion: 2.1 time: 1.060232 Oct 29 03:00:37.844587 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1426/3054] 10.222.0.46 () {58 vars in 1263 bytes} [Sat Oct 29 03:00:36 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1618626768 => generated 1515 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:37.844587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f00800da-7fbb-49a7-8b6b-e9bee72029f5 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff05c1b9040>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:37.918020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-49886d27-82e4-4309-a4ff-8ef1a4313ae0 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:37.946206 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-49886d27-82e4-4309-a4ff-8ef1a4313ae0 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:37.951504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-49886d27-82e4-4309-a4ff-8ef1a4313ae0 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:37.960136 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-49886d27-82e4-4309-a4ff-8ef1a4313ae0 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1879 microversion: 2.32 time: 0.452677 Oct 29 03:00:37.961776 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1629/3055] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:37 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1879 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:37.980128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eee71a96-eaf5-43f3-9aa3-6fea69ed6b39 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1487432934_updated"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:37.988196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-eee71a96-eaf5-43f3-9aa3-6fea69ed6b39 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: e2f85fd4-d094-4325-8bc3-8472914fa6a6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:38.022608 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-eee71a96-eaf5-43f3-9aa3-6fea69ed6b39 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Instance e2f85fd4-d094-4325-8bc3-8472914fa6a6 could not be found. Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eee71a96-eaf5-43f3-9aa3-6fea69ed6b39 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: request: PUT /compute/v2.1/servers/e2f85fd4-d094-4325-8bc3-8472914fa6a6 HTTP/1.1 Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 81 Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1487432934_updated"}} Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance e2f85fd4-d094-4325-8bc3-8472914fa6a6 could not be found. Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'e2f85fd4-d094-4325-8bc3-8472914fa6a6', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1487432934_updated'}}} Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2f85fd4-d094-4325-8bc3-8472914fa6a6 could not be found. Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 29 03:00:38.032664 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:00:38.037775 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:00:38.037775 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:00:38.037775 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:00:38.037775 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2f85fd4-d094-4325-8bc3-8472914fa6a6 could not be found. Oct 29 03:00:38.037775 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:38.037775 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:38.037775 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:38.037775 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:38.037775 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:38.037775 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:38.037775 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:00:38.037775 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:00:38.037775 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2f85fd4-d094-4325-8bc3-8472914fa6a6 could not be found. Oct 29 03:00:38.037775 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:38.037775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eee71a96-eaf5-43f3-9aa3-6fea69ed6b39 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 404 to user: Instance e2f85fd4-d094-4325-8bc3-8472914fa6a6 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:38.037775 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eee71a96-eaf5-43f3-9aa3-6fea69ed6b39 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "PUT /compute/v2.1/servers/e2f85fd4-d094-4325-8bc3-8472914fa6a6" status: 404 len: 111 microversion: 2.1 time: 0.071100 Oct 29 03:00:38.037775 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1630/3056] 10.222.0.46 () {60 vars in 1256 bytes} [Sat Oct 29 03:00:37 2022] PUT /compute/v2.1/servers/e2f85fd4-d094-4325-8bc3-8472914fa6a6 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:00:38.058065 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-885a5fe0-6948-493a-b168-ccbaa039ebbb tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:38.067958 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-885a5fe0-6948-493a-b168-ccbaa039ebbb tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:38.076838 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f00800da-7fbb-49a7-8b6b-e9bee72029f5 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/917b954f-5d5f-42d2-9717-2d38cda5517c" status: 200 len: 1436 microversion: 2.1 time: 0.242726 Oct 29 03:00:38.082598 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-885a5fe0-6948-493a-b168-ccbaa039ebbb tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:38.084034 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-885a5fe0-6948-493a-b168-ccbaa039ebbb tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:38.084956 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-885a5fe0-6948-493a-b168-ccbaa039ebbb tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:38.085322 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1427/3057] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:00:37 2022] GET /compute/v2.1/images/917b954f-5d5f-42d2-9717-2d38cda5517c => generated 1436 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:38.086638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-885a5fe0-6948-493a-b168-ccbaa039ebbb tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:38.087345 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-885a5fe0-6948-493a-b168-ccbaa039ebbb tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:38.088067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-885a5fe0-6948-493a-b168-ccbaa039ebbb tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:38.104940 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-14df3024-a3c5-49df-a1d9-e7dc4283edc4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:38.105560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-14df3024-a3c5-49df-a1d9-e7dc4283edc4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:38.138325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14df3024-a3c5-49df-a1d9-e7dc4283edc4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:38.139166 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14df3024-a3c5-49df-a1d9-e7dc4283edc4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:38.139874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14df3024-a3c5-49df-a1d9-e7dc4283edc4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:38.140988 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14df3024-a3c5-49df-a1d9-e7dc4283edc4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:38.141681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14df3024-a3c5-49df-a1d9-e7dc4283edc4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:38.143023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14df3024-a3c5-49df-a1d9-e7dc4283edc4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:38.316348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-885a5fe0-6948-493a-b168-ccbaa039ebbb tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:38.326638 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-885a5fe0-6948-493a-b168-ccbaa039ebbb tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1198 microversion: 2.1 time: 0.285486 Oct 29 03:00:38.327589 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1631/3058] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:38 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1198 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:38.333175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e8c89ebd-842b-46c9-b9c9-03d62cb70b60 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:38.339033 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e8c89ebd-842b-46c9-b9c9-03d62cb70b60 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:38.340401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e8c89ebd-842b-46c9-b9c9-03d62cb70b60 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '875f8af161b647758adaebd94449c8c1'} {{(pid=127124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:00:38.347606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8c89ebd-842b-46c9-b9c9-03d62cb70b60 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:38.348582 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8c89ebd-842b-46c9-b9c9-03d62cb70b60 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:38.349280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8c89ebd-842b-46c9-b9c9-03d62cb70b60 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:38.350970 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8c89ebd-842b-46c9-b9c9-03d62cb70b60 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:38.351844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8c89ebd-842b-46c9-b9c9-03d62cb70b60 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:38.352763 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8c89ebd-842b-46c9-b9c9-03d62cb70b60 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:38.572957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:38.584929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.multi_cell_list [None req-e8c89ebd-842b-46c9-b9c9-03d62cb70b60 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:00:38.698467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-14df3024-a3c5-49df-a1d9-e7dc4283edc4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:38.711915 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-14df3024-a3c5-49df-a1d9-e7dc4283edc4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 200 len: 1523 microversion: 2.1 time: 0.625098 Oct 29 03:00:38.712678 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1428/3059] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:38 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 1523 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:38.730143 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-247dcc16-ebb1-4808-938a-ff1c1e51e6c1 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:38.730775 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-247dcc16-ebb1-4808-938a-ff1c1e51e6c1 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:38.758013 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-247dcc16-ebb1-4808-938a-ff1c1e51e6c1 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:38.763135 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-247dcc16-ebb1-4808-938a-ff1c1e51e6c1 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:38.763938 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-247dcc16-ebb1-4808-938a-ff1c1e51e6c1 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:38.765131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-247dcc16-ebb1-4808-938a-ff1c1e51e6c1 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:38.765871 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-247dcc16-ebb1-4808-938a-ff1c1e51e6c1 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:38.766749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-247dcc16-ebb1-4808-938a-ff1c1e51e6c1 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:38.780631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e8c89ebd-842b-46c9-b9c9-03d62cb70b60 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:38.797702 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8c89ebd-842b-46c9-b9c9-03d62cb70b60 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:38.798996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8c89ebd-842b-46c9-b9c9-03d62cb70b60 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:38.800501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8c89ebd-842b-46c9-b9c9-03d62cb70b60 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:39.169906 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e8c89ebd-842b-46c9-b9c9-03d62cb70b60 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 0.841008 Oct 29 03:00:39.173099 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1632/3060] 10.222.0.46 () {58 vars in 1173 bytes} [Sat Oct 29 03:00:38 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:39.188996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d548d20b-4122-4051-9187-95942bd79083 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:39.189763 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d548d20b-4122-4051-9187-95942bd79083 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:39.228992 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d548d20b-4122-4051-9187-95942bd79083 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:39.229601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d548d20b-4122-4051-9187-95942bd79083 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:39.230057 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d548d20b-4122-4051-9187-95942bd79083 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:39.231168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d548d20b-4122-4051-9187-95942bd79083 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:39.232003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d548d20b-4122-4051-9187-95942bd79083 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:39.232548 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d548d20b-4122-4051-9187-95942bd79083 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:39.505796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-247dcc16-ebb1-4808-938a-ff1c1e51e6c1 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:39.532870 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-247dcc16-ebb1-4808-938a-ff1c1e51e6c1 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.818941 Oct 29 03:00:39.541766 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1429/3061] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:38 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:39.572960 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ef5337e7-fa68-42d1-ba78-51ebb5e1dfd3 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:39.582223 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ef5337e7-fa68-42d1-ba78-51ebb5e1dfd3 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:39.614994 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef5337e7-fa68-42d1-ba78-51ebb5e1dfd3 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:39.618058 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef5337e7-fa68-42d1-ba78-51ebb5e1dfd3 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:39.619534 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef5337e7-fa68-42d1-ba78-51ebb5e1dfd3 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:39.624161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef5337e7-fa68-42d1-ba78-51ebb5e1dfd3 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:39.626599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef5337e7-fa68-42d1-ba78-51ebb5e1dfd3 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:39.629973 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef5337e7-fa68-42d1-ba78-51ebb5e1dfd3 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:39.637081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d548d20b-4122-4051-9187-95942bd79083 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:39.667573 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d548d20b-4122-4051-9187-95942bd79083 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:39.679384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d548d20b-4122-4051-9187-95942bd79083 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:39.689234 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d548d20b-4122-4051-9187-95942bd79083 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1808 microversion: 2.20 time: 0.514457 Oct 29 03:00:39.705148 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1633/3062] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:39 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1808 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:39.739844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-007652a0-4d57-4da2-9339-e00ab684e390 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053411a60>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:40.339574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ef5337e7-fa68-42d1-ba78-51ebb5e1dfd3 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:40.375292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ef5337e7-fa68-42d1-ba78-51ebb5e1dfd3 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:40.376878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ef5337e7-fa68-42d1-ba78-51ebb5e1dfd3 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:40.378141 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ef5337e7-fa68-42d1-ba78-51ebb5e1dfd3 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1879 microversion: 2.32 time: 0.831802 Oct 29 03:00:40.383479 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1430/3063] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:39 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1879 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:40.392220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-55f1f426-b199-4430-8f80-0348f45e98c6 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:40.409792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-55f1f426-b199-4430-8f80-0348f45e98c6 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:40.410423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.compute.servers [None req-55f1f426-b199-4430-8f80-0348f45e98c6 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Removing options 'limit' from query {{(pid=127125) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 29 03:00:40.411369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-55f1f426-b199-4430-8f80-0348f45e98c6 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Searching by: {'deleted': False, 'project_id': '875f8af161b647758adaebd94449c8c1'} {{(pid=127125) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:00:40.431584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55f1f426-b199-4430-8f80-0348f45e98c6 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:40.432068 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55f1f426-b199-4430-8f80-0348f45e98c6 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:40.432497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55f1f426-b199-4430-8f80-0348f45e98c6 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:40.436985 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55f1f426-b199-4430-8f80-0348f45e98c6 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:40.437536 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55f1f426-b199-4430-8f80-0348f45e98c6 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:40.437998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55f1f426-b199-4430-8f80-0348f45e98c6 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:40.512727 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-55f1f426-b199-4430-8f80-0348f45e98c6 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:40.523153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55f1f426-b199-4430-8f80-0348f45e98c6 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:40.525755 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55f1f426-b199-4430-8f80-0348f45e98c6 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:40.526388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55f1f426-b199-4430-8f80-0348f45e98c6 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:41.808674 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-55f1f426-b199-4430-8f80-0348f45e98c6 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 1.423920 Oct 29 03:00:41.822276 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1431/3064] 10.222.0.46 () {58 vars in 1161 bytes} [Sat Oct 29 03:00:40 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:41.838708 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b6c29ed0-8d55-48b6-af87-a2b3fa55aff8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:41.842435 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b6c29ed0-8d55-48b6-af87-a2b3fa55aff8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:41.857304 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6c29ed0-8d55-48b6-af87-a2b3fa55aff8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:41.857812 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6c29ed0-8d55-48b6-af87-a2b3fa55aff8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:41.858283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6c29ed0-8d55-48b6-af87-a2b3fa55aff8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:41.859033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6c29ed0-8d55-48b6-af87-a2b3fa55aff8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:41.859480 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6c29ed0-8d55-48b6-af87-a2b3fa55aff8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:41.859944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6c29ed0-8d55-48b6-af87-a2b3fa55aff8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:42.590217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b6c29ed0-8d55-48b6-af87-a2b3fa55aff8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:42.608703 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b6c29ed0-8d55-48b6-af87-a2b3fa55aff8 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1198 microversion: 2.1 time: 0.785004 Oct 29 03:00:42.645680 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1432/3065] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:41 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1198 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:42.678688 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-ea2e3778-c5d0-414b-b65c-286c981c2b1c req-9a162848-a821-49b8-b0cb-ee293fd9c5bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dfcfa12-5d6b-4eda-973a-3be37b2f8a81", "name": "network-vif-plugged", "status": "completed", "tag": "4e35aeb0-0116-4e55-9d8d-f325c7156e3c"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:42.704256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ea2e3778-c5d0-414b-b65c-286c981c2b1c req-9a162848-a821-49b8-b0cb-ee293fd9c5bb service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:42.705231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ea2e3778-c5d0-414b-b65c-286c981c2b1c req-9a162848-a821-49b8-b0cb-ee293fd9c5bb service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:42.705886 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ea2e3778-c5d0-414b-b65c-286c981c2b1c req-9a162848-a821-49b8-b0cb-ee293fd9c5bb service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:42.739811 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-ea2e3778-c5d0-414b-b65c-286c981c2b1c req-9a162848-a821-49b8-b0cb-ee293fd9c5bb service nova] Creating event network-vif-plugged:4e35aeb0-0116-4e55-9d8d-f325c7156e3c for instance 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 on n-h2-862967-2 Oct 29 03:00:42.779458 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-ea2e3778-c5d0-414b-b65c-286c981c2b1c req-9a162848-a821-49b8-b0cb-ee293fd9c5bb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130699 Oct 29 03:00:42.783193 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1433/3066] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:42.807013 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bed99a5d-8f57-4aa8-9b0d-d1232dda6eed tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:42.810328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bed99a5d-8f57-4aa8-9b0d-d1232dda6eed tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:42.833775 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bed99a5d-8f57-4aa8-9b0d-d1232dda6eed tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:42.853892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bed99a5d-8f57-4aa8-9b0d-d1232dda6eed tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:42.854635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bed99a5d-8f57-4aa8-9b0d-d1232dda6eed tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:42.857200 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bed99a5d-8f57-4aa8-9b0d-d1232dda6eed tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:42.857701 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bed99a5d-8f57-4aa8-9b0d-d1232dda6eed tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:42.865345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bed99a5d-8f57-4aa8-9b0d-d1232dda6eed tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:43.548969 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bed99a5d-8f57-4aa8-9b0d-d1232dda6eed tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:43.571991 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bed99a5d-8f57-4aa8-9b0d-d1232dda6eed tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.783709 Oct 29 03:00:43.580886 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1434/3067] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:42 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:43.585810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-90065482-7ad0-4c9c-93b9-6e7df85b4aa4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:43.586420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-90065482-7ad0-4c9c-93b9-6e7df85b4aa4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:43.599187 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90065482-7ad0-4c9c-93b9-6e7df85b4aa4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:43.599678 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90065482-7ad0-4c9c-93b9-6e7df85b4aa4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:43.600305 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90065482-7ad0-4c9c-93b9-6e7df85b4aa4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:43.601255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90065482-7ad0-4c9c-93b9-6e7df85b4aa4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:43.601888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90065482-7ad0-4c9c-93b9-6e7df85b4aa4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:43.602595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90065482-7ad0-4c9c-93b9-6e7df85b4aa4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:44.233385 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-90065482-7ad0-4c9c-93b9-6e7df85b4aa4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:44.254321 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-90065482-7ad0-4c9c-93b9-6e7df85b4aa4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 200 len: 1523 microversion: 2.1 time: 0.671070 Oct 29 03:00:44.269485 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1435/3068] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:43 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 1523 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:44.278634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6406dfe9-5de5-4514-a400-68c9df90c7a6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:44.279616 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6406dfe9-5de5-4514-a400-68c9df90c7a6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:44.286785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6406dfe9-5de5-4514-a400-68c9df90c7a6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:44.287241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6406dfe9-5de5-4514-a400-68c9df90c7a6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:44.287666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6406dfe9-5de5-4514-a400-68c9df90c7a6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:44.288410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6406dfe9-5de5-4514-a400-68c9df90c7a6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:44.288984 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6406dfe9-5de5-4514-a400-68c9df90c7a6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:44.289881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6406dfe9-5de5-4514-a400-68c9df90c7a6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:45.194501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6406dfe9-5de5-4514-a400-68c9df90c7a6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:45.211202 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6406dfe9-5de5-4514-a400-68c9df90c7a6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:45.212801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6406dfe9-5de5-4514-a400-68c9df90c7a6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:45.214031 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6406dfe9-5de5-4514-a400-68c9df90c7a6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1808 microversion: 2.20 time: 0.939379 Oct 29 03:00:45.217472 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1436/3069] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:44 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1808 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:45.224211 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fc84e5fe-6bec-4b7c-8dde-8d7c32140e0f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:45.224850 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fc84e5fe-6bec-4b7c-8dde-8d7c32140e0f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:45.242869 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc84e5fe-6bec-4b7c-8dde-8d7c32140e0f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:45.243528 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc84e5fe-6bec-4b7c-8dde-8d7c32140e0f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:45.243923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc84e5fe-6bec-4b7c-8dde-8d7c32140e0f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:45.244598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc84e5fe-6bec-4b7c-8dde-8d7c32140e0f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:45.245078 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc84e5fe-6bec-4b7c-8dde-8d7c32140e0f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:45.245508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc84e5fe-6bec-4b7c-8dde-8d7c32140e0f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:45.812798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fc84e5fe-6bec-4b7c-8dde-8d7c32140e0f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:45.830047 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fc84e5fe-6bec-4b7c-8dde-8d7c32140e0f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:45.834728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fc84e5fe-6bec-4b7c-8dde-8d7c32140e0f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:45.836098 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fc84e5fe-6bec-4b7c-8dde-8d7c32140e0f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1879 microversion: 2.32 time: 0.617623 Oct 29 03:00:45.839419 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1437/3070] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:45 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1879 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:45.851845 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a53749d1-7812-4d1c-a506-fa394fe2425e tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:45.862882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a53749d1-7812-4d1c-a506-fa394fe2425e tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:45.863887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a53749d1-7812-4d1c-a506-fa394fe2425e tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '875f8af161b647758adaebd94449c8c1'} {{(pid=127125) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:00:45.881382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a53749d1-7812-4d1c-a506-fa394fe2425e tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:45.882000 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a53749d1-7812-4d1c-a506-fa394fe2425e tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:45.882968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a53749d1-7812-4d1c-a506-fa394fe2425e tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:45.883825 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a53749d1-7812-4d1c-a506-fa394fe2425e tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:45.884554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a53749d1-7812-4d1c-a506-fa394fe2425e tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:45.886803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a53749d1-7812-4d1c-a506-fa394fe2425e tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:45.955149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.multi_cell_list [None req-a53749d1-7812-4d1c-a506-fa394fe2425e tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:00:46.009472 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a53749d1-7812-4d1c-a506-fa394fe2425e tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.164453 Oct 29 03:00:46.025497 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1438/3071] 10.222.0.46 () {58 vars in 1152 bytes} [Sat Oct 29 03:00:45 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:46.025497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e032949f-9bbe-453a-970d-326168c5a870 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e032949f-9bbe-453a-970d-326168c5a870 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: request: PUT /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 HTTP/1.1 Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 280 Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '5d9854a1-ead6-4570-b801-13c47d0bf721', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:00:46.040346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:46.045155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:46.045155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:46.045155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:46.045155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:46.045155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:46.045155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:46.045155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:00:46.045155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:00:46.045155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 03:00:46.045155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 03:00:46.045155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:00:46.045155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:00:46.045155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:00:46.045155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:00:46.045155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 03:00:46.045155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:00:46.045155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:46.045155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:00:46.045155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:46.045155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:46.045155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:46.045155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:00:46.045155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:00:46.045155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 03:00:46.045155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:00:46.045155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e032949f-9bbe-453a-970d-326168c5a870 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:46.049058 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e032949f-9bbe-453a-970d-326168c5a870 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "PUT /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 400 len: 619 microversion: 2.1 time: 0.028544 Oct 29 03:00:46.052326 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1439/3072] 10.222.0.46 () {60 vars in 1257 bytes} [Sat Oct 29 03:00:46 2022] PUT /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 619 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:00:46.065352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0641ebbe-50b3-4ed7-bcfa-8e7a0688e907 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:46.066118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0641ebbe-50b3-4ed7-bcfa-8e7a0688e907 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:46.083624 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0641ebbe-50b3-4ed7-bcfa-8e7a0688e907 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:46.084263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0641ebbe-50b3-4ed7-bcfa-8e7a0688e907 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:46.084838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0641ebbe-50b3-4ed7-bcfa-8e7a0688e907 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:46.085832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0641ebbe-50b3-4ed7-bcfa-8e7a0688e907 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:46.086522 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0641ebbe-50b3-4ed7-bcfa-8e7a0688e907 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:46.087178 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0641ebbe-50b3-4ed7-bcfa-8e7a0688e907 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:46.526694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0641ebbe-50b3-4ed7-bcfa-8e7a0688e907 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:46.536384 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0641ebbe-50b3-4ed7-bcfa-8e7a0688e907 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1198 microversion: 2.1 time: 0.482579 Oct 29 03:00:46.539730 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1440/3073] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:46 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1198 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:46.550301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-03c07a5d-94ae-4257-a3ab-3b40d8c754bd tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:46.553178 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-03c07a5d-94ae-4257-a3ab-3b40d8c754bd tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:46.567767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03c07a5d-94ae-4257-a3ab-3b40d8c754bd tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:46.570467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03c07a5d-94ae-4257-a3ab-3b40d8c754bd tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:46.571240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03c07a5d-94ae-4257-a3ab-3b40d8c754bd tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:46.573390 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03c07a5d-94ae-4257-a3ab-3b40d8c754bd tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:46.576113 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03c07a5d-94ae-4257-a3ab-3b40d8c754bd tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:46.576882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03c07a5d-94ae-4257-a3ab-3b40d8c754bd tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:46.987698 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-03c07a5d-94ae-4257-a3ab-3b40d8c754bd tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:47.007113 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-03c07a5d-94ae-4257-a3ab-3b40d8c754bd tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 200 len: 1523 microversion: 2.1 time: 0.465403 Oct 29 03:00:47.008354 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1441/3074] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:46 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 1523 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:47.014588 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-097bcd7b-80d7-49c3-bf0f-aeddd0355e17 req-8d44e8e5-651b-4d8c-86c2-23124979d819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ab56816-cc78-4e73-918a-4c76895fed6b", "name": "network-vif-plugged", "status": "completed", "tag": "dbe9ee0b-c11e-4edb-a1e4-5c86a11499da"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:47.054910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-097bcd7b-80d7-49c3-bf0f-aeddd0355e17 req-8d44e8e5-651b-4d8c-86c2-23124979d819 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:47.057923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-097bcd7b-80d7-49c3-bf0f-aeddd0355e17 req-8d44e8e5-651b-4d8c-86c2-23124979d819 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:47.058677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-097bcd7b-80d7-49c3-bf0f-aeddd0355e17 req-8d44e8e5-651b-4d8c-86c2-23124979d819 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:47.095049 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-097bcd7b-80d7-49c3-bf0f-aeddd0355e17 req-8d44e8e5-651b-4d8c-86c2-23124979d819 service nova] Creating event network-vif-plugged:dbe9ee0b-c11e-4edb-a1e4-5c86a11499da for instance 1ab56816-cc78-4e73-918a-4c76895fed6b on n-h1-862967-2 Oct 29 03:00:47.101400 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-097bcd7b-80d7-49c3-bf0f-aeddd0355e17 req-8d44e8e5-651b-4d8c-86c2-23124979d819 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090333 Oct 29 03:00:47.106969 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1442/3075] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:47.124958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5d2bae02-f6eb-48b7-a06f-3b2e34fbe5c3 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:47.146069 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5d2bae02-f6eb-48b7-a06f-3b2e34fbe5c3 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:47.162388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.compute.servers [None req-5d2bae02-f6eb-48b7-a06f-3b2e34fbe5c3 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Removing options 'limit' from query {{(pid=127125) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 29 03:00:47.163771 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5d2bae02-f6eb-48b7-a06f-3b2e34fbe5c3 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Searching by: {'deleted': False, 'project_id': '875f8af161b647758adaebd94449c8c1'} {{(pid=127125) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:00:47.172239 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d2bae02-f6eb-48b7-a06f-3b2e34fbe5c3 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:47.173195 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d2bae02-f6eb-48b7-a06f-3b2e34fbe5c3 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:47.187027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d2bae02-f6eb-48b7-a06f-3b2e34fbe5c3 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:47.188339 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d2bae02-f6eb-48b7-a06f-3b2e34fbe5c3 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:47.190486 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d2bae02-f6eb-48b7-a06f-3b2e34fbe5c3 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:47.192843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d2bae02-f6eb-48b7-a06f-3b2e34fbe5c3 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:47.262305 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.multi_cell_list [None req-5d2bae02-f6eb-48b7-a06f-3b2e34fbe5c3 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:00:47.298507 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:47.327598 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5d2bae02-f6eb-48b7-a06f-3b2e34fbe5c3 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.219008 Oct 29 03:00:47.334226 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1443/3076] 10.222.0.46 () {58 vars in 1150 bytes} [Sat Oct 29 03:00:47 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:47.342923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2a7b4a35-37d6-4bd3-a1bd-fee6c09813fc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:47.343665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2a7b4a35-37d6-4bd3-a1bd-fee6c09813fc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:47.358603 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:47.363892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a7b4a35-37d6-4bd3-a1bd-fee6c09813fc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:47.364318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a7b4a35-37d6-4bd3-a1bd-fee6c09813fc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:47.364827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a7b4a35-37d6-4bd3-a1bd-fee6c09813fc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:47.365557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a7b4a35-37d6-4bd3-a1bd-fee6c09813fc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:47.368286 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a7b4a35-37d6-4bd3-a1bd-fee6c09813fc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:47.368742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a7b4a35-37d6-4bd3-a1bd-fee6c09813fc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:48.097490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2a7b4a35-37d6-4bd3-a1bd-fee6c09813fc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:48.109102 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2a7b4a35-37d6-4bd3-a1bd-fee6c09813fc tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.771794 Oct 29 03:00:48.110882 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1444/3077] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:47 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:48.116093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a2d23d41-b9bf-4f45-8dac-4a5f54917dc7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:48.117393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a2d23d41-b9bf-4f45-8dac-4a5f54917dc7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:48.125220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2d23d41-b9bf-4f45-8dac-4a5f54917dc7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:48.126083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2d23d41-b9bf-4f45-8dac-4a5f54917dc7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:48.126741 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2d23d41-b9bf-4f45-8dac-4a5f54917dc7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:48.127945 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2d23d41-b9bf-4f45-8dac-4a5f54917dc7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:48.128710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2d23d41-b9bf-4f45-8dac-4a5f54917dc7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:48.129390 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2d23d41-b9bf-4f45-8dac-4a5f54917dc7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:48.329091 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a2d23d41-b9bf-4f45-8dac-4a5f54917dc7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:48.341357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a2d23d41-b9bf-4f45-8dac-4a5f54917dc7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:48.344130 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a2d23d41-b9bf-4f45-8dac-4a5f54917dc7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:48.346168 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a2d23d41-b9bf-4f45-8dac-4a5f54917dc7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1808 microversion: 2.20 time: 0.233456 Oct 29 03:00:48.361298 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1445/3078] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:48 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1808 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:48.373315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1cd0d0ec-9081-454d-9431-e3e9ce579e02 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:48.374360 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1cd0d0ec-9081-454d-9431-e3e9ce579e02 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:48.381749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cd0d0ec-9081-454d-9431-e3e9ce579e02 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:48.382595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cd0d0ec-9081-454d-9431-e3e9ce579e02 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:48.383598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cd0d0ec-9081-454d-9431-e3e9ce579e02 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:48.384604 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cd0d0ec-9081-454d-9431-e3e9ce579e02 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:48.385293 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cd0d0ec-9081-454d-9431-e3e9ce579e02 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:48.385917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cd0d0ec-9081-454d-9431-e3e9ce579e02 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:48.447633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:48.714673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1cd0d0ec-9081-454d-9431-e3e9ce579e02 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:48.753784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1cd0d0ec-9081-454d-9431-e3e9ce579e02 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:48.753784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1cd0d0ec-9081-454d-9431-e3e9ce579e02 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:48.753784 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1cd0d0ec-9081-454d-9431-e3e9ce579e02 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1879 microversion: 2.32 time: 0.370660 Oct 29 03:00:48.753784 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1446/3079] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:48 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1879 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:48.763567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5f1b9e92-2870-4946-8bbe-cede6e958dc5 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:48.766640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:48.773098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5f1b9e92-2870-4946-8bbe-cede6e958dc5 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:48.773877 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5f1b9e92-2870-4946-8bbe-cede6e958dc5 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Searching by: {'deleted': False, 'project_id': '875f8af161b647758adaebd94449c8c1'} {{(pid=127125) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:00:48.792397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f1b9e92-2870-4946-8bbe-cede6e958dc5 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:48.794269 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f1b9e92-2870-4946-8bbe-cede6e958dc5 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:48.794803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f1b9e92-2870-4946-8bbe-cede6e958dc5 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:48.795722 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f1b9e92-2870-4946-8bbe-cede6e958dc5 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:48.796255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f1b9e92-2870-4946-8bbe-cede6e958dc5 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:48.796780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f1b9e92-2870-4946-8bbe-cede6e958dc5 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:48.843136 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.multi_cell_list [None req-5f1b9e92-2870-4946-8bbe-cede6e958dc5 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:00:48.940836 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5f1b9e92-2870-4946-8bbe-cede6e958dc5 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.182659 Oct 29 03:00:48.942144 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1447/3080] 10.222.0.46 () {58 vars in 1125 bytes} [Sat Oct 29 03:00:48 2022] GET /compute/v2.1/servers => generated 1010 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:49.066729 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3f0a6a3f-3736-4310-9a31-9d9be890eda9 tempest-ServerGroup264TestJSON-492227252 tempest-ServerGroup264TestJSON-492227252-project] Action: 'create', calling method: .version_select at 0x7ff05c24bca0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:49.108670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-3f0a6a3f-3736-4310-9a31-9d9be890eda9 tempest-ServerGroup264TestJSON-492227252 tempest-ServerGroup264TestJSON-492227252-project] Getting quotas for project 7742e98d7869458785edbdc1f7940ded. Resources: {'server_groups'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:00:49.138140 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-3f0a6a3f-3736-4310-9a31-9d9be890eda9 tempest-ServerGroup264TestJSON-492227252 tempest-ServerGroup264TestJSON-492227252-project] Getting quotas for user 127cbaf7b10e486f9a4c578b87c2dd4a and project 7742e98d7869458785edbdc1f7940ded. Resources: {'server_groups'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:00:49.228368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=85 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:49.252663 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-3f0a6a3f-3736-4310-9a31-9d9be890eda9 tempest-ServerGroup264TestJSON-492227252 tempest-ServerGroup264TestJSON-492227252-project] Getting quotas for project 7742e98d7869458785edbdc1f7940ded. Resources: {'server_groups'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:00:49.262415 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-3f0a6a3f-3736-4310-9a31-9d9be890eda9 tempest-ServerGroup264TestJSON-492227252 tempest-ServerGroup264TestJSON-492227252-project] Getting quotas for user 127cbaf7b10e486f9a4c578b87c2dd4a and project 7742e98d7869458785edbdc1f7940ded. Resources: {'server_groups'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:00:49.290398 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3f0a6a3f-3736-4310-9a31-9d9be890eda9 tempest-ServerGroup264TestJSON-492227252 tempest-ServerGroup264TestJSON-492227252-project] 10.222.0.46 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.346325 Oct 29 03:00:49.292582 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1448/3081] 10.222.0.46 () {62 vars in 1214 bytes} [Sat Oct 29 03:00:48 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:00:49.299810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-64c0b90a-67f9-49af-bb18-c93876bdfbdd tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:49.300790 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-64c0b90a-67f9-49af-bb18-c93876bdfbdd tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:49.324177 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64c0b90a-67f9-49af-bb18-c93876bdfbdd tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:49.325939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64c0b90a-67f9-49af-bb18-c93876bdfbdd tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:49.326634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64c0b90a-67f9-49af-bb18-c93876bdfbdd tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:49.327816 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64c0b90a-67f9-49af-bb18-c93876bdfbdd tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:49.328865 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64c0b90a-67f9-49af-bb18-c93876bdfbdd tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:49.329672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64c0b90a-67f9-49af-bb18-c93876bdfbdd tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:49.598918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-64c0b90a-67f9-49af-bb18-c93876bdfbdd tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:49.609655 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-64c0b90a-67f9-49af-bb18-c93876bdfbdd tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1198 microversion: 2.1 time: 0.315377 Oct 29 03:00:49.610911 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1449/3082] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:49 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1198 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:49.623526 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6bf02482-518a-47b0-b8dd-af3269ce6db0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:49.624560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6bf02482-518a-47b0-b8dd-af3269ce6db0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:49.641123 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bf02482-518a-47b0-b8dd-af3269ce6db0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:49.642057 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bf02482-518a-47b0-b8dd-af3269ce6db0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:49.642740 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bf02482-518a-47b0-b8dd-af3269ce6db0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:49.649020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=14 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:49.650942 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bf02482-518a-47b0-b8dd-af3269ce6db0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:49.651638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bf02482-518a-47b0-b8dd-af3269ce6db0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:49.652306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bf02482-518a-47b0-b8dd-af3269ce6db0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:49.830664 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6bf02482-518a-47b0-b8dd-af3269ce6db0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:49.842256 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6bf02482-518a-47b0-b8dd-af3269ce6db0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 200 len: 1523 microversion: 2.1 time: 0.220855 Oct 29 03:00:49.844201 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1450/3083] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:49 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:49.850277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-45ce932c-d126-421e-8249-9fe8fa4a331a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:49.851560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-45ce932c-d126-421e-8249-9fe8fa4a331a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:49.858972 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45ce932c-d126-421e-8249-9fe8fa4a331a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:49.859814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45ce932c-d126-421e-8249-9fe8fa4a331a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:49.860496 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45ce932c-d126-421e-8249-9fe8fa4a331a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:49.861677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45ce932c-d126-421e-8249-9fe8fa4a331a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:49.862476 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45ce932c-d126-421e-8249-9fe8fa4a331a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:49.863329 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45ce932c-d126-421e-8249-9fe8fa4a331a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:50.032193 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-45ce932c-d126-421e-8249-9fe8fa4a331a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:50.081197 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-45ce932c-d126-421e-8249-9fe8fa4a331a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.235453 Oct 29 03:00:50.105266 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1451/3084] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:49 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:50.112407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4138c219-20f9-46be-b6aa-10513c041cd0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:50.119083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4138c219-20f9-46be-b6aa-10513c041cd0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:50.120212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4138c219-20f9-46be-b6aa-10513c041cd0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '875f8af161b647758adaebd94449c8c1'} {{(pid=127125) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:00:50.148515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4138c219-20f9-46be-b6aa-10513c041cd0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:50.149312 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4138c219-20f9-46be-b6aa-10513c041cd0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:50.149857 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4138c219-20f9-46be-b6aa-10513c041cd0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:50.150754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4138c219-20f9-46be-b6aa-10513c041cd0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:50.151330 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4138c219-20f9-46be-b6aa-10513c041cd0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:50.151879 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4138c219-20f9-46be-b6aa-10513c041cd0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:50.281273 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.multi_cell_list [None req-4138c219-20f9-46be-b6aa-10513c041cd0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:00:50.354908 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4138c219-20f9-46be-b6aa-10513c041cd0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.247727 Oct 29 03:00:50.355509 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1452/3085] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 03:00:50 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:50.361306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-3398be5f-b430-4033-94fd-f0c483e92840 req-c7af3cfc-6866-418b-82d6-447c9262ae3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a79a761-e10f-4a8d-8e33-a21c08c81184", "name": "network-vif-plugged", "status": "completed", "tag": "bf31d1ed-88f4-45a8-b01b-b6122fb270a1"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:50.383261 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3398be5f-b430-4033-94fd-f0c483e92840 req-c7af3cfc-6866-418b-82d6-447c9262ae3b service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:50.383776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3398be5f-b430-4033-94fd-f0c483e92840 req-c7af3cfc-6866-418b-82d6-447c9262ae3b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:50.384213 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3398be5f-b430-4033-94fd-f0c483e92840 req-c7af3cfc-6866-418b-82d6-447c9262ae3b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:50.406158 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-3398be5f-b430-4033-94fd-f0c483e92840 req-c7af3cfc-6866-418b-82d6-447c9262ae3b service nova] Creating event network-vif-plugged:bf31d1ed-88f4-45a8-b01b-b6122fb270a1 for instance 6a79a761-e10f-4a8d-8e33-a21c08c81184 on n-h1-862967-2 Oct 29 03:00:50.412817 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-3398be5f-b430-4033-94fd-f0c483e92840 req-c7af3cfc-6866-418b-82d6-447c9262ae3b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055678 Oct 29 03:00:50.419904 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1453/3086] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:50.428153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8d06de46-6791-4d30-b5ce-e1287cc78a3d tempest-ServerGroup264TestJSON-492227252 tempest-ServerGroup264TestJSON-492227252-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:50.467475 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8d06de46-6791-4d30-b5ce-e1287cc78a3d tempest-ServerGroup264TestJSON-492227252 tempest-ServerGroup264TestJSON-492227252-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.044793 Oct 29 03:00:50.475234 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1454/3087] 10.222.0.46 () {60 vars in 1193 bytes} [Sat Oct 29 03:00:50 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:00:50.486426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-28b23d1a-6b30-40b7-a316-f165c473b4a1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:50.491707 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-28b23d1a-6b30-40b7-a316-f165c473b4a1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:50.515895 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28b23d1a-6b30-40b7-a316-f165c473b4a1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:50.516494 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28b23d1a-6b30-40b7-a316-f165c473b4a1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:50.516976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28b23d1a-6b30-40b7-a316-f165c473b4a1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:50.517724 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28b23d1a-6b30-40b7-a316-f165c473b4a1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:50.518180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28b23d1a-6b30-40b7-a316-f165c473b4a1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:50.518874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28b23d1a-6b30-40b7-a316-f165c473b4a1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:50.807205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-28b23d1a-6b30-40b7-a316-f165c473b4a1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:50.820503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-28b23d1a-6b30-40b7-a316-f165c473b4a1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:50.821988 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-28b23d1a-6b30-40b7-a316-f165c473b4a1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:50.823193 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-28b23d1a-6b30-40b7-a316-f165c473b4a1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1808 microversion: 2.20 time: 0.346872 Oct 29 03:00:50.823761 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1455/3088] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:50 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1808 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:50.856126 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-28d9f7d8-eea4-4d7d-b332-f12ae415a774 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:50.856787 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-28d9f7d8-eea4-4d7d-b332-f12ae415a774 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:50.873141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28d9f7d8-eea4-4d7d-b332-f12ae415a774 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:50.873645 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28d9f7d8-eea4-4d7d-b332-f12ae415a774 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:50.874086 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28d9f7d8-eea4-4d7d-b332-f12ae415a774 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:50.875071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28d9f7d8-eea4-4d7d-b332-f12ae415a774 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:50.875533 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28d9f7d8-eea4-4d7d-b332-f12ae415a774 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:50.875961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28d9f7d8-eea4-4d7d-b332-f12ae415a774 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:51.234060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-28d9f7d8-eea4-4d7d-b332-f12ae415a774 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:51.244255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-28d9f7d8-eea4-4d7d-b332-f12ae415a774 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:51.245751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-28d9f7d8-eea4-4d7d-b332-f12ae415a774 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:51.246986 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-28d9f7d8-eea4-4d7d-b332-f12ae415a774 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1879 microversion: 2.32 time: 0.395612 Oct 29 03:00:51.247645 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1456/3089] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:50 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1879 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:51.266760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ebe139d2-af31-4e06-a074-138907bba10a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ebe139d2-af31-4e06-a074-138907bba10a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: request: PUT /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 HTTP/1.1 Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 24 Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: {"server": {"name": ""}} Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '5d9854a1-ead6-4570-b801-13c47d0bf721', 'body': {'server': {'name': ''}}} Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi '' Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:00:51.279354 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 29 03:00:51.284895 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:00:51.284895 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:51.284895 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:00:51.284895 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:51.284895 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:51.284895 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:51.284895 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:00:51.284895 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:00:51.284895 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 29 03:00:51.284895 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:00:51.288658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ebe139d2-af31-4e06-a074-138907bba10a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:51.291182 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ebe139d2-af31-4e06-a074-138907bba10a tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "PUT /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 400 len: 108 microversion: 2.1 time: 0.042627 Oct 29 03:00:51.293159 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1457/3090] 10.222.0.46 () {60 vars in 1256 bytes} [Sat Oct 29 03:00:51 2022] PUT /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 108 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:00:51.305587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1b9a9380-d6a4-49bf-a086-0d3bd84c3708 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:51.321644 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1b9a9380-d6a4-49bf-a086-0d3bd84c3708 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:51.322863 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.compute.servers [None req-1b9a9380-d6a4-49bf-a086-0d3bd84c3708 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Removing options 'limit' from query {{(pid=127125) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 29 03:00:51.323730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1b9a9380-d6a4-49bf-a086-0d3bd84c3708 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Searching by: {'deleted': False, 'project_id': '875f8af161b647758adaebd94449c8c1'} {{(pid=127125) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:00:51.332340 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b9a9380-d6a4-49bf-a086-0d3bd84c3708 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:51.333149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b9a9380-d6a4-49bf-a086-0d3bd84c3708 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:51.333739 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b9a9380-d6a4-49bf-a086-0d3bd84c3708 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:51.334690 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b9a9380-d6a4-49bf-a086-0d3bd84c3708 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:51.336212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b9a9380-d6a4-49bf-a086-0d3bd84c3708 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:51.336840 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b9a9380-d6a4-49bf-a086-0d3bd84c3708 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:51.375472 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1b9a9380-d6a4-49bf-a086-0d3bd84c3708 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.075460 Oct 29 03:00:51.376315 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1458/3091] 10.222.0.46 () {58 vars in 1140 bytes} [Sat Oct 29 03:00:51 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:51.382404 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-006f11b6-d79d-48c4-8473-034cc0965c4b tempest-ServerGroup264TestJSON-492227252 tempest-ServerGroup264TestJSON-492227252-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:51.395440 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-006f11b6-d79d-48c4-8473-034cc0965c4b tempest-ServerGroup264TestJSON-492227252 tempest-ServerGroup264TestJSON-492227252-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups/92781418-579b-4d56-8aec-5d8d04d781da" status: 200 len: 235 microversion: 2.64 time: 0.017875 Oct 29 03:00:51.402005 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1459/3092] 10.222.0.46 () {60 vars in 1304 bytes} [Sat Oct 29 03:00:51 2022] GET /compute/v2.1/os-server-groups/92781418-579b-4d56-8aec-5d8d04d781da => generated 235 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:00:51.402005 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-07587f66-bce6-4c45-9801-67a1c1c4404c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:51.402841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-07587f66-bce6-4c45-9801-67a1c1c4404c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:51.410831 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07587f66-bce6-4c45-9801-67a1c1c4404c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:51.411409 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07587f66-bce6-4c45-9801-67a1c1c4404c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:51.412405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07587f66-bce6-4c45-9801-67a1c1c4404c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:51.413332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07587f66-bce6-4c45-9801-67a1c1c4404c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:51.413836 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07587f66-bce6-4c45-9801-67a1c1c4404c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:51.414453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07587f66-bce6-4c45-9801-67a1c1c4404c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:51.624811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-07587f66-bce6-4c45-9801-67a1c1c4404c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:51.636060 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-07587f66-bce6-4c45-9801-67a1c1c4404c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1198 microversion: 2.1 time: 0.238294 Oct 29 03:00:51.637429 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1460/3093] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:51 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1198 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:51.642891 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d988c906-0a80-4083-845a-49125886bdda tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:51.643693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d988c906-0a80-4083-845a-49125886bdda tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:51.651634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d988c906-0a80-4083-845a-49125886bdda tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:51.652362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d988c906-0a80-4083-845a-49125886bdda tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:51.653236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d988c906-0a80-4083-845a-49125886bdda tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:51.654468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d988c906-0a80-4083-845a-49125886bdda tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:51.655064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d988c906-0a80-4083-845a-49125886bdda tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:51.655658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d988c906-0a80-4083-845a-49125886bdda tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:51.821568 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d988c906-0a80-4083-845a-49125886bdda tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:51.831837 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d988c906-0a80-4083-845a-49125886bdda tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 200 len: 1523 microversion: 2.1 time: 0.193080 Oct 29 03:00:51.832439 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1461/3094] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:51 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:51.837557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ec5b4aad-a9cd-41c8-9837-ba181d4fb18b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:51.838417 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ec5b4aad-a9cd-41c8-9837-ba181d4fb18b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:51.854695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec5b4aad-a9cd-41c8-9837-ba181d4fb18b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:51.855615 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec5b4aad-a9cd-41c8-9837-ba181d4fb18b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:51.856404 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec5b4aad-a9cd-41c8-9837-ba181d4fb18b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:51.857427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec5b4aad-a9cd-41c8-9837-ba181d4fb18b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:51.858048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec5b4aad-a9cd-41c8-9837-ba181d4fb18b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:51.858475 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec5b4aad-a9cd-41c8-9837-ba181d4fb18b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:52.039633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ec5b4aad-a9cd-41c8-9837-ba181d4fb18b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:52.069005 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ec5b4aad-a9cd-41c8-9837-ba181d4fb18b tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1505 microversion: 2.1 time: 0.232811 Oct 29 03:00:52.072696 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1462/3095] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:51 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1505 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:52.097193 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2266e4f5-7bb5-4035-b8b3-73887643b55e tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:52.113233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2266e4f5-7bb5-4035-b8b3-73887643b55e tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:52.115505 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2266e4f5-7bb5-4035-b8b3-73887643b55e tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1618626768', 'deleted': False, 'project_id': '875f8af161b647758adaebd94449c8c1'} {{(pid=127125) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:00:52.129354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2266e4f5-7bb5-4035-b8b3-73887643b55e tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:52.132595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2266e4f5-7bb5-4035-b8b3-73887643b55e tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:52.133776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2266e4f5-7bb5-4035-b8b3-73887643b55e tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:52.134597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2266e4f5-7bb5-4035-b8b3-73887643b55e tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:52.135085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2266e4f5-7bb5-4035-b8b3-73887643b55e tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:52.135503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2266e4f5-7bb5-4035-b8b3-73887643b55e tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:52.324747 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.multi_cell_list [None req-2266e4f5-7bb5-4035-b8b3-73887643b55e tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:00:52.424961 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2266e4f5-7bb5-4035-b8b3-73887643b55e tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1618626768" status: 200 len: 346 microversion: 2.1 time: 0.349984 Oct 29 03:00:52.426122 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1463/3096] 10.222.0.46 () {58 vars in 1242 bytes} [Sat Oct 29 03:00:52 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1618626768 => generated 346 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:52.431746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9ed2472a-84ae-4284-84e5-92a9fdb387ec tempest-ServerGroup264TestJSON-492227252 tempest-ServerGroup264TestJSON-492227252-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:52.476039 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9ed2472a-84ae-4284-84e5-92a9fdb387ec tempest-ServerGroup264TestJSON-492227252 tempest-ServerGroup264TestJSON-492227252-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/92781418-579b-4d56-8aec-5d8d04d781da" status: 204 len: 0 microversion: 2.64 time: 0.048116 Oct 29 03:00:52.483414 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1464/3097] 10.222.0.46 () {60 vars in 1307 bytes} [Sat Oct 29 03:00:52 2022] DELETE /compute/v2.1/os-server-groups/92781418-579b-4d56-8aec-5d8d04d781da => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:00:52.497526 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a3168d17-6803-42da-b596-3900bafc365b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:52.499397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a3168d17-6803-42da-b596-3900bafc365b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:52.512616 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3168d17-6803-42da-b596-3900bafc365b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:52.513422 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3168d17-6803-42da-b596-3900bafc365b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:52.514504 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3168d17-6803-42da-b596-3900bafc365b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:52.515703 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3168d17-6803-42da-b596-3900bafc365b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:52.516415 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3168d17-6803-42da-b596-3900bafc365b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:52.517113 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3168d17-6803-42da-b596-3900bafc365b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:52.562322 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:52.626602 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-007652a0-4d57-4da2-9339-e00ab684e390 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/917b954f-5d5f-42d2-9717-2d38cda5517c" status: 200 len: 1436 microversion: 2.1 time: 12.919740 Oct 29 03:00:52.627504 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1634/3098] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:00:39 2022] GET /compute/v2.1/images/917b954f-5d5f-42d2-9717-2d38cda5517c => generated 1436 bytes in 12922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:52.638795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5f37166c-2de9-4054-a01e-5da07f7d7226 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:52.639421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5f37166c-2de9-4054-a01e-5da07f7d7226 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:52.659076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f37166c-2de9-4054-a01e-5da07f7d7226 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:52.664108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f37166c-2de9-4054-a01e-5da07f7d7226 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:52.667148 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f37166c-2de9-4054-a01e-5da07f7d7226 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:52.669220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f37166c-2de9-4054-a01e-5da07f7d7226 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:52.672119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f37166c-2de9-4054-a01e-5da07f7d7226 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:52.672598 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f37166c-2de9-4054-a01e-5da07f7d7226 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:52.809138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a3168d17-6803-42da-b596-3900bafc365b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:52.819575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a3168d17-6803-42da-b596-3900bafc365b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:52.821046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a3168d17-6803-42da-b596-3900bafc365b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:52.822255 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a3168d17-6803-42da-b596-3900bafc365b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1808 microversion: 2.20 time: 0.337381 Oct 29 03:00:52.832680 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1465/3099] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:52 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1808 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:52.849277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f94c62f2-80fe-48ff-bc48-d65a852c3193 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:52.872287 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f94c62f2-80fe-48ff-bc48-d65a852c3193 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:52.873183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f94c62f2-80fe-48ff-bc48-d65a852c3193 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:52.873329 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f94c62f2-80fe-48ff-bc48-d65a852c3193 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:53.016872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5f37166c-2de9-4054-a01e-5da07f7d7226 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:53.034014 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5f37166c-2de9-4054-a01e-5da07f7d7226 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:53.036057 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5f37166c-2de9-4054-a01e-5da07f7d7226 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:53.041493 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5f37166c-2de9-4054-a01e-5da07f7d7226 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1879 microversion: 2.32 time: 0.412983 Oct 29 03:00:53.042283 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1635/3100] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:52 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1879 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:53.052008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b7494c0e-ce5d-48ed-8c8c-6172f5aba1b7 tempest-ServerGroup264TestJSON-492227252 tempest-ServerGroup264TestJSON-492227252-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:53.060032 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-b7494c0e-ce5d-48ed-8c8c-6172f5aba1b7 tempest-ServerGroup264TestJSON-492227252 tempest-ServerGroup264TestJSON-492227252-project] HTTP exception thrown: Instance group 92781418-579b-4d56-8aec-5d8d04d781da could not be found. Oct 29 03:00:53.068151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f94c62f2-80fe-48ff-bc48-d65a852c3193 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92] Going to try to stop instance {{(pid=127125) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b7494c0e-ce5d-48ed-8c8c-6172f5aba1b7 tempest-ServerGroup264TestJSON-492227252 tempest-ServerGroup264TestJSON-492227252-project] Request method failure captured: Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/os-server-groups/92781418-579b-4d56-8aec-5d8d04d781da HTTP/1.1 Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJdfr7MKputD5v8KeoQj9pXPsR2OcsRsvUXgR_APT_C6wOGO8ytu-3EAwJOMFc6cwjcPJn-hkasEiXcw8920AeLusk7PsvicoNGtrATk1gIZpKuQtWWcTJ69-9ZCMZQAShvH9yqsMZShWscP7vBDhQ6JG1tvQv40cD_zom5Z8QtuUKI Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: X-Openstack-Nova-Api-Version: 2.64 Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 7742e98d7869458785edbdc1f7940ded Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServerGroup264TestJSON-492227252 Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7742e98d7869458785edbdc1f7940ded"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7742e98d7869458785edbdc1f7940ded"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7742e98d7869458785edbdc1f7940ded"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7742e98d7869458785edbdc1f7940ded"}]}] Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServerGroup264TestJSON-492227252 Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 7742e98d7869458785edbdc1f7940ded Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServerGroup264TestJSON-492227252 Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServerGroup264TestJSON-492227252-project Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 127cbaf7b10e486f9a4c578b87c2dd4a Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServerGroup264TestJSON-492227252-project Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance group 92781418-579b-4d56-8aec-5d8d04d781da could not be found. Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '92781418-579b-4d56-8aec-5d8d04d781da'} Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 92781418-579b-4d56-8aec-5d8d04d781da could not be found. Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 92781418-579b-4d56-8aec-5d8d04d781da could not be found. Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:53.069623 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:00:53.074521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:00:53.074521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:00:53.074521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:00:53.074521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:00:53.074521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 92781418-579b-4d56-8aec-5d8d04d781da could not be found. Oct 29 03:00:53.074521 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:00:53.077467 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b7494c0e-ce5d-48ed-8c8c-6172f5aba1b7 tempest-ServerGroup264TestJSON-492227252 tempest-ServerGroup264TestJSON-492227252-project] Returning 404 to user: Instance group 92781418-579b-4d56-8aec-5d8d04d781da could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:00:53.078540 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b7494c0e-ce5d-48ed-8c8c-6172f5aba1b7 tempest-ServerGroup264TestJSON-492227252 tempest-ServerGroup264TestJSON-492227252-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/92781418-579b-4d56-8aec-5d8d04d781da" status: 404 len: 117 microversion: 2.64 time: 0.034051 Oct 29 03:00:53.084991 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1636/3101] 10.222.0.46 () {60 vars in 1307 bytes} [Sat Oct 29 03:00:53 2022] DELETE /compute/v2.1/os-server-groups/92781418-579b-4d56-8aec-5d8d04d781da => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:00:53.094217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cccd33df-dca8-4ae5-8b12-9ba51bf4abe4 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:53.097335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cccd33df-dca8-4ae5-8b12-9ba51bf4abe4 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:53.115503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cccd33df-dca8-4ae5-8b12-9ba51bf4abe4 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:53.116271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cccd33df-dca8-4ae5-8b12-9ba51bf4abe4 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:53.116979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cccd33df-dca8-4ae5-8b12-9ba51bf4abe4 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:53.118828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cccd33df-dca8-4ae5-8b12-9ba51bf4abe4 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:53.119624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cccd33df-dca8-4ae5-8b12-9ba51bf4abe4 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:53.121168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cccd33df-dca8-4ae5-8b12-9ba51bf4abe4 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:53.181746 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f94c62f2-80fe-48ff-bc48-d65a852c3193 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "POST /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92/action" status: 202 len: 0 microversion: 2.1 time: 0.344948 Oct 29 03:00:53.185286 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1466/3102] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:00:52 2022] POST /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:00:53.223770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4811f81e-c076-448d-bda9-d79f45b04ee8 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:53.224608 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4811f81e-c076-448d-bda9-d79f45b04ee8 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:53.242144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4811f81e-c076-448d-bda9-d79f45b04ee8 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:53.242715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4811f81e-c076-448d-bda9-d79f45b04ee8 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:53.244164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4811f81e-c076-448d-bda9-d79f45b04ee8 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:53.244164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4811f81e-c076-448d-bda9-d79f45b04ee8 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:53.244715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4811f81e-c076-448d-bda9-d79f45b04ee8 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:53.245227 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4811f81e-c076-448d-bda9-d79f45b04ee8 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:53.443511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cccd33df-dca8-4ae5-8b12-9ba51bf4abe4 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:53.453504 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cccd33df-dca8-4ae5-8b12-9ba51bf4abe4 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1382 microversion: 2.1 time: 0.366604 Oct 29 03:00:53.455078 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1637/3103] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:53 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1382 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:53.460085 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b6816b81-7cbc-4f2e-83ae-14d31aa31a30 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:53.461020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b6816b81-7cbc-4f2e-83ae-14d31aa31a30 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:53.467359 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b6816b81-7cbc-4f2e-83ae-14d31aa31a30 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:53.468085 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b6816b81-7cbc-4f2e-83ae-14d31aa31a30 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:53.468832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b6816b81-7cbc-4f2e-83ae-14d31aa31a30 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:53.469744 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b6816b81-7cbc-4f2e-83ae-14d31aa31a30 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:53.470403 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b6816b81-7cbc-4f2e-83ae-14d31aa31a30 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:53.471052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b6816b81-7cbc-4f2e-83ae-14d31aa31a30 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:53.653824 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4811f81e-c076-448d-bda9-d79f45b04ee8 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:53.663382 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4811f81e-c076-448d-bda9-d79f45b04ee8 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 200 len: 1505 microversion: 2.1 time: 0.476887 Oct 29 03:00:53.668474 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1467/3104] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:53 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 1505 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:53.833145 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6c9c18ba-fb30-4944-b8aa-7df339f79c9a tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:53.834170 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6c9c18ba-fb30-4944-b8aa-7df339f79c9a tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:53.853595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c9c18ba-fb30-4944-b8aa-7df339f79c9a tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:53.853595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c9c18ba-fb30-4944-b8aa-7df339f79c9a tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:53.854300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c9c18ba-fb30-4944-b8aa-7df339f79c9a tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:53.855114 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c9c18ba-fb30-4944-b8aa-7df339f79c9a tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:53.855669 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c9c18ba-fb30-4944-b8aa-7df339f79c9a tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:53.856238 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c9c18ba-fb30-4944-b8aa-7df339f79c9a tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:53.975833 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b6816b81-7cbc-4f2e-83ae-14d31aa31a30 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:53.988699 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b6816b81-7cbc-4f2e-83ae-14d31aa31a30 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92" status: 200 len: 1522 microversion: 2.1 time: 0.532214 Oct 29 03:00:53.989956 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1638/3105] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:53 2022] GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 => generated 1522 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:53.995357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c28a4670-7b4c-49b5-bff4-c4a2d93cad06 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff0534721f0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:54.071891 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c28a4670-7b4c-49b5-bff4-c4a2d93cad06 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/917b954f-5d5f-42d2-9717-2d38cda5517c" status: 200 len: 1436 microversion: 2.1 time: 0.080547 Oct 29 03:00:54.073044 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1639/3106] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:00:53 2022] GET /compute/v2.1/images/917b954f-5d5f-42d2-9717-2d38cda5517c => generated 1436 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:54.090912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-00612ac7-14ab-4c14-b083-de67493fee71 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:54.091824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-00612ac7-14ab-4c14-b083-de67493fee71 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:54.099870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00612ac7-14ab-4c14-b083-de67493fee71 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:54.100773 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00612ac7-14ab-4c14-b083-de67493fee71 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:54.101431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00612ac7-14ab-4c14-b083-de67493fee71 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:54.102357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00612ac7-14ab-4c14-b083-de67493fee71 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:54.103009 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00612ac7-14ab-4c14-b083-de67493fee71 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:54.103646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00612ac7-14ab-4c14-b083-de67493fee71 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:54.274418 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6c9c18ba-fb30-4944-b8aa-7df339f79c9a tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1533 microversion: 2.1 time: 0.596740 Oct 29 03:00:54.275720 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1468/3107] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:53 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1533 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:54.298704 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9b0787ba-90ec-4196-adf0-cc4052ea6046 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:54.300179 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9b0787ba-90ec-4196-adf0-cc4052ea6046 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:54.308787 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b0787ba-90ec-4196-adf0-cc4052ea6046 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:54.313601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b0787ba-90ec-4196-adf0-cc4052ea6046 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:54.317050 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b0787ba-90ec-4196-adf0-cc4052ea6046 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:54.318184 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b0787ba-90ec-4196-adf0-cc4052ea6046 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:54.318768 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b0787ba-90ec-4196-adf0-cc4052ea6046 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:54.320605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b0787ba-90ec-4196-adf0-cc4052ea6046 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:54.343521 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-00612ac7-14ab-4c14-b083-de67493fee71 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:54.356950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-00612ac7-14ab-4c14-b083-de67493fee71 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:54.362184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-00612ac7-14ab-4c14-b083-de67493fee71 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:54.368958 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-00612ac7-14ab-4c14-b083-de67493fee71 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1795 microversion: 2.20 time: 0.294438 Oct 29 03:00:54.369829 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1640/3108] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:54 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1795 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:54.374406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-86310329-f13d-4bf2-b4e1-cb6c81013b9b tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:54.376280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-86310329-f13d-4bf2-b4e1-cb6c81013b9b tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:54.391056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86310329-f13d-4bf2-b4e1-cb6c81013b9b tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:54.391820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86310329-f13d-4bf2-b4e1-cb6c81013b9b tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:54.399557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86310329-f13d-4bf2-b4e1-cb6c81013b9b tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:54.400619 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86310329-f13d-4bf2-b4e1-cb6c81013b9b tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:54.401246 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86310329-f13d-4bf2-b4e1-cb6c81013b9b tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:54.401841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86310329-f13d-4bf2-b4e1-cb6c81013b9b tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:54.624680 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-86310329-f13d-4bf2-b4e1-cb6c81013b9b tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1533 microversion: 2.1 time: 0.253559 Oct 29 03:00:54.626114 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1641/3109] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:54 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1533 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:54.649876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0b3ca2b2-0dd2-4878-8af5-9b231e16d970 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:54.654682 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b3ca2b2-0dd2-4878-8af5-9b231e16d970 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:54.655407 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b3ca2b2-0dd2-4878-8af5-9b231e16d970 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:54.656072 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b3ca2b2-0dd2-4878-8af5-9b231e16d970 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:54.657103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b3ca2b2-0dd2-4878-8af5-9b231e16d970 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:54.657780 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b3ca2b2-0dd2-4878-8af5-9b231e16d970 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:54.659354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b3ca2b2-0dd2-4878-8af5-9b231e16d970 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:54.692823 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0b3ca2b2-0dd2-4878-8af5-9b231e16d970 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.047766 Oct 29 03:00:54.704037 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1642/3110] 10.222.0.46 () {58 vars in 1176 bytes} [Sat Oct 29 03:00:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:54.728366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e7eae955-72b9-46ef-998e-e6e883f2f537 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:54.728366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e7eae955-72b9-46ef-998e-e6e883f2f537 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:54.728366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7eae955-72b9-46ef-998e-e6e883f2f537 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:54.728366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7eae955-72b9-46ef-998e-e6e883f2f537 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:54.728366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7eae955-72b9-46ef-998e-e6e883f2f537 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:54.728366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7eae955-72b9-46ef-998e-e6e883f2f537 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:54.728366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7eae955-72b9-46ef-998e-e6e883f2f537 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:54.728366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7eae955-72b9-46ef-998e-e6e883f2f537 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:54.769255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9b0787ba-90ec-4196-adf0-cc4052ea6046 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:54.789313 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9b0787ba-90ec-4196-adf0-cc4052ea6046 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:54.790817 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9b0787ba-90ec-4196-adf0-cc4052ea6046 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:54.791950 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9b0787ba-90ec-4196-adf0-cc4052ea6046 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1879 microversion: 2.32 time: 0.501884 Oct 29 03:00:54.792620 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1469/3111] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:54 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1879 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:54.810782 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2090ae8e-acf0-4fde-a9e1-b523c9814875 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-862967-2", "block_migration": false, "disk_over_commit": false}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:54.813511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2090ae8e-acf0-4fde-a9e1-b523c9814875 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:54.822444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2090ae8e-acf0-4fde-a9e1-b523c9814875 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:54.824807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2090ae8e-acf0-4fde-a9e1-b523c9814875 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:54.825087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2090ae8e-acf0-4fde-a9e1-b523c9814875 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:54.825800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2090ae8e-acf0-4fde-a9e1-b523c9814875 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:54.826259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2090ae8e-acf0-4fde-a9e1-b523c9814875 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:54.826683 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2090ae8e-acf0-4fde-a9e1-b523c9814875 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:54.874430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-2090ae8e-acf0-4fde-a9e1-b523c9814875 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lazy-loading 'flavor' on Instance uuid 6a79a761-e10f-4a8d-8e33-a21c08c81184 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:00:54.895242 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e7eae955-72b9-46ef-998e-e6e883f2f537 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:54.900027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2090ae8e-acf0-4fde-a9e1-b523c9814875 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Going to try to live migrate instance to n-h2-862967-2 {{(pid=127125) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 03:00:54.907621 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e7eae955-72b9-46ef-998e-e6e883f2f537 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 200 len: 1505 microversion: 2.1 time: 0.201966 Oct 29 03:00:54.909976 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1643/3112] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:54 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 1505 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:55.029189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e8f87789-6c53-4499-9a95-06593ef4f7df tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:55.033397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e8f87789-6c53-4499-9a95-06593ef4f7df tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:55.045094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8f87789-6c53-4499-9a95-06593ef4f7df tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:55.046344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8f87789-6c53-4499-9a95-06593ef4f7df tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:55.047983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8f87789-6c53-4499-9a95-06593ef4f7df tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:55.055207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8f87789-6c53-4499-9a95-06593ef4f7df tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:55.056103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8f87789-6c53-4499-9a95-06593ef4f7df tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:55.056983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8f87789-6c53-4499-9a95-06593ef4f7df tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:55.499216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e8f87789-6c53-4499-9a95-06593ef4f7df tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:55.508781 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e8f87789-6c53-4499-9a95-06593ef4f7df tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92" status: 200 len: 1522 microversion: 2.1 time: 0.501097 Oct 29 03:00:55.529761 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1644/3113] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:55 2022] GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 => generated 1522 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:55.539236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-df175cc1-6493-4280-8066-84ae48668e58 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053407f70>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:55.628937 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-df175cc1-6493-4280-8066-84ae48668e58 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/917b954f-5d5f-42d2-9717-2d38cda5517c" status: 200 len: 1445 microversion: 2.1 time: 0.093364 Oct 29 03:00:55.629861 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1645/3114] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:00:55 2022] GET /compute/v2.1/images/917b954f-5d5f-42d2-9717-2d38cda5517c => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:55.642527 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-fbe2141a-e5ef-4997-b722-9e404553fd00 req-c8505214-3f7f-4374-a16a-ff2f854493da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e395101-378a-4976-b087-38ce3f22b912", "name": "network-vif-unplugged", "status": "completed", "tag": "8bb3b984-0aee-4027-aa60-42e7d9894d32"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:55.662762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-fbe2141a-e5ef-4997-b722-9e404553fd00 req-c8505214-3f7f-4374-a16a-ff2f854493da service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:55.663584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-fbe2141a-e5ef-4997-b722-9e404553fd00 req-c8505214-3f7f-4374-a16a-ff2f854493da service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:55.664233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-fbe2141a-e5ef-4997-b722-9e404553fd00 req-c8505214-3f7f-4374-a16a-ff2f854493da service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:55.709052 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-fbe2141a-e5ef-4997-b722-9e404553fd00 req-c8505214-3f7f-4374-a16a-ff2f854493da service nova] Creating event network-vif-unplugged:8bb3b984-0aee-4027-aa60-42e7d9894d32 for instance 6e395101-378a-4976-b087-38ce3f22b912 on n-h2-862967-2 Oct 29 03:00:55.722578 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-fbe2141a-e5ef-4997-b722-9e404553fd00 req-c8505214-3f7f-4374-a16a-ff2f854493da service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089445 Oct 29 03:00:55.727515 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1646/3115] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:00:55.742721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9683439c-67d9-4b05-a0b6-7ca89442af0a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053472820>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:55.842262 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9683439c-67d9-4b05-a0b6-7ca89442af0a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/917b954f-5d5f-42d2-9717-2d38cda5517c" status: 200 len: 1445 microversion: 2.1 time: 0.109956 Oct 29 03:00:55.843697 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1647/3116] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:00:55 2022] GET /compute/v2.1/images/917b954f-5d5f-42d2-9717-2d38cda5517c => generated 1445 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:55.868364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-953d31e2-6a3e-4735-9eab-cfb38fc9d114 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:55.870650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-953d31e2-6a3e-4735-9eab-cfb38fc9d114 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:55.886117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-953d31e2-6a3e-4735-9eab-cfb38fc9d114 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:55.887543 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-953d31e2-6a3e-4735-9eab-cfb38fc9d114 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:55.888202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-953d31e2-6a3e-4735-9eab-cfb38fc9d114 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:55.889155 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-953d31e2-6a3e-4735-9eab-cfb38fc9d114 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:55.889770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-953d31e2-6a3e-4735-9eab-cfb38fc9d114 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:55.890350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-953d31e2-6a3e-4735-9eab-cfb38fc9d114 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:56.236340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-953d31e2-6a3e-4735-9eab-cfb38fc9d114 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:56.258499 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-953d31e2-6a3e-4735-9eab-cfb38fc9d114 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:56.265740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-953d31e2-6a3e-4735-9eab-cfb38fc9d114 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:56.274757 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-953d31e2-6a3e-4735-9eab-cfb38fc9d114 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1879 microversion: 2.32 time: 0.429090 Oct 29 03:00:56.281038 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1648/3117] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:55 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1879 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:56.300429 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-109485b4-22a7-4081-b192-711e84f3f1f0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff05bfd8d30>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:57.358757 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-109485b4-22a7-4081-b192-711e84f3f1f0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "DELETE /compute/v2.1/images/917b954f-5d5f-42d2-9717-2d38cda5517c" status: 204 len: 0 microversion: 2.1 time: 1.076313 Oct 29 03:00:57.363570 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1649/3118] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:56 2022] DELETE /compute/v2.1/images/917b954f-5d5f-42d2-9717-2d38cda5517c => generated 0 bytes in 1079 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:00:57.368300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3087ed97-3ae6-4cfb-854e-0ea067ff8dc4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:57.369586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3087ed97-3ae6-4cfb-854e-0ea067ff8dc4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:57.412803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3087ed97-3ae6-4cfb-854e-0ea067ff8dc4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:57.413800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3087ed97-3ae6-4cfb-854e-0ea067ff8dc4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:57.415724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3087ed97-3ae6-4cfb-854e-0ea067ff8dc4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:57.417659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3087ed97-3ae6-4cfb-854e-0ea067ff8dc4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:57.418939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3087ed97-3ae6-4cfb-854e-0ea067ff8dc4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:57.422860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3087ed97-3ae6-4cfb-854e-0ea067ff8dc4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:57.731313 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3087ed97-3ae6-4cfb-854e-0ea067ff8dc4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:57.741564 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3087ed97-3ae6-4cfb-854e-0ea067ff8dc4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 200 len: 1448 microversion: 2.1 time: 0.379556 Oct 29 03:00:57.742548 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1650/3119] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:57 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 1448 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:57.748428 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-071cd6f4-a723-4fcd-8f9e-a93b30eb6e1c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:57.749257 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-071cd6f4-a723-4fcd-8f9e-a93b30eb6e1c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:57.756029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-071cd6f4-a723-4fcd-8f9e-a93b30eb6e1c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:57.756905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-071cd6f4-a723-4fcd-8f9e-a93b30eb6e1c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:57.758006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-071cd6f4-a723-4fcd-8f9e-a93b30eb6e1c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:57.758975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-071cd6f4-a723-4fcd-8f9e-a93b30eb6e1c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:57.759583 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-071cd6f4-a723-4fcd-8f9e-a93b30eb6e1c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:57.760189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-071cd6f4-a723-4fcd-8f9e-a93b30eb6e1c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:57.995734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-071cd6f4-a723-4fcd-8f9e-a93b30eb6e1c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:58.005473 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-071cd6f4-a723-4fcd-8f9e-a93b30eb6e1c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92" status: 200 len: 1522 microversion: 2.1 time: 0.261250 Oct 29 03:00:58.022609 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1651/3120] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:57 2022] GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:58.028974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-aa93c3e0-68ca-4cd2-855d-d114cd16213d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:58.030358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-aa93c3e0-68ca-4cd2-855d-d114cd16213d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:58.039316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aa93c3e0-68ca-4cd2-855d-d114cd16213d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:58.040241 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aa93c3e0-68ca-4cd2-855d-d114cd16213d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:58.041090 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aa93c3e0-68ca-4cd2-855d-d114cd16213d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:58.042404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aa93c3e0-68ca-4cd2-855d-d114cd16213d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:58.043142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aa93c3e0-68ca-4cd2-855d-d114cd16213d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:58.043581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aa93c3e0-68ca-4cd2-855d-d114cd16213d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:58.285153 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-aa93c3e0-68ca-4cd2-855d-d114cd16213d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:58.297266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-aa93c3e0-68ca-4cd2-855d-d114cd16213d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:58.299789 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-aa93c3e0-68ca-4cd2-855d-d114cd16213d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:58.301212 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-aa93c3e0-68ca-4cd2-855d-d114cd16213d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1879 microversion: 2.32 time: 0.277469 Oct 29 03:00:58.304699 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1652/3121] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:00:58 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1879 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:00:58.329746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-75203064-474e-4a42-96ab-ca4c0739f624 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:58.330262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-75203064-474e-4a42-96ab-ca4c0739f624 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:58.338013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-75203064-474e-4a42-96ab-ca4c0739f624 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:58.338518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-75203064-474e-4a42-96ab-ca4c0739f624 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:58.340020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-75203064-474e-4a42-96ab-ca4c0739f624 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:58.340864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-75203064-474e-4a42-96ab-ca4c0739f624 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:58.341358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-75203064-474e-4a42-96ab-ca4c0739f624 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:58.341817 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-75203064-474e-4a42-96ab-ca4c0739f624 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:58.352144 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2090ae8e-acf0-4fde-a9e1-b523c9814875 tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184/action" status: 202 len: 0 microversion: 2.1 time: 3.558467 Oct 29 03:00:58.354386 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1470/3122] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:00:54 2022] POST /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184/action => generated 0 bytes in 3561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:00:58.360007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6f08c42b-975c-4975-a613-9f833b0cda06 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:58.360942 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6f08c42b-975c-4975-a613-9f833b0cda06 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:58.371713 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f08c42b-975c-4975-a613-9f833b0cda06 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:58.372577 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f08c42b-975c-4975-a613-9f833b0cda06 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:58.373194 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f08c42b-975c-4975-a613-9f833b0cda06 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:58.374286 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f08c42b-975c-4975-a613-9f833b0cda06 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:58.375788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f08c42b-975c-4975-a613-9f833b0cda06 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:58.376491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f08c42b-975c-4975-a613-9f833b0cda06 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:58.387339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-75203064-474e-4a42-96ab-ca4c0739f624 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:00:58.429157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6f08c42b-975c-4975-a613-9f833b0cda06 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:00:58.460723 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.compute.api [None req-6f08c42b-975c-4975-a613-9f833b0cda06 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Working on deleting snapshot 7352ab83-a9ab-456c-a2e5-daab06571df2 from shelved instance... Oct 29 03:00:58.517013 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-75203064-474e-4a42-96ab-ca4c0739f624 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81" status: 204 len: 0 microversion: 2.1 time: 0.210717 Oct 29 03:00:58.517629 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1653/3123] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:00:58 2022] DELETE /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:00:58.531726 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-475743c7-f7de-48e6-aa4c-ccecb327b88f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:58.535056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-475743c7-f7de-48e6-aa4c-ccecb327b88f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:58.548581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-475743c7-f7de-48e6-aa4c-ccecb327b88f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:58.549081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-475743c7-f7de-48e6-aa4c-ccecb327b88f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:58.549604 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-475743c7-f7de-48e6-aa4c-ccecb327b88f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:58.550365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-475743c7-f7de-48e6-aa4c-ccecb327b88f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:58.550863 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-475743c7-f7de-48e6-aa4c-ccecb327b88f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:58.551262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-475743c7-f7de-48e6-aa4c-ccecb327b88f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:58.790712 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-475743c7-f7de-48e6-aa4c-ccecb327b88f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:00:58.802853 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-475743c7-f7de-48e6-aa4c-ccecb327b88f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1392 microversion: 2.1 time: 0.282084 Oct 29 03:00:58.807802 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1654/3124] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:58 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1392 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:00:58.823427 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6b912993-be08-40c0-81bd-682fd49272ac tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1776187465", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "18fc4cb9-056a-42e1-bd8a-e4a27cb291b2"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:00:58.913596 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-6b912993-be08-40c0-81bd-682fd49272ac tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] validate_networks() for [('18fc4cb9-056a-42e1-bd8a-e4a27cb291b2', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:00:59.310601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=12 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:59.334320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6f08c42b-975c-4975-a613-9f833b0cda06 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Doing local delete in cell 5270c754-82e2-4d8e-a02e-4533aa854f76(cell1) {{(pid=127125) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 29 03:00:59.336239 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f08c42b-975c-4975-a613-9f833b0cda06 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:59.337520 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f08c42b-975c-4975-a613-9f833b0cda06 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:59.338930 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f08c42b-975c-4975-a613-9f833b0cda06 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:59.339548 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.compute.api [None req-6f08c42b-975c-4975-a613-9f833b0cda06 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 29 03:00:59.344234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-6f08c42b-975c-4975-a613-9f833b0cda06 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] deallocate_for_instance() {{(pid=127125) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 29 03:00:59.663984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-6b912993-be08-40c0-81bd-682fd49272ac tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:00:59.665062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-6b912993-be08-40c0-81bd-682fd49272ac tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:00:59.665717 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-6b912993-be08-40c0-81bd-682fd49272ac tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:00:59.666286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-6b912993-be08-40c0-81bd-682fd49272ac tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:00:59.666856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-6b912993-be08-40c0-81bd-682fd49272ac tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:00:59.679140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b912993-be08-40c0-81bd-682fd49272ac tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:59.681355 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b912993-be08-40c0-81bd-682fd49272ac tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:59.681968 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b912993-be08-40c0-81bd-682fd49272ac tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:59.693750 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b912993-be08-40c0-81bd-682fd49272ac tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:59.694500 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b912993-be08-40c0-81bd-682fd49272ac tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:59.695097 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b912993-be08-40c0-81bd-682fd49272ac tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:59.731126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-6b912993-be08-40c0-81bd-682fd49272ac tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Getting quotas for project 185d32c10dd845768f4ff70a85680358. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:00:59.740126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-6b912993-be08-40c0-81bd-682fd49272ac tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Getting quotas for user c866f273672846eb8d7f4f2a00269666 and project 185d32c10dd845768f4ff70a85680358. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:00:59.772961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6b912993-be08-40c0-81bd-682fd49272ac tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:00:59.777003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6b912993-be08-40c0-81bd-682fd49272ac tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 28d33b72-926b-49d9-8807-1d2be68c487f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:00:59.889644 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6b912993-be08-40c0-81bd-682fd49272ac tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.077716 Oct 29 03:00:59.890449 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1655/3125] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:00:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:00:59.901633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5ec7f231-c757-4cde-9442-9dc0003d4ed1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:00:59.902651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5ec7f231-c757-4cde-9442-9dc0003d4ed1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:00:59.917726 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ec7f231-c757-4cde-9442-9dc0003d4ed1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:59.918681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ec7f231-c757-4cde-9442-9dc0003d4ed1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:59.919238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ec7f231-c757-4cde-9442-9dc0003d4ed1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:00:59.920190 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ec7f231-c757-4cde-9442-9dc0003d4ed1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:00:59.920758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ec7f231-c757-4cde-9442-9dc0003d4ed1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:00:59.921732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ec7f231-c757-4cde-9442-9dc0003d4ed1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:00.223928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5ec7f231-c757-4cde-9442-9dc0003d4ed1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:00.227857 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:00.237695 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5ec7f231-c757-4cde-9442-9dc0003d4ed1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92" status: 200 len: 1522 microversion: 2.1 time: 0.345746 Oct 29 03:01:00.238353 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1656/3126] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:00:59 2022] GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:00.249386 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e5e15714-8383-412c-998d-7b645ed833f2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:00.250008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e5e15714-8383-412c-998d-7b645ed833f2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:00.268217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e5e15714-8383-412c-998d-7b645ed833f2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:00.271922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e5e15714-8383-412c-998d-7b645ed833f2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:00.273619 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e5e15714-8383-412c-998d-7b645ed833f2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:00.275455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e5e15714-8383-412c-998d-7b645ed833f2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:00.276606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e5e15714-8383-412c-998d-7b645ed833f2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:00.277300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e5e15714-8383-412c-998d-7b645ed833f2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:00.489850 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-6f08c42b-975c-4975-a613-9f833b0cda06 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Updating instance_info_cache with network_info: [] {{(pid=127125) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 03:01:00.956702 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6f08c42b-975c-4975-a613-9f833b0cda06 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 204 len: 0 microversion: 2.1 time: 2.600637 Oct 29 03:01:00.959455 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1471/3127] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:00:58 2022] DELETE /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 0 bytes in 2604 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:01:00.969243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8baae91c-9b98-4993-8330-c9251ecf1c3d tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:00.969790 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8baae91c-9b98-4993-8330-c9251ecf1c3d tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:00.988476 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8baae91c-9b98-4993-8330-c9251ecf1c3d tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:00.989026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8baae91c-9b98-4993-8330-c9251ecf1c3d tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:00.989454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8baae91c-9b98-4993-8330-c9251ecf1c3d tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:00.991525 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8baae91c-9b98-4993-8330-c9251ecf1c3d tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:00.993959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8baae91c-9b98-4993-8330-c9251ecf1c3d tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:00.995271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8baae91c-9b98-4993-8330-c9251ecf1c3d tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:01.244702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8baae91c-9b98-4993-8330-c9251ecf1c3d tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:01.248516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=19,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:01.254818 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8baae91c-9b98-4993-8330-c9251ecf1c3d tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1392 microversion: 2.1 time: 0.294188 Oct 29 03:01:01.255692 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1472/3128] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:00 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1392 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:01.261791 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1915ec32-534b-4a2a-be10-1a27f0453955 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:01.262669 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1915ec32-534b-4a2a-be10-1a27f0453955 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 28d33b72-926b-49d9-8807-1d2be68c487f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:01.268443 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:01.270747 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1915ec32-534b-4a2a-be10-1a27f0453955 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:01.271584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1915ec32-534b-4a2a-be10-1a27f0453955 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:01.272240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1915ec32-534b-4a2a-be10-1a27f0453955 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:01.273159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1915ec32-534b-4a2a-be10-1a27f0453955 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:01.273769 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1915ec32-534b-4a2a-be10-1a27f0453955 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:01.274351 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1915ec32-534b-4a2a-be10-1a27f0453955 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:01.351367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1915ec32-534b-4a2a-be10-1a27f0453955 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:01.359905 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1915ec32-534b-4a2a-be10-1a27f0453955 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/28d33b72-926b-49d9-8807-1d2be68c487f" status: 200 len: 1260 microversion: 2.1 time: 0.102272 Oct 29 03:01:01.360795 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1473/3129] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:01 2022] GET /compute/v2.1/servers/28d33b72-926b-49d9-8807-1d2be68c487f => generated 1260 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:01.382125 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-7dd21988-f22b-48be-8fe9-d932fc12f9f9 req-1cb7a458-8110-4594-8e7b-b2854b646c49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dfcfa12-5d6b-4eda-973a-3be37b2f8a81", "name": "network-vif-unplugged", "status": "completed", "tag": "4e35aeb0-0116-4e55-9d8d-f325c7156e3c"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:01.397990 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7dd21988-f22b-48be-8fe9-d932fc12f9f9 req-1cb7a458-8110-4594-8e7b-b2854b646c49 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:01.398569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7dd21988-f22b-48be-8fe9-d932fc12f9f9 req-1cb7a458-8110-4594-8e7b-b2854b646c49 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:01.399061 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7dd21988-f22b-48be-8fe9-d932fc12f9f9 req-1cb7a458-8110-4594-8e7b-b2854b646c49 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:01.411353 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-7dd21988-f22b-48be-8fe9-d932fc12f9f9 req-1cb7a458-8110-4594-8e7b-b2854b646c49 service nova] Creating event network-vif-unplugged:4e35aeb0-0116-4e55-9d8d-f325c7156e3c for instance 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 on n-h2-862967-2 Oct 29 03:01:01.416613 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-7dd21988-f22b-48be-8fe9-d932fc12f9f9 req-1cb7a458-8110-4594-8e7b-b2854b646c49 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054427 Oct 29 03:01:01.417230 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1474/3130] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:01.425907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-44440123-96bf-49cf-87e8-ce8edf65f6ff tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:01.426841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-44440123-96bf-49cf-87e8-ce8edf65f6ff tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 9e23df79-0a40-4417-9312-723fdb1638d0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:01.433168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44440123-96bf-49cf-87e8-ce8edf65f6ff tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:01.433660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44440123-96bf-49cf-87e8-ce8edf65f6ff tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:01.434083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44440123-96bf-49cf-87e8-ce8edf65f6ff tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:01.434787 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44440123-96bf-49cf-87e8-ce8edf65f6ff tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:01.435238 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44440123-96bf-49cf-87e8-ce8edf65f6ff tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:01.435661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44440123-96bf-49cf-87e8-ce8edf65f6ff tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:01.436634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e5e15714-8383-412c-998d-7b645ed833f2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:01.448983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e5e15714-8383-412c-998d-7b645ed833f2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:01.450720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e5e15714-8383-412c-998d-7b645ed833f2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:01.450857 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-44440123-96bf-49cf-87e8-ce8edf65f6ff tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Instance 9e23df79-0a40-4417-9312-723fdb1638d0 could not be found. Oct 29 03:01:01.452576 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e5e15714-8383-412c-998d-7b645ed833f2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1879 microversion: 2.32 time: 1.213045 Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-44440123-96bf-49cf-87e8-ce8edf65f6ff tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0 HTTP/1.1 Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 9e23df79-0a40-4417-9312-723fdb1638d0 could not be found. Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '9e23df79-0a40-4417-9312-723fdb1638d0'} Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e23df79-0a40-4417-9312-723fdb1638d0 could not be found. Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:01:01.453184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:01:01.458704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e23df79-0a40-4417-9312-723fdb1638d0 could not be found. Oct 29 03:01:01.458704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:01.458704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:01.458704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:01.458704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:01.458704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:01.458704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:01.458704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:01:01.458704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:01:01.458704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e23df79-0a40-4417-9312-723fdb1638d0 could not be found. Oct 29 03:01:01.458704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:01.458704 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-44440123-96bf-49cf-87e8-ce8edf65f6ff tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 404 to user: Instance 9e23df79-0a40-4417-9312-723fdb1638d0 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:01:01.458704 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-44440123-96bf-49cf-87e8-ce8edf65f6ff tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0" status: 404 len: 111 microversion: 2.1 time: 0.034785 Oct 29 03:01:01.458704 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1475/3131] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:01:01 2022] DELETE /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:01:01.464372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-c1ee3aef-4ce9-4816-895d-b00885b29304 req-719b21a4-921e-48d3-9ec6-bdbb5748f391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e395101-378a-4976-b087-38ce3f22b912", "name": "network-vif-deleted", "tag": "8bb3b984-0aee-4027-aa60-42e7d9894d32"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:01.465316 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1657/3132] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:00 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1879 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:01.476477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c1ee3aef-4ce9-4816-895d-b00885b29304 req-719b21a4-921e-48d3-9ec6-bdbb5748f391 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:01.477383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c1ee3aef-4ce9-4816-895d-b00885b29304 req-719b21a4-921e-48d3-9ec6-bdbb5748f391 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:01.478157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c1ee3aef-4ce9-4816-895d-b00885b29304 req-719b21a4-921e-48d3-9ec6-bdbb5748f391 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:01.478747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c3b3dd4f-b54c-44f6-9532-fbf48fea5b51 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:01.479390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c3b3dd4f-b54c-44f6-9532-fbf48fea5b51 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:01.486837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3b3dd4f-b54c-44f6-9532-fbf48fea5b51 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:01.487604 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3b3dd4f-b54c-44f6-9532-fbf48fea5b51 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:01.488230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3b3dd4f-b54c-44f6-9532-fbf48fea5b51 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:01.489133 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3b3dd4f-b54c-44f6-9532-fbf48fea5b51 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:01.489751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3b3dd4f-b54c-44f6-9532-fbf48fea5b51 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:01.490541 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3b3dd4f-b54c-44f6-9532-fbf48fea5b51 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:01.492878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.compute.server_external_events [req-c1ee3aef-4ce9-4816-895d-b00885b29304 req-719b21a4-921e-48d3-9ec6-bdbb5748f391 service nova] Unable to find a host for instance 6e395101-378a-4976-b087-38ce3f22b912. Dropping event network-vif-deleted {{(pid=127125) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 29 03:01:01.493863 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-c1ee3aef-4ce9-4816-895d-b00885b29304 req-719b21a4-921e-48d3-9ec6-bdbb5748f391 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.033357 Oct 29 03:01:01.494523 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1476/3133] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 29 03:01:01.500467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ce7cc0ab-af5b-4001-a005-2797a0a04e80 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:01.501272 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ce7cc0ab-af5b-4001-a005-2797a0a04e80 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:01.507549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce7cc0ab-af5b-4001-a005-2797a0a04e80 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:01.508393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce7cc0ab-af5b-4001-a005-2797a0a04e80 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:01.508899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce7cc0ab-af5b-4001-a005-2797a0a04e80 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:01.509602 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce7cc0ab-af5b-4001-a005-2797a0a04e80 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:01.509719 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-c3b3dd4f-b54c-44f6-9532-fbf48fea5b51 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] HTTP exception thrown: Instance 6e395101-378a-4976-b087-38ce3f22b912 could not be found. Oct 29 03:01:01.510051 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce7cc0ab-af5b-4001-a005-2797a0a04e80 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:01.510472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce7cc0ab-af5b-4001-a005-2797a0a04e80 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c3b3dd4f-b54c-44f6-9532-fbf48fea5b51 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Request method failure captured: Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 HTTP/1.1 Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJaEy18RgNLoRH_Cx5N19ntl_MZAWseAedf6nDvdLqq5Uv9fWq711j0XNb6BgsjwGmwVkwDsYZqRqnlQy1v9Czdk1P2JZBE7MuExsRjBvQLnTgLkLacVPY3yLp9R5pSFE5uStbCf24z3K2C9Y_7prmanNUiQJvOS6fzPpIe1j-F47IQ Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b67fc8dd1f4349ca85422bd9a08d3e06"}]}] Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-DeleteServersTestJSON-485778383 Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 1ee6c4d28f304eab89014b9c46cc555a Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 6e395101-378a-4976-b087-38ce3f22b912 could not be found. Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '6e395101-378a-4976-b087-38ce3f22b912'} Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e395101-378a-4976-b087-38ce3f22b912 could not be found. Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e395101-378a-4976-b087-38ce3f22b912 could not be found. Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:01.511289 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:01.515708 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:01.515708 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:01.515708 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:01.515708 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:01:01.515708 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:01:01.515708 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e395101-378a-4976-b087-38ce3f22b912 could not be found. Oct 29 03:01:01.515708 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:01.515708 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c3b3dd4f-b54c-44f6-9532-fbf48fea5b51 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Returning 404 to user: Instance 6e395101-378a-4976-b087-38ce3f22b912 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:01:01.515708 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c3b3dd4f-b54c-44f6-9532-fbf48fea5b51 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 404 len: 111 microversion: 2.1 time: 0.046200 Oct 29 03:01:01.515708 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1658/3134] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:01 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:01:01.526217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5a7519fc-9155-4d38-88ed-3c16678e94c2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:01.527584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5a7519fc-9155-4d38-88ed-3c16678e94c2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 9e23df79-0a40-4417-9312-723fdb1638d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:01.550829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a7519fc-9155-4d38-88ed-3c16678e94c2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:01.552801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a7519fc-9155-4d38-88ed-3c16678e94c2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:01.557066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a7519fc-9155-4d38-88ed-3c16678e94c2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:01.557983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a7519fc-9155-4d38-88ed-3c16678e94c2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:01.558492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a7519fc-9155-4d38-88ed-3c16678e94c2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:01.559219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a7519fc-9155-4d38-88ed-3c16678e94c2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:01.589271 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-5a7519fc-9155-4d38-88ed-3c16678e94c2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Instance 9e23df79-0a40-4417-9312-723fdb1638d0 could not be found. Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5a7519fc-9155-4d38-88ed-3c16678e94c2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0 HTTP/1.1 Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 9e23df79-0a40-4417-9312-723fdb1638d0 could not be found. Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '9e23df79-0a40-4417-9312-723fdb1638d0'} Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e23df79-0a40-4417-9312-723fdb1638d0 could not be found. Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e23df79-0a40-4417-9312-723fdb1638d0 could not be found. Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:01.591275 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:01.596124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:01.596124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:01.596124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:01.596124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:01:01.596124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:01:01.596124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e23df79-0a40-4417-9312-723fdb1638d0 could not be found. Oct 29 03:01:01.596124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:01.596124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5a7519fc-9155-4d38-88ed-3c16678e94c2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 404 to user: Instance 9e23df79-0a40-4417-9312-723fdb1638d0 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:01:01.596124 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5a7519fc-9155-4d38-88ed-3c16678e94c2 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0" status: 404 len: 111 microversion: 2.1 time: 0.078111 Oct 29 03:01:01.596124 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1659/3135] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:01 2022] GET /compute/v2.1/servers/9e23df79-0a40-4417-9312-723fdb1638d0 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:01:01.606876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-100d0d04-2cd0-4035-9e11-e933019ff897 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:01.607380 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-100d0d04-2cd0-4035-9e11-e933019ff897 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:01.619879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-100d0d04-2cd0-4035-9e11-e933019ff897 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:01.620389 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-100d0d04-2cd0-4035-9e11-e933019ff897 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:01.629802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-100d0d04-2cd0-4035-9e11-e933019ff897 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:01.632593 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-100d0d04-2cd0-4035-9e11-e933019ff897 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:01.633628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-100d0d04-2cd0-4035-9e11-e933019ff897 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:01.634330 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-100d0d04-2cd0-4035-9e11-e933019ff897 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:01.669435 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-100d0d04-2cd0-4035-9e11-e933019ff897 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:01:01.710678 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ce7cc0ab-af5b-4001-a005-2797a0a04e80 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:01.720215 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ce7cc0ab-af5b-4001-a005-2797a0a04e80 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92" status: 200 len: 1522 microversion: 2.1 time: 0.224426 Oct 29 03:01:01.737589 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1477/3136] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:01 2022] GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:01.743174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dcd7a6b4-04e4-41f0-b841-069fb0f1b6c3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-522686298", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "2f016d14-d67d-40f5-811c-d451a32578a4"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:01.810876 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-100d0d04-2cd0-4035-9e11-e933019ff897 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 204 len: 0 microversion: 2.1 time: 0.209066 Oct 29 03:01:01.811976 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1660/3137] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:01:01 2022] DELETE /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:01:01.823569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-469f502d-8522-4e29-9ed1-3e430f8d5068 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:01.825990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-469f502d-8522-4e29-9ed1-3e430f8d5068 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:01.839453 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-469f502d-8522-4e29-9ed1-3e430f8d5068 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:01.840040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-469f502d-8522-4e29-9ed1-3e430f8d5068 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:01.844864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-dcd7a6b4-04e4-41f0-b841-069fb0f1b6c3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] validate_networks() for [('2f016d14-d67d-40f5-811c-d451a32578a4', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:01:01.848706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-469f502d-8522-4e29-9ed1-3e430f8d5068 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:01.850229 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-469f502d-8522-4e29-9ed1-3e430f8d5068 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:01.851029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-469f502d-8522-4e29-9ed1-3e430f8d5068 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:01.851685 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-469f502d-8522-4e29-9ed1-3e430f8d5068 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:02.167735 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=16 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:02.190457 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-469f502d-8522-4e29-9ed1-3e430f8d5068 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:02.204675 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-469f502d-8522-4e29-9ed1-3e430f8d5068 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1511 microversion: 2.1 time: 0.387933 Oct 29 03:01:02.221547 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1661/3138] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:01 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1511 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:02.586511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-d685fbad-1d3c-4a57-995c-adc17204a233 req-42220ea8-936a-4c80-aa5b-d06f5823c3b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dfcfa12-5d6b-4eda-973a-3be37b2f8a81", "name": "network-vif-deleted", "tag": "4e35aeb0-0116-4e55-9d8d-f325c7156e3c"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:02.608679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d685fbad-1d3c-4a57-995c-adc17204a233 req-42220ea8-936a-4c80-aa5b-d06f5823c3b5 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:02.609162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d685fbad-1d3c-4a57-995c-adc17204a233 req-42220ea8-936a-4c80-aa5b-d06f5823c3b5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:02.609590 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d685fbad-1d3c-4a57-995c-adc17204a233 req-42220ea8-936a-4c80-aa5b-d06f5823c3b5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:02.628989 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-d685fbad-1d3c-4a57-995c-adc17204a233 req-42220ea8-936a-4c80-aa5b-d06f5823c3b5 service nova] Creating event network-vif-deleted:4e35aeb0-0116-4e55-9d8d-f325c7156e3c for instance 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 on n-h2-862967-2 Oct 29 03:01:02.636001 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-d685fbad-1d3c-4a57-995c-adc17204a233 req-42220ea8-936a-4c80-aa5b-d06f5823c3b5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.413055 Oct 29 03:01:02.637548 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1662/3139] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:02.654630 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ae974e8e-24d7-4a5a-af0a-c0fa3695a5aa tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:02.655382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ae974e8e-24d7-4a5a-af0a-c0fa3695a5aa tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:02.666754 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae974e8e-24d7-4a5a-af0a-c0fa3695a5aa tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:02.667871 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae974e8e-24d7-4a5a-af0a-c0fa3695a5aa tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:02.668715 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae974e8e-24d7-4a5a-af0a-c0fa3695a5aa tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:02.670986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae974e8e-24d7-4a5a-af0a-c0fa3695a5aa tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:02.672035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae974e8e-24d7-4a5a-af0a-c0fa3695a5aa tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:02.673357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae974e8e-24d7-4a5a-af0a-c0fa3695a5aa tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:02.737394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-dcd7a6b4-04e4-41f0-b841-069fb0f1b6c3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:01:02.738938 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-dcd7a6b4-04e4-41f0-b841-069fb0f1b6c3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:01:02.739681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-dcd7a6b4-04e4-41f0-b841-069fb0f1b6c3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:01:02.740311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-dcd7a6b4-04e4-41f0-b841-069fb0f1b6c3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:01:02.740984 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-dcd7a6b4-04e4-41f0-b841-069fb0f1b6c3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:01:02.751122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dcd7a6b4-04e4-41f0-b841-069fb0f1b6c3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:02.752347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dcd7a6b4-04e4-41f0-b841-069fb0f1b6c3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:02.753098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dcd7a6b4-04e4-41f0-b841-069fb0f1b6c3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:02.754084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dcd7a6b4-04e4-41f0-b841-069fb0f1b6c3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:02.754742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dcd7a6b4-04e4-41f0-b841-069fb0f1b6c3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:02.755363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dcd7a6b4-04e4-41f0-b841-069fb0f1b6c3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:02.775441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-dcd7a6b4-04e4-41f0-b841-069fb0f1b6c3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Getting quotas for project b67fc8dd1f4349ca85422bd9a08d3e06. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:01:02.781855 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-dcd7a6b4-04e4-41f0-b841-069fb0f1b6c3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Getting quotas for user 1ee6c4d28f304eab89014b9c46cc555a and project b67fc8dd1f4349ca85422bd9a08d3e06. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:01:02.819239 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dcd7a6b4-04e4-41f0-b841-069fb0f1b6c3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:01:02.829513 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dcd7a6b4-04e4-41f0-b841-069fb0f1b6c3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:01:02.892243 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dcd7a6b4-04e4-41f0-b841-069fb0f1b6c3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.152764 Oct 29 03:01:02.893562 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1478/3140] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:01:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:01:02.904629 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9cb3d5a9-31f5-4d46-b3a1-a8310a283959 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:02.905929 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9cb3d5a9-31f5-4d46-b3a1-a8310a283959 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 28d33b72-926b-49d9-8807-1d2be68c487f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:02.914504 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cb3d5a9-31f5-4d46-b3a1-a8310a283959 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:02.914921 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cb3d5a9-31f5-4d46-b3a1-a8310a283959 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:02.915558 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cb3d5a9-31f5-4d46-b3a1-a8310a283959 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:02.917694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cb3d5a9-31f5-4d46-b3a1-a8310a283959 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:02.918571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cb3d5a9-31f5-4d46-b3a1-a8310a283959 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:02.919317 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cb3d5a9-31f5-4d46-b3a1-a8310a283959 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:03.060873 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9cb3d5a9-31f5-4d46-b3a1-a8310a283959 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:03.071112 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9cb3d5a9-31f5-4d46-b3a1-a8310a283959 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/28d33b72-926b-49d9-8807-1d2be68c487f" status: 200 len: 1266 microversion: 2.1 time: 0.176203 Oct 29 03:01:03.073106 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1479/3141] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:02 2022] GET /compute/v2.1/servers/28d33b72-926b-49d9-8807-1d2be68c487f => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:03.081816 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3bca7bac-d524-4239-9161-b16af2ec2d74 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:03.085161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3bca7bac-d524-4239-9161-b16af2ec2d74 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:03.114252 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bca7bac-d524-4239-9161-b16af2ec2d74 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:03.118335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bca7bac-d524-4239-9161-b16af2ec2d74 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:03.126974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ae974e8e-24d7-4a5a-af0a-c0fa3695a5aa tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:03.167090 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ae974e8e-24d7-4a5a-af0a-c0fa3695a5aa tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1392 microversion: 2.1 time: 0.528735 Oct 29 03:01:03.168941 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bca7bac-d524-4239-9161-b16af2ec2d74 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:03.170220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bca7bac-d524-4239-9161-b16af2ec2d74 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:03.171121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bca7bac-d524-4239-9161-b16af2ec2d74 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:03.172280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bca7bac-d524-4239-9161-b16af2ec2d74 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:03.184727 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1663/3142] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:02 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1392 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:03.220391 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bc70ee79-2609-479a-9cdf-d9169c3dfa6c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:03.229569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bc70ee79-2609-479a-9cdf-d9169c3dfa6c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:03.241037 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc70ee79-2609-479a-9cdf-d9169c3dfa6c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:03.246443 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc70ee79-2609-479a-9cdf-d9169c3dfa6c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:03.247028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc70ee79-2609-479a-9cdf-d9169c3dfa6c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:03.249721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc70ee79-2609-479a-9cdf-d9169c3dfa6c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:03.253236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc70ee79-2609-479a-9cdf-d9169c3dfa6c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:03.257161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc70ee79-2609-479a-9cdf-d9169c3dfa6c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:03.704449 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3bca7bac-d524-4239-9161-b16af2ec2d74 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:03.722536 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3bca7bac-d524-4239-9161-b16af2ec2d74 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:03.725204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3bca7bac-d524-4239-9161-b16af2ec2d74 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:03.726660 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3bca7bac-d524-4239-9161-b16af2ec2d74 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1879 microversion: 2.32 time: 0.652319 Oct 29 03:01:03.733273 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1480/3143] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:03 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1879 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:03.749128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fe114e93-45ab-4c7b-8173-4f125f362235 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:03.749796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fe114e93-45ab-4c7b-8173-4f125f362235 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:03.802678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bc70ee79-2609-479a-9cdf-d9169c3dfa6c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:03.819449 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bc70ee79-2609-479a-9cdf-d9169c3dfa6c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92" status: 200 len: 1522 microversion: 2.1 time: 0.626088 Oct 29 03:01:03.821322 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1664/3144] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:03 2022] GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 => generated 1522 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:03.838818 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ef35cca7-4882-4772-aeb5-9ab12d96ce80 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:03.839562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ef35cca7-4882-4772-aeb5-9ab12d96ce80 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:03.844173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fe114e93-45ab-4c7b-8173-4f125f362235 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:03.850920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef35cca7-4882-4772-aeb5-9ab12d96ce80 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:03.853286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef35cca7-4882-4772-aeb5-9ab12d96ce80 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:03.856382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef35cca7-4882-4772-aeb5-9ab12d96ce80 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:03.857261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef35cca7-4882-4772-aeb5-9ab12d96ce80 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:03.857870 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fe114e93-45ab-4c7b-8173-4f125f362235 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1214 microversion: 2.1 time: 0.122800 Oct 29 03:01:03.859103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef35cca7-4882-4772-aeb5-9ab12d96ce80 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:03.859319 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1481/3145] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:03 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1214 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:03.861392 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef35cca7-4882-4772-aeb5-9ab12d96ce80 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:04.097852 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9d60b1fb-0dd0-48e5-a86b-fd8293bdaff8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:04.101258 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9d60b1fb-0dd0-48e5-a86b-fd8293bdaff8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 28d33b72-926b-49d9-8807-1d2be68c487f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:04.114043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d60b1fb-0dd0-48e5-a86b-fd8293bdaff8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:04.120579 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d60b1fb-0dd0-48e5-a86b-fd8293bdaff8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:04.121873 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d60b1fb-0dd0-48e5-a86b-fd8293bdaff8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:04.124879 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d60b1fb-0dd0-48e5-a86b-fd8293bdaff8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:04.125526 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d60b1fb-0dd0-48e5-a86b-fd8293bdaff8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:04.126163 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d60b1fb-0dd0-48e5-a86b-fd8293bdaff8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:04.220900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ef35cca7-4882-4772-aeb5-9ab12d96ce80 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:04.232774 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ef35cca7-4882-4772-aeb5-9ab12d96ce80 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1511 microversion: 2.1 time: 0.407910 Oct 29 03:01:04.233997 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1665/3146] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:03 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1511 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:04.248329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bbe3dd03-0b1e-48b3-89d0-847ffd96976b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:04.249384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bbe3dd03-0b1e-48b3-89d0-847ffd96976b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:04.261079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbe3dd03-0b1e-48b3-89d0-847ffd96976b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:04.262831 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbe3dd03-0b1e-48b3-89d0-847ffd96976b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:04.263539 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbe3dd03-0b1e-48b3-89d0-847ffd96976b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:04.265082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbe3dd03-0b1e-48b3-89d0-847ffd96976b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:04.269922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbe3dd03-0b1e-48b3-89d0-847ffd96976b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:04.271166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbe3dd03-0b1e-48b3-89d0-847ffd96976b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:04.599359 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bbe3dd03-0b1e-48b3-89d0-847ffd96976b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:04.619537 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bbe3dd03-0b1e-48b3-89d0-847ffd96976b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1392 microversion: 2.1 time: 0.383142 Oct 29 03:01:04.620597 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1666/3147] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:04 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1392 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:04.764437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-39691c7b-9aad-42c1-be21-2b2032410b12 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:04.765331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-39691c7b-9aad-42c1-be21-2b2032410b12 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:04.781076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39691c7b-9aad-42c1-be21-2b2032410b12 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:04.781847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39691c7b-9aad-42c1-be21-2b2032410b12 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:04.782501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39691c7b-9aad-42c1-be21-2b2032410b12 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:04.783740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39691c7b-9aad-42c1-be21-2b2032410b12 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:04.784423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39691c7b-9aad-42c1-be21-2b2032410b12 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:04.785228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39691c7b-9aad-42c1-be21-2b2032410b12 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:04.916914 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9d60b1fb-0dd0-48e5-a86b-fd8293bdaff8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:04.927886 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9d60b1fb-0dd0-48e5-a86b-fd8293bdaff8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/28d33b72-926b-49d9-8807-1d2be68c487f" status: 200 len: 1308 microversion: 2.1 time: 0.835720 Oct 29 03:01:04.941158 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1482/3148] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:04 2022] GET /compute/v2.1/servers/28d33b72-926b-49d9-8807-1d2be68c487f => generated 1308 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:04.946074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fcf9daf5-768f-4d3f-8062-54bd6b10d176 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:04.946948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fcf9daf5-768f-4d3f-8062-54bd6b10d176 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:04.971707 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fcf9daf5-768f-4d3f-8062-54bd6b10d176 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:04.974260 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fcf9daf5-768f-4d3f-8062-54bd6b10d176 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:04.977885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fcf9daf5-768f-4d3f-8062-54bd6b10d176 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:04.978736 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fcf9daf5-768f-4d3f-8062-54bd6b10d176 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:04.981973 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fcf9daf5-768f-4d3f-8062-54bd6b10d176 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:04.984297 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fcf9daf5-768f-4d3f-8062-54bd6b10d176 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:05.287915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-39691c7b-9aad-42c1-be21-2b2032410b12 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:05.317744 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-39691c7b-9aad-42c1-be21-2b2032410b12 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:05.323821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-39691c7b-9aad-42c1-be21-2b2032410b12 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:05.331502 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-39691c7b-9aad-42c1-be21-2b2032410b12 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1879 microversion: 2.32 time: 0.572516 Oct 29 03:01:05.332266 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1667/3149] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:04 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1879 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:01:05.340974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-94647270-0674-4ef2-83ea-f7242da6cee7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:05.341844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-94647270-0674-4ef2-83ea-f7242da6cee7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:05.355925 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-94647270-0674-4ef2-83ea-f7242da6cee7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:05.356616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-94647270-0674-4ef2-83ea-f7242da6cee7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:05.361923 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-94647270-0674-4ef2-83ea-f7242da6cee7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:05.363559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-94647270-0674-4ef2-83ea-f7242da6cee7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:05.365461 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-94647270-0674-4ef2-83ea-f7242da6cee7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:05.375326 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-94647270-0674-4ef2-83ea-f7242da6cee7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:05.451145 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fcf9daf5-768f-4d3f-8062-54bd6b10d176 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:05.462350 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fcf9daf5-768f-4d3f-8062-54bd6b10d176 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92" status: 200 len: 1522 microversion: 2.1 time: 0.527245 Oct 29 03:01:05.470486 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1483/3150] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:04 2022] GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 => generated 1522 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:05.476096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-c89bc44c-a712-4161-85ee-e3ae543695a3 req-7fe10074-594a-4887-9850-2c484a5e3d5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28d33b72-926b-49d9-8807-1d2be68c487f", "tag": "5a2e20a8-d25a-49ae-9802-e29f037f1ef2"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:05.510569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c89bc44c-a712-4161-85ee-e3ae543695a3 req-7fe10074-594a-4887-9850-2c484a5e3d5c service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:05.511066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c89bc44c-a712-4161-85ee-e3ae543695a3 req-7fe10074-594a-4887-9850-2c484a5e3d5c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:05.514494 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c89bc44c-a712-4161-85ee-e3ae543695a3 req-7fe10074-594a-4887-9850-2c484a5e3d5c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:05.537981 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-c89bc44c-a712-4161-85ee-e3ae543695a3 req-7fe10074-594a-4887-9850-2c484a5e3d5c service nova] Creating event network-changed:5a2e20a8-d25a-49ae-9802-e29f037f1ef2 for instance 28d33b72-926b-49d9-8807-1d2be68c487f on n-h2-862967-2 Oct 29 03:01:05.551061 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-c89bc44c-a712-4161-85ee-e3ae543695a3 req-7fe10074-594a-4887-9850-2c484a5e3d5c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078791 Oct 29 03:01:05.553476 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1484/3151] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:05.563951 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d71d9bc8-d85a-420d-b24d-68f3791cd7f6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:05.569277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d71d9bc8-d85a-420d-b24d-68f3791cd7f6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:05.577825 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d71d9bc8-d85a-420d-b24d-68f3791cd7f6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:05.578628 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d71d9bc8-d85a-420d-b24d-68f3791cd7f6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:05.579215 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d71d9bc8-d85a-420d-b24d-68f3791cd7f6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:05.580725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d71d9bc8-d85a-420d-b24d-68f3791cd7f6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:05.581335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d71d9bc8-d85a-420d-b24d-68f3791cd7f6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:05.581996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d71d9bc8-d85a-420d-b24d-68f3791cd7f6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:05.667881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-94647270-0674-4ef2-83ea-f7242da6cee7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:05.677044 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-94647270-0674-4ef2-83ea-f7242da6cee7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1284 microversion: 2.1 time: 0.343551 Oct 29 03:01:05.689674 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1668/3152] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:05 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1284 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:05.694883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b541ccb0-4e4e-4da9-8d75-af2175189ac6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:05.695700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b541ccb0-4e4e-4da9-8d75-af2175189ac6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:05.703747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b541ccb0-4e4e-4da9-8d75-af2175189ac6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:05.709777 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b541ccb0-4e4e-4da9-8d75-af2175189ac6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:05.710487 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b541ccb0-4e4e-4da9-8d75-af2175189ac6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:05.711413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b541ccb0-4e4e-4da9-8d75-af2175189ac6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:05.712035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b541ccb0-4e4e-4da9-8d75-af2175189ac6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:05.713011 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b541ccb0-4e4e-4da9-8d75-af2175189ac6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:05.741509 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d71d9bc8-d85a-420d-b24d-68f3791cd7f6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:05.752671 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d71d9bc8-d85a-420d-b24d-68f3791cd7f6 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1469 microversion: 2.1 time: 0.192633 Oct 29 03:01:05.771093 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1485/3153] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:05 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1469 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:05.953940 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-887bd91a-ad24-4484-9bf6-219dc08df632 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:05.954669 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-887bd91a-ad24-4484-9bf6-219dc08df632 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 28d33b72-926b-49d9-8807-1d2be68c487f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:05.973844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-887bd91a-ad24-4484-9bf6-219dc08df632 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:05.974332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-887bd91a-ad24-4484-9bf6-219dc08df632 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:05.974767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-887bd91a-ad24-4484-9bf6-219dc08df632 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:05.975472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-887bd91a-ad24-4484-9bf6-219dc08df632 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:05.983871 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-887bd91a-ad24-4484-9bf6-219dc08df632 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:05.984619 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-887bd91a-ad24-4484-9bf6-219dc08df632 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:06.277568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b541ccb0-4e4e-4da9-8d75-af2175189ac6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:06.293855 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b541ccb0-4e4e-4da9-8d75-af2175189ac6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1392 microversion: 2.1 time: 0.602764 Oct 29 03:01:06.294447 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1669/3154] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:05 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1392 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:06.350004 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-887bd91a-ad24-4484-9bf6-219dc08df632 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:06.366956 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f662ff81-dc0d-4ce2-8426-51de79bb4522 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:06.367845 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f662ff81-dc0d-4ce2-8426-51de79bb4522 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:06.374965 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-887bd91a-ad24-4484-9bf6-219dc08df632 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/28d33b72-926b-49d9-8807-1d2be68c487f" status: 200 len: 1308 microversion: 2.1 time: 0.423915 Oct 29 03:01:06.377363 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1486/3155] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:05 2022] GET /compute/v2.1/servers/28d33b72-926b-49d9-8807-1d2be68c487f => generated 1308 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:01:06.390061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f662ff81-dc0d-4ce2-8426-51de79bb4522 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:06.390061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f662ff81-dc0d-4ce2-8426-51de79bb4522 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:06.390061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f662ff81-dc0d-4ce2-8426-51de79bb4522 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:06.390061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f662ff81-dc0d-4ce2-8426-51de79bb4522 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:06.390061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f662ff81-dc0d-4ce2-8426-51de79bb4522 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:06.390061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f662ff81-dc0d-4ce2-8426-51de79bb4522 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:06.498516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c16b5e81-2ab2-4ef8-9b21-c955b62d6a6c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:06.499508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c16b5e81-2ab2-4ef8-9b21-c955b62d6a6c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:06.512172 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c16b5e81-2ab2-4ef8-9b21-c955b62d6a6c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:06.514100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c16b5e81-2ab2-4ef8-9b21-c955b62d6a6c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:06.515473 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c16b5e81-2ab2-4ef8-9b21-c955b62d6a6c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:06.517260 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c16b5e81-2ab2-4ef8-9b21-c955b62d6a6c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:06.517925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c16b5e81-2ab2-4ef8-9b21-c955b62d6a6c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:06.518556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c16b5e81-2ab2-4ef8-9b21-c955b62d6a6c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:06.760840 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f662ff81-dc0d-4ce2-8426-51de79bb4522 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:06.813192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f662ff81-dc0d-4ce2-8426-51de79bb4522 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:06.817122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c16b5e81-2ab2-4ef8-9b21-c955b62d6a6c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:06.823562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f662ff81-dc0d-4ce2-8426-51de79bb4522 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:06.826091 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f662ff81-dc0d-4ce2-8426-51de79bb4522 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1879 microversion: 2.32 time: 0.463219 Oct 29 03:01:06.828434 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1670/3156] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:06 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1879 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:01:06.834146 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c16b5e81-2ab2-4ef8-9b21-c955b62d6a6c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92" status: 200 len: 1522 microversion: 2.1 time: 0.343374 Oct 29 03:01:06.835098 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1487/3157] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:06 2022] GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:01:06.847158 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0ecbec8b-ae83-4d51-b998-1e13e545cd28 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:06.848345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0ecbec8b-ae83-4d51-b998-1e13e545cd28 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:06.855887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ecbec8b-ae83-4d51-b998-1e13e545cd28 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:06.857640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ecbec8b-ae83-4d51-b998-1e13e545cd28 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:06.858514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ecbec8b-ae83-4d51-b998-1e13e545cd28 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:06.859544 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ecbec8b-ae83-4d51-b998-1e13e545cd28 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:06.860213 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ecbec8b-ae83-4d51-b998-1e13e545cd28 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:06.860837 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ecbec8b-ae83-4d51-b998-1e13e545cd28 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:06.861104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-95e2f817-b649-4b6c-ad3d-751bb722c821 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:06.862091 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-95e2f817-b649-4b6c-ad3d-751bb722c821 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:06.872318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95e2f817-b649-4b6c-ad3d-751bb722c821 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:06.873531 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95e2f817-b649-4b6c-ad3d-751bb722c821 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:06.874167 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95e2f817-b649-4b6c-ad3d-751bb722c821 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:06.875794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95e2f817-b649-4b6c-ad3d-751bb722c821 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:06.876494 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95e2f817-b649-4b6c-ad3d-751bb722c821 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:06.882277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95e2f817-b649-4b6c-ad3d-751bb722c821 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:06.929909 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ecbec8b-ae83-4d51-b998-1e13e545cd28 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:06.931260 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ecbec8b-ae83-4d51-b998-1e13e545cd28 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:06.931892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ecbec8b-ae83-4d51-b998-1e13e545cd28 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:06.933180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-0ecbec8b-ae83-4d51-b998-1e13e545cd28 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lazy-loading 'fault' on Instance uuid 5d9854a1-ead6-4570-b801-13c47d0bf721 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:01:07.051840 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0ecbec8b-ae83-4d51-b998-1e13e545cd28 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3507c0ada3424029805469182f328379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fab9e02a4cb341348f0611afa2293cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:07.071536 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0ecbec8b-ae83-4d51-b998-1e13e545cd28 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 200 len: 1306 microversion: 2.1 time: 0.234976 Oct 29 03:01:07.072888 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1488/3158] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:06 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 1306 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:07.162594 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-95e2f817-b649-4b6c-ad3d-751bb722c821 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:07.176145 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-95e2f817-b649-4b6c-ad3d-751bb722c821 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1272 microversion: 2.1 time: 0.321522 Oct 29 03:01:07.192445 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1671/3159] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:06 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1272 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:07.321350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e6c0197f-c9ac-4d11-8447-001ca4ce943b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:07.322169 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e6c0197f-c9ac-4d11-8447-001ca4ce943b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:07.334365 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6c0197f-c9ac-4d11-8447-001ca4ce943b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:07.334853 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6c0197f-c9ac-4d11-8447-001ca4ce943b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:07.335317 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6c0197f-c9ac-4d11-8447-001ca4ce943b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:07.336018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6c0197f-c9ac-4d11-8447-001ca4ce943b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:07.336464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6c0197f-c9ac-4d11-8447-001ca4ce943b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:07.336948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6c0197f-c9ac-4d11-8447-001ca4ce943b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:07.403134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d3c3a82f-ac82-42c9-ae3c-2294c7b64aad tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:07.403875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d3c3a82f-ac82-42c9-ae3c-2294c7b64aad tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 28d33b72-926b-49d9-8807-1d2be68c487f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:07.420835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3c3a82f-ac82-42c9-ae3c-2294c7b64aad tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:07.421613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3c3a82f-ac82-42c9-ae3c-2294c7b64aad tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:07.422219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3c3a82f-ac82-42c9-ae3c-2294c7b64aad tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:07.423157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3c3a82f-ac82-42c9-ae3c-2294c7b64aad tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:07.429245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3c3a82f-ac82-42c9-ae3c-2294c7b64aad tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:07.429929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3c3a82f-ac82-42c9-ae3c-2294c7b64aad tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:07.594361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e6c0197f-c9ac-4d11-8447-001ca4ce943b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:07.613300 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e6c0197f-c9ac-4d11-8447-001ca4ce943b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1392 microversion: 2.1 time: 0.296086 Oct 29 03:01:07.638924 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1489/3160] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:07 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1392 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:07.662543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-bb1e0b9f-f002-4bdd-9990-f191e6ffaf61 req-319914a5-332d-4c23-a7be-95bd85ae86e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d9854a1-ead6-4570-b801-13c47d0bf721", "name": "network-vif-deleted", "tag": "5c797ecc-c991-49d4-a9d6-68c2398ef486"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:07.688153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-bb1e0b9f-f002-4bdd-9990-f191e6ffaf61 req-319914a5-332d-4c23-a7be-95bd85ae86e6 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:07.688714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-bb1e0b9f-f002-4bdd-9990-f191e6ffaf61 req-319914a5-332d-4c23-a7be-95bd85ae86e6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:07.689148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-bb1e0b9f-f002-4bdd-9990-f191e6ffaf61 req-319914a5-332d-4c23-a7be-95bd85ae86e6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:07.713962 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-bb1e0b9f-f002-4bdd-9990-f191e6ffaf61 req-319914a5-332d-4c23-a7be-95bd85ae86e6 service nova] Creating event network-vif-deleted:5c797ecc-c991-49d4-a9d6-68c2398ef486 for instance 5d9854a1-ead6-4570-b801-13c47d0bf721 on n-h1-862967-2 Oct 29 03:01:07.729017 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-bb1e0b9f-f002-4bdd-9990-f191e6ffaf61 req-319914a5-332d-4c23-a7be-95bd85ae86e6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070333 Oct 29 03:01:07.729649 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1490/3161] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:01:07.871319 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9b6160fc-13cf-4ec3-9dd4-c0f8dc46a4d6 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:07.875363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9b6160fc-13cf-4ec3-9dd4-c0f8dc46a4d6 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:07.896987 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b6160fc-13cf-4ec3-9dd4-c0f8dc46a4d6 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:07.900795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b6160fc-13cf-4ec3-9dd4-c0f8dc46a4d6 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:07.907009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b6160fc-13cf-4ec3-9dd4-c0f8dc46a4d6 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:07.908908 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b6160fc-13cf-4ec3-9dd4-c0f8dc46a4d6 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:07.911003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b6160fc-13cf-4ec3-9dd4-c0f8dc46a4d6 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:07.918706 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b6160fc-13cf-4ec3-9dd4-c0f8dc46a4d6 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:08.012677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d3c3a82f-ac82-42c9-ae3c-2294c7b64aad tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:08.042425 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d3c3a82f-ac82-42c9-ae3c-2294c7b64aad tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/28d33b72-926b-49d9-8807-1d2be68c487f" status: 200 len: 1308 microversion: 2.1 time: 0.643362 Oct 29 03:01:08.043314 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1672/3162] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:07 2022] GET /compute/v2.1/servers/28d33b72-926b-49d9-8807-1d2be68c487f => generated 1308 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:01:08.062368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8d7eac3c-2265-46c5-8fb2-4e5dbaf0c3d6 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:08.066152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8d7eac3c-2265-46c5-8fb2-4e5dbaf0c3d6 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:08.082010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d7eac3c-2265-46c5-8fb2-4e5dbaf0c3d6 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:08.082767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d7eac3c-2265-46c5-8fb2-4e5dbaf0c3d6 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:08.083389 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d7eac3c-2265-46c5-8fb2-4e5dbaf0c3d6 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:08.084295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d7eac3c-2265-46c5-8fb2-4e5dbaf0c3d6 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:08.084932 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d7eac3c-2265-46c5-8fb2-4e5dbaf0c3d6 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:08.086031 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d7eac3c-2265-46c5-8fb2-4e5dbaf0c3d6 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:08.278034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9b6160fc-13cf-4ec3-9dd4-c0f8dc46a4d6 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:08.291661 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9b6160fc-13cf-4ec3-9dd4-c0f8dc46a4d6 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92" status: 200 len: 1522 microversion: 2.1 time: 0.435014 Oct 29 03:01:08.292303 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1491/3163] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:07 2022] GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:08.298601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-11f4769f-9bb7-4ae1-b4ed-cf9a004bfc39 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:08.299225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-11f4769f-9bb7-4ae1-b4ed-cf9a004bfc39 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] [instance: 5d9854a1-ead6-4570-b801-13c47d0bf721] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:08.319442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11f4769f-9bb7-4ae1-b4ed-cf9a004bfc39 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:08.319959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11f4769f-9bb7-4ae1-b4ed-cf9a004bfc39 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:08.320637 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11f4769f-9bb7-4ae1-b4ed-cf9a004bfc39 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:08.322470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11f4769f-9bb7-4ae1-b4ed-cf9a004bfc39 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:08.323129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11f4769f-9bb7-4ae1-b4ed-cf9a004bfc39 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:08.324052 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11f4769f-9bb7-4ae1-b4ed-cf9a004bfc39 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:08.341087 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-11f4769f-9bb7-4ae1-b4ed-cf9a004bfc39 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] HTTP exception thrown: Instance 5d9854a1-ead6-4570-b801-13c47d0bf721 could not be found. Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-11f4769f-9bb7-4ae1-b4ed-cf9a004bfc39 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Request method failure captured: Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 HTTP/1.1 Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJZW6L_YeL9nmCxOv_16OVN4idn1WAdXKHzYjEPSlducHiOmK4pCsDkfWqufP1WCfoRgp_OluXK0xPnbvGHewJDJ_JJg9M0kgM2BHIs6DVUkClIe5X_9HFwba8igYf31CopytD8xdBnKO7kA6uoqd91PAFOhGr31mO0cSsppRRj91PU Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_fab9e02a4cb341348f0611afa2293cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/fab9e02a4cb341348f0611afa2293cd0"}]}] Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: fab9e02a4cb341348f0611afa2293cd0 Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-673291538 Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersNegativeTestJSON-673291538-project Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 3507c0ada3424029805469182f328379 Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersNegativeTestJSON-673291538-project Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 5d9854a1-ead6-4570-b801-13c47d0bf721 could not be found. Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '5d9854a1-ead6-4570-b801-13c47d0bf721'} Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d9854a1-ead6-4570-b801-13c47d0bf721 could not be found. Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d9854a1-ead6-4570-b801-13c47d0bf721 could not be found. Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:08.343133 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:08.348362 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:08.348362 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:08.348362 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:08.348362 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:01:08.348362 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:01:08.348362 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d9854a1-ead6-4570-b801-13c47d0bf721 could not be found. Oct 29 03:01:08.348362 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:08.350204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-11f4769f-9bb7-4ae1-b4ed-cf9a004bfc39 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] Returning 404 to user: Instance 5d9854a1-ead6-4570-b801-13c47d0bf721 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:01:08.351195 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-11f4769f-9bb7-4ae1-b4ed-cf9a004bfc39 tempest-ServersNegativeTestJSON-673291538 tempest-ServersNegativeTestJSON-673291538-project] 10.222.0.46 "GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721" status: 404 len: 111 microversion: 2.1 time: 0.057881 Oct 29 03:01:08.352243 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1492/3164] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:08 2022] GET /compute/v2.1/servers/5d9854a1-ead6-4570-b801-13c47d0bf721 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:01:08.363588 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bd92440e-660b-4370-a479-9fb2913184fc tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:08.364333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bd92440e-660b-4370-a479-9fb2913184fc tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:08.372891 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd92440e-660b-4370-a479-9fb2913184fc tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:08.373380 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd92440e-660b-4370-a479-9fb2913184fc tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:08.373822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd92440e-660b-4370-a479-9fb2913184fc tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:08.374836 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd92440e-660b-4370-a479-9fb2913184fc tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:08.375306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd92440e-660b-4370-a479-9fb2913184fc tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:08.375729 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd92440e-660b-4370-a479-9fb2913184fc tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:08.785420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bd92440e-660b-4370-a479-9fb2913184fc tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:08.806150 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bd92440e-660b-4370-a479-9fb2913184fc tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1314 microversion: 2.1 time: 0.448754 Oct 29 03:01:08.810933 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1493/3165] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:08 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:08.833526 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bb3b398f-5088-4ff4-aa50-89656f00412f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:08.836488 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bb3b398f-5088-4ff4-aa50-89656f00412f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:08.854665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb3b398f-5088-4ff4-aa50-89656f00412f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:08.856393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb3b398f-5088-4ff4-aa50-89656f00412f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:08.857322 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb3b398f-5088-4ff4-aa50-89656f00412f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:08.858378 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb3b398f-5088-4ff4-aa50-89656f00412f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:08.859219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb3b398f-5088-4ff4-aa50-89656f00412f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:08.859808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb3b398f-5088-4ff4-aa50-89656f00412f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:09.259673 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8d7eac3c-2265-46c5-8fb2-4e5dbaf0c3d6 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:09.264089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:09.276406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8d7eac3c-2265-46c5-8fb2-4e5dbaf0c3d6 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:09.286406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8d7eac3c-2265-46c5-8fb2-4e5dbaf0c3d6 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:09.287750 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8d7eac3c-2265-46c5-8fb2-4e5dbaf0c3d6 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1879 microversion: 2.32 time: 1.242676 Oct 29 03:01:09.288340 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1673/3166] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:08 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1879 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:09.302862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6345054b-0250-4f0f-8072-14194c6c812a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:09.303522 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6345054b-0250-4f0f-8072-14194c6c812a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 28d33b72-926b-49d9-8807-1d2be68c487f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:09.316231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:09.320040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6345054b-0250-4f0f-8072-14194c6c812a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:09.320628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6345054b-0250-4f0f-8072-14194c6c812a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:09.321080 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6345054b-0250-4f0f-8072-14194c6c812a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:09.321811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6345054b-0250-4f0f-8072-14194c6c812a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:09.325308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6345054b-0250-4f0f-8072-14194c6c812a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:09.325809 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6345054b-0250-4f0f-8072-14194c6c812a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:09.593180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bb3b398f-5088-4ff4-aa50-89656f00412f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:09.601176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:09.611980 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bb3b398f-5088-4ff4-aa50-89656f00412f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1392 microversion: 2.1 time: 0.793063 Oct 29 03:01:09.613336 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1494/3167] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:08 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1392 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:09.635372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b0db352d-55eb-48a4-b470-367165694101 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:09.636559 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b0db352d-55eb-48a4-b470-367165694101 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:09.653771 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b0db352d-55eb-48a4-b470-367165694101 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:09.654032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b0db352d-55eb-48a4-b470-367165694101 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:09.654470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b0db352d-55eb-48a4-b470-367165694101 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:09.658232 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b0db352d-55eb-48a4-b470-367165694101 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:09.658728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b0db352d-55eb-48a4-b470-367165694101 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:09.660043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b0db352d-55eb-48a4-b470-367165694101 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:09.704194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:09.747171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6345054b-0250-4f0f-8072-14194c6c812a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:09.756980 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:09.767603 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6345054b-0250-4f0f-8072-14194c6c812a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/28d33b72-926b-49d9-8807-1d2be68c487f" status: 200 len: 1308 microversion: 2.1 time: 0.474027 Oct 29 03:01:09.768629 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1674/3168] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:09 2022] GET /compute/v2.1/servers/28d33b72-926b-49d9-8807-1d2be68c487f => generated 1308 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:09.837777 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f03139c9-0889-4f65-a2cf-187b44c05ea0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:09.838411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f03139c9-0889-4f65-a2cf-187b44c05ea0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:09.854688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f03139c9-0889-4f65-a2cf-187b44c05ea0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:09.855276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f03139c9-0889-4f65-a2cf-187b44c05ea0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:09.855640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f03139c9-0889-4f65-a2cf-187b44c05ea0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:09.856603 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f03139c9-0889-4f65-a2cf-187b44c05ea0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:09.867739 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f03139c9-0889-4f65-a2cf-187b44c05ea0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:09.868239 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f03139c9-0889-4f65-a2cf-187b44c05ea0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:10.039842 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b0db352d-55eb-48a4-b470-367165694101 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:10.053936 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b0db352d-55eb-48a4-b470-367165694101 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92" status: 200 len: 1499 microversion: 2.1 time: 0.439117 Oct 29 03:01:10.055195 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1495/3169] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:09 2022] GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 => generated 1499 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:10.085549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c3782495-1461-4609-9e9d-2f3c4f60551f tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:10.091190 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c3782495-1461-4609-9e9d-2f3c4f60551f tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:10.092972 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c3782495-1461-4609-9e9d-2f3c4f60551f tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '875f8af161b647758adaebd94449c8c1'} {{(pid=127125) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:01:10.100162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c3782495-1461-4609-9e9d-2f3c4f60551f tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:10.100948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c3782495-1461-4609-9e9d-2f3c4f60551f tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:10.101609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c3782495-1461-4609-9e9d-2f3c4f60551f tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:10.102721 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c3782495-1461-4609-9e9d-2f3c4f60551f tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:10.103423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c3782495-1461-4609-9e9d-2f3c4f60551f tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:10.104083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c3782495-1461-4609-9e9d-2f3c4f60551f tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:10.158217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.multi_cell_list [None req-c3782495-1461-4609-9e9d-2f3c4f60551f tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:01:10.241857 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c3782495-1461-4609-9e9d-2f3c4f60551f tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.161567 Oct 29 03:01:10.242876 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1496/3170] 10.222.0.46 () {58 vars in 1154 bytes} [Sat Oct 29 03:01:10 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:10.246288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f03139c9-0889-4f65-a2cf-187b44c05ea0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:10.258206 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bdd7225b-7b48-4ec5-9ee5-02d07d10b1e1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:10.264955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bdd7225b-7b48-4ec5-9ee5-02d07d10b1e1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:10.266166 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bdd7225b-7b48-4ec5-9ee5-02d07d10b1e1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:10.266948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bdd7225b-7b48-4ec5-9ee5-02d07d10b1e1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:10.275506 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f03139c9-0889-4f65-a2cf-187b44c05ea0 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1314 microversion: 2.1 time: 0.445117 Oct 29 03:01:10.294022 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1675/3171] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:09 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:10.319463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bdd7225b-7b48-4ec5-9ee5-02d07d10b1e1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92] Going to try to start instance {{(pid=127125) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 29 03:01:10.322294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-55dc4626-8b82-421a-999d-44bf7d3ceac0 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:10.322920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-55dc4626-8b82-421a-999d-44bf7d3ceac0 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:10.347828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55dc4626-8b82-421a-999d-44bf7d3ceac0 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:10.348183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55dc4626-8b82-421a-999d-44bf7d3ceac0 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:10.348882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55dc4626-8b82-421a-999d-44bf7d3ceac0 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:10.352012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55dc4626-8b82-421a-999d-44bf7d3ceac0 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:10.352749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55dc4626-8b82-421a-999d-44bf7d3ceac0 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:10.355282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55dc4626-8b82-421a-999d-44bf7d3ceac0 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:10.424014 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bdd7225b-7b48-4ec5-9ee5-02d07d10b1e1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "POST /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92/action" status: 202 len: 0 microversion: 2.1 time: 0.165428 Oct 29 03:01:10.426110 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1497/3172] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:01:10 2022] POST /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:01:10.445040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b636658c-a01c-4c8f-8304-e9a794c473d0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:10.447886 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b636658c-a01c-4c8f-8304-e9a794c473d0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:10.473450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b636658c-a01c-4c8f-8304-e9a794c473d0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:10.480357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b636658c-a01c-4c8f-8304-e9a794c473d0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:10.482918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b636658c-a01c-4c8f-8304-e9a794c473d0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:10.487304 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b636658c-a01c-4c8f-8304-e9a794c473d0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:10.492180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b636658c-a01c-4c8f-8304-e9a794c473d0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:10.494300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b636658c-a01c-4c8f-8304-e9a794c473d0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:10.886610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-55dc4626-8b82-421a-999d-44bf7d3ceac0 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:10.906919 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b636658c-a01c-4c8f-8304-e9a794c473d0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:10.917562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-55dc4626-8b82-421a-999d-44bf7d3ceac0 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:10.924642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-55dc4626-8b82-421a-999d-44bf7d3ceac0 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:10.926276 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b636658c-a01c-4c8f-8304-e9a794c473d0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92" status: 200 len: 1508 microversion: 2.1 time: 0.494891 Oct 29 03:01:10.927189 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1498/3173] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:10 2022] GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 => generated 1508 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:10.931769 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-b581ac8b-1842-4e43-9aeb-1f9206bffac2 req-8f48db4f-6e6b-45a2-9ffa-808d1dde8c5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afb9891b-c60a-4106-b2ed-b26d1ff0a459", "tag": "1c4eed69-bcd2-4a8f-87a2-773d5291f3db"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:10.941910 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-55dc4626-8b82-421a-999d-44bf7d3ceac0 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1879 microversion: 2.32 time: 0.623378 Oct 29 03:01:10.950453 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1676/3174] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:10 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1879 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:10.953953 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b581ac8b-1842-4e43-9aeb-1f9206bffac2 req-8f48db4f-6e6b-45a2-9ffa-808d1dde8c5b service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:10.954515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b581ac8b-1842-4e43-9aeb-1f9206bffac2 req-8f48db4f-6e6b-45a2-9ffa-808d1dde8c5b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:10.954985 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b581ac8b-1842-4e43-9aeb-1f9206bffac2 req-8f48db4f-6e6b-45a2-9ffa-808d1dde8c5b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:10.968915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-967e4527-e970-4199-9daf-19eb2a713c62 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:10.969624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-967e4527-e970-4199-9daf-19eb2a713c62 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:10.973176 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-b581ac8b-1842-4e43-9aeb-1f9206bffac2 req-8f48db4f-6e6b-45a2-9ffa-808d1dde8c5b service nova] Creating event network-changed:1c4eed69-bcd2-4a8f-87a2-773d5291f3db for instance afb9891b-c60a-4106-b2ed-b26d1ff0a459 on n-h2-862967-2 Oct 29 03:01:10.991404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-967e4527-e970-4199-9daf-19eb2a713c62 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:10.992698 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-967e4527-e970-4199-9daf-19eb2a713c62 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:10.993517 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-967e4527-e970-4199-9daf-19eb2a713c62 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:10.996726 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-b581ac8b-1842-4e43-9aeb-1f9206bffac2 req-8f48db4f-6e6b-45a2-9ffa-808d1dde8c5b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067824 Oct 29 03:01:10.997380 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-967e4527-e970-4199-9daf-19eb2a713c62 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:10.999764 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1499/3175] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:11.000819 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-967e4527-e970-4199-9daf-19eb2a713c62 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:11.001808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-967e4527-e970-4199-9daf-19eb2a713c62 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:11.013369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f20721a6-f9b7-4231-9a09-f7b1042ef962 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:11.014167 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f20721a6-f9b7-4231-9a09-f7b1042ef962 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 28d33b72-926b-49d9-8807-1d2be68c487f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:11.025998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f20721a6-f9b7-4231-9a09-f7b1042ef962 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:11.026498 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f20721a6-f9b7-4231-9a09-f7b1042ef962 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:11.026939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f20721a6-f9b7-4231-9a09-f7b1042ef962 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:11.027648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f20721a6-f9b7-4231-9a09-f7b1042ef962 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:11.028415 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f20721a6-f9b7-4231-9a09-f7b1042ef962 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:11.028565 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f20721a6-f9b7-4231-9a09-f7b1042ef962 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:11.275994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-967e4527-e970-4199-9daf-19eb2a713c62 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:11.287707 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-967e4527-e970-4199-9daf-19eb2a713c62 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1392 microversion: 2.1 time: 0.335748 Oct 29 03:01:11.289211 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1677/3176] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:10 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1392 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:11.295809 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-ccfb6cdb-62f1-46cb-b4cb-b30ce24496ac req-3b5e9ed9-d4e3-4f0a-92e4-50e7f0622914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28d33b72-926b-49d9-8807-1d2be68c487f", "name": "network-vif-plugged", "status": "completed", "tag": "5a2e20a8-d25a-49ae-9802-e29f037f1ef2"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:11.310137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ccfb6cdb-62f1-46cb-b4cb-b30ce24496ac req-3b5e9ed9-d4e3-4f0a-92e4-50e7f0622914 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:11.310912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ccfb6cdb-62f1-46cb-b4cb-b30ce24496ac req-3b5e9ed9-d4e3-4f0a-92e4-50e7f0622914 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:11.311823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ccfb6cdb-62f1-46cb-b4cb-b30ce24496ac req-3b5e9ed9-d4e3-4f0a-92e4-50e7f0622914 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:11.342907 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-ccfb6cdb-62f1-46cb-b4cb-b30ce24496ac req-3b5e9ed9-d4e3-4f0a-92e4-50e7f0622914 service nova] Creating event network-vif-plugged:5a2e20a8-d25a-49ae-9802-e29f037f1ef2 for instance 28d33b72-926b-49d9-8807-1d2be68c487f on n-h2-862967-2 Oct 29 03:01:11.349840 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-ccfb6cdb-62f1-46cb-b4cb-b30ce24496ac req-3b5e9ed9-d4e3-4f0a-92e4-50e7f0622914 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058244 Oct 29 03:01:11.350957 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1678/3177] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:11.357617 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1b84c152-d91e-4ac7-bdfc-440d792ba2ed tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:11.358576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1b84c152-d91e-4ac7-bdfc-440d792ba2ed tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:11.366402 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b84c152-d91e-4ac7-bdfc-440d792ba2ed tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:11.367038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b84c152-d91e-4ac7-bdfc-440d792ba2ed tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:11.367576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b84c152-d91e-4ac7-bdfc-440d792ba2ed tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:11.368388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b84c152-d91e-4ac7-bdfc-440d792ba2ed tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:11.369038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b84c152-d91e-4ac7-bdfc-440d792ba2ed tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:11.369571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b84c152-d91e-4ac7-bdfc-440d792ba2ed tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:11.521638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f20721a6-f9b7-4231-9a09-f7b1042ef962 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:11.522561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1b84c152-d91e-4ac7-bdfc-440d792ba2ed tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:11.531120 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f20721a6-f9b7-4231-9a09-f7b1042ef962 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/28d33b72-926b-49d9-8807-1d2be68c487f" status: 200 len: 1308 microversion: 2.1 time: 0.529770 Oct 29 03:01:11.531945 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1500/3178] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:10 2022] GET /compute/v2.1/servers/28d33b72-926b-49d9-8807-1d2be68c487f => generated 1308 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:11.542572 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1b84c152-d91e-4ac7-bdfc-440d792ba2ed tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1314 microversion: 2.1 time: 0.184997 Oct 29 03:01:11.542572 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1679/3179] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:11 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:11.956137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c9d346da-d25a-4ca8-800f-45a22edf0e66 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:11.956579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c9d346da-d25a-4ca8-800f-45a22edf0e66 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:11.964718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9d346da-d25a-4ca8-800f-45a22edf0e66 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:11.965909 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9d346da-d25a-4ca8-800f-45a22edf0e66 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:11.966367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9d346da-d25a-4ca8-800f-45a22edf0e66 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:11.969007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9d346da-d25a-4ca8-800f-45a22edf0e66 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:11.969007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9d346da-d25a-4ca8-800f-45a22edf0e66 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:11.969007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9d346da-d25a-4ca8-800f-45a22edf0e66 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:11.974895 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bf25e4cb-7a4f-4c08-9906-7bdc0c4d2448 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:11.975526 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bf25e4cb-7a4f-4c08-9906-7bdc0c4d2448 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:11.986564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf25e4cb-7a4f-4c08-9906-7bdc0c4d2448 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:11.987069 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf25e4cb-7a4f-4c08-9906-7bdc0c4d2448 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:11.987501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf25e4cb-7a4f-4c08-9906-7bdc0c4d2448 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:11.988216 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf25e4cb-7a4f-4c08-9906-7bdc0c4d2448 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:11.988712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf25e4cb-7a4f-4c08-9906-7bdc0c4d2448 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:11.989167 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf25e4cb-7a4f-4c08-9906-7bdc0c4d2448 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:12.156847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c9d346da-d25a-4ca8-800f-45a22edf0e66 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:12.168087 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c9d346da-d25a-4ca8-800f-45a22edf0e66 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92" status: 200 len: 1508 microversion: 2.1 time: 0.218563 Oct 29 03:01:12.169357 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1680/3180] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:11 2022] GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 => generated 1508 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:12.311183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c03e6226-62e5-4cb9-9ffc-a4287f1abbc6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:12.311881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c03e6226-62e5-4cb9-9ffc-a4287f1abbc6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:12.319352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c03e6226-62e5-4cb9-9ffc-a4287f1abbc6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:12.320088 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c03e6226-62e5-4cb9-9ffc-a4287f1abbc6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:12.320516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c03e6226-62e5-4cb9-9ffc-a4287f1abbc6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:12.321464 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c03e6226-62e5-4cb9-9ffc-a4287f1abbc6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:12.322077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c03e6226-62e5-4cb9-9ffc-a4287f1abbc6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:12.322657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c03e6226-62e5-4cb9-9ffc-a4287f1abbc6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:12.566865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c03e6226-62e5-4cb9-9ffc-a4287f1abbc6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:12.577983 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c03e6226-62e5-4cb9-9ffc-a4287f1abbc6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1392 microversion: 2.1 time: 0.270710 Oct 29 03:01:12.579005 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1681/3181] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:12 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1392 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:01:12.584040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d9de8903-f191-4cbd-9766-96315de5474c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:12.585038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d9de8903-f191-4cbd-9766-96315de5474c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 28d33b72-926b-49d9-8807-1d2be68c487f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:12.591760 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d9de8903-f191-4cbd-9766-96315de5474c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:12.592593 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d9de8903-f191-4cbd-9766-96315de5474c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:12.593260 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d9de8903-f191-4cbd-9766-96315de5474c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:12.594273 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d9de8903-f191-4cbd-9766-96315de5474c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:12.594952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d9de8903-f191-4cbd-9766-96315de5474c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:12.595601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d9de8903-f191-4cbd-9766-96315de5474c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:12.822311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d9de8903-f191-4cbd-9766-96315de5474c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:12.837043 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d9de8903-f191-4cbd-9766-96315de5474c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/28d33b72-926b-49d9-8807-1d2be68c487f" status: 200 len: 1308 microversion: 2.1 time: 0.256637 Oct 29 03:01:12.838522 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1682/3182] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:12 2022] GET /compute/v2.1/servers/28d33b72-926b-49d9-8807-1d2be68c487f => generated 1308 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:12.844373 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1e9d9734-bea6-4e85-a14d-c7ded78323ed tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:12.845659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1e9d9734-bea6-4e85-a14d-c7ded78323ed tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:12.855031 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e9d9734-bea6-4e85-a14d-c7ded78323ed tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:12.855937 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e9d9734-bea6-4e85-a14d-c7ded78323ed tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:12.857164 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e9d9734-bea6-4e85-a14d-c7ded78323ed tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:12.859034 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e9d9734-bea6-4e85-a14d-c7ded78323ed tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:12.859666 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e9d9734-bea6-4e85-a14d-c7ded78323ed tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:12.862089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e9d9734-bea6-4e85-a14d-c7ded78323ed tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:12.953682 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bf25e4cb-7a4f-4c08-9906-7bdc0c4d2448 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:12.970565 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bf25e4cb-7a4f-4c08-9906-7bdc0c4d2448 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:12.972672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bf25e4cb-7a4f-4c08-9906-7bdc0c4d2448 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:12.980846 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bf25e4cb-7a4f-4c08-9906-7bdc0c4d2448 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1879 microversion: 2.32 time: 1.010342 Oct 29 03:01:12.986679 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1501/3183] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:11 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1879 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:13.098683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1e9d9734-bea6-4e85-a14d-c7ded78323ed tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:13.108113 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1e9d9734-bea6-4e85-a14d-c7ded78323ed tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1314 microversion: 2.1 time: 0.268329 Oct 29 03:01:13.109149 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1683/3184] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:12 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:13.194887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1ffe3c70-4d22-4783-991c-0e25fc89cd56 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:13.195965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1ffe3c70-4d22-4783-991c-0e25fc89cd56 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:13.204472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ffe3c70-4d22-4783-991c-0e25fc89cd56 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:13.205388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ffe3c70-4d22-4783-991c-0e25fc89cd56 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:13.206162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ffe3c70-4d22-4783-991c-0e25fc89cd56 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:13.207344 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ffe3c70-4d22-4783-991c-0e25fc89cd56 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:13.208357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ffe3c70-4d22-4783-991c-0e25fc89cd56 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:13.209316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ffe3c70-4d22-4783-991c-0e25fc89cd56 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:13.518011 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1ffe3c70-4d22-4783-991c-0e25fc89cd56 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:13.527318 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1ffe3c70-4d22-4783-991c-0e25fc89cd56 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92" status: 200 len: 1508 microversion: 2.1 time: 0.336661 Oct 29 03:01:13.551801 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1502/3185] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:13 2022] GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 => generated 1508 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:13.605310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7959ebd1-817f-4a2e-8bdc-0beaa775555c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:13.606103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7959ebd1-817f-4a2e-8bdc-0beaa775555c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:13.618188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7959ebd1-817f-4a2e-8bdc-0beaa775555c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:13.625050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7959ebd1-817f-4a2e-8bdc-0beaa775555c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:13.625668 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7959ebd1-817f-4a2e-8bdc-0beaa775555c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:13.626554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7959ebd1-817f-4a2e-8bdc-0beaa775555c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:13.627108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7959ebd1-817f-4a2e-8bdc-0beaa775555c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:13.627916 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7959ebd1-817f-4a2e-8bdc-0beaa775555c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:13.831892 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7959ebd1-817f-4a2e-8bdc-0beaa775555c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:13.843722 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7959ebd1-817f-4a2e-8bdc-0beaa775555c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1392 microversion: 2.1 time: 0.241617 Oct 29 03:01:13.845203 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1684/3186] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:13 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1392 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:13.862304 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9d23dd6f-997f-45c9-adaf-c47e911a18dc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:13.862986 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9d23dd6f-997f-45c9-adaf-c47e911a18dc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 28d33b72-926b-49d9-8807-1d2be68c487f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:13.865074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=8 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:13.872750 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d23dd6f-997f-45c9-adaf-c47e911a18dc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:13.873243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d23dd6f-997f-45c9-adaf-c47e911a18dc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:13.873858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d23dd6f-997f-45c9-adaf-c47e911a18dc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:13.874741 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d23dd6f-997f-45c9-adaf-c47e911a18dc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:13.875355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d23dd6f-997f-45c9-adaf-c47e911a18dc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:13.875941 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d23dd6f-997f-45c9-adaf-c47e911a18dc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:14.013176 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fd23ca72-fd86-455d-9ef9-a2ab9b4b628b tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:14.013761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fd23ca72-fd86-455d-9ef9-a2ab9b4b628b tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:14.037603 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd23ca72-fd86-455d-9ef9-a2ab9b4b628b tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:14.038685 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd23ca72-fd86-455d-9ef9-a2ab9b4b628b tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:14.043319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd23ca72-fd86-455d-9ef9-a2ab9b4b628b tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:14.044714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd23ca72-fd86-455d-9ef9-a2ab9b4b628b tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:14.045443 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd23ca72-fd86-455d-9ef9-a2ab9b4b628b tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:14.046103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd23ca72-fd86-455d-9ef9-a2ab9b4b628b tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:14.226156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9d23dd6f-997f-45c9-adaf-c47e911a18dc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:14.238938 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9d23dd6f-997f-45c9-adaf-c47e911a18dc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/28d33b72-926b-49d9-8807-1d2be68c487f" status: 200 len: 1308 microversion: 2.1 time: 0.380424 Oct 29 03:01:14.240174 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1503/3187] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:13 2022] GET /compute/v2.1/servers/28d33b72-926b-49d9-8807-1d2be68c487f => generated 1308 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:14.245847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-151465e0-95a3-49f9-980b-7dba663cc504 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:14.255482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-151465e0-95a3-49f9-980b-7dba663cc504 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:14.299084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-151465e0-95a3-49f9-980b-7dba663cc504 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:14.301855 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-151465e0-95a3-49f9-980b-7dba663cc504 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:14.302634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-151465e0-95a3-49f9-980b-7dba663cc504 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:14.304640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-151465e0-95a3-49f9-980b-7dba663cc504 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:14.305776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-151465e0-95a3-49f9-980b-7dba663cc504 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:14.307096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-151465e0-95a3-49f9-980b-7dba663cc504 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:14.539996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fd23ca72-fd86-455d-9ef9-a2ab9b4b628b tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:14.551489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fd23ca72-fd86-455d-9ef9-a2ab9b4b628b tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:14.553427 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fd23ca72-fd86-455d-9ef9-a2ab9b4b628b tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:14.554899 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fd23ca72-fd86-455d-9ef9-a2ab9b4b628b tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1879 microversion: 2.32 time: 0.547457 Oct 29 03:01:14.555922 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1685/3188] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:14 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1879 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:01:14.560960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8d6ecf9c-0368-48b6-80fd-51f1a1bc6298 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:14.562081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8d6ecf9c-0368-48b6-80fd-51f1a1bc6298 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:14.568559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d6ecf9c-0368-48b6-80fd-51f1a1bc6298 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:14.569492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d6ecf9c-0368-48b6-80fd-51f1a1bc6298 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:14.570104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d6ecf9c-0368-48b6-80fd-51f1a1bc6298 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:14.571189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d6ecf9c-0368-48b6-80fd-51f1a1bc6298 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:14.571806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d6ecf9c-0368-48b6-80fd-51f1a1bc6298 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:14.572649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d6ecf9c-0368-48b6-80fd-51f1a1bc6298 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:14.599894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-151465e0-95a3-49f9-980b-7dba663cc504 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:14.623257 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-151465e0-95a3-49f9-980b-7dba663cc504 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1314 microversion: 2.1 time: 0.373769 Oct 29 03:01:14.638835 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1504/3189] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:14 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:14.787000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8d6ecf9c-0368-48b6-80fd-51f1a1bc6298 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:14.802196 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8d6ecf9c-0368-48b6-80fd-51f1a1bc6298 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92" status: 200 len: 1512 microversion: 2.1 time: 0.244849 Oct 29 03:01:14.812551 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1686/3190] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:14 2022] GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 => generated 1512 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:14.834598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-58319b8f-1c1d-4c16-bbe6-219781b18316 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:14.842677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-58319b8f-1c1d-4c16-bbe6-219781b18316 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:14.845915 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.compute.servers [None req-58319b8f-1c1d-4c16-bbe6-219781b18316 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Removing options 'limit' from query {{(pid=127125) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 29 03:01:14.846990 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-58319b8f-1c1d-4c16-bbe6-219781b18316 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Searching by: {'deleted': False, 'project_id': '875f8af161b647758adaebd94449c8c1'} {{(pid=127125) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:01:14.854395 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58319b8f-1c1d-4c16-bbe6-219781b18316 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:14.854892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58319b8f-1c1d-4c16-bbe6-219781b18316 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:14.857746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58319b8f-1c1d-4c16-bbe6-219781b18316 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:14.859189 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58319b8f-1c1d-4c16-bbe6-219781b18316 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:14.859662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58319b8f-1c1d-4c16-bbe6-219781b18316 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:14.860090 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58319b8f-1c1d-4c16-bbe6-219781b18316 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:14.861587 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-58319b8f-1c1d-4c16-bbe6-219781b18316 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.031108 Oct 29 03:01:14.866300 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1505/3191] 10.222.0.46 () {58 vars in 1140 bytes} [Sat Oct 29 03:01:14 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:01:14.873962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2439f6b5-8a88-4ad2-8b73-852a4d080336 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:14.875422 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2439f6b5-8a88-4ad2-8b73-852a4d080336 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:14.878176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2c7ae252-78b0-4c42-b744-f9fb8ed5e601 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:14.879061 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2c7ae252-78b0-4c42-b744-f9fb8ed5e601 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:14.885696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2439f6b5-8a88-4ad2-8b73-852a4d080336 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:14.886201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2439f6b5-8a88-4ad2-8b73-852a4d080336 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:14.886638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2439f6b5-8a88-4ad2-8b73-852a4d080336 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:14.887354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2439f6b5-8a88-4ad2-8b73-852a4d080336 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:14.887636 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2c7ae252-78b0-4c42-b744-f9fb8ed5e601 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:14.887803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2439f6b5-8a88-4ad2-8b73-852a4d080336 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:14.888377 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2c7ae252-78b0-4c42-b744-f9fb8ed5e601 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:14.889037 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2c7ae252-78b0-4c42-b744-f9fb8ed5e601 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:14.889939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2c7ae252-78b0-4c42-b744-f9fb8ed5e601 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:14.890747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2439f6b5-8a88-4ad2-8b73-852a4d080336 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:14.891382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2c7ae252-78b0-4c42-b744-f9fb8ed5e601 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:14.892156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2c7ae252-78b0-4c42-b744-f9fb8ed5e601 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:15.113431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2c7ae252-78b0-4c42-b744-f9fb8ed5e601 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:15.121924 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2c7ae252-78b0-4c42-b744-f9fb8ed5e601 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92" status: 200 len: 1512 microversion: 2.1 time: 0.247715 Oct 29 03:01:15.122653 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1506/3192] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:14 2022] GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 => generated 1512 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:01:15.148470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cd652300-45db-4c2c-a9b9-2b33a85ad792 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:15.149289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cd652300-45db-4c2c-a9b9-2b33a85ad792 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:15.155439 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd652300-45db-4c2c-a9b9-2b33a85ad792 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:15.155987 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd652300-45db-4c2c-a9b9-2b33a85ad792 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:15.156476 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd652300-45db-4c2c-a9b9-2b33a85ad792 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:15.157365 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd652300-45db-4c2c-a9b9-2b33a85ad792 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:15.157865 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd652300-45db-4c2c-a9b9-2b33a85ad792 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:15.158346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd652300-45db-4c2c-a9b9-2b33a85ad792 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:15.197593 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2439f6b5-8a88-4ad2-8b73-852a4d080336 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:15.206975 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2439f6b5-8a88-4ad2-8b73-852a4d080336 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1392 microversion: 2.1 time: 0.338630 Oct 29 03:01:15.207573 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1687/3193] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:14 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1392 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:15.311852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-880b3ebf-2a65-44ea-8d07-cee167726feb tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Action: 'create', calling method: .version_select at 0x7ff0533eb700>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1143227577", "policies": ["affinity"]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:15.352101 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-880b3ebf-2a65-44ea-8d07-cee167726feb tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Getting quotas for project 0c460e416a634939a16f63d0c4c01a68. Resources: {'server_groups'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:01:15.367226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cd652300-45db-4c2c-a9b9-2b33a85ad792 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:15.372076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-880b3ebf-2a65-44ea-8d07-cee167726feb tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Getting quotas for user b2b1564244d54ed9acc97a4924ecb4cd and project 0c460e416a634939a16f63d0c4c01a68. Resources: {'server_groups'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:01:15.384061 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cd652300-45db-4c2c-a9b9-2b33a85ad792 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a" status: 200 len: 1511 microversion: 2.1 time: 0.239119 Oct 29 03:01:15.384969 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1507/3194] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:15 2022] GET /compute/v2.1/servers/4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a => generated 1511 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:01:15.397241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-549e8a9b-60d9-46bf-86e3-bf1b02505705 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:15.397905 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-549e8a9b-60d9-46bf-86e3-bf1b02505705 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 28d33b72-926b-49d9-8807-1d2be68c487f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:15.405106 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-549e8a9b-60d9-46bf-86e3-bf1b02505705 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:15.405597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-549e8a9b-60d9-46bf-86e3-bf1b02505705 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:15.406026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-549e8a9b-60d9-46bf-86e3-bf1b02505705 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:15.406964 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-549e8a9b-60d9-46bf-86e3-bf1b02505705 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:15.407413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-549e8a9b-60d9-46bf-86e3-bf1b02505705 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:15.407832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-549e8a9b-60d9-46bf-86e3-bf1b02505705 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:15.490822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-880b3ebf-2a65-44ea-8d07-cee167726feb tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Getting quotas for project 0c460e416a634939a16f63d0c4c01a68. Resources: {'server_groups'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:01:15.496753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-880b3ebf-2a65-44ea-8d07-cee167726feb tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Getting quotas for user b2b1564244d54ed9acc97a4924ecb4cd and project 0c460e416a634939a16f63d0c4c01a68. Resources: {'server_groups'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:01:15.512629 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-880b3ebf-2a65-44ea-8d07-cee167726feb tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.303507 Oct 29 03:01:15.520152 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1688/3195] 10.222.0.46 () {60 vars in 1174 bytes} [Sat Oct 29 03:01:15 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:15.525888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6d26b1f0-e56a-4052-8764-9451675ae45a tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:15.526772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6d26b1f0-e56a-4052-8764-9451675ae45a tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 96a9fe4a-52f5-4b1f-955e-f991357b1813] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:15.536547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d26b1f0-e56a-4052-8764-9451675ae45a tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:15.537588 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d26b1f0-e56a-4052-8764-9451675ae45a tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:15.538192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d26b1f0-e56a-4052-8764-9451675ae45a tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:15.539129 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d26b1f0-e56a-4052-8764-9451675ae45a tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:15.539756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d26b1f0-e56a-4052-8764-9451675ae45a tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:15.540366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d26b1f0-e56a-4052-8764-9451675ae45a tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:15.652475 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-549e8a9b-60d9-46bf-86e3-bf1b02505705 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:15.661990 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-549e8a9b-60d9-46bf-86e3-bf1b02505705 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/28d33b72-926b-49d9-8807-1d2be68c487f" status: 200 len: 1487 microversion: 2.1 time: 0.275458 Oct 29 03:01:15.668666 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1508/3196] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:15 2022] GET /compute/v2.1/servers/28d33b72-926b-49d9-8807-1d2be68c487f => generated 1487 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:15.674820 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-25f7e403-2462-4035-916c-83e0dcc0f967 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Action: 'create', calling method: .version_select at 0x7ff053fb6550>, body: {"server_group": {"name": "tempest-server-group-1433534026", "policies": ["affinity"]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:15.703248 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-25f7e403-2462-4035-916c-83e0dcc0f967 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Getting quotas for project 0c460e416a634939a16f63d0c4c01a68. Resources: {'server_groups'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:01:15.711314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-25f7e403-2462-4035-916c-83e0dcc0f967 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Getting quotas for user b2b1564244d54ed9acc97a4924ecb4cd and project 0c460e416a634939a16f63d0c4c01a68. Resources: {'server_groups'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:01:15.740074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:15.779189 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-25f7e403-2462-4035-916c-83e0dcc0f967 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Getting quotas for project 0c460e416a634939a16f63d0c4c01a68. Resources: {'server_groups'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:01:15.786783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-25f7e403-2462-4035-916c-83e0dcc0f967 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Getting quotas for user b2b1564244d54ed9acc97a4924ecb4cd and project 0c460e416a634939a16f63d0c4c01a68. Resources: {'server_groups'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:01:15.804810 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-25f7e403-2462-4035-916c-83e0dcc0f967 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.134300 Oct 29 03:01:15.806047 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1509/3197] 10.222.0.46 () {60 vars in 1173 bytes} [Sat Oct 29 03:01:15 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:15.812114 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-eb2cbc4f-b4f9-40fe-b198-2d789966253c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:15.813082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-eb2cbc4f-b4f9-40fe-b198-2d789966253c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:15.822126 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb2cbc4f-b4f9-40fe-b198-2d789966253c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:15.822705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb2cbc4f-b4f9-40fe-b198-2d789966253c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:15.823488 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb2cbc4f-b4f9-40fe-b198-2d789966253c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:15.824310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb2cbc4f-b4f9-40fe-b198-2d789966253c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:15.824846 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb2cbc4f-b4f9-40fe-b198-2d789966253c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:15.825488 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb2cbc4f-b4f9-40fe-b198-2d789966253c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:16.108803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-eb2cbc4f-b4f9-40fe-b198-2d789966253c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:16.121002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-eb2cbc4f-b4f9-40fe-b198-2d789966253c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:16.122646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-eb2cbc4f-b4f9-40fe-b198-2d789966253c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:16.124329 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-eb2cbc4f-b4f9-40fe-b198-2d789966253c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1879 microversion: 2.32 time: 0.317141 Oct 29 03:01:16.149729 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1510/3198] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:15 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1879 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:16.158382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6d26b1f0-e56a-4052-8764-9451675ae45a tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:16.168868 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6d26b1f0-e56a-4052-8764-9451675ae45a tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813" status: 200 len: 1512 microversion: 2.1 time: 0.647084 Oct 29 03:01:16.170097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e7c1b322-5a8b-48c1-a060-bb9cdec0b61d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:16.170782 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e7c1b322-5a8b-48c1-a060-bb9cdec0b61d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:16.173944 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1689/3199] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:15 2022] GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813 => generated 1512 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:16.179529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7c1b322-5a8b-48c1-a060-bb9cdec0b61d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:16.180201 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7c1b322-5a8b-48c1-a060-bb9cdec0b61d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:16.180821 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7c1b322-5a8b-48c1-a060-bb9cdec0b61d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:16.181682 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7c1b322-5a8b-48c1-a060-bb9cdec0b61d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:16.182288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7c1b322-5a8b-48c1-a060-bb9cdec0b61d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:16.182886 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7c1b322-5a8b-48c1-a060-bb9cdec0b61d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:16.190072 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-db321b4c-50b9-42d4-9a62-3a4f883ef979 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1048608151"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:16.193288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-db321b4c-50b9-42d4-9a62-3a4f883ef979 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 28d33b72-926b-49d9-8807-1d2be68c487f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:16.204252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db321b4c-50b9-42d4-9a62-3a4f883ef979 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:16.205680 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db321b4c-50b9-42d4-9a62-3a4f883ef979 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:16.209220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db321b4c-50b9-42d4-9a62-3a4f883ef979 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:16.210227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db321b4c-50b9-42d4-9a62-3a4f883ef979 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:16.210855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db321b4c-50b9-42d4-9a62-3a4f883ef979 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:16.211725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db321b4c-50b9-42d4-9a62-3a4f883ef979 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:16.451426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e7c1b322-5a8b-48c1-a060-bb9cdec0b61d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:16.462079 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e7c1b322-5a8b-48c1-a060-bb9cdec0b61d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1314 microversion: 2.1 time: 0.310364 Oct 29 03:01:16.462881 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1511/3200] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:16 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:16.468275 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-12081c6e-2316-444b-bc37-ef0b02b0ca75 req-92ace033-d4f4-41f5-93b0-d4fa70c96011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afb9891b-c60a-4106-b2ed-b26d1ff0a459", "name": "network-vif-plugged", "status": "completed", "tag": "1c4eed69-bcd2-4a8f-87a2-773d5291f3db"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:16.480289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-12081c6e-2316-444b-bc37-ef0b02b0ca75 req-92ace033-d4f4-41f5-93b0-d4fa70c96011 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:16.480974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-12081c6e-2316-444b-bc37-ef0b02b0ca75 req-92ace033-d4f4-41f5-93b0-d4fa70c96011 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:16.481693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-12081c6e-2316-444b-bc37-ef0b02b0ca75 req-92ace033-d4f4-41f5-93b0-d4fa70c96011 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:16.498253 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-12081c6e-2316-444b-bc37-ef0b02b0ca75 req-92ace033-d4f4-41f5-93b0-d4fa70c96011 service nova] Creating event network-vif-plugged:1c4eed69-bcd2-4a8f-87a2-773d5291f3db for instance afb9891b-c60a-4106-b2ed-b26d1ff0a459 on n-h2-862967-2 Oct 29 03:01:16.505788 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-12081c6e-2316-444b-bc37-ef0b02b0ca75 req-92ace033-d4f4-41f5-93b0-d4fa70c96011 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039714 Oct 29 03:01:16.508869 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1512/3201] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:16.514892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7cf0cc85-35d9-4810-ad74-b26a8e365b80 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Action: 'create', calling method: .version_select at 0x7ff053615d30>, body: {"server_group": {"name": "tempest-server-group-1433534026", "policies": ["affinity"]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:16.559250 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:16.582692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-7cf0cc85-35d9-4810-ad74-b26a8e365b80 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Getting quotas for project 0c460e416a634939a16f63d0c4c01a68. Resources: {'server_groups'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:01:16.584102 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-db321b4c-50b9-42d4-9a62-3a4f883ef979 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "POST /compute/v2.1/servers/28d33b72-926b-49d9-8807-1d2be68c487f/action" status: 202 len: 0 microversion: 2.1 time: 0.408387 Oct 29 03:01:16.585355 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1690/3202] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:01:16 2022] POST /compute/v2.1/servers/28d33b72-926b-49d9-8807-1d2be68c487f/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 03:01:16.593320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-7cf0cc85-35d9-4810-ad74-b26a8e365b80 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Getting quotas for user b2b1564244d54ed9acc97a4924ecb4cd and project 0c460e416a634939a16f63d0c4c01a68. Resources: {'server_groups'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:01:16.598653 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8b9cbc8f-8f6e-473e-b24f-80d73957b666 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:16.606263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8b9cbc8f-8f6e-473e-b24f-80d73957b666 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:16.607351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8b9cbc8f-8f6e-473e-b24f-80d73957b666 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Searching by: {'ip': '172.20.0.11', 'deleted': False, 'project_id': '875f8af161b647758adaebd94449c8c1'} {{(pid=127124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:01:16.677968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-7cf0cc85-35d9-4810-ad74-b26a8e365b80 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Getting quotas for project 0c460e416a634939a16f63d0c4c01a68. Resources: {'server_groups'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:01:16.687925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-7cf0cc85-35d9-4810-ad74-b26a8e365b80 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Getting quotas for user b2b1564244d54ed9acc97a4924ecb4cd and project 0c460e416a634939a16f63d0c4c01a68. Resources: {'server_groups'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:01:16.712741 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7cf0cc85-35d9-4810-ad74-b26a8e365b80 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.198159 Oct 29 03:01:16.714440 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1513/3203] 10.222.0.46 () {60 vars in 1173 bytes} [Sat Oct 29 03:01:16 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:16.731827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6255f469-a7b3-4799-97e8-5baa977c8f90 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:16.732632 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6255f469-a7b3-4799-97e8-5baa977c8f90 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:16.747927 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6255f469-a7b3-4799-97e8-5baa977c8f90 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:16.750097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6255f469-a7b3-4799-97e8-5baa977c8f90 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:16.751953 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6255f469-a7b3-4799-97e8-5baa977c8f90 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:16.752516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6255f469-a7b3-4799-97e8-5baa977c8f90 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:16.753336 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6255f469-a7b3-4799-97e8-5baa977c8f90 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:16.754069 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6255f469-a7b3-4799-97e8-5baa977c8f90 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:16.833172 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:16.920085 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b9cbc8f-8f6e-473e-b24f-80d73957b666 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:16.920803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b9cbc8f-8f6e-473e-b24f-80d73957b666 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:16.921636 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b9cbc8f-8f6e-473e-b24f-80d73957b666 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:16.923337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b9cbc8f-8f6e-473e-b24f-80d73957b666 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:16.924053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b9cbc8f-8f6e-473e-b24f-80d73957b666 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:16.924571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b9cbc8f-8f6e-473e-b24f-80d73957b666 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:17.054108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.multi_cell_list [None req-8b9cbc8f-8f6e-473e-b24f-80d73957b666 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:01:17.163642 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6255f469-a7b3-4799-97e8-5baa977c8f90 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:17.179862 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6255f469-a7b3-4799-97e8-5baa977c8f90 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1392 microversion: 2.1 time: 0.454137 Oct 29 03:01:17.183891 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1514/3204] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:16 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1392 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:17.193726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-458b54e2-848c-48cc-a061-c5045fa3a34c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff0596c7c10>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:17.223974 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8b9cbc8f-8f6e-473e-b24f-80d73957b666 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers?ip=172.20.0.11" status: 200 len: 345 microversion: 2.1 time: 0.636565 Oct 29 03:01:17.225370 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1691/3205] 10.222.0.46 () {58 vars in 1154 bytes} [Sat Oct 29 03:01:16 2022] GET /compute/v2.1/servers?ip=172.20.0.11 => generated 345 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:17.240875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fd6f4b80-cde5-4197-b7ca-c2987dc333bd tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:17.297823 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-458b54e2-848c-48cc-a061-c5045fa3a34c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a" status: 200 len: 1410 microversion: 2.1 time: 0.111281 Oct 29 03:01:17.310107 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1515/3206] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:01:17 2022] GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a => generated 1410 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:17.310661 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fd6f4b80-cde5-4197-b7ca-c2987dc333bd tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/fc4e32b1-c845-44d2-bf57-940db8730515" status: 204 len: 0 microversion: 2.1 time: 0.074199 Oct 29 03:01:17.310661 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1692/3207] 10.222.0.46 () {58 vars in 1266 bytes} [Sat Oct 29 03:01:17 2022] DELETE /compute/v2.1/os-server-groups/fc4e32b1-c845-44d2-bf57-940db8730515 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:01:17.313756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2f11e0fe-88ea-467c-b534-1a15687cfc9c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:17.314351 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-76f1c2e6-aec5-44da-bb06-c057c8950f14 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:17.314515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2f11e0fe-88ea-467c-b534-1a15687cfc9c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:17.315609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-76f1c2e6-aec5-44da-bb06-c057c8950f14 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:17.323137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f11e0fe-88ea-467c-b534-1a15687cfc9c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:17.323670 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f11e0fe-88ea-467c-b534-1a15687cfc9c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:17.324298 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f11e0fe-88ea-467c-b534-1a15687cfc9c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:17.325205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f11e0fe-88ea-467c-b534-1a15687cfc9c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:17.325653 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f11e0fe-88ea-467c-b534-1a15687cfc9c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:17.326231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f11e0fe-88ea-467c-b534-1a15687cfc9c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:17.337356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-76f1c2e6-aec5-44da-bb06-c057c8950f14 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:17.339256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-76f1c2e6-aec5-44da-bb06-c057c8950f14 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:17.339968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-76f1c2e6-aec5-44da-bb06-c057c8950f14 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:17.343529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-76f1c2e6-aec5-44da-bb06-c057c8950f14 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:17.343529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-76f1c2e6-aec5-44da-bb06-c057c8950f14 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:17.343529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-76f1c2e6-aec5-44da-bb06-c057c8950f14 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:17.582604 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2f11e0fe-88ea-467c-b534-1a15687cfc9c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:17.593473 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2f11e0fe-88ea-467c-b534-1a15687cfc9c tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92" status: 200 len: 1512 microversion: 2.1 time: 0.283978 Oct 29 03:01:17.594873 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1693/3208] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:17 2022] GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 => generated 1512 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:17.610580 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f2dfa701-ee77-4ebb-9364-21c19a166e96 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:17.630331 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f2dfa701-ee77-4ebb-9364-21c19a166e96 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.034122 Oct 29 03:01:17.631644 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1694/3209] 10.222.0.46 () {58 vars in 1152 bytes} [Sat Oct 29 03:01:17 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:17.638758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fda851bc-7427-4beb-b8b5-0ae6eb95aa6d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:17.640398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fda851bc-7427-4beb-b8b5-0ae6eb95aa6d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:17.647589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fda851bc-7427-4beb-b8b5-0ae6eb95aa6d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:17.649014 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fda851bc-7427-4beb-b8b5-0ae6eb95aa6d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:17.649822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fda851bc-7427-4beb-b8b5-0ae6eb95aa6d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:17.650877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fda851bc-7427-4beb-b8b5-0ae6eb95aa6d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:17.651637 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fda851bc-7427-4beb-b8b5-0ae6eb95aa6d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:17.652421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fda851bc-7427-4beb-b8b5-0ae6eb95aa6d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:17.698457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-76f1c2e6-aec5-44da-bb06-c057c8950f14 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:17.717101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-76f1c2e6-aec5-44da-bb06-c057c8950f14 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:17.721901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-76f1c2e6-aec5-44da-bb06-c057c8950f14 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:17.723249 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-76f1c2e6-aec5-44da-bb06-c057c8950f14 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1879 microversion: 2.32 time: 0.420294 Oct 29 03:01:17.726353 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1516/3210] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:17 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1879 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:17.740158 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6d503f98-daa5-4c9e-97b1-05152eaa945f tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:17.742144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6d503f98-daa5-4c9e-97b1-05152eaa945f tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:17.759437 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d503f98-daa5-4c9e-97b1-05152eaa945f tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:17.760915 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d503f98-daa5-4c9e-97b1-05152eaa945f tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:17.762160 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d503f98-daa5-4c9e-97b1-05152eaa945f tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:17.763209 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d503f98-daa5-4c9e-97b1-05152eaa945f tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:17.768664 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d503f98-daa5-4c9e-97b1-05152eaa945f tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:17.769369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d503f98-daa5-4c9e-97b1-05152eaa945f tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:17.843085 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fda851bc-7427-4beb-b8b5-0ae6eb95aa6d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:17.856000 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fda851bc-7427-4beb-b8b5-0ae6eb95aa6d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1314 microversion: 2.1 time: 0.222717 Oct 29 03:01:17.856923 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1695/3211] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:17 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:17.870037 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ad244882-97c4-4e62-b1a8-d12a09afdd06 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:17.904887 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ad244882-97c4-4e62-b1a8-d12a09afdd06 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/cbdebda6-54e5-4f08-abb5-c41099a59877" status: 204 len: 0 microversion: 2.1 time: 0.044223 Oct 29 03:01:17.906725 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1696/3212] 10.222.0.46 () {58 vars in 1266 bytes} [Sat Oct 29 03:01:17 2022] DELETE /compute/v2.1/os-server-groups/cbdebda6-54e5-4f08-abb5-c41099a59877 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:01:17.987611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-5b0b532e-da68-47b0-812c-3af189a30c4f req-5a99e587-1cd9-4a34-b0ab-377d75511730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a79a761-e10f-4a8d-8e33-a21c08c81184", "name": "network-vif-unplugged", "status": "completed", "tag": "bf31d1ed-88f4-45a8-b01b-b6122fb270a1"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:18.014671 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5b0b532e-da68-47b0-812c-3af189a30c4f req-5a99e587-1cd9-4a34-b0ab-377d75511730 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:18.015486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5b0b532e-da68-47b0-812c-3af189a30c4f req-5a99e587-1cd9-4a34-b0ab-377d75511730 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:18.016434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5b0b532e-da68-47b0-812c-3af189a30c4f req-5a99e587-1cd9-4a34-b0ab-377d75511730 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:18.055222 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-5b0b532e-da68-47b0-812c-3af189a30c4f req-5a99e587-1cd9-4a34-b0ab-377d75511730 service nova] Creating event network-vif-unplugged:bf31d1ed-88f4-45a8-b01b-b6122fb270a1 for instance 6a79a761-e10f-4a8d-8e33-a21c08c81184 on n-h1-862967-2 Oct 29 03:01:18.062636 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-5b0b532e-da68-47b0-812c-3af189a30c4f req-5a99e587-1cd9-4a34-b0ab-377d75511730 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154433 Oct 29 03:01:18.064170 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1697/3213] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:18.082044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-64aafb25-55f8-43d4-812c-55e4687d4be5 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:18.104428 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-64aafb25-55f8-43d4-812c-55e4687d4be5 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.037807 Oct 29 03:01:18.105967 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1698/3214] 10.222.0.46 () {58 vars in 1152 bytes} [Sat Oct 29 03:01:18 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:18.136254 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a114adab-4d3d-4d0c-9872-39aa4fbf3c00 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Action: 'create', calling method: .version_select at 0x7ff053388a60>, body: {"server_group": {"name": "tempest-server-group-745555039", "policies": ["affinity"]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:18.137279 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6d503f98-daa5-4c9e-97b1-05152eaa945f tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:18.152863 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6d503f98-daa5-4c9e-97b1-05152eaa945f tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a" status: 200 len: 1511 microversion: 2.1 time: 0.422746 Oct 29 03:01:18.154285 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1517/3215] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:17 2022] GET /compute/v2.1/servers/4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a => generated 1511 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:18.176850 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b66b907d-b174-4fdc-8685-938f24ee8f58 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:18.177529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b66b907d-b174-4fdc-8685-938f24ee8f58 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 96a9fe4a-52f5-4b1f-955e-f991357b1813] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:18.185328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b66b907d-b174-4fdc-8685-938f24ee8f58 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:18.186053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b66b907d-b174-4fdc-8685-938f24ee8f58 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:18.186640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b66b907d-b174-4fdc-8685-938f24ee8f58 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:18.187603 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b66b907d-b174-4fdc-8685-938f24ee8f58 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:18.188276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b66b907d-b174-4fdc-8685-938f24ee8f58 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:18.188973 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b66b907d-b174-4fdc-8685-938f24ee8f58 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:18.246424 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-a114adab-4d3d-4d0c-9872-39aa4fbf3c00 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Getting quotas for project 0c460e416a634939a16f63d0c4c01a68. Resources: {'server_groups'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:01:18.252757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-a114adab-4d3d-4d0c-9872-39aa4fbf3c00 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Getting quotas for user b2b1564244d54ed9acc97a4924ecb4cd and project 0c460e416a634939a16f63d0c4c01a68. Resources: {'server_groups'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:01:18.312811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:18.333793 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-a114adab-4d3d-4d0c-9872-39aa4fbf3c00 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Getting quotas for project 0c460e416a634939a16f63d0c4c01a68. Resources: {'server_groups'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:01:18.370122 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-a114adab-4d3d-4d0c-9872-39aa4fbf3c00 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Getting quotas for user b2b1564244d54ed9acc97a4924ecb4cd and project 0c460e416a634939a16f63d0c4c01a68. Resources: {'server_groups'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:01:18.404380 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a114adab-4d3d-4d0c-9872-39aa4fbf3c00 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.288424 Oct 29 03:01:18.406101 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1699/3216] 10.222.0.46 () {60 vars in 1173 bytes} [Sat Oct 29 03:01:18 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:18.417893 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-39b212b8-0367-40c9-b408-fe34a103daeb tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:18.420735 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-39b212b8-0367-40c9-b408-fe34a103daeb tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:18.429650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39b212b8-0367-40c9-b408-fe34a103daeb tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:18.431169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39b212b8-0367-40c9-b408-fe34a103daeb tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:18.433687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39b212b8-0367-40c9-b408-fe34a103daeb tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:18.434712 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39b212b8-0367-40c9-b408-fe34a103daeb tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:18.436068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39b212b8-0367-40c9-b408-fe34a103daeb tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:18.438052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39b212b8-0367-40c9-b408-fe34a103daeb tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:18.536055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b66b907d-b174-4fdc-8685-938f24ee8f58 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:18.547043 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b66b907d-b174-4fdc-8685-938f24ee8f58 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813" status: 200 len: 1512 microversion: 2.1 time: 0.374090 Oct 29 03:01:18.547993 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1518/3217] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:18 2022] GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813 => generated 1512 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:01:18.559619 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-00b4a628-8cd3-43cf-86b5-0fd5393b33a4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff0589ca9d0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:18.631831 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-00b4a628-8cd3-43cf-86b5-0fd5393b33a4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a" status: 200 len: 1410 microversion: 2.1 time: 0.081889 Oct 29 03:01:18.633534 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1519/3218] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:01:18 2022] GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a => generated 1410 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:18.641874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1821da6a-a97d-43ce-b020-f72c1af8cc27 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:18.667693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-39b212b8-0367-40c9-b408-fe34a103daeb tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:18.681778 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-39b212b8-0367-40c9-b408-fe34a103daeb tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1392 microversion: 2.1 time: 0.273177 Oct 29 03:01:18.682380 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1700/3219] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:18 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1392 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:18.689611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-217ded2f-b34b-4f6d-838d-7e706a3b59ab tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:18.695229 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-217ded2f-b34b-4f6d-838d-7e706a3b59ab tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:18.696018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-217ded2f-b34b-4f6d-838d-7e706a3b59ab tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Searching by: {'deleted': False, 'project_id': '875f8af161b647758adaebd94449c8c1'} {{(pid=127124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:01:18.704859 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1821da6a-a97d-43ce-b020-f72c1af8cc27 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/a2e70ec4-0b5a-4ed5-a755-edff2447e921" status: 204 len: 0 microversion: 2.1 time: 0.069825 Oct 29 03:01:18.707590 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1520/3220] 10.222.0.46 () {58 vars in 1266 bytes} [Sat Oct 29 03:01:18 2022] DELETE /compute/v2.1/os-server-groups/a2e70ec4-0b5a-4ed5-a755-edff2447e921 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:01:18.709938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-217ded2f-b34b-4f6d-838d-7e706a3b59ab tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:18.710703 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-217ded2f-b34b-4f6d-838d-7e706a3b59ab tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:18.711145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-217ded2f-b34b-4f6d-838d-7e706a3b59ab tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:18.711873 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-217ded2f-b34b-4f6d-838d-7e706a3b59ab tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:18.712329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-217ded2f-b34b-4f6d-838d-7e706a3b59ab tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:18.712826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-217ded2f-b34b-4f6d-838d-7e706a3b59ab tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:18.719750 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6e641d37-3d25-46db-bcb0-2220a49a3d10 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:18.742918 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6e641d37-3d25-46db-bcb0-2220a49a3d10 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.030150 Oct 29 03:01:18.745299 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1521/3221] 10.222.0.46 () {58 vars in 1152 bytes} [Sat Oct 29 03:01:18 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:01:18.747898 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.multi_cell_list [None req-217ded2f-b34b-4f6d-838d-7e706a3b59ab tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:01:18.776052 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-0cc90555-4858-40d8-a262-263ccd316ef7 req-126b54ed-294f-4354-a391-2f179033d037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c72534eb-1844-4208-b625-ea8b5ece8108", "name": "network-vif-plugged", "status": "completed", "tag": "5c3d2712-9ad6-4627-8b5c-ca13b6071e0e"}, {"server_uuid": "c72534eb-1844-4208-b625-ea8b5ece8108", "name": "network-vif-plugged", "status": "completed", "tag": "951b4e8b-0238-4e1b-b891-991e85f03a1b"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:18.794519 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0cc90555-4858-40d8-a262-263ccd316ef7 req-126b54ed-294f-4354-a391-2f179033d037 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:18.794993 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0cc90555-4858-40d8-a262-263ccd316ef7 req-126b54ed-294f-4354-a391-2f179033d037 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:18.795417 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0cc90555-4858-40d8-a262-263ccd316ef7 req-126b54ed-294f-4354-a391-2f179033d037 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:18.828209 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-0cc90555-4858-40d8-a262-263ccd316ef7 req-126b54ed-294f-4354-a391-2f179033d037 service nova] Creating event network-vif-plugged:5c3d2712-9ad6-4627-8b5c-ca13b6071e0e for instance c72534eb-1844-4208-b625-ea8b5ece8108 on n-h1-862967-2 Oct 29 03:01:18.834013 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-0cc90555-4858-40d8-a262-263ccd316ef7 req-126b54ed-294f-4354-a391-2f179033d037 service nova] Creating event network-vif-plugged:951b4e8b-0238-4e1b-b891-991e85f03a1b for instance c72534eb-1844-4208-b625-ea8b5ece8108 on n-h1-862967-2 Oct 29 03:01:18.841756 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-0cc90555-4858-40d8-a262-263ccd316ef7 req-126b54ed-294f-4354-a391-2f179033d037 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.094006 Oct 29 03:01:18.842600 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1522/3222] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:18.848822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-db302cf1-0ff2-4ebf-a9ea-6dcb54b0080d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:18.849865 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-db302cf1-0ff2-4ebf-a9ea-6dcb54b0080d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:18.857069 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db302cf1-0ff2-4ebf-a9ea-6dcb54b0080d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:18.858023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db302cf1-0ff2-4ebf-a9ea-6dcb54b0080d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:18.859395 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db302cf1-0ff2-4ebf-a9ea-6dcb54b0080d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:18.860424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db302cf1-0ff2-4ebf-a9ea-6dcb54b0080d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:18.861887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db302cf1-0ff2-4ebf-a9ea-6dcb54b0080d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:18.862551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db302cf1-0ff2-4ebf-a9ea-6dcb54b0080d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:18.864611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-217ded2f-b34b-4f6d-838d-7e706a3b59ab tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:18.879825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-217ded2f-b34b-4f6d-838d-7e706a3b59ab tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:18.880176 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-217ded2f-b34b-4f6d-838d-7e706a3b59ab tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:18.880691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-217ded2f-b34b-4f6d-838d-7e706a3b59ab tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:19.084201 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-217ded2f-b34b-4f6d-838d-7e706a3b59ab tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 0.399012 Oct 29 03:01:19.084911 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1701/3223] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 03:01:18 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:19.089854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-58d39cbc-7d37-4d26-8a78-d4165a3daf05 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Action: 'create', calling method: .version_select at 0x7ff0533ee5e0>, body: {"server_group": {"name": "tempest-server-group-411153908", "policies": ["anti-affinity"]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:19.134974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-58d39cbc-7d37-4d26-8a78-d4165a3daf05 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Getting quotas for project 0c460e416a634939a16f63d0c4c01a68. Resources: {'server_groups'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:01:19.138554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-db302cf1-0ff2-4ebf-a9ea-6dcb54b0080d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:19.146676 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-58d39cbc-7d37-4d26-8a78-d4165a3daf05 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Getting quotas for user b2b1564244d54ed9acc97a4924ecb4cd and project 0c460e416a634939a16f63d0c4c01a68. Resources: {'server_groups'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:01:19.153900 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-db302cf1-0ff2-4ebf-a9ea-6dcb54b0080d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:19.156417 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-db302cf1-0ff2-4ebf-a9ea-6dcb54b0080d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:19.159430 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-db302cf1-0ff2-4ebf-a9ea-6dcb54b0080d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1879 microversion: 2.32 time: 0.315044 Oct 29 03:01:19.175801 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1523/3224] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:18 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1879 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:19.175801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f3c17b06-9ff0-4ff0-a364-5d77128e9cc3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:19.175801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f3c17b06-9ff0-4ff0-a364-5d77128e9cc3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:19.181203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3c17b06-9ff0-4ff0-a364-5d77128e9cc3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:19.181695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3c17b06-9ff0-4ff0-a364-5d77128e9cc3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:19.182123 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3c17b06-9ff0-4ff0-a364-5d77128e9cc3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:19.182990 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3c17b06-9ff0-4ff0-a364-5d77128e9cc3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:19.183655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3c17b06-9ff0-4ff0-a364-5d77128e9cc3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:19.184332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3c17b06-9ff0-4ff0-a364-5d77128e9cc3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:19.222426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-58d39cbc-7d37-4d26-8a78-d4165a3daf05 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Getting quotas for project 0c460e416a634939a16f63d0c4c01a68. Resources: {'server_groups'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:01:19.235927 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-58d39cbc-7d37-4d26-8a78-d4165a3daf05 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Getting quotas for user b2b1564244d54ed9acc97a4924ecb4cd and project 0c460e416a634939a16f63d0c4c01a68. Resources: {'server_groups'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:01:19.255106 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-58d39cbc-7d37-4d26-8a78-d4165a3daf05 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.169011 Oct 29 03:01:19.256063 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1702/3225] 10.222.0.46 () {60 vars in 1173 bytes} [Sat Oct 29 03:01:19 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:19.262216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dea07f4a-f4be-455a-91f9-e10ad1a7951b tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:19.269343 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dea07f4a-f4be-455a-91f9-e10ad1a7951b tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:19.270978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dea07f4a-f4be-455a-91f9-e10ad1a7951b tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '875f8af161b647758adaebd94449c8c1'} {{(pid=127124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:01:19.353196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dea07f4a-f4be-455a-91f9-e10ad1a7951b tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:19.354696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dea07f4a-f4be-455a-91f9-e10ad1a7951b tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:19.355290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dea07f4a-f4be-455a-91f9-e10ad1a7951b tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:19.356123 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dea07f4a-f4be-455a-91f9-e10ad1a7951b tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:19.356868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dea07f4a-f4be-455a-91f9-e10ad1a7951b tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:19.357787 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dea07f4a-f4be-455a-91f9-e10ad1a7951b tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:19.369421 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f3c17b06-9ff0-4ff0-a364-5d77128e9cc3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:19.385202 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f3c17b06-9ff0-4ff0-a364-5d77128e9cc3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1502 microversion: 2.1 time: 0.219778 Oct 29 03:01:19.394140 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1524/3226] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:19 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1502 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:19.396202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.multi_cell_list [None req-dea07f4a-f4be-455a-91f9-e10ad1a7951b tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:01:19.399165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-54dcbc4a-7547-4803-a204-050d27424bca tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:19.430401 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dea07f4a-f4be-455a-91f9-e10ad1a7951b tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.173062 Oct 29 03:01:19.431487 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1703/3227] 10.222.0.46 () {58 vars in 1150 bytes} [Sat Oct 29 03:01:19 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:19.441894 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-54dcbc4a-7547-4803-a204-050d27424bca tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/cc4f172c-8e0f-4730-b8d1-833451850ad7" status: 204 len: 0 microversion: 2.1 time: 0.040772 Oct 29 03:01:19.441894 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1525/3228] 10.222.0.46 () {58 vars in 1266 bytes} [Sat Oct 29 03:01:19 2022] DELETE /compute/v2.1/os-server-groups/cc4f172c-8e0f-4730-b8d1-833451850ad7 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:01:19.443445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0739a7eb-46a6-44f7-8d3b-f812c67212e6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:19.447802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f039df9c-5aa9-4d78-80dc-9dd297422102 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:19.454979 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0739a7eb-46a6-44f7-8d3b-f812c67212e6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:19.455852 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0739a7eb-46a6-44f7-8d3b-f812c67212e6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:19.456617 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0739a7eb-46a6-44f7-8d3b-f812c67212e6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:19.459637 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f039df9c-5aa9-4d78-80dc-9dd297422102 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.015782 Oct 29 03:01:19.460598 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1704/3229] 10.222.0.46 () {58 vars in 1152 bytes} [Sat Oct 29 03:01:19 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:19.465551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dec9eda6-620d-4777-b712-1ffff1f360c5 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:19.470893 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dec9eda6-620d-4777-b712-1ffff1f360c5 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:19.471865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dec9eda6-620d-4777-b712-1ffff1f360c5 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '875f8af161b647758adaebd94449c8c1'} {{(pid=127124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:01:19.478335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dec9eda6-620d-4777-b712-1ffff1f360c5 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:19.479012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dec9eda6-620d-4777-b712-1ffff1f360c5 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:19.479606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dec9eda6-620d-4777-b712-1ffff1f360c5 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:19.480495 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dec9eda6-620d-4777-b712-1ffff1f360c5 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:19.481259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dec9eda6-620d-4777-b712-1ffff1f360c5 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:19.481902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dec9eda6-620d-4777-b712-1ffff1f360c5 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:19.492614 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0739a7eb-46a6-44f7-8d3b-f812c67212e6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Going to try to stop instance {{(pid=127125) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 03:01:19.559073 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0739a7eb-46a6-44f7-8d3b-f812c67212e6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "POST /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459/action" status: 202 len: 0 microversion: 2.1 time: 0.120311 Oct 29 03:01:19.560001 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1526/3230] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:01:19 2022] POST /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:01:19.562719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0739a7eb-46a6-44f7-8d3b-f812c67212e6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:19.564798 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0739a7eb-46a6-44f7-8d3b-f812c67212e6 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003333 Oct 29 03:01:19.567260 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1527/3231] 10.222.0.46 () {56 vars in 886 bytes} [Sat Oct 29 03:01:19 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 29 03:01:19.578748 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3cabba79-9b1a-412b-9d3a-9bbe7416431d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:19.581551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3cabba79-9b1a-412b-9d3a-9bbe7416431d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:19.594526 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3cabba79-9b1a-412b-9d3a-9bbe7416431d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:19.595277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3cabba79-9b1a-412b-9d3a-9bbe7416431d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:19.596613 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3cabba79-9b1a-412b-9d3a-9bbe7416431d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:19.598267 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3cabba79-9b1a-412b-9d3a-9bbe7416431d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:19.599609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3cabba79-9b1a-412b-9d3a-9bbe7416431d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:19.600037 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.multi_cell_list [None req-dec9eda6-620d-4777-b712-1ffff1f360c5 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:01:19.600991 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3cabba79-9b1a-412b-9d3a-9bbe7416431d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:19.677876 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dec9eda6-620d-4777-b712-1ffff1f360c5 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.215917 Oct 29 03:01:19.678581 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1705/3232] 10.222.0.46 () {58 vars in 1212 bytes} [Sat Oct 29 03:01:19 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:19.679973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dec9eda6-620d-4777-b712-1ffff1f360c5 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:19.681036 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dec9eda6-620d-4777-b712-1ffff1f360c5 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001604 Oct 29 03:01:19.681414 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1706/3233] 10.222.0.46 () {54 vars in 1035 bytes} [Sat Oct 29 03:01:19 2022] GET /compute/v2/ => generated 379 bytes in 2 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 29 03:01:19.686604 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b6420f64-e1a3-4c48-a0c7-656d8440c8e6 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053bd80d0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:19.742048 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b6420f64-e1a3-4c48-a0c7-656d8440c8e6 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a" status: 200 len: 1410 microversion: 2.1 time: 0.059373 Oct 29 03:01:19.742850 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1707/3234] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:01:19 2022] GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a => generated 1410 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:19.760084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fdbebf41-6366-4928-82ad-af0c78485083 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1767372034", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "e516c195-af4a-44fd-acc0-7cda2a3fa163"}]}, "os:scheduler_hints": {"group": "04a00b30-e2f8-4b55-993b-ad65f6001012"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:19.775999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3cabba79-9b1a-412b-9d3a-9bbe7416431d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:19.784721 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3cabba79-9b1a-412b-9d3a-9bbe7416431d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1512 microversion: 2.1 time: 0.216029 Oct 29 03:01:19.785529 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1528/3235] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:19 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1512 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:19.790565 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-22cb41f4-fc79-4e5d-a961-03ccb08196c0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:19.795884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-22cb41f4-fc79-4e5d-a961-03ccb08196c0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:19.797222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-22cb41f4-fc79-4e5d-a961-03ccb08196c0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '875f8af161b647758adaebd94449c8c1'} {{(pid=127125) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:01:19.803084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22cb41f4-fc79-4e5d-a961-03ccb08196c0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:19.803851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22cb41f4-fc79-4e5d-a961-03ccb08196c0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:19.804482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22cb41f4-fc79-4e5d-a961-03ccb08196c0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:19.805285 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22cb41f4-fc79-4e5d-a961-03ccb08196c0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:19.805797 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22cb41f4-fc79-4e5d-a961-03ccb08196c0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:19.806280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22cb41f4-fc79-4e5d-a961-03ccb08196c0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:19.832042 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-fdbebf41-6366-4928-82ad-af0c78485083 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] validate_networks() for [('e516c195-af4a-44fd-acc0-7cda2a3fa163', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:01:19.906483 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.multi_cell_list [None req-22cb41f4-fc79-4e5d-a961-03ccb08196c0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:01:19.974685 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-22cb41f4-fc79-4e5d-a961-03ccb08196c0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.187771 Oct 29 03:01:19.982473 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1529/3236] 10.222.0.46 () {58 vars in 1196 bytes} [Sat Oct 29 03:01:19 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:19.982473 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-22cb41f4-fc79-4e5d-a961-03ccb08196c0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:19.982473 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-22cb41f4-fc79-4e5d-a961-03ccb08196c0 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001297 Oct 29 03:01:19.982473 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1530/3237] 10.222.0.46 () {54 vars in 1041 bytes} [Sat Oct 29 03:01:19 2022] GET /compute/v2.1/ => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:19.983477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ebe27c5d-4bb5-4aa6-9e13-b2c30ee37489 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:19.985438 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ebe27c5d-4bb5-4aa6-9e13-b2c30ee37489 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:19.990732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ebe27c5d-4bb5-4aa6-9e13-b2c30ee37489 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:19.991336 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ebe27c5d-4bb5-4aa6-9e13-b2c30ee37489 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:19.991860 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ebe27c5d-4bb5-4aa6-9e13-b2c30ee37489 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:19.992827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ebe27c5d-4bb5-4aa6-9e13-b2c30ee37489 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:19.993925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ebe27c5d-4bb5-4aa6-9e13-b2c30ee37489 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:19.993925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ebe27c5d-4bb5-4aa6-9e13-b2c30ee37489 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:20.178118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ebe27c5d-4bb5-4aa6-9e13-b2c30ee37489 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:20.188619 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ebe27c5d-4bb5-4aa6-9e13-b2c30ee37489 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1392 microversion: 2.1 time: 0.209205 Oct 29 03:01:20.197372 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1531/3238] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:19 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1392 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:20.208454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4c5fa70c-f17a-47a0-b1bf-f8b9bb50a21a tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:20.218847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4c5fa70c-f17a-47a0-b1bf-f8b9bb50a21a tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:20.220274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4c5fa70c-f17a-47a0-b1bf-f8b9bb50a21a tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Searching by: {'name': '1618626768', 'deleted': False, 'project_id': '875f8af161b647758adaebd94449c8c1'} {{(pid=127125) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:01:20.226789 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c5fa70c-f17a-47a0-b1bf-f8b9bb50a21a tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:20.227290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c5fa70c-f17a-47a0-b1bf-f8b9bb50a21a tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:20.228045 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c5fa70c-f17a-47a0-b1bf-f8b9bb50a21a tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:20.230241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c5fa70c-f17a-47a0-b1bf-f8b9bb50a21a tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:20.230849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c5fa70c-f17a-47a0-b1bf-f8b9bb50a21a tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:20.231491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c5fa70c-f17a-47a0-b1bf-f8b9bb50a21a tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:20.350503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.multi_cell_list [None req-4c5fa70c-f17a-47a0-b1bf-f8b9bb50a21a tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:01:20.352897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-fdbebf41-6366-4928-82ad-af0c78485083 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:01:20.353410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-fdbebf41-6366-4928-82ad-af0c78485083 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:01:20.353836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-fdbebf41-6366-4928-82ad-af0c78485083 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:01:20.354323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-fdbebf41-6366-4928-82ad-af0c78485083 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:01:20.355195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-fdbebf41-6366-4928-82ad-af0c78485083 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:01:20.391706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fdbebf41-6366-4928-82ad-af0c78485083 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:20.392290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fdbebf41-6366-4928-82ad-af0c78485083 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:20.392778 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fdbebf41-6366-4928-82ad-af0c78485083 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:20.393537 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fdbebf41-6366-4928-82ad-af0c78485083 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:20.394162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fdbebf41-6366-4928-82ad-af0c78485083 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:20.394596 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fdbebf41-6366-4928-82ad-af0c78485083 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:20.425451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-fdbebf41-6366-4928-82ad-af0c78485083 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Getting quotas for project 0c460e416a634939a16f63d0c4c01a68. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:01:20.431961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-fdbebf41-6366-4928-82ad-af0c78485083 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Getting quotas for user b2b1564244d54ed9acc97a4924ecb4cd and project 0c460e416a634939a16f63d0c4c01a68. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:01:20.458047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fdbebf41-6366-4928-82ad-af0c78485083 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:01:20.461700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fdbebf41-6366-4928-82ad-af0c78485083 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] [instance: 92925276-7e25-4969-b5f8-c1d4acbb346b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:01:20.493145 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4c5fa70c-f17a-47a0-b1bf-f8b9bb50a21a tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers?name=1618626768" status: 200 len: 346 microversion: 2.1 time: 0.294332 Oct 29 03:01:20.506781 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1532/3239] 10.222.0.46 () {58 vars in 1156 bytes} [Sat Oct 29 03:01:20 2022] GET /compute/v2.1/servers?name=1618626768 => generated 346 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:20.510106 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4c5fa70c-f17a-47a0-b1bf-f8b9bb50a21a tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:20.511263 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4c5fa70c-f17a-47a0-b1bf-f8b9bb50a21a tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003397 Oct 29 03:01:20.514577 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1533/3240] 10.222.0.46 () {56 vars in 886 bytes} [Sat Oct 29 03:01:20 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 29 03:01:20.525196 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-c520bdcf-b811-4a7e-87a4-5a2be3f98ce4 req-6e84b759-daa8-4b8c-89a1-774b28a3fba2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a79a761-e10f-4a8d-8e33-a21c08c81184", "tag": "bf31d1ed-88f4-45a8-b01b-b6122fb270a1"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:20.556417 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c520bdcf-b811-4a7e-87a4-5a2be3f98ce4 req-6e84b759-daa8-4b8c-89a1-774b28a3fba2 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:20.557145 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c520bdcf-b811-4a7e-87a4-5a2be3f98ce4 req-6e84b759-daa8-4b8c-89a1-774b28a3fba2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:20.557686 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c520bdcf-b811-4a7e-87a4-5a2be3f98ce4 req-6e84b759-daa8-4b8c-89a1-774b28a3fba2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:20.565166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-fdbebf41-6366-4928-82ad-af0c78485083 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Getting quotas for project 0c460e416a634939a16f63d0c4c01a68. Resources: {'server_group_members'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:01:20.572892 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-fdbebf41-6366-4928-82ad-af0c78485083 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Getting quotas for user b2b1564244d54ed9acc97a4924ecb4cd and project 0c460e416a634939a16f63d0c4c01a68. Resources: {'server_group_members'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:01:20.584161 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-c520bdcf-b811-4a7e-87a4-5a2be3f98ce4 req-6e84b759-daa8-4b8c-89a1-774b28a3fba2 service nova] Creating event network-changed:bf31d1ed-88f4-45a8-b01b-b6122fb270a1 for instance 6a79a761-e10f-4a8d-8e33-a21c08c81184 on n-h1-862967-2 Oct 29 03:01:20.596274 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-c520bdcf-b811-4a7e-87a4-5a2be3f98ce4 req-6e84b759-daa8-4b8c-89a1-774b28a3fba2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081900 Oct 29 03:01:20.598180 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1534/3241] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:20.615224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-58cbb894-dbe2-4a97-a89f-ddc4051ba2ca tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:20.616566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-58cbb894-dbe2-4a97-a89f-ddc4051ba2ca tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:20.624147 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58cbb894-dbe2-4a97-a89f-ddc4051ba2ca tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:20.625088 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58cbb894-dbe2-4a97-a89f-ddc4051ba2ca tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:20.625742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58cbb894-dbe2-4a97-a89f-ddc4051ba2ca tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:20.626616 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58cbb894-dbe2-4a97-a89f-ddc4051ba2ca tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:20.627079 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58cbb894-dbe2-4a97-a89f-ddc4051ba2ca tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:20.627510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58cbb894-dbe2-4a97-a89f-ddc4051ba2ca tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:20.651914 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-fdbebf41-6366-4928-82ad-af0c78485083 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Getting quotas for project 0c460e416a634939a16f63d0c4c01a68. Resources: {'server_group_members'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:01:20.659907 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-fdbebf41-6366-4928-82ad-af0c78485083 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Getting quotas for user b2b1564244d54ed9acc97a4924ecb4cd and project 0c460e416a634939a16f63d0c4c01a68. Resources: {'server_group_members'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:01:20.727780 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fdbebf41-6366-4928-82ad-af0c78485083 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.983813 Oct 29 03:01:20.744797 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1708/3242] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:01:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:01:20.762626 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6e81792d-2ad5-4999-aff5-30e36eba40d1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:20.770332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6e81792d-2ad5-4999-aff5-30e36eba40d1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:20.771365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6e81792d-2ad5-4999-aff5-30e36eba40d1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '875f8af161b647758adaebd94449c8c1'} {{(pid=127124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:01:20.778690 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e81792d-2ad5-4999-aff5-30e36eba40d1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:20.779172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e81792d-2ad5-4999-aff5-30e36eba40d1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:20.779676 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e81792d-2ad5-4999-aff5-30e36eba40d1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:20.780465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e81792d-2ad5-4999-aff5-30e36eba40d1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:20.781036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e81792d-2ad5-4999-aff5-30e36eba40d1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:20.781517 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e81792d-2ad5-4999-aff5-30e36eba40d1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:21.056057 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.multi_cell_list [None req-6e81792d-2ad5-4999-aff5-30e36eba40d1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:01:21.301203 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6e81792d-2ad5-4999-aff5-30e36eba40d1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.556920 Oct 29 03:01:21.301875 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1709/3243] 10.222.0.46 () {58 vars in 1154 bytes} [Sat Oct 29 03:01:20 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:21.313466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-985f70a8-d72b-4dee-906f-4137bc22afed tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:21.324804 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-985f70a8-d72b-4dee-906f-4137bc22afed tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] [instance: 92925276-7e25-4969-b5f8-c1d4acbb346b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:21.434256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-985f70a8-d72b-4dee-906f-4137bc22afed tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b1564244d54ed9acc97a4924ecb4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c460e416a634939a16f63d0c4c01a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:21.448234 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-985f70a8-d72b-4dee-906f-4137bc22afed tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b" status: 200 len: 1213 microversion: 2.1 time: 0.141641 Oct 29 03:01:21.448937 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1710/3244] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:21 2022] GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b => generated 1213 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:21.454606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-60b8162d-4b95-4a8f-8aad-c656ed5647f2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff058043e50>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:21.525196 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-60b8162d-4b95-4a8f-8aad-c656ed5647f2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a" status: 200 len: 1410 microversion: 2.1 time: 0.074177 Oct 29 03:01:21.526474 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1711/3245] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:01:21 2022] GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a => generated 1410 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:21.552039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-40a45084-0fa3-426b-9701-da94b76f512c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:21.553971 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-40a45084-0fa3-426b-9701-da94b76f512c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:21.568831 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40a45084-0fa3-426b-9701-da94b76f512c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:21.571758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40a45084-0fa3-426b-9701-da94b76f512c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:21.573060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40a45084-0fa3-426b-9701-da94b76f512c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:21.576028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40a45084-0fa3-426b-9701-da94b76f512c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:21.577383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40a45084-0fa3-426b-9701-da94b76f512c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:21.578383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40a45084-0fa3-426b-9701-da94b76f512c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:21.630841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-58cbb894-dbe2-4a97-a89f-ddc4051ba2ca tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:21.653540 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-58cbb894-dbe2-4a97-a89f-ddc4051ba2ca tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:21.657251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-58cbb894-dbe2-4a97-a89f-ddc4051ba2ca tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:21.663543 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-58cbb894-dbe2-4a97-a89f-ddc4051ba2ca tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1879 microversion: 2.32 time: 1.063799 Oct 29 03:01:21.665595 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1535/3246] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:20 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1879 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:21.673703 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-0bed2211-742d-415a-87cb-97efe94e9857 req-9dd15557-8ea4-443a-8655-311979f29732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c72534eb-1844-4208-b625-ea8b5ece8108", "name": "network-vif-plugged", "status": "completed", "tag": "c7d91e7c-5b11-484a-b555-6a407dc903e3"}, {"server_uuid": "c72534eb-1844-4208-b625-ea8b5ece8108", "name": "network-vif-plugged", "status": "completed", "tag": "998148a8-ddff-46d0-94b6-c27edcac4cb0"}, {"server_uuid": "c72534eb-1844-4208-b625-ea8b5ece8108", "name": "network-vif-plugged", "status": "completed", "tag": "4c67f638-2ba1-48d4-80b9-c0539cebe183"}, {"server_uuid": "c72534eb-1844-4208-b625-ea8b5ece8108", "name": "network-vif-plugged", "status": "completed", "tag": "3feb2664-749f-4176-9acc-3d1f17ebbb83"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:21.695833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0bed2211-742d-415a-87cb-97efe94e9857 req-9dd15557-8ea4-443a-8655-311979f29732 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:21.704810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0bed2211-742d-415a-87cb-97efe94e9857 req-9dd15557-8ea4-443a-8655-311979f29732 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:21.706290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0bed2211-742d-415a-87cb-97efe94e9857 req-9dd15557-8ea4-443a-8655-311979f29732 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:21.735512 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-0bed2211-742d-415a-87cb-97efe94e9857 req-9dd15557-8ea4-443a-8655-311979f29732 service nova] Creating event network-vif-plugged:c7d91e7c-5b11-484a-b555-6a407dc903e3 for instance c72534eb-1844-4208-b625-ea8b5ece8108 on n-h1-862967-2 Oct 29 03:01:21.742860 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-0bed2211-742d-415a-87cb-97efe94e9857 req-9dd15557-8ea4-443a-8655-311979f29732 service nova] Creating event network-vif-plugged:998148a8-ddff-46d0-94b6-c27edcac4cb0 for instance c72534eb-1844-4208-b625-ea8b5ece8108 on n-h1-862967-2 Oct 29 03:01:21.744874 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-0bed2211-742d-415a-87cb-97efe94e9857 req-9dd15557-8ea4-443a-8655-311979f29732 service nova] Creating event network-vif-plugged:4c67f638-2ba1-48d4-80b9-c0539cebe183 for instance c72534eb-1844-4208-b625-ea8b5ece8108 on n-h1-862967-2 Oct 29 03:01:21.749369 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-0bed2211-742d-415a-87cb-97efe94e9857 req-9dd15557-8ea4-443a-8655-311979f29732 service nova] Creating event network-vif-plugged:3feb2664-749f-4176-9acc-3d1f17ebbb83 for instance c72534eb-1844-4208-b625-ea8b5ece8108 on n-h1-862967-2 Oct 29 03:01:21.773624 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-0bed2211-742d-415a-87cb-97efe94e9857 req-9dd15557-8ea4-443a-8655-311979f29732 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.100171 Oct 29 03:01:21.783018 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1536/3247] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:21.792260 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d3e2513a-aafd-40d3-8d6f-2c5307dce559 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:21.797337 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d3e2513a-aafd-40d3-8d6f-2c5307dce559 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:21.812222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d3e2513a-aafd-40d3-8d6f-2c5307dce559 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:21.813620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d3e2513a-aafd-40d3-8d6f-2c5307dce559 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:21.814684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d3e2513a-aafd-40d3-8d6f-2c5307dce559 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:21.815777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d3e2513a-aafd-40d3-8d6f-2c5307dce559 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:21.817098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d3e2513a-aafd-40d3-8d6f-2c5307dce559 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:21.817799 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d3e2513a-aafd-40d3-8d6f-2c5307dce559 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:22.234330 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-40a45084-0fa3-426b-9701-da94b76f512c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:22.250701 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-40a45084-0fa3-426b-9701-da94b76f512c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1512 microversion: 2.1 time: 0.721676 Oct 29 03:01:22.262700 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1712/3248] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:21 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1512 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:22.280544 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-124a2cee-fb65-4e1f-9d84-5e43331b331b tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:22.297682 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-124a2cee-fb65-4e1f-9d84-5e43331b331b tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:22.298407 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-124a2cee-fb65-4e1f-9d84-5e43331b331b tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-161862676', 'deleted': False, 'project_id': '875f8af161b647758adaebd94449c8c1'} {{(pid=127124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:01:22.312687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-124a2cee-fb65-4e1f-9d84-5e43331b331b tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:22.313186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-124a2cee-fb65-4e1f-9d84-5e43331b331b tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:22.313620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-124a2cee-fb65-4e1f-9d84-5e43331b331b tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:22.314530 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-124a2cee-fb65-4e1f-9d84-5e43331b331b tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:22.315044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-124a2cee-fb65-4e1f-9d84-5e43331b331b tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:22.315526 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-124a2cee-fb65-4e1f-9d84-5e43331b331b tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:22.421012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d3e2513a-aafd-40d3-8d6f-2c5307dce559 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:22.437463 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d3e2513a-aafd-40d3-8d6f-2c5307dce559 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1392 microversion: 2.1 time: 0.650151 Oct 29 03:01:22.439691 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1537/3249] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:21 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1392 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:22.488905 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3fc9e934-9ec8-4388-999f-2085244819ce tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:22.490297 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3fc9e934-9ec8-4388-999f-2085244819ce tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] [instance: 92925276-7e25-4969-b5f8-c1d4acbb346b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:22.508710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3fc9e934-9ec8-4388-999f-2085244819ce tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:22.512036 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3fc9e934-9ec8-4388-999f-2085244819ce tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:22.515443 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3fc9e934-9ec8-4388-999f-2085244819ce tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:22.520125 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3fc9e934-9ec8-4388-999f-2085244819ce tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:22.522026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3fc9e934-9ec8-4388-999f-2085244819ce tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:22.524053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3fc9e934-9ec8-4388-999f-2085244819ce tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:22.574748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.multi_cell_list [None req-124a2cee-fb65-4e1f-9d84-5e43331b331b tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:01:22.752238 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-124a2cee-fb65-4e1f-9d84-5e43331b331b tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-161862676" status: 200 len: 346 microversion: 2.1 time: 0.489010 Oct 29 03:01:22.754832 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1713/3250] 10.222.0.46 () {58 vars in 1228 bytes} [Sat Oct 29 03:01:22 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-161862676 => generated 346 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:22.761969 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e9123d0b-12ea-4b73-9398-ac5b5e009726 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053e02e50>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:22.824401 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e9123d0b-12ea-4b73-9398-ac5b5e009726 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a" status: 200 len: 1410 microversion: 2.1 time: 0.067215 Oct 29 03:01:22.826515 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1714/3251] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:01:22 2022] GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a => generated 1410 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:22.842298 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e5638ebb-cf3d-4cdc-b28f-a9875a148e4e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:22.843443 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e5638ebb-cf3d-4cdc-b28f-a9875a148e4e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:22.850034 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:22.860815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e5638ebb-cf3d-4cdc-b28f-a9875a148e4e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:22.863653 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e5638ebb-cf3d-4cdc-b28f-a9875a148e4e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:22.864373 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e5638ebb-cf3d-4cdc-b28f-a9875a148e4e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:22.868999 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e5638ebb-cf3d-4cdc-b28f-a9875a148e4e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:22.869726 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e5638ebb-cf3d-4cdc-b28f-a9875a148e4e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:22.870330 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e5638ebb-cf3d-4cdc-b28f-a9875a148e4e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:22.914639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3fc9e934-9ec8-4388-999f-2085244819ce tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b1564244d54ed9acc97a4924ecb4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c460e416a634939a16f63d0c4c01a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:22.927294 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3fc9e934-9ec8-4388-999f-2085244819ce tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b" status: 200 len: 1209 microversion: 2.1 time: 0.459614 Oct 29 03:01:22.929696 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1538/3252] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:22 2022] GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b => generated 1209 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:22.934830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d1c2778d-b8b3-4499-9430-b75e82d6e2c1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:22.940155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d1c2778d-b8b3-4499-9430-b75e82d6e2c1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 96a9fe4a-52f5-4b1f-955e-f991357b1813] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:22.951410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=91,nova_api:DELETE=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:22.959608 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1c2778d-b8b3-4499-9430-b75e82d6e2c1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:22.965426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1c2778d-b8b3-4499-9430-b75e82d6e2c1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:22.966223 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1c2778d-b8b3-4499-9430-b75e82d6e2c1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:22.967896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1c2778d-b8b3-4499-9430-b75e82d6e2c1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:22.968787 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1c2778d-b8b3-4499-9430-b75e82d6e2c1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:22.969577 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1c2778d-b8b3-4499-9430-b75e82d6e2c1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:23.031292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:23.063994 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d1c2778d-b8b3-4499-9430-b75e82d6e2c1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 96a9fe4a-52f5-4b1f-955e-f991357b1813] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:01:23.282145 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d1c2778d-b8b3-4499-9430-b75e82d6e2c1 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "DELETE /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813" status: 204 len: 0 microversion: 2.1 time: 0.346679 Oct 29 03:01:23.286177 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1539/3253] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:01:22 2022] DELETE /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:01:23.306355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1b633fa7-4825-4db4-a2c5-67eeef43e718 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:23.312419 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1b633fa7-4825-4db4-a2c5-67eeef43e718 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:23.341527 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b633fa7-4825-4db4-a2c5-67eeef43e718 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:23.345071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b633fa7-4825-4db4-a2c5-67eeef43e718 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:23.345525 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b633fa7-4825-4db4-a2c5-67eeef43e718 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:23.346307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b633fa7-4825-4db4-a2c5-67eeef43e718 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:23.346827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b633fa7-4825-4db4-a2c5-67eeef43e718 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:23.347255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b633fa7-4825-4db4-a2c5-67eeef43e718 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:23.383015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e5638ebb-cf3d-4cdc-b28f-a9875a148e4e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:23.399575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e5638ebb-cf3d-4cdc-b28f-a9875a148e4e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:23.401568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e5638ebb-cf3d-4cdc-b28f-a9875a148e4e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:23.402994 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e5638ebb-cf3d-4cdc-b28f-a9875a148e4e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1879 microversion: 2.32 time: 0.575197 Oct 29 03:01:23.404000 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1715/3254] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:22 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1879 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:23.410513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2f06b84b-61ad-4acc-83c4-9c0d1f9e8873 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:23.410929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2f06b84b-61ad-4acc-83c4-9c0d1f9e8873 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 96a9fe4a-52f5-4b1f-955e-f991357b1813] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:23.418253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f06b84b-61ad-4acc-83c4-9c0d1f9e8873 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:23.419429 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f06b84b-61ad-4acc-83c4-9c0d1f9e8873 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:23.420107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f06b84b-61ad-4acc-83c4-9c0d1f9e8873 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:23.421615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f06b84b-61ad-4acc-83c4-9c0d1f9e8873 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:23.422328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f06b84b-61ad-4acc-83c4-9c0d1f9e8873 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:23.422996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f06b84b-61ad-4acc-83c4-9c0d1f9e8873 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:23.738586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2f06b84b-61ad-4acc-83c4-9c0d1f9e8873 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:23.750227 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2f06b84b-61ad-4acc-83c4-9c0d1f9e8873 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813" status: 200 len: 1518 microversion: 2.1 time: 0.342729 Oct 29 03:01:23.753044 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1716/3255] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:23 2022] GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813 => generated 1518 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:23.754256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1b633fa7-4825-4db4-a2c5-67eeef43e718 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:23.762907 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8b741741-52ac-4a30-a00c-3637895abeb0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:23.768301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8b741741-52ac-4a30-a00c-3637895abeb0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:23.769571 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1b633fa7-4825-4db4-a2c5-67eeef43e718 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1512 microversion: 2.1 time: 0.481671 Oct 29 03:01:23.770456 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1540/3256] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:23 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1512 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:23.789725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b741741-52ac-4a30-a00c-3637895abeb0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:23.790985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b741741-52ac-4a30-a00c-3637895abeb0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:23.791687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b741741-52ac-4a30-a00c-3637895abeb0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:23.793007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b741741-52ac-4a30-a00c-3637895abeb0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:23.793632 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b741741-52ac-4a30-a00c-3637895abeb0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:23.795030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b741741-52ac-4a30-a00c-3637895abeb0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:23.843160 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bff3a6c2-c1fe-4c92-b4f4-f9ff2c5d3b86 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff05c1a4d30>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:23.937168 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bff3a6c2-c1fe-4c92-b4f4-f9ff2c5d3b86 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a" status: 200 len: 1410 microversion: 2.1 time: 0.099230 Oct 29 03:01:23.944000 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1541/3257] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:01:23 2022] GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a => generated 1410 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:01:23.958503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4300aba2-1615-4b64-a9ae-3c0bc9dc6e6e tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:23.959416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4300aba2-1615-4b64-a9ae-3c0bc9dc6e6e tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] [instance: 92925276-7e25-4969-b5f8-c1d4acbb346b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:23.966992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4300aba2-1615-4b64-a9ae-3c0bc9dc6e6e tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:23.967877 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4300aba2-1615-4b64-a9ae-3c0bc9dc6e6e tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:23.968641 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4300aba2-1615-4b64-a9ae-3c0bc9dc6e6e tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:23.969657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4300aba2-1615-4b64-a9ae-3c0bc9dc6e6e tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:23.970528 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4300aba2-1615-4b64-a9ae-3c0bc9dc6e6e tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:23.971875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4300aba2-1615-4b64-a9ae-3c0bc9dc6e6e tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:24.097753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4300aba2-1615-4b64-a9ae-3c0bc9dc6e6e tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b1564244d54ed9acc97a4924ecb4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c460e416a634939a16f63d0c4c01a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:24.113265 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8b741741-52ac-4a30-a00c-3637895abeb0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:24.115682 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4300aba2-1615-4b64-a9ae-3c0bc9dc6e6e tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b" status: 200 len: 1265 microversion: 2.1 time: 0.162624 Oct 29 03:01:24.117317 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1542/3258] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:23 2022] GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:01:24.122459 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-68f9e6b2-3d38-4a82-a3df-dcfbd535ef5e req-c85fa630-60e1-46cf-9d94-ebc092086165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c72534eb-1844-4208-b625-ea8b5ece8108", "name": "network-vif-plugged", "status": "completed", "tag": "3febcbca-e08c-4130-ae81-3ac6a9c05e2b"}, {"server_uuid": "28d33b72-926b-49d9-8807-1d2be68c487f", "name": "network-vif-plugged", "status": "completed", "tag": "5a2e20a8-d25a-49ae-9802-e29f037f1ef2"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:24.125874 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8b741741-52ac-4a30-a00c-3637895abeb0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1392 microversion: 2.1 time: 0.369620 Oct 29 03:01:24.126961 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1717/3259] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:23 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1392 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:24.142582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-68f9e6b2-3d38-4a82-a3df-dcfbd535ef5e req-c85fa630-60e1-46cf-9d94-ebc092086165 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:24.143795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-68f9e6b2-3d38-4a82-a3df-dcfbd535ef5e req-c85fa630-60e1-46cf-9d94-ebc092086165 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:24.144238 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-68f9e6b2-3d38-4a82-a3df-dcfbd535ef5e req-c85fa630-60e1-46cf-9d94-ebc092086165 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:24.162313 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-68f9e6b2-3d38-4a82-a3df-dcfbd535ef5e req-c85fa630-60e1-46cf-9d94-ebc092086165 service nova] Creating event network-vif-plugged:3febcbca-e08c-4130-ae81-3ac6a9c05e2b for instance c72534eb-1844-4208-b625-ea8b5ece8108 on n-h1-862967-2 Oct 29 03:01:24.163197 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-68f9e6b2-3d38-4a82-a3df-dcfbd535ef5e req-c85fa630-60e1-46cf-9d94-ebc092086165 service nova] Creating event network-vif-plugged:5a2e20a8-d25a-49ae-9802-e29f037f1ef2 for instance 28d33b72-926b-49d9-8807-1d2be68c487f on n-h2-862967-2 Oct 29 03:01:24.174316 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-68f9e6b2-3d38-4a82-a3df-dcfbd535ef5e req-c85fa630-60e1-46cf-9d94-ebc092086165 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055562 Oct 29 03:01:24.175327 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1543/3260] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:24.431781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bed5e31b-6183-455b-8024-52f5c1dfdcad tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:24.433154 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bed5e31b-6183-455b-8024-52f5c1dfdcad tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:24.443420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bed5e31b-6183-455b-8024-52f5c1dfdcad tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:24.444615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bed5e31b-6183-455b-8024-52f5c1dfdcad tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:24.445486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bed5e31b-6183-455b-8024-52f5c1dfdcad tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:24.446472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bed5e31b-6183-455b-8024-52f5c1dfdcad tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:24.447218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bed5e31b-6183-455b-8024-52f5c1dfdcad tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:24.447910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bed5e31b-6183-455b-8024-52f5c1dfdcad tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:24.504089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=100 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:24.843289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cadbee0b-4790-40dd-a793-e0420cfc834c tempest-VolumesNegativeTest-21111073 tempest-VolumesNegativeTest-21111073-project] Action: 'create', calling method: .version_select at 0x7ff053a48a60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1576325769", "metadata": {"Type": "work"}}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cadbee0b-4790-40dd-a793-e0420cfc834c tempest-VolumesNegativeTest-21111073 tempest-VolumesNegativeTest-21111073-project] Request method failure captured: Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 122 Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJeE0Wbn40El0UX-rkNHIcYpMm6dzdP5FqS4SQa6K0FGOI8A94ZuSSNP4_hRkU_9vXStF6R0UoUlj-BzRixs9NboVfNntMzwf5WCDovnkwedmLfD6VYXOUOanYquvxZalOEUEtcrNt6gzsYA5J5AxPfUVmK4ZxggtA9awT3_qa0Zg6s Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 087991ef76fb450fa35022235b7c7a04 Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-VolumesNegativeTest-21111073 Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/087991ef76fb450fa35022235b7c7a04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/087991ef76fb450fa35022235b7c7a04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_087991ef76fb450fa35022235b7c7a04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/087991ef76fb450fa35022235b7c7a04"}]}] Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-VolumesNegativeTest-21111073 Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 087991ef76fb450fa35022235b7c7a04 Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-VolumesNegativeTest-21111073 Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-VolumesNegativeTest-21111073-project Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 49af4c9b65cf4ccf82202c8ae2b2b129 Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-VolumesNegativeTest-21111073-project Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1576325769", "metadata": {"Type": "work"}}} Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1576325769', 'metadata': {'Type': 'work'}}}} Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi '#$%' Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:01:24.860996 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:01:24.867328 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 29 03:01:24.867328 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:24.867328 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:24.867328 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:24.867328 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:24.867328 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:24.867328 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:24.867328 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:01:24.867328 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:01:24.867328 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 29 03:01:24.867328 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:24.867328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cadbee0b-4790-40dd-a793-e0420cfc834c tempest-VolumesNegativeTest-21111073 tempest-VolumesNegativeTest-21111073-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:01:24.867328 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cadbee0b-4790-40dd-a793-e0420cfc834c tempest-VolumesNegativeTest-21111073 tempest-VolumesNegativeTest-21111073-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.324013 Oct 29 03:01:24.867328 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1544/3261] 10.222.0.46 () {60 vars in 1156 bytes} [Sat Oct 29 03:01:24 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 325 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:01:24.878040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3b9d2953-2360-4e79-8eea-e237d10c85bd tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:24.878832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3b9d2953-2360-4e79-8eea-e237d10c85bd tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 96a9fe4a-52f5-4b1f-955e-f991357b1813] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:24.897569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b9d2953-2360-4e79-8eea-e237d10c85bd tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:24.898101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b9d2953-2360-4e79-8eea-e237d10c85bd tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:24.898544 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b9d2953-2360-4e79-8eea-e237d10c85bd tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:24.899495 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b9d2953-2360-4e79-8eea-e237d10c85bd tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:24.899902 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b9d2953-2360-4e79-8eea-e237d10c85bd tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:24.900322 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b9d2953-2360-4e79-8eea-e237d10c85bd tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:25.094307 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bed5e31b-6183-455b-8024-52f5c1dfdcad tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:25.113283 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bed5e31b-6183-455b-8024-52f5c1dfdcad tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:25.114541 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bed5e31b-6183-455b-8024-52f5c1dfdcad tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:25.115882 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bed5e31b-6183-455b-8024-52f5c1dfdcad tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1879 microversion: 2.32 time: 0.688638 Oct 29 03:01:25.116456 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1718/3262] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:24 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1879 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:25.127513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-40777bd6-2edd-430a-ab15-774584f57818 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:25.128191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-40777bd6-2edd-430a-ab15-774584f57818 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:25.140508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40777bd6-2edd-430a-ab15-774584f57818 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:25.146503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40777bd6-2edd-430a-ab15-774584f57818 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:25.146952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40777bd6-2edd-430a-ab15-774584f57818 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:25.148189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40777bd6-2edd-430a-ab15-774584f57818 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:25.148839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40777bd6-2edd-430a-ab15-774584f57818 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:25.149422 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40777bd6-2edd-430a-ab15-774584f57818 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:25.424413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-40777bd6-2edd-430a-ab15-774584f57818 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:25.433991 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-40777bd6-2edd-430a-ab15-774584f57818 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1512 microversion: 2.1 time: 0.315919 Oct 29 03:01:25.435862 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1719/3263] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:25 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1512 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:25.441064 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-635d2450-4ce5-4cb0-a945-4fa5a2bd73e7 tempest-VolumesNegativeTest-21111073 tempest-VolumesNegativeTest-21111073-project] Action: 'create', calling method: .version_select at 0x7ff0533ee5e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1917687627", "metadata": {"Type": "work"}}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-635d2450-4ce5-4cb0-a945-4fa5a2bd73e7 tempest-VolumesNegativeTest-21111073 tempest-VolumesNegativeTest-21111073-project] Request method failure captured: Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 120 Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJeE0Wbn40El0UX-rkNHIcYpMm6dzdP5FqS4SQa6K0FGOI8A94ZuSSNP4_hRkU_9vXStF6R0UoUlj-BzRixs9NboVfNntMzwf5WCDovnkwedmLfD6VYXOUOanYquvxZalOEUEtcrNt6gzsYA5J5AxPfUVmK4ZxggtA9awT3_qa0Zg6s Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 087991ef76fb450fa35022235b7c7a04 Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-VolumesNegativeTest-21111073 Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/087991ef76fb450fa35022235b7c7a04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/087991ef76fb450fa35022235b7c7a04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_087991ef76fb450fa35022235b7c7a04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/087991ef76fb450fa35022235b7c7a04"}]}] Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-VolumesNegativeTest-21111073 Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 087991ef76fb450fa35022235b7c7a04 Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-VolumesNegativeTest-21111073 Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-VolumesNegativeTest-21111073-project Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 49af4c9b65cf4ccf82202c8ae2b2b129 Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-VolumesNegativeTest-21111073-project Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1917687627", "metadata": {"Type": "work"}}} Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1917687627', 'metadata': {'Type': 'work'}}}} Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi '0' Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:01:25.446148 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:01:25.450801 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 29 03:01:25.450801 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:25.450801 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:25.450801 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:25.450801 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:25.450801 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:25.450801 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:25.450801 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:01:25.450801 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:01:25.450801 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 29 03:01:25.450801 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:25.453746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-635d2450-4ce5-4cb0-a945-4fa5a2bd73e7 tempest-VolumesNegativeTest-21111073 tempest-VolumesNegativeTest-21111073-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:01:25.454745 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-635d2450-4ce5-4cb0-a945-4fa5a2bd73e7 tempest-VolumesNegativeTest-21111073 tempest-VolumesNegativeTest-21111073-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017695 Oct 29 03:01:25.459679 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1720/3264] 10.222.0.46 () {60 vars in 1156 bytes} [Sat Oct 29 03:01:25 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:01:25.469612 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cc265259-f474-4d13-add6-31fe45b15c1b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff058015790>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:25.480472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3b9d2953-2360-4e79-8eea-e237d10c85bd tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:25.492926 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3b9d2953-2360-4e79-8eea-e237d10c85bd tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813" status: 200 len: 1518 microversion: 2.1 time: 0.624189 Oct 29 03:01:25.509026 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1545/3265] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:24 2022] GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813 => generated 1518 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:25.518435 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ccf26cd5-465c-4c42-b26f-6663aa7835e7 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:25.519069 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ccf26cd5-465c-4c42-b26f-6663aa7835e7 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] [instance: 92925276-7e25-4969-b5f8-c1d4acbb346b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:25.520217 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cc265259-f474-4d13-add6-31fe45b15c1b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a" status: 200 len: 1410 microversion: 2.1 time: 0.057593 Oct 29 03:01:25.521066 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1721/3266] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:01:25 2022] GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a => generated 1410 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:25.525895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d0a7a8de-aedb-4f9b-881b-1585a93b2ce4 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:25.527393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d0a7a8de-aedb-4f9b-881b-1585a93b2ce4 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:25.534055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0a7a8de-aedb-4f9b-881b-1585a93b2ce4 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:25.534946 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0a7a8de-aedb-4f9b-881b-1585a93b2ce4 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:25.535627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0a7a8de-aedb-4f9b-881b-1585a93b2ce4 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:25.536683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0a7a8de-aedb-4f9b-881b-1585a93b2ce4 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:25.537418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0a7a8de-aedb-4f9b-881b-1585a93b2ce4 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:25.538083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0a7a8de-aedb-4f9b-881b-1585a93b2ce4 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:25.540182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ccf26cd5-465c-4c42-b26f-6663aa7835e7 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:25.542920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ccf26cd5-465c-4c42-b26f-6663aa7835e7 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:25.543473 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ccf26cd5-465c-4c42-b26f-6663aa7835e7 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:25.545584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ccf26cd5-465c-4c42-b26f-6663aa7835e7 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:25.546393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ccf26cd5-465c-4c42-b26f-6663aa7835e7 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:25.549597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ccf26cd5-465c-4c42-b26f-6663aa7835e7 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:25.720672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ccf26cd5-465c-4c42-b26f-6663aa7835e7 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b1564244d54ed9acc97a4924ecb4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c460e416a634939a16f63d0c4c01a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:25.734221 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ccf26cd5-465c-4c42-b26f-6663aa7835e7 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b" status: 200 len: 1271 microversion: 2.1 time: 0.220622 Oct 29 03:01:25.744569 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1546/3267] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:25 2022] GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b => generated 1271 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:25.744569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-edbf26ad-b4c9-4fef-a841-f7a6a1ff238a tempest-VolumesNegativeTest-21111073 tempest-VolumesNegativeTest-21111073-project] Action: 'create', calling method: .version_select at 0x7ff053a48160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-512575216", "metadata": {"Type": "work"}}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-edbf26ad-b4c9-4fef-a841-f7a6a1ff238a tempest-VolumesNegativeTest-21111073 tempest-VolumesNegativeTest-21111073-project] Request method failure captured: Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 118 Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJeE0Wbn40El0UX-rkNHIcYpMm6dzdP5FqS4SQa6K0FGOI8A94ZuSSNP4_hRkU_9vXStF6R0UoUlj-BzRixs9NboVfNntMzwf5WCDovnkwedmLfD6VYXOUOanYquvxZalOEUEtcrNt6gzsYA5J5AxPfUVmK4ZxggtA9awT3_qa0Zg6s Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 087991ef76fb450fa35022235b7c7a04 Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-VolumesNegativeTest-21111073 Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/087991ef76fb450fa35022235b7c7a04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/087991ef76fb450fa35022235b7c7a04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_087991ef76fb450fa35022235b7c7a04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/087991ef76fb450fa35022235b7c7a04"}]}] Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-VolumesNegativeTest-21111073 Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 087991ef76fb450fa35022235b7c7a04 Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-VolumesNegativeTest-21111073 Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-VolumesNegativeTest-21111073-project Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 49af4c9b65cf4ccf82202c8ae2b2b129 Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-VolumesNegativeTest-21111073-project Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-512575216", "metadata": {"Type": "work"}}} Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-512575216', 'metadata': {'Type': 'work'}}}} Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi '' Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:01:25.755051 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:01:25.760068 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 29 03:01:25.760068 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:25.760068 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:25.760068 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:25.760068 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:25.760068 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:25.760068 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:25.760068 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:01:25.760068 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:01:25.760068 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 29 03:01:25.760068 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:25.760068 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-edbf26ad-b4c9-4fef-a841-f7a6a1ff238a tempest-VolumesNegativeTest-21111073 tempest-VolumesNegativeTest-21111073-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:01:25.760068 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-edbf26ad-b4c9-4fef-a841-f7a6a1ff238a tempest-VolumesNegativeTest-21111073 tempest-VolumesNegativeTest-21111073-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.020054 Oct 29 03:01:25.764637 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1547/3268] 10.222.0.46 () {60 vars in 1156 bytes} [Sat Oct 29 03:01:25 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:01:25.776193 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-941fc16d-6807-42ff-8321-b81aad6511b2 tempest-VolumesNegativeTest-21111073 tempest-VolumesNegativeTest-21111073-project] Calling method '.version_select at 0x7ff053ec4820>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:25.852547 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-941fc16d-6807-42ff-8321-b81aad6511b2 tempest-VolumesNegativeTest-21111073 tempest-VolumesNegativeTest-21111073-project] HTTP exception thrown: Volume tempest-invalid-2121704165 could not be found. Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-941fc16d-6807-42ff-8321-b81aad6511b2 tempest-VolumesNegativeTest-21111073 tempest-VolumesNegativeTest-21111073-project] Request method failure captured: Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2121704165 HTTP/1.1 Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJeE0Wbn40El0UX-rkNHIcYpMm6dzdP5FqS4SQa6K0FGOI8A94ZuSSNP4_hRkU_9vXStF6R0UoUlj-BzRixs9NboVfNntMzwf5WCDovnkwedmLfD6VYXOUOanYquvxZalOEUEtcrNt6gzsYA5J5AxPfUVmK4ZxggtA9awT3_qa0Zg6s Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 087991ef76fb450fa35022235b7c7a04 Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-VolumesNegativeTest-21111073 Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/087991ef76fb450fa35022235b7c7a04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/087991ef76fb450fa35022235b7c7a04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_087991ef76fb450fa35022235b7c7a04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/087991ef76fb450fa35022235b7c7a04"}]}] Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-VolumesNegativeTest-21111073 Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 087991ef76fb450fa35022235b7c7a04 Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-VolumesNegativeTest-21111073 Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-VolumesNegativeTest-21111073-project Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 49af4c9b65cf4ccf82202c8ae2b2b129 Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-VolumesNegativeTest-21111073-project Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: exception: Volume tempest-invalid-2121704165 could not be found. Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'tempest-invalid-2121704165'} Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2121704165 could not be found. (HTTP 404) (Request-ID: req-1bbbba79-147a-4a11-8e32-830514e84e24) Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:01:25.875502 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2121704165 could not be found. Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2121704165 could not be found. Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2121704165 could not be found. Oct 29 03:01:25.883131 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:25.890458 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-941fc16d-6807-42ff-8321-b81aad6511b2 tempest-VolumesNegativeTest-21111073 tempest-VolumesNegativeTest-21111073-project] Returning 404 to user: Volume tempest-invalid-2121704165 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:01:25.890706 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-941fc16d-6807-42ff-8321-b81aad6511b2 tempest-VolumesNegativeTest-21111073 tempest-VolumesNegativeTest-21111073-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2121704165" status: 404 len: 99 microversion: 2.1 time: 0.124670 Oct 29 03:01:25.897087 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1548/3269] 10.222.0.46 () {58 vars in 1218 bytes} [Sat Oct 29 03:01:25 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2121704165 => generated 99 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:01:25.903183 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-59e618e6-d670-4944-8717-17aaaf912eb4 tempest-VolumesNegativeTest-21111073 tempest-VolumesNegativeTest-21111073-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004626 Oct 29 03:01:25.905228 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1549/3270] 10.222.0.46 () {58 vars in 1140 bytes} [Sat Oct 29 03:01:25 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 29 03:01:25.920911 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ef9ac9ac-bf5d-4f6d-a446-fb72d6052836 tempest-VolumesNegativeTest-21111073 tempest-VolumesNegativeTest-21111073-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009012 Oct 29 03:01:25.928133 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1550/3271] 10.222.0.46 () {58 vars in 1137 bytes} [Sat Oct 29 03:01:25 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 29 03:01:25.942007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a19ec86b-80ff-424d-a3af-41777d36b719 tempest-VolumesNegativeTest-21111073 tempest-VolumesNegativeTest-21111073-project] Calling method '.version_select at 0x7ff053e8c700>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:25.949062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d0a7a8de-aedb-4f9b-881b-1585a93b2ce4 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:25.963087 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d0a7a8de-aedb-4f9b-881b-1585a93b2ce4 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1392 microversion: 2.1 time: 0.440719 Oct 29 03:01:25.963976 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1722/3272] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:25 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1392 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:26.005759 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-a19ec86b-80ff-424d-a3af-41777d36b719 tempest-VolumesNegativeTest-21111073 tempest-VolumesNegativeTest-21111073-project] HTTP exception thrown: Volume 70b63d69-6e1b-4bc2-9c93-6a36e5b0f159 could not be found. Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a19ec86b-80ff-424d-a3af-41777d36b719 tempest-VolumesNegativeTest-21111073 tempest-VolumesNegativeTest-21111073-project] Request method failure captured: Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/os-volumes/70b63d69-6e1b-4bc2-9c93-6a36e5b0f159 HTTP/1.1 Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJeE0Wbn40El0UX-rkNHIcYpMm6dzdP5FqS4SQa6K0FGOI8A94ZuSSNP4_hRkU_9vXStF6R0UoUlj-BzRixs9NboVfNntMzwf5WCDovnkwedmLfD6VYXOUOanYquvxZalOEUEtcrNt6gzsYA5J5AxPfUVmK4ZxggtA9awT3_qa0Zg6s Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 087991ef76fb450fa35022235b7c7a04 Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-VolumesNegativeTest-21111073 Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/087991ef76fb450fa35022235b7c7a04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/087991ef76fb450fa35022235b7c7a04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_087991ef76fb450fa35022235b7c7a04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/087991ef76fb450fa35022235b7c7a04"}]}] Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-VolumesNegativeTest-21111073 Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 087991ef76fb450fa35022235b7c7a04 Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-VolumesNegativeTest-21111073 Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-VolumesNegativeTest-21111073-project Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 49af4c9b65cf4ccf82202c8ae2b2b129 Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-VolumesNegativeTest-21111073-project Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: exception: Volume 70b63d69-6e1b-4bc2-9c93-6a36e5b0f159 could not be found. Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '70b63d69-6e1b-4bc2-9c93-6a36e5b0f159'} Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 70b63d69-6e1b-4bc2-9c93-6a36e5b0f159 could not be found. (HTTP 404) (Request-ID: req-e623b289-8b9e-402f-83f4-862a0386ba12) Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 03:01:26.008469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 70b63d69-6e1b-4bc2-9c93-6a36e5b0f159 could not be found. Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 70b63d69-6e1b-4bc2-9c93-6a36e5b0f159 could not be found. Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 70b63d69-6e1b-4bc2-9c93-6a36e5b0f159 could not be found. Oct 29 03:01:26.013346 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:26.019199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a19ec86b-80ff-424d-a3af-41777d36b719 tempest-VolumesNegativeTest-21111073 tempest-VolumesNegativeTest-21111073-project] Returning 404 to user: Volume 70b63d69-6e1b-4bc2-9c93-6a36e5b0f159 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:01:26.020775 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a19ec86b-80ff-424d-a3af-41777d36b719 tempest-VolumesNegativeTest-21111073 tempest-VolumesNegativeTest-21111073-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/70b63d69-6e1b-4bc2-9c93-6a36e5b0f159" status: 404 len: 109 microversion: 2.1 time: 0.090983 Oct 29 03:01:26.023387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-b0cbe9e2-fbef-4c3a-9fcd-4173187924bb req-1638136a-2ae7-4416-a61f-cdb9829ac663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96a9fe4a-52f5-4b1f-955e-f991357b1813", "name": "network-vif-deleted", "tag": "76c5f041-ee64-4474-8579-cca40e817df4"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:26.027670 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1551/3273] 10.222.0.46 () {58 vars in 1248 bytes} [Sat Oct 29 03:01:25 2022] DELETE /compute/v2.1/os-volumes/70b63d69-6e1b-4bc2-9c93-6a36e5b0f159 => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:01:26.039231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-61990e99-7360-4518-ab71-3ad0d52eb3bf tempest-VolumesNegativeTest-21111073 tempest-VolumesNegativeTest-21111073-project] Calling method '.version_select at 0x7ff053a91c10>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:26.057510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b0cbe9e2-fbef-4c3a-9fcd-4173187924bb req-1638136a-2ae7-4416-a61f-cdb9829ac663 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:26.057903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b0cbe9e2-fbef-4c3a-9fcd-4173187924bb req-1638136a-2ae7-4416-a61f-cdb9829ac663 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:26.058543 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b0cbe9e2-fbef-4c3a-9fcd-4173187924bb req-1638136a-2ae7-4416-a61f-cdb9829ac663 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:26.081166 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-b0cbe9e2-fbef-4c3a-9fcd-4173187924bb req-1638136a-2ae7-4416-a61f-cdb9829ac663 service nova] Creating event network-vif-deleted:76c5f041-ee64-4474-8579-cca40e817df4 for instance 96a9fe4a-52f5-4b1f-955e-f991357b1813 on n-h1-862967-2 Oct 29 03:01:26.090241 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-b0cbe9e2-fbef-4c3a-9fcd-4173187924bb req-1638136a-2ae7-4416-a61f-cdb9829ac663 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070842 Oct 29 03:01:26.091101 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1723/3274] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:26.098538 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-61990e99-7360-4518-ab71-3ad0d52eb3bf tempest-VolumesNegativeTest-21111073 tempest-VolumesNegativeTest-21111073-project] HTTP exception thrown: Volume 3e858b92-a81c-46eb-b24d-98173f57adf2 could not be found. Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-61990e99-7360-4518-ab71-3ad0d52eb3bf tempest-VolumesNegativeTest-21111073 tempest-VolumesNegativeTest-21111073-project] Request method failure captured: Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/os-volumes/3e858b92-a81c-46eb-b24d-98173f57adf2 HTTP/1.1 Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJeE0Wbn40El0UX-rkNHIcYpMm6dzdP5FqS4SQa6K0FGOI8A94ZuSSNP4_hRkU_9vXStF6R0UoUlj-BzRixs9NboVfNntMzwf5WCDovnkwedmLfD6VYXOUOanYquvxZalOEUEtcrNt6gzsYA5J5AxPfUVmK4ZxggtA9awT3_qa0Zg6s Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 087991ef76fb450fa35022235b7c7a04 Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-VolumesNegativeTest-21111073 Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/087991ef76fb450fa35022235b7c7a04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/087991ef76fb450fa35022235b7c7a04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_087991ef76fb450fa35022235b7c7a04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/087991ef76fb450fa35022235b7c7a04"}]}] Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-VolumesNegativeTest-21111073 Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 087991ef76fb450fa35022235b7c7a04 Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-VolumesNegativeTest-21111073 Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-VolumesNegativeTest-21111073-project Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 49af4c9b65cf4ccf82202c8ae2b2b129 Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-VolumesNegativeTest-21111073-project Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: exception: Volume 3e858b92-a81c-46eb-b24d-98173f57adf2 could not be found. Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '3e858b92-a81c-46eb-b24d-98173f57adf2'} Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3e858b92-a81c-46eb-b24d-98173f57adf2 could not be found. (HTTP 404) (Request-ID: req-10065ee1-d2f4-44ca-bedb-87b0b2aea66a) Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 03:01:26.101439 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3e858b92-a81c-46eb-b24d-98173f57adf2 could not be found. Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3e858b92-a81c-46eb-b24d-98173f57adf2 could not be found. Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3e858b92-a81c-46eb-b24d-98173f57adf2 could not be found. Oct 29 03:01:26.105618 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:26.110271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-61990e99-7360-4518-ab71-3ad0d52eb3bf tempest-VolumesNegativeTest-21111073 tempest-VolumesNegativeTest-21111073-project] Returning 404 to user: Volume 3e858b92-a81c-46eb-b24d-98173f57adf2 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:01:26.111378 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-61990e99-7360-4518-ab71-3ad0d52eb3bf tempest-VolumesNegativeTest-21111073 tempest-VolumesNegativeTest-21111073-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/3e858b92-a81c-46eb-b24d-98173f57adf2" status: 404 len: 109 microversion: 2.1 time: 0.081299 Oct 29 03:01:26.116963 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1552/3275] 10.222.0.46 () {58 vars in 1245 bytes} [Sat Oct 29 03:01:26 2022] GET /compute/v2.1/os-volumes/3e858b92-a81c-46eb-b24d-98173f57adf2 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:01:26.144360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-466bc4ef-8111-498f-82c4-0901de923f31 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:26.145201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-466bc4ef-8111-498f-82c4-0901de923f31 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:26.158599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-466bc4ef-8111-498f-82c4-0901de923f31 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:26.159121 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-466bc4ef-8111-498f-82c4-0901de923f31 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:26.159998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-466bc4ef-8111-498f-82c4-0901de923f31 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:26.163831 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-466bc4ef-8111-498f-82c4-0901de923f31 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:26.164434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-466bc4ef-8111-498f-82c4-0901de923f31 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:26.164926 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-466bc4ef-8111-498f-82c4-0901de923f31 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:26.458265 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ad68d1ae-fe6a-4eba-899c-abddcaa2f44a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:26.458881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ad68d1ae-fe6a-4eba-899c-abddcaa2f44a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:26.472551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad68d1ae-fe6a-4eba-899c-abddcaa2f44a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:26.473056 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad68d1ae-fe6a-4eba-899c-abddcaa2f44a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:26.473567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad68d1ae-fe6a-4eba-899c-abddcaa2f44a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:26.474208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad68d1ae-fe6a-4eba-899c-abddcaa2f44a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:26.474656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad68d1ae-fe6a-4eba-899c-abddcaa2f44a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:26.475075 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad68d1ae-fe6a-4eba-899c-abddcaa2f44a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:26.623466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-466bc4ef-8111-498f-82c4-0901de923f31 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:26.698309 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=16 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:26.705066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-466bc4ef-8111-498f-82c4-0901de923f31 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:26.711080 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-466bc4ef-8111-498f-82c4-0901de923f31 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:26.716995 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-466bc4ef-8111-498f-82c4-0901de923f31 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1879 microversion: 2.32 time: 0.576316 Oct 29 03:01:26.733824 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1724/3276] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:26 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1879 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:26.748401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4b1977ac-0fbe-41ec-85ac-0c33b5b5a093 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:26.750277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4b1977ac-0fbe-41ec-85ac-0c33b5b5a093 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 96a9fe4a-52f5-4b1f-955e-f991357b1813] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:26.777942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b1977ac-0fbe-41ec-85ac-0c33b5b5a093 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:26.778687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b1977ac-0fbe-41ec-85ac-0c33b5b5a093 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:26.779291 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b1977ac-0fbe-41ec-85ac-0c33b5b5a093 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:26.780291 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b1977ac-0fbe-41ec-85ac-0c33b5b5a093 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:26.780982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b1977ac-0fbe-41ec-85ac-0c33b5b5a093 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:26.781679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b1977ac-0fbe-41ec-85ac-0c33b5b5a093 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:26.846863 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b1977ac-0fbe-41ec-85ac-0c33b5b5a093 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:26.848261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b1977ac-0fbe-41ec-85ac-0c33b5b5a093 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:26.849032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b1977ac-0fbe-41ec-85ac-0c33b5b5a093 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:26.849735 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-4b1977ac-0fbe-41ec-85ac-0c33b5b5a093 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lazy-loading 'fault' on Instance uuid 96a9fe4a-52f5-4b1f-955e-f991357b1813 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:01:26.907183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4b1977ac-0fbe-41ec-85ac-0c33b5b5a093 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:26.917306 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4b1977ac-0fbe-41ec-85ac-0c33b5b5a093 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813" status: 200 len: 1310 microversion: 2.1 time: 0.174753 Oct 29 03:01:26.920792 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1725/3277] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:26 2022] GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813 => generated 1310 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:26.939292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-065b959e-15f6-4e78-85b5-01635c6b5f1c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff058043670>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:26.962696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ad68d1ae-fe6a-4eba-899c-abddcaa2f44a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:26.976025 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ad68d1ae-fe6a-4eba-899c-abddcaa2f44a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1512 microversion: 2.1 time: 0.516927 Oct 29 03:01:26.977287 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1553/3278] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:26 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1512 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:01:26.984255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-28198bae-c406-4e75-9a6f-2864f46fc1d8 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:26.987794 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-28198bae-c406-4e75-9a6f-2864f46fc1d8 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] [instance: 92925276-7e25-4969-b5f8-c1d4acbb346b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:27.018280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28198bae-c406-4e75-9a6f-2864f46fc1d8 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:27.021731 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28198bae-c406-4e75-9a6f-2864f46fc1d8 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:27.022392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28198bae-c406-4e75-9a6f-2864f46fc1d8 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:27.025865 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28198bae-c406-4e75-9a6f-2864f46fc1d8 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:27.026981 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28198bae-c406-4e75-9a6f-2864f46fc1d8 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:27.029994 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28198bae-c406-4e75-9a6f-2864f46fc1d8 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:27.087303 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-065b959e-15f6-4e78-85b5-01635c6b5f1c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a" status: 200 len: 1410 microversion: 2.1 time: 0.162565 Oct 29 03:01:27.096043 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1726/3279] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:01:26 2022] GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a => generated 1410 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:27.103158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a97b3016-f318-449e-b5b4-ed0ec3ea77ca tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:27.104021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a97b3016-f318-449e-b5b4-ed0ec3ea77ca tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:27.113550 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a97b3016-f318-449e-b5b4-ed0ec3ea77ca tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:27.114550 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a97b3016-f318-449e-b5b4-ed0ec3ea77ca tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:27.115166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a97b3016-f318-449e-b5b4-ed0ec3ea77ca tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:27.116228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a97b3016-f318-449e-b5b4-ed0ec3ea77ca tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:27.116874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a97b3016-f318-449e-b5b4-ed0ec3ea77ca tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:27.117476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a97b3016-f318-449e-b5b4-ed0ec3ea77ca tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:27.417830 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a97b3016-f318-449e-b5b4-ed0ec3ea77ca tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:27.431321 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a97b3016-f318-449e-b5b4-ed0ec3ea77ca tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1392 microversion: 2.1 time: 0.331734 Oct 29 03:01:27.432588 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1727/3280] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:27 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1392 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:27.589767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-28198bae-c406-4e75-9a6f-2864f46fc1d8 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b1564244d54ed9acc97a4924ecb4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c460e416a634939a16f63d0c4c01a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:27.602725 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-28198bae-c406-4e75-9a6f-2864f46fc1d8 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b" status: 200 len: 1313 microversion: 2.1 time: 0.624147 Oct 29 03:01:27.610034 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1554/3281] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:26 2022] GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b => generated 1313 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:27.752237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bac281b1-0d11-4a94-96f5-a8f3eadbb65a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:27.753024 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bac281b1-0d11-4a94-96f5-a8f3eadbb65a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:27.765114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bac281b1-0d11-4a94-96f5-a8f3eadbb65a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:27.767052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bac281b1-0d11-4a94-96f5-a8f3eadbb65a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:27.767743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bac281b1-0d11-4a94-96f5-a8f3eadbb65a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:27.768773 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bac281b1-0d11-4a94-96f5-a8f3eadbb65a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:27.773738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bac281b1-0d11-4a94-96f5-a8f3eadbb65a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:27.774707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bac281b1-0d11-4a94-96f5-a8f3eadbb65a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:27.945299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3cfd3738-afd0-42de-bdcf-6d88413f0309 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:27.946157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3cfd3738-afd0-42de-bdcf-6d88413f0309 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 96a9fe4a-52f5-4b1f-955e-f991357b1813] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:27.955305 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3cfd3738-afd0-42de-bdcf-6d88413f0309 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:27.955827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3cfd3738-afd0-42de-bdcf-6d88413f0309 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:27.956275 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3cfd3738-afd0-42de-bdcf-6d88413f0309 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:27.957032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3cfd3738-afd0-42de-bdcf-6d88413f0309 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:27.957485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3cfd3738-afd0-42de-bdcf-6d88413f0309 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:27.957908 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3cfd3738-afd0-42de-bdcf-6d88413f0309 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:28.008377 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-3cfd3738-afd0-42de-bdcf-6d88413f0309 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] HTTP exception thrown: Instance 96a9fe4a-52f5-4b1f-955e-f991357b1813 could not be found. Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3cfd3738-afd0-42de-bdcf-6d88413f0309 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Request method failure captured: Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813 HTTP/1.1 Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJciWNn9epMvdwlsb_gQo_J3lx4hm13bpk3OQVWfiPp_aConFkvvR-xcv_ERwkcVMH3KeG3WOzjgCi8Jo34r8qyt8PqOF11a_qLG0gQXCOVz2_8_YRb2vI0K1PGUkcC3hzQpxRFy7J4wlywCsMhrc-Yb0yCG7KuZ_fRlf6AWfeFvCiU Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 875f8af161b647758adaebd94449c8c1 Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ListServerFiltersTestJSON-1683262862 Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/875f8af161b647758adaebd94449c8c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/875f8af161b647758adaebd94449c8c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_875f8af161b647758adaebd94449c8c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/875f8af161b647758adaebd94449c8c1"}]}] Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ListServerFiltersTestJSON-1683262862 Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 875f8af161b647758adaebd94449c8c1 Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1683262862 Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ListServerFiltersTestJSON-1683262862-project Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: faa94d1a6a984ed7b4a150aa9229d033 Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ListServerFiltersTestJSON-1683262862-project Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 96a9fe4a-52f5-4b1f-955e-f991357b1813 could not be found. Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '96a9fe4a-52f5-4b1f-955e-f991357b1813'} Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96a9fe4a-52f5-4b1f-955e-f991357b1813 could not be found. Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96a9fe4a-52f5-4b1f-955e-f991357b1813 could not be found. Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:28.010562 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:28.015454 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:28.015454 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:28.015454 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:28.015454 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:01:28.015454 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:01:28.015454 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96a9fe4a-52f5-4b1f-955e-f991357b1813 could not be found. Oct 29 03:01:28.015454 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:28.015454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3cfd3738-afd0-42de-bdcf-6d88413f0309 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Returning 404 to user: Instance 96a9fe4a-52f5-4b1f-955e-f991357b1813 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:01:28.015454 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3cfd3738-afd0-42de-bdcf-6d88413f0309 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813" status: 404 len: 111 microversion: 2.1 time: 0.071463 Oct 29 03:01:28.015454 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1555/3282] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:27 2022] GET /compute/v2.1/servers/96a9fe4a-52f5-4b1f-955e-f991357b1813 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:01:28.028969 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d9846850-8649-4899-8796-576443715582 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:28.029797 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d9846850-8649-4899-8796-576443715582 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:28.031150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bac281b1-0d11-4a94-96f5-a8f3eadbb65a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:28.040777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d9846850-8649-4899-8796-576443715582 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:28.041370 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d9846850-8649-4899-8796-576443715582 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:28.041849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d9846850-8649-4899-8796-576443715582 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:28.043273 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d9846850-8649-4899-8796-576443715582 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:28.043781 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d9846850-8649-4899-8796-576443715582 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:28.044444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d9846850-8649-4899-8796-576443715582 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:28.046029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bac281b1-0d11-4a94-96f5-a8f3eadbb65a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:28.048158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bac281b1-0d11-4a94-96f5-a8f3eadbb65a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:28.050184 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bac281b1-0d11-4a94-96f5-a8f3eadbb65a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 2831 microversion: 2.32 time: 0.302367 Oct 29 03:01:28.083286 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1728/3283] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:27 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 2831 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:28.098608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ada1c423-3ed5-4cf5-881c-2910e20fd73d tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:28.103074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ada1c423-3ed5-4cf5-881c-2910e20fd73d tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:28.114666 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ada1c423-3ed5-4cf5-881c-2910e20fd73d tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:28.115145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ada1c423-3ed5-4cf5-881c-2910e20fd73d tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:28.115585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ada1c423-3ed5-4cf5-881c-2910e20fd73d tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:28.116370 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ada1c423-3ed5-4cf5-881c-2910e20fd73d tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:28.117013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ada1c423-3ed5-4cf5-881c-2910e20fd73d tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:28.117694 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ada1c423-3ed5-4cf5-881c-2910e20fd73d tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:28.188614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ada1c423-3ed5-4cf5-881c-2910e20fd73d tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:01:28.346933 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ada1c423-3ed5-4cf5-881c-2910e20fd73d tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a" status: 204 len: 0 microversion: 2.1 time: 0.260555 Oct 29 03:01:28.348550 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1729/3284] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:01:28 2022] DELETE /compute/v2.1/servers/4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:01:28.359588 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0b3f1c4e-5dc0-4dbb-af67-34177f7acb5a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:28.360640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0b3f1c4e-5dc0-4dbb-af67-34177f7acb5a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:28.368654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b3f1c4e-5dc0-4dbb-af67-34177f7acb5a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:28.369253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b3f1c4e-5dc0-4dbb-af67-34177f7acb5a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:28.369762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b3f1c4e-5dc0-4dbb-af67-34177f7acb5a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:28.370555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b3f1c4e-5dc0-4dbb-af67-34177f7acb5a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:28.371229 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b3f1c4e-5dc0-4dbb-af67-34177f7acb5a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:28.371715 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b3f1c4e-5dc0-4dbb-af67-34177f7acb5a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:28.511082 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0b3f1c4e-5dc0-4dbb-af67-34177f7acb5a tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.160382 Oct 29 03:01:28.512029 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1730/3285] 10.222.0.46 () {60 vars in 1316 bytes} [Sat Oct 29 03:01:28 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108/os-interface => generated 1831 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:28.517174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0d9abda5-8457-496e-91ae-8c4faab5ef21 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053fc1160>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:28.607480 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0d9abda5-8457-496e-91ae-8c4faab5ef21 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a" status: 200 len: 1410 microversion: 2.1 time: 0.094194 Oct 29 03:01:28.607948 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1731/3286] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:01:28 2022] GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a => generated 1410 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:28.642613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-786b39f9-9dd9-46d3-bd7d-cc5923c67d57 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:28.646086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-786b39f9-9dd9-46d3-bd7d-cc5923c67d57 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:28.671864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-786b39f9-9dd9-46d3-bd7d-cc5923c67d57 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:28.674057 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-786b39f9-9dd9-46d3-bd7d-cc5923c67d57 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:28.675350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-786b39f9-9dd9-46d3-bd7d-cc5923c67d57 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:28.677570 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-786b39f9-9dd9-46d3-bd7d-cc5923c67d57 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:28.679062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-786b39f9-9dd9-46d3-bd7d-cc5923c67d57 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:28.680493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-786b39f9-9dd9-46d3-bd7d-cc5923c67d57 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:28.725425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d9846850-8649-4899-8796-576443715582 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:28.735816 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d9846850-8649-4899-8796-576443715582 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1512 microversion: 2.1 time: 0.717906 Oct 29 03:01:28.737492 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1556/3287] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:28 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1512 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:28.743400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8e205d8e-c3ef-4a67-8b9f-59d1329927c6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:28.744296 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8e205d8e-c3ef-4a67-8b9f-59d1329927c6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:28.751514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8e205d8e-c3ef-4a67-8b9f-59d1329927c6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:28.752164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8e205d8e-c3ef-4a67-8b9f-59d1329927c6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:28.752984 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8e205d8e-c3ef-4a67-8b9f-59d1329927c6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:28.754658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8e205d8e-c3ef-4a67-8b9f-59d1329927c6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:28.755399 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8e205d8e-c3ef-4a67-8b9f-59d1329927c6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:28.756244 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8e205d8e-c3ef-4a67-8b9f-59d1329927c6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:29.068329 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8e205d8e-c3ef-4a67-8b9f-59d1329927c6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:29.084941 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8e205d8e-c3ef-4a67-8b9f-59d1329927c6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1392 microversion: 2.1 time: 0.346103 Oct 29 03:01:29.092311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-786b39f9-9dd9-46d3-bd7d-cc5923c67d57 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:29.108495 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-786b39f9-9dd9-46d3-bd7d-cc5923c67d57 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a" status: 200 len: 1517 microversion: 2.1 time: 0.497668 Oct 29 03:01:29.109909 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1732/3288] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:28 2022] GET /compute/v2.1/servers/4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a => generated 1517 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:29.118252 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1557/3289] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:28 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1392 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:29.125946 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4198813b-b891-483a-b79a-6ace18752ab7 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:29.126573 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4198813b-b891-483a-b79a-6ace18752ab7 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] [instance: 92925276-7e25-4969-b5f8-c1d4acbb346b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:29.142440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4198813b-b891-483a-b79a-6ace18752ab7 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:29.142937 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4198813b-b891-483a-b79a-6ace18752ab7 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:29.143475 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4198813b-b891-483a-b79a-6ace18752ab7 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:29.144190 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4198813b-b891-483a-b79a-6ace18752ab7 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:29.144672 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4198813b-b891-483a-b79a-6ace18752ab7 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:29.152516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4198813b-b891-483a-b79a-6ace18752ab7 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:29.357754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-6b64eae9-0cb4-436e-8d88-92e1cd5627d0 req-30137394-7b1a-4f32-a3cd-0008adfdbf10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92925276-7e25-4969-b5f8-c1d4acbb346b", "tag": "35d7129f-5d14-4fb7-8795-c1602fc1ed16"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:29.371405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6b64eae9-0cb4-436e-8d88-92e1cd5627d0 req-30137394-7b1a-4f32-a3cd-0008adfdbf10 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:29.372351 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6b64eae9-0cb4-436e-8d88-92e1cd5627d0 req-30137394-7b1a-4f32-a3cd-0008adfdbf10 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:29.373109 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6b64eae9-0cb4-436e-8d88-92e1cd5627d0 req-30137394-7b1a-4f32-a3cd-0008adfdbf10 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:29.416370 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-6b64eae9-0cb4-436e-8d88-92e1cd5627d0 req-30137394-7b1a-4f32-a3cd-0008adfdbf10 service nova] Creating event network-changed:35d7129f-5d14-4fb7-8795-c1602fc1ed16 for instance 92925276-7e25-4969-b5f8-c1d4acbb346b on n-h1-862967-2 Oct 29 03:01:29.432643 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-6b64eae9-0cb4-436e-8d88-92e1cd5627d0 req-30137394-7b1a-4f32-a3cd-0008adfdbf10 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074892 Oct 29 03:01:29.436799 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1558/3290] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:29.523024 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4198813b-b891-483a-b79a-6ace18752ab7 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b1564244d54ed9acc97a4924ecb4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c460e416a634939a16f63d0c4c01a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:29.535987 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4198813b-b891-483a-b79a-6ace18752ab7 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b" status: 200 len: 1313 microversion: 2.1 time: 0.423405 Oct 29 03:01:29.538135 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1733/3291] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:29 2022] GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b => generated 1313 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:29.627597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a0a15638-bb6c-429f-a298-9ab62a434fad tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff05878c3a0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:29.730640 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a0a15638-bb6c-429f-a298-9ab62a434fad tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a" status: 200 len: 1410 microversion: 2.1 time: 0.109874 Oct 29 03:01:29.731920 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1559/3292] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:01:29 2022] GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a => generated 1410 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:29.766284 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5895a015-97b3-448a-9c2f-1b29c57bf14e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:29.767681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5895a015-97b3-448a-9c2f-1b29c57bf14e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:29.795562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5895a015-97b3-448a-9c2f-1b29c57bf14e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:29.799185 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5895a015-97b3-448a-9c2f-1b29c57bf14e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:29.799746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5895a015-97b3-448a-9c2f-1b29c57bf14e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:29.800844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5895a015-97b3-448a-9c2f-1b29c57bf14e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:29.801450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5895a015-97b3-448a-9c2f-1b29c57bf14e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:29.805903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5895a015-97b3-448a-9c2f-1b29c57bf14e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:30.114292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cb38ebda-0b5e-418e-af1e-2c91fe832157 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:30.116414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cb38ebda-0b5e-418e-af1e-2c91fe832157 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:30.151068 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb38ebda-0b5e-418e-af1e-2c91fe832157 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:30.153936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb38ebda-0b5e-418e-af1e-2c91fe832157 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:30.156318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb38ebda-0b5e-418e-af1e-2c91fe832157 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:30.158741 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb38ebda-0b5e-418e-af1e-2c91fe832157 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:30.161062 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb38ebda-0b5e-418e-af1e-2c91fe832157 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:30.164282 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb38ebda-0b5e-418e-af1e-2c91fe832157 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:30.277119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=8 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:30.634164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cb38ebda-0b5e-418e-af1e-2c91fe832157 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:30.650724 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cb38ebda-0b5e-418e-af1e-2c91fe832157 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1392 microversion: 2.1 time: 0.542799 Oct 29 03:01:30.672084 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1560/3293] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:30 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1392 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:30.678584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-85285cbf-29c1-4e23-bda5-1bb7a6fecf55 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:30.679825 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-85285cbf-29c1-4e23-bda5-1bb7a6fecf55 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:30.688514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85285cbf-29c1-4e23-bda5-1bb7a6fecf55 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:30.689895 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85285cbf-29c1-4e23-bda5-1bb7a6fecf55 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:30.691059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85285cbf-29c1-4e23-bda5-1bb7a6fecf55 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:30.692259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85285cbf-29c1-4e23-bda5-1bb7a6fecf55 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:30.693136 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85285cbf-29c1-4e23-bda5-1bb7a6fecf55 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:30.693825 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85285cbf-29c1-4e23-bda5-1bb7a6fecf55 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:30.978135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5895a015-97b3-448a-9c2f-1b29c57bf14e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:30.989640 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5895a015-97b3-448a-9c2f-1b29c57bf14e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1512 microversion: 2.1 time: 1.228450 Oct 29 03:01:30.990250 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1734/3294] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:29 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1512 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:31.004723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3d9d6f1a-8e7f-4aa0-a83a-68bccda5fe28 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:31.005883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3d9d6f1a-8e7f-4aa0-a83a-68bccda5fe28 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] [instance: 92925276-7e25-4969-b5f8-c1d4acbb346b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:31.015518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d9d6f1a-8e7f-4aa0-a83a-68bccda5fe28 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:31.020802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d9d6f1a-8e7f-4aa0-a83a-68bccda5fe28 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:31.021575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d9d6f1a-8e7f-4aa0-a83a-68bccda5fe28 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:31.025026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-85285cbf-29c1-4e23-bda5-1bb7a6fecf55 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:31.026058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d9d6f1a-8e7f-4aa0-a83a-68bccda5fe28 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:31.026730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d9d6f1a-8e7f-4aa0-a83a-68bccda5fe28 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:31.027491 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d9d6f1a-8e7f-4aa0-a83a-68bccda5fe28 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:31.051405 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-85285cbf-29c1-4e23-bda5-1bb7a6fecf55 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a" status: 200 len: 1517 microversion: 2.1 time: 0.376827 Oct 29 03:01:31.079794 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1561/3295] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:30 2022] GET /compute/v2.1/servers/4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a => generated 1517 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:31.089614 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6e4eeb4d-cf7e-4d2f-b5bb-586411045a7c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053a9c790>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:31.173659 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6e4eeb4d-cf7e-4d2f-b5bb-586411045a7c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a" status: 200 len: 1410 microversion: 2.1 time: 0.092260 Oct 29 03:01:31.174302 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1562/3296] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:01:31 2022] GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a => generated 1410 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:31.440503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=42 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:31.539269 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3d9d6f1a-8e7f-4aa0-a83a-68bccda5fe28 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b1564244d54ed9acc97a4924ecb4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c460e416a634939a16f63d0c4c01a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:31.557367 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3d9d6f1a-8e7f-4aa0-a83a-68bccda5fe28 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b" status: 200 len: 1313 microversion: 2.1 time: 0.566012 Oct 29 03:01:31.558492 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1735/3297] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:30 2022] GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b => generated 1313 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:31.675460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-062d97cb-d69f-4b94-bddb-2dc4f90c0034 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:31.675998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-062d97cb-d69f-4b94-bddb-2dc4f90c0034 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:31.691922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-062d97cb-d69f-4b94-bddb-2dc4f90c0034 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:31.692424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-062d97cb-d69f-4b94-bddb-2dc4f90c0034 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:31.692893 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-062d97cb-d69f-4b94-bddb-2dc4f90c0034 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:31.693616 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-062d97cb-d69f-4b94-bddb-2dc4f90c0034 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:31.705129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-062d97cb-d69f-4b94-bddb-2dc4f90c0034 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:31.705835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-062d97cb-d69f-4b94-bddb-2dc4f90c0034 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:31.835494 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-caacfffe-33c8-420b-9ea4-8f96bcac72b0 req-3d877687-8124-4c93-96e5-690e08109cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c72534eb-1844-4208-b625-ea8b5ece8108", "tag": "c7d91e7c-5b11-484a-b555-6a407dc903e3"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:31.854671 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-caacfffe-33c8-420b-9ea4-8f96bcac72b0 req-3d877687-8124-4c93-96e5-690e08109cf7 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:31.855439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-caacfffe-33c8-420b-9ea4-8f96bcac72b0 req-3d877687-8124-4c93-96e5-690e08109cf7 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:31.857174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-caacfffe-33c8-420b-9ea4-8f96bcac72b0 req-3d877687-8124-4c93-96e5-690e08109cf7 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:31.886642 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-caacfffe-33c8-420b-9ea4-8f96bcac72b0 req-3d877687-8124-4c93-96e5-690e08109cf7 service nova] Creating event network-changed:c7d91e7c-5b11-484a-b555-6a407dc903e3 for instance c72534eb-1844-4208-b625-ea8b5ece8108 on n-h1-862967-2 Oct 29 03:01:31.903673 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-caacfffe-33c8-420b-9ea4-8f96bcac72b0 req-3d877687-8124-4c93-96e5-690e08109cf7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072780 Oct 29 03:01:31.904881 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1736/3298] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:01:32.019342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ba861b86-b4a2-4d2d-9f71-496d30916d33 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:32.022433 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ba861b86-b4a2-4d2d-9f71-496d30916d33 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:32.036798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba861b86-b4a2-4d2d-9f71-496d30916d33 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:32.056435 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba861b86-b4a2-4d2d-9f71-496d30916d33 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:32.057335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba861b86-b4a2-4d2d-9f71-496d30916d33 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:32.061219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba861b86-b4a2-4d2d-9f71-496d30916d33 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:32.062069 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba861b86-b4a2-4d2d-9f71-496d30916d33 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:32.062936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba861b86-b4a2-4d2d-9f71-496d30916d33 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:32.386301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=14 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:32.441684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ba861b86-b4a2-4d2d-9f71-496d30916d33 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:32.451948 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ba861b86-b4a2-4d2d-9f71-496d30916d33 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1512 microversion: 2.1 time: 0.437237 Oct 29 03:01:32.458558 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1737/3299] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:32 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1512 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:01:32.466874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6d1014b8-cb6a-4e49-961a-3d7f51e90eb4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:32.472924 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6d1014b8-cb6a-4e49-961a-3d7f51e90eb4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:32.497706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d1014b8-cb6a-4e49-961a-3d7f51e90eb4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:32.505830 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d1014b8-cb6a-4e49-961a-3d7f51e90eb4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:32.508539 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d1014b8-cb6a-4e49-961a-3d7f51e90eb4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:32.509586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d1014b8-cb6a-4e49-961a-3d7f51e90eb4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:32.511152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d1014b8-cb6a-4e49-961a-3d7f51e90eb4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:32.511807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d1014b8-cb6a-4e49-961a-3d7f51e90eb4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:32.618939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d1014b8-cb6a-4e49-961a-3d7f51e90eb4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:32.621161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d1014b8-cb6a-4e49-961a-3d7f51e90eb4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:32.628603 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d1014b8-cb6a-4e49-961a-3d7f51e90eb4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:32.629376 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-6d1014b8-cb6a-4e49-961a-3d7f51e90eb4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lazy-loading 'fault' on Instance uuid 4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:01:32.640612 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:32.730493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6d1014b8-cb6a-4e49-961a-3d7f51e90eb4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:32.740872 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6d1014b8-cb6a-4e49-961a-3d7f51e90eb4 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a" status: 200 len: 1310 microversion: 2.1 time: 0.277735 Oct 29 03:01:32.744353 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1738/3300] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:32 2022] GET /compute/v2.1/servers/4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a => generated 1310 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:32.757092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b6c89a33-fd48-470e-bdb5-fce394229fba tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053d455e0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:32.861437 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b6c89a33-fd48-470e-bdb5-fce394229fba tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a" status: 200 len: 1410 microversion: 2.1 time: 0.114297 Oct 29 03:01:32.862429 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1739/3301] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:01:32 2022] GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a => generated 1410 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:32.868930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4ff75dce-2054-4b91-9897-226a15c7230a tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:32.869737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4ff75dce-2054-4b91-9897-226a15c7230a tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] [instance: 92925276-7e25-4969-b5f8-c1d4acbb346b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:32.885312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ff75dce-2054-4b91-9897-226a15c7230a tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:32.886049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ff75dce-2054-4b91-9897-226a15c7230a tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:32.886598 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ff75dce-2054-4b91-9897-226a15c7230a tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:32.887533 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ff75dce-2054-4b91-9897-226a15c7230a tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:32.888244 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ff75dce-2054-4b91-9897-226a15c7230a tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:32.888814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ff75dce-2054-4b91-9897-226a15c7230a tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:32.960701 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-062d97cb-d69f-4b94-bddb-2dc4f90c0034 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:32.975275 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-062d97cb-d69f-4b94-bddb-2dc4f90c0034 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1382 microversion: 2.1 time: 1.303747 Oct 29 03:01:32.988245 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1563/3302] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:31 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1382 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:33.018922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a3aada10-86cc-4b49-96bc-dfe02bcb434d tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Calling method '.version_select at 0x7ff053a9c790>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:33.032846 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3aada10-86cc-4b49-96bc-dfe02bcb434d tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:33.038048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3aada10-86cc-4b49-96bc-dfe02bcb434d tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:33.040586 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3aada10-86cc-4b49-96bc-dfe02bcb434d tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:33.067103 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a3aada10-86cc-4b49-96bc-dfe02bcb434d tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 1550 microversion: 2.1 time: 0.051976 Oct 29 03:01:33.075117 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1564/3303] 10.222.0.46 () {58 vars in 1143 bytes} [Sat Oct 29 03:01:33 2022] GET /compute/v2.1/os-migrations => generated 1550 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:01:33.097473 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f216eeb9-bb89-423e-933b-c17b7927ee8b tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:33.104583 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f216eeb9-bb89-423e-933b-c17b7927ee8b tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:33.129104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f216eeb9-bb89-423e-933b-c17b7927ee8b tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:33.129888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f216eeb9-bb89-423e-933b-c17b7927ee8b tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:33.130499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f216eeb9-bb89-423e-933b-c17b7927ee8b tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:33.131539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f216eeb9-bb89-423e-933b-c17b7927ee8b tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:33.132386 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f216eeb9-bb89-423e-933b-c17b7927ee8b tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:33.133327 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f216eeb9-bb89-423e-933b-c17b7927ee8b tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:33.214493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4ff75dce-2054-4b91-9897-226a15c7230a tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b1564244d54ed9acc97a4924ecb4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c460e416a634939a16f63d0c4c01a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:33.225007 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4ff75dce-2054-4b91-9897-226a15c7230a tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b" status: 200 len: 1313 microversion: 2.1 time: 0.361100 Oct 29 03:01:33.225614 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1740/3304] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:32 2022] GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:33.481620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-deaa8c07-0087-4cf9-8197-f59e8926c78d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:33.482161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-deaa8c07-0087-4cf9-8197-f59e8926c78d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:33.496223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-deaa8c07-0087-4cf9-8197-f59e8926c78d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:33.501553 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-deaa8c07-0087-4cf9-8197-f59e8926c78d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:33.502312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-deaa8c07-0087-4cf9-8197-f59e8926c78d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:33.503275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-deaa8c07-0087-4cf9-8197-f59e8926c78d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:33.504008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-deaa8c07-0087-4cf9-8197-f59e8926c78d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:33.504641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-deaa8c07-0087-4cf9-8197-f59e8926c78d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:33.806349 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f216eeb9-bb89-423e-933b-c17b7927ee8b tempest-LiveMigrationTest-2074028247 tempest-LiveMigrationTest-2074028247-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1533 microversion: 2.1 time: 0.719070 Oct 29 03:01:33.811105 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1565/3305] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:33 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1533 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:01:33.835327 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f87f8328-70cc-4206-951f-d7949dd60326 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:33.841331 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f87f8328-70cc-4206-951f-d7949dd60326 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:33.870129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f87f8328-70cc-4206-951f-d7949dd60326 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:33.875219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f87f8328-70cc-4206-951f-d7949dd60326 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:33.880437 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f87f8328-70cc-4206-951f-d7949dd60326 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:33.882291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f87f8328-70cc-4206-951f-d7949dd60326 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:33.888655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f87f8328-70cc-4206-951f-d7949dd60326 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:33.892413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f87f8328-70cc-4206-951f-d7949dd60326 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:33.966981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-deaa8c07-0087-4cf9-8197-f59e8926c78d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:33.993916 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-deaa8c07-0087-4cf9-8197-f59e8926c78d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1512 microversion: 2.1 time: 0.512540 Oct 29 03:01:33.996551 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1741/3306] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:33 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1512 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:34.046991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e6b0d4d2-ece6-4be4-844b-22291bfc632e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:34.047545 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e6b0d4d2-ece6-4be4-844b-22291bfc632e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:34.058766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f87f8328-70cc-4206-951f-d7949dd60326 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:34.060005 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f87f8328-70cc-4206-951f-d7949dd60326 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:34.061323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f87f8328-70cc-4206-951f-d7949dd60326 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:34.064099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-f87f8328-70cc-4206-951f-d7949dd60326 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lazy-loading 'fault' on Instance uuid 4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:01:34.074145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6b0d4d2-ece6-4be4-844b-22291bfc632e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:34.076866 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6b0d4d2-ece6-4be4-844b-22291bfc632e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:34.079450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6b0d4d2-ece6-4be4-844b-22291bfc632e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:34.083131 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6b0d4d2-ece6-4be4-844b-22291bfc632e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:34.087228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6b0d4d2-ece6-4be4-844b-22291bfc632e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:34.087698 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6b0d4d2-ece6-4be4-844b-22291bfc632e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:34.171145 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e6b0d4d2-ece6-4be4-844b-22291bfc632e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/os-volume_attachments/ccb40ed0-dec7-4c1d-a55f-81974e56352b" status: 200 len: 194 microversion: 2.20 time: 0.171182 Oct 29 03:01:34.172826 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1742/3307] 10.222.0.46 () {60 vars in 1454 bytes} [Sat Oct 29 03:01:33 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/os-volume_attachments/ccb40ed0-dec7-4c1d-a55f-81974e56352b => generated 194 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:01:34.179129 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0983270d-7e5b-429f-819a-e5c4433b8e2a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:34.179675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0983270d-7e5b-429f-819a-e5c4433b8e2a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:34.189675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0983270d-7e5b-429f-819a-e5c4433b8e2a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:34.190740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0983270d-7e5b-429f-819a-e5c4433b8e2a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:34.191487 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0983270d-7e5b-429f-819a-e5c4433b8e2a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:34.193410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0983270d-7e5b-429f-819a-e5c4433b8e2a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:34.194231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0983270d-7e5b-429f-819a-e5c4433b8e2a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:34.194643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0983270d-7e5b-429f-819a-e5c4433b8e2a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:34.282900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0983270d-7e5b-429f-819a-e5c4433b8e2a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:01:34.421756 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f87f8328-70cc-4206-951f-d7949dd60326 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:34.425920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:34.433011 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f87f8328-70cc-4206-951f-d7949dd60326 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a" status: 200 len: 1310 microversion: 2.1 time: 0.613282 Oct 29 03:01:34.437934 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1566/3308] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:33 2022] GET /compute/v2.1/servers/4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a => generated 1310 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:34.460575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c43b17fa-b579-4438-96a4-262fd1ddc033 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053954af0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:34.473437 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0983270d-7e5b-429f-819a-e5c4433b8e2a tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 204 len: 0 microversion: 2.1 time: 0.299363 Oct 29 03:01:34.477469 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1743/3309] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:01:34 2022] DELETE /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:01:34.484855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-f3a132e1-4085-469b-82fe-52f3fc9345ab req-5a0efda2-9881-4a5c-b04d-34e04ecc52ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a", "name": "network-vif-deleted", "tag": "faae8e87-aa37-4d42-93da-4b5b661b44e5"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:34.497604 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f3a132e1-4085-469b-82fe-52f3fc9345ab req-5a0efda2-9881-4a5c-b04d-34e04ecc52ac service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:34.498448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f3a132e1-4085-469b-82fe-52f3fc9345ab req-5a0efda2-9881-4a5c-b04d-34e04ecc52ac service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:34.499083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f3a132e1-4085-469b-82fe-52f3fc9345ab req-5a0efda2-9881-4a5c-b04d-34e04ecc52ac service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:34.517352 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-f3a132e1-4085-469b-82fe-52f3fc9345ab req-5a0efda2-9881-4a5c-b04d-34e04ecc52ac service nova] Creating event network-vif-deleted:faae8e87-aa37-4d42-93da-4b5b661b44e5 for instance 4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a on n-h2-862967-2 Oct 29 03:01:34.524984 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-f3a132e1-4085-469b-82fe-52f3fc9345ab req-5a0efda2-9881-4a5c-b04d-34e04ecc52ac service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048463 Oct 29 03:01:34.530738 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1744/3310] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:34.544921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-faa70477-dcd1-4993-849a-e3429d086dbd tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:34.563873 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c43b17fa-b579-4438-96a4-262fd1ddc033 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a" status: 200 len: 1410 microversion: 2.1 time: 0.118393 Oct 29 03:01:34.564675 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1567/3311] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:01:34 2022] GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a => generated 1410 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:34.565846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-faa70477-dcd1-4993-849a-e3429d086dbd tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] [instance: 92925276-7e25-4969-b5f8-c1d4acbb346b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:34.578076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-12f713c0-fbc2-49e3-8992-2a13ab962ebf tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:34.578575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-12f713c0-fbc2-49e3-8992-2a13ab962ebf tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:34.582609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-faa70477-dcd1-4993-849a-e3429d086dbd tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:34.584962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-faa70477-dcd1-4993-849a-e3429d086dbd tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:34.585612 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-faa70477-dcd1-4993-849a-e3429d086dbd tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:34.587040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-faa70477-dcd1-4993-849a-e3429d086dbd tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:34.588880 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-faa70477-dcd1-4993-849a-e3429d086dbd tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:34.591447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-faa70477-dcd1-4993-849a-e3429d086dbd tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:34.602788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-12f713c0-fbc2-49e3-8992-2a13ab962ebf tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:34.604935 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-12f713c0-fbc2-49e3-8992-2a13ab962ebf tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:34.605274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-12f713c0-fbc2-49e3-8992-2a13ab962ebf tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:34.605996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-12f713c0-fbc2-49e3-8992-2a13ab962ebf tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:34.606443 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-12f713c0-fbc2-49e3-8992-2a13ab962ebf tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:34.610719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-12f713c0-fbc2-49e3-8992-2a13ab962ebf tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:34.791483 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-12f713c0-fbc2-49e3-8992-2a13ab962ebf tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lazy-loading 'services' on Instance uuid 1ab56816-cc78-4e73-918a-4c76895fed6b {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:01:34.870593 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-faa70477-dcd1-4993-849a-e3429d086dbd tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b1564244d54ed9acc97a4924ecb4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c460e416a634939a16f63d0c4c01a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:34.881942 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-faa70477-dcd1-4993-849a-e3429d086dbd tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b" status: 200 len: 1313 microversion: 2.1 time: 0.349170 Oct 29 03:01:34.884852 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1745/3312] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:34 2022] GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:34.905956 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-407b1230-d821-41d8-8635-b5fc153ccc08 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:34.907732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-407b1230-d821-41d8-8635-b5fc153ccc08 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:34.917208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-407b1230-d821-41d8-8635-b5fc153ccc08 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:34.917700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-407b1230-d821-41d8-8635-b5fc153ccc08 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:34.918135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-407b1230-d821-41d8-8635-b5fc153ccc08 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:34.918839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-407b1230-d821-41d8-8635-b5fc153ccc08 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:34.921530 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-407b1230-d821-41d8-8635-b5fc153ccc08 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:34.922180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-407b1230-d821-41d8-8635-b5fc153ccc08 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:34.950620 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-12f713c0-fbc2-49e3-8992-2a13ab962ebf tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/os-volume_attachments/ccb40ed0-dec7-4c1d-a55f-81974e56352b" status: 202 len: 0 microversion: 2.20 time: 0.384430 Oct 29 03:01:34.951241 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1568/3313] 10.222.0.46 () {60 vars in 1457 bytes} [Sat Oct 29 03:01:34 2022] DELETE /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/os-volume_attachments/ccb40ed0-dec7-4c1d-a55f-81974e56352b => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:01:34.973513 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b2ee81da-87bb-492f-ad4f-c51c204396d5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:34.981171 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b2ee81da-87bb-492f-ad4f-c51c204396d5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:35.011168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b2ee81da-87bb-492f-ad4f-c51c204396d5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:35.011675 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b2ee81da-87bb-492f-ad4f-c51c204396d5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:35.012115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b2ee81da-87bb-492f-ad4f-c51c204396d5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:35.012881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b2ee81da-87bb-492f-ad4f-c51c204396d5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:35.013323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b2ee81da-87bb-492f-ad4f-c51c204396d5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:35.013743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b2ee81da-87bb-492f-ad4f-c51c204396d5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:35.141735 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b2ee81da-87bb-492f-ad4f-c51c204396d5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.184452 Oct 29 03:01:35.142852 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1569/3314] 10.222.0.46 () {60 vars in 1343 bytes} [Sat Oct 29 03:01:34 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:01:35.161711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-04c34b93-9501-4067-a47e-aa1203f247a5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:35.163350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-04c34b93-9501-4067-a47e-aa1203f247a5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:35.177535 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04c34b93-9501-4067-a47e-aa1203f247a5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:35.178031 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04c34b93-9501-4067-a47e-aa1203f247a5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:35.178561 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04c34b93-9501-4067-a47e-aa1203f247a5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:35.179281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04c34b93-9501-4067-a47e-aa1203f247a5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:35.180352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04c34b93-9501-4067-a47e-aa1203f247a5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:35.181352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04c34b93-9501-4067-a47e-aa1203f247a5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:35.274584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-407b1230-d821-41d8-8635-b5fc153ccc08 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:35.282948 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-407b1230-d821-41d8-8635-b5fc153ccc08 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1388 microversion: 2.1 time: 0.395275 Oct 29 03:01:35.301515 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1746/3315] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:34 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1388 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:35.459777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-04c34b93-9501-4067-a47e-aa1203f247a5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:35.460476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d5b72107-9080-4137-ba8c-7f9b1a62dbe8 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:35.462041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d5b72107-9080-4137-ba8c-7f9b1a62dbe8 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:35.476390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5b72107-9080-4137-ba8c-7f9b1a62dbe8 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:35.477103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5b72107-9080-4137-ba8c-7f9b1a62dbe8 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:35.477596 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5b72107-9080-4137-ba8c-7f9b1a62dbe8 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:35.479849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5b72107-9080-4137-ba8c-7f9b1a62dbe8 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:35.482041 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-04c34b93-9501-4067-a47e-aa1203f247a5 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1512 microversion: 2.1 time: 0.337729 Oct 29 03:01:35.482996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5b72107-9080-4137-ba8c-7f9b1a62dbe8 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:35.483533 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5b72107-9080-4137-ba8c-7f9b1a62dbe8 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:35.484253 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1570/3316] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:35 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1512 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:35.502278 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-d5b72107-9080-4137-ba8c-7f9b1a62dbe8 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] HTTP exception thrown: Instance 4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a could not be found. Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d5b72107-9080-4137-ba8c-7f9b1a62dbe8 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Request method failure captured: Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a HTTP/1.1 Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJciWNn9epMvdwlsb_gQo_J3lx4hm13bpk3OQVWfiPp_aConFkvvR-xcv_ERwkcVMH3KeG3WOzjgCi8Jo34r8qyt8PqOF11a_qLG0gQXCOVz2_8_YRb2vI0K1PGUkcC3hzQpxRFy7J4wlywCsMhrc-Yb0yCG7KuZ_fRlf6AWfeFvCiU Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 875f8af161b647758adaebd94449c8c1 Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ListServerFiltersTestJSON-1683262862 Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/875f8af161b647758adaebd94449c8c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/875f8af161b647758adaebd94449c8c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_875f8af161b647758adaebd94449c8c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/875f8af161b647758adaebd94449c8c1"}]}] Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ListServerFiltersTestJSON-1683262862 Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 875f8af161b647758adaebd94449c8c1 Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1683262862 Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ListServerFiltersTestJSON-1683262862-project Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: faa94d1a6a984ed7b4a150aa9229d033 Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ListServerFiltersTestJSON-1683262862-project Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a could not be found. Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a'} Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a could not be found. Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a could not be found. Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:35.504505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:35.509930 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:35.509930 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:35.509930 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:35.509930 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:01:35.509930 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:01:35.509930 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a could not be found. Oct 29 03:01:35.509930 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:35.509930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d5b72107-9080-4137-ba8c-7f9b1a62dbe8 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Returning 404 to user: Instance 4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:01:35.511077 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d5b72107-9080-4137-ba8c-7f9b1a62dbe8 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a" status: 404 len: 111 microversion: 2.1 time: 0.055114 Oct 29 03:01:35.511902 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1747/3317] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:35 2022] GET /compute/v2.1/servers/4c58838c-8fec-4b1e-b03a-d7bfb32f6a6a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:01:35.522006 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-06239744-20c7-4a7a-b6fd-15da82b2b416 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:35.522544 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-06239744-20c7-4a7a-b6fd-15da82b2b416 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:35.529664 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06239744-20c7-4a7a-b6fd-15da82b2b416 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:35.530073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06239744-20c7-4a7a-b6fd-15da82b2b416 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:35.530501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06239744-20c7-4a7a-b6fd-15da82b2b416 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:35.531844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06239744-20c7-4a7a-b6fd-15da82b2b416 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:35.532318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06239744-20c7-4a7a-b6fd-15da82b2b416 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:35.532834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06239744-20c7-4a7a-b6fd-15da82b2b416 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:35.581362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-06239744-20c7-4a7a-b6fd-15da82b2b416 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:01:35.599344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-be03c095-7a55-489c-aa6c-6f82b30ffb56 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053472ca0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:35.660590 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-be03c095-7a55-489c-aa6c-6f82b30ffb56 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a" status: 200 len: 1410 microversion: 2.1 time: 0.062314 Oct 29 03:01:35.674303 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1748/3318] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:01:35 2022] GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a => generated 1410 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:35.860422 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-06239744-20c7-4a7a-b6fd-15da82b2b416 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "DELETE /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92" status: 204 len: 0 microversion: 2.1 time: 0.343421 Oct 29 03:01:35.861643 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1571/3319] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:01:35 2022] DELETE /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:01:35.871504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9446f4b8-6233-4a22-ae8f-23656e90b0f7 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:35.872121 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9446f4b8-6233-4a22-ae8f-23656e90b0f7 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:35.884401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9446f4b8-6233-4a22-ae8f-23656e90b0f7 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:35.885161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9446f4b8-6233-4a22-ae8f-23656e90b0f7 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:35.885575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9446f4b8-6233-4a22-ae8f-23656e90b0f7 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:35.886952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9446f4b8-6233-4a22-ae8f-23656e90b0f7 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:35.887527 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9446f4b8-6233-4a22-ae8f-23656e90b0f7 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:35.888713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9446f4b8-6233-4a22-ae8f-23656e90b0f7 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:35.914414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-61a3aef9-ab46-4172-ac74-e845ab8269df tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:35.916001 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-61a3aef9-ab46-4172-ac74-e845ab8269df tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] [instance: 92925276-7e25-4969-b5f8-c1d4acbb346b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:35.929248 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61a3aef9-ab46-4172-ac74-e845ab8269df tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:35.929740 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61a3aef9-ab46-4172-ac74-e845ab8269df tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:35.932891 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61a3aef9-ab46-4172-ac74-e845ab8269df tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:35.935087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61a3aef9-ab46-4172-ac74-e845ab8269df tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:35.936024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61a3aef9-ab46-4172-ac74-e845ab8269df tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:35.939778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61a3aef9-ab46-4172-ac74-e845ab8269df tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:36.115323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9446f4b8-6233-4a22-ae8f-23656e90b0f7 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:36.182307 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9446f4b8-6233-4a22-ae8f-23656e90b0f7 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92" status: 200 len: 1518 microversion: 2.1 time: 0.316210 Oct 29 03:01:36.186523 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1749/3320] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:35 2022] GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 => generated 1518 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:36.208069 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-eb0ba440-df03-4673-9c36-be0be8b12d63 req-5ef4a60f-d2cb-4a9e-9d1e-7dec1a3bb8a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a79a761-e10f-4a8d-8e33-a21c08c81184", "name": "network-vif-deleted", "tag": "bf31d1ed-88f4-45a8-b01b-b6122fb270a1"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:36.217145 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-61a3aef9-ab46-4172-ac74-e845ab8269df tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b1564244d54ed9acc97a4924ecb4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c460e416a634939a16f63d0c4c01a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:36.229093 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-61a3aef9-ab46-4172-ac74-e845ab8269df tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b" status: 200 len: 1313 microversion: 2.1 time: 0.320565 Oct 29 03:01:36.235078 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1572/3321] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:35 2022] GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b => generated 1313 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:36.245577 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ad4a4309-9325-4e64-a381-26ba494cb7b0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:36.246905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-eb0ba440-df03-4673-9c36-be0be8b12d63 req-5ef4a60f-d2cb-4a9e-9d1e-7dec1a3bb8a9 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:36.247828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ad4a4309-9325-4e64-a381-26ba494cb7b0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:36.255841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-eb0ba440-df03-4673-9c36-be0be8b12d63 req-5ef4a60f-d2cb-4a9e-9d1e-7dec1a3bb8a9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:36.256822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-eb0ba440-df03-4673-9c36-be0be8b12d63 req-5ef4a60f-d2cb-4a9e-9d1e-7dec1a3bb8a9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:36.284671 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-eb0ba440-df03-4673-9c36-be0be8b12d63 req-5ef4a60f-d2cb-4a9e-9d1e-7dec1a3bb8a9 service nova] Creating event network-vif-deleted:bf31d1ed-88f4-45a8-b01b-b6122fb270a1 for instance 6a79a761-e10f-4a8d-8e33-a21c08c81184 on n-h2-862967-2 Oct 29 03:01:36.295643 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad4a4309-9325-4e64-a381-26ba494cb7b0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:36.297715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad4a4309-9325-4e64-a381-26ba494cb7b0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:36.298087 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-eb0ba440-df03-4673-9c36-be0be8b12d63 req-5ef4a60f-d2cb-4a9e-9d1e-7dec1a3bb8a9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107599 Oct 29 03:01:36.301191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad4a4309-9325-4e64-a381-26ba494cb7b0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:36.301629 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1750/3322] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:36.305714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad4a4309-9325-4e64-a381-26ba494cb7b0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:36.306526 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad4a4309-9325-4e64-a381-26ba494cb7b0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:36.308556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad4a4309-9325-4e64-a381-26ba494cb7b0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:36.321222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d7c797f1-15aa-4b40-8669-98f0a1a2c3c5 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:36.322601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d7c797f1-15aa-4b40-8669-98f0a1a2c3c5 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:36.339315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7c797f1-15aa-4b40-8669-98f0a1a2c3c5 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:36.340084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7c797f1-15aa-4b40-8669-98f0a1a2c3c5 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:36.341172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7c797f1-15aa-4b40-8669-98f0a1a2c3c5 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:36.343961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7c797f1-15aa-4b40-8669-98f0a1a2c3c5 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:36.345174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7c797f1-15aa-4b40-8669-98f0a1a2c3c5 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:36.346382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7c797f1-15aa-4b40-8669-98f0a1a2c3c5 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:36.437490 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ad4a4309-9325-4e64-a381-26ba494cb7b0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.201174 Oct 29 03:01:36.441333 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1573/3323] 10.222.0.46 () {60 vars in 1343 bytes} [Sat Oct 29 03:01:36 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/os-volume_attachments => generated 197 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:01:36.487741 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-6034961b-c513-48e7-a630-8b1ab3fbd823 req-e807edbc-ee7d-400d-93d1-7f176c29b85c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92925276-7e25-4969-b5f8-c1d4acbb346b", "name": "network-vif-plugged", "status": "completed", "tag": "35d7129f-5d14-4fb7-8795-c1602fc1ed16"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:36.500146 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6034961b-c513-48e7-a630-8b1ab3fbd823 req-e807edbc-ee7d-400d-93d1-7f176c29b85c service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:36.501090 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6034961b-c513-48e7-a630-8b1ab3fbd823 req-e807edbc-ee7d-400d-93d1-7f176c29b85c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:36.501778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6034961b-c513-48e7-a630-8b1ab3fbd823 req-e807edbc-ee7d-400d-93d1-7f176c29b85c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:36.506026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d7c797f1-15aa-4b40-8669-98f0a1a2c3c5 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:36.521062 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d7c797f1-15aa-4b40-8669-98f0a1a2c3c5 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1183 microversion: 2.1 time: 0.214106 Oct 29 03:01:36.526451 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1751/3324] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:36 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:36.542869 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ce85e0be-8890-4eec-8793-06deda1e736a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:36.546024 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ce85e0be-8890-4eec-8793-06deda1e736a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:36.550895 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-6034961b-c513-48e7-a630-8b1ab3fbd823 req-e807edbc-ee7d-400d-93d1-7f176c29b85c service nova] Creating event network-vif-plugged:35d7129f-5d14-4fb7-8795-c1602fc1ed16 for instance 92925276-7e25-4969-b5f8-c1d4acbb346b on n-h1-862967-2 Oct 29 03:01:36.562666 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce85e0be-8890-4eec-8793-06deda1e736a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:36.565019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce85e0be-8890-4eec-8793-06deda1e736a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:36.565761 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-6034961b-c513-48e7-a630-8b1ab3fbd823 req-e807edbc-ee7d-400d-93d1-7f176c29b85c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084373 Oct 29 03:01:36.566402 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce85e0be-8890-4eec-8793-06deda1e736a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:36.567149 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1574/3325] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:01:36.568095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce85e0be-8890-4eec-8793-06deda1e736a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:36.568828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce85e0be-8890-4eec-8793-06deda1e736a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:36.570026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce85e0be-8890-4eec-8793-06deda1e736a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:36.694131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dd4edeae-acaa-4f7a-abca-9fda882ccb1b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053a483a0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:36.778545 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dd4edeae-acaa-4f7a-abca-9fda882ccb1b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a" status: 200 len: 1410 microversion: 2.1 time: 0.093103 Oct 29 03:01:36.779748 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1575/3326] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:01:36 2022] GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a => generated 1410 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:01:36.823278 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ce85e0be-8890-4eec-8793-06deda1e736a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:36.834049 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ce85e0be-8890-4eec-8793-06deda1e736a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1512 microversion: 2.1 time: 0.304902 Oct 29 03:01:36.849083 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1752/3327] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:36 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1512 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:37.210626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7f1a180d-bbfa-4a7a-bf85-76e053f9fdc2 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:37.211444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7f1a180d-bbfa-4a7a-bf85-76e053f9fdc2 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:37.224433 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f1a180d-bbfa-4a7a-bf85-76e053f9fdc2 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:37.225972 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f1a180d-bbfa-4a7a-bf85-76e053f9fdc2 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:37.228148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f1a180d-bbfa-4a7a-bf85-76e053f9fdc2 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:37.229906 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f1a180d-bbfa-4a7a-bf85-76e053f9fdc2 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:37.231646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f1a180d-bbfa-4a7a-bf85-76e053f9fdc2 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:37.234175 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f1a180d-bbfa-4a7a-bf85-76e053f9fdc2 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:37.251572 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a1bfaf5c-b89f-4ce2-9b2f-992250071691 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:37.252231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a1bfaf5c-b89f-4ce2-9b2f-992250071691 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] [instance: 92925276-7e25-4969-b5f8-c1d4acbb346b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:37.268133 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a1bfaf5c-b89f-4ce2-9b2f-992250071691 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:37.270112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a1bfaf5c-b89f-4ce2-9b2f-992250071691 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:37.270966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a1bfaf5c-b89f-4ce2-9b2f-992250071691 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:37.273494 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a1bfaf5c-b89f-4ce2-9b2f-992250071691 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:37.275460 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a1bfaf5c-b89f-4ce2-9b2f-992250071691 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:37.276766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a1bfaf5c-b89f-4ce2-9b2f-992250071691 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:37.519324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a1bfaf5c-b89f-4ce2-9b2f-992250071691 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b1564244d54ed9acc97a4924ecb4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c460e416a634939a16f63d0c4c01a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:37.531999 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a1bfaf5c-b89f-4ce2-9b2f-992250071691 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b" status: 200 len: 1313 microversion: 2.1 time: 0.284083 Oct 29 03:01:37.552132 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1753/3328] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:37 2022] GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:37.561078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-94f70876-cb30-42c9-9f1d-a80a553dfab4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:37.562225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7f1a180d-bbfa-4a7a-bf85-76e053f9fdc2 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:37.565358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-94f70876-cb30-42c9-9f1d-a80a553dfab4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:37.572921 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7f1a180d-bbfa-4a7a-bf85-76e053f9fdc2 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92" status: 200 len: 1518 microversion: 2.1 time: 0.365386 Oct 29 03:01:37.572921 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1576/3329] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:37 2022] GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 => generated 1518 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:37.577640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-94f70876-cb30-42c9-9f1d-a80a553dfab4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:37.578419 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-94f70876-cb30-42c9-9f1d-a80a553dfab4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:37.579033 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-94f70876-cb30-42c9-9f1d-a80a553dfab4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:37.579957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-94f70876-cb30-42c9-9f1d-a80a553dfab4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:37.580687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-94f70876-cb30-42c9-9f1d-a80a553dfab4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:37.581310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-94f70876-cb30-42c9-9f1d-a80a553dfab4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:37.607774 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9b68ac59-14f6-4248-a042-b6d01afcae6b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:37.608391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9b68ac59-14f6-4248-a042-b6d01afcae6b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:37.632212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b68ac59-14f6-4248-a042-b6d01afcae6b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:37.632941 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b68ac59-14f6-4248-a042-b6d01afcae6b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:37.633374 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b68ac59-14f6-4248-a042-b6d01afcae6b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:37.636192 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-94f70876-cb30-42c9-9f1d-a80a553dfab4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080637 Oct 29 03:01:37.637487 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1754/3330] 10.222.0.46 () {60 vars in 1343 bytes} [Sat Oct 29 03:01:37 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:01:37.641521 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b68ac59-14f6-4248-a042-b6d01afcae6b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:37.642041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b68ac59-14f6-4248-a042-b6d01afcae6b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:37.642739 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b68ac59-14f6-4248-a042-b6d01afcae6b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:37.800382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-51805afd-7654-4719-b7c2-79b28081b1c4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff058015d30>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:37.854632 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9b68ac59-14f6-4248-a042-b6d01afcae6b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:37.879400 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9b68ac59-14f6-4248-a042-b6d01afcae6b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1183 microversion: 2.1 time: 0.277488 Oct 29 03:01:37.882503 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1577/3331] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:37 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1183 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:37.903093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c9ff7108-4091-46f3-833d-43eaaddf3d7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:37.903905 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c9ff7108-4091-46f3-833d-43eaaddf3d7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:37.915082 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-51805afd-7654-4719-b7c2-79b28081b1c4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a" status: 200 len: 1410 microversion: 2.1 time: 0.124060 Oct 29 03:01:37.915385 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c9ff7108-4091-46f3-833d-43eaaddf3d7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:37.916047 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c9ff7108-4091-46f3-833d-43eaaddf3d7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:37.918122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c9ff7108-4091-46f3-833d-43eaaddf3d7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:37.919715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c9ff7108-4091-46f3-833d-43eaaddf3d7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:37.920469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c9ff7108-4091-46f3-833d-43eaaddf3d7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:37.921111 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c9ff7108-4091-46f3-833d-43eaaddf3d7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:37.923656 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1755/3332] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:01:37 2022] GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a => generated 1410 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:01:38.223342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c9ff7108-4091-46f3-833d-43eaaddf3d7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:38.235708 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c9ff7108-4091-46f3-833d-43eaaddf3d7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1512 microversion: 2.1 time: 0.345555 Oct 29 03:01:38.239308 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1578/3333] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:37 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1512 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:38.561401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e805ecb7-579c-4e72-bb1b-b63f9b61b730 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:38.563433 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e805ecb7-579c-4e72-bb1b-b63f9b61b730 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] [instance: 92925276-7e25-4969-b5f8-c1d4acbb346b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:38.575055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e805ecb7-579c-4e72-bb1b-b63f9b61b730 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:38.575885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e805ecb7-579c-4e72-bb1b-b63f9b61b730 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:38.576583 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e805ecb7-579c-4e72-bb1b-b63f9b61b730 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:38.577642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e805ecb7-579c-4e72-bb1b-b63f9b61b730 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:38.578550 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e805ecb7-579c-4e72-bb1b-b63f9b61b730 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:38.594424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fefc2822-873b-4d2a-90bb-eae2eeed1456 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:38.594893 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fefc2822-873b-4d2a-90bb-eae2eeed1456 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:38.601221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e805ecb7-579c-4e72-bb1b-b63f9b61b730 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:38.607978 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fefc2822-873b-4d2a-90bb-eae2eeed1456 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:38.615372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fefc2822-873b-4d2a-90bb-eae2eeed1456 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:38.615908 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fefc2822-873b-4d2a-90bb-eae2eeed1456 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:38.616692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fefc2822-873b-4d2a-90bb-eae2eeed1456 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:38.617185 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fefc2822-873b-4d2a-90bb-eae2eeed1456 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:38.619917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fefc2822-873b-4d2a-90bb-eae2eeed1456 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:38.791295 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fefc2822-873b-4d2a-90bb-eae2eeed1456 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:38.801256 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fefc2822-873b-4d2a-90bb-eae2eeed1456 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92" status: 200 len: 1476 microversion: 2.1 time: 0.211265 Oct 29 03:01:38.801848 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1579/3334] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:38 2022] GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 => generated 1476 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:38.807346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6de6b625-3bd4-4f78-8b70-e9680d0d786f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:38.840270 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6de6b625-3bd4-4f78-8b70-e9680d0d786f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:38.861240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6de6b625-3bd4-4f78-8b70-e9680d0d786f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:38.870079 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6de6b625-3bd4-4f78-8b70-e9680d0d786f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:38.888551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6de6b625-3bd4-4f78-8b70-e9680d0d786f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:38.895163 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6de6b625-3bd4-4f78-8b70-e9680d0d786f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:38.896566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6de6b625-3bd4-4f78-8b70-e9680d0d786f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:38.898806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6de6b625-3bd4-4f78-8b70-e9680d0d786f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:38.951051 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e805ecb7-579c-4e72-bb1b-b63f9b61b730 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b1564244d54ed9acc97a4924ecb4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c460e416a634939a16f63d0c4c01a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:38.967383 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e805ecb7-579c-4e72-bb1b-b63f9b61b730 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b" status: 200 len: 1313 microversion: 2.1 time: 0.410096 Oct 29 03:01:38.968712 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1756/3335] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:38 2022] GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b => generated 1313 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:39.003326 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a489ee4b-7748-42ed-a3dc-c2e383021fd3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:39.010433 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a489ee4b-7748-42ed-a3dc-c2e383021fd3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:39.036476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a489ee4b-7748-42ed-a3dc-c2e383021fd3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:39.041190 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a489ee4b-7748-42ed-a3dc-c2e383021fd3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:39.041846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a489ee4b-7748-42ed-a3dc-c2e383021fd3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:39.044022 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6de6b625-3bd4-4f78-8b70-e9680d0d786f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.236784 Oct 29 03:01:39.046014 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a489ee4b-7748-42ed-a3dc-c2e383021fd3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:39.047316 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1580/3336] 10.222.0.46 () {60 vars in 1343 bytes} [Sat Oct 29 03:01:38 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/os-volume_attachments => generated 197 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:01:39.049327 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a489ee4b-7748-42ed-a3dc-c2e383021fd3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:39.050013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a489ee4b-7748-42ed-a3dc-c2e383021fd3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:39.071347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-1e39d5b8-effb-4c8f-bb57-74d661a55e42 req-b989481b-7d6b-4751-8284-94d2e8ef9bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32ae03c4-2aee-40c8-9fc9-215ed9eaaf92", "name": "network-vif-deleted", "tag": "47657226-9a10-4275-8b35-5a770e9075d9"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:39.093163 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-1e39d5b8-effb-4c8f-bb57-74d661a55e42 req-b989481b-7d6b-4751-8284-94d2e8ef9bd9 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:39.094661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-1e39d5b8-effb-4c8f-bb57-74d661a55e42 req-b989481b-7d6b-4751-8284-94d2e8ef9bd9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:39.095399 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-1e39d5b8-effb-4c8f-bb57-74d661a55e42 req-b989481b-7d6b-4751-8284-94d2e8ef9bd9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:39.129557 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-1e39d5b8-effb-4c8f-bb57-74d661a55e42 req-b989481b-7d6b-4751-8284-94d2e8ef9bd9 service nova] Creating event network-vif-deleted:47657226-9a10-4275-8b35-5a770e9075d9 for instance 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 on n-h1-862967-2 Oct 29 03:01:39.141984 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-1e39d5b8-effb-4c8f-bb57-74d661a55e42 req-b989481b-7d6b-4751-8284-94d2e8ef9bd9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085184 Oct 29 03:01:39.147450 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1581/3337] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:39.162038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d168baf4-749f-4b78-9f97-8c310ceca0fb tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053954430>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:39.237162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a489ee4b-7748-42ed-a3dc-c2e383021fd3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:39.260805 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d168baf4-749f-4b78-9f97-8c310ceca0fb tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a" status: 200 len: 1410 microversion: 2.1 time: 0.111164 Oct 29 03:01:39.270387 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1582/3338] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:01:39 2022] GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a => generated 1410 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:39.272892 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a489ee4b-7748-42ed-a3dc-c2e383021fd3 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1183 microversion: 2.1 time: 0.287981 Oct 29 03:01:39.285349 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1757/3339] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:38 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1183 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:39.287568 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f2d504ca-63d4-4bc2-af54-eb42eb8f0538 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:39.293387 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f2d504ca-63d4-4bc2-af54-eb42eb8f0538 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:39.306087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2d504ca-63d4-4bc2-af54-eb42eb8f0538 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:39.307154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2d504ca-63d4-4bc2-af54-eb42eb8f0538 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:39.309248 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2d504ca-63d4-4bc2-af54-eb42eb8f0538 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:39.310372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2d504ca-63d4-4bc2-af54-eb42eb8f0538 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:39.313689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2d504ca-63d4-4bc2-af54-eb42eb8f0538 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:39.314357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2d504ca-63d4-4bc2-af54-eb42eb8f0538 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:39.537906 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f2d504ca-63d4-4bc2-af54-eb42eb8f0538 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:39.550852 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f2d504ca-63d4-4bc2-af54-eb42eb8f0538 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1512 microversion: 2.1 time: 0.278988 Oct 29 03:01:39.552227 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1583/3340] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:39 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1512 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:39.824209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eaedfc27-937e-4a45-b67c-d9fbbd2decaf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:39.827248 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-eaedfc27-937e-4a45-b67c-d9fbbd2decaf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:39.838043 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaedfc27-937e-4a45-b67c-d9fbbd2decaf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:39.839019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaedfc27-937e-4a45-b67c-d9fbbd2decaf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:39.840221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaedfc27-937e-4a45-b67c-d9fbbd2decaf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:39.842889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaedfc27-937e-4a45-b67c-d9fbbd2decaf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:39.843857 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaedfc27-937e-4a45-b67c-d9fbbd2decaf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:39.844626 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaedfc27-937e-4a45-b67c-d9fbbd2decaf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:39.883789 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:39.932662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaedfc27-937e-4a45-b67c-d9fbbd2decaf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:39.934969 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaedfc27-937e-4a45-b67c-d9fbbd2decaf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:39.935579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaedfc27-937e-4a45-b67c-d9fbbd2decaf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:39.936044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-eaedfc27-937e-4a45-b67c-d9fbbd2decaf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lazy-loading 'fault' on Instance uuid 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:01:39.996818 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-df68a6eb-d1d1-4294-a3a9-665f3d962dbf tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:39.997444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-df68a6eb-d1d1-4294-a3a9-665f3d962dbf tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] [instance: 92925276-7e25-4969-b5f8-c1d4acbb346b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:40.016392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df68a6eb-d1d1-4294-a3a9-665f3d962dbf tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:40.018652 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df68a6eb-d1d1-4294-a3a9-665f3d962dbf tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:40.019973 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df68a6eb-d1d1-4294-a3a9-665f3d962dbf tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:40.025510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df68a6eb-d1d1-4294-a3a9-665f3d962dbf tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:40.027023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df68a6eb-d1d1-4294-a3a9-665f3d962dbf tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:40.028249 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df68a6eb-d1d1-4294-a3a9-665f3d962dbf tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:40.076922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-eaedfc27-937e-4a45-b67c-d9fbbd2decaf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa94d1a6a984ed7b4a150aa9229d033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '875f8af161b647758adaebd94449c8c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:40.101026 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eaedfc27-937e-4a45-b67c-d9fbbd2decaf tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92" status: 200 len: 1311 microversion: 2.1 time: 0.281478 Oct 29 03:01:40.102345 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1758/3341] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:39 2022] GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 => generated 1311 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:40.109757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7fe01cad-be55-4ba6-a9d9-3426062a360d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:40.114489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7fe01cad-be55-4ba6-a9d9-3426062a360d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:40.124897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7fe01cad-be55-4ba6-a9d9-3426062a360d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:40.126774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7fe01cad-be55-4ba6-a9d9-3426062a360d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:40.127609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7fe01cad-be55-4ba6-a9d9-3426062a360d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:40.135120 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7fe01cad-be55-4ba6-a9d9-3426062a360d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:40.136712 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7fe01cad-be55-4ba6-a9d9-3426062a360d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:40.137460 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7fe01cad-be55-4ba6-a9d9-3426062a360d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:40.202549 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7fe01cad-be55-4ba6-a9d9-3426062a360d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.097898 Oct 29 03:01:40.204055 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1759/3342] 10.222.0.46 () {60 vars in 1343 bytes} [Sat Oct 29 03:01:40 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:01:40.276752 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-80abdd41-c7a9-47eb-a7c5-d4489859970d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff058015940>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:40.341763 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-80abdd41-c7a9-47eb-a7c5-d4489859970d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a" status: 200 len: 1410 microversion: 2.1 time: 0.068904 Oct 29 03:01:40.342351 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1760/3343] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:01:40 2022] GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a => generated 1410 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:40.357829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f2b7a28e-49df-4404-a87c-280da45202a7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:40.359079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f2b7a28e-49df-4404-a87c-280da45202a7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:40.367718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2b7a28e-49df-4404-a87c-280da45202a7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:40.368539 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2b7a28e-49df-4404-a87c-280da45202a7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:40.369134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2b7a28e-49df-4404-a87c-280da45202a7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:40.370233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2b7a28e-49df-4404-a87c-280da45202a7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:40.371037 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2b7a28e-49df-4404-a87c-280da45202a7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:40.371621 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2b7a28e-49df-4404-a87c-280da45202a7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:40.439044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-df68a6eb-d1d1-4294-a3a9-665f3d962dbf tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b1564244d54ed9acc97a4924ecb4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c460e416a634939a16f63d0c4c01a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:40.455967 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-df68a6eb-d1d1-4294-a3a9-665f3d962dbf tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b" status: 200 len: 1497 microversion: 2.1 time: 0.461586 Oct 29 03:01:40.458764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f2b7a28e-49df-4404-a87c-280da45202a7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:40.460214 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1584/3344] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:39 2022] GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b => generated 1497 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:01:40.485931 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f2b7a28e-49df-4404-a87c-280da45202a7 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1183 microversion: 2.1 time: 0.136296 Oct 29 03:01:40.486571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b7065fe8-fcab-4cfc-a62d-a8a5886898ee tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:40.489400 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1761/3345] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:40 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:40.522212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.compute.server_groups [None req-b7065fe8-fcab-4cfc-a62d-a8a5886898ee tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Querying cell 5270c754-82e2-4d8e-a02e-4533aa854f76(cell1) for 1 instances {{(pid=127125) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 29 03:01:40.529243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7065fe8-fcab-4cfc-a62d-a8a5886898ee tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:40.529608 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7065fe8-fcab-4cfc-a62d-a8a5886898ee tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:40.530310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7065fe8-fcab-4cfc-a62d-a8a5886898ee tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:40.566148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:40.575010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e3ae8767-8b8e-4288-b445-7e532e88bbda tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:40.575913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e3ae8767-8b8e-4288-b445-7e532e88bbda tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:40.583948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e3ae8767-8b8e-4288-b445-7e532e88bbda tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:40.585026 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b7065fe8-fcab-4cfc-a62d-a8a5886898ee tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups/04a00b30-e2f8-4b55-993b-ad65f6001012" status: 200 len: 222 microversion: 2.1 time: 0.104074 Oct 29 03:01:40.592836 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1585/3346] 10.222.0.46 () {58 vars in 1263 bytes} [Sat Oct 29 03:01:40 2022] GET /compute/v2.1/os-server-groups/04a00b30-e2f8-4b55-993b-ad65f6001012 => generated 222 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:01:40.594589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e3ae8767-8b8e-4288-b445-7e532e88bbda tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:40.595328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e3ae8767-8b8e-4288-b445-7e532e88bbda tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:40.596406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e3ae8767-8b8e-4288-b445-7e532e88bbda tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:40.599377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e3ae8767-8b8e-4288-b445-7e532e88bbda tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:40.600009 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e3ae8767-8b8e-4288-b445-7e532e88bbda tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:40.607150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-af5320f8-1cb5-4811-937b-c31710f94eb5 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:40.607994 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-af5320f8-1cb5-4811-937b-c31710f94eb5 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] [instance: 92925276-7e25-4969-b5f8-c1d4acbb346b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:40.624391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af5320f8-1cb5-4811-937b-c31710f94eb5 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:40.625192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af5320f8-1cb5-4811-937b-c31710f94eb5 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:40.625792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af5320f8-1cb5-4811-937b-c31710f94eb5 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:40.626653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af5320f8-1cb5-4811-937b-c31710f94eb5 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:40.627272 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af5320f8-1cb5-4811-937b-c31710f94eb5 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:40.627900 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af5320f8-1cb5-4811-937b-c31710f94eb5 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:40.661324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-af5320f8-1cb5-4811-937b-c31710f94eb5 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] [instance: 92925276-7e25-4969-b5f8-c1d4acbb346b] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:01:40.911824 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-af5320f8-1cb5-4811-937b-c31710f94eb5 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "DELETE /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b" status: 204 len: 0 microversion: 2.1 time: 0.317070 Oct 29 03:01:40.914033 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1586/3347] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:01:40 2022] DELETE /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:01:40.927747 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2423fbf0-9344-475a-9989-f2c3d150885a tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:40.929697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2423fbf0-9344-475a-9989-f2c3d150885a tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] [instance: 92925276-7e25-4969-b5f8-c1d4acbb346b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:40.950397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2423fbf0-9344-475a-9989-f2c3d150885a tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:40.953037 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2423fbf0-9344-475a-9989-f2c3d150885a tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:40.953037 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2423fbf0-9344-475a-9989-f2c3d150885a tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:40.953829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2423fbf0-9344-475a-9989-f2c3d150885a tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:40.954289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2423fbf0-9344-475a-9989-f2c3d150885a tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:40.954703 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2423fbf0-9344-475a-9989-f2c3d150885a tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:40.982259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e3ae8767-8b8e-4288-b445-7e532e88bbda tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:40.996345 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e3ae8767-8b8e-4288-b445-7e532e88bbda tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1512 microversion: 2.1 time: 0.425204 Oct 29 03:01:41.001746 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1762/3348] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:40 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1512 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:01:41.127690 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-299f87b9-7dad-4937-8ef7-6e4f4e2f2942 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:41.128858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-299f87b9-7dad-4937-8ef7-6e4f4e2f2942 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] [instance: 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:41.140629 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-299f87b9-7dad-4937-8ef7-6e4f4e2f2942 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:41.141087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-299f87b9-7dad-4937-8ef7-6e4f4e2f2942 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:41.141525 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-299f87b9-7dad-4937-8ef7-6e4f4e2f2942 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:41.142232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-299f87b9-7dad-4937-8ef7-6e4f4e2f2942 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:41.149978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-299f87b9-7dad-4937-8ef7-6e4f4e2f2942 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:41.150541 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-299f87b9-7dad-4937-8ef7-6e4f4e2f2942 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:41.194257 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-299f87b9-7dad-4937-8ef7-6e4f4e2f2942 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] HTTP exception thrown: Instance 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 could not be found. Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-299f87b9-7dad-4937-8ef7-6e4f4e2f2942 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Request method failure captured: Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 HTTP/1.1 Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJciWNn9epMvdwlsb_gQo_J3lx4hm13bpk3OQVWfiPp_aConFkvvR-xcv_ERwkcVMH3KeG3WOzjgCi8Jo34r8qyt8PqOF11a_qLG0gQXCOVz2_8_YRb2vI0K1PGUkcC3hzQpxRFy7J4wlywCsMhrc-Yb0yCG7KuZ_fRlf6AWfeFvCiU Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 875f8af161b647758adaebd94449c8c1 Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ListServerFiltersTestJSON-1683262862 Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/875f8af161b647758adaebd94449c8c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/875f8af161b647758adaebd94449c8c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_875f8af161b647758adaebd94449c8c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/875f8af161b647758adaebd94449c8c1"}]}] Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ListServerFiltersTestJSON-1683262862 Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 875f8af161b647758adaebd94449c8c1 Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1683262862 Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ListServerFiltersTestJSON-1683262862-project Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: faa94d1a6a984ed7b4a150aa9229d033 Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ListServerFiltersTestJSON-1683262862-project Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 could not be found. Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '32ae03c4-2aee-40c8-9fc9-215ed9eaaf92'} Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 could not be found. Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 could not be found. Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:41.195994 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:41.204814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:41.204814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:41.204814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:41.204814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:01:41.204814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:01:41.204814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 could not be found. Oct 29 03:01:41.204814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:41.204814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-299f87b9-7dad-4937-8ef7-6e4f4e2f2942 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] Returning 404 to user: Instance 32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:01:41.204814 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-299f87b9-7dad-4937-8ef7-6e4f4e2f2942 tempest-ListServerFiltersTestJSON-1683262862 tempest-ListServerFiltersTestJSON-1683262862-project] 10.222.0.46 "GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92" status: 404 len: 111 microversion: 2.1 time: 0.074585 Oct 29 03:01:41.204814 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1763/3349] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:41 2022] GET /compute/v2.1/servers/32ae03c4-2aee-40c8-9fc9-215ed9eaaf92 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:01:41.205793 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2423fbf0-9344-475a-9989-f2c3d150885a tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b1564244d54ed9acc97a4924ecb4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c460e416a634939a16f63d0c4c01a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:41.213506 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2423fbf0-9344-475a-9989-f2c3d150885a tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b" status: 200 len: 1503 microversion: 2.1 time: 0.291687 Oct 29 03:01:41.214445 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1587/3350] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:40 2022] GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b => generated 1503 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:41.216152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1b2952dc-cbfb-4730-af90-4dae0b231a70 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:41.218534 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1b2952dc-cbfb-4730-af90-4dae0b231a70 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:41.220437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:41.242562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b2952dc-cbfb-4730-af90-4dae0b231a70 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:41.242996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b2952dc-cbfb-4730-af90-4dae0b231a70 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:41.243521 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b2952dc-cbfb-4730-af90-4dae0b231a70 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:41.244233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b2952dc-cbfb-4730-af90-4dae0b231a70 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:41.252885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b2952dc-cbfb-4730-af90-4dae0b231a70 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:41.256143 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b2952dc-cbfb-4730-af90-4dae0b231a70 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:41.314986 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1b2952dc-cbfb-4730-af90-4dae0b231a70 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.103168 Oct 29 03:01:41.316966 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1764/3351] 10.222.0.46 () {60 vars in 1343 bytes} [Sat Oct 29 03:01:41 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:01:41.358838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-deed9694-abbb-4991-ab25-293c6496e0f3 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff0538128b0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:41.434017 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-deed9694-abbb-4991-ab25-293c6496e0f3 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a" status: 200 len: 1410 microversion: 2.1 time: 0.079674 Oct 29 03:01:41.443743 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1588/3352] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:01:41 2022] GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a => generated 1410 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:41.519023 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7c139d69-5d69-4e5d-bf26-97cc9884a82f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:41.519637 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7c139d69-5d69-4e5d-bf26-97cc9884a82f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:41.536562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c139d69-5d69-4e5d-bf26-97cc9884a82f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:41.537140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c139d69-5d69-4e5d-bf26-97cc9884a82f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:41.537664 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c139d69-5d69-4e5d-bf26-97cc9884a82f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:41.538387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c139d69-5d69-4e5d-bf26-97cc9884a82f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:41.538841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c139d69-5d69-4e5d-bf26-97cc9884a82f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:41.539264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c139d69-5d69-4e5d-bf26-97cc9884a82f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:41.665190 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7c139d69-5d69-4e5d-bf26-97cc9884a82f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:41.678356 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7c139d69-5d69-4e5d-bf26-97cc9884a82f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1183 microversion: 2.1 time: 0.165241 Oct 29 03:01:41.698240 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1765/3353] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:41 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:42.025704 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a50102a3-f27a-483c-9088-33abd4dc52bb tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:42.027751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a50102a3-f27a-483c-9088-33abd4dc52bb tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:42.043996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a50102a3-f27a-483c-9088-33abd4dc52bb tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:42.044480 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a50102a3-f27a-483c-9088-33abd4dc52bb tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:42.045798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a50102a3-f27a-483c-9088-33abd4dc52bb tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:42.046534 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a50102a3-f27a-483c-9088-33abd4dc52bb tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:42.047000 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a50102a3-f27a-483c-9088-33abd4dc52bb tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:42.050439 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a50102a3-f27a-483c-9088-33abd4dc52bb tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:42.241634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0d0afd65-f1bb-4905-88be-2841c44c0e57 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:42.242244 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0d0afd65-f1bb-4905-88be-2841c44c0e57 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] [instance: 92925276-7e25-4969-b5f8-c1d4acbb346b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:42.255206 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d0afd65-f1bb-4905-88be-2841c44c0e57 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:42.258359 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d0afd65-f1bb-4905-88be-2841c44c0e57 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:42.264093 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d0afd65-f1bb-4905-88be-2841c44c0e57 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:42.265050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d0afd65-f1bb-4905-88be-2841c44c0e57 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:42.265693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d0afd65-f1bb-4905-88be-2841c44c0e57 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:42.266272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d0afd65-f1bb-4905-88be-2841c44c0e57 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:42.401899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a50102a3-f27a-483c-9088-33abd4dc52bb tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:42.413924 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a50102a3-f27a-483c-9088-33abd4dc52bb tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1512 microversion: 2.1 time: 0.393098 Oct 29 03:01:42.416603 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1589/3354] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:42 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1512 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:42.429536 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1ea350b8-d236-43d9-adc3-26142b0f293f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:42.433519 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1ea350b8-d236-43d9-adc3-26142b0f293f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:42.452324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ea350b8-d236-43d9-adc3-26142b0f293f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:42.454441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ea350b8-d236-43d9-adc3-26142b0f293f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:42.459628 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ea350b8-d236-43d9-adc3-26142b0f293f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:42.461003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ea350b8-d236-43d9-adc3-26142b0f293f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:42.461780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ea350b8-d236-43d9-adc3-26142b0f293f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:42.462389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ea350b8-d236-43d9-adc3-26142b0f293f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:42.540736 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1ea350b8-d236-43d9-adc3-26142b0f293f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.119327 Oct 29 03:01:42.547077 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1590/3355] 10.222.0.46 () {60 vars in 1343 bytes} [Sat Oct 29 03:01:42 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:01:42.564926 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-91643a56-f710-40ff-86b7-332bb26a806b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053a22550>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:42.624087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0d0afd65-f1bb-4905-88be-2841c44c0e57 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b1564244d54ed9acc97a4924ecb4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c460e416a634939a16f63d0c4c01a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:42.637667 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0d0afd65-f1bb-4905-88be-2841c44c0e57 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b" status: 200 len: 1503 microversion: 2.1 time: 0.400769 Oct 29 03:01:42.644892 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1766/3356] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:42 2022] GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b => generated 1503 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:42.667620 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-91643a56-f710-40ff-86b7-332bb26a806b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a" status: 200 len: 1410 microversion: 2.1 time: 0.118535 Oct 29 03:01:42.669585 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1591/3357] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:01:42 2022] GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a => generated 1410 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:42.705185 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-71d17609-6762-465f-a3e7-660ff29b16b1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:42.705842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-71d17609-6762-465f-a3e7-660ff29b16b1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:42.716566 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-71d17609-6762-465f-a3e7-660ff29b16b1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:42.719013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-71d17609-6762-465f-a3e7-660ff29b16b1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:42.719539 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-71d17609-6762-465f-a3e7-660ff29b16b1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:42.720269 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-71d17609-6762-465f-a3e7-660ff29b16b1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:42.720797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-71d17609-6762-465f-a3e7-660ff29b16b1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:42.721294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-71d17609-6762-465f-a3e7-660ff29b16b1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:42.889370 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-71d17609-6762-465f-a3e7-660ff29b16b1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:42.901362 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-71d17609-6762-465f-a3e7-660ff29b16b1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1183 microversion: 2.1 time: 0.200641 Oct 29 03:01:42.902432 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1767/3358] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:42 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:01:43.211335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-b025a189-221f-468e-aa02-9f03ec58ad02 req-478137b0-934a-41f2-93d3-4b88f8a41589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92925276-7e25-4969-b5f8-c1d4acbb346b", "name": "network-vif-deleted", "tag": "35d7129f-5d14-4fb7-8795-c1602fc1ed16"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:43.241570 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b025a189-221f-468e-aa02-9f03ec58ad02 req-478137b0-934a-41f2-93d3-4b88f8a41589 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:43.250966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b025a189-221f-468e-aa02-9f03ec58ad02 req-478137b0-934a-41f2-93d3-4b88f8a41589 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:43.251717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b025a189-221f-468e-aa02-9f03ec58ad02 req-478137b0-934a-41f2-93d3-4b88f8a41589 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:43.284981 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-b025a189-221f-468e-aa02-9f03ec58ad02 req-478137b0-934a-41f2-93d3-4b88f8a41589 service nova] Creating event network-vif-deleted:35d7129f-5d14-4fb7-8795-c1602fc1ed16 for instance 92925276-7e25-4969-b5f8-c1d4acbb346b on n-h1-862967-2 Oct 29 03:01:43.292239 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-b025a189-221f-468e-aa02-9f03ec58ad02 req-478137b0-934a-41f2-93d3-4b88f8a41589 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087236 Oct 29 03:01:43.294549 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1592/3359] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:43.440465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-02771a71-5a19-4884-b4ee-a15984e7a964 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:43.441327 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-02771a71-5a19-4884-b4ee-a15984e7a964 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:43.448142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02771a71-5a19-4884-b4ee-a15984e7a964 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:43.448648 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02771a71-5a19-4884-b4ee-a15984e7a964 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:43.449074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02771a71-5a19-4884-b4ee-a15984e7a964 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:43.453448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02771a71-5a19-4884-b4ee-a15984e7a964 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:43.454599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02771a71-5a19-4884-b4ee-a15984e7a964 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:43.455832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02771a71-5a19-4884-b4ee-a15984e7a964 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:43.557071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-01188072-0a4a-43eb-aefa-a80c9a252c23 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:43.560473 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-01188072-0a4a-43eb-aefa-a80c9a252c23 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:43.573369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01188072-0a4a-43eb-aefa-a80c9a252c23 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:43.575113 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01188072-0a4a-43eb-aefa-a80c9a252c23 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:43.577554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01188072-0a4a-43eb-aefa-a80c9a252c23 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:43.579543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01188072-0a4a-43eb-aefa-a80c9a252c23 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:43.581214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01188072-0a4a-43eb-aefa-a80c9a252c23 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:43.584475 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01188072-0a4a-43eb-aefa-a80c9a252c23 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:43.674395 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-01188072-0a4a-43eb-aefa-a80c9a252c23 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.122381 Oct 29 03:01:43.681174 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1593/3360] 10.222.0.46 () {60 vars in 1343 bytes} [Sat Oct 29 03:01:43 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:01:43.686517 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7c6da510-1a86-4b99-9579-27a9013920aa tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:43.687127 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7c6da510-1a86-4b99-9579-27a9013920aa tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] [instance: 92925276-7e25-4969-b5f8-c1d4acbb346b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:43.693306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:43.695067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c6da510-1a86-4b99-9579-27a9013920aa tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:43.695597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c6da510-1a86-4b99-9579-27a9013920aa tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:43.696027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c6da510-1a86-4b99-9579-27a9013920aa tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:43.696954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c6da510-1a86-4b99-9579-27a9013920aa tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:43.697975 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c6da510-1a86-4b99-9579-27a9013920aa tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:43.698612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c6da510-1a86-4b99-9579-27a9013920aa tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:43.753262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-02771a71-5a19-4884-b4ee-a15984e7a964 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:43.760728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c6da510-1a86-4b99-9579-27a9013920aa tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:43.761218 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c6da510-1a86-4b99-9579-27a9013920aa tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:43.761646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c6da510-1a86-4b99-9579-27a9013920aa tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:43.762618 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-7c6da510-1a86-4b99-9579-27a9013920aa tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lazy-loading 'fault' on Instance uuid 92925276-7e25-4969-b5f8-c1d4acbb346b {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:01:43.764234 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-02771a71-5a19-4884-b4ee-a15984e7a964 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1512 microversion: 2.1 time: 0.327908 Oct 29 03:01:43.766949 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1768/3361] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:43 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1512 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:43.774149 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-04a68e4e-6b95-47fa-9afa-25e0a22489e5 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff0580653a0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:43.825574 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-04a68e4e-6b95-47fa-9afa-25e0a22489e5 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a" status: 200 len: 1419 microversion: 2.1 time: 0.057478 Oct 29 03:01:43.826803 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1769/3362] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:01:43 2022] GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a => generated 1419 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:43.841402 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-37022abc-c4de-47ad-90a8-349dd266d79b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053e5d790>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:43.880633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7c6da510-1a86-4b99-9579-27a9013920aa tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b1564244d54ed9acc97a4924ecb4cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c460e416a634939a16f63d0c4c01a68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:43.897732 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7c6da510-1a86-4b99-9579-27a9013920aa tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b" status: 200 len: 1303 microversion: 2.1 time: 0.212349 Oct 29 03:01:43.902075 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1594/3363] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:43 2022] GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b => generated 1303 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:43.918613 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-37022abc-c4de-47ad-90a8-349dd266d79b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a" status: 200 len: 1419 microversion: 2.1 time: 0.081465 Oct 29 03:01:43.919420 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1770/3364] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:01:43 2022] GET /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a => generated 1419 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:43.933282 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5dd1b310-ec29-4aa7-b728-771f44b5ccaa tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:43.933892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5dd1b310-ec29-4aa7-b728-771f44b5ccaa tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:43.943686 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5dd1b310-ec29-4aa7-b728-771f44b5ccaa tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:43.944456 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5dd1b310-ec29-4aa7-b728-771f44b5ccaa tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:43.945098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5dd1b310-ec29-4aa7-b728-771f44b5ccaa tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:43.946418 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5dd1b310-ec29-4aa7-b728-771f44b5ccaa tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:43.947134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5dd1b310-ec29-4aa7-b728-771f44b5ccaa tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:43.947752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5dd1b310-ec29-4aa7-b728-771f44b5ccaa tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:44.097808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5dd1b310-ec29-4aa7-b728-771f44b5ccaa tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:44.109150 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5dd1b310-ec29-4aa7-b728-771f44b5ccaa tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1183 microversion: 2.1 time: 0.181573 Oct 29 03:01:44.110211 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1595/3365] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:43 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:44.325756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3541b5d1-ca79-4109-aea4-44c7e80c1883 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-6703053", "imageRef": "bbd74575-2018-41ff-af14-0acb9cb1727a", "flavorRef": "452", "networks": [{"uuid": "18fc4cb9-056a-42e1-bd8a-e4a27cb291b2"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:44.386006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-3541b5d1-ca79-4109-aea4-44c7e80c1883 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] validate_networks() for [('18fc4cb9-056a-42e1-bd8a-e4a27cb291b2', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:01:44.690496 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0a90d08f-c59e-4d9d-bd7b-beec8638a774 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:44.692927 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0a90d08f-c59e-4d9d-bd7b-beec8638a774 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:44.702951 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a90d08f-c59e-4d9d-bd7b-beec8638a774 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:44.705048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a90d08f-c59e-4d9d-bd7b-beec8638a774 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:44.710503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a90d08f-c59e-4d9d-bd7b-beec8638a774 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:44.711547 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a90d08f-c59e-4d9d-bd7b-beec8638a774 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:44.712726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a90d08f-c59e-4d9d-bd7b-beec8638a774 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:44.714381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a90d08f-c59e-4d9d-bd7b-beec8638a774 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:44.760012 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0a90d08f-c59e-4d9d-bd7b-beec8638a774 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.074141 Oct 29 03:01:44.761245 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1596/3366] 10.222.0.46 () {60 vars in 1343 bytes} [Sat Oct 29 03:01:44 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:44.791034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-15a5067e-4004-410a-a180-5df29f413d7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:44.791743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-15a5067e-4004-410a-a180-5df29f413d7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:44.801175 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-15a5067e-4004-410a-a180-5df29f413d7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:44.803916 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-15a5067e-4004-410a-a180-5df29f413d7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:44.804376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-15a5067e-4004-410a-a180-5df29f413d7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:44.805136 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-15a5067e-4004-410a-a180-5df29f413d7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:44.805602 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-15a5067e-4004-410a-a180-5df29f413d7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:44.806030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-15a5067e-4004-410a-a180-5df29f413d7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:44.861635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-3541b5d1-ca79-4109-aea4-44c7e80c1883 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:01:44.862689 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-3541b5d1-ca79-4109-aea4-44c7e80c1883 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:01:44.863380 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-3541b5d1-ca79-4109-aea4-44c7e80c1883 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:01:44.863971 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-3541b5d1-ca79-4109-aea4-44c7e80c1883 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:01:44.864770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-3541b5d1-ca79-4109-aea4-44c7e80c1883 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:01:44.892732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3541b5d1-ca79-4109-aea4-44c7e80c1883 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:44.894049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3541b5d1-ca79-4109-aea4-44c7e80c1883 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:44.896333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3541b5d1-ca79-4109-aea4-44c7e80c1883 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:44.897502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3541b5d1-ca79-4109-aea4-44c7e80c1883 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:44.898264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3541b5d1-ca79-4109-aea4-44c7e80c1883 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:44.901267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3541b5d1-ca79-4109-aea4-44c7e80c1883 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:44.948150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-3541b5d1-ca79-4109-aea4-44c7e80c1883 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Getting quotas for project 185d32c10dd845768f4ff70a85680358. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:01:44.956108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-3541b5d1-ca79-4109-aea4-44c7e80c1883 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Getting quotas for user c866f273672846eb8d7f4f2a00269666 and project 185d32c10dd845768f4ff70a85680358. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:01:44.969463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3541b5d1-ca79-4109-aea4-44c7e80c1883 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:01:44.972273 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3541b5d1-ca79-4109-aea4-44c7e80c1883 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 6c51228f-b19b-4028-8c23-38cb4c0e1ad9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bbd74575-2018-41ff-af14-0acb9cb1727a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:01:45.031145 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3541b5d1-ca79-4109-aea4-44c7e80c1883 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.708544 Oct 29 03:01:45.036844 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1771/3367] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:01:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:01:45.042625 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-253642e0-d4af-44ac-8a1a-fd9c49d130bd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:45.043123 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-253642e0-d4af-44ac-8a1a-fd9c49d130bd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:45.063024 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-253642e0-d4af-44ac-8a1a-fd9c49d130bd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:45.064599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-253642e0-d4af-44ac-8a1a-fd9c49d130bd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:45.066106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-253642e0-d4af-44ac-8a1a-fd9c49d130bd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:45.068956 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-253642e0-d4af-44ac-8a1a-fd9c49d130bd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:45.071455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-253642e0-d4af-44ac-8a1a-fd9c49d130bd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:45.071906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-253642e0-d4af-44ac-8a1a-fd9c49d130bd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:45.121794 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-15a5067e-4004-410a-a180-5df29f413d7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:45.134001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-253642e0-d4af-44ac-8a1a-fd9c49d130bd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:01:45.140484 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-15a5067e-4004-410a-a180-5df29f413d7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1512 microversion: 2.1 time: 0.353853 Oct 29 03:01:45.148049 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1597/3368] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:44 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1512 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:01:45.163244 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bfac6e04-0c78-41f8-9ef2-9db2baf47195 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:45.168326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bfac6e04-0c78-41f8-9ef2-9db2baf47195 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] [instance: 92925276-7e25-4969-b5f8-c1d4acbb346b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:45.178248 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bfac6e04-0c78-41f8-9ef2-9db2baf47195 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:45.178988 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bfac6e04-0c78-41f8-9ef2-9db2baf47195 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:45.179699 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bfac6e04-0c78-41f8-9ef2-9db2baf47195 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:45.180888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bfac6e04-0c78-41f8-9ef2-9db2baf47195 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:45.181494 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bfac6e04-0c78-41f8-9ef2-9db2baf47195 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:45.182926 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bfac6e04-0c78-41f8-9ef2-9db2baf47195 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:45.213566 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-bfac6e04-0c78-41f8-9ef2-9db2baf47195 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] HTTP exception thrown: Instance 92925276-7e25-4969-b5f8-c1d4acbb346b could not be found. Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bfac6e04-0c78-41f8-9ef2-9db2baf47195 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Request method failure captured: Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b HTTP/1.1 Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJd7Jsw9r5sIIKBhKuSJQOpZbrgyvDRxzLseO6qATfHN9J9Y89kJ7CkETUhveeF_KIet2F1tjFEPn31qrtoHbT43A5Va-nlcK0FpV3DOv3lsBdQ4GB0MZvRb0_VkJZyIexQpias2r6bUwxJxqhtfhwE6HJs2H73KlwUGgtyTATXvsTw Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 0c460e416a634939a16f63d0c4c01a68 Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerGroupTestJSON-230576543 Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c460e416a634939a16f63d0c4c01a68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c460e416a634939a16f63d0c4c01a68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c460e416a634939a16f63d0c4c01a68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c460e416a634939a16f63d0c4c01a68"}]}] Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerGroupTestJSON-230576543 Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 0c460e416a634939a16f63d0c4c01a68 Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerGroupTestJSON-230576543 Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerGroupTestJSON-230576543-project Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: b2b1564244d54ed9acc97a4924ecb4cd Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerGroupTestJSON-230576543-project Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 92925276-7e25-4969-b5f8-c1d4acbb346b could not be found. Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '92925276-7e25-4969-b5f8-c1d4acbb346b'} Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92925276-7e25-4969-b5f8-c1d4acbb346b could not be found. Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92925276-7e25-4969-b5f8-c1d4acbb346b could not be found. Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:45.224935 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:45.230538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:45.230538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:45.230538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:45.230538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:01:45.230538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:01:45.230538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92925276-7e25-4969-b5f8-c1d4acbb346b could not be found. Oct 29 03:01:45.230538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:45.230538 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bfac6e04-0c78-41f8-9ef2-9db2baf47195 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Returning 404 to user: Instance 92925276-7e25-4969-b5f8-c1d4acbb346b could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:01:45.230538 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bfac6e04-0c78-41f8-9ef2-9db2baf47195 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b" status: 404 len: 111 microversion: 2.1 time: 0.077586 Oct 29 03:01:45.230538 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1598/3369] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:45 2022] GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:01:45.242728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f8dd6538-a317-4866-ae8f-6426253223a7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:45.243934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f8dd6538-a317-4866-ae8f-6426253223a7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 6c51228f-b19b-4028-8c23-38cb4c0e1ad9] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:45.293716 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-253642e0-d4af-44ac-8a1a-fd9c49d130bd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 204 len: 0 microversion: 2.20 time: 0.254719 Oct 29 03:01:45.297505 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1772/3370] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Oct 29 03:01:45 2022] DELETE /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:01:45.319985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-948172da-a842-4b43-82a0-abd82364865b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:45.322588 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-948172da-a842-4b43-82a0-abd82364865b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:45.339521 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-948172da-a842-4b43-82a0-abd82364865b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:45.340233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-948172da-a842-4b43-82a0-abd82364865b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:45.341740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-948172da-a842-4b43-82a0-abd82364865b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:45.343804 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-948172da-a842-4b43-82a0-abd82364865b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:45.344909 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-948172da-a842-4b43-82a0-abd82364865b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:45.346665 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-948172da-a842-4b43-82a0-abd82364865b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:45.358641 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f8dd6538-a317-4866-ae8f-6426253223a7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:45.366588 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f8dd6538-a317-4866-ae8f-6426253223a7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9" status: 200 len: 1205 microversion: 2.1 time: 0.136085 Oct 29 03:01:45.376941 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1599/3371] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:45 2022] GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9 => generated 1205 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:45.376941 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a2478cc8-dcfa-46ef-8b2e-92ccfb261076 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:45.412695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.compute.server_groups [None req-a2478cc8-dcfa-46ef-8b2e-92ccfb261076 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Querying cell 5270c754-82e2-4d8e-a02e-4533aa854f76(cell1) for 1 instances {{(pid=127125) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 29 03:01:45.413784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2478cc8-dcfa-46ef-8b2e-92ccfb261076 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:45.414273 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2478cc8-dcfa-46ef-8b2e-92ccfb261076 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:45.414838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2478cc8-dcfa-46ef-8b2e-92ccfb261076 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:45.450758 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a2478cc8-dcfa-46ef-8b2e-92ccfb261076 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.081259 Oct 29 03:01:45.452485 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1600/3372] 10.222.0.46 () {58 vars in 1152 bytes} [Sat Oct 29 03:01:45 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:45.465442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-15cf89cf-30a5-41ca-84db-05daa14630de tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:45.468060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-15cf89cf-30a5-41ca-84db-05daa14630de tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:45.486215 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-15cf89cf-30a5-41ca-84db-05daa14630de tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:45.488445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-948172da-a842-4b43-82a0-abd82364865b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:45.488881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-15cf89cf-30a5-41ca-84db-05daa14630de tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:45.491924 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-15cf89cf-30a5-41ca-84db-05daa14630de tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:45.493121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-15cf89cf-30a5-41ca-84db-05daa14630de tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:45.493763 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-15cf89cf-30a5-41ca-84db-05daa14630de tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:45.495994 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-15cf89cf-30a5-41ca-84db-05daa14630de tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:45.519034 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-948172da-a842-4b43-82a0-abd82364865b tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1183 microversion: 2.1 time: 0.218645 Oct 29 03:01:45.520972 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1773/3373] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:45 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:45.545330 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7350747b-fcb3-42f4-8597-d662c4db0dba tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:45.596125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.compute.server_groups [None req-7350747b-fcb3-42f4-8597-d662c4db0dba tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Querying cell 5270c754-82e2-4d8e-a02e-4533aa854f76(cell1) for 1 instances {{(pid=127124) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 29 03:01:45.597296 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7350747b-fcb3-42f4-8597-d662c4db0dba tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:45.599166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7350747b-fcb3-42f4-8597-d662c4db0dba tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:45.601212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7350747b-fcb3-42f4-8597-d662c4db0dba tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:45.636749 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7350747b-fcb3-42f4-8597-d662c4db0dba tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "GET /compute/v2.1/os-server-groups/04a00b30-e2f8-4b55-993b-ad65f6001012" status: 200 len: 184 microversion: 2.1 time: 0.113552 Oct 29 03:01:45.637401 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1774/3374] 10.222.0.46 () {58 vars in 1263 bytes} [Sat Oct 29 03:01:45 2022] GET /compute/v2.1/os-server-groups/04a00b30-e2f8-4b55-993b-ad65f6001012 => generated 184 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:45.667755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5ab35f3c-9cff-4506-9dea-1a6a69d48da6 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:45.669680 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5ab35f3c-9cff-4506-9dea-1a6a69d48da6 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] [instance: 92925276-7e25-4969-b5f8-c1d4acbb346b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:45.687991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ab35f3c-9cff-4506-9dea-1a6a69d48da6 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:45.688681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ab35f3c-9cff-4506-9dea-1a6a69d48da6 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:45.689357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ab35f3c-9cff-4506-9dea-1a6a69d48da6 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:45.690994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ab35f3c-9cff-4506-9dea-1a6a69d48da6 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:45.691643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ab35f3c-9cff-4506-9dea-1a6a69d48da6 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:45.692269 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ab35f3c-9cff-4506-9dea-1a6a69d48da6 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:45.723004 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-5ab35f3c-9cff-4506-9dea-1a6a69d48da6 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] HTTP exception thrown: Instance 92925276-7e25-4969-b5f8-c1d4acbb346b could not be found. Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5ab35f3c-9cff-4506-9dea-1a6a69d48da6 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Request method failure captured: Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b HTTP/1.1 Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJd7Jsw9r5sIIKBhKuSJQOpZbrgyvDRxzLseO6qATfHN9J9Y89kJ7CkETUhveeF_KIet2F1tjFEPn31qrtoHbT43A5Va-nlcK0FpV3DOv3lsBdQ4GB0MZvRb0_VkJZyIexQpias2r6bUwxJxqhtfhwE6HJs2H73KlwUGgtyTATXvsTw Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 0c460e416a634939a16f63d0c4c01a68 Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServerGroupTestJSON-230576543 Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c460e416a634939a16f63d0c4c01a68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c460e416a634939a16f63d0c4c01a68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c460e416a634939a16f63d0c4c01a68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c460e416a634939a16f63d0c4c01a68"}]}] Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServerGroupTestJSON-230576543 Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 0c460e416a634939a16f63d0c4c01a68 Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServerGroupTestJSON-230576543 Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServerGroupTestJSON-230576543-project Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: b2b1564244d54ed9acc97a4924ecb4cd Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServerGroupTestJSON-230576543-project Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 92925276-7e25-4969-b5f8-c1d4acbb346b could not be found. Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '92925276-7e25-4969-b5f8-c1d4acbb346b'} Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92925276-7e25-4969-b5f8-c1d4acbb346b could not be found. Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:01:45.730186 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:01:45.734212 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92925276-7e25-4969-b5f8-c1d4acbb346b could not be found. Oct 29 03:01:45.734212 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:45.734212 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:45.734212 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:45.734212 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:45.734212 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:45.734212 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:45.734212 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:01:45.734212 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:01:45.734212 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92925276-7e25-4969-b5f8-c1d4acbb346b could not be found. Oct 29 03:01:45.734212 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:45.738436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5ab35f3c-9cff-4506-9dea-1a6a69d48da6 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Returning 404 to user: Instance 92925276-7e25-4969-b5f8-c1d4acbb346b could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:01:45.742446 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5ab35f3c-9cff-4506-9dea-1a6a69d48da6 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "DELETE /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b" status: 404 len: 111 microversion: 2.1 time: 0.083119 Oct 29 03:01:45.743244 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1775/3375] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:01:45 2022] DELETE /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:01:45.767644 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-15cf89cf-30a5-41ca-84db-05daa14630de tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:45.776089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a7ed3915-520f-48f1-80f9-c5a488220791 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:45.778230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a7ed3915-520f-48f1-80f9-c5a488220791 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] [instance: 92925276-7e25-4969-b5f8-c1d4acbb346b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:45.782569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-15cf89cf-30a5-41ca-84db-05daa14630de tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:45.786556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-15cf89cf-30a5-41ca-84db-05daa14630de tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:45.788142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7ed3915-520f-48f1-80f9-c5a488220791 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:45.792123 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-15cf89cf-30a5-41ca-84db-05daa14630de tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1723 microversion: 2.20 time: 0.337593 Oct 29 03:01:45.792750 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1601/3376] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:45 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1723 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:45.795361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7ed3915-520f-48f1-80f9-c5a488220791 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:45.795912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7ed3915-520f-48f1-80f9-c5a488220791 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:45.796779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7ed3915-520f-48f1-80f9-c5a488220791 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:45.797956 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7ed3915-520f-48f1-80f9-c5a488220791 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:45.798618 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7ed3915-520f-48f1-80f9-c5a488220791 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:45.839264 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-a7ed3915-520f-48f1-80f9-c5a488220791 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] HTTP exception thrown: Instance 92925276-7e25-4969-b5f8-c1d4acbb346b could not be found. Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a7ed3915-520f-48f1-80f9-c5a488220791 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Request method failure captured: Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b HTTP/1.1 Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJd7Jsw9r5sIIKBhKuSJQOpZbrgyvDRxzLseO6qATfHN9J9Y89kJ7CkETUhveeF_KIet2F1tjFEPn31qrtoHbT43A5Va-nlcK0FpV3DOv3lsBdQ4GB0MZvRb0_VkJZyIexQpias2r6bUwxJxqhtfhwE6HJs2H73KlwUGgtyTATXvsTw Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 0c460e416a634939a16f63d0c4c01a68 Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServerGroupTestJSON-230576543 Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c460e416a634939a16f63d0c4c01a68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c460e416a634939a16f63d0c4c01a68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c460e416a634939a16f63d0c4c01a68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c460e416a634939a16f63d0c4c01a68"}]}] Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServerGroupTestJSON-230576543 Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 0c460e416a634939a16f63d0c4c01a68 Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServerGroupTestJSON-230576543 Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServerGroupTestJSON-230576543-project Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: b2b1564244d54ed9acc97a4924ecb4cd Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServerGroupTestJSON-230576543-project Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 92925276-7e25-4969-b5f8-c1d4acbb346b could not be found. Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '92925276-7e25-4969-b5f8-c1d4acbb346b'} Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92925276-7e25-4969-b5f8-c1d4acbb346b could not be found. Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92925276-7e25-4969-b5f8-c1d4acbb346b could not be found. Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:45.841794 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:45.847483 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:45.847483 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:45.847483 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:45.847483 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:01:45.847483 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:01:45.847483 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92925276-7e25-4969-b5f8-c1d4acbb346b could not be found. Oct 29 03:01:45.847483 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:45.849907 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a7ed3915-520f-48f1-80f9-c5a488220791 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Returning 404 to user: Instance 92925276-7e25-4969-b5f8-c1d4acbb346b could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:01:45.851430 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a7ed3915-520f-48f1-80f9-c5a488220791 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b" status: 404 len: 111 microversion: 2.1 time: 0.093383 Oct 29 03:01:45.852247 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1776/3377] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:45 2022] GET /compute/v2.1/servers/92925276-7e25-4969-b5f8-c1d4acbb346b => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:01:45.862073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8ac2babc-0590-43d9-aa01-cf5f05bf598e tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:45.874817 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-8ac2babc-0590-43d9-aa01-cf5f05bf598e tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] HTTP exception thrown: Instance group cc4f172c-8e0f-4730-b8d1-833451850ad7 could not be found. Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8ac2babc-0590-43d9-aa01-cf5f05bf598e tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Request method failure captured: Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/os-server-groups/cc4f172c-8e0f-4730-b8d1-833451850ad7 HTTP/1.1 Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJd7Jsw9r5sIIKBhKuSJQOpZbrgyvDRxzLseO6qATfHN9J9Y89kJ7CkETUhveeF_KIet2F1tjFEPn31qrtoHbT43A5Va-nlcK0FpV3DOv3lsBdQ4GB0MZvRb0_VkJZyIexQpias2r6bUwxJxqhtfhwE6HJs2H73KlwUGgtyTATXvsTw Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 0c460e416a634939a16f63d0c4c01a68 Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerGroupTestJSON-230576543 Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c460e416a634939a16f63d0c4c01a68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c460e416a634939a16f63d0c4c01a68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c460e416a634939a16f63d0c4c01a68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c460e416a634939a16f63d0c4c01a68"}]}] Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerGroupTestJSON-230576543 Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 0c460e416a634939a16f63d0c4c01a68 Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerGroupTestJSON-230576543 Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerGroupTestJSON-230576543-project Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: b2b1564244d54ed9acc97a4924ecb4cd Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerGroupTestJSON-230576543-project Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance group cc4f172c-8e0f-4730-b8d1-833451850ad7 could not be found. Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'cc4f172c-8e0f-4730-b8d1-833451850ad7'} Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group cc4f172c-8e0f-4730-b8d1-833451850ad7 could not be found. Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group cc4f172c-8e0f-4730-b8d1-833451850ad7 could not be found. Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:45.878097 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:45.882170 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:45.882170 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:45.882170 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:01:45.882170 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:01:45.882170 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group cc4f172c-8e0f-4730-b8d1-833451850ad7 could not be found. Oct 29 03:01:45.882170 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:45.887229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8ac2babc-0590-43d9-aa01-cf5f05bf598e tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Returning 404 to user: Instance group cc4f172c-8e0f-4730-b8d1-833451850ad7 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:01:45.888743 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8ac2babc-0590-43d9-aa01-cf5f05bf598e tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/cc4f172c-8e0f-4730-b8d1-833451850ad7" status: 404 len: 117 microversion: 2.1 time: 0.032041 Oct 29 03:01:45.889575 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1602/3378] 10.222.0.46 () {58 vars in 1266 bytes} [Sat Oct 29 03:01:45 2022] DELETE /compute/v2.1/os-server-groups/cc4f172c-8e0f-4730-b8d1-833451850ad7 => generated 117 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:01:45.900169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4de951e5-3113-49e9-b8d0-36f175bcfc6d tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:45.913503 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-4de951e5-3113-49e9-b8d0-36f175bcfc6d tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] HTTP exception thrown: Instance group a2e70ec4-0b5a-4ed5-a755-edff2447e921 could not be found. Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4de951e5-3113-49e9-b8d0-36f175bcfc6d tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Request method failure captured: Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/os-server-groups/a2e70ec4-0b5a-4ed5-a755-edff2447e921 HTTP/1.1 Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJd7Jsw9r5sIIKBhKuSJQOpZbrgyvDRxzLseO6qATfHN9J9Y89kJ7CkETUhveeF_KIet2F1tjFEPn31qrtoHbT43A5Va-nlcK0FpV3DOv3lsBdQ4GB0MZvRb0_VkJZyIexQpias2r6bUwxJxqhtfhwE6HJs2H73KlwUGgtyTATXvsTw Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 0c460e416a634939a16f63d0c4c01a68 Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServerGroupTestJSON-230576543 Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c460e416a634939a16f63d0c4c01a68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c460e416a634939a16f63d0c4c01a68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c460e416a634939a16f63d0c4c01a68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c460e416a634939a16f63d0c4c01a68"}]}] Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServerGroupTestJSON-230576543 Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 0c460e416a634939a16f63d0c4c01a68 Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServerGroupTestJSON-230576543 Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServerGroupTestJSON-230576543-project Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: b2b1564244d54ed9acc97a4924ecb4cd Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServerGroupTestJSON-230576543-project Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance group a2e70ec4-0b5a-4ed5-a755-edff2447e921 could not be found. Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'a2e70ec4-0b5a-4ed5-a755-edff2447e921'} Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a2e70ec4-0b5a-4ed5-a755-edff2447e921 could not be found. Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a2e70ec4-0b5a-4ed5-a755-edff2447e921 could not be found. Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:45.929824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:45.934827 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:45.934827 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:45.934827 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:01:45.934827 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:01:45.934827 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a2e70ec4-0b5a-4ed5-a755-edff2447e921 could not be found. Oct 29 03:01:45.934827 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:45.937243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4de951e5-3113-49e9-b8d0-36f175bcfc6d tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Returning 404 to user: Instance group a2e70ec4-0b5a-4ed5-a755-edff2447e921 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:01:45.939795 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4de951e5-3113-49e9-b8d0-36f175bcfc6d tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/a2e70ec4-0b5a-4ed5-a755-edff2447e921" status: 404 len: 117 microversion: 2.1 time: 0.043931 Oct 29 03:01:45.941592 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1777/3379] 10.222.0.46 () {58 vars in 1266 bytes} [Sat Oct 29 03:01:45 2022] DELETE /compute/v2.1/os-server-groups/a2e70ec4-0b5a-4ed5-a755-edff2447e921 => generated 117 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:01:45.953441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-39fa940b-0da8-476e-936b-c3eafee076c5 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:45.974135 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-39fa940b-0da8-476e-936b-c3eafee076c5 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] HTTP exception thrown: Instance group cbdebda6-54e5-4f08-abb5-c41099a59877 could not be found. Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-39fa940b-0da8-476e-936b-c3eafee076c5 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Request method failure captured: Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/os-server-groups/cbdebda6-54e5-4f08-abb5-c41099a59877 HTTP/1.1 Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJd7Jsw9r5sIIKBhKuSJQOpZbrgyvDRxzLseO6qATfHN9J9Y89kJ7CkETUhveeF_KIet2F1tjFEPn31qrtoHbT43A5Va-nlcK0FpV3DOv3lsBdQ4GB0MZvRb0_VkJZyIexQpias2r6bUwxJxqhtfhwE6HJs2H73KlwUGgtyTATXvsTw Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 0c460e416a634939a16f63d0c4c01a68 Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerGroupTestJSON-230576543 Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c460e416a634939a16f63d0c4c01a68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c460e416a634939a16f63d0c4c01a68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c460e416a634939a16f63d0c4c01a68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c460e416a634939a16f63d0c4c01a68"}]}] Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerGroupTestJSON-230576543 Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 0c460e416a634939a16f63d0c4c01a68 Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerGroupTestJSON-230576543 Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerGroupTestJSON-230576543-project Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: b2b1564244d54ed9acc97a4924ecb4cd Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerGroupTestJSON-230576543-project Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance group cbdebda6-54e5-4f08-abb5-c41099a59877 could not be found. Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'cbdebda6-54e5-4f08-abb5-c41099a59877'} Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group cbdebda6-54e5-4f08-abb5-c41099a59877 could not be found. Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group cbdebda6-54e5-4f08-abb5-c41099a59877 could not be found. Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:45.978938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:45.985016 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:45.985016 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:45.985016 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:01:45.985016 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:01:45.985016 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group cbdebda6-54e5-4f08-abb5-c41099a59877 could not be found. Oct 29 03:01:45.985016 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:01:45.988965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-39fa940b-0da8-476e-936b-c3eafee076c5 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Returning 404 to user: Instance group cbdebda6-54e5-4f08-abb5-c41099a59877 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:01:45.992441 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-39fa940b-0da8-476e-936b-c3eafee076c5 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/cbdebda6-54e5-4f08-abb5-c41099a59877" status: 404 len: 117 microversion: 2.1 time: 0.045441 Oct 29 03:01:45.998014 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1603/3380] 10.222.0.46 () {58 vars in 1266 bytes} [Sat Oct 29 03:01:45 2022] DELETE /compute/v2.1/os-server-groups/cbdebda6-54e5-4f08-abb5-c41099a59877 => generated 117 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:01:46.006934 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-99772d60-36e7-45e9-bca1-edd0d7cb7595 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:46.014841 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-99772d60-36e7-45e9-bca1-edd0d7cb7595 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] HTTP exception thrown: Instance group fc4e32b1-c845-44d2-bf57-940db8730515 could not be found. Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-99772d60-36e7-45e9-bca1-edd0d7cb7595 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Request method failure captured: Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/os-server-groups/fc4e32b1-c845-44d2-bf57-940db8730515 HTTP/1.1 Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJd7Jsw9r5sIIKBhKuSJQOpZbrgyvDRxzLseO6qATfHN9J9Y89kJ7CkETUhveeF_KIet2F1tjFEPn31qrtoHbT43A5Va-nlcK0FpV3DOv3lsBdQ4GB0MZvRb0_VkJZyIexQpias2r6bUwxJxqhtfhwE6HJs2H73KlwUGgtyTATXvsTw Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 0c460e416a634939a16f63d0c4c01a68 Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServerGroupTestJSON-230576543 Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c460e416a634939a16f63d0c4c01a68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c460e416a634939a16f63d0c4c01a68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c460e416a634939a16f63d0c4c01a68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c460e416a634939a16f63d0c4c01a68"}]}] Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServerGroupTestJSON-230576543 Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 0c460e416a634939a16f63d0c4c01a68 Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServerGroupTestJSON-230576543 Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServerGroupTestJSON-230576543-project Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: b2b1564244d54ed9acc97a4924ecb4cd Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServerGroupTestJSON-230576543-project Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance group fc4e32b1-c845-44d2-bf57-940db8730515 could not be found. Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'fc4e32b1-c845-44d2-bf57-940db8730515'} Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group fc4e32b1-c845-44d2-bf57-940db8730515 could not be found. Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group fc4e32b1-c845-44d2-bf57-940db8730515 could not be found. Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:46.015904 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:46.024181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:46.024181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:46.024181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:01:46.024181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:01:46.024181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group fc4e32b1-c845-44d2-bf57-940db8730515 could not be found. Oct 29 03:01:46.024181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:46.024181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-99772d60-36e7-45e9-bca1-edd0d7cb7595 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Returning 404 to user: Instance group fc4e32b1-c845-44d2-bf57-940db8730515 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:01:46.024181 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-99772d60-36e7-45e9-bca1-edd0d7cb7595 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/fc4e32b1-c845-44d2-bf57-940db8730515" status: 404 len: 117 microversion: 2.1 time: 0.015090 Oct 29 03:01:46.024181 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1778/3381] 10.222.0.46 () {58 vars in 1266 bytes} [Sat Oct 29 03:01:46 2022] DELETE /compute/v2.1/os-server-groups/fc4e32b1-c845-44d2-bf57-940db8730515 => generated 117 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:01:46.028336 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fcb7f881-4c0e-4bed-a059-7fedb075bfc1 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:46.084103 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fcb7f881-4c0e-4bed-a059-7fedb075bfc1 tempest-ServerGroupTestJSON-230576543 tempest-ServerGroupTestJSON-230576543-project] 10.222.0.46 "DELETE /compute/v2.1/os-server-groups/04a00b30-e2f8-4b55-993b-ad65f6001012" status: 204 len: 0 microversion: 2.1 time: 0.061009 Oct 29 03:01:46.085480 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1604/3382] 10.222.0.46 () {58 vars in 1266 bytes} [Sat Oct 29 03:01:46 2022] DELETE /compute/v2.1/os-server-groups/04a00b30-e2f8-4b55-993b-ad65f6001012 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 03:01:46.169607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c303c643-9eb6-42d3-b07d-d528f9dc286a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:46.170534 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c303c643-9eb6-42d3-b07d-d528f9dc286a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:46.183776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c303c643-9eb6-42d3-b07d-d528f9dc286a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:46.185654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c303c643-9eb6-42d3-b07d-d528f9dc286a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:46.186408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c303c643-9eb6-42d3-b07d-d528f9dc286a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:46.187802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c303c643-9eb6-42d3-b07d-d528f9dc286a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:46.189413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c303c643-9eb6-42d3-b07d-d528f9dc286a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:46.190778 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c303c643-9eb6-42d3-b07d-d528f9dc286a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:46.393548 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4a84e27b-3bb9-46ec-9037-2ff331b533f1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:46.394439 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4a84e27b-3bb9-46ec-9037-2ff331b533f1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 6c51228f-b19b-4028-8c23-38cb4c0e1ad9] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:46.402838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a84e27b-3bb9-46ec-9037-2ff331b533f1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:46.410082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a84e27b-3bb9-46ec-9037-2ff331b533f1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:46.411192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a84e27b-3bb9-46ec-9037-2ff331b533f1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:46.413457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a84e27b-3bb9-46ec-9037-2ff331b533f1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:46.416478 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a84e27b-3bb9-46ec-9037-2ff331b533f1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:46.416974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a84e27b-3bb9-46ec-9037-2ff331b533f1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:46.745876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c303c643-9eb6-42d3-b07d-d528f9dc286a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:46.756618 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c303c643-9eb6-42d3-b07d-d528f9dc286a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1512 microversion: 2.1 time: 0.595611 Oct 29 03:01:46.761757 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1779/3383] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:46 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1512 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:46.767842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f2ea1fd5-d944-49a9-afe8-e719e530bc85 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:46.768618 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f2ea1fd5-d944-49a9-afe8-e719e530bc85 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:46.787511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2ea1fd5-d944-49a9-afe8-e719e530bc85 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:46.788020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2ea1fd5-d944-49a9-afe8-e719e530bc85 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:46.790820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2ea1fd5-d944-49a9-afe8-e719e530bc85 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:46.792706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2ea1fd5-d944-49a9-afe8-e719e530bc85 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:46.795188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2ea1fd5-d944-49a9-afe8-e719e530bc85 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:46.795875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2ea1fd5-d944-49a9-afe8-e719e530bc85 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:47.027855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f2ea1fd5-d944-49a9-afe8-e719e530bc85 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:47.045513 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f2ea1fd5-d944-49a9-afe8-e719e530bc85 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1183 microversion: 2.1 time: 0.283108 Oct 29 03:01:47.046104 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1780/3384] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:46 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1183 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:47.077907 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9dc35591-d76b-4bbe-b926-ea0450bf4264 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:47.079756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9dc35591-d76b-4bbe-b926-ea0450bf4264 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:47.099959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9dc35591-d76b-4bbe-b926-ea0450bf4264 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:47.100833 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9dc35591-d76b-4bbe-b926-ea0450bf4264 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:47.104082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9dc35591-d76b-4bbe-b926-ea0450bf4264 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:47.105318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9dc35591-d76b-4bbe-b926-ea0450bf4264 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:47.108291 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9dc35591-d76b-4bbe-b926-ea0450bf4264 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:47.109381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9dc35591-d76b-4bbe-b926-ea0450bf4264 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:47.166355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4a84e27b-3bb9-46ec-9037-2ff331b533f1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:47.175783 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:47.189746 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4a84e27b-3bb9-46ec-9037-2ff331b533f1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9" status: 200 len: 1209 microversion: 2.1 time: 0.798379 Oct 29 03:01:47.208768 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1605/3385] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:46 2022] GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9 => generated 1209 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:47.529253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9dc35591-d76b-4bbe-b926-ea0450bf4264 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:47.544997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9dc35591-d76b-4bbe-b926-ea0450bf4264 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:47.548307 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9dc35591-d76b-4bbe-b926-ea0450bf4264 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:47.553022 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9dc35591-d76b-4bbe-b926-ea0450bf4264 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1723 microversion: 2.20 time: 0.482669 Oct 29 03:01:47.569543 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1781/3386] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:47 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1723 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:47.786213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6004267f-6966-4f9f-b92a-596158375745 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:47.787223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6004267f-6966-4f9f-b92a-596158375745 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:47.803762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6004267f-6966-4f9f-b92a-596158375745 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:47.806139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6004267f-6966-4f9f-b92a-596158375745 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:47.807729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6004267f-6966-4f9f-b92a-596158375745 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:47.811281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6004267f-6966-4f9f-b92a-596158375745 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:47.815071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6004267f-6966-4f9f-b92a-596158375745 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:47.818182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6004267f-6966-4f9f-b92a-596158375745 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:48.062444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-4ccaee4f-3084-4a9d-9c7d-8a30c5b66c8c req-4bee9bd0-c846-4d0b-b57c-9636e60a86a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28d33b72-926b-49d9-8807-1d2be68c487f", "name": "network-vif-unplugged", "status": "completed", "tag": "5a2e20a8-d25a-49ae-9802-e29f037f1ef2"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:48.095194 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4ccaee4f-3084-4a9d-9c7d-8a30c5b66c8c req-4bee9bd0-c846-4d0b-b57c-9636e60a86a1 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:48.095556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4ccaee4f-3084-4a9d-9c7d-8a30c5b66c8c req-4bee9bd0-c846-4d0b-b57c-9636e60a86a1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:48.096206 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4ccaee4f-3084-4a9d-9c7d-8a30c5b66c8c req-4bee9bd0-c846-4d0b-b57c-9636e60a86a1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:48.124368 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-4ccaee4f-3084-4a9d-9c7d-8a30c5b66c8c req-4bee9bd0-c846-4d0b-b57c-9636e60a86a1 service nova] Creating event network-vif-unplugged:5a2e20a8-d25a-49ae-9802-e29f037f1ef2 for instance 28d33b72-926b-49d9-8807-1d2be68c487f on n-h2-862967-2 Oct 29 03:01:48.133400 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-4ccaee4f-3084-4a9d-9c7d-8a30c5b66c8c req-4bee9bd0-c846-4d0b-b57c-9636e60a86a1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.445884 Oct 29 03:01:48.134109 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1606/3387] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:01:48.159276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0a161aa4-20db-41c9-b8c2-1417f15703e9 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:48.168825 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0a161aa4-20db-41c9-b8c2-1417f15703e9 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:48.194481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a161aa4-20db-41c9-b8c2-1417f15703e9 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:48.195108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a161aa4-20db-41c9-b8c2-1417f15703e9 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:48.195649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a161aa4-20db-41c9-b8c2-1417f15703e9 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:48.197347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a161aa4-20db-41c9-b8c2-1417f15703e9 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:48.199276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a161aa4-20db-41c9-b8c2-1417f15703e9 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:48.199820 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a161aa4-20db-41c9-b8c2-1417f15703e9 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:48.610651 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0a161aa4-20db-41c9-b8c2-1417f15703e9 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:48.622344 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0a161aa4-20db-41c9-b8c2-1417f15703e9 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1183 microversion: 2.1 time: 0.485909 Oct 29 03:01:48.627351 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1607/3388] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:48 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1183 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:48.644359 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3717d62b-2348-48a5-8046-44b97f8f8d72 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:48.645364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3717d62b-2348-48a5-8046-44b97f8f8d72 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 6c51228f-b19b-4028-8c23-38cb4c0e1ad9] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:48.659412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3717d62b-2348-48a5-8046-44b97f8f8d72 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:48.660583 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3717d62b-2348-48a5-8046-44b97f8f8d72 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:48.661191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3717d62b-2348-48a5-8046-44b97f8f8d72 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:48.662124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3717d62b-2348-48a5-8046-44b97f8f8d72 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:48.662737 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3717d62b-2348-48a5-8046-44b97f8f8d72 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:48.663322 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3717d62b-2348-48a5-8046-44b97f8f8d72 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:48.885728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6004267f-6966-4f9f-b92a-596158375745 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:48.896748 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6004267f-6966-4f9f-b92a-596158375745 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1512 microversion: 2.1 time: 1.117258 Oct 29 03:01:48.901872 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1782/3389] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:47 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1512 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:48.910366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f9bdec65-54f5-4634-95cf-636de3d9de59 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:48.924606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f9bdec65-54f5-4634-95cf-636de3d9de59 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:48.932581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3717d62b-2348-48a5-8046-44b97f8f8d72 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:48.940044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9bdec65-54f5-4634-95cf-636de3d9de59 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:48.941025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9bdec65-54f5-4634-95cf-636de3d9de59 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:48.943473 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9bdec65-54f5-4634-95cf-636de3d9de59 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:48.944589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9bdec65-54f5-4634-95cf-636de3d9de59 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:48.947631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9bdec65-54f5-4634-95cf-636de3d9de59 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:48.948286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9bdec65-54f5-4634-95cf-636de3d9de59 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:48.962329 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3717d62b-2348-48a5-8046-44b97f8f8d72 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9" status: 200 len: 1263 microversion: 2.1 time: 0.330256 Oct 29 03:01:48.965297 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1608/3390] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:48 2022] GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9 => generated 1263 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:49.657465 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ab18d989-f195-4f29-be9e-51f67d12e558 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:49.658082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ab18d989-f195-4f29-be9e-51f67d12e558 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:49.717393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab18d989-f195-4f29-be9e-51f67d12e558 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:49.718945 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab18d989-f195-4f29-be9e-51f67d12e558 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:49.719406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab18d989-f195-4f29-be9e-51f67d12e558 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:49.720470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab18d989-f195-4f29-be9e-51f67d12e558 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:49.729499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab18d989-f195-4f29-be9e-51f67d12e558 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:49.729955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab18d989-f195-4f29-be9e-51f67d12e558 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:49.744243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f9bdec65-54f5-4634-95cf-636de3d9de59 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:49.760995 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f9bdec65-54f5-4634-95cf-636de3d9de59 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:49.766474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f9bdec65-54f5-4634-95cf-636de3d9de59 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:49.769031 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f9bdec65-54f5-4634-95cf-636de3d9de59 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1723 microversion: 2.20 time: 0.864392 Oct 29 03:01:49.772438 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1783/3391] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:48 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1723 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:49.781725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:49.924579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-856b2aa0-174e-472e-93d6-09d9638cdd15 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:49.925346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-856b2aa0-174e-472e-93d6-09d9638cdd15 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:49.935584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-856b2aa0-174e-472e-93d6-09d9638cdd15 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:49.936175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-856b2aa0-174e-472e-93d6-09d9638cdd15 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:49.936735 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-856b2aa0-174e-472e-93d6-09d9638cdd15 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:49.937540 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-856b2aa0-174e-472e-93d6-09d9638cdd15 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:49.942623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-856b2aa0-174e-472e-93d6-09d9638cdd15 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:49.943183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-856b2aa0-174e-472e-93d6-09d9638cdd15 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:50.223639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ab18d989-f195-4f29-be9e-51f67d12e558 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:50.261139 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ab18d989-f195-4f29-be9e-51f67d12e558 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1183 microversion: 2.1 time: 0.609956 Oct 29 03:01:50.265133 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1609/3392] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:49 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1183 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:01:50.283576 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6d47f6ee-2bb4-4e8c-9ab3-139c55a561d0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:50.284558 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6d47f6ee-2bb4-4e8c-9ab3-139c55a561d0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 6c51228f-b19b-4028-8c23-38cb4c0e1ad9] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:50.297526 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d47f6ee-2bb4-4e8c-9ab3-139c55a561d0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:50.309950 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d47f6ee-2bb4-4e8c-9ab3-139c55a561d0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:50.311465 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d47f6ee-2bb4-4e8c-9ab3-139c55a561d0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:50.313917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d47f6ee-2bb4-4e8c-9ab3-139c55a561d0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:50.314563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d47f6ee-2bb4-4e8c-9ab3-139c55a561d0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:50.317637 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d47f6ee-2bb4-4e8c-9ab3-139c55a561d0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:50.631601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6d47f6ee-2bb4-4e8c-9ab3-139c55a561d0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:50.643304 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6d47f6ee-2bb4-4e8c-9ab3-139c55a561d0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9" status: 200 len: 1263 microversion: 2.1 time: 0.376316 Oct 29 03:01:50.650047 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1610/3393] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:50 2022] GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9 => generated 1263 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:50.801063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-19d7afcb-3ffa-4e70-9e00-23f04c00a63f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:50.801720 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-19d7afcb-3ffa-4e70-9e00-23f04c00a63f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:50.815567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19d7afcb-3ffa-4e70-9e00-23f04c00a63f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:50.816059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19d7afcb-3ffa-4e70-9e00-23f04c00a63f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:50.816703 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19d7afcb-3ffa-4e70-9e00-23f04c00a63f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:50.817606 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19d7afcb-3ffa-4e70-9e00-23f04c00a63f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:50.821559 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19d7afcb-3ffa-4e70-9e00-23f04c00a63f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:50.823481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19d7afcb-3ffa-4e70-9e00-23f04c00a63f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:50.830635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-856b2aa0-174e-472e-93d6-09d9638cdd15 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:50.841010 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-856b2aa0-174e-472e-93d6-09d9638cdd15 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1512 microversion: 2.1 time: 0.920826 Oct 29 03:01:50.849324 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1784/3394] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:49 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1512 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:01:51.190094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-19d7afcb-3ffa-4e70-9e00-23f04c00a63f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:51.203987 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-19d7afcb-3ffa-4e70-9e00-23f04c00a63f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:51.225958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-19d7afcb-3ffa-4e70-9e00-23f04c00a63f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:51.227210 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-19d7afcb-3ffa-4e70-9e00-23f04c00a63f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1656 microversion: 2.20 time: 0.430200 Oct 29 03:01:51.244554 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1611/3395] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:50 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1656 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:51.338353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-45616986-47c1-43e6-b504-507b8e65b1d6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:51.339460 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-45616986-47c1-43e6-b504-507b8e65b1d6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:51.357696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45616986-47c1-43e6-b504-507b8e65b1d6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:51.359107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45616986-47c1-43e6-b504-507b8e65b1d6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:51.360882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45616986-47c1-43e6-b504-507b8e65b1d6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:51.362133 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45616986-47c1-43e6-b504-507b8e65b1d6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:51.363292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45616986-47c1-43e6-b504-507b8e65b1d6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:51.363990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45616986-47c1-43e6-b504-507b8e65b1d6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:51.671494 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-36567b04-3cca-4fec-ab41-1266f760a812 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:51.672121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-36567b04-3cca-4fec-ab41-1266f760a812 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 6c51228f-b19b-4028-8c23-38cb4c0e1ad9] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:51.677552 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-45616986-47c1-43e6-b504-507b8e65b1d6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:51.678714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36567b04-3cca-4fec-ab41-1266f760a812 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:51.687741 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36567b04-3cca-4fec-ab41-1266f760a812 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:51.688199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36567b04-3cca-4fec-ab41-1266f760a812 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:51.709026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36567b04-3cca-4fec-ab41-1266f760a812 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:51.710446 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36567b04-3cca-4fec-ab41-1266f760a812 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:51.711381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36567b04-3cca-4fec-ab41-1266f760a812 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:51.737294 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-45616986-47c1-43e6-b504-507b8e65b1d6 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 200 len: 1183 microversion: 2.1 time: 0.419523 Oct 29 03:01:51.757110 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1785/3396] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:51 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 1183 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:51.875992 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2ce82951-2b8b-47c2-840e-8198ced9941f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:51.877667 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2ce82951-2b8b-47c2-840e-8198ced9941f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:51.890509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2ce82951-2b8b-47c2-840e-8198ced9941f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:51.894720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2ce82951-2b8b-47c2-840e-8198ced9941f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:51.895438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2ce82951-2b8b-47c2-840e-8198ced9941f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:51.901743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2ce82951-2b8b-47c2-840e-8198ced9941f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:51.904849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2ce82951-2b8b-47c2-840e-8198ced9941f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:51.905514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2ce82951-2b8b-47c2-840e-8198ced9941f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:52.657481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-36567b04-3cca-4fec-ab41-1266f760a812 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:52.668228 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-36567b04-3cca-4fec-ab41-1266f760a812 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9" status: 200 len: 1305 microversion: 2.1 time: 1.000677 Oct 29 03:01:52.687259 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1612/3397] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:51 2022] GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9 => generated 1305 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:52.697400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-116cb698-ab26-46ef-a4b7-44fcc1a73627 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:52.704143 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-116cb698-ab26-46ef-a4b7-44fcc1a73627 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:52.738160 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-116cb698-ab26-46ef-a4b7-44fcc1a73627 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:52.739703 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-116cb698-ab26-46ef-a4b7-44fcc1a73627 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:52.740806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-116cb698-ab26-46ef-a4b7-44fcc1a73627 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:52.742968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-116cb698-ab26-46ef-a4b7-44fcc1a73627 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:52.746135 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-116cb698-ab26-46ef-a4b7-44fcc1a73627 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:52.747529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-116cb698-ab26-46ef-a4b7-44fcc1a73627 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:53.143875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2ce82951-2b8b-47c2-840e-8198ced9941f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:53.177958 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2ce82951-2b8b-47c2-840e-8198ced9941f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1489 microversion: 2.1 time: 1.310313 Oct 29 03:01:53.182556 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1786/3398] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:51 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1489 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:53.225437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b00996fc-75db-4137-b171-b10d08c44722 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:53.226171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b00996fc-75db-4137-b171-b10d08c44722 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 6a79a761-e10f-4a8d-8e33-a21c08c81184] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:53.244511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b00996fc-75db-4137-b171-b10d08c44722 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:53.246782 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b00996fc-75db-4137-b171-b10d08c44722 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:53.247749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b00996fc-75db-4137-b171-b10d08c44722 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:53.249213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b00996fc-75db-4137-b171-b10d08c44722 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:53.249667 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b00996fc-75db-4137-b171-b10d08c44722 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:53.250109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b00996fc-75db-4137-b171-b10d08c44722 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:53.302973 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-b00996fc-75db-4137-b171-b10d08c44722 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] HTTP exception thrown: Instance 6a79a761-e10f-4a8d-8e33-a21c08c81184 could not be found. Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b00996fc-75db-4137-b171-b10d08c44722 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Request method failure captured: Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 HTTP/1.1 Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJXoG6-UKDd9auDnzRVlkQ2zkHgW8odihP0OMPkk3MkQzP1iYAQeSLWa3_nBbe64sCGvORDOOctsBAz0GOq1EIDZXpFzKkPlAWbyoSnVA9HbDyOFDBRBWmjMCnBXT25QcAIdCS8c7ut6W0v9Gq-r1pDCwvRALfmH54avwg2SRXKJw1k Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: cb1c877c178847ad8e652dda9a20e724 Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-LiveMigrationTest-268263720 Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cb1c877c178847ad8e652dda9a20e724"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cb1c877c178847ad8e652dda9a20e724"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_cb1c877c178847ad8e652dda9a20e724"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/cb1c877c178847ad8e652dda9a20e724"}]}] Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-LiveMigrationTest-268263720 Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: cb1c877c178847ad8e652dda9a20e724 Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-LiveMigrationTest-268263720 Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-LiveMigrationTest-268263720-project Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 68198185a8314417b2b5d09e831ff4fd Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-LiveMigrationTest-268263720-project Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 6a79a761-e10f-4a8d-8e33-a21c08c81184 could not be found. Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '6a79a761-e10f-4a8d-8e33-a21c08c81184'} Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a79a761-e10f-4a8d-8e33-a21c08c81184 could not be found. Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a79a761-e10f-4a8d-8e33-a21c08c81184 could not be found. Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:53.308861 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:53.313956 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:53.313956 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:53.313956 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:53.313956 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:01:53.313956 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:01:53.313956 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a79a761-e10f-4a8d-8e33-a21c08c81184 could not be found. Oct 29 03:01:53.313956 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:53.315766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b00996fc-75db-4137-b171-b10d08c44722 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Returning 404 to user: Instance 6a79a761-e10f-4a8d-8e33-a21c08c81184 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:01:53.316843 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b00996fc-75db-4137-b171-b10d08c44722 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184" status: 404 len: 111 microversion: 2.1 time: 0.125308 Oct 29 03:01:53.323346 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1787/3399] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:53 2022] GET /compute/v2.1/servers/6a79a761-e10f-4a8d-8e33-a21c08c81184 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:01:53.346275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3a12044f-1524-4569-8f2a-1706cc827c8a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:53.349129 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3a12044f-1524-4569-8f2a-1706cc827c8a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:53.363587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a12044f-1524-4569-8f2a-1706cc827c8a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:53.366335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a12044f-1524-4569-8f2a-1706cc827c8a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:53.368808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a12044f-1524-4569-8f2a-1706cc827c8a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:53.369742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a12044f-1524-4569-8f2a-1706cc827c8a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:53.370372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a12044f-1524-4569-8f2a-1706cc827c8a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:53.380426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a12044f-1524-4569-8f2a-1706cc827c8a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:53.463370 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3a12044f-1524-4569-8f2a-1706cc827c8a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:01:53.503201 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-116cb698-ab26-46ef-a4b7-44fcc1a73627 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:53.512357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-116cb698-ab26-46ef-a4b7-44fcc1a73627 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:53.513857 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-116cb698-ab26-46ef-a4b7-44fcc1a73627 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:53.522277 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-116cb698-ab26-46ef-a4b7-44fcc1a73627 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1656 microversion: 2.20 time: 0.825306 Oct 29 03:01:53.523244 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1613/3400] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:52 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1656 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:53.696620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6785dddc-594c-4065-85c4-3b0c3e2f764c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:53.697406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6785dddc-594c-4065-85c4-3b0c3e2f764c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 6c51228f-b19b-4028-8c23-38cb4c0e1ad9] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:53.719402 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6785dddc-594c-4065-85c4-3b0c3e2f764c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:53.722468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6785dddc-594c-4065-85c4-3b0c3e2f764c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:53.728074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6785dddc-594c-4065-85c4-3b0c3e2f764c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:53.728917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6785dddc-594c-4065-85c4-3b0c3e2f764c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:53.729390 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6785dddc-594c-4065-85c4-3b0c3e2f764c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:53.735492 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6785dddc-594c-4065-85c4-3b0c3e2f764c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:53.758644 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3a12044f-1524-4569-8f2a-1706cc827c8a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "DELETE /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 204 len: 0 microversion: 2.1 time: 0.433506 Oct 29 03:01:53.759777 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1788/3401] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:01:53 2022] DELETE /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:01:53.776177 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6ea514de-a38f-4e43-a4cd-21d9608aaa59 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:53.786076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6ea514de-a38f-4e43-a4cd-21d9608aaa59 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:53.810211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ea514de-a38f-4e43-a4cd-21d9608aaa59 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:53.810835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ea514de-a38f-4e43-a4cd-21d9608aaa59 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:53.811536 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ea514de-a38f-4e43-a4cd-21d9608aaa59 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:53.814248 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ea514de-a38f-4e43-a4cd-21d9608aaa59 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:53.816121 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ea514de-a38f-4e43-a4cd-21d9608aaa59 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:53.816972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ea514de-a38f-4e43-a4cd-21d9608aaa59 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:54.572962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6ea514de-a38f-4e43-a4cd-21d9608aaa59 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:54.587859 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6ea514de-a38f-4e43-a4cd-21d9608aaa59 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1495 microversion: 2.1 time: 0.820034 Oct 29 03:01:54.592894 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1789/3402] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:53 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1495 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:54.601760 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-03ad64cc-e5b3-48a0-9586-86c94e17371b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:54.616515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-03ad64cc-e5b3-48a0-9586-86c94e17371b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:54.631114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03ad64cc-e5b3-48a0-9586-86c94e17371b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:54.632173 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03ad64cc-e5b3-48a0-9586-86c94e17371b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:54.641178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03ad64cc-e5b3-48a0-9586-86c94e17371b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:54.642362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03ad64cc-e5b3-48a0-9586-86c94e17371b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:54.642480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03ad64cc-e5b3-48a0-9586-86c94e17371b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:54.643153 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03ad64cc-e5b3-48a0-9586-86c94e17371b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:54.824100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-03ad64cc-e5b3-48a0-9586-86c94e17371b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:54.836387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-03ad64cc-e5b3-48a0-9586-86c94e17371b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:54.862139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-03ad64cc-e5b3-48a0-9586-86c94e17371b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:54.863743 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-03ad64cc-e5b3-48a0-9586-86c94e17371b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1656 microversion: 2.20 time: 0.269587 Oct 29 03:01:54.864855 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1790/3403] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:54 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1656 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:55.203988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-f7cbafe8-00bc-4f4d-811f-5f9699856515 req-fb86fb0f-1073-4a06-88bb-fd3305b17ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ab56816-cc78-4e73-918a-4c76895fed6b", "name": "network-vif-deleted", "tag": "dbe9ee0b-c11e-4edb-a1e4-5c86a11499da"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:01:55.229318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:55.230461 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:55.234284 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f7cbafe8-00bc-4f4d-811f-5f9699856515 req-fb86fb0f-1073-4a06-88bb-fd3305b17ab1 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:55.237271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f7cbafe8-00bc-4f4d-811f-5f9699856515 req-fb86fb0f-1073-4a06-88bb-fd3305b17ab1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:55.243224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f7cbafe8-00bc-4f4d-811f-5f9699856515 req-fb86fb0f-1073-4a06-88bb-fd3305b17ab1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:55.290932 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-f7cbafe8-00bc-4f4d-811f-5f9699856515 req-fb86fb0f-1073-4a06-88bb-fd3305b17ab1 service nova] Creating event network-vif-deleted:dbe9ee0b-c11e-4edb-a1e4-5c86a11499da for instance 1ab56816-cc78-4e73-918a-4c76895fed6b on n-h1-862967-2 Oct 29 03:01:55.299483 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-f7cbafe8-00bc-4f4d-811f-5f9699856515 req-fb86fb0f-1073-4a06-88bb-fd3305b17ab1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098836 Oct 29 03:01:55.303777 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1791/3404] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:01:55.365946 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:55.615771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-32a75335-b3db-4622-9ff4-d49c2fb4b530 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:55.617534 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-32a75335-b3db-4622-9ff4-d49c2fb4b530 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:55.636457 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32a75335-b3db-4622-9ff4-d49c2fb4b530 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:55.644315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32a75335-b3db-4622-9ff4-d49c2fb4b530 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:55.645213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32a75335-b3db-4622-9ff4-d49c2fb4b530 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:55.646249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32a75335-b3db-4622-9ff4-d49c2fb4b530 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:55.648557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32a75335-b3db-4622-9ff4-d49c2fb4b530 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:55.649260 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32a75335-b3db-4622-9ff4-d49c2fb4b530 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:56.223887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6785dddc-594c-4065-85c4-3b0c3e2f764c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:56.251162 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6785dddc-594c-4065-85c4-3b0c3e2f764c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9" status: 200 len: 1305 microversion: 2.1 time: 2.559431 Oct 29 03:01:56.257824 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1614/3405] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:53 2022] GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9 => generated 1305 bytes in 2566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:56.271359 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-91eed86f-c792-4525-af0c-6c7ff56d44b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:56.281461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-91eed86f-c792-4525-af0c-6c7ff56d44b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:56.325104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91eed86f-c792-4525-af0c-6c7ff56d44b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:56.327684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91eed86f-c792-4525-af0c-6c7ff56d44b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:56.330665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91eed86f-c792-4525-af0c-6c7ff56d44b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:56.340030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91eed86f-c792-4525-af0c-6c7ff56d44b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:56.340870 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91eed86f-c792-4525-af0c-6c7ff56d44b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:56.344989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91eed86f-c792-4525-af0c-6c7ff56d44b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:56.487786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91eed86f-c792-4525-af0c-6c7ff56d44b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:56.488918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91eed86f-c792-4525-af0c-6c7ff56d44b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:56.495103 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91eed86f-c792-4525-af0c-6c7ff56d44b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:56.496235 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-91eed86f-c792-4525-af0c-6c7ff56d44b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lazy-loading 'fault' on Instance uuid 1ab56816-cc78-4e73-918a-4c76895fed6b {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:01:56.664413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-32a75335-b3db-4622-9ff4-d49c2fb4b530 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:56.680238 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-32a75335-b3db-4622-9ff4-d49c2fb4b530 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1495 microversion: 2.1 time: 1.069704 Oct 29 03:01:56.697339 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1792/3406] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:55 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1495 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:57.242887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-91eed86f-c792-4525-af0c-6c7ff56d44b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:57.281302 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-903ade0e-b3de-404a-85e3-ed5a25c88d75 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:57.282010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-903ade0e-b3de-404a-85e3-ed5a25c88d75 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 6c51228f-b19b-4028-8c23-38cb4c0e1ad9] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:57.287235 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-91eed86f-c792-4525-af0c-6c7ff56d44b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:57.292948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-91eed86f-c792-4525-af0c-6c7ff56d44b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:57.302954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-903ade0e-b3de-404a-85e3-ed5a25c88d75 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:57.306218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-903ade0e-b3de-404a-85e3-ed5a25c88d75 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:57.306807 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-91eed86f-c792-4525-af0c-6c7ff56d44b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 200 len: 1371 microversion: 2.20 time: 1.043572 Oct 29 03:01:57.308313 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-903ade0e-b3de-404a-85e3-ed5a25c88d75 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:57.310415 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1615/3407] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:56 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 1371 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:01:57.312862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-903ade0e-b3de-404a-85e3-ed5a25c88d75 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:57.315566 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-903ade0e-b3de-404a-85e3-ed5a25c88d75 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:57.318557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-903ade0e-b3de-404a-85e3-ed5a25c88d75 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:57.707091 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ccd5f626-c8ad-47bd-8b77-8c97e4fcce20 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:57.708333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ccd5f626-c8ad-47bd-8b77-8c97e4fcce20 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:57.761174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ccd5f626-c8ad-47bd-8b77-8c97e4fcce20 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:57.767243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ccd5f626-c8ad-47bd-8b77-8c97e4fcce20 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:57.767875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ccd5f626-c8ad-47bd-8b77-8c97e4fcce20 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:57.773268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ccd5f626-c8ad-47bd-8b77-8c97e4fcce20 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:57.773781 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ccd5f626-c8ad-47bd-8b77-8c97e4fcce20 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:57.776927 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ccd5f626-c8ad-47bd-8b77-8c97e4fcce20 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:58.220103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-903ade0e-b3de-404a-85e3-ed5a25c88d75 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:58.231705 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-903ade0e-b3de-404a-85e3-ed5a25c88d75 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9" status: 200 len: 1305 microversion: 2.1 time: 0.955631 Oct 29 03:01:58.257416 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1793/3408] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:57 2022] GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9 => generated 1305 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:01:58.334419 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2db835c7-f55d-43d1-9362-05516aa0f6e4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:58.335334 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2db835c7-f55d-43d1-9362-05516aa0f6e4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:58.368151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2db835c7-f55d-43d1-9362-05516aa0f6e4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:58.371958 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2db835c7-f55d-43d1-9362-05516aa0f6e4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:58.372746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2db835c7-f55d-43d1-9362-05516aa0f6e4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:58.373776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2db835c7-f55d-43d1-9362-05516aa0f6e4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:58.376633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2db835c7-f55d-43d1-9362-05516aa0f6e4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:58.377406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2db835c7-f55d-43d1-9362-05516aa0f6e4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:58.424710 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-2db835c7-f55d-43d1-9362-05516aa0f6e4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] HTTP exception thrown: Instance 1ab56816-cc78-4e73-918a-4c76895fed6b could not be found. Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2db835c7-f55d-43d1-9362-05516aa0f6e4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Request method failure captured: Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b HTTP/1.1 Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJaJHSXj-jqWtpuO19W_zKp1iKYpA1BxBdNPSEMxYnt5c-nWuInn2vhByoiyD50ujDbOWsEZgXQWvn1TdiZKPWXgOO222e5DgFFL5-_ptnqVjJ04ZUyvB4BJC1Pm_vqIkFGDupuRaHR-jseufm1Kp1jX7ZqMA9hUVj92Fx4vSSIHYDA Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: X-Openstack-Nova-Api-Version: 2.20 Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 746258dc83c74b9ba3634afbc2716d7b Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2053223102 Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/746258dc83c74b9ba3634afbc2716d7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/746258dc83c74b9ba3634afbc2716d7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_746258dc83c74b9ba3634afbc2716d7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/746258dc83c74b9ba3634afbc2716d7b"}]}] Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2053223102 Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 746258dc83c74b9ba3634afbc2716d7b Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2053223102 Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-AttachVolumeShelveTestJSON-2053223102-project Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 4dbcac917fc6415683ae17b220276c91 Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2053223102-project Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 1ab56816-cc78-4e73-918a-4c76895fed6b could not be found. Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '1ab56816-cc78-4e73-918a-4c76895fed6b'} Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ab56816-cc78-4e73-918a-4c76895fed6b could not be found. Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ab56816-cc78-4e73-918a-4c76895fed6b could not be found. Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:58.429271 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:01:58.434959 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:58.434959 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:01:58.434959 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:01:58.434959 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:01:58.434959 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:01:58.434959 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:01:58.434959 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ab56816-cc78-4e73-918a-4c76895fed6b could not be found. Oct 29 03:01:58.434959 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:01:58.448198 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2db835c7-f55d-43d1-9362-05516aa0f6e4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Returning 404 to user: Instance 1ab56816-cc78-4e73-918a-4c76895fed6b could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:01:58.449420 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2db835c7-f55d-43d1-9362-05516aa0f6e4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 404 len: 111 microversion: 2.20 time: 0.119343 Oct 29 03:01:58.452881 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1794/3409] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:01:58 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:01:58.468934 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2ec35c7c-33be-4280-9403-a819127ea4fd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '.version_select at 0x7ff058160ee0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:58.529973 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2ec35c7c-33be-4280-9403-a819127ea4fd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188994911" status: 204 len: 0 microversion: 2.20 time: 0.074851 Oct 29 03:01:58.533770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ccd5f626-c8ad-47bd-8b77-8c97e4fcce20 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:58.539061 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1795/3410] 10.222.0.46 () {60 vars in 1262 bytes} [Sat Oct 29 03:01:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188994911 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:01:58.554548 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ccd5f626-c8ad-47bd-8b77-8c97e4fcce20 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1495 microversion: 2.1 time: 0.852074 Oct 29 03:01:58.568689 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1616/3411] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:57 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1495 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:01:59.275169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ad492231-c3fe-43ec-8ba3-7d6b355c9edb tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:59.275915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ad492231-c3fe-43ec-8ba3-7d6b355c9edb tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 6c51228f-b19b-4028-8c23-38cb4c0e1ad9] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:59.293440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad492231-c3fe-43ec-8ba3-7d6b355c9edb tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:59.294022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad492231-c3fe-43ec-8ba3-7d6b355c9edb tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:59.294368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad492231-c3fe-43ec-8ba3-7d6b355c9edb tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:59.295146 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad492231-c3fe-43ec-8ba3-7d6b355c9edb tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:59.302200 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad492231-c3fe-43ec-8ba3-7d6b355c9edb tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:59.303752 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad492231-c3fe-43ec-8ba3-7d6b355c9edb tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:59.587921 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0f8841f7-be4a-408f-b0f4-8bee6cf0f93d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:01:59.596737 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0f8841f7-be4a-408f-b0f4-8bee6cf0f93d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:01:59.616598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f8841f7-be4a-408f-b0f4-8bee6cf0f93d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:59.617101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f8841f7-be4a-408f-b0f4-8bee6cf0f93d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:59.617586 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f8841f7-be4a-408f-b0f4-8bee6cf0f93d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:59.618301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f8841f7-be4a-408f-b0f4-8bee6cf0f93d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:01:59.618808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f8841f7-be4a-408f-b0f4-8bee6cf0f93d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:01:59.619233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f8841f7-be4a-408f-b0f4-8bee6cf0f93d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:01:59.960992 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ad492231-c3fe-43ec-8ba3-7d6b355c9edb tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:01:59.970426 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ad492231-c3fe-43ec-8ba3-7d6b355c9edb tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9" status: 200 len: 1305 microversion: 2.1 time: 0.702664 Oct 29 03:01:59.978665 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1796/3412] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:59 2022] GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9 => generated 1305 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:00.225173 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-f1dc962c-744a-40d6-b5bc-2dcdd0696b1c req-94f9c2b8-c70b-402e-aeb6-9fc8075615a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afb9891b-c60a-4106-b2ed-b26d1ff0a459", "name": "network-vif-deleted", "tag": "1c4eed69-bcd2-4a8f-87a2-773d5291f3db"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:00.261190 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f1dc962c-744a-40d6-b5bc-2dcdd0696b1c req-94f9c2b8-c70b-402e-aeb6-9fc8075615a8 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:00.263370 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f1dc962c-744a-40d6-b5bc-2dcdd0696b1c req-94f9c2b8-c70b-402e-aeb6-9fc8075615a8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:00.264052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f1dc962c-744a-40d6-b5bc-2dcdd0696b1c req-94f9c2b8-c70b-402e-aeb6-9fc8075615a8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:00.333055 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-f1dc962c-744a-40d6-b5bc-2dcdd0696b1c req-94f9c2b8-c70b-402e-aeb6-9fc8075615a8 service nova] Creating event network-vif-deleted:1c4eed69-bcd2-4a8f-87a2-773d5291f3db for instance afb9891b-c60a-4106-b2ed-b26d1ff0a459 on n-h2-862967-2 Oct 29 03:02:00.356659 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-f1dc962c-744a-40d6-b5bc-2dcdd0696b1c req-94f9c2b8-c70b-402e-aeb6-9fc8075615a8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132560 Oct 29 03:02:00.360489 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1797/3413] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:02:00.567980 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0f8841f7-be4a-408f-b0f4-8bee6cf0f93d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:00.585710 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0f8841f7-be4a-408f-b0f4-8bee6cf0f93d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 200 len: 1453 microversion: 2.1 time: 1.001491 Oct 29 03:02:00.599598 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1617/3414] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:01:59 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 1453 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:01.003763 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-af59c171-fc0f-453b-8684-9f07dbbfd5e0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:01.004552 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-af59c171-fc0f-453b-8684-9f07dbbfd5e0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 6c51228f-b19b-4028-8c23-38cb4c0e1ad9] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:01.053319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af59c171-fc0f-453b-8684-9f07dbbfd5e0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:01.053815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af59c171-fc0f-453b-8684-9f07dbbfd5e0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:01.054287 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af59c171-fc0f-453b-8684-9f07dbbfd5e0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:01.055191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af59c171-fc0f-453b-8684-9f07dbbfd5e0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:01.078646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af59c171-fc0f-453b-8684-9f07dbbfd5e0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:01.081614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af59c171-fc0f-453b-8684-9f07dbbfd5e0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:01.621151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5dc2c5e8-553f-4946-bfa3-ea4e854318f3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:01.622201 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5dc2c5e8-553f-4946-bfa3-ea4e854318f3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:01.645867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5dc2c5e8-553f-4946-bfa3-ea4e854318f3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:01.651946 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5dc2c5e8-553f-4946-bfa3-ea4e854318f3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:01.654706 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5dc2c5e8-553f-4946-bfa3-ea4e854318f3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:01.658296 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5dc2c5e8-553f-4946-bfa3-ea4e854318f3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:01.661354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5dc2c5e8-553f-4946-bfa3-ea4e854318f3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:01.667431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5dc2c5e8-553f-4946-bfa3-ea4e854318f3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:01.726078 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-5dc2c5e8-553f-4946-bfa3-ea4e854318f3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] HTTP exception thrown: Instance afb9891b-c60a-4106-b2ed-b26d1ff0a459 could not be found. Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5dc2c5e8-553f-4946-bfa3-ea4e854318f3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Request method failure captured: Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 HTTP/1.1 Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJaEy18RgNLoRH_Cx5N19ntl_MZAWseAedf6nDvdLqq5Uv9fWq711j0XNb6BgsjwGmwVkwDsYZqRqnlQy1v9Czdk1P2JZBE7MuExsRjBvQLnTgLkLacVPY3yLp9R5pSFE5uStbCf24z3K2C9Y_7prmanNUiQJvOS6fzPpIe1j-F47IQ Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b67fc8dd1f4349ca85422bd9a08d3e06"}]}] Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 1ee6c4d28f304eab89014b9c46cc555a Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance afb9891b-c60a-4106-b2ed-b26d1ff0a459 could not be found. Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'afb9891b-c60a-4106-b2ed-b26d1ff0a459'} Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afb9891b-c60a-4106-b2ed-b26d1ff0a459 could not be found. Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afb9891b-c60a-4106-b2ed-b26d1ff0a459 could not be found. Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:01.728251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:01.732724 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:01.732724 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:01.732724 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:01.732724 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:01.732724 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:01.732724 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afb9891b-c60a-4106-b2ed-b26d1ff0a459 could not be found. Oct 29 03:02:01.732724 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:01.752591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5dc2c5e8-553f-4946-bfa3-ea4e854318f3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Returning 404 to user: Instance afb9891b-c60a-4106-b2ed-b26d1ff0a459 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:01.765069 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5dc2c5e8-553f-4946-bfa3-ea4e854318f3 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 404 len: 111 microversion: 2.1 time: 0.145321 Oct 29 03:02:01.766981 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1618/3415] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:01 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:02:02.246139 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-18e15f72-6978-446e-9397-064b12bd724c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2104726555", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "2f016d14-d67d-40f5-811c-d451a32578a4"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:02.486596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-18e15f72-6978-446e-9397-064b12bd724c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] validate_networks() for [('2f016d14-d67d-40f5-811c-d451a32578a4', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:02:02.775445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-af59c171-fc0f-453b-8684-9f07dbbfd5e0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:02.804469 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-af59c171-fc0f-453b-8684-9f07dbbfd5e0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9" status: 200 len: 1305 microversion: 2.1 time: 1.805802 Oct 29 03:02:02.812513 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1798/3416] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:00 2022] GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9 => generated 1305 bytes in 1808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:02.844170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-9bf0cf2d-bd82-4c57-ac18-10855d567f4e req-ec9681ea-118f-4914-8a39-b00f4ef57845 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c51228f-b19b-4028-8c23-38cb4c0e1ad9", "tag": "5f16a572-3cd3-43e8-8cd6-c38e3a2ee0c1"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:02.945514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9bf0cf2d-bd82-4c57-ac18-10855d567f4e req-ec9681ea-118f-4914-8a39-b00f4ef57845 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:02.947389 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9bf0cf2d-bd82-4c57-ac18-10855d567f4e req-ec9681ea-118f-4914-8a39-b00f4ef57845 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:02.951365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9bf0cf2d-bd82-4c57-ac18-10855d567f4e req-ec9681ea-118f-4914-8a39-b00f4ef57845 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:03.011583 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-9bf0cf2d-bd82-4c57-ac18-10855d567f4e req-ec9681ea-118f-4914-8a39-b00f4ef57845 service nova] Creating event network-changed:5f16a572-3cd3-43e8-8cd6-c38e3a2ee0c1 for instance 6c51228f-b19b-4028-8c23-38cb4c0e1ad9 on n-h1-862967-2 Oct 29 03:02:03.033919 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-9bf0cf2d-bd82-4c57-ac18-10855d567f4e req-ec9681ea-118f-4914-8a39-b00f4ef57845 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215007 Oct 29 03:02:03.035011 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1799/3417] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:03.059665 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e85bbe10-c8c7-4989-b136-16f94150efc3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Action: 'create', calling method: .version_select at 0x7ff0580c25e0>, body: {"keypair": {"name": "tempest-keypair-1900859268", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQn2g1kQR+NsJYZYGhSFzPjvmbPMdvpu9C9hh9qoBJ27AVaakSaNrs02yTgyk8KiT+Lw5fLYHBGJsVuHuAOTDaqYdc1mHeIYC96gEcKtnuMXPhJbVfbQCL896FDH8LGXQ=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:03.109587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:03.144034 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-e85bbe10-c8c7-4989-b136-16f94150efc3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Getting quotas for project 746258dc83c74b9ba3634afbc2716d7b. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:02:03.177566 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-e85bbe10-c8c7-4989-b136-16f94150efc3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Getting quotas for user 4dbcac917fc6415683ae17b220276c91 and project 746258dc83c74b9ba3634afbc2716d7b. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:02:03.293313 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e85bbe10-c8c7-4989-b136-16f94150efc3 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.254334 Oct 29 03:02:03.293959 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1800/3418] 10.222.0.46 () {62 vars in 1200 bytes} [Sat Oct 29 03:02:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 256 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 03:02:03.841714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8a1c096c-bc73-4ad7-9127-60a314272dcf tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:03.842504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8a1c096c-bc73-4ad7-9127-60a314272dcf tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 6c51228f-b19b-4028-8c23-38cb4c0e1ad9] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:03.864505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8a1c096c-bc73-4ad7-9127-60a314272dcf tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:03.873212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8a1c096c-bc73-4ad7-9127-60a314272dcf tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:03.879340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8a1c096c-bc73-4ad7-9127-60a314272dcf tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:03.883382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8a1c096c-bc73-4ad7-9127-60a314272dcf tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:03.885963 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8a1c096c-bc73-4ad7-9127-60a314272dcf tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:03.888712 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8a1c096c-bc73-4ad7-9127-60a314272dcf tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:04.665447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8a1c096c-bc73-4ad7-9127-60a314272dcf tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:04.676796 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:04.679316 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8a1c096c-bc73-4ad7-9127-60a314272dcf tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9" status: 200 len: 1305 microversion: 2.1 time: 0.847665 Oct 29 03:02:04.679969 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1801/3419] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:03 2022] GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9 => generated 1305 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:04.692756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-26fd2d63-3d35-49a1-8cbb-db9055447a00 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:04.692756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-26fd2d63-3d35-49a1-8cbb-db9055447a00 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:04.720149 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-26fd2d63-3d35-49a1-8cbb-db9055447a00 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:04.720916 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-26fd2d63-3d35-49a1-8cbb-db9055447a00 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:04.730194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-26fd2d63-3d35-49a1-8cbb-db9055447a00 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:04.732563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-26fd2d63-3d35-49a1-8cbb-db9055447a00 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:04.741338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-26fd2d63-3d35-49a1-8cbb-db9055447a00 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:04.742398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-26fd2d63-3d35-49a1-8cbb-db9055447a00 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:04.816361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-26fd2d63-3d35-49a1-8cbb-db9055447a00 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:02:04.997198 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-26fd2d63-3d35-49a1-8cbb-db9055447a00 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 204 len: 0 microversion: 2.1 time: 0.314287 Oct 29 03:02:05.000427 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1802/3420] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:02:04 2022] DELETE /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:02:05.017738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d9bd54ec-f746-4e29-928d-f857346306db tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:05.021627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d9bd54ec-f746-4e29-928d-f857346306db tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:05.037261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d9bd54ec-f746-4e29-928d-f857346306db tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:05.040819 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d9bd54ec-f746-4e29-928d-f857346306db tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:05.041676 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d9bd54ec-f746-4e29-928d-f857346306db tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:05.042682 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d9bd54ec-f746-4e29-928d-f857346306db tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:05.045142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d9bd54ec-f746-4e29-928d-f857346306db tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:05.046204 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d9bd54ec-f746-4e29-928d-f857346306db tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:05.451617 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d9bd54ec-f746-4e29-928d-f857346306db tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:05.465493 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d9bd54ec-f746-4e29-928d-f857346306db tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1668 microversion: 2.1 time: 0.460699 Oct 29 03:02:05.482918 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1803/3421] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:05 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1668 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:05.707790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6b4dd2ed-0e2d-422f-bc05-5256a7b8e23b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:05.708940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6b4dd2ed-0e2d-422f-bc05-5256a7b8e23b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 6c51228f-b19b-4028-8c23-38cb4c0e1ad9] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:05.724179 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b4dd2ed-0e2d-422f-bc05-5256a7b8e23b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:05.725058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b4dd2ed-0e2d-422f-bc05-5256a7b8e23b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:05.725789 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b4dd2ed-0e2d-422f-bc05-5256a7b8e23b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:05.726792 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b4dd2ed-0e2d-422f-bc05-5256a7b8e23b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:05.731432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b4dd2ed-0e2d-422f-bc05-5256a7b8e23b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:05.732055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b4dd2ed-0e2d-422f-bc05-5256a7b8e23b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:05.978397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-18e15f72-6978-446e-9397-064b12bd724c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:02:05.978918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-18e15f72-6978-446e-9397-064b12bd724c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:02:05.979281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-18e15f72-6978-446e-9397-064b12bd724c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:02:05.980611 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-18e15f72-6978-446e-9397-064b12bd724c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:02:05.980611 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-18e15f72-6978-446e-9397-064b12bd724c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:02:06.009112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18e15f72-6978-446e-9397-064b12bd724c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:06.011847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18e15f72-6978-446e-9397-064b12bd724c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:06.013946 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18e15f72-6978-446e-9397-064b12bd724c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:06.015040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18e15f72-6978-446e-9397-064b12bd724c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:06.022661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6b4dd2ed-0e2d-422f-bc05-5256a7b8e23b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:06.032479 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6b4dd2ed-0e2d-422f-bc05-5256a7b8e23b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9" status: 200 len: 1305 microversion: 2.1 time: 0.328895 Oct 29 03:02:06.033545 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18e15f72-6978-446e-9397-064b12bd724c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:06.033993 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1804/3422] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:05 2022] GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9 => generated 1305 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:02:06.038477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18e15f72-6978-446e-9397-064b12bd724c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:06.101392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-18e15f72-6978-446e-9397-064b12bd724c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Getting quotas for project b67fc8dd1f4349ca85422bd9a08d3e06. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:02:06.112397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-18e15f72-6978-446e-9397-064b12bd724c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Getting quotas for user 1ee6c4d28f304eab89014b9c46cc555a and project b67fc8dd1f4349ca85422bd9a08d3e06. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:02:06.144807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-18e15f72-6978-446e-9397-064b12bd724c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:02:06.147598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-18e15f72-6978-446e-9397-064b12bd724c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 35982880-caba-4b90-80e1-3561ee53888b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:02:06.250171 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-18e15f72-6978-446e-9397-064b12bd724c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.000558 Oct 29 03:02:06.251667 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1619/3423] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:02:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 4011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:02:06.268557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ce0934aa-eee5-4089-b515-28ee28040533 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:06.271784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ce0934aa-eee5-4089-b515-28ee28040533 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 35982880-caba-4b90-80e1-3561ee53888b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:06.489765 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0810bb53-fa07-4e6c-bb03-f55600f50525 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:06.490121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0810bb53-fa07-4e6c-bb03-f55600f50525 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:06.510055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0810bb53-fa07-4e6c-bb03-f55600f50525 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:06.513328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0810bb53-fa07-4e6c-bb03-f55600f50525 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:06.514857 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0810bb53-fa07-4e6c-bb03-f55600f50525 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:06.517502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0810bb53-fa07-4e6c-bb03-f55600f50525 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:06.520511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0810bb53-fa07-4e6c-bb03-f55600f50525 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:06.521179 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0810bb53-fa07-4e6c-bb03-f55600f50525 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:06.885399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ce0934aa-eee5-4089-b515-28ee28040533 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:06.895861 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ce0934aa-eee5-4089-b515-28ee28040533 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b" status: 200 len: 1215 microversion: 2.1 time: 0.635941 Oct 29 03:02:06.901780 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1805/3424] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:06 2022] GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b => generated 1215 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:07.063086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9ae98f54-5ab9-45cc-99fb-6463fa53dfe8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:07.066081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9ae98f54-5ab9-45cc-99fb-6463fa53dfe8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 6c51228f-b19b-4028-8c23-38cb4c0e1ad9] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:07.081747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ae98f54-5ab9-45cc-99fb-6463fa53dfe8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:07.083842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ae98f54-5ab9-45cc-99fb-6463fa53dfe8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:07.084635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ae98f54-5ab9-45cc-99fb-6463fa53dfe8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:07.086408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ae98f54-5ab9-45cc-99fb-6463fa53dfe8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:07.087557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ae98f54-5ab9-45cc-99fb-6463fa53dfe8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:07.088312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ae98f54-5ab9-45cc-99fb-6463fa53dfe8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:07.484091 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0810bb53-fa07-4e6c-bb03-f55600f50525 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:07.531560 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0810bb53-fa07-4e6c-bb03-f55600f50525 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1668 microversion: 2.1 time: 1.045855 Oct 29 03:02:07.539211 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1620/3425] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:06 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1668 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:02:07.572463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9ae98f54-5ab9-45cc-99fb-6463fa53dfe8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:07.595977 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9ae98f54-5ab9-45cc-99fb-6463fa53dfe8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9" status: 200 len: 1305 microversion: 2.1 time: 0.540565 Oct 29 03:02:07.599732 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1806/3426] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:07 2022] GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9 => generated 1305 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:07.920740 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3a103bf3-f609-4493-aca2-14ef63cd439d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:07.921694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3a103bf3-f609-4493-aca2-14ef63cd439d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 35982880-caba-4b90-80e1-3561ee53888b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:07.930823 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a103bf3-f609-4493-aca2-14ef63cd439d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:07.931694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a103bf3-f609-4493-aca2-14ef63cd439d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:07.932324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a103bf3-f609-4493-aca2-14ef63cd439d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:07.933229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a103bf3-f609-4493-aca2-14ef63cd439d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:07.933961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a103bf3-f609-4493-aca2-14ef63cd439d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:07.934545 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a103bf3-f609-4493-aca2-14ef63cd439d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:08.565959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5c23cf39-e529-4255-bd2c-61bbf8d402ed tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:08.566801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5c23cf39-e529-4255-bd2c-61bbf8d402ed tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:08.578725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c23cf39-e529-4255-bd2c-61bbf8d402ed tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:08.581972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c23cf39-e529-4255-bd2c-61bbf8d402ed tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:08.582845 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c23cf39-e529-4255-bd2c-61bbf8d402ed tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:08.585396 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c23cf39-e529-4255-bd2c-61bbf8d402ed tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:08.586138 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c23cf39-e529-4255-bd2c-61bbf8d402ed tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:08.590101 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c23cf39-e529-4255-bd2c-61bbf8d402ed tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:08.817084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3a103bf3-f609-4493-aca2-14ef63cd439d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:08.846390 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3a103bf3-f609-4493-aca2-14ef63cd439d tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b" status: 200 len: 1267 microversion: 2.1 time: 0.930193 Oct 29 03:02:08.849468 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1621/3427] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:07 2022] GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b => generated 1267 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:08.857002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-28132366-46c7-4cf3-9250-e733f06bb1d3 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:08.857950 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-28132366-46c7-4cf3-9250-e733f06bb1d3 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 6c51228f-b19b-4028-8c23-38cb4c0e1ad9] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:08.867173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28132366-46c7-4cf3-9250-e733f06bb1d3 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:08.868746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28132366-46c7-4cf3-9250-e733f06bb1d3 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:08.869557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28132366-46c7-4cf3-9250-e733f06bb1d3 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:08.870553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28132366-46c7-4cf3-9250-e733f06bb1d3 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:08.871230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28132366-46c7-4cf3-9250-e733f06bb1d3 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:08.871959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28132366-46c7-4cf3-9250-e733f06bb1d3 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:08.938494 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5c23cf39-e529-4255-bd2c-61bbf8d402ed tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:08.951432 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5c23cf39-e529-4255-bd2c-61bbf8d402ed tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1668 microversion: 2.1 time: 0.391844 Oct 29 03:02:08.972986 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1807/3428] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:08 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1668 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:02:09.746833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-28132366-46c7-4cf3-9250-e733f06bb1d3 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:09.763685 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-28132366-46c7-4cf3-9250-e733f06bb1d3 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9" status: 200 len: 1305 microversion: 2.1 time: 0.911777 Oct 29 03:02:09.765789 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1622/3429] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:08 2022] GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9 => generated 1305 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:09.978707 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f9511036-3c6f-4b3e-b092-7abedd7dbe71 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:09.979495 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f9511036-3c6f-4b3e-b092-7abedd7dbe71 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:09.999720 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9511036-3c6f-4b3e-b092-7abedd7dbe71 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:10.000595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9511036-3c6f-4b3e-b092-7abedd7dbe71 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:10.001382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9511036-3c6f-4b3e-b092-7abedd7dbe71 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:10.002494 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9511036-3c6f-4b3e-b092-7abedd7dbe71 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:10.003281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9511036-3c6f-4b3e-b092-7abedd7dbe71 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:10.003965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9511036-3c6f-4b3e-b092-7abedd7dbe71 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:10.241209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-713d9241-9290-4d51-b169-8db975030994 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:10.242445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-713d9241-9290-4d51-b169-8db975030994 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 35982880-caba-4b90-80e1-3561ee53888b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:10.249961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-713d9241-9290-4d51-b169-8db975030994 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:10.250697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-713d9241-9290-4d51-b169-8db975030994 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:10.251297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-713d9241-9290-4d51-b169-8db975030994 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:10.252314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-713d9241-9290-4d51-b169-8db975030994 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:10.252971 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-713d9241-9290-4d51-b169-8db975030994 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:10.253649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-713d9241-9290-4d51-b169-8db975030994 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:10.408437 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f9511036-3c6f-4b3e-b092-7abedd7dbe71 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:10.421777 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f9511036-3c6f-4b3e-b092-7abedd7dbe71 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1600 microversion: 2.1 time: 0.446719 Oct 29 03:02:10.424633 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1623/3430] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:09 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1600 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:02:10.539039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-bd161130-1521-4797-a961-5d6fccc9ceaf req-699d3fd3-2ff2-4b7f-8219-e0cd252cd2cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c51228f-b19b-4028-8c23-38cb4c0e1ad9", "name": "network-vif-plugged", "status": "completed", "tag": "5f16a572-3cd3-43e8-8cd6-c38e3a2ee0c1"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:10.562254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-bd161130-1521-4797-a961-5d6fccc9ceaf req-699d3fd3-2ff2-4b7f-8219-e0cd252cd2cc service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:10.562784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-bd161130-1521-4797-a961-5d6fccc9ceaf req-699d3fd3-2ff2-4b7f-8219-e0cd252cd2cc service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:10.564078 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-bd161130-1521-4797-a961-5d6fccc9ceaf req-699d3fd3-2ff2-4b7f-8219-e0cd252cd2cc service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:10.604838 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-bd161130-1521-4797-a961-5d6fccc9ceaf req-699d3fd3-2ff2-4b7f-8219-e0cd252cd2cc service nova] Creating event network-vif-plugged:5f16a572-3cd3-43e8-8cd6-c38e3a2ee0c1 for instance 6c51228f-b19b-4028-8c23-38cb4c0e1ad9 on n-h1-862967-2 Oct 29 03:02:10.623832 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-bd161130-1521-4797-a961-5d6fccc9ceaf req-699d3fd3-2ff2-4b7f-8219-e0cd252cd2cc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091360 Oct 29 03:02:10.627403 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1624/3431] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:10.687737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-713d9241-9290-4d51-b169-8db975030994 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:10.709800 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-713d9241-9290-4d51-b169-8db975030994 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b" status: 200 len: 1315 microversion: 2.1 time: 0.840346 Oct 29 03:02:10.711598 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1808/3432] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:09 2022] GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b => generated 1315 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:10.796059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-066fd107-38c5-4d3c-bb79-fb5feded57bc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:10.797473 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-066fd107-38c5-4d3c-bb79-fb5feded57bc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 6c51228f-b19b-4028-8c23-38cb4c0e1ad9] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:10.814764 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-066fd107-38c5-4d3c-bb79-fb5feded57bc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:10.815441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-066fd107-38c5-4d3c-bb79-fb5feded57bc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:10.818028 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-066fd107-38c5-4d3c-bb79-fb5feded57bc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:10.818963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-066fd107-38c5-4d3c-bb79-fb5feded57bc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:10.822786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-066fd107-38c5-4d3c-bb79-fb5feded57bc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:10.823384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-066fd107-38c5-4d3c-bb79-fb5feded57bc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:11.458239 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f3229ebb-2b89-441a-8603-0e9a05743729 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:11.459035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f3229ebb-2b89-441a-8603-0e9a05743729 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:11.477325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3229ebb-2b89-441a-8603-0e9a05743729 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:11.482107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3229ebb-2b89-441a-8603-0e9a05743729 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:11.483038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3229ebb-2b89-441a-8603-0e9a05743729 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:11.485695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3229ebb-2b89-441a-8603-0e9a05743729 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:11.488475 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3229ebb-2b89-441a-8603-0e9a05743729 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:11.493077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3229ebb-2b89-441a-8603-0e9a05743729 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:11.631729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f3229ebb-2b89-441a-8603-0e9a05743729 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:11.633847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-066fd107-38c5-4d3c-bb79-fb5feded57bc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:11.654467 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-066fd107-38c5-4d3c-bb79-fb5feded57bc tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9" status: 200 len: 1305 microversion: 2.1 time: 0.858327 Oct 29 03:02:11.654467 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1625/3433] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:10 2022] GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9 => generated 1305 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:11.662933 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f3229ebb-2b89-441a-8603-0e9a05743729 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 200 len: 1600 microversion: 2.1 time: 0.208412 Oct 29 03:02:11.674445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-8c7074bd-2dc7-458e-ad19-461c263edaa9 req-02a7b7d0-500c-4def-ad96-5abe250add43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b40f7b3b-04d4-4cfa-8058-09afc05d791e", "name": "network-vif-deleted", "tag": "9766e845-d03c-426b-87c8-9df2fb171e28"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:11.677824 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1809/3434] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:11 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 1600 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:11.741515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9d2db54a-61c0-430d-a8f8-18df490fbb3e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:11.742457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8c7074bd-2dc7-458e-ad19-461c263edaa9 req-02a7b7d0-500c-4def-ad96-5abe250add43 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:11.745806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8c7074bd-2dc7-458e-ad19-461c263edaa9 req-02a7b7d0-500c-4def-ad96-5abe250add43 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:11.748345 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9d2db54a-61c0-430d-a8f8-18df490fbb3e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 35982880-caba-4b90-80e1-3561ee53888b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:11.751352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8c7074bd-2dc7-458e-ad19-461c263edaa9 req-02a7b7d0-500c-4def-ad96-5abe250add43 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:11.784092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d2db54a-61c0-430d-a8f8-18df490fbb3e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:11.784633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d2db54a-61c0-430d-a8f8-18df490fbb3e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:11.785083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d2db54a-61c0-430d-a8f8-18df490fbb3e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:11.793833 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d2db54a-61c0-430d-a8f8-18df490fbb3e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:11.795986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d2db54a-61c0-430d-a8f8-18df490fbb3e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:11.798479 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d2db54a-61c0-430d-a8f8-18df490fbb3e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:11.805637 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-8c7074bd-2dc7-458e-ad19-461c263edaa9 req-02a7b7d0-500c-4def-ad96-5abe250add43 service nova] Creating event network-vif-deleted:9766e845-d03c-426b-87c8-9df2fb171e28 for instance b40f7b3b-04d4-4cfa-8058-09afc05d791e on n-h2-862967-2 Oct 29 03:02:11.837350 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-8c7074bd-2dc7-458e-ad19-461c263edaa9 req-02a7b7d0-500c-4def-ad96-5abe250add43 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178968 Oct 29 03:02:11.847236 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1626/3435] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:11.895543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ad29a133-7148-4c01-bc9b-da160de704aa tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1611841898", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1e9a6515-d426-4dbd-8fdb-587ef2f1e1cf"}], "security_groups": [{"name": "tempest-securitygroup--1444389853"}], "key_name": "tempest-keypair-1900859268", "user_data": "}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:12.514477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-ad29a133-7148-4c01-bc9b-da160de704aa tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] validate_networks() for [('1e9a6515-d426-4dbd-8fdb-587ef2f1e1cf', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:02:13.239863 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9d2db54a-61c0-430d-a8f8-18df490fbb3e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:13.263099 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9d2db54a-61c0-430d-a8f8-18df490fbb3e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b" status: 200 len: 1315 microversion: 2.1 time: 1.529938 Oct 29 03:02:13.269028 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1810/3436] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:11 2022] GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b => generated 1315 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:13.297535 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-c16398c8-a1dc-4777-82a6-80cf0550424c req-fe53a578-977f-42fa-9f10-8589b9a49ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35982880-caba-4b90-80e1-3561ee53888b", "tag": "a2122170-a7ba-49ff-ae2d-2eb0eac1767f"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:13.334034 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c16398c8-a1dc-4777-82a6-80cf0550424c req-fe53a578-977f-42fa-9f10-8589b9a49ec7 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:13.334518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c16398c8-a1dc-4777-82a6-80cf0550424c req-fe53a578-977f-42fa-9f10-8589b9a49ec7 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:13.335134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c16398c8-a1dc-4777-82a6-80cf0550424c req-fe53a578-977f-42fa-9f10-8589b9a49ec7 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:13.354422 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-c16398c8-a1dc-4777-82a6-80cf0550424c req-fe53a578-977f-42fa-9f10-8589b9a49ec7 service nova] Creating event network-changed:a2122170-a7ba-49ff-ae2d-2eb0eac1767f for instance 35982880-caba-4b90-80e1-3561ee53888b on n-h2-862967-2 Oct 29 03:02:13.359941 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-c16398c8-a1dc-4777-82a6-80cf0550424c req-fe53a578-977f-42fa-9f10-8589b9a49ec7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094753 Oct 29 03:02:13.361633 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1811/3437] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:13.369177 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-83e31511-3fcb-437f-81e9-b1af4c38b427 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:13.370059 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-83e31511-3fcb-437f-81e9-b1af4c38b427 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 6c51228f-b19b-4028-8c23-38cb4c0e1ad9] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:13.379301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83e31511-3fcb-437f-81e9-b1af4c38b427 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:13.380476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83e31511-3fcb-437f-81e9-b1af4c38b427 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:13.381107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83e31511-3fcb-437f-81e9-b1af4c38b427 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:13.385165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83e31511-3fcb-437f-81e9-b1af4c38b427 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:13.385817 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83e31511-3fcb-437f-81e9-b1af4c38b427 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:13.389016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83e31511-3fcb-437f-81e9-b1af4c38b427 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:13.785282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-83e31511-3fcb-437f-81e9-b1af4c38b427 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:13.799924 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-83e31511-3fcb-437f-81e9-b1af4c38b427 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9" status: 200 len: 1485 microversion: 2.1 time: 0.436090 Oct 29 03:02:13.800979 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1812/3438] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:13 2022] GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9 => generated 1485 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:13.815177 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-220e790a-9e12-4c7b-95d0-8682516ae622 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:13.816285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-220e790a-9e12-4c7b-95d0-8682516ae622 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: b40f7b3b-04d4-4cfa-8058-09afc05d791e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:13.842979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-220e790a-9e12-4c7b-95d0-8682516ae622 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:13.848710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-220e790a-9e12-4c7b-95d0-8682516ae622 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:13.849286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-220e790a-9e12-4c7b-95d0-8682516ae622 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:13.850063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-220e790a-9e12-4c7b-95d0-8682516ae622 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:13.850544 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-220e790a-9e12-4c7b-95d0-8682516ae622 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:13.850976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-220e790a-9e12-4c7b-95d0-8682516ae622 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:13.888787 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-220e790a-9e12-4c7b-95d0-8682516ae622 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] HTTP exception thrown: Instance b40f7b3b-04d4-4cfa-8058-09afc05d791e could not be found. Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-220e790a-9e12-4c7b-95d0-8682516ae622 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Request method failure captured: Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e HTTP/1.1 Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJXoG6-UKDd9auDnzRVlkQ2zkHgW8odihP0OMPkk3MkQzP1iYAQeSLWa3_nBbe64sCGvORDOOctsBAz0GOq1EIDZXpFzKkPlAWbyoSnVA9HbDyOFDBRBWmjMCnBXT25QcAIdCS8c7ut6W0v9Gq-r1pDCwvRALfmH54avwg2SRXKJw1k Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: cb1c877c178847ad8e652dda9a20e724 Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-LiveMigrationTest-268263720 Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cb1c877c178847ad8e652dda9a20e724"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cb1c877c178847ad8e652dda9a20e724"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_cb1c877c178847ad8e652dda9a20e724"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/cb1c877c178847ad8e652dda9a20e724"}]}] Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-LiveMigrationTest-268263720 Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: cb1c877c178847ad8e652dda9a20e724 Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-LiveMigrationTest-268263720 Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-LiveMigrationTest-268263720-project Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 68198185a8314417b2b5d09e831ff4fd Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-LiveMigrationTest-268263720-project Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance b40f7b3b-04d4-4cfa-8058-09afc05d791e could not be found. Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'b40f7b3b-04d4-4cfa-8058-09afc05d791e'} Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b40f7b3b-04d4-4cfa-8058-09afc05d791e could not be found. Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b40f7b3b-04d4-4cfa-8058-09afc05d791e could not be found. Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:13.891013 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:13.895419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:13.895419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:13.895419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:13.895419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:13.895419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:13.895419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b40f7b3b-04d4-4cfa-8058-09afc05d791e could not be found. Oct 29 03:02:13.895419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:13.901475 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-220e790a-9e12-4c7b-95d0-8682516ae622 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Returning 404 to user: Instance b40f7b3b-04d4-4cfa-8058-09afc05d791e could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:13.902599 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-220e790a-9e12-4c7b-95d0-8682516ae622 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e" status: 404 len: 111 microversion: 2.1 time: 0.099102 Oct 29 03:02:13.907330 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1813/3439] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:13 2022] GET /compute/v2.1/servers/b40f7b3b-04d4-4cfa-8058-09afc05d791e => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:13.916032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ee5a2227-4380-4585-a365-0c31aa88d3c1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:13.919616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ee5a2227-4380-4585-a365-0c31aa88d3c1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 6c51228f-b19b-4028-8c23-38cb4c0e1ad9] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:13.934231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee5a2227-4380-4585-a365-0c31aa88d3c1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:13.940713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee5a2227-4380-4585-a365-0c31aa88d3c1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:13.941575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee5a2227-4380-4585-a365-0c31aa88d3c1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:13.942581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee5a2227-4380-4585-a365-0c31aa88d3c1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:13.948629 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee5a2227-4380-4585-a365-0c31aa88d3c1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:13.949608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee5a2227-4380-4585-a365-0c31aa88d3c1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:13.996437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ee5a2227-4380-4585-a365-0c31aa88d3c1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 6c51228f-b19b-4028-8c23-38cb4c0e1ad9] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:02:14.038726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-ad29a133-7148-4c01-bc9b-da160de704aa tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:02:14.039232 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-ad29a133-7148-4c01-bc9b-da160de704aa tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:02:14.039979 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-ad29a133-7148-4c01-bc9b-da160de704aa tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:02:14.042510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-ad29a133-7148-4c01-bc9b-da160de704aa tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:02:14.043387 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-ad29a133-7148-4c01-bc9b-da160de704aa tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:02:14.053326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:14.067724 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad29a133-7148-4c01-bc9b-da160de704aa tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:14.069463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad29a133-7148-4c01-bc9b-da160de704aa tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:14.070384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad29a133-7148-4c01-bc9b-da160de704aa tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:14.076685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad29a133-7148-4c01-bc9b-da160de704aa tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:14.078509 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad29a133-7148-4c01-bc9b-da160de704aa tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:14.079287 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad29a133-7148-4c01-bc9b-da160de704aa tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:14.118948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-ad29a133-7148-4c01-bc9b-da160de704aa tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Getting quotas for project 746258dc83c74b9ba3634afbc2716d7b. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:02:14.137992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-ad29a133-7148-4c01-bc9b-da160de704aa tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Getting quotas for user 4dbcac917fc6415683ae17b220276c91 and project 746258dc83c74b9ba3634afbc2716d7b. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:02:14.167431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ad29a133-7148-4c01-bc9b-da160de704aa tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:02:14.170318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ad29a133-7148-4c01-bc9b-da160de704aa tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:02:14.203991 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ee5a2227-4380-4585-a365-0c31aa88d3c1 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9" status: 204 len: 0 microversion: 2.1 time: 0.291497 Oct 29 03:02:14.208412 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1814/3440] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:02:13 2022] DELETE /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:02:14.225371 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fd723e66-3fe4-44df-94ac-d54e727aee52 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '.version_select at 0x7ff0581605e0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:14.277742 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ad29a133-7148-4c01-bc9b-da160de704aa tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.414304 Oct 29 03:02:14.279792 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fd723e66-3fe4-44df-94ac-d54e727aee52 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1238694404" status: 202 len: 0 microversion: 2.1 time: 0.072251 Oct 29 03:02:14.281125 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1815/3441] 10.222.0.46 () {58 vars in 1221 bytes} [Sat Oct 29 03:02:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1238694404 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:02:14.287778 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1627/3442] 10.222.0.46 () {62 vars in 1188 bytes} [Sat Oct 29 03:02:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 2431 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 03:02:14.298300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-59164d00-0c25-4879-a5fc-91245074dde2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:14.301056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-59164d00-0c25-4879-a5fc-91245074dde2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 6c51228f-b19b-4028-8c23-38cb4c0e1ad9] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:14.320113 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59164d00-0c25-4879-a5fc-91245074dde2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:14.320991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59164d00-0c25-4879-a5fc-91245074dde2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:14.321562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59164d00-0c25-4879-a5fc-91245074dde2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:14.322379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59164d00-0c25-4879-a5fc-91245074dde2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:14.323032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59164d00-0c25-4879-a5fc-91245074dde2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:14.327593 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59164d00-0c25-4879-a5fc-91245074dde2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:14.922693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-254a6e5c-53aa-4d7f-b109-005272664ce2 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:14.922847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-254a6e5c-53aa-4d7f-b109-005272664ce2 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:15.232762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-59164d00-0c25-4879-a5fc-91245074dde2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:15.243283 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-59164d00-0c25-4879-a5fc-91245074dde2 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9" status: 200 len: 1491 microversion: 2.1 time: 0.960842 Oct 29 03:02:15.253527 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1816/3443] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:14 2022] GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9 => generated 1491 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:15.255776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-254a6e5c-53aa-4d7f-b109-005272664ce2 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:15.271675 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-254a6e5c-53aa-4d7f-b109-005272664ce2 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:15.273261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4f8117d1-eecb-4a96-a4a0-339e2852a4c7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:15.278190 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4f8117d1-eecb-4a96-a4a0-339e2852a4c7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 35982880-caba-4b90-80e1-3561ee53888b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:15.280515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-254a6e5c-53aa-4d7f-b109-005272664ce2 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:15.284196 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-254a6e5c-53aa-4d7f-b109-005272664ce2 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1282 microversion: 2.20 time: 0.995263 Oct 29 03:02:15.293296 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1628/3444] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:14 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1282 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:15.304766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f8117d1-eecb-4a96-a4a0-339e2852a4c7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:15.304766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f8117d1-eecb-4a96-a4a0-339e2852a4c7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:15.305895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f8117d1-eecb-4a96-a4a0-339e2852a4c7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:15.310241 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f8117d1-eecb-4a96-a4a0-339e2852a4c7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:15.312236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f8117d1-eecb-4a96-a4a0-339e2852a4c7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:15.314602 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f8117d1-eecb-4a96-a4a0-339e2852a4c7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:15.707726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e7d8b6ca-44d5-4f47-b892-3609599c85a4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1551343169", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "6f67a35e-ba58-41d2-a295-f639fe07bc93"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:15.815455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4f8117d1-eecb-4a96-a4a0-339e2852a4c7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:15.850273 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4f8117d1-eecb-4a96-a4a0-339e2852a4c7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b" status: 200 len: 1315 microversion: 2.1 time: 0.593942 Oct 29 03:02:15.850902 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-e7d8b6ca-44d5-4f47-b892-3609599c85a4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] validate_networks() for [('6f67a35e-ba58-41d2-a295-f639fe07bc93', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:02:15.853971 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1817/3445] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:15 2022] GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b => generated 1315 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:16.267407 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-451c427b-bd58-4031-9ccf-e82ca2114132 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:16.268311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-451c427b-bd58-4031-9ccf-e82ca2114132 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 6c51228f-b19b-4028-8c23-38cb4c0e1ad9] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:16.279364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-451c427b-bd58-4031-9ccf-e82ca2114132 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:16.281198 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-451c427b-bd58-4031-9ccf-e82ca2114132 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:16.286539 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-451c427b-bd58-4031-9ccf-e82ca2114132 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:16.287303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-451c427b-bd58-4031-9ccf-e82ca2114132 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:16.287776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-451c427b-bd58-4031-9ccf-e82ca2114132 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:16.288209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-451c427b-bd58-4031-9ccf-e82ca2114132 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:16.342333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:16.590136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-451c427b-bd58-4031-9ccf-e82ca2114132 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:16.610736 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-451c427b-bd58-4031-9ccf-e82ca2114132 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9" status: 200 len: 1491 microversion: 2.1 time: 0.347105 Oct 29 03:02:16.611503 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1818/3446] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:16 2022] GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9 => generated 1491 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:02:16.618940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-150b4de3-3930-4084-a18d-c117dc5559e5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:16.619797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-150b4de3-3930-4084-a18d-c117dc5559e5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:16.628627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-150b4de3-3930-4084-a18d-c117dc5559e5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:16.643152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-150b4de3-3930-4084-a18d-c117dc5559e5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:16.646024 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-150b4de3-3930-4084-a18d-c117dc5559e5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:16.650125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-150b4de3-3930-4084-a18d-c117dc5559e5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:16.651012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-150b4de3-3930-4084-a18d-c117dc5559e5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:16.655623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-150b4de3-3930-4084-a18d-c117dc5559e5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:16.890747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:16.926302 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-150b4de3-3930-4084-a18d-c117dc5559e5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:16.936651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-150b4de3-3930-4084-a18d-c117dc5559e5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:16.938645 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-150b4de3-3930-4084-a18d-c117dc5559e5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:16.942357 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-150b4de3-3930-4084-a18d-c117dc5559e5 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1342 microversion: 2.20 time: 0.327453 Oct 29 03:02:16.944408 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1819/3447] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:16 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1342 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:16.965238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d17ef2bf-4d1d-467d-977a-c559f243c28d tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:16.966082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d17ef2bf-4d1d-467d-977a-c559f243c28d tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:16.973386 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d17ef2bf-4d1d-467d-977a-c559f243c28d tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:16.974213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d17ef2bf-4d1d-467d-977a-c559f243c28d tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:16.974885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d17ef2bf-4d1d-467d-977a-c559f243c28d tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:16.975904 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d17ef2bf-4d1d-467d-977a-c559f243c28d tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:16.976615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d17ef2bf-4d1d-467d-977a-c559f243c28d tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:16.977278 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d17ef2bf-4d1d-467d-977a-c559f243c28d tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:17.011721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d17ef2bf-4d1d-467d-977a-c559f243c28d tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:02:17.147777 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d17ef2bf-4d1d-467d-977a-c559f243c28d tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406" status: 204 len: 0 microversion: 2.1 time: 0.201409 Oct 29 03:02:17.148738 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1820/3448] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:02:16 2022] DELETE /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:02:17.156681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6c90dbe4-3a5f-41a4-87ff-78987ca72c69 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:17.158003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6c90dbe4-3a5f-41a4-87ff-78987ca72c69 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 35982880-caba-4b90-80e1-3561ee53888b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:17.165285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c90dbe4-3a5f-41a4-87ff-78987ca72c69 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:17.166063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c90dbe4-3a5f-41a4-87ff-78987ca72c69 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:17.166748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c90dbe4-3a5f-41a4-87ff-78987ca72c69 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:17.167681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c90dbe4-3a5f-41a4-87ff-78987ca72c69 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:17.168345 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c90dbe4-3a5f-41a4-87ff-78987ca72c69 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:17.169037 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c90dbe4-3a5f-41a4-87ff-78987ca72c69 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:17.443503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6c90dbe4-3a5f-41a4-87ff-78987ca72c69 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:17.456021 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6c90dbe4-3a5f-41a4-87ff-78987ca72c69 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b" status: 200 len: 1315 microversion: 2.1 time: 0.303023 Oct 29 03:02:17.456709 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1821/3449] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:17 2022] GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:17.483857 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3c2df176-9b75-4e3e-9982-19c1ceece3c0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:17.499731 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3c2df176-9b75-4e3e-9982-19c1ceece3c0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:17.519745 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-e7d8b6ca-44d5-4f47-b892-3609599c85a4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:02:17.521304 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-e7d8b6ca-44d5-4f47-b892-3609599c85a4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:02:17.521796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-e7d8b6ca-44d5-4f47-b892-3609599c85a4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:02:17.522210 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-e7d8b6ca-44d5-4f47-b892-3609599c85a4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:02:17.522661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-e7d8b6ca-44d5-4f47-b892-3609599c85a4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:02:17.526019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c2df176-9b75-4e3e-9982-19c1ceece3c0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:17.529094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c2df176-9b75-4e3e-9982-19c1ceece3c0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:17.529656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c2df176-9b75-4e3e-9982-19c1ceece3c0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:17.530734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c2df176-9b75-4e3e-9982-19c1ceece3c0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:17.531294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c2df176-9b75-4e3e-9982-19c1ceece3c0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:17.535171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c2df176-9b75-4e3e-9982-19c1ceece3c0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:17.554240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7d8b6ca-44d5-4f47-b892-3609599c85a4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:17.555149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7d8b6ca-44d5-4f47-b892-3609599c85a4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:17.555606 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7d8b6ca-44d5-4f47-b892-3609599c85a4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:17.556564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7d8b6ca-44d5-4f47-b892-3609599c85a4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:17.556944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7d8b6ca-44d5-4f47-b892-3609599c85a4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:17.557332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7d8b6ca-44d5-4f47-b892-3609599c85a4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:17.610267 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-e7d8b6ca-44d5-4f47-b892-3609599c85a4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Getting quotas for project 3fbd3d4fe8c54fc7852468af9eeb92ff. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:02:17.623867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-e7d8b6ca-44d5-4f47-b892-3609599c85a4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Getting quotas for user 8ed77e18046c455ba3a0e0c4434d44bf and project 3fbd3d4fe8c54fc7852468af9eeb92ff. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:02:17.659921 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e7d8b6ca-44d5-4f47-b892-3609599c85a4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Going to run 2 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:02:17.662940 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e7d8b6ca-44d5-4f47-b892-3609599c85a4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: a96c21c1-c8a7-4f6f-93d6-ebb2af6240cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:02:17.744867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e7d8b6ca-44d5-4f47-b892-3609599c85a4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 2a076d87-4f15-4e95-9be9-c89b035c72e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=a96c21c1-c8a7-4f6f-93d6-ebb2af6240cf,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:02:17.863266 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e7d8b6ca-44d5-4f47-b892-3609599c85a4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.556293 Oct 29 03:02:17.870673 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1629/3450] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:02:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:02:17.877171 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4c650367-c489-4e47-b3d7-6cba5ae42a6a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:17.879858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4c650367-c489-4e47-b3d7-6cba5ae42a6a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 6c51228f-b19b-4028-8c23-38cb4c0e1ad9] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:17.892802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c650367-c489-4e47-b3d7-6cba5ae42a6a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:17.893590 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c650367-c489-4e47-b3d7-6cba5ae42a6a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:17.908154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c650367-c489-4e47-b3d7-6cba5ae42a6a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:17.909454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c650367-c489-4e47-b3d7-6cba5ae42a6a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:17.910087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c650367-c489-4e47-b3d7-6cba5ae42a6a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:17.910692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c650367-c489-4e47-b3d7-6cba5ae42a6a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:17.977566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:18.262582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4c650367-c489-4e47-b3d7-6cba5ae42a6a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:18.281437 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4c650367-c489-4e47-b3d7-6cba5ae42a6a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9" status: 200 len: 1449 microversion: 2.1 time: 0.409506 Oct 29 03:02:18.282634 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1630/3451] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:17 2022] GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9 => generated 1449 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:18.296104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fb31f8d7-8df0-4bb1-8e56-3298c594d42f tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:18.329404 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fb31f8d7-8df0-4bb1-8e56-3298c594d42f tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:18.330665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fb31f8d7-8df0-4bb1-8e56-3298c594d42f tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Searching by: {'deleted': False, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff'} {{(pid=127125) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:02:18.372795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb31f8d7-8df0-4bb1-8e56-3298c594d42f tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:18.374188 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb31f8d7-8df0-4bb1-8e56-3298c594d42f tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:18.375961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb31f8d7-8df0-4bb1-8e56-3298c594d42f tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:18.378605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb31f8d7-8df0-4bb1-8e56-3298c594d42f tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:18.379241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb31f8d7-8df0-4bb1-8e56-3298c594d42f tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:18.380631 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb31f8d7-8df0-4bb1-8e56-3298c594d42f tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:18.434995 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fb31f8d7-8df0-4bb1-8e56-3298c594d42f tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.150302 Oct 29 03:02:18.450822 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1631/3452] 10.222.0.46 () {58 vars in 1125 bytes} [Sat Oct 29 03:02:18 2022] GET /compute/v2.1/servers => generated 677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:18.457131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-52221220-a26d-4ba9-99af-2c805e3d3377 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:18.459534 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-52221220-a26d-4ba9-99af-2c805e3d3377 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:18.475444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52221220-a26d-4ba9-99af-2c805e3d3377 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:18.476767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52221220-a26d-4ba9-99af-2c805e3d3377 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:18.477484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52221220-a26d-4ba9-99af-2c805e3d3377 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:18.478503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52221220-a26d-4ba9-99af-2c805e3d3377 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:18.479308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52221220-a26d-4ba9-99af-2c805e3d3377 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:18.480023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52221220-a26d-4ba9-99af-2c805e3d3377 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:18.662298 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3c2df176-9b75-4e3e-9982-19c1ceece3c0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:18.689833 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3c2df176-9b75-4e3e-9982-19c1ceece3c0 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406" status: 200 len: 1485 microversion: 2.1 time: 1.199907 Oct 29 03:02:18.692337 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1822/3453] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:17 2022] GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 => generated 1485 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:18.736570 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-09e6611b-d974-4625-94a1-9fa6b7c0eee9 req-17522503-75a5-4f7a-a108-e46ddfb9c04a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c51228f-b19b-4028-8c23-38cb4c0e1ad9", "name": "network-vif-deleted", "tag": "5f16a572-3cd3-43e8-8cd6-c38e3a2ee0c1"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:18.785682 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-09e6611b-d974-4625-94a1-9fa6b7c0eee9 req-17522503-75a5-4f7a-a108-e46ddfb9c04a service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:18.786522 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-09e6611b-d974-4625-94a1-9fa6b7c0eee9 req-17522503-75a5-4f7a-a108-e46ddfb9c04a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:18.786642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-09e6611b-d974-4625-94a1-9fa6b7c0eee9 req-17522503-75a5-4f7a-a108-e46ddfb9c04a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:18.868310 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-09e6611b-d974-4625-94a1-9fa6b7c0eee9 req-17522503-75a5-4f7a-a108-e46ddfb9c04a service nova] Creating event network-vif-deleted:5f16a572-3cd3-43e8-8cd6-c38e3a2ee0c1 for instance 6c51228f-b19b-4028-8c23-38cb4c0e1ad9 on n-h1-862967-2 Oct 29 03:02:18.885185 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-09e6611b-d974-4625-94a1-9fa6b7c0eee9 req-17522503-75a5-4f7a-a108-e46ddfb9c04a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191387 Oct 29 03:02:18.894483 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1823/3454] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:19.306347 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6109a01c-81a4-4bb0-8a64-06d4535bac39 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-2102616679", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "eb626ad7-451f-4d08-adb7-a454e4138f2b"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:19.444560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-6109a01c-81a4-4bb0-8a64-06d4535bac39 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] validate_networks() for [('eb626ad7-451f-4d08-adb7-a454e4138f2b', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:02:19.562138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-52221220-a26d-4ba9-99af-2c805e3d3377 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:19.596106 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-52221220-a26d-4ba9-99af-2c805e3d3377 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:19.597792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-52221220-a26d-4ba9-99af-2c805e3d3377 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:19.613718 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-52221220-a26d-4ba9-99af-2c805e3d3377 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1340 microversion: 2.20 time: 1.146752 Oct 29 03:02:19.618486 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1632/3455] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:18 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1340 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:19.637280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6e78e483-540e-4036-ae43-e48c29b66887 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:19.645900 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6e78e483-540e-4036-ae43-e48c29b66887 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 2a076d87-4f15-4e95-9be9-c89b035c72e2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:19.669208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e78e483-540e-4036-ae43-e48c29b66887 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:19.670147 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e78e483-540e-4036-ae43-e48c29b66887 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:19.670941 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e78e483-540e-4036-ae43-e48c29b66887 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:19.672026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e78e483-540e-4036-ae43-e48c29b66887 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:19.676327 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e78e483-540e-4036-ae43-e48c29b66887 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:19.677142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e78e483-540e-4036-ae43-e48c29b66887 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:19.861588 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6e78e483-540e-4036-ae43-e48c29b66887 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:19.873711 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6e78e483-540e-4036-ae43-e48c29b66887 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/2a076d87-4f15-4e95-9be9-c89b035c72e2" status: 200 len: 1224 microversion: 2.1 time: 0.253652 Oct 29 03:02:19.892592 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1633/3456] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:19 2022] GET /compute/v2.1/servers/2a076d87-4f15-4e95-9be9-c89b035c72e2 => generated 1224 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:19.902838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-01d16ff4-0d3a-467b-bbe6-0f8843460229 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:19.903774 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-01d16ff4-0d3a-467b-bbe6-0f8843460229 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 35982880-caba-4b90-80e1-3561ee53888b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:19.914313 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01d16ff4-0d3a-467b-bbe6-0f8843460229 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:19.915164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01d16ff4-0d3a-467b-bbe6-0f8843460229 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:19.915841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01d16ff4-0d3a-467b-bbe6-0f8843460229 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:19.916869 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01d16ff4-0d3a-467b-bbe6-0f8843460229 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:19.917710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01d16ff4-0d3a-467b-bbe6-0f8843460229 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:19.918420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01d16ff4-0d3a-467b-bbe6-0f8843460229 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:20.238247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-01d16ff4-0d3a-467b-bbe6-0f8843460229 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:20.250475 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-01d16ff4-0d3a-467b-bbe6-0f8843460229 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b" status: 200 len: 1315 microversion: 2.1 time: 0.355332 Oct 29 03:02:20.252290 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1634/3457] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:19 2022] GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:20.259256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-b097c2c8-0792-4807-84a6-30e77ea50f76 req-59824968-fc4c-45f1-a1dd-e9becfe96c8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e6b1a61-b925-4274-bc43-1dfda057b406", "name": "network-vif-deleted", "tag": "b6de9e1c-df45-4134-8fe2-03c9b87b0e66"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:20.272298 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b097c2c8-0792-4807-84a6-30e77ea50f76 req-59824968-fc4c-45f1-a1dd-e9becfe96c8d service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:20.273967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b097c2c8-0792-4807-84a6-30e77ea50f76 req-59824968-fc4c-45f1-a1dd-e9becfe96c8d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:20.274971 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b097c2c8-0792-4807-84a6-30e77ea50f76 req-59824968-fc4c-45f1-a1dd-e9becfe96c8d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:20.308695 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-b097c2c8-0792-4807-84a6-30e77ea50f76 req-59824968-fc4c-45f1-a1dd-e9becfe96c8d service nova] Creating event network-vif-deleted:b6de9e1c-df45-4134-8fe2-03c9b87b0e66 for instance 5e6b1a61-b925-4274-bc43-1dfda057b406 on n-h2-862967-2 Oct 29 03:02:20.321925 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-b097c2c8-0792-4807-84a6-30e77ea50f76 req-59824968-fc4c-45f1-a1dd-e9becfe96c8d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067945 Oct 29 03:02:20.322907 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1635/3458] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:20.722045 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-6109a01c-81a4-4bb0-8a64-06d4535bac39 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:02:20.722557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-6109a01c-81a4-4bb0-8a64-06d4535bac39 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:02:20.723017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-6109a01c-81a4-4bb0-8a64-06d4535bac39 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:02:20.723427 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-6109a01c-81a4-4bb0-8a64-06d4535bac39 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:02:20.723884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-6109a01c-81a4-4bb0-8a64-06d4535bac39 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:02:20.742069 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6109a01c-81a4-4bb0-8a64-06d4535bac39 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:20.743312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6109a01c-81a4-4bb0-8a64-06d4535bac39 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:20.746601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6109a01c-81a4-4bb0-8a64-06d4535bac39 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:20.747210 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6109a01c-81a4-4bb0-8a64-06d4535bac39 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:20.752666 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6109a01c-81a4-4bb0-8a64-06d4535bac39 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:20.756455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6109a01c-81a4-4bb0-8a64-06d4535bac39 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:20.758520 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-876e7876-372a-49a8-afab-f466c07c70ef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:20.759514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-876e7876-372a-49a8-afab-f466c07c70ef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 6c51228f-b19b-4028-8c23-38cb4c0e1ad9] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:20.767818 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-876e7876-372a-49a8-afab-f466c07c70ef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:20.775132 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-876e7876-372a-49a8-afab-f466c07c70ef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:20.775783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-876e7876-372a-49a8-afab-f466c07c70ef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:20.776857 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-876e7876-372a-49a8-afab-f466c07c70ef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:20.777730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-876e7876-372a-49a8-afab-f466c07c70ef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:20.778490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-876e7876-372a-49a8-afab-f466c07c70ef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:20.800734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-6109a01c-81a4-4bb0-8a64-06d4535bac39 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Getting quotas for project 25a563dd48004e3891a26468125ca652. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:02:20.811078 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-876e7876-372a-49a8-afab-f466c07c70ef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] HTTP exception thrown: Instance 6c51228f-b19b-4028-8c23-38cb4c0e1ad9 could not be found. Oct 29 03:02:20.812055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-6109a01c-81a4-4bb0-8a64-06d4535bac39 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Getting quotas for user b4d9c179a03f443c91b5e14528a332cc and project 25a563dd48004e3891a26468125ca652. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-876e7876-372a-49a8-afab-f466c07c70ef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Request method failure captured: Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9 HTTP/1.1 Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJaPFemTZ_UF20zmv9lzuySxzmYogL3HGJEwUZdUOnmSf32UFdECKHuxy10ErZgp7nOMsETdmVm6qO1Cseou8vOu24Afz6OEyVlhZTaET2mZYvbTpEFvWYnX_iHJiqkebumOgGpaD-j1ug4WAr0UmKaAvXO_0oQilfvx3gbnKVIbMs8 Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_185d32c10dd845768f4ff70a85680358"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/185d32c10dd845768f4ff70a85680358"}]}] Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ImagesTestJSON-90655156 Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: c866f273672846eb8d7f4f2a00269666 Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 6c51228f-b19b-4028-8c23-38cb4c0e1ad9 could not be found. Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '6c51228f-b19b-4028-8c23-38cb4c0e1ad9'} Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c51228f-b19b-4028-8c23-38cb4c0e1ad9 could not be found. Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c51228f-b19b-4028-8c23-38cb4c0e1ad9 could not be found. Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:20.813573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:20.818429 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:20.818429 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:20.818429 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:20.818429 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:20.818429 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c51228f-b19b-4028-8c23-38cb4c0e1ad9 could not be found. Oct 29 03:02:20.818429 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:20.821571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-876e7876-372a-49a8-afab-f466c07c70ef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Returning 404 to user: Instance 6c51228f-b19b-4028-8c23-38cb4c0e1ad9 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:20.822699 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-876e7876-372a-49a8-afab-f466c07c70ef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9" status: 404 len: 111 microversion: 2.1 time: 0.498615 Oct 29 03:02:20.823923 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1636/3459] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:20 2022] GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9 => generated 111 bytes in 500 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:20.829298 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b8f88deb-673a-4f6e-bf70-4f208a45e3b1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:20.831972 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b8f88deb-673a-4f6e-bf70-4f208a45e3b1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 5e6b1a61-b925-4274-bc43-1dfda057b406] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:20.839323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8f88deb-673a-4f6e-bf70-4f208a45e3b1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:20.839886 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8f88deb-673a-4f6e-bf70-4f208a45e3b1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:20.840842 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8f88deb-673a-4f6e-bf70-4f208a45e3b1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:20.842460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8f88deb-673a-4f6e-bf70-4f208a45e3b1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:20.842826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8f88deb-673a-4f6e-bf70-4f208a45e3b1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:20.843263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8f88deb-673a-4f6e-bf70-4f208a45e3b1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:20.866462 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-b8f88deb-673a-4f6e-bf70-4f208a45e3b1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] HTTP exception thrown: Instance 5e6b1a61-b925-4274-bc43-1dfda057b406 could not be found. Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b8f88deb-673a-4f6e-bf70-4f208a45e3b1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Request method failure captured: Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 HTTP/1.1 Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJXoG6-UKDd9auDnzRVlkQ2zkHgW8odihP0OMPkk3MkQzP1iYAQeSLWa3_nBbe64sCGvORDOOctsBAz0GOq1EIDZXpFzKkPlAWbyoSnVA9HbDyOFDBRBWmjMCnBXT25QcAIdCS8c7ut6W0v9Gq-r1pDCwvRALfmH54avwg2SRXKJw1k Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: cb1c877c178847ad8e652dda9a20e724 Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-LiveMigrationTest-268263720 Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cb1c877c178847ad8e652dda9a20e724"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cb1c877c178847ad8e652dda9a20e724"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_cb1c877c178847ad8e652dda9a20e724"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/cb1c877c178847ad8e652dda9a20e724"}]}] Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-LiveMigrationTest-268263720 Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: cb1c877c178847ad8e652dda9a20e724 Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-LiveMigrationTest-268263720 Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-LiveMigrationTest-268263720-project Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 68198185a8314417b2b5d09e831ff4fd Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-LiveMigrationTest-268263720-project Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 5e6b1a61-b925-4274-bc43-1dfda057b406 could not be found. Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '5e6b1a61-b925-4274-bc43-1dfda057b406'} Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e6b1a61-b925-4274-bc43-1dfda057b406 could not be found. Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e6b1a61-b925-4274-bc43-1dfda057b406 could not be found. Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:20.874795 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:20.885960 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:20.885960 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:20.885960 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:20.885960 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:20.885960 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:20.885960 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e6b1a61-b925-4274-bc43-1dfda057b406 could not be found. Oct 29 03:02:20.885960 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:20.885960 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b8f88deb-673a-4f6e-bf70-4f208a45e3b1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Returning 404 to user: Instance 5e6b1a61-b925-4274-bc43-1dfda057b406 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:20.885960 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b8f88deb-673a-4f6e-bf70-4f208a45e3b1 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406" status: 404 len: 111 microversion: 2.1 time: 0.050328 Oct 29 03:02:20.889341 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1637/3460] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:20 2022] GET /compute/v2.1/servers/5e6b1a61-b925-4274-bc43-1dfda057b406 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:20.906170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6109a01c-81a4-4bb0-8a64-06d4535bac39 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:02:20.909090 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6109a01c-81a4-4bb0-8a64-06d4535bac39 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] [instance: 7c79b743-fe77-42f1-88b9-594bc077b85b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:02:20.910227 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-f4a36582-f92a-4b41-83f5-633e1b1b1e3a req-dc9c7fce-2390-474c-88c4-d408cfb79b4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35982880-caba-4b90-80e1-3561ee53888b", "name": "network-vif-plugged", "status": "completed", "tag": "a2122170-a7ba-49ff-ae2d-2eb0eac1767f"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:20.956222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f4a36582-f92a-4b41-83f5-633e1b1b1e3a req-dc9c7fce-2390-474c-88c4-d408cfb79b4d service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:20.957166 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f4a36582-f92a-4b41-83f5-633e1b1b1e3a req-dc9c7fce-2390-474c-88c4-d408cfb79b4d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:20.957804 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f4a36582-f92a-4b41-83f5-633e1b1b1e3a req-dc9c7fce-2390-474c-88c4-d408cfb79b4d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:20.974505 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-f4a36582-f92a-4b41-83f5-633e1b1b1e3a req-dc9c7fce-2390-474c-88c4-d408cfb79b4d service nova] Creating event network-vif-plugged:a2122170-a7ba-49ff-ae2d-2eb0eac1767f for instance 35982880-caba-4b90-80e1-3561ee53888b on n-h2-862967-2 Oct 29 03:02:20.983073 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-f4a36582-f92a-4b41-83f5-633e1b1b1e3a req-dc9c7fce-2390-474c-88c4-d408cfb79b4d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085368 Oct 29 03:02:20.984462 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1638/3461] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:21.001726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-89e91938-48eb-43e0-bff6-e331f62de749 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:21.004162 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6109a01c-81a4-4bb0-8a64-06d4535bac39 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.106113 Oct 29 03:02:21.004999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-89e91938-48eb-43e0-bff6-e331f62de749 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:21.005505 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1824/3462] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:02:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:02:21.018339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e216d3e5-d26a-454a-b1c0-58f479cc7aaf tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff0580829d0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:21.037219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89e91938-48eb-43e0-bff6-e331f62de749 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:21.038046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89e91938-48eb-43e0-bff6-e331f62de749 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:21.041732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89e91938-48eb-43e0-bff6-e331f62de749 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:21.042851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89e91938-48eb-43e0-bff6-e331f62de749 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:21.043741 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89e91938-48eb-43e0-bff6-e331f62de749 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:21.044450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89e91938-48eb-43e0-bff6-e331f62de749 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:22.284070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-89e91938-48eb-43e0-bff6-e331f62de749 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:22.312669 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-89e91938-48eb-43e0-bff6-e331f62de749 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:22.322844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-89e91938-48eb-43e0-bff6-e331f62de749 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:22.330831 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-89e91938-48eb-43e0-bff6-e331f62de749 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1408 microversion: 2.20 time: 1.341925 Oct 29 03:02:22.337056 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1639/3463] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:20 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1408 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:22.365596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2295b946-2c16-4632-87be-7cc288e2285f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:22.366917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2295b946-2c16-4632-87be-7cc288e2285f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:22.402186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2295b946-2c16-4632-87be-7cc288e2285f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:22.404563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2295b946-2c16-4632-87be-7cc288e2285f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:22.411908 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2295b946-2c16-4632-87be-7cc288e2285f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:22.416591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2295b946-2c16-4632-87be-7cc288e2285f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:22.419894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2295b946-2c16-4632-87be-7cc288e2285f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:22.421143 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2295b946-2c16-4632-87be-7cc288e2285f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:22.545602 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e216d3e5-d26a-454a-b1c0-58f479cc7aaf tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "DELETE /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a" status: 204 len: 0 microversion: 2.1 time: 1.538614 Oct 29 03:02:22.547339 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1825/3464] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:21 2022] DELETE /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a => generated 0 bytes in 1541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:02:22.553426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-85420a19-894b-41b1-9103-0077817ca510 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:22.554406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2295b946-2c16-4632-87be-7cc288e2285f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:02:22.557021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-85420a19-894b-41b1-9103-0077817ca510 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 2a076d87-4f15-4e95-9be9-c89b035c72e2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:22.591920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-85420a19-894b-41b1-9103-0077817ca510 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:22.593932 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-85420a19-894b-41b1-9103-0077817ca510 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:22.595073 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-85420a19-894b-41b1-9103-0077817ca510 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:22.615668 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-85420a19-894b-41b1-9103-0077817ca510 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:22.616292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-85420a19-894b-41b1-9103-0077817ca510 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:22.618345 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-85420a19-894b-41b1-9103-0077817ca510 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:22.821575 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2295b946-2c16-4632-87be-7cc288e2285f tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "DELETE /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878" status: 204 len: 0 microversion: 2.1 time: 0.481682 Oct 29 03:02:22.828930 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1640/3465] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:02:22 2022] DELETE /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:02:22.841562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ee91f762-1752-4ff9-bb7d-d26a63964181 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:22.843448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ee91f762-1752-4ff9-bb7d-d26a63964181 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] [instance: 7c79b743-fe77-42f1-88b9-594bc077b85b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:22.865311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee91f762-1752-4ff9-bb7d-d26a63964181 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:22.866276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee91f762-1752-4ff9-bb7d-d26a63964181 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:22.866989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee91f762-1752-4ff9-bb7d-d26a63964181 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:22.867950 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee91f762-1752-4ff9-bb7d-d26a63964181 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:22.868612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee91f762-1752-4ff9-bb7d-d26a63964181 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:22.869291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee91f762-1752-4ff9-bb7d-d26a63964181 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:22.925151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-85420a19-894b-41b1-9103-0077817ca510 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:22.949766 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-85420a19-894b-41b1-9103-0077817ca510 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/2a076d87-4f15-4e95-9be9-c89b035c72e2" status: 200 len: 1278 microversion: 2.1 time: 0.400727 Oct 29 03:02:22.950870 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1826/3466] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:22 2022] GET /compute/v2.1/servers/2a076d87-4f15-4e95-9be9-c89b035c72e2 => generated 1278 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:22.967624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6c40cb23-75e1-4273-b48f-a483b6cef4e2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:22.968836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6c40cb23-75e1-4273-b48f-a483b6cef4e2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 35982880-caba-4b90-80e1-3561ee53888b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:22.979840 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c40cb23-75e1-4273-b48f-a483b6cef4e2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:22.983809 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c40cb23-75e1-4273-b48f-a483b6cef4e2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:22.984730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c40cb23-75e1-4273-b48f-a483b6cef4e2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:22.986097 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c40cb23-75e1-4273-b48f-a483b6cef4e2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:22.986895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c40cb23-75e1-4273-b48f-a483b6cef4e2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:22.989021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c40cb23-75e1-4273-b48f-a483b6cef4e2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:23.052219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ee91f762-1752-4ff9-bb7d-d26a63964181 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d9c179a03f443c91b5e14528a332cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a563dd48004e3891a26468125ca652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:23.066159 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ee91f762-1752-4ff9-bb7d-d26a63964181 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] 10.222.0.46 "GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b" status: 200 len: 1268 microversion: 2.1 time: 0.233886 Oct 29 03:02:23.067258 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1641/3467] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:22 2022] GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b => generated 1268 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:23.080618 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-11fd8943-e630-4657-9f56-37ae00753e28 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:23.081445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-11fd8943-e630-4657-9f56-37ae00753e28 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 28d33b72-926b-49d9-8807-1d2be68c487f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:23.092865 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11fd8943-e630-4657-9f56-37ae00753e28 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:23.093947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11fd8943-e630-4657-9f56-37ae00753e28 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:23.094618 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11fd8943-e630-4657-9f56-37ae00753e28 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:23.095819 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11fd8943-e630-4657-9f56-37ae00753e28 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:23.096867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11fd8943-e630-4657-9f56-37ae00753e28 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:23.098208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11fd8943-e630-4657-9f56-37ae00753e28 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:23.142477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-11fd8943-e630-4657-9f56-37ae00753e28 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 28d33b72-926b-49d9-8807-1d2be68c487f] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:02:23.349542 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-11fd8943-e630-4657-9f56-37ae00753e28 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "DELETE /compute/v2.1/servers/28d33b72-926b-49d9-8807-1d2be68c487f" status: 204 len: 0 microversion: 2.1 time: 0.278294 Oct 29 03:02:23.351020 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1642/3468] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:02:23 2022] DELETE /compute/v2.1/servers/28d33b72-926b-49d9-8807-1d2be68c487f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:02:23.357275 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ffdcf936-1ef0-4672-ba68-fe76d1d3ce19 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:23.358322 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ffdcf936-1ef0-4672-ba68-fe76d1d3ce19 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:23.380368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ffdcf936-1ef0-4672-ba68-fe76d1d3ce19 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:23.382457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ffdcf936-1ef0-4672-ba68-fe76d1d3ce19 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:23.383438 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ffdcf936-1ef0-4672-ba68-fe76d1d3ce19 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:23.385633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ffdcf936-1ef0-4672-ba68-fe76d1d3ce19 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:23.388001 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ffdcf936-1ef0-4672-ba68-fe76d1d3ce19 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:23.388861 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ffdcf936-1ef0-4672-ba68-fe76d1d3ce19 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:23.693581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6c40cb23-75e1-4273-b48f-a483b6cef4e2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:23.708270 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6c40cb23-75e1-4273-b48f-a483b6cef4e2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b" status: 200 len: 1315 microversion: 2.1 time: 0.744965 Oct 29 03:02:23.712356 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1827/3469] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:22 2022] GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b => generated 1315 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:23.727099 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-860f7bd0-0509-4792-983e-10f38600c596 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:23.730072 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-860f7bd0-0509-4792-983e-10f38600c596 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:23.744768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-860f7bd0-0509-4792-983e-10f38600c596 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:23.747826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-860f7bd0-0509-4792-983e-10f38600c596 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:23.748276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-860f7bd0-0509-4792-983e-10f38600c596 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:23.754688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-860f7bd0-0509-4792-983e-10f38600c596 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:23.758366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-860f7bd0-0509-4792-983e-10f38600c596 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:23.759066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-860f7bd0-0509-4792-983e-10f38600c596 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:23.884758 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ffdcf936-1ef0-4672-ba68-fe76d1d3ce19 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:23.898435 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ffdcf936-1ef0-4672-ba68-fe76d1d3ce19 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878" status: 200 len: 1500 microversion: 2.1 time: 0.545830 Oct 29 03:02:23.900316 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1643/3470] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:23 2022] GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 => generated 1500 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:23.905839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b981ba07-5565-40e5-8e1f-fe10db89acb7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-445487535", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "18fc4cb9-056a-42e1-bd8a-e4a27cb291b2"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:23.985188 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-b981ba07-5565-40e5-8e1f-fe10db89acb7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] validate_networks() for [('18fc4cb9-056a-42e1-bd8a-e4a27cb291b2', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:02:24.723548 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-860f7bd0-0509-4792-983e-10f38600c596 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:24.734483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-860f7bd0-0509-4792-983e-10f38600c596 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:24.736696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-860f7bd0-0509-4792-983e-10f38600c596 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:24.738537 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-860f7bd0-0509-4792-983e-10f38600c596 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1408 microversion: 2.20 time: 1.023531 Oct 29 03:02:24.739541 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1828/3471] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:23 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1408 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:24.766879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-86b03406-9992-44c3-b642-b87fcfb0a4ea tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:24.768066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-86b03406-9992-44c3-b642-b87fcfb0a4ea tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 2a076d87-4f15-4e95-9be9-c89b035c72e2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:24.776674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:24.781056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86b03406-9992-44c3-b642-b87fcfb0a4ea tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:24.782077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86b03406-9992-44c3-b642-b87fcfb0a4ea tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:24.782933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86b03406-9992-44c3-b642-b87fcfb0a4ea tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:24.784298 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86b03406-9992-44c3-b642-b87fcfb0a4ea tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:24.785069 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86b03406-9992-44c3-b642-b87fcfb0a4ea tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:24.785746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86b03406-9992-44c3-b642-b87fcfb0a4ea tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:25.216498 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-86b03406-9992-44c3-b642-b87fcfb0a4ea tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:25.238810 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-86b03406-9992-44c3-b642-b87fcfb0a4ea tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/2a076d87-4f15-4e95-9be9-c89b035c72e2" status: 200 len: 1320 microversion: 2.1 time: 0.480927 Oct 29 03:02:25.243314 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1829/3472] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:24 2022] GET /compute/v2.1/servers/2a076d87-4f15-4e95-9be9-c89b035c72e2 => generated 1320 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:25.257418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-4d61986b-4d78-43c2-b64f-80721b596fb8 req-6b4a0226-6166-417d-bbea-67a9ccacdf54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "354cb0c1-2737-486f-8e3b-d119c49a46a7", "tag": "0e820bc1-bfed-42bc-8698-d91dc009de10"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:25.268278 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4d61986b-4d78-43c2-b64f-80721b596fb8 req-6b4a0226-6166-417d-bbea-67a9ccacdf54 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:25.268789 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4d61986b-4d78-43c2-b64f-80721b596fb8 req-6b4a0226-6166-417d-bbea-67a9ccacdf54 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:25.269249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4d61986b-4d78-43c2-b64f-80721b596fb8 req-6b4a0226-6166-417d-bbea-67a9ccacdf54 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:25.281809 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-4d61986b-4d78-43c2-b64f-80721b596fb8 req-6b4a0226-6166-417d-bbea-67a9ccacdf54 service nova] Creating event network-changed:0e820bc1-bfed-42bc-8698-d91dc009de10 for instance 354cb0c1-2737-486f-8e3b-d119c49a46a7 on n-h1-862967-2 Oct 29 03:02:25.291321 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-4d61986b-4d78-43c2-b64f-80721b596fb8 req-6b4a0226-6166-417d-bbea-67a9ccacdf54 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044243 Oct 29 03:02:25.293041 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1830/3473] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:25.300758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-487d7f70-c3e4-411e-9a92-0ebef7b59acc tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:25.302584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-487d7f70-c3e4-411e-9a92-0ebef7b59acc tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] [instance: 7c79b743-fe77-42f1-88b9-594bc077b85b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:25.311621 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-487d7f70-c3e4-411e-9a92-0ebef7b59acc tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:25.312696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-487d7f70-c3e4-411e-9a92-0ebef7b59acc tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:25.313860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-487d7f70-c3e4-411e-9a92-0ebef7b59acc tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:25.314958 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-487d7f70-c3e4-411e-9a92-0ebef7b59acc tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:25.315587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-487d7f70-c3e4-411e-9a92-0ebef7b59acc tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:25.316114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-487d7f70-c3e4-411e-9a92-0ebef7b59acc tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:25.503476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-487d7f70-c3e4-411e-9a92-0ebef7b59acc tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d9c179a03f443c91b5e14528a332cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a563dd48004e3891a26468125ca652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:25.516050 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-487d7f70-c3e4-411e-9a92-0ebef7b59acc tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] 10.222.0.46 "GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b" status: 200 len: 1274 microversion: 2.1 time: 0.221037 Oct 29 03:02:25.517581 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1831/3474] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:25 2022] GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b => generated 1274 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:25.526390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-376e9e5d-0b0a-4e22-ac1a-3f7c76369977 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:25.527532 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-376e9e5d-0b0a-4e22-ac1a-3f7c76369977 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:25.538476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-376e9e5d-0b0a-4e22-ac1a-3f7c76369977 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:25.539231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-376e9e5d-0b0a-4e22-ac1a-3f7c76369977 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:25.539896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-376e9e5d-0b0a-4e22-ac1a-3f7c76369977 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:25.541065 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-376e9e5d-0b0a-4e22-ac1a-3f7c76369977 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:25.542206 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-376e9e5d-0b0a-4e22-ac1a-3f7c76369977 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:25.542891 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-376e9e5d-0b0a-4e22-ac1a-3f7c76369977 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:25.791116 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-b981ba07-5565-40e5-8e1f-fe10db89acb7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:02:25.791903 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-b981ba07-5565-40e5-8e1f-fe10db89acb7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:02:25.792454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-b981ba07-5565-40e5-8e1f-fe10db89acb7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:02:25.793129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-b981ba07-5565-40e5-8e1f-fe10db89acb7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:02:25.793553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-b981ba07-5565-40e5-8e1f-fe10db89acb7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:02:25.805111 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b981ba07-5565-40e5-8e1f-fe10db89acb7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:25.806831 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b981ba07-5565-40e5-8e1f-fe10db89acb7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:25.807287 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b981ba07-5565-40e5-8e1f-fe10db89acb7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:25.808029 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b981ba07-5565-40e5-8e1f-fe10db89acb7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:25.808745 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b981ba07-5565-40e5-8e1f-fe10db89acb7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:25.809376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b981ba07-5565-40e5-8e1f-fe10db89acb7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:25.832139 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-b981ba07-5565-40e5-8e1f-fe10db89acb7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Getting quotas for project 185d32c10dd845768f4ff70a85680358. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:02:25.839062 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-b981ba07-5565-40e5-8e1f-fe10db89acb7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Getting quotas for user c866f273672846eb8d7f4f2a00269666 and project 185d32c10dd845768f4ff70a85680358. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:02:25.853312 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b981ba07-5565-40e5-8e1f-fe10db89acb7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:02:25.855844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b981ba07-5565-40e5-8e1f-fe10db89acb7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 2f159c62-4461-466d-8a38-85d781f27563] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:02:25.930573 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b981ba07-5565-40e5-8e1f-fe10db89acb7 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.028911 Oct 29 03:02:25.937657 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1644/3475] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:02:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:02:25.945756 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b97ec1f4-c655-4bc6-b2e4-f201bfdb6c21 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:25.949218 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b97ec1f4-c655-4bc6-b2e4-f201bfdb6c21 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 35982880-caba-4b90-80e1-3561ee53888b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:25.960000 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b97ec1f4-c655-4bc6-b2e4-f201bfdb6c21 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:25.962554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b97ec1f4-c655-4bc6-b2e4-f201bfdb6c21 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:25.963591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b97ec1f4-c655-4bc6-b2e4-f201bfdb6c21 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:25.965463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b97ec1f4-c655-4bc6-b2e4-f201bfdb6c21 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:25.966305 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b97ec1f4-c655-4bc6-b2e4-f201bfdb6c21 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:25.967334 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b97ec1f4-c655-4bc6-b2e4-f201bfdb6c21 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:26.109840 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-376e9e5d-0b0a-4e22-ac1a-3f7c76369977 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:26.130456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-376e9e5d-0b0a-4e22-ac1a-3f7c76369977 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:26.141216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-376e9e5d-0b0a-4e22-ac1a-3f7c76369977 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:26.145255 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-376e9e5d-0b0a-4e22-ac1a-3f7c76369977 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 2949 microversion: 2.32 time: 0.622674 Oct 29 03:02:26.146390 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1832/3476] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:25 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 2949 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:26.153802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c2045b77-a51c-4b24-ab11-86c5a6ae3879 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:26.154458 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c2045b77-a51c-4b24-ab11-86c5a6ae3879 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:26.164260 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c2045b77-a51c-4b24-ab11-86c5a6ae3879 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:26.164825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c2045b77-a51c-4b24-ab11-86c5a6ae3879 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:26.165803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c2045b77-a51c-4b24-ab11-86c5a6ae3879 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:26.172718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c2045b77-a51c-4b24-ab11-86c5a6ae3879 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:26.173467 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c2045b77-a51c-4b24-ab11-86c5a6ae3879 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:26.174191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c2045b77-a51c-4b24-ab11-86c5a6ae3879 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:26.376147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c2045b77-a51c-4b24-ab11-86c5a6ae3879 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68198185a8314417b2b5d09e831ff4fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c877c178847ad8e652dda9a20e724', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:26.395812 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c2045b77-a51c-4b24-ab11-86c5a6ae3879 tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878" status: 200 len: 1458 microversion: 2.1 time: 0.247270 Oct 29 03:02:26.396688 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1833/3477] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:26 2022] GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 => generated 1458 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:26.415507 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b97ec1f4-c655-4bc6-b2e4-f201bfdb6c21 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:26.420395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e079b96a-25f1-4150-acf4-5494bba3179d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:26.421483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e079b96a-25f1-4150-acf4-5494bba3179d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:26.434811 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b97ec1f4-c655-4bc6-b2e4-f201bfdb6c21 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b" status: 200 len: 1502 microversion: 2.1 time: 0.495735 Oct 29 03:02:26.435781 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1645/3478] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:25 2022] GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b => generated 1502 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:26.447099 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e079b96a-25f1-4150-acf4-5494bba3179d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:26.448138 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e079b96a-25f1-4150-acf4-5494bba3179d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:26.449879 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5e434bb2-4d91-487f-a26f-2847d016f4b0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:26.450437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e079b96a-25f1-4150-acf4-5494bba3179d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:26.451323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5e434bb2-4d91-487f-a26f-2847d016f4b0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 2f159c62-4461-466d-8a38-85d781f27563] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:26.457156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e079b96a-25f1-4150-acf4-5494bba3179d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:26.460246 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e079b96a-25f1-4150-acf4-5494bba3179d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:26.461618 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e079b96a-25f1-4150-acf4-5494bba3179d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:26.633410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5e434bb2-4d91-487f-a26f-2847d016f4b0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:26.649751 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5e434bb2-4d91-487f-a26f-2847d016f4b0 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563" status: 200 len: 1207 microversion: 2.1 time: 0.213232 Oct 29 03:02:26.665841 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1646/3479] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:26 2022] GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563 => generated 1207 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:26.690466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-96e685c5-d026-485f-ac61-4ae8359b14ea tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:26.692576 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-96e685c5-d026-485f-ac61-4ae8359b14ea tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:26.700353 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=12,nova_api:UPDATE=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:26.714283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96e685c5-d026-485f-ac61-4ae8359b14ea tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:26.715606 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96e685c5-d026-485f-ac61-4ae8359b14ea tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:26.716554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96e685c5-d026-485f-ac61-4ae8359b14ea tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:26.717911 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96e685c5-d026-485f-ac61-4ae8359b14ea tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:26.718565 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96e685c5-d026-485f-ac61-4ae8359b14ea tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:26.719186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96e685c5-d026-485f-ac61-4ae8359b14ea tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:27.001962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e079b96a-25f1-4150-acf4-5494bba3179d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:27.015842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e079b96a-25f1-4150-acf4-5494bba3179d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:27.017828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e079b96a-25f1-4150-acf4-5494bba3179d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:27.021272 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e079b96a-25f1-4150-acf4-5494bba3179d tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1408 microversion: 2.20 time: 0.623168 Oct 29 03:02:27.022079 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1834/3480] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:26 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1408 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:27.035505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-31c2ecdc-8bb5-46b4-8bd2-7ffa66692a0a tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:27.036499 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-31c2ecdc-8bb5-46b4-8bd2-7ffa66692a0a tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 2a076d87-4f15-4e95-9be9-c89b035c72e2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:27.048456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31c2ecdc-8bb5-46b4-8bd2-7ffa66692a0a tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:27.049256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31c2ecdc-8bb5-46b4-8bd2-7ffa66692a0a tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:27.050315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31c2ecdc-8bb5-46b4-8bd2-7ffa66692a0a tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:27.055305 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-96e685c5-d026-485f-ac61-4ae8359b14ea tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.384445 Oct 29 03:02:27.060920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31c2ecdc-8bb5-46b4-8bd2-7ffa66692a0a tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:27.061783 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31c2ecdc-8bb5-46b4-8bd2-7ffa66692a0a tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:27.062410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31c2ecdc-8bb5-46b4-8bd2-7ffa66692a0a tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:27.088157 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1647/3481] 10.222.0.46 () {60 vars in 1316 bytes} [Sat Oct 29 03:02:26 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108/os-interface => generated 1831 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:27.096969 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6805cc74-2433-4489-a8f6-e82bd5f99f7e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:27.097989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6805cc74-2433-4489-a8f6-e82bd5f99f7e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 35982880-caba-4b90-80e1-3561ee53888b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:27.108687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6805cc74-2433-4489-a8f6-e82bd5f99f7e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:27.109369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6805cc74-2433-4489-a8f6-e82bd5f99f7e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:27.110312 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6805cc74-2433-4489-a8f6-e82bd5f99f7e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:27.112021 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6805cc74-2433-4489-a8f6-e82bd5f99f7e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:27.112809 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6805cc74-2433-4489-a8f6-e82bd5f99f7e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:27.113461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6805cc74-2433-4489-a8f6-e82bd5f99f7e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:27.165786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-6805cc74-2433-4489-a8f6-e82bd5f99f7e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lazy-loading 'flavor' on Instance uuid 35982880-caba-4b90-80e1-3561ee53888b {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:02:27.227386 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:27.321616 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6805cc74-2433-4489-a8f6-e82bd5f99f7e tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "POST /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b/action" status: 202 len: 0 microversion: 2.1 time: 0.227643 Oct 29 03:02:27.325538 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1648/3482] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:02:27 2022] POST /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:02:27.341166 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5d727066-6103-4709-8d70-574bce32cb99 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:27.342864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5d727066-6103-4709-8d70-574bce32cb99 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] [instance: 7c79b743-fe77-42f1-88b9-594bc077b85b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:27.361112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d727066-6103-4709-8d70-574bce32cb99 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:27.363508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d727066-6103-4709-8d70-574bce32cb99 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:27.364388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d727066-6103-4709-8d70-574bce32cb99 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:27.367732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d727066-6103-4709-8d70-574bce32cb99 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:27.368754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d727066-6103-4709-8d70-574bce32cb99 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:27.369592 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d727066-6103-4709-8d70-574bce32cb99 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:27.772384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-31c2ecdc-8bb5-46b4-8bd2-7ffa66692a0a tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:27.796083 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-31c2ecdc-8bb5-46b4-8bd2-7ffa66692a0a tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/2a076d87-4f15-4e95-9be9-c89b035c72e2" status: 200 len: 1320 microversion: 2.1 time: 0.771467 Oct 29 03:02:27.797449 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1835/3483] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:27 2022] GET /compute/v2.1/servers/2a076d87-4f15-4e95-9be9-c89b035c72e2 => generated 1320 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:27.804807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-45d2b39f-ad94-4ead-973c-62b5695eed11 req-756b5c6d-e5f0-4269-babf-314c6d55757b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28d33b72-926b-49d9-8807-1d2be68c487f", "name": "network-vif-deleted", "tag": "5a2e20a8-d25a-49ae-9802-e29f037f1ef2"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:27.825050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-45d2b39f-ad94-4ead-973c-62b5695eed11 req-756b5c6d-e5f0-4269-babf-314c6d55757b service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:27.828919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-45d2b39f-ad94-4ead-973c-62b5695eed11 req-756b5c6d-e5f0-4269-babf-314c6d55757b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:27.828919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-45d2b39f-ad94-4ead-973c-62b5695eed11 req-756b5c6d-e5f0-4269-babf-314c6d55757b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:27.860231 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-45d2b39f-ad94-4ead-973c-62b5695eed11 req-756b5c6d-e5f0-4269-babf-314c6d55757b service nova] Creating event network-vif-deleted:5a2e20a8-d25a-49ae-9802-e29f037f1ef2 for instance 28d33b72-926b-49d9-8807-1d2be68c487f on n-h2-862967-2 Oct 29 03:02:27.866544 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-45d2b39f-ad94-4ead-973c-62b5695eed11 req-756b5c6d-e5f0-4269-babf-314c6d55757b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067226 Oct 29 03:02:27.867506 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1836/3484] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:27.877837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6b567082-6cd2-4f49-adc1-f01d60f7012a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:27.879097 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6b567082-6cd2-4f49-adc1-f01d60f7012a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 35982880-caba-4b90-80e1-3561ee53888b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:27.889434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b567082-6cd2-4f49-adc1-f01d60f7012a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:27.891990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b567082-6cd2-4f49-adc1-f01d60f7012a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:27.892992 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b567082-6cd2-4f49-adc1-f01d60f7012a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:27.894055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b567082-6cd2-4f49-adc1-f01d60f7012a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:27.895875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b567082-6cd2-4f49-adc1-f01d60f7012a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:27.896757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b567082-6cd2-4f49-adc1-f01d60f7012a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:27.902540 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:27.913006 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5d727066-6103-4709-8d70-574bce32cb99 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d9c179a03f443c91b5e14528a332cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a563dd48004e3891a26468125ca652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:27.925149 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5d727066-6103-4709-8d70-574bce32cb99 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] 10.222.0.46 "GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b" status: 200 len: 1316 microversion: 2.1 time: 0.597125 Oct 29 03:02:27.943350 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1649/3485] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:27 2022] GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b => generated 1316 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:27.948433 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-55f4181d-525b-4531-be11-8972846e771c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:27.956500 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-55f4181d-525b-4531-be11-8972846e771c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] [instance: 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:27.965855 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55f4181d-525b-4531-be11-8972846e771c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:27.975084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55f4181d-525b-4531-be11-8972846e771c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:27.975528 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55f4181d-525b-4531-be11-8972846e771c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:27.976289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55f4181d-525b-4531-be11-8972846e771c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:27.976779 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55f4181d-525b-4531-be11-8972846e771c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:27.977209 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55f4181d-525b-4531-be11-8972846e771c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:27.998384 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-55f4181d-525b-4531-be11-8972846e771c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] HTTP exception thrown: Instance 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 could not be found. Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-55f4181d-525b-4531-be11-8972846e771c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Request method failure captured: Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 HTTP/1.1 Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJXoG6-UKDd9auDnzRVlkQ2zkHgW8odihP0OMPkk3MkQzP1iYAQeSLWa3_nBbe64sCGvORDOOctsBAz0GOq1EIDZXpFzKkPlAWbyoSnVA9HbDyOFDBRBWmjMCnBXT25QcAIdCS8c7ut6W0v9Gq-r1pDCwvRALfmH54avwg2SRXKJw1k Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: cb1c877c178847ad8e652dda9a20e724 Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-LiveMigrationTest-268263720 Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cb1c877c178847ad8e652dda9a20e724"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cb1c877c178847ad8e652dda9a20e724"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_cb1c877c178847ad8e652dda9a20e724"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/cb1c877c178847ad8e652dda9a20e724"}]}] Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-LiveMigrationTest-268263720 Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: cb1c877c178847ad8e652dda9a20e724 Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-LiveMigrationTest-268263720 Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-LiveMigrationTest-268263720-project Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 68198185a8314417b2b5d09e831ff4fd Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-LiveMigrationTest-268263720-project Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 could not be found. Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '42ddcbfc-a37e-4d2f-8e07-c28bfcf40878'} Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 could not be found. Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 could not be found. Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:28.000074 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:28.006147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:28.006147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:28.006147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:28.006147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:28.006147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:28.006147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 could not be found. Oct 29 03:02:28.006147 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:28.012829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-55f4181d-525b-4531-be11-8972846e771c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] Returning 404 to user: Instance 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:28.013898 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-55f4181d-525b-4531-be11-8972846e771c tempest-LiveMigrationTest-268263720 tempest-LiveMigrationTest-268263720-project] 10.222.0.46 "GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878" status: 404 len: 111 microversion: 2.1 time: 0.069341 Oct 29 03:02:28.014677 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1650/3486] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:27 2022] GET /compute/v2.1/servers/42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:28.019653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-2cc6a3e8-5d08-40e8-ab3b-a87b1af7d48d req-914403a8-1058-4e30-a56b-ce5dafbaf3ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42ddcbfc-a37e-4d2f-8e07-c28bfcf40878", "name": "network-vif-deleted", "tag": "8c18d333-2ae5-4735-96e6-5b6ea458aef2"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:28.047936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2cc6a3e8-5d08-40e8-ab3b-a87b1af7d48d req-914403a8-1058-4e30-a56b-ce5dafbaf3ec service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:28.055380 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2cc6a3e8-5d08-40e8-ab3b-a87b1af7d48d req-914403a8-1058-4e30-a56b-ce5dafbaf3ec service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:28.056129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2cc6a3e8-5d08-40e8-ab3b-a87b1af7d48d req-914403a8-1058-4e30-a56b-ce5dafbaf3ec service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:28.074219 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-2cc6a3e8-5d08-40e8-ab3b-a87b1af7d48d req-914403a8-1058-4e30-a56b-ce5dafbaf3ec service nova] Creating event network-vif-deleted:8c18d333-2ae5-4735-96e6-5b6ea458aef2 for instance 42ddcbfc-a37e-4d2f-8e07-c28bfcf40878 on n-h2-862967-2 Oct 29 03:02:28.095123 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-2cc6a3e8-5d08-40e8-ab3b-a87b1af7d48d req-914403a8-1058-4e30-a56b-ce5dafbaf3ec service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078864 Oct 29 03:02:28.096400 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1651/3487] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:28.103296 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3ce7dfd0-751c-44f1-95f2-e5ecf343434d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:28.104191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3ce7dfd0-751c-44f1-95f2-e5ecf343434d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 2f159c62-4461-466d-8a38-85d781f27563] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:28.120864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ce7dfd0-751c-44f1-95f2-e5ecf343434d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:28.121562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ce7dfd0-751c-44f1-95f2-e5ecf343434d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:28.122176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ce7dfd0-751c-44f1-95f2-e5ecf343434d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:28.123173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ce7dfd0-751c-44f1-95f2-e5ecf343434d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:28.123824 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ce7dfd0-751c-44f1-95f2-e5ecf343434d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:28.124417 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ce7dfd0-751c-44f1-95f2-e5ecf343434d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:28.378299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3ce7dfd0-751c-44f1-95f2-e5ecf343434d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:28.394019 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3ce7dfd0-751c-44f1-95f2-e5ecf343434d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563" status: 200 len: 1267 microversion: 2.1 time: 0.293938 Oct 29 03:02:28.404599 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1652/3488] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:28 2022] GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563 => generated 1267 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:28.407441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-175e8d64-0758-4a08-9d9b-d87d27d8a2f4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:28.408120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-175e8d64-0758-4a08-9d9b-d87d27d8a2f4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:28.428306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-175e8d64-0758-4a08-9d9b-d87d27d8a2f4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:28.429093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-175e8d64-0758-4a08-9d9b-d87d27d8a2f4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:28.429543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-175e8d64-0758-4a08-9d9b-d87d27d8a2f4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:28.431580 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-175e8d64-0758-4a08-9d9b-d87d27d8a2f4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:28.434411 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-175e8d64-0758-4a08-9d9b-d87d27d8a2f4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:28.436043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-175e8d64-0758-4a08-9d9b-d87d27d8a2f4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:28.519169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6b567082-6cd2-4f49-adc1-f01d60f7012a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:28.532645 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6b567082-6cd2-4f49-adc1-f01d60f7012a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b" status: 200 len: 1510 microversion: 2.1 time: 0.663624 Oct 29 03:02:28.534345 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1837/3489] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:27 2022] GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b => generated 1510 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:28.844710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4b20cdbf-38fb-4e13-940a-e48bf4a5f84c tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:28.845401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4b20cdbf-38fb-4e13-940a-e48bf4a5f84c tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 2a076d87-4f15-4e95-9be9-c89b035c72e2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:28.858102 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b20cdbf-38fb-4e13-940a-e48bf4a5f84c tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:28.858599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b20cdbf-38fb-4e13-940a-e48bf4a5f84c tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:28.859034 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b20cdbf-38fb-4e13-940a-e48bf4a5f84c tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:28.868243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b20cdbf-38fb-4e13-940a-e48bf4a5f84c tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:28.868889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b20cdbf-38fb-4e13-940a-e48bf4a5f84c tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:28.869337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b20cdbf-38fb-4e13-940a-e48bf4a5f84c tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:29.094580 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-175e8d64-0758-4a08-9d9b-d87d27d8a2f4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:29.138706 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-175e8d64-0758-4a08-9d9b-d87d27d8a2f4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:29.143657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-175e8d64-0758-4a08-9d9b-d87d27d8a2f4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:29.149384 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-175e8d64-0758-4a08-9d9b-d87d27d8a2f4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1408 microversion: 2.20 time: 0.750028 Oct 29 03:02:29.151654 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1653/3490] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:28 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1408 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:29.158737 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-60556149-62de-4502-b6cc-10dd66eb707c tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:29.159850 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-60556149-62de-4502-b6cc-10dd66eb707c tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] [instance: 7c79b743-fe77-42f1-88b9-594bc077b85b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:29.174424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-60556149-62de-4502-b6cc-10dd66eb707c tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:29.174920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-60556149-62de-4502-b6cc-10dd66eb707c tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:29.175543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-60556149-62de-4502-b6cc-10dd66eb707c tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:29.176553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-60556149-62de-4502-b6cc-10dd66eb707c tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:29.177246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-60556149-62de-4502-b6cc-10dd66eb707c tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:29.177887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-60556149-62de-4502-b6cc-10dd66eb707c tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:29.561424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-60556149-62de-4502-b6cc-10dd66eb707c tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d9c179a03f443c91b5e14528a332cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a563dd48004e3891a26468125ca652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:29.570831 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-60556149-62de-4502-b6cc-10dd66eb707c tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] 10.222.0.46 "GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b" status: 200 len: 1316 microversion: 2.1 time: 0.416357 Oct 29 03:02:29.572248 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1654/3491] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:29 2022] GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b => generated 1316 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:29.578770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8fb0aece-4087-4ed3-af01-527f4be2ecef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:29.579758 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8fb0aece-4087-4ed3-af01-527f4be2ecef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 2f159c62-4461-466d-8a38-85d781f27563] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:29.586955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8fb0aece-4087-4ed3-af01-527f4be2ecef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:29.587634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8fb0aece-4087-4ed3-af01-527f4be2ecef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:29.588451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8fb0aece-4087-4ed3-af01-527f4be2ecef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:29.589191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8fb0aece-4087-4ed3-af01-527f4be2ecef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:29.589679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8fb0aece-4087-4ed3-af01-527f4be2ecef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:29.590071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8fb0aece-4087-4ed3-af01-527f4be2ecef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:29.684317 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4b20cdbf-38fb-4e13-940a-e48bf4a5f84c tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:29.697378 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4b20cdbf-38fb-4e13-940a-e48bf4a5f84c tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/2a076d87-4f15-4e95-9be9-c89b035c72e2" status: 200 len: 1320 microversion: 2.1 time: 0.857072 Oct 29 03:02:29.698452 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1838/3492] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:28 2022] GET /compute/v2.1/servers/2a076d87-4f15-4e95-9be9-c89b035c72e2 => generated 1320 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:02:29.707071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f90ed906-99c2-4a5e-af72-0fc8d82d41c4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:29.708195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f90ed906-99c2-4a5e-af72-0fc8d82d41c4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 35982880-caba-4b90-80e1-3561ee53888b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:29.708350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8fb0aece-4087-4ed3-af01-527f4be2ecef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:29.719547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f90ed906-99c2-4a5e-af72-0fc8d82d41c4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:29.720623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f90ed906-99c2-4a5e-af72-0fc8d82d41c4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:29.721374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f90ed906-99c2-4a5e-af72-0fc8d82d41c4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:29.722352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f90ed906-99c2-4a5e-af72-0fc8d82d41c4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:29.723005 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f90ed906-99c2-4a5e-af72-0fc8d82d41c4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:29.723587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f90ed906-99c2-4a5e-af72-0fc8d82d41c4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:29.724384 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8fb0aece-4087-4ed3-af01-527f4be2ecef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563" status: 200 len: 1265 microversion: 2.1 time: 0.148488 Oct 29 03:02:29.725680 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1655/3493] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:29 2022] GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:29.948906 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-daf3737f-a745-40df-afc5-bc2be7277a4d req-bf581daf-f566-4cc9-aaec-7edea7c6ecfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a076d87-4f15-4e95-9be9-c89b035c72e2", "tag": "fc7e740a-c632-4df7-8793-3d1049c7d1f1"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:29.960128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-daf3737f-a745-40df-afc5-bc2be7277a4d req-bf581daf-f566-4cc9-aaec-7edea7c6ecfd service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:29.960620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-daf3737f-a745-40df-afc5-bc2be7277a4d req-bf581daf-f566-4cc9-aaec-7edea7c6ecfd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:29.961503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-daf3737f-a745-40df-afc5-bc2be7277a4d req-bf581daf-f566-4cc9-aaec-7edea7c6ecfd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:29.975355 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-daf3737f-a745-40df-afc5-bc2be7277a4d req-bf581daf-f566-4cc9-aaec-7edea7c6ecfd service nova] Creating event network-changed:fc7e740a-c632-4df7-8793-3d1049c7d1f1 for instance 2a076d87-4f15-4e95-9be9-c89b035c72e2 on n-h2-862967-2 Oct 29 03:02:29.980934 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-daf3737f-a745-40df-afc5-bc2be7277a4d req-bf581daf-f566-4cc9-aaec-7edea7c6ecfd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035996 Oct 29 03:02:29.981528 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1656/3494] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:02:30.012398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f90ed906-99c2-4a5e-af72-0fc8d82d41c4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:30.022491 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f90ed906-99c2-4a5e-af72-0fc8d82d41c4 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b" status: 200 len: 1493 microversion: 2.1 time: 0.322132 Oct 29 03:02:30.023229 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1839/3495] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:29 2022] GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b => generated 1493 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:30.052313 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-549a29ea-196b-4b16-886b-3647ed6aacd1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:30.053375 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-549a29ea-196b-4b16-886b-3647ed6aacd1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 35982880-caba-4b90-80e1-3561ee53888b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:30.063565 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-549a29ea-196b-4b16-886b-3647ed6aacd1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:30.064647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-549a29ea-196b-4b16-886b-3647ed6aacd1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:30.065341 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-549a29ea-196b-4b16-886b-3647ed6aacd1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:30.067165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-549a29ea-196b-4b16-886b-3647ed6aacd1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:30.067918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-549a29ea-196b-4b16-886b-3647ed6aacd1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:30.068500 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-549a29ea-196b-4b16-886b-3647ed6aacd1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:30.101452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-549a29ea-196b-4b16-886b-3647ed6aacd1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 35982880-caba-4b90-80e1-3561ee53888b] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:02:30.170635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-a32336fb-106a-46ef-b652-01653fab0ab2 req-b2bb48b7-c8f6-4713-87e5-f8b6c75729c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a96c21c1-c8a7-4f6f-93d6-ebb2af6240cf", "tag": "a83f3df1-a0d1-43c3-8096-0e9d2fd92e5f"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:30.181519 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a32336fb-106a-46ef-b652-01653fab0ab2 req-b2bb48b7-c8f6-4713-87e5-f8b6c75729c6 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:30.182374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a32336fb-106a-46ef-b652-01653fab0ab2 req-b2bb48b7-c8f6-4713-87e5-f8b6c75729c6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:30.182805 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a32336fb-106a-46ef-b652-01653fab0ab2 req-b2bb48b7-c8f6-4713-87e5-f8b6c75729c6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:30.208018 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-a32336fb-106a-46ef-b652-01653fab0ab2 req-b2bb48b7-c8f6-4713-87e5-f8b6c75729c6 service nova] Creating event network-changed:a83f3df1-a0d1-43c3-8096-0e9d2fd92e5f for instance a96c21c1-c8a7-4f6f-93d6-ebb2af6240cf on n-h1-862967-2 Oct 29 03:02:30.216818 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-549a29ea-196b-4b16-886b-3647ed6aacd1 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "DELETE /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b" status: 204 len: 0 microversion: 2.1 time: 0.169093 Oct 29 03:02:30.221535 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1657/3496] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:02:30 2022] DELETE /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:02:30.222337 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-a32336fb-106a-46ef-b652-01653fab0ab2 req-b2bb48b7-c8f6-4713-87e5-f8b6c75729c6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053863 Oct 29 03:02:30.226739 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3e0044b6-d336-4739-85cf-67e5697b8660 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:30.228041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3e0044b6-d336-4739-85cf-67e5697b8660 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:30.231008 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1840/3497] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:02:30.236922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f164286e-dc15-4d92-8ff1-52322c216d42 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:30.237931 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f164286e-dc15-4d92-8ff1-52322c216d42 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 35982880-caba-4b90-80e1-3561ee53888b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:30.239439 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e0044b6-d336-4739-85cf-67e5697b8660 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:30.240061 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e0044b6-d336-4739-85cf-67e5697b8660 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:30.240626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e0044b6-d336-4739-85cf-67e5697b8660 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:30.242703 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e0044b6-d336-4739-85cf-67e5697b8660 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:30.243859 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e0044b6-d336-4739-85cf-67e5697b8660 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:30.244434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e0044b6-d336-4739-85cf-67e5697b8660 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:30.245701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f164286e-dc15-4d92-8ff1-52322c216d42 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:30.246422 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f164286e-dc15-4d92-8ff1-52322c216d42 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:30.246862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f164286e-dc15-4d92-8ff1-52322c216d42 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:30.247574 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f164286e-dc15-4d92-8ff1-52322c216d42 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:30.248196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f164286e-dc15-4d92-8ff1-52322c216d42 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:30.248829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f164286e-dc15-4d92-8ff1-52322c216d42 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:30.482107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f164286e-dc15-4d92-8ff1-52322c216d42 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:30.496225 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f164286e-dc15-4d92-8ff1-52322c216d42 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b" status: 200 len: 1499 microversion: 2.1 time: 0.263343 Oct 29 03:02:30.512304 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1841/3498] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:30 2022] GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b => generated 1499 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:30.513100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3e0044b6-d336-4739-85cf-67e5697b8660 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:30.538620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3e0044b6-d336-4739-85cf-67e5697b8660 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:30.543984 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3e0044b6-d336-4739-85cf-67e5697b8660 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:30.556640 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3e0044b6-d336-4739-85cf-67e5697b8660 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1408 microversion: 2.20 time: 0.335557 Oct 29 03:02:30.562890 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1658/3499] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:30 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1408 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:30.596796 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a59b94fa-b608-4f5b-b012-dc3bb5486e58 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:30.597654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a59b94fa-b608-4f5b-b012-dc3bb5486e58 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] [instance: 7c79b743-fe77-42f1-88b9-594bc077b85b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:30.606921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a59b94fa-b608-4f5b-b012-dc3bb5486e58 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:30.607635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a59b94fa-b608-4f5b-b012-dc3bb5486e58 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:30.608084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a59b94fa-b608-4f5b-b012-dc3bb5486e58 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:30.612399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a59b94fa-b608-4f5b-b012-dc3bb5486e58 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:30.613212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a59b94fa-b608-4f5b-b012-dc3bb5486e58 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:30.613894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a59b94fa-b608-4f5b-b012-dc3bb5486e58 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:30.723945 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e39d62d3-7ce5-4f2a-8dd9-f8ea7ca8571a tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:30.724678 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e39d62d3-7ce5-4f2a-8dd9-f8ea7ca8571a tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 2a076d87-4f15-4e95-9be9-c89b035c72e2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:30.743919 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e39d62d3-7ce5-4f2a-8dd9-f8ea7ca8571a tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:30.744658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e39d62d3-7ce5-4f2a-8dd9-f8ea7ca8571a tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:30.745660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e39d62d3-7ce5-4f2a-8dd9-f8ea7ca8571a tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:30.746814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e39d62d3-7ce5-4f2a-8dd9-f8ea7ca8571a tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:30.747324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e39d62d3-7ce5-4f2a-8dd9-f8ea7ca8571a tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:30.747749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e39d62d3-7ce5-4f2a-8dd9-f8ea7ca8571a tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:30.781718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:30.868069 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:30.887823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a59b94fa-b608-4f5b-b012-dc3bb5486e58 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d9c179a03f443c91b5e14528a332cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a563dd48004e3891a26468125ca652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:30.901719 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a59b94fa-b608-4f5b-b012-dc3bb5486e58 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] 10.222.0.46 "GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b" status: 200 len: 1316 microversion: 2.1 time: 0.309331 Oct 29 03:02:30.925644 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1842/3500] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:30 2022] GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b => generated 1316 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:30.930758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9f4d8bba-e0d6-4184-bddb-acf0c1f18e2c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:30.931385 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9f4d8bba-e0d6-4184-bddb-acf0c1f18e2c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 2f159c62-4461-466d-8a38-85d781f27563] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:30.951018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f4d8bba-e0d6-4184-bddb-acf0c1f18e2c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:30.951483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f4d8bba-e0d6-4184-bddb-acf0c1f18e2c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:30.951931 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f4d8bba-e0d6-4184-bddb-acf0c1f18e2c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:30.952721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f4d8bba-e0d6-4184-bddb-acf0c1f18e2c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:30.953187 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f4d8bba-e0d6-4184-bddb-acf0c1f18e2c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:30.957496 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f4d8bba-e0d6-4184-bddb-acf0c1f18e2c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:31.304089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9f4d8bba-e0d6-4184-bddb-acf0c1f18e2c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:31.323276 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9f4d8bba-e0d6-4184-bddb-acf0c1f18e2c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563" status: 200 len: 1307 microversion: 2.1 time: 0.394402 Oct 29 03:02:31.324949 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1843/3501] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:30 2022] GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563 => generated 1307 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:31.333182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-27585fec-fd39-4f3e-8764-f16737abefb1 req-ba6e67b6-be80-4f58-acdf-1bcdfe80eacf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "354cb0c1-2737-486f-8e3b-d119c49a46a7", "name": "network-vif-plugged", "status": "completed", "tag": "0e820bc1-bfed-42bc-8698-d91dc009de10"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:31.347704 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-27585fec-fd39-4f3e-8764-f16737abefb1 req-ba6e67b6-be80-4f58-acdf-1bcdfe80eacf service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:31.348194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-27585fec-fd39-4f3e-8764-f16737abefb1 req-ba6e67b6-be80-4f58-acdf-1bcdfe80eacf service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:31.348874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-27585fec-fd39-4f3e-8764-f16737abefb1 req-ba6e67b6-be80-4f58-acdf-1bcdfe80eacf service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:31.368469 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-27585fec-fd39-4f3e-8764-f16737abefb1 req-ba6e67b6-be80-4f58-acdf-1bcdfe80eacf service nova] Creating event network-vif-plugged:0e820bc1-bfed-42bc-8698-d91dc009de10 for instance 354cb0c1-2737-486f-8e3b-d119c49a46a7 on n-h1-862967-2 Oct 29 03:02:31.374215 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-27585fec-fd39-4f3e-8764-f16737abefb1 req-ba6e67b6-be80-4f58-acdf-1bcdfe80eacf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047127 Oct 29 03:02:31.379627 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1844/3502] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:31.537899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4fd1d896-3bdd-4749-a3ae-c9184a619339 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:31.538598 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4fd1d896-3bdd-4749-a3ae-c9184a619339 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 35982880-caba-4b90-80e1-3561ee53888b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:31.547512 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4fd1d896-3bdd-4749-a3ae-c9184a619339 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:31.548197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4fd1d896-3bdd-4749-a3ae-c9184a619339 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:31.548848 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4fd1d896-3bdd-4749-a3ae-c9184a619339 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:31.549849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4fd1d896-3bdd-4749-a3ae-c9184a619339 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:31.550573 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4fd1d896-3bdd-4749-a3ae-c9184a619339 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:31.551066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4fd1d896-3bdd-4749-a3ae-c9184a619339 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:31.603556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e39d62d3-7ce5-4f2a-8dd9-f8ea7ca8571a tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:31.613818 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e39d62d3-7ce5-4f2a-8dd9-f8ea7ca8571a tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/2a076d87-4f15-4e95-9be9-c89b035c72e2" status: 200 len: 1320 microversion: 2.1 time: 0.896177 Oct 29 03:02:31.615090 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1659/3503] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:30 2022] GET /compute/v2.1/servers/2a076d87-4f15-4e95-9be9-c89b035c72e2 => generated 1320 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:31.620907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-92aa6911-21d2-4318-9171-bc207bac3cec tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:31.621811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-92aa6911-21d2-4318-9171-bc207bac3cec tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:31.628257 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92aa6911-21d2-4318-9171-bc207bac3cec tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:31.629162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92aa6911-21d2-4318-9171-bc207bac3cec tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:31.629794 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92aa6911-21d2-4318-9171-bc207bac3cec tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:31.631117 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92aa6911-21d2-4318-9171-bc207bac3cec tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:31.631633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92aa6911-21d2-4318-9171-bc207bac3cec tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:31.632138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92aa6911-21d2-4318-9171-bc207bac3cec tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:32.224505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4fd1d896-3bdd-4749-a3ae-c9184a619339 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:32.236898 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4fd1d896-3bdd-4749-a3ae-c9184a619339 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b" status: 200 len: 1499 microversion: 2.1 time: 0.703338 Oct 29 03:02:32.245164 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1845/3504] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:31 2022] GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b => generated 1499 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:02:32.259048 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5fced2ab-f484-41ad-8efb-450bd2790a04 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:32.259877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5fced2ab-f484-41ad-8efb-450bd2790a04 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] [instance: 7c79b743-fe77-42f1-88b9-594bc077b85b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:32.268627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fced2ab-f484-41ad-8efb-450bd2790a04 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:32.269564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fced2ab-f484-41ad-8efb-450bd2790a04 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:32.270251 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fced2ab-f484-41ad-8efb-450bd2790a04 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:32.271197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fced2ab-f484-41ad-8efb-450bd2790a04 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:32.271880 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fced2ab-f484-41ad-8efb-450bd2790a04 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:32.273073 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fced2ab-f484-41ad-8efb-450bd2790a04 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:32.342980 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-92aa6911-21d2-4318-9171-bc207bac3cec tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:32.356107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-92aa6911-21d2-4318-9171-bc207bac3cec tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:32.357612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-92aa6911-21d2-4318-9171-bc207bac3cec tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:32.358761 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-92aa6911-21d2-4318-9171-bc207bac3cec tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1408 microversion: 2.20 time: 0.741846 Oct 29 03:02:32.359335 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1660/3505] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:31 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1408 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:32.376732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-dd84b365-d389-4344-886a-de4839c9c680 req-108f2c66-4cad-41a0-b102-9812ada22039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c79b743-fe77-42f1-88b9-594bc077b85b", "tag": "c356dc32-a5d0-49c6-a976-d7325331e07d"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:32.376732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-dd84b365-d389-4344-886a-de4839c9c680 req-108f2c66-4cad-41a0-b102-9812ada22039 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:32.376732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-dd84b365-d389-4344-886a-de4839c9c680 req-108f2c66-4cad-41a0-b102-9812ada22039 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:32.376732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-dd84b365-d389-4344-886a-de4839c9c680 req-108f2c66-4cad-41a0-b102-9812ada22039 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:32.388767 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-dd84b365-d389-4344-886a-de4839c9c680 req-108f2c66-4cad-41a0-b102-9812ada22039 service nova] Creating event network-changed:c356dc32-a5d0-49c6-a976-d7325331e07d for instance 7c79b743-fe77-42f1-88b9-594bc077b85b on n-h1-862967-2 Oct 29 03:02:32.399813 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-dd84b365-d389-4344-886a-de4839c9c680 req-108f2c66-4cad-41a0-b102-9812ada22039 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035000 Oct 29 03:02:32.400958 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1661/3506] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:32.408063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4325a57c-7fec-4b0f-998a-6daf7da47aba tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:32.409358 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4325a57c-7fec-4b0f-998a-6daf7da47aba tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 2f159c62-4461-466d-8a38-85d781f27563] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:32.417647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4325a57c-7fec-4b0f-998a-6daf7da47aba tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:32.418460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4325a57c-7fec-4b0f-998a-6daf7da47aba tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:32.419287 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4325a57c-7fec-4b0f-998a-6daf7da47aba tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:32.420382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4325a57c-7fec-4b0f-998a-6daf7da47aba tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:32.421095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4325a57c-7fec-4b0f-998a-6daf7da47aba tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:32.421742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4325a57c-7fec-4b0f-998a-6daf7da47aba tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:32.656626 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5fced2ab-f484-41ad-8efb-450bd2790a04 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d9c179a03f443c91b5e14528a332cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a563dd48004e3891a26468125ca652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:32.667981 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5fced2ab-f484-41ad-8efb-450bd2790a04 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] 10.222.0.46 "GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b" status: 200 len: 1316 microversion: 2.1 time: 0.421248 Oct 29 03:02:32.689422 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1846/3507] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:32 2022] GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b => generated 1316 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:32.697437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ebfd3528-262f-422d-904f-37fc18b4cd43 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:32.698339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ebfd3528-262f-422d-904f-37fc18b4cd43 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 2a076d87-4f15-4e95-9be9-c89b035c72e2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:32.705788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebfd3528-262f-422d-904f-37fc18b4cd43 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:32.706672 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebfd3528-262f-422d-904f-37fc18b4cd43 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:32.707462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebfd3528-262f-422d-904f-37fc18b4cd43 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:32.708463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebfd3528-262f-422d-904f-37fc18b4cd43 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:32.709209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebfd3528-262f-422d-904f-37fc18b4cd43 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:32.710055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebfd3528-262f-422d-904f-37fc18b4cd43 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:33.188718 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4325a57c-7fec-4b0f-998a-6daf7da47aba tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:33.200095 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4325a57c-7fec-4b0f-998a-6daf7da47aba tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563" status: 200 len: 1307 microversion: 2.1 time: 0.795877 Oct 29 03:02:33.202232 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1662/3508] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:32 2022] GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563 => generated 1307 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:33.267157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ad3ceaca-eeeb-4a3c-b725-c5a58a391b74 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:33.267938 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ad3ceaca-eeeb-4a3c-b725-c5a58a391b74 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 35982880-caba-4b90-80e1-3561ee53888b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:33.287373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad3ceaca-eeeb-4a3c-b725-c5a58a391b74 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:33.287942 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad3ceaca-eeeb-4a3c-b725-c5a58a391b74 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:33.288305 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad3ceaca-eeeb-4a3c-b725-c5a58a391b74 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:33.293386 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad3ceaca-eeeb-4a3c-b725-c5a58a391b74 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:33.294133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad3ceaca-eeeb-4a3c-b725-c5a58a391b74 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:33.294585 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad3ceaca-eeeb-4a3c-b725-c5a58a391b74 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:33.417456 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ad3ceaca-eeeb-4a3c-b725-c5a58a391b74 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ee6c4d28f304eab89014b9c46cc555a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67fc8dd1f4349ca85422bd9a08d3e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:33.433821 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ad3ceaca-eeeb-4a3c-b725-c5a58a391b74 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b" status: 200 len: 1457 microversion: 2.1 time: 0.167837 Oct 29 03:02:33.434512 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1663/3509] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:33 2022] GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b => generated 1457 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:33.444053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a60f0498-db9c-41ee-b870-1b497e40e7b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:33.452155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a60f0498-db9c-41ee-b870-1b497e40e7b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:33.460548 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a60f0498-db9c-41ee-b870-1b497e40e7b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:33.461275 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a60f0498-db9c-41ee-b870-1b497e40e7b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:33.461899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a60f0498-db9c-41ee-b870-1b497e40e7b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:33.462776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a60f0498-db9c-41ee-b870-1b497e40e7b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:33.463394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a60f0498-db9c-41ee-b870-1b497e40e7b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:33.463978 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a60f0498-db9c-41ee-b870-1b497e40e7b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:33.515457 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ebfd3528-262f-422d-904f-37fc18b4cd43 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:33.538100 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ebfd3528-262f-422d-904f-37fc18b4cd43 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/2a076d87-4f15-4e95-9be9-c89b035c72e2" status: 200 len: 1320 microversion: 2.1 time: 0.838441 Oct 29 03:02:33.541584 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1847/3510] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:32 2022] GET /compute/v2.1/servers/2a076d87-4f15-4e95-9be9-c89b035c72e2 => generated 1320 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:33.556611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-6c5d9b8a-e408-4cf0-bfdb-8d69dabfb72d req-9508d045-337c-4a6e-ad0f-84a5514eed9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35982880-caba-4b90-80e1-3561ee53888b", "name": "network-vif-deleted", "tag": "a2122170-a7ba-49ff-ae2d-2eb0eac1767f"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:33.596855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-6c5d9b8a-e408-4cf0-bfdb-8d69dabfb72d req-9508d045-337c-4a6e-ad0f-84a5514eed9e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:33.597864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-6c5d9b8a-e408-4cf0-bfdb-8d69dabfb72d req-9508d045-337c-4a6e-ad0f-84a5514eed9e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:33.598335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-6c5d9b8a-e408-4cf0-bfdb-8d69dabfb72d req-9508d045-337c-4a6e-ad0f-84a5514eed9e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:33.638746 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-6c5d9b8a-e408-4cf0-bfdb-8d69dabfb72d req-9508d045-337c-4a6e-ad0f-84a5514eed9e service nova] Creating event network-vif-deleted:a2122170-a7ba-49ff-ae2d-2eb0eac1767f for instance 35982880-caba-4b90-80e1-3561ee53888b on n-h2-862967-2 Oct 29 03:02:33.654705 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-6c5d9b8a-e408-4cf0-bfdb-8d69dabfb72d req-9508d045-337c-4a6e-ad0f-84a5514eed9e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111153 Oct 29 03:02:33.659802 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1848/3511] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:33.699435 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-816db3d8-216a-447b-9a72-20a52cc51b2e tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:33.700270 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-816db3d8-216a-447b-9a72-20a52cc51b2e tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] [instance: 7c79b743-fe77-42f1-88b9-594bc077b85b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:33.715473 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-816db3d8-216a-447b-9a72-20a52cc51b2e tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:33.718352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-816db3d8-216a-447b-9a72-20a52cc51b2e tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:33.720545 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-816db3d8-216a-447b-9a72-20a52cc51b2e tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:33.721501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-816db3d8-216a-447b-9a72-20a52cc51b2e tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:33.722546 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-816db3d8-216a-447b-9a72-20a52cc51b2e tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:33.725198 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-816db3d8-216a-447b-9a72-20a52cc51b2e tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:33.792052 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a60f0498-db9c-41ee-b870-1b497e40e7b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:33.803168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a60f0498-db9c-41ee-b870-1b497e40e7b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:33.804708 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a60f0498-db9c-41ee-b870-1b497e40e7b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:33.806148 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a60f0498-db9c-41ee-b870-1b497e40e7b6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1408 microversion: 2.20 time: 0.370435 Oct 29 03:02:33.828570 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1664/3512] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:33 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1408 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:34.083429 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-816db3d8-216a-447b-9a72-20a52cc51b2e tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d9c179a03f443c91b5e14528a332cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a563dd48004e3891a26468125ca652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:34.124081 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-816db3d8-216a-447b-9a72-20a52cc51b2e tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] 10.222.0.46 "GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b" status: 200 len: 1316 microversion: 2.1 time: 0.429996 Oct 29 03:02:34.125482 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1849/3513] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:33 2022] GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b => generated 1316 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:02:34.251029 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-02c1638e-a189-4d7e-b7c7-d29b23c4b3c8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:34.258222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-02c1638e-a189-4d7e-b7c7-d29b23c4b3c8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 2f159c62-4461-466d-8a38-85d781f27563] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:34.309763 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02c1638e-a189-4d7e-b7c7-d29b23c4b3c8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:34.314096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02c1638e-a189-4d7e-b7c7-d29b23c4b3c8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:34.318891 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02c1638e-a189-4d7e-b7c7-d29b23c4b3c8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:34.325432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02c1638e-a189-4d7e-b7c7-d29b23c4b3c8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:34.333389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02c1638e-a189-4d7e-b7c7-d29b23c4b3c8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:34.341242 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02c1638e-a189-4d7e-b7c7-d29b23c4b3c8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:34.370273 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:34.463332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1c1d84ca-d082-46b6-be29-24c096e370f2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:34.463954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1c1d84ca-d082-46b6-be29-24c096e370f2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 35982880-caba-4b90-80e1-3561ee53888b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:34.475344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c1d84ca-d082-46b6-be29-24c096e370f2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:34.475890 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c1d84ca-d082-46b6-be29-24c096e370f2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:34.476340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c1d84ca-d082-46b6-be29-24c096e370f2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:34.477112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c1d84ca-d082-46b6-be29-24c096e370f2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:34.477541 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c1d84ca-d082-46b6-be29-24c096e370f2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:34.478003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c1d84ca-d082-46b6-be29-24c096e370f2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:34.504476 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-1c1d84ca-d082-46b6-be29-24c096e370f2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] HTTP exception thrown: Instance 35982880-caba-4b90-80e1-3561ee53888b could not be found. Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1c1d84ca-d082-46b6-be29-24c096e370f2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Request method failure captured: Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b HTTP/1.1 Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJaEy18RgNLoRH_Cx5N19ntl_MZAWseAedf6nDvdLqq5Uv9fWq711j0XNb6BgsjwGmwVkwDsYZqRqnlQy1v9Czdk1P2JZBE7MuExsRjBvQLnTgLkLacVPY3yLp9R5pSFE5uStbCf24z3K2C9Y_7prmanNUiQJvOS6fzPpIe1j-F47IQ Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b67fc8dd1f4349ca85422bd9a08d3e06"}]}] Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 1ee6c4d28f304eab89014b9c46cc555a Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 35982880-caba-4b90-80e1-3561ee53888b could not be found. Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '35982880-caba-4b90-80e1-3561ee53888b'} Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35982880-caba-4b90-80e1-3561ee53888b could not be found. Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35982880-caba-4b90-80e1-3561ee53888b could not be found. Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:34.507134 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:34.514566 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:34.514566 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:34.514566 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:34.514566 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:34.514566 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:34.514566 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35982880-caba-4b90-80e1-3561ee53888b could not be found. Oct 29 03:02:34.514566 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:34.514566 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1c1d84ca-d082-46b6-be29-24c096e370f2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Returning 404 to user: Instance 35982880-caba-4b90-80e1-3561ee53888b could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:34.514566 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1c1d84ca-d082-46b6-be29-24c096e370f2 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b" status: 404 len: 111 microversion: 2.1 time: 0.051689 Oct 29 03:02:34.515989 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1850/3514] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:34 2022] GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:34.522884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1de2da8e-65b9-45f1-8aa2-1b4865593019 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:34.523388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1de2da8e-65b9-45f1-8aa2-1b4865593019 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 35982880-caba-4b90-80e1-3561ee53888b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:34.534755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1de2da8e-65b9-45f1-8aa2-1b4865593019 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:34.535256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1de2da8e-65b9-45f1-8aa2-1b4865593019 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:34.536684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1de2da8e-65b9-45f1-8aa2-1b4865593019 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:34.538289 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1de2da8e-65b9-45f1-8aa2-1b4865593019 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:34.539306 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1de2da8e-65b9-45f1-8aa2-1b4865593019 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:34.540132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1de2da8e-65b9-45f1-8aa2-1b4865593019 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:34.562254 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-1de2da8e-65b9-45f1-8aa2-1b4865593019 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] HTTP exception thrown: Instance 35982880-caba-4b90-80e1-3561ee53888b could not be found. Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1de2da8e-65b9-45f1-8aa2-1b4865593019 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Request method failure captured: Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b HTTP/1.1 Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJaEy18RgNLoRH_Cx5N19ntl_MZAWseAedf6nDvdLqq5Uv9fWq711j0XNb6BgsjwGmwVkwDsYZqRqnlQy1v9Czdk1P2JZBE7MuExsRjBvQLnTgLkLacVPY3yLp9R5pSFE5uStbCf24z3K2C9Y_7prmanNUiQJvOS6fzPpIe1j-F47IQ Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b67fc8dd1f4349ca85422bd9a08d3e06"}]}] Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 1ee6c4d28f304eab89014b9c46cc555a Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 35982880-caba-4b90-80e1-3561ee53888b could not be found. Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '35982880-caba-4b90-80e1-3561ee53888b'} Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35982880-caba-4b90-80e1-3561ee53888b could not be found. Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:34.564903 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:34.570056 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35982880-caba-4b90-80e1-3561ee53888b could not be found. Oct 29 03:02:34.570056 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:34.570056 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:34.570056 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:34.570056 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:34.570056 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:34.570056 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:34.570056 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:34.570056 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:34.570056 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35982880-caba-4b90-80e1-3561ee53888b could not be found. Oct 29 03:02:34.570056 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:34.572212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1de2da8e-65b9-45f1-8aa2-1b4865593019 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Returning 404 to user: Instance 35982880-caba-4b90-80e1-3561ee53888b could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:34.573363 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1de2da8e-65b9-45f1-8aa2-1b4865593019 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "DELETE /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b" status: 404 len: 111 microversion: 2.1 time: 0.056743 Oct 29 03:02:34.577080 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1851/3515] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:02:34 2022] DELETE /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:34.583712 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dff98b97-46a2-411b-869b-4a5d04baa578 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:34.584893 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dff98b97-46a2-411b-869b-4a5d04baa578 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 2a076d87-4f15-4e95-9be9-c89b035c72e2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:34.593414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dff98b97-46a2-411b-869b-4a5d04baa578 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:34.593836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dff98b97-46a2-411b-869b-4a5d04baa578 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:34.594587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dff98b97-46a2-411b-869b-4a5d04baa578 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:34.595470 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dff98b97-46a2-411b-869b-4a5d04baa578 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:34.596292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dff98b97-46a2-411b-869b-4a5d04baa578 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:34.597480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dff98b97-46a2-411b-869b-4a5d04baa578 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:34.734771 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-02c1638e-a189-4d7e-b7c7-d29b23c4b3c8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:34.743760 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-02c1638e-a189-4d7e-b7c7-d29b23c4b3c8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563" status: 200 len: 1307 microversion: 2.1 time: 0.503905 Oct 29 03:02:34.757145 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1665/3516] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:34 2022] GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563 => generated 1307 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:34.768468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-152e9f8c-6bb7-4724-802d-24bb72dd6348 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:34.769114 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-152e9f8c-6bb7-4724-802d-24bb72dd6348 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 35982880-caba-4b90-80e1-3561ee53888b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:34.782562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-152e9f8c-6bb7-4724-802d-24bb72dd6348 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:34.784395 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-152e9f8c-6bb7-4724-802d-24bb72dd6348 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:34.785222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-152e9f8c-6bb7-4724-802d-24bb72dd6348 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:34.786904 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-152e9f8c-6bb7-4724-802d-24bb72dd6348 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:34.787692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-152e9f8c-6bb7-4724-802d-24bb72dd6348 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:34.788389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-152e9f8c-6bb7-4724-802d-24bb72dd6348 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:34.819946 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-152e9f8c-6bb7-4724-802d-24bb72dd6348 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] HTTP exception thrown: Instance 35982880-caba-4b90-80e1-3561ee53888b could not be found. Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-152e9f8c-6bb7-4724-802d-24bb72dd6348 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Request method failure captured: Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b HTTP/1.1 Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJaEy18RgNLoRH_Cx5N19ntl_MZAWseAedf6nDvdLqq5Uv9fWq711j0XNb6BgsjwGmwVkwDsYZqRqnlQy1v9Czdk1P2JZBE7MuExsRjBvQLnTgLkLacVPY3yLp9R5pSFE5uStbCf24z3K2C9Y_7prmanNUiQJvOS6fzPpIe1j-F47IQ Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b67fc8dd1f4349ca85422bd9a08d3e06"}]}] Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 1ee6c4d28f304eab89014b9c46cc555a Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 35982880-caba-4b90-80e1-3561ee53888b could not be found. Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '35982880-caba-4b90-80e1-3561ee53888b'} Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35982880-caba-4b90-80e1-3561ee53888b could not be found. Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35982880-caba-4b90-80e1-3561ee53888b could not be found. Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:34.822091 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:34.827338 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:34.827338 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:34.827338 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:34.827338 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:34.827338 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:34.827338 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35982880-caba-4b90-80e1-3561ee53888b could not be found. Oct 29 03:02:34.827338 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:34.827338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-152e9f8c-6bb7-4724-802d-24bb72dd6348 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Returning 404 to user: Instance 35982880-caba-4b90-80e1-3561ee53888b could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:34.827338 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-152e9f8c-6bb7-4724-802d-24bb72dd6348 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b" status: 404 len: 111 microversion: 2.1 time: 0.075475 Oct 29 03:02:34.828077 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1666/3517] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:34 2022] GET /compute/v2.1/servers/35982880-caba-4b90-80e1-3561ee53888b => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:34.840881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b14bbb68-16eb-4191-b1a9-c9e08e21b08f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:34.841801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b14bbb68-16eb-4191-b1a9-c9e08e21b08f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:34.849714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b14bbb68-16eb-4191-b1a9-c9e08e21b08f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:34.850730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b14bbb68-16eb-4191-b1a9-c9e08e21b08f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:34.851527 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b14bbb68-16eb-4191-b1a9-c9e08e21b08f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:34.852429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b14bbb68-16eb-4191-b1a9-c9e08e21b08f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:34.853687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b14bbb68-16eb-4191-b1a9-c9e08e21b08f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:34.854292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b14bbb68-16eb-4191-b1a9-c9e08e21b08f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:35.079772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dff98b97-46a2-411b-869b-4a5d04baa578 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:35.088796 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dff98b97-46a2-411b-869b-4a5d04baa578 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/2a076d87-4f15-4e95-9be9-c89b035c72e2" status: 200 len: 1320 microversion: 2.1 time: 0.510484 Oct 29 03:02:35.090032 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1852/3518] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:34 2022] GET /compute/v2.1/servers/2a076d87-4f15-4e95-9be9-c89b035c72e2 => generated 1320 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:35.097586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-604e180f-47ba-4d77-b248-274668ade45a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:35.098532 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-604e180f-47ba-4d77-b248-274668ade45a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:35.108119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-604e180f-47ba-4d77-b248-274668ade45a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:35.109036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-604e180f-47ba-4d77-b248-274668ade45a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:35.109955 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-604e180f-47ba-4d77-b248-274668ade45a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:35.113514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-604e180f-47ba-4d77-b248-274668ade45a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:35.119850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-604e180f-47ba-4d77-b248-274668ade45a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:35.120633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-604e180f-47ba-4d77-b248-274668ade45a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:35.153190 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-604e180f-47ba-4d77-b248-274668ade45a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] HTTP exception thrown: Instance afb9891b-c60a-4106-b2ed-b26d1ff0a459 could not be found. Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-604e180f-47ba-4d77-b248-274668ade45a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Request method failure captured: Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 HTTP/1.1 Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJaEy18RgNLoRH_Cx5N19ntl_MZAWseAedf6nDvdLqq5Uv9fWq711j0XNb6BgsjwGmwVkwDsYZqRqnlQy1v9Czdk1P2JZBE7MuExsRjBvQLnTgLkLacVPY3yLp9R5pSFE5uStbCf24z3K2C9Y_7prmanNUiQJvOS6fzPpIe1j-F47IQ Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b67fc8dd1f4349ca85422bd9a08d3e06"}]}] Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 1ee6c4d28f304eab89014b9c46cc555a Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance afb9891b-c60a-4106-b2ed-b26d1ff0a459 could not be found. Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'afb9891b-c60a-4106-b2ed-b26d1ff0a459'} Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afb9891b-c60a-4106-b2ed-b26d1ff0a459 could not be found. Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:35.155124 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:35.159977 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afb9891b-c60a-4106-b2ed-b26d1ff0a459 could not be found. Oct 29 03:02:35.159977 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.159977 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:35.159977 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.159977 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:35.159977 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:35.159977 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:35.159977 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:35.159977 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:35.159977 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afb9891b-c60a-4106-b2ed-b26d1ff0a459 could not be found. Oct 29 03:02:35.159977 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.161902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-604e180f-47ba-4d77-b248-274668ade45a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Returning 404 to user: Instance afb9891b-c60a-4106-b2ed-b26d1ff0a459 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:35.162956 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-604e180f-47ba-4d77-b248-274668ade45a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "DELETE /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 404 len: 111 microversion: 2.1 time: 0.071768 Oct 29 03:02:35.164020 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1853/3519] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:02:35 2022] DELETE /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:35.169035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-2ca23be7-8196-49c1-b922-5380c3f923b7 req-884f216e-26fb-4abd-83e9-d0c478c2c801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f159c62-4461-466d-8a38-85d781f27563", "tag": "be6a2e7b-8209-4567-8de0-f674259a2db5"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:35.190950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-2ca23be7-8196-49c1-b922-5380c3f923b7 req-884f216e-26fb-4abd-83e9-d0c478c2c801 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:35.191932 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-2ca23be7-8196-49c1-b922-5380c3f923b7 req-884f216e-26fb-4abd-83e9-d0c478c2c801 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:35.192556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-2ca23be7-8196-49c1-b922-5380c3f923b7 req-884f216e-26fb-4abd-83e9-d0c478c2c801 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:35.200192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b14bbb68-16eb-4191-b1a9-c9e08e21b08f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:35.211926 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-2ca23be7-8196-49c1-b922-5380c3f923b7 req-884f216e-26fb-4abd-83e9-d0c478c2c801 service nova] Creating event network-changed:be6a2e7b-8209-4567-8de0-f674259a2db5 for instance 2f159c62-4461-466d-8a38-85d781f27563 on n-h2-862967-2 Oct 29 03:02:35.213796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b14bbb68-16eb-4191-b1a9-c9e08e21b08f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:35.224380 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b14bbb68-16eb-4191-b1a9-c9e08e21b08f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:35.227366 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b14bbb68-16eb-4191-b1a9-c9e08e21b08f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1600 microversion: 2.20 time: 0.390779 Oct 29 03:02:35.252755 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-2ca23be7-8196-49c1-b922-5380c3f923b7 req-884f216e-26fb-4abd-83e9-d0c478c2c801 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061516 Oct 29 03:02:35.253652 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1854/3520] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:35.254078 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1667/3521] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:02:34 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1600 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:02:35.261684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-465ce10e-b865-4193-b8b2-ec7c5d9de7ae tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:35.262432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-465ce10e-b865-4193-b8b2-ec7c5d9de7ae tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: afb9891b-c60a-4106-b2ed-b26d1ff0a459] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:35.269045 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b3787e03-024b-4611-b15f-904aca5f4c61 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:35.269746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b3787e03-024b-4611-b15f-904aca5f4c61 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] [instance: 7c79b743-fe77-42f1-88b9-594bc077b85b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:35.277005 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-465ce10e-b865-4193-b8b2-ec7c5d9de7ae tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:35.277694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-465ce10e-b865-4193-b8b2-ec7c5d9de7ae tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:35.278983 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-465ce10e-b865-4193-b8b2-ec7c5d9de7ae tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:35.280095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-465ce10e-b865-4193-b8b2-ec7c5d9de7ae tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:35.281007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-465ce10e-b865-4193-b8b2-ec7c5d9de7ae tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:35.282009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-465ce10e-b865-4193-b8b2-ec7c5d9de7ae tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:35.292795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3787e03-024b-4611-b15f-904aca5f4c61 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:35.293299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3787e03-024b-4611-b15f-904aca5f4c61 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:35.293737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3787e03-024b-4611-b15f-904aca5f4c61 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:35.294643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3787e03-024b-4611-b15f-904aca5f4c61 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:35.295269 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3787e03-024b-4611-b15f-904aca5f4c61 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:35.295868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3787e03-024b-4611-b15f-904aca5f4c61 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:35.329724 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-465ce10e-b865-4193-b8b2-ec7c5d9de7ae tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] HTTP exception thrown: Instance afb9891b-c60a-4106-b2ed-b26d1ff0a459 could not be found. Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-465ce10e-b865-4193-b8b2-ec7c5d9de7ae tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Request method failure captured: Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 HTTP/1.1 Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJaEy18RgNLoRH_Cx5N19ntl_MZAWseAedf6nDvdLqq5Uv9fWq711j0XNb6BgsjwGmwVkwDsYZqRqnlQy1v9Czdk1P2JZBE7MuExsRjBvQLnTgLkLacVPY3yLp9R5pSFE5uStbCf24z3K2C9Y_7prmanNUiQJvOS6fzPpIe1j-F47IQ Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b67fc8dd1f4349ca85422bd9a08d3e06"}]}] Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 1ee6c4d28f304eab89014b9c46cc555a Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance afb9891b-c60a-4106-b2ed-b26d1ff0a459 could not be found. Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'afb9891b-c60a-4106-b2ed-b26d1ff0a459'} Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afb9891b-c60a-4106-b2ed-b26d1ff0a459 could not be found. Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afb9891b-c60a-4106-b2ed-b26d1ff0a459 could not be found. Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:35.334927 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.340780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:35.340780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:35.340780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:35.340780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:35.340780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:35.340780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afb9891b-c60a-4106-b2ed-b26d1ff0a459 could not be found. Oct 29 03:02:35.340780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.340780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-465ce10e-b865-4193-b8b2-ec7c5d9de7ae tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Returning 404 to user: Instance afb9891b-c60a-4106-b2ed-b26d1ff0a459 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:35.340780 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-465ce10e-b865-4193-b8b2-ec7c5d9de7ae tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459" status: 404 len: 111 microversion: 2.1 time: 0.082011 Oct 29 03:02:35.340780 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1668/3522] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:35 2022] GET /compute/v2.1/servers/afb9891b-c60a-4106-b2ed-b26d1ff0a459 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:35.347877 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-af67de47-55a9-49a0-96a4-db3e3492e0c2 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:35.348402 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-af67de47-55a9-49a0-96a4-db3e3492e0c2 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:35.354698 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af67de47-55a9-49a0-96a4-db3e3492e0c2 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:35.355180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af67de47-55a9-49a0-96a4-db3e3492e0c2 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:35.355607 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af67de47-55a9-49a0-96a4-db3e3492e0c2 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:35.356307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af67de47-55a9-49a0-96a4-db3e3492e0c2 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:35.356875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af67de47-55a9-49a0-96a4-db3e3492e0c2 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:35.357297 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af67de47-55a9-49a0-96a4-db3e3492e0c2 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:35.453553 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-af67de47-55a9-49a0-96a4-db3e3492e0c2 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.111437 Oct 29 03:02:35.461232 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1669/3523] 10.222.0.46 () {60 vars in 1316 bytes} [Sat Oct 29 03:02:35 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:02:35.461232 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-26715e78-d7bf-46f1-be5c-c1b3dc2e42d8 req-8474d831-8141-4e3d-8253-6e8197136037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a96c21c1-c8a7-4f6f-93d6-ebb2af6240cf", "name": "network-vif-plugged", "status": "completed", "tag": "a83f3df1-a0d1-43c3-8096-0e9d2fd92e5f"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:35.473800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-26715e78-d7bf-46f1-be5c-c1b3dc2e42d8 req-8474d831-8141-4e3d-8253-6e8197136037 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:35.474612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-26715e78-d7bf-46f1-be5c-c1b3dc2e42d8 req-8474d831-8141-4e3d-8253-6e8197136037 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:35.475277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-26715e78-d7bf-46f1-be5c-c1b3dc2e42d8 req-8474d831-8141-4e3d-8253-6e8197136037 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:35.508002 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-26715e78-d7bf-46f1-be5c-c1b3dc2e42d8 req-8474d831-8141-4e3d-8253-6e8197136037 service nova] Creating event network-vif-plugged:a83f3df1-a0d1-43c3-8096-0e9d2fd92e5f for instance a96c21c1-c8a7-4f6f-93d6-ebb2af6240cf on n-h1-862967-2 Oct 29 03:02:35.515061 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-26715e78-d7bf-46f1-be5c-c1b3dc2e42d8 req-8474d831-8141-4e3d-8253-6e8197136037 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059492 Oct 29 03:02:35.516269 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1670/3524] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:35.529224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6adbcf8c-1c25-4a99-af97-65121786e860 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:35.530074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6adbcf8c-1c25-4a99-af97-65121786e860 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:35.544694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6adbcf8c-1c25-4a99-af97-65121786e860 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:35.545200 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6adbcf8c-1c25-4a99-af97-65121786e860 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:35.570883 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6adbcf8c-1c25-4a99-af97-65121786e860 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:35.571616 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6adbcf8c-1c25-4a99-af97-65121786e860 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:35.572106 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6adbcf8c-1c25-4a99-af97-65121786e860 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:35.576612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6adbcf8c-1c25-4a99-af97-65121786e860 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:35.602358 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-6adbcf8c-1c25-4a99-af97-65121786e860 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] HTTP exception thrown: Instance 6e395101-378a-4976-b087-38ce3f22b912 could not be found. Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6adbcf8c-1c25-4a99-af97-65121786e860 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Request method failure captured: Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 HTTP/1.1 Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJaEy18RgNLoRH_Cx5N19ntl_MZAWseAedf6nDvdLqq5Uv9fWq711j0XNb6BgsjwGmwVkwDsYZqRqnlQy1v9Czdk1P2JZBE7MuExsRjBvQLnTgLkLacVPY3yLp9R5pSFE5uStbCf24z3K2C9Y_7prmanNUiQJvOS6fzPpIe1j-F47IQ Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b67fc8dd1f4349ca85422bd9a08d3e06"}]}] Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 1ee6c4d28f304eab89014b9c46cc555a Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 6e395101-378a-4976-b087-38ce3f22b912 could not be found. Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '6e395101-378a-4976-b087-38ce3f22b912'} Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e395101-378a-4976-b087-38ce3f22b912 could not be found. Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:35.605165 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:35.611281 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e395101-378a-4976-b087-38ce3f22b912 could not be found. Oct 29 03:02:35.611281 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.611281 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:35.611281 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.611281 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:35.611281 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:35.611281 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:35.611281 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:35.611281 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:35.611281 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e395101-378a-4976-b087-38ce3f22b912 could not be found. Oct 29 03:02:35.611281 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.614046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6adbcf8c-1c25-4a99-af97-65121786e860 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Returning 404 to user: Instance 6e395101-378a-4976-b087-38ce3f22b912 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:35.615224 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6adbcf8c-1c25-4a99-af97-65121786e860 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 404 len: 111 microversion: 2.1 time: 0.097452 Oct 29 03:02:35.616413 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1671/3525] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:02:35 2022] DELETE /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:35.629874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b27a6e1e-0904-42d0-a374-6fec21a411e7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:35.631077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b27a6e1e-0904-42d0-a374-6fec21a411e7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 6e395101-378a-4976-b087-38ce3f22b912] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:35.646459 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b27a6e1e-0904-42d0-a374-6fec21a411e7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:35.647333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b27a6e1e-0904-42d0-a374-6fec21a411e7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:35.648007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b27a6e1e-0904-42d0-a374-6fec21a411e7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:35.649412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b27a6e1e-0904-42d0-a374-6fec21a411e7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:35.650064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b27a6e1e-0904-42d0-a374-6fec21a411e7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:35.650669 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b27a6e1e-0904-42d0-a374-6fec21a411e7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:35.694465 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-b27a6e1e-0904-42d0-a374-6fec21a411e7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] HTTP exception thrown: Instance 6e395101-378a-4976-b087-38ce3f22b912 could not be found. Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b27a6e1e-0904-42d0-a374-6fec21a411e7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Request method failure captured: Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 HTTP/1.1 Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJaEy18RgNLoRH_Cx5N19ntl_MZAWseAedf6nDvdLqq5Uv9fWq711j0XNb6BgsjwGmwVkwDsYZqRqnlQy1v9Czdk1P2JZBE7MuExsRjBvQLnTgLkLacVPY3yLp9R5pSFE5uStbCf24z3K2C9Y_7prmanNUiQJvOS6fzPpIe1j-F47IQ Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b67fc8dd1f4349ca85422bd9a08d3e06"}]}] Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 1ee6c4d28f304eab89014b9c46cc555a Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 6e395101-378a-4976-b087-38ce3f22b912 could not be found. Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '6e395101-378a-4976-b087-38ce3f22b912'} Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e395101-378a-4976-b087-38ce3f22b912 could not be found. Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e395101-378a-4976-b087-38ce3f22b912 could not be found. Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:35.706430 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.711938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:35.711938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:35.711938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:35.711938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:35.711938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:35.711938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e395101-378a-4976-b087-38ce3f22b912 could not be found. Oct 29 03:02:35.711938 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.718041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b27a6e1e-0904-42d0-a374-6fec21a411e7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Returning 404 to user: Instance 6e395101-378a-4976-b087-38ce3f22b912 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:35.719247 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b27a6e1e-0904-42d0-a374-6fec21a411e7 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912" status: 404 len: 111 microversion: 2.1 time: 0.097469 Oct 29 03:02:35.720220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b3787e03-024b-4611-b15f-904aca5f4c61 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d9c179a03f443c91b5e14528a332cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a563dd48004e3891a26468125ca652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:35.728265 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1672/3526] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:35 2022] GET /compute/v2.1/servers/6e395101-378a-4976-b087-38ce3f22b912 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:35.739750 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b3787e03-024b-4611-b15f-904aca5f4c61 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] 10.222.0.46 "GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b" status: 200 len: 1316 microversion: 2.1 time: 0.481610 Oct 29 03:02:35.750732 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1855/3527] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:35 2022] GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b => generated 1316 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:35.754505 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-91fd5586-1e71-4d41-b513-7f11a250046a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:35.755945 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-91fd5586-1e71-4d41-b513-7f11a250046a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: d4cf7226-5b9f-4b20-9294-5fc3f0118ebd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:35.769294 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91fd5586-1e71-4d41-b513-7f11a250046a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:35.769871 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5654250a-bec5-4fc4-b8f0-4617442cf64c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:35.771555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91fd5586-1e71-4d41-b513-7f11a250046a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:35.771994 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91fd5586-1e71-4d41-b513-7f11a250046a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:35.772746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91fd5586-1e71-4d41-b513-7f11a250046a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:35.773190 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91fd5586-1e71-4d41-b513-7f11a250046a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:35.773806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91fd5586-1e71-4d41-b513-7f11a250046a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:35.774462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5654250a-bec5-4fc4-b8f0-4617442cf64c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 2f159c62-4461-466d-8a38-85d781f27563] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:35.792619 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5654250a-bec5-4fc4-b8f0-4617442cf64c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:35.793130 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5654250a-bec5-4fc4-b8f0-4617442cf64c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:35.793572 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5654250a-bec5-4fc4-b8f0-4617442cf64c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:35.794294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5654250a-bec5-4fc4-b8f0-4617442cf64c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:35.794751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5654250a-bec5-4fc4-b8f0-4617442cf64c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:35.795435 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5654250a-bec5-4fc4-b8f0-4617442cf64c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:35.801683 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-91fd5586-1e71-4d41-b513-7f11a250046a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] HTTP exception thrown: Instance d4cf7226-5b9f-4b20-9294-5fc3f0118ebd could not be found. Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-91fd5586-1e71-4d41-b513-7f11a250046a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Request method failure captured: Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd HTTP/1.1 Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJaEy18RgNLoRH_Cx5N19ntl_MZAWseAedf6nDvdLqq5Uv9fWq711j0XNb6BgsjwGmwVkwDsYZqRqnlQy1v9Czdk1P2JZBE7MuExsRjBvQLnTgLkLacVPY3yLp9R5pSFE5uStbCf24z3K2C9Y_7prmanNUiQJvOS6fzPpIe1j-F47IQ Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b67fc8dd1f4349ca85422bd9a08d3e06"}]}] Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 1ee6c4d28f304eab89014b9c46cc555a Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance d4cf7226-5b9f-4b20-9294-5fc3f0118ebd could not be found. Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'd4cf7226-5b9f-4b20-9294-5fc3f0118ebd'} Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4cf7226-5b9f-4b20-9294-5fc3f0118ebd could not be found. Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:35.803603 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:35.808777 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4cf7226-5b9f-4b20-9294-5fc3f0118ebd could not be found. Oct 29 03:02:35.808777 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.808777 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:35.808777 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.808777 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:35.808777 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:35.808777 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:35.808777 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:35.808777 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:35.808777 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4cf7226-5b9f-4b20-9294-5fc3f0118ebd could not be found. Oct 29 03:02:35.808777 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.811429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-91fd5586-1e71-4d41-b513-7f11a250046a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Returning 404 to user: Instance d4cf7226-5b9f-4b20-9294-5fc3f0118ebd could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:35.812484 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-91fd5586-1e71-4d41-b513-7f11a250046a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd" status: 404 len: 111 microversion: 2.1 time: 0.064046 Oct 29 03:02:35.814280 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1673/3528] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:02:35 2022] DELETE /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:35.823176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-90b8a31d-6626-4ce6-b4a5-5de13b71fb4a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:35.823783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-90b8a31d-6626-4ce6-b4a5-5de13b71fb4a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: d4cf7226-5b9f-4b20-9294-5fc3f0118ebd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:35.826112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=10 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:35.833815 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90b8a31d-6626-4ce6-b4a5-5de13b71fb4a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:35.835114 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90b8a31d-6626-4ce6-b4a5-5de13b71fb4a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:35.835889 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90b8a31d-6626-4ce6-b4a5-5de13b71fb4a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:35.836934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90b8a31d-6626-4ce6-b4a5-5de13b71fb4a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:35.837629 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90b8a31d-6626-4ce6-b4a5-5de13b71fb4a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:35.838264 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90b8a31d-6626-4ce6-b4a5-5de13b71fb4a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:35.861686 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-90b8a31d-6626-4ce6-b4a5-5de13b71fb4a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] HTTP exception thrown: Instance d4cf7226-5b9f-4b20-9294-5fc3f0118ebd could not be found. Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-90b8a31d-6626-4ce6-b4a5-5de13b71fb4a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Request method failure captured: Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd HTTP/1.1 Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJaEy18RgNLoRH_Cx5N19ntl_MZAWseAedf6nDvdLqq5Uv9fWq711j0XNb6BgsjwGmwVkwDsYZqRqnlQy1v9Czdk1P2JZBE7MuExsRjBvQLnTgLkLacVPY3yLp9R5pSFE5uStbCf24z3K2C9Y_7prmanNUiQJvOS6fzPpIe1j-F47IQ Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b67fc8dd1f4349ca85422bd9a08d3e06"}]}] Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 1ee6c4d28f304eab89014b9c46cc555a Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance d4cf7226-5b9f-4b20-9294-5fc3f0118ebd could not be found. Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'd4cf7226-5b9f-4b20-9294-5fc3f0118ebd'} Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4cf7226-5b9f-4b20-9294-5fc3f0118ebd could not be found. Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4cf7226-5b9f-4b20-9294-5fc3f0118ebd could not be found. Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:35.863644 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.870088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:35.870088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:35.870088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:35.870088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:35.870088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:35.870088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4cf7226-5b9f-4b20-9294-5fc3f0118ebd could not be found. Oct 29 03:02:35.870088 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.872579 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-90b8a31d-6626-4ce6-b4a5-5de13b71fb4a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Returning 404 to user: Instance d4cf7226-5b9f-4b20-9294-5fc3f0118ebd could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:35.873701 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-90b8a31d-6626-4ce6-b4a5-5de13b71fb4a tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd" status: 404 len: 111 microversion: 2.1 time: 0.055511 Oct 29 03:02:35.877577 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1674/3529] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:35 2022] GET /compute/v2.1/servers/d4cf7226-5b9f-4b20-9294-5fc3f0118ebd => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:02:35.887067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9dce74c1-5b2a-407b-863c-f30e1a9e3d21 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:35.888030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9dce74c1-5b2a-407b-863c-f30e1a9e3d21 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:35.897370 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-9dce74c1-5b2a-407b-863c-f30e1a9e3d21 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] HTTP exception thrown: Instance 8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0 could not be found. Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9dce74c1-5b2a-407b-863c-f30e1a9e3d21 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Request method failure captured: Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0 HTTP/1.1 Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJaEy18RgNLoRH_Cx5N19ntl_MZAWseAedf6nDvdLqq5Uv9fWq711j0XNb6BgsjwGmwVkwDsYZqRqnlQy1v9Czdk1P2JZBE7MuExsRjBvQLnTgLkLacVPY3yLp9R5pSFE5uStbCf24z3K2C9Y_7prmanNUiQJvOS6fzPpIe1j-F47IQ Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b67fc8dd1f4349ca85422bd9a08d3e06"}]}] Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 1ee6c4d28f304eab89014b9c46cc555a Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0 could not be found. Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0'} Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0 could not be found. Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0 could not be found. Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:35.899446 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.905780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:35.905780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:35.905780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:35.905780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:35.905780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:35.905780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0 could not be found. Oct 29 03:02:35.905780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.907833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9dce74c1-5b2a-407b-863c-f30e1a9e3d21 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Returning 404 to user: Instance 8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:35.908958 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9dce74c1-5b2a-407b-863c-f30e1a9e3d21 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0" status: 404 len: 111 microversion: 2.1 time: 0.027302 Oct 29 03:02:35.913736 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1675/3530] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:02:35 2022] DELETE /compute/v2.1/servers/8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:35.923004 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-97bdb6c3-475d-4c18-90dc-08b0e7c9e68c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:35.923921 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-97bdb6c3-475d-4c18-90dc-08b0e7c9e68c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:35.932011 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-97bdb6c3-475d-4c18-90dc-08b0e7c9e68c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] HTTP exception thrown: Instance 8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0 could not be found. Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-97bdb6c3-475d-4c18-90dc-08b0e7c9e68c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Request method failure captured: Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0 HTTP/1.1 Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJaEy18RgNLoRH_Cx5N19ntl_MZAWseAedf6nDvdLqq5Uv9fWq711j0XNb6BgsjwGmwVkwDsYZqRqnlQy1v9Czdk1P2JZBE7MuExsRjBvQLnTgLkLacVPY3yLp9R5pSFE5uStbCf24z3K2C9Y_7prmanNUiQJvOS6fzPpIe1j-F47IQ Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b67fc8dd1f4349ca85422bd9a08d3e06"}]}] Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 1ee6c4d28f304eab89014b9c46cc555a Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0 could not be found. Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0'} Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0 could not be found. Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0 could not be found. Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:35.934039 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:35.939489 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:35.939489 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:35.939489 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:35.939489 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0 could not be found. Oct 29 03:02:35.939489 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:35.941468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-97bdb6c3-475d-4c18-90dc-08b0e7c9e68c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Returning 404 to user: Instance 8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:35.942563 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-97bdb6c3-475d-4c18-90dc-08b0e7c9e68c tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0" status: 404 len: 111 microversion: 2.1 time: 0.027443 Oct 29 03:02:35.946533 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1676/3531] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:35 2022] GET /compute/v2.1/servers/8ea7edb1-3aba-4bb1-8c68-56f102ff8ba0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:36.114100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e1f33f70-7ff8-4343-bb2c-f21a0f3a9b72 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:36.114771 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e1f33f70-7ff8-4343-bb2c-f21a0f3a9b72 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 2a076d87-4f15-4e95-9be9-c89b035c72e2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:36.134969 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1f33f70-7ff8-4343-bb2c-f21a0f3a9b72 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:36.135501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1f33f70-7ff8-4343-bb2c-f21a0f3a9b72 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:36.136559 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1f33f70-7ff8-4343-bb2c-f21a0f3a9b72 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:36.137309 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1f33f70-7ff8-4343-bb2c-f21a0f3a9b72 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:36.137643 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1f33f70-7ff8-4343-bb2c-f21a0f3a9b72 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:36.138202 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1f33f70-7ff8-4343-bb2c-f21a0f3a9b72 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:36.206252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5654250a-bec5-4fc4-b8f0-4617442cf64c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:36.215619 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5654250a-bec5-4fc4-b8f0-4617442cf64c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563" status: 200 len: 1307 microversion: 2.1 time: 0.450549 Oct 29 03:02:36.216993 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1856/3532] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:35 2022] GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563 => generated 1307 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:36.641154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=28 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:36.646349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e1f33f70-7ff8-4343-bb2c-f21a0f3a9b72 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:36.663792 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e1f33f70-7ff8-4343-bb2c-f21a0f3a9b72 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/2a076d87-4f15-4e95-9be9-c89b035c72e2" status: 200 len: 1320 microversion: 2.1 time: 0.555756 Oct 29 03:02:36.664393 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1677/3533] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:36 2022] GET /compute/v2.1/servers/2a076d87-4f15-4e95-9be9-c89b035c72e2 => generated 1320 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:36.763774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9e8e665d-04d7-4689-a352-065596ed60d1 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:36.764502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9e8e665d-04d7-4689-a352-065596ed60d1 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] [instance: 7c79b743-fe77-42f1-88b9-594bc077b85b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:36.772082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e8e665d-04d7-4689-a352-065596ed60d1 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:36.772886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e8e665d-04d7-4689-a352-065596ed60d1 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:36.773493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e8e665d-04d7-4689-a352-065596ed60d1 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:36.774394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e8e665d-04d7-4689-a352-065596ed60d1 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:36.775037 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e8e665d-04d7-4689-a352-065596ed60d1 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:36.775468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e8e665d-04d7-4689-a352-065596ed60d1 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:37.240801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-86aa4b5f-e797-4f4a-8d33-f6fbff519481 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:37.241717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-86aa4b5f-e797-4f4a-8d33-f6fbff519481 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 2f159c62-4461-466d-8a38-85d781f27563] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:37.256340 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86aa4b5f-e797-4f4a-8d33-f6fbff519481 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:37.257145 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86aa4b5f-e797-4f4a-8d33-f6fbff519481 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:37.258957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86aa4b5f-e797-4f4a-8d33-f6fbff519481 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:37.259880 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86aa4b5f-e797-4f4a-8d33-f6fbff519481 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:37.261073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86aa4b5f-e797-4f4a-8d33-f6fbff519481 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:37.261729 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86aa4b5f-e797-4f4a-8d33-f6fbff519481 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:37.305341 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9e8e665d-04d7-4689-a352-065596ed60d1 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d9c179a03f443c91b5e14528a332cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a563dd48004e3891a26468125ca652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:37.317817 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9e8e665d-04d7-4689-a352-065596ed60d1 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] 10.222.0.46 "GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b" status: 200 len: 1316 microversion: 2.1 time: 0.557791 Oct 29 03:02:37.332548 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1857/3534] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:36 2022] GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b => generated 1316 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:02:37.533074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-86aa4b5f-e797-4f4a-8d33-f6fbff519481 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:37.543066 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-86aa4b5f-e797-4f4a-8d33-f6fbff519481 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563" status: 200 len: 1307 microversion: 2.1 time: 0.306083 Oct 29 03:02:37.562707 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1678/3535] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:37 2022] GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563 => generated 1307 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:37.580787 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-911c531d-2a8f-4088-85e8-397538721dea req-a4533bdb-8de2-4f0e-84d6-ca8f8ce2f4cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a076d87-4f15-4e95-9be9-c89b035c72e2", "name": "network-vif-plugged", "status": "completed", "tag": "fc7e740a-c632-4df7-8793-3d1049c7d1f1"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:37.607688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-911c531d-2a8f-4088-85e8-397538721dea req-a4533bdb-8de2-4f0e-84d6-ca8f8ce2f4cb service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:37.608195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-911c531d-2a8f-4088-85e8-397538721dea req-a4533bdb-8de2-4f0e-84d6-ca8f8ce2f4cb service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:37.620214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-911c531d-2a8f-4088-85e8-397538721dea req-a4533bdb-8de2-4f0e-84d6-ca8f8ce2f4cb service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:37.661841 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-911c531d-2a8f-4088-85e8-397538721dea req-a4533bdb-8de2-4f0e-84d6-ca8f8ce2f4cb service nova] Creating event network-vif-plugged:fc7e740a-c632-4df7-8793-3d1049c7d1f1 for instance 2a076d87-4f15-4e95-9be9-c89b035c72e2 on n-h2-862967-2 Oct 29 03:02:37.675725 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-911c531d-2a8f-4088-85e8-397538721dea req-a4533bdb-8de2-4f0e-84d6-ca8f8ce2f4cb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098734 Oct 29 03:02:37.676720 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1858/3536] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:37.690045 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-86cc3220-4a09-4632-ba23-a2b87a519406 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:37.690916 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-86cc3220-4a09-4632-ba23-a2b87a519406 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 2a076d87-4f15-4e95-9be9-c89b035c72e2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:37.707922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86cc3220-4a09-4632-ba23-a2b87a519406 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:37.708474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86cc3220-4a09-4632-ba23-a2b87a519406 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:37.713519 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86cc3220-4a09-4632-ba23-a2b87a519406 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:37.713901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86cc3220-4a09-4632-ba23-a2b87a519406 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:37.719186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86cc3220-4a09-4632-ba23-a2b87a519406 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:37.720300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86cc3220-4a09-4632-ba23-a2b87a519406 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:38.232345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-86cc3220-4a09-4632-ba23-a2b87a519406 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:38.319641 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-86cc3220-4a09-4632-ba23-a2b87a519406 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/2a076d87-4f15-4e95-9be9-c89b035c72e2" status: 200 len: 1320 microversion: 2.1 time: 0.634587 Oct 29 03:02:38.325170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-8b43847c-e266-4442-bdcb-010a39149b04 req-cc6acbf8-73a7-48d2-b6c0-e735ea9da6a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "354cb0c1-2737-486f-8e3b-d119c49a46a7", "tag": "0e820bc1-bfed-42bc-8698-d91dc009de10"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:38.325995 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1679/3537] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:37 2022] GET /compute/v2.1/servers/2a076d87-4f15-4e95-9be9-c89b035c72e2 => generated 1320 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:38.347266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8b43847c-e266-4442-bdcb-010a39149b04 req-cc6acbf8-73a7-48d2-b6c0-e735ea9da6a1 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:38.348351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8b43847c-e266-4442-bdcb-010a39149b04 req-cc6acbf8-73a7-48d2-b6c0-e735ea9da6a1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:38.349270 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8b43847c-e266-4442-bdcb-010a39149b04 req-cc6acbf8-73a7-48d2-b6c0-e735ea9da6a1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:38.356222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dd5c9871-d06b-4de1-8539-1dce52bf237b tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:38.356885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dd5c9871-d06b-4de1-8539-1dce52bf237b tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] [instance: 7c79b743-fe77-42f1-88b9-594bc077b85b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:38.358120 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=100 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:38.369121 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-8b43847c-e266-4442-bdcb-010a39149b04 req-cc6acbf8-73a7-48d2-b6c0-e735ea9da6a1 service nova] Creating event network-changed:0e820bc1-bfed-42bc-8698-d91dc009de10 for instance 354cb0c1-2737-486f-8e3b-d119c49a46a7 on n-h1-862967-2 Oct 29 03:02:38.375262 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-8b43847c-e266-4442-bdcb-010a39149b04 req-cc6acbf8-73a7-48d2-b6c0-e735ea9da6a1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062245 Oct 29 03:02:38.379978 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd5c9871-d06b-4de1-8539-1dce52bf237b tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:38.380461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd5c9871-d06b-4de1-8539-1dce52bf237b tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:38.380922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd5c9871-d06b-4de1-8539-1dce52bf237b tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:38.381098 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1859/3538] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:02:38.383354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd5c9871-d06b-4de1-8539-1dce52bf237b tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:38.383822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd5c9871-d06b-4de1-8539-1dce52bf237b tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:38.384245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd5c9871-d06b-4de1-8539-1dce52bf237b tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:38.585344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-64ebead6-6553-4766-bf15-aa5a8d911c8b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:38.586152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-64ebead6-6553-4766-bf15-aa5a8d911c8b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 2f159c62-4461-466d-8a38-85d781f27563] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:38.600640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-64ebead6-6553-4766-bf15-aa5a8d911c8b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:38.601410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-64ebead6-6553-4766-bf15-aa5a8d911c8b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:38.602094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-64ebead6-6553-4766-bf15-aa5a8d911c8b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:38.603952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-64ebead6-6553-4766-bf15-aa5a8d911c8b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:38.609054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-64ebead6-6553-4766-bf15-aa5a8d911c8b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:38.609876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-64ebead6-6553-4766-bf15-aa5a8d911c8b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:38.732211 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dd5c9871-d06b-4de1-8539-1dce52bf237b tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d9c179a03f443c91b5e14528a332cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a563dd48004e3891a26468125ca652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:38.751454 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dd5c9871-d06b-4de1-8539-1dce52bf237b tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] 10.222.0.46 "GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b" status: 200 len: 1316 microversion: 2.1 time: 0.409421 Oct 29 03:02:38.770135 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1680/3539] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:38 2022] GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b => generated 1316 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:38.945286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-64ebead6-6553-4766-bf15-aa5a8d911c8b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:38.958831 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-64ebead6-6553-4766-bf15-aa5a8d911c8b tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563" status: 200 len: 1307 microversion: 2.1 time: 0.379410 Oct 29 03:02:38.974299 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1860/3540] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:38 2022] GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563 => generated 1307 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:02:39.354324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dd6bd212-b6ae-40cb-b8a5-635ffcf4e6a3 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:39.354324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dd6bd212-b6ae-40cb-b8a5-635ffcf4e6a3 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 2a076d87-4f15-4e95-9be9-c89b035c72e2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:39.367951 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd6bd212-b6ae-40cb-b8a5-635ffcf4e6a3 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:39.369381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd6bd212-b6ae-40cb-b8a5-635ffcf4e6a3 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:39.370620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd6bd212-b6ae-40cb-b8a5-635ffcf4e6a3 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:39.372252 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd6bd212-b6ae-40cb-b8a5-635ffcf4e6a3 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:39.373480 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd6bd212-b6ae-40cb-b8a5-635ffcf4e6a3 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:39.374851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd6bd212-b6ae-40cb-b8a5-635ffcf4e6a3 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:39.728953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-1344b15c-479d-478e-af78-73fdd03fa4b3 req-d2205187-c058-4f04-ad0a-4bda7393cb82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c79b743-fe77-42f1-88b9-594bc077b85b", "name": "network-vif-plugged", "status": "completed", "tag": "c356dc32-a5d0-49c6-a976-d7325331e07d"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:39.775470 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1344b15c-479d-478e-af78-73fdd03fa4b3 req-d2205187-c058-4f04-ad0a-4bda7393cb82 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:39.776273 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1344b15c-479d-478e-af78-73fdd03fa4b3 req-d2205187-c058-4f04-ad0a-4bda7393cb82 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:39.796956 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1344b15c-479d-478e-af78-73fdd03fa4b3 req-d2205187-c058-4f04-ad0a-4bda7393cb82 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:39.856956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dd6bd212-b6ae-40cb-b8a5-635ffcf4e6a3 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:39.861170 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-1344b15c-479d-478e-af78-73fdd03fa4b3 req-d2205187-c058-4f04-ad0a-4bda7393cb82 service nova] Creating event network-vif-plugged:c356dc32-a5d0-49c6-a976-d7325331e07d for instance 7c79b743-fe77-42f1-88b9-594bc077b85b on n-h1-862967-2 Oct 29 03:02:39.870133 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dd6bd212-b6ae-40cb-b8a5-635ffcf4e6a3 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/2a076d87-4f15-4e95-9be9-c89b035c72e2" status: 200 len: 1508 microversion: 2.1 time: 0.522843 Oct 29 03:02:39.871128 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1681/3541] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:39 2022] GET /compute/v2.1/servers/2a076d87-4f15-4e95-9be9-c89b035c72e2 => generated 1508 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:39.875898 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f87ff480-eaf7-4a01-8ead-47a38b609bc7 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:39.881608 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f87ff480-eaf7-4a01-8ead-47a38b609bc7 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] [instance: 7c79b743-fe77-42f1-88b9-594bc077b85b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:39.894010 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-1344b15c-479d-478e-af78-73fdd03fa4b3 req-d2205187-c058-4f04-ad0a-4bda7393cb82 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173768 Oct 29 03:02:39.899644 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1861/3542] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 29 03:02:39.901205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f87ff480-eaf7-4a01-8ead-47a38b609bc7 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:39.901716 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f87ff480-eaf7-4a01-8ead-47a38b609bc7 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:39.909374 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f87ff480-eaf7-4a01-8ead-47a38b609bc7 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:39.910399 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f87ff480-eaf7-4a01-8ead-47a38b609bc7 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:39.911335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f87ff480-eaf7-4a01-8ead-47a38b609bc7 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:39.912038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f87ff480-eaf7-4a01-8ead-47a38b609bc7 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:39.917976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ec56e5e0-73a2-4083-88eb-5515fe18a3b5 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:39.918950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ec56e5e0-73a2-4083-88eb-5515fe18a3b5 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: a96c21c1-c8a7-4f6f-93d6-ebb2af6240cf] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:39.952048 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ec56e5e0-73a2-4083-88eb-5515fe18a3b5 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:39.952573 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ec56e5e0-73a2-4083-88eb-5515fe18a3b5 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:39.954312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ec56e5e0-73a2-4083-88eb-5515fe18a3b5 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:39.960144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ec56e5e0-73a2-4083-88eb-5515fe18a3b5 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:39.962403 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ec56e5e0-73a2-4083-88eb-5515fe18a3b5 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:39.963040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ec56e5e0-73a2-4083-88eb-5515fe18a3b5 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:40.265395 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f87ff480-eaf7-4a01-8ead-47a38b609bc7 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d9c179a03f443c91b5e14528a332cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a563dd48004e3891a26468125ca652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:40.289143 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f87ff480-eaf7-4a01-8ead-47a38b609bc7 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] 10.222.0.46 "GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b" status: 200 len: 1316 microversion: 2.1 time: 0.416672 Oct 29 03:02:40.290074 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1682/3543] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:39 2022] GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b => generated 1316 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:40.295255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8af54b4b-a408-4f34-80ef-953a8cd2021a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:40.296118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8af54b4b-a408-4f34-80ef-953a8cd2021a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 2f159c62-4461-466d-8a38-85d781f27563] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:40.311070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8af54b4b-a408-4f34-80ef-953a8cd2021a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:40.312408 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8af54b4b-a408-4f34-80ef-953a8cd2021a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:40.313541 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8af54b4b-a408-4f34-80ef-953a8cd2021a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:40.314835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8af54b4b-a408-4f34-80ef-953a8cd2021a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:40.318633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8af54b4b-a408-4f34-80ef-953a8cd2021a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:40.319431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8af54b4b-a408-4f34-80ef-953a8cd2021a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:40.527862 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8af54b4b-a408-4f34-80ef-953a8cd2021a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:40.540449 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8af54b4b-a408-4f34-80ef-953a8cd2021a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563" status: 200 len: 1307 microversion: 2.1 time: 0.248778 Oct 29 03:02:40.542475 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1683/3544] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:40 2022] GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563 => generated 1307 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:40.620665 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ec56e5e0-73a2-4083-88eb-5515fe18a3b5 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:40.646808 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ec56e5e0-73a2-4083-88eb-5515fe18a3b5 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/a96c21c1-c8a7-4f6f-93d6-ebb2af6240cf" status: 200 len: 1507 microversion: 2.1 time: 0.732236 Oct 29 03:02:40.648458 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1862/3545] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:39 2022] GET /compute/v2.1/servers/a96c21c1-c8a7-4f6f-93d6-ebb2af6240cf => generated 1507 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:40.678165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0c3291b9-3a21-4aeb-87c5-fe023b7d26f1 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:40.679385 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9c19b801-98f8-4e75-9d31-cd510d34dc7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:40.679843 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9c19b801-98f8-4e75-9d31-cd510d34dc7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 347ef944-7c69-4650-be60-12e2070c38ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:40.681861 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0c3291b9-3a21-4aeb-87c5-fe023b7d26f1 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: a96c21c1-c8a7-4f6f-93d6-ebb2af6240cf] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:40.686718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c19b801-98f8-4e75-9d31-cd510d34dc7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:40.687439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c19b801-98f8-4e75-9d31-cd510d34dc7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:40.688074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c19b801-98f8-4e75-9d31-cd510d34dc7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:40.689642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c19b801-98f8-4e75-9d31-cd510d34dc7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:40.690280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c19b801-98f8-4e75-9d31-cd510d34dc7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:40.690871 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c19b801-98f8-4e75-9d31-cd510d34dc7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:40.693003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c3291b9-3a21-4aeb-87c5-fe023b7d26f1 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:40.693641 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c3291b9-3a21-4aeb-87c5-fe023b7d26f1 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:40.694335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c3291b9-3a21-4aeb-87c5-fe023b7d26f1 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:40.695936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c3291b9-3a21-4aeb-87c5-fe023b7d26f1 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:40.698147 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c3291b9-3a21-4aeb-87c5-fe023b7d26f1 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:40.699333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c3291b9-3a21-4aeb-87c5-fe023b7d26f1 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:40.711674 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-9c19b801-98f8-4e75-9d31-cd510d34dc7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] HTTP exception thrown: Instance 347ef944-7c69-4650-be60-12e2070c38ad could not be found. Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9c19b801-98f8-4e75-9d31-cd510d34dc7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Request method failure captured: Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad HTTP/1.1 Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJaEy18RgNLoRH_Cx5N19ntl_MZAWseAedf6nDvdLqq5Uv9fWq711j0XNb6BgsjwGmwVkwDsYZqRqnlQy1v9Czdk1P2JZBE7MuExsRjBvQLnTgLkLacVPY3yLp9R5pSFE5uStbCf24z3K2C9Y_7prmanNUiQJvOS6fzPpIe1j-F47IQ Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b67fc8dd1f4349ca85422bd9a08d3e06"}]}] Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 1ee6c4d28f304eab89014b9c46cc555a Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 347ef944-7c69-4650-be60-12e2070c38ad could not be found. Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '347ef944-7c69-4650-be60-12e2070c38ad'} Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 347ef944-7c69-4650-be60-12e2070c38ad could not be found. Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:40.714362 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:40.721145 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 347ef944-7c69-4650-be60-12e2070c38ad could not be found. Oct 29 03:02:40.721145 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:40.721145 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:40.721145 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:40.721145 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:40.721145 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:40.721145 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:40.721145 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:40.721145 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:40.721145 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 347ef944-7c69-4650-be60-12e2070c38ad could not be found. Oct 29 03:02:40.721145 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:40.724656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9c19b801-98f8-4e75-9d31-cd510d34dc7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Returning 404 to user: Instance 347ef944-7c69-4650-be60-12e2070c38ad could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:40.725806 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9c19b801-98f8-4e75-9d31-cd510d34dc7f tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "DELETE /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad" status: 404 len: 111 microversion: 2.1 time: 0.057670 Oct 29 03:02:40.726602 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1863/3546] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:02:40 2022] DELETE /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:40.735739 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ad1ca60f-a158-424f-9aeb-d5631b707649 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:40.740715 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ad1ca60f-a158-424f-9aeb-d5631b707649 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 347ef944-7c69-4650-be60-12e2070c38ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:40.741423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0c3291b9-3a21-4aeb-87c5-fe023b7d26f1 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: a96c21c1-c8a7-4f6f-93d6-ebb2af6240cf] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:02:40.754565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad1ca60f-a158-424f-9aeb-d5631b707649 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:40.760678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad1ca60f-a158-424f-9aeb-d5631b707649 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:40.761498 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad1ca60f-a158-424f-9aeb-d5631b707649 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:40.762549 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad1ca60f-a158-424f-9aeb-d5631b707649 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:40.763246 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad1ca60f-a158-424f-9aeb-d5631b707649 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:40.763912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad1ca60f-a158-424f-9aeb-d5631b707649 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:40.797722 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-ad1ca60f-a158-424f-9aeb-d5631b707649 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] HTTP exception thrown: Instance 347ef944-7c69-4650-be60-12e2070c38ad could not be found. Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ad1ca60f-a158-424f-9aeb-d5631b707649 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Request method failure captured: Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad HTTP/1.1 Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJaEy18RgNLoRH_Cx5N19ntl_MZAWseAedf6nDvdLqq5Uv9fWq711j0XNb6BgsjwGmwVkwDsYZqRqnlQy1v9Czdk1P2JZBE7MuExsRjBvQLnTgLkLacVPY3yLp9R5pSFE5uStbCf24z3K2C9Y_7prmanNUiQJvOS6fzPpIe1j-F47IQ Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b67fc8dd1f4349ca85422bd9a08d3e06"}]}] Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 1ee6c4d28f304eab89014b9c46cc555a Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 347ef944-7c69-4650-be60-12e2070c38ad could not be found. Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '347ef944-7c69-4650-be60-12e2070c38ad'} Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 347ef944-7c69-4650-be60-12e2070c38ad could not be found. Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 347ef944-7c69-4650-be60-12e2070c38ad could not be found. Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:40.807189 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:40.812645 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:40.812645 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:40.812645 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:40.812645 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:40.812645 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:40.812645 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 347ef944-7c69-4650-be60-12e2070c38ad could not be found. Oct 29 03:02:40.812645 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:40.815412 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ad1ca60f-a158-424f-9aeb-d5631b707649 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Returning 404 to user: Instance 347ef944-7c69-4650-be60-12e2070c38ad could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:40.816766 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ad1ca60f-a158-424f-9aeb-d5631b707649 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad" status: 404 len: 111 microversion: 2.1 time: 0.084829 Oct 29 03:02:40.818084 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1864/3547] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:40 2022] GET /compute/v2.1/servers/347ef944-7c69-4650-be60-12e2070c38ad => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:40.832597 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e3c16e55-92a6-4034-a3f6-57b7c7df0d83 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:40.832597 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e3c16e55-92a6-4034-a3f6-57b7c7df0d83 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 4876d09c-0ef0-4434-adb5-ca84626ca4bb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:40.846533 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e3c16e55-92a6-4034-a3f6-57b7c7df0d83 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:40.847673 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e3c16e55-92a6-4034-a3f6-57b7c7df0d83 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:40.848118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e3c16e55-92a6-4034-a3f6-57b7c7df0d83 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:40.848866 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e3c16e55-92a6-4034-a3f6-57b7c7df0d83 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:40.849321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e3c16e55-92a6-4034-a3f6-57b7c7df0d83 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:40.849741 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e3c16e55-92a6-4034-a3f6-57b7c7df0d83 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:40.877674 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-e3c16e55-92a6-4034-a3f6-57b7c7df0d83 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] HTTP exception thrown: Instance 4876d09c-0ef0-4434-adb5-ca84626ca4bb could not be found. Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e3c16e55-92a6-4034-a3f6-57b7c7df0d83 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Request method failure captured: Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb HTTP/1.1 Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJaEy18RgNLoRH_Cx5N19ntl_MZAWseAedf6nDvdLqq5Uv9fWq711j0XNb6BgsjwGmwVkwDsYZqRqnlQy1v9Czdk1P2JZBE7MuExsRjBvQLnTgLkLacVPY3yLp9R5pSFE5uStbCf24z3K2C9Y_7prmanNUiQJvOS6fzPpIe1j-F47IQ Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b67fc8dd1f4349ca85422bd9a08d3e06"}]}] Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 1ee6c4d28f304eab89014b9c46cc555a Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 4876d09c-0ef0-4434-adb5-ca84626ca4bb could not be found. Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '4876d09c-0ef0-4434-adb5-ca84626ca4bb'} Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4876d09c-0ef0-4434-adb5-ca84626ca4bb could not be found. Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:40.879170 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:40.888069 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4876d09c-0ef0-4434-adb5-ca84626ca4bb could not be found. Oct 29 03:02:40.888069 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:40.888069 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:40.888069 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:40.888069 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:40.888069 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:40.888069 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:40.888069 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:40.888069 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:40.888069 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4876d09c-0ef0-4434-adb5-ca84626ca4bb could not be found. Oct 29 03:02:40.888069 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:40.888069 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e3c16e55-92a6-4034-a3f6-57b7c7df0d83 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Returning 404 to user: Instance 4876d09c-0ef0-4434-adb5-ca84626ca4bb could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:40.889205 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0c3291b9-3a21-4aeb-87c5-fe023b7d26f1 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a96c21c1-c8a7-4f6f-93d6-ebb2af6240cf" status: 204 len: 0 microversion: 2.1 time: 0.211637 Oct 29 03:02:40.889644 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e3c16e55-92a6-4034-a3f6-57b7c7df0d83 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb" status: 404 len: 111 microversion: 2.1 time: 0.058423 Oct 29 03:02:40.889759 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1684/3548] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:02:40 2022] DELETE /compute/v2.1/servers/a96c21c1-c8a7-4f6f-93d6-ebb2af6240cf => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:02:40.889861 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1865/3549] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:02:40 2022] DELETE /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:40.894022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-50668661-5ad6-4b8b-9f17-f41ff1fbc0e3 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:40.894781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-50668661-5ad6-4b8b-9f17-f41ff1fbc0e3 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 2a076d87-4f15-4e95-9be9-c89b035c72e2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:40.902070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50668661-5ad6-4b8b-9f17-f41ff1fbc0e3 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:40.902702 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50668661-5ad6-4b8b-9f17-f41ff1fbc0e3 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:40.903160 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c78535b1-0f5f-4d68-a633-b2b05883d912 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:40.903304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50668661-5ad6-4b8b-9f17-f41ff1fbc0e3 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:40.904101 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50668661-5ad6-4b8b-9f17-f41ff1fbc0e3 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:40.904845 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50668661-5ad6-4b8b-9f17-f41ff1fbc0e3 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:40.905374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50668661-5ad6-4b8b-9f17-f41ff1fbc0e3 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:40.905523 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c78535b1-0f5f-4d68-a633-b2b05883d912 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] [instance: 4876d09c-0ef0-4434-adb5-ca84626ca4bb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:40.931093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c78535b1-0f5f-4d68-a633-b2b05883d912 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:40.933310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c78535b1-0f5f-4d68-a633-b2b05883d912 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:40.933806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c78535b1-0f5f-4d68-a633-b2b05883d912 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:40.934569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c78535b1-0f5f-4d68-a633-b2b05883d912 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:40.937357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-50668661-5ad6-4b8b-9f17-f41ff1fbc0e3 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 2a076d87-4f15-4e95-9be9-c89b035c72e2] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:02:40.940443 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c78535b1-0f5f-4d68-a633-b2b05883d912 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:40.941376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c78535b1-0f5f-4d68-a633-b2b05883d912 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:40.988787 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-c78535b1-0f5f-4d68-a633-b2b05883d912 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] HTTP exception thrown: Instance 4876d09c-0ef0-4434-adb5-ca84626ca4bb could not be found. Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c78535b1-0f5f-4d68-a633-b2b05883d912 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Request method failure captured: Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb HTTP/1.1 Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJaEy18RgNLoRH_Cx5N19ntl_MZAWseAedf6nDvdLqq5Uv9fWq711j0XNb6BgsjwGmwVkwDsYZqRqnlQy1v9Czdk1P2JZBE7MuExsRjBvQLnTgLkLacVPY3yLp9R5pSFE5uStbCf24z3K2C9Y_7prmanNUiQJvOS6fzPpIe1j-F47IQ Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b67fc8dd1f4349ca85422bd9a08d3e06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b67fc8dd1f4349ca85422bd9a08d3e06"}]}] Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: b67fc8dd1f4349ca85422bd9a08d3e06 Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-DeleteServersTestJSON-485778383 Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 1ee6c4d28f304eab89014b9c46cc555a Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-DeleteServersTestJSON-485778383-project Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 4876d09c-0ef0-4434-adb5-ca84626ca4bb could not be found. Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '4876d09c-0ef0-4434-adb5-ca84626ca4bb'} Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4876d09c-0ef0-4434-adb5-ca84626ca4bb could not be found. Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4876d09c-0ef0-4434-adb5-ca84626ca4bb could not be found. Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:40.992247 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:41.000573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:41.000573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:41.000573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:41.000573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:41.000573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:41.000573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4876d09c-0ef0-4434-adb5-ca84626ca4bb could not be found. Oct 29 03:02:41.000573 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:41.000573 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c78535b1-0f5f-4d68-a633-b2b05883d912 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] Returning 404 to user: Instance 4876d09c-0ef0-4434-adb5-ca84626ca4bb could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:41.000573 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c78535b1-0f5f-4d68-a633-b2b05883d912 tempest-DeleteServersTestJSON-485778383 tempest-DeleteServersTestJSON-485778383-project] 10.222.0.46 "GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb" status: 404 len: 111 microversion: 2.1 time: 0.107940 Oct 29 03:02:41.002518 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1685/3550] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:40 2022] GET /compute/v2.1/servers/4876d09c-0ef0-4434-adb5-ca84626ca4bb => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:41.093467 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-50668661-5ad6-4b8b-9f17-f41ff1fbc0e3 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2a076d87-4f15-4e95-9be9-c89b035c72e2" status: 204 len: 0 microversion: 2.1 time: 0.203989 Oct 29 03:02:41.099461 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1866/3551] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:02:40 2022] DELETE /compute/v2.1/servers/2a076d87-4f15-4e95-9be9-c89b035c72e2 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:02:41.279314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-824a9c59-6291-4284-a6b4-e672ce5306ce tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-521705659", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "6f67a35e-ba58-41d2-a295-f639fe07bc93"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:41.315551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2b65ebae-b925-484b-9bd5-22d0aab64340 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:41.316262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2b65ebae-b925-484b-9bd5-22d0aab64340 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] [instance: 7c79b743-fe77-42f1-88b9-594bc077b85b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:41.329042 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2b65ebae-b925-484b-9bd5-22d0aab64340 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:41.329743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2b65ebae-b925-484b-9bd5-22d0aab64340 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:41.330238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2b65ebae-b925-484b-9bd5-22d0aab64340 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:41.331074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2b65ebae-b925-484b-9bd5-22d0aab64340 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:41.331578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2b65ebae-b925-484b-9bd5-22d0aab64340 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:41.332012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2b65ebae-b925-484b-9bd5-22d0aab64340 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:41.365702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-824a9c59-6291-4284-a6b4-e672ce5306ce tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] validate_networks() for [('6f67a35e-ba58-41d2-a295-f639fe07bc93', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:02:42.028145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2b65ebae-b925-484b-9bd5-22d0aab64340 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d9c179a03f443c91b5e14528a332cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a563dd48004e3891a26468125ca652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:42.061342 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2b65ebae-b925-484b-9bd5-22d0aab64340 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] 10.222.0.46 "GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b" status: 200 len: 1316 microversion: 2.1 time: 0.748632 Oct 29 03:02:42.073413 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1867/3552] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:41 2022] GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b => generated 1316 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:02:42.104329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8a247879-e748-4df7-9e0a-d3af97a3e6b4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:42.105899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8a247879-e748-4df7-9e0a-d3af97a3e6b4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 2f159c62-4461-466d-8a38-85d781f27563] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:42.147545 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8a247879-e748-4df7-9e0a-d3af97a3e6b4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:42.148644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8a247879-e748-4df7-9e0a-d3af97a3e6b4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:42.149588 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8a247879-e748-4df7-9e0a-d3af97a3e6b4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:42.151057 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8a247879-e748-4df7-9e0a-d3af97a3e6b4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:42.152013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8a247879-e748-4df7-9e0a-d3af97a3e6b4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:42.152994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8a247879-e748-4df7-9e0a-d3af97a3e6b4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:42.735806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-824a9c59-6291-4284-a6b4-e672ce5306ce tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:02:42.736669 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-824a9c59-6291-4284-a6b4-e672ce5306ce tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:02:42.737018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-824a9c59-6291-4284-a6b4-e672ce5306ce tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:02:42.737387 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-824a9c59-6291-4284-a6b4-e672ce5306ce tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:02:42.737545 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-824a9c59-6291-4284-a6b4-e672ce5306ce tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:02:42.761879 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-824a9c59-6291-4284-a6b4-e672ce5306ce tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:42.765436 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-824a9c59-6291-4284-a6b4-e672ce5306ce tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:42.766212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-824a9c59-6291-4284-a6b4-e672ce5306ce tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:42.767589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-824a9c59-6291-4284-a6b4-e672ce5306ce tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:42.770061 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-824a9c59-6291-4284-a6b4-e672ce5306ce tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:42.774398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-824a9c59-6291-4284-a6b4-e672ce5306ce tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:42.800052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8a247879-e748-4df7-9e0a-d3af97a3e6b4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:42.808465 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8a247879-e748-4df7-9e0a-d3af97a3e6b4 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563" status: 200 len: 1307 microversion: 2.1 time: 0.733067 Oct 29 03:02:42.809676 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1868/3553] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:42 2022] GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563 => generated 1307 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:42.817963 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-46d59fe7-3d8d-4aac-b8f7-fd7902ed692a req-3b097813-44d2-41bd-8595-ef760c0fdbaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f159c62-4461-466d-8a38-85d781f27563", "name": "network-vif-plugged", "status": "completed", "tag": "be6a2e7b-8209-4567-8de0-f674259a2db5"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:42.829761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-46d59fe7-3d8d-4aac-b8f7-fd7902ed692a req-3b097813-44d2-41bd-8595-ef760c0fdbaf service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:42.830647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-46d59fe7-3d8d-4aac-b8f7-fd7902ed692a req-3b097813-44d2-41bd-8595-ef760c0fdbaf service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:42.831296 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-46d59fe7-3d8d-4aac-b8f7-fd7902ed692a req-3b097813-44d2-41bd-8595-ef760c0fdbaf service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:42.842554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-824a9c59-6291-4284-a6b4-e672ce5306ce tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Getting quotas for project 3fbd3d4fe8c54fc7852468af9eeb92ff. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:02:42.849499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-824a9c59-6291-4284-a6b4-e672ce5306ce tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Getting quotas for user 8ed77e18046c455ba3a0e0c4434d44bf and project 3fbd3d4fe8c54fc7852468af9eeb92ff. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:02:42.864106 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-46d59fe7-3d8d-4aac-b8f7-fd7902ed692a req-3b097813-44d2-41bd-8595-ef760c0fdbaf service nova] Creating event network-vif-plugged:be6a2e7b-8209-4567-8de0-f674259a2db5 for instance 2f159c62-4461-466d-8a38-85d781f27563 on n-h2-862967-2 Oct 29 03:02:42.864726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:42.870986 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-824a9c59-6291-4284-a6b4-e672ce5306ce tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Going to run 2 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:02:42.871503 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-46d59fe7-3d8d-4aac-b8f7-fd7902ed692a req-3b097813-44d2-41bd-8595-ef760c0fdbaf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059677 Oct 29 03:02:42.876999 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1869/3554] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:42.877410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-824a9c59-6291-4284-a6b4-e672ce5306ce tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 9f07c0ca-a21e-4a99-a087-96888df280ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:02:42.927931 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-824a9c59-6291-4284-a6b4-e672ce5306ce tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 521d52e2-7212-40c5-b698-b15c52053181] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=9f07c0ca-a21e-4a99-a087-96888df280ed,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:02:43.001872 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-824a9c59-6291-4284-a6b4-e672ce5306ce tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.725532 Oct 29 03:02:43.007466 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1686/3555] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:02:41 2022] POST /compute/v2.1/servers => generated 32 bytes in 1728 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 29 03:02:43.013723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-57151006-6ca6-48fc-84fd-e7da213c6997 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:43.020781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-57151006-6ca6-48fc-84fd-e7da213c6997 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:43.021779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-57151006-6ca6-48fc-84fd-e7da213c6997 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Searching by: {'deleted': False, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff'} {{(pid=127124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:02:43.045272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-57151006-6ca6-48fc-84fd-e7da213c6997 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:43.046337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-57151006-6ca6-48fc-84fd-e7da213c6997 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:43.046564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-57151006-6ca6-48fc-84fd-e7da213c6997 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:43.047320 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-57151006-6ca6-48fc-84fd-e7da213c6997 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:43.048392 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-57151006-6ca6-48fc-84fd-e7da213c6997 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:43.049249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-57151006-6ca6-48fc-84fd-e7da213c6997 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:43.084176 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.multi_cell_list [None req-57151006-6ca6-48fc-84fd-e7da213c6997 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=127124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:02:43.104424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bcb4c47b-ce25-4b83-990b-1aa3c6c5f6a8 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:43.105119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bcb4c47b-ce25-4b83-990b-1aa3c6c5f6a8 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] [instance: 7c79b743-fe77-42f1-88b9-594bc077b85b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:43.116475 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bcb4c47b-ce25-4b83-990b-1aa3c6c5f6a8 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:43.116999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bcb4c47b-ce25-4b83-990b-1aa3c6c5f6a8 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:43.119119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bcb4c47b-ce25-4b83-990b-1aa3c6c5f6a8 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:43.120007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bcb4c47b-ce25-4b83-990b-1aa3c6c5f6a8 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:43.122742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bcb4c47b-ce25-4b83-990b-1aa3c6c5f6a8 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:43.123747 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bcb4c47b-ce25-4b83-990b-1aa3c6c5f6a8 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:43.159123 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-57151006-6ca6-48fc-84fd-e7da213c6997 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.149540 Oct 29 03:02:43.164252 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1870/3556] 10.222.0.46 () {58 vars in 1125 bytes} [Sat Oct 29 03:02:43 2022] GET /compute/v2.1/servers => generated 1335 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:43.191009 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2d0f129c-b1e7-4672-aadc-aad8b6b3ba50 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:43.195499 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2d0f129c-b1e7-4672-aadc-aad8b6b3ba50 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 521d52e2-7212-40c5-b698-b15c52053181] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:43.452492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2d0f129c-b1e7-4672-aadc-aad8b6b3ba50 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:43.482339 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2d0f129c-b1e7-4672-aadc-aad8b6b3ba50 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181" status: 200 len: 1217 microversion: 2.1 time: 0.298111 Oct 29 03:02:43.488963 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1871/3557] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:43 2022] GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181 => generated 1217 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:43.811928 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bcb4c47b-ce25-4b83-990b-1aa3c6c5f6a8 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d9c179a03f443c91b5e14528a332cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a563dd48004e3891a26468125ca652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:43.829966 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bcb4c47b-ce25-4b83-990b-1aa3c6c5f6a8 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] 10.222.0.46 "GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b" status: 200 len: 1504 microversion: 2.1 time: 0.730539 Oct 29 03:02:43.846503 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1687/3558] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:43 2022] GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b => generated 1504 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:02:43.856165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a893771a-d25f-442a-b91f-af5dae575f41 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:43.856843 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a893771a-d25f-442a-b91f-af5dae575f41 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 2f159c62-4461-466d-8a38-85d781f27563] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:43.874771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a893771a-d25f-442a-b91f-af5dae575f41 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:43.874771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a893771a-d25f-442a-b91f-af5dae575f41 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:43.874771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a893771a-d25f-442a-b91f-af5dae575f41 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:43.874771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a893771a-d25f-442a-b91f-af5dae575f41 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:43.874771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a893771a-d25f-442a-b91f-af5dae575f41 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:43.874771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a893771a-d25f-442a-b91f-af5dae575f41 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:43.886465 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-00990080-b14b-48bd-993d-55a092554cde tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:43.889778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-00990080-b14b-48bd-993d-55a092554cde tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] [instance: 7c79b743-fe77-42f1-88b9-594bc077b85b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:43.913741 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00990080-b14b-48bd-993d-55a092554cde tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:43.923863 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00990080-b14b-48bd-993d-55a092554cde tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:43.924964 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00990080-b14b-48bd-993d-55a092554cde tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:43.929404 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00990080-b14b-48bd-993d-55a092554cde tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:43.930488 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00990080-b14b-48bd-993d-55a092554cde tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:43.942795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00990080-b14b-48bd-993d-55a092554cde tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:44.000138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:44.099341 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-00990080-b14b-48bd-993d-55a092554cde tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.221594 Oct 29 03:02:44.103559 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1688/3559] 10.222.0.46 () {58 vars in 1296 bytes} [Sat Oct 29 03:02:43 2022] DELETE /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b/os-server-password => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:02:44.117326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1417583a-f5bf-4649-adb0-3fb6aff88e06 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:44.121204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1417583a-f5bf-4649-adb0-3fb6aff88e06 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] [instance: 7c79b743-fe77-42f1-88b9-594bc077b85b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:44.145569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1417583a-f5bf-4649-adb0-3fb6aff88e06 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:44.148961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1417583a-f5bf-4649-adb0-3fb6aff88e06 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:44.149529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1417583a-f5bf-4649-adb0-3fb6aff88e06 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:44.150953 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1417583a-f5bf-4649-adb0-3fb6aff88e06 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:44.156067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1417583a-f5bf-4649-adb0-3fb6aff88e06 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:44.160814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1417583a-f5bf-4649-adb0-3fb6aff88e06 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:44.256126 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1417583a-f5bf-4649-adb0-3fb6aff88e06 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] 10.222.0.46 "GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.144107 Oct 29 03:02:44.261853 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1689/3560] 10.222.0.46 () {58 vars in 1293 bytes} [Sat Oct 29 03:02:44 2022] GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b/os-server-password => generated 16 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 03:02:44.272459 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-6becce4b-11fb-47cd-a2b7-8b3ca7c7eeac req-62a7b5ad-fb11-4924-8ad8-5ecdb2dda840 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a076d87-4f15-4e95-9be9-c89b035c72e2", "name": "network-vif-deleted", "tag": "fc7e740a-c632-4df7-8793-3d1049c7d1f1"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:44.316477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6becce4b-11fb-47cd-a2b7-8b3ca7c7eeac req-62a7b5ad-fb11-4924-8ad8-5ecdb2dda840 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:44.321706 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6becce4b-11fb-47cd-a2b7-8b3ca7c7eeac req-62a7b5ad-fb11-4924-8ad8-5ecdb2dda840 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:44.322792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6becce4b-11fb-47cd-a2b7-8b3ca7c7eeac req-62a7b5ad-fb11-4924-8ad8-5ecdb2dda840 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:44.395079 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-6becce4b-11fb-47cd-a2b7-8b3ca7c7eeac req-62a7b5ad-fb11-4924-8ad8-5ecdb2dda840 service nova] Creating event network-vif-deleted:fc7e740a-c632-4df7-8793-3d1049c7d1f1 for instance 2a076d87-4f15-4e95-9be9-c89b035c72e2 on n-h2-862967-2 Oct 29 03:02:44.428912 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-6becce4b-11fb-47cd-a2b7-8b3ca7c7eeac req-62a7b5ad-fb11-4924-8ad8-5ecdb2dda840 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164160 Oct 29 03:02:44.429184 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1690/3561] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:44.440085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-21661734-c046-4b50-a7b2-b735ad64b4ad tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:44.448941 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-21661734-c046-4b50-a7b2-b735ad64b4ad tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] [instance: 7c79b743-fe77-42f1-88b9-594bc077b85b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:44.473326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-21661734-c046-4b50-a7b2-b735ad64b4ad tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:44.474735 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-21661734-c046-4b50-a7b2-b735ad64b4ad tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:44.476056 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-21661734-c046-4b50-a7b2-b735ad64b4ad tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:44.482225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-21661734-c046-4b50-a7b2-b735ad64b4ad tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:44.487027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-21661734-c046-4b50-a7b2-b735ad64b4ad tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:44.492005 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-21661734-c046-4b50-a7b2-b735ad64b4ad tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:44.597035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-21661734-c046-4b50-a7b2-b735ad64b4ad tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] [instance: 7c79b743-fe77-42f1-88b9-594bc077b85b] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:02:44.705848 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a893771a-d25f-442a-b91f-af5dae575f41 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:44.716819 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a893771a-d25f-442a-b91f-af5dae575f41 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563" status: 200 len: 1307 microversion: 2.1 time: 0.872398 Oct 29 03:02:44.724100 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1872/3562] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:43 2022] GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563 => generated 1307 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:44.742210 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e94abb47-8971-4364-a49f-811187f27488 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:44.742812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e94abb47-8971-4364-a49f-811187f27488 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 521d52e2-7212-40c5-b698-b15c52053181] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:44.772576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e94abb47-8971-4364-a49f-811187f27488 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:44.772859 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e94abb47-8971-4364-a49f-811187f27488 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:44.776834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e94abb47-8971-4364-a49f-811187f27488 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:44.777718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e94abb47-8971-4364-a49f-811187f27488 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:44.778212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e94abb47-8971-4364-a49f-811187f27488 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:44.778689 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e94abb47-8971-4364-a49f-811187f27488 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:44.935112 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-21661734-c046-4b50-a7b2-b735ad64b4ad tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b" status: 204 len: 0 microversion: 2.1 time: 0.502779 Oct 29 03:02:44.949107 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1691/3563] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:02:44 2022] DELETE /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:02:44.958570 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-f8f7c930-6b7e-4561-a15c-04c1a7d48e08 req-aa73acbf-38b1-4962-99de-1617082976b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a96c21c1-c8a7-4f6f-93d6-ebb2af6240cf", "name": "network-vif-deleted", "tag": "a83f3df1-a0d1-43c3-8096-0e9d2fd92e5f"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:44.979498 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e94abb47-8971-4364-a49f-811187f27488 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:44.993345 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e94abb47-8971-4364-a49f-811187f27488 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181" status: 200 len: 1221 microversion: 2.1 time: 0.268018 Oct 29 03:02:44.994302 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1873/3564] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:44 2022] GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181 => generated 1221 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:44.995060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f8f7c930-6b7e-4561-a15c-04c1a7d48e08 req-aa73acbf-38b1-4962-99de-1617082976b4 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:45.005423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f8f7c930-6b7e-4561-a15c-04c1a7d48e08 req-aa73acbf-38b1-4962-99de-1617082976b4 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:45.006288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f8f7c930-6b7e-4561-a15c-04c1a7d48e08 req-aa73acbf-38b1-4962-99de-1617082976b4 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:45.007202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bc45190b-6c68-4449-812f-60cd6f161dc0 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:45.008360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bc45190b-6c68-4449-812f-60cd6f161dc0 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] [instance: 7c79b743-fe77-42f1-88b9-594bc077b85b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:45.023038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc45190b-6c68-4449-812f-60cd6f161dc0 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:45.023863 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc45190b-6c68-4449-812f-60cd6f161dc0 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:45.025018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc45190b-6c68-4449-812f-60cd6f161dc0 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:45.027048 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc45190b-6c68-4449-812f-60cd6f161dc0 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:45.027682 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc45190b-6c68-4449-812f-60cd6f161dc0 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:45.030161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc45190b-6c68-4449-812f-60cd6f161dc0 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:45.044430 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-f8f7c930-6b7e-4561-a15c-04c1a7d48e08 req-aa73acbf-38b1-4962-99de-1617082976b4 service nova] Creating event network-vif-deleted:a83f3df1-a0d1-43c3-8096-0e9d2fd92e5f for instance a96c21c1-c8a7-4f6f-93d6-ebb2af6240cf on n-h1-862967-2 Oct 29 03:02:45.069364 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-f8f7c930-6b7e-4561-a15c-04c1a7d48e08 req-aa73acbf-38b1-4962-99de-1617082976b4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117596 Oct 29 03:02:45.085065 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1692/3565] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:45.412615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bc45190b-6c68-4449-812f-60cd6f161dc0 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d9c179a03f443c91b5e14528a332cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a563dd48004e3891a26468125ca652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:45.421812 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bc45190b-6c68-4449-812f-60cd6f161dc0 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] 10.222.0.46 "GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b" status: 200 len: 1510 microversion: 2.1 time: 0.426240 Oct 29 03:02:45.424031 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1874/3566] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:44 2022] GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b => generated 1510 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:45.750105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3d94990e-0382-43f7-96be-276727b92001 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:45.750105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3d94990e-0382-43f7-96be-276727b92001 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 2f159c62-4461-466d-8a38-85d781f27563] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:45.766155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d94990e-0382-43f7-96be-276727b92001 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:45.767482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d94990e-0382-43f7-96be-276727b92001 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:45.769079 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d94990e-0382-43f7-96be-276727b92001 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:45.770271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d94990e-0382-43f7-96be-276727b92001 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:45.770915 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d94990e-0382-43f7-96be-276727b92001 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:45.773063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d94990e-0382-43f7-96be-276727b92001 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:46.047041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d2482ba5-8140-4b31-a3f9-2791c4c7c21f tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:46.048206 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d2482ba5-8140-4b31-a3f9-2791c4c7c21f tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 521d52e2-7212-40c5-b698-b15c52053181] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:46.072844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:46.075527 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d2482ba5-8140-4b31-a3f9-2791c4c7c21f tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:46.076337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d2482ba5-8140-4b31-a3f9-2791c4c7c21f tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:46.081202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d2482ba5-8140-4b31-a3f9-2791c4c7c21f tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:46.082372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d2482ba5-8140-4b31-a3f9-2791c4c7c21f tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:46.093373 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d2482ba5-8140-4b31-a3f9-2791c4c7c21f tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:46.094295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d2482ba5-8140-4b31-a3f9-2791c4c7c21f tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:46.258344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d2482ba5-8140-4b31-a3f9-2791c4c7c21f tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:46.269103 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d2482ba5-8140-4b31-a3f9-2791c4c7c21f tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181" status: 200 len: 1287 microversion: 2.1 time: 0.230921 Oct 29 03:02:46.275478 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1875/3567] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:46 2022] GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181 => generated 1287 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:02:46.455516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ddba4a92-1cd4-4104-a712-e799546eae81 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:46.456144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ddba4a92-1cd4-4104-a712-e799546eae81 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] [instance: 7c79b743-fe77-42f1-88b9-594bc077b85b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:46.470673 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ddba4a92-1cd4-4104-a712-e799546eae81 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:46.471207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ddba4a92-1cd4-4104-a712-e799546eae81 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:46.472387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ddba4a92-1cd4-4104-a712-e799546eae81 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:46.473259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ddba4a92-1cd4-4104-a712-e799546eae81 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:46.473729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ddba4a92-1cd4-4104-a712-e799546eae81 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:46.477358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ddba4a92-1cd4-4104-a712-e799546eae81 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:46.541024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3d94990e-0382-43f7-96be-276727b92001 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:46.555246 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3d94990e-0382-43f7-96be-276727b92001 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563" status: 200 len: 1487 microversion: 2.1 time: 0.810849 Oct 29 03:02:46.563291 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1693/3568] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:45 2022] GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563 => generated 1487 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:02:46.602162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dfceadfc-81fd-40be-816d-df36f4ccf5bf tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1210456580"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:46.607876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dfceadfc-81fd-40be-816d-df36f4ccf5bf tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 2f159c62-4461-466d-8a38-85d781f27563] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:46.620474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dfceadfc-81fd-40be-816d-df36f4ccf5bf tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:46.621897 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dfceadfc-81fd-40be-816d-df36f4ccf5bf tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:46.622906 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dfceadfc-81fd-40be-816d-df36f4ccf5bf tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:46.623981 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dfceadfc-81fd-40be-816d-df36f4ccf5bf tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:46.624717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dfceadfc-81fd-40be-816d-df36f4ccf5bf tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:46.625524 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dfceadfc-81fd-40be-816d-df36f4ccf5bf tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:46.815320 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ddba4a92-1cd4-4104-a712-e799546eae81 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d9c179a03f443c91b5e14528a332cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a563dd48004e3891a26468125ca652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:46.850761 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ddba4a92-1cd4-4104-a712-e799546eae81 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] 10.222.0.46 "GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b" status: 200 len: 1510 microversion: 2.1 time: 0.396663 Oct 29 03:02:46.855831 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1876/3569] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:46 2022] GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b => generated 1510 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:02:46.996662 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dfceadfc-81fd-40be-816d-df36f4ccf5bf tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "POST /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563/action" status: 202 len: 0 microversion: 2.1 time: 0.400562 Oct 29 03:02:46.999414 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1694/3570] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:02:46 2022] POST /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 29 03:02:47.014405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b9e31def-9e73-4d00-a4d6-2369fe4f9e33 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff058160dc0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:47.130869 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b9e31def-9e73-4d00-a4d6-2369fe4f9e33 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/9832a0eb-f605-4545-916d-c18ec9e92137" status: 200 len: 1410 microversion: 2.1 time: 0.121234 Oct 29 03:02:47.145000 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1877/3571] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:02:47 2022] GET /compute/v2.1/images/9832a0eb-f605-4545-916d-c18ec9e92137 => generated 1410 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:02:47.160337 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2c1d527e-699a-4e7c-979b-2c2a6ec7e82c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053954160>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:47.293432 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2c1d527e-699a-4e7c-979b-2c2a6ec7e82c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/9832a0eb-f605-4545-916d-c18ec9e92137" status: 200 len: 1410 microversion: 2.1 time: 0.137780 Oct 29 03:02:47.297005 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1695/3572] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:02:47 2022] GET /compute/v2.1/images/9832a0eb-f605-4545-916d-c18ec9e92137 => generated 1410 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:47.325186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f0b3f896-3507-4ded-b4b0-a0e913054f3e tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:47.327272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f0b3f896-3507-4ded-b4b0-a0e913054f3e tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 521d52e2-7212-40c5-b698-b15c52053181] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:47.330345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-019e748d-2a3b-45e8-9755-fb4bde69d559 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff05387ad30>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:47.348241 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0b3f896-3507-4ded-b4b0-a0e913054f3e tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:47.349734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0b3f896-3507-4ded-b4b0-a0e913054f3e tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:47.353109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0b3f896-3507-4ded-b4b0-a0e913054f3e tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:47.355214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0b3f896-3507-4ded-b4b0-a0e913054f3e tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:47.358328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0b3f896-3507-4ded-b4b0-a0e913054f3e tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:47.359440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0b3f896-3507-4ded-b4b0-a0e913054f3e tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:47.595591 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-019e748d-2a3b-45e8-9755-fb4bde69d559 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "DELETE /compute/v2.1/images/9832a0eb-f605-4545-916d-c18ec9e92137" status: 204 len: 0 microversion: 2.1 time: 0.280235 Oct 29 03:02:47.600174 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1696/3573] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:47 2022] DELETE /compute/v2.1/images/9832a0eb-f605-4545-916d-c18ec9e92137 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:02:47.606349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cab6042d-83e8-4f88-81af-99964612a430 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff05387a790>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:47.659503 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-cab6042d-83e8-4f88-81af-99964612a430 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] HTTP exception thrown: Image not found. Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cab6042d-83e8-4f88-81af-99964612a430 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Request method failure captured: Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/images/9832a0eb-f605-4545-916d-c18ec9e92137 HTTP/1.1 Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJaPFemTZ_UF20zmv9lzuySxzmYogL3HGJEwUZdUOnmSf32UFdECKHuxy10ErZgp7nOMsETdmVm6qO1Cseou8vOu24Afz6OEyVlhZTaET2mZYvbTpEFvWYnX_iHJiqkebumOgGpaD-j1ug4WAr0UmKaAvXO_0oQilfvx3gbnKVIbMs8 Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_185d32c10dd845768f4ff70a85680358"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/185d32c10dd845768f4ff70a85680358"}]}] Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ImagesTestJSON-90655156 Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: c866f273672846eb8d7f4f2a00269666 Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: exception: Image not found. Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '9832a0eb-f605-4545-916d-c18ec9e92137'} Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9832a0eb-f605-4545-916d-c18ec9e92137 Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 29 03:02:47.661936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9832a0eb-f605-4545-916d-c18ec9e92137 could not be found. Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cab6042d-83e8-4f88-81af-99964612a430 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Returning 404 to user: Image not found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:47.666525 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cab6042d-83e8-4f88-81af-99964612a430 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/images/9832a0eb-f605-4545-916d-c18ec9e92137" status: 404 len: 62 microversion: 2.1 time: 0.062011 Oct 29 03:02:47.673466 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1697/3574] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:02:47 2022] GET /compute/v2.1/images/9832a0eb-f605-4545-916d-c18ec9e92137 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:02:47.686189 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5c48356e-2c20-457c-bb19-1657b8dbf3db tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:47.687472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5c48356e-2c20-457c-bb19-1657b8dbf3db tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 2f159c62-4461-466d-8a38-85d781f27563] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:47.710450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c48356e-2c20-457c-bb19-1657b8dbf3db tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:47.715673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c48356e-2c20-457c-bb19-1657b8dbf3db tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:47.716186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c48356e-2c20-457c-bb19-1657b8dbf3db tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:47.718895 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c48356e-2c20-457c-bb19-1657b8dbf3db tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:47.719398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c48356e-2c20-457c-bb19-1657b8dbf3db tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:47.719880 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c48356e-2c20-457c-bb19-1657b8dbf3db tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:48.175893 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f0b3f896-3507-4ded-b4b0-a0e913054f3e tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:48.221714 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f0b3f896-3507-4ded-b4b0-a0e913054f3e tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181" status: 200 len: 1317 microversion: 2.1 time: 0.914860 Oct 29 03:02:48.223421 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1878/3575] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:47 2022] GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181 => generated 1317 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:02:48.246335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b272e0f4-4f3c-4557-afbc-db4220f89053 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:48.251797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b272e0f4-4f3c-4557-afbc-db4220f89053 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] [instance: 7c79b743-fe77-42f1-88b9-594bc077b85b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:48.300092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b272e0f4-4f3c-4557-afbc-db4220f89053 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:48.302985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b272e0f4-4f3c-4557-afbc-db4220f89053 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:48.303742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b272e0f4-4f3c-4557-afbc-db4220f89053 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:48.305378 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b272e0f4-4f3c-4557-afbc-db4220f89053 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:48.307099 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b272e0f4-4f3c-4557-afbc-db4220f89053 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:48.308589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b272e0f4-4f3c-4557-afbc-db4220f89053 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:48.389104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5c48356e-2c20-457c-bb19-1657b8dbf3db tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:48.403257 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5c48356e-2c20-457c-bb19-1657b8dbf3db tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563" status: 200 len: 1499 microversion: 2.1 time: 0.733284 Oct 29 03:02:48.404583 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1698/3576] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:47 2022] GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563 => generated 1499 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:48.467708 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b272e0f4-4f3c-4557-afbc-db4220f89053 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4d9c179a03f443c91b5e14528a332cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25a563dd48004e3891a26468125ca652', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:48.476345 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:48.526851 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b272e0f4-4f3c-4557-afbc-db4220f89053 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] 10.222.0.46 "GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b" status: 200 len: 1468 microversion: 2.1 time: 0.298824 Oct 29 03:02:48.531692 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1879/3577] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:48 2022] GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b => generated 1468 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:48.678013 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-c9ada1db-5f13-4f0c-9a7e-3c439ceae005 req-0a56143f-0124-42f0-b640-aab060f3145e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c79b743-fe77-42f1-88b9-594bc077b85b", "name": "network-vif-deleted", "tag": "c356dc32-a5d0-49c6-a976-d7325331e07d"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:48.721319 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c9ada1db-5f13-4f0c-9a7e-3c439ceae005 req-0a56143f-0124-42f0-b640-aab060f3145e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:48.722501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c9ada1db-5f13-4f0c-9a7e-3c439ceae005 req-0a56143f-0124-42f0-b640-aab060f3145e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:48.723492 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c9ada1db-5f13-4f0c-9a7e-3c439ceae005 req-0a56143f-0124-42f0-b640-aab060f3145e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:48.749622 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-c9ada1db-5f13-4f0c-9a7e-3c439ceae005 req-0a56143f-0124-42f0-b640-aab060f3145e service nova] Creating event network-vif-deleted:c356dc32-a5d0-49c6-a976-d7325331e07d for instance 7c79b743-fe77-42f1-88b9-594bc077b85b on n-h1-862967-2 Oct 29 03:02:48.762072 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-c9ada1db-5f13-4f0c-9a7e-3c439ceae005 req-0a56143f-0124-42f0-b640-aab060f3145e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088887 Oct 29 03:02:48.769650 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1699/3578] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:02:49.258119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1cef38c0-3b4f-451a-b268-e6f6addf23b3 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:49.258876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1cef38c0-3b4f-451a-b268-e6f6addf23b3 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 521d52e2-7212-40c5-b698-b15c52053181] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:49.271656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cef38c0-3b4f-451a-b268-e6f6addf23b3 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:49.273105 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cef38c0-3b4f-451a-b268-e6f6addf23b3 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:49.274188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cef38c0-3b4f-451a-b268-e6f6addf23b3 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:49.275268 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cef38c0-3b4f-451a-b268-e6f6addf23b3 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:49.275911 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cef38c0-3b4f-451a-b268-e6f6addf23b3 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:49.276744 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cef38c0-3b4f-451a-b268-e6f6addf23b3 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:49.444215 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b650e47f-d824-4eb0-8a62-72970ea86b3c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:49.445456 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b650e47f-d824-4eb0-8a62-72970ea86b3c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 2f159c62-4461-466d-8a38-85d781f27563] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:49.462080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b650e47f-d824-4eb0-8a62-72970ea86b3c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:49.462583 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b650e47f-d824-4eb0-8a62-72970ea86b3c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:49.463016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b650e47f-d824-4eb0-8a62-72970ea86b3c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:49.466010 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b650e47f-d824-4eb0-8a62-72970ea86b3c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:49.468182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b650e47f-d824-4eb0-8a62-72970ea86b3c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:49.469001 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b650e47f-d824-4eb0-8a62-72970ea86b3c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:49.799268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b650e47f-d824-4eb0-8a62-72970ea86b3c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:49.813589 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b650e47f-d824-4eb0-8a62-72970ea86b3c tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563" status: 200 len: 1505 microversion: 2.1 time: 0.387386 Oct 29 03:02:49.814612 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1700/3579] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:49 2022] GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563 => generated 1505 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:49.821528 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ae38359e-729b-42b2-ac2c-a784fa430cc6 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:49.822345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ae38359e-729b-42b2-ac2c-a784fa430cc6 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] [instance: 7c79b743-fe77-42f1-88b9-594bc077b85b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:49.829411 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae38359e-729b-42b2-ac2c-a784fa430cc6 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:49.830174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae38359e-729b-42b2-ac2c-a784fa430cc6 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:49.830645 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae38359e-729b-42b2-ac2c-a784fa430cc6 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:49.831364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae38359e-729b-42b2-ac2c-a784fa430cc6 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:49.831814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae38359e-729b-42b2-ac2c-a784fa430cc6 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:49.832243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae38359e-729b-42b2-ac2c-a784fa430cc6 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:49.847397 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-ae38359e-729b-42b2-ac2c-a784fa430cc6 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] HTTP exception thrown: Instance 7c79b743-fe77-42f1-88b9-594bc077b85b could not be found. Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ae38359e-729b-42b2-ac2c-a784fa430cc6 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Request method failure captured: Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b HTTP/1.1 Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJe5qFW2wFMIfWUM80hJ-Mc7U0QiII8BA9Cv8jLRVSWSPJeH6wCspUXJFDKDybORJt_zTG0uTC4bu9nskdUSHmcPsukEYChydvahhf-ucArBY8xfvmxkN2XUS42MOGDvUlCZHUv0TZcMTgMJuBTD_1w6ol32lv1YnXFlf5_qZHPRmDY Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 25a563dd48004e3891a26468125ca652 Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerPasswordTestJSON-123944620 Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/25a563dd48004e3891a26468125ca652"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/25a563dd48004e3891a26468125ca652"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_25a563dd48004e3891a26468125ca652"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/25a563dd48004e3891a26468125ca652"}]}] Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerPasswordTestJSON-123944620 Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 25a563dd48004e3891a26468125ca652 Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerPasswordTestJSON-123944620 Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerPasswordTestJSON-123944620-project Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: b4d9c179a03f443c91b5e14528a332cc Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerPasswordTestJSON-123944620-project Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 7c79b743-fe77-42f1-88b9-594bc077b85b could not be found. Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '7c79b743-fe77-42f1-88b9-594bc077b85b'} Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c79b743-fe77-42f1-88b9-594bc077b85b could not be found. Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c79b743-fe77-42f1-88b9-594bc077b85b could not be found. Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:49.851214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:49.857122 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:49.857122 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:49.857122 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:49.857122 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:49.857122 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:49.857122 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c79b743-fe77-42f1-88b9-594bc077b85b could not be found. Oct 29 03:02:49.857122 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:49.857122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ae38359e-729b-42b2-ac2c-a784fa430cc6 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] Returning 404 to user: Instance 7c79b743-fe77-42f1-88b9-594bc077b85b could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:49.857122 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ae38359e-729b-42b2-ac2c-a784fa430cc6 tempest-ServerPasswordTestJSON-123944620 tempest-ServerPasswordTestJSON-123944620-project] 10.222.0.46 "GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b" status: 404 len: 111 microversion: 2.1 time: 0.035189 Oct 29 03:02:49.860765 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1701/3580] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:49 2022] GET /compute/v2.1/servers/7c79b743-fe77-42f1-88b9-594bc077b85b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:50.093565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1cef38c0-3b4f-451a-b268-e6f6addf23b3 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:50.110507 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1cef38c0-3b4f-451a-b268-e6f6addf23b3 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181" status: 200 len: 1317 microversion: 2.1 time: 0.859084 Oct 29 03:02:50.128203 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1880/3581] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:49 2022] GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181 => generated 1317 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:02:50.405702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-e99ff897-f8b9-4acc-aa3a-dffad1768be4 req-947e4c33-bd89-4376-af9e-a7b6b2840f5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "521d52e2-7212-40c5-b698-b15c52053181", "tag": "2ed7829e-62ec-49cd-9eee-973cc1c5a180"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:50.416313 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e99ff897-f8b9-4acc-aa3a-dffad1768be4 req-947e4c33-bd89-4376-af9e-a7b6b2840f5e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:50.417552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e99ff897-f8b9-4acc-aa3a-dffad1768be4 req-947e4c33-bd89-4376-af9e-a7b6b2840f5e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:50.418254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e99ff897-f8b9-4acc-aa3a-dffad1768be4 req-947e4c33-bd89-4376-af9e-a7b6b2840f5e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:50.431254 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-e99ff897-f8b9-4acc-aa3a-dffad1768be4 req-947e4c33-bd89-4376-af9e-a7b6b2840f5e service nova] Creating event network-changed:2ed7829e-62ec-49cd-9eee-973cc1c5a180 for instance 521d52e2-7212-40c5-b698-b15c52053181 on n-h2-862967-2 Oct 29 03:02:50.440816 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-e99ff897-f8b9-4acc-aa3a-dffad1768be4 req-947e4c33-bd89-4376-af9e-a7b6b2840f5e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037305 Oct 29 03:02:50.442040 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1702/3582] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:02:50.855475 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-91e74574-b7bd-44fc-8e9f-d4bda7f922de tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:50.858806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-91e74574-b7bd-44fc-8e9f-d4bda7f922de tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 2f159c62-4461-466d-8a38-85d781f27563] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:50.883751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91e74574-b7bd-44fc-8e9f-d4bda7f922de tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:50.884860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91e74574-b7bd-44fc-8e9f-d4bda7f922de tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:50.886413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91e74574-b7bd-44fc-8e9f-d4bda7f922de tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:50.887740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91e74574-b7bd-44fc-8e9f-d4bda7f922de tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:50.889655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91e74574-b7bd-44fc-8e9f-d4bda7f922de tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:50.891553 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91e74574-b7bd-44fc-8e9f-d4bda7f922de tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:51.143595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c7206c96-81dd-4585-a8db-fb6ec339959c tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:51.144317 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c7206c96-81dd-4585-a8db-fb6ec339959c tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 521d52e2-7212-40c5-b698-b15c52053181] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:51.181052 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7206c96-81dd-4585-a8db-fb6ec339959c tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:51.182096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7206c96-81dd-4585-a8db-fb6ec339959c tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:51.183091 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7206c96-81dd-4585-a8db-fb6ec339959c tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:51.184057 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7206c96-81dd-4585-a8db-fb6ec339959c tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:51.184741 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7206c96-81dd-4585-a8db-fb6ec339959c tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:51.185499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7206c96-81dd-4585-a8db-fb6ec339959c tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:51.603321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-91e74574-b7bd-44fc-8e9f-d4bda7f922de tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:51.615231 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-91e74574-b7bd-44fc-8e9f-d4bda7f922de tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563" status: 200 len: 1487 microversion: 2.1 time: 0.777295 Oct 29 03:02:51.616007 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1881/3583] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:50 2022] GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563 => generated 1487 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:51.646522 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b35751ea-79c2-41af-9dc7-23b90fa11cf3 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:51.647423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b35751ea-79c2-41af-9dc7-23b90fa11cf3 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 2f159c62-4461-466d-8a38-85d781f27563] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:51.652317 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c7206c96-81dd-4585-a8db-fb6ec339959c tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:51.661518 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c7206c96-81dd-4585-a8db-fb6ec339959c tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181" status: 200 len: 1317 microversion: 2.1 time: 0.527350 Oct 29 03:02:51.666441 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b35751ea-79c2-41af-9dc7-23b90fa11cf3 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:51.666904 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1703/3584] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:51 2022] GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181 => generated 1317 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:51.667601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b35751ea-79c2-41af-9dc7-23b90fa11cf3 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:51.668217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b35751ea-79c2-41af-9dc7-23b90fa11cf3 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:51.669272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b35751ea-79c2-41af-9dc7-23b90fa11cf3 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:51.669943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b35751ea-79c2-41af-9dc7-23b90fa11cf3 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:51.670579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b35751ea-79c2-41af-9dc7-23b90fa11cf3 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:51.708455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b35751ea-79c2-41af-9dc7-23b90fa11cf3 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 2f159c62-4461-466d-8a38-85d781f27563] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:02:51.893976 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b35751ea-79c2-41af-9dc7-23b90fa11cf3 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563" status: 204 len: 0 microversion: 2.1 time: 0.251108 Oct 29 03:02:51.896094 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1882/3585] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:02:51 2022] DELETE /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:02:51.936427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5d7ba25f-b175-4fe6-980f-f80389fc6666 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff05c1d2550>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:51.987627 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-5d7ba25f-b175-4fe6-980f-f80389fc6666 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] HTTP exception thrown: Image not found. Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5d7ba25f-b175-4fe6-980f-f80389fc6666 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Request method failure captured: Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/images/9832a0eb-f605-4545-916d-c18ec9e92137 HTTP/1.1 Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJaPFemTZ_UF20zmv9lzuySxzmYogL3HGJEwUZdUOnmSf32UFdECKHuxy10ErZgp7nOMsETdmVm6qO1Cseou8vOu24Afz6OEyVlhZTaET2mZYvbTpEFvWYnX_iHJiqkebumOgGpaD-j1ug4WAr0UmKaAvXO_0oQilfvx3gbnKVIbMs8 Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_185d32c10dd845768f4ff70a85680358"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/185d32c10dd845768f4ff70a85680358"}]}] Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ImagesTestJSON-90655156 Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: c866f273672846eb8d7f4f2a00269666 Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: exception: Image not found. Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '9832a0eb-f605-4545-916d-c18ec9e92137'} Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9832a0eb-f605-4545-916d-c18ec9e92137 to delete Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9832a0eb-f605-4545-916d-c18ec9e92137 could not be found. Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:51.991625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:51.998625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:51.998625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:51.998625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:51.998625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:51.998625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:02:51.998625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:02:51.998625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:51.998625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:51.998625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 03:02:51.998625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 03:02:51.998625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 03:02:51.998625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:51.998625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:51.998625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:51.998625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:51.998625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:51.998625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:51.998625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:51.998625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:51.998625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 03:02:51.998625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:51.998625 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5d7ba25f-b175-4fe6-980f-f80389fc6666 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Returning 404 to user: Image not found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:51.998625 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5d7ba25f-b175-4fe6-980f-f80389fc6666 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "DELETE /compute/v2.1/images/9832a0eb-f605-4545-916d-c18ec9e92137" status: 404 len: 62 microversion: 2.1 time: 0.069388 Oct 29 03:02:51.998625 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1704/3586] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:51 2022] DELETE /compute/v2.1/images/9832a0eb-f605-4545-916d-c18ec9e92137 => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:02:52.010737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-acdf9aeb-796e-4a91-aeae-8373ce2bf890 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:52.016386 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-acdf9aeb-796e-4a91-aeae-8373ce2bf890 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 2f159c62-4461-466d-8a38-85d781f27563] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:52.036187 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-acdf9aeb-796e-4a91-aeae-8373ce2bf890 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:52.036886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-acdf9aeb-796e-4a91-aeae-8373ce2bf890 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:52.037450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-acdf9aeb-796e-4a91-aeae-8373ce2bf890 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:52.039454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-acdf9aeb-796e-4a91-aeae-8373ce2bf890 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:52.039929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-acdf9aeb-796e-4a91-aeae-8373ce2bf890 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:52.043888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-acdf9aeb-796e-4a91-aeae-8373ce2bf890 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:52.103758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-acdf9aeb-796e-4a91-aeae-8373ce2bf890 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 2f159c62-4461-466d-8a38-85d781f27563] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:02:52.177659 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.compute.api [None req-acdf9aeb-796e-4a91-aeae-8373ce2bf890 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 2f159c62-4461-466d-8a38-85d781f27563] Instance is already in deleting state, ignoring this request Oct 29 03:02:52.180016 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-acdf9aeb-796e-4a91-aeae-8373ce2bf890 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563" status: 204 len: 0 microversion: 2.1 time: 0.174195 Oct 29 03:02:52.191906 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1883/3587] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:02:52 2022] DELETE /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:02:52.192782 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c5163752-6c67-40a0-9e5e-72d7ca55052d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:52.193689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c5163752-6c67-40a0-9e5e-72d7ca55052d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 2f159c62-4461-466d-8a38-85d781f27563] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:52.204256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5163752-6c67-40a0-9e5e-72d7ca55052d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:52.204963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5163752-6c67-40a0-9e5e-72d7ca55052d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:52.205499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5163752-6c67-40a0-9e5e-72d7ca55052d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:52.207062 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5163752-6c67-40a0-9e5e-72d7ca55052d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:52.210828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5163752-6c67-40a0-9e5e-72d7ca55052d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:52.212216 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5163752-6c67-40a0-9e5e-72d7ca55052d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:52.636934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c5163752-6c67-40a0-9e5e-72d7ca55052d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:52.644361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-63a336b9-9b63-4cdd-921f-31544f51d95c req-a17ef4c9-c988-4b01-b84d-8460650c7ceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f07c0ca-a21e-4a99-a087-96888df280ed", "tag": "525ff05b-0468-4b84-bfc6-fcccbe8eb2b1"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:52.654306 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c5163752-6c67-40a0-9e5e-72d7ca55052d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563" status: 200 len: 1493 microversion: 2.1 time: 0.466619 Oct 29 03:02:52.654919 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1705/3588] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:52 2022] GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563 => generated 1493 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:52.666545 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-63a336b9-9b63-4cdd-921f-31544f51d95c req-a17ef4c9-c988-4b01-b84d-8460650c7ceb service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:52.669577 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-63a336b9-9b63-4cdd-921f-31544f51d95c req-a17ef4c9-c988-4b01-b84d-8460650c7ceb service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:52.672715 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-63a336b9-9b63-4cdd-921f-31544f51d95c req-a17ef4c9-c988-4b01-b84d-8460650c7ceb service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:52.688444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d6bf47ca-f829-429c-bb00-3df52d12e6de tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:52.689246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d6bf47ca-f829-429c-bb00-3df52d12e6de tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 521d52e2-7212-40c5-b698-b15c52053181] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:52.698750 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6bf47ca-f829-429c-bb00-3df52d12e6de tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:52.700701 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6bf47ca-f829-429c-bb00-3df52d12e6de tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:52.701251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6bf47ca-f829-429c-bb00-3df52d12e6de tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:52.705413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6bf47ca-f829-429c-bb00-3df52d12e6de tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:52.706001 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6bf47ca-f829-429c-bb00-3df52d12e6de tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:52.706504 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6bf47ca-f829-429c-bb00-3df52d12e6de tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:52.709798 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-63a336b9-9b63-4cdd-921f-31544f51d95c req-a17ef4c9-c988-4b01-b84d-8460650c7ceb service nova] Creating event network-changed:525ff05b-0468-4b84-bfc6-fcccbe8eb2b1 for instance 9f07c0ca-a21e-4a99-a087-96888df280ed on n-h1-862967-2 Oct 29 03:02:52.729755 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-63a336b9-9b63-4cdd-921f-31544f51d95c req-a17ef4c9-c988-4b01-b84d-8460650c7ceb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090847 Oct 29 03:02:52.730686 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1884/3589] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:52.795476 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:52.862749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:53.163631 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d6bf47ca-f829-429c-bb00-3df52d12e6de tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:53.175471 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d6bf47ca-f829-429c-bb00-3df52d12e6de tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181" status: 200 len: 1317 microversion: 2.1 time: 0.491009 Oct 29 03:02:53.177348 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1706/3590] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:52 2022] GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181 => generated 1317 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:02:53.680881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:53.682961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:53.688277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ab6945e9-f8e1-4ccf-b075-aad464bbcf58 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:53.689291 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ab6945e9-f8e1-4ccf-b075-aad464bbcf58 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 2f159c62-4461-466d-8a38-85d781f27563] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:53.700432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ab6945e9-f8e1-4ccf-b075-aad464bbcf58 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:53.700959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ab6945e9-f8e1-4ccf-b075-aad464bbcf58 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:53.701596 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ab6945e9-f8e1-4ccf-b075-aad464bbcf58 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:53.702318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ab6945e9-f8e1-4ccf-b075-aad464bbcf58 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:53.702771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ab6945e9-f8e1-4ccf-b075-aad464bbcf58 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:53.703210 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ab6945e9-f8e1-4ccf-b075-aad464bbcf58 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:54.185943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ab6945e9-f8e1-4ccf-b075-aad464bbcf58 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:54.199490 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ab6945e9-f8e1-4ccf-b075-aad464bbcf58 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563" status: 200 len: 1493 microversion: 2.1 time: 0.520428 Oct 29 03:02:54.200124 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1885/3591] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:53 2022] GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563 => generated 1493 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:54.226156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-06cc5b88-2769-465c-8102-d75a74cf8631 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:54.226156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-06cc5b88-2769-465c-8102-d75a74cf8631 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 521d52e2-7212-40c5-b698-b15c52053181] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:54.229677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06cc5b88-2769-465c-8102-d75a74cf8631 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:54.230184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06cc5b88-2769-465c-8102-d75a74cf8631 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:54.230631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06cc5b88-2769-465c-8102-d75a74cf8631 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:54.231396 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06cc5b88-2769-465c-8102-d75a74cf8631 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:54.231874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06cc5b88-2769-465c-8102-d75a74cf8631 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:54.232309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06cc5b88-2769-465c-8102-d75a74cf8631 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:54.515285 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-599dd361-4aa6-4753-8da1-c0e4e71674a0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1467052085", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:54.619012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-599dd361-4aa6-4753-8da1-c0e4e71674a0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] validate_networks() for None {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:02:54.973513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-06cc5b88-2769-465c-8102-d75a74cf8631 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:54.988450 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-06cc5b88-2769-465c-8102-d75a74cf8631 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181" status: 200 len: 1317 microversion: 2.1 time: 0.786988 Oct 29 03:02:55.003899 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1886/3592] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:54 2022] GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181 => generated 1317 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:55.237049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1c1cb46d-b034-4e80-97f5-23dc97c6ac2a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:55.237869 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1c1cb46d-b034-4e80-97f5-23dc97c6ac2a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 2f159c62-4461-466d-8a38-85d781f27563] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:55.258370 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c1cb46d-b034-4e80-97f5-23dc97c6ac2a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:55.260006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c1cb46d-b034-4e80-97f5-23dc97c6ac2a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:55.260953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c1cb46d-b034-4e80-97f5-23dc97c6ac2a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:55.265200 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c1cb46d-b034-4e80-97f5-23dc97c6ac2a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:55.266194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c1cb46d-b034-4e80-97f5-23dc97c6ac2a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:55.269568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c1cb46d-b034-4e80-97f5-23dc97c6ac2a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:55.954409 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-599dd361-4aa6-4753-8da1-c0e4e71674a0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:02:55.955987 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-599dd361-4aa6-4753-8da1-c0e4e71674a0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:02:55.958735 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-599dd361-4aa6-4753-8da1-c0e4e71674a0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:02:55.959684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-599dd361-4aa6-4753-8da1-c0e4e71674a0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:02:55.962100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-599dd361-4aa6-4753-8da1-c0e4e71674a0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:02:55.994371 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-599dd361-4aa6-4753-8da1-c0e4e71674a0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:55.994879 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-599dd361-4aa6-4753-8da1-c0e4e71674a0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:55.996259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-599dd361-4aa6-4753-8da1-c0e4e71674a0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:55.997359 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-599dd361-4aa6-4753-8da1-c0e4e71674a0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:55.997826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-599dd361-4aa6-4753-8da1-c0e4e71674a0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:55.998293 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-599dd361-4aa6-4753-8da1-c0e4e71674a0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:56.040086 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-599dd361-4aa6-4753-8da1-c0e4e71674a0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Getting quotas for project 830acea7f5b948409e4b69d02aaeaf3b. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:02:56.048137 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-599dd361-4aa6-4753-8da1-c0e4e71674a0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Getting quotas for user 7d3a840b017844a7b45b98bea21e8e38 and project 830acea7f5b948409e4b69d02aaeaf3b. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:02:56.074467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-599dd361-4aa6-4753-8da1-c0e4e71674a0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:02:56.081743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-599dd361-4aa6-4753-8da1-c0e4e71674a0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:02:56.196313 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-599dd361-4aa6-4753-8da1-c0e4e71674a0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.305140 Oct 29 03:02:56.206190 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1707/3593] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:02:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:02:56.214774 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-2b2ef21d-737f-409c-bfb7-21af4f9d2536 req-7daab4d1-8b36-4805-bc28-35e29d696ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f159c62-4461-466d-8a38-85d781f27563", "name": "network-vif-deleted", "tag": "be6a2e7b-8209-4567-8de0-f674259a2db5"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:56.263557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2b2ef21d-737f-409c-bfb7-21af4f9d2536 req-7daab4d1-8b36-4805-bc28-35e29d696ab4 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:56.277171 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2b2ef21d-737f-409c-bfb7-21af4f9d2536 req-7daab4d1-8b36-4805-bc28-35e29d696ab4 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:56.277949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2b2ef21d-737f-409c-bfb7-21af4f9d2536 req-7daab4d1-8b36-4805-bc28-35e29d696ab4 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:56.317273 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-2b2ef21d-737f-409c-bfb7-21af4f9d2536 req-7daab4d1-8b36-4805-bc28-35e29d696ab4 service nova] Creating event network-vif-deleted:be6a2e7b-8209-4567-8de0-f674259a2db5 for instance 2f159c62-4461-466d-8a38-85d781f27563 on n-h2-862967-2 Oct 29 03:02:56.342410 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-2b2ef21d-737f-409c-bfb7-21af4f9d2536 req-7daab4d1-8b36-4805-bc28-35e29d696ab4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134569 Oct 29 03:02:56.348094 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1708/3594] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:56.391506 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4643d603-1013-45bd-a546-d72525a48fb1 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:56.394540 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4643d603-1013-45bd-a546-d72525a48fb1 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 521d52e2-7212-40c5-b698-b15c52053181] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:56.407096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4643d603-1013-45bd-a546-d72525a48fb1 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:56.412774 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4643d603-1013-45bd-a546-d72525a48fb1 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:56.413433 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4643d603-1013-45bd-a546-d72525a48fb1 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:56.417393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4643d603-1013-45bd-a546-d72525a48fb1 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:56.420869 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4643d603-1013-45bd-a546-d72525a48fb1 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:56.421606 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4643d603-1013-45bd-a546-d72525a48fb1 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:57.105077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4643d603-1013-45bd-a546-d72525a48fb1 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:57.134349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:57.134510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1c1cb46d-b034-4e80-97f5-23dc97c6ac2a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c866f273672846eb8d7f4f2a00269666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185d32c10dd845768f4ff70a85680358', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:57.142209 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4643d603-1013-45bd-a546-d72525a48fb1 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181" status: 200 len: 1317 microversion: 2.1 time: 0.792382 Oct 29 03:02:57.142978 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1709/3595] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:56 2022] GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181 => generated 1317 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:57.157442 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1c1cb46d-b034-4e80-97f5-23dc97c6ac2a tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563" status: 200 len: 1451 microversion: 2.1 time: 1.926467 Oct 29 03:02:57.158704 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1887/3596] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:55 2022] GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563 => generated 1451 bytes in 1929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:57.179248 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4bdf7bf8-98e1-4353-8caa-a1b68c3c1437 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:57.182729 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4bdf7bf8-98e1-4353-8caa-a1b68c3c1437 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:57.475543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4bdf7bf8-98e1-4353-8caa-a1b68c3c1437 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:57.526668 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4bdf7bf8-98e1-4353-8caa-a1b68c3c1437 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1213 microversion: 2.1 time: 0.357651 Oct 29 03:02:57.528253 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1710/3597] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:57 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1213 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:58.173837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e9c2a002-29bd-450f-9b10-bbc59f0113f4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:58.174815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e9c2a002-29bd-450f-9b10-bbc59f0113f4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 521d52e2-7212-40c5-b698-b15c52053181] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:58.200501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9c2a002-29bd-450f-9b10-bbc59f0113f4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:58.200989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d5dd2493-9afb-4e8e-8cb3-a1710ce09156 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:58.201490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9c2a002-29bd-450f-9b10-bbc59f0113f4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:58.201610 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d5dd2493-9afb-4e8e-8cb3-a1710ce09156 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 2f159c62-4461-466d-8a38-85d781f27563] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:58.202021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9c2a002-29bd-450f-9b10-bbc59f0113f4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:58.205820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9c2a002-29bd-450f-9b10-bbc59f0113f4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:58.208752 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9c2a002-29bd-450f-9b10-bbc59f0113f4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:58.210214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9c2a002-29bd-450f-9b10-bbc59f0113f4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:58.215866 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5dd2493-9afb-4e8e-8cb3-a1710ce09156 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:58.216368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5dd2493-9afb-4e8e-8cb3-a1710ce09156 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:58.220822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5dd2493-9afb-4e8e-8cb3-a1710ce09156 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:58.222809 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5dd2493-9afb-4e8e-8cb3-a1710ce09156 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:58.223508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5dd2493-9afb-4e8e-8cb3-a1710ce09156 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:58.224117 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5dd2493-9afb-4e8e-8cb3-a1710ce09156 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:58.242048 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-d5dd2493-9afb-4e8e-8cb3-a1710ce09156 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] HTTP exception thrown: Instance 2f159c62-4461-466d-8a38-85d781f27563 could not be found. Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d5dd2493-9afb-4e8e-8cb3-a1710ce09156 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Request method failure captured: Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563 HTTP/1.1 Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJaPFemTZ_UF20zmv9lzuySxzmYogL3HGJEwUZdUOnmSf32UFdECKHuxy10ErZgp7nOMsETdmVm6qO1Cseou8vOu24Afz6OEyVlhZTaET2mZYvbTpEFvWYnX_iHJiqkebumOgGpaD-j1ug4WAr0UmKaAvXO_0oQilfvx3gbnKVIbMs8 Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_185d32c10dd845768f4ff70a85680358"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/185d32c10dd845768f4ff70a85680358"}]}] Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ImagesTestJSON-90655156 Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: c866f273672846eb8d7f4f2a00269666 Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 2f159c62-4461-466d-8a38-85d781f27563 could not be found. Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '2f159c62-4461-466d-8a38-85d781f27563'} Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f159c62-4461-466d-8a38-85d781f27563 could not be found. Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f159c62-4461-466d-8a38-85d781f27563 could not be found. Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.244175 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.252997 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:58.252997 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:58.252997 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:58.252997 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:58.252997 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f159c62-4461-466d-8a38-85d781f27563 could not be found. Oct 29 03:02:58.252997 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.255627 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d5dd2493-9afb-4e8e-8cb3-a1710ce09156 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Returning 404 to user: Instance 2f159c62-4461-466d-8a38-85d781f27563 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:58.256970 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d5dd2493-9afb-4e8e-8cb3-a1710ce09156 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563" status: 404 len: 111 microversion: 2.1 time: 0.061563 Oct 29 03:02:58.258455 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1711/3598] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:58 2022] GET /compute/v2.1/servers/2f159c62-4461-466d-8a38-85d781f27563 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:58.289230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1eafaf8a-9c71-4355-8b0a-bbd3392b2636 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:58.290716 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1eafaf8a-9c71-4355-8b0a-bbd3392b2636 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 6c51228f-b19b-4028-8c23-38cb4c0e1ad9] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:58.300427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1eafaf8a-9c71-4355-8b0a-bbd3392b2636 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:58.301332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1eafaf8a-9c71-4355-8b0a-bbd3392b2636 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:58.301939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1eafaf8a-9c71-4355-8b0a-bbd3392b2636 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:58.302939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1eafaf8a-9c71-4355-8b0a-bbd3392b2636 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:58.303557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1eafaf8a-9c71-4355-8b0a-bbd3392b2636 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:58.304143 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1eafaf8a-9c71-4355-8b0a-bbd3392b2636 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:58.321000 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-1eafaf8a-9c71-4355-8b0a-bbd3392b2636 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] HTTP exception thrown: Instance 6c51228f-b19b-4028-8c23-38cb4c0e1ad9 could not be found. Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1eafaf8a-9c71-4355-8b0a-bbd3392b2636 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Request method failure captured: Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9 HTTP/1.1 Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJaPFemTZ_UF20zmv9lzuySxzmYogL3HGJEwUZdUOnmSf32UFdECKHuxy10ErZgp7nOMsETdmVm6qO1Cseou8vOu24Afz6OEyVlhZTaET2mZYvbTpEFvWYnX_iHJiqkebumOgGpaD-j1ug4WAr0UmKaAvXO_0oQilfvx3gbnKVIbMs8 Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_185d32c10dd845768f4ff70a85680358"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/185d32c10dd845768f4ff70a85680358"}]}] Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ImagesTestJSON-90655156 Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: c866f273672846eb8d7f4f2a00269666 Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 6c51228f-b19b-4028-8c23-38cb4c0e1ad9 could not be found. Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '6c51228f-b19b-4028-8c23-38cb4c0e1ad9'} Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c51228f-b19b-4028-8c23-38cb4c0e1ad9 could not be found. Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:58.324065 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c51228f-b19b-4028-8c23-38cb4c0e1ad9 could not be found. Oct 29 03:02:58.329332 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.329332 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:58.329332 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.329332 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.329332 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:58.329332 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:58.329332 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:58.329332 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:58.329332 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c51228f-b19b-4028-8c23-38cb4c0e1ad9 could not be found. Oct 29 03:02:58.329332 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.331571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1eafaf8a-9c71-4355-8b0a-bbd3392b2636 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Returning 404 to user: Instance 6c51228f-b19b-4028-8c23-38cb4c0e1ad9 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:58.332783 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1eafaf8a-9c71-4355-8b0a-bbd3392b2636 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9" status: 404 len: 111 microversion: 2.1 time: 0.067056 Oct 29 03:02:58.333843 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1712/3599] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:02:58 2022] DELETE /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:58.348815 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fc02738b-d48f-43da-a2d5-a107ffec2a64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:58.349845 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fc02738b-d48f-43da-a2d5-a107ffec2a64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 6c51228f-b19b-4028-8c23-38cb4c0e1ad9] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:58.361968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc02738b-d48f-43da-a2d5-a107ffec2a64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:58.362740 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc02738b-d48f-43da-a2d5-a107ffec2a64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:58.364000 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc02738b-d48f-43da-a2d5-a107ffec2a64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:58.365165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc02738b-d48f-43da-a2d5-a107ffec2a64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:58.366607 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc02738b-d48f-43da-a2d5-a107ffec2a64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:58.367335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc02738b-d48f-43da-a2d5-a107ffec2a64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:58.389375 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-fc02738b-d48f-43da-a2d5-a107ffec2a64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] HTTP exception thrown: Instance 6c51228f-b19b-4028-8c23-38cb4c0e1ad9 could not be found. Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fc02738b-d48f-43da-a2d5-a107ffec2a64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Request method failure captured: Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9 HTTP/1.1 Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJaPFemTZ_UF20zmv9lzuySxzmYogL3HGJEwUZdUOnmSf32UFdECKHuxy10ErZgp7nOMsETdmVm6qO1Cseou8vOu24Afz6OEyVlhZTaET2mZYvbTpEFvWYnX_iHJiqkebumOgGpaD-j1ug4WAr0UmKaAvXO_0oQilfvx3gbnKVIbMs8 Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_185d32c10dd845768f4ff70a85680358"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/185d32c10dd845768f4ff70a85680358"}]}] Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ImagesTestJSON-90655156 Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: c866f273672846eb8d7f4f2a00269666 Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 6c51228f-b19b-4028-8c23-38cb4c0e1ad9 could not be found. Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '6c51228f-b19b-4028-8c23-38cb4c0e1ad9'} Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c51228f-b19b-4028-8c23-38cb4c0e1ad9 could not be found. Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c51228f-b19b-4028-8c23-38cb4c0e1ad9 could not be found. Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.390923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.396393 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:58.396393 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:58.396393 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:58.396393 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:58.396393 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c51228f-b19b-4028-8c23-38cb4c0e1ad9 could not be found. Oct 29 03:02:58.396393 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.396393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fc02738b-d48f-43da-a2d5-a107ffec2a64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Returning 404 to user: Instance 6c51228f-b19b-4028-8c23-38cb4c0e1ad9 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:58.399021 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fc02738b-d48f-43da-a2d5-a107ffec2a64 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9" status: 404 len: 111 microversion: 2.1 time: 0.048617 Oct 29 03:02:58.399653 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1713/3600] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:58 2022] GET /compute/v2.1/servers/6c51228f-b19b-4028-8c23-38cb4c0e1ad9 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:58.411689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bed51821-1e02-4736-be7c-b9e3f64b6c9e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff05387a790>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:58.437976 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-bed51821-1e02-4736-be7c-b9e3f64b6c9e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] HTTP exception thrown: Image not found. Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bed51821-1e02-4736-be7c-b9e3f64b6c9e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Request method failure captured: Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a HTTP/1.1 Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJaPFemTZ_UF20zmv9lzuySxzmYogL3HGJEwUZdUOnmSf32UFdECKHuxy10ErZgp7nOMsETdmVm6qO1Cseou8vOu24Afz6OEyVlhZTaET2mZYvbTpEFvWYnX_iHJiqkebumOgGpaD-j1ug4WAr0UmKaAvXO_0oQilfvx3gbnKVIbMs8 Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_185d32c10dd845768f4ff70a85680358"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/185d32c10dd845768f4ff70a85680358"}]}] Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ImagesTestJSON-90655156 Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: c866f273672846eb8d7f4f2a00269666 Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: exception: Image not found. Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'bbd74575-2018-41ff-af14-0acb9cb1727a'} Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image bbd74575-2018-41ff-af14-0acb9cb1727a to delete Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bbd74575-2018-41ff-af14-0acb9cb1727a could not be found. Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.442872 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.448093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:58.448093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:58.448093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:58.448093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:58.448093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:02:58.448093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:02:58.448093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:58.448093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:58.448093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 03:02:58.448093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 03:02:58.448093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 03:02:58.448093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.448093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:58.448093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.448093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.448093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:58.448093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:58.448093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:58.448093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:58.448093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 03:02:58.448093 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.450949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bed51821-1e02-4736-be7c-b9e3f64b6c9e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Returning 404 to user: Image not found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:58.451808 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bed51821-1e02-4736-be7c-b9e3f64b6c9e tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "DELETE /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a" status: 404 len: 62 microversion: 2.1 time: 0.047575 Oct 29 03:02:58.455705 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1714/3601] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:58 2022] DELETE /compute/v2.1/images/bbd74575-2018-41ff-af14-0acb9cb1727a => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 29 03:02:58.461090 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ab9f6999-047f-4df5-9038-442a3744ea59 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:58.461818 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ab9f6999-047f-4df5-9038-442a3744ea59 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 28d33b72-926b-49d9-8807-1d2be68c487f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:58.469868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab9f6999-047f-4df5-9038-442a3744ea59 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:58.470964 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab9f6999-047f-4df5-9038-442a3744ea59 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:58.471555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab9f6999-047f-4df5-9038-442a3744ea59 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:58.472412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab9f6999-047f-4df5-9038-442a3744ea59 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:58.473088 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab9f6999-047f-4df5-9038-442a3744ea59 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:58.473510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab9f6999-047f-4df5-9038-442a3744ea59 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:58.490721 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-ab9f6999-047f-4df5-9038-442a3744ea59 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] HTTP exception thrown: Instance 28d33b72-926b-49d9-8807-1d2be68c487f could not be found. Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ab9f6999-047f-4df5-9038-442a3744ea59 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Request method failure captured: Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/28d33b72-926b-49d9-8807-1d2be68c487f HTTP/1.1 Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJaPFemTZ_UF20zmv9lzuySxzmYogL3HGJEwUZdUOnmSf32UFdECKHuxy10ErZgp7nOMsETdmVm6qO1Cseou8vOu24Afz6OEyVlhZTaET2mZYvbTpEFvWYnX_iHJiqkebumOgGpaD-j1ug4WAr0UmKaAvXO_0oQilfvx3gbnKVIbMs8 Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_185d32c10dd845768f4ff70a85680358"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/185d32c10dd845768f4ff70a85680358"}]}] Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ImagesTestJSON-90655156 Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: c866f273672846eb8d7f4f2a00269666 Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 28d33b72-926b-49d9-8807-1d2be68c487f could not be found. Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '28d33b72-926b-49d9-8807-1d2be68c487f'} Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28d33b72-926b-49d9-8807-1d2be68c487f could not be found. Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:58.492630 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28d33b72-926b-49d9-8807-1d2be68c487f could not be found. Oct 29 03:02:58.496924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.496924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:58.496924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.496924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.496924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:58.496924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:58.496924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:58.496924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:58.496924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28d33b72-926b-49d9-8807-1d2be68c487f could not be found. Oct 29 03:02:58.496924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.497597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ab9f6999-047f-4df5-9038-442a3744ea59 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Returning 404 to user: Instance 28d33b72-926b-49d9-8807-1d2be68c487f could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:58.503368 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ab9f6999-047f-4df5-9038-442a3744ea59 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "DELETE /compute/v2.1/servers/28d33b72-926b-49d9-8807-1d2be68c487f" status: 404 len: 111 microversion: 2.1 time: 0.041629 Oct 29 03:02:58.503368 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1715/3602] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:02:58 2022] DELETE /compute/v2.1/servers/28d33b72-926b-49d9-8807-1d2be68c487f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:58.509930 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bc5387a0-95f7-40a7-8c67-71a93d52d2b9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:58.510725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bc5387a0-95f7-40a7-8c67-71a93d52d2b9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 28d33b72-926b-49d9-8807-1d2be68c487f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:58.518002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc5387a0-95f7-40a7-8c67-71a93d52d2b9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:58.518492 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc5387a0-95f7-40a7-8c67-71a93d52d2b9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:58.519072 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc5387a0-95f7-40a7-8c67-71a93d52d2b9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:58.519798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc5387a0-95f7-40a7-8c67-71a93d52d2b9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:58.520443 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc5387a0-95f7-40a7-8c67-71a93d52d2b9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:58.521067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc5387a0-95f7-40a7-8c67-71a93d52d2b9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:58.539065 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-bc5387a0-95f7-40a7-8c67-71a93d52d2b9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] HTTP exception thrown: Instance 28d33b72-926b-49d9-8807-1d2be68c487f could not be found. Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bc5387a0-95f7-40a7-8c67-71a93d52d2b9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Request method failure captured: Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/28d33b72-926b-49d9-8807-1d2be68c487f HTTP/1.1 Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJaPFemTZ_UF20zmv9lzuySxzmYogL3HGJEwUZdUOnmSf32UFdECKHuxy10ErZgp7nOMsETdmVm6qO1Cseou8vOu24Afz6OEyVlhZTaET2mZYvbTpEFvWYnX_iHJiqkebumOgGpaD-j1ug4WAr0UmKaAvXO_0oQilfvx3gbnKVIbMs8 Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_185d32c10dd845768f4ff70a85680358"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/185d32c10dd845768f4ff70a85680358"}]}] Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ImagesTestJSON-90655156 Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: c866f273672846eb8d7f4f2a00269666 Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 28d33b72-926b-49d9-8807-1d2be68c487f could not be found. Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '28d33b72-926b-49d9-8807-1d2be68c487f'} Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28d33b72-926b-49d9-8807-1d2be68c487f could not be found. Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28d33b72-926b-49d9-8807-1d2be68c487f could not be found. Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.542704 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.553216 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:58.553216 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:58.553216 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:58.553216 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:58.553216 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28d33b72-926b-49d9-8807-1d2be68c487f could not be found. Oct 29 03:02:58.553216 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.553216 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bc5387a0-95f7-40a7-8c67-71a93d52d2b9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Returning 404 to user: Instance 28d33b72-926b-49d9-8807-1d2be68c487f could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:58.556724 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bc5387a0-95f7-40a7-8c67-71a93d52d2b9 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/28d33b72-926b-49d9-8807-1d2be68c487f" status: 404 len: 111 microversion: 2.1 time: 0.051439 Oct 29 03:02:58.557625 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1716/3603] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:58 2022] GET /compute/v2.1/servers/28d33b72-926b-49d9-8807-1d2be68c487f => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:58.571251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-23c28b83-e6f9-44df-84f5-4ff71fd905a8 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:58.572209 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-23c28b83-e6f9-44df-84f5-4ff71fd905a8 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:58.579300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23c28b83-e6f9-44df-84f5-4ff71fd905a8 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:58.579911 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23c28b83-e6f9-44df-84f5-4ff71fd905a8 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:58.580357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23c28b83-e6f9-44df-84f5-4ff71fd905a8 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:58.581109 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23c28b83-e6f9-44df-84f5-4ff71fd905a8 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:58.581568 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23c28b83-e6f9-44df-84f5-4ff71fd905a8 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:58.581993 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23c28b83-e6f9-44df-84f5-4ff71fd905a8 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:58.683356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-23c28b83-e6f9-44df-84f5-4ff71fd905a8 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:58.694991 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-23c28b83-e6f9-44df-84f5-4ff71fd905a8 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1283 microversion: 2.1 time: 0.130464 Oct 29 03:02:58.695901 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1717/3604] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:58 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1283 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:58.702450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c616b74a-5f36-4a5f-a19d-3bae98e3672d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff05c15b040>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:58.733196 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-c616b74a-5f36-4a5f-a19d-3bae98e3672d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] HTTP exception thrown: Image not found. Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c616b74a-5f36-4a5f-a19d-3bae98e3672d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Request method failure captured: Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/images/917b954f-5d5f-42d2-9717-2d38cda5517c HTTP/1.1 Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJaPFemTZ_UF20zmv9lzuySxzmYogL3HGJEwUZdUOnmSf32UFdECKHuxy10ErZgp7nOMsETdmVm6qO1Cseou8vOu24Afz6OEyVlhZTaET2mZYvbTpEFvWYnX_iHJiqkebumOgGpaD-j1ug4WAr0UmKaAvXO_0oQilfvx3gbnKVIbMs8 Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_185d32c10dd845768f4ff70a85680358"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/185d32c10dd845768f4ff70a85680358"}]}] Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ImagesTestJSON-90655156 Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: c866f273672846eb8d7f4f2a00269666 Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: exception: Image not found. Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '917b954f-5d5f-42d2-9717-2d38cda5517c'} Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 917b954f-5d5f-42d2-9717-2d38cda5517c to delete Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 917b954f-5d5f-42d2-9717-2d38cda5517c could not be found. Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.735329 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.741101 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:58.741101 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:58.741101 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:58.741101 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:58.741101 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:02:58.741101 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:02:58.741101 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:58.741101 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:58.741101 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 03:02:58.741101 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 03:02:58.741101 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 03:02:58.741101 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.741101 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:58.741101 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.741101 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.741101 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:58.741101 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:58.741101 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:58.741101 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:58.741101 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 03:02:58.741101 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.744597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c616b74a-5f36-4a5f-a19d-3bae98e3672d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Returning 404 to user: Image not found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:58.745834 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c616b74a-5f36-4a5f-a19d-3bae98e3672d tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "DELETE /compute/v2.1/images/917b954f-5d5f-42d2-9717-2d38cda5517c" status: 404 len: 62 microversion: 2.1 time: 0.048739 Oct 29 03:02:58.746759 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1718/3605] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:58 2022] DELETE /compute/v2.1/images/917b954f-5d5f-42d2-9717-2d38cda5517c => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:02:58.756218 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4c2f3859-5c20-4226-adf0-887764754899 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:58.757502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4c2f3859-5c20-4226-adf0-887764754899 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:58.765335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c2f3859-5c20-4226-adf0-887764754899 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:58.765887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c2f3859-5c20-4226-adf0-887764754899 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:58.766594 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c2f3859-5c20-4226-adf0-887764754899 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:58.767552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c2f3859-5c20-4226-adf0-887764754899 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:58.768003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c2f3859-5c20-4226-adf0-887764754899 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:58.768426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c2f3859-5c20-4226-adf0-887764754899 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:58.783063 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-4c2f3859-5c20-4226-adf0-887764754899 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] HTTP exception thrown: Instance 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 could not be found. Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4c2f3859-5c20-4226-adf0-887764754899 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Request method failure captured: Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 HTTP/1.1 Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJaPFemTZ_UF20zmv9lzuySxzmYogL3HGJEwUZdUOnmSf32UFdECKHuxy10ErZgp7nOMsETdmVm6qO1Cseou8vOu24Afz6OEyVlhZTaET2mZYvbTpEFvWYnX_iHJiqkebumOgGpaD-j1ug4WAr0UmKaAvXO_0oQilfvx3gbnKVIbMs8 Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_185d32c10dd845768f4ff70a85680358"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/185d32c10dd845768f4ff70a85680358"}]}] Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ImagesTestJSON-90655156 Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: c866f273672846eb8d7f4f2a00269666 Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 could not be found. Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '8dfcfa12-5d6b-4eda-973a-3be37b2f8a81'} Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 could not be found. Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:58.785040 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 could not be found. Oct 29 03:02:58.790245 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.790245 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:58.790245 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.790245 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.790245 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:58.790245 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:58.790245 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:58.790245 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:58.790245 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 could not be found. Oct 29 03:02:58.790245 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.792590 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4c2f3859-5c20-4226-adf0-887764754899 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Returning 404 to user: Instance 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:58.793508 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4c2f3859-5c20-4226-adf0-887764754899 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81" status: 404 len: 111 microversion: 2.1 time: 0.042612 Oct 29 03:02:58.794644 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1719/3606] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:02:58 2022] DELETE /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:02:58.808899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-22261475-4add-4341-9021-0d10b8e2e738 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:58.809441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-22261475-4add-4341-9021-0d10b8e2e738 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:58.817457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22261475-4add-4341-9021-0d10b8e2e738 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:58.818312 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22261475-4add-4341-9021-0d10b8e2e738 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:58.819009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22261475-4add-4341-9021-0d10b8e2e738 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:58.819951 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22261475-4add-4341-9021-0d10b8e2e738 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:58.821431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22261475-4add-4341-9021-0d10b8e2e738 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:58.822072 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22261475-4add-4341-9021-0d10b8e2e738 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:58.855964 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-22261475-4add-4341-9021-0d10b8e2e738 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] HTTP exception thrown: Instance 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 could not be found. Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-22261475-4add-4341-9021-0d10b8e2e738 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Request method failure captured: Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 HTTP/1.1 Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJaPFemTZ_UF20zmv9lzuySxzmYogL3HGJEwUZdUOnmSf32UFdECKHuxy10ErZgp7nOMsETdmVm6qO1Cseou8vOu24Afz6OEyVlhZTaET2mZYvbTpEFvWYnX_iHJiqkebumOgGpaD-j1ug4WAr0UmKaAvXO_0oQilfvx3gbnKVIbMs8 Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_185d32c10dd845768f4ff70a85680358"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/185d32c10dd845768f4ff70a85680358"}]}] Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ImagesTestJSON-90655156 Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: c866f273672846eb8d7f4f2a00269666 Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 could not be found. Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '8dfcfa12-5d6b-4eda-973a-3be37b2f8a81'} Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 could not be found. Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 could not be found. Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.858832 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.866059 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:58.866059 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:58.866059 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:58.866059 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:58.866059 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 could not be found. Oct 29 03:02:58.866059 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.866868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-22261475-4add-4341-9021-0d10b8e2e738 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Returning 404 to user: Instance 8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:58.867078 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-22261475-4add-4341-9021-0d10b8e2e738 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81" status: 404 len: 111 microversion: 2.1 time: 0.064689 Oct 29 03:02:58.867867 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1720/3607] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:58 2022] GET /compute/v2.1/servers/8dfcfa12-5d6b-4eda-973a-3be37b2f8a81 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:58.879233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4b1e83de-64d8-402a-8aec-c85fc74f0921 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053616550>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:58.912470 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-4b1e83de-64d8-402a-8aec-c85fc74f0921 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] HTTP exception thrown: Image not found. Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4b1e83de-64d8-402a-8aec-c85fc74f0921 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Request method failure captured: Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/images/fc37ec03-f8ad-40d5-9407-d7dca0bdc2b9 HTTP/1.1 Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJaPFemTZ_UF20zmv9lzuySxzmYogL3HGJEwUZdUOnmSf32UFdECKHuxy10ErZgp7nOMsETdmVm6qO1Cseou8vOu24Afz6OEyVlhZTaET2mZYvbTpEFvWYnX_iHJiqkebumOgGpaD-j1ug4WAr0UmKaAvXO_0oQilfvx3gbnKVIbMs8 Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_185d32c10dd845768f4ff70a85680358"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/185d32c10dd845768f4ff70a85680358"}]}] Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ImagesTestJSON-90655156 Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: c866f273672846eb8d7f4f2a00269666 Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: exception: Image not found. Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'fc37ec03-f8ad-40d5-9407-d7dca0bdc2b9'} Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fc37ec03-f8ad-40d5-9407-d7dca0bdc2b9 to delete Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fc37ec03-f8ad-40d5-9407-d7dca0bdc2b9 could not be found. Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.914859 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.920251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:58.920251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:58.920251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:58.920251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:58.920251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:02:58.920251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:02:58.920251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:58.920251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:58.920251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 03:02:58.920251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 03:02:58.920251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 03:02:58.920251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.920251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:58.920251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.920251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:58.920251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:58.920251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:58.920251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:58.920251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:58.920251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 03:02:58.920251 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:58.920251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4b1e83de-64d8-402a-8aec-c85fc74f0921 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Returning 404 to user: Image not found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:58.920251 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4b1e83de-64d8-402a-8aec-c85fc74f0921 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "DELETE /compute/v2.1/images/fc37ec03-f8ad-40d5-9407-d7dca0bdc2b9" status: 404 len: 62 microversion: 2.1 time: 0.043065 Oct 29 03:02:58.920251 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1721/3608] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:58 2022] DELETE /compute/v2.1/images/fc37ec03-f8ad-40d5-9407-d7dca0bdc2b9 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:02:58.932893 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bce83056-11c9-475e-96ac-74a3210de011 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:58.933701 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bce83056-11c9-475e-96ac-74a3210de011 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:58.940808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e9c2a002-29bd-450f-9b10-bbc59f0113f4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:58.948504 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bce83056-11c9-475e-96ac-74a3210de011 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:58.950474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bce83056-11c9-475e-96ac-74a3210de011 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:58.951351 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bce83056-11c9-475e-96ac-74a3210de011 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:58.956954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bce83056-11c9-475e-96ac-74a3210de011 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:58.962848 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e9c2a002-29bd-450f-9b10-bbc59f0113f4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181" status: 200 len: 1317 microversion: 2.1 time: 0.795485 Oct 29 03:02:58.977189 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bce83056-11c9-475e-96ac-74a3210de011 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:58.977576 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bce83056-11c9-475e-96ac-74a3210de011 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:58.977756 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1888/3609] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:58 2022] GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181 => generated 1317 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:02:59.005722 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-bce83056-11c9-475e-96ac-74a3210de011 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] HTTP exception thrown: Instance 7b7f1dd5-af84-416c-84a6-e7a0a67294e6 could not be found. Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bce83056-11c9-475e-96ac-74a3210de011 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Request method failure captured: Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 HTTP/1.1 Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJaPFemTZ_UF20zmv9lzuySxzmYogL3HGJEwUZdUOnmSf32UFdECKHuxy10ErZgp7nOMsETdmVm6qO1Cseou8vOu24Afz6OEyVlhZTaET2mZYvbTpEFvWYnX_iHJiqkebumOgGpaD-j1ug4WAr0UmKaAvXO_0oQilfvx3gbnKVIbMs8 Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_185d32c10dd845768f4ff70a85680358"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/185d32c10dd845768f4ff70a85680358"}]}] Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ImagesTestJSON-90655156 Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: c866f273672846eb8d7f4f2a00269666 Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 7b7f1dd5-af84-416c-84a6-e7a0a67294e6 could not be found. Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '7b7f1dd5-af84-416c-84a6-e7a0a67294e6'} Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b7f1dd5-af84-416c-84a6-e7a0a67294e6 could not be found. Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:59.008468 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b7f1dd5-af84-416c-84a6-e7a0a67294e6 could not be found. Oct 29 03:02:59.018640 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:59.018640 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:59.018640 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:59.018640 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:59.018640 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:59.018640 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:59.018640 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:59.018640 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:59.018640 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b7f1dd5-af84-416c-84a6-e7a0a67294e6 could not be found. Oct 29 03:02:59.018640 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:59.018640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bce83056-11c9-475e-96ac-74a3210de011 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Returning 404 to user: Instance 7b7f1dd5-af84-416c-84a6-e7a0a67294e6 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:59.018640 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bce83056-11c9-475e-96ac-74a3210de011 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6" status: 404 len: 111 microversion: 2.1 time: 0.087174 Oct 29 03:02:59.018640 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1722/3610] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:02:58 2022] DELETE /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:59.021584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eeb10a6f-40fc-4596-a3a0-aaee86535109 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:59.022598 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-eeb10a6f-40fc-4596-a3a0-aaee86535109 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: 7b7f1dd5-af84-416c-84a6-e7a0a67294e6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:59.038669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eeb10a6f-40fc-4596-a3a0-aaee86535109 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:59.038669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eeb10a6f-40fc-4596-a3a0-aaee86535109 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:59.038669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eeb10a6f-40fc-4596-a3a0-aaee86535109 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:59.038669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eeb10a6f-40fc-4596-a3a0-aaee86535109 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:59.038669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eeb10a6f-40fc-4596-a3a0-aaee86535109 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:59.038669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eeb10a6f-40fc-4596-a3a0-aaee86535109 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:59.059861 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-eeb10a6f-40fc-4596-a3a0-aaee86535109 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] HTTP exception thrown: Instance 7b7f1dd5-af84-416c-84a6-e7a0a67294e6 could not be found. Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eeb10a6f-40fc-4596-a3a0-aaee86535109 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Request method failure captured: Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 HTTP/1.1 Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJaPFemTZ_UF20zmv9lzuySxzmYogL3HGJEwUZdUOnmSf32UFdECKHuxy10ErZgp7nOMsETdmVm6qO1Cseou8vOu24Afz6OEyVlhZTaET2mZYvbTpEFvWYnX_iHJiqkebumOgGpaD-j1ug4WAr0UmKaAvXO_0oQilfvx3gbnKVIbMs8 Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_185d32c10dd845768f4ff70a85680358"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/185d32c10dd845768f4ff70a85680358"}]}] Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ImagesTestJSON-90655156 Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: c866f273672846eb8d7f4f2a00269666 Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 7b7f1dd5-af84-416c-84a6-e7a0a67294e6 could not be found. Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '7b7f1dd5-af84-416c-84a6-e7a0a67294e6'} Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b7f1dd5-af84-416c-84a6-e7a0a67294e6 could not be found. Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b7f1dd5-af84-416c-84a6-e7a0a67294e6 could not be found. Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:59.063631 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:59.079605 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:59.079605 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:59.079605 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:59.079605 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:59.079605 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b7f1dd5-af84-416c-84a6-e7a0a67294e6 could not be found. Oct 29 03:02:59.079605 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:59.079605 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eeb10a6f-40fc-4596-a3a0-aaee86535109 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Returning 404 to user: Instance 7b7f1dd5-af84-416c-84a6-e7a0a67294e6 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:59.079605 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eeb10a6f-40fc-4596-a3a0-aaee86535109 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6" status: 404 len: 111 microversion: 2.1 time: 0.059739 Oct 29 03:02:59.081362 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1889/3611] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:59 2022] GET /compute/v2.1/servers/7b7f1dd5-af84-416c-84a6-e7a0a67294e6 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:59.099236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c00f6a56-f709-4a32-a6cb-453ca856ae35 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '.version_select at 0x7ff053954160>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:59.130879 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-c00f6a56-f709-4a32-a6cb-453ca856ae35 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] HTTP exception thrown: Image not found. Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c00f6a56-f709-4a32-a6cb-453ca856ae35 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Request method failure captured: Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c HTTP/1.1 Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJaPFemTZ_UF20zmv9lzuySxzmYogL3HGJEwUZdUOnmSf32UFdECKHuxy10ErZgp7nOMsETdmVm6qO1Cseou8vOu24Afz6OEyVlhZTaET2mZYvbTpEFvWYnX_iHJiqkebumOgGpaD-j1ug4WAr0UmKaAvXO_0oQilfvx3gbnKVIbMs8 Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_185d32c10dd845768f4ff70a85680358"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/185d32c10dd845768f4ff70a85680358"}]}] Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ImagesTestJSON-90655156 Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: c866f273672846eb8d7f4f2a00269666 Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: exception: Image not found. Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '701150e2-794a-4f2f-a543-ac201d050d7c'} Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 701150e2-794a-4f2f-a543-ac201d050d7c to delete Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 701150e2-794a-4f2f-a543-ac201d050d7c could not be found. Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:59.133155 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:59.147649 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:59.147649 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:59.147649 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:59.147649 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:59.147649 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:02:59.147649 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:02:59.147649 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:59.147649 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:59.147649 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 29 03:02:59.147649 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 29 03:02:59.147649 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 29 03:02:59.147649 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:59.147649 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:59.147649 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:59.147649 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:59.147649 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:59.147649 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:59.147649 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:59.147649 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:59.147649 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 29 03:02:59.147649 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:59.147649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c00f6a56-f709-4a32-a6cb-453ca856ae35 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Returning 404 to user: Image not found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:59.147649 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c00f6a56-f709-4a32-a6cb-453ca856ae35 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "DELETE /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c" status: 404 len: 62 microversion: 2.1 time: 0.046311 Oct 29 03:02:59.154933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-31aa18c3-f38d-447c-ad3c-db655837d5f8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:59.154933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-31aa18c3-f38d-447c-ad3c-db655837d5f8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:59.155296 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1723/3612] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:59 2022] DELETE /compute/v2.1/images/701150e2-794a-4f2f-a543-ac201d050d7c => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:02:59.163789 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31aa18c3-f38d-447c-ad3c-db655837d5f8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:59.164632 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31aa18c3-f38d-447c-ad3c-db655837d5f8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:59.165367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31aa18c3-f38d-447c-ad3c-db655837d5f8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:59.166502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31aa18c3-f38d-447c-ad3c-db655837d5f8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:59.169656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31aa18c3-f38d-447c-ad3c-db655837d5f8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:59.170446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-31aa18c3-f38d-447c-ad3c-db655837d5f8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:59.207464 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-31aa18c3-f38d-447c-ad3c-db655837d5f8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] HTTP exception thrown: Instance f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 could not be found. Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-31aa18c3-f38d-447c-ad3c-db655837d5f8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Request method failure captured: Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 HTTP/1.1 Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJaPFemTZ_UF20zmv9lzuySxzmYogL3HGJEwUZdUOnmSf32UFdECKHuxy10ErZgp7nOMsETdmVm6qO1Cseou8vOu24Afz6OEyVlhZTaET2mZYvbTpEFvWYnX_iHJiqkebumOgGpaD-j1ug4WAr0UmKaAvXO_0oQilfvx3gbnKVIbMs8 Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_185d32c10dd845768f4ff70a85680358"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/185d32c10dd845768f4ff70a85680358"}]}] Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ImagesTestJSON-90655156 Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: c866f273672846eb8d7f4f2a00269666 Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 could not be found. Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8'} Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 could not be found. Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:59.211812 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 could not be found. Oct 29 03:02:59.227395 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:59.227395 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:59.227395 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:59.227395 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:59.227395 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:59.227395 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:59.227395 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:59.227395 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:59.227395 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 could not be found. Oct 29 03:02:59.227395 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:02:59.230832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-31aa18c3-f38d-447c-ad3c-db655837d5f8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Returning 404 to user: Instance f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:59.232942 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-31aa18c3-f38d-447c-ad3c-db655837d5f8 tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8" status: 404 len: 111 microversion: 2.1 time: 0.088368 Oct 29 03:02:59.234873 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1890/3613] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:02:59 2022] DELETE /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:59.255358 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8cb16f41-30ba-465b-854d-96a935a367ef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:59.257012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8cb16f41-30ba-465b-854d-96a935a367ef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] [instance: f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:59.279523 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8cb16f41-30ba-465b-854d-96a935a367ef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:59.280170 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8cb16f41-30ba-465b-854d-96a935a367ef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:59.281604 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8cb16f41-30ba-465b-854d-96a935a367ef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:59.283802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8cb16f41-30ba-465b-854d-96a935a367ef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:59.285360 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8cb16f41-30ba-465b-854d-96a935a367ef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:59.302002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8cb16f41-30ba-465b-854d-96a935a367ef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:59.328135 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-8cb16f41-30ba-465b-854d-96a935a367ef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] HTTP exception thrown: Instance f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 could not be found. Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8cb16f41-30ba-465b-854d-96a935a367ef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Request method failure captured: Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 HTTP/1.1 Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJaPFemTZ_UF20zmv9lzuySxzmYogL3HGJEwUZdUOnmSf32UFdECKHuxy10ErZgp7nOMsETdmVm6qO1Cseou8vOu24Afz6OEyVlhZTaET2mZYvbTpEFvWYnX_iHJiqkebumOgGpaD-j1ug4WAr0UmKaAvXO_0oQilfvx3gbnKVIbMs8 Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/185d32c10dd845768f4ff70a85680358"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_185d32c10dd845768f4ff70a85680358"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/185d32c10dd845768f4ff70a85680358"}]}] Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ImagesTestJSON-90655156 Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 185d32c10dd845768f4ff70a85680358 Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ImagesTestJSON-90655156 Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: c866f273672846eb8d7f4f2a00269666 Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ImagesTestJSON-90655156-project Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 could not be found. Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8'} Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 could not be found. Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 could not be found. Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:59.331582 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:02:59.338218 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:02:59.338218 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:02:59.338218 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:02:59.338218 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:02:59.338218 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 could not be found. Oct 29 03:02:59.338218 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:02:59.338218 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8cb16f41-30ba-465b-854d-96a935a367ef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] Returning 404 to user: Instance f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:02:59.338218 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8cb16f41-30ba-465b-854d-96a935a367ef tempest-ImagesTestJSON-90655156 tempest-ImagesTestJSON-90655156-project] 10.222.0.46 "GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8" status: 404 len: 111 microversion: 2.1 time: 0.096609 Oct 29 03:02:59.340411 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1724/3614] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:59 2022] GET /compute/v2.1/servers/f2b2ac21-3625-43ac-a91a-a11c7ce3c7f8 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:59.719610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-74e25737-b986-4150-b0a0-206213cdde95 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:02:59.720402 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-74e25737-b986-4150-b0a0-206213cdde95 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:02:59.734270 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-74e25737-b986-4150-b0a0-206213cdde95 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:59.737713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-74e25737-b986-4150-b0a0-206213cdde95 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:59.740126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-74e25737-b986-4150-b0a0-206213cdde95 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:59.742035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-74e25737-b986-4150-b0a0-206213cdde95 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:59.744021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-74e25737-b986-4150-b0a0-206213cdde95 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:59.745874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-74e25737-b986-4150-b0a0-206213cdde95 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:59.806680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-501e71d4-9033-44be-9520-d645f611fb05 req-96044fcb-dbe0-44b0-a2f4-f441902cb74d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f07c0ca-a21e-4a99-a087-96888df280ed", "name": "network-vif-plugged", "status": "completed", "tag": "525ff05b-0468-4b84-bfc6-fcccbe8eb2b1"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:02:59.863445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-501e71d4-9033-44be-9520-d645f611fb05 req-96044fcb-dbe0-44b0-a2f4-f441902cb74d service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:02:59.866779 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-501e71d4-9033-44be-9520-d645f611fb05 req-96044fcb-dbe0-44b0-a2f4-f441902cb74d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:02:59.870714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-501e71d4-9033-44be-9520-d645f611fb05 req-96044fcb-dbe0-44b0-a2f4-f441902cb74d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:02:59.912870 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-501e71d4-9033-44be-9520-d645f611fb05 req-96044fcb-dbe0-44b0-a2f4-f441902cb74d service nova] Creating event network-vif-plugged:525ff05b-0468-4b84-bfc6-fcccbe8eb2b1 for instance 9f07c0ca-a21e-4a99-a087-96888df280ed on n-h1-862967-2 Oct 29 03:02:59.935514 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-501e71d4-9033-44be-9520-d645f611fb05 req-96044fcb-dbe0-44b0-a2f4-f441902cb74d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138188 Oct 29 03:02:59.935741 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-74e25737-b986-4150-b0a0-206213cdde95 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:02:59.941040 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1725/3615] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:02:59.989973 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-74e25737-b986-4150-b0a0-206213cdde95 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1271 microversion: 2.1 time: 0.274316 Oct 29 03:02:59.995128 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1891/3616] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:02:59 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1271 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:00.012922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4b9c759a-2b40-4984-bc43-602781d03101 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:00.014346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4b9c759a-2b40-4984-bc43-602781d03101 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 521d52e2-7212-40c5-b698-b15c52053181] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:00.064785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b9c759a-2b40-4984-bc43-602781d03101 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:00.068795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b9c759a-2b40-4984-bc43-602781d03101 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:00.074049 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b9c759a-2b40-4984-bc43-602781d03101 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:00.078343 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b9c759a-2b40-4984-bc43-602781d03101 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:00.081694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b9c759a-2b40-4984-bc43-602781d03101 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:00.085846 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b9c759a-2b40-4984-bc43-602781d03101 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:00.651077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4b9c759a-2b40-4984-bc43-602781d03101 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:00.667525 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4b9c759a-2b40-4984-bc43-602781d03101 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181" status: 200 len: 1317 microversion: 2.1 time: 0.665183 Oct 29 03:03:00.687397 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1726/3617] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:00 2022] GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181 => generated 1317 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:01.032234 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-afbf6fa5-b3c8-48bf-9a02-f5524cd5791e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:01.033755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-afbf6fa5-b3c8-48bf-9a02-f5524cd5791e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:01.056372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-afbf6fa5-b3c8-48bf-9a02-f5524cd5791e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:01.057863 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-afbf6fa5-b3c8-48bf-9a02-f5524cd5791e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:01.058546 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-afbf6fa5-b3c8-48bf-9a02-f5524cd5791e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:01.059652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-afbf6fa5-b3c8-48bf-9a02-f5524cd5791e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:01.060352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-afbf6fa5-b3c8-48bf-9a02-f5524cd5791e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:01.061010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-afbf6fa5-b3c8-48bf-9a02-f5524cd5791e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:01.238784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-afbf6fa5-b3c8-48bf-9a02-f5524cd5791e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:01.274008 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-afbf6fa5-b3c8-48bf-9a02-f5524cd5791e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1271 microversion: 2.1 time: 0.247360 Oct 29 03:03:01.274827 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1892/3618] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:01 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1271 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:01.696494 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2800dbf7-550b-472d-b18e-ef292d08f629 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:01.697443 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2800dbf7-550b-472d-b18e-ef292d08f629 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 521d52e2-7212-40c5-b698-b15c52053181] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:01.712363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2800dbf7-550b-472d-b18e-ef292d08f629 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:01.721702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2800dbf7-550b-472d-b18e-ef292d08f629 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:01.722444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2800dbf7-550b-472d-b18e-ef292d08f629 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:01.725402 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2800dbf7-550b-472d-b18e-ef292d08f629 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:01.726197 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2800dbf7-550b-472d-b18e-ef292d08f629 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:01.726911 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2800dbf7-550b-472d-b18e-ef292d08f629 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:02.025360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-49c3c1a8-51aa-4bec-96f9-0e3060ebde2b req-e7aea9e4-2d15-403b-8615-25ecc9fe5858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "521d52e2-7212-40c5-b698-b15c52053181", "name": "network-vif-plugged", "status": "completed", "tag": "2ed7829e-62ec-49cd-9eee-973cc1c5a180"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:02.046879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-49c3c1a8-51aa-4bec-96f9-0e3060ebde2b req-e7aea9e4-2d15-403b-8615-25ecc9fe5858 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:02.050002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-49c3c1a8-51aa-4bec-96f9-0e3060ebde2b req-e7aea9e4-2d15-403b-8615-25ecc9fe5858 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:02.050838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-49c3c1a8-51aa-4bec-96f9-0e3060ebde2b req-e7aea9e4-2d15-403b-8615-25ecc9fe5858 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:02.098396 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-49c3c1a8-51aa-4bec-96f9-0e3060ebde2b req-e7aea9e4-2d15-403b-8615-25ecc9fe5858 service nova] Creating event network-vif-plugged:2ed7829e-62ec-49cd-9eee-973cc1c5a180 for instance 521d52e2-7212-40c5-b698-b15c52053181 on n-h2-862967-2 Oct 29 03:03:02.123679 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-49c3c1a8-51aa-4bec-96f9-0e3060ebde2b req-e7aea9e4-2d15-403b-8615-25ecc9fe5858 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101069 Oct 29 03:03:02.135969 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1893/3619] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:02.216322 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2800dbf7-550b-472d-b18e-ef292d08f629 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:02.228269 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2800dbf7-550b-472d-b18e-ef292d08f629 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181" status: 200 len: 1317 microversion: 2.1 time: 0.536533 Oct 29 03:03:02.228972 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1727/3620] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:01 2022] GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181 => generated 1317 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:03:02.319827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bd3f2407-4d0a-4554-86eb-e5608e86eef7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:02.321785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bd3f2407-4d0a-4554-86eb-e5608e86eef7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:02.343753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd3f2407-4d0a-4554-86eb-e5608e86eef7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:02.347717 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd3f2407-4d0a-4554-86eb-e5608e86eef7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:02.351721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd3f2407-4d0a-4554-86eb-e5608e86eef7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:02.353165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd3f2407-4d0a-4554-86eb-e5608e86eef7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:02.354192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd3f2407-4d0a-4554-86eb-e5608e86eef7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:02.355115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd3f2407-4d0a-4554-86eb-e5608e86eef7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:02.534713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bd3f2407-4d0a-4554-86eb-e5608e86eef7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:02.546979 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bd3f2407-4d0a-4554-86eb-e5608e86eef7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1271 microversion: 2.1 time: 0.250346 Oct 29 03:03:02.550837 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1894/3621] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:02 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1271 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:03.263271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f66a9464-7af1-4da8-92ce-758deb54b623 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:03.275345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f66a9464-7af1-4da8-92ce-758deb54b623 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 521d52e2-7212-40c5-b698-b15c52053181] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:03.279227 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f66a9464-7af1-4da8-92ce-758deb54b623 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:03.280007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f66a9464-7af1-4da8-92ce-758deb54b623 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:03.280724 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f66a9464-7af1-4da8-92ce-758deb54b623 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:03.282139 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f66a9464-7af1-4da8-92ce-758deb54b623 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:03.282802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f66a9464-7af1-4da8-92ce-758deb54b623 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:03.283460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f66a9464-7af1-4da8-92ce-758deb54b623 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:03.590681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-113f364f-3fc1-43eb-a25a-dc7732279dac tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:03.598353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-113f364f-3fc1-43eb-a25a-dc7732279dac tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:03.612698 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-113f364f-3fc1-43eb-a25a-dc7732279dac tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:03.617373 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-113f364f-3fc1-43eb-a25a-dc7732279dac tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:03.618205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-113f364f-3fc1-43eb-a25a-dc7732279dac tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:03.621413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-113f364f-3fc1-43eb-a25a-dc7732279dac tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:03.622877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-113f364f-3fc1-43eb-a25a-dc7732279dac tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:03.623619 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-113f364f-3fc1-43eb-a25a-dc7732279dac tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:03.774601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f66a9464-7af1-4da8-92ce-758deb54b623 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:03.800545 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f66a9464-7af1-4da8-92ce-758deb54b623 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181" status: 200 len: 1317 microversion: 2.1 time: 0.549298 Oct 29 03:03:03.801499 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1728/3622] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:03 2022] GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181 => generated 1317 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:04.539921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-113f364f-3fc1-43eb-a25a-dc7732279dac tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:04.584193 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-113f364f-3fc1-43eb-a25a-dc7732279dac tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1313 microversion: 2.1 time: 1.000745 Oct 29 03:03:04.587136 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1895/3623] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:03 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1313 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:04.840671 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f85dada1-ee41-4d74-a18e-ee720a043a4b tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:04.842079 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f85dada1-ee41-4d74-a18e-ee720a043a4b tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 521d52e2-7212-40c5-b698-b15c52053181] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:04.857159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:04.873614 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f85dada1-ee41-4d74-a18e-ee720a043a4b tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:04.875574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f85dada1-ee41-4d74-a18e-ee720a043a4b tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:04.876370 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f85dada1-ee41-4d74-a18e-ee720a043a4b tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:04.878024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f85dada1-ee41-4d74-a18e-ee720a043a4b tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:04.878837 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f85dada1-ee41-4d74-a18e-ee720a043a4b tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:04.879269 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f85dada1-ee41-4d74-a18e-ee720a043a4b tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:05.088266 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f85dada1-ee41-4d74-a18e-ee720a043a4b tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:05.099449 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f85dada1-ee41-4d74-a18e-ee720a043a4b tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181" status: 200 len: 1504 microversion: 2.1 time: 0.263677 Oct 29 03:03:05.101210 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1729/3624] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:04 2022] GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181 => generated 1504 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:05.140943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3d890614-964c-49b0-9382-3f5f4b85562d tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:05.143033 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3d890614-964c-49b0-9382-3f5f4b85562d tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 9f07c0ca-a21e-4a99-a087-96888df280ed] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:05.155479 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d890614-964c-49b0-9382-3f5f4b85562d tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:05.156640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d890614-964c-49b0-9382-3f5f4b85562d tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:05.157822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d890614-964c-49b0-9382-3f5f4b85562d tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:05.160977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d890614-964c-49b0-9382-3f5f4b85562d tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:05.162252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d890614-964c-49b0-9382-3f5f4b85562d tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:05.163438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d890614-964c-49b0-9382-3f5f4b85562d tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:05.207234 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:05.618397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5dd662fc-167c-4924-a807-eb49c7d91910 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:05.621521 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5dd662fc-167c-4924-a807-eb49c7d91910 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:05.634200 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5dd662fc-167c-4924-a807-eb49c7d91910 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:05.635431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5dd662fc-167c-4924-a807-eb49c7d91910 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:05.636212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5dd662fc-167c-4924-a807-eb49c7d91910 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:05.637792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5dd662fc-167c-4924-a807-eb49c7d91910 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:05.646522 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5dd662fc-167c-4924-a807-eb49c7d91910 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:05.650076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5dd662fc-167c-4924-a807-eb49c7d91910 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:05.911221 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5dd662fc-167c-4924-a807-eb49c7d91910 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:05.923181 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5dd662fc-167c-4924-a807-eb49c7d91910 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1313 microversion: 2.1 time: 0.312172 Oct 29 03:03:05.924779 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1730/3625] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:05 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:06.139662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3d890614-964c-49b0-9382-3f5f4b85562d tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:06.153461 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3d890614-964c-49b0-9382-3f5f4b85562d tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/9f07c0ca-a21e-4a99-a087-96888df280ed" status: 200 len: 1505 microversion: 2.1 time: 1.018868 Oct 29 03:03:06.164877 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1896/3626] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:05 2022] GET /compute/v2.1/servers/9f07c0ca-a21e-4a99-a087-96888df280ed => generated 1505 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:03:06.185714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-08e9132d-8f76-4092-91ff-b4b24103dfd4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:06.186212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-08e9132d-8f76-4092-91ff-b4b24103dfd4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 9f07c0ca-a21e-4a99-a087-96888df280ed] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:06.188227 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:06.204834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08e9132d-8f76-4092-91ff-b4b24103dfd4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:06.205324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08e9132d-8f76-4092-91ff-b4b24103dfd4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:06.206380 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08e9132d-8f76-4092-91ff-b4b24103dfd4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:06.207103 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08e9132d-8f76-4092-91ff-b4b24103dfd4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:06.207551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08e9132d-8f76-4092-91ff-b4b24103dfd4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:06.207967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08e9132d-8f76-4092-91ff-b4b24103dfd4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:06.239870 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-08e9132d-8f76-4092-91ff-b4b24103dfd4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 9f07c0ca-a21e-4a99-a087-96888df280ed] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:03:06.359713 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-08e9132d-8f76-4092-91ff-b4b24103dfd4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9f07c0ca-a21e-4a99-a087-96888df280ed" status: 204 len: 0 microversion: 2.1 time: 0.175367 Oct 29 03:03:06.361925 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1731/3627] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:03:06 2022] DELETE /compute/v2.1/servers/9f07c0ca-a21e-4a99-a087-96888df280ed => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:03:06.373629 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1ca44964-eab9-4b54-af9a-d4e06a25cf4c tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:06.374644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1ca44964-eab9-4b54-af9a-d4e06a25cf4c tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 521d52e2-7212-40c5-b698-b15c52053181] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:06.388968 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ca44964-eab9-4b54-af9a-d4e06a25cf4c tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:06.389874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ca44964-eab9-4b54-af9a-d4e06a25cf4c tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:06.390657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ca44964-eab9-4b54-af9a-d4e06a25cf4c tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:06.392002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ca44964-eab9-4b54-af9a-d4e06a25cf4c tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:06.392686 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ca44964-eab9-4b54-af9a-d4e06a25cf4c tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:06.393386 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ca44964-eab9-4b54-af9a-d4e06a25cf4c tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:06.441853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1ca44964-eab9-4b54-af9a-d4e06a25cf4c tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 521d52e2-7212-40c5-b698-b15c52053181] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:03:06.644102 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1ca44964-eab9-4b54-af9a-d4e06a25cf4c tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "DELETE /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181" status: 204 len: 0 microversion: 2.1 time: 0.275549 Oct 29 03:03:06.648417 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1897/3628] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:03:06 2022] DELETE /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:03:06.672675 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1df06a19-02e0-467f-ba88-d8658eb93406 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:06.674916 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1df06a19-02e0-467f-ba88-d8658eb93406 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 9f07c0ca-a21e-4a99-a087-96888df280ed] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:06.685876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1df06a19-02e0-467f-ba88-d8658eb93406 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:06.687179 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1df06a19-02e0-467f-ba88-d8658eb93406 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:06.688373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1df06a19-02e0-467f-ba88-d8658eb93406 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:06.690828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1df06a19-02e0-467f-ba88-d8658eb93406 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:06.691969 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1df06a19-02e0-467f-ba88-d8658eb93406 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:06.693066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1df06a19-02e0-467f-ba88-d8658eb93406 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:06.954440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7d159854-e95c-451f-8a0a-a6ef81fa601c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:06.960575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7d159854-e95c-451f-8a0a-a6ef81fa601c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:06.998315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7d159854-e95c-451f-8a0a-a6ef81fa601c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:07.003813 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7d159854-e95c-451f-8a0a-a6ef81fa601c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:07.005067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7d159854-e95c-451f-8a0a-a6ef81fa601c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:07.010537 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7d159854-e95c-451f-8a0a-a6ef81fa601c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:07.013067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7d159854-e95c-451f-8a0a-a6ef81fa601c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:07.015318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7d159854-e95c-451f-8a0a-a6ef81fa601c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:07.462374 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1df06a19-02e0-467f-ba88-d8658eb93406 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:07.491832 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1df06a19-02e0-467f-ba88-d8658eb93406 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/9f07c0ca-a21e-4a99-a087-96888df280ed" status: 200 len: 1511 microversion: 2.1 time: 0.829628 Oct 29 03:03:07.497427 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1732/3629] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:06 2022] GET /compute/v2.1/servers/9f07c0ca-a21e-4a99-a087-96888df280ed => generated 1511 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:07.509899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=8 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:07.519471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-4ac67b26-08af-40f9-a6e5-e987a633978d req-88967d2b-7379-4ecd-ad39-3bf7ca4cb5ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4953b8e-b647-4491-b532-3476e7837ab2", "tag": "898db35a-9988-48ff-8d18-1d616cacb84b"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:07.554002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4ac67b26-08af-40f9-a6e5-e987a633978d req-88967d2b-7379-4ecd-ad39-3bf7ca4cb5ab service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:07.555185 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4ac67b26-08af-40f9-a6e5-e987a633978d req-88967d2b-7379-4ecd-ad39-3bf7ca4cb5ab service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:07.555927 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4ac67b26-08af-40f9-a6e5-e987a633978d req-88967d2b-7379-4ecd-ad39-3bf7ca4cb5ab service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:07.589153 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-4ac67b26-08af-40f9-a6e5-e987a633978d req-88967d2b-7379-4ecd-ad39-3bf7ca4cb5ab service nova] Creating event network-changed:898db35a-9988-48ff-8d18-1d616cacb84b for instance c4953b8e-b647-4491-b532-3476e7837ab2 on n-h2-862967-2 Oct 29 03:03:07.598121 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-4ac67b26-08af-40f9-a6e5-e987a633978d req-88967d2b-7379-4ecd-ad39-3bf7ca4cb5ab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098683 Oct 29 03:03:07.601380 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1733/3630] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:08.067870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7d159854-e95c-451f-8a0a-a6ef81fa601c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:08.084945 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7d159854-e95c-451f-8a0a-a6ef81fa601c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1313 microversion: 2.1 time: 1.140626 Oct 29 03:03:08.100949 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1898/3631] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:06 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1313 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:08.539953 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e8bf710c-8c52-4276-8b21-8a02eb50f4ee tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:08.556350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e8bf710c-8c52-4276-8b21-8a02eb50f4ee tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 9f07c0ca-a21e-4a99-a087-96888df280ed] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:08.576247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e8bf710c-8c52-4276-8b21-8a02eb50f4ee tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:08.577667 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e8bf710c-8c52-4276-8b21-8a02eb50f4ee tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:08.578905 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e8bf710c-8c52-4276-8b21-8a02eb50f4ee tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:08.580494 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e8bf710c-8c52-4276-8b21-8a02eb50f4ee tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:08.581617 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e8bf710c-8c52-4276-8b21-8a02eb50f4ee tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:08.582702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e8bf710c-8c52-4276-8b21-8a02eb50f4ee tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:08.959466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e8bf710c-8c52-4276-8b21-8a02eb50f4ee tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:08.975599 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e8bf710c-8c52-4276-8b21-8a02eb50f4ee tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/9f07c0ca-a21e-4a99-a087-96888df280ed" status: 200 len: 1511 microversion: 2.1 time: 0.445306 Oct 29 03:03:08.977560 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1734/3632] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:08 2022] GET /compute/v2.1/servers/9f07c0ca-a21e-4a99-a087-96888df280ed => generated 1511 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:09.109313 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0b0b8453-e781-41e0-9bf5-a27f29bb0b06 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:09.111492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0b0b8453-e781-41e0-9bf5-a27f29bb0b06 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:09.141277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b0b8453-e781-41e0-9bf5-a27f29bb0b06 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:09.142084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b0b8453-e781-41e0-9bf5-a27f29bb0b06 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:09.146721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b0b8453-e781-41e0-9bf5-a27f29bb0b06 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:09.147809 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b0b8453-e781-41e0-9bf5-a27f29bb0b06 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:09.148942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b0b8453-e781-41e0-9bf5-a27f29bb0b06 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:09.153268 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b0b8453-e781-41e0-9bf5-a27f29bb0b06 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:10.000054 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c8bcadd7-6eac-48fb-9098-8b931c721b49 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:10.002754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c8bcadd7-6eac-48fb-9098-8b931c721b49 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 9f07c0ca-a21e-4a99-a087-96888df280ed] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:10.011422 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8bcadd7-6eac-48fb-9098-8b931c721b49 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:10.012515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8bcadd7-6eac-48fb-9098-8b931c721b49 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:10.013283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8bcadd7-6eac-48fb-9098-8b931c721b49 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:10.014276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8bcadd7-6eac-48fb-9098-8b931c721b49 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:10.015123 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8bcadd7-6eac-48fb-9098-8b931c721b49 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:10.015786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8bcadd7-6eac-48fb-9098-8b931c721b49 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:10.652118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c8bcadd7-6eac-48fb-9098-8b931c721b49 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:10.681716 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c8bcadd7-6eac-48fb-9098-8b931c721b49 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/9f07c0ca-a21e-4a99-a087-96888df280ed" status: 200 len: 1511 microversion: 2.1 time: 0.686586 Oct 29 03:03:10.687191 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1735/3633] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:09 2022] GET /compute/v2.1/servers/9f07c0ca-a21e-4a99-a087-96888df280ed => generated 1511 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:03:10.712728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-4128a030-6f03-4439-bb88-62a6ce61a12a req-ba3b7547-2729-4485-ad77-e186f391e7ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "521d52e2-7212-40c5-b698-b15c52053181", "name": "network-vif-deleted", "tag": "2ed7829e-62ec-49cd-9eee-973cc1c5a180"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:10.746875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4128a030-6f03-4439-bb88-62a6ce61a12a req-ba3b7547-2729-4485-ad77-e186f391e7ef service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:10.747649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4128a030-6f03-4439-bb88-62a6ce61a12a req-ba3b7547-2729-4485-ad77-e186f391e7ef service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:10.748653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4128a030-6f03-4439-bb88-62a6ce61a12a req-ba3b7547-2729-4485-ad77-e186f391e7ef service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:10.779050 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-4128a030-6f03-4439-bb88-62a6ce61a12a req-ba3b7547-2729-4485-ad77-e186f391e7ef service nova] Creating event network-vif-deleted:2ed7829e-62ec-49cd-9eee-973cc1c5a180 for instance 521d52e2-7212-40c5-b698-b15c52053181 on n-h2-862967-2 Oct 29 03:03:10.786983 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-4128a030-6f03-4439-bb88-62a6ce61a12a req-ba3b7547-2729-4485-ad77-e186f391e7ef service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095577 Oct 29 03:03:10.788271 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1736/3634] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:10.899749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0b0b8453-e781-41e0-9bf5-a27f29bb0b06 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:10.909457 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0b0b8453-e781-41e0-9bf5-a27f29bb0b06 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1313 microversion: 2.1 time: 1.803813 Oct 29 03:03:10.921218 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1899/3635] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:09 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1313 bytes in 1817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:11.619404 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-745816c1-23ec-472c-a93c-cf41b1ab0f20 req-5199ed12-eb64-40f4-9d27-42ce2e14964d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f07c0ca-a21e-4a99-a087-96888df280ed", "name": "network-vif-deleted", "tag": "525ff05b-0468-4b84-bfc6-fcccbe8eb2b1"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:11.685187 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-745816c1-23ec-472c-a93c-cf41b1ab0f20 req-5199ed12-eb64-40f4-9d27-42ce2e14964d service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:11.686932 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-745816c1-23ec-472c-a93c-cf41b1ab0f20 req-5199ed12-eb64-40f4-9d27-42ce2e14964d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:11.690268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-745816c1-23ec-472c-a93c-cf41b1ab0f20 req-5199ed12-eb64-40f4-9d27-42ce2e14964d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:11.717405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d4c2ef67-d101-4e0d-b6ff-d5e87354b987 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:11.724309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d4c2ef67-d101-4e0d-b6ff-d5e87354b987 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 9f07c0ca-a21e-4a99-a087-96888df280ed] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:11.785123 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4c2ef67-d101-4e0d-b6ff-d5e87354b987 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:11.786675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4c2ef67-d101-4e0d-b6ff-d5e87354b987 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:11.787625 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4c2ef67-d101-4e0d-b6ff-d5e87354b987 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:11.789061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4c2ef67-d101-4e0d-b6ff-d5e87354b987 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:11.790602 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-745816c1-23ec-472c-a93c-cf41b1ab0f20 req-5199ed12-eb64-40f4-9d27-42ce2e14964d service nova] Creating event network-vif-deleted:525ff05b-0468-4b84-bfc6-fcccbe8eb2b1 for instance 9f07c0ca-a21e-4a99-a087-96888df280ed on n-h1-862967-2 Oct 29 03:03:11.791705 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4c2ef67-d101-4e0d-b6ff-d5e87354b987 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:11.795915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4c2ef67-d101-4e0d-b6ff-d5e87354b987 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:11.812281 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-745816c1-23ec-472c-a93c-cf41b1ab0f20 req-5199ed12-eb64-40f4-9d27-42ce2e14964d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210878 Oct 29 03:03:11.819450 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1737/3636] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:11.881390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4c2ef67-d101-4e0d-b6ff-d5e87354b987 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:11.883231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4c2ef67-d101-4e0d-b6ff-d5e87354b987 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:11.884458 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4c2ef67-d101-4e0d-b6ff-d5e87354b987 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:11.885745 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-d4c2ef67-d101-4e0d-b6ff-d5e87354b987 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lazy-loading 'fault' on Instance uuid 9f07c0ca-a21e-4a99-a087-96888df280ed {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:03:11.962899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fc065949-dcb6-4152-ba29-4608418d6d73 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:11.963966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fc065949-dcb6-4152-ba29-4608418d6d73 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:11.990324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc065949-dcb6-4152-ba29-4608418d6d73 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:11.991083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc065949-dcb6-4152-ba29-4608418d6d73 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:11.991750 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc065949-dcb6-4152-ba29-4608418d6d73 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:11.992552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc065949-dcb6-4152-ba29-4608418d6d73 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:11.994108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc065949-dcb6-4152-ba29-4608418d6d73 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:11.994797 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc065949-dcb6-4152-ba29-4608418d6d73 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:12.056186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:12.062226 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d4c2ef67-d101-4e0d-b6ff-d5e87354b987 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed77e18046c455ba3a0e0c4434d44bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbd3d4fe8c54fc7852468af9eeb92ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:12.135530 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d4c2ef67-d101-4e0d-b6ff-d5e87354b987 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/9f07c0ca-a21e-4a99-a087-96888df280ed" status: 200 len: 1307 microversion: 2.1 time: 0.425697 Oct 29 03:03:12.169572 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1900/3637] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:11 2022] GET /compute/v2.1/servers/9f07c0ca-a21e-4a99-a087-96888df280ed => generated 1307 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:12.684742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6d4a8374-41f9-4651-b9be-cfdc29273b81 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-32882299", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "8d631639-964a-4e2c-b6db-3f163a5610f0"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:12.779572 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fc065949-dcb6-4152-ba29-4608418d6d73 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:12.816799 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fc065949-dcb6-4152-ba29-4608418d6d73 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1313 microversion: 2.1 time: 0.859800 Oct 29 03:03:12.831589 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1738/3638] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:11 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1313 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:12.850765 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-6d4a8374-41f9-4651-b9be-cfdc29273b81 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] validate_networks() for [('8d631639-964a-4e2c-b6db-3f163a5610f0', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:03:13.143802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-93cb16d0-b80c-4bfd-bb08-8cfe66e8148c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:13.145125 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-93cb16d0-b80c-4bfd-bb08-8cfe66e8148c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:13.156310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93cb16d0-b80c-4bfd-bb08-8cfe66e8148c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:13.157719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93cb16d0-b80c-4bfd-bb08-8cfe66e8148c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:13.159112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93cb16d0-b80c-4bfd-bb08-8cfe66e8148c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:13.162761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93cb16d0-b80c-4bfd-bb08-8cfe66e8148c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:13.163856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93cb16d0-b80c-4bfd-bb08-8cfe66e8148c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:13.164500 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93cb16d0-b80c-4bfd-bb08-8cfe66e8148c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:13.207700 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-93cb16d0-b80c-4bfd-bb08-8cfe66e8148c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7/ips" status: 200 len: 151 microversion: 2.20 time: 0.070736 Oct 29 03:03:13.216477 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1739/3639] 10.222.0.46 () {60 vars in 1289 bytes} [Sat Oct 29 03:03:13 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7/ips => generated 151 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:03:13.230591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8ac03c4a-052b-4b84-a8bd-ebaa07fe03f4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:13.231367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8ac03c4a-052b-4b84-a8bd-ebaa07fe03f4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 9f07c0ca-a21e-4a99-a087-96888df280ed] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:13.284451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ac03c4a-052b-4b84-a8bd-ebaa07fe03f4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:13.285272 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ac03c4a-052b-4b84-a8bd-ebaa07fe03f4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:13.300751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ac03c4a-052b-4b84-a8bd-ebaa07fe03f4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:13.301669 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ac03c4a-052b-4b84-a8bd-ebaa07fe03f4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:13.302170 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ac03c4a-052b-4b84-a8bd-ebaa07fe03f4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:13.303318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ac03c4a-052b-4b84-a8bd-ebaa07fe03f4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:13.373213 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-8ac03c4a-052b-4b84-a8bd-ebaa07fe03f4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] HTTP exception thrown: Instance 9f07c0ca-a21e-4a99-a087-96888df280ed could not be found. Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8ac03c4a-052b-4b84-a8bd-ebaa07fe03f4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Request method failure captured: Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/9f07c0ca-a21e-4a99-a087-96888df280ed HTTP/1.1 Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJe1DMePQcF9SX1dGADIL2bW8E_JQDdYr0zIor1vHYTdc4-OnQE-P3I41AjBxow0x3zml8ZJzxizJu0a1gRsIp5eqE8JOUXARxiECep3YLyc4vc4LyEOOsqDmyehqEB5m8bN8E64PLNVZ1m5aft0DQGxLO4iJfX1T2e8rV2Qwh9FWbQ Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 3fbd3d4fe8c54fc7852468af9eeb92ff Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-MultipleCreateTestJSON-1759367428 Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3fbd3d4fe8c54fc7852468af9eeb92ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3fbd3d4fe8c54fc7852468af9eeb92ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3fbd3d4fe8c54fc7852468af9eeb92ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3fbd3d4fe8c54fc7852468af9eeb92ff"}]}] Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-MultipleCreateTestJSON-1759367428 Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 3fbd3d4fe8c54fc7852468af9eeb92ff Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1759367428 Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-MultipleCreateTestJSON-1759367428-project Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 8ed77e18046c455ba3a0e0c4434d44bf Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-MultipleCreateTestJSON-1759367428-project Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 9f07c0ca-a21e-4a99-a087-96888df280ed could not be found. Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '9f07c0ca-a21e-4a99-a087-96888df280ed'} Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f07c0ca-a21e-4a99-a087-96888df280ed could not be found. Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f07c0ca-a21e-4a99-a087-96888df280ed could not be found. Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:03:13.386608 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:03:13.392477 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:03:13.392477 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:03:13.392477 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:03:13.392477 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:03:13.392477 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:03:13.392477 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f07c0ca-a21e-4a99-a087-96888df280ed could not be found. Oct 29 03:03:13.392477 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:03:13.393955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8ac03c4a-052b-4b84-a8bd-ebaa07fe03f4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Returning 404 to user: Instance 9f07c0ca-a21e-4a99-a087-96888df280ed could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:03:13.395105 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8ac03c4a-052b-4b84-a8bd-ebaa07fe03f4 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/9f07c0ca-a21e-4a99-a087-96888df280ed" status: 404 len: 111 microversion: 2.1 time: 0.182153 Oct 29 03:03:13.395866 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1740/3640] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:13 2022] GET /compute/v2.1/servers/9f07c0ca-a21e-4a99-a087-96888df280ed => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:03:13.405017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fc343b58-3df9-4465-baf8-94e7eca25947 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:13.406054 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fc343b58-3df9-4465-baf8-94e7eca25947 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] [instance: 521d52e2-7212-40c5-b698-b15c52053181] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:13.422628 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc343b58-3df9-4465-baf8-94e7eca25947 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:13.423525 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc343b58-3df9-4465-baf8-94e7eca25947 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:13.424163 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc343b58-3df9-4465-baf8-94e7eca25947 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:13.425275 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc343b58-3df9-4465-baf8-94e7eca25947 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:13.429503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc343b58-3df9-4465-baf8-94e7eca25947 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:13.430314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc343b58-3df9-4465-baf8-94e7eca25947 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:13.465647 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-fc343b58-3df9-4465-baf8-94e7eca25947 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] HTTP exception thrown: Instance 521d52e2-7212-40c5-b698-b15c52053181 could not be found. Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fc343b58-3df9-4465-baf8-94e7eca25947 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Request method failure captured: Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181 HTTP/1.1 Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJe1DMePQcF9SX1dGADIL2bW8E_JQDdYr0zIor1vHYTdc4-OnQE-P3I41AjBxow0x3zml8ZJzxizJu0a1gRsIp5eqE8JOUXARxiECep3YLyc4vc4LyEOOsqDmyehqEB5m8bN8E64PLNVZ1m5aft0DQGxLO4iJfX1T2e8rV2Qwh9FWbQ Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 3fbd3d4fe8c54fc7852468af9eeb92ff Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-MultipleCreateTestJSON-1759367428 Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3fbd3d4fe8c54fc7852468af9eeb92ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3fbd3d4fe8c54fc7852468af9eeb92ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3fbd3d4fe8c54fc7852468af9eeb92ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3fbd3d4fe8c54fc7852468af9eeb92ff"}]}] Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-MultipleCreateTestJSON-1759367428 Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 3fbd3d4fe8c54fc7852468af9eeb92ff Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1759367428 Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-MultipleCreateTestJSON-1759367428-project Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 8ed77e18046c455ba3a0e0c4434d44bf Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-MultipleCreateTestJSON-1759367428-project Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 521d52e2-7212-40c5-b698-b15c52053181 could not be found. Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '521d52e2-7212-40c5-b698-b15c52053181'} Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 521d52e2-7212-40c5-b698-b15c52053181 could not be found. Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 521d52e2-7212-40c5-b698-b15c52053181 could not be found. Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:03:13.467387 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:03:13.475679 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:03:13.475679 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:03:13.475679 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:03:13.475679 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:03:13.475679 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:03:13.475679 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 521d52e2-7212-40c5-b698-b15c52053181 could not be found. Oct 29 03:03:13.475679 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:03:13.475679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fc343b58-3df9-4465-baf8-94e7eca25947 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] Returning 404 to user: Instance 521d52e2-7212-40c5-b698-b15c52053181 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:03:13.475679 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fc343b58-3df9-4465-baf8-94e7eca25947 tempest-MultipleCreateTestJSON-1759367428 tempest-MultipleCreateTestJSON-1759367428-project] 10.222.0.46 "GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181" status: 404 len: 111 microversion: 2.1 time: 0.068538 Oct 29 03:03:13.475679 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1741/3641] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:13 2022] GET /compute/v2.1/servers/521d52e2-7212-40c5-b698-b15c52053181 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:03:13.858025 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-588dc32c-875f-4931-96ad-c6e2e247dd3a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:13.859464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-588dc32c-875f-4931-96ad-c6e2e247dd3a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:13.885121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-588dc32c-875f-4931-96ad-c6e2e247dd3a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:13.885121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-588dc32c-875f-4931-96ad-c6e2e247dd3a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:13.885121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-588dc32c-875f-4931-96ad-c6e2e247dd3a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:13.885121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-588dc32c-875f-4931-96ad-c6e2e247dd3a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:13.885121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-588dc32c-875f-4931-96ad-c6e2e247dd3a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:13.885121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-588dc32c-875f-4931-96ad-c6e2e247dd3a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:14.191999 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-6d4a8374-41f9-4651-b9be-cfdc29273b81 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:03:14.192965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-6d4a8374-41f9-4651-b9be-cfdc29273b81 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:03:14.193488 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-6d4a8374-41f9-4651-b9be-cfdc29273b81 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:03:14.194052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-6d4a8374-41f9-4651-b9be-cfdc29273b81 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:03:14.194483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-6d4a8374-41f9-4651-b9be-cfdc29273b81 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:03:14.223046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d4a8374-41f9-4651-b9be-cfdc29273b81 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:14.224165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d4a8374-41f9-4651-b9be-cfdc29273b81 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:14.224671 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d4a8374-41f9-4651-b9be-cfdc29273b81 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:14.225519 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d4a8374-41f9-4651-b9be-cfdc29273b81 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:14.230046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d4a8374-41f9-4651-b9be-cfdc29273b81 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:14.233022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d4a8374-41f9-4651-b9be-cfdc29273b81 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:14.302549 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-6d4a8374-41f9-4651-b9be-cfdc29273b81 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Getting quotas for project dea1a01e8b644da38cabae74b087f805. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:03:14.336690 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-6d4a8374-41f9-4651-b9be-cfdc29273b81 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Getting quotas for user fb3ea9c53c964d329774361a92615e78 and project dea1a01e8b644da38cabae74b087f805. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:03:14.370558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6d4a8374-41f9-4651-b9be-cfdc29273b81 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:03:14.377257 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6d4a8374-41f9-4651-b9be-cfdc29273b81 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] [instance: 809e7629-f880-4155-a83b-4b2ca39bb335] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:03:14.514146 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6d4a8374-41f9-4651-b9be-cfdc29273b81 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.153801 Oct 29 03:03:14.517910 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1901/3642] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:03:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 03:03:14.554505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-27a6fbce-9bf8-4827-b430-5c886e6e6b2b tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:14.555735 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-27a6fbce-9bf8-4827-b430-5c886e6e6b2b tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] [instance: 809e7629-f880-4155-a83b-4b2ca39bb335] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:14.700685 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-27a6fbce-9bf8-4827-b430-5c886e6e6b2b tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3ea9c53c964d329774361a92615e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea1a01e8b644da38cabae74b087f805', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:14.712119 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-27a6fbce-9bf8-4827-b430-5c886e6e6b2b tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] 10.222.0.46 "GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335" status: 200 len: 1215 microversion: 2.1 time: 0.179950 Oct 29 03:03:14.716589 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1902/3643] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:14 2022] GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335 => generated 1215 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:03:14.806081 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-588dc32c-875f-4931-96ad-c6e2e247dd3a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:14.819252 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-588dc32c-875f-4931-96ad-c6e2e247dd3a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1313 microversion: 2.1 time: 0.965258 Oct 29 03:03:14.825716 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1742/3644] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:13 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1313 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:03:15.757846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-627fa6ec-cab0-43f5-ba78-63ba6e2843d7 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:15.758835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-627fa6ec-cab0-43f5-ba78-63ba6e2843d7 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] [instance: 809e7629-f880-4155-a83b-4b2ca39bb335] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:15.799690 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-627fa6ec-cab0-43f5-ba78-63ba6e2843d7 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:15.801861 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-627fa6ec-cab0-43f5-ba78-63ba6e2843d7 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:15.804172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-627fa6ec-cab0-43f5-ba78-63ba6e2843d7 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:15.805556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-627fa6ec-cab0-43f5-ba78-63ba6e2843d7 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:15.808489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-627fa6ec-cab0-43f5-ba78-63ba6e2843d7 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:15.810734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-627fa6ec-cab0-43f5-ba78-63ba6e2843d7 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:15.860341 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f417e534-d038-4e80-83e0-6f2a73df5450 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:15.862388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f417e534-d038-4e80-83e0-6f2a73df5450 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:15.894539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f417e534-d038-4e80-83e0-6f2a73df5450 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:15.898381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f417e534-d038-4e80-83e0-6f2a73df5450 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:15.905326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f417e534-d038-4e80-83e0-6f2a73df5450 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:15.910720 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f417e534-d038-4e80-83e0-6f2a73df5450 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:15.911444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f417e534-d038-4e80-83e0-6f2a73df5450 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:15.912981 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f417e534-d038-4e80-83e0-6f2a73df5450 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:16.389869 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-627fa6ec-cab0-43f5-ba78-63ba6e2843d7 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3ea9c53c964d329774361a92615e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea1a01e8b644da38cabae74b087f805', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:16.424131 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-627fa6ec-cab0-43f5-ba78-63ba6e2843d7 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] 10.222.0.46 "GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335" status: 200 len: 1219 microversion: 2.1 time: 0.664548 Oct 29 03:03:16.436608 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1903/3645] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:15 2022] GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335 => generated 1219 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:16.465639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f417e534-d038-4e80-83e0-6f2a73df5450 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:16.481729 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f417e534-d038-4e80-83e0-6f2a73df5450 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1313 microversion: 2.1 time: 0.629213 Oct 29 03:03:16.482607 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1743/3646] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:15 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1313 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:03:17.455909 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-83797fab-ddd0-4903-a5ab-a62229116dcf tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:17.456965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-83797fab-ddd0-4903-a5ab-a62229116dcf tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] [instance: 809e7629-f880-4155-a83b-4b2ca39bb335] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:17.472839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:17.506029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83797fab-ddd0-4903-a5ab-a62229116dcf tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:17.506029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83797fab-ddd0-4903-a5ab-a62229116dcf tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:17.506029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83797fab-ddd0-4903-a5ab-a62229116dcf tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:17.511149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6fcaf8c0-310e-4f3a-8696-7fcc4e5c3eb2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:17.512233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6fcaf8c0-310e-4f3a-8696-7fcc4e5c3eb2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:17.520683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83797fab-ddd0-4903-a5ab-a62229116dcf tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:17.521318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83797fab-ddd0-4903-a5ab-a62229116dcf tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:17.525245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83797fab-ddd0-4903-a5ab-a62229116dcf tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:17.609426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6fcaf8c0-310e-4f3a-8696-7fcc4e5c3eb2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:17.610054 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6fcaf8c0-310e-4f3a-8696-7fcc4e5c3eb2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:17.610503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6fcaf8c0-310e-4f3a-8696-7fcc4e5c3eb2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:17.611261 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6fcaf8c0-310e-4f3a-8696-7fcc4e5c3eb2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:17.611716 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6fcaf8c0-310e-4f3a-8696-7fcc4e5c3eb2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:17.612139 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6fcaf8c0-310e-4f3a-8696-7fcc4e5c3eb2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:18.114880 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-83797fab-ddd0-4903-a5ab-a62229116dcf tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3ea9c53c964d329774361a92615e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea1a01e8b644da38cabae74b087f805', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:18.126746 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-83797fab-ddd0-4903-a5ab-a62229116dcf tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] 10.222.0.46 "GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335" status: 200 len: 1285 microversion: 2.1 time: 0.674948 Oct 29 03:03:18.129164 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1904/3647] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:17 2022] GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335 => generated 1285 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:18.136339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6b604dcc-951b-4381-8f04-236698f7dc59 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:18.140151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6b604dcc-951b-4381-8f04-236698f7dc59 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:18.152151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b604dcc-951b-4381-8f04-236698f7dc59 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:18.157178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b604dcc-951b-4381-8f04-236698f7dc59 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:18.157824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b604dcc-951b-4381-8f04-236698f7dc59 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:18.160286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b604dcc-951b-4381-8f04-236698f7dc59 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:18.160954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b604dcc-951b-4381-8f04-236698f7dc59 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:18.164144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b604dcc-951b-4381-8f04-236698f7dc59 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:18.235439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-6b604dcc-951b-4381-8f04-236698f7dc59 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lazy-loading 'flavor' on Instance uuid 354cb0c1-2737-486f-8e3b-d119c49a46a7 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:03:18.590142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6fcaf8c0-310e-4f3a-8696-7fcc4e5c3eb2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:18.633203 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6fcaf8c0-310e-4f3a-8696-7fcc4e5c3eb2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1313 microversion: 2.1 time: 1.124957 Oct 29 03:03:18.636192 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1744/3648] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:17 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1313 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:18.673454 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6b604dcc-951b-4381-8f04-236698f7dc59 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "POST /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7/action" status: 202 len: 0 microversion: 2.20 time: 0.542573 Oct 29 03:03:18.676871 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1905/3649] 10.222.0.46 () {62 vars in 1319 bytes} [Sat Oct 29 03:03:18 2022] POST /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7/action => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:03:18.679658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-a07db988-72dd-4a66-bcc9-f583edf66a64 req-0c55a6d2-f428-4a2a-bf2e-6461b216b129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4953b8e-b647-4491-b532-3476e7837ab2", "name": "network-vif-plugged", "status": "completed", "tag": "898db35a-9988-48ff-8d18-1d616cacb84b"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:18.696786 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0208bc57-767d-41a3-a6f3-508de257a4d0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:18.699150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0208bc57-767d-41a3-a6f3-508de257a4d0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:18.714631 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a07db988-72dd-4a66-bcc9-f583edf66a64 req-0c55a6d2-f428-4a2a-bf2e-6461b216b129 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:18.715500 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a07db988-72dd-4a66-bcc9-f583edf66a64 req-0c55a6d2-f428-4a2a-bf2e-6461b216b129 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:18.717098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a07db988-72dd-4a66-bcc9-f583edf66a64 req-0c55a6d2-f428-4a2a-bf2e-6461b216b129 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:18.718744 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0208bc57-767d-41a3-a6f3-508de257a4d0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:18.719364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0208bc57-767d-41a3-a6f3-508de257a4d0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:18.720628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0208bc57-767d-41a3-a6f3-508de257a4d0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:18.722283 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0208bc57-767d-41a3-a6f3-508de257a4d0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:18.725688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0208bc57-767d-41a3-a6f3-508de257a4d0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:18.726247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0208bc57-767d-41a3-a6f3-508de257a4d0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:18.735326 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-a07db988-72dd-4a66-bcc9-f583edf66a64 req-0c55a6d2-f428-4a2a-bf2e-6461b216b129 service nova] Creating event network-vif-plugged:898db35a-9988-48ff-8d18-1d616cacb84b for instance c4953b8e-b647-4491-b532-3476e7837ab2 on n-h2-862967-2 Oct 29 03:03:18.743709 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-a07db988-72dd-4a66-bcc9-f583edf66a64 req-0c55a6d2-f428-4a2a-bf2e-6461b216b129 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103304 Oct 29 03:03:18.745108 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1745/3650] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:19.173276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e4b83222-8bcf-487e-a65d-1906d123882e tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:19.181717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e4b83222-8bcf-487e-a65d-1906d123882e tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] [instance: 809e7629-f880-4155-a83b-4b2ca39bb335] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:19.212320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e4b83222-8bcf-487e-a65d-1906d123882e tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:19.216339 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e4b83222-8bcf-487e-a65d-1906d123882e tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:19.222742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e4b83222-8bcf-487e-a65d-1906d123882e tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:19.224043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e4b83222-8bcf-487e-a65d-1906d123882e tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:19.224894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e4b83222-8bcf-487e-a65d-1906d123882e tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:19.227371 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e4b83222-8bcf-487e-a65d-1906d123882e tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:19.443221 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e4b83222-8bcf-487e-a65d-1906d123882e tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3ea9c53c964d329774361a92615e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea1a01e8b644da38cabae74b087f805', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:19.477548 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e4b83222-8bcf-487e-a65d-1906d123882e tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] 10.222.0.46 "GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335" status: 200 len: 1273 microversion: 2.1 time: 0.316002 Oct 29 03:03:19.485629 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1746/3651] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:19 2022] GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335 => generated 1273 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:19.926954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2c7fff01-8199-491f-b863-8e1c939af209 tempest-AbsoluteLimitsNegativeTestJSON-1387427352 tempest-AbsoluteLimitsNegativeTestJSON-1387427352-project] Calling method '.version_select at 0x7ff053834d30>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:19.968450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2c7fff01-8199-491f-b863-8e1c939af209 tempest-AbsoluteLimitsNegativeTestJSON-1387427352 tempest-AbsoluteLimitsNegativeTestJSON-1387427352-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:19.969388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2c7fff01-8199-491f-b863-8e1c939af209 tempest-AbsoluteLimitsNegativeTestJSON-1387427352 tempest-AbsoluteLimitsNegativeTestJSON-1387427352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:19.970079 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2c7fff01-8199-491f-b863-8e1c939af209 tempest-AbsoluteLimitsNegativeTestJSON-1387427352 tempest-AbsoluteLimitsNegativeTestJSON-1387427352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:19.971080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2c7fff01-8199-491f-b863-8e1c939af209 tempest-AbsoluteLimitsNegativeTestJSON-1387427352 tempest-AbsoluteLimitsNegativeTestJSON-1387427352-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:19.971847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2c7fff01-8199-491f-b863-8e1c939af209 tempest-AbsoluteLimitsNegativeTestJSON-1387427352 tempest-AbsoluteLimitsNegativeTestJSON-1387427352-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:19.972548 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2c7fff01-8199-491f-b863-8e1c939af209 tempest-AbsoluteLimitsNegativeTestJSON-1387427352 tempest-AbsoluteLimitsNegativeTestJSON-1387427352-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:19.987683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0208bc57-767d-41a3-a6f3-508de257a4d0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:20.002503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0208bc57-767d-41a3-a6f3-508de257a4d0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:20.009156 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2c7fff01-8199-491f-b863-8e1c939af209 tempest-AbsoluteLimitsNegativeTestJSON-1387427352 tempest-AbsoluteLimitsNegativeTestJSON-1387427352-project] 10.222.0.46 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.519951 Oct 29 03:03:20.010674 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1747/3652] 10.222.0.46 () {58 vars in 1122 bytes} [Sat Oct 29 03:03:19 2022] GET /compute/v2.1/limits => generated 511 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:20.019448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0208bc57-767d-41a3-a6f3-508de257a4d0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:20.023165 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0208bc57-767d-41a3-a6f3-508de257a4d0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1724 microversion: 2.20 time: 1.341852 Oct 29 03:03:20.037764 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1906/3653] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:18 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1724 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:20.039242 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-269ec410-f659-445a-9244-4f51542a1ba4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:20.040990 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-269ec410-f659-445a-9244-4f51542a1ba4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:20.084304 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-269ec410-f659-445a-9244-4f51542a1ba4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:20.096785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-269ec410-f659-445a-9244-4f51542a1ba4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:20.097241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-269ec410-f659-445a-9244-4f51542a1ba4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:20.098000 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-269ec410-f659-445a-9244-4f51542a1ba4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:20.098457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-269ec410-f659-445a-9244-4f51542a1ba4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:20.103358 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-269ec410-f659-445a-9244-4f51542a1ba4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:20.155852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-095e3183-e6a2-4720-af3e-968eff6f51c3 tempest-AbsoluteLimitsNegativeTestJSON-1387427352 tempest-AbsoluteLimitsNegativeTestJSON-1387427352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-756346560", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:20.316138 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-095e3183-e6a2-4720-af3e-968eff6f51c3 tempest-AbsoluteLimitsNegativeTestJSON-1387427352 tempest-AbsoluteLimitsNegativeTestJSON-1387427352-project] validate_networks() for None {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:03:20.602632 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-269ec410-f659-445a-9244-4f51542a1ba4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:20.626882 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-269ec410-f659-445a-9244-4f51542a1ba4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1313 microversion: 2.1 time: 0.613898 Oct 29 03:03:20.628229 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1748/3654] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:20 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1313 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:20.652194 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4acd344b-30ed-4ef1-b116-e9d024110040 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:20.654253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4acd344b-30ed-4ef1-b116-e9d024110040 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] [instance: 809e7629-f880-4155-a83b-4b2ca39bb335] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:20.668477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4acd344b-30ed-4ef1-b116-e9d024110040 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:20.670752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4acd344b-30ed-4ef1-b116-e9d024110040 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:20.672802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4acd344b-30ed-4ef1-b116-e9d024110040 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:20.674225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4acd344b-30ed-4ef1-b116-e9d024110040 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:20.675384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4acd344b-30ed-4ef1-b116-e9d024110040 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:20.677369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4acd344b-30ed-4ef1-b116-e9d024110040 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:21.321966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4acd344b-30ed-4ef1-b116-e9d024110040 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3ea9c53c964d329774361a92615e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea1a01e8b644da38cabae74b087f805', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:21.344917 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4acd344b-30ed-4ef1-b116-e9d024110040 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] 10.222.0.46 "GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335" status: 200 len: 1315 microversion: 2.1 time: 0.714691 Oct 29 03:03:21.345803 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1749/3655] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:20 2022] GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335 => generated 1315 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:21.363932 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-eafe158b-64ee-4ac3-a469-5165837c538f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:21.367119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-eafe158b-64ee-4ac3-a469-5165837c538f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:21.380064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eafe158b-64ee-4ac3-a469-5165837c538f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:21.381322 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eafe158b-64ee-4ac3-a469-5165837c538f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:21.382286 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eafe158b-64ee-4ac3-a469-5165837c538f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:21.384482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eafe158b-64ee-4ac3-a469-5165837c538f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:21.385834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eafe158b-64ee-4ac3-a469-5165837c538f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:21.387544 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eafe158b-64ee-4ac3-a469-5165837c538f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:21.422517 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-095e3183-e6a2-4720-af3e-968eff6f51c3 tempest-AbsoluteLimitsNegativeTestJSON-1387427352 tempest-AbsoluteLimitsNegativeTestJSON-1387427352-project] Getting quotas for project 5163ea9c32e448d7990083372c42a8c9. Resources: dict_keys(['metadata_items']) {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:03:21.429219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-095e3183-e6a2-4720-af3e-968eff6f51c3 tempest-AbsoluteLimitsNegativeTestJSON-1387427352 tempest-AbsoluteLimitsNegativeTestJSON-1387427352-project] Getting quotas for user c3ba604cad7141139b8c45b018844a1a and project 5163ea9c32e448d7990083372c42a8c9. Resources: dict_keys(['metadata_items']) {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:03:21.494455 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-095e3183-e6a2-4720-af3e-968eff6f51c3 tempest-AbsoluteLimitsNegativeTestJSON-1387427352 tempest-AbsoluteLimitsNegativeTestJSON-1387427352-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-095e3183-e6a2-4720-af3e-968eff6f51c3 tempest-AbsoluteLimitsNegativeTestJSON-1387427352 tempest-AbsoluteLimitsNegativeTestJSON-1387427352-project] Request method failure captured: Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 1751 Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJf3EM7GUkwN6rgwkusOnRMSrsXJC2HibsTr0I0JAo6TX2Ygca7Q1iEZCt71bp7wLOHEX_YpN3sLEYsnqJoP3pWmLYtH1c6o5qIfuiL0b0uLqgqWKkN7zpHAm1u7-m3opdlj3ahxFQsIupM2MVD1OJ7jYim5T91LFnAiuLX4M49P6_4 Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 5163ea9c32e448d7990083372c42a8c9 Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1387427352 Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5163ea9c32e448d7990083372c42a8c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5163ea9c32e448d7990083372c42a8c9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5163ea9c32e448d7990083372c42a8c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5163ea9c32e448d7990083372c42a8c9"}]}] Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1387427352 Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 5163ea9c32e448d7990083372c42a8c9 Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1387427352 Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1387427352-project Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: c3ba604cad7141139b8c45b018844a1a Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1387427352-project Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-756346560", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:03:21.524302 n-d-862967-2 devstack@n-api.service[127124]: exception: Maximum number of metadata items exceeds 128 Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-756346560', 'imageRef': 'cd315600-df67-41c1-95d3-95a5145fc39a', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:03:21.528373 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:03:21.534436 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:03:21.534436 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 29 03:03:21.534436 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 29 03:03:21.534436 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 29 03:03:21.534436 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 29 03:03:21.534436 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:03:21.534436 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:03:21.534436 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:03:21.534436 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:03:21.534436 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:03:21.534436 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:03:21.534436 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:03:21.534436 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:03:21.534436 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 29 03:03:21.534436 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:03:21.534436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-095e3183-e6a2-4720-af3e-968eff6f51c3 tempest-AbsoluteLimitsNegativeTestJSON-1387427352 tempest-AbsoluteLimitsNegativeTestJSON-1387427352-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:03:21.534436 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-095e3183-e6a2-4720-af3e-968eff6f51c3 tempest-AbsoluteLimitsNegativeTestJSON-1387427352 tempest-AbsoluteLimitsNegativeTestJSON-1387427352-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.382606 Oct 29 03:03:21.534436 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1907/3656] 10.222.0.46 () {60 vars in 1148 bytes} [Sat Oct 29 03:03:20 2022] POST /compute/v2.1/servers => generated 87 bytes in 1386 msecs (HTTP/1.1 403) 9 headers in 378 bytes (2 switches on core 0) Oct 29 03:03:21.662785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a9992776-80cf-4144-a3cb-99d66f2d047a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:21.665975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a9992776-80cf-4144-a3cb-99d66f2d047a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:21.716398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9992776-80cf-4144-a3cb-99d66f2d047a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:21.719474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9992776-80cf-4144-a3cb-99d66f2d047a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:21.722177 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9992776-80cf-4144-a3cb-99d66f2d047a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:21.741568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9992776-80cf-4144-a3cb-99d66f2d047a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:21.744494 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9992776-80cf-4144-a3cb-99d66f2d047a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:21.747533 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9992776-80cf-4144-a3cb-99d66f2d047a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:22.222568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a9992776-80cf-4144-a3cb-99d66f2d047a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:22.236949 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a9992776-80cf-4144-a3cb-99d66f2d047a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1463 microversion: 2.1 time: 0.578448 Oct 29 03:03:22.237638 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1908/3657] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:21 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1463 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:03:22.510431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-eafe158b-64ee-4ac3-a469-5165837c538f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:22.528700 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-eafe158b-64ee-4ac3-a469-5165837c538f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:22.535124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-eafe158b-64ee-4ac3-a469-5165837c538f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:22.546161 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-eafe158b-64ee-4ac3-a469-5165837c538f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1724 microversion: 2.20 time: 1.199061 Oct 29 03:03:22.550871 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1750/3658] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:21 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1724 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:22.568709 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e2332947-6472-4cb3-8490-5b92b2596c2d tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:22.572649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e2332947-6472-4cb3-8490-5b92b2596c2d tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] [instance: 809e7629-f880-4155-a83b-4b2ca39bb335] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:22.595092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2332947-6472-4cb3-8490-5b92b2596c2d tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:22.595952 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2332947-6472-4cb3-8490-5b92b2596c2d tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:22.598297 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2332947-6472-4cb3-8490-5b92b2596c2d tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:22.599957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2332947-6472-4cb3-8490-5b92b2596c2d tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:22.604589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2332947-6472-4cb3-8490-5b92b2596c2d tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:22.615632 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2332947-6472-4cb3-8490-5b92b2596c2d tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:22.639678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8dabd882-4df5-4a93-8df6-21af1060f478 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:22.640515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8dabd882-4df5-4a93-8df6-21af1060f478 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:22.659398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8dabd882-4df5-4a93-8df6-21af1060f478 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:22.659900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8dabd882-4df5-4a93-8df6-21af1060f478 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:22.660340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8dabd882-4df5-4a93-8df6-21af1060f478 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:22.661117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8dabd882-4df5-4a93-8df6-21af1060f478 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:22.661761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8dabd882-4df5-4a93-8df6-21af1060f478 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:22.662186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8dabd882-4df5-4a93-8df6-21af1060f478 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:23.170750 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e2332947-6472-4cb3-8490-5b92b2596c2d tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3ea9c53c964d329774361a92615e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea1a01e8b644da38cabae74b087f805', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:23.197628 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e2332947-6472-4cb3-8490-5b92b2596c2d tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] 10.222.0.46 "GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335" status: 200 len: 1315 microversion: 2.1 time: 0.638089 Oct 29 03:03:23.198665 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1751/3659] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:22 2022] GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335 => generated 1315 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:23.597477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-aaeb0b0a-fe61-4a60-972c-2dbd253ac980 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-2130873004", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:23.709029 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8dabd882-4df5-4a93-8df6-21af1060f478 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1614 microversion: 2.1 time: 1.449249 Oct 29 03:03:23.713248 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1909/3660] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:22 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1614 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:03:23.741866 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3bcdadf1-f705-4000-b787-960473b1e059 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:23.744055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3bcdadf1-f705-4000-b787-960473b1e059 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:23.761772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3bcdadf1-f705-4000-b787-960473b1e059 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:23.763745 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3bcdadf1-f705-4000-b787-960473b1e059 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:23.764192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3bcdadf1-f705-4000-b787-960473b1e059 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:23.766681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-aaeb0b0a-fe61-4a60-972c-2dbd253ac980 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] validate_networks() for [('5b35fb71-6bc5-44b3-95a2-866b95850c05', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:03:23.767993 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3bcdadf1-f705-4000-b787-960473b1e059 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:23.768896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3bcdadf1-f705-4000-b787-960473b1e059 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:23.770329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3bcdadf1-f705-4000-b787-960473b1e059 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:24.262318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3bcdadf1-f705-4000-b787-960473b1e059 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:24.269758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:24.293162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3bcdadf1-f705-4000-b787-960473b1e059 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:24.296170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3bcdadf1-f705-4000-b787-960473b1e059 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:24.298151 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3bcdadf1-f705-4000-b787-960473b1e059 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1724 microversion: 2.20 time: 0.581076 Oct 29 03:03:24.299176 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1910/3661] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:23 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1724 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:24.340715 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d54e853b-122b-4c18-aea8-ca4bda2f995f tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:24.342799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d54e853b-122b-4c18-aea8-ca4bda2f995f tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:24.361140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d54e853b-122b-4c18-aea8-ca4bda2f995f tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:24.364147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d54e853b-122b-4c18-aea8-ca4bda2f995f tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:24.366286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d54e853b-122b-4c18-aea8-ca4bda2f995f tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:24.369912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d54e853b-122b-4c18-aea8-ca4bda2f995f tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:24.371077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d54e853b-122b-4c18-aea8-ca4bda2f995f tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:24.372355 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d54e853b-122b-4c18-aea8-ca4bda2f995f tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:24.550301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:24.615493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d54e853b-122b-4c18-aea8-ca4bda2f995f tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4a84597a69a04a1d980b82b35c2e0d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1012bab651274e7ab9a5a713f6e0a0d7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:24.616108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d54e853b-122b-4c18-aea8-ca4bda2f995f tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] flavor_id is None. Assuming migration. {{(pid=127124) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 29 03:03:24.616573 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d54e853b-122b-4c18-aea8-ca4bda2f995f tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127124) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 03:03:24.978133 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d54e853b-122b-4c18-aea8-ca4bda2f995f tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2/action" status: 202 len: 0 microversion: 2.1 time: 0.650006 Oct 29 03:03:24.989496 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1911/3662] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:03:24 2022] POST /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2/action => generated 0 bytes in 665 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:03:25.029009 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-51f67748-e993-4e76-bcd3-fb4c2f1f2815 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:25.032065 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-51f67748-e993-4e76-bcd3-fb4c2f1f2815 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] [instance: 809e7629-f880-4155-a83b-4b2ca39bb335] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:25.071576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51f67748-e993-4e76-bcd3-fb4c2f1f2815 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:25.072451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51f67748-e993-4e76-bcd3-fb4c2f1f2815 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:25.074774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51f67748-e993-4e76-bcd3-fb4c2f1f2815 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:25.078080 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51f67748-e993-4e76-bcd3-fb4c2f1f2815 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:25.082989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51f67748-e993-4e76-bcd3-fb4c2f1f2815 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:25.085356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51f67748-e993-4e76-bcd3-fb4c2f1f2815 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:26.388388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-aaeb0b0a-fe61-4a60-972c-2dbd253ac980 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:03:26.389259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-aaeb0b0a-fe61-4a60-972c-2dbd253ac980 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:03:26.389602 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-aaeb0b0a-fe61-4a60-972c-2dbd253ac980 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:03:26.390036 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-aaeb0b0a-fe61-4a60-972c-2dbd253ac980 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:03:26.390446 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-aaeb0b0a-fe61-4a60-972c-2dbd253ac980 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:03:26.411187 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aaeb0b0a-fe61-4a60-972c-2dbd253ac980 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:26.411687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aaeb0b0a-fe61-4a60-972c-2dbd253ac980 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:26.412314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aaeb0b0a-fe61-4a60-972c-2dbd253ac980 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:26.413444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aaeb0b0a-fe61-4a60-972c-2dbd253ac980 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:26.413922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aaeb0b0a-fe61-4a60-972c-2dbd253ac980 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:26.414352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aaeb0b0a-fe61-4a60-972c-2dbd253ac980 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:26.450676 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-51f67748-e993-4e76-bcd3-fb4c2f1f2815 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3ea9c53c964d329774361a92615e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea1a01e8b644da38cabae74b087f805', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:26.459993 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-51f67748-e993-4e76-bcd3-fb4c2f1f2815 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] 10.222.0.46 "GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335" status: 200 len: 1315 microversion: 2.1 time: 1.475055 Oct 29 03:03:26.463711 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1912/3663] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:24 2022] GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335 => generated 1315 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:26.475728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-aaeb0b0a-fe61-4a60-972c-2dbd253ac980 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Getting quotas for project bb24014d942448949743ad6b56d8d0a7. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:03:26.483310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-3e09ad9f-15c7-49f9-b954-5483d30577ff req-cad4dde6-7580-40a9-95da-743c32871948 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "809e7629-f880-4155-a83b-4b2ca39bb335", "tag": "41b55bef-60ac-4cc5-80bc-83ddf33b9004"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:26.491412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-aaeb0b0a-fe61-4a60-972c-2dbd253ac980 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Getting quotas for user 764f273de21745e0ab94f098ede04499 and project bb24014d942448949743ad6b56d8d0a7. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:03:26.510885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3e09ad9f-15c7-49f9-b954-5483d30577ff req-cad4dde6-7580-40a9-95da-743c32871948 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:26.511371 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3e09ad9f-15c7-49f9-b954-5483d30577ff req-cad4dde6-7580-40a9-95da-743c32871948 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:26.511809 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3e09ad9f-15c7-49f9-b954-5483d30577ff req-cad4dde6-7580-40a9-95da-743c32871948 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:26.514583 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-aaeb0b0a-fe61-4a60-972c-2dbd253ac980 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:03:26.518143 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-aaeb0b0a-fe61-4a60-972c-2dbd253ac980 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:03:26.555389 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-3e09ad9f-15c7-49f9-b954-5483d30577ff req-cad4dde6-7580-40a9-95da-743c32871948 service nova] Creating event network-changed:41b55bef-60ac-4cc5-80bc-83ddf33b9004 for instance 809e7629-f880-4155-a83b-4b2ca39bb335 on n-h1-862967-2 Oct 29 03:03:26.562557 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-3e09ad9f-15c7-49f9-b954-5483d30577ff req-cad4dde6-7580-40a9-95da-743c32871948 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096479 Oct 29 03:03:26.563530 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1913/3664] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:26.569312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bde8afd6-1f6d-4115-a495-d26b0e59058a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:26.570211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bde8afd6-1f6d-4115-a495-d26b0e59058a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:26.586673 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bde8afd6-1f6d-4115-a495-d26b0e59058a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:26.587506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bde8afd6-1f6d-4115-a495-d26b0e59058a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:26.588124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bde8afd6-1f6d-4115-a495-d26b0e59058a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:26.589071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bde8afd6-1f6d-4115-a495-d26b0e59058a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:26.589700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bde8afd6-1f6d-4115-a495-d26b0e59058a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:26.593135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bde8afd6-1f6d-4115-a495-d26b0e59058a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:26.635098 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-aaeb0b0a-fe61-4a60-972c-2dbd253ac980 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.252069 Oct 29 03:03:26.636404 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1752/3665] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:03:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 3256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 03:03:26.654867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ec2f76c6-4723-4edb-b60d-0055c540d781 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:26.657795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ec2f76c6-4723-4edb-b60d-0055c540d781 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:26.677271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec2f76c6-4723-4edb-b60d-0055c540d781 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:26.679448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec2f76c6-4723-4edb-b60d-0055c540d781 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:26.681050 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec2f76c6-4723-4edb-b60d-0055c540d781 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:26.685486 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec2f76c6-4723-4edb-b60d-0055c540d781 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:26.686897 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec2f76c6-4723-4edb-b60d-0055c540d781 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:26.689148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec2f76c6-4723-4edb-b60d-0055c540d781 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:27.442860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bde8afd6-1f6d-4115-a495-d26b0e59058a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:27.458367 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bde8afd6-1f6d-4115-a495-d26b0e59058a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1472 microversion: 2.1 time: 0.893463 Oct 29 03:03:27.464963 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1914/3666] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:26 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1472 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:27.472280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6af07357-f6d3-43a6-ae0a-371877ee6d30 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:27.477245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6af07357-f6d3-43a6-ae0a-371877ee6d30 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:27.832647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6af07357-f6d3-43a6-ae0a-371877ee6d30 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:27.846122 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6af07357-f6d3-43a6-ae0a-371877ee6d30 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa" status: 200 len: 1214 microversion: 2.1 time: 0.379184 Oct 29 03:03:27.846780 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1915/3667] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:27 2022] GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa => generated 1214 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:27.869528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9b39e5b3-178a-46da-ad87-60dfd3caea43 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:27.870970 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9b39e5b3-178a-46da-ad87-60dfd3caea43 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] [instance: 809e7629-f880-4155-a83b-4b2ca39bb335] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:27.904675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b39e5b3-178a-46da-ad87-60dfd3caea43 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:27.906144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b39e5b3-178a-46da-ad87-60dfd3caea43 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:27.906935 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b39e5b3-178a-46da-ad87-60dfd3caea43 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:27.908021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b39e5b3-178a-46da-ad87-60dfd3caea43 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:27.908847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b39e5b3-178a-46da-ad87-60dfd3caea43 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:27.909499 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b39e5b3-178a-46da-ad87-60dfd3caea43 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:28.288347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ec2f76c6-4723-4edb-b60d-0055c540d781 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:28.311689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ec2f76c6-4723-4edb-b60d-0055c540d781 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:28.320571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ec2f76c6-4723-4edb-b60d-0055c540d781 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:28.322567 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ec2f76c6-4723-4edb-b60d-0055c540d781 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1724 microversion: 2.20 time: 1.684528 Oct 29 03:03:28.329333 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1753/3668] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:26 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1724 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:28.504190 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cdd496d5-00d4-4b41-b59d-958c1495c7b1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:28.504885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cdd496d5-00d4-4b41-b59d-958c1495c7b1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:28.533364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdd496d5-00d4-4b41-b59d-958c1495c7b1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:28.534112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdd496d5-00d4-4b41-b59d-958c1495c7b1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:28.537607 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdd496d5-00d4-4b41-b59d-958c1495c7b1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:28.538955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdd496d5-00d4-4b41-b59d-958c1495c7b1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:28.539798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdd496d5-00d4-4b41-b59d-958c1495c7b1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:28.545481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdd496d5-00d4-4b41-b59d-958c1495c7b1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:28.587980 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9b39e5b3-178a-46da-ad87-60dfd3caea43 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3ea9c53c964d329774361a92615e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea1a01e8b644da38cabae74b087f805', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:28.614946 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9b39e5b3-178a-46da-ad87-60dfd3caea43 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] 10.222.0.46 "GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335" status: 200 len: 1315 microversion: 2.1 time: 0.766205 Oct 29 03:03:28.618738 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1916/3669] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:27 2022] GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335 => generated 1315 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:28.877101 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d0b8cc54-6ce2-4002-aff0-03339bb36a27 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:28.877738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d0b8cc54-6ce2-4002-aff0-03339bb36a27 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:28.891563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0b8cc54-6ce2-4002-aff0-03339bb36a27 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:28.892085 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0b8cc54-6ce2-4002-aff0-03339bb36a27 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:28.910762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0b8cc54-6ce2-4002-aff0-03339bb36a27 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:28.911748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0b8cc54-6ce2-4002-aff0-03339bb36a27 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:28.912255 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0b8cc54-6ce2-4002-aff0-03339bb36a27 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:28.912728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0b8cc54-6ce2-4002-aff0-03339bb36a27 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:29.057182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cdd496d5-00d4-4b41-b59d-958c1495c7b1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:29.067540 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cdd496d5-00d4-4b41-b59d-958c1495c7b1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1472 microversion: 2.1 time: 0.566565 Oct 29 03:03:29.069558 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1754/3670] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:28 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1472 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:03:29.243556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d0b8cc54-6ce2-4002-aff0-03339bb36a27 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:29.294139 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d0b8cc54-6ce2-4002-aff0-03339bb36a27 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa" status: 200 len: 1266 microversion: 2.1 time: 0.417413 Oct 29 03:03:29.316246 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1917/3671] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:28 2022] GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa => generated 1266 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:03:29.388716 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d7b04ddd-1938-43d9-884e-5a83c8f864ad tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:29.390504 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d7b04ddd-1938-43d9-884e-5a83c8f864ad tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:29.403399 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d7b04ddd-1938-43d9-884e-5a83c8f864ad tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:29.403896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d7b04ddd-1938-43d9-884e-5a83c8f864ad tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:29.408094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d7b04ddd-1938-43d9-884e-5a83c8f864ad tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:29.408957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d7b04ddd-1938-43d9-884e-5a83c8f864ad tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:29.409635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d7b04ddd-1938-43d9-884e-5a83c8f864ad tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:29.409840 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d7b04ddd-1938-43d9-884e-5a83c8f864ad tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:29.665047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f038f28c-0000-472f-83e1-f94414b9fd95 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:29.675348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f038f28c-0000-472f-83e1-f94414b9fd95 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] [instance: 809e7629-f880-4155-a83b-4b2ca39bb335] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:29.696706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f038f28c-0000-472f-83e1-f94414b9fd95 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:29.697675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f038f28c-0000-472f-83e1-f94414b9fd95 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:29.698449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f038f28c-0000-472f-83e1-f94414b9fd95 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:29.699733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f038f28c-0000-472f-83e1-f94414b9fd95 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:29.700840 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f038f28c-0000-472f-83e1-f94414b9fd95 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:29.701684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f038f28c-0000-472f-83e1-f94414b9fd95 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:30.088630 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d7b04ddd-1938-43d9-884e-5a83c8f864ad tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:30.105735 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d7b04ddd-1938-43d9-884e-5a83c8f864ad tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:30.108365 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d7b04ddd-1938-43d9-884e-5a83c8f864ad tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:30.110411 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d7b04ddd-1938-43d9-884e-5a83c8f864ad tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1724 microversion: 2.20 time: 0.741114 Oct 29 03:03:30.111857 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1755/3672] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:29 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1724 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:30.119653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-65ca0baa-aa78-4746-a463-86436addc879 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:30.120695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-65ca0baa-aa78-4746-a463-86436addc879 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:30.133847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65ca0baa-aa78-4746-a463-86436addc879 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:30.134407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65ca0baa-aa78-4746-a463-86436addc879 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:30.134909 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65ca0baa-aa78-4746-a463-86436addc879 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:30.143798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65ca0baa-aa78-4746-a463-86436addc879 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:30.144361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65ca0baa-aa78-4746-a463-86436addc879 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:30.145058 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65ca0baa-aa78-4746-a463-86436addc879 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:30.387195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f038f28c-0000-472f-83e1-f94414b9fd95 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3ea9c53c964d329774361a92615e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea1a01e8b644da38cabae74b087f805', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:30.416950 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f038f28c-0000-472f-83e1-f94414b9fd95 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] 10.222.0.46 "GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335" status: 200 len: 1315 microversion: 2.1 time: 0.762436 Oct 29 03:03:30.421397 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1918/3673] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:29 2022] GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335 => generated 1315 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:30.437494 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-516c5658-c789-4d1a-95e2-2aa07f7bc3d8 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:30.438432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-516c5658-c789-4d1a-95e2-2aa07f7bc3d8 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:30.450568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-516c5658-c789-4d1a-95e2-2aa07f7bc3d8 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:30.451387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-516c5658-c789-4d1a-95e2-2aa07f7bc3d8 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:30.452014 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-516c5658-c789-4d1a-95e2-2aa07f7bc3d8 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:30.452983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-516c5658-c789-4d1a-95e2-2aa07f7bc3d8 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:30.456947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-516c5658-c789-4d1a-95e2-2aa07f7bc3d8 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:30.458045 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-516c5658-c789-4d1a-95e2-2aa07f7bc3d8 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:30.687318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-516c5658-c789-4d1a-95e2-2aa07f7bc3d8 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:30.707227 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-516c5658-c789-4d1a-95e2-2aa07f7bc3d8 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa" status: 200 len: 1272 microversion: 2.1 time: 0.275330 Oct 29 03:03:30.720046 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1919/3674] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:30 2022] GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa => generated 1272 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:30.891708 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-65ca0baa-aa78-4746-a463-86436addc879 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:30.928789 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-65ca0baa-aa78-4746-a463-86436addc879 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1472 microversion: 2.1 time: 0.814046 Oct 29 03:03:30.939088 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1756/3675] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:30 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1472 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:31.157897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cd66a555-3d53-46a6-977a-9da8de4e4759 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:31.158561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cd66a555-3d53-46a6-977a-9da8de4e4759 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:31.173003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd66a555-3d53-46a6-977a-9da8de4e4759 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:31.173710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd66a555-3d53-46a6-977a-9da8de4e4759 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:31.174163 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd66a555-3d53-46a6-977a-9da8de4e4759 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:31.174913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd66a555-3d53-46a6-977a-9da8de4e4759 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:31.189677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd66a555-3d53-46a6-977a-9da8de4e4759 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:31.190229 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd66a555-3d53-46a6-977a-9da8de4e4759 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:31.467249 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ca7d81d4-cd06-419f-b57f-d190729b1380 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:31.469654 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ca7d81d4-cd06-419f-b57f-d190729b1380 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] [instance: 809e7629-f880-4155-a83b-4b2ca39bb335] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:31.490503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ca7d81d4-cd06-419f-b57f-d190729b1380 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:31.491697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ca7d81d4-cd06-419f-b57f-d190729b1380 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:31.492781 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ca7d81d4-cd06-419f-b57f-d190729b1380 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:31.493900 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ca7d81d4-cd06-419f-b57f-d190729b1380 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:31.495082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ca7d81d4-cd06-419f-b57f-d190729b1380 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:31.496013 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ca7d81d4-cd06-419f-b57f-d190729b1380 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:31.613200 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cd66a555-3d53-46a6-977a-9da8de4e4759 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:31.646002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cd66a555-3d53-46a6-977a-9da8de4e4759 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:31.652586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cd66a555-3d53-46a6-977a-9da8de4e4759 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:31.659548 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cd66a555-3d53-46a6-977a-9da8de4e4759 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1724 microversion: 2.20 time: 0.507214 Oct 29 03:03:31.663787 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1920/3676] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:31 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1724 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:31.764452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-005bead2-49ed-4733-8fa3-3762838260ba tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:31.770220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-005bead2-49ed-4733-8fa3-3762838260ba tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:31.808893 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-005bead2-49ed-4733-8fa3-3762838260ba tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:31.816263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-005bead2-49ed-4733-8fa3-3762838260ba tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:31.817814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-005bead2-49ed-4733-8fa3-3762838260ba tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:31.823664 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-005bead2-49ed-4733-8fa3-3762838260ba tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:31.825085 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-005bead2-49ed-4733-8fa3-3762838260ba tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:31.828146 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-005bead2-49ed-4733-8fa3-3762838260ba tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:32.338814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ca7d81d4-cd06-419f-b57f-d190729b1380 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3ea9c53c964d329774361a92615e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea1a01e8b644da38cabae74b087f805', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:32.356040 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ca7d81d4-cd06-419f-b57f-d190729b1380 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] 10.222.0.46 "GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335" status: 200 len: 1315 microversion: 2.1 time: 0.898892 Oct 29 03:03:32.359166 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1757/3677] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:31 2022] GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335 => generated 1315 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:32.382088 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a3301df4-32b9-4184-b070-252d23866e93 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:32.383691 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a3301df4-32b9-4184-b070-252d23866e93 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:32.400138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3301df4-32b9-4184-b070-252d23866e93 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:32.408070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3301df4-32b9-4184-b070-252d23866e93 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:32.409432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3301df4-32b9-4184-b070-252d23866e93 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:32.409949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3301df4-32b9-4184-b070-252d23866e93 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:32.415203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3301df4-32b9-4184-b070-252d23866e93 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:32.416110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3301df4-32b9-4184-b070-252d23866e93 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:32.760817 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-005bead2-49ed-4733-8fa3-3762838260ba tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:32.776299 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-005bead2-49ed-4733-8fa3-3762838260ba tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa" status: 200 len: 1314 microversion: 2.1 time: 1.040259 Oct 29 03:03:32.791853 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1921/3678] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:31 2022] GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa => generated 1314 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:03:32.797038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e511cb1b-4421-42d1-8aca-e6597228c0b4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:32.797655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e511cb1b-4421-42d1-8aca-e6597228c0b4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:32.822080 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e511cb1b-4421-42d1-8aca-e6597228c0b4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:32.822574 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e511cb1b-4421-42d1-8aca-e6597228c0b4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:32.823009 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e511cb1b-4421-42d1-8aca-e6597228c0b4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:32.823722 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e511cb1b-4421-42d1-8aca-e6597228c0b4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:32.824290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e511cb1b-4421-42d1-8aca-e6597228c0b4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:32.824766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e511cb1b-4421-42d1-8aca-e6597228c0b4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:33.495919 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a3301df4-32b9-4184-b070-252d23866e93 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:33.498925 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e511cb1b-4421-42d1-8aca-e6597228c0b4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:33.500845 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:33.536557 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a3301df4-32b9-4184-b070-252d23866e93 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1472 microversion: 2.1 time: 1.158555 Oct 29 03:03:33.537755 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1758/3679] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:32 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1472 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:33.563981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e511cb1b-4421-42d1-8aca-e6597228c0b4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:33.568379 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c9b099d3-7af2-4848-a749-a0340774accc tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:33.568950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e511cb1b-4421-42d1-8aca-e6597228c0b4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:33.571443 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e511cb1b-4421-42d1-8aca-e6597228c0b4 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1724 microversion: 2.20 time: 0.778008 Oct 29 03:03:33.574249 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c9b099d3-7af2-4848-a749-a0340774accc tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] [instance: 809e7629-f880-4155-a83b-4b2ca39bb335] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:33.595448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c9b099d3-7af2-4848-a749-a0340774accc tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:33.604851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c9b099d3-7af2-4848-a749-a0340774accc tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:33.604851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c9b099d3-7af2-4848-a749-a0340774accc tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:33.604851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c9b099d3-7af2-4848-a749-a0340774accc tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:33.604851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c9b099d3-7af2-4848-a749-a0340774accc tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:33.604851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c9b099d3-7af2-4848-a749-a0340774accc tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:33.608220 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1922/3680] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:32 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1724 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:33.779844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-5ededf50-89b5-4213-b113-63fa8d64946b req-04cc8c38-150f-4624-8542-8be891d3bceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "809e7629-f880-4155-a83b-4b2ca39bb335", "name": "network-vif-plugged", "status": "completed", "tag": "41b55bef-60ac-4cc5-80bc-83ddf33b9004"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:33.814075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5ededf50-89b5-4213-b113-63fa8d64946b req-04cc8c38-150f-4624-8542-8be891d3bceb service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:33.815031 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5ededf50-89b5-4213-b113-63fa8d64946b req-04cc8c38-150f-4624-8542-8be891d3bceb service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:33.815720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5ededf50-89b5-4213-b113-63fa8d64946b req-04cc8c38-150f-4624-8542-8be891d3bceb service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:33.829746 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-5ededf50-89b5-4213-b113-63fa8d64946b req-04cc8c38-150f-4624-8542-8be891d3bceb service nova] Creating event network-vif-plugged:41b55bef-60ac-4cc5-80bc-83ddf33b9004 for instance 809e7629-f880-4155-a83b-4b2ca39bb335 on n-h1-862967-2 Oct 29 03:03:33.839304 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-5ededf50-89b5-4213-b113-63fa8d64946b req-04cc8c38-150f-4624-8542-8be891d3bceb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064466 Oct 29 03:03:33.840837 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1923/3681] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:33.849625 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8af93fd1-4b43-4af9-86fd-03a2f37a6b0d tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:33.851035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8af93fd1-4b43-4af9-86fd-03a2f37a6b0d tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:33.858838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8af93fd1-4b43-4af9-86fd-03a2f37a6b0d tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:33.859920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8af93fd1-4b43-4af9-86fd-03a2f37a6b0d tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:33.862419 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8af93fd1-4b43-4af9-86fd-03a2f37a6b0d tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:33.863513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8af93fd1-4b43-4af9-86fd-03a2f37a6b0d tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:33.864405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8af93fd1-4b43-4af9-86fd-03a2f37a6b0d tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:33.865075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8af93fd1-4b43-4af9-86fd-03a2f37a6b0d tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:34.344749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8af93fd1-4b43-4af9-86fd-03a2f37a6b0d tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:34.370179 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8af93fd1-4b43-4af9-86fd-03a2f37a6b0d tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa" status: 200 len: 1314 microversion: 2.1 time: 0.527297 Oct 29 03:03:34.372169 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1924/3682] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:33 2022] GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:34.574749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-679011e9-dbea-481f-92a3-d4d6ab821a13 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:34.580570 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-679011e9-dbea-481f-92a3-d4d6ab821a13 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:34.611803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-679011e9-dbea-481f-92a3-d4d6ab821a13 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:34.612999 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-679011e9-dbea-481f-92a3-d4d6ab821a13 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:34.626552 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-679011e9-dbea-481f-92a3-d4d6ab821a13 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:34.629143 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-679011e9-dbea-481f-92a3-d4d6ab821a13 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:34.631361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-679011e9-dbea-481f-92a3-d4d6ab821a13 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:34.638412 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-679011e9-dbea-481f-92a3-d4d6ab821a13 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:35.125647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c9b099d3-7af2-4848-a749-a0340774accc tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3ea9c53c964d329774361a92615e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea1a01e8b644da38cabae74b087f805', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:35.156411 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c9b099d3-7af2-4848-a749-a0340774accc tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] 10.222.0.46 "GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335" status: 200 len: 1315 microversion: 2.1 time: 1.616565 Oct 29 03:03:35.158328 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1759/3683] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:33 2022] GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335 => generated 1315 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:35.181723 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cf393fdc-a161-4fb5-9b9e-9e9fbbb4beba tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:35.185007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cf393fdc-a161-4fb5-9b9e-9e9fbbb4beba tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:35.197934 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-679011e9-dbea-481f-92a3-d4d6ab821a13 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:35.208342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:35.217355 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-679011e9-dbea-481f-92a3-d4d6ab821a13 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1477 microversion: 2.1 time: 0.650766 Oct 29 03:03:35.217779 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf393fdc-a161-4fb5-9b9e-9e9fbbb4beba tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:35.219414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf393fdc-a161-4fb5-9b9e-9e9fbbb4beba tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:35.220773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf393fdc-a161-4fb5-9b9e-9e9fbbb4beba tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:35.222369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf393fdc-a161-4fb5-9b9e-9e9fbbb4beba tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:35.224036 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf393fdc-a161-4fb5-9b9e-9e9fbbb4beba tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:35.224994 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf393fdc-a161-4fb5-9b9e-9e9fbbb4beba tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:35.229054 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1925/3684] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:34 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1477 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:35.252644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-de0609eb-c119-4138-9a74-266cde62f728 req-4805ccac-f92c-4cbf-8ab1-bbdd95a1a1bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "854853c8-400f-420a-9519-5d46be009afa", "tag": "6f8fd018-e6f9-4c6a-9469-f0e4bd8650db"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:35.284599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-de0609eb-c119-4138-9a74-266cde62f728 req-4805ccac-f92c-4cbf-8ab1-bbdd95a1a1bd service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:35.285988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-de0609eb-c119-4138-9a74-266cde62f728 req-4805ccac-f92c-4cbf-8ab1-bbdd95a1a1bd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:35.286994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-de0609eb-c119-4138-9a74-266cde62f728 req-4805ccac-f92c-4cbf-8ab1-bbdd95a1a1bd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:35.319791 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-de0609eb-c119-4138-9a74-266cde62f728 req-4805ccac-f92c-4cbf-8ab1-bbdd95a1a1bd service nova] Creating event network-changed:6f8fd018-e6f9-4c6a-9469-f0e4bd8650db for instance 854853c8-400f-420a-9519-5d46be009afa on n-h2-862967-2 Oct 29 03:03:35.332643 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-de0609eb-c119-4138-9a74-266cde62f728 req-4805ccac-f92c-4cbf-8ab1-bbdd95a1a1bd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097410 Oct 29 03:03:35.334394 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1926/3685] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:35.401164 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fff0cd1e-f9f2-47d0-953f-b420e6a79faf tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:35.405727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fff0cd1e-f9f2-47d0-953f-b420e6a79faf tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:35.420696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fff0cd1e-f9f2-47d0-953f-b420e6a79faf tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:35.421360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fff0cd1e-f9f2-47d0-953f-b420e6a79faf tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:35.424181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fff0cd1e-f9f2-47d0-953f-b420e6a79faf tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:35.426281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fff0cd1e-f9f2-47d0-953f-b420e6a79faf tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:35.430488 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fff0cd1e-f9f2-47d0-953f-b420e6a79faf tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:35.431706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fff0cd1e-f9f2-47d0-953f-b420e6a79faf tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:35.773653 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fff0cd1e-f9f2-47d0-953f-b420e6a79faf tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:35.813978 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fff0cd1e-f9f2-47d0-953f-b420e6a79faf tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa" status: 200 len: 1314 microversion: 2.1 time: 0.420431 Oct 29 03:03:35.818203 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1927/3686] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:35 2022] GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:35.951513 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cf393fdc-a161-4fb5-9b9e-9e9fbbb4beba tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:35.980029 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cf393fdc-a161-4fb5-9b9e-9e9fbbb4beba tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:35.984508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cf393fdc-a161-4fb5-9b9e-9e9fbbb4beba tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:35.988072 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cf393fdc-a161-4fb5-9b9e-9e9fbbb4beba tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1745 microversion: 2.20 time: 0.827632 Oct 29 03:03:35.989928 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1760/3687] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:35 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1745 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:36.197815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ed2c9ba4-76e5-4188-9afd-46bcfe2c53bd tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:36.198827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ed2c9ba4-76e5-4188-9afd-46bcfe2c53bd tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] [instance: 809e7629-f880-4155-a83b-4b2ca39bb335] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:36.208343 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed2c9ba4-76e5-4188-9afd-46bcfe2c53bd tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:36.209308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed2c9ba4-76e5-4188-9afd-46bcfe2c53bd tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:36.209918 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed2c9ba4-76e5-4188-9afd-46bcfe2c53bd tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:36.211044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed2c9ba4-76e5-4188-9afd-46bcfe2c53bd tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:36.211689 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed2c9ba4-76e5-4188-9afd-46bcfe2c53bd tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:36.212322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed2c9ba4-76e5-4188-9afd-46bcfe2c53bd tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:36.263647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2b9513f1-04df-45ce-b549-7d684681fbf2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:36.264989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2b9513f1-04df-45ce-b549-7d684681fbf2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:36.272713 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b9513f1-04df-45ce-b549-7d684681fbf2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:36.273527 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b9513f1-04df-45ce-b549-7d684681fbf2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:36.274148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b9513f1-04df-45ce-b549-7d684681fbf2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:36.275059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b9513f1-04df-45ce-b549-7d684681fbf2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:36.275874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b9513f1-04df-45ce-b549-7d684681fbf2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:36.276508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b9513f1-04df-45ce-b549-7d684681fbf2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:36.441062 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:36.508226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=8 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:36.740362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2b9513f1-04df-45ce-b549-7d684681fbf2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:36.767625 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2b9513f1-04df-45ce-b549-7d684681fbf2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1477 microversion: 2.1 time: 0.507571 Oct 29 03:03:36.769376 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1761/3688] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:36 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1477 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:03:36.851963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-da5a3018-74d2-4138-8acb-1dcabe6d1b63 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:36.852934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-da5a3018-74d2-4138-8acb-1dcabe6d1b63 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:36.866442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da5a3018-74d2-4138-8acb-1dcabe6d1b63 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:36.872268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da5a3018-74d2-4138-8acb-1dcabe6d1b63 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:36.873076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da5a3018-74d2-4138-8acb-1dcabe6d1b63 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:36.874054 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da5a3018-74d2-4138-8acb-1dcabe6d1b63 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:36.874694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da5a3018-74d2-4138-8acb-1dcabe6d1b63 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:36.875764 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da5a3018-74d2-4138-8acb-1dcabe6d1b63 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:37.404033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-da5a3018-74d2-4138-8acb-1dcabe6d1b63 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:37.414709 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-da5a3018-74d2-4138-8acb-1dcabe6d1b63 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa" status: 200 len: 1314 microversion: 2.1 time: 0.566296 Oct 29 03:03:37.416017 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1762/3689] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:36 2022] GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:03:37.423071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4d1da875-e37e-4152-94f0-75c5ed8d6f9c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:37.423902 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4d1da875-e37e-4152-94f0-75c5ed8d6f9c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:37.431679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d1da875-e37e-4152-94f0-75c5ed8d6f9c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:37.432435 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d1da875-e37e-4152-94f0-75c5ed8d6f9c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:37.433110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d1da875-e37e-4152-94f0-75c5ed8d6f9c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:37.434607 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d1da875-e37e-4152-94f0-75c5ed8d6f9c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:37.435233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d1da875-e37e-4152-94f0-75c5ed8d6f9c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:37.435814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d1da875-e37e-4152-94f0-75c5ed8d6f9c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:37.603017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ed2c9ba4-76e5-4188-9afd-46bcfe2c53bd tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3ea9c53c964d329774361a92615e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea1a01e8b644da38cabae74b087f805', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:37.612573 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ed2c9ba4-76e5-4188-9afd-46bcfe2c53bd tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] 10.222.0.46 "GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335" status: 200 len: 1504 microversion: 2.1 time: 1.421064 Oct 29 03:03:37.616841 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1928/3690] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:36 2022] GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335 => generated 1504 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:37.655856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-93741a74-b81c-4dcd-bff3-bac85b48d1da tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:37.656701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-93741a74-b81c-4dcd-bff3-bac85b48d1da tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] [instance: 809e7629-f880-4155-a83b-4b2ca39bb335] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:37.673799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93741a74-b81c-4dcd-bff3-bac85b48d1da tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:37.674504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93741a74-b81c-4dcd-bff3-bac85b48d1da tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:37.675749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93741a74-b81c-4dcd-bff3-bac85b48d1da tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:37.677695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93741a74-b81c-4dcd-bff3-bac85b48d1da tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:37.680008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93741a74-b81c-4dcd-bff3-bac85b48d1da tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:37.680683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93741a74-b81c-4dcd-bff3-bac85b48d1da tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:37.739722 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:37.787272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-93741a74-b81c-4dcd-bff3-bac85b48d1da tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'fb3ea9c53c964d329774361a92615e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea1a01e8b644da38cabae74b087f805', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:37.793075 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-93741a74-b81c-4dcd-bff3-bac85b48d1da tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] 10.222.0.46 "GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335/os-instance-actions/req-6d4a8374-41f9-4651-b9be-cfdc29273b81" status: 200 len: 313 microversion: 2.1 time: 0.140411 Oct 29 03:03:37.795094 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1929/3691] 10.222.0.46 () {58 vars in 1419 bytes} [Sat Oct 29 03:03:37 2022] GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335/os-instance-actions/req-6d4a8374-41f9-4651-b9be-cfdc29273b81 => generated 313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:37.823334 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b5650a1a-6cb1-4b08-a35a-05ca3995ae41 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:37.827489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b5650a1a-6cb1-4b08-a35a-05ca3995ae41 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:37.848756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=14 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:37.851768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5650a1a-6cb1-4b08-a35a-05ca3995ae41 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:37.852777 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5650a1a-6cb1-4b08-a35a-05ca3995ae41 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:37.854166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5650a1a-6cb1-4b08-a35a-05ca3995ae41 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:37.856008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5650a1a-6cb1-4b08-a35a-05ca3995ae41 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:37.856986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5650a1a-6cb1-4b08-a35a-05ca3995ae41 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:37.857856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5650a1a-6cb1-4b08-a35a-05ca3995ae41 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:38.299412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4d1da875-e37e-4152-94f0-75c5ed8d6f9c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:38.345880 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4d1da875-e37e-4152-94f0-75c5ed8d6f9c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:38.363597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4d1da875-e37e-4152-94f0-75c5ed8d6f9c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:38.365799 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4d1da875-e37e-4152-94f0-75c5ed8d6f9c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1740 microversion: 2.20 time: 0.947241 Oct 29 03:03:38.366756 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1763/3692] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:37 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1740 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:38.393692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6f0070d9-0c7a-4595-ba59-1489db4f8fa2 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:38.417284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6f0070d9-0c7a-4595-ba59-1489db4f8fa2 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] [instance: 809e7629-f880-4155-a83b-4b2ca39bb335] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:38.454457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f0070d9-0c7a-4595-ba59-1489db4f8fa2 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:38.455017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f0070d9-0c7a-4595-ba59-1489db4f8fa2 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:38.455705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f0070d9-0c7a-4595-ba59-1489db4f8fa2 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:38.465591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f0070d9-0c7a-4595-ba59-1489db4f8fa2 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:38.470843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f0070d9-0c7a-4595-ba59-1489db4f8fa2 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:38.476843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f0070d9-0c7a-4595-ba59-1489db4f8fa2 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:38.535567 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b5650a1a-6cb1-4b08-a35a-05ca3995ae41 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:38.565768 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b5650a1a-6cb1-4b08-a35a-05ca3995ae41 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1477 microversion: 2.1 time: 0.759794 Oct 29 03:03:38.566663 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1930/3693] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:37 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1477 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:38.576850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2c3031ee-32a5-43a2-8a0f-46aeb309b088 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:38.598302 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2c3031ee-32a5-43a2-8a0f-46aeb309b088 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:38.627745 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c3031ee-32a5-43a2-8a0f-46aeb309b088 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:38.628562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c3031ee-32a5-43a2-8a0f-46aeb309b088 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:38.639605 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c3031ee-32a5-43a2-8a0f-46aeb309b088 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:38.640198 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c3031ee-32a5-43a2-8a0f-46aeb309b088 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:38.650454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c3031ee-32a5-43a2-8a0f-46aeb309b088 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:38.651070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c3031ee-32a5-43a2-8a0f-46aeb309b088 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:38.875483 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6f0070d9-0c7a-4595-ba59-1489db4f8fa2 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] 10.222.0.46 "POST /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335/action" status: 202 len: 0 microversion: 2.1 time: 0.500783 Oct 29 03:03:38.888272 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1764/3694] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:03:38 2022] POST /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:03:38.916078 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a422f5a7-4f2f-429c-a69f-d0c230be793b tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:38.920245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a422f5a7-4f2f-429c-a69f-d0c230be793b tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] [instance: 809e7629-f880-4155-a83b-4b2ca39bb335] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:38.937944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a422f5a7-4f2f-429c-a69f-d0c230be793b tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:38.944247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a422f5a7-4f2f-429c-a69f-d0c230be793b tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:38.945051 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a422f5a7-4f2f-429c-a69f-d0c230be793b tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:38.946247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a422f5a7-4f2f-429c-a69f-d0c230be793b tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:38.947054 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a422f5a7-4f2f-429c-a69f-d0c230be793b tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:38.947939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a422f5a7-4f2f-429c-a69f-d0c230be793b tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:39.969645 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2c3031ee-32a5-43a2-8a0f-46aeb309b088 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:40.006481 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2c3031ee-32a5-43a2-8a0f-46aeb309b088 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa" status: 200 len: 1314 microversion: 2.1 time: 1.435285 Oct 29 03:03:40.011012 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1931/3695] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:38 2022] GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa => generated 1314 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:40.070860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4f8bce96-5e78-455f-a791-48397a77ab76 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:40.077392 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4f8bce96-5e78-455f-a791-48397a77ab76 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:40.101015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f8bce96-5e78-455f-a791-48397a77ab76 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:40.105967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f8bce96-5e78-455f-a791-48397a77ab76 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:40.106879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f8bce96-5e78-455f-a791-48397a77ab76 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:40.109746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f8bce96-5e78-455f-a791-48397a77ab76 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:40.110574 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f8bce96-5e78-455f-a791-48397a77ab76 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:40.116729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f8bce96-5e78-455f-a791-48397a77ab76 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:40.669013 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a422f5a7-4f2f-429c-a69f-d0c230be793b tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3ea9c53c964d329774361a92615e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea1a01e8b644da38cabae74b087f805', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:40.682464 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a422f5a7-4f2f-429c-a69f-d0c230be793b tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] 10.222.0.46 "GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335" status: 200 len: 1506 microversion: 2.1 time: 1.779593 Oct 29 03:03:40.692599 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1765/3696] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:38 2022] GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335 => generated 1506 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:40.700563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e42ca79c-4dd5-4c40-9336-136facc46bda tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:40.700563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e42ca79c-4dd5-4c40-9336-136facc46bda tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:40.716892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e42ca79c-4dd5-4c40-9336-136facc46bda tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:40.717166 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e42ca79c-4dd5-4c40-9336-136facc46bda tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:40.717550 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e42ca79c-4dd5-4c40-9336-136facc46bda tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:40.718131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e42ca79c-4dd5-4c40-9336-136facc46bda tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:40.719137 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e42ca79c-4dd5-4c40-9336-136facc46bda tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:40.719137 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e42ca79c-4dd5-4c40-9336-136facc46bda tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:41.108317 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e42ca79c-4dd5-4c40-9336-136facc46bda tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:41.126189 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e42ca79c-4dd5-4c40-9336-136facc46bda tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1477 microversion: 2.1 time: 0.441128 Oct 29 03:03:41.130207 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1766/3697] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:40 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1477 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:41.147574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-50ad2012-8c26-4259-a90e-57ffb5db6a1a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:41.157956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-50ad2012-8c26-4259-a90e-57ffb5db6a1a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:41.181958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50ad2012-8c26-4259-a90e-57ffb5db6a1a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:41.184245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50ad2012-8c26-4259-a90e-57ffb5db6a1a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:41.185990 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50ad2012-8c26-4259-a90e-57ffb5db6a1a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:41.186975 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50ad2012-8c26-4259-a90e-57ffb5db6a1a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:41.191445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50ad2012-8c26-4259-a90e-57ffb5db6a1a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:41.192118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50ad2012-8c26-4259-a90e-57ffb5db6a1a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:41.356821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4f8bce96-5e78-455f-a791-48397a77ab76 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:41.425813 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4f8bce96-5e78-455f-a791-48397a77ab76 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:41.440238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4f8bce96-5e78-455f-a791-48397a77ab76 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:41.449510 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4f8bce96-5e78-455f-a791-48397a77ab76 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1740 microversion: 2.20 time: 1.402871 Oct 29 03:03:41.451275 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1932/3698] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:40 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1740 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:41.727330 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-920ba4d6-690f-47f7-8998-1551dc630a8f tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:41.732740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-920ba4d6-690f-47f7-8998-1551dc630a8f tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] [instance: 809e7629-f880-4155-a83b-4b2ca39bb335] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:41.755537 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-920ba4d6-690f-47f7-8998-1551dc630a8f tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:41.759102 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-920ba4d6-690f-47f7-8998-1551dc630a8f tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:41.763774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-920ba4d6-690f-47f7-8998-1551dc630a8f tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:41.770228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-920ba4d6-690f-47f7-8998-1551dc630a8f tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:41.773071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-920ba4d6-690f-47f7-8998-1551dc630a8f tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:41.776508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-920ba4d6-690f-47f7-8998-1551dc630a8f tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:42.839692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-50ad2012-8c26-4259-a90e-57ffb5db6a1a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:42.864483 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-50ad2012-8c26-4259-a90e-57ffb5db6a1a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa" status: 200 len: 1314 microversion: 2.1 time: 1.732969 Oct 29 03:03:42.873349 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1767/3699] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:41 2022] GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa => generated 1314 bytes in 1743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:42.891777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-88ef1c35-9d98-465a-8eab-9f83a7e01bfe tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:42.892414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-88ef1c35-9d98-465a-8eab-9f83a7e01bfe tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:42.916641 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88ef1c35-9d98-465a-8eab-9f83a7e01bfe tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:42.928702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88ef1c35-9d98-465a-8eab-9f83a7e01bfe tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:42.929695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88ef1c35-9d98-465a-8eab-9f83a7e01bfe tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:42.930662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88ef1c35-9d98-465a-8eab-9f83a7e01bfe tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:42.935442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88ef1c35-9d98-465a-8eab-9f83a7e01bfe tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:42.939038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88ef1c35-9d98-465a-8eab-9f83a7e01bfe tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:43.648274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-88ef1c35-9d98-465a-8eab-9f83a7e01bfe tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:43.661897 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-88ef1c35-9d98-465a-8eab-9f83a7e01bfe tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1477 microversion: 2.1 time: 0.781546 Oct 29 03:03:43.668818 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1768/3700] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:42 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1477 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:43.698212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4adfb593-4b1d-4b97-a1ab-1b6b2fa40992 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:43.705085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4adfb593-4b1d-4b97-a1ab-1b6b2fa40992 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:43.741396 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4adfb593-4b1d-4b97-a1ab-1b6b2fa40992 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:43.749992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4adfb593-4b1d-4b97-a1ab-1b6b2fa40992 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:43.750683 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4adfb593-4b1d-4b97-a1ab-1b6b2fa40992 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:43.751615 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4adfb593-4b1d-4b97-a1ab-1b6b2fa40992 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:43.761502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4adfb593-4b1d-4b97-a1ab-1b6b2fa40992 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:43.762157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4adfb593-4b1d-4b97-a1ab-1b6b2fa40992 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:43.876998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-920ba4d6-690f-47f7-8998-1551dc630a8f tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3ea9c53c964d329774361a92615e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea1a01e8b644da38cabae74b087f805', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:43.905249 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-920ba4d6-690f-47f7-8998-1551dc630a8f tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] 10.222.0.46 "GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335" status: 200 len: 1506 microversion: 2.1 time: 2.183930 Oct 29 03:03:43.921461 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1933/3701] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:41 2022] GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335 => generated 1506 bytes in 2198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:43.954136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-9f396e5c-3db3-498e-9cef-d67e1e23e893 req-3b542495-b2e4-44ab-aaba-11aee6cae321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "354cb0c1-2737-486f-8e3b-d119c49a46a7", "name": "network-vif-plugged", "status": "completed", "tag": "0e820bc1-bfed-42bc-8698-d91dc009de10"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:43.982672 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9f396e5c-3db3-498e-9cef-d67e1e23e893 req-3b542495-b2e4-44ab-aaba-11aee6cae321 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:43.992207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9f396e5c-3db3-498e-9cef-d67e1e23e893 req-3b542495-b2e4-44ab-aaba-11aee6cae321 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:43.992893 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9f396e5c-3db3-498e-9cef-d67e1e23e893 req-3b542495-b2e4-44ab-aaba-11aee6cae321 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:44.008423 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-9f396e5c-3db3-498e-9cef-d67e1e23e893 req-3b542495-b2e4-44ab-aaba-11aee6cae321 service nova] Creating event network-vif-plugged:0e820bc1-bfed-42bc-8698-d91dc009de10 for instance 354cb0c1-2737-486f-8e3b-d119c49a46a7 on n-h1-862967-2 Oct 29 03:03:44.027348 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-9f396e5c-3db3-498e-9cef-d67e1e23e893 req-3b542495-b2e4-44ab-aaba-11aee6cae321 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103656 Oct 29 03:03:44.028786 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1934/3702] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:44.040655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-250d3fed-0b13-4648-9c67-dbfb850f3b52 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:44.043622 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-250d3fed-0b13-4648-9c67-dbfb850f3b52 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:44.067180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-250d3fed-0b13-4648-9c67-dbfb850f3b52 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:44.067774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-250d3fed-0b13-4648-9c67-dbfb850f3b52 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:44.068303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-250d3fed-0b13-4648-9c67-dbfb850f3b52 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:44.068861 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-250d3fed-0b13-4648-9c67-dbfb850f3b52 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:44.077794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-250d3fed-0b13-4648-9c67-dbfb850f3b52 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:44.084875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-250d3fed-0b13-4648-9c67-dbfb850f3b52 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:44.667141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4adfb593-4b1d-4b97-a1ab-1b6b2fa40992 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:44.695553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4adfb593-4b1d-4b97-a1ab-1b6b2fa40992 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:44.701743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4adfb593-4b1d-4b97-a1ab-1b6b2fa40992 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:44.703382 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4adfb593-4b1d-4b97-a1ab-1b6b2fa40992 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1740 microversion: 2.20 time: 1.032607 Oct 29 03:03:44.706936 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1769/3703] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:43 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1740 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:44.724467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-342ba39a-c432-4714-bf9b-ef723dd413cf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:44.726182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-342ba39a-c432-4714-bf9b-ef723dd413cf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:44.740971 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-342ba39a-c432-4714-bf9b-ef723dd413cf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:44.742016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-342ba39a-c432-4714-bf9b-ef723dd413cf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:44.745222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-342ba39a-c432-4714-bf9b-ef723dd413cf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:44.746963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-342ba39a-c432-4714-bf9b-ef723dd413cf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:44.753251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-342ba39a-c432-4714-bf9b-ef723dd413cf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:44.754581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-342ba39a-c432-4714-bf9b-ef723dd413cf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:45.389117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-250d3fed-0b13-4648-9c67-dbfb850f3b52 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:45.405331 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-250d3fed-0b13-4648-9c67-dbfb850f3b52 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa" status: 200 len: 1314 microversion: 2.1 time: 1.374861 Oct 29 03:03:45.410967 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1935/3704] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:44 2022] GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa => generated 1314 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:45.533839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-342ba39a-c432-4714-bf9b-ef723dd413cf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:45.560214 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-342ba39a-c432-4714-bf9b-ef723dd413cf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1477 microversion: 2.1 time: 0.839590 Oct 29 03:03:45.561219 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1770/3705] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:44 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1477 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:45.612035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b6ef0df6-f4ba-4342-8b8e-c320f24897cf tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:45.613442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b6ef0df6-f4ba-4342-8b8e-c320f24897cf tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] [instance: 809e7629-f880-4155-a83b-4b2ca39bb335] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:45.630448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6ef0df6-f4ba-4342-8b8e-c320f24897cf tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:45.631231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6ef0df6-f4ba-4342-8b8e-c320f24897cf tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:45.633267 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6ef0df6-f4ba-4342-8b8e-c320f24897cf tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:45.639575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6ef0df6-f4ba-4342-8b8e-c320f24897cf tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:45.640881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6ef0df6-f4ba-4342-8b8e-c320f24897cf tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:45.643822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6ef0df6-f4ba-4342-8b8e-c320f24897cf tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:46.240452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7898f8da-0811-482f-a205-00cd823160bf tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Action: 'create', calling method: .version_select at 0x7ff05c1a49d0>, body: {"keypair": {"name": "tempest-keypair-909379506", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEj6f7sjd4TqQXD1LZ218Z/bZRGfrp+HLijpI0uzpNyg3k0lccyw9eAHYP+8S2yrQd8J1MhseFEl+jjcxLZ75pAgl5UYey9pgeQQL9aue8GWfbkI119tLrWMKXwmF0gauA=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:46.302051 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-7898f8da-0811-482f-a205-00cd823160bf tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Getting quotas for project f49b29d96f38485d82d772bd7c2b07d2. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:03:46.330687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-7898f8da-0811-482f-a205-00cd823160bf tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Getting quotas for user 85efe9a35c8646ffadadc5a6bd9f0824 and project f49b29d96f38485d82d772bd7c2b07d2. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:03:46.417454 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7898f8da-0811-482f-a205-00cd823160bf tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.004521 Oct 29 03:03:46.429209 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1936/3706] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:03:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:46.444807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a2d56c10-45bb-4bd1-8782-5611ec451323 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:46.449240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a2d56c10-45bb-4bd1-8782-5611ec451323 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:46.475124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2d56c10-45bb-4bd1-8782-5611ec451323 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:46.480409 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2d56c10-45bb-4bd1-8782-5611ec451323 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:46.481401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2d56c10-45bb-4bd1-8782-5611ec451323 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:46.482566 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2d56c10-45bb-4bd1-8782-5611ec451323 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:46.483263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2d56c10-45bb-4bd1-8782-5611ec451323 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:46.485037 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2d56c10-45bb-4bd1-8782-5611ec451323 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:46.800159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b6ef0df6-f4ba-4342-8b8e-c320f24897cf tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3ea9c53c964d329774361a92615e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea1a01e8b644da38cabae74b087f805', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:46.816564 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b6ef0df6-f4ba-4342-8b8e-c320f24897cf tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] 10.222.0.46 "GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335" status: 200 len: 1504 microversion: 2.1 time: 1.253607 Oct 29 03:03:46.833149 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1771/3707] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:45 2022] GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335 => generated 1504 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:46.857556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-6c362673-bebb-4b55-815a-6fd72b117519 req-3f4b4e96-46aa-4a27-a28a-28f339f48b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "854853c8-400f-420a-9519-5d46be009afa", "name": "network-vif-plugged", "status": "completed", "tag": "6f8fd018-e6f9-4c6a-9469-f0e4bd8650db"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:46.889117 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6c362673-bebb-4b55-815a-6fd72b117519 req-3f4b4e96-46aa-4a27-a28a-28f339f48b3d service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:46.889881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6c362673-bebb-4b55-815a-6fd72b117519 req-3f4b4e96-46aa-4a27-a28a-28f339f48b3d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:46.890543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6c362673-bebb-4b55-815a-6fd72b117519 req-3f4b4e96-46aa-4a27-a28a-28f339f48b3d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:46.918706 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-6c362673-bebb-4b55-815a-6fd72b117519 req-3f4b4e96-46aa-4a27-a28a-28f339f48b3d service nova] Creating event network-vif-plugged:6f8fd018-e6f9-4c6a-9469-f0e4bd8650db for instance 854853c8-400f-420a-9519-5d46be009afa on n-h2-862967-2 Oct 29 03:03:46.931003 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-6c362673-bebb-4b55-815a-6fd72b117519 req-3f4b4e96-46aa-4a27-a28a-28f339f48b3d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096098 Oct 29 03:03:46.936048 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1772/3708] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:46.951387 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-07720b09-8494-4ddf-883e-c0b94d4e1895 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:46.955138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-07720b09-8494-4ddf-883e-c0b94d4e1895 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:46.973976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07720b09-8494-4ddf-883e-c0b94d4e1895 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:46.985795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07720b09-8494-4ddf-883e-c0b94d4e1895 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:46.989038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07720b09-8494-4ddf-883e-c0b94d4e1895 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:46.991698 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07720b09-8494-4ddf-883e-c0b94d4e1895 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:46.996579 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07720b09-8494-4ddf-883e-c0b94d4e1895 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:46.999472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07720b09-8494-4ddf-883e-c0b94d4e1895 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:47.121058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a2d56c10-45bb-4bd1-8782-5611ec451323 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:47.140363 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a2d56c10-45bb-4bd1-8782-5611ec451323 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:47.149868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a2d56c10-45bb-4bd1-8782-5611ec451323 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:47.155373 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a2d56c10-45bb-4bd1-8782-5611ec451323 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1740 microversion: 2.20 time: 0.723583 Oct 29 03:03:47.157645 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1937/3709] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:46 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1740 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:47.206971 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ebf5ca4d-608a-43a4-b512-bb14a66cc732 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:47.210937 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ebf5ca4d-608a-43a4-b512-bb14a66cc732 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:47.251028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebf5ca4d-608a-43a4-b512-bb14a66cc732 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:47.252355 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebf5ca4d-608a-43a4-b512-bb14a66cc732 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:47.253205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebf5ca4d-608a-43a4-b512-bb14a66cc732 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:47.268066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebf5ca4d-608a-43a4-b512-bb14a66cc732 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:47.269176 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebf5ca4d-608a-43a4-b512-bb14a66cc732 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:47.269970 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebf5ca4d-608a-43a4-b512-bb14a66cc732 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:47.813974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ebf5ca4d-608a-43a4-b512-bb14a66cc732 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:47.836581 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ebf5ca4d-608a-43a4-b512-bb14a66cc732 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1477 microversion: 2.1 time: 0.663044 Oct 29 03:03:47.840404 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1938/3710] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:47 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1477 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:47.861968 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-724034c7-c345-411c-9ba1-2890ed7afa80 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Calling method '.version_select at 0x7ff05809a550>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:47.863616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-724034c7-c345-411c-9ba1-2890ed7afa80 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] [instance: 809e7629-f880-4155-a83b-4b2ca39bb335] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:47.881219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:47.884893 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-724034c7-c345-411c-9ba1-2890ed7afa80 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:47.891887 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-724034c7-c345-411c-9ba1-2890ed7afa80 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:47.893039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-724034c7-c345-411c-9ba1-2890ed7afa80 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:47.894303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-724034c7-c345-411c-9ba1-2890ed7afa80 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:47.896731 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-724034c7-c345-411c-9ba1-2890ed7afa80 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:47.899432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-724034c7-c345-411c-9ba1-2890ed7afa80 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:48.025786 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-724034c7-c345-411c-9ba1-2890ed7afa80 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] 10.222.0.46 "GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.183139 Oct 29 03:03:48.027956 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1939/3711] 10.222.0.46 () {58 vars in 1296 bytes} [Sat Oct 29 03:03:47 2022] GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335/os-instance-actions => generated 611 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:48.087786 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cd40a481-be55-48d7-8e65-c7b5b9fdf5a1 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:48.092940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cd40a481-be55-48d7-8e65-c7b5b9fdf5a1 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] [instance: 809e7629-f880-4155-a83b-4b2ca39bb335] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:48.162872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd40a481-be55-48d7-8e65-c7b5b9fdf5a1 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:48.168899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd40a481-be55-48d7-8e65-c7b5b9fdf5a1 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:48.170748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd40a481-be55-48d7-8e65-c7b5b9fdf5a1 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:48.178261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd40a481-be55-48d7-8e65-c7b5b9fdf5a1 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:48.183059 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd40a481-be55-48d7-8e65-c7b5b9fdf5a1 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:48.189246 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd40a481-be55-48d7-8e65-c7b5b9fdf5a1 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:48.315530 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cd40a481-be55-48d7-8e65-c7b5b9fdf5a1 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] [instance: 809e7629-f880-4155-a83b-4b2ca39bb335] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:03:48.503446 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cd40a481-be55-48d7-8e65-c7b5b9fdf5a1 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] 10.222.0.46 "DELETE /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335" status: 204 len: 0 microversion: 2.1 time: 0.447666 Oct 29 03:03:48.509299 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1940/3712] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:03:48 2022] DELETE /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:03:48.524237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4e57beba-0bb2-4b4b-93f8-0cca57959f77 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:48.529993 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4e57beba-0bb2-4b4b-93f8-0cca57959f77 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:48.546020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e57beba-0bb2-4b4b-93f8-0cca57959f77 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:48.548905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e57beba-0bb2-4b4b-93f8-0cca57959f77 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:48.550187 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e57beba-0bb2-4b4b-93f8-0cca57959f77 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:48.551704 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e57beba-0bb2-4b4b-93f8-0cca57959f77 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:48.554162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e57beba-0bb2-4b4b-93f8-0cca57959f77 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:48.554868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e57beba-0bb2-4b4b-93f8-0cca57959f77 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:48.574353 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-07720b09-8494-4ddf-883e-c0b94d4e1895 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:48.606372 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-07720b09-8494-4ddf-883e-c0b94d4e1895 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa" status: 200 len: 1314 microversion: 2.1 time: 1.664995 Oct 29 03:03:48.607042 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1773/3713] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:46 2022] GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa => generated 1314 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:48.643804 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9cb29c3f-0184-458f-9d04-28086b52dc16 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:48.648670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9cb29c3f-0184-458f-9d04-28086b52dc16 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] [instance: 809e7629-f880-4155-a83b-4b2ca39bb335] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:48.673546 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cb29c3f-0184-458f-9d04-28086b52dc16 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:48.692930 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cb29c3f-0184-458f-9d04-28086b52dc16 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:48.697973 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cb29c3f-0184-458f-9d04-28086b52dc16 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:48.699261 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cb29c3f-0184-458f-9d04-28086b52dc16 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:48.699909 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cb29c3f-0184-458f-9d04-28086b52dc16 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:48.700463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cb29c3f-0184-458f-9d04-28086b52dc16 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:49.265520 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4e57beba-0bb2-4b4b-93f8-0cca57959f77 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:49.289821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4e57beba-0bb2-4b4b-93f8-0cca57959f77 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:49.301745 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4e57beba-0bb2-4b4b-93f8-0cca57959f77 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:49.304427 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4e57beba-0bb2-4b4b-93f8-0cca57959f77 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1740 microversion: 2.20 time: 0.792347 Oct 29 03:03:49.310927 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1941/3714] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:48 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1740 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:49.326016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9d6a55e7-2f20-4512-8635-64e28c1b1c23 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:49.333102 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9d6a55e7-2f20-4512-8635-64e28c1b1c23 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:49.356188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d6a55e7-2f20-4512-8635-64e28c1b1c23 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:49.359125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d6a55e7-2f20-4512-8635-64e28c1b1c23 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:49.365480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d6a55e7-2f20-4512-8635-64e28c1b1c23 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:49.367291 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d6a55e7-2f20-4512-8635-64e28c1b1c23 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:49.374777 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d6a55e7-2f20-4512-8635-64e28c1b1c23 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:49.375987 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d6a55e7-2f20-4512-8635-64e28c1b1c23 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:49.427013 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9cb29c3f-0184-458f-9d04-28086b52dc16 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3ea9c53c964d329774361a92615e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea1a01e8b644da38cabae74b087f805', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:49.447579 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9cb29c3f-0184-458f-9d04-28086b52dc16 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] 10.222.0.46 "GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335" status: 200 len: 1510 microversion: 2.1 time: 0.835132 Oct 29 03:03:49.450452 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1774/3715] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:48 2022] GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335 => generated 1510 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:49.632513 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-58042b55-01b6-4f7f-8384-89e2ed3662b3 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:49.633986 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-58042b55-01b6-4f7f-8384-89e2ed3662b3 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:49.645457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58042b55-01b6-4f7f-8384-89e2ed3662b3 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:49.656025 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58042b55-01b6-4f7f-8384-89e2ed3662b3 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:49.656999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58042b55-01b6-4f7f-8384-89e2ed3662b3 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:49.658359 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58042b55-01b6-4f7f-8384-89e2ed3662b3 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:49.662018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58042b55-01b6-4f7f-8384-89e2ed3662b3 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:49.670444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58042b55-01b6-4f7f-8384-89e2ed3662b3 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:49.694432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:50.664557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9d6a55e7-2f20-4512-8635-64e28c1b1c23 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:50.673180 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9d6a55e7-2f20-4512-8635-64e28c1b1c23 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1477 microversion: 2.1 time: 1.359907 Oct 29 03:03:50.678375 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1942/3716] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:49 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1477 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:50.684602 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f3c1f75f-5937-4544-be32-21d0ddb7f221 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:50.685517 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f3c1f75f-5937-4544-be32-21d0ddb7f221 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:50.692489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3c1f75f-5937-4544-be32-21d0ddb7f221 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:50.693373 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3c1f75f-5937-4544-be32-21d0ddb7f221 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:50.694001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3c1f75f-5937-4544-be32-21d0ddb7f221 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:50.695042 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3c1f75f-5937-4544-be32-21d0ddb7f221 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:50.695691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3c1f75f-5937-4544-be32-21d0ddb7f221 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:50.696301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3c1f75f-5937-4544-be32-21d0ddb7f221 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:50.933852 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-58042b55-01b6-4f7f-8384-89e2ed3662b3 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:50.996142 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-58042b55-01b6-4f7f-8384-89e2ed3662b3 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa" status: 200 len: 1314 microversion: 2.1 time: 1.367872 Oct 29 03:03:51.006933 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1775/3717] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:49 2022] GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa => generated 1314 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:03:51.052583 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-83c4f0c4-584a-405d-8f57-f7176d3de896 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:51.099348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-83c4f0c4-584a-405d-8f57-f7176d3de896 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] [instance: 809e7629-f880-4155-a83b-4b2ca39bb335] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:51.132269 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83c4f0c4-584a-405d-8f57-f7176d3de896 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:51.133399 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83c4f0c4-584a-405d-8f57-f7176d3de896 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:51.134461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83c4f0c4-584a-405d-8f57-f7176d3de896 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:51.139967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83c4f0c4-584a-405d-8f57-f7176d3de896 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:51.141314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83c4f0c4-584a-405d-8f57-f7176d3de896 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:51.148029 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83c4f0c4-584a-405d-8f57-f7176d3de896 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:51.633454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-83c4f0c4-584a-405d-8f57-f7176d3de896 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3ea9c53c964d329774361a92615e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea1a01e8b644da38cabae74b087f805', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:51.656215 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-83c4f0c4-584a-405d-8f57-f7176d3de896 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] 10.222.0.46 "GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335" status: 200 len: 1510 microversion: 2.1 time: 0.635798 Oct 29 03:03:51.677280 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1776/3718] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:51 2022] GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335 => generated 1510 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:51.705622 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-98f4c1b0-b633-4964-ba55-0835e6640c24 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:51.707635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-98f4c1b0-b633-4964-ba55-0835e6640c24 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:51.730471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98f4c1b0-b633-4964-ba55-0835e6640c24 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:51.738152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98f4c1b0-b633-4964-ba55-0835e6640c24 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:51.739901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98f4c1b0-b633-4964-ba55-0835e6640c24 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:51.741094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98f4c1b0-b633-4964-ba55-0835e6640c24 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:51.741977 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98f4c1b0-b633-4964-ba55-0835e6640c24 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:51.742730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98f4c1b0-b633-4964-ba55-0835e6640c24 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:51.928935 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f3c1f75f-5937-4544-be32-21d0ddb7f221 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:51.973889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f3c1f75f-5937-4544-be32-21d0ddb7f221 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:51.977756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f3c1f75f-5937-4544-be32-21d0ddb7f221 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:51.980982 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f3c1f75f-5937-4544-be32-21d0ddb7f221 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1740 microversion: 2.20 time: 1.301215 Oct 29 03:03:51.997365 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1943/3719] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:50 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1740 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:52.038760 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1b054e6f-5eb2-4a5d-ab18-d97d5899e910 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:52.039860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1b054e6f-5eb2-4a5d-ab18-d97d5899e910 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:52.063123 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b054e6f-5eb2-4a5d-ab18-d97d5899e910 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:52.065135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b054e6f-5eb2-4a5d-ab18-d97d5899e910 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:52.065822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b054e6f-5eb2-4a5d-ab18-d97d5899e910 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:52.071649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b054e6f-5eb2-4a5d-ab18-d97d5899e910 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:52.072683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b054e6f-5eb2-4a5d-ab18-d97d5899e910 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:52.073553 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b054e6f-5eb2-4a5d-ab18-d97d5899e910 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:52.478851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-98f4c1b0-b633-4964-ba55-0835e6640c24 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:52.507161 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-98f4c1b0-b633-4964-ba55-0835e6640c24 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1476 microversion: 2.1 time: 0.804377 Oct 29 03:03:52.528689 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1777/3720] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:51 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1476 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:52.728614 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4ef4c02a-1ddb-452f-b887-4bdea53931e8 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:52.729748 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4ef4c02a-1ddb-452f-b887-4bdea53931e8 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] [instance: 809e7629-f880-4155-a83b-4b2ca39bb335] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:52.785639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ef4c02a-1ddb-452f-b887-4bdea53931e8 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:52.795821 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ef4c02a-1ddb-452f-b887-4bdea53931e8 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:52.799902 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ef4c02a-1ddb-452f-b887-4bdea53931e8 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:52.807121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ef4c02a-1ddb-452f-b887-4bdea53931e8 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:52.809939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ef4c02a-1ddb-452f-b887-4bdea53931e8 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:52.815245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ef4c02a-1ddb-452f-b887-4bdea53931e8 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:53.684844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4ef4c02a-1ddb-452f-b887-4bdea53931e8 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb3ea9c53c964d329774361a92615e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea1a01e8b644da38cabae74b087f805', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:53.726786 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4ef4c02a-1ddb-452f-b887-4bdea53931e8 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] 10.222.0.46 "GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335" status: 200 len: 1510 microversion: 2.1 time: 1.005733 Oct 29 03:03:53.758709 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1778/3721] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:52 2022] GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335 => generated 1510 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:03:53.778603 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4cdc1f1d-c2fb-474b-89f1-58192010e151 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:53.779828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4cdc1f1d-c2fb-474b-89f1-58192010e151 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:53.793974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cdc1f1d-c2fb-474b-89f1-58192010e151 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:53.795413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cdc1f1d-c2fb-474b-89f1-58192010e151 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:53.796617 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cdc1f1d-c2fb-474b-89f1-58192010e151 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:53.798299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cdc1f1d-c2fb-474b-89f1-58192010e151 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:53.799736 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cdc1f1d-c2fb-474b-89f1-58192010e151 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:53.800920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cdc1f1d-c2fb-474b-89f1-58192010e151 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:54.354852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1b054e6f-5eb2-4a5d-ab18-d97d5899e910 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:54.396154 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1b054e6f-5eb2-4a5d-ab18-d97d5899e910 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa" status: 200 len: 1499 microversion: 2.1 time: 2.363828 Oct 29 03:03:54.399583 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1944/3722] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:52 2022] GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa => generated 1499 bytes in 2368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:54.413978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c54d0cff-10e0-4a7e-a0d9-d70d2f545286 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:54.416012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c54d0cff-10e0-4a7e-a0d9-d70d2f545286 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:54.473175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c54d0cff-10e0-4a7e-a0d9-d70d2f545286 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:54.474642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c54d0cff-10e0-4a7e-a0d9-d70d2f545286 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:54.482748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c54d0cff-10e0-4a7e-a0d9-d70d2f545286 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:54.485042 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c54d0cff-10e0-4a7e-a0d9-d70d2f545286 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:54.488583 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c54d0cff-10e0-4a7e-a0d9-d70d2f545286 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:54.493375 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c54d0cff-10e0-4a7e-a0d9-d70d2f545286 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:54.893982 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4cdc1f1d-c2fb-474b-89f1-58192010e151 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:54.924800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4cdc1f1d-c2fb-474b-89f1-58192010e151 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:54.927491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4cdc1f1d-c2fb-474b-89f1-58192010e151 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:54.941200 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4cdc1f1d-c2fb-474b-89f1-58192010e151 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1740 microversion: 2.20 time: 1.180215 Oct 29 03:03:54.953125 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1779/3723] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:53 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1740 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:54.963637 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-57377a6a-e125-429c-a8ed-6b8c97077762 req-2118d316-ab6c-4798-8a33-9b101b58587a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4953b8e-b647-4491-b532-3476e7837ab2", "name": "network-vif-unplugged", "status": "completed", "tag": "898db35a-9988-48ff-8d18-1d616cacb84b"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:55.012318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-57377a6a-e125-429c-a8ed-6b8c97077762 req-2118d316-ab6c-4798-8a33-9b101b58587a service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:55.013185 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-57377a6a-e125-429c-a8ed-6b8c97077762 req-2118d316-ab6c-4798-8a33-9b101b58587a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:55.013874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-57377a6a-e125-429c-a8ed-6b8c97077762 req-2118d316-ab6c-4798-8a33-9b101b58587a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:55.050378 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-57377a6a-e125-429c-a8ed-6b8c97077762 req-2118d316-ab6c-4798-8a33-9b101b58587a service nova] Creating event network-vif-unplugged:898db35a-9988-48ff-8d18-1d616cacb84b for instance c4953b8e-b647-4491-b532-3476e7837ab2 on n-h1-862967-2 Oct 29 03:03:55.101489 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [req-57377a6a-e125-429c-a8ed-6b8c97077762 req-2118d316-ab6c-4798-8a33-9b101b58587a service nova] Instance c4953b8e-b647-4491-b532-3476e7837ab2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:03:55.155527 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-57377a6a-e125-429c-a8ed-6b8c97077762 req-2118d316-ab6c-4798-8a33-9b101b58587a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.194997 Oct 29 03:03:55.161092 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1780/3724] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:55.178310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-bbbaeec2-35cc-43de-a9c2-371c899ac552 req-81a9380f-4e5b-498b-8c92-c16a26dee19c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "809e7629-f880-4155-a83b-4b2ca39bb335", "name": "network-vif-deleted", "tag": "41b55bef-60ac-4cc5-80bc-83ddf33b9004"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:55.232356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-bbbaeec2-35cc-43de-a9c2-371c899ac552 req-81a9380f-4e5b-498b-8c92-c16a26dee19c service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:55.243516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-bbbaeec2-35cc-43de-a9c2-371c899ac552 req-81a9380f-4e5b-498b-8c92-c16a26dee19c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:55.244981 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-bbbaeec2-35cc-43de-a9c2-371c899ac552 req-81a9380f-4e5b-498b-8c92-c16a26dee19c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:55.339533 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-bbbaeec2-35cc-43de-a9c2-371c899ac552 req-81a9380f-4e5b-498b-8c92-c16a26dee19c service nova] Creating event network-vif-deleted:41b55bef-60ac-4cc5-80bc-83ddf33b9004 for instance 809e7629-f880-4155-a83b-4b2ca39bb335 on n-h1-862967-2 Oct 29 03:03:55.373304 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-bbbaeec2-35cc-43de-a9c2-371c899ac552 req-81a9380f-4e5b-498b-8c92-c16a26dee19c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204086 Oct 29 03:03:55.379454 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1781/3725] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:55.421298 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d8b79035-40b0-4296-9cbb-50ee889bf451 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:55.432957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d8b79035-40b0-4296-9cbb-50ee889bf451 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:55.466854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c54d0cff-10e0-4a7e-a0d9-d70d2f545286 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:55.469853 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8b79035-40b0-4296-9cbb-50ee889bf451 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:55.474906 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8b79035-40b0-4296-9cbb-50ee889bf451 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:55.475990 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8b79035-40b0-4296-9cbb-50ee889bf451 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:55.477538 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8b79035-40b0-4296-9cbb-50ee889bf451 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:55.481596 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c54d0cff-10e0-4a7e-a0d9-d70d2f545286 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1476 microversion: 2.1 time: 1.080396 Oct 29 03:03:55.482216 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1945/3726] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:54 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1476 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:55.500288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dd472fdb-7460-44cc-895e-39a87fccb646 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:55.502746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dd472fdb-7460-44cc-895e-39a87fccb646 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] [instance: 809e7629-f880-4155-a83b-4b2ca39bb335] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:55.510488 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8b79035-40b0-4296-9cbb-50ee889bf451 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:55.513384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8b79035-40b0-4296-9cbb-50ee889bf451 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:55.529570 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd472fdb-7460-44cc-895e-39a87fccb646 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:55.537769 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd472fdb-7460-44cc-895e-39a87fccb646 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:55.541113 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd472fdb-7460-44cc-895e-39a87fccb646 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:55.542000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd472fdb-7460-44cc-895e-39a87fccb646 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:55.542575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd472fdb-7460-44cc-895e-39a87fccb646 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:55.542900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd472fdb-7460-44cc-895e-39a87fccb646 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:55.582583 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:55.627865 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-dd472fdb-7460-44cc-895e-39a87fccb646 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] HTTP exception thrown: Instance 809e7629-f880-4155-a83b-4b2ca39bb335 could not be found. Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dd472fdb-7460-44cc-895e-39a87fccb646 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Request method failure captured: Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335 HTTP/1.1 Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJfw0_TueFi1uylfDu42E_r65-ohZxmV5jnJQZqGPF74WUnM3GoXz4Tahuo3ESWQB7R9b3hyfkZ9c3WiKasa8uztsuFcu9z9y7pkxmFgg3xJ9wdPs-wlcJMn4aUTbC1UJ6llz7sIkCbJpnk4SRTPsEEQsbaN4d73ZjEZvSRsNL074ck Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: dea1a01e8b644da38cabae74b087f805 Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-InstanceActionsTestJSON-1125336275 Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dea1a01e8b644da38cabae74b087f805"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/dea1a01e8b644da38cabae74b087f805"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_dea1a01e8b644da38cabae74b087f805"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/dea1a01e8b644da38cabae74b087f805"}]}] Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-InstanceActionsTestJSON-1125336275 Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: dea1a01e8b644da38cabae74b087f805 Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1125336275 Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-InstanceActionsTestJSON-1125336275-project Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: fb3ea9c53c964d329774361a92615e78 Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-InstanceActionsTestJSON-1125336275-project Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 809e7629-f880-4155-a83b-4b2ca39bb335 could not be found. Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '809e7629-f880-4155-a83b-4b2ca39bb335'} Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 809e7629-f880-4155-a83b-4b2ca39bb335 could not be found. Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 809e7629-f880-4155-a83b-4b2ca39bb335 could not be found. Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:03:55.646357 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:03:55.651326 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:03:55.651326 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:03:55.651326 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:03:55.651326 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:03:55.651326 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:03:55.651326 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 809e7629-f880-4155-a83b-4b2ca39bb335 could not be found. Oct 29 03:03:55.651326 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:03:55.661926 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dd472fdb-7460-44cc-895e-39a87fccb646 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] Returning 404 to user: Instance 809e7629-f880-4155-a83b-4b2ca39bb335 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:03:55.665554 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dd472fdb-7460-44cc-895e-39a87fccb646 tempest-InstanceActionsTestJSON-1125336275 tempest-InstanceActionsTestJSON-1125336275-project] 10.222.0.46 "GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335" status: 404 len: 111 microversion: 2.1 time: 0.180015 Oct 29 03:03:55.673957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-d8b79035-40b0-4296-9cbb-50ee889bf451 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lazy-loading 'flavor' on Instance uuid 854853c8-400f-420a-9519-5d46be009afa {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:03:55.674582 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1946/3727] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:55 2022] GET /compute/v2.1/servers/809e7629-f880-4155-a83b-4b2ca39bb335 => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:03:55.924652 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d8b79035-40b0-4296-9cbb-50ee889bf451 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "POST /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa/action" status: 200 len: 32 microversion: 2.1 time: 0.542989 Oct 29 03:03:55.940801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c86b6dcf-c5f5-4139-840d-7cb969726da1 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:55.941439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c86b6dcf-c5f5-4139-840d-7cb969726da1 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:55.947447 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1782/3728] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:03:55 2022] POST /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa/action => generated 32 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:03:55.962457 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c86b6dcf-c5f5-4139-840d-7cb969726da1 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:55.965142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c86b6dcf-c5f5-4139-840d-7cb969726da1 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:55.967283 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c86b6dcf-c5f5-4139-840d-7cb969726da1 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:55.970822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c86b6dcf-c5f5-4139-840d-7cb969726da1 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:55.971703 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c86b6dcf-c5f5-4139-840d-7cb969726da1 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:55.972152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c86b6dcf-c5f5-4139-840d-7cb969726da1 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:55.999242 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-298203ef-2806-4fa9-89aa-10519a934f08 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:56.000350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-298203ef-2806-4fa9-89aa-10519a934f08 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:56.013121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-298203ef-2806-4fa9-89aa-10519a934f08 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:56.019172 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-298203ef-2806-4fa9-89aa-10519a934f08 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:56.035521 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-298203ef-2806-4fa9-89aa-10519a934f08 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:56.041105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-298203ef-2806-4fa9-89aa-10519a934f08 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:56.041782 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-298203ef-2806-4fa9-89aa-10519a934f08 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:56.042378 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-298203ef-2806-4fa9-89aa-10519a934f08 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:56.355815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:56.676377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c86b6dcf-c5f5-4139-840d-7cb969726da1 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:56.688892 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c86b6dcf-c5f5-4139-840d-7cb969726da1 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa" status: 200 len: 1505 microversion: 2.1 time: 0.757770 Oct 29 03:03:56.712091 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1947/3729] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:55 2022] GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa => generated 1505 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:56.719855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-73faff9a-9a68-4db5-9c8c-0a769b14d164 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:56.720477 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-73faff9a-9a68-4db5-9c8c-0a769b14d164 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:56.739054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73faff9a-9a68-4db5-9c8c-0a769b14d164 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:56.741601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73faff9a-9a68-4db5-9c8c-0a769b14d164 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:56.742086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73faff9a-9a68-4db5-9c8c-0a769b14d164 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:56.743888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73faff9a-9a68-4db5-9c8c-0a769b14d164 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:56.744374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73faff9a-9a68-4db5-9c8c-0a769b14d164 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:56.744856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73faff9a-9a68-4db5-9c8c-0a769b14d164 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:57.376561 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-298203ef-2806-4fa9-89aa-10519a934f08 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:57.389538 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-298203ef-2806-4fa9-89aa-10519a934f08 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:57.393581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-298203ef-2806-4fa9-89aa-10519a934f08 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:57.396373 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-298203ef-2806-4fa9-89aa-10519a934f08 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1740 microversion: 2.20 time: 1.401369 Oct 29 03:03:57.399852 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1783/3730] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:55 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1740 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:03:57.474187 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-356699ed-8bf4-4581-a5c8-b52d44c6cc63 req-07b92808-0944-4278-8137-3a1b0af70799 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4953b8e-b647-4491-b532-3476e7837ab2", "tag": "898db35a-9988-48ff-8d18-1d616cacb84b"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:03:57.493561 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-356699ed-8bf4-4581-a5c8-b52d44c6cc63 req-07b92808-0944-4278-8137-3a1b0af70799 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:57.494494 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-356699ed-8bf4-4581-a5c8-b52d44c6cc63 req-07b92808-0944-4278-8137-3a1b0af70799 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:57.496047 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-356699ed-8bf4-4581-a5c8-b52d44c6cc63 req-07b92808-0944-4278-8137-3a1b0af70799 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:57.517314 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-356699ed-8bf4-4581-a5c8-b52d44c6cc63 req-07b92808-0944-4278-8137-3a1b0af70799 service nova] Creating event network-changed:898db35a-9988-48ff-8d18-1d616cacb84b for instance c4953b8e-b647-4491-b532-3476e7837ab2 on n-h1-862967-2 Oct 29 03:03:57.524101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [req-356699ed-8bf4-4581-a5c8-b52d44c6cc63 req-07b92808-0944-4278-8137-3a1b0af70799 service nova] Instance c4953b8e-b647-4491-b532-3476e7837ab2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:03:57.539347 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-356699ed-8bf4-4581-a5c8-b52d44c6cc63 req-07b92808-0944-4278-8137-3a1b0af70799 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070177 Oct 29 03:03:57.541427 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1784/3731] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:03:57.721474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7e1e3e32-05a1-4909-87cf-88e314ce8458 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:57.722477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7e1e3e32-05a1-4909-87cf-88e314ce8458 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:57.735063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e1e3e32-05a1-4909-87cf-88e314ce8458 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:57.737348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e1e3e32-05a1-4909-87cf-88e314ce8458 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:57.739464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e1e3e32-05a1-4909-87cf-88e314ce8458 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:57.743875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e1e3e32-05a1-4909-87cf-88e314ce8458 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:57.744599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e1e3e32-05a1-4909-87cf-88e314ce8458 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:57.745246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e1e3e32-05a1-4909-87cf-88e314ce8458 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:57.961213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-73faff9a-9a68-4db5-9c8c-0a769b14d164 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:57.970838 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-73faff9a-9a68-4db5-9c8c-0a769b14d164 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1476 microversion: 2.1 time: 1.257604 Oct 29 03:03:57.996577 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1948/3732] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:56 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1476 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:58.189038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7e1e3e32-05a1-4909-87cf-88e314ce8458 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:58.205932 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7e1e3e32-05a1-4909-87cf-88e314ce8458 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa" status: 200 len: 1505 microversion: 2.1 time: 0.488922 Oct 29 03:03:58.207973 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1785/3733] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:57 2022] GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa => generated 1505 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:03:58.429038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c9bf0a52-30b9-484b-8436-f263834a4154 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:58.429838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c9bf0a52-30b9-484b-8436-f263834a4154 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:58.449148 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9bf0a52-30b9-484b-8436-f263834a4154 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:58.457751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9bf0a52-30b9-484b-8436-f263834a4154 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:58.457751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9bf0a52-30b9-484b-8436-f263834a4154 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:58.458760 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9bf0a52-30b9-484b-8436-f263834a4154 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:58.459247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9bf0a52-30b9-484b-8436-f263834a4154 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:58.459959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9bf0a52-30b9-484b-8436-f263834a4154 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:58.976192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c9bf0a52-30b9-484b-8436-f263834a4154 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:58.995159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c9bf0a52-30b9-484b-8436-f263834a4154 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:58.997521 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c9bf0a52-30b9-484b-8436-f263834a4154 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:59.004999 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c9bf0a52-30b9-484b-8436-f263834a4154 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1740 microversion: 2.20 time: 0.581142 Oct 29 03:03:59.011867 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1949/3734] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:03:58 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1740 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:03:59.048292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-96475e9f-36c3-4e0f-b081-2f96f8afb460 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:59.049420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-96475e9f-36c3-4e0f-b081-2f96f8afb460 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:59.081899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96475e9f-36c3-4e0f-b081-2f96f8afb460 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:59.087285 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96475e9f-36c3-4e0f-b081-2f96f8afb460 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:59.087744 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96475e9f-36c3-4e0f-b081-2f96f8afb460 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:59.088551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96475e9f-36c3-4e0f-b081-2f96f8afb460 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:59.089106 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96475e9f-36c3-4e0f-b081-2f96f8afb460 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:59.089551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96475e9f-36c3-4e0f-b081-2f96f8afb460 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:59.236082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a2e95a06-2ed5-44c5-8800-2e6aa1332d14 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:03:59.237172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a2e95a06-2ed5-44c5-8800-2e6aa1332d14 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:03:59.261663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2e95a06-2ed5-44c5-8800-2e6aa1332d14 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:59.262460 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2e95a06-2ed5-44c5-8800-2e6aa1332d14 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:59.269392 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2e95a06-2ed5-44c5-8800-2e6aa1332d14 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:59.270596 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2e95a06-2ed5-44c5-8800-2e6aa1332d14 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:03:59.271383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2e95a06-2ed5-44c5-8800-2e6aa1332d14 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:03:59.275424 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2e95a06-2ed5-44c5-8800-2e6aa1332d14 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:03:59.594361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-96475e9f-36c3-4e0f-b081-2f96f8afb460 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:03:59.609089 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-96475e9f-36c3-4e0f-b081-2f96f8afb460 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1476 microversion: 2.1 time: 0.567348 Oct 29 03:03:59.609697 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1786/3735] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:59 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1476 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:00.048643 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-32f80195-a36f-4d10-80ba-6f7095b5ff0c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:00.050065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-32f80195-a36f-4d10-80ba-6f7095b5ff0c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:00.066104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32f80195-a36f-4d10-80ba-6f7095b5ff0c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:00.079389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32f80195-a36f-4d10-80ba-6f7095b5ff0c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:00.081062 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32f80195-a36f-4d10-80ba-6f7095b5ff0c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:00.082032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32f80195-a36f-4d10-80ba-6f7095b5ff0c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:00.083679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32f80195-a36f-4d10-80ba-6f7095b5ff0c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:00.086225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32f80195-a36f-4d10-80ba-6f7095b5ff0c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:00.307014 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-32f80195-a36f-4d10-80ba-6f7095b5ff0c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:00.321496 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-32f80195-a36f-4d10-80ba-6f7095b5ff0c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:00.323494 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-32f80195-a36f-4d10-80ba-6f7095b5ff0c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:00.325555 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-32f80195-a36f-4d10-80ba-6f7095b5ff0c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1740 microversion: 2.20 time: 0.281826 Oct 29 03:04:00.351785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a2e95a06-2ed5-44c5-8800-2e6aa1332d14 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:00.359092 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1787/3736] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:00 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1740 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:04:00.367587 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a2e95a06-2ed5-44c5-8800-2e6aa1332d14 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa" status: 200 len: 1505 microversion: 2.1 time: 1.138771 Oct 29 03:04:00.368976 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1950/3737] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:03:59 2022] GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa => generated 1505 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:00.643138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-de0843a5-1ebb-4441-ac85-df6d09082755 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:00.645966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-de0843a5-1ebb-4441-ac85-df6d09082755 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:00.669547 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-de0843a5-1ebb-4441-ac85-df6d09082755 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:00.672468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-de0843a5-1ebb-4441-ac85-df6d09082755 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:00.695539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-de0843a5-1ebb-4441-ac85-df6d09082755 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:00.700241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-de0843a5-1ebb-4441-ac85-df6d09082755 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:00.701188 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-de0843a5-1ebb-4441-ac85-df6d09082755 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:00.703028 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-de0843a5-1ebb-4441-ac85-df6d09082755 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:01.002908 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7f2230d7-ec42-48c5-b0e9-afb6df730faf tempest-PortsAdminExtendedAttrsTestJSON-1194265442 tempest-PortsAdminExtendedAttrsTestJSON-1194265442-project-admin] Calling method '.version_select at 0x7ff05c1a9ca0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:01.006277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f2230d7-ec42-48c5-b0e9-afb6df730faf tempest-PortsAdminExtendedAttrsTestJSON-1194265442 tempest-PortsAdminExtendedAttrsTestJSON-1194265442-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:01.007293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f2230d7-ec42-48c5-b0e9-afb6df730faf tempest-PortsAdminExtendedAttrsTestJSON-1194265442 tempest-PortsAdminExtendedAttrsTestJSON-1194265442-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:01.010173 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f2230d7-ec42-48c5-b0e9-afb6df730faf tempest-PortsAdminExtendedAttrsTestJSON-1194265442 tempest-PortsAdminExtendedAttrsTestJSON-1194265442-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:01.115558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f2230d7-ec42-48c5-b0e9-afb6df730faf tempest-PortsAdminExtendedAttrsTestJSON-1194265442 tempest-PortsAdminExtendedAttrsTestJSON-1194265442-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:01.117548 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f2230d7-ec42-48c5-b0e9-afb6df730faf tempest-PortsAdminExtendedAttrsTestJSON-1194265442 tempest-PortsAdminExtendedAttrsTestJSON-1194265442-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:01.119035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f2230d7-ec42-48c5-b0e9-afb6df730faf tempest-PortsAdminExtendedAttrsTestJSON-1194265442 tempest-PortsAdminExtendedAttrsTestJSON-1194265442-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:01.143533 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-de0843a5-1ebb-4441-ac85-df6d09082755 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:01.165569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f2230d7-ec42-48c5-b0e9-afb6df730faf tempest-PortsAdminExtendedAttrsTestJSON-1194265442 tempest-PortsAdminExtendedAttrsTestJSON-1194265442-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:01.166499 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f2230d7-ec42-48c5-b0e9-afb6df730faf tempest-PortsAdminExtendedAttrsTestJSON-1194265442 tempest-PortsAdminExtendedAttrsTestJSON-1194265442-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:01.168338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f2230d7-ec42-48c5-b0e9-afb6df730faf tempest-PortsAdminExtendedAttrsTestJSON-1194265442 tempest-PortsAdminExtendedAttrsTestJSON-1194265442-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:01.170351 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-de0843a5-1ebb-4441-ac85-df6d09082755 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1474 microversion: 2.1 time: 0.537137 Oct 29 03:04:01.173008 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1788/3738] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:00 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1474 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:01.197166 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7f2230d7-ec42-48c5-b0e9-afb6df730faf tempest-PortsAdminExtendedAttrsTestJSON-1194265442 tempest-PortsAdminExtendedAttrsTestJSON-1194265442-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.542717 Oct 29 03:04:01.201901 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1951/3739] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 03:04:00 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:04:01.360662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cf389aec-0dd2-4e79-834d-7948a52c9253 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:01.361262 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cf389aec-0dd2-4e79-834d-7948a52c9253 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:01.379996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf389aec-0dd2-4e79-834d-7948a52c9253 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:01.384110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf389aec-0dd2-4e79-834d-7948a52c9253 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:01.387330 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf389aec-0dd2-4e79-834d-7948a52c9253 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:01.391535 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf389aec-0dd2-4e79-834d-7948a52c9253 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:01.393341 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-03a28c27-fd0d-4266-bcee-cdcd8abb4f8f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:01.394552 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-03a28c27-fd0d-4266-bcee-cdcd8abb4f8f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:01.402647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf389aec-0dd2-4e79-834d-7948a52c9253 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:01.403090 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf389aec-0dd2-4e79-834d-7948a52c9253 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:01.405438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03a28c27-fd0d-4266-bcee-cdcd8abb4f8f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:01.407137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03a28c27-fd0d-4266-bcee-cdcd8abb4f8f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:01.409170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03a28c27-fd0d-4266-bcee-cdcd8abb4f8f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:01.411411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03a28c27-fd0d-4266-bcee-cdcd8abb4f8f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:01.412101 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03a28c27-fd0d-4266-bcee-cdcd8abb4f8f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:01.413878 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03a28c27-fd0d-4266-bcee-cdcd8abb4f8f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:02.487882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cf389aec-0dd2-4e79-834d-7948a52c9253 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:02.510132 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cf389aec-0dd2-4e79-834d-7948a52c9253 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:02.512087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cf389aec-0dd2-4e79-834d-7948a52c9253 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:02.513576 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cf389aec-0dd2-4e79-834d-7948a52c9253 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1740 microversion: 2.20 time: 1.158272 Oct 29 03:04:02.514637 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1789/3740] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:01 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1740 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:02.520304 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a2ae1641-b21f-47c5-b132-e7155a817fa5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:02.523251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a2ae1641-b21f-47c5-b132-e7155a817fa5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:02.543395 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2ae1641-b21f-47c5-b132-e7155a817fa5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:02.544218 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2ae1641-b21f-47c5-b132-e7155a817fa5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:02.544852 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2ae1641-b21f-47c5-b132-e7155a817fa5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:02.545830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2ae1641-b21f-47c5-b132-e7155a817fa5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:02.546572 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2ae1641-b21f-47c5-b132-e7155a817fa5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:02.547178 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2ae1641-b21f-47c5-b132-e7155a817fa5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:02.642631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-03a28c27-fd0d-4266-bcee-cdcd8abb4f8f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:02.655394 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-03a28c27-fd0d-4266-bcee-cdcd8abb4f8f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa" status: 200 len: 1505 microversion: 2.1 time: 1.266635 Oct 29 03:04:02.685008 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1952/3741] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:01 2022] GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa => generated 1505 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:03.553016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4f6721bc-11dd-4532-abba-50ea6bb972f1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:03.553687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4f6721bc-11dd-4532-abba-50ea6bb972f1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:03.592180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f6721bc-11dd-4532-abba-50ea6bb972f1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:03.596816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f6721bc-11dd-4532-abba-50ea6bb972f1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:03.597660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f6721bc-11dd-4532-abba-50ea6bb972f1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:03.603021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f6721bc-11dd-4532-abba-50ea6bb972f1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:03.605227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f6721bc-11dd-4532-abba-50ea6bb972f1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:03.610829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a2ae1641-b21f-47c5-b132-e7155a817fa5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:03.618824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f6721bc-11dd-4532-abba-50ea6bb972f1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:03.629288 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a2ae1641-b21f-47c5-b132-e7155a817fa5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1471 microversion: 2.1 time: 1.102620 Oct 29 03:04:03.630705 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1790/3742] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:02 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1471 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:03.659367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d7f7c5b9-64a8-4afc-b184-6d59cbf5257a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:03.660344 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d7f7c5b9-64a8-4afc-b184-6d59cbf5257a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:03.679620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d7f7c5b9-64a8-4afc-b184-6d59cbf5257a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:03.680862 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d7f7c5b9-64a8-4afc-b184-6d59cbf5257a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:03.681551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d7f7c5b9-64a8-4afc-b184-6d59cbf5257a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:03.685542 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d7f7c5b9-64a8-4afc-b184-6d59cbf5257a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:03.686357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d7f7c5b9-64a8-4afc-b184-6d59cbf5257a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:03.687141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d7f7c5b9-64a8-4afc-b184-6d59cbf5257a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:03.692180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:03.904730 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d7f7c5b9-64a8-4afc-b184-6d59cbf5257a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "POST /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2/action" status: 204 len: 0 microversion: 2.1 time: 0.249308 Oct 29 03:04:03.905934 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1791/3743] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:04:03 2022] POST /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2/action => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 03:04:03.922128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fc86801a-81fe-4a88-9fe9-9b240b3e24eb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:03.928934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fc86801a-81fe-4a88-9fe9-9b240b3e24eb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:03.949350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc86801a-81fe-4a88-9fe9-9b240b3e24eb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:03.961315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc86801a-81fe-4a88-9fe9-9b240b3e24eb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:03.964119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc86801a-81fe-4a88-9fe9-9b240b3e24eb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:03.965048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc86801a-81fe-4a88-9fe9-9b240b3e24eb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:03.966214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc86801a-81fe-4a88-9fe9-9b240b3e24eb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:03.968592 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc86801a-81fe-4a88-9fe9-9b240b3e24eb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:04.453651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4f6721bc-11dd-4532-abba-50ea6bb972f1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:04.462742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4f6721bc-11dd-4532-abba-50ea6bb972f1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:04.470332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4f6721bc-11dd-4532-abba-50ea6bb972f1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:04.479568 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4f6721bc-11dd-4532-abba-50ea6bb972f1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1740 microversion: 2.20 time: 0.937585 Oct 29 03:04:04.489858 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1953/3744] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:03 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1740 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:04.495455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d63619b0-80a6-4efb-aa8a-f4a056a03b24 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:04.505982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d63619b0-80a6-4efb-aa8a-f4a056a03b24 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:04.523747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d63619b0-80a6-4efb-aa8a-f4a056a03b24 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:04.531358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d63619b0-80a6-4efb-aa8a-f4a056a03b24 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:04.532106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d63619b0-80a6-4efb-aa8a-f4a056a03b24 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:04.533087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d63619b0-80a6-4efb-aa8a-f4a056a03b24 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:04.533733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d63619b0-80a6-4efb-aa8a-f4a056a03b24 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:04.534324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d63619b0-80a6-4efb-aa8a-f4a056a03b24 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:04.711321 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fc86801a-81fe-4a88-9fe9-9b240b3e24eb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:04.731772 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fc86801a-81fe-4a88-9fe9-9b240b3e24eb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa" status: 200 len: 1505 microversion: 2.1 time: 0.821309 Oct 29 03:04:04.735830 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1792/3745] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:03 2022] GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa => generated 1505 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:05.529598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-21675e06-5356-4d92-ad41-48f9253c29dc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:05.531748 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-21675e06-5356-4d92-ad41-48f9253c29dc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:05.560891 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=66 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:05.571773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-21675e06-5356-4d92-ad41-48f9253c29dc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:05.574221 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-21675e06-5356-4d92-ad41-48f9253c29dc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:05.576227 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-21675e06-5356-4d92-ad41-48f9253c29dc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:05.578592 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-21675e06-5356-4d92-ad41-48f9253c29dc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:05.582670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-21675e06-5356-4d92-ad41-48f9253c29dc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:05.587194 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-21675e06-5356-4d92-ad41-48f9253c29dc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:06.046438 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-21675e06-5356-4d92-ad41-48f9253c29dc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:06.068087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-21675e06-5356-4d92-ad41-48f9253c29dc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:06.072200 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-21675e06-5356-4d92-ad41-48f9253c29dc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:06.073756 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-21675e06-5356-4d92-ad41-48f9253c29dc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1740 microversion: 2.20 time: 0.558546 Oct 29 03:04:06.123047 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1793/3746] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:05 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1740 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:06.148858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-334c0337-f154-4bf1-b0a7-170d252e625a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:06.166479 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-334c0337-f154-4bf1-b0a7-170d252e625a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:06.182255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-334c0337-f154-4bf1-b0a7-170d252e625a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:06.184151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-334c0337-f154-4bf1-b0a7-170d252e625a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:06.188617 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-334c0337-f154-4bf1-b0a7-170d252e625a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:06.194308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-334c0337-f154-4bf1-b0a7-170d252e625a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:06.196372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-334c0337-f154-4bf1-b0a7-170d252e625a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:06.204225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-334c0337-f154-4bf1-b0a7-170d252e625a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:06.769758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d63619b0-80a6-4efb-aa8a-f4a056a03b24 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:06.812366 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d63619b0-80a6-4efb-aa8a-f4a056a03b24 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1471 microversion: 2.1 time: 2.320372 Oct 29 03:04:06.816754 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1954/3747] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:04 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1471 bytes in 2326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:06.932180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-334c0337-f154-4bf1-b0a7-170d252e625a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:06.941191 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-334c0337-f154-4bf1-b0a7-170d252e625a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa" status: 200 len: 1505 microversion: 2.1 time: 0.813423 Oct 29 03:04:06.952416 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1794/3748] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:06 2022] GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa => generated 1505 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:07.135338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-482413be-a049-4e69-ab08-de2d63311184 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:07.142259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-482413be-a049-4e69-ab08-de2d63311184 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:07.188381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-482413be-a049-4e69-ab08-de2d63311184 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:07.190037 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-482413be-a049-4e69-ab08-de2d63311184 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:07.191451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-482413be-a049-4e69-ab08-de2d63311184 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:07.196716 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-482413be-a049-4e69-ab08-de2d63311184 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:07.206143 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-482413be-a049-4e69-ab08-de2d63311184 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:07.208050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-482413be-a049-4e69-ab08-de2d63311184 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:07.845402 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4566c9c3-b512-433c-8ba2-46aa95979bfd tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:07.847348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4566c9c3-b512-433c-8ba2-46aa95979bfd tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:07.879074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4566c9c3-b512-433c-8ba2-46aa95979bfd tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:07.884445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4566c9c3-b512-433c-8ba2-46aa95979bfd tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:07.889688 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4566c9c3-b512-433c-8ba2-46aa95979bfd tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:07.891551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4566c9c3-b512-433c-8ba2-46aa95979bfd tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:07.894588 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4566c9c3-b512-433c-8ba2-46aa95979bfd tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:07.900742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4566c9c3-b512-433c-8ba2-46aa95979bfd tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:08.226857 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-482413be-a049-4e69-ab08-de2d63311184 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:08.297776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-482413be-a049-4e69-ab08-de2d63311184 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:08.301881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-482413be-a049-4e69-ab08-de2d63311184 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:08.306645 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-482413be-a049-4e69-ab08-de2d63311184 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1740 microversion: 2.20 time: 1.200203 Oct 29 03:04:08.313315 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1955/3749] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:07 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1740 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:08.322927 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5c9197dc-e66b-49ba-bc7e-93a45100bf81 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:08.324443 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5c9197dc-e66b-49ba-bc7e-93a45100bf81 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:08.412136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c9197dc-e66b-49ba-bc7e-93a45100bf81 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:08.415572 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c9197dc-e66b-49ba-bc7e-93a45100bf81 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:08.417809 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c9197dc-e66b-49ba-bc7e-93a45100bf81 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:08.421879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c9197dc-e66b-49ba-bc7e-93a45100bf81 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:08.425202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c9197dc-e66b-49ba-bc7e-93a45100bf81 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:08.426263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c9197dc-e66b-49ba-bc7e-93a45100bf81 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:09.173905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5c9197dc-e66b-49ba-bc7e-93a45100bf81 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:09.214378 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5c9197dc-e66b-49ba-bc7e-93a45100bf81 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa" status: 200 len: 1505 microversion: 2.1 time: 0.897395 Oct 29 03:04:09.247356 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1956/3750] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:08 2022] GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa => generated 1505 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:09.403505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cd5e7ce0-8c3e-484f-9e7d-15c31850882e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:09.404850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cd5e7ce0-8c3e-484f-9e7d-15c31850882e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:09.427960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd5e7ce0-8c3e-484f-9e7d-15c31850882e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:09.430036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd5e7ce0-8c3e-484f-9e7d-15c31850882e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:09.430818 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd5e7ce0-8c3e-484f-9e7d-15c31850882e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:09.431626 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd5e7ce0-8c3e-484f-9e7d-15c31850882e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:09.432132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd5e7ce0-8c3e-484f-9e7d-15c31850882e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:09.432619 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd5e7ce0-8c3e-484f-9e7d-15c31850882e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:09.605970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4566c9c3-b512-433c-8ba2-46aa95979bfd tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:09.620258 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4566c9c3-b512-433c-8ba2-46aa95979bfd tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1471 microversion: 2.1 time: 1.782632 Oct 29 03:04:09.621167 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1795/3751] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:07 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1471 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:10.193754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-a112f2b1-c3ee-4252-af2f-ae0bf7c32dd2 req-15156454-4108-4736-81e5-4fb3c114f75b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4953b8e-b647-4491-b532-3476e7837ab2", "name": "network-vif-plugged", "status": "completed", "tag": "898db35a-9988-48ff-8d18-1d616cacb84b"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:10.250709 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a112f2b1-c3ee-4252-af2f-ae0bf7c32dd2 req-15156454-4108-4736-81e5-4fb3c114f75b service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:10.252224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a112f2b1-c3ee-4252-af2f-ae0bf7c32dd2 req-15156454-4108-4736-81e5-4fb3c114f75b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:10.253737 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a112f2b1-c3ee-4252-af2f-ae0bf7c32dd2 req-15156454-4108-4736-81e5-4fb3c114f75b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:10.300275 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-a112f2b1-c3ee-4252-af2f-ae0bf7c32dd2 req-15156454-4108-4736-81e5-4fb3c114f75b service nova] Creating event network-vif-plugged:898db35a-9988-48ff-8d18-1d616cacb84b for instance c4953b8e-b647-4491-b532-3476e7837ab2 on n-h1-862967-2 Oct 29 03:04:10.314146 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-a112f2b1-c3ee-4252-af2f-ae0bf7c32dd2 req-15156454-4108-4736-81e5-4fb3c114f75b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141591 Oct 29 03:04:10.316541 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1796/3752] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:10.331616 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fd66fa27-52df-4656-8b07-ebc9b3d23171 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:10.334194 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fd66fa27-52df-4656-8b07-ebc9b3d23171 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:10.359326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd66fa27-52df-4656-8b07-ebc9b3d23171 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:10.361604 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd66fa27-52df-4656-8b07-ebc9b3d23171 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:10.362332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd66fa27-52df-4656-8b07-ebc9b3d23171 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:10.363912 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd66fa27-52df-4656-8b07-ebc9b3d23171 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:10.365748 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd66fa27-52df-4656-8b07-ebc9b3d23171 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:10.368173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd66fa27-52df-4656-8b07-ebc9b3d23171 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:10.472149 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cd5e7ce0-8c3e-484f-9e7d-15c31850882e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:10.497858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cd5e7ce0-8c3e-484f-9e7d-15c31850882e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:10.499698 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cd5e7ce0-8c3e-484f-9e7d-15c31850882e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:10.517165 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cd5e7ce0-8c3e-484f-9e7d-15c31850882e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1740 microversion: 2.20 time: 1.148759 Oct 29 03:04:10.521603 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1957/3753] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:09 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1740 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:10.668280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3056f6bd-a201-4546-a8c4-bcb2b684a027 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:10.669104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3056f6bd-a201-4546-a8c4-bcb2b684a027 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:10.680503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3056f6bd-a201-4546-a8c4-bcb2b684a027 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:10.681641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3056f6bd-a201-4546-a8c4-bcb2b684a027 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:10.682333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3056f6bd-a201-4546-a8c4-bcb2b684a027 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:10.683272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3056f6bd-a201-4546-a8c4-bcb2b684a027 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:10.684435 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3056f6bd-a201-4546-a8c4-bcb2b684a027 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:10.686127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3056f6bd-a201-4546-a8c4-bcb2b684a027 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:11.010564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fd66fa27-52df-4656-8b07-ebc9b3d23171 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:11.023747 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fd66fa27-52df-4656-8b07-ebc9b3d23171 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa" status: 200 len: 1505 microversion: 2.1 time: 0.704731 Oct 29 03:04:11.023747 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1797/3754] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:10 2022] GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa => generated 1505 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:11.381847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3056f6bd-a201-4546-a8c4-bcb2b684a027 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:11.405957 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3056f6bd-a201-4546-a8c4-bcb2b684a027 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1463 microversion: 2.1 time: 0.736768 Oct 29 03:04:11.419651 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1958/3755] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:10 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1463 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:11.444138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d744e1bd-7d39-4e6e-9bf1-6c997cb263aa tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:11.447181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d744e1bd-7d39-4e6e-9bf1-6c997cb263aa tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:11.466158 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d744e1bd-7d39-4e6e-9bf1-6c997cb263aa tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:11.467488 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d744e1bd-7d39-4e6e-9bf1-6c997cb263aa tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:11.468868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d744e1bd-7d39-4e6e-9bf1-6c997cb263aa tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:11.470504 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d744e1bd-7d39-4e6e-9bf1-6c997cb263aa tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:11.471412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d744e1bd-7d39-4e6e-9bf1-6c997cb263aa tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:11.472113 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d744e1bd-7d39-4e6e-9bf1-6c997cb263aa tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:11.562750 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4d4e341a-f542-4825-ad6a-9c1ae8c75770 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:11.569614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4d4e341a-f542-4825-ad6a-9c1ae8c75770 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:11.598780 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d4e341a-f542-4825-ad6a-9c1ae8c75770 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:11.600008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d4e341a-f542-4825-ad6a-9c1ae8c75770 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:11.600803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d4e341a-f542-4825-ad6a-9c1ae8c75770 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:11.602391 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d4e341a-f542-4825-ad6a-9c1ae8c75770 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:11.603170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d4e341a-f542-4825-ad6a-9c1ae8c75770 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:11.607336 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d4e341a-f542-4825-ad6a-9c1ae8c75770 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:11.922991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4d4e341a-f542-4825-ad6a-9c1ae8c75770 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:11.964960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4d4e341a-f542-4825-ad6a-9c1ae8c75770 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:11.967326 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4d4e341a-f542-4825-ad6a-9c1ae8c75770 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:11.969321 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4d4e341a-f542-4825-ad6a-9c1ae8c75770 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1740 microversion: 2.20 time: 0.419344 Oct 29 03:04:11.969904 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1959/3756] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:11 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1740 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:12.070963 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-067b70f7-b5e0-4e2b-9871-c591902cf7f3 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:12.072427 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-067b70f7-b5e0-4e2b-9871-c591902cf7f3 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:12.084400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-067b70f7-b5e0-4e2b-9871-c591902cf7f3 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:12.085456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-067b70f7-b5e0-4e2b-9871-c591902cf7f3 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:12.086617 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-067b70f7-b5e0-4e2b-9871-c591902cf7f3 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:12.087865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-067b70f7-b5e0-4e2b-9871-c591902cf7f3 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:12.088561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-067b70f7-b5e0-4e2b-9871-c591902cf7f3 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:12.089168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-067b70f7-b5e0-4e2b-9871-c591902cf7f3 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:12.313029 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d744e1bd-7d39-4e6e-9bf1-6c997cb263aa tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1614 microversion: 2.1 time: 0.872651 Oct 29 03:04:12.317090 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1798/3757] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:11 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1614 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:12.391972 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4fb1b94a-b929-412d-b4bf-e210e2362cc3 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Calling method '.version_select at 0x7ff052ea1790>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:12.397626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4fb1b94a-b929-412d-b4bf-e210e2362cc3 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:12.398543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4fb1b94a-b929-412d-b4bf-e210e2362cc3 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:12.402777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4fb1b94a-b929-412d-b4bf-e210e2362cc3 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:12.420586 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4fb1b94a-b929-412d-b4bf-e210e2362cc3 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.031641 Oct 29 03:04:12.420586 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1799/3758] 10.222.0.46 () {58 vars in 1143 bytes} [Sat Oct 29 03:04:12 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:12.529987 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-067b70f7-b5e0-4e2b-9871-c591902cf7f3 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:12.544692 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-067b70f7-b5e0-4e2b-9871-c591902cf7f3 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa" status: 200 len: 1505 microversion: 2.1 time: 0.475584 Oct 29 03:04:12.546636 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1960/3759] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:12 2022] GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa => generated 1505 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:12.697450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-736987a6-0b98-4129-a0d6-66ba2de876b4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1271134976", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:12.860369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-736987a6-0b98-4129-a0d6-66ba2de876b4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] validate_networks() for None {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:04:12.996165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8d8b933e-7ea8-4ead-9db6-3327584fa8ca tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:12.996826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8d8b933e-7ea8-4ead-9db6-3327584fa8ca tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:13.016976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d8b933e-7ea8-4ead-9db6-3327584fa8ca tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:13.018094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d8b933e-7ea8-4ead-9db6-3327584fa8ca tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:13.019899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d8b933e-7ea8-4ead-9db6-3327584fa8ca tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:13.021121 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d8b933e-7ea8-4ead-9db6-3327584fa8ca tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:13.026667 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d8b933e-7ea8-4ead-9db6-3327584fa8ca tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:13.027437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d8b933e-7ea8-4ead-9db6-3327584fa8ca tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:13.299406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8d8b933e-7ea8-4ead-9db6-3327584fa8ca tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:13.319715 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8d8b933e-7ea8-4ead-9db6-3327584fa8ca tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:13.321459 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8d8b933e-7ea8-4ead-9db6-3327584fa8ca tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:13.322706 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8d8b933e-7ea8-4ead-9db6-3327584fa8ca tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1722 microversion: 2.20 time: 0.331299 Oct 29 03:04:13.345471 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1961/3760] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:12 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1722 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:13.460958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-736987a6-0b98-4129-a0d6-66ba2de876b4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:04:13.461478 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-736987a6-0b98-4129-a0d6-66ba2de876b4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:04:13.461956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-736987a6-0b98-4129-a0d6-66ba2de876b4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:04:13.463145 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-736987a6-0b98-4129-a0d6-66ba2de876b4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:04:13.463689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-736987a6-0b98-4129-a0d6-66ba2de876b4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:04:13.492940 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-736987a6-0b98-4129-a0d6-66ba2de876b4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:13.493471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-736987a6-0b98-4129-a0d6-66ba2de876b4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:13.493901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-736987a6-0b98-4129-a0d6-66ba2de876b4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:13.494874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-736987a6-0b98-4129-a0d6-66ba2de876b4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:13.495330 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-736987a6-0b98-4129-a0d6-66ba2de876b4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:13.495751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-736987a6-0b98-4129-a0d6-66ba2de876b4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:13.539285 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-736987a6-0b98-4129-a0d6-66ba2de876b4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Getting quotas for project 830acea7f5b948409e4b69d02aaeaf3b. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:04:13.558948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-736987a6-0b98-4129-a0d6-66ba2de876b4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Getting quotas for user 7d3a840b017844a7b45b98bea21e8e38 and project 830acea7f5b948409e4b69d02aaeaf3b. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:04:13.576887 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c7539d6a-c6a4-412e-a985-74f249a2994f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:13.577608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c7539d6a-c6a4-412e-a985-74f249a2994f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:13.585882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c7539d6a-c6a4-412e-a985-74f249a2994f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:13.587101 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c7539d6a-c6a4-412e-a985-74f249a2994f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:13.587753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c7539d6a-c6a4-412e-a985-74f249a2994f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:13.588789 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c7539d6a-c6a4-412e-a985-74f249a2994f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:13.589446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c7539d6a-c6a4-412e-a985-74f249a2994f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:13.590053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c7539d6a-c6a4-412e-a985-74f249a2994f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:13.608484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-736987a6-0b98-4129-a0d6-66ba2de876b4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:04:13.612769 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-736987a6-0b98-4129-a0d6-66ba2de876b4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:04:13.715704 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-736987a6-0b98-4129-a0d6-66ba2de876b4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.030939 Oct 29 03:04:13.717222 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1800/3761] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:04:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:04:13.732174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b7402c32-02b3-469a-9290-a4043db4e989 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:13.736366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b7402c32-02b3-469a-9290-a4043db4e989 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:13.999893 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b7402c32-02b3-469a-9290-a4043db4e989 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:14.009520 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b7402c32-02b3-469a-9290-a4043db4e989 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1213 microversion: 2.1 time: 0.282587 Oct 29 03:04:14.011867 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1801/3762] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:13 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1213 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:14.357272 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-93fc2248-d2d3-483e-9681-3956581dac8f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:14.358342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-93fc2248-d2d3-483e-9681-3956581dac8f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:14.415956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93fc2248-d2d3-483e-9681-3956581dac8f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:14.416389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93fc2248-d2d3-483e-9681-3956581dac8f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:14.420394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93fc2248-d2d3-483e-9681-3956581dac8f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:14.428856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93fc2248-d2d3-483e-9681-3956581dac8f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:14.433208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93fc2248-d2d3-483e-9681-3956581dac8f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:14.435405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93fc2248-d2d3-483e-9681-3956581dac8f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:14.560130 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c7539d6a-c6a4-412e-a985-74f249a2994f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:14.571911 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c7539d6a-c6a4-412e-a985-74f249a2994f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa" status: 200 len: 1505 microversion: 2.1 time: 1.000724 Oct 29 03:04:14.590641 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1962/3763] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:13 2022] GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa => generated 1505 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:14.952557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-93fc2248-d2d3-483e-9681-3956581dac8f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:14.963490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-93fc2248-d2d3-483e-9681-3956581dac8f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:14.965035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-93fc2248-d2d3-483e-9681-3956581dac8f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:14.966213 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-93fc2248-d2d3-483e-9681-3956581dac8f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1722 microversion: 2.20 time: 0.617857 Oct 29 03:04:14.978765 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1802/3764] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:14 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1722 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:04:15.035535 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0eb089d8-a975-4bad-a571-8ec67bc7b6c1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:15.036153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0eb089d8-a975-4bad-a571-8ec67bc7b6c1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:15.050930 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0eb089d8-a975-4bad-a571-8ec67bc7b6c1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:15.052144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0eb089d8-a975-4bad-a571-8ec67bc7b6c1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:15.052773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0eb089d8-a975-4bad-a571-8ec67bc7b6c1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:15.054746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0eb089d8-a975-4bad-a571-8ec67bc7b6c1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:15.055331 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0eb089d8-a975-4bad-a571-8ec67bc7b6c1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:15.059867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0eb089d8-a975-4bad-a571-8ec67bc7b6c1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:15.259970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0eb089d8-a975-4bad-a571-8ec67bc7b6c1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:15.279129 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0eb089d8-a975-4bad-a571-8ec67bc7b6c1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1217 microversion: 2.1 time: 0.247236 Oct 29 03:04:15.303612 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1803/3765] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:15 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1217 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:15.410731 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-751ab057-46b8-4432-ae4b-e240894bd565 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1216185116", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": "none"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:15.514794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-751ab057-46b8-4432-ae4b-e240894bd565 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:04:15.515464 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-751ab057-46b8-4432-ae4b-e240894bd565 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:04:15.516096 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-751ab057-46b8-4432-ae4b-e240894bd565 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:04:15.517288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-751ab057-46b8-4432-ae4b-e240894bd565 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:04:15.517884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-751ab057-46b8-4432-ae4b-e240894bd565 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:04:15.530995 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-751ab057-46b8-4432-ae4b-e240894bd565 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:15.531780 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-751ab057-46b8-4432-ae4b-e240894bd565 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:15.532381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-751ab057-46b8-4432-ae4b-e240894bd565 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:15.533484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-751ab057-46b8-4432-ae4b-e240894bd565 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:15.534129 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-751ab057-46b8-4432-ae4b-e240894bd565 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:15.534736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-751ab057-46b8-4432-ae4b-e240894bd565 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:15.553662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-751ab057-46b8-4432-ae4b-e240894bd565 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Getting quotas for project d88eeed762584cb8bddc59be33318b79. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:04:15.559583 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-751ab057-46b8-4432-ae4b-e240894bd565 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Getting quotas for user a8167d8889f34242a559ac172f6cbf87 and project d88eeed762584cb8bddc59be33318b79. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:04:15.573457 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-751ab057-46b8-4432-ae4b-e240894bd565 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:04:15.582106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-751ab057-46b8-4432-ae4b-e240894bd565 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] [instance: ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:04:15.629162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-855d66bb-b6b0-42e6-aba9-7453d469a47d tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:15.630340 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-855d66bb-b6b0-42e6-aba9-7453d469a47d tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:15.651469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-855d66bb-b6b0-42e6-aba9-7453d469a47d tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:15.655289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-855d66bb-b6b0-42e6-aba9-7453d469a47d tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:15.656392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-855d66bb-b6b0-42e6-aba9-7453d469a47d tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:15.658507 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-855d66bb-b6b0-42e6-aba9-7453d469a47d tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:15.662574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-855d66bb-b6b0-42e6-aba9-7453d469a47d tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:15.663394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-855d66bb-b6b0-42e6-aba9-7453d469a47d tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:15.668271 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-751ab057-46b8-4432-ae4b-e240894bd565 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.664215 Oct 29 03:04:15.669037 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1963/3766] 10.222.0.46 () {62 vars in 1188 bytes} [Sat Oct 29 03:04:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 03:04:15.681456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-79c3ab5d-d696-40f1-ac76-c0ad16e3bb43 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:15.682075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-79c3ab5d-d696-40f1-ac76-c0ad16e3bb43 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] [instance: ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:15.813388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-79c3ab5d-d696-40f1-ac76-c0ad16e3bb43 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8167d8889f34242a559ac172f6cbf87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eeed762584cb8bddc59be33318b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:15.824205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-79c3ab5d-d696-40f1-ac76-c0ad16e3bb43 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8167d8889f34242a559ac172f6cbf87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eeed762584cb8bddc59be33318b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:15.826067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-79c3ab5d-d696-40f1-ac76-c0ad16e3bb43 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8167d8889f34242a559ac172f6cbf87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eeed762584cb8bddc59be33318b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:15.827950 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-79c3ab5d-d696-40f1-ac76-c0ad16e3bb43 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] 10.222.0.46 "GET /compute/v2.1/servers/ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c" status: 200 len: 1281 microversion: 2.47 time: 0.151007 Oct 29 03:04:15.829351 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1964/3767] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:15 2022] GET /compute/v2.1/servers/ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c => generated 1281 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:04:16.032912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a1b47ab3-ffa5-4e0c-905e-bb6469a2b84b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:16.033600 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a1b47ab3-ffa5-4e0c-905e-bb6469a2b84b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:16.050437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a1b47ab3-ffa5-4e0c-905e-bb6469a2b84b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:16.064393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a1b47ab3-ffa5-4e0c-905e-bb6469a2b84b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:16.065254 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a1b47ab3-ffa5-4e0c-905e-bb6469a2b84b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:16.066025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a1b47ab3-ffa5-4e0c-905e-bb6469a2b84b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:16.077313 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a1b47ab3-ffa5-4e0c-905e-bb6469a2b84b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:16.077947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a1b47ab3-ffa5-4e0c-905e-bb6469a2b84b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:16.143879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=100 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:16.957755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a1b47ab3-ffa5-4e0c-905e-bb6469a2b84b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:16.992243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a1b47ab3-ffa5-4e0c-905e-bb6469a2b84b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:16.997929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a1b47ab3-ffa5-4e0c-905e-bb6469a2b84b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:17.000430 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a1b47ab3-ffa5-4e0c-905e-bb6469a2b84b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1722 microversion: 2.20 time: 0.973711 Oct 29 03:04:17.011565 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1965/3768] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:16 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1722 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:04:17.029126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-09c90e59-0bce-44d9-9a01-b9fff4cd9b92 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:17.030290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-09c90e59-0bce-44d9-9a01-b9fff4cd9b92 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:17.037675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09c90e59-0bce-44d9-9a01-b9fff4cd9b92 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:17.038847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09c90e59-0bce-44d9-9a01-b9fff4cd9b92 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:17.040275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09c90e59-0bce-44d9-9a01-b9fff4cd9b92 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:17.045556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-855d66bb-b6b0-42e6-aba9-7453d469a47d tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:17.051711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09c90e59-0bce-44d9-9a01-b9fff4cd9b92 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:17.063194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09c90e59-0bce-44d9-9a01-b9fff4cd9b92 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:17.068287 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09c90e59-0bce-44d9-9a01-b9fff4cd9b92 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:17.079259 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-855d66bb-b6b0-42e6-aba9-7453d469a47d tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa" status: 200 len: 1505 microversion: 2.1 time: 1.447018 Oct 29 03:04:17.110370 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1804/3769] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:15 2022] GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa => generated 1505 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:17.121048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-05b2c3e2-bc17-48de-a204-1a93640711c0 req-33efd8ce-df68-4d28-8013-168719adaf00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "354cb0c1-2737-486f-8e3b-d119c49a46a7", "name": "network-vif-unplugged", "status": "completed", "tag": "0e820bc1-bfed-42bc-8698-d91dc009de10"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:17.149372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-05b2c3e2-bc17-48de-a204-1a93640711c0 req-33efd8ce-df68-4d28-8013-168719adaf00 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:17.150472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-05b2c3e2-bc17-48de-a204-1a93640711c0 req-33efd8ce-df68-4d28-8013-168719adaf00 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:17.151486 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-05b2c3e2-bc17-48de-a204-1a93640711c0 req-33efd8ce-df68-4d28-8013-168719adaf00 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:17.193433 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-05b2c3e2-bc17-48de-a204-1a93640711c0 req-33efd8ce-df68-4d28-8013-168719adaf00 service nova] Creating event network-vif-unplugged:0e820bc1-bfed-42bc-8698-d91dc009de10 for instance 354cb0c1-2737-486f-8e3b-d119c49a46a7 on n-h1-862967-2 Oct 29 03:04:17.210717 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-09c90e59-0bce-44d9-9a01-b9fff4cd9b92 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:17.219640 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-05b2c3e2-bc17-48de-a204-1a93640711c0 req-33efd8ce-df68-4d28-8013-168719adaf00 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103535 Oct 29 03:04:17.229546 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1805/3770] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:17.240831 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-09c90e59-0bce-44d9-9a01-b9fff4cd9b92 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1209 microversion: 2.1 time: 0.226298 Oct 29 03:04:17.245822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a8ba7a9e-9d5c-4839-a118-4ed60d1842b2 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:17.249901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a8ba7a9e-9d5c-4839-a118-4ed60d1842b2 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] [instance: ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:17.262847 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1966/3771] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:17 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1209 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:17.270304 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8ba7a9e-9d5c-4839-a118-4ed60d1842b2 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:17.271112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8ba7a9e-9d5c-4839-a118-4ed60d1842b2 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:17.271740 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8ba7a9e-9d5c-4839-a118-4ed60d1842b2 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:17.273096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8ba7a9e-9d5c-4839-a118-4ed60d1842b2 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:17.275444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8ba7a9e-9d5c-4839-a118-4ed60d1842b2 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:17.276975 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8ba7a9e-9d5c-4839-a118-4ed60d1842b2 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:17.463124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a8ba7a9e-9d5c-4839-a118-4ed60d1842b2 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8167d8889f34242a559ac172f6cbf87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eeed762584cb8bddc59be33318b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:17.491885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a8ba7a9e-9d5c-4839-a118-4ed60d1842b2 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8167d8889f34242a559ac172f6cbf87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eeed762584cb8bddc59be33318b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:17.505017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a8ba7a9e-9d5c-4839-a118-4ed60d1842b2 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8167d8889f34242a559ac172f6cbf87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eeed762584cb8bddc59be33318b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:17.508648 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a8ba7a9e-9d5c-4839-a118-4ed60d1842b2 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] 10.222.0.46 "GET /compute/v2.1/servers/ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c" status: 200 len: 1277 microversion: 2.47 time: 0.275498 Oct 29 03:04:17.512701 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1806/3772] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:17 2022] GET /compute/v2.1/servers/ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c => generated 1277 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:18.054889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5f3a5bae-bf08-4dcb-9ca8-6c14ae9ce3b1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:18.055669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5f3a5bae-bf08-4dcb-9ca8-6c14ae9ce3b1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:18.073197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:18.076348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f3a5bae-bf08-4dcb-9ca8-6c14ae9ce3b1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:18.076877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f3a5bae-bf08-4dcb-9ca8-6c14ae9ce3b1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:18.077359 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f3a5bae-bf08-4dcb-9ca8-6c14ae9ce3b1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:18.078187 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f3a5bae-bf08-4dcb-9ca8-6c14ae9ce3b1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:18.078652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f3a5bae-bf08-4dcb-9ca8-6c14ae9ce3b1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:18.079085 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f3a5bae-bf08-4dcb-9ca8-6c14ae9ce3b1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:18.121638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-43a1ad4e-8366-4331-8548-114fddba632a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:18.122448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-43a1ad4e-8366-4331-8548-114fddba632a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:18.148238 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43a1ad4e-8366-4331-8548-114fddba632a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:18.148596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43a1ad4e-8366-4331-8548-114fddba632a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:18.151212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43a1ad4e-8366-4331-8548-114fddba632a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:18.151977 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43a1ad4e-8366-4331-8548-114fddba632a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:18.152474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43a1ad4e-8366-4331-8548-114fddba632a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:18.152920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43a1ad4e-8366-4331-8548-114fddba632a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:18.558896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5f3a5bae-bf08-4dcb-9ca8-6c14ae9ce3b1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:18.599922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5f3a5bae-bf08-4dcb-9ca8-6c14ae9ce3b1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:18.603195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5f3a5bae-bf08-4dcb-9ca8-6c14ae9ce3b1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:18.605858 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5f3a5bae-bf08-4dcb-9ca8-6c14ae9ce3b1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1665 microversion: 2.20 time: 0.555041 Oct 29 03:04:18.639739 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1967/3773] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:18 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1665 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:18.646417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d7e9fc13-2493-446f-878c-adb476ecf436 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:18.659715 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d7e9fc13-2493-446f-878c-adb476ecf436 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:18.671414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7e9fc13-2493-446f-878c-adb476ecf436 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:18.672233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7e9fc13-2493-446f-878c-adb476ecf436 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:18.672911 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7e9fc13-2493-446f-878c-adb476ecf436 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:18.673837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7e9fc13-2493-446f-878c-adb476ecf436 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:18.675597 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7e9fc13-2493-446f-878c-adb476ecf436 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:18.676827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7e9fc13-2493-446f-878c-adb476ecf436 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:18.803023 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d7e9fc13-2493-446f-878c-adb476ecf436 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:18.813168 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d7e9fc13-2493-446f-878c-adb476ecf436 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1265 microversion: 2.1 time: 0.171856 Oct 29 03:04:18.818947 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1968/3774] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:18 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:18.830518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1213db60-7b02-4b5c-a20c-342f04b4f815 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:18.833293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1213db60-7b02-4b5c-a20c-342f04b4f815 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] [instance: ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:18.856238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1213db60-7b02-4b5c-a20c-342f04b4f815 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:18.856793 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1213db60-7b02-4b5c-a20c-342f04b4f815 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:18.860479 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1213db60-7b02-4b5c-a20c-342f04b4f815 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:18.863057 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1213db60-7b02-4b5c-a20c-342f04b4f815 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:18.864818 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1213db60-7b02-4b5c-a20c-342f04b4f815 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:18.865954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1213db60-7b02-4b5c-a20c-342f04b4f815 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:18.907725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-43a1ad4e-8366-4331-8548-114fddba632a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:18.933746 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-43a1ad4e-8366-4331-8548-114fddba632a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa" status: 200 len: 1485 microversion: 2.1 time: 0.816313 Oct 29 03:04:18.934685 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1807/3775] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:18 2022] GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa => generated 1485 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:18.963534 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-09fbcb05-8635-4ddd-bc6a-83583bbd276f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8032ae9f-aaf9-4f3e-844e-9d6f78276f70"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:18.967968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-09fbcb05-8635-4ddd-bc6a-83583bbd276f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:19.016924 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09fbcb05-8635-4ddd-bc6a-83583bbd276f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:19.017871 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09fbcb05-8635-4ddd-bc6a-83583bbd276f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:19.018649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09fbcb05-8635-4ddd-bc6a-83583bbd276f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:19.019946 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09fbcb05-8635-4ddd-bc6a-83583bbd276f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:19.037204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09fbcb05-8635-4ddd-bc6a-83583bbd276f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:19.041956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09fbcb05-8635-4ddd-bc6a-83583bbd276f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:19.053942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1213db60-7b02-4b5c-a20c-342f04b4f815 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8167d8889f34242a559ac172f6cbf87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eeed762584cb8bddc59be33318b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:19.067678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1213db60-7b02-4b5c-a20c-342f04b4f815 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8167d8889f34242a559ac172f6cbf87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eeed762584cb8bddc59be33318b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:19.083062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1213db60-7b02-4b5c-a20c-342f04b4f815 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8167d8889f34242a559ac172f6cbf87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eeed762584cb8bddc59be33318b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:19.084296 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1213db60-7b02-4b5c-a20c-342f04b4f815 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] 10.222.0.46 "GET /compute/v2.1/servers/ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c" status: 200 len: 1277 microversion: 2.47 time: 0.263951 Oct 29 03:04:19.111469 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1969/3776] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:18 2022] GET /compute/v2.1/servers/ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c => generated 1277 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:19.338923 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-91d92d1d-ea39-42ac-b3bd-6654200cc9ef tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1656957318", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:19.575182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-91d92d1d-ea39-42ac-b3bd-6654200cc9ef tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] validate_networks() for [('5b35fb71-6bc5-44b3-95a2-866b95850c05', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:04:19.689226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:19.894390 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-09fbcb05-8635-4ddd-bc6a-83583bbd276f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "POST /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.952989 Oct 29 03:04:19.896408 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1808/3777] 10.222.0.46 () {62 vars in 1364 bytes} [Sat Oct 29 03:04:18 2022] POST /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7/os-volume_attachments => generated 188 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:04:19.901254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-64bd2f76-2433-4a44-a869-0a42b62f78e7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:19.904030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-64bd2f76-2433-4a44-a869-0a42b62f78e7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:19.923461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64bd2f76-2433-4a44-a869-0a42b62f78e7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:19.924059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64bd2f76-2433-4a44-a869-0a42b62f78e7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:19.924693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64bd2f76-2433-4a44-a869-0a42b62f78e7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:19.925755 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64bd2f76-2433-4a44-a869-0a42b62f78e7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:19.926271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64bd2f76-2433-4a44-a869-0a42b62f78e7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:19.926790 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64bd2f76-2433-4a44-a869-0a42b62f78e7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:20.178229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-64bd2f76-2433-4a44-a869-0a42b62f78e7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:20.213287 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-64bd2f76-2433-4a44-a869-0a42b62f78e7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1271 microversion: 2.1 time: 0.315653 Oct 29 03:04:20.214391 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1809/3778] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:19 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1271 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:20.223796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b59edb2c-170a-4d76-9edd-3b954f36d9dc tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:20.226034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b59edb2c-170a-4d76-9edd-3b954f36d9dc tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] [instance: ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:20.233968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b59edb2c-170a-4d76-9edd-3b954f36d9dc tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:20.234839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b59edb2c-170a-4d76-9edd-3b954f36d9dc tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:20.235557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b59edb2c-170a-4d76-9edd-3b954f36d9dc tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:20.236587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b59edb2c-170a-4d76-9edd-3b954f36d9dc tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:20.238258 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b59edb2c-170a-4d76-9edd-3b954f36d9dc tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:20.238929 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b59edb2c-170a-4d76-9edd-3b954f36d9dc tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:20.646539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b59edb2c-170a-4d76-9edd-3b954f36d9dc tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8167d8889f34242a559ac172f6cbf87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eeed762584cb8bddc59be33318b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:20.670185 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b59edb2c-170a-4d76-9edd-3b954f36d9dc tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8167d8889f34242a559ac172f6cbf87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eeed762584cb8bddc59be33318b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:20.674222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b59edb2c-170a-4d76-9edd-3b954f36d9dc tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8167d8889f34242a559ac172f6cbf87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eeed762584cb8bddc59be33318b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:20.682782 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b59edb2c-170a-4d76-9edd-3b954f36d9dc tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] 10.222.0.46 "GET /compute/v2.1/servers/ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c" status: 200 len: 1341 microversion: 2.47 time: 0.462376 Oct 29 03:04:20.690417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-91d92d1d-ea39-42ac-b3bd-6654200cc9ef tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:04:20.690908 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-91d92d1d-ea39-42ac-b3bd-6654200cc9ef tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:04:20.691290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-91d92d1d-ea39-42ac-b3bd-6654200cc9ef tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:04:20.691947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-91d92d1d-ea39-42ac-b3bd-6654200cc9ef tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:04:20.692504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-91d92d1d-ea39-42ac-b3bd-6654200cc9ef tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:04:20.697656 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1810/3779] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:20 2022] GET /compute/v2.1/servers/ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c => generated 1341 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:20.709394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91d92d1d-ea39-42ac-b3bd-6654200cc9ef tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:20.710468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91d92d1d-ea39-42ac-b3bd-6654200cc9ef tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:20.711119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91d92d1d-ea39-42ac-b3bd-6654200cc9ef tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:20.716952 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-265179f3-e0da-4cd7-9b58-78058289db46 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:20.717761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91d92d1d-ea39-42ac-b3bd-6654200cc9ef tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:20.719002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-265179f3-e0da-4cd7-9b58-78058289db46 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:20.719840 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91d92d1d-ea39-42ac-b3bd-6654200cc9ef tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:20.720482 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91d92d1d-ea39-42ac-b3bd-6654200cc9ef tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:20.738880 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-265179f3-e0da-4cd7-9b58-78058289db46 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:20.740159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-265179f3-e0da-4cd7-9b58-78058289db46 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:20.741554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-265179f3-e0da-4cd7-9b58-78058289db46 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:20.744752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-265179f3-e0da-4cd7-9b58-78058289db46 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:20.745883 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-265179f3-e0da-4cd7-9b58-78058289db46 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:20.746774 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-265179f3-e0da-4cd7-9b58-78058289db46 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:20.780281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-91d92d1d-ea39-42ac-b3bd-6654200cc9ef tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Getting quotas for project bb24014d942448949743ad6b56d8d0a7. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:04:20.789574 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-91d92d1d-ea39-42ac-b3bd-6654200cc9ef tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Getting quotas for user 764f273de21745e0ab94f098ede04499 and project bb24014d942448949743ad6b56d8d0a7. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:04:20.851074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-91d92d1d-ea39-42ac-b3bd-6654200cc9ef tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:04:20.859537 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-91d92d1d-ea39-42ac-b3bd-6654200cc9ef tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:04:20.934122 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-91d92d1d-ea39-42ac-b3bd-6654200cc9ef tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.601800 Oct 29 03:04:20.936651 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1970/3780] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:04:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 1605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:04:20.962384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4ae7e37a-ff97-465d-a536-e93756105745 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:20.963486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4ae7e37a-ff97-465d-a536-e93756105745 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:21.053602 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4ae7e37a-ff97-465d-a536-e93756105745 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:21.069752 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4ae7e37a-ff97-465d-a536-e93756105745 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1214 microversion: 2.1 time: 0.123367 Oct 29 03:04:21.077599 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1971/3781] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:20 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1214 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:21.253678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-67fc442f-dcd3-4cbf-acb9-8054ef84dbd7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:21.254564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-67fc442f-dcd3-4cbf-acb9-8054ef84dbd7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:21.264805 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67fc442f-dcd3-4cbf-acb9-8054ef84dbd7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:21.271056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67fc442f-dcd3-4cbf-acb9-8054ef84dbd7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:21.277050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67fc442f-dcd3-4cbf-acb9-8054ef84dbd7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:21.278092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67fc442f-dcd3-4cbf-acb9-8054ef84dbd7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:21.278809 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67fc442f-dcd3-4cbf-acb9-8054ef84dbd7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:21.279404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67fc442f-dcd3-4cbf-acb9-8054ef84dbd7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:21.375935 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-265179f3-e0da-4cd7-9b58-78058289db46 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "DELETE /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7/os-volume_attachments/8032ae9f-aaf9-4f3e-844e-9d6f78276f70" status: 202 len: 0 microversion: 2.20 time: 0.674202 Oct 29 03:04:21.376886 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1811/3782] 10.222.0.46 () {60 vars in 1457 bytes} [Sat Oct 29 03:04:20 2022] DELETE /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7/os-volume_attachments/8032ae9f-aaf9-4f3e-844e-9d6f78276f70 => generated 0 bytes in 679 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:04:21.472336 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-67fc442f-dcd3-4cbf-acb9-8054ef84dbd7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:21.489925 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-67fc442f-dcd3-4cbf-acb9-8054ef84dbd7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1271 microversion: 2.1 time: 0.236427 Oct 29 03:04:21.490611 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1972/3783] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:21 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1271 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:21.577871 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7fa5027e-6f3f-443e-b09c-7c6aa62e0ee2 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1449742929", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "2d9e76b2-2b8c-435e-9161-5095a46919f8"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:21.582423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d7ea4507-fa77-4b38-ba35-dd9e7dc8d18f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:21.583040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d7ea4507-fa77-4b38-ba35-dd9e7dc8d18f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:21.604649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7ea4507-fa77-4b38-ba35-dd9e7dc8d18f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:21.605899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7ea4507-fa77-4b38-ba35-dd9e7dc8d18f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:21.606265 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7ea4507-fa77-4b38-ba35-dd9e7dc8d18f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:21.607476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7ea4507-fa77-4b38-ba35-dd9e7dc8d18f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:21.608560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7ea4507-fa77-4b38-ba35-dd9e7dc8d18f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:21.609328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7ea4507-fa77-4b38-ba35-dd9e7dc8d18f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:21.657992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-7fa5027e-6f3f-443e-b09c-7c6aa62e0ee2 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] validate_networks() for [('2d9e76b2-2b8c-435e-9161-5095a46919f8', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:04:21.682094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d7ea4507-fa77-4b38-ba35-dd9e7dc8d18f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127124) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 29 03:04:21.875393 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d7ea4507-fa77-4b38-ba35-dd9e7dc8d18f tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "POST /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7/action" status: 202 len: 0 microversion: 2.20 time: 0.299660 Oct 29 03:04:21.878275 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1973/3784] 10.222.0.46 () {62 vars in 1319 bytes} [Sat Oct 29 03:04:21 2022] POST /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:04:21.891342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-90e2d1cf-6d1f-41da-95a3-d7cb0fe82120 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:21.893135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-90e2d1cf-6d1f-41da-95a3-d7cb0fe82120 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] [instance: ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:21.906808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-90e2d1cf-6d1f-41da-95a3-d7cb0fe82120 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:21.908447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-90e2d1cf-6d1f-41da-95a3-d7cb0fe82120 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:21.909997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-90e2d1cf-6d1f-41da-95a3-d7cb0fe82120 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:21.913331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-90e2d1cf-6d1f-41da-95a3-d7cb0fe82120 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:21.914450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-90e2d1cf-6d1f-41da-95a3-d7cb0fe82120 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:21.916492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-90e2d1cf-6d1f-41da-95a3-d7cb0fe82120 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:22.091627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-90e2d1cf-6d1f-41da-95a3-d7cb0fe82120 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8167d8889f34242a559ac172f6cbf87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eeed762584cb8bddc59be33318b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:22.111726 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-90e2d1cf-6d1f-41da-95a3-d7cb0fe82120 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8167d8889f34242a559ac172f6cbf87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eeed762584cb8bddc59be33318b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:22.114336 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-90e2d1cf-6d1f-41da-95a3-d7cb0fe82120 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8167d8889f34242a559ac172f6cbf87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eeed762584cb8bddc59be33318b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:22.117032 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-90e2d1cf-6d1f-41da-95a3-d7cb0fe82120 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] 10.222.0.46 "GET /compute/v2.1/servers/ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c" status: 200 len: 1339 microversion: 2.47 time: 0.236169 Oct 29 03:04:22.134246 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1974/3785] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:21 2022] GET /compute/v2.1/servers/ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c => generated 1339 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:22.146982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c6971483-34fe-42f9-a53d-1c559749dfe1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:22.147765 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c6971483-34fe-42f9-a53d-1c559749dfe1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:22.155651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6971483-34fe-42f9-a53d-1c559749dfe1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:22.156704 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6971483-34fe-42f9-a53d-1c559749dfe1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:22.157403 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6971483-34fe-42f9-a53d-1c559749dfe1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:22.158369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6971483-34fe-42f9-a53d-1c559749dfe1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:22.161858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6971483-34fe-42f9-a53d-1c559749dfe1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:22.162774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6971483-34fe-42f9-a53d-1c559749dfe1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:22.537065 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c6971483-34fe-42f9-a53d-1c559749dfe1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:22.577084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c6971483-34fe-42f9-a53d-1c559749dfe1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:22.579232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c6971483-34fe-42f9-a53d-1c559749dfe1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:22.584744 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c6971483-34fe-42f9-a53d-1c559749dfe1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1673 microversion: 2.20 time: 0.448939 Oct 29 03:04:22.585628 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1975/3786] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:22 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1673 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:22.592159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-50fb0a39-74ee-42b3-8fc8-5a8cae638e25 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:22.592963 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-50fb0a39-74ee-42b3-8fc8-5a8cae638e25 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:22.629219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50fb0a39-74ee-42b3-8fc8-5a8cae638e25 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:22.629729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50fb0a39-74ee-42b3-8fc8-5a8cae638e25 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:22.631446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50fb0a39-74ee-42b3-8fc8-5a8cae638e25 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:22.634682 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50fb0a39-74ee-42b3-8fc8-5a8cae638e25 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:22.635242 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50fb0a39-74ee-42b3-8fc8-5a8cae638e25 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:22.635702 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50fb0a39-74ee-42b3-8fc8-5a8cae638e25 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:22.823020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-50fb0a39-74ee-42b3-8fc8-5a8cae638e25 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:22.843897 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-50fb0a39-74ee-42b3-8fc8-5a8cae638e25 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1266 microversion: 2.1 time: 0.256604 Oct 29 03:04:22.845379 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1976/3787] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:22 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:22.853598 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7ac35710-db17-4649-9b45-b3d7e3c7e0d2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:22.854822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7ac35710-db17-4649-9b45-b3d7e3c7e0d2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:22.876727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ac35710-db17-4649-9b45-b3d7e3c7e0d2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:22.878513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ac35710-db17-4649-9b45-b3d7e3c7e0d2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:22.879757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ac35710-db17-4649-9b45-b3d7e3c7e0d2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:22.881407 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ac35710-db17-4649-9b45-b3d7e3c7e0d2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:22.882537 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ac35710-db17-4649-9b45-b3d7e3c7e0d2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:22.883574 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ac35710-db17-4649-9b45-b3d7e3c7e0d2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:23.160389 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7ac35710-db17-4649-9b45-b3d7e3c7e0d2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:23.173753 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7ac35710-db17-4649-9b45-b3d7e3c7e0d2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1313 microversion: 2.1 time: 0.326430 Oct 29 03:04:23.174917 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1977/3788] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:22 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:23.187055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ebfbe2f1-50d0-413a-ac89-d86b9accf6b8 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:23.190518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ebfbe2f1-50d0-413a-ac89-d86b9accf6b8 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] [instance: ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:23.215488 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebfbe2f1-50d0-413a-ac89-d86b9accf6b8 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:23.218518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebfbe2f1-50d0-413a-ac89-d86b9accf6b8 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:23.220497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebfbe2f1-50d0-413a-ac89-d86b9accf6b8 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:23.224837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebfbe2f1-50d0-413a-ac89-d86b9accf6b8 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:23.225354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebfbe2f1-50d0-413a-ac89-d86b9accf6b8 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:23.225824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebfbe2f1-50d0-413a-ac89-d86b9accf6b8 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:23.513239 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:23.829902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ebfbe2f1-50d0-413a-ac89-d86b9accf6b8 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8167d8889f34242a559ac172f6cbf87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eeed762584cb8bddc59be33318b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:23.846890 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ebfbe2f1-50d0-413a-ac89-d86b9accf6b8 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8167d8889f34242a559ac172f6cbf87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eeed762584cb8bddc59be33318b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:23.849294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ebfbe2f1-50d0-413a-ac89-d86b9accf6b8 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8167d8889f34242a559ac172f6cbf87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eeed762584cb8bddc59be33318b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:23.855833 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ebfbe2f1-50d0-413a-ac89-d86b9accf6b8 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] 10.222.0.46 "GET /compute/v2.1/servers/ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c" status: 200 len: 1339 microversion: 2.47 time: 0.676436 Oct 29 03:04:23.857053 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1978/3789] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:23 2022] GET /compute/v2.1/servers/ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c => generated 1339 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:23.873348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d4f8c535-7b87-498f-ac58-75e95fb4b8ed tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:23.881902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d4f8c535-7b87-498f-ac58-75e95fb4b8ed tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:23.896448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4f8c535-7b87-498f-ac58-75e95fb4b8ed tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:23.898093 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4f8c535-7b87-498f-ac58-75e95fb4b8ed tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:23.899623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4f8c535-7b87-498f-ac58-75e95fb4b8ed tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:23.900605 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4f8c535-7b87-498f-ac58-75e95fb4b8ed tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:23.903186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4f8c535-7b87-498f-ac58-75e95fb4b8ed tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:23.904463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4f8c535-7b87-498f-ac58-75e95fb4b8ed tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:24.007185 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=8 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:24.127496 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-7fa5027e-6f3f-443e-b09c-7c6aa62e0ee2 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:04:24.128681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-7fa5027e-6f3f-443e-b09c-7c6aa62e0ee2 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:04:24.129750 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-7fa5027e-6f3f-443e-b09c-7c6aa62e0ee2 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:04:24.130712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-7fa5027e-6f3f-443e-b09c-7c6aa62e0ee2 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:04:24.131709 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-7fa5027e-6f3f-443e-b09c-7c6aa62e0ee2 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:04:24.155317 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fa5027e-6f3f-443e-b09c-7c6aa62e0ee2 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:24.157090 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fa5027e-6f3f-443e-b09c-7c6aa62e0ee2 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:24.177807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fa5027e-6f3f-443e-b09c-7c6aa62e0ee2 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:24.179368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fa5027e-6f3f-443e-b09c-7c6aa62e0ee2 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:24.182928 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fa5027e-6f3f-443e-b09c-7c6aa62e0ee2 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:24.185005 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fa5027e-6f3f-443e-b09c-7c6aa62e0ee2 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:24.294077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-7fa5027e-6f3f-443e-b09c-7c6aa62e0ee2 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Getting quotas for project 016dc7d91d1e4977ba712f7bed5218e3. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:04:24.326653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-7fa5027e-6f3f-443e-b09c-7c6aa62e0ee2 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Getting quotas for user 52009279acbd46919353742edb6cf2d8 and project 016dc7d91d1e4977ba712f7bed5218e3. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:04:24.383271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d4f8c535-7b87-498f-ac58-75e95fb4b8ed tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:24.384032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7fa5027e-6f3f-443e-b09c-7c6aa62e0ee2 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:04:24.393192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7fa5027e-6f3f-443e-b09c-7c6aa62e0ee2 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] [instance: b955d0c2-5679-4b7f-9c9b-92671911b574] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:04:24.406696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d4f8c535-7b87-498f-ac58-75e95fb4b8ed tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:24.410377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d4f8c535-7b87-498f-ac58-75e95fb4b8ed tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:24.415938 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d4f8c535-7b87-498f-ac58-75e95fb4b8ed tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1673 microversion: 2.20 time: 0.557577 Oct 29 03:04:24.419663 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1979/3790] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:23 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1673 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:24.477202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5705fd78-6929-4e54-b67e-8e01778339c7 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:24.478121 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5705fd78-6929-4e54-b67e-8e01778339c7 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:24.505071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5705fd78-6929-4e54-b67e-8e01778339c7 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:24.505835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5705fd78-6929-4e54-b67e-8e01778339c7 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:24.509366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5705fd78-6929-4e54-b67e-8e01778339c7 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:24.510703 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5705fd78-6929-4e54-b67e-8e01778339c7 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:24.511496 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5705fd78-6929-4e54-b67e-8e01778339c7 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:24.512230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5705fd78-6929-4e54-b67e-8e01778339c7 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:24.577153 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7fa5027e-6f3f-443e-b09c-7c6aa62e0ee2 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.194841 Oct 29 03:04:24.580611 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1812/3791] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:04:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 3201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:04:24.590895 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7f477b9c-898a-4775-8452-afd5fb0b2408 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:24.593388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7f477b9c-898a-4775-8452-afd5fb0b2408 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:24.607416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f477b9c-898a-4775-8452-afd5fb0b2408 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:24.608411 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f477b9c-898a-4775-8452-afd5fb0b2408 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:24.609111 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f477b9c-898a-4775-8452-afd5fb0b2408 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:24.610330 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f477b9c-898a-4775-8452-afd5fb0b2408 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:24.610966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f477b9c-898a-4775-8452-afd5fb0b2408 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:24.611561 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f477b9c-898a-4775-8452-afd5fb0b2408 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:25.022880 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5705fd78-6929-4e54-b67e-8e01778339c7 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:25.061961 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5705fd78-6929-4e54-b67e-8e01778339c7 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1272 microversion: 2.1 time: 0.598178 Oct 29 03:04:25.066621 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1980/3792] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:24 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1272 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:25.083200 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6d537f2c-881d-4942-aacd-f73c179bc585 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:25.093141 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6d537f2c-881d-4942-aacd-f73c179bc585 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] [instance: b955d0c2-5679-4b7f-9c9b-92671911b574] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:25.539882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7f477b9c-898a-4775-8452-afd5fb0b2408 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:25.563420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6d537f2c-881d-4942-aacd-f73c179bc585 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52009279acbd46919353742edb6cf2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016dc7d91d1e4977ba712f7bed5218e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:25.579282 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7f477b9c-898a-4775-8452-afd5fb0b2408 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1313 microversion: 2.1 time: 0.996500 Oct 29 03:04:25.589454 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6d537f2c-881d-4942-aacd-f73c179bc585 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] 10.222.0.46 "GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574" status: 200 len: 1228 microversion: 2.1 time: 0.520023 Oct 29 03:04:25.592958 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1981/3793] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:25 2022] GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574 => generated 1228 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:25.624512 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-447f74f8-60c9-4e72-affb-5a454072d6cb tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:25.635660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-447f74f8-60c9-4e72-affb-5a454072d6cb tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] [instance: ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:25.649111 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1813/3794] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:24 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1313 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:25.664160 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1d1bf481-82d0-4c75-8808-55458d98d5c1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:25.665174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1d1bf481-82d0-4c75-8808-55458d98d5c1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:25.665723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-447f74f8-60c9-4e72-affb-5a454072d6cb tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:25.672161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-447f74f8-60c9-4e72-affb-5a454072d6cb tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:25.678808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-447f74f8-60c9-4e72-affb-5a454072d6cb tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:25.682950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-447f74f8-60c9-4e72-affb-5a454072d6cb tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:25.683708 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-447f74f8-60c9-4e72-affb-5a454072d6cb tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:25.687082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-447f74f8-60c9-4e72-affb-5a454072d6cb tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:25.703315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d1bf481-82d0-4c75-8808-55458d98d5c1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:25.704134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d1bf481-82d0-4c75-8808-55458d98d5c1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:25.704911 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d1bf481-82d0-4c75-8808-55458d98d5c1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:25.706180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d1bf481-82d0-4c75-8808-55458d98d5c1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:25.706962 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d1bf481-82d0-4c75-8808-55458d98d5c1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:25.707708 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d1bf481-82d0-4c75-8808-55458d98d5c1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:26.050549 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-447f74f8-60c9-4e72-affb-5a454072d6cb tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8167d8889f34242a559ac172f6cbf87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eeed762584cb8bddc59be33318b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:26.071414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-447f74f8-60c9-4e72-affb-5a454072d6cb tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8167d8889f34242a559ac172f6cbf87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eeed762584cb8bddc59be33318b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:26.072922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-447f74f8-60c9-4e72-affb-5a454072d6cb tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8167d8889f34242a559ac172f6cbf87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eeed762584cb8bddc59be33318b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:26.090717 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-447f74f8-60c9-4e72-affb-5a454072d6cb tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] 10.222.0.46 "GET /compute/v2.1/servers/ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c" status: 200 len: 1360 microversion: 2.47 time: 0.491473 Oct 29 03:04:26.094368 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1982/3795] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:25 2022] GET /compute/v2.1/servers/ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c => generated 1360 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:26.113800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-55b6bdb9-6e87-4a09-8d83-499839359e2f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:26.115822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-55b6bdb9-6e87-4a09-8d83-499839359e2f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:26.129999 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55b6bdb9-6e87-4a09-8d83-499839359e2f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:26.133651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55b6bdb9-6e87-4a09-8d83-499839359e2f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:26.137301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55b6bdb9-6e87-4a09-8d83-499839359e2f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:26.140767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55b6bdb9-6e87-4a09-8d83-499839359e2f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:26.141648 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55b6bdb9-6e87-4a09-8d83-499839359e2f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:26.143645 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55b6bdb9-6e87-4a09-8d83-499839359e2f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:26.190705 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:26.729212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-55b6bdb9-6e87-4a09-8d83-499839359e2f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:26.756079 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-55b6bdb9-6e87-4a09-8d83-499839359e2f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1314 microversion: 2.1 time: 0.660466 Oct 29 03:04:26.760450 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1983/3796] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:26 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1314 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:26.777765 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-79f983ea-7428-4949-a0ad-9a6dada2e373 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-818658467"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:26.784938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-79f983ea-7428-4949-a0ad-9a6dada2e373 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] [instance: ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:26.825984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79f983ea-7428-4949-a0ad-9a6dada2e373 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:26.827527 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79f983ea-7428-4949-a0ad-9a6dada2e373 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:26.828296 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79f983ea-7428-4949-a0ad-9a6dada2e373 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:26.829219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79f983ea-7428-4949-a0ad-9a6dada2e373 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:26.830839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79f983ea-7428-4949-a0ad-9a6dada2e373 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:26.836056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79f983ea-7428-4949-a0ad-9a6dada2e373 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:27.441610 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1d1bf481-82d0-4c75-8808-55458d98d5c1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:27.508605 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-79f983ea-7428-4949-a0ad-9a6dada2e373 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] 10.222.0.46 "POST /compute/v2.1/servers/ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c/action" status: 202 len: 52 microversion: 2.47 time: 0.741295 Oct 29 03:04:27.513171 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1984/3797] 10.222.0.46 () {62 vars in 1319 bytes} [Sat Oct 29 03:04:26 2022] POST /compute/v2.1/servers/ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c/action => generated 52 bytes in 752 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 29 03:04:27.518204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1d1bf481-82d0-4c75-8808-55458d98d5c1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:27.528057 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1d1bf481-82d0-4c75-8808-55458d98d5c1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:27.529921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e947e8ec-0b2e-4b2d-96cb-0d7f5db5ab4a tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:27.532215 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e947e8ec-0b2e-4b2d-96cb-0d7f5db5ab4a tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] [instance: b955d0c2-5679-4b7f-9c9b-92671911b574] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:27.539480 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1d1bf481-82d0-4c75-8808-55458d98d5c1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1731 microversion: 2.20 time: 1.883048 Oct 29 03:04:27.541320 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1814/3798] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:25 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1731 bytes in 1892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:27.553619 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-36f643ec-848f-4fe0-89db-594def731f4a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:27.557013 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-36f643ec-848f-4fe0-89db-594def731f4a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:27.574977 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36f643ec-848f-4fe0-89db-594def731f4a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:27.576742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36f643ec-848f-4fe0-89db-594def731f4a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:27.581810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36f643ec-848f-4fe0-89db-594def731f4a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:27.584367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36f643ec-848f-4fe0-89db-594def731f4a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:27.586702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36f643ec-848f-4fe0-89db-594def731f4a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:27.589788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36f643ec-848f-4fe0-89db-594def731f4a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:27.601512 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e947e8ec-0b2e-4b2d-96cb-0d7f5db5ab4a tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:27.606066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e947e8ec-0b2e-4b2d-96cb-0d7f5db5ab4a tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:27.609853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e947e8ec-0b2e-4b2d-96cb-0d7f5db5ab4a tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:27.613276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e947e8ec-0b2e-4b2d-96cb-0d7f5db5ab4a tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:27.614130 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e947e8ec-0b2e-4b2d-96cb-0d7f5db5ab4a tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:27.615137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e947e8ec-0b2e-4b2d-96cb-0d7f5db5ab4a tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:27.830604 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e947e8ec-0b2e-4b2d-96cb-0d7f5db5ab4a tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52009279acbd46919353742edb6cf2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016dc7d91d1e4977ba712f7bed5218e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:27.890554 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e947e8ec-0b2e-4b2d-96cb-0d7f5db5ab4a tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] 10.222.0.46 "GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574" status: 200 len: 1288 microversion: 2.1 time: 0.374107 Oct 29 03:04:27.894374 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1985/3799] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:27 2022] GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574 => generated 1288 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:27.916789 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ab365ba5-5044-4506-89a9-9979fbd3ff67 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:27.925926 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ab365ba5-5044-4506-89a9-9979fbd3ff67 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] [instance: ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:27.944224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ab365ba5-5044-4506-89a9-9979fbd3ff67 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:27.947504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ab365ba5-5044-4506-89a9-9979fbd3ff67 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:27.949322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ab365ba5-5044-4506-89a9-9979fbd3ff67 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:27.954247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ab365ba5-5044-4506-89a9-9979fbd3ff67 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:27.955440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ab365ba5-5044-4506-89a9-9979fbd3ff67 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:27.956966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ab365ba5-5044-4506-89a9-9979fbd3ff67 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:28.017160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ab365ba5-5044-4506-89a9-9979fbd3ff67 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] [instance: ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:04:28.255192 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ab365ba5-5044-4506-89a9-9979fbd3ff67 tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c" status: 204 len: 0 microversion: 2.47 time: 0.348475 Oct 29 03:04:28.256017 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1986/3800] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Oct 29 03:04:27 2022] DELETE /compute/v2.1/servers/ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:04:28.287089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7ac4d965-6eb9-450e-bc78-dc1d8a39c397 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:28.288514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7ac4d965-6eb9-450e-bc78-dc1d8a39c397 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:28.317447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ac4d965-6eb9-450e-bc78-dc1d8a39c397 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:28.319620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ac4d965-6eb9-450e-bc78-dc1d8a39c397 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:28.324607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ac4d965-6eb9-450e-bc78-dc1d8a39c397 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:28.327257 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ac4d965-6eb9-450e-bc78-dc1d8a39c397 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:28.330441 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ac4d965-6eb9-450e-bc78-dc1d8a39c397 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:28.332860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ac4d965-6eb9-450e-bc78-dc1d8a39c397 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:28.633423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-36f643ec-848f-4fe0-89db-594def731f4a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:28.678208 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-36f643ec-848f-4fe0-89db-594def731f4a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1313 microversion: 2.1 time: 1.127266 Oct 29 03:04:28.681103 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1815/3801] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:27 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1313 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:28.709275 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b6a65a87-2828-4483-abb4-9533de69177a tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:28.713487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b6a65a87-2828-4483-abb4-9533de69177a tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] [instance: ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:28.739824 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6a65a87-2828-4483-abb4-9533de69177a tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:28.742387 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6a65a87-2828-4483-abb4-9533de69177a tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:28.744473 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6a65a87-2828-4483-abb4-9533de69177a tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:28.750126 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6a65a87-2828-4483-abb4-9533de69177a tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:28.751100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6a65a87-2828-4483-abb4-9533de69177a tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:28.752713 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6a65a87-2828-4483-abb4-9533de69177a tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:29.140147 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b6a65a87-2828-4483-abb4-9533de69177a tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8167d8889f34242a559ac172f6cbf87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eeed762584cb8bddc59be33318b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:29.160764 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b6a65a87-2828-4483-abb4-9533de69177a tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8167d8889f34242a559ac172f6cbf87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eeed762584cb8bddc59be33318b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:29.165228 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b6a65a87-2828-4483-abb4-9533de69177a tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8167d8889f34242a559ac172f6cbf87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eeed762584cb8bddc59be33318b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:29.167731 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b6a65a87-2828-4483-abb4-9533de69177a tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] 10.222.0.46 "GET /compute/v2.1/servers/ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c" status: 200 len: 1366 microversion: 2.47 time: 0.483888 Oct 29 03:04:29.176686 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1816/3802] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:28 2022] GET /compute/v2.1/servers/ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c => generated 1366 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:29.191509 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8aa0a18d-a7f1-4b09-8e8c-919e83c50f96 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:29.192474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8aa0a18d-a7f1-4b09-8e8c-919e83c50f96 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:29.206409 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8aa0a18d-a7f1-4b09-8e8c-919e83c50f96 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:29.207562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8aa0a18d-a7f1-4b09-8e8c-919e83c50f96 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:29.208511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8aa0a18d-a7f1-4b09-8e8c-919e83c50f96 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:29.210776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8aa0a18d-a7f1-4b09-8e8c-919e83c50f96 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:29.211858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8aa0a18d-a7f1-4b09-8e8c-919e83c50f96 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:29.213683 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8aa0a18d-a7f1-4b09-8e8c-919e83c50f96 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:29.434206 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7ac4d965-6eb9-450e-bc78-dc1d8a39c397 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:29.444211 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7ac4d965-6eb9-450e-bc78-dc1d8a39c397 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1314 microversion: 2.1 time: 1.186827 Oct 29 03:04:29.449133 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1987/3803] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:28 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1314 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:29.454388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f31b8d15-9c44-48f7-91c3-c7442a417d1b tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:29.460755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f31b8d15-9c44-48f7-91c3-c7442a417d1b tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] [instance: b955d0c2-5679-4b7f-9c9b-92671911b574] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:29.476829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f31b8d15-9c44-48f7-91c3-c7442a417d1b tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:29.477351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f31b8d15-9c44-48f7-91c3-c7442a417d1b tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:29.485264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f31b8d15-9c44-48f7-91c3-c7442a417d1b tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:29.486505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f31b8d15-9c44-48f7-91c3-c7442a417d1b tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:29.487191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f31b8d15-9c44-48f7-91c3-c7442a417d1b tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:29.488412 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f31b8d15-9c44-48f7-91c3-c7442a417d1b tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:29.708824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f31b8d15-9c44-48f7-91c3-c7442a417d1b tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52009279acbd46919353742edb6cf2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016dc7d91d1e4977ba712f7bed5218e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:29.749275 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f31b8d15-9c44-48f7-91c3-c7442a417d1b tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] 10.222.0.46 "GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574" status: 200 len: 1286 microversion: 2.1 time: 0.298748 Oct 29 03:04:29.750414 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1988/3804] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:29 2022] GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574 => generated 1286 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:29.756359 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8aa0a18d-a7f1-4b09-8e8c-919e83c50f96 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:29.768392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8aa0a18d-a7f1-4b09-8e8c-919e83c50f96 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:29.770985 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8aa0a18d-a7f1-4b09-8e8c-919e83c50f96 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:29.773085 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8aa0a18d-a7f1-4b09-8e8c-919e83c50f96 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1731 microversion: 2.20 time: 0.594603 Oct 29 03:04:29.781201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-2bcf5358-02be-4bf3-8824-feddd9bfdce0 req-c2a19ae3-3393-46b5-a42d-2dedea973bcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34628535-7e50-432b-9baf-a1d9b841a1ec", "tag": "a2e09809-ccdf-450a-a30b-75e01aaa1eef"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:29.808829 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1817/3805] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:29 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1731 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:29.820994 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c4f8a25e-aabc-46dd-9b6c-841d91ee47b8 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:29.821718 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c4f8a25e-aabc-46dd-9b6c-841d91ee47b8 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:29.822418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-2bcf5358-02be-4bf3-8824-feddd9bfdce0 req-c2a19ae3-3393-46b5-a42d-2dedea973bcf service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:29.824333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-2bcf5358-02be-4bf3-8824-feddd9bfdce0 req-c2a19ae3-3393-46b5-a42d-2dedea973bcf service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:29.826144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-2bcf5358-02be-4bf3-8824-feddd9bfdce0 req-c2a19ae3-3393-46b5-a42d-2dedea973bcf service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:29.835769 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c4f8a25e-aabc-46dd-9b6c-841d91ee47b8 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:29.836325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c4f8a25e-aabc-46dd-9b6c-841d91ee47b8 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:29.836899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c4f8a25e-aabc-46dd-9b6c-841d91ee47b8 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:29.837696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c4f8a25e-aabc-46dd-9b6c-841d91ee47b8 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:29.838220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c4f8a25e-aabc-46dd-9b6c-841d91ee47b8 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:29.838673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c4f8a25e-aabc-46dd-9b6c-841d91ee47b8 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:29.895741 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-2bcf5358-02be-4bf3-8824-feddd9bfdce0 req-c2a19ae3-3393-46b5-a42d-2dedea973bcf service nova] Creating event network-changed:a2e09809-ccdf-450a-a30b-75e01aaa1eef for instance 34628535-7e50-432b-9baf-a1d9b841a1ec on n-h1-862967-2 Oct 29 03:04:29.913520 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-2bcf5358-02be-4bf3-8824-feddd9bfdce0 req-c2a19ae3-3393-46b5-a42d-2dedea973bcf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161407 Oct 29 03:04:29.914152 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1989/3806] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:29.921749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-b9561d95-5dde-48e7-a83e-d68ac70e6cce req-b2a80a6b-ecbf-46e9-a960-10d182fe59a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66aafb24-5370-4be8-ab86-467f0a0e9f0e", "tag": "4a27e218-de2c-496e-866d-d2b68459a080"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:29.933500 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b9561d95-5dde-48e7-a83e-d68ac70e6cce req-b2a80a6b-ecbf-46e9-a960-10d182fe59a1 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:29.933985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b9561d95-5dde-48e7-a83e-d68ac70e6cce req-b2a80a6b-ecbf-46e9-a960-10d182fe59a1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:29.934424 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b9561d95-5dde-48e7-a83e-d68ac70e6cce req-b2a80a6b-ecbf-46e9-a960-10d182fe59a1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:29.947532 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-b9561d95-5dde-48e7-a83e-d68ac70e6cce req-b2a80a6b-ecbf-46e9-a960-10d182fe59a1 service nova] Creating event network-changed:4a27e218-de2c-496e-866d-d2b68459a080 for instance 66aafb24-5370-4be8-ab86-467f0a0e9f0e on n-h2-862967-2 Oct 29 03:04:29.953512 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-b9561d95-5dde-48e7-a83e-d68ac70e6cce req-b2a80a6b-ecbf-46e9-a960-10d182fe59a1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035532 Oct 29 03:04:29.955409 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1990/3807] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:30.209557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bb3dd4ae-43a9-4967-a353-c37ab26321ad tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:30.210509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bb3dd4ae-43a9-4967-a353-c37ab26321ad tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] [instance: ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:30.240083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb3dd4ae-43a9-4967-a353-c37ab26321ad tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:30.240821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb3dd4ae-43a9-4967-a353-c37ab26321ad tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:30.241882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb3dd4ae-43a9-4967-a353-c37ab26321ad tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:30.243559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb3dd4ae-43a9-4967-a353-c37ab26321ad tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:30.245688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb3dd4ae-43a9-4967-a353-c37ab26321ad tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:30.247755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb3dd4ae-43a9-4967-a353-c37ab26321ad tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:30.484249 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c4f8a25e-aabc-46dd-9b6c-841d91ee47b8 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:30.506006 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c4f8a25e-aabc-46dd-9b6c-841d91ee47b8 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1313 microversion: 2.1 time: 0.695877 Oct 29 03:04:30.521550 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1818/3808] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:29 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1313 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:30.553231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5ede8a4b-a424-497c-a464-800771ea2e68 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:30.554847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5ede8a4b-a424-497c-a464-800771ea2e68 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:30.581648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ede8a4b-a424-497c-a464-800771ea2e68 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:30.585589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ede8a4b-a424-497c-a464-800771ea2e68 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:30.588056 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ede8a4b-a424-497c-a464-800771ea2e68 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:30.598300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ede8a4b-a424-497c-a464-800771ea2e68 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:30.602625 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ede8a4b-a424-497c-a464-800771ea2e68 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:30.603738 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ede8a4b-a424-497c-a464-800771ea2e68 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:30.737422 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:30.881492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bb3dd4ae-43a9-4967-a353-c37ab26321ad tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8167d8889f34242a559ac172f6cbf87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eeed762584cb8bddc59be33318b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:30.945268 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bb3dd4ae-43a9-4967-a353-c37ab26321ad tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8167d8889f34242a559ac172f6cbf87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eeed762584cb8bddc59be33318b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:30.953477 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bb3dd4ae-43a9-4967-a353-c37ab26321ad tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8167d8889f34242a559ac172f6cbf87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eeed762584cb8bddc59be33318b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:30.959224 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bb3dd4ae-43a9-4967-a353-c37ab26321ad tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] 10.222.0.46 "GET /compute/v2.1/servers/ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c" status: 200 len: 1366 microversion: 2.47 time: 0.762287 Oct 29 03:04:30.981046 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1991/3809] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:30 2022] GET /compute/v2.1/servers/ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c => generated 1366 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:31.003469 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-10a617e7-472a-464c-b5e6-13b147e8af40 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:31.004197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-10a617e7-472a-464c-b5e6-13b147e8af40 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] [instance: b955d0c2-5679-4b7f-9c9b-92671911b574] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:31.038527 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10a617e7-472a-464c-b5e6-13b147e8af40 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:31.039044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10a617e7-472a-464c-b5e6-13b147e8af40 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:31.045252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10a617e7-472a-464c-b5e6-13b147e8af40 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:31.049620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10a617e7-472a-464c-b5e6-13b147e8af40 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:31.053202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10a617e7-472a-464c-b5e6-13b147e8af40 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:31.054632 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10a617e7-472a-464c-b5e6-13b147e8af40 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:31.608556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5ede8a4b-a424-497c-a464-800771ea2e68 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:31.622623 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5ede8a4b-a424-497c-a464-800771ea2e68 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1314 microversion: 2.1 time: 1.088186 Oct 29 03:04:31.623291 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1819/3810] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:30 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1314 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:31.652848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-47fb890c-2b5b-42fd-88b2-1c3a9b749853 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:31.654135 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-47fb890c-2b5b-42fd-88b2-1c3a9b749853 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:31.677040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47fb890c-2b5b-42fd-88b2-1c3a9b749853 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:31.679847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47fb890c-2b5b-42fd-88b2-1c3a9b749853 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:31.682725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47fb890c-2b5b-42fd-88b2-1c3a9b749853 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:31.684366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47fb890c-2b5b-42fd-88b2-1c3a9b749853 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:31.686287 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47fb890c-2b5b-42fd-88b2-1c3a9b749853 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:31.688781 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47fb890c-2b5b-42fd-88b2-1c3a9b749853 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:31.955389 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-10a617e7-472a-464c-b5e6-13b147e8af40 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52009279acbd46919353742edb6cf2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016dc7d91d1e4977ba712f7bed5218e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:31.980396 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-10a617e7-472a-464c-b5e6-13b147e8af40 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] 10.222.0.46 "GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574" status: 200 len: 1328 microversion: 2.1 time: 0.997793 Oct 29 03:04:31.981690 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1992/3811] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:30 2022] GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574 => generated 1328 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:31.998184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e7532638-8c15-4d64-bb69-4e4b45dbf511 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:31.999962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e7532638-8c15-4d64-bb69-4e4b45dbf511 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:32.017724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7532638-8c15-4d64-bb69-4e4b45dbf511 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:32.027076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7532638-8c15-4d64-bb69-4e4b45dbf511 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:32.028065 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7532638-8c15-4d64-bb69-4e4b45dbf511 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:32.029538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7532638-8c15-4d64-bb69-4e4b45dbf511 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:32.030446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7532638-8c15-4d64-bb69-4e4b45dbf511 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:32.031201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7532638-8c15-4d64-bb69-4e4b45dbf511 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:32.527804 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e7532638-8c15-4d64-bb69-4e4b45dbf511 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:32.542924 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e7532638-8c15-4d64-bb69-4e4b45dbf511 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1313 microversion: 2.1 time: 0.559688 Oct 29 03:04:32.556559 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1993/3812] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:31 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1313 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:33.319707 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-47fb890c-2b5b-42fd-88b2-1c3a9b749853 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:33.326174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8716c680-4ad0-4a39-bf11-a49d7a86f278 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:33.335726 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8716c680-4ad0-4a39-bf11-a49d7a86f278 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:33.357718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8716c680-4ad0-4a39-bf11-a49d7a86f278 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:33.359728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-47fb890c-2b5b-42fd-88b2-1c3a9b749853 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:33.363476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8716c680-4ad0-4a39-bf11-a49d7a86f278 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:33.365570 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8716c680-4ad0-4a39-bf11-a49d7a86f278 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:33.367240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-47fb890c-2b5b-42fd-88b2-1c3a9b749853 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:33.370683 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-47fb890c-2b5b-42fd-88b2-1c3a9b749853 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1731 microversion: 2.20 time: 1.736376 Oct 29 03:04:33.371569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8716c680-4ad0-4a39-bf11-a49d7a86f278 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:33.372781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8716c680-4ad0-4a39-bf11-a49d7a86f278 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:33.373915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8716c680-4ad0-4a39-bf11-a49d7a86f278 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:33.375324 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1820/3813] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:31 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1731 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:33.395067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-27278a2d-7620-46f7-9d07-59d69b01360e tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:33.401884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-27278a2d-7620-46f7-9d07-59d69b01360e tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] [instance: ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:33.424954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27278a2d-7620-46f7-9d07-59d69b01360e tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:33.431086 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27278a2d-7620-46f7-9d07-59d69b01360e tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:33.432498 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27278a2d-7620-46f7-9d07-59d69b01360e tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:33.440378 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27278a2d-7620-46f7-9d07-59d69b01360e tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:33.441844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27278a2d-7620-46f7-9d07-59d69b01360e tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:33.448997 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27278a2d-7620-46f7-9d07-59d69b01360e tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:33.567179 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8716c680-4ad0-4a39-bf11-a49d7a86f278 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:04:33.698404 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27278a2d-7620-46f7-9d07-59d69b01360e tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:33.701381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27278a2d-7620-46f7-9d07-59d69b01360e tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:33.706164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27278a2d-7620-46f7-9d07-59d69b01360e tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:33.707566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-27278a2d-7620-46f7-9d07-59d69b01360e tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lazy-loading 'fault' on Instance uuid ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:04:34.028980 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8716c680-4ad0-4a39-bf11-a49d7a86f278 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 204 len: 0 microversion: 2.32 time: 1.477192 Oct 29 03:04:34.035762 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1994/3814] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Oct 29 03:04:32 2022] DELETE /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 0 bytes in 1487 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:04:34.063079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c561c63d-1fb2-43f4-9b43-89de2e5c3e9a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:34.070488 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c561c63d-1fb2-43f4-9b43-89de2e5c3e9a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:34.096102 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c561c63d-1fb2-43f4-9b43-89de2e5c3e9a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:34.096102 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c561c63d-1fb2-43f4-9b43-89de2e5c3e9a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:34.096563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c561c63d-1fb2-43f4-9b43-89de2e5c3e9a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:34.106431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c561c63d-1fb2-43f4-9b43-89de2e5c3e9a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:34.107139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c561c63d-1fb2-43f4-9b43-89de2e5c3e9a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:34.111610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c561c63d-1fb2-43f4-9b43-89de2e5c3e9a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:34.178774 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-27278a2d-7620-46f7-9d07-59d69b01360e tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8167d8889f34242a559ac172f6cbf87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eeed762584cb8bddc59be33318b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:34.208727 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-27278a2d-7620-46f7-9d07-59d69b01360e tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a8167d8889f34242a559ac172f6cbf87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eeed762584cb8bddc59be33318b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:34.211168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-27278a2d-7620-46f7-9d07-59d69b01360e tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a8167d8889f34242a559ac172f6cbf87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd88eeed762584cb8bddc59be33318b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:34.230969 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-27278a2d-7620-46f7-9d07-59d69b01360e tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] 10.222.0.46 "GET /compute/v2.1/servers/ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c" status: 200 len: 1371 microversion: 2.47 time: 0.835015 Oct 29 03:04:34.232034 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1821/3815] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:33 2022] GET /compute/v2.1/servers/ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c => generated 1371 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:34.261573 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5ea22528-e8e7-4d99-9f46-bbe10887d27b tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:34.262688 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5ea22528-e8e7-4d99-9f46-bbe10887d27b tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] [instance: b955d0c2-5679-4b7f-9c9b-92671911b574] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:34.316073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:34.322426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ea22528-e8e7-4d99-9f46-bbe10887d27b tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:34.324457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ea22528-e8e7-4d99-9f46-bbe10887d27b tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:34.325051 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ea22528-e8e7-4d99-9f46-bbe10887d27b tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:34.328053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ea22528-e8e7-4d99-9f46-bbe10887d27b tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:34.328973 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ea22528-e8e7-4d99-9f46-bbe10887d27b tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:34.329790 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ea22528-e8e7-4d99-9f46-bbe10887d27b tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:34.394169 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:UPDATE=7,nova_cell1:INSERT=3,nova_cell1:SELECT=90 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:34.397429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:34.813743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5ea22528-e8e7-4d99-9f46-bbe10887d27b tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52009279acbd46919353742edb6cf2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016dc7d91d1e4977ba712f7bed5218e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:34.831402 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5ea22528-e8e7-4d99-9f46-bbe10887d27b tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] 10.222.0.46 "GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574" status: 200 len: 1328 microversion: 2.1 time: 0.597701 Oct 29 03:04:34.848809 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1822/3816] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:34 2022] GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574 => generated 1328 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:34.869185 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4e8bb8a8-da11-495f-8bda-07eb0ec3e9c2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:34.870513 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4e8bb8a8-da11-495f-8bda-07eb0ec3e9c2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:34.907136 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e8bb8a8-da11-495f-8bda-07eb0ec3e9c2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:34.908034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e8bb8a8-da11-495f-8bda-07eb0ec3e9c2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:34.909383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e8bb8a8-da11-495f-8bda-07eb0ec3e9c2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:34.910663 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e8bb8a8-da11-495f-8bda-07eb0ec3e9c2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:34.911455 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e8bb8a8-da11-495f-8bda-07eb0ec3e9c2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:34.916437 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e8bb8a8-da11-495f-8bda-07eb0ec3e9c2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:35.028582 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c561c63d-1fb2-43f4-9b43-89de2e5c3e9a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:35.043809 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c561c63d-1fb2-43f4-9b43-89de2e5c3e9a tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1314 microversion: 2.1 time: 0.999131 Oct 29 03:04:35.065431 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1995/3817] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:34 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1314 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:35.095880 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-864ef03f-f678-43d1-9e57-8f580ba79726 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:35.097196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-864ef03f-f678-43d1-9e57-8f580ba79726 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:35.106148 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-864ef03f-f678-43d1-9e57-8f580ba79726 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:35.106795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-864ef03f-f678-43d1-9e57-8f580ba79726 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:35.107505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-864ef03f-f678-43d1-9e57-8f580ba79726 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:35.109076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-864ef03f-f678-43d1-9e57-8f580ba79726 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:35.110016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-864ef03f-f678-43d1-9e57-8f580ba79726 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:35.110542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-864ef03f-f678-43d1-9e57-8f580ba79726 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:35.573688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-864ef03f-f678-43d1-9e57-8f580ba79726 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:35.580102 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=18 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:35.582327 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:35.598703 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-864ef03f-f678-43d1-9e57-8f580ba79726 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:35.601798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-864ef03f-f678-43d1-9e57-8f580ba79726 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:35.604262 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-864ef03f-f678-43d1-9e57-8f580ba79726 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 2955 microversion: 2.32 time: 0.519168 Oct 29 03:04:35.605896 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1996/3818] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:35 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 2955 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:35.615282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5691d339-e9d0-426e-905d-477c833c1aae tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:35.617081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5691d339-e9d0-426e-905d-477c833c1aae tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:35.628870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5691d339-e9d0-426e-905d-477c833c1aae tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:35.630007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5691d339-e9d0-426e-905d-477c833c1aae tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:35.631006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5691d339-e9d0-426e-905d-477c833c1aae tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:35.632620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5691d339-e9d0-426e-905d-477c833c1aae tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:35.634069 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5691d339-e9d0-426e-905d-477c833c1aae tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:35.635054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5691d339-e9d0-426e-905d-477c833c1aae tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:35.853716 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5691d339-e9d0-426e-905d-477c833c1aae tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:35.868446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5691d339-e9d0-426e-905d-477c833c1aae tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:35.871016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5691d339-e9d0-426e-905d-477c833c1aae tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:35.873149 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5691d339-e9d0-426e-905d-477c833c1aae tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1731 microversion: 2.20 time: 0.265518 Oct 29 03:04:35.874268 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1997/3819] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:35 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1731 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:35.903267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-18500d39-4caf-48fa-9d63-03a0b10ad8cb req-f55b8054-eeb1-4646-a0e6-03137a42ad2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66aafb24-5370-4be8-ab86-467f0a0e9f0e", "name": "network-vif-plugged", "status": "completed", "tag": "4a27e218-de2c-496e-866d-d2b68459a080"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:35.915945 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-18500d39-4caf-48fa-9d63-03a0b10ad8cb req-f55b8054-eeb1-4646-a0e6-03137a42ad2b service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:35.916782 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-18500d39-4caf-48fa-9d63-03a0b10ad8cb req-f55b8054-eeb1-4646-a0e6-03137a42ad2b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:35.917246 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-18500d39-4caf-48fa-9d63-03a0b10ad8cb req-f55b8054-eeb1-4646-a0e6-03137a42ad2b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:35.931926 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-18500d39-4caf-48fa-9d63-03a0b10ad8cb req-f55b8054-eeb1-4646-a0e6-03137a42ad2b service nova] Creating event network-vif-plugged:4a27e218-de2c-496e-866d-d2b68459a080 for instance 66aafb24-5370-4be8-ab86-467f0a0e9f0e on n-h2-862967-2 Oct 29 03:04:35.937581 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-18500d39-4caf-48fa-9d63-03a0b10ad8cb req-f55b8054-eeb1-4646-a0e6-03137a42ad2b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050131 Oct 29 03:04:35.938317 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1998/3820] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:35.945203 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-188379de-129a-4a70-a83b-faafdbf6080c tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:35.946164 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-188379de-129a-4a70-a83b-faafdbf6080c tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] [instance: ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:35.949612 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:35.957032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4e8bb8a8-da11-495f-8bda-07eb0ec3e9c2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:35.965686 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-188379de-129a-4a70-a83b-faafdbf6080c tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:35.966332 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4e8bb8a8-da11-495f-8bda-07eb0ec3e9c2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1313 microversion: 2.1 time: 1.126171 Oct 29 03:04:35.980557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-188379de-129a-4a70-a83b-faafdbf6080c tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:35.980557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-188379de-129a-4a70-a83b-faafdbf6080c tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:35.980557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-188379de-129a-4a70-a83b-faafdbf6080c tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:35.980557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-188379de-129a-4a70-a83b-faafdbf6080c tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:35.980557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-188379de-129a-4a70-a83b-faafdbf6080c tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:35.981944 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1823/3821] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:34 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1313 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:35.996451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-0fc8d568-3eb2-45fb-ac01-a703f7eebba4 req-5fcbf3c1-9bcb-4d5a-89bd-6896f1e9d94e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b955d0c2-5679-4b7f-9c9b-92671911b574", "tag": "59f467cf-8375-47a8-a788-87ff021e0b37"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:36.009205 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-188379de-129a-4a70-a83b-faafdbf6080c tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] HTTP exception thrown: Instance ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c could not be found. Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-188379de-129a-4a70-a83b-faafdbf6080c tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Request method failure captured: Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c HTTP/1.1 Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJguJexxGp9lqxyjU-Epq7CD0m_whvVQ9dCQH4q7yXwWUqD_GT_TgOGryUId_SoDVEmyW0X7Qo19DzPxBddDc8IjSOGOdXaAoKaOQ4zo4q8P_o8XFAtGG0-GuyI0IAxQsJPf45YAcQL9QmjsS3hRXvNu7hJdibaHguZm63ScCb7CXzI Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: X-Openstack-Nova-Api-Version: 2.47 Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: d88eeed762584cb8bddc59be33318b79 Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersAaction247Test-1782021113 Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d88eeed762584cb8bddc59be33318b79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d88eeed762584cb8bddc59be33318b79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d88eeed762584cb8bddc59be33318b79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d88eeed762584cb8bddc59be33318b79"}]}] Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersAaction247Test-1782021113 Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: d88eeed762584cb8bddc59be33318b79 Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersAaction247Test-1782021113 Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersAaction247Test-1782021113-project Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: a8167d8889f34242a559ac172f6cbf87 Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersAaction247Test-1782021113-project Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c could not be found. Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c'} Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c could not be found. Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c could not be found. Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:04:36.011152 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:36.021871 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:04:36.021871 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:36.021871 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:36.021871 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:36.021871 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:04:36.021871 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:04:36.021871 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c could not be found. Oct 29 03:04:36.021871 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:04:36.021871 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-188379de-129a-4a70-a83b-faafdbf6080c tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] Returning 404 to user: Instance ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:04:36.021871 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-188379de-129a-4a70-a83b-faafdbf6080c tempest-ServersAaction247Test-1782021113 tempest-ServersAaction247Test-1782021113-project] 10.222.0.46 "GET /compute/v2.1/servers/ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c" status: 404 len: 111 microversion: 2.47 time: 0.076102 Oct 29 03:04:36.021871 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 1999/3822] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:35 2022] GET /compute/v2.1/servers/ecab1cfa-3ee6-4e7a-ab6e-9300ec79795c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:04:36.026945 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8dc8e1d4-e662-4fac-a960-1605f7d9ebe8 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:36.029616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8dc8e1d4-e662-4fac-a960-1605f7d9ebe8 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] [instance: b955d0c2-5679-4b7f-9c9b-92671911b574] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:36.030287 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:36.032959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0fc8d568-3eb2-45fb-ac01-a703f7eebba4 req-5fcbf3c1-9bcb-4d5a-89bd-6896f1e9d94e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:36.033697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0fc8d568-3eb2-45fb-ac01-a703f7eebba4 req-5fcbf3c1-9bcb-4d5a-89bd-6896f1e9d94e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:36.034367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0fc8d568-3eb2-45fb-ac01-a703f7eebba4 req-5fcbf3c1-9bcb-4d5a-89bd-6896f1e9d94e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:36.040865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8dc8e1d4-e662-4fac-a960-1605f7d9ebe8 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:36.043784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8dc8e1d4-e662-4fac-a960-1605f7d9ebe8 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:36.044729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8dc8e1d4-e662-4fac-a960-1605f7d9ebe8 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:36.046181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8dc8e1d4-e662-4fac-a960-1605f7d9ebe8 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:36.046835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8dc8e1d4-e662-4fac-a960-1605f7d9ebe8 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:36.047485 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8dc8e1d4-e662-4fac-a960-1605f7d9ebe8 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:36.431951 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8dc8e1d4-e662-4fac-a960-1605f7d9ebe8 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52009279acbd46919353742edb6cf2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016dc7d91d1e4977ba712f7bed5218e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:36.445207 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8dc8e1d4-e662-4fac-a960-1605f7d9ebe8 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] 10.222.0.46 "GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574" status: 200 len: 1328 microversion: 2.1 time: 0.422324 Oct 29 03:04:36.448559 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2000/3823] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:36 2022] GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574 => generated 1328 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:36.456763 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a16a7921-9879-4668-83a6-ab7115cbf3a4 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:36.457871 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a16a7921-9879-4668-83a6-ab7115cbf3a4 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:36.476433 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a16a7921-9879-4668-83a6-ab7115cbf3a4 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:36.477366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a16a7921-9879-4668-83a6-ab7115cbf3a4 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:36.483640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a16a7921-9879-4668-83a6-ab7115cbf3a4 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:36.484852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a16a7921-9879-4668-83a6-ab7115cbf3a4 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:36.485604 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a16a7921-9879-4668-83a6-ab7115cbf3a4 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:36.486309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a16a7921-9879-4668-83a6-ab7115cbf3a4 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:36.726244 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-0fc8d568-3eb2-45fb-ac01-a703f7eebba4 req-5fcbf3c1-9bcb-4d5a-89bd-6896f1e9d94e service nova] Creating event network-changed:59f467cf-8375-47a8-a788-87ff021e0b37 for instance b955d0c2-5679-4b7f-9c9b-92671911b574 on n-h2-862967-2 Oct 29 03:04:36.733599 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-0fc8d568-3eb2-45fb-ac01-a703f7eebba4 req-5fcbf3c1-9bcb-4d5a-89bd-6896f1e9d94e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.749896 Oct 29 03:04:36.734773 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1824/3824] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:36.740358 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7ae69478-ff76-4cd5-8dff-4732d082c25e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:36.741355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7ae69478-ff76-4cd5-8dff-4732d082c25e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:36.748949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ae69478-ff76-4cd5-8dff-4732d082c25e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:36.749704 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ae69478-ff76-4cd5-8dff-4732d082c25e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:36.750321 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ae69478-ff76-4cd5-8dff-4732d082c25e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:36.751206 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ae69478-ff76-4cd5-8dff-4732d082c25e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:36.751831 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ae69478-ff76-4cd5-8dff-4732d082c25e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:36.752429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ae69478-ff76-4cd5-8dff-4732d082c25e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:36.836989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a16a7921-9879-4668-83a6-ab7115cbf3a4 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:36.861593 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a16a7921-9879-4668-83a6-ab7115cbf3a4 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1314 microversion: 2.1 time: 0.409143 Oct 29 03:04:36.886776 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2001/3825] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:36 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:36.916888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a8270ab3-8aab-40de-a8cc-e2ddf34b43d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:36.917533 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a8270ab3-8aab-40de-a8cc-e2ddf34b43d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:36.934704 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8270ab3-8aab-40de-a8cc-e2ddf34b43d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:36.937007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8270ab3-8aab-40de-a8cc-e2ddf34b43d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:36.938482 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8270ab3-8aab-40de-a8cc-e2ddf34b43d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:36.939432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8270ab3-8aab-40de-a8cc-e2ddf34b43d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:36.939900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8270ab3-8aab-40de-a8cc-e2ddf34b43d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:36.940849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8270ab3-8aab-40de-a8cc-e2ddf34b43d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:37.198297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a8270ab3-8aab-40de-a8cc-e2ddf34b43d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:37.221080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7ae69478-ff76-4cd5-8dff-4732d082c25e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:37.227232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a8270ab3-8aab-40de-a8cc-e2ddf34b43d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:37.234896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7ae69478-ff76-4cd5-8dff-4732d082c25e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:37.237379 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7ae69478-ff76-4cd5-8dff-4732d082c25e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:37.239603 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7ae69478-ff76-4cd5-8dff-4732d082c25e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 2955 microversion: 2.32 time: 0.503243 Oct 29 03:04:37.241149 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1825/3826] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:36 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 2955 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:37.246287 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6af896a8-d3c8-4e3e-9847-e2fb79ed1006 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:37.247292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6af896a8-d3c8-4e3e-9847-e2fb79ed1006 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:37.253950 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6af896a8-d3c8-4e3e-9847-e2fb79ed1006 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:37.254741 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6af896a8-d3c8-4e3e-9847-e2fb79ed1006 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:37.255628 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6af896a8-d3c8-4e3e-9847-e2fb79ed1006 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:37.256579 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6af896a8-d3c8-4e3e-9847-e2fb79ed1006 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:37.258158 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6af896a8-d3c8-4e3e-9847-e2fb79ed1006 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:37.258870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a8270ab3-8aab-40de-a8cc-e2ddf34b43d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:37.260346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6af896a8-d3c8-4e3e-9847-e2fb79ed1006 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:37.261994 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a8270ab3-8aab-40de-a8cc-e2ddf34b43d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1731 microversion: 2.20 time: 0.350914 Oct 29 03:04:37.264037 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2002/3827] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:36 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1731 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:37.475746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5f87d0b6-a980-4ea3-ad83-0bad0111122f tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:37.476654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5f87d0b6-a980-4ea3-ad83-0bad0111122f tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] [instance: b955d0c2-5679-4b7f-9c9b-92671911b574] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:37.496478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f87d0b6-a980-4ea3-ad83-0bad0111122f tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:37.497119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f87d0b6-a980-4ea3-ad83-0bad0111122f tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:37.497571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f87d0b6-a980-4ea3-ad83-0bad0111122f tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:37.498455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f87d0b6-a980-4ea3-ad83-0bad0111122f tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:37.498979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f87d0b6-a980-4ea3-ad83-0bad0111122f tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:37.499500 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f87d0b6-a980-4ea3-ad83-0bad0111122f tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:37.793385 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5f87d0b6-a980-4ea3-ad83-0bad0111122f tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52009279acbd46919353742edb6cf2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016dc7d91d1e4977ba712f7bed5218e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:37.820432 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5f87d0b6-a980-4ea3-ad83-0bad0111122f tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] 10.222.0.46 "GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574" status: 200 len: 1328 microversion: 2.1 time: 0.349285 Oct 29 03:04:37.822613 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2003/3828] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:37 2022] GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574 => generated 1328 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:37.900630 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-67888b93-71af-4da2-ad4a-0239904eeb59 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:37.906127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-67888b93-71af-4da2-ad4a-0239904eeb59 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:37.911677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6af896a8-d3c8-4e3e-9847-e2fb79ed1006 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:37.928329 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6af896a8-d3c8-4e3e-9847-e2fb79ed1006 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1313 microversion: 2.1 time: 0.681112 Oct 29 03:04:37.930152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67888b93-71af-4da2-ad4a-0239904eeb59 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:37.930941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67888b93-71af-4da2-ad4a-0239904eeb59 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:37.932076 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1826/3829] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:37 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1313 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:37.932654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67888b93-71af-4da2-ad4a-0239904eeb59 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:37.934365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67888b93-71af-4da2-ad4a-0239904eeb59 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:37.938658 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67888b93-71af-4da2-ad4a-0239904eeb59 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:37.952509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67888b93-71af-4da2-ad4a-0239904eeb59 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:38.259814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-67888b93-71af-4da2-ad4a-0239904eeb59 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:38.273294 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-67888b93-71af-4da2-ad4a-0239904eeb59 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1500 microversion: 2.1 time: 0.378913 Oct 29 03:04:38.274333 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2004/3830] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:37 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1500 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:38.298439 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-084a2970-1290-45af-a65b-1611381a7b80 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:38.299665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-084a2970-1290-45af-a65b-1611381a7b80 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:38.304112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a4ccfdce-aac6-4f41-9685-46c12f9cab88 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:38.305771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a4ccfdce-aac6-4f41-9685-46c12f9cab88 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:38.317270 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-084a2970-1290-45af-a65b-1611381a7b80 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:38.318050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a4ccfdce-aac6-4f41-9685-46c12f9cab88 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:38.318699 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-084a2970-1290-45af-a65b-1611381a7b80 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:38.319146 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-084a2970-1290-45af-a65b-1611381a7b80 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:38.322513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a4ccfdce-aac6-4f41-9685-46c12f9cab88 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:38.322513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a4ccfdce-aac6-4f41-9685-46c12f9cab88 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:38.322513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a4ccfdce-aac6-4f41-9685-46c12f9cab88 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:38.322513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a4ccfdce-aac6-4f41-9685-46c12f9cab88 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:38.322906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a4ccfdce-aac6-4f41-9685-46c12f9cab88 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:38.330120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-084a2970-1290-45af-a65b-1611381a7b80 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:38.331038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-084a2970-1290-45af-a65b-1611381a7b80 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:38.335059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-084a2970-1290-45af-a65b-1611381a7b80 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:38.724933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a4ccfdce-aac6-4f41-9685-46c12f9cab88 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:38.737968 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a4ccfdce-aac6-4f41-9685-46c12f9cab88 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:38.741310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a4ccfdce-aac6-4f41-9685-46c12f9cab88 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:38.743667 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a4ccfdce-aac6-4f41-9685-46c12f9cab88 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1731 microversion: 2.20 time: 0.450704 Oct 29 03:04:38.769521 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2005/3831] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:38 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1731 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:38.777520 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bbf695c8-ee9f-439f-b44b-c8e3d1fc30a6 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:38.781751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bbf695c8-ee9f-439f-b44b-c8e3d1fc30a6 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:38.789235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbf695c8-ee9f-439f-b44b-c8e3d1fc30a6 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:38.790554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbf695c8-ee9f-439f-b44b-c8e3d1fc30a6 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:38.791479 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbf695c8-ee9f-439f-b44b-c8e3d1fc30a6 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:38.792692 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbf695c8-ee9f-439f-b44b-c8e3d1fc30a6 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:38.793433 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbf695c8-ee9f-439f-b44b-c8e3d1fc30a6 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:38.794112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbf695c8-ee9f-439f-b44b-c8e3d1fc30a6 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:38.817662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-084a2970-1290-45af-a65b-1611381a7b80 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:38.840994 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-084a2970-1290-45af-a65b-1611381a7b80 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:38.858513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-bbf695c8-ee9f-439f-b44b-c8e3d1fc30a6 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lazy-loading 'flavor' on Instance uuid 66aafb24-5370-4be8-ab86-467f0a0e9f0e {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:04:38.861031 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-084a2970-1290-45af-a65b-1611381a7b80 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:38.864122 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-084a2970-1290-45af-a65b-1611381a7b80 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 2955 microversion: 2.32 time: 0.590137 Oct 29 03:04:38.892791 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1827/3832] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:38 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 2955 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:38.907802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5f6c8664-bf37-4475-bf21-b92379b25cb4 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:38.909043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5f6c8664-bf37-4475-bf21-b92379b25cb4 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] [instance: b955d0c2-5679-4b7f-9c9b-92671911b574] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:38.922021 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f6c8664-bf37-4475-bf21-b92379b25cb4 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:38.923665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f6c8664-bf37-4475-bf21-b92379b25cb4 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:38.924296 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f6c8664-bf37-4475-bf21-b92379b25cb4 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:38.925553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f6c8664-bf37-4475-bf21-b92379b25cb4 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:38.926797 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f6c8664-bf37-4475-bf21-b92379b25cb4 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:38.927132 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f6c8664-bf37-4475-bf21-b92379b25cb4 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:39.018832 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bbf695c8-ee9f-439f-b44b-c8e3d1fc30a6 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "POST /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e/action" status: 200 len: 32 microversion: 2.1 time: 0.244910 Oct 29 03:04:39.022819 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2006/3833] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:04:38 2022] POST /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e/action => generated 32 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:04:39.039290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3b4682d0-d20d-49c3-bbad-6244e572cab1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:39.055636 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3b4682d0-d20d-49c3-bbad-6244e572cab1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:39.104909 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b4682d0-d20d-49c3-bbad-6244e572cab1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:39.108455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b4682d0-d20d-49c3-bbad-6244e572cab1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:39.110445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b4682d0-d20d-49c3-bbad-6244e572cab1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:39.121266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b4682d0-d20d-49c3-bbad-6244e572cab1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:39.122024 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b4682d0-d20d-49c3-bbad-6244e572cab1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:39.127344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b4682d0-d20d-49c3-bbad-6244e572cab1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:39.503328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3b4682d0-d20d-49c3-bbad-6244e572cab1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:39.515293 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3b4682d0-d20d-49c3-bbad-6244e572cab1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1313 microversion: 2.1 time: 0.488625 Oct 29 03:04:39.519222 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2007/3834] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:39 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1313 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:39.524264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d63c2e0d-19d6-4857-b070-17cf7056ccdd tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:39.526318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d63c2e0d-19d6-4857-b070-17cf7056ccdd tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:39.541532 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d63c2e0d-19d6-4857-b070-17cf7056ccdd tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:39.544870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d63c2e0d-19d6-4857-b070-17cf7056ccdd tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:39.545569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d63c2e0d-19d6-4857-b070-17cf7056ccdd tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:39.547430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d63c2e0d-19d6-4857-b070-17cf7056ccdd tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:39.550235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d63c2e0d-19d6-4857-b070-17cf7056ccdd tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:39.550855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d63c2e0d-19d6-4857-b070-17cf7056ccdd tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:39.858788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5f6c8664-bf37-4475-bf21-b92379b25cb4 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52009279acbd46919353742edb6cf2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016dc7d91d1e4977ba712f7bed5218e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:39.870712 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5f6c8664-bf37-4475-bf21-b92379b25cb4 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] 10.222.0.46 "GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574" status: 200 len: 1328 microversion: 2.1 time: 0.974021 Oct 29 03:04:39.888101 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1828/3835] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:38 2022] GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574 => generated 1328 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:39.900777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dca7b5c8-632c-48dd-a0ca-b342b1ebafdc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:39.901721 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dca7b5c8-632c-48dd-a0ca-b342b1ebafdc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:39.913908 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dca7b5c8-632c-48dd-a0ca-b342b1ebafdc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:39.917391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dca7b5c8-632c-48dd-a0ca-b342b1ebafdc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:39.918267 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dca7b5c8-632c-48dd-a0ca-b342b1ebafdc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:39.920423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dca7b5c8-632c-48dd-a0ca-b342b1ebafdc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:39.921242 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dca7b5c8-632c-48dd-a0ca-b342b1ebafdc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:39.925796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dca7b5c8-632c-48dd-a0ca-b342b1ebafdc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:39.933418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d63c2e0d-19d6-4857-b070-17cf7056ccdd tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:39.942550 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d63c2e0d-19d6-4857-b070-17cf7056ccdd tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1506 microversion: 2.1 time: 0.421982 Oct 29 03:04:39.962387 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2008/3836] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:39 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1506 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:39.976888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c6ce0526-3490-4440-8d9e-e68f0ab7896d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:39.977547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c6ce0526-3490-4440-8d9e-e68f0ab7896d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:39.996125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6ce0526-3490-4440-8d9e-e68f0ab7896d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:39.996773 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6ce0526-3490-4440-8d9e-e68f0ab7896d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:39.997235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6ce0526-3490-4440-8d9e-e68f0ab7896d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:39.998006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6ce0526-3490-4440-8d9e-e68f0ab7896d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:40.001388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6ce0526-3490-4440-8d9e-e68f0ab7896d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:40.001853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6ce0526-3490-4440-8d9e-e68f0ab7896d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:40.446930 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dca7b5c8-632c-48dd-a0ca-b342b1ebafdc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:40.458948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dca7b5c8-632c-48dd-a0ca-b342b1ebafdc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:40.463959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dca7b5c8-632c-48dd-a0ca-b342b1ebafdc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:40.465934 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dca7b5c8-632c-48dd-a0ca-b342b1ebafdc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1731 microversion: 2.20 time: 0.576101 Oct 29 03:04:40.469943 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1829/3837] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:39 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1731 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:40.486023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ab848127-2043-4982-8a3c-c285d8c1f015 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-972811292", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "de9fb1f1-b05f-4edd-84de-d278a9ae730a"}], "security_groups": [{"name": "tempest-securitygroup--106309686"}], "key_name": "tempest-keypair-909379506", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "ce33d350-6153-44ca-b8b7-879855266db0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:40.629147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c6ce0526-3490-4440-8d9e-e68f0ab7896d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:40.651531 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c6ce0526-3490-4440-8d9e-e68f0ab7896d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:40.657970 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c6ce0526-3490-4440-8d9e-e68f0ab7896d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:40.661538 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c6ce0526-3490-4440-8d9e-e68f0ab7896d tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 2955 microversion: 2.32 time: 0.697778 Oct 29 03:04:40.665334 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2009/3838] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:39 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 2955 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:40.720114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3f4870c7-26a3-4584-9cfd-87f4f9cbef03 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:40.727371 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3f4870c7-26a3-4584-9cfd-87f4f9cbef03 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:40.751440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f4870c7-26a3-4584-9cfd-87f4f9cbef03 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:40.754626 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f4870c7-26a3-4584-9cfd-87f4f9cbef03 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:40.755332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f4870c7-26a3-4584-9cfd-87f4f9cbef03 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:40.757108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f4870c7-26a3-4584-9cfd-87f4f9cbef03 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:40.761097 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f4870c7-26a3-4584-9cfd-87f4f9cbef03 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:40.763449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f4870c7-26a3-4584-9cfd-87f4f9cbef03 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:41.387189 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-ab848127-2043-4982-8a3c-c285d8c1f015 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] validate_networks() for [('de9fb1f1-b05f-4edd-84de-d278a9ae730a', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:04:41.451579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3f4870c7-26a3-4584-9cfd-87f4f9cbef03 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:41.466028 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3f4870c7-26a3-4584-9cfd-87f4f9cbef03 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1313 microversion: 2.1 time: 0.768684 Oct 29 03:04:41.482931 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2010/3839] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:40 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1313 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:41.482931 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e6af7876-25a6-4a92-a42e-de8ff8648e5a tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:41.489103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e6af7876-25a6-4a92-a42e-de8ff8648e5a tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] [instance: b955d0c2-5679-4b7f-9c9b-92671911b574] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:41.511423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6af7876-25a6-4a92-a42e-de8ff8648e5a tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:41.512235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6af7876-25a6-4a92-a42e-de8ff8648e5a tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:41.512911 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6af7876-25a6-4a92-a42e-de8ff8648e5a tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:41.513834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6af7876-25a6-4a92-a42e-de8ff8648e5a tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:41.514506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6af7876-25a6-4a92-a42e-de8ff8648e5a tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:41.515118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6af7876-25a6-4a92-a42e-de8ff8648e5a tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:42.046551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e6af7876-25a6-4a92-a42e-de8ff8648e5a tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52009279acbd46919353742edb6cf2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016dc7d91d1e4977ba712f7bed5218e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:42.093852 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e6af7876-25a6-4a92-a42e-de8ff8648e5a tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] 10.222.0.46 "GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574" status: 200 len: 1328 microversion: 2.1 time: 0.622127 Oct 29 03:04:42.097322 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2011/3840] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:41 2022] GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574 => generated 1328 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:42.119346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1a2e300e-15d4-4f85-b23b-22329460197f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:42.120099 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1a2e300e-15d4-4f85-b23b-22329460197f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:42.127337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1a2e300e-15d4-4f85-b23b-22329460197f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:42.128249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1a2e300e-15d4-4f85-b23b-22329460197f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:42.128966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1a2e300e-15d4-4f85-b23b-22329460197f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:42.130071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1a2e300e-15d4-4f85-b23b-22329460197f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:42.130847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1a2e300e-15d4-4f85-b23b-22329460197f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:42.131535 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1a2e300e-15d4-4f85-b23b-22329460197f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:42.434224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1a2e300e-15d4-4f85-b23b-22329460197f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:42.445290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:42.458419 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1a2e300e-15d4-4f85-b23b-22329460197f tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1506 microversion: 2.1 time: 0.348239 Oct 29 03:04:42.461204 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2012/3841] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:42 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1506 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:42.481826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-9837b913-5c50-411e-b28f-95d51d2b265d req-7d45a797-1f82-4833-9952-ee18ab46b288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c72534eb-1844-4208-b625-ea8b5ece8108", "name": "network-vif-unplugged", "status": "completed", "tag": "5c3d2712-9ad6-4627-8b5c-ca13b6071e0e"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:42.493532 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9837b913-5c50-411e-b28f-95d51d2b265d req-7d45a797-1f82-4833-9952-ee18ab46b288 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:42.494437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9837b913-5c50-411e-b28f-95d51d2b265d req-7d45a797-1f82-4833-9952-ee18ab46b288 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:42.495134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9837b913-5c50-411e-b28f-95d51d2b265d req-7d45a797-1f82-4833-9952-ee18ab46b288 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:42.511631 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-9837b913-5c50-411e-b28f-95d51d2b265d req-7d45a797-1f82-4833-9952-ee18ab46b288 service nova] Creating event network-vif-unplugged:5c3d2712-9ad6-4627-8b5c-ca13b6071e0e for instance c72534eb-1844-4208-b625-ea8b5ece8108 on n-h1-862967-2 Oct 29 03:04:42.519169 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-9837b913-5c50-411e-b28f-95d51d2b265d req-7d45a797-1f82-4833-9952-ee18ab46b288 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054745 Oct 29 03:04:42.520548 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2013/3842] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:42.532845 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e2ba4e02-358f-4b3c-86e8-faf391601b11 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:42.533871 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e2ba4e02-358f-4b3c-86e8-faf391601b11 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:42.542892 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e2ba4e02-358f-4b3c-86e8-faf391601b11 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:42.543853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e2ba4e02-358f-4b3c-86e8-faf391601b11 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:42.544850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e2ba4e02-358f-4b3c-86e8-faf391601b11 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:42.546134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e2ba4e02-358f-4b3c-86e8-faf391601b11 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:42.547079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e2ba4e02-358f-4b3c-86e8-faf391601b11 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:42.547802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e2ba4e02-358f-4b3c-86e8-faf391601b11 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:42.797355 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e2ba4e02-358f-4b3c-86e8-faf391601b11 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:42.809412 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e2ba4e02-358f-4b3c-86e8-faf391601b11 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:42.811594 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e2ba4e02-358f-4b3c-86e8-faf391601b11 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:42.813547 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e2ba4e02-358f-4b3c-86e8-faf391601b11 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1731 microversion: 2.20 time: 0.291513 Oct 29 03:04:42.830146 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2014/3843] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:42 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1731 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:42.841046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8b97eab5-b866-4fcf-b150-baebfb509224 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:42.842406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8b97eab5-b866-4fcf-b150-baebfb509224 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:42.850839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b97eab5-b866-4fcf-b150-baebfb509224 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:42.851854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b97eab5-b866-4fcf-b150-baebfb509224 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:42.852729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b97eab5-b866-4fcf-b150-baebfb509224 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:42.853941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b97eab5-b866-4fcf-b150-baebfb509224 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:42.854870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b97eab5-b866-4fcf-b150-baebfb509224 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:42.855654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b97eab5-b866-4fcf-b150-baebfb509224 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:43.181824 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-ab848127-2043-4982-8a3c-c285d8c1f015 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Getting quotas for project f49b29d96f38485d82d772bd7c2b07d2. Resources: dict_keys(['metadata_items']) {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:04:43.202117 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-ab848127-2043-4982-8a3c-c285d8c1f015 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Getting quotas for user 85efe9a35c8646ffadadc5a6bd9f0824 and project f49b29d96f38485d82d772bd7c2b07d2. Resources: dict_keys(['metadata_items']) {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:04:43.233206 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-ab848127-2043-4982-8a3c-c285d8c1f015 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:04:43.234105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-ab848127-2043-4982-8a3c-c285d8c1f015 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:04:43.235388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-ab848127-2043-4982-8a3c-c285d8c1f015 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:04:43.236365 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-ab848127-2043-4982-8a3c-c285d8c1f015 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:04:43.237858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-ab848127-2043-4982-8a3c-c285d8c1f015 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:04:43.251292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab848127-2043-4982-8a3c-c285d8c1f015 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:43.254061 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab848127-2043-4982-8a3c-c285d8c1f015 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:43.255767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab848127-2043-4982-8a3c-c285d8c1f015 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:43.258413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab848127-2043-4982-8a3c-c285d8c1f015 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:43.259297 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab848127-2043-4982-8a3c-c285d8c1f015 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:43.260103 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab848127-2043-4982-8a3c-c285d8c1f015 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:43.301714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8b97eab5-b866-4fcf-b150-baebfb509224 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:43.307796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-ab848127-2043-4982-8a3c-c285d8c1f015 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Getting quotas for project f49b29d96f38485d82d772bd7c2b07d2. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:04:43.315752 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8b97eab5-b866-4fcf-b150-baebfb509224 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:43.322993 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8b97eab5-b866-4fcf-b150-baebfb509224 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:43.327646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-ab848127-2043-4982-8a3c-c285d8c1f015 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Getting quotas for user 85efe9a35c8646ffadadc5a6bd9f0824 and project f49b29d96f38485d82d772bd7c2b07d2. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:04:43.332493 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8b97eab5-b866-4fcf-b150-baebfb509224 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 2955 microversion: 2.32 time: 0.500724 Oct 29 03:04:43.337023 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2015/3844] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:42 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 2955 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:43.343819 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-af73f298-a973-4290-b1b3-407396657d0e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:43.353297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-af73f298-a973-4290-b1b3-407396657d0e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:43.374609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af73f298-a973-4290-b1b3-407396657d0e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:43.375547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af73f298-a973-4290-b1b3-407396657d0e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:43.381396 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af73f298-a973-4290-b1b3-407396657d0e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:43.389633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af73f298-a973-4290-b1b3-407396657d0e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:43.390490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af73f298-a973-4290-b1b3-407396657d0e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:43.395487 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af73f298-a973-4290-b1b3-407396657d0e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:43.568154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ab848127-2043-4982-8a3c-c285d8c1f015 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:04:43.571010 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ab848127-2043-4982-8a3c-c285d8c1f015 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ce33d350-6153-44ca-b8b7-879855266db0',volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:04:43.947967 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ab848127-2043-4982-8a3c-c285d8c1f015 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.475017 Oct 29 03:04:43.949329 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1830/3845] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:04:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 3478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:04:43.954450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d6e5a84d-6710-418f-afb6-0fe1c8148a3f tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:43.970306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d6e5a84d-6710-418f-afb6-0fe1c8148a3f tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] [instance: b955d0c2-5679-4b7f-9c9b-92671911b574] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:44.020831 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6e5a84d-6710-418f-afb6-0fe1c8148a3f tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:44.023889 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6e5a84d-6710-418f-afb6-0fe1c8148a3f tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:44.024655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6e5a84d-6710-418f-afb6-0fe1c8148a3f tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:44.027229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6e5a84d-6710-418f-afb6-0fe1c8148a3f tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:44.029832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6e5a84d-6710-418f-afb6-0fe1c8148a3f tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:44.031912 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6e5a84d-6710-418f-afb6-0fe1c8148a3f tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:44.127273 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-af73f298-a973-4290-b1b3-407396657d0e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:44.155143 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-af73f298-a973-4290-b1b3-407396657d0e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1313 microversion: 2.1 time: 0.815831 Oct 29 03:04:44.156095 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2016/3846] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:43 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1313 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:44.178815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-65262237-9a8a-451e-b167-83dbce88f9f1 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:44.179444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-65262237-9a8a-451e-b167-83dbce88f9f1 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:44.214296 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-65262237-9a8a-451e-b167-83dbce88f9f1 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:44.214845 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-65262237-9a8a-451e-b167-83dbce88f9f1 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:44.215880 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-65262237-9a8a-451e-b167-83dbce88f9f1 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:44.226624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-65262237-9a8a-451e-b167-83dbce88f9f1 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:44.235324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-65262237-9a8a-451e-b167-83dbce88f9f1 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:44.238128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-65262237-9a8a-451e-b167-83dbce88f9f1 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:44.566806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d6e5a84d-6710-418f-afb6-0fe1c8148a3f tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52009279acbd46919353742edb6cf2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016dc7d91d1e4977ba712f7bed5218e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:44.599720 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d6e5a84d-6710-418f-afb6-0fe1c8148a3f tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] 10.222.0.46 "GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574" status: 200 len: 1328 microversion: 2.1 time: 0.648939 Oct 29 03:04:44.602800 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1831/3847] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:43 2022] GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574 => generated 1328 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:44.616839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-db96609c-275b-4b6d-ac42-d44200039bdc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:44.618102 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-db96609c-275b-4b6d-ac42-d44200039bdc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:44.633656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db96609c-275b-4b6d-ac42-d44200039bdc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:44.637222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db96609c-275b-4b6d-ac42-d44200039bdc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:44.637803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db96609c-275b-4b6d-ac42-d44200039bdc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:44.638664 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db96609c-275b-4b6d-ac42-d44200039bdc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:44.639305 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db96609c-275b-4b6d-ac42-d44200039bdc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:44.639842 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db96609c-275b-4b6d-ac42-d44200039bdc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:45.097277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-db96609c-275b-4b6d-ac42-d44200039bdc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:45.110189 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-db96609c-275b-4b6d-ac42-d44200039bdc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:45.119963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-db96609c-275b-4b6d-ac42-d44200039bdc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:45.123991 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-db96609c-275b-4b6d-ac42-d44200039bdc tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1731 microversion: 2.20 time: 0.519877 Oct 29 03:04:45.124970 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1832/3848] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:44 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1731 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:45.131609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-09d119d9-cadb-4ed8-84ac-def28bc2f911 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:45.135610 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-09d119d9-cadb-4ed8-84ac-def28bc2f911 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:45.151280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09d119d9-cadb-4ed8-84ac-def28bc2f911 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:45.156359 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09d119d9-cadb-4ed8-84ac-def28bc2f911 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:45.157400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09d119d9-cadb-4ed8-84ac-def28bc2f911 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:45.161096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09d119d9-cadb-4ed8-84ac-def28bc2f911 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:45.161951 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09d119d9-cadb-4ed8-84ac-def28bc2f911 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:45.162919 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09d119d9-cadb-4ed8-84ac-def28bc2f911 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:45.308556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-09d119d9-cadb-4ed8-84ac-def28bc2f911 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85efe9a35c8646ffadadc5a6bd9f0824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:45.335562 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-09d119d9-cadb-4ed8-84ac-def28bc2f911 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2" status: 200 len: 1162 microversion: 2.1 time: 0.209057 Oct 29 03:04:45.339730 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1833/3849] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:45 2022] GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2 => generated 1162 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:45.349697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-65262237-9a8a-451e-b167-83dbce88f9f1 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:45.362971 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-65262237-9a8a-451e-b167-83dbce88f9f1 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1506 microversion: 2.1 time: 1.187889 Oct 29 03:04:45.363675 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2017/3850] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:44 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1506 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:45.378263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7b78f6fd-f95f-4a12-9ca2-e5cfe62d2746 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:45.378928 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7b78f6fd-f95f-4a12-9ca2-e5cfe62d2746 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:45.401703 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-02ae2439-aa31-4cd3-aa75-d017178dffba req-580be2c6-501a-401d-8666-45405a0596f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c72534eb-1844-4208-b625-ea8b5ece8108", "name": "network-vif-unplugged", "status": "completed", "tag": "951b4e8b-0238-4e1b-b891-991e85f03a1b"}, {"server_uuid": "c72534eb-1844-4208-b625-ea8b5ece8108", "name": "network-vif-unplugged", "status": "completed", "tag": "c7d91e7c-5b11-484a-b555-6a407dc903e3"}, {"server_uuid": "c72534eb-1844-4208-b625-ea8b5ece8108", "name": "network-vif-unplugged", "status": "completed", "tag": "998148a8-ddff-46d0-94b6-c27edcac4cb0"}, {"server_uuid": "c72534eb-1844-4208-b625-ea8b5ece8108", "name": "network-vif-unplugged", "status": "completed", "tag": "4c67f638-2ba1-48d4-80b9-c0539cebe183"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:45.413340 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7b78f6fd-f95f-4a12-9ca2-e5cfe62d2746 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:45.414180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7b78f6fd-f95f-4a12-9ca2-e5cfe62d2746 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:45.414816 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7b78f6fd-f95f-4a12-9ca2-e5cfe62d2746 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:45.415807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7b78f6fd-f95f-4a12-9ca2-e5cfe62d2746 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:45.416492 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7b78f6fd-f95f-4a12-9ca2-e5cfe62d2746 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:45.418071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7b78f6fd-f95f-4a12-9ca2-e5cfe62d2746 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:45.447007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-02ae2439-aa31-4cd3-aa75-d017178dffba req-580be2c6-501a-401d-8666-45405a0596f5 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:45.450754 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-02ae2439-aa31-4cd3-aa75-d017178dffba req-580be2c6-501a-401d-8666-45405a0596f5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:45.452302 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-02ae2439-aa31-4cd3-aa75-d017178dffba req-580be2c6-501a-401d-8666-45405a0596f5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:45.492056 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-02ae2439-aa31-4cd3-aa75-d017178dffba req-580be2c6-501a-401d-8666-45405a0596f5 service nova] Creating event network-vif-unplugged:951b4e8b-0238-4e1b-b891-991e85f03a1b for instance c72534eb-1844-4208-b625-ea8b5ece8108 on n-h1-862967-2 Oct 29 03:04:45.499353 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-02ae2439-aa31-4cd3-aa75-d017178dffba req-580be2c6-501a-401d-8666-45405a0596f5 service nova] Creating event network-vif-unplugged:c7d91e7c-5b11-484a-b555-6a407dc903e3 for instance c72534eb-1844-4208-b625-ea8b5ece8108 on n-h1-862967-2 Oct 29 03:04:45.500364 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-02ae2439-aa31-4cd3-aa75-d017178dffba req-580be2c6-501a-401d-8666-45405a0596f5 service nova] Creating event network-vif-unplugged:998148a8-ddff-46d0-94b6-c27edcac4cb0 for instance c72534eb-1844-4208-b625-ea8b5ece8108 on n-h1-862967-2 Oct 29 03:04:45.501217 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-02ae2439-aa31-4cd3-aa75-d017178dffba req-580be2c6-501a-401d-8666-45405a0596f5 service nova] Creating event network-vif-unplugged:4c67f638-2ba1-48d4-80b9-c0539cebe183 for instance c72534eb-1844-4208-b625-ea8b5ece8108 on n-h1-862967-2 Oct 29 03:04:45.515077 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-02ae2439-aa31-4cd3-aa75-d017178dffba req-580be2c6-501a-401d-8666-45405a0596f5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.129511 Oct 29 03:04:45.516509 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2018/3851] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:45.523754 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f7fc802b-a91f-4bd7-a758-d4c38e2d81a4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:45.524466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f7fc802b-a91f-4bd7-a758-d4c38e2d81a4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:45.533504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7fc802b-a91f-4bd7-a758-d4c38e2d81a4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:45.534305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7fc802b-a91f-4bd7-a758-d4c38e2d81a4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:45.534931 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7fc802b-a91f-4bd7-a758-d4c38e2d81a4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:45.535853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7fc802b-a91f-4bd7-a758-d4c38e2d81a4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:45.536484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7fc802b-a91f-4bd7-a758-d4c38e2d81a4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:45.537118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7fc802b-a91f-4bd7-a758-d4c38e2d81a4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:46.228337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f7fc802b-a91f-4bd7-a758-d4c38e2d81a4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:46.237955 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f7fc802b-a91f-4bd7-a758-d4c38e2d81a4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1313 microversion: 2.1 time: 0.719874 Oct 29 03:04:46.239150 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2019/3852] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:45 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1313 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:46.245113 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3a5df04d-93b1-42f6-afb3-b6ccb67c9a93 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:46.246408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3a5df04d-93b1-42f6-afb3-b6ccb67c9a93 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] [instance: b955d0c2-5679-4b7f-9c9b-92671911b574] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:46.254090 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a5df04d-93b1-42f6-afb3-b6ccb67c9a93 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:46.255372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a5df04d-93b1-42f6-afb3-b6ccb67c9a93 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:46.256008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a5df04d-93b1-42f6-afb3-b6ccb67c9a93 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:46.256997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a5df04d-93b1-42f6-afb3-b6ccb67c9a93 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:46.257638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a5df04d-93b1-42f6-afb3-b6ccb67c9a93 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:46.258575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a5df04d-93b1-42f6-afb3-b6ccb67c9a93 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:46.311784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7b78f6fd-f95f-4a12-9ca2-e5cfe62d2746 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:46.329020 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7b78f6fd-f95f-4a12-9ca2-e5cfe62d2746 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:46.332469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7b78f6fd-f95f-4a12-9ca2-e5cfe62d2746 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:46.341039 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7b78f6fd-f95f-4a12-9ca2-e5cfe62d2746 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 2955 microversion: 2.32 time: 0.999723 Oct 29 03:04:46.342070 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1834/3853] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:45 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 2955 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:46.347718 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1f33e533-71d0-4697-8c17-28e7dc6159cd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:46.348675 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1f33e533-71d0-4697-8c17-28e7dc6159cd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:46.357693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f33e533-71d0-4697-8c17-28e7dc6159cd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:46.365310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f33e533-71d0-4697-8c17-28e7dc6159cd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:46.365775 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f33e533-71d0-4697-8c17-28e7dc6159cd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:46.366535 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f33e533-71d0-4697-8c17-28e7dc6159cd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:46.366999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f33e533-71d0-4697-8c17-28e7dc6159cd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:46.367426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f33e533-71d0-4697-8c17-28e7dc6159cd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:46.652260 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1f33e533-71d0-4697-8c17-28e7dc6159cd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:46.670378 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1f33e533-71d0-4697-8c17-28e7dc6159cd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:46.673006 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1f33e533-71d0-4697-8c17-28e7dc6159cd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:46.674519 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1f33e533-71d0-4697-8c17-28e7dc6159cd tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1731 microversion: 2.20 time: 0.331311 Oct 29 03:04:46.686386 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1835/3854] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:46 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1731 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:46.691797 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1450da10-4d00-48d0-9c81-3bef1778dd9c tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:46.698205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1450da10-4d00-48d0-9c81-3bef1778dd9c tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:46.708694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1450da10-4d00-48d0-9c81-3bef1778dd9c tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:46.709177 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1450da10-4d00-48d0-9c81-3bef1778dd9c tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:46.709511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1450da10-4d00-48d0-9c81-3bef1778dd9c tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:46.710222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1450da10-4d00-48d0-9c81-3bef1778dd9c tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:46.710672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1450da10-4d00-48d0-9c81-3bef1778dd9c tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:46.717845 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1450da10-4d00-48d0-9c81-3bef1778dd9c tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:46.863833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1450da10-4d00-48d0-9c81-3bef1778dd9c tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85efe9a35c8646ffadadc5a6bd9f0824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:46.876749 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1450da10-4d00-48d0-9c81-3bef1778dd9c tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2" status: 200 len: 1218 microversion: 2.1 time: 0.188422 Oct 29 03:04:46.877567 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1836/3855] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:46 2022] GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2 => generated 1218 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:46.894434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bc4f87c6-2c63-471d-9742-6c52abf87974 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:46.895594 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bc4f87c6-2c63-471d-9742-6c52abf87974 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:46.913581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc4f87c6-2c63-471d-9742-6c52abf87974 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:46.914379 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc4f87c6-2c63-471d-9742-6c52abf87974 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:46.915089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc4f87c6-2c63-471d-9742-6c52abf87974 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:46.916664 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc4f87c6-2c63-471d-9742-6c52abf87974 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:46.917564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc4f87c6-2c63-471d-9742-6c52abf87974 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:46.918497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc4f87c6-2c63-471d-9742-6c52abf87974 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:47.160724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3a5df04d-93b1-42f6-afb3-b6ccb67c9a93 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52009279acbd46919353742edb6cf2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016dc7d91d1e4977ba712f7bed5218e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:47.169303 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3a5df04d-93b1-42f6-afb3-b6ccb67c9a93 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] 10.222.0.46 "GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574" status: 200 len: 1328 microversion: 2.1 time: 0.928592 Oct 29 03:04:47.178048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bc4f87c6-2c63-471d-9742-6c52abf87974 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:47.185098 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2020/3856] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:46 2022] GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574 => generated 1328 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:47.189573 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bc4f87c6-2c63-471d-9742-6c52abf87974 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1506 microversion: 2.1 time: 0.310289 Oct 29 03:04:47.190309 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1837/3857] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:46 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1506 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:47.277737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d132cc32-e2a0-417c-acd1-1ccd640b26bf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:47.278465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d132cc32-e2a0-417c-acd1-1ccd640b26bf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:47.286819 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d132cc32-e2a0-417c-acd1-1ccd640b26bf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:47.287406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d132cc32-e2a0-417c-acd1-1ccd640b26bf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:47.288220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d132cc32-e2a0-417c-acd1-1ccd640b26bf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:47.289324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d132cc32-e2a0-417c-acd1-1ccd640b26bf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:47.289783 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d132cc32-e2a0-417c-acd1-1ccd640b26bf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:47.290213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d132cc32-e2a0-417c-acd1-1ccd640b26bf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:47.373456 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4cfdb334-30cd-43b4-848f-2c2da5f0a72c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:47.374100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4cfdb334-30cd-43b4-848f-2c2da5f0a72c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:47.380064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cfdb334-30cd-43b4-848f-2c2da5f0a72c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:47.380618 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cfdb334-30cd-43b4-848f-2c2da5f0a72c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:47.381270 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cfdb334-30cd-43b4-848f-2c2da5f0a72c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:47.381982 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cfdb334-30cd-43b4-848f-2c2da5f0a72c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:47.387843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cfdb334-30cd-43b4-848f-2c2da5f0a72c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:47.388398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4cfdb334-30cd-43b4-848f-2c2da5f0a72c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:47.617913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d132cc32-e2a0-417c-acd1-1ccd640b26bf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:47.635471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4cfdb334-30cd-43b4-848f-2c2da5f0a72c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:47.637296 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d132cc32-e2a0-417c-acd1-1ccd640b26bf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1313 microversion: 2.1 time: 0.356339 Oct 29 03:04:47.638199 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2021/3858] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:47 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:47.646150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-172ab7c7-4fa1-4051-92b4-3a465adc08de req-49f19856-af2c-4418-82d8-4205fcaff8b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c72534eb-1844-4208-b625-ea8b5ece8108", "name": "network-vif-unplugged", "status": "completed", "tag": "3feb2664-749f-4176-9acc-3d1f17ebbb83"}, {"server_uuid": "c72534eb-1844-4208-b625-ea8b5ece8108", "name": "network-vif-unplugged", "status": "completed", "tag": "3febcbca-e08c-4130-ae81-3ac6a9c05e2b"}, {"server_uuid": "b955d0c2-5679-4b7f-9c9b-92671911b574", "name": "network-vif-plugged", "status": "completed", "tag": "59f467cf-8375-47a8-a788-87ff021e0b37"}, {"server_uuid": "34628535-7e50-432b-9baf-a1d9b841a1ec", "name": "network-vif-plugged", "status": "completed", "tag": "a2e09809-ccdf-450a-a30b-75e01aaa1eef"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:47.651320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4cfdb334-30cd-43b4-848f-2c2da5f0a72c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:47.653429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4cfdb334-30cd-43b4-848f-2c2da5f0a72c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:47.654756 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4cfdb334-30cd-43b4-848f-2c2da5f0a72c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 2934 microversion: 2.32 time: 0.286517 Oct 29 03:04:47.663999 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-172ab7c7-4fa1-4051-92b4-3a465adc08de req-49f19856-af2c-4418-82d8-4205fcaff8b5 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:47.664972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-172ab7c7-4fa1-4051-92b4-3a465adc08de req-49f19856-af2c-4418-82d8-4205fcaff8b5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:47.666637 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-172ab7c7-4fa1-4051-92b4-3a465adc08de req-49f19856-af2c-4418-82d8-4205fcaff8b5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:47.669214 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1838/3859] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:47 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 2934 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:47.688346 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-172ab7c7-4fa1-4051-92b4-3a465adc08de req-49f19856-af2c-4418-82d8-4205fcaff8b5 service nova] Creating event network-vif-unplugged:3feb2664-749f-4176-9acc-3d1f17ebbb83 for instance c72534eb-1844-4208-b625-ea8b5ece8108 on n-h1-862967-2 Oct 29 03:04:47.689501 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-172ab7c7-4fa1-4051-92b4-3a465adc08de req-49f19856-af2c-4418-82d8-4205fcaff8b5 service nova] Creating event network-vif-unplugged:3febcbca-e08c-4130-ae81-3ac6a9c05e2b for instance c72534eb-1844-4208-b625-ea8b5ece8108 on n-h1-862967-2 Oct 29 03:04:47.690368 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-172ab7c7-4fa1-4051-92b4-3a465adc08de req-49f19856-af2c-4418-82d8-4205fcaff8b5 service nova] Creating event network-vif-plugged:59f467cf-8375-47a8-a788-87ff021e0b37 for instance b955d0c2-5679-4b7f-9c9b-92671911b574 on n-h2-862967-2 Oct 29 03:04:47.691305 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-172ab7c7-4fa1-4051-92b4-3a465adc08de req-49f19856-af2c-4418-82d8-4205fcaff8b5 service nova] Creating event network-vif-plugged:a2e09809-ccdf-450a-a30b-75e01aaa1eef for instance 34628535-7e50-432b-9baf-a1d9b841a1ec on n-h1-862967-2 Oct 29 03:04:47.705322 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-172ab7c7-4fa1-4051-92b4-3a465adc08de req-49f19856-af2c-4418-82d8-4205fcaff8b5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 700 microversion: 2.1 time: 0.065056 Oct 29 03:04:47.708196 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3f242798-60f9-4fda-9f20-d07a5b6375c7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:47.708922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3f242798-60f9-4fda-9f20-d07a5b6375c7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:47.711569 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2022/3860] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 700 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:47.718951 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3f242798-60f9-4fda-9f20-d07a5b6375c7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:47.719455 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3f242798-60f9-4fda-9f20-d07a5b6375c7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:47.720817 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3f242798-60f9-4fda-9f20-d07a5b6375c7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:47.723126 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3f242798-60f9-4fda-9f20-d07a5b6375c7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:47.725157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3f242798-60f9-4fda-9f20-d07a5b6375c7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:47.725777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3f242798-60f9-4fda-9f20-d07a5b6375c7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:47.917934 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-52eb13ec-fcea-49bc-8b11-0dce4d552801 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:47.918643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-52eb13ec-fcea-49bc-8b11-0dce4d552801 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:47.928173 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-52eb13ec-fcea-49bc-8b11-0dce4d552801 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:47.928695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-52eb13ec-fcea-49bc-8b11-0dce4d552801 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:47.929135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-52eb13ec-fcea-49bc-8b11-0dce4d552801 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:47.937030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-52eb13ec-fcea-49bc-8b11-0dce4d552801 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:47.939225 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-52eb13ec-fcea-49bc-8b11-0dce4d552801 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:47.941155 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-52eb13ec-fcea-49bc-8b11-0dce4d552801 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:48.071528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-52eb13ec-fcea-49bc-8b11-0dce4d552801 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85efe9a35c8646ffadadc5a6bd9f0824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:48.093782 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-52eb13ec-fcea-49bc-8b11-0dce4d552801 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2" status: 200 len: 1236 microversion: 2.1 time: 0.179978 Oct 29 03:04:48.104569 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2023/3861] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:47 2022] GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2 => generated 1236 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:48.195732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ceae5a51-0224-44e4-a407-06ca83370b99 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:48.196361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ceae5a51-0224-44e4-a407-06ca83370b99 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] [instance: b955d0c2-5679-4b7f-9c9b-92671911b574] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:48.207463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ceae5a51-0224-44e4-a407-06ca83370b99 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:48.209817 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ceae5a51-0224-44e4-a407-06ca83370b99 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:48.210314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ceae5a51-0224-44e4-a407-06ca83370b99 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:48.216717 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ceae5a51-0224-44e4-a407-06ca83370b99 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:48.217412 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ceae5a51-0224-44e4-a407-06ca83370b99 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:48.224502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ceae5a51-0224-44e4-a407-06ca83370b99 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:48.421351 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3f242798-60f9-4fda-9f20-d07a5b6375c7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:48.430409 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3f242798-60f9-4fda-9f20-d07a5b6375c7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:48.431820 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3f242798-60f9-4fda-9f20-d07a5b6375c7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:48.433092 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3f242798-60f9-4fda-9f20-d07a5b6375c7 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1731 microversion: 2.20 time: 0.729486 Oct 29 03:04:48.445096 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1839/3862] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:47 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1731 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:04:48.468962 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7cbbac73-30f0-49e0-bbb9-5486d857d0ec tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:48.469728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7cbbac73-30f0-49e0-bbb9-5486d857d0ec tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:48.507616 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cbbac73-30f0-49e0-bbb9-5486d857d0ec tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:48.509421 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cbbac73-30f0-49e0-bbb9-5486d857d0ec tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:48.515417 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cbbac73-30f0-49e0-bbb9-5486d857d0ec tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:48.527172 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cbbac73-30f0-49e0-bbb9-5486d857d0ec tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:48.527681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cbbac73-30f0-49e0-bbb9-5486d857d0ec tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:48.528201 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cbbac73-30f0-49e0-bbb9-5486d857d0ec tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:48.588641 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:48.945445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7cbbac73-30f0-49e0-bbb9-5486d857d0ec tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:48.967844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ceae5a51-0224-44e4-a407-06ca83370b99 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52009279acbd46919353742edb6cf2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016dc7d91d1e4977ba712f7bed5218e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:48.970700 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7cbbac73-30f0-49e0-bbb9-5486d857d0ec tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1506 microversion: 2.1 time: 0.523689 Oct 29 03:04:48.977305 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ceae5a51-0224-44e4-a407-06ca83370b99 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] 10.222.0.46 "GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574" status: 200 len: 1328 microversion: 2.1 time: 0.786849 Oct 29 03:04:48.980059 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2024/3863] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:48 2022] GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574 => generated 1328 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:04:48.989231 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1840/3864] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:48 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1506 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:49.000251 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-483776e5-99ab-4165-8ca7-371407d66636 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:49.002580 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-483776e5-99ab-4165-8ca7-371407d66636 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:49.026814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b175d9fb-1981-43ee-9ced-f2284619d7c8 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:49.028495 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b175d9fb-1981-43ee-9ced-f2284619d7c8 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:49.029834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-483776e5-99ab-4165-8ca7-371407d66636 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:49.030346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-483776e5-99ab-4165-8ca7-371407d66636 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:49.036120 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-483776e5-99ab-4165-8ca7-371407d66636 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:49.039508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-483776e5-99ab-4165-8ca7-371407d66636 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:49.041980 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-483776e5-99ab-4165-8ca7-371407d66636 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:49.044007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-483776e5-99ab-4165-8ca7-371407d66636 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:49.044849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b175d9fb-1981-43ee-9ced-f2284619d7c8 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:49.046448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b175d9fb-1981-43ee-9ced-f2284619d7c8 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:49.047500 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b175d9fb-1981-43ee-9ced-f2284619d7c8 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:49.049148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b175d9fb-1981-43ee-9ced-f2284619d7c8 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:49.050445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b175d9fb-1981-43ee-9ced-f2284619d7c8 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:49.051501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b175d9fb-1981-43ee-9ced-f2284619d7c8 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:49.450465 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b175d9fb-1981-43ee-9ced-f2284619d7c8 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:49.472047 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b175d9fb-1981-43ee-9ced-f2284619d7c8 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:49.476425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b175d9fb-1981-43ee-9ced-f2284619d7c8 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:49.479176 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b175d9fb-1981-43ee-9ced-f2284619d7c8 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 2934 microversion: 2.32 time: 0.487771 Oct 29 03:04:49.506374 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1841/3865] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:48 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 2934 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:49.512538 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1125eb68-407e-4188-b439-a582193c0edc tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:49.513973 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1125eb68-407e-4188-b439-a582193c0edc tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:49.526585 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1125eb68-407e-4188-b439-a582193c0edc tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:49.527813 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1125eb68-407e-4188-b439-a582193c0edc tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:49.528420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1125eb68-407e-4188-b439-a582193c0edc tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:49.529340 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1125eb68-407e-4188-b439-a582193c0edc tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:49.530029 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1125eb68-407e-4188-b439-a582193c0edc tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:49.530669 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1125eb68-407e-4188-b439-a582193c0edc tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:49.599414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-483776e5-99ab-4165-8ca7-371407d66636 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:49.610106 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-483776e5-99ab-4165-8ca7-371407d66636 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1313 microversion: 2.1 time: 0.628557 Oct 29 03:04:49.610718 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2025/3866] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:48 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1313 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:49.626174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-27ffb510-5844-4c91-916a-662558f19e51 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:49.627988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-27ffb510-5844-4c91-916a-662558f19e51 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:49.646982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27ffb510-5844-4c91-916a-662558f19e51 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:49.651796 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27ffb510-5844-4c91-916a-662558f19e51 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:49.653509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27ffb510-5844-4c91-916a-662558f19e51 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:49.656678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27ffb510-5844-4c91-916a-662558f19e51 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:49.657348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27ffb510-5844-4c91-916a-662558f19e51 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:49.659167 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27ffb510-5844-4c91-916a-662558f19e51 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:50.031973 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1125eb68-407e-4188-b439-a582193c0edc tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85efe9a35c8646ffadadc5a6bd9f0824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:50.049046 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1125eb68-407e-4188-b439-a582193c0edc tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2" status: 200 len: 1236 microversion: 2.1 time: 0.537765 Oct 29 03:04:50.050075 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1842/3867] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:49 2022] GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2 => generated 1236 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:50.076857 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4877098e-dbc6-4bfa-8b7e-ed71c4a0e6b8 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:50.079065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4877098e-dbc6-4bfa-8b7e-ed71c4a0e6b8 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] [instance: b955d0c2-5679-4b7f-9c9b-92671911b574] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:50.087946 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4877098e-dbc6-4bfa-8b7e-ed71c4a0e6b8 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:50.088923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4877098e-dbc6-4bfa-8b7e-ed71c4a0e6b8 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:50.089672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4877098e-dbc6-4bfa-8b7e-ed71c4a0e6b8 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:50.090760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4877098e-dbc6-4bfa-8b7e-ed71c4a0e6b8 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:50.091502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4877098e-dbc6-4bfa-8b7e-ed71c4a0e6b8 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:50.092398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4877098e-dbc6-4bfa-8b7e-ed71c4a0e6b8 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:50.688818 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4877098e-dbc6-4bfa-8b7e-ed71c4a0e6b8 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52009279acbd46919353742edb6cf2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016dc7d91d1e4977ba712f7bed5218e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:50.727093 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4877098e-dbc6-4bfa-8b7e-ed71c4a0e6b8 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] 10.222.0.46 "GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574" status: 200 len: 1528 microversion: 2.1 time: 0.651616 Oct 29 03:04:50.727093 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1843/3868] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:50 2022] GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574 => generated 1528 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:50.727093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1d70b6fc-b5bc-4fd0-8543-9b09416f18ab tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:50.728400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1d70b6fc-b5bc-4fd0-8543-9b09416f18ab tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:50.742687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d70b6fc-b5bc-4fd0-8543-9b09416f18ab tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:50.745734 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d70b6fc-b5bc-4fd0-8543-9b09416f18ab tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:50.746280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d70b6fc-b5bc-4fd0-8543-9b09416f18ab tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:50.754510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d70b6fc-b5bc-4fd0-8543-9b09416f18ab tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:50.757485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d70b6fc-b5bc-4fd0-8543-9b09416f18ab tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:50.758935 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d70b6fc-b5bc-4fd0-8543-9b09416f18ab tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:51.053375 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-27ffb510-5844-4c91-916a-662558f19e51 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:51.067240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-27ffb510-5844-4c91-916a-662558f19e51 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:51.071985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-27ffb510-5844-4c91-916a-662558f19e51 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:51.073582 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-27ffb510-5844-4c91-916a-662558f19e51 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1731 microversion: 2.20 time: 1.461859 Oct 29 03:04:51.074147 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2026/3869] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:49 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1731 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:51.088858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a35a5766-9af6-4574-9919-50cb1bae66a2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:51.089772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a35a5766-9af6-4574-9919-50cb1bae66a2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:51.119850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a35a5766-9af6-4574-9919-50cb1bae66a2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:51.121569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a35a5766-9af6-4574-9919-50cb1bae66a2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:51.122281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a35a5766-9af6-4574-9919-50cb1bae66a2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:51.123735 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a35a5766-9af6-4574-9919-50cb1bae66a2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:51.124448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a35a5766-9af6-4574-9919-50cb1bae66a2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:51.125233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a35a5766-9af6-4574-9919-50cb1bae66a2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:51.216400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1d70b6fc-b5bc-4fd0-8543-9b09416f18ab tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:51.227886 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1d70b6fc-b5bc-4fd0-8543-9b09416f18ab tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1506 microversion: 2.1 time: 0.515960 Oct 29 03:04:51.247926 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1844/3870] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:50 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1506 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:51.253555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ad104125-0094-4198-ac46-1b3e7dddf2b6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:51.260381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ad104125-0094-4198-ac46-1b3e7dddf2b6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:51.272098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad104125-0094-4198-ac46-1b3e7dddf2b6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:51.279469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad104125-0094-4198-ac46-1b3e7dddf2b6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:51.280086 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad104125-0094-4198-ac46-1b3e7dddf2b6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:51.280989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad104125-0094-4198-ac46-1b3e7dddf2b6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:51.281554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad104125-0094-4198-ac46-1b3e7dddf2b6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:51.285031 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad104125-0094-4198-ac46-1b3e7dddf2b6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:51.682998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ad104125-0094-4198-ac46-1b3e7dddf2b6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:51.702682 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ad104125-0094-4198-ac46-1b3e7dddf2b6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1463 microversion: 2.1 time: 0.452799 Oct 29 03:04:51.706884 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1845/3871] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:51 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1463 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:51.726460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5dec6435-8ccd-44c6-8905-30be5b2a0f6f tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:51.728078 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5dec6435-8ccd-44c6-8905-30be5b2a0f6f tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] [instance: b955d0c2-5679-4b7f-9c9b-92671911b574] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:51.748181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5dec6435-8ccd-44c6-8905-30be5b2a0f6f tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:51.750680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5dec6435-8ccd-44c6-8905-30be5b2a0f6f tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:51.751648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5dec6435-8ccd-44c6-8905-30be5b2a0f6f tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:51.754403 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5dec6435-8ccd-44c6-8905-30be5b2a0f6f tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:51.755092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5dec6435-8ccd-44c6-8905-30be5b2a0f6f tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:51.758131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5dec6435-8ccd-44c6-8905-30be5b2a0f6f tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:51.784069 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a35a5766-9af6-4574-9919-50cb1bae66a2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:51.810109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a35a5766-9af6-4574-9919-50cb1bae66a2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:51.828661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a35a5766-9af6-4574-9919-50cb1bae66a2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:51.830293 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a35a5766-9af6-4574-9919-50cb1bae66a2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 2913 microversion: 2.32 time: 0.753373 Oct 29 03:04:51.830909 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2027/3872] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:51 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 2913 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:51.846518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-10a5c4f6-4ab9-455b-9385-e2294047cae4 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:51.847412 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-10a5c4f6-4ab9-455b-9385-e2294047cae4 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:51.854429 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10a5c4f6-4ab9-455b-9385-e2294047cae4 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:51.861509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10a5c4f6-4ab9-455b-9385-e2294047cae4 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:51.862194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10a5c4f6-4ab9-455b-9385-e2294047cae4 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:51.863678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10a5c4f6-4ab9-455b-9385-e2294047cae4 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:51.864340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10a5c4f6-4ab9-455b-9385-e2294047cae4 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:51.865589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10a5c4f6-4ab9-455b-9385-e2294047cae4 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:52.395081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-10a5c4f6-4ab9-455b-9385-e2294047cae4 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85efe9a35c8646ffadadc5a6bd9f0824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:52.403676 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-10a5c4f6-4ab9-455b-9385-e2294047cae4 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2" status: 200 len: 1303 microversion: 2.1 time: 0.571620 Oct 29 03:04:52.407955 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2028/3873] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:51 2022] GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2 => generated 1303 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:52.413724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ebff49ea-fd1b-4103-8a58-d37b9cd4c7e9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:52.444202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ebff49ea-fd1b-4103-8a58-d37b9cd4c7e9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:52.455800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebff49ea-fd1b-4103-8a58-d37b9cd4c7e9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:52.456303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebff49ea-fd1b-4103-8a58-d37b9cd4c7e9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:52.456777 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebff49ea-fd1b-4103-8a58-d37b9cd4c7e9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:52.457614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebff49ea-fd1b-4103-8a58-d37b9cd4c7e9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:52.457949 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebff49ea-fd1b-4103-8a58-d37b9cd4c7e9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:52.458375 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebff49ea-fd1b-4103-8a58-d37b9cd4c7e9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:52.623906 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5dec6435-8ccd-44c6-8905-30be5b2a0f6f tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52009279acbd46919353742edb6cf2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016dc7d91d1e4977ba712f7bed5218e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:52.637480 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5dec6435-8ccd-44c6-8905-30be5b2a0f6f tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] 10.222.0.46 "GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574" status: 200 len: 1528 microversion: 2.1 time: 0.927603 Oct 29 03:04:52.638718 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1846/3874] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:51 2022] GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574 => generated 1528 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:52.643676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-ec85abd2-781f-47b7-901f-e7d2c821585d req-8681eb13-8d8b-49e4-b249-06cd84c959c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c72534eb-1844-4208-b625-ea8b5ece8108", "name": "network-vif-deleted", "tag": "3febcbca-e08c-4130-ae81-3ac6a9c05e2b"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:52.656795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ebff49ea-fd1b-4103-8a58-d37b9cd4c7e9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:52.663357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ebff49ea-fd1b-4103-8a58-d37b9cd4c7e9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Old instance type m1.heat2, new instance type m1.heat {{(pid=127124) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 03:04:52.682508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-ebff49ea-fd1b-4103-8a58-d37b9cd4c7e9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:04:52.686845 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-ebff49ea-fd1b-4103-8a58-d37b9cd4c7e9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:04:52.687865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-ebff49ea-fd1b-4103-8a58-d37b9cd4c7e9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:04:52.689972 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ec85abd2-781f-47b7-901f-e7d2c821585d req-8681eb13-8d8b-49e4-b249-06cd84c959c5 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:52.690650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-ebff49ea-fd1b-4103-8a58-d37b9cd4c7e9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:04:52.700344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-ebff49ea-fd1b-4103-8a58-d37b9cd4c7e9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:04:52.710369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ec85abd2-781f-47b7-901f-e7d2c821585d req-8681eb13-8d8b-49e4-b249-06cd84c959c5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:52.711511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ec85abd2-781f-47b7-901f-e7d2c821585d req-8681eb13-8d8b-49e4-b249-06cd84c959c5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:52.750317 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-ec85abd2-781f-47b7-901f-e7d2c821585d req-8681eb13-8d8b-49e4-b249-06cd84c959c5 service nova] Creating event network-vif-deleted:3febcbca-e08c-4130-ae81-3ac6a9c05e2b for instance c72534eb-1844-4208-b625-ea8b5ece8108 on n-h1-862967-2 Oct 29 03:04:52.775782 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-ec85abd2-781f-47b7-901f-e7d2c821585d req-8681eb13-8d8b-49e4-b249-06cd84c959c5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135417 Oct 29 03:04:52.776814 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1847/3875] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:52.782379 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-281e1605-206e-4bfc-9ac7-4ec5e026f0ff tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:52.788264 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-281e1605-206e-4bfc-9ac7-4ec5e026f0ff tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:52.801690 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-281e1605-206e-4bfc-9ac7-4ec5e026f0ff tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:52.804184 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-281e1605-206e-4bfc-9ac7-4ec5e026f0ff tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:52.804870 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-281e1605-206e-4bfc-9ac7-4ec5e026f0ff tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:52.807220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-281e1605-206e-4bfc-9ac7-4ec5e026f0ff tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:52.808072 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-281e1605-206e-4bfc-9ac7-4ec5e026f0ff tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:52.812076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-281e1605-206e-4bfc-9ac7-4ec5e026f0ff tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:52.967344 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ebff49ea-fd1b-4103-8a58-d37b9cd4c7e9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "POST /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec/action" status: 202 len: 0 microversion: 2.1 time: 0.557552 Oct 29 03:04:52.976025 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2029/3876] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:04:52 2022] POST /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec/action => generated 0 bytes in 567 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:04:52.985332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d4f75e5e-7fbd-4320-8f88-a4e9b8aaf422 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:52.995465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d4f75e5e-7fbd-4320-8f88-a4e9b8aaf422 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:53.004120 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4f75e5e-7fbd-4320-8f88-a4e9b8aaf422 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:53.005025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4f75e5e-7fbd-4320-8f88-a4e9b8aaf422 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:53.011662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4f75e5e-7fbd-4320-8f88-a4e9b8aaf422 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:53.012917 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4f75e5e-7fbd-4320-8f88-a4e9b8aaf422 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:53.013589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4f75e5e-7fbd-4320-8f88-a4e9b8aaf422 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:53.014271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4f75e5e-7fbd-4320-8f88-a4e9b8aaf422 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:53.071697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:53.207737 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-281e1605-206e-4bfc-9ac7-4ec5e026f0ff tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:53.224185 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-281e1605-206e-4bfc-9ac7-4ec5e026f0ff tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:53.233695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-281e1605-206e-4bfc-9ac7-4ec5e026f0ff tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:53.238150 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-281e1605-206e-4bfc-9ac7-4ec5e026f0ff tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1731 microversion: 2.20 time: 0.460088 Oct 29 03:04:53.243185 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1848/3877] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:52 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1731 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:53.263697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-933cdf1d-b387-4873-8854-c11adf06ccd7 req-3a53c288-4ade-42dc-afe4-ede5bbeb1d71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "354cb0c1-2737-486f-8e3b-d119c49a46a7", "name": "network-vif-plugged", "status": "completed", "tag": "0e820bc1-bfed-42bc-8698-d91dc009de10"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:53.282786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-933cdf1d-b387-4873-8854-c11adf06ccd7 req-3a53c288-4ade-42dc-afe4-ede5bbeb1d71 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:53.283276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-933cdf1d-b387-4873-8854-c11adf06ccd7 req-3a53c288-4ade-42dc-afe4-ede5bbeb1d71 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:53.290203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-933cdf1d-b387-4873-8854-c11adf06ccd7 req-3a53c288-4ade-42dc-afe4-ede5bbeb1d71 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:53.301647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:53.324891 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-933cdf1d-b387-4873-8854-c11adf06ccd7 req-3a53c288-4ade-42dc-afe4-ede5bbeb1d71 service nova] Creating event network-vif-plugged:0e820bc1-bfed-42bc-8698-d91dc009de10 for instance 354cb0c1-2737-486f-8e3b-d119c49a46a7 on n-h1-862967-2 Oct 29 03:04:53.339597 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-933cdf1d-b387-4873-8854-c11adf06ccd7 req-3a53c288-4ade-42dc-afe4-ede5bbeb1d71 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094105 Oct 29 03:04:53.342179 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1849/3878] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:53.358795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=10 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:53.886501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dbcf8d98-ad82-4cfa-a911-47e73f0eac07 tempest-ServersNegativeTestMultiTenantJSON-1038592850 tempest-ServersNegativeTestMultiTenantJSON-1038592850-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:53.887411 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dbcf8d98-ad82-4cfa-a911-47e73f0eac07 tempest-ServersNegativeTestMultiTenantJSON-1038592850 tempest-ServersNegativeTestMultiTenantJSON-1038592850-project] [instance: b955d0c2-5679-4b7f-9c9b-92671911b574] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:53.906619 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbcf8d98-ad82-4cfa-a911-47e73f0eac07 tempest-ServersNegativeTestMultiTenantJSON-1038592850 tempest-ServersNegativeTestMultiTenantJSON-1038592850-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:53.908328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbcf8d98-ad82-4cfa-a911-47e73f0eac07 tempest-ServersNegativeTestMultiTenantJSON-1038592850 tempest-ServersNegativeTestMultiTenantJSON-1038592850-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:53.909544 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbcf8d98-ad82-4cfa-a911-47e73f0eac07 tempest-ServersNegativeTestMultiTenantJSON-1038592850 tempest-ServersNegativeTestMultiTenantJSON-1038592850-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:53.911032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbcf8d98-ad82-4cfa-a911-47e73f0eac07 tempest-ServersNegativeTestMultiTenantJSON-1038592850 tempest-ServersNegativeTestMultiTenantJSON-1038592850-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:53.913176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbcf8d98-ad82-4cfa-a911-47e73f0eac07 tempest-ServersNegativeTestMultiTenantJSON-1038592850 tempest-ServersNegativeTestMultiTenantJSON-1038592850-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:53.914501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbcf8d98-ad82-4cfa-a911-47e73f0eac07 tempest-ServersNegativeTestMultiTenantJSON-1038592850 tempest-ServersNegativeTestMultiTenantJSON-1038592850-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:53.958083 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-dbcf8d98-ad82-4cfa-a911-47e73f0eac07 tempest-ServersNegativeTestMultiTenantJSON-1038592850 tempest-ServersNegativeTestMultiTenantJSON-1038592850-project] HTTP exception thrown: Instance b955d0c2-5679-4b7f-9c9b-92671911b574 could not be found. Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dbcf8d98-ad82-4cfa-a911-47e73f0eac07 tempest-ServersNegativeTestMultiTenantJSON-1038592850 tempest-ServersNegativeTestMultiTenantJSON-1038592850-project] Request method failure captured: Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574 HTTP/1.1 Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJg0zd8Xtf2nLG_T32HlnON-PZi6v7OxEhqM8noKObuglecOvya2V5uUBkW15o8TxIw_-b571XjP1P2xufPpzx_1zHeg_rVw1V2nQj8AtH-_RaCAehpOom5Ec7zzakAqb48yamopghiopWvrwmc4WOIF1AxM91AgO5Xkj2GJoe1xgLI Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: d89e264bb2994245af9988ee3368f6d7 Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1038592850 Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d89e264bb2994245af9988ee3368f6d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d89e264bb2994245af9988ee3368f6d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d89e264bb2994245af9988ee3368f6d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d89e264bb2994245af9988ee3368f6d7"}]}] Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1038592850 Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: d89e264bb2994245af9988ee3368f6d7 Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1038592850 Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1038592850-project Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 3c383ba6db014ff1be07ec8d2a1fb967 Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1038592850-project Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance b955d0c2-5679-4b7f-9c9b-92671911b574 could not be found. Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'b955d0c2-5679-4b7f-9c9b-92671911b574'} Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b955d0c2-5679-4b7f-9c9b-92671911b574 could not be found. Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:04:53.960161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:04:53.965367 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b955d0c2-5679-4b7f-9c9b-92671911b574 could not be found. Oct 29 03:04:53.965367 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:04:53.965367 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:53.965367 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:04:53.965367 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:53.965367 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:53.965367 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:53.965367 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:04:53.965367 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:04:53.965367 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b955d0c2-5679-4b7f-9c9b-92671911b574 could not be found. Oct 29 03:04:53.965367 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:04:53.965367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dbcf8d98-ad82-4cfa-a911-47e73f0eac07 tempest-ServersNegativeTestMultiTenantJSON-1038592850 tempest-ServersNegativeTestMultiTenantJSON-1038592850-project] Returning 404 to user: Instance b955d0c2-5679-4b7f-9c9b-92671911b574 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:04:53.966269 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dbcf8d98-ad82-4cfa-a911-47e73f0eac07 tempest-ServersNegativeTestMultiTenantJSON-1038592850 tempest-ServersNegativeTestMultiTenantJSON-1038592850-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574" status: 404 len: 111 microversion: 2.1 time: 0.618179 Oct 29 03:04:53.966269 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1850/3879] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:04:53 2022] DELETE /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574 => generated 111 bytes in 620 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:04:53.981733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7849fb7f-7f65-426d-8256-40c3057a75a7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:53.982805 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7849fb7f-7f65-426d-8256-40c3057a75a7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:54.003452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7849fb7f-7f65-426d-8256-40c3057a75a7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:54.004120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7849fb7f-7f65-426d-8256-40c3057a75a7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:54.005288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7849fb7f-7f65-426d-8256-40c3057a75a7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:54.006564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7849fb7f-7f65-426d-8256-40c3057a75a7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:54.007109 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7849fb7f-7f65-426d-8256-40c3057a75a7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:54.008177 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7849fb7f-7f65-426d-8256-40c3057a75a7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:54.261323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d4f75e5e-7fbd-4320-8f88-a4e9b8aaf422 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:54.274988 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d4f75e5e-7fbd-4320-8f88-a4e9b8aaf422 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1506 microversion: 2.1 time: 1.295207 Oct 29 03:04:54.275745 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2030/3880] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:52 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1506 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:54.293038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-36cbc0f6-7d30-4545-90cc-2b3a2656977a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:54.293853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-36cbc0f6-7d30-4545-90cc-2b3a2656977a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:54.309027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36cbc0f6-7d30-4545-90cc-2b3a2656977a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:54.311368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36cbc0f6-7d30-4545-90cc-2b3a2656977a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:54.311884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36cbc0f6-7d30-4545-90cc-2b3a2656977a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:54.313752 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36cbc0f6-7d30-4545-90cc-2b3a2656977a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:54.315070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36cbc0f6-7d30-4545-90cc-2b3a2656977a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:54.316778 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36cbc0f6-7d30-4545-90cc-2b3a2656977a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:54.349832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7849fb7f-7f65-426d-8256-40c3057a75a7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:54.374283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7849fb7f-7f65-426d-8256-40c3057a75a7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:54.385299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7849fb7f-7f65-426d-8256-40c3057a75a7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:54.402761 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7849fb7f-7f65-426d-8256-40c3057a75a7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 2752 microversion: 2.32 time: 0.412645 Oct 29 03:04:54.417872 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1851/3881] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:53 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 2752 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:54.451181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-13d55c9b-aa28-4acc-8095-db30777df5a3 req-82593025-c112-4c9c-8ace-3ee7373ef44a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fa383d1-1572-4975-9de9-22286e5458a2", "tag": "2235e54c-806d-494b-b955-e92306257303"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:54.487080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-13d55c9b-aa28-4acc-8095-db30777df5a3 req-82593025-c112-4c9c-8ace-3ee7373ef44a service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:54.487631 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-13d55c9b-aa28-4acc-8095-db30777df5a3 req-82593025-c112-4c9c-8ace-3ee7373ef44a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:54.489083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-13d55c9b-aa28-4acc-8095-db30777df5a3 req-82593025-c112-4c9c-8ace-3ee7373ef44a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:54.543155 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-13d55c9b-aa28-4acc-8095-db30777df5a3 req-82593025-c112-4c9c-8ace-3ee7373ef44a service nova] Creating event network-changed:2235e54c-806d-494b-b955-e92306257303 for instance 6fa383d1-1572-4975-9de9-22286e5458a2 on n-h1-862967-2 Oct 29 03:04:54.569021 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-13d55c9b-aa28-4acc-8095-db30777df5a3 req-82593025-c112-4c9c-8ace-3ee7373ef44a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142869 Oct 29 03:04:54.569868 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1852/3882] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:54.595138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9e101364-b6dd-4041-98f0-b57e3386b9bd tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:54.596298 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9e101364-b6dd-4041-98f0-b57e3386b9bd tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:54.639715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e101364-b6dd-4041-98f0-b57e3386b9bd tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:54.642048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e101364-b6dd-4041-98f0-b57e3386b9bd tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:54.642899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e101364-b6dd-4041-98f0-b57e3386b9bd tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:54.644102 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e101364-b6dd-4041-98f0-b57e3386b9bd tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:54.644956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e101364-b6dd-4041-98f0-b57e3386b9bd tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:54.645726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e101364-b6dd-4041-98f0-b57e3386b9bd tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:54.852251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9e101364-b6dd-4041-98f0-b57e3386b9bd tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85efe9a35c8646ffadadc5a6bd9f0824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:54.873056 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9e101364-b6dd-4041-98f0-b57e3386b9bd tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2" status: 200 len: 1303 microversion: 2.1 time: 0.296848 Oct 29 03:04:54.875675 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1853/3883] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:54 2022] GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2 => generated 1303 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:54.885521 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-95302028-9028-4a26-9cbf-9e07d036e279 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:54.888320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-95302028-9028-4a26-9cbf-9e07d036e279 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] [instance: b955d0c2-5679-4b7f-9c9b-92671911b574] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:54.901365 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95302028-9028-4a26-9cbf-9e07d036e279 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:54.901892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95302028-9028-4a26-9cbf-9e07d036e279 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:54.903812 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95302028-9028-4a26-9cbf-9e07d036e279 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:54.904822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95302028-9028-4a26-9cbf-9e07d036e279 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:54.906462 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95302028-9028-4a26-9cbf-9e07d036e279 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:54.908854 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95302028-9028-4a26-9cbf-9e07d036e279 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:55.044567 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-36cbc0f6-7d30-4545-90cc-2b3a2656977a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:55.054439 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-36cbc0f6-7d30-4545-90cc-2b3a2656977a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1472 microversion: 2.1 time: 0.776952 Oct 29 03:04:55.056045 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2031/3884] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:54 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1472 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:55.061696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0431df43-376a-409b-9aae-ffa782c7eeb0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:55.063196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0431df43-376a-409b-9aae-ffa782c7eeb0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:55.079886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0431df43-376a-409b-9aae-ffa782c7eeb0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:55.080927 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0431df43-376a-409b-9aae-ffa782c7eeb0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:55.082355 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0431df43-376a-409b-9aae-ffa782c7eeb0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:55.083617 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0431df43-376a-409b-9aae-ffa782c7eeb0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:55.087706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0431df43-376a-409b-9aae-ffa782c7eeb0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:55.088672 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0431df43-376a-409b-9aae-ffa782c7eeb0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:55.459775 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-95302028-9028-4a26-9cbf-9e07d036e279 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52009279acbd46919353742edb6cf2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016dc7d91d1e4977ba712f7bed5218e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:55.471103 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-95302028-9028-4a26-9cbf-9e07d036e279 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] 10.222.0.46 "GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574" status: 200 len: 1528 microversion: 2.1 time: 0.593605 Oct 29 03:04:55.471619 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1854/3885] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:54 2022] GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574 => generated 1528 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:55.509649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2b9454bd-8145-4cb4-a44d-a6c6186c19f1 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:55.510770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2b9454bd-8145-4cb4-a44d-a6c6186c19f1 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:55.526806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b9454bd-8145-4cb4-a44d-a6c6186c19f1 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:55.527315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b9454bd-8145-4cb4-a44d-a6c6186c19f1 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:55.530355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b9454bd-8145-4cb4-a44d-a6c6186c19f1 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:55.531150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b9454bd-8145-4cb4-a44d-a6c6186c19f1 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:55.531621 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b9454bd-8145-4cb4-a44d-a6c6186c19f1 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:55.534908 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b9454bd-8145-4cb4-a44d-a6c6186c19f1 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:56.119512 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0431df43-376a-409b-9aae-ffa782c7eeb0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:56.191290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0431df43-376a-409b-9aae-ffa782c7eeb0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:56.199163 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0431df43-376a-409b-9aae-ffa782c7eeb0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:56.201248 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0431df43-376a-409b-9aae-ffa782c7eeb0 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1731 microversion: 2.20 time: 1.143492 Oct 29 03:04:56.227042 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2032/3886] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:55 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1731 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:56.255113 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-089b9b25-1b34-422c-b59b-02706d552879 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:56.255978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-089b9b25-1b34-422c-b59b-02706d552879 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:56.263502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-089b9b25-1b34-422c-b59b-02706d552879 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:56.279391 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-089b9b25-1b34-422c-b59b-02706d552879 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:56.280570 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-089b9b25-1b34-422c-b59b-02706d552879 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:56.281226 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-089b9b25-1b34-422c-b59b-02706d552879 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:56.281704 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-089b9b25-1b34-422c-b59b-02706d552879 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:56.282161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-089b9b25-1b34-422c-b59b-02706d552879 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:56.850319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-089b9b25-1b34-422c-b59b-02706d552879 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:56.860459 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-089b9b25-1b34-422c-b59b-02706d552879 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:56.877125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-089b9b25-1b34-422c-b59b-02706d552879 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:56.879271 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-089b9b25-1b34-422c-b59b-02706d552879 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 2705 microversion: 2.32 time: 0.642496 Oct 29 03:04:56.879883 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2033/3887] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:56 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 2705 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:56.894273 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-086ff2e6-08fb-45ff-ba6c-105121f39c0d tempest-ServersNegativeTestMultiTenantJSON-1038592850 tempest-ServersNegativeTestMultiTenantJSON-1038592850-project] Action: 'update', calling method: >, body: {"server": {"name": "b955d0c2-5679-4b7f-9c9b-92671911b574_new"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:56.896984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-086ff2e6-08fb-45ff-ba6c-105121f39c0d tempest-ServersNegativeTestMultiTenantJSON-1038592850 tempest-ServersNegativeTestMultiTenantJSON-1038592850-project] [instance: b955d0c2-5679-4b7f-9c9b-92671911b574] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:56.926713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-086ff2e6-08fb-45ff-ba6c-105121f39c0d tempest-ServersNegativeTestMultiTenantJSON-1038592850 tempest-ServersNegativeTestMultiTenantJSON-1038592850-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:56.927996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-086ff2e6-08fb-45ff-ba6c-105121f39c0d tempest-ServersNegativeTestMultiTenantJSON-1038592850 tempest-ServersNegativeTestMultiTenantJSON-1038592850-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:56.928810 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-086ff2e6-08fb-45ff-ba6c-105121f39c0d tempest-ServersNegativeTestMultiTenantJSON-1038592850 tempest-ServersNegativeTestMultiTenantJSON-1038592850-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:56.929875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-086ff2e6-08fb-45ff-ba6c-105121f39c0d tempest-ServersNegativeTestMultiTenantJSON-1038592850 tempest-ServersNegativeTestMultiTenantJSON-1038592850-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:56.933547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-086ff2e6-08fb-45ff-ba6c-105121f39c0d tempest-ServersNegativeTestMultiTenantJSON-1038592850 tempest-ServersNegativeTestMultiTenantJSON-1038592850-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:56.934327 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-086ff2e6-08fb-45ff-ba6c-105121f39c0d tempest-ServersNegativeTestMultiTenantJSON-1038592850 tempest-ServersNegativeTestMultiTenantJSON-1038592850-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:56.976586 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-086ff2e6-08fb-45ff-ba6c-105121f39c0d tempest-ServersNegativeTestMultiTenantJSON-1038592850 tempest-ServersNegativeTestMultiTenantJSON-1038592850-project] HTTP exception thrown: Instance b955d0c2-5679-4b7f-9c9b-92671911b574 could not be found. Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-086ff2e6-08fb-45ff-ba6c-105121f39c0d tempest-ServersNegativeTestMultiTenantJSON-1038592850 tempest-ServersNegativeTestMultiTenantJSON-1038592850-project] Request method failure captured: Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: request: PUT /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574 HTTP/1.1 Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 64 Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJg0zd8Xtf2nLG_T32HlnON-PZi6v7OxEhqM8noKObuglecOvya2V5uUBkW15o8TxIw_-b571XjP1P2xufPpzx_1zHeg_rVw1V2nQj8AtH-_RaCAehpOom5Ec7zzakAqb48yamopghiopWvrwmc4WOIF1AxM91AgO5Xkj2GJoe1xgLI Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: d89e264bb2994245af9988ee3368f6d7 Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1038592850 Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d89e264bb2994245af9988ee3368f6d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d89e264bb2994245af9988ee3368f6d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d89e264bb2994245af9988ee3368f6d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d89e264bb2994245af9988ee3368f6d7"}]}] Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1038592850 Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: d89e264bb2994245af9988ee3368f6d7 Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1038592850 Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1038592850-project Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 3c383ba6db014ff1be07ec8d2a1fb967 Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1038592850-project Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: {"server": {"name": "b955d0c2-5679-4b7f-9c9b-92671911b574_new"}} Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance b955d0c2-5679-4b7f-9c9b-92671911b574 could not be found. Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'b955d0c2-5679-4b7f-9c9b-92671911b574', 'body': {'server': {'name': 'b955d0c2-5679-4b7f-9c9b-92671911b574_new'}}} Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b955d0c2-5679-4b7f-9c9b-92671911b574 could not be found. Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:04:56.979177 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 29 03:04:57.026473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 29 03:04:57.026473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 29 03:04:57.026473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:04:57.026473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:04:57.026473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:04:57.026473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:04:57.026473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b955d0c2-5679-4b7f-9c9b-92671911b574 could not be found. Oct 29 03:04:57.026473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:04:57.026473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:04:57.026473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:04:57.026473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:04:57.026473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:04:57.026473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:04:57.026473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:04:57.026473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:04:57.026473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b955d0c2-5679-4b7f-9c9b-92671911b574 could not be found. Oct 29 03:04:57.026473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:04:57.026473 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-086ff2e6-08fb-45ff-ba6c-105121f39c0d tempest-ServersNegativeTestMultiTenantJSON-1038592850 tempest-ServersNegativeTestMultiTenantJSON-1038592850-project] Returning 404 to user: Instance b955d0c2-5679-4b7f-9c9b-92671911b574 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:04:57.026473 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-086ff2e6-08fb-45ff-ba6c-105121f39c0d tempest-ServersNegativeTestMultiTenantJSON-1038592850 tempest-ServersNegativeTestMultiTenantJSON-1038592850-project] 10.222.0.46 "PUT /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574" status: 404 len: 111 microversion: 2.1 time: 0.100287 Oct 29 03:04:57.026473 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2034/3888] 10.222.0.46 () {60 vars in 1256 bytes} [Sat Oct 29 03:04:56 2022] PUT /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:04:57.029218 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2b9454bd-8145-4cb4-a44d-a6c6186c19f1 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:57.050175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-54c70d2d-6dfd-4d93-9d35-c7ae8ffc3006 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:57.050806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-54c70d2d-6dfd-4d93-9d35-c7ae8ffc3006 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:57.060404 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2b9454bd-8145-4cb4-a44d-a6c6186c19f1 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1506 microversion: 2.1 time: 1.561475 Oct 29 03:04:57.069394 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1855/3889] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:55 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1506 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:57.087880 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fc345b98-1db1-49e9-99a2-77b90214dcaf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:57.094168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-54c70d2d-6dfd-4d93-9d35-c7ae8ffc3006 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:57.097382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fc345b98-1db1-49e9-99a2-77b90214dcaf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:57.098470 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-54c70d2d-6dfd-4d93-9d35-c7ae8ffc3006 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:57.109627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-54c70d2d-6dfd-4d93-9d35-c7ae8ffc3006 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:57.110849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-54c70d2d-6dfd-4d93-9d35-c7ae8ffc3006 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:57.114897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-54c70d2d-6dfd-4d93-9d35-c7ae8ffc3006 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:57.120434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-54c70d2d-6dfd-4d93-9d35-c7ae8ffc3006 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:57.143298 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc345b98-1db1-49e9-99a2-77b90214dcaf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:57.146356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc345b98-1db1-49e9-99a2-77b90214dcaf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:57.147158 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc345b98-1db1-49e9-99a2-77b90214dcaf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:57.148174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc345b98-1db1-49e9-99a2-77b90214dcaf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:57.157322 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc345b98-1db1-49e9-99a2-77b90214dcaf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:57.165240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc345b98-1db1-49e9-99a2-77b90214dcaf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:58.176303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-54c70d2d-6dfd-4d93-9d35-c7ae8ffc3006 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85efe9a35c8646ffadadc5a6bd9f0824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:58.190064 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-54c70d2d-6dfd-4d93-9d35-c7ae8ffc3006 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2" status: 200 len: 1303 microversion: 2.1 time: 1.195293 Oct 29 03:04:58.190957 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2035/3890] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:56 2022] GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2 => generated 1303 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:58.216744 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-765a0ebc-0eba-4d26-a972-0bb59c1e0828 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:58.217533 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-765a0ebc-0eba-4d26-a972-0bb59c1e0828 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] [instance: b955d0c2-5679-4b7f-9c9b-92671911b574] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:58.251720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-765a0ebc-0eba-4d26-a972-0bb59c1e0828 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:58.252355 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-765a0ebc-0eba-4d26-a972-0bb59c1e0828 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:58.252983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-765a0ebc-0eba-4d26-a972-0bb59c1e0828 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:58.253829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-765a0ebc-0eba-4d26-a972-0bb59c1e0828 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:58.254489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-765a0ebc-0eba-4d26-a972-0bb59c1e0828 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:58.255012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-765a0ebc-0eba-4d26-a972-0bb59c1e0828 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:58.323381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-765a0ebc-0eba-4d26-a972-0bb59c1e0828 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] [instance: b955d0c2-5679-4b7f-9c9b-92671911b574] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:04:58.552486 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fc345b98-1db1-49e9-99a2-77b90214dcaf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:58.561317 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fc345b98-1db1-49e9-99a2-77b90214dcaf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1472 microversion: 2.1 time: 1.484994 Oct 29 03:04:58.569812 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-765a0ebc-0eba-4d26-a972-0bb59c1e0828 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574" status: 204 len: 0 microversion: 2.1 time: 0.362218 Oct 29 03:04:58.570824 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1856/3891] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:57 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1472 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:58.586210 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2036/3892] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:04:58 2022] DELETE /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:04:58.593084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4d49eb58-f272-40e4-9d28-989fa877205b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:58.593894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4d49eb58-f272-40e4-9d28-989fa877205b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:58.601612 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-1b1247a0-d769-4aa9-bebf-6340a27657cb req-2c5d4701-7066-4e4f-8ac2-cd3186d03f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c72534eb-1844-4208-b625-ea8b5ece8108", "name": "network-vif-deleted", "tag": "c7d91e7c-5b11-484a-b555-6a407dc903e3"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:58.607513 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d49eb58-f272-40e4-9d28-989fa877205b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:58.608257 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d49eb58-f272-40e4-9d28-989fa877205b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:58.613125 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d49eb58-f272-40e4-9d28-989fa877205b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:58.614042 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d49eb58-f272-40e4-9d28-989fa877205b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:58.614656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d49eb58-f272-40e4-9d28-989fa877205b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:58.615221 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d49eb58-f272-40e4-9d28-989fa877205b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:58.634679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1b1247a0-d769-4aa9-bebf-6340a27657cb req-2c5d4701-7066-4e4f-8ac2-cd3186d03f57 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:58.637551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1b1247a0-d769-4aa9-bebf-6340a27657cb req-2c5d4701-7066-4e4f-8ac2-cd3186d03f57 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:58.641684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1b1247a0-d769-4aa9-bebf-6340a27657cb req-2c5d4701-7066-4e4f-8ac2-cd3186d03f57 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:58.687845 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-1b1247a0-d769-4aa9-bebf-6340a27657cb req-2c5d4701-7066-4e4f-8ac2-cd3186d03f57 service nova] Creating event network-vif-deleted:c7d91e7c-5b11-484a-b555-6a407dc903e3 for instance c72534eb-1844-4208-b625-ea8b5ece8108 on n-h1-862967-2 Oct 29 03:04:58.706652 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-1b1247a0-d769-4aa9-bebf-6340a27657cb req-2c5d4701-7066-4e4f-8ac2-cd3186d03f57 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114882 Oct 29 03:04:58.707330 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2037/3893] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:04:58.724515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ffd45bfe-04c9-44c8-94f8-a81f0d6b03d2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:58.729121 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ffd45bfe-04c9-44c8-94f8-a81f0d6b03d2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:58.747753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffd45bfe-04c9-44c8-94f8-a81f0d6b03d2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:58.749305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffd45bfe-04c9-44c8-94f8-a81f0d6b03d2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:58.750388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffd45bfe-04c9-44c8-94f8-a81f0d6b03d2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:58.752440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffd45bfe-04c9-44c8-94f8-a81f0d6b03d2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:58.753239 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffd45bfe-04c9-44c8-94f8-a81f0d6b03d2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:58.753828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffd45bfe-04c9-44c8-94f8-a81f0d6b03d2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:58.998296 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4d49eb58-f272-40e4-9d28-989fa877205b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:59.014030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4d49eb58-f272-40e4-9d28-989fa877205b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:59.015548 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4d49eb58-f272-40e4-9d28-989fa877205b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:59.017058 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4d49eb58-f272-40e4-9d28-989fa877205b tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1718 microversion: 2.20 time: 0.428857 Oct 29 03:04:59.017486 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1857/3894] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:58 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1718 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:59.029623 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b8feaca9-7554-4cdc-a210-52da4d59aff7 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:59.033583 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b8feaca9-7554-4cdc-a210-52da4d59aff7 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:59.044764 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8feaca9-7554-4cdc-a210-52da4d59aff7 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:59.045539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8feaca9-7554-4cdc-a210-52da4d59aff7 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:59.046234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8feaca9-7554-4cdc-a210-52da4d59aff7 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:59.046834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8feaca9-7554-4cdc-a210-52da4d59aff7 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:59.047435 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8feaca9-7554-4cdc-a210-52da4d59aff7 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:59.047998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8feaca9-7554-4cdc-a210-52da4d59aff7 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:59.217472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ffd45bfe-04c9-44c8-94f8-a81f0d6b03d2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:59.228733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ffd45bfe-04c9-44c8-94f8-a81f0d6b03d2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:59.230510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ffd45bfe-04c9-44c8-94f8-a81f0d6b03d2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:59.232190 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ffd45bfe-04c9-44c8-94f8-a81f0d6b03d2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 2418 microversion: 2.32 time: 0.520478 Oct 29 03:04:59.233597 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2038/3895] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:04:58 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 2418 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:04:59.238717 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ce3b6f3b-c802-467a-8733-c2e889c9775a tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:59.239485 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ce3b6f3b-c802-467a-8733-c2e889c9775a tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] [instance: b955d0c2-5679-4b7f-9c9b-92671911b574] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:59.246354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce3b6f3b-c802-467a-8733-c2e889c9775a tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:59.247002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce3b6f3b-c802-467a-8733-c2e889c9775a tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:59.247678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce3b6f3b-c802-467a-8733-c2e889c9775a tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:59.248751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce3b6f3b-c802-467a-8733-c2e889c9775a tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:59.249357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce3b6f3b-c802-467a-8733-c2e889c9775a tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:59.249924 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce3b6f3b-c802-467a-8733-c2e889c9775a tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:59.533381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b8feaca9-7554-4cdc-a210-52da4d59aff7 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:59.535928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ce3b6f3b-c802-467a-8733-c2e889c9775a tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52009279acbd46919353742edb6cf2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016dc7d91d1e4977ba712f7bed5218e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:04:59.544409 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ce3b6f3b-c802-467a-8733-c2e889c9775a tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] 10.222.0.46 "GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574" status: 200 len: 1534 microversion: 2.1 time: 0.309487 Oct 29 03:04:59.545065 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2039/3896] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:59 2022] GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574 => generated 1534 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:59.553998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-24f65fea-e069-411e-bc1e-673c01b7c49b tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:04:59.554616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-24f65fea-e069-411e-bc1e-673c01b7c49b tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:04:59.562055 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b8feaca9-7554-4cdc-a210-52da4d59aff7 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1506 microversion: 2.1 time: 0.538043 Oct 29 03:04:59.565118 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1858/3897] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:59 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1506 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:04:59.590849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-24f65fea-e069-411e-bc1e-673c01b7c49b tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:59.593836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-24f65fea-e069-411e-bc1e-673c01b7c49b tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:59.594456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-24f65fea-e069-411e-bc1e-673c01b7c49b tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:59.595380 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-24f65fea-e069-411e-bc1e-673c01b7c49b tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:04:59.596007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-24f65fea-e069-411e-bc1e-673c01b7c49b tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:04:59.596722 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-24f65fea-e069-411e-bc1e-673c01b7c49b tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:04:59.820995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cd9c8262-6108-4286-9596-5b40a4e5853a tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-244498515", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "819e9815-884e-46be-8b93-17fc94519d20"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:04:59.901120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-cd9c8262-6108-4286-9596-5b40a4e5853a tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] validate_networks() for [('819e9815-884e-46be-8b93-17fc94519d20', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:05:00.329389 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-24f65fea-e069-411e-bc1e-673c01b7c49b tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85efe9a35c8646ffadadc5a6bd9f0824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:00.340248 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-24f65fea-e069-411e-bc1e-673c01b7c49b tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2" status: 200 len: 1291 microversion: 2.1 time: 0.794061 Oct 29 03:05:00.344487 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2040/3898] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:04:59 2022] GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2 => generated 1291 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:00.368156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-908bb801-6c41-4d5b-994b-369b1b3f559e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:00.370964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-908bb801-6c41-4d5b-994b-369b1b3f559e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:00.394054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-908bb801-6c41-4d5b-994b-369b1b3f559e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:00.395902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-908bb801-6c41-4d5b-994b-369b1b3f559e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:00.396878 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-908bb801-6c41-4d5b-994b-369b1b3f559e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:00.398036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-908bb801-6c41-4d5b-994b-369b1b3f559e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:00.398820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-908bb801-6c41-4d5b-994b-369b1b3f559e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:00.399377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-908bb801-6c41-4d5b-994b-369b1b3f559e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:01.151230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-908bb801-6c41-4d5b-994b-369b1b3f559e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:01.166226 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-908bb801-6c41-4d5b-994b-369b1b3f559e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1477 microversion: 2.1 time: 0.808105 Oct 29 03:05:01.173264 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2041/3899] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:00 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1477 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:01.185026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-32cb25d4-a017-496c-b995-af533898b789 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:01.190139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-32cb25d4-a017-496c-b995-af533898b789 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:01.199478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32cb25d4-a017-496c-b995-af533898b789 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:01.202135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32cb25d4-a017-496c-b995-af533898b789 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:01.202599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32cb25d4-a017-496c-b995-af533898b789 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:01.203339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32cb25d4-a017-496c-b995-af533898b789 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:01.203798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32cb25d4-a017-496c-b995-af533898b789 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:01.204224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32cb25d4-a017-496c-b995-af533898b789 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:01.295800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-32cb25d4-a017-496c-b995-af533898b789 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:01.307605 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-32cb25d4-a017-496c-b995-af533898b789 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:01.309574 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-32cb25d4-a017-496c-b995-af533898b789 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:01.310720 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-32cb25d4-a017-496c-b995-af533898b789 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1604 microversion: 2.32 time: 0.136094 Oct 29 03:05:01.324054 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2042/3900] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:01 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1604 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:01.324054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b6364653-f835-4484-9f16-aea76643a841 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:01.324054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b6364653-f835-4484-9f16-aea76643a841 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] [instance: b955d0c2-5679-4b7f-9c9b-92671911b574] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:01.324054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b6364653-f835-4484-9f16-aea76643a841 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:01.324918 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b6364653-f835-4484-9f16-aea76643a841 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:01.324918 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b6364653-f835-4484-9f16-aea76643a841 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:01.329280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b6364653-f835-4484-9f16-aea76643a841 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:01.329280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b6364653-f835-4484-9f16-aea76643a841 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:01.329280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b6364653-f835-4484-9f16-aea76643a841 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:01.452846 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-cd9c8262-6108-4286-9596-5b40a4e5853a tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:05:01.453916 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-cd9c8262-6108-4286-9596-5b40a4e5853a tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:05:01.454864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-cd9c8262-6108-4286-9596-5b40a4e5853a tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:05:01.455530 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-cd9c8262-6108-4286-9596-5b40a4e5853a tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:05:01.456135 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-cd9c8262-6108-4286-9596-5b40a4e5853a tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:05:01.469212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd9c8262-6108-4286-9596-5b40a4e5853a tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:01.471001 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd9c8262-6108-4286-9596-5b40a4e5853a tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:01.471785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd9c8262-6108-4286-9596-5b40a4e5853a tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:01.473686 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd9c8262-6108-4286-9596-5b40a4e5853a tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:01.474562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd9c8262-6108-4286-9596-5b40a4e5853a tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:01.482185 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd9c8262-6108-4286-9596-5b40a4e5853a tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:01.544407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-cd9c8262-6108-4286-9596-5b40a4e5853a tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Getting quotas for project a1bba82857ca4c3f808c6860d7d2599c. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:05:01.547056 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:01.564190 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-cd9c8262-6108-4286-9596-5b40a4e5853a tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Getting quotas for user 891dec8f8be64fad8c8e967d8327dda5 and project a1bba82857ca4c3f808c6860d7d2599c. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:05:01.624809 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cd9c8262-6108-4286-9596-5b40a4e5853a tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:05:01.628097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cd9c8262-6108-4286-9596-5b40a4e5853a tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] [instance: 5e78b6cd-1c9a-45f3-9e2c-791e01457a27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:05:01.691459 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b6364653-f835-4484-9f16-aea76643a841 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52009279acbd46919353742edb6cf2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016dc7d91d1e4977ba712f7bed5218e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:01.704227 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b6364653-f835-4484-9f16-aea76643a841 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] 10.222.0.46 "GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574" status: 200 len: 1534 microversion: 2.1 time: 0.390699 Oct 29 03:05:01.706382 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2043/3901] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:01 2022] GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574 => generated 1534 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:01.715848 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6a8ea9eb-533a-4f1d-9c03-a20e6db92966 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:01.717054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6a8ea9eb-533a-4f1d-9c03-a20e6db92966 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:01.724547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:01.726872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a8ea9eb-533a-4f1d-9c03-a20e6db92966 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:01.728018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a8ea9eb-533a-4f1d-9c03-a20e6db92966 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:01.729190 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a8ea9eb-533a-4f1d-9c03-a20e6db92966 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:01.731439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a8ea9eb-533a-4f1d-9c03-a20e6db92966 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:01.733219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a8ea9eb-533a-4f1d-9c03-a20e6db92966 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:01.733960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a8ea9eb-533a-4f1d-9c03-a20e6db92966 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:01.751432 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cd9c8262-6108-4286-9596-5b40a4e5853a tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.183931 Oct 29 03:05:01.759428 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1859/3902] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:04:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:05:01.776843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-2bd346a7-364d-46bb-8773-776384b9feff req-95c29b3b-83fb-42d0-a82a-a0f630617032 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c72534eb-1844-4208-b625-ea8b5ece8108", "name": "network-vif-deleted", "tag": "5c3d2712-9ad6-4627-8b5c-ca13b6071e0e"}, {"server_uuid": "c72534eb-1844-4208-b625-ea8b5ece8108", "name": "network-vif-deleted", "tag": "4c67f638-2ba1-48d4-80b9-c0539cebe183"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:01.806976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2bd346a7-364d-46bb-8773-776384b9feff req-95c29b3b-83fb-42d0-a82a-a0f630617032 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:01.808671 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2bd346a7-364d-46bb-8773-776384b9feff req-95c29b3b-83fb-42d0-a82a-a0f630617032 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:01.810483 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2bd346a7-364d-46bb-8773-776384b9feff req-95c29b3b-83fb-42d0-a82a-a0f630617032 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:01.859262 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:01.867366 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-2bd346a7-364d-46bb-8773-776384b9feff req-95c29b3b-83fb-42d0-a82a-a0f630617032 service nova] Creating event network-vif-deleted:5c3d2712-9ad6-4627-8b5c-ca13b6071e0e for instance c72534eb-1844-4208-b625-ea8b5ece8108 on n-h1-862967-2 Oct 29 03:05:01.867875 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-2bd346a7-364d-46bb-8773-776384b9feff req-95c29b3b-83fb-42d0-a82a-a0f630617032 service nova] Creating event network-vif-deleted:4c67f638-2ba1-48d4-80b9-c0539cebe183 for instance c72534eb-1844-4208-b625-ea8b5ece8108 on n-h1-862967-2 Oct 29 03:05:01.912799 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-2bd346a7-364d-46bb-8773-776384b9feff req-95c29b3b-83fb-42d0-a82a-a0f630617032 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.139286 Oct 29 03:05:01.916613 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1860/3903] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:01.938808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b5317601-d3cc-44fa-8f6c-2b4f6c5a8860 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:01.941427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b5317601-d3cc-44fa-8f6c-2b4f6c5a8860 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:01.963204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5317601-d3cc-44fa-8f6c-2b4f6c5a8860 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:01.963706 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5317601-d3cc-44fa-8f6c-2b4f6c5a8860 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:01.969194 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5317601-d3cc-44fa-8f6c-2b4f6c5a8860 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:01.970202 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5317601-d3cc-44fa-8f6c-2b4f6c5a8860 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:01.970811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5317601-d3cc-44fa-8f6c-2b4f6c5a8860 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:01.976087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5317601-d3cc-44fa-8f6c-2b4f6c5a8860 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:02.853622 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6a8ea9eb-533a-4f1d-9c03-a20e6db92966 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:02.880315 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6a8ea9eb-533a-4f1d-9c03-a20e6db92966 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1506 microversion: 2.1 time: 1.169040 Oct 29 03:05:02.903378 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2044/3904] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:01 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1506 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:02.920021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c3f93c06-1b60-43b0-a28f-02fcf8869b6c tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:02.921317 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c3f93c06-1b60-43b0-a28f-02fcf8869b6c tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] [instance: 5e78b6cd-1c9a-45f3-9e2c-791e01457a27] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:02.942058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3f93c06-1b60-43b0-a28f-02fcf8869b6c tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:02.946246 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3f93c06-1b60-43b0-a28f-02fcf8869b6c tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:02.956685 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3f93c06-1b60-43b0-a28f-02fcf8869b6c tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:02.957551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3f93c06-1b60-43b0-a28f-02fcf8869b6c tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:02.958164 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3f93c06-1b60-43b0-a28f-02fcf8869b6c tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:02.958700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3f93c06-1b60-43b0-a28f-02fcf8869b6c tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:02.959336 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b5317601-d3cc-44fa-8f6c-2b4f6c5a8860 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85efe9a35c8646ffadadc5a6bd9f0824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:02.982544 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b5317601-d3cc-44fa-8f6c-2b4f6c5a8860 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2" status: 200 len: 1291 microversion: 2.1 time: 1.064394 Oct 29 03:05:02.990777 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1861/3905] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:01 2022] GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2 => generated 1291 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:03.002814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1f042f78-e812-4029-8922-f72db9661a21 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:03.011065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1f042f78-e812-4029-8922-f72db9661a21 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:03.022049 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f042f78-e812-4029-8922-f72db9661a21 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:03.023321 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f042f78-e812-4029-8922-f72db9661a21 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:03.024076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f042f78-e812-4029-8922-f72db9661a21 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:03.026199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f042f78-e812-4029-8922-f72db9661a21 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:03.027584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f042f78-e812-4029-8922-f72db9661a21 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:03.028339 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f042f78-e812-4029-8922-f72db9661a21 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:03.129157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c3f93c06-1b60-43b0-a28f-02fcf8869b6c tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891dec8f8be64fad8c8e967d8327dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bba82857ca4c3f808c6860d7d2599c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:03.137661 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c3f93c06-1b60-43b0-a28f-02fcf8869b6c tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] 10.222.0.46 "GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27" status: 200 len: 1228 microversion: 2.1 time: 0.232839 Oct 29 03:05:03.152839 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2045/3906] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:02 2022] GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27 => generated 1228 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:03.182655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-13be7d47-7c13-4df3-9ea5-c632c330a9df tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:03.184215 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-13be7d47-7c13-4df3-9ea5-c632c330a9df tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:03.203506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13be7d47-7c13-4df3-9ea5-c632c330a9df tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:03.204929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13be7d47-7c13-4df3-9ea5-c632c330a9df tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:03.205879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13be7d47-7c13-4df3-9ea5-c632c330a9df tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:03.207480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13be7d47-7c13-4df3-9ea5-c632c330a9df tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:03.212923 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13be7d47-7c13-4df3-9ea5-c632c330a9df tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:03.213624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13be7d47-7c13-4df3-9ea5-c632c330a9df tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:03.283608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:03.359461 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-13be7d47-7c13-4df3-9ea5-c632c330a9df tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:03.371867 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-13be7d47-7c13-4df3-9ea5-c632c330a9df tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:03.374012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-13be7d47-7c13-4df3-9ea5-c632c330a9df tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:03.375710 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-13be7d47-7c13-4df3-9ea5-c632c330a9df tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1604 microversion: 2.32 time: 0.209940 Oct 29 03:05:03.376925 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2046/3907] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:03 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1604 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:03.382356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c412b69a-6db4-408e-a008-0117d84c81da tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:03.383607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c412b69a-6db4-408e-a008-0117d84c81da tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] [instance: b955d0c2-5679-4b7f-9c9b-92671911b574] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:03.391226 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c412b69a-6db4-408e-a008-0117d84c81da tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:03.392064 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c412b69a-6db4-408e-a008-0117d84c81da tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:03.392839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c412b69a-6db4-408e-a008-0117d84c81da tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:03.393775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c412b69a-6db4-408e-a008-0117d84c81da tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:03.394751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c412b69a-6db4-408e-a008-0117d84c81da tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:03.395392 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c412b69a-6db4-408e-a008-0117d84c81da tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:03.456253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1f042f78-e812-4029-8922-f72db9661a21 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:03.473573 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1f042f78-e812-4029-8922-f72db9661a21 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1477 microversion: 2.1 time: 0.481158 Oct 29 03:05:03.479645 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c412b69a-6db4-408e-a008-0117d84c81da tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:03.480486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c412b69a-6db4-408e-a008-0117d84c81da tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:03.481177 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c412b69a-6db4-408e-a008-0117d84c81da tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:03.481831 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-c412b69a-6db4-408e-a008-0117d84c81da tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lazy-loading 'fault' on Instance uuid b955d0c2-5679-4b7f-9c9b-92671911b574 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:05:03.482650 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1862/3908] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:02 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1477 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:03.489844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-102fa3f7-4fe1-415b-946e-55cacc33bbe8 req-4f00dbcb-5fe1-4b3d-ae9e-cb8e8cfe535f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b955d0c2-5679-4b7f-9c9b-92671911b574", "name": "network-vif-deleted", "tag": "59f467cf-8375-47a8-a788-87ff021e0b37"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:03.536755 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-102fa3f7-4fe1-415b-946e-55cacc33bbe8 req-4f00dbcb-5fe1-4b3d-ae9e-cb8e8cfe535f service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:03.538221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c412b69a-6db4-408e-a008-0117d84c81da tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52009279acbd46919353742edb6cf2d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '016dc7d91d1e4977ba712f7bed5218e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:03.541202 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-102fa3f7-4fe1-415b-946e-55cacc33bbe8 req-4f00dbcb-5fe1-4b3d-ae9e-cb8e8cfe535f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:03.541848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-102fa3f7-4fe1-415b-946e-55cacc33bbe8 req-4f00dbcb-5fe1-4b3d-ae9e-cb8e8cfe535f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:03.547794 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c412b69a-6db4-408e-a008-0117d84c81da tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] 10.222.0.46 "GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574" status: 200 len: 1318 microversion: 2.1 time: 0.169259 Oct 29 03:05:03.549222 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2047/3909] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:03 2022] GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:03.563548 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-102fa3f7-4fe1-415b-946e-55cacc33bbe8 req-4f00dbcb-5fe1-4b3d-ae9e-cb8e8cfe535f service nova] Creating event network-vif-deleted:59f467cf-8375-47a8-a788-87ff021e0b37 for instance b955d0c2-5679-4b7f-9c9b-92671911b574 on n-h2-862967-2 Oct 29 03:05:03.579406 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-102fa3f7-4fe1-415b-946e-55cacc33bbe8 req-4f00dbcb-5fe1-4b3d-ae9e-cb8e8cfe535f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094452 Oct 29 03:05:03.580484 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1863/3910] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:03.908865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cdb5c8fc-5ff1-4009-8ade-ef1ba49d2ea6 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:03.909494 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cdb5c8fc-5ff1-4009-8ade-ef1ba49d2ea6 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:03.920793 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cdb5c8fc-5ff1-4009-8ade-ef1ba49d2ea6 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:03.921294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cdb5c8fc-5ff1-4009-8ade-ef1ba49d2ea6 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:03.921894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cdb5c8fc-5ff1-4009-8ade-ef1ba49d2ea6 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:03.922762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cdb5c8fc-5ff1-4009-8ade-ef1ba49d2ea6 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:03.926286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cdb5c8fc-5ff1-4009-8ade-ef1ba49d2ea6 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:03.926821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cdb5c8fc-5ff1-4009-8ade-ef1ba49d2ea6 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:04.022620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a5262a7a-78c2-4325-b139-a9d555be2788 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:04.024320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a5262a7a-78c2-4325-b139-a9d555be2788 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:04.040090 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a5262a7a-78c2-4325-b139-a9d555be2788 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:04.050120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a5262a7a-78c2-4325-b139-a9d555be2788 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:04.053622 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a5262a7a-78c2-4325-b139-a9d555be2788 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:04.057004 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a5262a7a-78c2-4325-b139-a9d555be2788 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:04.060053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a5262a7a-78c2-4325-b139-a9d555be2788 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:04.062149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a5262a7a-78c2-4325-b139-a9d555be2788 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:04.220668 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cdb5c8fc-5ff1-4009-8ade-ef1ba49d2ea6 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:04.231390 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cdb5c8fc-5ff1-4009-8ade-ef1ba49d2ea6 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1506 microversion: 2.1 time: 0.326249 Oct 29 03:05:04.234450 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2048/3911] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:03 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:04.254106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-1f299e88-a222-4cc4-b165-d8c713504a2e req-fc7e20f6-5266-4bc6-9afa-d7d0086a9526 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c72534eb-1844-4208-b625-ea8b5ece8108", "name": "network-vif-deleted", "tag": "3feb2664-749f-4176-9acc-3d1f17ebbb83"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:04.281673 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1f299e88-a222-4cc4-b165-d8c713504a2e req-fc7e20f6-5266-4bc6-9afa-d7d0086a9526 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:04.288866 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1f299e88-a222-4cc4-b165-d8c713504a2e req-fc7e20f6-5266-4bc6-9afa-d7d0086a9526 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:04.289334 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1f299e88-a222-4cc4-b165-d8c713504a2e req-fc7e20f6-5266-4bc6-9afa-d7d0086a9526 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:04.325798 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-1f299e88-a222-4cc4-b165-d8c713504a2e req-fc7e20f6-5266-4bc6-9afa-d7d0086a9526 service nova] Creating event network-vif-deleted:3feb2664-749f-4176-9acc-3d1f17ebbb83 for instance c72534eb-1844-4208-b625-ea8b5ece8108 on n-h1-862967-2 Oct 29 03:05:04.337051 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-1f299e88-a222-4cc4-b165-d8c713504a2e req-fc7e20f6-5266-4bc6-9afa-d7d0086a9526 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097299 Oct 29 03:05:04.344840 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2049/3912] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:04.359307 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d686c426-9a30-443a-82ce-e7bcae540497 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:04.360022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d686c426-9a30-443a-82ce-e7bcae540497 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] [instance: 5e78b6cd-1c9a-45f3-9e2c-791e01457a27] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:04.377556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d686c426-9a30-443a-82ce-e7bcae540497 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:04.378258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d686c426-9a30-443a-82ce-e7bcae540497 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:04.378655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d686c426-9a30-443a-82ce-e7bcae540497 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:04.379385 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d686c426-9a30-443a-82ce-e7bcae540497 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:04.379836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d686c426-9a30-443a-82ce-e7bcae540497 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:04.380300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d686c426-9a30-443a-82ce-e7bcae540497 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:04.554960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d686c426-9a30-443a-82ce-e7bcae540497 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891dec8f8be64fad8c8e967d8327dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bba82857ca4c3f808c6860d7d2599c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:04.571245 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d686c426-9a30-443a-82ce-e7bcae540497 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] 10.222.0.46 "GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27" status: 200 len: 1284 microversion: 2.1 time: 0.224952 Oct 29 03:05:04.571835 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2050/3913] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:04 2022] GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27 => generated 1284 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:04.585575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9a828022-4ff4-4161-809c-c160f7ae1f6b tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:04.586669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9a828022-4ff4-4161-809c-c160f7ae1f6b tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:04.604800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9a828022-4ff4-4161-809c-c160f7ae1f6b tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:04.605390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9a828022-4ff4-4161-809c-c160f7ae1f6b tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:04.605902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9a828022-4ff4-4161-809c-c160f7ae1f6b tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:04.606653 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9a828022-4ff4-4161-809c-c160f7ae1f6b tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:04.607111 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9a828022-4ff4-4161-809c-c160f7ae1f6b tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:04.607584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9a828022-4ff4-4161-809c-c160f7ae1f6b tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:04.724562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9a828022-4ff4-4161-809c-c160f7ae1f6b tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:04.741682 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9a828022-4ff4-4161-809c-c160f7ae1f6b tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:04.743165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9a828022-4ff4-4161-809c-c160f7ae1f6b tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:04.744510 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9a828022-4ff4-4161-809c-c160f7ae1f6b tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1604 microversion: 2.32 time: 0.165656 Oct 29 03:05:04.745019 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2051/3914] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:04 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1604 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:04.756477 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3f3ff93c-b7e2-4d24-b885-fb8c23f40014 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:04.757132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3f3ff93c-b7e2-4d24-b885-fb8c23f40014 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:04.768300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f3ff93c-b7e2-4d24-b885-fb8c23f40014 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:04.769049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f3ff93c-b7e2-4d24-b885-fb8c23f40014 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:04.769632 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f3ff93c-b7e2-4d24-b885-fb8c23f40014 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:04.770509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f3ff93c-b7e2-4d24-b885-fb8c23f40014 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:04.771111 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f3ff93c-b7e2-4d24-b885-fb8c23f40014 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:04.771712 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f3ff93c-b7e2-4d24-b885-fb8c23f40014 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:04.924464 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3f3ff93c-b7e2-4d24-b885-fb8c23f40014 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:04.940276 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3f3ff93c-b7e2-4d24-b885-fb8c23f40014 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1477 microversion: 2.1 time: 0.192248 Oct 29 03:05:04.941624 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2052/3915] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:04 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1477 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:04.950438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-67990410-61c3-4867-b3bf-9ae0a570f7a5 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:04.951466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-67990410-61c3-4867-b3bf-9ae0a570f7a5 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] [instance: b955d0c2-5679-4b7f-9c9b-92671911b574] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:04.972488 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67990410-61c3-4867-b3bf-9ae0a570f7a5 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:04.973510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67990410-61c3-4867-b3bf-9ae0a570f7a5 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:04.974167 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67990410-61c3-4867-b3bf-9ae0a570f7a5 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:04.975614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67990410-61c3-4867-b3bf-9ae0a570f7a5 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:04.976309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67990410-61c3-4867-b3bf-9ae0a570f7a5 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:04.976993 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67990410-61c3-4867-b3bf-9ae0a570f7a5 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:04.999298 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-67990410-61c3-4867-b3bf-9ae0a570f7a5 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] HTTP exception thrown: Instance b955d0c2-5679-4b7f-9c9b-92671911b574 could not be found. Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-67990410-61c3-4867-b3bf-9ae0a570f7a5 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Request method failure captured: Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574 HTTP/1.1 Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJggKn2gDOZ3KM-3eI1ZNwQ5YLeRy2plwBQmATYp27tCsjeJvZ58MpSOL3C3Ht1Mt1S88dijMx07OrXuPTL4qTGzSusN-xeBwfV5bo-TqO7MeTwjutzXcaVTbuc5egMr70kT9BKMf-eUdQTYqYvkntc-csT2CH-547RoMOOEIIdCeyk Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 016dc7d91d1e4977ba712f7bed5218e3 Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-902952442 Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/016dc7d91d1e4977ba712f7bed5218e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/016dc7d91d1e4977ba712f7bed5218e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_016dc7d91d1e4977ba712f7bed5218e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/016dc7d91d1e4977ba712f7bed5218e3"}]}] Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-902952442 Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 016dc7d91d1e4977ba712f7bed5218e3 Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-902952442 Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersNegativeTestMultiTenantJSON-902952442-project Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 52009279acbd46919353742edb6cf2d8 Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-902952442-project Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance b955d0c2-5679-4b7f-9c9b-92671911b574 could not be found. Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'b955d0c2-5679-4b7f-9c9b-92671911b574'} Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b955d0c2-5679-4b7f-9c9b-92671911b574 could not be found. Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b955d0c2-5679-4b7f-9c9b-92671911b574 could not be found. Oct 29 03:05:05.001675 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:05.004724 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:05.004724 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:05.004724 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:05.004724 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:05.004724 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:05.004724 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:05.004724 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:05.004724 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b955d0c2-5679-4b7f-9c9b-92671911b574 could not be found. Oct 29 03:05:05.004724 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:05.004724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-67990410-61c3-4867-b3bf-9ae0a570f7a5 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] Returning 404 to user: Instance b955d0c2-5679-4b7f-9c9b-92671911b574 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:05.004724 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-67990410-61c3-4867-b3bf-9ae0a570f7a5 tempest-ServersNegativeTestMultiTenantJSON-902952442 tempest-ServersNegativeTestMultiTenantJSON-902952442-project] 10.222.0.46 "GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574" status: 404 len: 111 microversion: 2.1 time: 0.057853 Oct 29 03:05:05.004724 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2053/3916] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:04 2022] GET /compute/v2.1/servers/b955d0c2-5679-4b7f-9c9b-92671911b574 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:05:05.190125 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a5262a7a-78c2-4325-b139-a9d555be2788 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85efe9a35c8646ffadadc5a6bd9f0824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:05.203597 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a5262a7a-78c2-4325-b139-a9d555be2788 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2" status: 200 len: 1291 microversion: 2.1 time: 1.185478 Oct 29 03:05:05.204205 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1864/3917] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:04 2022] GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2 => generated 1291 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:05.260811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1a0efcba-f457-40a0-b8f4-05111f5ca3bf tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:05.261368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1a0efcba-f457-40a0-b8f4-05111f5ca3bf tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:05.271547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1a0efcba-f457-40a0-b8f4-05111f5ca3bf tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:05.273097 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1a0efcba-f457-40a0-b8f4-05111f5ca3bf tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:05.273885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1a0efcba-f457-40a0-b8f4-05111f5ca3bf tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:05.274791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1a0efcba-f457-40a0-b8f4-05111f5ca3bf tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:05.275507 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1a0efcba-f457-40a0-b8f4-05111f5ca3bf tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:05.276069 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1a0efcba-f457-40a0-b8f4-05111f5ca3bf tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:05.604493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a8477b6e-982b-445e-9de1-498573d5df6c tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:05.607009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a8477b6e-982b-445e-9de1-498573d5df6c tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] [instance: 5e78b6cd-1c9a-45f3-9e2c-791e01457a27] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:05.612362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1a0efcba-f457-40a0-b8f4-05111f5ca3bf tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:05.620889 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1a0efcba-f457-40a0-b8f4-05111f5ca3bf tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1506 microversion: 2.1 time: 0.365624 Oct 29 03:05:05.623960 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2054/3918] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:05 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1506 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:05.633555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8477b6e-982b-445e-9de1-498573d5df6c tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:05.639244 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8477b6e-982b-445e-9de1-498573d5df6c tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:05.641431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8477b6e-982b-445e-9de1-498573d5df6c tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:05.642225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8477b6e-982b-445e-9de1-498573d5df6c tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:05.642690 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8477b6e-982b-445e-9de1-498573d5df6c tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:05.643117 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8477b6e-982b-445e-9de1-498573d5df6c tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:05.771295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cf73b8c4-ab51-4272-92c5-9a53897625f2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:05.772105 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cf73b8c4-ab51-4272-92c5-9a53897625f2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:05.779308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf73b8c4-ab51-4272-92c5-9a53897625f2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:05.779772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a8477b6e-982b-445e-9de1-498573d5df6c tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891dec8f8be64fad8c8e967d8327dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bba82857ca4c3f808c6860d7d2599c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:05.779997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf73b8c4-ab51-4272-92c5-9a53897625f2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:05.780721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf73b8c4-ab51-4272-92c5-9a53897625f2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:05.781647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf73b8c4-ab51-4272-92c5-9a53897625f2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:05.782304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf73b8c4-ab51-4272-92c5-9a53897625f2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:05.782935 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf73b8c4-ab51-4272-92c5-9a53897625f2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:05.792936 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a8477b6e-982b-445e-9de1-498573d5df6c tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] 10.222.0.46 "GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27" status: 200 len: 1282 microversion: 2.1 time: 0.193686 Oct 29 03:05:05.804621 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1865/3919] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:05 2022] GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27 => generated 1282 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:05.883439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cf73b8c4-ab51-4272-92c5-9a53897625f2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:05.903072 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cf73b8c4-ab51-4272-92c5-9a53897625f2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:05.904821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cf73b8c4-ab51-4272-92c5-9a53897625f2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:05.906193 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cf73b8c4-ab51-4272-92c5-9a53897625f2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1604 microversion: 2.32 time: 0.138906 Oct 29 03:05:05.920577 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2055/3920] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:05 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1604 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:05.967080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e99a2040-7b5b-48cb-884b-3840a3bc4e89 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:05.968242 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e99a2040-7b5b-48cb-884b-3840a3bc4e89 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:05.979012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e99a2040-7b5b-48cb-884b-3840a3bc4e89 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:05.981417 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e99a2040-7b5b-48cb-884b-3840a3bc4e89 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:05.982022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e99a2040-7b5b-48cb-884b-3840a3bc4e89 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:05.985855 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e99a2040-7b5b-48cb-884b-3840a3bc4e89 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:05.986497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e99a2040-7b5b-48cb-884b-3840a3bc4e89 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:05.987073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e99a2040-7b5b-48cb-884b-3840a3bc4e89 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:06.232953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6bd95d05-dd05-4466-abf7-dc96ebdbdfee tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:06.234106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6bd95d05-dd05-4466-abf7-dc96ebdbdfee tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:06.248940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6bd95d05-dd05-4466-abf7-dc96ebdbdfee tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:06.249655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6bd95d05-dd05-4466-abf7-dc96ebdbdfee tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:06.251990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6bd95d05-dd05-4466-abf7-dc96ebdbdfee tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:06.253452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6bd95d05-dd05-4466-abf7-dc96ebdbdfee tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:06.259021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6bd95d05-dd05-4466-abf7-dc96ebdbdfee tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:06.259878 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6bd95d05-dd05-4466-abf7-dc96ebdbdfee tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:06.460896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e99a2040-7b5b-48cb-884b-3840a3bc4e89 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:06.472483 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e99a2040-7b5b-48cb-884b-3840a3bc4e89 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1477 microversion: 2.1 time: 0.507584 Oct 29 03:05:06.485854 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1866/3921] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:05 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1477 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:06.649871 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-79e8ac5b-540c-46df-a08f-d467add610bb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:06.650496 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-79e8ac5b-540c-46df-a08f-d467add610bb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:06.664034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-79e8ac5b-540c-46df-a08f-d467add610bb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:06.664552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-79e8ac5b-540c-46df-a08f-d467add610bb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:06.664997 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-79e8ac5b-540c-46df-a08f-d467add610bb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:06.665734 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-79e8ac5b-540c-46df-a08f-d467add610bb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:06.666182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-79e8ac5b-540c-46df-a08f-d467add610bb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:06.666604 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-79e8ac5b-540c-46df-a08f-d467add610bb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:07.072464 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6bd95d05-dd05-4466-abf7-dc96ebdbdfee tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85efe9a35c8646ffadadc5a6bd9f0824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:07.090094 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6bd95d05-dd05-4466-abf7-dc96ebdbdfee tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2" status: 200 len: 1291 microversion: 2.1 time: 0.862172 Oct 29 03:05:07.091327 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2056/3922] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:06 2022] GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2 => generated 1291 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:05:07.146943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-822c0289-1950-42ec-81fe-bd1cb9fa9cba tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:07.153331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-822c0289-1950-42ec-81fe-bd1cb9fa9cba tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] [instance: 5e78b6cd-1c9a-45f3-9e2c-791e01457a27] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:07.170657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-822c0289-1950-42ec-81fe-bd1cb9fa9cba tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:07.171873 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-822c0289-1950-42ec-81fe-bd1cb9fa9cba tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:07.172782 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-822c0289-1950-42ec-81fe-bd1cb9fa9cba tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:07.173803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-822c0289-1950-42ec-81fe-bd1cb9fa9cba tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:07.174678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-822c0289-1950-42ec-81fe-bd1cb9fa9cba tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:07.175313 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-822c0289-1950-42ec-81fe-bd1cb9fa9cba tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:07.335722 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-79e8ac5b-540c-46df-a08f-d467add610bb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:07.348715 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-79e8ac5b-540c-46df-a08f-d467add610bb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1506 microversion: 2.1 time: 0.703110 Oct 29 03:05:07.349323 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1867/3923] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:06 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1506 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:05:07.360169 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-306bd2bf-eda6-4e79-b070-cb5faaab92ce tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:07.360826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-306bd2bf-eda6-4e79-b070-cb5faaab92ce tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:07.382804 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-306bd2bf-eda6-4e79-b070-cb5faaab92ce tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:07.384193 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-306bd2bf-eda6-4e79-b070-cb5faaab92ce tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:07.386057 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-306bd2bf-eda6-4e79-b070-cb5faaab92ce tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:07.387080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-306bd2bf-eda6-4e79-b070-cb5faaab92ce tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:07.387744 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-306bd2bf-eda6-4e79-b070-cb5faaab92ce tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:07.388433 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-306bd2bf-eda6-4e79-b070-cb5faaab92ce tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:07.471469 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-822c0289-1950-42ec-81fe-bd1cb9fa9cba tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891dec8f8be64fad8c8e967d8327dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bba82857ca4c3f808c6860d7d2599c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:07.502194 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-822c0289-1950-42ec-81fe-bd1cb9fa9cba tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] 10.222.0.46 "GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27" status: 200 len: 1282 microversion: 2.1 time: 0.408411 Oct 29 03:05:07.503687 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2057/3924] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:07 2022] GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27 => generated 1282 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:07.520223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dc66f796-f216-402d-bd08-a50e786f7a70 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:07.521362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dc66f796-f216-402d-bd08-a50e786f7a70 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:07.531991 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-306bd2bf-eda6-4e79-b070-cb5faaab92ce tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:07.548742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-306bd2bf-eda6-4e79-b070-cb5faaab92ce tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:07.550192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-306bd2bf-eda6-4e79-b070-cb5faaab92ce tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:07.551415 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-306bd2bf-eda6-4e79-b070-cb5faaab92ce tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1604 microversion: 2.32 time: 0.200067 Oct 29 03:05:07.555086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc66f796-f216-402d-bd08-a50e786f7a70 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:07.557256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc66f796-f216-402d-bd08-a50e786f7a70 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:07.560407 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1868/3925] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:07 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1604 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:07.561331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc66f796-f216-402d-bd08-a50e786f7a70 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:07.568466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc66f796-f216-402d-bd08-a50e786f7a70 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:07.570607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc66f796-f216-402d-bd08-a50e786f7a70 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:07.571411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc66f796-f216-402d-bd08-a50e786f7a70 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:08.118392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a1c5a136-f4eb-4feb-ba58-d4956856f32a tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:08.119375 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a1c5a136-f4eb-4feb-ba58-d4956856f32a tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:08.133594 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1c5a136-f4eb-4feb-ba58-d4956856f32a tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:08.134083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1c5a136-f4eb-4feb-ba58-d4956856f32a tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:08.134515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1c5a136-f4eb-4feb-ba58-d4956856f32a tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:08.135234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1c5a136-f4eb-4feb-ba58-d4956856f32a tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:08.135691 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1c5a136-f4eb-4feb-ba58-d4956856f32a tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:08.136113 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1c5a136-f4eb-4feb-ba58-d4956856f32a tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:08.316258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dc66f796-f216-402d-bd08-a50e786f7a70 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:08.333595 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dc66f796-f216-402d-bd08-a50e786f7a70 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1477 microversion: 2.1 time: 0.825969 Oct 29 03:05:08.334883 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2058/3926] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:07 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1477 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:08.383947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8571d595-d369-44c4-a124-3b37b83fc5e0 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:08.385218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8571d595-d369-44c4-a124-3b37b83fc5e0 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:08.396893 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8571d595-d369-44c4-a124-3b37b83fc5e0 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:08.401629 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8571d595-d369-44c4-a124-3b37b83fc5e0 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:08.402267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8571d595-d369-44c4-a124-3b37b83fc5e0 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:08.403156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8571d595-d369-44c4-a124-3b37b83fc5e0 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:08.404005 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8571d595-d369-44c4-a124-3b37b83fc5e0 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:08.408181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8571d595-d369-44c4-a124-3b37b83fc5e0 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:09.044908 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8571d595-d369-44c4-a124-3b37b83fc5e0 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:09.057085 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8571d595-d369-44c4-a124-3b37b83fc5e0 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1486 microversion: 2.1 time: 0.674025 Oct 29 03:05:09.058169 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2059/3927] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:08 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1486 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:09.063212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d8ba8e89-a9f8-49c6-85ad-2693a9e7bfd6 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:09.063837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d8ba8e89-a9f8-49c6-85ad-2693a9e7bfd6 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] [instance: 5e78b6cd-1c9a-45f3-9e2c-791e01457a27] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:09.081879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8ba8e89-a9f8-49c6-85ad-2693a9e7bfd6 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:09.082387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8ba8e89-a9f8-49c6-85ad-2693a9e7bfd6 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:09.082878 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8ba8e89-a9f8-49c6-85ad-2693a9e7bfd6 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:09.083762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8ba8e89-a9f8-49c6-85ad-2693a9e7bfd6 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:09.084638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8ba8e89-a9f8-49c6-85ad-2693a9e7bfd6 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:09.085439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8ba8e89-a9f8-49c6-85ad-2693a9e7bfd6 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:09.153824 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a1c5a136-f4eb-4feb-ba58-d4956856f32a tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85efe9a35c8646ffadadc5a6bd9f0824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:09.167963 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a1c5a136-f4eb-4feb-ba58-d4956856f32a tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2" status: 200 len: 1291 microversion: 2.1 time: 1.050352 Oct 29 03:05:09.168709 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1869/3928] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:08 2022] GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2 => generated 1291 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:05:09.182017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-07e86e35-ea54-434a-af61-1d6eaab91870 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:09.183066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-07e86e35-ea54-434a-af61-1d6eaab91870 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:09.190352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07e86e35-ea54-434a-af61-1d6eaab91870 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:09.191026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07e86e35-ea54-434a-af61-1d6eaab91870 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:09.191523 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07e86e35-ea54-434a-af61-1d6eaab91870 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:09.192375 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07e86e35-ea54-434a-af61-1d6eaab91870 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:09.192764 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07e86e35-ea54-434a-af61-1d6eaab91870 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:09.193188 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07e86e35-ea54-434a-af61-1d6eaab91870 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:09.329534 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-07e86e35-ea54-434a-af61-1d6eaab91870 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:09.347267 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-07e86e35-ea54-434a-af61-1d6eaab91870 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:09.349854 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-07e86e35-ea54-434a-af61-1d6eaab91870 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:09.352979 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-07e86e35-ea54-434a-af61-1d6eaab91870 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1604 microversion: 2.32 time: 0.175249 Oct 29 03:05:09.353733 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1870/3929] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:09 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1604 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:09.374829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-96bdfb8f-5d87-43bd-9119-0bea69be57fb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:09.376908 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-96bdfb8f-5d87-43bd-9119-0bea69be57fb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:09.397531 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96bdfb8f-5d87-43bd-9119-0bea69be57fb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:09.398255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96bdfb8f-5d87-43bd-9119-0bea69be57fb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:09.401909 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96bdfb8f-5d87-43bd-9119-0bea69be57fb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:09.402966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96bdfb8f-5d87-43bd-9119-0bea69be57fb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:09.403584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96bdfb8f-5d87-43bd-9119-0bea69be57fb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:09.405060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96bdfb8f-5d87-43bd-9119-0bea69be57fb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:09.524117 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-96bdfb8f-5d87-43bd-9119-0bea69be57fb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "POST /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e/action" status: 202 len: 0 microversion: 2.1 time: 0.168886 Oct 29 03:05:09.524897 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1871/3930] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:05:09 2022] POST /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:05:09.530473 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a026b256-5f28-405c-b80f-e6ae3a790e10 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:09.537665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a026b256-5f28-405c-b80f-e6ae3a790e10 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:09.553357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a026b256-5f28-405c-b80f-e6ae3a790e10 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:09.553934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a026b256-5f28-405c-b80f-e6ae3a790e10 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:09.554505 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a026b256-5f28-405c-b80f-e6ae3a790e10 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:09.557902 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a026b256-5f28-405c-b80f-e6ae3a790e10 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:09.558391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a026b256-5f28-405c-b80f-e6ae3a790e10 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:09.558826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a026b256-5f28-405c-b80f-e6ae3a790e10 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:09.621896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d8ba8e89-a9f8-49c6-85ad-2693a9e7bfd6 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891dec8f8be64fad8c8e967d8327dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bba82857ca4c3f808c6860d7d2599c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:09.635613 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d8ba8e89-a9f8-49c6-85ad-2693a9e7bfd6 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] 10.222.0.46 "GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27" status: 200 len: 1324 microversion: 2.1 time: 0.576205 Oct 29 03:05:09.640767 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2060/3931] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:09 2022] GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27 => generated 1324 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:09.650026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5ea2f405-ea75-492d-a68a-8d5cb25f1009 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:09.659384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5ea2f405-ea75-492d-a68a-8d5cb25f1009 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:09.666750 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ea2f405-ea75-492d-a68a-8d5cb25f1009 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:09.667491 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ea2f405-ea75-492d-a68a-8d5cb25f1009 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:09.668046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ea2f405-ea75-492d-a68a-8d5cb25f1009 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:09.668938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ea2f405-ea75-492d-a68a-8d5cb25f1009 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:09.669505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ea2f405-ea75-492d-a68a-8d5cb25f1009 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:09.670098 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ea2f405-ea75-492d-a68a-8d5cb25f1009 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:10.111558 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a026b256-5f28-405c-b80f-e6ae3a790e10 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:10.127904 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a026b256-5f28-405c-b80f-e6ae3a790e10 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1477 microversion: 2.1 time: 0.601713 Oct 29 03:05:10.129181 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1872/3932] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:09 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1477 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:10.154641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5ea2f405-ea75-492d-a68a-8d5cb25f1009 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:10.170479 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5ea2f405-ea75-492d-a68a-8d5cb25f1009 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1494 microversion: 2.1 time: 0.526425 Oct 29 03:05:10.171799 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2061/3933] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:09 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1494 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:10.197715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d26244d8-307e-45bc-a0b9-0fe3316a5913 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:10.199032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d26244d8-307e-45bc-a0b9-0fe3316a5913 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:10.213557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d26244d8-307e-45bc-a0b9-0fe3316a5913 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:10.223110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d26244d8-307e-45bc-a0b9-0fe3316a5913 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:10.223907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d26244d8-307e-45bc-a0b9-0fe3316a5913 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:10.225472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d26244d8-307e-45bc-a0b9-0fe3316a5913 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:10.226158 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d26244d8-307e-45bc-a0b9-0fe3316a5913 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:10.226850 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d26244d8-307e-45bc-a0b9-0fe3316a5913 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:10.401768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cf1909cc-c525-438a-ad9c-21e51b4c3119 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:10.403871 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cf1909cc-c525-438a-ad9c-21e51b4c3119 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:10.421794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf1909cc-c525-438a-ad9c-21e51b4c3119 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:10.422683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf1909cc-c525-438a-ad9c-21e51b4c3119 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:10.423710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf1909cc-c525-438a-ad9c-21e51b4c3119 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:10.424857 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf1909cc-c525-438a-ad9c-21e51b4c3119 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:10.425793 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf1909cc-c525-438a-ad9c-21e51b4c3119 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:10.426379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf1909cc-c525-438a-ad9c-21e51b4c3119 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:10.561654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cf1909cc-c525-438a-ad9c-21e51b4c3119 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:10.594724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cf1909cc-c525-438a-ad9c-21e51b4c3119 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:10.598313 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cf1909cc-c525-438a-ad9c-21e51b4c3119 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:10.606931 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cf1909cc-c525-438a-ad9c-21e51b4c3119 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1604 microversion: 2.32 time: 0.209080 Oct 29 03:05:10.609328 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2062/3934] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:10 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1604 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:10.663392 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-91a7b0c5-c66b-49f0-8182-20009135bce7 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:10.664023 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-91a7b0c5-c66b-49f0-8182-20009135bce7 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] [instance: 5e78b6cd-1c9a-45f3-9e2c-791e01457a27] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:10.679416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91a7b0c5-c66b-49f0-8182-20009135bce7 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:10.679416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91a7b0c5-c66b-49f0-8182-20009135bce7 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:10.680465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91a7b0c5-c66b-49f0-8182-20009135bce7 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:10.680711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91a7b0c5-c66b-49f0-8182-20009135bce7 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:10.681076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91a7b0c5-c66b-49f0-8182-20009135bce7 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:10.681724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91a7b0c5-c66b-49f0-8182-20009135bce7 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:10.713753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d26244d8-307e-45bc-a0b9-0fe3316a5913 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85efe9a35c8646ffadadc5a6bd9f0824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:10.723153 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d26244d8-307e-45bc-a0b9-0fe3316a5913 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2" status: 200 len: 1291 microversion: 2.1 time: 0.531516 Oct 29 03:05:10.729542 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1873/3935] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:10 2022] GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2 => generated 1291 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:10.829374 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-b96ad479-aac4-4291-a914-6e6a6a89a6b9 req-6f4e0715-9c72-40c5-91f6-b4f52c72709c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fa383d1-1572-4975-9de9-22286e5458a2", "name": "network-vif-plugged", "status": "completed", "tag": "2235e54c-806d-494b-b955-e92306257303"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:10.849075 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b96ad479-aac4-4291-a914-6e6a6a89a6b9 req-6f4e0715-9c72-40c5-91f6-b4f52c72709c service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:10.849901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b96ad479-aac4-4291-a914-6e6a6a89a6b9 req-6f4e0715-9c72-40c5-91f6-b4f52c72709c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:10.850535 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b96ad479-aac4-4291-a914-6e6a6a89a6b9 req-6f4e0715-9c72-40c5-91f6-b4f52c72709c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:10.914116 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-b96ad479-aac4-4291-a914-6e6a6a89a6b9 req-6f4e0715-9c72-40c5-91f6-b4f52c72709c service nova] Creating event network-vif-plugged:2235e54c-806d-494b-b955-e92306257303 for instance 6fa383d1-1572-4975-9de9-22286e5458a2 on n-h1-862967-2 Oct 29 03:05:10.931883 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-b96ad479-aac4-4291-a914-6e6a6a89a6b9 req-6f4e0715-9c72-40c5-91f6-b4f52c72709c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106280 Oct 29 03:05:10.933224 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1874/3936] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:05:11.104329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-91a7b0c5-c66b-49f0-8182-20009135bce7 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891dec8f8be64fad8c8e967d8327dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bba82857ca4c3f808c6860d7d2599c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:11.117233 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-91a7b0c5-c66b-49f0-8182-20009135bce7 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] 10.222.0.46 "GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27" status: 200 len: 1324 microversion: 2.1 time: 0.457736 Oct 29 03:05:11.118240 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2063/3937] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:10 2022] GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27 => generated 1324 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:05:11.160308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-676fbb04-ee57-458a-b482-7ae86505a7a4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:11.162069 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-676fbb04-ee57-458a-b482-7ae86505a7a4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:11.180172 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-676fbb04-ee57-458a-b482-7ae86505a7a4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:11.189490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-676fbb04-ee57-458a-b482-7ae86505a7a4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:11.190278 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-676fbb04-ee57-458a-b482-7ae86505a7a4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:11.191195 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-676fbb04-ee57-458a-b482-7ae86505a7a4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:11.191843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-676fbb04-ee57-458a-b482-7ae86505a7a4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:11.198022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bc2b04e8-dbd9-4a4c-8f14-1ea6a29c9b25 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:11.198865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bc2b04e8-dbd9-4a4c-8f14-1ea6a29c9b25 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:11.213939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-676fbb04-ee57-458a-b482-7ae86505a7a4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:11.223082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc2b04e8-dbd9-4a4c-8f14-1ea6a29c9b25 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:11.224817 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc2b04e8-dbd9-4a4c-8f14-1ea6a29c9b25 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:11.227885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc2b04e8-dbd9-4a4c-8f14-1ea6a29c9b25 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:11.234492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc2b04e8-dbd9-4a4c-8f14-1ea6a29c9b25 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:11.235447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc2b04e8-dbd9-4a4c-8f14-1ea6a29c9b25 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:11.239398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc2b04e8-dbd9-4a4c-8f14-1ea6a29c9b25 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:11.265451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=100 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:11.505288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bc2b04e8-dbd9-4a4c-8f14-1ea6a29c9b25 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:11.517521 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bc2b04e8-dbd9-4a4c-8f14-1ea6a29c9b25 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1494 microversion: 2.1 time: 0.323734 Oct 29 03:05:11.538276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:11.540600 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2064/3938] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:11 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1494 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:11.617311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:11.639764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4dfdef0e-be9b-45e6-aa81-17eec3bf2f7c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:11.640615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4dfdef0e-be9b-45e6-aa81-17eec3bf2f7c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:11.647706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4dfdef0e-be9b-45e6-aa81-17eec3bf2f7c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:11.648543 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4dfdef0e-be9b-45e6-aa81-17eec3bf2f7c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:11.649089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4dfdef0e-be9b-45e6-aa81-17eec3bf2f7c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:11.649939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4dfdef0e-be9b-45e6-aa81-17eec3bf2f7c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:11.650579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4dfdef0e-be9b-45e6-aa81-17eec3bf2f7c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:11.651331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4dfdef0e-be9b-45e6-aa81-17eec3bf2f7c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:11.732516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4dfdef0e-be9b-45e6-aa81-17eec3bf2f7c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:11.744515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4dfdef0e-be9b-45e6-aa81-17eec3bf2f7c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:11.746073 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4dfdef0e-be9b-45e6-aa81-17eec3bf2f7c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:11.747733 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4dfdef0e-be9b-45e6-aa81-17eec3bf2f7c tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1604 microversion: 2.32 time: 0.112484 Oct 29 03:05:11.748309 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2065/3939] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:11 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1604 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:11.752367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-676fbb04-ee57-458a-b482-7ae86505a7a4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:11.755693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-95c28f02-5485-489f-9ebe-82fc9be2220d tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:11.755976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-95c28f02-5485-489f-9ebe-82fc9be2220d tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:11.763587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95c28f02-5485-489f-9ebe-82fc9be2220d tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:11.764181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95c28f02-5485-489f-9ebe-82fc9be2220d tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:11.764746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95c28f02-5485-489f-9ebe-82fc9be2220d tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:11.765434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95c28f02-5485-489f-9ebe-82fc9be2220d tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:11.765894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95c28f02-5485-489f-9ebe-82fc9be2220d tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:11.766353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95c28f02-5485-489f-9ebe-82fc9be2220d tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:11.778958 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-676fbb04-ee57-458a-b482-7ae86505a7a4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1477 microversion: 2.1 time: 0.622883 Oct 29 03:05:11.779914 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1875/3940] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:11 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1477 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:12.001299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-f0dc80e2-bb0f-4fd7-9bc9-30176c16f194 req-34b44999-e227-4eb9-9082-541c2f78a0d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e78b6cd-1c9a-45f3-9e2c-791e01457a27", "tag": "c219da66-3863-41dd-a717-6128649f484b"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:12.017758 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f0dc80e2-bb0f-4fd7-9bc9-30176c16f194 req-34b44999-e227-4eb9-9082-541c2f78a0d0 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:12.018400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f0dc80e2-bb0f-4fd7-9bc9-30176c16f194 req-34b44999-e227-4eb9-9082-541c2f78a0d0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:12.019077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f0dc80e2-bb0f-4fd7-9bc9-30176c16f194 req-34b44999-e227-4eb9-9082-541c2f78a0d0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:12.033283 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-f0dc80e2-bb0f-4fd7-9bc9-30176c16f194 req-34b44999-e227-4eb9-9082-541c2f78a0d0 service nova] Creating event network-changed:c219da66-3863-41dd-a717-6128649f484b for instance 5e78b6cd-1c9a-45f3-9e2c-791e01457a27 on n-h2-862967-2 Oct 29 03:05:12.038941 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-f0dc80e2-bb0f-4fd7-9bc9-30176c16f194 req-34b44999-e227-4eb9-9082-541c2f78a0d0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042583 Oct 29 03:05:12.040186 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1876/3941] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:05:12.140656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-06e37dab-bd41-4993-a401-5596bca2e52d tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:12.141702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-06e37dab-bd41-4993-a401-5596bca2e52d tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] [instance: 5e78b6cd-1c9a-45f3-9e2c-791e01457a27] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:12.156128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06e37dab-bd41-4993-a401-5596bca2e52d tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:12.160948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06e37dab-bd41-4993-a401-5596bca2e52d tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:12.161698 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06e37dab-bd41-4993-a401-5596bca2e52d tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:12.163470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06e37dab-bd41-4993-a401-5596bca2e52d tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:12.166601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06e37dab-bd41-4993-a401-5596bca2e52d tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:12.167714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06e37dab-bd41-4993-a401-5596bca2e52d tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:12.294108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-95c28f02-5485-489f-9ebe-82fc9be2220d tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85efe9a35c8646ffadadc5a6bd9f0824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:12.304222 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-95c28f02-5485-489f-9ebe-82fc9be2220d tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2" status: 200 len: 1291 microversion: 2.1 time: 0.553523 Oct 29 03:05:12.305152 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2066/3942] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:11 2022] GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2 => generated 1291 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:12.547500 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3fc31828-d6b6-4ada-bda0-c9f2dc9db7aa tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:12.548430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3fc31828-d6b6-4ada-bda0-c9f2dc9db7aa tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:12.563062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3fc31828-d6b6-4ada-bda0-c9f2dc9db7aa tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:12.564125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3fc31828-d6b6-4ada-bda0-c9f2dc9db7aa tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:12.578433 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3fc31828-d6b6-4ada-bda0-c9f2dc9db7aa tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:12.584469 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3fc31828-d6b6-4ada-bda0-c9f2dc9db7aa tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:12.585113 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3fc31828-d6b6-4ada-bda0-c9f2dc9db7aa tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:12.585574 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3fc31828-d6b6-4ada-bda0-c9f2dc9db7aa tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:12.695749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-06e37dab-bd41-4993-a401-5596bca2e52d tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891dec8f8be64fad8c8e967d8327dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bba82857ca4c3f808c6860d7d2599c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:12.707265 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-06e37dab-bd41-4993-a401-5596bca2e52d tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] 10.222.0.46 "GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27" status: 200 len: 1324 microversion: 2.1 time: 0.568418 Oct 29 03:05:12.708418 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1877/3943] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:12 2022] GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27 => generated 1324 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:12.775614 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-29db2b2c-a4d0-4a6d-8aaa-83f380a9ca49 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:12.776615 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-29db2b2c-a4d0-4a6d-8aaa-83f380a9ca49 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:12.783965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29db2b2c-a4d0-4a6d-8aaa-83f380a9ca49 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:12.788568 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29db2b2c-a4d0-4a6d-8aaa-83f380a9ca49 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:12.789110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29db2b2c-a4d0-4a6d-8aaa-83f380a9ca49 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:12.795323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29db2b2c-a4d0-4a6d-8aaa-83f380a9ca49 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:12.796053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29db2b2c-a4d0-4a6d-8aaa-83f380a9ca49 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:12.796718 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29db2b2c-a4d0-4a6d-8aaa-83f380a9ca49 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:12.836580 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:12.890718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3fc31828-d6b6-4ada-bda0-c9f2dc9db7aa tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:12.901770 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3fc31828-d6b6-4ada-bda0-c9f2dc9db7aa tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1494 microversion: 2.1 time: 0.360094 Oct 29 03:05:12.902377 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2067/3944] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:12 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1494 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:12.909098 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6f7290a1-b4cb-49c8-ac86-bcb902843f3f tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:12.909945 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6f7290a1-b4cb-49c8-ac86-bcb902843f3f tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:12.912400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-29db2b2c-a4d0-4a6d-8aaa-83f380a9ca49 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:12.919451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f7290a1-b4cb-49c8-ac86-bcb902843f3f tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:12.922415 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f7290a1-b4cb-49c8-ac86-bcb902843f3f tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:12.924151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f7290a1-b4cb-49c8-ac86-bcb902843f3f tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:12.924151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f7290a1-b4cb-49c8-ac86-bcb902843f3f tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:12.925762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f7290a1-b4cb-49c8-ac86-bcb902843f3f tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:12.925762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f7290a1-b4cb-49c8-ac86-bcb902843f3f tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:12.935456 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-29db2b2c-a4d0-4a6d-8aaa-83f380a9ca49 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:12.937030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-29db2b2c-a4d0-4a6d-8aaa-83f380a9ca49 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:12.938245 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-29db2b2c-a4d0-4a6d-8aaa-83f380a9ca49 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1604 microversion: 2.32 time: 0.166884 Oct 29 03:05:12.948630 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1878/3945] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:12 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1604 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:13.081769 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6f7290a1-b4cb-49c8-ac86-bcb902843f3f tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:13.091101 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6f7290a1-b4cb-49c8-ac86-bcb902843f3f tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1477 microversion: 2.1 time: 0.187451 Oct 29 03:05:13.091923 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2068/3946] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:12 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1477 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:13.327398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c733ab8a-bf36-4b50-ab92-3fe6c8b183a2 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:13.328249 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c733ab8a-bf36-4b50-ab92-3fe6c8b183a2 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:13.335635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c733ab8a-bf36-4b50-ab92-3fe6c8b183a2 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:13.336121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c733ab8a-bf36-4b50-ab92-3fe6c8b183a2 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:13.336641 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c733ab8a-bf36-4b50-ab92-3fe6c8b183a2 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:13.337342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c733ab8a-bf36-4b50-ab92-3fe6c8b183a2 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:13.337816 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c733ab8a-bf36-4b50-ab92-3fe6c8b183a2 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:13.338367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c733ab8a-bf36-4b50-ab92-3fe6c8b183a2 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:13.695398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c733ab8a-bf36-4b50-ab92-3fe6c8b183a2 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85efe9a35c8646ffadadc5a6bd9f0824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:13.703646 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c733ab8a-bf36-4b50-ab92-3fe6c8b183a2 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2" status: 200 len: 1482 microversion: 2.1 time: 0.380365 Oct 29 03:05:13.705311 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1879/3947] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:13 2022] GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2 => generated 1482 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:13.729302 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e6ab4ed8-315d-4a0d-99cb-54e7fdf9b04f tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:13.730482 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e6ab4ed8-315d-4a0d-99cb-54e7fdf9b04f tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:13.733165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e3c4ceaa-75b5-4d7a-9c12-1cce893989e8 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:13.733858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e3c4ceaa-75b5-4d7a-9c12-1cce893989e8 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] [instance: 5e78b6cd-1c9a-45f3-9e2c-791e01457a27] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:13.738727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6ab4ed8-315d-4a0d-99cb-54e7fdf9b04f tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:13.739227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6ab4ed8-315d-4a0d-99cb-54e7fdf9b04f tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:13.739670 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6ab4ed8-315d-4a0d-99cb-54e7fdf9b04f tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:13.740393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6ab4ed8-315d-4a0d-99cb-54e7fdf9b04f tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:13.740879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6ab4ed8-315d-4a0d-99cb-54e7fdf9b04f tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:13.741308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6ab4ed8-315d-4a0d-99cb-54e7fdf9b04f tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:13.741761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3c4ceaa-75b5-4d7a-9c12-1cce893989e8 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:13.742354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3c4ceaa-75b5-4d7a-9c12-1cce893989e8 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:13.742838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3c4ceaa-75b5-4d7a-9c12-1cce893989e8 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:13.743846 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3c4ceaa-75b5-4d7a-9c12-1cce893989e8 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:13.744503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3c4ceaa-75b5-4d7a-9c12-1cce893989e8 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:13.745127 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3c4ceaa-75b5-4d7a-9c12-1cce893989e8 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:13.885993 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e6ab4ed8-315d-4a0d-99cb-54e7fdf9b04f tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.162464 Oct 29 03:05:13.887064 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2069/3948] 10.222.0.46 () {58 vars in 1275 bytes} [Sat Oct 29 03:05:13 2022] GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2/os-interface => generated 284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:13.943887 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-72e9890e-e7e9-463d-9790-860f7c3d9cd4 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:13.949827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-72e9890e-e7e9-463d-9790-860f7c3d9cd4 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:13.972192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72e9890e-e7e9-463d-9790-860f7c3d9cd4 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:13.972721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72e9890e-e7e9-463d-9790-860f7c3d9cd4 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:13.974552 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72e9890e-e7e9-463d-9790-860f7c3d9cd4 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:13.976650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72e9890e-e7e9-463d-9790-860f7c3d9cd4 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:13.979687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72e9890e-e7e9-463d-9790-860f7c3d9cd4 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:13.982078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72e9890e-e7e9-463d-9790-860f7c3d9cd4 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:14.296608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-72e9890e-e7e9-463d-9790-860f7c3d9cd4 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:14.309794 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-72e9890e-e7e9-463d-9790-860f7c3d9cd4 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1500 microversion: 2.1 time: 0.378165 Oct 29 03:05:14.349185 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2070/3949] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:13 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1500 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:14.363187 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5a5c57af-c1e1-45bf-8245-dfe82846e80f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:14.366711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5a5c57af-c1e1-45bf-8245-dfe82846e80f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:14.388425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a5c57af-c1e1-45bf-8245-dfe82846e80f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:14.389345 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a5c57af-c1e1-45bf-8245-dfe82846e80f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:14.391000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a5c57af-c1e1-45bf-8245-dfe82846e80f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:14.397400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a5c57af-c1e1-45bf-8245-dfe82846e80f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:14.398311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a5c57af-c1e1-45bf-8245-dfe82846e80f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:14.398999 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a5c57af-c1e1-45bf-8245-dfe82846e80f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:14.429684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e3c4ceaa-75b5-4d7a-9c12-1cce893989e8 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891dec8f8be64fad8c8e967d8327dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bba82857ca4c3f808c6860d7d2599c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:14.444911 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e3c4ceaa-75b5-4d7a-9c12-1cce893989e8 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] 10.222.0.46 "GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27" status: 200 len: 1324 microversion: 2.1 time: 0.718529 Oct 29 03:05:14.454628 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1880/3950] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:13 2022] GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27 => generated 1324 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:05:14.470731 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c2b940e5-35fe-4568-83ab-2f49cf5df82d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:14.478259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c2b940e5-35fe-4568-83ab-2f49cf5df82d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:14.495725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2b940e5-35fe-4568-83ab-2f49cf5df82d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:14.496989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2b940e5-35fe-4568-83ab-2f49cf5df82d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:14.498114 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2b940e5-35fe-4568-83ab-2f49cf5df82d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:14.499404 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2b940e5-35fe-4568-83ab-2f49cf5df82d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:14.501175 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2b940e5-35fe-4568-83ab-2f49cf5df82d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:14.501870 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2b940e5-35fe-4568-83ab-2f49cf5df82d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:14.661678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5a5c57af-c1e1-45bf-8245-dfe82846e80f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:14.688356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5a5c57af-c1e1-45bf-8245-dfe82846e80f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:14.692611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5a5c57af-c1e1-45bf-8245-dfe82846e80f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:14.694323 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5a5c57af-c1e1-45bf-8245-dfe82846e80f tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1604 microversion: 2.32 time: 0.343880 Oct 29 03:05:14.696073 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2071/3951] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:14 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1604 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:14.704038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9c431553-cd18-48a8-8b75-4f51420768e2 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:14.705535 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9c431553-cd18-48a8-8b75-4f51420768e2 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:14.712327 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c431553-cd18-48a8-8b75-4f51420768e2 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:14.713515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c431553-cd18-48a8-8b75-4f51420768e2 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:14.714219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c431553-cd18-48a8-8b75-4f51420768e2 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:14.715166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c431553-cd18-48a8-8b75-4f51420768e2 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:14.716779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c431553-cd18-48a8-8b75-4f51420768e2 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:14.717561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c431553-cd18-48a8-8b75-4f51420768e2 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:14.751367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9c431553-cd18-48a8-8b75-4f51420768e2 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:05:14.865674 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9c431553-cd18-48a8-8b75-4f51420768e2 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "DELETE /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 204 len: 0 microversion: 2.1 time: 0.167574 Oct 29 03:05:14.866620 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2072/3952] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:05:14 2022] DELETE /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:05:14.876349 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-818c23b8-bfce-4df9-a0b4-a47aa14df738 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:14.877109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-818c23b8-bfce-4df9-a0b4-a47aa14df738 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:14.885050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-818c23b8-bfce-4df9-a0b4-a47aa14df738 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:14.885555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-818c23b8-bfce-4df9-a0b4-a47aa14df738 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:14.886004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-818c23b8-bfce-4df9-a0b4-a47aa14df738 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:14.886780 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-818c23b8-bfce-4df9-a0b4-a47aa14df738 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:14.887262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-818c23b8-bfce-4df9-a0b4-a47aa14df738 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:14.887736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-818c23b8-bfce-4df9-a0b4-a47aa14df738 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:14.933846 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c2b940e5-35fe-4568-83ab-2f49cf5df82d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:14.947575 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c2b940e5-35fe-4568-83ab-2f49cf5df82d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1477 microversion: 2.1 time: 0.491047 Oct 29 03:05:14.948930 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1881/3953] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:14 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1477 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:15.364066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-818c23b8-bfce-4df9-a0b4-a47aa14df738 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:15.369525 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-818c23b8-bfce-4df9-a0b4-a47aa14df738 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1506 microversion: 2.1 time: 0.498004 Oct 29 03:05:15.376495 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2073/3954] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:14 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1506 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:15.477018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9be17455-aac3-4815-b1d0-27c1d6477913 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:15.477962 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9be17455-aac3-4815-b1d0-27c1d6477913 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] [instance: 5e78b6cd-1c9a-45f3-9e2c-791e01457a27] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:15.493162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9be17455-aac3-4815-b1d0-27c1d6477913 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:15.493763 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9be17455-aac3-4815-b1d0-27c1d6477913 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:15.494277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9be17455-aac3-4815-b1d0-27c1d6477913 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:15.495965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9be17455-aac3-4815-b1d0-27c1d6477913 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:15.499435 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9be17455-aac3-4815-b1d0-27c1d6477913 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:15.499992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9be17455-aac3-4815-b1d0-27c1d6477913 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:15.723519 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-00b4a977-cc75-4ed4-a7d8-42a88ede49e7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:15.724136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-00b4a977-cc75-4ed4-a7d8-42a88ede49e7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:15.731137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00b4a977-cc75-4ed4-a7d8-42a88ede49e7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:15.731904 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00b4a977-cc75-4ed4-a7d8-42a88ede49e7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:15.733026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00b4a977-cc75-4ed4-a7d8-42a88ede49e7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:15.733930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00b4a977-cc75-4ed4-a7d8-42a88ede49e7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:15.738589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00b4a977-cc75-4ed4-a7d8-42a88ede49e7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:15.739243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00b4a977-cc75-4ed4-a7d8-42a88ede49e7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:15.806618 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9be17455-aac3-4815-b1d0-27c1d6477913 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891dec8f8be64fad8c8e967d8327dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bba82857ca4c3f808c6860d7d2599c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:15.819265 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9be17455-aac3-4815-b1d0-27c1d6477913 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] 10.222.0.46 "GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27" status: 200 len: 1324 microversion: 2.1 time: 0.346343 Oct 29 03:05:15.820043 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1882/3955] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:15 2022] GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27 => generated 1324 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:15.905491 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-00b4a977-cc75-4ed4-a7d8-42a88ede49e7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:15.915382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-00b4a977-cc75-4ed4-a7d8-42a88ede49e7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:15.916899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-00b4a977-cc75-4ed4-a7d8-42a88ede49e7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:15.918099 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-00b4a977-cc75-4ed4-a7d8-42a88ede49e7 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1604 microversion: 2.32 time: 0.199876 Oct 29 03:05:15.925666 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2074/3956] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:15 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1604 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:05:15.983530 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fadf4833-976f-4895-9d8c-f0307e0613e6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:15.984160 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fadf4833-976f-4895-9d8c-f0307e0613e6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:15.993220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fadf4833-976f-4895-9d8c-f0307e0613e6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:15.994647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fadf4833-976f-4895-9d8c-f0307e0613e6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:15.998348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fadf4833-976f-4895-9d8c-f0307e0613e6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:15.999133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fadf4833-976f-4895-9d8c-f0307e0613e6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:15.999610 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fadf4833-976f-4895-9d8c-f0307e0613e6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:16.000054 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fadf4833-976f-4895-9d8c-f0307e0613e6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:16.330088 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fadf4833-976f-4895-9d8c-f0307e0613e6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:16.341767 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fadf4833-976f-4895-9d8c-f0307e0613e6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1477 microversion: 2.1 time: 0.361241 Oct 29 03:05:16.342560 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1883/3957] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:15 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1477 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:16.409785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d4c9edb4-ee59-4c27-9ba5-f46fdd782004 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:16.410346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d4c9edb4-ee59-4c27-9ba5-f46fdd782004 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:16.426668 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4c9edb4-ee59-4c27-9ba5-f46fdd782004 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:16.427169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4c9edb4-ee59-4c27-9ba5-f46fdd782004 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:16.427605 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4c9edb4-ee59-4c27-9ba5-f46fdd782004 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:16.428339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4c9edb4-ee59-4c27-9ba5-f46fdd782004 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:16.428801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4c9edb4-ee59-4c27-9ba5-f46fdd782004 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:16.429226 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4c9edb4-ee59-4c27-9ba5-f46fdd782004 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:16.691223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d4c9edb4-ee59-4c27-9ba5-f46fdd782004 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:16.699615 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d4c9edb4-ee59-4c27-9ba5-f46fdd782004 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1506 microversion: 2.1 time: 0.297961 Oct 29 03:05:16.715210 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2075/3958] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:16 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:16.849010 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ffecaa3c-3e5c-441f-9f33-ed4f16320a39 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:16.850031 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ffecaa3c-3e5c-441f-9f33-ed4f16320a39 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] [instance: 5e78b6cd-1c9a-45f3-9e2c-791e01457a27] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:16.861677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ffecaa3c-3e5c-441f-9f33-ed4f16320a39 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:16.869580 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ffecaa3c-3e5c-441f-9f33-ed4f16320a39 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:16.870390 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ffecaa3c-3e5c-441f-9f33-ed4f16320a39 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:16.871646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ffecaa3c-3e5c-441f-9f33-ed4f16320a39 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:16.872274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ffecaa3c-3e5c-441f-9f33-ed4f16320a39 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:16.872921 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ffecaa3c-3e5c-441f-9f33-ed4f16320a39 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:16.946530 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-81486dd7-6bc7-44aa-8766-46b93fa7fbdf tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:16.947700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-81486dd7-6bc7-44aa-8766-46b93fa7fbdf tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:16.979774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81486dd7-6bc7-44aa-8766-46b93fa7fbdf tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:16.980492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81486dd7-6bc7-44aa-8766-46b93fa7fbdf tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:16.981087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81486dd7-6bc7-44aa-8766-46b93fa7fbdf tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:16.981952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81486dd7-6bc7-44aa-8766-46b93fa7fbdf tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:16.982814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81486dd7-6bc7-44aa-8766-46b93fa7fbdf tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:16.983473 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81486dd7-6bc7-44aa-8766-46b93fa7fbdf tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:17.158846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-81486dd7-6bc7-44aa-8766-46b93fa7fbdf tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:17.177890 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-81486dd7-6bc7-44aa-8766-46b93fa7fbdf tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:17.179405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-81486dd7-6bc7-44aa-8766-46b93fa7fbdf tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:17.180836 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-81486dd7-6bc7-44aa-8766-46b93fa7fbdf tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1604 microversion: 2.32 time: 0.239858 Oct 29 03:05:17.199209 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2076/3959] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:16 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1604 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:17.371692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ffecaa3c-3e5c-441f-9f33-ed4f16320a39 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891dec8f8be64fad8c8e967d8327dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bba82857ca4c3f808c6860d7d2599c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:17.378150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c51dc04f-f1a6-4111-b53a-2372f4e7c5c7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:17.379559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c51dc04f-f1a6-4111-b53a-2372f4e7c5c7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:17.407142 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ffecaa3c-3e5c-441f-9f33-ed4f16320a39 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] 10.222.0.46 "GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27" status: 200 len: 1324 microversion: 2.1 time: 0.561826 Oct 29 03:05:17.407758 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1884/3960] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:16 2022] GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27 => generated 1324 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:17.410751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c51dc04f-f1a6-4111-b53a-2372f4e7c5c7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:17.411249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c51dc04f-f1a6-4111-b53a-2372f4e7c5c7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:17.414144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c51dc04f-f1a6-4111-b53a-2372f4e7c5c7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:17.417976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c51dc04f-f1a6-4111-b53a-2372f4e7c5c7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:17.422566 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c51dc04f-f1a6-4111-b53a-2372f4e7c5c7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:17.425305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c51dc04f-f1a6-4111-b53a-2372f4e7c5c7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:17.442796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-52c05dd9-88dd-4869-b778-e9ef8f4a8926 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:17.451155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-52c05dd9-88dd-4869-b778-e9ef8f4a8926 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:17.482798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52c05dd9-88dd-4869-b778-e9ef8f4a8926 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:17.495938 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52c05dd9-88dd-4869-b778-e9ef8f4a8926 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:17.496499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52c05dd9-88dd-4869-b778-e9ef8f4a8926 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:17.499097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52c05dd9-88dd-4869-b778-e9ef8f4a8926 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:17.511716 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52c05dd9-88dd-4869-b778-e9ef8f4a8926 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:17.516081 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52c05dd9-88dd-4869-b778-e9ef8f4a8926 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:17.800123 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-52c05dd9-88dd-4869-b778-e9ef8f4a8926 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85efe9a35c8646ffadadc5a6bd9f0824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:17.812748 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-52c05dd9-88dd-4869-b778-e9ef8f4a8926 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2" status: 200 len: 1482 microversion: 2.1 time: 0.403791 Oct 29 03:05:17.813375 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1885/3961] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:17 2022] GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2 => generated 1482 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:17.842172 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-b42d8065-bea5-4838-910b-2374af25dd0f req-d3b58b85-45cb-41c6-ad82-df8315d6aa43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fa383d1-1572-4975-9de9-22286e5458a2", "tag": "2235e54c-806d-494b-b955-e92306257303"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:17.871135 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b42d8065-bea5-4838-910b-2374af25dd0f req-d3b58b85-45cb-41c6-ad82-df8315d6aa43 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:17.871616 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b42d8065-bea5-4838-910b-2374af25dd0f req-d3b58b85-45cb-41c6-ad82-df8315d6aa43 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:17.872048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b42d8065-bea5-4838-910b-2374af25dd0f req-d3b58b85-45cb-41c6-ad82-df8315d6aa43 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:17.906209 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-b42d8065-bea5-4838-910b-2374af25dd0f req-d3b58b85-45cb-41c6-ad82-df8315d6aa43 service nova] Creating event network-changed:2235e54c-806d-494b-b955-e92306257303 for instance 6fa383d1-1572-4975-9de9-22286e5458a2 on n-h1-862967-2 Oct 29 03:05:17.912245 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-b42d8065-bea5-4838-910b-2374af25dd0f req-d3b58b85-45cb-41c6-ad82-df8315d6aa43 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074702 Oct 29 03:05:17.912890 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1886/3962] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:17.944009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0340fbaf-1b7e-4931-8ba2-70e282eed0c6 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:17.945022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0340fbaf-1b7e-4931-8ba2-70e282eed0c6 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:17.960058 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0340fbaf-1b7e-4931-8ba2-70e282eed0c6 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:17.960574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0340fbaf-1b7e-4931-8ba2-70e282eed0c6 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:17.966477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0340fbaf-1b7e-4931-8ba2-70e282eed0c6 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:17.968286 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0340fbaf-1b7e-4931-8ba2-70e282eed0c6 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:17.968975 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0340fbaf-1b7e-4931-8ba2-70e282eed0c6 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:17.969572 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0340fbaf-1b7e-4931-8ba2-70e282eed0c6 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:18.394863 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0340fbaf-1b7e-4931-8ba2-70e282eed0c6 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:18.412820 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0340fbaf-1b7e-4931-8ba2-70e282eed0c6 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1506 microversion: 2.1 time: 0.494798 Oct 29 03:05:18.428922 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1887/3963] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:17 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1506 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:18.437857 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d92e374d-e42a-47d8-9596-786b22487832 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:18.438766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d92e374d-e42a-47d8-9596-786b22487832 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:18.452574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d92e374d-e42a-47d8-9596-786b22487832 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:18.453477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d92e374d-e42a-47d8-9596-786b22487832 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:18.454228 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d92e374d-e42a-47d8-9596-786b22487832 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:18.455848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d92e374d-e42a-47d8-9596-786b22487832 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:18.457919 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d92e374d-e42a-47d8-9596-786b22487832 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:18.461634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d92e374d-e42a-47d8-9596-786b22487832 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:18.483876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c51dc04f-f1a6-4111-b53a-2372f4e7c5c7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:18.503245 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c51dc04f-f1a6-4111-b53a-2372f4e7c5c7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1477 microversion: 2.1 time: 1.137058 Oct 29 03:05:18.507110 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2077/3964] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:17 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1477 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:18.527607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cb7abfa7-aa21-485c-b2aa-b8b9fde1be92 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:18.531593 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cb7abfa7-aa21-485c-b2aa-b8b9fde1be92 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] [instance: 5e78b6cd-1c9a-45f3-9e2c-791e01457a27] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:18.551338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cb7abfa7-aa21-485c-b2aa-b8b9fde1be92 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:18.557052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cb7abfa7-aa21-485c-b2aa-b8b9fde1be92 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:18.565527 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cb7abfa7-aa21-485c-b2aa-b8b9fde1be92 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:18.567877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cb7abfa7-aa21-485c-b2aa-b8b9fde1be92 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:18.569548 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cb7abfa7-aa21-485c-b2aa-b8b9fde1be92 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:18.570632 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cb7abfa7-aa21-485c-b2aa-b8b9fde1be92 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:18.694099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d92e374d-e42a-47d8-9596-786b22487832 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:18.731456 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d92e374d-e42a-47d8-9596-786b22487832 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:18.745103 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d92e374d-e42a-47d8-9596-786b22487832 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:18.746462 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d92e374d-e42a-47d8-9596-786b22487832 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1604 microversion: 2.32 time: 0.315802 Oct 29 03:05:18.755073 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1888/3965] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:18 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1604 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:18.981784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cb7abfa7-aa21-485c-b2aa-b8b9fde1be92 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891dec8f8be64fad8c8e967d8327dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bba82857ca4c3f808c6860d7d2599c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:19.000114 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cb7abfa7-aa21-485c-b2aa-b8b9fde1be92 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] 10.222.0.46 "GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27" status: 200 len: 1324 microversion: 2.1 time: 0.488234 Oct 29 03:05:19.020508 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2078/3966] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:18 2022] GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27 => generated 1324 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:19.455146 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a279ba04-fe61-490e-b9e7-6d8531bb6a84 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:19.455888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a279ba04-fe61-490e-b9e7-6d8531bb6a84 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:19.472123 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a279ba04-fe61-490e-b9e7-6d8531bb6a84 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:19.477192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a279ba04-fe61-490e-b9e7-6d8531bb6a84 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:19.477784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a279ba04-fe61-490e-b9e7-6d8531bb6a84 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:19.478689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a279ba04-fe61-490e-b9e7-6d8531bb6a84 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:19.479233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a279ba04-fe61-490e-b9e7-6d8531bb6a84 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:19.479733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a279ba04-fe61-490e-b9e7-6d8531bb6a84 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:19.537607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c18e4a18-5928-4d04-b7f9-69d8c931723d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:19.538528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c18e4a18-5928-4d04-b7f9-69d8c931723d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:19.560142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c18e4a18-5928-4d04-b7f9-69d8c931723d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:19.563746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c18e4a18-5928-4d04-b7f9-69d8c931723d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:19.566042 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c18e4a18-5928-4d04-b7f9-69d8c931723d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:19.566920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c18e4a18-5928-4d04-b7f9-69d8c931723d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:19.569980 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c18e4a18-5928-4d04-b7f9-69d8c931723d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:19.574940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c18e4a18-5928-4d04-b7f9-69d8c931723d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:19.628332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:20.327677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a279ba04-fe61-490e-b9e7-6d8531bb6a84 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:20.336786 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a279ba04-fe61-490e-b9e7-6d8531bb6a84 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 200 len: 1506 microversion: 2.1 time: 0.885496 Oct 29 03:05:20.338652 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1889/3967] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:19 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 1506 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:20.343719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4bd411c8-8570-42a5-ae12-a50e1f5c29f9 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:20.344730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4bd411c8-8570-42a5-ae12-a50e1f5c29f9 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:20.355877 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bd411c8-8570-42a5-ae12-a50e1f5c29f9 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:20.357427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bd411c8-8570-42a5-ae12-a50e1f5c29f9 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:20.358644 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bd411c8-8570-42a5-ae12-a50e1f5c29f9 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:20.359994 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bd411c8-8570-42a5-ae12-a50e1f5c29f9 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:20.361416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bd411c8-8570-42a5-ae12-a50e1f5c29f9 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:20.362626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bd411c8-8570-42a5-ae12-a50e1f5c29f9 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:20.415442 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c18e4a18-5928-4d04-b7f9-69d8c931723d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:20.432511 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c18e4a18-5928-4d04-b7f9-69d8c931723d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1477 microversion: 2.1 time: 0.902864 Oct 29 03:05:20.451284 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2079/3968] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:19 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1477 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:20.459354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2ee6b08a-5250-4800-b2a6-f6049656f966 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:20.461867 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2ee6b08a-5250-4800-b2a6-f6049656f966 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] [instance: 5e78b6cd-1c9a-45f3-9e2c-791e01457a27] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:20.479435 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2ee6b08a-5250-4800-b2a6-f6049656f966 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:20.493695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2ee6b08a-5250-4800-b2a6-f6049656f966 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:20.494832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2ee6b08a-5250-4800-b2a6-f6049656f966 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:20.496287 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2ee6b08a-5250-4800-b2a6-f6049656f966 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:20.497282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2ee6b08a-5250-4800-b2a6-f6049656f966 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:20.498270 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2ee6b08a-5250-4800-b2a6-f6049656f966 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:20.520176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4bd411c8-8570-42a5-ae12-a50e1f5c29f9 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:20.534234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4bd411c8-8570-42a5-ae12-a50e1f5c29f9 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:20.535676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4bd411c8-8570-42a5-ae12-a50e1f5c29f9 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:20.536913 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4bd411c8-8570-42a5-ae12-a50e1f5c29f9 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1604 microversion: 2.32 time: 0.197082 Oct 29 03:05:20.561880 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1890/3969] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:20 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1604 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:20.588391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-43a34b66-32d0-4e29-83de-d5f16807cdab req-41eab981-41b3-485b-9390-7ed5760eb049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66aafb24-5370-4be8-ab86-467f0a0e9f0e", "name": "network-vif-deleted", "tag": "4a27e218-de2c-496e-866d-d2b68459a080"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:20.604794 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-43a34b66-32d0-4e29-83de-d5f16807cdab req-41eab981-41b3-485b-9390-7ed5760eb049 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:20.606002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-43a34b66-32d0-4e29-83de-d5f16807cdab req-41eab981-41b3-485b-9390-7ed5760eb049 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:20.606644 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-43a34b66-32d0-4e29-83de-d5f16807cdab req-41eab981-41b3-485b-9390-7ed5760eb049 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:20.627052 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-43a34b66-32d0-4e29-83de-d5f16807cdab req-41eab981-41b3-485b-9390-7ed5760eb049 service nova] Creating event network-vif-deleted:4a27e218-de2c-496e-866d-d2b68459a080 for instance 66aafb24-5370-4be8-ab86-467f0a0e9f0e on n-h2-862967-2 Oct 29 03:05:20.632677 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-43a34b66-32d0-4e29-83de-d5f16807cdab req-41eab981-41b3-485b-9390-7ed5760eb049 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062525 Oct 29 03:05:20.634185 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1891/3970] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:20.958949 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2ee6b08a-5250-4800-b2a6-f6049656f966 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891dec8f8be64fad8c8e967d8327dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bba82857ca4c3f808c6860d7d2599c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:20.978460 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2ee6b08a-5250-4800-b2a6-f6049656f966 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] 10.222.0.46 "GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27" status: 200 len: 1324 microversion: 2.1 time: 0.525366 Oct 29 03:05:20.999283 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2080/3971] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:20 2022] GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27 => generated 1324 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:21.369833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6e778659-b911-4c0d-a289-621062117dab tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:21.371719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6e778659-b911-4c0d-a289-621062117dab tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 66aafb24-5370-4be8-ab86-467f0a0e9f0e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:21.393366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e778659-b911-4c0d-a289-621062117dab tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:21.395669 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e778659-b911-4c0d-a289-621062117dab tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:21.396499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e778659-b911-4c0d-a289-621062117dab tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:21.399352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e778659-b911-4c0d-a289-621062117dab tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:21.401580 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e778659-b911-4c0d-a289-621062117dab tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:21.404742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e778659-b911-4c0d-a289-621062117dab tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:21.473469 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-6e778659-b911-4c0d-a289-621062117dab tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] HTTP exception thrown: Instance 66aafb24-5370-4be8-ab86-467f0a0e9f0e could not be found. Oct 29 03:05:21.475004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b2e872c2-d59e-4ee4-aa1d-5b4425890a5a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:21.475878 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b2e872c2-d59e-4ee4-aa1d-5b4425890a5a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6e778659-b911-4c0d-a289-621062117dab tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Request method failure captured: Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e HTTP/1.1 Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJf7ev_7tmTkhOFEkyRuW_SvvAyfCSjJj-Nuarla_3WyBC0liWpDG63OGpel2OnyxA4fA7G7YQe1-q4WBzBWv5mo4GJYu_-RutiUOwVhLP0Isla0-VqeYjSekjDtPgpmK3oVQqzNlw7i6bk3jpmpdtXTP-W2utCDWfFqKBaLMGbMN4E Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: bb24014d942448949743ad6b56d8d0a7 Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerRescueTestJSON-700466836 Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bb24014d942448949743ad6b56d8d0a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bb24014d942448949743ad6b56d8d0a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bb24014d942448949743ad6b56d8d0a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bb24014d942448949743ad6b56d8d0a7"}]}] Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerRescueTestJSON-700466836 Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: bb24014d942448949743ad6b56d8d0a7 Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerRescueTestJSON-700466836 Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerRescueTestJSON-700466836-project Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 764f273de21745e0ab94f098ede04499 Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerRescueTestJSON-700466836-project Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 66aafb24-5370-4be8-ab86-467f0a0e9f0e could not be found. Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '66aafb24-5370-4be8-ab86-467f0a0e9f0e'} Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66aafb24-5370-4be8-ab86-467f0a0e9f0e could not be found. Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66aafb24-5370-4be8-ab86-467f0a0e9f0e could not be found. Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:21.481728 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:05:21.489834 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:21.489834 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:21.489834 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:21.489834 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:21.489834 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:21.489834 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66aafb24-5370-4be8-ab86-467f0a0e9f0e could not be found. Oct 29 03:05:21.489834 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:05:21.489834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6e778659-b911-4c0d-a289-621062117dab tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Returning 404 to user: Instance 66aafb24-5370-4be8-ab86-467f0a0e9f0e could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:21.489834 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6e778659-b911-4c0d-a289-621062117dab tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e" status: 404 len: 111 microversion: 2.1 time: 0.124911 Oct 29 03:05:21.491479 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1892/3972] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:21 2022] GET /compute/v2.1/servers/66aafb24-5370-4be8-ab86-467f0a0e9f0e => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:05:21.495304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b2e872c2-d59e-4ee4-aa1d-5b4425890a5a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:21.495806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b2e872c2-d59e-4ee4-aa1d-5b4425890a5a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:21.496429 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b2e872c2-d59e-4ee4-aa1d-5b4425890a5a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:21.497198 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b2e872c2-d59e-4ee4-aa1d-5b4425890a5a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:21.497666 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b2e872c2-d59e-4ee4-aa1d-5b4425890a5a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:21.498138 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b2e872c2-d59e-4ee4-aa1d-5b4425890a5a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:21.503499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1f6db14a-368e-457a-8e66-5d3b29bd62bb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:21.504135 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1f6db14a-368e-457a-8e66-5d3b29bd62bb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:21.522264 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f6db14a-368e-457a-8e66-5d3b29bd62bb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:21.522890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f6db14a-368e-457a-8e66-5d3b29bd62bb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:21.523318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f6db14a-368e-457a-8e66-5d3b29bd62bb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:21.524152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f6db14a-368e-457a-8e66-5d3b29bd62bb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:21.524726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f6db14a-368e-457a-8e66-5d3b29bd62bb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:21.525247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f6db14a-368e-457a-8e66-5d3b29bd62bb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:21.552411 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1f6db14a-368e-457a-8e66-5d3b29bd62bb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:05:21.672833 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1f6db14a-368e-457a-8e66-5d3b29bd62bb tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "DELETE /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa" status: 204 len: 0 microversion: 2.1 time: 0.174973 Oct 29 03:05:21.674934 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1893/3973] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:05:21 2022] DELETE /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:05:21.682958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-133b616f-d492-4f77-81d5-0a217cc5af94 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:21.684803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-133b616f-d492-4f77-81d5-0a217cc5af94 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:21.692429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-133b616f-d492-4f77-81d5-0a217cc5af94 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:21.693403 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-133b616f-d492-4f77-81d5-0a217cc5af94 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:21.694080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-133b616f-d492-4f77-81d5-0a217cc5af94 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:21.695129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-133b616f-d492-4f77-81d5-0a217cc5af94 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:21.695780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-133b616f-d492-4f77-81d5-0a217cc5af94 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:21.696784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-133b616f-d492-4f77-81d5-0a217cc5af94 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:21.792153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-133b616f-d492-4f77-81d5-0a217cc5af94 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:21.815004 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-133b616f-d492-4f77-81d5-0a217cc5af94 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:21.818264 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-133b616f-d492-4f77-81d5-0a217cc5af94 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:21.820473 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-133b616f-d492-4f77-81d5-0a217cc5af94 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1604 microversion: 2.32 time: 0.143304 Oct 29 03:05:21.821714 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1894/3974] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:21 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1604 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:21.830584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-d1bb99bb-380d-49de-9526-8303efae288c req-d97bb1ca-8533-4058-be78-95ece6ce1dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e78b6cd-1c9a-45f3-9e2c-791e01457a27", "name": "network-vif-plugged", "status": "completed", "tag": "c219da66-3863-41dd-a717-6128649f484b"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:21.848993 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d1bb99bb-380d-49de-9526-8303efae288c req-d97bb1ca-8533-4058-be78-95ece6ce1dd4 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:21.849816 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d1bb99bb-380d-49de-9526-8303efae288c req-d97bb1ca-8533-4058-be78-95ece6ce1dd4 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:21.850556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d1bb99bb-380d-49de-9526-8303efae288c req-d97bb1ca-8533-4058-be78-95ece6ce1dd4 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:21.877588 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-d1bb99bb-380d-49de-9526-8303efae288c req-d97bb1ca-8533-4058-be78-95ece6ce1dd4 service nova] Creating event network-vif-plugged:c219da66-3863-41dd-a717-6128649f484b for instance 5e78b6cd-1c9a-45f3-9e2c-791e01457a27 on n-h2-862967-2 Oct 29 03:05:21.884897 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-d1bb99bb-380d-49de-9526-8303efae288c req-d97bb1ca-8533-4058-be78-95ece6ce1dd4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061265 Oct 29 03:05:21.886062 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1895/3975] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:21.892201 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-354dd63b-9553-4b81-97cf-a53b97670e8c tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:21.893047 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-354dd63b-9553-4b81-97cf-a53b97670e8c tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:21.900696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-354dd63b-9553-4b81-97cf-a53b97670e8c tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:21.901344 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-354dd63b-9553-4b81-97cf-a53b97670e8c tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:21.902019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-354dd63b-9553-4b81-97cf-a53b97670e8c tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:21.902913 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-354dd63b-9553-4b81-97cf-a53b97670e8c tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:21.903553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-354dd63b-9553-4b81-97cf-a53b97670e8c tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:21.904216 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-354dd63b-9553-4b81-97cf-a53b97670e8c tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:21.909639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:22.127177 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-354dd63b-9553-4b81-97cf-a53b97670e8c tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:22.139512 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-354dd63b-9553-4b81-97cf-a53b97670e8c tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa" status: 200 len: 1491 microversion: 2.1 time: 0.251831 Oct 29 03:05:22.157538 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1896/3976] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:21 2022] GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa => generated 1491 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:22.177335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5ce7f293-a314-4d5f-b031-612fcdab97ae tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:22.178540 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5ce7f293-a314-4d5f-b031-612fcdab97ae tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] [instance: 5e78b6cd-1c9a-45f3-9e2c-791e01457a27] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:22.188345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ce7f293-a314-4d5f-b031-612fcdab97ae tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:22.189168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ce7f293-a314-4d5f-b031-612fcdab97ae tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:22.189889 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ce7f293-a314-4d5f-b031-612fcdab97ae tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:22.191039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ce7f293-a314-4d5f-b031-612fcdab97ae tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:22.191797 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ce7f293-a314-4d5f-b031-612fcdab97ae tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:22.192512 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ce7f293-a314-4d5f-b031-612fcdab97ae tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:22.347328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b2e872c2-d59e-4ee4-aa1d-5b4425890a5a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:22.401430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5ce7f293-a314-4d5f-b031-612fcdab97ae tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891dec8f8be64fad8c8e967d8327dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bba82857ca4c3f808c6860d7d2599c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:22.423768 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5ce7f293-a314-4d5f-b031-612fcdab97ae tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] 10.222.0.46 "GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27" status: 200 len: 1324 microversion: 2.1 time: 0.263681 Oct 29 03:05:22.439722 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1897/3977] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:22 2022] GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27 => generated 1324 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:22.442326 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b2e872c2-d59e-4ee4-aa1d-5b4425890a5a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1477 microversion: 2.1 time: 0.962565 Oct 29 03:05:22.442326 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2081/3978] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:21 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1477 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:05:22.859819 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b19bec5d-d2d1-4e7b-97ad-fe8d9629c1a2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:22.862118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b19bec5d-d2d1-4e7b-97ad-fe8d9629c1a2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:22.880890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b19bec5d-d2d1-4e7b-97ad-fe8d9629c1a2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:22.882324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b19bec5d-d2d1-4e7b-97ad-fe8d9629c1a2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:22.883601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b19bec5d-d2d1-4e7b-97ad-fe8d9629c1a2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:22.885049 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b19bec5d-d2d1-4e7b-97ad-fe8d9629c1a2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:22.886025 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b19bec5d-d2d1-4e7b-97ad-fe8d9629c1a2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:22.886767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b19bec5d-d2d1-4e7b-97ad-fe8d9629c1a2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:22.950533 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b19bec5d-d2d1-4e7b-97ad-fe8d9629c1a2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:22.953635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b19bec5d-d2d1-4e7b-97ad-fe8d9629c1a2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:22.954621 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b19bec5d-d2d1-4e7b-97ad-fe8d9629c1a2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:22.955513 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-b19bec5d-d2d1-4e7b-97ad-fe8d9629c1a2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lazy-loading 'fault' on Instance uuid c72534eb-1844-4208-b625-ea8b5ece8108 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:05:23.064463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b19bec5d-d2d1-4e7b-97ad-fe8d9629c1a2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:23.101064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b19bec5d-d2d1-4e7b-97ad-fe8d9629c1a2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:23.104092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b19bec5d-d2d1-4e7b-97ad-fe8d9629c1a2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2230efa6fc74ba0ad51fc648835a035', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '908b0840bf614aaa9f07757baaeb950b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:23.106076 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b19bec5d-d2d1-4e7b-97ad-fe8d9629c1a2 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 200 len: 1609 microversion: 2.32 time: 0.254447 Oct 29 03:05:23.107520 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1898/3979] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:22 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 1609 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:23.190828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-51cf62f1-4a5a-44e5-a5f2-fbf472974143 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:23.191612 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-51cf62f1-4a5a-44e5-a5f2-fbf472974143 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:23.212800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51cf62f1-4a5a-44e5-a5f2-fbf472974143 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:23.213305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51cf62f1-4a5a-44e5-a5f2-fbf472974143 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:23.213761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51cf62f1-4a5a-44e5-a5f2-fbf472974143 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:23.214484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51cf62f1-4a5a-44e5-a5f2-fbf472974143 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:23.215130 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51cf62f1-4a5a-44e5-a5f2-fbf472974143 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:23.215566 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51cf62f1-4a5a-44e5-a5f2-fbf472974143 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:23.470460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ad19565e-9f24-4dba-b259-864e209a50e4 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:23.471094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ad19565e-9f24-4dba-b259-864e209a50e4 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] [instance: 5e78b6cd-1c9a-45f3-9e2c-791e01457a27] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:23.495263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad19565e-9f24-4dba-b259-864e209a50e4 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:23.496005 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad19565e-9f24-4dba-b259-864e209a50e4 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:23.498188 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad19565e-9f24-4dba-b259-864e209a50e4 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:23.499770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad19565e-9f24-4dba-b259-864e209a50e4 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:23.500787 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad19565e-9f24-4dba-b259-864e209a50e4 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:23.502172 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad19565e-9f24-4dba-b259-864e209a50e4 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:23.685475 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-51cf62f1-4a5a-44e5-a5f2-fbf472974143 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:23.697513 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-51cf62f1-4a5a-44e5-a5f2-fbf472974143 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa" status: 200 len: 1491 microversion: 2.1 time: 0.512062 Oct 29 03:05:23.699765 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2082/3980] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:23 2022] GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa => generated 1491 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:23.711526 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dd7b683c-61bb-4826-afeb-b65c2821b679 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:23.712894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dd7b683c-61bb-4826-afeb-b65c2821b679 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:23.725706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd7b683c-61bb-4826-afeb-b65c2821b679 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:23.730946 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd7b683c-61bb-4826-afeb-b65c2821b679 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:23.732680 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd7b683c-61bb-4826-afeb-b65c2821b679 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:23.736416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd7b683c-61bb-4826-afeb-b65c2821b679 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:23.737257 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd7b683c-61bb-4826-afeb-b65c2821b679 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:23.737878 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd7b683c-61bb-4826-afeb-b65c2821b679 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:23.848205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ad19565e-9f24-4dba-b259-864e209a50e4 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891dec8f8be64fad8c8e967d8327dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bba82857ca4c3f808c6860d7d2599c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:23.858231 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ad19565e-9f24-4dba-b259-864e209a50e4 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] 10.222.0.46 "GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27" status: 200 len: 1324 microversion: 2.1 time: 0.395078 Oct 29 03:05:23.873449 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1899/3981] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:23 2022] GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27 => generated 1324 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:24.141887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8176266f-ae7d-488e-a7eb-5856f11f74ce tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:24.143635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8176266f-ae7d-488e-a7eb-5856f11f74ce tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:24.153874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8176266f-ae7d-488e-a7eb-5856f11f74ce tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:24.154919 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8176266f-ae7d-488e-a7eb-5856f11f74ce tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:24.156593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8176266f-ae7d-488e-a7eb-5856f11f74ce tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:24.158937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8176266f-ae7d-488e-a7eb-5856f11f74ce tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:24.160184 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8176266f-ae7d-488e-a7eb-5856f11f74ce tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:24.161579 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8176266f-ae7d-488e-a7eb-5856f11f74ce tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:24.196944 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-8176266f-ae7d-488e-a7eb-5856f11f74ce tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] HTTP exception thrown: Instance c72534eb-1844-4208-b625-ea8b5ece8108 could not be found. Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8176266f-ae7d-488e-a7eb-5856f11f74ce tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Request method failure captured: Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 HTTP/1.1 Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJbGrBkH4jsdY4BExcRbpLhwD_CPN9zYv6OuCa6_MUUrfQGkhV7FER3qGnbgrwKfABkBF1yDZRhjmSMEPCgoMbVFe3t6Jt-VeibiOt6WLpG4u_zCC07lp12flvGPtcliZ59LkyWYLi02XVYIuDklDNALo7MKoY-QALwTsCK81cWi1yg Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: X-Openstack-Nova-Api-Version: 2.32 Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 908b0840bf614aaa9f07757baaeb950b Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TaggedBootDevicesTest-948370209 Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/908b0840bf614aaa9f07757baaeb950b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/908b0840bf614aaa9f07757baaeb950b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_908b0840bf614aaa9f07757baaeb950b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/908b0840bf614aaa9f07757baaeb950b"}]}] Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TaggedBootDevicesTest-948370209 Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 908b0840bf614aaa9f07757baaeb950b Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TaggedBootDevicesTest-948370209 Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TaggedBootDevicesTest-948370209-project Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: f2230efa6fc74ba0ad51fc648835a035 Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TaggedBootDevicesTest-948370209-project Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance c72534eb-1844-4208-b625-ea8b5ece8108 could not be found. Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'c72534eb-1844-4208-b625-ea8b5ece8108'} Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c72534eb-1844-4208-b625-ea8b5ece8108 could not be found. Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c72534eb-1844-4208-b625-ea8b5ece8108 could not be found. Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:24.199862 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:05:24.207960 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:24.207960 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:24.207960 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:24.207960 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:24.207960 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:24.207960 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c72534eb-1844-4208-b625-ea8b5ece8108 could not be found. Oct 29 03:05:24.207960 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:05:24.210274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8176266f-ae7d-488e-a7eb-5856f11f74ce tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Returning 404 to user: Instance c72534eb-1844-4208-b625-ea8b5ece8108 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:24.211358 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8176266f-ae7d-488e-a7eb-5856f11f74ce tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 404 len: 111 microversion: 2.32 time: 0.077621 Oct 29 03:05:24.212472 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1900/3982] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:24 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:05:24.225002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7d445aaa-a7f8-4f6b-9efa-bb1bdec796e5 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '.version_select at 0x7ff053886430>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:24.246286 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:24.250091 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dd7b683c-61bb-4826-afeb-b65c2821b679 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:24.265072 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dd7b683c-61bb-4826-afeb-b65c2821b679 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1476 microversion: 2.1 time: 0.563040 Oct 29 03:05:24.278058 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2083/3983] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:23 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1476 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:24.317599 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7d445aaa-a7f8-4f6b-9efa-bb1bdec796e5 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1109268866" status: 204 len: 0 microversion: 2.32 time: 0.097065 Oct 29 03:05:24.319814 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1901/3984] 10.222.0.46 () {60 vars in 1262 bytes} [Sat Oct 29 03:05:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1109268866 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:05:24.750698 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5024355c-bc15-456e-ac2d-560905f596e0 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:24.752960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5024355c-bc15-456e-ac2d-560905f596e0 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:24.767417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5024355c-bc15-456e-ac2d-560905f596e0 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:24.768768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5024355c-bc15-456e-ac2d-560905f596e0 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:24.769915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5024355c-bc15-456e-ac2d-560905f596e0 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:24.771500 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5024355c-bc15-456e-ac2d-560905f596e0 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:24.772568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5024355c-bc15-456e-ac2d-560905f596e0 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:24.773700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5024355c-bc15-456e-ac2d-560905f596e0 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:24.895993 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-73d455a7-dd37-43b5-872b-029efa0b756a tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:24.897921 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-73d455a7-dd37-43b5-872b-029efa0b756a tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] [instance: 5e78b6cd-1c9a-45f3-9e2c-791e01457a27] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:24.914129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73d455a7-dd37-43b5-872b-029efa0b756a tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:24.914977 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73d455a7-dd37-43b5-872b-029efa0b756a tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:24.915602 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73d455a7-dd37-43b5-872b-029efa0b756a tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:24.916581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73d455a7-dd37-43b5-872b-029efa0b756a tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:24.917254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73d455a7-dd37-43b5-872b-029efa0b756a tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:24.918029 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73d455a7-dd37-43b5-872b-029efa0b756a tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:24.927039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5024355c-bc15-456e-ac2d-560905f596e0 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '764f273de21745e0ab94f098ede04499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb24014d942448949743ad6b56d8d0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:24.978459 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5024355c-bc15-456e-ac2d-560905f596e0 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa" status: 200 len: 1449 microversion: 2.1 time: 0.234514 Oct 29 03:05:24.980685 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2084/3985] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:24 2022] GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa => generated 1449 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:24.996113 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-71591896-bfe7-4016-a7cf-94bcb930598e req-2fb7c757-84e0-416f-a682-f2bdfef2a1a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34628535-7e50-432b-9baf-a1d9b841a1ec", "name": "network-vif-unplugged", "status": "completed", "tag": "a2e09809-ccdf-450a-a30b-75e01aaa1eef"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:25.013000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-71591896-bfe7-4016-a7cf-94bcb930598e req-2fb7c757-84e0-416f-a682-f2bdfef2a1a4 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:25.013523 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-71591896-bfe7-4016-a7cf-94bcb930598e req-2fb7c757-84e0-416f-a682-f2bdfef2a1a4 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:25.014094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-71591896-bfe7-4016-a7cf-94bcb930598e req-2fb7c757-84e0-416f-a682-f2bdfef2a1a4 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:25.026827 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-71591896-bfe7-4016-a7cf-94bcb930598e req-2fb7c757-84e0-416f-a682-f2bdfef2a1a4 service nova] Creating event network-vif-unplugged:a2e09809-ccdf-450a-a30b-75e01aaa1eef for instance 34628535-7e50-432b-9baf-a1d9b841a1ec on n-h2-862967-2 Oct 29 03:05:25.036968 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [req-71591896-bfe7-4016-a7cf-94bcb930598e req-2fb7c757-84e0-416f-a682-f2bdfef2a1a4 service nova] Instance 34628535-7e50-432b-9baf-a1d9b841a1ec is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:05:25.053131 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-71591896-bfe7-4016-a7cf-94bcb930598e req-2fb7c757-84e0-416f-a682-f2bdfef2a1a4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069751 Oct 29 03:05:25.053891 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2085/3986] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:25.059585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-126fbff7-2161-412d-b4a4-3084983e8bd9 req-7e2c622e-6c7f-45d1-a779-c4fc4a1d2ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "854853c8-400f-420a-9519-5d46be009afa", "name": "network-vif-deleted", "tag": "6f8fd018-e6f9-4c6a-9469-f0e4bd8650db"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:25.073267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-126fbff7-2161-412d-b4a4-3084983e8bd9 req-7e2c622e-6c7f-45d1-a779-c4fc4a1d2ab2 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:25.073867 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-126fbff7-2161-412d-b4a4-3084983e8bd9 req-7e2c622e-6c7f-45d1-a779-c4fc4a1d2ab2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:25.074576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-126fbff7-2161-412d-b4a4-3084983e8bd9 req-7e2c622e-6c7f-45d1-a779-c4fc4a1d2ab2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:25.113349 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-126fbff7-2161-412d-b4a4-3084983e8bd9 req-7e2c622e-6c7f-45d1-a779-c4fc4a1d2ab2 service nova] Creating event network-vif-deleted:6f8fd018-e6f9-4c6a-9469-f0e4bd8650db for instance 854853c8-400f-420a-9519-5d46be009afa on n-h2-862967-2 Oct 29 03:05:25.128421 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-126fbff7-2161-412d-b4a4-3084983e8bd9 req-7e2c622e-6c7f-45d1-a779-c4fc4a1d2ab2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073023 Oct 29 03:05:25.129154 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2086/3987] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:25.305721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bae56bdc-8ed4-4f3a-9fe2-4032659cb299 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:25.306765 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bae56bdc-8ed4-4f3a-9fe2-4032659cb299 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:25.357537 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bae56bdc-8ed4-4f3a-9fe2-4032659cb299 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:25.359443 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bae56bdc-8ed4-4f3a-9fe2-4032659cb299 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:25.365125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bae56bdc-8ed4-4f3a-9fe2-4032659cb299 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:25.369977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bae56bdc-8ed4-4f3a-9fe2-4032659cb299 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:25.370846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bae56bdc-8ed4-4f3a-9fe2-4032659cb299 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:25.371854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bae56bdc-8ed4-4f3a-9fe2-4032659cb299 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:25.518403 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-73d455a7-dd37-43b5-872b-029efa0b756a tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891dec8f8be64fad8c8e967d8327dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bba82857ca4c3f808c6860d7d2599c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:25.531207 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-73d455a7-dd37-43b5-872b-029efa0b756a tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] 10.222.0.46 "GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27" status: 200 len: 1324 microversion: 2.1 time: 0.650088 Oct 29 03:05:25.545720 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1902/3988] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:24 2022] GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27 => generated 1324 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:25.675627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bae56bdc-8ed4-4f3a-9fe2-4032659cb299 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:25.684979 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bae56bdc-8ed4-4f3a-9fe2-4032659cb299 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1476 microversion: 2.1 time: 0.384655 Oct 29 03:05:25.685454 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2087/3989] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:25 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1476 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:26.015011 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-75821440-82e9-4a08-a01f-33ad2d1c8e30 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:26.018519 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-75821440-82e9-4a08-a01f-33ad2d1c8e30 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] [instance: 854853c8-400f-420a-9519-5d46be009afa] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:26.043002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75821440-82e9-4a08-a01f-33ad2d1c8e30 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:26.043875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75821440-82e9-4a08-a01f-33ad2d1c8e30 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:26.044737 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75821440-82e9-4a08-a01f-33ad2d1c8e30 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:26.046074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75821440-82e9-4a08-a01f-33ad2d1c8e30 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:26.046677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75821440-82e9-4a08-a01f-33ad2d1c8e30 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:26.047112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75821440-82e9-4a08-a01f-33ad2d1c8e30 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:26.114412 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-75821440-82e9-4a08-a01f-33ad2d1c8e30 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] HTTP exception thrown: Instance 854853c8-400f-420a-9519-5d46be009afa could not be found. Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-75821440-82e9-4a08-a01f-33ad2d1c8e30 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Request method failure captured: Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa HTTP/1.1 Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJf7ev_7tmTkhOFEkyRuW_SvvAyfCSjJj-Nuarla_3WyBC0liWpDG63OGpel2OnyxA4fA7G7YQe1-q4WBzBWv5mo4GJYu_-RutiUOwVhLP0Isla0-VqeYjSekjDtPgpmK3oVQqzNlw7i6bk3jpmpdtXTP-W2utCDWfFqKBaLMGbMN4E Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: bb24014d942448949743ad6b56d8d0a7 Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerRescueTestJSON-700466836 Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bb24014d942448949743ad6b56d8d0a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bb24014d942448949743ad6b56d8d0a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bb24014d942448949743ad6b56d8d0a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bb24014d942448949743ad6b56d8d0a7"}]}] Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerRescueTestJSON-700466836 Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: bb24014d942448949743ad6b56d8d0a7 Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerRescueTestJSON-700466836 Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerRescueTestJSON-700466836-project Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 764f273de21745e0ab94f098ede04499 Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerRescueTestJSON-700466836-project Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 854853c8-400f-420a-9519-5d46be009afa could not be found. Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '854853c8-400f-420a-9519-5d46be009afa'} Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 854853c8-400f-420a-9519-5d46be009afa could not be found. Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 854853c8-400f-420a-9519-5d46be009afa could not be found. Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:26.116096 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:05:26.120342 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:26.120342 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:26.120342 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:26.120342 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:26.120342 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:26.120342 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 854853c8-400f-420a-9519-5d46be009afa could not be found. Oct 29 03:05:26.120342 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:05:26.124903 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-75821440-82e9-4a08-a01f-33ad2d1c8e30 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] Returning 404 to user: Instance 854853c8-400f-420a-9519-5d46be009afa could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:26.125966 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-75821440-82e9-4a08-a01f-33ad2d1c8e30 tempest-ServerRescueTestJSON-700466836 tempest-ServerRescueTestJSON-700466836-project] 10.222.0.46 "GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa" status: 404 len: 111 microversion: 2.1 time: 0.118453 Oct 29 03:05:26.126959 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1903/3990] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:26 2022] GET /compute/v2.1/servers/854853c8-400f-420a-9519-5d46be009afa => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:05:26.492562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bae56bdc-8ed4-4f3a-9fe2-4032659cb299 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:26.494130 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bae56bdc-8ed4-4f3a-9fe2-4032659cb299 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002040 Oct 29 03:05:26.494676 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2088/3991] 10.222.0.46 () {56 vars in 886 bytes} [Sat Oct 29 03:05:26 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 29 03:05:26.562222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8f98091e-1206-4453-83d1-b8cd78e97dd0 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:26.563420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8f98091e-1206-4453-83d1-b8cd78e97dd0 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] [instance: 5e78b6cd-1c9a-45f3-9e2c-791e01457a27] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:26.575918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f98091e-1206-4453-83d1-b8cd78e97dd0 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:26.585506 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f98091e-1206-4453-83d1-b8cd78e97dd0 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:26.586364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f98091e-1206-4453-83d1-b8cd78e97dd0 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:26.587400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f98091e-1206-4453-83d1-b8cd78e97dd0 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:26.588107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f98091e-1206-4453-83d1-b8cd78e97dd0 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:26.588868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f98091e-1206-4453-83d1-b8cd78e97dd0 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:26.712540 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ee2aa932-5ba4-45d2-872d-f075786616fa tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:26.713236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ee2aa932-5ba4-45d2-872d-f075786616fa tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:26.720343 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee2aa932-5ba4-45d2-872d-f075786616fa tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:26.721139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee2aa932-5ba4-45d2-872d-f075786616fa tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:26.721786 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee2aa932-5ba4-45d2-872d-f075786616fa tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:26.722740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee2aa932-5ba4-45d2-872d-f075786616fa tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:26.723428 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee2aa932-5ba4-45d2-872d-f075786616fa tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:26.724342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee2aa932-5ba4-45d2-872d-f075786616fa tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:27.235547 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8f98091e-1206-4453-83d1-b8cd78e97dd0 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891dec8f8be64fad8c8e967d8327dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bba82857ca4c3f808c6860d7d2599c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:27.239571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ee2aa932-5ba4-45d2-872d-f075786616fa tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:27.245920 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8f98091e-1206-4453-83d1-b8cd78e97dd0 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] 10.222.0.46 "GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27" status: 200 len: 1520 microversion: 2.1 time: 0.688268 Oct 29 03:05:27.246507 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1904/3992] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:26 2022] GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27 => generated 1520 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:05:27.273986 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ee2aa932-5ba4-45d2-872d-f075786616fa tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1476 microversion: 2.1 time: 0.565694 Oct 29 03:05:27.275308 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2089/3993] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:26 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1476 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:05:27.276428 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-91fcba98-005e-46a2-a6e6-90a69bb7f24a req-73604fd6-517e-4c08-984b-d4640a192e6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34628535-7e50-432b-9baf-a1d9b841a1ec", "tag": "a2e09809-ccdf-450a-a30b-75e01aaa1eef"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:27.280194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-037d928f-2651-4aa1-ba3f-248d7b1a67d2 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:27.281063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-037d928f-2651-4aa1-ba3f-248d7b1a67d2 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] [instance: 5e78b6cd-1c9a-45f3-9e2c-791e01457a27] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:27.291819 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-037d928f-2651-4aa1-ba3f-248d7b1a67d2 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:27.293034 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-037d928f-2651-4aa1-ba3f-248d7b1a67d2 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:27.294029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-037d928f-2651-4aa1-ba3f-248d7b1a67d2 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:27.294980 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-037d928f-2651-4aa1-ba3f-248d7b1a67d2 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:27.295765 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-037d928f-2651-4aa1-ba3f-248d7b1a67d2 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:27.296372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-037d928f-2651-4aa1-ba3f-248d7b1a67d2 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:27.298888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-91fcba98-005e-46a2-a6e6-90a69bb7f24a req-73604fd6-517e-4c08-984b-d4640a192e6f service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:27.299440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-91fcba98-005e-46a2-a6e6-90a69bb7f24a req-73604fd6-517e-4c08-984b-d4640a192e6f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:27.299906 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-91fcba98-005e-46a2-a6e6-90a69bb7f24a req-73604fd6-517e-4c08-984b-d4640a192e6f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:27.331484 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-91fcba98-005e-46a2-a6e6-90a69bb7f24a req-73604fd6-517e-4c08-984b-d4640a192e6f service nova] Creating event network-changed:a2e09809-ccdf-450a-a30b-75e01aaa1eef for instance 34628535-7e50-432b-9baf-a1d9b841a1ec on n-h2-862967-2 Oct 29 03:05:27.345246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [req-91fcba98-005e-46a2-a6e6-90a69bb7f24a req-73604fd6-517e-4c08-984b-d4640a192e6f service nova] Instance 34628535-7e50-432b-9baf-a1d9b841a1ec is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:05:27.364219 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-037d928f-2651-4aa1-ba3f-248d7b1a67d2 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] HTTP exception thrown: Instance is not a member of specified network Oct 29 03:05:27.367793 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-91fcba98-005e-46a2-a6e6-90a69bb7f24a req-73604fd6-517e-4c08-984b-d4640a192e6f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119521 Oct 29 03:05:27.372252 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1905/3994] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-037d928f-2651-4aa1-ba3f-248d7b1a67d2 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Request method failure captured: Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27/ips/invalid HTTP/1.1 Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJhbIoGWF929aDnKQ9UCd3Q5RELktrXuoS9kXVU-0CFn6PnZVQbFyDB8MBGoiPhmjjtq9R7hH6cUwJxPfO7nQT4SBTAkUTSVshZAUhw4ULwvkZGRD357FnyXsRSrwHkDy3HW4YD4JFtnFgPi5SN-qLPRbg94rOwYHfOzaR2Bp7b9Ar0 Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: a1bba82857ca4c3f808c6860d7d2599c Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-621328605 Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a1bba82857ca4c3f808c6860d7d2599c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a1bba82857ca4c3f808c6860d7d2599c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a1bba82857ca4c3f808c6860d7d2599c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a1bba82857ca4c3f808c6860d7d2599c"}]}] Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-621328605 Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: a1bba82857ca4c3f808c6860d7d2599c Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-621328605 Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServerAddressesNegativeTestJSON-621328605-project Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 891dec8f8be64fad8c8e967d8327dda5 Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-621328605-project Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance is not a member of specified network Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'server_id': '5e78b6cd-1c9a-45f3-9e2c-791e01457a27', 'id': 'invalid'} Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 29 03:05:27.379615 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:27.386068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-037d928f-2651-4aa1-ba3f-248d7b1a67d2 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Returning 404 to user: Instance is not a member of specified network {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:27.388635 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-037d928f-2651-4aa1-ba3f-248d7b1a67d2 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] 10.222.0.46 "GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.112074 Oct 29 03:05:27.390081 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2090/3995] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 03:05:27 2022] GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27/ips/invalid => generated 91 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:05:27.405980 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f4094548-0c26-438c-b8ba-0d13dc993a30 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:27.406467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f4094548-0c26-438c-b8ba-0d13dc993a30 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Failed to fetch instance by id 999 {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 29 03:05:27.407180 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-f4094548-0c26-438c-b8ba-0d13dc993a30 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] HTTP exception thrown: Instance 999 could not be found. Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f4094548-0c26-438c-b8ba-0d13dc993a30 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Request method failure captured: Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJhbIoGWF929aDnKQ9UCd3Q5RELktrXuoS9kXVU-0CFn6PnZVQbFyDB8MBGoiPhmjjtq9R7hH6cUwJxPfO7nQT4SBTAkUTSVshZAUhw4ULwvkZGRD357FnyXsRSrwHkDy3HW4YD4JFtnFgPi5SN-qLPRbg94rOwYHfOzaR2Bp7b9Ar0 Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: a1bba82857ca4c3f808c6860d7d2599c Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-621328605 Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a1bba82857ca4c3f808c6860d7d2599c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a1bba82857ca4c3f808c6860d7d2599c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a1bba82857ca4c3f808c6860d7d2599c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a1bba82857ca4c3f808c6860d7d2599c"}]}] Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-621328605 Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: a1bba82857ca4c3f808c6860d7d2599c Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-621328605 Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerAddressesNegativeTestJSON-621328605-project Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 891dec8f8be64fad8c8e967d8327dda5 Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-621328605-project Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 999 could not be found. Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'server_id': '999'} Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 29 03:05:27.409150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:05:27.412550 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f4094548-0c26-438c-b8ba-0d13dc993a30 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Returning 404 to user: Instance 999 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:27.412550 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f4094548-0c26-438c-b8ba-0d13dc993a30 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] 10.222.0.46 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.011380 Oct 29 03:05:27.415382 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1906/3996] 10.222.0.46 () {58 vars in 1149 bytes} [Sat Oct 29 03:05:27 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:05:27.423225 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1a4b70f8-8800-4b74-9931-20793ad26fbe tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:27.423821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1a4b70f8-8800-4b74-9931-20793ad26fbe tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] [instance: 5e78b6cd-1c9a-45f3-9e2c-791e01457a27] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:27.448985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:27.454936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1a4b70f8-8800-4b74-9931-20793ad26fbe tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:27.456552 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1a4b70f8-8800-4b74-9931-20793ad26fbe tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:27.458932 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1a4b70f8-8800-4b74-9931-20793ad26fbe tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:27.460405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1a4b70f8-8800-4b74-9931-20793ad26fbe tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:27.463476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1a4b70f8-8800-4b74-9931-20793ad26fbe tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:27.465215 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1a4b70f8-8800-4b74-9931-20793ad26fbe tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:27.507166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1a4b70f8-8800-4b74-9931-20793ad26fbe tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] [instance: 5e78b6cd-1c9a-45f3-9e2c-791e01457a27] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:05:27.597097 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1a4b70f8-8800-4b74-9931-20793ad26fbe tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27" status: 204 len: 0 microversion: 2.1 time: 0.180304 Oct 29 03:05:27.610651 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f85fa76f-a2b6-4918-8ca0-78df1ffae4a9 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:27.612203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f85fa76f-a2b6-4918-8ca0-78df1ffae4a9 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] [instance: 5e78b6cd-1c9a-45f3-9e2c-791e01457a27] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:27.619035 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2091/3997] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:05:27 2022] DELETE /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:05:27.623364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f85fa76f-a2b6-4918-8ca0-78df1ffae4a9 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:27.624048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f85fa76f-a2b6-4918-8ca0-78df1ffae4a9 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:27.624813 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f85fa76f-a2b6-4918-8ca0-78df1ffae4a9 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:27.625720 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f85fa76f-a2b6-4918-8ca0-78df1ffae4a9 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:27.626334 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f85fa76f-a2b6-4918-8ca0-78df1ffae4a9 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:27.626911 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f85fa76f-a2b6-4918-8ca0-78df1ffae4a9 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:28.036372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f85fa76f-a2b6-4918-8ca0-78df1ffae4a9 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891dec8f8be64fad8c8e967d8327dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bba82857ca4c3f808c6860d7d2599c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:28.048847 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f85fa76f-a2b6-4918-8ca0-78df1ffae4a9 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] 10.222.0.46 "GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27" status: 200 len: 1526 microversion: 2.1 time: 0.444187 Oct 29 03:05:28.050474 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1907/3998] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:27 2022] GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27 => generated 1526 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:28.306100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1b2be873-9b43-4e72-839a-89c60aea0813 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:28.307794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1b2be873-9b43-4e72-839a-89c60aea0813 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:28.314449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b2be873-9b43-4e72-839a-89c60aea0813 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:28.314935 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b2be873-9b43-4e72-839a-89c60aea0813 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:28.315352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b2be873-9b43-4e72-839a-89c60aea0813 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:28.316048 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b2be873-9b43-4e72-839a-89c60aea0813 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:28.316495 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b2be873-9b43-4e72-839a-89c60aea0813 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:28.316996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b2be873-9b43-4e72-839a-89c60aea0813 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:29.019222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1b2be873-9b43-4e72-839a-89c60aea0813 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:29.080258 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-88cdc58f-1a49-4784-be72-bdbb8ea0ba4b tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:29.081446 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-88cdc58f-1a49-4784-be72-bdbb8ea0ba4b tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] [instance: 5e78b6cd-1c9a-45f3-9e2c-791e01457a27] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:29.088715 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1b2be873-9b43-4e72-839a-89c60aea0813 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1476 microversion: 2.1 time: 0.785940 Oct 29 03:05:29.094399 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2092/3999] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:28 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1476 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:29.106854 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88cdc58f-1a49-4784-be72-bdbb8ea0ba4b tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:29.114365 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88cdc58f-1a49-4784-be72-bdbb8ea0ba4b tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:29.114852 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88cdc58f-1a49-4784-be72-bdbb8ea0ba4b tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:29.115658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88cdc58f-1a49-4784-be72-bdbb8ea0ba4b tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:29.116077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88cdc58f-1a49-4784-be72-bdbb8ea0ba4b tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:29.116506 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88cdc58f-1a49-4784-be72-bdbb8ea0ba4b tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:29.516044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-88cdc58f-1a49-4784-be72-bdbb8ea0ba4b tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891dec8f8be64fad8c8e967d8327dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bba82857ca4c3f808c6860d7d2599c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:29.531173 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-88cdc58f-1a49-4784-be72-bdbb8ea0ba4b tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] 10.222.0.46 "GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27" status: 200 len: 1526 microversion: 2.1 time: 0.462237 Oct 29 03:05:29.533204 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1908/4000] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:29 2022] GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27 => generated 1526 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:05:30.118336 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-659b691a-8737-4291-8d76-c3050740d594 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:30.119674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-659b691a-8737-4291-8d76-c3050740d594 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:30.135655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-659b691a-8737-4291-8d76-c3050740d594 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:30.136394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-659b691a-8737-4291-8d76-c3050740d594 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:30.137019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-659b691a-8737-4291-8d76-c3050740d594 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:30.138393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-659b691a-8737-4291-8d76-c3050740d594 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:30.139775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-659b691a-8737-4291-8d76-c3050740d594 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:30.141633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-659b691a-8737-4291-8d76-c3050740d594 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:30.559148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f97a3434-bf11-4d7a-9a35-af58207c2f21 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:30.560758 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f97a3434-bf11-4d7a-9a35-af58207c2f21 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] [instance: 5e78b6cd-1c9a-45f3-9e2c-791e01457a27] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:30.577385 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f97a3434-bf11-4d7a-9a35-af58207c2f21 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:30.578508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f97a3434-bf11-4d7a-9a35-af58207c2f21 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:30.583837 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f97a3434-bf11-4d7a-9a35-af58207c2f21 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:30.584831 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f97a3434-bf11-4d7a-9a35-af58207c2f21 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:30.588050 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f97a3434-bf11-4d7a-9a35-af58207c2f21 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:30.595763 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f97a3434-bf11-4d7a-9a35-af58207c2f21 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:31.122786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f97a3434-bf11-4d7a-9a35-af58207c2f21 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891dec8f8be64fad8c8e967d8327dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bba82857ca4c3f808c6860d7d2599c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:31.146333 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f97a3434-bf11-4d7a-9a35-af58207c2f21 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] 10.222.0.46 "GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27" status: 200 len: 1526 microversion: 2.1 time: 0.591017 Oct 29 03:05:31.156989 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1909/4001] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:30 2022] GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27 => generated 1526 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:05:31.824083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-659b691a-8737-4291-8d76-c3050740d594 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:31.840588 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-659b691a-8737-4291-8d76-c3050740d594 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1474 microversion: 2.1 time: 1.726729 Oct 29 03:05:31.843670 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2093/4002] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:30 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1474 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:32.153722 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-29b0fd5b-b995-43ab-ac9d-1b10d421cb42 req-a4854f39-04ba-465d-bd57-f0b21e31a0f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e78b6cd-1c9a-45f3-9e2c-791e01457a27", "name": "network-vif-deleted", "tag": "c219da66-3863-41dd-a717-6128649f484b"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:32.176373 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3fe79ff1-89ea-4080-b5fa-786602826764 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:32.177349 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3fe79ff1-89ea-4080-b5fa-786602826764 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] [instance: 5e78b6cd-1c9a-45f3-9e2c-791e01457a27] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:32.197750 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-29b0fd5b-b995-43ab-ac9d-1b10d421cb42 req-a4854f39-04ba-465d-bd57-f0b21e31a0f5 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:32.198254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-29b0fd5b-b995-43ab-ac9d-1b10d421cb42 req-a4854f39-04ba-465d-bd57-f0b21e31a0f5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:32.198695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-29b0fd5b-b995-43ab-ac9d-1b10d421cb42 req-a4854f39-04ba-465d-bd57-f0b21e31a0f5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:32.212988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3fe79ff1-89ea-4080-b5fa-786602826764 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:32.212988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3fe79ff1-89ea-4080-b5fa-786602826764 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:32.212988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3fe79ff1-89ea-4080-b5fa-786602826764 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:32.212988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3fe79ff1-89ea-4080-b5fa-786602826764 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:32.212988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3fe79ff1-89ea-4080-b5fa-786602826764 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:32.212988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3fe79ff1-89ea-4080-b5fa-786602826764 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:32.250031 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-29b0fd5b-b995-43ab-ac9d-1b10d421cb42 req-a4854f39-04ba-465d-bd57-f0b21e31a0f5 service nova] Creating event network-vif-deleted:c219da66-3863-41dd-a717-6128649f484b for instance 5e78b6cd-1c9a-45f3-9e2c-791e01457a27 on n-h2-862967-2 Oct 29 03:05:32.278561 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-29b0fd5b-b995-43ab-ac9d-1b10d421cb42 req-a4854f39-04ba-465d-bd57-f0b21e31a0f5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132415 Oct 29 03:05:32.285585 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1910/4003] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:32.293545 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-00ecb3ce-e78e-4ebc-b69f-2a030f371a67 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:32.301198 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-00ecb3ce-e78e-4ebc-b69f-2a030f371a67 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:32.323137 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00ecb3ce-e78e-4ebc-b69f-2a030f371a67 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:32.325371 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00ecb3ce-e78e-4ebc-b69f-2a030f371a67 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:32.331588 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00ecb3ce-e78e-4ebc-b69f-2a030f371a67 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:32.332493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00ecb3ce-e78e-4ebc-b69f-2a030f371a67 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:32.333314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00ecb3ce-e78e-4ebc-b69f-2a030f371a67 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:32.333773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00ecb3ce-e78e-4ebc-b69f-2a030f371a67 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:32.432607 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-00ecb3ce-e78e-4ebc-b69f-2a030f371a67 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.144998 Oct 29 03:05:32.434343 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3fe79ff1-89ea-4080-b5fa-786602826764 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '891dec8f8be64fad8c8e967d8327dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bba82857ca4c3f808c6860d7d2599c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:32.441211 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1911/4004] 10.222.0.46 () {60 vars in 1343 bytes} [Sat Oct 29 03:05:32 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7/os-volume_attachments => generated 25 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:32.461360 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3fe79ff1-89ea-4080-b5fa-786602826764 tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] 10.222.0.46 "GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27" status: 200 len: 1484 microversion: 2.1 time: 0.289884 Oct 29 03:05:32.462971 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2094/4005] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:32 2022] GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27 => generated 1484 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:05:32.637784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8422f223-3cb2-4699-bdd4-6cab9d85fd9c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:32.638650 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8422f223-3cb2-4699-bdd4-6cab9d85fd9c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:32.649000 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8422f223-3cb2-4699-bdd4-6cab9d85fd9c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:32.650581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8422f223-3cb2-4699-bdd4-6cab9d85fd9c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:32.651982 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8422f223-3cb2-4699-bdd4-6cab9d85fd9c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:32.664859 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8422f223-3cb2-4699-bdd4-6cab9d85fd9c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:32.665667 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8422f223-3cb2-4699-bdd4-6cab9d85fd9c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:32.674045 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8422f223-3cb2-4699-bdd4-6cab9d85fd9c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:32.737223 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8422f223-3cb2-4699-bdd4-6cab9d85fd9c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:05:32.873488 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-959ebf81-e1de-4fe6-80dc-c269992e52c3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:32.874418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-959ebf81-e1de-4fe6-80dc-c269992e52c3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:32.902584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-959ebf81-e1de-4fe6-80dc-c269992e52c3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:32.904049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-959ebf81-e1de-4fe6-80dc-c269992e52c3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:32.905097 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-959ebf81-e1de-4fe6-80dc-c269992e52c3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:32.912807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-959ebf81-e1de-4fe6-80dc-c269992e52c3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:32.913691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-959ebf81-e1de-4fe6-80dc-c269992e52c3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:32.914558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-959ebf81-e1de-4fe6-80dc-c269992e52c3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:32.959074 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8422f223-3cb2-4699-bdd4-6cab9d85fd9c tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "DELETE /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 204 len: 0 microversion: 2.20 time: 0.325185 Oct 29 03:05:32.962565 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1912/4006] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Oct 29 03:05:32 2022] DELETE /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:05:32.981496 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d497d4b2-f83e-4cc3-9874-694a3af458b1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:32.982540 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d497d4b2-f83e-4cc3-9874-694a3af458b1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:33.003246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d497d4b2-f83e-4cc3-9874-694a3af458b1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:33.005810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d497d4b2-f83e-4cc3-9874-694a3af458b1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:33.006544 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d497d4b2-f83e-4cc3-9874-694a3af458b1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:33.007519 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d497d4b2-f83e-4cc3-9874-694a3af458b1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:33.010775 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d497d4b2-f83e-4cc3-9874-694a3af458b1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:33.011287 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d497d4b2-f83e-4cc3-9874-694a3af458b1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:33.369985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-959ebf81-e1de-4fe6-80dc-c269992e52c3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:33.382438 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-959ebf81-e1de-4fe6-80dc-c269992e52c3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1471 microversion: 2.1 time: 0.516925 Oct 29 03:05:33.385616 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2095/4007] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:32 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1471 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:33.436087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ca2aa57e-17d5-4f1c-bb96-8c6778bcdd82 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:33.437613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ca2aa57e-17d5-4f1c-bb96-8c6778bcdd82 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:33.453633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca2aa57e-17d5-4f1c-bb96-8c6778bcdd82 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:33.456172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca2aa57e-17d5-4f1c-bb96-8c6778bcdd82 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:33.457495 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca2aa57e-17d5-4f1c-bb96-8c6778bcdd82 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:33.458590 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca2aa57e-17d5-4f1c-bb96-8c6778bcdd82 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:33.459929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca2aa57e-17d5-4f1c-bb96-8c6778bcdd82 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:33.461056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca2aa57e-17d5-4f1c-bb96-8c6778bcdd82 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:33.558194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:33.689517 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ca2aa57e-17d5-4f1c-bb96-8c6778bcdd82 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "POST /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec/action" status: 204 len: 0 microversion: 2.1 time: 0.282833 Oct 29 03:05:33.690267 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2096/4008] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:05:33 2022] POST /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec/action => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 03:05:33.709916 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-072fd25a-fee1-4c56-a25f-4030d5deacfb tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:33.710767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-072fd25a-fee1-4c56-a25f-4030d5deacfb tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] [instance: 5e78b6cd-1c9a-45f3-9e2c-791e01457a27] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:33.725353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-072fd25a-fee1-4c56-a25f-4030d5deacfb tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:33.725893 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-072fd25a-fee1-4c56-a25f-4030d5deacfb tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:33.726417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-072fd25a-fee1-4c56-a25f-4030d5deacfb tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:33.727191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-072fd25a-fee1-4c56-a25f-4030d5deacfb tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:33.727692 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-072fd25a-fee1-4c56-a25f-4030d5deacfb tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:33.728297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-072fd25a-fee1-4c56-a25f-4030d5deacfb tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:33.752572 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-072fd25a-fee1-4c56-a25f-4030d5deacfb tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] HTTP exception thrown: Instance 5e78b6cd-1c9a-45f3-9e2c-791e01457a27 could not be found. Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-072fd25a-fee1-4c56-a25f-4030d5deacfb tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Request method failure captured: Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27 HTTP/1.1 Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJhbIoGWF929aDnKQ9UCd3Q5RELktrXuoS9kXVU-0CFn6PnZVQbFyDB8MBGoiPhmjjtq9R7hH6cUwJxPfO7nQT4SBTAkUTSVshZAUhw4ULwvkZGRD357FnyXsRSrwHkDy3HW4YD4JFtnFgPi5SN-qLPRbg94rOwYHfOzaR2Bp7b9Ar0 Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: a1bba82857ca4c3f808c6860d7d2599c Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-621328605 Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a1bba82857ca4c3f808c6860d7d2599c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a1bba82857ca4c3f808c6860d7d2599c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a1bba82857ca4c3f808c6860d7d2599c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a1bba82857ca4c3f808c6860d7d2599c"}]}] Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-621328605 Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: a1bba82857ca4c3f808c6860d7d2599c Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-621328605 Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServerAddressesNegativeTestJSON-621328605-project Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 891dec8f8be64fad8c8e967d8327dda5 Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-621328605-project Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 5e78b6cd-1c9a-45f3-9e2c-791e01457a27 could not be found. Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '5e78b6cd-1c9a-45f3-9e2c-791e01457a27'} Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e78b6cd-1c9a-45f3-9e2c-791e01457a27 could not be found. Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e78b6cd-1c9a-45f3-9e2c-791e01457a27 could not be found. Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:33.756690 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:33.763529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:33.763529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:33.763529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:33.763529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:33.763529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:33.763529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:33.763529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e78b6cd-1c9a-45f3-9e2c-791e01457a27 could not be found. Oct 29 03:05:33.763529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:33.763529 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-072fd25a-fee1-4c56-a25f-4030d5deacfb tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] Returning 404 to user: Instance 5e78b6cd-1c9a-45f3-9e2c-791e01457a27 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:33.763529 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-072fd25a-fee1-4c56-a25f-4030d5deacfb tempest-ServerAddressesNegativeTestJSON-621328605 tempest-ServerAddressesNegativeTestJSON-621328605-project] 10.222.0.46 "GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27" status: 404 len: 111 microversion: 2.1 time: 0.062451 Oct 29 03:05:33.764859 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2097/4009] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:33 2022] GET /compute/v2.1/servers/5e78b6cd-1c9a-45f3-9e2c-791e01457a27 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:05:33.774827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7def123a-280f-4e90-92be-65c8d3fbb941 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:33.779690 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7def123a-280f-4e90-92be-65c8d3fbb941 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:33.800392 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7def123a-280f-4e90-92be-65c8d3fbb941 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:33.803013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7def123a-280f-4e90-92be-65c8d3fbb941 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:33.803886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7def123a-280f-4e90-92be-65c8d3fbb941 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:33.805298 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7def123a-280f-4e90-92be-65c8d3fbb941 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:33.806757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7def123a-280f-4e90-92be-65c8d3fbb941 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:33.808948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7def123a-280f-4e90-92be-65c8d3fbb941 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:33.827321 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d497d4b2-f83e-4cc3-9874-694a3af458b1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:33.863501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d497d4b2-f83e-4cc3-9874-694a3af458b1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:33.865936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d497d4b2-f83e-4cc3-9874-694a3af458b1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:33.876771 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d497d4b2-f83e-4cc3-9874-694a3af458b1 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1724 microversion: 2.20 time: 0.908889 Oct 29 03:05:33.878244 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1913/4010] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:32 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1724 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:34.425878 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7def123a-280f-4e90-92be-65c8d3fbb941 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:34.436462 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7def123a-280f-4e90-92be-65c8d3fbb941 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1471 microversion: 2.1 time: 0.671410 Oct 29 03:05:34.437123 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2098/4011] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:33 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1471 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:34.915655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-698c95dd-bd3e-4c1c-9393-8f1733bf6e1e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:34.917469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-698c95dd-bd3e-4c1c-9393-8f1733bf6e1e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:34.935219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-698c95dd-bd3e-4c1c-9393-8f1733bf6e1e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:34.935957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-698c95dd-bd3e-4c1c-9393-8f1733bf6e1e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:34.936454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-698c95dd-bd3e-4c1c-9393-8f1733bf6e1e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:34.941216 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-698c95dd-bd3e-4c1c-9393-8f1733bf6e1e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:34.942687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-698c95dd-bd3e-4c1c-9393-8f1733bf6e1e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:34.943637 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-698c95dd-bd3e-4c1c-9393-8f1733bf6e1e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:35.175838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0e1d9f30-3dcf-4e8f-8b81-58401ca01190 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:35.177189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0e1d9f30-3dcf-4e8f-8b81-58401ca01190 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:35.213602 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0e1d9f30-3dcf-4e8f-8b81-58401ca01190 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:35.215137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0e1d9f30-3dcf-4e8f-8b81-58401ca01190 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:35.218844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0e1d9f30-3dcf-4e8f-8b81-58401ca01190 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:35.221563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0e1d9f30-3dcf-4e8f-8b81-58401ca01190 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:35.222496 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0e1d9f30-3dcf-4e8f-8b81-58401ca01190 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:35.223039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0e1d9f30-3dcf-4e8f-8b81-58401ca01190 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:35.250595 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-0e1d9f30-3dcf-4e8f-8b81-58401ca01190 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] HTTP exception thrown: Instance c72534eb-1844-4208-b625-ea8b5ece8108 could not be found. Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0e1d9f30-3dcf-4e8f-8b81-58401ca01190 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Request method failure captured: Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 HTTP/1.1 Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJbGrBkH4jsdY4BExcRbpLhwD_CPN9zYv6OuCa6_MUUrfQGkhV7FER3qGnbgrwKfABkBF1yDZRhjmSMEPCgoMbVFe3t6Jt-VeibiOt6WLpG4u_zCC07lp12flvGPtcliZ59LkyWYLi02XVYIuDklDNALo7MKoY-QALwTsCK81cWi1yg Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: X-Openstack-Nova-Api-Version: 2.32 Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 908b0840bf614aaa9f07757baaeb950b Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-TaggedBootDevicesTest-948370209 Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/908b0840bf614aaa9f07757baaeb950b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/908b0840bf614aaa9f07757baaeb950b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_908b0840bf614aaa9f07757baaeb950b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/908b0840bf614aaa9f07757baaeb950b"}]}] Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-TaggedBootDevicesTest-948370209 Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 908b0840bf614aaa9f07757baaeb950b Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-TaggedBootDevicesTest-948370209 Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-TaggedBootDevicesTest-948370209-project Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: f2230efa6fc74ba0ad51fc648835a035 Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-TaggedBootDevicesTest-948370209-project Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance c72534eb-1844-4208-b625-ea8b5ece8108 could not be found. Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'c72534eb-1844-4208-b625-ea8b5ece8108'} Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c72534eb-1844-4208-b625-ea8b5ece8108 could not be found. Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:35.262141 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:35.265775 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c72534eb-1844-4208-b625-ea8b5ece8108 could not be found. Oct 29 03:05:35.265775 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:35.265775 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:35.265775 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:35.265775 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:35.265775 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:35.265775 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:35.265775 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:35.265775 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:35.265775 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c72534eb-1844-4208-b625-ea8b5ece8108 could not be found. Oct 29 03:05:35.265775 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:35.269346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0e1d9f30-3dcf-4e8f-8b81-58401ca01190 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Returning 404 to user: Instance c72534eb-1844-4208-b625-ea8b5ece8108 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:35.273610 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0e1d9f30-3dcf-4e8f-8b81-58401ca01190 tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 404 len: 111 microversion: 2.32 time: 0.101887 Oct 29 03:05:35.276213 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2099/4012] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Oct 29 03:05:35 2022] DELETE /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 29 03:05:35.286955 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ca5f6e20-934c-4b49-b13b-28d3f570812e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:35.288241 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ca5f6e20-934c-4b49-b13b-28d3f570812e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] [instance: c72534eb-1844-4208-b625-ea8b5ece8108] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:35.303714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca5f6e20-934c-4b49-b13b-28d3f570812e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:35.305537 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca5f6e20-934c-4b49-b13b-28d3f570812e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:35.309068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca5f6e20-934c-4b49-b13b-28d3f570812e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:35.312261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca5f6e20-934c-4b49-b13b-28d3f570812e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:35.312985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca5f6e20-934c-4b49-b13b-28d3f570812e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:35.313587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca5f6e20-934c-4b49-b13b-28d3f570812e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:35.373258 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-ca5f6e20-934c-4b49-b13b-28d3f570812e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] HTTP exception thrown: Instance c72534eb-1844-4208-b625-ea8b5ece8108 could not be found. Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ca5f6e20-934c-4b49-b13b-28d3f570812e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Request method failure captured: Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 HTTP/1.1 Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJbGrBkH4jsdY4BExcRbpLhwD_CPN9zYv6OuCa6_MUUrfQGkhV7FER3qGnbgrwKfABkBF1yDZRhjmSMEPCgoMbVFe3t6Jt-VeibiOt6WLpG4u_zCC07lp12flvGPtcliZ59LkyWYLi02XVYIuDklDNALo7MKoY-QALwTsCK81cWi1yg Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: X-Openstack-Nova-Api-Version: 2.32 Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 908b0840bf614aaa9f07757baaeb950b Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-TaggedBootDevicesTest-948370209 Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/908b0840bf614aaa9f07757baaeb950b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/908b0840bf614aaa9f07757baaeb950b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_908b0840bf614aaa9f07757baaeb950b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/908b0840bf614aaa9f07757baaeb950b"}]}] Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-TaggedBootDevicesTest-948370209 Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 908b0840bf614aaa9f07757baaeb950b Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-TaggedBootDevicesTest-948370209 Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-TaggedBootDevicesTest-948370209-project Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: f2230efa6fc74ba0ad51fc648835a035 Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-TaggedBootDevicesTest-948370209-project Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance c72534eb-1844-4208-b625-ea8b5ece8108 could not be found. Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'c72534eb-1844-4208-b625-ea8b5ece8108'} Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c72534eb-1844-4208-b625-ea8b5ece8108 could not be found. Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c72534eb-1844-4208-b625-ea8b5ece8108 could not be found. Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:35.375113 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:35.384282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:35.384282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:35.384282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:35.384282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:35.384282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:35.384282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c72534eb-1844-4208-b625-ea8b5ece8108 could not be found. Oct 29 03:05:35.384282 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:35.384282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ca5f6e20-934c-4b49-b13b-28d3f570812e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] Returning 404 to user: Instance c72534eb-1844-4208-b625-ea8b5ece8108 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:35.384282 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ca5f6e20-934c-4b49-b13b-28d3f570812e tempest-TaggedBootDevicesTest-948370209 tempest-TaggedBootDevicesTest-948370209-project] 10.222.0.46 "GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108" status: 404 len: 111 microversion: 2.32 time: 0.096799 Oct 29 03:05:35.384282 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2100/4013] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:35 2022] GET /compute/v2.1/servers/c72534eb-1844-4208-b625-ea8b5ece8108 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:05:35.466198 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-51ad3723-379d-42c5-9d2f-3b02b505bce3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:35.471066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-51ad3723-379d-42c5-9d2f-3b02b505bce3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:35.496047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51ad3723-379d-42c5-9d2f-3b02b505bce3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:35.496852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51ad3723-379d-42c5-9d2f-3b02b505bce3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:35.499254 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51ad3723-379d-42c5-9d2f-3b02b505bce3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:35.502290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51ad3723-379d-42c5-9d2f-3b02b505bce3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:35.509190 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51ad3723-379d-42c5-9d2f-3b02b505bce3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:35.512326 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51ad3723-379d-42c5-9d2f-3b02b505bce3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:36.017350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-698c95dd-bd3e-4c1c-9393-8f1733bf6e1e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:36.054306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-698c95dd-bd3e-4c1c-9393-8f1733bf6e1e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:36.061123 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-698c95dd-bd3e-4c1c-9393-8f1733bf6e1e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:36.067837 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-698c95dd-bd3e-4c1c-9393-8f1733bf6e1e tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1724 microversion: 2.20 time: 1.160959 Oct 29 03:05:36.086850 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1914/4014] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:34 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1724 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:36.139360 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-219d92ca-1d35-4dc2-b332-fed10bc7a164 req-25f9a5d4-1041-4652-b1d3-5aebddf885b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34628535-7e50-432b-9baf-a1d9b841a1ec", "name": "network-vif-plugged", "status": "completed", "tag": "a2e09809-ccdf-450a-a30b-75e01aaa1eef"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:36.167178 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-219d92ca-1d35-4dc2-b332-fed10bc7a164 req-25f9a5d4-1041-4652-b1d3-5aebddf885b8 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:36.171338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-219d92ca-1d35-4dc2-b332-fed10bc7a164 req-25f9a5d4-1041-4652-b1d3-5aebddf885b8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:36.173268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-219d92ca-1d35-4dc2-b332-fed10bc7a164 req-25f9a5d4-1041-4652-b1d3-5aebddf885b8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:36.182684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:36.206948 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-219d92ca-1d35-4dc2-b332-fed10bc7a164 req-25f9a5d4-1041-4652-b1d3-5aebddf885b8 service nova] Creating event network-vif-plugged:a2e09809-ccdf-450a-a30b-75e01aaa1eef for instance 34628535-7e50-432b-9baf-a1d9b841a1ec on n-h2-862967-2 Oct 29 03:05:36.227127 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [req-219d92ca-1d35-4dc2-b332-fed10bc7a164 req-25f9a5d4-1041-4652-b1d3-5aebddf885b8 service nova] Instance 34628535-7e50-432b-9baf-a1d9b841a1ec is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:05:36.259895 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-219d92ca-1d35-4dc2-b332-fed10bc7a164 req-25f9a5d4-1041-4652-b1d3-5aebddf885b8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132275 Oct 29 03:05:36.261766 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1915/4015] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:05:37.143110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-32c8aa93-03d7-4817-b3ae-f5a07b75e153 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:37.145959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-32c8aa93-03d7-4817-b3ae-f5a07b75e153 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:37.171827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32c8aa93-03d7-4817-b3ae-f5a07b75e153 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:37.172332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32c8aa93-03d7-4817-b3ae-f5a07b75e153 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:37.176284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32c8aa93-03d7-4817-b3ae-f5a07b75e153 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:37.177484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32c8aa93-03d7-4817-b3ae-f5a07b75e153 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:37.177974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32c8aa93-03d7-4817-b3ae-f5a07b75e153 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:37.178420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32c8aa93-03d7-4817-b3ae-f5a07b75e153 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:37.324017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-51ad3723-379d-42c5-9d2f-3b02b505bce3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:37.338515 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-51ad3723-379d-42c5-9d2f-3b02b505bce3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1471 microversion: 2.1 time: 1.882949 Oct 29 03:05:37.342857 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2101/4016] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:35 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1471 bytes in 1888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:38.172114 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-32c8aa93-03d7-4817-b3ae-f5a07b75e153 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:38.197646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-32c8aa93-03d7-4817-b3ae-f5a07b75e153 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:38.203540 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-32c8aa93-03d7-4817-b3ae-f5a07b75e153 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:38.210474 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-32c8aa93-03d7-4817-b3ae-f5a07b75e153 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1724 microversion: 2.20 time: 1.091998 Oct 29 03:05:38.213223 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1916/4017] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:37 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1724 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:38.369165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-abeedd41-1850-4b98-ad20-94f8cf116a0e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:38.369797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-abeedd41-1850-4b98-ad20-94f8cf116a0e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:38.382174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abeedd41-1850-4b98-ad20-94f8cf116a0e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:38.382673 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abeedd41-1850-4b98-ad20-94f8cf116a0e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:38.383428 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abeedd41-1850-4b98-ad20-94f8cf116a0e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:38.390290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abeedd41-1850-4b98-ad20-94f8cf116a0e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:38.390790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abeedd41-1850-4b98-ad20-94f8cf116a0e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:38.391276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abeedd41-1850-4b98-ad20-94f8cf116a0e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:38.831475 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-abeedd41-1850-4b98-ad20-94f8cf116a0e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:38.863234 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-abeedd41-1850-4b98-ad20-94f8cf116a0e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1463 microversion: 2.1 time: 0.498052 Oct 29 03:05:38.864252 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2102/4018] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:38 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1463 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:38.888148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ee960619-93c0-4b06-ad47-2342babec5bb tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:38.889095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ee960619-93c0-4b06-ad47-2342babec5bb tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:38.896234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee960619-93c0-4b06-ad47-2342babec5bb tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:38.897002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee960619-93c0-4b06-ad47-2342babec5bb tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:38.897685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee960619-93c0-4b06-ad47-2342babec5bb tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:38.898735 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee960619-93c0-4b06-ad47-2342babec5bb tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:38.899391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee960619-93c0-4b06-ad47-2342babec5bb tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:38.899950 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee960619-93c0-4b06-ad47-2342babec5bb tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:39.244944 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3d200396-e096-430b-b6c6-e45bacde3221 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:39.245909 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3d200396-e096-430b-b6c6-e45bacde3221 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:39.275448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d200396-e096-430b-b6c6-e45bacde3221 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:39.275854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d200396-e096-430b-b6c6-e45bacde3221 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:39.297771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d200396-e096-430b-b6c6-e45bacde3221 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:39.298576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d200396-e096-430b-b6c6-e45bacde3221 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:39.299274 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d200396-e096-430b-b6c6-e45bacde3221 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:39.299897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d200396-e096-430b-b6c6-e45bacde3221 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:39.481364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3d200396-e096-430b-b6c6-e45bacde3221 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:39.493693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3d200396-e096-430b-b6c6-e45bacde3221 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:39.496091 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3d200396-e096-430b-b6c6-e45bacde3221 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:39.498901 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3d200396-e096-430b-b6c6-e45bacde3221 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1656 microversion: 2.20 time: 0.260838 Oct 29 03:05:39.511830 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2103/4019] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:39 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1656 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:39.906922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ee960619-93c0-4b06-ad47-2342babec5bb tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:39.916735 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ee960619-93c0-4b06-ad47-2342babec5bb tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1463 microversion: 2.1 time: 1.033497 Oct 29 03:05:39.917952 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1917/4020] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:38 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1463 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:39.947006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6ea06433-8bc6-4ee1-a082-40629d326dee tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Action: 'create', calling method: .version_select at 0x7ff058045c10>, body: {"keypair": {"name": "tempest-keypair-588545895", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9+qyQCC0uB22s6LCHQbdg+d92onElkcy2Nd+m4mCcGRBrk9b2bBD7v95On0QBv6okaCBC3EdbEi3M1LSjizve5unWAh6g0EHLHB7M9qX2OnDw4qZCPmbdGGf7P5uHYcQ=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:39.976954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-3e690558-0d55-45c7-b239-9fab4f4793f9 req-676f1395-32ae-4e8c-91f9-b4e735cb2e54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "354cb0c1-2737-486f-8e3b-d119c49a46a7", "name": "network-vif-deleted", "tag": "0e820bc1-bfed-42bc-8698-d91dc009de10"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:40.005391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3e690558-0d55-45c7-b239-9fab4f4793f9 req-676f1395-32ae-4e8c-91f9-b4e735cb2e54 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:40.006347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3e690558-0d55-45c7-b239-9fab4f4793f9 req-676f1395-32ae-4e8c-91f9-b4e735cb2e54 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:40.007601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3e690558-0d55-45c7-b239-9fab4f4793f9 req-676f1395-32ae-4e8c-91f9-b4e735cb2e54 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:40.013060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-6ea06433-8bc6-4ee1-a082-40629d326dee tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Getting quotas for project 830acea7f5b948409e4b69d02aaeaf3b. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:05:40.032727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-6ea06433-8bc6-4ee1-a082-40629d326dee tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Getting quotas for user 7d3a840b017844a7b45b98bea21e8e38 and project 830acea7f5b948409e4b69d02aaeaf3b. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:05:40.035612 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-3e690558-0d55-45c7-b239-9fab4f4793f9 req-676f1395-32ae-4e8c-91f9-b4e735cb2e54 service nova] Creating event network-vif-deleted:0e820bc1-bfed-42bc-8698-d91dc009de10 for instance 354cb0c1-2737-486f-8e3b-d119c49a46a7 on n-h1-862967-2 Oct 29 03:05:40.044953 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-3e690558-0d55-45c7-b239-9fab4f4793f9 req-676f1395-32ae-4e8c-91f9-b4e735cb2e54 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073762 Oct 29 03:05:40.047216 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1918/4021] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:05:40.073844 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6ea06433-8bc6-4ee1-a082-40629d326dee tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.132885 Oct 29 03:05:40.083217 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2104/4022] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:05:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:40.536192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-eb0f48e6-fc4d-41da-afed-d83cfd9b3c9a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:40.537444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-eb0f48e6-fc4d-41da-afed-d83cfd9b3c9a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:40.554663 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb0f48e6-fc4d-41da-afed-d83cfd9b3c9a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:40.555171 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb0f48e6-fc4d-41da-afed-d83cfd9b3c9a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:40.555605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb0f48e6-fc4d-41da-afed-d83cfd9b3c9a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:40.556854 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb0f48e6-fc4d-41da-afed-d83cfd9b3c9a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:40.568508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb0f48e6-fc4d-41da-afed-d83cfd9b3c9a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:40.571247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb0f48e6-fc4d-41da-afed-d83cfd9b3c9a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:40.645873 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb0f48e6-fc4d-41da-afed-d83cfd9b3c9a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:40.649420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb0f48e6-fc4d-41da-afed-d83cfd9b3c9a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:40.653284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb0f48e6-fc4d-41da-afed-d83cfd9b3c9a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:40.654915 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-eb0f48e6-fc4d-41da-afed-d83cfd9b3c9a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lazy-loading 'fault' on Instance uuid 354cb0c1-2737-486f-8e3b-d119c49a46a7 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:05:40.988601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-eb0f48e6-fc4d-41da-afed-d83cfd9b3c9a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:41.005840 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-eb0f48e6-fc4d-41da-afed-d83cfd9b3c9a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:41.007607 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-eb0f48e6-fc4d-41da-afed-d83cfd9b3c9a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4dbcac917fc6415683ae17b220276c91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746258dc83c74b9ba3634afbc2716d7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:41.011712 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-eb0f48e6-fc4d-41da-afed-d83cfd9b3c9a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 200 len: 1372 microversion: 2.20 time: 0.481967 Oct 29 03:05:41.012410 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1919/4023] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:40 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 1372 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:05:42.044759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-503d2ca7-9f33-4104-bc27-64bdbcbfa869 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:42.046661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-503d2ca7-9f33-4104-bc27-64bdbcbfa869 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:42.068702 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-503d2ca7-9f33-4104-bc27-64bdbcbfa869 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:42.069217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-503d2ca7-9f33-4104-bc27-64bdbcbfa869 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:42.069656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-503d2ca7-9f33-4104-bc27-64bdbcbfa869 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:42.070387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-503d2ca7-9f33-4104-bc27-64bdbcbfa869 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:42.071851 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-503d2ca7-9f33-4104-bc27-64bdbcbfa869 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:42.073027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-503d2ca7-9f33-4104-bc27-64bdbcbfa869 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:42.133710 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-503d2ca7-9f33-4104-bc27-64bdbcbfa869 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] HTTP exception thrown: Instance 354cb0c1-2737-486f-8e3b-d119c49a46a7 could not be found. Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-503d2ca7-9f33-4104-bc27-64bdbcbfa869 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Request method failure captured: Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 HTTP/1.1 Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJaJHSXj-jqWtpuO19W_zKp1iKYpA1BxBdNPSEMxYnt5c-nWuInn2vhByoiyD50ujDbOWsEZgXQWvn1TdiZKPWXgOO222e5DgFFL5-_ptnqVjJ04ZUyvB4BJC1Pm_vqIkFGDupuRaHR-jseufm1Kp1jX7ZqMA9hUVj92Fx4vSSIHYDA Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: X-Openstack-Nova-Api-Version: 2.20 Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 746258dc83c74b9ba3634afbc2716d7b Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2053223102 Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/746258dc83c74b9ba3634afbc2716d7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/746258dc83c74b9ba3634afbc2716d7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_746258dc83c74b9ba3634afbc2716d7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/746258dc83c74b9ba3634afbc2716d7b"}]}] Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2053223102 Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 746258dc83c74b9ba3634afbc2716d7b Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2053223102 Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-AttachVolumeShelveTestJSON-2053223102-project Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 4dbcac917fc6415683ae17b220276c91 Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2053223102-project Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 354cb0c1-2737-486f-8e3b-d119c49a46a7 could not be found. Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '354cb0c1-2737-486f-8e3b-d119c49a46a7'} Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 354cb0c1-2737-486f-8e3b-d119c49a46a7 could not be found. Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 354cb0c1-2737-486f-8e3b-d119c49a46a7 could not be found. Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:42.135527 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:42.139863 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:42.139863 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:42.139863 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:42.139863 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:42.139863 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:42.139863 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:42.139863 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 354cb0c1-2737-486f-8e3b-d119c49a46a7 could not be found. Oct 29 03:05:42.139863 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:42.141392 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-503d2ca7-9f33-4104-bc27-64bdbcbfa869 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Returning 404 to user: Instance 354cb0c1-2737-486f-8e3b-d119c49a46a7 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:42.142412 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-503d2ca7-9f33-4104-bc27-64bdbcbfa869 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 404 len: 111 microversion: 2.20 time: 0.102949 Oct 29 03:05:42.143134 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2105/4024] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:42 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:05:42.152788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e9b328eb-2215-42bb-aeb3-e56311d95c01 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '.version_select at 0x7ff0538de040>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:42.188721 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e9b328eb-2215-42bb-aeb3-e56311d95c01 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1900859268" status: 204 len: 0 microversion: 2.20 time: 0.039833 Oct 29 03:05:42.189818 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1920/4025] 10.222.0.46 () {60 vars in 1262 bytes} [Sat Oct 29 03:05:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1900859268 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:05:47.477721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e96b23d4-648f-4bc7-94f3-6233c9551e99 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Calling method '.version_select at 0x7ff0580ad1f0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:47.486467 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e96b23d4-648f-4bc7-94f3-6233c9551e99 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:47.487063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e96b23d4-648f-4bc7-94f3-6233c9551e99 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:47.489777 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e96b23d4-648f-4bc7-94f3-6233c9551e99 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:47.511248 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e96b23d4-648f-4bc7-94f3-6233c9551e99 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] 10.222.0.46 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.040386 Oct 29 03:05:47.524383 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2106/4026] 10.222.0.46 () {58 vars in 1143 bytes} [Sat Oct 29 03:05:47 2022] GET /compute/v2.1/os-migrations => generated 803 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:47.539305 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-515ba5ce-bae0-4dbb-9692-062b4c0fc465 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:47.569686 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-515ba5ce-bae0-4dbb-9692-062b4c0fc465 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035917 Oct 29 03:05:47.573290 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1921/4027] 10.222.0.46 () {58 vars in 1137 bytes} [Sat Oct 29 03:05:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:47.592449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-75bd3533-7fbb-46cc-8d3a-d7df23faae32 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-930221054", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:47.642615 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-75bd3533-7fbb-46cc-8d3a-d7df23faae32 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.052621 Oct 29 03:05:47.645274 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2107/4028] 10.222.0.46 () {60 vars in 1146 bytes} [Sat Oct 29 03:05:47 2022] POST /compute/v2.1/flavors => generated 498 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:47.667453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8751ffb2-1b1a-42a6-b281-960c29d6dc2c tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:47.687933 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8751ffb2-1b1a-42a6-b281-960c29d6dc2c tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.020888 Oct 29 03:05:47.689011 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1922/4029] 10.222.0.46 () {58 vars in 1182 bytes} [Sat Oct 29 03:05:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 03:05:47.925453 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-85ab9db4-7213-48c2-b5e6-bfe2a6017163 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1900379920", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "c9f63f65-d539-4d65-a6f9-d6f0ebe08502"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:05:48.061418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-85ab9db4-7213-48c2-b5e6-bfe2a6017163 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] validate_networks() for None {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:05:48.986884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-85ab9db4-7213-48c2-b5e6-bfe2a6017163 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:05:48.987636 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-85ab9db4-7213-48c2-b5e6-bfe2a6017163 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:05:48.987876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-85ab9db4-7213-48c2-b5e6-bfe2a6017163 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:05:48.988836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-85ab9db4-7213-48c2-b5e6-bfe2a6017163 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:05:48.989656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-85ab9db4-7213-48c2-b5e6-bfe2a6017163 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:05:49.021593 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-85ab9db4-7213-48c2-b5e6-bfe2a6017163 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:49.022414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-85ab9db4-7213-48c2-b5e6-bfe2a6017163 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:49.023186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-85ab9db4-7213-48c2-b5e6-bfe2a6017163 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:49.024400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-85ab9db4-7213-48c2-b5e6-bfe2a6017163 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:49.025266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-85ab9db4-7213-48c2-b5e6-bfe2a6017163 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:49.025853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-85ab9db4-7213-48c2-b5e6-bfe2a6017163 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:49.089151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-85ab9db4-7213-48c2-b5e6-bfe2a6017163 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Getting quotas for project 830acea7f5b948409e4b69d02aaeaf3b. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:05:49.096668 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-85ab9db4-7213-48c2-b5e6-bfe2a6017163 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Getting quotas for user 7d3a840b017844a7b45b98bea21e8e38 and project 830acea7f5b948409e4b69d02aaeaf3b. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:05:49.135605 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-85ab9db4-7213-48c2-b5e6-bfe2a6017163 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:05:49.144559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-85ab9db4-7213-48c2-b5e6-bfe2a6017163 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:05:49.278590 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-85ab9db4-7213-48c2-b5e6-bfe2a6017163 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.357899 Oct 29 03:05:49.280301 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2108/4030] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:05:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:05:49.292194 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4dbce25d-4606-4276-a720-2680224eace9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:49.293038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4dbce25d-4606-4276-a720-2680224eace9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:49.637919 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4dbce25d-4606-4276-a720-2680224eace9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:49.652114 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4dbce25d-4606-4276-a720-2680224eace9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1279 microversion: 2.1 time: 0.360544 Oct 29 03:05:49.656540 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1923/4031] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:49 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1279 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:50.683644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5485b1a7-e5eb-4818-8bfc-b60304fef8e3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:50.684302 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5485b1a7-e5eb-4818-8bfc-b60304fef8e3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:50.713950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5485b1a7-e5eb-4818-8bfc-b60304fef8e3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:50.714456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5485b1a7-e5eb-4818-8bfc-b60304fef8e3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:50.715557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5485b1a7-e5eb-4818-8bfc-b60304fef8e3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:50.720728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5485b1a7-e5eb-4818-8bfc-b60304fef8e3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:50.721572 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5485b1a7-e5eb-4818-8bfc-b60304fef8e3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:50.741455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5485b1a7-e5eb-4818-8bfc-b60304fef8e3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:51.301841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5485b1a7-e5eb-4818-8bfc-b60304fef8e3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:51.323371 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5485b1a7-e5eb-4818-8bfc-b60304fef8e3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1275 microversion: 2.1 time: 0.643814 Oct 29 03:05:51.329614 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2109/4032] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:50 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1275 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:51.444663 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-eaa4c515-4478-4786-8b4a-c1468e817f23 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:51.445866 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-eaa4c515-4478-4786-8b4a-c1468e817f23 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:51.466490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=24 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:51.472370 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eaa4c515-4478-4786-8b4a-c1468e817f23 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:51.480002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eaa4c515-4478-4786-8b4a-c1468e817f23 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:51.480760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eaa4c515-4478-4786-8b4a-c1468e817f23 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:51.484907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eaa4c515-4478-4786-8b4a-c1468e817f23 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:51.485725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eaa4c515-4478-4786-8b4a-c1468e817f23 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:51.486358 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eaa4c515-4478-4786-8b4a-c1468e817f23 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:51.551862 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-eaa4c515-4478-4786-8b4a-c1468e817f23 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] HTTP exception thrown: Instance 354cb0c1-2737-486f-8e3b-d119c49a46a7 could not be found. Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-eaa4c515-4478-4786-8b4a-c1468e817f23 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Request method failure captured: Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 HTTP/1.1 Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJaJHSXj-jqWtpuO19W_zKp1iKYpA1BxBdNPSEMxYnt5c-nWuInn2vhByoiyD50ujDbOWsEZgXQWvn1TdiZKPWXgOO222e5DgFFL5-_ptnqVjJ04ZUyvB4BJC1Pm_vqIkFGDupuRaHR-jseufm1Kp1jX7ZqMA9hUVj92Fx4vSSIHYDA Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: X-Openstack-Nova-Api-Version: 2.20 Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 746258dc83c74b9ba3634afbc2716d7b Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2053223102 Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/746258dc83c74b9ba3634afbc2716d7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/746258dc83c74b9ba3634afbc2716d7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_746258dc83c74b9ba3634afbc2716d7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/746258dc83c74b9ba3634afbc2716d7b"}]}] Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2053223102 Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 746258dc83c74b9ba3634afbc2716d7b Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2053223102 Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-AttachVolumeShelveTestJSON-2053223102-project Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 4dbcac917fc6415683ae17b220276c91 Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2053223102-project Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 354cb0c1-2737-486f-8e3b-d119c49a46a7 could not be found. Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '354cb0c1-2737-486f-8e3b-d119c49a46a7'} Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 354cb0c1-2737-486f-8e3b-d119c49a46a7 could not be found. Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:51.562840 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:51.566435 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 354cb0c1-2737-486f-8e3b-d119c49a46a7 could not be found. Oct 29 03:05:51.566435 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:05:51.566435 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:51.566435 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:05:51.566435 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:51.566435 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:51.566435 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:51.566435 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:51.566435 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:51.566435 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 354cb0c1-2737-486f-8e3b-d119c49a46a7 could not be found. Oct 29 03:05:51.566435 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:05:51.572800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-eaa4c515-4478-4786-8b4a-c1468e817f23 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Returning 404 to user: Instance 354cb0c1-2737-486f-8e3b-d119c49a46a7 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:51.575714 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-eaa4c515-4478-4786-8b4a-c1468e817f23 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "DELETE /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 404 len: 111 microversion: 2.20 time: 0.138349 Oct 29 03:05:51.578164 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1924/4033] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Oct 29 03:05:51 2022] DELETE /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:05:51.588768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-95d0d5ee-6eeb-46d2-8f02-5cb675b228d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:51.589544 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-95d0d5ee-6eeb-46d2-8f02-5cb675b228d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 354cb0c1-2737-486f-8e3b-d119c49a46a7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:51.618287 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95d0d5ee-6eeb-46d2-8f02-5cb675b228d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:51.621751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95d0d5ee-6eeb-46d2-8f02-5cb675b228d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:51.625971 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95d0d5ee-6eeb-46d2-8f02-5cb675b228d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:51.634139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95d0d5ee-6eeb-46d2-8f02-5cb675b228d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:51.635330 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95d0d5ee-6eeb-46d2-8f02-5cb675b228d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:51.639958 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95d0d5ee-6eeb-46d2-8f02-5cb675b228d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:51.698104 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-95d0d5ee-6eeb-46d2-8f02-5cb675b228d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] HTTP exception thrown: Instance 354cb0c1-2737-486f-8e3b-d119c49a46a7 could not be found. Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-95d0d5ee-6eeb-46d2-8f02-5cb675b228d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Request method failure captured: Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 HTTP/1.1 Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJaJHSXj-jqWtpuO19W_zKp1iKYpA1BxBdNPSEMxYnt5c-nWuInn2vhByoiyD50ujDbOWsEZgXQWvn1TdiZKPWXgOO222e5DgFFL5-_ptnqVjJ04ZUyvB4BJC1Pm_vqIkFGDupuRaHR-jseufm1Kp1jX7ZqMA9hUVj92Fx4vSSIHYDA Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: X-Openstack-Nova-Api-Version: 2.20 Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 746258dc83c74b9ba3634afbc2716d7b Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2053223102 Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/746258dc83c74b9ba3634afbc2716d7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/746258dc83c74b9ba3634afbc2716d7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_746258dc83c74b9ba3634afbc2716d7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/746258dc83c74b9ba3634afbc2716d7b"}]}] Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2053223102 Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 746258dc83c74b9ba3634afbc2716d7b Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2053223102 Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-AttachVolumeShelveTestJSON-2053223102-project Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 4dbcac917fc6415683ae17b220276c91 Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2053223102-project Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 354cb0c1-2737-486f-8e3b-d119c49a46a7 could not be found. Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '354cb0c1-2737-486f-8e3b-d119c49a46a7'} Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 354cb0c1-2737-486f-8e3b-d119c49a46a7 could not be found. Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 354cb0c1-2737-486f-8e3b-d119c49a46a7 could not be found. Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:51.703195 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:05:51.707562 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:51.707562 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:05:51.707562 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:05:51.707562 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:05:51.707562 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:05:51.707562 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:05:51.707562 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 354cb0c1-2737-486f-8e3b-d119c49a46a7 could not be found. Oct 29 03:05:51.707562 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:05:51.707562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-95d0d5ee-6eeb-46d2-8f02-5cb675b228d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Returning 404 to user: Instance 354cb0c1-2737-486f-8e3b-d119c49a46a7 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:05:51.712635 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-95d0d5ee-6eeb-46d2-8f02-5cb675b228d6 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7" status: 404 len: 111 microversion: 2.20 time: 0.121289 Oct 29 03:05:51.716393 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2110/4034] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:05:51 2022] GET /compute/v2.1/servers/354cb0c1-2737-486f-8e3b-d119c49a46a7 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:05:52.364309 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e88de669-e5b4-44ea-8238-056fcac24c74 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:52.366148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e88de669-e5b4-44ea-8238-056fcac24c74 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:52.381289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e88de669-e5b4-44ea-8238-056fcac24c74 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:52.383757 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e88de669-e5b4-44ea-8238-056fcac24c74 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:52.385345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e88de669-e5b4-44ea-8238-056fcac24c74 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:52.389581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e88de669-e5b4-44ea-8238-056fcac24c74 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:52.391232 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e88de669-e5b4-44ea-8238-056fcac24c74 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:52.409761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e88de669-e5b4-44ea-8238-056fcac24c74 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:52.569287 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e88de669-e5b4-44ea-8238-056fcac24c74 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:52.595055 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e88de669-e5b4-44ea-8238-056fcac24c74 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1337 microversion: 2.1 time: 0.232420 Oct 29 03:05:52.599606 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1925/4035] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:52 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1337 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:53.622788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-af4417f2-4721-472f-93b6-192be1a0b7fb tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:53.623393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-af4417f2-4721-472f-93b6-192be1a0b7fb tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:53.643898 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af4417f2-4721-472f-93b6-192be1a0b7fb tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:53.644405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af4417f2-4721-472f-93b6-192be1a0b7fb tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:53.644878 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af4417f2-4721-472f-93b6-192be1a0b7fb tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:53.646074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af4417f2-4721-472f-93b6-192be1a0b7fb tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:53.646554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af4417f2-4721-472f-93b6-192be1a0b7fb tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:53.646990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af4417f2-4721-472f-93b6-192be1a0b7fb tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:54.228861 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-af4417f2-4721-472f-93b6-192be1a0b7fb tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:54.245857 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-af4417f2-4721-472f-93b6-192be1a0b7fb tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1337 microversion: 2.1 time: 0.627088 Oct 29 03:05:54.252038 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2111/4036] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:53 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1337 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:55.290842 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9b15b8fb-1103-4544-8b98-c3998be4085a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:55.292191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9b15b8fb-1103-4544-8b98-c3998be4085a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:55.355594 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:55.381030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b15b8fb-1103-4544-8b98-c3998be4085a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:55.381579 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b15b8fb-1103-4544-8b98-c3998be4085a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:55.382031 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b15b8fb-1103-4544-8b98-c3998be4085a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:55.391699 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b15b8fb-1103-4544-8b98-c3998be4085a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:55.399007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b15b8fb-1103-4544-8b98-c3998be4085a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:55.400986 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b15b8fb-1103-4544-8b98-c3998be4085a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:55.909980 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9b15b8fb-1103-4544-8b98-c3998be4085a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:55.924479 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9b15b8fb-1103-4544-8b98-c3998be4085a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1337 microversion: 2.1 time: 0.647674 Oct 29 03:05:55.932690 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1926/4037] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:55 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1337 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:56.286257 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3e6b3f47-8d59-4375-9ca3-ea3665691f12 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:56.298776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3e6b3f47-8d59-4375-9ca3-ea3665691f12 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '85efe9a35c8646ffadadc5a6bd9f0824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:56.299620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3e6b3f47-8d59-4375-9ca3-ea3665691f12 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Searching by: {'deleted': False, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2'} {{(pid=127124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:05:56.322360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3e6b3f47-8d59-4375-9ca3-ea3665691f12 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:56.323137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3e6b3f47-8d59-4375-9ca3-ea3665691f12 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:56.323576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3e6b3f47-8d59-4375-9ca3-ea3665691f12 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:56.326232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3e6b3f47-8d59-4375-9ca3-ea3665691f12 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:56.327847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3e6b3f47-8d59-4375-9ca3-ea3665691f12 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:56.330218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3e6b3f47-8d59-4375-9ca3-ea3665691f12 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:56.387347 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.multi_cell_list [None req-3e6b3f47-8d59-4375-9ca3-ea3665691f12 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:05:56.436835 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3e6b3f47-8d59-4375-9ca3-ea3665691f12 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.155977 Oct 29 03:05:56.438302 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2112/4038] 10.222.0.46 () {58 vars in 1125 bytes} [Sat Oct 29 03:05:56 2022] GET /compute/v2.1/servers => generated 343 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:05:56.459845 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c5082b5f-8fc7-4122-b9d7-b3f3e2db1056 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:56.469673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c5082b5f-8fc7-4122-b9d7-b3f3e2db1056 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '85efe9a35c8646ffadadc5a6bd9f0824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:56.474115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c5082b5f-8fc7-4122-b9d7-b3f3e2db1056 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Searching by: {'deleted': False, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2'} {{(pid=127125) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:05:56.490545 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5082b5f-8fc7-4122-b9d7-b3f3e2db1056 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:56.491661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5082b5f-8fc7-4122-b9d7-b3f3e2db1056 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:56.492770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5082b5f-8fc7-4122-b9d7-b3f3e2db1056 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:56.495568 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5082b5f-8fc7-4122-b9d7-b3f3e2db1056 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:56.496252 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5082b5f-8fc7-4122-b9d7-b3f3e2db1056 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:56.497776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5082b5f-8fc7-4122-b9d7-b3f3e2db1056 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:56.668608 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.multi_cell_list [None req-c5082b5f-8fc7-4122-b9d7-b3f3e2db1056 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:05:56.804773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c5082b5f-8fc7-4122-b9d7-b3f3e2db1056 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85efe9a35c8646ffadadc5a6bd9f0824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:56.822677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5082b5f-8fc7-4122-b9d7-b3f3e2db1056 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:56.823178 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5082b5f-8fc7-4122-b9d7-b3f3e2db1056 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:56.825156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5082b5f-8fc7-4122-b9d7-b3f3e2db1056 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:56.963591 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1e802b9f-115c-4021-a3ce-e7a95a25a4c8 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:56.964620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1e802b9f-115c-4021-a3ce-e7a95a25a4c8 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:56.979404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e802b9f-115c-4021-a3ce-e7a95a25a4c8 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:56.981369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e802b9f-115c-4021-a3ce-e7a95a25a4c8 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:56.982381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e802b9f-115c-4021-a3ce-e7a95a25a4c8 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:56.986132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e802b9f-115c-4021-a3ce-e7a95a25a4c8 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:56.986839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e802b9f-115c-4021-a3ce-e7a95a25a4c8 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:56.987446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e802b9f-115c-4021-a3ce-e7a95a25a4c8 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:57.307219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1e802b9f-115c-4021-a3ce-e7a95a25a4c8 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:57.322898 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1e802b9f-115c-4021-a3ce-e7a95a25a4c8 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1337 microversion: 2.1 time: 0.363902 Oct 29 03:05:57.340278 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2113/4039] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:56 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1337 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:57.764554 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c5082b5f-8fc7-4122-b9d7-b3f3e2db1056 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 1.308942 Oct 29 03:05:57.779462 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1927/4040] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 03:05:56 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:05:57.829559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2a006321-23f5-4288-9217-3cdea3be2531 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:57.867934 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2a006321-23f5-4288-9217-3cdea3be2531 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.045537 Oct 29 03:05:57.876362 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2114/4041] 10.222.0.46 () {58 vars in 1137 bytes} [Sat Oct 29 03:05:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:05:58.352287 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c433430d-e740-4a5f-a2d7-c0b807dd23be tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:58.356831 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:58.362620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c433430d-e740-4a5f-a2d7-c0b807dd23be tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:58.363334 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7f72a7dd-ae4a-4370-bb58-5c73f2bcb402 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:58.363975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7f72a7dd-ae4a-4370-bb58-5c73f2bcb402 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:58.375154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c433430d-e740-4a5f-a2d7-c0b807dd23be tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:58.376024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c433430d-e740-4a5f-a2d7-c0b807dd23be tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:58.377800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c433430d-e740-4a5f-a2d7-c0b807dd23be tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:58.380992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c433430d-e740-4a5f-a2d7-c0b807dd23be tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:58.381759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c433430d-e740-4a5f-a2d7-c0b807dd23be tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:58.382559 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c433430d-e740-4a5f-a2d7-c0b807dd23be tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:58.412067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f72a7dd-ae4a-4370-bb58-5c73f2bcb402 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:58.413194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f72a7dd-ae4a-4370-bb58-5c73f2bcb402 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:58.415476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f72a7dd-ae4a-4370-bb58-5c73f2bcb402 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:58.421786 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f72a7dd-ae4a-4370-bb58-5c73f2bcb402 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:58.428968 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f72a7dd-ae4a-4370-bb58-5c73f2bcb402 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:58.435423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f72a7dd-ae4a-4370-bb58-5c73f2bcb402 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:58.608695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7f72a7dd-ae4a-4370-bb58-5c73f2bcb402 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:05:58.932195 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7f72a7dd-ae4a-4370-bb58-5c73f2bcb402 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2" status: 204 len: 0 microversion: 2.1 time: 0.575899 Oct 29 03:05:58.937512 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2115/4042] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:05:58 2022] DELETE /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:05:58.943920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5466194a-1fa6-4e19-8a79-ca765b52dfdf tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:58.944764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5466194a-1fa6-4e19-8a79-ca765b52dfdf tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:05:58.976029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5466194a-1fa6-4e19-8a79-ca765b52dfdf tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:58.976692 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5466194a-1fa6-4e19-8a79-ca765b52dfdf tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:58.977148 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5466194a-1fa6-4e19-8a79-ca765b52dfdf tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:58.979591 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5466194a-1fa6-4e19-8a79-ca765b52dfdf tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:05:58.980067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5466194a-1fa6-4e19-8a79-ca765b52dfdf tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:05:58.990160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5466194a-1fa6-4e19-8a79-ca765b52dfdf tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:05:59.129199 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=10 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:59.210730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c433430d-e740-4a5f-a2d7-c0b807dd23be tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:59.225528 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c433430d-e740-4a5f-a2d7-c0b807dd23be tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1379 microversion: 2.1 time: 0.879899 Oct 29 03:05:59.226139 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1928/4043] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:58 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1379 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:59.365321 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c433430d-e740-4a5f-a2d7-c0b807dd23be tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:59.366505 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c433430d-e740-4a5f-a2d7-c0b807dd23be tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001616 Oct 29 03:05:59.368269 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1929/4044] 10.222.0.46 () {56 vars in 886 bytes} [Sat Oct 29 03:05:59 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 29 03:05:59.834544 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5466194a-1fa6-4e19-8a79-ca765b52dfdf tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85efe9a35c8646ffadadc5a6bd9f0824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:05:59.849063 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5466194a-1fa6-4e19-8a79-ca765b52dfdf tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2" status: 200 len: 1607 microversion: 2.1 time: 0.909930 Oct 29 03:05:59.850077 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2116/4045] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:05:58 2022] GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2 => generated 1607 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:05:59.988690 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6803ceec-71c6-48de-bc35-39c7fedab910 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:05:59.989735 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6803ceec-71c6-48de-bc35-39c7fedab910 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:00.011523 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6803ceec-71c6-48de-bc35-39c7fedab910 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:00.012401 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6803ceec-71c6-48de-bc35-39c7fedab910 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:00.021730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6803ceec-71c6-48de-bc35-39c7fedab910 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:00.022931 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6803ceec-71c6-48de-bc35-39c7fedab910 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:00.023660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6803ceec-71c6-48de-bc35-39c7fedab910 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:00.024314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6803ceec-71c6-48de-bc35-39c7fedab910 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:00.063364 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-6803ceec-71c6-48de-bc35-39c7fedab910 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] HTTP exception thrown: Instance 1ab56816-cc78-4e73-918a-4c76895fed6b could not be found. Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6803ceec-71c6-48de-bc35-39c7fedab910 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Request method failure captured: Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b HTTP/1.1 Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJaJHSXj-jqWtpuO19W_zKp1iKYpA1BxBdNPSEMxYnt5c-nWuInn2vhByoiyD50ujDbOWsEZgXQWvn1TdiZKPWXgOO222e5DgFFL5-_ptnqVjJ04ZUyvB4BJC1Pm_vqIkFGDupuRaHR-jseufm1Kp1jX7ZqMA9hUVj92Fx4vSSIHYDA Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: X-Openstack-Nova-Api-Version: 2.20 Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 746258dc83c74b9ba3634afbc2716d7b Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2053223102 Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/746258dc83c74b9ba3634afbc2716d7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/746258dc83c74b9ba3634afbc2716d7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_746258dc83c74b9ba3634afbc2716d7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/746258dc83c74b9ba3634afbc2716d7b"}]}] Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2053223102 Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 746258dc83c74b9ba3634afbc2716d7b Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2053223102 Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-AttachVolumeShelveTestJSON-2053223102-project Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 4dbcac917fc6415683ae17b220276c91 Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2053223102-project Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 1ab56816-cc78-4e73-918a-4c76895fed6b could not be found. Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '1ab56816-cc78-4e73-918a-4c76895fed6b'} Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ab56816-cc78-4e73-918a-4c76895fed6b could not be found. Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:06:00.069569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:06:00.073331 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ab56816-cc78-4e73-918a-4c76895fed6b could not be found. Oct 29 03:06:00.073331 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:06:00.073331 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:06:00.073331 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:06:00.073331 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:00.073331 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:06:00.073331 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:06:00.073331 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:06:00.073331 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:06:00.073331 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ab56816-cc78-4e73-918a-4c76895fed6b could not be found. Oct 29 03:06:00.073331 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:06:00.077204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6803ceec-71c6-48de-bc35-39c7fedab910 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Returning 404 to user: Instance 1ab56816-cc78-4e73-918a-4c76895fed6b could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:06:00.081462 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6803ceec-71c6-48de-bc35-39c7fedab910 tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 404 len: 111 microversion: 2.20 time: 0.097002 Oct 29 03:06:00.084864 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1930/4046] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Oct 29 03:05:59 2022] DELETE /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:06:00.094473 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8b8c6993-517c-4885-8b8a-b6e1a4470f8a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:00.095459 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8b8c6993-517c-4885-8b8a-b6e1a4470f8a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] [instance: 1ab56816-cc78-4e73-918a-4c76895fed6b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:00.106511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b8c6993-517c-4885-8b8a-b6e1a4470f8a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:00.107971 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b8c6993-517c-4885-8b8a-b6e1a4470f8a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:00.109321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b8c6993-517c-4885-8b8a-b6e1a4470f8a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:00.110450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b8c6993-517c-4885-8b8a-b6e1a4470f8a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:00.111502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b8c6993-517c-4885-8b8a-b6e1a4470f8a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:00.112222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b8c6993-517c-4885-8b8a-b6e1a4470f8a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:00.132020 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-8b8c6993-517c-4885-8b8a-b6e1a4470f8a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] HTTP exception thrown: Instance 1ab56816-cc78-4e73-918a-4c76895fed6b could not be found. Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8b8c6993-517c-4885-8b8a-b6e1a4470f8a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Request method failure captured: Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b HTTP/1.1 Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJaJHSXj-jqWtpuO19W_zKp1iKYpA1BxBdNPSEMxYnt5c-nWuInn2vhByoiyD50ujDbOWsEZgXQWvn1TdiZKPWXgOO222e5DgFFL5-_ptnqVjJ04ZUyvB4BJC1Pm_vqIkFGDupuRaHR-jseufm1Kp1jX7ZqMA9hUVj92Fx4vSSIHYDA Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: X-Openstack-Nova-Api-Version: 2.20 Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 746258dc83c74b9ba3634afbc2716d7b Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2053223102 Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/746258dc83c74b9ba3634afbc2716d7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/746258dc83c74b9ba3634afbc2716d7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_746258dc83c74b9ba3634afbc2716d7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/746258dc83c74b9ba3634afbc2716d7b"}]}] Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2053223102 Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 746258dc83c74b9ba3634afbc2716d7b Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2053223102 Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-AttachVolumeShelveTestJSON-2053223102-project Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 4dbcac917fc6415683ae17b220276c91 Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2053223102-project Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 1ab56816-cc78-4e73-918a-4c76895fed6b could not be found. Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '1ab56816-cc78-4e73-918a-4c76895fed6b'} Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ab56816-cc78-4e73-918a-4c76895fed6b could not be found. Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ab56816-cc78-4e73-918a-4c76895fed6b could not be found. Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:06:00.135577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:06:00.139220 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:06:00.139220 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:00.139220 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:06:00.139220 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:06:00.139220 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:06:00.139220 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:06:00.139220 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ab56816-cc78-4e73-918a-4c76895fed6b could not be found. Oct 29 03:06:00.139220 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:06:00.143377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8b8c6993-517c-4885-8b8a-b6e1a4470f8a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] Returning 404 to user: Instance 1ab56816-cc78-4e73-918a-4c76895fed6b could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:06:00.144760 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8b8c6993-517c-4885-8b8a-b6e1a4470f8a tempest-AttachVolumeShelveTestJSON-2053223102 tempest-AttachVolumeShelveTestJSON-2053223102-project] 10.222.0.46 "GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b" status: 404 len: 111 microversion: 2.20 time: 0.056660 Oct 29 03:06:00.146434 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2117/4047] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:06:00 2022] GET /compute/v2.1/servers/1ab56816-cc78-4e73-918a-4c76895fed6b => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:06:00.255230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ab13b720-7c9a-4397-91bd-819d68658097 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:00.255849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ab13b720-7c9a-4397-91bd-819d68658097 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:00.270662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab13b720-7c9a-4397-91bd-819d68658097 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:00.273083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab13b720-7c9a-4397-91bd-819d68658097 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:00.273681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab13b720-7c9a-4397-91bd-819d68658097 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:00.281724 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab13b720-7c9a-4397-91bd-819d68658097 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:00.282645 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab13b720-7c9a-4397-91bd-819d68658097 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:00.283535 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab13b720-7c9a-4397-91bd-819d68658097 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:00.876289 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a5ed599b-ea15-4c14-97f4-251b4e6803f0 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:00.877846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a5ed599b-ea15-4c14-97f4-251b4e6803f0 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:00.895317 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a5ed599b-ea15-4c14-97f4-251b4e6803f0 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:00.898394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a5ed599b-ea15-4c14-97f4-251b4e6803f0 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:00.899086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a5ed599b-ea15-4c14-97f4-251b4e6803f0 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:00.900077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a5ed599b-ea15-4c14-97f4-251b4e6803f0 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:00.902428 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a5ed599b-ea15-4c14-97f4-251b4e6803f0 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:00.903916 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a5ed599b-ea15-4c14-97f4-251b4e6803f0 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:02.091038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ab13b720-7c9a-4397-91bd-819d68658097 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:02.114818 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ab13b720-7c9a-4397-91bd-819d68658097 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1379 microversion: 2.1 time: 1.861065 Oct 29 03:06:02.115614 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1931/4048] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:00 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1379 bytes in 1865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:02.565221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a5ed599b-ea15-4c14-97f4-251b4e6803f0 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85efe9a35c8646ffadadc5a6bd9f0824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:02.580440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:02.586178 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a5ed599b-ea15-4c14-97f4-251b4e6803f0 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2" status: 200 len: 1607 microversion: 2.1 time: 1.713693 Oct 29 03:06:02.588680 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2118/4049] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:00 2022] GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2 => generated 1607 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:06:03.148370 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0060851c-5262-4a52-ac9a-e05e5c458f6c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:03.149221 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0060851c-5262-4a52-ac9a-e05e5c458f6c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:03.166686 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0060851c-5262-4a52-ac9a-e05e5c458f6c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:03.167217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0060851c-5262-4a52-ac9a-e05e5c458f6c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:03.167651 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0060851c-5262-4a52-ac9a-e05e5c458f6c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:03.173270 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0060851c-5262-4a52-ac9a-e05e5c458f6c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:03.174228 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0060851c-5262-4a52-ac9a-e05e5c458f6c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:03.175053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0060851c-5262-4a52-ac9a-e05e5c458f6c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:03.880693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-bc226128-0266-4980-a523-9d827eb9bca3 req-d2570bea-71a3-4816-9396-606c642af84b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f60b0652-637b-48dd-8e61-950c0fe5b4c0", "tag": "7221ab02-8b17-48e5-a7aa-ed98c8fe3c5c"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:03.910815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-bc226128-0266-4980-a523-9d827eb9bca3 req-d2570bea-71a3-4816-9396-606c642af84b service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:03.913406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-bc226128-0266-4980-a523-9d827eb9bca3 req-d2570bea-71a3-4816-9396-606c642af84b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:03.917674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-bc226128-0266-4980-a523-9d827eb9bca3 req-d2570bea-71a3-4816-9396-606c642af84b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:03.970148 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-bc226128-0266-4980-a523-9d827eb9bca3 req-d2570bea-71a3-4816-9396-606c642af84b service nova] Creating event network-changed:7221ab02-8b17-48e5-a7aa-ed98c8fe3c5c for instance f60b0652-637b-48dd-8e61-950c0fe5b4c0 on n-h2-862967-2 Oct 29 03:06:03.993227 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-bc226128-0266-4980-a523-9d827eb9bca3 req-d2570bea-71a3-4816-9396-606c642af84b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.722722 Oct 29 03:06:03.994465 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2119/4050] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:04.006156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3fe77189-097b-4b21-94c7-6afc12b933b8 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:04.013316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3fe77189-097b-4b21-94c7-6afc12b933b8 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:04.031254 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3fe77189-097b-4b21-94c7-6afc12b933b8 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:04.031981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3fe77189-097b-4b21-94c7-6afc12b933b8 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:04.032436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3fe77189-097b-4b21-94c7-6afc12b933b8 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:04.033197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3fe77189-097b-4b21-94c7-6afc12b933b8 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:04.033655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3fe77189-097b-4b21-94c7-6afc12b933b8 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:04.034083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3fe77189-097b-4b21-94c7-6afc12b933b8 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:04.408547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3fe77189-097b-4b21-94c7-6afc12b933b8 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85efe9a35c8646ffadadc5a6bd9f0824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:04.418895 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3fe77189-097b-4b21-94c7-6afc12b933b8 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2" status: 200 len: 1540 microversion: 2.1 time: 0.422958 Oct 29 03:06:04.426641 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2120/4051] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:03 2022] GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2 => generated 1540 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:04.748168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0060851c-5262-4a52-ac9a-e05e5c458f6c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:04.763064 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0060851c-5262-4a52-ac9a-e05e5c458f6c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1379 microversion: 2.1 time: 1.623064 Oct 29 03:06:04.763691 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1932/4052] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:03 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1379 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:05.445373 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dd5ce052-2779-46b0-b1fe-1420f9712650 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:05.445981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dd5ce052-2779-46b0-b1fe-1420f9712650 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:05.465889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd5ce052-2779-46b0-b1fe-1420f9712650 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:05.469746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd5ce052-2779-46b0-b1fe-1420f9712650 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:05.471446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd5ce052-2779-46b0-b1fe-1420f9712650 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:05.475331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd5ce052-2779-46b0-b1fe-1420f9712650 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:05.476024 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd5ce052-2779-46b0-b1fe-1420f9712650 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:05.476657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd5ce052-2779-46b0-b1fe-1420f9712650 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:05.662004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dd5ce052-2779-46b0-b1fe-1420f9712650 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85efe9a35c8646ffadadc5a6bd9f0824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:05.670946 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dd5ce052-2779-46b0-b1fe-1420f9712650 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2" status: 200 len: 1251 microversion: 2.1 time: 0.229484 Oct 29 03:06:05.679708 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2121/4053] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:05 2022] GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2 => generated 1251 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:05.788031 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c7fe92a4-fcab-42a1-8a8e-ab649acc705b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:05.788779 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c7fe92a4-fcab-42a1-8a8e-ab649acc705b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:05.819307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7fe92a4-fcab-42a1-8a8e-ab649acc705b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:05.825687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7fe92a4-fcab-42a1-8a8e-ab649acc705b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:05.826544 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7fe92a4-fcab-42a1-8a8e-ab649acc705b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:05.827754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7fe92a4-fcab-42a1-8a8e-ab649acc705b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:05.831260 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7fe92a4-fcab-42a1-8a8e-ab649acc705b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:05.832226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7fe92a4-fcab-42a1-8a8e-ab649acc705b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:06.162878 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-aac62081-feb0-47ae-b4d9-7fb40823b3b5 req-99dec714-2aaf-4645-b467-3295caaa5511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fa383d1-1572-4975-9de9-22286e5458a2", "name": "network-vif-deleted", "tag": "2235e54c-806d-494b-b955-e92306257303"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:06.194447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-aac62081-feb0-47ae-b4d9-7fb40823b3b5 req-99dec714-2aaf-4645-b467-3295caaa5511 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:06.194985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-aac62081-feb0-47ae-b4d9-7fb40823b3b5 req-99dec714-2aaf-4645-b467-3295caaa5511 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:06.195513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-aac62081-feb0-47ae-b4d9-7fb40823b3b5 req-99dec714-2aaf-4645-b467-3295caaa5511 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:06.222304 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-aac62081-feb0-47ae-b4d9-7fb40823b3b5 req-99dec714-2aaf-4645-b467-3295caaa5511 service nova] Creating event network-vif-deleted:2235e54c-806d-494b-b955-e92306257303 for instance 6fa383d1-1572-4975-9de9-22286e5458a2 on n-h1-862967-2 Oct 29 03:06:06.248948 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-aac62081-feb0-47ae-b4d9-7fb40823b3b5 req-99dec714-2aaf-4645-b467-3295caaa5511 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089937 Oct 29 03:06:06.253322 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2122/4054] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:06.532980 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:06.704381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:06.713167 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c7fe92a4-fcab-42a1-8a8e-ab649acc705b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:06.720849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f68fae58-9007-4cc1-b82b-53272a24079b tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:06.726217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f68fae58-9007-4cc1-b82b-53272a24079b tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:06.733427 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c7fe92a4-fcab-42a1-8a8e-ab649acc705b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1379 microversion: 2.1 time: 0.949794 Oct 29 03:06:06.749850 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1933/4055] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:05 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1379 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:06.753417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f68fae58-9007-4cc1-b82b-53272a24079b tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:06.755118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f68fae58-9007-4cc1-b82b-53272a24079b tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:06.755881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f68fae58-9007-4cc1-b82b-53272a24079b tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:06.757065 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f68fae58-9007-4cc1-b82b-53272a24079b tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:06.760071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f68fae58-9007-4cc1-b82b-53272a24079b tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:06.763179 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f68fae58-9007-4cc1-b82b-53272a24079b tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:07.002300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f68fae58-9007-4cc1-b82b-53272a24079b tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85efe9a35c8646ffadadc5a6bd9f0824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:07.021450 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f68fae58-9007-4cc1-b82b-53272a24079b tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2" status: 200 len: 1251 microversion: 2.1 time: 0.319493 Oct 29 03:06:07.022538 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2123/4056] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:06 2022] GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2 => generated 1251 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:07.770819 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4838b990-292d-4bb4-9cb0-89b6c2902bb7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:07.772068 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4838b990-292d-4bb4-9cb0-89b6c2902bb7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:07.775514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:07.787131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4838b990-292d-4bb4-9cb0-89b6c2902bb7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:07.789585 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4838b990-292d-4bb4-9cb0-89b6c2902bb7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:07.790270 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4838b990-292d-4bb4-9cb0-89b6c2902bb7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:07.794685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4838b990-292d-4bb4-9cb0-89b6c2902bb7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:07.795537 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4838b990-292d-4bb4-9cb0-89b6c2902bb7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:07.796404 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4838b990-292d-4bb4-9cb0-89b6c2902bb7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:08.054097 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-76238519-a676-4e75-8a20-410a706fbf6e tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:08.054753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-76238519-a676-4e75-8a20-410a706fbf6e tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:08.082081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76238519-a676-4e75-8a20-410a706fbf6e tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:08.082646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76238519-a676-4e75-8a20-410a706fbf6e tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:08.083150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76238519-a676-4e75-8a20-410a706fbf6e tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:08.090136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76238519-a676-4e75-8a20-410a706fbf6e tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:08.090748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76238519-a676-4e75-8a20-410a706fbf6e tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:08.095664 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76238519-a676-4e75-8a20-410a706fbf6e tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:08.148251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4838b990-292d-4bb4-9cb0-89b6c2902bb7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:08.159408 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4838b990-292d-4bb4-9cb0-89b6c2902bb7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1379 microversion: 2.1 time: 0.392524 Oct 29 03:06:08.165718 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1934/4057] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:07 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1379 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:08.497371 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-76238519-a676-4e75-8a20-410a706fbf6e tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85efe9a35c8646ffadadc5a6bd9f0824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:08.519994 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-76238519-a676-4e75-8a20-410a706fbf6e tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2" status: 200 len: 1251 microversion: 2.1 time: 0.472129 Oct 29 03:06:08.523179 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2124/4058] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:08 2022] GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2 => generated 1251 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:09.190298 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3a3bae4a-c204-408f-8fa5-abb96c5694d1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:09.191074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3a3bae4a-c204-408f-8fa5-abb96c5694d1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:09.203599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a3bae4a-c204-408f-8fa5-abb96c5694d1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:09.204095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a3bae4a-c204-408f-8fa5-abb96c5694d1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:09.204554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a3bae4a-c204-408f-8fa5-abb96c5694d1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:09.205286 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a3bae4a-c204-408f-8fa5-abb96c5694d1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:09.213002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a3bae4a-c204-408f-8fa5-abb96c5694d1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:09.226889 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a3bae4a-c204-408f-8fa5-abb96c5694d1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:09.555455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7d6e942d-8d90-4f95-8b26-d2daa58719fd tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:09.557229 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7d6e942d-8d90-4f95-8b26-d2daa58719fd tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:09.585895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7d6e942d-8d90-4f95-8b26-d2daa58719fd tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:09.596157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7d6e942d-8d90-4f95-8b26-d2daa58719fd tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:09.596806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7d6e942d-8d90-4f95-8b26-d2daa58719fd tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:09.599051 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7d6e942d-8d90-4f95-8b26-d2daa58719fd tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:09.608126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7d6e942d-8d90-4f95-8b26-d2daa58719fd tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:09.610052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7d6e942d-8d90-4f95-8b26-d2daa58719fd tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:09.764013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7d6e942d-8d90-4f95-8b26-d2daa58719fd tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85efe9a35c8646ffadadc5a6bd9f0824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:09.776711 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7d6e942d-8d90-4f95-8b26-d2daa58719fd tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2" status: 200 len: 1251 microversion: 2.1 time: 0.231112 Oct 29 03:06:09.785329 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2125/4059] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:09 2022] GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2 => generated 1251 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:06:10.606909 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3a3bae4a-c204-408f-8fa5-abb96c5694d1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:10.625658 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3a3bae4a-c204-408f-8fa5-abb96c5694d1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1379 microversion: 2.1 time: 1.438381 Oct 29 03:06:10.627058 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1935/4060] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:09 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1379 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:10.812555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5786ff19-aace-48f7-81f4-1e205a560db4 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:10.815565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5786ff19-aace-48f7-81f4-1e205a560db4 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:10.835289 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5786ff19-aace-48f7-81f4-1e205a560db4 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:10.844764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5786ff19-aace-48f7-81f4-1e205a560db4 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:10.845635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5786ff19-aace-48f7-81f4-1e205a560db4 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:10.847718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5786ff19-aace-48f7-81f4-1e205a560db4 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:10.856135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5786ff19-aace-48f7-81f4-1e205a560db4 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:10.857102 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5786ff19-aace-48f7-81f4-1e205a560db4 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:11.089331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5786ff19-aace-48f7-81f4-1e205a560db4 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85efe9a35c8646ffadadc5a6bd9f0824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:11.101305 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5786ff19-aace-48f7-81f4-1e205a560db4 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2" status: 200 len: 1251 microversion: 2.1 time: 0.297377 Oct 29 03:06:11.124506 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2126/4061] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:10 2022] GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2 => generated 1251 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:11.663461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cde22b2d-63a0-408f-9a64-69496d701fb4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:11.664086 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cde22b2d-63a0-408f-9a64-69496d701fb4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:11.677268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cde22b2d-63a0-408f-9a64-69496d701fb4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:11.678016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cde22b2d-63a0-408f-9a64-69496d701fb4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:11.679765 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cde22b2d-63a0-408f-9a64-69496d701fb4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:11.680962 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cde22b2d-63a0-408f-9a64-69496d701fb4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:11.682244 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cde22b2d-63a0-408f-9a64-69496d701fb4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:11.682866 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cde22b2d-63a0-408f-9a64-69496d701fb4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:11.967846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-240500ef-a544-4720-a59d-fe4d64522062 req-f9b2dd81-d738-4aa0-80b9-60be729f3228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f60b0652-637b-48dd-8e61-950c0fe5b4c0", "name": "network-vif-plugged", "status": "completed", "tag": "7221ab02-8b17-48e5-a7aa-ed98c8fe3c5c"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:11.990213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-240500ef-a544-4720-a59d-fe4d64522062 req-f9b2dd81-d738-4aa0-80b9-60be729f3228 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:11.990894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-240500ef-a544-4720-a59d-fe4d64522062 req-f9b2dd81-d738-4aa0-80b9-60be729f3228 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:11.991334 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-240500ef-a544-4720-a59d-fe4d64522062 req-f9b2dd81-d738-4aa0-80b9-60be729f3228 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:12.036029 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-240500ef-a544-4720-a59d-fe4d64522062 req-f9b2dd81-d738-4aa0-80b9-60be729f3228 service nova] Creating event network-vif-plugged:7221ab02-8b17-48e5-a7aa-ed98c8fe3c5c for instance f60b0652-637b-48dd-8e61-950c0fe5b4c0 on n-h2-862967-2 Oct 29 03:06:12.049562 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-240500ef-a544-4720-a59d-fe4d64522062 req-f9b2dd81-d738-4aa0-80b9-60be729f3228 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084513 Oct 29 03:06:12.067773 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2127/4062] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:12.139325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5efee758-e4f6-4090-8869-d4446e79869e tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:12.140184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5efee758-e4f6-4090-8869-d4446e79869e tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:12.150742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5efee758-e4f6-4090-8869-d4446e79869e tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:12.153759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5efee758-e4f6-4090-8869-d4446e79869e tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:12.157038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5efee758-e4f6-4090-8869-d4446e79869e tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:12.157918 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5efee758-e4f6-4090-8869-d4446e79869e tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:12.158544 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5efee758-e4f6-4090-8869-d4446e79869e tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:12.166365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5efee758-e4f6-4090-8869-d4446e79869e tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:12.671836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5efee758-e4f6-4090-8869-d4446e79869e tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85efe9a35c8646ffadadc5a6bd9f0824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:12.708597 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5efee758-e4f6-4090-8869-d4446e79869e tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2" status: 200 len: 1251 microversion: 2.1 time: 0.573715 Oct 29 03:06:12.712113 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2128/4063] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:12 2022] GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2 => generated 1251 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:13.173883 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cde22b2d-63a0-408f-9a64-69496d701fb4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:13.189010 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cde22b2d-63a0-408f-9a64-69496d701fb4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1379 microversion: 2.1 time: 1.537627 Oct 29 03:06:13.197242 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1936/4064] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:11 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1379 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:13.742003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4ce4f198-6b25-4dc7-aecd-951010ac1325 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:13.742910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4ce4f198-6b25-4dc7-aecd-951010ac1325 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:13.792312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ce4f198-6b25-4dc7-aecd-951010ac1325 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:13.795510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ce4f198-6b25-4dc7-aecd-951010ac1325 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:13.798101 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ce4f198-6b25-4dc7-aecd-951010ac1325 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:13.800141 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ce4f198-6b25-4dc7-aecd-951010ac1325 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:13.801164 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ce4f198-6b25-4dc7-aecd-951010ac1325 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:13.801983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ce4f198-6b25-4dc7-aecd-951010ac1325 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:14.195679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4ce4f198-6b25-4dc7-aecd-951010ac1325 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85efe9a35c8646ffadadc5a6bd9f0824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49b29d96f38485d82d772bd7c2b07d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:14.228515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-506422d1-cf62-4d1f-8793-f769e57f4a4b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:14.233717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-506422d1-cf62-4d1f-8793-f769e57f4a4b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:14.243753 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4ce4f198-6b25-4dc7-aecd-951010ac1325 tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2" status: 200 len: 1251 microversion: 2.1 time: 0.507636 Oct 29 03:06:14.255518 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2129/4065] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:13 2022] GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2 => generated 1251 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:14.273803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-506422d1-cf62-4d1f-8793-f769e57f4a4b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:14.284414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-506422d1-cf62-4d1f-8793-f769e57f4a4b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:14.286748 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-506422d1-cf62-4d1f-8793-f769e57f4a4b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:14.289075 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-506422d1-cf62-4d1f-8793-f769e57f4a4b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:14.290024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-506422d1-cf62-4d1f-8793-f769e57f4a4b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:14.294099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-506422d1-cf62-4d1f-8793-f769e57f4a4b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:15.295864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c9d6d40d-4253-4cc3-94c2-679076d8a85a tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:15.297511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c9d6d40d-4253-4cc3-94c2-679076d8a85a tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] [instance: 6fa383d1-1572-4975-9de9-22286e5458a2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:15.320370 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9d6d40d-4253-4cc3-94c2-679076d8a85a tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:15.329981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9d6d40d-4253-4cc3-94c2-679076d8a85a tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:15.335243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9d6d40d-4253-4cc3-94c2-679076d8a85a tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:15.338350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9d6d40d-4253-4cc3-94c2-679076d8a85a tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:15.340966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9d6d40d-4253-4cc3-94c2-679076d8a85a tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:15.344850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9d6d40d-4253-4cc3-94c2-679076d8a85a tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:15.405806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-506422d1-cf62-4d1f-8793-f769e57f4a4b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:15.427225 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-506422d1-cf62-4d1f-8793-f769e57f4a4b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1379 microversion: 2.1 time: 1.200344 Oct 29 03:06:15.443111 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1937/4066] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:14 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1379 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:15.458879 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-c9d6d40d-4253-4cc3-94c2-679076d8a85a tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] HTTP exception thrown: Instance 6fa383d1-1572-4975-9de9-22286e5458a2 could not be found. Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c9d6d40d-4253-4cc3-94c2-679076d8a85a tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Request method failure captured: Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2 HTTP/1.1 Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJgQMq56PH9p5bXBMCO4GncyoEIf_8e8qsDAyhuKmbklouKmTnxTLrUjYyR1vYSSB25nVPcofZpm8vTPdqd6VOhHvafkJP2Fc8ZLwm6nG8NYeWP0LZQsMXtbXPMzpTIQcqbBkNOx-k0d73QjjmgNjfm4CcSPrvmprI5b2gkckKzcR40 Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: f49b29d96f38485d82d772bd7c2b07d2 Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersTestBootFromVolume-313226777 Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f49b29d96f38485d82d772bd7c2b07d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f49b29d96f38485d82d772bd7c2b07d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f49b29d96f38485d82d772bd7c2b07d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f49b29d96f38485d82d772bd7c2b07d2"}]}] Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersTestBootFromVolume-313226777 Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: f49b29d96f38485d82d772bd7c2b07d2 Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersTestBootFromVolume-313226777 Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersTestBootFromVolume-313226777-project Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 85efe9a35c8646ffadadc5a6bd9f0824 Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersTestBootFromVolume-313226777-project Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 6fa383d1-1572-4975-9de9-22286e5458a2 could not be found. Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '6fa383d1-1572-4975-9de9-22286e5458a2'} Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fa383d1-1572-4975-9de9-22286e5458a2 could not be found. Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fa383d1-1572-4975-9de9-22286e5458a2 could not be found. Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:06:15.479048 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:06:15.484698 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:06:15.484698 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:06:15.484698 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:06:15.484698 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:06:15.484698 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:06:15.484698 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fa383d1-1572-4975-9de9-22286e5458a2 could not be found. Oct 29 03:06:15.484698 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:06:15.491230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c9d6d40d-4253-4cc3-94c2-679076d8a85a tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Returning 404 to user: Instance 6fa383d1-1572-4975-9de9-22286e5458a2 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:06:15.498840 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c9d6d40d-4253-4cc3-94c2-679076d8a85a tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2" status: 404 len: 111 microversion: 2.1 time: 0.205659 Oct 29 03:06:15.507507 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2130/4067] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:15 2022] GET /compute/v2.1/servers/6fa383d1-1572-4975-9de9-22286e5458a2 => generated 111 bytes in 220 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:06:15.511574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-158e2190-cf0a-4d71-a91d-12acc06417ef tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] Calling method '.version_select at 0x7ff053a810d0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:15.548502 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-158e2190-cf0a-4d71-a91d-12acc06417ef tempest-ServersTestBootFromVolume-313226777 tempest-ServersTestBootFromVolume-313226777-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-909379506" status: 202 len: 0 microversion: 2.1 time: 0.042243 Oct 29 03:06:15.553710 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1938/4068] 10.222.0.46 () {58 vars in 1218 bytes} [Sat Oct 29 03:06:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-909379506 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:06:16.450747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-32fcbabb-82fa-48fc-a3f4-fc5f7ad35f4e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:16.452136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-32fcbabb-82fa-48fc-a3f4-fc5f7ad35f4e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:16.465261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32fcbabb-82fa-48fc-a3f4-fc5f7ad35f4e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:16.465832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32fcbabb-82fa-48fc-a3f4-fc5f7ad35f4e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:16.466375 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32fcbabb-82fa-48fc-a3f4-fc5f7ad35f4e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:16.467126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32fcbabb-82fa-48fc-a3f4-fc5f7ad35f4e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:16.471438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32fcbabb-82fa-48fc-a3f4-fc5f7ad35f4e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:16.472006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32fcbabb-82fa-48fc-a3f4-fc5f7ad35f4e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:17.998100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-32fcbabb-82fa-48fc-a3f4-fc5f7ad35f4e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:18.019740 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-32fcbabb-82fa-48fc-a3f4-fc5f7ad35f4e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1528 microversion: 2.1 time: 1.573024 Oct 29 03:06:18.021833 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2131/4069] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:16 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1528 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:18.045936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-758e50ef-76a7-4d28-9317-1b1321d3fda9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:18.047286 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-758e50ef-76a7-4d28-9317-1b1321d3fda9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:18.055890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-758e50ef-76a7-4d28-9317-1b1321d3fda9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:18.057418 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-758e50ef-76a7-4d28-9317-1b1321d3fda9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:18.058423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-758e50ef-76a7-4d28-9317-1b1321d3fda9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:18.059747 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-758e50ef-76a7-4d28-9317-1b1321d3fda9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:18.060448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-758e50ef-76a7-4d28-9317-1b1321d3fda9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:18.061128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-758e50ef-76a7-4d28-9317-1b1321d3fda9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:18.438362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-758e50ef-76a7-4d28-9317-1b1321d3fda9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:18.454937 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-758e50ef-76a7-4d28-9317-1b1321d3fda9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1528 microversion: 2.1 time: 0.415143 Oct 29 03:06:18.455566 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1939/4070] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:18 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1528 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:18.494984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-253f04f5-cc5b-4844-86e0-ae425581c0d8 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:18.531740 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-253f04f5-cc5b-4844-86e0-ae425581c0d8 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/c9f63f65-d539-4d65-a6f9-d6f0ebe08502" status: 202 len: 0 microversion: 2.1 time: 0.050667 Oct 29 03:06:18.536443 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2132/4071] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:06:18 2022] DELETE /compute/v2.1/flavors/c9f63f65-d539-4d65-a6f9-d6f0ebe08502 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:06:18.543144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-33daea0a-ec50-4295-af4f-cc73fdacfb77 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:18.568630 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-33daea0a-ec50-4295-af4f-cc73fdacfb77 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030300 Oct 29 03:06:18.569497 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1940/4072] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 03:06:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:06:18.589713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-81d54097-9871-4f44-901a-85f1ff4053f4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:18.592821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-81d54097-9871-4f44-901a-85f1ff4053f4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:18.612834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81d54097-9871-4f44-901a-85f1ff4053f4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:18.613835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81d54097-9871-4f44-901a-85f1ff4053f4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:18.614528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81d54097-9871-4f44-901a-85f1ff4053f4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:18.617367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81d54097-9871-4f44-901a-85f1ff4053f4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:18.618688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81d54097-9871-4f44-901a-85f1ff4053f4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:18.619518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81d54097-9871-4f44-901a-85f1ff4053f4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:18.670542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-81d54097-9871-4f44-901a-85f1ff4053f4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:18.680029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-81d54097-9871-4f44-901a-85f1ff4053f4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Old instance type tempest-test_resize_flavor_-930221054, new instance type m1.heat {{(pid=127124) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 03:06:18.690960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-81d54097-9871-4f44-901a-85f1ff4053f4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:06:18.691637 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-81d54097-9871-4f44-901a-85f1ff4053f4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:06:18.692312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-81d54097-9871-4f44-901a-85f1ff4053f4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:06:18.692992 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-81d54097-9871-4f44-901a-85f1ff4053f4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:06:18.693639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-81d54097-9871-4f44-901a-85f1ff4053f4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:06:18.855956 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-81d54097-9871-4f44-901a-85f1ff4053f4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "POST /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0/action" status: 202 len: 0 microversion: 2.1 time: 0.261874 Oct 29 03:06:18.857206 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2133/4073] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:06:18 2022] POST /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:06:18.871961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bc319e85-c665-44cd-9d2d-39b6fc84bbd0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:18.872563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bc319e85-c665-44cd-9d2d-39b6fc84bbd0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:18.894761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc319e85-c665-44cd-9d2d-39b6fc84bbd0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:18.895381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc319e85-c665-44cd-9d2d-39b6fc84bbd0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:18.895843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc319e85-c665-44cd-9d2d-39b6fc84bbd0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:18.902885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc319e85-c665-44cd-9d2d-39b6fc84bbd0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:18.905509 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc319e85-c665-44cd-9d2d-39b6fc84bbd0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:18.906128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc319e85-c665-44cd-9d2d-39b6fc84bbd0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:19.655990 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bc319e85-c665-44cd-9d2d-39b6fc84bbd0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:19.666916 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bc319e85-c665-44cd-9d2d-39b6fc84bbd0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1537 microversion: 2.1 time: 0.801597 Oct 29 03:06:19.678665 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1941/4074] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:18 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1537 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:20.394230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a6c765f8-2c8a-49eb-b05e-2c0b30ff4621 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1392833677", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:20.592485 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-a6c765f8-2c8a-49eb-b05e-2c0b30ff4621 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] validate_networks() for [('f033c0e4-b301-490d-90b1-f0012cd324da', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:06:20.703697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f6ec7501-fb6c-4159-80d4-37c8eff8fd19 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:20.704323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f6ec7501-fb6c-4159-80d4-37c8eff8fd19 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:20.729418 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6ec7501-fb6c-4159-80d4-37c8eff8fd19 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:20.729941 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6ec7501-fb6c-4159-80d4-37c8eff8fd19 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:20.731011 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6ec7501-fb6c-4159-80d4-37c8eff8fd19 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:20.732494 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6ec7501-fb6c-4159-80d4-37c8eff8fd19 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:20.735577 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6ec7501-fb6c-4159-80d4-37c8eff8fd19 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:20.736104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6ec7501-fb6c-4159-80d4-37c8eff8fd19 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:21.071341 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f6ec7501-fb6c-4159-80d4-37c8eff8fd19 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:21.085079 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f6ec7501-fb6c-4159-80d4-37c8eff8fd19 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1537 microversion: 2.1 time: 0.386463 Oct 29 03:06:21.102285 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1942/4075] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:20 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1537 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:22.134192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-880d63b3-19e1-4f87-adea-cccf3f0b2ef1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:22.135163 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-880d63b3-19e1-4f87-adea-cccf3f0b2ef1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:22.152846 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-880d63b3-19e1-4f87-adea-cccf3f0b2ef1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:22.154163 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-880d63b3-19e1-4f87-adea-cccf3f0b2ef1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:22.154938 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-880d63b3-19e1-4f87-adea-cccf3f0b2ef1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:22.158064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-880d63b3-19e1-4f87-adea-cccf3f0b2ef1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:22.159410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-880d63b3-19e1-4f87-adea-cccf3f0b2ef1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:22.160405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-880d63b3-19e1-4f87-adea-cccf3f0b2ef1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:22.179226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=93 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:22.970093 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-a6c765f8-2c8a-49eb-b05e-2c0b30ff4621 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:06:22.971201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-a6c765f8-2c8a-49eb-b05e-2c0b30ff4621 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:06:22.971911 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-a6c765f8-2c8a-49eb-b05e-2c0b30ff4621 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:06:22.972843 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-a6c765f8-2c8a-49eb-b05e-2c0b30ff4621 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:06:22.973472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-a6c765f8-2c8a-49eb-b05e-2c0b30ff4621 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:06:22.999844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6c765f8-2c8a-49eb-b05e-2c0b30ff4621 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:23.000792 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6c765f8-2c8a-49eb-b05e-2c0b30ff4621 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:23.001449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6c765f8-2c8a-49eb-b05e-2c0b30ff4621 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:23.002420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6c765f8-2c8a-49eb-b05e-2c0b30ff4621 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:23.003432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6c765f8-2c8a-49eb-b05e-2c0b30ff4621 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:23.004115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6c765f8-2c8a-49eb-b05e-2c0b30ff4621 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:23.054584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-a6c765f8-2c8a-49eb-b05e-2c0b30ff4621 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Getting quotas for project ee274ac8b7204c6a92db7d65a8f4ea62. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:06:23.061414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-a6c765f8-2c8a-49eb-b05e-2c0b30ff4621 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Getting quotas for user f563b6bf99e7480aacedc2a28dbfee01 and project ee274ac8b7204c6a92db7d65a8f4ea62. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:06:23.091709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a6c765f8-2c8a-49eb-b05e-2c0b30ff4621 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:06:23.094319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a6c765f8-2c8a-49eb-b05e-2c0b30ff4621 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:06:23.189540 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a6c765f8-2c8a-49eb-b05e-2c0b30ff4621 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.198016 Oct 29 03:06:23.197179 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2134/4076] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:06:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 3206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:06:23.207151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-73fed66b-2901-41dd-bf1e-4d2f840c2098 tempest-VolumesTestJSON-1859352383 tempest-VolumesTestJSON-1859352383-project] Calling method '.version_select at 0x7ff05c0b8280>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:23.355078 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-73fed66b-2901-41dd-bf1e-4d2f840c2098 tempest-VolumesTestJSON-1859352383 tempest-VolumesTestJSON-1859352383-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f35c8be6-3c80-4dfc-8976-bce2df00f1bc" status: 200 len: 351 microversion: 2.1 time: 0.156530 Oct 29 03:06:23.355663 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2135/4077] 10.222.0.46 () {58 vars in 1245 bytes} [Sat Oct 29 03:06:23 2022] GET /compute/v2.1/os-volumes/f35c8be6-3c80-4dfc-8976-bce2df00f1bc => generated 351 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:23.380872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-01b525ac-6912-4cef-b4a9-3564d788e60d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:23.381808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-01b525ac-6912-4cef-b4a9-3564d788e60d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:23.978468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-01b525ac-6912-4cef-b4a9-3564d788e60d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f563b6bf99e7480aacedc2a28dbfee01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee274ac8b7204c6a92db7d65a8f4ea62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:23.987451 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-01b525ac-6912-4cef-b4a9-3564d788e60d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 200 len: 1223 microversion: 2.1 time: 0.630461 Oct 29 03:06:23.990890 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2136/4078] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:23 2022] GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 1223 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:24.246274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-880d63b3-19e1-4f87-adea-cccf3f0b2ef1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:24.265349 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-880d63b3-19e1-4f87-adea-cccf3f0b2ef1 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1537 microversion: 2.1 time: 2.139584 Oct 29 03:06:24.283917 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1943/4079] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:22 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1537 bytes in 2159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:25.016379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1e374f95-e0c6-44fb-b49f-b7da843e6a1d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:25.020725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1e374f95-e0c6-44fb-b49f-b7da843e6a1d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:25.051108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e374f95-e0c6-44fb-b49f-b7da843e6a1d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:25.053442 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e374f95-e0c6-44fb-b49f-b7da843e6a1d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:25.055359 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e374f95-e0c6-44fb-b49f-b7da843e6a1d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:25.056944 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e374f95-e0c6-44fb-b49f-b7da843e6a1d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:25.059309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e374f95-e0c6-44fb-b49f-b7da843e6a1d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:25.061096 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e374f95-e0c6-44fb-b49f-b7da843e6a1d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:25.292565 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9c3a9373-9a7f-4f20-8fb2-bd905a700061 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:25.296130 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9c3a9373-9a7f-4f20-8fb2-bd905a700061 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:25.312196 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c3a9373-9a7f-4f20-8fb2-bd905a700061 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:25.319602 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c3a9373-9a7f-4f20-8fb2-bd905a700061 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:25.320287 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c3a9373-9a7f-4f20-8fb2-bd905a700061 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:25.321644 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c3a9373-9a7f-4f20-8fb2-bd905a700061 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:25.322557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c3a9373-9a7f-4f20-8fb2-bd905a700061 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:25.328439 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c3a9373-9a7f-4f20-8fb2-bd905a700061 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:25.512970 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1e374f95-e0c6-44fb-b49f-b7da843e6a1d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f563b6bf99e7480aacedc2a28dbfee01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee274ac8b7204c6a92db7d65a8f4ea62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:25.529083 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1e374f95-e0c6-44fb-b49f-b7da843e6a1d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 200 len: 1219 microversion: 2.1 time: 0.513234 Oct 29 03:06:25.530396 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2137/4080] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:25 2022] GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 1219 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:25.950801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9c3a9373-9a7f-4f20-8fb2-bd905a700061 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:25.971240 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9c3a9373-9a7f-4f20-8fb2-bd905a700061 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1537 microversion: 2.1 time: 0.684306 Oct 29 03:06:25.976058 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1944/4081] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:25 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1537 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:26.533756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b319f087-18d0-4a6b-852b-929188632520 tempest-VolumesTestJSON-1859352383 tempest-VolumesTestJSON-1859352383-project] Calling method '.version_select at 0x7ff053388670>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:26.558344 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-69e4bd9a-7ad5-4b51-ae97-404684ec2968 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:26.558979 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-69e4bd9a-7ad5-4b51-ae97-404684ec2968 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:26.572148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:26.580345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-69e4bd9a-7ad5-4b51-ae97-404684ec2968 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:26.581131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-69e4bd9a-7ad5-4b51-ae97-404684ec2968 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:26.582051 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-69e4bd9a-7ad5-4b51-ae97-404684ec2968 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:26.583041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-69e4bd9a-7ad5-4b51-ae97-404684ec2968 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:26.583691 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-69e4bd9a-7ad5-4b51-ae97-404684ec2968 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:26.584878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-69e4bd9a-7ad5-4b51-ae97-404684ec2968 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:26.672828 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b319f087-18d0-4a6b-852b-929188632520 tempest-VolumesTestJSON-1859352383 tempest-VolumesTestJSON-1859352383-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/fc68a809-70e1-48e5-8ee5-6390282868e9" status: 200 len: 350 microversion: 2.1 time: 0.149834 Oct 29 03:06:26.683417 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2138/4082] 10.222.0.46 () {58 vars in 1245 bytes} [Sat Oct 29 03:06:26 2022] GET /compute/v2.1/os-volumes/fc68a809-70e1-48e5-8ee5-6390282868e9 => generated 350 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:26.779254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-69e4bd9a-7ad5-4b51-ae97-404684ec2968 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f563b6bf99e7480aacedc2a28dbfee01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee274ac8b7204c6a92db7d65a8f4ea62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:26.802042 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-69e4bd9a-7ad5-4b51-ae97-404684ec2968 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 200 len: 1281 microversion: 2.1 time: 0.248257 Oct 29 03:06:26.805154 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1945/4083] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:26 2022] GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 1281 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:26.999684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7721b90b-7243-4420-82f8-02e7d1277130 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:27.000440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7721b90b-7243-4420-82f8-02e7d1277130 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:27.026646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7721b90b-7243-4420-82f8-02e7d1277130 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:27.028992 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7721b90b-7243-4420-82f8-02e7d1277130 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:27.029708 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7721b90b-7243-4420-82f8-02e7d1277130 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:27.030776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7721b90b-7243-4420-82f8-02e7d1277130 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:27.031918 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7721b90b-7243-4420-82f8-02e7d1277130 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:27.032750 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7721b90b-7243-4420-82f8-02e7d1277130 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:27.351256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7721b90b-7243-4420-82f8-02e7d1277130 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:27.359721 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7721b90b-7243-4420-82f8-02e7d1277130 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1537 microversion: 2.1 time: 0.365206 Oct 29 03:06:27.360333 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2139/4084] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:26 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1537 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:27.836337 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4b388a74-d2c4-46fb-892f-09adc4fad478 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:27.837955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4b388a74-d2c4-46fb-892f-09adc4fad478 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:27.862038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b388a74-d2c4-46fb-892f-09adc4fad478 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:27.865360 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b388a74-d2c4-46fb-892f-09adc4fad478 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:27.866288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b388a74-d2c4-46fb-892f-09adc4fad478 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:27.871719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b388a74-d2c4-46fb-892f-09adc4fad478 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:27.873413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b388a74-d2c4-46fb-892f-09adc4fad478 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:27.876111 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b388a74-d2c4-46fb-892f-09adc4fad478 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:28.175700 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4b388a74-d2c4-46fb-892f-09adc4fad478 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f563b6bf99e7480aacedc2a28dbfee01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee274ac8b7204c6a92db7d65a8f4ea62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:28.245913 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4b388a74-d2c4-46fb-892f-09adc4fad478 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 200 len: 1281 microversion: 2.1 time: 0.410898 Oct 29 03:06:28.255603 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1946/4085] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:27 2022] GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 1281 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:28.398291 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-99552872-099d-4395-9de8-6674650c28ed tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:28.398974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-99552872-099d-4395-9de8-6674650c28ed tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:28.418785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-99552872-099d-4395-9de8-6674650c28ed tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:28.419627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-99552872-099d-4395-9de8-6674650c28ed tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:28.420384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-99552872-099d-4395-9de8-6674650c28ed tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:28.443702 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-99552872-099d-4395-9de8-6674650c28ed tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:28.444207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-99552872-099d-4395-9de8-6674650c28ed tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:28.444717 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-99552872-099d-4395-9de8-6674650c28ed tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:29.051620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-99552872-099d-4395-9de8-6674650c28ed tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:29.119787 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-99552872-099d-4395-9de8-6674650c28ed tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1542 microversion: 2.1 time: 0.727375 Oct 29 03:06:29.142503 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2140/4086] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:28 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1542 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:06:29.272119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8ead7133-60fb-42a1-97c8-6220528906d6 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:29.272949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8ead7133-60fb-42a1-97c8-6220528906d6 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:29.288286 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ead7133-60fb-42a1-97c8-6220528906d6 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:29.289019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ead7133-60fb-42a1-97c8-6220528906d6 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:29.290979 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ead7133-60fb-42a1-97c8-6220528906d6 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:29.292211 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ead7133-60fb-42a1-97c8-6220528906d6 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:29.295529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ead7133-60fb-42a1-97c8-6220528906d6 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:29.297077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ead7133-60fb-42a1-97c8-6220528906d6 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:30.161626 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-371af7b5-551c-4181-a241-03bee4aab41d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:30.162307 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-371af7b5-551c-4181-a241-03bee4aab41d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:30.165259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:30.183552 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-371af7b5-551c-4181-a241-03bee4aab41d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:30.186322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-371af7b5-551c-4181-a241-03bee4aab41d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:30.186888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-371af7b5-551c-4181-a241-03bee4aab41d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:30.187655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-371af7b5-551c-4181-a241-03bee4aab41d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:30.190573 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-371af7b5-551c-4181-a241-03bee4aab41d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:30.191220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-371af7b5-551c-4181-a241-03bee4aab41d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:30.246919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:30.336495 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8ead7133-60fb-42a1-97c8-6220528906d6 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f563b6bf99e7480aacedc2a28dbfee01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee274ac8b7204c6a92db7d65a8f4ea62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:30.359510 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8ead7133-60fb-42a1-97c8-6220528906d6 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 200 len: 1323 microversion: 2.1 time: 1.092540 Oct 29 03:06:30.363259 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1947/4087] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:29 2022] GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 1323 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:30.552783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-36a87a0f-da49-4104-aff2-c684e1eab2a4 tempest-VolumesTestJSON-1859352383 tempest-VolumesTestJSON-1859352383-project] Calling method '.version_select at 0x7ff0539bf1f0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:30.624707 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-36a87a0f-da49-4104-aff2-c684e1eab2a4 tempest-VolumesTestJSON-1859352383 tempest-VolumesTestJSON-1859352383-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/eb5dc09b-934b-4bf5-97ae-2abeaae2139b" status: 200 len: 350 microversion: 2.1 time: 0.077147 Oct 29 03:06:30.625292 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1948/4088] 10.222.0.46 () {58 vars in 1245 bytes} [Sat Oct 29 03:06:30 2022] GET /compute/v2.1/os-volumes/eb5dc09b-934b-4bf5-97ae-2abeaae2139b => generated 350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:30.639809 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a79d9b6c-7523-4008-b9f5-993398d5ab96 tempest-VolumesTestJSON-1859352383 tempest-VolumesTestJSON-1859352383-project] Calling method '.version_select at 0x7ff053886f70>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:30.775951 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a79d9b6c-7523-4008-b9f5-993398d5ab96 tempest-VolumesTestJSON-1859352383 tempest-VolumesTestJSON-1859352383-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.140218 Oct 29 03:06:30.776557 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1949/4089] 10.222.0.46 () {58 vars in 1134 bytes} [Sat Oct 29 03:06:30 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:06:30.791158 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-320bc8c2-a777-4515-ba89-ccaf625b9bb4 tempest-VolumesTestJSON-1859352383 tempest-VolumesTestJSON-1859352383-project] Calling method '.version_select at 0x7ff053812a60>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:31.004017 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-320bc8c2-a777-4515-ba89-ccaf625b9bb4 tempest-VolumesTestJSON-1859352383 tempest-VolumesTestJSON-1859352383-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.216127 Oct 29 03:06:31.004017 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1950/4090] 10.222.0.46 () {58 vars in 1149 bytes} [Sat Oct 29 03:06:30 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:06:31.030223 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7a56875c-094a-4648-a72c-fa88e96c1e3d tempest-VolumesTestJSON-1859352383 tempest-VolumesTestJSON-1859352383-project] Calling method '.version_select at 0x7ff053886af0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:31.200553 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7a56875c-094a-4648-a72c-fa88e96c1e3d tempest-VolumesTestJSON-1859352383 tempest-VolumesTestJSON-1859352383-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.175316 Oct 29 03:06:31.201259 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1951/4091] 10.222.0.46 () {58 vars in 1134 bytes} [Sat Oct 29 03:06:31 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:06:31.216066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ad0dcb82-d8cd-44a0-a4d9-8635997b93e7 tempest-VolumesTestJSON-1859352383 tempest-VolumesTestJSON-1859352383-project] Calling method '.version_select at 0x7ff0537041f0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:31.385231 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ad0dcb82-d8cd-44a0-a4d9-8635997b93e7 tempest-VolumesTestJSON-1859352383 tempest-VolumesTestJSON-1859352383-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.174212 Oct 29 03:06:31.386449 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1952/4092] 10.222.0.46 () {58 vars in 1167 bytes} [Sat Oct 29 03:06:31 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:06:31.391609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1dbdd98a-6b44-4d6e-82ab-5c26bfaea281 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:31.392253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1dbdd98a-6b44-4d6e-82ab-5c26bfaea281 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:31.400875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1dbdd98a-6b44-4d6e-82ab-5c26bfaea281 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:31.401567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1dbdd98a-6b44-4d6e-82ab-5c26bfaea281 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:31.402165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1dbdd98a-6b44-4d6e-82ab-5c26bfaea281 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:31.403063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1dbdd98a-6b44-4d6e-82ab-5c26bfaea281 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:31.403666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1dbdd98a-6b44-4d6e-82ab-5c26bfaea281 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:31.404273 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1dbdd98a-6b44-4d6e-82ab-5c26bfaea281 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:31.461520 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-371af7b5-551c-4181-a241-03bee4aab41d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:31.498260 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-371af7b5-551c-4181-a241-03bee4aab41d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1542 microversion: 2.1 time: 1.347464 Oct 29 03:06:31.513503 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2141/4093] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:30 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1542 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:31.526410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d699e92a-b3cd-47cd-990f-74e3b4511eda tempest-VolumesTestJSON-1859352383 tempest-VolumesTestJSON-1859352383-project] Calling method '.version_select at 0x7ff05c042160>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:31.658766 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d699e92a-b3cd-47cd-990f-74e3b4511eda tempest-VolumesTestJSON-1859352383 tempest-VolumesTestJSON-1859352383-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.140123 Oct 29 03:06:31.660890 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2142/4094] 10.222.0.46 () {58 vars in 1170 bytes} [Sat Oct 29 03:06:31 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:31.668901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1dbdd98a-6b44-4d6e-82ab-5c26bfaea281 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f563b6bf99e7480aacedc2a28dbfee01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee274ac8b7204c6a92db7d65a8f4ea62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:31.679371 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ca6759fb-bc3b-4ad0-af87-bae121a1818d tempest-VolumesTestJSON-1859352383 tempest-VolumesTestJSON-1859352383-project] Calling method '.version_select at 0x7ff053ea03a0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:31.680475 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1dbdd98a-6b44-4d6e-82ab-5c26bfaea281 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 200 len: 1323 microversion: 2.1 time: 0.292810 Oct 29 03:06:31.693600 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1953/4095] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:31 2022] GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 1323 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:31.827310 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ca6759fb-bc3b-4ad0-af87-bae121a1818d tempest-VolumesTestJSON-1859352383 tempest-VolumesTestJSON-1859352383-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.156187 Oct 29 03:06:31.828284 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2143/4096] 10.222.0.46 () {58 vars in 1155 bytes} [Sat Oct 29 03:06:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:06:31.849880 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-12eda908-a671-4019-a84b-4781e699693b tempest-VolumesTestJSON-1859352383 tempest-VolumesTestJSON-1859352383-project] Calling method '.version_select at 0x7ff053a81b80>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:32.015525 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-12eda908-a671-4019-a84b-4781e699693b tempest-VolumesTestJSON-1859352383 tempest-VolumesTestJSON-1859352383-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.172071 Oct 29 03:06:32.028658 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1954/4097] 10.222.0.46 () {58 vars in 1188 bytes} [Sat Oct 29 03:06:31 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:32.035646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2703b8cb-99b2-4054-a97d-3887fafe5c76 tempest-VolumesTestJSON-1859352383 tempest-VolumesTestJSON-1859352383-project] Calling method '.version_select at 0x7ff053f84f70>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:32.164880 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2703b8cb-99b2-4054-a97d-3887fafe5c76 tempest-VolumesTestJSON-1859352383 tempest-VolumesTestJSON-1859352383-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.136089 Oct 29 03:06:32.166260 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2144/4098] 10.222.0.46 () {58 vars in 1155 bytes} [Sat Oct 29 03:06:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:32.533772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-68aa3714-5d20-482e-a1c1-fa13c71e4b79 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:32.543260 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-68aa3714-5d20-482e-a1c1-fa13c71e4b79 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:32.569811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68aa3714-5d20-482e-a1c1-fa13c71e4b79 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:32.571038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68aa3714-5d20-482e-a1c1-fa13c71e4b79 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:32.572073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68aa3714-5d20-482e-a1c1-fa13c71e4b79 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:32.574027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68aa3714-5d20-482e-a1c1-fa13c71e4b79 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:32.575220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68aa3714-5d20-482e-a1c1-fa13c71e4b79 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:32.576209 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68aa3714-5d20-482e-a1c1-fa13c71e4b79 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:32.715192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-59f09f94-ae6b-4695-81fc-0d5256e07495 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:32.716651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-59f09f94-ae6b-4695-81fc-0d5256e07495 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:32.743652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59f09f94-ae6b-4695-81fc-0d5256e07495 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:32.747149 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59f09f94-ae6b-4695-81fc-0d5256e07495 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:32.748793 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59f09f94-ae6b-4695-81fc-0d5256e07495 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:32.751754 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59f09f94-ae6b-4695-81fc-0d5256e07495 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:32.753551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59f09f94-ae6b-4695-81fc-0d5256e07495 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:32.756776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59f09f94-ae6b-4695-81fc-0d5256e07495 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:33.029658 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:33.832472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-68aa3714-5d20-482e-a1c1-fa13c71e4b79 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:33.847125 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-68aa3714-5d20-482e-a1c1-fa13c71e4b79 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1542 microversion: 2.1 time: 1.325715 Oct 29 03:06:33.851056 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1955/4099] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:32 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1542 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:33.861927 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-80d4578f-5d35-42cd-a1b2-305926331626 req-67241120-1a8c-493d-aa26-e93d717ab21d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23eb1465-3e98-4ff0-acd6-15c3d092953e", "tag": "00a83dbb-19d1-425c-aada-3a0206b02101"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:33.887359 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-80d4578f-5d35-42cd-a1b2-305926331626 req-67241120-1a8c-493d-aa26-e93d717ab21d service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:33.888238 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-80d4578f-5d35-42cd-a1b2-305926331626 req-67241120-1a8c-493d-aa26-e93d717ab21d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:33.889022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-80d4578f-5d35-42cd-a1b2-305926331626 req-67241120-1a8c-493d-aa26-e93d717ab21d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:33.912415 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-80d4578f-5d35-42cd-a1b2-305926331626 req-67241120-1a8c-493d-aa26-e93d717ab21d service nova] Creating event network-changed:00a83dbb-19d1-425c-aada-3a0206b02101 for instance 23eb1465-3e98-4ff0-acd6-15c3d092953e on n-h1-862967-2 Oct 29 03:06:33.920123 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-80d4578f-5d35-42cd-a1b2-305926331626 req-67241120-1a8c-493d-aa26-e93d717ab21d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067333 Oct 29 03:06:33.921344 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1956/4100] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:33.986711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=8 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:34.233594 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-59f09f94-ae6b-4695-81fc-0d5256e07495 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f563b6bf99e7480aacedc2a28dbfee01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee274ac8b7204c6a92db7d65a8f4ea62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:34.250292 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-59f09f94-ae6b-4695-81fc-0d5256e07495 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 200 len: 1323 microversion: 2.1 time: 1.546581 Oct 29 03:06:34.258217 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2145/4101] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:32 2022] GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 1323 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:34.880590 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-90938239-4336-41b8-a2c1-3c12457fc07a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:34.881861 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-90938239-4336-41b8-a2c1-3c12457fc07a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:34.898922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90938239-4336-41b8-a2c1-3c12457fc07a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:34.899800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90938239-4336-41b8-a2c1-3c12457fc07a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:34.900279 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90938239-4336-41b8-a2c1-3c12457fc07a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:34.901407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90938239-4336-41b8-a2c1-3c12457fc07a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:34.901889 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90938239-4336-41b8-a2c1-3c12457fc07a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:34.902323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90938239-4336-41b8-a2c1-3c12457fc07a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:35.278458 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b40e8177-e618-415c-94d9-47f2c7f65aad tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:35.280606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b40e8177-e618-415c-94d9-47f2c7f65aad tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:35.296567 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b40e8177-e618-415c-94d9-47f2c7f65aad tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:35.299738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b40e8177-e618-415c-94d9-47f2c7f65aad tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:35.301847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b40e8177-e618-415c-94d9-47f2c7f65aad tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:35.305335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b40e8177-e618-415c-94d9-47f2c7f65aad tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:35.313062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b40e8177-e618-415c-94d9-47f2c7f65aad tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:35.315810 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b40e8177-e618-415c-94d9-47f2c7f65aad tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:35.834736 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-90938239-4336-41b8-a2c1-3c12457fc07a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:35.854035 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-90938239-4336-41b8-a2c1-3c12457fc07a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1542 microversion: 2.1 time: 0.978839 Oct 29 03:06:35.854638 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1957/4102] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:34 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1542 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:06:36.288987 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b40e8177-e618-415c-94d9-47f2c7f65aad tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f563b6bf99e7480aacedc2a28dbfee01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee274ac8b7204c6a92db7d65a8f4ea62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:36.313849 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b40e8177-e618-415c-94d9-47f2c7f65aad tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 200 len: 1323 microversion: 2.1 time: 1.032342 Oct 29 03:06:36.315851 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2146/4103] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:35 2022] GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 1323 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:36.879262 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7adc0258-8133-4256-b9a7-518942048e13 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:36.883823 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7adc0258-8133-4256-b9a7-518942048e13 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:36.898278 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7adc0258-8133-4256-b9a7-518942048e13 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:36.899055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7adc0258-8133-4256-b9a7-518942048e13 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:36.899669 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7adc0258-8133-4256-b9a7-518942048e13 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:36.900617 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7adc0258-8133-4256-b9a7-518942048e13 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:36.901242 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7adc0258-8133-4256-b9a7-518942048e13 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:36.901824 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7adc0258-8133-4256-b9a7-518942048e13 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:37.341681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a943a342-275a-443f-be3b-8b05579a5198 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:37.343569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a943a342-275a-443f-be3b-8b05579a5198 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:37.353183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a943a342-275a-443f-be3b-8b05579a5198 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:37.354225 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a943a342-275a-443f-be3b-8b05579a5198 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:37.354860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a943a342-275a-443f-be3b-8b05579a5198 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:37.355805 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a943a342-275a-443f-be3b-8b05579a5198 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:37.356757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a943a342-275a-443f-be3b-8b05579a5198 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:37.357830 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a943a342-275a-443f-be3b-8b05579a5198 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:38.002015 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7adc0258-8133-4256-b9a7-518942048e13 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:38.017486 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7adc0258-8133-4256-b9a7-518942048e13 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1542 microversion: 2.1 time: 1.142240 Oct 29 03:06:38.019003 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1958/4104] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:36 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1542 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:38.813692 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a943a342-275a-443f-be3b-8b05579a5198 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f563b6bf99e7480aacedc2a28dbfee01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee274ac8b7204c6a92db7d65a8f4ea62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:38.829152 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a943a342-275a-443f-be3b-8b05579a5198 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 200 len: 1323 microversion: 2.1 time: 1.493332 Oct 29 03:06:38.844562 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2147/4105] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:37 2022] GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 1323 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:39.041251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-46b6f5b0-92c4-433e-b433-0768733ea573 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:39.043770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-46b6f5b0-92c4-433e-b433-0768733ea573 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:39.054325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46b6f5b0-92c4-433e-b433-0768733ea573 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:39.058065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46b6f5b0-92c4-433e-b433-0768733ea573 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:39.058719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46b6f5b0-92c4-433e-b433-0768733ea573 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:39.061754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46b6f5b0-92c4-433e-b433-0768733ea573 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:39.062404 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46b6f5b0-92c4-433e-b433-0768733ea573 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:39.063541 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46b6f5b0-92c4-433e-b433-0768733ea573 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:39.859247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6d8f996a-578b-4f80-a5c5-ebd27b85c5cb tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:39.860496 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6d8f996a-578b-4f80-a5c5-ebd27b85c5cb tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:39.876370 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d8f996a-578b-4f80-a5c5-ebd27b85c5cb tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:39.877376 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d8f996a-578b-4f80-a5c5-ebd27b85c5cb tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:39.878816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d8f996a-578b-4f80-a5c5-ebd27b85c5cb tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:39.880790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d8f996a-578b-4f80-a5c5-ebd27b85c5cb tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:39.884984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d8f996a-578b-4f80-a5c5-ebd27b85c5cb tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:39.885632 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d8f996a-578b-4f80-a5c5-ebd27b85c5cb tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:39.925860 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-46b6f5b0-92c4-433e-b433-0768733ea573 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:39.935148 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-46b6f5b0-92c4-433e-b433-0768733ea573 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1542 microversion: 2.1 time: 0.898078 Oct 29 03:06:39.943315 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1959/4106] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:39 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1542 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:40.621233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6d8f996a-578b-4f80-a5c5-ebd27b85c5cb tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f563b6bf99e7480aacedc2a28dbfee01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee274ac8b7204c6a92db7d65a8f4ea62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:40.634712 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6d8f996a-578b-4f80-a5c5-ebd27b85c5cb tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 200 len: 1323 microversion: 2.1 time: 0.778928 Oct 29 03:06:40.652419 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2148/4107] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:39 2022] GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 1323 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:40.993623 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-77260fcd-a3ed-419c-aadd-c04d69ba4e00 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:40.996656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-77260fcd-a3ed-419c-aadd-c04d69ba4e00 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:41.009380 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77260fcd-a3ed-419c-aadd-c04d69ba4e00 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:41.010351 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77260fcd-a3ed-419c-aadd-c04d69ba4e00 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:41.011229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77260fcd-a3ed-419c-aadd-c04d69ba4e00 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:41.012658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77260fcd-a3ed-419c-aadd-c04d69ba4e00 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:41.013643 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77260fcd-a3ed-419c-aadd-c04d69ba4e00 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:41.014571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77260fcd-a3ed-419c-aadd-c04d69ba4e00 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:41.667240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-582185b5-7bbb-4f84-9f4e-c0b24860a813 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:41.668996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-582185b5-7bbb-4f84-9f4e-c0b24860a813 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:41.696598 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-582185b5-7bbb-4f84-9f4e-c0b24860a813 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:41.697001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-582185b5-7bbb-4f84-9f4e-c0b24860a813 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:41.697455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-582185b5-7bbb-4f84-9f4e-c0b24860a813 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:41.698186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-582185b5-7bbb-4f84-9f4e-c0b24860a813 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:41.698781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-582185b5-7bbb-4f84-9f4e-c0b24860a813 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:41.699215 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-582185b5-7bbb-4f84-9f4e-c0b24860a813 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:42.054654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-582185b5-7bbb-4f84-9f4e-c0b24860a813 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f563b6bf99e7480aacedc2a28dbfee01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee274ac8b7204c6a92db7d65a8f4ea62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:42.086615 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-582185b5-7bbb-4f84-9f4e-c0b24860a813 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 200 len: 1323 microversion: 2.1 time: 0.429279 Oct 29 03:06:42.087799 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2149/4108] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:41 2022] GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 1323 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:06:43.139792 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e44b50c9-cb2d-4fec-aece-7b0cbbfd78cf tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:43.143506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e44b50c9-cb2d-4fec-aece-7b0cbbfd78cf tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:43.186571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e44b50c9-cb2d-4fec-aece-7b0cbbfd78cf tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:43.189136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e44b50c9-cb2d-4fec-aece-7b0cbbfd78cf tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:43.191900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e44b50c9-cb2d-4fec-aece-7b0cbbfd78cf tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:43.194047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e44b50c9-cb2d-4fec-aece-7b0cbbfd78cf tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:43.194546 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e44b50c9-cb2d-4fec-aece-7b0cbbfd78cf tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:43.196396 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e44b50c9-cb2d-4fec-aece-7b0cbbfd78cf tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:43.219788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-77260fcd-a3ed-419c-aadd-c04d69ba4e00 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:43.240811 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-77260fcd-a3ed-419c-aadd-c04d69ba4e00 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1542 microversion: 2.1 time: 2.252639 Oct 29 03:06:43.242388 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1960/4109] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:40 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1542 bytes in 2257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:43.773975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e44b50c9-cb2d-4fec-aece-7b0cbbfd78cf tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f563b6bf99e7480aacedc2a28dbfee01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee274ac8b7204c6a92db7d65a8f4ea62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:43.789910 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e44b50c9-cb2d-4fec-aece-7b0cbbfd78cf tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 200 len: 1323 microversion: 2.1 time: 0.664879 Oct 29 03:06:43.790651 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2150/4110] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:43 2022] GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 1323 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:06:44.270161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c26fa267-826b-4d60-8f0b-e23bcb022c7b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:44.270801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c26fa267-826b-4d60-8f0b-e23bcb022c7b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:44.298798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c26fa267-826b-4d60-8f0b-e23bcb022c7b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:44.299306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c26fa267-826b-4d60-8f0b-e23bcb022c7b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:44.303419 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c26fa267-826b-4d60-8f0b-e23bcb022c7b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:44.305981 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c26fa267-826b-4d60-8f0b-e23bcb022c7b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:44.306493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c26fa267-826b-4d60-8f0b-e23bcb022c7b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:44.312503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c26fa267-826b-4d60-8f0b-e23bcb022c7b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:44.657589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-de8f1740-8ae8-4b8b-b56a-9f04fc882452 req-61d89893-c403-4ec2-8326-250427aa9029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23eb1465-3e98-4ff0-acd6-15c3d092953e", "name": "network-vif-plugged", "status": "completed", "tag": "00a83dbb-19d1-425c-aada-3a0206b02101"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:44.688666 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-de8f1740-8ae8-4b8b-b56a-9f04fc882452 req-61d89893-c403-4ec2-8326-250427aa9029 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:44.692737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-de8f1740-8ae8-4b8b-b56a-9f04fc882452 req-61d89893-c403-4ec2-8326-250427aa9029 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:44.693347 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-de8f1740-8ae8-4b8b-b56a-9f04fc882452 req-61d89893-c403-4ec2-8326-250427aa9029 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:44.725986 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-de8f1740-8ae8-4b8b-b56a-9f04fc882452 req-61d89893-c403-4ec2-8326-250427aa9029 service nova] Creating event network-vif-plugged:00a83dbb-19d1-425c-aada-3a0206b02101 for instance 23eb1465-3e98-4ff0-acd6-15c3d092953e on n-h1-862967-2 Oct 29 03:06:44.742890 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-de8f1740-8ae8-4b8b-b56a-9f04fc882452 req-61d89893-c403-4ec2-8326-250427aa9029 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091599 Oct 29 03:06:44.743550 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2151/4111] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:44.820156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f7d95058-56c0-4bf5-95e6-40b3fb219f5c tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:44.821119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f7d95058-56c0-4bf5-95e6-40b3fb219f5c tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:44.856387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7d95058-56c0-4bf5-95e6-40b3fb219f5c tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:44.857574 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7d95058-56c0-4bf5-95e6-40b3fb219f5c tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:44.863079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7d95058-56c0-4bf5-95e6-40b3fb219f5c tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:44.871093 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7d95058-56c0-4bf5-95e6-40b3fb219f5c tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:44.872691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7d95058-56c0-4bf5-95e6-40b3fb219f5c tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:44.873295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7d95058-56c0-4bf5-95e6-40b3fb219f5c tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:45.217258 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c26fa267-826b-4d60-8f0b-e23bcb022c7b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:45.219193 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f7d95058-56c0-4bf5-95e6-40b3fb219f5c tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f563b6bf99e7480aacedc2a28dbfee01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee274ac8b7204c6a92db7d65a8f4ea62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:45.231910 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f7d95058-56c0-4bf5-95e6-40b3fb219f5c tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 200 len: 1323 microversion: 2.1 time: 0.418883 Oct 29 03:06:45.233679 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2152/4112] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:44 2022] GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 1323 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:06:45.297186 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c26fa267-826b-4d60-8f0b-e23bcb022c7b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1542 microversion: 2.1 time: 1.022254 Oct 29 03:06:45.298936 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1961/4113] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:44 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1542 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:46.269633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1daa86ee-8ae4-4bba-be93-cb355cbd3a51 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:46.270258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1daa86ee-8ae4-4bba-be93-cb355cbd3a51 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:46.283988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1daa86ee-8ae4-4bba-be93-cb355cbd3a51 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:46.284492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1daa86ee-8ae4-4bba-be93-cb355cbd3a51 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:46.284978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1daa86ee-8ae4-4bba-be93-cb355cbd3a51 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:46.285699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1daa86ee-8ae4-4bba-be93-cb355cbd3a51 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:46.286154 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1daa86ee-8ae4-4bba-be93-cb355cbd3a51 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:46.286578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1daa86ee-8ae4-4bba-be93-cb355cbd3a51 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:46.329547 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-efa77edb-f3f4-49ec-bbeb-2b9ef873deb6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:46.330360 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-efa77edb-f3f4-49ec-bbeb-2b9ef873deb6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:46.347090 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efa77edb-f3f4-49ec-bbeb-2b9ef873deb6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:46.349022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efa77edb-f3f4-49ec-bbeb-2b9ef873deb6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:46.350334 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efa77edb-f3f4-49ec-bbeb-2b9ef873deb6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:46.355342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efa77edb-f3f4-49ec-bbeb-2b9ef873deb6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:46.357542 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efa77edb-f3f4-49ec-bbeb-2b9ef873deb6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:46.358194 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-efa77edb-f3f4-49ec-bbeb-2b9ef873deb6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:47.200688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1daa86ee-8ae4-4bba-be93-cb355cbd3a51 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f563b6bf99e7480aacedc2a28dbfee01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee274ac8b7204c6a92db7d65a8f4ea62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:47.222788 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1daa86ee-8ae4-4bba-be93-cb355cbd3a51 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 200 len: 1323 microversion: 2.1 time: 0.955742 Oct 29 03:06:47.224015 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2153/4114] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:46 2022] GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 1323 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:48.252899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fc6d0c36-6592-48f1-9fd1-ccd41fbe3644 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:48.254239 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fc6d0c36-6592-48f1-9fd1-ccd41fbe3644 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:48.276454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc6d0c36-6592-48f1-9fd1-ccd41fbe3644 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:48.289397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc6d0c36-6592-48f1-9fd1-ccd41fbe3644 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:48.290101 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc6d0c36-6592-48f1-9fd1-ccd41fbe3644 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:48.291029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc6d0c36-6592-48f1-9fd1-ccd41fbe3644 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:48.291488 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc6d0c36-6592-48f1-9fd1-ccd41fbe3644 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:48.291920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc6d0c36-6592-48f1-9fd1-ccd41fbe3644 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:48.458864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-efa77edb-f3f4-49ec-bbeb-2b9ef873deb6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:48.472343 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-efa77edb-f3f4-49ec-bbeb-2b9ef873deb6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1541 microversion: 2.1 time: 2.154077 Oct 29 03:06:48.492796 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1962/4115] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:46 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1541 bytes in 2168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:06:48.677558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fc6d0c36-6592-48f1-9fd1-ccd41fbe3644 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f563b6bf99e7480aacedc2a28dbfee01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee274ac8b7204c6a92db7d65a8f4ea62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:48.694037 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fc6d0c36-6592-48f1-9fd1-ccd41fbe3644 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 200 len: 1517 microversion: 2.1 time: 0.444978 Oct 29 03:06:48.716092 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2154/4116] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:48 2022] GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 1517 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:06:48.730172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-145229b9-abaf-46ff-8c60-370051a7952d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:48.735276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-145229b9-abaf-46ff-8c60-370051a7952d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:48.752274 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-145229b9-abaf-46ff-8c60-370051a7952d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:48.753746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-145229b9-abaf-46ff-8c60-370051a7952d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:48.757044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-145229b9-abaf-46ff-8c60-370051a7952d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:48.761738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-145229b9-abaf-46ff-8c60-370051a7952d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:48.765012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-145229b9-abaf-46ff-8c60-370051a7952d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:48.766451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-145229b9-abaf-46ff-8c60-370051a7952d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:48.844310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-145229b9-abaf-46ff-8c60-370051a7952d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lazy-loading 'flavor' on Instance uuid 23eb1465-3e98-4ff0-acd6-15c3d092953e {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:06:48.860046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-32ab405e-264f-44c3-aa27-756f69ec8804 req-41850355-af23-48aa-9f32-10c1640e7237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f60b0652-637b-48dd-8e61-950c0fe5b4c0", "name": "network-vif-unplugged", "status": "completed", "tag": "7221ab02-8b17-48e5-a7aa-ed98c8fe3c5c"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:48.883797 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-32ab405e-264f-44c3-aa27-756f69ec8804 req-41850355-af23-48aa-9f32-10c1640e7237 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:48.884658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-32ab405e-264f-44c3-aa27-756f69ec8804 req-41850355-af23-48aa-9f32-10c1640e7237 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:48.888848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-32ab405e-264f-44c3-aa27-756f69ec8804 req-41850355-af23-48aa-9f32-10c1640e7237 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:48.923111 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-32ab405e-264f-44c3-aa27-756f69ec8804 req-41850355-af23-48aa-9f32-10c1640e7237 service nova] Creating event network-vif-unplugged:7221ab02-8b17-48e5-a7aa-ed98c8fe3c5c for instance f60b0652-637b-48dd-8e61-950c0fe5b4c0 on n-h1-862967-2 Oct 29 03:06:48.933323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [req-32ab405e-264f-44c3-aa27-756f69ec8804 req-41850355-af23-48aa-9f32-10c1640e7237 service nova] Instance f60b0652-637b-48dd-8e61-950c0fe5b4c0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:06:48.972580 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-32ab405e-264f-44c3-aa27-756f69ec8804 req-41850355-af23-48aa-9f32-10c1640e7237 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.428580 Oct 29 03:06:48.975084 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1963/4117] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:49.031570 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-145229b9-abaf-46ff-8c60-370051a7952d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "POST /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e/action" status: 200 len: 32 microversion: 2.1 time: 0.309386 Oct 29 03:06:49.043762 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b260f319-6870-4030-a88a-5342272a0486 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:49.044487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b260f319-6870-4030-a88a-5342272a0486 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:49.048330 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2155/4118] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:06:48 2022] POST /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e/action => generated 32 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:06:49.053597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b260f319-6870-4030-a88a-5342272a0486 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:49.054096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b260f319-6870-4030-a88a-5342272a0486 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:49.054589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b260f319-6870-4030-a88a-5342272a0486 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:49.055305 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b260f319-6870-4030-a88a-5342272a0486 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:49.055935 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b260f319-6870-4030-a88a-5342272a0486 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:49.056603 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b260f319-6870-4030-a88a-5342272a0486 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:49.520468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3e76aa87-df4f-43d9-82a0-0ade15216d8e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:49.531800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3e76aa87-df4f-43d9-82a0-0ade15216d8e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:49.578894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3e76aa87-df4f-43d9-82a0-0ade15216d8e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:49.593690 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3e76aa87-df4f-43d9-82a0-0ade15216d8e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:49.594436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3e76aa87-df4f-43d9-82a0-0ade15216d8e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:49.595724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3e76aa87-df4f-43d9-82a0-0ade15216d8e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:49.601508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3e76aa87-df4f-43d9-82a0-0ade15216d8e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:49.602301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3e76aa87-df4f-43d9-82a0-0ade15216d8e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:50.904461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b260f319-6870-4030-a88a-5342272a0486 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f563b6bf99e7480aacedc2a28dbfee01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee274ac8b7204c6a92db7d65a8f4ea62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:50.920628 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b260f319-6870-4030-a88a-5342272a0486 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 200 len: 1523 microversion: 2.1 time: 1.881498 Oct 29 03:06:50.921242 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1964/4119] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:49 2022] GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 1523 bytes in 1883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:51.021261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3e76aa87-df4f-43d9-82a0-0ade15216d8e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:51.053822 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3e76aa87-df4f-43d9-82a0-0ade15216d8e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1541 microversion: 2.1 time: 1.549484 Oct 29 03:06:51.060950 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2156/4120] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:49 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1541 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:51.259946 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-f93c48c1-04d8-4bc8-8dfa-5c5fe1f4bc3c req-63193576-3978-448b-8f44-b7f7e134c39e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f60b0652-637b-48dd-8e61-950c0fe5b4c0", "tag": "7221ab02-8b17-48e5-a7aa-ed98c8fe3c5c"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:51.321236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f93c48c1-04d8-4bc8-8dfa-5c5fe1f4bc3c req-63193576-3978-448b-8f44-b7f7e134c39e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:51.322323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f93c48c1-04d8-4bc8-8dfa-5c5fe1f4bc3c req-63193576-3978-448b-8f44-b7f7e134c39e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:51.323159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f93c48c1-04d8-4bc8-8dfa-5c5fe1f4bc3c req-63193576-3978-448b-8f44-b7f7e134c39e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:51.377692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-00fc4ed8-aa89-40c4-a710-23aecb53fc84 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Action: 'create', calling method: .version_select at 0x7ff053a85af0>, body: {"keypair": {"name": "tempest-keypair-1912400694", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy5Bos5HMtRLSA+FWD/r/xOgma6fzcPC193nZRY9QH7/wdlGKBbr59+Btl8XKjhrTuWuSXuMscnNcyrHx/htjaJqHK8Ui9j89gs/uVFuLMEfoQWrt6wIO8rKQXZkvY0gw=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:06:51.386839 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-f93c48c1-04d8-4bc8-8dfa-5c5fe1f4bc3c req-63193576-3978-448b-8f44-b7f7e134c39e service nova] Creating event network-changed:7221ab02-8b17-48e5-a7aa-ed98c8fe3c5c for instance f60b0652-637b-48dd-8e61-950c0fe5b4c0 on n-h1-862967-2 Oct 29 03:06:51.416924 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [req-f93c48c1-04d8-4bc8-8dfa-5c5fe1f4bc3c req-63193576-3978-448b-8f44-b7f7e134c39e service nova] Instance f60b0652-637b-48dd-8e61-950c0fe5b4c0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:06:51.428167 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-00fc4ed8-aa89-40c4-a710-23aecb53fc84 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Getting quotas for project f4853225daef418bb782b4f9f6d1382c. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:06:51.446933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-00fc4ed8-aa89-40c4-a710-23aecb53fc84 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Getting quotas for user 494c556b424a4fa388680ab08a340a1d and project f4853225daef418bb782b4f9f6d1382c. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:06:51.467570 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-f93c48c1-04d8-4bc8-8dfa-5c5fe1f4bc3c req-63193576-3978-448b-8f44-b7f7e134c39e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214369 Oct 29 03:06:51.469902 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2157/4121] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:51.509185 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-00fc4ed8-aa89-40c4-a710-23aecb53fc84 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.586418 Oct 29 03:06:51.512458 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1965/4122] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:06:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:06:51.951865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6608fce7-ca62-4a98-87b1-12bc6b010dc7 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:51.959118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6608fce7-ca62-4a98-87b1-12bc6b010dc7 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:51.988981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6608fce7-ca62-4a98-87b1-12bc6b010dc7 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:51.991043 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6608fce7-ca62-4a98-87b1-12bc6b010dc7 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:51.992195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6608fce7-ca62-4a98-87b1-12bc6b010dc7 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:51.993743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6608fce7-ca62-4a98-87b1-12bc6b010dc7 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:52.000933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6608fce7-ca62-4a98-87b1-12bc6b010dc7 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:52.002072 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6608fce7-ca62-4a98-87b1-12bc6b010dc7 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:52.087447 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2117ee40-72f2-4b51-88a4-01ee5bae32d2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:52.088273 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2117ee40-72f2-4b51-88a4-01ee5bae32d2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:52.104361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2117ee40-72f2-4b51-88a4-01ee5bae32d2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:52.107281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2117ee40-72f2-4b51-88a4-01ee5bae32d2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:52.107805 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2117ee40-72f2-4b51-88a4-01ee5bae32d2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:52.108601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2117ee40-72f2-4b51-88a4-01ee5bae32d2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:52.109082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2117ee40-72f2-4b51-88a4-01ee5bae32d2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:52.109506 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2117ee40-72f2-4b51-88a4-01ee5bae32d2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:53.536398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6608fce7-ca62-4a98-87b1-12bc6b010dc7 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f563b6bf99e7480aacedc2a28dbfee01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee274ac8b7204c6a92db7d65a8f4ea62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:53.578092 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6608fce7-ca62-4a98-87b1-12bc6b010dc7 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 200 len: 1523 microversion: 2.1 time: 1.635669 Oct 29 03:06:53.582234 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2158/4123] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:51 2022] GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 1523 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:53.980871 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2117ee40-72f2-4b51-88a4-01ee5bae32d2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:53.983752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=94 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:54.017136 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2117ee40-72f2-4b51-88a4-01ee5bae32d2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1541 microversion: 2.1 time: 1.933740 Oct 29 03:06:54.019137 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1966/4124] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:52 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1541 bytes in 1938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:06:54.603844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4f0703c1-c1d7-49db-8653-646a0f44bb46 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:54.604511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4f0703c1-c1d7-49db-8653-646a0f44bb46 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:54.618238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f0703c1-c1d7-49db-8653-646a0f44bb46 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:54.618750 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f0703c1-c1d7-49db-8653-646a0f44bb46 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:54.621302 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f0703c1-c1d7-49db-8653-646a0f44bb46 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:54.623972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f0703c1-c1d7-49db-8653-646a0f44bb46 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:54.624461 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f0703c1-c1d7-49db-8653-646a0f44bb46 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:54.624936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f0703c1-c1d7-49db-8653-646a0f44bb46 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:55.050549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-86301317-283f-43d0-a48e-89fb4ee9ed89 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:55.051371 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-86301317-283f-43d0-a48e-89fb4ee9ed89 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:55.081070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86301317-283f-43d0-a48e-89fb4ee9ed89 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:55.081430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86301317-283f-43d0-a48e-89fb4ee9ed89 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:55.082166 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86301317-283f-43d0-a48e-89fb4ee9ed89 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:55.086774 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86301317-283f-43d0-a48e-89fb4ee9ed89 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:55.090030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86301317-283f-43d0-a48e-89fb4ee9ed89 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:55.090766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86301317-283f-43d0-a48e-89fb4ee9ed89 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:55.845919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4f0703c1-c1d7-49db-8653-646a0f44bb46 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f563b6bf99e7480aacedc2a28dbfee01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee274ac8b7204c6a92db7d65a8f4ea62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:55.873254 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4f0703c1-c1d7-49db-8653-646a0f44bb46 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 200 len: 1523 microversion: 2.1 time: 1.261972 Oct 29 03:06:55.873967 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2159/4125] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:54 2022] GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 1523 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:56.728814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-86301317-283f-43d0-a48e-89fb4ee9ed89 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:56.759510 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-86301317-283f-43d0-a48e-89fb4ee9ed89 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1541 microversion: 2.1 time: 1.712102 Oct 29 03:06:56.761896 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1967/4126] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:55 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1541 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:56.904047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9e486f9d-c6e6-4e1b-ad02-892a235b5871 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:56.909038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9e486f9d-c6e6-4e1b-ad02-892a235b5871 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:56.936041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e486f9d-c6e6-4e1b-ad02-892a235b5871 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:56.936918 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e486f9d-c6e6-4e1b-ad02-892a235b5871 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:56.937926 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e486f9d-c6e6-4e1b-ad02-892a235b5871 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:56.942071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e486f9d-c6e6-4e1b-ad02-892a235b5871 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:56.943248 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e486f9d-c6e6-4e1b-ad02-892a235b5871 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:56.948555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e486f9d-c6e6-4e1b-ad02-892a235b5871 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:57.041812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:57.797994 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f1c5f19f-ce75-49d8-b690-290f882c9bca tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:57.803526 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f1c5f19f-ce75-49d8-b690-290f882c9bca tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:57.834506 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:57.842040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1c5f19f-ce75-49d8-b690-290f882c9bca tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:57.842909 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1c5f19f-ce75-49d8-b690-290f882c9bca tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:57.843669 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1c5f19f-ce75-49d8-b690-290f882c9bca tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:57.849134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1c5f19f-ce75-49d8-b690-290f882c9bca tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:57.852087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1c5f19f-ce75-49d8-b690-290f882c9bca tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:57.852997 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1c5f19f-ce75-49d8-b690-290f882c9bca tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:58.484217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9e486f9d-c6e6-4e1b-ad02-892a235b5871 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f563b6bf99e7480aacedc2a28dbfee01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee274ac8b7204c6a92db7d65a8f4ea62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:06:58.505507 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9e486f9d-c6e6-4e1b-ad02-892a235b5871 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 200 len: 1523 microversion: 2.1 time: 1.609165 Oct 29 03:06:58.519751 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2160/4127] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:56 2022] GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 1523 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:06:59.541050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2d6cf158-8c28-49e7-9db0-3440be929fbe tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:06:59.542109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2d6cf158-8c28-49e7-9db0-3440be929fbe tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:06:59.558663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2d6cf158-8c28-49e7-9db0-3440be929fbe tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:59.562126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2d6cf158-8c28-49e7-9db0-3440be929fbe tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:59.563748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2d6cf158-8c28-49e7-9db0-3440be929fbe tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:06:59.566041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2d6cf158-8c28-49e7-9db0-3440be929fbe tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:06:59.567510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2d6cf158-8c28-49e7-9db0-3440be929fbe tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:06:59.569025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2d6cf158-8c28-49e7-9db0-3440be929fbe tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:00.009690 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f1c5f19f-ce75-49d8-b690-290f882c9bca tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:00.043675 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f1c5f19f-ce75-49d8-b690-290f882c9bca tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1473 microversion: 2.1 time: 2.246276 Oct 29 03:07:00.062558 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1968/4128] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:57 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1473 bytes in 2275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:00.356759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2d6cf158-8c28-49e7-9db0-3440be929fbe tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f563b6bf99e7480aacedc2a28dbfee01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee274ac8b7204c6a92db7d65a8f4ea62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:00.373008 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2d6cf158-8c28-49e7-9db0-3440be929fbe tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 200 len: 1523 microversion: 2.1 time: 0.836750 Oct 29 03:07:00.392194 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2161/4129] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:06:59 2022] GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 1523 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:07:01.072070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4dd3c57b-1e0e-4cb1-bea7-0cf7738ffe5e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:01.076354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4dd3c57b-1e0e-4cb1-bea7-0cf7738ffe5e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:01.133781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=36 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:01.148679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4dd3c57b-1e0e-4cb1-bea7-0cf7738ffe5e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:01.152103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4dd3c57b-1e0e-4cb1-bea7-0cf7738ffe5e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:01.153255 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4dd3c57b-1e0e-4cb1-bea7-0cf7738ffe5e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:01.154275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4dd3c57b-1e0e-4cb1-bea7-0cf7738ffe5e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:01.154894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4dd3c57b-1e0e-4cb1-bea7-0cf7738ffe5e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:01.155490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4dd3c57b-1e0e-4cb1-bea7-0cf7738ffe5e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:01.328803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d5ccc248-52c2-4594-aefd-b1ae472ce76d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1093880334", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "422060dc-f3e4-4259-bfc7-fe63290d7156"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:01.407666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-d5ccc248-52c2-4594-aefd-b1ae472ce76d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] validate_networks() for [('422060dc-f3e4-4259-bfc7-fe63290d7156', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:07:01.470397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:01.760744 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4dd3c57b-1e0e-4cb1-bea7-0cf7738ffe5e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:01.770146 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4dd3c57b-1e0e-4cb1-bea7-0cf7738ffe5e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1470 microversion: 2.1 time: 0.705951 Oct 29 03:07:01.786103 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2162/4130] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:01 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1470 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:01.800875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bd4dc48c-fad5-44c9-a084-fe65c94807da tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:01.801673 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bd4dc48c-fad5-44c9-a084-fe65c94807da tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:01.812406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd4dc48c-fad5-44c9-a084-fe65c94807da tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:01.813403 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd4dc48c-fad5-44c9-a084-fe65c94807da tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:01.816615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd4dc48c-fad5-44c9-a084-fe65c94807da tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:01.817964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd4dc48c-fad5-44c9-a084-fe65c94807da tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:01.818811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd4dc48c-fad5-44c9-a084-fe65c94807da tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:01.819254 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd4dc48c-fad5-44c9-a084-fe65c94807da tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:02.335839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bd4dc48c-fad5-44c9-a084-fe65c94807da tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f563b6bf99e7480aacedc2a28dbfee01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee274ac8b7204c6a92db7d65a8f4ea62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:02.362188 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bd4dc48c-fad5-44c9-a084-fe65c94807da tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 200 len: 1523 microversion: 2.1 time: 0.566774 Oct 29 03:07:02.363852 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2163/4131] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:01 2022] GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 1523 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:02.387410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-72b9092a-c66c-449a-bd34-5e80417ed007 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:02.389240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-72b9092a-c66c-449a-bd34-5e80417ed007 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:02.417327 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72b9092a-c66c-449a-bd34-5e80417ed007 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:02.419355 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72b9092a-c66c-449a-bd34-5e80417ed007 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:02.422951 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72b9092a-c66c-449a-bd34-5e80417ed007 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:02.424264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72b9092a-c66c-449a-bd34-5e80417ed007 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:02.425032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72b9092a-c66c-449a-bd34-5e80417ed007 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:02.428181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72b9092a-c66c-449a-bd34-5e80417ed007 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:02.535549 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72b9092a-c66c-449a-bd34-5e80417ed007 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:02.536042 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72b9092a-c66c-449a-bd34-5e80417ed007 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:02.537224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72b9092a-c66c-449a-bd34-5e80417ed007 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:02.537348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72b9092a-c66c-449a-bd34-5e80417ed007 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:02.537702 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72b9092a-c66c-449a-bd34-5e80417ed007 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:02.538129 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72b9092a-c66c-449a-bd34-5e80417ed007 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:02.595706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-72b9092a-c66c-449a-bd34-5e80417ed007 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Getting quotas for project 830acea7f5b948409e4b69d02aaeaf3b. Resources: {'cores', 'ram'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:07:02.605188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-72b9092a-c66c-449a-bd34-5e80417ed007 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Getting quotas for user 7d3a840b017844a7b45b98bea21e8e38 and project 830acea7f5b948409e4b69d02aaeaf3b. Resources: {'cores', 'ram'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:07:02.891853 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-72b9092a-c66c-449a-bd34-5e80417ed007 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "POST /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0/action" status: 202 len: 0 microversion: 2.1 time: 0.522631 Oct 29 03:07:02.895998 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2164/4132] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:07:02 2022] POST /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:07:03.213810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-d5ccc248-52c2-4594-aefd-b1ae472ce76d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:07:03.213810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-d5ccc248-52c2-4594-aefd-b1ae472ce76d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:07:03.213810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-d5ccc248-52c2-4594-aefd-b1ae472ce76d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:07:03.213810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-d5ccc248-52c2-4594-aefd-b1ae472ce76d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:07:03.213810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-d5ccc248-52c2-4594-aefd-b1ae472ce76d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:07:03.228275 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5ccc248-52c2-4594-aefd-b1ae472ce76d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:03.229940 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5ccc248-52c2-4594-aefd-b1ae472ce76d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:03.230514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5ccc248-52c2-4594-aefd-b1ae472ce76d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:03.232265 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5ccc248-52c2-4594-aefd-b1ae472ce76d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:03.235884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5ccc248-52c2-4594-aefd-b1ae472ce76d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:03.236497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5ccc248-52c2-4594-aefd-b1ae472ce76d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:03.288396 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-d5ccc248-52c2-4594-aefd-b1ae472ce76d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Getting quotas for project ba5398fd3ca249b098fbaf6c2cb3b1ba. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:07:03.303702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-d5ccc248-52c2-4594-aefd-b1ae472ce76d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Getting quotas for user d5feeb5524b34e7f91decfd441023a61 and project ba5398fd3ca249b098fbaf6c2cb3b1ba. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:07:03.336899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d5ccc248-52c2-4594-aefd-b1ae472ce76d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:07:03.344273 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d5ccc248-52c2-4594-aefd-b1ae472ce76d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] [instance: d9632deb-2bc8-41bc-a569-7adc8ee7aeae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:07:03.452607 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d5ccc248-52c2-4594-aefd-b1ae472ce76d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.481774 Oct 29 03:07:03.456606 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1969/4133] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:07:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:07:03.467755 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2b858516-5313-4ef7-af40-0f66b2589a09 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:03.472318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2b858516-5313-4ef7-af40-0f66b2589a09 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:03.485251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b858516-5313-4ef7-af40-0f66b2589a09 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:03.486734 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b858516-5313-4ef7-af40-0f66b2589a09 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:03.487741 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b858516-5313-4ef7-af40-0f66b2589a09 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:03.489100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b858516-5313-4ef7-af40-0f66b2589a09 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:03.490111 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b858516-5313-4ef7-af40-0f66b2589a09 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:03.491215 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b858516-5313-4ef7-af40-0f66b2589a09 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:03.592920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e77959d5-256b-4e23-886b-3d444c40e741 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1875235207", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "6c59e214-5839-4bff-bfed-21b7256669fd"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:03.719717 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-e77959d5-256b-4e23-886b-3d444c40e741 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] validate_networks() for [('6c59e214-5839-4bff-bfed-21b7256669fd', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:07:04.741844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2b858516-5313-4ef7-af40-0f66b2589a09 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:04.769702 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2b858516-5313-4ef7-af40-0f66b2589a09 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1469 microversion: 2.1 time: 1.310120 Oct 29 03:07:04.772114 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1970/4134] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:03 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1469 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:04.807217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5d6611e0-c529-46e3-9a08-c1a5db86ab0b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-446873121", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc3d40a5-97fb-479b-90dd-e776e89d02f0"}], "security_groups": [{"name": "tempest-securitygroup--280402461"}], "key_name": "tempest-keypair-1912400694", "user_data": "}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:04.930530 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e77959d5-256b-4e23-886b-3d444c40e741 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:07:04.931168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e77959d5-256b-4e23-886b-3d444c40e741 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:07:04.931310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e77959d5-256b-4e23-886b-3d444c40e741 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:07:04.931947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e77959d5-256b-4e23-886b-3d444c40e741 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:07:04.932416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e77959d5-256b-4e23-886b-3d444c40e741 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:07:04.976114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e77959d5-256b-4e23-886b-3d444c40e741 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:04.977451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e77959d5-256b-4e23-886b-3d444c40e741 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:04.977769 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e77959d5-256b-4e23-886b-3d444c40e741 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:04.978532 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e77959d5-256b-4e23-886b-3d444c40e741 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:04.979852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e77959d5-256b-4e23-886b-3d444c40e741 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:04.980591 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e77959d5-256b-4e23-886b-3d444c40e741 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:05.092381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-e77959d5-256b-4e23-886b-3d444c40e741 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Getting quotas for project b15a0dfb728949ac8cd3ada72385fe68. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:07:05.113328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-e77959d5-256b-4e23-886b-3d444c40e741 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Getting quotas for user bb050a35fbdf4bfe9727f4c0dce1118e and project b15a0dfb728949ac8cd3ada72385fe68. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:07:05.157627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e77959d5-256b-4e23-886b-3d444c40e741 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:07:05.170915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e77959d5-256b-4e23-886b-3d444c40e741 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] [instance: be35564a-a67e-4a66-8dea-ea549a28c888] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:07:05.292429 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e77959d5-256b-4e23-886b-3d444c40e741 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.391564 Oct 29 03:07:05.293214 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2165/4135] 10.222.0.46 () {62 vars in 1188 bytes} [Sat Oct 29 03:07:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2396 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 03:07:05.305400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dac46674-9103-4c00-a111-fceb657f5df8 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:05.306026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dac46674-9103-4c00-a111-fceb657f5df8 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:05.321460 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dac46674-9103-4c00-a111-fceb657f5df8 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:05.324711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dac46674-9103-4c00-a111-fceb657f5df8 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:05.325493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dac46674-9103-4c00-a111-fceb657f5df8 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:05.328536 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dac46674-9103-4c00-a111-fceb657f5df8 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:05.329184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dac46674-9103-4c00-a111-fceb657f5df8 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:05.329808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dac46674-9103-4c00-a111-fceb657f5df8 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:05.522230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-5d6611e0-c529-46e3-9a08-c1a5db86ab0b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] validate_networks() for [('fc3d40a5-97fb-479b-90dd-e776e89d02f0', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:07:06.252505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dac46674-9103-4c00-a111-fceb657f5df8 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f563b6bf99e7480aacedc2a28dbfee01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee274ac8b7204c6a92db7d65a8f4ea62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:06.268125 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dac46674-9103-4c00-a111-fceb657f5df8 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 200 len: 1523 microversion: 2.1 time: 0.973789 Oct 29 03:07:06.268864 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2166/4136] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:05 2022] GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 1523 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:06.294876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f3c3b51b-e00d-4c8b-b86e-50c2a7847259 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:06.295631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f3c3b51b-e00d-4c8b-b86e-50c2a7847259 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] [instance: d9632deb-2bc8-41bc-a569-7adc8ee7aeae] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:06.321827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3c3b51b-e00d-4c8b-b86e-50c2a7847259 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:06.322335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3c3b51b-e00d-4c8b-b86e-50c2a7847259 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:06.325208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3c3b51b-e00d-4c8b-b86e-50c2a7847259 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:06.331984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3c3b51b-e00d-4c8b-b86e-50c2a7847259 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:06.332749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3c3b51b-e00d-4c8b-b86e-50c2a7847259 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:06.333369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3c3b51b-e00d-4c8b-b86e-50c2a7847259 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:06.851794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f3c3b51b-e00d-4c8b-b86e-50c2a7847259 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5feeb5524b34e7f91decfd441023a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5398fd3ca249b098fbaf6c2cb3b1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:06.861180 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f3c3b51b-e00d-4c8b-b86e-50c2a7847259 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] 10.222.0.46 "GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae" status: 200 len: 1275 microversion: 2.1 time: 0.591205 Oct 29 03:07:06.862500 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2167/4137] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:06 2022] GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae => generated 1275 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:06.884430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e44dbbed-6029-412e-a2b8-1367cc4f7694 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:06.886383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e44dbbed-6029-412e-a2b8-1367cc4f7694 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] [instance: be35564a-a67e-4a66-8dea-ea549a28c888] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:06.906910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e44dbbed-6029-412e-a2b8-1367cc4f7694 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:06.909950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e44dbbed-6029-412e-a2b8-1367cc4f7694 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:06.911286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e44dbbed-6029-412e-a2b8-1367cc4f7694 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:06.913994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e44dbbed-6029-412e-a2b8-1367cc4f7694 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:06.915781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e44dbbed-6029-412e-a2b8-1367cc4f7694 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:06.918953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e44dbbed-6029-412e-a2b8-1367cc4f7694 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:07.427876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e44dbbed-6029-412e-a2b8-1367cc4f7694 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:07.439614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e44dbbed-6029-412e-a2b8-1367cc4f7694 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:07.451123 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e44dbbed-6029-412e-a2b8-1367cc4f7694 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:07.459934 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e44dbbed-6029-412e-a2b8-1367cc4f7694 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] 10.222.0.46 "GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888" status: 200 len: 1311 microversion: 2.21 time: 0.595817 Oct 29 03:07:07.473775 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2168/4138] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:06 2022] GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888 => generated 1311 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:07.484657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0d850478-84ce-44d7-b63a-01ff2f14df8c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:07.485289 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0d850478-84ce-44d7-b63a-01ff2f14df8c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:07.511476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d850478-84ce-44d7-b63a-01ff2f14df8c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:07.512068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d850478-84ce-44d7-b63a-01ff2f14df8c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:07.512569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d850478-84ce-44d7-b63a-01ff2f14df8c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:07.513292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d850478-84ce-44d7-b63a-01ff2f14df8c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:07.513751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d850478-84ce-44d7-b63a-01ff2f14df8c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:07.514180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d850478-84ce-44d7-b63a-01ff2f14df8c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:08.246272 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-5d6611e0-c529-46e3-9a08-c1a5db86ab0b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:07:08.247086 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-5d6611e0-c529-46e3-9a08-c1a5db86ab0b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:07:08.247416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-5d6611e0-c529-46e3-9a08-c1a5db86ab0b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:07:08.248405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-5d6611e0-c529-46e3-9a08-c1a5db86ab0b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:07:08.248856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-5d6611e0-c529-46e3-9a08-c1a5db86ab0b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:07:08.298897 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d6611e0-c529-46e3-9a08-c1a5db86ab0b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:08.302504 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d6611e0-c529-46e3-9a08-c1a5db86ab0b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:08.303690 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d6611e0-c529-46e3-9a08-c1a5db86ab0b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:08.311716 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d6611e0-c529-46e3-9a08-c1a5db86ab0b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:08.316680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d6611e0-c529-46e3-9a08-c1a5db86ab0b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:08.317352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d6611e0-c529-46e3-9a08-c1a5db86ab0b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:08.414817 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-5d6611e0-c529-46e3-9a08-c1a5db86ab0b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Getting quotas for project f4853225daef418bb782b4f9f6d1382c. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:07:08.439714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-5d6611e0-c529-46e3-9a08-c1a5db86ab0b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Getting quotas for user 494c556b424a4fa388680ab08a340a1d and project f4853225daef418bb782b4f9f6d1382c. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:07:08.492183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5d6611e0-c529-46e3-9a08-c1a5db86ab0b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:07:08.498849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5d6611e0-c529-46e3-9a08-c1a5db86ab0b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:07:08.529135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0d850478-84ce-44d7-b63a-01ff2f14df8c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:08.545618 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0d850478-84ce-44d7-b63a-01ff2f14df8c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1469 microversion: 2.1 time: 1.068259 Oct 29 03:07:08.562304 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2169/4139] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:07 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1469 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:08.663175 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5d6611e0-c529-46e3-9a08-c1a5db86ab0b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.872400 Oct 29 03:07:08.673248 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1971/4140] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:07:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 3900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:07:08.690374 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4371d060-c00d-4af9-a29b-c227ff8a13c9 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:08.709519 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4371d060-c00d-4af9-a29b-c227ff8a13c9 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:08.729782 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4371d060-c00d-4af9-a29b-c227ff8a13c9 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:08.730581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4371d060-c00d-4af9-a29b-c227ff8a13c9 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:08.731251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4371d060-c00d-4af9-a29b-c227ff8a13c9 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:08.732123 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4371d060-c00d-4af9-a29b-c227ff8a13c9 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:08.732778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4371d060-c00d-4af9-a29b-c227ff8a13c9 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:08.735923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4371d060-c00d-4af9-a29b-c227ff8a13c9 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:09.038267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-fe903f4d-1175-40e8-a528-a576881f6bf8 req-c155615b-5534-4b6f-8300-af2e9357bd7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f60b0652-637b-48dd-8e61-950c0fe5b4c0", "name": "network-vif-plugged", "status": "completed", "tag": "7221ab02-8b17-48e5-a7aa-ed98c8fe3c5c"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:09.079923 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-fe903f4d-1175-40e8-a528-a576881f6bf8 req-c155615b-5534-4b6f-8300-af2e9357bd7e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:09.080560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-fe903f4d-1175-40e8-a528-a576881f6bf8 req-c155615b-5534-4b6f-8300-af2e9357bd7e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:09.084280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-fe903f4d-1175-40e8-a528-a576881f6bf8 req-c155615b-5534-4b6f-8300-af2e9357bd7e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:09.130982 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-fe903f4d-1175-40e8-a528-a576881f6bf8 req-c155615b-5534-4b6f-8300-af2e9357bd7e service nova] Creating event network-vif-plugged:7221ab02-8b17-48e5-a7aa-ed98c8fe3c5c for instance f60b0652-637b-48dd-8e61-950c0fe5b4c0 on n-h1-862967-2 Oct 29 03:07:09.154265 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [req-fe903f4d-1175-40e8-a528-a576881f6bf8 req-c155615b-5534-4b6f-8300-af2e9357bd7e service nova] Instance f60b0652-637b-48dd-8e61-950c0fe5b4c0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:07:09.184563 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-fe903f4d-1175-40e8-a528-a576881f6bf8 req-c155615b-5534-4b6f-8300-af2e9357bd7e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.620262 Oct 29 03:07:09.185197 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2170/4141] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:09.213551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6eb84846-6504-437a-91e3-b0f9579c06a0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:09.221657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6eb84846-6504-437a-91e3-b0f9579c06a0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] [instance: d9632deb-2bc8-41bc-a569-7adc8ee7aeae] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:09.230343 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6eb84846-6504-437a-91e3-b0f9579c06a0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:09.231196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6eb84846-6504-437a-91e3-b0f9579c06a0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:09.232321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6eb84846-6504-437a-91e3-b0f9579c06a0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:09.233234 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6eb84846-6504-437a-91e3-b0f9579c06a0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:09.233849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6eb84846-6504-437a-91e3-b0f9579c06a0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:09.234427 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6eb84846-6504-437a-91e3-b0f9579c06a0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:09.660653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4371d060-c00d-4af9-a29b-c227ff8a13c9 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f563b6bf99e7480aacedc2a28dbfee01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee274ac8b7204c6a92db7d65a8f4ea62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:09.673026 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4371d060-c00d-4af9-a29b-c227ff8a13c9 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 200 len: 1523 microversion: 2.1 time: 0.996901 Oct 29 03:07:09.673459 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1972/4142] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:08 2022] GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 1523 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:09.683922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3a144df5-f630-48d3-820e-4d15e40b4ccc tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:09.684559 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3a144df5-f630-48d3-820e-4d15e40b4ccc tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] [instance: be35564a-a67e-4a66-8dea-ea549a28c888] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:09.700920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a144df5-f630-48d3-820e-4d15e40b4ccc tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:09.703889 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a144df5-f630-48d3-820e-4d15e40b4ccc tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:09.705983 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a144df5-f630-48d3-820e-4d15e40b4ccc tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:09.706573 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a144df5-f630-48d3-820e-4d15e40b4ccc tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:09.707058 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a144df5-f630-48d3-820e-4d15e40b4ccc tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:09.707492 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a144df5-f630-48d3-820e-4d15e40b4ccc tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:09.768314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6eb84846-6504-437a-91e3-b0f9579c06a0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5feeb5524b34e7f91decfd441023a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5398fd3ca249b098fbaf6c2cb3b1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:09.788209 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6eb84846-6504-437a-91e3-b0f9579c06a0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] 10.222.0.46 "GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae" status: 200 len: 1275 microversion: 2.1 time: 0.595882 Oct 29 03:07:09.791107 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2171/4143] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:09 2022] GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae => generated 1275 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:09.808938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9784952e-622e-4224-9c2c-8229ff1bce5a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:09.810352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9784952e-622e-4224-9c2c-8229ff1bce5a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:09.922005 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3a144df5-f630-48d3-820e-4d15e40b4ccc tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:09.940042 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3a144df5-f630-48d3-820e-4d15e40b4ccc tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:09.943466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3a144df5-f630-48d3-820e-4d15e40b4ccc tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:09.945859 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3a144df5-f630-48d3-820e-4d15e40b4ccc tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] 10.222.0.46 "GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888" status: 200 len: 1317 microversion: 2.21 time: 0.270979 Oct 29 03:07:09.947164 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1973/4144] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:09 2022] GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:09.952903 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ef75de59-6835-414d-a477-f6ce3ab51e64 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:09.953734 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ef75de59-6835-414d-a477-f6ce3ab51e64 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:09.965742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef75de59-6835-414d-a477-f6ce3ab51e64 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:09.967294 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef75de59-6835-414d-a477-f6ce3ab51e64 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:09.968126 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef75de59-6835-414d-a477-f6ce3ab51e64 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:09.969129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef75de59-6835-414d-a477-f6ce3ab51e64 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:09.973325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef75de59-6835-414d-a477-f6ce3ab51e64 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:09.974213 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef75de59-6835-414d-a477-f6ce3ab51e64 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:10.087608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9784952e-622e-4224-9c2c-8229ff1bce5a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:10.113222 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9784952e-622e-4224-9c2c-8229ff1bce5a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1237 microversion: 2.1 time: 0.319974 Oct 29 03:07:10.114657 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2172/4145] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:09 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1237 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:10.448645 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ef75de59-6835-414d-a477-f6ce3ab51e64 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:10.474108 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ef75de59-6835-414d-a477-f6ce3ab51e64 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1469 microversion: 2.1 time: 0.524521 Oct 29 03:07:10.476933 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1974/4146] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:09 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1469 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:10.697850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-243e1364-0ad4-4b42-8b7b-3deeec065bce tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:10.698919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-243e1364-0ad4-4b42-8b7b-3deeec065bce tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:10.718671 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-243e1364-0ad4-4b42-8b7b-3deeec065bce tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:10.721942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-243e1364-0ad4-4b42-8b7b-3deeec065bce tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:10.722443 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-243e1364-0ad4-4b42-8b7b-3deeec065bce tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:10.723209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-243e1364-0ad4-4b42-8b7b-3deeec065bce tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:10.723680 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-243e1364-0ad4-4b42-8b7b-3deeec065bce tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:10.724111 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-243e1364-0ad4-4b42-8b7b-3deeec065bce tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:10.826923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-60e825e5-23e0-4e16-980b-a5889da0946a tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:10.828332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-60e825e5-23e0-4e16-980b-a5889da0946a tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] [instance: d9632deb-2bc8-41bc-a569-7adc8ee7aeae] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:10.862613 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-60e825e5-23e0-4e16-980b-a5889da0946a tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:10.864191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-60e825e5-23e0-4e16-980b-a5889da0946a tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:10.864929 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-60e825e5-23e0-4e16-980b-a5889da0946a tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:10.867206 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-60e825e5-23e0-4e16-980b-a5889da0946a tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:10.869149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-60e825e5-23e0-4e16-980b-a5889da0946a tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:10.870079 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-60e825e5-23e0-4e16-980b-a5889da0946a tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:11.015440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-60e825e5-23e0-4e16-980b-a5889da0946a tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5feeb5524b34e7f91decfd441023a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5398fd3ca249b098fbaf6c2cb3b1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:11.033463 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-60e825e5-23e0-4e16-980b-a5889da0946a tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] 10.222.0.46 "GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae" status: 200 len: 1275 microversion: 2.1 time: 0.215608 Oct 29 03:07:11.034473 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1975/4147] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:10 2022] GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae => generated 1275 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:11.051289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d12ea505-4ea6-413d-8a8c-aef94e0044a7 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:11.052265 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d12ea505-4ea6-413d-8a8c-aef94e0044a7 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] [instance: be35564a-a67e-4a66-8dea-ea549a28c888] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:11.070405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d12ea505-4ea6-413d-8a8c-aef94e0044a7 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:11.071234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d12ea505-4ea6-413d-8a8c-aef94e0044a7 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:11.071868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d12ea505-4ea6-413d-8a8c-aef94e0044a7 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:11.072879 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d12ea505-4ea6-413d-8a8c-aef94e0044a7 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:11.073586 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d12ea505-4ea6-413d-8a8c-aef94e0044a7 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:11.074272 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d12ea505-4ea6-413d-8a8c-aef94e0044a7 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:11.234162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d12ea505-4ea6-413d-8a8c-aef94e0044a7 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:11.248729 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d12ea505-4ea6-413d-8a8c-aef94e0044a7 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:11.250621 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d12ea505-4ea6-413d-8a8c-aef94e0044a7 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:11.251997 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d12ea505-4ea6-413d-8a8c-aef94e0044a7 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] 10.222.0.46 "GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888" status: 200 len: 1317 microversion: 2.21 time: 0.216086 Oct 29 03:07:11.252666 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1976/4148] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:11 2022] GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:11.257977 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e24119e6-6430-433d-946e-bb9ac5b291ad tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:11.259072 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e24119e6-6430-433d-946e-bb9ac5b291ad tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:11.288501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e24119e6-6430-433d-946e-bb9ac5b291ad tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:11.291163 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e24119e6-6430-433d-946e-bb9ac5b291ad tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:11.291923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e24119e6-6430-433d-946e-bb9ac5b291ad tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:11.293183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e24119e6-6430-433d-946e-bb9ac5b291ad tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:11.293970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e24119e6-6430-433d-946e-bb9ac5b291ad tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:11.294645 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e24119e6-6430-433d-946e-bb9ac5b291ad tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:11.361104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-243e1364-0ad4-4b42-8b7b-3deeec065bce tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f563b6bf99e7480aacedc2a28dbfee01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee274ac8b7204c6a92db7d65a8f4ea62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:11.371898 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-243e1364-0ad4-4b42-8b7b-3deeec065bce tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 200 len: 1523 microversion: 2.1 time: 0.679743 Oct 29 03:07:11.372717 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2173/4149] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:10 2022] GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 1523 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:11.429712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e24119e6-6430-433d-946e-bb9ac5b291ad tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:11.457519 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e24119e6-6430-433d-946e-bb9ac5b291ad tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1307 microversion: 2.1 time: 0.203126 Oct 29 03:07:11.468683 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1977/4150] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:11 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1307 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:11.501809 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-95a5fc2d-fc45-4493-af94-eb0d98473b44 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:11.503378 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-95a5fc2d-fc45-4493-af94-eb0d98473b44 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:11.515360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95a5fc2d-fc45-4493-af94-eb0d98473b44 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:11.516274 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95a5fc2d-fc45-4493-af94-eb0d98473b44 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:11.516902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95a5fc2d-fc45-4493-af94-eb0d98473b44 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:11.518486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95a5fc2d-fc45-4493-af94-eb0d98473b44 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:11.520776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95a5fc2d-fc45-4493-af94-eb0d98473b44 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:11.521524 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95a5fc2d-fc45-4493-af94-eb0d98473b44 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:12.073134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-92084f32-3009-4b38-8f82-65bb6cb3e659 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:12.074479 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-92084f32-3009-4b38-8f82-65bb6cb3e659 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] [instance: d9632deb-2bc8-41bc-a569-7adc8ee7aeae] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:12.107536 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92084f32-3009-4b38-8f82-65bb6cb3e659 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:12.110389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92084f32-3009-4b38-8f82-65bb6cb3e659 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:12.111748 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92084f32-3009-4b38-8f82-65bb6cb3e659 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:12.114470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92084f32-3009-4b38-8f82-65bb6cb3e659 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:12.118108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92084f32-3009-4b38-8f82-65bb6cb3e659 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:12.118841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92084f32-3009-4b38-8f82-65bb6cb3e659 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:12.585168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-92084f32-3009-4b38-8f82-65bb6cb3e659 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5feeb5524b34e7f91decfd441023a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5398fd3ca249b098fbaf6c2cb3b1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:12.599023 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-92084f32-3009-4b38-8f82-65bb6cb3e659 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] 10.222.0.46 "GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae" status: 200 len: 1317 microversion: 2.1 time: 0.535818 Oct 29 03:07:12.599633 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1978/4151] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:12 2022] GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae => generated 1317 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:07:12.609815 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3cdfaf06-d9dc-4f6c-bf86-afe40e423c3d tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:12.610599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3cdfaf06-d9dc-4f6c-bf86-afe40e423c3d tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] [instance: be35564a-a67e-4a66-8dea-ea549a28c888] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:12.622612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3cdfaf06-d9dc-4f6c-bf86-afe40e423c3d tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:12.623193 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3cdfaf06-d9dc-4f6c-bf86-afe40e423c3d tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:12.623633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3cdfaf06-d9dc-4f6c-bf86-afe40e423c3d tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:12.624366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3cdfaf06-d9dc-4f6c-bf86-afe40e423c3d tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:12.630760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3cdfaf06-d9dc-4f6c-bf86-afe40e423c3d tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:12.631263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3cdfaf06-d9dc-4f6c-bf86-afe40e423c3d tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:12.669166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-95a5fc2d-fc45-4493-af94-eb0d98473b44 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:12.682226 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-95a5fc2d-fc45-4493-af94-eb0d98473b44 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1469 microversion: 2.1 time: 1.185517 Oct 29 03:07:12.683503 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2174/4152] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:11 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1469 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:12.697496 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dcf102c4-b83d-4ffa-a944-f266ed4a2b9f tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:12.698442 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dcf102c4-b83d-4ffa-a944-f266ed4a2b9f tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:12.705710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dcf102c4-b83d-4ffa-a944-f266ed4a2b9f tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:12.706561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dcf102c4-b83d-4ffa-a944-f266ed4a2b9f tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:12.708002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dcf102c4-b83d-4ffa-a944-f266ed4a2b9f tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:12.709040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dcf102c4-b83d-4ffa-a944-f266ed4a2b9f tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:12.709682 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dcf102c4-b83d-4ffa-a944-f266ed4a2b9f tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:12.710363 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dcf102c4-b83d-4ffa-a944-f266ed4a2b9f tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:13.076801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3cdfaf06-d9dc-4f6c-bf86-afe40e423c3d tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:13.151566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3cdfaf06-d9dc-4f6c-bf86-afe40e423c3d tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:13.153253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3cdfaf06-d9dc-4f6c-bf86-afe40e423c3d tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:13.160494 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3cdfaf06-d9dc-4f6c-bf86-afe40e423c3d tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] 10.222.0.46 "GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888" status: 200 len: 1359 microversion: 2.21 time: 0.559725 Oct 29 03:07:13.161944 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1979/4153] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:12 2022] GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888 => generated 1359 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:13.182073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a922b84b-139b-4682-ad07-6395aad3c49c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:13.183197 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a922b84b-139b-4682-ad07-6395aad3c49c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:13.211933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a922b84b-139b-4682-ad07-6395aad3c49c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:13.212482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a922b84b-139b-4682-ad07-6395aad3c49c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:13.217911 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a922b84b-139b-4682-ad07-6395aad3c49c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:13.218765 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a922b84b-139b-4682-ad07-6395aad3c49c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:13.219262 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a922b84b-139b-4682-ad07-6395aad3c49c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:13.220245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a922b84b-139b-4682-ad07-6395aad3c49c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:13.278601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dcf102c4-b83d-4ffa-a944-f266ed4a2b9f tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f563b6bf99e7480aacedc2a28dbfee01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee274ac8b7204c6a92db7d65a8f4ea62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:13.288972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:13.293817 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dcf102c4-b83d-4ffa-a944-f266ed4a2b9f tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 200 len: 1503 microversion: 2.1 time: 0.608958 Oct 29 03:07:13.294434 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2175/4154] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:12 2022] GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 1503 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:13.321728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-74de5631-cbc9-4928-a997-775fbeb4c249 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Action: 'create', calling method: .version_select at 0x7ff053ea9550>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-860705020", "description": "tempest-description-1604883983"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:13.726786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a922b84b-139b-4682-ad07-6395aad3c49c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:13.742266 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a922b84b-139b-4682-ad07-6395aad3c49c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1362 microversion: 2.1 time: 0.578104 Oct 29 03:07:13.743819 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1980/4155] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:13 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1362 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:13.783658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-a18f284b-6370-4f7f-b627-68b641592f91 req-c39684d9-10bc-42fb-8aa4-dfab893338c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f60b0652-637b-48dd-8e61-950c0fe5b4c0", "name": "network-vif-unplugged", "status": "completed", "tag": "7221ab02-8b17-48e5-a7aa-ed98c8fe3c5c"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:13.835318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a18f284b-6370-4f7f-b627-68b641592f91 req-c39684d9-10bc-42fb-8aa4-dfab893338c9 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:13.838431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a18f284b-6370-4f7f-b627-68b641592f91 req-c39684d9-10bc-42fb-8aa4-dfab893338c9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:13.839029 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a18f284b-6370-4f7f-b627-68b641592f91 req-c39684d9-10bc-42fb-8aa4-dfab893338c9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:13.884162 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-a18f284b-6370-4f7f-b627-68b641592f91 req-c39684d9-10bc-42fb-8aa4-dfab893338c9 service nova] Creating event network-vif-unplugged:7221ab02-8b17-48e5-a7aa-ed98c8fe3c5c for instance f60b0652-637b-48dd-8e61-950c0fe5b4c0 on n-h2-862967-2 Oct 29 03:07:13.900133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [req-a18f284b-6370-4f7f-b627-68b641592f91 req-c39684d9-10bc-42fb-8aa4-dfab893338c9 service nova] Instance f60b0652-637b-48dd-8e61-950c0fe5b4c0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:07:13.915307 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-a18f284b-6370-4f7f-b627-68b641592f91 req-c39684d9-10bc-42fb-8aa4-dfab893338c9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.149332 Oct 29 03:07:13.916035 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1981/4156] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:13.926034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e5863ab7-5ada-40b1-9015-bbe61451773e tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:13.927247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e5863ab7-5ada-40b1-9015-bbe61451773e tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] [instance: d9632deb-2bc8-41bc-a569-7adc8ee7aeae] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:13.936941 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5863ab7-5ada-40b1-9015-bbe61451773e tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:13.937604 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5863ab7-5ada-40b1-9015-bbe61451773e tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:13.938376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5863ab7-5ada-40b1-9015-bbe61451773e tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:13.939540 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5863ab7-5ada-40b1-9015-bbe61451773e tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:13.940159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5863ab7-5ada-40b1-9015-bbe61451773e tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:13.940762 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5863ab7-5ada-40b1-9015-bbe61451773e tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:14.450086 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-74de5631-cbc9-4928-a997-775fbeb4c249 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 1.132374 Oct 29 03:07:14.450086 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2176/4157] 10.222.0.46 () {60 vars in 1180 bytes} [Sat Oct 29 03:07:13 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:07:14.453656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ddb1ec6c-036b-46b5-a625-52d37d2657ab tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:14.454656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ddb1ec6c-036b-46b5-a625-52d37d2657ab tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:14.473578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ddb1ec6c-036b-46b5-a625-52d37d2657ab tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:14.474090 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ddb1ec6c-036b-46b5-a625-52d37d2657ab tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:14.476714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ddb1ec6c-036b-46b5-a625-52d37d2657ab tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:14.477714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ddb1ec6c-036b-46b5-a625-52d37d2657ab tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:14.478147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ddb1ec6c-036b-46b5-a625-52d37d2657ab tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:14.478594 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ddb1ec6c-036b-46b5-a625-52d37d2657ab tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:14.664484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e5863ab7-5ada-40b1-9015-bbe61451773e tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5feeb5524b34e7f91decfd441023a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5398fd3ca249b098fbaf6c2cb3b1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:14.689957 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e5863ab7-5ada-40b1-9015-bbe61451773e tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] 10.222.0.46 "GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae" status: 200 len: 1317 microversion: 2.1 time: 0.771605 Oct 29 03:07:14.704556 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1982/4158] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:13 2022] GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae => generated 1317 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:14.704556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-42214474-9f75-439c-ac97-256f4937925d tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:14.704556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-42214474-9f75-439c-ac97-256f4937925d tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] [instance: be35564a-a67e-4a66-8dea-ea549a28c888] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:14.720597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-42214474-9f75-439c-ac97-256f4937925d tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:14.723184 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-42214474-9f75-439c-ac97-256f4937925d tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:14.723872 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-42214474-9f75-439c-ac97-256f4937925d tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:14.727577 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-42214474-9f75-439c-ac97-256f4937925d tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:14.728408 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-42214474-9f75-439c-ac97-256f4937925d tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:14.731551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-42214474-9f75-439c-ac97-256f4937925d tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:15.040909 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=5 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:15.066818 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-42214474-9f75-439c-ac97-256f4937925d tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:15.083235 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-42214474-9f75-439c-ac97-256f4937925d tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:15.089788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-42214474-9f75-439c-ac97-256f4937925d tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:15.091522 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-42214474-9f75-439c-ac97-256f4937925d tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] 10.222.0.46 "GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888" status: 200 len: 1359 microversion: 2.21 time: 0.397204 Oct 29 03:07:15.093407 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1983/4159] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:14 2022] GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888 => generated 1359 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:15.109628 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f34e022f-3bd5-420d-923a-55112b4bab58 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-860705020"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:15.110586 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f34e022f-3bd5-420d-923a-55112b4bab58 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:15.130421 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f34e022f-3bd5-420d-923a-55112b4bab58 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:15.134381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f34e022f-3bd5-420d-923a-55112b4bab58 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:15.135204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f34e022f-3bd5-420d-923a-55112b4bab58 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:15.136711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f34e022f-3bd5-420d-923a-55112b4bab58 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:15.138721 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f34e022f-3bd5-420d-923a-55112b4bab58 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:15.140180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f34e022f-3bd5-420d-923a-55112b4bab58 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:15.713497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ddb1ec6c-036b-46b5-a625-52d37d2657ab tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:15.739965 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ddb1ec6c-036b-46b5-a625-52d37d2657ab tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1535 microversion: 2.1 time: 1.290088 Oct 29 03:07:15.741085 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2177/4160] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:14 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1535 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:15.745997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b61980d4-129c-4b5d-930f-688401883ab4 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:15.746621 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b61980d4-129c-4b5d-930f-688401883ab4 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:15.763026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b61980d4-129c-4b5d-930f-688401883ab4 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:15.763872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b61980d4-129c-4b5d-930f-688401883ab4 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:15.764483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b61980d4-129c-4b5d-930f-688401883ab4 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:15.765420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b61980d4-129c-4b5d-930f-688401883ab4 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:15.766051 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b61980d4-129c-4b5d-930f-688401883ab4 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:15.766634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b61980d4-129c-4b5d-930f-688401883ab4 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:15.899746 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.network.security_group_api [None req-f34e022f-3bd5-420d-923a-55112b4bab58 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Adding security group b2b2db34-041a-492d-98cf-0a64e702bb48 to port 00a83dbb-19d1-425c-aada-3a0206b02101 Oct 29 03:07:16.381422 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b61980d4-129c-4b5d-930f-688401883ab4 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:16.419569 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b61980d4-129c-4b5d-930f-688401883ab4 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1362 microversion: 2.1 time: 0.677285 Oct 29 03:07:16.421161 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2178/4161] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:15 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1362 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:16.447844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eeb3c56e-7dd7-43bf-93aa-e7753a295c14 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:16.448788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-eeb3c56e-7dd7-43bf-93aa-e7753a295c14 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] [instance: d9632deb-2bc8-41bc-a569-7adc8ee7aeae] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:16.465482 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eeb3c56e-7dd7-43bf-93aa-e7753a295c14 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:16.466365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eeb3c56e-7dd7-43bf-93aa-e7753a295c14 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:16.467082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eeb3c56e-7dd7-43bf-93aa-e7753a295c14 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:16.468234 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eeb3c56e-7dd7-43bf-93aa-e7753a295c14 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:16.470885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eeb3c56e-7dd7-43bf-93aa-e7753a295c14 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:16.473820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eeb3c56e-7dd7-43bf-93aa-e7753a295c14 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:17.113046 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f34e022f-3bd5-420d-923a-55112b4bab58 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "POST /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e/action" status: 202 len: 0 microversion: 2.1 time: 2.017744 Oct 29 03:07:17.114618 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1984/4162] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:07:15 2022] POST /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e/action => generated 0 bytes in 2020 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:07:17.120155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dee82e34-e57f-4d7a-b854-53c3fefab5b9 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:17.121101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dee82e34-e57f-4d7a-b854-53c3fefab5b9 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] [instance: be35564a-a67e-4a66-8dea-ea549a28c888] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:17.137814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dee82e34-e57f-4d7a-b854-53c3fefab5b9 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:17.138320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dee82e34-e57f-4d7a-b854-53c3fefab5b9 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:17.138787 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dee82e34-e57f-4d7a-b854-53c3fefab5b9 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:17.154733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dee82e34-e57f-4d7a-b854-53c3fefab5b9 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:17.155758 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dee82e34-e57f-4d7a-b854-53c3fefab5b9 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:17.157554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dee82e34-e57f-4d7a-b854-53c3fefab5b9 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:17.196400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:17.377918 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-eeb3c56e-7dd7-43bf-93aa-e7753a295c14 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5feeb5524b34e7f91decfd441023a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5398fd3ca249b098fbaf6c2cb3b1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:17.406953 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eeb3c56e-7dd7-43bf-93aa-e7753a295c14 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] 10.222.0.46 "GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae" status: 200 len: 1317 microversion: 2.1 time: 0.983775 Oct 29 03:07:17.417193 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2179/4163] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:16 2022] GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae => generated 1317 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:17.435290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-87b3a676-f733-4183-9e46-72175450d121 req-62795ff6-ca6c-45dd-b41c-bc3d2e409f4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05f5328d-7d86-44f3-bb9f-8d06de0daa17", "tag": "febf7e0e-53b9-4105-ae6d-f9ae262ab497"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:17.475867 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-87b3a676-f733-4183-9e46-72175450d121 req-62795ff6-ca6c-45dd-b41c-bc3d2e409f4c service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:17.477052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-87b3a676-f733-4183-9e46-72175450d121 req-62795ff6-ca6c-45dd-b41c-bc3d2e409f4c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:17.492457 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-87b3a676-f733-4183-9e46-72175450d121 req-62795ff6-ca6c-45dd-b41c-bc3d2e409f4c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:17.520247 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-87b3a676-f733-4183-9e46-72175450d121 req-62795ff6-ca6c-45dd-b41c-bc3d2e409f4c service nova] Creating event network-changed:febf7e0e-53b9-4105-ae6d-f9ae262ab497 for instance 05f5328d-7d86-44f3-bb9f-8d06de0daa17 on n-h2-862967-2 Oct 29 03:07:17.531619 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-87b3a676-f733-4183-9e46-72175450d121 req-62795ff6-ca6c-45dd-b41c-bc3d2e409f4c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111719 Oct 29 03:07:17.534272 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2180/4164] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:17.547319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3025c5ca-6747-4eb1-ba34-175e50ea8564 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:17.549575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3025c5ca-6747-4eb1-ba34-175e50ea8564 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:17.563999 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3025c5ca-6747-4eb1-ba34-175e50ea8564 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:17.565396 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3025c5ca-6747-4eb1-ba34-175e50ea8564 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:17.567973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3025c5ca-6747-4eb1-ba34-175e50ea8564 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:17.570121 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3025c5ca-6747-4eb1-ba34-175e50ea8564 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:17.571544 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3025c5ca-6747-4eb1-ba34-175e50ea8564 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:17.572284 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3025c5ca-6747-4eb1-ba34-175e50ea8564 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:17.829847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dee82e34-e57f-4d7a-b854-53c3fefab5b9 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:17.838924 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dee82e34-e57f-4d7a-b854-53c3fefab5b9 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:17.841601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dee82e34-e57f-4d7a-b854-53c3fefab5b9 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:17.843128 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dee82e34-e57f-4d7a-b854-53c3fefab5b9 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] 10.222.0.46 "GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888" status: 200 len: 1359 microversion: 2.21 time: 0.727345 Oct 29 03:07:17.843907 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1985/4165] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:17 2022] GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888 => generated 1359 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:17.868700 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-0a8c11c9-1059-4eea-873a-a2d0cbf3273a req-bb3c11cd-a0e2-4009-9647-e077fdc6a683 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9632deb-2bc8-41bc-a569-7adc8ee7aeae", "tag": "6014e303-2345-4b76-b7e7-7dd97081538f"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:17.880479 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0a8c11c9-1059-4eea-873a-a2d0cbf3273a req-bb3c11cd-a0e2-4009-9647-e077fdc6a683 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:17.881289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0a8c11c9-1059-4eea-873a-a2d0cbf3273a req-bb3c11cd-a0e2-4009-9647-e077fdc6a683 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:17.881873 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0a8c11c9-1059-4eea-873a-a2d0cbf3273a req-bb3c11cd-a0e2-4009-9647-e077fdc6a683 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:17.899583 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-0a8c11c9-1059-4eea-873a-a2d0cbf3273a req-bb3c11cd-a0e2-4009-9647-e077fdc6a683 service nova] Creating event network-changed:6014e303-2345-4b76-b7e7-7dd97081538f for instance d9632deb-2bc8-41bc-a569-7adc8ee7aeae on n-h2-862967-2 Oct 29 03:07:17.908945 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-0a8c11c9-1059-4eea-873a-a2d0cbf3273a req-bb3c11cd-a0e2-4009-9647-e077fdc6a683 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045832 Oct 29 03:07:17.910480 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1986/4166] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:17.916966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7873c7fe-d4b1-49ee-a967-a9a2f30d4208 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-860705020"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:17.918073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7873c7fe-d4b1-49ee-a967-a9a2f30d4208 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:17.925330 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7873c7fe-d4b1-49ee-a967-a9a2f30d4208 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:17.926257 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7873c7fe-d4b1-49ee-a967-a9a2f30d4208 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:17.926960 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7873c7fe-d4b1-49ee-a967-a9a2f30d4208 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:17.927966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7873c7fe-d4b1-49ee-a967-a9a2f30d4208 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:17.928891 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7873c7fe-d4b1-49ee-a967-a9a2f30d4208 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:17.929543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7873c7fe-d4b1-49ee-a967-a9a2f30d4208 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:18.266089 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.network.security_group_api [None req-7873c7fe-d4b1-49ee-a967-a9a2f30d4208 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Removing security group b2b2db34-041a-492d-98cf-0a64e702bb48 from port 00a83dbb-19d1-425c-aada-3a0206b02101 Oct 29 03:07:18.375504 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:18.481534 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=12 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:18.705015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3025c5ca-6747-4eb1-ba34-175e50ea8564 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:18.713516 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3025c5ca-6747-4eb1-ba34-175e50ea8564 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1535 microversion: 2.1 time: 1.176918 Oct 29 03:07:18.714090 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2181/4167] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:17 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1535 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:18.733397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-10175202-abde-4c80-a9ef-2b5377bdd9d7 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:18.734688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-10175202-abde-4c80-a9ef-2b5377bdd9d7 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:18.746008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10175202-abde-4c80-a9ef-2b5377bdd9d7 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:18.746597 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10175202-abde-4c80-a9ef-2b5377bdd9d7 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:18.747286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10175202-abde-4c80-a9ef-2b5377bdd9d7 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:18.748216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10175202-abde-4c80-a9ef-2b5377bdd9d7 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:18.749447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10175202-abde-4c80-a9ef-2b5377bdd9d7 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:18.750082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10175202-abde-4c80-a9ef-2b5377bdd9d7 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:19.181444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-10175202-abde-4c80-a9ef-2b5377bdd9d7 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:19.196508 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-10175202-abde-4c80-a9ef-2b5377bdd9d7 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1362 microversion: 2.1 time: 0.481045 Oct 29 03:07:19.200463 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2182/4168] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:18 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1362 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:19.207502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9f2ee8be-c814-4061-bcc9-3b8c2a985e24 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:19.208475 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9f2ee8be-c814-4061-bcc9-3b8c2a985e24 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] [instance: d9632deb-2bc8-41bc-a569-7adc8ee7aeae] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:19.221374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f2ee8be-c814-4061-bcc9-3b8c2a985e24 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:19.223290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f2ee8be-c814-4061-bcc9-3b8c2a985e24 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:19.224208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f2ee8be-c814-4061-bcc9-3b8c2a985e24 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:19.226205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f2ee8be-c814-4061-bcc9-3b8c2a985e24 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:19.227151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f2ee8be-c814-4061-bcc9-3b8c2a985e24 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:19.228210 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f2ee8be-c814-4061-bcc9-3b8c2a985e24 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:19.244118 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7873c7fe-d4b1-49ee-a967-a9a2f30d4208 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "POST /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e/action" status: 202 len: 0 microversion: 2.1 time: 1.331545 Oct 29 03:07:19.247403 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1987/4169] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:07:17 2022] POST /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e/action => generated 0 bytes in 1336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:07:19.281296 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-68139cb6-e145-4c91-b265-1347f4ca087a tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:19.283219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-68139cb6-e145-4c91-b265-1347f4ca087a tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] [instance: be35564a-a67e-4a66-8dea-ea549a28c888] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:19.310775 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68139cb6-e145-4c91-b265-1347f4ca087a tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:19.315802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68139cb6-e145-4c91-b265-1347f4ca087a tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:19.316930 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68139cb6-e145-4c91-b265-1347f4ca087a tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:19.322750 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68139cb6-e145-4c91-b265-1347f4ca087a tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:19.324651 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68139cb6-e145-4c91-b265-1347f4ca087a tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:19.326247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68139cb6-e145-4c91-b265-1347f4ca087a tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:19.730643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9f2ee8be-c814-4061-bcc9-3b8c2a985e24 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5feeb5524b34e7f91decfd441023a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5398fd3ca249b098fbaf6c2cb3b1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:19.742407 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9f2ee8be-c814-4061-bcc9-3b8c2a985e24 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] 10.222.0.46 "GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae" status: 200 len: 1317 microversion: 2.1 time: 0.542499 Oct 29 03:07:19.743017 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2183/4170] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:19 2022] GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae => generated 1317 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:19.755064 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1127063b-da3e-4c4a-b582-3e70946111e5 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Action: 'create', calling method: .version_select at 0x7ff05c04ec10>, body: {"pool": null} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:20.103939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=8 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:20.254768 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-68139cb6-e145-4c91-b265-1347f4ca087a tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:20.282891 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-68139cb6-e145-4c91-b265-1347f4ca087a tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:20.287199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-68139cb6-e145-4c91-b265-1347f4ca087a tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:20.293000 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-68139cb6-e145-4c91-b265-1347f4ca087a tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] 10.222.0.46 "GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888" status: 200 len: 1359 microversion: 2.21 time: 1.036340 Oct 29 03:07:20.293769 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1988/4171] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:19 2022] GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888 => generated 1359 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:20.300659 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-d94ae38c-9653-40d2-a780-6317ad02672e req-3d27b4e2-2405-4341-8152-6069a628457a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23eb1465-3e98-4ff0-acd6-15c3d092953e", "tag": "00a83dbb-19d1-425c-aada-3a0206b02101"}, {"name": "network-changed", "server_uuid": "23eb1465-3e98-4ff0-acd6-15c3d092953e", "tag": "00a83dbb-19d1-425c-aada-3a0206b02101"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:20.313593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d94ae38c-9653-40d2-a780-6317ad02672e req-3d27b4e2-2405-4341-8152-6069a628457a service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:20.315116 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d94ae38c-9653-40d2-a780-6317ad02672e req-3d27b4e2-2405-4341-8152-6069a628457a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:20.315770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d94ae38c-9653-40d2-a780-6317ad02672e req-3d27b4e2-2405-4341-8152-6069a628457a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:20.330059 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-d94ae38c-9653-40d2-a780-6317ad02672e req-3d27b4e2-2405-4341-8152-6069a628457a service nova] Creating event network-changed:00a83dbb-19d1-425c-aada-3a0206b02101 for instance 23eb1465-3e98-4ff0-acd6-15c3d092953e on n-h1-862967-2 Oct 29 03:07:20.330570 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-d94ae38c-9653-40d2-a780-6317ad02672e req-3d27b4e2-2405-4341-8152-6069a628457a service nova] Creating event network-changed:00a83dbb-19d1-425c-aada-3a0206b02101 for instance 23eb1465-3e98-4ff0-acd6-15c3d092953e on n-h1-862967-2 Oct 29 03:07:20.337126 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-d94ae38c-9653-40d2-a780-6317ad02672e req-3d27b4e2-2405-4341-8152-6069a628457a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.040539 Oct 29 03:07:20.338451 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1989/4172] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:20.346893 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-419f3064-6b0e-45a1-b14f-e3560def29f7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:20.348024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-419f3064-6b0e-45a1-b14f-e3560def29f7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:20.355023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-419f3064-6b0e-45a1-b14f-e3560def29f7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:20.355876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-419f3064-6b0e-45a1-b14f-e3560def29f7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:20.356501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-419f3064-6b0e-45a1-b14f-e3560def29f7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:20.357448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-419f3064-6b0e-45a1-b14f-e3560def29f7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:20.358094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-419f3064-6b0e-45a1-b14f-e3560def29f7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:20.359028 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-419f3064-6b0e-45a1-b14f-e3560def29f7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:21.136856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-419f3064-6b0e-45a1-b14f-e3560def29f7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:21.150646 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-419f3064-6b0e-45a1-b14f-e3560def29f7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1535 microversion: 2.1 time: 0.809993 Oct 29 03:07:21.152085 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1990/4173] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:20 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1535 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:21.167069 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-5f1e2fcc-7e8c-4ca0-8487-e657f915d7c8 req-4f1f5ba5-5b8a-4ebc-b85e-934012482eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be35564a-a67e-4a66-8dea-ea549a28c888", "tag": "487baea1-128b-43b5-8b22-1c8bdaa6e2e2"}, {"name": "network-changed", "server_uuid": "f60b0652-637b-48dd-8e61-950c0fe5b4c0", "tag": "7221ab02-8b17-48e5-a7aa-ed98c8fe3c5c"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:21.175638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-5f1e2fcc-7e8c-4ca0-8487-e657f915d7c8 req-4f1f5ba5-5b8a-4ebc-b85e-934012482eb1 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:21.177471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-5f1e2fcc-7e8c-4ca0-8487-e657f915d7c8 req-4f1f5ba5-5b8a-4ebc-b85e-934012482eb1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:21.178113 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-5f1e2fcc-7e8c-4ca0-8487-e657f915d7c8 req-4f1f5ba5-5b8a-4ebc-b85e-934012482eb1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:21.204358 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-5f1e2fcc-7e8c-4ca0-8487-e657f915d7c8 req-4f1f5ba5-5b8a-4ebc-b85e-934012482eb1 service nova] Creating event network-changed:487baea1-128b-43b5-8b22-1c8bdaa6e2e2 for instance be35564a-a67e-4a66-8dea-ea549a28c888 on n-h1-862967-2 Oct 29 03:07:21.205977 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-5f1e2fcc-7e8c-4ca0-8487-e657f915d7c8 req-4f1f5ba5-5b8a-4ebc-b85e-934012482eb1 service nova] Creating event network-changed:7221ab02-8b17-48e5-a7aa-ed98c8fe3c5c for instance f60b0652-637b-48dd-8e61-950c0fe5b4c0 on n-h2-862967-2 Oct 29 03:07:21.219855 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [req-5f1e2fcc-7e8c-4ca0-8487-e657f915d7c8 req-4f1f5ba5-5b8a-4ebc-b85e-934012482eb1 service nova] Instance f60b0652-637b-48dd-8e61-950c0fe5b4c0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:07:21.236136 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-5f1e2fcc-7e8c-4ca0-8487-e657f915d7c8 req-4f1f5ba5-5b8a-4ebc-b85e-934012482eb1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.082609 Oct 29 03:07:21.237496 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1991/4174] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:21.259817 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1db4e809-4b5e-4849-b1db-38a8536b395b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:21.260789 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1db4e809-4b5e-4849-b1db-38a8536b395b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:21.270103 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1db4e809-4b5e-4849-b1db-38a8536b395b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:21.270989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1db4e809-4b5e-4849-b1db-38a8536b395b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:21.272004 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1db4e809-4b5e-4849-b1db-38a8536b395b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:21.273311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1db4e809-4b5e-4849-b1db-38a8536b395b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:21.273968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1db4e809-4b5e-4849-b1db-38a8536b395b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:21.274646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1db4e809-4b5e-4849-b1db-38a8536b395b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:22.029881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1db4e809-4b5e-4849-b1db-38a8536b395b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:22.051886 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1db4e809-4b5e-4849-b1db-38a8536b395b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1362 microversion: 2.1 time: 0.812047 Oct 29 03:07:22.052745 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1992/4175] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:21 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1362 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:22.061475 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dd63c6c6-4972-4ef9-ac64-f0cf0203f23f tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:22.062495 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dd63c6c6-4972-4ef9-ac64-f0cf0203f23f tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] [instance: d9632deb-2bc8-41bc-a569-7adc8ee7aeae] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:22.077620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd63c6c6-4972-4ef9-ac64-f0cf0203f23f tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:22.079060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd63c6c6-4972-4ef9-ac64-f0cf0203f23f tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:22.079831 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd63c6c6-4972-4ef9-ac64-f0cf0203f23f tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:22.085889 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd63c6c6-4972-4ef9-ac64-f0cf0203f23f tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:22.087397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd63c6c6-4972-4ef9-ac64-f0cf0203f23f tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:22.087957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd63c6c6-4972-4ef9-ac64-f0cf0203f23f tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:23.191915 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dd63c6c6-4972-4ef9-ac64-f0cf0203f23f tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5feeb5524b34e7f91decfd441023a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5398fd3ca249b098fbaf6c2cb3b1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:23.207198 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dd63c6c6-4972-4ef9-ac64-f0cf0203f23f tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] 10.222.0.46 "GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae" status: 200 len: 1317 microversion: 2.1 time: 1.152985 Oct 29 03:07:23.207797 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1993/4176] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:22 2022] GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae => generated 1317 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:23.214946 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-34e316cc-f133-4c20-9a6e-42aed970a9a6 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:23.225880 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-34e316cc-f133-4c20-9a6e-42aed970a9a6 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] [instance: be35564a-a67e-4a66-8dea-ea549a28c888] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:23.242452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34e316cc-f133-4c20-9a6e-42aed970a9a6 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:23.243569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34e316cc-f133-4c20-9a6e-42aed970a9a6 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:23.244485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34e316cc-f133-4c20-9a6e-42aed970a9a6 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:23.259173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34e316cc-f133-4c20-9a6e-42aed970a9a6 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:23.260090 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34e316cc-f133-4c20-9a6e-42aed970a9a6 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:23.260955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34e316cc-f133-4c20-9a6e-42aed970a9a6 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:23.824316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-34e316cc-f133-4c20-9a6e-42aed970a9a6 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:23.846290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-34e316cc-f133-4c20-9a6e-42aed970a9a6 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:23.861452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-34e316cc-f133-4c20-9a6e-42aed970a9a6 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:23.863773 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-34e316cc-f133-4c20-9a6e-42aed970a9a6 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] 10.222.0.46 "GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888" status: 200 len: 1359 microversion: 2.21 time: 0.654473 Oct 29 03:07:23.864884 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1994/4177] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:23 2022] GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888 => generated 1359 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:23.874014 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0401d560-bbe8-409a-bbf6-5ba4ce2688a4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:23.878081 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0401d560-bbe8-409a-bbf6-5ba4ce2688a4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:23.901744 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0401d560-bbe8-409a-bbf6-5ba4ce2688a4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:23.902907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0401d560-bbe8-409a-bbf6-5ba4ce2688a4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:23.903725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0401d560-bbe8-409a-bbf6-5ba4ce2688a4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:23.905153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0401d560-bbe8-409a-bbf6-5ba4ce2688a4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:23.905968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0401d560-bbe8-409a-bbf6-5ba4ce2688a4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:23.912800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0401d560-bbe8-409a-bbf6-5ba4ce2688a4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:24.920032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0401d560-bbe8-409a-bbf6-5ba4ce2688a4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:24.931723 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0401d560-bbe8-409a-bbf6-5ba4ce2688a4 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1535 microversion: 2.1 time: 1.065038 Oct 29 03:07:24.945161 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1995/4178] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:23 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1535 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:24.945161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-9e8f3e86-d64f-4556-bc27-e08321ab77bc req-c8c56cdb-31a6-4865-8522-31d8421f0260 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05f5328d-7d86-44f3-bb9f-8d06de0daa17", "name": "network-vif-plugged", "status": "completed", "tag": "febf7e0e-53b9-4105-ae6d-f9ae262ab497"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:24.977067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9e8f3e86-d64f-4556-bc27-e08321ab77bc req-c8c56cdb-31a6-4865-8522-31d8421f0260 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:24.977845 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9e8f3e86-d64f-4556-bc27-e08321ab77bc req-c8c56cdb-31a6-4865-8522-31d8421f0260 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:24.978460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9e8f3e86-d64f-4556-bc27-e08321ab77bc req-c8c56cdb-31a6-4865-8522-31d8421f0260 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:25.021151 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-9e8f3e86-d64f-4556-bc27-e08321ab77bc req-c8c56cdb-31a6-4865-8522-31d8421f0260 service nova] Creating event network-vif-plugged:febf7e0e-53b9-4105-ae6d-f9ae262ab497 for instance 05f5328d-7d86-44f3-bb9f-8d06de0daa17 on n-h2-862967-2 Oct 29 03:07:25.069505 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-9e8f3e86-d64f-4556-bc27-e08321ab77bc req-c8c56cdb-31a6-4865-8522-31d8421f0260 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119377 Oct 29 03:07:25.082735 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1996/4179] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:25.090180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3e3ae56d-c1c2-49b7-bec1-b405380c6940 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:25.091266 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3e3ae56d-c1c2-49b7-bec1-b405380c6940 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:25.100868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e3ae56d-c1c2-49b7-bec1-b405380c6940 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:25.102444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e3ae56d-c1c2-49b7-bec1-b405380c6940 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:25.103961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e3ae56d-c1c2-49b7-bec1-b405380c6940 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:25.111809 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e3ae56d-c1c2-49b7-bec1-b405380c6940 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:25.113347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e3ae56d-c1c2-49b7-bec1-b405380c6940 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:25.114435 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e3ae56d-c1c2-49b7-bec1-b405380c6940 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:25.161370 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1127063b-da3e-4c4a-b582-3e70946111e5 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.416824 Oct 29 03:07:25.162720 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2184/4180] 10.222.0.46 () {60 vars in 1170 bytes} [Sat Oct 29 03:07:19 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:25.171303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d069a88e-c8b3-4790-99e0-00871c3559bc tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:25.173594 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d069a88e-c8b3-4790-99e0-00871c3559bc tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] [instance: d9632deb-2bc8-41bc-a569-7adc8ee7aeae] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:25.186243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d069a88e-c8b3-4790-99e0-00871c3559bc tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:25.187081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d069a88e-c8b3-4790-99e0-00871c3559bc tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:25.187752 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d069a88e-c8b3-4790-99e0-00871c3559bc tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:25.189698 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d069a88e-c8b3-4790-99e0-00871c3559bc tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:25.190478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d069a88e-c8b3-4790-99e0-00871c3559bc tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:25.191419 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d069a88e-c8b3-4790-99e0-00871c3559bc tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:25.555463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d069a88e-c8b3-4790-99e0-00871c3559bc tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5feeb5524b34e7f91decfd441023a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5398fd3ca249b098fbaf6c2cb3b1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:25.568032 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d069a88e-c8b3-4790-99e0-00871c3559bc tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] 10.222.0.46 "GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae" status: 200 len: 1317 microversion: 2.1 time: 0.403941 Oct 29 03:07:25.569217 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2185/4181] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:25 2022] GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae => generated 1317 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:25.591618 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-117dae5a-f449-4ad7-878e-86abd8e6f948 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:25.592628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-117dae5a-f449-4ad7-878e-86abd8e6f948 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] [instance: be35564a-a67e-4a66-8dea-ea549a28c888] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:25.599297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-117dae5a-f449-4ad7-878e-86abd8e6f948 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:25.599850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-117dae5a-f449-4ad7-878e-86abd8e6f948 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:25.600838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-117dae5a-f449-4ad7-878e-86abd8e6f948 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:25.601974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-117dae5a-f449-4ad7-878e-86abd8e6f948 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:25.602612 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-117dae5a-f449-4ad7-878e-86abd8e6f948 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:25.603247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-117dae5a-f449-4ad7-878e-86abd8e6f948 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:25.859147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-117dae5a-f449-4ad7-878e-86abd8e6f948 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:25.873296 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-117dae5a-f449-4ad7-878e-86abd8e6f948 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:25.875026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-117dae5a-f449-4ad7-878e-86abd8e6f948 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:25.876452 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-117dae5a-f449-4ad7-878e-86abd8e6f948 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] 10.222.0.46 "GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888" status: 200 len: 1359 microversion: 2.21 time: 0.289181 Oct 29 03:07:25.888892 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2186/4182] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:25 2022] GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888 => generated 1359 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:25.893752 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4a8abf6c-6502-4564-ace3-ad5c9a7ac34e tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.7.189"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:25.896904 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4a8abf6c-6502-4564-ace3-ad5c9a7ac34e tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:25.903625 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a8abf6c-6502-4564-ace3-ad5c9a7ac34e tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:25.904359 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a8abf6c-6502-4564-ace3-ad5c9a7ac34e tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:25.905020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a8abf6c-6502-4564-ace3-ad5c9a7ac34e tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:25.905888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a8abf6c-6502-4564-ace3-ad5c9a7ac34e tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:25.906701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a8abf6c-6502-4564-ace3-ad5c9a7ac34e tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:25.907285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a8abf6c-6502-4564-ace3-ad5c9a7ac34e tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:25.964162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a8abf6c-6502-4564-ace3-ad5c9a7ac34e tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "refresh_cache-23eb1465-3e98-4ff0-acd6-15c3d092953e" {{(pid=127124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 03:07:25.965049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a8abf6c-6502-4564-ace3-ad5c9a7ac34e tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquired lock "refresh_cache-23eb1465-3e98-4ff0-acd6-15c3d092953e" {{(pid=127124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 03:07:26.041751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3e3ae56d-c1c2-49b7-bec1-b405380c6940 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:26.066268 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3e3ae56d-c1c2-49b7-bec1-b405380c6940 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1362 microversion: 2.1 time: 0.981942 Oct 29 03:07:26.067118 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1997/4183] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:25 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1362 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:26.085726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9a0d7e0e-5c3d-4a8e-8d1c-1cbf1a8819f2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:26.086759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9a0d7e0e-5c3d-4a8e-8d1c-1cbf1a8819f2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:26.102991 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a0d7e0e-5c3d-4a8e-8d1c-1cbf1a8819f2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:26.103951 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a0d7e0e-5c3d-4a8e-8d1c-1cbf1a8819f2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:26.104569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a0d7e0e-5c3d-4a8e-8d1c-1cbf1a8819f2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:26.105790 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a0d7e0e-5c3d-4a8e-8d1c-1cbf1a8819f2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:26.107414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a0d7e0e-5c3d-4a8e-8d1c-1cbf1a8819f2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:26.109140 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a0d7e0e-5c3d-4a8e-8d1c-1cbf1a8819f2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:26.758170 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9a0d7e0e-5c3d-4a8e-8d1c-1cbf1a8819f2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:26.783197 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9a0d7e0e-5c3d-4a8e-8d1c-1cbf1a8819f2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1528 microversion: 2.1 time: 0.714394 Oct 29 03:07:26.786408 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1998/4184] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:26 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1528 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:26.806637 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8c5640c5-f360-48d9-8bfe-d879d1099d4c tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:26.810057 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8c5640c5-f360-48d9-8bfe-d879d1099d4c tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] [instance: d9632deb-2bc8-41bc-a569-7adc8ee7aeae] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:26.832372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c5640c5-f360-48d9-8bfe-d879d1099d4c tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:26.833018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c5640c5-f360-48d9-8bfe-d879d1099d4c tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:26.833342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c5640c5-f360-48d9-8bfe-d879d1099d4c tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:26.834071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c5640c5-f360-48d9-8bfe-d879d1099d4c tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:26.836126 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c5640c5-f360-48d9-8bfe-d879d1099d4c tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:26.836624 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c5640c5-f360-48d9-8bfe-d879d1099d4c tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:27.531190 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8c5640c5-f360-48d9-8bfe-d879d1099d4c tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5feeb5524b34e7f91decfd441023a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5398fd3ca249b098fbaf6c2cb3b1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:27.547437 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8c5640c5-f360-48d9-8bfe-d879d1099d4c tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] 10.222.0.46 "GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae" status: 200 len: 1317 microversion: 2.1 time: 0.757031 Oct 29 03:07:27.548426 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 1999/4185] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:26 2022] GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae => generated 1317 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:27.562756 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c18110fd-3f37-4bbf-a105-71de8571fe82 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:27.564229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c18110fd-3f37-4bbf-a105-71de8571fe82 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:27.587121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c18110fd-3f37-4bbf-a105-71de8571fe82 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:27.590298 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c18110fd-3f37-4bbf-a105-71de8571fe82 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:27.595656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c18110fd-3f37-4bbf-a105-71de8571fe82 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:27.597346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c18110fd-3f37-4bbf-a105-71de8571fe82 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:27.601281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c18110fd-3f37-4bbf-a105-71de8571fe82 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:27.603030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c18110fd-3f37-4bbf-a105-71de8571fe82 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:28.340929 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c18110fd-3f37-4bbf-a105-71de8571fe82 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:28.362300 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c18110fd-3f37-4bbf-a105-71de8571fe82 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1528 microversion: 2.1 time: 0.811428 Oct 29 03:07:28.364151 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2000/4186] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:27 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1528 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:28.378173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-33aec03c-9798-43fc-a8bc-32e6a28d0f02 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:28.380223 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-33aec03c-9798-43fc-a8bc-32e6a28d0f02 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] [instance: be35564a-a67e-4a66-8dea-ea549a28c888] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:28.385347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:28.395290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33aec03c-9798-43fc-a8bc-32e6a28d0f02 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:28.401347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33aec03c-9798-43fc-a8bc-32e6a28d0f02 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:28.402620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33aec03c-9798-43fc-a8bc-32e6a28d0f02 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:28.404413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33aec03c-9798-43fc-a8bc-32e6a28d0f02 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:28.405589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33aec03c-9798-43fc-a8bc-32e6a28d0f02 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:28.406673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33aec03c-9798-43fc-a8bc-32e6a28d0f02 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:28.573336 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-4a8abf6c-6502-4564-ace3-ad5c9a7ac34e tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Building network info cache for instance {{(pid=127124) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 03:07:29.111759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-33aec03c-9798-43fc-a8bc-32e6a28d0f02 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:29.123866 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-33aec03c-9798-43fc-a8bc-32e6a28d0f02 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:29.126284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-33aec03c-9798-43fc-a8bc-32e6a28d0f02 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:29.127482 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-33aec03c-9798-43fc-a8bc-32e6a28d0f02 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] 10.222.0.46 "GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888" status: 200 len: 1359 microversion: 2.21 time: 0.761568 Oct 29 03:07:29.144571 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2001/4187] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:28 2022] GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888 => generated 1359 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:29.144571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-639f6efd-3d22-4ba7-8779-46dc487db1c1 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:29.144571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-639f6efd-3d22-4ba7-8779-46dc487db1c1 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:29.146439 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-639f6efd-3d22-4ba7-8779-46dc487db1c1 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:29.146951 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-639f6efd-3d22-4ba7-8779-46dc487db1c1 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:29.147394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-639f6efd-3d22-4ba7-8779-46dc487db1c1 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:29.148108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-639f6efd-3d22-4ba7-8779-46dc487db1c1 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:29.148773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-639f6efd-3d22-4ba7-8779-46dc487db1c1 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:29.149353 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-639f6efd-3d22-4ba7-8779-46dc487db1c1 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:29.452369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-4a8abf6c-6502-4564-ace3-ad5c9a7ac34e tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Updating instance_info_cache with network_info: [{"id": "00a83dbb-19d1-425c-aada-3a0206b02101", "address": "fa:16:3e:80:07:29", "network": {"id": "f033c0e4-b301-490d-90b1-f0012cd324da", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-145791643-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.7.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ee274ac8b7204c6a92db7d65a8f4ea62", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap00a83dbb-19", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127124) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 03:07:29.473421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a8abf6c-6502-4564-ace3-ad5c9a7ac34e tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Releasing lock "refresh_cache-23eb1465-3e98-4ff0-acd6-15c3d092953e" {{(pid=127124) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 03:07:29.475018 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4a8abf6c-6502-4564-ace3-ad5c9a7ac34e tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "POST /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e/action" status: 202 len: 0 microversion: 2.1 time: 3.596199 Oct 29 03:07:29.475369 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2187/4188] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:07:25 2022] POST /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e/action => generated 0 bytes in 3597 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 03:07:29.480582 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-1272c781-6fc7-4250-8e9e-0698211bbcfc req-0c57afc4-66bb-4a85-a6d1-524a55719585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9632deb-2bc8-41bc-a569-7adc8ee7aeae", "name": "network-vif-plugged", "status": "completed", "tag": "6014e303-2345-4b76-b7e7-7dd97081538f"}, {"server_uuid": "be35564a-a67e-4a66-8dea-ea549a28c888", "name": "network-vif-plugged", "status": "completed", "tag": "487baea1-128b-43b5-8b22-1c8bdaa6e2e2"}, {"server_uuid": "f60b0652-637b-48dd-8e61-950c0fe5b4c0", "name": "network-vif-plugged", "status": "completed", "tag": "7221ab02-8b17-48e5-a7aa-ed98c8fe3c5c"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:29.493490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1272c781-6fc7-4250-8e9e-0698211bbcfc req-0c57afc4-66bb-4a85-a6d1-524a55719585 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:29.493988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1272c781-6fc7-4250-8e9e-0698211bbcfc req-0c57afc4-66bb-4a85-a6d1-524a55719585 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:29.494424 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1272c781-6fc7-4250-8e9e-0698211bbcfc req-0c57afc4-66bb-4a85-a6d1-524a55719585 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:29.512080 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-1272c781-6fc7-4250-8e9e-0698211bbcfc req-0c57afc4-66bb-4a85-a6d1-524a55719585 service nova] Creating event network-vif-plugged:6014e303-2345-4b76-b7e7-7dd97081538f for instance d9632deb-2bc8-41bc-a569-7adc8ee7aeae on n-h2-862967-2 Oct 29 03:07:29.512931 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-1272c781-6fc7-4250-8e9e-0698211bbcfc req-0c57afc4-66bb-4a85-a6d1-524a55719585 service nova] Creating event network-vif-plugged:487baea1-128b-43b5-8b22-1c8bdaa6e2e2 for instance be35564a-a67e-4a66-8dea-ea549a28c888 on n-h1-862967-2 Oct 29 03:07:29.513747 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-1272c781-6fc7-4250-8e9e-0698211bbcfc req-0c57afc4-66bb-4a85-a6d1-524a55719585 service nova] Creating event network-vif-plugged:7221ab02-8b17-48e5-a7aa-ed98c8fe3c5c for instance f60b0652-637b-48dd-8e61-950c0fe5b4c0 on n-h2-862967-2 Oct 29 03:07:29.526597 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-1272c781-6fc7-4250-8e9e-0698211bbcfc req-0c57afc4-66bb-4a85-a6d1-524a55719585 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.049799 Oct 29 03:07:29.527531 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2188/4189] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:29.533718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-897cd44d-3692-4685-b370-52ecc116d0db tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:29.546431 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-897cd44d-3692-4685-b370-52ecc116d0db tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] HTTP exception thrown: Flavor c9f63f65-d539-4d65-a6f9-d6f0ebe08502 could not be found. Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-897cd44d-3692-4685-b370-52ecc116d0db tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Request method failure captured: Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/flavors/c9f63f65-d539-4d65-a6f9-d6f0ebe08502 HTTP/1.1 Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJfd0y2i6-293Kjwv-gEJGSdzkls9Uu61peO1lpo7ejybTGUaQyz3di4IB8aJ11aQFG7VkRthJxMVm1tJh0WLyZZ9TqY_E4nfyo8oDcOlAyCs-Rh-VzRCHwUKzuKjaiW2-dEw-A4Xa7N9DEfN_myFcCndOfI9lkZlAVbhrHFbCiP7a4 Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 1012bab651274e7ab9a5a713f6e0a0d7 Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-MigrationsAdminTest-872333494 Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: X-Role: admin,reader,member Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: admin,reader,member Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1012bab651274e7ab9a5a713f6e0a0d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1012bab651274e7ab9a5a713f6e0a0d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1012bab651274e7ab9a5a713f6e0a0d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1012bab651274e7ab9a5a713f6e0a0d7"}]}] Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-MigrationsAdminTest-872333494 Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 1012bab651274e7ab9a5a713f6e0a0d7 Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-MigrationsAdminTest-872333494 Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-MigrationsAdminTest-872333494-project-admin Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 4a84597a69a04a1d980b82b35c2e0d38 Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-MigrationsAdminTest-872333494-project-admin Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: exception: Flavor c9f63f65-d539-4d65-a6f9-d6f0ebe08502 could not be found. Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'c9f63f65-d539-4d65-a6f9-d6f0ebe08502'} Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor c9f63f65-d539-4d65-a6f9-d6f0ebe08502 could not be found. Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor c9f63f65-d539-4d65-a6f9-d6f0ebe08502 could not be found. Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:07:29.555309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:29.559407 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:07:29.559407 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:29.559407 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:29.559407 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:29.559407 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:07:29.559407 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:07:29.559407 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor c9f63f65-d539-4d65-a6f9-d6f0ebe08502 could not be found. Oct 29 03:07:29.559407 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:07:29.561181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-897cd44d-3692-4685-b370-52ecc116d0db tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Returning 404 to user: Flavor c9f63f65-d539-4d65-a6f9-d6f0ebe08502 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:07:29.562253 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-897cd44d-3692-4685-b370-52ecc116d0db tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/c9f63f65-d539-4d65-a6f9-d6f0ebe08502" status: 404 len: 109 microversion: 2.1 time: 0.033447 Oct 29 03:07:29.567069 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2189/4190] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:07:29 2022] DELETE /compute/v2.1/flavors/c9f63f65-d539-4d65-a6f9-d6f0ebe08502 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:07:29.583591 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3bf27c0e-8122-4ae0-ab47-264c58b0c0e0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:29.585039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3bf27c0e-8122-4ae0-ab47-264c58b0c0e0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] [instance: d9632deb-2bc8-41bc-a569-7adc8ee7aeae] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:29.595370 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3bf27c0e-8122-4ae0-ab47-264c58b0c0e0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:29.596234 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3bf27c0e-8122-4ae0-ab47-264c58b0c0e0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:29.596914 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3bf27c0e-8122-4ae0-ab47-264c58b0c0e0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:29.597892 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3bf27c0e-8122-4ae0-ab47-264c58b0c0e0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:29.598583 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3bf27c0e-8122-4ae0-ab47-264c58b0c0e0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:29.599447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3bf27c0e-8122-4ae0-ab47-264c58b0c0e0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:29.841641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3bf27c0e-8122-4ae0-ab47-264c58b0c0e0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5feeb5524b34e7f91decfd441023a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5398fd3ca249b098fbaf6c2cb3b1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:29.857788 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3bf27c0e-8122-4ae0-ab47-264c58b0c0e0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] 10.222.0.46 "GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae" status: 200 len: 1317 microversion: 2.1 time: 0.288612 Oct 29 03:07:29.860366 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2190/4191] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:29 2022] GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae => generated 1317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:29.871030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-5ab2928e-44c0-4b19-aae1-352fd06cd8ff req-53eebcee-be24-4030-9138-53f96dee591b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23eb1465-3e98-4ff0-acd6-15c3d092953e", "tag": "00a83dbb-19d1-425c-aada-3a0206b02101"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:29.906292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-639f6efd-3d22-4ba7-8779-46dc487db1c1 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:29.920399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5ab2928e-44c0-4b19-aae1-352fd06cd8ff req-53eebcee-be24-4030-9138-53f96dee591b service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:29.924631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5ab2928e-44c0-4b19-aae1-352fd06cd8ff req-53eebcee-be24-4030-9138-53f96dee591b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:29.928961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5ab2928e-44c0-4b19-aae1-352fd06cd8ff req-53eebcee-be24-4030-9138-53f96dee591b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:29.953949 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-5ab2928e-44c0-4b19-aae1-352fd06cd8ff req-53eebcee-be24-4030-9138-53f96dee591b service nova] Creating event network-changed:00a83dbb-19d1-425c-aada-3a0206b02101 for instance 23eb1465-3e98-4ff0-acd6-15c3d092953e on n-h1-862967-2 Oct 29 03:07:29.956581 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-639f6efd-3d22-4ba7-8779-46dc487db1c1 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1548 microversion: 2.1 time: 0.825770 Oct 29 03:07:29.966737 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-5ab2928e-44c0-4b19-aae1-352fd06cd8ff req-53eebcee-be24-4030-9138-53f96dee591b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103318 Oct 29 03:07:29.968088 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2002/4192] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:29 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1548 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:29.968890 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2191/4193] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:29.979159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-96853b8b-da0f-4cf8-8b51-fe188ca33e0d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.7.189"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:29.984847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c376740c-d702-4696-80b6-2795b90aacd5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-69134278", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:30.122550 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-c376740c-d702-4696-80b6-2795b90aacd5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] validate_networks() for None {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:07:30.416076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-96853b8b-da0f-4cf8-8b51-fe188ca33e0d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:30.423893 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96853b8b-da0f-4cf8-8b51-fe188ca33e0d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:30.424692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96853b8b-da0f-4cf8-8b51-fe188ca33e0d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:30.425297 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96853b8b-da0f-4cf8-8b51-fe188ca33e0d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:30.426167 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96853b8b-da0f-4cf8-8b51-fe188ca33e0d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:30.427519 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96853b8b-da0f-4cf8-8b51-fe188ca33e0d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:30.430443 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96853b8b-da0f-4cf8-8b51-fe188ca33e0d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:30.715156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-c376740c-d702-4696-80b6-2795b90aacd5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:07:30.715831 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-c376740c-d702-4696-80b6-2795b90aacd5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:07:30.716239 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-c376740c-d702-4696-80b6-2795b90aacd5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:07:30.716827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-c376740c-d702-4696-80b6-2795b90aacd5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:07:30.717345 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-c376740c-d702-4696-80b6-2795b90aacd5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:07:30.736681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c376740c-d702-4696-80b6-2795b90aacd5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:30.740999 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c376740c-d702-4696-80b6-2795b90aacd5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:30.741607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c376740c-d702-4696-80b6-2795b90aacd5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:30.745708 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c376740c-d702-4696-80b6-2795b90aacd5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:30.746452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c376740c-d702-4696-80b6-2795b90aacd5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:30.746955 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c376740c-d702-4696-80b6-2795b90aacd5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:30.845335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-c376740c-d702-4696-80b6-2795b90aacd5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Getting quotas for project 830acea7f5b948409e4b69d02aaeaf3b. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:07:30.853867 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-c376740c-d702-4696-80b6-2795b90aacd5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Getting quotas for user 7d3a840b017844a7b45b98bea21e8e38 and project 830acea7f5b948409e4b69d02aaeaf3b. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:07:30.871097 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c376740c-d702-4696-80b6-2795b90aacd5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:07:30.874620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c376740c-d702-4696-80b6-2795b90aacd5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:07:30.911106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:30.936317 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c376740c-d702-4696-80b6-2795b90aacd5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.959529 Oct 29 03:07:30.944320 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2192/4194] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:07:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:07:30.950655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8bbdffdb-d360-4ea6-b991-4dbecab57541 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:30.951550 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8bbdffdb-d360-4ea6-b991-4dbecab57541 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:30.979686 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bbdffdb-d360-4ea6-b991-4dbecab57541 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:30.981013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bbdffdb-d360-4ea6-b991-4dbecab57541 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:30.982618 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bbdffdb-d360-4ea6-b991-4dbecab57541 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:30.983713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bbdffdb-d360-4ea6-b991-4dbecab57541 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:30.984497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bbdffdb-d360-4ea6-b991-4dbecab57541 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:30.985165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bbdffdb-d360-4ea6-b991-4dbecab57541 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:31.345226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96853b8b-da0f-4cf8-8b51-fe188ca33e0d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "refresh_cache-23eb1465-3e98-4ff0-acd6-15c3d092953e" {{(pid=127125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 29 03:07:31.345636 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96853b8b-da0f-4cf8-8b51-fe188ca33e0d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquired lock "refresh_cache-23eb1465-3e98-4ff0-acd6-15c3d092953e" {{(pid=127125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 29 03:07:31.507984 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8bbdffdb-d360-4ea6-b991-4dbecab57541 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.560593 Oct 29 03:07:31.509974 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2193/4195] 10.222.0.46 () {58 vars in 1275 bytes} [Sat Oct 29 03:07:30 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17/os-interface => generated 285 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:31.520623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0104237d-9c8a-4bb3-ab5f-87d71aa4ccd8 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:31.527915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0104237d-9c8a-4bb3-ab5f-87d71aa4ccd8 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] [instance: be35564a-a67e-4a66-8dea-ea549a28c888] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:31.568872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0104237d-9c8a-4bb3-ab5f-87d71aa4ccd8 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:31.572834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0104237d-9c8a-4bb3-ab5f-87d71aa4ccd8 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:31.576214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0104237d-9c8a-4bb3-ab5f-87d71aa4ccd8 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:31.578963 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0104237d-9c8a-4bb3-ab5f-87d71aa4ccd8 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:31.582353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0104237d-9c8a-4bb3-ab5f-87d71aa4ccd8 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:31.583196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0104237d-9c8a-4bb3-ab5f-87d71aa4ccd8 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:32.493975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0104237d-9c8a-4bb3-ab5f-87d71aa4ccd8 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:32.517177 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0104237d-9c8a-4bb3-ab5f-87d71aa4ccd8 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:32.520663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0104237d-9c8a-4bb3-ab5f-87d71aa4ccd8 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:32.525671 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0104237d-9c8a-4bb3-ab5f-87d71aa4ccd8 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] 10.222.0.46 "GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888" status: 200 len: 1553 microversion: 2.21 time: 1.013684 Oct 29 03:07:32.539203 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2194/4196] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:31 2022] GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888 => generated 1553 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:32.545490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8617fedf-d7ef-4954-a682-29a8898c6462 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:32.546270 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8617fedf-d7ef-4954-a682-29a8898c6462 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] [instance: d9632deb-2bc8-41bc-a569-7adc8ee7aeae] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:32.553317 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8617fedf-d7ef-4954-a682-29a8898c6462 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:32.553976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8617fedf-d7ef-4954-a682-29a8898c6462 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:32.554554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8617fedf-d7ef-4954-a682-29a8898c6462 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:32.556086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8617fedf-d7ef-4954-a682-29a8898c6462 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:32.556086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8617fedf-d7ef-4954-a682-29a8898c6462 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:32.557180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8617fedf-d7ef-4954-a682-29a8898c6462 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:33.128248 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8617fedf-d7ef-4954-a682-29a8898c6462 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5feeb5524b34e7f91decfd441023a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5398fd3ca249b098fbaf6c2cb3b1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:33.153650 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8617fedf-d7ef-4954-a682-29a8898c6462 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] 10.222.0.46 "GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae" status: 200 len: 1505 microversion: 2.1 time: 0.612648 Oct 29 03:07:33.154922 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2195/4197] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:32 2022] GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae => generated 1505 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:33.175684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8275180c-cec6-4244-8c55-9de38ad8fedc tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:33.178643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8275180c-cec6-4244-8c55-9de38ad8fedc tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:33.200484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8275180c-cec6-4244-8c55-9de38ad8fedc tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:33.201920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8275180c-cec6-4244-8c55-9de38ad8fedc tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:33.206064 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8275180c-cec6-4244-8c55-9de38ad8fedc tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:33.207587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8275180c-cec6-4244-8c55-9de38ad8fedc tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:33.209161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8275180c-cec6-4244-8c55-9de38ad8fedc tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:33.210040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8275180c-cec6-4244-8c55-9de38ad8fedc tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:33.391531 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8275180c-cec6-4244-8c55-9de38ad8fedc tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:33.417610 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8275180c-cec6-4244-8c55-9de38ad8fedc tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1269 microversion: 2.1 time: 0.261134 Oct 29 03:07:33.430770 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2196/4198] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:33 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1269 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:33.442281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-689871ac-cd1c-4b25-bced-f2a01cad298c tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:33.443389 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-689871ac-cd1c-4b25-bced-f2a01cad298c tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] [instance: be35564a-a67e-4a66-8dea-ea549a28c888] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:33.453578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-689871ac-cd1c-4b25-bced-f2a01cad298c tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:33.454345 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-689871ac-cd1c-4b25-bced-f2a01cad298c tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:33.454957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-689871ac-cd1c-4b25-bced-f2a01cad298c tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:33.455683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-689871ac-cd1c-4b25-bced-f2a01cad298c tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:33.456332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-689871ac-cd1c-4b25-bced-f2a01cad298c tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:33.457004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-689871ac-cd1c-4b25-bced-f2a01cad298c tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:33.500965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:33.510395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-689871ac-cd1c-4b25-bced-f2a01cad298c tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] [instance: be35564a-a67e-4a66-8dea-ea549a28c888] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:07:33.665072 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-689871ac-cd1c-4b25-bced-f2a01cad298c tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] 10.222.0.46 "DELETE /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888" status: 204 len: 0 microversion: 2.21 time: 0.232305 Oct 29 03:07:33.666229 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2197/4199] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Oct 29 03:07:33 2022] DELETE /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:07:33.674527 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eb06e4c5-0377-47da-8080-be9648c4d41d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:33.675165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-eb06e4c5-0377-47da-8080-be9648c4d41d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] [instance: d9632deb-2bc8-41bc-a569-7adc8ee7aeae] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:33.686772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb06e4c5-0377-47da-8080-be9648c4d41d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:33.687856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb06e4c5-0377-47da-8080-be9648c4d41d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:33.688671 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb06e4c5-0377-47da-8080-be9648c4d41d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:33.689897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb06e4c5-0377-47da-8080-be9648c4d41d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:33.691032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb06e4c5-0377-47da-8080-be9648c4d41d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:33.692122 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb06e4c5-0377-47da-8080-be9648c4d41d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:33.734137 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eb06e4c5-0377-47da-8080-be9648c4d41d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] 10.222.0.46 "GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae/ips" status: 200 len: 108 microversion: 2.1 time: 0.066325 Oct 29 03:07:33.735365 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2198/4200] 10.222.0.46 () {58 vars in 1248 bytes} [Sat Oct 29 03:07:33 2022] GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae/ips => generated 108 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:33.740369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-09159fb3-0bd7-46c7-933d-9bb8922f35e1 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:33.741290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-09159fb3-0bd7-46c7-933d-9bb8922f35e1 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] [instance: be35564a-a67e-4a66-8dea-ea549a28c888] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:33.750839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09159fb3-0bd7-46c7-933d-9bb8922f35e1 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:33.752085 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09159fb3-0bd7-46c7-933d-9bb8922f35e1 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:33.752924 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09159fb3-0bd7-46c7-933d-9bb8922f35e1 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:33.753838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09159fb3-0bd7-46c7-933d-9bb8922f35e1 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:33.755617 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09159fb3-0bd7-46c7-933d-9bb8922f35e1 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:33.756230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09159fb3-0bd7-46c7-933d-9bb8922f35e1 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:34.192553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-96853b8b-da0f-4cf8-8b51-fe188ca33e0d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Building network info cache for instance {{(pid=127125) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 29 03:07:34.392110 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-09159fb3-0bd7-46c7-933d-9bb8922f35e1 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:34.407062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-09159fb3-0bd7-46c7-933d-9bb8922f35e1 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:34.409926 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-09159fb3-0bd7-46c7-933d-9bb8922f35e1 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:34.416035 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-09159fb3-0bd7-46c7-933d-9bb8922f35e1 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] 10.222.0.46 "GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888" status: 200 len: 1559 microversion: 2.21 time: 0.679407 Oct 29 03:07:34.417092 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2199/4201] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:33 2022] GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888 => generated 1559 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:34.430848 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cfb189df-8a7e-4f53-a948-e50335c4155d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:34.434559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cfb189df-8a7e-4f53-a948-e50335c4155d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] [instance: d9632deb-2bc8-41bc-a569-7adc8ee7aeae] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:34.455480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cfb189df-8a7e-4f53-a948-e50335c4155d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:34.456305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cfb189df-8a7e-4f53-a948-e50335c4155d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:34.456950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cfb189df-8a7e-4f53-a948-e50335c4155d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:34.457852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cfb189df-8a7e-4f53-a948-e50335c4155d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:34.458638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cfb189df-8a7e-4f53-a948-e50335c4155d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:34.460125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cfb189df-8a7e-4f53-a948-e50335c4155d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:34.511923 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cfb189df-8a7e-4f53-a948-e50335c4155d tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] 10.222.0.46 "GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae/ips" status: 200 len: 108 microversion: 2.1 time: 0.091251 Oct 29 03:07:34.528272 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2200/4202] 10.222.0.46 () {58 vars in 1248 bytes} [Sat Oct 29 03:07:34 2022] GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae/ips => generated 108 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:34.535750 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-52be555d-f325-419f-801e-386fc2ecc59e req-afa6a7a8-87bf-411e-b043-d81411822850 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23eb1465-3e98-4ff0-acd6-15c3d092953e", "tag": "00a83dbb-19d1-425c-aada-3a0206b02101"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:34.562691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-52be555d-f325-419f-801e-386fc2ecc59e req-afa6a7a8-87bf-411e-b043-d81411822850 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:34.563673 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-52be555d-f325-419f-801e-386fc2ecc59e req-afa6a7a8-87bf-411e-b043-d81411822850 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:34.564965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-52be555d-f325-419f-801e-386fc2ecc59e req-afa6a7a8-87bf-411e-b043-d81411822850 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:34.580390 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-52be555d-f325-419f-801e-386fc2ecc59e req-afa6a7a8-87bf-411e-b043-d81411822850 service nova] Creating event network-changed:00a83dbb-19d1-425c-aada-3a0206b02101 for instance 23eb1465-3e98-4ff0-acd6-15c3d092953e on n-h1-862967-2 Oct 29 03:07:34.586681 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-52be555d-f325-419f-801e-386fc2ecc59e req-afa6a7a8-87bf-411e-b043-d81411822850 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056724 Oct 29 03:07:34.587745 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2201/4203] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:34.594445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-df20153b-60cb-4db6-8e70-0de8ea09c779 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:34.595623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-df20153b-60cb-4db6-8e70-0de8ea09c779 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:34.608997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-df20153b-60cb-4db6-8e70-0de8ea09c779 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:34.609846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-df20153b-60cb-4db6-8e70-0de8ea09c779 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:34.610743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-df20153b-60cb-4db6-8e70-0de8ea09c779 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:34.612019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-df20153b-60cb-4db6-8e70-0de8ea09c779 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:34.612805 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-df20153b-60cb-4db6-8e70-0de8ea09c779 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:34.613881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-df20153b-60cb-4db6-8e70-0de8ea09c779 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:34.710952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-df20153b-60cb-4db6-8e70-0de8ea09c779 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:34.729210 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-df20153b-60cb-4db6-8e70-0de8ea09c779 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1269 microversion: 2.1 time: 0.139939 Oct 29 03:07:34.730111 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2202/4204] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:34 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1269 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:34.735472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3cf756e0-7d4d-4bbe-b651-e45b3782dff9 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:34.735841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3cf756e0-7d4d-4bbe-b651-e45b3782dff9 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] [instance: d9632deb-2bc8-41bc-a569-7adc8ee7aeae] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:34.748067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3cf756e0-7d4d-4bbe-b651-e45b3782dff9 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:34.748579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3cf756e0-7d4d-4bbe-b651-e45b3782dff9 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:34.756039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3cf756e0-7d4d-4bbe-b651-e45b3782dff9 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:34.757204 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3cf756e0-7d4d-4bbe-b651-e45b3782dff9 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:34.759965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3cf756e0-7d4d-4bbe-b651-e45b3782dff9 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:34.760618 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3cf756e0-7d4d-4bbe-b651-e45b3782dff9 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:34.800222 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3cf756e0-7d4d-4bbe-b651-e45b3782dff9 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] 10.222.0.46 "GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae/ips/tempest-ServerAddressesTestJSON-117268862-network" status: 200 len: 93 microversion: 2.1 time: 0.068953 Oct 29 03:07:34.801462 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2203/4205] 10.222.0.46 () {58 vars in 1398 bytes} [Sat Oct 29 03:07:34 2022] GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae/ips/tempest-ServerAddressesTestJSON-117268862-network => generated 93 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:07:34.820966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1c6efc96-22d6-4360-894f-3d4099f43f0a tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:34.821938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1c6efc96-22d6-4360-894f-3d4099f43f0a tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] [instance: d9632deb-2bc8-41bc-a569-7adc8ee7aeae] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:34.837875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c6efc96-22d6-4360-894f-3d4099f43f0a tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:34.848473 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c6efc96-22d6-4360-894f-3d4099f43f0a tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:34.853218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c6efc96-22d6-4360-894f-3d4099f43f0a tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:34.857566 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c6efc96-22d6-4360-894f-3d4099f43f0a tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:34.858294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c6efc96-22d6-4360-894f-3d4099f43f0a tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:34.860621 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c6efc96-22d6-4360-894f-3d4099f43f0a tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:34.950016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1c6efc96-22d6-4360-894f-3d4099f43f0a tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] [instance: d9632deb-2bc8-41bc-a569-7adc8ee7aeae] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:07:35.158085 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1c6efc96-22d6-4360-894f-3d4099f43f0a tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae" status: 204 len: 0 microversion: 2.1 time: 0.348112 Oct 29 03:07:35.159800 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2204/4206] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:07:34 2022] DELETE /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 03:07:35.173060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bdbf84fa-10f2-4db0-92e5-e0438a24e740 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:35.174834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bdbf84fa-10f2-4db0-92e5-e0438a24e740 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] [instance: d9632deb-2bc8-41bc-a569-7adc8ee7aeae] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:35.191752 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdbf84fa-10f2-4db0-92e5-e0438a24e740 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:35.193628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdbf84fa-10f2-4db0-92e5-e0438a24e740 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:35.194868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdbf84fa-10f2-4db0-92e5-e0438a24e740 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:35.197579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdbf84fa-10f2-4db0-92e5-e0438a24e740 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:35.198512 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdbf84fa-10f2-4db0-92e5-e0438a24e740 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:35.199981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdbf84fa-10f2-4db0-92e5-e0438a24e740 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:35.997159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bdbf84fa-10f2-4db0-92e5-e0438a24e740 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5feeb5524b34e7f91decfd441023a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5398fd3ca249b098fbaf6c2cb3b1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:36.009429 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bdbf84fa-10f2-4db0-92e5-e0438a24e740 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] 10.222.0.46 "GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae" status: 200 len: 1511 microversion: 2.1 time: 0.841774 Oct 29 03:07:36.011591 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2205/4207] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:35 2022] GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae => generated 1511 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:36.022639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-4538b262-2539-42f9-a337-329ddf63fde1 req-789db06a-1e8c-4b93-b97d-704bac89e412 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05f5328d-7d86-44f3-bb9f-8d06de0daa17", "tag": "febf7e0e-53b9-4105-ae6d-f9ae262ab497"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:36.048905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4538b262-2539-42f9-a337-329ddf63fde1 req-789db06a-1e8c-4b93-b97d-704bac89e412 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:36.051562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4538b262-2539-42f9-a337-329ddf63fde1 req-789db06a-1e8c-4b93-b97d-704bac89e412 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:36.052230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4538b262-2539-42f9-a337-329ddf63fde1 req-789db06a-1e8c-4b93-b97d-704bac89e412 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:36.089138 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-4538b262-2539-42f9-a337-329ddf63fde1 req-789db06a-1e8c-4b93-b97d-704bac89e412 service nova] Creating event network-changed:febf7e0e-53b9-4105-ae6d-f9ae262ab497 for instance 05f5328d-7d86-44f3-bb9f-8d06de0daa17 on n-h2-862967-2 Oct 29 03:07:36.099271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-96853b8b-da0f-4cf8-8b51-fe188ca33e0d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Updating instance_info_cache with network_info: [{"id": "00a83dbb-19d1-425c-aada-3a0206b02101", "address": "fa:16:3e:80:07:29", "network": {"id": "f033c0e4-b301-490d-90b1-f0012cd324da", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-145791643-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ee274ac8b7204c6a92db7d65a8f4ea62", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap00a83dbb-19", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127125) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 03:07:36.112073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:36.116825 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-4538b262-2539-42f9-a337-329ddf63fde1 req-789db06a-1e8c-4b93-b97d-704bac89e412 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102051 Oct 29 03:07:36.118658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96853b8b-da0f-4cf8-8b51-fe188ca33e0d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Releasing lock "refresh_cache-23eb1465-3e98-4ff0-acd6-15c3d092953e" {{(pid=127125) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 29 03:07:36.119224 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2206/4208] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:36.124014 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-96853b8b-da0f-4cf8-8b51-fe188ca33e0d tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "POST /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e/action" status: 202 len: 0 microversion: 2.1 time: 6.153575 Oct 29 03:07:36.125135 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2003/4209] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:07:29 2022] POST /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e/action => generated 0 bytes in 6156 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 29 03:07:36.137417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-07ae9166-0457-4bc8-8140-3dd678493f6b tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:36.139131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-07987b48-e84f-4766-af92-94e68410e64c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:36.141522 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-07ae9166-0457-4bc8-8140-3dd678493f6b tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] [instance: be35564a-a67e-4a66-8dea-ea549a28c888] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:36.143369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-07987b48-e84f-4766-af92-94e68410e64c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:36.163644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07ae9166-0457-4bc8-8140-3dd678493f6b tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:36.167375 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07ae9166-0457-4bc8-8140-3dd678493f6b tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:36.169643 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07987b48-e84f-4766-af92-94e68410e64c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:36.170852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07ae9166-0457-4bc8-8140-3dd678493f6b tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:36.172753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07ae9166-0457-4bc8-8140-3dd678493f6b tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:36.173835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07987b48-e84f-4766-af92-94e68410e64c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:36.174521 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07987b48-e84f-4766-af92-94e68410e64c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:36.175266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07ae9166-0457-4bc8-8140-3dd678493f6b tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:36.176247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07987b48-e84f-4766-af92-94e68410e64c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:36.176960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07ae9166-0457-4bc8-8140-3dd678493f6b tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:36.177719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07987b48-e84f-4766-af92-94e68410e64c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:36.178864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07987b48-e84f-4766-af92-94e68410e64c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:37.123585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-07ae9166-0457-4bc8-8140-3dd678493f6b tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:37.138966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-07ae9166-0457-4bc8-8140-3dd678493f6b tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:37.145084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-07ae9166-0457-4bc8-8140-3dd678493f6b tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:37.149086 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-07ae9166-0457-4bc8-8140-3dd678493f6b tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] 10.222.0.46 "GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888" status: 200 len: 1559 microversion: 2.21 time: 1.027290 Oct 29 03:07:37.150933 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2207/4210] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:36 2022] GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888 => generated 1559 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:37.160309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ed1aa5b6-67b2-4b7b-9a96-1cbc3acb20c8 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '.version_select at 0x7ff05c042a60>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:37.257324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-07987b48-e84f-4766-af92-94e68410e64c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:37.282353 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-07987b48-e84f-4766-af92-94e68410e64c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1311 microversion: 2.1 time: 1.153198 Oct 29 03:07:37.283504 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2004/4211] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:36 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1311 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:37.290132 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-376acb4f-3a9e-4d3a-b0e4-90f5562a8554 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:37.293022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-376acb4f-3a9e-4d3a-b0e4-90f5562a8554 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] [instance: d9632deb-2bc8-41bc-a569-7adc8ee7aeae] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:37.304925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-376acb4f-3a9e-4d3a-b0e4-90f5562a8554 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:37.306003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-376acb4f-3a9e-4d3a-b0e4-90f5562a8554 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:37.306950 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-376acb4f-3a9e-4d3a-b0e4-90f5562a8554 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:37.308072 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-376acb4f-3a9e-4d3a-b0e4-90f5562a8554 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:37.308877 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-376acb4f-3a9e-4d3a-b0e4-90f5562a8554 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:37.310207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-376acb4f-3a9e-4d3a-b0e4-90f5562a8554 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:38.187120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-376acb4f-3a9e-4d3a-b0e4-90f5562a8554 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5feeb5524b34e7f91decfd441023a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5398fd3ca249b098fbaf6c2cb3b1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:38.203542 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-376acb4f-3a9e-4d3a-b0e4-90f5562a8554 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] 10.222.0.46 "GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae" status: 200 len: 1511 microversion: 2.1 time: 0.918562 Oct 29 03:07:38.204223 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2005/4212] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:37 2022] GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae => generated 1511 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:38.214154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-6d0188dd-f1fb-4791-bfdf-e124c02acafd req-effd28bc-e884-4c96-be7a-3eeb666b7060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be35564a-a67e-4a66-8dea-ea549a28c888", "name": "network-vif-deleted", "tag": "487baea1-128b-43b5-8b22-1c8bdaa6e2e2"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:38.230936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6d0188dd-f1fb-4791-bfdf-e124c02acafd req-effd28bc-e884-4c96-be7a-3eeb666b7060 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:38.231272 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6d0188dd-f1fb-4791-bfdf-e124c02acafd req-effd28bc-e884-4c96-be7a-3eeb666b7060 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:38.232008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6d0188dd-f1fb-4791-bfdf-e124c02acafd req-effd28bc-e884-4c96-be7a-3eeb666b7060 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:38.245395 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-6d0188dd-f1fb-4791-bfdf-e124c02acafd req-effd28bc-e884-4c96-be7a-3eeb666b7060 service nova] Creating event network-vif-deleted:487baea1-128b-43b5-8b22-1c8bdaa6e2e2 for instance be35564a-a67e-4a66-8dea-ea549a28c888 on n-h1-862967-2 Oct 29 03:07:38.253701 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-6d0188dd-f1fb-4791-bfdf-e124c02acafd req-effd28bc-e884-4c96-be7a-3eeb666b7060 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042972 Oct 29 03:07:38.258304 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2006/4213] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:38.288093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cbd71315-ae50-4f97-ba43-583cf8f7c0b8 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:38.291626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cbd71315-ae50-4f97-ba43-583cf8f7c0b8 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] [instance: be35564a-a67e-4a66-8dea-ea549a28c888] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:38.313833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbd71315-ae50-4f97-ba43-583cf8f7c0b8 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:38.314357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbd71315-ae50-4f97-ba43-583cf8f7c0b8 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:38.314785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbd71315-ae50-4f97-ba43-583cf8f7c0b8 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:38.315560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbd71315-ae50-4f97-ba43-583cf8f7c0b8 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:38.316053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbd71315-ae50-4f97-ba43-583cf8f7c0b8 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:38.316609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbd71315-ae50-4f97-ba43-583cf8f7c0b8 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:38.370306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbd71315-ae50-4f97-ba43-583cf8f7c0b8 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:38.371074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbd71315-ae50-4f97-ba43-583cf8f7c0b8 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:38.372063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbd71315-ae50-4f97-ba43-583cf8f7c0b8 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:38.373122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-cbd71315-ae50-4f97-ba43-583cf8f7c0b8 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lazy-loading 'fault' on Instance uuid be35564a-a67e-4a66-8dea-ea549a28c888 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:07:38.510218 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cbd71315-ae50-4f97-ba43-583cf8f7c0b8 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:38.520105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cbd71315-ae50-4f97-ba43-583cf8f7c0b8 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:38.531156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cbd71315-ae50-4f97-ba43-583cf8f7c0b8 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb050a35fbdf4bfe9727f4c0dce1118e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15a0dfb728949ac8cd3ada72385fe68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:38.532613 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cbd71315-ae50-4f97-ba43-583cf8f7c0b8 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] 10.222.0.46 "GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888" status: 200 len: 1349 microversion: 2.21 time: 0.272139 Oct 29 03:07:38.533465 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2007/4214] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:38 2022] GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888 => generated 1349 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:07:38.543313 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7f3d8103-2c24-432b-be84-958ce8dee523 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:38.544141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7f3d8103-2c24-432b-be84-958ce8dee523 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:38.566308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f3d8103-2c24-432b-be84-958ce8dee523 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:38.567021 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f3d8103-2c24-432b-be84-958ce8dee523 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:38.567617 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f3d8103-2c24-432b-be84-958ce8dee523 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:38.568513 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f3d8103-2c24-432b-be84-958ce8dee523 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:38.569155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f3d8103-2c24-432b-be84-958ce8dee523 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:38.569732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f3d8103-2c24-432b-be84-958ce8dee523 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:39.261640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7f3d8103-2c24-432b-be84-958ce8dee523 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:39.281213 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7f3d8103-2c24-432b-be84-958ce8dee523 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1311 microversion: 2.1 time: 0.746401 Oct 29 03:07:39.291164 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2008/4215] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:38 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1311 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:39.329567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f5c85319-4e14-441d-a223-7199b216cb58 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:39.339634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f5c85319-4e14-441d-a223-7199b216cb58 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] [instance: d9632deb-2bc8-41bc-a569-7adc8ee7aeae] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:39.363183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5c85319-4e14-441d-a223-7199b216cb58 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:39.363881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5c85319-4e14-441d-a223-7199b216cb58 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:39.364774 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5c85319-4e14-441d-a223-7199b216cb58 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:39.366404 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5c85319-4e14-441d-a223-7199b216cb58 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:39.369741 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5c85319-4e14-441d-a223-7199b216cb58 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:39.370446 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5c85319-4e14-441d-a223-7199b216cb58 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:39.944421 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f5c85319-4e14-441d-a223-7199b216cb58 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5feeb5524b34e7f91decfd441023a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5398fd3ca249b098fbaf6c2cb3b1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:39.961638 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f5c85319-4e14-441d-a223-7199b216cb58 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] 10.222.0.46 "GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae" status: 200 len: 1511 microversion: 2.1 time: 0.668443 Oct 29 03:07:39.962242 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2009/4216] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:39 2022] GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae => generated 1511 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:39.981352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-77552f14-2d45-4e78-9e43-7de56706bbd2 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:39.982319 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-77552f14-2d45-4e78-9e43-7de56706bbd2 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] [instance: be35564a-a67e-4a66-8dea-ea549a28c888] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:39.994187 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77552f14-2d45-4e78-9e43-7de56706bbd2 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:39.995152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77552f14-2d45-4e78-9e43-7de56706bbd2 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:39.995888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77552f14-2d45-4e78-9e43-7de56706bbd2 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:39.997366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77552f14-2d45-4e78-9e43-7de56706bbd2 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:39.999053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77552f14-2d45-4e78-9e43-7de56706bbd2 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:40.001453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77552f14-2d45-4e78-9e43-7de56706bbd2 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:40.028283 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-77552f14-2d45-4e78-9e43-7de56706bbd2 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] HTTP exception thrown: Instance be35564a-a67e-4a66-8dea-ea549a28c888 could not be found. Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-77552f14-2d45-4e78-9e43-7de56706bbd2 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Request method failure captured: Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888 HTTP/1.1 Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJjWoC7ExXeiCjbvhIfmgaIKDKt-2ny0K8bjBcollW9-EoefeWi2MVpr7GYXIHZCFGNheZpK0lkrgBYwGG7icXuKET4DVaRnXhMjr6Pcg-JrSuQZBqRf0gocwUYbguEoSPETM-_jG5EBztnOjYnfZNUTAgna4f7P0A6jczHLzW777ac Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: X-Openstack-Nova-Api-Version: 2.21 Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: b15a0dfb728949ac8cd3ada72385fe68 Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-InstanceActionsV221TestJSON-924200889 Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b15a0dfb728949ac8cd3ada72385fe68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b15a0dfb728949ac8cd3ada72385fe68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b15a0dfb728949ac8cd3ada72385fe68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b15a0dfb728949ac8cd3ada72385fe68"}]}] Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-InstanceActionsV221TestJSON-924200889 Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: b15a0dfb728949ac8cd3ada72385fe68 Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-924200889 Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-InstanceActionsV221TestJSON-924200889-project Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: bb050a35fbdf4bfe9727f4c0dce1118e Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-InstanceActionsV221TestJSON-924200889-project Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance be35564a-a67e-4a66-8dea-ea549a28c888 could not be found. Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'be35564a-a67e-4a66-8dea-ea549a28c888'} Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be35564a-a67e-4a66-8dea-ea549a28c888 could not be found. Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be35564a-a67e-4a66-8dea-ea549a28c888 could not be found. Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:07:40.042678 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:40.047118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:07:40.047118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:40.047118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:40.047118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:40.047118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:07:40.047118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:07:40.047118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be35564a-a67e-4a66-8dea-ea549a28c888 could not be found. Oct 29 03:07:40.047118 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:07:40.049388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-77552f14-2d45-4e78-9e43-7de56706bbd2 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Returning 404 to user: Instance be35564a-a67e-4a66-8dea-ea549a28c888 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:07:40.050550 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-77552f14-2d45-4e78-9e43-7de56706bbd2 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] 10.222.0.46 "GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888" status: 404 len: 111 microversion: 2.21 time: 0.087026 Oct 29 03:07:40.051762 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2010/4217] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:39 2022] GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:07:40.060693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-00887660-9eb6-4dde-ad08-689b6607e149 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Calling method '.version_select at 0x7ff053a85ca0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:40.061670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-00887660-9eb6-4dde-ad08-689b6607e149 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] [instance: be35564a-a67e-4a66-8dea-ea549a28c888] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:40.074943 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00887660-9eb6-4dde-ad08-689b6607e149 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:40.078086 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00887660-9eb6-4dde-ad08-689b6607e149 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:40.078849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00887660-9eb6-4dde-ad08-689b6607e149 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:40.079660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00887660-9eb6-4dde-ad08-689b6607e149 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:40.081711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00887660-9eb6-4dde-ad08-689b6607e149 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:40.082245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00887660-9eb6-4dde-ad08-689b6607e149 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:40.254081 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-00887660-9eb6-4dde-ad08-689b6607e149 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] 10.222.0.46 "GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.197633 Oct 29 03:07:40.258490 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2011/4218] 10.222.0.46 () {60 vars in 1337 bytes} [Sat Oct 29 03:07:40 2022] GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888/os-instance-actions => generated 611 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:07:40.274234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0f1ff001-ba76-4e6b-9247-49185eab7d17 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:40.275598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0f1ff001-ba76-4e6b-9247-49185eab7d17 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] [instance: be35564a-a67e-4a66-8dea-ea549a28c888] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:40.295459 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f1ff001-ba76-4e6b-9247-49185eab7d17 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:40.295957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f1ff001-ba76-4e6b-9247-49185eab7d17 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:40.296644 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f1ff001-ba76-4e6b-9247-49185eab7d17 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:40.297364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f1ff001-ba76-4e6b-9247-49185eab7d17 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:40.298076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f1ff001-ba76-4e6b-9247-49185eab7d17 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:40.298716 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f1ff001-ba76-4e6b-9247-49185eab7d17 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:40.329591 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-0f1ff001-ba76-4e6b-9247-49185eab7d17 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] HTTP exception thrown: Instance be35564a-a67e-4a66-8dea-ea549a28c888 could not be found. Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0f1ff001-ba76-4e6b-9247-49185eab7d17 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Request method failure captured: Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888 HTTP/1.1 Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJjWoC7ExXeiCjbvhIfmgaIKDKt-2ny0K8bjBcollW9-EoefeWi2MVpr7GYXIHZCFGNheZpK0lkrgBYwGG7icXuKET4DVaRnXhMjr6Pcg-JrSuQZBqRf0gocwUYbguEoSPETM-_jG5EBztnOjYnfZNUTAgna4f7P0A6jczHLzW777ac Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: X-Openstack-Nova-Api-Version: 2.21 Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: b15a0dfb728949ac8cd3ada72385fe68 Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-InstanceActionsV221TestJSON-924200889 Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b15a0dfb728949ac8cd3ada72385fe68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b15a0dfb728949ac8cd3ada72385fe68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b15a0dfb728949ac8cd3ada72385fe68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b15a0dfb728949ac8cd3ada72385fe68"}]}] Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-InstanceActionsV221TestJSON-924200889 Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: b15a0dfb728949ac8cd3ada72385fe68 Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-924200889 Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-InstanceActionsV221TestJSON-924200889-project Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: bb050a35fbdf4bfe9727f4c0dce1118e Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-InstanceActionsV221TestJSON-924200889-project Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance be35564a-a67e-4a66-8dea-ea549a28c888 could not be found. Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'be35564a-a67e-4a66-8dea-ea549a28c888'} Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be35564a-a67e-4a66-8dea-ea549a28c888 could not be found. Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:07:40.333341 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:07:40.340398 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be35564a-a67e-4a66-8dea-ea549a28c888 could not be found. Oct 29 03:07:40.340398 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:07:40.340398 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:40.340398 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:07:40.340398 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:40.340398 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:40.340398 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:40.340398 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:07:40.340398 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:07:40.340398 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be35564a-a67e-4a66-8dea-ea549a28c888 could not be found. Oct 29 03:07:40.340398 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:07:40.349525 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0f1ff001-ba76-4e6b-9247-49185eab7d17 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Returning 404 to user: Instance be35564a-a67e-4a66-8dea-ea549a28c888 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:07:40.351459 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0f1ff001-ba76-4e6b-9247-49185eab7d17 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] 10.222.0.46 "DELETE /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888" status: 404 len: 111 microversion: 2.21 time: 0.081573 Oct 29 03:07:40.368802 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2012/4219] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Oct 29 03:07:40 2022] DELETE /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:07:40.371978 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-92ce8d61-2a0a-4627-ae98-b061d94f205d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:40.372792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-92ce8d61-2a0a-4627-ae98-b061d94f205d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:40.389893 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92ce8d61-2a0a-4627-ae98-b061d94f205d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:40.390641 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92ce8d61-2a0a-4627-ae98-b061d94f205d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:40.391259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92ce8d61-2a0a-4627-ae98-b061d94f205d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:40.392141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92ce8d61-2a0a-4627-ae98-b061d94f205d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:40.392779 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92ce8d61-2a0a-4627-ae98-b061d94f205d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:40.393442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92ce8d61-2a0a-4627-ae98-b061d94f205d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:40.814839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:40.865806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:41.060997 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-92ce8d61-2a0a-4627-ae98-b061d94f205d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:41.069579 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-92ce8d61-2a0a-4627-ae98-b061d94f205d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1311 microversion: 2.1 time: 0.702750 Oct 29 03:07:41.079971 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2013/4220] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:40 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1311 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:41.085976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-f24904d2-f56a-4b8c-b4c6-181e8248e1ad req-ca074a22-3619-49fe-8001-f39835b1f152 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c25c557-35b6-4dce-99f0-4e2b1c43cf40", "tag": "544bbd3a-133a-48fc-85fa-eb236d549271"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:41.119420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f24904d2-f56a-4b8c-b4c6-181e8248e1ad req-ca074a22-3619-49fe-8001-f39835b1f152 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:41.119899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f24904d2-f56a-4b8c-b4c6-181e8248e1ad req-ca074a22-3619-49fe-8001-f39835b1f152 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:41.120661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f24904d2-f56a-4b8c-b4c6-181e8248e1ad req-ca074a22-3619-49fe-8001-f39835b1f152 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:41.141342 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-f24904d2-f56a-4b8c-b4c6-181e8248e1ad req-ca074a22-3619-49fe-8001-f39835b1f152 service nova] Creating event network-changed:544bbd3a-133a-48fc-85fa-eb236d549271 for instance 3c25c557-35b6-4dce-99f0-4e2b1c43cf40 on n-h1-862967-2 Oct 29 03:07:41.159618 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-f24904d2-f56a-4b8c-b4c6-181e8248e1ad req-ca074a22-3619-49fe-8001-f39835b1f152 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077754 Oct 29 03:07:41.170106 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2014/4221] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:41.187526 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f76d9923-8735-4959-b3ed-136bc7f7ca53 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:41.191655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f76d9923-8735-4959-b3ed-136bc7f7ca53 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] [instance: be35564a-a67e-4a66-8dea-ea549a28c888] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:41.202301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f76d9923-8735-4959-b3ed-136bc7f7ca53 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:41.203454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f76d9923-8735-4959-b3ed-136bc7f7ca53 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:41.204477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f76d9923-8735-4959-b3ed-136bc7f7ca53 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:41.206271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f76d9923-8735-4959-b3ed-136bc7f7ca53 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:41.207311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f76d9923-8735-4959-b3ed-136bc7f7ca53 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:41.208316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f76d9923-8735-4959-b3ed-136bc7f7ca53 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:41.240431 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-f76d9923-8735-4959-b3ed-136bc7f7ca53 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] HTTP exception thrown: Instance be35564a-a67e-4a66-8dea-ea549a28c888 could not be found. Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f76d9923-8735-4959-b3ed-136bc7f7ca53 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Request method failure captured: Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888 HTTP/1.1 Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJjWoC7ExXeiCjbvhIfmgaIKDKt-2ny0K8bjBcollW9-EoefeWi2MVpr7GYXIHZCFGNheZpK0lkrgBYwGG7icXuKET4DVaRnXhMjr6Pcg-JrSuQZBqRf0gocwUYbguEoSPETM-_jG5EBztnOjYnfZNUTAgna4f7P0A6jczHLzW777ac Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: X-Openstack-Nova-Api-Version: 2.21 Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: b15a0dfb728949ac8cd3ada72385fe68 Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-InstanceActionsV221TestJSON-924200889 Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b15a0dfb728949ac8cd3ada72385fe68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b15a0dfb728949ac8cd3ada72385fe68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b15a0dfb728949ac8cd3ada72385fe68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b15a0dfb728949ac8cd3ada72385fe68"}]}] Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-InstanceActionsV221TestJSON-924200889 Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: b15a0dfb728949ac8cd3ada72385fe68 Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-924200889 Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-InstanceActionsV221TestJSON-924200889-project Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: bb050a35fbdf4bfe9727f4c0dce1118e Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-InstanceActionsV221TestJSON-924200889-project Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance be35564a-a67e-4a66-8dea-ea549a28c888 could not be found. Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'be35564a-a67e-4a66-8dea-ea549a28c888'} Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be35564a-a67e-4a66-8dea-ea549a28c888 could not be found. Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be35564a-a67e-4a66-8dea-ea549a28c888 could not be found. Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:07:41.244222 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:41.251284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:07:41.251284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:41.251284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:41.251284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:41.251284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:07:41.251284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:07:41.251284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be35564a-a67e-4a66-8dea-ea549a28c888 could not be found. Oct 29 03:07:41.251284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:07:41.257486 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f76d9923-8735-4959-b3ed-136bc7f7ca53 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] Returning 404 to user: Instance be35564a-a67e-4a66-8dea-ea549a28c888 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:07:41.259698 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f76d9923-8735-4959-b3ed-136bc7f7ca53 tempest-InstanceActionsV221TestJSON-924200889 tempest-InstanceActionsV221TestJSON-924200889-project] 10.222.0.46 "GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888" status: 404 len: 111 microversion: 2.21 time: 0.087599 Oct 29 03:07:41.260859 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2015/4222] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:07:41 2022] GET /compute/v2.1/servers/be35564a-a67e-4a66-8dea-ea549a28c888 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:07:41.265869 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-e9301a7a-95a3-40f8-a26c-6f51f163c32d req-5a3fcde7-1588-4cee-8c14-eca9f3551e5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9632deb-2bc8-41bc-a569-7adc8ee7aeae", "name": "network-vif-deleted", "tag": "6014e303-2345-4b76-b7e7-7dd97081538f"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:41.283957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e9301a7a-95a3-40f8-a26c-6f51f163c32d req-5a3fcde7-1588-4cee-8c14-eca9f3551e5b service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:41.285173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e9301a7a-95a3-40f8-a26c-6f51f163c32d req-5a3fcde7-1588-4cee-8c14-eca9f3551e5b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:41.285963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e9301a7a-95a3-40f8-a26c-6f51f163c32d req-5a3fcde7-1588-4cee-8c14-eca9f3551e5b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:41.312007 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-e9301a7a-95a3-40f8-a26c-6f51f163c32d req-5a3fcde7-1588-4cee-8c14-eca9f3551e5b service nova] Creating event network-vif-deleted:6014e303-2345-4b76-b7e7-7dd97081538f for instance d9632deb-2bc8-41bc-a569-7adc8ee7aeae on n-h2-862967-2 Oct 29 03:07:41.327243 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-e9301a7a-95a3-40f8-a26c-6f51f163c32d req-5a3fcde7-1588-4cee-8c14-eca9f3551e5b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064344 Oct 29 03:07:41.334810 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2016/4223] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:41.353581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-924cc947-f622-49aa-b961-bb922dd258d0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:41.361805 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-924cc947-f622-49aa-b961-bb922dd258d0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] [instance: d9632deb-2bc8-41bc-a569-7adc8ee7aeae] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:41.379836 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-924cc947-f622-49aa-b961-bb922dd258d0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:41.380248 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-924cc947-f622-49aa-b961-bb922dd258d0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:41.380719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-924cc947-f622-49aa-b961-bb922dd258d0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:41.381440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-924cc947-f622-49aa-b961-bb922dd258d0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:41.381898 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-924cc947-f622-49aa-b961-bb922dd258d0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:41.382315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-924cc947-f622-49aa-b961-bb922dd258d0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:41.474667 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-924cc947-f622-49aa-b961-bb922dd258d0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:41.476771 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-924cc947-f622-49aa-b961-bb922dd258d0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:41.477271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-924cc947-f622-49aa-b961-bb922dd258d0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:41.480758 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-924cc947-f622-49aa-b961-bb922dd258d0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lazy-loading 'fault' on Instance uuid d9632deb-2bc8-41bc-a569-7adc8ee7aeae {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:07:42.026162 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ed1aa5b6-67b2-4b7b-9a96-1cbc3acb20c8 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "DELETE /compute/v2.1/os-floating-ips/74dbc01b-f7ac-4138-942f-0ffaca0cfe6e" status: 202 len: 0 microversion: 2.1 time: 4.873359 Oct 29 03:07:42.026953 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2208/4224] 10.222.0.46 () {58 vars in 1263 bytes} [Sat Oct 29 03:07:37 2022] DELETE /compute/v2.1/os-floating-ips/74dbc01b-f7ac-4138-942f-0ffaca0cfe6e => generated 0 bytes in 4875 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:07:42.039936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-39970cc2-e74a-45b5-bd1c-a2a8c6faf6dd tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '.version_select at 0x7ff05c042310>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:42.105934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-924cc947-f622-49aa-b961-bb922dd258d0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5feeb5524b34e7f91decfd441023a61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5398fd3ca249b098fbaf6c2cb3b1ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:42.139247 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-924cc947-f622-49aa-b961-bb922dd258d0 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] 10.222.0.46 "GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae" status: 200 len: 1307 microversion: 2.1 time: 0.802670 Oct 29 03:07:42.153583 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2017/4225] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:41 2022] GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae => generated 1307 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:42.162868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-501c2501-9afa-4163-b21f-32579ecc3b3d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:42.165293 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-501c2501-9afa-4163-b21f-32579ecc3b3d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:42.171786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-501c2501-9afa-4163-b21f-32579ecc3b3d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:42.172643 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-501c2501-9afa-4163-b21f-32579ecc3b3d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:42.173292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-501c2501-9afa-4163-b21f-32579ecc3b3d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:42.175438 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-501c2501-9afa-4163-b21f-32579ecc3b3d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:42.176120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-501c2501-9afa-4163-b21f-32579ecc3b3d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:42.176809 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-501c2501-9afa-4163-b21f-32579ecc3b3d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:42.735644 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-501c2501-9afa-4163-b21f-32579ecc3b3d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:42.749833 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-501c2501-9afa-4163-b21f-32579ecc3b3d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1311 microversion: 2.1 time: 0.594702 Oct 29 03:07:42.765070 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2018/4226] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:42 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1311 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:42.774145 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-39970cc2-e74a-45b5-bd1c-a2a8c6faf6dd tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "DELETE /compute/v2.1/os-security-groups/b2b2db34-041a-492d-98cf-0a64e702bb48" status: 202 len: 0 microversion: 2.1 time: 0.739631 Oct 29 03:07:42.774846 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2209/4227] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 03:07:42 2022] DELETE /compute/v2.1/os-security-groups/b2b2db34-041a-492d-98cf-0a64e702bb48 => generated 0 bytes in 741 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:07:42.784000 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0f1b6a2a-e405-4db4-96e2-4ad05c2100c7 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:42.790302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0f1b6a2a-e405-4db4-96e2-4ad05c2100c7 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:42.798921 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f1b6a2a-e405-4db4-96e2-4ad05c2100c7 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:42.799424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f1b6a2a-e405-4db4-96e2-4ad05c2100c7 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:42.799865 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f1b6a2a-e405-4db4-96e2-4ad05c2100c7 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:42.800607 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f1b6a2a-e405-4db4-96e2-4ad05c2100c7 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:42.801072 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f1b6a2a-e405-4db4-96e2-4ad05c2100c7 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:42.801493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f1b6a2a-e405-4db4-96e2-4ad05c2100c7 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:42.850729 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0f1b6a2a-e405-4db4-96e2-4ad05c2100c7 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:07:43.034696 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0f1b6a2a-e405-4db4-96e2-4ad05c2100c7 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "DELETE /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 204 len: 0 microversion: 2.1 time: 0.252382 Oct 29 03:07:43.035917 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2019/4228] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:07:42 2022] DELETE /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:07:43.048632 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d011b5a1-b884-4311-99f0-ea960b70d239 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:43.050411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d011b5a1-b884-4311-99f0-ea960b70d239 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:43.069814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d011b5a1-b884-4311-99f0-ea960b70d239 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:43.079733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d011b5a1-b884-4311-99f0-ea960b70d239 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:43.080491 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d011b5a1-b884-4311-99f0-ea960b70d239 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:43.081531 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d011b5a1-b884-4311-99f0-ea960b70d239 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:43.082784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d011b5a1-b884-4311-99f0-ea960b70d239 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:43.083438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d011b5a1-b884-4311-99f0-ea960b70d239 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:43.168327 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6a21ff6b-6c95-47f5-80b2-26eef3659293 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:43.169187 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6a21ff6b-6c95-47f5-80b2-26eef3659293 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] [instance: d9632deb-2bc8-41bc-a569-7adc8ee7aeae] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:43.183850 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a21ff6b-6c95-47f5-80b2-26eef3659293 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:43.184354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a21ff6b-6c95-47f5-80b2-26eef3659293 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:43.185189 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a21ff6b-6c95-47f5-80b2-26eef3659293 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:43.185548 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a21ff6b-6c95-47f5-80b2-26eef3659293 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:43.193414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a21ff6b-6c95-47f5-80b2-26eef3659293 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:43.194077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a21ff6b-6c95-47f5-80b2-26eef3659293 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:43.219947 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-6a21ff6b-6c95-47f5-80b2-26eef3659293 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] HTTP exception thrown: Instance d9632deb-2bc8-41bc-a569-7adc8ee7aeae could not be found. Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6a21ff6b-6c95-47f5-80b2-26eef3659293 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Request method failure captured: Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae HTTP/1.1 Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJjU8JQM2KEuKdSCD87prJp3sCR_dJS6_rcRseODkz3EaQNmkqgmFrwYtL0mjzZ8AVQhN7rPzGb-fV8Humz4s97j2gfUTg6O7bH8izcjPML-tXGfz64gmJ3urPRt3rnviY67dUKHIt51TlUsvJnA63wV9Ty0si4-afcxpqLCZQXZTNo Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: ba5398fd3ca249b098fbaf6c2cb3b1ba Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerAddressesTestJSON-313286636 Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ba5398fd3ca249b098fbaf6c2cb3b1ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ba5398fd3ca249b098fbaf6c2cb3b1ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ba5398fd3ca249b098fbaf6c2cb3b1ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ba5398fd3ca249b098fbaf6c2cb3b1ba"}]}] Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerAddressesTestJSON-313286636 Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: ba5398fd3ca249b098fbaf6c2cb3b1ba Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerAddressesTestJSON-313286636 Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerAddressesTestJSON-313286636-project Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: d5feeb5524b34e7f91decfd441023a61 Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerAddressesTestJSON-313286636-project Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance d9632deb-2bc8-41bc-a569-7adc8ee7aeae could not be found. Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'd9632deb-2bc8-41bc-a569-7adc8ee7aeae'} Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9632deb-2bc8-41bc-a569-7adc8ee7aeae could not be found. Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9632deb-2bc8-41bc-a569-7adc8ee7aeae could not be found. Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:43.223201 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:07:43.227161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:43.227161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:43.227161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:43.227161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:07:43.227161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:07:43.227161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9632deb-2bc8-41bc-a569-7adc8ee7aeae could not be found. Oct 29 03:07:43.227161 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:07:43.227161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6a21ff6b-6c95-47f5-80b2-26eef3659293 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] Returning 404 to user: Instance d9632deb-2bc8-41bc-a569-7adc8ee7aeae could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:07:43.227161 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6a21ff6b-6c95-47f5-80b2-26eef3659293 tempest-ServerAddressesTestJSON-313286636 tempest-ServerAddressesTestJSON-313286636-project] 10.222.0.46 "GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae" status: 404 len: 111 microversion: 2.1 time: 0.061486 Oct 29 03:07:43.227161 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2020/4229] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:43 2022] GET /compute/v2.1/servers/d9632deb-2bc8-41bc-a569-7adc8ee7aeae => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:07:43.461053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d011b5a1-b884-4311-99f0-ea960b70d239 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f563b6bf99e7480aacedc2a28dbfee01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee274ac8b7204c6a92db7d65a8f4ea62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:43.479671 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d011b5a1-b884-4311-99f0-ea960b70d239 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 200 len: 1509 microversion: 2.1 time: 0.436971 Oct 29 03:07:43.481020 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2210/4230] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:43 2022] GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 1509 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:43.780770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6cb2becf-45b3-431e-86eb-9782db96eb3b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:43.782885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6cb2becf-45b3-431e-86eb-9782db96eb3b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:43.790855 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6cb2becf-45b3-431e-86eb-9782db96eb3b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:43.792852 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6cb2becf-45b3-431e-86eb-9782db96eb3b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:43.793541 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6cb2becf-45b3-431e-86eb-9782db96eb3b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:43.794503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6cb2becf-45b3-431e-86eb-9782db96eb3b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:43.795183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6cb2becf-45b3-431e-86eb-9782db96eb3b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:43.795929 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6cb2becf-45b3-431e-86eb-9782db96eb3b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:44.505615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-354ee1a8-5b93-45a5-9734-f89c24dd00c5 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:44.506240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-354ee1a8-5b93-45a5-9734-f89c24dd00c5 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:44.519059 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-354ee1a8-5b93-45a5-9734-f89c24dd00c5 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:44.519587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-354ee1a8-5b93-45a5-9734-f89c24dd00c5 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:44.523641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-354ee1a8-5b93-45a5-9734-f89c24dd00c5 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:44.525297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-354ee1a8-5b93-45a5-9734-f89c24dd00c5 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:44.526280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-354ee1a8-5b93-45a5-9734-f89c24dd00c5 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:44.530458 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-354ee1a8-5b93-45a5-9734-f89c24dd00c5 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:44.819206 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6cb2becf-45b3-431e-86eb-9782db96eb3b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:44.849923 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6cb2becf-45b3-431e-86eb-9782db96eb3b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1311 microversion: 2.1 time: 1.073395 Oct 29 03:07:44.852992 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2021/4231] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:43 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1311 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:45.049723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-354ee1a8-5b93-45a5-9734-f89c24dd00c5 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f563b6bf99e7480aacedc2a28dbfee01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee274ac8b7204c6a92db7d65a8f4ea62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:45.082892 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-354ee1a8-5b93-45a5-9734-f89c24dd00c5 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 200 len: 1509 microversion: 2.1 time: 0.578918 Oct 29 03:07:45.084199 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2211/4232] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:44 2022] GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 1509 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:07:45.875129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7aca834b-914b-44ff-a09c-f03ad13a271c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:45.876616 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7aca834b-914b-44ff-a09c-f03ad13a271c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:45.892156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7aca834b-914b-44ff-a09c-f03ad13a271c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:45.897420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7aca834b-914b-44ff-a09c-f03ad13a271c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:45.899754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7aca834b-914b-44ff-a09c-f03ad13a271c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:45.900789 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7aca834b-914b-44ff-a09c-f03ad13a271c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:45.904720 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7aca834b-914b-44ff-a09c-f03ad13a271c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:45.906301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7aca834b-914b-44ff-a09c-f03ad13a271c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:46.111406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d4aee891-9577-4fb0-b8ea-63e5e6d2fc0e tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:46.112184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d4aee891-9577-4fb0-b8ea-63e5e6d2fc0e tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:46.123280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4aee891-9577-4fb0-b8ea-63e5e6d2fc0e tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:46.123917 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4aee891-9577-4fb0-b8ea-63e5e6d2fc0e tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:46.124572 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4aee891-9577-4fb0-b8ea-63e5e6d2fc0e tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:46.125464 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4aee891-9577-4fb0-b8ea-63e5e6d2fc0e tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:46.126279 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4aee891-9577-4fb0-b8ea-63e5e6d2fc0e tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:46.127033 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4aee891-9577-4fb0-b8ea-63e5e6d2fc0e tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:46.612928 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7aca834b-914b-44ff-a09c-f03ad13a271c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:46.617048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:46.627203 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7aca834b-914b-44ff-a09c-f03ad13a271c tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1311 microversion: 2.1 time: 0.756426 Oct 29 03:07:46.629203 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2022/4233] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:45 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1311 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:46.640973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d4aee891-9577-4fb0-b8ea-63e5e6d2fc0e tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f563b6bf99e7480aacedc2a28dbfee01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee274ac8b7204c6a92db7d65a8f4ea62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:46.650335 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d4aee891-9577-4fb0-b8ea-63e5e6d2fc0e tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 200 len: 1509 microversion: 2.1 time: 0.547450 Oct 29 03:07:46.650930 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2212/4234] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:46 2022] GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 1509 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:46.968795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-2d361304-24b4-41f7-a35c-ddfd252e8511 req-36b56273-08c5-4d55-8854-597816d2645b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23eb1465-3e98-4ff0-acd6-15c3d092953e", "name": "network-vif-deleted", "tag": "00a83dbb-19d1-425c-aada-3a0206b02101"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:46.983599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2d361304-24b4-41f7-a35c-ddfd252e8511 req-36b56273-08c5-4d55-8854-597816d2645b service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:46.987765 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2d361304-24b4-41f7-a35c-ddfd252e8511 req-36b56273-08c5-4d55-8854-597816d2645b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:46.990513 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2d361304-24b4-41f7-a35c-ddfd252e8511 req-36b56273-08c5-4d55-8854-597816d2645b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:47.011346 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-2d361304-24b4-41f7-a35c-ddfd252e8511 req-36b56273-08c5-4d55-8854-597816d2645b service nova] Creating event network-vif-deleted:00a83dbb-19d1-425c-aada-3a0206b02101 for instance 23eb1465-3e98-4ff0-acd6-15c3d092953e on n-h1-862967-2 Oct 29 03:07:47.016874 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-2d361304-24b4-41f7-a35c-ddfd252e8511 req-36b56273-08c5-4d55-8854-597816d2645b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051862 Oct 29 03:07:47.018699 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2023/4235] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:47.655394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3ae49982-7bbc-47db-b698-e9c92499802d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:47.656010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3ae49982-7bbc-47db-b698-e9c92499802d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:47.679398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a2385954-e377-4d3a-973c-cb946963cde5 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:47.680114 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a2385954-e377-4d3a-973c-cb946963cde5 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:47.699045 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ae49982-7bbc-47db-b698-e9c92499802d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:47.700041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ae49982-7bbc-47db-b698-e9c92499802d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:47.702591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2385954-e377-4d3a-973c-cb946963cde5 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:47.703792 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ae49982-7bbc-47db-b698-e9c92499802d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:47.719590 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2385954-e377-4d3a-973c-cb946963cde5 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:47.725630 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ae49982-7bbc-47db-b698-e9c92499802d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:47.726873 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2385954-e377-4d3a-973c-cb946963cde5 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:47.728982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ae49982-7bbc-47db-b698-e9c92499802d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:47.731105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2385954-e377-4d3a-973c-cb946963cde5 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:47.731656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ae49982-7bbc-47db-b698-e9c92499802d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:47.735299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2385954-e377-4d3a-973c-cb946963cde5 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:47.738208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2385954-e377-4d3a-973c-cb946963cde5 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:47.889552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2385954-e377-4d3a-973c-cb946963cde5 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:47.890414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2385954-e377-4d3a-973c-cb946963cde5 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:47.891110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2385954-e377-4d3a-973c-cb946963cde5 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:47.891783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-a2385954-e377-4d3a-973c-cb946963cde5 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lazy-loading 'fault' on Instance uuid 23eb1465-3e98-4ff0-acd6-15c3d092953e {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:07:48.094873 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a2385954-e377-4d3a-973c-cb946963cde5 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f563b6bf99e7480aacedc2a28dbfee01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee274ac8b7204c6a92db7d65a8f4ea62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:48.127448 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a2385954-e377-4d3a-973c-cb946963cde5 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 200 len: 1313 microversion: 2.1 time: 0.451377 Oct 29 03:07:48.143978 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2024/4236] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:47 2022] GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 1313 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:07:48.176844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3ae49982-7bbc-47db-b698-e9c92499802d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:48.201310 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3ae49982-7bbc-47db-b698-e9c92499802d tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1311 microversion: 2.1 time: 0.546811 Oct 29 03:07:48.201971 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2213/4237] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:47 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1311 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:48.819820 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-9cf198b1-23a3-4268-8cd5-98c0756fe192 req-5dfbbb16-ce13-4c84-8d06-7b6d00cd986e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c25c557-35b6-4dce-99f0-4e2b1c43cf40", "name": "network-vif-plugged", "status": "completed", "tag": "544bbd3a-133a-48fc-85fa-eb236d549271"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:48.836514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9cf198b1-23a3-4268-8cd5-98c0756fe192 req-5dfbbb16-ce13-4c84-8d06-7b6d00cd986e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:48.837286 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9cf198b1-23a3-4268-8cd5-98c0756fe192 req-5dfbbb16-ce13-4c84-8d06-7b6d00cd986e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:48.842741 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9cf198b1-23a3-4268-8cd5-98c0756fe192 req-5dfbbb16-ce13-4c84-8d06-7b6d00cd986e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:48.867608 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-9cf198b1-23a3-4268-8cd5-98c0756fe192 req-5dfbbb16-ce13-4c84-8d06-7b6d00cd986e service nova] Creating event network-vif-plugged:544bbd3a-133a-48fc-85fa-eb236d549271 for instance 3c25c557-35b6-4dce-99f0-4e2b1c43cf40 on n-h1-862967-2 Oct 29 03:07:48.879972 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-9cf198b1-23a3-4268-8cd5-98c0756fe192 req-5dfbbb16-ce13-4c84-8d06-7b6d00cd986e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062402 Oct 29 03:07:48.881506 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2025/4238] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:07:49.163996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6105d1fd-48ba-45e1-a1b1-c6b6014b1cc2 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:49.164703 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6105d1fd-48ba-45e1-a1b1-c6b6014b1cc2 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] [instance: 23eb1465-3e98-4ff0-acd6-15c3d092953e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:49.171734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6105d1fd-48ba-45e1-a1b1-c6b6014b1cc2 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:49.172790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6105d1fd-48ba-45e1-a1b1-c6b6014b1cc2 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:49.173559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6105d1fd-48ba-45e1-a1b1-c6b6014b1cc2 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:49.174496 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6105d1fd-48ba-45e1-a1b1-c6b6014b1cc2 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:49.175156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6105d1fd-48ba-45e1-a1b1-c6b6014b1cc2 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:49.175788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6105d1fd-48ba-45e1-a1b1-c6b6014b1cc2 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:49.192902 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-6105d1fd-48ba-45e1-a1b1-c6b6014b1cc2 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] HTTP exception thrown: Instance 23eb1465-3e98-4ff0-acd6-15c3d092953e could not be found. Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6105d1fd-48ba-45e1-a1b1-c6b6014b1cc2 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Request method failure captured: Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e HTTP/1.1 Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJirY1VoOXydTDozg8aN5cnoEPw5s0ptJqul5kf4SLCgYscn2SXOYOBE8NTS7ge7tNMhCZrkmIaSDJ3vXACyfcnOeJQPI2-A3d8HjKpoORq1256GBRTVOCApZpNBXkH5FCKGOtEd-nsBdKcSskUUSLCgLSuUgW3qZETM8NJ6i1dvUtQ Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: ee274ac8b7204c6a92db7d65a8f4ea62 Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-677646516 Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ee274ac8b7204c6a92db7d65a8f4ea62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ee274ac8b7204c6a92db7d65a8f4ea62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ee274ac8b7204c6a92db7d65a8f4ea62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ee274ac8b7204c6a92db7d65a8f4ea62"}]}] Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-677646516 Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: ee274ac8b7204c6a92db7d65a8f4ea62 Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-677646516 Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServerRescueTestJSONUnderV235-677646516-project Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: f563b6bf99e7480aacedc2a28dbfee01 Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-677646516-project Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 23eb1465-3e98-4ff0-acd6-15c3d092953e could not be found. Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '23eb1465-3e98-4ff0-acd6-15c3d092953e'} Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23eb1465-3e98-4ff0-acd6-15c3d092953e could not be found. Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23eb1465-3e98-4ff0-acd6-15c3d092953e could not be found. Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:07:49.194847 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:07:49.198626 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:07:49.198626 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:07:49.198626 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:07:49.198626 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:07:49.198626 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:07:49.198626 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:07:49.198626 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23eb1465-3e98-4ff0-acd6-15c3d092953e could not be found. Oct 29 03:07:49.198626 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:07:49.200759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6105d1fd-48ba-45e1-a1b1-c6b6014b1cc2 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] Returning 404 to user: Instance 23eb1465-3e98-4ff0-acd6-15c3d092953e could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:07:49.201852 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6105d1fd-48ba-45e1-a1b1-c6b6014b1cc2 tempest-ServerRescueTestJSONUnderV235-677646516 tempest-ServerRescueTestJSONUnderV235-677646516-project] 10.222.0.46 "GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e" status: 404 len: 111 microversion: 2.1 time: 0.041757 Oct 29 03:07:49.207090 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2214/4239] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:49 2022] GET /compute/v2.1/servers/23eb1465-3e98-4ff0-acd6-15c3d092953e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:07:49.228695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b06e97cb-d177-4c15-b9eb-3b26bde03695 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:49.230233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b06e97cb-d177-4c15-b9eb-3b26bde03695 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:49.239957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b06e97cb-d177-4c15-b9eb-3b26bde03695 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:49.243715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b06e97cb-d177-4c15-b9eb-3b26bde03695 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:49.246306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b06e97cb-d177-4c15-b9eb-3b26bde03695 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:49.248053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b06e97cb-d177-4c15-b9eb-3b26bde03695 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:49.249085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b06e97cb-d177-4c15-b9eb-3b26bde03695 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:49.250740 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b06e97cb-d177-4c15-b9eb-3b26bde03695 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:49.842257 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b06e97cb-d177-4c15-b9eb-3b26bde03695 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:49.853342 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b06e97cb-d177-4c15-b9eb-3b26bde03695 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1311 microversion: 2.1 time: 0.627384 Oct 29 03:07:49.854081 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2026/4240] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:49 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1311 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:50.888644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c9f7a6db-9931-4fa5-888b-12cbcb6218f9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:50.889907 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c9f7a6db-9931-4fa5-888b-12cbcb6218f9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:50.925348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9f7a6db-9931-4fa5-888b-12cbcb6218f9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:50.926110 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9f7a6db-9931-4fa5-888b-12cbcb6218f9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:50.928755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9f7a6db-9931-4fa5-888b-12cbcb6218f9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:50.934543 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9f7a6db-9931-4fa5-888b-12cbcb6218f9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:50.935852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9f7a6db-9931-4fa5-888b-12cbcb6218f9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:50.936955 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9f7a6db-9931-4fa5-888b-12cbcb6218f9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:52.448035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c9f7a6db-9931-4fa5-888b-12cbcb6218f9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:52.460015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:52.465805 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c9f7a6db-9931-4fa5-888b-12cbcb6218f9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1311 microversion: 2.1 time: 1.583540 Oct 29 03:07:52.472602 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2215/4241] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:50 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1311 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:53.511728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4a02e8a1-6bfc-401c-bf8c-c9094b640ce9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:53.513942 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4a02e8a1-6bfc-401c-bf8c-c9094b640ce9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:53.555409 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a02e8a1-6bfc-401c-bf8c-c9094b640ce9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:53.571224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a02e8a1-6bfc-401c-bf8c-c9094b640ce9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:53.573194 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a02e8a1-6bfc-401c-bf8c-c9094b640ce9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:53.578467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a02e8a1-6bfc-401c-bf8c-c9094b640ce9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:53.580191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a02e8a1-6bfc-401c-bf8c-c9094b640ce9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:53.600976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a02e8a1-6bfc-401c-bf8c-c9094b640ce9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:54.609959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4a02e8a1-6bfc-401c-bf8c-c9094b640ce9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:54.632012 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4a02e8a1-6bfc-401c-bf8c-c9094b640ce9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1460 microversion: 2.1 time: 1.130705 Oct 29 03:07:54.635565 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2027/4242] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:53 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1460 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:54.659773 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c2653653-2bf5-40e3-ba43-917bc8852543 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:54.660489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c2653653-2bf5-40e3-ba43-917bc8852543 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:54.673296 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c2653653-2bf5-40e3-ba43-917bc8852543 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:54.673674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c2653653-2bf5-40e3-ba43-917bc8852543 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:54.674119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c2653653-2bf5-40e3-ba43-917bc8852543 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:54.675001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c2653653-2bf5-40e3-ba43-917bc8852543 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:54.675451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c2653653-2bf5-40e3-ba43-917bc8852543 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:54.675869 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c2653653-2bf5-40e3-ba43-917bc8852543 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:54.974779 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c2653653-2bf5-40e3-ba43-917bc8852543 tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1611 microversion: 2.1 time: 0.319862 Oct 29 03:07:54.981052 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2216/4243] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:54 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1611 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:07:55.004334 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3f427b16-8927-4c4b-b670-e201401e8bcf tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:07:55.005718 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3f427b16-8927-4c4b-b670-e201401e8bcf tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:55.019600 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3f427b16-8927-4c4b-b670-e201401e8bcf tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:55.029280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3f427b16-8927-4c4b-b670-e201401e8bcf tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:55.030176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3f427b16-8927-4c4b-b670-e201401e8bcf tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:55.036945 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3f427b16-8927-4c4b-b670-e201401e8bcf tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:55.043011 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3f427b16-8927-4c4b-b670-e201401e8bcf tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:55.043603 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3f427b16-8927-4c4b-b670-e201401e8bcf tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:55.124752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3f427b16-8927-4c4b-b670-e201401e8bcf tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4a84597a69a04a1d980b82b35c2e0d38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1012bab651274e7ab9a5a713f6e0a0d7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:55.125248 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3f427b16-8927-4c4b-b670-e201401e8bcf tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] flavor_id is None. Assuming migration. {{(pid=127125) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 29 03:07:55.125680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3f427b16-8927-4c4b-b670-e201401e8bcf tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127125) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 03:07:55.964370 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3f427b16-8927-4c4b-b670-e201401e8bcf tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40/action" status: 202 len: 0 microversion: 2.1 time: 0.967538 Oct 29 03:07:55.969939 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2028/4244] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:07:54 2022] POST /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40/action => generated 0 bytes in 974 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:07:55.982127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-968eb73a-fa6c-4918-9e09-0dbadb0b94da tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:55.982770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-968eb73a-fa6c-4918-9e09-0dbadb0b94da tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:55.993150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-968eb73a-fa6c-4918-9e09-0dbadb0b94da tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:55.993650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-968eb73a-fa6c-4918-9e09-0dbadb0b94da tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:55.994093 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-968eb73a-fa6c-4918-9e09-0dbadb0b94da tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:55.994830 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-968eb73a-fa6c-4918-9e09-0dbadb0b94da tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:56.001077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-968eb73a-fa6c-4918-9e09-0dbadb0b94da tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:56.001791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-968eb73a-fa6c-4918-9e09-0dbadb0b94da tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:57.879550 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-968eb73a-fa6c-4918-9e09-0dbadb0b94da tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:57.895572 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-968eb73a-fa6c-4918-9e09-0dbadb0b94da tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1469 microversion: 2.1 time: 1.920995 Oct 29 03:07:57.913379 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2217/4245] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:55 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1469 bytes in 1940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:07:58.939711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-da51d3c6-70b9-4526-b281-22d4a7137ed9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:07:58.940954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-da51d3c6-70b9-4526-b281-22d4a7137ed9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:07:58.948131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:58.950230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da51d3c6-70b9-4526-b281-22d4a7137ed9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:58.950889 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da51d3c6-70b9-4526-b281-22d4a7137ed9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:58.951466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da51d3c6-70b9-4526-b281-22d4a7137ed9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:58.952616 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da51d3c6-70b9-4526-b281-22d4a7137ed9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:07:58.953219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da51d3c6-70b9-4526-b281-22d4a7137ed9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:07:58.953795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da51d3c6-70b9-4526-b281-22d4a7137ed9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:07:59.467468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-da51d3c6-70b9-4526-b281-22d4a7137ed9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:07:59.482190 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-da51d3c6-70b9-4526-b281-22d4a7137ed9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1469 microversion: 2.1 time: 0.547287 Oct 29 03:07:59.483549 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2029/4246] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:07:58 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1469 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:00.506389 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2c641350-fcb4-4932-a4b2-5346c1c914a9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:00.507110 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2c641350-fcb4-4932-a4b2-5346c1c914a9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:00.522396 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c641350-fcb4-4932-a4b2-5346c1c914a9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:00.529395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c641350-fcb4-4932-a4b2-5346c1c914a9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:00.529395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c641350-fcb4-4932-a4b2-5346c1c914a9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:00.531755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c641350-fcb4-4932-a4b2-5346c1c914a9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:00.532303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c641350-fcb4-4932-a4b2-5346c1c914a9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:00.532965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c641350-fcb4-4932-a4b2-5346c1c914a9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:00.799614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2c641350-fcb4-4932-a4b2-5346c1c914a9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:00.810211 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2c641350-fcb4-4932-a4b2-5346c1c914a9 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1469 microversion: 2.1 time: 0.307596 Oct 29 03:08:00.813490 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2218/4247] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:00 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1469 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:01.841303 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1f25f927-c33a-4ab2-b440-8ab2a41e2735 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:01.846274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1f25f927-c33a-4ab2-b440-8ab2a41e2735 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:01.875122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f25f927-c33a-4ab2-b440-8ab2a41e2735 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:01.877220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f25f927-c33a-4ab2-b440-8ab2a41e2735 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:01.879097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f25f927-c33a-4ab2-b440-8ab2a41e2735 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:01.882039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f25f927-c33a-4ab2-b440-8ab2a41e2735 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:01.882800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f25f927-c33a-4ab2-b440-8ab2a41e2735 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:01.884552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f25f927-c33a-4ab2-b440-8ab2a41e2735 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:02.497183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3ecfc69f-042e-40d5-9c69-173210706c54 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:02.498639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3ecfc69f-042e-40d5-9c69-173210706c54 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:02.502025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=59,nova_api:UPDATE=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:02.510156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ecfc69f-042e-40d5-9c69-173210706c54 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:02.511202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ecfc69f-042e-40d5-9c69-173210706c54 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:02.511858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ecfc69f-042e-40d5-9c69-173210706c54 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:02.513417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ecfc69f-042e-40d5-9c69-173210706c54 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:02.514276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ecfc69f-042e-40d5-9c69-173210706c54 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:02.515037 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ecfc69f-042e-40d5-9c69-173210706c54 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:02.589713 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3ecfc69f-042e-40d5-9c69-173210706c54 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17/ips" status: 200 len: 146 microversion: 2.1 time: 0.096059 Oct 29 03:08:02.614101 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2219/4248] 10.222.0.46 () {58 vars in 1248 bytes} [Sat Oct 29 03:08:02 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17/ips => generated 146 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:02.702008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1f25f927-c33a-4ab2-b440-8ab2a41e2735 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:02.724886 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1f25f927-c33a-4ab2-b440-8ab2a41e2735 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1469 microversion: 2.1 time: 0.888920 Oct 29 03:08:02.727412 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2030/4249] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:01 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1469 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:03.735560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-92ac3c24-2381-4e51-a6d6-3fcf8a8633a4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1799768734", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": "none"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:03.761744 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-df2d6177-59b6-471c-a04f-678f9bb1f109 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:03.764771 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-df2d6177-59b6-471c-a04f-678f9bb1f109 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:03.799499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df2d6177-59b6-471c-a04f-678f9bb1f109 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:03.803822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df2d6177-59b6-471c-a04f-678f9bb1f109 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:03.805698 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df2d6177-59b6-471c-a04f-678f9bb1f109 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:03.806964 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df2d6177-59b6-471c-a04f-678f9bb1f109 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:03.832301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df2d6177-59b6-471c-a04f-678f9bb1f109 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:03.844981 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df2d6177-59b6-471c-a04f-678f9bb1f109 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:03.912775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-92ac3c24-2381-4e51-a6d6-3fcf8a8633a4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:08:03.913208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-92ac3c24-2381-4e51-a6d6-3fcf8a8633a4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:08:03.913678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-92ac3c24-2381-4e51-a6d6-3fcf8a8633a4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:08:03.914085 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-92ac3c24-2381-4e51-a6d6-3fcf8a8633a4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:08:03.914494 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-92ac3c24-2381-4e51-a6d6-3fcf8a8633a4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:08:03.942059 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92ac3c24-2381-4e51-a6d6-3fcf8a8633a4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:03.943023 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92ac3c24-2381-4e51-a6d6-3fcf8a8633a4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:03.943615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92ac3c24-2381-4e51-a6d6-3fcf8a8633a4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:03.944669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92ac3c24-2381-4e51-a6d6-3fcf8a8633a4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:03.945286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92ac3c24-2381-4e51-a6d6-3fcf8a8633a4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:03.945895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92ac3c24-2381-4e51-a6d6-3fcf8a8633a4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:03.980089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-92ac3c24-2381-4e51-a6d6-3fcf8a8633a4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Getting quotas for project d63f1533a3fd4dc18b6169f3270922b7. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:08:03.993764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-92ac3c24-2381-4e51-a6d6-3fcf8a8633a4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Getting quotas for user 9e0e028c4fec4c38be22f1f74b2d79f1 and project d63f1533a3fd4dc18b6169f3270922b7. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:08:04.055610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-92ac3c24-2381-4e51-a6d6-3fcf8a8633a4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:08:04.066722 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-92ac3c24-2381-4e51-a6d6-3fcf8a8633a4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: 924784e9-e94f-44d8-88e3-adfca6a35372] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:08:04.215323 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-92ac3c24-2381-4e51-a6d6-3fcf8a8633a4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.909148 Oct 29 03:08:04.216633 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2220/4250] 10.222.0.46 () {62 vars in 1188 bytes} [Sat Oct 29 03:08:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 03:08:04.227699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8be12a02-c67f-4315-a8cb-f510dc515a02 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:04.228640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8be12a02-c67f-4315-a8cb-f510dc515a02 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: 924784e9-e94f-44d8-88e3-adfca6a35372] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:04.414677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8be12a02-c67f-4315-a8cb-f510dc515a02 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:04.420926 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-df2d6177-59b6-471c-a04f-678f9bb1f109 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:04.430914 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-df2d6177-59b6-471c-a04f-678f9bb1f109 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1474 microversion: 2.1 time: 0.679023 Oct 29 03:08:04.432984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8be12a02-c67f-4315-a8cb-f510dc515a02 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:04.436334 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8be12a02-c67f-4315-a8cb-f510dc515a02 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:04.437265 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2031/4251] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:03 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1474 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:08:04.444028 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8be12a02-c67f-4315-a8cb-f510dc515a02 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/924784e9-e94f-44d8-88e3-adfca6a35372" status: 200 len: 1278 microversion: 2.47 time: 0.216311 Oct 29 03:08:04.447392 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2221/4252] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:04 2022] GET /compute/v2.1/servers/924784e9-e94f-44d8-88e3-adfca6a35372 => generated 1278 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:08:04.712788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f85508ac-25ae-405a-86af-8e03b90a67bb tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-672029916", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": "none"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:04.852161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-f85508ac-25ae-405a-86af-8e03b90a67bb tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:08:04.852908 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-f85508ac-25ae-405a-86af-8e03b90a67bb tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:08:04.853085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-f85508ac-25ae-405a-86af-8e03b90a67bb tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:08:04.853495 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-f85508ac-25ae-405a-86af-8e03b90a67bb tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:08:04.854182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-f85508ac-25ae-405a-86af-8e03b90a67bb tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:08:04.879584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f85508ac-25ae-405a-86af-8e03b90a67bb tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:04.880096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f85508ac-25ae-405a-86af-8e03b90a67bb tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:04.880516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f85508ac-25ae-405a-86af-8e03b90a67bb tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:04.882370 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f85508ac-25ae-405a-86af-8e03b90a67bb tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:04.882834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f85508ac-25ae-405a-86af-8e03b90a67bb tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:04.888314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f85508ac-25ae-405a-86af-8e03b90a67bb tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:04.935183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-f85508ac-25ae-405a-86af-8e03b90a67bb tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Getting quotas for project d63f1533a3fd4dc18b6169f3270922b7. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:08:04.948503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-f85508ac-25ae-405a-86af-8e03b90a67bb tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Getting quotas for user 9e0e028c4fec4c38be22f1f74b2d79f1 and project d63f1533a3fd4dc18b6169f3270922b7. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:08:04.994412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f85508ac-25ae-405a-86af-8e03b90a67bb tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:08:04.996875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f85508ac-25ae-405a-86af-8e03b90a67bb tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:08:05.169709 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f85508ac-25ae-405a-86af-8e03b90a67bb tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.460821 Oct 29 03:08:05.170396 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2032/4253] 10.222.0.46 () {62 vars in 1188 bytes} [Sat Oct 29 03:08:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 462 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 29 03:08:05.182879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9034d8ec-c60c-4daf-b54a-6bba54f1d84e tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:05.185673 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9034d8ec-c60c-4daf-b54a-6bba54f1d84e tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:05.295209 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9034d8ec-c60c-4daf-b54a-6bba54f1d84e tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "PUT /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 991 microversion: 2.47 time: 0.116606 Oct 29 03:08:05.314189 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2222/4254] 10.222.0.46 () {62 vars in 1297 bytes} [Sat Oct 29 03:08:05 2022] PUT /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 991 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:08:05.322001 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bcacf4ac-2ef6-4342-8ae6-488384cec62f tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:05.322919 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bcacf4ac-2ef6-4342-8ae6-488384cec62f tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:05.460186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-41f101f9-fad0-429e-85d4-f2044cc4dda7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:05.461121 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-41f101f9-fad0-429e-85d4-f2044cc4dda7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:05.470355 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41f101f9-fad0-429e-85d4-f2044cc4dda7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:05.473230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41f101f9-fad0-429e-85d4-f2044cc4dda7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:05.473864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41f101f9-fad0-429e-85d4-f2044cc4dda7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:05.477262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41f101f9-fad0-429e-85d4-f2044cc4dda7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:05.477949 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41f101f9-fad0-429e-85d4-f2044cc4dda7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:05.478565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41f101f9-fad0-429e-85d4-f2044cc4dda7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:05.482557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bcacf4ac-2ef6-4342-8ae6-488384cec62f tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:05.495678 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bcacf4ac-2ef6-4342-8ae6-488384cec62f tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:05.497170 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bcacf4ac-2ef6-4342-8ae6-488384cec62f tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:05.498368 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bcacf4ac-2ef6-4342-8ae6-488384cec62f tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1277 microversion: 2.47 time: 0.180560 Oct 29 03:08:05.509176 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2033/4255] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:05 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1277 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:08:06.349358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-41f101f9-fad0-429e-85d4-f2044cc4dda7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:06.365307 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-41f101f9-fad0-429e-85d4-f2044cc4dda7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1474 microversion: 2.1 time: 0.909286 Oct 29 03:08:06.367560 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2223/4256] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:05 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1474 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:08:06.529711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-57b6f651-64bf-40c0-987d-7c4ea223f968 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:06.531238 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-57b6f651-64bf-40c0-987d-7c4ea223f968 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:06.553885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57b6f651-64bf-40c0-987d-7c4ea223f968 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:06.554382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57b6f651-64bf-40c0-987d-7c4ea223f968 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:06.554822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57b6f651-64bf-40c0-987d-7c4ea223f968 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:06.571294 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57b6f651-64bf-40c0-987d-7c4ea223f968 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:06.571803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57b6f651-64bf-40c0-987d-7c4ea223f968 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:06.572260 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57b6f651-64bf-40c0-987d-7c4ea223f968 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:07.169469 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ffaf62fa-86c4-42c1-a2df-4856dcb649f7 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f6a9ea7-7869-4e93-92b3-db94e1f8fa7d"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:07.183059 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ffaf62fa-86c4-42c1-a2df-4856dcb649f7 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:07.222003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffaf62fa-86c4-42c1-a2df-4856dcb649f7 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:07.228471 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffaf62fa-86c4-42c1-a2df-4856dcb649f7 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:07.228976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffaf62fa-86c4-42c1-a2df-4856dcb649f7 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:07.229868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffaf62fa-86c4-42c1-a2df-4856dcb649f7 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:07.230332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffaf62fa-86c4-42c1-a2df-4856dcb649f7 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:07.230754 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffaf62fa-86c4-42c1-a2df-4856dcb649f7 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:07.392449 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-57b6f651-64bf-40c0-987d-7c4ea223f968 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:07.407183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-57b6f651-64bf-40c0-987d-7c4ea223f968 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:07.409185 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-57b6f651-64bf-40c0-987d-7c4ea223f968 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:07.410408 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-57b6f651-64bf-40c0-987d-7c4ea223f968 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1273 microversion: 2.47 time: 0.886499 Oct 29 03:08:07.434058 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2034/4257] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:06 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1273 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:08:07.445464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7a64ed36-f26f-4066-82d2-5ccd3483d5cf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:07.446544 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7a64ed36-f26f-4066-82d2-5ccd3483d5cf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:07.478894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a64ed36-f26f-4066-82d2-5ccd3483d5cf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:07.487424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a64ed36-f26f-4066-82d2-5ccd3483d5cf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:07.487890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a64ed36-f26f-4066-82d2-5ccd3483d5cf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:07.488877 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a64ed36-f26f-4066-82d2-5ccd3483d5cf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:07.489453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a64ed36-f26f-4066-82d2-5ccd3483d5cf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:07.489764 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a64ed36-f26f-4066-82d2-5ccd3483d5cf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:07.907645 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7a64ed36-f26f-4066-82d2-5ccd3483d5cf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:07.925621 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7a64ed36-f26f-4066-82d2-5ccd3483d5cf tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1474 microversion: 2.1 time: 0.487521 Oct 29 03:08:07.926590 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2035/4258] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:07 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1474 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:08.445906 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d91824ac-c6ee-4e2c-b900-e7086fb975e5 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:08.446706 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d91824ac-c6ee-4e2c-b900-e7086fb975e5 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:08.493189 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d91824ac-c6ee-4e2c-b900-e7086fb975e5 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:08.493691 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d91824ac-c6ee-4e2c-b900-e7086fb975e5 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:08.494129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d91824ac-c6ee-4e2c-b900-e7086fb975e5 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:08.499663 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d91824ac-c6ee-4e2c-b900-e7086fb975e5 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:08.500233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d91824ac-c6ee-4e2c-b900-e7086fb975e5 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:08.501697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d91824ac-c6ee-4e2c-b900-e7086fb975e5 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:08.612860 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ffaf62fa-86c4-42c1-a2df-4856dcb649f7 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "POST /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.461882 Oct 29 03:08:08.617491 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2224/4259] 10.222.0.46 () {60 vars in 1323 bytes} [Sat Oct 29 03:08:07 2022] POST /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17/os-volume_attachments => generated 194 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:08.851270 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d91824ac-c6ee-4e2c-b900-e7086fb975e5 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:08.865401 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d91824ac-c6ee-4e2c-b900-e7086fb975e5 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:08.867386 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d91824ac-c6ee-4e2c-b900-e7086fb975e5 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:08.868954 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d91824ac-c6ee-4e2c-b900-e7086fb975e5 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1347 microversion: 2.47 time: 0.429683 Oct 29 03:08:08.869756 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2036/4260] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:08 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1347 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:08:08.956245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c35df43e-3b4d-4537-af0f-284ebc5313ce tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:08.956998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c35df43e-3b4d-4537-af0f-284ebc5313ce tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:08.970856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c35df43e-3b4d-4537-af0f-284ebc5313ce tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:08.977601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c35df43e-3b4d-4537-af0f-284ebc5313ce tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:08.978282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c35df43e-3b4d-4537-af0f-284ebc5313ce tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:08.979058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c35df43e-3b4d-4537-af0f-284ebc5313ce tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:08.979752 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c35df43e-3b4d-4537-af0f-284ebc5313ce tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:08.980186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c35df43e-3b4d-4537-af0f-284ebc5313ce tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:09.405650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c35df43e-3b4d-4537-af0f-284ebc5313ce tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:09.424829 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c35df43e-3b4d-4537-af0f-284ebc5313ce tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1474 microversion: 2.1 time: 0.473973 Oct 29 03:08:09.429435 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2225/4261] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:08 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1474 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:09.897109 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cbbda25c-75d1-45f8-8f64-a0b300ed2683 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:09.897806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cbbda25c-75d1-45f8-8f64-a0b300ed2683 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:09.914078 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbbda25c-75d1-45f8-8f64-a0b300ed2683 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:09.914420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbbda25c-75d1-45f8-8f64-a0b300ed2683 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:09.914853 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbbda25c-75d1-45f8-8f64-a0b300ed2683 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:09.915564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbbda25c-75d1-45f8-8f64-a0b300ed2683 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:09.916014 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbbda25c-75d1-45f8-8f64-a0b300ed2683 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:09.916429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbbda25c-75d1-45f8-8f64-a0b300ed2683 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:10.100165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cbbda25c-75d1-45f8-8f64-a0b300ed2683 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:10.119845 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cbbda25c-75d1-45f8-8f64-a0b300ed2683 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:10.128149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cbbda25c-75d1-45f8-8f64-a0b300ed2683 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:10.134578 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cbbda25c-75d1-45f8-8f64-a0b300ed2683 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1335 microversion: 2.47 time: 0.239477 Oct 29 03:08:10.136745 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2037/4262] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:09 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1335 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:08:10.451944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ef7245dc-750e-480b-ad0d-ee962e0b9522 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:10.452726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ef7245dc-750e-480b-ad0d-ee962e0b9522 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:10.466381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef7245dc-750e-480b-ad0d-ee962e0b9522 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:10.469168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef7245dc-750e-480b-ad0d-ee962e0b9522 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:10.470015 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef7245dc-750e-480b-ad0d-ee962e0b9522 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:10.474205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef7245dc-750e-480b-ad0d-ee962e0b9522 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:10.475079 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef7245dc-750e-480b-ad0d-ee962e0b9522 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:10.479666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef7245dc-750e-480b-ad0d-ee962e0b9522 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:10.642298 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bb4f3b83-db2d-4528-bad6-1b367f124f7e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-790528157", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "d25ade9a-1879-4e1a-bc6a-7ab9288c4389"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:10.725719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-bb4f3b83-db2d-4528-bad6-1b367f124f7e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] validate_networks() for [('d25ade9a-1879-4e1a-bc6a-7ab9288c4389', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:08:11.427261 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ef7245dc-750e-480b-ad0d-ee962e0b9522 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:11.440049 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ef7245dc-750e-480b-ad0d-ee962e0b9522 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1474 microversion: 2.1 time: 0.992394 Oct 29 03:08:11.445886 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2038/4263] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:10 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1474 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:11.451640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1ed154bc-463e-4e89-a08e-628983f9f782 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:11.465362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1ed154bc-463e-4e89-a08e-628983f9f782 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:11.488174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ed154bc-463e-4e89-a08e-628983f9f782 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:11.488808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ed154bc-463e-4e89-a08e-628983f9f782 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:11.489696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ed154bc-463e-4e89-a08e-628983f9f782 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:11.491015 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ed154bc-463e-4e89-a08e-628983f9f782 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:11.491693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ed154bc-463e-4e89-a08e-628983f9f782 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:11.492598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ed154bc-463e-4e89-a08e-628983f9f782 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:11.592263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1ed154bc-463e-4e89-a08e-628983f9f782 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:11.606099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1ed154bc-463e-4e89-a08e-628983f9f782 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:11.612144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1ed154bc-463e-4e89-a08e-628983f9f782 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:11.613797 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1ed154bc-463e-4e89-a08e-628983f9f782 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1356 microversion: 2.47 time: 0.166564 Oct 29 03:08:11.616171 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2039/4264] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:11 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1356 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:08:11.648010 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a26ea05f-70ed-45ec-9dba-8c30c8beccc2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:11.652303 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a26ea05f-70ed-45ec-9dba-8c30c8beccc2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:11.670840 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a26ea05f-70ed-45ec-9dba-8c30c8beccc2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:11.674604 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a26ea05f-70ed-45ec-9dba-8c30c8beccc2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:11.675262 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a26ea05f-70ed-45ec-9dba-8c30c8beccc2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:11.677579 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a26ea05f-70ed-45ec-9dba-8c30c8beccc2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:11.685352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a26ea05f-70ed-45ec-9dba-8c30c8beccc2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:11.686049 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a26ea05f-70ed-45ec-9dba-8c30c8beccc2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:11.742531 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:11.865954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-a26ea05f-70ed-45ec-9dba-8c30c8beccc2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:08:11.866530 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-a26ea05f-70ed-45ec-9dba-8c30c8beccc2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:08:11.867123 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-a26ea05f-70ed-45ec-9dba-8c30c8beccc2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:08:11.867636 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-a26ea05f-70ed-45ec-9dba-8c30c8beccc2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:08:11.868219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-a26ea05f-70ed-45ec-9dba-8c30c8beccc2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:08:12.008107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a26ea05f-70ed-45ec-9dba-8c30c8beccc2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:12.025276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a26ea05f-70ed-45ec-9dba-8c30c8beccc2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:12.027315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a26ea05f-70ed-45ec-9dba-8c30c8beccc2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:12.028188 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a26ea05f-70ed-45ec-9dba-8c30c8beccc2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:12.032709 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a26ea05f-70ed-45ec-9dba-8c30c8beccc2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:12.034005 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a26ea05f-70ed-45ec-9dba-8c30c8beccc2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:12.034813 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a26ea05f-70ed-45ec-9dba-8c30c8beccc2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:12.185284 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a26ea05f-70ed-45ec-9dba-8c30c8beccc2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "POST /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a/action" status: 202 len: 1078 microversion: 2.47 time: 0.540254 Oct 29 03:08:12.187223 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2040/4265] 10.222.0.46 () {62 vars in 1319 bytes} [Sat Oct 29 03:08:11 2022] POST /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a/action => generated 1078 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 29 03:08:12.222240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7fa17814-717c-4d18-a611-b04bfd9b8538 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:12.227624 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7fa17814-717c-4d18-a611-b04bfd9b8538 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:12.271207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fa17814-717c-4d18-a611-b04bfd9b8538 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:12.274652 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fa17814-717c-4d18-a611-b04bfd9b8538 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:12.276451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fa17814-717c-4d18-a611-b04bfd9b8538 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:12.281117 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fa17814-717c-4d18-a611-b04bfd9b8538 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:12.302894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fa17814-717c-4d18-a611-b04bfd9b8538 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:12.303975 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fa17814-717c-4d18-a611-b04bfd9b8538 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:12.476110 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-bb4f3b83-db2d-4528-bad6-1b367f124f7e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:08:12.476742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-bb4f3b83-db2d-4528-bad6-1b367f124f7e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:08:12.477602 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-bb4f3b83-db2d-4528-bad6-1b367f124f7e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:08:12.477910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-bb4f3b83-db2d-4528-bad6-1b367f124f7e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:08:12.478384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-bb4f3b83-db2d-4528-bad6-1b367f124f7e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:08:12.502103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb4f3b83-db2d-4528-bad6-1b367f124f7e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:12.504963 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb4f3b83-db2d-4528-bad6-1b367f124f7e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:12.508209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb4f3b83-db2d-4528-bad6-1b367f124f7e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:12.510827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb4f3b83-db2d-4528-bad6-1b367f124f7e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:12.514924 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb4f3b83-db2d-4528-bad6-1b367f124f7e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:12.515758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb4f3b83-db2d-4528-bad6-1b367f124f7e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:12.574828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-bb4f3b83-db2d-4528-bad6-1b367f124f7e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Getting quotas for project 0c1e510b5644490d839cefd879108416. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:08:12.587201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-bb4f3b83-db2d-4528-bad6-1b367f124f7e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Getting quotas for user 94aca590158c420399a46af6c9e88bb8 and project 0c1e510b5644490d839cefd879108416. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:08:12.611259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bb4f3b83-db2d-4528-bad6-1b367f124f7e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Going to run 3 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:08:12.614972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bb4f3b83-db2d-4528-bad6-1b367f124f7e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: 79b80ca1-484d-4fd4-9002-ef3626fd858b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:08:12.663223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bb4f3b83-db2d-4528-bad6-1b367f124f7e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: 3c597067-efff-40a4-b890-1c6e7a69e96e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=79b80ca1-484d-4fd4-9002-ef3626fd858b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:08:12.685986 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7fa17814-717c-4d18-a611-b04bfd9b8538 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:12.699335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7fa17814-717c-4d18-a611-b04bfd9b8538 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:12.702452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7fa17814-717c-4d18-a611-b04bfd9b8538 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:12.707034 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7fa17814-717c-4d18-a611-b04bfd9b8538 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1365 microversion: 2.47 time: 0.501437 Oct 29 03:08:12.709552 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2041/4266] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:12 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1365 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:08:12.724463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6d80e734-35a5-469e-98e1-585526481725 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:12.725524 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6d80e734-35a5-469e-98e1-585526481725 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:12.739293 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d80e734-35a5-469e-98e1-585526481725 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:12.740164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d80e734-35a5-469e-98e1-585526481725 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:12.740999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d80e734-35a5-469e-98e1-585526481725 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:12.742087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d80e734-35a5-469e-98e1-585526481725 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:12.748804 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d80e734-35a5-469e-98e1-585526481725 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:12.749756 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d80e734-35a5-469e-98e1-585526481725 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:12.762299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bb4f3b83-db2d-4528-bad6-1b367f124f7e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: ba75665d-3656-45c2-8bd8-f6dc6a66c851] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=3c597067-efff-40a4-b890-1c6e7a69e96e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:08:12.919750 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bb4f3b83-db2d-4528-bad6-1b367f124f7e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.636759 Oct 29 03:08:12.923048 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2226/4267] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:08:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:08:12.944645 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3d544594-3a3c-4137-9295-9f225d713262 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:12.965924 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3d544594-3a3c-4137-9295-9f225d713262 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:12.967559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3d544594-3a3c-4137-9295-9f225d713262 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Searching by: {'deleted': False, 'project_id': '0c1e510b5644490d839cefd879108416'} {{(pid=127124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:08:13.081688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d544594-3a3c-4137-9295-9f225d713262 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:13.082573 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d544594-3a3c-4137-9295-9f225d713262 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:13.083330 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d544594-3a3c-4137-9295-9f225d713262 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:13.084685 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d544594-3a3c-4137-9295-9f225d713262 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:13.099693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d544594-3a3c-4137-9295-9f225d713262 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:13.100616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d544594-3a3c-4137-9295-9f225d713262 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:13.224253 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3d544594-3a3c-4137-9295-9f225d713262 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.292736 Oct 29 03:08:13.225335 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2227/4268] 10.222.0.46 () {58 vars in 1125 bytes} [Sat Oct 29 03:08:12 2022] GET /compute/v2.1/servers => generated 1015 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:08:13.282867 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8d845608-cba8-46ce-b3f8-911c0d0f4787 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:13.286043 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8d845608-cba8-46ce-b3f8-911c0d0f4787 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: ba75665d-3656-45c2-8bd8-f6dc6a66c851] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:13.537435 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6d80e734-35a5-469e-98e1-585526481725 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:13.553957 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6d80e734-35a5-469e-98e1-585526481725 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1474 microversion: 2.1 time: 0.842050 Oct 29 03:08:13.568379 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2042/4269] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:12 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1474 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:13.619367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8d845608-cba8-46ce-b3f8-911c0d0f4787 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:13.630634 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8d845608-cba8-46ce-b3f8-911c0d0f4787 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851" status: 200 len: 1222 microversion: 2.1 time: 0.393375 Oct 29 03:08:13.631243 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2228/4270] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:13 2022] GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851 => generated 1222 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:13.738301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-79b8dde2-9648-4134-bf96-ff1e090e7777 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:13.739517 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-79b8dde2-9648-4134-bf96-ff1e090e7777 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:13.747066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-79b8dde2-9648-4134-bf96-ff1e090e7777 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:13.750901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-79b8dde2-9648-4134-bf96-ff1e090e7777 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:13.753477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-79b8dde2-9648-4134-bf96-ff1e090e7777 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:13.754410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-79b8dde2-9648-4134-bf96-ff1e090e7777 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:13.756223 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-79b8dde2-9648-4134-bf96-ff1e090e7777 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:13.759378 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-79b8dde2-9648-4134-bf96-ff1e090e7777 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:14.121761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-79b8dde2-9648-4134-bf96-ff1e090e7777 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:14.135696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-79b8dde2-9648-4134-bf96-ff1e090e7777 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:14.138012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-79b8dde2-9648-4134-bf96-ff1e090e7777 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:14.139763 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-79b8dde2-9648-4134-bf96-ff1e090e7777 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1365 microversion: 2.47 time: 0.405326 Oct 29 03:08:14.140874 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2043/4271] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:13 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1365 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:08:14.591171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6f4239a6-b266-4e28-984b-4e3dbcc381f3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:14.591891 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6f4239a6-b266-4e28-984b-4e3dbcc381f3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:14.605313 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f4239a6-b266-4e28-984b-4e3dbcc381f3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:14.605934 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f4239a6-b266-4e28-984b-4e3dbcc381f3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:14.606323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f4239a6-b266-4e28-984b-4e3dbcc381f3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:14.607137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f4239a6-b266-4e28-984b-4e3dbcc381f3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:14.607601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f4239a6-b266-4e28-984b-4e3dbcc381f3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:14.608032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f4239a6-b266-4e28-984b-4e3dbcc381f3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:14.653827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fd168d87-776b-4077-9828-aa5d3db3bb89 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:14.654424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fd168d87-776b-4077-9828-aa5d3db3bb89 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: ba75665d-3656-45c2-8bd8-f6dc6a66c851] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:14.911661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:15.000224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fd168d87-776b-4077-9828-aa5d3db3bb89 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:15.015165 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fd168d87-776b-4077-9828-aa5d3db3bb89 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851" status: 200 len: 1222 microversion: 2.1 time: 0.365151 Oct 29 03:08:15.016145 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2044/4272] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:14 2022] GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851 => generated 1222 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:08:15.175445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3839aac3-ea8d-4177-84c9-b88248e3350c tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:15.175445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3839aac3-ea8d-4177-84c9-b88248e3350c tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:15.188203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3839aac3-ea8d-4177-84c9-b88248e3350c tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:15.195399 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3839aac3-ea8d-4177-84c9-b88248e3350c tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:15.195984 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3839aac3-ea8d-4177-84c9-b88248e3350c tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:15.196810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3839aac3-ea8d-4177-84c9-b88248e3350c tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:15.197336 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3839aac3-ea8d-4177-84c9-b88248e3350c tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:15.203044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3839aac3-ea8d-4177-84c9-b88248e3350c tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:15.665276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3839aac3-ea8d-4177-84c9-b88248e3350c tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:15.681925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3839aac3-ea8d-4177-84c9-b88248e3350c tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:15.690364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3839aac3-ea8d-4177-84c9-b88248e3350c tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:15.691599 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3839aac3-ea8d-4177-84c9-b88248e3350c tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1365 microversion: 2.47 time: 0.521294 Oct 29 03:08:15.695265 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2045/4273] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:15 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1365 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:08:15.947407 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6f4239a6-b266-4e28-984b-4e3dbcc381f3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:15.967430 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6f4239a6-b266-4e28-984b-4e3dbcc381f3 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1474 microversion: 2.1 time: 1.387581 Oct 29 03:08:15.972567 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2229/4274] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:14 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1474 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:16.054547 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c0f9abb4-2f94-46d3-b3d7-f1bf6ebc7697 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:16.055434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c0f9abb4-2f94-46d3-b3d7-f1bf6ebc7697 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: ba75665d-3656-45c2-8bd8-f6dc6a66c851] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:16.072245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0f9abb4-2f94-46d3-b3d7-f1bf6ebc7697 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:16.076276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0f9abb4-2f94-46d3-b3d7-f1bf6ebc7697 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:16.081245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0f9abb4-2f94-46d3-b3d7-f1bf6ebc7697 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:16.082325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0f9abb4-2f94-46d3-b3d7-f1bf6ebc7697 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:16.085610 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0f9abb4-2f94-46d3-b3d7-f1bf6ebc7697 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:16.086555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0f9abb4-2f94-46d3-b3d7-f1bf6ebc7697 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:16.573323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c0f9abb4-2f94-46d3-b3d7-f1bf6ebc7697 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:16.582465 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c0f9abb4-2f94-46d3-b3d7-f1bf6ebc7697 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851" status: 200 len: 1274 microversion: 2.1 time: 0.539400 Oct 29 03:08:16.613410 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2046/4275] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:16 2022] GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851 => generated 1274 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:16.722816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-13fe879e-c158-46dc-b9bd-5f8bbbc48df1 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:16.723663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-13fe879e-c158-46dc-b9bd-5f8bbbc48df1 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:16.747167 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13fe879e-c158-46dc-b9bd-5f8bbbc48df1 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:16.750070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13fe879e-c158-46dc-b9bd-5f8bbbc48df1 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:16.752174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13fe879e-c158-46dc-b9bd-5f8bbbc48df1 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:16.753438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13fe879e-c158-46dc-b9bd-5f8bbbc48df1 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:16.755246 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13fe879e-c158-46dc-b9bd-5f8bbbc48df1 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:16.756591 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13fe879e-c158-46dc-b9bd-5f8bbbc48df1 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:16.999659 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f173402c-aec9-4b86-a41f-32ccebc37708 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:17.000835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f173402c-aec9-4b86-a41f-32ccebc37708 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:17.030112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f173402c-aec9-4b86-a41f-32ccebc37708 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:17.032487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f173402c-aec9-4b86-a41f-32ccebc37708 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:17.033739 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f173402c-aec9-4b86-a41f-32ccebc37708 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:17.035268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f173402c-aec9-4b86-a41f-32ccebc37708 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:17.036329 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f173402c-aec9-4b86-a41f-32ccebc37708 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:17.041330 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f173402c-aec9-4b86-a41f-32ccebc37708 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:17.123197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-13fe879e-c158-46dc-b9bd-5f8bbbc48df1 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:17.143472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-13fe879e-c158-46dc-b9bd-5f8bbbc48df1 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:17.144959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-13fe879e-c158-46dc-b9bd-5f8bbbc48df1 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:17.146249 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-13fe879e-c158-46dc-b9bd-5f8bbbc48df1 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1365 microversion: 2.47 time: 0.429881 Oct 29 03:08:17.146802 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2230/4276] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:16 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1365 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:08:17.607798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f0c1d83f-923f-418b-9487-279af1d35ca4 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:17.608431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f0c1d83f-923f-418b-9487-279af1d35ca4 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: ba75665d-3656-45c2-8bd8-f6dc6a66c851] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:17.618490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0c1d83f-923f-418b-9487-279af1d35ca4 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:17.621728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0c1d83f-923f-418b-9487-279af1d35ca4 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:17.622484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0c1d83f-923f-418b-9487-279af1d35ca4 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:17.623445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0c1d83f-923f-418b-9487-279af1d35ca4 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:17.625292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0c1d83f-923f-418b-9487-279af1d35ca4 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:17.627760 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0c1d83f-923f-418b-9487-279af1d35ca4 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:18.103018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f173402c-aec9-4b86-a41f-32ccebc37708 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:18.116838 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f173402c-aec9-4b86-a41f-32ccebc37708 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1474 microversion: 2.1 time: 1.122276 Oct 29 03:08:18.122732 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2047/4277] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:16 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1474 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:18.179039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a66813db-8d61-4352-b2b4-edc8b2903cc4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:18.179670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a66813db-8d61-4352-b2b4-edc8b2903cc4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:18.196711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a66813db-8d61-4352-b2b4-edc8b2903cc4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:18.197314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a66813db-8d61-4352-b2b4-edc8b2903cc4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:18.201201 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a66813db-8d61-4352-b2b4-edc8b2903cc4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:18.202996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a66813db-8d61-4352-b2b4-edc8b2903cc4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:18.203561 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a66813db-8d61-4352-b2b4-edc8b2903cc4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:18.204017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a66813db-8d61-4352-b2b4-edc8b2903cc4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:18.476576 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a66813db-8d61-4352-b2b4-edc8b2903cc4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:18.499431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a66813db-8d61-4352-b2b4-edc8b2903cc4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:18.502305 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a66813db-8d61-4352-b2b4-edc8b2903cc4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:18.506200 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a66813db-8d61-4352-b2b4-edc8b2903cc4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1365 microversion: 2.47 time: 0.332374 Oct 29 03:08:18.509590 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2048/4278] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:18 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1365 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:08:18.534019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f0c1d83f-923f-418b-9487-279af1d35ca4 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:18.546437 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f0c1d83f-923f-418b-9487-279af1d35ca4 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851" status: 200 len: 1280 microversion: 2.1 time: 0.942676 Oct 29 03:08:18.548743 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2231/4279] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:17 2022] GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851 => generated 1280 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:19.146853 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b037909d-24e9-4b89-894b-ae5443aa72ad tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:19.149576 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b037909d-24e9-4b89-894b-ae5443aa72ad tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:19.166773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b037909d-24e9-4b89-894b-ae5443aa72ad tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:19.169809 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b037909d-24e9-4b89-894b-ae5443aa72ad tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:19.171540 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b037909d-24e9-4b89-894b-ae5443aa72ad tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:19.193087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b037909d-24e9-4b89-894b-ae5443aa72ad tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:19.194135 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b037909d-24e9-4b89-894b-ae5443aa72ad tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:19.195733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b037909d-24e9-4b89-894b-ae5443aa72ad tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:19.538286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-74bb61a7-debf-4982-943e-828e8de6e410 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:19.539024 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-74bb61a7-debf-4982-943e-828e8de6e410 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:19.556904 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-74bb61a7-debf-4982-943e-828e8de6e410 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:19.557481 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-74bb61a7-debf-4982-943e-828e8de6e410 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:19.557932 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-74bb61a7-debf-4982-943e-828e8de6e410 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:19.569760 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-74bb61a7-debf-4982-943e-828e8de6e410 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:19.570308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-74bb61a7-debf-4982-943e-828e8de6e410 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:19.570981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-74bb61a7-debf-4982-943e-828e8de6e410 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:19.774964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-74bb61a7-debf-4982-943e-828e8de6e410 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:19.790279 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-74bb61a7-debf-4982-943e-828e8de6e410 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:19.794136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-74bb61a7-debf-4982-943e-828e8de6e410 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:19.802617 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-74bb61a7-debf-4982-943e-828e8de6e410 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1365 microversion: 2.47 time: 0.268505 Oct 29 03:08:19.807815 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2232/4280] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:19 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1365 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:08:19.820315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ca0efa4f-e2e4-4db8-8b65-1a769c8bd2a8 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:19.827338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ca0efa4f-e2e4-4db8-8b65-1a769c8bd2a8 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: ba75665d-3656-45c2-8bd8-f6dc6a66c851] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:19.849803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca0efa4f-e2e4-4db8-8b65-1a769c8bd2a8 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:19.850537 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca0efa4f-e2e4-4db8-8b65-1a769c8bd2a8 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:19.851037 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca0efa4f-e2e4-4db8-8b65-1a769c8bd2a8 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:19.851823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca0efa4f-e2e4-4db8-8b65-1a769c8bd2a8 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:19.852288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca0efa4f-e2e4-4db8-8b65-1a769c8bd2a8 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:19.852759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca0efa4f-e2e4-4db8-8b65-1a769c8bd2a8 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:19.920308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b037909d-24e9-4b89-894b-ae5443aa72ad tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:19.933138 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b037909d-24e9-4b89-894b-ae5443aa72ad tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1474 microversion: 2.1 time: 0.791000 Oct 29 03:08:19.940783 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2049/4281] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:19 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1474 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:20.838803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-040d5932-cffb-46bd-8450-073c95b09c68 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:20.839419 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-040d5932-cffb-46bd-8450-073c95b09c68 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:20.860144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-040d5932-cffb-46bd-8450-073c95b09c68 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:20.862256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-040d5932-cffb-46bd-8450-073c95b09c68 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:20.865159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-040d5932-cffb-46bd-8450-073c95b09c68 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:20.866263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-040d5932-cffb-46bd-8450-073c95b09c68 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:20.868414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-040d5932-cffb-46bd-8450-073c95b09c68 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:20.873517 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-040d5932-cffb-46bd-8450-073c95b09c68 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:21.145097 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ca0efa4f-e2e4-4db8-8b65-1a769c8bd2a8 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:21.153600 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ca0efa4f-e2e4-4db8-8b65-1a769c8bd2a8 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851" status: 200 len: 1322 microversion: 2.1 time: 1.344111 Oct 29 03:08:21.154238 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2233/4282] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:19 2022] GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851 => generated 1322 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:21.177248 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9e430d11-c4b8-4d85-abbb-2bc4c5457d05 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:21.177893 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9e430d11-c4b8-4d85-abbb-2bc4c5457d05 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:21.210956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-040d5932-cffb-46bd-8450-073c95b09c68 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:21.218519 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e430d11-c4b8-4d85-abbb-2bc4c5457d05 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:21.222929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e430d11-c4b8-4d85-abbb-2bc4c5457d05 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:21.226847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e430d11-c4b8-4d85-abbb-2bc4c5457d05 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:21.227747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e430d11-c4b8-4d85-abbb-2bc4c5457d05 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:21.232368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e430d11-c4b8-4d85-abbb-2bc4c5457d05 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:21.234794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e430d11-c4b8-4d85-abbb-2bc4c5457d05 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:21.235940 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-040d5932-cffb-46bd-8450-073c95b09c68 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:21.247362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-040d5932-cffb-46bd-8450-073c95b09c68 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:21.249390 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-040d5932-cffb-46bd-8450-073c95b09c68 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1365 microversion: 2.47 time: 0.415580 Oct 29 03:08:21.257323 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2050/4283] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:20 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1365 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:08:21.601124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9e430d11-c4b8-4d85-abbb-2bc4c5457d05 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:21.625359 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9e430d11-c4b8-4d85-abbb-2bc4c5457d05 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1474 microversion: 2.1 time: 0.463397 Oct 29 03:08:21.628275 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2234/4284] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:21 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1474 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:22.180429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a2ce6760-aa5d-402a-9e0c-7eb146e7725d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:22.183297 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a2ce6760-aa5d-402a-9e0c-7eb146e7725d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: ba75665d-3656-45c2-8bd8-f6dc6a66c851] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:22.195638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2ce6760-aa5d-402a-9e0c-7eb146e7725d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:22.196131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2ce6760-aa5d-402a-9e0c-7eb146e7725d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:22.196650 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2ce6760-aa5d-402a-9e0c-7eb146e7725d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:22.197373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2ce6760-aa5d-402a-9e0c-7eb146e7725d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:22.198077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2ce6760-aa5d-402a-9e0c-7eb146e7725d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:22.198513 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2ce6760-aa5d-402a-9e0c-7eb146e7725d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:22.297135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-29778c24-f7be-4990-a5a7-aa27e5bb6742 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:22.301104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-29778c24-f7be-4990-a5a7-aa27e5bb6742 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:22.336279 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-29778c24-f7be-4990-a5a7-aa27e5bb6742 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:22.338512 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-29778c24-f7be-4990-a5a7-aa27e5bb6742 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:22.339358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-29778c24-f7be-4990-a5a7-aa27e5bb6742 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:22.340516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-29778c24-f7be-4990-a5a7-aa27e5bb6742 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:22.341431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-29778c24-f7be-4990-a5a7-aa27e5bb6742 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:22.342190 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-29778c24-f7be-4990-a5a7-aa27e5bb6742 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:22.524714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-29778c24-f7be-4990-a5a7-aa27e5bb6742 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:22.538425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-29778c24-f7be-4990-a5a7-aa27e5bb6742 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:22.539914 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-29778c24-f7be-4990-a5a7-aa27e5bb6742 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:22.548948 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-29778c24-f7be-4990-a5a7-aa27e5bb6742 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1365 microversion: 2.47 time: 0.261251 Oct 29 03:08:22.552286 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2235/4285] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:22 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:08:22.662794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-936b3e8e-b5b1-4eb2-88d8-ce3e94894408 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:22.663766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-936b3e8e-b5b1-4eb2-88d8-ce3e94894408 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:22.676263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-936b3e8e-b5b1-4eb2-88d8-ce3e94894408 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:22.676263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-936b3e8e-b5b1-4eb2-88d8-ce3e94894408 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:22.676263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-936b3e8e-b5b1-4eb2-88d8-ce3e94894408 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:22.676263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-936b3e8e-b5b1-4eb2-88d8-ce3e94894408 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:22.679325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-936b3e8e-b5b1-4eb2-88d8-ce3e94894408 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:22.680127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-936b3e8e-b5b1-4eb2-88d8-ce3e94894408 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:22.726622 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:23.154996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:23.476968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a2ce6760-aa5d-402a-9e0c-7eb146e7725d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:23.487787 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a2ce6760-aa5d-402a-9e0c-7eb146e7725d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851" status: 200 len: 1322 microversion: 2.1 time: 1.311237 Oct 29 03:08:23.492180 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2051/4286] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:22 2022] GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851 => generated 1322 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:23.582890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4a55aa63-3a51-4d41-9b47-151c7da5a94b tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:23.583910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4a55aa63-3a51-4d41-9b47-151c7da5a94b tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:23.591115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a55aa63-3a51-4d41-9b47-151c7da5a94b tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:23.592263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a55aa63-3a51-4d41-9b47-151c7da5a94b tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:23.593118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a55aa63-3a51-4d41-9b47-151c7da5a94b tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:23.594076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a55aa63-3a51-4d41-9b47-151c7da5a94b tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:23.594776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a55aa63-3a51-4d41-9b47-151c7da5a94b tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:23.595420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a55aa63-3a51-4d41-9b47-151c7da5a94b tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:23.630288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=16 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:23.734660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-936b3e8e-b5b1-4eb2-88d8-ce3e94894408 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:23.743944 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-936b3e8e-b5b1-4eb2-88d8-ce3e94894408 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1474 microversion: 2.1 time: 1.091604 Oct 29 03:08:23.744736 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2236/4287] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:22 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1474 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:24.195264 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4a55aa63-3a51-4d41-9b47-151c7da5a94b tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:24.210519 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4a55aa63-3a51-4d41-9b47-151c7da5a94b tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:24.216914 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4a55aa63-3a51-4d41-9b47-151c7da5a94b tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:24.225314 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4a55aa63-3a51-4d41-9b47-151c7da5a94b tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1365 microversion: 2.47 time: 0.643270 Oct 29 03:08:24.226764 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2052/4288] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:23 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1365 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:08:24.524276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b422ccf7-8ba1-436d-8799-4a0a83d4b55e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:24.527430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b422ccf7-8ba1-436d-8799-4a0a83d4b55e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: ba75665d-3656-45c2-8bd8-f6dc6a66c851] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:24.560426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b422ccf7-8ba1-436d-8799-4a0a83d4b55e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:24.561559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b422ccf7-8ba1-436d-8799-4a0a83d4b55e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:24.562502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b422ccf7-8ba1-436d-8799-4a0a83d4b55e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:24.564051 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b422ccf7-8ba1-436d-8799-4a0a83d4b55e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:24.566657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b422ccf7-8ba1-436d-8799-4a0a83d4b55e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:24.567928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b422ccf7-8ba1-436d-8799-4a0a83d4b55e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:24.769834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a46e73f9-618b-4f89-9e9b-cf028a2933a5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:24.770559 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a46e73f9-618b-4f89-9e9b-cf028a2933a5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:24.797421 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a46e73f9-618b-4f89-9e9b-cf028a2933a5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:24.803806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a46e73f9-618b-4f89-9e9b-cf028a2933a5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:24.804626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a46e73f9-618b-4f89-9e9b-cf028a2933a5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:24.811760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a46e73f9-618b-4f89-9e9b-cf028a2933a5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:24.815303 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a46e73f9-618b-4f89-9e9b-cf028a2933a5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:24.819908 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a46e73f9-618b-4f89-9e9b-cf028a2933a5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:25.004940 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=10 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:25.304829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b422ccf7-8ba1-436d-8799-4a0a83d4b55e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:25.316668 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b422ccf7-8ba1-436d-8799-4a0a83d4b55e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851" status: 200 len: 1322 microversion: 2.1 time: 0.800685 Oct 29 03:08:25.325772 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2237/4289] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:24 2022] GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851 => generated 1322 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:25.347174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6cd521bb-8473-4495-8731-f8174c13881d tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:25.348211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6cd521bb-8473-4495-8731-f8174c13881d tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:25.385396 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cd521bb-8473-4495-8731-f8174c13881d tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:25.386344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cd521bb-8473-4495-8731-f8174c13881d tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:25.387229 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cd521bb-8473-4495-8731-f8174c13881d tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:25.388065 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cd521bb-8473-4495-8731-f8174c13881d tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:25.389553 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cd521bb-8473-4495-8731-f8174c13881d tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:25.390874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cd521bb-8473-4495-8731-f8174c13881d tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:25.432229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a46e73f9-618b-4f89-9e9b-cf028a2933a5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:25.445758 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a46e73f9-618b-4f89-9e9b-cf028a2933a5 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1473 microversion: 2.1 time: 0.680958 Oct 29 03:08:25.463185 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2053/4290] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:24 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1473 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:25.601976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6cd521bb-8473-4495-8731-f8174c13881d tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:25.617096 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6cd521bb-8473-4495-8731-f8174c13881d tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:25.619699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6cd521bb-8473-4495-8731-f8174c13881d tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:25.621256 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6cd521bb-8473-4495-8731-f8174c13881d tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1365 microversion: 2.47 time: 0.294151 Oct 29 03:08:25.622050 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2238/4291] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:25 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1365 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:08:26.045773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-311046e5-0b9f-4f25-ab62-fbd709c98476 req-f2675415-4cfe-4c81-ac79-ff7805c09bdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba75665d-3656-45c2-8bd8-f6dc6a66c851", "tag": "e6d17c69-1713-4142-ba71-2fb8e8f5c28c"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:26.103920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-311046e5-0b9f-4f25-ab62-fbd709c98476 req-f2675415-4cfe-4c81-ac79-ff7805c09bdc service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:26.105888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-311046e5-0b9f-4f25-ab62-fbd709c98476 req-f2675415-4cfe-4c81-ac79-ff7805c09bdc service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:26.106848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-311046e5-0b9f-4f25-ab62-fbd709c98476 req-f2675415-4cfe-4c81-ac79-ff7805c09bdc service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:26.127027 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-311046e5-0b9f-4f25-ab62-fbd709c98476 req-f2675415-4cfe-4c81-ac79-ff7805c09bdc service nova] Creating event network-changed:e6d17c69-1713-4142-ba71-2fb8e8f5c28c for instance ba75665d-3656-45c2-8bd8-f6dc6a66c851 on n-h2-862967-2 Oct 29 03:08:26.133548 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-311046e5-0b9f-4f25-ab62-fbd709c98476 req-f2675415-4cfe-4c81-ac79-ff7805c09bdc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111033 Oct 29 03:08:26.139708 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2054/4292] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:26.345134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cc1e5611-2790-4b7e-822f-61b0c0b94935 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:26.347256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cc1e5611-2790-4b7e-822f-61b0c0b94935 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: ba75665d-3656-45c2-8bd8-f6dc6a66c851] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:26.356169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc1e5611-2790-4b7e-822f-61b0c0b94935 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:26.356169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc1e5611-2790-4b7e-822f-61b0c0b94935 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:26.357522 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc1e5611-2790-4b7e-822f-61b0c0b94935 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:26.357522 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc1e5611-2790-4b7e-822f-61b0c0b94935 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:26.358123 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc1e5611-2790-4b7e-822f-61b0c0b94935 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:26.358727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc1e5611-2790-4b7e-822f-61b0c0b94935 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:26.476924 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-047a69b6-37d4-4d86-828c-f824f13db55b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:26.478512 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-047a69b6-37d4-4d86-828c-f824f13db55b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:26.487569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-047a69b6-37d4-4d86-828c-f824f13db55b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:26.488294 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-047a69b6-37d4-4d86-828c-f824f13db55b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:26.488891 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-047a69b6-37d4-4d86-828c-f824f13db55b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:26.489805 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-047a69b6-37d4-4d86-828c-f824f13db55b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:26.490367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-047a69b6-37d4-4d86-828c-f824f13db55b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:26.490965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-047a69b6-37d4-4d86-828c-f824f13db55b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:27.144339 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-047a69b6-37d4-4d86-828c-f824f13db55b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:27.153190 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-047a69b6-37d4-4d86-828c-f824f13db55b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1473 microversion: 2.1 time: 0.681780 Oct 29 03:08:27.153800 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2055/4293] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:26 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1473 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:27.165054 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a91a1cb9-73c8-4897-a07d-6672996d4615 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:27.168791 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a91a1cb9-73c8-4897-a07d-6672996d4615 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:27.180231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a91a1cb9-73c8-4897-a07d-6672996d4615 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:27.183355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a91a1cb9-73c8-4897-a07d-6672996d4615 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:27.184035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a91a1cb9-73c8-4897-a07d-6672996d4615 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:27.189402 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a91a1cb9-73c8-4897-a07d-6672996d4615 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:27.190164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a91a1cb9-73c8-4897-a07d-6672996d4615 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:27.190665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a91a1cb9-73c8-4897-a07d-6672996d4615 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:27.204086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cc1e5611-2790-4b7e-822f-61b0c0b94935 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:27.216891 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cc1e5611-2790-4b7e-822f-61b0c0b94935 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851" status: 200 len: 1322 microversion: 2.1 time: 0.878135 Oct 29 03:08:27.218437 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2239/4294] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:26 2022] GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851 => generated 1322 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:27.395627 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a91a1cb9-73c8-4897-a07d-6672996d4615 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:27.405015 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:27.409622 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a91a1cb9-73c8-4897-a07d-6672996d4615 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:27.411285 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a91a1cb9-73c8-4897-a07d-6672996d4615 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:27.420137 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a91a1cb9-73c8-4897-a07d-6672996d4615 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1365 microversion: 2.47 time: 0.258853 Oct 29 03:08:27.422655 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2056/4295] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:27 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1365 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:08:28.033573 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-d3c4ce87-6e34-4d58-bfd8-c50f6592811f req-691630ce-613a-4ba9-b9f1-fa9c7378c930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79b80ca1-484d-4fd4-9002-ef3626fd858b", "tag": "1af16bf9-f26a-4d1e-9af2-fadf898c15ff"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:28.059314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d3c4ce87-6e34-4d58-bfd8-c50f6592811f req-691630ce-613a-4ba9-b9f1-fa9c7378c930 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:28.063148 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d3c4ce87-6e34-4d58-bfd8-c50f6592811f req-691630ce-613a-4ba9-b9f1-fa9c7378c930 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:28.068399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d3c4ce87-6e34-4d58-bfd8-c50f6592811f req-691630ce-613a-4ba9-b9f1-fa9c7378c930 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:28.096178 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-d3c4ce87-6e34-4d58-bfd8-c50f6592811f req-691630ce-613a-4ba9-b9f1-fa9c7378c930 service nova] Creating event network-changed:1af16bf9-f26a-4d1e-9af2-fadf898c15ff for instance 79b80ca1-484d-4fd4-9002-ef3626fd858b on n-h1-862967-2 Oct 29 03:08:28.102878 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-d3c4ce87-6e34-4d58-bfd8-c50f6592811f req-691630ce-613a-4ba9-b9f1-fa9c7378c930 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082665 Oct 29 03:08:28.106216 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2240/4296] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:28.182385 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-08b45a5f-227c-4713-98d6-a7a91c6a080b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:28.193900 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-08b45a5f-227c-4713-98d6-a7a91c6a080b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:28.201858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-9835b095-a51e-4d1d-890e-a0641825f135 req-17f333d5-1f7a-4954-81ba-275dbbce8d6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c25c557-35b6-4dce-99f0-4e2b1c43cf40", "name": "network-vif-unplugged", "status": "completed", "tag": "544bbd3a-133a-48fc-85fa-eb236d549271"}, {"name": "network-changed", "server_uuid": "3c597067-efff-40a4-b890-1c6e7a69e96e", "tag": "3effa6d0-a0dd-42b8-9a4e-4274badc6551"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:28.220746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08b45a5f-227c-4713-98d6-a7a91c6a080b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:28.222149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08b45a5f-227c-4713-98d6-a7a91c6a080b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:28.223462 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08b45a5f-227c-4713-98d6-a7a91c6a080b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:28.225283 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9835b095-a51e-4d1d-890e-a0641825f135 req-17f333d5-1f7a-4954-81ba-275dbbce8d6f service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:28.225771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9835b095-a51e-4d1d-890e-a0641825f135 req-17f333d5-1f7a-4954-81ba-275dbbce8d6f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:28.226207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9835b095-a51e-4d1d-890e-a0641825f135 req-17f333d5-1f7a-4954-81ba-275dbbce8d6f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:28.238029 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08b45a5f-227c-4713-98d6-a7a91c6a080b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:28.239863 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08b45a5f-227c-4713-98d6-a7a91c6a080b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:28.241467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08b45a5f-227c-4713-98d6-a7a91c6a080b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:28.254640 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-9835b095-a51e-4d1d-890e-a0641825f135 req-17f333d5-1f7a-4954-81ba-275dbbce8d6f service nova] Creating event network-vif-unplugged:544bbd3a-133a-48fc-85fa-eb236d549271 for instance 3c25c557-35b6-4dce-99f0-4e2b1c43cf40 on n-h2-862967-2 Oct 29 03:08:28.255145 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-9835b095-a51e-4d1d-890e-a0641825f135 req-17f333d5-1f7a-4954-81ba-275dbbce8d6f service nova] Creating event network-changed:3effa6d0-a0dd-42b8-9a4e-4274badc6551 for instance 3c597067-efff-40a4-b890-1c6e7a69e96e on n-h1-862967-2 Oct 29 03:08:28.272179 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [req-9835b095-a51e-4d1d-890e-a0641825f135 req-17f333d5-1f7a-4954-81ba-275dbbce8d6f service nova] Instance 3c25c557-35b6-4dce-99f0-4e2b1c43cf40 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:08:28.296356 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-9835b095-a51e-4d1d-890e-a0641825f135 req-17f333d5-1f7a-4954-81ba-275dbbce8d6f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.112615 Oct 29 03:08:28.297313 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2241/4297] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:28.302448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6cf1bf2c-8f42-449b-b010-f7a5bc66f5cd tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:28.303156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6cf1bf2c-8f42-449b-b010-f7a5bc66f5cd tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: ba75665d-3656-45c2-8bd8-f6dc6a66c851] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:28.324432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cf1bf2c-8f42-449b-b010-f7a5bc66f5cd tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:28.333186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cf1bf2c-8f42-449b-b010-f7a5bc66f5cd tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:28.333655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cf1bf2c-8f42-449b-b010-f7a5bc66f5cd tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:28.334433 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cf1bf2c-8f42-449b-b010-f7a5bc66f5cd tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:28.334899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cf1bf2c-8f42-449b-b010-f7a5bc66f5cd tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:28.335333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cf1bf2c-8f42-449b-b010-f7a5bc66f5cd tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:28.861855 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-08b45a5f-227c-4713-98d6-a7a91c6a080b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:28.877658 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-08b45a5f-227c-4713-98d6-a7a91c6a080b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1473 microversion: 2.1 time: 0.699387 Oct 29 03:08:28.878592 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2057/4298] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:28 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1473 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:28.883260 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b9095294-8880-4927-b0cd-8e84996c9aaf tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:28.883878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b9095294-8880-4927-b0cd-8e84996c9aaf tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:28.902302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9095294-8880-4927-b0cd-8e84996c9aaf tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:28.902803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9095294-8880-4927-b0cd-8e84996c9aaf tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:28.903246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9095294-8880-4927-b0cd-8e84996c9aaf tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:28.909549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9095294-8880-4927-b0cd-8e84996c9aaf tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:28.910039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9095294-8880-4927-b0cd-8e84996c9aaf tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:28.910480 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9095294-8880-4927-b0cd-8e84996c9aaf tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:29.081149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b9095294-8880-4927-b0cd-8e84996c9aaf tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:29.091186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b9095294-8880-4927-b0cd-8e84996c9aaf tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:29.092819 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b9095294-8880-4927-b0cd-8e84996c9aaf tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:29.094321 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b9095294-8880-4927-b0cd-8e84996c9aaf tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1365 microversion: 2.47 time: 0.214730 Oct 29 03:08:29.094928 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2058/4299] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:28 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:08:29.120669 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bf1711ab-2729-4510-8143-1dbb0391a782 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:29.122993 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:29.137571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf1711ab-2729-4510-8143-1dbb0391a782 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:29.138062 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf1711ab-2729-4510-8143-1dbb0391a782 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:29.138503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf1711ab-2729-4510-8143-1dbb0391a782 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:29.179406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bf1711ab-2729-4510-8143-1dbb0391a782 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Going to try to stop instance {{(pid=127125) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 03:08:29.298521 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bf1711ab-2729-4510-8143-1dbb0391a782 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "POST /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17/action" status: 202 len: 0 microversion: 2.1 time: 0.193341 Oct 29 03:08:29.299247 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2059/4300] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:08:29 2022] POST /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:08:29.543163 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b97f8f34-5e33-4922-b80f-075a84c96b6e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1204870543", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:29.623947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-b97f8f34-5e33-4922-b80f-075a84c96b6e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] validate_networks() for [('1f6f70fe-4dc4-4a72-9da8-235db3cfa873', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:08:29.732927 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6cf1bf2c-8f42-449b-b010-f7a5bc66f5cd tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:29.750005 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6cf1bf2c-8f42-449b-b010-f7a5bc66f5cd tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851" status: 200 len: 1322 microversion: 2.1 time: 1.450871 Oct 29 03:08:29.764932 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2242/4301] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:28 2022] GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851 => generated 1322 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:29.770525 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b220baab-6172-4294-bf49-9a3d1d066b59 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:29.771137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b220baab-6172-4294-bf49-9a3d1d066b59 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:29.777542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b220baab-6172-4294-bf49-9a3d1d066b59 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:29.778293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b220baab-6172-4294-bf49-9a3d1d066b59 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:29.778914 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b220baab-6172-4294-bf49-9a3d1d066b59 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:29.779788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b220baab-6172-4294-bf49-9a3d1d066b59 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:29.780395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b220baab-6172-4294-bf49-9a3d1d066b59 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:29.780994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b220baab-6172-4294-bf49-9a3d1d066b59 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:30.839729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b220baab-6172-4294-bf49-9a3d1d066b59 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:30.850001 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b220baab-6172-4294-bf49-9a3d1d066b59 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1723 microversion: 2.1 time: 1.083825 Oct 29 03:08:30.851977 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2243/4302] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:29 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1723 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:30.858764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bccefd82-c428-49ab-813f-3636dd489786 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:30.859679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bccefd82-c428-49ab-813f-3636dd489786 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:30.866696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bccefd82-c428-49ab-813f-3636dd489786 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:30.867557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bccefd82-c428-49ab-813f-3636dd489786 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:30.868184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bccefd82-c428-49ab-813f-3636dd489786 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:30.869208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bccefd82-c428-49ab-813f-3636dd489786 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:30.869992 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bccefd82-c428-49ab-813f-3636dd489786 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:30.870639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bccefd82-c428-49ab-813f-3636dd489786 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:31.105365 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-b97f8f34-5e33-4922-b80f-075a84c96b6e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:08:31.105914 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-b97f8f34-5e33-4922-b80f-075a84c96b6e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:08:31.106934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-b97f8f34-5e33-4922-b80f-075a84c96b6e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:08:31.107410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-b97f8f34-5e33-4922-b80f-075a84c96b6e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:08:31.108008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-b97f8f34-5e33-4922-b80f-075a84c96b6e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:08:31.126119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b97f8f34-5e33-4922-b80f-075a84c96b6e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:31.127010 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b97f8f34-5e33-4922-b80f-075a84c96b6e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:31.127673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b97f8f34-5e33-4922-b80f-075a84c96b6e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:31.128735 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b97f8f34-5e33-4922-b80f-075a84c96b6e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:31.129402 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b97f8f34-5e33-4922-b80f-075a84c96b6e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:31.130886 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b97f8f34-5e33-4922-b80f-075a84c96b6e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:31.172147 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-b97f8f34-5e33-4922-b80f-075a84c96b6e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Getting quotas for project 1d97a655408746baabe76d9c8b0e3d64. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:08:31.181356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-b97f8f34-5e33-4922-b80f-075a84c96b6e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Getting quotas for user 06be3266f5774dc0acea36973521a5e5 and project 1d97a655408746baabe76d9c8b0e3d64. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:08:31.203431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b97f8f34-5e33-4922-b80f-075a84c96b6e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:08:31.207396 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b97f8f34-5e33-4922-b80f-075a84c96b6e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:08:31.290534 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bccefd82-c428-49ab-813f-3636dd489786 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:31.299616 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bccefd82-c428-49ab-813f-3636dd489786 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1473 microversion: 2.1 time: 0.445634 Oct 29 03:08:31.307282 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2244/4303] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:30 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1473 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:31.312388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dac98581-6248-476c-b252-126512eb8337 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:31.325462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dac98581-6248-476c-b252-126512eb8337 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:31.337998 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b97f8f34-5e33-4922-b80f-075a84c96b6e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.032855 Oct 29 03:08:31.339569 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2060/4304] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:08:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 2040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:08:31.341130 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dac98581-6248-476c-b252-126512eb8337 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:31.341638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dac98581-6248-476c-b252-126512eb8337 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:31.342071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dac98581-6248-476c-b252-126512eb8337 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:31.348024 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dac98581-6248-476c-b252-126512eb8337 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:31.348743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dac98581-6248-476c-b252-126512eb8337 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:31.349345 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dac98581-6248-476c-b252-126512eb8337 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:31.357267 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ef774c4c-ba1f-4f30-a74a-e75471759a61 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:31.358299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ef774c4c-ba1f-4f30-a74a-e75471759a61 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: ba75665d-3656-45c2-8bd8-f6dc6a66c851] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:31.367580 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef774c4c-ba1f-4f30-a74a-e75471759a61 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:31.369136 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef774c4c-ba1f-4f30-a74a-e75471759a61 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:31.369849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef774c4c-ba1f-4f30-a74a-e75471759a61 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:31.372381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef774c4c-ba1f-4f30-a74a-e75471759a61 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:31.373214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef774c4c-ba1f-4f30-a74a-e75471759a61 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:31.374730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef774c4c-ba1f-4f30-a74a-e75471759a61 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:31.615725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dac98581-6248-476c-b252-126512eb8337 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:31.629022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dac98581-6248-476c-b252-126512eb8337 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:31.631603 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dac98581-6248-476c-b252-126512eb8337 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:31.633070 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dac98581-6248-476c-b252-126512eb8337 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1365 microversion: 2.47 time: 0.324569 Oct 29 03:08:31.639584 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2245/4305] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:31 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1365 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:08:31.650472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-0edff154-f8c5-411c-b749-d9117dde4946 req-976073a6-4ca0-4c54-9f8d-e56bf9a1e6b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c25c557-35b6-4dce-99f0-4e2b1c43cf40", "tag": "544bbd3a-133a-48fc-85fa-eb236d549271"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:31.665967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:31.681332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-0edff154-f8c5-411c-b749-d9117dde4946 req-976073a6-4ca0-4c54-9f8d-e56bf9a1e6b2 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:31.682334 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-0edff154-f8c5-411c-b749-d9117dde4946 req-976073a6-4ca0-4c54-9f8d-e56bf9a1e6b2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:31.682933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-0edff154-f8c5-411c-b749-d9117dde4946 req-976073a6-4ca0-4c54-9f8d-e56bf9a1e6b2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:31.700433 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ef774c4c-ba1f-4f30-a74a-e75471759a61 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:31.710277 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-0edff154-f8c5-411c-b749-d9117dde4946 req-976073a6-4ca0-4c54-9f8d-e56bf9a1e6b2 service nova] Creating event network-changed:544bbd3a-133a-48fc-85fa-eb236d549271 for instance 3c25c557-35b6-4dce-99f0-4e2b1c43cf40 on n-h2-862967-2 Oct 29 03:08:31.721950 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ef774c4c-ba1f-4f30-a74a-e75471759a61 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851" status: 200 len: 1322 microversion: 2.1 time: 0.376487 Oct 29 03:08:31.724165 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2061/4306] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:31 2022] GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851 => generated 1322 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:31.726301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [req-0edff154-f8c5-411c-b749-d9117dde4946 req-976073a6-4ca0-4c54-9f8d-e56bf9a1e6b2 service nova] Instance 3c25c557-35b6-4dce-99f0-4e2b1c43cf40 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:08:31.732485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2d104b7e-f0c1-4933-b725-d5394711ee87 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:31.736156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2d104b7e-f0c1-4933-b725-d5394711ee87 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:31.754548 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-0edff154-f8c5-411c-b749-d9117dde4946 req-976073a6-4ca0-4c54-9f8d-e56bf9a1e6b2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112211 Oct 29 03:08:31.755752 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2246/4307] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:31.870836 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2d104b7e-f0c1-4933-b725-d5394711ee87 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:31.879956 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e8d765b3-b049-4ab4-ba2e-a6d358ab4c74 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:31.881288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e8d765b3-b049-4ab4-ba2e-a6d358ab4c74 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:31.886013 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2d104b7e-f0c1-4933-b725-d5394711ee87 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94" status: 200 len: 1222 microversion: 2.1 time: 0.159058 Oct 29 03:08:31.900561 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2062/4308] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:31 2022] GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 => generated 1222 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:31.944166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8d765b3-b049-4ab4-ba2e-a6d358ab4c74 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:31.944869 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8d765b3-b049-4ab4-ba2e-a6d358ab4c74 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:31.945332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8d765b3-b049-4ab4-ba2e-a6d358ab4c74 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:31.946093 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8d765b3-b049-4ab4-ba2e-a6d358ab4c74 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:31.946555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8d765b3-b049-4ab4-ba2e-a6d358ab4c74 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:31.959043 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8d765b3-b049-4ab4-ba2e-a6d358ab4c74 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:32.015967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3122f7b5-22e1-423a-905b-c705f6dbde32 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1352801566", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:32.119727 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-3122f7b5-22e1-423a-905b-c705f6dbde32 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] validate_networks() for [('1f6f70fe-4dc4-4a72-9da8-235db3cfa873', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:08:32.909192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e8d765b3-b049-4ab4-ba2e-a6d358ab4c74 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:32.920904 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e8d765b3-b049-4ab4-ba2e-a6d358ab4c74 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1723 microversion: 2.1 time: 1.045121 Oct 29 03:08:32.921869 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2247/4309] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:31 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1723 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:32.948426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ad1ba7b8-10b8-4fd8-9d90-00641c957c23 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:32.950820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ad1ba7b8-10b8-4fd8-9d90-00641c957c23 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:32.965010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad1ba7b8-10b8-4fd8-9d90-00641c957c23 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:32.965510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad1ba7b8-10b8-4fd8-9d90-00641c957c23 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:32.969450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad1ba7b8-10b8-4fd8-9d90-00641c957c23 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:32.970401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad1ba7b8-10b8-4fd8-9d90-00641c957c23 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:32.973213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad1ba7b8-10b8-4fd8-9d90-00641c957c23 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:32.973802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad1ba7b8-10b8-4fd8-9d90-00641c957c23 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:33.560766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ad1ba7b8-10b8-4fd8-9d90-00641c957c23 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:33.574240 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ad1ba7b8-10b8-4fd8-9d90-00641c957c23 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1471 microversion: 2.1 time: 0.650634 Oct 29 03:08:33.574840 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2248/4310] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:32 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1471 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:33.588818 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a70bbd5a-6a23-4e1c-bf09-399b94638661 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:33.589712 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a70bbd5a-6a23-4e1c-bf09-399b94638661 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:33.606523 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a70bbd5a-6a23-4e1c-bf09-399b94638661 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:33.607019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a70bbd5a-6a23-4e1c-bf09-399b94638661 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:33.607457 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a70bbd5a-6a23-4e1c-bf09-399b94638661 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:33.608191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a70bbd5a-6a23-4e1c-bf09-399b94638661 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:33.608669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a70bbd5a-6a23-4e1c-bf09-399b94638661 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:33.609107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a70bbd5a-6a23-4e1c-bf09-399b94638661 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:33.800846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a70bbd5a-6a23-4e1c-bf09-399b94638661 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:33.819088 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a70bbd5a-6a23-4e1c-bf09-399b94638661 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:33.822563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a70bbd5a-6a23-4e1c-bf09-399b94638661 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:33.824157 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a70bbd5a-6a23-4e1c-bf09-399b94638661 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1365 microversion: 2.47 time: 0.248196 Oct 29 03:08:33.826647 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2249/4311] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:33 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:08:33.835230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-95f1c45b-06e7-4080-9554-dbbe04180800 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:33.836718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-95f1c45b-06e7-4080-9554-dbbe04180800 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: ba75665d-3656-45c2-8bd8-f6dc6a66c851] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:33.847319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95f1c45b-06e7-4080-9554-dbbe04180800 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:33.849219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95f1c45b-06e7-4080-9554-dbbe04180800 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:33.849883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95f1c45b-06e7-4080-9554-dbbe04180800 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:33.852105 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95f1c45b-06e7-4080-9554-dbbe04180800 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:33.852825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95f1c45b-06e7-4080-9554-dbbe04180800 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:33.853603 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95f1c45b-06e7-4080-9554-dbbe04180800 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:34.292834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-3122f7b5-22e1-423a-905b-c705f6dbde32 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:08:34.293401 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-3122f7b5-22e1-423a-905b-c705f6dbde32 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:08:34.293934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-3122f7b5-22e1-423a-905b-c705f6dbde32 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:08:34.294634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-3122f7b5-22e1-423a-905b-c705f6dbde32 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:08:34.295143 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-3122f7b5-22e1-423a-905b-c705f6dbde32 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:08:34.304851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3122f7b5-22e1-423a-905b-c705f6dbde32 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:34.305526 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3122f7b5-22e1-423a-905b-c705f6dbde32 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:34.306207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3122f7b5-22e1-423a-905b-c705f6dbde32 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:34.307169 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3122f7b5-22e1-423a-905b-c705f6dbde32 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:34.307912 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3122f7b5-22e1-423a-905b-c705f6dbde32 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:34.308767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3122f7b5-22e1-423a-905b-c705f6dbde32 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:34.331588 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-3122f7b5-22e1-423a-905b-c705f6dbde32 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Getting quotas for project 1d97a655408746baabe76d9c8b0e3d64. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:08:34.339266 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-3122f7b5-22e1-423a-905b-c705f6dbde32 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Getting quotas for user 06be3266f5774dc0acea36973521a5e5 and project 1d97a655408746baabe76d9c8b0e3d64. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:08:34.362279 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3122f7b5-22e1-423a-905b-c705f6dbde32 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:08:34.365587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3122f7b5-22e1-423a-905b-c705f6dbde32 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:08:34.488316 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3122f7b5-22e1-423a-905b-c705f6dbde32 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.479183 Oct 29 03:08:34.489416 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2063/4312] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:08:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 2481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 03:08:34.494326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-c15f354d-3b5f-4dc9-8cfa-e6dc1ce5d3f6 req-020d20fe-4fe2-4a12-945c-0bf050282776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba75665d-3656-45c2-8bd8-f6dc6a66c851", "name": "network-vif-plugged", "status": "completed", "tag": "e6d17c69-1713-4142-ba71-2fb8e8f5c28c"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:34.558761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c15f354d-3b5f-4dc9-8cfa-e6dc1ce5d3f6 req-020d20fe-4fe2-4a12-945c-0bf050282776 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:34.562369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c15f354d-3b5f-4dc9-8cfa-e6dc1ce5d3f6 req-020d20fe-4fe2-4a12-945c-0bf050282776 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:34.564921 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c15f354d-3b5f-4dc9-8cfa-e6dc1ce5d3f6 req-020d20fe-4fe2-4a12-945c-0bf050282776 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:34.598132 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-c15f354d-3b5f-4dc9-8cfa-e6dc1ce5d3f6 req-020d20fe-4fe2-4a12-945c-0bf050282776 service nova] Creating event network-vif-plugged:e6d17c69-1713-4142-ba71-2fb8e8f5c28c for instance ba75665d-3656-45c2-8bd8-f6dc6a66c851 on n-h2-862967-2 Oct 29 03:08:34.614388 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-c15f354d-3b5f-4dc9-8cfa-e6dc1ce5d3f6 req-020d20fe-4fe2-4a12-945c-0bf050282776 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123439 Oct 29 03:08:34.615035 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2064/4313] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:34.623254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6c8487de-7de9-4873-9fcf-1bff3e34343a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:34.624211 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6c8487de-7de9-4873-9fcf-1bff3e34343a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:34.643348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c8487de-7de9-4873-9fcf-1bff3e34343a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:34.646780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c8487de-7de9-4873-9fcf-1bff3e34343a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:34.647198 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c8487de-7de9-4873-9fcf-1bff3e34343a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:34.648363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c8487de-7de9-4873-9fcf-1bff3e34343a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:34.648931 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c8487de-7de9-4873-9fcf-1bff3e34343a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:34.649308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c8487de-7de9-4873-9fcf-1bff3e34343a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:34.709401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-95f1c45b-06e7-4080-9554-dbbe04180800 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:34.722459 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-95f1c45b-06e7-4080-9554-dbbe04180800 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851" status: 200 len: 1322 microversion: 2.1 time: 0.891206 Oct 29 03:08:34.724109 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2250/4314] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:33 2022] GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851 => generated 1322 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:34.739806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9171e097-efa2-4ccc-b038-d22df4d9eae4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:34.740847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9171e097-efa2-4ccc-b038-d22df4d9eae4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:34.938551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9171e097-efa2-4ccc-b038-d22df4d9eae4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:34.980794 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9171e097-efa2-4ccc-b038-d22df4d9eae4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1222 microversion: 2.1 time: 0.248917 Oct 29 03:08:34.984900 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2251/4315] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:34 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1222 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:35.010544 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-82b44270-63f5-4667-afc4-e0b1c809f3b2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:35.012913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-82b44270-63f5-4667-afc4-e0b1c809f3b2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:35.056755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82b44270-63f5-4667-afc4-e0b1c809f3b2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:35.067837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82b44270-63f5-4667-afc4-e0b1c809f3b2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:35.068357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82b44270-63f5-4667-afc4-e0b1c809f3b2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:35.069409 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82b44270-63f5-4667-afc4-e0b1c809f3b2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:35.069890 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82b44270-63f5-4667-afc4-e0b1c809f3b2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:35.081048 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82b44270-63f5-4667-afc4-e0b1c809f3b2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:35.111270 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6c8487de-7de9-4873-9fcf-1bff3e34343a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:35.130866 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6c8487de-7de9-4873-9fcf-1bff3e34343a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1723 microversion: 2.1 time: 0.512952 Oct 29 03:08:35.133763 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2065/4316] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:34 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1723 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:35.142793 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ad49c75b-ebc3-4e3d-9cff-574b1c906f6e tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:35.151063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ad49c75b-ebc3-4e3d-9cff-574b1c906f6e tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:35.164498 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad49c75b-ebc3-4e3d-9cff-574b1c906f6e tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:35.177662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad49c75b-ebc3-4e3d-9cff-574b1c906f6e tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:35.178858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad49c75b-ebc3-4e3d-9cff-574b1c906f6e tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:35.180048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad49c75b-ebc3-4e3d-9cff-574b1c906f6e tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:35.180852 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad49c75b-ebc3-4e3d-9cff-574b1c906f6e tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:35.181582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad49c75b-ebc3-4e3d-9cff-574b1c906f6e tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:35.367663 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ad49c75b-ebc3-4e3d-9cff-574b1c906f6e tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:35.385989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ad49c75b-ebc3-4e3d-9cff-574b1c906f6e tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:35.393190 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ad49c75b-ebc3-4e3d-9cff-574b1c906f6e tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:35.398844 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ad49c75b-ebc3-4e3d-9cff-574b1c906f6e tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1365 microversion: 2.47 time: 0.263040 Oct 29 03:08:35.402452 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2066/4317] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:35 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:08:35.713319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-82b44270-63f5-4667-afc4-e0b1c809f3b2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:35.725155 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-82b44270-63f5-4667-afc4-e0b1c809f3b2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1468 microversion: 2.1 time: 0.736835 Oct 29 03:08:35.727130 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2252/4318] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:34 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1468 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:35.750288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cf6308c3-75ad-4800-9fae-809c95dc8014 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:35.751084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cf6308c3-75ad-4800-9fae-809c95dc8014 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:35.761412 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-23a7ff16-557a-4a13-a177-af53b3a80021 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:35.765752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf6308c3-75ad-4800-9fae-809c95dc8014 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:35.766566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf6308c3-75ad-4800-9fae-809c95dc8014 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:35.767158 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf6308c3-75ad-4800-9fae-809c95dc8014 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:35.768653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf6308c3-75ad-4800-9fae-809c95dc8014 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:35.769673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf6308c3-75ad-4800-9fae-809c95dc8014 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:35.771945 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf6308c3-75ad-4800-9fae-809c95dc8014 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:35.772730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-23a7ff16-557a-4a13-a177-af53b3a80021 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: ba75665d-3656-45c2-8bd8-f6dc6a66c851] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:35.788838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23a7ff16-557a-4a13-a177-af53b3a80021 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:35.792870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23a7ff16-557a-4a13-a177-af53b3a80021 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:35.793600 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23a7ff16-557a-4a13-a177-af53b3a80021 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:35.794514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23a7ff16-557a-4a13-a177-af53b3a80021 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:35.797165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23a7ff16-557a-4a13-a177-af53b3a80021 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:35.805449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23a7ff16-557a-4a13-a177-af53b3a80021 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:36.055345 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cf6308c3-75ad-4800-9fae-809c95dc8014 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "POST /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40/action" status: 202 len: 0 microversion: 2.1 time: 0.308174 Oct 29 03:08:36.059926 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2067/4319] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:08:35 2022] POST /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:08:36.073204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-10e7ebd7-60d9-4fa0-b1d7-09ca4bf7be4d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:36.074958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-10e7ebd7-60d9-4fa0-b1d7-09ca4bf7be4d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:36.089301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-10e7ebd7-60d9-4fa0-b1d7-09ca4bf7be4d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:36.090006 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-10e7ebd7-60d9-4fa0-b1d7-09ca4bf7be4d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:36.092057 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-10e7ebd7-60d9-4fa0-b1d7-09ca4bf7be4d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:36.092057 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-10e7ebd7-60d9-4fa0-b1d7-09ca4bf7be4d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:36.092390 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-10e7ebd7-60d9-4fa0-b1d7-09ca4bf7be4d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:36.092745 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-10e7ebd7-60d9-4fa0-b1d7-09ca4bf7be4d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:36.212339 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-10e7ebd7-60d9-4fa0-b1d7-09ca4bf7be4d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:36.222952 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-10e7ebd7-60d9-4fa0-b1d7-09ca4bf7be4d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1274 microversion: 2.1 time: 0.160510 Oct 29 03:08:36.223788 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2068/4320] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:36 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1274 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:36.231478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-23a7ff16-557a-4a13-a177-af53b3a80021 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:36.235972 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0f93ed44-094b-422c-9218-5c3e35f5bd02 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:36.236863 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0f93ed44-094b-422c-9218-5c3e35f5bd02 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:36.246148 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-23a7ff16-557a-4a13-a177-af53b3a80021 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851" status: 200 len: 1322 microversion: 2.1 time: 0.488978 Oct 29 03:08:36.247025 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2253/4321] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:35 2022] GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851 => generated 1322 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:36.255701 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f93ed44-094b-422c-9218-5c3e35f5bd02 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:36.256441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f93ed44-094b-422c-9218-5c3e35f5bd02 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:36.257088 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f93ed44-094b-422c-9218-5c3e35f5bd02 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:36.257730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5b51ff9e-283e-401a-8336-2c5fba04736a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:36.258161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f93ed44-094b-422c-9218-5c3e35f5bd02 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:36.258448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5b51ff9e-283e-401a-8336-2c5fba04736a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:36.258970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f93ed44-094b-422c-9218-5c3e35f5bd02 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:36.259898 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f93ed44-094b-422c-9218-5c3e35f5bd02 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:36.268746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b51ff9e-283e-401a-8336-2c5fba04736a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:36.269252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b51ff9e-283e-401a-8336-2c5fba04736a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:36.269703 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b51ff9e-283e-401a-8336-2c5fba04736a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:36.272632 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b51ff9e-283e-401a-8336-2c5fba04736a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:36.273107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b51ff9e-283e-401a-8336-2c5fba04736a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:36.273543 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b51ff9e-283e-401a-8336-2c5fba04736a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:36.658675 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0f93ed44-094b-422c-9218-5c3e35f5bd02 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:36.672204 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0f93ed44-094b-422c-9218-5c3e35f5bd02 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1467 microversion: 2.1 time: 0.446889 Oct 29 03:08:36.672837 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2069/4322] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:36 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1467 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:36.681670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b1944745-209b-4085-ab1a-aa60ba0c2fb5 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:36.682353 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b1944745-209b-4085-ab1a-aa60ba0c2fb5 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:36.702009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1944745-209b-4085-ab1a-aa60ba0c2fb5 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:36.702256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1944745-209b-4085-ab1a-aa60ba0c2fb5 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:36.702699 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1944745-209b-4085-ab1a-aa60ba0c2fb5 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:36.703685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1944745-209b-4085-ab1a-aa60ba0c2fb5 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:36.703864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1944745-209b-4085-ab1a-aa60ba0c2fb5 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:36.704294 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1944745-209b-4085-ab1a-aa60ba0c2fb5 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:36.843629 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5b51ff9e-283e-401a-8336-2c5fba04736a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:36.877793 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b1944745-209b-4085-ab1a-aa60ba0c2fb5 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:36.889840 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5b51ff9e-283e-401a-8336-2c5fba04736a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1723 microversion: 2.1 time: 0.639827 Oct 29 03:08:36.892973 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2254/4323] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:36 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1723 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:36.961290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-6bab49d4-b4ae-446e-a525-02b78bcb8b0a req-62d976b8-cf7c-4ec8-8f6d-994f0efb6a46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79b80ca1-484d-4fd4-9002-ef3626fd858b", "name": "network-vif-plugged", "status": "completed", "tag": "1af16bf9-f26a-4d1e-9af2-fadf898c15ff"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:36.965222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b1944745-209b-4085-ab1a-aa60ba0c2fb5 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:36.985577 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b1944745-209b-4085-ab1a-aa60ba0c2fb5 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:36.986986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-6bab49d4-b4ae-446e-a525-02b78bcb8b0a req-62d976b8-cf7c-4ec8-8f6d-994f0efb6a46 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:36.990420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-6bab49d4-b4ae-446e-a525-02b78bcb8b0a req-62d976b8-cf7c-4ec8-8f6d-994f0efb6a46 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:36.991077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-6bab49d4-b4ae-446e-a525-02b78bcb8b0a req-62d976b8-cf7c-4ec8-8f6d-994f0efb6a46 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:37.008849 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b1944745-209b-4085-ab1a-aa60ba0c2fb5 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1365 microversion: 2.47 time: 0.334858 Oct 29 03:08:37.009737 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-6bab49d4-b4ae-446e-a525-02b78bcb8b0a req-62d976b8-cf7c-4ec8-8f6d-994f0efb6a46 service nova] Creating event network-vif-plugged:1af16bf9-f26a-4d1e-9af2-fadf898c15ff for instance 79b80ca1-484d-4fd4-9002-ef3626fd858b on n-h1-862967-2 Oct 29 03:08:37.021132 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2070/4324] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:36 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1365 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:08:37.042286 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-6bab49d4-b4ae-446e-a525-02b78bcb8b0a req-62d976b8-cf7c-4ec8-8f6d-994f0efb6a46 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145263 Oct 29 03:08:37.042950 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2255/4325] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:37.251394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2b10e94b-ffff-4714-aa35-44534c70adf9 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:37.252792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2b10e94b-ffff-4714-aa35-44534c70adf9 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:37.263973 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b10e94b-ffff-4714-aa35-44534c70adf9 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:37.265521 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b10e94b-ffff-4714-aa35-44534c70adf9 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:37.266364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b10e94b-ffff-4714-aa35-44534c70adf9 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:37.273710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b10e94b-ffff-4714-aa35-44534c70adf9 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:37.274814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f43b3270-e1d6-42c6-ade8-5354d0b6c913 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:37.275466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b10e94b-ffff-4714-aa35-44534c70adf9 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:37.275613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f43b3270-e1d6-42c6-ade8-5354d0b6c913 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: ba75665d-3656-45c2-8bd8-f6dc6a66c851] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:37.276753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b10e94b-ffff-4714-aa35-44534c70adf9 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:37.297855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f43b3270-e1d6-42c6-ade8-5354d0b6c913 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:37.298374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f43b3270-e1d6-42c6-ade8-5354d0b6c913 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:37.298971 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f43b3270-e1d6-42c6-ade8-5354d0b6c913 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:37.300885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f43b3270-e1d6-42c6-ade8-5354d0b6c913 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:37.301352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f43b3270-e1d6-42c6-ade8-5354d0b6c913 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:37.301996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f43b3270-e1d6-42c6-ade8-5354d0b6c913 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:37.308912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=100 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:37.765537 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2b10e94b-ffff-4714-aa35-44534c70adf9 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:37.777763 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2b10e94b-ffff-4714-aa35-44534c70adf9 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1274 microversion: 2.1 time: 0.531548 Oct 29 03:08:37.795071 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2071/4326] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:37 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1274 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:37.813807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cab8452a-8057-4139-9d08-53a573826d2f tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:37.814479 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cab8452a-8057-4139-9d08-53a573826d2f tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:37.823202 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cab8452a-8057-4139-9d08-53a573826d2f tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:37.823700 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cab8452a-8057-4139-9d08-53a573826d2f tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:37.824828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cab8452a-8057-4139-9d08-53a573826d2f tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:37.826771 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cab8452a-8057-4139-9d08-53a573826d2f tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:37.828761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cab8452a-8057-4139-9d08-53a573826d2f tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:37.829239 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cab8452a-8057-4139-9d08-53a573826d2f tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:38.211753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cab8452a-8057-4139-9d08-53a573826d2f tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:38.229340 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cab8452a-8057-4139-9d08-53a573826d2f tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1467 microversion: 2.1 time: 0.431849 Oct 29 03:08:38.229935 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2072/4327] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:37 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1467 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:38.234703 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-209dd676-e1c8-4c71-9474-f689b3e5e683 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:38.235529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-209dd676-e1c8-4c71-9474-f689b3e5e683 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:38.236127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f43b3270-e1d6-42c6-ade8-5354d0b6c913 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:38.251593 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f43b3270-e1d6-42c6-ade8-5354d0b6c913 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851" status: 200 len: 1516 microversion: 2.1 time: 0.981896 Oct 29 03:08:38.253354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-209dd676-e1c8-4c71-9474-f689b3e5e683 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:38.253847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-209dd676-e1c8-4c71-9474-f689b3e5e683 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:38.254275 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-209dd676-e1c8-4c71-9474-f689b3e5e683 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:38.255034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-209dd676-e1c8-4c71-9474-f689b3e5e683 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:38.255416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-209dd676-e1c8-4c71-9474-f689b3e5e683 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:38.255932 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-209dd676-e1c8-4c71-9474-f689b3e5e683 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:38.264744 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2256/4328] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:37 2022] GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851 => generated 1516 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:08:38.275977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-72bd0e09-ff21-4dec-9c67-b7648cd18ba3 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:38.276911 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-72bd0e09-ff21-4dec-9c67-b7648cd18ba3 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:38.284879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72bd0e09-ff21-4dec-9c67-b7648cd18ba3 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:38.285662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72bd0e09-ff21-4dec-9c67-b7648cd18ba3 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:38.286284 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72bd0e09-ff21-4dec-9c67-b7648cd18ba3 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:38.287165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72bd0e09-ff21-4dec-9c67-b7648cd18ba3 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:38.287976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72bd0e09-ff21-4dec-9c67-b7648cd18ba3 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:38.288577 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72bd0e09-ff21-4dec-9c67-b7648cd18ba3 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:38.458693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-72bd0e09-ff21-4dec-9c67-b7648cd18ba3 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:38.474183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-72bd0e09-ff21-4dec-9c67-b7648cd18ba3 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:38.475657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-72bd0e09-ff21-4dec-9c67-b7648cd18ba3 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:38.477125 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-72bd0e09-ff21-4dec-9c67-b7648cd18ba3 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1365 microversion: 2.47 time: 0.211249 Oct 29 03:08:38.477876 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2257/4329] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:38 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:08:38.497166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-88a46daa-0404-4f8d-bb16-28d31394e681 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:38.499607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-88a46daa-0404-4f8d-bb16-28d31394e681 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: 3c597067-efff-40a4-b890-1c6e7a69e96e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:38.506902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88a46daa-0404-4f8d-bb16-28d31394e681 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:38.507402 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88a46daa-0404-4f8d-bb16-28d31394e681 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:38.507882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88a46daa-0404-4f8d-bb16-28d31394e681 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:38.508623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88a46daa-0404-4f8d-bb16-28d31394e681 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:38.521329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88a46daa-0404-4f8d-bb16-28d31394e681 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:38.522099 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88a46daa-0404-4f8d-bb16-28d31394e681 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:38.774896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-209dd676-e1c8-4c71-9474-f689b3e5e683 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:38.778893 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:38.799349 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-209dd676-e1c8-4c71-9474-f689b3e5e683 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1723 microversion: 2.1 time: 0.567698 Oct 29 03:08:38.817242 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2073/4330] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:38 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1723 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:38.839282 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-57aed8f4-bb0b-4067-8f78-1661da528d2a tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:38.840779 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-57aed8f4-bb0b-4067-8f78-1661da528d2a tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:38.851359 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57aed8f4-bb0b-4067-8f78-1661da528d2a tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:38.852612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57aed8f4-bb0b-4067-8f78-1661da528d2a tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:38.853585 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57aed8f4-bb0b-4067-8f78-1661da528d2a tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:38.854954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57aed8f4-bb0b-4067-8f78-1661da528d2a tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:38.855749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57aed8f4-bb0b-4067-8f78-1661da528d2a tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:38.856739 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57aed8f4-bb0b-4067-8f78-1661da528d2a tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:39.072840 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-57aed8f4-bb0b-4067-8f78-1661da528d2a tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:39.092628 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-57aed8f4-bb0b-4067-8f78-1661da528d2a tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1280 microversion: 2.1 time: 0.273298 Oct 29 03:08:39.093256 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2074/4331] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:38 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1280 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:39.097961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-c2efc49d-f3f4-4e31-abae-74527c859bf6 req-a91b5e53-c010-4bb6-bf42-17f9b339b999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c25c557-35b6-4dce-99f0-4e2b1c43cf40", "name": "network-vif-plugged", "status": "completed", "tag": "544bbd3a-133a-48fc-85fa-eb236d549271"}, {"server_uuid": "3c597067-efff-40a4-b890-1c6e7a69e96e", "name": "network-vif-plugged", "status": "completed", "tag": "3effa6d0-a0dd-42b8-9a4e-4274badc6551"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:39.117659 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c2efc49d-f3f4-4e31-abae-74527c859bf6 req-a91b5e53-c010-4bb6-bf42-17f9b339b999 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:39.118170 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c2efc49d-f3f4-4e31-abae-74527c859bf6 req-a91b5e53-c010-4bb6-bf42-17f9b339b999 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:39.118622 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c2efc49d-f3f4-4e31-abae-74527c859bf6 req-a91b5e53-c010-4bb6-bf42-17f9b339b999 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:39.122329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-88a46daa-0404-4f8d-bb16-28d31394e681 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:39.137227 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-88a46daa-0404-4f8d-bb16-28d31394e681 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers/3c597067-efff-40a4-b890-1c6e7a69e96e" status: 200 len: 1322 microversion: 2.1 time: 0.656200 Oct 29 03:08:39.139570 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2258/4332] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:38 2022] GET /compute/v2.1/servers/3c597067-efff-40a4-b890-1c6e7a69e96e => generated 1322 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:39.143906 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-c2efc49d-f3f4-4e31-abae-74527c859bf6 req-a91b5e53-c010-4bb6-bf42-17f9b339b999 service nova] Creating event network-vif-plugged:544bbd3a-133a-48fc-85fa-eb236d549271 for instance 3c25c557-35b6-4dce-99f0-4e2b1c43cf40 on n-h2-862967-2 Oct 29 03:08:39.144414 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-c2efc49d-f3f4-4e31-abae-74527c859bf6 req-a91b5e53-c010-4bb6-bf42-17f9b339b999 service nova] Creating event network-vif-plugged:3effa6d0-a0dd-42b8-9a4e-4274badc6551 for instance 3c597067-efff-40a4-b890-1c6e7a69e96e on n-h1-862967-2 Oct 29 03:08:39.150499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [req-c2efc49d-f3f4-4e31-abae-74527c859bf6 req-a91b5e53-c010-4bb6-bf42-17f9b339b999 service nova] Instance 3c25c557-35b6-4dce-99f0-4e2b1c43cf40 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:08:39.163836 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-c2efc49d-f3f4-4e31-abae-74527c859bf6 req-a91b5e53-c010-4bb6-bf42-17f9b339b999 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.069315 Oct 29 03:08:39.165179 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2075/4333] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:39.228651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-dc2f4cb5-e2ea-4825-aa70-7de464d98789 req-e355fbd3-d039-4eb4-aec0-d6f426737871 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab5ee183-e4bd-4de0-bb66-cda1ce9ead94", "tag": "c010f3e0-ed80-4c2d-8830-85d67ad0153a"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:39.256386 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-01f78cae-197f-4444-882f-3eafbac6fd35 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:39.260256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-01f78cae-197f-4444-882f-3eafbac6fd35 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:39.273057 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-dc2f4cb5-e2ea-4825-aa70-7de464d98789 req-e355fbd3-d039-4eb4-aec0-d6f426737871 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:39.273620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-dc2f4cb5-e2ea-4825-aa70-7de464d98789 req-e355fbd3-d039-4eb4-aec0-d6f426737871 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:39.274038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-dc2f4cb5-e2ea-4825-aa70-7de464d98789 req-e355fbd3-d039-4eb4-aec0-d6f426737871 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:39.282822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01f78cae-197f-4444-882f-3eafbac6fd35 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:39.283537 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01f78cae-197f-4444-882f-3eafbac6fd35 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:39.284327 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01f78cae-197f-4444-882f-3eafbac6fd35 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:39.285487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01f78cae-197f-4444-882f-3eafbac6fd35 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:39.286710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01f78cae-197f-4444-882f-3eafbac6fd35 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:39.287152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01f78cae-197f-4444-882f-3eafbac6fd35 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:39.327490 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-dc2f4cb5-e2ea-4825-aa70-7de464d98789 req-e355fbd3-d039-4eb4-aec0-d6f426737871 service nova] Creating event network-changed:c010f3e0-ed80-4c2d-8830-85d67ad0153a for instance ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 on n-h1-862967-2 Oct 29 03:08:39.338603 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-dc2f4cb5-e2ea-4825-aa70-7de464d98789 req-e355fbd3-d039-4eb4-aec0-d6f426737871 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115848 Oct 29 03:08:39.344264 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2259/4334] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:39.505349 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-04505b8d-2ce5-441d-bf7f-0ac3ea36a3dc tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:39.506076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-04505b8d-2ce5-441d-bf7f-0ac3ea36a3dc tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:39.513671 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-04505b8d-2ce5-441d-bf7f-0ac3ea36a3dc tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:39.514430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-04505b8d-2ce5-441d-bf7f-0ac3ea36a3dc tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:39.515053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-04505b8d-2ce5-441d-bf7f-0ac3ea36a3dc tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:39.515942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-04505b8d-2ce5-441d-bf7f-0ac3ea36a3dc tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:39.516586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-04505b8d-2ce5-441d-bf7f-0ac3ea36a3dc tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:39.517178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-04505b8d-2ce5-441d-bf7f-0ac3ea36a3dc tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:39.645895 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-01f78cae-197f-4444-882f-3eafbac6fd35 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:39.648624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-04505b8d-2ce5-441d-bf7f-0ac3ea36a3dc tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:39.656892 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-01f78cae-197f-4444-882f-3eafbac6fd35 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1467 microversion: 2.1 time: 0.406243 Oct 29 03:08:39.658176 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2076/4335] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:39 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1467 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:39.663768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-04505b8d-2ce5-441d-bf7f-0ac3ea36a3dc tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:39.665265 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-04505b8d-2ce5-441d-bf7f-0ac3ea36a3dc tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:39.666545 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-04505b8d-2ce5-441d-bf7f-0ac3ea36a3dc tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1365 microversion: 2.47 time: 0.165592 Oct 29 03:08:39.667113 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2260/4336] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:39 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:08:39.839511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-986d5d17-1e9c-4fa6-9227-86989807f088 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:39.840276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-986d5d17-1e9c-4fa6-9227-86989807f088 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:39.846634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-986d5d17-1e9c-4fa6-9227-86989807f088 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:39.847407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-986d5d17-1e9c-4fa6-9227-86989807f088 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:39.848066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-986d5d17-1e9c-4fa6-9227-86989807f088 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:39.849180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-986d5d17-1e9c-4fa6-9227-86989807f088 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:39.849928 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-986d5d17-1e9c-4fa6-9227-86989807f088 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:39.850579 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-986d5d17-1e9c-4fa6-9227-86989807f088 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:40.115856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c49512b8-f10e-4bdd-8b8e-25ab0e305306 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:40.116850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c49512b8-f10e-4bdd-8b8e-25ab0e305306 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:40.127928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c49512b8-f10e-4bdd-8b8e-25ab0e305306 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:40.128723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c49512b8-f10e-4bdd-8b8e-25ab0e305306 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:40.129333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c49512b8-f10e-4bdd-8b8e-25ab0e305306 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:40.133179 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c49512b8-f10e-4bdd-8b8e-25ab0e305306 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:40.133795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c49512b8-f10e-4bdd-8b8e-25ab0e305306 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:40.134683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c49512b8-f10e-4bdd-8b8e-25ab0e305306 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:40.285453 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c49512b8-f10e-4bdd-8b8e-25ab0e305306 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:40.306802 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c49512b8-f10e-4bdd-8b8e-25ab0e305306 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1280 microversion: 2.1 time: 0.195017 Oct 29 03:08:40.309278 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2261/4337] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:40 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1280 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:08:40.339173 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0ea7cf7b-117e-4726-a0fd-74ec5b0ac0f0 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:40.356484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0ea7cf7b-117e-4726-a0fd-74ec5b0ac0f0 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: 3c597067-efff-40a4-b890-1c6e7a69e96e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:40.371523 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ea7cf7b-117e-4726-a0fd-74ec5b0ac0f0 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:40.372911 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ea7cf7b-117e-4726-a0fd-74ec5b0ac0f0 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:40.381240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ea7cf7b-117e-4726-a0fd-74ec5b0ac0f0 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:40.385229 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ea7cf7b-117e-4726-a0fd-74ec5b0ac0f0 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:40.388571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ea7cf7b-117e-4726-a0fd-74ec5b0ac0f0 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:40.389701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ea7cf7b-117e-4726-a0fd-74ec5b0ac0f0 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:40.443471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-986d5d17-1e9c-4fa6-9227-86989807f088 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:40.461798 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-986d5d17-1e9c-4fa6-9227-86989807f088 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1723 microversion: 2.1 time: 0.626324 Oct 29 03:08:40.464624 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2077/4338] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:39 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1723 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:40.687665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-673d3032-a2b9-451b-bd54-0dd172cf055b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:40.690834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-673d3032-a2b9-451b-bd54-0dd172cf055b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:40.719835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-673d3032-a2b9-451b-bd54-0dd172cf055b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:40.720616 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-673d3032-a2b9-451b-bd54-0dd172cf055b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:40.721161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-673d3032-a2b9-451b-bd54-0dd172cf055b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:40.722137 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-673d3032-a2b9-451b-bd54-0dd172cf055b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:40.722760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-673d3032-a2b9-451b-bd54-0dd172cf055b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:40.723307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-673d3032-a2b9-451b-bd54-0dd172cf055b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:40.941379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0ea7cf7b-117e-4726-a0fd-74ec5b0ac0f0 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:40.980441 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0ea7cf7b-117e-4726-a0fd-74ec5b0ac0f0 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers/3c597067-efff-40a4-b890-1c6e7a69e96e" status: 200 len: 1322 microversion: 2.1 time: 0.669167 Oct 29 03:08:40.983349 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2262/4339] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:40 2022] GET /compute/v2.1/servers/3c597067-efff-40a4-b890-1c6e7a69e96e => generated 1322 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:40.993173 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eb2ea4f4-4da7-4bf0-b3ba-6c3e05bff1c6 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:40.997971 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-eb2ea4f4-4da7-4bf0-b3ba-6c3e05bff1c6 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:41.009494 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb2ea4f4-4da7-4bf0-b3ba-6c3e05bff1c6 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:41.010004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb2ea4f4-4da7-4bf0-b3ba-6c3e05bff1c6 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:41.010510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb2ea4f4-4da7-4bf0-b3ba-6c3e05bff1c6 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:41.011257 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb2ea4f4-4da7-4bf0-b3ba-6c3e05bff1c6 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:41.011718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb2ea4f4-4da7-4bf0-b3ba-6c3e05bff1c6 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:41.012149 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb2ea4f4-4da7-4bf0-b3ba-6c3e05bff1c6 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:41.056662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-673d3032-a2b9-451b-bd54-0dd172cf055b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:41.073805 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-673d3032-a2b9-451b-bd54-0dd172cf055b tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1467 microversion: 2.1 time: 0.393532 Oct 29 03:08:41.094033 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2078/4340] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:40 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1467 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:08:41.210844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-eb2ea4f4-4da7-4bf0-b3ba-6c3e05bff1c6 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:41.228017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-eb2ea4f4-4da7-4bf0-b3ba-6c3e05bff1c6 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:41.231361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-eb2ea4f4-4da7-4bf0-b3ba-6c3e05bff1c6 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:41.234203 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eb2ea4f4-4da7-4bf0-b3ba-6c3e05bff1c6 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1365 microversion: 2.47 time: 0.248471 Oct 29 03:08:41.235916 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2263/4341] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:40 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:08:41.343284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b9056bbc-792d-4daa-a59f-eedd5cc116fa tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:41.344043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b9056bbc-792d-4daa-a59f-eedd5cc116fa tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:41.362382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9056bbc-792d-4daa-a59f-eedd5cc116fa tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:41.366354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9056bbc-792d-4daa-a59f-eedd5cc116fa tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:41.366877 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9056bbc-792d-4daa-a59f-eedd5cc116fa tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:41.369265 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9056bbc-792d-4daa-a59f-eedd5cc116fa tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:41.370392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9056bbc-792d-4daa-a59f-eedd5cc116fa tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:41.371461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9056bbc-792d-4daa-a59f-eedd5cc116fa tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:41.492084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f704d001-5033-46e1-aa22-d53b9f03f491 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:41.494216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f704d001-5033-46e1-aa22-d53b9f03f491 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:41.506755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f704d001-5033-46e1-aa22-d53b9f03f491 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:41.507672 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f704d001-5033-46e1-aa22-d53b9f03f491 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:41.508393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f704d001-5033-46e1-aa22-d53b9f03f491 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:41.509788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f704d001-5033-46e1-aa22-d53b9f03f491 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:41.511057 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f704d001-5033-46e1-aa22-d53b9f03f491 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:41.511855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f704d001-5033-46e1-aa22-d53b9f03f491 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:42.306308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f704d001-5033-46e1-aa22-d53b9f03f491 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:42.318610 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f704d001-5033-46e1-aa22-d53b9f03f491 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1723 microversion: 2.1 time: 0.833483 Oct 29 03:08:42.325402 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2264/4342] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:41 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1723 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:42.330470 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4c475fcd-d4ec-4f8d-9995-6ab05dda050f tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:42.331105 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4c475fcd-d4ec-4f8d-9995-6ab05dda050f tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: 3c597067-efff-40a4-b890-1c6e7a69e96e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:42.358599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c475fcd-d4ec-4f8d-9995-6ab05dda050f tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:42.359123 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c475fcd-d4ec-4f8d-9995-6ab05dda050f tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:42.359574 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c475fcd-d4ec-4f8d-9995-6ab05dda050f tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:42.360786 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c475fcd-d4ec-4f8d-9995-6ab05dda050f tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:42.361461 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c475fcd-d4ec-4f8d-9995-6ab05dda050f tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:42.362070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c475fcd-d4ec-4f8d-9995-6ab05dda050f tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:42.363868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b9056bbc-792d-4daa-a59f-eedd5cc116fa tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:42.388221 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b9056bbc-792d-4daa-a59f-eedd5cc116fa tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1322 microversion: 2.1 time: 1.049478 Oct 29 03:08:42.388893 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2079/4343] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:41 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1322 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:08:42.397428 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e0eea9c3-cdc6-4cbe-8fb5-5711efb13478 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:42.399673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e0eea9c3-cdc6-4cbe-8fb5-5711efb13478 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:42.425744 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0eea9c3-cdc6-4cbe-8fb5-5711efb13478 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:42.432916 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0eea9c3-cdc6-4cbe-8fb5-5711efb13478 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:42.439755 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0eea9c3-cdc6-4cbe-8fb5-5711efb13478 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:42.447811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0eea9c3-cdc6-4cbe-8fb5-5711efb13478 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:42.450457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0eea9c3-cdc6-4cbe-8fb5-5711efb13478 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:42.451099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0eea9c3-cdc6-4cbe-8fb5-5711efb13478 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:42.996249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4c475fcd-d4ec-4f8d-9995-6ab05dda050f tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:43.007225 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4c475fcd-d4ec-4f8d-9995-6ab05dda050f tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers/3c597067-efff-40a4-b890-1c6e7a69e96e" status: 200 len: 1515 microversion: 2.1 time: 0.680624 Oct 29 03:08:43.008721 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2265/4344] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:42 2022] GET /compute/v2.1/servers/3c597067-efff-40a4-b890-1c6e7a69e96e => generated 1515 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:43.014609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1d0ef7e3-340a-4425-bd5b-8561516990ef tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:43.015311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1d0ef7e3-340a-4425-bd5b-8561516990ef tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:43.021483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d0ef7e3-340a-4425-bd5b-8561516990ef tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:43.022358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d0ef7e3-340a-4425-bd5b-8561516990ef tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:43.022791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d0ef7e3-340a-4425-bd5b-8561516990ef tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:43.023656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d0ef7e3-340a-4425-bd5b-8561516990ef tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:43.024281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d0ef7e3-340a-4425-bd5b-8561516990ef tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:43.024884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d0ef7e3-340a-4425-bd5b-8561516990ef tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:43.186312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1d0ef7e3-340a-4425-bd5b-8561516990ef tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:43.198263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1d0ef7e3-340a-4425-bd5b-8561516990ef tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:43.200179 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1d0ef7e3-340a-4425-bd5b-8561516990ef tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:43.202063 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1d0ef7e3-340a-4425-bd5b-8561516990ef tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1365 microversion: 2.47 time: 0.191846 Oct 29 03:08:43.203182 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2266/4345] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:43 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:08:43.207992 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-af3d3502-168d-4c52-8309-c4c75fa8a030 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:43.208751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-af3d3502-168d-4c52-8309-c4c75fa8a030 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: 79b80ca1-484d-4fd4-9002-ef3626fd858b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:43.215360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af3d3502-168d-4c52-8309-c4c75fa8a030 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:43.215920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af3d3502-168d-4c52-8309-c4c75fa8a030 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:43.216454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af3d3502-168d-4c52-8309-c4c75fa8a030 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:43.217253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af3d3502-168d-4c52-8309-c4c75fa8a030 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:43.217931 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af3d3502-168d-4c52-8309-c4c75fa8a030 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:43.218800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af3d3502-168d-4c52-8309-c4c75fa8a030 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:43.280365 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e0eea9c3-cdc6-4cbe-8fb5-5711efb13478 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:43.288240 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e0eea9c3-cdc6-4cbe-8fb5-5711efb13478 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1467 microversion: 2.1 time: 0.898075 Oct 29 03:08:43.288853 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2080/4346] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:42 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1467 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:43.350150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d3ed169b-f8ae-4516-a25b-4e6eb3664de3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:43.351043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d3ed169b-f8ae-4516-a25b-4e6eb3664de3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:43.363639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d3ed169b-f8ae-4516-a25b-4e6eb3664de3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:43.364220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d3ed169b-f8ae-4516-a25b-4e6eb3664de3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:43.365773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d3ed169b-f8ae-4516-a25b-4e6eb3664de3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:43.367033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d3ed169b-f8ae-4516-a25b-4e6eb3664de3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:43.368620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d3ed169b-f8ae-4516-a25b-4e6eb3664de3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:43.369088 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d3ed169b-f8ae-4516-a25b-4e6eb3664de3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:43.652746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-af3d3502-168d-4c52-8309-c4c75fa8a030 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:43.663870 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-af3d3502-168d-4c52-8309-c4c75fa8a030 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers/79b80ca1-484d-4fd4-9002-ef3626fd858b" status: 200 len: 1516 microversion: 2.1 time: 0.459391 Oct 29 03:08:43.666070 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2267/4347] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:43 2022] GET /compute/v2.1/servers/79b80ca1-484d-4fd4-9002-ef3626fd858b => generated 1516 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:43.683681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0b1f37f9-2014-4f54-803c-61bdf1aa1b7f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:43.684728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0b1f37f9-2014-4f54-803c-61bdf1aa1b7f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:43.691983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b1f37f9-2014-4f54-803c-61bdf1aa1b7f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:43.692738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b1f37f9-2014-4f54-803c-61bdf1aa1b7f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:43.693254 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b1f37f9-2014-4f54-803c-61bdf1aa1b7f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:43.694024 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b1f37f9-2014-4f54-803c-61bdf1aa1b7f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:43.694581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b1f37f9-2014-4f54-803c-61bdf1aa1b7f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:43.695644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b1f37f9-2014-4f54-803c-61bdf1aa1b7f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:43.875055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d3ed169b-f8ae-4516-a25b-4e6eb3664de3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:43.896282 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d3ed169b-f8ae-4516-a25b-4e6eb3664de3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1723 microversion: 2.1 time: 0.550519 Oct 29 03:08:43.908550 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2081/4348] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:43 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1723 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:08:43.908550 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4edaab87-f896-419e-b28e-11f0750c4f23 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:43.908550 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4edaab87-f896-419e-b28e-11f0750c4f23 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: 79b80ca1-484d-4fd4-9002-ef3626fd858b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:43.908932 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4edaab87-f896-419e-b28e-11f0750c4f23 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:43.909210 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4edaab87-f896-419e-b28e-11f0750c4f23 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:43.909830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4edaab87-f896-419e-b28e-11f0750c4f23 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:43.910670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4edaab87-f896-419e-b28e-11f0750c4f23 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:43.911276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4edaab87-f896-419e-b28e-11f0750c4f23 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:43.911840 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4edaab87-f896-419e-b28e-11f0750c4f23 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:43.965539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4edaab87-f896-419e-b28e-11f0750c4f23 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: 79b80ca1-484d-4fd4-9002-ef3626fd858b] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:08:44.095693 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4edaab87-f896-419e-b28e-11f0750c4f23 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "DELETE /compute/v2.1/servers/79b80ca1-484d-4fd4-9002-ef3626fd858b" status: 204 len: 0 microversion: 2.1 time: 0.196917 Oct 29 03:08:44.097129 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2082/4349] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:08:43 2022] DELETE /compute/v2.1/servers/79b80ca1-484d-4fd4-9002-ef3626fd858b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:08:44.105373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-ff7d21f1-8cca-4e68-b654-b27527850e39 req-6fab9803-dbfd-4983-9d2b-0ed88a73a93b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c25c557-35b6-4dce-99f0-4e2b1c43cf40", "name": "network-vif-unplugged", "status": "completed", "tag": "544bbd3a-133a-48fc-85fa-eb236d549271"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:44.120837 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ff7d21f1-8cca-4e68-b654-b27527850e39 req-6fab9803-dbfd-4983-9d2b-0ed88a73a93b service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:44.122013 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ff7d21f1-8cca-4e68-b654-b27527850e39 req-6fab9803-dbfd-4983-9d2b-0ed88a73a93b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:44.122934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ff7d21f1-8cca-4e68-b654-b27527850e39 req-6fab9803-dbfd-4983-9d2b-0ed88a73a93b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:44.138435 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-ff7d21f1-8cca-4e68-b654-b27527850e39 req-6fab9803-dbfd-4983-9d2b-0ed88a73a93b service nova] Creating event network-vif-unplugged:544bbd3a-133a-48fc-85fa-eb236d549271 for instance 3c25c557-35b6-4dce-99f0-4e2b1c43cf40 on n-h1-862967-2 Oct 29 03:08:44.145773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [req-ff7d21f1-8cca-4e68-b654-b27527850e39 req-6fab9803-dbfd-4983-9d2b-0ed88a73a93b service nova] Instance 3c25c557-35b6-4dce-99f0-4e2b1c43cf40 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:08:44.160961 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-ff7d21f1-8cca-4e68-b654-b27527850e39 req-6fab9803-dbfd-4983-9d2b-0ed88a73a93b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061884 Oct 29 03:08:44.162450 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2083/4350] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:44.170960 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fd6c9004-492c-4ca8-98af-897c1040299c tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:44.171863 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fd6c9004-492c-4ca8-98af-897c1040299c tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: 79b80ca1-484d-4fd4-9002-ef3626fd858b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:44.182887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd6c9004-492c-4ca8-98af-897c1040299c tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:44.183784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd6c9004-492c-4ca8-98af-897c1040299c tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:44.184504 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd6c9004-492c-4ca8-98af-897c1040299c tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:44.185440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd6c9004-492c-4ca8-98af-897c1040299c tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:44.186259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd6c9004-492c-4ca8-98af-897c1040299c tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:44.187019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd6c9004-492c-4ca8-98af-897c1040299c tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:44.254865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0b1f37f9-2014-4f54-803c-61bdf1aa1b7f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:44.266427 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0b1f37f9-2014-4f54-803c-61bdf1aa1b7f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1322 microversion: 2.1 time: 0.598161 Oct 29 03:08:44.267290 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2268/4351] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:43 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1322 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:44.273396 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e4812f14-1142-4086-9442-df19eb01a00b tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:44.274309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e4812f14-1142-4086-9442-df19eb01a00b tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:44.281915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e4812f14-1142-4086-9442-df19eb01a00b tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:44.282849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e4812f14-1142-4086-9442-df19eb01a00b tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:44.283538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e4812f14-1142-4086-9442-df19eb01a00b tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:44.285039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e4812f14-1142-4086-9442-df19eb01a00b tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:44.285712 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e4812f14-1142-4086-9442-df19eb01a00b tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:44.286779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e4812f14-1142-4086-9442-df19eb01a00b tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:44.321491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:44.353198 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=14 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:44.450826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e4812f14-1142-4086-9442-df19eb01a00b tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:44.462154 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e4812f14-1142-4086-9442-df19eb01a00b tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:44.464357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e4812f14-1142-4086-9442-df19eb01a00b tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:44.466112 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e4812f14-1142-4086-9442-df19eb01a00b tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1371 microversion: 2.47 time: 0.197712 Oct 29 03:08:44.467296 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2269/4352] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:44 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:08:44.472369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ff47c607-a15b-4fb9-bf8f-ff6c947fdb40 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:44.473210 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ff47c607-a15b-4fb9-bf8f-ff6c947fdb40 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:44.480224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff47c607-a15b-4fb9-bf8f-ff6c947fdb40 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:44.481273 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff47c607-a15b-4fb9-bf8f-ff6c947fdb40 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:44.481947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff47c607-a15b-4fb9-bf8f-ff6c947fdb40 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:44.482895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff47c607-a15b-4fb9-bf8f-ff6c947fdb40 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:44.483561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff47c607-a15b-4fb9-bf8f-ff6c947fdb40 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:44.484244 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff47c607-a15b-4fb9-bf8f-ff6c947fdb40 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:44.736195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ff47c607-a15b-4fb9-bf8f-ff6c947fdb40 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:44.745579 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ff47c607-a15b-4fb9-bf8f-ff6c947fdb40 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1467 microversion: 2.1 time: 0.276942 Oct 29 03:08:44.761582 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2270/4353] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:44 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1467 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:44.924411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-91d04985-7670-48f2-9ac4-def688f296d4 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:44.925548 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-91d04985-7670-48f2-9ac4-def688f296d4 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:44.927214 n-d-862967-2 devstack@n-api.service[127124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:08:44.927214 n-d-862967-2 devstack@n-api.service[127124]: Sat Oct 29 03:08:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 (ip 10.222.0.46) !!! Oct 29 03:08:44.934341 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91d04985-7670-48f2-9ac4-def688f296d4 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:44.934832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91d04985-7670-48f2-9ac4-def688f296d4 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:44.935276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91d04985-7670-48f2-9ac4-def688f296d4 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:44.935985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91d04985-7670-48f2-9ac4-def688f296d4 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:44.936441 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91d04985-7670-48f2-9ac4-def688f296d4 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:44.936932 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91d04985-7670-48f2-9ac4-def688f296d4 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:44.981577 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:45.029469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fd6c9004-492c-4ca8-98af-897c1040299c tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:45.040009 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fd6c9004-492c-4ca8-98af-897c1040299c tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers/79b80ca1-484d-4fd4-9002-ef3626fd858b" status: 200 len: 1522 microversion: 2.1 time: 0.875827 Oct 29 03:08:45.050472 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2084/4354] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:44 2022] GET /compute/v2.1/servers/79b80ca1-484d-4fd4-9002-ef3626fd858b => generated 1522 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:45.303814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fdfe76c9-395b-4852-b0df-2a98e41763cb tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:45.304787 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fdfe76c9-395b-4852-b0df-2a98e41763cb tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:45.311127 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdfe76c9-395b-4852-b0df-2a98e41763cb tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:45.311960 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdfe76c9-395b-4852-b0df-2a98e41763cb tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:45.312674 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdfe76c9-395b-4852-b0df-2a98e41763cb tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:45.313959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdfe76c9-395b-4852-b0df-2a98e41763cb tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:45.314633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdfe76c9-395b-4852-b0df-2a98e41763cb tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:45.315275 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdfe76c9-395b-4852-b0df-2a98e41763cb tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:45.400838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-91d04985-7670-48f2-9ac4-def688f296d4 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:45.417419 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-91d04985-7670-48f2-9ac4-def688f296d4 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1723 microversion: 2.1 time: 0.497083 Oct 29 03:08:45.419089 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2271/4355] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:44 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1723 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:45.497495 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-91d6ad94-aa8c-400f-a382-569f818252f2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:45.497495 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-91d6ad94-aa8c-400f-a382-569f818252f2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:45.510282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91d6ad94-aa8c-400f-a382-569f818252f2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:45.511350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91d6ad94-aa8c-400f-a382-569f818252f2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:45.512170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91d6ad94-aa8c-400f-a382-569f818252f2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:45.513757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91d6ad94-aa8c-400f-a382-569f818252f2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:45.514781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91d6ad94-aa8c-400f-a382-569f818252f2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:45.515575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91d6ad94-aa8c-400f-a382-569f818252f2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:45.853250 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fdfe76c9-395b-4852-b0df-2a98e41763cb tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:45.883875 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fdfe76c9-395b-4852-b0df-2a98e41763cb tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1322 microversion: 2.1 time: 0.583243 Oct 29 03:08:45.896612 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2085/4356] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:45 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1322 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:08:45.911635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0c5472c1-8122-4d47-9f0e-918f6fe245b6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:45.917892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0c5472c1-8122-4d47-9f0e-918f6fe245b6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:45.928303 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c5472c1-8122-4d47-9f0e-918f6fe245b6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:45.929279 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c5472c1-8122-4d47-9f0e-918f6fe245b6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:45.932418 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c5472c1-8122-4d47-9f0e-918f6fe245b6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:45.933446 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c5472c1-8122-4d47-9f0e-918f6fe245b6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:45.935811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c5472c1-8122-4d47-9f0e-918f6fe245b6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:45.936632 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c5472c1-8122-4d47-9f0e-918f6fe245b6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:45.949541 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-91d6ad94-aa8c-400f-a382-569f818252f2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:45.972171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-91d6ad94-aa8c-400f-a382-569f818252f2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:45.978542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-91d6ad94-aa8c-400f-a382-569f818252f2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:45.985926 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-91d6ad94-aa8c-400f-a382-569f818252f2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1371 microversion: 2.47 time: 0.491516 Oct 29 03:08:45.986909 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2272/4357] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:45 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1371 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:08:46.081825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e066e368-7704-40bc-a58e-51e4b89955a2 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:46.082693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e066e368-7704-40bc-a58e-51e4b89955a2 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: 79b80ca1-484d-4fd4-9002-ef3626fd858b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:46.090509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e066e368-7704-40bc-a58e-51e4b89955a2 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:46.091263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e066e368-7704-40bc-a58e-51e4b89955a2 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:46.091940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e066e368-7704-40bc-a58e-51e4b89955a2 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:46.092860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e066e368-7704-40bc-a58e-51e4b89955a2 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:46.093511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e066e368-7704-40bc-a58e-51e4b89955a2 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:46.094243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e066e368-7704-40bc-a58e-51e4b89955a2 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:46.134470 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=100 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:46.664314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e066e368-7704-40bc-a58e-51e4b89955a2 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:46.664918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0c5472c1-8122-4d47-9f0e-918f6fe245b6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:46.673297 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e066e368-7704-40bc-a58e-51e4b89955a2 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers/79b80ca1-484d-4fd4-9002-ef3626fd858b" status: 200 len: 1522 microversion: 2.1 time: 0.600548 Oct 29 03:08:46.673543 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0c5472c1-8122-4d47-9f0e-918f6fe245b6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1467 microversion: 2.1 time: 0.774730 Oct 29 03:08:46.684859 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2273/4359] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:46 2022] GET /compute/v2.1/servers/79b80ca1-484d-4fd4-9002-ef3626fd858b => generated 1522 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:46.685807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-14b6a56d-3fe1-47df-b89a-6176869c38fb req-9a17e5be-cfcd-40e0-bba5-98b032208121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab5ee183-e4bd-4de0-bb66-cda1ce9ead94", "name": "network-vif-plugged", "status": "completed", "tag": "c010f3e0-ed80-4c2d-8830-85d67ad0153a"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:46.689972 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2086/4359] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:45 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1467 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:46.696329 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-6d65b947-bd33-4454-8ef8-f55b9e86f2de req-ac40ef9f-7494-447b-a044-b92dbc36de23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d04a110-8ee9-4c6d-a68a-49e8493b8be2", "tag": "b3ee4f85-8bd6-4217-9d11-7140be55636a"}, {"name": "network-changed", "server_uuid": "3c25c557-35b6-4dce-99f0-4e2b1c43cf40", "tag": "544bbd3a-133a-48fc-85fa-eb236d549271"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:46.708501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-14b6a56d-3fe1-47df-b89a-6176869c38fb req-9a17e5be-cfcd-40e0-bba5-98b032208121 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:46.709020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-14b6a56d-3fe1-47df-b89a-6176869c38fb req-9a17e5be-cfcd-40e0-bba5-98b032208121 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:46.709446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-14b6a56d-3fe1-47df-b89a-6176869c38fb req-9a17e5be-cfcd-40e0-bba5-98b032208121 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:46.714658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6d65b947-bd33-4454-8ef8-f55b9e86f2de req-ac40ef9f-7494-447b-a044-b92dbc36de23 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:46.715353 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6d65b947-bd33-4454-8ef8-f55b9e86f2de req-ac40ef9f-7494-447b-a044-b92dbc36de23 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:46.718708 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6d65b947-bd33-4454-8ef8-f55b9e86f2de req-ac40ef9f-7494-447b-a044-b92dbc36de23 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:46.733052 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-14b6a56d-3fe1-47df-b89a-6176869c38fb req-9a17e5be-cfcd-40e0-bba5-98b032208121 service nova] Creating event network-vif-plugged:c010f3e0-ed80-4c2d-8830-85d67ad0153a for instance ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 on n-h1-862967-2 Oct 29 03:08:46.742345 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-14b6a56d-3fe1-47df-b89a-6176869c38fb req-9a17e5be-cfcd-40e0-bba5-98b032208121 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064202 Oct 29 03:08:46.744892 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2274/4360] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:46.752616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-228498d0-84c1-40cf-a772-04a79b4c4ccc tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:46.754892 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-6d65b947-bd33-4454-8ef8-f55b9e86f2de req-ac40ef9f-7494-447b-a044-b92dbc36de23 service nova] Creating event network-changed:b3ee4f85-8bd6-4217-9d11-7140be55636a for instance 3d04a110-8ee9-4c6d-a68a-49e8493b8be2 on n-h2-862967-2 Oct 29 03:08:46.755397 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-6d65b947-bd33-4454-8ef8-f55b9e86f2de req-ac40ef9f-7494-447b-a044-b92dbc36de23 service nova] Creating event network-changed:544bbd3a-133a-48fc-85fa-eb236d549271 for instance 3c25c557-35b6-4dce-99f0-4e2b1c43cf40 on n-h1-862967-2 Oct 29 03:08:46.765601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-228498d0-84c1-40cf-a772-04a79b4c4ccc tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:46.772403 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-228498d0-84c1-40cf-a772-04a79b4c4ccc tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:46.773221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-228498d0-84c1-40cf-a772-04a79b4c4ccc tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:46.773446 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [req-6d65b947-bd33-4454-8ef8-f55b9e86f2de req-ac40ef9f-7494-447b-a044-b92dbc36de23 service nova] Instance 3c25c557-35b6-4dce-99f0-4e2b1c43cf40 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:08:46.774002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-228498d0-84c1-40cf-a772-04a79b4c4ccc tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:46.785197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-228498d0-84c1-40cf-a772-04a79b4c4ccc tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:46.785885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-228498d0-84c1-40cf-a772-04a79b4c4ccc tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:46.786315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-228498d0-84c1-40cf-a772-04a79b4c4ccc tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:46.810609 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-6d65b947-bd33-4454-8ef8-f55b9e86f2de req-ac40ef9f-7494-447b-a044-b92dbc36de23 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.119131 Oct 29 03:08:46.811818 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2087/4361] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:46.909297 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-63ebadd2-7668-4c5f-9a44-bfed25b6265c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:46.911231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-63ebadd2-7668-4c5f-9a44-bfed25b6265c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:46.925913 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63ebadd2-7668-4c5f-9a44-bfed25b6265c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:46.926404 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63ebadd2-7668-4c5f-9a44-bfed25b6265c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:46.927187 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63ebadd2-7668-4c5f-9a44-bfed25b6265c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:46.928062 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63ebadd2-7668-4c5f-9a44-bfed25b6265c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:46.928774 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63ebadd2-7668-4c5f-9a44-bfed25b6265c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:46.929642 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63ebadd2-7668-4c5f-9a44-bfed25b6265c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:47.398727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-228498d0-84c1-40cf-a772-04a79b4c4ccc tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:47.410455 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-228498d0-84c1-40cf-a772-04a79b4c4ccc tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1723 microversion: 2.1 time: 0.664022 Oct 29 03:08:47.413484 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2275/4362] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:46 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1723 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:47.418979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-09f6e159-be16-434b-94f0-e7ffc633a50f tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:47.419689 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-09f6e159-be16-434b-94f0-e7ffc633a50f tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:47.426277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09f6e159-be16-434b-94f0-e7ffc633a50f tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:47.426839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09f6e159-be16-434b-94f0-e7ffc633a50f tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:47.427521 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09f6e159-be16-434b-94f0-e7ffc633a50f tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:47.428437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09f6e159-be16-434b-94f0-e7ffc633a50f tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:47.429242 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09f6e159-be16-434b-94f0-e7ffc633a50f tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:47.429780 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09f6e159-be16-434b-94f0-e7ffc633a50f tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:47.564261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-09f6e159-be16-434b-94f0-e7ffc633a50f tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:47.581930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-09f6e159-be16-434b-94f0-e7ffc633a50f tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:47.583811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-09f6e159-be16-434b-94f0-e7ffc633a50f tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:47.585407 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-09f6e159-be16-434b-94f0-e7ffc633a50f tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1356 microversion: 2.47 time: 0.170513 Oct 29 03:08:47.590084 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2276/4363] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:47 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1356 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:08:47.616401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8c94c6e6-07ad-487c-9310-b83bca9b045d tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:47.624235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8c94c6e6-07ad-487c-9310-b83bca9b045d tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:47.625330 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8c94c6e6-07ad-487c-9310-b83bca9b045d tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Searching by: {'deleted': False, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7'} {{(pid=127124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:08:47.634716 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c94c6e6-07ad-487c-9310-b83bca9b045d tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:47.635462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c94c6e6-07ad-487c-9310-b83bca9b045d tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:47.638147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c94c6e6-07ad-487c-9310-b83bca9b045d tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:47.639312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c94c6e6-07ad-487c-9310-b83bca9b045d tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:47.640900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c94c6e6-07ad-487c-9310-b83bca9b045d tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:47.641675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c94c6e6-07ad-487c-9310-b83bca9b045d tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:47.845029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.multi_cell_list [None req-8c94c6e6-07ad-487c-9310-b83bca9b045d tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:08:48.050983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8c94c6e6-07ad-487c-9310-b83bca9b045d tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:48.070993 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c94c6e6-07ad-487c-9310-b83bca9b045d tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:48.071542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c94c6e6-07ad-487c-9310-b83bca9b045d tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:48.073765 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c94c6e6-07ad-487c-9310-b83bca9b045d tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:48.088244 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-63ebadd2-7668-4c5f-9a44-bfed25b6265c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:48.098748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8c94c6e6-07ad-487c-9310-b83bca9b045d tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:48.100607 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-63ebadd2-7668-4c5f-9a44-bfed25b6265c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1322 microversion: 2.1 time: 1.194406 Oct 29 03:08:48.101624 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2088/4364] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:46 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1322 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:48.122306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e1162632-d08b-44c1-90bb-c183236bb720 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:48.123075 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e1162632-d08b-44c1-90bb-c183236bb720 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:48.132348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:48.139814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8c94c6e6-07ad-487c-9310-b83bca9b045d tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:48.145219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1162632-d08b-44c1-90bb-c183236bb720 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:48.145763 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1162632-d08b-44c1-90bb-c183236bb720 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:48.149190 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1162632-d08b-44c1-90bb-c183236bb720 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:48.150136 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1162632-d08b-44c1-90bb-c183236bb720 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:48.150648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1162632-d08b-44c1-90bb-c183236bb720 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:48.157240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1162632-d08b-44c1-90bb-c183236bb720 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:48.242079 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8c94c6e6-07ad-487c-9310-b83bca9b045d tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.630273 Oct 29 03:08:48.250649 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2277/4365] 10.222.0.46 () {60 vars in 1187 bytes} [Sat Oct 29 03:08:47 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:08:48.258729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-80c45b18-52a2-4633-9f25-c9f88c669b59 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:48.260053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-80c45b18-52a2-4633-9f25-c9f88c669b59 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: 79b80ca1-484d-4fd4-9002-ef3626fd858b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:48.277034 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80c45b18-52a2-4633-9f25-c9f88c669b59 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:48.277932 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80c45b18-52a2-4633-9f25-c9f88c669b59 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:48.278520 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80c45b18-52a2-4633-9f25-c9f88c669b59 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:48.279449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80c45b18-52a2-4633-9f25-c9f88c669b59 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:48.280087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80c45b18-52a2-4633-9f25-c9f88c669b59 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:48.280774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80c45b18-52a2-4633-9f25-c9f88c669b59 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:48.317642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80c45b18-52a2-4633-9f25-c9f88c669b59 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:48.318386 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80c45b18-52a2-4633-9f25-c9f88c669b59 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:48.318975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80c45b18-52a2-4633-9f25-c9f88c669b59 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:48.319575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-80c45b18-52a2-4633-9f25-c9f88c669b59 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lazy-loading 'fault' on Instance uuid 79b80ca1-484d-4fd4-9002-ef3626fd858b {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:08:48.479555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-80c45b18-52a2-4633-9f25-c9f88c669b59 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:48.489857 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-80c45b18-52a2-4633-9f25-c9f88c669b59 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers/79b80ca1-484d-4fd4-9002-ef3626fd858b" status: 200 len: 1312 microversion: 2.1 time: 0.236570 Oct 29 03:08:48.491329 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2278/4366] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:48 2022] GET /compute/v2.1/servers/79b80ca1-484d-4fd4-9002-ef3626fd858b => generated 1312 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:48.499257 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ada9945d-4223-4479-8d55-45a71f9d062e tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:48.499762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ada9945d-4223-4479-8d55-45a71f9d062e tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:48.518039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ada9945d-4223-4479-8d55-45a71f9d062e tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:48.518789 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ada9945d-4223-4479-8d55-45a71f9d062e tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:48.528109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ada9945d-4223-4479-8d55-45a71f9d062e tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:48.529215 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ada9945d-4223-4479-8d55-45a71f9d062e tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:48.529848 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ada9945d-4223-4479-8d55-45a71f9d062e tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:48.530441 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ada9945d-4223-4479-8d55-45a71f9d062e tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:48.576944 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ada9945d-4223-4479-8d55-45a71f9d062e tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:08:48.672231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e1162632-d08b-44c1-90bb-c183236bb720 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:48.674535 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:48.690100 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e1162632-d08b-44c1-90bb-c183236bb720 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1467 microversion: 2.1 time: 0.587212 Oct 29 03:08:48.693263 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2089/4367] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:48 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1467 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:48.699679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e2d337a7-909e-417d-b182-0d8260ef85e3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:48.711576 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e2d337a7-909e-417d-b182-0d8260ef85e3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:48.732773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2d337a7-909e-417d-b182-0d8260ef85e3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:48.735202 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2d337a7-909e-417d-b182-0d8260ef85e3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:48.736910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2d337a7-909e-417d-b182-0d8260ef85e3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:48.738412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2d337a7-909e-417d-b182-0d8260ef85e3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:48.743444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2d337a7-909e-417d-b182-0d8260ef85e3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:48.744803 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ada9945d-4223-4479-8d55-45a71f9d062e tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 204 len: 0 microversion: 2.47 time: 0.251964 Oct 29 03:08:48.745762 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2d337a7-909e-417d-b182-0d8260ef85e3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:48.755033 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2279/4368] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Oct 29 03:08:48 2022] DELETE /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:08:48.763742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5e01b410-38ac-43be-8632-5a390755ffd4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:48.769509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5e01b410-38ac-43be-8632-5a390755ffd4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:48.778356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e01b410-38ac-43be-8632-5a390755ffd4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:48.783081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e01b410-38ac-43be-8632-5a390755ffd4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:48.783716 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e01b410-38ac-43be-8632-5a390755ffd4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:48.784648 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e01b410-38ac-43be-8632-5a390755ffd4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:48.785248 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e01b410-38ac-43be-8632-5a390755ffd4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:48.785841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e01b410-38ac-43be-8632-5a390755ffd4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:48.984103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5e01b410-38ac-43be-8632-5a390755ffd4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:48.997976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5e01b410-38ac-43be-8632-5a390755ffd4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:49.008908 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5e01b410-38ac-43be-8632-5a390755ffd4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:49.010775 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5e01b410-38ac-43be-8632-5a390755ffd4 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1362 microversion: 2.47 time: 0.254452 Oct 29 03:08:49.038851 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2280/4369] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:48 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1362 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:08:49.047474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-296c5937-9dd2-4132-9604-c8659ac82ff6 req-256e1b05-cb93-42ba-bee1-19af7ed83d0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79b80ca1-484d-4fd4-9002-ef3626fd858b", "name": "network-vif-deleted", "tag": "1af16bf9-f26a-4d1e-9af2-fadf898c15ff"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:49.063609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-296c5937-9dd2-4132-9604-c8659ac82ff6 req-256e1b05-cb93-42ba-bee1-19af7ed83d0d service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:49.064305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-296c5937-9dd2-4132-9604-c8659ac82ff6 req-256e1b05-cb93-42ba-bee1-19af7ed83d0d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:49.064914 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-296c5937-9dd2-4132-9604-c8659ac82ff6 req-256e1b05-cb93-42ba-bee1-19af7ed83d0d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:49.084483 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-296c5937-9dd2-4132-9604-c8659ac82ff6 req-256e1b05-cb93-42ba-bee1-19af7ed83d0d service nova] Creating event network-vif-deleted:1af16bf9-f26a-4d1e-9af2-fadf898c15ff for instance 79b80ca1-484d-4fd4-9002-ef3626fd858b on n-h1-862967-2 Oct 29 03:08:49.100276 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-296c5937-9dd2-4132-9604-c8659ac82ff6 req-256e1b05-cb93-42ba-bee1-19af7ed83d0d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060637 Oct 29 03:08:49.102843 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2281/4370] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:49.144052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-56affe61-1dc7-455b-be78-adcf76a46d2f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:49.145078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-56affe61-1dc7-455b-be78-adcf76a46d2f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:49.168683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56affe61-1dc7-455b-be78-adcf76a46d2f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:49.169373 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56affe61-1dc7-455b-be78-adcf76a46d2f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:49.169993 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56affe61-1dc7-455b-be78-adcf76a46d2f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:49.172497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56affe61-1dc7-455b-be78-adcf76a46d2f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:49.173201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56affe61-1dc7-455b-be78-adcf76a46d2f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:49.179861 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56affe61-1dc7-455b-be78-adcf76a46d2f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:49.412181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e2d337a7-909e-417d-b182-0d8260ef85e3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:49.434046 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e2d337a7-909e-417d-b182-0d8260ef85e3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1723 microversion: 2.1 time: 0.739287 Oct 29 03:08:49.450128 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2090/4371] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:48 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1723 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:49.518135 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-375d54b5-6b3c-4474-a353-b0fa25a6f08f tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:49.519186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-375d54b5-6b3c-4474-a353-b0fa25a6f08f tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: 79b80ca1-484d-4fd4-9002-ef3626fd858b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:49.534632 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-375d54b5-6b3c-4474-a353-b0fa25a6f08f tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:49.536899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-375d54b5-6b3c-4474-a353-b0fa25a6f08f tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:49.541583 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-375d54b5-6b3c-4474-a353-b0fa25a6f08f tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:49.542354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-375d54b5-6b3c-4474-a353-b0fa25a6f08f tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:49.543228 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-375d54b5-6b3c-4474-a353-b0fa25a6f08f tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:49.543660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-375d54b5-6b3c-4474-a353-b0fa25a6f08f tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:49.627741 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-375d54b5-6b3c-4474-a353-b0fa25a6f08f tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:49.628825 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-375d54b5-6b3c-4474-a353-b0fa25a6f08f tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:49.629945 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-375d54b5-6b3c-4474-a353-b0fa25a6f08f tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:49.631023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-375d54b5-6b3c-4474-a353-b0fa25a6f08f tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lazy-loading 'fault' on Instance uuid 79b80ca1-484d-4fd4-9002-ef3626fd858b {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:08:49.688681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-375d54b5-6b3c-4474-a353-b0fa25a6f08f tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:49.703087 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-375d54b5-6b3c-4474-a353-b0fa25a6f08f tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers/79b80ca1-484d-4fd4-9002-ef3626fd858b" status: 200 len: 1312 microversion: 2.1 time: 0.193501 Oct 29 03:08:49.704306 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2091/4372] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:49 2022] GET /compute/v2.1/servers/79b80ca1-484d-4fd4-9002-ef3626fd858b => generated 1312 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:08:49.726189 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6b6480b2-5286-4ae9-bc9e-3eeee2b09ca7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:49.727078 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6b6480b2-5286-4ae9-bc9e-3eeee2b09ca7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:49.743882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b6480b2-5286-4ae9-bc9e-3eeee2b09ca7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:49.746960 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b6480b2-5286-4ae9-bc9e-3eeee2b09ca7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:49.747734 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b6480b2-5286-4ae9-bc9e-3eeee2b09ca7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:49.749459 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b6480b2-5286-4ae9-bc9e-3eeee2b09ca7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:49.756176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b6480b2-5286-4ae9-bc9e-3eeee2b09ca7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:49.757021 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b6480b2-5286-4ae9-bc9e-3eeee2b09ca7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:49.919851 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-56affe61-1dc7-455b-be78-adcf76a46d2f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:49.929034 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-56affe61-1dc7-455b-be78-adcf76a46d2f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1322 microversion: 2.1 time: 0.789299 Oct 29 03:08:49.933879 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2282/4373] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:49 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1322 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:08:50.039429 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e59fcb05-a26a-4929-94ad-feaba7b880e9 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:50.040786 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e59fcb05-a26a-4929-94ad-feaba7b880e9 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:50.058928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e59fcb05-a26a-4929-94ad-feaba7b880e9 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:50.059672 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e59fcb05-a26a-4929-94ad-feaba7b880e9 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:50.060135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e59fcb05-a26a-4929-94ad-feaba7b880e9 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:50.061022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e59fcb05-a26a-4929-94ad-feaba7b880e9 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:50.061342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e59fcb05-a26a-4929-94ad-feaba7b880e9 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:50.062100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e59fcb05-a26a-4929-94ad-feaba7b880e9 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:50.177112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e59fcb05-a26a-4929-94ad-feaba7b880e9 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:50.196810 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e59fcb05-a26a-4929-94ad-feaba7b880e9 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:50.199029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e59fcb05-a26a-4929-94ad-feaba7b880e9 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:50.200592 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e59fcb05-a26a-4929-94ad-feaba7b880e9 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1362 microversion: 2.47 time: 0.165132 Oct 29 03:08:50.201386 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2283/4374] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:50 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:08:50.472136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1c7132a1-e17d-4d35-a5fd-a3e1f1e107cf tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:50.472771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1c7132a1-e17d-4d35-a5fd-a3e1f1e107cf tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:50.485555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c7132a1-e17d-4d35-a5fd-a3e1f1e107cf tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:50.486040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c7132a1-e17d-4d35-a5fd-a3e1f1e107cf tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:50.486476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c7132a1-e17d-4d35-a5fd-a3e1f1e107cf tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:50.487182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c7132a1-e17d-4d35-a5fd-a3e1f1e107cf tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:50.487626 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c7132a1-e17d-4d35-a5fd-a3e1f1e107cf tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:50.488044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c7132a1-e17d-4d35-a5fd-a3e1f1e107cf tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:50.492710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6b6480b2-5286-4ae9-bc9e-3eeee2b09ca7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:50.508161 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6b6480b2-5286-4ae9-bc9e-3eeee2b09ca7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1467 microversion: 2.1 time: 0.790967 Oct 29 03:08:50.522046 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2092/4375] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:49 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1467 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:50.731261 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b9015add-cfdb-411c-9cc0-93a45a375456 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:50.737807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b9015add-cfdb-411c-9cc0-93a45a375456 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: 79b80ca1-484d-4fd4-9002-ef3626fd858b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:50.754675 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9015add-cfdb-411c-9cc0-93a45a375456 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:50.758047 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9015add-cfdb-411c-9cc0-93a45a375456 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:50.759780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9015add-cfdb-411c-9cc0-93a45a375456 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:50.761846 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9015add-cfdb-411c-9cc0-93a45a375456 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:50.767727 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9015add-cfdb-411c-9cc0-93a45a375456 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:50.768751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9015add-cfdb-411c-9cc0-93a45a375456 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:50.809780 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1c7132a1-e17d-4d35-a5fd-a3e1f1e107cf tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:50.816173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9015add-cfdb-411c-9cc0-93a45a375456 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:50.817000 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9015add-cfdb-411c-9cc0-93a45a375456 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:50.817651 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9015add-cfdb-411c-9cc0-93a45a375456 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:50.818293 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-b9015add-cfdb-411c-9cc0-93a45a375456 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lazy-loading 'fault' on Instance uuid 79b80ca1-484d-4fd4-9002-ef3626fd858b {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:08:50.836032 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1c7132a1-e17d-4d35-a5fd-a3e1f1e107cf tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1723 microversion: 2.1 time: 0.367100 Oct 29 03:08:50.838743 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2284/4376] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:50 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1723 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:08:50.957899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b9015add-cfdb-411c-9cc0-93a45a375456 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:50.959020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-036b6937-9de9-4b5e-8bb4-755c87fef640 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:50.959985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-036b6937-9de9-4b5e-8bb4-755c87fef640 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:50.971493 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b9015add-cfdb-411c-9cc0-93a45a375456 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers/79b80ca1-484d-4fd4-9002-ef3626fd858b" status: 200 len: 1312 microversion: 2.1 time: 0.247457 Oct 29 03:08:50.972115 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2093/4377] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:50 2022] GET /compute/v2.1/servers/79b80ca1-484d-4fd4-9002-ef3626fd858b => generated 1312 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:50.974721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-036b6937-9de9-4b5e-8bb4-755c87fef640 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:50.978128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-036b6937-9de9-4b5e-8bb4-755c87fef640 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:50.978876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-036b6937-9de9-4b5e-8bb4-755c87fef640 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:50.979848 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-036b6937-9de9-4b5e-8bb4-755c87fef640 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:50.980474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-036b6937-9de9-4b5e-8bb4-755c87fef640 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:50.982090 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-036b6937-9de9-4b5e-8bb4-755c87fef640 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:51.233956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-03854f3c-150c-4cfd-accd-612f060442f8 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:51.234578 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-03854f3c-150c-4cfd-accd-612f060442f8 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:51.241472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03854f3c-150c-4cfd-accd-612f060442f8 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:51.248147 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03854f3c-150c-4cfd-accd-612f060442f8 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:51.248825 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03854f3c-150c-4cfd-accd-612f060442f8 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:51.249599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03854f3c-150c-4cfd-accd-612f060442f8 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:51.250064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03854f3c-150c-4cfd-accd-612f060442f8 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:51.250636 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03854f3c-150c-4cfd-accd-612f060442f8 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:51.633784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-036b6937-9de9-4b5e-8bb4-755c87fef640 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:51.652000 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-036b6937-9de9-4b5e-8bb4-755c87fef640 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1322 microversion: 2.1 time: 0.695122 Oct 29 03:08:51.668036 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2285/4378] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:50 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1322 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:51.688350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-03854f3c-150c-4cfd-accd-612f060442f8 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:51.695858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0f63ddf2-04e4-4866-8dee-b0bf0c0aa393 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:51.698366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0f63ddf2-04e4-4866-8dee-b0bf0c0aa393 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:51.700465 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-03854f3c-150c-4cfd-accd-612f060442f8 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:51.702802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-03854f3c-150c-4cfd-accd-612f060442f8 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:51.706481 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-03854f3c-150c-4cfd-accd-612f060442f8 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 200 len: 1362 microversion: 2.47 time: 0.476479 Oct 29 03:08:51.710886 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2094/4379] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:51 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 1362 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:08:51.725172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f63ddf2-04e4-4866-8dee-b0bf0c0aa393 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:51.725673 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f63ddf2-04e4-4866-8dee-b0bf0c0aa393 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:51.726120 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f63ddf2-04e4-4866-8dee-b0bf0c0aa393 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:51.726842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f63ddf2-04e4-4866-8dee-b0bf0c0aa393 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:51.727314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f63ddf2-04e4-4866-8dee-b0bf0c0aa393 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:51.731974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f63ddf2-04e4-4866-8dee-b0bf0c0aa393 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:51.863551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9c1cccef-7b02-4993-b560-134da129fd46 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:51.864736 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9c1cccef-7b02-4993-b560-134da129fd46 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:51.884830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c1cccef-7b02-4993-b560-134da129fd46 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:51.885275 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c1cccef-7b02-4993-b560-134da129fd46 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:51.885712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c1cccef-7b02-4993-b560-134da129fd46 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:51.886437 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c1cccef-7b02-4993-b560-134da129fd46 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:51.886892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c1cccef-7b02-4993-b560-134da129fd46 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:51.887316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c1cccef-7b02-4993-b560-134da129fd46 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:52.127707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0f63ddf2-04e4-4866-8dee-b0bf0c0aa393 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:52.135970 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0f63ddf2-04e4-4866-8dee-b0bf0c0aa393 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1460 microversion: 2.1 time: 0.468540 Oct 29 03:08:52.149651 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2286/4380] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:51 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1460 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:52.162460 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6d7df58e-abb9-4e57-b23c-77c52ae78406 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:52.163396 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6d7df58e-abb9-4e57-b23c-77c52ae78406 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: 79b80ca1-484d-4fd4-9002-ef3626fd858b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:52.174077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d7df58e-abb9-4e57-b23c-77c52ae78406 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:52.174827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d7df58e-abb9-4e57-b23c-77c52ae78406 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:52.175489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d7df58e-abb9-4e57-b23c-77c52ae78406 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:52.176433 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d7df58e-abb9-4e57-b23c-77c52ae78406 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:52.177103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d7df58e-abb9-4e57-b23c-77c52ae78406 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:52.178310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d7df58e-abb9-4e57-b23c-77c52ae78406 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:52.200035 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-6d7df58e-abb9-4e57-b23c-77c52ae78406 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] HTTP exception thrown: Instance 79b80ca1-484d-4fd4-9002-ef3626fd858b could not be found. Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6d7df58e-abb9-4e57-b23c-77c52ae78406 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Request method failure captured: Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/79b80ca1-484d-4fd4-9002-ef3626fd858b HTTP/1.1 Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJkZpRH_5I0VEWenSx_2qthFArNon1K0nfO2BIJXwF7d_xI3qcHWkWKzFJXYpaUesV6bEt8bMGH0Lx8nWLk6ooHEQz2PNWzJ5dxEmDqJrBtoz-xlzX3omFTGuKn_Zy89ScGPhUln_8-bCJzTxISTwiJ8bTo4xYVYeQAIJMKFGVYs0C4 Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 0c1e510b5644490d839cefd879108416 Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ListServersNegativeTestJSON-1914539329 Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c1e510b5644490d839cefd879108416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c1e510b5644490d839cefd879108416"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c1e510b5644490d839cefd879108416"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c1e510b5644490d839cefd879108416"}]}] Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ListServersNegativeTestJSON-1914539329 Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 0c1e510b5644490d839cefd879108416 Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1914539329 Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ListServersNegativeTestJSON-1914539329-project Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 94aca590158c420399a46af6c9e88bb8 Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ListServersNegativeTestJSON-1914539329-project Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 79b80ca1-484d-4fd4-9002-ef3626fd858b could not be found. Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '79b80ca1-484d-4fd4-9002-ef3626fd858b'} Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79b80ca1-484d-4fd4-9002-ef3626fd858b could not be found. Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79b80ca1-484d-4fd4-9002-ef3626fd858b could not be found. Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:52.202142 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:52.207615 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:52.207615 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:52.207615 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:52.207615 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:52.207615 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:08:52.207615 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:08:52.207615 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79b80ca1-484d-4fd4-9002-ef3626fd858b could not be found. Oct 29 03:08:52.207615 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:52.210258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6d7df58e-abb9-4e57-b23c-77c52ae78406 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Returning 404 to user: Instance 79b80ca1-484d-4fd4-9002-ef3626fd858b could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:52.211875 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6d7df58e-abb9-4e57-b23c-77c52ae78406 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers/79b80ca1-484d-4fd4-9002-ef3626fd858b" status: 404 len: 111 microversion: 2.1 time: 0.054264 Oct 29 03:08:52.213218 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2287/4381] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:52 2022] GET /compute/v2.1/servers/79b80ca1-484d-4fd4-9002-ef3626fd858b => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:08:52.446460 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f4d7a635-acee-47c1-b6b5-5731baf5af4c tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:52.446460 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f4d7a635-acee-47c1-b6b5-5731baf5af4c tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:52.455805 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f4d7a635-acee-47c1-b6b5-5731baf5af4c tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:52.456299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f4d7a635-acee-47c1-b6b5-5731baf5af4c tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:52.456759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f4d7a635-acee-47c1-b6b5-5731baf5af4c tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:52.472499 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f4d7a635-acee-47c1-b6b5-5731baf5af4c tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:52.473038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f4d7a635-acee-47c1-b6b5-5731baf5af4c tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:52.473483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f4d7a635-acee-47c1-b6b5-5731baf5af4c tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:52.712275 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f4d7a635-acee-47c1-b6b5-5731baf5af4c tempest-MigrationsAdminTest-872333494 tempest-MigrationsAdminTest-872333494-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1611 microversion: 2.1 time: 0.497504 Oct 29 03:08:52.712921 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2288/4382] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:52 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1611 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:52.719300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-da8027ac-5193-4901-adb0-325f144b269d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:52.724505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-da8027ac-5193-4901-adb0-325f144b269d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:52.725636 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-da8027ac-5193-4901-adb0-325f144b269d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '0c1e510b5644490d839cefd879108416'} {{(pid=127124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:08:52.731346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da8027ac-5193-4901-adb0-325f144b269d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:52.732026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da8027ac-5193-4901-adb0-325f144b269d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:52.732661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da8027ac-5193-4901-adb0-325f144b269d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:52.733614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da8027ac-5193-4901-adb0-325f144b269d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:52.734238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da8027ac-5193-4901-adb0-325f144b269d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:52.734868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da8027ac-5193-4901-adb0-325f144b269d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:52.830845 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-da8027ac-5193-4901-adb0-325f144b269d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.115102 Oct 29 03:08:52.839612 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2289/4383] 10.222.0.46 () {58 vars in 1230 bytes} [Sat Oct 29 03:08:52 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:08:52.844842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-37c16cb5-6b25-437e-bd76-bec3a4121399 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:52.845717 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-37c16cb5-6b25-437e-bd76-bec3a4121399 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:52.851430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:52.853299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37c16cb5-6b25-437e-bd76-bec3a4121399 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:52.854249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37c16cb5-6b25-437e-bd76-bec3a4121399 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:52.854895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37c16cb5-6b25-437e-bd76-bec3a4121399 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:52.855831 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37c16cb5-6b25-437e-bd76-bec3a4121399 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:52.856472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37c16cb5-6b25-437e-bd76-bec3a4121399 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:52.857751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37c16cb5-6b25-437e-bd76-bec3a4121399 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:52.894005 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:52.908813 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9c1cccef-7b02-4993-b560-134da129fd46 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:52.917451 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9c1cccef-7b02-4993-b560-134da129fd46 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1723 microversion: 2.1 time: 1.058038 Oct 29 03:08:52.940799 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2095/4384] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:51 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1723 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:08:52.962275 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a2ec3f7e-f03d-4731-a0af-259d395e07b2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:52.962925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a2ec3f7e-f03d-4731-a0af-259d395e07b2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: e8daa465-8a5f-42f2-aefa-d76c10de016a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:52.992213 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2ec3f7e-f03d-4731-a0af-259d395e07b2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:52.992959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2ec3f7e-f03d-4731-a0af-259d395e07b2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:52.993539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2ec3f7e-f03d-4731-a0af-259d395e07b2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:52.994498 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2ec3f7e-f03d-4731-a0af-259d395e07b2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:52.995179 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2ec3f7e-f03d-4731-a0af-259d395e07b2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:52.995805 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2ec3f7e-f03d-4731-a0af-259d395e07b2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:53.019862 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-a2ec3f7e-f03d-4731-a0af-259d395e07b2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] HTTP exception thrown: Instance e8daa465-8a5f-42f2-aefa-d76c10de016a could not be found. Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a2ec3f7e-f03d-4731-a0af-259d395e07b2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Request method failure captured: Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a HTTP/1.1 Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJkTN0rAiiM5nQrh6fft15cnuFazYIrkHygRib2JfobJbs-5Fwj7FTHkvf8Wt8aogiVyeO4BsCBa0mRwXpuH55s_4ejjfSTA0hDc1ye--h6lyOQK-_FscJ-zwrMLME6JlE5q_nij-aCQ5dYuTatzsdvEArNZ9nBxH3aw4aPdkuFiSzU Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: X-Openstack-Nova-Api-Version: 2.47 Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: d63f1533a3fd4dc18b6169f3270922b7 Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerShowV247Test-613742821 Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d63f1533a3fd4dc18b6169f3270922b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d63f1533a3fd4dc18b6169f3270922b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d63f1533a3fd4dc18b6169f3270922b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d63f1533a3fd4dc18b6169f3270922b7"}]}] Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerShowV247Test-613742821 Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: d63f1533a3fd4dc18b6169f3270922b7 Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerShowV247Test-613742821 Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerShowV247Test-613742821-project Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 9e0e028c4fec4c38be22f1f74b2d79f1 Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerShowV247Test-613742821-project Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance e8daa465-8a5f-42f2-aefa-d76c10de016a could not be found. Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'e8daa465-8a5f-42f2-aefa-d76c10de016a'} Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8daa465-8a5f-42f2-aefa-d76c10de016a could not be found. Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8daa465-8a5f-42f2-aefa-d76c10de016a could not be found. Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:53.022924 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:08:53.029283 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:53.029283 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:53.029283 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:53.029283 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:08:53.029283 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:08:53.029283 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8daa465-8a5f-42f2-aefa-d76c10de016a could not be found. Oct 29 03:08:53.029283 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:08:53.032391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a2ec3f7e-f03d-4731-a0af-259d395e07b2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Returning 404 to user: Instance e8daa465-8a5f-42f2-aefa-d76c10de016a could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:53.034274 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a2ec3f7e-f03d-4731-a0af-259d395e07b2 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a" status: 404 len: 111 microversion: 2.47 time: 0.085841 Oct 29 03:08:53.035286 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2096/4385] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:52 2022] GET /compute/v2.1/servers/e8daa465-8a5f-42f2-aefa-d76c10de016a => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:08:53.042756 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-866cfb4a-63c1-4963-91b1-38069efd8815 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:53.043470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-866cfb4a-63c1-4963-91b1-38069efd8815 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:53.049990 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-866cfb4a-63c1-4963-91b1-38069efd8815 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:53.050789 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-866cfb4a-63c1-4963-91b1-38069efd8815 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:53.051408 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-866cfb4a-63c1-4963-91b1-38069efd8815 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:53.052339 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-866cfb4a-63c1-4963-91b1-38069efd8815 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:53.053061 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-866cfb4a-63c1-4963-91b1-38069efd8815 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:53.053690 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-866cfb4a-63c1-4963-91b1-38069efd8815 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:53.093293 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-866cfb4a-63c1-4963-91b1-38069efd8815 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:08:53.143882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-37c16cb5-6b25-437e-bd76-bec3a4121399 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:53.155411 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-37c16cb5-6b25-437e-bd76-bec3a4121399 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1322 microversion: 2.1 time: 0.314135 Oct 29 03:08:53.164692 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2290/4386] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:52 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:53.197552 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9b9fcb28-7068-47db-a20b-b041c542aa5c tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9b9fcb28-7068-47db-a20b-b041c542aa5c tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Request method failure captured: Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJkZpRH_5I0VEWenSx_2qthFArNon1K0nfO2BIJXwF7d_xI3qcHWkWKzFJXYpaUesV6bEt8bMGH0Lx8nWLk6ooHEQz2PNWzJ5dxEmDqJrBtoz-xlzX3omFTGuKn_Zy89ScGPhUln_8-bCJzTxISTwiJ8bTo4xYVYeQAIJMKFGVYs0C4 Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 0c1e510b5644490d839cefd879108416 Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ListServersNegativeTestJSON-1914539329 Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c1e510b5644490d839cefd879108416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c1e510b5644490d839cefd879108416"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c1e510b5644490d839cefd879108416"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c1e510b5644490d839cefd879108416"}]}] Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ListServersNegativeTestJSON-1914539329 Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 0c1e510b5644490d839cefd879108416 Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1914539329 Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ListServersNegativeTestJSON-1914539329-project Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 94aca590158c420399a46af6c9e88bb8 Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ListServersNegativeTestJSON-1914539329-project Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: action_args: {} Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 29 03:08:53.202932 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:08:53.207912 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:08:53.207912 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:08:53.207912 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:08:53.207912 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 29 03:08:53.207912 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:53.207912 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:53.207912 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:53.207912 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:53.207912 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:53.207912 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:53.207912 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:08:53.207912 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:08:53.207912 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 29 03:08:53.207912 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:53.214088 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9b9fcb28-7068-47db-a20b-b041c542aa5c tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:53.215359 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9b9fcb28-7068-47db-a20b-b041c542aa5c tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.044043 Oct 29 03:08:53.226259 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2291/4387] 10.222.0.46 () {58 vars in 1182 bytes} [Sat Oct 29 03:08:53 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:08:53.236332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-57acbc50-e421-428c-9533-70f50bbe4c01 req-c63f7752-908d-424d-88cf-be94f042b619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d04a110-8ee9-4c6d-a68a-49e8493b8be2", "name": "network-vif-plugged", "status": "completed", "tag": "b3ee4f85-8bd6-4217-9d11-7140be55636a"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:53.257562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-57acbc50-e421-428c-9533-70f50bbe4c01 req-c63f7752-908d-424d-88cf-be94f042b619 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:53.258226 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-866cfb4a-63c1-4963-91b1-38069efd8815 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 204 len: 0 microversion: 2.1 time: 0.216786 Oct 29 03:08:53.258694 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-57acbc50-e421-428c-9533-70f50bbe4c01 req-c63f7752-908d-424d-88cf-be94f042b619 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:53.261277 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2097/4388] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:08:53 2022] DELETE /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:08:53.266450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-57acbc50-e421-428c-9533-70f50bbe4c01 req-c63f7752-908d-424d-88cf-be94f042b619 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:53.278728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9fc6b3ff-05bc-46d3-bd0f-ad5e9f2a4fb3 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:53.279350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9fc6b3ff-05bc-46d3-bd0f-ad5e9f2a4fb3 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: 924784e9-e94f-44d8-88e3-adfca6a35372] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:53.285741 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-57acbc50-e421-428c-9533-70f50bbe4c01 req-c63f7752-908d-424d-88cf-be94f042b619 service nova] Creating event network-vif-plugged:b3ee4f85-8bd6-4217-9d11-7140be55636a for instance 3d04a110-8ee9-4c6d-a68a-49e8493b8be2 on n-h2-862967-2 Oct 29 03:08:53.300467 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-57acbc50-e421-428c-9533-70f50bbe4c01 req-c63f7752-908d-424d-88cf-be94f042b619 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069453 Oct 29 03:08:53.303588 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2292/4389] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:53.307376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9fc6b3ff-05bc-46d3-bd0f-ad5e9f2a4fb3 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:53.309980 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9fc6b3ff-05bc-46d3-bd0f-ad5e9f2a4fb3 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:53.310714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9fc6b3ff-05bc-46d3-bd0f-ad5e9f2a4fb3 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:53.313481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9fc6b3ff-05bc-46d3-bd0f-ad5e9f2a4fb3 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:53.314935 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0027a78f-2e7a-4d82-9c62-fdc9cca199fb tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:53.320478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0027a78f-2e7a-4d82-9c62-fdc9cca199fb tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:53.321733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0027a78f-2e7a-4d82-9c62-fdc9cca199fb tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Searching by: {'deleted': False, 'project_id': '0c1e510b5644490d839cefd879108416'} {{(pid=127124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:08:53.327242 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9fc6b3ff-05bc-46d3-bd0f-ad5e9f2a4fb3 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:53.328013 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9fc6b3ff-05bc-46d3-bd0f-ad5e9f2a4fb3 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:53.329990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0027a78f-2e7a-4d82-9c62-fdc9cca199fb tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:53.330778 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0027a78f-2e7a-4d82-9c62-fdc9cca199fb tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:53.331507 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0027a78f-2e7a-4d82-9c62-fdc9cca199fb tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:53.332646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0027a78f-2e7a-4d82-9c62-fdc9cca199fb tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:53.333564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0027a78f-2e7a-4d82-9c62-fdc9cca199fb tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:53.334266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0027a78f-2e7a-4d82-9c62-fdc9cca199fb tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:53.371169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.multi_cell_list [None req-0027a78f-2e7a-4d82-9c62-fdc9cca199fb tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:08:53.406471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9fc6b3ff-05bc-46d3-bd0f-ad5e9f2a4fb3 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: 924784e9-e94f-44d8-88e3-adfca6a35372] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:08:53.443622 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0027a78f-2e7a-4d82-9c62-fdc9cca199fb tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.138281 Oct 29 03:08:53.451800 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2293/4390] 10.222.0.46 () {58 vars in 1125 bytes} [Sat Oct 29 03:08:53 2022] GET /compute/v2.1/servers => generated 681 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:53.457798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e3e0448b-fe49-4a20-a1d0-a5ba406bd651 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:53.458969 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e3e0448b-fe49-4a20-a1d0-a5ba406bd651 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:53.467314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e3e0448b-fe49-4a20-a1d0-a5ba406bd651 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:53.467908 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e3e0448b-fe49-4a20-a1d0-a5ba406bd651 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:53.468431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e3e0448b-fe49-4a20-a1d0-a5ba406bd651 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:53.469310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e3e0448b-fe49-4a20-a1d0-a5ba406bd651 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:53.469846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e3e0448b-fe49-4a20-a1d0-a5ba406bd651 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:53.470485 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e3e0448b-fe49-4a20-a1d0-a5ba406bd651 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:53.585752 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9fc6b3ff-05bc-46d3-bd0f-ad5e9f2a4fb3 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "DELETE /compute/v2.1/servers/924784e9-e94f-44d8-88e3-adfca6a35372" status: 204 len: 0 microversion: 2.47 time: 0.320745 Oct 29 03:08:53.587102 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2098/4391] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Oct 29 03:08:53 2022] DELETE /compute/v2.1/servers/924784e9-e94f-44d8-88e3-adfca6a35372 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:08:53.597904 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-24c71a91-a1e9-4644-9003-13108dad6a4d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:53.606900 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-24c71a91-a1e9-4644-9003-13108dad6a4d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:53.607535 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.compute.servers [None req-24c71a91-a1e9-4644-9003-13108dad6a4d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Removing options 'limit' from query {{(pid=127125) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 29 03:08:53.608578 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-24c71a91-a1e9-4644-9003-13108dad6a4d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Searching by: {'deleted': False, 'project_id': '0c1e510b5644490d839cefd879108416'} {{(pid=127125) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:08:53.615306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24c71a91-a1e9-4644-9003-13108dad6a4d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:53.616230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24c71a91-a1e9-4644-9003-13108dad6a4d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:53.616658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24c71a91-a1e9-4644-9003-13108dad6a4d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:53.617531 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24c71a91-a1e9-4644-9003-13108dad6a4d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:53.618129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24c71a91-a1e9-4644-9003-13108dad6a4d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:53.618640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24c71a91-a1e9-4644-9003-13108dad6a4d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:53.662383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.multi_cell_list [None req-24c71a91-a1e9-4644-9003-13108dad6a4d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=127125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:08:53.712194 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-24c71a91-a1e9-4644-9003-13108dad6a4d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.123260 Oct 29 03:08:53.721680 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2099/4392] 10.222.0.46 () {58 vars in 1144 bytes} [Sat Oct 29 03:08:53 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:53.721680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-104604f6-32f4-4138-8104-d60252f06a9c tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:53.721680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-104604f6-32f4-4138-8104-d60252f06a9c tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: 924784e9-e94f-44d8-88e3-adfca6a35372] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:53.733859 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-104604f6-32f4-4138-8104-d60252f06a9c tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:53.734590 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-104604f6-32f4-4138-8104-d60252f06a9c tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:53.736584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-104604f6-32f4-4138-8104-d60252f06a9c tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:53.736996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-104604f6-32f4-4138-8104-d60252f06a9c tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:53.737963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-104604f6-32f4-4138-8104-d60252f06a9c tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:53.740766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-104604f6-32f4-4138-8104-d60252f06a9c tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:53.806441 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e3e0448b-fe49-4a20-a1d0-a5ba406bd651 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:53.816143 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e3e0448b-fe49-4a20-a1d0-a5ba406bd651 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1466 microversion: 2.1 time: 0.362603 Oct 29 03:08:53.818120 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2294/4393] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:53 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1466 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:53.824166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9484d70f-0d82-433e-b5d2-1b7b27099822 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9484d70f-0d82-433e-b5d2-1b7b27099822 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Request method failure captured: Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJkZpRH_5I0VEWenSx_2qthFArNon1K0nfO2BIJXwF7d_xI3qcHWkWKzFJXYpaUesV6bEt8bMGH0Lx8nWLk6ooHEQz2PNWzJ5dxEmDqJrBtoz-xlzX3omFTGuKn_Zy89ScGPhUln_8-bCJzTxISTwiJ8bTo4xYVYeQAIJMKFGVYs0C4 Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 0c1e510b5644490d839cefd879108416 Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ListServersNegativeTestJSON-1914539329 Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c1e510b5644490d839cefd879108416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c1e510b5644490d839cefd879108416"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c1e510b5644490d839cefd879108416"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c1e510b5644490d839cefd879108416"}]}] Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ListServersNegativeTestJSON-1914539329 Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 0c1e510b5644490d839cefd879108416 Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1914539329 Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ListServersNegativeTestJSON-1914539329-project Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 94aca590158c420399a46af6c9e88bb8 Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ListServersNegativeTestJSON-1914539329-project Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: action_args: {} Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi '-1' Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 29 03:08:53.832446 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 29 03:08:53.836639 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:08:53.836639 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:08:53.836639 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:08:53.836639 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:08:53.836639 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 29 03:08:53.836639 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:53.836639 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:53.836639 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:53.836639 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:53.836639 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:53.836639 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:53.836639 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:08:53.836639 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:08:53.836639 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 29 03:08:53.836639 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:53.839832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9484d70f-0d82-433e-b5d2-1b7b27099822 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:53.849274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-104604f6-32f4-4138-8104-d60252f06a9c tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:53.859788 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9484d70f-0d82-433e-b5d2-1b7b27099822 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.040061 Oct 29 03:08:53.862242 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2295/4394] 10.222.0.46 () {58 vars in 1142 bytes} [Sat Oct 29 03:08:53 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:08:53.864407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-104604f6-32f4-4138-8104-d60252f06a9c tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:53.870709 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-104604f6-32f4-4138-8104-d60252f06a9c tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:53.873919 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-104604f6-32f4-4138-8104-d60252f06a9c tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/924784e9-e94f-44d8-88e3-adfca6a35372" status: 200 len: 1363 microversion: 2.47 time: 0.159281 Oct 29 03:08:53.888775 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2100/4395] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:53 2022] GET /compute/v2.1/servers/924784e9-e94f-44d8-88e3-adfca6a35372 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:08:53.889117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bdabfd8e-d095-454c-81cb-416ff6eb2a25 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bdabfd8e-d095-454c-81cb-416ff6eb2a25 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Request method failure captured: Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJkZpRH_5I0VEWenSx_2qthFArNon1K0nfO2BIJXwF7d_xI3qcHWkWKzFJXYpaUesV6bEt8bMGH0Lx8nWLk6ooHEQz2PNWzJ5dxEmDqJrBtoz-xlzX3omFTGuKn_Zy89ScGPhUln_8-bCJzTxISTwiJ8bTo4xYVYeQAIJMKFGVYs0C4 Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 0c1e510b5644490d839cefd879108416 Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ListServersNegativeTestJSON-1914539329 Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c1e510b5644490d839cefd879108416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c1e510b5644490d839cefd879108416"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c1e510b5644490d839cefd879108416"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c1e510b5644490d839cefd879108416"}]}] Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ListServersNegativeTestJSON-1914539329 Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 0c1e510b5644490d839cefd879108416 Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1914539329 Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ListServersNegativeTestJSON-1914539329-project Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 94aca590158c420399a46af6c9e88bb8 Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ListServersNegativeTestJSON-1914539329-project Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: action_args: {} Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'testing' Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 29 03:08:53.898636 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 29 03:08:53.903897 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:08:53.903897 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:08:53.903897 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:08:53.903897 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:08:53.903897 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 29 03:08:53.903897 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:53.903897 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:53.903897 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:53.903897 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:53.903897 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:53.903897 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:53.903897 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:08:53.903897 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:08:53.903897 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 29 03:08:53.903897 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:53.903897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bdabfd8e-d095-454c-81cb-416ff6eb2a25 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:53.905103 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bdabfd8e-d095-454c-81cb-416ff6eb2a25 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.036492 Oct 29 03:08:53.908746 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2296/4396] 10.222.0.46 () {58 vars in 1152 bytes} [Sat Oct 29 03:08:53 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:08:53.914556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8adce543-8e9f-4a18-b225-11771e72be06 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:53.920414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8adce543-8e9f-4a18-b225-11771e72be06 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:53.921575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8adce543-8e9f-4a18-b225-11771e72be06 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '0c1e510b5644490d839cefd879108416'} {{(pid=127125) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:08:53.934974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.compute.servers [None req-8adce543-8e9f-4a18-b225-11771e72be06 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Flavor 'non_existing_flavor' could not be found {{(pid=127125) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 29 03:08:53.936357 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8adce543-8e9f-4a18-b225-11771e72be06 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.025867 Oct 29 03:08:53.946833 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2101/4397] 10.222.0.46 () {58 vars in 1178 bytes} [Sat Oct 29 03:08:53 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:08:53.962125 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6956950c-ed9a-4598-bfe3-01c54e0a39bf tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:53.965550 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d0198263-d1c1-4474-9e13-8ac95e648fac tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:53.967507 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6956950c-ed9a-4598-bfe3-01c54e0a39bf tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:53.971979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d0198263-d1c1-4474-9e13-8ac95e648fac tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:53.972706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d0198263-d1c1-4474-9e13-8ac95e648fac tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '0c1e510b5644490d839cefd879108416'} {{(pid=127124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:08:53.993705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6956950c-ed9a-4598-bfe3-01c54e0a39bf tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:53.995040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6956950c-ed9a-4598-bfe3-01c54e0a39bf tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:53.996125 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6956950c-ed9a-4598-bfe3-01c54e0a39bf tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:53.997745 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6956950c-ed9a-4598-bfe3-01c54e0a39bf tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:53.998665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6956950c-ed9a-4598-bfe3-01c54e0a39bf tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:53.999488 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6956950c-ed9a-4598-bfe3-01c54e0a39bf tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:54.000693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0198263-d1c1-4474-9e13-8ac95e648fac tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:54.001266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0198263-d1c1-4474-9e13-8ac95e648fac tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:54.001724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0198263-d1c1-4474-9e13-8ac95e648fac tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:54.002555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0198263-d1c1-4474-9e13-8ac95e648fac tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:54.006567 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0198263-d1c1-4474-9e13-8ac95e648fac tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:54.007625 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0198263-d1c1-4474-9e13-8ac95e648fac tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:54.172935 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d0198263-d1c1-4474-9e13-8ac95e648fac tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.217894 Oct 29 03:08:54.180866 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2297/4398] 10.222.0.46 () {58 vars in 1174 bytes} [Sat Oct 29 03:08:53 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:08:54.187287 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eb9db63a-129f-4840-b9b1-948d404da8e1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:54.188475 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-eb9db63a-129f-4840-b9b1-948d404da8e1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:54.196176 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb9db63a-129f-4840-b9b1-948d404da8e1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:54.198337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb9db63a-129f-4840-b9b1-948d404da8e1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:54.199099 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb9db63a-129f-4840-b9b1-948d404da8e1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:54.200055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb9db63a-129f-4840-b9b1-948d404da8e1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:54.200757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb9db63a-129f-4840-b9b1-948d404da8e1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:54.201357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb9db63a-129f-4840-b9b1-948d404da8e1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:54.569009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6956950c-ed9a-4598-bfe3-01c54e0a39bf tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:54.586523 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6956950c-ed9a-4598-bfe3-01c54e0a39bf tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1723 microversion: 2.1 time: 0.631614 Oct 29 03:08:54.588805 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2102/4399] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:53 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1723 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:54.604367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6755ce56-d5e7-4367-a493-c8e755062167 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:54.624266 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6755ce56-d5e7-4367-a493-c8e755062167 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:54.627607 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6755ce56-d5e7-4367-a493-c8e755062167 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '0c1e510b5644490d839cefd879108416'} {{(pid=127125) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:08:54.642082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6755ce56-d5e7-4367-a493-c8e755062167 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:54.643014 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6755ce56-d5e7-4367-a493-c8e755062167 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:54.644623 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6755ce56-d5e7-4367-a493-c8e755062167 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:54.645612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6755ce56-d5e7-4367-a493-c8e755062167 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:54.649197 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6755ce56-d5e7-4367-a493-c8e755062167 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:54.650239 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6755ce56-d5e7-4367-a493-c8e755062167 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:54.675046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-eb9db63a-129f-4840-b9b1-948d404da8e1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:54.687548 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eb9db63a-129f-4840-b9b1-948d404da8e1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1322 microversion: 2.1 time: 0.503601 Oct 29 03:08:54.704303 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2298/4400] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:54 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1322 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:54.802710 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6755ce56-d5e7-4367-a493-c8e755062167 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.210853 Oct 29 03:08:54.803677 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2103/4401] 10.222.0.46 () {58 vars in 1184 bytes} [Sat Oct 29 03:08:54 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:08:54.816196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-34e57e32-7672-4134-a7e1-3e91275ca403 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:54.822993 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-34e57e32-7672-4134-a7e1-3e91275ca403 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:54.823773 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-34e57e32-7672-4134-a7e1-3e91275ca403 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Searching by: {'deleted': False, 'project_id': '0c1e510b5644490d839cefd879108416'} {{(pid=127124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:08:54.829639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34e57e32-7672-4134-a7e1-3e91275ca403 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:54.830506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34e57e32-7672-4134-a7e1-3e91275ca403 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:54.831166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34e57e32-7672-4134-a7e1-3e91275ca403 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:54.832446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34e57e32-7672-4134-a7e1-3e91275ca403 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:54.832941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34e57e32-7672-4134-a7e1-3e91275ca403 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:54.833369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34e57e32-7672-4134-a7e1-3e91275ca403 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:54.841120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b198302f-c8f5-4aed-ac99-b642b65a59a6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:54.842018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b198302f-c8f5-4aed-ac99-b642b65a59a6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:54.855020 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b198302f-c8f5-4aed-ac99-b642b65a59a6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:54.855518 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b198302f-c8f5-4aed-ac99-b642b65a59a6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:54.855958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b198302f-c8f5-4aed-ac99-b642b65a59a6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:54.856712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b198302f-c8f5-4aed-ac99-b642b65a59a6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:54.857166 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b198302f-c8f5-4aed-ac99-b642b65a59a6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:54.857594 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b198302f-c8f5-4aed-ac99-b642b65a59a6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:54.882633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.multi_cell_list [None req-34e57e32-7672-4134-a7e1-3e91275ca403 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:08:54.883166 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:54.933872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-34e57e32-7672-4134-a7e1-3e91275ca403 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:54.942126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34e57e32-7672-4134-a7e1-3e91275ca403 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:54.942948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34e57e32-7672-4134-a7e1-3e91275ca403 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:54.943554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34e57e32-7672-4134-a7e1-3e91275ca403 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:55.158979 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-34e57e32-7672-4134-a7e1-3e91275ca403 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.346533 Oct 29 03:08:55.159588 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2299/4402] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 03:08:54 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:55.165163 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-68b5f0f8-8aa0-4ad4-b5ee-6cc4b2823b16 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:55.166073 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-68b5f0f8-8aa0-4ad4-b5ee-6cc4b2823b16 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: 924784e9-e94f-44d8-88e3-adfca6a35372] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:55.173375 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68b5f0f8-8aa0-4ad4-b5ee-6cc4b2823b16 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:55.174244 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68b5f0f8-8aa0-4ad4-b5ee-6cc4b2823b16 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:55.174950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68b5f0f8-8aa0-4ad4-b5ee-6cc4b2823b16 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:55.176704 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68b5f0f8-8aa0-4ad4-b5ee-6cc4b2823b16 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:55.177538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68b5f0f8-8aa0-4ad4-b5ee-6cc4b2823b16 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:55.178224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68b5f0f8-8aa0-4ad4-b5ee-6cc4b2823b16 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:55.287671 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-68b5f0f8-8aa0-4ad4-b5ee-6cc4b2823b16 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:55.303445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-68b5f0f8-8aa0-4ad4-b5ee-6cc4b2823b16 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:55.306388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-68b5f0f8-8aa0-4ad4-b5ee-6cc4b2823b16 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:55.308405 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-68b5f0f8-8aa0-4ad4-b5ee-6cc4b2823b16 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/924784e9-e94f-44d8-88e3-adfca6a35372" status: 200 len: 1363 microversion: 2.47 time: 0.147857 Oct 29 03:08:55.309535 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2300/4403] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:55 2022] GET /compute/v2.1/servers/924784e9-e94f-44d8-88e3-adfca6a35372 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:08:55.315415 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-372211a2-819d-4199-abf2-cee5c4bb0a9e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:55.329052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-372211a2-819d-4199-abf2-cee5c4bb0a9e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:55.332229 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-372211a2-819d-4199-abf2-cee5c4bb0a9e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.020509 Oct 29 03:08:55.334614 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2301/4404] 10.222.0.46 () {58 vars in 1178 bytes} [Sat Oct 29 03:08:55 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:08:55.362396 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-8e4a1bf5-f37e-4b24-8d19-e42d82e7fef5 req-6f64a6cc-e2c4-456a-ac3d-e4469f0fe87f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c25c557-35b6-4dce-99f0-4e2b1c43cf40", "name": "network-vif-plugged", "status": "completed", "tag": "544bbd3a-133a-48fc-85fa-eb236d549271"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:55.375803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8e4a1bf5-f37e-4b24-8d19-e42d82e7fef5 req-6f64a6cc-e2c4-456a-ac3d-e4469f0fe87f service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:55.376827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8e4a1bf5-f37e-4b24-8d19-e42d82e7fef5 req-6f64a6cc-e2c4-456a-ac3d-e4469f0fe87f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:55.377514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8e4a1bf5-f37e-4b24-8d19-e42d82e7fef5 req-6f64a6cc-e2c4-456a-ac3d-e4469f0fe87f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:55.393989 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-8e4a1bf5-f37e-4b24-8d19-e42d82e7fef5 req-6f64a6cc-e2c4-456a-ac3d-e4469f0fe87f service nova] Creating event network-vif-plugged:544bbd3a-133a-48fc-85fa-eb236d549271 for instance 3c25c557-35b6-4dce-99f0-4e2b1c43cf40 on n-h1-862967-2 Oct 29 03:08:55.402177 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-8e4a1bf5-f37e-4b24-8d19-e42d82e7fef5 req-6f64a6cc-e2c4-456a-ac3d-e4469f0fe87f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055771 Oct 29 03:08:55.403460 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2302/4405] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:55.411249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-825338f8-bb5b-431f-89ca-87dee3d30232 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:55.417728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-825338f8-bb5b-431f-89ca-87dee3d30232 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:55.418830 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-825338f8-bb5b-431f-89ca-87dee3d30232 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Searching by: {'deleted': False, 'project_id': '0c1e510b5644490d839cefd879108416'} {{(pid=127124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:08:55.424651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-825338f8-bb5b-431f-89ca-87dee3d30232 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:55.427069 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-825338f8-bb5b-431f-89ca-87dee3d30232 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:55.428615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-825338f8-bb5b-431f-89ca-87dee3d30232 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:55.429621 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-825338f8-bb5b-431f-89ca-87dee3d30232 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:55.430317 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-825338f8-bb5b-431f-89ca-87dee3d30232 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:55.431503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-825338f8-bb5b-431f-89ca-87dee3d30232 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:55.466782 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.multi_cell_list [None req-825338f8-bb5b-431f-89ca-87dee3d30232 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:08:55.505375 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-825338f8-bb5b-431f-89ca-87dee3d30232 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.100127 Oct 29 03:08:55.506159 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2303/4406] 10.222.0.46 () {58 vars in 1125 bytes} [Sat Oct 29 03:08:55 2022] GET /compute/v2.1/servers => generated 681 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:55.520098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b198302f-c8f5-4aed-ac99-b642b65a59a6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:55.520821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8fb888bb-6036-4ee4-86ea-b344f366866d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:55.521450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8fb888bb-6036-4ee4-86ea-b344f366866d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: 79b80ca1-484d-4fd4-9002-ef3626fd858b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:55.532325 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b198302f-c8f5-4aed-ac99-b642b65a59a6 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1466 microversion: 2.1 time: 0.695071 Oct 29 03:08:55.536036 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2104/4407] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:54 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1466 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:08:55.537494 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fb888bb-6036-4ee4-86ea-b344f366866d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:55.538114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fb888bb-6036-4ee4-86ea-b344f366866d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:55.538741 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fb888bb-6036-4ee4-86ea-b344f366866d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:55.539555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fb888bb-6036-4ee4-86ea-b344f366866d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:55.541339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fb888bb-6036-4ee4-86ea-b344f366866d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:55.542070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fb888bb-6036-4ee4-86ea-b344f366866d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:55.570729 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-8fb888bb-6036-4ee4-86ea-b344f366866d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] HTTP exception thrown: Instance 79b80ca1-484d-4fd4-9002-ef3626fd858b could not be found. Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8fb888bb-6036-4ee4-86ea-b344f366866d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Request method failure captured: Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/servers/79b80ca1-484d-4fd4-9002-ef3626fd858b HTTP/1.1 Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJkZpRH_5I0VEWenSx_2qthFArNon1K0nfO2BIJXwF7d_xI3qcHWkWKzFJXYpaUesV6bEt8bMGH0Lx8nWLk6ooHEQz2PNWzJ5dxEmDqJrBtoz-xlzX3omFTGuKn_Zy89ScGPhUln_8-bCJzTxISTwiJ8bTo4xYVYeQAIJMKFGVYs0C4 Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 0c1e510b5644490d839cefd879108416 Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ListServersNegativeTestJSON-1914539329 Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c1e510b5644490d839cefd879108416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c1e510b5644490d839cefd879108416"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c1e510b5644490d839cefd879108416"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c1e510b5644490d839cefd879108416"}]}] Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ListServersNegativeTestJSON-1914539329 Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 0c1e510b5644490d839cefd879108416 Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1914539329 Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ListServersNegativeTestJSON-1914539329-project Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 94aca590158c420399a46af6c9e88bb8 Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ListServersNegativeTestJSON-1914539329-project Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 79b80ca1-484d-4fd4-9002-ef3626fd858b could not be found. Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '79b80ca1-484d-4fd4-9002-ef3626fd858b'} Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79b80ca1-484d-4fd4-9002-ef3626fd858b could not be found. Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:08:55.572892 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:08:55.577556 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79b80ca1-484d-4fd4-9002-ef3626fd858b could not be found. Oct 29 03:08:55.577556 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:55.577556 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:55.577556 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:55.577556 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:55.577556 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:55.577556 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:55.577556 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:08:55.577556 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:08:55.577556 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79b80ca1-484d-4fd4-9002-ef3626fd858b could not be found. Oct 29 03:08:55.577556 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:55.577556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8fb888bb-6036-4ee4-86ea-b344f366866d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Returning 404 to user: Instance 79b80ca1-484d-4fd4-9002-ef3626fd858b could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:55.577556 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8fb888bb-6036-4ee4-86ea-b344f366866d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "DELETE /compute/v2.1/servers/79b80ca1-484d-4fd4-9002-ef3626fd858b" status: 404 len: 111 microversion: 2.1 time: 0.059980 Oct 29 03:08:55.579232 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2304/4408] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:08:55 2022] DELETE /compute/v2.1/servers/79b80ca1-484d-4fd4-9002-ef3626fd858b => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:08:55.587330 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a919e8c4-438e-480b-8008-fbdf6fa471bf tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:55.587833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a919e8c4-438e-480b-8008-fbdf6fa471bf tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: 3c597067-efff-40a4-b890-1c6e7a69e96e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:55.599679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a919e8c4-438e-480b-8008-fbdf6fa471bf tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:55.600182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a919e8c4-438e-480b-8008-fbdf6fa471bf tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:55.608279 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a919e8c4-438e-480b-8008-fbdf6fa471bf tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:55.609733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a919e8c4-438e-480b-8008-fbdf6fa471bf tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:55.610544 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a919e8c4-438e-480b-8008-fbdf6fa471bf tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:55.611286 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a919e8c4-438e-480b-8008-fbdf6fa471bf tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:55.614131 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f9432380-6c3b-4b81-ad23-438a20e0f8a1 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:55.615012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f9432380-6c3b-4b81-ad23-438a20e0f8a1 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:55.623724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9432380-6c3b-4b81-ad23-438a20e0f8a1 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:55.628956 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9432380-6c3b-4b81-ad23-438a20e0f8a1 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:55.629560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9432380-6c3b-4b81-ad23-438a20e0f8a1 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:55.630693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9432380-6c3b-4b81-ad23-438a20e0f8a1 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:55.631288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9432380-6c3b-4b81-ad23-438a20e0f8a1 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:55.632710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9432380-6c3b-4b81-ad23-438a20e0f8a1 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:55.683862 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a919e8c4-438e-480b-8008-fbdf6fa471bf tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: 3c597067-efff-40a4-b890-1c6e7a69e96e] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:08:55.837247 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a919e8c4-438e-480b-8008-fbdf6fa471bf tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3c597067-efff-40a4-b890-1c6e7a69e96e" status: 204 len: 0 microversion: 2.1 time: 0.253192 Oct 29 03:08:55.841712 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2105/4409] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:08:55 2022] DELETE /compute/v2.1/servers/3c597067-efff-40a4-b890-1c6e7a69e96e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:08:55.848708 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a82234df-bada-414e-ae69-82d8d9f705d7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:55.849459 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a82234df-bada-414e-ae69-82d8d9f705d7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:55.858118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a82234df-bada-414e-ae69-82d8d9f705d7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:55.859208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a82234df-bada-414e-ae69-82d8d9f705d7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:55.859208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a82234df-bada-414e-ae69-82d8d9f705d7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:55.859835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a82234df-bada-414e-ae69-82d8d9f705d7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:55.860390 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a82234df-bada-414e-ae69-82d8d9f705d7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:55.860956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a82234df-bada-414e-ae69-82d8d9f705d7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:56.241797 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a82234df-bada-414e-ae69-82d8d9f705d7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:56.251188 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a82234df-bada-414e-ae69-82d8d9f705d7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1516 microversion: 2.1 time: 0.406908 Oct 29 03:08:56.251815 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2106/4410] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:55 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1516 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:56.260390 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-35538095-1758-4175-9bf7-5920059ab60a tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:56.262238 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-35538095-1758-4175-9bf7-5920059ab60a tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: ba75665d-3656-45c2-8bd8-f6dc6a66c851] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:56.278275 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35538095-1758-4175-9bf7-5920059ab60a tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:56.279139 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35538095-1758-4175-9bf7-5920059ab60a tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:56.284855 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35538095-1758-4175-9bf7-5920059ab60a tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:56.285741 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35538095-1758-4175-9bf7-5920059ab60a tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:56.286231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35538095-1758-4175-9bf7-5920059ab60a tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:56.286667 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35538095-1758-4175-9bf7-5920059ab60a tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:56.361259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-35538095-1758-4175-9bf7-5920059ab60a tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: ba75665d-3656-45c2-8bd8-f6dc6a66c851] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:08:56.560089 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-35538095-1758-4175-9bf7-5920059ab60a tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851" status: 204 len: 0 microversion: 2.1 time: 0.306927 Oct 29 03:08:56.560858 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2107/4411] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:08:56 2022] DELETE /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:08:56.566432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0fd4368d-7b85-42ad-b3ed-bb1a589e19c0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:56.569277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0fd4368d-7b85-42ad-b3ed-bb1a589e19c0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:56.593125 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fd4368d-7b85-42ad-b3ed-bb1a589e19c0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:56.593621 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fd4368d-7b85-42ad-b3ed-bb1a589e19c0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:56.594055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fd4368d-7b85-42ad-b3ed-bb1a589e19c0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:56.594769 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fd4368d-7b85-42ad-b3ed-bb1a589e19c0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:56.595216 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fd4368d-7b85-42ad-b3ed-bb1a589e19c0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:56.595634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fd4368d-7b85-42ad-b3ed-bb1a589e19c0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:56.622551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-0fd4368d-7b85-42ad-b3ed-bb1a589e19c0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lazy-loading 'flavor' on Instance uuid 3d04a110-8ee9-4c6d-a68a-49e8493b8be2 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:08:56.746809 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0fd4368d-7b85-42ad-b3ed-bb1a589e19c0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "POST /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2/action" status: 200 len: 32 microversion: 2.1 time: 0.184614 Oct 29 03:08:56.748335 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2108/4412] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:08:56 2022] POST /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2/action => generated 32 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:08:56.760658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f0313585-ee37-463b-905f-7275442f3c24 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:56.761885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f0313585-ee37-463b-905f-7275442f3c24 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: 924784e9-e94f-44d8-88e3-adfca6a35372] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:56.771914 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f0313585-ee37-463b-905f-7275442f3c24 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:56.772991 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f0313585-ee37-463b-905f-7275442f3c24 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:56.773644 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f0313585-ee37-463b-905f-7275442f3c24 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:56.774713 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f0313585-ee37-463b-905f-7275442f3c24 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:56.775538 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f0313585-ee37-463b-905f-7275442f3c24 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:56.776296 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f0313585-ee37-463b-905f-7275442f3c24 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:56.831480 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f0313585-ee37-463b-905f-7275442f3c24 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:56.831968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f0313585-ee37-463b-905f-7275442f3c24 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:56.832644 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f0313585-ee37-463b-905f-7275442f3c24 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:56.833253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-f0313585-ee37-463b-905f-7275442f3c24 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lazy-loading 'fault' on Instance uuid 924784e9-e94f-44d8-88e3-adfca6a35372 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:08:56.974182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f0313585-ee37-463b-905f-7275442f3c24 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:56.988207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f0313585-ee37-463b-905f-7275442f3c24 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:56.989744 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f0313585-ee37-463b-905f-7275442f3c24 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e0e028c4fec4c38be22f1f74b2d79f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd63f1533a3fd4dc18b6169f3270922b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:56.990999 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f0313585-ee37-463b-905f-7275442f3c24 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/924784e9-e94f-44d8-88e3-adfca6a35372" status: 200 len: 1368 microversion: 2.47 time: 0.240707 Oct 29 03:08:56.996953 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2109/4413] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:56 2022] GET /compute/v2.1/servers/924784e9-e94f-44d8-88e3-adfca6a35372 => generated 1368 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:08:57.009609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-152968b4-e918-44bf-9ff3-a8d168314f98 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:57.010271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-152968b4-e918-44bf-9ff3-a8d168314f98 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:57.022288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-152968b4-e918-44bf-9ff3-a8d168314f98 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:57.022784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-152968b4-e918-44bf-9ff3-a8d168314f98 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:57.030302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-152968b4-e918-44bf-9ff3-a8d168314f98 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:57.031305 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-152968b4-e918-44bf-9ff3-a8d168314f98 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:57.031961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-152968b4-e918-44bf-9ff3-a8d168314f98 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:57.032709 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-152968b4-e918-44bf-9ff3-a8d168314f98 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:57.119231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-152968b4-e918-44bf-9ff3-a8d168314f98 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:57.121692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-152968b4-e918-44bf-9ff3-a8d168314f98 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:57.122143 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-152968b4-e918-44bf-9ff3-a8d168314f98 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:57.122608 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-152968b4-e918-44bf-9ff3-a8d168314f98 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lazy-loading 'fault' on Instance uuid 3c25c557-35b6-4dce-99f0-4e2b1c43cf40 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:08:57.324720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f9432380-6c3b-4b81-ad23-438a20e0f8a1 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:57.334589 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f9432380-6c3b-4b81-ad23-438a20e0f8a1 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1700 microversion: 2.1 time: 1.724943 Oct 29 03:08:57.349997 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2305/4414] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:55 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1700 bytes in 1741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:57.360107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-432360eb-2e4f-412e-9710-14e923a7710e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:57.361154 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-432360eb-2e4f-412e-9710-14e923a7710e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: 79b80ca1-484d-4fd4-9002-ef3626fd858b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:57.367681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-432360eb-2e4f-412e-9710-14e923a7710e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:57.368500 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-432360eb-2e4f-412e-9710-14e923a7710e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:57.369318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-432360eb-2e4f-412e-9710-14e923a7710e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:57.370337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-432360eb-2e4f-412e-9710-14e923a7710e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:57.371063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-432360eb-2e4f-412e-9710-14e923a7710e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:57.371706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-432360eb-2e4f-412e-9710-14e923a7710e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:57.387273 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-432360eb-2e4f-412e-9710-14e923a7710e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] HTTP exception thrown: Instance 79b80ca1-484d-4fd4-9002-ef3626fd858b could not be found. Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-432360eb-2e4f-412e-9710-14e923a7710e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Request method failure captured: Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/79b80ca1-484d-4fd4-9002-ef3626fd858b HTTP/1.1 Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJkZpRH_5I0VEWenSx_2qthFArNon1K0nfO2BIJXwF7d_xI3qcHWkWKzFJXYpaUesV6bEt8bMGH0Lx8nWLk6ooHEQz2PNWzJ5dxEmDqJrBtoz-xlzX3omFTGuKn_Zy89ScGPhUln_8-bCJzTxISTwiJ8bTo4xYVYeQAIJMKFGVYs0C4 Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 0c1e510b5644490d839cefd879108416 Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ListServersNegativeTestJSON-1914539329 Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c1e510b5644490d839cefd879108416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c1e510b5644490d839cefd879108416"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c1e510b5644490d839cefd879108416"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c1e510b5644490d839cefd879108416"}]}] Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ListServersNegativeTestJSON-1914539329 Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 0c1e510b5644490d839cefd879108416 Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1914539329 Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ListServersNegativeTestJSON-1914539329-project Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 94aca590158c420399a46af6c9e88bb8 Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ListServersNegativeTestJSON-1914539329-project Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 79b80ca1-484d-4fd4-9002-ef3626fd858b could not be found. Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '79b80ca1-484d-4fd4-9002-ef3626fd858b'} Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79b80ca1-484d-4fd4-9002-ef3626fd858b could not be found. Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79b80ca1-484d-4fd4-9002-ef3626fd858b could not be found. Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:57.389581 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:57.393264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:57.393264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:57.393264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:57.393264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:57.393264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:08:57.393264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:08:57.393264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79b80ca1-484d-4fd4-9002-ef3626fd858b could not be found. Oct 29 03:08:57.393264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:08:57.395777 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-432360eb-2e4f-412e-9710-14e923a7710e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Returning 404 to user: Instance 79b80ca1-484d-4fd4-9002-ef3626fd858b could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:57.396952 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-432360eb-2e4f-412e-9710-14e923a7710e tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers/79b80ca1-484d-4fd4-9002-ef3626fd858b" status: 404 len: 111 microversion: 2.1 time: 0.045618 Oct 29 03:08:57.398095 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2306/4415] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:57 2022] GET /compute/v2.1/servers/79b80ca1-484d-4fd4-9002-ef3626fd858b => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:08:57.403201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ff5d97a5-933c-4231-8931-c8f056fe34c6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:57.408187 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ff5d97a5-933c-4231-8931-c8f056fe34c6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:57.419338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff5d97a5-933c-4231-8931-c8f056fe34c6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:57.420185 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff5d97a5-933c-4231-8931-c8f056fe34c6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:57.421068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff5d97a5-933c-4231-8931-c8f056fe34c6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:57.422046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff5d97a5-933c-4231-8931-c8f056fe34c6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:57.422755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff5d97a5-933c-4231-8931-c8f056fe34c6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:57.423507 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff5d97a5-933c-4231-8931-c8f056fe34c6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:57.467536 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-152968b4-e918-44bf-9ff3-a8d168314f98 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:57.477749 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-152968b4-e918-44bf-9ff3-a8d168314f98 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 200 len: 1301 microversion: 2.1 time: 0.479310 Oct 29 03:08:57.478968 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2110/4416] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:56 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 1301 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:57.485744 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-8b8866ac-5038-4208-812a-1455219e0b51 req-5960174d-f01e-447f-bad0-9597b6e6ea5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c25c557-35b6-4dce-99f0-4e2b1c43cf40", "name": "network-vif-deleted", "tag": "544bbd3a-133a-48fc-85fa-eb236d549271"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:57.499381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8b8866ac-5038-4208-812a-1455219e0b51 req-5960174d-f01e-447f-bad0-9597b6e6ea5e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:57.500026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8b8866ac-5038-4208-812a-1455219e0b51 req-5960174d-f01e-447f-bad0-9597b6e6ea5e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:57.500598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8b8866ac-5038-4208-812a-1455219e0b51 req-5960174d-f01e-447f-bad0-9597b6e6ea5e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:57.525122 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-8b8866ac-5038-4208-812a-1455219e0b51 req-5960174d-f01e-447f-bad0-9597b6e6ea5e service nova] Creating event network-vif-deleted:544bbd3a-133a-48fc-85fa-eb236d549271 for instance 3c25c557-35b6-4dce-99f0-4e2b1c43cf40 on n-h1-862967-2 Oct 29 03:08:57.531166 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-8b8866ac-5038-4208-812a-1455219e0b51 req-5960174d-f01e-447f-bad0-9597b6e6ea5e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050038 Oct 29 03:08:57.531778 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2111/4417] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:08:57.539074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cd815939-2506-4098-adc7-9c6e59fdc99e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:08:57.553430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd815939-2506-4098-adc7-9c6e59fdc99e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:57.554661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd815939-2506-4098-adc7-9c6e59fdc99e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:57.555244 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd815939-2506-4098-adc7-9c6e59fdc99e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:57.585428 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cd815939-2506-4098-adc7-9c6e59fdc99e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Going to try to start instance {{(pid=127125) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 29 03:08:57.676144 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cd815939-2506-4098-adc7-9c6e59fdc99e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "POST /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17/action" status: 202 len: 0 microversion: 2.1 time: 0.140268 Oct 29 03:08:57.695147 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2112/4418] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:08:57 2022] POST /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:08:57.710612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-67933a17-58e4-4788-96bc-fe534d753a4c tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:57.712241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-67933a17-58e4-4788-96bc-fe534d753a4c tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: 3c597067-efff-40a4-b890-1c6e7a69e96e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:57.719639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67933a17-58e4-4788-96bc-fe534d753a4c tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:57.720144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67933a17-58e4-4788-96bc-fe534d753a4c tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:57.720610 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67933a17-58e4-4788-96bc-fe534d753a4c tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:57.721383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67933a17-58e4-4788-96bc-fe534d753a4c tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:57.721833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67933a17-58e4-4788-96bc-fe534d753a4c tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:57.722264 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67933a17-58e4-4788-96bc-fe534d753a4c tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:57.965948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ff5d97a5-933c-4231-8931-c8f056fe34c6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:57.982736 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ff5d97a5-933c-4231-8931-c8f056fe34c6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1522 microversion: 2.1 time: 0.582573 Oct 29 03:08:57.983991 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2307/4419] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:57 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1522 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:57.989609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5479f3c0-bef9-4cd9-8a31-5ef6e946270b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:57.992257 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5479f3c0-bef9-4cd9-8a31-5ef6e946270b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:58.001442 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5479f3c0-bef9-4cd9-8a31-5ef6e946270b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:58.002292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5479f3c0-bef9-4cd9-8a31-5ef6e946270b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:58.002937 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5479f3c0-bef9-4cd9-8a31-5ef6e946270b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:58.004118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5479f3c0-bef9-4cd9-8a31-5ef6e946270b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:58.004841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5479f3c0-bef9-4cd9-8a31-5ef6e946270b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:58.005478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5479f3c0-bef9-4cd9-8a31-5ef6e946270b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:58.671204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-67933a17-58e4-4788-96bc-fe534d753a4c tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:58.689507 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-67933a17-58e4-4788-96bc-fe534d753a4c tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers/3c597067-efff-40a4-b890-1c6e7a69e96e" status: 200 len: 1521 microversion: 2.1 time: 0.990644 Oct 29 03:08:58.701402 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2113/4420] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:57 2022] GET /compute/v2.1/servers/3c597067-efff-40a4-b890-1c6e7a69e96e => generated 1521 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:58.701402 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4fd9870d-d841-42cb-9e6d-dee8cb998e50 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:58.701402 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4fd9870d-d841-42cb-9e6d-dee8cb998e50 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] [instance: 924784e9-e94f-44d8-88e3-adfca6a35372] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:58.711374 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4fd9870d-d841-42cb-9e6d-dee8cb998e50 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:58.712485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4fd9870d-d841-42cb-9e6d-dee8cb998e50 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:58.712485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4fd9870d-d841-42cb-9e6d-dee8cb998e50 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:58.713337 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4fd9870d-d841-42cb-9e6d-dee8cb998e50 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:58.713893 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4fd9870d-d841-42cb-9e6d-dee8cb998e50 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:58.714227 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4fd9870d-d841-42cb-9e6d-dee8cb998e50 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:58.735546 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-4fd9870d-d841-42cb-9e6d-dee8cb998e50 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] HTTP exception thrown: Instance 924784e9-e94f-44d8-88e3-adfca6a35372 could not be found. Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4fd9870d-d841-42cb-9e6d-dee8cb998e50 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Request method failure captured: Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/924784e9-e94f-44d8-88e3-adfca6a35372 HTTP/1.1 Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJkTN0rAiiM5nQrh6fft15cnuFazYIrkHygRib2JfobJbs-5Fwj7FTHkvf8Wt8aogiVyeO4BsCBa0mRwXpuH55s_4ejjfSTA0hDc1ye--h6lyOQK-_FscJ-zwrMLME6JlE5q_nij-aCQ5dYuTatzsdvEArNZ9nBxH3aw4aPdkuFiSzU Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: X-Openstack-Nova-Api-Version: 2.47 Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: d63f1533a3fd4dc18b6169f3270922b7 Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerShowV247Test-613742821 Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d63f1533a3fd4dc18b6169f3270922b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d63f1533a3fd4dc18b6169f3270922b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d63f1533a3fd4dc18b6169f3270922b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d63f1533a3fd4dc18b6169f3270922b7"}]}] Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerShowV247Test-613742821 Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: d63f1533a3fd4dc18b6169f3270922b7 Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerShowV247Test-613742821 Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerShowV247Test-613742821-project Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 9e0e028c4fec4c38be22f1f74b2d79f1 Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerShowV247Test-613742821-project Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 924784e9-e94f-44d8-88e3-adfca6a35372 could not be found. Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '924784e9-e94f-44d8-88e3-adfca6a35372'} Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 924784e9-e94f-44d8-88e3-adfca6a35372 could not be found. Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 924784e9-e94f-44d8-88e3-adfca6a35372 could not be found. Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:58.737356 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:08:58.743041 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:58.743041 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:58.743041 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:58.743041 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:08:58.743041 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:08:58.743041 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 924784e9-e94f-44d8-88e3-adfca6a35372 could not be found. Oct 29 03:08:58.743041 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:08:58.743041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4fd9870d-d841-42cb-9e6d-dee8cb998e50 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] Returning 404 to user: Instance 924784e9-e94f-44d8-88e3-adfca6a35372 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:58.743041 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4fd9870d-d841-42cb-9e6d-dee8cb998e50 tempest-ServerShowV247Test-613742821 tempest-ServerShowV247Test-613742821-project] 10.222.0.46 "GET /compute/v2.1/servers/924784e9-e94f-44d8-88e3-adfca6a35372" status: 404 len: 111 microversion: 2.47 time: 0.047256 Oct 29 03:08:58.743041 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2114/4421] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:08:58 2022] GET /compute/v2.1/servers/924784e9-e94f-44d8-88e3-adfca6a35372 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:08:58.755629 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ac59e3c5-90b0-4d55-8212-73b49ab98198 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:58.756303 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ac59e3c5-90b0-4d55-8212-73b49ab98198 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 3c25c557-35b6-4dce-99f0-4e2b1c43cf40] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:58.774882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ac59e3c5-90b0-4d55-8212-73b49ab98198 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:58.775376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ac59e3c5-90b0-4d55-8212-73b49ab98198 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:58.775944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ac59e3c5-90b0-4d55-8212-73b49ab98198 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:58.776680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ac59e3c5-90b0-4d55-8212-73b49ab98198 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:58.777130 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ac59e3c5-90b0-4d55-8212-73b49ab98198 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:58.777548 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ac59e3c5-90b0-4d55-8212-73b49ab98198 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:58.811630 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-ac59e3c5-90b0-4d55-8212-73b49ab98198 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] HTTP exception thrown: Instance 3c25c557-35b6-4dce-99f0-4e2b1c43cf40 could not be found. Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ac59e3c5-90b0-4d55-8212-73b49ab98198 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Request method failure captured: Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 HTTP/1.1 Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJfc2e4Qexbx3G4-jywmZ_Ln-wqtVbKFRzy8sjTSuJdLRp4YmhqEZ-b3JfzSAkXcoVfbWYNlr9SdxLU6qrS2txstodv8k_2U_87A-tiRXJFDBtTHTWJiCStiRcg7EKEStpBqBVgpo-GRsKLikXbmXcBj7pBfFmQ-X6If_An9AqMsKyQ Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 830acea7f5b948409e4b69d02aaeaf3b Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-MigrationsAdminTest-924811521 Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/830acea7f5b948409e4b69d02aaeaf3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/830acea7f5b948409e4b69d02aaeaf3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_830acea7f5b948409e4b69d02aaeaf3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/830acea7f5b948409e4b69d02aaeaf3b"}]}] Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-MigrationsAdminTest-924811521 Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 830acea7f5b948409e4b69d02aaeaf3b Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-MigrationsAdminTest-924811521 Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-MigrationsAdminTest-924811521-project Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 7d3a840b017844a7b45b98bea21e8e38 Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-MigrationsAdminTest-924811521-project Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 3c25c557-35b6-4dce-99f0-4e2b1c43cf40 could not be found. Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '3c25c557-35b6-4dce-99f0-4e2b1c43cf40'} Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c25c557-35b6-4dce-99f0-4e2b1c43cf40 could not be found. Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c25c557-35b6-4dce-99f0-4e2b1c43cf40 could not be found. Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:08:58.813607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:08:58.818637 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:08:58.818637 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:08:58.818637 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:08:58.818637 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:08:58.818637 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:08:58.818637 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c25c557-35b6-4dce-99f0-4e2b1c43cf40 could not be found. Oct 29 03:08:58.818637 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:08:58.821392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ac59e3c5-90b0-4d55-8212-73b49ab98198 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Returning 404 to user: Instance 3c25c557-35b6-4dce-99f0-4e2b1c43cf40 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:08:58.824845 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ac59e3c5-90b0-4d55-8212-73b49ab98198 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40" status: 404 len: 111 microversion: 2.1 time: 0.081296 Oct 29 03:08:58.828398 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2115/4422] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:58 2022] GET /compute/v2.1/servers/3c25c557-35b6-4dce-99f0-4e2b1c43cf40 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:08:58.840402 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-208dc4e1-e1dc-4859-b4f9-84babb54cdff tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:58.844759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-208dc4e1-e1dc-4859-b4f9-84babb54cdff tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:58.866664 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-208dc4e1-e1dc-4859-b4f9-84babb54cdff tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:58.867393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-208dc4e1-e1dc-4859-b4f9-84babb54cdff tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:58.867964 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-208dc4e1-e1dc-4859-b4f9-84babb54cdff tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:58.869350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-208dc4e1-e1dc-4859-b4f9-84babb54cdff tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:58.871292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-208dc4e1-e1dc-4859-b4f9-84babb54cdff tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:58.871930 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-208dc4e1-e1dc-4859-b4f9-84babb54cdff tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:58.876703 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5479f3c0-bef9-4cd9-8a31-5ef6e946270b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:58.889985 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:58.896048 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5479f3c0-bef9-4cd9-8a31-5ef6e946270b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1709 microversion: 2.1 time: 0.910590 Oct 29 03:08:58.916002 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2308/4423] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:57 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1709 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:58.932607 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-208dc4e1-e1dc-4859-b4f9-84babb54cdff tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:08:59.017018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-73099a27-834d-4953-9dfa-57e60037c595 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:59.018509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-73099a27-834d-4953-9dfa-57e60037c595 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:59.025761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73099a27-834d-4953-9dfa-57e60037c595 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:59.027366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73099a27-834d-4953-9dfa-57e60037c595 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:59.030158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73099a27-834d-4953-9dfa-57e60037c595 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:59.032216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73099a27-834d-4953-9dfa-57e60037c595 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:59.032780 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73099a27-834d-4953-9dfa-57e60037c595 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:59.033215 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73099a27-834d-4953-9dfa-57e60037c595 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:59.087468 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-208dc4e1-e1dc-4859-b4f9-84babb54cdff tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 204 len: 0 microversion: 2.1 time: 0.257353 Oct 29 03:08:59.090627 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2116/4424] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:08:58 2022] DELETE /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:08:59.104994 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6a32c1c5-bc0c-4863-973e-3a613d11af75 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:59.107253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6a32c1c5-bc0c-4863-973e-3a613d11af75 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:59.120636 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a32c1c5-bc0c-4863-973e-3a613d11af75 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:59.125250 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a32c1c5-bc0c-4863-973e-3a613d11af75 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:59.127714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a32c1c5-bc0c-4863-973e-3a613d11af75 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:59.130224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a32c1c5-bc0c-4863-973e-3a613d11af75 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:59.132002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a32c1c5-bc0c-4863-973e-3a613d11af75 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:59.132949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a32c1c5-bc0c-4863-973e-3a613d11af75 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:59.495260 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-73099a27-834d-4953-9dfa-57e60037c595 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:59.554214 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-73099a27-834d-4953-9dfa-57e60037c595 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1522 microversion: 2.1 time: 0.538902 Oct 29 03:08:59.560905 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2309/4425] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:59 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1522 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:59.717839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bb72e140-4294-443f-ae4d-6aa164b2f324 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:59.719229 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bb72e140-4294-443f-ae4d-6aa164b2f324 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: 3c597067-efff-40a4-b890-1c6e7a69e96e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:59.739549 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb72e140-4294-443f-ae4d-6aa164b2f324 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:59.743323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb72e140-4294-443f-ae4d-6aa164b2f324 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:59.744299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb72e140-4294-443f-ae4d-6aa164b2f324 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:59.745160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb72e140-4294-443f-ae4d-6aa164b2f324 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:59.747138 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb72e140-4294-443f-ae4d-6aa164b2f324 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:59.747802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb72e140-4294-443f-ae4d-6aa164b2f324 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:59.777742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6a32c1c5-bc0c-4863-973e-3a613d11af75 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:08:59.798287 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6a32c1c5-bc0c-4863-973e-3a613d11af75 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1534 microversion: 2.1 time: 0.702261 Oct 29 03:08:59.814261 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2117/4426] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:59 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1534 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:08:59.928008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3d5c110d-59a6-44d8-9530-181a0f1c4363 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:08:59.929229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3d5c110d-59a6-44d8-9530-181a0f1c4363 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:08:59.968130 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d5c110d-59a6-44d8-9530-181a0f1c4363 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:59.969116 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d5c110d-59a6-44d8-9530-181a0f1c4363 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:59.969875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d5c110d-59a6-44d8-9530-181a0f1c4363 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:08:59.971094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d5c110d-59a6-44d8-9530-181a0f1c4363 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:08:59.972067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d5c110d-59a6-44d8-9530-181a0f1c4363 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:08:59.973056 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d5c110d-59a6-44d8-9530-181a0f1c4363 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:00.238301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bb72e140-4294-443f-ae4d-6aa164b2f324 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:00.252910 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bb72e140-4294-443f-ae4d-6aa164b2f324 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers/3c597067-efff-40a4-b890-1c6e7a69e96e" status: 200 len: 1479 microversion: 2.1 time: 0.539372 Oct 29 03:09:00.253971 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2310/4427] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:59 2022] GET /compute/v2.1/servers/3c597067-efff-40a4-b890-1c6e7a69e96e => generated 1479 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:00.518858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-131e72cc-792e-4252-b088-be03b9752a78 req-2de05535-c7f7-4ced-b12e-b6d5398e4dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c597067-efff-40a4-b890-1c6e7a69e96e", "name": "network-vif-deleted", "tag": "3effa6d0-a0dd-42b8-9a4e-4274badc6551"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:00.541525 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-131e72cc-792e-4252-b088-be03b9752a78 req-2de05535-c7f7-4ced-b12e-b6d5398e4dc9 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:00.549254 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-131e72cc-792e-4252-b088-be03b9752a78 req-2de05535-c7f7-4ced-b12e-b6d5398e4dc9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:00.549922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-131e72cc-792e-4252-b088-be03b9752a78 req-2de05535-c7f7-4ced-b12e-b6d5398e4dc9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:00.567312 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-131e72cc-792e-4252-b088-be03b9752a78 req-2de05535-c7f7-4ced-b12e-b6d5398e4dc9 service nova] Creating event network-vif-deleted:3effa6d0-a0dd-42b8-9a4e-4274badc6551 for instance 3c597067-efff-40a4-b890-1c6e7a69e96e on n-h1-862967-2 Oct 29 03:09:00.575737 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-131e72cc-792e-4252-b088-be03b9752a78 req-2de05535-c7f7-4ced-b12e-b6d5398e4dc9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060776 Oct 29 03:09:00.577048 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2311/4428] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:09:00.620275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f0bc70cf-5244-4f72-87a3-39905b7c6cbc tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:00.626948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f0bc70cf-5244-4f72-87a3-39905b7c6cbc tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:00.652070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0bc70cf-5244-4f72-87a3-39905b7c6cbc tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:00.652867 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0bc70cf-5244-4f72-87a3-39905b7c6cbc tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:00.653471 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0bc70cf-5244-4f72-87a3-39905b7c6cbc tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:00.654465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0bc70cf-5244-4f72-87a3-39905b7c6cbc tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:00.655207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0bc70cf-5244-4f72-87a3-39905b7c6cbc tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:00.655792 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0bc70cf-5244-4f72-87a3-39905b7c6cbc tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:00.890014 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3d5c110d-59a6-44d8-9530-181a0f1c4363 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:00.920819 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3d5c110d-59a6-44d8-9530-181a0f1c4363 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1709 microversion: 2.1 time: 0.997840 Oct 29 03:09:00.922375 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2118/4429] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:59 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1709 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:00.930740 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-57108ee6-438c-49dc-95fa-b90442e7224a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:00.931906 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-57108ee6-438c-49dc-95fa-b90442e7224a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:00.939364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57108ee6-438c-49dc-95fa-b90442e7224a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:00.940063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57108ee6-438c-49dc-95fa-b90442e7224a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:00.940620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57108ee6-438c-49dc-95fa-b90442e7224a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:00.941427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57108ee6-438c-49dc-95fa-b90442e7224a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:00.942013 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57108ee6-438c-49dc-95fa-b90442e7224a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:00.942700 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57108ee6-438c-49dc-95fa-b90442e7224a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:01.453238 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-57108ee6-438c-49dc-95fa-b90442e7224a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:01.468908 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-57108ee6-438c-49dc-95fa-b90442e7224a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1534 microversion: 2.1 time: 0.542757 Oct 29 03:09:01.469834 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2119/4430] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:00 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1534 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:01.480154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-d62d4c00-13c4-4297-bffb-e1e6e8c82d3a req-4b8af0e7-8d56-4736-9e4d-37a9ec1f9887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f60b0652-637b-48dd-8e61-950c0fe5b4c0", "name": "network-vif-unplugged", "status": "completed", "tag": "7221ab02-8b17-48e5-a7aa-ed98c8fe3c5c"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:01.496548 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=5 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:01.500756 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d62d4c00-13c4-4297-bffb-e1e6e8c82d3a req-4b8af0e7-8d56-4736-9e4d-37a9ec1f9887 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:01.501901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d62d4c00-13c4-4297-bffb-e1e6e8c82d3a req-4b8af0e7-8d56-4736-9e4d-37a9ec1f9887 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:01.502963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d62d4c00-13c4-4297-bffb-e1e6e8c82d3a req-4b8af0e7-8d56-4736-9e4d-37a9ec1f9887 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:01.532068 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-d62d4c00-13c4-4297-bffb-e1e6e8c82d3a req-4b8af0e7-8d56-4736-9e4d-37a9ec1f9887 service nova] Creating event network-vif-unplugged:7221ab02-8b17-48e5-a7aa-ed98c8fe3c5c for instance f60b0652-637b-48dd-8e61-950c0fe5b4c0 on n-h2-862967-2 Oct 29 03:09:01.543573 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-d62d4c00-13c4-4297-bffb-e1e6e8c82d3a req-4b8af0e7-8d56-4736-9e4d-37a9ec1f9887 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071656 Oct 29 03:09:01.551662 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2120/4431] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:09:01.563687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-4fbcd600-ec68-42d6-b5f4-da976ee373a7 req-7eb3f235-98c3-4350-a620-f5d242a921b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba75665d-3656-45c2-8bd8-f6dc6a66c851", "name": "network-vif-deleted", "tag": "e6d17c69-1713-4142-ba71-2fb8e8f5c28c"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:01.581131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4fbcd600-ec68-42d6-b5f4-da976ee373a7 req-7eb3f235-98c3-4350-a620-f5d242a921b5 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:01.581989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4fbcd600-ec68-42d6-b5f4-da976ee373a7 req-7eb3f235-98c3-4350-a620-f5d242a921b5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:01.582736 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4fbcd600-ec68-42d6-b5f4-da976ee373a7 req-7eb3f235-98c3-4350-a620-f5d242a921b5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:01.603778 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-4fbcd600-ec68-42d6-b5f4-da976ee373a7 req-7eb3f235-98c3-4350-a620-f5d242a921b5 service nova] Creating event network-vif-deleted:e6d17c69-1713-4142-ba71-2fb8e8f5c28c for instance ba75665d-3656-45c2-8bd8-f6dc6a66c851 on n-h2-862967-2 Oct 29 03:09:01.612780 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-4fbcd600-ec68-42d6-b5f4-da976ee373a7 req-7eb3f235-98c3-4350-a620-f5d242a921b5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058642 Oct 29 03:09:01.614447 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2121/4432] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:09:01.624413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-481fa769-e299-4b60-ae5c-c031a18be579 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:01.626015 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-481fa769-e299-4b60-ae5c-c031a18be579 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: 3c597067-efff-40a4-b890-1c6e7a69e96e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:01.637564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-481fa769-e299-4b60-ae5c-c031a18be579 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:01.638582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-481fa769-e299-4b60-ae5c-c031a18be579 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:01.639470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-481fa769-e299-4b60-ae5c-c031a18be579 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:01.640888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-481fa769-e299-4b60-ae5c-c031a18be579 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:01.641830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-481fa769-e299-4b60-ae5c-c031a18be579 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:01.642636 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-481fa769-e299-4b60-ae5c-c031a18be579 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:01.674521 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-481fa769-e299-4b60-ae5c-c031a18be579 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] HTTP exception thrown: Instance 3c597067-efff-40a4-b890-1c6e7a69e96e could not be found. Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-481fa769-e299-4b60-ae5c-c031a18be579 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Request method failure captured: Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/3c597067-efff-40a4-b890-1c6e7a69e96e HTTP/1.1 Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJkZpRH_5I0VEWenSx_2qthFArNon1K0nfO2BIJXwF7d_xI3qcHWkWKzFJXYpaUesV6bEt8bMGH0Lx8nWLk6ooHEQz2PNWzJ5dxEmDqJrBtoz-xlzX3omFTGuKn_Zy89ScGPhUln_8-bCJzTxISTwiJ8bTo4xYVYeQAIJMKFGVYs0C4 Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 0c1e510b5644490d839cefd879108416 Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ListServersNegativeTestJSON-1914539329 Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c1e510b5644490d839cefd879108416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c1e510b5644490d839cefd879108416"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c1e510b5644490d839cefd879108416"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c1e510b5644490d839cefd879108416"}]}] Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ListServersNegativeTestJSON-1914539329 Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 0c1e510b5644490d839cefd879108416 Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1914539329 Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ListServersNegativeTestJSON-1914539329-project Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 94aca590158c420399a46af6c9e88bb8 Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ListServersNegativeTestJSON-1914539329-project Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 3c597067-efff-40a4-b890-1c6e7a69e96e could not be found. Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '3c597067-efff-40a4-b890-1c6e7a69e96e'} Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c597067-efff-40a4-b890-1c6e7a69e96e could not be found. Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c597067-efff-40a4-b890-1c6e7a69e96e could not be found. Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:09:01.678915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:09:01.683653 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:09:01.683653 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:01.683653 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:09:01.683653 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:09:01.683653 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:09:01.683653 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:09:01.683653 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c597067-efff-40a4-b890-1c6e7a69e96e could not be found. Oct 29 03:09:01.683653 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:09:01.683653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-481fa769-e299-4b60-ae5c-c031a18be579 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Returning 404 to user: Instance 3c597067-efff-40a4-b890-1c6e7a69e96e could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:09:01.683653 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-481fa769-e299-4b60-ae5c-c031a18be579 tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers/3c597067-efff-40a4-b890-1c6e7a69e96e" status: 404 len: 111 microversion: 2.1 time: 0.062921 Oct 29 03:09:01.683653 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2122/4433] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:01 2022] GET /compute/v2.1/servers/3c597067-efff-40a4-b890-1c6e7a69e96e => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:09:01.691633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0a283d76-698d-4b3f-9dfe-65cd9cac928d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:01.692361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0a283d76-698d-4b3f-9dfe-65cd9cac928d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: ba75665d-3656-45c2-8bd8-f6dc6a66c851] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:01.705320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a283d76-698d-4b3f-9dfe-65cd9cac928d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:01.706289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a283d76-698d-4b3f-9dfe-65cd9cac928d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:01.706950 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a283d76-698d-4b3f-9dfe-65cd9cac928d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:01.707923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a283d76-698d-4b3f-9dfe-65cd9cac928d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:01.708605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a283d76-698d-4b3f-9dfe-65cd9cac928d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:01.709224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a283d76-698d-4b3f-9dfe-65cd9cac928d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:01.754617 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a283d76-698d-4b3f-9dfe-65cd9cac928d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:01.755359 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a283d76-698d-4b3f-9dfe-65cd9cac928d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:01.755945 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a283d76-698d-4b3f-9dfe-65cd9cac928d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:01.756584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-0a283d76-698d-4b3f-9dfe-65cd9cac928d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lazy-loading 'fault' on Instance uuid ba75665d-3656-45c2-8bd8-f6dc6a66c851 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:09:01.820007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f0bc70cf-5244-4f72-87a3-39905b7c6cbc tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:01.835069 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f0bc70cf-5244-4f72-87a3-39905b7c6cbc tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1522 microversion: 2.1 time: 1.223066 Oct 29 03:09:01.839168 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2312/4434] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:00 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1522 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:01.850237 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0a283d76-698d-4b3f-9dfe-65cd9cac928d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94aca590158c420399a46af6c9e88bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1e510b5644490d839cefd879108416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:01.858440 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0a283d76-698d-4b3f-9dfe-65cd9cac928d tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851" status: 200 len: 1312 microversion: 2.1 time: 0.170419 Oct 29 03:09:01.859767 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2123/4435] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:01 2022] GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851 => generated 1312 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:01.950592 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d1d49171-257e-496a-bc03-bcd6e16a7c85 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:01.951895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d1d49171-257e-496a-bc03-bcd6e16a7c85 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:01.961498 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1d49171-257e-496a-bc03-bcd6e16a7c85 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:01.962193 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1d49171-257e-496a-bc03-bcd6e16a7c85 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:01.962793 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1d49171-257e-496a-bc03-bcd6e16a7c85 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:01.964507 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1d49171-257e-496a-bc03-bcd6e16a7c85 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:01.965327 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1d49171-257e-496a-bc03-bcd6e16a7c85 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:01.974984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1d49171-257e-496a-bc03-bcd6e16a7c85 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:02.032300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=100 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:02.497702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bd912d51-4c90-4459-bebb-62b7d9c8498a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:02.498726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bd912d51-4c90-4459-bebb-62b7d9c8498a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:02.511076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd912d51-4c90-4459-bebb-62b7d9c8498a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:02.511800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd912d51-4c90-4459-bebb-62b7d9c8498a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:02.512644 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd912d51-4c90-4459-bebb-62b7d9c8498a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:02.513600 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd912d51-4c90-4459-bebb-62b7d9c8498a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:02.514224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd912d51-4c90-4459-bebb-62b7d9c8498a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:02.515120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd912d51-4c90-4459-bebb-62b7d9c8498a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:02.615900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d1d49171-257e-496a-bc03-bcd6e16a7c85 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:02.625672 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d1d49171-257e-496a-bc03-bcd6e16a7c85 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1709 microversion: 2.1 time: 0.683182 Oct 29 03:09:02.630081 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2313/4436] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:01 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1709 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:03.048943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-05b56a6e-0608-468e-8cba-054e07a50124 tempest-ExtensionsTest-425121879 tempest-ExtensionsTest-425121879-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:03.051229 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-05b56a6e-0608-468e-8cba-054e07a50124 tempest-ExtensionsTest-425121879 tempest-ExtensionsTest-425121879-project] 10.222.0.46 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.202896 Oct 29 03:09:03.057610 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2314/4437] 10.222.0.46 () {58 vars in 1170 bytes} [Sat Oct 29 03:09:02 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:09:03.064817 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ad5867f0-e952-46cd-847b-3b733ba395e2 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:03.066474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ad5867f0-e952-46cd-847b-3b733ba395e2 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:03.076823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad5867f0-e952-46cd-847b-3b733ba395e2 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:03.077345 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad5867f0-e952-46cd-847b-3b733ba395e2 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:03.078181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad5867f0-e952-46cd-847b-3b733ba395e2 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:03.079757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad5867f0-e952-46cd-847b-3b733ba395e2 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:03.080277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad5867f0-e952-46cd-847b-3b733ba395e2 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:03.080890 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad5867f0-e952-46cd-847b-3b733ba395e2 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:03.086532 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bd912d51-4c90-4459-bebb-62b7d9c8498a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:03.101359 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bd912d51-4c90-4459-bebb-62b7d9c8498a tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 200 len: 1534 microversion: 2.1 time: 0.607540 Oct 29 03:09:03.107178 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2124/4438] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:02 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 1534 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:03.123138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8ca23f77-d58b-4aa3-b6f1-7f9c9d6e1d9a tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:03.123783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8ca23f77-d58b-4aa3-b6f1-7f9c9d6e1d9a tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] [instance: ba75665d-3656-45c2-8bd8-f6dc6a66c851] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:03.137128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ca23f77-d58b-4aa3-b6f1-7f9c9d6e1d9a tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:03.137659 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ca23f77-d58b-4aa3-b6f1-7f9c9d6e1d9a tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:03.138101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ca23f77-d58b-4aa3-b6f1-7f9c9d6e1d9a tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:03.140442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ca23f77-d58b-4aa3-b6f1-7f9c9d6e1d9a tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:03.142916 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ca23f77-d58b-4aa3-b6f1-7f9c9d6e1d9a tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:03.143561 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ca23f77-d58b-4aa3-b6f1-7f9c9d6e1d9a tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:03.165825 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-8ca23f77-d58b-4aa3-b6f1-7f9c9d6e1d9a tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] HTTP exception thrown: Instance ba75665d-3656-45c2-8bd8-f6dc6a66c851 could not be found. Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8ca23f77-d58b-4aa3-b6f1-7f9c9d6e1d9a tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Request method failure captured: Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851 HTTP/1.1 Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJkZpRH_5I0VEWenSx_2qthFArNon1K0nfO2BIJXwF7d_xI3qcHWkWKzFJXYpaUesV6bEt8bMGH0Lx8nWLk6ooHEQz2PNWzJ5dxEmDqJrBtoz-xlzX3omFTGuKn_Zy89ScGPhUln_8-bCJzTxISTwiJ8bTo4xYVYeQAIJMKFGVYs0C4 Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 0c1e510b5644490d839cefd879108416 Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ListServersNegativeTestJSON-1914539329 Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c1e510b5644490d839cefd879108416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0c1e510b5644490d839cefd879108416"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0c1e510b5644490d839cefd879108416"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0c1e510b5644490d839cefd879108416"}]}] Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ListServersNegativeTestJSON-1914539329 Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 0c1e510b5644490d839cefd879108416 Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1914539329 Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ListServersNegativeTestJSON-1914539329-project Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 94aca590158c420399a46af6c9e88bb8 Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ListServersNegativeTestJSON-1914539329-project Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance ba75665d-3656-45c2-8bd8-f6dc6a66c851 could not be found. Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'ba75665d-3656-45c2-8bd8-f6dc6a66c851'} Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba75665d-3656-45c2-8bd8-f6dc6a66c851 could not be found. Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba75665d-3656-45c2-8bd8-f6dc6a66c851 could not be found. Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:09:03.167706 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:09:03.172607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:09:03.172607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:03.172607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:09:03.172607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:09:03.172607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:09:03.172607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:09:03.172607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba75665d-3656-45c2-8bd8-f6dc6a66c851 could not be found. Oct 29 03:09:03.172607 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:09:03.174036 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8ca23f77-d58b-4aa3-b6f1-7f9c9d6e1d9a tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] Returning 404 to user: Instance ba75665d-3656-45c2-8bd8-f6dc6a66c851 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:09:03.175132 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8ca23f77-d58b-4aa3-b6f1-7f9c9d6e1d9a tempest-ListServersNegativeTestJSON-1914539329 tempest-ListServersNegativeTestJSON-1914539329-project] 10.222.0.46 "GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851" status: 404 len: 111 microversion: 2.1 time: 0.066668 Oct 29 03:09:03.176259 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2125/4439] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:03 2022] GET /compute/v2.1/servers/ba75665d-3656-45c2-8bd8-f6dc6a66c851 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:09:03.181897 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ae6abe3b-caec-4ee5-bfef-f20486dcb2a6 tempest-ExtensionsTest-425121879 tempest-ExtensionsTest-425121879-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:03.185554 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ae6abe3b-caec-4ee5-bfef-f20486dcb2a6 tempest-ExtensionsTest-425121879 tempest-ExtensionsTest-425121879-project] 10.222.0.46 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.007971 Oct 29 03:09:03.205697 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2126/4440] 10.222.0.46 () {58 vars in 1134 bytes} [Sat Oct 29 03:09:03 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:09:03.370497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ad5867f0-e952-46cd-847b-3b733ba395e2 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:03.386625 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ad5867f0-e952-46cd-847b-3b733ba395e2 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1522 microversion: 2.1 time: 0.327049 Oct 29 03:09:03.390283 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2315/4441] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:03 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:03.654982 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9bfab246-5937-4928-921f-534c95b48742 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:03.655595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9bfab246-5937-4928-921f-534c95b48742 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:03.670010 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9bfab246-5937-4928-921f-534c95b48742 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:03.671922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9bfab246-5937-4928-921f-534c95b48742 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:03.672845 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9bfab246-5937-4928-921f-534c95b48742 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:03.674502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9bfab246-5937-4928-921f-534c95b48742 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:03.675226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9bfab246-5937-4928-921f-534c95b48742 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:03.675980 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9bfab246-5937-4928-921f-534c95b48742 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:03.687514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-da3bbd54-e637-4cc2-992e-5516bdae97f1 req-2e8397cb-becc-4c68-9ff3-cab05ad5e654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f60b0652-637b-48dd-8e61-950c0fe5b4c0", "name": "network-vif-deleted", "tag": "7221ab02-8b17-48e5-a7aa-ed98c8fe3c5c"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:03.712737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-da3bbd54-e637-4cc2-992e-5516bdae97f1 req-2e8397cb-becc-4c68-9ff3-cab05ad5e654 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:03.716867 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-da3bbd54-e637-4cc2-992e-5516bdae97f1 req-2e8397cb-becc-4c68-9ff3-cab05ad5e654 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:03.717381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-da3bbd54-e637-4cc2-992e-5516bdae97f1 req-2e8397cb-becc-4c68-9ff3-cab05ad5e654 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:03.750382 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-da3bbd54-e637-4cc2-992e-5516bdae97f1 req-2e8397cb-becc-4c68-9ff3-cab05ad5e654 service nova] Creating event network-vif-deleted:7221ab02-8b17-48e5-a7aa-ed98c8fe3c5c for instance f60b0652-637b-48dd-8e61-950c0fe5b4c0 on n-h2-862967-2 Oct 29 03:09:03.758455 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-da3bbd54-e637-4cc2-992e-5516bdae97f1 req-2e8397cb-becc-4c68-9ff3-cab05ad5e654 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076747 Oct 29 03:09:03.760383 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2316/4442] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:09:04.136856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f9bdc1e4-0b03-4928-9594-366328fca83e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:04.138551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f9bdc1e4-0b03-4928-9594-366328fca83e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: f60b0652-637b-48dd-8e61-950c0fe5b4c0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:04.147422 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9bdc1e4-0b03-4928-9594-366328fca83e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:04.148058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9bdc1e4-0b03-4928-9594-366328fca83e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:04.148671 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9bdc1e4-0b03-4928-9594-366328fca83e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:04.149713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9bdc1e4-0b03-4928-9594-366328fca83e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:04.150512 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9bdc1e4-0b03-4928-9594-366328fca83e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:04.151259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9bdc1e4-0b03-4928-9594-366328fca83e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:04.169390 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-f9bdc1e4-0b03-4928-9594-366328fca83e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] HTTP exception thrown: Instance f60b0652-637b-48dd-8e61-950c0fe5b4c0 could not be found. Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f9bdc1e4-0b03-4928-9594-366328fca83e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Request method failure captured: Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 HTTP/1.1 Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJfc2e4Qexbx3G4-jywmZ_Ln-wqtVbKFRzy8sjTSuJdLRp4YmhqEZ-b3JfzSAkXcoVfbWYNlr9SdxLU6qrS2txstodv8k_2U_87A-tiRXJFDBtTHTWJiCStiRcg7EKEStpBqBVgpo-GRsKLikXbmXcBj7pBfFmQ-X6If_An9AqMsKyQ Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 830acea7f5b948409e4b69d02aaeaf3b Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-MigrationsAdminTest-924811521 Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/830acea7f5b948409e4b69d02aaeaf3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/830acea7f5b948409e4b69d02aaeaf3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_830acea7f5b948409e4b69d02aaeaf3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/830acea7f5b948409e4b69d02aaeaf3b"}]}] Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-MigrationsAdminTest-924811521 Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 830acea7f5b948409e4b69d02aaeaf3b Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-MigrationsAdminTest-924811521 Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-MigrationsAdminTest-924811521-project Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 7d3a840b017844a7b45b98bea21e8e38 Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-MigrationsAdminTest-924811521-project Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance f60b0652-637b-48dd-8e61-950c0fe5b4c0 could not be found. Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'f60b0652-637b-48dd-8e61-950c0fe5b4c0'} Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f60b0652-637b-48dd-8e61-950c0fe5b4c0 could not be found. Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f60b0652-637b-48dd-8e61-950c0fe5b4c0 could not be found. Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:09:04.171260 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:09:04.175854 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:04.175854 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:09:04.175854 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:09:04.175854 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:09:04.175854 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:09:04.175854 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f60b0652-637b-48dd-8e61-950c0fe5b4c0 could not be found. Oct 29 03:09:04.175854 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:09:04.177369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f9bdc1e4-0b03-4928-9594-366328fca83e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Returning 404 to user: Instance f60b0652-637b-48dd-8e61-950c0fe5b4c0 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:09:04.179043 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f9bdc1e4-0b03-4928-9594-366328fca83e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0" status: 404 len: 111 microversion: 2.1 time: 0.049253 Oct 29 03:09:04.179894 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2317/4443] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:04 2022] GET /compute/v2.1/servers/f60b0652-637b-48dd-8e61-950c0fe5b4c0 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:09:04.190436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6c0949ed-f5b1-4c83-bdfc-82cd09448eb7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '.version_select at 0x7ff052bbc160>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:04.219819 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6c0949ed-f5b1-4c83-bdfc-82cd09448eb7 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-588545895" status: 202 len: 0 microversion: 2.1 time: 0.034076 Oct 29 03:09:04.220927 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2318/4444] 10.222.0.46 () {58 vars in 1218 bytes} [Sat Oct 29 03:09:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-588545895 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:09:04.415015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2144b2af-1de6-4050-8303-e4772cd09466 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:04.415858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2144b2af-1de6-4050-8303-e4772cd09466 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:04.424717 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2144b2af-1de6-4050-8303-e4772cd09466 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:04.425221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2144b2af-1de6-4050-8303-e4772cd09466 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:04.425848 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2144b2af-1de6-4050-8303-e4772cd09466 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:04.426571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2144b2af-1de6-4050-8303-e4772cd09466 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:04.427050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2144b2af-1de6-4050-8303-e4772cd09466 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:04.427502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2144b2af-1de6-4050-8303-e4772cd09466 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:04.503555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9bfab246-5937-4928-921f-534c95b48742 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:04.513792 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9bfab246-5937-4928-921f-534c95b48742 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1713 microversion: 2.1 time: 0.863491 Oct 29 03:09:04.524887 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2127/4445] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:03 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1713 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:04.790397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2144b2af-1de6-4050-8303-e4772cd09466 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:04.799121 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2144b2af-1de6-4050-8303-e4772cd09466 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1522 microversion: 2.1 time: 0.388534 Oct 29 03:09:04.799728 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2319/4446] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:04 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:05.821462 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:05.826312 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-63fce050-8c30-4860-82b3-16b197cf61f7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:05.827921 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-63fce050-8c30-4860-82b3-16b197cf61f7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:05.837416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63fce050-8c30-4860-82b3-16b197cf61f7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:05.838007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63fce050-8c30-4860-82b3-16b197cf61f7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:05.838594 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63fce050-8c30-4860-82b3-16b197cf61f7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:05.839357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63fce050-8c30-4860-82b3-16b197cf61f7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:05.839875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63fce050-8c30-4860-82b3-16b197cf61f7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:05.840560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63fce050-8c30-4860-82b3-16b197cf61f7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:06.580691 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-63fce050-8c30-4860-82b3-16b197cf61f7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:06.597307 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-63fce050-8c30-4860-82b3-16b197cf61f7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1522 microversion: 2.1 time: 0.777373 Oct 29 03:09:06.598886 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2128/4447] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:05 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1522 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:06.633627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-59cfecb2-65f0-445a-83b9-61e19f537de0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:06.634707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-59cfecb2-65f0-445a-83b9-61e19f537de0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:06.638559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:06.640351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=12 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:06.647451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59cfecb2-65f0-445a-83b9-61e19f537de0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:06.647959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59cfecb2-65f0-445a-83b9-61e19f537de0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:06.648483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59cfecb2-65f0-445a-83b9-61e19f537de0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:06.649611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59cfecb2-65f0-445a-83b9-61e19f537de0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:06.650452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59cfecb2-65f0-445a-83b9-61e19f537de0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:06.651053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59cfecb2-65f0-445a-83b9-61e19f537de0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:06.697392 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-59cfecb2-65f0-445a-83b9-61e19f537de0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:09:06.836309 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-59cfecb2-65f0-445a-83b9-61e19f537de0 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "DELETE /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 204 len: 0 microversion: 2.1 time: 0.204279 Oct 29 03:09:06.841148 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2320/4448] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:09:06 2022] DELETE /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:09:06.868466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6b6084ec-a0b7-4c54-af30-c270cf90b066 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:06.869443 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6b6084ec-a0b7-4c54-af30-c270cf90b066 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:06.888268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b6084ec-a0b7-4c54-af30-c270cf90b066 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:06.899370 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b6084ec-a0b7-4c54-af30-c270cf90b066 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:06.899974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b6084ec-a0b7-4c54-af30-c270cf90b066 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:06.900816 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b6084ec-a0b7-4c54-af30-c270cf90b066 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:06.901278 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b6084ec-a0b7-4c54-af30-c270cf90b066 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:06.901706 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b6084ec-a0b7-4c54-af30-c270cf90b066 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:07.267292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-955cc26a-1d41-4b28-a859-44d207db4e3d tempest-ComputeTenantNetworksTest-1797756724 tempest-ComputeTenantNetworksTest-1797756724-project] Calling method '.version_select at 0x7ff052b61820>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:07.502039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6b6084ec-a0b7-4c54-af30-c270cf90b066 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:07.522562 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6b6084ec-a0b7-4c54-af30-c270cf90b066 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1469 microversion: 2.1 time: 0.674799 Oct 29 03:09:07.523791 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2129/4449] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:06 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1469 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:07.612361 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-955cc26a-1d41-4b28-a859-44d207db4e3d tempest-ComputeTenantNetworksTest-1797756724 tempest-ComputeTenantNetworksTest-1797756724-project] 10.222.0.46 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.570623 Oct 29 03:09:07.613064 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2321/4450] 10.222.0.46 () {58 vars in 1158 bytes} [Sat Oct 29 03:09:07 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:09:07.634188 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4ec0697b-beed-44c7-807f-7ca792dd18bf tempest-ComputeTenantNetworksTest-1797756724 tempest-ComputeTenantNetworksTest-1797756724-project] Calling method '.version_select at 0x7ff052d3c430>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:07.638709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c1107899-5dc3-447c-8aa7-d8edb11e8faa tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:07.640626 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c1107899-5dc3-447c-8aa7-d8edb11e8faa tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:07.661548 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1107899-5dc3-447c-8aa7-d8edb11e8faa tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:07.662232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1107899-5dc3-447c-8aa7-d8edb11e8faa tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:07.662770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1107899-5dc3-447c-8aa7-d8edb11e8faa tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:07.664129 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1107899-5dc3-447c-8aa7-d8edb11e8faa tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:07.664129 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1107899-5dc3-447c-8aa7-d8edb11e8faa tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:07.664701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1107899-5dc3-447c-8aa7-d8edb11e8faa tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:07.923434 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4ec0697b-beed-44c7-807f-7ca792dd18bf tempest-ComputeTenantNetworksTest-1797756724 tempest-ComputeTenantNetworksTest-1797756724-project] 10.222.0.46 "GET /compute/v2.1/os-tenant-networks/521c5db4-163c-4611-9946-163af60f4f1d" status: 200 len: 140 microversion: 2.1 time: 0.301647 Oct 29 03:09:07.927765 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2130/4451] 10.222.0.46 () {58 vars in 1269 bytes} [Sat Oct 29 03:09:07 2022] GET /compute/v2.1/os-tenant-networks/521c5db4-163c-4611-9946-163af60f4f1d => generated 140 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:09:08.311764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c1107899-5dc3-447c-8aa7-d8edb11e8faa tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:08.326088 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c1107899-5dc3-447c-8aa7-d8edb11e8faa tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1522 microversion: 2.1 time: 0.699262 Oct 29 03:09:08.341240 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2322/4452] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:07 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1522 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:08.551874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2ad0427e-52ff-493e-a134-a8bb406758d2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:08.553338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2ad0427e-52ff-493e-a134-a8bb406758d2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:08.568204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2ad0427e-52ff-493e-a134-a8bb406758d2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:08.569221 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2ad0427e-52ff-493e-a134-a8bb406758d2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:08.569830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2ad0427e-52ff-493e-a134-a8bb406758d2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:08.570971 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2ad0427e-52ff-493e-a134-a8bb406758d2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:08.571702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2ad0427e-52ff-493e-a134-a8bb406758d2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:08.572514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2ad0427e-52ff-493e-a134-a8bb406758d2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:09.353735 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c4f34ec4-8a88-4118-8f39-46ba8ca8f232 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:09.359351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c4f34ec4-8a88-4118-8f39-46ba8ca8f232 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:09.389653 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c4f34ec4-8a88-4118-8f39-46ba8ca8f232 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:09.390987 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c4f34ec4-8a88-4118-8f39-46ba8ca8f232 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:09.392677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c4f34ec4-8a88-4118-8f39-46ba8ca8f232 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:09.394614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c4f34ec4-8a88-4118-8f39-46ba8ca8f232 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:09.398832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c4f34ec4-8a88-4118-8f39-46ba8ca8f232 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:09.399675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c4f34ec4-8a88-4118-8f39-46ba8ca8f232 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:09.748581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c4f34ec4-8a88-4118-8f39-46ba8ca8f232 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:09.762297 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c4f34ec4-8a88-4118-8f39-46ba8ca8f232 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1522 microversion: 2.1 time: 0.413315 Oct 29 03:09:09.772724 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2323/4453] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:09 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:09.779981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-388e85d1-6fbe-4148-9568-32165d648c8f req-4de91700-8e7e-4df4-a319-72c3871c7472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34628535-7e50-432b-9baf-a1d9b841a1ec", "name": "network-vif-deleted", "tag": "a2e09809-ccdf-450a-a30b-75e01aaa1eef"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:09.802812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-388e85d1-6fbe-4148-9568-32165d648c8f req-4de91700-8e7e-4df4-a319-72c3871c7472 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:09.803390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-388e85d1-6fbe-4148-9568-32165d648c8f req-4de91700-8e7e-4df4-a319-72c3871c7472 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:09.803912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-388e85d1-6fbe-4148-9568-32165d648c8f req-4de91700-8e7e-4df4-a319-72c3871c7472 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:09.817233 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-388e85d1-6fbe-4148-9568-32165d648c8f req-4de91700-8e7e-4df4-a319-72c3871c7472 service nova] Creating event network-vif-deleted:a2e09809-ccdf-450a-a30b-75e01aaa1eef for instance 34628535-7e50-432b-9baf-a1d9b841a1ec on n-h2-862967-2 Oct 29 03:09:09.832376 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-388e85d1-6fbe-4148-9568-32165d648c8f req-4de91700-8e7e-4df4-a319-72c3871c7472 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065015 Oct 29 03:09:09.833155 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2324/4454] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:09:09.894008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2ad0427e-52ff-493e-a134-a8bb406758d2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:09.905935 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2ad0427e-52ff-493e-a134-a8bb406758d2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 200 len: 1469 microversion: 2.1 time: 1.357882 Oct 29 03:09:09.907178 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2131/4455] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:08 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 1469 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:10.790641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-de42b0ff-733a-4866-afb0-c6414ee702c6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:10.792090 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-de42b0ff-733a-4866-afb0-c6414ee702c6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:10.802689 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-de42b0ff-733a-4866-afb0-c6414ee702c6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:10.803197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-de42b0ff-733a-4866-afb0-c6414ee702c6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:10.803643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-de42b0ff-733a-4866-afb0-c6414ee702c6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:10.804367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-de42b0ff-733a-4866-afb0-c6414ee702c6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:10.804857 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-de42b0ff-733a-4866-afb0-c6414ee702c6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:10.805281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-de42b0ff-733a-4866-afb0-c6414ee702c6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:10.930540 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c0bcdbeb-887b-4d1a-8914-6348b4b56f80 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:10.931501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c0bcdbeb-887b-4d1a-8914-6348b4b56f80 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: 34628535-7e50-432b-9baf-a1d9b841a1ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:10.944395 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0bcdbeb-887b-4d1a-8914-6348b4b56f80 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:10.945230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0bcdbeb-887b-4d1a-8914-6348b4b56f80 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:10.945848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0bcdbeb-887b-4d1a-8914-6348b4b56f80 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:10.947419 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0bcdbeb-887b-4d1a-8914-6348b4b56f80 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:10.948064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0bcdbeb-887b-4d1a-8914-6348b4b56f80 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:10.949709 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0bcdbeb-887b-4d1a-8914-6348b4b56f80 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:10.972167 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-c0bcdbeb-887b-4d1a-8914-6348b4b56f80 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] HTTP exception thrown: Instance 34628535-7e50-432b-9baf-a1d9b841a1ec could not be found. Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c0bcdbeb-887b-4d1a-8914-6348b4b56f80 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Request method failure captured: Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec HTTP/1.1 Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJfc2e4Qexbx3G4-jywmZ_Ln-wqtVbKFRzy8sjTSuJdLRp4YmhqEZ-b3JfzSAkXcoVfbWYNlr9SdxLU6qrS2txstodv8k_2U_87A-tiRXJFDBtTHTWJiCStiRcg7EKEStpBqBVgpo-GRsKLikXbmXcBj7pBfFmQ-X6If_An9AqMsKyQ Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 830acea7f5b948409e4b69d02aaeaf3b Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-MigrationsAdminTest-924811521 Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/830acea7f5b948409e4b69d02aaeaf3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/830acea7f5b948409e4b69d02aaeaf3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_830acea7f5b948409e4b69d02aaeaf3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/830acea7f5b948409e4b69d02aaeaf3b"}]}] Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-MigrationsAdminTest-924811521 Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 830acea7f5b948409e4b69d02aaeaf3b Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-MigrationsAdminTest-924811521 Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-MigrationsAdminTest-924811521-project Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 7d3a840b017844a7b45b98bea21e8e38 Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-MigrationsAdminTest-924811521-project Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 34628535-7e50-432b-9baf-a1d9b841a1ec could not be found. Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '34628535-7e50-432b-9baf-a1d9b841a1ec'} Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34628535-7e50-432b-9baf-a1d9b841a1ec could not be found. Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34628535-7e50-432b-9baf-a1d9b841a1ec could not be found. Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:09:10.974176 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:09:10.979312 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:10.979312 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:09:10.979312 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:09:10.979312 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:09:10.979312 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:09:10.979312 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34628535-7e50-432b-9baf-a1d9b841a1ec could not be found. Oct 29 03:09:10.979312 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:09:10.981550 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c0bcdbeb-887b-4d1a-8914-6348b4b56f80 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Returning 404 to user: Instance 34628535-7e50-432b-9baf-a1d9b841a1ec could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:09:10.982981 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c0bcdbeb-887b-4d1a-8914-6348b4b56f80 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec" status: 404 len: 111 microversion: 2.1 time: 0.056868 Oct 29 03:09:10.987247 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2132/4456] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:10 2022] GET /compute/v2.1/servers/34628535-7e50-432b-9baf-a1d9b841a1ec => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:09:10.993659 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-06b52f6d-c3f3-4b7d-a1a2-28a6e7132b28 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:10.994504 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-06b52f6d-c3f3-4b7d-a1a2-28a6e7132b28 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:11.002681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06b52f6d-c3f3-4b7d-a1a2-28a6e7132b28 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:11.003357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06b52f6d-c3f3-4b7d-a1a2-28a6e7132b28 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:11.004036 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06b52f6d-c3f3-4b7d-a1a2-28a6e7132b28 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:11.005115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06b52f6d-c3f3-4b7d-a1a2-28a6e7132b28 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:11.005803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06b52f6d-c3f3-4b7d-a1a2-28a6e7132b28 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:11.006469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-06b52f6d-c3f3-4b7d-a1a2-28a6e7132b28 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:11.041056 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-06b52f6d-c3f3-4b7d-a1a2-28a6e7132b28 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:09:11.200208 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-06b52f6d-c3f3-4b7d-a1a2-28a6e7132b28 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 204 len: 0 microversion: 2.1 time: 0.210265 Oct 29 03:09:11.206786 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2133/4457] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:09:10 2022] DELETE /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:09:11.214332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b1b7c09c-3080-40d0-9b28-1b9552eed629 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:11.215553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b1b7c09c-3080-40d0-9b28-1b9552eed629 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:11.224630 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1b7c09c-3080-40d0-9b28-1b9552eed629 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:11.225415 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1b7c09c-3080-40d0-9b28-1b9552eed629 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:11.226019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1b7c09c-3080-40d0-9b28-1b9552eed629 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:11.227706 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1b7c09c-3080-40d0-9b28-1b9552eed629 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:11.228324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1b7c09c-3080-40d0-9b28-1b9552eed629 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:11.229005 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1b7c09c-3080-40d0-9b28-1b9552eed629 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:11.261112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:11.354441 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-de42b0ff-733a-4866-afb0-c6414ee702c6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:11.369536 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-de42b0ff-733a-4866-afb0-c6414ee702c6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1522 microversion: 2.1 time: 0.584225 Oct 29 03:09:11.378583 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2325/4458] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:10 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1522 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:11.560989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b1b7c09c-3080-40d0-9b28-1b9552eed629 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:11.577342 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b1b7c09c-3080-40d0-9b28-1b9552eed629 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1469 microversion: 2.1 time: 0.368154 Oct 29 03:09:11.577947 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2134/4459] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:11 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1469 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:12.403115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-39707a36-480c-4696-ab12-d926ec1afc50 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:12.403908 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-39707a36-480c-4696-ab12-d926ec1afc50 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:12.416108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39707a36-480c-4696-ab12-d926ec1afc50 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:12.417865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39707a36-480c-4696-ab12-d926ec1afc50 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:12.420497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39707a36-480c-4696-ab12-d926ec1afc50 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:12.422256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39707a36-480c-4696-ab12-d926ec1afc50 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:12.425329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39707a36-480c-4696-ab12-d926ec1afc50 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:12.426526 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39707a36-480c-4696-ab12-d926ec1afc50 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:12.610995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a6026855-2e1a-48d1-ae30-793be1844e12 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:12.613043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a6026855-2e1a-48d1-ae30-793be1844e12 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:12.643056 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6026855-2e1a-48d1-ae30-793be1844e12 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:12.646049 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6026855-2e1a-48d1-ae30-793be1844e12 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:12.647826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6026855-2e1a-48d1-ae30-793be1844e12 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:12.649634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6026855-2e1a-48d1-ae30-793be1844e12 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:12.651183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6026855-2e1a-48d1-ae30-793be1844e12 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:12.652348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6026855-2e1a-48d1-ae30-793be1844e12 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:12.742216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-39707a36-480c-4696-ab12-d926ec1afc50 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:12.758053 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-39707a36-480c-4696-ab12-d926ec1afc50 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1522 microversion: 2.1 time: 0.359800 Oct 29 03:09:12.759224 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2326/4460] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:12 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:13.198667 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a6026855-2e1a-48d1-ae30-793be1844e12 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:13.211575 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a6026855-2e1a-48d1-ae30-793be1844e12 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1469 microversion: 2.1 time: 0.606350 Oct 29 03:09:13.212997 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2135/4461] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:12 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1469 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:13.699969 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-7d8cbda4-a909-4a2e-adab-909d2241320e req-99ec5fc7-f6a7-46f8-89ff-24cb1b8b1b9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4953b8e-b647-4491-b532-3476e7837ab2", "name": "network-vif-deleted", "tag": "898db35a-9988-48ff-8d18-1d616cacb84b"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:13.739015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7d8cbda4-a909-4a2e-adab-909d2241320e req-99ec5fc7-f6a7-46f8-89ff-24cb1b8b1b9b service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:13.740211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7d8cbda4-a909-4a2e-adab-909d2241320e req-99ec5fc7-f6a7-46f8-89ff-24cb1b8b1b9b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:13.740671 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7d8cbda4-a909-4a2e-adab-909d2241320e req-99ec5fc7-f6a7-46f8-89ff-24cb1b8b1b9b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:13.776508 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-7d8cbda4-a909-4a2e-adab-909d2241320e req-99ec5fc7-f6a7-46f8-89ff-24cb1b8b1b9b service nova] Creating event network-vif-deleted:898db35a-9988-48ff-8d18-1d616cacb84b for instance c4953b8e-b647-4491-b532-3476e7837ab2 on n-h1-862967-2 Oct 29 03:09:13.790377 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-35cabe8d-0b4d-4b76-b059-c127f1e1c17b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:13.791069 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-35cabe8d-0b4d-4b76-b059-c127f1e1c17b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:13.812062 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-7d8cbda4-a909-4a2e-adab-909d2241320e req-99ec5fc7-f6a7-46f8-89ff-24cb1b8b1b9b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106300 Oct 29 03:09:13.815148 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2327/4462] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:09:13.833104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35cabe8d-0b4d-4b76-b059-c127f1e1c17b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:13.837940 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35cabe8d-0b4d-4b76-b059-c127f1e1c17b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:13.841427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35cabe8d-0b4d-4b76-b059-c127f1e1c17b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:13.846992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35cabe8d-0b4d-4b76-b059-c127f1e1c17b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:13.846992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35cabe8d-0b4d-4b76-b059-c127f1e1c17b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:13.852572 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35cabe8d-0b4d-4b76-b059-c127f1e1c17b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:14.236939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-93604bf4-53b3-4424-9009-3cf765dd9a1e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:14.238277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-93604bf4-53b3-4424-9009-3cf765dd9a1e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:14.251991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93604bf4-53b3-4424-9009-3cf765dd9a1e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:14.252491 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93604bf4-53b3-4424-9009-3cf765dd9a1e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:14.252949 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93604bf4-53b3-4424-9009-3cf765dd9a1e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:14.255279 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93604bf4-53b3-4424-9009-3cf765dd9a1e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:14.255781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93604bf4-53b3-4424-9009-3cf765dd9a1e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:14.256211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93604bf4-53b3-4424-9009-3cf765dd9a1e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:14.342323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93604bf4-53b3-4424-9009-3cf765dd9a1e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:14.348063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93604bf4-53b3-4424-9009-3cf765dd9a1e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:14.348791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93604bf4-53b3-4424-9009-3cf765dd9a1e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:14.349420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-93604bf4-53b3-4424-9009-3cf765dd9a1e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lazy-loading 'fault' on Instance uuid c4953b8e-b647-4491-b532-3476e7837ab2 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:09:14.376688 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-35cabe8d-0b4d-4b76-b059-c127f1e1c17b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:14.387036 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-35cabe8d-0b4d-4b76-b059-c127f1e1c17b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1522 microversion: 2.1 time: 0.603580 Oct 29 03:09:14.406405 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2136/4463] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:13 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1522 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:14.527691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-93604bf4-53b3-4424-9009-3cf765dd9a1e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d3a840b017844a7b45b98bea21e8e38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '830acea7f5b948409e4b69d02aaeaf3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:14.541629 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-93604bf4-53b3-4424-9009-3cf765dd9a1e tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 200 len: 1303 microversion: 2.1 time: 0.308745 Oct 29 03:09:14.545855 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2328/4464] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:14 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 1303 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:15.433517 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-aa6f625d-0651-418b-b8e4-6e48d9d9cf4e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:15.434913 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-aa6f625d-0651-418b-b8e4-6e48d9d9cf4e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:15.462542 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa6f625d-0651-418b-b8e4-6e48d9d9cf4e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:15.463345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa6f625d-0651-418b-b8e4-6e48d9d9cf4e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:15.465597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa6f625d-0651-418b-b8e4-6e48d9d9cf4e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:15.466551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa6f625d-0651-418b-b8e4-6e48d9d9cf4e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:15.468733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa6f625d-0651-418b-b8e4-6e48d9d9cf4e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:15.470868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa6f625d-0651-418b-b8e4-6e48d9d9cf4e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:15.571843 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-885bc4eb-d040-4427-8715-f3a8a9bbe1f2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:15.573174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-885bc4eb-d040-4427-8715-f3a8a9bbe1f2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] [instance: c4953b8e-b647-4491-b532-3476e7837ab2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:15.580238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-885bc4eb-d040-4427-8715-f3a8a9bbe1f2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:15.580976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-885bc4eb-d040-4427-8715-f3a8a9bbe1f2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:15.581557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-885bc4eb-d040-4427-8715-f3a8a9bbe1f2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:15.582553 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-885bc4eb-d040-4427-8715-f3a8a9bbe1f2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:15.582997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-885bc4eb-d040-4427-8715-f3a8a9bbe1f2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:15.583790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-885bc4eb-d040-4427-8715-f3a8a9bbe1f2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:15.606005 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-885bc4eb-d040-4427-8715-f3a8a9bbe1f2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] HTTP exception thrown: Instance c4953b8e-b647-4491-b532-3476e7837ab2 could not be found. Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-885bc4eb-d040-4427-8715-f3a8a9bbe1f2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Request method failure captured: Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 HTTP/1.1 Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJfc2e4Qexbx3G4-jywmZ_Ln-wqtVbKFRzy8sjTSuJdLRp4YmhqEZ-b3JfzSAkXcoVfbWYNlr9SdxLU6qrS2txstodv8k_2U_87A-tiRXJFDBtTHTWJiCStiRcg7EKEStpBqBVgpo-GRsKLikXbmXcBj7pBfFmQ-X6If_An9AqMsKyQ Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 830acea7f5b948409e4b69d02aaeaf3b Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-MigrationsAdminTest-924811521 Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/830acea7f5b948409e4b69d02aaeaf3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/830acea7f5b948409e4b69d02aaeaf3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_830acea7f5b948409e4b69d02aaeaf3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/830acea7f5b948409e4b69d02aaeaf3b"}]}] Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-MigrationsAdminTest-924811521 Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 830acea7f5b948409e4b69d02aaeaf3b Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-MigrationsAdminTest-924811521 Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-MigrationsAdminTest-924811521-project Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 7d3a840b017844a7b45b98bea21e8e38 Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-MigrationsAdminTest-924811521-project Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance c4953b8e-b647-4491-b532-3476e7837ab2 could not be found. Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'c4953b8e-b647-4491-b532-3476e7837ab2'} Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4953b8e-b647-4491-b532-3476e7837ab2 could not be found. Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4953b8e-b647-4491-b532-3476e7837ab2 could not be found. Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:09:15.608891 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:09:15.613137 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:15.613137 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:09:15.613137 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:09:15.613137 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:09:15.613137 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:09:15.613137 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4953b8e-b647-4491-b532-3476e7837ab2 could not be found. Oct 29 03:09:15.613137 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:09:15.614453 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-885bc4eb-d040-4427-8715-f3a8a9bbe1f2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] Returning 404 to user: Instance c4953b8e-b647-4491-b532-3476e7837ab2 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:09:15.615851 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-885bc4eb-d040-4427-8715-f3a8a9bbe1f2 tempest-MigrationsAdminTest-924811521 tempest-MigrationsAdminTest-924811521-project] 10.222.0.46 "GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2" status: 404 len: 111 microversion: 2.1 time: 0.048290 Oct 29 03:09:15.618795 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2329/4465] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:15 2022] GET /compute/v2.1/servers/c4953b8e-b647-4491-b532-3476e7837ab2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:09:15.859595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-aa6f625d-0651-418b-b8e4-6e48d9d9cf4e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:15.873531 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-aa6f625d-0651-418b-b8e4-6e48d9d9cf4e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1522 microversion: 2.1 time: 0.443298 Oct 29 03:09:15.875541 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2137/4466] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:15 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1522 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:16.901499 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1a42622c-cf76-43a9-b0ce-18c0c820b37c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:16.904318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1a42622c-cf76-43a9-b0ce-18c0c820b37c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:16.920584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1a42622c-cf76-43a9-b0ce-18c0c820b37c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:16.921986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1a42622c-cf76-43a9-b0ce-18c0c820b37c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:16.922799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1a42622c-cf76-43a9-b0ce-18c0c820b37c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:16.925356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1a42622c-cf76-43a9-b0ce-18c0c820b37c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:16.927268 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1a42622c-cf76-43a9-b0ce-18c0c820b37c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:16.927960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1a42622c-cf76-43a9-b0ce-18c0c820b37c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:17.801863 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1a42622c-cf76-43a9-b0ce-18c0c820b37c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:17.815802 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1a42622c-cf76-43a9-b0ce-18c0c820b37c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1522 microversion: 2.1 time: 0.920100 Oct 29 03:09:17.831845 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2330/4467] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:16 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1522 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:18.845094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-89668965-ab21-4b99-ba8c-7f071b8a78c3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:18.845877 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-89668965-ab21-4b99-ba8c-7f071b8a78c3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:18.854649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89668965-ab21-4b99-ba8c-7f071b8a78c3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:18.858128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89668965-ab21-4b99-ba8c-7f071b8a78c3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:18.858870 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89668965-ab21-4b99-ba8c-7f071b8a78c3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:18.860732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89668965-ab21-4b99-ba8c-7f071b8a78c3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:18.861438 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89668965-ab21-4b99-ba8c-7f071b8a78c3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:18.862083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89668965-ab21-4b99-ba8c-7f071b8a78c3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:19.040289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-89668965-ab21-4b99-ba8c-7f071b8a78c3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:19.050238 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-89668965-ab21-4b99-ba8c-7f071b8a78c3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1522 microversion: 2.1 time: 0.210399 Oct 29 03:09:19.050970 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2138/4468] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:18 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:20.081208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-993179e7-617b-411a-a8dd-f1d5ebf921d5 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:20.083559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-993179e7-617b-411a-a8dd-f1d5ebf921d5 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:20.111529 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-993179e7-617b-411a-a8dd-f1d5ebf921d5 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:20.114710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-993179e7-617b-411a-a8dd-f1d5ebf921d5 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:20.115621 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-993179e7-617b-411a-a8dd-f1d5ebf921d5 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:20.127023 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-993179e7-617b-411a-a8dd-f1d5ebf921d5 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:20.131286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-993179e7-617b-411a-a8dd-f1d5ebf921d5 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:20.132454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-993179e7-617b-411a-a8dd-f1d5ebf921d5 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:20.937380 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-993179e7-617b-411a-a8dd-f1d5ebf921d5 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:20.954423 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-993179e7-617b-411a-a8dd-f1d5ebf921d5 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1502 microversion: 2.1 time: 0.883212 Oct 29 03:09:20.970897 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2331/4469] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:20 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1502 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:20.984374 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6045267d-e417-4041-af42-c064fdaea3a1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:20.987102 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6045267d-e417-4041-af42-c064fdaea3a1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:21.000891 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6045267d-e417-4041-af42-c064fdaea3a1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:21.004016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6045267d-e417-4041-af42-c064fdaea3a1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:21.005520 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6045267d-e417-4041-af42-c064fdaea3a1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:21.007317 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6045267d-e417-4041-af42-c064fdaea3a1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:21.010992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6045267d-e417-4041-af42-c064fdaea3a1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:21.011555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6045267d-e417-4041-af42-c064fdaea3a1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:21.715192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6045267d-e417-4041-af42-c064fdaea3a1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:21.728297 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6045267d-e417-4041-af42-c064fdaea3a1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94" status: 200 len: 1517 microversion: 2.1 time: 0.747340 Oct 29 03:09:21.730466 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2139/4470] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:20 2022] GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 => generated 1517 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:21.754991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b086330e-8753-4a52-b4fb-23f89b647369 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:21.757401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b086330e-8753-4a52-b4fb-23f89b647369 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: d1dcaa8b-0989-4c5f-9e96-b07d852ad9d5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:21.769340 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-b086330e-8753-4a52-b4fb-23f89b647369 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] HTTP exception thrown: Instance d1dcaa8b-0989-4c5f-9e96-b07d852ad9d5 could not be found. Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b086330e-8753-4a52-b4fb-23f89b647369 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Request method failure captured: Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers/d1dcaa8b-0989-4c5f-9e96-b07d852ad9d5/action HTTP/1.1 Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 14 Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJkstpA5nrrKxuzeE1g4WEYzXnFix9I4sSziPbQz99dUgzomHyqw4KsPh1hn9KOAuebDlCdyeoB2kux2qwxeu2Z6mzS4iRWjeZGoPYlFLBau8TUQ57qGw9-PfGzzlfqexDt_gFdVfpeGXf1jJa4Rp1iRzDcKossbo6MCW_huYuDbUoI Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 1d97a655408746baabe76d9c8b0e3d64 Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-927401152 Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1d97a655408746baabe76d9c8b0e3d64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1d97a655408746baabe76d9c8b0e3d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1d97a655408746baabe76d9c8b0e3d64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1d97a655408746baabe76d9c8b0e3d64"}]}] Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServerRescueNegativeTestJSON-927401152 Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 1d97a655408746baabe76d9c8b0e3d64 Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-927401152 Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServerRescueNegativeTestJSON-927401152-project Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 06be3266f5774dc0acea36973521a5e5 Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServerRescueNegativeTestJSON-927401152-project Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: {"rescue": {}} Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance d1dcaa8b-0989-4c5f-9e96-b07d852ad9d5 could not be found. Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'd1dcaa8b-0989-4c5f-9e96-b07d852ad9d5', 'body': {'rescue': {}}} Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1dcaa8b-0989-4c5f-9e96-b07d852ad9d5 could not be found. Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1dcaa8b-0989-4c5f-9e96-b07d852ad9d5 could not be found. Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:09:21.774201 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:21.778325 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:09:21.778325 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:09:21.778325 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:09:21.778325 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:09:21.778325 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1dcaa8b-0989-4c5f-9e96-b07d852ad9d5 could not be found. Oct 29 03:09:21.778325 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:09:21.782757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b086330e-8753-4a52-b4fb-23f89b647369 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Returning 404 to user: Instance d1dcaa8b-0989-4c5f-9e96-b07d852ad9d5 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:09:21.785908 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b086330e-8753-4a52-b4fb-23f89b647369 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "POST /compute/v2.1/servers/d1dcaa8b-0989-4c5f-9e96-b07d852ad9d5/action" status: 404 len: 111 microversion: 2.1 time: 0.035185 Oct 29 03:09:21.791702 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2332/4471] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:09:21 2022] POST /compute/v2.1/servers/d1dcaa8b-0989-4c5f-9e96-b07d852ad9d5/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:09:21.797195 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3fe97509-5904-4f85-bcf5-658421e8977b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:21.798993 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3fe97509-5904-4f85-bcf5-658421e8977b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:21.808151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3fe97509-5904-4f85-bcf5-658421e8977b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:21.809497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3fe97509-5904-4f85-bcf5-658421e8977b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:21.810567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3fe97509-5904-4f85-bcf5-658421e8977b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:21.812077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3fe97509-5904-4f85-bcf5-658421e8977b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:21.813116 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3fe97509-5904-4f85-bcf5-658421e8977b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:21.814096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3fe97509-5904-4f85-bcf5-658421e8977b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:21.931601 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3fe97509-5904-4f85-bcf5-658421e8977b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "POST /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94/action" status: 202 len: 0 microversion: 2.1 time: 0.138688 Oct 29 03:09:21.933229 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2140/4472] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:09:21 2022] POST /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:09:21.941633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4148385a-f6cd-4b18-8f9d-47a7fd771b8f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:21.942241 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4148385a-f6cd-4b18-8f9d-47a7fd771b8f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:21.956106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4148385a-f6cd-4b18-8f9d-47a7fd771b8f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:21.958327 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4148385a-f6cd-4b18-8f9d-47a7fd771b8f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:21.960599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4148385a-f6cd-4b18-8f9d-47a7fd771b8f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:21.961680 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4148385a-f6cd-4b18-8f9d-47a7fd771b8f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:21.962759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4148385a-f6cd-4b18-8f9d-47a7fd771b8f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:21.963733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4148385a-f6cd-4b18-8f9d-47a7fd771b8f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:22.273961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4148385a-f6cd-4b18-8f9d-47a7fd771b8f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:22.288319 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4148385a-f6cd-4b18-8f9d-47a7fd771b8f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94" status: 200 len: 1522 microversion: 2.1 time: 0.351141 Oct 29 03:09:22.292132 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2333/4473] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:21 2022] GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:22.360720 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d18a7dfb-f397-4509-b12c-9f84e66e2fbd tempest-NetworksTest-1301361848 tempest-NetworksTest-1301361848-project-admin] Calling method '.version_select at 0x7ff052ce0d30>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:22.767753 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d18a7dfb-f397-4509-b12c-9f84e66e2fbd tempest-NetworksTest-1301361848 tempest-NetworksTest-1301361848-project-admin] 10.222.0.46 "GET /compute/v2.1/os-networks" status: 200 len: 4667 microversion: 2.1 time: 0.643728 Oct 29 03:09:22.768606 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2141/4474] 10.222.0.46 () {58 vars in 1137 bytes} [Sat Oct 29 03:09:22 2022] GET /compute/v2.1/os-networks => generated 4667 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:22.778852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5d491b45-2311-49fd-8aeb-2e7b254fdd93 tempest-NetworksTest-1301361848 tempest-NetworksTest-1301361848-project-admin] Calling method '.version_select at 0x7ff052b61820>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:23.042713 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5d491b45-2311-49fd-8aeb-2e7b254fdd93 tempest-NetworksTest-1301361848 tempest-NetworksTest-1301361848-project-admin] 10.222.0.46 "GET /compute/v2.1/os-networks/067f6498-08a7-4612-b1a7-402ac9c9abc8" status: 200 len: 652 microversion: 2.1 time: 0.269433 Oct 29 03:09:23.043270 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2334/4475] 10.222.0.46 () {58 vars in 1248 bytes} [Sat Oct 29 03:09:22 2022] GET /compute/v2.1/os-networks/067f6498-08a7-4612-b1a7-402ac9c9abc8 => generated 652 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:09:23.053597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d3d055ef-8c88-43e4-b5a4-768b5d2c1914 tempest-NetworksTest-1301361848 tempest-NetworksTest-1301361848-project-admin] Calling method '.version_select at 0x7ff052ce0ca0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:23.317098 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d5045ed5-2936-42a4-aee6-20d2f7c458fa tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:23.318618 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d5045ed5-2936-42a4-aee6-20d2f7c458fa tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:23.321017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:23.335528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5045ed5-2936-42a4-aee6-20d2f7c458fa tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:23.336344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5045ed5-2936-42a4-aee6-20d2f7c458fa tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:23.337416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5045ed5-2936-42a4-aee6-20d2f7c458fa tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:23.341571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5045ed5-2936-42a4-aee6-20d2f7c458fa tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:23.345467 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5045ed5-2936-42a4-aee6-20d2f7c458fa tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:23.347380 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5045ed5-2936-42a4-aee6-20d2f7c458fa tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:23.360512 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d3d055ef-8c88-43e4-b5a4-768b5d2c1914 tempest-NetworksTest-1301361848 tempest-NetworksTest-1301361848-project-admin] 10.222.0.46 "GET /compute/v2.1/os-networks" status: 200 len: 3993 microversion: 2.1 time: 0.311206 Oct 29 03:09:23.367098 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2142/4476] 10.222.0.46 () {58 vars in 1137 bytes} [Sat Oct 29 03:09:23 2022] GET /compute/v2.1/os-networks => generated 3993 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:23.622165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d5045ed5-2936-42a4-aee6-20d2f7c458fa tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:23.630759 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d5045ed5-2936-42a4-aee6-20d2f7c458fa tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94" status: 200 len: 1502 microversion: 2.1 time: 0.317657 Oct 29 03:09:23.645558 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2335/4477] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:23 2022] GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 => generated 1502 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:23.660115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-505654f5-1a9b-48e9-bf8f-41275da3381f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:23.667434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-505654f5-1a9b-48e9-bf8f-41275da3381f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:23.677485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-505654f5-1a9b-48e9-bf8f-41275da3381f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:23.678605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-505654f5-1a9b-48e9-bf8f-41275da3381f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:23.679214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-505654f5-1a9b-48e9-bf8f-41275da3381f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:23.681095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-505654f5-1a9b-48e9-bf8f-41275da3381f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:23.681790 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-505654f5-1a9b-48e9-bf8f-41275da3381f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:23.682425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-505654f5-1a9b-48e9-bf8f-41275da3381f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:23.718278 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-505654f5-1a9b-48e9-bf8f-41275da3381f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lazy-loading 'flavor' on Instance uuid ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:09:23.747591 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-505654f5-1a9b-48e9-bf8f-41275da3381f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] HTTP exception thrown: Cannot 'rescue' instance ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 while it is in vm_state paused Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-505654f5-1a9b-48e9-bf8f-41275da3381f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Request method failure captured: Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94/action HTTP/1.1 Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 14 Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJkstpA5nrrKxuzeE1g4WEYzXnFix9I4sSziPbQz99dUgzomHyqw4KsPh1hn9KOAuebDlCdyeoB2kux2qwxeu2Z6mzS4iRWjeZGoPYlFLBau8TUQ57qGw9-PfGzzlfqexDt_gFdVfpeGXf1jJa4Rp1iRzDcKossbo6MCW_huYuDbUoI Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 1d97a655408746baabe76d9c8b0e3d64 Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-927401152 Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1d97a655408746baabe76d9c8b0e3d64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1d97a655408746baabe76d9c8b0e3d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1d97a655408746baabe76d9c8b0e3d64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1d97a655408746baabe76d9c8b0e3d64"}]}] Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerRescueNegativeTestJSON-927401152 Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 1d97a655408746baabe76d9c8b0e3d64 Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-927401152 Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerRescueNegativeTestJSON-927401152-project Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 06be3266f5774dc0acea36973521a5e5 Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerRescueNegativeTestJSON-927401152-project Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: {"rescue": {}} Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: exception: Cannot 'rescue' instance ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 while it is in vm_state paused Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'ab5ee183-e4bd-4de0-bb66-cda1ce9ead94', 'body': {'rescue': {}}} Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 in vm_state paused. Cannot rescue while the instance is in this state. Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 while it is in vm_state paused Oct 29 03:09:23.756416 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:09:23.761711 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:09:23.761711 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:09:23.761711 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:23.761711 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:09:23.761711 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:09:23.761711 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:09:23.761711 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:09:23.761711 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 while it is in vm_state paused Oct 29 03:09:23.761711 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:09:23.765402 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-505654f5-1a9b-48e9-bf8f-41275da3381f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Returning 409 to user: Cannot 'rescue' instance ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 while it is in vm_state paused {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:09:23.768749 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-505654f5-1a9b-48e9-bf8f-41275da3381f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "POST /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94/action" status: 409 len: 144 microversion: 2.1 time: 0.114908 Oct 29 03:09:23.771107 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2143/4478] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:09:23 2022] POST /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94/action => generated 144 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:09:23.780230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d1db7548-d1f8-4a35-a8ba-ecd8cd882c4e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:23.780962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d1db7548-d1f8-4a35-a8ba-ecd8cd882c4e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:23.788414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1db7548-d1f8-4a35-a8ba-ecd8cd882c4e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:23.789064 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1db7548-d1f8-4a35-a8ba-ecd8cd882c4e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:23.789617 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1db7548-d1f8-4a35-a8ba-ecd8cd882c4e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:23.790416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1db7548-d1f8-4a35-a8ba-ecd8cd882c4e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:23.791081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1db7548-d1f8-4a35-a8ba-ecd8cd882c4e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:23.791593 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1db7548-d1f8-4a35-a8ba-ecd8cd882c4e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:23.816406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:23.911649 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d1db7548-d1f8-4a35-a8ba-ecd8cd882c4e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "POST /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94/action" status: 202 len: 0 microversion: 2.1 time: 0.136885 Oct 29 03:09:23.923803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e682a73f-3def-4ece-8b7f-de99980fff4b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:23.926117 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e682a73f-3def-4ece-8b7f-de99980fff4b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:23.931855 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2336/4479] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:09:23 2022] POST /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:09:23.935543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e682a73f-3def-4ece-8b7f-de99980fff4b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:23.936394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e682a73f-3def-4ece-8b7f-de99980fff4b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:23.937384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e682a73f-3def-4ece-8b7f-de99980fff4b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:23.938704 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e682a73f-3def-4ece-8b7f-de99980fff4b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:23.939527 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e682a73f-3def-4ece-8b7f-de99980fff4b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:23.940213 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e682a73f-3def-4ece-8b7f-de99980fff4b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:24.386668 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e682a73f-3def-4ece-8b7f-de99980fff4b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:24.396699 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e682a73f-3def-4ece-8b7f-de99980fff4b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94" status: 200 len: 1509 microversion: 2.1 time: 0.477135 Oct 29 03:09:24.404074 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2144/4480] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:23 2022] GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 => generated 1509 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:25.425444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d3164a6f-23be-4a2b-91dc-2203b7110777 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:25.426134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d3164a6f-23be-4a2b-91dc-2203b7110777 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:25.441638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3164a6f-23be-4a2b-91dc-2203b7110777 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:25.443643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3164a6f-23be-4a2b-91dc-2203b7110777 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:25.445323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3164a6f-23be-4a2b-91dc-2203b7110777 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:25.450548 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3164a6f-23be-4a2b-91dc-2203b7110777 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:25.452378 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3164a6f-23be-4a2b-91dc-2203b7110777 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:25.452881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3164a6f-23be-4a2b-91dc-2203b7110777 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:25.683423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d3164a6f-23be-4a2b-91dc-2203b7110777 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:25.693227 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d3164a6f-23be-4a2b-91dc-2203b7110777 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94" status: 200 len: 1517 microversion: 2.1 time: 0.273813 Oct 29 03:09:25.710609 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2337/4481] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:25 2022] GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 => generated 1517 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:28.561276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3a5e3418-3947-4bba-ab52-2655f472c652 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:28.564167 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3a5e3418-3947-4bba-ab52-2655f472c652 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:28.571687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a5e3418-3947-4bba-ab52-2655f472c652 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:28.572432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a5e3418-3947-4bba-ab52-2655f472c652 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:28.573061 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a5e3418-3947-4bba-ab52-2655f472c652 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:28.573952 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a5e3418-3947-4bba-ab52-2655f472c652 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:28.574557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a5e3418-3947-4bba-ab52-2655f472c652 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:28.575152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a5e3418-3947-4bba-ab52-2655f472c652 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:28.602855 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-3a5e3418-3947-4bba-ab52-2655f472c652 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lazy-loading 'flavor' on Instance uuid ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:09:28.727552 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3a5e3418-3947-4bba-ab52-2655f472c652 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "POST /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94/action" status: 200 len: 32 microversion: 2.1 time: 0.169723 Oct 29 03:09:28.729333 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2145/4482] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:09:28 2022] POST /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94/action => generated 32 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:09:28.744187 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-675d0bc2-8e78-4a02-b9d8-bb6726c4adc1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:28.745787 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-675d0bc2-8e78-4a02-b9d8-bb6726c4adc1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:28.762202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-675d0bc2-8e78-4a02-b9d8-bb6726c4adc1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:28.762979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-675d0bc2-8e78-4a02-b9d8-bb6726c4adc1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:28.763829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-675d0bc2-8e78-4a02-b9d8-bb6726c4adc1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:28.765412 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-675d0bc2-8e78-4a02-b9d8-bb6726c4adc1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:28.766121 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-675d0bc2-8e78-4a02-b9d8-bb6726c4adc1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:28.767386 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-675d0bc2-8e78-4a02-b9d8-bb6726c4adc1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:29.131119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-675d0bc2-8e78-4a02-b9d8-bb6726c4adc1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:29.143743 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-675d0bc2-8e78-4a02-b9d8-bb6726c4adc1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94" status: 200 len: 1523 microversion: 2.1 time: 0.408118 Oct 29 03:09:29.146188 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2338/4483] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:28 2022] GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 => generated 1523 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:30.174812 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e5836da9-02a8-446e-91b6-dc6f2aa34e29 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:30.174812 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e5836da9-02a8-446e-91b6-dc6f2aa34e29 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:30.185807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5836da9-02a8-446e-91b6-dc6f2aa34e29 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:30.186663 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5836da9-02a8-446e-91b6-dc6f2aa34e29 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:30.187508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5836da9-02a8-446e-91b6-dc6f2aa34e29 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:30.189182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5836da9-02a8-446e-91b6-dc6f2aa34e29 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:30.189864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5836da9-02a8-446e-91b6-dc6f2aa34e29 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:30.191002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5836da9-02a8-446e-91b6-dc6f2aa34e29 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:30.469219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e5836da9-02a8-446e-91b6-dc6f2aa34e29 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:30.480992 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e5836da9-02a8-446e-91b6-dc6f2aa34e29 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94" status: 200 len: 1523 microversion: 2.1 time: 0.316716 Oct 29 03:09:30.489379 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2146/4484] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:30 2022] GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 => generated 1523 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:31.511203 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-af22e678-99d1-4aa9-8571-aff0e9358ed4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:31.511868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-af22e678-99d1-4aa9-8571-aff0e9358ed4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:31.525201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af22e678-99d1-4aa9-8571-aff0e9358ed4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:31.525860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af22e678-99d1-4aa9-8571-aff0e9358ed4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:31.526385 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af22e678-99d1-4aa9-8571-aff0e9358ed4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:31.527348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af22e678-99d1-4aa9-8571-aff0e9358ed4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:31.528011 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af22e678-99d1-4aa9-8571-aff0e9358ed4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:31.528776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af22e678-99d1-4aa9-8571-aff0e9358ed4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:31.772563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-af22e678-99d1-4aa9-8571-aff0e9358ed4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:31.792394 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-af22e678-99d1-4aa9-8571-aff0e9358ed4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94" status: 200 len: 1523 microversion: 2.1 time: 0.285849 Oct 29 03:09:31.806156 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2339/4485] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:31 2022] GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 => generated 1523 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:32.222266 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-97dd6a7d-3c81-4f98-b266-1424c37925b8 tempest-QuotaClassesAdmin257Test-1294446025 tempest-QuotaClassesAdmin257Test-1294446025-project-admin] Calling method '.version_select at 0x7ff052e5a4c0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:32.231903 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:32.242244 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-97dd6a7d-3c81-4f98-b266-1424c37925b8 tempest-QuotaClassesAdmin257Test-1294446025 tempest-QuotaClassesAdmin257Test-1294446025-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.389872 Oct 29 03:09:32.242861 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2147/4486] 10.222.0.46 () {60 vars in 1226 bytes} [Sat Oct 29 03:09:31 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:09:32.255013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8ce0038c-df91-46a0-948d-086b9ce786ca tempest-QuotaClassesAdmin257Test-1294446025 tempest-QuotaClassesAdmin257Test-1294446025-project-admin] Action: 'update', calling method: .version_select at 0x7ff052b0edc0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:32.469765 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8ce0038c-df91-46a0-948d-086b9ce786ca tempest-QuotaClassesAdmin257Test-1294446025 tempest-QuotaClassesAdmin257Test-1294446025-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.218990 Oct 29 03:09:32.473978 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2340/4487] 10.222.0.46 () {62 vars in 1247 bytes} [Sat Oct 29 03:09:32 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:09:32.485069 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a1fac4ef-6972-4323-be56-3fb813c56a3c tempest-QuotaClassesAdmin257Test-1294446025 tempest-QuotaClassesAdmin257Test-1294446025-project-admin] Calling method '.version_select at 0x7ff053834430>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:32.510573 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a1fac4ef-6972-4323-be56-3fb813c56a3c tempest-QuotaClassesAdmin257Test-1294446025 tempest-QuotaClassesAdmin257Test-1294446025-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.033139 Oct 29 03:09:32.517725 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2148/4488] 10.222.0.46 () {60 vars in 1226 bytes} [Sat Oct 29 03:09:32 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 03:09:32.523643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-24e0cab4-95c6-4141-83c5-3278f61b77fb tempest-QuotaClassesAdmin257Test-1294446025 tempest-QuotaClassesAdmin257Test-1294446025-project-admin] Action: 'update', calling method: .version_select at 0x7ff052bbc310>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:32.634262 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-24e0cab4-95c6-4141-83c5-3278f61b77fb tempest-QuotaClassesAdmin257Test-1294446025 tempest-QuotaClassesAdmin257Test-1294446025-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.114183 Oct 29 03:09:32.636506 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2341/4489] 10.222.0.46 () {62 vars in 1247 bytes} [Sat Oct 29 03:09:32 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:09:32.820023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-03b7b427-73f3-4265-aa59-609dbb7dc5bb tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:32.822176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-03b7b427-73f3-4265-aa59-609dbb7dc5bb tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:32.832751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03b7b427-73f3-4265-aa59-609dbb7dc5bb tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:32.833627 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03b7b427-73f3-4265-aa59-609dbb7dc5bb tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:32.834051 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03b7b427-73f3-4265-aa59-609dbb7dc5bb tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:32.834787 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03b7b427-73f3-4265-aa59-609dbb7dc5bb tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:32.835285 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03b7b427-73f3-4265-aa59-609dbb7dc5bb tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:32.835958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03b7b427-73f3-4265-aa59-609dbb7dc5bb tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:33.041269 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-03b7b427-73f3-4265-aa59-609dbb7dc5bb tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:33.054384 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-03b7b427-73f3-4265-aa59-609dbb7dc5bb tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94" status: 200 len: 1523 microversion: 2.1 time: 0.239973 Oct 29 03:09:33.071605 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2149/4490] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:32 2022] GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 => generated 1523 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:33.211713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4c09d77b-224f-4b6d-9e64-485c668563e3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:33.212743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4c09d77b-224f-4b6d-9e64-485c668563e3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:33.229483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c09d77b-224f-4b6d-9e64-485c668563e3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:33.230255 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c09d77b-224f-4b6d-9e64-485c668563e3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:33.231029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c09d77b-224f-4b6d-9e64-485c668563e3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:33.232494 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c09d77b-224f-4b6d-9e64-485c668563e3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:33.233474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c09d77b-224f-4b6d-9e64-485c668563e3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:33.234120 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c09d77b-224f-4b6d-9e64-485c668563e3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:33.370352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-4c09d77b-224f-4b6d-9e64-485c668563e3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lazy-loading 'services' on Instance uuid 05f5328d-7d86-44f3-bb9f-8d06de0daa17 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:09:33.470032 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4c09d77b-224f-4b6d-9e64-485c668563e3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "DELETE /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17/os-volume_attachments/1f6a9ea7-7869-4e93-92b3-db94e1f8fa7d" status: 202 len: 0 microversion: 2.1 time: 0.262132 Oct 29 03:09:33.474272 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2342/4491] 10.222.0.46 () {58 vars in 1416 bytes} [Sat Oct 29 03:09:33 2022] DELETE /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17/os-volume_attachments/1f6a9ea7-7869-4e93-92b3-db94e1f8fa7d => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:09:34.079096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-80ba36f7-6671-4213-9012-e7cb892d3302 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:34.080471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-80ba36f7-6671-4213-9012-e7cb892d3302 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:34.100932 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-80ba36f7-6671-4213-9012-e7cb892d3302 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:34.101624 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-80ba36f7-6671-4213-9012-e7cb892d3302 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:34.102256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-80ba36f7-6671-4213-9012-e7cb892d3302 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:34.103651 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-80ba36f7-6671-4213-9012-e7cb892d3302 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:34.106149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-80ba36f7-6671-4213-9012-e7cb892d3302 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:34.109140 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-80ba36f7-6671-4213-9012-e7cb892d3302 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:34.399544 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-80ba36f7-6671-4213-9012-e7cb892d3302 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:34.414889 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-80ba36f7-6671-4213-9012-e7cb892d3302 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94" status: 200 len: 1523 microversion: 2.1 time: 0.340399 Oct 29 03:09:34.432549 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2150/4492] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:34 2022] GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 => generated 1523 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:35.447900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8787955d-34c2-4bae-899b-6472dd00dd4d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:35.449539 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8787955d-34c2-4bae-899b-6472dd00dd4d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:35.468115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8787955d-34c2-4bae-899b-6472dd00dd4d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:35.469027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8787955d-34c2-4bae-899b-6472dd00dd4d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:35.469787 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8787955d-34c2-4bae-899b-6472dd00dd4d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:35.479800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8787955d-34c2-4bae-899b-6472dd00dd4d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:35.483207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8787955d-34c2-4bae-899b-6472dd00dd4d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:35.488968 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8787955d-34c2-4bae-899b-6472dd00dd4d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:36.021510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8787955d-34c2-4bae-899b-6472dd00dd4d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:36.039371 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8787955d-34c2-4bae-899b-6472dd00dd4d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94" status: 200 len: 1523 microversion: 2.1 time: 0.597607 Oct 29 03:09:36.040282 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2343/4493] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:35 2022] GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 => generated 1523 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:37.071560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4e099bea-97c1-48da-b921-34d4393034c3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:37.073450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4e099bea-97c1-48da-b921-34d4393034c3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:37.086931 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e099bea-97c1-48da-b921-34d4393034c3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:37.087665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e099bea-97c1-48da-b921-34d4393034c3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:37.089565 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e099bea-97c1-48da-b921-34d4393034c3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:37.091564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e099bea-97c1-48da-b921-34d4393034c3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:37.093671 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e099bea-97c1-48da-b921-34d4393034c3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:37.095625 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e099bea-97c1-48da-b921-34d4393034c3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:37.418960 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4e099bea-97c1-48da-b921-34d4393034c3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:37.441521 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4e099bea-97c1-48da-b921-34d4393034c3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94" status: 200 len: 1523 microversion: 2.1 time: 0.373285 Oct 29 03:09:37.442700 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2151/4494] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:37 2022] GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 => generated 1523 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:38.466135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6d512e7b-6a4d-4a71-8f4e-2a2f99b2ebf0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:38.467380 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6d512e7b-6a4d-4a71-8f4e-2a2f99b2ebf0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:38.479196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d512e7b-6a4d-4a71-8f4e-2a2f99b2ebf0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:38.480771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d512e7b-6a4d-4a71-8f4e-2a2f99b2ebf0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:38.483337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d512e7b-6a4d-4a71-8f4e-2a2f99b2ebf0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:38.484181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d512e7b-6a4d-4a71-8f4e-2a2f99b2ebf0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:38.486883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d512e7b-6a4d-4a71-8f4e-2a2f99b2ebf0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:38.487729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d512e7b-6a4d-4a71-8f4e-2a2f99b2ebf0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:39.384239 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6d512e7b-6a4d-4a71-8f4e-2a2f99b2ebf0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:39.399056 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6d512e7b-6a4d-4a71-8f4e-2a2f99b2ebf0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94" status: 200 len: 1523 microversion: 2.1 time: 0.936722 Oct 29 03:09:39.408948 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2344/4495] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:38 2022] GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 => generated 1523 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:40.432537 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f6d35012-20dd-4e60-94bf-7d0f52f82b7f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:40.433882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f6d35012-20dd-4e60-94bf-7d0f52f82b7f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:40.450677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6d35012-20dd-4e60-94bf-7d0f52f82b7f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:40.451929 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6d35012-20dd-4e60-94bf-7d0f52f82b7f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:40.453449 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6d35012-20dd-4e60-94bf-7d0f52f82b7f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:40.454676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6d35012-20dd-4e60-94bf-7d0f52f82b7f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:40.456019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6d35012-20dd-4e60-94bf-7d0f52f82b7f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:40.456890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f6d35012-20dd-4e60-94bf-7d0f52f82b7f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:40.519931 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:40.858968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f6d35012-20dd-4e60-94bf-7d0f52f82b7f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:40.880884 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f6d35012-20dd-4e60-94bf-7d0f52f82b7f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94" status: 200 len: 1523 microversion: 2.1 time: 0.461210 Oct 29 03:09:40.883047 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2152/4496] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:40 2022] GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 => generated 1523 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:41.913916 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eaaa72e8-92df-4e71-a3a8-62f1d6a98c57 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:41.914832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-eaaa72e8-92df-4e71-a3a8-62f1d6a98c57 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:41.935350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaaa72e8-92df-4e71-a3a8-62f1d6a98c57 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:41.936243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaaa72e8-92df-4e71-a3a8-62f1d6a98c57 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:41.936886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaaa72e8-92df-4e71-a3a8-62f1d6a98c57 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:41.938629 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaaa72e8-92df-4e71-a3a8-62f1d6a98c57 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:41.939732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaaa72e8-92df-4e71-a3a8-62f1d6a98c57 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:41.940485 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaaa72e8-92df-4e71-a3a8-62f1d6a98c57 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:42.505440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-eaaa72e8-92df-4e71-a3a8-62f1d6a98c57 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:42.517672 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eaaa72e8-92df-4e71-a3a8-62f1d6a98c57 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94" status: 200 len: 1523 microversion: 2.1 time: 0.614904 Oct 29 03:09:42.518803 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2345/4497] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:41 2022] GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 => generated 1523 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:42.709677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6e0e6447-85c4-4e7f-874b-39a748ff408b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:42.714304 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:42.731885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e0e6447-85c4-4e7f-874b-39a748ff408b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:42.733176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e0e6447-85c4-4e7f-874b-39a748ff408b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:42.733620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6e0e6447-85c4-4e7f-874b-39a748ff408b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:42.784223 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6e0e6447-85c4-4e7f-874b-39a748ff408b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Going to try to stop instance {{(pid=127125) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 03:09:42.798243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=10,nova_cell0:UPDATE=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:42.873499 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6e0e6447-85c4-4e7f-874b-39a748ff408b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "POST /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17/action" status: 202 len: 0 microversion: 2.1 time: 0.168558 Oct 29 03:09:42.890238 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2153/4498] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:09:42 2022] POST /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:09:42.909634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b9178a5e-7981-4379-b728-1098145e6ebd tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:42.911044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b9178a5e-7981-4379-b728-1098145e6ebd tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:42.931138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9178a5e-7981-4379-b728-1098145e6ebd tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:42.931822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9178a5e-7981-4379-b728-1098145e6ebd tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:42.932623 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9178a5e-7981-4379-b728-1098145e6ebd tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:42.934354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9178a5e-7981-4379-b728-1098145e6ebd tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:42.937721 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9178a5e-7981-4379-b728-1098145e6ebd tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:42.938338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9178a5e-7981-4379-b728-1098145e6ebd tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:43.335538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d5a48540-e688-4ebd-8a7e-91eae4d22dab tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] Action: 'update', calling method: .version_select at 0x7ff052b3bca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:43.594763 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b9178a5e-7981-4379-b728-1098145e6ebd tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:43.605673 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b9178a5e-7981-4379-b728-1098145e6ebd tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1677 microversion: 2.1 time: 0.713833 Oct 29 03:09:43.607354 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2154/4499] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:42 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1677 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:43.627575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-12867cb8-cef0-4168-84c0-884f76666f8f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:43.628747 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-12867cb8-cef0-4168-84c0-884f76666f8f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:43.641214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-12867cb8-cef0-4168-84c0-884f76666f8f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:43.645148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-12867cb8-cef0-4168-84c0-884f76666f8f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:43.651472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-12867cb8-cef0-4168-84c0-884f76666f8f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:43.652885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-12867cb8-cef0-4168-84c0-884f76666f8f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:43.653515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-12867cb8-cef0-4168-84c0-884f76666f8f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:43.654096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-12867cb8-cef0-4168-84c0-884f76666f8f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:43.885717 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5a48540-e688-4ebd-8a7e-91eae4d22dab tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:43.886205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5a48540-e688-4ebd-8a7e-91eae4d22dab tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:43.886639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5a48540-e688-4ebd-8a7e-91eae4d22dab tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:43.887361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5a48540-e688-4ebd-8a7e-91eae4d22dab tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:43.887808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5a48540-e688-4ebd-8a7e-91eae4d22dab tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:43.888227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5a48540-e688-4ebd-8a7e-91eae4d22dab tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:44.118676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-12867cb8-cef0-4168-84c0-884f76666f8f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:44.131453 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-12867cb8-cef0-4168-84c0-884f76666f8f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94" status: 200 len: 1503 microversion: 2.1 time: 0.522547 Oct 29 03:09:44.145607 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2155/4500] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:43 2022] GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 => generated 1503 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:44.162744 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0c42081d-a22e-4896-977f-4fbd8d7bffc2 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34fde911-f127-414d-88ff-e24c041f3e2f"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:44.166382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0c42081d-a22e-4896-977f-4fbd8d7bffc2 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:44.173354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c42081d-a22e-4896-977f-4fbd8d7bffc2 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:44.174063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c42081d-a22e-4896-977f-4fbd8d7bffc2 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:44.174655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c42081d-a22e-4896-977f-4fbd8d7bffc2 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:44.175996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c42081d-a22e-4896-977f-4fbd8d7bffc2 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:44.176640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c42081d-a22e-4896-977f-4fbd8d7bffc2 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:44.177214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c42081d-a22e-4896-977f-4fbd8d7bffc2 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:44.203467 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-0c42081d-a22e-4896-977f-4fbd8d7bffc2 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] HTTP exception thrown: Cannot 'attach_volume' instance ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 while it is in vm_state rescued Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0c42081d-a22e-4896-977f-4fbd8d7bffc2 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Request method failure captured: Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94/os-volume_attachments HTTP/1.1 Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 74 Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJkstpA5nrrKxuzeE1g4WEYzXnFix9I4sSziPbQz99dUgzomHyqw4KsPh1hn9KOAuebDlCdyeoB2kux2qwxeu2Z6mzS4iRWjeZGoPYlFLBau8TUQ57qGw9-PfGzzlfqexDt_gFdVfpeGXf1jJa4Rp1iRzDcKossbo6MCW_huYuDbUoI Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 1d97a655408746baabe76d9c8b0e3d64 Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-927401152 Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1d97a655408746baabe76d9c8b0e3d64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1d97a655408746baabe76d9c8b0e3d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1d97a655408746baabe76d9c8b0e3d64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1d97a655408746baabe76d9c8b0e3d64"}]}] Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerRescueNegativeTestJSON-927401152 Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 1d97a655408746baabe76d9c8b0e3d64 Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-927401152 Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerRescueNegativeTestJSON-927401152-project Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 06be3266f5774dc0acea36973521a5e5 Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerRescueNegativeTestJSON-927401152-project Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: {"volumeAttachment": {"volumeId": "34fde911-f127-414d-88ff-e24c041f3e2f"}} Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: exception: Cannot 'attach_volume' instance ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 while it is in vm_state rescued Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'server_id': 'ab5ee183-e4bd-4de0-bb66-cda1ce9ead94', 'body': {'volumeAttachment': {'volumeId': '34fde911-f127-414d-88ff-e24c041f3e2f'}}} Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 29 03:09:44.205515 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 03:09:44.209621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 03:09:44.209621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 03:09:44.209621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 while it is in vm_state rescued Oct 29 03:09:44.209621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:09:44.209621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:09:44.209621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:09:44.209621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:09:44.209621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:09:44.209621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:09:44.209621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:09:44.209621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:09:44.209621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 while it is in vm_state rescued Oct 29 03:09:44.209621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:09:44.212889 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0c42081d-a22e-4896-977f-4fbd8d7bffc2 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Returning 409 to user: Cannot 'attach_volume' instance ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 while it is in vm_state rescued {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:09:44.214185 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0c42081d-a22e-4896-977f-4fbd8d7bffc2 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "POST /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.061649 Oct 29 03:09:44.219115 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2156/4501] 10.222.0.46 () {60 vars in 1323 bytes} [Sat Oct 29 03:09:44 2022] POST /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94/os-volume_attachments => generated 152 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 29 03:09:44.225930 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-48fb892f-0bf2-4225-900f-f5b68d8e1f88 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:44.226771 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-48fb892f-0bf2-4225-900f-f5b68d8e1f88 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:44.235231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48fb892f-0bf2-4225-900f-f5b68d8e1f88 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:44.235854 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48fb892f-0bf2-4225-900f-f5b68d8e1f88 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:44.236584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48fb892f-0bf2-4225-900f-f5b68d8e1f88 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:44.237524 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48fb892f-0bf2-4225-900f-f5b68d8e1f88 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:44.238207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48fb892f-0bf2-4225-900f-f5b68d8e1f88 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:44.238868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48fb892f-0bf2-4225-900f-f5b68d8e1f88 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:44.371454 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-48fb892f-0bf2-4225-900f-f5b68d8e1f88 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "POST /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94/action" status: 202 len: 0 microversion: 2.1 time: 0.150667 Oct 29 03:09:44.378354 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2157/4502] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:09:44 2022] POST /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:09:44.393564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c253b2b2-9188-4061-a696-1e9c2527dd40 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:44.396875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c253b2b2-9188-4061-a696-1e9c2527dd40 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:44.416786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c253b2b2-9188-4061-a696-1e9c2527dd40 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:44.417543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c253b2b2-9188-4061-a696-1e9c2527dd40 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:44.418170 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c253b2b2-9188-4061-a696-1e9c2527dd40 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:44.419131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c253b2b2-9188-4061-a696-1e9c2527dd40 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:44.419755 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c253b2b2-9188-4061-a696-1e9c2527dd40 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:44.420384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c253b2b2-9188-4061-a696-1e9c2527dd40 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:44.586642 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d5a48540-e688-4ebd-8a7e-91eae4d22dab tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/9be17144469e43e0bb4b6b867117c46d" status: 200 len: 148 microversion: 2.57 time: 1.794286 Oct 29 03:09:44.587785 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2346/4503] 10.222.0.46 () {62 vars in 1303 bytes} [Sat Oct 29 03:09:42 2022] PUT /compute/v2.1/os-quota-sets/9be17144469e43e0bb4b6b867117c46d => generated 148 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 03:09:44.598862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9764f005-43cc-44cf-8c6a-0c0e7e72571d tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] Calling method '.version_select at 0x7ff052b3bf70>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:44.775587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c253b2b2-9188-4061-a696-1e9c2527dd40 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:44.785027 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c253b2b2-9188-4061-a696-1e9c2527dd40 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94" status: 200 len: 1511 microversion: 2.1 time: 0.404436 Oct 29 03:09:44.785630 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2158/4504] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:44 2022] GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 => generated 1511 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:44.805502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7acd7e8f-b084-4981-97c5-c2aa0a4692af tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:44.807064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7acd7e8f-b084-4981-97c5-c2aa0a4692af tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:44.814216 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7acd7e8f-b084-4981-97c5-c2aa0a4692af tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:44.815124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7acd7e8f-b084-4981-97c5-c2aa0a4692af tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:44.815793 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7acd7e8f-b084-4981-97c5-c2aa0a4692af tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:44.816694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7acd7e8f-b084-4981-97c5-c2aa0a4692af tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:44.817332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7acd7e8f-b084-4981-97c5-c2aa0a4692af tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:44.817894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7acd7e8f-b084-4981-97c5-c2aa0a4692af tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:45.090459 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9764f005-43cc-44cf-8c6a-0c0e7e72571d tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:45.091132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9764f005-43cc-44cf-8c6a-0c0e7e72571d tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:45.091616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9764f005-43cc-44cf-8c6a-0c0e7e72571d tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:45.092360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9764f005-43cc-44cf-8c6a-0c0e7e72571d tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:45.092853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9764f005-43cc-44cf-8c6a-0c0e7e72571d tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:45.093280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9764f005-43cc-44cf-8c6a-0c0e7e72571d tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:45.121777 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9764f005-43cc-44cf-8c6a-0c0e7e72571d tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/9be17144469e43e0bb4b6b867117c46d/detail" status: 200 len: 463 microversion: 2.57 time: 0.527462 Oct 29 03:09:45.122741 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2347/4505] 10.222.0.46 () {60 vars in 1304 bytes} [Sat Oct 29 03:09:44 2022] GET /compute/v2.1/os-quota-sets/9be17144469e43e0bb4b6b867117c46d/detail => generated 463 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 03:09:45.557376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7acd7e8f-b084-4981-97c5-c2aa0a4692af tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:45.585947 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7acd7e8f-b084-4981-97c5-c2aa0a4692af tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1677 microversion: 2.1 time: 0.795986 Oct 29 03:09:45.587574 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2159/4506] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:44 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1677 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:45.827800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-93ec44bf-cd63-450c-ad88-ffd1347d9860 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:45.830312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-93ec44bf-cd63-450c-ad88-ffd1347d9860 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:45.848986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93ec44bf-cd63-450c-ad88-ffd1347d9860 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:45.849512 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93ec44bf-cd63-450c-ad88-ffd1347d9860 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:45.850041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93ec44bf-cd63-450c-ad88-ffd1347d9860 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:45.850792 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93ec44bf-cd63-450c-ad88-ffd1347d9860 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:45.851253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93ec44bf-cd63-450c-ad88-ffd1347d9860 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:45.851683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93ec44bf-cd63-450c-ad88-ffd1347d9860 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:46.196291 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-93ec44bf-cd63-450c-ad88-ffd1347d9860 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:46.210527 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-93ec44bf-cd63-450c-ad88-ffd1347d9860 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94" status: 200 len: 1511 microversion: 2.1 time: 0.403469 Oct 29 03:09:46.216017 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2348/4507] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:45 2022] GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 => generated 1511 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:46.276362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-053cbaaf-4462-48cd-98a0-177b741285d1 tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] Action: 'update', calling method: .version_select at 0x7ff0538341f0>, body: {"quota_set": {"ram": "2048"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:46.627235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-956c1f3a-f249-4682-beb1-8231ce9aac7c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:46.629416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-956c1f3a-f249-4682-beb1-8231ce9aac7c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:46.637327 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-956c1f3a-f249-4682-beb1-8231ce9aac7c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:46.637829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-956c1f3a-f249-4682-beb1-8231ce9aac7c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:46.638273 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-956c1f3a-f249-4682-beb1-8231ce9aac7c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:46.639158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-956c1f3a-f249-4682-beb1-8231ce9aac7c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:46.639804 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-956c1f3a-f249-4682-beb1-8231ce9aac7c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:46.640398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-956c1f3a-f249-4682-beb1-8231ce9aac7c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:46.813539 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-956c1f3a-f249-4682-beb1-8231ce9aac7c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:46.821956 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-956c1f3a-f249-4682-beb1-8231ce9aac7c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1677 microversion: 2.1 time: 0.198670 Oct 29 03:09:46.837787 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2349/4508] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:46 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1677 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:47.025416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-053cbaaf-4462-48cd-98a0-177b741285d1 tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:47.027924 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-053cbaaf-4462-48cd-98a0-177b741285d1 tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:47.028389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-053cbaaf-4462-48cd-98a0-177b741285d1 tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:47.029367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-053cbaaf-4462-48cd-98a0-177b741285d1 tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:47.030262 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-053cbaaf-4462-48cd-98a0-177b741285d1 tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:47.030875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-053cbaaf-4462-48cd-98a0-177b741285d1 tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:47.079766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-053cbaaf-4462-48cd-98a0-177b741285d1 tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:47.080849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-053cbaaf-4462-48cd-98a0-177b741285d1 tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:47.081442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-053cbaaf-4462-48cd-98a0-177b741285d1 tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:47.082590 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-053cbaaf-4462-48cd-98a0-177b741285d1 tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:47.083228 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-053cbaaf-4462-48cd-98a0-177b741285d1 tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:47.084498 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-053cbaaf-4462-48cd-98a0-177b741285d1 tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:47.164245 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-053cbaaf-4462-48cd-98a0-177b741285d1 tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-quota-sets/9be17144469e43e0bb4b6b867117c46d?user_id=a44597107dc44cf7bc5d27c4d316ab1e" status: 200 len: 148 microversion: 2.57 time: 0.892505 Oct 29 03:09:47.165990 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2160/4509] 10.222.0.46 () {62 vars in 1384 bytes} [Sat Oct 29 03:09:46 2022] PUT /compute/v2.1/os-quota-sets/9be17144469e43e0bb4b6b867117c46d?user_id=a44597107dc44cf7bc5d27c4d316ab1e => generated 148 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:09:47.177568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3e3ad32d-c3d2-4b2e-88b2-22c0d4679739 tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] Calling method '.version_select at 0x7ff052c72dc0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:47.245373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dfe3a186-11e3-4806-8a5b-fcbe796a9587 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:47.246332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dfe3a186-11e3-4806-8a5b-fcbe796a9587 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:47.258318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dfe3a186-11e3-4806-8a5b-fcbe796a9587 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:47.261501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dfe3a186-11e3-4806-8a5b-fcbe796a9587 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:47.262340 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dfe3a186-11e3-4806-8a5b-fcbe796a9587 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:47.264129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dfe3a186-11e3-4806-8a5b-fcbe796a9587 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:47.266734 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dfe3a186-11e3-4806-8a5b-fcbe796a9587 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:47.267416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dfe3a186-11e3-4806-8a5b-fcbe796a9587 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:47.544504 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3e3ad32d-c3d2-4b2e-88b2-22c0d4679739 tempest-QuotasAdminTestV257-1320398090 tempest-QuotasAdminTestV257-1320398090-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/9be17144469e43e0bb4b6b867117c46d?user_id=a44597107dc44cf7bc5d27c4d316ab1e" status: 200 len: 190 microversion: 2.57 time: 0.370698 Oct 29 03:09:47.545971 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2350/4510] 10.222.0.46 () {60 vars in 1364 bytes} [Sat Oct 29 03:09:47 2022] GET /compute/v2.1/os-quota-sets/9be17144469e43e0bb4b6b867117c46d?user_id=a44597107dc44cf7bc5d27c4d316ab1e => generated 190 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:09:47.852331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d0bee68d-0505-4ffa-a2f5-395c5a68c293 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:47.854051 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d0bee68d-0505-4ffa-a2f5-395c5a68c293 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:47.883157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0bee68d-0505-4ffa-a2f5-395c5a68c293 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:47.883662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0bee68d-0505-4ffa-a2f5-395c5a68c293 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:47.884164 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0bee68d-0505-4ffa-a2f5-395c5a68c293 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:47.885315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0bee68d-0505-4ffa-a2f5-395c5a68c293 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:47.885895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0bee68d-0505-4ffa-a2f5-395c5a68c293 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:47.886368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d0bee68d-0505-4ffa-a2f5-395c5a68c293 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:47.904634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dfe3a186-11e3-4806-8a5b-fcbe796a9587 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:47.916412 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dfe3a186-11e3-4806-8a5b-fcbe796a9587 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94" status: 200 len: 1511 microversion: 2.1 time: 0.675873 Oct 29 03:09:47.955083 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2161/4511] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:47 2022] GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 => generated 1511 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:48.249089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d0bee68d-0505-4ffa-a2f5-395c5a68c293 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:48.261533 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d0bee68d-0505-4ffa-a2f5-395c5a68c293 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1677 microversion: 2.1 time: 0.417167 Oct 29 03:09:48.262619 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2351/4512] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:47 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1677 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:48.942536 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-825602e1-a58e-4a69-94ef-88926055c7e7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:48.943158 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-825602e1-a58e-4a69-94ef-88926055c7e7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:48.960678 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-825602e1-a58e-4a69-94ef-88926055c7e7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:48.962550 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-825602e1-a58e-4a69-94ef-88926055c7e7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:48.963038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-825602e1-a58e-4a69-94ef-88926055c7e7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:48.963795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-825602e1-a58e-4a69-94ef-88926055c7e7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:48.967103 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-825602e1-a58e-4a69-94ef-88926055c7e7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:48.967854 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-825602e1-a58e-4a69-94ef-88926055c7e7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:49.288187 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cc12f0bc-7c47-48ce-93e4-c58eb161eed8 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:49.288881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cc12f0bc-7c47-48ce-93e4-c58eb161eed8 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:49.302452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc12f0bc-7c47-48ce-93e4-c58eb161eed8 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:49.302966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc12f0bc-7c47-48ce-93e4-c58eb161eed8 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:49.305126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc12f0bc-7c47-48ce-93e4-c58eb161eed8 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:49.305894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc12f0bc-7c47-48ce-93e4-c58eb161eed8 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:49.308573 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc12f0bc-7c47-48ce-93e4-c58eb161eed8 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:49.309073 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc12f0bc-7c47-48ce-93e4-c58eb161eed8 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:49.424039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-825602e1-a58e-4a69-94ef-88926055c7e7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:49.432923 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-825602e1-a58e-4a69-94ef-88926055c7e7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94" status: 200 len: 1517 microversion: 2.1 time: 0.494774 Oct 29 03:09:49.437114 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2162/4513] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:48 2022] GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 => generated 1517 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:50.067439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cc12f0bc-7c47-48ce-93e4-c58eb161eed8 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:50.091013 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cc12f0bc-7c47-48ce-93e4-c58eb161eed8 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1677 microversion: 2.1 time: 0.808754 Oct 29 03:09:50.105149 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2352/4514] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:49 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1677 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:51.118495 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0eb290ff-5aaa-4345-84c8-4bc5b609b768 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:51.119923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0eb290ff-5aaa-4345-84c8-4bc5b609b768 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:51.136121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0eb290ff-5aaa-4345-84c8-4bc5b609b768 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:51.137094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0eb290ff-5aaa-4345-84c8-4bc5b609b768 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:51.138659 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0eb290ff-5aaa-4345-84c8-4bc5b609b768 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:51.139600 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0eb290ff-5aaa-4345-84c8-4bc5b609b768 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:51.144035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0eb290ff-5aaa-4345-84c8-4bc5b609b768 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:51.144764 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0eb290ff-5aaa-4345-84c8-4bc5b609b768 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:51.889879 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0eb290ff-5aaa-4345-84c8-4bc5b609b768 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:51.909079 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0eb290ff-5aaa-4345-84c8-4bc5b609b768 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1677 microversion: 2.1 time: 0.794145 Oct 29 03:09:51.911619 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2163/4515] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:51 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1677 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:52.131036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f3e9611f-f935-4d31-a0a7-6e4e18ac62ad tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Action: 'create', calling method: .version_select at 0x7ff052c72790>, body: {"keypair": {"name": "tempest-keypair-529664979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbprXe2D1V9oIslXrxYC0kBktSs5/RZKrf6uXGqtkSNjIyZs3VVcLxV277OC2iRrEyA7JIbj3Fn1hHaEx0Sp4YdyH0zwoDrLR2BhrBW305gazXYC7CHEjU8+gD6vtUK4w=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:52.157245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-f3e9611f-f935-4d31-a0a7-6e4e18ac62ad tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Getting quotas for project 1d97a655408746baabe76d9c8b0e3d64. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:09:52.168063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-f3e9611f-f935-4d31-a0a7-6e4e18ac62ad tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Getting quotas for user 06be3266f5774dc0acea36973521a5e5 and project 1d97a655408746baabe76d9c8b0e3d64. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:09:52.199397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=14,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:52.220111 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f3e9611f-f935-4d31-a0a7-6e4e18ac62ad tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.093251 Oct 29 03:09:52.221612 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2353/4516] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:09:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:09:52.936408 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3e181da5-722a-421d-995b-4f6feed596b9 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:52.937089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3e181da5-722a-421d-995b-4f6feed596b9 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:52.947435 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e181da5-722a-421d-995b-4f6feed596b9 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:52.952926 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e181da5-722a-421d-995b-4f6feed596b9 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:52.955228 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e181da5-722a-421d-995b-4f6feed596b9 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:52.956056 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e181da5-722a-421d-995b-4f6feed596b9 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:52.959692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e181da5-722a-421d-995b-4f6feed596b9 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:52.960404 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e181da5-722a-421d-995b-4f6feed596b9 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:53.225091 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3e181da5-722a-421d-995b-4f6feed596b9 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:53.241707 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3e181da5-722a-421d-995b-4f6feed596b9 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1677 microversion: 2.1 time: 0.310298 Oct 29 03:09:53.242304 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2164/4517] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:52 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1677 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:54.275914 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a5c8c6c7-c27e-412c-adf9-3a30f1f96421 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:54.277378 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a5c8c6c7-c27e-412c-adf9-3a30f1f96421 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:54.293638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a5c8c6c7-c27e-412c-adf9-3a30f1f96421 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:54.294866 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a5c8c6c7-c27e-412c-adf9-3a30f1f96421 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:54.295641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a5c8c6c7-c27e-412c-adf9-3a30f1f96421 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:54.297072 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a5c8c6c7-c27e-412c-adf9-3a30f1f96421 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:54.298447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a5c8c6c7-c27e-412c-adf9-3a30f1f96421 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:54.299606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a5c8c6c7-c27e-412c-adf9-3a30f1f96421 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:54.371751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:54.556857 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a5c8c6c7-c27e-412c-adf9-3a30f1f96421 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:54.570805 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a5c8c6c7-c27e-412c-adf9-3a30f1f96421 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1654 microversion: 2.1 time: 0.301258 Oct 29 03:09:54.575988 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2354/4518] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:54 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1654 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:54.604483 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-68056d51-3932-479e-9967-08593ad4dd02 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:54.622783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68056d51-3932-479e-9967-08593ad4dd02 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:54.624363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68056d51-3932-479e-9967-08593ad4dd02 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:54.625763 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68056d51-3932-479e-9967-08593ad4dd02 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:54.662878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-68056d51-3932-479e-9967-08593ad4dd02 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Going to try to start instance {{(pid=127125) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 29 03:09:54.730596 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-68056d51-3932-479e-9967-08593ad4dd02 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "POST /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17/action" status: 202 len: 0 microversion: 2.1 time: 0.133813 Oct 29 03:09:54.734477 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2165/4519] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:09:54 2022] POST /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:09:54.740416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a677c616-fe6a-4156-94f0-4b3979951b56 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:54.741237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a677c616-fe6a-4156-94f0-4b3979951b56 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:54.757220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a677c616-fe6a-4156-94f0-4b3979951b56 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:54.757851 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a677c616-fe6a-4156-94f0-4b3979951b56 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:54.758516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a677c616-fe6a-4156-94f0-4b3979951b56 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:54.759469 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a677c616-fe6a-4156-94f0-4b3979951b56 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:54.760429 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a677c616-fe6a-4156-94f0-4b3979951b56 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:54.761123 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a677c616-fe6a-4156-94f0-4b3979951b56 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:55.109014 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:55.228242 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a677c616-fe6a-4156-94f0-4b3979951b56 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:55.238624 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a677c616-fe6a-4156-94f0-4b3979951b56 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1663 microversion: 2.1 time: 0.502735 Oct 29 03:09:55.249876 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2355/4520] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:54 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1663 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:56.269298 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6b37a487-2f49-4fcd-a715-47c1f3f1183c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:56.270814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6b37a487-2f49-4fcd-a715-47c1f3f1183c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:56.286896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b37a487-2f49-4fcd-a715-47c1f3f1183c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:56.289229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b37a487-2f49-4fcd-a715-47c1f3f1183c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:56.290872 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b37a487-2f49-4fcd-a715-47c1f3f1183c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:56.292877 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b37a487-2f49-4fcd-a715-47c1f3f1183c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:56.295646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b37a487-2f49-4fcd-a715-47c1f3f1183c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:56.297016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b37a487-2f49-4fcd-a715-47c1f3f1183c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:56.314955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:56.640163 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6b37a487-2f49-4fcd-a715-47c1f3f1183c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:56.652440 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6b37a487-2f49-4fcd-a715-47c1f3f1183c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1663 microversion: 2.1 time: 0.389774 Oct 29 03:09:56.665992 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2166/4521] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:56 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1663 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:57.082565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dff9b186-bb66-40dd-a7e7-d945a0dd26fe tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2091116581", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1f6f70fe-4dc4-4a72-9da8-235db3cfa873"}], "security_groups": [{"name": "tempest-securitygroup--1513638070"}], "key_name": "tempest-keypair-529664979", "user_data": "}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:09:57.386090 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-dff9b186-bb66-40dd-a7e7-d945a0dd26fe tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] validate_networks() for [('1f6f70fe-4dc4-4a72-9da8-235db3cfa873', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:09:57.678127 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=5 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:57.679426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=12 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:57.685563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d020b1e2-fe60-4939-af22-b36616b992de tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:57.686611 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d020b1e2-fe60-4939-af22-b36616b992de tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:57.700412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d020b1e2-fe60-4939-af22-b36616b992de tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:57.701244 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d020b1e2-fe60-4939-af22-b36616b992de tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:57.702644 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d020b1e2-fe60-4939-af22-b36616b992de tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:57.702644 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d020b1e2-fe60-4939-af22-b36616b992de tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:57.703035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d020b1e2-fe60-4939-af22-b36616b992de tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:57.707583 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d020b1e2-fe60-4939-af22-b36616b992de tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:58.127748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-dff9b186-bb66-40dd-a7e7-d945a0dd26fe tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:09:58.128210 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-dff9b186-bb66-40dd-a7e7-d945a0dd26fe tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:09:58.128739 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-dff9b186-bb66-40dd-a7e7-d945a0dd26fe tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:09:58.129143 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-dff9b186-bb66-40dd-a7e7-d945a0dd26fe tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:09:58.129708 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-dff9b186-bb66-40dd-a7e7-d945a0dd26fe tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:09:58.152461 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dff9b186-bb66-40dd-a7e7-d945a0dd26fe tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:58.152990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dff9b186-bb66-40dd-a7e7-d945a0dd26fe tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:58.153429 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dff9b186-bb66-40dd-a7e7-d945a0dd26fe tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:58.155160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dff9b186-bb66-40dd-a7e7-d945a0dd26fe tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:58.156036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dff9b186-bb66-40dd-a7e7-d945a0dd26fe tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:58.156463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dff9b186-bb66-40dd-a7e7-d945a0dd26fe tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:58.219677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-dff9b186-bb66-40dd-a7e7-d945a0dd26fe tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Getting quotas for project 1d97a655408746baabe76d9c8b0e3d64. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:09:58.228122 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-dff9b186-bb66-40dd-a7e7-d945a0dd26fe tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Getting quotas for user 06be3266f5774dc0acea36973521a5e5 and project 1d97a655408746baabe76d9c8b0e3d64. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:09:58.282892 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dff9b186-bb66-40dd-a7e7-d945a0dd26fe tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:09:58.287251 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dff9b186-bb66-40dd-a7e7-d945a0dd26fe tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:09:58.405014 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dff9b186-bb66-40dd-a7e7-d945a0dd26fe tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.332214 Oct 29 03:09:58.408164 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2356/4522] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:09:57 2022] POST /compute/v2.1/servers => generated 409 bytes in 1339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:09:58.433743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-89b067d8-dc88-425d-971b-315b33870c22 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:58.435293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-89b067d8-dc88-425d-971b-315b33870c22 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:58.506840 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-89b067d8-dc88-425d-971b-315b33870c22 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:58.519139 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-89b067d8-dc88-425d-971b-315b33870c22 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1245 microversion: 2.1 time: 0.096443 Oct 29 03:09:58.520340 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2357/4523] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:58 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1245 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:09:58.842880 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d020b1e2-fe60-4939-af22-b36616b992de tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:58.862215 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d020b1e2-fe60-4939-af22-b36616b992de tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1667 microversion: 2.1 time: 1.184711 Oct 29 03:09:58.865522 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2167/4524] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:57 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1667 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:09:59.542209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e8166e67-829f-42be-923e-ba8d598674fb tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:09:59.543436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e8166e67-829f-42be-923e-ba8d598674fb tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:09:59.556749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8166e67-829f-42be-923e-ba8d598674fb tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:59.557689 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8166e67-829f-42be-923e-ba8d598674fb tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:59.558570 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8166e67-829f-42be-923e-ba8d598674fb tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:59.559710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8166e67-829f-42be-923e-ba8d598674fb tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:09:59.561079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8166e67-829f-42be-923e-ba8d598674fb tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:09:59.562832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e8166e67-829f-42be-923e-ba8d598674fb tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:09:59.674260 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e8166e67-829f-42be-923e-ba8d598674fb tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:09:59.685800 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e8166e67-829f-42be-923e-ba8d598674fb tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1241 microversion: 2.1 time: 0.146687 Oct 29 03:09:59.688748 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2358/4525] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:09:59 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1241 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:00.726783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f997249a-b84b-441f-b767-fc3a2f48f05e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:00.735986 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f997249a-b84b-441f-b767-fc3a2f48f05e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:00.780717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f997249a-b84b-441f-b767-fc3a2f48f05e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:00.784559 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f997249a-b84b-441f-b767-fc3a2f48f05e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:00.786573 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f997249a-b84b-441f-b767-fc3a2f48f05e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:00.790249 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f997249a-b84b-441f-b767-fc3a2f48f05e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:00.792629 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f997249a-b84b-441f-b767-fc3a2f48f05e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:00.795417 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f997249a-b84b-441f-b767-fc3a2f48f05e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:00.954003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f997249a-b84b-441f-b767-fc3a2f48f05e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:00.972203 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f997249a-b84b-441f-b767-fc3a2f48f05e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1303 microversion: 2.1 time: 0.258801 Oct 29 03:10:00.973777 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2168/4526] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:00 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1303 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:01.997413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6789b2a0-41e6-4de0-9c83-0c6cff21194c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:01.998284 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6789b2a0-41e6-4de0-9c83-0c6cff21194c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:02.010299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6789b2a0-41e6-4de0-9c83-0c6cff21194c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:02.010840 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6789b2a0-41e6-4de0-9c83-0c6cff21194c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:02.011293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6789b2a0-41e6-4de0-9c83-0c6cff21194c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:02.012126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6789b2a0-41e6-4de0-9c83-0c6cff21194c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:02.018684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6789b2a0-41e6-4de0-9c83-0c6cff21194c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:02.019257 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6789b2a0-41e6-4de0-9c83-0c6cff21194c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:02.427053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6789b2a0-41e6-4de0-9c83-0c6cff21194c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:02.443285 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6789b2a0-41e6-4de0-9c83-0c6cff21194c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1303 microversion: 2.1 time: 0.449903 Oct 29 03:10:02.444665 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2359/4527] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:01 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1303 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:03.466541 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6ddb99c1-c44a-4c10-aece-a6372e8d3f85 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:03.467746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6ddb99c1-c44a-4c10-aece-a6372e8d3f85 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:03.472264 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:03.482885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ddb99c1-c44a-4c10-aece-a6372e8d3f85 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:03.483576 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ddb99c1-c44a-4c10-aece-a6372e8d3f85 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:03.485880 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ddb99c1-c44a-4c10-aece-a6372e8d3f85 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:03.488182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ddb99c1-c44a-4c10-aece-a6372e8d3f85 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:03.489057 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ddb99c1-c44a-4c10-aece-a6372e8d3f85 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:03.492725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ddb99c1-c44a-4c10-aece-a6372e8d3f85 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:04.032135 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6ddb99c1-c44a-4c10-aece-a6372e8d3f85 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:04.046727 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6ddb99c1-c44a-4c10-aece-a6372e8d3f85 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1371 microversion: 2.1 time: 0.584304 Oct 29 03:10:04.067438 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2169/4528] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:03 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1371 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:04.380571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-afdc10f9-6918-423c-ab6b-8bf105d90a9f req-ad2a1e46-cc8f-41fa-8b81-5da062d3d7c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0116c079-f618-42b3-94f5-340b2ed6efdd", "tag": "e14797d0-26ba-4515-ad2c-8ff690e8db5f"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:10:04.420299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-afdc10f9-6918-423c-ab6b-8bf105d90a9f req-ad2a1e46-cc8f-41fa-8b81-5da062d3d7c4 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:04.421049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-afdc10f9-6918-423c-ab6b-8bf105d90a9f req-ad2a1e46-cc8f-41fa-8b81-5da062d3d7c4 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:04.421713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-afdc10f9-6918-423c-ab6b-8bf105d90a9f req-ad2a1e46-cc8f-41fa-8b81-5da062d3d7c4 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:04.437704 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-afdc10f9-6918-423c-ab6b-8bf105d90a9f req-ad2a1e46-cc8f-41fa-8b81-5da062d3d7c4 service nova] Creating event network-changed:e14797d0-26ba-4515-ad2c-8ff690e8db5f for instance 0116c079-f618-42b3-94f5-340b2ed6efdd on n-h1-862967-2 Oct 29 03:10:04.452485 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-afdc10f9-6918-423c-ab6b-8bf105d90a9f req-ad2a1e46-cc8f-41fa-8b81-5da062d3d7c4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082985 Oct 29 03:10:04.453504 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2360/4529] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:10:05.074882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6ff188ad-5d0b-4aaa-8203-04910cd2dbcf tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:05.078511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6ff188ad-5d0b-4aaa-8203-04910cd2dbcf tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:05.085872 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ff188ad-5d0b-4aaa-8203-04910cd2dbcf tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:05.092623 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ff188ad-5d0b-4aaa-8203-04910cd2dbcf tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:05.093300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ff188ad-5d0b-4aaa-8203-04910cd2dbcf tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:05.094261 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ff188ad-5d0b-4aaa-8203-04910cd2dbcf tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:05.095548 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ff188ad-5d0b-4aaa-8203-04910cd2dbcf tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:05.096237 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ff188ad-5d0b-4aaa-8203-04910cd2dbcf tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:05.575565 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6ff188ad-5d0b-4aaa-8203-04910cd2dbcf tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:05.608697 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6ff188ad-5d0b-4aaa-8203-04910cd2dbcf tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1371 microversion: 2.1 time: 0.536261 Oct 29 03:10:05.610644 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2170/4530] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:05 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1371 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:06.637484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2c5a3ec2-bdb1-4f91-a516-46c49a351754 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:06.638977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2c5a3ec2-bdb1-4f91-a516-46c49a351754 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:06.660027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c5a3ec2-bdb1-4f91-a516-46c49a351754 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:06.661493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c5a3ec2-bdb1-4f91-a516-46c49a351754 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:06.663418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c5a3ec2-bdb1-4f91-a516-46c49a351754 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:06.665867 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c5a3ec2-bdb1-4f91-a516-46c49a351754 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:06.667573 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c5a3ec2-bdb1-4f91-a516-46c49a351754 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:06.669749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c5a3ec2-bdb1-4f91-a516-46c49a351754 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:07.209125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2c5a3ec2-bdb1-4f91-a516-46c49a351754 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:07.221308 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2c5a3ec2-bdb1-4f91-a516-46c49a351754 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1371 microversion: 2.1 time: 0.588253 Oct 29 03:10:07.222235 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2361/4531] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:06 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1371 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:08.249804 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2c5b403e-d82e-470d-af59-a97453b543b8 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:08.251280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2c5b403e-d82e-470d-af59-a97453b543b8 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:08.258411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:08.268554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c5b403e-d82e-470d-af59-a97453b543b8 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:08.269072 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c5b403e-d82e-470d-af59-a97453b543b8 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:08.269527 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c5b403e-d82e-470d-af59-a97453b543b8 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:08.270261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c5b403e-d82e-470d-af59-a97453b543b8 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:08.270722 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c5b403e-d82e-470d-af59-a97453b543b8 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:08.271153 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c5b403e-d82e-470d-af59-a97453b543b8 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:08.517227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=26 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:08.756719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2c5b403e-d82e-470d-af59-a97453b543b8 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:08.771774 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2c5b403e-d82e-470d-af59-a97453b543b8 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1371 microversion: 2.1 time: 0.525478 Oct 29 03:10:08.774926 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2362/4532] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:08 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1371 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:08.783415 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ca4e1420-1b69-48f2-9495-2fa8fb38e056 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:08.788970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ca4e1420-1b69-48f2-9495-2fa8fb38e056 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:08.791868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ca4e1420-1b69-48f2-9495-2fa8fb38e056 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:08.792328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ca4e1420-1b69-48f2-9495-2fa8fb38e056 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:08.793137 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ca4e1420-1b69-48f2-9495-2fa8fb38e056 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:08.793591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ca4e1420-1b69-48f2-9495-2fa8fb38e056 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:08.794016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ca4e1420-1b69-48f2-9495-2fa8fb38e056 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:08.842612 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ca4e1420-1b69-48f2-9495-2fa8fb38e056 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.751553 Oct 29 03:10:08.844976 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2171/4533] 10.222.0.46 () {58 vars in 1137 bytes} [Sat Oct 29 03:10:08 2022] GET /compute/v2.1/os-services => generated 944 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:10:08.858763 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3c2f2c24-b6ad-449f-8c47-f714109bc4dc tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:08.862720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c2f2c24-b6ad-449f-8c47-f714109bc4dc tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:08.863852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c2f2c24-b6ad-449f-8c47-f714109bc4dc tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:08.864699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c2f2c24-b6ad-449f-8c47-f714109bc4dc tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:08.866305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c2f2c24-b6ad-449f-8c47-f714109bc4dc tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:08.866986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c2f2c24-b6ad-449f-8c47-f714109bc4dc tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:08.867641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c2f2c24-b6ad-449f-8c47-f714109bc4dc tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:08.897737 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3c2f2c24-b6ad-449f-8c47-f714109bc4dc tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.043700 Oct 29 03:10:08.906985 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2363/4534] 10.222.0.46 () {58 vars in 1170 bytes} [Sat Oct 29 03:10:08 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:10:08.912988 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f4fc02bc-c990-4cb2-8e78-7f3cf4d37ca6 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:08.917888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4fc02bc-c990-4cb2-8e78-7f3cf4d37ca6 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:08.918897 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4fc02bc-c990-4cb2-8e78-7f3cf4d37ca6 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:08.919469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4fc02bc-c990-4cb2-8e78-7f3cf4d37ca6 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:08.920356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4fc02bc-c990-4cb2-8e78-7f3cf4d37ca6 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:08.921079 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4fc02bc-c990-4cb2-8e78-7f3cf4d37ca6 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:08.921600 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4fc02bc-c990-4cb2-8e78-7f3cf4d37ca6 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:08.951630 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f4fc02bc-c990-4cb2-8e78-7f3cf4d37ca6 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.042891 Oct 29 03:10:08.960556 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2172/4535] 10.222.0.46 () {58 vars in 1137 bytes} [Sat Oct 29 03:10:08 2022] GET /compute/v2.1/os-services => generated 944 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:10:08.968362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-35b26c81-a613-4062-94e6-f01eff117b26 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:08.979394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35b26c81-a613-4062-94e6-f01eff117b26 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:08.979610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35b26c81-a613-4062-94e6-f01eff117b26 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:08.981359 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35b26c81-a613-4062-94e6-f01eff117b26 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:08.982131 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35b26c81-a613-4062-94e6-f01eff117b26 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:08.982594 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35b26c81-a613-4062-94e6-f01eff117b26 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:08.986029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35b26c81-a613-4062-94e6-f01eff117b26 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:09.034507 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-35b26c81-a613-4062-94e6-f01eff117b26 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?host=n-d-862967-2&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.071867 Oct 29 03:10:09.035591 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2364/4536] 10.222.0.46 () {58 vars in 1194 bytes} [Sat Oct 29 03:10:08 2022] GET /compute/v2.1/os-services?host=n-d-862967-2&binary=xxx => generated 16 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:10:09.048593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c0a860bb-85a9-4896-b070-14bcde562200 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:09.052236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0a860bb-85a9-4896-b070-14bcde562200 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:09.053369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0a860bb-85a9-4896-b070-14bcde562200 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:09.054032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0a860bb-85a9-4896-b070-14bcde562200 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:09.056295 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0a860bb-85a9-4896-b070-14bcde562200 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:09.058350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0a860bb-85a9-4896-b070-14bcde562200 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:09.059086 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0a860bb-85a9-4896-b070-14bcde562200 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:09.139086 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c0a860bb-85a9-4896-b070-14bcde562200 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.093933 Oct 29 03:10:09.150312 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2173/4537] 10.222.0.46 () {58 vars in 1137 bytes} [Sat Oct 29 03:10:09 2022] GET /compute/v2.1/os-services => generated 944 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:10:09.155090 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a3bccc0d-d586-4d55-830b-9f89abb42f31 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:09.160076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a3bccc0d-d586-4d55-830b-9f89abb42f31 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:09.161783 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a3bccc0d-d586-4d55-830b-9f89abb42f31 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:09.162445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a3bccc0d-d586-4d55-830b-9f89abb42f31 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:09.164881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a3bccc0d-d586-4d55-830b-9f89abb42f31 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:09.168790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a3bccc0d-d586-4d55-830b-9f89abb42f31 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:09.169160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a3bccc0d-d586-4d55-830b-9f89abb42f31 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:09.228968 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a3bccc0d-d586-4d55-830b-9f89abb42f31 tempest-ServicesAdminNegativeTestJSON-1989853106 tempest-ServicesAdminNegativeTestJSON-1989853106-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.080225 Oct 29 03:10:09.230991 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2365/4538] 10.222.0.46 () {58 vars in 1198 bytes} [Sat Oct 29 03:10:09 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:10:09.805609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-519996b7-2048-483f-af91-5cb33bc7d5e0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:09.807226 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-519996b7-2048-483f-af91-5cb33bc7d5e0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:09.818514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-519996b7-2048-483f-af91-5cb33bc7d5e0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:09.819410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-519996b7-2048-483f-af91-5cb33bc7d5e0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:09.820651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-519996b7-2048-483f-af91-5cb33bc7d5e0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:09.821679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-519996b7-2048-483f-af91-5cb33bc7d5e0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:09.822630 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-519996b7-2048-483f-af91-5cb33bc7d5e0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:09.823539 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-519996b7-2048-483f-af91-5cb33bc7d5e0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:09.859363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-89fdca30-4b2d-43f6-b49a-4e354b47f8bf tempest-ServicesAdminNegativeTestJSON-1179733875 tempest-ServicesAdminNegativeTestJSON-1179733875-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:09.863210 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-89fdca30-4b2d-43f6-b49a-4e354b47f8bf tempest-ServicesAdminNegativeTestJSON-1179733875 tempest-ServicesAdminNegativeTestJSON-1179733875-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '73894a2ddab847c4852f2286a54bd88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9f7984c90464bbfa05daf3e3d917b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-89fdca30-4b2d-43f6-b49a-4e354b47f8bf tempest-ServicesAdminNegativeTestJSON-1179733875 tempest-ServicesAdminNegativeTestJSON-1179733875-project] Request method failure captured: Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJmNZ45aDzDrlip4qXmz6EXer-xpQ0ESWxq-wxZVTjFIJfgZ0WyiC95BasTtwK7jY1VIahFB5_2DlBMzO7wCMLokIJ9XZalcfgwYICD1l8ByBIfnHwEJpS3buyT5JNyuYvqsFQ5fVnGOVB5ntVkE8PViwEv_RgkXdxZsYqOTDfIX2ms Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: a9f7984c90464bbfa05daf3e3d917b61 Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1179733875 Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a9f7984c90464bbfa05daf3e3d917b61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a9f7984c90464bbfa05daf3e3d917b61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a9f7984c90464bbfa05daf3e3d917b61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a9f7984c90464bbfa05daf3e3d917b61"}]}] Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1179733875 Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: a9f7984c90464bbfa05daf3e3d917b61 Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1179733875 Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServicesAdminNegativeTestJSON-1179733875-project Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 73894a2ddab847c4852f2286a54bd88f Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1179733875-project Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: action_args: {} Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 29 03:10:09.869976 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:10:09.875112 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:10:09.875112 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:10:09.875112 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:09.875112 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:10:09.875112 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:10:09.875112 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 29 03:10:09.875112 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 29 03:10:09.875112 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 29 03:10:09.875112 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:10:09.878553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-89fdca30-4b2d-43f6-b49a-4e354b47f8bf tempest-ServicesAdminNegativeTestJSON-1179733875 tempest-ServicesAdminNegativeTestJSON-1179733875-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:10:09.880991 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-89fdca30-4b2d-43f6-b49a-4e354b47f8bf tempest-ServicesAdminNegativeTestJSON-1179733875 tempest-ServicesAdminNegativeTestJSON-1179733875-project] 10.222.0.46 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.641382 Oct 29 03:10:09.887946 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2174/4539] 10.222.0.46 () {58 vars in 1137 bytes} [Sat Oct 29 03:10:09 2022] GET /compute/v2.1/os-services => generated 112 bytes in 649 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:10:10.119094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-519996b7-2048-483f-af91-5cb33bc7d5e0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:10.130097 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-519996b7-2048-483f-af91-5cb33bc7d5e0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1371 microversion: 2.1 time: 0.329966 Oct 29 03:10:10.131160 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2366/4540] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:09 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1371 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:10.849578 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-e1d67d64-dcf6-4cbc-b6fd-8f8aa929b2cd req-7f64306e-e7e2-4730-9ef2-8e3ddb71defa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0116c079-f618-42b3-94f5-340b2ed6efdd", "name": "network-vif-plugged", "status": "completed", "tag": "e14797d0-26ba-4515-ad2c-8ff690e8db5f"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:10:10.881384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e1d67d64-dcf6-4cbc-b6fd-8f8aa929b2cd req-7f64306e-e7e2-4730-9ef2-8e3ddb71defa service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:10.882024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e1d67d64-dcf6-4cbc-b6fd-8f8aa929b2cd req-7f64306e-e7e2-4730-9ef2-8e3ddb71defa service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:10.884453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e1d67d64-dcf6-4cbc-b6fd-8f8aa929b2cd req-7f64306e-e7e2-4730-9ef2-8e3ddb71defa service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:10.910764 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-e1d67d64-dcf6-4cbc-b6fd-8f8aa929b2cd req-7f64306e-e7e2-4730-9ef2-8e3ddb71defa service nova] Creating event network-vif-plugged:e14797d0-26ba-4515-ad2c-8ff690e8db5f for instance 0116c079-f618-42b3-94f5-340b2ed6efdd on n-h1-862967-2 Oct 29 03:10:10.936994 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-e1d67d64-dcf6-4cbc-b6fd-8f8aa929b2cd req-7f64306e-e7e2-4730-9ef2-8e3ddb71defa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079899 Oct 29 03:10:10.940627 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2175/4541] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:10:11.155733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6d00bbaa-f3ef-41ed-aeed-467960456610 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:11.156348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6d00bbaa-f3ef-41ed-aeed-467960456610 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:11.172728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d00bbaa-f3ef-41ed-aeed-467960456610 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:11.173547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d00bbaa-f3ef-41ed-aeed-467960456610 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:11.184995 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d00bbaa-f3ef-41ed-aeed-467960456610 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:11.186229 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d00bbaa-f3ef-41ed-aeed-467960456610 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:11.186866 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d00bbaa-f3ef-41ed-aeed-467960456610 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:11.187876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d00bbaa-f3ef-41ed-aeed-467960456610 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:11.568423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6d00bbaa-f3ef-41ed-aeed-467960456610 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:11.582890 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6d00bbaa-f3ef-41ed-aeed-467960456610 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1371 microversion: 2.1 time: 0.429090 Oct 29 03:10:11.588002 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2367/4542] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:11 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1371 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:12.622565 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b351f874-d608-4888-8bf3-cfbdd2ce453d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:12.623993 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b351f874-d608-4888-8bf3-cfbdd2ce453d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:12.639362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b351f874-d608-4888-8bf3-cfbdd2ce453d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:12.642237 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b351f874-d608-4888-8bf3-cfbdd2ce453d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:12.642857 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b351f874-d608-4888-8bf3-cfbdd2ce453d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:12.644100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b351f874-d608-4888-8bf3-cfbdd2ce453d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:12.645119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b351f874-d608-4888-8bf3-cfbdd2ce453d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:12.648367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b351f874-d608-4888-8bf3-cfbdd2ce453d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:12.946091 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b351f874-d608-4888-8bf3-cfbdd2ce453d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:12.956368 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b351f874-d608-4888-8bf3-cfbdd2ce453d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1566 microversion: 2.1 time: 0.345132 Oct 29 03:10:12.960182 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2176/4543] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:12 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1566 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:12.982947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cd02d13d-7ad1-4beb-a1eb-03b757d0a865 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:12.984235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cd02d13d-7ad1-4beb-a1eb-03b757d0a865 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:13.001048 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd02d13d-7ad1-4beb-a1eb-03b757d0a865 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:13.003509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd02d13d-7ad1-4beb-a1eb-03b757d0a865 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:13.005086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd02d13d-7ad1-4beb-a1eb-03b757d0a865 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:13.006390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd02d13d-7ad1-4beb-a1eb-03b757d0a865 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:13.008088 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd02d13d-7ad1-4beb-a1eb-03b757d0a865 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:13.009092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd02d13d-7ad1-4beb-a1eb-03b757d0a865 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:13.206669 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cd02d13d-7ad1-4beb-a1eb-03b757d0a865 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.227533 Oct 29 03:10:13.208429 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2368/4544] 10.222.0.46 () {58 vars in 1275 bytes} [Sat Oct 29 03:10:12 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-interface => generated 285 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:10:15.380075 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-75747a78-06fe-4424-9085-59d5e01f1bf4 req-1e86025b-0d57-4e1c-8e14-2cab31438c44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0116c079-f618-42b3-94f5-340b2ed6efdd", "tag": "e14797d0-26ba-4515-ad2c-8ff690e8db5f"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:10:15.397715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-75747a78-06fe-4424-9085-59d5e01f1bf4 req-1e86025b-0d57-4e1c-8e14-2cab31438c44 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:15.398688 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-75747a78-06fe-4424-9085-59d5e01f1bf4 req-1e86025b-0d57-4e1c-8e14-2cab31438c44 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:15.399733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-75747a78-06fe-4424-9085-59d5e01f1bf4 req-1e86025b-0d57-4e1c-8e14-2cab31438c44 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:15.436262 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-75747a78-06fe-4424-9085-59d5e01f1bf4 req-1e86025b-0d57-4e1c-8e14-2cab31438c44 service nova] Creating event network-changed:e14797d0-26ba-4515-ad2c-8ff690e8db5f for instance 0116c079-f618-42b3-94f5-340b2ed6efdd on n-h1-862967-2 Oct 29 03:10:15.444307 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-75747a78-06fe-4424-9085-59d5e01f1bf4 req-1e86025b-0d57-4e1c-8e14-2cab31438c44 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070072 Oct 29 03:10:15.445420 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2177/4545] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:10:20.949418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:21.471899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-72474dec-da32-4a5a-a432-91b28bf9d191 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1074796407", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:10:21.590761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-72474dec-da32-4a5a-a432-91b28bf9d191 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] validate_networks() for None {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:10:23.052751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=61 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:23.611608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-72474dec-da32-4a5a-a432-91b28bf9d191 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:10:23.612029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-72474dec-da32-4a5a-a432-91b28bf9d191 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:10:23.612830 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-72474dec-da32-4a5a-a432-91b28bf9d191 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:10:23.613421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-72474dec-da32-4a5a-a432-91b28bf9d191 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:10:23.614034 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-72474dec-da32-4a5a-a432-91b28bf9d191 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:10:23.631972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72474dec-da32-4a5a-a432-91b28bf9d191 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:23.635702 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72474dec-da32-4a5a-a432-91b28bf9d191 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:23.636815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72474dec-da32-4a5a-a432-91b28bf9d191 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:23.641974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72474dec-da32-4a5a-a432-91b28bf9d191 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:23.642875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72474dec-da32-4a5a-a432-91b28bf9d191 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:23.643801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72474dec-da32-4a5a-a432-91b28bf9d191 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:23.694954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-72474dec-da32-4a5a-a432-91b28bf9d191 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Getting quotas for project 74e028976bdb4e608fc6b9f98e75dfdf. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:10:23.707793 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-72474dec-da32-4a5a-a432-91b28bf9d191 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Getting quotas for user a5cd2b2f1db54b5fa177672aca965cf8 and project 74e028976bdb4e608fc6b9f98e75dfdf. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:10:23.746916 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-72474dec-da32-4a5a-a432-91b28bf9d191 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:10:23.759212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-72474dec-da32-4a5a-a432-91b28bf9d191 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] [instance: 75fdd06f-8d70-450f-8232-333c181ab8eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:10:23.867093 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-72474dec-da32-4a5a-a432-91b28bf9d191 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.926552 Oct 29 03:10:23.868155 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2369/4546] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:10:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:10:23.881194 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6024b827-5eed-4b45-8c27-d666409da57c tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:23.881889 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6024b827-5eed-4b45-8c27-d666409da57c tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] [instance: 75fdd06f-8d70-450f-8232-333c181ab8eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:23.891966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:24.209333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6024b827-5eed-4b45-8c27-d666409da57c tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cd2b2f1db54b5fa177672aca965cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e028976bdb4e608fc6b9f98e75dfdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:24.224843 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6024b827-5eed-4b45-8c27-d666409da57c tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] 10.222.0.46 "GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb" status: 200 len: 1214 microversion: 2.1 time: 0.347021 Oct 29 03:10:24.229796 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2178/4547] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:23 2022] GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb => generated 1214 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:25.251287 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-96cf6727-070e-498d-a5f8-b0aa24d2dcad tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:25.251979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-96cf6727-070e-498d-a5f8-b0aa24d2dcad tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] [instance: 75fdd06f-8d70-450f-8232-333c181ab8eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:25.257135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=65 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:25.275421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-96cf6727-070e-498d-a5f8-b0aa24d2dcad tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:25.275927 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-96cf6727-070e-498d-a5f8-b0aa24d2dcad tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:25.276571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-96cf6727-070e-498d-a5f8-b0aa24d2dcad tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:25.278556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-96cf6727-070e-498d-a5f8-b0aa24d2dcad tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:25.279024 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-96cf6727-070e-498d-a5f8-b0aa24d2dcad tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:25.280738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-96cf6727-070e-498d-a5f8-b0aa24d2dcad tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:25.512191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-96cf6727-070e-498d-a5f8-b0aa24d2dcad tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cd2b2f1db54b5fa177672aca965cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e028976bdb4e608fc6b9f98e75dfdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:25.522959 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-96cf6727-070e-498d-a5f8-b0aa24d2dcad tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] 10.222.0.46 "GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb" status: 200 len: 1266 microversion: 2.1 time: 0.276891 Oct 29 03:10:25.528864 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2370/4548] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:25 2022] GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:26.551246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-01916929-6a32-451e-ac7d-5c338f03bdcf tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:26.552755 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-01916929-6a32-451e-ac7d-5c338f03bdcf tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] [instance: 75fdd06f-8d70-450f-8232-333c181ab8eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:26.566884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=44 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:26.574064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01916929-6a32-451e-ac7d-5c338f03bdcf tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:26.576167 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01916929-6a32-451e-ac7d-5c338f03bdcf tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:26.576855 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01916929-6a32-451e-ac7d-5c338f03bdcf tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:26.578839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01916929-6a32-451e-ac7d-5c338f03bdcf tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:26.580297 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01916929-6a32-451e-ac7d-5c338f03bdcf tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:26.581568 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01916929-6a32-451e-ac7d-5c338f03bdcf tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:26.798060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-01916929-6a32-451e-ac7d-5c338f03bdcf tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cd2b2f1db54b5fa177672aca965cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e028976bdb4e608fc6b9f98e75dfdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:26.810371 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-01916929-6a32-451e-ac7d-5c338f03bdcf tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] 10.222.0.46 "GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb" status: 200 len: 1272 microversion: 2.1 time: 0.263790 Oct 29 03:10:26.823621 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2179/4549] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:26 2022] GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb => generated 1272 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:27.843715 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3c3ae9e2-3bac-466f-9b5d-2a7b0bfaf183 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:27.844341 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3c3ae9e2-3bac-466f-9b5d-2a7b0bfaf183 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] [instance: 75fdd06f-8d70-450f-8232-333c181ab8eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:27.859650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c3ae9e2-3bac-466f-9b5d-2a7b0bfaf183 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:27.860434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c3ae9e2-3bac-466f-9b5d-2a7b0bfaf183 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:27.861489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c3ae9e2-3bac-466f-9b5d-2a7b0bfaf183 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:27.862533 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c3ae9e2-3bac-466f-9b5d-2a7b0bfaf183 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:27.864370 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c3ae9e2-3bac-466f-9b5d-2a7b0bfaf183 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:27.865580 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c3ae9e2-3bac-466f-9b5d-2a7b0bfaf183 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:28.788707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3c3ae9e2-3bac-466f-9b5d-2a7b0bfaf183 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cd2b2f1db54b5fa177672aca965cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e028976bdb4e608fc6b9f98e75dfdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:28.801427 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3c3ae9e2-3bac-466f-9b5d-2a7b0bfaf183 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] 10.222.0.46 "GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb" status: 200 len: 1314 microversion: 2.1 time: 0.959112 Oct 29 03:10:28.805137 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2371/4550] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:27 2022] GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb => generated 1314 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:29.777758 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8ef2722b-6158-472b-9923-69c8c3925cda tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:29.779948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8ef2722b-6158-472b-9923-69c8c3925cda tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:29.797671 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ef2722b-6158-472b-9923-69c8c3925cda tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:29.797671 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ef2722b-6158-472b-9923-69c8c3925cda tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:29.797959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ef2722b-6158-472b-9923-69c8c3925cda tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:29.799590 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ef2722b-6158-472b-9923-69c8c3925cda tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:29.800237 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ef2722b-6158-472b-9923-69c8c3925cda tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:29.800856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ef2722b-6158-472b-9923-69c8c3925cda tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:29.830664 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d03c655e-de47-44a6-9bc9-d68ec6f0fb29 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:29.832474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d03c655e-de47-44a6-9bc9-d68ec6f0fb29 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] [instance: 75fdd06f-8d70-450f-8232-333c181ab8eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:29.860556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d03c655e-de47-44a6-9bc9-d68ec6f0fb29 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:29.861155 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d03c655e-de47-44a6-9bc9-d68ec6f0fb29 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:29.861711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d03c655e-de47-44a6-9bc9-d68ec6f0fb29 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:29.862860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d03c655e-de47-44a6-9bc9-d68ec6f0fb29 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:29.863725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d03c655e-de47-44a6-9bc9-d68ec6f0fb29 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:29.864257 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d03c655e-de47-44a6-9bc9-d68ec6f0fb29 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:29.875381 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8ef2722b-6158-472b-9923-69c8c3925cda tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102129 Oct 29 03:10:29.880271 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2180/4551] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:10:29 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:10:29.973902 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-033695a0-f870-4856-afcf-b0e40b9a066c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:29.974517 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-033695a0-f870-4856-afcf-b0e40b9a066c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:29.985402 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-033695a0-f870-4856-afcf-b0e40b9a066c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:29.986202 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-033695a0-f870-4856-afcf-b0e40b9a066c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:29.989628 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-033695a0-f870-4856-afcf-b0e40b9a066c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:29.990566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-033695a0-f870-4856-afcf-b0e40b9a066c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:29.991449 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-033695a0-f870-4856-afcf-b0e40b9a066c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:29.993363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-033695a0-f870-4856-afcf-b0e40b9a066c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:30.030792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-033695a0-f870-4856-afcf-b0e40b9a066c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:10:30.195623 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-033695a0-f870-4856-afcf-b0e40b9a066c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "DELETE /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 204 len: 0 microversion: 2.1 time: 0.225321 Oct 29 03:10:30.197327 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2181/4552] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:10:29 2022] DELETE /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 03:10:30.208666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5ce4ec3d-0b4a-49b7-8461-24094c6a0f20 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:30.209424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5ce4ec3d-0b4a-49b7-8461-24094c6a0f20 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:30.217333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ce4ec3d-0b4a-49b7-8461-24094c6a0f20 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:30.218338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ce4ec3d-0b4a-49b7-8461-24094c6a0f20 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:30.218980 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ce4ec3d-0b4a-49b7-8461-24094c6a0f20 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:30.220350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ce4ec3d-0b4a-49b7-8461-24094c6a0f20 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:30.221497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ce4ec3d-0b4a-49b7-8461-24094c6a0f20 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:30.222371 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ce4ec3d-0b4a-49b7-8461-24094c6a0f20 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:30.520806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5ce4ec3d-0b4a-49b7-8461-24094c6a0f20 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:30.530973 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5ce4ec3d-0b4a-49b7-8461-24094c6a0f20 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1673 microversion: 2.1 time: 0.329028 Oct 29 03:10:30.531815 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2182/4553] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:30 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1673 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:10:31.473452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d03c655e-de47-44a6-9bc9-d68ec6f0fb29 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cd2b2f1db54b5fa177672aca965cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e028976bdb4e608fc6b9f98e75dfdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:31.490344 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d03c655e-de47-44a6-9bc9-d68ec6f0fb29 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] 10.222.0.46 "GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb" status: 200 len: 1314 microversion: 2.1 time: 1.660188 Oct 29 03:10:31.491715 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2372/4554] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:29 2022] GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb => generated 1314 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:10:31.557206 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-73a790e4-3b4a-46d4-9c7a-7ecd89d12c9c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:31.558027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-73a790e4-3b4a-46d4-9c7a-7ecd89d12c9c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:31.566255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73a790e4-3b4a-46d4-9c7a-7ecd89d12c9c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:31.567355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73a790e4-3b4a-46d4-9c7a-7ecd89d12c9c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:31.568015 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73a790e4-3b4a-46d4-9c7a-7ecd89d12c9c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:31.568995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73a790e4-3b4a-46d4-9c7a-7ecd89d12c9c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:31.572897 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73a790e4-3b4a-46d4-9c7a-7ecd89d12c9c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:31.573884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73a790e4-3b4a-46d4-9c7a-7ecd89d12c9c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:32.024902 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-73a790e4-3b4a-46d4-9c7a-7ecd89d12c9c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:32.053556 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-73a790e4-3b4a-46d4-9c7a-7ecd89d12c9c tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1673 microversion: 2.1 time: 0.496492 Oct 29 03:10:32.058301 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2183/4555] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:31 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1673 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:32.517812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bb8fa4b0-a44c-4134-a323-826c0c7e7e90 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:32.520789 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bb8fa4b0-a44c-4134-a323-826c0c7e7e90 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] [instance: 75fdd06f-8d70-450f-8232-333c181ab8eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:32.532305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb8fa4b0-a44c-4134-a323-826c0c7e7e90 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:32.533391 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb8fa4b0-a44c-4134-a323-826c0c7e7e90 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:32.535538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb8fa4b0-a44c-4134-a323-826c0c7e7e90 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:32.537547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb8fa4b0-a44c-4134-a323-826c0c7e7e90 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:32.539213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb8fa4b0-a44c-4134-a323-826c0c7e7e90 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:32.541083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb8fa4b0-a44c-4134-a323-826c0c7e7e90 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:32.810248 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-ced85741-0b36-408c-a892-3e9eae5b98cf req-d0420154-4f3f-4261-9a13-8f99d6ecbd0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75fdd06f-8d70-450f-8232-333c181ab8eb", "tag": "3ce9e3f2-08c0-46c7-8bf3-eb1d0d2d965d"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:10:32.833998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ced85741-0b36-408c-a892-3e9eae5b98cf req-d0420154-4f3f-4261-9a13-8f99d6ecbd0a service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:32.834743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ced85741-0b36-408c-a892-3e9eae5b98cf req-d0420154-4f3f-4261-9a13-8f99d6ecbd0a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:32.840746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ced85741-0b36-408c-a892-3e9eae5b98cf req-d0420154-4f3f-4261-9a13-8f99d6ecbd0a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:32.874927 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-ced85741-0b36-408c-a892-3e9eae5b98cf req-d0420154-4f3f-4261-9a13-8f99d6ecbd0a service nova] Creating event network-changed:3ce9e3f2-08c0-46c7-8bf3-eb1d0d2d965d for instance 75fdd06f-8d70-450f-8232-333c181ab8eb on n-h2-862967-2 Oct 29 03:10:32.886428 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-ced85741-0b36-408c-a892-3e9eae5b98cf req-d0420154-4f3f-4261-9a13-8f99d6ecbd0a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080254 Oct 29 03:10:32.887894 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2184/4556] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:10:33.085236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-452295bc-cc7e-4e3c-88c1-6d86c73f64bb tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:33.086044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-452295bc-cc7e-4e3c-88c1-6d86c73f64bb tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:33.097024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-452295bc-cc7e-4e3c-88c1-6d86c73f64bb tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:33.098628 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-452295bc-cc7e-4e3c-88c1-6d86c73f64bb tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:33.102660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-452295bc-cc7e-4e3c-88c1-6d86c73f64bb tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:33.103591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-452295bc-cc7e-4e3c-88c1-6d86c73f64bb tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:33.104411 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-452295bc-cc7e-4e3c-88c1-6d86c73f64bb tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:33.104935 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-452295bc-cc7e-4e3c-88c1-6d86c73f64bb tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:33.340047 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-452295bc-cc7e-4e3c-88c1-6d86c73f64bb tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:33.356126 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-452295bc-cc7e-4e3c-88c1-6d86c73f64bb tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1673 microversion: 2.1 time: 0.276332 Oct 29 03:10:33.372226 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2185/4557] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:33 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1673 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:33.666752 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:33.696073 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bb8fa4b0-a44c-4134-a323-826c0c7e7e90 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cd2b2f1db54b5fa177672aca965cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e028976bdb4e608fc6b9f98e75dfdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:33.715915 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bb8fa4b0-a44c-4134-a323-826c0c7e7e90 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] 10.222.0.46 "GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb" status: 200 len: 1314 microversion: 2.1 time: 1.204719 Oct 29 03:10:33.738772 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2373/4558] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:32 2022] GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb => generated 1314 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:34.380356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ddd1eadf-4e3c-47e9-8802-b1ef3cba4e4f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:34.381162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ddd1eadf-4e3c-47e9-8802-b1ef3cba4e4f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:34.392800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:34.395203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:34.396745 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ddd1eadf-4e3c-47e9-8802-b1ef3cba4e4f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:34.398107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ddd1eadf-4e3c-47e9-8802-b1ef3cba4e4f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:34.399213 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ddd1eadf-4e3c-47e9-8802-b1ef3cba4e4f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:34.400389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ddd1eadf-4e3c-47e9-8802-b1ef3cba4e4f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:34.401121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ddd1eadf-4e3c-47e9-8802-b1ef3cba4e4f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:34.402145 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ddd1eadf-4e3c-47e9-8802-b1ef3cba4e4f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:34.754742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4bc3f8dc-8eab-4c5f-aa6b-03f377a9846a tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:34.758188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4bc3f8dc-8eab-4c5f-aa6b-03f377a9846a tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] [instance: 75fdd06f-8d70-450f-8232-333c181ab8eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:34.774794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:34.781670 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bc3f8dc-8eab-4c5f-aa6b-03f377a9846a tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:34.783548 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bc3f8dc-8eab-4c5f-aa6b-03f377a9846a tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:34.786674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bc3f8dc-8eab-4c5f-aa6b-03f377a9846a tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:34.787714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bc3f8dc-8eab-4c5f-aa6b-03f377a9846a tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:34.789362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bc3f8dc-8eab-4c5f-aa6b-03f377a9846a tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:34.790968 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bc3f8dc-8eab-4c5f-aa6b-03f377a9846a tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:34.853000 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ddd1eadf-4e3c-47e9-8802-b1ef3cba4e4f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:34.871191 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ddd1eadf-4e3c-47e9-8802-b1ef3cba4e4f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1673 microversion: 2.1 time: 0.493330 Oct 29 03:10:34.873837 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2186/4559] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:34 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1673 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:35.365518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4bc3f8dc-8eab-4c5f-aa6b-03f377a9846a tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cd2b2f1db54b5fa177672aca965cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e028976bdb4e608fc6b9f98e75dfdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:35.378029 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4bc3f8dc-8eab-4c5f-aa6b-03f377a9846a tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] 10.222.0.46 "GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb" status: 200 len: 1314 microversion: 2.1 time: 0.631644 Oct 29 03:10:35.378774 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2374/4560] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:34 2022] GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:35.856133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-30366bad-d451-4bac-a802-940866b85320 req-efd2665c-e6e3-4155-ac13-26724023dced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05f5328d-7d86-44f3-bb9f-8d06de0daa17", "name": "network-vif-deleted", "tag": "febf7e0e-53b9-4105-ae6d-f9ae262ab497"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:10:35.874791 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-30366bad-d451-4bac-a802-940866b85320 req-efd2665c-e6e3-4155-ac13-26724023dced service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:35.875612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-30366bad-d451-4bac-a802-940866b85320 req-efd2665c-e6e3-4155-ac13-26724023dced service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:35.876279 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-30366bad-d451-4bac-a802-940866b85320 req-efd2665c-e6e3-4155-ac13-26724023dced service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:35.898331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4f842538-3316-440c-b15b-45c01f1f3baa tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:35.899392 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4f842538-3316-440c-b15b-45c01f1f3baa tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:35.907473 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-30366bad-d451-4bac-a802-940866b85320 req-efd2665c-e6e3-4155-ac13-26724023dced service nova] Creating event network-vif-deleted:febf7e0e-53b9-4105-ae6d-f9ae262ab497 for instance 05f5328d-7d86-44f3-bb9f-8d06de0daa17 on n-h2-862967-2 Oct 29 03:10:35.917237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f842538-3316-440c-b15b-45c01f1f3baa tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:35.918319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f842538-3316-440c-b15b-45c01f1f3baa tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:35.918319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f842538-3316-440c-b15b-45c01f1f3baa tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:35.927884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f842538-3316-440c-b15b-45c01f1f3baa tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:35.931331 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-30366bad-d451-4bac-a802-940866b85320 req-efd2665c-e6e3-4155-ac13-26724023dced service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081145 Oct 29 03:10:35.931544 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f842538-3316-440c-b15b-45c01f1f3baa tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:35.933576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f842538-3316-440c-b15b-45c01f1f3baa tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:35.933864 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2187/4561] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:10:36.165583 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4f842538-3316-440c-b15b-45c01f1f3baa tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:36.179368 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4f842538-3316-440c-b15b-45c01f1f3baa tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 200 len: 1322 microversion: 2.1 time: 0.285225 Oct 29 03:10:36.183606 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2375/4562] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:35 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 1322 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:36.403502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7f93a3c8-51c6-4f0f-a7f4-02a587e6989c tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:36.404785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7f93a3c8-51c6-4f0f-a7f4-02a587e6989c tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] [instance: 75fdd06f-8d70-450f-8232-333c181ab8eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:36.411553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f93a3c8-51c6-4f0f-a7f4-02a587e6989c tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:36.412305 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f93a3c8-51c6-4f0f-a7f4-02a587e6989c tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:36.415268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f93a3c8-51c6-4f0f-a7f4-02a587e6989c tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:36.416308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f93a3c8-51c6-4f0f-a7f4-02a587e6989c tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:36.417331 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f93a3c8-51c6-4f0f-a7f4-02a587e6989c tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:36.420090 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f93a3c8-51c6-4f0f-a7f4-02a587e6989c tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:37.211297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2714b01e-7fe1-4a84-8b3d-335c969bb108 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:37.212104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2714b01e-7fe1-4a84-8b3d-335c969bb108 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:37.229601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2714b01e-7fe1-4a84-8b3d-335c969bb108 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:37.230177 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2714b01e-7fe1-4a84-8b3d-335c969bb108 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:37.230638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2714b01e-7fe1-4a84-8b3d-335c969bb108 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:37.236648 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2714b01e-7fe1-4a84-8b3d-335c969bb108 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:37.237981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2714b01e-7fe1-4a84-8b3d-335c969bb108 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:37.243323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2714b01e-7fe1-4a84-8b3d-335c969bb108 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:37.281199 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-2714b01e-7fe1-4a84-8b3d-335c969bb108 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] HTTP exception thrown: Instance 05f5328d-7d86-44f3-bb9f-8d06de0daa17 could not be found. Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2714b01e-7fe1-4a84-8b3d-335c969bb108 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Request method failure captured: Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 HTTP/1.1 Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJjKfda75b0pK70-1QXV8FG9LaFMExKiAhRA5WbJMc8e3WmfYg16rfnbph7_l5MUUwyIfa7l-BwMxMXmQnZKFai0PhtrxzZeOOL_kgJDWXHWhtAht76gGVf4wldFhwTTvnxG2gXJrHNQT-5dSS2YaMBC_A4KNuLwMY7IpgTDJ9usUkk Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: f4853225daef418bb782b4f9f6d1382c Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-AttachVolumeTestJSON-706277848 Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f4853225daef418bb782b4f9f6d1382c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f4853225daef418bb782b4f9f6d1382c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f4853225daef418bb782b4f9f6d1382c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f4853225daef418bb782b4f9f6d1382c"}]}] Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-AttachVolumeTestJSON-706277848 Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: f4853225daef418bb782b4f9f6d1382c Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-AttachVolumeTestJSON-706277848 Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-AttachVolumeTestJSON-706277848-project Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 494c556b424a4fa388680ab08a340a1d Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-AttachVolumeTestJSON-706277848-project Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 05f5328d-7d86-44f3-bb9f-8d06de0daa17 could not be found. Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '05f5328d-7d86-44f3-bb9f-8d06de0daa17'} Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05f5328d-7d86-44f3-bb9f-8d06de0daa17 could not be found. Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05f5328d-7d86-44f3-bb9f-8d06de0daa17 could not be found. Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:10:37.288782 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:10:37.293771 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:37.293771 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:10:37.293771 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:10:37.293771 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:10:37.293771 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:10:37.293771 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05f5328d-7d86-44f3-bb9f-8d06de0daa17 could not be found. Oct 29 03:10:37.293771 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:10:37.299888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2714b01e-7fe1-4a84-8b3d-335c969bb108 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Returning 404 to user: Instance 05f5328d-7d86-44f3-bb9f-8d06de0daa17 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:10:37.301014 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2714b01e-7fe1-4a84-8b3d-335c969bb108 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 404 len: 111 microversion: 2.1 time: 0.095367 Oct 29 03:10:37.303784 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2376/4563] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:37 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:10:37.312733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9c2bd08a-9c1a-4d95-88c6-9bc7f16df27d tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '.version_select at 0x7ff052b3b8b0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:37.355846 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9c2bd08a-9c1a-4d95-88c6-9bc7f16df27d tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1912400694" status: 202 len: 0 microversion: 2.1 time: 0.047701 Oct 29 03:10:37.356868 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2377/4564] 10.222.0.46 () {58 vars in 1221 bytes} [Sat Oct 29 03:10:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1912400694 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:10:37.605869 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7f93a3c8-51c6-4f0f-a7f4-02a587e6989c tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cd2b2f1db54b5fa177672aca965cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e028976bdb4e608fc6b9f98e75dfdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:37.621371 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7f93a3c8-51c6-4f0f-a7f4-02a587e6989c tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] 10.222.0.46 "GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb" status: 200 len: 1314 microversion: 2.1 time: 1.222158 Oct 29 03:10:37.644195 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2188/4565] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:36 2022] GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb => generated 1314 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:38.651779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-22c4b4e6-faca-40cf-9391-29fc5c39e45a tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:38.652161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-22c4b4e6-faca-40cf-9391-29fc5c39e45a tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] [instance: 75fdd06f-8d70-450f-8232-333c181ab8eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:38.659511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22c4b4e6-faca-40cf-9391-29fc5c39e45a tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:38.660004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22c4b4e6-faca-40cf-9391-29fc5c39e45a tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:38.663143 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22c4b4e6-faca-40cf-9391-29fc5c39e45a tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:38.664097 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22c4b4e6-faca-40cf-9391-29fc5c39e45a tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:38.664855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22c4b4e6-faca-40cf-9391-29fc5c39e45a tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:38.666931 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22c4b4e6-faca-40cf-9391-29fc5c39e45a tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:39.141870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-22c4b4e6-faca-40cf-9391-29fc5c39e45a tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cd2b2f1db54b5fa177672aca965cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e028976bdb4e608fc6b9f98e75dfdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:39.152960 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-22c4b4e6-faca-40cf-9391-29fc5c39e45a tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] 10.222.0.46 "GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb" status: 200 len: 1314 microversion: 2.1 time: 0.506530 Oct 29 03:10:39.169063 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2378/4566] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:38 2022] GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb => generated 1314 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:40.167197 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d4a88cdb-6105-4ccf-ae6a-371a5dcdf7f3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Action: 'create', calling method: .version_select at 0x7ff0539bf1f0>, body: {"keypair": {"name": "tempest-keypair-122694989", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlLEcrEdVquOvcDXz8DEE8UCNLTmi0TdO2rcjJ/dVgLXCrfYnoYfHrWf0g4i8JDfOM2BHd2LZ2tIitoogPxy0KoQH3avoTWXVAP+BPgdsPxbd8yrnZsLZKfUKFgYdwgRg=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:10:40.178416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dc1de855-6f25-4bc7-9dbc-43fdaa98a2a3 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:40.179685 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dc1de855-6f25-4bc7-9dbc-43fdaa98a2a3 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] [instance: 75fdd06f-8d70-450f-8232-333c181ab8eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:40.199104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc1de855-6f25-4bc7-9dbc-43fdaa98a2a3 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:40.199857 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc1de855-6f25-4bc7-9dbc-43fdaa98a2a3 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:40.200469 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc1de855-6f25-4bc7-9dbc-43fdaa98a2a3 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:40.204092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc1de855-6f25-4bc7-9dbc-43fdaa98a2a3 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:40.204786 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc1de855-6f25-4bc7-9dbc-43fdaa98a2a3 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:40.205371 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dc1de855-6f25-4bc7-9dbc-43fdaa98a2a3 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:40.238284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-d4a88cdb-6105-4ccf-ae6a-371a5dcdf7f3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Getting quotas for project f4853225daef418bb782b4f9f6d1382c. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:10:40.243960 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-d4a88cdb-6105-4ccf-ae6a-371a5dcdf7f3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Getting quotas for user 494c556b424a4fa388680ab08a340a1d and project f4853225daef418bb782b4f9f6d1382c. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:10:40.294137 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d4a88cdb-6105-4ccf-ae6a-371a5dcdf7f3 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.131093 Oct 29 03:10:40.301268 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2189/4567] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:10:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:10:40.532756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dc1de855-6f25-4bc7-9dbc-43fdaa98a2a3 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cd2b2f1db54b5fa177672aca965cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e028976bdb4e608fc6b9f98e75dfdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:40.543161 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dc1de855-6f25-4bc7-9dbc-43fdaa98a2a3 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] 10.222.0.46 "GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb" status: 200 len: 1314 microversion: 2.1 time: 0.369250 Oct 29 03:10:40.567719 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2379/4568] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:40 2022] GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:41.223193 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-4e874c8a-ac81-48da-99f1-8eceb397baac req-80809eed-df1e-40aa-9c6a-7d3c539713b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75fdd06f-8d70-450f-8232-333c181ab8eb", "name": "network-vif-plugged", "status": "completed", "tag": "3ce9e3f2-08c0-46c7-8bf3-eb1d0d2d965d"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:10:41.264221 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4e874c8a-ac81-48da-99f1-8eceb397baac req-80809eed-df1e-40aa-9c6a-7d3c539713b3 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:41.269412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4e874c8a-ac81-48da-99f1-8eceb397baac req-80809eed-df1e-40aa-9c6a-7d3c539713b3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:41.270247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4e874c8a-ac81-48da-99f1-8eceb397baac req-80809eed-df1e-40aa-9c6a-7d3c539713b3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:41.287115 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-4e874c8a-ac81-48da-99f1-8eceb397baac req-80809eed-df1e-40aa-9c6a-7d3c539713b3 service nova] Creating event network-vif-plugged:3ce9e3f2-08c0-46c7-8bf3-eb1d0d2d965d for instance 75fdd06f-8d70-450f-8232-333c181ab8eb on n-h2-862967-2 Oct 29 03:10:41.293094 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-4e874c8a-ac81-48da-99f1-8eceb397baac req-80809eed-df1e-40aa-9c6a-7d3c539713b3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074525 Oct 29 03:10:41.294009 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2190/4569] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:10:41.575524 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3e250e52-8774-4367-bb02-3837d08483d8 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:41.576290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3e250e52-8774-4367-bb02-3837d08483d8 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] [instance: 75fdd06f-8d70-450f-8232-333c181ab8eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:41.586898 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3e250e52-8774-4367-bb02-3837d08483d8 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:41.589191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3e250e52-8774-4367-bb02-3837d08483d8 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:41.591340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3e250e52-8774-4367-bb02-3837d08483d8 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:41.592723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3e250e52-8774-4367-bb02-3837d08483d8 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:41.593999 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3e250e52-8774-4367-bb02-3837d08483d8 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:41.596011 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3e250e52-8774-4367-bb02-3837d08483d8 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:41.910654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3e250e52-8774-4367-bb02-3837d08483d8 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cd2b2f1db54b5fa177672aca965cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e028976bdb4e608fc6b9f98e75dfdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:41.923509 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3e250e52-8774-4367-bb02-3837d08483d8 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] 10.222.0.46 "GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb" status: 200 len: 1314 microversion: 2.1 time: 0.352104 Oct 29 03:10:41.952866 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2380/4570] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:41 2022] GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:42.960007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c564ccd7-74a3-478c-bdb8-705a7b5db8be tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:42.961510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c564ccd7-74a3-478c-bdb8-705a7b5db8be tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] [instance: 75fdd06f-8d70-450f-8232-333c181ab8eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:42.972610 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c564ccd7-74a3-478c-bdb8-705a7b5db8be tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:42.973537 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c564ccd7-74a3-478c-bdb8-705a7b5db8be tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:42.974268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c564ccd7-74a3-478c-bdb8-705a7b5db8be tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:42.975019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c564ccd7-74a3-478c-bdb8-705a7b5db8be tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:42.975823 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c564ccd7-74a3-478c-bdb8-705a7b5db8be tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:42.976261 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c564ccd7-74a3-478c-bdb8-705a7b5db8be tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:43.481596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c564ccd7-74a3-478c-bdb8-705a7b5db8be tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cd2b2f1db54b5fa177672aca965cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e028976bdb4e608fc6b9f98e75dfdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:43.493350 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c564ccd7-74a3-478c-bdb8-705a7b5db8be tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] 10.222.0.46 "GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb" status: 200 len: 1464 microversion: 2.1 time: 0.537812 Oct 29 03:10:43.495249 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2191/4571] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:42 2022] GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb => generated 1464 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:44.284539 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8d9ee4cc-b3df-4f84-8671-3da29557eb8a tempest-TenantUsagesTestJSON-176732713 tempest-TenantUsagesTestJSON-176732713-project-admin] Calling method '.version_select at 0x7ff052c72550>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:44.315952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d9ee4cc-b3df-4f84-8671-3da29557eb8a tempest-TenantUsagesTestJSON-176732713 tempest-TenantUsagesTestJSON-176732713-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:44.326843 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d9ee4cc-b3df-4f84-8671-3da29557eb8a tempest-TenantUsagesTestJSON-176732713 tempest-TenantUsagesTestJSON-176732713-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:44.327502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d9ee4cc-b3df-4f84-8671-3da29557eb8a tempest-TenantUsagesTestJSON-176732713 tempest-TenantUsagesTestJSON-176732713-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:44.386298 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d9ee4cc-b3df-4f84-8671-3da29557eb8a tempest-TenantUsagesTestJSON-176732713 tempest-TenantUsagesTestJSON-176732713-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:44.387151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d9ee4cc-b3df-4f84-8671-3da29557eb8a tempest-TenantUsagesTestJSON-176732713 tempest-TenantUsagesTestJSON-176732713-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:44.388611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d9ee4cc-b3df-4f84-8671-3da29557eb8a tempest-TenantUsagesTestJSON-176732713 tempest-TenantUsagesTestJSON-176732713-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:44.423522 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8d9ee4cc-b3df-4f84-8671-3da29557eb8a tempest-TenantUsagesTestJSON-176732713 tempest-TenantUsagesTestJSON-176732713-project-admin] 10.222.0.46 "GET /compute/v2.1/os-simple-tenant-usage/74e028976bdb4e608fc6b9f98e75dfdf?start=2022-10-28T03%3A10%3A43.513628&end=2022-10-30T03%3A10%3A43.513628" status: 200 len: 695 microversion: 2.1 time: 0.903242 Oct 29 03:10:44.435672 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2381/4572] 10.222.0.46 () {58 vars in 1412 bytes} [Sat Oct 29 03:10:43 2022] GET /compute/v2.1/os-simple-tenant-usage/74e028976bdb4e608fc6b9f98e75dfdf?start=2022-10-28T03%3A10%3A43.513628&end=2022-10-30T03%3A10%3A43.513628 => generated 695 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:10:44.448380 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-df8177eb-d72b-4369-8a80-109e20869314 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Calling method '.version_select at 0x7ff052cfa4c0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:44.472434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df8177eb-d72b-4369-8a80-109e20869314 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:44.472965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df8177eb-d72b-4369-8a80-109e20869314 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:44.474822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df8177eb-d72b-4369-8a80-109e20869314 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:44.519077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df8177eb-d72b-4369-8a80-109e20869314 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:44.519875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df8177eb-d72b-4369-8a80-109e20869314 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:44.520726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df8177eb-d72b-4369-8a80-109e20869314 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:44.559638 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-df8177eb-d72b-4369-8a80-109e20869314 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] 10.222.0.46 "GET /compute/v2.1/os-simple-tenant-usage/74e028976bdb4e608fc6b9f98e75dfdf?start=2022-10-28T03%3A10%3A43.513628&end=2022-10-30T03%3A10%3A43.513628" status: 200 len: 695 microversion: 2.1 time: 0.121958 Oct 29 03:10:44.567745 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2192/4573] 10.222.0.46 () {58 vars in 1412 bytes} [Sat Oct 29 03:10:44 2022] GET /compute/v2.1/os-simple-tenant-usage/74e028976bdb4e608fc6b9f98e75dfdf?start=2022-10-28T03%3A10%3A43.513628&end=2022-10-30T03%3A10%3A43.513628 => generated 695 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:10:44.583555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eb602559-f73d-4b0b-b308-d2e1e906aa11 tempest-TenantUsagesTestJSON-176732713 tempest-TenantUsagesTestJSON-176732713-project-admin] Calling method '.version_select at 0x7ff052d7e700>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:44.599306 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb602559-f73d-4b0b-b308-d2e1e906aa11 tempest-TenantUsagesTestJSON-176732713 tempest-TenantUsagesTestJSON-176732713-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:44.600002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb602559-f73d-4b0b-b308-d2e1e906aa11 tempest-TenantUsagesTestJSON-176732713 tempest-TenantUsagesTestJSON-176732713-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:44.600692 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb602559-f73d-4b0b-b308-d2e1e906aa11 tempest-TenantUsagesTestJSON-176732713 tempest-TenantUsagesTestJSON-176732713-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:44.631293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb602559-f73d-4b0b-b308-d2e1e906aa11 tempest-TenantUsagesTestJSON-176732713 tempest-TenantUsagesTestJSON-176732713-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:44.631815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb602559-f73d-4b0b-b308-d2e1e906aa11 tempest-TenantUsagesTestJSON-176732713 tempest-TenantUsagesTestJSON-176732713-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:44.632300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb602559-f73d-4b0b-b308-d2e1e906aa11 tempest-TenantUsagesTestJSON-176732713 tempest-TenantUsagesTestJSON-176732713-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:44.933664 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eb602559-f73d-4b0b-b308-d2e1e906aa11 tempest-TenantUsagesTestJSON-176732713 tempest-TenantUsagesTestJSON-176732713-project-admin] 10.222.0.46 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-28T03%3A10%3A43.513628&end=2022-10-30T03%3A10%3A43.513628&detailed=1" status: 200 len: 56806 microversion: 2.1 time: 0.354025 Oct 29 03:10:44.955390 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2382/4574] 10.222.0.46 () {58 vars in 1335 bytes} [Sat Oct 29 03:10:44 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-28T03%3A10%3A43.513628&end=2022-10-30T03%3A10%3A43.513628&detailed=1 => generated 56806 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:10:45.027024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e7d32201-6212-4363-b4de-3b2fe345d467 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:45.027637 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e7d32201-6212-4363-b4de-3b2fe345d467 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] [instance: 75fdd06f-8d70-450f-8232-333c181ab8eb] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:45.048171 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7d32201-6212-4363-b4de-3b2fe345d467 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:45.049459 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7d32201-6212-4363-b4de-3b2fe345d467 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:45.052061 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7d32201-6212-4363-b4de-3b2fe345d467 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:45.052979 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7d32201-6212-4363-b4de-3b2fe345d467 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:45.055780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7d32201-6212-4363-b4de-3b2fe345d467 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:45.056454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7d32201-6212-4363-b4de-3b2fe345d467 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:45.147824 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e7d32201-6212-4363-b4de-3b2fe345d467 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] [instance: 75fdd06f-8d70-450f-8232-333c181ab8eb] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:10:45.373460 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e7d32201-6212-4363-b4de-3b2fe345d467 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] 10.222.0.46 "DELETE /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb" status: 204 len: 0 microversion: 2.1 time: 0.334200 Oct 29 03:10:45.388726 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2193/4575] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:10:45 2022] DELETE /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:10:45.394891 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ca36bab8-8f34-4e02-945d-2031942c5938 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:45.395527 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ca36bab8-8f34-4e02-945d-2031942c5938 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] [instance: 75fdd06f-8d70-450f-8232-333c181ab8eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:45.408909 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca36bab8-8f34-4e02-945d-2031942c5938 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:45.411720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca36bab8-8f34-4e02-945d-2031942c5938 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:45.412455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca36bab8-8f34-4e02-945d-2031942c5938 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:45.414848 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca36bab8-8f34-4e02-945d-2031942c5938 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:45.416333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca36bab8-8f34-4e02-945d-2031942c5938 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:45.420096 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca36bab8-8f34-4e02-945d-2031942c5938 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:45.698266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ca36bab8-8f34-4e02-945d-2031942c5938 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cd2b2f1db54b5fa177672aca965cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e028976bdb4e608fc6b9f98e75dfdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:45.720981 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ca36bab8-8f34-4e02-945d-2031942c5938 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] 10.222.0.46 "GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb" status: 200 len: 1470 microversion: 2.1 time: 0.329895 Oct 29 03:10:45.722985 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2383/4576] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:45 2022] GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb => generated 1470 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:45.953690 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-53950245-3aa3-484b-9724-e778c80a0e15 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-723686688", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc3d40a5-97fb-479b-90dd-e776e89d02f0"}], "security_groups": [{"name": "tempest-securitygroup--1931790684"}], "key_name": "tempest-keypair-122694989", "user_data": "}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:10:46.242082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-53950245-3aa3-484b-9724-e778c80a0e15 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] validate_networks() for [('fc3d40a5-97fb-479b-90dd-e776e89d02f0', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:10:46.751905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8eb0e84a-f171-4849-a591-8bfe3a372e8c tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:46.753250 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8eb0e84a-f171-4849-a591-8bfe3a372e8c tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] [instance: 75fdd06f-8d70-450f-8232-333c181ab8eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:46.783955 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8eb0e84a-f171-4849-a591-8bfe3a372e8c tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:46.791344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8eb0e84a-f171-4849-a591-8bfe3a372e8c tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:46.792304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8eb0e84a-f171-4849-a591-8bfe3a372e8c tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:46.796869 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8eb0e84a-f171-4849-a591-8bfe3a372e8c tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:46.797580 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8eb0e84a-f171-4849-a591-8bfe3a372e8c tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:46.798192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8eb0e84a-f171-4849-a591-8bfe3a372e8c tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:47.596947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8eb0e84a-f171-4849-a591-8bfe3a372e8c tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cd2b2f1db54b5fa177672aca965cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e028976bdb4e608fc6b9f98e75dfdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:47.610270 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8eb0e84a-f171-4849-a591-8bfe3a372e8c tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] 10.222.0.46 "GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb" status: 200 len: 1470 microversion: 2.1 time: 0.865194 Oct 29 03:10:47.617783 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2384/4577] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:46 2022] GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb => generated 1470 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:48.645631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4126ea29-15a5-487d-bf61-0bb21fc57c99 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:48.647279 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4126ea29-15a5-487d-bf61-0bb21fc57c99 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] [instance: 75fdd06f-8d70-450f-8232-333c181ab8eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:48.680316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4126ea29-15a5-487d-bf61-0bb21fc57c99 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:48.684139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4126ea29-15a5-487d-bf61-0bb21fc57c99 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:48.686478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4126ea29-15a5-487d-bf61-0bb21fc57c99 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:48.695035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4126ea29-15a5-487d-bf61-0bb21fc57c99 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:48.695911 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4126ea29-15a5-487d-bf61-0bb21fc57c99 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:48.698817 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4126ea29-15a5-487d-bf61-0bb21fc57c99 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:48.895833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-53950245-3aa3-484b-9724-e778c80a0e15 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:10:48.896387 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-53950245-3aa3-484b-9724-e778c80a0e15 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:10:48.896701 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-53950245-3aa3-484b-9724-e778c80a0e15 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:10:48.897098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-53950245-3aa3-484b-9724-e778c80a0e15 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:10:48.897503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-53950245-3aa3-484b-9724-e778c80a0e15 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:10:48.914337 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53950245-3aa3-484b-9724-e778c80a0e15 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:48.914860 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53950245-3aa3-484b-9724-e778c80a0e15 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:48.915292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53950245-3aa3-484b-9724-e778c80a0e15 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:48.916016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53950245-3aa3-484b-9724-e778c80a0e15 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:48.916461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53950245-3aa3-484b-9724-e778c80a0e15 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:48.921217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53950245-3aa3-484b-9724-e778c80a0e15 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:48.945277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-53950245-3aa3-484b-9724-e778c80a0e15 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Getting quotas for project f4853225daef418bb782b4f9f6d1382c. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:10:48.951481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-53950245-3aa3-484b-9724-e778c80a0e15 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Getting quotas for user 494c556b424a4fa388680ab08a340a1d and project f4853225daef418bb782b4f9f6d1382c. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:10:48.965847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-53950245-3aa3-484b-9724-e778c80a0e15 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:10:48.968276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-53950245-3aa3-484b-9724-e778c80a0e15 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:10:49.129912 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-53950245-3aa3-484b-9724-e778c80a0e15 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.183593 Oct 29 03:10:49.145113 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2194/4578] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:10:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 3199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 03:10:49.160779 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-17be4be5-d32d-4d10-8959-7a5f23e84514 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:49.167030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-17be4be5-d32d-4d10-8959-7a5f23e84514 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:49.526291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-17be4be5-d32d-4d10-8959-7a5f23e84514 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:49.548660 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-17be4be5-d32d-4d10-8959-7a5f23e84514 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e" status: 200 len: 1236 microversion: 2.1 time: 0.402016 Oct 29 03:10:49.554142 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2195/4579] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:49 2022] GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e => generated 1236 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:50.263390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4126ea29-15a5-487d-bf61-0bb21fc57c99 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5cd2b2f1db54b5fa177672aca965cf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74e028976bdb4e608fc6b9f98e75dfdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:50.274321 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4126ea29-15a5-487d-bf61-0bb21fc57c99 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] 10.222.0.46 "GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb" status: 200 len: 1470 microversion: 2.1 time: 1.634323 Oct 29 03:10:50.277767 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2385/4580] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:48 2022] GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb => generated 1470 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:10:50.318829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-a8af3d09-4f48-4078-b010-a5cefa35f71f req-6aeaa3f1-caae-4603-987a-77ff6dce0a97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75fdd06f-8d70-450f-8232-333c181ab8eb", "name": "network-vif-deleted", "tag": "3ce9e3f2-08c0-46c7-8bf3-eb1d0d2d965d"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:10:50.342779 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a8af3d09-4f48-4078-b010-a5cefa35f71f req-6aeaa3f1-caae-4603-987a-77ff6dce0a97 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:50.343263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a8af3d09-4f48-4078-b010-a5cefa35f71f req-6aeaa3f1-caae-4603-987a-77ff6dce0a97 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:50.343696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a8af3d09-4f48-4078-b010-a5cefa35f71f req-6aeaa3f1-caae-4603-987a-77ff6dce0a97 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:50.380824 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-a8af3d09-4f48-4078-b010-a5cefa35f71f req-6aeaa3f1-caae-4603-987a-77ff6dce0a97 service nova] Creating event network-vif-deleted:3ce9e3f2-08c0-46c7-8bf3-eb1d0d2d965d for instance 75fdd06f-8d70-450f-8232-333c181ab8eb on n-h2-862967-2 Oct 29 03:10:50.392138 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-a8af3d09-4f48-4078-b010-a5cefa35f71f req-6aeaa3f1-caae-4603-987a-77ff6dce0a97 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076953 Oct 29 03:10:50.396627 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2196/4581] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:10:50.576820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fbec2142-7ed3-47b1-9d38-0cbac1b42c7f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:50.577724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fbec2142-7ed3-47b1-9d38-0cbac1b42c7f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:50.586001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbec2142-7ed3-47b1-9d38-0cbac1b42c7f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:50.586942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbec2142-7ed3-47b1-9d38-0cbac1b42c7f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:50.589191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbec2142-7ed3-47b1-9d38-0cbac1b42c7f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:50.590198 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbec2142-7ed3-47b1-9d38-0cbac1b42c7f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:50.593106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbec2142-7ed3-47b1-9d38-0cbac1b42c7f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:50.593882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbec2142-7ed3-47b1-9d38-0cbac1b42c7f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:50.854926 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9f9915b5-5203-4bd9-975a-732320b13a21 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93b3658d-8bd2-48c4-81d7-0ff74f04fe81"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:10:50.860400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9f9915b5-5203-4bd9-975a-732320b13a21 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:50.873553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f9915b5-5203-4bd9-975a-732320b13a21 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:50.876801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f9915b5-5203-4bd9-975a-732320b13a21 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:50.878802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f9915b5-5203-4bd9-975a-732320b13a21 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:50.881587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f9915b5-5203-4bd9-975a-732320b13a21 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:50.882220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f9915b5-5203-4bd9-975a-732320b13a21 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:50.886750 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f9915b5-5203-4bd9-975a-732320b13a21 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:51.127849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:51.355262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fbec2142-7ed3-47b1-9d38-0cbac1b42c7f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:51.369459 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fbec2142-7ed3-47b1-9d38-0cbac1b42c7f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e" status: 200 len: 1288 microversion: 2.1 time: 0.796439 Oct 29 03:10:51.370064 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2386/4582] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:50 2022] GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e => generated 1288 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:51.386027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2666ca6c-a9b2-438a-8d08-ab6a2c28cf73 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:51.389283 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2666ca6c-a9b2-438a-8d08-ab6a2c28cf73 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] [instance: 75fdd06f-8d70-450f-8232-333c181ab8eb] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:51.418948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2666ca6c-a9b2-438a-8d08-ab6a2c28cf73 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:51.420814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2666ca6c-a9b2-438a-8d08-ab6a2c28cf73 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:51.421563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2666ca6c-a9b2-438a-8d08-ab6a2c28cf73 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:51.423724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2666ca6c-a9b2-438a-8d08-ab6a2c28cf73 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:51.426699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2666ca6c-a9b2-438a-8d08-ab6a2c28cf73 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:51.427841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2666ca6c-a9b2-438a-8d08-ab6a2c28cf73 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:51.488009 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-2666ca6c-a9b2-438a-8d08-ab6a2c28cf73 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] HTTP exception thrown: Instance 75fdd06f-8d70-450f-8232-333c181ab8eb could not be found. Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2666ca6c-a9b2-438a-8d08-ab6a2c28cf73 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Request method failure captured: Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb HTTP/1.1 Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJmaW0Cs8qjROriSKq0TdSPNQpjWWzLRCX327FS3VF427mQDGn7JBzGfO4ex--CRi87Q7UHGfHPQ2vn0bfyMAdfqCn8oqN8Hhr7gIGqLZUkY2ZUx1uxnn02YCjsm-8EEvkGLCyekRtksjrlPVuX0ePX6HlV5z90lGzs7i5622KVefpM Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 74e028976bdb4e608fc6b9f98e75dfdf Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-TenantUsagesTestJSON-1206458646 Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/74e028976bdb4e608fc6b9f98e75dfdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/74e028976bdb4e608fc6b9f98e75dfdf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_74e028976bdb4e608fc6b9f98e75dfdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/74e028976bdb4e608fc6b9f98e75dfdf"}]}] Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-TenantUsagesTestJSON-1206458646 Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 74e028976bdb4e608fc6b9f98e75dfdf Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1206458646 Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-TenantUsagesTestJSON-1206458646-project Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: a5cd2b2f1db54b5fa177672aca965cf8 Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-TenantUsagesTestJSON-1206458646-project Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 75fdd06f-8d70-450f-8232-333c181ab8eb could not be found. Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '75fdd06f-8d70-450f-8232-333c181ab8eb'} Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75fdd06f-8d70-450f-8232-333c181ab8eb could not be found. Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75fdd06f-8d70-450f-8232-333c181ab8eb could not be found. Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:10:51.490155 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:10:51.496158 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:10:51.496158 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:10:51.496158 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:10:51.496158 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:10:51.496158 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:10:51.496158 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75fdd06f-8d70-450f-8232-333c181ab8eb could not be found. Oct 29 03:10:51.496158 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:10:51.497024 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9f9915b5-5203-4bd9-975a-732320b13a21 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "POST /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.641799 Oct 29 03:10:51.501362 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2197/4583] 10.222.0.46 () {60 vars in 1323 bytes} [Sat Oct 29 03:10:50 2022] POST /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-volume_attachments => generated 194 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:10:51.512759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2666ca6c-a9b2-438a-8d08-ab6a2c28cf73 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] Returning 404 to user: Instance 75fdd06f-8d70-450f-8232-333c181ab8eb could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:10:51.514882 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2666ca6c-a9b2-438a-8d08-ab6a2c28cf73 tempest-TenantUsagesTestJSON-1206458646 tempest-TenantUsagesTestJSON-1206458646-project] 10.222.0.46 "GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb" status: 404 len: 111 microversion: 2.1 time: 0.136795 Oct 29 03:10:51.515932 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2387/4584] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:51 2022] GET /compute/v2.1/servers/75fdd06f-8d70-450f-8232-333c181ab8eb => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:10:52.401726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-734fff04-7d9f-488a-b92a-cbbf95c9cbc0 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:52.402564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-734fff04-7d9f-488a-b92a-cbbf95c9cbc0 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:52.417930 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-734fff04-7d9f-488a-b92a-cbbf95c9cbc0 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:52.423063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-734fff04-7d9f-488a-b92a-cbbf95c9cbc0 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:52.423848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-734fff04-7d9f-488a-b92a-cbbf95c9cbc0 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:52.425349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-734fff04-7d9f-488a-b92a-cbbf95c9cbc0 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:52.430461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-734fff04-7d9f-488a-b92a-cbbf95c9cbc0 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:52.431427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-734fff04-7d9f-488a-b92a-cbbf95c9cbc0 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:52.811767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-734fff04-7d9f-488a-b92a-cbbf95c9cbc0 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:52.824613 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-734fff04-7d9f-488a-b92a-cbbf95c9cbc0 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e" status: 200 len: 1294 microversion: 2.1 time: 0.431934 Oct 29 03:10:52.828113 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2198/4585] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:52 2022] GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e => generated 1294 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:53.855760 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e19613f1-1965-4e19-8bce-86550d990a83 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:53.859232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e19613f1-1965-4e19-8bce-86550d990a83 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:53.882014 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e19613f1-1965-4e19-8bce-86550d990a83 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:53.882531 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e19613f1-1965-4e19-8bce-86550d990a83 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:53.887287 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e19613f1-1965-4e19-8bce-86550d990a83 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:53.890125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e19613f1-1965-4e19-8bce-86550d990a83 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:53.890627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e19613f1-1965-4e19-8bce-86550d990a83 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:53.895784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e19613f1-1965-4e19-8bce-86550d990a83 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:53.919426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=89 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:54.624343 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:55.386619 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e19613f1-1965-4e19-8bce-86550d990a83 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:55.406456 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e19613f1-1965-4e19-8bce-86550d990a83 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e" status: 200 len: 1362 microversion: 2.1 time: 1.554143 Oct 29 03:10:55.408089 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2388/4586] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:53 2022] GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e => generated 1362 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:10:56.087859 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-70d14f39-2160-4822-867f-8f104fae0d8b req-1ee4a3c7-4c46-4ea3-aba1-2125256b4eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "659587f7-4fe6-4f7e-9f2d-5581cf3b169e", "tag": "4c9cb732-00e2-465f-9020-794505c32c62"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:10:56.119525 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-70d14f39-2160-4822-867f-8f104fae0d8b req-1ee4a3c7-4c46-4ea3-aba1-2125256b4eb8 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:56.120635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-70d14f39-2160-4822-867f-8f104fae0d8b req-1ee4a3c7-4c46-4ea3-aba1-2125256b4eb8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:56.121315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-70d14f39-2160-4822-867f-8f104fae0d8b req-1ee4a3c7-4c46-4ea3-aba1-2125256b4eb8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:56.159644 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-70d14f39-2160-4822-867f-8f104fae0d8b req-1ee4a3c7-4c46-4ea3-aba1-2125256b4eb8 service nova] Creating event network-changed:4c9cb732-00e2-465f-9020-794505c32c62 for instance 659587f7-4fe6-4f7e-9f2d-5581cf3b169e on n-h1-862967-2 Oct 29 03:10:56.180153 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-70d14f39-2160-4822-867f-8f104fae0d8b req-1ee4a3c7-4c46-4ea3-aba1-2125256b4eb8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097219 Oct 29 03:10:56.183919 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2199/4587] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:10:56.436114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d6516472-5f33-426a-9517-2c2c04532d76 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:56.437731 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d6516472-5f33-426a-9517-2c2c04532d76 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:56.447432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:56.449234 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6516472-5f33-426a-9517-2c2c04532d76 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:56.449855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6516472-5f33-426a-9517-2c2c04532d76 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:56.450395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6516472-5f33-426a-9517-2c2c04532d76 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:56.451206 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6516472-5f33-426a-9517-2c2c04532d76 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:56.451760 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6516472-5f33-426a-9517-2c2c04532d76 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:56.452496 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6516472-5f33-426a-9517-2c2c04532d76 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:57.323132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d6516472-5f33-426a-9517-2c2c04532d76 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:57.341642 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d6516472-5f33-426a-9517-2c2c04532d76 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e" status: 200 len: 1362 microversion: 2.1 time: 0.911563 Oct 29 03:10:57.342973 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2389/4588] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:56 2022] GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e => generated 1362 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:10:58.365537 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4ffd2f46-fd42-4b74-98ae-dcb348f731a1 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:10:58.366242 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4ffd2f46-fd42-4b74-98ae-dcb348f731a1 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:10:58.387424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ffd2f46-fd42-4b74-98ae-dcb348f731a1 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:58.394373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ffd2f46-fd42-4b74-98ae-dcb348f731a1 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:58.396713 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ffd2f46-fd42-4b74-98ae-dcb348f731a1 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:58.397749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ffd2f46-fd42-4b74-98ae-dcb348f731a1 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:10:58.398455 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ffd2f46-fd42-4b74-98ae-dcb348f731a1 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:10:58.400227 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ffd2f46-fd42-4b74-98ae-dcb348f731a1 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:10:58.937618 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:59.531968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=12 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:59.654015 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4ffd2f46-fd42-4b74-98ae-dcb348f731a1 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:10:59.676022 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4ffd2f46-fd42-4b74-98ae-dcb348f731a1 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e" status: 200 len: 1362 microversion: 2.1 time: 1.304062 Oct 29 03:10:59.678556 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2200/4589] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:10:58 2022] GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e => generated 1362 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:00.704286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-beeab4a1-28b0-4485-b793-b82aacf60c37 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:00.705540 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-beeab4a1-28b0-4485-b793-b82aacf60c37 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:00.721163 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-beeab4a1-28b0-4485-b793-b82aacf60c37 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:00.722026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-beeab4a1-28b0-4485-b793-b82aacf60c37 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:00.722687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-beeab4a1-28b0-4485-b793-b82aacf60c37 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:00.723657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-beeab4a1-28b0-4485-b793-b82aacf60c37 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:00.724329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-beeab4a1-28b0-4485-b793-b82aacf60c37 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:00.726794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-beeab4a1-28b0-4485-b793-b82aacf60c37 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:01.215425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-beeab4a1-28b0-4485-b793-b82aacf60c37 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:01.265885 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-beeab4a1-28b0-4485-b793-b82aacf60c37 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e" status: 200 len: 1362 microversion: 2.1 time: 0.570844 Oct 29 03:11:01.271417 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2390/4590] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:00 2022] GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e => generated 1362 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:02.291731 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3acc234e-9fab-4cd4-9320-8cd8ce8f6d8f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:02.293168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3acc234e-9fab-4cd4-9320-8cd8ce8f6d8f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:02.308161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3acc234e-9fab-4cd4-9320-8cd8ce8f6d8f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:02.314045 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3acc234e-9fab-4cd4-9320-8cd8ce8f6d8f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:02.314735 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3acc234e-9fab-4cd4-9320-8cd8ce8f6d8f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:02.315647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3acc234e-9fab-4cd4-9320-8cd8ce8f6d8f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:02.316338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3acc234e-9fab-4cd4-9320-8cd8ce8f6d8f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:02.316964 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3acc234e-9fab-4cd4-9320-8cd8ce8f6d8f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:02.949507 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3acc234e-9fab-4cd4-9320-8cd8ce8f6d8f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:02.957815 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3acc234e-9fab-4cd4-9320-8cd8ce8f6d8f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e" status: 200 len: 1362 microversion: 2.1 time: 0.670053 Oct 29 03:11:02.980301 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2201/4591] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:02 2022] GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e => generated 1362 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:03.987749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6bd48bb7-9437-4c72-9ff1-a5e43339f761 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:03.989173 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6bd48bb7-9437-4c72-9ff1-a5e43339f761 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:04.000849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6bd48bb7-9437-4c72-9ff1-a5e43339f761 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:04.003647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6bd48bb7-9437-4c72-9ff1-a5e43339f761 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:04.005696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6bd48bb7-9437-4c72-9ff1-a5e43339f761 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:04.007730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6bd48bb7-9437-4c72-9ff1-a5e43339f761 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:04.008752 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6bd48bb7-9437-4c72-9ff1-a5e43339f761 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:04.009713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6bd48bb7-9437-4c72-9ff1-a5e43339f761 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:04.265853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6bd48bb7-9437-4c72-9ff1-a5e43339f761 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:04.277096 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6bd48bb7-9437-4c72-9ff1-a5e43339f761 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e" status: 200 len: 1362 microversion: 2.1 time: 0.291107 Oct 29 03:11:04.279554 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2391/4592] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:03 2022] GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e => generated 1362 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:05.165838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-d489ac82-b633-41eb-90ab-efcf066b3a78 req-e4de4ffb-cc76-4bbd-bb9f-f2a1debfbe6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659587f7-4fe6-4f7e-9f2d-5581cf3b169e", "name": "network-vif-plugged", "status": "completed", "tag": "4c9cb732-00e2-465f-9020-794505c32c62"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:11:05.183360 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:05.188647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d489ac82-b633-41eb-90ab-efcf066b3a78 req-e4de4ffb-cc76-4bbd-bb9f-f2a1debfbe6d service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:05.189229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d489ac82-b633-41eb-90ab-efcf066b3a78 req-e4de4ffb-cc76-4bbd-bb9f-f2a1debfbe6d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:05.191895 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d489ac82-b633-41eb-90ab-efcf066b3a78 req-e4de4ffb-cc76-4bbd-bb9f-f2a1debfbe6d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:05.223354 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-d489ac82-b633-41eb-90ab-efcf066b3a78 req-e4de4ffb-cc76-4bbd-bb9f-f2a1debfbe6d service nova] Creating event network-vif-plugged:4c9cb732-00e2-465f-9020-794505c32c62 for instance 659587f7-4fe6-4f7e-9f2d-5581cf3b169e on n-h1-862967-2 Oct 29 03:11:05.238965 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-d489ac82-b633-41eb-90ab-efcf066b3a78 req-e4de4ffb-cc76-4bbd-bb9f-f2a1debfbe6d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077567 Oct 29 03:11:05.240645 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2202/4593] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:11:05.305271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-56a6f65e-c478-4525-a48f-85a03012e49f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:05.306657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-56a6f65e-c478-4525-a48f-85a03012e49f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:05.328313 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56a6f65e-c478-4525-a48f-85a03012e49f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:05.328831 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56a6f65e-c478-4525-a48f-85a03012e49f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:05.329261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56a6f65e-c478-4525-a48f-85a03012e49f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:05.335301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56a6f65e-c478-4525-a48f-85a03012e49f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:05.336008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56a6f65e-c478-4525-a48f-85a03012e49f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:05.336697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56a6f65e-c478-4525-a48f-85a03012e49f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:05.857989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-56a6f65e-c478-4525-a48f-85a03012e49f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:05.874541 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-56a6f65e-c478-4525-a48f-85a03012e49f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e" status: 200 len: 1362 microversion: 2.1 time: 0.573501 Oct 29 03:11:05.882327 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2392/4594] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:05 2022] GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e => generated 1362 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:06.910922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-86b698ab-66ca-4bc0-97fd-06145b4478ce tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:06.911783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-86b698ab-66ca-4bc0-97fd-06145b4478ce tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:06.929361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86b698ab-66ca-4bc0-97fd-06145b4478ce tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:06.930253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86b698ab-66ca-4bc0-97fd-06145b4478ce tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:06.932177 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86b698ab-66ca-4bc0-97fd-06145b4478ce tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:06.933224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86b698ab-66ca-4bc0-97fd-06145b4478ce tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:06.936907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86b698ab-66ca-4bc0-97fd-06145b4478ce tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:06.937560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86b698ab-66ca-4bc0-97fd-06145b4478ce tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:07.517778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-86b698ab-66ca-4bc0-97fd-06145b4478ce tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:07.532249 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-86b698ab-66ca-4bc0-97fd-06145b4478ce tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e" status: 200 len: 1362 microversion: 2.1 time: 0.628644 Oct 29 03:11:07.534686 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2203/4595] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:06 2022] GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e => generated 1362 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:08.558348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-717f4f03-cee0-4ebe-aa7b-1fbc1843ac6a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:08.559055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-717f4f03-cee0-4ebe-aa7b-1fbc1843ac6a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:08.581453 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-717f4f03-cee0-4ebe-aa7b-1fbc1843ac6a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:08.582019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-717f4f03-cee0-4ebe-aa7b-1fbc1843ac6a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:08.582405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-717f4f03-cee0-4ebe-aa7b-1fbc1843ac6a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:08.583141 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-717f4f03-cee0-4ebe-aa7b-1fbc1843ac6a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:08.583600 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-717f4f03-cee0-4ebe-aa7b-1fbc1843ac6a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:08.584023 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-717f4f03-cee0-4ebe-aa7b-1fbc1843ac6a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:09.640319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-717f4f03-cee0-4ebe-aa7b-1fbc1843ac6a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:09.660595 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-717f4f03-cee0-4ebe-aa7b-1fbc1843ac6a tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e" status: 200 len: 1547 microversion: 2.1 time: 1.104954 Oct 29 03:11:09.661796 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2393/4596] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:08 2022] GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e => generated 1547 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:09.703345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0cb87b4f-09bf-4977-a358-525dfa07c977 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:09.704537 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0cb87b4f-09bf-4977-a358-525dfa07c977 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:09.713464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0cb87b4f-09bf-4977-a358-525dfa07c977 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:09.714470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0cb87b4f-09bf-4977-a358-525dfa07c977 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:09.715344 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0cb87b4f-09bf-4977-a358-525dfa07c977 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:09.716580 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0cb87b4f-09bf-4977-a358-525dfa07c977 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:09.717237 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0cb87b4f-09bf-4977-a358-525dfa07c977 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:09.717960 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0cb87b4f-09bf-4977-a358-525dfa07c977 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:09.861247 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0cb87b4f-09bf-4977-a358-525dfa07c977 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.172302 Oct 29 03:11:09.872406 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2204/4597] 10.222.0.46 () {58 vars in 1275 bytes} [Sat Oct 29 03:11:09 2022] GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e/os-interface => generated 284 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:11:10.786483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-757660dd-9183-41e7-9273-a33a3d4b0c7a tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:11:10.788961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-757660dd-9183-41e7-9273-a33a3d4b0c7a tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:10.809338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-757660dd-9183-41e7-9273-a33a3d4b0c7a tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:10.809577 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-757660dd-9183-41e7-9273-a33a3d4b0c7a tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:10.809996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-757660dd-9183-41e7-9273-a33a3d4b0c7a tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:10.810716 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-757660dd-9183-41e7-9273-a33a3d4b0c7a tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:10.811169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-757660dd-9183-41e7-9273-a33a3d4b0c7a tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:10.811591 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-757660dd-9183-41e7-9273-a33a3d4b0c7a tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:10.895650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-757660dd-9183-41e7-9273-a33a3d4b0c7a tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lazy-loading 'flavor' on Instance uuid 0116c079-f618-42b3-94f5-340b2ed6efdd {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:11:11.217973 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-757660dd-9183-41e7-9273-a33a3d4b0c7a tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "POST /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/action" status: 200 len: 32 microversion: 2.1 time: 0.436705 Oct 29 03:11:11.230858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-871b863a-306d-4160-a391-f4c5c3bfbf41 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:11.232241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-871b863a-306d-4160-a391-f4c5c3bfbf41 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:11.236568 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2394/4598] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:11:10 2022] POST /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/action => generated 32 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:11:11.259480 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-871b863a-306d-4160-a391-f4c5c3bfbf41 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:11.259972 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-871b863a-306d-4160-a391-f4c5c3bfbf41 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:11.263284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-871b863a-306d-4160-a391-f4c5c3bfbf41 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:11.264066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-871b863a-306d-4160-a391-f4c5c3bfbf41 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:11.264560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-871b863a-306d-4160-a391-f4c5c3bfbf41 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:11.273510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-871b863a-306d-4160-a391-f4c5c3bfbf41 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:12.359023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-871b863a-306d-4160-a391-f4c5c3bfbf41 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:12.381145 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-871b863a-306d-4160-a391-f4c5c3bfbf41 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1737 microversion: 2.1 time: 1.155998 Oct 29 03:11:12.393566 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2205/4599] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:11 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1737 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:12.523802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8bcfd00b-da9e-49d0-8823-21719af5620c tempest-PortsAdminExtendedAttrsIpV6TestJSON-75919635 tempest-PortsAdminExtendedAttrsIpV6TestJSON-75919635-project-admin] Calling method '.version_select at 0x7ff053a2f160>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:12.525638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bcfd00b-da9e-49d0-8823-21719af5620c tempest-PortsAdminExtendedAttrsIpV6TestJSON-75919635 tempest-PortsAdminExtendedAttrsIpV6TestJSON-75919635-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:12.526122 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bcfd00b-da9e-49d0-8823-21719af5620c tempest-PortsAdminExtendedAttrsIpV6TestJSON-75919635 tempest-PortsAdminExtendedAttrsIpV6TestJSON-75919635-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:12.526655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bcfd00b-da9e-49d0-8823-21719af5620c tempest-PortsAdminExtendedAttrsIpV6TestJSON-75919635 tempest-PortsAdminExtendedAttrsIpV6TestJSON-75919635-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:12.559029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bcfd00b-da9e-49d0-8823-21719af5620c tempest-PortsAdminExtendedAttrsIpV6TestJSON-75919635 tempest-PortsAdminExtendedAttrsIpV6TestJSON-75919635-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:12.559425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bcfd00b-da9e-49d0-8823-21719af5620c tempest-PortsAdminExtendedAttrsIpV6TestJSON-75919635 tempest-PortsAdminExtendedAttrsIpV6TestJSON-75919635-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:12.559859 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bcfd00b-da9e-49d0-8823-21719af5620c tempest-PortsAdminExtendedAttrsIpV6TestJSON-75919635 tempest-PortsAdminExtendedAttrsIpV6TestJSON-75919635-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:12.586531 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bcfd00b-da9e-49d0-8823-21719af5620c tempest-PortsAdminExtendedAttrsIpV6TestJSON-75919635 tempest-PortsAdminExtendedAttrsIpV6TestJSON-75919635-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:12.587029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bcfd00b-da9e-49d0-8823-21719af5620c tempest-PortsAdminExtendedAttrsIpV6TestJSON-75919635 tempest-PortsAdminExtendedAttrsIpV6TestJSON-75919635-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:12.587466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bcfd00b-da9e-49d0-8823-21719af5620c tempest-PortsAdminExtendedAttrsIpV6TestJSON-75919635 tempest-PortsAdminExtendedAttrsIpV6TestJSON-75919635-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:12.612762 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8bcfd00b-da9e-49d0-8823-21719af5620c tempest-PortsAdminExtendedAttrsIpV6TestJSON-75919635 tempest-PortsAdminExtendedAttrsIpV6TestJSON-75919635-project-admin] 10.222.0.46 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.646491 Oct 29 03:11:12.613878 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2395/4600] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 03:11:11 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:11:13.417548 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a62c9be2-8be8-4750-bed3-01cf4f22d76e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:13.419399 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a62c9be2-8be8-4750-bed3-01cf4f22d76e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:13.446497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a62c9be2-8be8-4750-bed3-01cf4f22d76e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:13.452515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a62c9be2-8be8-4750-bed3-01cf4f22d76e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:13.453441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a62c9be2-8be8-4750-bed3-01cf4f22d76e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:13.456503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a62c9be2-8be8-4750-bed3-01cf4f22d76e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:13.458520 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a62c9be2-8be8-4750-bed3-01cf4f22d76e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:13.462595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a62c9be2-8be8-4750-bed3-01cf4f22d76e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:13.876971 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a62c9be2-8be8-4750-bed3-01cf4f22d76e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:13.890645 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a62c9be2-8be8-4750-bed3-01cf4f22d76e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1737 microversion: 2.1 time: 0.478184 Oct 29 03:11:13.911474 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2206/4601] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:13 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1737 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:14.938221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fb2a530f-8c7c-4a3f-b6c8-6ea7b9504f76 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:14.944014 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fb2a530f-8c7c-4a3f-b6c8-6ea7b9504f76 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:14.996599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fb2a530f-8c7c-4a3f-b6c8-6ea7b9504f76 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:15.001536 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fb2a530f-8c7c-4a3f-b6c8-6ea7b9504f76 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:15.003571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fb2a530f-8c7c-4a3f-b6c8-6ea7b9504f76 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:15.009328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fb2a530f-8c7c-4a3f-b6c8-6ea7b9504f76 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:15.013264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fb2a530f-8c7c-4a3f-b6c8-6ea7b9504f76 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:15.014574 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fb2a530f-8c7c-4a3f-b6c8-6ea7b9504f76 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:15.910910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fb2a530f-8c7c-4a3f-b6c8-6ea7b9504f76 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:15.925626 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fb2a530f-8c7c-4a3f-b6c8-6ea7b9504f76 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1737 microversion: 2.1 time: 1.010245 Oct 29 03:11:15.931829 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2396/4602] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:14 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1737 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:16.163689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-189c5763-28c1-4c7c-82fb-bd24a98a74b9 req-99119a7d-f718-4c30-b014-ebd45f86c16e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "659587f7-4fe6-4f7e-9f2d-5581cf3b169e", "tag": "4c9cb732-00e2-465f-9020-794505c32c62"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:11:16.184347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-189c5763-28c1-4c7c-82fb-bd24a98a74b9 req-99119a7d-f718-4c30-b014-ebd45f86c16e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:16.186385 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-189c5763-28c1-4c7c-82fb-bd24a98a74b9 req-99119a7d-f718-4c30-b014-ebd45f86c16e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:16.187149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-189c5763-28c1-4c7c-82fb-bd24a98a74b9 req-99119a7d-f718-4c30-b014-ebd45f86c16e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:16.238361 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-189c5763-28c1-4c7c-82fb-bd24a98a74b9 req-99119a7d-f718-4c30-b014-ebd45f86c16e service nova] Creating event network-changed:4c9cb732-00e2-465f-9020-794505c32c62 for instance 659587f7-4fe6-4f7e-9f2d-5581cf3b169e on n-h1-862967-2 Oct 29 03:11:16.266520 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-189c5763-28c1-4c7c-82fb-bd24a98a74b9 req-99119a7d-f718-4c30-b014-ebd45f86c16e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.509677 Oct 29 03:11:16.269732 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2207/4603] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:11:16.952399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fa10d670-2bf6-4700-9967-bc0d02505170 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:16.953566 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fa10d670-2bf6-4700-9967-bc0d02505170 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:16.968300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fa10d670-2bf6-4700-9967-bc0d02505170 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:16.968829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fa10d670-2bf6-4700-9967-bc0d02505170 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:16.969276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fa10d670-2bf6-4700-9967-bc0d02505170 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:16.970117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fa10d670-2bf6-4700-9967-bc0d02505170 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:16.970583 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fa10d670-2bf6-4700-9967-bc0d02505170 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:16.971015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fa10d670-2bf6-4700-9967-bc0d02505170 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:17.756274 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fa10d670-2bf6-4700-9967-bc0d02505170 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:17.769725 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fa10d670-2bf6-4700-9967-bc0d02505170 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1737 microversion: 2.1 time: 0.821352 Oct 29 03:11:17.785869 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2397/4604] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:16 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1737 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:18.799010 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f4d868d6-eabc-4e04-b753-8cda74ef3317 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:18.800818 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f4d868d6-eabc-4e04-b753-8cda74ef3317 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:18.812925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4d868d6-eabc-4e04-b753-8cda74ef3317 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:18.819616 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4d868d6-eabc-4e04-b753-8cda74ef3317 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:18.820337 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4d868d6-eabc-4e04-b753-8cda74ef3317 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:18.821386 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4d868d6-eabc-4e04-b753-8cda74ef3317 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:18.822063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4d868d6-eabc-4e04-b753-8cda74ef3317 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:18.824634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4d868d6-eabc-4e04-b753-8cda74ef3317 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:19.290367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f4d868d6-eabc-4e04-b753-8cda74ef3317 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:19.305391 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f4d868d6-eabc-4e04-b753-8cda74ef3317 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1737 microversion: 2.1 time: 0.510554 Oct 29 03:11:19.306096 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2208/4605] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:18 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1737 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:20.329194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-64388839-9c53-4df3-b9cd-ba01a3634ff4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:20.330539 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-64388839-9c53-4df3-b9cd-ba01a3634ff4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:20.341157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-64388839-9c53-4df3-b9cd-ba01a3634ff4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:20.344707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-64388839-9c53-4df3-b9cd-ba01a3634ff4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:20.346915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-64388839-9c53-4df3-b9cd-ba01a3634ff4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:20.348960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-64388839-9c53-4df3-b9cd-ba01a3634ff4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:20.349706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-64388839-9c53-4df3-b9cd-ba01a3634ff4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:20.350686 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-64388839-9c53-4df3-b9cd-ba01a3634ff4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:20.775620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-64388839-9c53-4df3-b9cd-ba01a3634ff4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:20.790948 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-64388839-9c53-4df3-b9cd-ba01a3634ff4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1737 microversion: 2.1 time: 0.466136 Oct 29 03:11:20.792816 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2398/4606] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:20 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1737 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:21.818352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6829b353-d5c6-4b04-98c6-617116b47c18 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:21.819005 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6829b353-d5c6-4b04-98c6-617116b47c18 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:21.826611 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6829b353-d5c6-4b04-98c6-617116b47c18 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:21.827105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6829b353-d5c6-4b04-98c6-617116b47c18 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:21.827528 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6829b353-d5c6-4b04-98c6-617116b47c18 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:21.828241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6829b353-d5c6-4b04-98c6-617116b47c18 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:21.844966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6829b353-d5c6-4b04-98c6-617116b47c18 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:21.845576 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6829b353-d5c6-4b04-98c6-617116b47c18 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:21.848807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:22.881807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6829b353-d5c6-4b04-98c6-617116b47c18 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:22.897233 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6829b353-d5c6-4b04-98c6-617116b47c18 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1737 microversion: 2.1 time: 1.082611 Oct 29 03:11:22.897856 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2209/4607] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:21 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1737 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:23.923833 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6eb4174f-8e1a-4f7e-a132-038e5bc859e0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:23.925170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6eb4174f-8e1a-4f7e-a132-038e5bc859e0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:23.937124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6eb4174f-8e1a-4f7e-a132-038e5bc859e0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:23.939585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6eb4174f-8e1a-4f7e-a132-038e5bc859e0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:23.940206 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6eb4174f-8e1a-4f7e-a132-038e5bc859e0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:23.941135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6eb4174f-8e1a-4f7e-a132-038e5bc859e0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:23.944405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6eb4174f-8e1a-4f7e-a132-038e5bc859e0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:23.946660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6eb4174f-8e1a-4f7e-a132-038e5bc859e0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:24.398718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6eb4174f-8e1a-4f7e-a132-038e5bc859e0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:24.411077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:24.416846 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6eb4174f-8e1a-4f7e-a132-038e5bc859e0 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1737 microversion: 2.1 time: 0.497116 Oct 29 03:11:24.420587 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2399/4608] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:23 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1737 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:25.453468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-63a3e2f2-aa7a-41df-a94d-23b2a2a67d7c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:25.455099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-63a3e2f2-aa7a-41df-a94d-23b2a2a67d7c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:25.472663 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63a3e2f2-aa7a-41df-a94d-23b2a2a67d7c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:25.473432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63a3e2f2-aa7a-41df-a94d-23b2a2a67d7c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:25.474636 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63a3e2f2-aa7a-41df-a94d-23b2a2a67d7c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:25.475525 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63a3e2f2-aa7a-41df-a94d-23b2a2a67d7c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:25.476141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63a3e2f2-aa7a-41df-a94d-23b2a2a67d7c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:25.476785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63a3e2f2-aa7a-41df-a94d-23b2a2a67d7c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:25.968107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-63a3e2f2-aa7a-41df-a94d-23b2a2a67d7c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:25.979634 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-63a3e2f2-aa7a-41df-a94d-23b2a2a67d7c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1737 microversion: 2.1 time: 0.534975 Oct 29 03:11:25.982527 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2210/4609] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:25 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1737 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:27.006292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6ef4f97d-0102-406a-97f6-9ea9a5003bfc tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:27.007430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6ef4f97d-0102-406a-97f6-9ea9a5003bfc tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:27.022440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=24 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:27.028209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ef4f97d-0102-406a-97f6-9ea9a5003bfc tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:27.028919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ef4f97d-0102-406a-97f6-9ea9a5003bfc tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:27.031031 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ef4f97d-0102-406a-97f6-9ea9a5003bfc tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:27.032542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ef4f97d-0102-406a-97f6-9ea9a5003bfc tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:27.033651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ef4f97d-0102-406a-97f6-9ea9a5003bfc tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:27.034249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ef4f97d-0102-406a-97f6-9ea9a5003bfc tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:28.436282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6ef4f97d-0102-406a-97f6-9ea9a5003bfc tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:28.448079 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6ef4f97d-0102-406a-97f6-9ea9a5003bfc tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1737 microversion: 2.1 time: 1.446103 Oct 29 03:11:28.460180 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2400/4610] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:27 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1737 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:29.478290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-81b39338-8498-4dd4-83d7-d7f6e848ffb4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:29.478967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-81b39338-8498-4dd4-83d7-d7f6e848ffb4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:29.490662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-81b39338-8498-4dd4-83d7-d7f6e848ffb4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:29.491246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-81b39338-8498-4dd4-83d7-d7f6e848ffb4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:29.493486 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-81b39338-8498-4dd4-83d7-d7f6e848ffb4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:29.494247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-81b39338-8498-4dd4-83d7-d7f6e848ffb4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:29.494715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-81b39338-8498-4dd4-83d7-d7f6e848ffb4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:29.495149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-81b39338-8498-4dd4-83d7-d7f6e848ffb4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:30.320175 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-81b39338-8498-4dd4-83d7-d7f6e848ffb4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:30.332452 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-81b39338-8498-4dd4-83d7-d7f6e848ffb4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1737 microversion: 2.1 time: 0.858874 Oct 29 03:11:30.351497 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2211/4611] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:29 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1737 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:31.359919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e1051d8f-1e96-4ebf-b43d-280528d5d86e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:31.361276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e1051d8f-1e96-4ebf-b43d-280528d5d86e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:31.374333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1051d8f-1e96-4ebf-b43d-280528d5d86e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:31.377995 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1051d8f-1e96-4ebf-b43d-280528d5d86e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:31.381176 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1051d8f-1e96-4ebf-b43d-280528d5d86e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:31.381990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1051d8f-1e96-4ebf-b43d-280528d5d86e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:31.384062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1051d8f-1e96-4ebf-b43d-280528d5d86e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:31.384562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1051d8f-1e96-4ebf-b43d-280528d5d86e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:32.591009 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e1051d8f-1e96-4ebf-b43d-280528d5d86e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:32.606869 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e1051d8f-1e96-4ebf-b43d-280528d5d86e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1737 microversion: 2.1 time: 1.251696 Oct 29 03:11:32.608097 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2401/4612] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:31 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1737 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:33.632782 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a194cef8-7444-45c6-b916-204c01f86dc1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:33.633400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a194cef8-7444-45c6-b916-204c01f86dc1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:33.649673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a194cef8-7444-45c6-b916-204c01f86dc1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:33.650169 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a194cef8-7444-45c6-b916-204c01f86dc1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:33.656271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a194cef8-7444-45c6-b916-204c01f86dc1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:33.657489 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a194cef8-7444-45c6-b916-204c01f86dc1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:33.659741 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a194cef8-7444-45c6-b916-204c01f86dc1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:33.660382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a194cef8-7444-45c6-b916-204c01f86dc1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:34.038301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a194cef8-7444-45c6-b916-204c01f86dc1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:34.054266 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a194cef8-7444-45c6-b916-204c01f86dc1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1737 microversion: 2.1 time: 0.424941 Oct 29 03:11:34.055827 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2212/4613] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:33 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1737 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:35.081991 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-63a719fe-ab98-4765-88ff-27ccc2675e73 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:35.083217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-63a719fe-ab98-4765-88ff-27ccc2675e73 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:35.091895 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63a719fe-ab98-4765-88ff-27ccc2675e73 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:35.092388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63a719fe-ab98-4765-88ff-27ccc2675e73 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:35.092854 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63a719fe-ab98-4765-88ff-27ccc2675e73 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:35.093563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63a719fe-ab98-4765-88ff-27ccc2675e73 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:35.099266 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63a719fe-ab98-4765-88ff-27ccc2675e73 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:35.099663 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63a719fe-ab98-4765-88ff-27ccc2675e73 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:35.239620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f683922f-7915-4644-9c75-11b626428387 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Action: 'create', calling method: .version_select at 0x7ff05338ed30>, body: {"keypair": {"name": "tempest-keypair-1259869734", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdctA5VTpflNjGqh8nbP1RKjoQHcHDpF6S7wsYH1TYLq+pBMwSMZ6+YCACsk0oyxki3uKevL4BDvBANghGytTmKS5Ixyi98v48hYROFF34aTgfA6x42E+VKlRhk/t30Ug=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:11:35.299471 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-f683922f-7915-4644-9c75-11b626428387 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Getting quotas for project ad74f13c0ac347418ed8445140531b7e. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:11:35.313890 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-f683922f-7915-4644-9c75-11b626428387 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Getting quotas for user aee9c3cade7948b0abb8a47afe3e581e and project ad74f13c0ac347418ed8445140531b7e. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:11:35.397698 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f683922f-7915-4644-9c75-11b626428387 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.674932 Oct 29 03:11:35.409702 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2402/4614] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:11:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:11:36.012394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-63a719fe-ab98-4765-88ff-27ccc2675e73 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:36.045487 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-63a719fe-ab98-4765-88ff-27ccc2675e73 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1737 microversion: 2.1 time: 0.966242 Oct 29 03:11:36.064300 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2213/4615] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:35 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1737 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:37.074364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eaa143a5-8baa-4a88-b4eb-f798c15af520 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:37.075627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-eaa143a5-8baa-4a88-b4eb-f798c15af520 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:37.098580 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaa143a5-8baa-4a88-b4eb-f798c15af520 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:37.099201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaa143a5-8baa-4a88-b4eb-f798c15af520 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:37.101569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaa143a5-8baa-4a88-b4eb-f798c15af520 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:37.102348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaa143a5-8baa-4a88-b4eb-f798c15af520 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:37.109264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaa143a5-8baa-4a88-b4eb-f798c15af520 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:37.109989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaa143a5-8baa-4a88-b4eb-f798c15af520 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:37.769611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-eaa143a5-8baa-4a88-b4eb-f798c15af520 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:37.778822 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eaa143a5-8baa-4a88-b4eb-f798c15af520 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1737 microversion: 2.1 time: 0.712309 Oct 29 03:11:37.779505 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2403/4616] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:37 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1737 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:38.807664 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6443b284-6583-40f2-bf46-4c1d2766793f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:38.808284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6443b284-6583-40f2-bf46-4c1d2766793f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:38.811070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=24 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:38.826707 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6443b284-6583-40f2-bf46-4c1d2766793f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:38.827466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6443b284-6583-40f2-bf46-4c1d2766793f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:38.828078 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6443b284-6583-40f2-bf46-4c1d2766793f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:38.829025 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6443b284-6583-40f2-bf46-4c1d2766793f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:38.829707 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6443b284-6583-40f2-bf46-4c1d2766793f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:38.830297 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6443b284-6583-40f2-bf46-4c1d2766793f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:39.145935 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6443b284-6583-40f2-bf46-4c1d2766793f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:39.158544 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6443b284-6583-40f2-bf46-4c1d2766793f tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1737 microversion: 2.1 time: 0.354791 Oct 29 03:11:39.164573 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2214/4617] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:38 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1737 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:40.187976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-68226543-2ed3-480a-9342-f84388359a1b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:40.189066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-68226543-2ed3-480a-9342-f84388359a1b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:40.215259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68226543-2ed3-480a-9342-f84388359a1b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:40.217902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68226543-2ed3-480a-9342-f84388359a1b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:40.221189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68226543-2ed3-480a-9342-f84388359a1b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:40.223442 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68226543-2ed3-480a-9342-f84388359a1b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:40.224420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68226543-2ed3-480a-9342-f84388359a1b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:40.225060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68226543-2ed3-480a-9342-f84388359a1b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:40.666548 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-68226543-2ed3-480a-9342-f84388359a1b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:40.694214 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-68226543-2ed3-480a-9342-f84388359a1b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1737 microversion: 2.1 time: 0.511931 Oct 29 03:11:40.696863 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2404/4618] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:40 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1737 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:40.889098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0bc02c3f-06ba-4c9c-a25c-7eb68b518c39 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1607600448", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "7c67d1a9-4768-41b0-9ed7-2a2bf18af28b"}], "security_groups": [{"name": "tempest-securitygroup--1740225874"}], "key_name": "tempest-keypair-1259869734", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:11:41.382402 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-0bc02c3f-06ba-4c9c-a25c-7eb68b518c39 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] validate_networks() for [('7c67d1a9-4768-41b0-9ed7-2a2bf18af28b', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:11:41.719670 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-aeff66a0-003a-44c2-9f5f-9d6bd47ec650 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:41.721245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-aeff66a0-003a-44c2-9f5f-9d6bd47ec650 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:41.748444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aeff66a0-003a-44c2-9f5f-9d6bd47ec650 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:41.750853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aeff66a0-003a-44c2-9f5f-9d6bd47ec650 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:41.751657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aeff66a0-003a-44c2-9f5f-9d6bd47ec650 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:41.758404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aeff66a0-003a-44c2-9f5f-9d6bd47ec650 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:41.758894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aeff66a0-003a-44c2-9f5f-9d6bd47ec650 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:41.766059 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aeff66a0-003a-44c2-9f5f-9d6bd47ec650 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:42.106134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-aeff66a0-003a-44c2-9f5f-9d6bd47ec650 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:42.122433 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-aeff66a0-003a-44c2-9f5f-9d6bd47ec650 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1737 microversion: 2.1 time: 0.407638 Oct 29 03:11:42.133577 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2405/4619] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:41 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1737 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:43.157741 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e442c5cf-7656-4625-99a3-683ca942490b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:43.158403 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e442c5cf-7656-4625-99a3-683ca942490b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:43.166696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e442c5cf-7656-4625-99a3-683ca942490b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:43.167435 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e442c5cf-7656-4625-99a3-683ca942490b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:43.168048 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e442c5cf-7656-4625-99a3-683ca942490b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:43.168961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e442c5cf-7656-4625-99a3-683ca942490b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:43.169728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e442c5cf-7656-4625-99a3-683ca942490b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:43.170316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e442c5cf-7656-4625-99a3-683ca942490b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:43.554797 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-0bc02c3f-06ba-4c9c-a25c-7eb68b518c39 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:11:43.555882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-0bc02c3f-06ba-4c9c-a25c-7eb68b518c39 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:11:43.556862 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-0bc02c3f-06ba-4c9c-a25c-7eb68b518c39 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:11:43.557583 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-0bc02c3f-06ba-4c9c-a25c-7eb68b518c39 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:11:43.558639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-0bc02c3f-06ba-4c9c-a25c-7eb68b518c39 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:11:43.577236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0bc02c3f-06ba-4c9c-a25c-7eb68b518c39 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:43.588082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0bc02c3f-06ba-4c9c-a25c-7eb68b518c39 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:43.589066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0bc02c3f-06ba-4c9c-a25c-7eb68b518c39 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:43.590110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0bc02c3f-06ba-4c9c-a25c-7eb68b518c39 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:43.590747 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0bc02c3f-06ba-4c9c-a25c-7eb68b518c39 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:43.591524 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0bc02c3f-06ba-4c9c-a25c-7eb68b518c39 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:43.637620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-0bc02c3f-06ba-4c9c-a25c-7eb68b518c39 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Getting quotas for project ad74f13c0ac347418ed8445140531b7e. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:11:43.655890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-0bc02c3f-06ba-4c9c-a25c-7eb68b518c39 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Getting quotas for user aee9c3cade7948b0abb8a47afe3e581e and project ad74f13c0ac347418ed8445140531b7e. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:11:43.694310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0bc02c3f-06ba-4c9c-a25c-7eb68b518c39 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:11:43.696889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e442c5cf-7656-4625-99a3-683ca942490b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:43.699836 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0bc02c3f-06ba-4c9c-a25c-7eb68b518c39 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:11:43.726629 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e442c5cf-7656-4625-99a3-683ca942490b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1737 microversion: 2.1 time: 0.573102 Oct 29 03:11:43.727870 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2406/4620] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:43 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1737 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:43.817603 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0bc02c3f-06ba-4c9c-a25c-7eb68b518c39 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.932767 Oct 29 03:11:43.818567 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2215/4621] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:11:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 2934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:11:43.835625 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2aff7220-469d-4ee5-a3de-3f2dbd1bad0b tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:43.836349 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2aff7220-469d-4ee5-a3de-3f2dbd1bad0b tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:44.441434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2aff7220-469d-4ee5-a3de-3f2dbd1bad0b tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:44.463699 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2aff7220-469d-4ee5-a3de-3f2dbd1bad0b tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad" status: 200 len: 1242 microversion: 2.1 time: 0.637326 Oct 29 03:11:44.465463 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2407/4622] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:43 2022] GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad => generated 1242 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:44.757304 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4a41a5b6-706e-4123-8d04-7283fc52d912 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:44.758106 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4a41a5b6-706e-4123-8d04-7283fc52d912 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:44.790728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a41a5b6-706e-4123-8d04-7283fc52d912 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:44.791985 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a41a5b6-706e-4123-8d04-7283fc52d912 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:44.793289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a41a5b6-706e-4123-8d04-7283fc52d912 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:44.796310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a41a5b6-706e-4123-8d04-7283fc52d912 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:44.801239 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a41a5b6-706e-4123-8d04-7283fc52d912 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:44.801799 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a41a5b6-706e-4123-8d04-7283fc52d912 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:45.487701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2c403430-d43a-4ac3-9b05-e74a6826c94c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:45.488323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2c403430-d43a-4ac3-9b05-e74a6826c94c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:45.504086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c403430-d43a-4ac3-9b05-e74a6826c94c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:45.504596 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c403430-d43a-4ac3-9b05-e74a6826c94c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:45.505032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c403430-d43a-4ac3-9b05-e74a6826c94c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:45.505742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c403430-d43a-4ac3-9b05-e74a6826c94c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:45.511721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c403430-d43a-4ac3-9b05-e74a6826c94c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:45.512232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c403430-d43a-4ac3-9b05-e74a6826c94c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:45.619732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4a41a5b6-706e-4123-8d04-7283fc52d912 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:45.634785 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4a41a5b6-706e-4123-8d04-7283fc52d912 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1737 microversion: 2.1 time: 0.884360 Oct 29 03:11:45.655223 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2216/4623] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:44 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1737 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:45.731696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2c403430-d43a-4ac3-9b05-e74a6826c94c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:45.739791 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2c403430-d43a-4ac3-9b05-e74a6826c94c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad" status: 200 len: 1238 microversion: 2.1 time: 0.255927 Oct 29 03:11:45.761431 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2408/4624] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:45 2022] GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad => generated 1238 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:46.660094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b341279e-7731-4900-9945-037485f94171 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:46.660733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b341279e-7731-4900-9945-037485f94171 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:46.667824 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b341279e-7731-4900-9945-037485f94171 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:46.668567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b341279e-7731-4900-9945-037485f94171 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:46.669633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b341279e-7731-4900-9945-037485f94171 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:46.670603 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b341279e-7731-4900-9945-037485f94171 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:46.671339 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b341279e-7731-4900-9945-037485f94171 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:46.671995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b341279e-7731-4900-9945-037485f94171 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:46.768005 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e9eb4dba-e4d4-4b1c-b38e-cf39063cc747 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:46.768813 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e9eb4dba-e4d4-4b1c-b38e-cf39063cc747 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:46.779341 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9eb4dba-e4d4-4b1c-b38e-cf39063cc747 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:46.780144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9eb4dba-e4d4-4b1c-b38e-cf39063cc747 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:46.780839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9eb4dba-e4d4-4b1c-b38e-cf39063cc747 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:46.781781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9eb4dba-e4d4-4b1c-b38e-cf39063cc747 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:46.782431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9eb4dba-e4d4-4b1c-b38e-cf39063cc747 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:46.783052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9eb4dba-e4d4-4b1c-b38e-cf39063cc747 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:47.205091 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e9eb4dba-e4d4-4b1c-b38e-cf39063cc747 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:47.233874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b341279e-7731-4900-9945-037485f94171 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:47.247706 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b341279e-7731-4900-9945-037485f94171 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1737 microversion: 2.1 time: 0.592024 Oct 29 03:11:47.250234 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e9eb4dba-e4d4-4b1c-b38e-cf39063cc747 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad" status: 200 len: 1300 microversion: 2.1 time: 0.486283 Oct 29 03:11:47.253418 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2409/4625] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:46 2022] GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad => generated 1300 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:11:47.277258 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2217/4626] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:46 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1737 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:48.263038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-68cd8a90-c501-4792-96e4-3ca26002afdc tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:48.264158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-68cd8a90-c501-4792-96e4-3ca26002afdc tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:48.275708 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68cd8a90-c501-4792-96e4-3ca26002afdc tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:48.290153 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68cd8a90-c501-4792-96e4-3ca26002afdc tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:48.292197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68cd8a90-c501-4792-96e4-3ca26002afdc tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:48.297282 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2a76934e-228e-4c86-a449-3f2cf7d8b276 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:48.298142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2a76934e-228e-4c86-a449-3f2cf7d8b276 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:48.304133 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68cd8a90-c501-4792-96e4-3ca26002afdc tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:48.305766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68cd8a90-c501-4792-96e4-3ca26002afdc tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:48.308398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68cd8a90-c501-4792-96e4-3ca26002afdc tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:48.313245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a76934e-228e-4c86-a449-3f2cf7d8b276 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:48.313747 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a76934e-228e-4c86-a449-3f2cf7d8b276 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:48.314555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a76934e-228e-4c86-a449-3f2cf7d8b276 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:48.315605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a76934e-228e-4c86-a449-3f2cf7d8b276 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:48.316405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a76934e-228e-4c86-a449-3f2cf7d8b276 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:48.317017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a76934e-228e-4c86-a449-3f2cf7d8b276 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:48.349099 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-68cd8a90-c501-4792-96e4-3ca26002afdc tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e/ips" status: 200 len: 145 microversion: 2.1 time: 0.089568 Oct 29 03:11:48.357231 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2410/4627] 10.222.0.46 () {58 vars in 1248 bytes} [Sat Oct 29 03:11:48 2022] GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e/ips => generated 145 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:11:48.367349 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5bf8366f-5400-46a1-bc13-b0c5b487655b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:48.368357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5bf8366f-5400-46a1-bc13-b0c5b487655b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:48.375822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5bf8366f-5400-46a1-bc13-b0c5b487655b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:48.377347 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5bf8366f-5400-46a1-bc13-b0c5b487655b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:48.378036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5bf8366f-5400-46a1-bc13-b0c5b487655b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:48.379340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5bf8366f-5400-46a1-bc13-b0c5b487655b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:48.380123 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5bf8366f-5400-46a1-bc13-b0c5b487655b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:48.380812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5bf8366f-5400-46a1-bc13-b0c5b487655b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:48.811354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5bf8366f-5400-46a1-bc13-b0c5b487655b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:48.819829 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5bf8366f-5400-46a1-bc13-b0c5b487655b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1717 microversion: 2.1 time: 0.459623 Oct 29 03:11:48.820466 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2411/4628] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:48 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1717 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:49.048677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-643124b9-11c0-4bec-ace7-f10265ce7ec6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:49.049516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-643124b9-11c0-4bec-ace7-f10265ce7ec6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:49.083052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-643124b9-11c0-4bec-ace7-f10265ce7ec6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:49.083781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-643124b9-11c0-4bec-ace7-f10265ce7ec6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:49.084392 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-643124b9-11c0-4bec-ace7-f10265ce7ec6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:49.085792 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-643124b9-11c0-4bec-ace7-f10265ce7ec6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:49.086425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-643124b9-11c0-4bec-ace7-f10265ce7ec6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:49.087025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-643124b9-11c0-4bec-ace7-f10265ce7ec6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:49.344367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2a76934e-228e-4c86-a449-3f2cf7d8b276 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:49.355861 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2a76934e-228e-4c86-a449-3f2cf7d8b276 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad" status: 200 len: 1368 microversion: 2.1 time: 1.062381 Oct 29 03:11:49.364479 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-643124b9-11c0-4bec-ace7-f10265ce7ec6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] HTTP exception thrown: Cannot 'detach_volume' instance 0116c079-f618-42b3-94f5-340b2ed6efdd while it is in vm_state rescued Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-643124b9-11c0-4bec-ace7-f10265ce7ec6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Request method failure captured: Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-volume_attachments/93b3658d-8bd2-48c4-81d7-0ff74f04fe81 HTTP/1.1 Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJkstpA5nrrKxuzeE1g4WEYzXnFix9I4sSziPbQz99dUgzomHyqw4KsPh1hn9KOAuebDlCdyeoB2kux2qwxeu2Z6mzS4iRWjeZGoPYlFLBau8TUQ57qGw9-PfGzzlfqexDt_gFdVfpeGXf1jJa4Rp1iRzDcKossbo6MCW_huYuDbUoI Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 1d97a655408746baabe76d9c8b0e3d64 Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-927401152 Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1d97a655408746baabe76d9c8b0e3d64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1d97a655408746baabe76d9c8b0e3d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1d97a655408746baabe76d9c8b0e3d64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1d97a655408746baabe76d9c8b0e3d64"}]}] Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServerRescueNegativeTestJSON-927401152 Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 1d97a655408746baabe76d9c8b0e3d64 Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-927401152 Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServerRescueNegativeTestJSON-927401152-project Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 06be3266f5774dc0acea36973521a5e5 Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServerRescueNegativeTestJSON-927401152-project Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: exception: Cannot 'detach_volume' instance 0116c079-f618-42b3-94f5-340b2ed6efdd while it is in vm_state rescued Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'server_id': '0116c079-f618-42b3-94f5-340b2ed6efdd', 'id': '93b3658d-8bd2-48c4-81d7-0ff74f04fe81'} Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0116c079-f618-42b3-94f5-340b2ed6efdd in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0116c079-f618-42b3-94f5-340b2ed6efdd while it is in vm_state rescued Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:11:49.367323 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:11:49.373351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:11:49.373351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:11:49.373351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:11:49.373351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:11:49.373351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0116c079-f618-42b3-94f5-340b2ed6efdd while it is in vm_state rescued Oct 29 03:11:49.373351 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:11:49.374944 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-643124b9-11c0-4bec-ace7-f10265ce7ec6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Returning 409 to user: Cannot 'detach_volume' instance 0116c079-f618-42b3-94f5-340b2ed6efdd while it is in vm_state rescued {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:11:49.376140 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-643124b9-11c0-4bec-ace7-f10265ce7ec6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-volume_attachments/93b3658d-8bd2-48c4-81d7-0ff74f04fe81" status: 409 len: 152 microversion: 2.1 time: 0.333352 Oct 29 03:11:49.376650 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2218/4629] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:48 2022] GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad => generated 1368 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:49.378758 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2412/4630] 10.222.0.46 () {58 vars in 1416 bytes} [Sat Oct 29 03:11:49 2022] DELETE /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-volume_attachments/93b3658d-8bd2-48c4-81d7-0ff74f04fe81 => generated 152 bytes in 336 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:11:49.390397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8b2cca54-9402-4af8-89aa-d4c5f7295169 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:11:49.390935 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8b2cca54-9402-4af8-89aa-d4c5f7295169 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:49.405045 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b2cca54-9402-4af8-89aa-d4c5f7295169 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:49.406035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b2cca54-9402-4af8-89aa-d4c5f7295169 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:49.406488 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b2cca54-9402-4af8-89aa-d4c5f7295169 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:49.407196 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b2cca54-9402-4af8-89aa-d4c5f7295169 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:49.407648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b2cca54-9402-4af8-89aa-d4c5f7295169 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:49.408069 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b2cca54-9402-4af8-89aa-d4c5f7295169 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:49.584982 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8b2cca54-9402-4af8-89aa-d4c5f7295169 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "POST /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/action" status: 202 len: 0 microversion: 2.1 time: 0.160506 Oct 29 03:11:49.586666 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-48b46db4-50c8-4914-8bd7-df670b802434 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:49.586666 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-48b46db4-50c8-4914-8bd7-df670b802434 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:49.587039 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2219/4631] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:11:49 2022] POST /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:11:49.587304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-48b46db4-50c8-4914-8bd7-df670b802434 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:49.587304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-48b46db4-50c8-4914-8bd7-df670b802434 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:49.587304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-48b46db4-50c8-4914-8bd7-df670b802434 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:49.587304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-48b46db4-50c8-4914-8bd7-df670b802434 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:49.587304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-48b46db4-50c8-4914-8bd7-df670b802434 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:49.587304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-48b46db4-50c8-4914-8bd7-df670b802434 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:50.384684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-08ebf1bf-94f8-4752-878c-29bb9bf899e2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:50.385507 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-08ebf1bf-94f8-4752-878c-29bb9bf899e2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:50.403769 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08ebf1bf-94f8-4752-878c-29bb9bf899e2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:50.404406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08ebf1bf-94f8-4752-878c-29bb9bf899e2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:50.404934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08ebf1bf-94f8-4752-878c-29bb9bf899e2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:50.407997 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08ebf1bf-94f8-4752-878c-29bb9bf899e2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:50.408667 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08ebf1bf-94f8-4752-878c-29bb9bf899e2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:50.409132 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08ebf1bf-94f8-4752-878c-29bb9bf899e2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:50.567667 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-48b46db4-50c8-4914-8bd7-df670b802434 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:50.578196 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-48b46db4-50c8-4914-8bd7-df670b802434 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1725 microversion: 2.1 time: 1.022772 Oct 29 03:11:50.596316 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2413/4632] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:49 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1725 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:11:51.133061 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-08ebf1bf-94f8-4752-878c-29bb9bf899e2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:51.149669 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-08ebf1bf-94f8-4752-878c-29bb9bf899e2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad" status: 200 len: 1368 microversion: 2.1 time: 0.769561 Oct 29 03:11:51.150290 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2220/4633] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:50 2022] GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad => generated 1368 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:51.412590 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8fa56224-f12f-48e0-8979-fc0f1089a4c2 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d614b230-8ca6-4098-a973-3241a81b1c9e"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:11:51.417329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8fa56224-f12f-48e0-8979-fc0f1089a4c2 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:51.449621 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fa56224-f12f-48e0-8979-fc0f1089a4c2 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:51.451118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fa56224-f12f-48e0-8979-fc0f1089a4c2 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:51.451734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fa56224-f12f-48e0-8979-fc0f1089a4c2 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:51.453688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fa56224-f12f-48e0-8979-fc0f1089a4c2 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:51.454377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fa56224-f12f-48e0-8979-fc0f1089a4c2 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:51.455199 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fa56224-f12f-48e0-8979-fc0f1089a4c2 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:51.603901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a03db9d5-e980-4648-8566-b386e8da9089 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:51.604649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a03db9d5-e980-4648-8566-b386e8da9089 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:51.619112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a03db9d5-e980-4648-8566-b386e8da9089 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:51.622451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a03db9d5-e980-4648-8566-b386e8da9089 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:51.623165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a03db9d5-e980-4648-8566-b386e8da9089 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:51.624261 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a03db9d5-e980-4648-8566-b386e8da9089 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:51.626362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a03db9d5-e980-4648-8566-b386e8da9089 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:51.628454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a03db9d5-e980-4648-8566-b386e8da9089 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:51.924621 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8fa56224-f12f-48e0-8979-fc0f1089a4c2 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "POST /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.515036 Oct 29 03:11:51.952598 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2414/4634] 10.222.0.46 () {60 vars in 1323 bytes} [Sat Oct 29 03:11:51 2022] POST /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e/os-volume_attachments => generated 194 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:11:52.184621 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4037903d-3db7-4f4b-b659-6fb77a404f14 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:52.185904 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4037903d-3db7-4f4b-b659-6fb77a404f14 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:52.196127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4037903d-3db7-4f4b-b659-6fb77a404f14 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:52.198411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4037903d-3db7-4f4b-b659-6fb77a404f14 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:52.199259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4037903d-3db7-4f4b-b659-6fb77a404f14 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:52.200462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4037903d-3db7-4f4b-b659-6fb77a404f14 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:52.201185 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4037903d-3db7-4f4b-b659-6fb77a404f14 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:52.201952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4037903d-3db7-4f4b-b659-6fb77a404f14 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:52.393952 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a03db9d5-e980-4648-8566-b386e8da9089 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:52.404097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:52.412701 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a03db9d5-e980-4648-8566-b386e8da9089 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1725 microversion: 2.1 time: 0.811282 Oct 29 03:11:52.414372 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2221/4635] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:51 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1725 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:52.655281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-8dcd44d4-137d-4ee6-b86f-5a5d16c78286 req-5322b63b-24de-4ab3-911f-6873b93957fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83b9fc20-0b3e-488b-817c-a8cfe934ddad", "tag": "8dc32258-276c-49b9-bff3-9cf8882c90b3"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:11:52.685491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8dcd44d4-137d-4ee6-b86f-5a5d16c78286 req-5322b63b-24de-4ab3-911f-6873b93957fe service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:52.688697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8dcd44d4-137d-4ee6-b86f-5a5d16c78286 req-5322b63b-24de-4ab3-911f-6873b93957fe service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:52.689322 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8dcd44d4-137d-4ee6-b86f-5a5d16c78286 req-5322b63b-24de-4ab3-911f-6873b93957fe service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:52.721914 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-8dcd44d4-137d-4ee6-b86f-5a5d16c78286 req-5322b63b-24de-4ab3-911f-6873b93957fe service nova] Creating event network-changed:8dc32258-276c-49b9-bff3-9cf8882c90b3 for instance 83b9fc20-0b3e-488b-817c-a8cfe934ddad on n-h2-862967-2 Oct 29 03:11:52.745328 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-8dcd44d4-137d-4ee6-b86f-5a5d16c78286 req-5322b63b-24de-4ab3-911f-6873b93957fe service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095189 Oct 29 03:11:52.746257 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2222/4636] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:11:52.923948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4037903d-3db7-4f4b-b659-6fb77a404f14 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:52.940687 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4037903d-3db7-4f4b-b659-6fb77a404f14 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad" status: 200 len: 1368 microversion: 2.1 time: 0.769255 Oct 29 03:11:52.942050 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2415/4637] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:52 2022] GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad => generated 1368 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:53.443892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-670c1d7a-4575-4a7a-a1dc-827a4929fd42 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:53.445049 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-670c1d7a-4575-4a7a-a1dc-827a4929fd42 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:53.458273 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-670c1d7a-4575-4a7a-a1dc-827a4929fd42 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:53.459167 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-670c1d7a-4575-4a7a-a1dc-827a4929fd42 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:53.459887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-670c1d7a-4575-4a7a-a1dc-827a4929fd42 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:53.461098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-670c1d7a-4575-4a7a-a1dc-827a4929fd42 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:53.461746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-670c1d7a-4575-4a7a-a1dc-827a4929fd42 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:53.462335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-670c1d7a-4575-4a7a-a1dc-827a4929fd42 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:53.613541 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:53.678733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:53.895701 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-670c1d7a-4575-4a7a-a1dc-827a4929fd42 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:53.917216 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-670c1d7a-4575-4a7a-a1dc-827a4929fd42 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1725 microversion: 2.1 time: 0.477591 Oct 29 03:11:53.943856 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2223/4638] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:53 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1725 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:53.966341 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bbe650e7-39a7-4311-8a0a-be39343f4c43 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:53.967231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bbe650e7-39a7-4311-8a0a-be39343f4c43 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:53.980233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbe650e7-39a7-4311-8a0a-be39343f4c43 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:53.985350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbe650e7-39a7-4311-8a0a-be39343f4c43 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:53.986220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbe650e7-39a7-4311-8a0a-be39343f4c43 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:53.987688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbe650e7-39a7-4311-8a0a-be39343f4c43 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:53.988553 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbe650e7-39a7-4311-8a0a-be39343f4c43 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:53.989328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbe650e7-39a7-4311-8a0a-be39343f4c43 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:54.446248 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:54.645619 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bbe650e7-39a7-4311-8a0a-be39343f4c43 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:54.699415 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bbe650e7-39a7-4311-8a0a-be39343f4c43 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad" status: 200 len: 1368 microversion: 2.1 time: 0.737132 Oct 29 03:11:54.702139 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2416/4639] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:53 2022] GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad => generated 1368 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:54.949725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-119216d5-5137-44a0-b4e5-c88deafd00d7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:54.954917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-119216d5-5137-44a0-b4e5-c88deafd00d7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:54.980439 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-119216d5-5137-44a0-b4e5-c88deafd00d7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:54.981795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-119216d5-5137-44a0-b4e5-c88deafd00d7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:54.982729 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-119216d5-5137-44a0-b4e5-c88deafd00d7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:54.985668 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-119216d5-5137-44a0-b4e5-c88deafd00d7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:54.986968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-119216d5-5137-44a0-b4e5-c88deafd00d7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:54.988355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-119216d5-5137-44a0-b4e5-c88deafd00d7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:55.729950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d5a50c84-0698-49ad-a06a-9112efa9cbba tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:55.735061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d5a50c84-0698-49ad-a06a-9112efa9cbba tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:55.761271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5a50c84-0698-49ad-a06a-9112efa9cbba tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:55.768011 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5a50c84-0698-49ad-a06a-9112efa9cbba tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:55.769174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5a50c84-0698-49ad-a06a-9112efa9cbba tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:55.773330 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5a50c84-0698-49ad-a06a-9112efa9cbba tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:55.774431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5a50c84-0698-49ad-a06a-9112efa9cbba tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:55.775444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5a50c84-0698-49ad-a06a-9112efa9cbba tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:55.877719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:56.024964 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-119216d5-5137-44a0-b4e5-c88deafd00d7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:56.036220 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-119216d5-5137-44a0-b4e5-c88deafd00d7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1725 microversion: 2.1 time: 1.096546 Oct 29 03:11:56.037660 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2224/4640] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:54 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1725 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:11:57.063406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-50881c18-976a-4a41-82f9-e44c29f66259 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:57.065225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-50881c18-976a-4a41-82f9-e44c29f66259 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:57.081622 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50881c18-976a-4a41-82f9-e44c29f66259 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:57.086093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50881c18-976a-4a41-82f9-e44c29f66259 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:57.089477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50881c18-976a-4a41-82f9-e44c29f66259 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:57.090598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50881c18-976a-4a41-82f9-e44c29f66259 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:57.091650 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50881c18-976a-4a41-82f9-e44c29f66259 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:57.095355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50881c18-976a-4a41-82f9-e44c29f66259 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:57.573159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d5a50c84-0698-49ad-a06a-9112efa9cbba tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:57.589859 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d5a50c84-0698-49ad-a06a-9112efa9cbba tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad" status: 200 len: 1368 microversion: 2.1 time: 1.868102 Oct 29 03:11:57.591910 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2417/4641] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:55 2022] GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad => generated 1368 bytes in 1871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:57.765820 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-50881c18-976a-4a41-82f9-e44c29f66259 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:57.778605 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-50881c18-976a-4a41-82f9-e44c29f66259 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1731 microversion: 2.1 time: 0.719829 Oct 29 03:11:57.779865 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2225/4642] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:57 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1731 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:57.803119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-08eeb202-eef3-417e-9153-9239c0289ed4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:57.803606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-08eeb202-eef3-417e-9153-9239c0289ed4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:57.829419 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:57.832018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-08eeb202-eef3-417e-9153-9239c0289ed4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:57.832590 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-08eeb202-eef3-417e-9153-9239c0289ed4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:57.833302 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-08eeb202-eef3-417e-9153-9239c0289ed4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:57.833946 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-08eeb202-eef3-417e-9153-9239c0289ed4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:57.834403 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-08eeb202-eef3-417e-9153-9239c0289ed4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:57.834872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-08eeb202-eef3-417e-9153-9239c0289ed4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:58.142809 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-08eeb202-eef3-417e-9153-9239c0289ed4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.343859 Oct 29 03:11:58.152203 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2418/4643] 10.222.0.46 () {58 vars in 1275 bytes} [Sat Oct 29 03:11:57 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-interface => generated 285 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:11:58.615033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6b53fcc5-2aff-43c6-843a-f8a6acc4bd0d tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:11:58.615645 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6b53fcc5-2aff-43c6-843a-f8a6acc4bd0d tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:11:58.632159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b53fcc5-2aff-43c6-843a-f8a6acc4bd0d tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:58.632987 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b53fcc5-2aff-43c6-843a-f8a6acc4bd0d tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:58.634129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b53fcc5-2aff-43c6-843a-f8a6acc4bd0d tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:58.635118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b53fcc5-2aff-43c6-843a-f8a6acc4bd0d tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:58.635754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b53fcc5-2aff-43c6-843a-f8a6acc4bd0d tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:58.636813 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b53fcc5-2aff-43c6-843a-f8a6acc4bd0d tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:59.218469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6b53fcc5-2aff-43c6-843a-f8a6acc4bd0d tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:11:59.232626 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6b53fcc5-2aff-43c6-843a-f8a6acc4bd0d tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad" status: 200 len: 1368 microversion: 2.1 time: 0.621296 Oct 29 03:11:59.236424 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2226/4644] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:11:58 2022] GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad => generated 1368 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:11:59.511427 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-c2da6a87-ccc7-41a8-9ab7-ecc7a956028d req-92ed3394-fd1e-447f-ac7b-9412a4829fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83b9fc20-0b3e-488b-817c-a8cfe934ddad", "name": "network-vif-plugged", "status": "completed", "tag": "8dc32258-276c-49b9-bff3-9cf8882c90b3"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:11:59.532056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c2da6a87-ccc7-41a8-9ab7-ecc7a956028d req-92ed3394-fd1e-447f-ac7b-9412a4829fb8 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:11:59.532848 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c2da6a87-ccc7-41a8-9ab7-ecc7a956028d req-92ed3394-fd1e-447f-ac7b-9412a4829fb8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:11:59.533557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c2da6a87-ccc7-41a8-9ab7-ecc7a956028d req-92ed3394-fd1e-447f-ac7b-9412a4829fb8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:11:59.563828 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-c2da6a87-ccc7-41a8-9ab7-ecc7a956028d req-92ed3394-fd1e-447f-ac7b-9412a4829fb8 service nova] Creating event network-vif-plugged:8dc32258-276c-49b9-bff3-9cf8882c90b3 for instance 83b9fc20-0b3e-488b-817c-a8cfe934ddad on n-h2-862967-2 Oct 29 03:11:59.578491 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-c2da6a87-ccc7-41a8-9ab7-ecc7a956028d req-92ed3394-fd1e-447f-ac7b-9412a4829fb8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071002 Oct 29 03:11:59.579722 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2419/4645] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:00.258030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4f8de4a1-98e5-4938-84fb-9071d722b795 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:00.258659 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4f8de4a1-98e5-4938-84fb-9071d722b795 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:00.279976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f8de4a1-98e5-4938-84fb-9071d722b795 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:00.280780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f8de4a1-98e5-4938-84fb-9071d722b795 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:00.281229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f8de4a1-98e5-4938-84fb-9071d722b795 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:00.281973 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f8de4a1-98e5-4938-84fb-9071d722b795 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:00.293288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f8de4a1-98e5-4938-84fb-9071d722b795 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:00.293761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f8de4a1-98e5-4938-84fb-9071d722b795 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:01.510042 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4f8de4a1-98e5-4938-84fb-9071d722b795 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:01.521869 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4f8de4a1-98e5-4938-84fb-9071d722b795 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad" status: 200 len: 1368 microversion: 2.1 time: 1.268857 Oct 29 03:12:01.522839 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2227/4646] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:00 2022] GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad => generated 1368 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:01.902315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-d104d477-94e4-4ff8-8cf9-d04e62246448 req-7f824bba-91f1-42c0-9fad-1743c2031252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0116c079-f618-42b3-94f5-340b2ed6efdd", "tag": "e14797d0-26ba-4515-ad2c-8ff690e8db5f"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:12:01.936753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d104d477-94e4-4ff8-8cf9-d04e62246448 req-7f824bba-91f1-42c0-9fad-1743c2031252 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:01.937503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d104d477-94e4-4ff8-8cf9-d04e62246448 req-7f824bba-91f1-42c0-9fad-1743c2031252 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:01.938593 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d104d477-94e4-4ff8-8cf9-d04e62246448 req-7f824bba-91f1-42c0-9fad-1743c2031252 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:01.979323 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-d104d477-94e4-4ff8-8cf9-d04e62246448 req-7f824bba-91f1-42c0-9fad-1743c2031252 service nova] Creating event network-changed:e14797d0-26ba-4515-ad2c-8ff690e8db5f for instance 0116c079-f618-42b3-94f5-340b2ed6efdd on n-h1-862967-2 Oct 29 03:12:01.988894 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-d104d477-94e4-4ff8-8cf9-d04e62246448 req-7f824bba-91f1-42c0-9fad-1743c2031252 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102425 Oct 29 03:12:01.990196 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2420/4647] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:02.545691 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b50a8dc7-32a7-40b2-b83a-f18af4658ac8 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:02.546281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b50a8dc7-32a7-40b2-b83a-f18af4658ac8 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:02.559574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b50a8dc7-32a7-40b2-b83a-f18af4658ac8 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:02.559811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b50a8dc7-32a7-40b2-b83a-f18af4658ac8 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:02.560211 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b50a8dc7-32a7-40b2-b83a-f18af4658ac8 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:02.560954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b50a8dc7-32a7-40b2-b83a-f18af4658ac8 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:02.561398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b50a8dc7-32a7-40b2-b83a-f18af4658ac8 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:02.561927 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b50a8dc7-32a7-40b2-b83a-f18af4658ac8 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:03.887037 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b50a8dc7-32a7-40b2-b83a-f18af4658ac8 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:03.897663 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b50a8dc7-32a7-40b2-b83a-f18af4658ac8 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad" status: 200 len: 1558 microversion: 2.1 time: 1.355744 Oct 29 03:12:03.903472 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2228/4648] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:02 2022] GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad => generated 1558 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:12:03.932052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-819f6d43-db9a-474c-8f11-8d88e42aafe8 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:03.932679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-819f6d43-db9a-474c-8f11-8d88e42aafe8 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:03.946168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-819f6d43-db9a-474c-8f11-8d88e42aafe8 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:03.949910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-819f6d43-db9a-474c-8f11-8d88e42aafe8 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:03.950707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-819f6d43-db9a-474c-8f11-8d88e42aafe8 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:03.951688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-819f6d43-db9a-474c-8f11-8d88e42aafe8 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:03.954823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-819f6d43-db9a-474c-8f11-8d88e42aafe8 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:03.955955 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-819f6d43-db9a-474c-8f11-8d88e42aafe8 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:04.091370 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-9f744f7a-a10c-48cd-a297-3c35d84cdb5b req-6a4775f9-f8f7-41e8-b064-5274b84ef967 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0116c079-f618-42b3-94f5-340b2ed6efdd", "tag": "e14797d0-26ba-4515-ad2c-8ff690e8db5f"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:12:04.111443 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9f744f7a-a10c-48cd-a297-3c35d84cdb5b req-6a4775f9-f8f7-41e8-b064-5274b84ef967 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:04.112278 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9f744f7a-a10c-48cd-a297-3c35d84cdb5b req-6a4775f9-f8f7-41e8-b064-5274b84ef967 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:04.112964 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9f744f7a-a10c-48cd-a297-3c35d84cdb5b req-6a4775f9-f8f7-41e8-b064-5274b84ef967 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:04.140196 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-9f744f7a-a10c-48cd-a297-3c35d84cdb5b req-6a4775f9-f8f7-41e8-b064-5274b84ef967 service nova] Creating event network-changed:e14797d0-26ba-4515-ad2c-8ff690e8db5f for instance 0116c079-f618-42b3-94f5-340b2ed6efdd on n-h1-862967-2 Oct 29 03:12:04.148194 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-9f744f7a-a10c-48cd-a297-3c35d84cdb5b req-6a4775f9-f8f7-41e8-b064-5274b84ef967 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061317 Oct 29 03:12:04.150094 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2229/4649] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:04.255426 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-819f6d43-db9a-474c-8f11-8d88e42aafe8 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.332529 Oct 29 03:12:04.256336 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2421/4650] 10.222.0.46 () {58 vars in 1275 bytes} [Sat Oct 29 03:12:03 2022] GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad/os-interface => generated 285 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:08.247173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9f391556-85f3-433e-ac19-9da1786b48b9 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:08.250487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9f391556-85f3-433e-ac19-9da1786b48b9 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:08.260313 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f391556-85f3-433e-ac19-9da1786b48b9 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:08.261486 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f391556-85f3-433e-ac19-9da1786b48b9 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:08.269127 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f391556-85f3-433e-ac19-9da1786b48b9 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:08.270230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f391556-85f3-433e-ac19-9da1786b48b9 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:08.270886 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f391556-85f3-433e-ac19-9da1786b48b9 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:08.271482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f391556-85f3-433e-ac19-9da1786b48b9 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:08.358540 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9f391556-85f3-433e-ac19-9da1786b48b9 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115927 Oct 29 03:12:08.359644 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2230/4651] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:12:08 2022] GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:08.370731 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-00a44cb7-80ab-492a-8453-4b37af95be9e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:08.371893 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-00a44cb7-80ab-492a-8453-4b37af95be9e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:08.380517 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00a44cb7-80ab-492a-8453-4b37af95be9e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:08.381236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00a44cb7-80ab-492a-8453-4b37af95be9e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:08.381851 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00a44cb7-80ab-492a-8453-4b37af95be9e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:08.383034 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00a44cb7-80ab-492a-8453-4b37af95be9e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:08.384316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00a44cb7-80ab-492a-8453-4b37af95be9e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:08.385112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00a44cb7-80ab-492a-8453-4b37af95be9e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:08.429042 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-00a44cb7-80ab-492a-8453-4b37af95be9e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e/os-volume_attachments/d614b230-8ca6-4098-a973-3241a81b1c9e" status: 200 len: 194 microversion: 2.1 time: 0.062462 Oct 29 03:12:08.437231 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2422/4652] 10.222.0.46 () {58 vars in 1413 bytes} [Sat Oct 29 03:12:08 2022] GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e/os-volume_attachments/d614b230-8ca6-4098-a973-3241a81b1c9e => generated 194 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:08.824675 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-f63e6363-9d84-44d8-8744-6a25656e8592 req-85a62a1c-0902-4916-8f51-8b95541b1fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83b9fc20-0b3e-488b-817c-a8cfe934ddad", "tag": "8dc32258-276c-49b9-bff3-9cf8882c90b3"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:12:08.841849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:08.847856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f63e6363-9d84-44d8-8744-6a25656e8592 req-85a62a1c-0902-4916-8f51-8b95541b1fe3 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:08.852031 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f63e6363-9d84-44d8-8744-6a25656e8592 req-85a62a1c-0902-4916-8f51-8b95541b1fe3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:08.871720 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f63e6363-9d84-44d8-8744-6a25656e8592 req-85a62a1c-0902-4916-8f51-8b95541b1fe3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:08.887806 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-f63e6363-9d84-44d8-8744-6a25656e8592 req-85a62a1c-0902-4916-8f51-8b95541b1fe3 service nova] Creating event network-changed:8dc32258-276c-49b9-bff3-9cf8882c90b3 for instance 83b9fc20-0b3e-488b-817c-a8cfe934ddad on n-h2-862967-2 Oct 29 03:12:08.896205 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-f63e6363-9d84-44d8-8744-6a25656e8592 req-85a62a1c-0902-4916-8f51-8b95541b1fe3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076608 Oct 29 03:12:08.898210 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2231/4653] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:11.132320 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-75213b92-5991-41cd-81d4-23eb936e1f35 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4441b24-9403-48cd-b46c-de8036e4b737"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:12:11.135056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-75213b92-5991-41cd-81d4-23eb936e1f35 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:11.157768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-75213b92-5991-41cd-81d4-23eb936e1f35 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:11.160408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-75213b92-5991-41cd-81d4-23eb936e1f35 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:11.162438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-75213b92-5991-41cd-81d4-23eb936e1f35 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:11.167169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-75213b92-5991-41cd-81d4-23eb936e1f35 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:11.171801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-75213b92-5991-41cd-81d4-23eb936e1f35 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:11.175016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-75213b92-5991-41cd-81d4-23eb936e1f35 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:11.693042 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-75213b92-5991-41cd-81d4-23eb936e1f35 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "POST /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.564512 Oct 29 03:12:11.695473 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2423/4654] 10.222.0.46 () {60 vars in 1323 bytes} [Sat Oct 29 03:12:11 2022] POST /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e/os-volume_attachments => generated 194 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:26.310002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=49 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:26.311127 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:26.317448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b7db8ebe-51e5-4835-b570-e46a88fa35f2 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:26.321426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b7db8ebe-51e5-4835-b570-e46a88fa35f2 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:26.329804 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7db8ebe-51e5-4835-b570-e46a88fa35f2 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:26.330496 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7db8ebe-51e5-4835-b570-e46a88fa35f2 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:26.331078 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7db8ebe-51e5-4835-b570-e46a88fa35f2 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:26.332046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7db8ebe-51e5-4835-b570-e46a88fa35f2 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:26.332912 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7db8ebe-51e5-4835-b570-e46a88fa35f2 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:26.334120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7db8ebe-51e5-4835-b570-e46a88fa35f2 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:26.375442 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b7db8ebe-51e5-4835-b570-e46a88fa35f2 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.068109 Oct 29 03:12:26.376493 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2232/4655] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:12:26 2022] GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e/os-volume_attachments => generated 371 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:26.523109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=11 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:26.524594 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:26.532268 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ff0b0a23-50b2-40b2-903a-bbc1fc4055fe tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:26.533137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ff0b0a23-50b2-40b2-903a-bbc1fc4055fe tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:26.540837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff0b0a23-50b2-40b2-903a-bbc1fc4055fe tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:26.541746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff0b0a23-50b2-40b2-903a-bbc1fc4055fe tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:26.542405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff0b0a23-50b2-40b2-903a-bbc1fc4055fe tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:26.543362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff0b0a23-50b2-40b2-903a-bbc1fc4055fe tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:26.544039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff0b0a23-50b2-40b2-903a-bbc1fc4055fe tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:26.544727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff0b0a23-50b2-40b2-903a-bbc1fc4055fe tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:26.589907 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ff0b0a23-50b2-40b2-903a-bbc1fc4055fe tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e/os-volume_attachments/d614b230-8ca6-4098-a973-3241a81b1c9e" status: 200 len: 194 microversion: 2.1 time: 0.069880 Oct 29 03:12:26.591469 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2424/4656] 10.222.0.46 () {58 vars in 1413 bytes} [Sat Oct 29 03:12:26 2022] GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e/os-volume_attachments/d614b230-8ca6-4098-a973-3241a81b1c9e => generated 194 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:26.601639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-19d05d2e-be48-4f82-a4e1-af2614cd03ea tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:26.602132 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-19d05d2e-be48-4f82-a4e1-af2614cd03ea tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:26.608705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19d05d2e-be48-4f82-a4e1-af2614cd03ea tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:26.609523 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19d05d2e-be48-4f82-a4e1-af2614cd03ea tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:26.610171 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19d05d2e-be48-4f82-a4e1-af2614cd03ea tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:26.611086 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19d05d2e-be48-4f82-a4e1-af2614cd03ea tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:26.612008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19d05d2e-be48-4f82-a4e1-af2614cd03ea tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:26.612678 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19d05d2e-be48-4f82-a4e1-af2614cd03ea tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:26.724269 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-19d05d2e-be48-4f82-a4e1-af2614cd03ea tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lazy-loading 'services' on Instance uuid 659587f7-4fe6-4f7e-9f2d-5581cf3b169e {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:12:26.833902 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-19d05d2e-be48-4f82-a4e1-af2614cd03ea tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "DELETE /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e/os-volume_attachments/d614b230-8ca6-4098-a973-3241a81b1c9e" status: 202 len: 0 microversion: 2.1 time: 0.236033 Oct 29 03:12:26.836575 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2233/4657] 10.222.0.46 () {58 vars in 1416 bytes} [Sat Oct 29 03:12:26 2022] DELETE /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e/os-volume_attachments/d614b230-8ca6-4098-a973-3241a81b1c9e => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:12:31.248822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-770dbf52-ff9b-45d8-a558-778254b9e69b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:31.249485 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-770dbf52-ff9b-45d8-a558-778254b9e69b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:31.258930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-770dbf52-ff9b-45d8-a558-778254b9e69b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:31.261753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-770dbf52-ff9b-45d8-a558-778254b9e69b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:31.262306 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-770dbf52-ff9b-45d8-a558-778254b9e69b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:31.263946 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-770dbf52-ff9b-45d8-a558-778254b9e69b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:31.265468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-770dbf52-ff9b-45d8-a558-778254b9e69b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:31.266637 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-770dbf52-ff9b-45d8-a558-778254b9e69b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:31.420044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-770dbf52-ff9b-45d8-a558-778254b9e69b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lazy-loading 'services' on Instance uuid 0116c079-f618-42b3-94f5-340b2ed6efdd {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:12:31.706277 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-770dbf52-ff9b-45d8-a558-778254b9e69b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-volume_attachments/93b3658d-8bd2-48c4-81d7-0ff74f04fe81" status: 202 len: 0 microversion: 2.1 time: 0.461275 Oct 29 03:12:31.711561 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2425/4658] 10.222.0.46 () {58 vars in 1416 bytes} [Sat Oct 29 03:12:31 2022] DELETE /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-volume_attachments/93b3658d-8bd2-48c4-81d7-0ff74f04fe81 => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:12:31.716077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ecd1720a-ba01-46d9-9a7b-4e1199dba900 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:31.718446 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ecd1720a-ba01-46d9-9a7b-4e1199dba900 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:31.744223 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecd1720a-ba01-46d9-9a7b-4e1199dba900 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:31.744471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecd1720a-ba01-46d9-9a7b-4e1199dba900 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:31.745972 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecd1720a-ba01-46d9-9a7b-4e1199dba900 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:31.745972 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecd1720a-ba01-46d9-9a7b-4e1199dba900 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:31.745972 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecd1720a-ba01-46d9-9a7b-4e1199dba900 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:31.749983 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecd1720a-ba01-46d9-9a7b-4e1199dba900 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:31.889391 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ecd1720a-ba01-46d9-9a7b-4e1199dba900 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.174824 Oct 29 03:12:31.897251 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2234/4659] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:12:31 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:32.905897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4dacd023-e30f-4528-be39-0c92df900d17 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:32.908355 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4dacd023-e30f-4528-be39-0c92df900d17 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:32.949332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4dacd023-e30f-4528-be39-0c92df900d17 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:32.949849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4dacd023-e30f-4528-be39-0c92df900d17 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:32.950295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4dacd023-e30f-4528-be39-0c92df900d17 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:32.951108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4dacd023-e30f-4528-be39-0c92df900d17 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:32.951664 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4dacd023-e30f-4528-be39-0c92df900d17 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:32.952377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4dacd023-e30f-4528-be39-0c92df900d17 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:33.031026 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4dacd023-e30f-4528-be39-0c92df900d17 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130747 Oct 29 03:12:33.031294 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2426/4660] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:12:32 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:34.045278 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6b9c7f8b-b548-4402-a1b9-6bfc571dd79b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:34.048220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6b9c7f8b-b548-4402-a1b9-6bfc571dd79b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:34.063788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b9c7f8b-b548-4402-a1b9-6bfc571dd79b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:34.064588 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b9c7f8b-b548-4402-a1b9-6bfc571dd79b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:34.069144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b9c7f8b-b548-4402-a1b9-6bfc571dd79b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:34.070243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b9c7f8b-b548-4402-a1b9-6bfc571dd79b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:34.070884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b9c7f8b-b548-4402-a1b9-6bfc571dd79b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:34.071475 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b9c7f8b-b548-4402-a1b9-6bfc571dd79b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:34.123147 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6b9c7f8b-b548-4402-a1b9-6bfc571dd79b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084539 Oct 29 03:12:34.125288 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2235/4661] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:12:34 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:34.560898 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-73a23512-0939-41b1-8258-2a641e54c3c5 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:34.561517 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-73a23512-0939-41b1-8258-2a641e54c3c5 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:34.576595 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73a23512-0939-41b1-8258-2a641e54c3c5 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:34.577155 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73a23512-0939-41b1-8258-2a641e54c3c5 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:34.577605 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73a23512-0939-41b1-8258-2a641e54c3c5 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:34.578335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73a23512-0939-41b1-8258-2a641e54c3c5 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:34.580224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73a23512-0939-41b1-8258-2a641e54c3c5 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:34.580728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73a23512-0939-41b1-8258-2a641e54c3c5 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:34.614107 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-73a23512-0939-41b1-8258-2a641e54c3c5 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e/os-volume_attachments/d4441b24-9403-48cd-b46c-de8036e4b737" status: 200 len: 194 microversion: 2.1 time: 0.057436 Oct 29 03:12:34.626133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c09f4a35-86bf-46a1-84b0-ff406077d93e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:34.626552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c09f4a35-86bf-46a1-84b0-ff406077d93e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:34.630235 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2427/4662] 10.222.0.46 () {58 vars in 1413 bytes} [Sat Oct 29 03:12:34 2022] GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e/os-volume_attachments/d4441b24-9403-48cd-b46c-de8036e4b737 => generated 194 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:34.633758 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c09f4a35-86bf-46a1-84b0-ff406077d93e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:34.634476 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c09f4a35-86bf-46a1-84b0-ff406077d93e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:34.635091 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c09f4a35-86bf-46a1-84b0-ff406077d93e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:34.635957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c09f4a35-86bf-46a1-84b0-ff406077d93e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:34.637260 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c09f4a35-86bf-46a1-84b0-ff406077d93e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:34.637935 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c09f4a35-86bf-46a1-84b0-ff406077d93e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:34.746528 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-c09f4a35-86bf-46a1-84b0-ff406077d93e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lazy-loading 'services' on Instance uuid 659587f7-4fe6-4f7e-9f2d-5581cf3b169e {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:12:34.874874 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c09f4a35-86bf-46a1-84b0-ff406077d93e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "DELETE /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e/os-volume_attachments/d4441b24-9403-48cd-b46c-de8036e4b737" status: 202 len: 0 microversion: 2.1 time: 0.253083 Oct 29 03:12:34.876142 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2236/4663] 10.222.0.46 () {58 vars in 1416 bytes} [Sat Oct 29 03:12:34 2022] DELETE /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e/os-volume_attachments/d4441b24-9403-48cd-b46c-de8036e4b737 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:12:35.142169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-47a6f5af-2184-4e93-b376-8068b7e8818c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:35.145591 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-47a6f5af-2184-4e93-b376-8068b7e8818c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:35.164832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47a6f5af-2184-4e93-b376-8068b7e8818c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:35.165341 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47a6f5af-2184-4e93-b376-8068b7e8818c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:35.166062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47a6f5af-2184-4e93-b376-8068b7e8818c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:35.166989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47a6f5af-2184-4e93-b376-8068b7e8818c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:35.167610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47a6f5af-2184-4e93-b376-8068b7e8818c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:35.168788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47a6f5af-2184-4e93-b376-8068b7e8818c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:35.220419 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-47a6f5af-2184-4e93-b376-8068b7e8818c tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087996 Oct 29 03:12:35.229808 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2428/4664] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:12:35 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:36.246152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1c01ef27-4a2e-4fe9-8097-60d916cbe0c8 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:36.248563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1c01ef27-4a2e-4fe9-8097-60d916cbe0c8 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:36.284918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c01ef27-4a2e-4fe9-8097-60d916cbe0c8 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:36.286263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c01ef27-4a2e-4fe9-8097-60d916cbe0c8 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:36.286759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c01ef27-4a2e-4fe9-8097-60d916cbe0c8 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:36.294580 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c01ef27-4a2e-4fe9-8097-60d916cbe0c8 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:36.295100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c01ef27-4a2e-4fe9-8097-60d916cbe0c8 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:36.297405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c01ef27-4a2e-4fe9-8097-60d916cbe0c8 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:36.341889 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1c01ef27-4a2e-4fe9-8097-60d916cbe0c8 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112097 Oct 29 03:12:36.343264 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2237/4665] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:12:36 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:37.357258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-160d4c87-b89d-49ca-b8b9-0c973c447c38 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:37.359565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-160d4c87-b89d-49ca-b8b9-0c973c447c38 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:37.378723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-160d4c87-b89d-49ca-b8b9-0c973c447c38 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:37.379302 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-160d4c87-b89d-49ca-b8b9-0c973c447c38 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:37.380614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-160d4c87-b89d-49ca-b8b9-0c973c447c38 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:37.383407 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-160d4c87-b89d-49ca-b8b9-0c973c447c38 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:37.385592 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-160d4c87-b89d-49ca-b8b9-0c973c447c38 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:37.387993 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-160d4c87-b89d-49ca-b8b9-0c973c447c38 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:37.471440 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-160d4c87-b89d-49ca-b8b9-0c973c447c38 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121113 Oct 29 03:12:37.472692 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2429/4666] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:12:37 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:38.483843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ef4fe39a-7e70-4766-8cb8-5c785b72079e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:38.486619 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ef4fe39a-7e70-4766-8cb8-5c785b72079e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:38.505119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef4fe39a-7e70-4766-8cb8-5c785b72079e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:38.506045 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef4fe39a-7e70-4766-8cb8-5c785b72079e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:38.506505 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef4fe39a-7e70-4766-8cb8-5c785b72079e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:38.507343 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef4fe39a-7e70-4766-8cb8-5c785b72079e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:38.507804 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef4fe39a-7e70-4766-8cb8-5c785b72079e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:38.508227 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef4fe39a-7e70-4766-8cb8-5c785b72079e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:38.559474 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ef4fe39a-7e70-4766-8cb8-5c785b72079e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079715 Oct 29 03:12:38.560500 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2238/4667] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:12:38 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:39.577847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1da7a08e-cfc5-413b-8d9e-5f79a1d55d35 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:39.581268 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1da7a08e-cfc5-413b-8d9e-5f79a1d55d35 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:39.593020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1da7a08e-cfc5-413b-8d9e-5f79a1d55d35 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:39.593729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1da7a08e-cfc5-413b-8d9e-5f79a1d55d35 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:39.594357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1da7a08e-cfc5-413b-8d9e-5f79a1d55d35 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:39.595226 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1da7a08e-cfc5-413b-8d9e-5f79a1d55d35 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:39.595827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1da7a08e-cfc5-413b-8d9e-5f79a1d55d35 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:39.596401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1da7a08e-cfc5-413b-8d9e-5f79a1d55d35 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:39.635877 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1da7a08e-cfc5-413b-8d9e-5f79a1d55d35 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067148 Oct 29 03:12:39.641730 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2430/4668] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:12:39 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:40.649693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fef53b0d-198e-4d7c-9e39-f27135b986bf tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:40.651892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fef53b0d-198e-4d7c-9e39-f27135b986bf tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:40.660575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fef53b0d-198e-4d7c-9e39-f27135b986bf tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:40.661069 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fef53b0d-198e-4d7c-9e39-f27135b986bf tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:40.661500 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fef53b0d-198e-4d7c-9e39-f27135b986bf tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:40.663064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fef53b0d-198e-4d7c-9e39-f27135b986bf tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:40.663979 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fef53b0d-198e-4d7c-9e39-f27135b986bf tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:40.664660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fef53b0d-198e-4d7c-9e39-f27135b986bf tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:40.743388 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fef53b0d-198e-4d7c-9e39-f27135b986bf tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098316 Oct 29 03:12:40.746928 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2239/4669] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:12:40 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:12:41.757466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-22efb549-9707-4576-9b5b-f10b8c41fe88 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:41.761021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-22efb549-9707-4576-9b5b-f10b8c41fe88 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:41.790500 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22efb549-9707-4576-9b5b-f10b8c41fe88 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:41.791000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22efb549-9707-4576-9b5b-f10b8c41fe88 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:41.796774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22efb549-9707-4576-9b5b-f10b8c41fe88 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:41.797820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22efb549-9707-4576-9b5b-f10b8c41fe88 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:41.802445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22efb549-9707-4576-9b5b-f10b8c41fe88 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:41.803197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22efb549-9707-4576-9b5b-f10b8c41fe88 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:41.910800 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-22efb549-9707-4576-9b5b-f10b8c41fe88 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.155704 Oct 29 03:12:41.919357 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2431/4670] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:12:41 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd/os-volume_attachments => generated 25 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:12:42.468667 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-69270842-8c1c-48a5-ad72-e45d19f500e1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:12:42.473246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-69270842-8c1c-48a5-ad72-e45d19f500e1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:42.507487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-69270842-8c1c-48a5-ad72-e45d19f500e1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:42.507999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-69270842-8c1c-48a5-ad72-e45d19f500e1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:42.514258 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-69270842-8c1c-48a5-ad72-e45d19f500e1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:42.533353 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-69270842-8c1c-48a5-ad72-e45d19f500e1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:42.534346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-69270842-8c1c-48a5-ad72-e45d19f500e1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:42.534988 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-69270842-8c1c-48a5-ad72-e45d19f500e1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:42.616618 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-69270842-8c1c-48a5-ad72-e45d19f500e1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] HTTP exception thrown: Cannot 'reboot' instance 3d04a110-8ee9-4c6d-a68a-49e8493b8be2 while it is in vm_state rescued Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-69270842-8c1c-48a5-ad72-e45d19f500e1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Request method failure captured: Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2/action HTTP/1.1 Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 28 Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJkstpA5nrrKxuzeE1g4WEYzXnFix9I4sSziPbQz99dUgzomHyqw4KsPh1hn9KOAuebDlCdyeoB2kux2qwxeu2Z6mzS4iRWjeZGoPYlFLBau8TUQ57qGw9-PfGzzlfqexDt_gFdVfpeGXf1jJa4Rp1iRzDcKossbo6MCW_huYuDbUoI Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 1d97a655408746baabe76d9c8b0e3d64 Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-927401152 Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1d97a655408746baabe76d9c8b0e3d64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1d97a655408746baabe76d9c8b0e3d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1d97a655408746baabe76d9c8b0e3d64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1d97a655408746baabe76d9c8b0e3d64"}]}] Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerRescueNegativeTestJSON-927401152 Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 1d97a655408746baabe76d9c8b0e3d64 Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-927401152 Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerRescueNegativeTestJSON-927401152-project Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 06be3266f5774dc0acea36973521a5e5 Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerRescueNegativeTestJSON-927401152-project Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: {"reboot": {"type": "HARD"}} Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: exception: Cannot 'reboot' instance 3d04a110-8ee9-4c6d-a68a-49e8493b8be2 while it is in vm_state rescued Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '3d04a110-8ee9-4c6d-a68a-49e8493b8be2', 'body': {'reboot': {'type': 'HARD'}}} Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3d04a110-8ee9-4c6d-a68a-49e8493b8be2 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 03:12:42.622494 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 03:12:42.635746 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 3d04a110-8ee9-4c6d-a68a-49e8493b8be2 while it is in vm_state rescued Oct 29 03:12:42.635746 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:12:42.635746 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:42.635746 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:12:42.635746 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:42.635746 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:42.635746 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:42.635746 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:12:42.635746 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:12:42.635746 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 3d04a110-8ee9-4c6d-a68a-49e8493b8be2 while it is in vm_state rescued Oct 29 03:12:42.635746 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:12:42.635746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-69270842-8c1c-48a5-ad72-e45d19f500e1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Returning 409 to user: Cannot 'reboot' instance 3d04a110-8ee9-4c6d-a68a-49e8493b8be2 while it is in vm_state rescued {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:12:42.635746 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-69270842-8c1c-48a5-ad72-e45d19f500e1 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "POST /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2/action" status: 409 len: 145 microversion: 2.1 time: 0.159737 Oct 29 03:12:42.635746 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2240/4671] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:12:42 2022] POST /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2/action => generated 145 bytes in 170 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:12:42.638008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d00a7382-debb-4847-ac5d-ec5a5f4f97e3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:12:42.647359 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d00a7382-debb-4847-ac5d-ec5a5f4f97e3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:42.689445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d00a7382-debb-4847-ac5d-ec5a5f4f97e3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:42.690120 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d00a7382-debb-4847-ac5d-ec5a5f4f97e3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:42.690587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d00a7382-debb-4847-ac5d-ec5a5f4f97e3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:42.691368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d00a7382-debb-4847-ac5d-ec5a5f4f97e3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:42.691860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d00a7382-debb-4847-ac5d-ec5a5f4f97e3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:42.692288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d00a7382-debb-4847-ac5d-ec5a5f4f97e3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:42.802458 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-d00a7382-debb-4847-ac5d-ec5a5f4f97e3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] HTTP exception thrown: Cannot 'rebuild' instance 3d04a110-8ee9-4c6d-a68a-49e8493b8be2 while it is in vm_state rescued Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d00a7382-debb-4847-ac5d-ec5a5f4f97e3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Request method failure captured: Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2/action HTTP/1.1 Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 65 Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJkstpA5nrrKxuzeE1g4WEYzXnFix9I4sSziPbQz99dUgzomHyqw4KsPh1hn9KOAuebDlCdyeoB2kux2qwxeu2Z6mzS4iRWjeZGoPYlFLBau8TUQ57qGw9-PfGzzlfqexDt_gFdVfpeGXf1jJa4Rp1iRzDcKossbo6MCW_huYuDbUoI Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 1d97a655408746baabe76d9c8b0e3d64 Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-927401152 Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1d97a655408746baabe76d9c8b0e3d64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1d97a655408746baabe76d9c8b0e3d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1d97a655408746baabe76d9c8b0e3d64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1d97a655408746baabe76d9c8b0e3d64"}]}] Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServerRescueNegativeTestJSON-927401152 Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 1d97a655408746baabe76d9c8b0e3d64 Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-927401152 Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServerRescueNegativeTestJSON-927401152-project Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 06be3266f5774dc0acea36973521a5e5 Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServerRescueNegativeTestJSON-927401152-project Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: {"rebuild": {"imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a"}} Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: exception: Cannot 'rebuild' instance 3d04a110-8ee9-4c6d-a68a-49e8493b8be2 while it is in vm_state rescued Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '3d04a110-8ee9-4c6d-a68a-49e8493b8be2', 'body': {'rebuild': {'imageRef': 'cd315600-df67-41c1-95d3-95a5145fc39a'}}} Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3d04a110-8ee9-4c6d-a68a-49e8493b8be2 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:12:42.818910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:12:42.823868 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:12:42.823868 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 29 03:12:42.823868 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 29 03:12:42.823868 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 29 03:12:42.823868 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 29 03:12:42.823868 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 29 03:12:42.823868 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 3d04a110-8ee9-4c6d-a68a-49e8493b8be2 while it is in vm_state rescued Oct 29 03:12:42.823868 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:12:42.823868 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:42.823868 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:12:42.823868 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:42.823868 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:42.823868 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:42.823868 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:12:42.823868 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:12:42.823868 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 3d04a110-8ee9-4c6d-a68a-49e8493b8be2 while it is in vm_state rescued Oct 29 03:12:42.823868 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:12:42.827266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d00a7382-debb-4847-ac5d-ec5a5f4f97e3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Returning 409 to user: Cannot 'rebuild' instance 3d04a110-8ee9-4c6d-a68a-49e8493b8be2 while it is in vm_state rescued {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:12:42.828392 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d00a7382-debb-4847-ac5d-ec5a5f4f97e3 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "POST /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2/action" status: 409 len: 146 microversion: 2.1 time: 0.197283 Oct 29 03:12:42.829547 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2432/4672] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:12:42 2022] POST /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2/action => generated 146 bytes in 199 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:12:42.839926 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-19f6bb98-d9fe-45da-89ec-9de3c2032f07 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:42.840441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-19f6bb98-d9fe-45da-89ec-9de3c2032f07 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:42.854361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19f6bb98-d9fe-45da-89ec-9de3c2032f07 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:42.854862 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19f6bb98-d9fe-45da-89ec-9de3c2032f07 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:42.855304 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19f6bb98-d9fe-45da-89ec-9de3c2032f07 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:42.856030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19f6bb98-d9fe-45da-89ec-9de3c2032f07 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:42.856485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19f6bb98-d9fe-45da-89ec-9de3c2032f07 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:42.856935 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19f6bb98-d9fe-45da-89ec-9de3c2032f07 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:42.958067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-19f6bb98-d9fe-45da-89ec-9de3c2032f07 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:12:43.148394 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-19f6bb98-d9fe-45da-89ec-9de3c2032f07 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 204 len: 0 microversion: 2.1 time: 0.312937 Oct 29 03:12:43.149329 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2241/4673] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:12:42 2022] DELETE /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:12:43.157489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-83e21fa8-c84c-4462-b1d5-af4acc7995ea tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:43.158308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-83e21fa8-c84c-4462-b1d5-af4acc7995ea tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:43.174781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83e21fa8-c84c-4462-b1d5-af4acc7995ea tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:43.178017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83e21fa8-c84c-4462-b1d5-af4acc7995ea tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:43.178885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83e21fa8-c84c-4462-b1d5-af4acc7995ea tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:43.179972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83e21fa8-c84c-4462-b1d5-af4acc7995ea tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:43.180825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83e21fa8-c84c-4462-b1d5-af4acc7995ea tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:43.182748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83e21fa8-c84c-4462-b1d5-af4acc7995ea tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:43.715082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-83e21fa8-c84c-4462-b1d5-af4acc7995ea tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:43.728139 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-83e21fa8-c84c-4462-b1d5-af4acc7995ea tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1691 microversion: 2.1 time: 0.574549 Oct 29 03:12:43.731298 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2433/4674] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:43 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1691 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:44.765021 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-83b1b0a2-3a50-4ea2-ab48-434649d3a613 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:44.766719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-83b1b0a2-3a50-4ea2-ab48-434649d3a613 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:44.786425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83b1b0a2-3a50-4ea2-ab48-434649d3a613 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:44.787366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83b1b0a2-3a50-4ea2-ab48-434649d3a613 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:44.787806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e10a77a5-acf7-4479-b311-73511866df07 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "914cd23b-3532-42af-9220-967b439e7567"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:12:44.789166 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83b1b0a2-3a50-4ea2-ab48-434649d3a613 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:44.790197 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83b1b0a2-3a50-4ea2-ab48-434649d3a613 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:44.791080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83b1b0a2-3a50-4ea2-ab48-434649d3a613 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:44.791898 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83b1b0a2-3a50-4ea2-ab48-434649d3a613 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:44.801051 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e10a77a5-acf7-4479-b311-73511866df07 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:44.823883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e10a77a5-acf7-4479-b311-73511866df07 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:44.824312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e10a77a5-acf7-4479-b311-73511866df07 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:44.828665 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e10a77a5-acf7-4479-b311-73511866df07 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:44.830124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e10a77a5-acf7-4479-b311-73511866df07 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:44.831516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e10a77a5-acf7-4479-b311-73511866df07 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:44.831974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e10a77a5-acf7-4479-b311-73511866df07 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:45.425771 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e10a77a5-acf7-4479-b311-73511866df07 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "POST /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.644622 Oct 29 03:12:45.443345 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2434/4675] 10.222.0.46 () {60 vars in 1323 bytes} [Sat Oct 29 03:12:44 2022] POST /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad/os-volume_attachments => generated 194 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:12:45.494943 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-83b1b0a2-3a50-4ea2-ab48-434649d3a613 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:45.506927 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-83b1b0a2-3a50-4ea2-ab48-434649d3a613 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1691 microversion: 2.1 time: 0.753696 Oct 29 03:12:45.509231 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2242/4676] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:44 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1691 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:46.537741 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fd0908e2-77ee-448a-9c36-115cc2b050e7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:46.539255 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fd0908e2-77ee-448a-9c36-115cc2b050e7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:46.547966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd0908e2-77ee-448a-9c36-115cc2b050e7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:46.549292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd0908e2-77ee-448a-9c36-115cc2b050e7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:46.549969 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd0908e2-77ee-448a-9c36-115cc2b050e7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:46.550945 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd0908e2-77ee-448a-9c36-115cc2b050e7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:46.552608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd0908e2-77ee-448a-9c36-115cc2b050e7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:46.553272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd0908e2-77ee-448a-9c36-115cc2b050e7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:47.362895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fd0908e2-77ee-448a-9c36-115cc2b050e7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:47.372632 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fd0908e2-77ee-448a-9c36-115cc2b050e7 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1691 microversion: 2.1 time: 0.842668 Oct 29 03:12:47.378670 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2435/4677] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:46 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1691 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:48.405901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9a30f7f7-68e4-4ca0-bed5-9db1728ba3d4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:48.407150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9a30f7f7-68e4-4ca0-bed5-9db1728ba3d4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:48.417025 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a30f7f7-68e4-4ca0-bed5-9db1728ba3d4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:48.417782 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a30f7f7-68e4-4ca0-bed5-9db1728ba3d4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:48.418404 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a30f7f7-68e4-4ca0-bed5-9db1728ba3d4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:48.419890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a30f7f7-68e4-4ca0-bed5-9db1728ba3d4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:48.420760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a30f7f7-68e4-4ca0-bed5-9db1728ba3d4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:48.421370 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a30f7f7-68e4-4ca0-bed5-9db1728ba3d4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:48.821442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9a30f7f7-68e4-4ca0-bed5-9db1728ba3d4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:48.832396 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9a30f7f7-68e4-4ca0-bed5-9db1728ba3d4 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1691 microversion: 2.1 time: 0.430182 Oct 29 03:12:48.834767 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2243/4678] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:48 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1691 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:49.412126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0df82ad7-ed41-4ed4-a95b-1c082f9c83d8 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:49.416314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0df82ad7-ed41-4ed4-a95b-1c082f9c83d8 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:49.453745 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0df82ad7-ed41-4ed4-a95b-1c082f9c83d8 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:49.460192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0df82ad7-ed41-4ed4-a95b-1c082f9c83d8 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:49.461213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0df82ad7-ed41-4ed4-a95b-1c082f9c83d8 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:49.464506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0df82ad7-ed41-4ed4-a95b-1c082f9c83d8 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:49.468833 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0df82ad7-ed41-4ed4-a95b-1c082f9c83d8 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:49.469776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0df82ad7-ed41-4ed4-a95b-1c082f9c83d8 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:49.512777 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0df82ad7-ed41-4ed4-a95b-1c082f9c83d8 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106332 Oct 29 03:12:49.513983 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2436/4679] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:12:49 2022] GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:12:49.738032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4628aa70-43c4-48c7-8f19-05c311f1858f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:49.741859 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4628aa70-43c4-48c7-8f19-05c311f1858f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:49.757535 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4628aa70-43c4-48c7-8f19-05c311f1858f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:49.761202 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4628aa70-43c4-48c7-8f19-05c311f1858f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:49.769264 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4628aa70-43c4-48c7-8f19-05c311f1858f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:49.773471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4628aa70-43c4-48c7-8f19-05c311f1858f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:49.773982 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4628aa70-43c4-48c7-8f19-05c311f1858f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:49.774419 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4628aa70-43c4-48c7-8f19-05c311f1858f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:49.845250 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4628aa70-43c4-48c7-8f19-05c311f1858f tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.108913 Oct 29 03:12:49.846483 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2244/4680] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:12:49 2022] GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:12:49.858077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5bfa4b7c-f758-46f9-8d05-7b6ed4a5d368 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:49.858719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5bfa4b7c-f758-46f9-8d05-7b6ed4a5d368 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:49.869168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5bfa4b7c-f758-46f9-8d05-7b6ed4a5d368 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:49.869679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5bfa4b7c-f758-46f9-8d05-7b6ed4a5d368 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:49.870124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5bfa4b7c-f758-46f9-8d05-7b6ed4a5d368 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:49.874394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5bfa4b7c-f758-46f9-8d05-7b6ed4a5d368 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:49.876016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5bfa4b7c-f758-46f9-8d05-7b6ed4a5d368 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:49.876706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5bfa4b7c-f758-46f9-8d05-7b6ed4a5d368 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:49.969830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-05208ec3-0eca-4a97-9647-9f3adf1754e8 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:49.970246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-05208ec3-0eca-4a97-9647-9f3adf1754e8 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:49.979175 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05208ec3-0eca-4a97-9647-9f3adf1754e8 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:49.979661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05208ec3-0eca-4a97-9647-9f3adf1754e8 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:49.980098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05208ec3-0eca-4a97-9647-9f3adf1754e8 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:49.981531 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05208ec3-0eca-4a97-9647-9f3adf1754e8 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:49.981531 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05208ec3-0eca-4a97-9647-9f3adf1754e8 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:49.981736 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05208ec3-0eca-4a97-9647-9f3adf1754e8 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:50.038977 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-05208ec3-0eca-4a97-9647-9f3adf1754e8 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:12:50.048444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:50.139262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5bfa4b7c-f758-46f9-8d05-7b6ed4a5d368 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:50.153840 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5bfa4b7c-f758-46f9-8d05-7b6ed4a5d368 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1623 microversion: 2.1 time: 0.299577 Oct 29 03:12:50.167220 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2437/4681] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:49 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1623 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:50.405537 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-05208ec3-0eca-4a97-9647-9f3adf1754e8 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "DELETE /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e" status: 204 len: 0 microversion: 2.1 time: 0.439511 Oct 29 03:12:50.406150 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2245/4682] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:12:49 2022] DELETE /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 03:12:50.415323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8bd297eb-62e0-495b-83bb-4407c16c794e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:50.415726 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8bd297eb-62e0-495b-83bb-4407c16c794e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:50.425458 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bd297eb-62e0-495b-83bb-4407c16c794e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:50.426948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bd297eb-62e0-495b-83bb-4407c16c794e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:50.428362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bd297eb-62e0-495b-83bb-4407c16c794e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:50.429388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bd297eb-62e0-495b-83bb-4407c16c794e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:50.429915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bd297eb-62e0-495b-83bb-4407c16c794e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:50.430503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bd297eb-62e0-495b-83bb-4407c16c794e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:51.184922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9e77b9dd-d9fb-4f04-bf7e-ec5464cea035 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:51.185633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9e77b9dd-d9fb-4f04-bf7e-ec5464cea035 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:51.198496 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e77b9dd-d9fb-4f04-bf7e-ec5464cea035 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:51.199239 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e77b9dd-d9fb-4f04-bf7e-ec5464cea035 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:51.202747 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e77b9dd-d9fb-4f04-bf7e-ec5464cea035 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:51.205014 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e77b9dd-d9fb-4f04-bf7e-ec5464cea035 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:51.205683 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e77b9dd-d9fb-4f04-bf7e-ec5464cea035 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:51.206295 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e77b9dd-d9fb-4f04-bf7e-ec5464cea035 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:51.566703 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8bd297eb-62e0-495b-83bb-4407c16c794e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:51.575624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:51.587548 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8bd297eb-62e0-495b-83bb-4407c16c794e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e" status: 200 len: 1672 microversion: 2.1 time: 1.173663 Oct 29 03:12:51.589145 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2438/4683] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:50 2022] GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e => generated 1672 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:51.979370 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-e77b8624-43fb-4310-9b65-bf597677d005 req-0e6e7b77-9f86-4914-a2a8-9184d535a362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0116c079-f618-42b3-94f5-340b2ed6efdd", "name": "network-vif-deleted", "tag": "e14797d0-26ba-4515-ad2c-8ff690e8db5f"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:12:52.004118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e77b8624-43fb-4310-9b65-bf597677d005 req-0e6e7b77-9f86-4914-a2a8-9184d535a362 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:52.004991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e77b8624-43fb-4310-9b65-bf597677d005 req-0e6e7b77-9f86-4914-a2a8-9184d535a362 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:52.006534 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e77b8624-43fb-4310-9b65-bf597677d005 req-0e6e7b77-9f86-4914-a2a8-9184d535a362 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:52.025721 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-e77b8624-43fb-4310-9b65-bf597677d005 req-0e6e7b77-9f86-4914-a2a8-9184d535a362 service nova] Creating event network-vif-deleted:e14797d0-26ba-4515-ad2c-8ff690e8db5f for instance 0116c079-f618-42b3-94f5-340b2ed6efdd on n-h1-862967-2 Oct 29 03:12:52.031685 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-e77b8624-43fb-4310-9b65-bf597677d005 req-0e6e7b77-9f86-4914-a2a8-9184d535a362 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.418909 Oct 29 03:12:52.032912 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2439/4684] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:12:52.205198 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9e77b9dd-d9fb-4f04-bf7e-ec5464cea035 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:52.216294 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9e77b9dd-d9fb-4f04-bf7e-ec5464cea035 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 200 len: 1623 microversion: 2.1 time: 1.037244 Oct 29 03:12:52.229905 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2246/4685] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:51 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 1623 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:52.618791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-50f20a8a-0388-43c3-bed0-1af646640923 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:52.621267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-50f20a8a-0388-43c3-bed0-1af646640923 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:52.634270 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50f20a8a-0388-43c3-bed0-1af646640923 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:52.637351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50f20a8a-0388-43c3-bed0-1af646640923 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:52.638564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50f20a8a-0388-43c3-bed0-1af646640923 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:52.639875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50f20a8a-0388-43c3-bed0-1af646640923 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:52.643135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50f20a8a-0388-43c3-bed0-1af646640923 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:52.644423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50f20a8a-0388-43c3-bed0-1af646640923 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:53.243473 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9012fd1b-e653-4306-88f0-08bc671980ab tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:53.244450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9012fd1b-e653-4306-88f0-08bc671980ab tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 0116c079-f618-42b3-94f5-340b2ed6efdd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:53.266090 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9012fd1b-e653-4306-88f0-08bc671980ab tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:53.266594 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9012fd1b-e653-4306-88f0-08bc671980ab tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:53.267035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9012fd1b-e653-4306-88f0-08bc671980ab tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:53.267750 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9012fd1b-e653-4306-88f0-08bc671980ab tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:53.268198 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9012fd1b-e653-4306-88f0-08bc671980ab tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:53.268650 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9012fd1b-e653-4306-88f0-08bc671980ab tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:53.300014 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-9012fd1b-e653-4306-88f0-08bc671980ab tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] HTTP exception thrown: Instance 0116c079-f618-42b3-94f5-340b2ed6efdd could not be found. Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9012fd1b-e653-4306-88f0-08bc671980ab tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Request method failure captured: Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd HTTP/1.1 Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJkstpA5nrrKxuzeE1g4WEYzXnFix9I4sSziPbQz99dUgzomHyqw4KsPh1hn9KOAuebDlCdyeoB2kux2qwxeu2Z6mzS4iRWjeZGoPYlFLBau8TUQ57qGw9-PfGzzlfqexDt_gFdVfpeGXf1jJa4Rp1iRzDcKossbo6MCW_huYuDbUoI Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 1d97a655408746baabe76d9c8b0e3d64 Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-927401152 Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1d97a655408746baabe76d9c8b0e3d64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1d97a655408746baabe76d9c8b0e3d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1d97a655408746baabe76d9c8b0e3d64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1d97a655408746baabe76d9c8b0e3d64"}]}] Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerRescueNegativeTestJSON-927401152 Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 1d97a655408746baabe76d9c8b0e3d64 Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-927401152 Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerRescueNegativeTestJSON-927401152-project Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 06be3266f5774dc0acea36973521a5e5 Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerRescueNegativeTestJSON-927401152-project Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 0116c079-f618-42b3-94f5-340b2ed6efdd could not be found. Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '0116c079-f618-42b3-94f5-340b2ed6efdd'} Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0116c079-f618-42b3-94f5-340b2ed6efdd could not be found. Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0116c079-f618-42b3-94f5-340b2ed6efdd could not be found. Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:12:53.307992 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:53.313569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:12:53.313569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:53.313569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:53.313569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:53.313569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:12:53.313569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:12:53.313569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0116c079-f618-42b3-94f5-340b2ed6efdd could not be found. Oct 29 03:12:53.313569 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:12:53.313569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9012fd1b-e653-4306-88f0-08bc671980ab tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Returning 404 to user: Instance 0116c079-f618-42b3-94f5-340b2ed6efdd could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:12:53.313569 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9012fd1b-e653-4306-88f0-08bc671980ab tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd" status: 404 len: 111 microversion: 2.1 time: 0.071095 Oct 29 03:12:53.313569 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2247/4686] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:53 2022] GET /compute/v2.1/servers/0116c079-f618-42b3-94f5-340b2ed6efdd => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:12:53.327776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0118e870-2a9a-4c9d-97d7-a6207b47a6cc tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '.version_select at 0x7ff052bc20d0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:53.333861 n-d-862967-2 devstack@n-api.service[127125]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0118e870-2a9a-4c9d-97d7-a6207b47a6cc tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [6eee867f-424a-42b4-a30e-df10028d97ed] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 03:12:53.603787 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-50f20a8a-0388-43c3-bed0-1af646640923 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:53.617829 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-50f20a8a-0388-43c3-bed0-1af646640923 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e" status: 200 len: 1672 microversion: 2.1 time: 1.005832 Oct 29 03:12:53.619428 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2440/4687] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:52 2022] GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e => generated 1672 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:54.340984 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [None req-0118e870-2a9a-4c9d-97d7-a6207b47a6cc tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [6eee867f-424a-42b4-a30e-df10028d97ed] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 32838. Oct 29 03:12:54.371305 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0118e870-2a9a-4c9d-97d7-a6207b47a6cc tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-529664979" status: 202 len: 0 microversion: 2.1 time: 1.056473 Oct 29 03:12:54.376659 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2248/4688] 10.222.0.46 () {58 vars in 1218 bytes} [Sat Oct 29 03:12:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-529664979 => generated 0 bytes in 1062 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:12:54.654821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1db33e6e-1475-498f-b61e-14f979b645ab tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:54.656026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1db33e6e-1475-498f-b61e-14f979b645ab tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:54.665584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1db33e6e-1475-498f-b61e-14f979b645ab tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:54.677286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1db33e6e-1475-498f-b61e-14f979b645ab tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:54.678089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1db33e6e-1475-498f-b61e-14f979b645ab tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:54.679089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1db33e6e-1475-498f-b61e-14f979b645ab tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:54.679745 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1db33e6e-1475-498f-b61e-14f979b645ab tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:54.680367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1db33e6e-1475-498f-b61e-14f979b645ab tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:54.886944 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1db33e6e-1475-498f-b61e-14f979b645ab tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:54.903292 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1db33e6e-1475-498f-b61e-14f979b645ab tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e" status: 200 len: 1604 microversion: 2.1 time: 0.252354 Oct 29 03:12:54.908557 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2441/4689] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:54 2022] GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e => generated 1604 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:55.798385 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-d86ec764-b4ed-43fd-8dd1-be6024fbd441 req-713fb30f-bcf6-4a86-83db-30f0d2958ffd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659587f7-4fe6-4f7e-9f2d-5581cf3b169e", "name": "network-vif-deleted", "tag": "4c9cb732-00e2-465f-9020-794505c32c62"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:12:55.841550 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d86ec764-b4ed-43fd-8dd1-be6024fbd441 req-713fb30f-bcf6-4a86-83db-30f0d2958ffd service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:55.845905 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d86ec764-b4ed-43fd-8dd1-be6024fbd441 req-713fb30f-bcf6-4a86-83db-30f0d2958ffd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:55.847280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d86ec764-b4ed-43fd-8dd1-be6024fbd441 req-713fb30f-bcf6-4a86-83db-30f0d2958ffd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:55.868341 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-d86ec764-b4ed-43fd-8dd1-be6024fbd441 req-713fb30f-bcf6-4a86-83db-30f0d2958ffd service nova] Creating event network-vif-deleted:4c9cb732-00e2-465f-9020-794505c32c62 for instance 659587f7-4fe6-4f7e-9f2d-5581cf3b169e on n-h1-862967-2 Oct 29 03:12:55.875654 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-d86ec764-b4ed-43fd-8dd1-be6024fbd441 req-713fb30f-bcf6-4a86-83db-30f0d2958ffd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081651 Oct 29 03:12:55.876896 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2249/4690] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:12:55.936420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-031fd67e-9c6f-4358-a6ce-1bc886205016 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:55.937088 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-031fd67e-9c6f-4358-a6ce-1bc886205016 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:55.966356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-031fd67e-9c6f-4358-a6ce-1bc886205016 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:55.967175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-031fd67e-9c6f-4358-a6ce-1bc886205016 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:55.967175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-031fd67e-9c6f-4358-a6ce-1bc886205016 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:55.967747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-031fd67e-9c6f-4358-a6ce-1bc886205016 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:55.968207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-031fd67e-9c6f-4358-a6ce-1bc886205016 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:55.968659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-031fd67e-9c6f-4358-a6ce-1bc886205016 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:56.052589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-031fd67e-9c6f-4358-a6ce-1bc886205016 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:56.053768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-031fd67e-9c6f-4358-a6ce-1bc886205016 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:56.055849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-031fd67e-9c6f-4358-a6ce-1bc886205016 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:56.066428 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-031fd67e-9c6f-4358-a6ce-1bc886205016 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lazy-loading 'fault' on Instance uuid 659587f7-4fe6-4f7e-9f2d-5581cf3b169e {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:12:56.831076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-031fd67e-9c6f-4358-a6ce-1bc886205016 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '494c556b424a4fa388680ab08a340a1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4853225daef418bb782b4f9f6d1382c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:12:56.840448 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-031fd67e-9c6f-4358-a6ce-1bc886205016 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e" status: 200 len: 1326 microversion: 2.1 time: 0.912847 Oct 29 03:12:56.863254 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2442/4691] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:55 2022] GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e => generated 1326 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:12:57.869176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-419b4660-e360-411f-8493-4fd57fc269ba tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:57.869879 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-419b4660-e360-411f-8493-4fd57fc269ba tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:12:57.881744 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:57.885715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-419b4660-e360-411f-8493-4fd57fc269ba tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:57.886253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-419b4660-e360-411f-8493-4fd57fc269ba tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:57.887471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-419b4660-e360-411f-8493-4fd57fc269ba tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:57.895508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-419b4660-e360-411f-8493-4fd57fc269ba tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:12:57.896109 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-419b4660-e360-411f-8493-4fd57fc269ba tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:12:57.896710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-419b4660-e360-411f-8493-4fd57fc269ba tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:12:57.925800 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-419b4660-e360-411f-8493-4fd57fc269ba tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] HTTP exception thrown: Instance 659587f7-4fe6-4f7e-9f2d-5581cf3b169e could not be found. Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-419b4660-e360-411f-8493-4fd57fc269ba tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Request method failure captured: Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e HTTP/1.1 Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJjKfda75b0pK70-1QXV8FG9LaFMExKiAhRA5WbJMc8e3WmfYg16rfnbph7_l5MUUwyIfa7l-BwMxMXmQnZKFai0PhtrxzZeOOL_kgJDWXHWhtAht76gGVf4wldFhwTTvnxG2gXJrHNQT-5dSS2YaMBC_A4KNuLwMY7IpgTDJ9usUkk Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: f4853225daef418bb782b4f9f6d1382c Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-AttachVolumeTestJSON-706277848 Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f4853225daef418bb782b4f9f6d1382c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f4853225daef418bb782b4f9f6d1382c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f4853225daef418bb782b4f9f6d1382c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f4853225daef418bb782b4f9f6d1382c"}]}] Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-AttachVolumeTestJSON-706277848 Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: f4853225daef418bb782b4f9f6d1382c Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-AttachVolumeTestJSON-706277848 Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-AttachVolumeTestJSON-706277848-project Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 494c556b424a4fa388680ab08a340a1d Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-AttachVolumeTestJSON-706277848-project Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 659587f7-4fe6-4f7e-9f2d-5581cf3b169e could not be found. Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '659587f7-4fe6-4f7e-9f2d-5581cf3b169e'} Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 659587f7-4fe6-4f7e-9f2d-5581cf3b169e could not be found. Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 659587f7-4fe6-4f7e-9f2d-5581cf3b169e could not be found. Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:12:57.931017 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:12:57.938892 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:12:57.938892 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:12:57.938892 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:12:57.938892 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:12:57.938892 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:12:57.938892 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 659587f7-4fe6-4f7e-9f2d-5581cf3b169e could not be found. Oct 29 03:12:57.938892 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:12:57.938892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-419b4660-e360-411f-8493-4fd57fc269ba tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Returning 404 to user: Instance 659587f7-4fe6-4f7e-9f2d-5581cf3b169e could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:12:57.938892 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-419b4660-e360-411f-8493-4fd57fc269ba tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e" status: 404 len: 111 microversion: 2.1 time: 0.069329 Oct 29 03:12:57.938892 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2250/4692] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:12:57 2022] GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:12:57.943016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-25031ea5-88f1-40e7-96a8-bb5c322fa8cb tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '.version_select at 0x7ff0533eeca0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:12:57.965629 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=41 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:57.982079 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-25031ea5-88f1-40e7-96a8-bb5c322fa8cb tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-122694989" status: 202 len: 0 microversion: 2.1 time: 0.042909 Oct 29 03:12:57.986309 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2443/4693] 10.222.0.46 () {58 vars in 1218 bytes} [Sat Oct 29 03:12:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-122694989 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:13:03.629711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-af959eb5-b5a1-4e89-af5b-65b436580c95 tempest-VolumesAdminNegativeTest-1372261999 tempest-VolumesAdminNegativeTest-1372261999-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "29720599-a52a-4202-9aab-6c0a9390a921"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:13:03.633251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-af959eb5-b5a1-4e89-af5b-65b436580c95 tempest-VolumesAdminNegativeTest-1372261999 tempest-VolumesAdminNegativeTest-1372261999-project-admin] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:03.652928 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af959eb5-b5a1-4e89-af5b-65b436580c95 tempest-VolumesAdminNegativeTest-1372261999 tempest-VolumesAdminNegativeTest-1372261999-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:03.653429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af959eb5-b5a1-4e89-af5b-65b436580c95 tempest-VolumesAdminNegativeTest-1372261999 tempest-VolumesAdminNegativeTest-1372261999-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:03.656063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af959eb5-b5a1-4e89-af5b-65b436580c95 tempest-VolumesAdminNegativeTest-1372261999 tempest-VolumesAdminNegativeTest-1372261999-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:03.658274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af959eb5-b5a1-4e89-af5b-65b436580c95 tempest-VolumesAdminNegativeTest-1372261999 tempest-VolumesAdminNegativeTest-1372261999-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:03.660085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af959eb5-b5a1-4e89-af5b-65b436580c95 tempest-VolumesAdminNegativeTest-1372261999 tempest-VolumesAdminNegativeTest-1372261999-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:03.662231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af959eb5-b5a1-4e89-af5b-65b436580c95 tempest-VolumesAdminNegativeTest-1372261999 tempest-VolumesAdminNegativeTest-1372261999-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:03.991032 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-af959eb5-b5a1-4e89-af5b-65b436580c95 tempest-VolumesAdminNegativeTest-1372261999 tempest-VolumesAdminNegativeTest-1372261999-project-admin] HTTP exception thrown: Volume 29720599-a52a-4202-9aab-6c0a9390a921 could not be found. Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-af959eb5-b5a1-4e89-af5b-65b436580c95 tempest-VolumesAdminNegativeTest-1372261999 tempest-VolumesAdminNegativeTest-1372261999-project-admin] Request method failure captured: Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: request: PUT /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad/os-volume_attachments/914cd23b-3532-42af-9220-967b439e7567 HTTP/1.1 Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 74 Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJnmOkgmvk2wLMRLgNtgFf27JK_i6r7ouPv7WXDlztTXouJVZ2U4TubAbjK-b4NQRmG4EqP1Nz_1hRafllFaxnOyYHIgdiszz8EaWq6_n_cg7DBO2q-R3fu3lCw17naL-HyzWkyszk3Wetur9grD6GNu8BLedI_Ppo-K4ai8GwosyLw Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 3797f0908776421bae0663e1a358a6cd Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-VolumesAdminNegativeTest-1372261999 Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: X-Role: admin,reader,member Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: admin,reader,member Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3797f0908776421bae0663e1a358a6cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3797f0908776421bae0663e1a358a6cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3797f0908776421bae0663e1a358a6cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3797f0908776421bae0663e1a358a6cd"}]}] Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-VolumesAdminNegativeTest-1372261999 Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 3797f0908776421bae0663e1a358a6cd Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1372261999 Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-VolumesAdminNegativeTest-1372261999-project-admin Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 011f0bf68ed34ad48e2d658e18d857d8 Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-VolumesAdminNegativeTest-1372261999-project-admin Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: {"volumeAttachment": {"volumeId": "29720599-a52a-4202-9aab-6c0a9390a921"}} Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: exception: Volume 29720599-a52a-4202-9aab-6c0a9390a921 could not be found. Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'server_id': '83b9fc20-0b3e-488b-817c-a8cfe934ddad', 'id': '914cd23b-3532-42af-9220-967b439e7567', 'body': {'volumeAttachment': {'volumeId': '29720599-a52a-4202-9aab-6c0a9390a921'}}} Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 29720599-a52a-4202-9aab-6c0a9390a921 could not be found. (HTTP 404) (Request-ID: req-dd4622f2-5e1d-4be5-84b8-ca271f720288) Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 03:13:03.993712 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 29720599-a52a-4202-9aab-6c0a9390a921 could not be found. Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 29720599-a52a-4202-9aab-6c0a9390a921 could not be found. Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 29720599-a52a-4202-9aab-6c0a9390a921 could not be found. Oct 29 03:13:03.998937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:13:04.008555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-af959eb5-b5a1-4e89-af5b-65b436580c95 tempest-VolumesAdminNegativeTest-1372261999 tempest-VolumesAdminNegativeTest-1372261999-project-admin] Returning 400 to user: Volume 29720599-a52a-4202-9aab-6c0a9390a921 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:13:04.010917 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-af959eb5-b5a1-4e89-af5b-65b436580c95 tempest-VolumesAdminNegativeTest-1372261999 tempest-VolumesAdminNegativeTest-1372261999-project-admin] 10.222.0.46 "PUT /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad/os-volume_attachments/914cd23b-3532-42af-9220-967b439e7567" status: 400 len: 107 microversion: 2.1 time: 1.052830 Oct 29 03:13:04.015638 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2251/4694] 10.222.0.46 () {60 vars in 1433 bytes} [Sat Oct 29 03:13:02 2022] PUT /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad/os-volume_attachments/914cd23b-3532-42af-9220-967b439e7567 => generated 107 bytes in 1059 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:13:04.230372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f5b0a58d-b1d4-4cc4-b16d-4b0644fdd426 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:04.231169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f5b0a58d-b1d4-4cc4-b16d-4b0644fdd426 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:04.257652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5b0a58d-b1d4-4cc4-b16d-4b0644fdd426 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:04.258083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5b0a58d-b1d4-4cc4-b16d-4b0644fdd426 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:04.258534 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5b0a58d-b1d4-4cc4-b16d-4b0644fdd426 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:04.259270 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5b0a58d-b1d4-4cc4-b16d-4b0644fdd426 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:04.262630 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5b0a58d-b1d4-4cc4-b16d-4b0644fdd426 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:04.267871 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5b0a58d-b1d4-4cc4-b16d-4b0644fdd426 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:04.571994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-f5b0a58d-b1d4-4cc4-b16d-4b0644fdd426 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lazy-loading 'services' on Instance uuid 83b9fc20-0b3e-488b-817c-a8cfe934ddad {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:13:04.731063 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f5b0a58d-b1d4-4cc4-b16d-4b0644fdd426 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "DELETE /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad/os-volume_attachments/914cd23b-3532-42af-9220-967b439e7567" status: 202 len: 0 microversion: 2.1 time: 0.504454 Oct 29 03:13:04.735137 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2444/4695] 10.222.0.46 () {58 vars in 1416 bytes} [Sat Oct 29 03:13:04 2022] DELETE /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad/os-volume_attachments/914cd23b-3532-42af-9220-967b439e7567 => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:13:04.744947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5d50a5e9-8005-4579-81fc-2d3885896dcd tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:04.748281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5d50a5e9-8005-4579-81fc-2d3885896dcd tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:04.770300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d50a5e9-8005-4579-81fc-2d3885896dcd tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:04.785421 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d50a5e9-8005-4579-81fc-2d3885896dcd tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:04.786179 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d50a5e9-8005-4579-81fc-2d3885896dcd tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:04.787159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d50a5e9-8005-4579-81fc-2d3885896dcd tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:04.787831 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d50a5e9-8005-4579-81fc-2d3885896dcd tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:04.789165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d50a5e9-8005-4579-81fc-2d3885896dcd tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:04.836968 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5d50a5e9-8005-4579-81fc-2d3885896dcd tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100600 Oct 29 03:13:04.838434 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2252/4696] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:13:04 2022] GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:13:05.853414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d7639bdd-1c4a-4bcc-8591-ea8f9136a1c7 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:05.856568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d7639bdd-1c4a-4bcc-8591-ea8f9136a1c7 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:05.876914 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7639bdd-1c4a-4bcc-8591-ea8f9136a1c7 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:05.884127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7639bdd-1c4a-4bcc-8591-ea8f9136a1c7 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:05.889506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7639bdd-1c4a-4bcc-8591-ea8f9136a1c7 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:05.892463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7639bdd-1c4a-4bcc-8591-ea8f9136a1c7 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:05.893165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7639bdd-1c4a-4bcc-8591-ea8f9136a1c7 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:05.893955 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7639bdd-1c4a-4bcc-8591-ea8f9136a1c7 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:06.023019 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d7639bdd-1c4a-4bcc-8591-ea8f9136a1c7 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168041 Oct 29 03:13:06.032751 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2445/4697] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:13:05 2022] GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:13:07.029027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-52f4925c-ced4-45d4-9140-59d5c2f3c3d0 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:07.031407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-52f4925c-ced4-45d4-9140-59d5c2f3c3d0 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:07.047009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52f4925c-ced4-45d4-9140-59d5c2f3c3d0 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:07.051210 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52f4925c-ced4-45d4-9140-59d5c2f3c3d0 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:07.051848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52f4925c-ced4-45d4-9140-59d5c2f3c3d0 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:07.054058 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52f4925c-ced4-45d4-9140-59d5c2f3c3d0 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:07.056424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52f4925c-ced4-45d4-9140-59d5c2f3c3d0 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:07.058080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52f4925c-ced4-45d4-9140-59d5c2f3c3d0 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:07.145229 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-52f4925c-ced4-45d4-9140-59d5c2f3c3d0 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119530 Oct 29 03:13:07.146759 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2253/4698] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:13:07 2022] GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:13:08.166029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5b83e5bd-d525-4ddc-af9f-d3b57d50492c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:08.169836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5b83e5bd-d525-4ddc-af9f-d3b57d50492c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:08.227576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b83e5bd-d525-4ddc-af9f-d3b57d50492c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:08.228261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b83e5bd-d525-4ddc-af9f-d3b57d50492c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:08.228770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b83e5bd-d525-4ddc-af9f-d3b57d50492c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:08.234500 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b83e5bd-d525-4ddc-af9f-d3b57d50492c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:08.235010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b83e5bd-d525-4ddc-af9f-d3b57d50492c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:08.235457 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b83e5bd-d525-4ddc-af9f-d3b57d50492c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:08.337465 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5b83e5bd-d525-4ddc-af9f-d3b57d50492c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.177840 Oct 29 03:13:08.338759 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2446/4699] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:13:08 2022] GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:13:09.354380 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-88db3b25-2aee-42a1-8906-1d07e99b8728 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:09.357397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-88db3b25-2aee-42a1-8906-1d07e99b8728 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:09.376956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88db3b25-2aee-42a1-8906-1d07e99b8728 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:09.378487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88db3b25-2aee-42a1-8906-1d07e99b8728 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:09.379133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88db3b25-2aee-42a1-8906-1d07e99b8728 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:09.380764 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88db3b25-2aee-42a1-8906-1d07e99b8728 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:09.381416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88db3b25-2aee-42a1-8906-1d07e99b8728 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:09.382168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88db3b25-2aee-42a1-8906-1d07e99b8728 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:09.469852 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-88db3b25-2aee-42a1-8906-1d07e99b8728 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120129 Oct 29 03:13:09.476124 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2254/4700] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:13:09 2022] GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:13:09.666995 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-662ce824-cf8d-4d7b-9667-0f198537c61e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:09.667894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-662ce824-cf8d-4d7b-9667-0f198537c61e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:09.696015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-662ce824-cf8d-4d7b-9667-0f198537c61e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:09.697004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-662ce824-cf8d-4d7b-9667-0f198537c61e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:09.698600 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-662ce824-cf8d-4d7b-9667-0f198537c61e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:09.700384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-662ce824-cf8d-4d7b-9667-0f198537c61e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:09.703168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-662ce824-cf8d-4d7b-9667-0f198537c61e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:09.704696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-662ce824-cf8d-4d7b-9667-0f198537c61e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:09.797108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-662ce824-cf8d-4d7b-9667-0f198537c61e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:13:10.182123 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-662ce824-cf8d-4d7b-9667-0f198537c61e tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 204 len: 0 microversion: 2.1 time: 0.521092 Oct 29 03:13:10.184240 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2447/4701] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:13:09 2022] DELETE /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:13:10.198482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ffca6e1c-9411-41a3-93ec-bb9396b02111 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:10.200695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ffca6e1c-9411-41a3-93ec-bb9396b02111 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:10.216257 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ffca6e1c-9411-41a3-93ec-bb9396b02111 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:10.220024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ffca6e1c-9411-41a3-93ec-bb9396b02111 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:10.221539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ffca6e1c-9411-41a3-93ec-bb9396b02111 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:10.232884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ffca6e1c-9411-41a3-93ec-bb9396b02111 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:10.233551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ffca6e1c-9411-41a3-93ec-bb9396b02111 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:10.234173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ffca6e1c-9411-41a3-93ec-bb9396b02111 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:10.488934 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-52f78e98-23a1-45f2-937a-93f6817d6c9b tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:10.491734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-52f78e98-23a1-45f2-937a-93f6817d6c9b tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:10.503502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-52f78e98-23a1-45f2-937a-93f6817d6c9b tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:10.504161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-52f78e98-23a1-45f2-937a-93f6817d6c9b tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:10.512434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-52f78e98-23a1-45f2-937a-93f6817d6c9b tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:10.513526 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-52f78e98-23a1-45f2-937a-93f6817d6c9b tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:10.516073 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-52f78e98-23a1-45f2-937a-93f6817d6c9b tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:10.517911 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-52f78e98-23a1-45f2-937a-93f6817d6c9b tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:10.610786 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-52f78e98-23a1-45f2-937a-93f6817d6c9b tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126283 Oct 29 03:13:10.617364 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2448/4702] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:13:10 2022] GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:13:10.991607 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ffca6e1c-9411-41a3-93ec-bb9396b02111 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:10.999839 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ffca6e1c-9411-41a3-93ec-bb9396b02111 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1508 microversion: 2.1 time: 0.811296 Oct 29 03:13:11.013181 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2255/4703] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:10 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1508 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:11.623746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f93d2adc-cdc1-4e1c-ac3d-50887a149d83 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:11.626429 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f93d2adc-cdc1-4e1c-ac3d-50887a149d83 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:11.670420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f93d2adc-cdc1-4e1c-ac3d-50887a149d83 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:11.675639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f93d2adc-cdc1-4e1c-ac3d-50887a149d83 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:11.678846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f93d2adc-cdc1-4e1c-ac3d-50887a149d83 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:11.679713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f93d2adc-cdc1-4e1c-ac3d-50887a149d83 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:11.680441 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f93d2adc-cdc1-4e1c-ac3d-50887a149d83 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:11.681238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f93d2adc-cdc1-4e1c-ac3d-50887a149d83 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:11.806862 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f93d2adc-cdc1-4e1c-ac3d-50887a149d83 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.187093 Oct 29 03:13:11.811835 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2449/4704] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:13:11 2022] GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:13:12.026172 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5b978c4c-9a95-4f94-b016-4840bd88ef63 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:12.026952 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5b978c4c-9a95-4f94-b016-4840bd88ef63 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:12.043420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5b978c4c-9a95-4f94-b016-4840bd88ef63 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:12.043921 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5b978c4c-9a95-4f94-b016-4840bd88ef63 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:12.044354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5b978c4c-9a95-4f94-b016-4840bd88ef63 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:12.045090 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5b978c4c-9a95-4f94-b016-4840bd88ef63 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:12.045539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5b978c4c-9a95-4f94-b016-4840bd88ef63 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:12.045958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5b978c4c-9a95-4f94-b016-4840bd88ef63 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:12.360612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5b978c4c-9a95-4f94-b016-4840bd88ef63 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:12.375789 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5b978c4c-9a95-4f94-b016-4840bd88ef63 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1508 microversion: 2.1 time: 0.354915 Oct 29 03:13:12.386408 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2256/4705] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:12 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1508 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:12.824060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bf8458b2-e90c-4e20-a69d-c12afa69d684 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:12.827220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bf8458b2-e90c-4e20-a69d-c12afa69d684 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:12.844482 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf8458b2-e90c-4e20-a69d-c12afa69d684 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:12.845905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf8458b2-e90c-4e20-a69d-c12afa69d684 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:12.848926 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf8458b2-e90c-4e20-a69d-c12afa69d684 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:12.854086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf8458b2-e90c-4e20-a69d-c12afa69d684 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:12.855247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf8458b2-e90c-4e20-a69d-c12afa69d684 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:12.858581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf8458b2-e90c-4e20-a69d-c12afa69d684 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:12.921669 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bf8458b2-e90c-4e20-a69d-c12afa69d684 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102995 Oct 29 03:13:12.922647 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2450/4706] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:13:12 2022] GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:13:13.404712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-df84cd75-276c-4c22-b940-4f60aa843949 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:13.405924 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-df84cd75-276c-4c22-b940-4f60aa843949 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:13.426413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df84cd75-276c-4c22-b940-4f60aa843949 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:13.426925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df84cd75-276c-4c22-b940-4f60aa843949 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:13.427362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df84cd75-276c-4c22-b940-4f60aa843949 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:13.435287 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df84cd75-276c-4c22-b940-4f60aa843949 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:13.436043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df84cd75-276c-4c22-b940-4f60aa843949 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:13.436798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df84cd75-276c-4c22-b940-4f60aa843949 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:13.936232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-60906312-7689-4990-9d15-342f7d23d0d2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:13.939296 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-60906312-7689-4990-9d15-342f7d23d0d2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:13.956145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60906312-7689-4990-9d15-342f7d23d0d2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:13.957170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60906312-7689-4990-9d15-342f7d23d0d2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:13.959666 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60906312-7689-4990-9d15-342f7d23d0d2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:13.960686 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60906312-7689-4990-9d15-342f7d23d0d2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:13.962609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60906312-7689-4990-9d15-342f7d23d0d2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:13.963304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60906312-7689-4990-9d15-342f7d23d0d2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:14.026863 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-60906312-7689-4990-9d15-342f7d23d0d2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095164 Oct 29 03:13:14.031475 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2451/4707] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:13:13 2022] GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:13:14.403767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-df84cd75-276c-4c22-b940-4f60aa843949 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:14.422454 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-df84cd75-276c-4c22-b940-4f60aa843949 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1508 microversion: 2.1 time: 1.021670 Oct 29 03:13:14.426416 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2257/4708] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:13 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1508 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:14.987070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-9b04b17f-72c4-4a9c-970e-d05bbeb0d2b5 req-8b9cb07b-adb0-4c6a-8c04-d1eca73b3ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d04a110-8ee9-4c6d-a68a-49e8493b8be2", "name": "network-vif-deleted", "tag": "b3ee4f85-8bd6-4217-9d11-7140be55636a"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:13:15.041818 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ce8d38fb-afa2-4c50-b80b-22b81513532c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:15.044496 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ce8d38fb-afa2-4c50-b80b-22b81513532c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:15.092237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9b04b17f-72c4-4a9c-970e-d05bbeb0d2b5 req-8b9cb07b-adb0-4c6a-8c04-d1eca73b3ec2 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:15.092923 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9b04b17f-72c4-4a9c-970e-d05bbeb0d2b5 req-8b9cb07b-adb0-4c6a-8c04-d1eca73b3ec2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:15.093486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9b04b17f-72c4-4a9c-970e-d05bbeb0d2b5 req-8b9cb07b-adb0-4c6a-8c04-d1eca73b3ec2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:15.098352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce8d38fb-afa2-4c50-b80b-22b81513532c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:15.103646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce8d38fb-afa2-4c50-b80b-22b81513532c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:15.107731 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce8d38fb-afa2-4c50-b80b-22b81513532c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:15.109707 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce8d38fb-afa2-4c50-b80b-22b81513532c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:15.112307 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-9b04b17f-72c4-4a9c-970e-d05bbeb0d2b5 req-8b9cb07b-adb0-4c6a-8c04-d1eca73b3ec2 service nova] Creating event network-vif-deleted:b3ee4f85-8bd6-4217-9d11-7140be55636a for instance 3d04a110-8ee9-4c6d-a68a-49e8493b8be2 on n-h2-862967-2 Oct 29 03:13:15.115673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce8d38fb-afa2-4c50-b80b-22b81513532c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:15.116192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce8d38fb-afa2-4c50-b80b-22b81513532c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:15.119520 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-9b04b17f-72c4-4a9c-970e-d05bbeb0d2b5 req-8b9cb07b-adb0-4c6a-8c04-d1eca73b3ec2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139039 Oct 29 03:13:15.120383 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2452/4709] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:13:15.201594 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ce8d38fb-afa2-4c50-b80b-22b81513532c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.165704 Oct 29 03:13:15.217481 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2258/4710] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:13:15 2022] GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad/os-volume_attachments => generated 25 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 03:13:15.453885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4bf9c020-75e5-4f36-9bce-6ec7ab19ac9d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:15.454871 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4bf9c020-75e5-4f36-9bce-6ec7ab19ac9d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:15.465235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bf9c020-75e5-4f36-9bce-6ec7ab19ac9d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:15.467476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bf9c020-75e5-4f36-9bce-6ec7ab19ac9d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:15.467935 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bf9c020-75e5-4f36-9bce-6ec7ab19ac9d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:15.473489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bf9c020-75e5-4f36-9bce-6ec7ab19ac9d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:15.477047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bf9c020-75e5-4f36-9bce-6ec7ab19ac9d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:15.477537 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bf9c020-75e5-4f36-9bce-6ec7ab19ac9d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:15.585107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bf9c020-75e5-4f36-9bce-6ec7ab19ac9d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:15.592190 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bf9c020-75e5-4f36-9bce-6ec7ab19ac9d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:15.592673 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bf9c020-75e5-4f36-9bce-6ec7ab19ac9d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:15.593142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-4bf9c020-75e5-4f36-9bce-6ec7ab19ac9d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lazy-loading 'fault' on Instance uuid 3d04a110-8ee9-4c6d-a68a-49e8493b8be2 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:13:15.610068 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a257a141-6651-4e7a-b2d5-55490eacdd67 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1377775118", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "7c67d1a9-4768-41b0-9ed7-2a2bf18af28b"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:13:15.723722 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4bf9c020-75e5-4f36-9bce-6ec7ab19ac9d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:15.745162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-a257a141-6651-4e7a-b2d5-55490eacdd67 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] validate_networks() for [('7c67d1a9-4768-41b0-9ed7-2a2bf18af28b', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:13:15.749443 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4bf9c020-75e5-4f36-9bce-6ec7ab19ac9d tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 200 len: 1312 microversion: 2.1 time: 0.304561 Oct 29 03:13:15.754932 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2453/4711] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:15 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 1312 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:16.775980 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e37b810d-2c84-4b65-b461-230ab23ce256 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:16.777494 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e37b810d-2c84-4b65-b461-230ab23ce256 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: 3d04a110-8ee9-4c6d-a68a-49e8493b8be2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:16.790230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e37b810d-2c84-4b65-b461-230ab23ce256 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:16.791067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e37b810d-2c84-4b65-b461-230ab23ce256 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:16.795207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e37b810d-2c84-4b65-b461-230ab23ce256 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:16.796589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e37b810d-2c84-4b65-b461-230ab23ce256 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:16.797494 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e37b810d-2c84-4b65-b461-230ab23ce256 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:16.798705 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e37b810d-2c84-4b65-b461-230ab23ce256 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:16.824406 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-e37b810d-2c84-4b65-b461-230ab23ce256 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] HTTP exception thrown: Instance 3d04a110-8ee9-4c6d-a68a-49e8493b8be2 could not be found. Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e37b810d-2c84-4b65-b461-230ab23ce256 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Request method failure captured: Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 HTTP/1.1 Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJkstpA5nrrKxuzeE1g4WEYzXnFix9I4sSziPbQz99dUgzomHyqw4KsPh1hn9KOAuebDlCdyeoB2kux2qwxeu2Z6mzS4iRWjeZGoPYlFLBau8TUQ57qGw9-PfGzzlfqexDt_gFdVfpeGXf1jJa4Rp1iRzDcKossbo6MCW_huYuDbUoI Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 1d97a655408746baabe76d9c8b0e3d64 Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-927401152 Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1d97a655408746baabe76d9c8b0e3d64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1d97a655408746baabe76d9c8b0e3d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1d97a655408746baabe76d9c8b0e3d64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1d97a655408746baabe76d9c8b0e3d64"}]}] Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServerRescueNegativeTestJSON-927401152 Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 1d97a655408746baabe76d9c8b0e3d64 Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-927401152 Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServerRescueNegativeTestJSON-927401152-project Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 06be3266f5774dc0acea36973521a5e5 Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServerRescueNegativeTestJSON-927401152-project Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 3d04a110-8ee9-4c6d-a68a-49e8493b8be2 could not be found. Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '3d04a110-8ee9-4c6d-a68a-49e8493b8be2'} Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d04a110-8ee9-4c6d-a68a-49e8493b8be2 could not be found. Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d04a110-8ee9-4c6d-a68a-49e8493b8be2 could not be found. Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:13:16.826670 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:16.832934 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:13:16.832934 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:16.832934 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:13:16.832934 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:13:16.832934 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:13:16.832934 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:13:16.832934 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d04a110-8ee9-4c6d-a68a-49e8493b8be2 could not be found. Oct 29 03:13:16.832934 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:13:16.836452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e37b810d-2c84-4b65-b461-230ab23ce256 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Returning 404 to user: Instance 3d04a110-8ee9-4c6d-a68a-49e8493b8be2 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:13:16.837621 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e37b810d-2c84-4b65-b461-230ab23ce256 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2" status: 404 len: 111 microversion: 2.1 time: 0.065822 Oct 29 03:13:16.838827 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2454/4712] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:16 2022] GET /compute/v2.1/servers/3d04a110-8ee9-4c6d-a68a-49e8493b8be2 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:13:16.855626 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-56f8c2e2-114d-4768-aff7-776be6849231 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:16.857321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-56f8c2e2-114d-4768-aff7-776be6849231 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:16.870587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-a257a141-6651-4e7a-b2d5-55490eacdd67 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:13:16.871528 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-a257a141-6651-4e7a-b2d5-55490eacdd67 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:13:16.871528 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-a257a141-6651-4e7a-b2d5-55490eacdd67 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:13:16.871727 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-a257a141-6651-4e7a-b2d5-55490eacdd67 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:13:16.872101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-a257a141-6651-4e7a-b2d5-55490eacdd67 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:13:16.883007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56f8c2e2-114d-4768-aff7-776be6849231 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:16.883446 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a257a141-6651-4e7a-b2d5-55490eacdd67 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:16.884126 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a257a141-6651-4e7a-b2d5-55490eacdd67 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:16.884890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a257a141-6651-4e7a-b2d5-55490eacdd67 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:16.885602 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56f8c2e2-114d-4768-aff7-776be6849231 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:16.886075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56f8c2e2-114d-4768-aff7-776be6849231 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:16.886383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a257a141-6651-4e7a-b2d5-55490eacdd67 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:16.887119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56f8c2e2-114d-4768-aff7-776be6849231 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:16.887614 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a257a141-6651-4e7a-b2d5-55490eacdd67 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:16.888291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a257a141-6651-4e7a-b2d5-55490eacdd67 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:16.889130 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56f8c2e2-114d-4768-aff7-776be6849231 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:16.891544 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56f8c2e2-114d-4768-aff7-776be6849231 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:16.911136 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-a257a141-6651-4e7a-b2d5-55490eacdd67 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Getting quotas for project ad74f13c0ac347418ed8445140531b7e. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:13:16.918006 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-a257a141-6651-4e7a-b2d5-55490eacdd67 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Getting quotas for user aee9c3cade7948b0abb8a47afe3e581e and project ad74f13c0ac347418ed8445140531b7e. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:13:16.933268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a257a141-6651-4e7a-b2d5-55490eacdd67 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:13:16.936861 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a257a141-6651-4e7a-b2d5-55490eacdd67 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: f0262838-6e13-4c99-be76-758460f510e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:13:16.941582 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:16.966973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-56f8c2e2-114d-4768-aff7-776be6849231 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:13:17.030654 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a257a141-6651-4e7a-b2d5-55490eacdd67 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.424410 Oct 29 03:13:17.038298 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2259/4713] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:13:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1433 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:13:17.043591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-30ee43bd-d4e1-40c4-9b4e-f50a17d72254 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:17.054368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-30ee43bd-d4e1-40c4-9b4e-f50a17d72254 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: f0262838-6e13-4c99-be76-758460f510e7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:17.175378 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-56f8c2e2-114d-4768-aff7-776be6849231 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94" status: 204 len: 0 microversion: 2.1 time: 0.331321 Oct 29 03:13:17.177336 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2455/4714] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:13:16 2022] DELETE /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:13:17.200266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d8d58d39-28f2-4f4b-aeb4-c5b0323ccbca tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:17.202319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d8d58d39-28f2-4f4b-aeb4-c5b0323ccbca tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:17.217958 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8d58d39-28f2-4f4b-aeb4-c5b0323ccbca tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:17.220140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8d58d39-28f2-4f4b-aeb4-c5b0323ccbca tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:17.220810 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8d58d39-28f2-4f4b-aeb4-c5b0323ccbca tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:17.222953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8d58d39-28f2-4f4b-aeb4-c5b0323ccbca tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:17.224071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8d58d39-28f2-4f4b-aeb4-c5b0323ccbca tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:17.228879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8d58d39-28f2-4f4b-aeb4-c5b0323ccbca tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:17.600466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-30ee43bd-d4e1-40c4-9b4e-f50a17d72254 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:17.609325 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-30ee43bd-d4e1-40c4-9b4e-f50a17d72254 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7" status: 200 len: 1218 microversion: 2.1 time: 0.569650 Oct 29 03:13:17.615252 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2260/4715] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:17 2022] GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7 => generated 1218 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:18.491989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d8d58d39-28f2-4f4b-aeb4-c5b0323ccbca tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:18.502011 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d8d58d39-28f2-4f4b-aeb4-c5b0323ccbca tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94" status: 200 len: 1523 microversion: 2.1 time: 1.318166 Oct 29 03:13:18.518885 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2456/4716] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:17 2022] GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 => generated 1523 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:18.643007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ced66d8e-c9a7-444d-8220-ebbbc9344e91 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:18.644228 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ced66d8e-c9a7-444d-8220-ebbbc9344e91 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: f0262838-6e13-4c99-be76-758460f510e7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:18.663772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ced66d8e-c9a7-444d-8220-ebbbc9344e91 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:18.665214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ced66d8e-c9a7-444d-8220-ebbbc9344e91 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:18.665667 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ced66d8e-c9a7-444d-8220-ebbbc9344e91 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:18.666435 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ced66d8e-c9a7-444d-8220-ebbbc9344e91 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:18.666903 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ced66d8e-c9a7-444d-8220-ebbbc9344e91 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:18.669477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ced66d8e-c9a7-444d-8220-ebbbc9344e91 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:18.918800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ced66d8e-c9a7-444d-8220-ebbbc9344e91 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:18.941361 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ced66d8e-c9a7-444d-8220-ebbbc9344e91 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7" status: 200 len: 1270 microversion: 2.1 time: 0.299241 Oct 29 03:13:18.956554 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2261/4717] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:18 2022] GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7 => generated 1270 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:19.534873 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-84e7b23b-9cc8-4446-b7b8-7c1b2574e67b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:19.536373 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-84e7b23b-9cc8-4446-b7b8-7c1b2574e67b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:19.553824 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e5a2bab3-73cd-498c-b08c-d49e81de88eb tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:19.554331 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e5a2bab3-73cd-498c-b08c-d49e81de88eb tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:19.557266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-84e7b23b-9cc8-4446-b7b8-7c1b2574e67b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:19.558008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-84e7b23b-9cc8-4446-b7b8-7c1b2574e67b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:19.559610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-84e7b23b-9cc8-4446-b7b8-7c1b2574e67b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:19.560480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-84e7b23b-9cc8-4446-b7b8-7c1b2574e67b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:19.565110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5a2bab3-73cd-498c-b08c-d49e81de88eb tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:19.565873 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-84e7b23b-9cc8-4446-b7b8-7c1b2574e67b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:19.566646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-84e7b23b-9cc8-4446-b7b8-7c1b2574e67b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:19.571674 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5a2bab3-73cd-498c-b08c-d49e81de88eb tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:19.572226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5a2bab3-73cd-498c-b08c-d49e81de88eb tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:19.573034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5a2bab3-73cd-498c-b08c-d49e81de88eb tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:19.574001 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5a2bab3-73cd-498c-b08c-d49e81de88eb tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:19.574432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5a2bab3-73cd-498c-b08c-d49e81de88eb tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:19.622656 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-e5a2bab3-73cd-498c-b08c-d49e81de88eb tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] HTTP exception thrown: Instance 659587f7-4fe6-4f7e-9f2d-5581cf3b169e could not be found. Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e5a2bab3-73cd-498c-b08c-d49e81de88eb tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Request method failure captured: Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e HTTP/1.1 Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJjKfda75b0pK70-1QXV8FG9LaFMExKiAhRA5WbJMc8e3WmfYg16rfnbph7_l5MUUwyIfa7l-BwMxMXmQnZKFai0PhtrxzZeOOL_kgJDWXHWhtAht76gGVf4wldFhwTTvnxG2gXJrHNQT-5dSS2YaMBC_A4KNuLwMY7IpgTDJ9usUkk Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: f4853225daef418bb782b4f9f6d1382c Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-AttachVolumeTestJSON-706277848 Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f4853225daef418bb782b4f9f6d1382c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f4853225daef418bb782b4f9f6d1382c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f4853225daef418bb782b4f9f6d1382c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f4853225daef418bb782b4f9f6d1382c"}]}] Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-AttachVolumeTestJSON-706277848 Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: f4853225daef418bb782b4f9f6d1382c Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-AttachVolumeTestJSON-706277848 Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-AttachVolumeTestJSON-706277848-project Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 494c556b424a4fa388680ab08a340a1d Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-AttachVolumeTestJSON-706277848-project Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 659587f7-4fe6-4f7e-9f2d-5581cf3b169e could not be found. Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '659587f7-4fe6-4f7e-9f2d-5581cf3b169e'} Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 659587f7-4fe6-4f7e-9f2d-5581cf3b169e could not be found. Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:13:19.625389 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:13:19.632455 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 659587f7-4fe6-4f7e-9f2d-5581cf3b169e could not be found. Oct 29 03:13:19.632455 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:13:19.632455 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:19.632455 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:13:19.632455 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:19.632455 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:13:19.632455 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:13:19.632455 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:13:19.632455 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:13:19.632455 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 659587f7-4fe6-4f7e-9f2d-5581cf3b169e could not be found. Oct 29 03:13:19.632455 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:13:19.634713 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e5a2bab3-73cd-498c-b08c-d49e81de88eb tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Returning 404 to user: Instance 659587f7-4fe6-4f7e-9f2d-5581cf3b169e could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:13:19.636003 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e5a2bab3-73cd-498c-b08c-d49e81de88eb tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "DELETE /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e" status: 404 len: 111 microversion: 2.1 time: 0.088402 Oct 29 03:13:19.637436 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2262/4718] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:13:19 2022] DELETE /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:13:19.655224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7d2c88f1-e3a3-45e6-9bca-232bcf26ee7b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:19.658418 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7d2c88f1-e3a3-45e6-9bca-232bcf26ee7b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 659587f7-4fe6-4f7e-9f2d-5581cf3b169e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:19.679393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7d2c88f1-e3a3-45e6-9bca-232bcf26ee7b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:19.680093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7d2c88f1-e3a3-45e6-9bca-232bcf26ee7b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:19.680793 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7d2c88f1-e3a3-45e6-9bca-232bcf26ee7b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:19.685663 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7d2c88f1-e3a3-45e6-9bca-232bcf26ee7b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:19.686374 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7d2c88f1-e3a3-45e6-9bca-232bcf26ee7b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:19.687341 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7d2c88f1-e3a3-45e6-9bca-232bcf26ee7b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:19.738364 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-7d2c88f1-e3a3-45e6-9bca-232bcf26ee7b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] HTTP exception thrown: Instance 659587f7-4fe6-4f7e-9f2d-5581cf3b169e could not be found. Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7d2c88f1-e3a3-45e6-9bca-232bcf26ee7b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Request method failure captured: Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e HTTP/1.1 Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJjKfda75b0pK70-1QXV8FG9LaFMExKiAhRA5WbJMc8e3WmfYg16rfnbph7_l5MUUwyIfa7l-BwMxMXmQnZKFai0PhtrxzZeOOL_kgJDWXHWhtAht76gGVf4wldFhwTTvnxG2gXJrHNQT-5dSS2YaMBC_A4KNuLwMY7IpgTDJ9usUkk Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: f4853225daef418bb782b4f9f6d1382c Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-AttachVolumeTestJSON-706277848 Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f4853225daef418bb782b4f9f6d1382c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f4853225daef418bb782b4f9f6d1382c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f4853225daef418bb782b4f9f6d1382c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f4853225daef418bb782b4f9f6d1382c"}]}] Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-AttachVolumeTestJSON-706277848 Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: f4853225daef418bb782b4f9f6d1382c Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-AttachVolumeTestJSON-706277848 Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-AttachVolumeTestJSON-706277848-project Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 494c556b424a4fa388680ab08a340a1d Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-AttachVolumeTestJSON-706277848-project Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 659587f7-4fe6-4f7e-9f2d-5581cf3b169e could not be found. Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '659587f7-4fe6-4f7e-9f2d-5581cf3b169e'} Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 659587f7-4fe6-4f7e-9f2d-5581cf3b169e could not be found. Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 659587f7-4fe6-4f7e-9f2d-5581cf3b169e could not be found. Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:19.740576 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:13:19.749184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:19.749184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:13:19.749184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:13:19.749184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:13:19.749184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:13:19.749184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 659587f7-4fe6-4f7e-9f2d-5581cf3b169e could not be found. Oct 29 03:13:19.749184 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:13:19.752299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7d2c88f1-e3a3-45e6-9bca-232bcf26ee7b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Returning 404 to user: Instance 659587f7-4fe6-4f7e-9f2d-5581cf3b169e could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:13:19.753473 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7d2c88f1-e3a3-45e6-9bca-232bcf26ee7b tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e" status: 404 len: 111 microversion: 2.1 time: 0.111951 Oct 29 03:13:19.754071 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2263/4719] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:19 2022] GET /compute/v2.1/servers/659587f7-4fe6-4f7e-9f2d-5581cf3b169e => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:13:19.969484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5234abb5-c070-4e26-8946-bc82437627cd tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:19.970413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5234abb5-c070-4e26-8946-bc82437627cd tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: f0262838-6e13-4c99-be76-758460f510e7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:19.981203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5234abb5-c070-4e26-8946-bc82437627cd tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:19.990464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5234abb5-c070-4e26-8946-bc82437627cd tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:19.995027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5234abb5-c070-4e26-8946-bc82437627cd tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:19.996160 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5234abb5-c070-4e26-8946-bc82437627cd tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:19.996850 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5234abb5-c070-4e26-8946-bc82437627cd tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:19.998211 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5234abb5-c070-4e26-8946-bc82437627cd tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:20.142910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5234abb5-c070-4e26-8946-bc82437627cd tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:20.145494 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:20.162735 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5234abb5-c070-4e26-8946-bc82437627cd tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7" status: 200 len: 1276 microversion: 2.1 time: 0.197242 Oct 29 03:13:20.169465 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2264/4720] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:19 2022] GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7 => generated 1276 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:20.333793 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-84e7b23b-9cc8-4446-b7b8-7c1b2574e67b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:20.345382 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-84e7b23b-9cc8-4446-b7b8-7c1b2574e67b tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94" status: 200 len: 1523 microversion: 2.1 time: 0.821723 Oct 29 03:13:20.360545 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2457/4721] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:19 2022] GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 => generated 1523 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:21.200484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7a29bcdb-8663-4568-9ca6-a7a4abb65354 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:21.201362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7a29bcdb-8663-4568-9ca6-a7a4abb65354 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: f0262838-6e13-4c99-be76-758460f510e7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:21.222109 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a29bcdb-8663-4568-9ca6-a7a4abb65354 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:21.222826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a29bcdb-8663-4568-9ca6-a7a4abb65354 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:21.225007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a29bcdb-8663-4568-9ca6-a7a4abb65354 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:21.226944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a29bcdb-8663-4568-9ca6-a7a4abb65354 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:21.234950 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a29bcdb-8663-4568-9ca6-a7a4abb65354 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:21.235883 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a29bcdb-8663-4568-9ca6-a7a4abb65354 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:21.379866 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-13e6a4b8-777c-46cb-83bc-cd3dedecbe62 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:21.384932 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-13e6a4b8-777c-46cb-83bc-cd3dedecbe62 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:21.404394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13e6a4b8-777c-46cb-83bc-cd3dedecbe62 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:21.409164 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13e6a4b8-777c-46cb-83bc-cd3dedecbe62 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:21.410062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13e6a4b8-777c-46cb-83bc-cd3dedecbe62 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:21.412835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13e6a4b8-777c-46cb-83bc-cd3dedecbe62 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:21.419299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13e6a4b8-777c-46cb-83bc-cd3dedecbe62 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:21.420216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13e6a4b8-777c-46cb-83bc-cd3dedecbe62 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:21.816883 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7a29bcdb-8663-4568-9ca6-a7a4abb65354 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:21.840607 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7a29bcdb-8663-4568-9ca6-a7a4abb65354 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7" status: 200 len: 1276 microversion: 2.1 time: 0.649302 Oct 29 03:13:21.846087 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2265/4722] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:21 2022] GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7 => generated 1276 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:22.214771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-13e6a4b8-777c-46cb-83bc-cd3dedecbe62 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:22.243896 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-13e6a4b8-777c-46cb-83bc-cd3dedecbe62 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94" status: 200 len: 1523 microversion: 2.1 time: 0.871527 Oct 29 03:13:22.253445 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2458/4723] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:21 2022] GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 => generated 1523 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:22.868441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8f6337f7-3e80-4085-8223-50b235806fff tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:22.875004 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8f6337f7-3e80-4085-8223-50b235806fff tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: f0262838-6e13-4c99-be76-758460f510e7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:22.898166 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f6337f7-3e80-4085-8223-50b235806fff tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:22.905768 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f6337f7-3e80-4085-8223-50b235806fff tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:22.906925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f6337f7-3e80-4085-8223-50b235806fff tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:22.908762 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f6337f7-3e80-4085-8223-50b235806fff tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:22.909929 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f6337f7-3e80-4085-8223-50b235806fff tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:22.910942 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f6337f7-3e80-4085-8223-50b235806fff tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:23.280610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f3059b56-ea58-424f-af24-4baf2b1d0f91 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:23.286489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f3059b56-ea58-424f-af24-4baf2b1d0f91 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:23.308818 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3059b56-ea58-424f-af24-4baf2b1d0f91 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:23.309748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3059b56-ea58-424f-af24-4baf2b1d0f91 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:23.311994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3059b56-ea58-424f-af24-4baf2b1d0f91 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:23.316706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3059b56-ea58-424f-af24-4baf2b1d0f91 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:23.317843 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3059b56-ea58-424f-af24-4baf2b1d0f91 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:23.324379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3059b56-ea58-424f-af24-4baf2b1d0f91 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:23.758068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f3059b56-ea58-424f-af24-4baf2b1d0f91 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06be3266f5774dc0acea36973521a5e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d97a655408746baabe76d9c8b0e3d64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:23.810668 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f3059b56-ea58-424f-af24-4baf2b1d0f91 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94" status: 200 len: 1481 microversion: 2.1 time: 0.529027 Oct 29 03:13:23.814063 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2459/4724] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:23 2022] GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 => generated 1481 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:23.844395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-10fdd41b-d1be-43cb-a942-028ff18479c9 req-99a3ea41-04fd-4eaa-9f48-39502021ebec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab5ee183-e4bd-4de0-bb66-cda1ce9ead94", "name": "network-vif-deleted", "tag": "c010f3e0-ed80-4c2d-8830-85d67ad0153a"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:13:23.892361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-10fdd41b-d1be-43cb-a942-028ff18479c9 req-99a3ea41-04fd-4eaa-9f48-39502021ebec service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:23.892885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-10fdd41b-d1be-43cb-a942-028ff18479c9 req-99a3ea41-04fd-4eaa-9f48-39502021ebec service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:23.896853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-10fdd41b-d1be-43cb-a942-028ff18479c9 req-99a3ea41-04fd-4eaa-9f48-39502021ebec service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:23.931802 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-10fdd41b-d1be-43cb-a942-028ff18479c9 req-99a3ea41-04fd-4eaa-9f48-39502021ebec service nova] Creating event network-vif-deleted:c010f3e0-ed80-4c2d-8830-85d67ad0153a for instance ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 on n-h1-862967-2 Oct 29 03:13:23.965642 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-10fdd41b-d1be-43cb-a942-028ff18479c9 req-99a3ea41-04fd-4eaa-9f48-39502021ebec service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149517 Oct 29 03:13:23.966995 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2460/4725] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:13:24.028547 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8f6337f7-3e80-4085-8223-50b235806fff tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:24.039225 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8f6337f7-3e80-4085-8223-50b235806fff tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7" status: 200 len: 1318 microversion: 2.1 time: 1.178115 Oct 29 03:13:24.041856 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2266/4726] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:22 2022] GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7 => generated 1318 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:24.849439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ef15c480-f795-428d-8d24-aebb657645e6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:24.851459 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ef15c480-f795-428d-8d24-aebb657645e6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] [instance: ab5ee183-e4bd-4de0-bb66-cda1ce9ead94] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:24.890202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef15c480-f795-428d-8d24-aebb657645e6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:24.891979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef15c480-f795-428d-8d24-aebb657645e6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:24.893112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef15c480-f795-428d-8d24-aebb657645e6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:24.895603 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef15c480-f795-428d-8d24-aebb657645e6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:24.896805 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef15c480-f795-428d-8d24-aebb657645e6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:24.897900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef15c480-f795-428d-8d24-aebb657645e6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:24.928884 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-ef15c480-f795-428d-8d24-aebb657645e6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] HTTP exception thrown: Instance ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 could not be found. Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ef15c480-f795-428d-8d24-aebb657645e6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Request method failure captured: Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 HTTP/1.1 Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJkstpA5nrrKxuzeE1g4WEYzXnFix9I4sSziPbQz99dUgzomHyqw4KsPh1hn9KOAuebDlCdyeoB2kux2qwxeu2Z6mzS4iRWjeZGoPYlFLBau8TUQ57qGw9-PfGzzlfqexDt_gFdVfpeGXf1jJa4Rp1iRzDcKossbo6MCW_huYuDbUoI Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 1d97a655408746baabe76d9c8b0e3d64 Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-927401152 Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1d97a655408746baabe76d9c8b0e3d64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/1d97a655408746baabe76d9c8b0e3d64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_1d97a655408746baabe76d9c8b0e3d64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/1d97a655408746baabe76d9c8b0e3d64"}]}] Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServerRescueNegativeTestJSON-927401152 Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 1d97a655408746baabe76d9c8b0e3d64 Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-927401152 Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServerRescueNegativeTestJSON-927401152-project Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 06be3266f5774dc0acea36973521a5e5 Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServerRescueNegativeTestJSON-927401152-project Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 could not be found. Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'ab5ee183-e4bd-4de0-bb66-cda1ce9ead94'} Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 could not be found. Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 could not be found. Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:13:24.933084 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:24.939454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:13:24.939454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:24.939454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:13:24.939454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:13:24.939454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:13:24.939454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:13:24.939454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 could not be found. Oct 29 03:13:24.939454 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:13:24.944015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ef15c480-f795-428d-8d24-aebb657645e6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] Returning 404 to user: Instance ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:13:24.945283 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ef15c480-f795-428d-8d24-aebb657645e6 tempest-ServerRescueNegativeTestJSON-927401152 tempest-ServerRescueNegativeTestJSON-927401152-project] 10.222.0.46 "GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94" status: 404 len: 111 microversion: 2.1 time: 0.101297 Oct 29 03:13:24.951756 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2461/4727] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:24 2022] GET /compute/v2.1/servers/ab5ee183-e4bd-4de0-bb66-cda1ce9ead94 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:13:25.066671 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1d3c509b-f2e4-4477-9692-115449b0083c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:25.072070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1d3c509b-f2e4-4477-9692-115449b0083c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: f0262838-6e13-4c99-be76-758460f510e7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:25.120499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d3c509b-f2e4-4477-9692-115449b0083c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:25.122165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d3c509b-f2e4-4477-9692-115449b0083c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:25.124013 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d3c509b-f2e4-4477-9692-115449b0083c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:25.126276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d3c509b-f2e4-4477-9692-115449b0083c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:25.129867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d3c509b-f2e4-4477-9692-115449b0083c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:25.131799 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d3c509b-f2e4-4477-9692-115449b0083c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:25.286560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-ad5006f6-b8fb-4ebb-9508-5545aebe0f3a req-036bfffa-6310-4b0d-8f02-9bf29f6b2a2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0262838-6e13-4c99-be76-758460f510e7", "tag": "f7eb50fa-e046-4ceb-b8d2-38a47bc5eabd"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:13:25.299861 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ad5006f6-b8fb-4ebb-9508-5545aebe0f3a req-036bfffa-6310-4b0d-8f02-9bf29f6b2a2f service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:25.300558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ad5006f6-b8fb-4ebb-9508-5545aebe0f3a req-036bfffa-6310-4b0d-8f02-9bf29f6b2a2f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:25.301379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ad5006f6-b8fb-4ebb-9508-5545aebe0f3a req-036bfffa-6310-4b0d-8f02-9bf29f6b2a2f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:25.325207 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-ad5006f6-b8fb-4ebb-9508-5545aebe0f3a req-036bfffa-6310-4b0d-8f02-9bf29f6b2a2f service nova] Creating event network-changed:f7eb50fa-e046-4ceb-b8d2-38a47bc5eabd for instance f0262838-6e13-4c99-be76-758460f510e7 on n-h2-862967-2 Oct 29 03:13:25.335998 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-ad5006f6-b8fb-4ebb-9508-5545aebe0f3a req-036bfffa-6310-4b0d-8f02-9bf29f6b2a2f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051854 Oct 29 03:13:25.338694 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2462/4728] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:13:25.608749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5788e18c-0127-40eb-b181-841625ba0531 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:25.610027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5788e18c-0127-40eb-b181-841625ba0531 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:25.630926 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5788e18c-0127-40eb-b181-841625ba0531 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:25.631539 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5788e18c-0127-40eb-b181-841625ba0531 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:25.632063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5788e18c-0127-40eb-b181-841625ba0531 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:25.635075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5788e18c-0127-40eb-b181-841625ba0531 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:25.635640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5788e18c-0127-40eb-b181-841625ba0531 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:25.636152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5788e18c-0127-40eb-b181-841625ba0531 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:25.677189 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-5788e18c-0127-40eb-b181-841625ba0531 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] HTTP exception thrown: Instance 05f5328d-7d86-44f3-bb9f-8d06de0daa17 could not be found. Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5788e18c-0127-40eb-b181-841625ba0531 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Request method failure captured: Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 HTTP/1.1 Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJjKfda75b0pK70-1QXV8FG9LaFMExKiAhRA5WbJMc8e3WmfYg16rfnbph7_l5MUUwyIfa7l-BwMxMXmQnZKFai0PhtrxzZeOOL_kgJDWXHWhtAht76gGVf4wldFhwTTvnxG2gXJrHNQT-5dSS2YaMBC_A4KNuLwMY7IpgTDJ9usUkk Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: f4853225daef418bb782b4f9f6d1382c Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-AttachVolumeTestJSON-706277848 Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f4853225daef418bb782b4f9f6d1382c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f4853225daef418bb782b4f9f6d1382c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f4853225daef418bb782b4f9f6d1382c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f4853225daef418bb782b4f9f6d1382c"}]}] Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-AttachVolumeTestJSON-706277848 Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: f4853225daef418bb782b4f9f6d1382c Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-AttachVolumeTestJSON-706277848 Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-AttachVolumeTestJSON-706277848-project Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 494c556b424a4fa388680ab08a340a1d Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-AttachVolumeTestJSON-706277848-project Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 05f5328d-7d86-44f3-bb9f-8d06de0daa17 could not be found. Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '05f5328d-7d86-44f3-bb9f-8d06de0daa17'} Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05f5328d-7d86-44f3-bb9f-8d06de0daa17 could not be found. Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:13:25.681159 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:13:25.690523 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05f5328d-7d86-44f3-bb9f-8d06de0daa17 could not be found. Oct 29 03:13:25.690523 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:13:25.690523 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:25.690523 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:13:25.690523 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:25.690523 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:13:25.690523 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:13:25.690523 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:13:25.690523 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:13:25.690523 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05f5328d-7d86-44f3-bb9f-8d06de0daa17 could not be found. Oct 29 03:13:25.690523 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:13:25.690523 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5788e18c-0127-40eb-b181-841625ba0531 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Returning 404 to user: Instance 05f5328d-7d86-44f3-bb9f-8d06de0daa17 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:13:25.690523 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5788e18c-0127-40eb-b181-841625ba0531 tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "DELETE /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 404 len: 111 microversion: 2.1 time: 0.082949 Oct 29 03:13:25.690523 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2463/4729] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:13:25 2022] DELETE /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:13:25.697344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5da85cff-213b-4846-845c-53f5e3c3613e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:25.698088 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5da85cff-213b-4846-845c-53f5e3c3613e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] [instance: 05f5328d-7d86-44f3-bb9f-8d06de0daa17] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:25.712140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5da85cff-213b-4846-845c-53f5e3c3613e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:25.712828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5da85cff-213b-4846-845c-53f5e3c3613e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:25.713651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5da85cff-213b-4846-845c-53f5e3c3613e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:25.714896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5da85cff-213b-4846-845c-53f5e3c3613e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:25.715678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5da85cff-213b-4846-845c-53f5e3c3613e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:25.716265 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5da85cff-213b-4846-845c-53f5e3c3613e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:25.744372 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-5da85cff-213b-4846-845c-53f5e3c3613e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] HTTP exception thrown: Instance 05f5328d-7d86-44f3-bb9f-8d06de0daa17 could not be found. Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5da85cff-213b-4846-845c-53f5e3c3613e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Request method failure captured: Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 HTTP/1.1 Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJjKfda75b0pK70-1QXV8FG9LaFMExKiAhRA5WbJMc8e3WmfYg16rfnbph7_l5MUUwyIfa7l-BwMxMXmQnZKFai0PhtrxzZeOOL_kgJDWXHWhtAht76gGVf4wldFhwTTvnxG2gXJrHNQT-5dSS2YaMBC_A4KNuLwMY7IpgTDJ9usUkk Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: f4853225daef418bb782b4f9f6d1382c Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-AttachVolumeTestJSON-706277848 Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f4853225daef418bb782b4f9f6d1382c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f4853225daef418bb782b4f9f6d1382c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f4853225daef418bb782b4f9f6d1382c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f4853225daef418bb782b4f9f6d1382c"}]}] Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-AttachVolumeTestJSON-706277848 Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: f4853225daef418bb782b4f9f6d1382c Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-AttachVolumeTestJSON-706277848 Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-AttachVolumeTestJSON-706277848-project Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 494c556b424a4fa388680ab08a340a1d Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-AttachVolumeTestJSON-706277848-project Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 05f5328d-7d86-44f3-bb9f-8d06de0daa17 could not be found. Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '05f5328d-7d86-44f3-bb9f-8d06de0daa17'} Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05f5328d-7d86-44f3-bb9f-8d06de0daa17 could not be found. Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05f5328d-7d86-44f3-bb9f-8d06de0daa17 could not be found. Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:25.748193 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:13:25.753368 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:25.753368 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:13:25.753368 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:13:25.753368 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:13:25.753368 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:13:25.753368 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05f5328d-7d86-44f3-bb9f-8d06de0daa17 could not be found. Oct 29 03:13:25.753368 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:13:25.756586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5da85cff-213b-4846-845c-53f5e3c3613e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] Returning 404 to user: Instance 05f5328d-7d86-44f3-bb9f-8d06de0daa17 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:13:25.757669 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5da85cff-213b-4846-845c-53f5e3c3613e tempest-AttachVolumeTestJSON-706277848 tempest-AttachVolumeTestJSON-706277848-project] 10.222.0.46 "GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17" status: 404 len: 111 microversion: 2.1 time: 0.065514 Oct 29 03:13:25.766167 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2464/4730] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:25 2022] GET /compute/v2.1/servers/05f5328d-7d86-44f3-bb9f-8d06de0daa17 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:13:26.129467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1d3c509b-f2e4-4477-9692-115449b0083c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:26.143607 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1d3c509b-f2e4-4477-9692-115449b0083c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7" status: 200 len: 1318 microversion: 2.1 time: 1.082428 Oct 29 03:13:26.146684 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2267/4731] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:25 2022] GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7 => generated 1318 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:27.167609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-66780b49-e112-45b0-94af-3e915330f2b1 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:27.171175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-66780b49-e112-45b0-94af-3e915330f2b1 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: f0262838-6e13-4c99-be76-758460f510e7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:27.192580 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66780b49-e112-45b0-94af-3e915330f2b1 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:27.193145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66780b49-e112-45b0-94af-3e915330f2b1 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:27.199643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66780b49-e112-45b0-94af-3e915330f2b1 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:27.200466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66780b49-e112-45b0-94af-3e915330f2b1 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:27.201157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66780b49-e112-45b0-94af-3e915330f2b1 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:27.201603 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66780b49-e112-45b0-94af-3e915330f2b1 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:27.986274 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-66780b49-e112-45b0-94af-3e915330f2b1 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:27.996286 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-66780b49-e112-45b0-94af-3e915330f2b1 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7" status: 200 len: 1318 microversion: 2.1 time: 0.833125 Oct 29 03:13:27.996929 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2465/4732] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:27 2022] GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7 => generated 1318 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:29.022479 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5ff9e7de-9813-44ee-8b71-f67ccd2c3300 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:29.023429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5ff9e7de-9813-44ee-8b71-f67ccd2c3300 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: f0262838-6e13-4c99-be76-758460f510e7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:29.035129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:29.037868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=8 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:29.041493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ff9e7de-9813-44ee-8b71-f67ccd2c3300 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:29.042639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ff9e7de-9813-44ee-8b71-f67ccd2c3300 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:29.043523 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ff9e7de-9813-44ee-8b71-f67ccd2c3300 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:29.044434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ff9e7de-9813-44ee-8b71-f67ccd2c3300 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:29.045166 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ff9e7de-9813-44ee-8b71-f67ccd2c3300 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:29.045812 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ff9e7de-9813-44ee-8b71-f67ccd2c3300 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:29.421585 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5ff9e7de-9813-44ee-8b71-f67ccd2c3300 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:29.437614 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5ff9e7de-9813-44ee-8b71-f67ccd2c3300 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7" status: 200 len: 1318 microversion: 2.1 time: 0.420913 Oct 29 03:13:29.452338 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2268/4733] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:29 2022] GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7 => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:30.470031 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7ad8457f-0f65-44fc-809f-5d177d8379eb tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:30.470507 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7ad8457f-0f65-44fc-809f-5d177d8379eb tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: f0262838-6e13-4c99-be76-758460f510e7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:30.476048 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:30.483383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ad8457f-0f65-44fc-809f-5d177d8379eb tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:30.484244 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ad8457f-0f65-44fc-809f-5d177d8379eb tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:30.484733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ad8457f-0f65-44fc-809f-5d177d8379eb tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:30.485503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ad8457f-0f65-44fc-809f-5d177d8379eb tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:30.486319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ad8457f-0f65-44fc-809f-5d177d8379eb tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:30.486757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ad8457f-0f65-44fc-809f-5d177d8379eb tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:31.252230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7ad8457f-0f65-44fc-809f-5d177d8379eb tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:31.263770 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7ad8457f-0f65-44fc-809f-5d177d8379eb tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7" status: 200 len: 1318 microversion: 2.1 time: 0.801930 Oct 29 03:13:31.282481 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2466/4734] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:30 2022] GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7 => generated 1318 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:32.289846 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e10be953-a52e-49de-ae46-112c158e6a9b tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:32.290796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e10be953-a52e-49de-ae46-112c158e6a9b tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: f0262838-6e13-4c99-be76-758460f510e7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:32.320450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e10be953-a52e-49de-ae46-112c158e6a9b tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:32.320981 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e10be953-a52e-49de-ae46-112c158e6a9b tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:32.321503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e10be953-a52e-49de-ae46-112c158e6a9b tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:32.322334 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e10be953-a52e-49de-ae46-112c158e6a9b tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:32.322791 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e10be953-a52e-49de-ae46-112c158e6a9b tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:32.334653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e10be953-a52e-49de-ae46-112c158e6a9b tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:32.764509 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e10be953-a52e-49de-ae46-112c158e6a9b tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:32.774332 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e10be953-a52e-49de-ae46-112c158e6a9b tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7" status: 200 len: 1318 microversion: 2.1 time: 0.490447 Oct 29 03:13:32.777594 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2269/4735] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:32 2022] GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7 => generated 1318 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:33.803103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a4cc5a88-0998-4aba-ac9c-c47e0f821689 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:33.803761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a4cc5a88-0998-4aba-ac9c-c47e0f821689 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: f0262838-6e13-4c99-be76-758460f510e7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:33.818226 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a4cc5a88-0998-4aba-ac9c-c47e0f821689 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:33.821768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a4cc5a88-0998-4aba-ac9c-c47e0f821689 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:33.822439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a4cc5a88-0998-4aba-ac9c-c47e0f821689 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:33.825691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a4cc5a88-0998-4aba-ac9c-c47e0f821689 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:33.827491 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a4cc5a88-0998-4aba-ac9c-c47e0f821689 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:33.828093 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a4cc5a88-0998-4aba-ac9c-c47e0f821689 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:34.478016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a4cc5a88-0998-4aba-ac9c-c47e0f821689 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:34.487487 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a4cc5a88-0998-4aba-ac9c-c47e0f821689 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7" status: 200 len: 1318 microversion: 2.1 time: 0.689993 Oct 29 03:13:34.492181 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2467/4736] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:33 2022] GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7 => generated 1318 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:35.522095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3739dce9-f0f1-45a8-bc77-4e515ed7f90f tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:35.523735 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3739dce9-f0f1-45a8-bc77-4e515ed7f90f tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: f0262838-6e13-4c99-be76-758460f510e7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:35.537271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:35.542034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3739dce9-f0f1-45a8-bc77-4e515ed7f90f tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:35.545122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3739dce9-f0f1-45a8-bc77-4e515ed7f90f tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:35.547241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3739dce9-f0f1-45a8-bc77-4e515ed7f90f tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:35.548406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3739dce9-f0f1-45a8-bc77-4e515ed7f90f tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:35.549603 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3739dce9-f0f1-45a8-bc77-4e515ed7f90f tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:35.550473 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3739dce9-f0f1-45a8-bc77-4e515ed7f90f tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:36.142672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3739dce9-f0f1-45a8-bc77-4e515ed7f90f tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:36.151040 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3739dce9-f0f1-45a8-bc77-4e515ed7f90f tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7" status: 200 len: 1318 microversion: 2.1 time: 0.635919 Oct 29 03:13:36.151644 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2270/4737] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:35 2022] GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7 => generated 1318 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:36.246074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-a812e2cd-0f2c-4bf7-acb1-2f0373c1ee1e req-5c2a1aec-478c-4685-ae3e-f195191a2370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0262838-6e13-4c99-be76-758460f510e7", "name": "network-vif-plugged", "status": "completed", "tag": "f7eb50fa-e046-4ceb-b8d2-38a47bc5eabd"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:13:36.264030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a812e2cd-0f2c-4bf7-acb1-2f0373c1ee1e req-5c2a1aec-478c-4685-ae3e-f195191a2370 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:36.265210 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a812e2cd-0f2c-4bf7-acb1-2f0373c1ee1e req-5c2a1aec-478c-4685-ae3e-f195191a2370 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:36.266160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a812e2cd-0f2c-4bf7-acb1-2f0373c1ee1e req-5c2a1aec-478c-4685-ae3e-f195191a2370 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:36.296203 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-a812e2cd-0f2c-4bf7-acb1-2f0373c1ee1e req-5c2a1aec-478c-4685-ae3e-f195191a2370 service nova] Creating event network-vif-plugged:f7eb50fa-e046-4ceb-b8d2-38a47bc5eabd for instance f0262838-6e13-4c99-be76-758460f510e7 on n-h2-862967-2 Oct 29 03:13:36.310116 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-a812e2cd-0f2c-4bf7-acb1-2f0373c1ee1e req-5c2a1aec-478c-4685-ae3e-f195191a2370 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.414728 Oct 29 03:13:36.329893 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2468/4738] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:13:37.176493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9723e8f0-b8ca-4d36-a7a7-36df662dd887 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:37.177875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9723e8f0-b8ca-4d36-a7a7-36df662dd887 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: f0262838-6e13-4c99-be76-758460f510e7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:37.193862 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9723e8f0-b8ca-4d36-a7a7-36df662dd887 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:37.194582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9723e8f0-b8ca-4d36-a7a7-36df662dd887 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:37.197861 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9723e8f0-b8ca-4d36-a7a7-36df662dd887 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:37.200495 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9723e8f0-b8ca-4d36-a7a7-36df662dd887 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:37.201455 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9723e8f0-b8ca-4d36-a7a7-36df662dd887 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:37.203029 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9723e8f0-b8ca-4d36-a7a7-36df662dd887 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:37.795893 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9723e8f0-b8ca-4d36-a7a7-36df662dd887 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:37.824618 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9723e8f0-b8ca-4d36-a7a7-36df662dd887 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7" status: 200 len: 1318 microversion: 2.1 time: 0.648670 Oct 29 03:13:37.829079 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2271/4739] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:37 2022] GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7 => generated 1318 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:38.852744 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-12c04796-1c6d-4323-8e4b-e05f4ae4f994 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:38.853272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-12c04796-1c6d-4323-8e4b-e05f4ae4f994 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: f0262838-6e13-4c99-be76-758460f510e7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:38.867042 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12c04796-1c6d-4323-8e4b-e05f4ae4f994 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:38.867748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12c04796-1c6d-4323-8e4b-e05f4ae4f994 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:38.868633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12c04796-1c6d-4323-8e4b-e05f4ae4f994 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:38.877712 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12c04796-1c6d-4323-8e4b-e05f4ae4f994 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:38.878328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12c04796-1c6d-4323-8e4b-e05f4ae4f994 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:38.878801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12c04796-1c6d-4323-8e4b-e05f4ae4f994 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:39.525630 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-12c04796-1c6d-4323-8e4b-e05f4ae4f994 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:39.563547 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-12c04796-1c6d-4323-8e4b-e05f4ae4f994 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7" status: 200 len: 1507 microversion: 2.1 time: 0.713975 Oct 29 03:13:39.568288 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2469/4740] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:38 2022] GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7 => generated 1507 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:42.407969 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-daaa5d0e-369f-4d2e-946d-01082ee94f6e tempest-VolumesAdminNegativeTest-1372261999 tempest-VolumesAdminNegativeTest-1372261999-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "952e86d7-8355-40df-92ee-340ef31036c4"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:13:42.411353 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-daaa5d0e-369f-4d2e-946d-01082ee94f6e tempest-VolumesAdminNegativeTest-1372261999 tempest-VolumesAdminNegativeTest-1372261999-project-admin] [instance: f0262838-6e13-4c99-be76-758460f510e7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:42.423373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-daaa5d0e-369f-4d2e-946d-01082ee94f6e tempest-VolumesAdminNegativeTest-1372261999 tempest-VolumesAdminNegativeTest-1372261999-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:42.429604 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-daaa5d0e-369f-4d2e-946d-01082ee94f6e tempest-VolumesAdminNegativeTest-1372261999 tempest-VolumesAdminNegativeTest-1372261999-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:42.430579 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-daaa5d0e-369f-4d2e-946d-01082ee94f6e tempest-VolumesAdminNegativeTest-1372261999 tempest-VolumesAdminNegativeTest-1372261999-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:42.431658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-daaa5d0e-369f-4d2e-946d-01082ee94f6e tempest-VolumesAdminNegativeTest-1372261999 tempest-VolumesAdminNegativeTest-1372261999-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:42.433089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-daaa5d0e-369f-4d2e-946d-01082ee94f6e tempest-VolumesAdminNegativeTest-1372261999 tempest-VolumesAdminNegativeTest-1372261999-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:42.433685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-daaa5d0e-369f-4d2e-946d-01082ee94f6e tempest-VolumesAdminNegativeTest-1372261999 tempest-VolumesAdminNegativeTest-1372261999-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:42.542975 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-daaa5d0e-369f-4d2e-946d-01082ee94f6e tempest-VolumesAdminNegativeTest-1372261999 tempest-VolumesAdminNegativeTest-1372261999-project-admin] HTTP exception thrown: Volume fe246598-4785-4f0b-8a76-650f09674af0 could not be found. Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-daaa5d0e-369f-4d2e-946d-01082ee94f6e tempest-VolumesAdminNegativeTest-1372261999 tempest-VolumesAdminNegativeTest-1372261999-project-admin] Request method failure captured: Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: request: PUT /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7/os-volume_attachments/fe246598-4785-4f0b-8a76-650f09674af0 HTTP/1.1 Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 74 Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJnmOkgmvk2wLMRLgNtgFf27JK_i6r7ouPv7WXDlztTXouJVZ2U4TubAbjK-b4NQRmG4EqP1Nz_1hRafllFaxnOyYHIgdiszz8EaWq6_n_cg7DBO2q-R3fu3lCw17naL-HyzWkyszk3Wetur9grD6GNu8BLedI_Ppo-K4ai8GwosyLw Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 3797f0908776421bae0663e1a358a6cd Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-VolumesAdminNegativeTest-1372261999 Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: X-Role: admin,reader,member Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: admin,reader,member Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3797f0908776421bae0663e1a358a6cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3797f0908776421bae0663e1a358a6cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3797f0908776421bae0663e1a358a6cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3797f0908776421bae0663e1a358a6cd"}]}] Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-VolumesAdminNegativeTest-1372261999 Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 3797f0908776421bae0663e1a358a6cd Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1372261999 Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-VolumesAdminNegativeTest-1372261999-project-admin Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 011f0bf68ed34ad48e2d658e18d857d8 Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-VolumesAdminNegativeTest-1372261999-project-admin Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: {"volumeAttachment": {"volumeId": "952e86d7-8355-40df-92ee-340ef31036c4"}} Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: exception: Volume fe246598-4785-4f0b-8a76-650f09674af0 could not be found. Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'server_id': 'f0262838-6e13-4c99-be76-758460f510e7', 'id': 'fe246598-4785-4f0b-8a76-650f09674af0', 'body': {'volumeAttachment': {'volumeId': '952e86d7-8355-40df-92ee-340ef31036c4'}}} Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fe246598-4785-4f0b-8a76-650f09674af0 could not be found. (HTTP 404) (Request-ID: req-dbd6b3ae-e809-4688-912a-b129058b1ec7) Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 03:13:42.545627 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fe246598-4785-4f0b-8a76-650f09674af0 could not be found. Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fe246598-4785-4f0b-8a76-650f09674af0 could not be found. Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fe246598-4785-4f0b-8a76-650f09674af0 could not be found. Oct 29 03:13:42.549080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:13:42.554942 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-daaa5d0e-369f-4d2e-946d-01082ee94f6e tempest-VolumesAdminNegativeTest-1372261999 tempest-VolumesAdminNegativeTest-1372261999-project-admin] Returning 404 to user: Volume fe246598-4785-4f0b-8a76-650f09674af0 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:13:42.557259 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-daaa5d0e-369f-4d2e-946d-01082ee94f6e tempest-VolumesAdminNegativeTest-1372261999 tempest-VolumesAdminNegativeTest-1372261999-project-admin] 10.222.0.46 "PUT /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7/os-volume_attachments/fe246598-4785-4f0b-8a76-650f09674af0" status: 404 len: 109 microversion: 2.1 time: 0.153601 Oct 29 03:13:42.560579 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2272/4741] 10.222.0.46 () {60 vars in 1433 bytes} [Sat Oct 29 03:13:42 2022] PUT /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7/os-volume_attachments/fe246598-4785-4f0b-8a76-650f09674af0 => generated 109 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:13:48.420219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-257a8606-7bdf-4e4f-9155-94e68623ca14 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:48.420790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-257a8606-7bdf-4e4f-9155-94e68623ca14 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: f0262838-6e13-4c99-be76-758460f510e7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:48.445138 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-257a8606-7bdf-4e4f-9155-94e68623ca14 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:48.445636 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-257a8606-7bdf-4e4f-9155-94e68623ca14 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:48.446077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-257a8606-7bdf-4e4f-9155-94e68623ca14 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:48.446795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-257a8606-7bdf-4e4f-9155-94e68623ca14 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:48.450677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-257a8606-7bdf-4e4f-9155-94e68623ca14 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:48.452613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-257a8606-7bdf-4e4f-9155-94e68623ca14 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:48.456747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:48.534771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-257a8606-7bdf-4e4f-9155-94e68623ca14 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: f0262838-6e13-4c99-be76-758460f510e7] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:13:48.731830 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-257a8606-7bdf-4e4f-9155-94e68623ca14 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7" status: 204 len: 0 microversion: 2.1 time: 0.315437 Oct 29 03:13:48.733270 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2470/4742] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:13:48 2022] DELETE /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:13:48.743303 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dd6ec567-6b22-4f0b-8fe1-39473c76c295 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:48.744473 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dd6ec567-6b22-4f0b-8fe1-39473c76c295 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: f0262838-6e13-4c99-be76-758460f510e7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:48.759173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd6ec567-6b22-4f0b-8fe1-39473c76c295 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:48.759689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd6ec567-6b22-4f0b-8fe1-39473c76c295 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:48.760092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd6ec567-6b22-4f0b-8fe1-39473c76c295 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:48.769186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd6ec567-6b22-4f0b-8fe1-39473c76c295 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:48.769900 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd6ec567-6b22-4f0b-8fe1-39473c76c295 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:48.770352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd6ec567-6b22-4f0b-8fe1-39473c76c295 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:49.382865 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dd6ec567-6b22-4f0b-8fe1-39473c76c295 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:49.397255 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dd6ec567-6b22-4f0b-8fe1-39473c76c295 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7" status: 200 len: 1513 microversion: 2.1 time: 0.659705 Oct 29 03:13:49.398429 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2273/4743] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:48 2022] GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7 => generated 1513 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:50.423920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9320aae5-4cb2-472a-9723-2a408fdc9d9a tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:50.425207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9320aae5-4cb2-472a-9723-2a408fdc9d9a tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: f0262838-6e13-4c99-be76-758460f510e7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:50.434310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9320aae5-4cb2-472a-9723-2a408fdc9d9a tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:50.435147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9320aae5-4cb2-472a-9723-2a408fdc9d9a tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:50.435921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9320aae5-4cb2-472a-9723-2a408fdc9d9a tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:50.436989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9320aae5-4cb2-472a-9723-2a408fdc9d9a tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:50.437666 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9320aae5-4cb2-472a-9723-2a408fdc9d9a tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:50.438980 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9320aae5-4cb2-472a-9723-2a408fdc9d9a tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:51.177825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9320aae5-4cb2-472a-9723-2a408fdc9d9a tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:51.212426 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9320aae5-4cb2-472a-9723-2a408fdc9d9a tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7" status: 200 len: 1513 microversion: 2.1 time: 0.792019 Oct 29 03:13:51.215715 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2471/4744] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:50 2022] GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7 => generated 1513 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:52.238449 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a1f17352-122a-4bfe-ba9c-a8a42a9f96a6 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:52.239160 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a1f17352-122a-4bfe-ba9c-a8a42a9f96a6 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: f0262838-6e13-4c99-be76-758460f510e7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:52.258528 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1f17352-122a-4bfe-ba9c-a8a42a9f96a6 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:52.259192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1f17352-122a-4bfe-ba9c-a8a42a9f96a6 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:52.260124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1f17352-122a-4bfe-ba9c-a8a42a9f96a6 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:52.261047 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1f17352-122a-4bfe-ba9c-a8a42a9f96a6 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:52.261626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1f17352-122a-4bfe-ba9c-a8a42a9f96a6 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:52.262482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1f17352-122a-4bfe-ba9c-a8a42a9f96a6 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:52.283510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=54 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:52.382816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-f22ad836-5528-4cd8-8700-77cb66a35d46 req-a419dabe-20ff-423a-b44b-dc58b722e67e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0262838-6e13-4c99-be76-758460f510e7", "name": "network-vif-deleted", "tag": "f7eb50fa-e046-4ceb-b8d2-38a47bc5eabd"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:13:52.418531 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f22ad836-5528-4cd8-8700-77cb66a35d46 req-a419dabe-20ff-423a-b44b-dc58b722e67e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:52.435751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f22ad836-5528-4cd8-8700-77cb66a35d46 req-a419dabe-20ff-423a-b44b-dc58b722e67e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:52.436388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f22ad836-5528-4cd8-8700-77cb66a35d46 req-a419dabe-20ff-423a-b44b-dc58b722e67e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:52.466306 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-f22ad836-5528-4cd8-8700-77cb66a35d46 req-a419dabe-20ff-423a-b44b-dc58b722e67e service nova] Creating event network-vif-deleted:f7eb50fa-e046-4ceb-b8d2-38a47bc5eabd for instance f0262838-6e13-4c99-be76-758460f510e7 on n-h2-862967-2 Oct 29 03:13:52.476147 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-f22ad836-5528-4cd8-8700-77cb66a35d46 req-a419dabe-20ff-423a-b44b-dc58b722e67e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097256 Oct 29 03:13:52.480218 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2472/4745] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:13:52.496501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a1f17352-122a-4bfe-ba9c-a8a42a9f96a6 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:13:52.509102 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a1f17352-122a-4bfe-ba9c-a8a42a9f96a6 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7" status: 200 len: 1471 microversion: 2.1 time: 0.275140 Oct 29 03:13:52.512903 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2274/4746] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:52 2022] GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7 => generated 1471 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:13:53.552361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5d642802-0762-4497-8ba3-f4ee5542518e tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:13:53.555323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5d642802-0762-4497-8ba3-f4ee5542518e tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: f0262838-6e13-4c99-be76-758460f510e7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:13:53.580701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5d642802-0762-4497-8ba3-f4ee5542518e tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:53.582850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5d642802-0762-4497-8ba3-f4ee5542518e tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:53.585118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5d642802-0762-4497-8ba3-f4ee5542518e tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:53.586351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5d642802-0762-4497-8ba3-f4ee5542518e tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:13:53.590868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5d642802-0762-4497-8ba3-f4ee5542518e tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:13:53.591677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5d642802-0762-4497-8ba3-f4ee5542518e tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:13:53.654750 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-5d642802-0762-4497-8ba3-f4ee5542518e tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] HTTP exception thrown: Instance f0262838-6e13-4c99-be76-758460f510e7 could not be found. Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5d642802-0762-4497-8ba3-f4ee5542518e tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Request method failure captured: Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7 HTTP/1.1 Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJnXNEXyDmQuOHfwud15HSEkzmsbulYK10F9M2emcDENIqPm1TzdHknaEhWylr2igkB9fUm-zXJ7Hdym_i3HG1f4wYsx5eNTowxFONh0AWR6qr3QH6EcoYb_cAi8YjARcQdlGYcAI_BF9EnYIVLwbku38A8ES4xsgr6nV250CZEVsK4 Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: ad74f13c0ac347418ed8445140531b7e Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-VolumesAdminNegativeTest-444581559 Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ad74f13c0ac347418ed8445140531b7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ad74f13c0ac347418ed8445140531b7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ad74f13c0ac347418ed8445140531b7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ad74f13c0ac347418ed8445140531b7e"}]}] Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-VolumesAdminNegativeTest-444581559 Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: ad74f13c0ac347418ed8445140531b7e Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-444581559 Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-VolumesAdminNegativeTest-444581559-project Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: aee9c3cade7948b0abb8a47afe3e581e Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-VolumesAdminNegativeTest-444581559-project Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance f0262838-6e13-4c99-be76-758460f510e7 could not be found. Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'f0262838-6e13-4c99-be76-758460f510e7'} Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0262838-6e13-4c99-be76-758460f510e7 could not be found. Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0262838-6e13-4c99-be76-758460f510e7 could not be found. Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:13:53.663119 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:13:53.666727 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:13:53.666727 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:13:53.666727 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:13:53.666727 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:13:53.666727 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:13:53.666727 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0262838-6e13-4c99-be76-758460f510e7 could not be found. Oct 29 03:13:53.666727 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:13:53.669701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5d642802-0762-4497-8ba3-f4ee5542518e tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Returning 404 to user: Instance f0262838-6e13-4c99-be76-758460f510e7 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:13:53.672896 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5d642802-0762-4497-8ba3-f4ee5542518e tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7" status: 404 len: 111 microversion: 2.1 time: 0.137159 Oct 29 03:13:53.678850 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2473/4747] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:13:53 2022] GET /compute/v2.1/servers/f0262838-6e13-4c99-be76-758460f510e7 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:14:00.715053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0dd882df-e0e2-4f74-bd69-77d452386578 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:00.715560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0dd882df-e0e2-4f74-bd69-77d452386578 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:00.738757 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0dd882df-e0e2-4f74-bd69-77d452386578 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:00.744165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0dd882df-e0e2-4f74-bd69-77d452386578 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:00.745487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0dd882df-e0e2-4f74-bd69-77d452386578 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:00.747165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0dd882df-e0e2-4f74-bd69-77d452386578 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:00.747989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0dd882df-e0e2-4f74-bd69-77d452386578 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:00.749210 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0dd882df-e0e2-4f74-bd69-77d452386578 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:00.837207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0dd882df-e0e2-4f74-bd69-77d452386578 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:14:01.020371 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0dd882df-e0e2-4f74-bd69-77d452386578 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "DELETE /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad" status: 204 len: 0 microversion: 2.1 time: 0.312387 Oct 29 03:14:01.028005 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2275/4748] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:14:00 2022] DELETE /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:14:01.037998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-570fe096-56e5-44a4-a1ea-233021c3f85c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:01.039520 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-570fe096-56e5-44a4-a1ea-233021c3f85c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:01.048060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:01.050011 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-570fe096-56e5-44a4-a1ea-233021c3f85c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:01.050921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-570fe096-56e5-44a4-a1ea-233021c3f85c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:01.051715 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-570fe096-56e5-44a4-a1ea-233021c3f85c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:01.053028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-570fe096-56e5-44a4-a1ea-233021c3f85c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:01.053715 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-570fe096-56e5-44a4-a1ea-233021c3f85c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:01.080084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-570fe096-56e5-44a4-a1ea-233021c3f85c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:01.845635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-570fe096-56e5-44a4-a1ea-233021c3f85c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:01.868720 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-570fe096-56e5-44a4-a1ea-233021c3f85c tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad" status: 200 len: 1683 microversion: 2.1 time: 0.836211 Oct 29 03:14:01.872409 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2474/4749] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:01 2022] GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad => generated 1683 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:02.897667 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-48bc7ac5-c7f0-49d7-88c3-703d42a54fbb tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:02.899712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-48bc7ac5-c7f0-49d7-88c3-703d42a54fbb tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:02.927629 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48bc7ac5-c7f0-49d7-88c3-703d42a54fbb tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:02.928182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48bc7ac5-c7f0-49d7-88c3-703d42a54fbb tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:02.928650 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48bc7ac5-c7f0-49d7-88c3-703d42a54fbb tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:02.929360 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48bc7ac5-c7f0-49d7-88c3-703d42a54fbb tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:02.929812 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48bc7ac5-c7f0-49d7-88c3-703d42a54fbb tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:02.949199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48bc7ac5-c7f0-49d7-88c3-703d42a54fbb tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:03.322960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c3f860c1-7b07-4c4f-8e2b-6a8d55f9cf52 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-118408534", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "9f156bcd-563b-48fe-a8a3-b8d609743c0b"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:03.418773 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-c3f860c1-7b07-4c4f-8e2b-6a8d55f9cf52 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] validate_networks() for [('9f156bcd-563b-48fe-a8a3-b8d609743c0b', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:14:03.608300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-48bc7ac5-c7f0-49d7-88c3-703d42a54fbb tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:03.618293 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-48bc7ac5-c7f0-49d7-88c3-703d42a54fbb tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad" status: 200 len: 1615 microversion: 2.1 time: 0.724898 Oct 29 03:14:03.636562 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2276/4750] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:02 2022] GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad => generated 1615 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:04.459260 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-c3f860c1-7b07-4c4f-8e2b-6a8d55f9cf52 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:14:04.459801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-c3f860c1-7b07-4c4f-8e2b-6a8d55f9cf52 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:14:04.460245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-c3f860c1-7b07-4c4f-8e2b-6a8d55f9cf52 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:14:04.460775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-c3f860c1-7b07-4c4f-8e2b-6a8d55f9cf52 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:14:04.461361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-c3f860c1-7b07-4c4f-8e2b-6a8d55f9cf52 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:14:04.479244 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3f860c1-7b07-4c4f-8e2b-6a8d55f9cf52 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:04.480328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3f860c1-7b07-4c4f-8e2b-6a8d55f9cf52 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:04.480796 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3f860c1-7b07-4c4f-8e2b-6a8d55f9cf52 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:04.484640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3f860c1-7b07-4c4f-8e2b-6a8d55f9cf52 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:04.487160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3f860c1-7b07-4c4f-8e2b-6a8d55f9cf52 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:04.487828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3f860c1-7b07-4c4f-8e2b-6a8d55f9cf52 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:04.537667 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-c3f860c1-7b07-4c4f-8e2b-6a8d55f9cf52 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Getting quotas for project 381fb1b5500b4dd6804304ef434619b4. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:14:04.554734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-c3f860c1-7b07-4c4f-8e2b-6a8d55f9cf52 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Getting quotas for user 9b4b0d5e12044da5ba9796c450080c3f and project 381fb1b5500b4dd6804304ef434619b4. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:14:04.589683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c3f860c1-7b07-4c4f-8e2b-6a8d55f9cf52 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:14:04.593383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c3f860c1-7b07-4c4f-8e2b-6a8d55f9cf52 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:14:04.650635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-17df6e96-ec50-4778-9ca0-daeff43e95ad tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:04.651466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-17df6e96-ec50-4778-9ca0-daeff43e95ad tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:04.664421 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-17df6e96-ec50-4778-9ca0-daeff43e95ad tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:04.665265 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-17df6e96-ec50-4778-9ca0-daeff43e95ad tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:04.666549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-17df6e96-ec50-4778-9ca0-daeff43e95ad tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:04.667379 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-17df6e96-ec50-4778-9ca0-daeff43e95ad tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:04.668675 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-17df6e96-ec50-4778-9ca0-daeff43e95ad tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:04.670951 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-17df6e96-ec50-4778-9ca0-daeff43e95ad tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:04.718961 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c3f860c1-7b07-4c4f-8e2b-6a8d55f9cf52 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.685909 Oct 29 03:14:04.726569 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2475/4751] 10.222.0.46 () {62 vars in 1188 bytes} [Sat Oct 29 03:14:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1694 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 03:14:04.740780 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0af5df39-fc6c-45d2-938a-b68706519623 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:04.741652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0af5df39-fc6c-45d2-938a-b68706519623 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:04.975211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0af5df39-fc6c-45d2-938a-b68706519623 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:04.986731 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0af5df39-fc6c-45d2-938a-b68706519623 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:04.996200 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-17df6e96-ec50-4778-9ca0-daeff43e95ad tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aee9c3cade7948b0abb8a47afe3e581e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad74f13c0ac347418ed8445140531b7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:05.015817 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0af5df39-fc6c-45d2-938a-b68706519623 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:05.017075 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0af5df39-fc6c-45d2-938a-b68706519623 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a" status: 200 len: 1261 microversion: 2.26 time: 0.288429 Oct 29 03:14:05.020967 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-17df6e96-ec50-4778-9ca0-daeff43e95ad tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad" status: 200 len: 1615 microversion: 2.1 time: 0.375881 Oct 29 03:14:05.024767 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2277/4752] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:04 2022] GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad => generated 1615 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:05.027913 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2476/4753] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:14:04 2022] GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a => generated 1261 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:14:05.035616 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-ecd9a57c-9c02-46af-9216-d637779ef418 req-a674fca1-db58-4c75-aa02-49a74cc439f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83b9fc20-0b3e-488b-817c-a8cfe934ddad", "name": "network-vif-deleted", "tag": "8dc32258-276c-49b9-bff3-9cf8882c90b3"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:05.064461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ecd9a57c-9c02-46af-9216-d637779ef418 req-a674fca1-db58-4c75-aa02-49a74cc439f3 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:05.065378 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ecd9a57c-9c02-46af-9216-d637779ef418 req-a674fca1-db58-4c75-aa02-49a74cc439f3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:05.068132 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ecd9a57c-9c02-46af-9216-d637779ef418 req-a674fca1-db58-4c75-aa02-49a74cc439f3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:05.101521 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-ecd9a57c-9c02-46af-9216-d637779ef418 req-a674fca1-db58-4c75-aa02-49a74cc439f3 service nova] Creating event network-vif-deleted:8dc32258-276c-49b9-bff3-9cf8882c90b3 for instance 83b9fc20-0b3e-488b-817c-a8cfe934ddad on n-h2-862967-2 Oct 29 03:14:05.147518 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-ecd9a57c-9c02-46af-9216-d637779ef418 req-a674fca1-db58-4c75-aa02-49a74cc439f3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121149 Oct 29 03:14:05.148159 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2278/4754] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:14:06.054906 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a91cbb76-ca1a-433c-a743-45d4d52ad5a2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:06.056126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1eb6f329-77af-4640-8163-a1e8c92609d4 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:06.058078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1eb6f329-77af-4640-8163-a1e8c92609d4 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:06.060481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a91cbb76-ca1a-433c-a743-45d4d52ad5a2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] [instance: 83b9fc20-0b3e-488b-817c-a8cfe934ddad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:06.085577 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:06.098368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a91cbb76-ca1a-433c-a743-45d4d52ad5a2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:06.106047 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a91cbb76-ca1a-433c-a743-45d4d52ad5a2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:06.107428 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a91cbb76-ca1a-433c-a743-45d4d52ad5a2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:06.110704 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a91cbb76-ca1a-433c-a743-45d4d52ad5a2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:06.119738 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a91cbb76-ca1a-433c-a743-45d4d52ad5a2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:06.122346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a91cbb76-ca1a-433c-a743-45d4d52ad5a2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:06.182817 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-a91cbb76-ca1a-433c-a743-45d4d52ad5a2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] HTTP exception thrown: Instance 83b9fc20-0b3e-488b-817c-a8cfe934ddad could not be found. Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a91cbb76-ca1a-433c-a743-45d4d52ad5a2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Request method failure captured: Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad HTTP/1.1 Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJnXNEXyDmQuOHfwud15HSEkzmsbulYK10F9M2emcDENIqPm1TzdHknaEhWylr2igkB9fUm-zXJ7Hdym_i3HG1f4wYsx5eNTowxFONh0AWR6qr3QH6EcoYb_cAi8YjARcQdlGYcAI_BF9EnYIVLwbku38A8ES4xsgr6nV250CZEVsK4 Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: ad74f13c0ac347418ed8445140531b7e Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-VolumesAdminNegativeTest-444581559 Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ad74f13c0ac347418ed8445140531b7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ad74f13c0ac347418ed8445140531b7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ad74f13c0ac347418ed8445140531b7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ad74f13c0ac347418ed8445140531b7e"}]}] Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-VolumesAdminNegativeTest-444581559 Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: ad74f13c0ac347418ed8445140531b7e Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-444581559 Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-VolumesAdminNegativeTest-444581559-project Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: aee9c3cade7948b0abb8a47afe3e581e Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-VolumesAdminNegativeTest-444581559-project Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 83b9fc20-0b3e-488b-817c-a8cfe934ddad could not be found. Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '83b9fc20-0b3e-488b-817c-a8cfe934ddad'} Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83b9fc20-0b3e-488b-817c-a8cfe934ddad could not be found. Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83b9fc20-0b3e-488b-817c-a8cfe934ddad could not be found. Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:06.188575 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:06.194273 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:06.194273 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:14:06.194273 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:14:06.194273 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:14:06.194273 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:14:06.194273 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83b9fc20-0b3e-488b-817c-a8cfe934ddad could not be found. Oct 29 03:14:06.194273 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:06.194273 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a91cbb76-ca1a-433c-a743-45d4d52ad5a2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Returning 404 to user: Instance 83b9fc20-0b3e-488b-817c-a8cfe934ddad could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:14:06.194273 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a91cbb76-ca1a-433c-a743-45d4d52ad5a2 tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad" status: 404 len: 111 microversion: 2.1 time: 0.146698 Oct 29 03:14:06.195507 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2279/4755] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:06 2022] GET /compute/v2.1/servers/83b9fc20-0b3e-488b-817c-a8cfe934ddad => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:14:06.204146 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5437ead7-b761-4157-9988-5b673ff79dbb tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] Calling method '.version_select at 0x7ff0538c90d0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:06.253621 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1eb6f329-77af-4640-8163-a1e8c92609d4 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:06.269228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1eb6f329-77af-4640-8163-a1e8c92609d4 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:06.270824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1eb6f329-77af-4640-8163-a1e8c92609d4 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:06.283670 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1eb6f329-77af-4640-8163-a1e8c92609d4 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a" status: 200 len: 1261 microversion: 2.26 time: 0.239979 Oct 29 03:14:06.284158 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5437ead7-b761-4157-9988-5b673ff79dbb tempest-VolumesAdminNegativeTest-444581559 tempest-VolumesAdminNegativeTest-444581559-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1259869734" status: 202 len: 0 microversion: 2.1 time: 0.083021 Oct 29 03:14:06.292618 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2477/4756] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:14:06 2022] GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a => generated 1261 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:14:06.293902 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2280/4757] 10.222.0.46 () {58 vars in 1221 bytes} [Sat Oct 29 03:14:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1259869734 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:14:06.781271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f877fe92-d100-44dc-bad1-74b69edca7a6 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Action: 'create', calling method: .version_select at 0x7ff05c1204c0>, body: {"keypair": {"name": "tempest-keypair-1893616529", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP327fkXOYXB+xeNvthfi2LPxIlNlwfSDytCWy1yDueZnVv3josFJ0b/mgKJoPwVVo58DE5KduZtGk00uaeb67SDdQ7tIpWkDtBDGglKFbugolIv1ZK4NrM1ok7Ipo+lg=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:06.827394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-f877fe92-d100-44dc-bad1-74b69edca7a6 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Getting quotas for project 4c05b5161bd341acb4fc97fa616b3713. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:14:06.849588 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-f877fe92-d100-44dc-bad1-74b69edca7a6 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Getting quotas for user e9086760822f48ee921bcdb7bd5ae299 and project 4c05b5161bd341acb4fc97fa616b3713. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:14:06.941337 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f877fe92-d100-44dc-bad1-74b69edca7a6 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.554080 Oct 29 03:14:06.943800 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2478/4758] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:14:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:14:07.313968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7caed6d7-bd94-47e1-9784-26e980199361 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:07.314605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7caed6d7-bd94-47e1-9784-26e980199361 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:07.329336 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7caed6d7-bd94-47e1-9784-26e980199361 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:07.329837 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7caed6d7-bd94-47e1-9784-26e980199361 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:07.330281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7caed6d7-bd94-47e1-9784-26e980199361 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:07.331019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7caed6d7-bd94-47e1-9784-26e980199361 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:07.331476 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7caed6d7-bd94-47e1-9784-26e980199361 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:07.337186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7caed6d7-bd94-47e1-9784-26e980199361 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:07.800138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7caed6d7-bd94-47e1-9784-26e980199361 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:07.826164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7caed6d7-bd94-47e1-9784-26e980199361 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:07.836666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7caed6d7-bd94-47e1-9784-26e980199361 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:07.839765 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7caed6d7-bd94-47e1-9784-26e980199361 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a" status: 200 len: 1265 microversion: 2.26 time: 0.529922 Oct 29 03:14:07.845835 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2281/4759] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:14:07 2022] GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a => generated 1265 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:14:08.879095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0b10f979-fb91-4940-b64e-7a5474c31170 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:08.879917 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0b10f979-fb91-4940-b64e-7a5474c31170 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:08.914901 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b10f979-fb91-4940-b64e-7a5474c31170 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:08.915688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b10f979-fb91-4940-b64e-7a5474c31170 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:08.917970 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b10f979-fb91-4940-b64e-7a5474c31170 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:08.919470 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b10f979-fb91-4940-b64e-7a5474c31170 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:08.921647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b10f979-fb91-4940-b64e-7a5474c31170 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:08.923793 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b10f979-fb91-4940-b64e-7a5474c31170 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:09.289829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0b10f979-fb91-4940-b64e-7a5474c31170 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:09.301988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0b10f979-fb91-4940-b64e-7a5474c31170 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:09.303500 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0b10f979-fb91-4940-b64e-7a5474c31170 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:09.304741 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0b10f979-fb91-4940-b64e-7a5474c31170 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a" status: 200 len: 1313 microversion: 2.26 time: 0.431338 Oct 29 03:14:09.318841 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2479/4760] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:14:08 2022] GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a => generated 1313 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:14:10.335209 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4ec4e4be-2e1e-423d-a7ce-fcec3430660b tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:10.336420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4ec4e4be-2e1e-423d-a7ce-fcec3430660b tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:10.343956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ec4e4be-2e1e-423d-a7ce-fcec3430660b tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:10.345138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ec4e4be-2e1e-423d-a7ce-fcec3430660b tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:10.345871 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ec4e4be-2e1e-423d-a7ce-fcec3430660b tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:10.346897 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ec4e4be-2e1e-423d-a7ce-fcec3430660b tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:10.347541 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ec4e4be-2e1e-423d-a7ce-fcec3430660b tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:10.348161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ec4e4be-2e1e-423d-a7ce-fcec3430660b tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:10.840635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4ec4e4be-2e1e-423d-a7ce-fcec3430660b tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:10.853189 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4ec4e4be-2e1e-423d-a7ce-fcec3430660b tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:10.855297 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4ec4e4be-2e1e-423d-a7ce-fcec3430660b tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:10.856795 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4ec4e4be-2e1e-423d-a7ce-fcec3430660b tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a" status: 200 len: 1319 microversion: 2.26 time: 0.526901 Oct 29 03:14:10.857521 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2282/4761] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:14:10 2022] GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a => generated 1319 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:14:11.891165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bff16f07-4a97-4c18-9b93-6c8efe3c0a1b tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:11.901555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bff16f07-4a97-4c18-9b93-6c8efe3c0a1b tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:11.928994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bff16f07-4a97-4c18-9b93-6c8efe3c0a1b tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:11.930217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bff16f07-4a97-4c18-9b93-6c8efe3c0a1b tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:11.931155 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bff16f07-4a97-4c18-9b93-6c8efe3c0a1b tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:11.932846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bff16f07-4a97-4c18-9b93-6c8efe3c0a1b tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:11.933796 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bff16f07-4a97-4c18-9b93-6c8efe3c0a1b tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:11.934677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bff16f07-4a97-4c18-9b93-6c8efe3c0a1b tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:13.077217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bff16f07-4a97-4c18-9b93-6c8efe3c0a1b tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:13.099003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bff16f07-4a97-4c18-9b93-6c8efe3c0a1b tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:13.100798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bff16f07-4a97-4c18-9b93-6c8efe3c0a1b tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:13.106978 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bff16f07-4a97-4c18-9b93-6c8efe3c0a1b tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a" status: 200 len: 1361 microversion: 2.26 time: 1.219940 Oct 29 03:14:13.108152 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2480/4762] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:14:11 2022] GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a => generated 1361 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:14:14.139065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c73f4eb8-7030-410f-a7a1-2a84c0dccc3e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:14.139700 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c73f4eb8-7030-410f-a7a1-2a84c0dccc3e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:14.162848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c73f4eb8-7030-410f-a7a1-2a84c0dccc3e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:14.163276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c73f4eb8-7030-410f-a7a1-2a84c0dccc3e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:14.163723 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c73f4eb8-7030-410f-a7a1-2a84c0dccc3e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:14.164469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c73f4eb8-7030-410f-a7a1-2a84c0dccc3e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:14.164959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c73f4eb8-7030-410f-a7a1-2a84c0dccc3e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:14.165388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c73f4eb8-7030-410f-a7a1-2a84c0dccc3e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:14.873656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c73f4eb8-7030-410f-a7a1-2a84c0dccc3e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:14.892463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c73f4eb8-7030-410f-a7a1-2a84c0dccc3e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:14.900038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c73f4eb8-7030-410f-a7a1-2a84c0dccc3e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:14.901572 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c73f4eb8-7030-410f-a7a1-2a84c0dccc3e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a" status: 200 len: 1361 microversion: 2.26 time: 0.768679 Oct 29 03:14:14.904646 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2283/4763] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:14:14 2022] GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a => generated 1361 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:14:15.491844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-da9e13a7-f546-49f7-89f3-e4ba4f5e0332 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1600943238", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2930b46-8565-462a-9f64-b9b374f3c23b"}], "security_groups": [{"name": "tempest-securitygroup--501640815"}], "key_name": "tempest-keypair-1893616529", "user_data": "}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:15.541646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:15.901812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-da9e13a7-f546-49f7-89f3-e4ba4f5e0332 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] validate_networks() for [('e2930b46-8565-462a-9f64-b9b374f3c23b', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:14:15.934230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5d47484f-61e7-481f-a1f5-c4fb45110c42 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:15.934969 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5d47484f-61e7-481f-a1f5-c4fb45110c42 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:15.945128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d47484f-61e7-481f-a1f5-c4fb45110c42 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:15.952747 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d47484f-61e7-481f-a1f5-c4fb45110c42 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:15.953441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d47484f-61e7-481f-a1f5-c4fb45110c42 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:15.954354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d47484f-61e7-481f-a1f5-c4fb45110c42 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:15.954967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d47484f-61e7-481f-a1f5-c4fb45110c42 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:15.955557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d47484f-61e7-481f-a1f5-c4fb45110c42 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:16.896770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=14 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:17.085759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5d47484f-61e7-481f-a1f5-c4fb45110c42 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:17.104068 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5d47484f-61e7-481f-a1f5-c4fb45110c42 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:17.106433 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5d47484f-61e7-481f-a1f5-c4fb45110c42 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:17.118200 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5d47484f-61e7-481f-a1f5-c4fb45110c42 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a" status: 200 len: 1361 microversion: 2.26 time: 1.184222 Oct 29 03:14:17.137675 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2284/4764] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:14:15 2022] GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a => generated 1361 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:14:17.152112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-9f61f11a-aec2-44a1-9428-87a7f7c548cc req-96e0422e-e8df-4fb6-b780-7dc427b98846 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "916c0747-3241-4cf8-9085-57e392ee5e6a", "tag": "8d59506e-b7aa-4a47-8f5f-5b451e420148"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:17.166985 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9f61f11a-aec2-44a1-9428-87a7f7c548cc req-96e0422e-e8df-4fb6-b780-7dc427b98846 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:17.167868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9f61f11a-aec2-44a1-9428-87a7f7c548cc req-96e0422e-e8df-4fb6-b780-7dc427b98846 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:17.168516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9f61f11a-aec2-44a1-9428-87a7f7c548cc req-96e0422e-e8df-4fb6-b780-7dc427b98846 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:17.206734 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-9f61f11a-aec2-44a1-9428-87a7f7c548cc req-96e0422e-e8df-4fb6-b780-7dc427b98846 service nova] Creating event network-changed:8d59506e-b7aa-4a47-8f5f-5b451e420148 for instance 916c0747-3241-4cf8-9085-57e392ee5e6a on n-h2-862967-2 Oct 29 03:14:17.228606 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-9f61f11a-aec2-44a1-9428-87a7f7c548cc req-96e0422e-e8df-4fb6-b780-7dc427b98846 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088154 Oct 29 03:14:17.229807 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2285/4765] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:14:18.160704 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6b3bab2d-a2b8-4236-999e-62a5f013f5fe tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:18.165966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6b3bab2d-a2b8-4236-999e-62a5f013f5fe tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:18.186093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b3bab2d-a2b8-4236-999e-62a5f013f5fe tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:18.186780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b3bab2d-a2b8-4236-999e-62a5f013f5fe tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:18.187371 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b3bab2d-a2b8-4236-999e-62a5f013f5fe tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:18.188267 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b3bab2d-a2b8-4236-999e-62a5f013f5fe tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:18.188966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b3bab2d-a2b8-4236-999e-62a5f013f5fe tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:18.189535 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b3bab2d-a2b8-4236-999e-62a5f013f5fe tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:18.395890 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-da9e13a7-f546-49f7-89f3-e4ba4f5e0332 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:14:18.397114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-da9e13a7-f546-49f7-89f3-e4ba4f5e0332 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:14:18.398788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-da9e13a7-f546-49f7-89f3-e4ba4f5e0332 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:14:18.399502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-da9e13a7-f546-49f7-89f3-e4ba4f5e0332 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:14:18.400247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-da9e13a7-f546-49f7-89f3-e4ba4f5e0332 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:14:18.422168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da9e13a7-f546-49f7-89f3-e4ba4f5e0332 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:18.422758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da9e13a7-f546-49f7-89f3-e4ba4f5e0332 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:18.423153 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da9e13a7-f546-49f7-89f3-e4ba4f5e0332 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:18.425084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da9e13a7-f546-49f7-89f3-e4ba4f5e0332 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:18.427366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da9e13a7-f546-49f7-89f3-e4ba4f5e0332 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:18.429103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da9e13a7-f546-49f7-89f3-e4ba4f5e0332 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:18.483697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-da9e13a7-f546-49f7-89f3-e4ba4f5e0332 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Getting quotas for project 4c05b5161bd341acb4fc97fa616b3713. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:14:18.499661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-da9e13a7-f546-49f7-89f3-e4ba4f5e0332 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Getting quotas for user e9086760822f48ee921bcdb7bd5ae299 and project 4c05b5161bd341acb4fc97fa616b3713. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:14:18.545178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-da9e13a7-f546-49f7-89f3-e4ba4f5e0332 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:14:18.547452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-da9e13a7-f546-49f7-89f3-e4ba4f5e0332 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:14:18.663925 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-da9e13a7-f546-49f7-89f3-e4ba4f5e0332 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.176646 Oct 29 03:14:18.664775 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2481/4766] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:14:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 3178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:14:18.687678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-075936c5-dbaa-4084-ab13-284be69b1eec tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:18.688711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-075936c5-dbaa-4084-ab13-284be69b1eec tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:18.966943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-075936c5-dbaa-4084-ab13-284be69b1eec tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:18.985890 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-075936c5-dbaa-4084-ab13-284be69b1eec tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7" status: 200 len: 1242 microversion: 2.1 time: 0.304456 Oct 29 03:14:19.007424 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2482/4767] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:18 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7 => generated 1242 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:19.176937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6b3bab2d-a2b8-4236-999e-62a5f013f5fe tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:19.193359 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6b3bab2d-a2b8-4236-999e-62a5f013f5fe tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:19.197474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6b3bab2d-a2b8-4236-999e-62a5f013f5fe tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:19.203587 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6b3bab2d-a2b8-4236-999e-62a5f013f5fe tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a" status: 200 len: 1361 microversion: 2.26 time: 1.053911 Oct 29 03:14:19.204886 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2286/4768] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:14:18 2022] GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a => generated 1361 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:14:20.025846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b43d584f-da01-4080-95b3-7b501a61f113 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:20.026775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b43d584f-da01-4080-95b3-7b501a61f113 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:20.038957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b43d584f-da01-4080-95b3-7b501a61f113 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:20.042130 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b43d584f-da01-4080-95b3-7b501a61f113 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:20.045106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b43d584f-da01-4080-95b3-7b501a61f113 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:20.046062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b43d584f-da01-4080-95b3-7b501a61f113 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:20.048864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b43d584f-da01-4080-95b3-7b501a61f113 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:20.049556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b43d584f-da01-4080-95b3-7b501a61f113 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:20.065510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:20.237301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c6941f6e-2a96-4340-b1ff-3968b2557578 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:20.238584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c6941f6e-2a96-4340-b1ff-3968b2557578 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:20.250150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6941f6e-2a96-4340-b1ff-3968b2557578 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:20.261133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6941f6e-2a96-4340-b1ff-3968b2557578 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:20.264091 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6941f6e-2a96-4340-b1ff-3968b2557578 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:20.271725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6941f6e-2a96-4340-b1ff-3968b2557578 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:20.273424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6941f6e-2a96-4340-b1ff-3968b2557578 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:20.274345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6941f6e-2a96-4340-b1ff-3968b2557578 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:20.730582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c6941f6e-2a96-4340-b1ff-3968b2557578 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:20.741959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c6941f6e-2a96-4340-b1ff-3968b2557578 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:20.745533 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c6941f6e-2a96-4340-b1ff-3968b2557578 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:20.749104 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c6941f6e-2a96-4340-b1ff-3968b2557578 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a" status: 200 len: 1361 microversion: 2.26 time: 0.516735 Oct 29 03:14:20.750287 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2287/4769] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:14:20 2022] GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a => generated 1361 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:14:21.028209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b43d584f-da01-4080-95b3-7b501a61f113 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:21.060892 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b43d584f-da01-4080-95b3-7b501a61f113 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7" status: 200 len: 1238 microversion: 2.1 time: 1.039607 Oct 29 03:14:21.064069 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2483/4770] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:20 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7 => generated 1238 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:21.791173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cb780b04-5120-48f4-84bc-c6a67ce69ca2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:21.792383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cb780b04-5120-48f4-84bc-c6a67ce69ca2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:21.801912 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb780b04-5120-48f4-84bc-c6a67ce69ca2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:21.805300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb780b04-5120-48f4-84bc-c6a67ce69ca2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:21.806043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb780b04-5120-48f4-84bc-c6a67ce69ca2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:21.807010 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb780b04-5120-48f4-84bc-c6a67ce69ca2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:21.817332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb780b04-5120-48f4-84bc-c6a67ce69ca2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:21.818189 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb780b04-5120-48f4-84bc-c6a67ce69ca2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:22.097453 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fac1ce1b-0abf-46ea-a16d-2291b057a448 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:22.099578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fac1ce1b-0abf-46ea-a16d-2291b057a448 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:22.118742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fac1ce1b-0abf-46ea-a16d-2291b057a448 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:22.120043 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fac1ce1b-0abf-46ea-a16d-2291b057a448 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:22.120669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fac1ce1b-0abf-46ea-a16d-2291b057a448 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:22.121596 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fac1ce1b-0abf-46ea-a16d-2291b057a448 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:22.122824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fac1ce1b-0abf-46ea-a16d-2291b057a448 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:22.123555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fac1ce1b-0abf-46ea-a16d-2291b057a448 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:22.298624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fac1ce1b-0abf-46ea-a16d-2291b057a448 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:22.311058 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fac1ce1b-0abf-46ea-a16d-2291b057a448 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7" status: 200 len: 1300 microversion: 2.1 time: 0.220698 Oct 29 03:14:22.325395 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2484/4771] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:22 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7 => generated 1300 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:22.566252 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cb780b04-5120-48f4-84bc-c6a67ce69ca2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:22.576670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:22.595770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cb780b04-5120-48f4-84bc-c6a67ce69ca2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:22.595770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cb780b04-5120-48f4-84bc-c6a67ce69ca2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:22.595770 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cb780b04-5120-48f4-84bc-c6a67ce69ca2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a" status: 200 len: 1361 microversion: 2.26 time: 0.814180 Oct 29 03:14:22.595770 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2288/4772] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:14:21 2022] GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a => generated 1361 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:14:23.339844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-36094b18-3cc7-4ce3-9f89-e84d8d487419 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:23.340385 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-36094b18-3cc7-4ce3-9f89-e84d8d487419 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:23.359642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36094b18-3cc7-4ce3-9f89-e84d8d487419 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:23.360149 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36094b18-3cc7-4ce3-9f89-e84d8d487419 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:23.360616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36094b18-3cc7-4ce3-9f89-e84d8d487419 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:23.361362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36094b18-3cc7-4ce3-9f89-e84d8d487419 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:23.370565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36094b18-3cc7-4ce3-9f89-e84d8d487419 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:23.373166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36094b18-3cc7-4ce3-9f89-e84d8d487419 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:23.627373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8107e5f7-2f79-470a-b062-c727af2f55da tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:23.629187 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8107e5f7-2f79-470a-b062-c727af2f55da tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:23.654104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8107e5f7-2f79-470a-b062-c727af2f55da tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:23.654645 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8107e5f7-2f79-470a-b062-c727af2f55da tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:23.655095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8107e5f7-2f79-470a-b062-c727af2f55da tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:23.657862 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8107e5f7-2f79-470a-b062-c727af2f55da tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:23.658342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8107e5f7-2f79-470a-b062-c727af2f55da tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:23.658772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8107e5f7-2f79-470a-b062-c727af2f55da tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:23.776837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-36094b18-3cc7-4ce3-9f89-e84d8d487419 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:23.790475 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-36094b18-3cc7-4ce3-9f89-e84d8d487419 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7" status: 200 len: 1300 microversion: 2.1 time: 0.455121 Oct 29 03:14:23.805377 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2485/4773] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:23 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7 => generated 1300 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:14:24.541134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8107e5f7-2f79-470a-b062-c727af2f55da tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:24.554520 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8107e5f7-2f79-470a-b062-c727af2f55da tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:24.556048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8107e5f7-2f79-470a-b062-c727af2f55da tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:24.561515 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8107e5f7-2f79-470a-b062-c727af2f55da tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a" status: 200 len: 1361 microversion: 2.26 time: 0.947592 Oct 29 03:14:24.562423 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2289/4774] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:14:23 2022] GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a => generated 1361 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:14:24.819069 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c51f46a3-fa17-464c-a05f-9b78cfaa39f9 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:24.819737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c51f46a3-fa17-464c-a05f-9b78cfaa39f9 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:24.846828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c51f46a3-fa17-464c-a05f-9b78cfaa39f9 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:24.854938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c51f46a3-fa17-464c-a05f-9b78cfaa39f9 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:24.858384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c51f46a3-fa17-464c-a05f-9b78cfaa39f9 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:24.859169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c51f46a3-fa17-464c-a05f-9b78cfaa39f9 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:24.861456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c51f46a3-fa17-464c-a05f-9b78cfaa39f9 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:24.862955 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c51f46a3-fa17-464c-a05f-9b78cfaa39f9 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:25.589525 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-03fdec49-4f65-4543-beaf-9efc6f3b0c81 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:25.592584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-03fdec49-4f65-4543-beaf-9efc6f3b0c81 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:25.605877 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03fdec49-4f65-4543-beaf-9efc6f3b0c81 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:25.606388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03fdec49-4f65-4543-beaf-9efc6f3b0c81 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:25.616951 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03fdec49-4f65-4543-beaf-9efc6f3b0c81 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:25.617870 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03fdec49-4f65-4543-beaf-9efc6f3b0c81 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:25.618548 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03fdec49-4f65-4543-beaf-9efc6f3b0c81 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:25.618998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03fdec49-4f65-4543-beaf-9efc6f3b0c81 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:25.784764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c51f46a3-fa17-464c-a05f-9b78cfaa39f9 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:25.798597 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c51f46a3-fa17-464c-a05f-9b78cfaa39f9 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7" status: 200 len: 1367 microversion: 2.1 time: 0.983117 Oct 29 03:14:25.800026 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2486/4775] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:24 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7 => generated 1367 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:26.256861 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-03fdec49-4f65-4543-beaf-9efc6f3b0c81 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:26.266596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-03fdec49-4f65-4543-beaf-9efc6f3b0c81 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:26.276745 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-03fdec49-4f65-4543-beaf-9efc6f3b0c81 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:26.278229 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-03fdec49-4f65-4543-beaf-9efc6f3b0c81 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a" status: 200 len: 1361 microversion: 2.26 time: 0.692660 Oct 29 03:14:26.279049 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2290/4776] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:14:25 2022] GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a => generated 1361 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:14:26.814551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-0e08c523-41ae-4f5e-88e9-e92efe0b90e6 req-09cc6b72-fae0-45fb-8187-076ec3d44303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "916c0747-3241-4cf8-9085-57e392ee5e6a", "name": "network-vif-plugged", "status": "completed", "tag": "8d59506e-b7aa-4a47-8f5f-5b451e420148"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:26.822717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e36bb4eb-867c-4f23-bea3-65edc437b4ac tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:26.824628 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e36bb4eb-867c-4f23-bea3-65edc437b4ac tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:26.843547 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e36bb4eb-867c-4f23-bea3-65edc437b4ac tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:26.844105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e36bb4eb-867c-4f23-bea3-65edc437b4ac tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:26.844739 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e36bb4eb-867c-4f23-bea3-65edc437b4ac tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:26.845696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e36bb4eb-867c-4f23-bea3-65edc437b4ac tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:26.846333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e36bb4eb-867c-4f23-bea3-65edc437b4ac tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:26.847062 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e36bb4eb-867c-4f23-bea3-65edc437b4ac tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:26.860299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-0e08c523-41ae-4f5e-88e9-e92efe0b90e6 req-09cc6b72-fae0-45fb-8187-076ec3d44303 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:26.861007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-0e08c523-41ae-4f5e-88e9-e92efe0b90e6 req-09cc6b72-fae0-45fb-8187-076ec3d44303 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:26.862812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-0e08c523-41ae-4f5e-88e9-e92efe0b90e6 req-09cc6b72-fae0-45fb-8187-076ec3d44303 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:26.881769 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-0e08c523-41ae-4f5e-88e9-e92efe0b90e6 req-09cc6b72-fae0-45fb-8187-076ec3d44303 service nova] Creating event network-vif-plugged:8d59506e-b7aa-4a47-8f5f-5b451e420148 for instance 916c0747-3241-4cf8-9085-57e392ee5e6a on n-h2-862967-2 Oct 29 03:14:26.889556 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-0e08c523-41ae-4f5e-88e9-e92efe0b90e6 req-09cc6b72-fae0-45fb-8187-076ec3d44303 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077163 Oct 29 03:14:26.890530 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2487/4777] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:14:27.307641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2f834cfd-b2ee-4e4f-b8cf-5df442dc220d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:27.308460 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2f834cfd-b2ee-4e4f-b8cf-5df442dc220d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:27.322677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f834cfd-b2ee-4e4f-b8cf-5df442dc220d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:27.323186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f834cfd-b2ee-4e4f-b8cf-5df442dc220d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:27.324108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f834cfd-b2ee-4e4f-b8cf-5df442dc220d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:27.324864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f834cfd-b2ee-4e4f-b8cf-5df442dc220d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:27.325328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f834cfd-b2ee-4e4f-b8cf-5df442dc220d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:27.327921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f834cfd-b2ee-4e4f-b8cf-5df442dc220d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:27.653664 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e36bb4eb-867c-4f23-bea3-65edc437b4ac tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:27.661674 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e36bb4eb-867c-4f23-bea3-65edc437b4ac tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7" status: 200 len: 1367 microversion: 2.1 time: 0.843151 Oct 29 03:14:27.677020 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2291/4778] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:26 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7 => generated 1367 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:27.971305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2f834cfd-b2ee-4e4f-b8cf-5df442dc220d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:27.983006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2f834cfd-b2ee-4e4f-b8cf-5df442dc220d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:27.984477 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2f834cfd-b2ee-4e4f-b8cf-5df442dc220d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:27.998861 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2f834cfd-b2ee-4e4f-b8cf-5df442dc220d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a" status: 200 len: 1361 microversion: 2.26 time: 0.696082 Oct 29 03:14:27.999496 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2488/4779] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:14:27 2022] GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a => generated 1361 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:14:28.685805 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-db4ac2d5-446c-4a05-ae93-23096646b02a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:28.686784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-db4ac2d5-446c-4a05-ae93-23096646b02a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:28.695723 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db4ac2d5-446c-4a05-ae93-23096646b02a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:28.696215 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db4ac2d5-446c-4a05-ae93-23096646b02a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:28.702599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db4ac2d5-446c-4a05-ae93-23096646b02a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:28.703393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db4ac2d5-446c-4a05-ae93-23096646b02a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:28.703879 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db4ac2d5-446c-4a05-ae93-23096646b02a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:28.704311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db4ac2d5-446c-4a05-ae93-23096646b02a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:29.025529 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8b9367e0-b59a-472d-92b2-1e8e6d6e6646 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:29.026776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8b9367e0-b59a-472d-92b2-1e8e6d6e6646 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:29.035978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:29.040185 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=8 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:29.045695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b9367e0-b59a-472d-92b2-1e8e6d6e6646 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:29.049236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b9367e0-b59a-472d-92b2-1e8e6d6e6646 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:29.049885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b9367e0-b59a-472d-92b2-1e8e6d6e6646 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:29.050840 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b9367e0-b59a-472d-92b2-1e8e6d6e6646 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:29.054921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b9367e0-b59a-472d-92b2-1e8e6d6e6646 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:29.055750 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b9367e0-b59a-472d-92b2-1e8e6d6e6646 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:29.420728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-db4ac2d5-446c-4a05-ae93-23096646b02a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:29.429466 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-db4ac2d5-446c-4a05-ae93-23096646b02a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7" status: 200 len: 1367 microversion: 2.1 time: 0.747529 Oct 29 03:14:29.449889 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2292/4780] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:28 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7 => generated 1367 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:29.792065 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8b9367e0-b59a-472d-92b2-1e8e6d6e6646 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:29.801952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8b9367e0-b59a-472d-92b2-1e8e6d6e6646 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:29.803723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8b9367e0-b59a-472d-92b2-1e8e6d6e6646 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:29.811818 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8b9367e0-b59a-472d-92b2-1e8e6d6e6646 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a" status: 200 len: 1546 microversion: 2.26 time: 0.791111 Oct 29 03:14:29.812880 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2489/4781] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:14:29 2022] GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a => generated 1546 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:14:29.847887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0095cd5d-3298-4b1e-ac12-2c54fa898616 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '.version_select at 0x7ff052d10820>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:29.885597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0095cd5d-3298-4b1e-ac12-2c54fa898616 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:29.886164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0095cd5d-3298-4b1e-ac12-2c54fa898616 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:29.886606 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0095cd5d-3298-4b1e-ac12-2c54fa898616 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:29.887102 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0095cd5d-3298-4b1e-ac12-2c54fa898616 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:29.901999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0095cd5d-3298-4b1e-ac12-2c54fa898616 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:29.902499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0095cd5d-3298-4b1e-ac12-2c54fa898616 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:29.902937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0095cd5d-3298-4b1e-ac12-2c54fa898616 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:29.903649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0095cd5d-3298-4b1e-ac12-2c54fa898616 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:29.908325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0095cd5d-3298-4b1e-ac12-2c54fa898616 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:29.910279 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0095cd5d-3298-4b1e-ac12-2c54fa898616 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:29.960230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0095cd5d-3298-4b1e-ac12-2c54fa898616 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:29.967660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0095cd5d-3298-4b1e-ac12-2c54fa898616 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:29.968415 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0095cd5d-3298-4b1e-ac12-2c54fa898616 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:29.991514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0095cd5d-3298-4b1e-ac12-2c54fa898616 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:29.991931 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0095cd5d-3298-4b1e-ac12-2c54fa898616 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:29.992373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0095cd5d-3298-4b1e-ac12-2c54fa898616 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:30.034362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-0095cd5d-3298-4b1e-ac12-2c54fa898616 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lazy-loading 'flavor' on Instance uuid 916c0747-3241-4cf8-9085-57e392ee5e6a {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:14:30.079626 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0095cd5d-3298-4b1e-ac12-2c54fa898616 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "PUT /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags/tempest-tag-650078436" status: 201 len: 0 microversion: 2.26 time: 0.229366 Oct 29 03:14:30.087348 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2293/4782] 10.222.0.46 () {62 vars in 1377 bytes} [Sat Oct 29 03:14:29 2022] PUT /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags/tempest-tag-650078436 => generated 0 bytes in 240 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 29 03:14:30.092773 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1be304d2-a64e-442f-bafc-fa9cfefaee75 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '.version_select at 0x7ff05340fe50>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:30.110925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-9514caa7-92fc-4dcf-8f87-35c4a35bfbf4 req-b68d7fb1-f902-4e27-a511-4c9d7ce6a54a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2493755-2599-4a13-a4bd-d5104e0d22b7", "tag": "b0bf68ca-62d2-43a2-9aff-8be72aa3cd0f"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:30.118816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1be304d2-a64e-442f-bafc-fa9cfefaee75 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:30.121030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1be304d2-a64e-442f-bafc-fa9cfefaee75 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:30.122910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1be304d2-a64e-442f-bafc-fa9cfefaee75 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:30.130500 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9514caa7-92fc-4dcf-8f87-35c4a35bfbf4 req-b68d7fb1-f902-4e27-a511-4c9d7ce6a54a service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:30.131560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9514caa7-92fc-4dcf-8f87-35c4a35bfbf4 req-b68d7fb1-f902-4e27-a511-4c9d7ce6a54a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:30.132316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9514caa7-92fc-4dcf-8f87-35c4a35bfbf4 req-b68d7fb1-f902-4e27-a511-4c9d7ce6a54a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:30.173843 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-9514caa7-92fc-4dcf-8f87-35c4a35bfbf4 req-b68d7fb1-f902-4e27-a511-4c9d7ce6a54a service nova] Creating event network-changed:b0bf68ca-62d2-43a2-9aff-8be72aa3cd0f for instance f2493755-2599-4a13-a4bd-d5104e0d22b7 on n-h1-862967-2 Oct 29 03:14:30.183596 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1be304d2-a64e-442f-bafc-fa9cfefaee75 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags/tempest-tag-650078436" status: 204 len: 0 microversion: 2.26 time: 0.095066 Oct 29 03:14:30.187292 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-9514caa7-92fc-4dcf-8f87-35c4a35bfbf4 req-b68d7fb1-f902-4e27-a511-4c9d7ce6a54a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080844 Oct 29 03:14:30.188116 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2294/4784] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:14:30.188653 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2490/4784] 10.222.0.46 () {60 vars in 1358 bytes} [Sat Oct 29 03:14:30 2022] GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags/tempest-tag-650078436 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:14:30.197849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4b62e681-046f-46c5-9a74-b5a2881a2b25 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '.version_select at 0x7ff052d7e940>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:30.207813 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b62e681-046f-46c5-9a74-b5a2881a2b25 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:30.208614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b62e681-046f-46c5-9a74-b5a2881a2b25 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:30.210197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b62e681-046f-46c5-9a74-b5a2881a2b25 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:30.210724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4b62e681-046f-46c5-9a74-b5a2881a2b25 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:30.218634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b62e681-046f-46c5-9a74-b5a2881a2b25 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:30.219336 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b62e681-046f-46c5-9a74-b5a2881a2b25 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:30.220248 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b62e681-046f-46c5-9a74-b5a2881a2b25 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:30.221254 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b62e681-046f-46c5-9a74-b5a2881a2b25 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:30.221892 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b62e681-046f-46c5-9a74-b5a2881a2b25 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:30.222664 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b62e681-046f-46c5-9a74-b5a2881a2b25 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:30.261864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b62e681-046f-46c5-9a74-b5a2881a2b25 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:30.263344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b62e681-046f-46c5-9a74-b5a2881a2b25 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:30.263988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b62e681-046f-46c5-9a74-b5a2881a2b25 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:30.292047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-4b62e681-046f-46c5-9a74-b5a2881a2b25 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lazy-loading 'flavor' on Instance uuid 916c0747-3241-4cf8-9085-57e392ee5e6a {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:14:30.315065 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4b62e681-046f-46c5-9a74-b5a2881a2b25 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "DELETE /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags" status: 204 len: 0 microversion: 2.26 time: 0.123580 Oct 29 03:14:30.317377 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2491/4785] 10.222.0.46 () {60 vars in 1295 bytes} [Sat Oct 29 03:14:30 2022] DELETE /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:14:30.328062 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f49aedc6-8031-4bcf-aff4-9fccbfa2cab5 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '.version_select at 0x7ff052e5aca0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:30.342453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f49aedc6-8031-4bcf-aff4-9fccbfa2cab5 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:30.344352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f49aedc6-8031-4bcf-aff4-9fccbfa2cab5 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:30.344830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f49aedc6-8031-4bcf-aff4-9fccbfa2cab5 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:30.369225 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f49aedc6-8031-4bcf-aff4-9fccbfa2cab5 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags" status: 200 len: 12 microversion: 2.26 time: 0.045917 Oct 29 03:14:30.369863 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2295/4786] 10.222.0.46 () {60 vars in 1292 bytes} [Sat Oct 29 03:14:30 2022] GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags => generated 12 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:30.382059 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2c904930-3037-4b1c-9c29-d7e3dfce0a9d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '.version_select at 0x7ff058748160>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:30.395150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c904930-3037-4b1c-9c29-d7e3dfce0a9d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:30.395655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c904930-3037-4b1c-9c29-d7e3dfce0a9d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:30.396109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c904930-3037-4b1c-9c29-d7e3dfce0a9d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:30.396749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2c904930-3037-4b1c-9c29-d7e3dfce0a9d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:30.404203 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c904930-3037-4b1c-9c29-d7e3dfce0a9d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:30.404747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c904930-3037-4b1c-9c29-d7e3dfce0a9d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:30.405352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c904930-3037-4b1c-9c29-d7e3dfce0a9d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:30.406092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c904930-3037-4b1c-9c29-d7e3dfce0a9d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:30.409040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c904930-3037-4b1c-9c29-d7e3dfce0a9d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:30.409519 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c904930-3037-4b1c-9c29-d7e3dfce0a9d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:30.465221 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-471fcf38-706d-448b-9228-354f73692c98 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:30.466039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-471fcf38-706d-448b-9228-354f73692c98 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:30.472587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-471fcf38-706d-448b-9228-354f73692c98 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:30.473339 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-471fcf38-706d-448b-9228-354f73692c98 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:30.473759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-471fcf38-706d-448b-9228-354f73692c98 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:30.474874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-471fcf38-706d-448b-9228-354f73692c98 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:30.475330 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-471fcf38-706d-448b-9228-354f73692c98 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:30.475851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-471fcf38-706d-448b-9228-354f73692c98 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:30.477490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c904930-3037-4b1c-9c29-d7e3dfce0a9d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:30.478174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c904930-3037-4b1c-9c29-d7e3dfce0a9d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:30.478729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c904930-3037-4b1c-9c29-d7e3dfce0a9d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:30.493563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c904930-3037-4b1c-9c29-d7e3dfce0a9d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:30.496381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c904930-3037-4b1c-9c29-d7e3dfce0a9d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:30.496934 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c904930-3037-4b1c-9c29-d7e3dfce0a9d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:30.534332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-2c904930-3037-4b1c-9c29-d7e3dfce0a9d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lazy-loading 'flavor' on Instance uuid 916c0747-3241-4cf8-9085-57e392ee5e6a {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:14:30.554703 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2c904930-3037-4b1c-9c29-d7e3dfce0a9d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "PUT /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags/tempest-tag-1197648510" status: 201 len: 0 microversion: 2.26 time: 0.178280 Oct 29 03:14:30.556055 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2492/4787] 10.222.0.46 () {62 vars in 1380 bytes} [Sat Oct 29 03:14:30 2022] PUT /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags/tempest-tag-1197648510 => generated 0 bytes in 180 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 29 03:14:30.570330 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-feadbc95-5100-4da9-bf77-9e83c341a604 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '.version_select at 0x7ff052b79af0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:30.578819 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-feadbc95-5100-4da9-bf77-9e83c341a604 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:30.579544 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-feadbc95-5100-4da9-bf77-9e83c341a604 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:30.579981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-feadbc95-5100-4da9-bf77-9e83c341a604 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:30.616240 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-feadbc95-5100-4da9-bf77-9e83c341a604 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags" status: 200 len: 36 microversion: 2.26 time: 0.054303 Oct 29 03:14:30.617772 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2493/4788] 10.222.0.46 () {60 vars in 1292 bytes} [Sat Oct 29 03:14:30 2022] GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags => generated 36 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:30.647835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3d4c4829-03b3-4c95-ab72-a087a629c3b2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '.version_select at 0x7ff05c23e820>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:30.677469 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d4c4829-03b3-4c95-ab72-a087a629c3b2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:30.677469 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d4c4829-03b3-4c95-ab72-a087a629c3b2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:30.677469 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d4c4829-03b3-4c95-ab72-a087a629c3b2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:30.677469 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3d4c4829-03b3-4c95-ab72-a087a629c3b2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:30.689056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d4c4829-03b3-4c95-ab72-a087a629c3b2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:30.689623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d4c4829-03b3-4c95-ab72-a087a629c3b2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:30.690107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d4c4829-03b3-4c95-ab72-a087a629c3b2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:30.690927 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d4c4829-03b3-4c95-ab72-a087a629c3b2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:30.691451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d4c4829-03b3-4c95-ab72-a087a629c3b2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:30.691937 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d4c4829-03b3-4c95-ab72-a087a629c3b2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:30.730104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d4c4829-03b3-4c95-ab72-a087a629c3b2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:30.730868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d4c4829-03b3-4c95-ab72-a087a629c3b2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:30.731532 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d4c4829-03b3-4c95-ab72-a087a629c3b2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:30.774830 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-3d4c4829-03b3-4c95-ab72-a087a629c3b2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lazy-loading 'flavor' on Instance uuid 916c0747-3241-4cf8-9085-57e392ee5e6a {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:14:30.793278 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3d4c4829-03b3-4c95-ab72-a087a629c3b2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "DELETE /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags/tempest-tag-1197648510" status: 204 len: 0 microversion: 2.26 time: 0.167506 Oct 29 03:14:30.794559 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2494/4789] 10.222.0.46 () {60 vars in 1364 bytes} [Sat Oct 29 03:14:30 2022] DELETE /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags/tempest-tag-1197648510 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:14:30.805414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3a3daa99-19a1-4a51-b48f-a5a1c0b1b87d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '.version_select at 0x7ff053388ca0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:30.815584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a3daa99-19a1-4a51-b48f-a5a1c0b1b87d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:30.816729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a3daa99-19a1-4a51-b48f-a5a1c0b1b87d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:30.817418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a3daa99-19a1-4a51-b48f-a5a1c0b1b87d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:30.832763 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3a3daa99-19a1-4a51-b48f-a5a1c0b1b87d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags" status: 200 len: 12 microversion: 2.26 time: 0.032132 Oct 29 03:14:30.833738 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2495/4790] 10.222.0.46 () {60 vars in 1292 bytes} [Sat Oct 29 03:14:30 2022] GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags => generated 12 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:30.861798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f7ca363b-4916-418b-a114-ddd3f8a81fef tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '.version_select at 0x7ff053c0e4c0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:30.881823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7ca363b-4916-418b-a114-ddd3f8a81fef tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:30.886500 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7ca363b-4916-418b-a114-ddd3f8a81fef tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:30.887044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7ca363b-4916-418b-a114-ddd3f8a81fef tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:30.888679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f7ca363b-4916-418b-a114-ddd3f8a81fef tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:30.907262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7ca363b-4916-418b-a114-ddd3f8a81fef tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:30.907778 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7ca363b-4916-418b-a114-ddd3f8a81fef tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:30.908435 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7ca363b-4916-418b-a114-ddd3f8a81fef tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:30.910456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7ca363b-4916-418b-a114-ddd3f8a81fef tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:30.910914 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7ca363b-4916-418b-a114-ddd3f8a81fef tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:30.911355 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7ca363b-4916-418b-a114-ddd3f8a81fef tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:30.964945 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7ca363b-4916-418b-a114-ddd3f8a81fef tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:30.965613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7ca363b-4916-418b-a114-ddd3f8a81fef tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:30.966179 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7ca363b-4916-418b-a114-ddd3f8a81fef tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:30.979633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-f7ca363b-4916-418b-a114-ddd3f8a81fef tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lazy-loading 'flavor' on Instance uuid 916c0747-3241-4cf8-9085-57e392ee5e6a {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:14:31.044071 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f7ca363b-4916-418b-a114-ddd3f8a81fef tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "DELETE /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags" status: 204 len: 0 microversion: 2.26 time: 0.203274 Oct 29 03:14:31.045786 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2496/4791] 10.222.0.46 () {60 vars in 1295 bytes} [Sat Oct 29 03:14:30 2022] DELETE /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 29 03:14:31.080380 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d1501b56-1e2c-4c47-8eeb-4ab0d02fc348 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '.version_select at 0x7ff05c0fbdc0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:31.084955 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:31.092205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1501b56-1e2c-4c47-8eeb-4ab0d02fc348 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:31.092725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1501b56-1e2c-4c47-8eeb-4ab0d02fc348 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:31.093161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1501b56-1e2c-4c47-8eeb-4ab0d02fc348 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:31.093807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d1501b56-1e2c-4c47-8eeb-4ab0d02fc348 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:31.120312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1501b56-1e2c-4c47-8eeb-4ab0d02fc348 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:31.120826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1501b56-1e2c-4c47-8eeb-4ab0d02fc348 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:31.121265 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1501b56-1e2c-4c47-8eeb-4ab0d02fc348 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:31.121968 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1501b56-1e2c-4c47-8eeb-4ab0d02fc348 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:31.122418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1501b56-1e2c-4c47-8eeb-4ab0d02fc348 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:31.122834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1501b56-1e2c-4c47-8eeb-4ab0d02fc348 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:31.169215 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1501b56-1e2c-4c47-8eeb-4ab0d02fc348 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:31.169801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1501b56-1e2c-4c47-8eeb-4ab0d02fc348 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:31.170299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1501b56-1e2c-4c47-8eeb-4ab0d02fc348 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:31.178427 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=94,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:31.182766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1501b56-1e2c-4c47-8eeb-4ab0d02fc348 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:31.183542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1501b56-1e2c-4c47-8eeb-4ab0d02fc348 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:31.184392 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1501b56-1e2c-4c47-8eeb-4ab0d02fc348 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:31.196726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-471fcf38-706d-448b-9228-354f73692c98 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:31.205017 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-471fcf38-706d-448b-9228-354f73692c98 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7" status: 200 len: 1367 microversion: 2.1 time: 0.744615 Oct 29 03:14:31.213853 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2296/4792] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:30 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7 => generated 1367 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:14:31.236206 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-d1501b56-1e2c-4c47-8eeb-4ab0d02fc348 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lazy-loading 'flavor' on Instance uuid 916c0747-3241-4cf8-9085-57e392ee5e6a {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:14:31.259246 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d1501b56-1e2c-4c47-8eeb-4ab0d02fc348 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "PUT /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags/tempest-tag-1920237829" status: 201 len: 0 microversion: 2.26 time: 0.205283 Oct 29 03:14:31.261271 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2497/4793] 10.222.0.46 () {62 vars in 1380 bytes} [Sat Oct 29 03:14:31 2022] PUT /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags/tempest-tag-1920237829 => generated 0 bytes in 208 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 29 03:14:31.271523 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b14be2f0-e826-47db-b0e8-a9ffa7514292 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '.version_select at 0x7ff052d10280>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:31.283484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b14be2f0-e826-47db-b0e8-a9ffa7514292 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:31.284283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b14be2f0-e826-47db-b0e8-a9ffa7514292 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:31.284941 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b14be2f0-e826-47db-b0e8-a9ffa7514292 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:31.285647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b14be2f0-e826-47db-b0e8-a9ffa7514292 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:31.330049 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b14be2f0-e826-47db-b0e8-a9ffa7514292 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:31.334134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b14be2f0-e826-47db-b0e8-a9ffa7514292 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:31.343093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b14be2f0-e826-47db-b0e8-a9ffa7514292 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:31.345446 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b14be2f0-e826-47db-b0e8-a9ffa7514292 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:31.352761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b14be2f0-e826-47db-b0e8-a9ffa7514292 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:31.353346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b14be2f0-e826-47db-b0e8-a9ffa7514292 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:31.444305 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b14be2f0-e826-47db-b0e8-a9ffa7514292 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:31.445019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b14be2f0-e826-47db-b0e8-a9ffa7514292 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:31.447387 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b14be2f0-e826-47db-b0e8-a9ffa7514292 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:31.463981 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b14be2f0-e826-47db-b0e8-a9ffa7514292 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:31.464720 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b14be2f0-e826-47db-b0e8-a9ffa7514292 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:31.465301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b14be2f0-e826-47db-b0e8-a9ffa7514292 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:31.500200 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-b14be2f0-e826-47db-b0e8-a9ffa7514292 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lazy-loading 'flavor' on Instance uuid 916c0747-3241-4cf8-9085-57e392ee5e6a {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:14:31.527415 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b14be2f0-e826-47db-b0e8-a9ffa7514292 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "PUT /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags/tempest-tag-1883192118" status: 201 len: 0 microversion: 2.26 time: 0.259380 Oct 29 03:14:31.536570 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2297/4794] 10.222.0.46 () {62 vars in 1380 bytes} [Sat Oct 29 03:14:31 2022] PUT /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags/tempest-tag-1883192118 => generated 0 bytes in 270 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 29 03:14:31.541969 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-34950549-b9a4-4125-953e-b3f3cc75c6c5 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '.version_select at 0x7ff05340fe50>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:31.558139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34950549-b9a4-4125-953e-b3f3cc75c6c5 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:31.558693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34950549-b9a4-4125-953e-b3f3cc75c6c5 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:31.559976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34950549-b9a4-4125-953e-b3f3cc75c6c5 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:31.560489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-34950549-b9a4-4125-953e-b3f3cc75c6c5 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:31.582186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34950549-b9a4-4125-953e-b3f3cc75c6c5 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:31.582858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34950549-b9a4-4125-953e-b3f3cc75c6c5 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:31.583372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34950549-b9a4-4125-953e-b3f3cc75c6c5 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:31.584180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34950549-b9a4-4125-953e-b3f3cc75c6c5 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:31.584672 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34950549-b9a4-4125-953e-b3f3cc75c6c5 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:31.585107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34950549-b9a4-4125-953e-b3f3cc75c6c5 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:31.630431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34950549-b9a4-4125-953e-b3f3cc75c6c5 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:31.635797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34950549-b9a4-4125-953e-b3f3cc75c6c5 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:31.636484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34950549-b9a4-4125-953e-b3f3cc75c6c5 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:31.673258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-34950549-b9a4-4125-953e-b3f3cc75c6c5 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lazy-loading 'flavor' on Instance uuid 916c0747-3241-4cf8-9085-57e392ee5e6a {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:14:31.722547 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-34950549-b9a4-4125-953e-b3f3cc75c6c5 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "DELETE /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags" status: 204 len: 0 microversion: 2.26 time: 0.187910 Oct 29 03:14:31.723422 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2498/4795] 10.222.0.46 () {60 vars in 1295 bytes} [Sat Oct 29 03:14:31 2022] DELETE /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 29 03:14:31.732565 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ebdc390c-4e7f-41f4-bd96-3022908b96a2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '.version_select at 0x7ff052c25ca0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:31.742967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ebdc390c-4e7f-41f4-bd96-3022908b96a2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:31.743849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ebdc390c-4e7f-41f4-bd96-3022908b96a2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:31.744441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ebdc390c-4e7f-41f4-bd96-3022908b96a2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:31.755564 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ebdc390c-4e7f-41f4-bd96-3022908b96a2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags" status: 200 len: 12 microversion: 2.26 time: 0.027539 Oct 29 03:14:31.763769 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2298/4796] 10.222.0.46 () {60 vars in 1292 bytes} [Sat Oct 29 03:14:31 2022] GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags => generated 12 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:31.767100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ca47dece-cb09-4a6d-b2c8-3845f986db47 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '.version_select at 0x7ff0533ebd30>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:31.779576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca47dece-cb09-4a6d-b2c8-3845f986db47 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:31.779989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca47dece-cb09-4a6d-b2c8-3845f986db47 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:31.780433 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca47dece-cb09-4a6d-b2c8-3845f986db47 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:31.792559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ca47dece-cb09-4a6d-b2c8-3845f986db47 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:31.802227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca47dece-cb09-4a6d-b2c8-3845f986db47 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:31.802765 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca47dece-cb09-4a6d-b2c8-3845f986db47 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:31.803216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca47dece-cb09-4a6d-b2c8-3845f986db47 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:31.804100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca47dece-cb09-4a6d-b2c8-3845f986db47 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:31.804603 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca47dece-cb09-4a6d-b2c8-3845f986db47 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:31.805043 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca47dece-cb09-4a6d-b2c8-3845f986db47 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:31.833958 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca47dece-cb09-4a6d-b2c8-3845f986db47 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:31.834453 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca47dece-cb09-4a6d-b2c8-3845f986db47 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:31.834945 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca47dece-cb09-4a6d-b2c8-3845f986db47 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:31.850652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-ca47dece-cb09-4a6d-b2c8-3845f986db47 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lazy-loading 'flavor' on Instance uuid 916c0747-3241-4cf8-9085-57e392ee5e6a {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:14:31.891400 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ca47dece-cb09-4a6d-b2c8-3845f986db47 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "DELETE /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags" status: 204 len: 0 microversion: 2.26 time: 0.126954 Oct 29 03:14:31.893977 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2499/4797] 10.222.0.46 () {60 vars in 1295 bytes} [Sat Oct 29 03:14:31 2022] DELETE /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:14:31.901961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d4199d26-ad15-48d9-ac02-96dc0d152e4e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '.version_select at 0x7ff052d10e50>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:31.915983 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d4199d26-ad15-48d9-ac02-96dc0d152e4e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:31.916475 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d4199d26-ad15-48d9-ac02-96dc0d152e4e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:31.917701 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d4199d26-ad15-48d9-ac02-96dc0d152e4e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:31.918210 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d4199d26-ad15-48d9-ac02-96dc0d152e4e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:31.926241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d4199d26-ad15-48d9-ac02-96dc0d152e4e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:31.927572 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d4199d26-ad15-48d9-ac02-96dc0d152e4e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:31.928452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d4199d26-ad15-48d9-ac02-96dc0d152e4e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:31.929383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d4199d26-ad15-48d9-ac02-96dc0d152e4e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:31.929998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d4199d26-ad15-48d9-ac02-96dc0d152e4e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:31.930580 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d4199d26-ad15-48d9-ac02-96dc0d152e4e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:31.966304 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d4199d26-ad15-48d9-ac02-96dc0d152e4e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:31.967151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d4199d26-ad15-48d9-ac02-96dc0d152e4e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:31.968331 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d4199d26-ad15-48d9-ac02-96dc0d152e4e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:31.981291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d4199d26-ad15-48d9-ac02-96dc0d152e4e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:31.982638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d4199d26-ad15-48d9-ac02-96dc0d152e4e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:31.984132 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d4199d26-ad15-48d9-ac02-96dc0d152e4e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:32.030376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-d4199d26-ad15-48d9-ac02-96dc0d152e4e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lazy-loading 'flavor' on Instance uuid 916c0747-3241-4cf8-9085-57e392ee5e6a {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:14:32.055657 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d4199d26-ad15-48d9-ac02-96dc0d152e4e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "PUT /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags/tempest-tag-288077064" status: 201 len: 0 microversion: 2.26 time: 0.158012 Oct 29 03:14:32.068515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8c67d0d3-3f2a-4d27-bfdd-3c91bed66b50 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '.version_select at 0x7ff05c1a4b80>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:32.074150 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2299/4798] 10.222.0.46 () {62 vars in 1377 bytes} [Sat Oct 29 03:14:31 2022] PUT /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags/tempest-tag-288077064 => generated 0 bytes in 177 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 29 03:14:32.088238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c67d0d3-3f2a-4d27-bfdd-3c91bed66b50 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:32.091250 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c67d0d3-3f2a-4d27-bfdd-3c91bed66b50 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:32.094709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c67d0d3-3f2a-4d27-bfdd-3c91bed66b50 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:32.096100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8c67d0d3-3f2a-4d27-bfdd-3c91bed66b50 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:32.102921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c67d0d3-3f2a-4d27-bfdd-3c91bed66b50 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:32.103841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c67d0d3-3f2a-4d27-bfdd-3c91bed66b50 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:32.104768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c67d0d3-3f2a-4d27-bfdd-3c91bed66b50 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:32.105943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c67d0d3-3f2a-4d27-bfdd-3c91bed66b50 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:32.106644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c67d0d3-3f2a-4d27-bfdd-3c91bed66b50 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:32.107266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c67d0d3-3f2a-4d27-bfdd-3c91bed66b50 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:32.181687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c67d0d3-3f2a-4d27-bfdd-3c91bed66b50 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:32.181687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c67d0d3-3f2a-4d27-bfdd-3c91bed66b50 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:32.181687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c67d0d3-3f2a-4d27-bfdd-3c91bed66b50 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:32.185639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c67d0d3-3f2a-4d27-bfdd-3c91bed66b50 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:32.185639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c67d0d3-3f2a-4d27-bfdd-3c91bed66b50 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:32.186332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c67d0d3-3f2a-4d27-bfdd-3c91bed66b50 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:32.223410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-8c67d0d3-3f2a-4d27-bfdd-3c91bed66b50 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lazy-loading 'flavor' on Instance uuid 916c0747-3241-4cf8-9085-57e392ee5e6a {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:14:32.242792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-15c3097e-bc9a-41e0-a4d8-83e6c81b2e48 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:32.244609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-15c3097e-bc9a-41e0-a4d8-83e6c81b2e48 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:32.258366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-15c3097e-bc9a-41e0-a4d8-83e6c81b2e48 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:32.259077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-15c3097e-bc9a-41e0-a4d8-83e6c81b2e48 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:32.264857 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-15c3097e-bc9a-41e0-a4d8-83e6c81b2e48 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:32.265855 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-15c3097e-bc9a-41e0-a4d8-83e6c81b2e48 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:32.267737 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-15c3097e-bc9a-41e0-a4d8-83e6c81b2e48 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:32.268690 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-15c3097e-bc9a-41e0-a4d8-83e6c81b2e48 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:32.274768 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8c67d0d3-3f2a-4d27-bfdd-3c91bed66b50 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "PUT /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags/tempest-tag-1319492473" status: 201 len: 0 microversion: 2.26 time: 0.211704 Oct 29 03:14:32.285282 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2500/4799] 10.222.0.46 () {62 vars in 1380 bytes} [Sat Oct 29 03:14:32 2022] PUT /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags/tempest-tag-1319492473 => generated 0 bytes in 223 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 29 03:14:32.296052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-60fb1d46-23a9-462c-aa05-11b122357354 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Action: 'update_all', calling method: .version_select at 0x7ff0533eeca0>, body: {"tags": ["tempest-tag-1163678037", "tempest-tag-943282470"]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:32.340438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60fb1d46-23a9-462c-aa05-11b122357354 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:32.354446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60fb1d46-23a9-462c-aa05-11b122357354 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:32.360293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60fb1d46-23a9-462c-aa05-11b122357354 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:32.366187 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-60fb1d46-23a9-462c-aa05-11b122357354 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:32.393128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60fb1d46-23a9-462c-aa05-11b122357354 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:32.393128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60fb1d46-23a9-462c-aa05-11b122357354 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:32.396595 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60fb1d46-23a9-462c-aa05-11b122357354 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:32.397528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60fb1d46-23a9-462c-aa05-11b122357354 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:32.401384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60fb1d46-23a9-462c-aa05-11b122357354 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:32.407097 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60fb1d46-23a9-462c-aa05-11b122357354 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:32.463927 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60fb1d46-23a9-462c-aa05-11b122357354 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:32.467669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60fb1d46-23a9-462c-aa05-11b122357354 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:32.471435 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60fb1d46-23a9-462c-aa05-11b122357354 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:32.511105 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-60fb1d46-23a9-462c-aa05-11b122357354 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lazy-loading 'flavor' on Instance uuid 916c0747-3241-4cf8-9085-57e392ee5e6a {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:14:32.551894 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-60fb1d46-23a9-462c-aa05-11b122357354 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "PUT /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags" status: 200 len: 61 microversion: 2.26 time: 0.264678 Oct 29 03:14:32.554892 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2501/4800] 10.222.0.46 () {62 vars in 1312 bytes} [Sat Oct 29 03:14:32 2022] PUT /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags => generated 61 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:32.565233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-45df70d0-f837-49f7-a187-f2d4409db4d3 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '.version_select at 0x7ff058a13c10>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:32.574349 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45df70d0-f837-49f7-a187-f2d4409db4d3 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:32.575127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45df70d0-f837-49f7-a187-f2d4409db4d3 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:32.575746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45df70d0-f837-49f7-a187-f2d4409db4d3 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:32.586792 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-45df70d0-f837-49f7-a187-f2d4409db4d3 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags" status: 200 len: 61 microversion: 2.26 time: 0.025829 Oct 29 03:14:32.593283 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2502/4801] 10.222.0.46 () {60 vars in 1292 bytes} [Sat Oct 29 03:14:32 2022] GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags => generated 61 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:14:32.599902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c5bbb498-5195-4ad6-995c-a82809b774d2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '.version_select at 0x7ff053db6700>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:32.624070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5bbb498-5195-4ad6-995c-a82809b774d2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:32.625305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5bbb498-5195-4ad6-995c-a82809b774d2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:32.626204 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5bbb498-5195-4ad6-995c-a82809b774d2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:32.626820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c5bbb498-5195-4ad6-995c-a82809b774d2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:32.637135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5bbb498-5195-4ad6-995c-a82809b774d2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:32.638234 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5bbb498-5195-4ad6-995c-a82809b774d2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:32.638552 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5bbb498-5195-4ad6-995c-a82809b774d2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:32.640017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5bbb498-5195-4ad6-995c-a82809b774d2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:32.640647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5bbb498-5195-4ad6-995c-a82809b774d2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:32.641288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5bbb498-5195-4ad6-995c-a82809b774d2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:32.658960 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-15c3097e-bc9a-41e0-a4d8-83e6c81b2e48 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:32.668886 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-15c3097e-bc9a-41e0-a4d8-83e6c81b2e48 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7" status: 200 len: 1367 microversion: 2.1 time: 0.430994 Oct 29 03:14:32.669906 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2300/4802] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:32 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7 => generated 1367 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:14:32.686764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5bbb498-5195-4ad6-995c-a82809b774d2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:32.686764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5bbb498-5195-4ad6-995c-a82809b774d2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:32.686764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5bbb498-5195-4ad6-995c-a82809b774d2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:32.709387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-c5bbb498-5195-4ad6-995c-a82809b774d2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lazy-loading 'flavor' on Instance uuid 916c0747-3241-4cf8-9085-57e392ee5e6a {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:14:32.741332 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c5bbb498-5195-4ad6-995c-a82809b774d2 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "DELETE /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags" status: 204 len: 0 microversion: 2.26 time: 0.146807 Oct 29 03:14:32.744037 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2503/4803] 10.222.0.46 () {60 vars in 1295 bytes} [Sat Oct 29 03:14:32 2022] DELETE /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a/tags => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:14:32.755790 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f8bb0260-3aa1-4eaf-893a-c6256dcb1203 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:32.757790 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f8bb0260-3aa1-4eaf-893a-c6256dcb1203 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:32.773120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f8bb0260-3aa1-4eaf-893a-c6256dcb1203 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:32.774084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f8bb0260-3aa1-4eaf-893a-c6256dcb1203 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:32.774676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f8bb0260-3aa1-4eaf-893a-c6256dcb1203 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:32.775934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f8bb0260-3aa1-4eaf-893a-c6256dcb1203 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:32.776622 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f8bb0260-3aa1-4eaf-893a-c6256dcb1203 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:32.778646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f8bb0260-3aa1-4eaf-893a-c6256dcb1203 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:32.812767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:32.817539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f8bb0260-3aa1-4eaf-893a-c6256dcb1203 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:14:32.961705 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f8bb0260-3aa1-4eaf-893a-c6256dcb1203 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "DELETE /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a" status: 204 len: 0 microversion: 2.26 time: 0.210950 Oct 29 03:14:32.966517 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2301/4804] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Oct 29 03:14:32 2022] DELETE /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:14:32.972658 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0f2c4cba-eb6f-49c3-82b3-2c44b56bf5d9 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:32.973846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0f2c4cba-eb6f-49c3-82b3-2c44b56bf5d9 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:32.981857 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f2c4cba-eb6f-49c3-82b3-2c44b56bf5d9 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:32.987663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f2c4cba-eb6f-49c3-82b3-2c44b56bf5d9 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:32.988229 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f2c4cba-eb6f-49c3-82b3-2c44b56bf5d9 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:32.989244 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f2c4cba-eb6f-49c3-82b3-2c44b56bf5d9 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:32.989742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f2c4cba-eb6f-49c3-82b3-2c44b56bf5d9 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:32.990689 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f2c4cba-eb6f-49c3-82b3-2c44b56bf5d9 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:33.695430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-afeea552-0b17-47c0-94a3-8e61e7ba57c6 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:33.698500 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-afeea552-0b17-47c0-94a3-8e61e7ba57c6 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:33.706708 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-afeea552-0b17-47c0-94a3-8e61e7ba57c6 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:33.707498 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-afeea552-0b17-47c0-94a3-8e61e7ba57c6 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:33.708366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-afeea552-0b17-47c0-94a3-8e61e7ba57c6 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:33.709557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-afeea552-0b17-47c0-94a3-8e61e7ba57c6 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:33.710229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-afeea552-0b17-47c0-94a3-8e61e7ba57c6 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:33.710856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-afeea552-0b17-47c0-94a3-8e61e7ba57c6 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:33.733456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0f2c4cba-eb6f-49c3-82b3-2c44b56bf5d9 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:33.748035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0f2c4cba-eb6f-49c3-82b3-2c44b56bf5d9 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:33.753212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0f2c4cba-eb6f-49c3-82b3-2c44b56bf5d9 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:33.754812 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0f2c4cba-eb6f-49c3-82b3-2c44b56bf5d9 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a" status: 200 len: 1552 microversion: 2.26 time: 0.786940 Oct 29 03:14:33.756866 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2504/4805] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:14:32 2022] GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a => generated 1552 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:14:34.195523 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-afeea552-0b17-47c0-94a3-8e61e7ba57c6 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:34.211077 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-afeea552-0b17-47c0-94a3-8e61e7ba57c6 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7" status: 200 len: 1367 microversion: 2.1 time: 0.519662 Oct 29 03:14:34.229157 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2302/4806] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:33 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7 => generated 1367 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:34.787201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c76a6ebd-7bc0-473d-904e-d5c473c4469e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:34.787883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c76a6ebd-7bc0-473d-904e-d5c473c4469e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:34.794915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c76a6ebd-7bc0-473d-904e-d5c473c4469e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:34.795768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c76a6ebd-7bc0-473d-904e-d5c473c4469e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:34.796356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c76a6ebd-7bc0-473d-904e-d5c473c4469e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:34.797249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c76a6ebd-7bc0-473d-904e-d5c473c4469e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:34.797845 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c76a6ebd-7bc0-473d-904e-d5c473c4469e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:34.798414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c76a6ebd-7bc0-473d-904e-d5c473c4469e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:35.236342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-28ee8bd9-06db-4a35-9b83-fbc8c4ced1d0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:35.237226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-28ee8bd9-06db-4a35-9b83-fbc8c4ced1d0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:35.247662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28ee8bd9-06db-4a35-9b83-fbc8c4ced1d0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:35.248158 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28ee8bd9-06db-4a35-9b83-fbc8c4ced1d0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:35.252197 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28ee8bd9-06db-4a35-9b83-fbc8c4ced1d0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:35.253193 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28ee8bd9-06db-4a35-9b83-fbc8c4ced1d0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:35.254766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28ee8bd9-06db-4a35-9b83-fbc8c4ced1d0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:35.255393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-28ee8bd9-06db-4a35-9b83-fbc8c4ced1d0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:35.613451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c76a6ebd-7bc0-473d-904e-d5c473c4469e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:35.653122 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c76a6ebd-7bc0-473d-904e-d5c473c4469e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:35.658209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c76a6ebd-7bc0-473d-904e-d5c473c4469e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:35.659491 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c76a6ebd-7bc0-473d-904e-d5c473c4469e tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a" status: 200 len: 1552 microversion: 2.26 time: 0.876431 Oct 29 03:14:35.681917 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2505/4807] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:14:34 2022] GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a => generated 1552 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:14:35.943478 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-28ee8bd9-06db-4a35-9b83-fbc8c4ced1d0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:35.958968 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-28ee8bd9-06db-4a35-9b83-fbc8c4ced1d0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7" status: 200 len: 1367 microversion: 2.1 time: 0.727556 Oct 29 03:14:35.972989 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2303/4808] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:35 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7 => generated 1367 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:36.322005 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-d15f19da-2fd4-4d8b-a53b-4cb54ad8942a req-6ccfcbf5-a41c-412c-b329-283b976e50f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2493755-2599-4a13-a4bd-d5104e0d22b7", "name": "network-vif-plugged", "status": "completed", "tag": "b0bf68ca-62d2-43a2-9aff-8be72aa3cd0f"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:36.342740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d15f19da-2fd4-4d8b-a53b-4cb54ad8942a req-6ccfcbf5-a41c-412c-b329-283b976e50f4 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:36.343220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d15f19da-2fd4-4d8b-a53b-4cb54ad8942a req-6ccfcbf5-a41c-412c-b329-283b976e50f4 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:36.343650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d15f19da-2fd4-4d8b-a53b-4cb54ad8942a req-6ccfcbf5-a41c-412c-b329-283b976e50f4 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:36.390409 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-d15f19da-2fd4-4d8b-a53b-4cb54ad8942a req-6ccfcbf5-a41c-412c-b329-283b976e50f4 service nova] Creating event network-vif-plugged:b0bf68ca-62d2-43a2-9aff-8be72aa3cd0f for instance f2493755-2599-4a13-a4bd-d5104e0d22b7 on n-h1-862967-2 Oct 29 03:14:36.409719 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-d15f19da-2fd4-4d8b-a53b-4cb54ad8942a req-6ccfcbf5-a41c-412c-b329-283b976e50f4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091904 Oct 29 03:14:36.410670 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2506/4809] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:14:36.701080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a1a2a3bd-043c-4a77-9c78-f4b79edb51c8 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:36.703106 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a1a2a3bd-043c-4a77-9c78-f4b79edb51c8 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:36.707665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:36.731594 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1a2a3bd-043c-4a77-9c78-f4b79edb51c8 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:36.732384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1a2a3bd-043c-4a77-9c78-f4b79edb51c8 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:36.734896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1a2a3bd-043c-4a77-9c78-f4b79edb51c8 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:36.735959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1a2a3bd-043c-4a77-9c78-f4b79edb51c8 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:36.736589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1a2a3bd-043c-4a77-9c78-f4b79edb51c8 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:36.739671 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1a2a3bd-043c-4a77-9c78-f4b79edb51c8 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:36.987625 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-079fe5c5-e1b1-4d6d-b3ab-257a0d1a7518 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:36.988491 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-079fe5c5-e1b1-4d6d-b3ab-257a0d1a7518 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:37.002338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-079fe5c5-e1b1-4d6d-b3ab-257a0d1a7518 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:37.003989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-079fe5c5-e1b1-4d6d-b3ab-257a0d1a7518 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:37.004624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-079fe5c5-e1b1-4d6d-b3ab-257a0d1a7518 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:37.005746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-079fe5c5-e1b1-4d6d-b3ab-257a0d1a7518 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:37.010450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-079fe5c5-e1b1-4d6d-b3ab-257a0d1a7518 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:37.011197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-079fe5c5-e1b1-4d6d-b3ab-257a0d1a7518 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:37.095578 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a1a2a3bd-043c-4a77-9c78-f4b79edb51c8 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:37.110881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a1a2a3bd-043c-4a77-9c78-f4b79edb51c8 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:37.115689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a1a2a3bd-043c-4a77-9c78-f4b79edb51c8 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:37.119308 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a1a2a3bd-043c-4a77-9c78-f4b79edb51c8 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a" status: 200 len: 1552 microversion: 2.26 time: 0.422999 Oct 29 03:14:37.121794 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2304/4810] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:14:36 2022] GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a => generated 1552 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:14:37.684472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-98afc567-e97a-440d-8a2d-bcd547f7fd6a req-fb1ed7e6-0497-4ab4-8b5c-ac75753e5ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "916c0747-3241-4cf8-9085-57e392ee5e6a", "name": "network-vif-deleted", "tag": "8d59506e-b7aa-4a47-8f5f-5b451e420148"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:37.706224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-98afc567-e97a-440d-8a2d-bcd547f7fd6a req-fb1ed7e6-0497-4ab4-8b5c-ac75753e5ddf service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:37.706754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-98afc567-e97a-440d-8a2d-bcd547f7fd6a req-fb1ed7e6-0497-4ab4-8b5c-ac75753e5ddf service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:37.707180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-98afc567-e97a-440d-8a2d-bcd547f7fd6a req-fb1ed7e6-0497-4ab4-8b5c-ac75753e5ddf service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:37.730912 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-98afc567-e97a-440d-8a2d-bcd547f7fd6a req-fb1ed7e6-0497-4ab4-8b5c-ac75753e5ddf service nova] Creating event network-vif-deleted:8d59506e-b7aa-4a47-8f5f-5b451e420148 for instance 916c0747-3241-4cf8-9085-57e392ee5e6a on n-h2-862967-2 Oct 29 03:14:37.746900 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-98afc567-e97a-440d-8a2d-bcd547f7fd6a req-fb1ed7e6-0497-4ab4-8b5c-ac75753e5ddf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066527 Oct 29 03:14:37.747523 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2305/4811] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:14:37.792236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-079fe5c5-e1b1-4d6d-b3ab-257a0d1a7518 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:37.838225 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-079fe5c5-e1b1-4d6d-b3ab-257a0d1a7518 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7" status: 200 len: 1367 microversion: 2.1 time: 0.854936 Oct 29 03:14:37.843202 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2507/4812] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:36 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7 => generated 1367 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:14:38.156339 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ee414e84-db58-4b6c-81f2-a651c4a5877d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:38.157535 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ee414e84-db58-4b6c-81f2-a651c4a5877d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:38.175393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee414e84-db58-4b6c-81f2-a651c4a5877d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:38.182072 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee414e84-db58-4b6c-81f2-a651c4a5877d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:38.182648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee414e84-db58-4b6c-81f2-a651c4a5877d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:38.183435 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee414e84-db58-4b6c-81f2-a651c4a5877d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:38.183912 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee414e84-db58-4b6c-81f2-a651c4a5877d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:38.184342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee414e84-db58-4b6c-81f2-a651c4a5877d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:38.270670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee414e84-db58-4b6c-81f2-a651c4a5877d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:38.271256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee414e84-db58-4b6c-81f2-a651c4a5877d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:38.275497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee414e84-db58-4b6c-81f2-a651c4a5877d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:38.276075 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-ee414e84-db58-4b6c-81f2-a651c4a5877d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lazy-loading 'fault' on Instance uuid 916c0747-3241-4cf8-9085-57e392ee5e6a {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:14:38.398651 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ee414e84-db58-4b6c-81f2-a651c4a5877d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:38.418241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ee414e84-db58-4b6c-81f2-a651c4a5877d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:38.421524 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ee414e84-db58-4b6c-81f2-a651c4a5877d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9b4b0d5e12044da5ba9796c450080c3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381fb1b5500b4dd6804304ef434619b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:38.423515 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ee414e84-db58-4b6c-81f2-a651c4a5877d tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a" status: 200 len: 1351 microversion: 2.26 time: 0.275008 Oct 29 03:14:38.425129 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2306/4813] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:14:38 2022] GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a => generated 1351 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:14:38.870285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c14e516f-1c64-4b6f-8c7a-db5ec8c5dcbc tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:38.870902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c14e516f-1c64-4b6f-8c7a-db5ec8c5dcbc tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:38.884172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c14e516f-1c64-4b6f-8c7a-db5ec8c5dcbc tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:38.884677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c14e516f-1c64-4b6f-8c7a-db5ec8c5dcbc tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:38.885113 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c14e516f-1c64-4b6f-8c7a-db5ec8c5dcbc tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:38.885825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c14e516f-1c64-4b6f-8c7a-db5ec8c5dcbc tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:38.892828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c14e516f-1c64-4b6f-8c7a-db5ec8c5dcbc tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:38.893320 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c14e516f-1c64-4b6f-8c7a-db5ec8c5dcbc tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:39.452848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f45fc269-12bc-40b8-b5e9-19b174d2bb70 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:39.455234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f45fc269-12bc-40b8-b5e9-19b174d2bb70 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] [instance: 916c0747-3241-4cf8-9085-57e392ee5e6a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:39.484263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f45fc269-12bc-40b8-b5e9-19b174d2bb70 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:39.493478 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f45fc269-12bc-40b8-b5e9-19b174d2bb70 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:39.501249 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f45fc269-12bc-40b8-b5e9-19b174d2bb70 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:39.502025 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f45fc269-12bc-40b8-b5e9-19b174d2bb70 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:39.502500 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f45fc269-12bc-40b8-b5e9-19b174d2bb70 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:39.502939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f45fc269-12bc-40b8-b5e9-19b174d2bb70 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:39.560907 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-f45fc269-12bc-40b8-b5e9-19b174d2bb70 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] HTTP exception thrown: Instance 916c0747-3241-4cf8-9085-57e392ee5e6a could not be found. Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f45fc269-12bc-40b8-b5e9-19b174d2bb70 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Request method failure captured: Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a HTTP/1.1 Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJp6VYdpRIV8qVW7VzoJMz-GyLwOptsxHMmfcWM-0ZRlaKz8BlKqaZ9IHeJydeXFlEU60pk37v5LefIZQqFFwhl7zEuJQprUPQdNyu-r061yYHIBw1YiD0N6fTAELP7cEUzINiDFXG4Wne0Gw-FDsqVd9EOw1D-eQA8qU-G_P1jk83E Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: X-Openstack-Nova-Api-Version: 2.26 Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 381fb1b5500b4dd6804304ef434619b4 Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerTagsTestJSON-266609823 Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/381fb1b5500b4dd6804304ef434619b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/381fb1b5500b4dd6804304ef434619b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_381fb1b5500b4dd6804304ef434619b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/381fb1b5500b4dd6804304ef434619b4"}]}] Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerTagsTestJSON-266609823 Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 381fb1b5500b4dd6804304ef434619b4 Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerTagsTestJSON-266609823 Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerTagsTestJSON-266609823-project Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 9b4b0d5e12044da5ba9796c450080c3f Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerTagsTestJSON-266609823-project Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 916c0747-3241-4cf8-9085-57e392ee5e6a could not be found. Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '916c0747-3241-4cf8-9085-57e392ee5e6a'} Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 916c0747-3241-4cf8-9085-57e392ee5e6a could not be found. Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 916c0747-3241-4cf8-9085-57e392ee5e6a could not be found. Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:39.573284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:39.577907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:39.577907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:14:39.577907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:14:39.577907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:14:39.577907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:14:39.577907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 916c0747-3241-4cf8-9085-57e392ee5e6a could not be found. Oct 29 03:14:39.577907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:39.579570 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f45fc269-12bc-40b8-b5e9-19b174d2bb70 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] Returning 404 to user: Instance 916c0747-3241-4cf8-9085-57e392ee5e6a could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:14:39.582099 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f45fc269-12bc-40b8-b5e9-19b174d2bb70 tempest-ServerTagsTestJSON-266609823 tempest-ServerTagsTestJSON-266609823-project] 10.222.0.46 "GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a" status: 404 len: 111 microversion: 2.26 time: 0.135580 Oct 29 03:14:39.584623 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2307/4814] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:14:39 2022] GET /compute/v2.1/servers/916c0747-3241-4cf8-9085-57e392ee5e6a => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 29 03:14:39.799155 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c14e516f-1c64-4b6f-8c7a-db5ec8c5dcbc tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:14:39.814248 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c14e516f-1c64-4b6f-8c7a-db5ec8c5dcbc tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7" status: 200 len: 1557 microversion: 2.1 time: 0.947791 Oct 29 03:14:39.818322 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2508/4815] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:38 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7 => generated 1557 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:14:39.847326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f7aac184-2c6f-4a1e-816d-1398d812c239 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:39.848063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f7aac184-2c6f-4a1e-816d-1398d812c239 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:14:39.859329 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f7aac184-2c6f-4a1e-816d-1398d812c239 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:39.861089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f7aac184-2c6f-4a1e-816d-1398d812c239 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:39.862289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f7aac184-2c6f-4a1e-816d-1398d812c239 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:39.863209 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f7aac184-2c6f-4a1e-816d-1398d812c239 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:39.865437 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f7aac184-2c6f-4a1e-816d-1398d812c239 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:39.868251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f7aac184-2c6f-4a1e-816d-1398d812c239 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:40.025978 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f7aac184-2c6f-4a1e-816d-1398d812c239 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.186501 Oct 29 03:14:40.027790 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2308/4816] 10.222.0.46 () {58 vars in 1275 bytes} [Sat Oct 29 03:14:39 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7/os-interface => generated 285 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:14:42.699500 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-258213bd-1535-44c8-9978-3c31c5634cfd tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Calling method '.version_select at 0x7ff058a13c10>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:42.789610 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-258213bd-1535-44c8-9978-3c31c5634cfd tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] 10.222.0.46 "GET /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690" status: 200 len: 636 microversion: 2.1 time: 0.094619 Oct 29 03:14:42.808172 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2509/4817] 10.222.0.46 () {58 vars in 1233 bytes} [Sat Oct 29 03:14:42 2022] GET /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690 => generated 636 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:14:42.813448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7f48c804-b790-408b-8929-fc2fd8c78d0f tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Action: 'update_all', calling method: .version_select at 0x7ff052cf24c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:42.894465 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-7f48c804-b790-408b-8929-fc2fd8c78d0f tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Getting quotas for project 8ba078dbe9cf40228bd565f975e10359. Resources: dict_keys(['metadata_items']) {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:14:42.920195 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-7f48c804-b790-408b-8929-fc2fd8c78d0f tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Getting quotas for user 2d8bd598405b4068956a69f806b462d6 and project 8ba078dbe9cf40228bd565f975e10359. Resources: dict_keys(['metadata_items']) {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:14:43.816492 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7f48c804-b790-408b-8929-fc2fd8c78d0f tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] 10.222.0.46 "PUT /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata" status: 200 len: 61 microversion: 2.1 time: 1.007370 Oct 29 03:14:43.817441 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2309/4818] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Oct 29 03:14:42 2022] PUT /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata => generated 61 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:14:43.838729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8c68d968-dfb1-4707-89cb-9b68a6da5676 tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Calling method '.version_select at 0x7ff053e0e820>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:43.844159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-c07c897c-8a3f-45d8-b913-c1b9ed13e0f8 req-3848b28a-f067-4747-a09d-8673edf46ace service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2493755-2599-4a13-a4bd-d5104e0d22b7", "tag": "b0bf68ca-62d2-43a2-9aff-8be72aa3cd0f"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:43.912082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c07c897c-8a3f-45d8-b913-c1b9ed13e0f8 req-3848b28a-f067-4747-a09d-8673edf46ace service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:14:43.912866 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c07c897c-8a3f-45d8-b913-c1b9ed13e0f8 req-3848b28a-f067-4747-a09d-8673edf46ace service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:14:43.913483 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c07c897c-8a3f-45d8-b913-c1b9ed13e0f8 req-3848b28a-f067-4747-a09d-8673edf46ace service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:14:43.933234 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-c07c897c-8a3f-45d8-b913-c1b9ed13e0f8 req-3848b28a-f067-4747-a09d-8673edf46ace service nova] Creating event network-changed:b0bf68ca-62d2-43a2-9aff-8be72aa3cd0f for instance f2493755-2599-4a13-a4bd-d5104e0d22b7 on n-h1-862967-2 Oct 29 03:14:43.945896 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-c07c897c-8a3f-45d8-b913-c1b9ed13e0f8 req-3848b28a-f067-4747-a09d-8673edf46ace service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111488 Oct 29 03:14:43.947943 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2310/4819] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:14:44.554766 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8c68d968-dfb1-4707-89cb-9b68a6da5676 tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] 10.222.0.46 "DELETE /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.727391 Oct 29 03:14:44.559611 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2510/4820] 10.222.0.46 () {58 vars in 1296 bytes} [Sat Oct 29 03:14:43 2022] DELETE /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata/os_version => generated 0 bytes in 730 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:14:44.566356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-758f471d-2878-488c-867e-79da885a06a2 tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Calling method '.version_select at 0x7ff052cf25e0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:44.636740 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-758f471d-2878-488c-867e-79da885a06a2 tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] 10.222.0.46 "GET /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata" status: 200 len: 37 microversion: 2.1 time: 0.075001 Oct 29 03:14:44.637473 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2311/4821] 10.222.0.46 () {58 vars in 1260 bytes} [Sat Oct 29 03:14:44 2022] GET /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata => generated 37 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:14:44.651437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-80a97805-9bdc-4c37-a208-a84ed5087b81 tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Action: 'update_all', calling method: .version_select at 0x7ff052d5f940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:44.790501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-80a97805-9bdc-4c37-a208-a84ed5087b81 tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Getting quotas for project 8ba078dbe9cf40228bd565f975e10359. Resources: dict_keys(['metadata_items']) {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:14:44.811844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-80a97805-9bdc-4c37-a208-a84ed5087b81 tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Getting quotas for user 2d8bd598405b4068956a69f806b462d6 and project 8ba078dbe9cf40228bd565f975e10359. Resources: dict_keys(['metadata_items']) {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:14:45.652896 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-80a97805-9bdc-4c37-a208-a84ed5087b81 tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] 10.222.0.46 "PUT /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata" status: 200 len: 61 microversion: 2.1 time: 1.005405 Oct 29 03:14:45.653940 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2511/4822] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Oct 29 03:14:44 2022] PUT /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata => generated 61 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:14:45.664471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e4d9c069-5d7f-437b-8689-a8d03d21a0e8 tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Calling method '.version_select at 0x7ff052d10e50>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:45.761761 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e4d9c069-5d7f-437b-8689-a8d03d21a0e8 tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] 10.222.0.46 "GET /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.102229 Oct 29 03:14:45.763097 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2312/4823] 10.222.0.46 () {58 vars in 1290 bytes} [Sat Oct 29 03:14:45 2022] GET /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata/os_distro => generated 33 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:14:45.774669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-04e7b2de-f30b-4a7a-a227-883f9e2b7204 tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Action: 'update_all', calling method: .version_select at 0x7ff053cdbaf0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:45.886806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-04e7b2de-f30b-4a7a-a227-883f9e2b7204 tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Getting quotas for project 8ba078dbe9cf40228bd565f975e10359. Resources: dict_keys(['metadata_items']) {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:14:45.919046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-04e7b2de-f30b-4a7a-a227-883f9e2b7204 tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Getting quotas for user 2d8bd598405b4068956a69f806b462d6 and project 8ba078dbe9cf40228bd565f975e10359. Resources: dict_keys(['metadata_items']) {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:14:46.322838 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-04e7b2de-f30b-4a7a-a227-883f9e2b7204 tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] 10.222.0.46 "PUT /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata" status: 200 len: 61 microversion: 2.1 time: 0.552511 Oct 29 03:14:46.323466 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2512/4824] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Oct 29 03:14:45 2022] PUT /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata => generated 61 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:14:46.337419 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3925dce4-3436-4e0c-8be0-a335fe246ac6 tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Calling method '.version_select at 0x7ff05c22e3a0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:46.471635 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3925dce4-3436-4e0c-8be0-a335fe246ac6 tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] 10.222.0.46 "GET /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata" status: 200 len: 61 microversion: 2.1 time: 0.142013 Oct 29 03:14:46.472584 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2313/4825] 10.222.0.46 () {58 vars in 1260 bytes} [Sat Oct 29 03:14:46 2022] GET /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata => generated 61 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:14:46.483495 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-310426e8-0b13-482b-930a-7446b4b6b0bb tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Action: 'update_all', calling method: .version_select at 0x7ff053cdb0d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:46.612289 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-310426e8-0b13-482b-930a-7446b4b6b0bb tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Getting quotas for project 8ba078dbe9cf40228bd565f975e10359. Resources: dict_keys(['metadata_items']) {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:14:46.640868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-310426e8-0b13-482b-930a-7446b4b6b0bb tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Getting quotas for user 2d8bd598405b4068956a69f806b462d6 and project 8ba078dbe9cf40228bd565f975e10359. Resources: dict_keys(['metadata_items']) {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:14:46.960578 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-310426e8-0b13-482b-930a-7446b4b6b0bb tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] 10.222.0.46 "PUT /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata" status: 200 len: 61 microversion: 2.1 time: 0.481001 Oct 29 03:14:46.966884 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2513/4826] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Oct 29 03:14:46 2022] PUT /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata => generated 61 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:14:46.971495 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7b6f268f-9843-4af1-885d-0cd7f6a664db tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Action: 'update_all', calling method: .version_select at 0x7ff053660e50>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:47.103345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-7b6f268f-9843-4af1-885d-0cd7f6a664db tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Getting quotas for project 8ba078dbe9cf40228bd565f975e10359. Resources: dict_keys(['metadata_items']) {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:14:47.163165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-7b6f268f-9843-4af1-885d-0cd7f6a664db tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Getting quotas for user 2d8bd598405b4068956a69f806b462d6 and project 8ba078dbe9cf40228bd565f975e10359. Resources: dict_keys(['metadata_items']) {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:14:47.905132 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7b6f268f-9843-4af1-885d-0cd7f6a664db tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] 10.222.0.46 "PUT /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata" status: 200 len: 64 microversion: 2.1 time: 0.937665 Oct 29 03:14:47.906059 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2314/4827] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Oct 29 03:14:46 2022] PUT /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata => generated 64 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 03:14:47.917285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-06c3ccf3-88f0-410d-ad39-2bd88c644041 tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Calling method '.version_select at 0x7ff058015310>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:48.005059 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-06c3ccf3-88f0-410d-ad39-2bd88c644041 tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] 10.222.0.46 "GET /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata" status: 200 len: 64 microversion: 2.1 time: 0.092705 Oct 29 03:14:48.007340 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2514/4828] 10.222.0.46 () {58 vars in 1260 bytes} [Sat Oct 29 03:14:47 2022] GET /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata => generated 64 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:14:48.020606 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9516c985-1892-4cb2-a127-daeeb573d94b tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Action: 'update_all', calling method: .version_select at 0x7ff05c1ade50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:48.195374 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-9516c985-1892-4cb2-a127-daeeb573d94b tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Getting quotas for project 8ba078dbe9cf40228bd565f975e10359. Resources: dict_keys(['metadata_items']) {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:14:48.219579 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-9516c985-1892-4cb2-a127-daeeb573d94b tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Getting quotas for user 2d8bd598405b4068956a69f806b462d6 and project 8ba078dbe9cf40228bd565f975e10359. Resources: dict_keys(['metadata_items']) {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:14:48.764476 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9516c985-1892-4cb2-a127-daeeb573d94b tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] 10.222.0.46 "PUT /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata" status: 200 len: 61 microversion: 2.1 time: 0.749963 Oct 29 03:14:48.765255 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2315/4829] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Oct 29 03:14:48 2022] PUT /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata => generated 61 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:14:48.775991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-18b34f16-97fe-435e-bc8c-79151668ff0b tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Action: 'update', calling method: .version_select at 0x7ff0586ef040>, body: {"meta": {"os_version": "alt"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:48.861772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-18b34f16-97fe-435e-bc8c-79151668ff0b tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Getting quotas for project 8ba078dbe9cf40228bd565f975e10359. Resources: dict_keys(['metadata_items']) {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:14:48.894178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-18b34f16-97fe-435e-bc8c-79151668ff0b tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Getting quotas for user 2d8bd598405b4068956a69f806b462d6 and project 8ba078dbe9cf40228bd565f975e10359. Resources: dict_keys(['metadata_items']) {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:14:49.433964 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-18b34f16-97fe-435e-bc8c-79151668ff0b tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] 10.222.0.46 "PUT /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.636585 Oct 29 03:14:49.439385 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2515/4830] 10.222.0.46 () {60 vars in 1313 bytes} [Sat Oct 29 03:14:48 2022] PUT /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata/os_version => generated 31 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:14:49.445545 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-189fabeb-7893-4cf9-9c7b-d826ef363294 tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Calling method '.version_select at 0x7ff053660790>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:49.514558 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-189fabeb-7893-4cf9-9c7b-d826ef363294 tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] 10.222.0.46 "GET /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata" status: 200 len: 58 microversion: 2.1 time: 0.072825 Oct 29 03:14:49.517572 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2316/4831] 10.222.0.46 () {58 vars in 1260 bytes} [Sat Oct 29 03:14:49 2022] GET /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata => generated 58 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:14:49.529794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d9a6bcb7-bb06-40cb-8431-a1c76b8708ed tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Action: 'update_all', calling method: .version_select at 0x7ff058015a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:49.628002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-d9a6bcb7-bb06-40cb-8431-a1c76b8708ed tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Getting quotas for project 8ba078dbe9cf40228bd565f975e10359. Resources: dict_keys(['metadata_items']) {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:14:49.642236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-d9a6bcb7-bb06-40cb-8431-a1c76b8708ed tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Getting quotas for user 2d8bd598405b4068956a69f806b462d6 and project 8ba078dbe9cf40228bd565f975e10359. Resources: dict_keys(['metadata_items']) {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:14:49.807052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=84,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:DELETE=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:50.231493 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d9a6bcb7-bb06-40cb-8431-a1c76b8708ed tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] 10.222.0.46 "PUT /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata" status: 200 len: 61 microversion: 2.1 time: 0.707034 Oct 29 03:14:50.232343 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2516/4832] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Oct 29 03:14:49 2022] PUT /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata => generated 61 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:14:50.242042 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c22c2ab6-cc04-4a9a-b287-99d138129a81 tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Action: 'create', calling method: .version_select at 0x7ff052cf25e0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:50.326426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-c22c2ab6-cc04-4a9a-b287-99d138129a81 tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Getting quotas for project 8ba078dbe9cf40228bd565f975e10359. Resources: dict_keys(['metadata_items']) {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:14:50.338176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-c22c2ab6-cc04-4a9a-b287-99d138129a81 tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Getting quotas for user 2d8bd598405b4068956a69f806b462d6 and project 8ba078dbe9cf40228bd565f975e10359. Resources: dict_keys(['metadata_items']) {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:14:50.765579 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c22c2ab6-cc04-4a9a-b287-99d138129a81 tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] 10.222.0.46 "POST /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata" status: 200 len: 85 microversion: 2.1 time: 0.524954 Oct 29 03:14:50.765579 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2317/4833] 10.222.0.46 () {60 vars in 1281 bytes} [Sat Oct 29 03:14:50 2022] POST /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata => generated 85 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:14:50.777478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b4385cdc-ad5a-4fbb-a8de-50495ef65d38 tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] Calling method '.version_select at 0x7ff0580159d0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:50.846274 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b4385cdc-ad5a-4fbb-a8de-50495ef65d38 tempest-ImagesMetadataTestJSON-1716326926 tempest-ImagesMetadataTestJSON-1716326926-project] 10.222.0.46 "GET /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata" status: 200 len: 85 microversion: 2.1 time: 0.073930 Oct 29 03:14:50.847160 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2517/4834] 10.222.0.46 () {58 vars in 1260 bytes} [Sat Oct 29 03:14:50 2022] GET /compute/v2.1/images/c35effbc-89ba-452d-a3ba-27bcba12a690/metadata => generated 85 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 03:14:55.983445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:56.594732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5d15936f-253e-4cdc-9077-50f75ef11b68 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Action: 'create', calling method: .version_select at 0x7ff053731a60>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAgSMiJGq4fxYCSsKxXUrDmHupq0ExUbcj/ip8+ZYNKVsWGe0XZle7SSTCZnjuJXAG/udRl/ik+LGxrVQ3jhu0yeISHOfsD+Ac+gLJTLZVQMm3/jCg0EmS8MS53WtbQ3Gw=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5d15936f-253e-4cdc-9077-50f75ef11b68 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Request method failure captured: Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 257 Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJqvDx3CLZQX8MB63dDbbx9XMDw2BWrGtnQEC7T58hnNO5UZR8xoLQbQqHm8lFDNnNpCMP4_bY_JhivnSARLhdWSEGlIMdIMAtlQ_5G3hT8-rDc1DzXvQ-9pCYS1Hr8dpoEnKtrk-W_sBO_cNU3Egukf3npdBu8whpI8AqzbFJ3uhEY Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 93153539c1314fcca04bd37875154308 Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-721076295 Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/93153539c1314fcca04bd37875154308"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/93153539c1314fcca04bd37875154308"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_93153539c1314fcca04bd37875154308"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/93153539c1314fcca04bd37875154308"}]}] Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-KeyPairsNegativeTestJSON-721076295 Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 93153539c1314fcca04bd37875154308 Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-721076295 Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-KeyPairsNegativeTestJSON-721076295-project Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 1fee19addcaf4360ab3fe208c2f92667 Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-KeyPairsNegativeTestJSON-721076295-project Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAgSMiJGq4fxYCSsKxXUrDmHupq0ExUbcj/ip8+ZYNKVsWGe0XZle7SSTCZnjuJXAG/udRl/ik+LGxrVQ3jhu0yeISHOfsD+Ac+gLJTLZVQMm3/jCg0EmS8MS53WtbQ3Gw=="}} Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAgSMiJGq4fxYCSsKxXUrDmHupq0ExUbcj/ip8+ZYNKVsWGe0XZle7SSTCZnjuJXAG/udRl/ik+LGxrVQ3jhu0yeISHOfsD+Ac+gLJTLZVQMm3/jCg0EmS8MS53WtbQ3Gw=='}}} Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 29 03:14:56.601066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:56.604885 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:56.604885 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:56.604885 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:56.604885 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:14:56.604885 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:14:56.604885 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:14:56.604885 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:14:56.604885 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:14:56.604885 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:14:56.604885 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:14:56.604885 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:14:56.604885 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:14:56.604885 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:14:56.604885 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 03:14:56.604885 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 03:14:56.604885 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:14:56.604885 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:14:56.604885 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:14:56.604885 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:14:56.604885 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 29 03:14:56.604885 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:56.604885 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:56.604885 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:56.604885 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:56.604885 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:14:56.604885 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:14:56.604885 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:14:56.604885 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:14:56.604885 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 29 03:14:56.604885 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:56.610760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5d15936f-253e-4cdc-9077-50f75ef11b68 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:14:56.617850 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5d15936f-253e-4cdc-9077-50f75ef11b68 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.633911 Oct 29 03:14:56.619040 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2318/4835] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:14:55 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 638 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:14:56.629921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-127efc2a-4d80-439d-8ee7-d6e5b64201b0 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Action: 'create', calling method: .version_select at 0x7ff05c120430>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1767240131", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:56.682870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-127efc2a-4d80-439d-8ee7-d6e5b64201b0 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Getting quotas for project 93153539c1314fcca04bd37875154308. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:14:56.707251 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-127efc2a-4d80-439d-8ee7-d6e5b64201b0 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Getting quotas for user 1fee19addcaf4360ab3fe208c2f92667 and project 93153539c1314fcca04bd37875154308. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:14:56.763938 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-127efc2a-4d80-439d-8ee7-d6e5b64201b0 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-127efc2a-4d80-439d-8ee7-d6e5b64201b0 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Request method failure captured: Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 2167 Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJqvDx3CLZQX8MB63dDbbx9XMDw2BWrGtnQEC7T58hnNO5UZR8xoLQbQqHm8lFDNnNpCMP4_bY_JhivnSARLhdWSEGlIMdIMAtlQ_5G3hT8-rDc1DzXvQ-9pCYS1Hr8dpoEnKtrk-W_sBO_cNU3Egukf3npdBu8whpI8AqzbFJ3uhEY Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 93153539c1314fcca04bd37875154308 Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-721076295 Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/93153539c1314fcca04bd37875154308"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/93153539c1314fcca04bd37875154308"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_93153539c1314fcca04bd37875154308"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/93153539c1314fcca04bd37875154308"}]}] Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-KeyPairsNegativeTestJSON-721076295 Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 93153539c1314fcca04bd37875154308 Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-721076295 Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-KeyPairsNegativeTestJSON-721076295-project Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 1fee19addcaf4360ab3fe208c2f92667 Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-KeyPairsNegativeTestJSON-721076295-project Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1767240131", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 03:14:56.780476 n-d-862967-2 devstack@n-api.service[127124]: exception: Keypair data is invalid: failed to generate fingerprint Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1767240131', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:14:56.782417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:14:56.791339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:14:56.791339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:14:56.791339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:14:56.791339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:14:56.791339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 29 03:14:56.791339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 29 03:14:56.791339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 29 03:14:56.791339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 29 03:14:56.791339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 29 03:14:56.791339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:56.791339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:56.791339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:56.791339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:56.791339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:14:56.791339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:14:56.791339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:14:56.791339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:14:56.791339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 29 03:14:56.791339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:56.791339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-127efc2a-4d80-439d-8ee7-d6e5b64201b0 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:14:56.791339 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-127efc2a-4d80-439d-8ee7-d6e5b64201b0 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.158202 Oct 29 03:14:56.791339 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2518/4836] 10.222.0.46 () {60 vars in 1160 bytes} [Sat Oct 29 03:14:56 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 159 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 03:14:56.795178 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-33bbda6c-35e4-47c3-8046-33fcef4964c6 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Action: 'create', calling method: .version_select at 0x7ff05c1e1670>, body: {"keypair": {"name": "tempest-keypair-1724291620", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxqTmd6XCKg9bfm6ZxK0OPF2KVjFW5v+4ymyTbiXmUMLJd8jupxO/DGP8Yo+KLvcotMAz16J/D9zG6bGlJCIOHdh331RDcSYhr4SFVZ2Q5o9AagxeOHkutA0cwfBASMqQ=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:56.839116 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-33bbda6c-35e4-47c3-8046-33fcef4964c6 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Getting quotas for project 93153539c1314fcca04bd37875154308. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:14:56.862883 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-33bbda6c-35e4-47c3-8046-33fcef4964c6 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Getting quotas for user 1fee19addcaf4360ab3fe208c2f92667 and project 93153539c1314fcca04bd37875154308. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:14:56.923320 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-33bbda6c-35e4-47c3-8046-33fcef4964c6 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.132174 Oct 29 03:14:56.932060 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2319/4837] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:14:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:14:56.938292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-15f29376-8c43-4249-a917-ff1499b48248 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Action: 'create', calling method: .version_select at 0x7ff058045d30>, body: {"keypair": {"name": "tempest-keypair-1724291620", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLocLbMABjVnxF7/m5lwZ4o2okR300dFAPwKsmjzmTEac8gfi/NLezcMTi2xOdj5ws/BsjiW+pFpN4rp6oB0B0QzB25V2ocnLREkBgRJADsd7ylbx1t5Md3Hqgc3j4WFw=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:56.979527 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-15f29376-8c43-4249-a917-ff1499b48248 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Getting quotas for project 93153539c1314fcca04bd37875154308. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:14:57.004694 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-15f29376-8c43-4249-a917-ff1499b48248 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Getting quotas for user 1fee19addcaf4360ab3fe208c2f92667 and project 93153539c1314fcca04bd37875154308. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:14:57.079078 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-15f29376-8c43-4249-a917-ff1499b48248 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] HTTP exception thrown: Key pair 'tempest-keypair-1724291620' already exists. Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-15f29376-8c43-4249-a917-ff1499b48248 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Request method failure captured: Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 273 Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJqvDx3CLZQX8MB63dDbbx9XMDw2BWrGtnQEC7T58hnNO5UZR8xoLQbQqHm8lFDNnNpCMP4_bY_JhivnSARLhdWSEGlIMdIMAtlQ_5G3hT8-rDc1DzXvQ-9pCYS1Hr8dpoEnKtrk-W_sBO_cNU3Egukf3npdBu8whpI8AqzbFJ3uhEY Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 93153539c1314fcca04bd37875154308 Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-721076295 Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/93153539c1314fcca04bd37875154308"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/93153539c1314fcca04bd37875154308"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_93153539c1314fcca04bd37875154308"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/93153539c1314fcca04bd37875154308"}]}] Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-KeyPairsNegativeTestJSON-721076295 Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 93153539c1314fcca04bd37875154308 Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-721076295 Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-KeyPairsNegativeTestJSON-721076295-project Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 1fee19addcaf4360ab3fe208c2f92667 Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-KeyPairsNegativeTestJSON-721076295-project Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: {"keypair": {"name": "tempest-keypair-1724291620", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLocLbMABjVnxF7/m5lwZ4o2okR300dFAPwKsmjzmTEac8gfi/NLezcMTi2xOdj5ws/BsjiW+pFpN4rp6oB0B0QzB25V2ocnLREkBgRJADsd7ylbx1t5Md3Hqgc3j4WFw=="}} Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: exception: Key pair 'tempest-keypair-1724291620' already exists. Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1724291620', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLocLbMABjVnxF7/m5lwZ4o2okR300dFAPwKsmjzmTEac8gfi/NLezcMTi2xOdj5ws/BsjiW+pFpN4rp6oB0B0QzB25V2ocnLREkBgRJADsd7ylbx1t5Md3Hqgc3j4WFw=='}}} Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result.read() Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '1fee19addcaf4360ab3fe208c2f92667-tempest-keypair-1724291620' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 29 03:14:57.089078 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi session.flush() Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result.read() Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 29 03:14:57.092339 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '1fee19addcaf4360ab3fe208c2f92667-tempest-keypair-1724291620' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 29, 3, 14, 57, 58930), 'updated_at': None, 'name': 'tempest-keypair-1724291620', 'user_id': '1fee19addcaf4360ab3fe208c2f92667', 'fingerprint': 'b7:dd:ac:0f:74:2d:9e:7c:d1:dc:1a:eb:07:ca:99:0d', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLocLbMABjVnxF7/m5lwZ4o2okR300dFAPwKsmjzmTEac8gfi/NLezcMTi2xOdj5ws/BsjiW+pFpN4rp6oB0B0QzB25V2ocnLREkBgRJADsd7ylbx1t5Md3Hqgc3j4WFw==', 'type': 'ssh'}] Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi keypair.create() Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._create() Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1724291620' already exists. Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 29 03:14:57.103419 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1724291620' already exists. Oct 29 03:14:57.111970 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.111970 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:57.111970 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.111970 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:57.111970 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:14:57.111970 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:14:57.111970 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:14:57.111970 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:14:57.111970 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1724291620' already exists. Oct 29 03:14:57.111970 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.111970 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-15f29376-8c43-4249-a917-ff1499b48248 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Returning 409 to user: Key pair 'tempest-keypair-1724291620' already exists. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:14:57.111970 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-15f29376-8c43-4249-a917-ff1499b48248 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.156574 Oct 29 03:14:57.111970 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2519/4838] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:14:56 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 166 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:14:57.118037 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-71ba1a82-0d4c-46bd-aff3-63033d53945f tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Calling method '.version_select at 0x7ff052d10430>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:57.173408 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-71ba1a82-0d4c-46bd-aff3-63033d53945f tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1724291620" status: 202 len: 0 microversion: 2.1 time: 0.068929 Oct 29 03:14:57.175335 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2320/4839] 10.222.0.46 () {58 vars in 1221 bytes} [Sat Oct 29 03:14:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1724291620 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:14:57.189978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dbf186ac-88fc-4098-95c8-3897983b4898 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Action: 'create', calling method: .version_select at 0x7ff05bfd8a60>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+i1rKjtddmL5v4QJ7d47OE3uMRHA5UyOIWzuF673Gxff7c0OW2Ym2Z3W0Bxbq6/+X7mq+E6Y7ebobO/IcYbK/d4F5MYK7ujIRt0HzDULmCRB3BLoyhzSVCgJrFi6eR6A=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dbf186ac-88fc-4098-95c8-3897983b4898 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Request method failure captured: Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 247 Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJqvDx3CLZQX8MB63dDbbx9XMDw2BWrGtnQEC7T58hnNO5UZR8xoLQbQqHm8lFDNnNpCMP4_bY_JhivnSARLhdWSEGlIMdIMAtlQ_5G3hT8-rDc1DzXvQ-9pCYS1Hr8dpoEnKtrk-W_sBO_cNU3Egukf3npdBu8whpI8AqzbFJ3uhEY Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 93153539c1314fcca04bd37875154308 Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-721076295 Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/93153539c1314fcca04bd37875154308"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/93153539c1314fcca04bd37875154308"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_93153539c1314fcca04bd37875154308"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/93153539c1314fcca04bd37875154308"}]}] Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-KeyPairsNegativeTestJSON-721076295 Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 93153539c1314fcca04bd37875154308 Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-721076295 Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-KeyPairsNegativeTestJSON-721076295-project Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 1fee19addcaf4360ab3fe208c2f92667 Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-KeyPairsNegativeTestJSON-721076295-project Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+i1rKjtddmL5v4QJ7d47OE3uMRHA5UyOIWzuF673Gxff7c0OW2Ym2Z3W0Bxbq6/+X7mq+E6Y7ebobO/IcYbK/d4F5MYK7ujIRt0HzDULmCRB3BLoyhzSVCgJrFi6eR6A=="}} Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+i1rKjtddmL5v4QJ7d47OE3uMRHA5UyOIWzuF673Gxff7c0OW2Ym2Z3W0Bxbq6/+X7mq+E6Y7ebobO/IcYbK/d4F5MYK7ujIRt0HzDULmCRB3BLoyhzSVCgJrFi6eR6A=='}}} Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi '' Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 03:14:57.194563 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 03:14:57.199035 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:14:57.199035 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:14:57.199035 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:14:57.199035 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:14:57.199035 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 29 03:14:57.199035 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.199035 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:57.199035 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.199035 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:57.199035 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:14:57.199035 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:14:57.199035 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:14:57.199035 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:14:57.199035 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 29 03:14:57.199035 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.206637 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dbf186ac-88fc-4098-95c8-3897983b4898 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:14:57.207611 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dbf186ac-88fc-4098-95c8-3897983b4898 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.021591 Oct 29 03:14:57.208262 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2520/4840] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:14:57 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:14:57.218144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-206d0f0c-33bc-4be9-9e2c-95538146c758 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Action: 'create', calling method: .version_select at 0x7ff05c10bf70>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-309051451", "public_key": " "}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:57.287944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-206d0f0c-33bc-4be9-9e2c-95538146c758 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Getting quotas for project 93153539c1314fcca04bd37875154308. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:14:57.287944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-206d0f0c-33bc-4be9-9e2c-95538146c758 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Getting quotas for user 1fee19addcaf4360ab3fe208c2f92667 and project 93153539c1314fcca04bd37875154308. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:14:57.329744 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-206d0f0c-33bc-4be9-9e2c-95538146c758 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-206d0f0c-33bc-4be9-9e2c-95538146c758 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Request method failure captured: Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 94 Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJqvDx3CLZQX8MB63dDbbx9XMDw2BWrGtnQEC7T58hnNO5UZR8xoLQbQqHm8lFDNnNpCMP4_bY_JhivnSARLhdWSEGlIMdIMAtlQ_5G3hT8-rDc1DzXvQ-9pCYS1Hr8dpoEnKtrk-W_sBO_cNU3Egukf3npdBu8whpI8AqzbFJ3uhEY Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 93153539c1314fcca04bd37875154308 Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-721076295 Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/93153539c1314fcca04bd37875154308"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/93153539c1314fcca04bd37875154308"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_93153539c1314fcca04bd37875154308"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/93153539c1314fcca04bd37875154308"}]}] Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-KeyPairsNegativeTestJSON-721076295 Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 93153539c1314fcca04bd37875154308 Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-721076295 Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-KeyPairsNegativeTestJSON-721076295-project Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 1fee19addcaf4360ab3fe208c2f92667 Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-KeyPairsNegativeTestJSON-721076295-project Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-309051451", "public_key": " "}} Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: exception: Keypair data is invalid: failed to generate fingerprint Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-309051451', 'public_key': ' '}}} Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:57.332980 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.338538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:57.338538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:14:57.338538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:14:57.338538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:14:57.338538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:14:57.338538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:14:57.338538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:14:57.338538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:14:57.338538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:14:57.338538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:14:57.338538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:14:57.338538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:14:57.338538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:14:57.338538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 29 03:14:57.338538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 29 03:14:57.338538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 29 03:14:57.338538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 29 03:14:57.338538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 29 03:14:57.338538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.338538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:57.338538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.338538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:57.338538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:14:57.338538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:14:57.338538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:14:57.338538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:14:57.338538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 29 03:14:57.338538 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.345047 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-206d0f0c-33bc-4be9-9e2c-95538146c758 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:14:57.345047 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-206d0f0c-33bc-4be9-9e2c-95538146c758 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.129778 Oct 29 03:14:57.345047 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2321/4841] 10.222.0.46 () {60 vars in 1158 bytes} [Sat Oct 29 03:14:57 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 03:14:57.361955 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-49fe0569-0892-48ba-a597-b3337962f964 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Action: 'create', calling method: .version_select at 0x7ff053e8b310>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExz66qbSMwjifLepxMIwoAmVZTGsVQxKX6g8KCl+c3NyhhbvLHbOHMXkp5AU1EhHP6zauRECek7b7gE7TSa+SHA68t1UqcFQwrzjohpyZFJtFy9kucz4Evemvfiv/JhLQ=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-49fe0569-0892-48ba-a597-b3337962f964 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Request method failure captured: Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 507 Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJqvDx3CLZQX8MB63dDbbx9XMDw2BWrGtnQEC7T58hnNO5UZR8xoLQbQqHm8lFDNnNpCMP4_bY_JhivnSARLhdWSEGlIMdIMAtlQ_5G3hT8-rDc1DzXvQ-9pCYS1Hr8dpoEnKtrk-W_sBO_cNU3Egukf3npdBu8whpI8AqzbFJ3uhEY Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 93153539c1314fcca04bd37875154308 Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-721076295 Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/93153539c1314fcca04bd37875154308"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/93153539c1314fcca04bd37875154308"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_93153539c1314fcca04bd37875154308"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/93153539c1314fcca04bd37875154308"}]}] Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-KeyPairsNegativeTestJSON-721076295 Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 93153539c1314fcca04bd37875154308 Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-721076295 Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-KeyPairsNegativeTestJSON-721076295-project Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 1fee19addcaf4360ab3fe208c2f92667 Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-KeyPairsNegativeTestJSON-721076295-project Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExz66qbSMwjifLepxMIwoAmVZTGsVQxKX6g8KCl+c3NyhhbvLHbOHMXkp5AU1EhHP6zauRECek7b7gE7TSa+SHA68t1UqcFQwrzjohpyZFJtFy9kucz4Evemvfiv/JhLQ=="}} Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExz66qbSMwjifLepxMIwoAmVZTGsVQxKX6g8KCl+c3NyhhbvLHbOHMXkp5AU1EhHP6zauRECek7b7gE7TSa+SHA68t1UqcFQwrzjohpyZFJtFy9kucz4Evemvfiv/JhLQ=='}}} Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 29 03:14:57.369192 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.372167 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-49fe0569-0892-48ba-a597-b3337962f964 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:14:57.374188 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-49fe0569-0892-48ba-a597-b3337962f964 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.018182 Oct 29 03:14:57.374270 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2521/4842] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:14:57 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 03:14:57.383232 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7fb4e3e6-6fa2-4f8b-a7e8-38b8cf8a98f6 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Action: 'create', calling method: .version_select at 0x7ff05c1fb700>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-308337444", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:14:57.404363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-7fb4e3e6-6fa2-4f8b-a7e8-38b8cf8a98f6 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Getting quotas for project 93153539c1314fcca04bd37875154308. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:14:57.412207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-7fb4e3e6-6fa2-4f8b-a7e8-38b8cf8a98f6 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Getting quotas for user 1fee19addcaf4360ab3fe208c2f92667 and project 93153539c1314fcca04bd37875154308. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:14:57.444747 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-7fb4e3e6-6fa2-4f8b-a7e8-38b8cf8a98f6 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7fb4e3e6-6fa2-4f8b-a7e8-38b8cf8a98f6 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Request method failure captured: Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 117 Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJqvDx3CLZQX8MB63dDbbx9XMDw2BWrGtnQEC7T58hnNO5UZR8xoLQbQqHm8lFDNnNpCMP4_bY_JhivnSARLhdWSEGlIMdIMAtlQ_5G3hT8-rDc1DzXvQ-9pCYS1Hr8dpoEnKtrk-W_sBO_cNU3Egukf3npdBu8whpI8AqzbFJ3uhEY Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 93153539c1314fcca04bd37875154308 Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-721076295 Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/93153539c1314fcca04bd37875154308"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/93153539c1314fcca04bd37875154308"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_93153539c1314fcca04bd37875154308"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/93153539c1314fcca04bd37875154308"}]}] Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-KeyPairsNegativeTestJSON-721076295 Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 93153539c1314fcca04bd37875154308 Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-721076295 Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-KeyPairsNegativeTestJSON-721076295-project Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 1fee19addcaf4360ab3fe208c2f92667 Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-KeyPairsNegativeTestJSON-721076295-project Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-308337444", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: method: Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: exception: Keypair data is invalid: failed to generate fingerprint Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-308337444', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 29 03:14:57.450452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 29 03:14:57.454376 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.458751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7fb4e3e6-6fa2-4f8b-a7e8-38b8cf8a98f6 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:14:57.462791 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7fb4e3e6-6fa2-4f8b-a7e8-38b8cf8a98f6 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.083718 Oct 29 03:14:57.464443 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2322/4843] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:14:57 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 86 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 29 03:14:57.473386 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-20a053e4-0ec5-4ccd-8b9e-580f829dada2 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Calling method '.version_select at 0x7ff058015550>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:14:57.491002 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-20a053e4-0ec5-4ccd-8b9e-580f829dada2 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-994399431 not found for user 1fee19addcaf4360ab3fe208c2f92667 Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-20a053e4-0ec5-4ccd-8b9e-580f829dada2 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Request method failure captured: Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-994399431 HTTP/1.1 Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJqvDx3CLZQX8MB63dDbbx9XMDw2BWrGtnQEC7T58hnNO5UZR8xoLQbQqHm8lFDNnNpCMP4_bY_JhivnSARLhdWSEGlIMdIMAtlQ_5G3hT8-rDc1DzXvQ-9pCYS1Hr8dpoEnKtrk-W_sBO_cNU3Egukf3npdBu8whpI8AqzbFJ3uhEY Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 93153539c1314fcca04bd37875154308 Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-721076295 Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/93153539c1314fcca04bd37875154308"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/93153539c1314fcca04bd37875154308"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_93153539c1314fcca04bd37875154308"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/93153539c1314fcca04bd37875154308"}]}] Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-KeyPairsNegativeTestJSON-721076295 Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 93153539c1314fcca04bd37875154308 Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-721076295 Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-KeyPairsNegativeTestJSON-721076295-project Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 1fee19addcaf4360ab3fe208c2f92667 Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-KeyPairsNegativeTestJSON-721076295-project Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: exception: Keypair tempest-keypair-non-existent-994399431 not found for user 1fee19addcaf4360ab3fe208c2f92667 Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'tempest-keypair-non-existent-994399431'} Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise self.value Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-994399431 not found for user 1fee19addcaf4360ab3fe208c2f92667 Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.493824 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:57.497253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.497253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:57.497253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:14:57.497253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:14:57.497253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:14:57.497253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:14:57.497253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:14:57.497253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:14:57.497253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 03:14:57.497253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:14:57.497253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:14:57.497253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:14:57.497253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 29 03:14:57.497253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 29 03:14:57.497253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 29 03:14:57.497253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 29 03:14:57.497253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-994399431 not found for user 1fee19addcaf4360ab3fe208c2f92667 Oct 29 03:14:57.497253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.497253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:14:57.497253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.497253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:14:57.497253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:14:57.497253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:14:57.497253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:14:57.497253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:14:57.497253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-994399431 not found for user 1fee19addcaf4360ab3fe208c2f92667 Oct 29 03:14:57.497253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:14:57.501887 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-20a053e4-0ec5-4ccd-8b9e-580f829dada2 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] Returning 404 to user: Keypair tempest-keypair-non-existent-994399431 not found for user 1fee19addcaf4360ab3fe208c2f92667 {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:14:57.502987 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-20a053e4-0ec5-4ccd-8b9e-580f829dada2 tempest-KeyPairsNegativeTestJSON-721076295 tempest-KeyPairsNegativeTestJSON-721076295-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-994399431" status: 404 len: 144 microversion: 2.1 time: 0.033556 Oct 29 03:14:57.503931 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2522/4844] 10.222.0.46 () {58 vars in 1257 bytes} [Sat Oct 29 03:14:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-994399431 => generated 144 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:15:13.545241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=28 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:13.546643 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:14.195041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c1a7d7bf-ecf3-454a-a34f-4c8234061a2a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'create', calling method: .version_select at 0x7ff053731a60>, body: {"keypair": {"name": "tempest-keypair-1240594448", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8+KPg6cQC2OkvmxG6pi/5ZRmWlRCzu37YTYdGLss1TuBS6+rkiiYGm1d9uG01pBxYKDWkoURlaY85BEBihq8a4t372ijhcf5KIQuaalk4IP2Y8J5t4QfX1uVq3NtUrFQ=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:15:14.269750 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-c1a7d7bf-ecf3-454a-a34f-4c8234061a2a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Getting quotas for project df5fe7cedcd14b61925dc300274b3c70. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:15:14.291208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-c1a7d7bf-ecf3-454a-a34f-4c8234061a2a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Getting quotas for user aac411c78a5648be8a1c43893d9a0798 and project df5fe7cedcd14b61925dc300274b3c70. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:15:14.387832 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c1a7d7bf-ecf3-454a-a34f-4c8234061a2a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.842777 Oct 29 03:15:14.402703 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2323/4845] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:15:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:15:16.540923 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6d362385-4389-43ec-aac3-d9ada2799164 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:16.542308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6d362385-4389-43ec-aac3-d9ada2799164 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:16.555115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=28 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:16.562039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:16.571807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d362385-4389-43ec-aac3-d9ada2799164 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:16.572850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d362385-4389-43ec-aac3-d9ada2799164 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:16.573482 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d362385-4389-43ec-aac3-d9ada2799164 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:16.574581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d362385-4389-43ec-aac3-d9ada2799164 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:16.575374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d362385-4389-43ec-aac3-d9ada2799164 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:16.575954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d362385-4389-43ec-aac3-d9ada2799164 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:16.655744 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6d362385-4389-43ec-aac3-d9ada2799164 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7/ips" status: 200 len: 150 microversion: 2.1 time: 0.118286 Oct 29 03:15:16.658182 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2523/4846] 10.222.0.46 () {58 vars in 1248 bytes} [Sat Oct 29 03:15:16 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7/ips => generated 150 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:15:19.895197 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9ccdb2a9-a608-4bbb-837a-5411a0fee05c tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77732b38-f0a5-4a93-af23-9f5c72546adb"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:15:19.906827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9ccdb2a9-a608-4bbb-837a-5411a0fee05c tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:19.944451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ccdb2a9-a608-4bbb-837a-5411a0fee05c tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:19.948212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ccdb2a9-a608-4bbb-837a-5411a0fee05c tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:19.949559 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ccdb2a9-a608-4bbb-837a-5411a0fee05c tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:19.953720 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ccdb2a9-a608-4bbb-837a-5411a0fee05c tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:19.954937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ccdb2a9-a608-4bbb-837a-5411a0fee05c tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:19.958667 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ccdb2a9-a608-4bbb-837a-5411a0fee05c tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:20.501834 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9ccdb2a9-a608-4bbb-837a-5411a0fee05c tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "POST /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.611845 Oct 29 03:15:20.502451 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2324/4847] 10.222.0.46 () {60 vars in 1323 bytes} [Sat Oct 29 03:15:19 2022] POST /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7/os-volume_attachments => generated 194 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:15:21.330031 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0007169c-de8e-44a4-a0ee-aa7ca68c8ed5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1716351791", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e565ca97-fa54-4380-a34f-e5c00430d054"}], "security_groups": [{"name": "tempest-securitygroup--842769644"}], "key_name": "tempest-keypair-1240594448", "user_data": "}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:15:21.580928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-0007169c-de8e-44a4-a0ee-aa7ca68c8ed5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] validate_networks() for [('e565ca97-fa54-4380-a34f-e5c00430d054', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:15:23.521918 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-0007169c-de8e-44a4-a0ee-aa7ca68c8ed5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:15:23.522511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-0007169c-de8e-44a4-a0ee-aa7ca68c8ed5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:15:23.522808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-0007169c-de8e-44a4-a0ee-aa7ca68c8ed5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:15:23.523216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-0007169c-de8e-44a4-a0ee-aa7ca68c8ed5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:15:23.523625 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-0007169c-de8e-44a4-a0ee-aa7ca68c8ed5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:15:23.534183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0007169c-de8e-44a4-a0ee-aa7ca68c8ed5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:23.534892 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0007169c-de8e-44a4-a0ee-aa7ca68c8ed5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:23.535329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0007169c-de8e-44a4-a0ee-aa7ca68c8ed5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:23.536056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0007169c-de8e-44a4-a0ee-aa7ca68c8ed5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:23.536910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0007169c-de8e-44a4-a0ee-aa7ca68c8ed5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:23.537493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0007169c-de8e-44a4-a0ee-aa7ca68c8ed5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:23.555540 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-0007169c-de8e-44a4-a0ee-aa7ca68c8ed5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Getting quotas for project df5fe7cedcd14b61925dc300274b3c70. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:15:23.561310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-0007169c-de8e-44a4-a0ee-aa7ca68c8ed5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Getting quotas for user aac411c78a5648be8a1c43893d9a0798 and project df5fe7cedcd14b61925dc300274b3c70. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:15:23.575059 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0007169c-de8e-44a4-a0ee-aa7ca68c8ed5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:15:23.577773 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0007169c-de8e-44a4-a0ee-aa7ca68c8ed5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:15:23.632899 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0007169c-de8e-44a4-a0ee-aa7ca68c8ed5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.308533 Oct 29 03:15:23.633842 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2524/4848] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:15:21 2022] POST /compute/v2.1/servers => generated 408 bytes in 2310 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:15:23.647156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6c116b23-c15b-43ff-b80e-632a48fc272c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:23.647585 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6c116b23-c15b-43ff-b80e-632a48fc272c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:23.808920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6c116b23-c15b-43ff-b80e-632a48fc272c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:23.823083 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6c116b23-c15b-43ff-b80e-632a48fc272c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1239 microversion: 2.1 time: 0.181462 Oct 29 03:15:23.824608 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2325/4849] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:23 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1239 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:24.847803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-33483f54-1f50-4b46-aad1-639c2feff41f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:24.848634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-33483f54-1f50-4b46-aad1-639c2feff41f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:24.862492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33483f54-1f50-4b46-aad1-639c2feff41f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:24.863213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33483f54-1f50-4b46-aad1-639c2feff41f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:24.863866 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33483f54-1f50-4b46-aad1-639c2feff41f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:24.865000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33483f54-1f50-4b46-aad1-639c2feff41f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:24.865710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33483f54-1f50-4b46-aad1-639c2feff41f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:24.868759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33483f54-1f50-4b46-aad1-639c2feff41f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:24.979727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-33483f54-1f50-4b46-aad1-639c2feff41f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:25.000194 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-33483f54-1f50-4b46-aad1-639c2feff41f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1235 microversion: 2.1 time: 0.155162 Oct 29 03:15:25.023749 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2525/4850] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:24 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1235 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:26.042877 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d2426825-2ed1-4bb3-a333-26053acf556d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:26.048224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d2426825-2ed1-4bb3-a333-26053acf556d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:26.073481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d2426825-2ed1-4bb3-a333-26053acf556d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:26.073894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d2426825-2ed1-4bb3-a333-26053acf556d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:26.074330 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d2426825-2ed1-4bb3-a333-26053acf556d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:26.075048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d2426825-2ed1-4bb3-a333-26053acf556d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:26.075502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d2426825-2ed1-4bb3-a333-26053acf556d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:26.075925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d2426825-2ed1-4bb3-a333-26053acf556d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:26.254451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d2426825-2ed1-4bb3-a333-26053acf556d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:26.265713 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d2426825-2ed1-4bb3-a333-26053acf556d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1297 microversion: 2.1 time: 0.238490 Oct 29 03:15:26.275159 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2326/4851] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:26 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1297 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:27.307579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b8c7ab56-6dc4-490c-b4b0-be861738bd5a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:27.308789 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b8c7ab56-6dc4-490c-b4b0-be861738bd5a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:27.336572 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b8c7ab56-6dc4-490c-b4b0-be861738bd5a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:27.348095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b8c7ab56-6dc4-490c-b4b0-be861738bd5a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:27.350250 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b8c7ab56-6dc4-490c-b4b0-be861738bd5a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:27.351430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b8c7ab56-6dc4-490c-b4b0-be861738bd5a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:27.353223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b8c7ab56-6dc4-490c-b4b0-be861738bd5a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:27.354279 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b8c7ab56-6dc4-490c-b4b0-be861738bd5a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:27.653888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b8c7ab56-6dc4-490c-b4b0-be861738bd5a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:27.661990 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b8c7ab56-6dc4-490c-b4b0-be861738bd5a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1364 microversion: 2.1 time: 0.362854 Oct 29 03:15:27.667647 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2526/4852] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:27 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1364 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:28.692042 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bc668425-3341-4820-8b37-e187bcc3b909 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:28.693394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bc668425-3341-4820-8b37-e187bcc3b909 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:28.702349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc668425-3341-4820-8b37-e187bcc3b909 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:28.703747 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc668425-3341-4820-8b37-e187bcc3b909 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:28.704378 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc668425-3341-4820-8b37-e187bcc3b909 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:28.705481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc668425-3341-4820-8b37-e187bcc3b909 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:28.706154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc668425-3341-4820-8b37-e187bcc3b909 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:28.706892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc668425-3341-4820-8b37-e187bcc3b909 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:28.767804 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:15:28.768335 n-d-862967-2 devstack@n-api.service[127125]: Sat Oct 29 03:15:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 (ip 10.222.0.46) !!! Oct 29 03:15:29.038327 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bc668425-3341-4820-8b37-e187bcc3b909 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:29.054877 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bc668425-3341-4820-8b37-e187bcc3b909 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1364 microversion: 2.1 time: 0.367331 Oct 29 03:15:29.060300 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2327/4853] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:28 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1364 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:29.391612 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1d060e5d-e0d9-424a-bbf2-0b6b453fc5d6 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-297117111", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "ff13cfe2-2508-4322-8e51-24d01a3f02d9"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:15:29.473410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-1d060e5d-e0d9-424a-bbf2-0b6b453fc5d6 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] validate_networks() for [('ff13cfe2-2508-4322-8e51-24d01a3f02d9', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:15:30.088738 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-256469e4-11da-4380-b476-03442fe04149 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:30.090042 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-256469e4-11da-4380-b476-03442fe04149 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:30.102186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-256469e4-11da-4380-b476-03442fe04149 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:30.104385 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-256469e4-11da-4380-b476-03442fe04149 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:30.106871 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-256469e4-11da-4380-b476-03442fe04149 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:30.110180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-256469e4-11da-4380-b476-03442fe04149 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:30.110912 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-256469e4-11da-4380-b476-03442fe04149 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:30.117255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-256469e4-11da-4380-b476-03442fe04149 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:30.790887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-256469e4-11da-4380-b476-03442fe04149 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:30.803338 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-256469e4-11da-4380-b476-03442fe04149 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1364 microversion: 2.1 time: 0.718613 Oct 29 03:15:30.804356 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2328/4854] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:30 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1364 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:30.853015 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-92a0a766-e940-4fe5-adff-c873e2c9c000 req-6c9effd1-d064-4aad-84c0-658c357812e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23349ce8-2588-42c9-8de7-90865b56c980", "tag": "26865343-33e7-4622-bd06-ed6191938067"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:15:30.874469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-92a0a766-e940-4fe5-adff-c873e2c9c000 req-6c9effd1-d064-4aad-84c0-658c357812e5 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:30.874952 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-92a0a766-e940-4fe5-adff-c873e2c9c000 req-6c9effd1-d064-4aad-84c0-658c357812e5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:30.875394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-92a0a766-e940-4fe5-adff-c873e2c9c000 req-6c9effd1-d064-4aad-84c0-658c357812e5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:30.909772 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-92a0a766-e940-4fe5-adff-c873e2c9c000 req-6c9effd1-d064-4aad-84c0-658c357812e5 service nova] Creating event network-changed:26865343-33e7-4622-bd06-ed6191938067 for instance 23349ce8-2588-42c9-8de7-90865b56c980 on n-h2-862967-2 Oct 29 03:15:30.924453 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-92a0a766-e940-4fe5-adff-c873e2c9c000 req-6c9effd1-d064-4aad-84c0-658c357812e5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076642 Oct 29 03:15:30.925527 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2329/4855] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:15:31.176411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-1d060e5d-e0d9-424a-bbf2-0b6b453fc5d6 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:15:31.178045 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-1d060e5d-e0d9-424a-bbf2-0b6b453fc5d6 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:15:31.178733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-1d060e5d-e0d9-424a-bbf2-0b6b453fc5d6 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:15:31.181110 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-1d060e5d-e0d9-424a-bbf2-0b6b453fc5d6 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:15:31.182001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-1d060e5d-e0d9-424a-bbf2-0b6b453fc5d6 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:15:31.203800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d060e5d-e0d9-424a-bbf2-0b6b453fc5d6 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:31.204306 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d060e5d-e0d9-424a-bbf2-0b6b453fc5d6 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:31.208082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d060e5d-e0d9-424a-bbf2-0b6b453fc5d6 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:31.209129 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d060e5d-e0d9-424a-bbf2-0b6b453fc5d6 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:31.209628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d060e5d-e0d9-424a-bbf2-0b6b453fc5d6 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:31.210071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d060e5d-e0d9-424a-bbf2-0b6b453fc5d6 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:31.259878 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-1d060e5d-e0d9-424a-bbf2-0b6b453fc5d6 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Getting quotas for project 65109d16cc974a7db3fa5706cb5d7db7. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:15:31.271542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-1d060e5d-e0d9-424a-bbf2-0b6b453fc5d6 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Getting quotas for user 2d658dc3070248f08379ce63a45cc327 and project 65109d16cc974a7db3fa5706cb5d7db7. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:15:31.303776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1d060e5d-e0d9-424a-bbf2-0b6b453fc5d6 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:15:31.307282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1d060e5d-e0d9-424a-bbf2-0b6b453fc5d6 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] [instance: 0412cc20-ca45-47f6-bd5b-c2c73106ba53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:15:31.412864 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1d060e5d-e0d9-424a-bbf2-0b6b453fc5d6 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.566418 Oct 29 03:15:31.413992 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2527/4856] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:15:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:15:31.428118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-73a29647-fb81-4b53-b6fc-90b4ccfa5a91 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:31.429686 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-73a29647-fb81-4b53-b6fc-90b4ccfa5a91 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] [instance: 0412cc20-ca45-47f6-bd5b-c2c73106ba53] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:31.581778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-73a29647-fb81-4b53-b6fc-90b4ccfa5a91 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d658dc3070248f08379ce63a45cc327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65109d16cc974a7db3fa5706cb5d7db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:31.590545 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-73a29647-fb81-4b53-b6fc-90b4ccfa5a91 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] 10.222.0.46 "GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53" status: 200 len: 1213 microversion: 2.1 time: 0.168684 Oct 29 03:15:31.593656 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2330/4857] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:31 2022] GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53 => generated 1213 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:31.837755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1cf9b713-814e-468b-bff9-3437e425b21a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:31.838377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1cf9b713-814e-468b-bff9-3437e425b21a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:31.864708 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cf9b713-814e-468b-bff9-3437e425b21a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:31.867021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cf9b713-814e-468b-bff9-3437e425b21a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:31.868596 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cf9b713-814e-468b-bff9-3437e425b21a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:31.870212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cf9b713-814e-468b-bff9-3437e425b21a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:31.872392 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cf9b713-814e-468b-bff9-3437e425b21a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:31.873705 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cf9b713-814e-468b-bff9-3437e425b21a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:32.615975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1cf9b713-814e-468b-bff9-3437e425b21a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:32.622256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1c5cd7f8-9761-4c52-8ea7-044a528005c0 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:32.623607 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1c5cd7f8-9761-4c52-8ea7-044a528005c0 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] [instance: 0412cc20-ca45-47f6-bd5b-c2c73106ba53] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:32.629069 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1cf9b713-814e-468b-bff9-3437e425b21a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1364 microversion: 2.1 time: 0.794990 Oct 29 03:15:32.630207 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2528/4858] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:31 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1364 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:32.646638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c5cd7f8-9761-4c52-8ea7-044a528005c0 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:32.647493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c5cd7f8-9761-4c52-8ea7-044a528005c0 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:32.648196 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c5cd7f8-9761-4c52-8ea7-044a528005c0 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:32.649833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c5cd7f8-9761-4c52-8ea7-044a528005c0 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:32.650791 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c5cd7f8-9761-4c52-8ea7-044a528005c0 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:32.651425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c5cd7f8-9761-4c52-8ea7-044a528005c0 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:32.804705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1c5cd7f8-9761-4c52-8ea7-044a528005c0 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d658dc3070248f08379ce63a45cc327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65109d16cc974a7db3fa5706cb5d7db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:32.830071 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1c5cd7f8-9761-4c52-8ea7-044a528005c0 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] 10.222.0.46 "GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53" status: 200 len: 1209 microversion: 2.1 time: 0.212779 Oct 29 03:15:32.847407 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2331/4859] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:32 2022] GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53 => generated 1209 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:33.664859 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-02692db2-3a0c-4a15-bbdb-0f0be29285de tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:33.671558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-02692db2-3a0c-4a15-bbdb-0f0be29285de tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:33.689101 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02692db2-3a0c-4a15-bbdb-0f0be29285de tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:33.691932 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02692db2-3a0c-4a15-bbdb-0f0be29285de tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:33.693921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02692db2-3a0c-4a15-bbdb-0f0be29285de tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:33.697200 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02692db2-3a0c-4a15-bbdb-0f0be29285de tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:33.700678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02692db2-3a0c-4a15-bbdb-0f0be29285de tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:33.701718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02692db2-3a0c-4a15-bbdb-0f0be29285de tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:33.859378 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-19373043-12c8-43c0-999e-fa9c2a0e7853 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:33.860613 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-19373043-12c8-43c0-999e-fa9c2a0e7853 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] [instance: 0412cc20-ca45-47f6-bd5b-c2c73106ba53] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:33.874744 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19373043-12c8-43c0-999e-fa9c2a0e7853 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:33.875239 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19373043-12c8-43c0-999e-fa9c2a0e7853 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:33.875673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19373043-12c8-43c0-999e-fa9c2a0e7853 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:33.876393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19373043-12c8-43c0-999e-fa9c2a0e7853 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:33.877253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19373043-12c8-43c0-999e-fa9c2a0e7853 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:33.877253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19373043-12c8-43c0-999e-fa9c2a0e7853 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:34.055404 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-19373043-12c8-43c0-999e-fa9c2a0e7853 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d658dc3070248f08379ce63a45cc327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65109d16cc974a7db3fa5706cb5d7db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:34.089685 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-19373043-12c8-43c0-999e-fa9c2a0e7853 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] 10.222.0.46 "GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53" status: 200 len: 1271 microversion: 2.1 time: 0.233812 Oct 29 03:15:34.102067 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2332/4860] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:33 2022] GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53 => generated 1271 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:34.206944 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-02692db2-3a0c-4a15-bbdb-0f0be29285de tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:34.224909 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-02692db2-3a0c-4a15-bbdb-0f0be29285de tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1364 microversion: 2.1 time: 0.575752 Oct 29 03:15:34.231150 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2529/4861] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:33 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1364 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:35.118903 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ee0b0563-e740-4fd5-b7d2-4cb3e1a25c46 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:35.120396 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ee0b0563-e740-4fd5-b7d2-4cb3e1a25c46 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] [instance: 0412cc20-ca45-47f6-bd5b-c2c73106ba53] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:35.129262 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee0b0563-e740-4fd5-b7d2-4cb3e1a25c46 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:35.130500 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee0b0563-e740-4fd5-b7d2-4cb3e1a25c46 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:35.131123 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee0b0563-e740-4fd5-b7d2-4cb3e1a25c46 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:35.131999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee0b0563-e740-4fd5-b7d2-4cb3e1a25c46 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:35.132643 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee0b0563-e740-4fd5-b7d2-4cb3e1a25c46 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:35.133210 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee0b0563-e740-4fd5-b7d2-4cb3e1a25c46 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:35.260922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f4a63920-85b7-41f5-898d-d2d9181e0462 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:35.262648 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f4a63920-85b7-41f5-898d-d2d9181e0462 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:35.279830 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f4a63920-85b7-41f5-898d-d2d9181e0462 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:35.281823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f4a63920-85b7-41f5-898d-d2d9181e0462 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:35.282425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f4a63920-85b7-41f5-898d-d2d9181e0462 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:35.284695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f4a63920-85b7-41f5-898d-d2d9181e0462 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:35.285346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f4a63920-85b7-41f5-898d-d2d9181e0462 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:35.287694 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f4a63920-85b7-41f5-898d-d2d9181e0462 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:35.482602 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ee0b0563-e740-4fd5-b7d2-4cb3e1a25c46 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d658dc3070248f08379ce63a45cc327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65109d16cc974a7db3fa5706cb5d7db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:35.512333 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ee0b0563-e740-4fd5-b7d2-4cb3e1a25c46 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] 10.222.0.46 "GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53" status: 200 len: 1271 microversion: 2.1 time: 0.387901 Oct 29 03:15:35.529164 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2333/4862] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:35 2022] GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53 => generated 1271 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:35.869200 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f4a63920-85b7-41f5-898d-d2d9181e0462 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:35.881518 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f4a63920-85b7-41f5-898d-d2d9181e0462 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1364 microversion: 2.1 time: 0.625713 Oct 29 03:15:35.888816 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2530/4863] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:35 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1364 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:15:36.554019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ee6000ff-4a27-48f9-9160-9c0acfe937a4 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:36.555370 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ee6000ff-4a27-48f9-9160-9c0acfe937a4 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] [instance: 0412cc20-ca45-47f6-bd5b-c2c73106ba53] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:36.582465 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee6000ff-4a27-48f9-9160-9c0acfe937a4 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:36.584505 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee6000ff-4a27-48f9-9160-9c0acfe937a4 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:36.585441 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-bf4c5613-cbf9-4dd0-988e-8f32970001f6 req-0e606aa8-b06d-4aa2-a0d6-f3ba58e945b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23349ce8-2588-42c9-8de7-90865b56c980", "name": "network-vif-plugged", "status": "completed", "tag": "26865343-33e7-4622-bd06-ed6191938067"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:15:36.586067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee6000ff-4a27-48f9-9160-9c0acfe937a4 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:36.589191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee6000ff-4a27-48f9-9160-9c0acfe937a4 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:36.589738 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee6000ff-4a27-48f9-9160-9c0acfe937a4 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:36.590245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee6000ff-4a27-48f9-9160-9c0acfe937a4 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:36.618674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-bf4c5613-cbf9-4dd0-988e-8f32970001f6 req-0e606aa8-b06d-4aa2-a0d6-f3ba58e945b3 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:36.622012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-bf4c5613-cbf9-4dd0-988e-8f32970001f6 req-0e606aa8-b06d-4aa2-a0d6-f3ba58e945b3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:36.622693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-bf4c5613-cbf9-4dd0-988e-8f32970001f6 req-0e606aa8-b06d-4aa2-a0d6-f3ba58e945b3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:36.713224 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-bf4c5613-cbf9-4dd0-988e-8f32970001f6 req-0e606aa8-b06d-4aa2-a0d6-f3ba58e945b3 service nova] Creating event network-vif-plugged:26865343-33e7-4622-bd06-ed6191938067 for instance 23349ce8-2588-42c9-8de7-90865b56c980 on n-h2-862967-2 Oct 29 03:15:36.742371 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-bf4c5613-cbf9-4dd0-988e-8f32970001f6 req-0e606aa8-b06d-4aa2-a0d6-f3ba58e945b3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161922 Oct 29 03:15:36.752715 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2531/4864] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:15:36.921716 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-86e6380e-0e44-4856-840c-9b60e973e15d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:36.923760 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-86e6380e-0e44-4856-840c-9b60e973e15d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:36.948563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86e6380e-0e44-4856-840c-9b60e973e15d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:36.949050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86e6380e-0e44-4856-840c-9b60e973e15d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:36.949498 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86e6380e-0e44-4856-840c-9b60e973e15d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:36.950253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86e6380e-0e44-4856-840c-9b60e973e15d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:36.950686 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86e6380e-0e44-4856-840c-9b60e973e15d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:36.951120 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86e6380e-0e44-4856-840c-9b60e973e15d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:37.757029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-86e6380e-0e44-4856-840c-9b60e973e15d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:37.769939 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-86e6380e-0e44-4856-840c-9b60e973e15d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1364 microversion: 2.1 time: 0.865203 Oct 29 03:15:37.784862 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2532/4865] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:36 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1364 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:37.796414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ee6000ff-4a27-48f9-9160-9c0acfe937a4 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d658dc3070248f08379ce63a45cc327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65109d16cc974a7db3fa5706cb5d7db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:37.812848 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ee6000ff-4a27-48f9-9160-9c0acfe937a4 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] 10.222.0.46 "GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53" status: 200 len: 1313 microversion: 2.1 time: 1.265363 Oct 29 03:15:37.815900 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2334/4866] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:36 2022] GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53 => generated 1313 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:38.805295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f256affc-f541-4aa4-a47e-88371d70148c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:38.805933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f256affc-f541-4aa4-a47e-88371d70148c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:38.822523 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f256affc-f541-4aa4-a47e-88371d70148c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:38.823798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f256affc-f541-4aa4-a47e-88371d70148c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:38.824916 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f256affc-f541-4aa4-a47e-88371d70148c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:38.826090 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f256affc-f541-4aa4-a47e-88371d70148c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:38.826755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f256affc-f541-4aa4-a47e-88371d70148c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:38.828075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f256affc-f541-4aa4-a47e-88371d70148c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:38.838859 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-961d3bbf-a97d-45c7-9ce1-d271fe0214e9 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:38.839348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-961d3bbf-a97d-45c7-9ce1-d271fe0214e9 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] [instance: 0412cc20-ca45-47f6-bd5b-c2c73106ba53] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:38.858244 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-961d3bbf-a97d-45c7-9ce1-d271fe0214e9 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:38.860394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-961d3bbf-a97d-45c7-9ce1-d271fe0214e9 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:38.861252 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-961d3bbf-a97d-45c7-9ce1-d271fe0214e9 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:38.863342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-961d3bbf-a97d-45c7-9ce1-d271fe0214e9 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:38.866077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-961d3bbf-a97d-45c7-9ce1-d271fe0214e9 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:38.867235 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-961d3bbf-a97d-45c7-9ce1-d271fe0214e9 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:39.154563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f256affc-f541-4aa4-a47e-88371d70148c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:39.169296 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f256affc-f541-4aa4-a47e-88371d70148c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1551 microversion: 2.1 time: 0.375118 Oct 29 03:15:39.169894 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2533/4867] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:38 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1551 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:39.191321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b3a9b7e4-aeed-46a6-998d-a3af35bc2516 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:39.192063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b3a9b7e4-aeed-46a6-998d-a3af35bc2516 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:39.199403 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3a9b7e4-aeed-46a6-998d-a3af35bc2516 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:39.200071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3a9b7e4-aeed-46a6-998d-a3af35bc2516 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:39.200776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3a9b7e4-aeed-46a6-998d-a3af35bc2516 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:39.201751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3a9b7e4-aeed-46a6-998d-a3af35bc2516 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:39.202402 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3a9b7e4-aeed-46a6-998d-a3af35bc2516 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:39.203117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3a9b7e4-aeed-46a6-998d-a3af35bc2516 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:39.265901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-961d3bbf-a97d-45c7-9ce1-d271fe0214e9 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d658dc3070248f08379ce63a45cc327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65109d16cc974a7db3fa5706cb5d7db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:39.276788 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-961d3bbf-a97d-45c7-9ce1-d271fe0214e9 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] 10.222.0.46 "GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53" status: 200 len: 1313 microversion: 2.1 time: 0.441987 Oct 29 03:15:39.277388 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2335/4868] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:38 2022] GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53 => generated 1313 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:15:39.350315 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b3a9b7e4-aeed-46a6-998d-a3af35bc2516 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.162732 Oct 29 03:15:39.351401 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2534/4869] 10.222.0.46 () {58 vars in 1275 bytes} [Sat Oct 29 03:15:39 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:15:39.509677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-7ce08dcf-1391-47ca-8a3e-452231664fd7 req-47dbea8c-9baf-44a7-884b-39724243b5fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0412cc20-ca45-47f6-bd5b-c2c73106ba53", "tag": "08acf100-0058-4400-8149-0bed3c84d177"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:15:39.532822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7ce08dcf-1391-47ca-8a3e-452231664fd7 req-47dbea8c-9baf-44a7-884b-39724243b5fb service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:39.533407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7ce08dcf-1391-47ca-8a3e-452231664fd7 req-47dbea8c-9baf-44a7-884b-39724243b5fb service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:39.533845 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7ce08dcf-1391-47ca-8a3e-452231664fd7 req-47dbea8c-9baf-44a7-884b-39724243b5fb service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:39.563828 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-7ce08dcf-1391-47ca-8a3e-452231664fd7 req-47dbea8c-9baf-44a7-884b-39724243b5fb service nova] Creating event network-changed:08acf100-0058-4400-8149-0bed3c84d177 for instance 0412cc20-ca45-47f6-bd5b-c2c73106ba53 on n-h1-862967-2 Oct 29 03:15:39.573539 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-7ce08dcf-1391-47ca-8a3e-452231664fd7 req-47dbea8c-9baf-44a7-884b-39724243b5fb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068233 Oct 29 03:15:39.574592 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2336/4870] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:15:40.302222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cafd4aa6-0e5b-4b01-bf64-5b5f18e415d3 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:40.302850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cafd4aa6-0e5b-4b01-bf64-5b5f18e415d3 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] [instance: 0412cc20-ca45-47f6-bd5b-c2c73106ba53] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:40.315919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cafd4aa6-0e5b-4b01-bf64-5b5f18e415d3 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:40.316778 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cafd4aa6-0e5b-4b01-bf64-5b5f18e415d3 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:40.321008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cafd4aa6-0e5b-4b01-bf64-5b5f18e415d3 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:40.322038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cafd4aa6-0e5b-4b01-bf64-5b5f18e415d3 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:40.322677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cafd4aa6-0e5b-4b01-bf64-5b5f18e415d3 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:40.323282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cafd4aa6-0e5b-4b01-bf64-5b5f18e415d3 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:41.232070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:41.289168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=12 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:41.800638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cafd4aa6-0e5b-4b01-bf64-5b5f18e415d3 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d658dc3070248f08379ce63a45cc327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65109d16cc974a7db3fa5706cb5d7db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:41.814851 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cafd4aa6-0e5b-4b01-bf64-5b5f18e415d3 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] 10.222.0.46 "GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53" status: 200 len: 1313 microversion: 2.1 time: 1.514748 Oct 29 03:15:41.818193 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2535/4871] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:40 2022] GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53 => generated 1313 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:42.371664 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-abde3215-9b23-4736-8c6f-638094162283 req-7c9f85ed-90d3-4209-821f-db862a8cd972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23349ce8-2588-42c9-8de7-90865b56c980", "tag": "26865343-33e7-4622-bd06-ed6191938067"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:15:42.437032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=8 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:42.451901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-abde3215-9b23-4736-8c6f-638094162283 req-7c9f85ed-90d3-4209-821f-db862a8cd972 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:42.452661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-abde3215-9b23-4736-8c6f-638094162283 req-7c9f85ed-90d3-4209-821f-db862a8cd972 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:42.453324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-abde3215-9b23-4736-8c6f-638094162283 req-7c9f85ed-90d3-4209-821f-db862a8cd972 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:42.481038 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-abde3215-9b23-4736-8c6f-638094162283 req-7c9f85ed-90d3-4209-821f-db862a8cd972 service nova] Creating event network-changed:26865343-33e7-4622-bd06-ed6191938067 for instance 23349ce8-2588-42c9-8de7-90865b56c980 on n-h2-862967-2 Oct 29 03:15:42.498559 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-abde3215-9b23-4736-8c6f-638094162283 req-7c9f85ed-90d3-4209-821f-db862a8cd972 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134747 Oct 29 03:15:42.499238 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2337/4872] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:15:42.845462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a15390d6-4747-4db6-88ab-9ebff863ffce tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:42.846079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a15390d6-4747-4db6-88ab-9ebff863ffce tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] [instance: 0412cc20-ca45-47f6-bd5b-c2c73106ba53] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:42.885984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a15390d6-4747-4db6-88ab-9ebff863ffce tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:42.886614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a15390d6-4747-4db6-88ab-9ebff863ffce tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:42.886925 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a15390d6-4747-4db6-88ab-9ebff863ffce tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:42.887643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a15390d6-4747-4db6-88ab-9ebff863ffce tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:42.888092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a15390d6-4747-4db6-88ab-9ebff863ffce tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:42.893523 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a15390d6-4747-4db6-88ab-9ebff863ffce tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:43.368538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a15390d6-4747-4db6-88ab-9ebff863ffce tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d658dc3070248f08379ce63a45cc327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65109d16cc974a7db3fa5706cb5d7db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:43.390875 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a15390d6-4747-4db6-88ab-9ebff863ffce tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] 10.222.0.46 "GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53" status: 200 len: 1313 microversion: 2.1 time: 0.542895 Oct 29 03:15:43.410898 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2536/4873] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:42 2022] GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53 => generated 1313 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:44.417478 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7e5a4840-41a7-41ac-9115-dc8192f80f5a tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:44.418202 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7e5a4840-41a7-41ac-9115-dc8192f80f5a tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] [instance: 0412cc20-ca45-47f6-bd5b-c2c73106ba53] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:44.434383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:44.437655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e5a4840-41a7-41ac-9115-dc8192f80f5a tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:44.442080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e5a4840-41a7-41ac-9115-dc8192f80f5a tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:44.443638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e5a4840-41a7-41ac-9115-dc8192f80f5a tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:44.444407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e5a4840-41a7-41ac-9115-dc8192f80f5a tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:44.446753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e5a4840-41a7-41ac-9115-dc8192f80f5a tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:44.447436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8d772560-d813-432f-b7d2-71380fca515f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Action: 'create', calling method: .version_select at 0x7ff05340f040>, body: {"keypair": {"name": "tempest-keypair-981456936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXxVHN7ffit9ZRBim6pX17hDmq8XmRVNBA4MV76+aIGHgYri79425cKuiTL6TvtC2BiJaxTlCZsHN70v296uCUXEkiJomIe1sDxVcY0bYzJ/jS7lAeR6ETgxnKiOGh/yA=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:15:44.449177 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e5a4840-41a7-41ac-9115-dc8192f80f5a tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:44.462000 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:44.503912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-8d772560-d813-432f-b7d2-71380fca515f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Getting quotas for project 4c05b5161bd341acb4fc97fa616b3713. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:15:44.522088 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-8d772560-d813-432f-b7d2-71380fca515f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Getting quotas for user e9086760822f48ee921bcdb7bd5ae299 and project 4c05b5161bd341acb4fc97fa616b3713. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:15:44.639285 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8d772560-d813-432f-b7d2-71380fca515f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.207862 Oct 29 03:15:44.649476 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2537/4874] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:15:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:15:44.770183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7e5a4840-41a7-41ac-9115-dc8192f80f5a tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d658dc3070248f08379ce63a45cc327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65109d16cc974a7db3fa5706cb5d7db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:44.780800 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7e5a4840-41a7-41ac-9115-dc8192f80f5a tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] 10.222.0.46 "GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53" status: 200 len: 1313 microversion: 2.1 time: 0.368957 Oct 29 03:15:44.790430 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2338/4875] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:44 2022] GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53 => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:45.806552 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7747412e-b6af-403d-8f72-ace2d72a4cb1 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:45.808229 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7747412e-b6af-403d-8f72-ace2d72a4cb1 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] [instance: 0412cc20-ca45-47f6-bd5b-c2c73106ba53] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:45.830745 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7747412e-b6af-403d-8f72-ace2d72a4cb1 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:45.831245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7747412e-b6af-403d-8f72-ace2d72a4cb1 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:45.831686 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7747412e-b6af-403d-8f72-ace2d72a4cb1 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:45.832405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7747412e-b6af-403d-8f72-ace2d72a4cb1 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:45.851626 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7747412e-b6af-403d-8f72-ace2d72a4cb1 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:45.852554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7747412e-b6af-403d-8f72-ace2d72a4cb1 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:46.134561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7747412e-b6af-403d-8f72-ace2d72a4cb1 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d658dc3070248f08379ce63a45cc327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65109d16cc974a7db3fa5706cb5d7db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:46.147867 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7747412e-b6af-403d-8f72-ace2d72a4cb1 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] 10.222.0.46 "GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53" status: 200 len: 1313 microversion: 2.1 time: 0.346979 Oct 29 03:15:46.167952 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2538/4876] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:45 2022] GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53 => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:46.188304 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-29fbd300-df41-49b2-8049-15a38ac36b11 req-5f7df421-29e4-4b2f-885b-bd5a82925ddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0412cc20-ca45-47f6-bd5b-c2c73106ba53", "name": "network-vif-plugged", "status": "completed", "tag": "08acf100-0058-4400-8149-0bed3c84d177"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:15:46.203841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-29fbd300-df41-49b2-8049-15a38ac36b11 req-5f7df421-29e4-4b2f-885b-bd5a82925ddd service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:46.205464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-29fbd300-df41-49b2-8049-15a38ac36b11 req-5f7df421-29e4-4b2f-885b-bd5a82925ddd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:46.206341 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-29fbd300-df41-49b2-8049-15a38ac36b11 req-5f7df421-29e4-4b2f-885b-bd5a82925ddd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:46.229629 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-29fbd300-df41-49b2-8049-15a38ac36b11 req-5f7df421-29e4-4b2f-885b-bd5a82925ddd service nova] Creating event network-vif-plugged:08acf100-0058-4400-8149-0bed3c84d177 for instance 0412cc20-ca45-47f6-bd5b-c2c73106ba53 on n-h1-862967-2 Oct 29 03:15:46.237562 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-29fbd300-df41-49b2-8049-15a38ac36b11 req-5f7df421-29e4-4b2f-885b-bd5a82925ddd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055661 Oct 29 03:15:46.238856 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2339/4877] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:15:47.172962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9ce710fb-66ea-408d-b54c-121bf5170f77 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:47.174603 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9ce710fb-66ea-408d-b54c-121bf5170f77 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] [instance: 0412cc20-ca45-47f6-bd5b-c2c73106ba53] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:47.181089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=7 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:47.200768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ce710fb-66ea-408d-b54c-121bf5170f77 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:47.201393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ce710fb-66ea-408d-b54c-121bf5170f77 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:47.202147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ce710fb-66ea-408d-b54c-121bf5170f77 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:47.204042 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ce710fb-66ea-408d-b54c-121bf5170f77 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:47.204869 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ce710fb-66ea-408d-b54c-121bf5170f77 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:47.205582 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ce710fb-66ea-408d-b54c-121bf5170f77 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:47.214810 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=75 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:47.524815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9ce710fb-66ea-408d-b54c-121bf5170f77 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d658dc3070248f08379ce63a45cc327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65109d16cc974a7db3fa5706cb5d7db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:47.542501 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9ce710fb-66ea-408d-b54c-121bf5170f77 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] 10.222.0.46 "GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53" status: 200 len: 1313 microversion: 2.1 time: 0.371795 Oct 29 03:15:47.544040 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2539/4878] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:47 2022] GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53 => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:47.939440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fc77ba85-cd92-4a2d-be91-9fdf9c7bdc4a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-653536600", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2930b46-8565-462a-9f64-b9b374f3c23b"}], "security_groups": [{"name": "tempest-securitygroup--791917900"}], "key_name": "tempest-keypair-981456936", "user_data": "}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:15:48.129236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-fc77ba85-cd92-4a2d-be91-9fdf9c7bdc4a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] validate_networks() for [('e2930b46-8565-462a-9f64-b9b374f3c23b', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:15:48.570924 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b7cbc808-8a5b-4c85-8dbf-b1212abbc309 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:48.573869 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b7cbc808-8a5b-4c85-8dbf-b1212abbc309 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] [instance: 0412cc20-ca45-47f6-bd5b-c2c73106ba53] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:48.585629 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7cbc808-8a5b-4c85-8dbf-b1212abbc309 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:48.586556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7cbc808-8a5b-4c85-8dbf-b1212abbc309 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:48.587664 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7cbc808-8a5b-4c85-8dbf-b1212abbc309 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:48.588753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7cbc808-8a5b-4c85-8dbf-b1212abbc309 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:48.589539 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7cbc808-8a5b-4c85-8dbf-b1212abbc309 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:48.590515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7cbc808-8a5b-4c85-8dbf-b1212abbc309 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:48.860407 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b7cbc808-8a5b-4c85-8dbf-b1212abbc309 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d658dc3070248f08379ce63a45cc327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65109d16cc974a7db3fa5706cb5d7db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:48.873161 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b7cbc808-8a5b-4c85-8dbf-b1212abbc309 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] 10.222.0.46 "GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53" status: 200 len: 1496 microversion: 2.1 time: 0.308009 Oct 29 03:15:48.887368 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2540/4879] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:48 2022] GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53 => generated 1496 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:49.371876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-fc77ba85-cd92-4a2d-be91-9fdf9c7bdc4a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:15:49.373733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-fc77ba85-cd92-4a2d-be91-9fdf9c7bdc4a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:15:49.374480 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-fc77ba85-cd92-4a2d-be91-9fdf9c7bdc4a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:15:49.375564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-fc77ba85-cd92-4a2d-be91-9fdf9c7bdc4a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:15:49.376306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-fc77ba85-cd92-4a2d-be91-9fdf9c7bdc4a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:15:49.399818 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc77ba85-cd92-4a2d-be91-9fdf9c7bdc4a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:49.400316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc77ba85-cd92-4a2d-be91-9fdf9c7bdc4a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:49.400781 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc77ba85-cd92-4a2d-be91-9fdf9c7bdc4a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:49.401542 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc77ba85-cd92-4a2d-be91-9fdf9c7bdc4a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:49.402955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc77ba85-cd92-4a2d-be91-9fdf9c7bdc4a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:49.403395 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc77ba85-cd92-4a2d-be91-9fdf9c7bdc4a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:49.434948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-fc77ba85-cd92-4a2d-be91-9fdf9c7bdc4a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Getting quotas for project 4c05b5161bd341acb4fc97fa616b3713. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:15:49.443841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-fc77ba85-cd92-4a2d-be91-9fdf9c7bdc4a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Getting quotas for user e9086760822f48ee921bcdb7bd5ae299 and project 4c05b5161bd341acb4fc97fa616b3713. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:15:49.465532 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fc77ba85-cd92-4a2d-be91-9fdf9c7bdc4a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:15:49.482107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fc77ba85-cd92-4a2d-be91-9fdf9c7bdc4a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 9e7f97fd-a366-4b20-a65c-9b2395b20ec2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:15:49.637742 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fc77ba85-cd92-4a2d-be91-9fdf9c7bdc4a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.707122 Oct 29 03:15:49.639005 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2340/4880] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:15:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 1709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:15:49.651769 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f08bef13-b2d5-4a9e-b54e-20fec06af143 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:49.653019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f08bef13-b2d5-4a9e-b54e-20fec06af143 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 9e7f97fd-a366-4b20-a65c-9b2395b20ec2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:49.824275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f08bef13-b2d5-4a9e-b54e-20fec06af143 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:49.837443 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f08bef13-b2d5-4a9e-b54e-20fec06af143 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2" status: 200 len: 1240 microversion: 2.1 time: 0.186566 Oct 29 03:15:49.840697 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2541/4881] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:49 2022] GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2 => generated 1240 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:50.864378 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-16c63fa3-9ec9-417f-8ed4-be0a6aefcc57 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:50.865272 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-16c63fa3-9ec9-417f-8ed4-be0a6aefcc57 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 9e7f97fd-a366-4b20-a65c-9b2395b20ec2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:50.883457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-16c63fa3-9ec9-417f-8ed4-be0a6aefcc57 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:50.884365 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-16c63fa3-9ec9-417f-8ed4-be0a6aefcc57 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:50.890975 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-16c63fa3-9ec9-417f-8ed4-be0a6aefcc57 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:50.891800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-16c63fa3-9ec9-417f-8ed4-be0a6aefcc57 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:50.903312 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-16c63fa3-9ec9-417f-8ed4-be0a6aefcc57 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:50.903809 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-16c63fa3-9ec9-417f-8ed4-be0a6aefcc57 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:51.379159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-16c63fa3-9ec9-417f-8ed4-be0a6aefcc57 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:51.394165 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-16c63fa3-9ec9-417f-8ed4-be0a6aefcc57 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2" status: 200 len: 1244 microversion: 2.1 time: 0.535428 Oct 29 03:15:51.396756 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2341/4882] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:50 2022] GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2 => generated 1244 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:52.422695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bde9a820-df4d-4fa8-8f62-264e2e6074b5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:52.423489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bde9a820-df4d-4fa8-8f62-264e2e6074b5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 9e7f97fd-a366-4b20-a65c-9b2395b20ec2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:52.444691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bde9a820-df4d-4fa8-8f62-264e2e6074b5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:52.447482 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bde9a820-df4d-4fa8-8f62-264e2e6074b5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:52.448259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bde9a820-df4d-4fa8-8f62-264e2e6074b5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:52.449695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bde9a820-df4d-4fa8-8f62-264e2e6074b5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:52.450451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bde9a820-df4d-4fa8-8f62-264e2e6074b5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:52.451621 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bde9a820-df4d-4fa8-8f62-264e2e6074b5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:52.632272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bde9a820-df4d-4fa8-8f62-264e2e6074b5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:52.649020 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bde9a820-df4d-4fa8-8f62-264e2e6074b5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2" status: 200 len: 1298 microversion: 2.1 time: 0.232018 Oct 29 03:15:52.661101 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2542/4883] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:52 2022] GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2 => generated 1298 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:53.678337 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-23da93e9-4bd3-4b0c-97be-5e76c1a5a049 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:53.679545 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-23da93e9-4bd3-4b0c-97be-5e76c1a5a049 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 9e7f97fd-a366-4b20-a65c-9b2395b20ec2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:53.700674 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23da93e9-4bd3-4b0c-97be-5e76c1a5a049 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:53.705215 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23da93e9-4bd3-4b0c-97be-5e76c1a5a049 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:53.705957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23da93e9-4bd3-4b0c-97be-5e76c1a5a049 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:53.706884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23da93e9-4bd3-4b0c-97be-5e76c1a5a049 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:53.708088 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23da93e9-4bd3-4b0c-97be-5e76c1a5a049 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:53.721486 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23da93e9-4bd3-4b0c-97be-5e76c1a5a049 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:54.249331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5e8a6d33-74d3-46ad-b628-641db870a595 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:54.252195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5e8a6d33-74d3-46ad-b628-641db870a595 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] [instance: 0412cc20-ca45-47f6-bd5b-c2c73106ba53] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:54.266132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e8a6d33-74d3-46ad-b628-641db870a595 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:54.269096 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e8a6d33-74d3-46ad-b628-641db870a595 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:54.269855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e8a6d33-74d3-46ad-b628-641db870a595 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:54.273082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e8a6d33-74d3-46ad-b628-641db870a595 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:54.275150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e8a6d33-74d3-46ad-b628-641db870a595 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:54.277702 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e8a6d33-74d3-46ad-b628-641db870a595 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:54.364139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5e8a6d33-74d3-46ad-b628-641db870a595 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] [instance: 0412cc20-ca45-47f6-bd5b-c2c73106ba53] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:15:54.458345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-23da93e9-4bd3-4b0c-97be-5e76c1a5a049 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:54.468001 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-23da93e9-4bd3-4b0c-97be-5e76c1a5a049 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2" status: 200 len: 1365 microversion: 2.1 time: 0.794041 Oct 29 03:15:54.491421 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2342/4884] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:53 2022] GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2 => generated 1365 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:54.578102 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5e8a6d33-74d3-46ad-b628-641db870a595 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53" status: 204 len: 0 microversion: 2.1 time: 0.337036 Oct 29 03:15:54.579023 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2543/4885] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:15:54 2022] DELETE /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:15:54.594786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e6544ad2-d85f-4ee3-96ca-59348d75bb02 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:54.596022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e6544ad2-d85f-4ee3-96ca-59348d75bb02 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] [instance: 0412cc20-ca45-47f6-bd5b-c2c73106ba53] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:54.606332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6544ad2-d85f-4ee3-96ca-59348d75bb02 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:54.606833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6544ad2-d85f-4ee3-96ca-59348d75bb02 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:54.609459 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6544ad2-d85f-4ee3-96ca-59348d75bb02 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:54.610250 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6544ad2-d85f-4ee3-96ca-59348d75bb02 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:54.610706 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6544ad2-d85f-4ee3-96ca-59348d75bb02 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:54.611142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6544ad2-d85f-4ee3-96ca-59348d75bb02 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:55.143373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e6544ad2-d85f-4ee3-96ca-59348d75bb02 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d658dc3070248f08379ce63a45cc327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65109d16cc974a7db3fa5706cb5d7db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:55.158055 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e6544ad2-d85f-4ee3-96ca-59348d75bb02 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] 10.222.0.46 "GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53" status: 200 len: 1502 microversion: 2.1 time: 0.574403 Oct 29 03:15:55.161498 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2343/4886] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:54 2022] GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53 => generated 1502 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:55.497938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5fec3e1c-bd79-4b3a-827a-637e447930c3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:55.499694 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5fec3e1c-bd79-4b3a-827a-637e447930c3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 9e7f97fd-a366-4b20-a65c-9b2395b20ec2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:55.518145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fec3e1c-bd79-4b3a-827a-637e447930c3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:55.519768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fec3e1c-bd79-4b3a-827a-637e447930c3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:55.520437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fec3e1c-bd79-4b3a-827a-637e447930c3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:55.522794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fec3e1c-bd79-4b3a-827a-637e447930c3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:55.525163 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fec3e1c-bd79-4b3a-827a-637e447930c3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:55.525791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fec3e1c-bd79-4b3a-827a-637e447930c3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:56.188758 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-19bfe951-9b35-4296-9db9-1f6d11ee8aa4 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:56.190128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-19bfe951-9b35-4296-9db9-1f6d11ee8aa4 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] [instance: 0412cc20-ca45-47f6-bd5b-c2c73106ba53] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:56.202895 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19bfe951-9b35-4296-9db9-1f6d11ee8aa4 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:56.207703 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19bfe951-9b35-4296-9db9-1f6d11ee8aa4 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:56.208781 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19bfe951-9b35-4296-9db9-1f6d11ee8aa4 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:56.210535 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19bfe951-9b35-4296-9db9-1f6d11ee8aa4 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:56.211406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19bfe951-9b35-4296-9db9-1f6d11ee8aa4 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:56.216045 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19bfe951-9b35-4296-9db9-1f6d11ee8aa4 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:56.258711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5fec3e1c-bd79-4b3a-827a-637e447930c3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:56.271167 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5fec3e1c-bd79-4b3a-827a-637e447930c3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2" status: 200 len: 1365 microversion: 2.1 time: 0.779404 Oct 29 03:15:56.275390 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2544/4887] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:55 2022] GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2 => generated 1365 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:56.983249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-af770779-3521-401f-acd4-f1e8f53d52b3 req-dfa3ac90-9690-44cf-a9d8-cb31f9ccabc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e7f97fd-a366-4b20-a65c-9b2395b20ec2", "tag": "b1f413bd-9ddf-415c-ab2d-619b60a5296d"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:15:57.025161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-af770779-3521-401f-acd4-f1e8f53d52b3 req-dfa3ac90-9690-44cf-a9d8-cb31f9ccabc7 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:57.026508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-af770779-3521-401f-acd4-f1e8f53d52b3 req-dfa3ac90-9690-44cf-a9d8-cb31f9ccabc7 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:57.027303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-af770779-3521-401f-acd4-f1e8f53d52b3 req-dfa3ac90-9690-44cf-a9d8-cb31f9ccabc7 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:57.057518 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-af770779-3521-401f-acd4-f1e8f53d52b3 req-dfa3ac90-9690-44cf-a9d8-cb31f9ccabc7 service nova] Creating event network-changed:b1f413bd-9ddf-415c-ab2d-619b60a5296d for instance 9e7f97fd-a366-4b20-a65c-9b2395b20ec2 on n-h2-862967-2 Oct 29 03:15:57.070180 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-af770779-3521-401f-acd4-f1e8f53d52b3 req-dfa3ac90-9690-44cf-a9d8-cb31f9ccabc7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093050 Oct 29 03:15:57.073213 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2545/4888] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:15:57.298783 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-583ae276-ac92-4941-a2cb-b88ee79fa930 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:57.301039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-583ae276-ac92-4941-a2cb-b88ee79fa930 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 9e7f97fd-a366-4b20-a65c-9b2395b20ec2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:57.312326 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-583ae276-ac92-4941-a2cb-b88ee79fa930 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:57.316881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-583ae276-ac92-4941-a2cb-b88ee79fa930 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:57.317721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-583ae276-ac92-4941-a2cb-b88ee79fa930 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:57.322586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-583ae276-ac92-4941-a2cb-b88ee79fa930 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:57.325033 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-583ae276-ac92-4941-a2cb-b88ee79fa930 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:57.328503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-583ae276-ac92-4941-a2cb-b88ee79fa930 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:57.341087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-19bfe951-9b35-4296-9db9-1f6d11ee8aa4 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d658dc3070248f08379ce63a45cc327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65109d16cc974a7db3fa5706cb5d7db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:57.357561 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-19bfe951-9b35-4296-9db9-1f6d11ee8aa4 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] 10.222.0.46 "GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53" status: 200 len: 1502 microversion: 2.1 time: 1.171103 Oct 29 03:15:57.360725 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2344/4889] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:56 2022] GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53 => generated 1502 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:58.166294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-583ae276-ac92-4941-a2cb-b88ee79fa930 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:58.177883 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-583ae276-ac92-4941-a2cb-b88ee79fa930 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2" status: 200 len: 1365 microversion: 2.1 time: 0.883257 Oct 29 03:15:58.178489 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2546/4890] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:57 2022] GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2 => generated 1365 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:15:58.387326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-308b7b6a-bc73-46ac-9b37-7809f9479294 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:58.388135 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-308b7b6a-bc73-46ac-9b37-7809f9479294 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] [instance: 0412cc20-ca45-47f6-bd5b-c2c73106ba53] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:58.407463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-308b7b6a-bc73-46ac-9b37-7809f9479294 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:58.407967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-308b7b6a-bc73-46ac-9b37-7809f9479294 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:58.408421 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-308b7b6a-bc73-46ac-9b37-7809f9479294 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:58.409183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-308b7b6a-bc73-46ac-9b37-7809f9479294 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:58.409633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-308b7b6a-bc73-46ac-9b37-7809f9479294 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:58.413715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-308b7b6a-bc73-46ac-9b37-7809f9479294 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:58.750463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-308b7b6a-bc73-46ac-9b37-7809f9479294 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d658dc3070248f08379ce63a45cc327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65109d16cc974a7db3fa5706cb5d7db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:58.759910 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-308b7b6a-bc73-46ac-9b37-7809f9479294 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] 10.222.0.46 "GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53" status: 200 len: 1460 microversion: 2.1 time: 0.381168 Oct 29 03:15:58.764876 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2345/4891] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:58 2022] GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53 => generated 1460 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:58.787547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-8d8f6663-dc37-45a6-b7e3-f53553033a25 req-8acec490-f1e4-4f14-98aa-2a2c16dfd101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0412cc20-ca45-47f6-bd5b-c2c73106ba53", "name": "network-vif-deleted", "tag": "08acf100-0058-4400-8149-0bed3c84d177"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:15:58.801896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8d8f6663-dc37-45a6-b7e3-f53553033a25 req-8acec490-f1e4-4f14-98aa-2a2c16dfd101 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:58.802857 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8d8f6663-dc37-45a6-b7e3-f53553033a25 req-8acec490-f1e4-4f14-98aa-2a2c16dfd101 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:58.804959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8d8f6663-dc37-45a6-b7e3-f53553033a25 req-8acec490-f1e4-4f14-98aa-2a2c16dfd101 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:58.820412 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-8d8f6663-dc37-45a6-b7e3-f53553033a25 req-8acec490-f1e4-4f14-98aa-2a2c16dfd101 service nova] Creating event network-vif-deleted:08acf100-0058-4400-8149-0bed3c84d177 for instance 0412cc20-ca45-47f6-bd5b-c2c73106ba53 on n-h1-862967-2 Oct 29 03:15:58.829655 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-8d8f6663-dc37-45a6-b7e3-f53553033a25 req-8acec490-f1e4-4f14-98aa-2a2c16dfd101 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046531 Oct 29 03:15:58.831451 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2547/4892] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:15:59.204751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-947f339a-0467-48bc-ba58-c9f49ca2818e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:59.205670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-947f339a-0467-48bc-ba58-c9f49ca2818e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 9e7f97fd-a366-4b20-a65c-9b2395b20ec2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:59.215895 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-947f339a-0467-48bc-ba58-c9f49ca2818e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:59.216382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-947f339a-0467-48bc-ba58-c9f49ca2818e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:59.219825 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-947f339a-0467-48bc-ba58-c9f49ca2818e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:59.221858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-947f339a-0467-48bc-ba58-c9f49ca2818e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:59.222560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-947f339a-0467-48bc-ba58-c9f49ca2818e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:59.225119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-947f339a-0467-48bc-ba58-c9f49ca2818e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:59.416694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:59.457511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:59.552415 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-947f339a-0467-48bc-ba58-c9f49ca2818e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:15:59.567984 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-947f339a-0467-48bc-ba58-c9f49ca2818e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2" status: 200 len: 1365 microversion: 2.1 time: 0.364908 Oct 29 03:15:59.580754 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2346/4893] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:59 2022] GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2 => generated 1365 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:15:59.788683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-56bb2fbe-9c1a-4863-83c0-1ca810470612 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:15:59.790095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-56bb2fbe-9c1a-4863-83c0-1ca810470612 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] [instance: 0412cc20-ca45-47f6-bd5b-c2c73106ba53] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:15:59.808066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56bb2fbe-9c1a-4863-83c0-1ca810470612 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:59.808685 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56bb2fbe-9c1a-4863-83c0-1ca810470612 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:59.809327 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56bb2fbe-9c1a-4863-83c0-1ca810470612 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:59.810193 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56bb2fbe-9c1a-4863-83c0-1ca810470612 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:15:59.810645 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56bb2fbe-9c1a-4863-83c0-1ca810470612 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:15:59.811065 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56bb2fbe-9c1a-4863-83c0-1ca810470612 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:15:59.841878 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:59.843634 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-56bb2fbe-9c1a-4863-83c0-1ca810470612 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] HTTP exception thrown: Instance 0412cc20-ca45-47f6-bd5b-c2c73106ba53 could not be found. Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-56bb2fbe-9c1a-4863-83c0-1ca810470612 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Request method failure captured: Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53 HTTP/1.1 Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJrMjrsk6RJ_vgm3_r16_I6pqOyX41JK62UWXd2FliCEfZDiG0Jq6Lg5JzDzbC3dg_pr6ASWq3t0OcRQKuk4XKnNGJxKQvq-3EWrcY2f0aXxkzytXqcAYiN9B2kd6gZBVttRXqAPvJVj3edrX9Mu5ISyz2QbL3frgmFOe0NenCzmAwo Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 65109d16cc974a7db3fa5706cb5d7db7 Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-VolumesActionsTest-1266398514 Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/65109d16cc974a7db3fa5706cb5d7db7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/65109d16cc974a7db3fa5706cb5d7db7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_65109d16cc974a7db3fa5706cb5d7db7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/65109d16cc974a7db3fa5706cb5d7db7"}]}] Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-VolumesActionsTest-1266398514 Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 65109d16cc974a7db3fa5706cb5d7db7 Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-VolumesActionsTest-1266398514 Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-VolumesActionsTest-1266398514-project Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 2d658dc3070248f08379ce63a45cc327 Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-VolumesActionsTest-1266398514-project Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 0412cc20-ca45-47f6-bd5b-c2c73106ba53 could not be found. Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '0412cc20-ca45-47f6-bd5b-c2c73106ba53'} Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0412cc20-ca45-47f6-bd5b-c2c73106ba53 could not be found. Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0412cc20-ca45-47f6-bd5b-c2c73106ba53 could not be found. Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:15:59.845322 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:15:59.849431 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:15:59.849431 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:15:59.849431 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:15:59.849431 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:15:59.849431 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:15:59.849431 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0412cc20-ca45-47f6-bd5b-c2c73106ba53 could not be found. Oct 29 03:15:59.849431 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:15:59.849431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-56bb2fbe-9c1a-4863-83c0-1ca810470612 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] Returning 404 to user: Instance 0412cc20-ca45-47f6-bd5b-c2c73106ba53 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:15:59.849431 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-56bb2fbe-9c1a-4863-83c0-1ca810470612 tempest-VolumesActionsTest-1266398514 tempest-VolumesActionsTest-1266398514-project] 10.222.0.46 "GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53" status: 404 len: 111 microversion: 2.1 time: 0.063398 Oct 29 03:15:59.849431 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2548/4894] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:15:59 2022] GET /compute/v2.1/servers/0412cc20-ca45-47f6-bd5b-c2c73106ba53 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:16:00.592465 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-98f46334-d700-4f18-969f-149302ef3b30 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:00.593189 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-98f46334-d700-4f18-969f-149302ef3b30 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 9e7f97fd-a366-4b20-a65c-9b2395b20ec2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:00.608378 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98f46334-d700-4f18-969f-149302ef3b30 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:00.609271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98f46334-d700-4f18-969f-149302ef3b30 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:00.611067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98f46334-d700-4f18-969f-149302ef3b30 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:00.612735 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98f46334-d700-4f18-969f-149302ef3b30 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:00.614792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98f46334-d700-4f18-969f-149302ef3b30 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:00.617062 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98f46334-d700-4f18-969f-149302ef3b30 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:00.946450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-98f46334-d700-4f18-969f-149302ef3b30 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:00.957553 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-98f46334-d700-4f18-969f-149302ef3b30 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2" status: 200 len: 1365 microversion: 2.1 time: 0.370207 Oct 29 03:16:00.959042 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2347/4895] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:00 2022] GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2 => generated 1365 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:01.985386 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0f79be4b-76a5-4d1b-ae2e-ede03daf1d24 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:01.985991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0f79be4b-76a5-4d1b-ae2e-ede03daf1d24 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 9e7f97fd-a366-4b20-a65c-9b2395b20ec2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:01.994738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f79be4b-76a5-4d1b-ae2e-ede03daf1d24 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:01.995225 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f79be4b-76a5-4d1b-ae2e-ede03daf1d24 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:01.995700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f79be4b-76a5-4d1b-ae2e-ede03daf1d24 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:01.996730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f79be4b-76a5-4d1b-ae2e-ede03daf1d24 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:01.996918 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f79be4b-76a5-4d1b-ae2e-ede03daf1d24 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:02.005440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f79be4b-76a5-4d1b-ae2e-ede03daf1d24 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:02.285567 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0f79be4b-76a5-4d1b-ae2e-ede03daf1d24 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:02.296307 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0f79be4b-76a5-4d1b-ae2e-ede03daf1d24 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2" status: 200 len: 1365 microversion: 2.1 time: 0.316753 Oct 29 03:16:02.301631 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2549/4896] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:01 2022] GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2 => generated 1365 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:02.689093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-1df93c1a-3442-4213-b35a-84db2f58727b req-28a572da-4607-47fc-b2fb-b61945727b30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e7f97fd-a366-4b20-a65c-9b2395b20ec2", "name": "network-vif-plugged", "status": "completed", "tag": "b1f413bd-9ddf-415c-ab2d-619b60a5296d"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:16:02.726497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-1df93c1a-3442-4213-b35a-84db2f58727b req-28a572da-4607-47fc-b2fb-b61945727b30 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:02.729220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-1df93c1a-3442-4213-b35a-84db2f58727b req-28a572da-4607-47fc-b2fb-b61945727b30 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:02.731156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-1df93c1a-3442-4213-b35a-84db2f58727b req-28a572da-4607-47fc-b2fb-b61945727b30 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:02.768931 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-1df93c1a-3442-4213-b35a-84db2f58727b req-28a572da-4607-47fc-b2fb-b61945727b30 service nova] Creating event network-vif-plugged:b1f413bd-9ddf-415c-ab2d-619b60a5296d for instance 9e7f97fd-a366-4b20-a65c-9b2395b20ec2 on n-h2-862967-2 Oct 29 03:16:02.789987 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-1df93c1a-3442-4213-b35a-84db2f58727b req-28a572da-4607-47fc-b2fb-b61945727b30 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104847 Oct 29 03:16:02.794160 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2348/4897] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:16:03.327197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-06a89a1b-68a3-432f-a6ac-8456eac5da6b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:03.328219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-06a89a1b-68a3-432f-a6ac-8456eac5da6b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 9e7f97fd-a366-4b20-a65c-9b2395b20ec2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:03.342931 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06a89a1b-68a3-432f-a6ac-8456eac5da6b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:03.343788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06a89a1b-68a3-432f-a6ac-8456eac5da6b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:03.344430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06a89a1b-68a3-432f-a6ac-8456eac5da6b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:03.345667 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06a89a1b-68a3-432f-a6ac-8456eac5da6b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:03.346350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06a89a1b-68a3-432f-a6ac-8456eac5da6b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:03.347000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06a89a1b-68a3-432f-a6ac-8456eac5da6b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:03.717222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-06a89a1b-68a3-432f-a6ac-8456eac5da6b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:03.733454 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-06a89a1b-68a3-432f-a6ac-8456eac5da6b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2" status: 200 len: 1365 microversion: 2.1 time: 0.412355 Oct 29 03:16:03.734412 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2550/4898] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:03 2022] GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2 => generated 1365 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:04.757923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-18585572-2e0d-49c6-9524-98d73b18e017 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:04.759337 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-18585572-2e0d-49c6-9524-98d73b18e017 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 9e7f97fd-a366-4b20-a65c-9b2395b20ec2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:04.776970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18585572-2e0d-49c6-9524-98d73b18e017 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:04.778773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18585572-2e0d-49c6-9524-98d73b18e017 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:04.779559 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18585572-2e0d-49c6-9524-98d73b18e017 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:04.781136 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18585572-2e0d-49c6-9524-98d73b18e017 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:04.784032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18585572-2e0d-49c6-9524-98d73b18e017 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:04.784892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18585572-2e0d-49c6-9524-98d73b18e017 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:05.029536 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-18585572-2e0d-49c6-9524-98d73b18e017 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:05.039621 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-18585572-2e0d-49c6-9524-98d73b18e017 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2" status: 200 len: 1554 microversion: 2.1 time: 0.286356 Oct 29 03:16:05.061232 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2349/4899] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:04 2022] GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2 => generated 1554 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:05.066930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bd3b5563-037f-4225-8f77-83cd1fe1acc7 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:05.067690 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bd3b5563-037f-4225-8f77-83cd1fe1acc7 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 9e7f97fd-a366-4b20-a65c-9b2395b20ec2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:05.075974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd3b5563-037f-4225-8f77-83cd1fe1acc7 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:05.076652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd3b5563-037f-4225-8f77-83cd1fe1acc7 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:05.077238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd3b5563-037f-4225-8f77-83cd1fe1acc7 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:05.078056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd3b5563-037f-4225-8f77-83cd1fe1acc7 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:05.078616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd3b5563-037f-4225-8f77-83cd1fe1acc7 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:05.079144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd3b5563-037f-4225-8f77-83cd1fe1acc7 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:05.254536 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bd3b5563-037f-4225-8f77-83cd1fe1acc7 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.191841 Oct 29 03:16:05.255594 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2551/4900] 10.222.0.46 () {58 vars in 1275 bytes} [Sat Oct 29 03:16:05 2022] GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2/os-interface => generated 284 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:16:08.592476 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-37c050e6-8534-43d6-a8a0-ad3e0236523c req-900a5c35-2a43-4fab-a40c-bf2e1cd1a3a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e7f97fd-a366-4b20-a65c-9b2395b20ec2", "tag": "b1f413bd-9ddf-415c-ab2d-619b60a5296d"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:16:08.631691 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-37c050e6-8534-43d6-a8a0-ad3e0236523c req-900a5c35-2a43-4fab-a40c-bf2e1cd1a3a1 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:08.632239 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-37c050e6-8534-43d6-a8a0-ad3e0236523c req-900a5c35-2a43-4fab-a40c-bf2e1cd1a3a1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:08.632719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-37c050e6-8534-43d6-a8a0-ad3e0236523c req-900a5c35-2a43-4fab-a40c-bf2e1cd1a3a1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:08.684393 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-37c050e6-8534-43d6-a8a0-ad3e0236523c req-900a5c35-2a43-4fab-a40c-bf2e1cd1a3a1 service nova] Creating event network-changed:b1f413bd-9ddf-415c-ab2d-619b60a5296d for instance 9e7f97fd-a366-4b20-a65c-9b2395b20ec2 on n-h2-862967-2 Oct 29 03:16:08.701755 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-37c050e6-8534-43d6-a8a0-ad3e0236523c req-900a5c35-2a43-4fab-a40c-bf2e1cd1a3a1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109858 Oct 29 03:16:08.705483 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2350/4901] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:16:15.706471 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:15.707235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:15.711527 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c06222a4-51f5-4f65-bd94-9b325f263fbd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:15.712238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c06222a4-51f5-4f65-bd94-9b325f263fbd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:15.729416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c06222a4-51f5-4f65-bd94-9b325f263fbd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:15.730010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c06222a4-51f5-4f65-bd94-9b325f263fbd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:15.730462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c06222a4-51f5-4f65-bd94-9b325f263fbd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:15.735741 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c06222a4-51f5-4f65-bd94-9b325f263fbd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:15.736236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c06222a4-51f5-4f65-bd94-9b325f263fbd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:15.736701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c06222a4-51f5-4f65-bd94-9b325f263fbd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:16.111609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c06222a4-51f5-4f65-bd94-9b325f263fbd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:16.126408 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c06222a4-51f5-4f65-bd94-9b325f263fbd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.421439 Oct 29 03:16:16.127345 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2552/4902] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:15 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:16.155560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8ac39e0f-ec1f-4457-a6a7-db2ef41e0f6d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:16.156993 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8ac39e0f-ec1f-4457-a6a7-db2ef41e0f6d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:16.161492 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:16.170955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ac39e0f-ec1f-4457-a6a7-db2ef41e0f6d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:16.171733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ac39e0f-ec1f-4457-a6a7-db2ef41e0f6d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:16.172411 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ac39e0f-ec1f-4457-a6a7-db2ef41e0f6d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:16.173376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ac39e0f-ec1f-4457-a6a7-db2ef41e0f6d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:16.174038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ac39e0f-ec1f-4457-a6a7-db2ef41e0f6d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:16.174670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ac39e0f-ec1f-4457-a6a7-db2ef41e0f6d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:16.250449 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=62 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:17.295468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8ac39e0f-ec1f-4457-a6a7-db2ef41e0f6d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:17.313404 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8ac39e0f-ec1f-4457-a6a7-db2ef41e0f6d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 1.163788 Oct 29 03:16:17.328731 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2351/4903] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:16 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:17.343631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a306bd3e-54b4-4f9d-b686-d2aa7bc24b7d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:17.345343 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a306bd3e-54b4-4f9d-b686-d2aa7bc24b7d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:17.359707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a306bd3e-54b4-4f9d-b686-d2aa7bc24b7d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:17.362345 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a306bd3e-54b4-4f9d-b686-d2aa7bc24b7d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:17.364859 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a306bd3e-54b4-4f9d-b686-d2aa7bc24b7d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:17.367754 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a306bd3e-54b4-4f9d-b686-d2aa7bc24b7d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:17.368718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a306bd3e-54b4-4f9d-b686-d2aa7bc24b7d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:17.370407 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a306bd3e-54b4-4f9d-b686-d2aa7bc24b7d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:17.928377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a306bd3e-54b4-4f9d-b686-d2aa7bc24b7d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:17.969107 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a306bd3e-54b4-4f9d-b686-d2aa7bc24b7d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.629374 Oct 29 03:16:17.986929 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2553/4904] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:17 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:18.004053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fe23c93b-0f2b-4d30-84b5-2e282402f292 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-580440784"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:16:18.011218 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fe23c93b-0f2b-4d30-84b5-2e282402f292 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:18.031137 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fe23c93b-0f2b-4d30-84b5-2e282402f292 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:18.031660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fe23c93b-0f2b-4d30-84b5-2e282402f292 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:18.032110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fe23c93b-0f2b-4d30-84b5-2e282402f292 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:18.032892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fe23c93b-0f2b-4d30-84b5-2e282402f292 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:18.033366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fe23c93b-0f2b-4d30-84b5-2e282402f292 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:18.033960 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fe23c93b-0f2b-4d30-84b5-2e282402f292 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:18.598353 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fe23c93b-0f2b-4d30-84b5-2e282402f292 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action" status: 202 len: 0 microversion: 2.1 time: 0.598068 Oct 29 03:16:18.609840 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2352/4905] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:16:17 2022] POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action => generated 0 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 29 03:16:24.801448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-4b97f4c5-cc27-4895-89ff-f51a337b148a req-310fcb3a-000e-4db1-99d5-db90533db76d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23349ce8-2588-42c9-8de7-90865b56c980", "name": "network-vif-plugged", "status": "completed", "tag": "26865343-33e7-4622-bd06-ed6191938067"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:16:24.844436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4b97f4c5-cc27-4895-89ff-f51a337b148a req-310fcb3a-000e-4db1-99d5-db90533db76d service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:24.849313 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4b97f4c5-cc27-4895-89ff-f51a337b148a req-310fcb3a-000e-4db1-99d5-db90533db76d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:24.850302 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4b97f4c5-cc27-4895-89ff-f51a337b148a req-310fcb3a-000e-4db1-99d5-db90533db76d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:24.902946 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-4b97f4c5-cc27-4895-89ff-f51a337b148a req-310fcb3a-000e-4db1-99d5-db90533db76d service nova] Creating event network-vif-plugged:26865343-33e7-4622-bd06-ed6191938067 for instance 23349ce8-2588-42c9-8de7-90865b56c980 on n-h2-862967-2 Oct 29 03:16:24.915885 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-4b97f4c5-cc27-4895-89ff-f51a337b148a req-310fcb3a-000e-4db1-99d5-db90533db76d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120441 Oct 29 03:16:24.921089 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2554/4906] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:16:41.023621 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-61eb9ec6-a2cd-4702-bb17-cad0249d0c10 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:41.024210 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-61eb9ec6-a2cd-4702-bb17-cad0249d0c10 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 9e7f97fd-a366-4b20-a65c-9b2395b20ec2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:41.057193 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:41.067330 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:41.070432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61eb9ec6-a2cd-4702-bb17-cad0249d0c10 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:41.072490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61eb9ec6-a2cd-4702-bb17-cad0249d0c10 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:41.081795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61eb9ec6-a2cd-4702-bb17-cad0249d0c10 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:41.087540 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61eb9ec6-a2cd-4702-bb17-cad0249d0c10 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:41.088817 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61eb9ec6-a2cd-4702-bb17-cad0249d0c10 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:41.091934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61eb9ec6-a2cd-4702-bb17-cad0249d0c10 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:41.195663 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-61eb9ec6-a2cd-4702-bb17-cad0249d0c10 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2/ips" status: 200 len: 149 microversion: 2.1 time: 0.176753 Oct 29 03:16:41.198554 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2353/4907] 10.222.0.46 () {58 vars in 1248 bytes} [Sat Oct 29 03:16:41 2022] GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2/ips => generated 149 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:16:41.211892 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-857851e1-3abb-4eae-8e8f-804ee5e09a4d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77732b38-f0a5-4a93-af23-9f5c72546adb"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:16:41.215036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-857851e1-3abb-4eae-8e8f-804ee5e09a4d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 9e7f97fd-a366-4b20-a65c-9b2395b20ec2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:41.259080 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:41.261040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=14 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:41.265902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-857851e1-3abb-4eae-8e8f-804ee5e09a4d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:41.288304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-857851e1-3abb-4eae-8e8f-804ee5e09a4d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:41.291780 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-857851e1-3abb-4eae-8e8f-804ee5e09a4d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:41.295733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-857851e1-3abb-4eae-8e8f-804ee5e09a4d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:41.304990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-857851e1-3abb-4eae-8e8f-804ee5e09a4d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:41.305579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-857851e1-3abb-4eae-8e8f-804ee5e09a4d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:41.607992 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-857851e1-3abb-4eae-8e8f-804ee5e09a4d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] HTTP exception thrown: Invalid volume: volume 77732b38-f0a5-4a93-af23-9f5c72546adb is already attached to instances: f2493755-2599-4a13-a4bd-d5104e0d22b7 Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-857851e1-3abb-4eae-8e8f-804ee5e09a4d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Request method failure captured: Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2/os-volume_attachments HTTP/1.1 Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 74 Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJp-lWXa7bAqr_3cIx72XHiAsdLYD16twUkV-_OiY8rnLVDQQaYoa5MTy-Rf6PU7b1BJZp9_V3gh0A9BPD-pAHEbb2w6qwO87hDTiy2iuRRJAVfin8hEyxtECKBEa_6rf3V6E0wsMuLS1DRhhUPui0KdkBEsp0tJIYHf71qqCJib-MM Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 4c05b5161bd341acb4fc97fa616b3713 Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4c05b5161bd341acb4fc97fa616b3713"}]}] Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 4c05b5161bd341acb4fc97fa616b3713 Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-AttachVolumeNegativeTest-648637356-project Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: e9086760822f48ee921bcdb7bd5ae299 Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-AttachVolumeNegativeTest-648637356-project Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: {"volumeAttachment": {"volumeId": "77732b38-f0a5-4a93-af23-9f5c72546adb"}} Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: exception: Invalid volume: volume 77732b38-f0a5-4a93-af23-9f5c72546adb is already attached to instances: f2493755-2599-4a13-a4bd-d5104e0d22b7 Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'server_id': '9e7f97fd-a366-4b20-a65c-9b2395b20ec2', 'body': {'volumeAttachment': {'volumeId': '77732b38-f0a5-4a93-af23-9f5c72546adb'}}} Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 77732b38-f0a5-4a93-af23-9f5c72546adb is already attached to instances: f2493755-2599-4a13-a4bd-d5104e0d22b7 Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:16:41.613946 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:16:41.622835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:16:41.622835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:16:41.622835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 29 03:16:41.622835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 29 03:16:41.622835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 77732b38-f0a5-4a93-af23-9f5c72546adb is already attached to instances: f2493755-2599-4a13-a4bd-d5104e0d22b7 Oct 29 03:16:41.622835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:16:41.622835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:16:41.622835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:16:41.622835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:16:41.622835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:16:41.622835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:16:41.622835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:16:41.622835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:16:41.622835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 77732b38-f0a5-4a93-af23-9f5c72546adb is already attached to instances: f2493755-2599-4a13-a4bd-d5104e0d22b7 Oct 29 03:16:41.622835 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:16:41.622835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-857851e1-3abb-4eae-8e8f-804ee5e09a4d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Returning 400 to user: Invalid volume: volume 77732b38-f0a5-4a93-af23-9f5c72546adb is already attached to instances: f2493755-2599-4a13-a4bd-d5104e0d22b7 {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:16:41.622835 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-857851e1-3abb-4eae-8e8f-804ee5e09a4d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "POST /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.410693 Oct 29 03:16:41.627611 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fce5ea17-7b37-4db6-8bea-b018a19abd45 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:41.627611 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fce5ea17-7b37-4db6-8bea-b018a19abd45 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 9e7f97fd-a366-4b20-a65c-9b2395b20ec2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:41.628671 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2555/4908] 10.222.0.46 () {60 vars in 1323 bytes} [Sat Oct 29 03:16:41 2022] POST /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2/os-volume_attachments => generated 174 bytes in 421 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:16:41.639826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fce5ea17-7b37-4db6-8bea-b018a19abd45 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:41.640362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fce5ea17-7b37-4db6-8bea-b018a19abd45 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:41.640935 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fce5ea17-7b37-4db6-8bea-b018a19abd45 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:41.641689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fce5ea17-7b37-4db6-8bea-b018a19abd45 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:41.643477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fce5ea17-7b37-4db6-8bea-b018a19abd45 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:41.643963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fce5ea17-7b37-4db6-8bea-b018a19abd45 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:41.711339 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fce5ea17-7b37-4db6-8bea-b018a19abd45 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 9e7f97fd-a366-4b20-a65c-9b2395b20ec2] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:16:41.937520 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fce5ea17-7b37-4db6-8bea-b018a19abd45 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2" status: 204 len: 0 microversion: 2.1 time: 0.314521 Oct 29 03:16:41.943083 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2354/4909] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:16:41 2022] DELETE /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:16:41.949657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-45c89ad5-cfb7-4529-a8a9-b35e1b51c057 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:41.950604 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-45c89ad5-cfb7-4529-a8a9-b35e1b51c057 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 9e7f97fd-a366-4b20-a65c-9b2395b20ec2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:41.982595 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45c89ad5-cfb7-4529-a8a9-b35e1b51c057 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:41.987342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45c89ad5-cfb7-4529-a8a9-b35e1b51c057 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:41.988145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45c89ad5-cfb7-4529-a8a9-b35e1b51c057 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:41.989235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45c89ad5-cfb7-4529-a8a9-b35e1b51c057 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:41.990013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45c89ad5-cfb7-4529-a8a9-b35e1b51c057 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:41.990659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45c89ad5-cfb7-4529-a8a9-b35e1b51c057 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:42.563611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-45c89ad5-cfb7-4529-a8a9-b35e1b51c057 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:42.591615 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-45c89ad5-cfb7-4529-a8a9-b35e1b51c057 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2" status: 200 len: 1679 microversion: 2.1 time: 0.645791 Oct 29 03:16:42.596175 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2556/4910] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:41 2022] GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2 => generated 1679 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:43.623358 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0e7969e0-e4f2-41e0-bdb5-5eb64f67e0d3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:43.624860 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0e7969e0-e4f2-41e0-bdb5-5eb64f67e0d3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 9e7f97fd-a366-4b20-a65c-9b2395b20ec2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:43.638809 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0e7969e0-e4f2-41e0-bdb5-5eb64f67e0d3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:43.644188 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0e7969e0-e4f2-41e0-bdb5-5eb64f67e0d3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:43.647075 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0e7969e0-e4f2-41e0-bdb5-5eb64f67e0d3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:43.648044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0e7969e0-e4f2-41e0-bdb5-5eb64f67e0d3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:43.648708 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0e7969e0-e4f2-41e0-bdb5-5eb64f67e0d3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:43.650448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0e7969e0-e4f2-41e0-bdb5-5eb64f67e0d3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:44.574642 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0e7969e0-e4f2-41e0-bdb5-5eb64f67e0d3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:44.590668 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0e7969e0-e4f2-41e0-bdb5-5eb64f67e0d3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2" status: 200 len: 1679 microversion: 2.1 time: 0.970710 Oct 29 03:16:44.591881 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2355/4911] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:43 2022] GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2 => generated 1679 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:45.615346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-80c03418-c272-4292-ba6b-096af2183f11 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:45.615979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-80c03418-c272-4292-ba6b-096af2183f11 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 9e7f97fd-a366-4b20-a65c-9b2395b20ec2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:45.643935 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80c03418-c272-4292-ba6b-096af2183f11 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:45.644444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80c03418-c272-4292-ba6b-096af2183f11 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:45.648071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80c03418-c272-4292-ba6b-096af2183f11 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:45.651188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80c03418-c272-4292-ba6b-096af2183f11 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:45.654439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80c03418-c272-4292-ba6b-096af2183f11 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:45.657413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80c03418-c272-4292-ba6b-096af2183f11 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:46.093519 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-80c03418-c272-4292-ba6b-096af2183f11 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:46.104777 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-80c03418-c272-4292-ba6b-096af2183f11 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2" status: 200 len: 1612 microversion: 2.1 time: 0.493258 Oct 29 03:16:46.120473 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2557/4912] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:45 2022] GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2 => generated 1612 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:47.128343 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bbf6ebbb-4def-4501-bdff-9aa79d0ceff3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:47.130343 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bbf6ebbb-4def-4501-bdff-9aa79d0ceff3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 9e7f97fd-a366-4b20-a65c-9b2395b20ec2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:47.157860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbf6ebbb-4def-4501-bdff-9aa79d0ceff3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:47.161321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbf6ebbb-4def-4501-bdff-9aa79d0ceff3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:47.166508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbf6ebbb-4def-4501-bdff-9aa79d0ceff3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:47.169836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbf6ebbb-4def-4501-bdff-9aa79d0ceff3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:47.174277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbf6ebbb-4def-4501-bdff-9aa79d0ceff3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:47.175017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbf6ebbb-4def-4501-bdff-9aa79d0ceff3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:47.367654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbf6ebbb-4def-4501-bdff-9aa79d0ceff3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:47.371235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbf6ebbb-4def-4501-bdff-9aa79d0ceff3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:47.371902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbf6ebbb-4def-4501-bdff-9aa79d0ceff3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:47.374196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-bbf6ebbb-4def-4501-bdff-9aa79d0ceff3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lazy-loading 'fault' on Instance uuid 9e7f97fd-a366-4b20-a65c-9b2395b20ec2 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:16:47.510486 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-c82d1c71-4a6a-4691-a2ba-9a6a28f443ab req-07a872f1-157b-408c-9f8b-17ed05d60f20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e7f97fd-a366-4b20-a65c-9b2395b20ec2", "name": "network-vif-deleted", "tag": "b1f413bd-9ddf-415c-ab2d-619b60a5296d"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:16:47.565444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bbf6ebbb-4def-4501-bdff-9aa79d0ceff3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:47.602727 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c82d1c71-4a6a-4691-a2ba-9a6a28f443ab req-07a872f1-157b-408c-9f8b-17ed05d60f20 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:47.602727 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c82d1c71-4a6a-4691-a2ba-9a6a28f443ab req-07a872f1-157b-408c-9f8b-17ed05d60f20 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:47.602727 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c82d1c71-4a6a-4691-a2ba-9a6a28f443ab req-07a872f1-157b-408c-9f8b-17ed05d60f20 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:47.622432 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bbf6ebbb-4def-4501-bdff-9aa79d0ceff3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2" status: 200 len: 1330 microversion: 2.1 time: 0.488512 Oct 29 03:16:47.627011 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2558/4913] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:47 2022] GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2 => generated 1330 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:16:47.681612 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-c82d1c71-4a6a-4691-a2ba-9a6a28f443ab req-07a872f1-157b-408c-9f8b-17ed05d60f20 service nova] Creating event network-vif-deleted:b1f413bd-9ddf-415c-ab2d-619b60a5296d for instance 9e7f97fd-a366-4b20-a65c-9b2395b20ec2 on n-h2-862967-2 Oct 29 03:16:47.697591 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-c82d1c71-4a6a-4691-a2ba-9a6a28f443ab req-07a872f1-157b-408c-9f8b-17ed05d60f20 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.937841 Oct 29 03:16:47.700192 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2356/4914] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:16:48.664064 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3184b935-a849-478f-97cc-59d7827a0bc4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:48.665645 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3184b935-a849-478f-97cc-59d7827a0bc4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 9e7f97fd-a366-4b20-a65c-9b2395b20ec2] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:48.678232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3184b935-a849-478f-97cc-59d7827a0bc4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:48.682863 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3184b935-a849-478f-97cc-59d7827a0bc4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:48.683699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3184b935-a849-478f-97cc-59d7827a0bc4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:48.684633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3184b935-a849-478f-97cc-59d7827a0bc4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:48.686473 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3184b935-a849-478f-97cc-59d7827a0bc4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:48.687184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3184b935-a849-478f-97cc-59d7827a0bc4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:48.734853 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-3184b935-a849-478f-97cc-59d7827a0bc4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] HTTP exception thrown: Instance 9e7f97fd-a366-4b20-a65c-9b2395b20ec2 could not be found. Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3184b935-a849-478f-97cc-59d7827a0bc4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Request method failure captured: Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2 HTTP/1.1 Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJp-lWXa7bAqr_3cIx72XHiAsdLYD16twUkV-_OiY8rnLVDQQaYoa5MTy-Rf6PU7b1BJZp9_V3gh0A9BPD-pAHEbb2w6qwO87hDTiy2iuRRJAVfin8hEyxtECKBEa_6rf3V6E0wsMuLS1DRhhUPui0KdkBEsp0tJIYHf71qqCJib-MM Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 4c05b5161bd341acb4fc97fa616b3713 Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4c05b5161bd341acb4fc97fa616b3713"}]}] Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 4c05b5161bd341acb4fc97fa616b3713 Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-AttachVolumeNegativeTest-648637356-project Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: e9086760822f48ee921bcdb7bd5ae299 Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-AttachVolumeNegativeTest-648637356-project Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 9e7f97fd-a366-4b20-a65c-9b2395b20ec2 could not be found. Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '9e7f97fd-a366-4b20-a65c-9b2395b20ec2'} Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e7f97fd-a366-4b20-a65c-9b2395b20ec2 could not be found. Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e7f97fd-a366-4b20-a65c-9b2395b20ec2 could not be found. Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:16:48.741557 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:16:48.748024 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:16:48.748024 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:16:48.748024 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:16:48.748024 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:16:48.748024 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:16:48.748024 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e7f97fd-a366-4b20-a65c-9b2395b20ec2 could not be found. Oct 29 03:16:48.748024 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:16:48.751367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3184b935-a849-478f-97cc-59d7827a0bc4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Returning 404 to user: Instance 9e7f97fd-a366-4b20-a65c-9b2395b20ec2 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:16:48.753615 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3184b935-a849-478f-97cc-59d7827a0bc4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2" status: 404 len: 111 microversion: 2.1 time: 0.095437 Oct 29 03:16:48.757382 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2559/4915] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:48 2022] GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:16:48.765514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7c0359bd-0403-46ef-85ea-22611f93ba5d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '.version_select at 0x7ff052e5a9d0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:48.863322 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7c0359bd-0403-46ef-85ea-22611f93ba5d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-981456936" status: 202 len: 0 microversion: 2.1 time: 0.082207 Oct 29 03:16:48.868497 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2357/4916] 10.222.0.46 () {58 vars in 1218 bytes} [Sat Oct 29 03:16:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-981456936 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:16:53.551390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-03a8f37e-cff2-4205-8a85-ef6733735b94 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:53.552018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-03a8f37e-cff2-4205-8a85-ef6733735b94 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:53.571864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03a8f37e-cff2-4205-8a85-ef6733735b94 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:53.572677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03a8f37e-cff2-4205-8a85-ef6733735b94 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:53.573436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03a8f37e-cff2-4205-8a85-ef6733735b94 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:53.574813 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03a8f37e-cff2-4205-8a85-ef6733735b94 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:53.575431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03a8f37e-cff2-4205-8a85-ef6733735b94 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:53.576044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03a8f37e-cff2-4205-8a85-ef6733735b94 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:53.825806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-03a8f37e-cff2-4205-8a85-ef6733735b94 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lazy-loading 'services' on Instance uuid f2493755-2599-4a13-a4bd-d5104e0d22b7 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:16:54.020050 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-03a8f37e-cff2-4205-8a85-ef6733735b94 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7/os-volume_attachments/77732b38-f0a5-4a93-af23-9f5c72546adb" status: 202 len: 0 microversion: 2.1 time: 0.474825 Oct 29 03:16:54.026740 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2560/4917] 10.222.0.46 () {58 vars in 1416 bytes} [Sat Oct 29 03:16:53 2022] DELETE /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7/os-volume_attachments/77732b38-f0a5-4a93-af23-9f5c72546adb => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:16:54.054751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1d6b80c5-7705-4313-9a3e-d58b387d4897 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:54.057878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1d6b80c5-7705-4313-9a3e-d58b387d4897 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:54.095013 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d6b80c5-7705-4313-9a3e-d58b387d4897 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:54.098567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d6b80c5-7705-4313-9a3e-d58b387d4897 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:54.099119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d6b80c5-7705-4313-9a3e-d58b387d4897 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:54.099948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d6b80c5-7705-4313-9a3e-d58b387d4897 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:54.106080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d6b80c5-7705-4313-9a3e-d58b387d4897 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:54.106620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d6b80c5-7705-4313-9a3e-d58b387d4897 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:54.226992 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1d6b80c5-7705-4313-9a3e-d58b387d4897 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.198349 Oct 29 03:16:54.228207 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2358/4918] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:16:54 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:16:55.241888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ff794f6c-f6f6-48a1-8e8c-a8c1669c8fa3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:55.248141 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ff794f6c-f6f6-48a1-8e8c-a8c1669c8fa3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:55.276968 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff794f6c-f6f6-48a1-8e8c-a8c1669c8fa3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:55.286808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff794f6c-f6f6-48a1-8e8c-a8c1669c8fa3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:55.292196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff794f6c-f6f6-48a1-8e8c-a8c1669c8fa3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:55.299387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff794f6c-f6f6-48a1-8e8c-a8c1669c8fa3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:55.302349 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff794f6c-f6f6-48a1-8e8c-a8c1669c8fa3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:55.304164 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff794f6c-f6f6-48a1-8e8c-a8c1669c8fa3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:55.445950 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ff794f6c-f6f6-48a1-8e8c-a8c1669c8fa3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.210060 Oct 29 03:16:55.457928 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2561/4919] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:16:55 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7/os-volume_attachments => generated 197 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:16:56.338961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-989fb677-a30a-4a5d-b2d6-f86dbda971a6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:56.340808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-989fb677-a30a-4a5d-b2d6-f86dbda971a6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:56.353531 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-989fb677-a30a-4a5d-b2d6-f86dbda971a6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:56.354754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-989fb677-a30a-4a5d-b2d6-f86dbda971a6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:56.356572 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-989fb677-a30a-4a5d-b2d6-f86dbda971a6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:56.357501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-989fb677-a30a-4a5d-b2d6-f86dbda971a6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:56.358937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-989fb677-a30a-4a5d-b2d6-f86dbda971a6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:56.361178 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-989fb677-a30a-4a5d-b2d6-f86dbda971a6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:56.470158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9ed0615a-0f1e-4b47-b7a2-0ac358edef73 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:56.473801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9ed0615a-0f1e-4b47-b7a2-0ac358edef73 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:56.484356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ed0615a-0f1e-4b47-b7a2-0ac358edef73 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:56.485562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ed0615a-0f1e-4b47-b7a2-0ac358edef73 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:56.486172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ed0615a-0f1e-4b47-b7a2-0ac358edef73 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:56.487273 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ed0615a-0f1e-4b47-b7a2-0ac358edef73 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:56.487952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ed0615a-0f1e-4b47-b7a2-0ac358edef73 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:56.488978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ed0615a-0f1e-4b47-b7a2-0ac358edef73 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:56.581112 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9ed0615a-0f1e-4b47-b7a2-0ac358edef73 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119069 Oct 29 03:16:56.593276 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2562/4920] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:16:56 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:16:57.101526 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-989fb677-a30a-4a5d-b2d6-f86dbda971a6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:57.121326 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-989fb677-a30a-4a5d-b2d6-f86dbda971a6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1683 microversion: 2.1 time: 0.787380 Oct 29 03:16:57.121933 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2359/4921] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:56 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1683 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:57.593817 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d181e771-fb2c-4dcb-898c-d105a56a1162 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:57.596394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d181e771-fb2c-4dcb-898c-d105a56a1162 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:57.618704 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d181e771-fb2c-4dcb-898c-d105a56a1162 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:57.619195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d181e771-fb2c-4dcb-898c-d105a56a1162 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:57.619634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d181e771-fb2c-4dcb-898c-d105a56a1162 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:57.620341 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d181e771-fb2c-4dcb-898c-d105a56a1162 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:57.620824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d181e771-fb2c-4dcb-898c-d105a56a1162 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:57.621246 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d181e771-fb2c-4dcb-898c-d105a56a1162 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:57.730468 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d181e771-fb2c-4dcb-898c-d105a56a1162 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140683 Oct 29 03:16:57.731467 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2563/4922] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:16:57 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:16:58.146157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6f31716d-a67f-4e5a-b13c-fe64d4865e3a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:58.146880 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6f31716d-a67f-4e5a-b13c-fe64d4865e3a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:58.158039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f31716d-a67f-4e5a-b13c-fe64d4865e3a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:58.160096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f31716d-a67f-4e5a-b13c-fe64d4865e3a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:58.160847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f31716d-a67f-4e5a-b13c-fe64d4865e3a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:58.165913 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f31716d-a67f-4e5a-b13c-fe64d4865e3a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:58.166676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f31716d-a67f-4e5a-b13c-fe64d4865e3a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:58.167244 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f31716d-a67f-4e5a-b13c-fe64d4865e3a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:58.447843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6f31716d-a67f-4e5a-b13c-fe64d4865e3a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:16:58.460562 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6f31716d-a67f-4e5a-b13c-fe64d4865e3a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.318463 Oct 29 03:16:58.469181 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2360/4923] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:16:58 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:16:58.496842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-907e088a-a2b1-4638-8cb0-ceed30d7f185 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-310386127"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:16:58.501357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-907e088a-a2b1-4638-8cb0-ceed30d7f185 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:58.511633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-907e088a-a2b1-4638-8cb0-ceed30d7f185 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:58.514826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-907e088a-a2b1-4638-8cb0-ceed30d7f185 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:58.516216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-907e088a-a2b1-4638-8cb0-ceed30d7f185 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:58.516884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-907e088a-a2b1-4638-8cb0-ceed30d7f185 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:58.517688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-907e088a-a2b1-4638-8cb0-ceed30d7f185 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:58.518563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-907e088a-a2b1-4638-8cb0-ceed30d7f185 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:58.750309 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9ce36e8f-1736-4f8a-bad8-b41c0369c1ac tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:58.759763 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9ce36e8f-1736-4f8a-bad8-b41c0369c1ac tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:58.779618 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ce36e8f-1736-4f8a-bad8-b41c0369c1ac tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:58.783159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ce36e8f-1736-4f8a-bad8-b41c0369c1ac tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:58.783830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ce36e8f-1736-4f8a-bad8-b41c0369c1ac tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:58.794986 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ce36e8f-1736-4f8a-bad8-b41c0369c1ac tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:58.795680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ce36e8f-1736-4f8a-bad8-b41c0369c1ac tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:58.798120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ce36e8f-1736-4f8a-bad8-b41c0369c1ac tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:58.919831 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9ce36e8f-1736-4f8a-bad8-b41c0369c1ac tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.173079 Oct 29 03:16:58.927410 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-907e088a-a2b1-4638-8cb0-ceed30d7f185 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action" status: 202 len: 0 microversion: 2.1 time: 0.440787 Oct 29 03:16:58.928262 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2564/4924] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:16:58 2022] POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 29 03:16:58.952255 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2361/4925] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:16:58 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7/os-volume_attachments => generated 197 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:16:59.964012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-22033728-0900-448f-a449-e4c0d3239888 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:16:59.967246 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-22033728-0900-448f-a449-e4c0d3239888 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:16:59.975872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22033728-0900-448f-a449-e4c0d3239888 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:59.976947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22033728-0900-448f-a449-e4c0d3239888 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:59.977849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22033728-0900-448f-a449-e4c0d3239888 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:16:59.979457 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22033728-0900-448f-a449-e4c0d3239888 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:16:59.980913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22033728-0900-448f-a449-e4c0d3239888 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:16:59.982141 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22033728-0900-448f-a449-e4c0d3239888 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:00.071108 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-22033728-0900-448f-a449-e4c0d3239888 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112300 Oct 29 03:17:00.078363 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2565/4926] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:16:59 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:17:00.626347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-94c14d59-3eef-4a46-92e8-31a86896ce82 req-1c705b62-6146-4ade-b71b-8905ba643483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23349ce8-2588-42c9-8de7-90865b56c980", "name": "network-vif-unplugged", "status": "completed", "tag": "26865343-33e7-4622-bd06-ed6191938067"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:17:00.677182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-94c14d59-3eef-4a46-92e8-31a86896ce82 req-1c705b62-6146-4ade-b71b-8905ba643483 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:00.677721 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-94c14d59-3eef-4a46-92e8-31a86896ce82 req-1c705b62-6146-4ade-b71b-8905ba643483 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:00.678170 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-94c14d59-3eef-4a46-92e8-31a86896ce82 req-1c705b62-6146-4ade-b71b-8905ba643483 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:00.700551 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-94c14d59-3eef-4a46-92e8-31a86896ce82 req-1c705b62-6146-4ade-b71b-8905ba643483 service nova] Creating event network-vif-unplugged:26865343-33e7-4622-bd06-ed6191938067 for instance 23349ce8-2588-42c9-8de7-90865b56c980 on n-h2-862967-2 Oct 29 03:17:00.708179 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-94c14d59-3eef-4a46-92e8-31a86896ce82 req-1c705b62-6146-4ade-b71b-8905ba643483 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085890 Oct 29 03:17:00.709254 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2362/4927] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:17:01.084106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a262c96b-5585-452d-bc56-5800e92cc168 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:01.086905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a262c96b-5585-452d-bc56-5800e92cc168 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:01.103643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a262c96b-5585-452d-bc56-5800e92cc168 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:01.104307 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a262c96b-5585-452d-bc56-5800e92cc168 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:01.104929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a262c96b-5585-452d-bc56-5800e92cc168 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:01.105908 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a262c96b-5585-452d-bc56-5800e92cc168 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:01.106554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a262c96b-5585-452d-bc56-5800e92cc168 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:01.107132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a262c96b-5585-452d-bc56-5800e92cc168 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:01.196853 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a262c96b-5585-452d-bc56-5800e92cc168 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102455 Oct 29 03:17:01.199311 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2566/4928] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:17:01 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:17:02.217282 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c780f16e-96d9-43fd-81b0-9a8656cd46fb tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:02.220029 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c780f16e-96d9-43fd-81b0-9a8656cd46fb tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:02.241040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c780f16e-96d9-43fd-81b0-9a8656cd46fb tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:02.243544 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c780f16e-96d9-43fd-81b0-9a8656cd46fb tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:02.244359 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c780f16e-96d9-43fd-81b0-9a8656cd46fb tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:02.247485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c780f16e-96d9-43fd-81b0-9a8656cd46fb tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:02.250984 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c780f16e-96d9-43fd-81b0-9a8656cd46fb tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:02.251739 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c780f16e-96d9-43fd-81b0-9a8656cd46fb tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:02.353050 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c780f16e-96d9-43fd-81b0-9a8656cd46fb tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144848 Oct 29 03:17:02.355082 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2363/4929] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:17:02 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:17:03.366170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-33bf8e49-32ce-4046-9361-6efa6bcc9f5a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:03.369571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-33bf8e49-32ce-4046-9361-6efa6bcc9f5a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:03.382933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33bf8e49-32ce-4046-9361-6efa6bcc9f5a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:03.385427 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33bf8e49-32ce-4046-9361-6efa6bcc9f5a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:03.387659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33bf8e49-32ce-4046-9361-6efa6bcc9f5a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:03.390289 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33bf8e49-32ce-4046-9361-6efa6bcc9f5a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:03.392798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33bf8e49-32ce-4046-9361-6efa6bcc9f5a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:03.393941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33bf8e49-32ce-4046-9361-6efa6bcc9f5a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:03.477157 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-33bf8e49-32ce-4046-9361-6efa6bcc9f5a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114464 Oct 29 03:17:03.479973 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2567/4930] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:17:03 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:17:04.544046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-23f141bf-30ac-41a4-aac6-2da54b39a0a0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:04.548190 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-23f141bf-30ac-41a4-aac6-2da54b39a0a0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:04.583231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23f141bf-30ac-41a4-aac6-2da54b39a0a0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:04.591932 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23f141bf-30ac-41a4-aac6-2da54b39a0a0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:04.593647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23f141bf-30ac-41a4-aac6-2da54b39a0a0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:04.601311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23f141bf-30ac-41a4-aac6-2da54b39a0a0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:04.605307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23f141bf-30ac-41a4-aac6-2da54b39a0a0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:04.613555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23f141bf-30ac-41a4-aac6-2da54b39a0a0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:04.777763 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-23f141bf-30ac-41a4-aac6-2da54b39a0a0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.288720 Oct 29 03:17:04.780272 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2364/4931] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:17:04 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7/os-volume_attachments => generated 197 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:17:05.180231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-c3b12623-e811-4211-bdc6-5a66eddfd9ea req-124c5576-a404-4999-a876-ac2a68772fda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23349ce8-2588-42c9-8de7-90865b56c980", "name": "network-vif-plugged", "status": "completed", "tag": "26865343-33e7-4622-bd06-ed6191938067"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:17:05.223352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c3b12623-e811-4211-bdc6-5a66eddfd9ea req-124c5576-a404-4999-a876-ac2a68772fda service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:05.226436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c3b12623-e811-4211-bdc6-5a66eddfd9ea req-124c5576-a404-4999-a876-ac2a68772fda service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:05.227030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c3b12623-e811-4211-bdc6-5a66eddfd9ea req-124c5576-a404-4999-a876-ac2a68772fda service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:05.281045 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-c3b12623-e811-4211-bdc6-5a66eddfd9ea req-124c5576-a404-4999-a876-ac2a68772fda service nova] Creating event network-vif-plugged:26865343-33e7-4622-bd06-ed6191938067 for instance 23349ce8-2588-42c9-8de7-90865b56c980 on n-h2-862967-2 Oct 29 03:17:05.301424 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-c3b12623-e811-4211-bdc6-5a66eddfd9ea req-124c5576-a404-4999-a876-ac2a68772fda service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126336 Oct 29 03:17:05.304988 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2568/4932] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:17:05.793134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e7558621-071c-4ecd-b79d-462369d82e79 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:05.795798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e7558621-071c-4ecd-b79d-462369d82e79 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:05.825984 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7558621-071c-4ecd-b79d-462369d82e79 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:05.827107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7558621-071c-4ecd-b79d-462369d82e79 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:05.828226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7558621-071c-4ecd-b79d-462369d82e79 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:05.830787 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7558621-071c-4ecd-b79d-462369d82e79 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:05.835582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7558621-071c-4ecd-b79d-462369d82e79 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:05.838783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7558621-071c-4ecd-b79d-462369d82e79 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:05.953634 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e7558621-071c-4ecd-b79d-462369d82e79 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.165561 Oct 29 03:17:05.956617 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2365/4933] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:17:05 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7/os-volume_attachments => generated 25 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:17:06.087209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e0dbfa87-d5cc-4acc-a14d-4f38b1e571a3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:06.087798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e0dbfa87-d5cc-4acc-a14d-4f38b1e571a3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:06.117828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e0dbfa87-d5cc-4acc-a14d-4f38b1e571a3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:06.118455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e0dbfa87-d5cc-4acc-a14d-4f38b1e571a3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:06.119183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e0dbfa87-d5cc-4acc-a14d-4f38b1e571a3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:06.122399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e0dbfa87-d5cc-4acc-a14d-4f38b1e571a3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:06.127333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e0dbfa87-d5cc-4acc-a14d-4f38b1e571a3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:06.127797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e0dbfa87-d5cc-4acc-a14d-4f38b1e571a3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:06.221947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e0dbfa87-d5cc-4acc-a14d-4f38b1e571a3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:17:06.346724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:06.480772 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e0dbfa87-d5cc-4acc-a14d-4f38b1e571a3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7" status: 204 len: 0 microversion: 2.1 time: 0.398201 Oct 29 03:17:06.485386 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2569/4934] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:17:06 2022] DELETE /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:17:06.492739 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cfbba2e9-a6e1-41a3-b3e8-144e1a0aa77b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:06.493361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cfbba2e9-a6e1-41a3-b3e8-144e1a0aa77b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:06.507001 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cfbba2e9-a6e1-41a3-b3e8-144e1a0aa77b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:06.508752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cfbba2e9-a6e1-41a3-b3e8-144e1a0aa77b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:06.509205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cfbba2e9-a6e1-41a3-b3e8-144e1a0aa77b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:06.509930 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cfbba2e9-a6e1-41a3-b3e8-144e1a0aa77b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:06.510385 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cfbba2e9-a6e1-41a3-b3e8-144e1a0aa77b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:06.514026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cfbba2e9-a6e1-41a3-b3e8-144e1a0aa77b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:07.354591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cfbba2e9-a6e1-41a3-b3e8-144e1a0aa77b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:07.374420 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cfbba2e9-a6e1-41a3-b3e8-144e1a0aa77b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7" status: 200 len: 1682 microversion: 2.1 time: 0.881983 Oct 29 03:17:07.397896 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2366/4935] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:06 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7 => generated 1682 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:08.405716 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7deafd0f-1e6c-4a40-a8ac-f06fcfc2dcf7 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:08.406482 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7deafd0f-1e6c-4a40-a8ac-f06fcfc2dcf7 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:08.428460 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7deafd0f-1e6c-4a40-a8ac-f06fcfc2dcf7 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:08.433885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7deafd0f-1e6c-4a40-a8ac-f06fcfc2dcf7 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:08.436928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7deafd0f-1e6c-4a40-a8ac-f06fcfc2dcf7 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:08.440170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7deafd0f-1e6c-4a40-a8ac-f06fcfc2dcf7 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:08.443359 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7deafd0f-1e6c-4a40-a8ac-f06fcfc2dcf7 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:08.446967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7deafd0f-1e6c-4a40-a8ac-f06fcfc2dcf7 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:09.299182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7deafd0f-1e6c-4a40-a8ac-f06fcfc2dcf7 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:09.312810 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7deafd0f-1e6c-4a40-a8ac-f06fcfc2dcf7 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7" status: 200 len: 1682 microversion: 2.1 time: 0.910532 Oct 29 03:17:09.315456 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2570/4936] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:08 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7 => generated 1682 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:10.342750 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c73c08bb-61de-42d8-963a-68c9d0c716c2 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:10.343521 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c73c08bb-61de-42d8-963a-68c9d0c716c2 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:10.356657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c73c08bb-61de-42d8-963a-68c9d0c716c2 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:10.357073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c73c08bb-61de-42d8-963a-68c9d0c716c2 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:10.357511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c73c08bb-61de-42d8-963a-68c9d0c716c2 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:10.358220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c73c08bb-61de-42d8-963a-68c9d0c716c2 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:10.379993 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c73c08bb-61de-42d8-963a-68c9d0c716c2 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:10.380452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c73c08bb-61de-42d8-963a-68c9d0c716c2 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:10.443625 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-3de2ca87-5517-45f8-9326-d53256225f8d req-3c96d7be-1e7d-4f7f-82af-f5959fd9df9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2493755-2599-4a13-a4bd-d5104e0d22b7", "name": "network-vif-deleted", "tag": "b0bf68ca-62d2-43a2-9aff-8be72aa3cd0f"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:17:10.473742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3de2ca87-5517-45f8-9326-d53256225f8d req-3c96d7be-1e7d-4f7f-82af-f5959fd9df9e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:10.474317 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3de2ca87-5517-45f8-9326-d53256225f8d req-3c96d7be-1e7d-4f7f-82af-f5959fd9df9e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:10.474746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3de2ca87-5517-45f8-9326-d53256225f8d req-3c96d7be-1e7d-4f7f-82af-f5959fd9df9e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:10.505679 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-3de2ca87-5517-45f8-9326-d53256225f8d req-3c96d7be-1e7d-4f7f-82af-f5959fd9df9e service nova] Creating event network-vif-deleted:b0bf68ca-62d2-43a2-9aff-8be72aa3cd0f for instance f2493755-2599-4a13-a4bd-d5104e0d22b7 on n-h1-862967-2 Oct 29 03:17:10.519955 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-3de2ca87-5517-45f8-9326-d53256225f8d req-3c96d7be-1e7d-4f7f-82af-f5959fd9df9e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079722 Oct 29 03:17:10.521253 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2571/4937] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:17:10.726769 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c73c08bb-61de-42d8-963a-68c9d0c716c2 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:10.737877 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c73c08bb-61de-42d8-963a-68c9d0c716c2 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7" status: 200 len: 1615 microversion: 2.1 time: 0.400131 Oct 29 03:17:10.765083 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2367/4938] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:10 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7 => generated 1615 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:11.765526 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-77184bb7-0bef-429c-a617-ae8cb9c0800d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:11.766230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-77184bb7-0bef-429c-a617-ae8cb9c0800d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:11.778316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:11.782859 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-77184bb7-0bef-429c-a617-ae8cb9c0800d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:11.784300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-77184bb7-0bef-429c-a617-ae8cb9c0800d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:11.792932 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-77184bb7-0bef-429c-a617-ae8cb9c0800d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:11.793945 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-77184bb7-0bef-429c-a617-ae8cb9c0800d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:11.794685 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-77184bb7-0bef-429c-a617-ae8cb9c0800d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:11.795275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-77184bb7-0bef-429c-a617-ae8cb9c0800d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:11.826034 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-77184bb7-0bef-429c-a617-ae8cb9c0800d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] HTTP exception thrown: Instance f2493755-2599-4a13-a4bd-d5104e0d22b7 could not be found. Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-77184bb7-0bef-429c-a617-ae8cb9c0800d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Request method failure captured: Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7 HTTP/1.1 Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJp-lWXa7bAqr_3cIx72XHiAsdLYD16twUkV-_OiY8rnLVDQQaYoa5MTy-Rf6PU7b1BJZp9_V3gh0A9BPD-pAHEbb2w6qwO87hDTiy2iuRRJAVfin8hEyxtECKBEa_6rf3V6E0wsMuLS1DRhhUPui0KdkBEsp0tJIYHf71qqCJib-MM Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 4c05b5161bd341acb4fc97fa616b3713 Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4c05b5161bd341acb4fc97fa616b3713"}]}] Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 4c05b5161bd341acb4fc97fa616b3713 Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-AttachVolumeNegativeTest-648637356-project Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: e9086760822f48ee921bcdb7bd5ae299 Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-AttachVolumeNegativeTest-648637356-project Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance f2493755-2599-4a13-a4bd-d5104e0d22b7 could not be found. Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'f2493755-2599-4a13-a4bd-d5104e0d22b7'} Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2493755-2599-4a13-a4bd-d5104e0d22b7 could not be found. Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2493755-2599-4a13-a4bd-d5104e0d22b7 could not be found. Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:17:11.834699 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:17:11.840792 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:17:11.840792 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:17:11.840792 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:17:11.840792 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:17:11.840792 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:17:11.840792 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2493755-2599-4a13-a4bd-d5104e0d22b7 could not be found. Oct 29 03:17:11.840792 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:17:11.842620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-77184bb7-0bef-429c-a617-ae8cb9c0800d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Returning 404 to user: Instance f2493755-2599-4a13-a4bd-d5104e0d22b7 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:17:11.845835 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-77184bb7-0bef-429c-a617-ae8cb9c0800d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7" status: 404 len: 111 microversion: 2.1 time: 0.083678 Oct 29 03:17:11.846921 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2572/4939] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:11 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:17:11.856955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8c36ad85-0946-48a3-853b-9ca99fe5f993 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '.version_select at 0x7ff053660280>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:11.892243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:11.952437 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8c36ad85-0946-48a3-853b-9ca99fe5f993 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1893616529" status: 202 len: 0 microversion: 2.1 time: 0.100288 Oct 29 03:17:11.958242 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2368/4940] 10.222.0.46 () {58 vars in 1221 bytes} [Sat Oct 29 03:17:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1893616529 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:17:14.273684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c320b376-ec3a-4e45-80e9-adda8a2626e1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Action: 'create', calling method: .version_select at 0x7ff058531c10>, body: {"keypair": {"name": "tempest-keypair-1844444409", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYOiCDNA2OxKXiWz/f3hZI6VZeuDijffChr0sfP/pklZtU/1LiFU+ZN4qHbNQowO6pxritzc1qW3vtB/hbMRqFK8WugGh2hvHP2eet6Nx6c3mP3cHzfMZFq1Q1spN0vcQ=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:17:14.339309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-c320b376-ec3a-4e45-80e9-adda8a2626e1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Getting quotas for project 4c05b5161bd341acb4fc97fa616b3713. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:17:14.368938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-c320b376-ec3a-4e45-80e9-adda8a2626e1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Getting quotas for user e9086760822f48ee921bcdb7bd5ae299 and project 4c05b5161bd341acb4fc97fa616b3713. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:17:14.459281 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c320b376-ec3a-4e45-80e9-adda8a2626e1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.189412 Oct 29 03:17:14.468143 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2573/4941] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:17:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:17:21.441148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2a03917b-4fba-4ceb-97c5-d9994bfec80a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1995654233", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2930b46-8565-462a-9f64-b9b374f3c23b"}], "security_groups": [{"name": "tempest-securitygroup--962310605"}], "key_name": "tempest-keypair-1844444409", "user_data": "}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:17:21.495736 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:21.856385 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-2a03917b-4fba-4ceb-97c5-d9994bfec80a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] validate_networks() for [('e2930b46-8565-462a-9f64-b9b374f3c23b', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:17:22.807742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-2a03917b-4fba-4ceb-97c5-d9994bfec80a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:17:22.808937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-2a03917b-4fba-4ceb-97c5-d9994bfec80a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:17:22.809569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-2a03917b-4fba-4ceb-97c5-d9994bfec80a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:17:22.810159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-2a03917b-4fba-4ceb-97c5-d9994bfec80a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:17:22.816391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-2a03917b-4fba-4ceb-97c5-d9994bfec80a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:17:22.851858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a03917b-4fba-4ceb-97c5-d9994bfec80a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:22.852350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a03917b-4fba-4ceb-97c5-d9994bfec80a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:22.858428 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a03917b-4fba-4ceb-97c5-d9994bfec80a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:22.863607 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a03917b-4fba-4ceb-97c5-d9994bfec80a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:22.864100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a03917b-4fba-4ceb-97c5-d9994bfec80a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:22.864558 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a03917b-4fba-4ceb-97c5-d9994bfec80a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:23.011672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-2a03917b-4fba-4ceb-97c5-d9994bfec80a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Getting quotas for project 4c05b5161bd341acb4fc97fa616b3713. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:17:23.056852 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-2a03917b-4fba-4ceb-97c5-d9994bfec80a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Getting quotas for user e9086760822f48ee921bcdb7bd5ae299 and project 4c05b5161bd341acb4fc97fa616b3713. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:17:23.168677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2a03917b-4fba-4ceb-97c5-d9994bfec80a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:17:23.171042 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2a03917b-4fba-4ceb-97c5-d9994bfec80a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:17:23.269964 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2a03917b-4fba-4ceb-97c5-d9994bfec80a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.833314 Oct 29 03:17:23.270679 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2369/4942] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:17:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 1835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:17:23.287175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3da36672-e2ad-433d-be4c-e9c704ebd57c tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:23.288991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3da36672-e2ad-433d-be4c-e9c704ebd57c tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:23.299998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=14,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:23.526766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3da36672-e2ad-433d-be4c-e9c704ebd57c tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:23.562550 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3da36672-e2ad-433d-be4c-e9c704ebd57c tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49" status: 200 len: 1242 microversion: 2.1 time: 0.269213 Oct 29 03:17:23.566670 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2574/4943] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:23 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 => generated 1242 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:24.591823 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c8e5eb12-f53f-4ff0-a966-7ad0fdee8c81 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:24.592471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c8e5eb12-f53f-4ff0-a966-7ad0fdee8c81 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:24.760105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c8e5eb12-f53f-4ff0-a966-7ad0fdee8c81 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:24.791119 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c8e5eb12-f53f-4ff0-a966-7ad0fdee8c81 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49" status: 200 len: 1242 microversion: 2.1 time: 0.203841 Oct 29 03:17:24.794480 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2370/4944] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:24 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 => generated 1242 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:25.819460 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2adbe98f-9aa3-471a-ba40-7f7cc6902983 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:25.822283 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2adbe98f-9aa3-471a-ba40-7f7cc6902983 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:25.864927 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2adbe98f-9aa3-471a-ba40-7f7cc6902983 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:25.865509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2adbe98f-9aa3-471a-ba40-7f7cc6902983 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:25.865962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2adbe98f-9aa3-471a-ba40-7f7cc6902983 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:25.866711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2adbe98f-9aa3-471a-ba40-7f7cc6902983 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:25.867167 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2adbe98f-9aa3-471a-ba40-7f7cc6902983 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:25.875765 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2adbe98f-9aa3-471a-ba40-7f7cc6902983 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:26.046486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2adbe98f-9aa3-471a-ba40-7f7cc6902983 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:26.071470 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2adbe98f-9aa3-471a-ba40-7f7cc6902983 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49" status: 200 len: 1294 microversion: 2.1 time: 0.257220 Oct 29 03:17:26.078208 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2575/4945] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:25 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 => generated 1294 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:27.100655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9cb74414-5594-4f50-8cd3-27db4cd4e5c1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:27.101319 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9cb74414-5594-4f50-8cd3-27db4cd4e5c1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:27.125944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cb74414-5594-4f50-8cd3-27db4cd4e5c1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:27.133682 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cb74414-5594-4f50-8cd3-27db4cd4e5c1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:27.134239 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cb74414-5594-4f50-8cd3-27db4cd4e5c1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:27.138042 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cb74414-5594-4f50-8cd3-27db4cd4e5c1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:27.138530 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cb74414-5594-4f50-8cd3-27db4cd4e5c1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:27.148059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cb74414-5594-4f50-8cd3-27db4cd4e5c1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:28.926552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9cb74414-5594-4f50-8cd3-27db4cd4e5c1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:28.952414 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9cb74414-5594-4f50-8cd3-27db4cd4e5c1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49" status: 200 len: 1300 microversion: 2.1 time: 1.856889 Oct 29 03:17:28.962533 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2371/4946] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:27 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 => generated 1300 bytes in 1868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:29.993964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3acc7713-c4ab-438e-9ba2-ba04a435ce21 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:29.996388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3acc7713-c4ab-438e-9ba2-ba04a435ce21 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:30.021527 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3acc7713-c4ab-438e-9ba2-ba04a435ce21 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:30.030881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3acc7713-c4ab-438e-9ba2-ba04a435ce21 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:30.031635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3acc7713-c4ab-438e-9ba2-ba04a435ce21 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:30.038177 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3acc7713-c4ab-438e-9ba2-ba04a435ce21 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:30.049000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3acc7713-c4ab-438e-9ba2-ba04a435ce21 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:30.049799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3acc7713-c4ab-438e-9ba2-ba04a435ce21 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:30.782592 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3acc7713-c4ab-438e-9ba2-ba04a435ce21 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:30.805150 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3acc7713-c4ab-438e-9ba2-ba04a435ce21 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49" status: 200 len: 1367 microversion: 2.1 time: 0.816615 Oct 29 03:17:30.820212 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2576/4947] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:29 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 => generated 1367 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:31.848495 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2b89df37-17e3-4b7f-97d8-c007566444b2 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:31.849851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2b89df37-17e3-4b7f-97d8-c007566444b2 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:31.869986 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b89df37-17e3-4b7f-97d8-c007566444b2 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:31.880501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b89df37-17e3-4b7f-97d8-c007566444b2 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:31.882569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b89df37-17e3-4b7f-97d8-c007566444b2 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:31.883589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b89df37-17e3-4b7f-97d8-c007566444b2 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:31.885198 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b89df37-17e3-4b7f-97d8-c007566444b2 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:31.888057 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b89df37-17e3-4b7f-97d8-c007566444b2 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:32.479102 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2b89df37-17e3-4b7f-97d8-c007566444b2 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:32.501927 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2b89df37-17e3-4b7f-97d8-c007566444b2 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49" status: 200 len: 1367 microversion: 2.1 time: 0.656470 Oct 29 03:17:32.544494 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2372/4948] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:31 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 => generated 1367 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:33.549408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-db086d37-78f0-4792-b6c9-6aac6ede6a14 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:33.551659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-db086d37-78f0-4792-b6c9-6aac6ede6a14 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:33.554970 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:33.579607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db086d37-78f0-4792-b6c9-6aac6ede6a14 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:33.583427 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db086d37-78f0-4792-b6c9-6aac6ede6a14 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:33.587853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db086d37-78f0-4792-b6c9-6aac6ede6a14 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:33.591130 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db086d37-78f0-4792-b6c9-6aac6ede6a14 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:33.595212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db086d37-78f0-4792-b6c9-6aac6ede6a14 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:33.599162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db086d37-78f0-4792-b6c9-6aac6ede6a14 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:34.125538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-db086d37-78f0-4792-b6c9-6aac6ede6a14 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:34.135784 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-db086d37-78f0-4792-b6c9-6aac6ede6a14 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49" status: 200 len: 1367 microversion: 2.1 time: 0.590182 Oct 29 03:17:34.148739 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2577/4949] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:33 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 => generated 1367 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:34.845206 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-c802d6df-6131-42d8-ae8b-a99de7c3e021 req-86144bc3-1f0a-4b5f-ab8c-c131af1bbed4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8356f447-88b7-4047-a578-eb3c1cd24e49", "tag": "5f0d4892-1602-4f1f-8fec-6840b8340948"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:17:34.888191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:34.888517 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-67fc94a5-6046-4692-b1ce-4d3bf8967a0f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:34.889187 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-67fc94a5-6046-4692-b1ce-4d3bf8967a0f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:34.893371 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=8 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:34.908960 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c802d6df-6131-42d8-ae8b-a99de7c3e021 req-86144bc3-1f0a-4b5f-ab8c-c131af1bbed4 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:34.913141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c802d6df-6131-42d8-ae8b-a99de7c3e021 req-86144bc3-1f0a-4b5f-ab8c-c131af1bbed4 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:34.913780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c802d6df-6131-42d8-ae8b-a99de7c3e021 req-86144bc3-1f0a-4b5f-ab8c-c131af1bbed4 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:34.914402 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67fc94a5-6046-4692-b1ce-4d3bf8967a0f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:34.928971 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67fc94a5-6046-4692-b1ce-4d3bf8967a0f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:34.929842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67fc94a5-6046-4692-b1ce-4d3bf8967a0f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:34.932030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67fc94a5-6046-4692-b1ce-4d3bf8967a0f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:34.940086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67fc94a5-6046-4692-b1ce-4d3bf8967a0f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:34.945896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67fc94a5-6046-4692-b1ce-4d3bf8967a0f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:34.979743 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-c802d6df-6131-42d8-ae8b-a99de7c3e021 req-86144bc3-1f0a-4b5f-ab8c-c131af1bbed4 service nova] Creating event network-changed:5f0d4892-1602-4f1f-8fec-6840b8340948 for instance 8356f447-88b7-4047-a578-eb3c1cd24e49 on n-h1-862967-2 Oct 29 03:17:35.007102 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-c802d6df-6131-42d8-ae8b-a99de7c3e021 req-86144bc3-1f0a-4b5f-ab8c-c131af1bbed4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165982 Oct 29 03:17:35.018097 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2373/4950] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:17:35.173150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6125ab3d-fd5e-42cc-95db-abf2c97e5cfc tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:35.173772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6125ab3d-fd5e-42cc-95db-abf2c97e5cfc tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:35.186730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6125ab3d-fd5e-42cc-95db-abf2c97e5cfc tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:35.187367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6125ab3d-fd5e-42cc-95db-abf2c97e5cfc tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:35.187818 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6125ab3d-fd5e-42cc-95db-abf2c97e5cfc tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:35.190987 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6125ab3d-fd5e-42cc-95db-abf2c97e5cfc tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:35.191576 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6125ab3d-fd5e-42cc-95db-abf2c97e5cfc tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:35.195170 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6125ab3d-fd5e-42cc-95db-abf2c97e5cfc tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:35.975901 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-67fc94a5-6046-4692-b1ce-4d3bf8967a0f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:35.986222 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-67fc94a5-6046-4692-b1ce-4d3bf8967a0f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1683 microversion: 2.1 time: 1.102692 Oct 29 03:17:36.009164 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2578/4951] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:34 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1683 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:36.286525 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6125ab3d-fd5e-42cc-95db-abf2c97e5cfc tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:36.298725 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6125ab3d-fd5e-42cc-95db-abf2c97e5cfc tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49" status: 200 len: 1367 microversion: 2.1 time: 1.128906 Oct 29 03:17:36.314295 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2374/4952] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:35 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 => generated 1367 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:17:37.011359 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-33ca968c-ae03-467d-bbcc-3ce4e4c1dde8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:37.012654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-33ca968c-ae03-467d-bbcc-3ce4e4c1dde8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:37.025652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33ca968c-ae03-467d-bbcc-3ce4e4c1dde8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:37.040808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33ca968c-ae03-467d-bbcc-3ce4e4c1dde8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:37.042963 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33ca968c-ae03-467d-bbcc-3ce4e4c1dde8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:37.043772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33ca968c-ae03-467d-bbcc-3ce4e4c1dde8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:37.051102 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33ca968c-ae03-467d-bbcc-3ce4e4c1dde8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:37.052005 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33ca968c-ae03-467d-bbcc-3ce4e4c1dde8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:37.332508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-405e6bf0-8171-46ae-a4ab-68e2b74d1e01 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:37.334012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-405e6bf0-8171-46ae-a4ab-68e2b74d1e01 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:37.359074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-405e6bf0-8171-46ae-a4ab-68e2b74d1e01 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:37.361881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-405e6bf0-8171-46ae-a4ab-68e2b74d1e01 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:37.362493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-405e6bf0-8171-46ae-a4ab-68e2b74d1e01 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:37.364057 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-405e6bf0-8171-46ae-a4ab-68e2b74d1e01 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:37.370464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-405e6bf0-8171-46ae-a4ab-68e2b74d1e01 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:37.373559 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-405e6bf0-8171-46ae-a4ab-68e2b74d1e01 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:38.173162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-33ca968c-ae03-467d-bbcc-3ce4e4c1dde8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:38.188155 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-33ca968c-ae03-467d-bbcc-3ce4e4c1dde8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 1.180852 Oct 29 03:17:38.196608 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2579/4953] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:37 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:38.225324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cf262092-8d1a-4d0d-baf9-9b50cdb1f9bb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-128694394"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:17:38.232925 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cf262092-8d1a-4d0d-baf9-9b50cdb1f9bb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:38.241887 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf262092-8d1a-4d0d-baf9-9b50cdb1f9bb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:38.242558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf262092-8d1a-4d0d-baf9-9b50cdb1f9bb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:38.243450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf262092-8d1a-4d0d-baf9-9b50cdb1f9bb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:38.245258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf262092-8d1a-4d0d-baf9-9b50cdb1f9bb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:38.245891 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf262092-8d1a-4d0d-baf9-9b50cdb1f9bb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:38.246501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf262092-8d1a-4d0d-baf9-9b50cdb1f9bb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:38.626231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-405e6bf0-8171-46ae-a4ab-68e2b74d1e01 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:38.657272 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-405e6bf0-8171-46ae-a4ab-68e2b74d1e01 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49" status: 200 len: 1367 microversion: 2.1 time: 1.333638 Oct 29 03:17:38.657931 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2375/4954] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:37 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 => generated 1367 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:38.848815 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cf262092-8d1a-4d0d-baf9-9b50cdb1f9bb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action" status: 202 len: 0 microversion: 2.1 time: 0.638198 Oct 29 03:17:38.855477 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2580/4955] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:17:38 2022] POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action => generated 0 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 29 03:17:38.865282 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-17eb6ab7-9eb3-42bf-b73f-57744c731ef8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:38.866016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-17eb6ab7-9eb3-42bf-b73f-57744c731ef8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:38.888404 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-17eb6ab7-9eb3-42bf-b73f-57744c731ef8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:38.888968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-17eb6ab7-9eb3-42bf-b73f-57744c731ef8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:38.889406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-17eb6ab7-9eb3-42bf-b73f-57744c731ef8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:38.895168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-17eb6ab7-9eb3-42bf-b73f-57744c731ef8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:38.895594 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-17eb6ab7-9eb3-42bf-b73f-57744c731ef8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:38.896076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-17eb6ab7-9eb3-42bf-b73f-57744c731ef8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:39.165839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-d1a581d9-86f1-4b25-933d-b7d500ed688b req-f6385793-2d41-4749-9049-dfeee51dc6d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23349ce8-2588-42c9-8de7-90865b56c980", "name": "network-vif-unplugged", "status": "completed", "tag": "26865343-33e7-4622-bd06-ed6191938067"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:17:39.188939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d1a581d9-86f1-4b25-933d-b7d500ed688b req-f6385793-2d41-4749-9049-dfeee51dc6d6 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:39.195354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d1a581d9-86f1-4b25-933d-b7d500ed688b req-f6385793-2d41-4749-9049-dfeee51dc6d6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:39.196158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d1a581d9-86f1-4b25-933d-b7d500ed688b req-f6385793-2d41-4749-9049-dfeee51dc6d6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:39.225516 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-d1a581d9-86f1-4b25-933d-b7d500ed688b req-f6385793-2d41-4749-9049-dfeee51dc6d6 service nova] Creating event network-vif-unplugged:26865343-33e7-4622-bd06-ed6191938067 for instance 23349ce8-2588-42c9-8de7-90865b56c980 on n-h2-862967-2 Oct 29 03:17:39.247001 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-d1a581d9-86f1-4b25-933d-b7d500ed688b req-f6385793-2d41-4749-9049-dfeee51dc6d6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078149 Oct 29 03:17:39.248088 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2581/4956] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:17:39.702460 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-59402208-4884-4c84-ab76-8b51eb59fa69 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:39.703452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-59402208-4884-4c84-ab76-8b51eb59fa69 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:39.721334 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59402208-4884-4c84-ab76-8b51eb59fa69 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:39.721868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59402208-4884-4c84-ab76-8b51eb59fa69 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:39.722356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59402208-4884-4c84-ab76-8b51eb59fa69 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:39.723099 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59402208-4884-4c84-ab76-8b51eb59fa69 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:39.723559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59402208-4884-4c84-ab76-8b51eb59fa69 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:39.728931 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59402208-4884-4c84-ab76-8b51eb59fa69 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:39.919537 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-17eb6ab7-9eb3-42bf-b73f-57744c731ef8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:39.931208 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-17eb6ab7-9eb3-42bf-b73f-57744c731ef8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1680 microversion: 2.1 time: 1.073485 Oct 29 03:17:39.936219 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2376/4957] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:38 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1680 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:40.231022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-59402208-4884-4c84-ab76-8b51eb59fa69 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:40.244938 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-59402208-4884-4c84-ab76-8b51eb59fa69 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49" status: 200 len: 1367 microversion: 2.1 time: 0.564723 Oct 29 03:17:40.246039 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2582/4958] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:39 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 => generated 1367 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:40.960638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fcb86f99-c69f-44df-9034-98651488eec2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:40.961263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fcb86f99-c69f-44df-9034-98651488eec2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:40.975117 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fcb86f99-c69f-44df-9034-98651488eec2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:40.975618 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fcb86f99-c69f-44df-9034-98651488eec2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:40.976092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fcb86f99-c69f-44df-9034-98651488eec2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:40.979594 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fcb86f99-c69f-44df-9034-98651488eec2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:40.980409 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fcb86f99-c69f-44df-9034-98651488eec2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:40.985212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fcb86f99-c69f-44df-9034-98651488eec2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:41.269452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fcb86f99-c69f-44df-9034-98651488eec2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:41.269834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6558c443-d65d-4f15-a30c-0e45e6b338b4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:41.270805 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6558c443-d65d-4f15-a30c-0e45e6b338b4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:41.287304 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fcb86f99-c69f-44df-9034-98651488eec2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1688 microversion: 2.1 time: 0.331074 Oct 29 03:17:41.288910 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2377/4959] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:40 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1688 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:41.296972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6558c443-d65d-4f15-a30c-0e45e6b338b4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:41.297476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6558c443-d65d-4f15-a30c-0e45e6b338b4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:41.297917 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6558c443-d65d-4f15-a30c-0e45e6b338b4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:41.298636 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6558c443-d65d-4f15-a30c-0e45e6b338b4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:41.302572 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6558c443-d65d-4f15-a30c-0e45e6b338b4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:41.305747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6558c443-d65d-4f15-a30c-0e45e6b338b4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:41.916435 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6558c443-d65d-4f15-a30c-0e45e6b338b4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:41.931635 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6558c443-d65d-4f15-a30c-0e45e6b338b4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49" status: 200 len: 1367 microversion: 2.1 time: 0.665014 Oct 29 03:17:41.934804 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2583/4960] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:41 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 => generated 1367 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:42.312398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-361f9bcd-d6c0-42b0-8156-3d1a283e2b89 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:42.312914 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-361f9bcd-d6c0-42b0-8156-3d1a283e2b89 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:42.330931 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-361f9bcd-d6c0-42b0-8156-3d1a283e2b89 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:42.331394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-361f9bcd-d6c0-42b0-8156-3d1a283e2b89 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:42.334038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-361f9bcd-d6c0-42b0-8156-3d1a283e2b89 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:42.336605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-361f9bcd-d6c0-42b0-8156-3d1a283e2b89 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:42.337110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-361f9bcd-d6c0-42b0-8156-3d1a283e2b89 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:42.337529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-361f9bcd-d6c0-42b0-8156-3d1a283e2b89 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:42.862768 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-361f9bcd-d6c0-42b0-8156-3d1a283e2b89 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:42.925715 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-361f9bcd-d6c0-42b0-8156-3d1a283e2b89 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1688 microversion: 2.1 time: 0.614615 Oct 29 03:17:42.930506 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2378/4961] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:42 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1688 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:42.977379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-214e7f46-a10f-4e63-9e42-2c0cfc8c0a43 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:42.978125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-214e7f46-a10f-4e63-9e42-2c0cfc8c0a43 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:42.983945 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:43.020635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-214e7f46-a10f-4e63-9e42-2c0cfc8c0a43 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:43.023173 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-214e7f46-a10f-4e63-9e42-2c0cfc8c0a43 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:43.025590 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-214e7f46-a10f-4e63-9e42-2c0cfc8c0a43 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:43.029454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-214e7f46-a10f-4e63-9e42-2c0cfc8c0a43 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:43.034003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-214e7f46-a10f-4e63-9e42-2c0cfc8c0a43 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:43.036870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-214e7f46-a10f-4e63-9e42-2c0cfc8c0a43 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:43.582362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-214e7f46-a10f-4e63-9e42-2c0cfc8c0a43 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:43.594746 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-214e7f46-a10f-4e63-9e42-2c0cfc8c0a43 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49" status: 200 len: 1367 microversion: 2.1 time: 0.638431 Oct 29 03:17:43.595773 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2584/4962] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:42 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 => generated 1367 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:43.961947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-63933945-d64e-4f6e-be39-bd7ef515275c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:43.963032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-63933945-d64e-4f6e-be39-bd7ef515275c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:43.974364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63933945-d64e-4f6e-be39-bd7ef515275c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:43.975428 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63933945-d64e-4f6e-be39-bd7ef515275c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:43.975884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63933945-d64e-4f6e-be39-bd7ef515275c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:43.976772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63933945-d64e-4f6e-be39-bd7ef515275c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:43.978058 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63933945-d64e-4f6e-be39-bd7ef515275c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:43.978484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63933945-d64e-4f6e-be39-bd7ef515275c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:44.524907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-63933945-d64e-4f6e-be39-bd7ef515275c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:44.537317 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-63933945-d64e-4f6e-be39-bd7ef515275c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1683 microversion: 2.1 time: 0.581962 Oct 29 03:17:44.553867 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2379/4963] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:43 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1683 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:17:44.622775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c34c51cd-c775-48ee-8ae3-7ac1b5aeb92a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:44.624006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c34c51cd-c775-48ee-8ae3-7ac1b5aeb92a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:44.635379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c34c51cd-c775-48ee-8ae3-7ac1b5aeb92a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:44.635883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c34c51cd-c775-48ee-8ae3-7ac1b5aeb92a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:44.636315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c34c51cd-c775-48ee-8ae3-7ac1b5aeb92a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:44.637058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c34c51cd-c775-48ee-8ae3-7ac1b5aeb92a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:44.637508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c34c51cd-c775-48ee-8ae3-7ac1b5aeb92a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:44.638235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c34c51cd-c775-48ee-8ae3-7ac1b5aeb92a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:45.158498 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c34c51cd-c775-48ee-8ae3-7ac1b5aeb92a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:45.169429 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c34c51cd-c775-48ee-8ae3-7ac1b5aeb92a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49" status: 200 len: 1367 microversion: 2.1 time: 0.550457 Oct 29 03:17:45.170408 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2585/4964] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:44 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 => generated 1367 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:17:45.573847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a15f9d1e-df36-438d-ae4b-de850fae769d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:45.574605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a15f9d1e-df36-438d-ae4b-de850fae769d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:45.593483 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a15f9d1e-df36-438d-ae4b-de850fae769d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:45.593992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a15f9d1e-df36-438d-ae4b-de850fae769d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:45.594408 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a15f9d1e-df36-438d-ae4b-de850fae769d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:45.595124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a15f9d1e-df36-438d-ae4b-de850fae769d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:45.595588 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a15f9d1e-df36-438d-ae4b-de850fae769d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:45.595999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a15f9d1e-df36-438d-ae4b-de850fae769d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:46.195676 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-88e96087-2141-46a0-9cd3-f808b9cd044e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:46.197520 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-88e96087-2141-46a0-9cd3-f808b9cd044e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:46.237650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88e96087-2141-46a0-9cd3-f808b9cd044e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:46.239064 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88e96087-2141-46a0-9cd3-f808b9cd044e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:46.242634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88e96087-2141-46a0-9cd3-f808b9cd044e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:46.243033 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88e96087-2141-46a0-9cd3-f808b9cd044e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:46.245597 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88e96087-2141-46a0-9cd3-f808b9cd044e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:46.246283 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88e96087-2141-46a0-9cd3-f808b9cd044e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:46.583563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a15f9d1e-df36-438d-ae4b-de850fae769d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:46.604571 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a15f9d1e-df36-438d-ae4b-de850fae769d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1683 microversion: 2.1 time: 1.032176 Oct 29 03:17:46.605442 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2380/4965] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:45 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1683 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:47.015218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-88e96087-2141-46a0-9cd3-f808b9cd044e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:47.031689 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-88e96087-2141-46a0-9cd3-f808b9cd044e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49" status: 200 len: 1367 microversion: 2.1 time: 0.841700 Oct 29 03:17:47.032964 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2586/4966] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:46 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 => generated 1367 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:47.634898 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3af5fa3a-4c58-4386-a4f9-c4725d3be6b3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:47.635843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3af5fa3a-4c58-4386-a4f9-c4725d3be6b3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:47.654140 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3af5fa3a-4c58-4386-a4f9-c4725d3be6b3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:47.654769 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3af5fa3a-4c58-4386-a4f9-c4725d3be6b3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:47.655390 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3af5fa3a-4c58-4386-a4f9-c4725d3be6b3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:47.657844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3af5fa3a-4c58-4386-a4f9-c4725d3be6b3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:47.658444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3af5fa3a-4c58-4386-a4f9-c4725d3be6b3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:47.660061 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3af5fa3a-4c58-4386-a4f9-c4725d3be6b3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:48.058029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-46ad295c-47e0-4e54-8f11-e6f131f0e432 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:48.059428 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-46ad295c-47e0-4e54-8f11-e6f131f0e432 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:48.076295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46ad295c-47e0-4e54-8f11-e6f131f0e432 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:48.078924 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46ad295c-47e0-4e54-8f11-e6f131f0e432 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:48.079375 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46ad295c-47e0-4e54-8f11-e6f131f0e432 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:48.084684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46ad295c-47e0-4e54-8f11-e6f131f0e432 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:48.087009 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46ad295c-47e0-4e54-8f11-e6f131f0e432 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:48.089290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46ad295c-47e0-4e54-8f11-e6f131f0e432 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:48.258820 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3af5fa3a-4c58-4386-a4f9-c4725d3be6b3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:48.275141 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3af5fa3a-4c58-4386-a4f9-c4725d3be6b3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1683 microversion: 2.1 time: 0.645858 Oct 29 03:17:48.277073 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2381/4967] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:47 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1683 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:48.681070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-46ad295c-47e0-4e54-8f11-e6f131f0e432 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:48.694025 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-46ad295c-47e0-4e54-8f11-e6f131f0e432 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49" status: 200 len: 1367 microversion: 2.1 time: 0.640159 Oct 29 03:17:48.694697 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2587/4968] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:48 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 => generated 1367 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:17:49.303851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dc45f209-c92f-4c67-8820-b24a4908f211 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:49.304463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dc45f209-c92f-4c67-8820-b24a4908f211 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:49.318954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc45f209-c92f-4c67-8820-b24a4908f211 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:49.319582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc45f209-c92f-4c67-8820-b24a4908f211 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:49.320049 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc45f209-c92f-4c67-8820-b24a4908f211 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:49.320856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc45f209-c92f-4c67-8820-b24a4908f211 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:49.321314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc45f209-c92f-4c67-8820-b24a4908f211 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:49.325047 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc45f209-c92f-4c67-8820-b24a4908f211 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:49.725342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2f21a2be-3c88-46a1-822e-f824dc8d728b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:49.726486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2f21a2be-3c88-46a1-822e-f824dc8d728b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:49.736455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f21a2be-3c88-46a1-822e-f824dc8d728b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:49.739261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f21a2be-3c88-46a1-822e-f824dc8d728b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:49.739876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f21a2be-3c88-46a1-822e-f824dc8d728b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:49.741537 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f21a2be-3c88-46a1-822e-f824dc8d728b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:49.743750 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f21a2be-3c88-46a1-822e-f824dc8d728b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:49.744561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f21a2be-3c88-46a1-822e-f824dc8d728b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:49.984330 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dc45f209-c92f-4c67-8820-b24a4908f211 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:49.996623 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dc45f209-c92f-4c67-8820-b24a4908f211 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1683 microversion: 2.1 time: 0.696562 Oct 29 03:17:49.999120 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2382/4969] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:49 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1683 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:50.516313 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-295606cf-eee8-4988-b1bb-54480c108971 req-1bf0dcd4-dd8c-40fc-b72b-862bb2da2a9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23349ce8-2588-42c9-8de7-90865b56c980", "name": "network-vif-plugged", "status": "completed", "tag": "26865343-33e7-4622-bd06-ed6191938067"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:17:50.547769 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-295606cf-eee8-4988-b1bb-54480c108971 req-1bf0dcd4-dd8c-40fc-b72b-862bb2da2a9e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:50.549438 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-295606cf-eee8-4988-b1bb-54480c108971 req-1bf0dcd4-dd8c-40fc-b72b-862bb2da2a9e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:50.550068 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-295606cf-eee8-4988-b1bb-54480c108971 req-1bf0dcd4-dd8c-40fc-b72b-862bb2da2a9e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:50.592702 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-295606cf-eee8-4988-b1bb-54480c108971 req-1bf0dcd4-dd8c-40fc-b72b-862bb2da2a9e service nova] Creating event network-vif-plugged:26865343-33e7-4622-bd06-ed6191938067 for instance 23349ce8-2588-42c9-8de7-90865b56c980 on n-h2-862967-2 Oct 29 03:17:50.610997 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-295606cf-eee8-4988-b1bb-54480c108971 req-1bf0dcd4-dd8c-40fc-b72b-862bb2da2a9e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098452 Oct 29 03:17:50.613739 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2383/4970] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:17:51.023363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c8702a73-5e84-4676-bfc8-eaa6158ede7c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:51.024064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c8702a73-5e84-4676-bfc8-eaa6158ede7c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:51.044558 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8702a73-5e84-4676-bfc8-eaa6158ede7c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:51.045080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8702a73-5e84-4676-bfc8-eaa6158ede7c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:51.053692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8702a73-5e84-4676-bfc8-eaa6158ede7c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:51.061373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8702a73-5e84-4676-bfc8-eaa6158ede7c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:51.063883 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8702a73-5e84-4676-bfc8-eaa6158ede7c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:51.064399 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8702a73-5e84-4676-bfc8-eaa6158ede7c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:51.458153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c8702a73-5e84-4676-bfc8-eaa6158ede7c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:51.474897 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c8702a73-5e84-4676-bfc8-eaa6158ede7c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1683 microversion: 2.1 time: 0.457967 Oct 29 03:17:51.475501 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2384/4971] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:51 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1683 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:52.507976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-978d316b-e0af-4d58-981e-70e0f7af3e38 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:52.509018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-978d316b-e0af-4d58-981e-70e0f7af3e38 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:52.525675 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:52.528296 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2f21a2be-3c88-46a1-822e-f824dc8d728b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:52.549403 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2f21a2be-3c88-46a1-822e-f824dc8d728b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49" status: 200 len: 1367 microversion: 2.1 time: 2.830036 Oct 29 03:17:52.574424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-978d316b-e0af-4d58-981e-70e0f7af3e38 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:52.580473 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-978d316b-e0af-4d58-981e-70e0f7af3e38 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:52.582226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-978d316b-e0af-4d58-981e-70e0f7af3e38 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:52.587675 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-978d316b-e0af-4d58-981e-70e0f7af3e38 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:52.588184 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-978d316b-e0af-4d58-981e-70e0f7af3e38 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:52.593388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-978d316b-e0af-4d58-981e-70e0f7af3e38 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:52.595896 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2588/4972] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:49 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 => generated 1367 bytes in 2877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:52.635862 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=79 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:53.261529 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-adc68d8f-a26b-4119-a54d-64a854d9a1b7 req-df0e0c9a-d75a-4d33-8fdc-810449695312 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8356f447-88b7-4047-a578-eb3c1cd24e49", "name": "network-vif-plugged", "status": "completed", "tag": "5f0d4892-1602-4f1f-8fec-6840b8340948"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:17:53.313608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-adc68d8f-a26b-4119-a54d-64a854d9a1b7 req-df0e0c9a-d75a-4d33-8fdc-810449695312 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:53.314091 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-adc68d8f-a26b-4119-a54d-64a854d9a1b7 req-df0e0c9a-d75a-4d33-8fdc-810449695312 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:53.314521 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-adc68d8f-a26b-4119-a54d-64a854d9a1b7 req-df0e0c9a-d75a-4d33-8fdc-810449695312 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:53.352930 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-adc68d8f-a26b-4119-a54d-64a854d9a1b7 req-df0e0c9a-d75a-4d33-8fdc-810449695312 service nova] Creating event network-vif-plugged:5f0d4892-1602-4f1f-8fec-6840b8340948 for instance 8356f447-88b7-4047-a578-eb3c1cd24e49 on n-h1-862967-2 Oct 29 03:17:53.362547 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-adc68d8f-a26b-4119-a54d-64a854d9a1b7 req-df0e0c9a-d75a-4d33-8fdc-810449695312 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108821 Oct 29 03:17:53.363906 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2589/4973] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:17:53.453453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-978d316b-e0af-4d58-981e-70e0f7af3e38 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:53.504576 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-978d316b-e0af-4d58-981e-70e0f7af3e38 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1683 microversion: 2.1 time: 1.001192 Oct 29 03:17:53.505236 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2385/4974] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:52 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1683 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:17:53.590171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5dbcfbcb-c7cf-4107-837c-b7b44ca6af15 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:53.592451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5dbcfbcb-c7cf-4107-837c-b7b44ca6af15 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:53.626556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5dbcfbcb-c7cf-4107-837c-b7b44ca6af15 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:53.642892 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5dbcfbcb-c7cf-4107-837c-b7b44ca6af15 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:53.651147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5dbcfbcb-c7cf-4107-837c-b7b44ca6af15 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:53.653627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5dbcfbcb-c7cf-4107-837c-b7b44ca6af15 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:53.656987 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5dbcfbcb-c7cf-4107-837c-b7b44ca6af15 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:53.657968 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5dbcfbcb-c7cf-4107-837c-b7b44ca6af15 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:53.679298 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:54.532933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2b02c5e6-0a2d-4081-9b1f-ee73cb834de5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:54.533694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2b02c5e6-0a2d-4081-9b1f-ee73cb834de5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:54.544943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5dbcfbcb-c7cf-4107-837c-b7b44ca6af15 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:54.553161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b02c5e6-0a2d-4081-9b1f-ee73cb834de5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:54.553763 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b02c5e6-0a2d-4081-9b1f-ee73cb834de5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:54.554082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b02c5e6-0a2d-4081-9b1f-ee73cb834de5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:54.554796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b02c5e6-0a2d-4081-9b1f-ee73cb834de5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:54.555248 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b02c5e6-0a2d-4081-9b1f-ee73cb834de5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:54.555697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b02c5e6-0a2d-4081-9b1f-ee73cb834de5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:54.556970 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5dbcfbcb-c7cf-4107-837c-b7b44ca6af15 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49" status: 200 len: 1367 microversion: 2.1 time: 0.974456 Oct 29 03:17:54.558033 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2590/4975] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:53 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 => generated 1367 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:55.368144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2b02c5e6-0a2d-4081-9b1f-ee73cb834de5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:55.381376 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2b02c5e6-0a2d-4081-9b1f-ee73cb834de5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1683 microversion: 2.1 time: 0.852658 Oct 29 03:17:55.390769 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2386/4976] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:54 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1683 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:55.585248 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c0f6fb40-791b-46bc-9efe-2fb408f9d37b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:55.586043 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c0f6fb40-791b-46bc-9efe-2fb408f9d37b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:55.610499 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0f6fb40-791b-46bc-9efe-2fb408f9d37b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:55.613367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0f6fb40-791b-46bc-9efe-2fb408f9d37b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:55.633437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0f6fb40-791b-46bc-9efe-2fb408f9d37b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:55.634563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0f6fb40-791b-46bc-9efe-2fb408f9d37b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:55.635395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0f6fb40-791b-46bc-9efe-2fb408f9d37b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:55.636280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0f6fb40-791b-46bc-9efe-2fb408f9d37b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:56.406263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dbcdb5cf-37c0-4f72-9c10-e82154dfc8e0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:56.406958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dbcdb5cf-37c0-4f72-9c10-e82154dfc8e0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:56.442569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbcdb5cf-37c0-4f72-9c10-e82154dfc8e0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:56.452001 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbcdb5cf-37c0-4f72-9c10-e82154dfc8e0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:56.452550 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbcdb5cf-37c0-4f72-9c10-e82154dfc8e0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:56.453315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbcdb5cf-37c0-4f72-9c10-e82154dfc8e0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:56.453787 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbcdb5cf-37c0-4f72-9c10-e82154dfc8e0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:56.454219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbcdb5cf-37c0-4f72-9c10-e82154dfc8e0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:57.154713 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dbcdb5cf-37c0-4f72-9c10-e82154dfc8e0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:57.165780 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dbcdb5cf-37c0-4f72-9c10-e82154dfc8e0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1683 microversion: 2.1 time: 0.763477 Oct 29 03:17:57.177373 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2387/4977] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:56 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1683 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:17:57.188337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c0f6fb40-791b-46bc-9efe-2fb408f9d37b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:57.210964 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c0f6fb40-791b-46bc-9efe-2fb408f9d37b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49" status: 200 len: 1367 microversion: 2.1 time: 1.615790 Oct 29 03:17:57.215206 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2591/4978] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:55 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 => generated 1367 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:58.204963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-02d5276d-88b8-47d3-a6cf-fbaafb4b29c8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:58.205654 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-02d5276d-88b8-47d3-a6cf-fbaafb4b29c8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:58.227338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02d5276d-88b8-47d3-a6cf-fbaafb4b29c8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:58.228141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02d5276d-88b8-47d3-a6cf-fbaafb4b29c8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:58.228720 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02d5276d-88b8-47d3-a6cf-fbaafb4b29c8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:58.229576 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02d5276d-88b8-47d3-a6cf-fbaafb4b29c8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:58.232555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02d5276d-88b8-47d3-a6cf-fbaafb4b29c8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:58.239584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f890565b-1294-41a6-81ee-3743604fc0f8 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:58.240869 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f890565b-1294-41a6-81ee-3743604fc0f8 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:58.246487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02d5276d-88b8-47d3-a6cf-fbaafb4b29c8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:58.260990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f890565b-1294-41a6-81ee-3743604fc0f8 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:58.261547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f890565b-1294-41a6-81ee-3743604fc0f8 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:58.265917 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f890565b-1294-41a6-81ee-3743604fc0f8 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:58.269272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f890565b-1294-41a6-81ee-3743604fc0f8 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:58.269272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f890565b-1294-41a6-81ee-3743604fc0f8 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:58.270052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f890565b-1294-41a6-81ee-3743604fc0f8 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:58.852785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f890565b-1294-41a6-81ee-3743604fc0f8 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:58.870928 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f890565b-1294-41a6-81ee-3743604fc0f8 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49" status: 200 len: 1556 microversion: 2.1 time: 0.635723 Oct 29 03:17:58.873003 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2592/4979] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:58 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 => generated 1556 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:17:58.899670 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b949518c-e571-4750-95a0-f92325862b28 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:17:58.900330 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b949518c-e571-4750-95a0-f92325862b28 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:17:58.924867 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b949518c-e571-4750-95a0-f92325862b28 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:58.933762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b949518c-e571-4750-95a0-f92325862b28 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:58.935735 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b949518c-e571-4750-95a0-f92325862b28 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:58.938449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b949518c-e571-4750-95a0-f92325862b28 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:17:58.941157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b949518c-e571-4750-95a0-f92325862b28 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:17:58.942684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b949518c-e571-4750-95a0-f92325862b28 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:17:59.158977 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b949518c-e571-4750-95a0-f92325862b28 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.258262 Oct 29 03:17:59.160424 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2593/4980] 10.222.0.46 () {58 vars in 1275 bytes} [Sat Oct 29 03:17:58 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-interface => generated 284 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:17:59.314822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-02d5276d-88b8-47d3-a6cf-fbaafb4b29c8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:17:59.345545 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-02d5276d-88b8-47d3-a6cf-fbaafb4b29c8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1683 microversion: 2.1 time: 1.144709 Oct 29 03:17:59.347868 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2388/4981] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:17:58 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1683 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:00.376216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f0f8b7e3-c011-420a-85ec-1ed8fdae0ae1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:00.377502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f0f8b7e3-c011-420a-85ec-1ed8fdae0ae1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:00.393448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0f8b7e3-c011-420a-85ec-1ed8fdae0ae1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:00.395567 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0f8b7e3-c011-420a-85ec-1ed8fdae0ae1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:00.396282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0f8b7e3-c011-420a-85ec-1ed8fdae0ae1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:00.397886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0f8b7e3-c011-420a-85ec-1ed8fdae0ae1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:00.399276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0f8b7e3-c011-420a-85ec-1ed8fdae0ae1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:00.400697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0f8b7e3-c011-420a-85ec-1ed8fdae0ae1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:00.994393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f0f8b7e3-c011-420a-85ec-1ed8fdae0ae1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:01.009219 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f0f8b7e3-c011-420a-85ec-1ed8fdae0ae1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1683 microversion: 2.1 time: 0.638759 Oct 29 03:18:01.010807 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2594/4982] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:00 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1683 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:02.051364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f2b530e2-e5e9-45de-a6d7-e25575995d5e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:02.055695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f2b530e2-e5e9-45de-a6d7-e25575995d5e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:02.116789 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2b530e2-e5e9-45de-a6d7-e25575995d5e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:02.126513 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2b530e2-e5e9-45de-a6d7-e25575995d5e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:02.127464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2b530e2-e5e9-45de-a6d7-e25575995d5e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:02.129376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2b530e2-e5e9-45de-a6d7-e25575995d5e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:02.130414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2b530e2-e5e9-45de-a6d7-e25575995d5e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:02.135745 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2b530e2-e5e9-45de-a6d7-e25575995d5e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:03.719340 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f2b530e2-e5e9-45de-a6d7-e25575995d5e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:03.733717 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f2b530e2-e5e9-45de-a6d7-e25575995d5e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1683 microversion: 2.1 time: 1.698925 Oct 29 03:18:03.753098 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2389/4983] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:02 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1683 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:04.769658 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-977ac4c4-dd40-4a34-9109-89a0f58cfae9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:04.770499 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-977ac4c4-dd40-4a34-9109-89a0f58cfae9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:04.783238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-977ac4c4-dd40-4a34-9109-89a0f58cfae9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:04.794844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-977ac4c4-dd40-4a34-9109-89a0f58cfae9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:04.795439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-977ac4c4-dd40-4a34-9109-89a0f58cfae9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:04.798656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-977ac4c4-dd40-4a34-9109-89a0f58cfae9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:04.801816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-977ac4c4-dd40-4a34-9109-89a0f58cfae9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:04.802691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-977ac4c4-dd40-4a34-9109-89a0f58cfae9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:05.577428 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-977ac4c4-dd40-4a34-9109-89a0f58cfae9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:05.594177 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-977ac4c4-dd40-4a34-9109-89a0f58cfae9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1683 microversion: 2.1 time: 0.826330 Oct 29 03:18:05.625025 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2595/4984] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:04 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1683 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:06.622963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-99783eaf-519c-4c4c-8776-b96058cb895a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:06.623768 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-99783eaf-519c-4c4c-8776-b96058cb895a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:06.643414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-99783eaf-519c-4c4c-8776-b96058cb895a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:06.653823 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-99783eaf-519c-4c4c-8776-b96058cb895a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:06.664743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-99783eaf-519c-4c4c-8776-b96058cb895a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:06.683126 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-99783eaf-519c-4c4c-8776-b96058cb895a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:06.686046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-99783eaf-519c-4c4c-8776-b96058cb895a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:06.686681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-99783eaf-519c-4c4c-8776-b96058cb895a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:07.037517 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-c435364e-68eb-4e93-a367-6f11aede00f5 req-b18dc2eb-b90c-4510-abf4-7d94d58ce431 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8356f447-88b7-4047-a578-eb3c1cd24e49", "tag": "5f0d4892-1602-4f1f-8fec-6840b8340948"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:18:07.067727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c435364e-68eb-4e93-a367-6f11aede00f5 req-b18dc2eb-b90c-4510-abf4-7d94d58ce431 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:07.068204 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c435364e-68eb-4e93-a367-6f11aede00f5 req-b18dc2eb-b90c-4510-abf4-7d94d58ce431 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:07.079245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c435364e-68eb-4e93-a367-6f11aede00f5 req-b18dc2eb-b90c-4510-abf4-7d94d58ce431 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:07.147620 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-c435364e-68eb-4e93-a367-6f11aede00f5 req-b18dc2eb-b90c-4510-abf4-7d94d58ce431 service nova] Creating event network-changed:5f0d4892-1602-4f1f-8fec-6840b8340948 for instance 8356f447-88b7-4047-a578-eb3c1cd24e49 on n-h1-862967-2 Oct 29 03:18:07.176162 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-c435364e-68eb-4e93-a367-6f11aede00f5 req-b18dc2eb-b90c-4510-abf4-7d94d58ce431 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.526898 Oct 29 03:18:07.177374 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2596/4985] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:18:08.100331 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-99783eaf-519c-4c4c-8776-b96058cb895a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:08.118821 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-99783eaf-519c-4c4c-8776-b96058cb895a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1683 microversion: 2.1 time: 1.501670 Oct 29 03:18:08.145018 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2390/4986] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:06 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1683 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:09.162019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c904db0c-f769-4100-8162-6fb53007ad04 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:09.163596 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c904db0c-f769-4100-8162-6fb53007ad04 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:09.180044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c904db0c-f769-4100-8162-6fb53007ad04 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:09.180935 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c904db0c-f769-4100-8162-6fb53007ad04 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:09.181601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c904db0c-f769-4100-8162-6fb53007ad04 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:09.182551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c904db0c-f769-4100-8162-6fb53007ad04 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:09.184109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c904db0c-f769-4100-8162-6fb53007ad04 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:09.188564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c904db0c-f769-4100-8162-6fb53007ad04 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:09.536409 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c904db0c-f769-4100-8162-6fb53007ad04 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:09.550965 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c904db0c-f769-4100-8162-6fb53007ad04 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1683 microversion: 2.1 time: 0.393073 Oct 29 03:18:09.553038 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2597/4987] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:09 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1683 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:10.574662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-22f76723-bab8-45ad-8a2e-43e8d4f8426a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:10.576035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-22f76723-bab8-45ad-8a2e-43e8d4f8426a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:10.587113 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22f76723-bab8-45ad-8a2e-43e8d4f8426a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:10.597108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22f76723-bab8-45ad-8a2e-43e8d4f8426a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:10.598036 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22f76723-bab8-45ad-8a2e-43e8d4f8426a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:10.599040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22f76723-bab8-45ad-8a2e-43e8d4f8426a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:10.600223 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22f76723-bab8-45ad-8a2e-43e8d4f8426a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:10.600914 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22f76723-bab8-45ad-8a2e-43e8d4f8426a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:12.679022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-22f76723-bab8-45ad-8a2e-43e8d4f8426a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:12.702052 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-22f76723-bab8-45ad-8a2e-43e8d4f8426a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1683 microversion: 2.1 time: 2.119853 Oct 29 03:18:12.718525 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2391/4988] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:10 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1683 bytes in 2148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:13.731755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e02a63af-c3d2-475d-bdd6-4079e683b8fe tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:13.733237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e02a63af-c3d2-475d-bdd6-4079e683b8fe tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:13.737610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=28 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:13.749811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e02a63af-c3d2-475d-bdd6-4079e683b8fe tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:13.750312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e02a63af-c3d2-475d-bdd6-4079e683b8fe tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:13.750757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e02a63af-c3d2-475d-bdd6-4079e683b8fe tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:13.751493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e02a63af-c3d2-475d-bdd6-4079e683b8fe tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:13.752112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e02a63af-c3d2-475d-bdd6-4079e683b8fe tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:13.752713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e02a63af-c3d2-475d-bdd6-4079e683b8fe tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:14.183095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e02a63af-c3d2-475d-bdd6-4079e683b8fe tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:14.194493 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e02a63af-c3d2-475d-bdd6-4079e683b8fe tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1683 microversion: 2.1 time: 0.464659 Oct 29 03:18:14.196399 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2598/4989] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:13 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1683 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:15.224775 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-da06275a-caac-4e7d-b56b-4a738c0674d5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:15.225562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-da06275a-caac-4e7d-b56b-4a738c0674d5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:15.242082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da06275a-caac-4e7d-b56b-4a738c0674d5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:15.244499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da06275a-caac-4e7d-b56b-4a738c0674d5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:15.245075 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da06275a-caac-4e7d-b56b-4a738c0674d5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:15.246473 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da06275a-caac-4e7d-b56b-4a738c0674d5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:15.250096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da06275a-caac-4e7d-b56b-4a738c0674d5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:15.250688 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da06275a-caac-4e7d-b56b-4a738c0674d5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:15.752458 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-da06275a-caac-4e7d-b56b-4a738c0674d5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:15.761202 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-da06275a-caac-4e7d-b56b-4a738c0674d5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1683 microversion: 2.1 time: 0.540581 Oct 29 03:18:15.780895 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2392/4990] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:15 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1683 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:18:16.799650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-66071a1c-06dc-4fe7-adfb-41bf288e620d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:16.800479 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-66071a1c-06dc-4fe7-adfb-41bf288e620d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:16.828507 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66071a1c-06dc-4fe7-adfb-41bf288e620d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:16.832281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66071a1c-06dc-4fe7-adfb-41bf288e620d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:16.840514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66071a1c-06dc-4fe7-adfb-41bf288e620d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:16.846980 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66071a1c-06dc-4fe7-adfb-41bf288e620d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:16.855449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66071a1c-06dc-4fe7-adfb-41bf288e620d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:16.861298 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66071a1c-06dc-4fe7-adfb-41bf288e620d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:17.923947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-66071a1c-06dc-4fe7-adfb-41bf288e620d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:17.963527 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-66071a1c-06dc-4fe7-adfb-41bf288e620d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1683 microversion: 2.1 time: 1.157063 Oct 29 03:18:17.969416 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2599/4991] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:16 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1683 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:18.991372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9db3e145-8e2b-42ed-ad25-d5af01835c8f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:18.992947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9db3e145-8e2b-42ed-ad25-d5af01835c8f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:19.020142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9db3e145-8e2b-42ed-ad25-d5af01835c8f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:19.020696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9db3e145-8e2b-42ed-ad25-d5af01835c8f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:19.021137 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9db3e145-8e2b-42ed-ad25-d5af01835c8f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:19.021874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9db3e145-8e2b-42ed-ad25-d5af01835c8f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:19.022336 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9db3e145-8e2b-42ed-ad25-d5af01835c8f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:19.022769 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9db3e145-8e2b-42ed-ad25-d5af01835c8f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:19.510666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9db3e145-8e2b-42ed-ad25-d5af01835c8f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:19.528096 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9db3e145-8e2b-42ed-ad25-d5af01835c8f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.534232 Oct 29 03:18:19.533397 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2393/4992] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:18 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:20.447310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-aca804da-aeba-4e56-8f97-76c6a67ee7da tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:20.448119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-aca804da-aeba-4e56-8f97-76c6a67ee7da tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:20.467438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aca804da-aeba-4e56-8f97-76c6a67ee7da tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:20.467952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aca804da-aeba-4e56-8f97-76c6a67ee7da tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:20.468405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aca804da-aeba-4e56-8f97-76c6a67ee7da tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:20.469169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aca804da-aeba-4e56-8f97-76c6a67ee7da tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:20.475420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aca804da-aeba-4e56-8f97-76c6a67ee7da tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:20.479482 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aca804da-aeba-4e56-8f97-76c6a67ee7da tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:20.917217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-aca804da-aeba-4e56-8f97-76c6a67ee7da tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:20.936985 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-aca804da-aeba-4e56-8f97-76c6a67ee7da tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.493318 Oct 29 03:18:20.947736 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2600/4993] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:20 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:21.509789 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-c07c447e-87ef-4849-9e71-364f81971a96 req-4451cf48-9cb5-4a59-add0-ff15373bdfea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23349ce8-2588-42c9-8de7-90865b56c980", "name": "network-vif-unplugged", "status": "completed", "tag": "26865343-33e7-4622-bd06-ed6191938067"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:18:21.553388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c07c447e-87ef-4849-9e71-364f81971a96 req-4451cf48-9cb5-4a59-add0-ff15373bdfea service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:21.554071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c07c447e-87ef-4849-9e71-364f81971a96 req-4451cf48-9cb5-4a59-add0-ff15373bdfea service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:21.554524 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c07c447e-87ef-4849-9e71-364f81971a96 req-4451cf48-9cb5-4a59-add0-ff15373bdfea service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:21.641888 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-c07c447e-87ef-4849-9e71-364f81971a96 req-4451cf48-9cb5-4a59-add0-ff15373bdfea service nova] Creating event network-vif-unplugged:26865343-33e7-4622-bd06-ed6191938067 for instance 23349ce8-2588-42c9-8de7-90865b56c980 on n-h2-862967-2 Oct 29 03:18:21.679440 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-c07c447e-87ef-4849-9e71-364f81971a96 req-4451cf48-9cb5-4a59-add0-ff15373bdfea service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.172104 Oct 29 03:18:21.682342 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2394/4994] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:18:23.138334 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a3468cfe-47a6-48e4-874b-088af4220289 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:23.138773 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a3468cfe-47a6-48e4-874b-088af4220289 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:23.164950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a3468cfe-47a6-48e4-874b-088af4220289 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:23.173530 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a3468cfe-47a6-48e4-874b-088af4220289 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:23.174114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a3468cfe-47a6-48e4-874b-088af4220289 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:23.174943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a3468cfe-47a6-48e4-874b-088af4220289 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:23.175448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a3468cfe-47a6-48e4-874b-088af4220289 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:23.175892 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a3468cfe-47a6-48e4-874b-088af4220289 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:23.806884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a3468cfe-47a6-48e4-874b-088af4220289 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:23.817142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=64 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:23.829708 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a3468cfe-47a6-48e4-874b-088af4220289 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.701334 Oct 29 03:18:23.831909 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2601/4995] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:23 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:23.865610 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6d743916-a8ec-4b81-a4c7-2350e36d2709 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:23.867055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6d743916-a8ec-4b81-a4c7-2350e36d2709 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:23.884277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=20 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:23.886960 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d743916-a8ec-4b81-a4c7-2350e36d2709 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:23.894250 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d743916-a8ec-4b81-a4c7-2350e36d2709 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:23.896146 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d743916-a8ec-4b81-a4c7-2350e36d2709 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:23.899692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d743916-a8ec-4b81-a4c7-2350e36d2709 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:23.900399 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d743916-a8ec-4b81-a4c7-2350e36d2709 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:23.901945 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d743916-a8ec-4b81-a4c7-2350e36d2709 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:23.962714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=56 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:24.221984 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6d743916-a8ec-4b81-a4c7-2350e36d2709 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:24.230892 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6d743916-a8ec-4b81-a4c7-2350e36d2709 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.374596 Oct 29 03:18:24.236488 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2395/4996] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:23 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:24.259977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4a72e854-9be7-4ad2-b2c9-45512b0c49f6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:24.261352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4a72e854-9be7-4ad2-b2c9-45512b0c49f6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:24.281706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a72e854-9be7-4ad2-b2c9-45512b0c49f6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:24.282209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a72e854-9be7-4ad2-b2c9-45512b0c49f6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:24.282649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a72e854-9be7-4ad2-b2c9-45512b0c49f6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:24.283418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a72e854-9be7-4ad2-b2c9-45512b0c49f6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:24.283804 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a72e854-9be7-4ad2-b2c9-45512b0c49f6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:24.284227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a72e854-9be7-4ad2-b2c9-45512b0c49f6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:24.749726 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4a72e854-9be7-4ad2-b2c9-45512b0c49f6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:24.766472 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4a72e854-9be7-4ad2-b2c9-45512b0c49f6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.506996 Oct 29 03:18:24.769871 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2602/4997] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:24 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:24.801872 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-61b06b84-4d79-40d3-b4f4-0bf7bd92f84f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:18:24.804282 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-61b06b84-4d79-40d3-b4f4-0bf7bd92f84f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:24.814256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61b06b84-4d79-40d3-b4f4-0bf7bd92f84f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:24.817537 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61b06b84-4d79-40d3-b4f4-0bf7bd92f84f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:24.820862 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61b06b84-4d79-40d3-b4f4-0bf7bd92f84f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:24.822124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61b06b84-4d79-40d3-b4f4-0bf7bd92f84f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:24.822981 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61b06b84-4d79-40d3-b4f4-0bf7bd92f84f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:24.824256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61b06b84-4d79-40d3-b4f4-0bf7bd92f84f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:25.028027 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-61b06b84-4d79-40d3-b4f4-0bf7bd92f84f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action" status: 202 len: 0 microversion: 2.1 time: 0.237975 Oct 29 03:18:25.030563 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2396/4998] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:18:24 2022] POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:18:25.045465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6fd0a6f5-18a4-4fb1-b8e4-d27dc445f78c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:25.046114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6fd0a6f5-18a4-4fb1-b8e4-d27dc445f78c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:25.065480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6fd0a6f5-18a4-4fb1-b8e4-d27dc445f78c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:25.068208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6fd0a6f5-18a4-4fb1-b8e4-d27dc445f78c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:25.068685 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6fd0a6f5-18a4-4fb1-b8e4-d27dc445f78c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:25.069415 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6fd0a6f5-18a4-4fb1-b8e4-d27dc445f78c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:25.073145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6fd0a6f5-18a4-4fb1-b8e4-d27dc445f78c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:25.073795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6fd0a6f5-18a4-4fb1-b8e4-d27dc445f78c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:25.815807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6fd0a6f5-18a4-4fb1-b8e4-d27dc445f78c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:25.827021 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6fd0a6f5-18a4-4fb1-b8e4-d27dc445f78c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1672 microversion: 2.1 time: 0.789698 Oct 29 03:18:25.845179 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2603/4999] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:25 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1672 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:26.857592 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1df38fdb-234a-4247-83cb-aed9206c8f42 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:26.858388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1df38fdb-234a-4247-83cb-aed9206c8f42 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:26.886093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1df38fdb-234a-4247-83cb-aed9206c8f42 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:26.887892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1df38fdb-234a-4247-83cb-aed9206c8f42 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:26.888808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1df38fdb-234a-4247-83cb-aed9206c8f42 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:26.891880 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1df38fdb-234a-4247-83cb-aed9206c8f42 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:26.892834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1df38fdb-234a-4247-83cb-aed9206c8f42 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:26.893511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1df38fdb-234a-4247-83cb-aed9206c8f42 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:27.216547 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1df38fdb-234a-4247-83cb-aed9206c8f42 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:27.230505 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1df38fdb-234a-4247-83cb-aed9206c8f42 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1672 microversion: 2.1 time: 0.378156 Oct 29 03:18:27.243343 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2397/5000] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:26 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1672 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:28.263969 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-961a2619-a21a-400f-b153-06f899d0c1a7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:28.265607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-961a2619-a21a-400f-b153-06f899d0c1a7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:28.295422 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-961a2619-a21a-400f-b153-06f899d0c1a7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:28.301912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-961a2619-a21a-400f-b153-06f899d0c1a7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:28.303384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-961a2619-a21a-400f-b153-06f899d0c1a7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:28.305620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-961a2619-a21a-400f-b153-06f899d0c1a7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:28.311131 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-961a2619-a21a-400f-b153-06f899d0c1a7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:28.314784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-961a2619-a21a-400f-b153-06f899d0c1a7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:28.926678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-961a2619-a21a-400f-b153-06f899d0c1a7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:28.937493 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-961a2619-a21a-400f-b153-06f899d0c1a7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1677 microversion: 2.1 time: 0.681512 Oct 29 03:18:28.939619 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2604/5001] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:28 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1677 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:29.981121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e811142c-5264-4071-b4f6-a94e9fe56f69 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:29.981814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e811142c-5264-4071-b4f6-a94e9fe56f69 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:29.994503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e811142c-5264-4071-b4f6-a94e9fe56f69 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:29.995256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e811142c-5264-4071-b4f6-a94e9fe56f69 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:29.997219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e811142c-5264-4071-b4f6-a94e9fe56f69 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:30.000256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e811142c-5264-4071-b4f6-a94e9fe56f69 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:30.001847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e811142c-5264-4071-b4f6-a94e9fe56f69 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:30.004089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e811142c-5264-4071-b4f6-a94e9fe56f69 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:30.464161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e811142c-5264-4071-b4f6-a94e9fe56f69 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:30.476099 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e811142c-5264-4071-b4f6-a94e9fe56f69 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.513463 Oct 29 03:18:30.476809 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2398/5002] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:29 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:30.502662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-288dcec7-14c6-4b2d-bbda-c758f54a1d9e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:18:30.506236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-288dcec7-14c6-4b2d-bbda-c758f54a1d9e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:30.516322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-288dcec7-14c6-4b2d-bbda-c758f54a1d9e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:30.517480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-288dcec7-14c6-4b2d-bbda-c758f54a1d9e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:30.519323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-288dcec7-14c6-4b2d-bbda-c758f54a1d9e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:30.520378 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-288dcec7-14c6-4b2d-bbda-c758f54a1d9e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:30.521272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-288dcec7-14c6-4b2d-bbda-c758f54a1d9e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:30.522873 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-288dcec7-14c6-4b2d-bbda-c758f54a1d9e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:30.597618 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-288dcec7-14c6-4b2d-bbda-c758f54a1d9e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action" status: 200 len: 322 microversion: 2.1 time: 0.096679 Oct 29 03:18:30.599097 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2605/5003] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:18:30 2022] POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action => generated 322 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:18:30.611045 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-19517c7e-8f77-4b2a-af0d-2f02570f7c13 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:30.617978 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-19517c7e-8f77-4b2a-af0d-2f02570f7c13 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:30.659094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19517c7e-8f77-4b2a-af0d-2f02570f7c13 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:30.659826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19517c7e-8f77-4b2a-af0d-2f02570f7c13 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:30.665626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19517c7e-8f77-4b2a-af0d-2f02570f7c13 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:30.667458 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19517c7e-8f77-4b2a-af0d-2f02570f7c13 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:30.667997 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19517c7e-8f77-4b2a-af0d-2f02570f7c13 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:30.668503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19517c7e-8f77-4b2a-af0d-2f02570f7c13 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:30.959221 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-19517c7e-8f77-4b2a-af0d-2f02570f7c13 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:30.974828 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-19517c7e-8f77-4b2a-af0d-2f02570f7c13 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.369645 Oct 29 03:18:30.975999 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2399/5004] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:30 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:31.018175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5c8e9f68-b875-435f-8d41-da66a9441542 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:31.019072 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5c8e9f68-b875-435f-8d41-da66a9441542 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:31.032609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c8e9f68-b875-435f-8d41-da66a9441542 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:31.037371 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c8e9f68-b875-435f-8d41-da66a9441542 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:31.037371 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c8e9f68-b875-435f-8d41-da66a9441542 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:31.037371 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c8e9f68-b875-435f-8d41-da66a9441542 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:31.037371 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c8e9f68-b875-435f-8d41-da66a9441542 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:31.037371 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c8e9f68-b875-435f-8d41-da66a9441542 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:31.366627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5c8e9f68-b875-435f-8d41-da66a9441542 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:31.383808 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5c8e9f68-b875-435f-8d41-da66a9441542 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.370766 Oct 29 03:18:31.388145 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2606/5005] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:31 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:31.421155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c8c4ea71-6cc5-43b3-a7f5-096681f93799 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:31.422442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c8c4ea71-6cc5-43b3-a7f5-096681f93799 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:31.441425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8c4ea71-6cc5-43b3-a7f5-096681f93799 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:31.442142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8c4ea71-6cc5-43b3-a7f5-096681f93799 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:31.442909 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8c4ea71-6cc5-43b3-a7f5-096681f93799 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:31.444152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8c4ea71-6cc5-43b3-a7f5-096681f93799 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:31.445383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8c4ea71-6cc5-43b3-a7f5-096681f93799 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:31.446307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8c4ea71-6cc5-43b3-a7f5-096681f93799 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:31.927738 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c8c4ea71-6cc5-43b3-a7f5-096681f93799 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:31.940290 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c8c4ea71-6cc5-43b3-a7f5-096681f93799 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.525859 Oct 29 03:18:31.941242 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2400/5006] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:31 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:31.965043 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c51d5088-37fa-4986-bd33-87f50ae88fb8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:31.965863 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c51d5088-37fa-4986-bd33-87f50ae88fb8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:31.974427 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c51d5088-37fa-4986-bd33-87f50ae88fb8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:31.974915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c51d5088-37fa-4986-bd33-87f50ae88fb8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:31.975697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c51d5088-37fa-4986-bd33-87f50ae88fb8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:31.976578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c51d5088-37fa-4986-bd33-87f50ae88fb8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:31.979681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c51d5088-37fa-4986-bd33-87f50ae88fb8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:31.980384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c51d5088-37fa-4986-bd33-87f50ae88fb8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:32.274641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c51d5088-37fa-4986-bd33-87f50ae88fb8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:32.275756 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7628ef48-b461-4956-a1e5-ebb25eabbe6f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:32.278428 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7628ef48-b461-4956-a1e5-ebb25eabbe6f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:32.290931 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c51d5088-37fa-4986-bd33-87f50ae88fb8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.328323 Oct 29 03:18:32.299609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7628ef48-b461-4956-a1e5-ebb25eabbe6f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:32.300310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7628ef48-b461-4956-a1e5-ebb25eabbe6f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:32.300880 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7628ef48-b461-4956-a1e5-ebb25eabbe6f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:32.301770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7628ef48-b461-4956-a1e5-ebb25eabbe6f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:32.302324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7628ef48-b461-4956-a1e5-ebb25eabbe6f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:32.302845 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7628ef48-b461-4956-a1e5-ebb25eabbe6f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:32.320457 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2607/5007] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:31 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:32.359495 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7628ef48-b461-4956-a1e5-ebb25eabbe6f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/ips" status: 200 len: 148 microversion: 2.1 time: 0.091935 Oct 29 03:18:32.378792 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2401/5008] 10.222.0.46 () {58 vars in 1248 bytes} [Sat Oct 29 03:18:32 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/ips => generated 148 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:18:32.594082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e805a06e-ebd0-4e84-92f9-57c089b4ef75 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1705676072", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "e565ca97-fa54-4380-a34f-e5c00430d054"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:18:32.771828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-e805a06e-ebd0-4e84-92f9-57c089b4ef75 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] validate_networks() for [('e565ca97-fa54-4380-a34f-e5c00430d054', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:18:33.885492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e805a06e-ebd0-4e84-92f9-57c089b4ef75 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:18:33.886150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e805a06e-ebd0-4e84-92f9-57c089b4ef75 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:18:33.886360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e805a06e-ebd0-4e84-92f9-57c089b4ef75 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:18:33.886764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e805a06e-ebd0-4e84-92f9-57c089b4ef75 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:18:33.887170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e805a06e-ebd0-4e84-92f9-57c089b4ef75 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:18:33.914342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e805a06e-ebd0-4e84-92f9-57c089b4ef75 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:33.916497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e805a06e-ebd0-4e84-92f9-57c089b4ef75 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:33.917223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e805a06e-ebd0-4e84-92f9-57c089b4ef75 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:33.923377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e805a06e-ebd0-4e84-92f9-57c089b4ef75 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:33.924112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e805a06e-ebd0-4e84-92f9-57c089b4ef75 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:33.924791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e805a06e-ebd0-4e84-92f9-57c089b4ef75 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:33.974567 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-e805a06e-ebd0-4e84-92f9-57c089b4ef75 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Getting quotas for project df5fe7cedcd14b61925dc300274b3c70. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:18:33.991984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-e805a06e-ebd0-4e84-92f9-57c089b4ef75 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Getting quotas for user aac411c78a5648be8a1c43893d9a0798 and project df5fe7cedcd14b61925dc300274b3c70. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:18:34.022148 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e805a06e-ebd0-4e84-92f9-57c089b4ef75 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:18:34.029451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e805a06e-ebd0-4e84-92f9-57c089b4ef75 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:18:34.157766 n-d-862967-2 devstack@n-api.service[127124]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e805a06e-ebd0-4e84-92f9-57c089b4ef75 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [57ab3292-8ad1-4d3b-8783-cd63a9c55e8f] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 03:18:35.165504 n-d-862967-2 devstack@n-api.service[127124]: INFO oslo.messaging._drivers.impl_rabbit [None req-e805a06e-ebd0-4e84-92f9-57c089b4ef75 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [57ab3292-8ad1-4d3b-8783-cd63a9c55e8f] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 42968. Oct 29 03:18:35.170816 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e805a06e-ebd0-4e84-92f9-57c089b4ef75 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.585117 Oct 29 03:18:35.172046 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2608/5009] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:18:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:18:35.183328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-693b957a-4deb-462f-b86e-90011304ca04 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:35.183928 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-693b957a-4deb-462f-b86e-90011304ca04 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:35.461909 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-389b0dca-e29b-45f3-b530-6402d4636f66 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a8227d1-1131-4f5f-a8ca-d16b608bc0bc"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:18:35.465263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-389b0dca-e29b-45f3-b530-6402d4636f66 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:35.481519 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-389b0dca-e29b-45f3-b530-6402d4636f66 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:35.483720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-389b0dca-e29b-45f3-b530-6402d4636f66 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:35.484424 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-389b0dca-e29b-45f3-b530-6402d4636f66 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:35.486100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-389b0dca-e29b-45f3-b530-6402d4636f66 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:35.491095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-389b0dca-e29b-45f3-b530-6402d4636f66 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:35.492110 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-389b0dca-e29b-45f3-b530-6402d4636f66 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:35.516722 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-693b957a-4deb-462f-b86e-90011304ca04 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:35.529516 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-693b957a-4deb-462f-b86e-90011304ca04 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1215 microversion: 2.1 time: 0.348983 Oct 29 03:18:35.532925 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2402/5010] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:35 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1215 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:36.115154 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-389b0dca-e29b-45f3-b530-6402d4636f66 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "POST /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.658065 Oct 29 03:18:36.117595 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2609/5011] 10.222.0.46 () {60 vars in 1323 bytes} [Sat Oct 29 03:18:35 2022] POST /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments => generated 194 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:18:36.556672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cbb22268-95b0-4210-b6ab-469d55d93411 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:36.556672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cbb22268-95b0-4210-b6ab-469d55d93411 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:36.746294 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cbb22268-95b0-4210-b6ab-469d55d93411 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:36.757050 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cbb22268-95b0-4210-b6ab-469d55d93411 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1215 microversion: 2.1 time: 0.205017 Oct 29 03:18:36.757970 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2403/5012] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:36 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1215 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:37.794716 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b4e71866-d43c-440f-9a43-af2eb90240f9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:37.796653 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b4e71866-d43c-440f-9a43-af2eb90240f9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:37.943838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b4e71866-d43c-440f-9a43-af2eb90240f9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:37.959601 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b4e71866-d43c-440f-9a43-af2eb90240f9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1215 microversion: 2.1 time: 0.181252 Oct 29 03:18:37.962766 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2610/5013] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:37 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1215 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:38.989225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-62190b24-cb7d-4d3f-9da7-940c69a56eff tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:38.989831 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-62190b24-cb7d-4d3f-9da7-940c69a56eff tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:39.290910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-62190b24-cb7d-4d3f-9da7-940c69a56eff tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:39.301335 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-62190b24-cb7d-4d3f-9da7-940c69a56eff tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1215 microversion: 2.1 time: 0.314972 Oct 29 03:18:39.303918 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2404/5014] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:38 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1215 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:40.328168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-be2dc7a5-ab7c-4ffe-95d3-60e198cffa33 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:40.329526 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-be2dc7a5-ab7c-4ffe-95d3-60e198cffa33 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:40.343371 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be2dc7a5-ab7c-4ffe-95d3-60e198cffa33 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:40.344190 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be2dc7a5-ab7c-4ffe-95d3-60e198cffa33 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:40.346798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be2dc7a5-ab7c-4ffe-95d3-60e198cffa33 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:40.347782 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be2dc7a5-ab7c-4ffe-95d3-60e198cffa33 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:40.349820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be2dc7a5-ab7c-4ffe-95d3-60e198cffa33 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:40.354313 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be2dc7a5-ab7c-4ffe-95d3-60e198cffa33 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:41.527150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-be2dc7a5-ab7c-4ffe-95d3-60e198cffa33 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:41.547152 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-be2dc7a5-ab7c-4ffe-95d3-60e198cffa33 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1275 microversion: 2.1 time: 1.223017 Oct 29 03:18:41.548375 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2611/5015] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:40 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1275 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:42.580836 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-238dd940-bf17-467c-bbe3-5a66d428846a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:42.581812 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-238dd940-bf17-467c-bbe3-5a66d428846a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:42.596491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:42.616317 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-238dd940-bf17-467c-bbe3-5a66d428846a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:42.618060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-238dd940-bf17-467c-bbe3-5a66d428846a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:42.618688 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-238dd940-bf17-467c-bbe3-5a66d428846a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:42.619549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-238dd940-bf17-467c-bbe3-5a66d428846a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:42.620509 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-238dd940-bf17-467c-bbe3-5a66d428846a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:42.622185 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-238dd940-bf17-467c-bbe3-5a66d428846a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:42.856726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-238dd940-bf17-467c-bbe3-5a66d428846a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:42.867655 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-238dd940-bf17-467c-bbe3-5a66d428846a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1273 microversion: 2.1 time: 0.291575 Oct 29 03:18:42.872192 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2405/5016] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:42 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1273 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:43.895057 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4c6bff5a-0618-43db-ac10-eac3814c66cf tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:43.895707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4c6bff5a-0618-43db-ac10-eac3814c66cf tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:43.903853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:43.915325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c6bff5a-0618-43db-ac10-eac3814c66cf tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:43.915877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c6bff5a-0618-43db-ac10-eac3814c66cf tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:43.916325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c6bff5a-0618-43db-ac10-eac3814c66cf tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:43.917075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c6bff5a-0618-43db-ac10-eac3814c66cf tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:43.919454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c6bff5a-0618-43db-ac10-eac3814c66cf tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:43.923147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c6bff5a-0618-43db-ac10-eac3814c66cf tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:43.975455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:44.386448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4c6bff5a-0618-43db-ac10-eac3814c66cf tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:44.395516 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4c6bff5a-0618-43db-ac10-eac3814c66cf tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1315 microversion: 2.1 time: 0.505678 Oct 29 03:18:44.396887 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2612/5017] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:43 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1315 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:45.068042 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-2628c44a-c30b-4578-92f1-04ef2c92b217 req-0a2a24c1-6dff-4e6a-a4cf-f8ab80585a51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d4de7cf-9511-450e-b531-3a9c95494958", "tag": "6ee4d134-5f59-466d-998a-92cc2a06da13"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:18:45.122906 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2628c44a-c30b-4578-92f1-04ef2c92b217 req-0a2a24c1-6dff-4e6a-a4cf-f8ab80585a51 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:45.138358 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2628c44a-c30b-4578-92f1-04ef2c92b217 req-0a2a24c1-6dff-4e6a-a4cf-f8ab80585a51 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:45.142474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2628c44a-c30b-4578-92f1-04ef2c92b217 req-0a2a24c1-6dff-4e6a-a4cf-f8ab80585a51 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:45.210876 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-2628c44a-c30b-4578-92f1-04ef2c92b217 req-0a2a24c1-6dff-4e6a-a4cf-f8ab80585a51 service nova] Creating event network-changed:6ee4d134-5f59-466d-998a-92cc2a06da13 for instance 2d4de7cf-9511-450e-b531-3a9c95494958 on n-h2-862967-2 Oct 29 03:18:45.228839 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-2628c44a-c30b-4578-92f1-04ef2c92b217 req-0a2a24c1-6dff-4e6a-a4cf-f8ab80585a51 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175386 Oct 29 03:18:45.239819 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2406/5018] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:18:45.422106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a88001e5-99cd-4781-9a7d-9e764085ed86 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:45.422670 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a88001e5-99cd-4781-9a7d-9e764085ed86 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:45.453000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a88001e5-99cd-4781-9a7d-9e764085ed86 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:45.460866 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a88001e5-99cd-4781-9a7d-9e764085ed86 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:45.461814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a88001e5-99cd-4781-9a7d-9e764085ed86 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:45.462748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a88001e5-99cd-4781-9a7d-9e764085ed86 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:45.466732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a88001e5-99cd-4781-9a7d-9e764085ed86 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:45.467413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a88001e5-99cd-4781-9a7d-9e764085ed86 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:46.098083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a88001e5-99cd-4781-9a7d-9e764085ed86 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:46.111997 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a88001e5-99cd-4781-9a7d-9e764085ed86 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1315 microversion: 2.1 time: 0.692835 Oct 29 03:18:46.112724 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2613/5019] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:45 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1315 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:47.142453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c333e0bc-c84c-4718-836d-de873f85abd0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:47.143173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c333e0bc-c84c-4718-836d-de873f85abd0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:47.160727 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c333e0bc-c84c-4718-836d-de873f85abd0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:47.161231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c333e0bc-c84c-4718-836d-de873f85abd0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:47.161671 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c333e0bc-c84c-4718-836d-de873f85abd0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:47.162423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c333e0bc-c84c-4718-836d-de873f85abd0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:47.162873 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c333e0bc-c84c-4718-836d-de873f85abd0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:47.170670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c333e0bc-c84c-4718-836d-de873f85abd0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:47.567668 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c333e0bc-c84c-4718-836d-de873f85abd0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:47.578314 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c333e0bc-c84c-4718-836d-de873f85abd0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1315 microversion: 2.1 time: 0.442697 Oct 29 03:18:47.578912 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2407/5020] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:47 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:48.607312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-58387a0b-d4e2-4a6e-bc47-962b51a00968 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:48.608945 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-58387a0b-d4e2-4a6e-bc47-962b51a00968 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:48.619024 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=8 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:48.672832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-58387a0b-d4e2-4a6e-bc47-962b51a00968 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:48.677720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-58387a0b-d4e2-4a6e-bc47-962b51a00968 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:48.679082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-58387a0b-d4e2-4a6e-bc47-962b51a00968 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:48.681012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-58387a0b-d4e2-4a6e-bc47-962b51a00968 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:48.682406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-58387a0b-d4e2-4a6e-bc47-962b51a00968 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:48.683006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-58387a0b-d4e2-4a6e-bc47-962b51a00968 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:49.120368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-58387a0b-d4e2-4a6e-bc47-962b51a00968 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:49.137555 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-58387a0b-d4e2-4a6e-bc47-962b51a00968 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1315 microversion: 2.1 time: 0.536320 Oct 29 03:18:49.163537 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2614/5021] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:48 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1315 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:50.169907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-35b4e56c-cc82-4f96-9cf4-97a03bc82275 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:50.170631 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-35b4e56c-cc82-4f96-9cf4-97a03bc82275 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:50.188093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:50.209977 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35b4e56c-cc82-4f96-9cf4-97a03bc82275 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:50.218977 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35b4e56c-cc82-4f96-9cf4-97a03bc82275 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:50.220162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35b4e56c-cc82-4f96-9cf4-97a03bc82275 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:50.221823 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35b4e56c-cc82-4f96-9cf4-97a03bc82275 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:50.226291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35b4e56c-cc82-4f96-9cf4-97a03bc82275 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:50.226992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35b4e56c-cc82-4f96-9cf4-97a03bc82275 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:50.698420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-35b4e56c-cc82-4f96-9cf4-97a03bc82275 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:50.711164 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-35b4e56c-cc82-4f96-9cf4-97a03bc82275 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1315 microversion: 2.1 time: 0.543673 Oct 29 03:18:50.713309 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2408/5022] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:50 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1315 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:51.741308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-25981139-a614-4473-9bf9-6310631b4fab tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:51.741984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-25981139-a614-4473-9bf9-6310631b4fab tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:51.753560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25981139-a614-4473-9bf9-6310631b4fab tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:51.754064 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25981139-a614-4473-9bf9-6310631b4fab tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:51.754501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25981139-a614-4473-9bf9-6310631b4fab tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:51.755282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25981139-a614-4473-9bf9-6310631b4fab tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:51.755684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25981139-a614-4473-9bf9-6310631b4fab tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:51.756092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25981139-a614-4473-9bf9-6310631b4fab tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:52.077811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-25981139-a614-4473-9bf9-6310631b4fab tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:52.088346 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-25981139-a614-4473-9bf9-6310631b4fab tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1315 microversion: 2.1 time: 0.350964 Oct 29 03:18:52.107968 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2615/5023] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:51 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:52.228897 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-466cf3e7-6aa1-417a-88db-465de1f6276e req-6ce5f63b-6ba2-4df8-a69a-61bd36aad8c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4de7cf-9511-450e-b531-3a9c95494958", "name": "network-vif-plugged", "status": "completed", "tag": "6ee4d134-5f59-466d-998a-92cc2a06da13"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:18:52.271881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-466cf3e7-6aa1-417a-88db-465de1f6276e req-6ce5f63b-6ba2-4df8-a69a-61bd36aad8c3 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:52.275901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-466cf3e7-6aa1-417a-88db-465de1f6276e req-6ce5f63b-6ba2-4df8-a69a-61bd36aad8c3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:52.282751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-466cf3e7-6aa1-417a-88db-465de1f6276e req-6ce5f63b-6ba2-4df8-a69a-61bd36aad8c3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:52.335767 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-466cf3e7-6aa1-417a-88db-465de1f6276e req-6ce5f63b-6ba2-4df8-a69a-61bd36aad8c3 service nova] Creating event network-vif-plugged:6ee4d134-5f59-466d-998a-92cc2a06da13 for instance 2d4de7cf-9511-450e-b531-3a9c95494958 on n-h2-862967-2 Oct 29 03:18:52.357211 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-466cf3e7-6aa1-417a-88db-465de1f6276e req-6ce5f63b-6ba2-4df8-a69a-61bd36aad8c3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.546226 Oct 29 03:18:52.374086 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2409/5024] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:18:53.115181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a84eb4eb-4239-4ed9-9673-0c271ca545af tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:53.115727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a84eb4eb-4239-4ed9-9673-0c271ca545af tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:53.127436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a84eb4eb-4239-4ed9-9673-0c271ca545af tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:53.128012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a84eb4eb-4239-4ed9-9673-0c271ca545af tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:53.128449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a84eb4eb-4239-4ed9-9673-0c271ca545af tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:53.136192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a84eb4eb-4239-4ed9-9673-0c271ca545af tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:53.137919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a84eb4eb-4239-4ed9-9673-0c271ca545af tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:53.138528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a84eb4eb-4239-4ed9-9673-0c271ca545af tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:54.017301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a84eb4eb-4239-4ed9-9673-0c271ca545af tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:54.043982 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a84eb4eb-4239-4ed9-9673-0c271ca545af tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1315 microversion: 2.1 time: 0.929770 Oct 29 03:18:54.047481 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2616/5025] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:53 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1315 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:55.085676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2777708c-2157-409e-821e-70d803778761 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:55.091521 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2777708c-2157-409e-821e-70d803778761 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:55.114084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=36 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:55.121230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2777708c-2157-409e-821e-70d803778761 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:55.125052 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2777708c-2157-409e-821e-70d803778761 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:55.127108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2777708c-2157-409e-821e-70d803778761 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:55.128056 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2777708c-2157-409e-821e-70d803778761 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:55.138794 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2777708c-2157-409e-821e-70d803778761 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:55.139368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2777708c-2157-409e-821e-70d803778761 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:55.602547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d13942b1-69f7-4419-b4e4-bc2b6d3b5bd5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a8227d1-1131-4f5f-a8ca-d16b608bc0bc"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:18:55.605278 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d13942b1-69f7-4419-b4e4-bc2b6d3b5bd5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:55.625538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d13942b1-69f7-4419-b4e4-bc2b6d3b5bd5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:55.627382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d13942b1-69f7-4419-b4e4-bc2b6d3b5bd5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:55.631196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d13942b1-69f7-4419-b4e4-bc2b6d3b5bd5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:55.632929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d13942b1-69f7-4419-b4e4-bc2b6d3b5bd5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:55.634199 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d13942b1-69f7-4419-b4e4-bc2b6d3b5bd5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:55.636094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d13942b1-69f7-4419-b4e4-bc2b6d3b5bd5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:55.649614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:55.911963 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-d13942b1-69f7-4419-b4e4-bc2b6d3b5bd5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] HTTP exception thrown: Invalid volume: volume 8a8227d1-1131-4f5f-a8ca-d16b608bc0bc is already attached to instances: 8356f447-88b7-4047-a578-eb3c1cd24e49 Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d13942b1-69f7-4419-b4e4-bc2b6d3b5bd5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Request method failure captured: Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments HTTP/1.1 Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 74 Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJp-lWXa7bAqr_3cIx72XHiAsdLYD16twUkV-_OiY8rnLVDQQaYoa5MTy-Rf6PU7b1BJZp9_V3gh0A9BPD-pAHEbb2w6qwO87hDTiy2iuRRJAVfin8hEyxtECKBEa_6rf3V6E0wsMuLS1DRhhUPui0KdkBEsp0tJIYHf71qqCJib-MM Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 4c05b5161bd341acb4fc97fa616b3713 Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4c05b5161bd341acb4fc97fa616b3713"}]}] Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 4c05b5161bd341acb4fc97fa616b3713 Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-AttachVolumeNegativeTest-648637356-project Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: e9086760822f48ee921bcdb7bd5ae299 Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-AttachVolumeNegativeTest-648637356-project Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: {"volumeAttachment": {"volumeId": "8a8227d1-1131-4f5f-a8ca-d16b608bc0bc"}} Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: exception: Invalid volume: volume 8a8227d1-1131-4f5f-a8ca-d16b608bc0bc is already attached to instances: 8356f447-88b7-4047-a578-eb3c1cd24e49 Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'server_id': '8356f447-88b7-4047-a578-eb3c1cd24e49', 'body': {'volumeAttachment': {'volumeId': '8a8227d1-1131-4f5f-a8ca-d16b608bc0bc'}}} Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8a8227d1-1131-4f5f-a8ca-d16b608bc0bc is already attached to instances: 8356f447-88b7-4047-a578-eb3c1cd24e49 Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:18:55.932381 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:18:55.937506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:18:55.937506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:18:55.937506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 29 03:18:55.937506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 29 03:18:55.937506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8a8227d1-1131-4f5f-a8ca-d16b608bc0bc is already attached to instances: 8356f447-88b7-4047-a578-eb3c1cd24e49 Oct 29 03:18:55.937506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:18:55.937506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:18:55.937506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:18:55.937506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:18:55.937506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:18:55.937506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:18:55.937506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:18:55.937506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:18:55.937506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8a8227d1-1131-4f5f-a8ca-d16b608bc0bc is already attached to instances: 8356f447-88b7-4047-a578-eb3c1cd24e49 Oct 29 03:18:55.937506 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:18:55.939078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d13942b1-69f7-4419-b4e4-bc2b6d3b5bd5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Returning 400 to user: Invalid volume: volume 8a8227d1-1131-4f5f-a8ca-d16b608bc0bc is already attached to instances: 8356f447-88b7-4047-a578-eb3c1cd24e49 {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:18:55.940706 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d13942b1-69f7-4419-b4e4-bc2b6d3b5bd5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "POST /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.342236 Oct 29 03:18:55.941470 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2617/5026] 10.222.0.46 () {60 vars in 1323 bytes} [Sat Oct 29 03:18:55 2022] POST /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments => generated 174 bytes in 344 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 03:18:56.137138 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9f91dc73-2739-41b5-b318-6a347dff33d8 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:56.137982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9f91dc73-2739-41b5-b318-6a347dff33d8 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:56.147524 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f91dc73-2739-41b5-b318-6a347dff33d8 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:56.153346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f91dc73-2739-41b5-b318-6a347dff33d8 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:56.154074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f91dc73-2739-41b5-b318-6a347dff33d8 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:56.155306 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f91dc73-2739-41b5-b318-6a347dff33d8 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:56.155991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f91dc73-2739-41b5-b318-6a347dff33d8 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:56.156665 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f91dc73-2739-41b5-b318-6a347dff33d8 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:56.406281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-9f91dc73-2739-41b5-b318-6a347dff33d8 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lazy-loading 'services' on Instance uuid 8356f447-88b7-4047-a578-eb3c1cd24e49 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:18:56.632809 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9f91dc73-2739-41b5-b318-6a347dff33d8 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments/8a8227d1-1131-4f5f-a8ca-d16b608bc0bc" status: 202 len: 0 microversion: 2.1 time: 0.495868 Oct 29 03:18:56.661080 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2618/5027] 10.222.0.46 () {58 vars in 1416 bytes} [Sat Oct 29 03:18:56 2022] DELETE /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments/8a8227d1-1131-4f5f-a8ca-d16b608bc0bc => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:18:56.700563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-92fb32d1-da06-4dfa-afe3-a32de44ec376 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:56.724119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-92fb32d1-da06-4dfa-afe3-a32de44ec376 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:56.755598 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92fb32d1-da06-4dfa-afe3-a32de44ec376 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:56.762516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92fb32d1-da06-4dfa-afe3-a32de44ec376 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:56.765053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92fb32d1-da06-4dfa-afe3-a32de44ec376 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:56.766360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92fb32d1-da06-4dfa-afe3-a32de44ec376 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:56.769426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92fb32d1-da06-4dfa-afe3-a32de44ec376 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:56.773783 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92fb32d1-da06-4dfa-afe3-a32de44ec376 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:56.964026 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-92fb32d1-da06-4dfa-afe3-a32de44ec376 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.288888 Oct 29 03:18:56.965206 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2619/5028] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:18:56 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments => generated 197 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:18:57.472830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2777708c-2157-409e-821e-70d803778761 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:57.486322 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2777708c-2157-409e-821e-70d803778761 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1503 microversion: 2.1 time: 2.412404 Oct 29 03:18:57.505831 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2410/5029] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:55 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1503 bytes in 2436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:57.512879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0d21fb1f-f98a-4961-96cb-70ed96dd82c6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:18:57.525082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d21fb1f-f98a-4961-96cb-70ed96dd82c6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:57.529177 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d21fb1f-f98a-4961-96cb-70ed96dd82c6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:57.529850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d21fb1f-f98a-4961-96cb-70ed96dd82c6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:57.581173 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0d21fb1f-f98a-4961-96cb-70ed96dd82c6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Going to try to stop instance {{(pid=127124) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 03:18:57.678413 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0d21fb1f-f98a-4961-96cb-70ed96dd82c6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958/action" status: 202 len: 0 microversion: 2.1 time: 0.171011 Oct 29 03:18:57.680124 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2620/5030] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:18:57 2022] POST /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:18:57.690292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-18ab153e-d136-4f39-9876-332b8e30df46 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:57.691151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-18ab153e-d136-4f39-9876-332b8e30df46 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:57.702540 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18ab153e-d136-4f39-9876-332b8e30df46 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:57.703773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18ab153e-d136-4f39-9876-332b8e30df46 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:57.705178 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18ab153e-d136-4f39-9876-332b8e30df46 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:57.708690 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18ab153e-d136-4f39-9876-332b8e30df46 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:57.713225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18ab153e-d136-4f39-9876-332b8e30df46 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:57.713876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18ab153e-d136-4f39-9876-332b8e30df46 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:57.979212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b2197419-6025-4a5c-a882-df4d072aed43 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:57.981781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b2197419-6025-4a5c-a882-df4d072aed43 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:58.000959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b2197419-6025-4a5c-a882-df4d072aed43 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:58.004227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b2197419-6025-4a5c-a882-df4d072aed43 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:58.005974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b2197419-6025-4a5c-a882-df4d072aed43 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:58.009434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b2197419-6025-4a5c-a882-df4d072aed43 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:58.011461 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b2197419-6025-4a5c-a882-df4d072aed43 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:58.012641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b2197419-6025-4a5c-a882-df4d072aed43 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:58.153576 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b2197419-6025-4a5c-a882-df4d072aed43 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.179667 Oct 29 03:18:58.164383 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2621/5031] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:18:57 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:18:58.256662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-18ab153e-d136-4f39-9876-332b8e30df46 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:18:58.270381 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-18ab153e-d136-4f39-9876-332b8e30df46 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1513 microversion: 2.1 time: 0.583275 Oct 29 03:18:58.286331 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2411/5032] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:57 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1513 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:18:59.181866 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-88f6ea82-b5c9-4c09-a752-79255899572b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:59.185685 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-88f6ea82-b5c9-4c09-a752-79255899572b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:59.216859 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88f6ea82-b5c9-4c09-a752-79255899572b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:59.217628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88f6ea82-b5c9-4c09-a752-79255899572b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:59.225353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88f6ea82-b5c9-4c09-a752-79255899572b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:59.226430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88f6ea82-b5c9-4c09-a752-79255899572b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:59.227071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88f6ea82-b5c9-4c09-a752-79255899572b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:59.227667 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88f6ea82-b5c9-4c09-a752-79255899572b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:59.298316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4a504c6b-33f8-4b55-a116-854bcd683bcd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:18:59.299817 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4a504c6b-33f8-4b55-a116-854bcd683bcd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:18:59.320345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a504c6b-33f8-4b55-a116-854bcd683bcd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:59.323345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a504c6b-33f8-4b55-a116-854bcd683bcd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:59.326342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a504c6b-33f8-4b55-a116-854bcd683bcd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:59.330014 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a504c6b-33f8-4b55-a116-854bcd683bcd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:18:59.332206 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a504c6b-33f8-4b55-a116-854bcd683bcd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:18:59.334839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a504c6b-33f8-4b55-a116-854bcd683bcd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:18:59.344401 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-88f6ea82-b5c9-4c09-a752-79255899572b tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166553 Oct 29 03:18:59.355815 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2622/5033] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:18:59 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:19:00.363342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9eeabc8d-27a0-4660-956f-bec82d57994f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:00.366312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9eeabc8d-27a0-4660-956f-bec82d57994f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:00.383391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4a504c6b-33f8-4b55-a116-854bcd683bcd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:00.384751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9eeabc8d-27a0-4660-956f-bec82d57994f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:00.385257 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9eeabc8d-27a0-4660-956f-bec82d57994f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:00.385704 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9eeabc8d-27a0-4660-956f-bec82d57994f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:00.386470 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9eeabc8d-27a0-4660-956f-bec82d57994f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:00.386879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9eeabc8d-27a0-4660-956f-bec82d57994f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:00.387309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9eeabc8d-27a0-4660-956f-bec82d57994f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:00.397999 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4a504c6b-33f8-4b55-a116-854bcd683bcd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1513 microversion: 2.1 time: 1.104597 Oct 29 03:19:00.400357 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2412/5034] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:59 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1513 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:00.515546 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9eeabc8d-27a0-4660-956f-bec82d57994f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156192 Oct 29 03:19:00.521319 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2623/5035] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:19:00 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:19:01.428759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5a35546d-3e0d-4118-8003-353f153fb403 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:01.430038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5a35546d-3e0d-4118-8003-353f153fb403 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:01.439661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a35546d-3e0d-4118-8003-353f153fb403 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:01.440547 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a35546d-3e0d-4118-8003-353f153fb403 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:01.441227 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a35546d-3e0d-4118-8003-353f153fb403 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:01.442197 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a35546d-3e0d-4118-8003-353f153fb403 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:01.443298 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a35546d-3e0d-4118-8003-353f153fb403 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:01.444078 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a35546d-3e0d-4118-8003-353f153fb403 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:01.536150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c8603675-a13b-490d-84e0-6867a4315cfd tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:01.538745 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c8603675-a13b-490d-84e0-6867a4315cfd tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:01.555710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c8603675-a13b-490d-84e0-6867a4315cfd tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:01.556416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c8603675-a13b-490d-84e0-6867a4315cfd tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:01.557077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c8603675-a13b-490d-84e0-6867a4315cfd tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:01.558120 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c8603675-a13b-490d-84e0-6867a4315cfd tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:01.561080 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c8603675-a13b-490d-84e0-6867a4315cfd tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:01.561727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c8603675-a13b-490d-84e0-6867a4315cfd tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:01.637278 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c8603675-a13b-490d-84e0-6867a4315cfd tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112547 Oct 29 03:19:01.638675 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2624/5036] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:19:01 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:19:01.931848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5a35546d-3e0d-4118-8003-353f153fb403 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:01.944812 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5a35546d-3e0d-4118-8003-353f153fb403 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1513 microversion: 2.1 time: 0.519667 Oct 29 03:19:01.947997 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2413/5037] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:01 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1513 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:02.650749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e966836c-c29a-44ed-99da-0fc438fb63f0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:02.654733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e966836c-c29a-44ed-99da-0fc438fb63f0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:02.674139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e966836c-c29a-44ed-99da-0fc438fb63f0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:02.677832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e966836c-c29a-44ed-99da-0fc438fb63f0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:02.682527 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e966836c-c29a-44ed-99da-0fc438fb63f0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:02.683752 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e966836c-c29a-44ed-99da-0fc438fb63f0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:02.685834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e966836c-c29a-44ed-99da-0fc438fb63f0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:02.686484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e966836c-c29a-44ed-99da-0fc438fb63f0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:02.753061 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e966836c-c29a-44ed-99da-0fc438fb63f0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106201 Oct 29 03:19:02.756585 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2625/5038] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:19:02 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:19:02.970725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8a572e55-7dc3-44f0-8328-3371ea78c5aa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:02.971349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8a572e55-7dc3-44f0-8328-3371ea78c5aa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:02.996235 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a572e55-7dc3-44f0-8328-3371ea78c5aa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:03.000871 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a572e55-7dc3-44f0-8328-3371ea78c5aa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:03.001739 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a572e55-7dc3-44f0-8328-3371ea78c5aa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:03.002723 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a572e55-7dc3-44f0-8328-3371ea78c5aa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:03.003820 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a572e55-7dc3-44f0-8328-3371ea78c5aa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:03.005968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a572e55-7dc3-44f0-8328-3371ea78c5aa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:03.397851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8a572e55-7dc3-44f0-8328-3371ea78c5aa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:03.410899 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8a572e55-7dc3-44f0-8328-3371ea78c5aa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1513 microversion: 2.1 time: 0.445107 Oct 29 03:19:03.411686 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2414/5039] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:02 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1513 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:03.769314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e768c545-42ed-431d-8ba3-c7e5270bb73d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:03.772690 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e768c545-42ed-431d-8ba3-c7e5270bb73d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:03.787304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e768c545-42ed-431d-8ba3-c7e5270bb73d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:03.792431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e768c545-42ed-431d-8ba3-c7e5270bb73d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:03.793318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e768c545-42ed-431d-8ba3-c7e5270bb73d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:03.794228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e768c545-42ed-431d-8ba3-c7e5270bb73d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:03.795047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e768c545-42ed-431d-8ba3-c7e5270bb73d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:03.795653 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e768c545-42ed-431d-8ba3-c7e5270bb73d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:03.930953 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e768c545-42ed-431d-8ba3-c7e5270bb73d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166078 Oct 29 03:19:03.948206 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2626/5040] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:19:03 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:19:04.435423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-abb48e88-62b9-4630-ab49-6e5a49b63252 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:04.436046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-abb48e88-62b9-4630-ab49-6e5a49b63252 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:04.456243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-abb48e88-62b9-4630-ab49-6e5a49b63252 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:04.456765 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-abb48e88-62b9-4630-ab49-6e5a49b63252 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:04.457203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-abb48e88-62b9-4630-ab49-6e5a49b63252 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:04.457907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-abb48e88-62b9-4630-ab49-6e5a49b63252 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:04.458363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-abb48e88-62b9-4630-ab49-6e5a49b63252 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:04.458785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-abb48e88-62b9-4630-ab49-6e5a49b63252 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:04.651558 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-abb48e88-62b9-4630-ab49-6e5a49b63252 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:04.661178 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-abb48e88-62b9-4630-ab49-6e5a49b63252 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1513 microversion: 2.1 time: 0.230639 Oct 29 03:19:04.663332 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2415/5041] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:04 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1513 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:04.965048 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3f51cbf3-c4b5-494f-8905-8425ee52bd71 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:04.971683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3f51cbf3-c4b5-494f-8905-8425ee52bd71 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:04.992463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f51cbf3-c4b5-494f-8905-8425ee52bd71 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:04.993950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f51cbf3-c4b5-494f-8905-8425ee52bd71 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:04.994404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f51cbf3-c4b5-494f-8905-8425ee52bd71 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:04.995176 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f51cbf3-c4b5-494f-8905-8425ee52bd71 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:04.997092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f51cbf3-c4b5-494f-8905-8425ee52bd71 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:04.997538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f51cbf3-c4b5-494f-8905-8425ee52bd71 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:05.065162 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3f51cbf3-c4b5-494f-8905-8425ee52bd71 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114525 Oct 29 03:19:05.066376 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2627/5042] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:19:04 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:19:05.690383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-aed0351d-0e84-4704-b2dd-6ca9b51be09c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:05.696947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-aed0351d-0e84-4704-b2dd-6ca9b51be09c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:05.726518 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aed0351d-0e84-4704-b2dd-6ca9b51be09c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:05.728589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aed0351d-0e84-4704-b2dd-6ca9b51be09c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:05.735458 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aed0351d-0e84-4704-b2dd-6ca9b51be09c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:05.738655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aed0351d-0e84-4704-b2dd-6ca9b51be09c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:05.739208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aed0351d-0e84-4704-b2dd-6ca9b51be09c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:05.741671 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aed0351d-0e84-4704-b2dd-6ca9b51be09c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:06.078543 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-00c01dd3-20ff-4cac-91c7-34d196ec12ee tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:06.084651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-00c01dd3-20ff-4cac-91c7-34d196ec12ee tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:06.111731 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00c01dd3-20ff-4cac-91c7-34d196ec12ee tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:06.114356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00c01dd3-20ff-4cac-91c7-34d196ec12ee tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:06.115193 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00c01dd3-20ff-4cac-91c7-34d196ec12ee tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:06.116472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00c01dd3-20ff-4cac-91c7-34d196ec12ee tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:06.125931 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00c01dd3-20ff-4cac-91c7-34d196ec12ee tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:06.126693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-00c01dd3-20ff-4cac-91c7-34d196ec12ee tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:06.264882 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-00c01dd3-20ff-4cac-91c7-34d196ec12ee tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.190619 Oct 29 03:19:06.266939 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2628/5043] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:19:06 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:19:06.838732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-aed0351d-0e84-4704-b2dd-6ca9b51be09c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:06.854651 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-aed0351d-0e84-4704-b2dd-6ca9b51be09c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1513 microversion: 2.1 time: 1.169314 Oct 29 03:19:06.860187 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2416/5044] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:05 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1513 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:07.566315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-88cb35cd-d617-4e11-8e06-36e87a793eab tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:07.568556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-88cb35cd-d617-4e11-8e06-36e87a793eab tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:07.585872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88cb35cd-d617-4e11-8e06-36e87a793eab tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:07.586377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88cb35cd-d617-4e11-8e06-36e87a793eab tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:07.586819 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88cb35cd-d617-4e11-8e06-36e87a793eab tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:07.587531 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88cb35cd-d617-4e11-8e06-36e87a793eab tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:07.587995 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88cb35cd-d617-4e11-8e06-36e87a793eab tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:07.588421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-88cb35cd-d617-4e11-8e06-36e87a793eab tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:07.655666 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-88cb35cd-d617-4e11-8e06-36e87a793eab tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.378680 Oct 29 03:19:07.662418 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2629/5045] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:19:07 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments => generated 197 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:19:07.884610 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a0dcd169-fa59-4f04-a310-6d381bd56bfd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:07.885397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a0dcd169-fa59-4f04-a310-6d381bd56bfd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:07.896481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a0dcd169-fa59-4f04-a310-6d381bd56bfd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:07.899921 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a0dcd169-fa59-4f04-a310-6d381bd56bfd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:07.900858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a0dcd169-fa59-4f04-a310-6d381bd56bfd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:07.904004 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a0dcd169-fa59-4f04-a310-6d381bd56bfd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:07.905820 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a0dcd169-fa59-4f04-a310-6d381bd56bfd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:07.906685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a0dcd169-fa59-4f04-a310-6d381bd56bfd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:08.673843 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-829bb565-9f27-4baa-9b4e-4e680a5c7225 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:08.676352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-829bb565-9f27-4baa-9b4e-4e680a5c7225 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:08.684481 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-829bb565-9f27-4baa-9b4e-4e680a5c7225 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:08.685271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-829bb565-9f27-4baa-9b4e-4e680a5c7225 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:08.685843 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-829bb565-9f27-4baa-9b4e-4e680a5c7225 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:08.686699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-829bb565-9f27-4baa-9b4e-4e680a5c7225 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:08.687268 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-829bb565-9f27-4baa-9b4e-4e680a5c7225 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:08.687798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-829bb565-9f27-4baa-9b4e-4e680a5c7225 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:08.743591 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-829bb565-9f27-4baa-9b4e-4e680a5c7225 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071095 Oct 29 03:19:08.744981 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2630/5046] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:19:08 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:19:08.927040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a0dcd169-fa59-4f04-a310-6d381bd56bfd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:08.935414 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a0dcd169-fa59-4f04-a310-6d381bd56bfd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1513 microversion: 2.1 time: 1.056014 Oct 29 03:19:08.936113 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2417/5047] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:07 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1513 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:09.758853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b0646a36-7b3a-48ff-922d-7a9efbf9dfd8 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:09.761354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b0646a36-7b3a-48ff-922d-7a9efbf9dfd8 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:09.783155 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0646a36-7b3a-48ff-922d-7a9efbf9dfd8 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:09.787222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0646a36-7b3a-48ff-922d-7a9efbf9dfd8 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:09.788838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0646a36-7b3a-48ff-922d-7a9efbf9dfd8 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:09.790240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0646a36-7b3a-48ff-922d-7a9efbf9dfd8 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:09.793791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0646a36-7b3a-48ff-922d-7a9efbf9dfd8 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:09.798854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0646a36-7b3a-48ff-922d-7a9efbf9dfd8 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:09.885582 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b0646a36-7b3a-48ff-922d-7a9efbf9dfd8 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.132461 Oct 29 03:19:09.886187 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2631/5048] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:19:09 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49/os-volume_attachments => generated 25 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:19:09.959557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9ec69a15-ea56-4faf-83a8-c895b8757f42 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:09.963820 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9ec69a15-ea56-4faf-83a8-c895b8757f42 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:09.982960 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ec69a15-ea56-4faf-83a8-c895b8757f42 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:09.983573 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ec69a15-ea56-4faf-83a8-c895b8757f42 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:09.988736 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ec69a15-ea56-4faf-83a8-c895b8757f42 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:09.989834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ec69a15-ea56-4faf-83a8-c895b8757f42 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:09.990332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ec69a15-ea56-4faf-83a8-c895b8757f42 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:09.990775 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ec69a15-ea56-4faf-83a8-c895b8757f42 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:10.022677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-22230772-f739-4b3e-a4fb-16f45ff0506a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:10.030518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-22230772-f739-4b3e-a4fb-16f45ff0506a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:10.093681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22230772-f739-4b3e-a4fb-16f45ff0506a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:10.095327 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22230772-f739-4b3e-a4fb-16f45ff0506a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:10.101768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22230772-f739-4b3e-a4fb-16f45ff0506a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:10.103363 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22230772-f739-4b3e-a4fb-16f45ff0506a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:10.108440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22230772-f739-4b3e-a4fb-16f45ff0506a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:10.110316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22230772-f739-4b3e-a4fb-16f45ff0506a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:10.127163 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:10.198316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-22230772-f739-4b3e-a4fb-16f45ff0506a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:19:10.376981 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9ec69a15-ea56-4faf-83a8-c895b8757f42 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:10.404797 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9ec69a15-ea56-4faf-83a8-c895b8757f42 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1513 microversion: 2.1 time: 0.440659 Oct 29 03:19:10.404797 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2418/5049] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:09 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1513 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:10.404993 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-22230772-f739-4b3e-a4fb-16f45ff0506a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49" status: 204 len: 0 microversion: 2.1 time: 0.386041 Oct 29 03:19:10.408133 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2632/5050] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:19:10 2022] DELETE /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:19:10.417349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c00554d9-0707-43f4-81b1-138bf797f90a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:10.417970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c00554d9-0707-43f4-81b1-138bf797f90a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:10.440493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c00554d9-0707-43f4-81b1-138bf797f90a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:10.441034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c00554d9-0707-43f4-81b1-138bf797f90a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:10.442683 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c00554d9-0707-43f4-81b1-138bf797f90a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:10.445424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c00554d9-0707-43f4-81b1-138bf797f90a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:10.446124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c00554d9-0707-43f4-81b1-138bf797f90a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:10.446774 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c00554d9-0707-43f4-81b1-138bf797f90a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:11.004623 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c00554d9-0707-43f4-81b1-138bf797f90a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:11.027046 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c00554d9-0707-43f4-81b1-138bf797f90a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49" status: 200 len: 1680 microversion: 2.1 time: 0.616895 Oct 29 03:19:11.029760 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2419/5051] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:10 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 => generated 1680 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:11.423994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dbbe3c1f-a230-489c-82ba-c6e95ee4360f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:11.425458 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dbbe3c1f-a230-489c-82ba-c6e95ee4360f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:11.435791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dbbe3c1f-a230-489c-82ba-c6e95ee4360f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:11.441148 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dbbe3c1f-a230-489c-82ba-c6e95ee4360f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:11.441862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dbbe3c1f-a230-489c-82ba-c6e95ee4360f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:11.442790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dbbe3c1f-a230-489c-82ba-c6e95ee4360f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:11.444883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dbbe3c1f-a230-489c-82ba-c6e95ee4360f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:11.445628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dbbe3c1f-a230-489c-82ba-c6e95ee4360f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:11.647226 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dbbe3c1f-a230-489c-82ba-c6e95ee4360f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:11.658788 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dbbe3c1f-a230-489c-82ba-c6e95ee4360f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1513 microversion: 2.1 time: 0.240831 Oct 29 03:19:11.660330 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2633/5052] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:11 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1513 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:11.746971 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-20afc55b-8702-49a9-b9cf-a8487e07b338 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1754349590", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:11.840382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-20afc55b-8702-49a9-b9cf-a8487e07b338 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] validate_networks() for None {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:19:12.056881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-25352ffe-bb6a-4a2b-a3cc-0c4c4107ea72 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:12.057537 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-25352ffe-bb6a-4a2b-a3cc-0c4c4107ea72 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:12.069308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25352ffe-bb6a-4a2b-a3cc-0c4c4107ea72 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:12.072542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25352ffe-bb6a-4a2b-a3cc-0c4c4107ea72 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:12.073597 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25352ffe-bb6a-4a2b-a3cc-0c4c4107ea72 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:12.077023 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25352ffe-bb6a-4a2b-a3cc-0c4c4107ea72 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:12.077698 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25352ffe-bb6a-4a2b-a3cc-0c4c4107ea72 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:12.078332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25352ffe-bb6a-4a2b-a3cc-0c4c4107ea72 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:12.410013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-25352ffe-bb6a-4a2b-a3cc-0c4c4107ea72 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:12.423027 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-25352ffe-bb6a-4a2b-a3cc-0c4c4107ea72 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49" status: 200 len: 1680 microversion: 2.1 time: 0.369146 Oct 29 03:19:12.437907 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2634/5053] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:12 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 => generated 1680 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:12.651394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-20afc55b-8702-49a9-b9cf-a8487e07b338 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:19:12.653375 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-20afc55b-8702-49a9-b9cf-a8487e07b338 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:19:12.654988 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-20afc55b-8702-49a9-b9cf-a8487e07b338 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:19:12.655714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-20afc55b-8702-49a9-b9cf-a8487e07b338 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:19:12.656689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-20afc55b-8702-49a9-b9cf-a8487e07b338 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:19:12.669248 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20afc55b-8702-49a9-b9cf-a8487e07b338 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:12.670055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20afc55b-8702-49a9-b9cf-a8487e07b338 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:12.670710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20afc55b-8702-49a9-b9cf-a8487e07b338 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:12.671968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20afc55b-8702-49a9-b9cf-a8487e07b338 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:12.672771 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20afc55b-8702-49a9-b9cf-a8487e07b338 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:12.673510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20afc55b-8702-49a9-b9cf-a8487e07b338 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:12.682099 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-141bff82-2131-4663-8bfd-6934410a5367 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:12.682719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-141bff82-2131-4663-8bfd-6934410a5367 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:12.696462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-141bff82-2131-4663-8bfd-6934410a5367 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:12.696997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-141bff82-2131-4663-8bfd-6934410a5367 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:12.697440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-141bff82-2131-4663-8bfd-6934410a5367 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:12.698156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-141bff82-2131-4663-8bfd-6934410a5367 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:12.698610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-141bff82-2131-4663-8bfd-6934410a5367 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:12.699040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-141bff82-2131-4663-8bfd-6934410a5367 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:12.707217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-20afc55b-8702-49a9-b9cf-a8487e07b338 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Getting quotas for project db7fd46462a44bd1a19f4bb82f40c6f8. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:19:12.714138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-20afc55b-8702-49a9-b9cf-a8487e07b338 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Getting quotas for user abec8eabe4424d16b2c971275dbe4fc7 and project db7fd46462a44bd1a19f4bb82f40c6f8. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:19:12.732861 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-20afc55b-8702-49a9-b9cf-a8487e07b338 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:19:12.736632 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-20afc55b-8702-49a9-b9cf-a8487e07b338 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] [instance: cb3109eb-0cf4-42a3-9861-da23557d66f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:19:12.860953 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-20afc55b-8702-49a9-b9cf-a8487e07b338 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.118313 Oct 29 03:19:12.861831 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2420/5054] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:19:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:19:12.901594 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-56ba554a-3d0a-43c2-bd25-4ee69d8f76d4 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:12.903197 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-56ba554a-3d0a-43c2-bd25-4ee69d8f76d4 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] [instance: cb3109eb-0cf4-42a3-9861-da23557d66f8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:13.026133 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-141bff82-2131-4663-8bfd-6934410a5367 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:13.038426 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-141bff82-2131-4663-8bfd-6934410a5367 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1513 microversion: 2.1 time: 0.358545 Oct 29 03:19:13.039793 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2635/5055] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:12 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1513 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:13.144645 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-56ba554a-3d0a-43c2-bd25-4ee69d8f76d4 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abec8eabe4424d16b2c971275dbe4fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7fd46462a44bd1a19f4bb82f40c6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:13.159473 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-56ba554a-3d0a-43c2-bd25-4ee69d8f76d4 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] 10.222.0.46 "GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8" status: 200 len: 1215 microversion: 2.1 time: 0.284510 Oct 29 03:19:13.159983 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2421/5056] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:12 2022] GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8 => generated 1215 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:13.455152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1dbec37a-a600-4b52-af0c-0281aa803dc7 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:13.457338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1dbec37a-a600-4b52-af0c-0281aa803dc7 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:13.479819 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1dbec37a-a600-4b52-af0c-0281aa803dc7 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:13.480562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1dbec37a-a600-4b52-af0c-0281aa803dc7 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:13.481424 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1dbec37a-a600-4b52-af0c-0281aa803dc7 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:13.483402 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1dbec37a-a600-4b52-af0c-0281aa803dc7 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:13.484239 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1dbec37a-a600-4b52-af0c-0281aa803dc7 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:13.485085 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1dbec37a-a600-4b52-af0c-0281aa803dc7 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:13.841564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1dbec37a-a600-4b52-af0c-0281aa803dc7 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:13.850559 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1dbec37a-a600-4b52-af0c-0281aa803dc7 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49" status: 200 len: 1680 microversion: 2.1 time: 0.404053 Oct 29 03:19:13.853365 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2636/5057] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:13 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 => generated 1680 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:14.073309 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a45caedc-0bc6-467e-964e-0064cc68593d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:14.073919 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a45caedc-0bc6-467e-964e-0064cc68593d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:14.085318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a45caedc-0bc6-467e-964e-0064cc68593d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:14.085917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a45caedc-0bc6-467e-964e-0064cc68593d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:14.086247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a45caedc-0bc6-467e-964e-0064cc68593d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:14.090807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a45caedc-0bc6-467e-964e-0064cc68593d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:14.091270 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a45caedc-0bc6-467e-964e-0064cc68593d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:14.091828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a45caedc-0bc6-467e-964e-0064cc68593d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:14.110418 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=85 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:14.185311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2fee31fc-ba96-4ba0-a1e8-73cf21c63f54 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:14.186166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2fee31fc-ba96-4ba0-a1e8-73cf21c63f54 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] [instance: cb3109eb-0cf4-42a3-9861-da23557d66f8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:14.188397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:14.200188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2fee31fc-ba96-4ba0-a1e8-73cf21c63f54 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:14.200873 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2fee31fc-ba96-4ba0-a1e8-73cf21c63f54 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:14.201351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2fee31fc-ba96-4ba0-a1e8-73cf21c63f54 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:14.205909 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2fee31fc-ba96-4ba0-a1e8-73cf21c63f54 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:14.205909 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2fee31fc-ba96-4ba0-a1e8-73cf21c63f54 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:14.210438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2fee31fc-ba96-4ba0-a1e8-73cf21c63f54 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:14.563614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2fee31fc-ba96-4ba0-a1e8-73cf21c63f54 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abec8eabe4424d16b2c971275dbe4fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7fd46462a44bd1a19f4bb82f40c6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:14.588043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a45caedc-0bc6-467e-964e-0064cc68593d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:14.603200 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2fee31fc-ba96-4ba0-a1e8-73cf21c63f54 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] 10.222.0.46 "GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8" status: 200 len: 1211 microversion: 2.1 time: 0.421151 Oct 29 03:19:14.604360 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a45caedc-0bc6-467e-964e-0064cc68593d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1513 microversion: 2.1 time: 0.533339 Oct 29 03:19:14.606510 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2637/5058] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:14 2022] GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8 => generated 1211 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:14.622243 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2422/5059] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:14 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1513 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:14.875598 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-12341e1c-253a-4619-9ac4-1085c9df4841 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:14.876565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-12341e1c-253a-4619-9ac4-1085c9df4841 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:14.896685 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12341e1c-253a-4619-9ac4-1085c9df4841 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:14.897480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12341e1c-253a-4619-9ac4-1085c9df4841 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:14.898163 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12341e1c-253a-4619-9ac4-1085c9df4841 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:14.901900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12341e1c-253a-4619-9ac4-1085c9df4841 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:14.904591 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12341e1c-253a-4619-9ac4-1085c9df4841 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:14.905189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12341e1c-253a-4619-9ac4-1085c9df4841 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:15.262220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-12341e1c-253a-4619-9ac4-1085c9df4841 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:15.287272 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-12341e1c-253a-4619-9ac4-1085c9df4841 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49" status: 200 len: 1613 microversion: 2.1 time: 0.410688 Oct 29 03:19:15.289428 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2638/5060] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:14 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 => generated 1613 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:15.635049 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-602bddbf-da1a-4e68-bb7e-2a6a6b51683c tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:15.636568 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-602bddbf-da1a-4e68-bb7e-2a6a6b51683c tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] [instance: cb3109eb-0cf4-42a3-9861-da23557d66f8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:15.639209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-da4b002a-4d21-44a1-8d7c-be3109102d9a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:15.640646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-da4b002a-4d21-44a1-8d7c-be3109102d9a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:15.656243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-602bddbf-da1a-4e68-bb7e-2a6a6b51683c tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:15.666268 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da4b002a-4d21-44a1-8d7c-be3109102d9a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:15.667240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da4b002a-4d21-44a1-8d7c-be3109102d9a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:15.668814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da4b002a-4d21-44a1-8d7c-be3109102d9a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:15.671465 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-602bddbf-da1a-4e68-bb7e-2a6a6b51683c tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:15.672630 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da4b002a-4d21-44a1-8d7c-be3109102d9a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:15.675206 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da4b002a-4d21-44a1-8d7c-be3109102d9a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:15.677037 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da4b002a-4d21-44a1-8d7c-be3109102d9a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:15.689553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-602bddbf-da1a-4e68-bb7e-2a6a6b51683c tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:15.692294 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-602bddbf-da1a-4e68-bb7e-2a6a6b51683c tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:15.696513 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-602bddbf-da1a-4e68-bb7e-2a6a6b51683c tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:15.697498 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-602bddbf-da1a-4e68-bb7e-2a6a6b51683c tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:15.987807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-602bddbf-da1a-4e68-bb7e-2a6a6b51683c tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abec8eabe4424d16b2c971275dbe4fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7fd46462a44bd1a19f4bb82f40c6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:16.027801 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-602bddbf-da1a-4e68-bb7e-2a6a6b51683c tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] 10.222.0.46 "GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8" status: 200 len: 1273 microversion: 2.1 time: 0.402107 Oct 29 03:19:16.030599 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2423/5061] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:15 2022] GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8 => generated 1273 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:16.114016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-494514aa-7318-4b68-93ee-26d4983a3f9f req-923a95c3-3b65-43a6-850f-b687af40c1f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8356f447-88b7-4047-a578-eb3c1cd24e49", "name": "network-vif-deleted", "tag": "5f0d4892-1602-4f1f-8fec-6840b8340948"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:16.139250 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-494514aa-7318-4b68-93ee-26d4983a3f9f req-923a95c3-3b65-43a6-850f-b687af40c1f6 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:16.140812 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-494514aa-7318-4b68-93ee-26d4983a3f9f req-923a95c3-3b65-43a6-850f-b687af40c1f6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:16.145719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-494514aa-7318-4b68-93ee-26d4983a3f9f req-923a95c3-3b65-43a6-850f-b687af40c1f6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:16.183569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-da4b002a-4d21-44a1-8d7c-be3109102d9a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:16.209205 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-494514aa-7318-4b68-93ee-26d4983a3f9f req-923a95c3-3b65-43a6-850f-b687af40c1f6 service nova] Creating event network-vif-deleted:5f0d4892-1602-4f1f-8fec-6840b8340948 for instance 8356f447-88b7-4047-a578-eb3c1cd24e49 on n-h1-862967-2 Oct 29 03:19:16.210191 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-da4b002a-4d21-44a1-8d7c-be3109102d9a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1513 microversion: 2.1 time: 0.578845 Oct 29 03:19:16.227041 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2639/5062] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:15 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1513 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:19:16.249377 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-494514aa-7318-4b68-93ee-26d4983a3f9f req-923a95c3-3b65-43a6-850f-b687af40c1f6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139662 Oct 29 03:19:16.262675 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2424/5063] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:19:16.319687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c0f8fa21-d741-41dc-a075-43612fd099d5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:16.320428 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c0f8fa21-d741-41dc-a075-43612fd099d5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:16.355984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0f8fa21-d741-41dc-a075-43612fd099d5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:16.356638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0f8fa21-d741-41dc-a075-43612fd099d5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:16.357097 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0f8fa21-d741-41dc-a075-43612fd099d5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:16.357852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0f8fa21-d741-41dc-a075-43612fd099d5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:16.358300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0f8fa21-d741-41dc-a075-43612fd099d5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:16.358723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0f8fa21-d741-41dc-a075-43612fd099d5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:16.489428 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0f8fa21-d741-41dc-a075-43612fd099d5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:16.489924 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0f8fa21-d741-41dc-a075-43612fd099d5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:16.490360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0f8fa21-d741-41dc-a075-43612fd099d5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:16.490818 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-c0f8fa21-d741-41dc-a075-43612fd099d5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lazy-loading 'fault' on Instance uuid 8356f447-88b7-4047-a578-eb3c1cd24e49 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:19:16.843939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c0f8fa21-d741-41dc-a075-43612fd099d5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:16.860850 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c0f8fa21-d741-41dc-a075-43612fd099d5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49" status: 200 len: 1332 microversion: 2.1 time: 0.549996 Oct 29 03:19:16.869843 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2640/5064] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:16 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 => generated 1332 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:17.056799 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-921dcabe-6b07-46d8-a324-3de8972517ce tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:17.058046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-921dcabe-6b07-46d8-a324-3de8972517ce tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] [instance: cb3109eb-0cf4-42a3-9861-da23557d66f8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:17.080085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-921dcabe-6b07-46d8-a324-3de8972517ce tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:17.080616 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-921dcabe-6b07-46d8-a324-3de8972517ce tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:17.081094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-921dcabe-6b07-46d8-a324-3de8972517ce tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:17.081818 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-921dcabe-6b07-46d8-a324-3de8972517ce tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:17.082276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-921dcabe-6b07-46d8-a324-3de8972517ce tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:17.102908 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-921dcabe-6b07-46d8-a324-3de8972517ce tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:17.244279 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1fa3c072-b641-46fc-ab49-9e81dc12050a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:17.245862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1fa3c072-b641-46fc-ab49-9e81dc12050a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:17.276649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fa3c072-b641-46fc-ab49-9e81dc12050a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:17.277163 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fa3c072-b641-46fc-ab49-9e81dc12050a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:17.291275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fa3c072-b641-46fc-ab49-9e81dc12050a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:17.296547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fa3c072-b641-46fc-ab49-9e81dc12050a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:17.321106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fa3c072-b641-46fc-ab49-9e81dc12050a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:17.321754 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fa3c072-b641-46fc-ab49-9e81dc12050a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:17.853144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1fa3c072-b641-46fc-ab49-9e81dc12050a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:17.875374 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1fa3c072-b641-46fc-ab49-9e81dc12050a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1513 microversion: 2.1 time: 0.639086 Oct 29 03:19:17.876636 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2641/5065] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:17 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1513 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:17.894101 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a8b0b457-30e6-483d-b99a-4dbffc26ed73 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:17.895600 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a8b0b457-30e6-483d-b99a-4dbffc26ed73 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:17.920762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8b0b457-30e6-483d-b99a-4dbffc26ed73 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:17.922912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8b0b457-30e6-483d-b99a-4dbffc26ed73 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:17.923618 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8b0b457-30e6-483d-b99a-4dbffc26ed73 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:17.927865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8b0b457-30e6-483d-b99a-4dbffc26ed73 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:17.931091 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8b0b457-30e6-483d-b99a-4dbffc26ed73 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:17.931724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8b0b457-30e6-483d-b99a-4dbffc26ed73 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:17.954134 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-a8b0b457-30e6-483d-b99a-4dbffc26ed73 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] HTTP exception thrown: Instance 8356f447-88b7-4047-a578-eb3c1cd24e49 could not be found. Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a8b0b457-30e6-483d-b99a-4dbffc26ed73 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Request method failure captured: Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 HTTP/1.1 Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJp-lWXa7bAqr_3cIx72XHiAsdLYD16twUkV-_OiY8rnLVDQQaYoa5MTy-Rf6PU7b1BJZp9_V3gh0A9BPD-pAHEbb2w6qwO87hDTiy2iuRRJAVfin8hEyxtECKBEa_6rf3V6E0wsMuLS1DRhhUPui0KdkBEsp0tJIYHf71qqCJib-MM Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 4c05b5161bd341acb4fc97fa616b3713 Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4c05b5161bd341acb4fc97fa616b3713"}]}] Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 4c05b5161bd341acb4fc97fa616b3713 Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-AttachVolumeNegativeTest-648637356-project Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: e9086760822f48ee921bcdb7bd5ae299 Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-AttachVolumeNegativeTest-648637356-project Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 8356f447-88b7-4047-a578-eb3c1cd24e49 could not be found. Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '8356f447-88b7-4047-a578-eb3c1cd24e49'} Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8356f447-88b7-4047-a578-eb3c1cd24e49 could not be found. Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8356f447-88b7-4047-a578-eb3c1cd24e49 could not be found. Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:19:17.959181 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:19:17.963511 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:19:17.963511 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:19:17.963511 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:19:17.963511 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:19:17.963511 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:19:17.963511 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8356f447-88b7-4047-a578-eb3c1cd24e49 could not be found. Oct 29 03:19:17.963511 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:19:17.967842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a8b0b457-30e6-483d-b99a-4dbffc26ed73 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Returning 404 to user: Instance 8356f447-88b7-4047-a578-eb3c1cd24e49 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:19:17.969398 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a8b0b457-30e6-483d-b99a-4dbffc26ed73 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49" status: 404 len: 111 microversion: 2.1 time: 0.079586 Oct 29 03:19:17.970232 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2642/5066] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:17 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:19:17.981074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4d3e56a4-8d54-478c-b02d-3f21dda709d0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '.version_select at 0x7ff05c1a9af0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:18.011780 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4d3e56a4-8d54-478c-b02d-3f21dda709d0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1844444409" status: 202 len: 0 microversion: 2.1 time: 0.034376 Oct 29 03:19:18.012859 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2643/5067] 10.222.0.46 () {58 vars in 1221 bytes} [Sat Oct 29 03:19:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1844444409 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:19:18.683501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-921dcabe-6b07-46d8-a324-3de8972517ce tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abec8eabe4424d16b2c971275dbe4fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7fd46462a44bd1a19f4bb82f40c6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:18.692400 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-921dcabe-6b07-46d8-a324-3de8972517ce tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] 10.222.0.46 "GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8" status: 200 len: 1315 microversion: 2.1 time: 1.640718 Oct 29 03:19:18.696821 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2425/5068] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:17 2022] GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8 => generated 1315 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:18.904121 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-604571f6-08ca-4001-a6a4-3493da3dbf7c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:18.909399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-604571f6-08ca-4001-a6a4-3493da3dbf7c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:18.937075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-604571f6-08ca-4001-a6a4-3493da3dbf7c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:18.937583 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-604571f6-08ca-4001-a6a4-3493da3dbf7c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:18.940949 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-604571f6-08ca-4001-a6a4-3493da3dbf7c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:18.942055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-604571f6-08ca-4001-a6a4-3493da3dbf7c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:18.942650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-604571f6-08ca-4001-a6a4-3493da3dbf7c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:18.943091 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-604571f6-08ca-4001-a6a4-3493da3dbf7c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:19.504514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-604571f6-08ca-4001-a6a4-3493da3dbf7c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:19.515552 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-604571f6-08ca-4001-a6a4-3493da3dbf7c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1513 microversion: 2.1 time: 0.616374 Oct 29 03:19:19.517041 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2644/5069] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:18 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1513 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:19.554836 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8ca651eb-51a4-4fb8-8075-00b1395af174 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Action: 'create', calling method: .version_select at 0x7ff053616d30>, body: {"keypair": {"name": "tempest-keypair-674371434", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQWYQvRfGHb96khOHwQSGH+f/Gu0dElRkG+Sra1f9tennEfaq1aIv1+TUbue0SYsjQF0dtOECqkPwZcLQq5aCO6+WFklm7SGJsLYWTTaSKRHXqGIIsq0UR3oX1Qd9V6cw=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:19.583100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-8ca651eb-51a4-4fb8-8075-00b1395af174 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Getting quotas for project 4c05b5161bd341acb4fc97fa616b3713. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:19:19.590003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-8ca651eb-51a4-4fb8-8075-00b1395af174 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Getting quotas for user e9086760822f48ee921bcdb7bd5ae299 and project 4c05b5161bd341acb4fc97fa616b3713. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:19:19.618090 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8ca651eb-51a4-4fb8-8075-00b1395af174 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.068345 Oct 29 03:19:19.622580 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2426/5070] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:19:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:19:19.719394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a9d184d9-ff6d-40b5-9388-642d38bf9937 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:19.720464 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a9d184d9-ff6d-40b5-9388-642d38bf9937 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] [instance: cb3109eb-0cf4-42a3-9861-da23557d66f8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:19.733998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9d184d9-ff6d-40b5-9388-642d38bf9937 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:19.734537 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9d184d9-ff6d-40b5-9388-642d38bf9937 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:19.734985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9d184d9-ff6d-40b5-9388-642d38bf9937 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:19.735744 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9d184d9-ff6d-40b5-9388-642d38bf9937 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:19.736194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9d184d9-ff6d-40b5-9388-642d38bf9937 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:19.737351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9d184d9-ff6d-40b5-9388-642d38bf9937 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:20.013262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a9d184d9-ff6d-40b5-9388-642d38bf9937 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abec8eabe4424d16b2c971275dbe4fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7fd46462a44bd1a19f4bb82f40c6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:20.027494 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a9d184d9-ff6d-40b5-9388-642d38bf9937 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] 10.222.0.46 "GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8" status: 200 len: 1315 microversion: 2.1 time: 0.311817 Oct 29 03:19:20.029144 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2645/5071] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:19 2022] GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:20.540752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2e994813-959e-4420-92da-9efed68433f7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:20.541380 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2e994813-959e-4420-92da-9efed68433f7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:20.555672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e994813-959e-4420-92da-9efed68433f7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:20.558709 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e994813-959e-4420-92da-9efed68433f7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:20.559386 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e994813-959e-4420-92da-9efed68433f7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:20.560252 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e994813-959e-4420-92da-9efed68433f7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:20.564344 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e994813-959e-4420-92da-9efed68433f7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:20.564949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e994813-959e-4420-92da-9efed68433f7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:20.680039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-187d1a59-30d9-47d4-b398-51cbbe09a47e req-b6aec38f-57d4-42fa-854c-486d235ca8db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb3109eb-0cf4-42a3-9861-da23557d66f8", "tag": "7fdabec7-5756-4bcf-b809-c088951cde1f"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:20.712459 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-187d1a59-30d9-47d4-b398-51cbbe09a47e req-b6aec38f-57d4-42fa-854c-486d235ca8db service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:20.713492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-187d1a59-30d9-47d4-b398-51cbbe09a47e req-b6aec38f-57d4-42fa-854c-486d235ca8db service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:20.715715 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-187d1a59-30d9-47d4-b398-51cbbe09a47e req-b6aec38f-57d4-42fa-854c-486d235ca8db service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:20.744499 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-187d1a59-30d9-47d4-b398-51cbbe09a47e req-b6aec38f-57d4-42fa-854c-486d235ca8db service nova] Creating event network-changed:7fdabec7-5756-4bcf-b809-c088951cde1f for instance cb3109eb-0cf4-42a3-9861-da23557d66f8 on n-h1-862967-2 Oct 29 03:19:20.772324 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-187d1a59-30d9-47d4-b398-51cbbe09a47e req-b6aec38f-57d4-42fa-854c-486d235ca8db service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104206 Oct 29 03:19:20.776512 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2646/5072] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:19:21.065018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4e75fbf5-df9d-4449-a969-4f95bce28f9b tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:21.066028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4e75fbf5-df9d-4449-a969-4f95bce28f9b tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] [instance: cb3109eb-0cf4-42a3-9861-da23557d66f8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:21.080839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e75fbf5-df9d-4449-a969-4f95bce28f9b tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:21.081389 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e75fbf5-df9d-4449-a969-4f95bce28f9b tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:21.084495 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e75fbf5-df9d-4449-a969-4f95bce28f9b tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:21.087594 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e75fbf5-df9d-4449-a969-4f95bce28f9b tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:21.088079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e75fbf5-df9d-4449-a969-4f95bce28f9b tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:21.090820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e75fbf5-df9d-4449-a969-4f95bce28f9b tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:21.283680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2e994813-959e-4420-92da-9efed68433f7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:21.293339 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2e994813-959e-4420-92da-9efed68433f7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1513 microversion: 2.1 time: 0.756229 Oct 29 03:19:21.298035 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2427/5073] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:20 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1513 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:21.981541 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4e75fbf5-df9d-4449-a969-4f95bce28f9b tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abec8eabe4424d16b2c971275dbe4fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7fd46462a44bd1a19f4bb82f40c6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:21.995861 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4e75fbf5-df9d-4449-a969-4f95bce28f9b tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] 10.222.0.46 "GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8" status: 200 len: 1315 microversion: 2.1 time: 0.935879 Oct 29 03:19:21.997010 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2647/5074] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:21 2022] GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8 => generated 1315 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:19:22.324343 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d249837e-93bd-42c2-8df1-33632ed44feb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:22.324990 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d249837e-93bd-42c2-8df1-33632ed44feb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:22.342646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d249837e-93bd-42c2-8df1-33632ed44feb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:22.343141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d249837e-93bd-42c2-8df1-33632ed44feb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:22.346160 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d249837e-93bd-42c2-8df1-33632ed44feb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:22.348325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d249837e-93bd-42c2-8df1-33632ed44feb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:22.348841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d249837e-93bd-42c2-8df1-33632ed44feb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:22.349281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d249837e-93bd-42c2-8df1-33632ed44feb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:22.692075 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:23.023906 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d249837e-93bd-42c2-8df1-33632ed44feb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:23.027318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1827bc1f-6638-4706-b469-55c3bf891ac2 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:23.032439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1827bc1f-6638-4706-b469-55c3bf891ac2 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] [instance: cb3109eb-0cf4-42a3-9861-da23557d66f8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:23.047416 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d249837e-93bd-42c2-8df1-33632ed44feb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1513 microversion: 2.1 time: 0.727469 Oct 29 03:19:23.055216 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2428/5075] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:22 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1513 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:23.056723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1827bc1f-6638-4706-b469-55c3bf891ac2 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:23.065280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1827bc1f-6638-4706-b469-55c3bf891ac2 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:23.066161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1827bc1f-6638-4706-b469-55c3bf891ac2 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:23.081684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1827bc1f-6638-4706-b469-55c3bf891ac2 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:23.082105 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1827bc1f-6638-4706-b469-55c3bf891ac2 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:23.082551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1827bc1f-6638-4706-b469-55c3bf891ac2 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:23.678065 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1827bc1f-6638-4706-b469-55c3bf891ac2 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abec8eabe4424d16b2c971275dbe4fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7fd46462a44bd1a19f4bb82f40c6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:23.695658 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1827bc1f-6638-4706-b469-55c3bf891ac2 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] 10.222.0.46 "GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8" status: 200 len: 1315 microversion: 2.1 time: 0.675919 Oct 29 03:19:23.711193 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2648/5076] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:23 2022] GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8 => generated 1315 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:24.084056 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-108719cd-7428-49a4-a689-e410e980d0d9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:24.085660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-108719cd-7428-49a4-a689-e410e980d0d9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:24.103095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-108719cd-7428-49a4-a689-e410e980d0d9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:24.104613 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-108719cd-7428-49a4-a689-e410e980d0d9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:24.107953 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-108719cd-7428-49a4-a689-e410e980d0d9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:24.111595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-108719cd-7428-49a4-a689-e410e980d0d9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:24.112636 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-108719cd-7428-49a4-a689-e410e980d0d9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:24.113253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-108719cd-7428-49a4-a689-e410e980d0d9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:24.419063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-108719cd-7428-49a4-a689-e410e980d0d9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:24.428733 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-108719cd-7428-49a4-a689-e410e980d0d9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1513 microversion: 2.1 time: 0.350006 Oct 29 03:19:24.432886 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2429/5077] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:24 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1513 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:24.663049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-589ecead-18d0-4aa9-b64d-61dc38ef0f19 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-217936977", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2930b46-8565-462a-9f64-b9b374f3c23b"}], "security_groups": [{"name": "tempest-securitygroup--1360668005"}], "key_name": "tempest-keypair-674371434", "user_data": "}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:24.722614 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-81e16f2a-0de1-428e-ac2f-91335b998f5b tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:24.723587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-81e16f2a-0de1-428e-ac2f-91335b998f5b tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] [instance: cb3109eb-0cf4-42a3-9861-da23557d66f8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:24.737299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-81e16f2a-0de1-428e-ac2f-91335b998f5b tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:24.741917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-81e16f2a-0de1-428e-ac2f-91335b998f5b tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:24.742607 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-81e16f2a-0de1-428e-ac2f-91335b998f5b tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:24.743508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-81e16f2a-0de1-428e-ac2f-91335b998f5b tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:24.754319 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-81e16f2a-0de1-428e-ac2f-91335b998f5b tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:24.754841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-81e16f2a-0de1-428e-ac2f-91335b998f5b tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:24.903506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-589ecead-18d0-4aa9-b64d-61dc38ef0f19 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] validate_networks() for [('e2930b46-8565-462a-9f64-b9b374f3c23b', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:19:24.956987 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-81e16f2a-0de1-428e-ac2f-91335b998f5b tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abec8eabe4424d16b2c971275dbe4fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7fd46462a44bd1a19f4bb82f40c6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:24.971010 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-81e16f2a-0de1-428e-ac2f-91335b998f5b tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] 10.222.0.46 "GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8" status: 200 len: 1315 microversion: 2.1 time: 0.252402 Oct 29 03:19:24.972665 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2430/5078] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:24 2022] GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:19:25.458928 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1f944eb1-37da-4865-b961-24ddfb523a58 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:25.459671 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1f944eb1-37da-4865-b961-24ddfb523a58 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:25.462697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:25.478696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f944eb1-37da-4865-b961-24ddfb523a58 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:25.480270 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f944eb1-37da-4865-b961-24ddfb523a58 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:25.484229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f944eb1-37da-4865-b961-24ddfb523a58 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:25.484229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f944eb1-37da-4865-b961-24ddfb523a58 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:25.484229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f944eb1-37da-4865-b961-24ddfb523a58 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:25.485548 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f944eb1-37da-4865-b961-24ddfb523a58 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:25.921716 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-589ecead-18d0-4aa9-b64d-61dc38ef0f19 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:19:25.922208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-589ecead-18d0-4aa9-b64d-61dc38ef0f19 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:19:25.922591 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-589ecead-18d0-4aa9-b64d-61dc38ef0f19 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:19:25.922990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-589ecead-18d0-4aa9-b64d-61dc38ef0f19 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:19:25.923588 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-589ecead-18d0-4aa9-b64d-61dc38ef0f19 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:19:25.933342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-589ecead-18d0-4aa9-b64d-61dc38ef0f19 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:25.934098 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-589ecead-18d0-4aa9-b64d-61dc38ef0f19 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:25.934706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-589ecead-18d0-4aa9-b64d-61dc38ef0f19 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:25.935426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-589ecead-18d0-4aa9-b64d-61dc38ef0f19 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:25.936035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-589ecead-18d0-4aa9-b64d-61dc38ef0f19 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:25.936631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-589ecead-18d0-4aa9-b64d-61dc38ef0f19 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:25.959072 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:25.980071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-589ecead-18d0-4aa9-b64d-61dc38ef0f19 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Getting quotas for project 4c05b5161bd341acb4fc97fa616b3713. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:19:25.991298 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-589ecead-18d0-4aa9-b64d-61dc38ef0f19 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Getting quotas for user e9086760822f48ee921bcdb7bd5ae299 and project 4c05b5161bd341acb4fc97fa616b3713. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:19:25.993577 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1f944eb1-37da-4865-b961-24ddfb523a58 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:26.006768 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1f944eb1-37da-4865-b961-24ddfb523a58 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1513 microversion: 2.1 time: 0.553086 Oct 29 03:19:26.008084 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2431/5079] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:25 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1513 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:26.015041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f1823545-f615-480d-b6b6-0601bf6eccdf tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:26.016504 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f1823545-f615-480d-b6b6-0601bf6eccdf tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] [instance: cb3109eb-0cf4-42a3-9861-da23557d66f8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:26.028467 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-589ecead-18d0-4aa9-b64d-61dc38ef0f19 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:19:26.030871 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-589ecead-18d0-4aa9-b64d-61dc38ef0f19 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:19:26.038271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1823545-f615-480d-b6b6-0601bf6eccdf tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:26.043425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1823545-f615-480d-b6b6-0601bf6eccdf tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:26.045089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1823545-f615-480d-b6b6-0601bf6eccdf tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:26.046804 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1823545-f615-480d-b6b6-0601bf6eccdf tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:26.049037 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1823545-f615-480d-b6b6-0601bf6eccdf tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:26.052998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1823545-f615-480d-b6b6-0601bf6eccdf tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:26.126447 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-589ecead-18d0-4aa9-b64d-61dc38ef0f19 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.468813 Oct 29 03:19:26.134535 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2649/5080] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:19:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 1478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:19:26.139829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-aca97cc9-c581-4845-8c27-598015464395 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:26.140778 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-aca97cc9-c581-4845-8c27-598015464395 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:26.303751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-aca97cc9-c581-4845-8c27-598015464395 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:26.313582 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-aca97cc9-c581-4845-8c27-598015464395 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0" status: 200 len: 1240 microversion: 2.1 time: 0.175950 Oct 29 03:19:26.315573 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2650/5081] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:26 2022] GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0 => generated 1240 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:26.463692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f1823545-f615-480d-b6b6-0601bf6eccdf tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abec8eabe4424d16b2c971275dbe4fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7fd46462a44bd1a19f4bb82f40c6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:26.482002 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f1823545-f615-480d-b6b6-0601bf6eccdf tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] 10.222.0.46 "GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8" status: 200 len: 1315 microversion: 2.1 time: 0.469898 Oct 29 03:19:26.482835 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2432/5082] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:26 2022] GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8 => generated 1315 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:27.033513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dfc9e747-4d3d-48ce-8187-8d55b1c49ec9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:27.034288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dfc9e747-4d3d-48ce-8187-8d55b1c49ec9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:27.050716 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfc9e747-4d3d-48ce-8187-8d55b1c49ec9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:27.051484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfc9e747-4d3d-48ce-8187-8d55b1c49ec9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:27.052832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfc9e747-4d3d-48ce-8187-8d55b1c49ec9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:27.053784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfc9e747-4d3d-48ce-8187-8d55b1c49ec9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:27.054662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfc9e747-4d3d-48ce-8187-8d55b1c49ec9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:27.055347 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfc9e747-4d3d-48ce-8187-8d55b1c49ec9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:27.056464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-041dce16-0008-40b8-b702-bddd63171eb8 req-4449819e-df35-48c9-bef9-57828fa26d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb3109eb-0cf4-42a3-9861-da23557d66f8", "name": "network-vif-plugged", "status": "completed", "tag": "7fdabec7-5756-4bcf-b809-c088951cde1f"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:27.085406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-041dce16-0008-40b8-b702-bddd63171eb8 req-4449819e-df35-48c9-bef9-57828fa26d32 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:27.089037 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-041dce16-0008-40b8-b702-bddd63171eb8 req-4449819e-df35-48c9-bef9-57828fa26d32 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:27.093222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-041dce16-0008-40b8-b702-bddd63171eb8 req-4449819e-df35-48c9-bef9-57828fa26d32 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:27.132216 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-041dce16-0008-40b8-b702-bddd63171eb8 req-4449819e-df35-48c9-bef9-57828fa26d32 service nova] Creating event network-vif-plugged:7fdabec7-5756-4bcf-b809-c088951cde1f for instance cb3109eb-0cf4-42a3-9861-da23557d66f8 on n-h1-862967-2 Oct 29 03:19:27.145631 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-041dce16-0008-40b8-b702-bddd63171eb8 req-4449819e-df35-48c9-bef9-57828fa26d32 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099585 Oct 29 03:19:27.148255 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2433/5083] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:19:27.341301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a5119b18-075e-450a-9523-40724ee42c49 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:27.342662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a5119b18-075e-450a-9523-40724ee42c49 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:27.357481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a5119b18-075e-450a-9523-40724ee42c49 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:27.358703 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a5119b18-075e-450a-9523-40724ee42c49 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:27.359448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a5119b18-075e-450a-9523-40724ee42c49 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:27.360360 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a5119b18-075e-450a-9523-40724ee42c49 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:27.361317 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a5119b18-075e-450a-9523-40724ee42c49 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:27.362019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a5119b18-075e-450a-9523-40724ee42c49 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:27.420821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dfc9e747-4d3d-48ce-8187-8d55b1c49ec9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:27.432220 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dfc9e747-4d3d-48ce-8187-8d55b1c49ec9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1513 microversion: 2.1 time: 0.404242 Oct 29 03:19:27.440794 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2651/5084] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:27 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1513 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:27.509648 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1fedfe10-02cd-48c5-8b7c-bb3185e3b196 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:27.510424 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1fedfe10-02cd-48c5-8b7c-bb3185e3b196 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] [instance: cb3109eb-0cf4-42a3-9861-da23557d66f8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:27.526425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fedfe10-02cd-48c5-8b7c-bb3185e3b196 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:27.526922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fedfe10-02cd-48c5-8b7c-bb3185e3b196 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:27.527414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fedfe10-02cd-48c5-8b7c-bb3185e3b196 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:27.528062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fedfe10-02cd-48c5-8b7c-bb3185e3b196 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:27.528725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fedfe10-02cd-48c5-8b7c-bb3185e3b196 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:27.529308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fedfe10-02cd-48c5-8b7c-bb3185e3b196 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:27.565549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a5119b18-075e-450a-9523-40724ee42c49 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:27.573295 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a5119b18-075e-450a-9523-40724ee42c49 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0" status: 200 len: 1292 microversion: 2.1 time: 0.237902 Oct 29 03:19:27.573880 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2434/5085] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:27 2022] GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0 => generated 1292 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:27.788691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1fedfe10-02cd-48c5-8b7c-bb3185e3b196 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abec8eabe4424d16b2c971275dbe4fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7fd46462a44bd1a19f4bb82f40c6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:27.798026 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1fedfe10-02cd-48c5-8b7c-bb3185e3b196 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] 10.222.0.46 "GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8" status: 200 len: 1315 microversion: 2.1 time: 0.292137 Oct 29 03:19:27.799109 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2652/5086] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:27 2022] GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:28.466666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-be504165-eb28-45aa-87a5-1f2d705ae8b5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:28.467593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-be504165-eb28-45aa-87a5-1f2d705ae8b5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:28.476987 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be504165-eb28-45aa-87a5-1f2d705ae8b5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:28.477721 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be504165-eb28-45aa-87a5-1f2d705ae8b5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:28.478155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be504165-eb28-45aa-87a5-1f2d705ae8b5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:28.478892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be504165-eb28-45aa-87a5-1f2d705ae8b5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:28.479610 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be504165-eb28-45aa-87a5-1f2d705ae8b5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:28.479878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be504165-eb28-45aa-87a5-1f2d705ae8b5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:28.600000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ce66044d-a5e7-4524-9c22-b470cab6f0d1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:28.600650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ce66044d-a5e7-4524-9c22-b470cab6f0d1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:28.611812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce66044d-a5e7-4524-9c22-b470cab6f0d1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:28.613918 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce66044d-a5e7-4524-9c22-b470cab6f0d1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:28.616122 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce66044d-a5e7-4524-9c22-b470cab6f0d1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:28.619036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce66044d-a5e7-4524-9c22-b470cab6f0d1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:28.620696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce66044d-a5e7-4524-9c22-b470cab6f0d1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:28.622941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce66044d-a5e7-4524-9c22-b470cab6f0d1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:28.744363 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ce66044d-a5e7-4524-9c22-b470cab6f0d1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:28.758208 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ce66044d-a5e7-4524-9c22-b470cab6f0d1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0" status: 200 len: 1310 microversion: 2.1 time: 0.160981 Oct 29 03:19:28.772555 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2653/5087] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:28 2022] GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0 => generated 1310 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:19:28.823199 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-61bba8c2-3c2e-4194-910a-4786fe675a14 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:28.824019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-61bba8c2-3c2e-4194-910a-4786fe675a14 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] [instance: cb3109eb-0cf4-42a3-9861-da23557d66f8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:28.834425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-61bba8c2-3c2e-4194-910a-4786fe675a14 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:28.836199 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-61bba8c2-3c2e-4194-910a-4786fe675a14 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:28.838490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-61bba8c2-3c2e-4194-910a-4786fe675a14 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:28.839641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-61bba8c2-3c2e-4194-910a-4786fe675a14 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:28.841303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-61bba8c2-3c2e-4194-910a-4786fe675a14 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:28.842021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-61bba8c2-3c2e-4194-910a-4786fe675a14 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:28.914843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-be504165-eb28-45aa-87a5-1f2d705ae8b5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:28.930608 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-be504165-eb28-45aa-87a5-1f2d705ae8b5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1490 microversion: 2.1 time: 0.472763 Oct 29 03:19:28.952072 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2435/5088] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:28 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1490 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:28.963670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d6fccc5b-4006-4157-890b-297b0a0c2541 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:28.982451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d6fccc5b-4006-4157-890b-297b0a0c2541 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:29.003947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6fccc5b-4006-4157-890b-297b0a0c2541 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:29.005278 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6fccc5b-4006-4157-890b-297b0a0c2541 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:29.005938 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6fccc5b-4006-4157-890b-297b0a0c2541 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:29.009288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6fccc5b-4006-4157-890b-297b0a0c2541 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:29.011151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6fccc5b-4006-4157-890b-297b0a0c2541 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:29.012286 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6fccc5b-4006-4157-890b-297b0a0c2541 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:29.090750 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d6fccc5b-4006-4157-890b-297b0a0c2541 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action" status: 200 len: 133 microversion: 2.1 time: 0.136230 Oct 29 03:19:29.093974 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2436/5089] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:19:28 2022] POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action => generated 133 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:19:29.104327 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d0ed152c-91a3-49b4-83ba-3f5b10f78558 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:29.105376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d0ed152c-91a3-49b4-83ba-3f5b10f78558 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:29.116289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0ed152c-91a3-49b4-83ba-3f5b10f78558 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:29.117056 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0ed152c-91a3-49b4-83ba-3f5b10f78558 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:29.117667 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0ed152c-91a3-49b4-83ba-3f5b10f78558 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:29.118791 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0ed152c-91a3-49b4-83ba-3f5b10f78558 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:29.119710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0ed152c-91a3-49b4-83ba-3f5b10f78558 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:29.120308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0ed152c-91a3-49b4-83ba-3f5b10f78558 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:29.122069 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-61bba8c2-3c2e-4194-910a-4786fe675a14 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abec8eabe4424d16b2c971275dbe4fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7fd46462a44bd1a19f4bb82f40c6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:29.144912 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-61bba8c2-3c2e-4194-910a-4786fe675a14 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] 10.222.0.46 "GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8" status: 200 len: 1315 microversion: 2.1 time: 0.323843 Oct 29 03:19:29.146224 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2654/5090] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:28 2022] GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8 => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:29.423048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d0ed152c-91a3-49b4-83ba-3f5b10f78558 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:29.433518 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d0ed152c-91a3-49b4-83ba-3f5b10f78558 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.334208 Oct 29 03:19:29.448847 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2437/5091] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:29 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:29.465003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-02234353-7291-4899-b4f2-a3224e5acad2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:29.465815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-02234353-7291-4899-b4f2-a3224e5acad2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:29.471982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02234353-7291-4899-b4f2-a3224e5acad2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:29.472730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02234353-7291-4899-b4f2-a3224e5acad2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:29.473323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02234353-7291-4899-b4f2-a3224e5acad2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:29.474190 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02234353-7291-4899-b4f2-a3224e5acad2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:29.474801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02234353-7291-4899-b4f2-a3224e5acad2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:29.475423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02234353-7291-4899-b4f2-a3224e5acad2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:29.666734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-02234353-7291-4899-b4f2-a3224e5acad2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:29.679529 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-02234353-7291-4899-b4f2-a3224e5acad2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.218425 Oct 29 03:19:29.692639 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2655/5092] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:29 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:29.703570 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1ab0de03-4d0b-4d1b-9be1-f7bf402e28cc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:29.704189 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1ab0de03-4d0b-4d1b-9be1-f7bf402e28cc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:29.707673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=12 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:29.720718 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ab0de03-4d0b-4d1b-9be1-f7bf402e28cc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:29.721248 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ab0de03-4d0b-4d1b-9be1-f7bf402e28cc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:29.722264 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ab0de03-4d0b-4d1b-9be1-f7bf402e28cc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:29.723005 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ab0de03-4d0b-4d1b-9be1-f7bf402e28cc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:29.723996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ab0de03-4d0b-4d1b-9be1-f7bf402e28cc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:29.724511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ab0de03-4d0b-4d1b-9be1-f7bf402e28cc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:29.782793 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-af8523e3-ab3f-4187-b6e4-bdff27466450 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:29.783793 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-af8523e3-ab3f-4187-b6e4-bdff27466450 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:29.791408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af8523e3-ab3f-4187-b6e4-bdff27466450 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:29.792919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af8523e3-ab3f-4187-b6e4-bdff27466450 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:29.794905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af8523e3-ab3f-4187-b6e4-bdff27466450 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:29.795798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af8523e3-ab3f-4187-b6e4-bdff27466450 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:29.796415 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af8523e3-ab3f-4187-b6e4-bdff27466450 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:29.797050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-af8523e3-ab3f-4187-b6e4-bdff27466450 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:29.876174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-af8523e3-ab3f-4187-b6e4-bdff27466450 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:29.884835 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-af8523e3-ab3f-4187-b6e4-bdff27466450 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0" status: 200 len: 1298 microversion: 2.1 time: 0.105936 Oct 29 03:19:29.892757 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2656/5093] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:29 2022] GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0 => generated 1298 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:30.154436 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1ab0de03-4d0b-4d1b-9be1-f7bf402e28cc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:30.164166 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1ab0de03-4d0b-4d1b-9be1-f7bf402e28cc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.464426 Oct 29 03:19:30.171796 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0dde01ed-72bc-45c0-91a7-e31fe72aa0f2 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:30.172419 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0dde01ed-72bc-45c0-91a7-e31fe72aa0f2 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] [instance: cb3109eb-0cf4-42a3-9861-da23557d66f8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:30.181005 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2438/5094] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:29 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:30.203720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0dde01ed-72bc-45c0-91a7-e31fe72aa0f2 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:30.209944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5bf2a4ef-fe7f-47e9-adae-4f5513caf0b6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:30.210472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0dde01ed-72bc-45c0-91a7-e31fe72aa0f2 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:30.211325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0dde01ed-72bc-45c0-91a7-e31fe72aa0f2 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:30.213359 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0dde01ed-72bc-45c0-91a7-e31fe72aa0f2 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:30.214011 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0dde01ed-72bc-45c0-91a7-e31fe72aa0f2 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:30.216409 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0dde01ed-72bc-45c0-91a7-e31fe72aa0f2 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:30.217473 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5bf2a4ef-fe7f-47e9-adae-4f5513caf0b6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:30.237065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5bf2a4ef-fe7f-47e9-adae-4f5513caf0b6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:30.238390 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5bf2a4ef-fe7f-47e9-adae-4f5513caf0b6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:30.240598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5bf2a4ef-fe7f-47e9-adae-4f5513caf0b6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:30.241561 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5bf2a4ef-fe7f-47e9-adae-4f5513caf0b6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:30.247326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5bf2a4ef-fe7f-47e9-adae-4f5513caf0b6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:30.248003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5bf2a4ef-fe7f-47e9-adae-4f5513caf0b6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:30.547919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0dde01ed-72bc-45c0-91a7-e31fe72aa0f2 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abec8eabe4424d16b2c971275dbe4fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7fd46462a44bd1a19f4bb82f40c6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:30.559564 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0dde01ed-72bc-45c0-91a7-e31fe72aa0f2 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] 10.222.0.46 "GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8" status: 200 len: 1465 microversion: 2.1 time: 0.392897 Oct 29 03:19:30.560376 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2657/5095] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:30 2022] GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8 => generated 1465 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:30.650841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bcb07fba-47e0-4b81-a5f2-e463736524e0 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:30.651348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bcb07fba-47e0-4b81-a5f2-e463736524e0 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] [instance: cb3109eb-0cf4-42a3-9861-da23557d66f8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:30.662580 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bcb07fba-47e0-4b81-a5f2-e463736524e0 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:30.663609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bcb07fba-47e0-4b81-a5f2-e463736524e0 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:30.664807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bcb07fba-47e0-4b81-a5f2-e463736524e0 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:30.669874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bcb07fba-47e0-4b81-a5f2-e463736524e0 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:30.670463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bcb07fba-47e0-4b81-a5f2-e463736524e0 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:30.671221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bcb07fba-47e0-4b81-a5f2-e463736524e0 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:30.712449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bcb07fba-47e0-4b81-a5f2-e463736524e0 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] [instance: cb3109eb-0cf4-42a3-9861-da23557d66f8] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:19:30.738284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5bf2a4ef-fe7f-47e9-adae-4f5513caf0b6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:30.747194 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5bf2a4ef-fe7f-47e9-adae-4f5513caf0b6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.541417 Oct 29 03:19:30.747792 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2439/5096] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:30 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:30.856898 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bcb07fba-47e0-4b81-a5f2-e463736524e0 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8" status: 204 len: 0 microversion: 2.1 time: 0.210370 Oct 29 03:19:30.857897 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2658/5097] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:19:30 2022] DELETE /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 03:19:30.874088 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-04f02d8a-9371-44d7-9f0c-835044ec1e09 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:30.875094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-04f02d8a-9371-44d7-9f0c-835044ec1e09 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] [instance: cb3109eb-0cf4-42a3-9861-da23557d66f8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:30.898770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04f02d8a-9371-44d7-9f0c-835044ec1e09 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:30.899648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04f02d8a-9371-44d7-9f0c-835044ec1e09 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:30.900261 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04f02d8a-9371-44d7-9f0c-835044ec1e09 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:30.901343 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04f02d8a-9371-44d7-9f0c-835044ec1e09 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:30.903009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04f02d8a-9371-44d7-9f0c-835044ec1e09 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:30.903962 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04f02d8a-9371-44d7-9f0c-835044ec1e09 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:30.909767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2f32ae38-4e8a-4ea5-89a4-f9986cddddaf tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:30.911785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2f32ae38-4e8a-4ea5-89a4-f9986cddddaf tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:30.927120 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f32ae38-4e8a-4ea5-89a4-f9986cddddaf tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:30.928611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f32ae38-4e8a-4ea5-89a4-f9986cddddaf tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:30.930390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f32ae38-4e8a-4ea5-89a4-f9986cddddaf tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:30.932228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f32ae38-4e8a-4ea5-89a4-f9986cddddaf tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:30.933649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f32ae38-4e8a-4ea5-89a4-f9986cddddaf tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:30.935626 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f32ae38-4e8a-4ea5-89a4-f9986cddddaf tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:31.174575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2f32ae38-4e8a-4ea5-89a4-f9986cddddaf tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:31.191127 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2f32ae38-4e8a-4ea5-89a4-f9986cddddaf tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0" status: 200 len: 1366 microversion: 2.1 time: 0.287032 Oct 29 03:19:31.192944 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2659/5098] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:30 2022] GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0 => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:19:31.213240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5b689802-4c9d-4baa-96a3-5956b9e5eba0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-467331015", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "e565ca97-fa54-4380-a34f-e5c00430d054"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:31.315454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-04f02d8a-9371-44d7-9f0c-835044ec1e09 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abec8eabe4424d16b2c971275dbe4fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7fd46462a44bd1a19f4bb82f40c6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:31.319267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-5b689802-4c9d-4baa-96a3-5956b9e5eba0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] validate_networks() for [('e565ca97-fa54-4380-a34f-e5c00430d054', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:19:31.326716 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-04f02d8a-9371-44d7-9f0c-835044ec1e09 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] 10.222.0.46 "GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8" status: 200 len: 1471 microversion: 2.1 time: 0.463461 Oct 29 03:19:31.337190 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2440/5099] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:30 2022] GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8 => generated 1471 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:31.913516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-5b689802-4c9d-4baa-96a3-5956b9e5eba0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:19:31.914091 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-5b689802-4c9d-4baa-96a3-5956b9e5eba0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:19:31.914393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-5b689802-4c9d-4baa-96a3-5956b9e5eba0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:19:31.914797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-5b689802-4c9d-4baa-96a3-5956b9e5eba0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:19:31.915202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-5b689802-4c9d-4baa-96a3-5956b9e5eba0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:19:31.949767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b689802-4c9d-4baa-96a3-5956b9e5eba0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:31.950269 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b689802-4c9d-4baa-96a3-5956b9e5eba0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:31.950806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b689802-4c9d-4baa-96a3-5956b9e5eba0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:31.951844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b689802-4c9d-4baa-96a3-5956b9e5eba0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:31.952723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b689802-4c9d-4baa-96a3-5956b9e5eba0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:31.955635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b689802-4c9d-4baa-96a3-5956b9e5eba0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:31.983052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-5b689802-4c9d-4baa-96a3-5956b9e5eba0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Getting quotas for project df5fe7cedcd14b61925dc300274b3c70. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:19:31.992785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-5b689802-4c9d-4baa-96a3-5956b9e5eba0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Getting quotas for user aac411c78a5648be8a1c43893d9a0798 and project df5fe7cedcd14b61925dc300274b3c70. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:19:32.013073 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5b689802-4c9d-4baa-96a3-5956b9e5eba0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:19:32.015845 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5b689802-4c9d-4baa-96a3-5956b9e5eba0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:19:32.103551 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5b689802-4c9d-4baa-96a3-5956b9e5eba0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.908798 Oct 29 03:19:32.104981 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2660/5100] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:19:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:19:32.119441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-06e1d252-fc71-4139-a2c8-26ef26b5c83e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:32.120196 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-06e1d252-fc71-4139-a2c8-26ef26b5c83e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:32.191584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-5d81f6f5-8b11-4015-976a-374a0dbe7598 req-5daf9c6c-277f-4a90-bb19-142c29d7a4f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5efc47a-1e03-4d14-bc60-5d3f067a89d0", "tag": "f10311b9-c69d-4c20-96a9-543008cc1a15"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:32.206059 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5d81f6f5-8b11-4015-976a-374a0dbe7598 req-5daf9c6c-277f-4a90-bb19-142c29d7a4f2 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:32.208966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5d81f6f5-8b11-4015-976a-374a0dbe7598 req-5daf9c6c-277f-4a90-bb19-142c29d7a4f2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:32.210317 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5d81f6f5-8b11-4015-976a-374a0dbe7598 req-5daf9c6c-277f-4a90-bb19-142c29d7a4f2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:32.236465 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-5d81f6f5-8b11-4015-976a-374a0dbe7598 req-5daf9c6c-277f-4a90-bb19-142c29d7a4f2 service nova] Creating event network-changed:f10311b9-c69d-4c20-96a9-543008cc1a15 for instance d5efc47a-1e03-4d14-bc60-5d3f067a89d0 on n-h1-862967-2 Oct 29 03:19:32.246874 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-5d81f6f5-8b11-4015-976a-374a0dbe7598 req-5daf9c6c-277f-4a90-bb19-142c29d7a4f2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061751 Oct 29 03:19:32.247743 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2661/5101] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:19:32.257051 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-77b855ed-de69-4f77-a353-61e6d723effc tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:32.258032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-77b855ed-de69-4f77-a353-61e6d723effc tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:32.271533 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-77b855ed-de69-4f77-a353-61e6d723effc tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:32.272174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-77b855ed-de69-4f77-a353-61e6d723effc tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:32.272657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-77b855ed-de69-4f77-a353-61e6d723effc tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:32.273426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-77b855ed-de69-4f77-a353-61e6d723effc tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:32.273992 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-77b855ed-de69-4f77-a353-61e6d723effc tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:32.274425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-77b855ed-de69-4f77-a353-61e6d723effc tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:32.560141 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-77b855ed-de69-4f77-a353-61e6d723effc tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:32.569062 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-77b855ed-de69-4f77-a353-61e6d723effc tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0" status: 200 len: 1366 microversion: 2.1 time: 0.318709 Oct 29 03:19:32.570722 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2662/5102] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:32 2022] GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0 => generated 1366 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:32.575548 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-263696cc-f27b-432c-a1fe-52a3090d583b tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:32.576163 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-263696cc-f27b-432c-a1fe-52a3090d583b tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] [instance: cb3109eb-0cf4-42a3-9861-da23557d66f8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:32.583709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-263696cc-f27b-432c-a1fe-52a3090d583b tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:32.583956 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-263696cc-f27b-432c-a1fe-52a3090d583b tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:32.584325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-263696cc-f27b-432c-a1fe-52a3090d583b tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:32.585096 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-263696cc-f27b-432c-a1fe-52a3090d583b tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:32.585554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-263696cc-f27b-432c-a1fe-52a3090d583b tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:32.585979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-263696cc-f27b-432c-a1fe-52a3090d583b tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:32.667217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-06e1d252-fc71-4139-a2c8-26ef26b5c83e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:32.680761 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-06e1d252-fc71-4139-a2c8-26ef26b5c83e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92" status: 200 len: 1214 microversion: 2.1 time: 0.565552 Oct 29 03:19:32.681369 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2441/5103] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:32 2022] GET /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92 => generated 1214 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:19:32.842402 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-263696cc-f27b-432c-a1fe-52a3090d583b tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abec8eabe4424d16b2c971275dbe4fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7fd46462a44bd1a19f4bb82f40c6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:32.853895 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-263696cc-f27b-432c-a1fe-52a3090d583b tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] 10.222.0.46 "GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8" status: 200 len: 1471 microversion: 2.1 time: 0.281819 Oct 29 03:19:32.869852 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2663/5104] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:32 2022] GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8 => generated 1471 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:33.604842 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-22b455cf-06fa-43bb-befb-e8320f9e7580 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:33.604842 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-22b455cf-06fa-43bb-befb-e8320f9e7580 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:33.625410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22b455cf-06fa-43bb-befb-e8320f9e7580 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:33.625915 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22b455cf-06fa-43bb-befb-e8320f9e7580 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:33.626352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22b455cf-06fa-43bb-befb-e8320f9e7580 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:33.628017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22b455cf-06fa-43bb-befb-e8320f9e7580 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:33.633261 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22b455cf-06fa-43bb-befb-e8320f9e7580 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:33.634466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22b455cf-06fa-43bb-befb-e8320f9e7580 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:33.665517 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:33.706014 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-aa58071e-770c-4155-b91e-d62aa65600ff tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:33.707437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-aa58071e-770c-4155-b91e-d62aa65600ff tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:33.718631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aa58071e-770c-4155-b91e-d62aa65600ff tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:33.721083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aa58071e-770c-4155-b91e-d62aa65600ff tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:33.721806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aa58071e-770c-4155-b91e-d62aa65600ff tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:33.723007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aa58071e-770c-4155-b91e-d62aa65600ff tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:33.723727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aa58071e-770c-4155-b91e-d62aa65600ff tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:33.724508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aa58071e-770c-4155-b91e-d62aa65600ff tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:33.820790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-aa58071e-770c-4155-b91e-d62aa65600ff tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:33.832489 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-aa58071e-770c-4155-b91e-d62aa65600ff tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92" status: 200 len: 1266 microversion: 2.1 time: 0.130968 Oct 29 03:19:33.833856 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2664/5105] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:33 2022] GET /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92 => generated 1266 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:19:33.884843 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-30f8985d-76ec-47ea-8114-d9b83f3755c3 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:33.885878 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-30f8985d-76ec-47ea-8114-d9b83f3755c3 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] [instance: cb3109eb-0cf4-42a3-9861-da23557d66f8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:33.900281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30f8985d-76ec-47ea-8114-d9b83f3755c3 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:33.902643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30f8985d-76ec-47ea-8114-d9b83f3755c3 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:33.903426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30f8985d-76ec-47ea-8114-d9b83f3755c3 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:33.908025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30f8985d-76ec-47ea-8114-d9b83f3755c3 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:33.909154 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30f8985d-76ec-47ea-8114-d9b83f3755c3 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:33.911948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30f8985d-76ec-47ea-8114-d9b83f3755c3 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:34.101893 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-22b455cf-06fa-43bb-befb-e8320f9e7580 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:34.115587 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-22b455cf-06fa-43bb-befb-e8320f9e7580 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0" status: 200 len: 1366 microversion: 2.1 time: 0.517207 Oct 29 03:19:34.122053 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2442/5106] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:33 2022] GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0 => generated 1366 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:34.558113 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-dc6915f8-3841-42f8-b8b9-c44999217a8a req-d8e1ab01-bbf6-4ea8-8ce0-d4528545b6f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb3109eb-0cf4-42a3-9861-da23557d66f8", "name": "network-vif-deleted", "tag": "7fdabec7-5756-4bcf-b809-c088951cde1f"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:34.570994 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-dc6915f8-3841-42f8-b8b9-c44999217a8a req-d8e1ab01-bbf6-4ea8-8ce0-d4528545b6f2 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:34.572182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-dc6915f8-3841-42f8-b8b9-c44999217a8a req-d8e1ab01-bbf6-4ea8-8ce0-d4528545b6f2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:34.573421 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-dc6915f8-3841-42f8-b8b9-c44999217a8a req-d8e1ab01-bbf6-4ea8-8ce0-d4528545b6f2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:34.591565 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-dc6915f8-3841-42f8-b8b9-c44999217a8a req-d8e1ab01-bbf6-4ea8-8ce0-d4528545b6f2 service nova] Creating event network-vif-deleted:7fdabec7-5756-4bcf-b809-c088951cde1f for instance cb3109eb-0cf4-42a3-9861-da23557d66f8 on n-h1-862967-2 Oct 29 03:19:34.602459 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-dc6915f8-3841-42f8-b8b9-c44999217a8a req-d8e1ab01-bbf6-4ea8-8ce0-d4528545b6f2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045891 Oct 29 03:19:34.603546 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2443/5107] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:19:34.670453 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-30f8985d-76ec-47ea-8114-d9b83f3755c3 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abec8eabe4424d16b2c971275dbe4fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7fd46462a44bd1a19f4bb82f40c6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:34.691377 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-30f8985d-76ec-47ea-8114-d9b83f3755c3 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] 10.222.0.46 "GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8" status: 200 len: 1471 microversion: 2.1 time: 0.812307 Oct 29 03:19:34.693499 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2665/5108] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:33 2022] GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8 => generated 1471 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:19:34.859268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-eb95f78e-d1d8-4d22-8432-00b2289be391 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:34.860567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-eb95f78e-d1d8-4d22-8432-00b2289be391 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:34.869402 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb95f78e-d1d8-4d22-8432-00b2289be391 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:34.870345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb95f78e-d1d8-4d22-8432-00b2289be391 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:34.870988 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb95f78e-d1d8-4d22-8432-00b2289be391 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:34.872255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb95f78e-d1d8-4d22-8432-00b2289be391 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:34.872966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb95f78e-d1d8-4d22-8432-00b2289be391 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:34.873972 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb95f78e-d1d8-4d22-8432-00b2289be391 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:35.025982 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-eb95f78e-d1d8-4d22-8432-00b2289be391 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:35.039561 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-eb95f78e-d1d8-4d22-8432-00b2289be391 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92" status: 200 len: 1272 microversion: 2.1 time: 0.186558 Oct 29 03:19:35.040660 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2444/5109] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:34 2022] GET /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92 => generated 1272 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:35.148071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3638abba-be88-4b18-b6ec-3e26204dccf5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:35.149040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3638abba-be88-4b18-b6ec-3e26204dccf5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:35.157907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3638abba-be88-4b18-b6ec-3e26204dccf5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:35.158427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3638abba-be88-4b18-b6ec-3e26204dccf5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:35.162949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3638abba-be88-4b18-b6ec-3e26204dccf5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:35.163769 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3638abba-be88-4b18-b6ec-3e26204dccf5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:35.164235 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3638abba-be88-4b18-b6ec-3e26204dccf5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:35.165655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3638abba-be88-4b18-b6ec-3e26204dccf5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:35.484680 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b5cefa0b-3058-4bdc-95f2-fd14dd9a6c62 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Action: 'create', calling method: .version_select at 0x7ff05c230280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-266528313", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHpUZQ4eAX8ghN+QId9dySPkvFfcWvG8bbfDDkCpowLklvG80iIYczRwLXg+HRBoS9aWogZ0S+1wCkxzFdQGuHOXu1KVrxSUYi1GZ2D8ntpvYvxCV/7mpnBUf16+Kgq4g=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:35.490681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:35.532251 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-b5cefa0b-3058-4bdc-95f2-fd14dd9a6c62 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Getting quotas for project c898299eb0444aa1a1983fb127153c65. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:19:35.540011 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-b5cefa0b-3058-4bdc-95f2-fd14dd9a6c62 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Getting quotas for user 789295d938084ee3b7d618690fee5bfa and project c898299eb0444aa1a1983fb127153c65. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:19:35.583543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3638abba-be88-4b18-b6ec-3e26204dccf5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:35.591643 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b5cefa0b-3058-4bdc-95f2-fd14dd9a6c62 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.545592 Oct 29 03:19:35.593788 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2666/5110] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:19:35 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:19:35.597111 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3638abba-be88-4b18-b6ec-3e26204dccf5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0" status: 200 len: 1366 microversion: 2.1 time: 0.451691 Oct 29 03:19:35.598298 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2445/5111] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:35 2022] GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0 => generated 1366 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:35.721470 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-20d8a9b1-3de2-48a3-a435-92a616e1f7fb tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:35.722152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-20d8a9b1-3de2-48a3-a435-92a616e1f7fb tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] [instance: cb3109eb-0cf4-42a3-9861-da23557d66f8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:35.777803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20d8a9b1-3de2-48a3-a435-92a616e1f7fb tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:35.778326 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20d8a9b1-3de2-48a3-a435-92a616e1f7fb tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:35.778776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20d8a9b1-3de2-48a3-a435-92a616e1f7fb tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:35.779520 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20d8a9b1-3de2-48a3-a435-92a616e1f7fb tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:35.779974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20d8a9b1-3de2-48a3-a435-92a616e1f7fb tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:35.780400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20d8a9b1-3de2-48a3-a435-92a616e1f7fb tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:35.918937 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20d8a9b1-3de2-48a3-a435-92a616e1f7fb tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:35.920251 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20d8a9b1-3de2-48a3-a435-92a616e1f7fb tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:35.921628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20d8a9b1-3de2-48a3-a435-92a616e1f7fb tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:35.922387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-20d8a9b1-3de2-48a3-a435-92a616e1f7fb tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lazy-loading 'fault' on Instance uuid cb3109eb-0cf4-42a3-9861-da23557d66f8 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:19:36.024756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-20d8a9b1-3de2-48a3-a435-92a616e1f7fb tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abec8eabe4424d16b2c971275dbe4fc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db7fd46462a44bd1a19f4bb82f40c6f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:36.027078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:36.054028 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-20d8a9b1-3de2-48a3-a435-92a616e1f7fb tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] 10.222.0.46 "GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8" status: 200 len: 1305 microversion: 2.1 time: 0.336806 Oct 29 03:19:36.055545 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2667/5112] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:35 2022] GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8 => generated 1305 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:36.070638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8f235b06-3801-42a4-a827-99c9b99fe4b6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:36.071306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8f235b06-3801-42a4-a827-99c9b99fe4b6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:36.089648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f235b06-3801-42a4-a827-99c9b99fe4b6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:36.090122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f235b06-3801-42a4-a827-99c9b99fe4b6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:36.090567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f235b06-3801-42a4-a827-99c9b99fe4b6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:36.091290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f235b06-3801-42a4-a827-99c9b99fe4b6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:36.091756 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f235b06-3801-42a4-a827-99c9b99fe4b6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:36.092224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f235b06-3801-42a4-a827-99c9b99fe4b6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:36.521823 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8f235b06-3801-42a4-a827-99c9b99fe4b6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:36.538213 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8f235b06-3801-42a4-a827-99c9b99fe4b6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92" status: 200 len: 1314 microversion: 2.1 time: 0.476772 Oct 29 03:19:36.560746 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2446/5113] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:36 2022] GET /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92 => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:36.624111 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c0d83ad3-0c38-4380-b514-5ebeb3b252c9 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:36.625051 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c0d83ad3-0c38-4380-b514-5ebeb3b252c9 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:36.639471 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0d83ad3-0c38-4380-b514-5ebeb3b252c9 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:36.641652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0d83ad3-0c38-4380-b514-5ebeb3b252c9 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:36.642200 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0d83ad3-0c38-4380-b514-5ebeb3b252c9 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:36.643168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0d83ad3-0c38-4380-b514-5ebeb3b252c9 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:36.645643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0d83ad3-0c38-4380-b514-5ebeb3b252c9 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:36.651548 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0d83ad3-0c38-4380-b514-5ebeb3b252c9 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:36.963213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c0d83ad3-0c38-4380-b514-5ebeb3b252c9 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:36.977392 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c0d83ad3-0c38-4380-b514-5ebeb3b252c9 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0" status: 200 len: 1366 microversion: 2.1 time: 0.354908 Oct 29 03:19:36.993845 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2668/5114] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:36 2022] GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0 => generated 1366 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:37.079416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1c077713-8e33-45ab-b4bc-a4b277e03ba5 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:37.080749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1c077713-8e33-45ab-b4bc-a4b277e03ba5 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] [instance: cb3109eb-0cf4-42a3-9861-da23557d66f8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:37.099213 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c077713-8e33-45ab-b4bc-a4b277e03ba5 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:37.099980 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c077713-8e33-45ab-b4bc-a4b277e03ba5 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:37.100817 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c077713-8e33-45ab-b4bc-a4b277e03ba5 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:37.101889 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c077713-8e33-45ab-b4bc-a4b277e03ba5 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:37.102541 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c077713-8e33-45ab-b4bc-a4b277e03ba5 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:37.103314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c077713-8e33-45ab-b4bc-a4b277e03ba5 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:37.131345 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-1c077713-8e33-45ab-b4bc-a4b277e03ba5 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] HTTP exception thrown: Instance cb3109eb-0cf4-42a3-9861-da23557d66f8 could not be found. Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1c077713-8e33-45ab-b4bc-a4b277e03ba5 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Request method failure captured: Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8 HTTP/1.1 Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJuszl3y-U82XHaxhP9wkTwm90XzP4-Obd0nf6yYtCAMiQgFttK804JBGw3ROwUES4ft8d2TKK9xE_9SgmChFfDxydmdmT8toLswNHWI4ycJZ2oK0mbvqskScKIzy7BbHhG9rF_FVuLU3DRcAmXZXwMmYH85AwG64S2cZx3Vs9FryKQ Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: db7fd46462a44bd1a19f4bb82f40c6f8 Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-VolumesNegativeTest-1102539405 Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/db7fd46462a44bd1a19f4bb82f40c6f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/db7fd46462a44bd1a19f4bb82f40c6f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_db7fd46462a44bd1a19f4bb82f40c6f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/db7fd46462a44bd1a19f4bb82f40c6f8"}]}] Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-VolumesNegativeTest-1102539405 Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: db7fd46462a44bd1a19f4bb82f40c6f8 Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-VolumesNegativeTest-1102539405 Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-VolumesNegativeTest-1102539405-project Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: abec8eabe4424d16b2c971275dbe4fc7 Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-VolumesNegativeTest-1102539405-project Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance cb3109eb-0cf4-42a3-9861-da23557d66f8 could not be found. Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'cb3109eb-0cf4-42a3-9861-da23557d66f8'} Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb3109eb-0cf4-42a3-9861-da23557d66f8 could not be found. Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb3109eb-0cf4-42a3-9861-da23557d66f8 could not be found. Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:19:37.142605 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:19:37.148294 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:19:37.148294 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:19:37.148294 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:19:37.148294 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:19:37.148294 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:19:37.148294 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb3109eb-0cf4-42a3-9861-da23557d66f8 could not be found. Oct 29 03:19:37.148294 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:19:37.149919 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1c077713-8e33-45ab-b4bc-a4b277e03ba5 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] Returning 404 to user: Instance cb3109eb-0cf4-42a3-9861-da23557d66f8 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:19:37.151056 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1c077713-8e33-45ab-b4bc-a4b277e03ba5 tempest-VolumesNegativeTest-1102539405 tempest-VolumesNegativeTest-1102539405-project] 10.222.0.46 "GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8" status: 404 len: 111 microversion: 2.1 time: 0.075703 Oct 29 03:19:37.152132 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2447/5115] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:37 2022] GET /compute/v2.1/servers/cb3109eb-0cf4-42a3-9861-da23557d66f8 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:19:37.234932 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-cca13921-3d76-4d7e-b71b-44e221348481 req-3d9d9f71-aff5-4f9c-a078-808a2f093adc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92", "tag": "4430a02f-d29d-45d9-af10-ee5e74cb9bb6"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:37.267015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-cca13921-3d76-4d7e-b71b-44e221348481 req-3d9d9f71-aff5-4f9c-a078-808a2f093adc service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:37.268138 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-cca13921-3d76-4d7e-b71b-44e221348481 req-3d9d9f71-aff5-4f9c-a078-808a2f093adc service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:37.268618 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-cca13921-3d76-4d7e-b71b-44e221348481 req-3d9d9f71-aff5-4f9c-a078-808a2f093adc service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:37.303018 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-cca13921-3d76-4d7e-b71b-44e221348481 req-3d9d9f71-aff5-4f9c-a078-808a2f093adc service nova] Creating event network-changed:4430a02f-d29d-45d9-af10-ee5e74cb9bb6 for instance e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92 on n-h2-862967-2 Oct 29 03:19:37.319569 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-cca13921-3d76-4d7e-b71b-44e221348481 req-3d9d9f71-aff5-4f9c-a078-808a2f093adc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090394 Oct 29 03:19:37.323213 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2669/5116] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:19:37.564133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6686e388-5a38-43c7-8231-db030ef8f37d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:37.564911 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6686e388-5a38-43c7-8231-db030ef8f37d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:37.590396 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6686e388-5a38-43c7-8231-db030ef8f37d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:37.591401 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6686e388-5a38-43c7-8231-db030ef8f37d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:37.592195 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6686e388-5a38-43c7-8231-db030ef8f37d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:37.593237 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6686e388-5a38-43c7-8231-db030ef8f37d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:37.593855 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6686e388-5a38-43c7-8231-db030ef8f37d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:37.595955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6686e388-5a38-43c7-8231-db030ef8f37d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:38.007301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7b75d5e2-1d9b-4060-ad0b-84658e37a0e3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:38.008002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7b75d5e2-1d9b-4060-ad0b-84658e37a0e3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:38.023641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b75d5e2-1d9b-4060-ad0b-84658e37a0e3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:38.024165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b75d5e2-1d9b-4060-ad0b-84658e37a0e3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:38.024640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b75d5e2-1d9b-4060-ad0b-84658e37a0e3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:38.025614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b75d5e2-1d9b-4060-ad0b-84658e37a0e3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:38.026078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b75d5e2-1d9b-4060-ad0b-84658e37a0e3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:38.026501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b75d5e2-1d9b-4060-ad0b-84658e37a0e3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:38.114950 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6686e388-5a38-43c7-8231-db030ef8f37d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:38.131833 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6686e388-5a38-43c7-8231-db030ef8f37d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92" status: 200 len: 1314 microversion: 2.1 time: 0.569679 Oct 29 03:19:38.132505 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2448/5117] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:37 2022] GET /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92 => generated 1314 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:38.651639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7b75d5e2-1d9b-4060-ad0b-84658e37a0e3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:38.669501 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7b75d5e2-1d9b-4060-ad0b-84658e37a0e3 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0" status: 200 len: 1366 microversion: 2.1 time: 0.666494 Oct 29 03:19:38.681321 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2670/5118] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:38 2022] GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0 => generated 1366 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:19:39.156516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-64f70362-9ec3-4ff1-9438-d34edc08fc27 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:39.157861 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-64f70362-9ec3-4ff1-9438-d34edc08fc27 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:39.179086 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64f70362-9ec3-4ff1-9438-d34edc08fc27 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:39.185806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64f70362-9ec3-4ff1-9438-d34edc08fc27 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:39.186616 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64f70362-9ec3-4ff1-9438-d34edc08fc27 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:39.189614 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64f70362-9ec3-4ff1-9438-d34edc08fc27 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:39.190313 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64f70362-9ec3-4ff1-9438-d34edc08fc27 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:39.192836 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64f70362-9ec3-4ff1-9438-d34edc08fc27 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:39.439240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-2b7faec4-ac0b-47cb-8d58-ec9d10f067bd req-0a50ef68-f067-4b62-8863-056509aa7e00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5efc47a-1e03-4d14-bc60-5d3f067a89d0", "name": "network-vif-plugged", "status": "completed", "tag": "f10311b9-c69d-4c20-96a9-543008cc1a15"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:39.463162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-2b7faec4-ac0b-47cb-8d58-ec9d10f067bd req-0a50ef68-f067-4b62-8863-056509aa7e00 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:39.469285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-2b7faec4-ac0b-47cb-8d58-ec9d10f067bd req-0a50ef68-f067-4b62-8863-056509aa7e00 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:39.470116 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-2b7faec4-ac0b-47cb-8d58-ec9d10f067bd req-0a50ef68-f067-4b62-8863-056509aa7e00 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:39.498503 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-2b7faec4-ac0b-47cb-8d58-ec9d10f067bd req-0a50ef68-f067-4b62-8863-056509aa7e00 service nova] Creating event network-vif-plugged:f10311b9-c69d-4c20-96a9-543008cc1a15 for instance d5efc47a-1e03-4d14-bc60-5d3f067a89d0 on n-h1-862967-2 Oct 29 03:19:39.512581 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-2b7faec4-ac0b-47cb-8d58-ec9d10f067bd req-0a50ef68-f067-4b62-8863-056509aa7e00 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077441 Oct 29 03:19:39.515094 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2671/5119] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:19:39.694766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6c5f0657-1ad1-410e-8c93-bf2305f35c63 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:39.696387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6c5f0657-1ad1-410e-8c93-bf2305f35c63 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:39.711541 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c5f0657-1ad1-410e-8c93-bf2305f35c63 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:39.714173 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c5f0657-1ad1-410e-8c93-bf2305f35c63 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:39.716707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c5f0657-1ad1-410e-8c93-bf2305f35c63 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:39.728084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c5f0657-1ad1-410e-8c93-bf2305f35c63 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:39.729618 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c5f0657-1ad1-410e-8c93-bf2305f35c63 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:39.730256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c5f0657-1ad1-410e-8c93-bf2305f35c63 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:39.934465 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-64f70362-9ec3-4ff1-9438-d34edc08fc27 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:39.962323 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-64f70362-9ec3-4ff1-9438-d34edc08fc27 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92" status: 200 len: 1314 microversion: 2.1 time: 0.811154 Oct 29 03:19:39.965185 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2449/5120] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:39 2022] GET /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92 => generated 1314 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:40.388867 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6c5f0657-1ad1-410e-8c93-bf2305f35c63 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:40.416096 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6c5f0657-1ad1-410e-8c93-bf2305f35c63 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0" status: 200 len: 1366 microversion: 2.1 time: 0.719986 Oct 29 03:19:40.420311 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2672/5121] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:39 2022] GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0 => generated 1366 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:19:40.987662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-292e13da-a1c8-4f69-aaf1-9034ebcd4c94 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:40.988406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-292e13da-a1c8-4f69-aaf1-9034ebcd4c94 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:41.005332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-292e13da-a1c8-4f69-aaf1-9034ebcd4c94 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:41.009144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-292e13da-a1c8-4f69-aaf1-9034ebcd4c94 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:41.009719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-292e13da-a1c8-4f69-aaf1-9034ebcd4c94 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:41.019102 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-292e13da-a1c8-4f69-aaf1-9034ebcd4c94 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:41.019102 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-292e13da-a1c8-4f69-aaf1-9034ebcd4c94 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:41.019102 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-292e13da-a1c8-4f69-aaf1-9034ebcd4c94 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:41.397665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-292e13da-a1c8-4f69-aaf1-9034ebcd4c94 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:41.426333 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-292e13da-a1c8-4f69-aaf1-9034ebcd4c94 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92" status: 200 len: 1314 microversion: 2.1 time: 0.442729 Oct 29 03:19:41.443100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1fcb3ed9-4789-40ac-b18e-5ff7e45055bf tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:41.444476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1fcb3ed9-4789-40ac-b18e-5ff7e45055bf tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:41.456403 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2450/5122] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:40 2022] GET /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92 => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:41.462933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fcb3ed9-4789-40ac-b18e-5ff7e45055bf tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:41.468443 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fcb3ed9-4789-40ac-b18e-5ff7e45055bf tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:41.475293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fcb3ed9-4789-40ac-b18e-5ff7e45055bf tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:41.476073 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fcb3ed9-4789-40ac-b18e-5ff7e45055bf tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:41.483939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fcb3ed9-4789-40ac-b18e-5ff7e45055bf tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:41.484821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fcb3ed9-4789-40ac-b18e-5ff7e45055bf tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:41.972382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:42.465404 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-78fedf7f-b758-409c-b07b-77617ebb670f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:42.466161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-78fedf7f-b758-409c-b07b-77617ebb670f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:42.472805 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1fcb3ed9-4789-40ac-b18e-5ff7e45055bf tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:42.484017 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1fcb3ed9-4789-40ac-b18e-5ff7e45055bf tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0" status: 200 len: 1555 microversion: 2.1 time: 1.044804 Oct 29 03:19:42.485024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78fedf7f-b758-409c-b07b-77617ebb670f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:42.487144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78fedf7f-b758-409c-b07b-77617ebb670f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:42.488058 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2673/5123] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:41 2022] GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0 => generated 1555 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:19:42.489806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78fedf7f-b758-409c-b07b-77617ebb670f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:42.493674 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78fedf7f-b758-409c-b07b-77617ebb670f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:42.494172 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78fedf7f-b758-409c-b07b-77617ebb670f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:42.494649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78fedf7f-b758-409c-b07b-77617ebb670f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:42.543867 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e932136d-c221-493c-8813-c9dc321a994f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:42.544808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e932136d-c221-493c-8813-c9dc321a994f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:42.565695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e932136d-c221-493c-8813-c9dc321a994f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:42.570532 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e932136d-c221-493c-8813-c9dc321a994f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:42.573358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e932136d-c221-493c-8813-c9dc321a994f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:42.574366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e932136d-c221-493c-8813-c9dc321a994f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:42.576231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e932136d-c221-493c-8813-c9dc321a994f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:42.579609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e932136d-c221-493c-8813-c9dc321a994f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:42.679422 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:42.839762 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e932136d-c221-493c-8813-c9dc321a994f tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.299762 Oct 29 03:19:42.841625 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2674/5124] 10.222.0.46 () {58 vars in 1275 bytes} [Sat Oct 29 03:19:42 2022] GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0/os-interface => generated 284 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:19:43.017066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-78fedf7f-b758-409c-b07b-77617ebb670f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:43.044015 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-78fedf7f-b758-409c-b07b-77617ebb670f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92" status: 200 len: 1314 microversion: 2.1 time: 0.585044 Oct 29 03:19:43.047679 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2451/5125] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:42 2022] GET /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92 => generated 1314 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:19:44.076114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fc4aa76d-2b64-40df-bd70-8161fc83ed26 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:44.076948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fc4aa76d-2b64-40df-bd70-8161fc83ed26 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:44.099170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc4aa76d-2b64-40df-bd70-8161fc83ed26 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:44.099170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc4aa76d-2b64-40df-bd70-8161fc83ed26 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:44.099496 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc4aa76d-2b64-40df-bd70-8161fc83ed26 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:44.100683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc4aa76d-2b64-40df-bd70-8161fc83ed26 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:44.101144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc4aa76d-2b64-40df-bd70-8161fc83ed26 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:44.101562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc4aa76d-2b64-40df-bd70-8161fc83ed26 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:44.187206 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-ff7101f0-37ed-4955-9759-073ded7a428b req-94ec413e-3a75-4537-a771-b46617f7c683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92", "name": "network-vif-plugged", "status": "completed", "tag": "4430a02f-d29d-45d9-af10-ee5e74cb9bb6"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:44.207274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ff7101f0-37ed-4955-9759-073ded7a428b req-94ec413e-3a75-4537-a771-b46617f7c683 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:44.207754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ff7101f0-37ed-4955-9759-073ded7a428b req-94ec413e-3a75-4537-a771-b46617f7c683 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:44.208188 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ff7101f0-37ed-4955-9759-073ded7a428b req-94ec413e-3a75-4537-a771-b46617f7c683 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:44.247007 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-ff7101f0-37ed-4955-9759-073ded7a428b req-94ec413e-3a75-4537-a771-b46617f7c683 service nova] Creating event network-vif-plugged:4430a02f-d29d-45d9-af10-ee5e74cb9bb6 for instance e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92 on n-h2-862967-2 Oct 29 03:19:44.262377 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-ff7101f0-37ed-4955-9759-073ded7a428b req-94ec413e-3a75-4537-a771-b46617f7c683 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077334 Oct 29 03:19:44.263982 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2452/5126] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:19:45.557178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=18 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:46.002212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fc4aa76d-2b64-40df-bd70-8161fc83ed26 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:46.013775 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fc4aa76d-2b64-40df-bd70-8161fc83ed26 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92" status: 200 len: 1314 microversion: 2.1 time: 1.942325 Oct 29 03:19:46.019540 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2675/5127] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:44 2022] GET /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92 => generated 1314 bytes in 1949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:47.051780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7a4f562d-a0cb-491d-9e5d-493b455fb6aa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:47.052569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7a4f562d-a0cb-491d-9e5d-493b455fb6aa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:47.075815 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a4f562d-a0cb-491d-9e5d-493b455fb6aa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:47.081641 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a4f562d-a0cb-491d-9e5d-493b455fb6aa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:47.082112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a4f562d-a0cb-491d-9e5d-493b455fb6aa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:47.082860 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a4f562d-a0cb-491d-9e5d-493b455fb6aa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:47.083315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a4f562d-a0cb-491d-9e5d-493b455fb6aa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:47.083735 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7a4f562d-a0cb-491d-9e5d-493b455fb6aa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:47.277167 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-398082a9-7410-4221-b390-f61e754f5056 req-d6a2adfe-7cd8-4875-8cb5-66c9cb752145 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5efc47a-1e03-4d14-bc60-5d3f067a89d0", "tag": "f10311b9-c69d-4c20-96a9-543008cc1a15"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:47.312736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-398082a9-7410-4221-b390-f61e754f5056 req-d6a2adfe-7cd8-4875-8cb5-66c9cb752145 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:47.314026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-398082a9-7410-4221-b390-f61e754f5056 req-d6a2adfe-7cd8-4875-8cb5-66c9cb752145 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:47.315990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-398082a9-7410-4221-b390-f61e754f5056 req-d6a2adfe-7cd8-4875-8cb5-66c9cb752145 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:47.357825 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-398082a9-7410-4221-b390-f61e754f5056 req-d6a2adfe-7cd8-4875-8cb5-66c9cb752145 service nova] Creating event network-changed:f10311b9-c69d-4c20-96a9-543008cc1a15 for instance d5efc47a-1e03-4d14-bc60-5d3f067a89d0 on n-h1-862967-2 Oct 29 03:19:47.377425 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-398082a9-7410-4221-b390-f61e754f5056 req-d6a2adfe-7cd8-4875-8cb5-66c9cb752145 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103765 Oct 29 03:19:47.379056 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2676/5128] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:19:47.643500 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7a4f562d-a0cb-491d-9e5d-493b455fb6aa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:47.654382 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7a4f562d-a0cb-491d-9e5d-493b455fb6aa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92" status: 200 len: 1501 microversion: 2.1 time: 0.607812 Oct 29 03:19:47.656165 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2453/5129] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:47 2022] GET /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92 => generated 1501 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:47.686129 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5946b366-2381-43bd-86f5-68d9921b8814 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:47.689845 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5946b366-2381-43bd-86f5-68d9921b8814 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:47.718922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5946b366-2381-43bd-86f5-68d9921b8814 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:47.728383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5946b366-2381-43bd-86f5-68d9921b8814 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:47.730467 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5946b366-2381-43bd-86f5-68d9921b8814 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:47.732963 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5946b366-2381-43bd-86f5-68d9921b8814 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:47.737986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5946b366-2381-43bd-86f5-68d9921b8814 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:47.739080 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5946b366-2381-43bd-86f5-68d9921b8814 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:47.858467 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5946b366-2381-43bd-86f5-68d9921b8814 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92/action" status: 200 len: 14 microversion: 2.1 time: 0.177402 Oct 29 03:19:47.860953 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2677/5130] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:19:47 2022] POST /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92/action => generated 14 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:19:48.872005 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a3b66401-7750-4280-8843-7d49b00812d3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:48.874356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a3b66401-7750-4280-8843-7d49b00812d3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:48.895279 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3b66401-7750-4280-8843-7d49b00812d3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:48.895879 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3b66401-7750-4280-8843-7d49b00812d3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:48.896334 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3b66401-7750-4280-8843-7d49b00812d3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:48.897132 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3b66401-7750-4280-8843-7d49b00812d3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:48.897585 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3b66401-7750-4280-8843-7d49b00812d3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:48.905232 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3b66401-7750-4280-8843-7d49b00812d3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:49.038178 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a3b66401-7750-4280-8843-7d49b00812d3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92/action" status: 200 len: 14 microversion: 2.1 time: 0.169802 Oct 29 03:19:49.039685 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2454/5131] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:19:48 2022] POST /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:19:50.060308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0d344b8a-27f2-4ffb-8adb-244733bd6b87 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:50.070309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0d344b8a-27f2-4ffb-8adb-244733bd6b87 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:50.100699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d344b8a-27f2-4ffb-8adb-244733bd6b87 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:50.101149 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d344b8a-27f2-4ffb-8adb-244733bd6b87 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:50.103055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d344b8a-27f2-4ffb-8adb-244733bd6b87 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:50.106978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d344b8a-27f2-4ffb-8adb-244733bd6b87 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:50.110008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d344b8a-27f2-4ffb-8adb-244733bd6b87 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:50.113233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d344b8a-27f2-4ffb-8adb-244733bd6b87 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:50.240355 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0d344b8a-27f2-4ffb-8adb-244733bd6b87 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92/action" status: 200 len: 14 microversion: 2.1 time: 0.189957 Oct 29 03:19:50.244767 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2678/5132] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:19:50 2022] POST /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92/action => generated 14 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:19:51.258221 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cb0e18cc-f566-40c6-b666-9dab6a08cfd1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:51.262573 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cb0e18cc-f566-40c6-b666-9dab6a08cfd1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:51.305557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb0e18cc-f566-40c6-b666-9dab6a08cfd1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:51.307767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb0e18cc-f566-40c6-b666-9dab6a08cfd1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:51.313619 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb0e18cc-f566-40c6-b666-9dab6a08cfd1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:51.318859 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb0e18cc-f566-40c6-b666-9dab6a08cfd1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:51.325012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb0e18cc-f566-40c6-b666-9dab6a08cfd1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:51.326908 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb0e18cc-f566-40c6-b666-9dab6a08cfd1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:51.444789 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cb0e18cc-f566-40c6-b666-9dab6a08cfd1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92/action" status: 200 len: 14 microversion: 2.1 time: 0.192228 Oct 29 03:19:51.454674 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2455/5133] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:19:51 2022] POST /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92/action => generated 14 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 03:19:52.473862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a7aa7742-3bd0-447a-a152-7899a25bf852 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:52.487307 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a7aa7742-3bd0-447a-a152-7899a25bf852 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:52.514240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7aa7742-3bd0-447a-a152-7899a25bf852 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:52.515051 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7aa7742-3bd0-447a-a152-7899a25bf852 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:52.518854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7aa7742-3bd0-447a-a152-7899a25bf852 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:52.519820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7aa7742-3bd0-447a-a152-7899a25bf852 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:52.520869 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7aa7742-3bd0-447a-a152-7899a25bf852 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:52.522068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7aa7742-3bd0-447a-a152-7899a25bf852 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:52.620410 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a7aa7742-3bd0-447a-a152-7899a25bf852 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92/action" status: 200 len: 14 microversion: 2.1 time: 0.155488 Oct 29 03:19:52.629020 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2679/5134] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:19:52 2022] POST /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:19:52.807424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e5414325-ee6d-495f-8b7d-2332a4474ae3 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Action: 'create', calling method: .version_select at 0x7ff053a6b9d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1963349401", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNT64Ok6tiAoeuonhfkOPO1tNLEd/eJ5ZdqNxppRxFPpQcyKeGopasr2C94Ee2935ZsEgl3kswGj6/m8EAV/aJ/PvUw//Zdf/vEliO9tQXVsGZyOE2qxmUHy9cQ244UYA=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:52.927055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-e5414325-ee6d-495f-8b7d-2332a4474ae3 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Getting quotas for project 987564b626dd4c12b6109c1d23de75c6. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:19:52.946729 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-e5414325-ee6d-495f-8b7d-2332a4474ae3 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Getting quotas for user 969be4a3c9bd432fa544ee27fa186564 and project 987564b626dd4c12b6109c1d23de75c6. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:19:53.012815 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e5414325-ee6d-495f-8b7d-2332a4474ae3 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.210417 Oct 29 03:19:53.014487 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2456/5135] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:19:52 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:19:53.644852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3be9c008-a8ea-47f3-80a8-a4147693a97c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:53.663571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3be9c008-a8ea-47f3-80a8-a4147693a97c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:53.720372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3be9c008-a8ea-47f3-80a8-a4147693a97c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:53.721004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3be9c008-a8ea-47f3-80a8-a4147693a97c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:53.728902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3be9c008-a8ea-47f3-80a8-a4147693a97c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:53.758023 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3be9c008-a8ea-47f3-80a8-a4147693a97c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:53.765794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3be9c008-a8ea-47f3-80a8-a4147693a97c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:53.767613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3be9c008-a8ea-47f3-80a8-a4147693a97c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:53.934712 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3be9c008-a8ea-47f3-80a8-a4147693a97c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92/action" status: 200 len: 14 microversion: 2.1 time: 0.300506 Oct 29 03:19:53.937605 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2680/5136] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:19:53 2022] POST /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92/action => generated 14 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:19:54.948735 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dd60f610-3f75-481a-bab3-5183acafa2fb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:54.951890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dd60f610-3f75-481a-bab3-5183acafa2fb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:55.004468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd60f610-3f75-481a-bab3-5183acafa2fb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:55.006058 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd60f610-3f75-481a-bab3-5183acafa2fb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:55.007454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd60f610-3f75-481a-bab3-5183acafa2fb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:55.010546 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd60f610-3f75-481a-bab3-5183acafa2fb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:55.012043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd60f610-3f75-481a-bab3-5183acafa2fb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:55.013549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd60f610-3f75-481a-bab3-5183acafa2fb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:55.142490 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dd60f610-3f75-481a-bab3-5183acafa2fb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92/action" status: 200 len: 14 microversion: 2.1 time: 0.198251 Oct 29 03:19:55.146112 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2457/5137] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:19:54 2022] POST /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92/action => generated 14 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:19:56.155387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d50be2de-a9af-48ad-acf6-1de8d1e00093 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:56.159576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d50be2de-a9af-48ad-acf6-1de8d1e00093 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:56.184558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d50be2de-a9af-48ad-acf6-1de8d1e00093 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:56.185396 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d50be2de-a9af-48ad-acf6-1de8d1e00093 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:56.186491 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d50be2de-a9af-48ad-acf6-1de8d1e00093 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:56.189055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d50be2de-a9af-48ad-acf6-1de8d1e00093 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:56.189849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d50be2de-a9af-48ad-acf6-1de8d1e00093 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:56.194550 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d50be2de-a9af-48ad-acf6-1de8d1e00093 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:56.292879 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d50be2de-a9af-48ad-acf6-1de8d1e00093 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92/action" status: 200 len: 14 microversion: 2.1 time: 0.141949 Oct 29 03:19:56.293883 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2681/5138] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:19:56 2022] POST /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:19:57.305824 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-01ebb50a-6754-4484-82bd-9d593745a9c4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:57.310491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-01ebb50a-6754-4484-82bd-9d593745a9c4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:57.323482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:57.330148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01ebb50a-6754-4484-82bd-9d593745a9c4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:57.331238 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01ebb50a-6754-4484-82bd-9d593745a9c4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:57.337290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01ebb50a-6754-4484-82bd-9d593745a9c4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:57.338647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01ebb50a-6754-4484-82bd-9d593745a9c4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:57.339514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01ebb50a-6754-4484-82bd-9d593745a9c4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:57.340344 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01ebb50a-6754-4484-82bd-9d593745a9c4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:57.412720 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-01ebb50a-6754-4484-82bd-9d593745a9c4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92/action" status: 200 len: 14 microversion: 2.1 time: 0.112076 Oct 29 03:19:57.416911 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2458/5139] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:19:57 2022] POST /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:19:57.843884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8152d0bd-1245-4f8b-a5f9-cdc82df18b4d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-558034672", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "c0d8572c-edd0-4ac4-ad9d-b4276b3bfa15"}], "key_name": "tempest-TestNetworkBasicOps-1963349401", "security_groups": [{"name": "tempest-secgroup-smoke-1380513055"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:58.424656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b9c2f60d-f634-4ba2-8bf2-5c9406140909 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:19:58.431825 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b9c2f60d-f634-4ba2-8bf2-5c9406140909 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:58.463477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9c2f60d-f634-4ba2-8bf2-5c9406140909 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:58.465710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9c2f60d-f634-4ba2-8bf2-5c9406140909 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:58.466443 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9c2f60d-f634-4ba2-8bf2-5c9406140909 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:58.467722 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9c2f60d-f634-4ba2-8bf2-5c9406140909 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:58.481545 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9c2f60d-f634-4ba2-8bf2-5c9406140909 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:58.482294 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9c2f60d-f634-4ba2-8bf2-5c9406140909 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:58.564808 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b9c2f60d-f634-4ba2-8bf2-5c9406140909 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92/action" status: 200 len: 8208 microversion: 2.1 time: 0.144346 Oct 29 03:19:58.566052 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2459/5140] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:19:58 2022] POST /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92/action => generated 8208 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:58.575830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0647f6dc-8c23-4a0e-80ad-5bf9ac5e758f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:58.579296 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0647f6dc-8c23-4a0e-80ad-5bf9ac5e758f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:58.603426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0647f6dc-8c23-4a0e-80ad-5bf9ac5e758f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:58.613568 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0647f6dc-8c23-4a0e-80ad-5bf9ac5e758f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:58.614162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0647f6dc-8c23-4a0e-80ad-5bf9ac5e758f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:58.616427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0647f6dc-8c23-4a0e-80ad-5bf9ac5e758f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:58.617089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0647f6dc-8c23-4a0e-80ad-5bf9ac5e758f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:58.618318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0647f6dc-8c23-4a0e-80ad-5bf9ac5e758f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:58.673628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-8152d0bd-1245-4f8b-a5f9-cdc82df18b4d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] validate_networks() for [('c0d8572c-edd0-4ac4-ad9d-b4276b3bfa15', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:19:59.070110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0647f6dc-8c23-4a0e-80ad-5bf9ac5e758f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:59.084274 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0647f6dc-8c23-4a0e-80ad-5bf9ac5e758f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.512207 Oct 29 03:19:59.092629 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2460/5141] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:58 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:19:59.120227 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e2fd0bc6-6aee-4c2e-8af4-e15564114d89 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:59.121223 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e2fd0bc6-6aee-4c2e-8af4-e15564114d89 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:59.130099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2fd0bc6-6aee-4c2e-8af4-e15564114d89 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:59.133241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2fd0bc6-6aee-4c2e-8af4-e15564114d89 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:59.134000 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2fd0bc6-6aee-4c2e-8af4-e15564114d89 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:59.145176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2fd0bc6-6aee-4c2e-8af4-e15564114d89 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:59.145796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2fd0bc6-6aee-4c2e-8af4-e15564114d89 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:59.146355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e2fd0bc6-6aee-4c2e-8af4-e15564114d89 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:59.465523 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e2fd0bc6-6aee-4c2e-8af4-e15564114d89 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:59.473920 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e2fd0bc6-6aee-4c2e-8af4-e15564114d89 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.357443 Oct 29 03:19:59.477559 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2461/5142] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:59 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:19:59.502881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e80f1587-1903-4d1c-8c59-16865662383d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:19:59.504369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e80f1587-1903-4d1c-8c59-16865662383d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:19:59.517472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e80f1587-1903-4d1c-8c59-16865662383d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:59.518428 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e80f1587-1903-4d1c-8c59-16865662383d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:59.519393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e80f1587-1903-4d1c-8c59-16865662383d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:59.520354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e80f1587-1903-4d1c-8c59-16865662383d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:19:59.521082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e80f1587-1903-4d1c-8c59-16865662383d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:19:59.521743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e80f1587-1903-4d1c-8c59-16865662383d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:19:59.875060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e80f1587-1903-4d1c-8c59-16865662383d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:19:59.883885 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e80f1587-1903-4d1c-8c59-16865662383d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.384866 Oct 29 03:19:59.884516 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2462/5143] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:19:59 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:19:59.895417 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4ee19a67-102a-4585-81ff-fad122de0810 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-847539114", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "c6879d34-dab3-473f-85c0-31abea360a2c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-266528313", "security_groups": [{"name": "tempest-secgroup-smoke-141645023"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:00.070454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-8152d0bd-1245-4f8b-a5f9-cdc82df18b4d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:20:00.070998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-8152d0bd-1245-4f8b-a5f9-cdc82df18b4d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:20:00.071336 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-8152d0bd-1245-4f8b-a5f9-cdc82df18b4d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:20:00.071742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-8152d0bd-1245-4f8b-a5f9-cdc82df18b4d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:20:00.072150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-8152d0bd-1245-4f8b-a5f9-cdc82df18b4d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:20:00.092259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8152d0bd-1245-4f8b-a5f9-cdc82df18b4d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:00.092805 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8152d0bd-1245-4f8b-a5f9-cdc82df18b4d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:00.093250 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8152d0bd-1245-4f8b-a5f9-cdc82df18b4d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:00.101030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8152d0bd-1245-4f8b-a5f9-cdc82df18b4d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:00.101539 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8152d0bd-1245-4f8b-a5f9-cdc82df18b4d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:00.101991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8152d0bd-1245-4f8b-a5f9-cdc82df18b4d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:00.149156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-8152d0bd-1245-4f8b-a5f9-cdc82df18b4d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Getting quotas for project 987564b626dd4c12b6109c1d23de75c6. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:20:00.159318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-4ee19a67-102a-4585-81ff-fad122de0810 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] validate_networks() for [('c6879d34-dab3-473f-85c0-31abea360a2c', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:20:00.166679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-8152d0bd-1245-4f8b-a5f9-cdc82df18b4d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Getting quotas for user 969be4a3c9bd432fa544ee27fa186564 and project 987564b626dd4c12b6109c1d23de75c6. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:20:00.195290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8152d0bd-1245-4f8b-a5f9-cdc82df18b4d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:20:00.198078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8152d0bd-1245-4f8b-a5f9-cdc82df18b4d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 5562f723-95f1-4fc0-93db-b9b457324d35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:20:00.389880 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8152d0bd-1245-4f8b-a5f9-cdc82df18b4d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.543159 Oct 29 03:20:00.396865 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2682/5144] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:19:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 2558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:20:00.435172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-34a08e28-13f6-48fc-95b5-d89a69e198e7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:00.436666 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-34a08e28-13f6-48fc-95b5-d89a69e198e7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:00.484425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34a08e28-13f6-48fc-95b5-d89a69e198e7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:00.487133 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34a08e28-13f6-48fc-95b5-d89a69e198e7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:00.487716 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34a08e28-13f6-48fc-95b5-d89a69e198e7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:00.489475 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34a08e28-13f6-48fc-95b5-d89a69e198e7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:00.491086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34a08e28-13f6-48fc-95b5-d89a69e198e7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:00.491772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34a08e28-13f6-48fc-95b5-d89a69e198e7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:01.093656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-34a08e28-13f6-48fc-95b5-d89a69e198e7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:01.102418 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-34a08e28-13f6-48fc-95b5-d89a69e198e7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.703848 Oct 29 03:20:01.103022 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2683/5145] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:00 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:01.133695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b7a92b8b-4b72-415e-8002-eb2ee43f3eef tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:01.137388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b7a92b8b-4b72-415e-8002-eb2ee43f3eef tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 5562f723-95f1-4fc0-93db-b9b457324d35] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:01.250271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b7a92b8b-4b72-415e-8002-eb2ee43f3eef tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:01.261746 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b7a92b8b-4b72-415e-8002-eb2ee43f3eef tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35" status: 200 len: 1248 microversion: 2.1 time: 0.131670 Oct 29 03:20:01.268655 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2684/5146] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:01 2022] GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35 => generated 1248 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:01.284619 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6d6c5bbe-c463-4d4f-989a-cb378c16a1c1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:01.285898 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6d6c5bbe-c463-4d4f-989a-cb378c16a1c1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:01.311771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d6c5bbe-c463-4d4f-989a-cb378c16a1c1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:01.312504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d6c5bbe-c463-4d4f-989a-cb378c16a1c1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:01.314516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d6c5bbe-c463-4d4f-989a-cb378c16a1c1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:01.316877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d6c5bbe-c463-4d4f-989a-cb378c16a1c1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:01.317520 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d6c5bbe-c463-4d4f-989a-cb378c16a1c1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:01.319378 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d6c5bbe-c463-4d4f-989a-cb378c16a1c1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:01.325111 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-4ee19a67-102a-4585-81ff-fad122de0810 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:20:01.326152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-4ee19a67-102a-4585-81ff-fad122de0810 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:20:01.326793 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-4ee19a67-102a-4585-81ff-fad122de0810 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:20:01.327397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-4ee19a67-102a-4585-81ff-fad122de0810 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:20:01.327796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-4ee19a67-102a-4585-81ff-fad122de0810 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:20:01.341368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ee19a67-102a-4585-81ff-fad122de0810 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:01.341862 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ee19a67-102a-4585-81ff-fad122de0810 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:01.349810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ee19a67-102a-4585-81ff-fad122de0810 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:01.350858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ee19a67-102a-4585-81ff-fad122de0810 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:01.351620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ee19a67-102a-4585-81ff-fad122de0810 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:01.352238 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ee19a67-102a-4585-81ff-fad122de0810 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:01.400355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-4ee19a67-102a-4585-81ff-fad122de0810 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Getting quotas for project c898299eb0444aa1a1983fb127153c65. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:20:01.410655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-4ee19a67-102a-4585-81ff-fad122de0810 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Getting quotas for user 789295d938084ee3b7d618690fee5bfa and project c898299eb0444aa1a1983fb127153c65. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:20:01.431884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6d6c5bbe-c463-4d4f-989a-cb378c16a1c1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Locking {{(pid=127124) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 29 03:20:01.448129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4ee19a67-102a-4585-81ff-fad122de0810 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:20:01.452043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4ee19a67-102a-4585-81ff-fad122de0810 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:20:01.545018 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4ee19a67-102a-4585-81ff-fad122de0810 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.659328 Oct 29 03:20:01.548184 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2463/5147] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:19:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 1663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:20:01.564927 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d21c690b-fe6f-445a-862e-808c404e04d4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:01.591786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d21c690b-fe6f-445a-862e-808c404e04d4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:01.608801 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6d6c5bbe-c463-4d4f-989a-cb378c16a1c1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action" status: 202 len: 0 microversion: 2.1 time: 0.337790 Oct 29 03:20:01.610116 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2685/5148] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:20:01 2022] POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:20:01.622522 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bbec61d7-e443-4ea2-84db-95dc2d54cae2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:01.624231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bbec61d7-e443-4ea2-84db-95dc2d54cae2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:01.637001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbec61d7-e443-4ea2-84db-95dc2d54cae2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:01.639309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbec61d7-e443-4ea2-84db-95dc2d54cae2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:01.643535 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbec61d7-e443-4ea2-84db-95dc2d54cae2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:01.646407 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbec61d7-e443-4ea2-84db-95dc2d54cae2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:01.647214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbec61d7-e443-4ea2-84db-95dc2d54cae2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:01.650225 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbec61d7-e443-4ea2-84db-95dc2d54cae2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:01.748807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d21c690b-fe6f-445a-862e-808c404e04d4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:01.772347 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d21c690b-fe6f-445a-862e-808c404e04d4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1265 microversion: 2.1 time: 0.213195 Oct 29 03:20:01.776542 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2464/5149] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:01 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:02.272205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bbec61d7-e443-4ea2-84db-95dc2d54cae2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:02.283174 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bbec61d7-e443-4ea2-84db-95dc2d54cae2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.668502 Oct 29 03:20:02.284420 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2686/5150] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:01 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:02.295794 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5d1f8234-41bd-46a1-869e-3eea9186e93b tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:02.296683 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5d1f8234-41bd-46a1-869e-3eea9186e93b tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 5562f723-95f1-4fc0-93db-b9b457324d35] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:02.310046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d1f8234-41bd-46a1-869e-3eea9186e93b tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:02.313245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d1f8234-41bd-46a1-869e-3eea9186e93b tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:02.315990 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d1f8234-41bd-46a1-869e-3eea9186e93b tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:02.317943 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d1f8234-41bd-46a1-869e-3eea9186e93b tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:02.318496 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d1f8234-41bd-46a1-869e-3eea9186e93b tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:02.321030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d1f8234-41bd-46a1-869e-3eea9186e93b tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:02.334606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7eb86c3b-efef-496c-8962-b16d280dc815 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:02.352357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7eb86c3b-efef-496c-8962-b16d280dc815 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:02.352929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7eb86c3b-efef-496c-8962-b16d280dc815 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:02.353374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7eb86c3b-efef-496c-8962-b16d280dc815 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:02.378775 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:02.437772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:02.474060 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-7eb86c3b-efef-496c-8962-b16d280dc815 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] HTTP exception thrown: Instance 23349ce8-2588-42c9-8de7-90865b56c980 is locked Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7eb86c3b-efef-496c-8962-b16d280dc815 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Request method failure captured: Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action HTTP/1.1 Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 15 Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJrBEld31_ePW0eW7K3K43c4mjwkjjugq-rdAhOVlo7sDAu80OCKquivv6iAf8BI6lShu9ZDCXrw8POtLG6DQDhjZ3gEDkqYAv8E5X2C0u3J69FOg8yuu0dLy3EdjifUrqcpmrU9YXQ7ewUei1xDtAEB9ZAOTpvrMpo4LGrGscneUrI Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: df5fe7cedcd14b61925dc300274b3c70 Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServerActionsTestJSON-426455045 Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df5fe7cedcd14b61925dc300274b3c70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df5fe7cedcd14b61925dc300274b3c70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_df5fe7cedcd14b61925dc300274b3c70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/df5fe7cedcd14b61925dc300274b3c70"}]}] Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServerActionsTestJSON-426455045 Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: df5fe7cedcd14b61925dc300274b3c70 Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServerActionsTestJSON-426455045 Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServerActionsTestJSON-426455045-project Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: aac411c78a5648be8a1c43893d9a0798 Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServerActionsTestJSON-426455045-project Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: {"os-stop": {}} Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 23349ce8-2588-42c9-8de7-90865b56c980 is locked Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '23349ce8-2588-42c9-8de7-90865b56c980', 'body': {'os-stop': {}}} Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 23349ce8-2588-42c9-8de7-90865b56c980 is locked Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 23349ce8-2588-42c9-8de7-90865b56c980 is locked Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23349ce8-2588-42c9-8de7-90865b56c980 is locked Oct 29 03:20:02.479355 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:20:02.488095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7eb86c3b-efef-496c-8962-b16d280dc815 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Returning 409 to user: Instance 23349ce8-2588-42c9-8de7-90865b56c980 is locked {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:20:02.490062 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7eb86c3b-efef-496c-8962-b16d280dc815 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action" status: 409 len: 107 microversion: 2.1 time: 0.180828 Oct 29 03:20:02.493247 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2687/5151] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:20:02 2022] POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action => generated 107 bytes in 186 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 29 03:20:02.503921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8bf5ad6a-6711-4677-a50e-0be8c6ed30f7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:02.509280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8bf5ad6a-6711-4677-a50e-0be8c6ed30f7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:02.527703 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bf5ad6a-6711-4677-a50e-0be8c6ed30f7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:02.529447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bf5ad6a-6711-4677-a50e-0be8c6ed30f7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:02.530309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bf5ad6a-6711-4677-a50e-0be8c6ed30f7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:02.532049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bf5ad6a-6711-4677-a50e-0be8c6ed30f7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:02.534311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bf5ad6a-6711-4677-a50e-0be8c6ed30f7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:02.535104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bf5ad6a-6711-4677-a50e-0be8c6ed30f7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:02.588224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5d1f8234-41bd-46a1-869e-3eea9186e93b tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:02.598096 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5d1f8234-41bd-46a1-869e-3eea9186e93b tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35" status: 200 len: 1300 microversion: 2.1 time: 0.306725 Oct 29 03:20:02.598801 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2465/5152] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:02 2022] GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35 => generated 1300 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:20:02.653941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8bf5ad6a-6711-4677-a50e-0be8c6ed30f7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Unlocking {{(pid=127124) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 29 03:20:02.770727 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8bf5ad6a-6711-4677-a50e-0be8c6ed30f7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action" status: 202 len: 0 microversion: 2.1 time: 0.272543 Oct 29 03:20:02.771951 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2688/5153] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:20:02 2022] POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:20:02.783139 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a6c42160-0bff-4d48-b6e7-2042b48be446 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:02.796127 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6c42160-0bff-4d48-b6e7-2042b48be446 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:02.797844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6c42160-0bff-4d48-b6e7-2042b48be446 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:02.799786 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4d61dc72-939f-4dca-840a-86e82193ba66 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:02.800008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6c42160-0bff-4d48-b6e7-2042b48be446 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:02.800869 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4d61dc72-939f-4dca-840a-86e82193ba66 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:02.812205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d61dc72-939f-4dca-840a-86e82193ba66 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:02.812892 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d61dc72-939f-4dca-840a-86e82193ba66 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:02.814430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d61dc72-939f-4dca-840a-86e82193ba66 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:02.816075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d61dc72-939f-4dca-840a-86e82193ba66 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:02.817707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d61dc72-939f-4dca-840a-86e82193ba66 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:02.818174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d61dc72-939f-4dca-840a-86e82193ba66 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:02.863706 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a6c42160-0bff-4d48-b6e7-2042b48be446 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Going to try to stop instance {{(pid=127125) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 03:20:02.991791 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a6c42160-0bff-4d48-b6e7-2042b48be446 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action" status: 202 len: 0 microversion: 2.1 time: 0.213188 Oct 29 03:20:03.003366 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2466/5154] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:20:02 2022] POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:20:03.030520 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bb7f273c-71c0-40f2-a755-3bce9121bdc4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:03.034580 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bb7f273c-71c0-40f2-a755-3bce9121bdc4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:03.045262 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb7f273c-71c0-40f2-a755-3bce9121bdc4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:03.046182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb7f273c-71c0-40f2-a755-3bce9121bdc4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:03.046785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb7f273c-71c0-40f2-a755-3bce9121bdc4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:03.047747 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb7f273c-71c0-40f2-a755-3bce9121bdc4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:03.048366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb7f273c-71c0-40f2-a755-3bce9121bdc4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:03.049049 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb7f273c-71c0-40f2-a755-3bce9121bdc4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:03.064216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4d61dc72-939f-4dca-840a-86e82193ba66 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:03.069471 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4d61dc72-939f-4dca-840a-86e82193ba66 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1269 microversion: 2.1 time: 0.273667 Oct 29 03:20:03.070081 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2689/5155] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:02 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1269 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:20:03.512090 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bb7f273c-71c0-40f2-a755-3bce9121bdc4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:03.525456 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bb7f273c-71c0-40f2-a755-3bce9121bdc4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1680 microversion: 2.1 time: 0.511253 Oct 29 03:20:03.532192 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2467/5156] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:03 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1680 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:03.627913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d094fc42-dbd9-445d-8507-6e675fb769c5 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:03.628702 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d094fc42-dbd9-445d-8507-6e675fb769c5 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 5562f723-95f1-4fc0-93db-b9b457324d35] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:03.648157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d094fc42-dbd9-445d-8507-6e675fb769c5 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:03.648959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d094fc42-dbd9-445d-8507-6e675fb769c5 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:03.653277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d094fc42-dbd9-445d-8507-6e675fb769c5 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:03.654508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d094fc42-dbd9-445d-8507-6e675fb769c5 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:03.655359 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d094fc42-dbd9-445d-8507-6e675fb769c5 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:03.655943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d094fc42-dbd9-445d-8507-6e675fb769c5 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:03.963659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d094fc42-dbd9-445d-8507-6e675fb769c5 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:03.973693 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d094fc42-dbd9-445d-8507-6e675fb769c5 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35" status: 200 len: 1306 microversion: 2.1 time: 0.350213 Oct 29 03:20:03.976489 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2690/5157] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:03 2022] GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35 => generated 1306 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:04.091255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f76dcb64-1c7c-4909-b4ce-300ba8ac6361 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:04.092450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f76dcb64-1c7c-4909-b4ce-300ba8ac6361 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:04.103829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f76dcb64-1c7c-4909-b4ce-300ba8ac6361 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:04.105632 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f76dcb64-1c7c-4909-b4ce-300ba8ac6361 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:04.127126 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f76dcb64-1c7c-4909-b4ce-300ba8ac6361 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:04.129493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f76dcb64-1c7c-4909-b4ce-300ba8ac6361 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:04.131028 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f76dcb64-1c7c-4909-b4ce-300ba8ac6361 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:04.134830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f76dcb64-1c7c-4909-b4ce-300ba8ac6361 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:04.310535 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f76dcb64-1c7c-4909-b4ce-300ba8ac6361 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:04.320790 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f76dcb64-1c7c-4909-b4ce-300ba8ac6361 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1335 microversion: 2.1 time: 0.232589 Oct 29 03:20:04.322270 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2468/5158] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:04 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1335 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:04.556165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5c8150e7-3311-4307-b040-510d00488be1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:04.556957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5c8150e7-3311-4307-b040-510d00488be1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:04.568914 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c8150e7-3311-4307-b040-510d00488be1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:04.569322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c8150e7-3311-4307-b040-510d00488be1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:04.569757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c8150e7-3311-4307-b040-510d00488be1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:04.583064 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c8150e7-3311-4307-b040-510d00488be1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:04.583914 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c8150e7-3311-4307-b040-510d00488be1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:04.586779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5c8150e7-3311-4307-b040-510d00488be1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:04.999291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f361906c-e7c4-4b28-be45-245998162eb4 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:05.000451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f361906c-e7c4-4b28-be45-245998162eb4 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 5562f723-95f1-4fc0-93db-b9b457324d35] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:05.017852 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f361906c-e7c4-4b28-be45-245998162eb4 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:05.019231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f361906c-e7c4-4b28-be45-245998162eb4 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:05.019898 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f361906c-e7c4-4b28-be45-245998162eb4 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:05.020914 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f361906c-e7c4-4b28-be45-245998162eb4 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:05.021540 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f361906c-e7c4-4b28-be45-245998162eb4 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:05.022175 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f361906c-e7c4-4b28-be45-245998162eb4 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:05.569326 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5c8150e7-3311-4307-b040-510d00488be1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:05.581163 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5c8150e7-3311-4307-b040-510d00488be1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1680 microversion: 2.1 time: 1.029794 Oct 29 03:20:05.599858 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2691/5159] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:04 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1680 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:05.614470 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8a9a9852-0e6f-4be1-bbf5-b56e62c389d3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:05.615114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8a9a9852-0e6f-4be1-bbf5-b56e62c389d3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:05.628312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:05.634262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8a9a9852-0e6f-4be1-bbf5-b56e62c389d3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:05.637357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8a9a9852-0e6f-4be1-bbf5-b56e62c389d3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:05.637849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8a9a9852-0e6f-4be1-bbf5-b56e62c389d3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:05.638613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8a9a9852-0e6f-4be1-bbf5-b56e62c389d3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:05.639074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8a9a9852-0e6f-4be1-bbf5-b56e62c389d3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:05.639503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8a9a9852-0e6f-4be1-bbf5-b56e62c389d3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:05.791201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8a9a9852-0e6f-4be1-bbf5-b56e62c389d3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:05.803692 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8a9a9852-0e6f-4be1-bbf5-b56e62c389d3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1323 microversion: 2.1 time: 0.200302 Oct 29 03:20:05.806241 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2692/5160] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:05 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1323 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:05.958590 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f361906c-e7c4-4b28-be45-245998162eb4 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:05.967419 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f361906c-e7c4-4b28-be45-245998162eb4 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35" status: 200 len: 1374 microversion: 2.1 time: 0.972758 Oct 29 03:20:05.988966 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2469/5161] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:04 2022] GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35 => generated 1374 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:20:06.605722 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-881f8845-68c2-4fae-a97f-5c87821b6945 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:06.607979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-881f8845-68c2-4fae-a97f-5c87821b6945 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:06.626660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-881f8845-68c2-4fae-a97f-5c87821b6945 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:06.627140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-881f8845-68c2-4fae-a97f-5c87821b6945 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:06.627576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-881f8845-68c2-4fae-a97f-5c87821b6945 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:06.628293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-881f8845-68c2-4fae-a97f-5c87821b6945 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:06.646177 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-881f8845-68c2-4fae-a97f-5c87821b6945 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:06.646757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-881f8845-68c2-4fae-a97f-5c87821b6945 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:06.830485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-86bcd61c-9f8a-4489-a58c-c8f4b52d830c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:06.831727 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-86bcd61c-9f8a-4489-a58c-c8f4b52d830c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:06.847171 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86bcd61c-9f8a-4489-a58c-c8f4b52d830c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:06.847676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86bcd61c-9f8a-4489-a58c-c8f4b52d830c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:06.848115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86bcd61c-9f8a-4489-a58c-c8f4b52d830c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:06.857107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86bcd61c-9f8a-4489-a58c-c8f4b52d830c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:06.857648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86bcd61c-9f8a-4489-a58c-c8f4b52d830c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:06.858104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86bcd61c-9f8a-4489-a58c-c8f4b52d830c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:07.246914 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-86bcd61c-9f8a-4489-a58c-c8f4b52d830c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:07.266088 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-86bcd61c-9f8a-4489-a58c-c8f4b52d830c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1323 microversion: 2.1 time: 0.439617 Oct 29 03:20:07.267745 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2470/5162] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:06 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1323 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:20:07.273177 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b830af2e-9717-42aa-84b8-5390bb942b22 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:07.274025 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b830af2e-9717-42aa-84b8-5390bb942b22 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 5562f723-95f1-4fc0-93db-b9b457324d35] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:07.283537 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b830af2e-9717-42aa-84b8-5390bb942b22 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:07.285711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b830af2e-9717-42aa-84b8-5390bb942b22 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:07.286832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b830af2e-9717-42aa-84b8-5390bb942b22 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:07.290373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b830af2e-9717-42aa-84b8-5390bb942b22 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:07.292039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b830af2e-9717-42aa-84b8-5390bb942b22 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:07.292715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b830af2e-9717-42aa-84b8-5390bb942b22 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:07.464878 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-881f8845-68c2-4fae-a97f-5c87821b6945 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:07.507749 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-881f8845-68c2-4fae-a97f-5c87821b6945 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1680 microversion: 2.1 time: 0.906240 Oct 29 03:20:07.512145 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2693/5163] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:06 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1680 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:07.717298 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b830af2e-9717-42aa-84b8-5390bb942b22 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:07.745804 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b830af2e-9717-42aa-84b8-5390bb942b22 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35" status: 200 len: 1374 microversion: 2.1 time: 0.475927 Oct 29 03:20:07.767911 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2471/5164] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:07 2022] GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35 => generated 1374 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:08.291773 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-148c1021-418b-41db-95cc-3787f13f7525 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:08.292395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-148c1021-418b-41db-95cc-3787f13f7525 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:08.319763 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-148c1021-418b-41db-95cc-3787f13f7525 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:08.324998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-148c1021-418b-41db-95cc-3787f13f7525 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:08.325504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-148c1021-418b-41db-95cc-3787f13f7525 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:08.326266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-148c1021-418b-41db-95cc-3787f13f7525 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:08.326729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-148c1021-418b-41db-95cc-3787f13f7525 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:08.342604 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-148c1021-418b-41db-95cc-3787f13f7525 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:08.542426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9b9db9c1-1f58-48a1-963e-29b9e9081709 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:08.549852 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9b9db9c1-1f58-48a1-963e-29b9e9081709 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:08.557400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b9db9c1-1f58-48a1-963e-29b9e9081709 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:08.558031 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b9db9c1-1f58-48a1-963e-29b9e9081709 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:08.558468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b9db9c1-1f58-48a1-963e-29b9e9081709 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:08.561159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b9db9c1-1f58-48a1-963e-29b9e9081709 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:08.561159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b9db9c1-1f58-48a1-963e-29b9e9081709 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:08.561159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b9db9c1-1f58-48a1-963e-29b9e9081709 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:08.923396 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-148c1021-418b-41db-95cc-3787f13f7525 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:08.934069 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-148c1021-418b-41db-95cc-3787f13f7525 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1390 microversion: 2.1 time: 0.648742 Oct 29 03:20:08.948697 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2694/5165] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:08 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1390 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:08.948697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-90e279a6-b602-45b5-9e17-712019bc92e7 req-b646a119-a93e-42ba-8b72-a3c2823fa6b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5562f723-95f1-4fc0-93db-b9b457324d35", "tag": "c306f18b-bb8b-4b3e-a0d9-6ced8168f711"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:08.958942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-90e279a6-b602-45b5-9e17-712019bc92e7 req-b646a119-a93e-42ba-8b72-a3c2823fa6b6 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:08.965521 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-90e279a6-b602-45b5-9e17-712019bc92e7 req-b646a119-a93e-42ba-8b72-a3c2823fa6b6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:08.969785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-90e279a6-b602-45b5-9e17-712019bc92e7 req-b646a119-a93e-42ba-8b72-a3c2823fa6b6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:09.020235 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-90e279a6-b602-45b5-9e17-712019bc92e7 req-b646a119-a93e-42ba-8b72-a3c2823fa6b6 service nova] Creating event network-changed:c306f18b-bb8b-4b3e-a0d9-6ced8168f711 for instance 5562f723-95f1-4fc0-93db-b9b457324d35 on n-h1-862967-2 Oct 29 03:20:09.025700 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-90e279a6-b602-45b5-9e17-712019bc92e7 req-b646a119-a93e-42ba-8b72-a3c2823fa6b6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089415 Oct 29 03:20:09.026436 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2695/5166] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:20:09.031999 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a7de0a83-88d4-496d-901f-ce2febb3c8a5 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:09.032928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a7de0a83-88d4-496d-901f-ce2febb3c8a5 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 5562f723-95f1-4fc0-93db-b9b457324d35] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:09.043431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7de0a83-88d4-496d-901f-ce2febb3c8a5 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:09.045119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7de0a83-88d4-496d-901f-ce2febb3c8a5 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:09.047348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7de0a83-88d4-496d-901f-ce2febb3c8a5 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:09.049497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7de0a83-88d4-496d-901f-ce2febb3c8a5 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:09.050916 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7de0a83-88d4-496d-901f-ce2febb3c8a5 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:09.052211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7de0a83-88d4-496d-901f-ce2febb3c8a5 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:09.336236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a7de0a83-88d4-496d-901f-ce2febb3c8a5 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:09.353901 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a7de0a83-88d4-496d-901f-ce2febb3c8a5 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35" status: 200 len: 1374 microversion: 2.1 time: 0.326229 Oct 29 03:20:09.355595 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2696/5167] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:09 2022] GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35 => generated 1374 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:09.783995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9b9db9c1-1f58-48a1-963e-29b9e9081709 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:09.805403 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9b9db9c1-1f58-48a1-963e-29b9e9081709 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1680 microversion: 2.1 time: 1.271643 Oct 29 03:20:09.808078 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2472/5168] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:08 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1680 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:09.959256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b1de5d50-8750-4cf5-9852-b756ed5a15a8 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:09.959943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b1de5d50-8750-4cf5-9852-b756ed5a15a8 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:09.973760 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b1de5d50-8750-4cf5-9852-b756ed5a15a8 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:09.974805 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b1de5d50-8750-4cf5-9852-b756ed5a15a8 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:09.975268 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b1de5d50-8750-4cf5-9852-b756ed5a15a8 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:09.977261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b1de5d50-8750-4cf5-9852-b756ed5a15a8 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:09.977669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b1de5d50-8750-4cf5-9852-b756ed5a15a8 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:09.979394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b1de5d50-8750-4cf5-9852-b756ed5a15a8 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:10.119640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:10.380321 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5a090111-da73-4f74-a86c-0d6a042ad983 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:10.382246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5a090111-da73-4f74-a86c-0d6a042ad983 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 5562f723-95f1-4fc0-93db-b9b457324d35] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:10.412055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b1de5d50-8750-4cf5-9852-b756ed5a15a8 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:10.421192 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b1de5d50-8750-4cf5-9852-b756ed5a15a8 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1390 microversion: 2.1 time: 0.466816 Oct 29 03:20:10.421784 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2697/5169] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:09 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1390 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:10.439690 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a090111-da73-4f74-a86c-0d6a042ad983 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:10.444036 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a090111-da73-4f74-a86c-0d6a042ad983 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:10.445851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a090111-da73-4f74-a86c-0d6a042ad983 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:10.450083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a090111-da73-4f74-a86c-0d6a042ad983 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:10.453515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a090111-da73-4f74-a86c-0d6a042ad983 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:10.459201 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a090111-da73-4f74-a86c-0d6a042ad983 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:10.821575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5a090111-da73-4f74-a86c-0d6a042ad983 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:10.833747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-750edaad-65b1-401e-ad2d-b5e8d6c0a901 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:10.834705 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-750edaad-65b1-401e-ad2d-b5e8d6c0a901 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:10.843153 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5a090111-da73-4f74-a86c-0d6a042ad983 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35" status: 200 len: 1374 microversion: 2.1 time: 0.467664 Oct 29 03:20:10.847761 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2473/5170] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:10 2022] GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35 => generated 1374 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:10.860855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-750edaad-65b1-401e-ad2d-b5e8d6c0a901 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:10.861602 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-750edaad-65b1-401e-ad2d-b5e8d6c0a901 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:10.862250 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-750edaad-65b1-401e-ad2d-b5e8d6c0a901 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:10.864142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-750edaad-65b1-401e-ad2d-b5e8d6c0a901 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:10.866107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-750edaad-65b1-401e-ad2d-b5e8d6c0a901 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:10.866786 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-750edaad-65b1-401e-ad2d-b5e8d6c0a901 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:11.114364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-3d773251-5bcf-4d2f-89cd-4913a5f51044 req-8f66ff0c-22b6-4546-9caf-29faab884465 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0568de01-669e-4f98-8ca7-3e358669ef8f", "tag": "c42a747a-f6ba-448c-a70e-519721103faf"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:11.133775 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3d773251-5bcf-4d2f-89cd-4913a5f51044 req-8f66ff0c-22b6-4546-9caf-29faab884465 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:11.134259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3d773251-5bcf-4d2f-89cd-4913a5f51044 req-8f66ff0c-22b6-4546-9caf-29faab884465 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:11.134691 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3d773251-5bcf-4d2f-89cd-4913a5f51044 req-8f66ff0c-22b6-4546-9caf-29faab884465 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:11.161164 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-750edaad-65b1-401e-ad2d-b5e8d6c0a901 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:11.164610 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-3d773251-5bcf-4d2f-89cd-4913a5f51044 req-8f66ff0c-22b6-4546-9caf-29faab884465 service nova] Creating event network-changed:c42a747a-f6ba-448c-a70e-519721103faf for instance 0568de01-669e-4f98-8ca7-3e358669ef8f on n-h1-862967-2 Oct 29 03:20:11.171048 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-750edaad-65b1-401e-ad2d-b5e8d6c0a901 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1680 microversion: 2.1 time: 0.341244 Oct 29 03:20:11.172015 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2698/5171] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:10 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1680 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:20:11.191363 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-3d773251-5bcf-4d2f-89cd-4913a5f51044 req-8f66ff0c-22b6-4546-9caf-29faab884465 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081851 Oct 29 03:20:11.192662 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2474/5172] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:20:11.447801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-badd6f32-da31-4a1d-8131-9265f9173093 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:11.448418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-badd6f32-da31-4a1d-8131-9265f9173093 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:11.450302 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=8 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:11.463472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-badd6f32-da31-4a1d-8131-9265f9173093 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:11.464421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-badd6f32-da31-4a1d-8131-9265f9173093 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:11.465311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-badd6f32-da31-4a1d-8131-9265f9173093 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:11.466303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-badd6f32-da31-4a1d-8131-9265f9173093 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:11.466864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-badd6f32-da31-4a1d-8131-9265f9173093 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:11.467493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-badd6f32-da31-4a1d-8131-9265f9173093 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:11.835974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-badd6f32-da31-4a1d-8131-9265f9173093 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:11.845595 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-badd6f32-da31-4a1d-8131-9265f9173093 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1390 microversion: 2.1 time: 0.401545 Oct 29 03:20:11.868100 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2699/5173] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:11 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1390 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:11.869004 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b7a07954-62c9-414b-9d24-ed8ea8ab7a77 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:11.871003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b7a07954-62c9-414b-9d24-ed8ea8ab7a77 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 5562f723-95f1-4fc0-93db-b9b457324d35] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:11.873263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:11.876267 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=12 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:11.886202 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7a07954-62c9-414b-9d24-ed8ea8ab7a77 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:11.895190 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7a07954-62c9-414b-9d24-ed8ea8ab7a77 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:11.897077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7a07954-62c9-414b-9d24-ed8ea8ab7a77 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:11.901463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7a07954-62c9-414b-9d24-ed8ea8ab7a77 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:11.910182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7a07954-62c9-414b-9d24-ed8ea8ab7a77 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:11.911866 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7a07954-62c9-414b-9d24-ed8ea8ab7a77 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:12.198836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b2c39e7b-34ae-4f91-9ba1-419c1e4e3102 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:12.200086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b2c39e7b-34ae-4f91-9ba1-419c1e4e3102 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:12.221360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b2c39e7b-34ae-4f91-9ba1-419c1e4e3102 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:12.222857 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b2c39e7b-34ae-4f91-9ba1-419c1e4e3102 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:12.225139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b2c39e7b-34ae-4f91-9ba1-419c1e4e3102 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:12.227176 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b2c39e7b-34ae-4f91-9ba1-419c1e4e3102 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:12.227658 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b2c39e7b-34ae-4f91-9ba1-419c1e4e3102 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:12.228771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b2c39e7b-34ae-4f91-9ba1-419c1e4e3102 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:12.319426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b7a07954-62c9-414b-9d24-ed8ea8ab7a77 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:12.332886 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b7a07954-62c9-414b-9d24-ed8ea8ab7a77 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35" status: 200 len: 1374 microversion: 2.1 time: 0.470038 Oct 29 03:20:12.333681 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2475/5174] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:11 2022] GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35 => generated 1374 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:12.621278 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b2c39e7b-34ae-4f91-9ba1-419c1e4e3102 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:12.638674 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b2c39e7b-34ae-4f91-9ba1-419c1e4e3102 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1680 microversion: 2.1 time: 0.446572 Oct 29 03:20:12.656431 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2700/5175] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:12 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1680 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:12.875521 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3345ecb1-7ff5-4483-9620-b1588fc2f984 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:12.876672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3345ecb1-7ff5-4483-9620-b1588fc2f984 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:12.893024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3345ecb1-7ff5-4483-9620-b1588fc2f984 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:12.896226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3345ecb1-7ff5-4483-9620-b1588fc2f984 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:12.898430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3345ecb1-7ff5-4483-9620-b1588fc2f984 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:12.900409 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3345ecb1-7ff5-4483-9620-b1588fc2f984 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:12.901747 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3345ecb1-7ff5-4483-9620-b1588fc2f984 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:12.903957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3345ecb1-7ff5-4483-9620-b1588fc2f984 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:13.363201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c5fcc26d-e174-4c6e-931d-8e7ae83f5802 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:13.363828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c5fcc26d-e174-4c6e-931d-8e7ae83f5802 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 5562f723-95f1-4fc0-93db-b9b457324d35] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:13.372117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5fcc26d-e174-4c6e-931d-8e7ae83f5802 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:13.373085 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5fcc26d-e174-4c6e-931d-8e7ae83f5802 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:13.375933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5fcc26d-e174-4c6e-931d-8e7ae83f5802 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:13.378063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5fcc26d-e174-4c6e-931d-8e7ae83f5802 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:13.379166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5fcc26d-e174-4c6e-931d-8e7ae83f5802 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:13.381749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5fcc26d-e174-4c6e-931d-8e7ae83f5802 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:13.419635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3345ecb1-7ff5-4483-9620-b1588fc2f984 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:13.428195 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3345ecb1-7ff5-4483-9620-b1588fc2f984 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1390 microversion: 2.1 time: 0.556607 Oct 29 03:20:13.428838 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2476/5176] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:12 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1390 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:13.722258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c5fcc26d-e174-4c6e-931d-8e7ae83f5802 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:13.734090 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c5fcc26d-e174-4c6e-931d-8e7ae83f5802 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35" status: 200 len: 1374 microversion: 2.1 time: 0.374858 Oct 29 03:20:13.735447 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2701/5177] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:13 2022] GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35 => generated 1374 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:14.128856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-88d22b1f-0261-4c7f-a7f9-628fc4ec08cf tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:14.129533 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-88d22b1f-0261-4c7f-a7f9-628fc4ec08cf tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:14.139197 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88d22b1f-0261-4c7f-a7f9-628fc4ec08cf tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:14.140142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88d22b1f-0261-4c7f-a7f9-628fc4ec08cf tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:14.140888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88d22b1f-0261-4c7f-a7f9-628fc4ec08cf tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:14.142423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88d22b1f-0261-4c7f-a7f9-628fc4ec08cf tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:14.143086 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88d22b1f-0261-4c7f-a7f9-628fc4ec08cf tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:14.150250 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88d22b1f-0261-4c7f-a7f9-628fc4ec08cf tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:14.455363 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-aa0d6300-8ec0-4259-b5a8-d8387d5a71fb tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:14.456154 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-aa0d6300-8ec0-4259-b5a8-d8387d5a71fb tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:14.465612 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aa0d6300-8ec0-4259-b5a8-d8387d5a71fb tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:14.466520 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aa0d6300-8ec0-4259-b5a8-d8387d5a71fb tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:14.467207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aa0d6300-8ec0-4259-b5a8-d8387d5a71fb tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:14.468193 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aa0d6300-8ec0-4259-b5a8-d8387d5a71fb tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:14.468999 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aa0d6300-8ec0-4259-b5a8-d8387d5a71fb tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:14.470115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aa0d6300-8ec0-4259-b5a8-d8387d5a71fb tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:14.521493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-88d22b1f-0261-4c7f-a7f9-628fc4ec08cf tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:14.531292 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-88d22b1f-0261-4c7f-a7f9-628fc4ec08cf tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1657 microversion: 2.1 time: 0.870483 Oct 29 03:20:14.537708 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2477/5178] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:13 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1657 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:14.564623 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-59364fc7-e54a-4ce8-833e-2d1961116fbb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:14.581292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59364fc7-e54a-4ce8-833e-2d1961116fbb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:14.583032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59364fc7-e54a-4ce8-833e-2d1961116fbb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:14.583722 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59364fc7-e54a-4ce8-833e-2d1961116fbb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:14.617631 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-59364fc7-e54a-4ce8-833e-2d1961116fbb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Going to try to start instance {{(pid=127125) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 29 03:20:14.676573 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-aa0d6300-8ec0-4259-b5a8-d8387d5a71fb tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:14.678941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:14.698738 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-aa0d6300-8ec0-4259-b5a8-d8387d5a71fb tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1390 microversion: 2.1 time: 0.250325 Oct 29 03:20:14.699436 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-59364fc7-e54a-4ce8-833e-2d1961116fbb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action" status: 202 len: 0 microversion: 2.1 time: 0.143724 Oct 29 03:20:14.701892 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2478/5179] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:20:14 2022] POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:20:14.715975 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2702/5180] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:14 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1390 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:14.726931 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0d82fe3f-9fa7-460f-ae1c-e983e9450b42 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:14.729006 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0d82fe3f-9fa7-460f-ae1c-e983e9450b42 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:14.766000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-932a8502-d057-4c7c-9ad5-3ab833b22cad tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:14.767646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-932a8502-d057-4c7c-9ad5-3ab833b22cad tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 5562f723-95f1-4fc0-93db-b9b457324d35] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:14.768080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0d82fe3f-9fa7-460f-ae1c-e983e9450b42 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:14.771731 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0d82fe3f-9fa7-460f-ae1c-e983e9450b42 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:14.772329 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0d82fe3f-9fa7-460f-ae1c-e983e9450b42 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:14.776515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-932a8502-d057-4c7c-9ad5-3ab833b22cad tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:14.781110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0d82fe3f-9fa7-460f-ae1c-e983e9450b42 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:14.781920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0d82fe3f-9fa7-460f-ae1c-e983e9450b42 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:14.782953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-932a8502-d057-4c7c-9ad5-3ab833b22cad tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:14.785629 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-932a8502-d057-4c7c-9ad5-3ab833b22cad tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:14.786498 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-932a8502-d057-4c7c-9ad5-3ab833b22cad tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:14.788243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-932a8502-d057-4c7c-9ad5-3ab833b22cad tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:14.788430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-932a8502-d057-4c7c-9ad5-3ab833b22cad tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:14.792838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0d82fe3f-9fa7-460f-ae1c-e983e9450b42 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:15.282267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-932a8502-d057-4c7c-9ad5-3ab833b22cad tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:15.299433 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-932a8502-d057-4c7c-9ad5-3ab833b22cad tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35" status: 200 len: 1374 microversion: 2.1 time: 0.538693 Oct 29 03:20:15.299575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0d82fe3f-9fa7-460f-ae1c-e983e9450b42 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:15.306132 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0d82fe3f-9fa7-460f-ae1c-e983e9450b42 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1666 microversion: 2.1 time: 0.599803 Oct 29 03:20:15.309716 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2479/5181] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:14 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1666 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:15.310306 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2703/5182] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:14 2022] GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35 => generated 1374 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:20:15.723641 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4bb5233b-57d7-4b88-8d9d-5cedfd97750b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:15.725637 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4bb5233b-57d7-4b88-8d9d-5cedfd97750b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:15.741184 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bb5233b-57d7-4b88-8d9d-5cedfd97750b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:15.743839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bb5233b-57d7-4b88-8d9d-5cedfd97750b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:15.744548 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bb5233b-57d7-4b88-8d9d-5cedfd97750b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:15.746924 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bb5233b-57d7-4b88-8d9d-5cedfd97750b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:15.748246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bb5233b-57d7-4b88-8d9d-5cedfd97750b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:15.749990 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bb5233b-57d7-4b88-8d9d-5cedfd97750b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:16.318919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fecde554-09bf-44a4-8667-a9544d342acc tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:16.320224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fecde554-09bf-44a4-8667-a9544d342acc tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 5562f723-95f1-4fc0-93db-b9b457324d35] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:16.331844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fecde554-09bf-44a4-8667-a9544d342acc tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:16.335812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fecde554-09bf-44a4-8667-a9544d342acc tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:16.337824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fecde554-09bf-44a4-8667-a9544d342acc tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:16.340551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fecde554-09bf-44a4-8667-a9544d342acc tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:16.341695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fecde554-09bf-44a4-8667-a9544d342acc tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:16.342335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fecde554-09bf-44a4-8667-a9544d342acc tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:16.543314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4bb5233b-57d7-4b88-8d9d-5cedfd97750b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:16.563150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:16.566826 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4bb5233b-57d7-4b88-8d9d-5cedfd97750b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1390 microversion: 2.1 time: 0.847934 Oct 29 03:20:16.568674 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2480/5183] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:15 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1390 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:20:16.579747 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b6326655-afe2-463b-978a-8371da5fa463 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:16.586280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b6326655-afe2-463b-978a-8371da5fa463 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:16.592219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fecde554-09bf-44a4-8667-a9544d342acc tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:16.597118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6326655-afe2-463b-978a-8371da5fa463 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:16.597842 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6326655-afe2-463b-978a-8371da5fa463 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:16.598494 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6326655-afe2-463b-978a-8371da5fa463 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:16.599539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6326655-afe2-463b-978a-8371da5fa463 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:16.600242 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6326655-afe2-463b-978a-8371da5fa463 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:16.603172 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fecde554-09bf-44a4-8667-a9544d342acc tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35" status: 200 len: 1374 microversion: 2.1 time: 0.288510 Oct 29 03:20:16.616899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6326655-afe2-463b-978a-8371da5fa463 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:16.618062 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2704/5184] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:16 2022] GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35 => generated 1374 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:17.078955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b6326655-afe2-463b-978a-8371da5fa463 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:17.091594 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b6326655-afe2-463b-978a-8371da5fa463 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.518607 Oct 29 03:20:17.092435 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2481/5185] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:16 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:17.118706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3c5c0c0e-ba80-4e79-b36b-277d60f78968 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:17.119298 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3c5c0c0e-ba80-4e79-b36b-277d60f78968 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:17.141107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c5c0c0e-ba80-4e79-b36b-277d60f78968 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:17.142709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c5c0c0e-ba80-4e79-b36b-277d60f78968 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:17.147148 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c5c0c0e-ba80-4e79-b36b-277d60f78968 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:17.148193 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c5c0c0e-ba80-4e79-b36b-277d60f78968 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:17.149192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c5c0c0e-ba80-4e79-b36b-277d60f78968 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:17.152401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c5c0c0e-ba80-4e79-b36b-277d60f78968 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:17.593095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5e2d9ca3-a15c-4d9f-99bf-2343163998f5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:17.593875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5e2d9ca3-a15c-4d9f-99bf-2343163998f5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:17.612160 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e2d9ca3-a15c-4d9f-99bf-2343163998f5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:17.621155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e2d9ca3-a15c-4d9f-99bf-2343163998f5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:17.621745 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e2d9ca3-a15c-4d9f-99bf-2343163998f5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:17.622606 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e2d9ca3-a15c-4d9f-99bf-2343163998f5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:17.623180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e2d9ca3-a15c-4d9f-99bf-2343163998f5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:17.623707 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e2d9ca3-a15c-4d9f-99bf-2343163998f5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:17.811346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3c5c0c0e-ba80-4e79-b36b-277d60f78968 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:17.821155 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3c5c0c0e-ba80-4e79-b36b-277d60f78968 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.706292 Oct 29 03:20:17.838401 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2705/5186] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:17 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:17.843434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b12725e0-202e-4b56-86a0-f90e69f8f06d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:17.844328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b12725e0-202e-4b56-86a0-f90e69f8f06d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 5562f723-95f1-4fc0-93db-b9b457324d35] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:17.867271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b12725e0-202e-4b56-86a0-f90e69f8f06d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:17.869412 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b12725e0-202e-4b56-86a0-f90e69f8f06d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:17.870081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b12725e0-202e-4b56-86a0-f90e69f8f06d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:17.876711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b12725e0-202e-4b56-86a0-f90e69f8f06d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:17.877944 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b12725e0-202e-4b56-86a0-f90e69f8f06d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:17.879604 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b12725e0-202e-4b56-86a0-f90e69f8f06d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:18.375530 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5e2d9ca3-a15c-4d9f-99bf-2343163998f5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:18.391438 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5e2d9ca3-a15c-4d9f-99bf-2343163998f5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1390 microversion: 2.1 time: 0.802922 Oct 29 03:20:18.392371 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2482/5187] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:17 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1390 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:20:18.409326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d242d2f4-e14c-4c0e-aa75-ebc606b1dd1c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:18.409878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d242d2f4-e14c-4c0e-aa75-ebc606b1dd1c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:18.444571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d242d2f4-e14c-4c0e-aa75-ebc606b1dd1c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:18.445124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d242d2f4-e14c-4c0e-aa75-ebc606b1dd1c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:18.445578 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d242d2f4-e14c-4c0e-aa75-ebc606b1dd1c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:18.446319 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d242d2f4-e14c-4c0e-aa75-ebc606b1dd1c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:18.446779 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d242d2f4-e14c-4c0e-aa75-ebc606b1dd1c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:18.447207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d242d2f4-e14c-4c0e-aa75-ebc606b1dd1c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:18.559776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b12725e0-202e-4b56-86a0-f90e69f8f06d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:18.567783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d242d2f4-e14c-4c0e-aa75-ebc606b1dd1c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Unlocking {{(pid=127125) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 29 03:20:18.574877 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b12725e0-202e-4b56-86a0-f90e69f8f06d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35" status: 200 len: 1374 microversion: 2.1 time: 0.734143 Oct 29 03:20:18.576768 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2706/5188] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:17 2022] GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35 => generated 1374 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:18.583779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-1274dd8d-8a83-47a3-8b04-d921b20d766f req-836cd16d-7073-4532-9ecb-8bdf40ffaf17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5562f723-95f1-4fc0-93db-b9b457324d35", "name": "network-vif-plugged", "status": "completed", "tag": "c306f18b-bb8b-4b3e-a0d9-6ced8168f711"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:18.602683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1274dd8d-8a83-47a3-8b04-d921b20d766f req-836cd16d-7073-4532-9ecb-8bdf40ffaf17 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:18.603252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1274dd8d-8a83-47a3-8b04-d921b20d766f req-836cd16d-7073-4532-9ecb-8bdf40ffaf17 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:18.604214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1274dd8d-8a83-47a3-8b04-d921b20d766f req-836cd16d-7073-4532-9ecb-8bdf40ffaf17 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:18.622950 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-1274dd8d-8a83-47a3-8b04-d921b20d766f req-836cd16d-7073-4532-9ecb-8bdf40ffaf17 service nova] Creating event network-vif-plugged:c306f18b-bb8b-4b3e-a0d9-6ced8168f711 for instance 5562f723-95f1-4fc0-93db-b9b457324d35 on n-h1-862967-2 Oct 29 03:20:18.631182 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-1274dd8d-8a83-47a3-8b04-d921b20d766f req-836cd16d-7073-4532-9ecb-8bdf40ffaf17 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052991 Oct 29 03:20:18.632145 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2707/5189] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:20:18.712281 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d242d2f4-e14c-4c0e-aa75-ebc606b1dd1c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action" status: 202 len: 0 microversion: 2.1 time: 0.312922 Oct 29 03:20:18.713260 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2483/5190] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:20:18 2022] POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:20:18.728633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e6054f6d-4672-479b-bc76-ecfd94e05e8e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:18.729726 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e6054f6d-4672-479b-bc76-ecfd94e05e8e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:18.745931 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6054f6d-4672-479b-bc76-ecfd94e05e8e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:18.748741 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6054f6d-4672-479b-bc76-ecfd94e05e8e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:18.751022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6054f6d-4672-479b-bc76-ecfd94e05e8e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:18.754309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6054f6d-4672-479b-bc76-ecfd94e05e8e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:18.755185 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6054f6d-4672-479b-bc76-ecfd94e05e8e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:18.755873 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e6054f6d-4672-479b-bc76-ecfd94e05e8e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:19.178071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e6054f6d-4672-479b-bc76-ecfd94e05e8e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:19.196207 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e6054f6d-4672-479b-bc76-ecfd94e05e8e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.476835 Oct 29 03:20:19.197188 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2708/5191] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:18 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:20:19.226355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f3def4a1-926d-475f-bdfe-1ef6e8da4a18 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:19.226997 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f3def4a1-926d-475f-bdfe-1ef6e8da4a18 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:19.235123 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3def4a1-926d-475f-bdfe-1ef6e8da4a18 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:19.235925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3def4a1-926d-475f-bdfe-1ef6e8da4a18 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:19.236645 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3def4a1-926d-475f-bdfe-1ef6e8da4a18 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:19.237579 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3def4a1-926d-475f-bdfe-1ef6e8da4a18 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:19.238758 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3def4a1-926d-475f-bdfe-1ef6e8da4a18 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:19.239359 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3def4a1-926d-475f-bdfe-1ef6e8da4a18 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:19.421178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7495f184-6b2f-439a-b58d-8713e0d23b13 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:19.422740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7495f184-6b2f-439a-b58d-8713e0d23b13 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:19.441721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7495f184-6b2f-439a-b58d-8713e0d23b13 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:19.442503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7495f184-6b2f-439a-b58d-8713e0d23b13 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:19.443825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7495f184-6b2f-439a-b58d-8713e0d23b13 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:19.448321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7495f184-6b2f-439a-b58d-8713e0d23b13 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:19.449381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7495f184-6b2f-439a-b58d-8713e0d23b13 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:19.450723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7495f184-6b2f-439a-b58d-8713e0d23b13 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:19.704121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f3def4a1-926d-475f-bdfe-1ef6e8da4a18 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:19.723634 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f3def4a1-926d-475f-bdfe-1ef6e8da4a18 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.502034 Oct 29 03:20:19.725383 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2484/5192] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:19 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:19.753480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7495f184-6b2f-439a-b58d-8713e0d23b13 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:19.754422 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a040ae0e-6988-4f95-b903-639553137b71 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:19.755300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a040ae0e-6988-4f95-b903-639553137b71 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 5562f723-95f1-4fc0-93db-b9b457324d35] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:19.761941 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a040ae0e-6988-4f95-b903-639553137b71 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:19.762680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a040ae0e-6988-4f95-b903-639553137b71 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:19.763466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a040ae0e-6988-4f95-b903-639553137b71 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:19.764396 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a040ae0e-6988-4f95-b903-639553137b71 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:19.764757 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7495f184-6b2f-439a-b58d-8713e0d23b13 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1390 microversion: 2.1 time: 0.353804 Oct 29 03:20:19.765220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a040ae0e-6988-4f95-b903-639553137b71 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:19.765350 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2709/5193] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:19 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1390 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:19.766194 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a040ae0e-6988-4f95-b903-639553137b71 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:19.788010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-173b9fbc-21c7-4da2-a676-52ac185029ef tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:19.792743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-173b9fbc-21c7-4da2-a676-52ac185029ef tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:19.813788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-173b9fbc-21c7-4da2-a676-52ac185029ef tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:19.815347 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-173b9fbc-21c7-4da2-a676-52ac185029ef tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:19.816715 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-173b9fbc-21c7-4da2-a676-52ac185029ef tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:19.819794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-173b9fbc-21c7-4da2-a676-52ac185029ef tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:19.821743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-173b9fbc-21c7-4da2-a676-52ac185029ef tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:19.822409 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-173b9fbc-21c7-4da2-a676-52ac185029ef tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:20.134445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-173b9fbc-21c7-4da2-a676-52ac185029ef tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:20.147904 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-173b9fbc-21c7-4da2-a676-52ac185029ef tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.374071 Oct 29 03:20:20.149113 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2710/5194] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:19 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:20.189991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8c09d3dd-563f-410e-b6ae-e632b066a34f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:20.192316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8c09d3dd-563f-410e-b6ae-e632b066a34f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:20.210472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c09d3dd-563f-410e-b6ae-e632b066a34f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:20.211567 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c09d3dd-563f-410e-b6ae-e632b066a34f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:20.213134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c09d3dd-563f-410e-b6ae-e632b066a34f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:20.214326 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c09d3dd-563f-410e-b6ae-e632b066a34f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:20.214952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c09d3dd-563f-410e-b6ae-e632b066a34f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:20.217137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c09d3dd-563f-410e-b6ae-e632b066a34f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:20.233464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a040ae0e-6988-4f95-b903-639553137b71 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:20.267514 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a040ae0e-6988-4f95-b903-639553137b71 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35" status: 200 len: 1374 microversion: 2.1 time: 0.517833 Oct 29 03:20:20.268222 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2485/5195] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:19 2022] GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35 => generated 1374 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:20.351340 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8c09d3dd-563f-410e-b6ae-e632b066a34f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action" status: 202 len: 0 microversion: 2.1 time: 0.181461 Oct 29 03:20:20.356101 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2711/5196] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:20:20 2022] POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:20:20.361033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ee7e98b7-5b49-4dcc-8ef7-2c80359c764b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:20.361779 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ee7e98b7-5b49-4dcc-8ef7-2c80359c764b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:20.386637 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee7e98b7-5b49-4dcc-8ef7-2c80359c764b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:20.387133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee7e98b7-5b49-4dcc-8ef7-2c80359c764b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:20.387572 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee7e98b7-5b49-4dcc-8ef7-2c80359c764b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:20.388292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee7e98b7-5b49-4dcc-8ef7-2c80359c764b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:20.388785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee7e98b7-5b49-4dcc-8ef7-2c80359c764b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:20.397668 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee7e98b7-5b49-4dcc-8ef7-2c80359c764b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:20.776451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ee7e98b7-5b49-4dcc-8ef7-2c80359c764b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:20.791074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-06439c00-8f57-4c63-863a-f3662e4ed957 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:20.791074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-06439c00-8f57-4c63-863a-f3662e4ed957 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:20.794059 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ee7e98b7-5b49-4dcc-8ef7-2c80359c764b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1675 microversion: 2.1 time: 0.437091 Oct 29 03:20:20.804234 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2486/5197] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:20 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1675 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:20:20.806001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06439c00-8f57-4c63-863a-f3662e4ed957 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:20.807080 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06439c00-8f57-4c63-863a-f3662e4ed957 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:20.807808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06439c00-8f57-4c63-863a-f3662e4ed957 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:20.808838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06439c00-8f57-4c63-863a-f3662e4ed957 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:20.810195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06439c00-8f57-4c63-863a-f3662e4ed957 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:20.811139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06439c00-8f57-4c63-863a-f3662e4ed957 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:21.089206 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-06439c00-8f57-4c63-863a-f3662e4ed957 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:21.103371 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-06439c00-8f57-4c63-863a-f3662e4ed957 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1390 microversion: 2.1 time: 0.319675 Oct 29 03:20:21.123672 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2712/5198] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:20 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1390 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:20:21.238300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4156e24e-8242-4579-a101-deae5118d8c1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:21.238798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4156e24e-8242-4579-a101-deae5118d8c1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:21.246842 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4156e24e-8242-4579-a101-deae5118d8c1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:21.247326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4156e24e-8242-4579-a101-deae5118d8c1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:21.247761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4156e24e-8242-4579-a101-deae5118d8c1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:21.248457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4156e24e-8242-4579-a101-deae5118d8c1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:21.248932 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4156e24e-8242-4579-a101-deae5118d8c1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:21.251429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4156e24e-8242-4579-a101-deae5118d8c1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:21.292990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5e6300d2-7bbe-46e8-ab7c-6a994f69e968 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:21.293886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5e6300d2-7bbe-46e8-ab7c-6a994f69e968 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 5562f723-95f1-4fc0-93db-b9b457324d35] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:21.308217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e6300d2-7bbe-46e8-ab7c-6a994f69e968 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:21.308739 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e6300d2-7bbe-46e8-ab7c-6a994f69e968 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:21.315757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e6300d2-7bbe-46e8-ab7c-6a994f69e968 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:21.317937 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e6300d2-7bbe-46e8-ab7c-6a994f69e968 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:21.320180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e6300d2-7bbe-46e8-ab7c-6a994f69e968 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:21.320858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e6300d2-7bbe-46e8-ab7c-6a994f69e968 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:21.323723 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4156e24e-8242-4579-a101-deae5118d8c1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0/ips" status: 200 len: 149 microversion: 2.1 time: 0.088406 Oct 29 03:20:21.326064 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2487/5199] 10.222.0.46 () {58 vars in 1248 bytes} [Sat Oct 29 03:20:21 2022] GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0/ips => generated 149 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:20:21.650064 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5e6300d2-7bbe-46e8-ab7c-6a994f69e968 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:21.662018 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5e6300d2-7bbe-46e8-ab7c-6a994f69e968 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35" status: 200 len: 1545 microversion: 2.1 time: 0.373878 Oct 29 03:20:21.677799 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2713/5200] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:21 2022] GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35 => generated 1545 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:21.693916 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0e8f37c5-ae93-4f3f-a9ab-17903e12ff8d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:21.694576 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0e8f37c5-ae93-4f3f-a9ab-17903e12ff8d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 5562f723-95f1-4fc0-93db-b9b457324d35] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:21.704768 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0e8f37c5-ae93-4f3f-a9ab-17903e12ff8d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:21.714423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0e8f37c5-ae93-4f3f-a9ab-17903e12ff8d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:21.714879 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0e8f37c5-ae93-4f3f-a9ab-17903e12ff8d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:21.720760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0e8f37c5-ae93-4f3f-a9ab-17903e12ff8d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:21.721337 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0e8f37c5-ae93-4f3f-a9ab-17903e12ff8d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:21.736193 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0e8f37c5-ae93-4f3f-a9ab-17903e12ff8d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:21.820117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a053c87f-c72a-45f9-b808-02b94326a820 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:21.820790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a053c87f-c72a-45f9-b808-02b94326a820 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:21.839623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a053c87f-c72a-45f9-b808-02b94326a820 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:21.840641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a053c87f-c72a-45f9-b808-02b94326a820 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:21.842862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a053c87f-c72a-45f9-b808-02b94326a820 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:21.850743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a053c87f-c72a-45f9-b808-02b94326a820 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:21.851311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a053c87f-c72a-45f9-b808-02b94326a820 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:21.857330 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a053c87f-c72a-45f9-b808-02b94326a820 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:22.184962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a053c87f-c72a-45f9-b808-02b94326a820 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:22.195478 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a053c87f-c72a-45f9-b808-02b94326a820 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1655 microversion: 2.1 time: 0.379195 Oct 29 03:20:22.210490 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2714/5201] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:21 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1655 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:22.221704 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ed341523-de28-4462-b250-c44d910d1b53 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:22.224565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ed341523-de28-4462-b250-c44d910d1b53 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:22.236984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed341523-de28-4462-b250-c44d910d1b53 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:22.237827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed341523-de28-4462-b250-c44d910d1b53 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:22.239876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed341523-de28-4462-b250-c44d910d1b53 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:22.240911 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed341523-de28-4462-b250-c44d910d1b53 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:22.241676 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed341523-de28-4462-b250-c44d910d1b53 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:22.242388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed341523-de28-4462-b250-c44d910d1b53 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:22.434289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0e8f37c5-ae93-4f3f-a9ab-17903e12ff8d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:22.452453 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0e8f37c5-ae93-4f3f-a9ab-17903e12ff8d tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35" status: 200 len: 1545 microversion: 2.1 time: 0.764067 Oct 29 03:20:22.477789 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2488/5202] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:21 2022] GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35 => generated 1545 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:22.490466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-70df3f35-04f0-4afb-8dc2-8cbd1fec5320 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:22.494609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-70df3f35-04f0-4afb-8dc2-8cbd1fec5320 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:22.509640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70df3f35-04f0-4afb-8dc2-8cbd1fec5320 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:22.510251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70df3f35-04f0-4afb-8dc2-8cbd1fec5320 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:22.512267 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70df3f35-04f0-4afb-8dc2-8cbd1fec5320 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:22.518057 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70df3f35-04f0-4afb-8dc2-8cbd1fec5320 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:22.519041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70df3f35-04f0-4afb-8dc2-8cbd1fec5320 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:22.519728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70df3f35-04f0-4afb-8dc2-8cbd1fec5320 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:22.537476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ed341523-de28-4462-b250-c44d910d1b53 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:22.553148 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ed341523-de28-4462-b250-c44d910d1b53 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1390 microversion: 2.1 time: 0.338611 Oct 29 03:20:22.555245 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2715/5203] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:22 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1390 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:22.689233 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-70df3f35-04f0-4afb-8dc2-8cbd1fec5320 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action" status: 202 len: 0 microversion: 2.1 time: 0.209275 Oct 29 03:20:22.690131 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2489/5204] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:20:22 2022] POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:20:22.700008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e78c8703-3eba-400b-add6-f0e20c5985b5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:22.700852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e78c8703-3eba-400b-add6-f0e20c5985b5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:22.711393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e78c8703-3eba-400b-add6-f0e20c5985b5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:22.711929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e78c8703-3eba-400b-add6-f0e20c5985b5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:22.714466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e78c8703-3eba-400b-add6-f0e20c5985b5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:22.717736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e78c8703-3eba-400b-add6-f0e20c5985b5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:22.719785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e78c8703-3eba-400b-add6-f0e20c5985b5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:22.722163 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e78c8703-3eba-400b-add6-f0e20c5985b5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:23.327337 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-a3bca69e-46f0-4031-a43a-2b57a367a90e req-fe6b01e0-9148-4279-9f01-23fbc3d8cd36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0568de01-669e-4f98-8ca7-3e358669ef8f", "name": "network-vif-plugged", "status": "completed", "tag": "c42a747a-f6ba-448c-a70e-519721103faf"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:23.359823 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a3bca69e-46f0-4031-a43a-2b57a367a90e req-fe6b01e0-9148-4279-9f01-23fbc3d8cd36 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:23.360315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a3bca69e-46f0-4031-a43a-2b57a367a90e req-fe6b01e0-9148-4279-9f01-23fbc3d8cd36 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:23.360774 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a3bca69e-46f0-4031-a43a-2b57a367a90e req-fe6b01e0-9148-4279-9f01-23fbc3d8cd36 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:23.414837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e78c8703-3eba-400b-add6-f0e20c5985b5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:23.423362 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-a3bca69e-46f0-4031-a43a-2b57a367a90e req-fe6b01e0-9148-4279-9f01-23fbc3d8cd36 service nova] Creating event network-vif-plugged:c42a747a-f6ba-448c-a70e-519721103faf for instance 0568de01-669e-4f98-8ca7-3e358669ef8f on n-h1-862967-2 Oct 29 03:20:23.432687 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e78c8703-3eba-400b-add6-f0e20c5985b5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1662 microversion: 2.1 time: 0.737447 Oct 29 03:20:23.433311 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2716/5205] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:22 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1662 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:23.457545 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-a3bca69e-46f0-4031-a43a-2b57a367a90e req-fe6b01e0-9148-4279-9f01-23fbc3d8cd36 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138513 Oct 29 03:20:23.459364 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2490/5206] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:20:23.582207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e45bcad9-ae2c-448b-b54d-673413c2c000 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:23.583576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e45bcad9-ae2c-448b-b54d-673413c2c000 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:23.593609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e45bcad9-ae2c-448b-b54d-673413c2c000 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:23.594365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e45bcad9-ae2c-448b-b54d-673413c2c000 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:23.594979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e45bcad9-ae2c-448b-b54d-673413c2c000 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:23.596003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e45bcad9-ae2c-448b-b54d-673413c2c000 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:23.596961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e45bcad9-ae2c-448b-b54d-673413c2c000 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:23.597558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e45bcad9-ae2c-448b-b54d-673413c2c000 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:23.961331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e45bcad9-ae2c-448b-b54d-673413c2c000 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:23.975483 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e45bcad9-ae2c-448b-b54d-673413c2c000 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1390 microversion: 2.1 time: 0.398718 Oct 29 03:20:23.988347 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2717/5207] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:23 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1390 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:24.462154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a980b73a-5205-4cd6-b7f1-c1c3c329b422 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:24.463595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a980b73a-5205-4cd6-b7f1-c1c3c329b422 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:24.475414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a980b73a-5205-4cd6-b7f1-c1c3c329b422 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:24.476915 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a980b73a-5205-4cd6-b7f1-c1c3c329b422 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:24.477526 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a980b73a-5205-4cd6-b7f1-c1c3c329b422 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:24.480545 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a980b73a-5205-4cd6-b7f1-c1c3c329b422 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:24.483391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a980b73a-5205-4cd6-b7f1-c1c3c329b422 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:24.484761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a980b73a-5205-4cd6-b7f1-c1c3c329b422 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:25.013853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-77e83d14-ad07-40e6-920b-7b6b35898e56 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:25.014655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-77e83d14-ad07-40e6-920b-7b6b35898e56 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:25.034795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-77e83d14-ad07-40e6-920b-7b6b35898e56 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:25.035307 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-77e83d14-ad07-40e6-920b-7b6b35898e56 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:25.035747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-77e83d14-ad07-40e6-920b-7b6b35898e56 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:25.036482 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-77e83d14-ad07-40e6-920b-7b6b35898e56 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:25.039937 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-77e83d14-ad07-40e6-920b-7b6b35898e56 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:25.067238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-77e83d14-ad07-40e6-920b-7b6b35898e56 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:25.149855 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a980b73a-5205-4cd6-b7f1-c1c3c329b422 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:25.159666 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a980b73a-5205-4cd6-b7f1-c1c3c329b422 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.702974 Oct 29 03:20:25.162174 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2491/5208] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:24 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:25.190182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-787cacaf-0cc7-490a-8104-e419929a745a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:25.193254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-787cacaf-0cc7-490a-8104-e419929a745a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:25.208302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-787cacaf-0cc7-490a-8104-e419929a745a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:25.212128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-787cacaf-0cc7-490a-8104-e419929a745a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:25.217878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-787cacaf-0cc7-490a-8104-e419929a745a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:25.230253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-787cacaf-0cc7-490a-8104-e419929a745a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:25.232427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-787cacaf-0cc7-490a-8104-e419929a745a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:25.234096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-787cacaf-0cc7-490a-8104-e419929a745a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:25.763014 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-77e83d14-ad07-40e6-920b-7b6b35898e56 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:25.777977 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-77e83d14-ad07-40e6-920b-7b6b35898e56 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1390 microversion: 2.1 time: 0.768105 Oct 29 03:20:25.796231 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2718/5209] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:25 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1390 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:20:25.808537 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-27e5984c-267b-4ca8-addc-9c702f2ef705 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c052df0-e6e3-423b-9e88-bd190fe33229"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:25.813509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-27e5984c-267b-4ca8-addc-9c702f2ef705 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:25.827829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27e5984c-267b-4ca8-addc-9c702f2ef705 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:25.828288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27e5984c-267b-4ca8-addc-9c702f2ef705 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:25.830904 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27e5984c-267b-4ca8-addc-9c702f2ef705 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:25.831707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27e5984c-267b-4ca8-addc-9c702f2ef705 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:25.832187 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27e5984c-267b-4ca8-addc-9c702f2ef705 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:25.832658 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27e5984c-267b-4ca8-addc-9c702f2ef705 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:25.846261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:26.186679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-787cacaf-0cc7-490a-8104-e419929a745a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:26.198797 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-787cacaf-0cc7-490a-8104-e419929a745a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 1.015760 Oct 29 03:20:26.207435 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2492/5210] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:25 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:20:26.236657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0122307e-b860-4bed-a7d5-a1a6a6ff54ac tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:26.238611 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0122307e-b860-4bed-a7d5-a1a6a6ff54ac tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:26.290632 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0122307e-b860-4bed-a7d5-a1a6a6ff54ac tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:26.294250 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0122307e-b860-4bed-a7d5-a1a6a6ff54ac tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:26.296461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0122307e-b860-4bed-a7d5-a1a6a6ff54ac tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:26.299089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0122307e-b860-4bed-a7d5-a1a6a6ff54ac tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:26.301076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0122307e-b860-4bed-a7d5-a1a6a6ff54ac tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:26.302367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0122307e-b860-4bed-a7d5-a1a6a6ff54ac tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:26.421822 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-27e5984c-267b-4ca8-addc-9c702f2ef705 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "POST /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.623776 Oct 29 03:20:26.423173 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2719/5211] 10.222.0.46 () {60 vars in 1323 bytes} [Sat Oct 29 03:20:25 2022] POST /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0/os-volume_attachments => generated 194 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:20:26.734967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0122307e-b860-4bed-a7d5-a1a6a6ff54ac tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:26.749288 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0122307e-b860-4bed-a7d5-a1a6a6ff54ac tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.519519 Oct 29 03:20:26.761705 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2493/5212] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:26 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:26.778949 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-087fee75-1f93-47bd-a101-9fc70cc85d2d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:26.780129 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-087fee75-1f93-47bd-a101-9fc70cc85d2d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:26.810712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0141b837-f1e2-47b3-8a04-e68bdca08548 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:26.811679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0141b837-f1e2-47b3-8a04-e68bdca08548 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:26.822209 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0141b837-f1e2-47b3-8a04-e68bdca08548 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:26.823675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-087fee75-1f93-47bd-a101-9fc70cc85d2d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:26.825177 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-087fee75-1f93-47bd-a101-9fc70cc85d2d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:26.825854 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0141b837-f1e2-47b3-8a04-e68bdca08548 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:26.826376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0141b837-f1e2-47b3-8a04-e68bdca08548 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:26.827684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0141b837-f1e2-47b3-8a04-e68bdca08548 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:26.831792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0141b837-f1e2-47b3-8a04-e68bdca08548 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:26.834391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0141b837-f1e2-47b3-8a04-e68bdca08548 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:26.838951 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-087fee75-1f93-47bd-a101-9fc70cc85d2d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:26.839814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-087fee75-1f93-47bd-a101-9fc70cc85d2d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:26.840305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-087fee75-1f93-47bd-a101-9fc70cc85d2d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:26.840777 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-087fee75-1f93-47bd-a101-9fc70cc85d2d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:27.287004 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0141b837-f1e2-47b3-8a04-e68bdca08548 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:27.292442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:27.318705 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0141b837-f1e2-47b3-8a04-e68bdca08548 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1562 microversion: 2.1 time: 0.506503 Oct 29 03:20:27.340905 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2494/5213] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:26 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1562 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:27.361066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6467b334-c276-4655-bcdf-ed943430342d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:27.361746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6467b334-c276-4655-bcdf-ed943430342d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:27.388482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:27.390336 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6467b334-c276-4655-bcdf-ed943430342d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:27.390980 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6467b334-c276-4655-bcdf-ed943430342d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:27.392437 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6467b334-c276-4655-bcdf-ed943430342d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:27.398066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6467b334-c276-4655-bcdf-ed943430342d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:27.398826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6467b334-c276-4655-bcdf-ed943430342d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:27.399437 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6467b334-c276-4655-bcdf-ed943430342d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:27.597293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-087fee75-1f93-47bd-a101-9fc70cc85d2d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:27.620752 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-087fee75-1f93-47bd-a101-9fc70cc85d2d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.847739 Oct 29 03:20:27.635763 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2720/5214] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:26 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:27.655579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7db4d481-9a29-421b-ac3d-c6d13378597b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:27.656389 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7db4d481-9a29-421b-ac3d-c6d13378597b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:27.679125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7db4d481-9a29-421b-ac3d-c6d13378597b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:27.682143 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7db4d481-9a29-421b-ac3d-c6d13378597b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:27.684549 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7db4d481-9a29-421b-ac3d-c6d13378597b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:27.685481 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7db4d481-9a29-421b-ac3d-c6d13378597b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:27.686119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7db4d481-9a29-421b-ac3d-c6d13378597b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:27.691126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7db4d481-9a29-421b-ac3d-c6d13378597b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:27.908172 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6467b334-c276-4655-bcdf-ed943430342d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:27.919894 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6467b334-c276-4655-bcdf-ed943430342d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1562 microversion: 2.1 time: 0.573375 Oct 29 03:20:27.931746 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2495/5215] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:27 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1562 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:28.493870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7db4d481-9a29-421b-ac3d-c6d13378597b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:28.506295 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7db4d481-9a29-421b-ac3d-c6d13378597b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.854682 Oct 29 03:20:28.506917 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2721/5216] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:27 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:28.530151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-12955c6c-a1a6-424f-878f-2612f265367a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:28.530776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-12955c6c-a1a6-424f-878f-2612f265367a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:28.548664 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-12955c6c-a1a6-424f-878f-2612f265367a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:28.548965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-12955c6c-a1a6-424f-878f-2612f265367a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:28.549374 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-12955c6c-a1a6-424f-878f-2612f265367a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:28.550357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-12955c6c-a1a6-424f-878f-2612f265367a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:28.550685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-12955c6c-a1a6-424f-878f-2612f265367a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:28.551137 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-12955c6c-a1a6-424f-878f-2612f265367a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:28.983237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-364a42e9-f06f-4540-98ee-9b2c8b3d601c req-75b841d3-7879-46e2-82a4-7596c79170b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5562f723-95f1-4fc0-93db-b9b457324d35", "tag": "c306f18b-bb8b-4b3e-a0d9-6ced8168f711"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:29.005519 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-364a42e9-f06f-4540-98ee-9b2c8b3d601c req-75b841d3-7879-46e2-82a4-7596c79170b0 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:29.006020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-364a42e9-f06f-4540-98ee-9b2c8b3d601c req-75b841d3-7879-46e2-82a4-7596c79170b0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:29.006468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-364a42e9-f06f-4540-98ee-9b2c8b3d601c req-75b841d3-7879-46e2-82a4-7596c79170b0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:29.058723 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-364a42e9-f06f-4540-98ee-9b2c8b3d601c req-75b841d3-7879-46e2-82a4-7596c79170b0 service nova] Creating event network-changed:c306f18b-bb8b-4b3e-a0d9-6ced8168f711 for instance 5562f723-95f1-4fc0-93db-b9b457324d35 on n-h1-862967-2 Oct 29 03:20:29.063262 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-12955c6c-a1a6-424f-878f-2612f265367a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:29.068259 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-364a42e9-f06f-4540-98ee-9b2c8b3d601c req-75b841d3-7879-46e2-82a4-7596c79170b0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088829 Oct 29 03:20:29.080721 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2722/5217] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:20:29.091347 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-12955c6c-a1a6-424f-878f-2612f265367a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.553091 Oct 29 03:20:29.092615 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2496/5218] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:28 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:32.668538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2c75e7ae-2d34-4320-bc8f-3990be5ae43b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:32.669634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-83e8bb79-4586-429e-a511-d97809c9f1c8 req-a23915bc-2eef-4155-b68f-8cb41e3f7950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0568de01-669e-4f98-8ca7-3e358669ef8f", "tag": "c42a747a-f6ba-448c-a70e-519721103faf"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:32.670607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2c75e7ae-2d34-4320-bc8f-3990be5ae43b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:32.680271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c75e7ae-2d34-4320-bc8f-3990be5ae43b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:32.681104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c75e7ae-2d34-4320-bc8f-3990be5ae43b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:32.681721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c75e7ae-2d34-4320-bc8f-3990be5ae43b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:32.683012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c75e7ae-2d34-4320-bc8f-3990be5ae43b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:32.683634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c75e7ae-2d34-4320-bc8f-3990be5ae43b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:32.684793 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c75e7ae-2d34-4320-bc8f-3990be5ae43b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:32.699797 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-83e8bb79-4586-429e-a511-d97809c9f1c8 req-a23915bc-2eef-4155-b68f-8cb41e3f7950 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:32.702257 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-83e8bb79-4586-429e-a511-d97809c9f1c8 req-a23915bc-2eef-4155-b68f-8cb41e3f7950 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:32.704698 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-83e8bb79-4586-429e-a511-d97809c9f1c8 req-a23915bc-2eef-4155-b68f-8cb41e3f7950 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:32.749289 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-83e8bb79-4586-429e-a511-d97809c9f1c8 req-a23915bc-2eef-4155-b68f-8cb41e3f7950 service nova] Creating event network-changed:c42a747a-f6ba-448c-a70e-519721103faf for instance 0568de01-669e-4f98-8ca7-3e358669ef8f on n-h1-862967-2 Oct 29 03:20:32.765878 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-83e8bb79-4586-429e-a511-d97809c9f1c8 req-a23915bc-2eef-4155-b68f-8cb41e3f7950 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099878 Oct 29 03:20:32.774151 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2497/5219] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:20:34.457352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2c75e7ae-2d34-4320-bc8f-3990be5ae43b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:34.467808 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2c75e7ae-2d34-4320-bc8f-3990be5ae43b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1562 microversion: 2.1 time: 1.807279 Oct 29 03:20:34.468752 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2723/5220] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:32 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1562 bytes in 1809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:39.010500 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-64dc6e89-d364-4e6a-8cf0-56964adc7e6d tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Action: 'create', calling method: .version_select at 0x7ff0537048b0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1708734707", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCzwt1NCwRoKnQpqKPCF3FUsgPzcrYnqapTfwxk2UZCnT6nuZOsXhz9/82dzlCZ5v2NvWD+HakwPb1we2I9/DaZy5gfbz1s/AwmWFQw9UHxSQZy71vzsbsFq5fj3Z567w=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:39.031131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-64dc6e89-d364-4e6a-8cf0-56964adc7e6d tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Getting quotas for project ee68afb8421144efa7b6fdccd5106655. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:20:39.040735 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-64dc6e89-d364-4e6a-8cf0-56964adc7e6d tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Getting quotas for user 6134cc5f6a6e44f09c3754b564383dba and project ee68afb8421144efa7b6fdccd5106655. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:20:39.094158 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-64dc6e89-d364-4e6a-8cf0-56964adc7e6d tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.209998 Oct 29 03:20:39.094158 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2498/5221] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:20:38 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:20:40.640564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-339469e0-1933-4fe9-b069-20b2576bb226 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1253118306", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1708734707", "security_groups": [{"name": "tempest-secgroup-smoke-1099015740"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "2d64ae9a-2d25-4653-a988-2764ed340d90"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:40.683079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=64 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:40.844875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-339469e0-1933-4fe9-b069-20b2576bb226 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] validate_networks() for [('2d64ae9a-2d25-4653-a988-2764ed340d90', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:20:41.352444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-339469e0-1933-4fe9-b069-20b2576bb226 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Getting quotas for project ee68afb8421144efa7b6fdccd5106655. Resources: dict_keys(['metadata_items']) {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:20:41.358560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-339469e0-1933-4fe9-b069-20b2576bb226 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Getting quotas for user 6134cc5f6a6e44f09c3754b564383dba and project ee68afb8421144efa7b6fdccd5106655. Resources: dict_keys(['metadata_items']) {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:20:41.373456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-339469e0-1933-4fe9-b069-20b2576bb226 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:20:41.373877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-339469e0-1933-4fe9-b069-20b2576bb226 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:20:41.374351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-339469e0-1933-4fe9-b069-20b2576bb226 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:20:41.374754 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-339469e0-1933-4fe9-b069-20b2576bb226 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:20:41.375160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-339469e0-1933-4fe9-b069-20b2576bb226 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:20:41.386398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-339469e0-1933-4fe9-b069-20b2576bb226 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:41.387569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-339469e0-1933-4fe9-b069-20b2576bb226 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:41.388036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-339469e0-1933-4fe9-b069-20b2576bb226 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:41.388767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-339469e0-1933-4fe9-b069-20b2576bb226 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:41.389464 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-339469e0-1933-4fe9-b069-20b2576bb226 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:41.389847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-339469e0-1933-4fe9-b069-20b2576bb226 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:41.412379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-339469e0-1933-4fe9-b069-20b2576bb226 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Getting quotas for project ee68afb8421144efa7b6fdccd5106655. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:20:41.419740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-339469e0-1933-4fe9-b069-20b2576bb226 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Getting quotas for user 6134cc5f6a6e44f09c3754b564383dba and project ee68afb8421144efa7b6fdccd5106655. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:20:41.436557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-339469e0-1933-4fe9-b069-20b2576bb226 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:20:41.439081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-339469e0-1933-4fe9-b069-20b2576bb226 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] [instance: 00aa17f2-3f29-4036-b14a-9b3809bfbd7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:20:41.498002 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-339469e0-1933-4fe9-b069-20b2576bb226 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.871150 Oct 29 03:20:41.498980 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2724/5222] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:20:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:20:41.513553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b07ed9f0-5419-4398-a718-a2a5b6bcfefb tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:41.515654 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b07ed9f0-5419-4398-a718-a2a5b6bcfefb tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] [instance: 00aa17f2-3f29-4036-b14a-9b3809bfbd7a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:41.680959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b07ed9f0-5419-4398-a718-a2a5b6bcfefb tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134cc5f6a6e44f09c3754b564383dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee68afb8421144efa7b6fdccd5106655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:41.688869 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b07ed9f0-5419-4398-a718-a2a5b6bcfefb tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] 10.222.0.46 "GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a" status: 200 len: 1303 microversion: 2.1 time: 0.182110 Oct 29 03:20:41.689541 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2499/5223] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:41 2022] GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a => generated 1303 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:42.712943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9693acd8-cf3e-4410-b3e2-64757ea68ff0 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:42.714528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9693acd8-cf3e-4410-b3e2-64757ea68ff0 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] [instance: 00aa17f2-3f29-4036-b14a-9b3809bfbd7a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:42.723335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9693acd8-cf3e-4410-b3e2-64757ea68ff0 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:42.723794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9693acd8-cf3e-4410-b3e2-64757ea68ff0 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:42.724502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9693acd8-cf3e-4410-b3e2-64757ea68ff0 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:42.725392 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9693acd8-cf3e-4410-b3e2-64757ea68ff0 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:42.725902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9693acd8-cf3e-4410-b3e2-64757ea68ff0 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:42.727059 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9693acd8-cf3e-4410-b3e2-64757ea68ff0 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:42.818282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9693acd8-cf3e-4410-b3e2-64757ea68ff0 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134cc5f6a6e44f09c3754b564383dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee68afb8421144efa7b6fdccd5106655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:42.833527 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9693acd8-cf3e-4410-b3e2-64757ea68ff0 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] 10.222.0.46 "GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a" status: 200 len: 1355 microversion: 2.1 time: 0.124291 Oct 29 03:20:42.857526 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2725/5224] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:42 2022] GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a => generated 1355 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:43.858005 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-922b10dc-adcf-471c-9dfc-e60cf5caeed1 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:43.859262 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-922b10dc-adcf-471c-9dfc-e60cf5caeed1 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] [instance: 00aa17f2-3f29-4036-b14a-9b3809bfbd7a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:43.862441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=14 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:43.870356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-922b10dc-adcf-471c-9dfc-e60cf5caeed1 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:43.874281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-922b10dc-adcf-471c-9dfc-e60cf5caeed1 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:43.876288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-922b10dc-adcf-471c-9dfc-e60cf5caeed1 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:43.880479 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-922b10dc-adcf-471c-9dfc-e60cf5caeed1 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:43.881319 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-922b10dc-adcf-471c-9dfc-e60cf5caeed1 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:43.885178 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-922b10dc-adcf-471c-9dfc-e60cf5caeed1 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:43.949878 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1b2c87a3-7f11-43e9-b7c7-b09cd8b14506 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:43.952030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1b2c87a3-7f11-43e9-b7c7-b09cd8b14506 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:43.968599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b2c87a3-7f11-43e9-b7c7-b09cd8b14506 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:43.970136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b2c87a3-7f11-43e9-b7c7-b09cd8b14506 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:43.972084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b2c87a3-7f11-43e9-b7c7-b09cd8b14506 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:43.973570 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b2c87a3-7f11-43e9-b7c7-b09cd8b14506 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:43.975071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b2c87a3-7f11-43e9-b7c7-b09cd8b14506 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:43.977356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b2c87a3-7f11-43e9-b7c7-b09cd8b14506 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:44.255970 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-1b2c87a3-7f11-43e9-b7c7-b09cd8b14506 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lazy-loading 'services' on Instance uuid d5efc47a-1e03-4d14-bc60-5d3f067a89d0 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:20:44.339069 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-922b10dc-adcf-471c-9dfc-e60cf5caeed1 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134cc5f6a6e44f09c3754b564383dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee68afb8421144efa7b6fdccd5106655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:44.346005 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1b2c87a3-7f11-43e9-b7c7-b09cd8b14506 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0/os-volume_attachments/8c052df0-e6e3-423b-9e88-bd190fe33229" status: 202 len: 0 microversion: 2.1 time: 0.399931 Oct 29 03:20:44.347588 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2726/5225] 10.222.0.46 () {58 vars in 1416 bytes} [Sat Oct 29 03:20:43 2022] DELETE /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0/os-volume_attachments/8c052df0-e6e3-423b-9e88-bd190fe33229 => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:20:44.350665 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-922b10dc-adcf-471c-9dfc-e60cf5caeed1 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] 10.222.0.46 "GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a" status: 200 len: 1429 microversion: 2.1 time: 0.496728 Oct 29 03:20:44.356782 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6c4bde63-4d43-451c-b82e-3848a3ff533d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:44.359762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6c4bde63-4d43-451c-b82e-3848a3ff533d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:44.367955 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c4bde63-4d43-451c-b82e-3848a3ff533d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:44.369160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c4bde63-4d43-451c-b82e-3848a3ff533d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:44.369622 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2500/5226] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:43 2022] GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a => generated 1429 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:44.380603 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c4bde63-4d43-451c-b82e-3848a3ff533d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:44.380603 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c4bde63-4d43-451c-b82e-3848a3ff533d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:44.380603 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c4bde63-4d43-451c-b82e-3848a3ff533d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:44.380603 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c4bde63-4d43-451c-b82e-3848a3ff533d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:44.442023 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6c4bde63-4d43-451c-b82e-3848a3ff533d tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089526 Oct 29 03:20:44.442688 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2727/5227] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:20:44 2022] GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:20:45.356976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-cef88fa2-ec57-4b65-91d5-c8b3cfa9fc00 req-74475e46-ac7c-42c7-a000-69846aafc2cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00aa17f2-3f29-4036-b14a-9b3809bfbd7a", "tag": "64a13004-89c8-4e77-8bd1-ef0532745375"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:45.383974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-cef88fa2-ec57-4b65-91d5-c8b3cfa9fc00 req-74475e46-ac7c-42c7-a000-69846aafc2cf service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:45.384778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-cef88fa2-ec57-4b65-91d5-c8b3cfa9fc00 req-74475e46-ac7c-42c7-a000-69846aafc2cf service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:45.385859 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-cef88fa2-ec57-4b65-91d5-c8b3cfa9fc00 req-74475e46-ac7c-42c7-a000-69846aafc2cf service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:45.397583 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-da1e601a-1dc7-46a2-9437-ad3f48194f6e tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:45.399130 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-da1e601a-1dc7-46a2-9437-ad3f48194f6e tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] [instance: 00aa17f2-3f29-4036-b14a-9b3809bfbd7a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:45.405570 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-cef88fa2-ec57-4b65-91d5-c8b3cfa9fc00 req-74475e46-ac7c-42c7-a000-69846aafc2cf service nova] Creating event network-changed:64a13004-89c8-4e77-8bd1-ef0532745375 for instance 00aa17f2-3f29-4036-b14a-9b3809bfbd7a on n-h2-862967-2 Oct 29 03:20:45.411061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da1e601a-1dc7-46a2-9437-ad3f48194f6e tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:45.417303 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-cef88fa2-ec57-4b65-91d5-c8b3cfa9fc00 req-74475e46-ac7c-42c7-a000-69846aafc2cf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063457 Oct 29 03:20:45.418792 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2501/5228] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:20:45.420269 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da1e601a-1dc7-46a2-9437-ad3f48194f6e tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:45.422179 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da1e601a-1dc7-46a2-9437-ad3f48194f6e tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:45.423119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da1e601a-1dc7-46a2-9437-ad3f48194f6e tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:45.424080 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da1e601a-1dc7-46a2-9437-ad3f48194f6e tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:45.424876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da1e601a-1dc7-46a2-9437-ad3f48194f6e tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:45.458429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-93996e76-0292-48d9-9ae3-39cd9a7f97d2 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:45.461897 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-93996e76-0292-48d9-9ae3-39cd9a7f97d2 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:45.481283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93996e76-0292-48d9-9ae3-39cd9a7f97d2 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:45.482089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93996e76-0292-48d9-9ae3-39cd9a7f97d2 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:45.483694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93996e76-0292-48d9-9ae3-39cd9a7f97d2 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:45.484883 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93996e76-0292-48d9-9ae3-39cd9a7f97d2 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:45.485618 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93996e76-0292-48d9-9ae3-39cd9a7f97d2 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:45.486438 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93996e76-0292-48d9-9ae3-39cd9a7f97d2 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:45.537176 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-93996e76-0292-48d9-9ae3-39cd9a7f97d2 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085324 Oct 29 03:20:45.543080 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2502/5229] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:20:45 2022] GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:20:45.700007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-da1e601a-1dc7-46a2-9437-ad3f48194f6e tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134cc5f6a6e44f09c3754b564383dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee68afb8421144efa7b6fdccd5106655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:45.713719 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-da1e601a-1dc7-46a2-9437-ad3f48194f6e tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] 10.222.0.46 "GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a" status: 200 len: 1429 microversion: 2.1 time: 0.322154 Oct 29 03:20:45.725216 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2728/5230] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:45 2022] GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a => generated 1429 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:20:46.550517 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4216c1ca-2ace-4ce0-873e-36bbb55f1841 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:46.552789 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4216c1ca-2ace-4ce0-873e-36bbb55f1841 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:46.569572 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4216c1ca-2ace-4ce0-873e-36bbb55f1841 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:46.570171 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4216c1ca-2ace-4ce0-873e-36bbb55f1841 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:46.570621 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4216c1ca-2ace-4ce0-873e-36bbb55f1841 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:46.572815 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4216c1ca-2ace-4ce0-873e-36bbb55f1841 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:46.573282 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4216c1ca-2ace-4ce0-873e-36bbb55f1841 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:46.575926 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4216c1ca-2ace-4ce0-873e-36bbb55f1841 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:46.627904 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4216c1ca-2ace-4ce0-873e-36bbb55f1841 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082111 Oct 29 03:20:46.629155 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2503/5231] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:20:46 2022] GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:20:46.738211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9955d9cc-ebe9-4e43-99ca-d13b7c0d7ca1 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:46.739409 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9955d9cc-ebe9-4e43-99ca-d13b7c0d7ca1 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] [instance: 00aa17f2-3f29-4036-b14a-9b3809bfbd7a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:46.756262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9955d9cc-ebe9-4e43-99ca-d13b7c0d7ca1 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:46.756782 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9955d9cc-ebe9-4e43-99ca-d13b7c0d7ca1 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:46.757216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9955d9cc-ebe9-4e43-99ca-d13b7c0d7ca1 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:46.757922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9955d9cc-ebe9-4e43-99ca-d13b7c0d7ca1 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:46.758368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9955d9cc-ebe9-4e43-99ca-d13b7c0d7ca1 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:46.758786 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9955d9cc-ebe9-4e43-99ca-d13b7c0d7ca1 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:47.115619 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9955d9cc-ebe9-4e43-99ca-d13b7c0d7ca1 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134cc5f6a6e44f09c3754b564383dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee68afb8421144efa7b6fdccd5106655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:47.131060 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9955d9cc-ebe9-4e43-99ca-d13b7c0d7ca1 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] 10.222.0.46 "GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a" status: 200 len: 1429 microversion: 2.1 time: 0.396634 Oct 29 03:20:47.131674 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2729/5232] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:46 2022] GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a => generated 1429 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:47.642334 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b4e499d9-e76d-40b9-9b81-5ba0abac6a44 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:47.647074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b4e499d9-e76d-40b9-9b81-5ba0abac6a44 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:47.658333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4e499d9-e76d-40b9-9b81-5ba0abac6a44 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:47.659274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4e499d9-e76d-40b9-9b81-5ba0abac6a44 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:47.660139 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4e499d9-e76d-40b9-9b81-5ba0abac6a44 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:47.661178 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4e499d9-e76d-40b9-9b81-5ba0abac6a44 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:47.662110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4e499d9-e76d-40b9-9b81-5ba0abac6a44 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:47.662785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4e499d9-e76d-40b9-9b81-5ba0abac6a44 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:47.716902 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b4e499d9-e76d-40b9-9b81-5ba0abac6a44 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079881 Oct 29 03:20:47.717855 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2504/5233] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:20:47 2022] GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:20:48.155383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b64ed583-02ac-4b14-8406-0cdf5f594c97 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:48.156222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b64ed583-02ac-4b14-8406-0cdf5f594c97 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] [instance: 00aa17f2-3f29-4036-b14a-9b3809bfbd7a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:48.171070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b64ed583-02ac-4b14-8406-0cdf5f594c97 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:48.171699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b64ed583-02ac-4b14-8406-0cdf5f594c97 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:48.172280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b64ed583-02ac-4b14-8406-0cdf5f594c97 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:48.173175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b64ed583-02ac-4b14-8406-0cdf5f594c97 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:48.173829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b64ed583-02ac-4b14-8406-0cdf5f594c97 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:48.177889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b64ed583-02ac-4b14-8406-0cdf5f594c97 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:48.414405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b64ed583-02ac-4b14-8406-0cdf5f594c97 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134cc5f6a6e44f09c3754b564383dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee68afb8421144efa7b6fdccd5106655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:48.429373 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b64ed583-02ac-4b14-8406-0cdf5f594c97 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] 10.222.0.46 "GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a" status: 200 len: 1429 microversion: 2.1 time: 0.278440 Oct 29 03:20:48.430441 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2730/5234] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:48 2022] GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a => generated 1429 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:48.494749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8b7d8f75-8016-47a0-8228-07938e05176e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:48.497540 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8b7d8f75-8016-47a0-8228-07938e05176e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 5562f723-95f1-4fc0-93db-b9b457324d35] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:48.510715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b7d8f75-8016-47a0-8228-07938e05176e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:48.511887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b7d8f75-8016-47a0-8228-07938e05176e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:48.513578 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b7d8f75-8016-47a0-8228-07938e05176e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:48.515340 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b7d8f75-8016-47a0-8228-07938e05176e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:48.517545 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b7d8f75-8016-47a0-8228-07938e05176e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:48.520042 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b7d8f75-8016-47a0-8228-07938e05176e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:48.585569 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8b7d8f75-8016-47a0-8228-07938e05176e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "POST /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35/action" status: 200 len: 24548 microversion: 2.1 time: 0.094001 Oct 29 03:20:48.586600 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2505/5235] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:20:48 2022] POST /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35/action => generated 24548 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:20:48.732213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9443b1dc-0757-4113-8405-983d1b14fcd1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:48.735168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9443b1dc-0757-4113-8405-983d1b14fcd1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:48.743973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9443b1dc-0757-4113-8405-983d1b14fcd1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:48.744772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9443b1dc-0757-4113-8405-983d1b14fcd1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:48.745300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9443b1dc-0757-4113-8405-983d1b14fcd1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:48.746109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9443b1dc-0757-4113-8405-983d1b14fcd1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:48.746637 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9443b1dc-0757-4113-8405-983d1b14fcd1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:48.747295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9443b1dc-0757-4113-8405-983d1b14fcd1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:48.785602 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9443b1dc-0757-4113-8405-983d1b14fcd1 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059328 Oct 29 03:20:48.786242 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2731/5236] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:20:48 2022] GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:20:49.454088 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4083df77-4165-421b-85bd-6e744c70f6ba tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:49.455684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4083df77-4165-421b-85bd-6e744c70f6ba tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] [instance: 00aa17f2-3f29-4036-b14a-9b3809bfbd7a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:49.465957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4083df77-4165-421b-85bd-6e744c70f6ba tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:49.466787 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4083df77-4165-421b-85bd-6e744c70f6ba tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:49.467433 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4083df77-4165-421b-85bd-6e744c70f6ba tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:49.468406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4083df77-4165-421b-85bd-6e744c70f6ba tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:49.469091 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4083df77-4165-421b-85bd-6e744c70f6ba tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:49.469708 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4083df77-4165-421b-85bd-6e744c70f6ba tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:49.673713 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4083df77-4165-421b-85bd-6e744c70f6ba tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134cc5f6a6e44f09c3754b564383dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee68afb8421144efa7b6fdccd5106655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:49.683297 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4083df77-4165-421b-85bd-6e744c70f6ba tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] 10.222.0.46 "GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a" status: 200 len: 1429 microversion: 2.1 time: 0.234136 Oct 29 03:20:49.695014 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2506/5237] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:49 2022] GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a => generated 1429 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:49.798251 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2657bc14-9a47-4506-90ec-0f5f7d8dd676 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:49.800839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2657bc14-9a47-4506-90ec-0f5f7d8dd676 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:49.818250 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2657bc14-9a47-4506-90ec-0f5f7d8dd676 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:49.819085 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2657bc14-9a47-4506-90ec-0f5f7d8dd676 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:49.819723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2657bc14-9a47-4506-90ec-0f5f7d8dd676 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:49.820716 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2657bc14-9a47-4506-90ec-0f5f7d8dd676 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:49.821359 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2657bc14-9a47-4506-90ec-0f5f7d8dd676 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:49.822112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2657bc14-9a47-4506-90ec-0f5f7d8dd676 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:49.880649 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2657bc14-9a47-4506-90ec-0f5f7d8dd676 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087095 Oct 29 03:20:49.881549 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2732/5238] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:20:49 2022] GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:20:49.976145 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-468dbed5-e6c6-40e2-806d-9e26379ff7d3 req-80ff3ca0-298d-456a-b35a-799adba04ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00aa17f2-3f29-4036-b14a-9b3809bfbd7a", "name": "network-vif-plugged", "status": "completed", "tag": "64a13004-89c8-4e77-8bd1-ef0532745375"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:49.999434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-468dbed5-e6c6-40e2-806d-9e26379ff7d3 req-80ff3ca0-298d-456a-b35a-799adba04ce1 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:49.999914 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-468dbed5-e6c6-40e2-806d-9e26379ff7d3 req-80ff3ca0-298d-456a-b35a-799adba04ce1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:50.000339 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-468dbed5-e6c6-40e2-806d-9e26379ff7d3 req-80ff3ca0-298d-456a-b35a-799adba04ce1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:50.029150 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-468dbed5-e6c6-40e2-806d-9e26379ff7d3 req-80ff3ca0-298d-456a-b35a-799adba04ce1 service nova] Creating event network-vif-plugged:64a13004-89c8-4e77-8bd1-ef0532745375 for instance 00aa17f2-3f29-4036-b14a-9b3809bfbd7a on n-h2-862967-2 Oct 29 03:20:50.034739 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-468dbed5-e6c6-40e2-806d-9e26379ff7d3 req-80ff3ca0-298d-456a-b35a-799adba04ce1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064082 Oct 29 03:20:50.036296 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2507/5239] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:20:50.708405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-510cd9c9-199a-44dd-a441-3e39b8b34ffd tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:50.708405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-510cd9c9-199a-44dd-a441-3e39b8b34ffd tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] [instance: 00aa17f2-3f29-4036-b14a-9b3809bfbd7a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:50.714812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-510cd9c9-199a-44dd-a441-3e39b8b34ffd tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:50.715329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-510cd9c9-199a-44dd-a441-3e39b8b34ffd tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:50.715728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-510cd9c9-199a-44dd-a441-3e39b8b34ffd tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:50.716562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-510cd9c9-199a-44dd-a441-3e39b8b34ffd tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:50.716887 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-510cd9c9-199a-44dd-a441-3e39b8b34ffd tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:50.717309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-510cd9c9-199a-44dd-a441-3e39b8b34ffd tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:50.858892 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-510cd9c9-199a-44dd-a441-3e39b8b34ffd tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134cc5f6a6e44f09c3754b564383dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee68afb8421144efa7b6fdccd5106655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:50.867783 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-510cd9c9-199a-44dd-a441-3e39b8b34ffd tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] 10.222.0.46 "GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a" status: 200 len: 1429 microversion: 2.1 time: 0.164300 Oct 29 03:20:50.868880 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2733/5240] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:50 2022] GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a => generated 1429 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:50.897231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-61973e40-eac1-4a76-b2ea-7c0e20aeefa5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:50.899589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-61973e40-eac1-4a76-b2ea-7c0e20aeefa5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:50.908213 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61973e40-eac1-4a76-b2ea-7c0e20aeefa5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:50.908749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61973e40-eac1-4a76-b2ea-7c0e20aeefa5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:50.909191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61973e40-eac1-4a76-b2ea-7c0e20aeefa5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:50.910102 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61973e40-eac1-4a76-b2ea-7c0e20aeefa5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:50.910555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61973e40-eac1-4a76-b2ea-7c0e20aeefa5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:50.911203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-61973e40-eac1-4a76-b2ea-7c0e20aeefa5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:50.946964 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-61973e40-eac1-4a76-b2ea-7c0e20aeefa5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055530 Oct 29 03:20:50.947741 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2508/5241] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:20:50 2022] GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:20:51.023253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-572ad6fb-92d1-44a8-8f66-d8b312e66dc0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:51.023788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-572ad6fb-92d1-44a8-8f66-d8b312e66dc0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:51.029888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-572ad6fb-92d1-44a8-8f66-d8b312e66dc0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:51.030619 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-572ad6fb-92d1-44a8-8f66-d8b312e66dc0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:51.031221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-572ad6fb-92d1-44a8-8f66-d8b312e66dc0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:51.032080 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-572ad6fb-92d1-44a8-8f66-d8b312e66dc0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:51.032738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-572ad6fb-92d1-44a8-8f66-d8b312e66dc0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:51.033202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-572ad6fb-92d1-44a8-8f66-d8b312e66dc0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:51.067563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-572ad6fb-92d1-44a8-8f66-d8b312e66dc0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:20:51.086122 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:51.169051 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-572ad6fb-92d1-44a8-8f66-d8b312e66dc0 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0" status: 204 len: 0 microversion: 2.1 time: 0.149436 Oct 29 03:20:51.170220 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2734/5242] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:20:51 2022] DELETE /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 03:20:51.178641 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ef677c5a-2586-4f29-85d9-e56766350443 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:51.179517 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ef677c5a-2586-4f29-85d9-e56766350443 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:51.185866 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef677c5a-2586-4f29-85d9-e56766350443 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:51.186348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef677c5a-2586-4f29-85d9-e56766350443 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:51.186784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef677c5a-2586-4f29-85d9-e56766350443 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:51.187479 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef677c5a-2586-4f29-85d9-e56766350443 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:51.187926 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef677c5a-2586-4f29-85d9-e56766350443 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:51.188351 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef677c5a-2586-4f29-85d9-e56766350443 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:51.363599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ef677c5a-2586-4f29-85d9-e56766350443 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:51.372720 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ef677c5a-2586-4f29-85d9-e56766350443 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0" status: 200 len: 1680 microversion: 2.1 time: 0.197973 Oct 29 03:20:51.373484 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2509/5243] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:51 2022] GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0 => generated 1680 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:20:51.893594 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8377b8a1-bdda-4dfd-a35a-9830b197907c tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:51.894625 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8377b8a1-bdda-4dfd-a35a-9830b197907c tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] [instance: 00aa17f2-3f29-4036-b14a-9b3809bfbd7a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:51.901757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:51.902543 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=10 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:51.908372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8377b8a1-bdda-4dfd-a35a-9830b197907c tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:51.908972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8377b8a1-bdda-4dfd-a35a-9830b197907c tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:51.909475 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8377b8a1-bdda-4dfd-a35a-9830b197907c tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:51.910353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8377b8a1-bdda-4dfd-a35a-9830b197907c tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:51.911015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8377b8a1-bdda-4dfd-a35a-9830b197907c tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:51.911513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8377b8a1-bdda-4dfd-a35a-9830b197907c tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:51.942934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-86b6a962-a7e0-4244-a546-61e4a1c9408c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:51.945768 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-86b6a962-a7e0-4244-a546-61e4a1c9408c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:51.948324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:51.968498 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86b6a962-a7e0-4244-a546-61e4a1c9408c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:51.969106 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86b6a962-a7e0-4244-a546-61e4a1c9408c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:51.969659 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86b6a962-a7e0-4244-a546-61e4a1c9408c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:51.971248 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86b6a962-a7e0-4244-a546-61e4a1c9408c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:51.971712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86b6a962-a7e0-4244-a546-61e4a1c9408c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:51.972255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86b6a962-a7e0-4244-a546-61e4a1c9408c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:52.156894 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-86b6a962-a7e0-4244-a546-61e4a1c9408c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action" status: 202 len: 0 microversion: 2.1 time: 0.212550 Oct 29 03:20:52.164022 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2510/5244] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:20:51 2022] POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:20:52.181360 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-44e7f728-4d06-4821-b2e3-8f5e10c4b961 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:52.183242 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-44e7f728-4d06-4821-b2e3-8f5e10c4b961 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:52.190207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44e7f728-4d06-4821-b2e3-8f5e10c4b961 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:52.191330 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44e7f728-4d06-4821-b2e3-8f5e10c4b961 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:52.202825 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44e7f728-4d06-4821-b2e3-8f5e10c4b961 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:52.204054 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44e7f728-4d06-4821-b2e3-8f5e10c4b961 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:52.204937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44e7f728-4d06-4821-b2e3-8f5e10c4b961 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:52.205917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44e7f728-4d06-4821-b2e3-8f5e10c4b961 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:52.295362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8377b8a1-bdda-4dfd-a35a-9830b197907c tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134cc5f6a6e44f09c3754b564383dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee68afb8421144efa7b6fdccd5106655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:52.307088 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8377b8a1-bdda-4dfd-a35a-9830b197907c tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] 10.222.0.46 "GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a" status: 200 len: 1609 microversion: 2.1 time: 0.419556 Oct 29 03:20:52.307691 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2735/5245] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:51 2022] GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a => generated 1609 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:52.314811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-64823cb6-0b59-41d2-ad33-f583eb54baf8 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:52.317602 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-64823cb6-0b59-41d2-ad33-f583eb54baf8 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:52.329879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-64823cb6-0b59-41d2-ad33-f583eb54baf8 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:52.335828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-64823cb6-0b59-41d2-ad33-f583eb54baf8 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:52.337775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-64823cb6-0b59-41d2-ad33-f583eb54baf8 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:52.338896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-64823cb6-0b59-41d2-ad33-f583eb54baf8 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:52.339628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-64823cb6-0b59-41d2-ad33-f583eb54baf8 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:52.341147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-64823cb6-0b59-41d2-ad33-f583eb54baf8 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:52.427425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-44e7f728-4d06-4821-b2e3-8f5e10c4b961 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:52.438158 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-44e7f728-4d06-4821-b2e3-8f5e10c4b961 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1672 microversion: 2.1 time: 0.269951 Oct 29 03:20:52.438774 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2511/5246] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:52 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1672 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:52.448864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d6e93e4e-e031-4404-bf20-3e6dce17ae70 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:52.449753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d6e93e4e-e031-4404-bf20-3e6dce17ae70 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] [instance: 00aa17f2-3f29-4036-b14a-9b3809bfbd7a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:52.460182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6e93e4e-e031-4404-bf20-3e6dce17ae70 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:52.461204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6e93e4e-e031-4404-bf20-3e6dce17ae70 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:52.461940 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6e93e4e-e031-4404-bf20-3e6dce17ae70 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:52.463045 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6e93e4e-e031-4404-bf20-3e6dce17ae70 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:52.463829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6e93e4e-e031-4404-bf20-3e6dce17ae70 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:52.464888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6e93e4e-e031-4404-bf20-3e6dce17ae70 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:52.531156 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-64823cb6-0b59-41d2-ad33-f583eb54baf8 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "POST /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f/action" status: 200 len: 24566 microversion: 2.1 time: 0.220610 Oct 29 03:20:52.531874 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2736/5247] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:20:52 2022] POST /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f/action => generated 24566 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:20:52.550290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4389113a-9063-45ba-b9ab-87a5524f2db4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:52.551018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4389113a-9063-45ba-b9ab-87a5524f2db4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:52.600196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4389113a-9063-45ba-b9ab-87a5524f2db4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:52.600756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4389113a-9063-45ba-b9ab-87a5524f2db4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:52.601207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4389113a-9063-45ba-b9ab-87a5524f2db4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:52.601960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4389113a-9063-45ba-b9ab-87a5524f2db4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:52.602420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4389113a-9063-45ba-b9ab-87a5524f2db4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:52.602842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4389113a-9063-45ba-b9ab-87a5524f2db4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:52.687959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d6e93e4e-e031-4404-bf20-3e6dce17ae70 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134cc5f6a6e44f09c3754b564383dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee68afb8421144efa7b6fdccd5106655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:52.699714 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d6e93e4e-e031-4404-bf20-3e6dce17ae70 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] 10.222.0.46 "GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a" status: 200 len: 1609 microversion: 2.1 time: 0.259239 Oct 29 03:20:52.700971 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2512/5248] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:52 2022] GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a => generated 1609 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:52.723586 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-42185c92-5428-4db9-860f-2a971d76a3ec tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:52.724206 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-42185c92-5428-4db9-860f-2a971d76a3ec tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] [instance: 00aa17f2-3f29-4036-b14a-9b3809bfbd7a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:52.731503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-42185c92-5428-4db9-860f-2a971d76a3ec tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:52.731910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-42185c92-5428-4db9-860f-2a971d76a3ec tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:52.732343 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-42185c92-5428-4db9-860f-2a971d76a3ec tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:52.733342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-42185c92-5428-4db9-860f-2a971d76a3ec tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:52.733796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-42185c92-5428-4db9-860f-2a971d76a3ec tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:52.734215 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-42185c92-5428-4db9-860f-2a971d76a3ec tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:52.921334 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4389113a-9063-45ba-b9ab-87a5524f2db4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:52.934183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-42185c92-5428-4db9-860f-2a971d76a3ec tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134cc5f6a6e44f09c3754b564383dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee68afb8421144efa7b6fdccd5106655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:52.936762 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4389113a-9063-45ba-b9ab-87a5524f2db4 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0" status: 200 len: 1680 microversion: 2.1 time: 0.396382 Oct 29 03:20:52.938961 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2737/5249] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:52 2022] GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0 => generated 1680 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:52.944434 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-42185c92-5428-4db9-860f-2a971d76a3ec tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] 10.222.0.46 "GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a" status: 200 len: 1609 microversion: 2.1 time: 0.225510 Oct 29 03:20:52.960763 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2513/5250] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:52 2022] GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a => generated 1609 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:20:53.463468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2001ea75-1072-4046-af88-6e0e4a3d7db7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:53.463982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2001ea75-1072-4046-af88-6e0e4a3d7db7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:53.471757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2001ea75-1072-4046-af88-6e0e4a3d7db7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:53.472247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2001ea75-1072-4046-af88-6e0e4a3d7db7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:53.472720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2001ea75-1072-4046-af88-6e0e4a3d7db7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:53.473629 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2001ea75-1072-4046-af88-6e0e4a3d7db7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:53.474090 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2001ea75-1072-4046-af88-6e0e4a3d7db7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:53.474514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2001ea75-1072-4046-af88-6e0e4a3d7db7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:53.811586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2001ea75-1072-4046-af88-6e0e4a3d7db7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:53.822416 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2001ea75-1072-4046-af88-6e0e4a3d7db7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1677 microversion: 2.1 time: 0.363062 Oct 29 03:20:53.826246 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2738/5251] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:53 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1677 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:53.969683 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5fd1c463-e829-49fc-a1f5-0bf0afd208ce tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:53.973292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5fd1c463-e829-49fc-a1f5-0bf0afd208ce tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:53.990100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5fd1c463-e829-49fc-a1f5-0bf0afd208ce tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:53.990605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5fd1c463-e829-49fc-a1f5-0bf0afd208ce tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:53.991039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5fd1c463-e829-49fc-a1f5-0bf0afd208ce tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:53.991977 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5fd1c463-e829-49fc-a1f5-0bf0afd208ce tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:53.992432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5fd1c463-e829-49fc-a1f5-0bf0afd208ce tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:53.996812 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5fd1c463-e829-49fc-a1f5-0bf0afd208ce tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:54.089785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5fd1c463-e829-49fc-a1f5-0bf0afd208ce tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:54.103251 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5fd1c463-e829-49fc-a1f5-0bf0afd208ce tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0" status: 200 len: 1612 microversion: 2.1 time: 0.144310 Oct 29 03:20:54.103860 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2514/5252] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:53 2022] GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0 => generated 1612 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:54.306893 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-834d221e-81a8-42e1-a0b2-c2bbb8c42350 req-8e07ba28-80af-4a88-94b7-e7dcf1946472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5efc47a-1e03-4d14-bc60-5d3f067a89d0", "name": "network-vif-deleted", "tag": "f10311b9-c69d-4c20-96a9-543008cc1a15"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:54.333742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-834d221e-81a8-42e1-a0b2-c2bbb8c42350 req-8e07ba28-80af-4a88-94b7-e7dcf1946472 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:54.334229 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-834d221e-81a8-42e1-a0b2-c2bbb8c42350 req-8e07ba28-80af-4a88-94b7-e7dcf1946472 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:54.334664 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-834d221e-81a8-42e1-a0b2-c2bbb8c42350 req-8e07ba28-80af-4a88-94b7-e7dcf1946472 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:54.406125 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-834d221e-81a8-42e1-a0b2-c2bbb8c42350 req-8e07ba28-80af-4a88-94b7-e7dcf1946472 service nova] Creating event network-vif-deleted:f10311b9-c69d-4c20-96a9-543008cc1a15 for instance d5efc47a-1e03-4d14-bc60-5d3f067a89d0 on n-h1-862967-2 Oct 29 03:20:54.422490 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-834d221e-81a8-42e1-a0b2-c2bbb8c42350 req-8e07ba28-80af-4a88-94b7-e7dcf1946472 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119228 Oct 29 03:20:54.437055 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2739/5253] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:20:54.867545 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fb255907-868e-43d2-b42f-1c43c1ab10cb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:54.868453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fb255907-868e-43d2-b42f-1c43c1ab10cb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:54.886561 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb255907-868e-43d2-b42f-1c43c1ab10cb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:54.887341 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb255907-868e-43d2-b42f-1c43c1ab10cb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:54.887984 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb255907-868e-43d2-b42f-1c43c1ab10cb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:54.888922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb255907-868e-43d2-b42f-1c43c1ab10cb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:54.889546 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb255907-868e-43d2-b42f-1c43c1ab10cb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:54.890137 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb255907-868e-43d2-b42f-1c43c1ab10cb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:55.132249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-22b94bfd-ea4b-4f6f-9a7f-d5e71256fbf5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:55.133172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-22b94bfd-ea4b-4f6f-9a7f-d5e71256fbf5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:55.147467 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22b94bfd-ea4b-4f6f-9a7f-d5e71256fbf5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:55.147970 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22b94bfd-ea4b-4f6f-9a7f-d5e71256fbf5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:55.149189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22b94bfd-ea4b-4f6f-9a7f-d5e71256fbf5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:55.149919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22b94bfd-ea4b-4f6f-9a7f-d5e71256fbf5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:55.150730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22b94bfd-ea4b-4f6f-9a7f-d5e71256fbf5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:55.150858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22b94bfd-ea4b-4f6f-9a7f-d5e71256fbf5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:55.195609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fb255907-868e-43d2-b42f-1c43c1ab10cb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:55.209690 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fb255907-868e-43d2-b42f-1c43c1ab10cb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1677 microversion: 2.1 time: 0.340580 Oct 29 03:20:55.211719 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2515/5254] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:54 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1677 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:55.225599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22b94bfd-ea4b-4f6f-9a7f-d5e71256fbf5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:55.225599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22b94bfd-ea4b-4f6f-9a7f-d5e71256fbf5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:55.225599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22b94bfd-ea4b-4f6f-9a7f-d5e71256fbf5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:55.225599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-22b94bfd-ea4b-4f6f-9a7f-d5e71256fbf5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lazy-loading 'fault' on Instance uuid d5efc47a-1e03-4d14-bc60-5d3f067a89d0 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:20:55.358490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-22b94bfd-ea4b-4f6f-9a7f-d5e71256fbf5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9086760822f48ee921bcdb7bd5ae299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c05b5161bd341acb4fc97fa616b3713', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:55.366484 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-22b94bfd-ea4b-4f6f-9a7f-d5e71256fbf5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0" status: 200 len: 1330 microversion: 2.1 time: 0.240464 Oct 29 03:20:55.376683 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2740/5255] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:55 2022] GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0 => generated 1330 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:56.241126 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-93f46115-4ebc-4cd5-8bdd-4c66a372ee0d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:56.242618 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-93f46115-4ebc-4cd5-8bdd-4c66a372ee0d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:56.252828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93f46115-4ebc-4cd5-8bdd-4c66a372ee0d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:56.253653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93f46115-4ebc-4cd5-8bdd-4c66a372ee0d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:56.255003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93f46115-4ebc-4cd5-8bdd-4c66a372ee0d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:56.256466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93f46115-4ebc-4cd5-8bdd-4c66a372ee0d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:56.257488 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93f46115-4ebc-4cd5-8bdd-4c66a372ee0d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:56.258535 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93f46115-4ebc-4cd5-8bdd-4c66a372ee0d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:56.399033 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d4b75869-d788-4cc7-ad23-1ff6e7818e1c tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:56.399703 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d4b75869-d788-4cc7-ad23-1ff6e7818e1c tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:56.409189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4b75869-d788-4cc7-ad23-1ff6e7818e1c tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:56.412492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4b75869-d788-4cc7-ad23-1ff6e7818e1c tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:56.416909 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4b75869-d788-4cc7-ad23-1ff6e7818e1c tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:56.417859 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4b75869-d788-4cc7-ad23-1ff6e7818e1c tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:56.418439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4b75869-d788-4cc7-ad23-1ff6e7818e1c tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:56.418974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4b75869-d788-4cc7-ad23-1ff6e7818e1c tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:56.445561 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-d4b75869-d788-4cc7-ad23-1ff6e7818e1c tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] HTTP exception thrown: Instance d5efc47a-1e03-4d14-bc60-5d3f067a89d0 could not be found. Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d4b75869-d788-4cc7-ad23-1ff6e7818e1c tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Request method failure captured: Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0 HTTP/1.1 Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJp-lWXa7bAqr_3cIx72XHiAsdLYD16twUkV-_OiY8rnLVDQQaYoa5MTy-Rf6PU7b1BJZp9_V3gh0A9BPD-pAHEbb2w6qwO87hDTiy2iuRRJAVfin8hEyxtECKBEa_6rf3V6E0wsMuLS1DRhhUPui0KdkBEsp0tJIYHf71qqCJib-MM Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 4c05b5161bd341acb4fc97fa616b3713 Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4c05b5161bd341acb4fc97fa616b3713"}]}] Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 4c05b5161bd341acb4fc97fa616b3713 Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-AttachVolumeNegativeTest-648637356-project Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: e9086760822f48ee921bcdb7bd5ae299 Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-AttachVolumeNegativeTest-648637356-project Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance d5efc47a-1e03-4d14-bc60-5d3f067a89d0 could not be found. Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'd5efc47a-1e03-4d14-bc60-5d3f067a89d0'} Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5efc47a-1e03-4d14-bc60-5d3f067a89d0 could not be found. Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5efc47a-1e03-4d14-bc60-5d3f067a89d0 could not be found. Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:20:56.454790 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:20:56.460073 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:20:56.460073 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:20:56.460073 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:20:56.460073 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:20:56.460073 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:20:56.460073 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5efc47a-1e03-4d14-bc60-5d3f067a89d0 could not be found. Oct 29 03:20:56.460073 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:20:56.461423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d4b75869-d788-4cc7-ad23-1ff6e7818e1c tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Returning 404 to user: Instance d5efc47a-1e03-4d14-bc60-5d3f067a89d0 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:20:56.467402 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d4b75869-d788-4cc7-ad23-1ff6e7818e1c tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0" status: 404 len: 111 microversion: 2.1 time: 0.073214 Oct 29 03:20:56.468494 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2741/5256] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:56 2022] GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:20:56.476807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-54e6689e-c81f-4d96-bf3e-e7c2a5f20c2a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '.version_select at 0x7ff052b68550>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:56.477793 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-93f46115-4ebc-4cd5-8bdd-4c66a372ee0d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:56.486549 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-93f46115-4ebc-4cd5-8bdd-4c66a372ee0d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1677 microversion: 2.1 time: 0.251213 Oct 29 03:20:56.487148 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2516/5257] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:56 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1677 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:56.516438 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-54e6689e-c81f-4d96-bf3e-e7c2a5f20c2a tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-674371434" status: 202 len: 0 microversion: 2.1 time: 0.043437 Oct 29 03:20:56.523139 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2742/5258] 10.222.0.46 () {58 vars in 1218 bytes} [Sat Oct 29 03:20:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-674371434 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:20:56.536186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-7dcb3a02-e01e-4236-a954-78acd4dd237c req-d4062638-d6d7-4dda-90d7-28943f658e85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00aa17f2-3f29-4036-b14a-9b3809bfbd7a", "tag": "64a13004-89c8-4e77-8bd1-ef0532745375"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:20:56.565792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7dcb3a02-e01e-4236-a954-78acd4dd237c req-d4062638-d6d7-4dda-90d7-28943f658e85 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:56.566291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7dcb3a02-e01e-4236-a954-78acd4dd237c req-d4062638-d6d7-4dda-90d7-28943f658e85 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:56.566946 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7dcb3a02-e01e-4236-a954-78acd4dd237c req-d4062638-d6d7-4dda-90d7-28943f658e85 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:56.571812 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:56.591895 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-7dcb3a02-e01e-4236-a954-78acd4dd237c req-d4062638-d6d7-4dda-90d7-28943f658e85 service nova] Creating event network-changed:64a13004-89c8-4e77-8bd1-ef0532745375 for instance 00aa17f2-3f29-4036-b14a-9b3809bfbd7a on n-h2-862967-2 Oct 29 03:20:56.597366 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-7dcb3a02-e01e-4236-a954-78acd4dd237c req-d4062638-d6d7-4dda-90d7-28943f658e85 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065048 Oct 29 03:20:56.616289 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2517/5259] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:20:57.518438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9b66ce94-a701-45e9-9e72-e046639a0168 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:57.519168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9b66ce94-a701-45e9-9e72-e046639a0168 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:57.559047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b66ce94-a701-45e9-9e72-e046639a0168 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:57.560171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b66ce94-a701-45e9-9e72-e046639a0168 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:57.560896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b66ce94-a701-45e9-9e72-e046639a0168 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:57.562833 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b66ce94-a701-45e9-9e72-e046639a0168 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:57.567334 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b66ce94-a701-45e9-9e72-e046639a0168 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:57.571452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b66ce94-a701-45e9-9e72-e046639a0168 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:57.772933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9b66ce94-a701-45e9-9e72-e046639a0168 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:57.781722 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9b66ce94-a701-45e9-9e72-e046639a0168 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1677 microversion: 2.1 time: 0.272276 Oct 29 03:20:57.782448 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2743/5260] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:57 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1677 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:20:58.818329 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9ad4686f-f8fc-42f1-82ff-6743faed0add tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:20:58.819656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9ad4686f-f8fc-42f1-82ff-6743faed0add tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:20:58.822751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:58.829491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ad4686f-f8fc-42f1-82ff-6743faed0add tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:58.830236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ad4686f-f8fc-42f1-82ff-6743faed0add tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:58.830661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ad4686f-f8fc-42f1-82ff-6743faed0add tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:58.831369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ad4686f-f8fc-42f1-82ff-6743faed0add tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:20:58.831812 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ad4686f-f8fc-42f1-82ff-6743faed0add tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:20:58.832411 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ad4686f-f8fc-42f1-82ff-6743faed0add tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:20:59.094238 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9ad4686f-f8fc-42f1-82ff-6743faed0add tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:20:59.103958 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9ad4686f-f8fc-42f1-82ff-6743faed0add tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.289783 Oct 29 03:20:59.105083 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2518/5261] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:20:58 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:02.924201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cc1611c8-96ea-428c-be69-8d9564e6ec95 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:02.925610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cc1611c8-96ea-428c-be69-8d9564e6ec95 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:02.938254 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc1611c8-96ea-428c-be69-8d9564e6ec95 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:02.940653 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc1611c8-96ea-428c-be69-8d9564e6ec95 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:02.941225 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc1611c8-96ea-428c-be69-8d9564e6ec95 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:02.943259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc1611c8-96ea-428c-be69-8d9564e6ec95 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:02.943983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc1611c8-96ea-428c-be69-8d9564e6ec95 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:02.944707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc1611c8-96ea-428c-be69-8d9564e6ec95 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:02.960609 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-cc1611c8-96ea-428c-be69-8d9564e6ec95 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] HTTP exception thrown: Instance d5efc47a-1e03-4d14-bc60-5d3f067a89d0 could not be found. Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cc1611c8-96ea-428c-be69-8d9564e6ec95 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Request method failure captured: Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0 HTTP/1.1 Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJp-lWXa7bAqr_3cIx72XHiAsdLYD16twUkV-_OiY8rnLVDQQaYoa5MTy-Rf6PU7b1BJZp9_V3gh0A9BPD-pAHEbb2w6qwO87hDTiy2iuRRJAVfin8hEyxtECKBEa_6rf3V6E0wsMuLS1DRhhUPui0KdkBEsp0tJIYHf71qqCJib-MM Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 4c05b5161bd341acb4fc97fa616b3713 Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4c05b5161bd341acb4fc97fa616b3713"}]}] Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 4c05b5161bd341acb4fc97fa616b3713 Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-AttachVolumeNegativeTest-648637356-project Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: e9086760822f48ee921bcdb7bd5ae299 Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-AttachVolumeNegativeTest-648637356-project Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance d5efc47a-1e03-4d14-bc60-5d3f067a89d0 could not be found. Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'd5efc47a-1e03-4d14-bc60-5d3f067a89d0'} Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5efc47a-1e03-4d14-bc60-5d3f067a89d0 could not be found. Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:21:02.962725 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:21:02.967597 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5efc47a-1e03-4d14-bc60-5d3f067a89d0 could not be found. Oct 29 03:21:02.967597 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:02.967597 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:02.967597 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:02.967597 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:02.967597 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:02.967597 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:02.967597 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:21:02.967597 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:21:02.967597 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5efc47a-1e03-4d14-bc60-5d3f067a89d0 could not be found. Oct 29 03:21:02.967597 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:02.969561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cc1611c8-96ea-428c-be69-8d9564e6ec95 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Returning 404 to user: Instance d5efc47a-1e03-4d14-bc60-5d3f067a89d0 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:21:02.970869 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cc1611c8-96ea-428c-be69-8d9564e6ec95 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0" status: 404 len: 111 microversion: 2.1 time: 0.053773 Oct 29 03:21:02.980249 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c58e8f2b-6256-4ab5-96a9-05b91d9033b5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:02.982948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c58e8f2b-6256-4ab5-96a9-05b91d9033b5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: d5efc47a-1e03-4d14-bc60-5d3f067a89d0] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:02.988365 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2744/5262] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:21:02 2022] DELETE /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:21:02.991865 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c58e8f2b-6256-4ab5-96a9-05b91d9033b5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:02.992841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c58e8f2b-6256-4ab5-96a9-05b91d9033b5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:02.993508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c58e8f2b-6256-4ab5-96a9-05b91d9033b5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:02.994446 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c58e8f2b-6256-4ab5-96a9-05b91d9033b5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:02.995124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c58e8f2b-6256-4ab5-96a9-05b91d9033b5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:02.995796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c58e8f2b-6256-4ab5-96a9-05b91d9033b5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:03.011238 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-c58e8f2b-6256-4ab5-96a9-05b91d9033b5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] HTTP exception thrown: Instance d5efc47a-1e03-4d14-bc60-5d3f067a89d0 could not be found. Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c58e8f2b-6256-4ab5-96a9-05b91d9033b5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Request method failure captured: Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0 HTTP/1.1 Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJp-lWXa7bAqr_3cIx72XHiAsdLYD16twUkV-_OiY8rnLVDQQaYoa5MTy-Rf6PU7b1BJZp9_V3gh0A9BPD-pAHEbb2w6qwO87hDTiy2iuRRJAVfin8hEyxtECKBEa_6rf3V6E0wsMuLS1DRhhUPui0KdkBEsp0tJIYHf71qqCJib-MM Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 4c05b5161bd341acb4fc97fa616b3713 Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4c05b5161bd341acb4fc97fa616b3713"}]}] Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 4c05b5161bd341acb4fc97fa616b3713 Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-AttachVolumeNegativeTest-648637356-project Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: e9086760822f48ee921bcdb7bd5ae299 Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-AttachVolumeNegativeTest-648637356-project Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance d5efc47a-1e03-4d14-bc60-5d3f067a89d0 could not be found. Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'd5efc47a-1e03-4d14-bc60-5d3f067a89d0'} Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5efc47a-1e03-4d14-bc60-5d3f067a89d0 could not be found. Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5efc47a-1e03-4d14-bc60-5d3f067a89d0 could not be found. Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:03.013284 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:21:03.018559 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:03.018559 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:03.018559 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:03.018559 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:21:03.018559 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:21:03.018559 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5efc47a-1e03-4d14-bc60-5d3f067a89d0 could not be found. Oct 29 03:21:03.018559 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:21:03.020701 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c58e8f2b-6256-4ab5-96a9-05b91d9033b5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Returning 404 to user: Instance d5efc47a-1e03-4d14-bc60-5d3f067a89d0 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:21:03.021811 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c58e8f2b-6256-4ab5-96a9-05b91d9033b5 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0" status: 404 len: 111 microversion: 2.1 time: 0.045864 Oct 29 03:21:03.026865 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2519/5263] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:02 2022] GET /compute/v2.1/servers/d5efc47a-1e03-4d14-bc60-5d3f067a89d0 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:21:03.420828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fd395166-73bc-4b3c-82fc-be75e13d6e1e tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:03.421641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fd395166-73bc-4b3c-82fc-be75e13d6e1e tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:03.430153 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd395166-73bc-4b3c-82fc-be75e13d6e1e tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:03.433098 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd395166-73bc-4b3c-82fc-be75e13d6e1e tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:03.433777 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd395166-73bc-4b3c-82fc-be75e13d6e1e tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:03.434734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd395166-73bc-4b3c-82fc-be75e13d6e1e tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:03.437066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd395166-73bc-4b3c-82fc-be75e13d6e1e tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:03.437770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd395166-73bc-4b3c-82fc-be75e13d6e1e tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:04.167312 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fd395166-73bc-4b3c-82fc-be75e13d6e1e tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1832 microversion: 2.1 time: 0.750096 Oct 29 03:21:04.174340 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2745/5264] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:03 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1832 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:04.193561 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-903761f4-e511-4877-a940-1270ed762a38 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:04.194696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-903761f4-e511-4877-a940-1270ed762a38 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:04.208909 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-903761f4-e511-4877-a940-1270ed762a38 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:04.211698 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-903761f4-e511-4877-a940-1270ed762a38 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:04.212536 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-903761f4-e511-4877-a940-1270ed762a38 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:04.213459 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-903761f4-e511-4877-a940-1270ed762a38 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:04.214017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-903761f4-e511-4877-a940-1270ed762a38 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:04.214886 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-903761f4-e511-4877-a940-1270ed762a38 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:04.451024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-903761f4-e511-4877-a940-1270ed762a38 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:04.462794 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-903761f4-e511-4877-a940-1270ed762a38 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1681 microversion: 2.1 time: 0.274216 Oct 29 03:21:04.465483 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2520/5265] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:04 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1681 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:04.649533 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0614b81e-9146-42d3-a2be-591544c34be8 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:04.651844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0614b81e-9146-42d3-a2be-591544c34be8 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:04.669539 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0614b81e-9146-42d3-a2be-591544c34be8 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:04.670038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0614b81e-9146-42d3-a2be-591544c34be8 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:04.670478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0614b81e-9146-42d3-a2be-591544c34be8 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:04.671193 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0614b81e-9146-42d3-a2be-591544c34be8 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:04.671644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0614b81e-9146-42d3-a2be-591544c34be8 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:04.672072 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0614b81e-9146-42d3-a2be-591544c34be8 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:04.757574 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0614b81e-9146-42d3-a2be-591544c34be8 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "POST /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f/action" status: 200 len: 32640 microversion: 2.1 time: 0.112636 Oct 29 03:21:04.765200 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2746/5266] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:21:04 2022] POST /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f/action => generated 32640 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 03:21:04.998275 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5c766845-dd3d-471d-8973-26cd4ccd9b24 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:04.998496 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5c766845-dd3d-471d-8973-26cd4ccd9b24 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:05.010400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c766845-dd3d-471d-8973-26cd4ccd9b24 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:05.010989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c766845-dd3d-471d-8973-26cd4ccd9b24 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:05.013306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c766845-dd3d-471d-8973-26cd4ccd9b24 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:05.015006 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c766845-dd3d-471d-8973-26cd4ccd9b24 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:05.017738 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c766845-dd3d-471d-8973-26cd4ccd9b24 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:05.018423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c766845-dd3d-471d-8973-26cd4ccd9b24 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:05.273456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5767fa88-c71d-4d0b-a8dd-6d5c5cdf0166 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Action: 'create', calling method: .version_select at 0x7ff052b685e0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1886258093", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGquX8r4T2+r4zjjZpr7PiajN3NRhsVk1F4CMhM+7Z6LWaFDID/908X3hJpca0yvBoOUPh4BzZ3xa58+7Fta3gQieSqnsLmNzLZy8EREnL7GBmTLmpyWRNDwC9ahrLXJVA=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:05.328624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-5767fa88-c71d-4d0b-a8dd-6d5c5cdf0166 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Getting quotas for project 987564b626dd4c12b6109c1d23de75c6. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:21:05.337190 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-5767fa88-c71d-4d0b-a8dd-6d5c5cdf0166 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Getting quotas for user 969be4a3c9bd432fa544ee27fa186564 and project 987564b626dd4c12b6109c1d23de75c6. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:21:05.372962 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5767fa88-c71d-4d0b-a8dd-6d5c5cdf0166 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.105306 Oct 29 03:21:05.374659 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2747/5267] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:21:05 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:05.482110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5c766845-dd3d-471d-8973-26cd4ccd9b24 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9f6c93de3f4643f8a4804c69ecce37e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b1a017032a4a54bfff32a27c7f9712', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:05.483440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5c766845-dd3d-471d-8973-26cd4ccd9b24 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] flavor_id is None. Assuming migration. {{(pid=127125) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 29 03:21:05.484161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5c766845-dd3d-471d-8973-26cd4ccd9b24 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127125) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 03:21:05.953449 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5c766845-dd3d-471d-8973-26cd4ccd9b24 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f/action" status: 202 len: 0 microversion: 2.1 time: 0.959970 Oct 29 03:21:05.954709 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2521/5268] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:21:04 2022] POST /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f/action => generated 0 bytes in 962 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:21:05.965541 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ab6a6aaf-a6e6-4ff5-a765-f3cea0ca8de6 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:05.967500 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ab6a6aaf-a6e6-4ff5-a765-f3cea0ca8de6 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:05.989382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ab6a6aaf-a6e6-4ff5-a765-f3cea0ca8de6 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:05.993154 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ab6a6aaf-a6e6-4ff5-a765-f3cea0ca8de6 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:05.993619 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ab6a6aaf-a6e6-4ff5-a765-f3cea0ca8de6 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:05.994369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ab6a6aaf-a6e6-4ff5-a765-f3cea0ca8de6 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:06.000337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ab6a6aaf-a6e6-4ff5-a765-f3cea0ca8de6 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:06.001267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ab6a6aaf-a6e6-4ff5-a765-f3cea0ca8de6 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:06.270426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ab6a6aaf-a6e6-4ff5-a765-f3cea0ca8de6 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:06.313894 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ab6a6aaf-a6e6-4ff5-a765-f3cea0ca8de6 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1690 microversion: 2.1 time: 0.351622 Oct 29 03:21:06.333309 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2748/5269] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:05 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1690 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:07.343328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-35f1ae56-def3-4db8-b694-de4d6263a559 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:07.344743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-35f1ae56-def3-4db8-b694-de4d6263a559 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:07.353413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35f1ae56-def3-4db8-b694-de4d6263a559 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:07.356515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35f1ae56-def3-4db8-b694-de4d6263a559 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:07.357453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35f1ae56-def3-4db8-b694-de4d6263a559 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:07.358506 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35f1ae56-def3-4db8-b694-de4d6263a559 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:07.359156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35f1ae56-def3-4db8-b694-de4d6263a559 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:07.359592 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35f1ae56-def3-4db8-b694-de4d6263a559 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:07.568486 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-35f1ae56-def3-4db8-b694-de4d6263a559 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:07.582468 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-35f1ae56-def3-4db8-b694-de4d6263a559 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1690 microversion: 2.1 time: 0.243839 Oct 29 03:21:07.586472 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2522/5270] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:07 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1690 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:07.922481 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-94faa559-24aa-47f0-b8c2-55a04b4aa42e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1118501717", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "eddc22a2-d49f-47f7-9370-155232c98093"}], "key_name": "tempest-TestNetworkBasicOps-1886258093", "security_groups": [{"name": "tempest-secgroup-smoke-1991364294"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:08.171490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-94faa559-24aa-47f0-b8c2-55a04b4aa42e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] validate_networks() for [('eddc22a2-d49f-47f7-9370-155232c98093', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:21:08.612991 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-88c5470d-2fe6-4387-9ae2-136c7da8ae9a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:08.614605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-88c5470d-2fe6-4387-9ae2-136c7da8ae9a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:08.627416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88c5470d-2fe6-4387-9ae2-136c7da8ae9a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:08.629313 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88c5470d-2fe6-4387-9ae2-136c7da8ae9a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:08.630444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88c5470d-2fe6-4387-9ae2-136c7da8ae9a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:08.634359 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88c5470d-2fe6-4387-9ae2-136c7da8ae9a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:08.635326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88c5470d-2fe6-4387-9ae2-136c7da8ae9a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:08.636160 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88c5470d-2fe6-4387-9ae2-136c7da8ae9a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:08.947828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-88c5470d-2fe6-4387-9ae2-136c7da8ae9a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:08.959205 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-88c5470d-2fe6-4387-9ae2-136c7da8ae9a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1690 microversion: 2.1 time: 0.350549 Oct 29 03:21:08.960691 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2523/5271] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:08 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1690 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:21:08.966613 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a7e9040f-0e38-45a1-acb7-74c54f5f9398 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:08.967551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a7e9040f-0e38-45a1-acb7-74c54f5f9398 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:08.994501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-94faa559-24aa-47f0-b8c2-55a04b4aa42e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:21:08.995039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-94faa559-24aa-47f0-b8c2-55a04b4aa42e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:21:08.995465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-94faa559-24aa-47f0-b8c2-55a04b4aa42e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:21:08.995772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-94faa559-24aa-47f0-b8c2-55a04b4aa42e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:21:08.996180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-94faa559-24aa-47f0-b8c2-55a04b4aa42e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:21:08.996472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7e9040f-0e38-45a1-acb7-74c54f5f9398 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:09.010047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-94faa559-24aa-47f0-b8c2-55a04b4aa42e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:09.010224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7e9040f-0e38-45a1-acb7-74c54f5f9398 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:09.010688 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7e9040f-0e38-45a1-acb7-74c54f5f9398 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:09.011127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-94faa559-24aa-47f0-b8c2-55a04b4aa42e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:09.011764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-94faa559-24aa-47f0-b8c2-55a04b4aa42e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:09.012158 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7e9040f-0e38-45a1-acb7-74c54f5f9398 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:09.013004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-94faa559-24aa-47f0-b8c2-55a04b4aa42e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:09.014222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7e9040f-0e38-45a1-acb7-74c54f5f9398 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:09.014846 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7e9040f-0e38-45a1-acb7-74c54f5f9398 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:09.016124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-94faa559-24aa-47f0-b8c2-55a04b4aa42e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:09.016832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-94faa559-24aa-47f0-b8c2-55a04b4aa42e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:09.055284 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-a7e9040f-0e38-45a1-acb7-74c54f5f9398 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] HTTP exception thrown: Instance 8356f447-88b7-4047-a578-eb3c1cd24e49 could not be found. Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a7e9040f-0e38-45a1-acb7-74c54f5f9398 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Request method failure captured: Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 HTTP/1.1 Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJp-lWXa7bAqr_3cIx72XHiAsdLYD16twUkV-_OiY8rnLVDQQaYoa5MTy-Rf6PU7b1BJZp9_V3gh0A9BPD-pAHEbb2w6qwO87hDTiy2iuRRJAVfin8hEyxtECKBEa_6rf3V6E0wsMuLS1DRhhUPui0KdkBEsp0tJIYHf71qqCJib-MM Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 4c05b5161bd341acb4fc97fa616b3713 Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4c05b5161bd341acb4fc97fa616b3713"}]}] Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 4c05b5161bd341acb4fc97fa616b3713 Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-AttachVolumeNegativeTest-648637356-project Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: e9086760822f48ee921bcdb7bd5ae299 Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-AttachVolumeNegativeTest-648637356-project Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 8356f447-88b7-4047-a578-eb3c1cd24e49 could not be found. Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '8356f447-88b7-4047-a578-eb3c1cd24e49'} Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8356f447-88b7-4047-a578-eb3c1cd24e49 could not be found. Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:21:09.066697 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:21:09.076240 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8356f447-88b7-4047-a578-eb3c1cd24e49 could not be found. Oct 29 03:21:09.076240 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:21:09.076240 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:09.076240 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:21:09.076240 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:09.076240 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:09.076240 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:09.076240 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:21:09.076240 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:21:09.076240 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8356f447-88b7-4047-a578-eb3c1cd24e49 could not be found. Oct 29 03:21:09.076240 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:21:09.076240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a7e9040f-0e38-45a1-acb7-74c54f5f9398 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Returning 404 to user: Instance 8356f447-88b7-4047-a578-eb3c1cd24e49 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:21:09.076240 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a7e9040f-0e38-45a1-acb7-74c54f5f9398 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49" status: 404 len: 111 microversion: 2.1 time: 0.100044 Oct 29 03:21:09.076240 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2524/5272] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:21:08 2022] DELETE /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:21:09.086422 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:09.087218 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-77f774b3-3d0f-4f42-afa1-ae1c8d6629fe tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:09.087218 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-77f774b3-3d0f-4f42-afa1-ae1c8d6629fe tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 8356f447-88b7-4047-a578-eb3c1cd24e49] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:09.090898 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-94faa559-24aa-47f0-b8c2-55a04b4aa42e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Getting quotas for project 987564b626dd4c12b6109c1d23de75c6. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:21:09.109663 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77f774b3-3d0f-4f42-afa1-ae1c8d6629fe tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:09.110288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77f774b3-3d0f-4f42-afa1-ae1c8d6629fe tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:09.110798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77f774b3-3d0f-4f42-afa1-ae1c8d6629fe tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:09.111831 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77f774b3-3d0f-4f42-afa1-ae1c8d6629fe tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:09.112574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77f774b3-3d0f-4f42-afa1-ae1c8d6629fe tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:09.113168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77f774b3-3d0f-4f42-afa1-ae1c8d6629fe tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:09.113593 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-94faa559-24aa-47f0-b8c2-55a04b4aa42e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Getting quotas for user 969be4a3c9bd432fa544ee27fa186564 and project 987564b626dd4c12b6109c1d23de75c6. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:21:09.146508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-94faa559-24aa-47f0-b8c2-55a04b4aa42e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:21:09.149045 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-94faa559-24aa-47f0-b8c2-55a04b4aa42e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: b44493f2-0d26-4a42-9951-00557618dfd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:21:09.162704 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-77f774b3-3d0f-4f42-afa1-ae1c8d6629fe tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] HTTP exception thrown: Instance 8356f447-88b7-4047-a578-eb3c1cd24e49 could not be found. Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-77f774b3-3d0f-4f42-afa1-ae1c8d6629fe tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Request method failure captured: Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 HTTP/1.1 Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJp-lWXa7bAqr_3cIx72XHiAsdLYD16twUkV-_OiY8rnLVDQQaYoa5MTy-Rf6PU7b1BJZp9_V3gh0A9BPD-pAHEbb2w6qwO87hDTiy2iuRRJAVfin8hEyxtECKBEa_6rf3V6E0wsMuLS1DRhhUPui0KdkBEsp0tJIYHf71qqCJib-MM Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 4c05b5161bd341acb4fc97fa616b3713 Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4c05b5161bd341acb4fc97fa616b3713"}]}] Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 4c05b5161bd341acb4fc97fa616b3713 Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-AttachVolumeNegativeTest-648637356-project Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: e9086760822f48ee921bcdb7bd5ae299 Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-AttachVolumeNegativeTest-648637356-project Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 8356f447-88b7-4047-a578-eb3c1cd24e49 could not be found. Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '8356f447-88b7-4047-a578-eb3c1cd24e49'} Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8356f447-88b7-4047-a578-eb3c1cd24e49 could not be found. Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8356f447-88b7-4047-a578-eb3c1cd24e49 could not be found. Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:09.168333 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:21:09.173703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:09.173703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:09.173703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:09.173703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:21:09.173703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:21:09.173703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8356f447-88b7-4047-a578-eb3c1cd24e49 could not be found. Oct 29 03:21:09.173703 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:21:09.173703 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-77f774b3-3d0f-4f42-afa1-ae1c8d6629fe tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Returning 404 to user: Instance 8356f447-88b7-4047-a578-eb3c1cd24e49 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:21:09.178780 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-77f774b3-3d0f-4f42-afa1-ae1c8d6629fe tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49" status: 404 len: 111 microversion: 2.1 time: 0.102620 Oct 29 03:21:09.178780 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2525/5273] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:09 2022] GET /compute/v2.1/servers/8356f447-88b7-4047-a578-eb3c1cd24e49 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:21:09.186437 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7c115f2b-1152-42db-ab79-68df557a1cee tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:09.189220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7c115f2b-1152-42db-ab79-68df557a1cee tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 9e7f97fd-a366-4b20-a65c-9b2395b20ec2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:09.203913 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c115f2b-1152-42db-ab79-68df557a1cee tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:09.204829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c115f2b-1152-42db-ab79-68df557a1cee tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:09.206811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c115f2b-1152-42db-ab79-68df557a1cee tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:09.207800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c115f2b-1152-42db-ab79-68df557a1cee tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:09.210566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c115f2b-1152-42db-ab79-68df557a1cee tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:09.213328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c115f2b-1152-42db-ab79-68df557a1cee tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:09.250047 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-7c115f2b-1152-42db-ab79-68df557a1cee tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] HTTP exception thrown: Instance 9e7f97fd-a366-4b20-a65c-9b2395b20ec2 could not be found. Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7c115f2b-1152-42db-ab79-68df557a1cee tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Request method failure captured: Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2 HTTP/1.1 Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJp-lWXa7bAqr_3cIx72XHiAsdLYD16twUkV-_OiY8rnLVDQQaYoa5MTy-Rf6PU7b1BJZp9_V3gh0A9BPD-pAHEbb2w6qwO87hDTiy2iuRRJAVfin8hEyxtECKBEa_6rf3V6E0wsMuLS1DRhhUPui0KdkBEsp0tJIYHf71qqCJib-MM Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 4c05b5161bd341acb4fc97fa616b3713 Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4c05b5161bd341acb4fc97fa616b3713"}]}] Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 4c05b5161bd341acb4fc97fa616b3713 Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-AttachVolumeNegativeTest-648637356-project Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: e9086760822f48ee921bcdb7bd5ae299 Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-AttachVolumeNegativeTest-648637356-project Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 9e7f97fd-a366-4b20-a65c-9b2395b20ec2 could not be found. Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '9e7f97fd-a366-4b20-a65c-9b2395b20ec2'} Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e7f97fd-a366-4b20-a65c-9b2395b20ec2 could not be found. Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:21:09.257799 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:21:09.262889 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e7f97fd-a366-4b20-a65c-9b2395b20ec2 could not be found. Oct 29 03:21:09.262889 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:21:09.262889 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:09.262889 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:21:09.262889 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:09.262889 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:09.262889 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:09.262889 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:21:09.262889 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:21:09.262889 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e7f97fd-a366-4b20-a65c-9b2395b20ec2 could not be found. Oct 29 03:21:09.262889 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:21:09.265403 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7c115f2b-1152-42db-ab79-68df557a1cee tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Returning 404 to user: Instance 9e7f97fd-a366-4b20-a65c-9b2395b20ec2 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:21:09.267757 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-94faa559-24aa-47f0-b8c2-55a04b4aa42e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.348249 Oct 29 03:21:09.268179 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7c115f2b-1152-42db-ab79-68df557a1cee tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2" status: 404 len: 111 microversion: 2.1 time: 0.084947 Oct 29 03:21:09.273187 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2526/5274] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:21:09 2022] DELETE /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:21:09.275112 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2749/5275] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:21:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 1358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:21:09.282589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-12f841ef-b49a-431c-9a14-a3bd082d31ec tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:09.286265 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-12f841ef-b49a-431c-9a14-a3bd082d31ec tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: 9e7f97fd-a366-4b20-a65c-9b2395b20ec2] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:09.287661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-71d49fd9-5b64-4471-bf4e-f7918855dae9 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:09.301955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-12f841ef-b49a-431c-9a14-a3bd082d31ec tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:09.302470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-12f841ef-b49a-431c-9a14-a3bd082d31ec tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:09.302923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-12f841ef-b49a-431c-9a14-a3bd082d31ec tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:09.303826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-71d49fd9-5b64-4471-bf4e-f7918855dae9 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: b44493f2-0d26-4a42-9951-00557618dfd5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:09.305852 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-12f841ef-b49a-431c-9a14-a3bd082d31ec tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:09.306336 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-12f841ef-b49a-431c-9a14-a3bd082d31ec tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:09.306781 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-12f841ef-b49a-431c-9a14-a3bd082d31ec tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:09.357194 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-12f841ef-b49a-431c-9a14-a3bd082d31ec tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] HTTP exception thrown: Instance 9e7f97fd-a366-4b20-a65c-9b2395b20ec2 could not be found. Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-12f841ef-b49a-431c-9a14-a3bd082d31ec tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Request method failure captured: Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2 HTTP/1.1 Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJp-lWXa7bAqr_3cIx72XHiAsdLYD16twUkV-_OiY8rnLVDQQaYoa5MTy-Rf6PU7b1BJZp9_V3gh0A9BPD-pAHEbb2w6qwO87hDTiy2iuRRJAVfin8hEyxtECKBEa_6rf3V6E0wsMuLS1DRhhUPui0KdkBEsp0tJIYHf71qqCJib-MM Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 4c05b5161bd341acb4fc97fa616b3713 Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4c05b5161bd341acb4fc97fa616b3713"}]}] Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 4c05b5161bd341acb4fc97fa616b3713 Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-AttachVolumeNegativeTest-648637356-project Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: e9086760822f48ee921bcdb7bd5ae299 Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-AttachVolumeNegativeTest-648637356-project Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 9e7f97fd-a366-4b20-a65c-9b2395b20ec2 could not be found. Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '9e7f97fd-a366-4b20-a65c-9b2395b20ec2'} Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e7f97fd-a366-4b20-a65c-9b2395b20ec2 could not be found. Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e7f97fd-a366-4b20-a65c-9b2395b20ec2 could not be found. Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:09.361191 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:21:09.369883 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:09.369883 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:09.369883 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:09.369883 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:21:09.369883 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:21:09.369883 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e7f97fd-a366-4b20-a65c-9b2395b20ec2 could not be found. Oct 29 03:21:09.369883 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:21:09.369883 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-12f841ef-b49a-431c-9a14-a3bd082d31ec tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Returning 404 to user: Instance 9e7f97fd-a366-4b20-a65c-9b2395b20ec2 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:21:09.369883 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-12f841ef-b49a-431c-9a14-a3bd082d31ec tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2" status: 404 len: 111 microversion: 2.1 time: 0.088035 Oct 29 03:21:09.369883 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2527/5276] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:09 2022] GET /compute/v2.1/servers/9e7f97fd-a366-4b20-a65c-9b2395b20ec2 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:21:09.431874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-71d49fd9-5b64-4471-bf4e-f7918855dae9 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:09.450372 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-71d49fd9-5b64-4471-bf4e-f7918855dae9 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5" status: 200 len: 1249 microversion: 2.1 time: 0.169454 Oct 29 03:21:09.458138 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2750/5277] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:09 2022] GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5 => generated 1249 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:21:09.987945 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0eedc0f7-57b2-40f6-875d-aceecfd02344 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:09.989210 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0eedc0f7-57b2-40f6-875d-aceecfd02344 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:10.003098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0eedc0f7-57b2-40f6-875d-aceecfd02344 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:10.006908 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0eedc0f7-57b2-40f6-875d-aceecfd02344 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:10.007635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0eedc0f7-57b2-40f6-875d-aceecfd02344 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:10.008742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0eedc0f7-57b2-40f6-875d-aceecfd02344 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:10.010431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0eedc0f7-57b2-40f6-875d-aceecfd02344 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:10.011388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0eedc0f7-57b2-40f6-875d-aceecfd02344 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:10.436279 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0eedc0f7-57b2-40f6-875d-aceecfd02344 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:10.447977 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0eedc0f7-57b2-40f6-875d-aceecfd02344 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1690 microversion: 2.1 time: 0.464180 Oct 29 03:21:10.452077 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2528/5278] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:09 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1690 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:10.484706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1980deb6-93bc-414a-a00f-9b30cb44aedd tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:10.486128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1980deb6-93bc-414a-a00f-9b30cb44aedd tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: b44493f2-0d26-4a42-9951-00557618dfd5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:10.499605 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1980deb6-93bc-414a-a00f-9b30cb44aedd tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:10.500514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1980deb6-93bc-414a-a00f-9b30cb44aedd tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:10.501260 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1980deb6-93bc-414a-a00f-9b30cb44aedd tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:10.505473 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1980deb6-93bc-414a-a00f-9b30cb44aedd tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:10.506250 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1980deb6-93bc-414a-a00f-9b30cb44aedd tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:10.506902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1980deb6-93bc-414a-a00f-9b30cb44aedd tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:10.717603 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1980deb6-93bc-414a-a00f-9b30cb44aedd tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:10.726905 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1980deb6-93bc-414a-a00f-9b30cb44aedd tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5" status: 200 len: 1245 microversion: 2.1 time: 0.246996 Oct 29 03:21:10.732905 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2751/5279] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:10 2022] GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5 => generated 1245 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:11.481839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4128e09b-1ce8-42c5-a5a2-6a74f374aeae tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:11.483227 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4128e09b-1ce8-42c5-a5a2-6a74f374aeae tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:11.501129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4128e09b-1ce8-42c5-a5a2-6a74f374aeae tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:11.502079 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4128e09b-1ce8-42c5-a5a2-6a74f374aeae tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:11.502745 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4128e09b-1ce8-42c5-a5a2-6a74f374aeae tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:11.503673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4128e09b-1ce8-42c5-a5a2-6a74f374aeae tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:11.504315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4128e09b-1ce8-42c5-a5a2-6a74f374aeae tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:11.505049 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4128e09b-1ce8-42c5-a5a2-6a74f374aeae tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:11.751705 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-69b7093c-e390-4c3d-838d-d8801ac37747 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:11.752497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-69b7093c-e390-4c3d-838d-d8801ac37747 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: b44493f2-0d26-4a42-9951-00557618dfd5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:11.764057 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69b7093c-e390-4c3d-838d-d8801ac37747 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:11.770201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69b7093c-e390-4c3d-838d-d8801ac37747 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:11.771031 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69b7093c-e390-4c3d-838d-d8801ac37747 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:11.772655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69b7093c-e390-4c3d-838d-d8801ac37747 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:11.773294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69b7093c-e390-4c3d-838d-d8801ac37747 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:11.773956 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69b7093c-e390-4c3d-838d-d8801ac37747 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:11.888550 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-69b7093c-e390-4c3d-838d-d8801ac37747 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:11.901138 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-69b7093c-e390-4c3d-838d-d8801ac37747 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5" status: 200 len: 1307 microversion: 2.1 time: 0.154185 Oct 29 03:21:11.905147 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2752/5280] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:11 2022] GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5 => generated 1307 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:12.230627 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4128e09b-1ce8-42c5-a5a2-6a74f374aeae tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:12.242487 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4128e09b-1ce8-42c5-a5a2-6a74f374aeae tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1695 microversion: 2.1 time: 0.766021 Oct 29 03:21:12.243088 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2529/5281] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:11 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1695 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:12.932396 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4fcb67be-42cf-4f9b-82b6-a9744affd55f tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:12.935113 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4fcb67be-42cf-4f9b-82b6-a9744affd55f tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: b44493f2-0d26-4a42-9951-00557618dfd5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:12.948101 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4fcb67be-42cf-4f9b-82b6-a9744affd55f tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:12.949352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4fcb67be-42cf-4f9b-82b6-a9744affd55f tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:12.949982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4fcb67be-42cf-4f9b-82b6-a9744affd55f tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:12.951851 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4fcb67be-42cf-4f9b-82b6-a9744affd55f tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:12.952691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4fcb67be-42cf-4f9b-82b6-a9744affd55f tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:12.953587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4fcb67be-42cf-4f9b-82b6-a9744affd55f tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:13.076561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4fcb67be-42cf-4f9b-82b6-a9744affd55f tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:13.087156 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4fcb67be-42cf-4f9b-82b6-a9744affd55f tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5" status: 200 len: 1307 microversion: 2.1 time: 0.161636 Oct 29 03:21:13.092900 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2753/5282] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:12 2022] GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5 => generated 1307 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:13.270676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-19acd1e2-dc59-4ca4-84a8-5826c4405b12 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:13.271309 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-19acd1e2-dc59-4ca4-84a8-5826c4405b12 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:13.300558 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19acd1e2-dc59-4ca4-84a8-5826c4405b12 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:13.301554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19acd1e2-dc59-4ca4-84a8-5826c4405b12 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:13.302008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19acd1e2-dc59-4ca4-84a8-5826c4405b12 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:13.309120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19acd1e2-dc59-4ca4-84a8-5826c4405b12 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:13.313506 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19acd1e2-dc59-4ca4-84a8-5826c4405b12 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:13.314069 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19acd1e2-dc59-4ca4-84a8-5826c4405b12 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:13.744458 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-19acd1e2-dc59-4ca4-84a8-5826c4405b12 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:13.753045 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-19acd1e2-dc59-4ca4-84a8-5826c4405b12 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1695 microversion: 2.1 time: 0.487516 Oct 29 03:21:13.754331 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2530/5283] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:13 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1695 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:13.945258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d8ce95d4-b3ba-4f6e-97b8-155f95370928 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:13.945811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d8ce95d4-b3ba-4f6e-97b8-155f95370928 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:13.958528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8ce95d4-b3ba-4f6e-97b8-155f95370928 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:13.959569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8ce95d4-b3ba-4f6e-97b8-155f95370928 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:13.961028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8ce95d4-b3ba-4f6e-97b8-155f95370928 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:13.965794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8ce95d4-b3ba-4f6e-97b8-155f95370928 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:13.966526 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8ce95d4-b3ba-4f6e-97b8-155f95370928 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:13.967157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8ce95d4-b3ba-4f6e-97b8-155f95370928 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:14.005219 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-d8ce95d4-b3ba-4f6e-97b8-155f95370928 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] HTTP exception thrown: Instance f2493755-2599-4a13-a4bd-d5104e0d22b7 could not be found. Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d8ce95d4-b3ba-4f6e-97b8-155f95370928 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Request method failure captured: Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7 HTTP/1.1 Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJp-lWXa7bAqr_3cIx72XHiAsdLYD16twUkV-_OiY8rnLVDQQaYoa5MTy-Rf6PU7b1BJZp9_V3gh0A9BPD-pAHEbb2w6qwO87hDTiy2iuRRJAVfin8hEyxtECKBEa_6rf3V6E0wsMuLS1DRhhUPui0KdkBEsp0tJIYHf71qqCJib-MM Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 4c05b5161bd341acb4fc97fa616b3713 Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4c05b5161bd341acb4fc97fa616b3713"}]}] Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 4c05b5161bd341acb4fc97fa616b3713 Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-AttachVolumeNegativeTest-648637356-project Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: e9086760822f48ee921bcdb7bd5ae299 Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-AttachVolumeNegativeTest-648637356-project Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance f2493755-2599-4a13-a4bd-d5104e0d22b7 could not be found. Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'f2493755-2599-4a13-a4bd-d5104e0d22b7'} Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2493755-2599-4a13-a4bd-d5104e0d22b7 could not be found. Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:21:14.007545 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:21:14.013161 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2493755-2599-4a13-a4bd-d5104e0d22b7 could not be found. Oct 29 03:21:14.013161 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:14.013161 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:14.013161 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:14.013161 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:14.013161 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:14.013161 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:14.013161 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:21:14.013161 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:21:14.013161 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2493755-2599-4a13-a4bd-d5104e0d22b7 could not be found. Oct 29 03:21:14.013161 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:14.014985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d8ce95d4-b3ba-4f6e-97b8-155f95370928 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Returning 404 to user: Instance f2493755-2599-4a13-a4bd-d5104e0d22b7 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:21:14.016251 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d8ce95d4-b3ba-4f6e-97b8-155f95370928 tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7" status: 404 len: 111 microversion: 2.1 time: 0.075071 Oct 29 03:21:14.017720 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2754/5284] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:21:13 2022] DELETE /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:21:14.032494 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9b2ca994-a1de-47bc-a54f-d340d4013c2e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:14.034033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9b2ca994-a1de-47bc-a54f-d340d4013c2e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] [instance: f2493755-2599-4a13-a4bd-d5104e0d22b7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:14.041701 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b2ca994-a1de-47bc-a54f-d340d4013c2e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:14.042323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b2ca994-a1de-47bc-a54f-d340d4013c2e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:14.043040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b2ca994-a1de-47bc-a54f-d340d4013c2e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:14.043986 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b2ca994-a1de-47bc-a54f-d340d4013c2e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:14.044719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b2ca994-a1de-47bc-a54f-d340d4013c2e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:14.045581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b2ca994-a1de-47bc-a54f-d340d4013c2e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:14.071211 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-9b2ca994-a1de-47bc-a54f-d340d4013c2e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] HTTP exception thrown: Instance f2493755-2599-4a13-a4bd-d5104e0d22b7 could not be found. Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9b2ca994-a1de-47bc-a54f-d340d4013c2e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Request method failure captured: Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7 HTTP/1.1 Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJp-lWXa7bAqr_3cIx72XHiAsdLYD16twUkV-_OiY8rnLVDQQaYoa5MTy-Rf6PU7b1BJZp9_V3gh0A9BPD-pAHEbb2w6qwO87hDTiy2iuRRJAVfin8hEyxtECKBEa_6rf3V6E0wsMuLS1DRhhUPui0KdkBEsp0tJIYHf71qqCJib-MM Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 4c05b5161bd341acb4fc97fa616b3713 Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4c05b5161bd341acb4fc97fa616b3713"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4c05b5161bd341acb4fc97fa616b3713"}]}] Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 4c05b5161bd341acb4fc97fa616b3713 Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-648637356 Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-AttachVolumeNegativeTest-648637356-project Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: e9086760822f48ee921bcdb7bd5ae299 Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-AttachVolumeNegativeTest-648637356-project Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance f2493755-2599-4a13-a4bd-d5104e0d22b7 could not be found. Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'f2493755-2599-4a13-a4bd-d5104e0d22b7'} Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2493755-2599-4a13-a4bd-d5104e0d22b7 could not be found. Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2493755-2599-4a13-a4bd-d5104e0d22b7 could not be found. Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:14.077408 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:21:14.082219 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:14.082219 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:14.082219 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:14.082219 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:21:14.082219 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:21:14.082219 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2493755-2599-4a13-a4bd-d5104e0d22b7 could not be found. Oct 29 03:21:14.082219 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:21:14.086561 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9b2ca994-a1de-47bc-a54f-d340d4013c2e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] Returning 404 to user: Instance f2493755-2599-4a13-a4bd-d5104e0d22b7 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:21:14.093608 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9b2ca994-a1de-47bc-a54f-d340d4013c2e tempest-AttachVolumeNegativeTest-648637356 tempest-AttachVolumeNegativeTest-648637356-project] 10.222.0.46 "GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7" status: 404 len: 111 microversion: 2.1 time: 0.071733 Oct 29 03:21:14.098603 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2531/5285] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:14 2022] GET /compute/v2.1/servers/f2493755-2599-4a13-a4bd-d5104e0d22b7 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:21:14.114261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ca156e82-700c-41aa-bae4-1514e130aa89 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:14.114911 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ca156e82-700c-41aa-bae4-1514e130aa89 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: b44493f2-0d26-4a42-9951-00557618dfd5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:14.126300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca156e82-700c-41aa-bae4-1514e130aa89 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:14.129708 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca156e82-700c-41aa-bae4-1514e130aa89 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:14.130187 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca156e82-700c-41aa-bae4-1514e130aa89 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:14.130962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca156e82-700c-41aa-bae4-1514e130aa89 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:14.131476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca156e82-700c-41aa-bae4-1514e130aa89 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:14.131925 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca156e82-700c-41aa-bae4-1514e130aa89 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:14.510824 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-c4249b58-cd73-4e01-8876-3f3e26d96ac5 req-b8f6ff59-d1ce-4d6a-a18e-73f9a05d8cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b44493f2-0d26-4a42-9951-00557618dfd5", "tag": "7b9d91da-18f4-42ae-b347-06d99bc5a16e"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:14.525195 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c4249b58-cd73-4e01-8876-3f3e26d96ac5 req-b8f6ff59-d1ce-4d6a-a18e-73f9a05d8cf9 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:14.527435 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c4249b58-cd73-4e01-8876-3f3e26d96ac5 req-b8f6ff59-d1ce-4d6a-a18e-73f9a05d8cf9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:14.528087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c4249b58-cd73-4e01-8876-3f3e26d96ac5 req-b8f6ff59-d1ce-4d6a-a18e-73f9a05d8cf9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:14.542616 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-c4249b58-cd73-4e01-8876-3f3e26d96ac5 req-b8f6ff59-d1ce-4d6a-a18e-73f9a05d8cf9 service nova] Creating event network-changed:7b9d91da-18f4-42ae-b347-06d99bc5a16e for instance b44493f2-0d26-4a42-9951-00557618dfd5 on n-h1-862967-2 Oct 29 03:21:14.550794 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-c4249b58-cd73-4e01-8876-3f3e26d96ac5 req-b8f6ff59-d1ce-4d6a-a18e-73f9a05d8cf9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043703 Oct 29 03:21:14.552048 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2532/5286] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:14.786971 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bf6ba36d-d2c9-4748-baa2-211dbba91746 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:14.792310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bf6ba36d-d2c9-4748-baa2-211dbba91746 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:14.808364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf6ba36d-d2c9-4748-baa2-211dbba91746 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:14.808988 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf6ba36d-d2c9-4748-baa2-211dbba91746 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:14.809490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf6ba36d-d2c9-4748-baa2-211dbba91746 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:14.810278 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf6ba36d-d2c9-4748-baa2-211dbba91746 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:14.810798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf6ba36d-d2c9-4748-baa2-211dbba91746 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:14.811303 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf6ba36d-d2c9-4748-baa2-211dbba91746 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:14.990508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ca156e82-700c-41aa-bae4-1514e130aa89 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:15.028474 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ca156e82-700c-41aa-bae4-1514e130aa89 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5" status: 200 len: 1375 microversion: 2.1 time: 0.918291 Oct 29 03:21:15.032258 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2755/5287] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:14 2022] GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5 => generated 1375 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:15.359765 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bf6ba36d-d2c9-4748-baa2-211dbba91746 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:15.391455 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bf6ba36d-d2c9-4748-baa2-211dbba91746 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1695 microversion: 2.1 time: 0.612194 Oct 29 03:21:15.396916 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2533/5288] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:14 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1695 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:21:16.057453 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5aa0b84e-a844-4545-b48b-243e5c997387 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:16.058077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5aa0b84e-a844-4545-b48b-243e5c997387 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: b44493f2-0d26-4a42-9951-00557618dfd5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:16.066115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5aa0b84e-a844-4545-b48b-243e5c997387 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:16.066782 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5aa0b84e-a844-4545-b48b-243e5c997387 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:16.067365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5aa0b84e-a844-4545-b48b-243e5c997387 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:16.068232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5aa0b84e-a844-4545-b48b-243e5c997387 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:16.068786 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5aa0b84e-a844-4545-b48b-243e5c997387 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:16.069282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5aa0b84e-a844-4545-b48b-243e5c997387 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:16.384986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5aa0b84e-a844-4545-b48b-243e5c997387 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:16.389772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:16.396163 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5aa0b84e-a844-4545-b48b-243e5c997387 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5" status: 200 len: 1375 microversion: 2.1 time: 0.343304 Oct 29 03:21:16.397180 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2756/5289] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:16 2022] GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5 => generated 1375 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:16.423685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-92feec89-3527-4516-833b-0f5a12b5d965 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:16.424358 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-92feec89-3527-4516-833b-0f5a12b5d965 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:16.433205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92feec89-3527-4516-833b-0f5a12b5d965 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:16.433702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92feec89-3527-4516-833b-0f5a12b5d965 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:16.447053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92feec89-3527-4516-833b-0f5a12b5d965 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:16.449593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92feec89-3527-4516-833b-0f5a12b5d965 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:16.450806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92feec89-3527-4516-833b-0f5a12b5d965 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:16.452902 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92feec89-3527-4516-833b-0f5a12b5d965 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:16.744399 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-92feec89-3527-4516-833b-0f5a12b5d965 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:16.760815 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-92feec89-3527-4516-833b-0f5a12b5d965 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1695 microversion: 2.1 time: 0.341915 Oct 29 03:21:16.775005 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2534/5290] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:16 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1695 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:17.422550 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6c413c30-6cc7-43ff-b89f-eefa14eb2c41 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:17.423945 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6c413c30-6cc7-43ff-b89f-eefa14eb2c41 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: b44493f2-0d26-4a42-9951-00557618dfd5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:17.446303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c413c30-6cc7-43ff-b89f-eefa14eb2c41 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:17.446818 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c413c30-6cc7-43ff-b89f-eefa14eb2c41 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:17.447287 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c413c30-6cc7-43ff-b89f-eefa14eb2c41 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:17.451833 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c413c30-6cc7-43ff-b89f-eefa14eb2c41 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:17.453509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c413c30-6cc7-43ff-b89f-eefa14eb2c41 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:17.454211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c413c30-6cc7-43ff-b89f-eefa14eb2c41 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:17.787067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-03e46b8e-c2a1-4fc5-b85c-90c58d76169e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:17.788053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-03e46b8e-c2a1-4fc5-b85c-90c58d76169e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:17.799232 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03e46b8e-c2a1-4fc5-b85c-90c58d76169e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:17.814719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03e46b8e-c2a1-4fc5-b85c-90c58d76169e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:17.815530 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03e46b8e-c2a1-4fc5-b85c-90c58d76169e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:17.820586 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03e46b8e-c2a1-4fc5-b85c-90c58d76169e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:17.822041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03e46b8e-c2a1-4fc5-b85c-90c58d76169e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:17.825023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03e46b8e-c2a1-4fc5-b85c-90c58d76169e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:17.982457 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6c413c30-6cc7-43ff-b89f-eefa14eb2c41 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:17.991209 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6c413c30-6cc7-43ff-b89f-eefa14eb2c41 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5" status: 200 len: 1375 microversion: 2.1 time: 0.575460 Oct 29 03:21:17.991734 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2757/5291] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:17 2022] GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5 => generated 1375 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:18.196742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-03e46b8e-c2a1-4fc5-b85c-90c58d76169e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:18.206710 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-03e46b8e-c2a1-4fc5-b85c-90c58d76169e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1695 microversion: 2.1 time: 0.423659 Oct 29 03:21:18.207905 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2535/5292] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:17 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1695 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:21:19.015325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fbfafc2f-9c5b-49e3-8282-3d0dac3ab6c3 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:19.015934 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fbfafc2f-9c5b-49e3-8282-3d0dac3ab6c3 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: b44493f2-0d26-4a42-9951-00557618dfd5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:19.037575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbfafc2f-9c5b-49e3-8282-3d0dac3ab6c3 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:19.038419 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbfafc2f-9c5b-49e3-8282-3d0dac3ab6c3 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:19.039031 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbfafc2f-9c5b-49e3-8282-3d0dac3ab6c3 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:19.039938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbfafc2f-9c5b-49e3-8282-3d0dac3ab6c3 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:19.040651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbfafc2f-9c5b-49e3-8282-3d0dac3ab6c3 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:19.043185 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbfafc2f-9c5b-49e3-8282-3d0dac3ab6c3 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:19.107953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:19.236101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-19cfb201-dbb7-4314-8099-d398300381a1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:19.238247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-19cfb201-dbb7-4314-8099-d398300381a1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:19.257494 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19cfb201-dbb7-4314-8099-d398300381a1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:19.258310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19cfb201-dbb7-4314-8099-d398300381a1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:19.259165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19cfb201-dbb7-4314-8099-d398300381a1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:19.260394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19cfb201-dbb7-4314-8099-d398300381a1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:19.261060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19cfb201-dbb7-4314-8099-d398300381a1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:19.261504 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19cfb201-dbb7-4314-8099-d398300381a1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:19.361078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fbfafc2f-9c5b-49e3-8282-3d0dac3ab6c3 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:19.370162 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fbfafc2f-9c5b-49e3-8282-3d0dac3ab6c3 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5" status: 200 len: 1375 microversion: 2.1 time: 0.358646 Oct 29 03:21:19.370771 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2758/5293] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:19 2022] GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5 => generated 1375 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:19.590518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-4551cba9-bb11-4591-bcc4-9d183972723f req-fd176822-d6c7-4537-82c7-6a9d8e698f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b44493f2-0d26-4a42-9951-00557618dfd5", "name": "network-vif-plugged", "status": "completed", "tag": "7b9d91da-18f4-42ae-b347-06d99bc5a16e"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:19.603484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=12 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:19.622744 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4551cba9-bb11-4591-bcc4-9d183972723f req-fd176822-d6c7-4537-82c7-6a9d8e698f7a service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:19.623134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4551cba9-bb11-4591-bcc4-9d183972723f req-fd176822-d6c7-4537-82c7-6a9d8e698f7a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:19.623563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4551cba9-bb11-4591-bcc4-9d183972723f req-fd176822-d6c7-4537-82c7-6a9d8e698f7a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:19.653409 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-4551cba9-bb11-4591-bcc4-9d183972723f req-fd176822-d6c7-4537-82c7-6a9d8e698f7a service nova] Creating event network-vif-plugged:7b9d91da-18f4-42ae-b347-06d99bc5a16e for instance b44493f2-0d26-4a42-9951-00557618dfd5 on n-h1-862967-2 Oct 29 03:21:19.661065 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-4551cba9-bb11-4591-bcc4-9d183972723f req-fd176822-d6c7-4537-82c7-6a9d8e698f7a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073941 Oct 29 03:21:19.663311 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2759/5294] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:19.669154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-19cfb201-dbb7-4314-8099-d398300381a1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:19.689826 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-19cfb201-dbb7-4314-8099-d398300381a1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1695 microversion: 2.1 time: 0.463275 Oct 29 03:21:19.701811 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2536/5295] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:19 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1695 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:21:20.416687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7f1d91f0-3dc7-49ec-b3c9-b7a6c8e03762 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:20.417389 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7f1d91f0-3dc7-49ec-b3c9-b7a6c8e03762 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: b44493f2-0d26-4a42-9951-00557618dfd5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:20.433106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f1d91f0-3dc7-49ec-b3c9-b7a6c8e03762 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:20.433607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f1d91f0-3dc7-49ec-b3c9-b7a6c8e03762 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:20.434043 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f1d91f0-3dc7-49ec-b3c9-b7a6c8e03762 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:20.434759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f1d91f0-3dc7-49ec-b3c9-b7a6c8e03762 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:20.435465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f1d91f0-3dc7-49ec-b3c9-b7a6c8e03762 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:20.436288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f1d91f0-3dc7-49ec-b3c9-b7a6c8e03762 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:20.636916 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7f1d91f0-3dc7-49ec-b3c9-b7a6c8e03762 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:20.649145 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7f1d91f0-3dc7-49ec-b3c9-b7a6c8e03762 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5" status: 200 len: 1375 microversion: 2.1 time: 0.238078 Oct 29 03:21:20.650306 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2760/5296] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:20 2022] GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5 => generated 1375 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:20.715148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8b376e96-2c5c-4863-8282-7942e6206f37 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:20.715760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8b376e96-2c5c-4863-8282-7942e6206f37 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:20.745934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b376e96-2c5c-4863-8282-7942e6206f37 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:20.747538 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b376e96-2c5c-4863-8282-7942e6206f37 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:20.749200 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b376e96-2c5c-4863-8282-7942e6206f37 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:20.751670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b376e96-2c5c-4863-8282-7942e6206f37 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:20.752491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b376e96-2c5c-4863-8282-7942e6206f37 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:20.754332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b376e96-2c5c-4863-8282-7942e6206f37 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:20.792330 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:21.068507 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8b376e96-2c5c-4863-8282-7942e6206f37 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:21.090564 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8b376e96-2c5c-4863-8282-7942e6206f37 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1695 microversion: 2.1 time: 0.376600 Oct 29 03:21:21.109553 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2537/5297] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:20 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1695 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:21.649596 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fee5b2a9-e850-4846-9d3f-7e9181ca3e1f tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] Action: 'create', calling method: .version_select at 0x7ff052a04790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-285870012"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:21.672252 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-41040618-7bb0-4eec-86c3-652ea2d73a7e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:21.673000 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-41040618-7bb0-4eec-86c3-652ea2d73a7e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: b44493f2-0d26-4a42-9951-00557618dfd5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:21.679502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41040618-7bb0-4eec-86c3-652ea2d73a7e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:21.680283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41040618-7bb0-4eec-86c3-652ea2d73a7e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:21.680983 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41040618-7bb0-4eec-86c3-652ea2d73a7e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:21.681917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41040618-7bb0-4eec-86c3-652ea2d73a7e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:21.682597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41040618-7bb0-4eec-86c3-652ea2d73a7e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:21.683250 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41040618-7bb0-4eec-86c3-652ea2d73a7e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:21.877852 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-41040618-7bb0-4eec-86c3-652ea2d73a7e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:21.886358 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-41040618-7bb0-4eec-86c3-652ea2d73a7e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5" status: 200 len: 1548 microversion: 2.1 time: 0.218060 Oct 29 03:21:21.896990 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2538/5298] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:21 2022] GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5 => generated 1548 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:21:21.913998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-11ad8060-ba4b-4371-a36b-bf1a9045dfc9 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:21.914952 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-11ad8060-ba4b-4371-a36b-bf1a9045dfc9 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: b44493f2-0d26-4a42-9951-00557618dfd5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:21.921755 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11ad8060-ba4b-4371-a36b-bf1a9045dfc9 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:21.922334 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11ad8060-ba4b-4371-a36b-bf1a9045dfc9 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:21.922827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11ad8060-ba4b-4371-a36b-bf1a9045dfc9 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:21.923902 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11ad8060-ba4b-4371-a36b-bf1a9045dfc9 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:21.924761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11ad8060-ba4b-4371-a36b-bf1a9045dfc9 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:21.925269 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11ad8060-ba4b-4371-a36b-bf1a9045dfc9 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:22.110960 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fee5b2a9-e850-4846-9d3f-7e9181ca3e1f tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.641036 Oct 29 03:21:22.120368 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2761/5299] 10.222.0.46 () {60 vars in 1155 bytes} [Sat Oct 29 03:21:21 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 643 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 29 03:21:22.124833 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-031302ad-4d1e-4637-9874-35fca15242d3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:22.126513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-031302ad-4d1e-4637-9874-35fca15242d3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:22.141718 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-11ad8060-ba4b-4371-a36b-bf1a9045dfc9 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:22.146111 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-031302ad-4d1e-4637-9874-35fca15242d3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:22.147914 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-031302ad-4d1e-4637-9874-35fca15242d3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:22.149820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-031302ad-4d1e-4637-9874-35fca15242d3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:22.150700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-031302ad-4d1e-4637-9874-35fca15242d3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:22.151006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-031302ad-4d1e-4637-9874-35fca15242d3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:22.154859 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-031302ad-4d1e-4637-9874-35fca15242d3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:22.155248 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-11ad8060-ba4b-4371-a36b-bf1a9045dfc9 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5" status: 200 len: 1548 microversion: 2.1 time: 0.244761 Oct 29 03:21:22.156455 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2539/5300] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:21 2022] GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5 => generated 1548 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:22.162401 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1babe3ef-198d-4043-9c3a-0daa975cd21c tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] Calling method '.version_select at 0x7ff05c1ccb80>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:22.249027 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1babe3ef-198d-4043-9c3a-0daa975cd21c tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/b920bc6c-b716-4754-b20b-7e0a87872f34" status: 200 len: 344 microversion: 2.1 time: 0.090993 Oct 29 03:21:22.249923 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2540/5301] 10.222.0.46 () {58 vars in 1245 bytes} [Sat Oct 29 03:21:22 2022] GET /compute/v2.1/os-volumes/b920bc6c-b716-4754-b20b-7e0a87872f34 => generated 344 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:22.425504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-031302ad-4d1e-4637-9874-35fca15242d3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:22.437370 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-031302ad-4d1e-4637-9874-35fca15242d3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1695 microversion: 2.1 time: 0.319082 Oct 29 03:21:22.438073 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2762/5302] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:22 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1695 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:23.266089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7f066a89-54d5-4b76-8ec9-6b3ced780875 tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] Calling method '.version_select at 0x7ff0538de430>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:23.337921 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7f066a89-54d5-4b76-8ec9-6b3ced780875 tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/b920bc6c-b716-4754-b20b-7e0a87872f34" status: 200 len: 345 microversion: 2.1 time: 0.070564 Oct 29 03:21:23.337921 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2541/5303] 10.222.0.46 () {58 vars in 1245 bytes} [Sat Oct 29 03:21:23 2022] GET /compute/v2.1/os-volumes/b920bc6c-b716-4754-b20b-7e0a87872f34 => generated 345 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:23.344964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-71a5ba10-deca-457d-a29e-7f9b7f6cfe75 tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] Action: 'create', calling method: .version_select at 0x7ff052b684c0>, body: {"snapshot": {"volume_id": "b920bc6c-b716-4754-b20b-7e0a87872f34", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-536420834"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:23.463760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fabbf30a-e7bc-4d97-9549-727abfa45725 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:23.464661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fabbf30a-e7bc-4d97-9549-727abfa45725 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:23.473563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fabbf30a-e7bc-4d97-9549-727abfa45725 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:23.474674 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fabbf30a-e7bc-4d97-9549-727abfa45725 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:23.475366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fabbf30a-e7bc-4d97-9549-727abfa45725 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:23.476092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fabbf30a-e7bc-4d97-9549-727abfa45725 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:23.476578 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fabbf30a-e7bc-4d97-9549-727abfa45725 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:23.477008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fabbf30a-e7bc-4d97-9549-727abfa45725 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:23.584261 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-71a5ba10-deca-457d-a29e-7f9b7f6cfe75 tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.242925 Oct 29 03:21:23.585567 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2763/5304] 10.222.0.46 () {60 vars in 1162 bytes} [Sat Oct 29 03:21:23 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:23.596442 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-83dc099e-56d8-497e-9fb5-eced124768a4 tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] Calling method '.version_select at 0x7ff052a56d30>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:23.640890 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-83dc099e-56d8-497e-9fb5-eced124768a4 tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/8bfb00c9-c9bd-4219-9462-51d96e67bc37" status: 200 len: 286 microversion: 2.1 time: 0.048268 Oct 29 03:21:23.642086 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2764/5305] 10.222.0.46 () {58 vars in 1251 bytes} [Sat Oct 29 03:21:23 2022] GET /compute/v2.1/os-snapshots/8bfb00c9-c9bd-4219-9462-51d96e67bc37 => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:23.655787 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ac71f454-08bd-4637-a7f1-83a1db53a0cd tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] Calling method '.version_select at 0x7ff052ac5af0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:23.711002 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ac71f454-08bd-4637-a7f1-83a1db53a0cd tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.061271 Oct 29 03:21:23.711786 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2765/5306] 10.222.0.46 () {58 vars in 1140 bytes} [Sat Oct 29 03:21:23 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:21:23.726419 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-361676fb-1dec-4835-a77a-a3cb88df9116 tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] Calling method '.version_select at 0x7ff052a04b80>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:23.769817 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fabbf30a-e7bc-4d97-9549-727abfa45725 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:23.780993 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-361676fb-1dec-4835-a77a-a3cb88df9116 tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/8bfb00c9-c9bd-4219-9462-51d96e67bc37" status: 200 len: 286 microversion: 2.1 time: 0.061405 Oct 29 03:21:23.782575 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2766/5307] 10.222.0.46 () {58 vars in 1251 bytes} [Sat Oct 29 03:21:23 2022] GET /compute/v2.1/os-snapshots/8bfb00c9-c9bd-4219-9462-51d96e67bc37 => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:21:23.786388 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fabbf30a-e7bc-4d97-9549-727abfa45725 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1695 microversion: 2.1 time: 0.327882 Oct 29 03:21:23.788237 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2542/5308] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:23 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1695 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:21:24.796964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1d91d602-8b82-4351-82d1-e0836bfda97e tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] Calling method '.version_select at 0x7ff052a5a3a0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:24.811499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d235a7c9-2617-4819-b467-3928f164503c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:24.812699 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d235a7c9-2617-4819-b467-3928f164503c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:24.847558 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d235a7c9-2617-4819-b467-3928f164503c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:24.848093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d235a7c9-2617-4819-b467-3928f164503c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:24.848550 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d235a7c9-2617-4819-b467-3928f164503c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:24.849316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d235a7c9-2617-4819-b467-3928f164503c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:24.849769 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d235a7c9-2617-4819-b467-3928f164503c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:24.850199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d235a7c9-2617-4819-b467-3928f164503c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:24.875035 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1d91d602-8b82-4351-82d1-e0836bfda97e tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/8bfb00c9-c9bd-4219-9462-51d96e67bc37" status: 200 len: 286 microversion: 2.1 time: 0.083350 Oct 29 03:21:24.876222 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2767/5309] 10.222.0.46 () {58 vars in 1251 bytes} [Sat Oct 29 03:21:24 2022] GET /compute/v2.1/os-snapshots/8bfb00c9-c9bd-4219-9462-51d96e67bc37 => generated 286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:25.153631 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d235a7c9-2617-4819-b467-3928f164503c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:25.170388 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d235a7c9-2617-4819-b467-3928f164503c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1694 microversion: 2.1 time: 0.361648 Oct 29 03:21:25.184682 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2543/5310] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:24 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1694 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:21:25.238860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-5e5abc71-ef4a-4ff4-a468-6b2781c49e12 req-a8e241e8-c9c1-4caf-95fb-db4809ff0341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0568de01-669e-4f98-8ca7-3e358669ef8f", "name": "network-vif-unplugged", "status": "completed", "tag": "c42a747a-f6ba-448c-a70e-519721103faf"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:25.256381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5e5abc71-ef4a-4ff4-a468-6b2781c49e12 req-a8e241e8-c9c1-4caf-95fb-db4809ff0341 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:25.258020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5e5abc71-ef4a-4ff4-a468-6b2781c49e12 req-a8e241e8-c9c1-4caf-95fb-db4809ff0341 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:25.259226 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5e5abc71-ef4a-4ff4-a468-6b2781c49e12 req-a8e241e8-c9c1-4caf-95fb-db4809ff0341 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:25.284134 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-5e5abc71-ef4a-4ff4-a468-6b2781c49e12 req-a8e241e8-c9c1-4caf-95fb-db4809ff0341 service nova] Creating event network-vif-unplugged:c42a747a-f6ba-448c-a70e-519721103faf for instance 0568de01-669e-4f98-8ca7-3e358669ef8f on n-h2-862967-2 Oct 29 03:21:25.303511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [req-5e5abc71-ef4a-4ff4-a468-6b2781c49e12 req-a8e241e8-c9c1-4caf-95fb-db4809ff0341 service nova] Instance 0568de01-669e-4f98-8ca7-3e358669ef8f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:21:25.346152 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-5e5abc71-ef4a-4ff4-a468-6b2781c49e12 req-a8e241e8-c9c1-4caf-95fb-db4809ff0341 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105518 Oct 29 03:21:25.349783 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2768/5311] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:25.889637 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-22c2b372-222f-42ce-acc2-3599854818ff tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] Calling method '.version_select at 0x7ff053816040>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:25.927782 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-22c2b372-222f-42ce-acc2-3599854818ff tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/8bfb00c9-c9bd-4219-9462-51d96e67bc37" status: 200 len: 287 microversion: 2.1 time: 0.043000 Oct 29 03:21:25.936340 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2544/5312] 10.222.0.46 () {58 vars in 1251 bytes} [Sat Oct 29 03:21:25 2022] GET /compute/v2.1/os-snapshots/8bfb00c9-c9bd-4219-9462-51d96e67bc37 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:25.943855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-52513b69-9146-4470-b333-4f9a67644479 tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] Calling method '.version_select at 0x7ff052a561f0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:26.062350 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-52513b69-9146-4470-b333-4f9a67644479 tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/8bfb00c9-c9bd-4219-9462-51d96e67bc37" status: 202 len: 0 microversion: 2.1 time: 0.122216 Oct 29 03:21:26.067617 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2769/5313] 10.222.0.46 () {58 vars in 1254 bytes} [Sat Oct 29 03:21:25 2022] DELETE /compute/v2.1/os-snapshots/8bfb00c9-c9bd-4219-9462-51d96e67bc37 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:21:26.076484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-597d515a-96bf-4098-a247-3c46cfd644ab tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] Calling method '.version_select at 0x7ff053704040>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:26.130201 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-597d515a-96bf-4098-a247-3c46cfd644ab tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/8bfb00c9-c9bd-4219-9462-51d96e67bc37" status: 200 len: 286 microversion: 2.1 time: 0.057880 Oct 29 03:21:26.130786 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2545/5314] 10.222.0.46 () {58 vars in 1251 bytes} [Sat Oct 29 03:21:26 2022] GET /compute/v2.1/os-snapshots/8bfb00c9-c9bd-4219-9462-51d96e67bc37 => generated 286 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:26.219617 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e7170a30-a6c5-4645-8de5-eba5ded797a7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:26.235169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e7170a30-a6c5-4645-8de5-eba5ded797a7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:26.249798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7170a30-a6c5-4645-8de5-eba5ded797a7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:26.251245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7170a30-a6c5-4645-8de5-eba5ded797a7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:26.251978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7170a30-a6c5-4645-8de5-eba5ded797a7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:26.252982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7170a30-a6c5-4645-8de5-eba5ded797a7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:26.253699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7170a30-a6c5-4645-8de5-eba5ded797a7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:26.254366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7170a30-a6c5-4645-8de5-eba5ded797a7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:26.615263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e7170a30-a6c5-4645-8de5-eba5ded797a7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:26.629199 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e7170a30-a6c5-4645-8de5-eba5ded797a7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1694 microversion: 2.1 time: 0.413311 Oct 29 03:21:26.653489 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2770/5315] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:26 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1694 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:27.144589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-469cd743-42d4-405a-81b4-36d1773d1f5d tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] Calling method '.version_select at 0x7ff0538de040>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:27.219606 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-469cd743-42d4-405a-81b4-36d1773d1f5d tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/8bfb00c9-c9bd-4219-9462-51d96e67bc37" status: 200 len: 286 microversion: 2.1 time: 0.080086 Oct 29 03:21:27.227124 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2546/5316] 10.222.0.46 () {58 vars in 1251 bytes} [Sat Oct 29 03:21:27 2022] GET /compute/v2.1/os-snapshots/8bfb00c9-c9bd-4219-9462-51d96e67bc37 => generated 286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:27.433019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-b069231d-54b6-407c-9e50-260064a59a2f req-4ce3ba1c-2274-4330-b852-ceef2f988c0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0568de01-669e-4f98-8ca7-3e358669ef8f", "tag": "c42a747a-f6ba-448c-a70e-519721103faf"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:27.452044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b069231d-54b6-407c-9e50-260064a59a2f req-4ce3ba1c-2274-4330-b852-ceef2f988c0f service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:27.452942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b069231d-54b6-407c-9e50-260064a59a2f req-4ce3ba1c-2274-4330-b852-ceef2f988c0f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:27.459041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b069231d-54b6-407c-9e50-260064a59a2f req-4ce3ba1c-2274-4330-b852-ceef2f988c0f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:27.492467 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-b069231d-54b6-407c-9e50-260064a59a2f req-4ce3ba1c-2274-4330-b852-ceef2f988c0f service nova] Creating event network-changed:c42a747a-f6ba-448c-a70e-519721103faf for instance 0568de01-669e-4f98-8ca7-3e358669ef8f on n-h2-862967-2 Oct 29 03:21:27.504681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [req-b069231d-54b6-407c-9e50-260064a59a2f req-4ce3ba1c-2274-4330-b852-ceef2f988c0f service nova] Instance 0568de01-669e-4f98-8ca7-3e358669ef8f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:21:27.524815 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-b069231d-54b6-407c-9e50-260064a59a2f req-4ce3ba1c-2274-4330-b852-ceef2f988c0f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094989 Oct 29 03:21:27.526627 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2771/5317] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:27.659154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-92e7df52-f23d-4960-9277-f9f8495e49ce tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:27.659826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-92e7df52-f23d-4960-9277-f9f8495e49ce tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:27.667327 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92e7df52-f23d-4960-9277-f9f8495e49ce tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:27.668025 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92e7df52-f23d-4960-9277-f9f8495e49ce tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:27.668551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92e7df52-f23d-4960-9277-f9f8495e49ce tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:27.669530 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92e7df52-f23d-4960-9277-f9f8495e49ce tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:27.671359 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92e7df52-f23d-4960-9277-f9f8495e49ce tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:27.672063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92e7df52-f23d-4960-9277-f9f8495e49ce tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:28.085016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-92e7df52-f23d-4960-9277-f9f8495e49ce tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:28.096373 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-92e7df52-f23d-4960-9277-f9f8495e49ce tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1692 microversion: 2.1 time: 0.441051 Oct 29 03:21:28.097352 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2547/5318] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:27 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1692 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:28.234069 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8a7c05b9-df2f-4d3a-9006-e45bdfe1a2fe tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] Calling method '.version_select at 0x7ff052a2f1f0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:28.289060 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8a7c05b9-df2f-4d3a-9006-e45bdfe1a2fe tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/8bfb00c9-c9bd-4219-9462-51d96e67bc37" status: 200 len: 286 microversion: 2.1 time: 0.059089 Oct 29 03:21:28.289645 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2772/5319] 10.222.0.46 () {58 vars in 1251 bytes} [Sat Oct 29 03:21:28 2022] GET /compute/v2.1/os-snapshots/8bfb00c9-c9bd-4219-9462-51d96e67bc37 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:29.128884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e3ea61eb-6025-4e7e-a33c-b34c77be9231 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:29.129679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e3ea61eb-6025-4e7e-a33c-b34c77be9231 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:29.134871 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=52 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:29.143510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3ea61eb-6025-4e7e-a33c-b34c77be9231 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:29.143997 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3ea61eb-6025-4e7e-a33c-b34c77be9231 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:29.144434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3ea61eb-6025-4e7e-a33c-b34c77be9231 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:29.148668 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3ea61eb-6025-4e7e-a33c-b34c77be9231 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:29.149175 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3ea61eb-6025-4e7e-a33c-b34c77be9231 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:29.149722 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3ea61eb-6025-4e7e-a33c-b34c77be9231 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:29.305002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4cb125fe-770a-4c8a-ab3c-460fca982feb tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] Calling method '.version_select at 0x7ff052aa3f70>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:29.347762 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-4cb125fe-770a-4c8a-ab3c-460fca982feb tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] HTTP exception thrown: Snapshot 8bfb00c9-c9bd-4219-9462-51d96e67bc37 could not be found. Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4cb125fe-770a-4c8a-ab3c-460fca982feb tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] Request method failure captured: Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/os-snapshots/8bfb00c9-c9bd-4219-9462-51d96e67bc37 HTTP/1.1 Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJwxweXEMnNe2mBX64aNfGdsS7w9W_6ZOWFf_idHy__19tqZhWUAOa3o3qx2NRLdo23seIvXo8rhzF7qNrB45qV0qRB9_s_imGrPlzUmWj08qCgZPS17eIBp9DlAdqlNlp8BpGXrhw06iW4N9-M3KCnjZg4AWq44dnKfX9PJfG_O-co Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: e64a32413efe4acfa297471e85b99c91 Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1224159872 Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e64a32413efe4acfa297471e85b99c91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e64a32413efe4acfa297471e85b99c91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e64a32413efe4acfa297471e85b99c91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e64a32413efe4acfa297471e85b99c91"}]}] Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1224159872 Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: e64a32413efe4acfa297471e85b99c91 Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1224159872 Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-VolumesSnapshotsTestJSON-1224159872-project Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 5a03335dde3245ad954ac433a2e7f36d Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1224159872-project Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: exception: Snapshot 8bfb00c9-c9bd-4219-9462-51d96e67bc37 could not be found. Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '8bfb00c9-c9bd-4219-9462-51d96e67bc37'} Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8bfb00c9-c9bd-4219-9462-51d96e67bc37 could not be found. (HTTP 404) (Request-ID: req-ba58dd0d-efb8-455b-8f11-39acb0de9348) Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 03:21:29.358995 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8bfb00c9-c9bd-4219-9462-51d96e67bc37 could not be found. Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8bfb00c9-c9bd-4219-9462-51d96e67bc37 could not be found. Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8bfb00c9-c9bd-4219-9462-51d96e67bc37 could not be found. Oct 29 03:21:29.364576 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:29.371800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4cb125fe-770a-4c8a-ab3c-460fca982feb tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] Returning 404 to user: Snapshot 8bfb00c9-c9bd-4219-9462-51d96e67bc37 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:21:29.373325 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4cb125fe-770a-4c8a-ab3c-460fca982feb tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/8bfb00c9-c9bd-4219-9462-51d96e67bc37" status: 404 len: 111 microversion: 2.1 time: 0.074062 Oct 29 03:21:29.375273 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2773/5320] 10.222.0.46 () {58 vars in 1251 bytes} [Sat Oct 29 03:21:29 2022] GET /compute/v2.1/os-snapshots/8bfb00c9-c9bd-4219-9462-51d96e67bc37 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:21:29.384096 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0c197e08-4fc5-44e8-b5f1-41af00c55022 tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] Calling method '.version_select at 0x7ff052ac5ca0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:29.417584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e3ea61eb-6025-4e7e-a33c-b34c77be9231 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:29.426698 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e3ea61eb-6025-4e7e-a33c-b34c77be9231 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1692 microversion: 2.1 time: 0.305473 Oct 29 03:21:29.432425 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2548/5321] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:29 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1692 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:29.510862 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0c197e08-4fc5-44e8-b5f1-41af00c55022 tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/b920bc6c-b716-4754-b20b-7e0a87872f34" status: 202 len: 0 microversion: 2.1 time: 0.130992 Oct 29 03:21:29.511850 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2774/5322] 10.222.0.46 () {58 vars in 1248 bytes} [Sat Oct 29 03:21:29 2022] DELETE /compute/v2.1/os-volumes/b920bc6c-b716-4754-b20b-7e0a87872f34 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:21:29.520556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9aa61065-be9d-45cd-ac02-ff14a103689f tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] Calling method '.version_select at 0x7ff05c15b700>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:29.633654 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9aa61065-be9d-45cd-ac02-ff14a103689f tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/b920bc6c-b716-4754-b20b-7e0a87872f34" status: 200 len: 344 microversion: 2.1 time: 0.117734 Oct 29 03:21:29.634836 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2549/5323] 10.222.0.46 () {58 vars in 1245 bytes} [Sat Oct 29 03:21:29 2022] GET /compute/v2.1/os-volumes/b920bc6c-b716-4754-b20b-7e0a87872f34 => generated 344 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:30.453201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c3478d04-bb01-4f30-b999-c1562b61ede5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:30.454016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c3478d04-bb01-4f30-b999-c1562b61ede5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:30.471114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3478d04-bb01-4f30-b999-c1562b61ede5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:30.471720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3478d04-bb01-4f30-b999-c1562b61ede5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:30.472568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3478d04-bb01-4f30-b999-c1562b61ede5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:30.473296 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3478d04-bb01-4f30-b999-c1562b61ede5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:30.473757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3478d04-bb01-4f30-b999-c1562b61ede5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:30.474188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3478d04-bb01-4f30-b999-c1562b61ede5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:30.650321 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5e544e8a-33f8-4107-b294-9e0b98ee8bcb tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] Calling method '.version_select at 0x7ff05c0a4820>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:30.671908 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c3478d04-bb01-4f30-b999-c1562b61ede5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:30.686081 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c3478d04-bb01-4f30-b999-c1562b61ede5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1689 microversion: 2.1 time: 0.238267 Oct 29 03:21:30.687010 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2775/5324] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:30 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1689 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:30.716418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-97b0d062-5fd3-4337-b817-19055cd953cf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:30.717087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-97b0d062-5fd3-4337-b817-19055cd953cf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:30.736389 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-97b0d062-5fd3-4337-b817-19055cd953cf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:30.737217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-97b0d062-5fd3-4337-b817-19055cd953cf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:30.737972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-97b0d062-5fd3-4337-b817-19055cd953cf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:30.738188 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5e544e8a-33f8-4107-b294-9e0b98ee8bcb tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/b920bc6c-b716-4754-b20b-7e0a87872f34" status: 200 len: 344 microversion: 2.1 time: 0.092198 Oct 29 03:21:30.739112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-97b0d062-5fd3-4337-b817-19055cd953cf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:30.739248 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2550/5325] 10.222.0.46 () {58 vars in 1245 bytes} [Sat Oct 29 03:21:30 2022] GET /compute/v2.1/os-volumes/b920bc6c-b716-4754-b20b-7e0a87872f34 => generated 344 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:21:30.740006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-97b0d062-5fd3-4337-b817-19055cd953cf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:30.740751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-97b0d062-5fd3-4337-b817-19055cd953cf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:30.815009 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-97b0d062-5fd3-4337-b817-19055cd953cf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "POST /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f/action" status: 204 len: 0 microversion: 2.1 time: 0.104118 Oct 29 03:21:30.818898 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2776/5326] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:21:30 2022] POST /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f/action => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:21:30.824876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6b99c9d7-f22d-4661-9f29-ce69ced7bf70 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:30.825507 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6b99c9d7-f22d-4661-9f29-ce69ced7bf70 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:30.836223 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b99c9d7-f22d-4661-9f29-ce69ced7bf70 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:30.836748 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b99c9d7-f22d-4661-9f29-ce69ced7bf70 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:30.837188 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b99c9d7-f22d-4661-9f29-ce69ced7bf70 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:30.837908 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b99c9d7-f22d-4661-9f29-ce69ced7bf70 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:30.838360 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b99c9d7-f22d-4661-9f29-ce69ced7bf70 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:30.846539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b99c9d7-f22d-4661-9f29-ce69ced7bf70 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:31.049803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6cd785ab-7feb-4e16-a9c8-db0b636e7b57 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:31.050889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6cd785ab-7feb-4e16-a9c8-db0b636e7b57 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:31.061562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cd785ab-7feb-4e16-a9c8-db0b636e7b57 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:31.071231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cd785ab-7feb-4e16-a9c8-db0b636e7b57 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:31.079508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cd785ab-7feb-4e16-a9c8-db0b636e7b57 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:31.080498 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cd785ab-7feb-4e16-a9c8-db0b636e7b57 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:31.081212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cd785ab-7feb-4e16-a9c8-db0b636e7b57 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:31.081647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cd785ab-7feb-4e16-a9c8-db0b636e7b57 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:31.226605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6b99c9d7-f22d-4661-9f29-ce69ced7bf70 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:31.242938 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6b99c9d7-f22d-4661-9f29-ce69ced7bf70 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1689 microversion: 2.1 time: 0.420907 Oct 29 03:21:31.259436 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2551/5327] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:30 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1689 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:31.409259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6cd785ab-7feb-4e16-a9c8-db0b636e7b57 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:31.419140 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6cd785ab-7feb-4e16-a9c8-db0b636e7b57 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.374238 Oct 29 03:21:31.421270 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2777/5328] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:31 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:21:31.454282 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2b18d064-ffc7-4e7c-a3ba-36cfc7b4651a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:31.455935 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2b18d064-ffc7-4e7c-a3ba-36cfc7b4651a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:31.484772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b18d064-ffc7-4e7c-a3ba-36cfc7b4651a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:31.486866 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b18d064-ffc7-4e7c-a3ba-36cfc7b4651a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:31.490780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b18d064-ffc7-4e7c-a3ba-36cfc7b4651a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:31.492284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b18d064-ffc7-4e7c-a3ba-36cfc7b4651a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:31.493209 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b18d064-ffc7-4e7c-a3ba-36cfc7b4651a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:31.494688 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b18d064-ffc7-4e7c-a3ba-36cfc7b4651a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:31.753415 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-56cb6edb-c677-49a0-9bee-7c53a770e925 tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] Calling method '.version_select at 0x7ff052b68ee0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:31.818851 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-56cb6edb-c677-49a0-9bee-7c53a770e925 tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/b920bc6c-b716-4754-b20b-7e0a87872f34" status: 200 len: 344 microversion: 2.1 time: 0.069497 Oct 29 03:21:31.819556 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2778/5329] 10.222.0.46 () {58 vars in 1245 bytes} [Sat Oct 29 03:21:31 2022] GET /compute/v2.1/os-volumes/b920bc6c-b716-4754-b20b-7e0a87872f34 => generated 344 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:21:32.274076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4d50e354-b495-4ab9-ba69-4666eac2f759 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:32.274796 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4d50e354-b495-4ab9-ba69-4666eac2f759 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:32.306808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d50e354-b495-4ab9-ba69-4666eac2f759 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:32.307426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d50e354-b495-4ab9-ba69-4666eac2f759 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:32.307979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d50e354-b495-4ab9-ba69-4666eac2f759 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:32.317486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d50e354-b495-4ab9-ba69-4666eac2f759 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:32.318270 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2b18d064-ffc7-4e7c-a3ba-36cfc7b4651a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:32.318755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d50e354-b495-4ab9-ba69-4666eac2f759 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:32.320118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d50e354-b495-4ab9-ba69-4666eac2f759 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:32.338888 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2b18d064-ffc7-4e7c-a3ba-36cfc7b4651a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.884712 Oct 29 03:21:32.346207 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2552/5330] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:31 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:21:32.395020 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8e4ccebb-366e-4698-902f-5479f7128a65 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:32.395736 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8e4ccebb-366e-4698-902f-5479f7128a65 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:32.417472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8e4ccebb-366e-4698-902f-5479f7128a65 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:32.421394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8e4ccebb-366e-4698-902f-5479f7128a65 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:32.424974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8e4ccebb-366e-4698-902f-5479f7128a65 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:32.426389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8e4ccebb-366e-4698-902f-5479f7128a65 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:32.433080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8e4ccebb-366e-4698-902f-5479f7128a65 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:32.433804 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8e4ccebb-366e-4698-902f-5479f7128a65 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:32.970662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4d50e354-b495-4ab9-ba69-4666eac2f759 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:32.990571 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4d50e354-b495-4ab9-ba69-4666eac2f759 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1689 microversion: 2.1 time: 0.720763 Oct 29 03:21:33.004556 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2779/5331] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:32 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1689 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:33.015648 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-de901292-25f2-4681-9374-a6266a8b3687 tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] Calling method '.version_select at 0x7ff052aaf040>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:33.048392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8e4ccebb-366e-4698-902f-5479f7128a65 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:33.056349 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8e4ccebb-366e-4698-902f-5479f7128a65 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.684116 Oct 29 03:21:33.060643 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2553/5332] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:32 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:33.091306 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-de901292-25f2-4681-9374-a6266a8b3687 tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] HTTP exception thrown: Volume b920bc6c-b716-4754-b20b-7e0a87872f34 could not be found. Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-de901292-25f2-4681-9374-a6266a8b3687 tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] Request method failure captured: Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/os-volumes/b920bc6c-b716-4754-b20b-7e0a87872f34 HTTP/1.1 Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJwxweXEMnNe2mBX64aNfGdsS7w9W_6ZOWFf_idHy__19tqZhWUAOa3o3qx2NRLdo23seIvXo8rhzF7qNrB45qV0qRB9_s_imGrPlzUmWj08qCgZPS17eIBp9DlAdqlNlp8BpGXrhw06iW4N9-M3KCnjZg4AWq44dnKfX9PJfG_O-co Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: e64a32413efe4acfa297471e85b99c91 Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1224159872 Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e64a32413efe4acfa297471e85b99c91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e64a32413efe4acfa297471e85b99c91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e64a32413efe4acfa297471e85b99c91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e64a32413efe4acfa297471e85b99c91"}]}] Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1224159872 Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: e64a32413efe4acfa297471e85b99c91 Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1224159872 Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-VolumesSnapshotsTestJSON-1224159872-project Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 5a03335dde3245ad954ac433a2e7f36d Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1224159872-project Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: exception: Volume b920bc6c-b716-4754-b20b-7e0a87872f34 could not be found. Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'b920bc6c-b716-4754-b20b-7e0a87872f34'} Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b920bc6c-b716-4754-b20b-7e0a87872f34 could not be found. (HTTP 404) (Request-ID: req-0c5a7acb-4e04-4880-92f8-e7d36c556782) Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 03:21:33.094582 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b920bc6c-b716-4754-b20b-7e0a87872f34 could not be found. Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b920bc6c-b716-4754-b20b-7e0a87872f34 could not be found. Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b920bc6c-b716-4754-b20b-7e0a87872f34 could not be found. Oct 29 03:21:33.099278 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:33.108256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3f1ffcfb-bf7a-4e30-8ea5-918d2d760946 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:33.108256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3f1ffcfb-bf7a-4e30-8ea5-918d2d760946 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:33.108648 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-de901292-25f2-4681-9374-a6266a8b3687 tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] Returning 404 to user: Volume b920bc6c-b716-4754-b20b-7e0a87872f34 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:21:33.110204 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-de901292-25f2-4681-9374-a6266a8b3687 tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/b920bc6c-b716-4754-b20b-7e0a87872f34" status: 404 len: 109 microversion: 2.1 time: 0.114370 Oct 29 03:21:33.111010 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2780/5333] 10.222.0.46 () {58 vars in 1245 bytes} [Sat Oct 29 03:21:32 2022] GET /compute/v2.1/os-volumes/b920bc6c-b716-4754-b20b-7e0a87872f34 => generated 109 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:21:33.117928 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3f1ffcfb-bf7a-4e30-8ea5-918d2d760946 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:33.118554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3f1ffcfb-bf7a-4e30-8ea5-918d2d760946 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:33.120227 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3f1ffcfb-bf7a-4e30-8ea5-918d2d760946 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:33.122490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fcf42a2d-3a40-41ea-9417-b4c02d981e9c tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] Calling method '.version_select at 0x7ff052a1c5e0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:33.123408 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3f1ffcfb-bf7a-4e30-8ea5-918d2d760946 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:33.123897 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3f1ffcfb-bf7a-4e30-8ea5-918d2d760946 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:33.124343 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3f1ffcfb-bf7a-4e30-8ea5-918d2d760946 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:33.208420 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-fcf42a2d-3a40-41ea-9417-b4c02d981e9c tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] HTTP exception thrown: Volume b920bc6c-b716-4754-b20b-7e0a87872f34 could not be found. Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fcf42a2d-3a40-41ea-9417-b4c02d981e9c tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] Request method failure captured: Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/os-volumes/b920bc6c-b716-4754-b20b-7e0a87872f34 HTTP/1.1 Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJwxweXEMnNe2mBX64aNfGdsS7w9W_6ZOWFf_idHy__19tqZhWUAOa3o3qx2NRLdo23seIvXo8rhzF7qNrB45qV0qRB9_s_imGrPlzUmWj08qCgZPS17eIBp9DlAdqlNlp8BpGXrhw06iW4N9-M3KCnjZg4AWq44dnKfX9PJfG_O-co Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: e64a32413efe4acfa297471e85b99c91 Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1224159872 Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e64a32413efe4acfa297471e85b99c91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e64a32413efe4acfa297471e85b99c91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e64a32413efe4acfa297471e85b99c91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e64a32413efe4acfa297471e85b99c91"}]}] Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1224159872 Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: e64a32413efe4acfa297471e85b99c91 Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1224159872 Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-VolumesSnapshotsTestJSON-1224159872-project Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 5a03335dde3245ad954ac433a2e7f36d Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1224159872-project Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: exception: Volume b920bc6c-b716-4754-b20b-7e0a87872f34 could not be found. Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'b920bc6c-b716-4754-b20b-7e0a87872f34'} Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b920bc6c-b716-4754-b20b-7e0a87872f34 could not be found. (HTTP 404) (Request-ID: req-109e08e4-93f6-49d9-941d-5a3c26d122c0) Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 03:21:33.211002 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b920bc6c-b716-4754-b20b-7e0a87872f34 could not be found. Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b920bc6c-b716-4754-b20b-7e0a87872f34 could not be found. Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b920bc6c-b716-4754-b20b-7e0a87872f34 could not be found. Oct 29 03:21:33.216163 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:33.222395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fcf42a2d-3a40-41ea-9417-b4c02d981e9c tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] Returning 404 to user: Volume b920bc6c-b716-4754-b20b-7e0a87872f34 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:21:33.222395 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fcf42a2d-3a40-41ea-9417-b4c02d981e9c tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/b920bc6c-b716-4754-b20b-7e0a87872f34" status: 404 len: 109 microversion: 2.1 time: 0.104430 Oct 29 03:21:33.222395 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2781/5334] 10.222.0.46 () {58 vars in 1248 bytes} [Sat Oct 29 03:21:33 2022] DELETE /compute/v2.1/os-volumes/b920bc6c-b716-4754-b20b-7e0a87872f34 => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:21:33.235796 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9f29dad3-384b-44a6-ad82-c6f97fb4a320 tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] Calling method '.version_select at 0x7ff052a68f70>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:33.336408 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-9f29dad3-384b-44a6-ad82-c6f97fb4a320 tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] HTTP exception thrown: Volume b920bc6c-b716-4754-b20b-7e0a87872f34 could not be found. Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9f29dad3-384b-44a6-ad82-c6f97fb4a320 tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] Request method failure captured: Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/os-volumes/b920bc6c-b716-4754-b20b-7e0a87872f34 HTTP/1.1 Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJwxweXEMnNe2mBX64aNfGdsS7w9W_6ZOWFf_idHy__19tqZhWUAOa3o3qx2NRLdo23seIvXo8rhzF7qNrB45qV0qRB9_s_imGrPlzUmWj08qCgZPS17eIBp9DlAdqlNlp8BpGXrhw06iW4N9-M3KCnjZg4AWq44dnKfX9PJfG_O-co Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: e64a32413efe4acfa297471e85b99c91 Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1224159872 Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e64a32413efe4acfa297471e85b99c91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e64a32413efe4acfa297471e85b99c91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e64a32413efe4acfa297471e85b99c91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e64a32413efe4acfa297471e85b99c91"}]}] Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1224159872 Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: e64a32413efe4acfa297471e85b99c91 Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1224159872 Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-VolumesSnapshotsTestJSON-1224159872-project Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 5a03335dde3245ad954ac433a2e7f36d Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1224159872-project Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: exception: Volume b920bc6c-b716-4754-b20b-7e0a87872f34 could not be found. Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'b920bc6c-b716-4754-b20b-7e0a87872f34'} Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b920bc6c-b716-4754-b20b-7e0a87872f34 could not be found. (HTTP 404) (Request-ID: req-efdc66a5-83d1-4ddb-8b7e-0f0b599465b8) Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 03:21:33.344340 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b920bc6c-b716-4754-b20b-7e0a87872f34 could not be found. Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b920bc6c-b716-4754-b20b-7e0a87872f34 could not be found. Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b920bc6c-b716-4754-b20b-7e0a87872f34 could not be found. Oct 29 03:21:33.351455 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:33.360678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9f29dad3-384b-44a6-ad82-c6f97fb4a320 tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] Returning 404 to user: Volume b920bc6c-b716-4754-b20b-7e0a87872f34 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:21:33.360678 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9f29dad3-384b-44a6-ad82-c6f97fb4a320 tempest-VolumesSnapshotsTestJSON-1224159872 tempest-VolumesSnapshotsTestJSON-1224159872-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/b920bc6c-b716-4754-b20b-7e0a87872f34" status: 404 len: 109 microversion: 2.1 time: 0.131850 Oct 29 03:21:33.369470 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2782/5335] 10.222.0.46 () {58 vars in 1245 bytes} [Sat Oct 29 03:21:33 2022] GET /compute/v2.1/os-volumes/b920bc6c-b716-4754-b20b-7e0a87872f34 => generated 109 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:21:33.908856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-60fa1e4f-d393-4378-8f13-3155b49b1422 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:33.909434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-60fa1e4f-d393-4378-8f13-3155b49b1422 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] [instance: 00aa17f2-3f29-4036-b14a-9b3809bfbd7a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:33.920120 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60fa1e4f-d393-4378-8f13-3155b49b1422 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:33.922132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60fa1e4f-d393-4378-8f13-3155b49b1422 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:33.923410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60fa1e4f-d393-4378-8f13-3155b49b1422 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:33.924153 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60fa1e4f-d393-4378-8f13-3155b49b1422 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:33.924687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60fa1e4f-d393-4378-8f13-3155b49b1422 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:33.925117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60fa1e4f-d393-4378-8f13-3155b49b1422 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:34.006347 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-60fa1e4f-d393-4378-8f13-3155b49b1422 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] 10.222.0.46 "GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.103418 Oct 29 03:21:34.019377 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2783/5336] 10.222.0.46 () {58 vars in 1293 bytes} [Sat Oct 29 03:21:33 2022] GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a/os-server-password => generated 116 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:34.041250 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eccf8964-c214-4122-a76a-d45055997ade tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:34.043525 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-eccf8964-c214-4122-a76a-d45055997ade tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:34.065137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eccf8964-c214-4122-a76a-d45055997ade tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:34.069493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eccf8964-c214-4122-a76a-d45055997ade tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:34.070387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eccf8964-c214-4122-a76a-d45055997ade tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:34.072744 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eccf8964-c214-4122-a76a-d45055997ade tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:34.074321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eccf8964-c214-4122-a76a-d45055997ade tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:34.075309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eccf8964-c214-4122-a76a-d45055997ade tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:34.180332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3f1ffcfb-bf7a-4e30-8ea5-918d2d760946 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:34.190229 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3f1ffcfb-bf7a-4e30-8ea5-918d2d760946 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 1.108572 Oct 29 03:21:34.220127 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2554/5337] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:33 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:34.361185 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-92f26cfa-7517-4671-9b10-42588ead135c req-6ffb0318-a52c-4ed8-b829-409faf3d3e75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0568de01-669e-4f98-8ca7-3e358669ef8f", "name": "network-vif-plugged", "status": "completed", "tag": "c42a747a-f6ba-448c-a70e-519721103faf"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:34.413197 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-92f26cfa-7517-4671-9b10-42588ead135c req-6ffb0318-a52c-4ed8-b829-409faf3d3e75 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:34.419653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-92f26cfa-7517-4671-9b10-42588ead135c req-6ffb0318-a52c-4ed8-b829-409faf3d3e75 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:34.421183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-92f26cfa-7517-4671-9b10-42588ead135c req-6ffb0318-a52c-4ed8-b829-409faf3d3e75 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:34.477183 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-92f26cfa-7517-4671-9b10-42588ead135c req-6ffb0318-a52c-4ed8-b829-409faf3d3e75 service nova] Creating event network-vif-plugged:c42a747a-f6ba-448c-a70e-519721103faf for instance 0568de01-669e-4f98-8ca7-3e358669ef8f on n-h2-862967-2 Oct 29 03:21:34.491216 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [req-92f26cfa-7517-4671-9b10-42588ead135c req-6ffb0318-a52c-4ed8-b829-409faf3d3e75 service nova] Instance 0568de01-669e-4f98-8ca7-3e358669ef8f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:21:34.541378 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-92f26cfa-7517-4671-9b10-42588ead135c req-6ffb0318-a52c-4ed8-b829-409faf3d3e75 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180270 Oct 29 03:21:34.542320 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2555/5338] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:34.549434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d03e29d6-950b-40da-8f9b-1a65dbb29fbd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-533784672", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "e565ca97-fa54-4380-a34f-e5c00430d054"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:34.661217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-d03e29d6-950b-40da-8f9b-1a65dbb29fbd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] validate_networks() for [('e565ca97-fa54-4380-a34f-e5c00430d054', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:21:34.691238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-eccf8964-c214-4122-a76a-d45055997ade tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:34.704283 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eccf8964-c214-4122-a76a-d45055997ade tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1689 microversion: 2.1 time: 0.683632 Oct 29 03:21:34.704998 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2784/5339] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:34 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1689 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:35.402763 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-d03e29d6-950b-40da-8f9b-1a65dbb29fbd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:21:35.403998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-d03e29d6-950b-40da-8f9b-1a65dbb29fbd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:21:35.405044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-d03e29d6-950b-40da-8f9b-1a65dbb29fbd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:21:35.405678 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-d03e29d6-950b-40da-8f9b-1a65dbb29fbd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:21:35.406800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-d03e29d6-950b-40da-8f9b-1a65dbb29fbd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:21:35.420362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d03e29d6-950b-40da-8f9b-1a65dbb29fbd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:35.421211 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d03e29d6-950b-40da-8f9b-1a65dbb29fbd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:35.421814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d03e29d6-950b-40da-8f9b-1a65dbb29fbd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:35.422865 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d03e29d6-950b-40da-8f9b-1a65dbb29fbd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:35.424059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d03e29d6-950b-40da-8f9b-1a65dbb29fbd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:35.424766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d03e29d6-950b-40da-8f9b-1a65dbb29fbd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:35.447899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-d03e29d6-950b-40da-8f9b-1a65dbb29fbd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Getting quotas for project df5fe7cedcd14b61925dc300274b3c70. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:21:35.455491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-d03e29d6-950b-40da-8f9b-1a65dbb29fbd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Getting quotas for user aac411c78a5648be8a1c43893d9a0798 and project df5fe7cedcd14b61925dc300274b3c70. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:21:35.484790 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d03e29d6-950b-40da-8f9b-1a65dbb29fbd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:21:35.487534 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d03e29d6-950b-40da-8f9b-1a65dbb29fbd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 7b81a724-aab0-42cc-b5a6-0d732165217b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:21:35.543962 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d03e29d6-950b-40da-8f9b-1a65dbb29fbd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.000291 Oct 29 03:21:35.557780 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-04a50fcf-c6a9-4e0b-9c42-d8cd586828f0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:35.559229 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-04a50fcf-c6a9-4e0b-9c42-d8cd586828f0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 7b81a724-aab0-42cc-b5a6-0d732165217b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:35.566320 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2556/5340] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:21:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:21:35.668359 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-04a50fcf-c6a9-4e0b-9c42-d8cd586828f0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:35.677072 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-04a50fcf-c6a9-4e0b-9c42-d8cd586828f0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b" status: 200 len: 1214 microversion: 2.1 time: 0.123498 Oct 29 03:21:35.689259 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2785/5341] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:35 2022] GET /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b => generated 1214 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:35.732203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-64e5e689-f5b4-4e66-8950-d3c3125d33bc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:35.732868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-64e5e689-f5b4-4e66-8950-d3c3125d33bc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:35.744218 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64e5e689-f5b4-4e66-8950-d3c3125d33bc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:35.744871 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64e5e689-f5b4-4e66-8950-d3c3125d33bc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:35.745171 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64e5e689-f5b4-4e66-8950-d3c3125d33bc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:35.745883 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64e5e689-f5b4-4e66-8950-d3c3125d33bc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:35.746343 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64e5e689-f5b4-4e66-8950-d3c3125d33bc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:35.746916 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64e5e689-f5b4-4e66-8950-d3c3125d33bc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:35.907908 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-64e5e689-f5b4-4e66-8950-d3c3125d33bc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:35.918766 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-64e5e689-f5b4-4e66-8950-d3c3125d33bc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1681 microversion: 2.1 time: 0.191208 Oct 29 03:21:35.920062 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2557/5342] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:35 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1681 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:36.702955 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6557125c-c8d9-4fba-b823-882e52c692c4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:36.704769 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6557125c-c8d9-4fba-b823-882e52c692c4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 7b81a724-aab0-42cc-b5a6-0d732165217b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:36.719788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6557125c-c8d9-4fba-b823-882e52c692c4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:36.720610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6557125c-c8d9-4fba-b823-882e52c692c4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:36.721249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6557125c-c8d9-4fba-b823-882e52c692c4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:36.722417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6557125c-c8d9-4fba-b823-882e52c692c4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:36.723133 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6557125c-c8d9-4fba-b823-882e52c692c4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:36.723722 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6557125c-c8d9-4fba-b823-882e52c692c4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:36.804807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6557125c-c8d9-4fba-b823-882e52c692c4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:36.815945 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6557125c-c8d9-4fba-b823-882e52c692c4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b" status: 200 len: 1266 microversion: 2.1 time: 0.119991 Oct 29 03:21:36.818016 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2786/5343] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:36 2022] GET /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b => generated 1266 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:37.849730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5d586a5e-c4b4-4a60-91fe-45ee09423cee tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:37.850266 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5d586a5e-c4b4-4a60-91fe-45ee09423cee tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 7b81a724-aab0-42cc-b5a6-0d732165217b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:37.888658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d586a5e-c4b4-4a60-91fe-45ee09423cee tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:37.893520 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d586a5e-c4b4-4a60-91fe-45ee09423cee tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:37.895582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d586a5e-c4b4-4a60-91fe-45ee09423cee tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:37.902853 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d586a5e-c4b4-4a60-91fe-45ee09423cee tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:37.903546 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d586a5e-c4b4-4a60-91fe-45ee09423cee tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:37.903994 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d586a5e-c4b4-4a60-91fe-45ee09423cee tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:38.165555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5d586a5e-c4b4-4a60-91fe-45ee09423cee tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:38.188251 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5d586a5e-c4b4-4a60-91fe-45ee09423cee tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b" status: 200 len: 1314 microversion: 2.1 time: 0.350507 Oct 29 03:21:38.189580 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2558/5344] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:37 2022] GET /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:38.932481 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-fa7c4e16-2ded-45ae-ba1b-aab217b56d3a req-ee69a9ec-7635-48e0-8469-1f269a750573 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b81a724-aab0-42cc-b5a6-0d732165217b", "tag": "c15dc864-37b7-4a0c-8d64-c4ce30f10c49"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:38.963910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-fa7c4e16-2ded-45ae-ba1b-aab217b56d3a req-ee69a9ec-7635-48e0-8469-1f269a750573 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:38.965370 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-fa7c4e16-2ded-45ae-ba1b-aab217b56d3a req-ee69a9ec-7635-48e0-8469-1f269a750573 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:38.966054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-fa7c4e16-2ded-45ae-ba1b-aab217b56d3a req-ee69a9ec-7635-48e0-8469-1f269a750573 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:38.982211 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-fa7c4e16-2ded-45ae-ba1b-aab217b56d3a req-ee69a9ec-7635-48e0-8469-1f269a750573 service nova] Creating event network-changed:c15dc864-37b7-4a0c-8d64-c4ce30f10c49 for instance 7b81a724-aab0-42cc-b5a6-0d732165217b on n-h1-862967-2 Oct 29 03:21:38.987985 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-fa7c4e16-2ded-45ae-ba1b-aab217b56d3a req-ee69a9ec-7635-48e0-8469-1f269a750573 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066174 Oct 29 03:21:38.988944 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2787/5345] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:39.217951 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ebdba540-d662-41df-b10a-0b941507aa70 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:39.219201 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ebdba540-d662-41df-b10a-0b941507aa70 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 7b81a724-aab0-42cc-b5a6-0d732165217b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:39.236270 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ebdba540-d662-41df-b10a-0b941507aa70 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:39.236907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ebdba540-d662-41df-b10a-0b941507aa70 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:39.237422 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ebdba540-d662-41df-b10a-0b941507aa70 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:39.238225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ebdba540-d662-41df-b10a-0b941507aa70 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:39.238765 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ebdba540-d662-41df-b10a-0b941507aa70 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:39.239235 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ebdba540-d662-41df-b10a-0b941507aa70 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:39.480823 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ebdba540-d662-41df-b10a-0b941507aa70 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:39.494078 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ebdba540-d662-41df-b10a-0b941507aa70 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b" status: 200 len: 1314 microversion: 2.1 time: 0.285967 Oct 29 03:21:39.499510 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2559/5346] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:39 2022] GET /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:40.522691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3b170b23-1e70-4069-bcde-7068e887ef12 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:40.523396 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3b170b23-1e70-4069-bcde-7068e887ef12 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 7b81a724-aab0-42cc-b5a6-0d732165217b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:40.531076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:40.538866 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b170b23-1e70-4069-bcde-7068e887ef12 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:40.539364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b170b23-1e70-4069-bcde-7068e887ef12 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:40.539799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b170b23-1e70-4069-bcde-7068e887ef12 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:40.540836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b170b23-1e70-4069-bcde-7068e887ef12 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:40.541608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b170b23-1e70-4069-bcde-7068e887ef12 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:40.542335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b170b23-1e70-4069-bcde-7068e887ef12 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:40.752915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3b170b23-1e70-4069-bcde-7068e887ef12 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:40.761599 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3b170b23-1e70-4069-bcde-7068e887ef12 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b" status: 200 len: 1314 microversion: 2.1 time: 0.244344 Oct 29 03:21:40.762681 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2788/5347] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:40 2022] GET /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:41.786897 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-98f1ee9b-d697-41a6-8ee3-b606455896e2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:41.790073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-98f1ee9b-d697-41a6-8ee3-b606455896e2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 7b81a724-aab0-42cc-b5a6-0d732165217b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:41.800337 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98f1ee9b-d697-41a6-8ee3-b606455896e2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:41.801896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98f1ee9b-d697-41a6-8ee3-b606455896e2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:41.802937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98f1ee9b-d697-41a6-8ee3-b606455896e2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:41.805000 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98f1ee9b-d697-41a6-8ee3-b606455896e2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:41.806364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98f1ee9b-d697-41a6-8ee3-b606455896e2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:41.807372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98f1ee9b-d697-41a6-8ee3-b606455896e2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:42.045320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-98f1ee9b-d697-41a6-8ee3-b606455896e2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:42.055752 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-98f1ee9b-d697-41a6-8ee3-b606455896e2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b" status: 200 len: 1314 microversion: 2.1 time: 0.274303 Oct 29 03:21:42.058633 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2560/5348] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:41 2022] GET /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:43.086756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-abb1ec7b-6cec-4648-a705-811dfc28e781 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:43.088232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-abb1ec7b-6cec-4648-a705-811dfc28e781 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 7b81a724-aab0-42cc-b5a6-0d732165217b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:43.095790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abb1ec7b-6cec-4648-a705-811dfc28e781 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:43.096587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abb1ec7b-6cec-4648-a705-811dfc28e781 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:43.097197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abb1ec7b-6cec-4648-a705-811dfc28e781 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:43.098348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abb1ec7b-6cec-4648-a705-811dfc28e781 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:43.099137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abb1ec7b-6cec-4648-a705-811dfc28e781 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:43.099732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abb1ec7b-6cec-4648-a705-811dfc28e781 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:43.121586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:43.380660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-abb1ec7b-6cec-4648-a705-811dfc28e781 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:43.395622 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-abb1ec7b-6cec-4648-a705-811dfc28e781 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b" status: 200 len: 1314 microversion: 2.1 time: 0.310956 Oct 29 03:21:43.398222 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2789/5349] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:43 2022] GET /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:43.703047 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-19638c73-91b2-4609-8e7d-4cb4f30f095a req-cf379a7c-5ef6-4a71-887c-ec8586d96fcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b81a724-aab0-42cc-b5a6-0d732165217b", "name": "network-vif-plugged", "status": "completed", "tag": "c15dc864-37b7-4a0c-8d64-c4ce30f10c49"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:43.723451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-19638c73-91b2-4609-8e7d-4cb4f30f095a req-cf379a7c-5ef6-4a71-887c-ec8586d96fcd service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:43.723944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-19638c73-91b2-4609-8e7d-4cb4f30f095a req-cf379a7c-5ef6-4a71-887c-ec8586d96fcd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:43.724395 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-19638c73-91b2-4609-8e7d-4cb4f30f095a req-cf379a7c-5ef6-4a71-887c-ec8586d96fcd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:43.764409 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-19638c73-91b2-4609-8e7d-4cb4f30f095a req-cf379a7c-5ef6-4a71-887c-ec8586d96fcd service nova] Creating event network-vif-plugged:c15dc864-37b7-4a0c-8d64-c4ce30f10c49 for instance 7b81a724-aab0-42cc-b5a6-0d732165217b on n-h1-862967-2 Oct 29 03:21:43.778744 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-19638c73-91b2-4609-8e7d-4cb4f30f095a req-cf379a7c-5ef6-4a71-887c-ec8586d96fcd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077832 Oct 29 03:21:43.779151 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2561/5350] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:44.423487 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f80ca2c5-35d4-4895-b8ff-0942809cfc7a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:44.425189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f80ca2c5-35d4-4895-b8ff-0942809cfc7a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 7b81a724-aab0-42cc-b5a6-0d732165217b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:44.435417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f80ca2c5-35d4-4895-b8ff-0942809cfc7a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:44.436513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f80ca2c5-35d4-4895-b8ff-0942809cfc7a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:44.437228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f80ca2c5-35d4-4895-b8ff-0942809cfc7a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:44.438329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f80ca2c5-35d4-4895-b8ff-0942809cfc7a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:44.439316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f80ca2c5-35d4-4895-b8ff-0942809cfc7a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:44.439972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f80ca2c5-35d4-4895-b8ff-0942809cfc7a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:44.596228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f80ca2c5-35d4-4895-b8ff-0942809cfc7a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:44.607860 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f80ca2c5-35d4-4895-b8ff-0942809cfc7a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b" status: 200 len: 1314 microversion: 2.1 time: 0.190592 Oct 29 03:21:44.625167 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2790/5351] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:44 2022] GET /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:21:45.630334 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:45.632311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:45.639232 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c52c8521-c2ca-4287-8c04-bd3445ce42f1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:45.640936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c52c8521-c2ca-4287-8c04-bd3445ce42f1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 7b81a724-aab0-42cc-b5a6-0d732165217b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:45.659763 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c52c8521-c2ca-4287-8c04-bd3445ce42f1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:45.663187 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c52c8521-c2ca-4287-8c04-bd3445ce42f1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:45.664094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c52c8521-c2ca-4287-8c04-bd3445ce42f1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:45.665310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c52c8521-c2ca-4287-8c04-bd3445ce42f1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:45.665991 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c52c8521-c2ca-4287-8c04-bd3445ce42f1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:45.666596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c52c8521-c2ca-4287-8c04-bd3445ce42f1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:45.838271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c52c8521-c2ca-4287-8c04-bd3445ce42f1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:45.845636 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:45.848740 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c52c8521-c2ca-4287-8c04-bd3445ce42f1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b" status: 200 len: 1501 microversion: 2.1 time: 0.220961 Oct 29 03:21:45.849690 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2562/5352] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:45 2022] GET /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b => generated 1501 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:45.872341 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-64f6f678-ca6d-49b7-960a-8b3fc6528472 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:45.873470 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-64f6f678-ca6d-49b7-960a-8b3fc6528472 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 7b81a724-aab0-42cc-b5a6-0d732165217b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:45.880061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:45.882331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-64f6f678-ca6d-49b7-960a-8b3fc6528472 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:45.883250 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-64f6f678-ca6d-49b7-960a-8b3fc6528472 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:45.883959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-64f6f678-ca6d-49b7-960a-8b3fc6528472 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:45.884742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-64f6f678-ca6d-49b7-960a-8b3fc6528472 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:45.885331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-64f6f678-ca6d-49b7-960a-8b3fc6528472 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:45.886057 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-64f6f678-ca6d-49b7-960a-8b3fc6528472 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:46.079618 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.network.security_group_api [None req-64f6f678-ca6d-49b7-960a-8b3fc6528472 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Removing security group 3f7b490d-8e18-47b4-914e-273ffb049b54 from port c15dc864-37b7-4a0c-8d64-c4ce30f10c49 Oct 29 03:21:46.510625 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-64f6f678-ca6d-49b7-960a-8b3fc6528472 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b/action" status: 202 len: 0 microversion: 2.1 time: 0.642299 Oct 29 03:21:46.515512 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2791/5353] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:21:45 2022] POST /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b/action => generated 0 bytes in 648 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:21:46.520386 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-847a8d28-706e-4d08-b62a-bb73aab5fe72 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:46.521039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-847a8d28-706e-4d08-b62a-bb73aab5fe72 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 7b81a724-aab0-42cc-b5a6-0d732165217b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:46.528106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-28880435-380a-4b7c-a128-517ed0f36e14 req-42fe2011-38b9-4e52-b4f4-1b1e0b77719f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b81a724-aab0-42cc-b5a6-0d732165217b", "tag": "c15dc864-37b7-4a0c-8d64-c4ce30f10c49"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:46.538466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-847a8d28-706e-4d08-b62a-bb73aab5fe72 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:46.542006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-28880435-380a-4b7c-a128-517ed0f36e14 req-42fe2011-38b9-4e52-b4f4-1b1e0b77719f service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:46.542864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-28880435-380a-4b7c-a128-517ed0f36e14 req-42fe2011-38b9-4e52-b4f4-1b1e0b77719f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:46.543509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-28880435-380a-4b7c-a128-517ed0f36e14 req-42fe2011-38b9-4e52-b4f4-1b1e0b77719f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:46.548141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-847a8d28-706e-4d08-b62a-bb73aab5fe72 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:46.548684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-847a8d28-706e-4d08-b62a-bb73aab5fe72 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:46.549547 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-847a8d28-706e-4d08-b62a-bb73aab5fe72 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:46.550299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-847a8d28-706e-4d08-b62a-bb73aab5fe72 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:46.550904 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-847a8d28-706e-4d08-b62a-bb73aab5fe72 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:46.561803 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-28880435-380a-4b7c-a128-517ed0f36e14 req-42fe2011-38b9-4e52-b4f4-1b1e0b77719f service nova] Creating event network-changed:c15dc864-37b7-4a0c-8d64-c4ce30f10c49 for instance 7b81a724-aab0-42cc-b5a6-0d732165217b on n-h1-862967-2 Oct 29 03:21:46.569658 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-28880435-380a-4b7c-a128-517ed0f36e14 req-42fe2011-38b9-4e52-b4f4-1b1e0b77719f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045774 Oct 29 03:21:46.570861 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2792/5354] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:46.716711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-847a8d28-706e-4d08-b62a-bb73aab5fe72 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:46.728566 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-847a8d28-706e-4d08-b62a-bb73aab5fe72 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b" status: 200 len: 1459 microversion: 2.1 time: 0.209637 Oct 29 03:21:46.730028 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2563/5355] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:46 2022] GET /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b => generated 1459 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:46.761468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9c946151-04a3-4a00-b5c2-05238c304bec tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:46.762182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9c946151-04a3-4a00-b5c2-05238c304bec tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:46.774156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c946151-04a3-4a00-b5c2-05238c304bec tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:46.778062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c946151-04a3-4a00-b5c2-05238c304bec tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:46.779376 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c946151-04a3-4a00-b5c2-05238c304bec tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:46.782553 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c946151-04a3-4a00-b5c2-05238c304bec tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:46.783480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c946151-04a3-4a00-b5c2-05238c304bec tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:46.785283 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c946151-04a3-4a00-b5c2-05238c304bec tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:47.000888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9c946151-04a3-4a00-b5c2-05238c304bec tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:47.010885 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9c946151-04a3-4a00-b5c2-05238c304bec tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.255144 Oct 29 03:21:47.012256 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2793/5356] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:46 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:47.042957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ad1aa2ff-c266-48d6-b2b1-250e542e53f0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:47.043432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ad1aa2ff-c266-48d6-b2b1-250e542e53f0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:47.053317 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad1aa2ff-c266-48d6-b2b1-250e542e53f0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:47.053817 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad1aa2ff-c266-48d6-b2b1-250e542e53f0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:47.054264 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad1aa2ff-c266-48d6-b2b1-250e542e53f0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:47.054980 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad1aa2ff-c266-48d6-b2b1-250e542e53f0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:47.060988 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad1aa2ff-c266-48d6-b2b1-250e542e53f0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:47.061733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad1aa2ff-c266-48d6-b2b1-250e542e53f0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:47.377538 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ad1aa2ff-c266-48d6-b2b1-250e542e53f0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:47.386929 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ad1aa2ff-c266-48d6-b2b1-250e542e53f0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.347637 Oct 29 03:21:47.402076 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2564/5357] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:47 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:47.412318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5cc3e4e1-d519-427c-b28d-3a829f5e1ee7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:47.414383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5cc3e4e1-d519-427c-b28d-3a829f5e1ee7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:47.425963 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5cc3e4e1-d519-427c-b28d-3a829f5e1ee7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:47.427647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5cc3e4e1-d519-427c-b28d-3a829f5e1ee7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:47.428236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5cc3e4e1-d519-427c-b28d-3a829f5e1ee7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:47.432235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5cc3e4e1-d519-427c-b28d-3a829f5e1ee7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:47.433063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5cc3e4e1-d519-427c-b28d-3a829f5e1ee7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:47.433635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5cc3e4e1-d519-427c-b28d-3a829f5e1ee7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:47.622108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5cc3e4e1-d519-427c-b28d-3a829f5e1ee7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:47.631122 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5cc3e4e1-d519-427c-b28d-3a829f5e1ee7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.222752 Oct 29 03:21:47.632967 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2794/5358] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:47 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:47.655636 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c711cc2f-b388-422c-9a53-b498cfc5789b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:47.656278 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c711cc2f-b388-422c-9a53-b498cfc5789b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:47.663966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c711cc2f-b388-422c-9a53-b498cfc5789b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:47.664654 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c711cc2f-b388-422c-9a53-b498cfc5789b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:47.665254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c711cc2f-b388-422c-9a53-b498cfc5789b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:47.666094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c711cc2f-b388-422c-9a53-b498cfc5789b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:47.666685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c711cc2f-b388-422c-9a53-b498cfc5789b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:47.667244 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c711cc2f-b388-422c-9a53-b498cfc5789b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:47.835336 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c711cc2f-b388-422c-9a53-b498cfc5789b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:47.843914 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c711cc2f-b388-422c-9a53-b498cfc5789b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.192485 Oct 29 03:21:47.865317 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2565/5359] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:47 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:47.988960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4b914a95-04ae-487c-a6a1-eecb1c24efcd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1379079829", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "e565ca97-fa54-4380-a34f-e5c00430d054"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:48.051342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-4b914a95-04ae-487c-a6a1-eecb1c24efcd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] validate_networks() for [('e565ca97-fa54-4380-a34f-e5c00430d054', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:21:48.471058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-4b914a95-04ae-487c-a6a1-eecb1c24efcd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:21:48.471367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-4b914a95-04ae-487c-a6a1-eecb1c24efcd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:21:48.471906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-4b914a95-04ae-487c-a6a1-eecb1c24efcd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:21:48.472434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-4b914a95-04ae-487c-a6a1-eecb1c24efcd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:21:48.472950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-4b914a95-04ae-487c-a6a1-eecb1c24efcd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:21:48.482641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b914a95-04ae-487c-a6a1-eecb1c24efcd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:48.483237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b914a95-04ae-487c-a6a1-eecb1c24efcd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:48.483672 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b914a95-04ae-487c-a6a1-eecb1c24efcd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:48.484397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b914a95-04ae-487c-a6a1-eecb1c24efcd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:48.484894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b914a95-04ae-487c-a6a1-eecb1c24efcd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:48.485319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b914a95-04ae-487c-a6a1-eecb1c24efcd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:48.502684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-4b914a95-04ae-487c-a6a1-eecb1c24efcd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Getting quotas for project df5fe7cedcd14b61925dc300274b3c70. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:21:48.508329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-4b914a95-04ae-487c-a6a1-eecb1c24efcd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Getting quotas for user aac411c78a5648be8a1c43893d9a0798 and project df5fe7cedcd14b61925dc300274b3c70. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:21:48.521929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4b914a95-04ae-487c-a6a1-eecb1c24efcd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:21:48.525267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4b914a95-04ae-487c-a6a1-eecb1c24efcd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:21:48.578277 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4b914a95-04ae-487c-a6a1-eecb1c24efcd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593268 Oct 29 03:21:48.579273 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2795/5360] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:21:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:21:48.591890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4c677f98-41e5-4f3c-9ac6-ce5ceee39f9b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:48.598910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4c677f98-41e5-4f3c-9ac6-ce5ceee39f9b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:48.704766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4c677f98-41e5-4f3c-9ac6-ce5ceee39f9b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:48.720794 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4c677f98-41e5-4f3c-9ac6-ce5ceee39f9b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1215 microversion: 2.1 time: 0.132557 Oct 29 03:21:48.722043 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2566/5361] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:48 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1215 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:49.743771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-91ff2c0a-e69a-4eac-9e75-24dc7d40760e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:49.744374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-91ff2c0a-e69a-4eac-9e75-24dc7d40760e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:49.763482 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91ff2c0a-e69a-4eac-9e75-24dc7d40760e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:49.769319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91ff2c0a-e69a-4eac-9e75-24dc7d40760e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:49.769742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91ff2c0a-e69a-4eac-9e75-24dc7d40760e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:49.772015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91ff2c0a-e69a-4eac-9e75-24dc7d40760e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:49.773450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91ff2c0a-e69a-4eac-9e75-24dc7d40760e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:49.773883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-91ff2c0a-e69a-4eac-9e75-24dc7d40760e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:49.954986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-91ff2c0a-e69a-4eac-9e75-24dc7d40760e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:49.982446 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-91ff2c0a-e69a-4eac-9e75-24dc7d40760e tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1267 microversion: 2.1 time: 0.241962 Oct 29 03:21:49.984978 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2796/5362] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:49 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1267 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:51.012904 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-148a002e-42d7-465d-adb1-51e04936099a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:51.013552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-148a002e-42d7-465d-adb1-51e04936099a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:51.027699 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-148a002e-42d7-465d-adb1-51e04936099a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:51.042508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-148a002e-42d7-465d-adb1-51e04936099a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:51.043160 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-148a002e-42d7-465d-adb1-51e04936099a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:51.043942 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-148a002e-42d7-465d-adb1-51e04936099a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:51.044425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-148a002e-42d7-465d-adb1-51e04936099a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:51.044880 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-148a002e-42d7-465d-adb1-51e04936099a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:51.168783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-148a002e-42d7-465d-adb1-51e04936099a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:51.185135 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-148a002e-42d7-465d-adb1-51e04936099a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1273 microversion: 2.1 time: 0.176171 Oct 29 03:21:51.186081 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2567/5363] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:51 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1273 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:52.209079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e321ef17-778c-4108-b33c-ec741ae32d0f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:52.209922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e321ef17-778c-4108-b33c-ec741ae32d0f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:52.221661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e321ef17-778c-4108-b33c-ec741ae32d0f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:52.223605 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e321ef17-778c-4108-b33c-ec741ae32d0f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:52.224175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e321ef17-778c-4108-b33c-ec741ae32d0f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:52.228381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e321ef17-778c-4108-b33c-ec741ae32d0f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:52.230922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e321ef17-778c-4108-b33c-ec741ae32d0f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:52.231478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e321ef17-778c-4108-b33c-ec741ae32d0f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:53.081225 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e321ef17-778c-4108-b33c-ec741ae32d0f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:53.089796 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e321ef17-778c-4108-b33c-ec741ae32d0f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1315 microversion: 2.1 time: 0.885589 Oct 29 03:21:53.090402 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2797/5364] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:52 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1315 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:53.656443 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d820712e-dec0-4505-af61-2aa02decbe70 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:53.657665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d820712e-dec0-4505-af61-2aa02decbe70 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: b44493f2-0d26-4a42-9951-00557618dfd5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:53.671263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d820712e-dec0-4505-af61-2aa02decbe70 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:53.672220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d820712e-dec0-4505-af61-2aa02decbe70 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:53.673063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d820712e-dec0-4505-af61-2aa02decbe70 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:53.674251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d820712e-dec0-4505-af61-2aa02decbe70 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:53.677657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d820712e-dec0-4505-af61-2aa02decbe70 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:53.680032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d820712e-dec0-4505-af61-2aa02decbe70 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:53.744071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d820712e-dec0-4505-af61-2aa02decbe70 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: b44493f2-0d26-4a42-9951-00557618dfd5] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:21:54.023504 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d820712e-dec0-4505-af61-2aa02decbe70 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5" status: 204 len: 0 microversion: 2.1 time: 0.375115 Oct 29 03:21:54.025735 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2568/5365] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:21:53 2022] DELETE /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:21:54.033476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4c5a86c4-8f81-4ec1-b086-169828100fef tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:54.035912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4c5a86c4-8f81-4ec1-b086-169828100fef tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: b44493f2-0d26-4a42-9951-00557618dfd5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:54.053034 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c5a86c4-8f81-4ec1-b086-169828100fef tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:54.055606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c5a86c4-8f81-4ec1-b086-169828100fef tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:54.056312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c5a86c4-8f81-4ec1-b086-169828100fef tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:54.057868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c5a86c4-8f81-4ec1-b086-169828100fef tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:54.064434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c5a86c4-8f81-4ec1-b086-169828100fef tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:54.066007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c5a86c4-8f81-4ec1-b086-169828100fef tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:54.117861 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0fb84ed1-06c5-41e6-85d9-92a4b72cc36b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:54.118941 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0fb84ed1-06c5-41e6-85d9-92a4b72cc36b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:54.140695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fb84ed1-06c5-41e6-85d9-92a4b72cc36b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:54.145743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fb84ed1-06c5-41e6-85d9-92a4b72cc36b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:54.147898 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fb84ed1-06c5-41e6-85d9-92a4b72cc36b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:54.149711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fb84ed1-06c5-41e6-85d9-92a4b72cc36b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:54.151801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fb84ed1-06c5-41e6-85d9-92a4b72cc36b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:54.154513 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fb84ed1-06c5-41e6-85d9-92a4b72cc36b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:54.564408 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0fb84ed1-06c5-41e6-85d9-92a4b72cc36b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:54.574468 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0fb84ed1-06c5-41e6-85d9-92a4b72cc36b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1315 microversion: 2.1 time: 0.463815 Oct 29 03:21:54.575844 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2569/5366] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:54 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:54.593870 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4888ea34-a27c-4fbc-be93-683aeedb6698 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:54.596730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4888ea34-a27c-4fbc-be93-683aeedb6698 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:54.610227 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4888ea34-a27c-4fbc-be93-683aeedb6698 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:54.612027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4888ea34-a27c-4fbc-be93-683aeedb6698 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:54.612473 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4888ea34-a27c-4fbc-be93-683aeedb6698 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:54.615782 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4888ea34-a27c-4fbc-be93-683aeedb6698 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:54.619611 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4888ea34-a27c-4fbc-be93-683aeedb6698 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:54.620007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4888ea34-a27c-4fbc-be93-683aeedb6698 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:54.699929 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4888ea34-a27c-4fbc-be93-683aeedb6698 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "POST /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f/action" status: 200 len: 24577 microversion: 2.1 time: 0.122606 Oct 29 03:21:54.709235 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2570/5367] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:21:54 2022] POST /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f/action => generated 24577 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:21:54.836053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4c5a86c4-8f81-4ec1-b086-169828100fef tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:54.849838 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4c5a86c4-8f81-4ec1-b086-169828100fef tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5" status: 200 len: 1554 microversion: 2.1 time: 0.818685 Oct 29 03:21:54.851858 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2798/5368] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:54 2022] GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5 => generated 1554 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:55.602796 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0981dfe1-49ea-49b3-bdbd-ab7091e96346 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:55.604657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0981dfe1-49ea-49b3-bdbd-ab7091e96346 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:55.620570 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-476a031c-5ac2-4b84-b6a5-a34cacd04452 req-1027c56f-9921-47d4-a025-3e99f2fbf7d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31815e5e-cc50-4f59-950f-ca62e30e9e6d", "tag": "3e99d247-4408-432a-bb8c-076c7841fa59"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:55.633474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0981dfe1-49ea-49b3-bdbd-ab7091e96346 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:55.634361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0981dfe1-49ea-49b3-bdbd-ab7091e96346 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:55.640134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0981dfe1-49ea-49b3-bdbd-ab7091e96346 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:55.641310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0981dfe1-49ea-49b3-bdbd-ab7091e96346 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:55.646542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0981dfe1-49ea-49b3-bdbd-ab7091e96346 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:55.651415 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0981dfe1-49ea-49b3-bdbd-ab7091e96346 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:55.654666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-476a031c-5ac2-4b84-b6a5-a34cacd04452 req-1027c56f-9921-47d4-a025-3e99f2fbf7d5 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:55.655155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-476a031c-5ac2-4b84-b6a5-a34cacd04452 req-1027c56f-9921-47d4-a025-3e99f2fbf7d5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:55.655591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-476a031c-5ac2-4b84-b6a5-a34cacd04452 req-1027c56f-9921-47d4-a025-3e99f2fbf7d5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:55.752094 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-476a031c-5ac2-4b84-b6a5-a34cacd04452 req-1027c56f-9921-47d4-a025-3e99f2fbf7d5 service nova] Creating event network-changed:3e99d247-4408-432a-bb8c-076c7841fa59 for instance 31815e5e-cc50-4f59-950f-ca62e30e9e6d on n-h2-862967-2 Oct 29 03:21:55.773463 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-476a031c-5ac2-4b84-b6a5-a34cacd04452 req-1027c56f-9921-47d4-a025-3e99f2fbf7d5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.681670 Oct 29 03:21:55.777854 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2571/5369] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:55.886219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-67e86930-3665-4467-94a4-aaebc5bab130 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:55.886946 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-67e86930-3665-4467-94a4-aaebc5bab130 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: b44493f2-0d26-4a42-9951-00557618dfd5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:55.931284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67e86930-3665-4467-94a4-aaebc5bab130 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:55.931738 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67e86930-3665-4467-94a4-aaebc5bab130 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:55.932192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67e86930-3665-4467-94a4-aaebc5bab130 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:55.932974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67e86930-3665-4467-94a4-aaebc5bab130 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:55.933435 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67e86930-3665-4467-94a4-aaebc5bab130 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:55.935482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67e86930-3665-4467-94a4-aaebc5bab130 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:56.322816 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-67e86930-3665-4467-94a4-aaebc5bab130 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:56.343587 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-67e86930-3665-4467-94a4-aaebc5bab130 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5" status: 200 len: 1554 microversion: 2.1 time: 0.468280 Oct 29 03:21:56.348247 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2572/5370] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:55 2022] GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5 => generated 1554 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:56.656680 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0981dfe1-49ea-49b3-bdbd-ab7091e96346 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:56.667299 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0981dfe1-49ea-49b3-bdbd-ab7091e96346 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1315 microversion: 2.1 time: 1.071568 Oct 29 03:21:56.673331 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2799/5371] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:55 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1315 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:57.075409 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-9ef846f6-23e9-465e-818e-3bba6b6b5c9e req-8ad5ba1e-97f3-4c0e-b73d-354df0a86c11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b44493f2-0d26-4a42-9951-00557618dfd5", "name": "network-vif-deleted", "tag": "7b9d91da-18f4-42ae-b347-06d99bc5a16e"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:21:57.107016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9ef846f6-23e9-465e-818e-3bba6b6b5c9e req-8ad5ba1e-97f3-4c0e-b73d-354df0a86c11 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:57.108423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9ef846f6-23e9-465e-818e-3bba6b6b5c9e req-8ad5ba1e-97f3-4c0e-b73d-354df0a86c11 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:57.109480 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9ef846f6-23e9-465e-818e-3bba6b6b5c9e req-8ad5ba1e-97f3-4c0e-b73d-354df0a86c11 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:57.139550 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-9ef846f6-23e9-465e-818e-3bba6b6b5c9e req-8ad5ba1e-97f3-4c0e-b73d-354df0a86c11 service nova] Creating event network-vif-deleted:7b9d91da-18f4-42ae-b347-06d99bc5a16e for instance b44493f2-0d26-4a42-9951-00557618dfd5 on n-h1-862967-2 Oct 29 03:21:57.146383 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-9ef846f6-23e9-465e-818e-3bba6b6b5c9e req-8ad5ba1e-97f3-4c0e-b73d-354df0a86c11 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075794 Oct 29 03:21:57.148854 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2573/5372] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:21:57.376176 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-30b7f326-f281-4379-bd20-eca037672262 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:57.377102 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-30b7f326-f281-4379-bd20-eca037672262 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: b44493f2-0d26-4a42-9951-00557618dfd5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:57.389176 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30b7f326-f281-4379-bd20-eca037672262 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:57.389690 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30b7f326-f281-4379-bd20-eca037672262 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:57.390311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30b7f326-f281-4379-bd20-eca037672262 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:57.391323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30b7f326-f281-4379-bd20-eca037672262 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:57.392002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30b7f326-f281-4379-bd20-eca037672262 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:57.392613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30b7f326-f281-4379-bd20-eca037672262 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:57.434884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30b7f326-f281-4379-bd20-eca037672262 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:57.435590 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30b7f326-f281-4379-bd20-eca037672262 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:57.436159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30b7f326-f281-4379-bd20-eca037672262 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:57.436790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-30b7f326-f281-4379-bd20-eca037672262 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lazy-loading 'fault' on Instance uuid b44493f2-0d26-4a42-9951-00557618dfd5 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:21:57.545579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-30b7f326-f281-4379-bd20-eca037672262 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:57.560063 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-30b7f326-f281-4379-bd20-eca037672262 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5" status: 200 len: 1339 microversion: 2.1 time: 0.188150 Oct 29 03:21:57.561113 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2800/5373] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:57 2022] GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5 => generated 1339 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:57.701421 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cd5f075e-3223-49a6-a12c-426bdfa102b7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:57.702120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cd5f075e-3223-49a6-a12c-426bdfa102b7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:57.708168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd5f075e-3223-49a6-a12c-426bdfa102b7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:57.708676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd5f075e-3223-49a6-a12c-426bdfa102b7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:57.709105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd5f075e-3223-49a6-a12c-426bdfa102b7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:57.709875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd5f075e-3223-49a6-a12c-426bdfa102b7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:57.710268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd5f075e-3223-49a6-a12c-426bdfa102b7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:57.710688 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd5f075e-3223-49a6-a12c-426bdfa102b7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:57.859463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cd5f075e-3223-49a6-a12c-426bdfa102b7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:57.893945 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cd5f075e-3223-49a6-a12c-426bdfa102b7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1315 microversion: 2.1 time: 0.197527 Oct 29 03:21:57.896423 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2574/5374] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:57 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:21:58.584943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0d23a33e-ac2c-4aa0-97e1-0c1a365b2cf7 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:58.585543 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0d23a33e-ac2c-4aa0-97e1-0c1a365b2cf7 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: b44493f2-0d26-4a42-9951-00557618dfd5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:58.588545 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:58.589732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:58.610780 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d23a33e-ac2c-4aa0-97e1-0c1a365b2cf7 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:58.611587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d23a33e-ac2c-4aa0-97e1-0c1a365b2cf7 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:58.612338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d23a33e-ac2c-4aa0-97e1-0c1a365b2cf7 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:58.613440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d23a33e-ac2c-4aa0-97e1-0c1a365b2cf7 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:58.614075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d23a33e-ac2c-4aa0-97e1-0c1a365b2cf7 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:58.614694 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d23a33e-ac2c-4aa0-97e1-0c1a365b2cf7 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:58.644384 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-0d23a33e-ac2c-4aa0-97e1-0c1a365b2cf7 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] HTTP exception thrown: Instance b44493f2-0d26-4a42-9951-00557618dfd5 could not be found. Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0d23a33e-ac2c-4aa0-97e1-0c1a365b2cf7 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Request method failure captured: Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5 HTTP/1.1 Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJvE3nnIW37LzFb613JzJw0HypManPMbsxNU4oyKOp5zL0PJNck-rt9zXNRtLVZDEXfVAD5l4i00OLhLPto0kyiNWcTofBQjAJ5oVoGupwCdghDBPY9JXmCxhFK33vvd6iynXLz_-5YILKYHzmhxV05rCazPRkppDjCJSFlN28FyPeQ Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 987564b626dd4c12b6109c1d23de75c6 Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-TestNetworkBasicOps-1774990457 Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/987564b626dd4c12b6109c1d23de75c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/987564b626dd4c12b6109c1d23de75c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_987564b626dd4c12b6109c1d23de75c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/987564b626dd4c12b6109c1d23de75c6"}]}] Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-TestNetworkBasicOps-1774990457 Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 987564b626dd4c12b6109c1d23de75c6 Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-TestNetworkBasicOps-1774990457 Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-TestNetworkBasicOps-1774990457-project Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 969be4a3c9bd432fa544ee27fa186564 Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-TestNetworkBasicOps-1774990457-project Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance b44493f2-0d26-4a42-9951-00557618dfd5 could not be found. Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'b44493f2-0d26-4a42-9951-00557618dfd5'} Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b44493f2-0d26-4a42-9951-00557618dfd5 could not be found. Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b44493f2-0d26-4a42-9951-00557618dfd5 could not be found. Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:21:58.648199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:58.651452 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:21:58.651452 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:21:58.651452 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:21:58.651452 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:21:58.651452 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:21:58.651452 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b44493f2-0d26-4a42-9951-00557618dfd5 could not be found. Oct 29 03:21:58.651452 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:21:58.651452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0d23a33e-ac2c-4aa0-97e1-0c1a365b2cf7 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Returning 404 to user: Instance b44493f2-0d26-4a42-9951-00557618dfd5 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:21:58.651452 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0d23a33e-ac2c-4aa0-97e1-0c1a365b2cf7 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5" status: 404 len: 111 microversion: 2.1 time: 0.068584 Oct 29 03:21:58.660862 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2801/5375] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:58 2022] GET /compute/v2.1/servers/b44493f2-0d26-4a42-9951-00557618dfd5 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:21:58.937770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bbdfc109-bc20-4167-b348-6ecc748e08bc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:58.938419 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bbdfc109-bc20-4167-b348-6ecc748e08bc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:21:58.941408 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:58.956262 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bbdfc109-bc20-4167-b348-6ecc748e08bc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:58.957022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bbdfc109-bc20-4167-b348-6ecc748e08bc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:58.957526 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bbdfc109-bc20-4167-b348-6ecc748e08bc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:58.958564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bbdfc109-bc20-4167-b348-6ecc748e08bc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:21:58.959028 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bbdfc109-bc20-4167-b348-6ecc748e08bc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:21:58.959450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bbdfc109-bc20-4167-b348-6ecc748e08bc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:21:58.981216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8cae8cea-d511-4464-8ced-b3e617ea046a tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '.version_select at 0x7ff052a04af0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:21:59.014090 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8cae8cea-d511-4464-8ced-b3e617ea046a tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1886258093" status: 202 len: 0 microversion: 2.1 time: 0.036782 Oct 29 03:21:59.014775 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2802/5376] 10.222.0.46 () {58 vars in 1257 bytes} [Sat Oct 29 03:21:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1886258093 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:21:59.191968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bbdfc109-bc20-4167-b348-6ecc748e08bc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:21:59.202588 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bbdfc109-bc20-4167-b348-6ecc748e08bc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1315 microversion: 2.1 time: 0.269679 Oct 29 03:21:59.204080 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2575/5377] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:21:58 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:00.226160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2c9614e1-5e15-4ea2-8ae5-1e683fa1aed9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:00.226767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2c9614e1-5e15-4ea2-8ae5-1e683fa1aed9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:00.242953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c9614e1-5e15-4ea2-8ae5-1e683fa1aed9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:00.245510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c9614e1-5e15-4ea2-8ae5-1e683fa1aed9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:00.246133 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c9614e1-5e15-4ea2-8ae5-1e683fa1aed9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:00.247053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c9614e1-5e15-4ea2-8ae5-1e683fa1aed9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:00.253082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c9614e1-5e15-4ea2-8ae5-1e683fa1aed9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:00.253822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c9614e1-5e15-4ea2-8ae5-1e683fa1aed9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:00.506191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2c9614e1-5e15-4ea2-8ae5-1e683fa1aed9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:00.516919 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2c9614e1-5e15-4ea2-8ae5-1e683fa1aed9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1315 microversion: 2.1 time: 0.294309 Oct 29 03:22:00.520804 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2803/5378] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:00 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:00.973361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7546ad2a-129e-47aa-8793-e98138c2eb78 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:00.974627 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7546ad2a-129e-47aa-8793-e98138c2eb78 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:00.993627 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:00.998320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7546ad2a-129e-47aa-8793-e98138c2eb78 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:01.001060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7546ad2a-129e-47aa-8793-e98138c2eb78 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:01.001773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7546ad2a-129e-47aa-8793-e98138c2eb78 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:01.005657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7546ad2a-129e-47aa-8793-e98138c2eb78 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:01.006435 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7546ad2a-129e-47aa-8793-e98138c2eb78 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:01.009758 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7546ad2a-129e-47aa-8793-e98138c2eb78 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:01.365598 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7546ad2a-129e-47aa-8793-e98138c2eb78 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1832 microversion: 2.1 time: 0.397535 Oct 29 03:22:01.389458 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2576/5379] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:00 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1832 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:01.545089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-19e1ce9d-c4a4-4043-888c-e0dce3fc1e52 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:01.547616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-19e1ce9d-c4a4-4043-888c-e0dce3fc1e52 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:01.562876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-19e1ce9d-c4a4-4043-888c-e0dce3fc1e52 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:01.563761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-19e1ce9d-c4a4-4043-888c-e0dce3fc1e52 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:01.565050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-19e1ce9d-c4a4-4043-888c-e0dce3fc1e52 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:01.568285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-19e1ce9d-c4a4-4043-888c-e0dce3fc1e52 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:01.581304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-19e1ce9d-c4a4-4043-888c-e0dce3fc1e52 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:01.581304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-19e1ce9d-c4a4-4043-888c-e0dce3fc1e52 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:01.941184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-19e1ce9d-c4a4-4043-888c-e0dce3fc1e52 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:01.963641 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-19e1ce9d-c4a4-4043-888c-e0dce3fc1e52 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1315 microversion: 2.1 time: 0.422855 Oct 29 03:22:01.984277 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2804/5380] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:01 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:02.392678 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0b589244-377b-469b-acc6-f405c6cf0a39 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:02.399322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-0810bcb8-ab2d-44be-8178-fd193b7112d8 req-d690d599-0b4a-4ab2-8e46-bd896bccf74b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5562f723-95f1-4fc0-93db-b9b457324d35", "tag": "c306f18b-bb8b-4b3e-a0d9-6ced8168f711"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:22:02.400802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0b589244-377b-469b-acc6-f405c6cf0a39 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 5562f723-95f1-4fc0-93db-b9b457324d35] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:02.414724 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b589244-377b-469b-acc6-f405c6cf0a39 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:02.418927 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-0810bcb8-ab2d-44be-8178-fd193b7112d8 req-d690d599-0b4a-4ab2-8e46-bd896bccf74b service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:02.420274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b589244-377b-469b-acc6-f405c6cf0a39 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:02.421185 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b589244-377b-469b-acc6-f405c6cf0a39 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:02.422137 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b589244-377b-469b-acc6-f405c6cf0a39 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:02.423018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-0810bcb8-ab2d-44be-8178-fd193b7112d8 req-d690d599-0b4a-4ab2-8e46-bd896bccf74b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:02.423724 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b589244-377b-469b-acc6-f405c6cf0a39 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:02.424364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0b589244-377b-469b-acc6-f405c6cf0a39 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:02.425062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-0810bcb8-ab2d-44be-8178-fd193b7112d8 req-d690d599-0b4a-4ab2-8e46-bd896bccf74b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:02.448554 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-0810bcb8-ab2d-44be-8178-fd193b7112d8 req-d690d599-0b4a-4ab2-8e46-bd896bccf74b service nova] Creating event network-changed:c306f18b-bb8b-4b3e-a0d9-6ced8168f711 for instance 5562f723-95f1-4fc0-93db-b9b457324d35 on n-h1-862967-2 Oct 29 03:22:02.464033 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-0810bcb8-ab2d-44be-8178-fd193b7112d8 req-d690d599-0b4a-4ab2-8e46-bd896bccf74b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068864 Oct 29 03:22:02.465648 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2805/5381] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:22:02.474576 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0b589244-377b-469b-acc6-f405c6cf0a39 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 5562f723-95f1-4fc0-93db-b9b457324d35] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:22:02.644064 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0b589244-377b-469b-acc6-f405c6cf0a39 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35" status: 204 len: 0 microversion: 2.1 time: 0.254892 Oct 29 03:22:02.644996 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2577/5382] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:22:02 2022] DELETE /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:22:02.655009 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dfb4480b-6d9b-4dd7-a9ed-2cff447d4e30 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:02.656353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dfb4480b-6d9b-4dd7-a9ed-2cff447d4e30 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 5562f723-95f1-4fc0-93db-b9b457324d35] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:02.667837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfb4480b-6d9b-4dd7-a9ed-2cff447d4e30 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:02.673658 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfb4480b-6d9b-4dd7-a9ed-2cff447d4e30 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:02.676711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfb4480b-6d9b-4dd7-a9ed-2cff447d4e30 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:02.677711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfb4480b-6d9b-4dd7-a9ed-2cff447d4e30 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:02.679236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfb4480b-6d9b-4dd7-a9ed-2cff447d4e30 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:02.681235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfb4480b-6d9b-4dd7-a9ed-2cff447d4e30 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:02.791048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-cee6f219-8be7-4e6e-98e9-8b702b556de8 req-45bd5c52-5666-48c7-b58f-18fbbe45d055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31815e5e-cc50-4f59-950f-ca62e30e9e6d", "name": "network-vif-plugged", "status": "completed", "tag": "3e99d247-4408-432a-bb8c-076c7841fa59"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:22:02.813094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-cee6f219-8be7-4e6e-98e9-8b702b556de8 req-45bd5c52-5666-48c7-b58f-18fbbe45d055 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:02.814010 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-cee6f219-8be7-4e6e-98e9-8b702b556de8 req-45bd5c52-5666-48c7-b58f-18fbbe45d055 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:02.814588 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-cee6f219-8be7-4e6e-98e9-8b702b556de8 req-45bd5c52-5666-48c7-b58f-18fbbe45d055 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:02.843037 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-cee6f219-8be7-4e6e-98e9-8b702b556de8 req-45bd5c52-5666-48c7-b58f-18fbbe45d055 service nova] Creating event network-vif-plugged:3e99d247-4408-432a-bb8c-076c7841fa59 for instance 31815e5e-cc50-4f59-950f-ca62e30e9e6d on n-h2-862967-2 Oct 29 03:22:02.857139 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-cee6f219-8be7-4e6e-98e9-8b702b556de8 req-45bd5c52-5666-48c7-b58f-18fbbe45d055 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070213 Oct 29 03:22:02.858146 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2578/5383] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:22:02.992077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f351b0a5-f0e4-4c85-ba85-d38789f360d8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:02.992947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f351b0a5-f0e4-4c85-ba85-d38789f360d8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:03.016061 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f351b0a5-f0e4-4c85-ba85-d38789f360d8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:03.016967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f351b0a5-f0e4-4c85-ba85-d38789f360d8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:03.023920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f351b0a5-f0e4-4c85-ba85-d38789f360d8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:03.025139 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f351b0a5-f0e4-4c85-ba85-d38789f360d8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:03.025688 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f351b0a5-f0e4-4c85-ba85-d38789f360d8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:03.026181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f351b0a5-f0e4-4c85-ba85-d38789f360d8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:03.075461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:03.226905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dfb4480b-6d9b-4dd7-a9ed-2cff447d4e30 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:03.244117 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dfb4480b-6d9b-4dd7-a9ed-2cff447d4e30 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35" status: 200 len: 1670 microversion: 2.1 time: 0.594301 Oct 29 03:22:03.246666 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2806/5384] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:02 2022] GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35 => generated 1670 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:03.464953 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f351b0a5-f0e4-4c85-ba85-d38789f360d8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:03.474436 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f351b0a5-f0e4-4c85-ba85-d38789f360d8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1315 microversion: 2.1 time: 0.486957 Oct 29 03:22:03.479011 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2579/5385] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:02 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1315 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:03.507421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-45999f70-8eb8-485a-9d0a-5c62352e930f tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:03.508231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-45999f70-8eb8-485a-9d0a-5c62352e930f tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:03.512156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-8f422f25-78ab-4f84-bac4-71cfa90021ac req-9f06b28d-febd-4846-b778-19602b4fb04c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0568de01-669e-4f98-8ca7-3e358669ef8f", "tag": "c42a747a-f6ba-448c-a70e-519721103faf"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:22:03.524560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45999f70-8eb8-485a-9d0a-5c62352e930f tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:03.526743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45999f70-8eb8-485a-9d0a-5c62352e930f tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:03.528592 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8f422f25-78ab-4f84-bac4-71cfa90021ac req-9f06b28d-febd-4846-b778-19602b4fb04c service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:03.528897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45999f70-8eb8-485a-9d0a-5c62352e930f tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:03.529868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45999f70-8eb8-485a-9d0a-5c62352e930f tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:03.530497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45999f70-8eb8-485a-9d0a-5c62352e930f tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:03.532199 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45999f70-8eb8-485a-9d0a-5c62352e930f tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:03.532348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8f422f25-78ab-4f84-bac4-71cfa90021ac req-9f06b28d-febd-4846-b778-19602b4fb04c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:03.533025 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8f422f25-78ab-4f84-bac4-71cfa90021ac req-9f06b28d-febd-4846-b778-19602b4fb04c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:03.571193 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-8f422f25-78ab-4f84-bac4-71cfa90021ac req-9f06b28d-febd-4846-b778-19602b4fb04c service nova] Creating event network-changed:c42a747a-f6ba-448c-a70e-519721103faf for instance 0568de01-669e-4f98-8ca7-3e358669ef8f on n-h2-862967-2 Oct 29 03:22:03.597230 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-8f422f25-78ab-4f84-bac4-71cfa90021ac req-9f06b28d-febd-4846-b778-19602b4fb04c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089035 Oct 29 03:22:03.601676 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2580/5386] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:22:03.616680 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-45999f70-8eb8-485a-9d0a-5c62352e930f tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:22:03.756473 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-45999f70-8eb8-485a-9d0a-5c62352e930f tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 204 len: 0 microversion: 2.1 time: 0.252786 Oct 29 03:22:03.757811 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2807/5387] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:22:03 2022] DELETE /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:22:03.767536 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f600b5f1-98d1-4792-80e5-89749bc99524 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:03.768877 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f600b5f1-98d1-4792-80e5-89749bc99524 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:03.776471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f600b5f1-98d1-4792-80e5-89749bc99524 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:03.777240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f600b5f1-98d1-4792-80e5-89749bc99524 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:03.777826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f600b5f1-98d1-4792-80e5-89749bc99524 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:03.778714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f600b5f1-98d1-4792-80e5-89749bc99524 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:03.779393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f600b5f1-98d1-4792-80e5-89749bc99524 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:03.779956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f600b5f1-98d1-4792-80e5-89749bc99524 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:04.277204 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7504bcde-00a1-4602-b87e-f6f7cce4c853 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:04.278168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7504bcde-00a1-4602-b87e-f6f7cce4c853 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 5562f723-95f1-4fc0-93db-b9b457324d35] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:04.290237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7504bcde-00a1-4602-b87e-f6f7cce4c853 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:04.294439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7504bcde-00a1-4602-b87e-f6f7cce4c853 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:04.297113 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7504bcde-00a1-4602-b87e-f6f7cce4c853 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:04.300103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7504bcde-00a1-4602-b87e-f6f7cce4c853 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:04.301843 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7504bcde-00a1-4602-b87e-f6f7cce4c853 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:04.303500 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7504bcde-00a1-4602-b87e-f6f7cce4c853 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:04.313642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:04.326399 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f600b5f1-98d1-4792-80e5-89749bc99524 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:04.344273 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f600b5f1-98d1-4792-80e5-89749bc99524 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1687 microversion: 2.1 time: 0.580710 Oct 29 03:22:04.344994 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2581/5388] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:03 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1687 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:04.508241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d1f001d8-af23-415a-9f2b-87de1755fd56 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:04.508994 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d1f001d8-af23-415a-9f2b-87de1755fd56 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:04.521926 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1f001d8-af23-415a-9f2b-87de1755fd56 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:04.525369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1f001d8-af23-415a-9f2b-87de1755fd56 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:04.525985 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1f001d8-af23-415a-9f2b-87de1755fd56 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:04.526951 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1f001d8-af23-415a-9f2b-87de1755fd56 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:04.527562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1f001d8-af23-415a-9f2b-87de1755fd56 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:04.529656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1f001d8-af23-415a-9f2b-87de1755fd56 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:04.567112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7504bcde-00a1-4602-b87e-f6f7cce4c853 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:04.576995 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7504bcde-00a1-4602-b87e-f6f7cce4c853 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35" status: 200 len: 1670 microversion: 2.1 time: 0.306663 Oct 29 03:22:04.584745 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2808/5389] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:04 2022] GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35 => generated 1670 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:05.168411 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d1f001d8-af23-415a-9f2b-87de1755fd56 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:05.177242 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d1f001d8-af23-415a-9f2b-87de1755fd56 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1315 microversion: 2.1 time: 0.673337 Oct 29 03:22:05.177909 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2582/5390] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:04 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1315 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:22:05.371506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1d5547c6-3e0f-4b9f-b129-bc9976de0743 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:05.372872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1d5547c6-3e0f-4b9f-b129-bc9976de0743 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:05.380343 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d5547c6-3e0f-4b9f-b129-bc9976de0743 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:05.381160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d5547c6-3e0f-4b9f-b129-bc9976de0743 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:05.381808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d5547c6-3e0f-4b9f-b129-bc9976de0743 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:05.382757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d5547c6-3e0f-4b9f-b129-bc9976de0743 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:05.383415 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d5547c6-3e0f-4b9f-b129-bc9976de0743 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:05.384046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d5547c6-3e0f-4b9f-b129-bc9976de0743 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:05.601666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-354b0d30-5a1c-497c-88e8-842ef84f9066 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:05.604202 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-354b0d30-5a1c-497c-88e8-842ef84f9066 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 5562f723-95f1-4fc0-93db-b9b457324d35] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:05.619546 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-354b0d30-5a1c-497c-88e8-842ef84f9066 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:05.620143 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-354b0d30-5a1c-497c-88e8-842ef84f9066 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:05.620649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-354b0d30-5a1c-497c-88e8-842ef84f9066 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:05.621454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-354b0d30-5a1c-497c-88e8-842ef84f9066 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:05.625748 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-354b0d30-5a1c-497c-88e8-842ef84f9066 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:05.631566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-354b0d30-5a1c-497c-88e8-842ef84f9066 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:05.782148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-354b0d30-5a1c-497c-88e8-842ef84f9066 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:05.791839 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-354b0d30-5a1c-497c-88e8-842ef84f9066 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35" status: 200 len: 1333 microversion: 2.1 time: 0.195711 Oct 29 03:22:05.794645 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2583/5391] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:05 2022] GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35 => generated 1333 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:22:05.812290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-47abd4b0-ebe2-4b1a-9261-0ee5ab1047e5 req-c2707fc8-fe47-4f46-b712-4dc3b265f5d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5562f723-95f1-4fc0-93db-b9b457324d35", "name": "network-vif-deleted", "tag": "c306f18b-bb8b-4b3e-a0d9-6ced8168f711"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:22:05.834414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-47abd4b0-ebe2-4b1a-9261-0ee5ab1047e5 req-c2707fc8-fe47-4f46-b712-4dc3b265f5d0 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:05.835978 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-47abd4b0-ebe2-4b1a-9261-0ee5ab1047e5 req-c2707fc8-fe47-4f46-b712-4dc3b265f5d0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:05.842729 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-47abd4b0-ebe2-4b1a-9261-0ee5ab1047e5 req-c2707fc8-fe47-4f46-b712-4dc3b265f5d0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:05.872572 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-47abd4b0-ebe2-4b1a-9261-0ee5ab1047e5 req-c2707fc8-fe47-4f46-b712-4dc3b265f5d0 service nova] Creating event network-vif-deleted:c306f18b-bb8b-4b3e-a0d9-6ced8168f711 for instance 5562f723-95f1-4fc0-93db-b9b457324d35 on n-h1-862967-2 Oct 29 03:22:05.878845 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-47abd4b0-ebe2-4b1a-9261-0ee5ab1047e5 req-c2707fc8-fe47-4f46-b712-4dc3b265f5d0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082090 Oct 29 03:22:05.879777 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2584/5392] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:22:06.205326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-029dec51-f0d8-46c3-a8c9-e1281e8d0734 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:06.206100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-029dec51-f0d8-46c3-a8c9-e1281e8d0734 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:06.216380 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-029dec51-f0d8-46c3-a8c9-e1281e8d0734 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:06.217789 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-029dec51-f0d8-46c3-a8c9-e1281e8d0734 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:06.219144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-029dec51-f0d8-46c3-a8c9-e1281e8d0734 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:06.221281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-029dec51-f0d8-46c3-a8c9-e1281e8d0734 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:06.222325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-029dec51-f0d8-46c3-a8c9-e1281e8d0734 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:06.223686 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-029dec51-f0d8-46c3-a8c9-e1281e8d0734 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:06.375647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1d5547c6-3e0f-4b9f-b129-bc9976de0743 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:06.408689 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1d5547c6-3e0f-4b9f-b129-bc9976de0743 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1687 microversion: 2.1 time: 1.041649 Oct 29 03:22:06.424567 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2809/5393] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:05 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1687 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:06.634305 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-029dec51-f0d8-46c3-a8c9-e1281e8d0734 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:06.642819 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-029dec51-f0d8-46c3-a8c9-e1281e8d0734 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1502 microversion: 2.1 time: 0.442999 Oct 29 03:22:06.643981 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2585/5394] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:06 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1502 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:06.666510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d25d7386-7461-4449-b97b-8c647038813b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:22:06.673923 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d25d7386-7461-4449-b97b-8c647038813b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:06.691645 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d25d7386-7461-4449-b97b-8c647038813b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:06.692352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d25d7386-7461-4449-b97b-8c647038813b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:06.692961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d25d7386-7461-4449-b97b-8c647038813b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:06.693820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d25d7386-7461-4449-b97b-8c647038813b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:06.694892 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d25d7386-7461-4449-b97b-8c647038813b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:06.695456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d25d7386-7461-4449-b97b-8c647038813b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:06.793196 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d25d7386-7461-4449-b97b-8c647038813b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d/action" status: 202 len: 0 microversion: 2.1 time: 0.130472 Oct 29 03:22:06.795978 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2810/5395] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:22:06 2022] POST /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:22:06.808404 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8eda2217-6255-451c-a8e4-56f66877db84 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:06.812471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8eda2217-6255-451c-a8e4-56f66877db84 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:06.825474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-20a5f3b3-7371-48bf-b8fa-c2adecf56730 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:06.826431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-20a5f3b3-7371-48bf-b8fa-c2adecf56730 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 5562f723-95f1-4fc0-93db-b9b457324d35] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:06.832232 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8eda2217-6255-451c-a8e4-56f66877db84 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:06.833365 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8eda2217-6255-451c-a8e4-56f66877db84 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:06.834133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8eda2217-6255-451c-a8e4-56f66877db84 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:06.835191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8eda2217-6255-451c-a8e4-56f66877db84 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:06.835794 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8eda2217-6255-451c-a8e4-56f66877db84 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:06.838058 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8eda2217-6255-451c-a8e4-56f66877db84 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:06.841810 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20a5f3b3-7371-48bf-b8fa-c2adecf56730 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:06.842311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20a5f3b3-7371-48bf-b8fa-c2adecf56730 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:06.842739 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20a5f3b3-7371-48bf-b8fa-c2adecf56730 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:06.843450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20a5f3b3-7371-48bf-b8fa-c2adecf56730 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:06.848215 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20a5f3b3-7371-48bf-b8fa-c2adecf56730 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:06.848737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20a5f3b3-7371-48bf-b8fa-c2adecf56730 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:06.909744 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-20a5f3b3-7371-48bf-b8fa-c2adecf56730 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] HTTP exception thrown: Instance 5562f723-95f1-4fc0-93db-b9b457324d35 could not be found. Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-20a5f3b3-7371-48bf-b8fa-c2adecf56730 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Request method failure captured: Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35 HTTP/1.1 Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJvE3nnIW37LzFb613JzJw0HypManPMbsxNU4oyKOp5zL0PJNck-rt9zXNRtLVZDEXfVAD5l4i00OLhLPto0kyiNWcTofBQjAJ5oVoGupwCdghDBPY9JXmCxhFK33vvd6iynXLz_-5YILKYHzmhxV05rCazPRkppDjCJSFlN28FyPeQ Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 987564b626dd4c12b6109c1d23de75c6 Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-TestNetworkBasicOps-1774990457 Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/987564b626dd4c12b6109c1d23de75c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/987564b626dd4c12b6109c1d23de75c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_987564b626dd4c12b6109c1d23de75c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/987564b626dd4c12b6109c1d23de75c6"}]}] Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-TestNetworkBasicOps-1774990457 Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 987564b626dd4c12b6109c1d23de75c6 Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-TestNetworkBasicOps-1774990457 Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-TestNetworkBasicOps-1774990457-project Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 969be4a3c9bd432fa544ee27fa186564 Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-TestNetworkBasicOps-1774990457-project Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 5562f723-95f1-4fc0-93db-b9b457324d35 could not be found. Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '5562f723-95f1-4fc0-93db-b9b457324d35'} Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5562f723-95f1-4fc0-93db-b9b457324d35 could not be found. Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5562f723-95f1-4fc0-93db-b9b457324d35 could not be found. Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:22:06.913097 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:22:06.917009 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:22:06.917009 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:22:06.917009 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:22:06.917009 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:22:06.917009 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:22:06.917009 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5562f723-95f1-4fc0-93db-b9b457324d35 could not be found. Oct 29 03:22:06.917009 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:22:06.917009 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-20a5f3b3-7371-48bf-b8fa-c2adecf56730 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Returning 404 to user: Instance 5562f723-95f1-4fc0-93db-b9b457324d35 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:22:06.917009 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-20a5f3b3-7371-48bf-b8fa-c2adecf56730 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35" status: 404 len: 111 microversion: 2.1 time: 0.096073 Oct 29 03:22:06.917009 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2811/5396] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:06 2022] GET /compute/v2.1/servers/5562f723-95f1-4fc0-93db-b9b457324d35 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:22:07.263581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8eda2217-6255-451c-a8e4-56f66877db84 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:07.272374 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8eda2217-6255-451c-a8e4-56f66877db84 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1507 microversion: 2.1 time: 0.467820 Oct 29 03:22:07.277520 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2586/5397] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:06 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1507 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:07.368672 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c4f6877d-bfc3-4312-9ed8-ce1138b4781b tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '.version_select at 0x7ff052ac5f70>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:07.434820 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c4f6877d-bfc3-4312-9ed8-ce1138b4781b tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1963349401" status: 202 len: 0 microversion: 2.1 time: 0.070372 Oct 29 03:22:07.436547 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2812/5398] 10.222.0.46 () {58 vars in 1257 bytes} [Sat Oct 29 03:22:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1963349401 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:22:07.445226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-bec5ebb4-2bc9-41b5-8285-f44de1b9d21c req-9edd9d5f-29b0-4129-8139-483cfe31e0da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0568de01-669e-4f98-8ca7-3e358669ef8f", "name": "network-vif-deleted", "tag": "c42a747a-f6ba-448c-a70e-519721103faf"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:22:07.460283 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f1bdb04f-f621-4804-9a99-28b71a03f2d5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:07.482059 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f1bdb04f-f621-4804-9a99-28b71a03f2d5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:07.490686 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-bec5ebb4-2bc9-41b5-8285-f44de1b9d21c req-9edd9d5f-29b0-4129-8139-483cfe31e0da service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:07.494144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-bec5ebb4-2bc9-41b5-8285-f44de1b9d21c req-9edd9d5f-29b0-4129-8139-483cfe31e0da service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:07.494758 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-bec5ebb4-2bc9-41b5-8285-f44de1b9d21c req-9edd9d5f-29b0-4129-8139-483cfe31e0da service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:07.524785 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-bec5ebb4-2bc9-41b5-8285-f44de1b9d21c req-9edd9d5f-29b0-4129-8139-483cfe31e0da service nova] Creating event network-vif-deleted:c42a747a-f6ba-448c-a70e-519721103faf for instance 0568de01-669e-4f98-8ca7-3e358669ef8f on n-h2-862967-2 Oct 29 03:22:07.537700 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-bec5ebb4-2bc9-41b5-8285-f44de1b9d21c req-9edd9d5f-29b0-4129-8139-483cfe31e0da service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109344 Oct 29 03:22:07.538330 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2587/5399] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:22:07.549519 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f1bdb04f-f621-4804-9a99-28b71a03f2d5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:07.550018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f1bdb04f-f621-4804-9a99-28b71a03f2d5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:07.552567 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f1bdb04f-f621-4804-9a99-28b71a03f2d5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:07.553327 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f1bdb04f-f621-4804-9a99-28b71a03f2d5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:07.553788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f1bdb04f-f621-4804-9a99-28b71a03f2d5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:07.554215 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f1bdb04f-f621-4804-9a99-28b71a03f2d5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:07.648847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f1bdb04f-f621-4804-9a99-28b71a03f2d5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:07.659415 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f1bdb04f-f621-4804-9a99-28b71a03f2d5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 200 len: 1350 microversion: 2.1 time: 0.221335 Oct 29 03:22:07.663510 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2813/5400] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:07 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 1350 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:08.307790 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a83ca6ad-f665-4cb7-8178-11b4e9bc1ae9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:08.318325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a83ca6ad-f665-4cb7-8178-11b4e9bc1ae9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:08.340797 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a83ca6ad-f665-4cb7-8178-11b4e9bc1ae9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:08.344354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a83ca6ad-f665-4cb7-8178-11b4e9bc1ae9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:08.344890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a83ca6ad-f665-4cb7-8178-11b4e9bc1ae9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:08.345934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a83ca6ad-f665-4cb7-8178-11b4e9bc1ae9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:08.367000 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a83ca6ad-f665-4cb7-8178-11b4e9bc1ae9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:08.367477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a83ca6ad-f665-4cb7-8178-11b4e9bc1ae9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:08.691246 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a1478d66-1342-416d-bf42-866f7bb2d23a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:08.695383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a1478d66-1342-416d-bf42-866f7bb2d23a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 0568de01-669e-4f98-8ca7-3e358669ef8f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:08.706633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a1478d66-1342-416d-bf42-866f7bb2d23a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:08.707589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a1478d66-1342-416d-bf42-866f7bb2d23a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:08.708436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a1478d66-1342-416d-bf42-866f7bb2d23a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:08.709502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a1478d66-1342-416d-bf42-866f7bb2d23a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:08.710234 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a1478d66-1342-416d-bf42-866f7bb2d23a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:08.710927 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a1478d66-1342-416d-bf42-866f7bb2d23a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:08.731410 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-a1478d66-1342-416d-bf42-866f7bb2d23a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] HTTP exception thrown: Instance 0568de01-669e-4f98-8ca7-3e358669ef8f could not be found. Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a1478d66-1342-416d-bf42-866f7bb2d23a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Request method failure captured: Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f HTTP/1.1 Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJvFDgv39YEHxHfIGPphS_gbBVnKLoR2NMVFu2W7_hYkDRDJ01RHk3ODd2efOl__KQE-71QHOfy9i5K9cE39s3-f5uUaGST3mGa6UP6ZiaoXfrXgr9ANswBW4fhoyYxt5VjIwP2IaqtzixgmpqXZparOwp6ERMwaDHZ09cH_NGeZj5o Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: c898299eb0444aa1a1983fb127153c65 Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1800856932 Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c898299eb0444aa1a1983fb127153c65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c898299eb0444aa1a1983fb127153c65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c898299eb0444aa1a1983fb127153c65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c898299eb0444aa1a1983fb127153c65"}]}] Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1800856932 Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: c898299eb0444aa1a1983fb127153c65 Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1800856932 Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-TestNetworkAdvancedServerOps-1800856932-project Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 789295d938084ee3b7d618690fee5bfa Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1800856932-project Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 0568de01-669e-4f98-8ca7-3e358669ef8f could not be found. Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '0568de01-669e-4f98-8ca7-3e358669ef8f'} Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0568de01-669e-4f98-8ca7-3e358669ef8f could not be found. Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0568de01-669e-4f98-8ca7-3e358669ef8f could not be found. Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:22:08.734614 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:22:08.738952 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:22:08.738952 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:22:08.738952 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:22:08.738952 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:22:08.738952 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:22:08.738952 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:22:08.738952 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0568de01-669e-4f98-8ca7-3e358669ef8f could not be found. Oct 29 03:22:08.738952 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:22:08.740547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a1478d66-1342-416d-bf42-866f7bb2d23a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Returning 404 to user: Instance 0568de01-669e-4f98-8ca7-3e358669ef8f could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:22:08.741751 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a1478d66-1342-416d-bf42-866f7bb2d23a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f" status: 404 len: 111 microversion: 2.1 time: 0.055920 Oct 29 03:22:08.742510 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2814/5401] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:08 2022] GET /compute/v2.1/servers/0568de01-669e-4f98-8ca7-3e358669ef8f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:22:09.216256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a83ca6ad-f665-4cb7-8178-11b4e9bc1ae9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:09.230659 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a83ca6ad-f665-4cb7-8178-11b4e9bc1ae9 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1487 microversion: 2.1 time: 0.928047 Oct 29 03:22:09.231417 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2588/5402] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:08 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1487 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:09.261409 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3d906a3a-97a4-42ee-93dd-a02ee16611c1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:22:09.262622 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3d906a3a-97a4-42ee-93dd-a02ee16611c1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:09.273728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d906a3a-97a4-42ee-93dd-a02ee16611c1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:09.277150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d906a3a-97a4-42ee-93dd-a02ee16611c1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:09.277764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d906a3a-97a4-42ee-93dd-a02ee16611c1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:09.297011 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d906a3a-97a4-42ee-93dd-a02ee16611c1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:09.297554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d906a3a-97a4-42ee-93dd-a02ee16611c1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:09.297967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3d906a3a-97a4-42ee-93dd-a02ee16611c1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:09.330550 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-3d906a3a-97a4-42ee-93dd-a02ee16611c1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lazy-loading 'flavor' on Instance uuid 31815e5e-cc50-4f59-950f-ca62e30e9e6d {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:22:09.763666 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3d906a3a-97a4-42ee-93dd-a02ee16611c1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d/action" status: 202 len: 0 microversion: 2.1 time: 0.507633 Oct 29 03:22:09.769844 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2815/5403] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:22:09 2022] POST /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d/action => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:22:09.781657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b6fd78fe-7ba2-4f86-b5e0-e54cbd6160cb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:09.784326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b6fd78fe-7ba2-4f86-b5e0-e54cbd6160cb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:09.810893 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6fd78fe-7ba2-4f86-b5e0-e54cbd6160cb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:09.813992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6fd78fe-7ba2-4f86-b5e0-e54cbd6160cb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:09.818481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6fd78fe-7ba2-4f86-b5e0-e54cbd6160cb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:09.820007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6fd78fe-7ba2-4f86-b5e0-e54cbd6160cb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:09.822006 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6fd78fe-7ba2-4f86-b5e0-e54cbd6160cb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:09.823695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6fd78fe-7ba2-4f86-b5e0-e54cbd6160cb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:10.158194 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b6fd78fe-7ba2-4f86-b5e0-e54cbd6160cb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:10.172485 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b6fd78fe-7ba2-4f86-b5e0-e54cbd6160cb tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1493 microversion: 2.1 time: 0.398965 Oct 29 03:22:10.188217 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2589/5404] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:09 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1493 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:22:11.200605 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-52a239d1-3193-49ce-9b6c-7899cf03f3d1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:11.201851 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-52a239d1-3193-49ce-9b6c-7899cf03f3d1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:11.246607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:11.278378 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-52a239d1-3193-49ce-9b6c-7899cf03f3d1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:11.280329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-52a239d1-3193-49ce-9b6c-7899cf03f3d1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:11.281877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-52a239d1-3193-49ce-9b6c-7899cf03f3d1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:11.284829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-52a239d1-3193-49ce-9b6c-7899cf03f3d1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:11.285320 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-52a239d1-3193-49ce-9b6c-7899cf03f3d1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:11.288769 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-52a239d1-3193-49ce-9b6c-7899cf03f3d1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:11.943017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-52a239d1-3193-49ce-9b6c-7899cf03f3d1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:11.957945 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-52a239d1-3193-49ce-9b6c-7899cf03f3d1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1514 microversion: 2.1 time: 0.759717 Oct 29 03:22:11.959078 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2816/5405] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:11 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1514 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:12.983620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-92cd052e-c632-4b50-bd93-9a3e7aa2e416 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:12.984222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-92cd052e-c632-4b50-bd93-9a3e7aa2e416 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:13.009511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92cd052e-c632-4b50-bd93-9a3e7aa2e416 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:13.011873 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92cd052e-c632-4b50-bd93-9a3e7aa2e416 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:13.013165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92cd052e-c632-4b50-bd93-9a3e7aa2e416 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:13.013925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92cd052e-c632-4b50-bd93-9a3e7aa2e416 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:13.014427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92cd052e-c632-4b50-bd93-9a3e7aa2e416 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:13.019820 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92cd052e-c632-4b50-bd93-9a3e7aa2e416 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:14.035533 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-92cd052e-c632-4b50-bd93-9a3e7aa2e416 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:14.088920 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-92cd052e-c632-4b50-bd93-9a3e7aa2e416 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1509 microversion: 2.1 time: 1.110042 Oct 29 03:22:14.089715 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2590/5406] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:12 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1509 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:15.113386 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4029edc9-1eb6-4643-889c-ce72373a6881 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:15.113975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4029edc9-1eb6-4643-889c-ce72373a6881 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:15.129062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4029edc9-1eb6-4643-889c-ce72373a6881 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:15.135527 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4029edc9-1eb6-4643-889c-ce72373a6881 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:15.136201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4029edc9-1eb6-4643-889c-ce72373a6881 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:15.137190 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4029edc9-1eb6-4643-889c-ce72373a6881 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:15.138019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4029edc9-1eb6-4643-889c-ce72373a6881 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:15.139050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4029edc9-1eb6-4643-889c-ce72373a6881 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:16.488814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4029edc9-1eb6-4643-889c-ce72373a6881 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:16.502726 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4029edc9-1eb6-4643-889c-ce72373a6881 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1509 microversion: 2.1 time: 1.393200 Oct 29 03:22:16.503690 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2817/5407] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:15 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1509 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:17.530267 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-57d25af2-f943-4fc7-b591-113bcd083ca6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:17.531677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-57d25af2-f943-4fc7-b591-113bcd083ca6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:17.539888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57d25af2-f943-4fc7-b591-113bcd083ca6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:17.540782 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57d25af2-f943-4fc7-b591-113bcd083ca6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:17.541431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57d25af2-f943-4fc7-b591-113bcd083ca6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:17.542419 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57d25af2-f943-4fc7-b591-113bcd083ca6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:17.543063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57d25af2-f943-4fc7-b591-113bcd083ca6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:17.543675 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57d25af2-f943-4fc7-b591-113bcd083ca6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:17.598855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-5047ba2f-6639-43a7-b7de-a4768fce0dc0 req-c8b1ae00-d76e-4099-be55-edff8ad5e372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31815e5e-cc50-4f59-950f-ca62e30e9e6d", "name": "network-vif-plugged", "status": "completed", "tag": "3e99d247-4408-432a-bb8c-076c7841fa59"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:22:17.615327 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5047ba2f-6639-43a7-b7de-a4768fce0dc0 req-c8b1ae00-d76e-4099-be55-edff8ad5e372 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:17.616068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5047ba2f-6639-43a7-b7de-a4768fce0dc0 req-c8b1ae00-d76e-4099-be55-edff8ad5e372 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:17.617091 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5047ba2f-6639-43a7-b7de-a4768fce0dc0 req-c8b1ae00-d76e-4099-be55-edff8ad5e372 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:17.632604 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-5047ba2f-6639-43a7-b7de-a4768fce0dc0 req-c8b1ae00-d76e-4099-be55-edff8ad5e372 service nova] Creating event network-vif-plugged:3e99d247-4408-432a-bb8c-076c7841fa59 for instance 31815e5e-cc50-4f59-950f-ca62e30e9e6d on n-h2-862967-2 Oct 29 03:22:17.647075 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-5047ba2f-6639-43a7-b7de-a4768fce0dc0 req-c8b1ae00-d76e-4099-be55-edff8ad5e372 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047698 Oct 29 03:22:17.648983 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2818/5408] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:22:18.062412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-57d25af2-f943-4fc7-b591-113bcd083ca6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:18.075660 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-57d25af2-f943-4fc7-b591-113bcd083ca6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1509 microversion: 2.1 time: 0.548584 Oct 29 03:22:18.079432 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2591/5409] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:17 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1509 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:18.885990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-692b0dc2-82c0-4e5b-af92-93d8aa5fbc61 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '.version_select at 0x7ff052a68670>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:18.924015 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-692b0dc2-82c0-4e5b-af92-93d8aa5fbc61 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-266528313" status: 202 len: 0 microversion: 2.1 time: 0.043645 Oct 29 03:22:18.924814 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2819/5410] 10.222.0.46 () {58 vars in 1281 bytes} [Sat Oct 29 03:22:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-266528313 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:22:18.974276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f45207d4-f502-4758-96ca-f45500053b0e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Action: 'create', calling method: .version_select at 0x7ff053704670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-451399934", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/+u2UTwHz/wiLvFoI/5pFiF/HHrIZgiOspJ6svaQhgWLkPh+dgbKYVLNFr4GwihCTDc+oNS/7LRgnRB7zHrQ+WIRsOqCHYh/VFILWe2fvFK6kd3W7w6hyoKZEDwphShg=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:22:19.055415 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-f45207d4-f502-4758-96ca-f45500053b0e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Getting quotas for project c898299eb0444aa1a1983fb127153c65. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:22:19.076990 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-f45207d4-f502-4758-96ca-f45500053b0e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Getting quotas for user 789295d938084ee3b7d618690fee5bfa and project c898299eb0444aa1a1983fb127153c65. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:22:19.104874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2ddacfbe-d42e-4156-bf3f-ecb2fb178392 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:19.107115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2ddacfbe-d42e-4156-bf3f-ecb2fb178392 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:19.120364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2ddacfbe-d42e-4156-bf3f-ecb2fb178392 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:19.121539 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2ddacfbe-d42e-4156-bf3f-ecb2fb178392 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:19.124660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2ddacfbe-d42e-4156-bf3f-ecb2fb178392 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:19.127571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2ddacfbe-d42e-4156-bf3f-ecb2fb178392 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:19.128335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2ddacfbe-d42e-4156-bf3f-ecb2fb178392 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:19.128965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2ddacfbe-d42e-4156-bf3f-ecb2fb178392 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:19.147508 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f45207d4-f502-4758-96ca-f45500053b0e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.177185 Oct 29 03:22:19.154275 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2592/5411] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:22:18 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:22:19.411460 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2ddacfbe-d42e-4156-bf3f-ecb2fb178392 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:19.423399 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2ddacfbe-d42e-4156-bf3f-ecb2fb178392 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1509 microversion: 2.1 time: 0.322225 Oct 29 03:22:19.424312 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2820/5412] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:19 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1509 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:20.449873 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d7b696db-e800-459a-ba4c-3adc3c36d184 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:20.450501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d7b696db-e800-459a-ba4c-3adc3c36d184 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:20.457461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d7b696db-e800-459a-ba4c-3adc3c36d184 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:20.458541 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d7b696db-e800-459a-ba4c-3adc3c36d184 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:20.459133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d7b696db-e800-459a-ba4c-3adc3c36d184 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:20.460306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d7b696db-e800-459a-ba4c-3adc3c36d184 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:20.460910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d7b696db-e800-459a-ba4c-3adc3c36d184 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:20.461907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d7b696db-e800-459a-ba4c-3adc3c36d184 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:20.791653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d7b696db-e800-459a-ba4c-3adc3c36d184 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:20.819456 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d7b696db-e800-459a-ba4c-3adc3c36d184 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1509 microversion: 2.1 time: 0.376564 Oct 29 03:22:20.824950 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2593/5413] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:20 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1509 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:21.843329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9b67e532-eb6b-4868-9488-93fdf8702583 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:21.844004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9b67e532-eb6b-4868-9488-93fdf8702583 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:21.859719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b67e532-eb6b-4868-9488-93fdf8702583 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:21.860282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b67e532-eb6b-4868-9488-93fdf8702583 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:21.865455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b67e532-eb6b-4868-9488-93fdf8702583 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:21.866339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b67e532-eb6b-4868-9488-93fdf8702583 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:21.866835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b67e532-eb6b-4868-9488-93fdf8702583 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:21.867610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b67e532-eb6b-4868-9488-93fdf8702583 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:22.244568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9b67e532-eb6b-4868-9488-93fdf8702583 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:22.255103 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9b67e532-eb6b-4868-9488-93fdf8702583 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1509 microversion: 2.1 time: 0.415978 Oct 29 03:22:22.260859 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2821/5414] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:21 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1509 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:23.288981 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-37ae69fd-f2d1-46ac-9466-14154019d139 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:23.296172 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-37ae69fd-f2d1-46ac-9466-14154019d139 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:23.317954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-37ae69fd-f2d1-46ac-9466-14154019d139 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:23.322771 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-37ae69fd-f2d1-46ac-9466-14154019d139 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:23.326028 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-37ae69fd-f2d1-46ac-9466-14154019d139 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:23.334269 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-37ae69fd-f2d1-46ac-9466-14154019d139 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:23.338342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-37ae69fd-f2d1-46ac-9466-14154019d139 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:23.342125 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-37ae69fd-f2d1-46ac-9466-14154019d139 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:23.700587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-37ae69fd-f2d1-46ac-9466-14154019d139 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:23.715338 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-37ae69fd-f2d1-46ac-9466-14154019d139 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1509 microversion: 2.1 time: 0.436834 Oct 29 03:22:23.717187 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2594/5415] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:23 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1509 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:24.741687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-76a590cf-9c38-4bbf-832c-e20807143a44 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:24.743144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-76a590cf-9c38-4bbf-832c-e20807143a44 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:24.760366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76a590cf-9c38-4bbf-832c-e20807143a44 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:24.767561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76a590cf-9c38-4bbf-832c-e20807143a44 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:24.768659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76a590cf-9c38-4bbf-832c-e20807143a44 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:24.770280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76a590cf-9c38-4bbf-832c-e20807143a44 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:24.771755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76a590cf-9c38-4bbf-832c-e20807143a44 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:24.773209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76a590cf-9c38-4bbf-832c-e20807143a44 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:25.370954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-76a590cf-9c38-4bbf-832c-e20807143a44 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:25.382167 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-76a590cf-9c38-4bbf-832c-e20807143a44 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1509 microversion: 2.1 time: 0.644410 Oct 29 03:22:25.384650 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2822/5416] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:24 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1509 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:26.412130 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bad852d9-851b-49f6-9641-0758df97ed5f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:26.414153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bad852d9-851b-49f6-9641-0758df97ed5f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:26.433927 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bad852d9-851b-49f6-9641-0758df97ed5f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:26.434852 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bad852d9-851b-49f6-9641-0758df97ed5f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:26.435474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bad852d9-851b-49f6-9641-0758df97ed5f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:26.436679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bad852d9-851b-49f6-9641-0758df97ed5f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:26.439433 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bad852d9-851b-49f6-9641-0758df97ed5f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:26.440159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bad852d9-851b-49f6-9641-0758df97ed5f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:27.310232 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bad852d9-851b-49f6-9641-0758df97ed5f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:27.330053 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bad852d9-851b-49f6-9641-0758df97ed5f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1509 microversion: 2.1 time: 0.921813 Oct 29 03:22:27.330691 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2595/5417] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:26 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1509 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:28.358552 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c14e1293-f1c6-4929-96c8-59873024ecd8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:28.359328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c14e1293-f1c6-4929-96c8-59873024ecd8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:28.374878 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c14e1293-f1c6-4929-96c8-59873024ecd8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:28.375561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c14e1293-f1c6-4929-96c8-59873024ecd8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:28.376473 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c14e1293-f1c6-4929-96c8-59873024ecd8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:28.378785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c14e1293-f1c6-4929-96c8-59873024ecd8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:28.380378 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c14e1293-f1c6-4929-96c8-59873024ecd8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:28.382581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c14e1293-f1c6-4929-96c8-59873024ecd8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:29.170762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c14e1293-f1c6-4929-96c8-59873024ecd8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:29.195628 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c14e1293-f1c6-4929-96c8-59873024ecd8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1509 microversion: 2.1 time: 0.841813 Oct 29 03:22:29.197469 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2823/5418] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:28 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1509 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:30.224466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3a30ad16-c555-44bb-8a2f-5ca13883dc95 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:30.225116 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3a30ad16-c555-44bb-8a2f-5ca13883dc95 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:30.245668 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:30.250041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a30ad16-c555-44bb-8a2f-5ca13883dc95 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:30.250623 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a30ad16-c555-44bb-8a2f-5ca13883dc95 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:30.251114 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a30ad16-c555-44bb-8a2f-5ca13883dc95 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:30.251713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-06b7d24e-297e-45c8-82bb-aea3875fa3fc tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Action: 'create', calling method: .version_select at 0x7ff05295bb80>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1057370026", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLNWjvTmcSOa50RjqQaF0RA6iH3hdfEh7IeBR7jVqVk1YOLzx6ouhdzTTFWCKgFRz0ed3MLl7+/VLgNpCAGW/HNaNm12R0TOtliJLKwHnL1OvZxY6DEXENZYhj7yL3nwew=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:22:30.252182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a30ad16-c555-44bb-8a2f-5ca13883dc95 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:30.252302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a30ad16-c555-44bb-8a2f-5ca13883dc95 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:30.260373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a30ad16-c555-44bb-8a2f-5ca13883dc95 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:30.282409 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-06b7d24e-297e-45c8-82bb-aea3875fa3fc tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Getting quotas for project 987564b626dd4c12b6109c1d23de75c6. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:22:30.296936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-06b7d24e-297e-45c8-82bb-aea3875fa3fc tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Getting quotas for user 969be4a3c9bd432fa544ee27fa186564 and project 987564b626dd4c12b6109c1d23de75c6. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:22:30.359489 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-06b7d24e-297e-45c8-82bb-aea3875fa3fc tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.112354 Oct 29 03:22:30.376724 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2824/5419] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:22:30 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:22:30.816415 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3a30ad16-c555-44bb-8a2f-5ca13883dc95 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:30.828751 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3a30ad16-c555-44bb-8a2f-5ca13883dc95 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1509 microversion: 2.1 time: 0.608240 Oct 29 03:22:30.849722 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2596/5420] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:30 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1509 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:31.856130 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9acfc3e4-e5bb-4f71-916a-5fd1fe2ebdcf tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:31.856816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9acfc3e4-e5bb-4f71-916a-5fd1fe2ebdcf tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:31.871331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9acfc3e4-e5bb-4f71-916a-5fd1fe2ebdcf tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:31.874977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9acfc3e4-e5bb-4f71-916a-5fd1fe2ebdcf tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:31.875641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9acfc3e4-e5bb-4f71-916a-5fd1fe2ebdcf tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:31.892732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9acfc3e4-e5bb-4f71-916a-5fd1fe2ebdcf tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:31.893974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9acfc3e4-e5bb-4f71-916a-5fd1fe2ebdcf tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:31.894572 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9acfc3e4-e5bb-4f71-916a-5fd1fe2ebdcf tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:32.373572 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9acfc3e4-e5bb-4f71-916a-5fd1fe2ebdcf tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:32.385414 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9acfc3e4-e5bb-4f71-916a-5fd1fe2ebdcf tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1509 microversion: 2.1 time: 0.534144 Oct 29 03:22:32.387977 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2825/5421] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:31 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1509 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:33.416301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-33929036-b7c4-4d77-a667-b68a4447f795 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:33.418356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-33929036-b7c4-4d77-a667-b68a4447f795 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:33.421262 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:33.449235 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33929036-b7c4-4d77-a667-b68a4447f795 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:33.450205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33929036-b7c4-4d77-a667-b68a4447f795 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:33.450742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33929036-b7c4-4d77-a667-b68a4447f795 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:33.451676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33929036-b7c4-4d77-a667-b68a4447f795 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:33.455844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33929036-b7c4-4d77-a667-b68a4447f795 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:33.456640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33929036-b7c4-4d77-a667-b68a4447f795 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:33.471589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=87 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:33.757388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-becdac6c-5c50-4f37-9352-8c4159820c24 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1257234553", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "39ce7a57-cedf-41a8-9636-573302374abf"}], "key_name": "tempest-TestNetworkBasicOps-1057370026", "security_groups": [{"name": "tempest-secgroup-smoke-1013630491"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:22:33.852933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-33929036-b7c4-4d77-a667-b68a4447f795 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:33.878840 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-33929036-b7c4-4d77-a667-b68a4447f795 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1509 microversion: 2.1 time: 0.463379 Oct 29 03:22:33.879483 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2597/5422] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:33 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1509 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:34.066723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-becdac6c-5c50-4f37-9352-8c4159820c24 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] validate_networks() for [('39ce7a57-cedf-41a8-9636-573302374abf', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:22:34.906052 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1f5f7ed7-322c-4486-8ac6-ecd922185cf6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:34.906705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1f5f7ed7-322c-4486-8ac6-ecd922185cf6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:34.920990 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f5f7ed7-322c-4486-8ac6-ecd922185cf6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:34.921706 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f5f7ed7-322c-4486-8ac6-ecd922185cf6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:34.922369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f5f7ed7-322c-4486-8ac6-ecd922185cf6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:34.923266 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f5f7ed7-322c-4486-8ac6-ecd922185cf6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:34.925270 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f5f7ed7-322c-4486-8ac6-ecd922185cf6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:34.925881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f5f7ed7-322c-4486-8ac6-ecd922185cf6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:35.324502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1f5f7ed7-322c-4486-8ac6-ecd922185cf6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:35.335673 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1f5f7ed7-322c-4486-8ac6-ecd922185cf6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1509 microversion: 2.1 time: 0.433668 Oct 29 03:22:35.340606 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2598/5423] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:34 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1509 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:22:35.697478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-becdac6c-5c50-4f37-9352-8c4159820c24 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:22:35.699210 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-becdac6c-5c50-4f37-9352-8c4159820c24 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:22:35.699838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-becdac6c-5c50-4f37-9352-8c4159820c24 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:22:35.700387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-becdac6c-5c50-4f37-9352-8c4159820c24 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:22:35.700977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-becdac6c-5c50-4f37-9352-8c4159820c24 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:22:35.726194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-becdac6c-5c50-4f37-9352-8c4159820c24 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:35.738539 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-becdac6c-5c50-4f37-9352-8c4159820c24 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:35.739526 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-becdac6c-5c50-4f37-9352-8c4159820c24 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:35.743714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-becdac6c-5c50-4f37-9352-8c4159820c24 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:35.758029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-becdac6c-5c50-4f37-9352-8c4159820c24 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:35.759066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-becdac6c-5c50-4f37-9352-8c4159820c24 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:35.818483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:35.893146 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-becdac6c-5c50-4f37-9352-8c4159820c24 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Getting quotas for project 987564b626dd4c12b6109c1d23de75c6. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:22:35.913650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-becdac6c-5c50-4f37-9352-8c4159820c24 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Getting quotas for user 969be4a3c9bd432fa544ee27fa186564 and project 987564b626dd4c12b6109c1d23de75c6. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:22:35.950361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-becdac6c-5c50-4f37-9352-8c4159820c24 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:22:35.956923 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-becdac6c-5c50-4f37-9352-8c4159820c24 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 7bb1a735-8673-475d-8092-c67222d3415d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:22:36.036029 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-becdac6c-5c50-4f37-9352-8c4159820c24 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.282201 Oct 29 03:22:36.037133 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2826/5424] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:22:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 2284 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:22:36.055767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-325dfcda-4455-4611-afe7-6b7547ecb188 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:36.094165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-325dfcda-4455-4611-afe7-6b7547ecb188 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 7bb1a735-8673-475d-8092-c67222d3415d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:36.374059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-325dfcda-4455-4611-afe7-6b7547ecb188 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:36.374651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3163d0df-7e6e-48d3-ab1f-baf1dcf6d3be tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:36.375276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3163d0df-7e6e-48d3-ab1f-baf1dcf6d3be tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:36.393044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3163d0df-7e6e-48d3-ab1f-baf1dcf6d3be tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:36.393853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3163d0df-7e6e-48d3-ab1f-baf1dcf6d3be tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:36.394284 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3163d0df-7e6e-48d3-ab1f-baf1dcf6d3be tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:36.408065 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3163d0df-7e6e-48d3-ab1f-baf1dcf6d3be tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:36.416603 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3163d0df-7e6e-48d3-ab1f-baf1dcf6d3be tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:36.418648 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-325dfcda-4455-4611-afe7-6b7547ecb188 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d" status: 200 len: 1249 microversion: 2.1 time: 0.369741 Oct 29 03:22:36.420190 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2599/5425] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:36 2022] GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d => generated 1249 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:36.424043 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3163d0df-7e6e-48d3-ab1f-baf1dcf6d3be tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:36.933606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3163d0df-7e6e-48d3-ab1f-baf1dcf6d3be tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:36.947860 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3163d0df-7e6e-48d3-ab1f-baf1dcf6d3be tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1509 microversion: 2.1 time: 0.584537 Oct 29 03:22:36.960976 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2827/5426] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:36 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1509 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:37.452995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ef450736-a53e-4ab6-89a2-aec974360898 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:37.453619 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ef450736-a53e-4ab6-89a2-aec974360898 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 7bb1a735-8673-475d-8092-c67222d3415d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:37.648781 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ef450736-a53e-4ab6-89a2-aec974360898 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:37.692151 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ef450736-a53e-4ab6-89a2-aec974360898 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d" status: 200 len: 1249 microversion: 2.1 time: 0.237908 Oct 29 03:22:37.694912 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2600/5427] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:37 2022] GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d => generated 1249 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:37.743656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0c697719-5745-4fb1-bf4b-2312ebc56fae tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-148285694", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "4a33d08e-dcf4-41f9-a370-463c92b1f92f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-451399934", "security_groups": [{"name": "tempest-secgroup-smoke-1725850863"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:22:37.973885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f530fdc2-3cb8-4733-941f-ce639212df65 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:37.975156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f530fdc2-3cb8-4733-941f-ce639212df65 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:38.010876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f530fdc2-3cb8-4733-941f-ce639212df65 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:38.011388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f530fdc2-3cb8-4733-941f-ce639212df65 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:38.014992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f530fdc2-3cb8-4733-941f-ce639212df65 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:38.015763 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f530fdc2-3cb8-4733-941f-ce639212df65 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:38.025243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f530fdc2-3cb8-4733-941f-ce639212df65 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:38.025973 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f530fdc2-3cb8-4733-941f-ce639212df65 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:38.094807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-0c697719-5745-4fb1-bf4b-2312ebc56fae tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] validate_networks() for [('4a33d08e-dcf4-41f9-a370-463c92b1f92f', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:22:38.754817 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f530fdc2-3cb8-4733-941f-ce639212df65 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:38.765330 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f530fdc2-3cb8-4733-941f-ce639212df65 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1509 microversion: 2.1 time: 0.798005 Oct 29 03:22:38.777613 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2601/5428] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:37 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1509 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:22:38.782911 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-40fe4da3-4e3a-4783-9a9e-0b6a73d92681 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:38.828608 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-40fe4da3-4e3a-4783-9a9e-0b6a73d92681 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 7bb1a735-8673-475d-8092-c67222d3415d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:38.854110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40fe4da3-4e3a-4783-9a9e-0b6a73d92681 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:38.857857 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40fe4da3-4e3a-4783-9a9e-0b6a73d92681 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:38.861115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40fe4da3-4e3a-4783-9a9e-0b6a73d92681 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:38.864938 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40fe4da3-4e3a-4783-9a9e-0b6a73d92681 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:38.865420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40fe4da3-4e3a-4783-9a9e-0b6a73d92681 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:38.865852 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40fe4da3-4e3a-4783-9a9e-0b6a73d92681 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:39.040484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-40fe4da3-4e3a-4783-9a9e-0b6a73d92681 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:39.049033 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-40fe4da3-4e3a-4783-9a9e-0b6a73d92681 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d" status: 200 len: 1301 microversion: 2.1 time: 0.270015 Oct 29 03:22:39.075830 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2602/5429] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:38 2022] GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d => generated 1301 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:39.375047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-0c697719-5745-4fb1-bf4b-2312ebc56fae tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:22:39.376184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-0c697719-5745-4fb1-bf4b-2312ebc56fae tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:22:39.376826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-0c697719-5745-4fb1-bf4b-2312ebc56fae tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:22:39.377370 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-0c697719-5745-4fb1-bf4b-2312ebc56fae tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:22:39.378100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-0c697719-5745-4fb1-bf4b-2312ebc56fae tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:22:39.400297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0c697719-5745-4fb1-bf4b-2312ebc56fae tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:39.408261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0c697719-5745-4fb1-bf4b-2312ebc56fae tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:39.408807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0c697719-5745-4fb1-bf4b-2312ebc56fae tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:39.413092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0c697719-5745-4fb1-bf4b-2312ebc56fae tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:39.414122 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0c697719-5745-4fb1-bf4b-2312ebc56fae tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:39.418423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0c697719-5745-4fb1-bf4b-2312ebc56fae tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:39.502299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-0c697719-5745-4fb1-bf4b-2312ebc56fae tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Getting quotas for project c898299eb0444aa1a1983fb127153c65. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:22:39.527939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-0c697719-5745-4fb1-bf4b-2312ebc56fae tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Getting quotas for user 789295d938084ee3b7d618690fee5bfa and project c898299eb0444aa1a1983fb127153c65. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:22:39.580743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0c697719-5745-4fb1-bf4b-2312ebc56fae tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:22:39.602142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0c697719-5745-4fb1-bf4b-2312ebc56fae tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:22:39.806081 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5610ff11-4113-4a01-adad-ffa5416555e8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:39.807277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5610ff11-4113-4a01-adad-ffa5416555e8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:39.825142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5610ff11-4113-4a01-adad-ffa5416555e8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:39.831933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5610ff11-4113-4a01-adad-ffa5416555e8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:39.833748 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5610ff11-4113-4a01-adad-ffa5416555e8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:39.837104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5610ff11-4113-4a01-adad-ffa5416555e8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:39.840729 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5610ff11-4113-4a01-adad-ffa5416555e8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:39.843789 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5610ff11-4113-4a01-adad-ffa5416555e8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:39.850351 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0c697719-5745-4fb1-bf4b-2312ebc56fae tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.112440 Oct 29 03:22:39.863388 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2828/5430] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:22:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 2125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:22:39.868371 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ad19b76c-0e03-4905-bcec-aa6bbd156687 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:39.893205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ad19b76c-0e03-4905-bcec-aa6bbd156687 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:40.076565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ad19b76c-0e03-4905-bcec-aa6bbd156687 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:40.088607 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ad19b76c-0e03-4905-bcec-aa6bbd156687 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1265 microversion: 2.1 time: 0.224000 Oct 29 03:22:40.092993 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2829/5431] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:39 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:40.104262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f7d3b6d6-fffd-42cc-9a45-c508d91cddc6 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:40.109476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f7d3b6d6-fffd-42cc-9a45-c508d91cddc6 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 7bb1a735-8673-475d-8092-c67222d3415d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:40.124362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7d3b6d6-fffd-42cc-9a45-c508d91cddc6 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:40.124881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7d3b6d6-fffd-42cc-9a45-c508d91cddc6 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:40.127492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7d3b6d6-fffd-42cc-9a45-c508d91cddc6 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:40.128248 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7d3b6d6-fffd-42cc-9a45-c508d91cddc6 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:40.128746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7d3b6d6-fffd-42cc-9a45-c508d91cddc6 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:40.208447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f7d3b6d6-fffd-42cc-9a45-c508d91cddc6 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.079s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:40.474334 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f7d3b6d6-fffd-42cc-9a45-c508d91cddc6 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:40.485945 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5610ff11-4113-4a01-adad-ffa5416555e8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:40.489614 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f7d3b6d6-fffd-42cc-9a45-c508d91cddc6 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d" status: 200 len: 1307 microversion: 2.1 time: 0.393293 Oct 29 03:22:40.497915 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5610ff11-4113-4a01-adad-ffa5416555e8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1509 microversion: 2.1 time: 0.698156 Oct 29 03:22:40.504871 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2603/5432] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:39 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1509 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:40.514487 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2830/5433] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:40 2022] GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d => generated 1307 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:41.119226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-26c2af28-2ae6-4819-b5e9-9757395e1268 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:41.120344 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-26c2af28-2ae6-4819-b5e9-9757395e1268 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:41.402262 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-26c2af28-2ae6-4819-b5e9-9757395e1268 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:41.411438 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-26c2af28-2ae6-4819-b5e9-9757395e1268 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1265 microversion: 2.1 time: 0.296302 Oct 29 03:22:41.420240 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2604/5434] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:41 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1265 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:41.522618 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d5e1ddb8-cfa9-4dbc-833e-b478c785878d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:41.522819 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-df19b9bf-bee5-4f81-b290-d2d23c3dc919 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:41.523262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-df19b9bf-bee5-4f81-b290-d2d23c3dc919 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 7bb1a735-8673-475d-8092-c67222d3415d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:41.524401 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d5e1ddb8-cfa9-4dbc-833e-b478c785878d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:41.525455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:41.553143 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-df19b9bf-bee5-4f81-b290-d2d23c3dc919 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:41.554685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5e1ddb8-cfa9-4dbc-833e-b478c785878d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:41.557060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5e1ddb8-cfa9-4dbc-833e-b478c785878d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:41.558417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-df19b9bf-bee5-4f81-b290-d2d23c3dc919 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:41.560647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-df19b9bf-bee5-4f81-b290-d2d23c3dc919 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:41.561189 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5e1ddb8-cfa9-4dbc-833e-b478c785878d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:41.561435 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-df19b9bf-bee5-4f81-b290-d2d23c3dc919 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:41.561917 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-df19b9bf-bee5-4f81-b290-d2d23c3dc919 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:41.567160 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5e1ddb8-cfa9-4dbc-833e-b478c785878d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:41.568947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5e1ddb8-cfa9-4dbc-833e-b478c785878d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:41.572386 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5e1ddb8-cfa9-4dbc-833e-b478c785878d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:41.575036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-df19b9bf-bee5-4f81-b290-d2d23c3dc919 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:42.072128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-df19b9bf-bee5-4f81-b290-d2d23c3dc919 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:42.117831 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-df19b9bf-bee5-4f81-b290-d2d23c3dc919 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d" status: 200 len: 1375 microversion: 2.1 time: 0.601701 Oct 29 03:22:42.127206 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2831/5435] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:41 2022] GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d => generated 1375 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:42.441619 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-33c5b187-a09b-4e62-95f0-44f0cb200167 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:42.442894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-33c5b187-a09b-4e62-95f0-44f0cb200167 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:42.450662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33c5b187-a09b-4e62-95f0-44f0cb200167 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:42.460396 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33c5b187-a09b-4e62-95f0-44f0cb200167 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:42.463188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33c5b187-a09b-4e62-95f0-44f0cb200167 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:42.465817 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33c5b187-a09b-4e62-95f0-44f0cb200167 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:42.469053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33c5b187-a09b-4e62-95f0-44f0cb200167 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:42.472921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33c5b187-a09b-4e62-95f0-44f0cb200167 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:42.562828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d5e1ddb8-cfa9-4dbc-833e-b478c785878d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:42.577034 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d5e1ddb8-cfa9-4dbc-833e-b478c785878d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1509 microversion: 2.1 time: 1.058378 Oct 29 03:22:42.587151 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2605/5436] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:41 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1509 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:42.674486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-33c5b187-a09b-4e62-95f0-44f0cb200167 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:42.703405 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-33c5b187-a09b-4e62-95f0-44f0cb200167 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1317 microversion: 2.1 time: 0.267410 Oct 29 03:22:42.710752 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2832/5437] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:42 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:43.154240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4c8202d4-0eba-49cf-a9ec-a9113ca46e1e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:43.155038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4c8202d4-0eba-49cf-a9ec-a9113ca46e1e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 7bb1a735-8673-475d-8092-c67222d3415d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:43.179326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c8202d4-0eba-49cf-a9ec-a9113ca46e1e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:43.185888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c8202d4-0eba-49cf-a9ec-a9113ca46e1e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:43.187290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c8202d4-0eba-49cf-a9ec-a9113ca46e1e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:43.188292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c8202d4-0eba-49cf-a9ec-a9113ca46e1e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:43.189137 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c8202d4-0eba-49cf-a9ec-a9113ca46e1e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:43.189801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c8202d4-0eba-49cf-a9ec-a9113ca46e1e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:43.611909 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ade137dd-3007-4eb0-b33a-d5544d872b51 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:43.612661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ade137dd-3007-4eb0-b33a-d5544d872b51 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:43.623493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ade137dd-3007-4eb0-b33a-d5544d872b51 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:43.629236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ade137dd-3007-4eb0-b33a-d5544d872b51 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:43.629803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ade137dd-3007-4eb0-b33a-d5544d872b51 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:43.633323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ade137dd-3007-4eb0-b33a-d5544d872b51 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:43.633908 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ade137dd-3007-4eb0-b33a-d5544d872b51 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:43.634416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ade137dd-3007-4eb0-b33a-d5544d872b51 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:43.779584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4c8202d4-0eba-49cf-a9ec-a9113ca46e1e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:43.798243 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4c8202d4-0eba-49cf-a9ec-a9113ca46e1e tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d" status: 200 len: 1375 microversion: 2.1 time: 0.654499 Oct 29 03:22:43.799498 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2606/5438] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:43 2022] GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d => generated 1375 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:22:43.809364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5802285d-a01b-4df9-ada6-880555b4b986 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:43.812965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5802285d-a01b-4df9-ada6-880555b4b986 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:43.829302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5802285d-a01b-4df9-ada6-880555b4b986 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:43.832176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5802285d-a01b-4df9-ada6-880555b4b986 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:43.832816 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5802285d-a01b-4df9-ada6-880555b4b986 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:43.833935 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5802285d-a01b-4df9-ada6-880555b4b986 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:43.834584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5802285d-a01b-4df9-ada6-880555b4b986 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:43.836805 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5802285d-a01b-4df9-ada6-880555b4b986 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:43.958333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ade137dd-3007-4eb0-b33a-d5544d872b51 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:43.968850 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ade137dd-3007-4eb0-b33a-d5544d872b51 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1506 microversion: 2.1 time: 0.360997 Oct 29 03:22:43.969676 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2833/5439] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:43 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1506 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:44.002092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5802285d-a01b-4df9-ada6-880555b4b986 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:44.010265 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5802285d-a01b-4df9-ada6-880555b4b986 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1323 microversion: 2.1 time: 0.209162 Oct 29 03:22:44.010844 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2607/5440] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:43 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1323 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:44.833840 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d6456e05-e94b-43aa-8dfa-100651fb5f17 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:44.834969 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d6456e05-e94b-43aa-8dfa-100651fb5f17 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 7bb1a735-8673-475d-8092-c67222d3415d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:44.845775 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-d74e066b-e350-42cf-b0c1-5fdfc3e5ecdf req-a3cd7405-4aca-46ee-89e9-a4a456734e72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bb1a735-8673-475d-8092-c67222d3415d", "tag": "8c2f6d11-aace-4074-9601-98ac0d56eb39"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:22:44.866754 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6456e05-e94b-43aa-8dfa-100651fb5f17 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:44.867826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6456e05-e94b-43aa-8dfa-100651fb5f17 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:44.871111 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6456e05-e94b-43aa-8dfa-100651fb5f17 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:44.873150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6456e05-e94b-43aa-8dfa-100651fb5f17 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:44.875781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6456e05-e94b-43aa-8dfa-100651fb5f17 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:44.876873 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6456e05-e94b-43aa-8dfa-100651fb5f17 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:44.884188 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d74e066b-e350-42cf-b0c1-5fdfc3e5ecdf req-a3cd7405-4aca-46ee-89e9-a4a456734e72 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:44.884801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d74e066b-e350-42cf-b0c1-5fdfc3e5ecdf req-a3cd7405-4aca-46ee-89e9-a4a456734e72 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:44.885947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d74e066b-e350-42cf-b0c1-5fdfc3e5ecdf req-a3cd7405-4aca-46ee-89e9-a4a456734e72 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:44.904952 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-d74e066b-e350-42cf-b0c1-5fdfc3e5ecdf req-a3cd7405-4aca-46ee-89e9-a4a456734e72 service nova] Creating event network-changed:8c2f6d11-aace-4074-9601-98ac0d56eb39 for instance 7bb1a735-8673-475d-8092-c67222d3415d on n-h1-862967-2 Oct 29 03:22:44.913518 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-d74e066b-e350-42cf-b0c1-5fdfc3e5ecdf req-a3cd7405-4aca-46ee-89e9-a4a456734e72 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073349 Oct 29 03:22:44.915956 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2608/5441] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:22:44.994900 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-36e3a9a3-bc38-4567-8294-c7babbf9b7b7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:44.995902 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-36e3a9a3-bc38-4567-8294-c7babbf9b7b7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:45.013585 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36e3a9a3-bc38-4567-8294-c7babbf9b7b7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:45.014504 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36e3a9a3-bc38-4567-8294-c7babbf9b7b7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:45.015175 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36e3a9a3-bc38-4567-8294-c7babbf9b7b7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:45.016270 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36e3a9a3-bc38-4567-8294-c7babbf9b7b7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:45.017049 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36e3a9a3-bc38-4567-8294-c7babbf9b7b7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:45.017709 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36e3a9a3-bc38-4567-8294-c7babbf9b7b7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:45.189593 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d6456e05-e94b-43aa-8dfa-100651fb5f17 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:45.201193 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d6456e05-e94b-43aa-8dfa-100651fb5f17 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d" status: 200 len: 1375 microversion: 2.1 time: 0.378210 Oct 29 03:22:45.202795 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2834/5442] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:44 2022] GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d => generated 1375 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:45.225377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b3cd798e-d997-4397-bff9-7c27922634cc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:45.236490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b3cd798e-d997-4397-bff9-7c27922634cc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:45.244162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3cd798e-d997-4397-bff9-7c27922634cc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:45.248483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3cd798e-d997-4397-bff9-7c27922634cc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:45.249850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3cd798e-d997-4397-bff9-7c27922634cc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:45.254196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3cd798e-d997-4397-bff9-7c27922634cc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:45.254844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3cd798e-d997-4397-bff9-7c27922634cc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:45.255466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3cd798e-d997-4397-bff9-7c27922634cc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:45.414098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-36e3a9a3-bc38-4567-8294-c7babbf9b7b7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:45.429854 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-36e3a9a3-bc38-4567-8294-c7babbf9b7b7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1506 microversion: 2.1 time: 0.440587 Oct 29 03:22:45.430931 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2609/5443] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:44 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1506 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:45.531337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b3cd798e-d997-4397-bff9-7c27922634cc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:45.544820 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b3cd798e-d997-4397-bff9-7c27922634cc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1323 microversion: 2.1 time: 0.326454 Oct 29 03:22:45.548288 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2835/5444] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:45 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1323 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:46.229447 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-45eb1f9b-e587-477b-b68d-eca3dc62e780 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:46.230403 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-45eb1f9b-e587-477b-b68d-eca3dc62e780 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 7bb1a735-8673-475d-8092-c67222d3415d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:46.242753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45eb1f9b-e587-477b-b68d-eca3dc62e780 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:46.244472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45eb1f9b-e587-477b-b68d-eca3dc62e780 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:46.245112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45eb1f9b-e587-477b-b68d-eca3dc62e780 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:46.245992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45eb1f9b-e587-477b-b68d-eca3dc62e780 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:46.249185 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45eb1f9b-e587-477b-b68d-eca3dc62e780 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:46.249839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45eb1f9b-e587-477b-b68d-eca3dc62e780 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:46.441181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-45eb1f9b-e587-477b-b68d-eca3dc62e780 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:46.451311 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-45eb1f9b-e587-477b-b68d-eca3dc62e780 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d" status: 200 len: 1375 microversion: 2.1 time: 0.224277 Oct 29 03:22:46.469115 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2610/5445] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:46 2022] GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d => generated 1375 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:46.470487 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b23621dc-d9d9-4629-8339-8990e1521555 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:46.471143 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b23621dc-d9d9-4629-8339-8990e1521555 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:46.479709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b23621dc-d9d9-4629-8339-8990e1521555 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:46.480204 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b23621dc-d9d9-4629-8339-8990e1521555 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:46.480704 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b23621dc-d9d9-4629-8339-8990e1521555 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:46.481408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b23621dc-d9d9-4629-8339-8990e1521555 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:46.481885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b23621dc-d9d9-4629-8339-8990e1521555 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:46.482288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b23621dc-d9d9-4629-8339-8990e1521555 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:46.571252 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-77d4c5aa-13e6-42ba-80cf-603df98273ea tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:46.572384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-77d4c5aa-13e6-42ba-80cf-603df98273ea tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:46.587275 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77d4c5aa-13e6-42ba-80cf-603df98273ea tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:46.587785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77d4c5aa-13e6-42ba-80cf-603df98273ea tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:46.588231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77d4c5aa-13e6-42ba-80cf-603df98273ea tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:46.589242 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77d4c5aa-13e6-42ba-80cf-603df98273ea tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:46.589716 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77d4c5aa-13e6-42ba-80cf-603df98273ea tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:46.590152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77d4c5aa-13e6-42ba-80cf-603df98273ea tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:46.725440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b23621dc-d9d9-4629-8339-8990e1521555 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:46.735227 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b23621dc-d9d9-4629-8339-8990e1521555 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 200 len: 1449 microversion: 2.1 time: 0.268973 Oct 29 03:22:46.769255 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2836/5446] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:46 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 1449 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:46.775548 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-03e244cf-ba8a-407c-a38f-cc5fe6cd8c6b req-4bf2fba3-5fa8-40ce-9409-d5d404ecf4a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31815e5e-cc50-4f59-950f-ca62e30e9e6d", "name": "network-vif-unplugged", "status": "completed", "tag": "3e99d247-4408-432a-bb8c-076c7841fa59"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:22:46.794533 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-03e244cf-ba8a-407c-a38f-cc5fe6cd8c6b req-4bf2fba3-5fa8-40ce-9409-d5d404ecf4a8 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:46.811299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-03e244cf-ba8a-407c-a38f-cc5fe6cd8c6b req-4bf2fba3-5fa8-40ce-9409-d5d404ecf4a8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:46.811876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-03e244cf-ba8a-407c-a38f-cc5fe6cd8c6b req-4bf2fba3-5fa8-40ce-9409-d5d404ecf4a8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:46.826391 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.compute.server_external_events [req-03e244cf-ba8a-407c-a38f-cc5fe6cd8c6b req-4bf2fba3-5fa8-40ce-9409-d5d404ecf4a8 service nova] Unable to find a host for instance 31815e5e-cc50-4f59-950f-ca62e30e9e6d. Dropping event network-vif-unplugged {{(pid=127124) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 29 03:22:46.827566 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-03e244cf-ba8a-407c-a38f-cc5fe6cd8c6b req-4bf2fba3-5fa8-40ce-9409-d5d404ecf4a8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.057025 Oct 29 03:22:46.828351 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2837/5447] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 58 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 29 03:22:46.837228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-33c3bd3c-d343-42db-a53c-66ae0f058e2d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:46.837888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-33c3bd3c-d343-42db-a53c-66ae0f058e2d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:46.846884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33c3bd3c-d343-42db-a53c-66ae0f058e2d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:46.847492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33c3bd3c-d343-42db-a53c-66ae0f058e2d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:46.847929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33c3bd3c-d343-42db-a53c-66ae0f058e2d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:46.848673 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33c3bd3c-d343-42db-a53c-66ae0f058e2d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:46.849287 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33c3bd3c-d343-42db-a53c-66ae0f058e2d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:46.850016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-33c3bd3c-d343-42db-a53c-66ae0f058e2d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:47.126731 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-33c3bd3c-d343-42db-a53c-66ae0f058e2d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:47.159539 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-33c3bd3c-d343-42db-a53c-66ae0f058e2d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.326367 Oct 29 03:22:47.160568 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2838/5448] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:46 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:47.192382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4f8aac05-f14c-41be-a9ca-14bbb02ca74b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:47.193033 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4f8aac05-f14c-41be-a9ca-14bbb02ca74b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:47.202655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f8aac05-f14c-41be-a9ca-14bbb02ca74b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:47.203574 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f8aac05-f14c-41be-a9ca-14bbb02ca74b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:47.204450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f8aac05-f14c-41be-a9ca-14bbb02ca74b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:47.205502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f8aac05-f14c-41be-a9ca-14bbb02ca74b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:47.206165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f8aac05-f14c-41be-a9ca-14bbb02ca74b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:47.206849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f8aac05-f14c-41be-a9ca-14bbb02ca74b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:47.546455 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-77d4c5aa-13e6-42ba-80cf-603df98273ea tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:47.554532 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-77d4c5aa-13e6-42ba-80cf-603df98273ea tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1391 microversion: 2.1 time: 0.987710 Oct 29 03:22:47.574464 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2611/5449] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:46 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1391 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:22:47.587811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-792a0bed-57ef-43a9-b3aa-c04742f173d2 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:47.589055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-792a0bed-57ef-43a9-b3aa-c04742f173d2 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 7bb1a735-8673-475d-8092-c67222d3415d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:47.603136 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-792a0bed-57ef-43a9-b3aa-c04742f173d2 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:47.603876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-792a0bed-57ef-43a9-b3aa-c04742f173d2 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:47.604467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-792a0bed-57ef-43a9-b3aa-c04742f173d2 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:47.605375 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-792a0bed-57ef-43a9-b3aa-c04742f173d2 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:47.606772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-792a0bed-57ef-43a9-b3aa-c04742f173d2 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:47.607929 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-792a0bed-57ef-43a9-b3aa-c04742f173d2 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:47.905949 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4f8aac05-f14c-41be-a9ca-14bbb02ca74b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:47.918373 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4f8aac05-f14c-41be-a9ca-14bbb02ca74b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.729844 Oct 29 03:22:47.919955 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2839/5450] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:47 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:22:47.944297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e74583cb-e4fd-4903-8bec-6c5963725298 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:47.950288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e74583cb-e4fd-4903-8bec-6c5963725298 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:47.966965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e74583cb-e4fd-4903-8bec-6c5963725298 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:47.967466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e74583cb-e4fd-4903-8bec-6c5963725298 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:47.967906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e74583cb-e4fd-4903-8bec-6c5963725298 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:47.968646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e74583cb-e4fd-4903-8bec-6c5963725298 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:47.969108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e74583cb-e4fd-4903-8bec-6c5963725298 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:47.969589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e74583cb-e4fd-4903-8bec-6c5963725298 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:47.990751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-792a0bed-57ef-43a9-b3aa-c04742f173d2 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:48.007147 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-792a0bed-57ef-43a9-b3aa-c04742f173d2 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d" status: 200 len: 1375 microversion: 2.1 time: 0.430271 Oct 29 03:22:48.007934 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2612/5451] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:47 2022] GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d => generated 1375 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:48.583832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1c818978-9d46-4ccb-9a72-5022c98005a1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:48.584499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1c818978-9d46-4ccb-9a72-5022c98005a1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:48.599595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c818978-9d46-4ccb-9a72-5022c98005a1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:48.600082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c818978-9d46-4ccb-9a72-5022c98005a1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:48.606182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c818978-9d46-4ccb-9a72-5022c98005a1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:48.610426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c818978-9d46-4ccb-9a72-5022c98005a1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:48.611089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c818978-9d46-4ccb-9a72-5022c98005a1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:48.613019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c818978-9d46-4ccb-9a72-5022c98005a1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:48.634438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e74583cb-e4fd-4903-8bec-6c5963725298 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:48.648568 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e74583cb-e4fd-4903-8bec-6c5963725298 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.708024 Oct 29 03:22:48.671323 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2840/5452] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:47 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:22:48.678979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-efcc67f4-1bdc-42c3-b720-0248659c0201 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:48.688689 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-efcc67f4-1bdc-42c3-b720-0248659c0201 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:48.711656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-efcc67f4-1bdc-42c3-b720-0248659c0201 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:48.712271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-efcc67f4-1bdc-42c3-b720-0248659c0201 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:48.712750 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-efcc67f4-1bdc-42c3-b720-0248659c0201 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:48.713475 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-efcc67f4-1bdc-42c3-b720-0248659c0201 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:48.713937 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-efcc67f4-1bdc-42c3-b720-0248659c0201 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:48.717389 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-efcc67f4-1bdc-42c3-b720-0248659c0201 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:48.906362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-efcc67f4-1bdc-42c3-b720-0248659c0201 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:48.918294 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-efcc67f4-1bdc-42c3-b720-0248659c0201 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.245058 Oct 29 03:22:48.919050 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2841/5453] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:48 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:48.942085 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2cda38f8-b9a7-4dad-ad31-5e81ab057556 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:22:48.962388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2cda38f8-b9a7-4dad-ad31-5e81ab057556 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:48.962897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2cda38f8-b9a7-4dad-ad31-5e81ab057556 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:48.963340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2cda38f8-b9a7-4dad-ad31-5e81ab057556 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:49.022685 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2cda38f8-b9a7-4dad-ad31-5e81ab057556 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Going to try to stop instance {{(pid=127124) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 03:22:49.127705 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2cda38f8-b9a7-4dad-ad31-5e81ab057556 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action" status: 202 len: 0 microversion: 2.1 time: 0.189437 Oct 29 03:22:49.133124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1c818978-9d46-4ccb-9a72-5022c98005a1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:49.140779 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2842/5454] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:22:48 2022] POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:22:49.150458 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1c818978-9d46-4ccb-9a72-5022c98005a1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1391 microversion: 2.1 time: 0.571170 Oct 29 03:22:49.157122 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2613/5455] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:48 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1391 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:22:49.161087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3dc0e2a0-aff9-43fc-b5df-982150f3d249 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:49.167757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3dc0e2a0-aff9-43fc-b5df-982150f3d249 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 7bb1a735-8673-475d-8092-c67222d3415d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:49.178595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-759ff229-b8ed-4d21-b369-ecc0776fda22 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:49.179673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-759ff229-b8ed-4d21-b369-ecc0776fda22 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:49.185678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3dc0e2a0-aff9-43fc-b5df-982150f3d249 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:49.186121 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3dc0e2a0-aff9-43fc-b5df-982150f3d249 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:49.186710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3dc0e2a0-aff9-43fc-b5df-982150f3d249 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:49.187751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3dc0e2a0-aff9-43fc-b5df-982150f3d249 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:49.188472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3dc0e2a0-aff9-43fc-b5df-982150f3d249 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:49.189276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3dc0e2a0-aff9-43fc-b5df-982150f3d249 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:49.194918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-759ff229-b8ed-4d21-b369-ecc0776fda22 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:49.196679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-759ff229-b8ed-4d21-b369-ecc0776fda22 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:49.198167 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-759ff229-b8ed-4d21-b369-ecc0776fda22 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:49.200655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-759ff229-b8ed-4d21-b369-ecc0776fda22 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:49.201354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-759ff229-b8ed-4d21-b369-ecc0776fda22 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:49.201963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-759ff229-b8ed-4d21-b369-ecc0776fda22 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:49.453985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:49.568593 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3dc0e2a0-aff9-43fc-b5df-982150f3d249 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:49.579951 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3dc0e2a0-aff9-43fc-b5df-982150f3d249 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d" status: 200 len: 1375 microversion: 2.1 time: 0.437504 Oct 29 03:22:49.592113 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2843/5456] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:49 2022] GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d => generated 1375 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:49.592113 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-a2ed1730-f888-4ecf-90a8-2c0edd7086bc req-25902601-0872-4391-b673-c13d29af47d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c079f7ae-3459-468a-a699-b54f5df31e41", "tag": "48355ce5-2082-4f79-98bc-fdccde7f4f8f"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:22:49.612151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a2ed1730-f888-4ecf-90a8-2c0edd7086bc req-25902601-0872-4391-b673-c13d29af47d8 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:49.612671 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a2ed1730-f888-4ecf-90a8-2c0edd7086bc req-25902601-0872-4391-b673-c13d29af47d8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:49.613106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a2ed1730-f888-4ecf-90a8-2c0edd7086bc req-25902601-0872-4391-b673-c13d29af47d8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:49.645765 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-a2ed1730-f888-4ecf-90a8-2c0edd7086bc req-25902601-0872-4391-b673-c13d29af47d8 service nova] Creating event network-changed:48355ce5-2082-4f79-98bc-fdccde7f4f8f for instance c079f7ae-3459-468a-a699-b54f5df31e41 on n-h1-862967-2 Oct 29 03:22:49.654109 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-a2ed1730-f888-4ecf-90a8-2c0edd7086bc req-25902601-0872-4391-b673-c13d29af47d8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070296 Oct 29 03:22:49.658042 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2844/5457] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:22:49.755390 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-759ff229-b8ed-4d21-b369-ecc0776fda22 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:49.773575 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-759ff229-b8ed-4d21-b369-ecc0776fda22 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1680 microversion: 2.1 time: 0.614440 Oct 29 03:22:49.774775 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2614/5458] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:49 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1680 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:49.936138 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-0a4fa0d2-88dc-4294-98ed-3f0caa2d28ce req-94f96a81-4307-409c-b23c-fc5ad1a02163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb1a735-8673-475d-8092-c67222d3415d", "name": "network-vif-plugged", "status": "completed", "tag": "8c2f6d11-aace-4074-9601-98ac0d56eb39"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:22:49.954904 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-0a4fa0d2-88dc-4294-98ed-3f0caa2d28ce req-94f96a81-4307-409c-b23c-fc5ad1a02163 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:49.955705 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-0a4fa0d2-88dc-4294-98ed-3f0caa2d28ce req-94f96a81-4307-409c-b23c-fc5ad1a02163 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:49.957097 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-0a4fa0d2-88dc-4294-98ed-3f0caa2d28ce req-94f96a81-4307-409c-b23c-fc5ad1a02163 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:49.982065 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-0a4fa0d2-88dc-4294-98ed-3f0caa2d28ce req-94f96a81-4307-409c-b23c-fc5ad1a02163 service nova] Creating event network-vif-plugged:8c2f6d11-aace-4074-9601-98ac0d56eb39 for instance 7bb1a735-8673-475d-8092-c67222d3415d on n-h1-862967-2 Oct 29 03:22:49.995577 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-0a4fa0d2-88dc-4294-98ed-3f0caa2d28ce req-94f96a81-4307-409c-b23c-fc5ad1a02163 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063539 Oct 29 03:22:49.998009 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2845/5459] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:22:50.183433 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ad6672ad-f7c9-4d59-97fa-0599d419b537 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:50.184742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ad6672ad-f7c9-4d59-97fa-0599d419b537 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:50.200665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad6672ad-f7c9-4d59-97fa-0599d419b537 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:50.202102 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad6672ad-f7c9-4d59-97fa-0599d419b537 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:50.203824 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad6672ad-f7c9-4d59-97fa-0599d419b537 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:50.205092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad6672ad-f7c9-4d59-97fa-0599d419b537 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:50.209026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad6672ad-f7c9-4d59-97fa-0599d419b537 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:50.209581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad6672ad-f7c9-4d59-97fa-0599d419b537 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:50.609452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dfd9ec8d-5476-4963-9541-3612780384af tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:50.610353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dfd9ec8d-5476-4963-9541-3612780384af tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 7bb1a735-8673-475d-8092-c67222d3415d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:50.631796 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=18 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:50.640274 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfd9ec8d-5476-4963-9541-3612780384af tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:50.640855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfd9ec8d-5476-4963-9541-3612780384af tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:50.644592 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfd9ec8d-5476-4963-9541-3612780384af tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:50.659726 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfd9ec8d-5476-4963-9541-3612780384af tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:50.660402 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfd9ec8d-5476-4963-9541-3612780384af tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:50.665913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dfd9ec8d-5476-4963-9541-3612780384af tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:50.681943 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ad6672ad-f7c9-4d59-97fa-0599d419b537 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:50.691065 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ad6672ad-f7c9-4d59-97fa-0599d419b537 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1391 microversion: 2.1 time: 0.514181 Oct 29 03:22:50.697388 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2615/5460] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:50 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1391 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:50.726806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:50.802419 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-41e11e27-483e-49cd-b510-1ba7b5e1a0d1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:50.803041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-41e11e27-483e-49cd-b510-1ba7b5e1a0d1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:50.811319 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41e11e27-483e-49cd-b510-1ba7b5e1a0d1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:50.811830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41e11e27-483e-49cd-b510-1ba7b5e1a0d1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:50.812270 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41e11e27-483e-49cd-b510-1ba7b5e1a0d1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:50.813024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41e11e27-483e-49cd-b510-1ba7b5e1a0d1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:50.813561 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41e11e27-483e-49cd-b510-1ba7b5e1a0d1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:50.813996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41e11e27-483e-49cd-b510-1ba7b5e1a0d1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:51.004823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dfd9ec8d-5476-4963-9541-3612780384af tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:51.015087 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dfd9ec8d-5476-4963-9541-3612780384af tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d" status: 200 len: 1375 microversion: 2.1 time: 0.410976 Oct 29 03:22:51.020811 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2846/5461] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:50 2022] GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d => generated 1375 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:51.126981 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-41e11e27-483e-49cd-b510-1ba7b5e1a0d1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:51.141373 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-41e11e27-483e-49cd-b510-1ba7b5e1a0d1 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1680 microversion: 2.1 time: 0.343098 Oct 29 03:22:51.142163 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2616/5462] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:50 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1680 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:51.722664 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-72539fef-66ca-4a55-a8b7-fd5aa6333a81 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:51.723286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-72539fef-66ca-4a55-a8b7-fd5aa6333a81 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:51.732073 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72539fef-66ca-4a55-a8b7-fd5aa6333a81 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:51.732577 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72539fef-66ca-4a55-a8b7-fd5aa6333a81 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:51.733011 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72539fef-66ca-4a55-a8b7-fd5aa6333a81 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:51.733709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72539fef-66ca-4a55-a8b7-fd5aa6333a81 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:51.734157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72539fef-66ca-4a55-a8b7-fd5aa6333a81 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:51.734574 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72539fef-66ca-4a55-a8b7-fd5aa6333a81 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:52.002388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-72539fef-66ca-4a55-a8b7-fd5aa6333a81 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:52.013270 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-72539fef-66ca-4a55-a8b7-fd5aa6333a81 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1391 microversion: 2.1 time: 0.294226 Oct 29 03:22:52.014890 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2847/5463] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:51 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1391 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:52.045707 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c752848e-df83-4e5b-a022-ff0dc3084cea tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:52.047128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c752848e-df83-4e5b-a022-ff0dc3084cea tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 7bb1a735-8673-475d-8092-c67222d3415d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:52.049270 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:52.064359 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c752848e-df83-4e5b-a022-ff0dc3084cea tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:52.065064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c752848e-df83-4e5b-a022-ff0dc3084cea tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:52.065692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c752848e-df83-4e5b-a022-ff0dc3084cea tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:52.066646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c752848e-df83-4e5b-a022-ff0dc3084cea tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:52.067259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c752848e-df83-4e5b-a022-ff0dc3084cea tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:52.067857 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c752848e-df83-4e5b-a022-ff0dc3084cea tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:52.104956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:52.169095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7dc5db79-6ba5-4c13-ba08-48e9a01145a0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:52.169707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7dc5db79-6ba5-4c13-ba08-48e9a01145a0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:52.190408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7dc5db79-6ba5-4c13-ba08-48e9a01145a0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:52.191200 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7dc5db79-6ba5-4c13-ba08-48e9a01145a0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:52.191658 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7dc5db79-6ba5-4c13-ba08-48e9a01145a0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:52.192601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7dc5db79-6ba5-4c13-ba08-48e9a01145a0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:52.195178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7dc5db79-6ba5-4c13-ba08-48e9a01145a0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:52.195815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7dc5db79-6ba5-4c13-ba08-48e9a01145a0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:52.484115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c752848e-df83-4e5b-a022-ff0dc3084cea tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:52.501475 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c752848e-df83-4e5b-a022-ff0dc3084cea tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d" status: 200 len: 1375 microversion: 2.1 time: 0.459589 Oct 29 03:22:52.518488 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2617/5464] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:52 2022] GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d => generated 1375 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:52.549027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7dc5db79-6ba5-4c13-ba08-48e9a01145a0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:52.557175 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7dc5db79-6ba5-4c13-ba08-48e9a01145a0 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1680 microversion: 2.1 time: 0.391829 Oct 29 03:22:52.563225 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2848/5465] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:52 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1680 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:53.038749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-abfdbef6-55e3-47d5-bc8e-af487d6034c6 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:53.039350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-abfdbef6-55e3-47d5-bc8e-af487d6034c6 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:53.051968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-abfdbef6-55e3-47d5-bc8e-af487d6034c6 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:53.052669 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-abfdbef6-55e3-47d5-bc8e-af487d6034c6 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:53.054236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-abfdbef6-55e3-47d5-bc8e-af487d6034c6 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:53.055174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-abfdbef6-55e3-47d5-bc8e-af487d6034c6 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:53.057050 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-abfdbef6-55e3-47d5-bc8e-af487d6034c6 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:53.057729 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-abfdbef6-55e3-47d5-bc8e-af487d6034c6 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:53.308325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-abfdbef6-55e3-47d5-bc8e-af487d6034c6 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:53.316594 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-abfdbef6-55e3-47d5-bc8e-af487d6034c6 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1391 microversion: 2.1 time: 0.281849 Oct 29 03:22:53.323496 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2618/5466] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:53 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1391 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:22:53.528795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fb7baf2a-4f5e-43fd-9e90-1459230c9306 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:53.530391 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fb7baf2a-4f5e-43fd-9e90-1459230c9306 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 7bb1a735-8673-475d-8092-c67222d3415d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:53.539354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fb7baf2a-4f5e-43fd-9e90-1459230c9306 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:53.540427 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fb7baf2a-4f5e-43fd-9e90-1459230c9306 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:53.541103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fb7baf2a-4f5e-43fd-9e90-1459230c9306 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:53.542011 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fb7baf2a-4f5e-43fd-9e90-1459230c9306 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:53.542659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fb7baf2a-4f5e-43fd-9e90-1459230c9306 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:53.543276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fb7baf2a-4f5e-43fd-9e90-1459230c9306 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:53.589065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f4ab692f-3702-4e9c-9603-5ec432fd85b6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:53.590150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f4ab692f-3702-4e9c-9603-5ec432fd85b6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:53.598135 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4ab692f-3702-4e9c-9603-5ec432fd85b6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:53.599495 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4ab692f-3702-4e9c-9603-5ec432fd85b6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:53.600192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4ab692f-3702-4e9c-9603-5ec432fd85b6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:53.601311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4ab692f-3702-4e9c-9603-5ec432fd85b6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:53.601966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4ab692f-3702-4e9c-9603-5ec432fd85b6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:53.602682 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4ab692f-3702-4e9c-9603-5ec432fd85b6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:54.171734 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f4ab692f-3702-4e9c-9603-5ec432fd85b6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:54.171734 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f4ab692f-3702-4e9c-9603-5ec432fd85b6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1680 microversion: 2.1 time: 0.499243 Oct 29 03:22:54.171734 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2619/5467] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:53 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1680 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:22:54.347363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a346ec5b-1d6a-4764-982a-f567b222a149 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:54.347902 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a346ec5b-1d6a-4764-982a-f567b222a149 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:54.358919 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a346ec5b-1d6a-4764-982a-f567b222a149 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:54.359394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fb7baf2a-4f5e-43fd-9e90-1459230c9306 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:54.359551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a346ec5b-1d6a-4764-982a-f567b222a149 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:54.359851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a346ec5b-1d6a-4764-982a-f567b222a149 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:54.360593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a346ec5b-1d6a-4764-982a-f567b222a149 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:54.361046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a346ec5b-1d6a-4764-982a-f567b222a149 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:54.361472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a346ec5b-1d6a-4764-982a-f567b222a149 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:54.377137 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fb7baf2a-4f5e-43fd-9e90-1459230c9306 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d" status: 200 len: 1547 microversion: 2.1 time: 0.849842 Oct 29 03:22:54.379070 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2849/5468] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:53 2022] GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d => generated 1547 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:54.411114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cf8a7719-2cd2-4c38-889f-2ba57116af7f tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:54.412797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cf8a7719-2cd2-4c38-889f-2ba57116af7f tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 7bb1a735-8673-475d-8092-c67222d3415d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:54.430163 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf8a7719-2cd2-4c38-889f-2ba57116af7f tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:54.431492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf8a7719-2cd2-4c38-889f-2ba57116af7f tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:54.437693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf8a7719-2cd2-4c38-889f-2ba57116af7f tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:54.440573 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf8a7719-2cd2-4c38-889f-2ba57116af7f tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:54.455446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf8a7719-2cd2-4c38-889f-2ba57116af7f tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:54.455905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf8a7719-2cd2-4c38-889f-2ba57116af7f tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:54.803297 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a346ec5b-1d6a-4764-982a-f567b222a149 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:54.814922 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a346ec5b-1d6a-4764-982a-f567b222a149 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1391 microversion: 2.1 time: 0.470488 Oct 29 03:22:54.816113 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2620/5469] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:54 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1391 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:54.941661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cf8a7719-2cd2-4c38-889f-2ba57116af7f tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:54.953318 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cf8a7719-2cd2-4c38-889f-2ba57116af7f tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d" status: 200 len: 1547 microversion: 2.1 time: 0.548644 Oct 29 03:22:54.956867 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2850/5470] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:54 2022] GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d => generated 1547 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:22:55.126623 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5e39df8b-ee3a-4194-9be8-987afa3a337d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:55.127275 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5e39df8b-ee3a-4194-9be8-987afa3a337d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:55.145544 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e39df8b-ee3a-4194-9be8-987afa3a337d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:55.149612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e39df8b-ee3a-4194-9be8-987afa3a337d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:55.153389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e39df8b-ee3a-4194-9be8-987afa3a337d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:55.156737 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e39df8b-ee3a-4194-9be8-987afa3a337d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:55.158773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e39df8b-ee3a-4194-9be8-987afa3a337d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:55.159330 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e39df8b-ee3a-4194-9be8-987afa3a337d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:55.602528 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5e39df8b-ee3a-4194-9be8-987afa3a337d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:55.629584 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5e39df8b-ee3a-4194-9be8-987afa3a337d tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1680 microversion: 2.1 time: 0.518315 Oct 29 03:22:55.648560 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2621/5471] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:55 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1680 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:55.853628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b4db1e79-255d-47b7-bdc3-031659eb7d6e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:55.854263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b4db1e79-255d-47b7-bdc3-031659eb7d6e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:55.891633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4db1e79-255d-47b7-bdc3-031659eb7d6e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:55.892512 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4db1e79-255d-47b7-bdc3-031659eb7d6e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:55.893325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4db1e79-255d-47b7-bdc3-031659eb7d6e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:55.896777 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4db1e79-255d-47b7-bdc3-031659eb7d6e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:55.909434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4db1e79-255d-47b7-bdc3-031659eb7d6e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:55.910385 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4db1e79-255d-47b7-bdc3-031659eb7d6e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:56.278816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b4db1e79-255d-47b7-bdc3-031659eb7d6e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:56.287402 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b4db1e79-255d-47b7-bdc3-031659eb7d6e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1391 microversion: 2.1 time: 0.440871 Oct 29 03:22:56.295565 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2851/5472] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:55 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1391 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:56.623743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-61c1f6e2-4c7a-48e3-ae2a-530e7c13ceca req-af3ca2ce-7494-439b-be6b-ebd5dc03f011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c079f7ae-3459-468a-a699-b54f5df31e41", "name": "network-vif-plugged", "status": "completed", "tag": "48355ce5-2082-4f79-98bc-fdccde7f4f8f"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:22:56.659222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-29d89821-a1cc-467b-9363-0f5378ddcf83 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:56.660627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-29d89821-a1cc-467b-9363-0f5378ddcf83 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:56.666066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-61c1f6e2-4c7a-48e3-ae2a-530e7c13ceca req-af3ca2ce-7494-439b-be6b-ebd5dc03f011 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:56.669563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-29d89821-a1cc-467b-9363-0f5378ddcf83 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:56.670840 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-61c1f6e2-4c7a-48e3-ae2a-530e7c13ceca req-af3ca2ce-7494-439b-be6b-ebd5dc03f011 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:56.671630 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-29d89821-a1cc-467b-9363-0f5378ddcf83 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:56.672227 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-61c1f6e2-4c7a-48e3-ae2a-530e7c13ceca req-af3ca2ce-7494-439b-be6b-ebd5dc03f011 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:56.672889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-29d89821-a1cc-467b-9363-0f5378ddcf83 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:56.678038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-29d89821-a1cc-467b-9363-0f5378ddcf83 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:56.681084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-29d89821-a1cc-467b-9363-0f5378ddcf83 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:56.681699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-29d89821-a1cc-467b-9363-0f5378ddcf83 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:56.713471 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-61c1f6e2-4c7a-48e3-ae2a-530e7c13ceca req-af3ca2ce-7494-439b-be6b-ebd5dc03f011 service nova] Creating event network-vif-plugged:48355ce5-2082-4f79-98bc-fdccde7f4f8f for instance c079f7ae-3459-468a-a699-b54f5df31e41 on n-h1-862967-2 Oct 29 03:22:56.730813 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-61c1f6e2-4c7a-48e3-ae2a-530e7c13ceca req-af3ca2ce-7494-439b-be6b-ebd5dc03f011 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121051 Oct 29 03:22:56.731950 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2622/5473] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:22:57.184430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-29d89821-a1cc-467b-9363-0f5378ddcf83 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:57.201282 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-29d89821-a1cc-467b-9363-0f5378ddcf83 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1680 microversion: 2.1 time: 0.546127 Oct 29 03:22:57.202030 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2852/5474] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:56 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1680 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:22:57.317386 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d35d3c8d-985a-42a5-a64b-b6e154a0fa09 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:57.318472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d35d3c8d-985a-42a5-a64b-b6e154a0fa09 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:57.332768 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d35d3c8d-985a-42a5-a64b-b6e154a0fa09 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:57.337314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d35d3c8d-985a-42a5-a64b-b6e154a0fa09 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:57.338060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d35d3c8d-985a-42a5-a64b-b6e154a0fa09 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:57.339163 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d35d3c8d-985a-42a5-a64b-b6e154a0fa09 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:57.339880 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d35d3c8d-985a-42a5-a64b-b6e154a0fa09 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:57.340553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d35d3c8d-985a-42a5-a64b-b6e154a0fa09 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:58.231953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8fcf29c7-4505-4f52-9e35-185d99734bbc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:58.233316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8fcf29c7-4505-4f52-9e35-185d99734bbc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:58.244983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fcf29c7-4505-4f52-9e35-185d99734bbc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:58.245475 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fcf29c7-4505-4f52-9e35-185d99734bbc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:58.245864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fcf29c7-4505-4f52-9e35-185d99734bbc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:58.252253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fcf29c7-4505-4f52-9e35-185d99734bbc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:58.253893 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fcf29c7-4505-4f52-9e35-185d99734bbc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:58.256359 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fcf29c7-4505-4f52-9e35-185d99734bbc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:58.277383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d35d3c8d-985a-42a5-a64b-b6e154a0fa09 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:58.322058 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d35d3c8d-985a-42a5-a64b-b6e154a0fa09 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1391 microversion: 2.1 time: 1.008809 Oct 29 03:22:58.327846 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2623/5475] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:57 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1391 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:58.680648 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8fcf29c7-4505-4f52-9e35-185d99734bbc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:22:58.699004 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8fcf29c7-4505-4f52-9e35-185d99734bbc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1680 microversion: 2.1 time: 0.471925 Oct 29 03:22:58.699761 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2853/5476] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:58 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1680 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:22:59.368651 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-711a7de7-c309-4c9e-89e9-7d2ace12acce tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:59.370109 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-711a7de7-c309-4c9e-89e9-7d2ace12acce tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:59.387426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-711a7de7-c309-4c9e-89e9-7d2ace12acce tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:59.388402 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-711a7de7-c309-4c9e-89e9-7d2ace12acce tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:59.388713 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-711a7de7-c309-4c9e-89e9-7d2ace12acce tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:59.389634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-711a7de7-c309-4c9e-89e9-7d2ace12acce tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:59.390266 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-711a7de7-c309-4c9e-89e9-7d2ace12acce tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:59.390838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-711a7de7-c309-4c9e-89e9-7d2ace12acce tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:59.742087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-092b20d3-d3cf-48a0-ad56-e46a5d94e5c7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:22:59.750081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-092b20d3-d3cf-48a0-ad56-e46a5d94e5c7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:22:59.770001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-092b20d3-d3cf-48a0-ad56-e46a5d94e5c7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:59.777312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-092b20d3-d3cf-48a0-ad56-e46a5d94e5c7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:59.778333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-092b20d3-d3cf-48a0-ad56-e46a5d94e5c7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:22:59.780152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-092b20d3-d3cf-48a0-ad56-e46a5d94e5c7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:22:59.780659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-092b20d3-d3cf-48a0-ad56-e46a5d94e5c7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:22:59.781074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-092b20d3-d3cf-48a0-ad56-e46a5d94e5c7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:00.185109 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-711a7de7-c309-4c9e-89e9-7d2ace12acce tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:00.208449 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-711a7de7-c309-4c9e-89e9-7d2ace12acce tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1562 microversion: 2.1 time: 0.849895 Oct 29 03:23:00.209497 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2624/5477] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:59 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1562 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:00.251669 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1d52595a-b330-41bf-a8e7-b151759a7330 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:00.253314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1d52595a-b330-41bf-a8e7-b151759a7330 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:00.269159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d52595a-b330-41bf-a8e7-b151759a7330 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:00.272192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d52595a-b330-41bf-a8e7-b151759a7330 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:00.273108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d52595a-b330-41bf-a8e7-b151759a7330 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:00.277788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d52595a-b330-41bf-a8e7-b151759a7330 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:00.278283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d52595a-b330-41bf-a8e7-b151759a7330 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:00.278727 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d52595a-b330-41bf-a8e7-b151759a7330 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:00.426195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-092b20d3-d3cf-48a0-ad56-e46a5d94e5c7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:00.445741 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-092b20d3-d3cf-48a0-ad56-e46a5d94e5c7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1657 microversion: 2.1 time: 0.725406 Oct 29 03:23:00.447135 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2854/5478] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:22:59 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1657 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:00.452244 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-e06d0b42-a3ec-4730-8e98-8bf5425e32e0 req-5522f77e-2bc1-4f7a-a047-813bf5341fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bb1a735-8673-475d-8092-c67222d3415d", "tag": "8c2f6d11-aace-4074-9601-98ac0d56eb39"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:23:00.476132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e06d0b42-a3ec-4730-8e98-8bf5425e32e0 req-5522f77e-2bc1-4f7a-a047-813bf5341fa1 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:00.476864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e06d0b42-a3ec-4730-8e98-8bf5425e32e0 req-5522f77e-2bc1-4f7a-a047-813bf5341fa1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:00.477434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e06d0b42-a3ec-4730-8e98-8bf5425e32e0 req-5522f77e-2bc1-4f7a-a047-813bf5341fa1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:00.523131 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-e06d0b42-a3ec-4730-8e98-8bf5425e32e0 req-5522f77e-2bc1-4f7a-a047-813bf5341fa1 service nova] Creating event network-changed:8c2f6d11-aace-4074-9601-98ac0d56eb39 for instance 7bb1a735-8673-475d-8092-c67222d3415d on n-h1-862967-2 Oct 29 03:23:00.546756 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-e06d0b42-a3ec-4730-8e98-8bf5425e32e0 req-5522f77e-2bc1-4f7a-a047-813bf5341fa1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097992 Oct 29 03:23:00.548872 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2855/5479] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:23:00.559425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-32e402f0-a829-4a23-aca4-c73edb5813de tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:23:00.575107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32e402f0-a829-4a23-aca4-c73edb5813de tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:00.578779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32e402f0-a829-4a23-aca4-c73edb5813de tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:00.583415 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32e402f0-a829-4a23-aca4-c73edb5813de tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:00.628398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-32e402f0-a829-4a23-aca4-c73edb5813de tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Going to try to start instance {{(pid=127124) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 29 03:23:00.764125 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-32e402f0-a829-4a23-aca4-c73edb5813de tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action" status: 202 len: 0 microversion: 2.1 time: 0.212011 Oct 29 03:23:00.777243 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2856/5480] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:23:00 2022] POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:23:00.789641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dbbb094f-c690-4ebe-b7b5-7fc40485d364 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:00.790347 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dbbb094f-c690-4ebe-b7b5-7fc40485d364 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:00.846149 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dbbb094f-c690-4ebe-b7b5-7fc40485d364 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:00.857496 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dbbb094f-c690-4ebe-b7b5-7fc40485d364 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:00.857961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dbbb094f-c690-4ebe-b7b5-7fc40485d364 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:00.858749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dbbb094f-c690-4ebe-b7b5-7fc40485d364 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:00.859210 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dbbb094f-c690-4ebe-b7b5-7fc40485d364 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:00.859629 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dbbb094f-c690-4ebe-b7b5-7fc40485d364 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:01.157103 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1d52595a-b330-41bf-a8e7-b151759a7330 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:01.167559 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1d52595a-b330-41bf-a8e7-b151759a7330 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1562 microversion: 2.1 time: 0.925433 Oct 29 03:23:01.184946 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2625/5481] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:00 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1562 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:01.333349 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dbbb094f-c690-4ebe-b7b5-7fc40485d364 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:01.357381 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dbbb094f-c690-4ebe-b7b5-7fc40485d364 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1666 microversion: 2.1 time: 0.576742 Oct 29 03:23:01.359375 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2857/5482] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:00 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1666 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:02.394650 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-43b60040-fb45-422a-9809-1abc0535a351 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:02.395267 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-43b60040-fb45-422a-9809-1abc0535a351 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:02.412910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43b60040-fb45-422a-9809-1abc0535a351 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:02.413426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43b60040-fb45-422a-9809-1abc0535a351 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:02.415411 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43b60040-fb45-422a-9809-1abc0535a351 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:02.415411 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43b60040-fb45-422a-9809-1abc0535a351 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:02.415411 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43b60040-fb45-422a-9809-1abc0535a351 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:02.415411 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43b60040-fb45-422a-9809-1abc0535a351 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:03.268569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-43b60040-fb45-422a-9809-1abc0535a351 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:03.276780 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-43b60040-fb45-422a-9809-1abc0535a351 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1666 microversion: 2.1 time: 0.886305 Oct 29 03:23:03.293038 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2626/5483] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:02 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1666 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:04.311375 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9bcc307c-9af2-4073-b8e9-689566b20c00 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:04.311375 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9bcc307c-9af2-4073-b8e9-689566b20c00 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:04.317466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9bcc307c-9af2-4073-b8e9-689566b20c00 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:04.318220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9bcc307c-9af2-4073-b8e9-689566b20c00 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:04.318718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9bcc307c-9af2-4073-b8e9-689566b20c00 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:04.319482 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9bcc307c-9af2-4073-b8e9-689566b20c00 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:04.319936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9bcc307c-9af2-4073-b8e9-689566b20c00 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:04.320361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9bcc307c-9af2-4073-b8e9-689566b20c00 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:04.680029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9bcc307c-9af2-4073-b8e9-689566b20c00 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:04.695561 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9bcc307c-9af2-4073-b8e9-689566b20c00 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.395516 Oct 29 03:23:04.697825 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2858/5484] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:04 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:04.726110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fa20ef88-f4c2-4086-9b10-f6f9523e2fd7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:04.727624 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fa20ef88-f4c2-4086-9b10-f6f9523e2fd7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:04.731041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=66 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:04.755695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa20ef88-f4c2-4086-9b10-f6f9523e2fd7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:04.757245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa20ef88-f4c2-4086-9b10-f6f9523e2fd7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:04.758393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa20ef88-f4c2-4086-9b10-f6f9523e2fd7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:04.759833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa20ef88-f4c2-4086-9b10-f6f9523e2fd7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:04.761007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa20ef88-f4c2-4086-9b10-f6f9523e2fd7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:04.774957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa20ef88-f4c2-4086-9b10-f6f9523e2fd7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:04.966142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fa20ef88-f4c2-4086-9b10-f6f9523e2fd7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:04.997774 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fa20ef88-f4c2-4086-9b10-f6f9523e2fd7 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.276847 Oct 29 03:23:05.003005 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2627/5485] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:04 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:05.033224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1c9fe68b-cc64-465a-b06e-e0ca724b4384 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:05.033773 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1c9fe68b-cc64-465a-b06e-e0ca724b4384 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:05.040735 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c9fe68b-cc64-465a-b06e-e0ca724b4384 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:05.041406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c9fe68b-cc64-465a-b06e-e0ca724b4384 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:05.042011 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c9fe68b-cc64-465a-b06e-e0ca724b4384 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:05.042865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c9fe68b-cc64-465a-b06e-e0ca724b4384 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:05.043554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c9fe68b-cc64-465a-b06e-e0ca724b4384 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:05.044152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c9fe68b-cc64-465a-b06e-e0ca724b4384 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:05.055724 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-abb2d2c4-1b71-4df3-b52f-199ad6a1218e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:05.056467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-abb2d2c4-1b71-4df3-b52f-199ad6a1218e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:05.065094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-abb2d2c4-1b71-4df3-b52f-199ad6a1218e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:05.069080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-abb2d2c4-1b71-4df3-b52f-199ad6a1218e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:05.069641 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-abb2d2c4-1b71-4df3-b52f-199ad6a1218e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:05.072954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-abb2d2c4-1b71-4df3-b52f-199ad6a1218e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:05.073567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-abb2d2c4-1b71-4df3-b52f-199ad6a1218e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:05.074174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-abb2d2c4-1b71-4df3-b52f-199ad6a1218e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:05.282070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-abb2d2c4-1b71-4df3-b52f-199ad6a1218e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:05.294955 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-abb2d2c4-1b71-4df3-b52f-199ad6a1218e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1562 microversion: 2.1 time: 0.243948 Oct 29 03:23:05.296244 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2628/5486] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:05 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1562 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:05.302279 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-32ad165a-d5be-4f6d-9b50-d34048ffae71 req-ae00f29a-562c-4a19-9384-efb1e46191ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c079f7ae-3459-468a-a699-b54f5df31e41", "tag": "48355ce5-2082-4f79-98bc-fdccde7f4f8f"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:23:05.312388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-32ad165a-d5be-4f6d-9b50-d34048ffae71 req-ae00f29a-562c-4a19-9384-efb1e46191ef service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:05.313336 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-32ad165a-d5be-4f6d-9b50-d34048ffae71 req-ae00f29a-562c-4a19-9384-efb1e46191ef service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:05.314009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-32ad165a-d5be-4f6d-9b50-d34048ffae71 req-ae00f29a-562c-4a19-9384-efb1e46191ef service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:05.328167 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-32ad165a-d5be-4f6d-9b50-d34048ffae71 req-ae00f29a-562c-4a19-9384-efb1e46191ef service nova] Creating event network-changed:48355ce5-2082-4f79-98bc-fdccde7f4f8f for instance c079f7ae-3459-468a-a699-b54f5df31e41 on n-h1-862967-2 Oct 29 03:23:05.336040 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-32ad165a-d5be-4f6d-9b50-d34048ffae71 req-ae00f29a-562c-4a19-9384-efb1e46191ef service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038045 Oct 29 03:23:05.337260 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2629/5487] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:23:05.434205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1c9fe68b-cc64-465a-b06e-e0ca724b4384 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:05.450378 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1c9fe68b-cc64-465a-b06e-e0ca724b4384 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.420617 Oct 29 03:23:05.451720 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2859/5488] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:05 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:05.477860 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3c2435e2-20bf-4adf-9b98-1b4185dd054f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:05.478732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3c2435e2-20bf-4adf-9b98-1b4185dd054f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:05.488438 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3c2435e2-20bf-4adf-9b98-1b4185dd054f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:05.489104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3c2435e2-20bf-4adf-9b98-1b4185dd054f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:05.489681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3c2435e2-20bf-4adf-9b98-1b4185dd054f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:05.490508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3c2435e2-20bf-4adf-9b98-1b4185dd054f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:05.508627 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3c2435e2-20bf-4adf-9b98-1b4185dd054f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:05.510757 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3c2435e2-20bf-4adf-9b98-1b4185dd054f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:05.786274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3c2435e2-20bf-4adf-9b98-1b4185dd054f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:05.800799 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3c2435e2-20bf-4adf-9b98-1b4185dd054f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.325141 Oct 29 03:23:05.801946 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2630/5489] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:05 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:05.825958 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-46943be8-3dce-4a48-855e-4ff5a96f1b57 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:05.827882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-46943be8-3dce-4a48-855e-4ff5a96f1b57 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:05.834959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46943be8-3dce-4a48-855e-4ff5a96f1b57 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:05.835605 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46943be8-3dce-4a48-855e-4ff5a96f1b57 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:05.836190 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46943be8-3dce-4a48-855e-4ff5a96f1b57 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:05.837166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46943be8-3dce-4a48-855e-4ff5a96f1b57 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:05.838189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46943be8-3dce-4a48-855e-4ff5a96f1b57 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:05.838765 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-46943be8-3dce-4a48-855e-4ff5a96f1b57 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:06.110475 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-46943be8-3dce-4a48-855e-4ff5a96f1b57 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:06.119809 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-46943be8-3dce-4a48-855e-4ff5a96f1b57 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.298229 Oct 29 03:23:06.120399 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2860/5490] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:05 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:06.150332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-639a7a40-af5b-4382-86be-53ec8469b4c4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:23:06.150815 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-639a7a40-af5b-4382-86be-53ec8469b4c4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:06.161832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-639a7a40-af5b-4382-86be-53ec8469b4c4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:06.162334 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-639a7a40-af5b-4382-86be-53ec8469b4c4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:06.165395 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-639a7a40-af5b-4382-86be-53ec8469b4c4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:06.166219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-639a7a40-af5b-4382-86be-53ec8469b4c4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:06.166742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-639a7a40-af5b-4382-86be-53ec8469b4c4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:06.167118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-639a7a40-af5b-4382-86be-53ec8469b4c4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:06.219598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-639a7a40-af5b-4382-86be-53ec8469b4c4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lazy-loading 'flavor' on Instance uuid 23349ce8-2588-42c9-8de7-90865b56c980 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:23:06.422695 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-639a7a40-af5b-4382-86be-53ec8469b4c4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action" status: 202 len: 0 microversion: 2.1 time: 0.251392 Oct 29 03:23:06.426347 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2631/5491] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:23:06 2022] POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:23:06.448511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1b0dca91-b97a-4fec-96ed-d8f8a4765e8b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:06.449242 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1b0dca91-b97a-4fec-96ed-d8f8a4765e8b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:06.471357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b0dca91-b97a-4fec-96ed-d8f8a4765e8b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:06.492939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b0dca91-b97a-4fec-96ed-d8f8a4765e8b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:06.496511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b0dca91-b97a-4fec-96ed-d8f8a4765e8b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:06.498212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b0dca91-b97a-4fec-96ed-d8f8a4765e8b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:06.499260 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b0dca91-b97a-4fec-96ed-d8f8a4765e8b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:06.501813 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b0dca91-b97a-4fec-96ed-d8f8a4765e8b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:06.846846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1b0dca91-b97a-4fec-96ed-d8f8a4765e8b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:06.857073 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1b0dca91-b97a-4fec-96ed-d8f8a4765e8b tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1678 microversion: 2.1 time: 0.425648 Oct 29 03:23:06.858008 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2861/5492] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:06 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1678 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:07.885331 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3a27df76-18b1-4f92-87ca-96e1259bb49a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:07.886088 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3a27df76-18b1-4f92-87ca-96e1259bb49a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:07.902023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a27df76-18b1-4f92-87ca-96e1259bb49a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:07.902752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a27df76-18b1-4f92-87ca-96e1259bb49a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:07.903677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a27df76-18b1-4f92-87ca-96e1259bb49a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:07.907071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a27df76-18b1-4f92-87ca-96e1259bb49a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:07.907545 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a27df76-18b1-4f92-87ca-96e1259bb49a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:07.907986 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a27df76-18b1-4f92-87ca-96e1259bb49a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:08.225187 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3a27df76-18b1-4f92-87ca-96e1259bb49a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:08.236247 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3a27df76-18b1-4f92-87ca-96e1259bb49a tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1661 microversion: 2.1 time: 0.358528 Oct 29 03:23:08.240033 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2632/5493] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:07 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1661 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:08.267296 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c689501d-d320-4378-9df9-51d4da205f3f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:23:08.268440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c689501d-d320-4378-9df9-51d4da205f3f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:08.280144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c689501d-d320-4378-9df9-51d4da205f3f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:08.281808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c689501d-d320-4378-9df9-51d4da205f3f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:08.282253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c689501d-d320-4378-9df9-51d4da205f3f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:08.282980 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c689501d-d320-4378-9df9-51d4da205f3f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:08.283439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c689501d-d320-4378-9df9-51d4da205f3f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:08.286039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c689501d-d320-4378-9df9-51d4da205f3f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:08.339885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:08.450387 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c689501d-d320-4378-9df9-51d4da205f3f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action" status: 202 len: 0 microversion: 2.1 time: 0.186874 Oct 29 03:23:08.451661 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2862/5494] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:23:08 2022] POST /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:23:08.466088 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d97e61ed-1f9f-4939-8bec-0fdea12894ba tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:08.472195 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d97e61ed-1f9f-4939-8bec-0fdea12894ba tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:08.492390 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d97e61ed-1f9f-4939-8bec-0fdea12894ba tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:08.493313 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d97e61ed-1f9f-4939-8bec-0fdea12894ba tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:08.493958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d97e61ed-1f9f-4939-8bec-0fdea12894ba tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:08.494906 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d97e61ed-1f9f-4939-8bec-0fdea12894ba tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:08.495365 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d97e61ed-1f9f-4939-8bec-0fdea12894ba tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:08.495948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d97e61ed-1f9f-4939-8bec-0fdea12894ba tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:08.800972 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d97e61ed-1f9f-4939-8bec-0fdea12894ba tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:08.804327 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:08.823519 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d97e61ed-1f9f-4939-8bec-0fdea12894ba tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1667 microversion: 2.1 time: 0.363420 Oct 29 03:23:08.833033 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2633/5495] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:08 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1667 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:09.851667 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6d200502-b3f9-46c0-b887-feabd64fe55c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:09.852386 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6d200502-b3f9-46c0-b887-feabd64fe55c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:09.870360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d200502-b3f9-46c0-b887-feabd64fe55c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:09.872029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d200502-b3f9-46c0-b887-feabd64fe55c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:09.873425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d200502-b3f9-46c0-b887-feabd64fe55c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:09.875791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d200502-b3f9-46c0-b887-feabd64fe55c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:09.876579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d200502-b3f9-46c0-b887-feabd64fe55c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:09.877176 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d200502-b3f9-46c0-b887-feabd64fe55c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:10.051823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6d200502-b3f9-46c0-b887-feabd64fe55c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:10.069774 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6d200502-b3f9-46c0-b887-feabd64fe55c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1667 microversion: 2.1 time: 0.223161 Oct 29 03:23:10.085088 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2863/5496] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:09 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1667 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:11.108080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b58fbcd7-99e8-4595-92db-d7d8feca0d75 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:11.111251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b58fbcd7-99e8-4595-92db-d7d8feca0d75 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:11.119199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b58fbcd7-99e8-4595-92db-d7d8feca0d75 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:11.120032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b58fbcd7-99e8-4595-92db-d7d8feca0d75 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:11.120720 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b58fbcd7-99e8-4595-92db-d7d8feca0d75 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:11.121871 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b58fbcd7-99e8-4595-92db-d7d8feca0d75 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:11.124074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b58fbcd7-99e8-4595-92db-d7d8feca0d75 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:11.124957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b58fbcd7-99e8-4595-92db-d7d8feca0d75 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:11.501799 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b58fbcd7-99e8-4595-92db-d7d8feca0d75 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:11.528127 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b58fbcd7-99e8-4595-92db-d7d8feca0d75 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.429692 Oct 29 03:23:11.528127 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2634/5497] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:11 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:11.551935 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-63c8f57a-e90f-4147-8755-a6d470e147f5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:11.552992 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-63c8f57a-e90f-4147-8755-a6d470e147f5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:11.560860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-63c8f57a-e90f-4147-8755-a6d470e147f5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:11.561974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-63c8f57a-e90f-4147-8755-a6d470e147f5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:11.562491 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-63c8f57a-e90f-4147-8755-a6d470e147f5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:11.563631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-63c8f57a-e90f-4147-8755-a6d470e147f5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:11.564282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-63c8f57a-e90f-4147-8755-a6d470e147f5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:11.564816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-63c8f57a-e90f-4147-8755-a6d470e147f5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:11.793006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-63c8f57a-e90f-4147-8755-a6d470e147f5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:11.810025 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-63c8f57a-e90f-4147-8755-a6d470e147f5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1670 microversion: 2.1 time: 0.262412 Oct 29 03:23:11.810894 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2864/5498] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:11 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1670 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:11.836089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ec4b5276-2ac2-48c1-964a-f30f26c69d05 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:11.836632 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ec4b5276-2ac2-48c1-964a-f30f26c69d05 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:11.842996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec4b5276-2ac2-48c1-964a-f30f26c69d05 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:11.843495 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec4b5276-2ac2-48c1-964a-f30f26c69d05 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:11.844175 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec4b5276-2ac2-48c1-964a-f30f26c69d05 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:11.845162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec4b5276-2ac2-48c1-964a-f30f26c69d05 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:11.846263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec4b5276-2ac2-48c1-964a-f30f26c69d05 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:11.846663 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec4b5276-2ac2-48c1-964a-f30f26c69d05 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:11.897730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ec4b5276-2ac2-48c1-964a-f30f26c69d05 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:23:11.908126 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.compute.api [None req-ec4b5276-2ac2-48c1-964a-f30f26c69d05 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Working on deleting snapshot e3755974-99b0-4671-9ec7-7a39257c7aa6 from shelved instance... Oct 29 03:23:12.896900 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ec4b5276-2ac2-48c1-964a-f30f26c69d05 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Doing local delete in cell 5270c754-82e2-4d8e-a02e-4533aa854f76(cell1) {{(pid=127125) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 29 03:23:12.898389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec4b5276-2ac2-48c1-964a-f30f26c69d05 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:12.898867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec4b5276-2ac2-48c1-964a-f30f26c69d05 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:12.899438 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec4b5276-2ac2-48c1-964a-f30f26c69d05 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:12.899924 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.compute.api [None req-ec4b5276-2ac2-48c1-964a-f30f26c69d05 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 29 03:23:12.903949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-ec4b5276-2ac2-48c1-964a-f30f26c69d05 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] deallocate_for_instance() {{(pid=127125) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 29 03:23:14.159392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-ec4b5276-2ac2-48c1-964a-f30f26c69d05 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Updating instance_info_cache with network_info: [] {{(pid=127125) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 29 03:23:14.571519 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-23cf815c-79a6-42c4-962c-13a1f6fcf04a req-9869f890-997a-456a-a5c8-0c523a5f869b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31815e5e-cc50-4f59-950f-ca62e30e9e6d", "name": "network-vif-deleted", "tag": "3e99d247-4408-432a-bb8c-076c7841fa59"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:23:14.576919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=68 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:14.605015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-23cf815c-79a6-42c4-962c-13a1f6fcf04a req-9869f890-997a-456a-a5c8-0c523a5f869b service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:14.605523 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-23cf815c-79a6-42c4-962c-13a1f6fcf04a req-9869f890-997a-456a-a5c8-0c523a5f869b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:14.609086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-23cf815c-79a6-42c4-962c-13a1f6fcf04a req-9869f890-997a-456a-a5c8-0c523a5f869b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:14.635833 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.compute.server_external_events [req-23cf815c-79a6-42c4-962c-13a1f6fcf04a req-9869f890-997a-456a-a5c8-0c523a5f869b service nova] Unable to find a host for instance 31815e5e-cc50-4f59-950f-ca62e30e9e6d. Dropping event network-vif-deleted {{(pid=127124) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 29 03:23:14.638171 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ec4b5276-2ac2-48c1-964a-f30f26c69d05 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "DELETE /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 204 len: 0 microversion: 2.1 time: 2.806027 Oct 29 03:23:14.639293 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-23cf815c-79a6-42c4-962c-13a1f6fcf04a req-9869f890-997a-456a-a5c8-0c523a5f869b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.501844 Oct 29 03:23:14.643167 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2635/5499] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:23:11 2022] DELETE /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 0 bytes in 2809 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:23:14.656810 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2865/5500] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 522 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 29 03:23:14.668175 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ea5ec0d4-aa9e-4d6b-ad17-7d017dcee7d3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:14.669019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ea5ec0d4-aa9e-4d6b-ad17-7d017dcee7d3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 31815e5e-cc50-4f59-950f-ca62e30e9e6d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:14.680267 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea5ec0d4-aa9e-4d6b-ad17-7d017dcee7d3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:14.680878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea5ec0d4-aa9e-4d6b-ad17-7d017dcee7d3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:14.681525 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea5ec0d4-aa9e-4d6b-ad17-7d017dcee7d3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:14.682442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea5ec0d4-aa9e-4d6b-ad17-7d017dcee7d3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:14.683105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea5ec0d4-aa9e-4d6b-ad17-7d017dcee7d3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:14.684958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea5ec0d4-aa9e-4d6b-ad17-7d017dcee7d3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:14.714750 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-ea5ec0d4-aa9e-4d6b-ad17-7d017dcee7d3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] HTTP exception thrown: Instance 31815e5e-cc50-4f59-950f-ca62e30e9e6d could not be found. Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ea5ec0d4-aa9e-4d6b-ad17-7d017dcee7d3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Request method failure captured: Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d HTTP/1.1 Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJrBEld31_ePW0eW7K3K43c4mjwkjjugq-rdAhOVlo7sDAu80OCKquivv6iAf8BI6lShu9ZDCXrw8POtLG6DQDhjZ3gEDkqYAv8E5X2C0u3J69FOg8yuu0dLy3EdjifUrqcpmrU9YXQ7ewUei1xDtAEB9ZAOTpvrMpo4LGrGscneUrI Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: df5fe7cedcd14b61925dc300274b3c70 Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerActionsTestJSON-426455045 Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df5fe7cedcd14b61925dc300274b3c70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df5fe7cedcd14b61925dc300274b3c70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_df5fe7cedcd14b61925dc300274b3c70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/df5fe7cedcd14b61925dc300274b3c70"}]}] Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerActionsTestJSON-426455045 Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: df5fe7cedcd14b61925dc300274b3c70 Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerActionsTestJSON-426455045 Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerActionsTestJSON-426455045-project Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: aac411c78a5648be8a1c43893d9a0798 Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerActionsTestJSON-426455045-project Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 31815e5e-cc50-4f59-950f-ca62e30e9e6d could not be found. Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '31815e5e-cc50-4f59-950f-ca62e30e9e6d'} Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31815e5e-cc50-4f59-950f-ca62e30e9e6d could not be found. Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31815e5e-cc50-4f59-950f-ca62e30e9e6d could not be found. Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:23:14.716907 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:23:14.720672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:23:14.720672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:23:14.720672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:23:14.720672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:23:14.720672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:23:14.720672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31815e5e-cc50-4f59-950f-ca62e30e9e6d could not be found. Oct 29 03:23:14.720672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:23:14.720672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ea5ec0d4-aa9e-4d6b-ad17-7d017dcee7d3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Returning 404 to user: Instance 31815e5e-cc50-4f59-950f-ca62e30e9e6d could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:23:14.721117 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ea5ec0d4-aa9e-4d6b-ad17-7d017dcee7d3 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d" status: 404 len: 111 microversion: 2.1 time: 0.076846 Oct 29 03:23:14.724742 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2636/5501] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:14 2022] GET /compute/v2.1/servers/31815e5e-cc50-4f59-950f-ca62e30e9e6d => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:23:14.730091 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-78be1467-7c3c-4321-bf07-d580e79aa0f6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:14.731077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-78be1467-7c3c-4321-bf07-d580e79aa0f6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 7b81a724-aab0-42cc-b5a6-0d732165217b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:14.738178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78be1467-7c3c-4321-bf07-d580e79aa0f6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:14.739020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78be1467-7c3c-4321-bf07-d580e79aa0f6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:14.739654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78be1467-7c3c-4321-bf07-d580e79aa0f6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:14.740855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78be1467-7c3c-4321-bf07-d580e79aa0f6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:14.741506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78be1467-7c3c-4321-bf07-d580e79aa0f6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:14.742125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78be1467-7c3c-4321-bf07-d580e79aa0f6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:14.773172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-78be1467-7c3c-4321-bf07-d580e79aa0f6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 7b81a724-aab0-42cc-b5a6-0d732165217b] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:23:14.886290 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-78be1467-7c3c-4321-bf07-d580e79aa0f6 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b" status: 204 len: 0 microversion: 2.1 time: 0.159749 Oct 29 03:23:14.891214 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2866/5502] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:23:14 2022] DELETE /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:23:14.897743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ef2d8813-8f6c-42b4-844c-4b1de9c44dc8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:14.898555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ef2d8813-8f6c-42b4-844c-4b1de9c44dc8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 7b81a724-aab0-42cc-b5a6-0d732165217b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:14.909672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef2d8813-8f6c-42b4-844c-4b1de9c44dc8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:14.913643 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef2d8813-8f6c-42b4-844c-4b1de9c44dc8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:14.914363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef2d8813-8f6c-42b4-844c-4b1de9c44dc8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:14.915767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef2d8813-8f6c-42b4-844c-4b1de9c44dc8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:14.916301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef2d8813-8f6c-42b4-844c-4b1de9c44dc8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:14.917253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ef2d8813-8f6c-42b4-844c-4b1de9c44dc8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:15.170309 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ef2d8813-8f6c-42b4-844c-4b1de9c44dc8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:15.184745 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ef2d8813-8f6c-42b4-844c-4b1de9c44dc8 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b" status: 200 len: 1465 microversion: 2.1 time: 0.292370 Oct 29 03:23:15.189504 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2637/5503] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:14 2022] GET /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b => generated 1465 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:23:16.212922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-69bfae85-ec1e-4285-bd81-f5508e69832f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:16.213931 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-69bfae85-ec1e-4285-bd81-f5508e69832f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 7b81a724-aab0-42cc-b5a6-0d732165217b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:16.231906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69bfae85-ec1e-4285-bd81-f5508e69832f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:16.240885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69bfae85-ec1e-4285-bd81-f5508e69832f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:16.241675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69bfae85-ec1e-4285-bd81-f5508e69832f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:16.242963 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69bfae85-ec1e-4285-bd81-f5508e69832f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:16.247967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69bfae85-ec1e-4285-bd81-f5508e69832f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:16.248712 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69bfae85-ec1e-4285-bd81-f5508e69832f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:16.555532 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-69bfae85-ec1e-4285-bd81-f5508e69832f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:16.569746 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-69bfae85-ec1e-4285-bd81-f5508e69832f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b" status: 200 len: 1465 microversion: 2.1 time: 0.357387 Oct 29 03:23:16.572711 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2867/5504] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:16 2022] GET /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b => generated 1465 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:17.132271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-43a65841-a87a-455d-857f-e3db796139bb req-6828556c-a670-4b58-b504-151b7da576b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b81a724-aab0-42cc-b5a6-0d732165217b", "name": "network-vif-deleted", "tag": "c15dc864-37b7-4a0c-8d64-c4ce30f10c49"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:23:17.155070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-43a65841-a87a-455d-857f-e3db796139bb req-6828556c-a670-4b58-b504-151b7da576b1 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:17.155803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-43a65841-a87a-455d-857f-e3db796139bb req-6828556c-a670-4b58-b504-151b7da576b1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:17.156396 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-43a65841-a87a-455d-857f-e3db796139bb req-6828556c-a670-4b58-b504-151b7da576b1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:17.182121 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-43a65841-a87a-455d-857f-e3db796139bb req-6828556c-a670-4b58-b504-151b7da576b1 service nova] Creating event network-vif-deleted:c15dc864-37b7-4a0c-8d64-c4ce30f10c49 for instance 7b81a724-aab0-42cc-b5a6-0d732165217b on n-h1-862967-2 Oct 29 03:23:17.188701 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-43a65841-a87a-455d-857f-e3db796139bb req-6828556c-a670-4b58-b504-151b7da576b1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059968 Oct 29 03:23:17.189263 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2638/5505] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:23:17.620958 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-60cc80b0-96d5-4e9a-b625-49975ec7c78f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:17.622597 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-60cc80b0-96d5-4e9a-b625-49975ec7c78f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 7b81a724-aab0-42cc-b5a6-0d732165217b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:17.645551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60cc80b0-96d5-4e9a-b625-49975ec7c78f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:17.646152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60cc80b0-96d5-4e9a-b625-49975ec7c78f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:17.651611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60cc80b0-96d5-4e9a-b625-49975ec7c78f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:17.652551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60cc80b0-96d5-4e9a-b625-49975ec7c78f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:17.657918 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60cc80b0-96d5-4e9a-b625-49975ec7c78f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:17.658984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60cc80b0-96d5-4e9a-b625-49975ec7c78f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:17.776801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60cc80b0-96d5-4e9a-b625-49975ec7c78f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:17.778853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60cc80b0-96d5-4e9a-b625-49975ec7c78f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:17.779336 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-60cc80b0-96d5-4e9a-b625-49975ec7c78f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:17.781049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-60cc80b0-96d5-4e9a-b625-49975ec7c78f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lazy-loading 'fault' on Instance uuid 7b81a724-aab0-42cc-b5a6-0d732165217b {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:23:17.873163 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-60cc80b0-96d5-4e9a-b625-49975ec7c78f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:17.886919 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-60cc80b0-96d5-4e9a-b625-49975ec7c78f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b" status: 200 len: 1304 microversion: 2.1 time: 0.281062 Oct 29 03:23:17.887699 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2868/5506] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:17 2022] GET /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b => generated 1304 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:23:18.418778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-22bb1d4c-f3d1-4043-8f18-f8b867c9a1b6 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:23:18.421939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-22bb1d4c-f3d1-4043-8f18-f8b867c9a1b6 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 7bb1a735-8673-475d-8092-c67222d3415d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:18.430048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22bb1d4c-f3d1-4043-8f18-f8b867c9a1b6 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:18.431334 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22bb1d4c-f3d1-4043-8f18-f8b867c9a1b6 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:18.432026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22bb1d4c-f3d1-4043-8f18-f8b867c9a1b6 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:18.433712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22bb1d4c-f3d1-4043-8f18-f8b867c9a1b6 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:18.434451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22bb1d4c-f3d1-4043-8f18-f8b867c9a1b6 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:18.435470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22bb1d4c-f3d1-4043-8f18-f8b867c9a1b6 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:18.525355 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-22bb1d4c-f3d1-4043-8f18-f8b867c9a1b6 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "POST /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d/action" status: 200 len: 24562 microversion: 2.1 time: 0.112168 Oct 29 03:23:18.526245 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2639/5507] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:23:18 2022] POST /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d/action => generated 24562 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 03:23:18.921043 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-894a6e8c-7f5d-4e9f-b635-80d193f877e4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:18.921912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-894a6e8c-7f5d-4e9f-b635-80d193f877e4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 7b81a724-aab0-42cc-b5a6-0d732165217b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:18.944641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-894a6e8c-7f5d-4e9f-b635-80d193f877e4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:18.951017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-894a6e8c-7f5d-4e9f-b635-80d193f877e4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:18.952578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-894a6e8c-7f5d-4e9f-b635-80d193f877e4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:18.953584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-894a6e8c-7f5d-4e9f-b635-80d193f877e4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:18.954215 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-894a6e8c-7f5d-4e9f-b635-80d193f877e4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:18.954795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-894a6e8c-7f5d-4e9f-b635-80d193f877e4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:18.988459 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-894a6e8c-7f5d-4e9f-b635-80d193f877e4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] HTTP exception thrown: Instance 7b81a724-aab0-42cc-b5a6-0d732165217b could not be found. Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-894a6e8c-7f5d-4e9f-b635-80d193f877e4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Request method failure captured: Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b HTTP/1.1 Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJrBEld31_ePW0eW7K3K43c4mjwkjjugq-rdAhOVlo7sDAu80OCKquivv6iAf8BI6lShu9ZDCXrw8POtLG6DQDhjZ3gEDkqYAv8E5X2C0u3J69FOg8yuu0dLy3EdjifUrqcpmrU9YXQ7ewUei1xDtAEB9ZAOTpvrMpo4LGrGscneUrI Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: df5fe7cedcd14b61925dc300274b3c70 Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServerActionsTestJSON-426455045 Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df5fe7cedcd14b61925dc300274b3c70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df5fe7cedcd14b61925dc300274b3c70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_df5fe7cedcd14b61925dc300274b3c70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/df5fe7cedcd14b61925dc300274b3c70"}]}] Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServerActionsTestJSON-426455045 Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: df5fe7cedcd14b61925dc300274b3c70 Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServerActionsTestJSON-426455045 Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServerActionsTestJSON-426455045-project Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: aac411c78a5648be8a1c43893d9a0798 Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServerActionsTestJSON-426455045-project Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 7b81a724-aab0-42cc-b5a6-0d732165217b could not be found. Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '7b81a724-aab0-42cc-b5a6-0d732165217b'} Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b81a724-aab0-42cc-b5a6-0d732165217b could not be found. Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b81a724-aab0-42cc-b5a6-0d732165217b could not be found. Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:23:18.994199 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:23:18.997898 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:23:18.997898 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:23:18.997898 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:23:18.997898 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:23:18.997898 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:23:18.997898 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b81a724-aab0-42cc-b5a6-0d732165217b could not be found. Oct 29 03:23:18.997898 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:23:18.997898 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-894a6e8c-7f5d-4e9f-b635-80d193f877e4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Returning 404 to user: Instance 7b81a724-aab0-42cc-b5a6-0d732165217b could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:23:19.000072 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-894a6e8c-7f5d-4e9f-b635-80d193f877e4 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b" status: 404 len: 111 microversion: 2.1 time: 0.084352 Oct 29 03:23:19.005208 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2869/5508] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:18 2022] GET /compute/v2.1/servers/7b81a724-aab0-42cc-b5a6-0d732165217b => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:23:19.010229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1592211f-d7d7-4410-b53d-92ea64d0868c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:19.011390 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1592211f-d7d7-4410-b53d-92ea64d0868c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:19.024338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1592211f-d7d7-4410-b53d-92ea64d0868c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:19.025174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1592211f-d7d7-4410-b53d-92ea64d0868c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:19.027556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1592211f-d7d7-4410-b53d-92ea64d0868c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:19.028468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1592211f-d7d7-4410-b53d-92ea64d0868c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:19.028953 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1592211f-d7d7-4410-b53d-92ea64d0868c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:19.029375 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1592211f-d7d7-4410-b53d-92ea64d0868c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:19.099092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1592211f-d7d7-4410-b53d-92ea64d0868c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:23:19.277040 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1592211f-d7d7-4410-b53d-92ea64d0868c tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92" status: 204 len: 0 microversion: 2.1 time: 0.271265 Oct 29 03:23:19.281339 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2640/5509] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:23:19 2022] DELETE /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:23:19.286190 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d100ab6d-9222-4b7e-b5dd-e54c9f03fa67 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:19.286920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d100ab6d-9222-4b7e-b5dd-e54c9f03fa67 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:19.313961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d100ab6d-9222-4b7e-b5dd-e54c9f03fa67 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:19.315053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d100ab6d-9222-4b7e-b5dd-e54c9f03fa67 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:19.315753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d100ab6d-9222-4b7e-b5dd-e54c9f03fa67 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:19.318999 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d100ab6d-9222-4b7e-b5dd-e54c9f03fa67 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:19.320846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d100ab6d-9222-4b7e-b5dd-e54c9f03fa67 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:19.321641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d100ab6d-9222-4b7e-b5dd-e54c9f03fa67 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:19.548971 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d100ab6d-9222-4b7e-b5dd-e54c9f03fa67 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:19.559308 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d100ab6d-9222-4b7e-b5dd-e54c9f03fa67 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92" status: 200 len: 1507 microversion: 2.1 time: 0.277255 Oct 29 03:23:19.560433 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2870/5510] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:19 2022] GET /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92 => generated 1507 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:20.583822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4a531331-22bb-4d1f-b426-22527a4265ed tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:20.585164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4a531331-22bb-4d1f-b426-22527a4265ed tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:20.603176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a531331-22bb-4d1f-b426-22527a4265ed tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:20.603899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a531331-22bb-4d1f-b426-22527a4265ed tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:20.606641 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a531331-22bb-4d1f-b426-22527a4265ed tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:20.607545 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a531331-22bb-4d1f-b426-22527a4265ed tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:20.608139 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a531331-22bb-4d1f-b426-22527a4265ed tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:20.608760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a531331-22bb-4d1f-b426-22527a4265ed tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:20.982401 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4a531331-22bb-4d1f-b426-22527a4265ed tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:20.994406 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4a531331-22bb-4d1f-b426-22527a4265ed tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92" status: 200 len: 1507 microversion: 2.1 time: 0.414682 Oct 29 03:23:21.013456 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2641/5511] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:20 2022] GET /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92 => generated 1507 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:21.693176 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-385bbc0c-cc0f-4476-9c1a-f14e2481c3b5 req-9ee94672-7d88-45fa-88aa-ec9622ee52f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92", "name": "network-vif-deleted", "tag": "4430a02f-d29d-45d9-af10-ee5e74cb9bb6"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:23:21.717327 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-385bbc0c-cc0f-4476-9c1a-f14e2481c3b5 req-9ee94672-7d88-45fa-88aa-ec9622ee52f1 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:21.724389 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-385bbc0c-cc0f-4476-9c1a-f14e2481c3b5 req-9ee94672-7d88-45fa-88aa-ec9622ee52f1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:21.725197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-385bbc0c-cc0f-4476-9c1a-f14e2481c3b5 req-9ee94672-7d88-45fa-88aa-ec9622ee52f1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:21.744373 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-385bbc0c-cc0f-4476-9c1a-f14e2481c3b5 req-9ee94672-7d88-45fa-88aa-ec9622ee52f1 service nova] Creating event network-vif-deleted:4430a02f-d29d-45d9-af10-ee5e74cb9bb6 for instance e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92 on n-h2-862967-2 Oct 29 03:23:21.758955 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-385bbc0c-cc0f-4476-9c1a-f14e2481c3b5 req-9ee94672-7d88-45fa-88aa-ec9622ee52f1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074587 Oct 29 03:23:21.761089 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2871/5512] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:23:22.027576 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9dfef8a6-2562-4e20-8743-6bf350152fdd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:22.028196 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9dfef8a6-2562-4e20-8743-6bf350152fdd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:22.061206 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9dfef8a6-2562-4e20-8743-6bf350152fdd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:22.061732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9dfef8a6-2562-4e20-8743-6bf350152fdd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:22.062167 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9dfef8a6-2562-4e20-8743-6bf350152fdd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:22.062970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9dfef8a6-2562-4e20-8743-6bf350152fdd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:22.063422 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9dfef8a6-2562-4e20-8743-6bf350152fdd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:22.063845 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9dfef8a6-2562-4e20-8743-6bf350152fdd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:22.181123 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9dfef8a6-2562-4e20-8743-6bf350152fdd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:22.181621 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9dfef8a6-2562-4e20-8743-6bf350152fdd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:22.182055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9dfef8a6-2562-4e20-8743-6bf350152fdd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:22.182513 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-9dfef8a6-2562-4e20-8743-6bf350152fdd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lazy-loading 'fault' on Instance uuid e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:23:22.270524 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9dfef8a6-2562-4e20-8743-6bf350152fdd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:22.283085 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9dfef8a6-2562-4e20-8743-6bf350152fdd tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92" status: 200 len: 1304 microversion: 2.1 time: 0.263612 Oct 29 03:23:22.286398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c55e69dd-bb5c-48f2-adc5-6cc9eed67c6b tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Action: 'create', calling method: .version_select at 0x7ff052919310>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-2132373316", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+8fgHLSFnz1WRYYJp1jAKGGIqv5sfgGSOsMQW7ZlXKOoZA35G9oN7RUuqURXtgvlrs4kdcLCkI5NYDPJmoArLWQsTlfOW5zIWmUqv4r71rzenBPUUMrkKWFRK1AtMw5w=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:23:22.294255 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2642/5513] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:22 2022] GET /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92 => generated 1304 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:22.327110 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-c55e69dd-bb5c-48f2-adc5-6cc9eed67c6b tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Getting quotas for project eab62a8a623d48dd865d5c7c96daead1. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:23:22.334824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-c55e69dd-bb5c-48f2-adc5-6cc9eed67c6b tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Getting quotas for user 4fb06badda8549e3ae02e9f6222098bc and project eab62a8a623d48dd865d5c7c96daead1. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:23:22.386020 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c55e69dd-bb5c-48f2-adc5-6cc9eed67c6b tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.105499 Oct 29 03:23:22.388275 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2872/5514] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:23:22 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:23:23.309604 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-31d00083-4c82-4671-b5a1-ca377adc48f2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:23.310774 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-31d00083-4c82-4671-b5a1-ca377adc48f2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:23.318664 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-31d00083-4c82-4671-b5a1-ca377adc48f2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:23.319413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-31d00083-4c82-4671-b5a1-ca377adc48f2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:23.320186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-31d00083-4c82-4671-b5a1-ca377adc48f2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:23.321082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-31d00083-4c82-4671-b5a1-ca377adc48f2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:23.321677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-31d00083-4c82-4671-b5a1-ca377adc48f2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:23.322241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-31d00083-4c82-4671-b5a1-ca377adc48f2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:23.337597 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-31d00083-4c82-4671-b5a1-ca377adc48f2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] HTTP exception thrown: Instance e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92 could not be found. Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-31d00083-4c82-4671-b5a1-ca377adc48f2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Request method failure captured: Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92 HTTP/1.1 Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJrBEld31_ePW0eW7K3K43c4mjwkjjugq-rdAhOVlo7sDAu80OCKquivv6iAf8BI6lShu9ZDCXrw8POtLG6DQDhjZ3gEDkqYAv8E5X2C0u3J69FOg8yuu0dLy3EdjifUrqcpmrU9YXQ7ewUei1xDtAEB9ZAOTpvrMpo4LGrGscneUrI Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: df5fe7cedcd14b61925dc300274b3c70 Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerActionsTestJSON-426455045 Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df5fe7cedcd14b61925dc300274b3c70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df5fe7cedcd14b61925dc300274b3c70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_df5fe7cedcd14b61925dc300274b3c70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/df5fe7cedcd14b61925dc300274b3c70"}]}] Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerActionsTestJSON-426455045 Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: df5fe7cedcd14b61925dc300274b3c70 Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerActionsTestJSON-426455045 Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerActionsTestJSON-426455045-project Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: aac411c78a5648be8a1c43893d9a0798 Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerActionsTestJSON-426455045-project Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92 could not be found. Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92'} Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92 could not be found. Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92 could not be found. Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:23:23.339452 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:23:23.343734 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:23:23.343734 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:23:23.343734 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:23:23.343734 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:23:23.343734 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:23:23.343734 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92 could not be found. Oct 29 03:23:23.343734 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:23:23.345438 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-31d00083-4c82-4671-b5a1-ca377adc48f2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Returning 404 to user: Instance e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:23:23.346460 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-31d00083-4c82-4671-b5a1-ca377adc48f2 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92" status: 404 len: 111 microversion: 2.1 time: 0.040819 Oct 29 03:23:23.347484 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2643/5515] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:23 2022] GET /compute/v2.1/servers/e9ccf27c-fc9b-4699-bf70-af7fd4b4fe92 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:23:23.357850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2bc392c7-58b1-42f9-9c33-b3e0f3d8f3aa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:23.358651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2bc392c7-58b1-42f9-9c33-b3e0f3d8f3aa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:23.372402 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2bc392c7-58b1-42f9-9c33-b3e0f3d8f3aa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:23.373270 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2bc392c7-58b1-42f9-9c33-b3e0f3d8f3aa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:23.373388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2bc392c7-58b1-42f9-9c33-b3e0f3d8f3aa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:23.374055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2bc392c7-58b1-42f9-9c33-b3e0f3d8f3aa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:23.374498 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2bc392c7-58b1-42f9-9c33-b3e0f3d8f3aa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:23.374920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2bc392c7-58b1-42f9-9c33-b3e0f3d8f3aa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:23.435429 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2bc392c7-58b1-42f9-9c33-b3e0f3d8f3aa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:23:23.585946 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2bc392c7-58b1-42f9-9c33-b3e0f3d8f3aa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 204 len: 0 microversion: 2.1 time: 0.233115 Oct 29 03:23:23.587505 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2873/5516] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:23:23 2022] DELETE /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 03:23:23.598371 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6bb3ecad-0784-4d89-b1f6-5d845d3062fc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:23.599469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6bb3ecad-0784-4d89-b1f6-5d845d3062fc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:23.606543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bb3ecad-0784-4d89-b1f6-5d845d3062fc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:23.607130 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bb3ecad-0784-4d89-b1f6-5d845d3062fc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:23.607756 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bb3ecad-0784-4d89-b1f6-5d845d3062fc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:23.611513 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bb3ecad-0784-4d89-b1f6-5d845d3062fc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:23.611513 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bb3ecad-0784-4d89-b1f6-5d845d3062fc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:23.611513 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bb3ecad-0784-4d89-b1f6-5d845d3062fc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:23.636609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:23.875381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6bb3ecad-0784-4d89-b1f6-5d845d3062fc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:23.903571 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6bb3ecad-0784-4d89-b1f6-5d845d3062fc tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1496 microversion: 2.1 time: 0.301497 Oct 29 03:23:23.907433 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2644/5517] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:23 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1496 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:23:24.161611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e0566559-4100-47f4-ae7a-3503d647c6df tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-526018006", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "2f6e2e61-afea-49a7-8ec7-ff32b1cf5323", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-2132373316", "security_groups": [{"name": "tempest-secgroup-smoke-502360681"}], "networks": [{"uuid": "47019a3a-763a-47c0-8890-72c5fa967395"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:23:24.370224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-e0566559-4100-47f4-ae7a-3503d647c6df tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] validate_networks() for [('47019a3a-763a-47c0-8890-72c5fa967395', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:23:24.935284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b8628d00-2ca4-40ba-b22d-3f89a6358d96 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:24.936671 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b8628d00-2ca4-40ba-b22d-3f89a6358d96 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:24.946190 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8628d00-2ca4-40ba-b22d-3f89a6358d96 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:24.946684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8628d00-2ca4-40ba-b22d-3f89a6358d96 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:24.947121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8628d00-2ca4-40ba-b22d-3f89a6358d96 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:24.947830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8628d00-2ca4-40ba-b22d-3f89a6358d96 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:24.948286 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8628d00-2ca4-40ba-b22d-3f89a6358d96 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:24.948749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8628d00-2ca4-40ba-b22d-3f89a6358d96 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:24.999020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e0566559-4100-47f4-ae7a-3503d647c6df tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:23:24.999444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e0566559-4100-47f4-ae7a-3503d647c6df tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:23:24.999920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e0566559-4100-47f4-ae7a-3503d647c6df tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:23:25.000356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e0566559-4100-47f4-ae7a-3503d647c6df tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:23:25.000786 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e0566559-4100-47f4-ae7a-3503d647c6df tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:23:25.011968 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e0566559-4100-47f4-ae7a-3503d647c6df tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:25.013037 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e0566559-4100-47f4-ae7a-3503d647c6df tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:25.013859 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e0566559-4100-47f4-ae7a-3503d647c6df tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:25.014757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e0566559-4100-47f4-ae7a-3503d647c6df tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:25.015373 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e0566559-4100-47f4-ae7a-3503d647c6df tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:25.016536 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e0566559-4100-47f4-ae7a-3503d647c6df tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:25.068171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-e0566559-4100-47f4-ae7a-3503d647c6df tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Getting quotas for project eab62a8a623d48dd865d5c7c96daead1. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:23:25.088576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-e0566559-4100-47f4-ae7a-3503d647c6df tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Getting quotas for user 4fb06badda8549e3ae02e9f6222098bc and project eab62a8a623d48dd865d5c7c96daead1. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:23:25.201770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e0566559-4100-47f4-ae7a-3503d647c6df tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:23:25.204766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e0566559-4100-47f4-ae7a-3503d647c6df tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] [instance: 3fa9077c-183f-48e0-898d-563797ebd546] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2f6e2e61-afea-49a7-8ec7-ff32b1cf5323',volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:23:25.259896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b8628d00-2ca4-40ba-b22d-3f89a6358d96 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:25.268802 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b8628d00-2ca4-40ba-b22d-3f89a6358d96 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 200 len: 1496 microversion: 2.1 time: 0.340216 Oct 29 03:23:25.273278 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2645/5518] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:24 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 1496 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:23:25.452012 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e0566559-4100-47f4-ae7a-3503d647c6df tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.298535 Oct 29 03:23:25.452919 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-6246a439-53ff-425a-8c1e-418b35b15fd7 req-7421b1b2-d1dd-4030-bf58-2bf98fac2108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d4de7cf-9511-450e-b531-3a9c95494958", "name": "network-vif-deleted", "tag": "6ee4d134-5f59-466d-998a-92cc2a06da13"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:23:25.454514 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2874/5519] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:23:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 1303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:23:25.462917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6246a439-53ff-425a-8c1e-418b35b15fd7 req-7421b1b2-d1dd-4030-bf58-2bf98fac2108 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:25.463730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6246a439-53ff-425a-8c1e-418b35b15fd7 req-7421b1b2-d1dd-4030-bf58-2bf98fac2108 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:25.464589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6246a439-53ff-425a-8c1e-418b35b15fd7 req-7421b1b2-d1dd-4030-bf58-2bf98fac2108 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:25.467997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bb24df47-8f96-46e9-9a89-58b02d57ce08 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:25.468962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bb24df47-8f96-46e9-9a89-58b02d57ce08 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] [instance: 3fa9077c-183f-48e0-898d-563797ebd546] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:25.513079 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-6246a439-53ff-425a-8c1e-418b35b15fd7 req-7421b1b2-d1dd-4030-bf58-2bf98fac2108 service nova] Creating event network-vif-deleted:6ee4d134-5f59-466d-998a-92cc2a06da13 for instance 2d4de7cf-9511-450e-b531-3a9c95494958 on n-h2-862967-2 Oct 29 03:23:25.525634 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-6246a439-53ff-425a-8c1e-418b35b15fd7 req-7421b1b2-d1dd-4030-bf58-2bf98fac2108 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076285 Oct 29 03:23:25.527611 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2646/5520] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:23:25.580017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bb24df47-8f96-46e9-9a89-58b02d57ce08 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb06badda8549e3ae02e9f6222098bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab62a8a623d48dd865d5c7c96daead1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:25.588103 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bb24df47-8f96-46e9-9a89-58b02d57ce08 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] 10.222.0.46 "GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546" status: 200 len: 1098 microversion: 2.1 time: 0.126399 Oct 29 03:23:25.588729 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2875/5521] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:25 2022] GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546 => generated 1098 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:25.745000 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c14f4a5e-4a26-43fa-aa7c-8a850b09bd5d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:23:25.748064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c14f4a5e-4a26-43fa-aa7c-8a850b09bd5d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:25.767876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c14f4a5e-4a26-43fa-aa7c-8a850b09bd5d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:25.771335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c14f4a5e-4a26-43fa-aa7c-8a850b09bd5d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:25.773833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c14f4a5e-4a26-43fa-aa7c-8a850b09bd5d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:25.775076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c14f4a5e-4a26-43fa-aa7c-8a850b09bd5d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:25.775556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c14f4a5e-4a26-43fa-aa7c-8a850b09bd5d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:25.776730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c14f4a5e-4a26-43fa-aa7c-8a850b09bd5d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:25.880044 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c14f4a5e-4a26-43fa-aa7c-8a850b09bd5d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "POST /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41/action" status: 200 len: 24560 microversion: 2.1 time: 0.139393 Oct 29 03:23:25.887427 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2647/5522] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:23:25 2022] POST /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41/action => generated 24560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:23:26.301502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0f31f363-41d1-44af-8df5-1390e0200caa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:26.302138 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0f31f363-41d1-44af-8df5-1390e0200caa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 2d4de7cf-9511-450e-b531-3a9c95494958] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:26.314038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f31f363-41d1-44af-8df5-1390e0200caa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:26.314646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f31f363-41d1-44af-8df5-1390e0200caa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:26.315212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f31f363-41d1-44af-8df5-1390e0200caa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:26.316035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f31f363-41d1-44af-8df5-1390e0200caa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:26.316495 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f31f363-41d1-44af-8df5-1390e0200caa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:26.318006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f31f363-41d1-44af-8df5-1390e0200caa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:26.344416 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-0f31f363-41d1-44af-8df5-1390e0200caa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] HTTP exception thrown: Instance 2d4de7cf-9511-450e-b531-3a9c95494958 could not be found. Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0f31f363-41d1-44af-8df5-1390e0200caa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Request method failure captured: Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 HTTP/1.1 Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJrBEld31_ePW0eW7K3K43c4mjwkjjugq-rdAhOVlo7sDAu80OCKquivv6iAf8BI6lShu9ZDCXrw8POtLG6DQDhjZ3gEDkqYAv8E5X2C0u3J69FOg8yuu0dLy3EdjifUrqcpmrU9YXQ7ewUei1xDtAEB9ZAOTpvrMpo4LGrGscneUrI Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: df5fe7cedcd14b61925dc300274b3c70 Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServerActionsTestJSON-426455045 Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df5fe7cedcd14b61925dc300274b3c70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df5fe7cedcd14b61925dc300274b3c70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_df5fe7cedcd14b61925dc300274b3c70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/df5fe7cedcd14b61925dc300274b3c70"}]}] Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServerActionsTestJSON-426455045 Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: df5fe7cedcd14b61925dc300274b3c70 Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServerActionsTestJSON-426455045 Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServerActionsTestJSON-426455045-project Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: aac411c78a5648be8a1c43893d9a0798 Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServerActionsTestJSON-426455045-project Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 2d4de7cf-9511-450e-b531-3a9c95494958 could not be found. Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '2d4de7cf-9511-450e-b531-3a9c95494958'} Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d4de7cf-9511-450e-b531-3a9c95494958 could not be found. Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d4de7cf-9511-450e-b531-3a9c95494958 could not be found. Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:23:26.349415 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:23:26.353911 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:23:26.353911 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:23:26.353911 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:23:26.353911 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:23:26.353911 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:23:26.353911 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d4de7cf-9511-450e-b531-3a9c95494958 could not be found. Oct 29 03:23:26.353911 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:23:26.353911 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0f31f363-41d1-44af-8df5-1390e0200caa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Returning 404 to user: Instance 2d4de7cf-9511-450e-b531-3a9c95494958 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:23:26.355521 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0f31f363-41d1-44af-8df5-1390e0200caa tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958" status: 404 len: 111 microversion: 2.1 time: 0.062489 Oct 29 03:23:26.357837 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2876/5523] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:26 2022] GET /compute/v2.1/servers/2d4de7cf-9511-450e-b531-3a9c95494958 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:23:26.366932 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-475db6e0-371f-40f8-a7f9-5072503271f5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:26.367510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-475db6e0-371f-40f8-a7f9-5072503271f5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:26.391763 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-475db6e0-371f-40f8-a7f9-5072503271f5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:26.394505 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-475db6e0-371f-40f8-a7f9-5072503271f5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:26.397684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-475db6e0-371f-40f8-a7f9-5072503271f5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:26.398631 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-475db6e0-371f-40f8-a7f9-5072503271f5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:26.399310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-475db6e0-371f-40f8-a7f9-5072503271f5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:26.401073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-475db6e0-371f-40f8-a7f9-5072503271f5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:26.435457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-475db6e0-371f-40f8-a7f9-5072503271f5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:23:26.539142 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-475db6e0-371f-40f8-a7f9-5072503271f5 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "DELETE /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 204 len: 0 microversion: 2.1 time: 0.176238 Oct 29 03:23:26.540360 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2648/5524] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:23:26 2022] DELETE /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:23:26.548713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-83a5f092-9df0-4dab-959f-44dc32beab95 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:26.549353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-83a5f092-9df0-4dab-959f-44dc32beab95 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:26.562512 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83a5f092-9df0-4dab-959f-44dc32beab95 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:26.564714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83a5f092-9df0-4dab-959f-44dc32beab95 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:26.565747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83a5f092-9df0-4dab-959f-44dc32beab95 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:26.567032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83a5f092-9df0-4dab-959f-44dc32beab95 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:26.567759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83a5f092-9df0-4dab-959f-44dc32beab95 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:26.568387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83a5f092-9df0-4dab-959f-44dc32beab95 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:26.619704 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-eda98538-673d-42a1-8b99-4c8ac4449f72 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:26.620588 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-eda98538-673d-42a1-8b99-4c8ac4449f72 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] [instance: 3fa9077c-183f-48e0-898d-563797ebd546] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:26.631259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eda98538-673d-42a1-8b99-4c8ac4449f72 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:26.633509 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eda98538-673d-42a1-8b99-4c8ac4449f72 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:26.633996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eda98538-673d-42a1-8b99-4c8ac4449f72 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:26.634728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eda98538-673d-42a1-8b99-4c8ac4449f72 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:26.635185 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eda98538-673d-42a1-8b99-4c8ac4449f72 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:26.635611 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eda98538-673d-42a1-8b99-4c8ac4449f72 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:26.760918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-eda98538-673d-42a1-8b99-4c8ac4449f72 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb06badda8549e3ae02e9f6222098bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab62a8a623d48dd865d5c7c96daead1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:26.761078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-83a5f092-9df0-4dab-959f-44dc32beab95 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:26.770099 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-eda98538-673d-42a1-8b99-4c8ac4449f72 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] 10.222.0.46 "GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546" status: 200 len: 1196 microversion: 2.1 time: 0.161200 Oct 29 03:23:26.771735 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2649/5525] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:26 2022] GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546 => generated 1196 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:23:26.807344 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-83a5f092-9df0-4dab-959f-44dc32beab95 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1676 microversion: 2.1 time: 0.262736 Oct 29 03:23:26.810099 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2877/5526] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:26 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1676 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:27.794099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-83a49060-b72e-4c96-a770-429e0e8939fe tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:27.795179 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-83a49060-b72e-4c96-a770-429e0e8939fe tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] [instance: 3fa9077c-183f-48e0-898d-563797ebd546] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:27.815145 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83a49060-b72e-4c96-a770-429e0e8939fe tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:27.816285 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83a49060-b72e-4c96-a770-429e0e8939fe tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:27.819014 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83a49060-b72e-4c96-a770-429e0e8939fe tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:27.822501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83a49060-b72e-4c96-a770-429e0e8939fe tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:27.824786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83a49060-b72e-4c96-a770-429e0e8939fe tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:27.826145 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83a49060-b72e-4c96-a770-429e0e8939fe tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:27.835554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-956f8f00-0444-4730-b1a6-f166bfc15e97 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:27.836183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-956f8f00-0444-4730-b1a6-f166bfc15e97 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:27.847651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-956f8f00-0444-4730-b1a6-f166bfc15e97 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:27.848160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-956f8f00-0444-4730-b1a6-f166bfc15e97 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:27.848669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-956f8f00-0444-4730-b1a6-f166bfc15e97 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:27.849395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-956f8f00-0444-4730-b1a6-f166bfc15e97 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:27.849851 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-956f8f00-0444-4730-b1a6-f166bfc15e97 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:27.850282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-956f8f00-0444-4730-b1a6-f166bfc15e97 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:27.954654 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-83a49060-b72e-4c96-a770-429e0e8939fe tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb06badda8549e3ae02e9f6222098bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab62a8a623d48dd865d5c7c96daead1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:27.979643 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-83a49060-b72e-4c96-a770-429e0e8939fe tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] 10.222.0.46 "GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546" status: 200 len: 1196 microversion: 2.1 time: 0.189644 Oct 29 03:23:27.991664 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2650/5527] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:27 2022] GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546 => generated 1196 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:28.211589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-956f8f00-0444-4730-b1a6-f166bfc15e97 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:28.250026 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-956f8f00-0444-4730-b1a6-f166bfc15e97 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1676 microversion: 2.1 time: 0.418499 Oct 29 03:23:28.251237 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2878/5528] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:27 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1676 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:23:29.006319 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-896aec7a-abdf-4b65-9318-64f80cf3d6cd tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:29.006931 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-896aec7a-abdf-4b65-9318-64f80cf3d6cd tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] [instance: 3fa9077c-183f-48e0-898d-563797ebd546] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:29.022779 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-896aec7a-abdf-4b65-9318-64f80cf3d6cd tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:29.023703 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-896aec7a-abdf-4b65-9318-64f80cf3d6cd tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:29.024368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-896aec7a-abdf-4b65-9318-64f80cf3d6cd tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:29.025357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-896aec7a-abdf-4b65-9318-64f80cf3d6cd tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:29.043088 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-896aec7a-abdf-4b65-9318-64f80cf3d6cd tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:29.043816 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-896aec7a-abdf-4b65-9318-64f80cf3d6cd tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:29.129603 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-896aec7a-abdf-4b65-9318-64f80cf3d6cd tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb06badda8549e3ae02e9f6222098bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab62a8a623d48dd865d5c7c96daead1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:29.139028 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-896aec7a-abdf-4b65-9318-64f80cf3d6cd tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] 10.222.0.46 "GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546" status: 200 len: 1214 microversion: 2.1 time: 0.137621 Oct 29 03:23:29.139787 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2651/5529] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:29 2022] GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546 => generated 1214 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:29.276346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4ca65325-1950-4042-9330-eea221c49a36 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:29.277779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4ca65325-1950-4042-9330-eea221c49a36 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:29.292381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ca65325-1950-4042-9330-eea221c49a36 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:29.294195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ca65325-1950-4042-9330-eea221c49a36 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:29.294819 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ca65325-1950-4042-9330-eea221c49a36 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:29.295733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ca65325-1950-4042-9330-eea221c49a36 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:29.296412 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ca65325-1950-4042-9330-eea221c49a36 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:29.297049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ca65325-1950-4042-9330-eea221c49a36 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:29.497915 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-598e67fc-a874-439f-981a-2e361e47fc65 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:23:29.500864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-598e67fc-a874-439f-981a-2e361e47fc65 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 7bb1a735-8673-475d-8092-c67222d3415d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:29.509216 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-598e67fc-a874-439f-981a-2e361e47fc65 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:29.509964 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-598e67fc-a874-439f-981a-2e361e47fc65 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:29.510558 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-598e67fc-a874-439f-981a-2e361e47fc65 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:29.511472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-598e67fc-a874-439f-981a-2e361e47fc65 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:29.512655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-598e67fc-a874-439f-981a-2e361e47fc65 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:29.513241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-598e67fc-a874-439f-981a-2e361e47fc65 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:29.578967 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-598e67fc-a874-439f-981a-2e361e47fc65 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "POST /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d/action" status: 200 len: 32636 microversion: 2.1 time: 0.084254 Oct 29 03:23:29.580763 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2652/5530] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:23:29 2022] POST /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d/action => generated 32636 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 03:23:30.164211 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-421ecc74-fa60-4dd3-a623-c7007983ff78 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:30.165801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-421ecc74-fa60-4dd3-a623-c7007983ff78 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] [instance: 3fa9077c-183f-48e0-898d-563797ebd546] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:30.182943 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-421ecc74-fa60-4dd3-a623-c7007983ff78 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:30.183351 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-421ecc74-fa60-4dd3-a623-c7007983ff78 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:30.183791 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-421ecc74-fa60-4dd3-a623-c7007983ff78 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:30.184508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-421ecc74-fa60-4dd3-a623-c7007983ff78 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:30.184985 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-421ecc74-fa60-4dd3-a623-c7007983ff78 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:30.185423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-421ecc74-fa60-4dd3-a623-c7007983ff78 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:30.198405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4ca65325-1950-4042-9330-eea221c49a36 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:30.209300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:30.217032 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4ca65325-1950-4042-9330-eea221c49a36 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1676 microversion: 2.1 time: 0.945728 Oct 29 03:23:30.239918 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2879/5531] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:29 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1676 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:30.466529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-421ecc74-fa60-4dd3-a623-c7007983ff78 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb06badda8549e3ae02e9f6222098bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab62a8a623d48dd865d5c7c96daead1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:30.479627 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-421ecc74-fa60-4dd3-a623-c7007983ff78 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] 10.222.0.46 "GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546" status: 200 len: 1214 microversion: 2.1 time: 0.320085 Oct 29 03:23:30.485947 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2653/5532] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:30 2022] GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546 => generated 1214 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:23:31.259531 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-921deaa4-b9bd-40b7-8bd2-a52b527b6aee tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:31.260153 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-921deaa4-b9bd-40b7-8bd2-a52b527b6aee tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:31.290227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-921deaa4-b9bd-40b7-8bd2-a52b527b6aee tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:31.294692 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-921deaa4-b9bd-40b7-8bd2-a52b527b6aee tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:31.297269 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-921deaa4-b9bd-40b7-8bd2-a52b527b6aee tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:31.303322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-921deaa4-b9bd-40b7-8bd2-a52b527b6aee tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:31.305157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-921deaa4-b9bd-40b7-8bd2-a52b527b6aee tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:31.308549 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-921deaa4-b9bd-40b7-8bd2-a52b527b6aee tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:31.509240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b223abdd-65d2-4ed5-8060-4dce09b82908 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:31.510878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b223abdd-65d2-4ed5-8060-4dce09b82908 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] [instance: 3fa9077c-183f-48e0-898d-563797ebd546] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:31.528415 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b223abdd-65d2-4ed5-8060-4dce09b82908 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:31.529233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b223abdd-65d2-4ed5-8060-4dce09b82908 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:31.530337 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b223abdd-65d2-4ed5-8060-4dce09b82908 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:31.531462 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b223abdd-65d2-4ed5-8060-4dce09b82908 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:31.534625 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b223abdd-65d2-4ed5-8060-4dce09b82908 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:31.535307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b223abdd-65d2-4ed5-8060-4dce09b82908 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:31.730619 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-921deaa4-b9bd-40b7-8bd2-a52b527b6aee tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:31.747906 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-921deaa4-b9bd-40b7-8bd2-a52b527b6aee tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1609 microversion: 2.1 time: 0.493982 Oct 29 03:23:31.748688 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2880/5533] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:31 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1609 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:31.954224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b223abdd-65d2-4ed5-8060-4dce09b82908 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb06badda8549e3ae02e9f6222098bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab62a8a623d48dd865d5c7c96daead1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:31.965599 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b223abdd-65d2-4ed5-8060-4dce09b82908 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] 10.222.0.46 "GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546" status: 200 len: 1281 microversion: 2.1 time: 0.461008 Oct 29 03:23:31.976998 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2654/5534] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:31 2022] GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546 => generated 1281 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:32.366785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-a852baf7-f6fe-4f02-86c5-c8958afc0386 req-c5350e34-6e0f-401e-8371-4bfea5dd07fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23349ce8-2588-42c9-8de7-90865b56c980", "name": "network-vif-deleted", "tag": "26865343-33e7-4622-bd06-ed6191938067"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:23:32.415133 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a852baf7-f6fe-4f02-86c5-c8958afc0386 req-c5350e34-6e0f-401e-8371-4bfea5dd07fe service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:32.415631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a852baf7-f6fe-4f02-86c5-c8958afc0386 req-c5350e34-6e0f-401e-8371-4bfea5dd07fe service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:32.416064 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a852baf7-f6fe-4f02-86c5-c8958afc0386 req-c5350e34-6e0f-401e-8371-4bfea5dd07fe service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:32.459849 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-a852baf7-f6fe-4f02-86c5-c8958afc0386 req-c5350e34-6e0f-401e-8371-4bfea5dd07fe service nova] Creating event network-vif-deleted:26865343-33e7-4622-bd06-ed6191938067 for instance 23349ce8-2588-42c9-8de7-90865b56c980 on n-h2-862967-2 Oct 29 03:23:32.480769 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-a852baf7-f6fe-4f02-86c5-c8958afc0386 req-c5350e34-6e0f-401e-8371-4bfea5dd07fe service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117794 Oct 29 03:23:32.484342 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2881/5535] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:23:32.758684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a886970c-69c1-4e0c-b5b6-bfc4c046e1ee tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:32.760042 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a886970c-69c1-4e0c-b5b6-bfc4c046e1ee tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 7bb1a735-8673-475d-8092-c67222d3415d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:32.774089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6c4f09f8-3520-40c4-86b6-a7462d6d1bad tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:32.775167 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6c4f09f8-3520-40c4-86b6-a7462d6d1bad tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:32.786418 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a886970c-69c1-4e0c-b5b6-bfc4c046e1ee tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:32.788880 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c4f09f8-3520-40c4-86b6-a7462d6d1bad tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:32.789336 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a886970c-69c1-4e0c-b5b6-bfc4c046e1ee tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:32.790005 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c4f09f8-3520-40c4-86b6-a7462d6d1bad tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:32.792393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a886970c-69c1-4e0c-b5b6-bfc4c046e1ee tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:32.793179 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c4f09f8-3520-40c4-86b6-a7462d6d1bad tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:32.794122 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c4f09f8-3520-40c4-86b6-a7462d6d1bad tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:32.794746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c4f09f8-3520-40c4-86b6-a7462d6d1bad tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:32.797635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a886970c-69c1-4e0c-b5b6-bfc4c046e1ee tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:32.798368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c4f09f8-3520-40c4-86b6-a7462d6d1bad tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:32.800416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a886970c-69c1-4e0c-b5b6-bfc4c046e1ee tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:32.801214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a886970c-69c1-4e0c-b5b6-bfc4c046e1ee tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:32.906244 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a886970c-69c1-4e0c-b5b6-bfc4c046e1ee tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 7bb1a735-8673-475d-8092-c67222d3415d] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:23:32.914944 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c4f09f8-3520-40c4-86b6-a7462d6d1bad tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:32.915613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c4f09f8-3520-40c4-86b6-a7462d6d1bad tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:32.916205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c4f09f8-3520-40c4-86b6-a7462d6d1bad tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:32.916880 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-6c4f09f8-3520-40c4-86b6-a7462d6d1bad tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lazy-loading 'fault' on Instance uuid 23349ce8-2588-42c9-8de7-90865b56c980 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:23:33.007926 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6c4f09f8-3520-40c4-86b6-a7462d6d1bad tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac411c78a5648be8a1c43893d9a0798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5fe7cedcd14b61925dc300274b3c70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:33.036425 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6c4f09f8-3520-40c4-86b6-a7462d6d1bad tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 200 len: 1329 microversion: 2.1 time: 0.267108 Oct 29 03:23:33.056793 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2882/5536] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:32 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 1329 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:33.072590 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a8411d51-f568-4820-b925-fc2e4eba5c22 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:33.073610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a8411d51-f568-4820-b925-fc2e4eba5c22 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] [instance: 3fa9077c-183f-48e0-898d-563797ebd546] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:33.105114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8411d51-f568-4820-b925-fc2e4eba5c22 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:33.108478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8411d51-f568-4820-b925-fc2e4eba5c22 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:33.111563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8411d51-f568-4820-b925-fc2e4eba5c22 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:33.116115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8411d51-f568-4820-b925-fc2e4eba5c22 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:33.116887 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8411d51-f568-4820-b925-fc2e4eba5c22 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:33.122540 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8411d51-f568-4820-b925-fc2e4eba5c22 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:33.142109 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a886970c-69c1-4e0c-b5b6-bfc4c046e1ee tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d" status: 204 len: 0 microversion: 2.1 time: 0.387242 Oct 29 03:23:33.143514 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2655/5537] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:23:32 2022] DELETE /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:23:33.164375 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f11c9197-be6e-45ad-b609-aa7716b995c5 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:33.165372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f11c9197-be6e-45ad-b609-aa7716b995c5 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 7bb1a735-8673-475d-8092-c67222d3415d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:33.187432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f11c9197-be6e-45ad-b609-aa7716b995c5 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:33.189723 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f11c9197-be6e-45ad-b609-aa7716b995c5 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:33.190566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f11c9197-be6e-45ad-b609-aa7716b995c5 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:33.195648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f11c9197-be6e-45ad-b609-aa7716b995c5 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:33.196408 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f11c9197-be6e-45ad-b609-aa7716b995c5 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:33.197198 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f11c9197-be6e-45ad-b609-aa7716b995c5 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:33.688326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f11c9197-be6e-45ad-b609-aa7716b995c5 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:33.699202 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f11c9197-be6e-45ad-b609-aa7716b995c5 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d" status: 200 len: 1671 microversion: 2.1 time: 0.548553 Oct 29 03:23:33.702748 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2656/5538] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:33 2022] GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d => generated 1671 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:33.834337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a8411d51-f568-4820-b925-fc2e4eba5c22 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb06badda8549e3ae02e9f6222098bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab62a8a623d48dd865d5c7c96daead1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:33.846445 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a8411d51-f568-4820-b925-fc2e4eba5c22 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] 10.222.0.46 "GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546" status: 200 len: 1281 microversion: 2.1 time: 0.786650 Oct 29 03:23:33.849734 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2883/5539] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:33 2022] GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546 => generated 1281 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:34.063116 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2fbc3a9e-6adc-43cd-90dd-2060b8eb0317 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:34.064144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2fbc3a9e-6adc-43cd-90dd-2060b8eb0317 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] [instance: 23349ce8-2588-42c9-8de7-90865b56c980] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:34.075834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fbc3a9e-6adc-43cd-90dd-2060b8eb0317 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:34.088835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fbc3a9e-6adc-43cd-90dd-2060b8eb0317 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:34.089501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fbc3a9e-6adc-43cd-90dd-2060b8eb0317 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:34.095082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fbc3a9e-6adc-43cd-90dd-2060b8eb0317 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:34.097186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fbc3a9e-6adc-43cd-90dd-2060b8eb0317 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:34.098732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2fbc3a9e-6adc-43cd-90dd-2060b8eb0317 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:34.140577 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-2fbc3a9e-6adc-43cd-90dd-2060b8eb0317 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] HTTP exception thrown: Instance 23349ce8-2588-42c9-8de7-90865b56c980 could not be found. Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2fbc3a9e-6adc-43cd-90dd-2060b8eb0317 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Request method failure captured: Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 HTTP/1.1 Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJrBEld31_ePW0eW7K3K43c4mjwkjjugq-rdAhOVlo7sDAu80OCKquivv6iAf8BI6lShu9ZDCXrw8POtLG6DQDhjZ3gEDkqYAv8E5X2C0u3J69FOg8yuu0dLy3EdjifUrqcpmrU9YXQ7ewUei1xDtAEB9ZAOTpvrMpo4LGrGscneUrI Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: df5fe7cedcd14b61925dc300274b3c70 Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerActionsTestJSON-426455045 Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df5fe7cedcd14b61925dc300274b3c70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/df5fe7cedcd14b61925dc300274b3c70"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_df5fe7cedcd14b61925dc300274b3c70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/df5fe7cedcd14b61925dc300274b3c70"}]}] Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerActionsTestJSON-426455045 Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: df5fe7cedcd14b61925dc300274b3c70 Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerActionsTestJSON-426455045 Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerActionsTestJSON-426455045-project Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: aac411c78a5648be8a1c43893d9a0798 Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerActionsTestJSON-426455045-project Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 23349ce8-2588-42c9-8de7-90865b56c980 could not be found. Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '23349ce8-2588-42c9-8de7-90865b56c980'} Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23349ce8-2588-42c9-8de7-90865b56c980 could not be found. Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23349ce8-2588-42c9-8de7-90865b56c980 could not be found. Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:23:34.150043 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:23:34.153629 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:23:34.153629 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:23:34.153629 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:23:34.153629 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:23:34.153629 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:23:34.153629 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23349ce8-2588-42c9-8de7-90865b56c980 could not be found. Oct 29 03:23:34.153629 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:23:34.154031 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2fbc3a9e-6adc-43cd-90dd-2060b8eb0317 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Returning 404 to user: Instance 23349ce8-2588-42c9-8de7-90865b56c980 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:23:34.157194 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2fbc3a9e-6adc-43cd-90dd-2060b8eb0317 tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980" status: 404 len: 111 microversion: 2.1 time: 0.098045 Oct 29 03:23:34.158781 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2657/5540] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:34 2022] GET /compute/v2.1/servers/23349ce8-2588-42c9-8de7-90865b56c980 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:23:34.166928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-23de04fb-65b5-48dd-82e4-c85fa9c1c98f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] Calling method '.version_select at 0x7ff052a48d30>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:34.208160 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-23de04fb-65b5-48dd-82e4-c85fa9c1c98f tempest-ServerActionsTestJSON-426455045 tempest-ServerActionsTestJSON-426455045-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240594448" status: 202 len: 0 microversion: 2.1 time: 0.045592 Oct 29 03:23:34.212142 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2884/5541] 10.222.0.46 () {58 vars in 1221 bytes} [Sat Oct 29 03:23:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240594448 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:23:34.627435 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-ee25deba-b4f6-43a6-8471-021e5b05b0b6 req-dd33498a-85a5-41e4-8c54-f033fc090909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bb1a735-8673-475d-8092-c67222d3415d", "tag": "8c2f6d11-aace-4074-9601-98ac0d56eb39"}, {"name": "network-changed", "server_uuid": "3fa9077c-183f-48e0-898d-563797ebd546", "tag": "ab51c241-18f1-4ba6-9e8f-12aeb85b8a5e"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:23:34.652851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ee25deba-b4f6-43a6-8471-021e5b05b0b6 req-dd33498a-85a5-41e4-8c54-f033fc090909 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:34.653354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ee25deba-b4f6-43a6-8471-021e5b05b0b6 req-dd33498a-85a5-41e4-8c54-f033fc090909 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:34.656883 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ee25deba-b4f6-43a6-8471-021e5b05b0b6 req-dd33498a-85a5-41e4-8c54-f033fc090909 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:34.694808 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-ee25deba-b4f6-43a6-8471-021e5b05b0b6 req-dd33498a-85a5-41e4-8c54-f033fc090909 service nova] Creating event network-changed:8c2f6d11-aace-4074-9601-98ac0d56eb39 for instance 7bb1a735-8673-475d-8092-c67222d3415d on n-h1-862967-2 Oct 29 03:23:34.695387 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-ee25deba-b4f6-43a6-8471-021e5b05b0b6 req-dd33498a-85a5-41e4-8c54-f033fc090909 service nova] Creating event network-changed:ab51c241-18f1-4ba6-9e8f-12aeb85b8a5e for instance 3fa9077c-183f-48e0-898d-563797ebd546 on n-h2-862967-2 Oct 29 03:23:34.726860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ffbbbd35-9e8a-425c-87c8-88f3f53d4355 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:34.727660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ffbbbd35-9e8a-425c-87c8-88f3f53d4355 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 7bb1a735-8673-475d-8092-c67222d3415d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:34.737596 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-ee25deba-b4f6-43a6-8471-021e5b05b0b6 req-dd33498a-85a5-41e4-8c54-f033fc090909 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.110177 Oct 29 03:23:34.744094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffbbbd35-9e8a-425c-87c8-88f3f53d4355 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:34.744318 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2658/5542] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:23:34.745122 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffbbbd35-9e8a-425c-87c8-88f3f53d4355 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:34.745810 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffbbbd35-9e8a-425c-87c8-88f3f53d4355 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:34.747050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffbbbd35-9e8a-425c-87c8-88f3f53d4355 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:34.748318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffbbbd35-9e8a-425c-87c8-88f3f53d4355 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:34.751496 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffbbbd35-9e8a-425c-87c8-88f3f53d4355 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:34.880619 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-45da4b1e-4aea-47f5-b9eb-2378b14ee1c3 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:34.881339 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-45da4b1e-4aea-47f5-b9eb-2378b14ee1c3 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] [instance: 3fa9077c-183f-48e0-898d-563797ebd546] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:34.885080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:34.901544 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45da4b1e-4aea-47f5-b9eb-2378b14ee1c3 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:34.902048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45da4b1e-4aea-47f5-b9eb-2378b14ee1c3 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:34.902490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45da4b1e-4aea-47f5-b9eb-2378b14ee1c3 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:34.903222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45da4b1e-4aea-47f5-b9eb-2378b14ee1c3 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:34.903679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45da4b1e-4aea-47f5-b9eb-2378b14ee1c3 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:34.904108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45da4b1e-4aea-47f5-b9eb-2378b14ee1c3 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:35.475702 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:35.587689 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=12 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:36.378665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-45da4b1e-4aea-47f5-b9eb-2378b14ee1c3 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb06badda8549e3ae02e9f6222098bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab62a8a623d48dd865d5c7c96daead1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:36.388812 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-45da4b1e-4aea-47f5-b9eb-2378b14ee1c3 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] 10.222.0.46 "GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546" status: 200 len: 1281 microversion: 2.1 time: 1.513391 Oct 29 03:23:36.390486 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2659/5543] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:34 2022] GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546 => generated 1281 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:23:36.442219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ffbbbd35-9e8a-425c-87c8-88f3f53d4355 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:36.465713 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ffbbbd35-9e8a-425c-87c8-88f3f53d4355 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d" status: 200 len: 1671 microversion: 2.1 time: 1.741619 Oct 29 03:23:36.468053 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2885/5544] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:34 2022] GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d => generated 1671 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:36.728427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-44a3b856-13b2-405b-a75c-2546789512e1 req-cbebf1e5-2fc9-44a0-a2fe-3ba201860475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb1a735-8673-475d-8092-c67222d3415d", "name": "network-vif-deleted", "tag": "8c2f6d11-aace-4074-9601-98ac0d56eb39"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:23:36.751745 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-44a3b856-13b2-405b-a75c-2546789512e1 req-cbebf1e5-2fc9-44a0-a2fe-3ba201860475 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:36.753904 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-44a3b856-13b2-405b-a75c-2546789512e1 req-cbebf1e5-2fc9-44a0-a2fe-3ba201860475 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:36.756030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-44a3b856-13b2-405b-a75c-2546789512e1 req-cbebf1e5-2fc9-44a0-a2fe-3ba201860475 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:36.805906 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-44a3b856-13b2-405b-a75c-2546789512e1 req-cbebf1e5-2fc9-44a0-a2fe-3ba201860475 service nova] Creating event network-vif-deleted:8c2f6d11-aace-4074-9601-98ac0d56eb39 for instance 7bb1a735-8673-475d-8092-c67222d3415d on n-h1-862967-2 Oct 29 03:23:36.812215 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-44a3b856-13b2-405b-a75c-2546789512e1 req-cbebf1e5-2fc9-44a0-a2fe-3ba201860475 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088163 Oct 29 03:23:36.813569 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2660/5545] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:23:36.836799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-27744ec0-1216-491d-abf3-8a059713325f tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:36.837634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-27744ec0-1216-491d-abf3-8a059713325f tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:36.858458 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27744ec0-1216-491d-abf3-8a059713325f tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:36.862252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27744ec0-1216-491d-abf3-8a059713325f tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:36.864349 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27744ec0-1216-491d-abf3-8a059713325f tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:36.866325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27744ec0-1216-491d-abf3-8a059713325f tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:36.869612 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27744ec0-1216-491d-abf3-8a059713325f tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:36.871385 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27744ec0-1216-491d-abf3-8a059713325f tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:37.415906 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-711c8954-b129-45a2-9341-cc666c57151f tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:37.416861 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-711c8954-b129-45a2-9341-cc666c57151f tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] [instance: 3fa9077c-183f-48e0-898d-563797ebd546] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:37.453638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-711c8954-b129-45a2-9341-cc666c57151f tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:37.454552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-711c8954-b129-45a2-9341-cc666c57151f tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:37.455199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-711c8954-b129-45a2-9341-cc666c57151f tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:37.458253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-711c8954-b129-45a2-9341-cc666c57151f tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:37.460051 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-711c8954-b129-45a2-9341-cc666c57151f tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:37.460789 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-711c8954-b129-45a2-9341-cc666c57151f tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:37.510051 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-27744ec0-1216-491d-abf3-8a059713325f tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1832 microversion: 2.1 time: 0.677668 Oct 29 03:23:37.517453 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2886/5546] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:36 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1832 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:37.522704 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c5b697d6-6871-47d4-9ccd-ea66ee472a34 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:37.528441 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c5b697d6-6871-47d4-9ccd-ea66ee472a34 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 7bb1a735-8673-475d-8092-c67222d3415d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:37.537678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5b697d6-6871-47d4-9ccd-ea66ee472a34 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:37.552791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5b697d6-6871-47d4-9ccd-ea66ee472a34 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:37.553841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5b697d6-6871-47d4-9ccd-ea66ee472a34 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:37.554954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5b697d6-6871-47d4-9ccd-ea66ee472a34 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:37.555576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5b697d6-6871-47d4-9ccd-ea66ee472a34 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:37.556179 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5b697d6-6871-47d4-9ccd-ea66ee472a34 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:37.575072 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:37.627135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5b697d6-6871-47d4-9ccd-ea66ee472a34 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:37.627888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5b697d6-6871-47d4-9ccd-ea66ee472a34 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:37.628663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5b697d6-6871-47d4-9ccd-ea66ee472a34 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:37.630665 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-c5b697d6-6871-47d4-9ccd-ea66ee472a34 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lazy-loading 'fault' on Instance uuid 7bb1a735-8673-475d-8092-c67222d3415d {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:23:37.960700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c5b697d6-6871-47d4-9ccd-ea66ee472a34 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969be4a3c9bd432fa544ee27fa186564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '987564b626dd4c12b6109c1d23de75c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:37.989960 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c5b697d6-6871-47d4-9ccd-ea66ee472a34 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d" status: 200 len: 1339 microversion: 2.1 time: 0.463412 Oct 29 03:23:37.990833 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2887/5547] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:37 2022] GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d => generated 1339 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:38.000356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-400c494c-b708-4ee0-aee8-6a62d29ae4c4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:38.001327 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-400c494c-b708-4ee0-aee8-6a62d29ae4c4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:38.020149 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-400c494c-b708-4ee0-aee8-6a62d29ae4c4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:38.022395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-400c494c-b708-4ee0-aee8-6a62d29ae4c4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:38.023202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-400c494c-b708-4ee0-aee8-6a62d29ae4c4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:38.024297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-400c494c-b708-4ee0-aee8-6a62d29ae4c4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:38.026533 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-711c8954-b129-45a2-9341-cc666c57151f tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb06badda8549e3ae02e9f6222098bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab62a8a623d48dd865d5c7c96daead1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:38.027242 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-400c494c-b708-4ee0-aee8-6a62d29ae4c4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:38.027879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-400c494c-b708-4ee0-aee8-6a62d29ae4c4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:38.056246 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-711c8954-b129-45a2-9341-cc666c57151f tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] 10.222.0.46 "GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546" status: 200 len: 1281 microversion: 2.1 time: 0.647924 Oct 29 03:23:38.069691 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2661/5548] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:37 2022] GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546 => generated 1281 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:23:38.425688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-400c494c-b708-4ee0-aee8-6a62d29ae4c4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:38.450793 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-400c494c-b708-4ee0-aee8-6a62d29ae4c4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1681 microversion: 2.1 time: 0.457715 Oct 29 03:23:38.451391 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2888/5549] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:37 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1681 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:38.654265 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cce324be-4a70-4a13-8994-29653786cbe1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:23:38.656632 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cce324be-4a70-4a13-8994-29653786cbe1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:38.671485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cce324be-4a70-4a13-8994-29653786cbe1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:38.672013 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cce324be-4a70-4a13-8994-29653786cbe1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:38.672672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cce324be-4a70-4a13-8994-29653786cbe1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:38.673383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cce324be-4a70-4a13-8994-29653786cbe1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:38.673830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cce324be-4a70-4a13-8994-29653786cbe1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:38.674248 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cce324be-4a70-4a13-8994-29653786cbe1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:38.752641 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cce324be-4a70-4a13-8994-29653786cbe1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "POST /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41/action" status: 200 len: 32631 microversion: 2.1 time: 0.102710 Oct 29 03:23:38.753571 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2662/5550] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:23:38 2022] POST /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41/action => generated 32631 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:23:38.932262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dd133c32-fda4-459f-86a8-fef79f48b761 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:23:38.932893 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dd133c32-fda4-459f-86a8-fef79f48b761 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:38.940079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd133c32-fda4-459f-86a8-fef79f48b761 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:38.940592 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd133c32-fda4-459f-86a8-fef79f48b761 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:38.941237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd133c32-fda4-459f-86a8-fef79f48b761 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:38.942214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd133c32-fda4-459f-86a8-fef79f48b761 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:38.942877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd133c32-fda4-459f-86a8-fef79f48b761 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:38.943453 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dd133c32-fda4-459f-86a8-fef79f48b761 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:38.995695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dd133c32-fda4-459f-86a8-fef79f48b761 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9f6c93de3f4643f8a4804c69ecce37e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b1a017032a4a54bfff32a27c7f9712', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:38.997106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dd133c32-fda4-459f-86a8-fef79f48b761 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] flavor_id is None. Assuming migration. {{(pid=127124) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 29 03:23:38.997106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dd133c32-fda4-459f-86a8-fef79f48b761 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127124) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 03:23:39.022280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b7823fb9-d3c4-4f4f-8bce-e220e7d8ce78 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:39.030413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b7823fb9-d3c4-4f4f-8bce-e220e7d8ce78 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] [instance: 7bb1a735-8673-475d-8092-c67222d3415d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:39.044505 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7823fb9-d3c4-4f4f-8bce-e220e7d8ce78 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:39.045546 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7823fb9-d3c4-4f4f-8bce-e220e7d8ce78 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:39.047766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7823fb9-d3c4-4f4f-8bce-e220e7d8ce78 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:39.048947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7823fb9-d3c4-4f4f-8bce-e220e7d8ce78 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:39.052715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7823fb9-d3c4-4f4f-8bce-e220e7d8ce78 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:39.054758 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7823fb9-d3c4-4f4f-8bce-e220e7d8ce78 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:39.072836 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-b7823fb9-d3c4-4f4f-8bce-e220e7d8ce78 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] HTTP exception thrown: Instance 7bb1a735-8673-475d-8092-c67222d3415d could not be found. Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b7823fb9-d3c4-4f4f-8bce-e220e7d8ce78 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Request method failure captured: Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d HTTP/1.1 Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJvE3nnIW37LzFb613JzJw0HypManPMbsxNU4oyKOp5zL0PJNck-rt9zXNRtLVZDEXfVAD5l4i00OLhLPto0kyiNWcTofBQjAJ5oVoGupwCdghDBPY9JXmCxhFK33vvd6iynXLz_-5YILKYHzmhxV05rCazPRkppDjCJSFlN28FyPeQ Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 987564b626dd4c12b6109c1d23de75c6 Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestNetworkBasicOps-1774990457 Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/987564b626dd4c12b6109c1d23de75c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/987564b626dd4c12b6109c1d23de75c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_987564b626dd4c12b6109c1d23de75c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/987564b626dd4c12b6109c1d23de75c6"}]}] Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestNetworkBasicOps-1774990457 Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 987564b626dd4c12b6109c1d23de75c6 Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestNetworkBasicOps-1774990457 Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestNetworkBasicOps-1774990457-project Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 969be4a3c9bd432fa544ee27fa186564 Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestNetworkBasicOps-1774990457-project Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 7bb1a735-8673-475d-8092-c67222d3415d could not be found. Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '7bb1a735-8673-475d-8092-c67222d3415d'} Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bb1a735-8673-475d-8092-c67222d3415d could not be found. Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bb1a735-8673-475d-8092-c67222d3415d could not be found. Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:23:39.074875 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:23:39.079522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:23:39.079522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:23:39.079522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:23:39.079522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:23:39.079522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:23:39.079522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bb1a735-8673-475d-8092-c67222d3415d could not be found. Oct 29 03:23:39.079522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:23:39.081898 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b7823fb9-d3c4-4f4f-8bce-e220e7d8ce78 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Returning 404 to user: Instance 7bb1a735-8673-475d-8092-c67222d3415d could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:23:39.083133 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b7823fb9-d3c4-4f4f-8bce-e220e7d8ce78 tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d" status: 404 len: 111 microversion: 2.1 time: 0.067538 Oct 29 03:23:39.084231 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2663/5551] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:39 2022] GET /compute/v2.1/servers/7bb1a735-8673-475d-8092-c67222d3415d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:23:39.089790 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dcdb8ea3-3e5c-44fa-ba7f-b48ee55f70e4 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:39.090636 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dcdb8ea3-3e5c-44fa-ba7f-b48ee55f70e4 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] [instance: 3fa9077c-183f-48e0-898d-563797ebd546] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:39.098032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dcdb8ea3-3e5c-44fa-ba7f-b48ee55f70e4 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:39.099023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dcdb8ea3-3e5c-44fa-ba7f-b48ee55f70e4 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:39.099702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dcdb8ea3-3e5c-44fa-ba7f-b48ee55f70e4 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:39.100678 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dcdb8ea3-3e5c-44fa-ba7f-b48ee55f70e4 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:39.101473 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dcdb8ea3-3e5c-44fa-ba7f-b48ee55f70e4 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:39.102095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dcdb8ea3-3e5c-44fa-ba7f-b48ee55f70e4 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:39.463301 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dd133c32-fda4-459f-86a8-fef79f48b761 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41/action" status: 202 len: 0 microversion: 2.1 time: 0.534814 Oct 29 03:23:39.468735 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2889/5552] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:23:38 2022] POST /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:23:39.481648 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a32117c0-26d6-4c73-b8dc-d6690841ff94 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:39.485042 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a32117c0-26d6-4c73-b8dc-d6690841ff94 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:39.501166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:39.504221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a32117c0-26d6-4c73-b8dc-d6690841ff94 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:39.512063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a32117c0-26d6-4c73-b8dc-d6690841ff94 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:39.512956 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a32117c0-26d6-4c73-b8dc-d6690841ff94 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:39.530409 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a32117c0-26d6-4c73-b8dc-d6690841ff94 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:39.531279 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a32117c0-26d6-4c73-b8dc-d6690841ff94 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:39.531987 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a32117c0-26d6-4c73-b8dc-d6690841ff94 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:39.822984 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dcdb8ea3-3e5c-44fa-ba7f-b48ee55f70e4 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb06badda8549e3ae02e9f6222098bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab62a8a623d48dd865d5c7c96daead1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:39.836383 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dcdb8ea3-3e5c-44fa-ba7f-b48ee55f70e4 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] 10.222.0.46 "GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546" status: 200 len: 1269 microversion: 2.1 time: 0.750717 Oct 29 03:23:39.838750 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2664/5553] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:39 2022] GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546 => generated 1269 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:39.971490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-428900cc-19fe-473e-8b31-85d916e0401b tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] Calling method '.version_select at 0x7ff052bac9d0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:40.006423 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-428900cc-19fe-473e-8b31-85d916e0401b tempest-TestNetworkBasicOps-1774990457 tempest-TestNetworkBasicOps-1774990457-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1057370026" status: 202 len: 0 microversion: 2.1 time: 0.039677 Oct 29 03:23:40.007082 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2665/5554] 10.222.0.46 () {58 vars in 1257 bytes} [Sat Oct 29 03:23:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1057370026 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:23:40.017706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a32117c0-26d6-4c73-b8dc-d6690841ff94 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:40.029679 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a32117c0-26d6-4c73-b8dc-d6690841ff94 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1690 microversion: 2.1 time: 0.557060 Oct 29 03:23:40.032174 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2890/5555] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:39 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1690 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:40.861597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fee83232-bad0-4db2-a200-1fbdb1ad329d tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:40.862812 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fee83232-bad0-4db2-a200-1fbdb1ad329d tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] [instance: 3fa9077c-183f-48e0-898d-563797ebd546] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:40.881388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fee83232-bad0-4db2-a200-1fbdb1ad329d tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:40.881878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fee83232-bad0-4db2-a200-1fbdb1ad329d tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:40.882305 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fee83232-bad0-4db2-a200-1fbdb1ad329d tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:40.883007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fee83232-bad0-4db2-a200-1fbdb1ad329d tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:40.883454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fee83232-bad0-4db2-a200-1fbdb1ad329d tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:40.883872 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fee83232-bad0-4db2-a200-1fbdb1ad329d tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:41.059902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c51574ae-cc17-4fa6-a9ba-f9274a54d04e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:41.060515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c51574ae-cc17-4fa6-a9ba-f9274a54d04e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:41.079768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c51574ae-cc17-4fa6-a9ba-f9274a54d04e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:41.080267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c51574ae-cc17-4fa6-a9ba-f9274a54d04e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:41.080742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c51574ae-cc17-4fa6-a9ba-f9274a54d04e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:41.081539 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c51574ae-cc17-4fa6-a9ba-f9274a54d04e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:41.081895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c51574ae-cc17-4fa6-a9ba-f9274a54d04e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:41.082317 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c51574ae-cc17-4fa6-a9ba-f9274a54d04e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:41.559484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c51574ae-cc17-4fa6-a9ba-f9274a54d04e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:41.573314 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c51574ae-cc17-4fa6-a9ba-f9274a54d04e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1690 microversion: 2.1 time: 0.520801 Oct 29 03:23:41.573906 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2891/5556] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:41 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1690 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:41.727538 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fee83232-bad0-4db2-a200-1fbdb1ad329d tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb06badda8549e3ae02e9f6222098bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab62a8a623d48dd865d5c7c96daead1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:41.740280 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fee83232-bad0-4db2-a200-1fbdb1ad329d tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] 10.222.0.46 "GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546" status: 200 len: 1269 microversion: 2.1 time: 0.881303 Oct 29 03:23:41.742422 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2666/5557] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:40 2022] GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546 => generated 1269 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:42.604656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-750702f5-1871-443e-b0ba-7cb8382bcebe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:42.605940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-750702f5-1871-443e-b0ba-7cb8382bcebe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:42.613311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-750702f5-1871-443e-b0ba-7cb8382bcebe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:42.614104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-750702f5-1871-443e-b0ba-7cb8382bcebe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:42.614759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-750702f5-1871-443e-b0ba-7cb8382bcebe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:42.615689 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-750702f5-1871-443e-b0ba-7cb8382bcebe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:42.616572 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-750702f5-1871-443e-b0ba-7cb8382bcebe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:42.617258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-750702f5-1871-443e-b0ba-7cb8382bcebe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:42.768833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-46d9eccc-7117-4403-ad70-c0410fd79085 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:42.770508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-46d9eccc-7117-4403-ad70-c0410fd79085 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] [instance: 3fa9077c-183f-48e0-898d-563797ebd546] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:42.783952 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46d9eccc-7117-4403-ad70-c0410fd79085 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:42.784844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46d9eccc-7117-4403-ad70-c0410fd79085 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:42.786118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46d9eccc-7117-4403-ad70-c0410fd79085 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:42.787099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46d9eccc-7117-4403-ad70-c0410fd79085 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:42.787796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46d9eccc-7117-4403-ad70-c0410fd79085 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:42.788416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-46d9eccc-7117-4403-ad70-c0410fd79085 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:42.961669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-750702f5-1871-443e-b0ba-7cb8382bcebe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:42.978881 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-750702f5-1871-443e-b0ba-7cb8382bcebe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1690 microversion: 2.1 time: 0.378464 Oct 29 03:23:42.980651 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2892/5558] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:42 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1690 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:43.953713 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-46d9eccc-7117-4403-ad70-c0410fd79085 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb06badda8549e3ae02e9f6222098bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab62a8a623d48dd865d5c7c96daead1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:43.964098 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-46d9eccc-7117-4403-ad70-c0410fd79085 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] 10.222.0.46 "GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546" status: 200 len: 1269 microversion: 2.1 time: 1.201168 Oct 29 03:23:43.981681 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2667/5559] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:42 2022] GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546 => generated 1269 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:44.002710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d84db038-9896-4dad-83df-d4ecbb214d05 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:44.003973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d84db038-9896-4dad-83df-d4ecbb214d05 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:44.013889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d84db038-9896-4dad-83df-d4ecbb214d05 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:44.019222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d84db038-9896-4dad-83df-d4ecbb214d05 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:44.020304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d84db038-9896-4dad-83df-d4ecbb214d05 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:44.021292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d84db038-9896-4dad-83df-d4ecbb214d05 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:44.021939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d84db038-9896-4dad-83df-d4ecbb214d05 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:44.027238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d84db038-9896-4dad-83df-d4ecbb214d05 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:44.273468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d84db038-9896-4dad-83df-d4ecbb214d05 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:44.282494 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d84db038-9896-4dad-83df-d4ecbb214d05 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1690 microversion: 2.1 time: 0.283552 Oct 29 03:23:44.282985 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2893/5560] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:43 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1690 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:23:44.995237 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d11235af-8727-41aa-aacc-91f0782da058 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:44.995966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d11235af-8727-41aa-aacc-91f0782da058 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] [instance: 3fa9077c-183f-48e0-898d-563797ebd546] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:45.005130 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d11235af-8727-41aa-aacc-91f0782da058 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:45.018562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d11235af-8727-41aa-aacc-91f0782da058 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:45.020483 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d11235af-8727-41aa-aacc-91f0782da058 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:45.022335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d11235af-8727-41aa-aacc-91f0782da058 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:45.023637 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d11235af-8727-41aa-aacc-91f0782da058 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:45.024011 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d11235af-8727-41aa-aacc-91f0782da058 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:45.310478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1468d812-48f8-457a-b1b2-af5c4b9cc548 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:45.312372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1468d812-48f8-457a-b1b2-af5c4b9cc548 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:45.342151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1468d812-48f8-457a-b1b2-af5c4b9cc548 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:45.342653 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1468d812-48f8-457a-b1b2-af5c4b9cc548 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:45.350218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1468d812-48f8-457a-b1b2-af5c4b9cc548 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:45.352138 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1468d812-48f8-457a-b1b2-af5c4b9cc548 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:45.353762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1468d812-48f8-457a-b1b2-af5c4b9cc548 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:45.355019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1468d812-48f8-457a-b1b2-af5c4b9cc548 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:45.539184 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d11235af-8727-41aa-aacc-91f0782da058 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb06badda8549e3ae02e9f6222098bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab62a8a623d48dd865d5c7c96daead1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:45.553504 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d11235af-8727-41aa-aacc-91f0782da058 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] 10.222.0.46 "GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546" status: 200 len: 1269 microversion: 2.1 time: 0.569367 Oct 29 03:23:45.558911 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2668/5561] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:44 2022] GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546 => generated 1269 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:45.744636 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1468d812-48f8-457a-b1b2-af5c4b9cc548 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:45.755054 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1468d812-48f8-457a-b1b2-af5c4b9cc548 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1695 microversion: 2.1 time: 0.451630 Oct 29 03:23:45.765150 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2894/5562] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:45 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1695 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:23:46.577571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-27ea1122-5f97-416a-bd28-9e0b46190c57 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:46.578550 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-27ea1122-5f97-416a-bd28-9e0b46190c57 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] [instance: 3fa9077c-183f-48e0-898d-563797ebd546] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:46.595598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27ea1122-5f97-416a-bd28-9e0b46190c57 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:46.597322 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27ea1122-5f97-416a-bd28-9e0b46190c57 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:46.597773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27ea1122-5f97-416a-bd28-9e0b46190c57 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:46.599760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27ea1122-5f97-416a-bd28-9e0b46190c57 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:46.602233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27ea1122-5f97-416a-bd28-9e0b46190c57 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:46.602858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-27ea1122-5f97-416a-bd28-9e0b46190c57 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:46.783711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8239db29-ff08-458a-866f-ddee1b4e63f5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:46.784869 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8239db29-ff08-458a-866f-ddee1b4e63f5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:46.795286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8239db29-ff08-458a-866f-ddee1b4e63f5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:46.796112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8239db29-ff08-458a-866f-ddee1b4e63f5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:46.796626 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8239db29-ff08-458a-866f-ddee1b4e63f5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:46.797581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8239db29-ff08-458a-866f-ddee1b4e63f5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:46.798049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8239db29-ff08-458a-866f-ddee1b4e63f5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:46.798478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8239db29-ff08-458a-866f-ddee1b4e63f5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:47.159447 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-27ea1122-5f97-416a-bd28-9e0b46190c57 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb06badda8549e3ae02e9f6222098bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab62a8a623d48dd865d5c7c96daead1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:47.169291 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-27ea1122-5f97-416a-bd28-9e0b46190c57 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] 10.222.0.46 "GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546" status: 200 len: 1269 microversion: 2.1 time: 0.597799 Oct 29 03:23:47.187853 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2669/5563] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:46 2022] GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546 => generated 1269 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:47.203561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8239db29-ff08-458a-866f-ddee1b4e63f5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:47.205910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:47.221454 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8239db29-ff08-458a-866f-ddee1b4e63f5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1695 microversion: 2.1 time: 0.444568 Oct 29 03:23:47.236550 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2895/5564] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:46 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1695 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:23:48.197549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f709caef-eecb-46f7-8665-abb64e7c0add tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:48.198222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f709caef-eecb-46f7-8665-abb64e7c0add tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] [instance: 3fa9077c-183f-48e0-898d-563797ebd546] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:48.212387 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f709caef-eecb-46f7-8665-abb64e7c0add tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:48.216192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f709caef-eecb-46f7-8665-abb64e7c0add tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:48.216832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f709caef-eecb-46f7-8665-abb64e7c0add tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:48.221356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f709caef-eecb-46f7-8665-abb64e7c0add tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:48.222699 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f709caef-eecb-46f7-8665-abb64e7c0add tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:48.224004 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f709caef-eecb-46f7-8665-abb64e7c0add tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:48.252262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a60dfa68-6cc9-4b1a-8e0a-6742ab904159 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:48.253690 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a60dfa68-6cc9-4b1a-8e0a-6742ab904159 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:48.281484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a60dfa68-6cc9-4b1a-8e0a-6742ab904159 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:48.290745 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a60dfa68-6cc9-4b1a-8e0a-6742ab904159 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:48.296017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a60dfa68-6cc9-4b1a-8e0a-6742ab904159 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:48.298596 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a60dfa68-6cc9-4b1a-8e0a-6742ab904159 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:48.318952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a60dfa68-6cc9-4b1a-8e0a-6742ab904159 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:48.320218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a60dfa68-6cc9-4b1a-8e0a-6742ab904159 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:48.878049 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f709caef-eecb-46f7-8665-abb64e7c0add tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb06badda8549e3ae02e9f6222098bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab62a8a623d48dd865d5c7c96daead1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:48.890164 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f709caef-eecb-46f7-8665-abb64e7c0add tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] 10.222.0.46 "GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546" status: 200 len: 1269 microversion: 2.1 time: 0.697485 Oct 29 03:23:48.909846 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2670/5565] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:48 2022] GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546 => generated 1269 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:49.005561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a60dfa68-6cc9-4b1a-8e0a-6742ab904159 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:49.018512 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a60dfa68-6cc9-4b1a-8e0a-6742ab904159 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1695 microversion: 2.1 time: 0.770708 Oct 29 03:23:49.036604 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2896/5566] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:48 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1695 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:23:49.331408 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-e2110539-ad2d-4008-80b6-842154d20abb req-2d588e7d-e276-49d0-af1f-39320ae1c7ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fa9077c-183f-48e0-898d-563797ebd546", "name": "network-vif-plugged", "status": "completed", "tag": "ab51c241-18f1-4ba6-9e8f-12aeb85b8a5e"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:23:49.394327 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e2110539-ad2d-4008-80b6-842154d20abb req-2d588e7d-e276-49d0-af1f-39320ae1c7ce service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:49.396453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e2110539-ad2d-4008-80b6-842154d20abb req-2d588e7d-e276-49d0-af1f-39320ae1c7ce service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:49.398246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e2110539-ad2d-4008-80b6-842154d20abb req-2d588e7d-e276-49d0-af1f-39320ae1c7ce service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:49.431957 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-e2110539-ad2d-4008-80b6-842154d20abb req-2d588e7d-e276-49d0-af1f-39320ae1c7ce service nova] Creating event network-vif-plugged:ab51c241-18f1-4ba6-9e8f-12aeb85b8a5e for instance 3fa9077c-183f-48e0-898d-563797ebd546 on n-h2-862967-2 Oct 29 03:23:49.448003 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-e2110539-ad2d-4008-80b6-842154d20abb req-2d588e7d-e276-49d0-af1f-39320ae1c7ce service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129205 Oct 29 03:23:49.450017 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2671/5567] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:23:49.918347 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-972979d0-104f-48cd-b70e-d1dc793de458 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:49.919210 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-972979d0-104f-48cd-b70e-d1dc793de458 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] [instance: 3fa9077c-183f-48e0-898d-563797ebd546] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:49.929450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-972979d0-104f-48cd-b70e-d1dc793de458 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:49.930158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-972979d0-104f-48cd-b70e-d1dc793de458 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:49.930776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-972979d0-104f-48cd-b70e-d1dc793de458 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:49.931964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-972979d0-104f-48cd-b70e-d1dc793de458 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:49.932984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-972979d0-104f-48cd-b70e-d1dc793de458 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:49.940671 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-972979d0-104f-48cd-b70e-d1dc793de458 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:50.045242 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6a637f6e-5df9-48a4-9527-7b6558d1139e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:50.046156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6a637f6e-5df9-48a4-9527-7b6558d1139e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:50.059748 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a637f6e-5df9-48a4-9527-7b6558d1139e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:50.062608 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a637f6e-5df9-48a4-9527-7b6558d1139e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:50.063234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a637f6e-5df9-48a4-9527-7b6558d1139e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:50.065656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a637f6e-5df9-48a4-9527-7b6558d1139e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:50.066440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a637f6e-5df9-48a4-9527-7b6558d1139e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:50.067351 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a637f6e-5df9-48a4-9527-7b6558d1139e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:50.394190 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-972979d0-104f-48cd-b70e-d1dc793de458 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb06badda8549e3ae02e9f6222098bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab62a8a623d48dd865d5c7c96daead1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:50.403436 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-972979d0-104f-48cd-b70e-d1dc793de458 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] 10.222.0.46 "GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546" status: 200 len: 1269 microversion: 2.1 time: 0.489700 Oct 29 03:23:50.413508 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2897/5568] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:49 2022] GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546 => generated 1269 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:50.562148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6a637f6e-5df9-48a4-9527-7b6558d1139e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:50.573954 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6a637f6e-5df9-48a4-9527-7b6558d1139e tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1695 microversion: 2.1 time: 0.534051 Oct 29 03:23:50.575645 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2672/5569] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:50 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1695 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:23:51.435861 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0bec8113-8773-4b64-b501-5d61037ddb30 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:51.436882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0bec8113-8773-4b64-b501-5d61037ddb30 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] [instance: 3fa9077c-183f-48e0-898d-563797ebd546] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:51.450442 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0bec8113-8773-4b64-b501-5d61037ddb30 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:51.455784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0bec8113-8773-4b64-b501-5d61037ddb30 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:51.456511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0bec8113-8773-4b64-b501-5d61037ddb30 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:51.459883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0bec8113-8773-4b64-b501-5d61037ddb30 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:51.461148 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0bec8113-8773-4b64-b501-5d61037ddb30 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:51.463963 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0bec8113-8773-4b64-b501-5d61037ddb30 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:51.600546 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-38d1d3ae-757d-4b09-8684-eff4215202a5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:51.601341 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-38d1d3ae-757d-4b09-8684-eff4215202a5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:51.624342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-38d1d3ae-757d-4b09-8684-eff4215202a5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:51.625076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-38d1d3ae-757d-4b09-8684-eff4215202a5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:51.625638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-38d1d3ae-757d-4b09-8684-eff4215202a5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:51.628772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-38d1d3ae-757d-4b09-8684-eff4215202a5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:51.629658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-38d1d3ae-757d-4b09-8684-eff4215202a5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:51.630320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-38d1d3ae-757d-4b09-8684-eff4215202a5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:51.995959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-38d1d3ae-757d-4b09-8684-eff4215202a5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:52.009498 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-38d1d3ae-757d-4b09-8684-eff4215202a5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1695 microversion: 2.1 time: 0.412912 Oct 29 03:23:52.010848 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2673/5570] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:51 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1695 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:23:52.050509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0bec8113-8773-4b64-b501-5d61037ddb30 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb06badda8549e3ae02e9f6222098bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab62a8a623d48dd865d5c7c96daead1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:52.066024 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0bec8113-8773-4b64-b501-5d61037ddb30 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] 10.222.0.46 "GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546" status: 200 len: 1457 microversion: 2.1 time: 0.634500 Oct 29 03:23:52.066620 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2898/5571] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:51 2022] GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546 => generated 1457 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:52.102113 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a19cfe87-fbe0-45ba-ab5c-2b026fc5b649 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:52.103075 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a19cfe87-fbe0-45ba-ab5c-2b026fc5b649 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] [instance: 3fa9077c-183f-48e0-898d-563797ebd546] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:52.125507 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a19cfe87-fbe0-45ba-ab5c-2b026fc5b649 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:52.126630 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a19cfe87-fbe0-45ba-ab5c-2b026fc5b649 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:52.127176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a19cfe87-fbe0-45ba-ab5c-2b026fc5b649 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:52.128027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a19cfe87-fbe0-45ba-ab5c-2b026fc5b649 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:52.133729 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a19cfe87-fbe0-45ba-ab5c-2b026fc5b649 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:52.134534 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a19cfe87-fbe0-45ba-ab5c-2b026fc5b649 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:52.784818 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a19cfe87-fbe0-45ba-ab5c-2b026fc5b649 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb06badda8549e3ae02e9f6222098bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab62a8a623d48dd865d5c7c96daead1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:52.801219 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a19cfe87-fbe0-45ba-ab5c-2b026fc5b649 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] 10.222.0.46 "GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546" status: 200 len: 1457 microversion: 2.1 time: 0.702941 Oct 29 03:23:52.817672 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2674/5572] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:52 2022] GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546 => generated 1457 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:53.047099 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9161b3bc-8e50-48ab-8573-f978808e82c5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:53.049408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9161b3bc-8e50-48ab-8573-f978808e82c5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:53.079758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9161b3bc-8e50-48ab-8573-f978808e82c5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:53.083434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9161b3bc-8e50-48ab-8573-f978808e82c5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:53.085832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9161b3bc-8e50-48ab-8573-f978808e82c5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:53.090291 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9161b3bc-8e50-48ab-8573-f978808e82c5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:53.095663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9161b3bc-8e50-48ab-8573-f978808e82c5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:53.097265 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9161b3bc-8e50-48ab-8573-f978808e82c5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:53.559393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9161b3bc-8e50-48ab-8573-f978808e82c5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:53.571684 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9161b3bc-8e50-48ab-8573-f978808e82c5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1695 microversion: 2.1 time: 0.529134 Oct 29 03:23:53.580261 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2899/5573] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:53 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1695 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:54.605245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b2f877ac-dbdc-4f2a-96d7-c95d32e73c10 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:54.605982 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b2f877ac-dbdc-4f2a-96d7-c95d32e73c10 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:54.621153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b2f877ac-dbdc-4f2a-96d7-c95d32e73c10 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:54.622770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b2f877ac-dbdc-4f2a-96d7-c95d32e73c10 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:54.625012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b2f877ac-dbdc-4f2a-96d7-c95d32e73c10 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:54.625990 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b2f877ac-dbdc-4f2a-96d7-c95d32e73c10 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:54.627969 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b2f877ac-dbdc-4f2a-96d7-c95d32e73c10 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:54.628967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b2f877ac-dbdc-4f2a-96d7-c95d32e73c10 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:55.413439 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b2f877ac-dbdc-4f2a-96d7-c95d32e73c10 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:55.424203 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b2f877ac-dbdc-4f2a-96d7-c95d32e73c10 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1695 microversion: 2.1 time: 0.823853 Oct 29 03:23:55.431545 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2675/5574] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:54 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1695 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:56.462537 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-20b4e735-4753-4439-8af3-837821c28167 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:56.463165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-20b4e735-4753-4439-8af3-837821c28167 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:56.475998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20b4e735-4753-4439-8af3-837821c28167 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:56.479672 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20b4e735-4753-4439-8af3-837821c28167 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:56.482673 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20b4e735-4753-4439-8af3-837821c28167 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:56.483654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20b4e735-4753-4439-8af3-837821c28167 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:56.486209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20b4e735-4753-4439-8af3-837821c28167 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:56.486669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20b4e735-4753-4439-8af3-837821c28167 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:57.008985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-20b4e735-4753-4439-8af3-837821c28167 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:57.025413 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-20b4e735-4753-4439-8af3-837821c28167 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1695 microversion: 2.1 time: 0.570938 Oct 29 03:23:57.026226 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2900/5575] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:56 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1695 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:57.900972 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-da9c743c-9ff3-4ee6-aa44-3c206089fee1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-25255011", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "ca8e0bef-c1ec-47bd-9591-43a816db6a16"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:23:58.012794 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-da9c743c-9ff3-4ee6-aa44-3c206089fee1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] validate_networks() for [('ca8e0bef-c1ec-47bd-9591-43a816db6a16', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:23:58.058819 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a0935654-becf-4b7c-a22b-d3792a2b9041 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:58.059564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a0935654-becf-4b7c-a22b-d3792a2b9041 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:58.075163 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a0935654-becf-4b7c-a22b-d3792a2b9041 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:58.077092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a0935654-becf-4b7c-a22b-d3792a2b9041 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:58.078676 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a0935654-becf-4b7c-a22b-d3792a2b9041 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:58.080714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a0935654-becf-4b7c-a22b-d3792a2b9041 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:58.082186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a0935654-becf-4b7c-a22b-d3792a2b9041 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:58.083438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a0935654-becf-4b7c-a22b-d3792a2b9041 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:58.958880 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a0935654-becf-4b7c-a22b-d3792a2b9041 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:23:58.969799 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a0935654-becf-4b7c-a22b-d3792a2b9041 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1694 microversion: 2.1 time: 0.920693 Oct 29 03:23:58.978174 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2901/5576] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:58 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1694 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:23:59.009696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-6140c0f2-c755-49ed-9165-7bd009aa7ee9 req-f9c7e6da-509b-408b-a54a-d5360b9a9a3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c079f7ae-3459-468a-a699-b54f5df31e41", "name": "network-vif-unplugged", "status": "completed", "tag": "48355ce5-2082-4f79-98bc-fdccde7f4f8f"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:23:59.038689 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-6140c0f2-c755-49ed-9165-7bd009aa7ee9 req-f9c7e6da-509b-408b-a54a-d5360b9a9a3e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:59.044136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-6140c0f2-c755-49ed-9165-7bd009aa7ee9 req-f9c7e6da-509b-408b-a54a-d5360b9a9a3e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:59.050255 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-6140c0f2-c755-49ed-9165-7bd009aa7ee9 req-f9c7e6da-509b-408b-a54a-d5360b9a9a3e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:59.071409 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-6140c0f2-c755-49ed-9165-7bd009aa7ee9 req-f9c7e6da-509b-408b-a54a-d5360b9a9a3e service nova] Creating event network-vif-unplugged:48355ce5-2082-4f79-98bc-fdccde7f4f8f for instance c079f7ae-3459-468a-a699-b54f5df31e41 on n-h2-862967-2 Oct 29 03:23:59.081653 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [req-6140c0f2-c755-49ed-9165-7bd009aa7ee9 req-f9c7e6da-509b-408b-a54a-d5360b9a9a3e service nova] Instance c079f7ae-3459-468a-a699-b54f5df31e41 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:23:59.108868 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-6140c0f2-c755-49ed-9165-7bd009aa7ee9 req-f9c7e6da-509b-408b-a54a-d5360b9a9a3e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128854 Oct 29 03:23:59.109527 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2902/5577] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:23:59.544408 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-da9c743c-9ff3-4ee6-aa44-3c206089fee1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:23:59.548045 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-da9c743c-9ff3-4ee6-aa44-3c206089fee1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:23:59.549927 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-da9c743c-9ff3-4ee6-aa44-3c206089fee1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:23:59.550778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-da9c743c-9ff3-4ee6-aa44-3c206089fee1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:23:59.551487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-da9c743c-9ff3-4ee6-aa44-3c206089fee1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:23:59.568263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da9c743c-9ff3-4ee6-aa44-3c206089fee1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:59.569178 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da9c743c-9ff3-4ee6-aa44-3c206089fee1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:59.569861 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da9c743c-9ff3-4ee6-aa44-3c206089fee1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:59.572306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da9c743c-9ff3-4ee6-aa44-3c206089fee1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:59.574350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da9c743c-9ff3-4ee6-aa44-3c206089fee1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:59.577798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da9c743c-9ff3-4ee6-aa44-3c206089fee1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:59.632732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-da9c743c-9ff3-4ee6-aa44-3c206089fee1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Getting quotas for project af30f7beecad4c448ff0706230ecb8d9. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:23:59.641515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-da9c743c-9ff3-4ee6-aa44-3c206089fee1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Getting quotas for user 50ec777bf8ea4a9eb7d9d6cf995ba4ef and project af30f7beecad4c448ff0706230ecb8d9. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:23:59.660883 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-da9c743c-9ff3-4ee6-aa44-3c206089fee1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:23:59.663806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-da9c743c-9ff3-4ee6-aa44-3c206089fee1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 27b96381-fce8-4748-b7e8-01b474c7067c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:23:59.744376 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-da9c743c-9ff3-4ee6-aa44-3c206089fee1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.141495 Oct 29 03:23:59.746205 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2676/5578] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:23:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:23:59.759198 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-16736da4-f085-4b66-a5e8-354ff9bfe0fc tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:23:59.759900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-16736da4-f085-4b66-a5e8-354ff9bfe0fc tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 27b96381-fce8-4748-b7e8-01b474c7067c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:23:59.794324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-b78b3a3b-56ea-4cb5-aa2d-5d9ad5a29fd9 req-0ac8b65d-0266-42ae-a8c3-4ac204f24a04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fa9077c-183f-48e0-898d-563797ebd546", "tag": "ab51c241-18f1-4ba6-9e8f-12aeb85b8a5e"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:23:59.813045 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b78b3a3b-56ea-4cb5-aa2d-5d9ad5a29fd9 req-0ac8b65d-0266-42ae-a8c3-4ac204f24a04 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:23:59.814863 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b78b3a3b-56ea-4cb5-aa2d-5d9ad5a29fd9 req-0ac8b65d-0266-42ae-a8c3-4ac204f24a04 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:23:59.815390 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b78b3a3b-56ea-4cb5-aa2d-5d9ad5a29fd9 req-0ac8b65d-0266-42ae-a8c3-4ac204f24a04 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:23:59.860739 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-b78b3a3b-56ea-4cb5-aa2d-5d9ad5a29fd9 req-0ac8b65d-0266-42ae-a8c3-4ac204f24a04 service nova] Creating event network-changed:ab51c241-18f1-4ba6-9e8f-12aeb85b8a5e for instance 3fa9077c-183f-48e0-898d-563797ebd546 on n-h2-862967-2 Oct 29 03:23:59.878617 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-b78b3a3b-56ea-4cb5-aa2d-5d9ad5a29fd9 req-0ac8b65d-0266-42ae-a8c3-4ac204f24a04 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089660 Oct 29 03:23:59.879812 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2677/5579] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:24:00.005393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-44dc1fe5-57b6-4c6b-91bb-e4c5b509eb1c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:00.006414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-44dc1fe5-57b6-4c6b-91bb-e4c5b509eb1c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:00.022924 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44dc1fe5-57b6-4c6b-91bb-e4c5b509eb1c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:00.024544 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44dc1fe5-57b6-4c6b-91bb-e4c5b509eb1c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:00.027369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44dc1fe5-57b6-4c6b-91bb-e4c5b509eb1c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:00.032731 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44dc1fe5-57b6-4c6b-91bb-e4c5b509eb1c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:00.033524 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44dc1fe5-57b6-4c6b-91bb-e4c5b509eb1c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:00.037164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44dc1fe5-57b6-4c6b-91bb-e4c5b509eb1c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:00.096987 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-16736da4-f085-4b66-a5e8-354ff9bfe0fc tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:00.123196 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-16736da4-f085-4b66-a5e8-354ff9bfe0fc tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c" status: 200 len: 1191 microversion: 2.1 time: 0.368980 Oct 29 03:24:00.123833 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2903/5580] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:59 2022] GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c => generated 1191 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:00.506493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-44dc1fe5-57b6-4c6b-91bb-e4c5b509eb1c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:00.514853 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-44dc1fe5-57b6-4c6b-91bb-e4c5b509eb1c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1694 microversion: 2.1 time: 0.513825 Oct 29 03:24:00.515513 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2678/5581] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:23:59 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1694 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:24:01.153250 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7a418e4f-9a7c-4fc9-a3cd-017882677a6a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:01.156229 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7a418e4f-9a7c-4fc9-a3cd-017882677a6a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 27b96381-fce8-4748-b7e8-01b474c7067c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:01.180688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7a418e4f-9a7c-4fc9-a3cd-017882677a6a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:01.181439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7a418e4f-9a7c-4fc9-a3cd-017882677a6a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:01.182383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7a418e4f-9a7c-4fc9-a3cd-017882677a6a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:01.183307 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7a418e4f-9a7c-4fc9-a3cd-017882677a6a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:01.183960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7a418e4f-9a7c-4fc9-a3cd-017882677a6a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:01.184766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7a418e4f-9a7c-4fc9-a3cd-017882677a6a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:01.277279 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-7da2672a-76dc-4cdc-b40a-c678e0ea2e6f req-463096df-bc59-4d4e-a82a-2acb98918e99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c079f7ae-3459-468a-a699-b54f5df31e41", "tag": "48355ce5-2082-4f79-98bc-fdccde7f4f8f"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:24:01.294770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7da2672a-76dc-4cdc-b40a-c678e0ea2e6f req-463096df-bc59-4d4e-a82a-2acb98918e99 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:01.302885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7da2672a-76dc-4cdc-b40a-c678e0ea2e6f req-463096df-bc59-4d4e-a82a-2acb98918e99 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:01.306321 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7da2672a-76dc-4cdc-b40a-c678e0ea2e6f req-463096df-bc59-4d4e-a82a-2acb98918e99 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:01.360826 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-7da2672a-76dc-4cdc-b40a-c678e0ea2e6f req-463096df-bc59-4d4e-a82a-2acb98918e99 service nova] Creating event network-changed:48355ce5-2082-4f79-98bc-fdccde7f4f8f for instance c079f7ae-3459-468a-a699-b54f5df31e41 on n-h2-862967-2 Oct 29 03:24:01.377848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [req-7da2672a-76dc-4cdc-b40a-c678e0ea2e6f req-463096df-bc59-4d4e-a82a-2acb98918e99 service nova] Instance c079f7ae-3459-468a-a699-b54f5df31e41 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:24:01.422042 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-7da2672a-76dc-4cdc-b40a-c678e0ea2e6f req-463096df-bc59-4d4e-a82a-2acb98918e99 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147197 Oct 29 03:24:01.423566 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2679/5582] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:24:01.539338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8c4a8695-6fa6-4697-b156-5e016e252eed tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:01.540410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8c4a8695-6fa6-4697-b156-5e016e252eed tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:01.559810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c4a8695-6fa6-4697-b156-5e016e252eed tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:01.560712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c4a8695-6fa6-4697-b156-5e016e252eed tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:01.561382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c4a8695-6fa6-4697-b156-5e016e252eed tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:01.564795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c4a8695-6fa6-4697-b156-5e016e252eed tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:01.565569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c4a8695-6fa6-4697-b156-5e016e252eed tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:01.566210 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c4a8695-6fa6-4697-b156-5e016e252eed tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:02.212040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7a418e4f-9a7c-4fc9-a3cd-017882677a6a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:02.227330 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7a418e4f-9a7c-4fc9-a3cd-017882677a6a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c" status: 200 len: 1243 microversion: 2.1 time: 1.085024 Oct 29 03:24:02.229581 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2904/5583] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:01 2022] GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c => generated 1243 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:02.751272 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8c4a8695-6fa6-4697-b156-5e016e252eed tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:02.765236 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8c4a8695-6fa6-4697-b156-5e016e252eed tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1694 microversion: 2.1 time: 1.230363 Oct 29 03:24:02.765895 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2680/5584] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:01 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1694 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:03.051199 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-e6871198-b1a6-4be5-bdde-5514daf3f50a req-bc159edb-8f25-45e4-80f6-2bdb4eca5d19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fa9077c-183f-48e0-898d-563797ebd546", "tag": "ab51c241-18f1-4ba6-9e8f-12aeb85b8a5e"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:24:03.087039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e6871198-b1a6-4be5-bdde-5514daf3f50a req-bc159edb-8f25-45e4-80f6-2bdb4eca5d19 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:03.087895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e6871198-b1a6-4be5-bdde-5514daf3f50a req-bc159edb-8f25-45e4-80f6-2bdb4eca5d19 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:03.088579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e6871198-b1a6-4be5-bdde-5514daf3f50a req-bc159edb-8f25-45e4-80f6-2bdb4eca5d19 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:03.116913 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-e6871198-b1a6-4be5-bdde-5514daf3f50a req-bc159edb-8f25-45e4-80f6-2bdb4eca5d19 service nova] Creating event network-changed:ab51c241-18f1-4ba6-9e8f-12aeb85b8a5e for instance 3fa9077c-183f-48e0-898d-563797ebd546 on n-h2-862967-2 Oct 29 03:24:03.129875 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-e6871198-b1a6-4be5-bdde-5514daf3f50a req-bc159edb-8f25-45e4-80f6-2bdb4eca5d19 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083422 Oct 29 03:24:03.136941 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2905/5585] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:24:03.258389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fa13b75d-a45f-424a-ac65-cfe2d902f782 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:03.259545 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fa13b75d-a45f-424a-ac65-cfe2d902f782 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 27b96381-fce8-4748-b7e8-01b474c7067c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:03.270835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa13b75d-a45f-424a-ac65-cfe2d902f782 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:03.277336 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa13b75d-a45f-424a-ac65-cfe2d902f782 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:03.278610 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa13b75d-a45f-424a-ac65-cfe2d902f782 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:03.279498 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa13b75d-a45f-424a-ac65-cfe2d902f782 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:03.283196 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa13b75d-a45f-424a-ac65-cfe2d902f782 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:03.292749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fa13b75d-a45f-424a-ac65-cfe2d902f782 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:03.588441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fa13b75d-a45f-424a-ac65-cfe2d902f782 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:03.602969 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fa13b75d-a45f-424a-ac65-cfe2d902f782 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c" status: 200 len: 1249 microversion: 2.1 time: 0.349089 Oct 29 03:24:03.609946 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2681/5586] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:03 2022] GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c => generated 1249 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:24:03.804449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-99996f00-7cac-4d5f-b509-18cb1072c9f4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:03.814107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-99996f00-7cac-4d5f-b509-18cb1072c9f4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:03.837990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-99996f00-7cac-4d5f-b509-18cb1072c9f4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:03.838410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-99996f00-7cac-4d5f-b509-18cb1072c9f4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:03.839351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-99996f00-7cac-4d5f-b509-18cb1072c9f4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:03.840514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-99996f00-7cac-4d5f-b509-18cb1072c9f4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:03.841345 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-99996f00-7cac-4d5f-b509-18cb1072c9f4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:03.841933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-99996f00-7cac-4d5f-b509-18cb1072c9f4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:04.110061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-99996f00-7cac-4d5f-b509-18cb1072c9f4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:04.125852 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-99996f00-7cac-4d5f-b509-18cb1072c9f4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1692 microversion: 2.1 time: 0.337880 Oct 29 03:24:04.126729 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2906/5587] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:03 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1692 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:04.632487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-01e37379-7c29-4552-8d6b-5a5bf9cefc76 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:04.633768 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-01e37379-7c29-4552-8d6b-5a5bf9cefc76 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 27b96381-fce8-4748-b7e8-01b474c7067c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:04.649385 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01e37379-7c29-4552-8d6b-5a5bf9cefc76 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:04.649904 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01e37379-7c29-4552-8d6b-5a5bf9cefc76 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:04.650337 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01e37379-7c29-4552-8d6b-5a5bf9cefc76 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:04.652440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01e37379-7c29-4552-8d6b-5a5bf9cefc76 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:04.652940 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01e37379-7c29-4552-8d6b-5a5bf9cefc76 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:04.653375 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01e37379-7c29-4552-8d6b-5a5bf9cefc76 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:04.727513 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:05.154061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-79ab21b4-2791-4d2c-ab46-542755d0b863 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:05.154722 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-79ab21b4-2791-4d2c-ab46-542755d0b863 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:05.181192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79ab21b4-2791-4d2c-ab46-542755d0b863 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:05.182013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79ab21b4-2791-4d2c-ab46-542755d0b863 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:05.184776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79ab21b4-2791-4d2c-ab46-542755d0b863 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:05.187219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79ab21b4-2791-4d2c-ab46-542755d0b863 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:05.193722 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79ab21b4-2791-4d2c-ab46-542755d0b863 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:05.194759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79ab21b4-2791-4d2c-ab46-542755d0b863 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:05.290074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-01e37379-7c29-4552-8d6b-5a5bf9cefc76 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:05.308773 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-01e37379-7c29-4552-8d6b-5a5bf9cefc76 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c" status: 200 len: 1291 microversion: 2.1 time: 0.678536 Oct 29 03:24:05.319592 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2682/5588] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:04 2022] GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c => generated 1291 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:05.334849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-92c62546-1ea4-4a08-a0c3-2c0367a7df81 req-86c38db7-cefa-43ad-bebb-9d1108019bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fa9077c-183f-48e0-898d-563797ebd546", "tag": "ab51c241-18f1-4ba6-9e8f-12aeb85b8a5e"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:24:05.340546 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:05.366724 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-92c62546-1ea4-4a08-a0c3-2c0367a7df81 req-86c38db7-cefa-43ad-bebb-9d1108019bd5 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:05.367565 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-92c62546-1ea4-4a08-a0c3-2c0367a7df81 req-86c38db7-cefa-43ad-bebb-9d1108019bd5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:05.368174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-92c62546-1ea4-4a08-a0c3-2c0367a7df81 req-86c38db7-cefa-43ad-bebb-9d1108019bd5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:05.399039 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-92c62546-1ea4-4a08-a0c3-2c0367a7df81 req-86c38db7-cefa-43ad-bebb-9d1108019bd5 service nova] Creating event network-changed:ab51c241-18f1-4ba6-9e8f-12aeb85b8a5e for instance 3fa9077c-183f-48e0-898d-563797ebd546 on n-h2-862967-2 Oct 29 03:24:05.412988 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-92c62546-1ea4-4a08-a0c3-2c0367a7df81 req-86c38db7-cefa-43ad-bebb-9d1108019bd5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087592 Oct 29 03:24:05.413675 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2683/5589] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:24:05.806339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-79ab21b4-2791-4d2c-ab46-542755d0b863 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:05.821392 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-79ab21b4-2791-4d2c-ab46-542755d0b863 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1689 microversion: 2.1 time: 0.669126 Oct 29 03:24:05.824132 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2907/5590] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:05 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1689 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:05.848475 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ec9ee9ce-979f-43e2-9b70-200d91a16504 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:24:05.850654 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ec9ee9ce-979f-43e2-9b70-200d91a16504 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:05.866278 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec9ee9ce-979f-43e2-9b70-200d91a16504 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:05.867909 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec9ee9ce-979f-43e2-9b70-200d91a16504 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:05.870804 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec9ee9ce-979f-43e2-9b70-200d91a16504 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:05.873944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec9ee9ce-979f-43e2-9b70-200d91a16504 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:05.874645 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec9ee9ce-979f-43e2-9b70-200d91a16504 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:05.875704 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec9ee9ce-979f-43e2-9b70-200d91a16504 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:06.179212 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ec9ee9ce-979f-43e2-9b70-200d91a16504 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "POST /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41/action" status: 202 len: 0 microversion: 2.1 time: 0.334329 Oct 29 03:24:06.184342 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2684/5591] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:24:05 2022] POST /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:24:06.199149 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-722cb58f-6f74-4819-81ab-11c537c928cf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:06.200008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-722cb58f-6f74-4819-81ab-11c537c928cf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:06.221146 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-722cb58f-6f74-4819-81ab-11c537c928cf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:06.222022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-722cb58f-6f74-4819-81ab-11c537c928cf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:06.225859 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-722cb58f-6f74-4819-81ab-11c537c928cf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:06.229538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-722cb58f-6f74-4819-81ab-11c537c928cf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:06.230684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-722cb58f-6f74-4819-81ab-11c537c928cf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:06.233669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-722cb58f-6f74-4819-81ab-11c537c928cf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:06.337517 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a64dc65b-c0e1-4e8b-aded-016ebd204112 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:06.339200 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a64dc65b-c0e1-4e8b-aded-016ebd204112 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 27b96381-fce8-4748-b7e8-01b474c7067c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:06.348957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a64dc65b-c0e1-4e8b-aded-016ebd204112 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:06.352785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a64dc65b-c0e1-4e8b-aded-016ebd204112 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:06.353918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a64dc65b-c0e1-4e8b-aded-016ebd204112 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:06.354918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a64dc65b-c0e1-4e8b-aded-016ebd204112 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:06.358682 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a64dc65b-c0e1-4e8b-aded-016ebd204112 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:06.359886 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a64dc65b-c0e1-4e8b-aded-016ebd204112 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:06.585210 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a64dc65b-c0e1-4e8b-aded-016ebd204112 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:06.597108 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a64dc65b-c0e1-4e8b-aded-016ebd204112 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c" status: 200 len: 1291 microversion: 2.1 time: 0.263449 Oct 29 03:24:06.597779 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2685/5592] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:06 2022] GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c => generated 1291 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:24:06.738493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-722cb58f-6f74-4819-81ab-11c537c928cf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:06.748549 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-722cb58f-6f74-4819-81ab-11c537c928cf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1688 microversion: 2.1 time: 0.563547 Oct 29 03:24:06.757545 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2908/5593] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:06 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1688 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:07.456462 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-92886039-50fd-4555-ab4a-5107e7ba8d61 req-2e1736cc-3b2d-4f0a-a526-a04fa6c5e825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27b96381-fce8-4748-b7e8-01b474c7067c", "tag": "6084388e-a2b4-4f6a-9edf-b57ee1197683"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:24:07.474683 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-92886039-50fd-4555-ab4a-5107e7ba8d61 req-2e1736cc-3b2d-4f0a-a526-a04fa6c5e825 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:07.485717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-92886039-50fd-4555-ab4a-5107e7ba8d61 req-2e1736cc-3b2d-4f0a-a526-a04fa6c5e825 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:07.486516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-92886039-50fd-4555-ab4a-5107e7ba8d61 req-2e1736cc-3b2d-4f0a-a526-a04fa6c5e825 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:07.512880 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-92886039-50fd-4555-ab4a-5107e7ba8d61 req-2e1736cc-3b2d-4f0a-a526-a04fa6c5e825 service nova] Creating event network-changed:6084388e-a2b4-4f6a-9edf-b57ee1197683 for instance 27b96381-fce8-4748-b7e8-01b474c7067c on n-h2-862967-2 Oct 29 03:24:07.520670 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-92886039-50fd-4555-ab4a-5107e7ba8d61 req-2e1736cc-3b2d-4f0a-a526-a04fa6c5e825 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067810 Oct 29 03:24:07.521898 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2686/5594] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:24:07.619858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ff87a888-cb56-49b5-871f-d75a2f01d758 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:07.621625 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ff87a888-cb56-49b5-871f-d75a2f01d758 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 27b96381-fce8-4748-b7e8-01b474c7067c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:07.629897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff87a888-cb56-49b5-871f-d75a2f01d758 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:07.630449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff87a888-cb56-49b5-871f-d75a2f01d758 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:07.631093 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff87a888-cb56-49b5-871f-d75a2f01d758 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:07.632044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff87a888-cb56-49b5-871f-d75a2f01d758 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:07.632640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff87a888-cb56-49b5-871f-d75a2f01d758 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:07.633222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff87a888-cb56-49b5-871f-d75a2f01d758 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:07.792341 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-482a7575-f1b6-4481-bb7a-dd9b842654ee tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:07.793084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-482a7575-f1b6-4481-bb7a-dd9b842654ee tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:07.803796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-482a7575-f1b6-4481-bb7a-dd9b842654ee tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:07.809223 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-482a7575-f1b6-4481-bb7a-dd9b842654ee tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:07.809982 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-482a7575-f1b6-4481-bb7a-dd9b842654ee tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:07.810993 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-482a7575-f1b6-4481-bb7a-dd9b842654ee tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:07.811885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-482a7575-f1b6-4481-bb7a-dd9b842654ee tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:07.817002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-482a7575-f1b6-4481-bb7a-dd9b842654ee tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:07.881797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ff87a888-cb56-49b5-871f-d75a2f01d758 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:07.892736 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ff87a888-cb56-49b5-871f-d75a2f01d758 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c" status: 200 len: 1291 microversion: 2.1 time: 0.277062 Oct 29 03:24:07.893897 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2909/5595] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:07 2022] GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c => generated 1291 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:24:08.109079 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-482a7575-f1b6-4481-bb7a-dd9b842654ee tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:08.121517 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-482a7575-f1b6-4481-bb7a-dd9b842654ee tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1688 microversion: 2.1 time: 0.340120 Oct 29 03:24:08.122121 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2687/5596] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:07 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1688 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:08.926699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1d227127-a1c1-4a94-b7a0-997960542471 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:08.927356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1d227127-a1c1-4a94-b7a0-997960542471 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 27b96381-fce8-4748-b7e8-01b474c7067c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:08.938761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d227127-a1c1-4a94-b7a0-997960542471 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:08.940929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d227127-a1c1-4a94-b7a0-997960542471 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:08.942063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d227127-a1c1-4a94-b7a0-997960542471 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:08.945372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d227127-a1c1-4a94-b7a0-997960542471 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:08.947840 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d227127-a1c1-4a94-b7a0-997960542471 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:08.949000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d227127-a1c1-4a94-b7a0-997960542471 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:09.168627 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-89e2ac8d-35dd-437e-b6f8-c9908e881005 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:09.170327 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-89e2ac8d-35dd-437e-b6f8-c9908e881005 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:09.199727 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89e2ac8d-35dd-437e-b6f8-c9908e881005 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:09.200913 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89e2ac8d-35dd-437e-b6f8-c9908e881005 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:09.201698 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89e2ac8d-35dd-437e-b6f8-c9908e881005 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:09.203441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89e2ac8d-35dd-437e-b6f8-c9908e881005 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:09.204887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89e2ac8d-35dd-437e-b6f8-c9908e881005 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:09.205706 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89e2ac8d-35dd-437e-b6f8-c9908e881005 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:09.616765 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-89e2ac8d-35dd-437e-b6f8-c9908e881005 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:09.620161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:09.633061 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-89e2ac8d-35dd-437e-b6f8-c9908e881005 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1688 microversion: 2.1 time: 0.480968 Oct 29 03:24:09.637847 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2688/5597] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:09 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1688 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:09.663608 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:09.694281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1d227127-a1c1-4a94-b7a0-997960542471 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:09.705211 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1d227127-a1c1-4a94-b7a0-997960542471 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c" status: 200 len: 1291 microversion: 2.1 time: 0.783424 Oct 29 03:24:09.710405 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2910/5598] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:08 2022] GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c => generated 1291 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:09.781087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-d5851ff2-991d-497f-a459-7375d5d619f2 req-d72c8d47-23a0-45cf-870c-d8208c116ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c079f7ae-3459-468a-a699-b54f5df31e41", "name": "network-vif-plugged", "status": "completed", "tag": "48355ce5-2082-4f79-98bc-fdccde7f4f8f"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:24:09.791630 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d5851ff2-991d-497f-a459-7375d5d619f2 req-d72c8d47-23a0-45cf-870c-d8208c116ee5 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:09.792093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d5851ff2-991d-497f-a459-7375d5d619f2 req-d72c8d47-23a0-45cf-870c-d8208c116ee5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:09.792552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d5851ff2-991d-497f-a459-7375d5d619f2 req-d72c8d47-23a0-45cf-870c-d8208c116ee5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:09.807374 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-d5851ff2-991d-497f-a459-7375d5d619f2 req-d72c8d47-23a0-45cf-870c-d8208c116ee5 service nova] Creating event network-vif-plugged:48355ce5-2082-4f79-98bc-fdccde7f4f8f for instance c079f7ae-3459-468a-a699-b54f5df31e41 on n-h2-862967-2 Oct 29 03:24:09.813786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [req-d5851ff2-991d-497f-a459-7375d5d619f2 req-d72c8d47-23a0-45cf-870c-d8208c116ee5 service nova] Instance c079f7ae-3459-468a-a699-b54f5df31e41 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:24:09.833145 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-d5851ff2-991d-497f-a459-7375d5d619f2 req-d72c8d47-23a0-45cf-870c-d8208c116ee5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193749 Oct 29 03:24:09.834342 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2689/5599] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:24:10.678744 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-26f68925-0f3c-4401-83b0-b1d9f702a9a0 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:10.679366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-26f68925-0f3c-4401-83b0-b1d9f702a9a0 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:10.686948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:10.688273 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=44 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:10.690206 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-26f68925-0f3c-4401-83b0-b1d9f702a9a0 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:10.691239 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-26f68925-0f3c-4401-83b0-b1d9f702a9a0 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:10.692031 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-26f68925-0f3c-4401-83b0-b1d9f702a9a0 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:10.693175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-26f68925-0f3c-4401-83b0-b1d9f702a9a0 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:10.693955 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-26f68925-0f3c-4401-83b0-b1d9f702a9a0 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:10.695126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-26f68925-0f3c-4401-83b0-b1d9f702a9a0 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:10.762725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7f358436-8c75-4af3-831c-a3de118c081b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:10.763501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7f358436-8c75-4af3-831c-a3de118c081b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 27b96381-fce8-4748-b7e8-01b474c7067c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:10.823049 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f358436-8c75-4af3-831c-a3de118c081b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:10.823378 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f358436-8c75-4af3-831c-a3de118c081b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:10.823827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f358436-8c75-4af3-831c-a3de118c081b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:10.824606 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f358436-8c75-4af3-831c-a3de118c081b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:10.830530 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f358436-8c75-4af3-831c-a3de118c081b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:10.833335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f358436-8c75-4af3-831c-a3de118c081b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:11.081611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-26f68925-0f3c-4401-83b0-b1d9f702a9a0 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:11.094341 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-26f68925-0f3c-4401-83b0-b1d9f702a9a0 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1688 microversion: 2.1 time: 0.417777 Oct 29 03:24:11.097907 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2911/5600] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:10 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1688 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:11.268084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7f358436-8c75-4af3-831c-a3de118c081b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:11.280099 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7f358436-8c75-4af3-831c-a3de118c081b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c" status: 200 len: 1291 microversion: 2.1 time: 0.546722 Oct 29 03:24:11.280725 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2690/5601] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:10 2022] GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c => generated 1291 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:12.151656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9db545f2-36a8-4b3f-8dc7-1279de6145cd tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:12.152440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9db545f2-36a8-4b3f-8dc7-1279de6145cd tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:12.180621 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9db545f2-36a8-4b3f-8dc7-1279de6145cd tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:12.191590 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9db545f2-36a8-4b3f-8dc7-1279de6145cd tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:12.196032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9db545f2-36a8-4b3f-8dc7-1279de6145cd tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:12.197980 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9db545f2-36a8-4b3f-8dc7-1279de6145cd tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:12.201040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9db545f2-36a8-4b3f-8dc7-1279de6145cd tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:12.205494 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9db545f2-36a8-4b3f-8dc7-1279de6145cd tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:12.308319 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ced0a24e-3209-4736-a492-9e0a522ee58d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:12.309352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ced0a24e-3209-4736-a492-9e0a522ee58d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 27b96381-fce8-4748-b7e8-01b474c7067c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:12.334517 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ced0a24e-3209-4736-a492-9e0a522ee58d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:12.339966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ced0a24e-3209-4736-a492-9e0a522ee58d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:12.343399 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ced0a24e-3209-4736-a492-9e0a522ee58d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:12.344492 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ced0a24e-3209-4736-a492-9e0a522ee58d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:12.345011 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ced0a24e-3209-4736-a492-9e0a522ee58d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:12.354329 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ced0a24e-3209-4736-a492-9e0a522ee58d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:12.591579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9db545f2-36a8-4b3f-8dc7-1279de6145cd tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:12.601653 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9db545f2-36a8-4b3f-8dc7-1279de6145cd tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1688 microversion: 2.1 time: 0.458240 Oct 29 03:24:12.617769 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2912/5602] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:12 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1688 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:12.624060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-6890d463-75a3-4ea5-9fa0-6aa7050197d2 req-057807bb-ed43-4910-954b-f31249ff9e4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c079f7ae-3459-468a-a699-b54f5df31e41", "name": "network-vif-unplugged", "status": "completed", "tag": "48355ce5-2082-4f79-98bc-fdccde7f4f8f"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:24:12.636472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-6890d463-75a3-4ea5-9fa0-6aa7050197d2 req-057807bb-ed43-4910-954b-f31249ff9e4b service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:12.637400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-6890d463-75a3-4ea5-9fa0-6aa7050197d2 req-057807bb-ed43-4910-954b-f31249ff9e4b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:12.638067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-6890d463-75a3-4ea5-9fa0-6aa7050197d2 req-057807bb-ed43-4910-954b-f31249ff9e4b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:12.652154 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-6890d463-75a3-4ea5-9fa0-6aa7050197d2 req-057807bb-ed43-4910-954b-f31249ff9e4b service nova] Creating event network-vif-unplugged:48355ce5-2082-4f79-98bc-fdccde7f4f8f for instance c079f7ae-3459-468a-a699-b54f5df31e41 on n-h1-862967-2 Oct 29 03:24:12.658676 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [req-6890d463-75a3-4ea5-9fa0-6aa7050197d2 req-057807bb-ed43-4910-954b-f31249ff9e4b service nova] Instance c079f7ae-3459-468a-a699-b54f5df31e41 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:24:12.678967 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-6890d463-75a3-4ea5-9fa0-6aa7050197d2 req-057807bb-ed43-4910-954b-f31249ff9e4b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059597 Oct 29 03:24:12.683852 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2913/5603] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:24:12.746792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ced0a24e-3209-4736-a492-9e0a522ee58d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:12.757597 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ced0a24e-3209-4736-a492-9e0a522ee58d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c" status: 200 len: 1291 microversion: 2.1 time: 0.453993 Oct 29 03:24:12.758515 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2691/5604] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:12 2022] GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c => generated 1291 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:13.243322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-b0a5d9ec-4101-4bb0-b8f2-8d65122d5e7b req-02f01f7a-6a8e-4dcb-81fa-4e98af6e7d62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b96381-fce8-4748-b7e8-01b474c7067c", "name": "network-vif-plugged", "status": "completed", "tag": "6084388e-a2b4-4f6a-9edf-b57ee1197683"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:24:13.263663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b0a5d9ec-4101-4bb0-b8f2-8d65122d5e7b req-02f01f7a-6a8e-4dcb-81fa-4e98af6e7d62 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:13.264065 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b0a5d9ec-4101-4bb0-b8f2-8d65122d5e7b req-02f01f7a-6a8e-4dcb-81fa-4e98af6e7d62 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:13.268850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b0a5d9ec-4101-4bb0-b8f2-8d65122d5e7b req-02f01f7a-6a8e-4dcb-81fa-4e98af6e7d62 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:13.298566 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-b0a5d9ec-4101-4bb0-b8f2-8d65122d5e7b req-02f01f7a-6a8e-4dcb-81fa-4e98af6e7d62 service nova] Creating event network-vif-plugged:6084388e-a2b4-4f6a-9edf-b57ee1197683 for instance 27b96381-fce8-4748-b7e8-01b474c7067c on n-h2-862967-2 Oct 29 03:24:13.322181 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-b0a5d9ec-4101-4bb0-b8f2-8d65122d5e7b req-02f01f7a-6a8e-4dcb-81fa-4e98af6e7d62 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082008 Oct 29 03:24:13.328206 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2914/5605] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:24:13.630297 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e8c49462-f431-4cff-90c8-dffd7074dbb2 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:13.631878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e8c49462-f431-4cff-90c8-dffd7074dbb2 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:13.645727 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e8c49462-f431-4cff-90c8-dffd7074dbb2 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:13.649002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e8c49462-f431-4cff-90c8-dffd7074dbb2 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:13.651549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e8c49462-f431-4cff-90c8-dffd7074dbb2 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:13.652469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e8c49462-f431-4cff-90c8-dffd7074dbb2 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:13.653082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e8c49462-f431-4cff-90c8-dffd7074dbb2 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:13.655782 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e8c49462-f431-4cff-90c8-dffd7074dbb2 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:13.782431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9da099ca-15a5-456d-bd17-c41809f9f4c2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:13.783342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9da099ca-15a5-456d-bd17-c41809f9f4c2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 27b96381-fce8-4748-b7e8-01b474c7067c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:13.790104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9da099ca-15a5-456d-bd17-c41809f9f4c2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:13.790875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9da099ca-15a5-456d-bd17-c41809f9f4c2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:13.791470 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9da099ca-15a5-456d-bd17-c41809f9f4c2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:13.792358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9da099ca-15a5-456d-bd17-c41809f9f4c2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:13.792997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9da099ca-15a5-456d-bd17-c41809f9f4c2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:13.793583 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9da099ca-15a5-456d-bd17-c41809f9f4c2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:13.810359 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=100 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:14.045422 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9da099ca-15a5-456d-bd17-c41809f9f4c2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:14.061592 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9da099ca-15a5-456d-bd17-c41809f9f4c2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c" status: 200 len: 1291 microversion: 2.1 time: 0.283542 Oct 29 03:24:14.077328 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2915/5606] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:13 2022] GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c => generated 1291 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:14.251429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e8c49462-f431-4cff-90c8-dffd7074dbb2 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:14.260296 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e8c49462-f431-4cff-90c8-dffd7074dbb2 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1688 microversion: 2.1 time: 0.634335 Oct 29 03:24:14.261586 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2692/5607] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:13 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1688 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:14.706965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-5e26c590-9e1a-4083-a7dc-cbc91535c877 req-04ddae59-68d8-4652-bba2-d55751fbba20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c079f7ae-3459-468a-a699-b54f5df31e41", "tag": "48355ce5-2082-4f79-98bc-fdccde7f4f8f"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:24:14.723677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5e26c590-9e1a-4083-a7dc-cbc91535c877 req-04ddae59-68d8-4652-bba2-d55751fbba20 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:14.726177 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5e26c590-9e1a-4083-a7dc-cbc91535c877 req-04ddae59-68d8-4652-bba2-d55751fbba20 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:14.727030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5e26c590-9e1a-4083-a7dc-cbc91535c877 req-04ddae59-68d8-4652-bba2-d55751fbba20 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:14.750396 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-5e26c590-9e1a-4083-a7dc-cbc91535c877 req-04ddae59-68d8-4652-bba2-d55751fbba20 service nova] Creating event network-changed:48355ce5-2082-4f79-98bc-fdccde7f4f8f for instance c079f7ae-3459-468a-a699-b54f5df31e41 on n-h1-862967-2 Oct 29 03:24:14.759275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [req-5e26c590-9e1a-4083-a7dc-cbc91535c877 req-04ddae59-68d8-4652-bba2-d55751fbba20 service nova] Instance c079f7ae-3459-468a-a699-b54f5df31e41 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:24:14.772948 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-5e26c590-9e1a-4083-a7dc-cbc91535c877 req-04ddae59-68d8-4652-bba2-d55751fbba20 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070618 Oct 29 03:24:14.773932 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2916/5608] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:24:15.085506 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4a93cc68-6e41-469e-a05b-fb92ef856848 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:15.086685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4a93cc68-6e41-469e-a05b-fb92ef856848 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 27b96381-fce8-4748-b7e8-01b474c7067c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:15.096992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a93cc68-6e41-469e-a05b-fb92ef856848 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:15.097947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a93cc68-6e41-469e-a05b-fb92ef856848 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:15.098550 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a93cc68-6e41-469e-a05b-fb92ef856848 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:15.099872 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a93cc68-6e41-469e-a05b-fb92ef856848 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:15.100417 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a93cc68-6e41-469e-a05b-fb92ef856848 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:15.100951 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a93cc68-6e41-469e-a05b-fb92ef856848 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:15.284278 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1d5f1fa8-b21b-48da-af7f-94af875f8a7c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:15.285037 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1d5f1fa8-b21b-48da-af7f-94af875f8a7c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:15.296408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d5f1fa8-b21b-48da-af7f-94af875f8a7c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:15.297252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d5f1fa8-b21b-48da-af7f-94af875f8a7c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:15.297705 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d5f1fa8-b21b-48da-af7f-94af875f8a7c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:15.298650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d5f1fa8-b21b-48da-af7f-94af875f8a7c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:15.312451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d5f1fa8-b21b-48da-af7f-94af875f8a7c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:15.313100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d5f1fa8-b21b-48da-af7f-94af875f8a7c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:15.502003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4a93cc68-6e41-469e-a05b-fb92ef856848 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:15.512430 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4a93cc68-6e41-469e-a05b-fb92ef856848 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c" status: 200 len: 1291 microversion: 2.1 time: 0.431078 Oct 29 03:24:15.513502 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2693/5609] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:15 2022] GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c => generated 1291 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:15.587088 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1d5f1fa8-b21b-48da-af7f-94af875f8a7c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:15.597856 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1d5f1fa8-b21b-48da-af7f-94af875f8a7c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1688 microversion: 2.1 time: 0.318199 Oct 29 03:24:15.599454 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2917/5610] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:15 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1688 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:24:16.538652 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c0461814-9b22-4c81-8141-75a4e88afe49 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:16.541052 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c0461814-9b22-4c81-8141-75a4e88afe49 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 27b96381-fce8-4748-b7e8-01b474c7067c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:16.569398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0461814-9b22-4c81-8141-75a4e88afe49 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:16.569882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0461814-9b22-4c81-8141-75a4e88afe49 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:16.573158 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0461814-9b22-4c81-8141-75a4e88afe49 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:16.574156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0461814-9b22-4c81-8141-75a4e88afe49 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:16.574612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0461814-9b22-4c81-8141-75a4e88afe49 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:16.575046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0461814-9b22-4c81-8141-75a4e88afe49 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:16.624054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a75c99fc-8ac7-4c71-a205-07eab49f6009 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:16.625283 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a75c99fc-8ac7-4c71-a205-07eab49f6009 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:16.635907 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a75c99fc-8ac7-4c71-a205-07eab49f6009 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:16.638964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a75c99fc-8ac7-4c71-a205-07eab49f6009 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:16.640724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a75c99fc-8ac7-4c71-a205-07eab49f6009 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:16.642503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a75c99fc-8ac7-4c71-a205-07eab49f6009 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:16.647355 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a75c99fc-8ac7-4c71-a205-07eab49f6009 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:16.650477 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a75c99fc-8ac7-4c71-a205-07eab49f6009 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:16.885768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a75c99fc-8ac7-4c71-a205-07eab49f6009 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:16.905319 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a75c99fc-8ac7-4c71-a205-07eab49f6009 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1688 microversion: 2.1 time: 0.283730 Oct 29 03:24:16.907105 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2918/5611] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:16 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1688 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:24:17.008238 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c0461814-9b22-4c81-8141-75a4e88afe49 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:17.023962 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c0461814-9b22-4c81-8141-75a4e88afe49 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c" status: 200 len: 1470 microversion: 2.1 time: 0.489978 Oct 29 03:24:17.026320 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2694/5612] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:16 2022] GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c => generated 1470 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:17.147542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-30b49879-31fd-4760-ab9e-e4e5b62e53ce tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-792779536", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:24:17.242874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-30b49879-31fd-4760-ab9e-e4e5b62e53ce tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] validate_networks() for [('ca8e0bef-c1ec-47bd-9591-43a816db6a16', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:24:17.724942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-30b49879-31fd-4760-ab9e-e4e5b62e53ce tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:24:17.725568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-30b49879-31fd-4760-ab9e-e4e5b62e53ce tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:24:17.725831 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-30b49879-31fd-4760-ab9e-e4e5b62e53ce tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:24:17.726234 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-30b49879-31fd-4760-ab9e-e4e5b62e53ce tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:24:17.726649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-30b49879-31fd-4760-ab9e-e4e5b62e53ce tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:24:17.737984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30b49879-31fd-4760-ab9e-e4e5b62e53ce tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:17.738633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30b49879-31fd-4760-ab9e-e4e5b62e53ce tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:17.739086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30b49879-31fd-4760-ab9e-e4e5b62e53ce tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:17.739826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30b49879-31fd-4760-ab9e-e4e5b62e53ce tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:17.740293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30b49879-31fd-4760-ab9e-e4e5b62e53ce tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:17.740755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30b49879-31fd-4760-ab9e-e4e5b62e53ce tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:17.760141 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-30b49879-31fd-4760-ab9e-e4e5b62e53ce tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Getting quotas for project af30f7beecad4c448ff0706230ecb8d9. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:24:17.766514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-30b49879-31fd-4760-ab9e-e4e5b62e53ce tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Getting quotas for user 50ec777bf8ea4a9eb7d9d6cf995ba4ef and project af30f7beecad4c448ff0706230ecb8d9. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:24:17.780708 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-30b49879-31fd-4760-ab9e-e4e5b62e53ce tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:24:17.783302 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-30b49879-31fd-4760-ab9e-e4e5b62e53ce tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: caf24fbc-76ec-4028-ba07-62ce8514cfa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:24:17.832769 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-30b49879-31fd-4760-ab9e-e4e5b62e53ce tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.696382 Oct 29 03:24:17.840538 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2919/5613] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:24:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:24:17.845414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a8531837-fe7d-401b-bbef-3ab6a8172d82 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:17.846621 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a8531837-fe7d-401b-bbef-3ab6a8172d82 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: caf24fbc-76ec-4028-ba07-62ce8514cfa6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:17.878378 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a8531837-fe7d-401b-bbef-3ab6a8172d82 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: caf24fbc-76ec-4028-ba07-62ce8514cfa6] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:24:17.935345 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b95708fa-d10a-49e9-a4b9-76a52cc4ed21 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:17.936008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b95708fa-d10a-49e9-a4b9-76a52cc4ed21 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:17.943328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b95708fa-d10a-49e9-a4b9-76a52cc4ed21 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:17.950530 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b95708fa-d10a-49e9-a4b9-76a52cc4ed21 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:17.951012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b95708fa-d10a-49e9-a4b9-76a52cc4ed21 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:17.951791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b95708fa-d10a-49e9-a4b9-76a52cc4ed21 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:17.952263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b95708fa-d10a-49e9-a4b9-76a52cc4ed21 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:17.952742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b95708fa-d10a-49e9-a4b9-76a52cc4ed21 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:18.030415 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a8531837-fe7d-401b-bbef-3ab6a8172d82 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "DELETE /compute/v2.1/servers/caf24fbc-76ec-4028-ba07-62ce8514cfa6" status: 204 len: 0 microversion: 2.1 time: 0.187810 Oct 29 03:24:18.032606 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2695/5614] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:24:17 2022] DELETE /compute/v2.1/servers/caf24fbc-76ec-4028-ba07-62ce8514cfa6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:24:18.044965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d6eb436c-0f12-4007-8ac8-9d1da4db2f1e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:18.046183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d6eb436c-0f12-4007-8ac8-9d1da4db2f1e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: caf24fbc-76ec-4028-ba07-62ce8514cfa6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:18.082552 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-d6eb436c-0f12-4007-8ac8-9d1da4db2f1e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] HTTP exception thrown: Instance caf24fbc-76ec-4028-ba07-62ce8514cfa6 could not be found. Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d6eb436c-0f12-4007-8ac8-9d1da4db2f1e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Request method failure captured: Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/caf24fbc-76ec-4028-ba07-62ce8514cfa6 HTTP/1.1 Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJzN_0W3F2Tvd5_DwYEYaE7yArMUzQkw0yVRFyD806tbuPfgIN9hrPP-pm4QkI5-axnSQL2lFY8Zz_29U2X0iME7rTgOu74wHL71o9B_5IukGwbcOdtvhyWYdmcAPvnUhuYS1WrbTu-q-KzFqGL1fD3An-d36JB4OLVV1PNh19tG-1E Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/af30f7beecad4c448ff0706230ecb8d9"}]}] Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersTestJSON-1972911719 Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersTestJSON-1972911719-project Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 50ec777bf8ea4a9eb7d9d6cf995ba4ef Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersTestJSON-1972911719-project Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance caf24fbc-76ec-4028-ba07-62ce8514cfa6 could not be found. Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'caf24fbc-76ec-4028-ba07-62ce8514cfa6'} Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance caf24fbc-76ec-4028-ba07-62ce8514cfa6 Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caf24fbc-76ec-4028-ba07-62ce8514cfa6 could not be found. Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:24:18.110923 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:24:18.116687 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:24:18.116687 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:24:18.116687 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:24:18.116687 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:24:18.116687 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:24:18.116687 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:24:18.116687 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:24:18.116687 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:24:18.116687 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:24:18.116687 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:24:18.116687 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caf24fbc-76ec-4028-ba07-62ce8514cfa6 could not be found. Oct 29 03:24:18.116687 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:24:18.116687 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:24:18.116687 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:24:18.116687 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:24:18.116687 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:24:18.116687 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:24:18.116687 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:24:18.116687 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:24:18.116687 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caf24fbc-76ec-4028-ba07-62ce8514cfa6 could not be found. Oct 29 03:24:18.116687 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:24:18.116687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d6eb436c-0f12-4007-8ac8-9d1da4db2f1e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Returning 404 to user: Instance caf24fbc-76ec-4028-ba07-62ce8514cfa6 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:24:18.116687 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d6eb436c-0f12-4007-8ac8-9d1da4db2f1e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/caf24fbc-76ec-4028-ba07-62ce8514cfa6" status: 404 len: 111 microversion: 2.1 time: 0.077532 Oct 29 03:24:18.116687 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2696/5615] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:18 2022] GET /compute/v2.1/servers/caf24fbc-76ec-4028-ba07-62ce8514cfa6 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:24:18.234239 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b95708fa-d10a-49e9-a4b9-76a52cc4ed21 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:18.242240 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b95708fa-d10a-49e9-a4b9-76a52cc4ed21 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1681 microversion: 2.1 time: 0.310848 Oct 29 03:24:18.256709 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2920/5616] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:17 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1681 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:24:18.300859 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4a0e17ad-1f1e-4580-96da-e8a72f15b93f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1891354736", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "ca8e0bef-c1ec-47bd-9591-43a816db6a16"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:24:18.377629 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-4a0e17ad-1f1e-4580-96da-e8a72f15b93f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] validate_networks() for [('ca8e0bef-c1ec-47bd-9591-43a816db6a16', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:24:18.406843 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-5d0f3877-7715-4dd2-9ac2-29b9a2ce5039 req-97b10910-d899-4283-b262-6b9574b06d50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c079f7ae-3459-468a-a699-b54f5df31e41", "name": "network-vif-plugged", "status": "completed", "tag": "48355ce5-2082-4f79-98bc-fdccde7f4f8f"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:24:18.418834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5d0f3877-7715-4dd2-9ac2-29b9a2ce5039 req-97b10910-d899-4283-b262-6b9574b06d50 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:18.425126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5d0f3877-7715-4dd2-9ac2-29b9a2ce5039 req-97b10910-d899-4283-b262-6b9574b06d50 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:18.425699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5d0f3877-7715-4dd2-9ac2-29b9a2ce5039 req-97b10910-d899-4283-b262-6b9574b06d50 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:18.448811 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-5d0f3877-7715-4dd2-9ac2-29b9a2ce5039 req-97b10910-d899-4283-b262-6b9574b06d50 service nova] Creating event network-vif-plugged:48355ce5-2082-4f79-98bc-fdccde7f4f8f for instance c079f7ae-3459-468a-a699-b54f5df31e41 on n-h1-862967-2 Oct 29 03:24:18.458175 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-5d0f3877-7715-4dd2-9ac2-29b9a2ce5039 req-97b10910-d899-4283-b262-6b9574b06d50 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055031 Oct 29 03:24:18.458796 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2921/5617] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:24:18.807256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-4a0e17ad-1f1e-4580-96da-e8a72f15b93f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:24:18.807672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-4a0e17ad-1f1e-4580-96da-e8a72f15b93f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:24:18.808138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-4a0e17ad-1f1e-4580-96da-e8a72f15b93f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:24:18.808711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-4a0e17ad-1f1e-4580-96da-e8a72f15b93f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:24:18.809119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-4a0e17ad-1f1e-4580-96da-e8a72f15b93f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:24:18.818691 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a0e17ad-1f1e-4580-96da-e8a72f15b93f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:18.819170 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a0e17ad-1f1e-4580-96da-e8a72f15b93f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:18.819601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a0e17ad-1f1e-4580-96da-e8a72f15b93f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:18.820312 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a0e17ad-1f1e-4580-96da-e8a72f15b93f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:18.820788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a0e17ad-1f1e-4580-96da-e8a72f15b93f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:18.821210 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4a0e17ad-1f1e-4580-96da-e8a72f15b93f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:18.838559 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-4a0e17ad-1f1e-4580-96da-e8a72f15b93f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Getting quotas for project af30f7beecad4c448ff0706230ecb8d9. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:24:18.843984 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-4a0e17ad-1f1e-4580-96da-e8a72f15b93f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Getting quotas for user 50ec777bf8ea4a9eb7d9d6cf995ba4ef and project af30f7beecad4c448ff0706230ecb8d9. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:24:18.857153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4a0e17ad-1f1e-4580-96da-e8a72f15b93f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:24:18.859724 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4a0e17ad-1f1e-4580-96da-e8a72f15b93f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 925ba68c-9ad9-4da3-ab7c-9a2118eed63e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:24:18.910319 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4a0e17ad-1f1e-4580-96da-e8a72f15b93f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614341 Oct 29 03:24:18.911429 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2697/5618] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:24:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 03:24:18.925100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-760d3ba4-5c90-4041-ba29-634f787dc6e1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:18.926461 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-760d3ba4-5c90-4041-ba29-634f787dc6e1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 925ba68c-9ad9-4da3-ab7c-9a2118eed63e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:19.002823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-760d3ba4-5c90-4041-ba29-634f787dc6e1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:19.014418 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-760d3ba4-5c90-4041-ba29-634f787dc6e1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e" status: 200 len: 1221 microversion: 2.1 time: 0.091454 Oct 29 03:24:19.014418 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2922/5619] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:18 2022] GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e => generated 1221 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:20.036282 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-01f05acd-eccc-4fef-a6be-38f55a910a6e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:20.036992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-01f05acd-eccc-4fef-a6be-38f55a910a6e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 925ba68c-9ad9-4da3-ab7c-9a2118eed63e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:20.052643 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01f05acd-eccc-4fef-a6be-38f55a910a6e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:20.055107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01f05acd-eccc-4fef-a6be-38f55a910a6e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:20.057495 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01f05acd-eccc-4fef-a6be-38f55a910a6e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:20.058844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01f05acd-eccc-4fef-a6be-38f55a910a6e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:20.062235 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01f05acd-eccc-4fef-a6be-38f55a910a6e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:20.062910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-01f05acd-eccc-4fef-a6be-38f55a910a6e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:20.157346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-01f05acd-eccc-4fef-a6be-38f55a910a6e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:20.166022 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-01f05acd-eccc-4fef-a6be-38f55a910a6e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e" status: 200 len: 1273 microversion: 2.1 time: 0.134096 Oct 29 03:24:20.167069 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2698/5620] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:20 2022] GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e => generated 1273 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:21.196265 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-12b40b6e-e9c6-4561-b931-2410b787dec0 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:21.198452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-12b40b6e-e9c6-4561-b931-2410b787dec0 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 925ba68c-9ad9-4da3-ab7c-9a2118eed63e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:21.207946 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12b40b6e-e9c6-4561-b931-2410b787dec0 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:21.208919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12b40b6e-e9c6-4561-b931-2410b787dec0 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:21.209578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12b40b6e-e9c6-4561-b931-2410b787dec0 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:21.210749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12b40b6e-e9c6-4561-b931-2410b787dec0 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:21.211430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12b40b6e-e9c6-4561-b931-2410b787dec0 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:21.212071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12b40b6e-e9c6-4561-b931-2410b787dec0 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:21.352379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-12b40b6e-e9c6-4561-b931-2410b787dec0 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:21.381771 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-12b40b6e-e9c6-4561-b931-2410b787dec0 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e" status: 200 len: 1279 microversion: 2.1 time: 0.192177 Oct 29 03:24:21.382957 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2923/5621] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:21 2022] GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e => generated 1279 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:22.422624 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-02f3706c-3e87-4308-9668-6bd4d4591930 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:22.424141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-02f3706c-3e87-4308-9668-6bd4d4591930 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 925ba68c-9ad9-4da3-ab7c-9a2118eed63e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:22.447469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02f3706c-3e87-4308-9668-6bd4d4591930 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:22.448479 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02f3706c-3e87-4308-9668-6bd4d4591930 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:22.456467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02f3706c-3e87-4308-9668-6bd4d4591930 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:22.460583 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02f3706c-3e87-4308-9668-6bd4d4591930 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:22.461409 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02f3706c-3e87-4308-9668-6bd4d4591930 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:22.461993 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02f3706c-3e87-4308-9668-6bd4d4591930 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:22.929114 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-02f3706c-3e87-4308-9668-6bd4d4591930 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:22.937121 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-02f3706c-3e87-4308-9668-6bd4d4591930 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e" status: 200 len: 1321 microversion: 2.1 time: 0.529172 Oct 29 03:24:22.940886 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2699/5622] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:22 2022] GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e => generated 1321 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:23.295196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-7048ada5-f46b-4b2d-b7b3-491b38c8c3e1 req-e43093ce-212d-4a1b-af65-7b2d015e8cec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "925ba68c-9ad9-4da3-ab7c-9a2118eed63e", "tag": "3c6a746e-508e-4c42-a78d-30ccab024121"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:24:23.349384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7048ada5-f46b-4b2d-b7b3-491b38c8c3e1 req-e43093ce-212d-4a1b-af65-7b2d015e8cec service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:23.360114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7048ada5-f46b-4b2d-b7b3-491b38c8c3e1 req-e43093ce-212d-4a1b-af65-7b2d015e8cec service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:23.371260 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7048ada5-f46b-4b2d-b7b3-491b38c8c3e1 req-e43093ce-212d-4a1b-af65-7b2d015e8cec service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:23.427384 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-7048ada5-f46b-4b2d-b7b3-491b38c8c3e1 req-e43093ce-212d-4a1b-af65-7b2d015e8cec service nova] Creating event network-changed:3c6a746e-508e-4c42-a78d-30ccab024121 for instance 925ba68c-9ad9-4da3-ab7c-9a2118eed63e on n-h1-862967-2 Oct 29 03:24:23.439993 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-7048ada5-f46b-4b2d-b7b3-491b38c8c3e1 req-e43093ce-212d-4a1b-af65-7b2d015e8cec service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152560 Oct 29 03:24:23.445248 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2924/5623] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:24:23.974081 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-56d43c0b-0c20-47e8-85a0-70cf3fd36e3d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:23.975642 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-56d43c0b-0c20-47e8-85a0-70cf3fd36e3d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 925ba68c-9ad9-4da3-ab7c-9a2118eed63e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:23.996062 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-56d43c0b-0c20-47e8-85a0-70cf3fd36e3d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:24.005258 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-56d43c0b-0c20-47e8-85a0-70cf3fd36e3d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:24.014381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-56d43c0b-0c20-47e8-85a0-70cf3fd36e3d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:24.017814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-56d43c0b-0c20-47e8-85a0-70cf3fd36e3d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:24.019566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-56d43c0b-0c20-47e8-85a0-70cf3fd36e3d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:24.021407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-56d43c0b-0c20-47e8-85a0-70cf3fd36e3d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:24.405363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-56d43c0b-0c20-47e8-85a0-70cf3fd36e3d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:24.456813 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-56d43c0b-0c20-47e8-85a0-70cf3fd36e3d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e" status: 200 len: 1321 microversion: 2.1 time: 0.454864 Oct 29 03:24:24.462671 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2700/5624] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:23 2022] GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e => generated 1321 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:25.499084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-70b3640e-9ae8-4a71-94af-716c31d43506 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:25.502185 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-70b3640e-9ae8-4a71-94af-716c31d43506 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 925ba68c-9ad9-4da3-ab7c-9a2118eed63e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:25.524073 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70b3640e-9ae8-4a71-94af-716c31d43506 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:25.524597 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70b3640e-9ae8-4a71-94af-716c31d43506 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:25.525043 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70b3640e-9ae8-4a71-94af-716c31d43506 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:25.531609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70b3640e-9ae8-4a71-94af-716c31d43506 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:25.532152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70b3640e-9ae8-4a71-94af-716c31d43506 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:25.532655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70b3640e-9ae8-4a71-94af-716c31d43506 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:25.830275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-70b3640e-9ae8-4a71-94af-716c31d43506 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:25.840081 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-70b3640e-9ae8-4a71-94af-716c31d43506 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e" status: 200 len: 1321 microversion: 2.1 time: 0.357036 Oct 29 03:24:25.855930 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2925/5625] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:25 2022] GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e => generated 1321 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:26.864052 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1b9c3535-ecb9-4c33-b099-0c27786fffbe tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:26.865516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1b9c3535-ecb9-4c33-b099-0c27786fffbe tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 925ba68c-9ad9-4da3-ab7c-9a2118eed63e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:26.878044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b9c3535-ecb9-4c33-b099-0c27786fffbe tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:26.880316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b9c3535-ecb9-4c33-b099-0c27786fffbe tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:26.881002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b9c3535-ecb9-4c33-b099-0c27786fffbe tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:26.882119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b9c3535-ecb9-4c33-b099-0c27786fffbe tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:26.883465 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b9c3535-ecb9-4c33-b099-0c27786fffbe tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:26.884113 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b9c3535-ecb9-4c33-b099-0c27786fffbe tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:26.934068 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:27.135447 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1b9c3535-ecb9-4c33-b099-0c27786fffbe tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:27.143837 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1b9c3535-ecb9-4c33-b099-0c27786fffbe tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e" status: 200 len: 1321 microversion: 2.1 time: 0.284342 Oct 29 03:24:27.144434 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2701/5626] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:26 2022] GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e => generated 1321 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:28.166976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-007a657a-d774-4e94-937c-dbdc4bb77fcb tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:28.167601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-007a657a-d774-4e94-937c-dbdc4bb77fcb tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 925ba68c-9ad9-4da3-ab7c-9a2118eed63e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:28.178832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:28.180933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-007a657a-d774-4e94-937c-dbdc4bb77fcb tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:28.186243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-007a657a-d774-4e94-937c-dbdc4bb77fcb tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:28.186886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-007a657a-d774-4e94-937c-dbdc4bb77fcb tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:28.187896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-007a657a-d774-4e94-937c-dbdc4bb77fcb tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:28.188369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-007a657a-d774-4e94-937c-dbdc4bb77fcb tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:28.188830 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-007a657a-d774-4e94-937c-dbdc4bb77fcb tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:28.435101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-2844dab6-f351-4938-92b7-93cb73a4292f req-b5e0ba15-cfa0-4fe7-8b0b-517179c812ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "925ba68c-9ad9-4da3-ab7c-9a2118eed63e", "name": "network-vif-plugged", "status": "completed", "tag": "3c6a746e-508e-4c42-a78d-30ccab024121"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:24:28.446409 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2844dab6-f351-4938-92b7-93cb73a4292f req-b5e0ba15-cfa0-4fe7-8b0b-517179c812ac service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:28.447162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2844dab6-f351-4938-92b7-93cb73a4292f req-b5e0ba15-cfa0-4fe7-8b0b-517179c812ac service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:28.447767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2844dab6-f351-4938-92b7-93cb73a4292f req-b5e0ba15-cfa0-4fe7-8b0b-517179c812ac service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:28.460474 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-2844dab6-f351-4938-92b7-93cb73a4292f req-b5e0ba15-cfa0-4fe7-8b0b-517179c812ac service nova] Creating event network-vif-plugged:3c6a746e-508e-4c42-a78d-30ccab024121 for instance 925ba68c-9ad9-4da3-ab7c-9a2118eed63e on n-h1-862967-2 Oct 29 03:24:28.469556 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-2844dab6-f351-4938-92b7-93cb73a4292f req-b5e0ba15-cfa0-4fe7-8b0b-517179c812ac service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037262 Oct 29 03:24:28.471307 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2702/5627] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:24:28.759043 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-007a657a-d774-4e94-937c-dbdc4bb77fcb tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:28.772975 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-007a657a-d774-4e94-937c-dbdc4bb77fcb tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e" status: 200 len: 1321 microversion: 2.1 time: 0.609094 Oct 29 03:24:28.774282 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2926/5628] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:28 2022] GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e => generated 1321 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:29.797629 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b86345d8-b260-4c98-be69-036ab9f429a1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:29.799182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b86345d8-b260-4c98-be69-036ab9f429a1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 925ba68c-9ad9-4da3-ab7c-9a2118eed63e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:29.807647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:29.808604 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=8 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:29.812536 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b86345d8-b260-4c98-be69-036ab9f429a1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:29.813520 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b86345d8-b260-4c98-be69-036ab9f429a1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:29.814177 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b86345d8-b260-4c98-be69-036ab9f429a1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:29.815543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b86345d8-b260-4c98-be69-036ab9f429a1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:29.815800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b86345d8-b260-4c98-be69-036ab9f429a1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:29.816352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b86345d8-b260-4c98-be69-036ab9f429a1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:30.005350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b86345d8-b260-4c98-be69-036ab9f429a1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:30.021093 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b86345d8-b260-4c98-be69-036ab9f429a1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e" status: 200 len: 1321 microversion: 2.1 time: 0.227807 Oct 29 03:24:30.022799 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2703/5629] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:29 2022] GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:31.050032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e47b67c3-6a0d-462a-a5c3-c285abc4ef83 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:31.051782 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e47b67c3-6a0d-462a-a5c3-c285abc4ef83 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 925ba68c-9ad9-4da3-ab7c-9a2118eed63e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:31.056424 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=8 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:31.072660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e47b67c3-6a0d-462a-a5c3-c285abc4ef83 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:31.074533 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e47b67c3-6a0d-462a-a5c3-c285abc4ef83 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:31.075161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e47b67c3-6a0d-462a-a5c3-c285abc4ef83 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:31.076259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e47b67c3-6a0d-462a-a5c3-c285abc4ef83 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:31.077918 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e47b67c3-6a0d-462a-a5c3-c285abc4ef83 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:31.079762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e47b67c3-6a0d-462a-a5c3-c285abc4ef83 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:31.413580 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e47b67c3-6a0d-462a-a5c3-c285abc4ef83 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:31.447270 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e47b67c3-6a0d-462a-a5c3-c285abc4ef83 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e" status: 200 len: 1500 microversion: 2.1 time: 0.403723 Oct 29 03:24:31.448568 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2927/5630] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:31 2022] GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e => generated 1500 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:31.476392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-83e31629-fa44-4030-81e3-cca8d60af15f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:31.477050 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-83e31629-fa44-4030-81e3-cca8d60af15f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 925ba68c-9ad9-4da3-ab7c-9a2118eed63e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:31.488217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83e31629-fa44-4030-81e3-cca8d60af15f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:31.489711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83e31629-fa44-4030-81e3-cca8d60af15f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:31.491064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83e31629-fa44-4030-81e3-cca8d60af15f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:31.493352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83e31629-fa44-4030-81e3-cca8d60af15f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:31.495684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83e31629-fa44-4030-81e3-cca8d60af15f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:31.496225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83e31629-fa44-4030-81e3-cca8d60af15f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:31.567328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-65592696-1b00-4baa-9fd2-49b09f0a5b12 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:31.567997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-65592696-1b00-4baa-9fd2-49b09f0a5b12 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] [instance: 3fa9077c-183f-48e0-898d-563797ebd546] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:31.579129 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-65592696-1b00-4baa-9fd2-49b09f0a5b12 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:31.579578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-65592696-1b00-4baa-9fd2-49b09f0a5b12 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:31.580041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-65592696-1b00-4baa-9fd2-49b09f0a5b12 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:31.582825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-65592696-1b00-4baa-9fd2-49b09f0a5b12 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:31.586212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-65592696-1b00-4baa-9fd2-49b09f0a5b12 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:31.589411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-65592696-1b00-4baa-9fd2-49b09f0a5b12 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:31.662501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-65592696-1b00-4baa-9fd2-49b09f0a5b12 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] [instance: 3fa9077c-183f-48e0-898d-563797ebd546] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:24:31.786249 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-83e31629-fa44-4030-81e3-cca8d60af15f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:31.796380 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-83e31629-fa44-4030-81e3-cca8d60af15f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e" status: 200 len: 1500 microversion: 2.1 time: 0.325997 Oct 29 03:24:31.800694 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2704/5631] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:31 2022] GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e => generated 1500 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:24:31.811931 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-f6280939-c432-42f0-b927-a1caa7816678 req-e52e1820-21c9-491e-a2fd-663b77788ffd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fa9077c-183f-48e0-898d-563797ebd546", "tag": "ab51c241-18f1-4ba6-9e8f-12aeb85b8a5e"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:24:31.839391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f6280939-c432-42f0-b927-a1caa7816678 req-e52e1820-21c9-491e-a2fd-663b77788ffd service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:31.840118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f6280939-c432-42f0-b927-a1caa7816678 req-e52e1820-21c9-491e-a2fd-663b77788ffd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:31.840750 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f6280939-c432-42f0-b927-a1caa7816678 req-e52e1820-21c9-491e-a2fd-663b77788ffd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:31.864855 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-65592696-1b00-4baa-9fd2-49b09f0a5b12 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546" status: 204 len: 0 microversion: 2.1 time: 0.301673 Oct 29 03:24:31.866629 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2928/5632] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:24:31 2022] DELETE /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:24:31.873054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c576b79f-964f-48c4-ba0e-6312512d5c82 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:31.873896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c576b79f-964f-48c4-ba0e-6312512d5c82 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 925ba68c-9ad9-4da3-ab7c-9a2118eed63e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:31.882178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c576b79f-964f-48c4-ba0e-6312512d5c82 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:31.883218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c576b79f-964f-48c4-ba0e-6312512d5c82 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:31.883989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c576b79f-964f-48c4-ba0e-6312512d5c82 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:31.885377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c576b79f-964f-48c4-ba0e-6312512d5c82 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:31.886133 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c576b79f-964f-48c4-ba0e-6312512d5c82 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:31.887021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c576b79f-964f-48c4-ba0e-6312512d5c82 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:31.892093 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-f6280939-c432-42f0-b927-a1caa7816678 req-e52e1820-21c9-491e-a2fd-663b77788ffd service nova] Creating event network-changed:ab51c241-18f1-4ba6-9e8f-12aeb85b8a5e for instance 3fa9077c-183f-48e0-898d-563797ebd546 on n-h2-862967-2 Oct 29 03:24:31.923514 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-f6280939-c432-42f0-b927-a1caa7816678 req-e52e1820-21c9-491e-a2fd-663b77788ffd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118714 Oct 29 03:24:31.930466 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2705/5633] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:24:31.932465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c576b79f-964f-48c4-ba0e-6312512d5c82 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 925ba68c-9ad9-4da3-ab7c-9a2118eed63e] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:24:31.945060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ac845e4b-0960-484f-b298-4f6eed582ba3 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:31.949977 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ac845e4b-0960-484f-b298-4f6eed582ba3 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] [instance: 3fa9077c-183f-48e0-898d-563797ebd546] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:31.977348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ac845e4b-0960-484f-b298-4f6eed582ba3 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:31.978391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ac845e4b-0960-484f-b298-4f6eed582ba3 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:31.979466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ac845e4b-0960-484f-b298-4f6eed582ba3 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:31.982517 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ac845e4b-0960-484f-b298-4f6eed582ba3 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:31.983145 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ac845e4b-0960-484f-b298-4f6eed582ba3 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:31.986254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ac845e4b-0960-484f-b298-4f6eed582ba3 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:32.193331 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c576b79f-964f-48c4-ba0e-6312512d5c82 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "DELETE /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e" status: 204 len: 0 microversion: 2.1 time: 0.324753 Oct 29 03:24:32.196772 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2929/5634] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:24:31 2022] DELETE /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:24:32.215616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9ad969bf-d005-4151-ba14-b3200ab24fe1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:32.220918 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9ad969bf-d005-4151-ba14-b3200ab24fe1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 925ba68c-9ad9-4da3-ab7c-9a2118eed63e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:32.231761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ad969bf-d005-4151-ba14-b3200ab24fe1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:32.233025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ad969bf-d005-4151-ba14-b3200ab24fe1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:32.234150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ad969bf-d005-4151-ba14-b3200ab24fe1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:32.237460 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ad969bf-d005-4151-ba14-b3200ab24fe1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:32.238531 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ad969bf-d005-4151-ba14-b3200ab24fe1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:32.241331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ad969bf-d005-4151-ba14-b3200ab24fe1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:32.332726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ac845e4b-0960-484f-b298-4f6eed582ba3 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb06badda8549e3ae02e9f6222098bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab62a8a623d48dd865d5c7c96daead1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:32.344463 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ac845e4b-0960-484f-b298-4f6eed582ba3 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] 10.222.0.46 "GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546" status: 200 len: 1581 microversion: 2.1 time: 0.411717 Oct 29 03:24:32.346131 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2706/5635] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:31 2022] GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546 => generated 1581 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:32.609406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9ad969bf-d005-4151-ba14-b3200ab24fe1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:32.620309 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9ad969bf-d005-4151-ba14-b3200ab24fe1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e" status: 200 len: 1506 microversion: 2.1 time: 0.418267 Oct 29 03:24:32.620949 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2930/5636] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:32 2022] GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e => generated 1506 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:33.376170 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cf3e0954-eec0-4a8a-9b48-ccc7d8520b06 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:33.377459 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cf3e0954-eec0-4a8a-9b48-ccc7d8520b06 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] [instance: 3fa9077c-183f-48e0-898d-563797ebd546] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:33.396844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf3e0954-eec0-4a8a-9b48-ccc7d8520b06 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:33.397642 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf3e0954-eec0-4a8a-9b48-ccc7d8520b06 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:33.398090 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf3e0954-eec0-4a8a-9b48-ccc7d8520b06 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:33.399081 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf3e0954-eec0-4a8a-9b48-ccc7d8520b06 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:33.399627 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf3e0954-eec0-4a8a-9b48-ccc7d8520b06 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:33.399953 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf3e0954-eec0-4a8a-9b48-ccc7d8520b06 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:33.644079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5103a85d-f1df-4935-9bc7-a00f84add853 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:33.644771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5103a85d-f1df-4935-9bc7-a00f84add853 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 925ba68c-9ad9-4da3-ab7c-9a2118eed63e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:33.655072 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5103a85d-f1df-4935-9bc7-a00f84add853 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:33.662616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5103a85d-f1df-4935-9bc7-a00f84add853 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:33.663362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5103a85d-f1df-4935-9bc7-a00f84add853 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:33.664285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5103a85d-f1df-4935-9bc7-a00f84add853 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:33.665091 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5103a85d-f1df-4935-9bc7-a00f84add853 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:33.665700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5103a85d-f1df-4935-9bc7-a00f84add853 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:33.892965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5103a85d-f1df-4935-9bc7-a00f84add853 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:33.903927 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5103a85d-f1df-4935-9bc7-a00f84add853 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e" status: 200 len: 1506 microversion: 2.1 time: 0.264479 Oct 29 03:24:33.907330 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2931/5637] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:33 2022] GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e => generated 1506 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:24:34.133505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-42c9899c-61ae-4943-8ab3-fea1ba9ca9ea req-292c15f6-aca7-4847-8e18-9fb4af36bafe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fa9077c-183f-48e0-898d-563797ebd546", "name": "network-vif-deleted", "tag": "ab51c241-18f1-4ba6-9e8f-12aeb85b8a5e"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:24:34.144563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-42c9899c-61ae-4943-8ab3-fea1ba9ca9ea req-292c15f6-aca7-4847-8e18-9fb4af36bafe service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:34.145948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-42c9899c-61ae-4943-8ab3-fea1ba9ca9ea req-292c15f6-aca7-4847-8e18-9fb4af36bafe service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:34.146542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-42c9899c-61ae-4943-8ab3-fea1ba9ca9ea req-292c15f6-aca7-4847-8e18-9fb4af36bafe service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:34.157913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:34.160399 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-42c9899c-61ae-4943-8ab3-fea1ba9ca9ea req-292c15f6-aca7-4847-8e18-9fb4af36bafe service nova] Creating event network-vif-deleted:ab51c241-18f1-4ba6-9e8f-12aeb85b8a5e for instance 3fa9077c-183f-48e0-898d-563797ebd546 on n-h2-862967-2 Oct 29 03:24:34.166833 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-42c9899c-61ae-4943-8ab3-fea1ba9ca9ea req-292c15f6-aca7-4847-8e18-9fb4af36bafe service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037044 Oct 29 03:24:34.168037 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2932/5638] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:24:34.255197 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cf3e0954-eec0-4a8a-9b48-ccc7d8520b06 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb06badda8549e3ae02e9f6222098bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab62a8a623d48dd865d5c7c96daead1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:34.263820 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cf3e0954-eec0-4a8a-9b48-ccc7d8520b06 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] 10.222.0.46 "GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546" status: 200 len: 1581 microversion: 2.1 time: 0.892188 Oct 29 03:24:34.264810 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2707/5639] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:33 2022] GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546 => generated 1581 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:34.932915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f701b34f-d74c-440b-b835-71e581776b58 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:34.934372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f701b34f-d74c-440b-b835-71e581776b58 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 925ba68c-9ad9-4da3-ab7c-9a2118eed63e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:34.948898 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f701b34f-d74c-440b-b835-71e581776b58 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:34.950107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f701b34f-d74c-440b-b835-71e581776b58 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:34.950765 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f701b34f-d74c-440b-b835-71e581776b58 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:34.952020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f701b34f-d74c-440b-b835-71e581776b58 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:34.953096 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f701b34f-d74c-440b-b835-71e581776b58 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:34.954293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f701b34f-d74c-440b-b835-71e581776b58 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:35.142005 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f701b34f-d74c-440b-b835-71e581776b58 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:35.165451 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f701b34f-d74c-440b-b835-71e581776b58 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e" status: 200 len: 1506 microversion: 2.1 time: 0.239357 Oct 29 03:24:35.166318 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2933/5640] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:34 2022] GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e => generated 1506 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:35.287693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0e3b3021-8447-4c1d-8b4e-25f559a2eb8c tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:35.288205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0e3b3021-8447-4c1d-8b4e-25f559a2eb8c tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] [instance: 3fa9077c-183f-48e0-898d-563797ebd546] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:35.299292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0e3b3021-8447-4c1d-8b4e-25f559a2eb8c tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:35.299974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0e3b3021-8447-4c1d-8b4e-25f559a2eb8c tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:35.300684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0e3b3021-8447-4c1d-8b4e-25f559a2eb8c tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:35.301772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0e3b3021-8447-4c1d-8b4e-25f559a2eb8c tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:35.302415 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0e3b3021-8447-4c1d-8b4e-25f559a2eb8c tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:35.303000 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0e3b3021-8447-4c1d-8b4e-25f559a2eb8c tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:35.337662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-cf6442b5-5b77-4d5b-b27a-68c57212a47a req-747f6782-6864-46ab-a1ad-49a024f93b2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "925ba68c-9ad9-4da3-ab7c-9a2118eed63e", "name": "network-vif-deleted", "tag": "3c6a746e-508e-4c42-a78d-30ccab024121"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:24:35.358781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-cf6442b5-5b77-4d5b-b27a-68c57212a47a req-747f6782-6864-46ab-a1ad-49a024f93b2b service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:35.360144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-cf6442b5-5b77-4d5b-b27a-68c57212a47a req-747f6782-6864-46ab-a1ad-49a024f93b2b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:35.364889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-cf6442b5-5b77-4d5b-b27a-68c57212a47a req-747f6782-6864-46ab-a1ad-49a024f93b2b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:35.391838 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-cf6442b5-5b77-4d5b-b27a-68c57212a47a req-747f6782-6864-46ab-a1ad-49a024f93b2b service nova] Creating event network-vif-deleted:3c6a746e-508e-4c42-a78d-30ccab024121 for instance 925ba68c-9ad9-4da3-ab7c-9a2118eed63e on n-h1-862967-2 Oct 29 03:24:35.407931 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-cf6442b5-5b77-4d5b-b27a-68c57212a47a req-747f6782-6864-46ab-a1ad-49a024f93b2b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075581 Oct 29 03:24:35.416947 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2934/5641] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 29 03:24:35.521072 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0e3b3021-8447-4c1d-8b4e-25f559a2eb8c tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb06badda8549e3ae02e9f6222098bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab62a8a623d48dd865d5c7c96daead1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:35.532259 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0e3b3021-8447-4c1d-8b4e-25f559a2eb8c tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] 10.222.0.46 "GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546" status: 200 len: 1396 microversion: 2.1 time: 0.248136 Oct 29 03:24:35.553611 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2708/5642] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:35 2022] GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546 => generated 1396 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:36.193567 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3a61b2ac-b5a0-44f2-981f-1aa35ef17eb7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:36.194264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3a61b2ac-b5a0-44f2-981f-1aa35ef17eb7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 925ba68c-9ad9-4da3-ab7c-9a2118eed63e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:36.211212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a61b2ac-b5a0-44f2-981f-1aa35ef17eb7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:36.211707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a61b2ac-b5a0-44f2-981f-1aa35ef17eb7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:36.212354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a61b2ac-b5a0-44f2-981f-1aa35ef17eb7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:36.213280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a61b2ac-b5a0-44f2-981f-1aa35ef17eb7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:36.213882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a61b2ac-b5a0-44f2-981f-1aa35ef17eb7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:36.214456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3a61b2ac-b5a0-44f2-981f-1aa35ef17eb7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:36.229860 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-3a61b2ac-b5a0-44f2-981f-1aa35ef17eb7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] HTTP exception thrown: Instance 925ba68c-9ad9-4da3-ab7c-9a2118eed63e could not be found. Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3a61b2ac-b5a0-44f2-981f-1aa35ef17eb7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Request method failure captured: Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e HTTP/1.1 Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJzN_0W3F2Tvd5_DwYEYaE7yArMUzQkw0yVRFyD806tbuPfgIN9hrPP-pm4QkI5-axnSQL2lFY8Zz_29U2X0iME7rTgOu74wHL71o9B_5IukGwbcOdtvhyWYdmcAPvnUhuYS1WrbTu-q-KzFqGL1fD3An-d36JB4OLVV1PNh19tG-1E Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/af30f7beecad4c448ff0706230ecb8d9"}]}] Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersTestJSON-1972911719 Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersTestJSON-1972911719-project Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 50ec777bf8ea4a9eb7d9d6cf995ba4ef Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersTestJSON-1972911719-project Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 925ba68c-9ad9-4da3-ab7c-9a2118eed63e could not be found. Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '925ba68c-9ad9-4da3-ab7c-9a2118eed63e'} Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 925ba68c-9ad9-4da3-ab7c-9a2118eed63e could not be found. Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 925ba68c-9ad9-4da3-ab7c-9a2118eed63e could not be found. Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:24:36.232095 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:24:36.236004 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:24:36.236004 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:24:36.236004 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:24:36.236004 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:24:36.236004 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:24:36.236004 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 925ba68c-9ad9-4da3-ab7c-9a2118eed63e could not be found. Oct 29 03:24:36.236004 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:24:36.236004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3a61b2ac-b5a0-44f2-981f-1aa35ef17eb7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Returning 404 to user: Instance 925ba68c-9ad9-4da3-ab7c-9a2118eed63e could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:24:36.236004 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3a61b2ac-b5a0-44f2-981f-1aa35ef17eb7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e" status: 404 len: 111 microversion: 2.1 time: 0.047555 Oct 29 03:24:36.242111 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2935/5643] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:36 2022] GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:24:36.247049 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a3d0633b-c5b5-4edb-bb17-b05dd74f7cea tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Action: 'create', calling method: .version_select at 0x7ff052bac940>, body: {"keypair": {"name": "tempest-key-1840098627", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLK6j8Foe1uZ9AY5Fzo3t7pJYGsctyhbfeCBNYiikbzmHU5toi+GgV/4e3Io/or1QnK4ThH8tL2/xv+XOBs6TFWBW/qr9lYmGhy41lF023Aj5n0cAafekv6Zxluo5fljw=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:24:36.252918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:36.272700 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-a3d0633b-c5b5-4edb-bb17-b05dd74f7cea tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Getting quotas for project af30f7beecad4c448ff0706230ecb8d9. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:24:36.286344 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-a3d0633b-c5b5-4edb-bb17-b05dd74f7cea tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Getting quotas for user 50ec777bf8ea4a9eb7d9d6cf995ba4ef and project af30f7beecad4c448ff0706230ecb8d9. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:24:36.323570 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a3d0633b-c5b5-4edb-bb17-b05dd74f7cea tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.080082 Oct 29 03:24:36.324818 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2709/5644] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:24:36 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:24:36.334792 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a86168ce-0907-41dc-b609-7bbd10b6f97b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '.version_select at 0x7ff05295baf0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:36.338994 n-d-862967-2 devstack@n-api.service[127124]: WARNING oslo_db.sqlalchemy.utils [None req-a86168ce-0907-41dc-b609-7bbd10b6f97b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 29 03:24:36.347316 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a86168ce-0907-41dc-b609-7bbd10b6f97b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.016259 Oct 29 03:24:36.352672 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2936/5645] 10.222.0.46 () {58 vars in 1137 bytes} [Sat Oct 29 03:24:36 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:24:36.477699 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ddc901a0-cf0f-4b95-965d-92eb17831261 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-300307571", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "key_name": "tempest-key-1840098627", "networks": [{"uuid": "ca8e0bef-c1ec-47bd-9591-43a816db6a16"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:24:36.569125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6d8d054e-da14-4b34-9075-addc5539204a tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:36.569702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-ddc901a0-cf0f-4b95-965d-92eb17831261 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] validate_networks() for [('ca8e0bef-c1ec-47bd-9591-43a816db6a16', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:24:36.572163 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6d8d054e-da14-4b34-9075-addc5539204a tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] [instance: 3fa9077c-183f-48e0-898d-563797ebd546] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:36.593581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d8d054e-da14-4b34-9075-addc5539204a tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:36.594081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d8d054e-da14-4b34-9075-addc5539204a tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:36.595510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d8d054e-da14-4b34-9075-addc5539204a tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:36.597144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d8d054e-da14-4b34-9075-addc5539204a tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:36.597611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d8d054e-da14-4b34-9075-addc5539204a tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:36.599706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d8d054e-da14-4b34-9075-addc5539204a tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:36.723562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6d8d054e-da14-4b34-9075-addc5539204a tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb06badda8549e3ae02e9f6222098bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab62a8a623d48dd865d5c7c96daead1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:36.739386 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6d8d054e-da14-4b34-9075-addc5539204a tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] 10.222.0.46 "GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546" status: 200 len: 1396 microversion: 2.1 time: 0.188515 Oct 29 03:24:36.750786 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2937/5646] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:36 2022] GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546 => generated 1396 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:37.217954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-ddc901a0-cf0f-4b95-965d-92eb17831261 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:24:37.218461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-ddc901a0-cf0f-4b95-965d-92eb17831261 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:24:37.219014 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-ddc901a0-cf0f-4b95-965d-92eb17831261 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:24:37.219484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-ddc901a0-cf0f-4b95-965d-92eb17831261 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:24:37.219961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-ddc901a0-cf0f-4b95-965d-92eb17831261 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:24:37.235819 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ddc901a0-cf0f-4b95-965d-92eb17831261 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:37.240233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ddc901a0-cf0f-4b95-965d-92eb17831261 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:37.240794 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ddc901a0-cf0f-4b95-965d-92eb17831261 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:37.252148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ddc901a0-cf0f-4b95-965d-92eb17831261 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:37.256705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ddc901a0-cf0f-4b95-965d-92eb17831261 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:37.257246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ddc901a0-cf0f-4b95-965d-92eb17831261 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:37.301116 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-ddc901a0-cf0f-4b95-965d-92eb17831261 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Getting quotas for project af30f7beecad4c448ff0706230ecb8d9. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:24:37.307843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-ddc901a0-cf0f-4b95-965d-92eb17831261 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Getting quotas for user 50ec777bf8ea4a9eb7d9d6cf995ba4ef and project af30f7beecad4c448ff0706230ecb8d9. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:24:37.323914 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ddc901a0-cf0f-4b95-965d-92eb17831261 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:24:37.327496 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ddc901a0-cf0f-4b95-965d-92eb17831261 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: d1718402-c25a-437a-a916-4e828bde1d67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:24:37.416428 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ddc901a0-cf0f-4b95-965d-92eb17831261 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.942265 Oct 29 03:24:37.417726 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2710/5647] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:24:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:24:37.430996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4ad33633-ec41-4a9e-8bd3-f6906bb7df27 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:37.442044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4ad33633-ec41-4a9e-8bd3-f6906bb7df27 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: d1718402-c25a-437a-a916-4e828bde1d67] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:37.652738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4ad33633-ec41-4a9e-8bd3-f6906bb7df27 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:37.660488 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4ad33633-ec41-4a9e-8bd3-f6906bb7df27 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67" status: 200 len: 1228 microversion: 2.1 time: 0.233300 Oct 29 03:24:37.678873 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2938/5648] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:37 2022] GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67 => generated 1228 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:37.770767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1cdf09f2-208d-47e3-98e5-1f9d7dfae16a tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:37.771621 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1cdf09f2-208d-47e3-98e5-1f9d7dfae16a tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] [instance: 3fa9077c-183f-48e0-898d-563797ebd546] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:37.789517 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cdf09f2-208d-47e3-98e5-1f9d7dfae16a tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:37.790395 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cdf09f2-208d-47e3-98e5-1f9d7dfae16a tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:37.790991 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cdf09f2-208d-47e3-98e5-1f9d7dfae16a tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:37.791875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cdf09f2-208d-47e3-98e5-1f9d7dfae16a tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:37.792487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cdf09f2-208d-47e3-98e5-1f9d7dfae16a tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:37.793068 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cdf09f2-208d-47e3-98e5-1f9d7dfae16a tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:37.986229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1cdf09f2-208d-47e3-98e5-1f9d7dfae16a tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb06badda8549e3ae02e9f6222098bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab62a8a623d48dd865d5c7c96daead1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:38.013264 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1cdf09f2-208d-47e3-98e5-1f9d7dfae16a tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] 10.222.0.46 "GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546" status: 200 len: 1396 microversion: 2.1 time: 0.245732 Oct 29 03:24:38.026882 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2711/5649] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:37 2022] GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546 => generated 1396 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:38.683615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-abf0a0a6-5794-473c-a7cf-2448f0c9eb7b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:38.685130 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-abf0a0a6-5794-473c-a7cf-2448f0c9eb7b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: d1718402-c25a-437a-a916-4e828bde1d67] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:38.696789 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abf0a0a6-5794-473c-a7cf-2448f0c9eb7b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:38.697765 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abf0a0a6-5794-473c-a7cf-2448f0c9eb7b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:38.698368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abf0a0a6-5794-473c-a7cf-2448f0c9eb7b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:38.700050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abf0a0a6-5794-473c-a7cf-2448f0c9eb7b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:38.701080 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abf0a0a6-5794-473c-a7cf-2448f0c9eb7b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:38.701892 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abf0a0a6-5794-473c-a7cf-2448f0c9eb7b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:38.836336 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-abf0a0a6-5794-473c-a7cf-2448f0c9eb7b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:38.849008 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-abf0a0a6-5794-473c-a7cf-2448f0c9eb7b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67" status: 200 len: 1280 microversion: 2.1 time: 0.166552 Oct 29 03:24:38.849655 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2939/5650] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:38 2022] GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67 => generated 1280 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:39.038780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c2a062c4-a61b-40f1-9cda-9702cf1fbe84 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:39.040086 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c2a062c4-a61b-40f1-9cda-9702cf1fbe84 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] [instance: 3fa9077c-183f-48e0-898d-563797ebd546] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:39.052859 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2a062c4-a61b-40f1-9cda-9702cf1fbe84 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:39.054067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2a062c4-a61b-40f1-9cda-9702cf1fbe84 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:39.055525 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2a062c4-a61b-40f1-9cda-9702cf1fbe84 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:39.058685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2a062c4-a61b-40f1-9cda-9702cf1fbe84 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:39.059342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2a062c4-a61b-40f1-9cda-9702cf1fbe84 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:39.059943 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2a062c4-a61b-40f1-9cda-9702cf1fbe84 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:39.245530 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c2a062c4-a61b-40f1-9cda-9702cf1fbe84 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb06badda8549e3ae02e9f6222098bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab62a8a623d48dd865d5c7c96daead1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:39.257308 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c2a062c4-a61b-40f1-9cda-9702cf1fbe84 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] 10.222.0.46 "GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546" status: 200 len: 1396 microversion: 2.1 time: 0.223180 Oct 29 03:24:39.272718 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2712/5651] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:39 2022] GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546 => generated 1396 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:39.875605 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c3d3804f-7a6e-4d1b-81a0-331573a307a3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:39.876248 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c3d3804f-7a6e-4d1b-81a0-331573a307a3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: d1718402-c25a-437a-a916-4e828bde1d67] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:39.887150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3d3804f-7a6e-4d1b-81a0-331573a307a3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:39.887646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3d3804f-7a6e-4d1b-81a0-331573a307a3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:39.888088 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3d3804f-7a6e-4d1b-81a0-331573a307a3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:39.888835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3d3804f-7a6e-4d1b-81a0-331573a307a3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:39.892822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3d3804f-7a6e-4d1b-81a0-331573a307a3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:39.895418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3d3804f-7a6e-4d1b-81a0-331573a307a3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:40.021293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c3d3804f-7a6e-4d1b-81a0-331573a307a3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:40.031672 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c3d3804f-7a6e-4d1b-81a0-331573a307a3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67" status: 200 len: 1286 microversion: 2.1 time: 0.160732 Oct 29 03:24:40.033020 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2940/5652] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:39 2022] GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67 => generated 1286 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:40.283845 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-507a8b1d-3d84-4f51-8d07-2b4f2c7d32e9 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:40.284445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-507a8b1d-3d84-4f51-8d07-2b4f2c7d32e9 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] [instance: 3fa9077c-183f-48e0-898d-563797ebd546] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:40.293641 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-507a8b1d-3d84-4f51-8d07-2b4f2c7d32e9 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:40.294459 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-507a8b1d-3d84-4f51-8d07-2b4f2c7d32e9 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:40.295180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-507a8b1d-3d84-4f51-8d07-2b4f2c7d32e9 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:40.296109 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-507a8b1d-3d84-4f51-8d07-2b4f2c7d32e9 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:40.296819 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-507a8b1d-3d84-4f51-8d07-2b4f2c7d32e9 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:40.297470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-507a8b1d-3d84-4f51-8d07-2b4f2c7d32e9 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:40.337362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-507a8b1d-3d84-4f51-8d07-2b4f2c7d32e9 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:40.338153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-507a8b1d-3d84-4f51-8d07-2b4f2c7d32e9 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:40.338799 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-507a8b1d-3d84-4f51-8d07-2b4f2c7d32e9 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:40.339463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-507a8b1d-3d84-4f51-8d07-2b4f2c7d32e9 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lazy-loading 'fault' on Instance uuid 3fa9077c-183f-48e0-898d-563797ebd546 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:24:40.512602 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-507a8b1d-3d84-4f51-8d07-2b4f2c7d32e9 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb06badda8549e3ae02e9f6222098bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eab62a8a623d48dd865d5c7c96daead1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:40.526788 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-507a8b1d-3d84-4f51-8d07-2b4f2c7d32e9 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] 10.222.0.46 "GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546" status: 200 len: 1401 microversion: 2.1 time: 0.247116 Oct 29 03:24:40.528591 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2713/5653] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:40 2022] GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546 => generated 1401 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:41.056168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fbcce3b3-22d5-42f0-a225-13576a8cf393 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:41.056978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fbcce3b3-22d5-42f0-a225-13576a8cf393 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: d1718402-c25a-437a-a916-4e828bde1d67] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:41.062089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:41.066124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbcce3b3-22d5-42f0-a225-13576a8cf393 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:41.066961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbcce3b3-22d5-42f0-a225-13576a8cf393 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:41.083193 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbcce3b3-22d5-42f0-a225-13576a8cf393 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:41.083193 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbcce3b3-22d5-42f0-a225-13576a8cf393 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:41.085353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbcce3b3-22d5-42f0-a225-13576a8cf393 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:41.086570 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fbcce3b3-22d5-42f0-a225-13576a8cf393 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:41.275558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fbcce3b3-22d5-42f0-a225-13576a8cf393 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:41.288597 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fbcce3b3-22d5-42f0-a225-13576a8cf393 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67" status: 200 len: 1328 microversion: 2.1 time: 0.236855 Oct 29 03:24:41.289565 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2941/5654] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:41 2022] GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67 => generated 1328 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:41.550316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-853b851f-38d6-44ae-8a02-4bd8830955f1 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:41.551093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-853b851f-38d6-44ae-8a02-4bd8830955f1 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] [instance: 3fa9077c-183f-48e0-898d-563797ebd546] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:41.562335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-853b851f-38d6-44ae-8a02-4bd8830955f1 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:41.563444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-853b851f-38d6-44ae-8a02-4bd8830955f1 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:41.564178 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-853b851f-38d6-44ae-8a02-4bd8830955f1 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:41.565910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-853b851f-38d6-44ae-8a02-4bd8830955f1 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:41.567287 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-853b851f-38d6-44ae-8a02-4bd8830955f1 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:41.568657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-853b851f-38d6-44ae-8a02-4bd8830955f1 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:41.595979 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-853b851f-38d6-44ae-8a02-4bd8830955f1 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] HTTP exception thrown: Instance 3fa9077c-183f-48e0-898d-563797ebd546 could not be found. Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-853b851f-38d6-44ae-8a02-4bd8830955f1 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Request method failure captured: Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546 HTTP/1.1 Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJvpw8jKnpRGdJJ74DHuE_CC8n3ISamW4o2Zwtz1w88Ft3gJqGggYV9FYFIvWZ7GSaP8SqU_dscHBg7NK7T2qIxkoIcB9VbEYWtfCTQ0oaayPezbSbCm0f4da09TUimv8oybnwgKe3ioZ3JH5Fa0Jr7Q1ni_znKpqYsrvlcXmfXjw58 Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: eab62a8a623d48dd865d5c7c96daead1 Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestVolumeBackupRestore-892410835 Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/eab62a8a623d48dd865d5c7c96daead1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/eab62a8a623d48dd865d5c7c96daead1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_eab62a8a623d48dd865d5c7c96daead1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/eab62a8a623d48dd865d5c7c96daead1"}]}] Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestVolumeBackupRestore-892410835 Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: eab62a8a623d48dd865d5c7c96daead1 Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestVolumeBackupRestore-892410835 Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestVolumeBackupRestore-892410835-project Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 4fb06badda8549e3ae02e9f6222098bc Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestVolumeBackupRestore-892410835-project Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 3fa9077c-183f-48e0-898d-563797ebd546 could not be found. Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '3fa9077c-183f-48e0-898d-563797ebd546'} Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fa9077c-183f-48e0-898d-563797ebd546 could not be found. Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fa9077c-183f-48e0-898d-563797ebd546 could not be found. Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:24:41.599180 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:24:41.603198 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:24:41.603198 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:24:41.603198 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:24:41.603198 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:24:41.603198 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:24:41.603198 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fa9077c-183f-48e0-898d-563797ebd546 could not be found. Oct 29 03:24:41.603198 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:24:41.609871 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-853b851f-38d6-44ae-8a02-4bd8830955f1 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Returning 404 to user: Instance 3fa9077c-183f-48e0-898d-563797ebd546 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:24:41.615421 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-853b851f-38d6-44ae-8a02-4bd8830955f1 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] 10.222.0.46 "GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546" status: 404 len: 111 microversion: 2.1 time: 0.067196 Oct 29 03:24:41.621406 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2714/5655] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:41 2022] GET /compute/v2.1/servers/3fa9077c-183f-48e0-898d-563797ebd546 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:24:41.791901 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-64ae7554-f3f7-4901-97d5-2bef1af5a51b req-2896184b-1707-4dde-bf66-ad575ca33964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1718402-c25a-437a-a916-4e828bde1d67", "tag": "1de22cad-dce9-4137-bb17-39e33f5b5c04"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:24:41.836771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-64ae7554-f3f7-4901-97d5-2bef1af5a51b req-2896184b-1707-4dde-bf66-ad575ca33964 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:41.836771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-64ae7554-f3f7-4901-97d5-2bef1af5a51b req-2896184b-1707-4dde-bf66-ad575ca33964 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:41.836771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-64ae7554-f3f7-4901-97d5-2bef1af5a51b req-2896184b-1707-4dde-bf66-ad575ca33964 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:41.844235 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-64ae7554-f3f7-4901-97d5-2bef1af5a51b req-2896184b-1707-4dde-bf66-ad575ca33964 service nova] Creating event network-changed:1de22cad-dce9-4137-bb17-39e33f5b5c04 for instance d1718402-c25a-437a-a916-4e828bde1d67 on n-h1-862967-2 Oct 29 03:24:41.851432 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-64ae7554-f3f7-4901-97d5-2bef1af5a51b req-2896184b-1707-4dde-bf66-ad575ca33964 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063035 Oct 29 03:24:41.855030 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2942/5656] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:24:42.060083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f6751203-12e4-4be7-b0d2-505743847002 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] Calling method '.version_select at 0x7ff052bbbaf0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:42.086479 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f6751203-12e4-4be7-b0d2-505743847002 tempest-TestVolumeBackupRestore-892410835 tempest-TestVolumeBackupRestore-892410835-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2132373316" status: 202 len: 0 microversion: 2.1 time: 0.030485 Oct 29 03:24:42.087436 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2715/5657] 10.222.0.46 () {58 vars in 1269 bytes} [Sat Oct 29 03:24:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2132373316 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:24:42.323730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cdc3e3b7-d56d-414e-8934-8f499d97ecc6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:42.323730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cdc3e3b7-d56d-414e-8934-8f499d97ecc6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: d1718402-c25a-437a-a916-4e828bde1d67] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:42.330608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cdc3e3b7-d56d-414e-8934-8f499d97ecc6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:42.331105 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cdc3e3b7-d56d-414e-8934-8f499d97ecc6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:42.331580 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cdc3e3b7-d56d-414e-8934-8f499d97ecc6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:42.334195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cdc3e3b7-d56d-414e-8934-8f499d97ecc6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:42.335186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cdc3e3b7-d56d-414e-8934-8f499d97ecc6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:42.335626 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cdc3e3b7-d56d-414e-8934-8f499d97ecc6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:42.896938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cdc3e3b7-d56d-414e-8934-8f499d97ecc6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:42.922600 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cdc3e3b7-d56d-414e-8934-8f499d97ecc6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67" status: 200 len: 1328 microversion: 2.1 time: 0.611982 Oct 29 03:24:42.923586 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2943/5658] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:42 2022] GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67 => generated 1328 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:43.951520 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9b907ee3-2251-4ef8-9ecb-4539a52c39c3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:43.952831 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9b907ee3-2251-4ef8-9ecb-4539a52c39c3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: d1718402-c25a-437a-a916-4e828bde1d67] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:43.969732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b907ee3-2251-4ef8-9ecb-4539a52c39c3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:43.970495 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b907ee3-2251-4ef8-9ecb-4539a52c39c3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:43.971128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b907ee3-2251-4ef8-9ecb-4539a52c39c3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:43.972136 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b907ee3-2251-4ef8-9ecb-4539a52c39c3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:43.973143 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b907ee3-2251-4ef8-9ecb-4539a52c39c3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:43.974705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b907ee3-2251-4ef8-9ecb-4539a52c39c3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:44.649811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9b907ee3-2251-4ef8-9ecb-4539a52c39c3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:44.679606 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9b907ee3-2251-4ef8-9ecb-4539a52c39c3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67" status: 200 len: 1328 microversion: 2.1 time: 0.735965 Oct 29 03:24:44.691824 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2716/5659] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:43 2022] GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67 => generated 1328 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:45.139416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5fee758b-a613-4e4f-a5ba-37017158b4c7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:24:45.141851 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5fee758b-a613-4e4f-a5ba-37017158b4c7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:45.152846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fee758b-a613-4e4f-a5ba-37017158b4c7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:45.153346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fee758b-a613-4e4f-a5ba-37017158b4c7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:45.153779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fee758b-a613-4e4f-a5ba-37017158b4c7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:45.154489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fee758b-a613-4e4f-a5ba-37017158b4c7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:45.154943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fee758b-a613-4e4f-a5ba-37017158b4c7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:45.155456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fee758b-a613-4e4f-a5ba-37017158b4c7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:45.249193 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5fee758b-a613-4e4f-a5ba-37017158b4c7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "POST /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41/action" status: 200 len: 63166 microversion: 2.1 time: 0.627433 Oct 29 03:24:45.267710 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2944/5660] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:24:44 2022] POST /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41/action => generated 63166 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 03:24:45.709472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cb6a44ce-1137-4089-be3e-489957e109d1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:45.710153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cb6a44ce-1137-4089-be3e-489957e109d1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: d1718402-c25a-437a-a916-4e828bde1d67] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:45.728566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb6a44ce-1137-4089-be3e-489957e109d1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:45.729094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb6a44ce-1137-4089-be3e-489957e109d1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:45.729709 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb6a44ce-1137-4089-be3e-489957e109d1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:45.732209 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb6a44ce-1137-4089-be3e-489957e109d1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:45.732850 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb6a44ce-1137-4089-be3e-489957e109d1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:45.733421 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb6a44ce-1137-4089-be3e-489957e109d1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:46.004370 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cb6a44ce-1137-4089-be3e-489957e109d1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:46.014003 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cb6a44ce-1137-4089-be3e-489957e109d1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67" status: 200 len: 1328 microversion: 2.1 time: 0.311926 Oct 29 03:24:46.021517 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2717/5661] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:45 2022] GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67 => generated 1328 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:24:46.517117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-a2118164-fb94-4ad6-ae17-df80ef57e451 req-e82d8393-6238-4a39-adcc-1f06ddfae125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1718402-c25a-437a-a916-4e828bde1d67", "name": "network-vif-plugged", "status": "completed", "tag": "1de22cad-dce9-4137-bb17-39e33f5b5c04"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:24:46.547799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a2118164-fb94-4ad6-ae17-df80ef57e451 req-e82d8393-6238-4a39-adcc-1f06ddfae125 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:46.548298 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a2118164-fb94-4ad6-ae17-df80ef57e451 req-e82d8393-6238-4a39-adcc-1f06ddfae125 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:46.548775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a2118164-fb94-4ad6-ae17-df80ef57e451 req-e82d8393-6238-4a39-adcc-1f06ddfae125 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:46.599486 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-a2118164-fb94-4ad6-ae17-df80ef57e451 req-e82d8393-6238-4a39-adcc-1f06ddfae125 service nova] Creating event network-vif-plugged:1de22cad-dce9-4137-bb17-39e33f5b5c04 for instance d1718402-c25a-437a-a916-4e828bde1d67 on n-h1-862967-2 Oct 29 03:24:46.617227 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-a2118164-fb94-4ad6-ae17-df80ef57e451 req-e82d8393-6238-4a39-adcc-1f06ddfae125 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105800 Oct 29 03:24:46.618550 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2945/5662] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:24:47.043979 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f75b13c1-413b-46c8-808b-8c6489daa689 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:47.044488 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f75b13c1-413b-46c8-808b-8c6489daa689 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: d1718402-c25a-437a-a916-4e828bde1d67] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:47.053631 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f75b13c1-413b-46c8-808b-8c6489daa689 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:47.079203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f75b13c1-413b-46c8-808b-8c6489daa689 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:47.089271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f75b13c1-413b-46c8-808b-8c6489daa689 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:47.090361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f75b13c1-413b-46c8-808b-8c6489daa689 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:47.091019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f75b13c1-413b-46c8-808b-8c6489daa689 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:47.091639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f75b13c1-413b-46c8-808b-8c6489daa689 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:47.287687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:47.299410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f75b13c1-413b-46c8-808b-8c6489daa689 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:47.308023 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f75b13c1-413b-46c8-808b-8c6489daa689 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67" status: 200 len: 1328 microversion: 2.1 time: 0.268020 Oct 29 03:24:47.308647 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2718/5663] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:47 2022] GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67 => generated 1328 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:24:48.329529 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:48.334771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4159169c-c581-4872-ac77-a66fb456d5c4 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:48.335800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4159169c-c581-4872-ac77-a66fb456d5c4 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: d1718402-c25a-437a-a916-4e828bde1d67] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:48.350747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4159169c-c581-4872-ac77-a66fb456d5c4 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:48.351249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4159169c-c581-4872-ac77-a66fb456d5c4 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:48.351695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4159169c-c581-4872-ac77-a66fb456d5c4 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:48.352489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4159169c-c581-4872-ac77-a66fb456d5c4 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:48.352941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4159169c-c581-4872-ac77-a66fb456d5c4 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:48.353356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4159169c-c581-4872-ac77-a66fb456d5c4 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:48.567413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4159169c-c581-4872-ac77-a66fb456d5c4 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:48.577209 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4159169c-c581-4872-ac77-a66fb456d5c4 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67" status: 200 len: 1507 microversion: 2.1 time: 0.249504 Oct 29 03:24:48.578125 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2946/5664] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:48 2022] GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67 => generated 1507 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:48.604383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-39dc0587-3684-44b1-9e02-eb16c1dfb63f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:48.605018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-39dc0587-3684-44b1-9e02-eb16c1dfb63f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: d1718402-c25a-437a-a916-4e828bde1d67] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:48.610842 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=10 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:48.617249 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39dc0587-3684-44b1-9e02-eb16c1dfb63f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:48.617741 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39dc0587-3684-44b1-9e02-eb16c1dfb63f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:48.618174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39dc0587-3684-44b1-9e02-eb16c1dfb63f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:48.618883 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39dc0587-3684-44b1-9e02-eb16c1dfb63f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:48.619332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39dc0587-3684-44b1-9e02-eb16c1dfb63f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:48.619750 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39dc0587-3684-44b1-9e02-eb16c1dfb63f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:48.840009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-39dc0587-3684-44b1-9e02-eb16c1dfb63f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:48.851825 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-39dc0587-3684-44b1-9e02-eb16c1dfb63f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67" status: 200 len: 1507 microversion: 2.1 time: 0.251138 Oct 29 03:24:48.854775 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2719/5665] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:48 2022] GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67 => generated 1507 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:48.880199 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bc6bf53a-7b1b-48c7-b879-4549c232345f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:48.880845 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bc6bf53a-7b1b-48c7-b879-4549c232345f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: d1718402-c25a-437a-a916-4e828bde1d67] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:48.906811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc6bf53a-7b1b-48c7-b879-4549c232345f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:48.908599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc6bf53a-7b1b-48c7-b879-4549c232345f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:48.909312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc6bf53a-7b1b-48c7-b879-4549c232345f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:48.912159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc6bf53a-7b1b-48c7-b879-4549c232345f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:48.913948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc6bf53a-7b1b-48c7-b879-4549c232345f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:48.915439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc6bf53a-7b1b-48c7-b879-4549c232345f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:48.982826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bc6bf53a-7b1b-48c7-b879-4549c232345f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: d1718402-c25a-437a-a916-4e828bde1d67] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:24:49.139751 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bc6bf53a-7b1b-48c7-b879-4549c232345f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67" status: 204 len: 0 microversion: 2.1 time: 0.262344 Oct 29 03:24:49.141536 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2947/5666] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:24:48 2022] DELETE /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:24:49.150008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ebef3f41-b2ec-4780-be0d-cdb9fd7b5e8f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:49.150825 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ebef3f41-b2ec-4780-be0d-cdb9fd7b5e8f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: d1718402-c25a-437a-a916-4e828bde1d67] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:49.160083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ebef3f41-b2ec-4780-be0d-cdb9fd7b5e8f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:49.162901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ebef3f41-b2ec-4780-be0d-cdb9fd7b5e8f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:49.163510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ebef3f41-b2ec-4780-be0d-cdb9fd7b5e8f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:49.166213 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ebef3f41-b2ec-4780-be0d-cdb9fd7b5e8f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:49.167857 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ebef3f41-b2ec-4780-be0d-cdb9fd7b5e8f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:49.169092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ebef3f41-b2ec-4780-be0d-cdb9fd7b5e8f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:49.464688 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ebef3f41-b2ec-4780-be0d-cdb9fd7b5e8f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:49.479803 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ebef3f41-b2ec-4780-be0d-cdb9fd7b5e8f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67" status: 200 len: 1513 microversion: 2.1 time: 0.333581 Oct 29 03:24:49.481331 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2720/5667] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:49 2022] GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67 => generated 1513 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:24:50.507529 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4167292f-d546-442e-b4ed-ee1f43c3616f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:50.508284 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4167292f-d546-442e-b4ed-ee1f43c3616f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: d1718402-c25a-437a-a916-4e828bde1d67] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:50.531626 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4167292f-d546-442e-b4ed-ee1f43c3616f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:50.532406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4167292f-d546-442e-b4ed-ee1f43c3616f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:50.533636 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4167292f-d546-442e-b4ed-ee1f43c3616f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:50.534746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4167292f-d546-442e-b4ed-ee1f43c3616f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:50.535352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4167292f-d546-442e-b4ed-ee1f43c3616f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:50.535929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4167292f-d546-442e-b4ed-ee1f43c3616f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:50.718350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4167292f-d546-442e-b4ed-ee1f43c3616f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:50.727414 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4167292f-d546-442e-b4ed-ee1f43c3616f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67" status: 200 len: 1513 microversion: 2.1 time: 0.224271 Oct 29 03:24:50.744348 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2948/5668] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:50 2022] GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67 => generated 1513 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:51.685677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-27d173fa-fd67-43a2-9862-bf06c8136efc req-4ac9c2d1-d5e4-49db-b4bc-dc07e3dcd676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1718402-c25a-437a-a916-4e828bde1d67", "name": "network-vif-deleted", "tag": "1de22cad-dce9-4137-bb17-39e33f5b5c04"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:24:51.715053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-27d173fa-fd67-43a2-9862-bf06c8136efc req-4ac9c2d1-d5e4-49db-b4bc-dc07e3dcd676 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:51.719486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-27d173fa-fd67-43a2-9862-bf06c8136efc req-4ac9c2d1-d5e4-49db-b4bc-dc07e3dcd676 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:51.720164 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-27d173fa-fd67-43a2-9862-bf06c8136efc req-4ac9c2d1-d5e4-49db-b4bc-dc07e3dcd676 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:51.758531 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-27d173fa-fd67-43a2-9862-bf06c8136efc req-4ac9c2d1-d5e4-49db-b4bc-dc07e3dcd676 service nova] Creating event network-vif-deleted:1de22cad-dce9-4137-bb17-39e33f5b5c04 for instance d1718402-c25a-437a-a916-4e828bde1d67 on n-h1-862967-2 Oct 29 03:24:51.773848 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-27d173fa-fd67-43a2-9862-bf06c8136efc req-4ac9c2d1-d5e4-49db-b4bc-dc07e3dcd676 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096594 Oct 29 03:24:51.776828 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2949/5669] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:24:51.792063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d7f4b782-35ba-4216-9286-a38b73910c70 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:51.794389 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d7f4b782-35ba-4216-9286-a38b73910c70 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: d1718402-c25a-437a-a916-4e828bde1d67] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:51.817607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7f4b782-35ba-4216-9286-a38b73910c70 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:51.818277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7f4b782-35ba-4216-9286-a38b73910c70 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:51.818797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7f4b782-35ba-4216-9286-a38b73910c70 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:51.821324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7f4b782-35ba-4216-9286-a38b73910c70 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:51.822649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7f4b782-35ba-4216-9286-a38b73910c70 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:51.825690 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7f4b782-35ba-4216-9286-a38b73910c70 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:51.934034 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d7f4b782-35ba-4216-9286-a38b73910c70 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:51.946792 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d7f4b782-35ba-4216-9286-a38b73910c70 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67" status: 200 len: 1313 microversion: 2.1 time: 0.167734 Oct 29 03:24:51.964853 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2950/5670] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:51 2022] GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:52.067731 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e3f8b799-81cf-4ffb-8d9f-fe8390cb6697 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:52.070798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e3f8b799-81cf-4ffb-8d9f-fe8390cb6697 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:52.079533 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3f8b799-81cf-4ffb-8d9f-fe8390cb6697 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:52.080195 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3f8b799-81cf-4ffb-8d9f-fe8390cb6697 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:52.080683 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3f8b799-81cf-4ffb-8d9f-fe8390cb6697 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:52.081652 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3f8b799-81cf-4ffb-8d9f-fe8390cb6697 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:52.082279 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3f8b799-81cf-4ffb-8d9f-fe8390cb6697 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:52.082954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3f8b799-81cf-4ffb-8d9f-fe8390cb6697 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:52.370223 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e3f8b799-81cf-4ffb-8d9f-fe8390cb6697 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1832 microversion: 2.1 time: 0.712634 Oct 29 03:24:52.386361 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2721/5671] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:51 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1832 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:52.986421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f3d6b220-167c-44cd-838e-3b771cc663b8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:52.987046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f3d6b220-167c-44cd-838e-3b771cc663b8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: d1718402-c25a-437a-a916-4e828bde1d67] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:53.002400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3d6b220-167c-44cd-838e-3b771cc663b8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:53.004221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3d6b220-167c-44cd-838e-3b771cc663b8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:53.006116 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3d6b220-167c-44cd-838e-3b771cc663b8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:53.006950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3d6b220-167c-44cd-838e-3b771cc663b8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:53.008774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3d6b220-167c-44cd-838e-3b771cc663b8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:53.009249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3d6b220-167c-44cd-838e-3b771cc663b8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:53.065665 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-f3d6b220-167c-44cd-838e-3b771cc663b8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] HTTP exception thrown: Instance d1718402-c25a-437a-a916-4e828bde1d67 could not be found. Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f3d6b220-167c-44cd-838e-3b771cc663b8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Request method failure captured: Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67 HTTP/1.1 Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJzN_0W3F2Tvd5_DwYEYaE7yArMUzQkw0yVRFyD806tbuPfgIN9hrPP-pm4QkI5-axnSQL2lFY8Zz_29U2X0iME7rTgOu74wHL71o9B_5IukGwbcOdtvhyWYdmcAPvnUhuYS1WrbTu-q-KzFqGL1fD3An-d36JB4OLVV1PNh19tG-1E Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/af30f7beecad4c448ff0706230ecb8d9"}]}] Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersTestJSON-1972911719 Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersTestJSON-1972911719-project Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 50ec777bf8ea4a9eb7d9d6cf995ba4ef Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersTestJSON-1972911719-project Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance d1718402-c25a-437a-a916-4e828bde1d67 could not be found. Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'd1718402-c25a-437a-a916-4e828bde1d67'} Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1718402-c25a-437a-a916-4e828bde1d67 could not be found. Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1718402-c25a-437a-a916-4e828bde1d67 could not be found. Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:24:53.074246 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:24:53.079065 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:24:53.079065 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:24:53.079065 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:24:53.079065 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:24:53.079065 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:24:53.079065 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1718402-c25a-437a-a916-4e828bde1d67 could not be found. Oct 29 03:24:53.079065 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:24:53.079065 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f3d6b220-167c-44cd-838e-3b771cc663b8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Returning 404 to user: Instance d1718402-c25a-437a-a916-4e828bde1d67 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:24:53.079065 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f3d6b220-167c-44cd-838e-3b771cc663b8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67" status: 404 len: 111 microversion: 2.1 time: 0.094303 Oct 29 03:24:53.086085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bbaada87-ade6-4538-a00d-8e152c977ac7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '.version_select at 0x7ff052b8eaf0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:53.102039 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2951/5672] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:52 2022] GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:24:53.132406 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bbaada87-ade6-4538-a00d-8e152c977ac7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-key-1840098627" status: 202 len: 0 microversion: 2.1 time: 0.051418 Oct 29 03:24:53.143456 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2722/5673] 10.222.0.46 () {58 vars in 1209 bytes} [Sat Oct 29 03:24:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1840098627 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:24:53.300004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-22305b88-8acc-4bfa-a682-4b5ad4594dca tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-691035177", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "ca8e0bef-c1ec-47bd-9591-43a816db6a16"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:24:53.381986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-22305b88-8acc-4bfa-a682-4b5ad4594dca tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] validate_networks() for [('ca8e0bef-c1ec-47bd-9591-43a816db6a16', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:24:54.023539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bc3d1ca8-a00f-49cc-b823-b03da44e8618 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:54.026281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bc3d1ca8-a00f-49cc-b823-b03da44e8618 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:54.049744 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc3d1ca8-a00f-49cc-b823-b03da44e8618 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:54.051168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc3d1ca8-a00f-49cc-b823-b03da44e8618 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:54.053491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc3d1ca8-a00f-49cc-b823-b03da44e8618 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:54.055549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc3d1ca8-a00f-49cc-b823-b03da44e8618 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:54.056761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc3d1ca8-a00f-49cc-b823-b03da44e8618 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:54.058794 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc3d1ca8-a00f-49cc-b823-b03da44e8618 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:54.074005 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:54.135725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bc3d1ca8-a00f-49cc-b823-b03da44e8618 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:24:54.264684 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bc3d1ca8-a00f-49cc-b823-b03da44e8618 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 204 len: 0 microversion: 2.1 time: 0.250680 Oct 29 03:24:54.270771 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2723/5674] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:24:54 2022] DELETE /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:24:54.295201 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-384938c9-7df2-4a32-8aa2-73ceb0943adb req-96f85863-903b-40c4-b25c-a15589a9e9f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c079f7ae-3459-468a-a699-b54f5df31e41", "tag": "48355ce5-2082-4f79-98bc-fdccde7f4f8f"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:24:54.336733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-384938c9-7df2-4a32-8aa2-73ceb0943adb req-96f85863-903b-40c4-b25c-a15589a9e9f3 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:54.337719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-384938c9-7df2-4a32-8aa2-73ceb0943adb req-96f85863-903b-40c4-b25c-a15589a9e9f3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:54.338488 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-384938c9-7df2-4a32-8aa2-73ceb0943adb req-96f85863-903b-40c4-b25c-a15589a9e9f3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:54.360904 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-384938c9-7df2-4a32-8aa2-73ceb0943adb req-96f85863-903b-40c4-b25c-a15589a9e9f3 service nova] Creating event network-changed:48355ce5-2082-4f79-98bc-fdccde7f4f8f for instance c079f7ae-3459-468a-a699-b54f5df31e41 on n-h1-862967-2 Oct 29 03:24:54.370595 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-384938c9-7df2-4a32-8aa2-73ceb0943adb req-96f85863-903b-40c4-b25c-a15589a9e9f3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095471 Oct 29 03:24:54.372046 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2724/5675] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:24:54.379126 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f05d6213-a2ac-4649-b2fd-2d2598f8f9df tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:54.380161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f05d6213-a2ac-4649-b2fd-2d2598f8f9df tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:54.389447 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f05d6213-a2ac-4649-b2fd-2d2598f8f9df tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:54.391227 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f05d6213-a2ac-4649-b2fd-2d2598f8f9df tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:54.394588 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f05d6213-a2ac-4649-b2fd-2d2598f8f9df tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:54.396985 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f05d6213-a2ac-4649-b2fd-2d2598f8f9df tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:54.397726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f05d6213-a2ac-4649-b2fd-2d2598f8f9df tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:54.399436 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f05d6213-a2ac-4649-b2fd-2d2598f8f9df tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:54.610468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f05d6213-a2ac-4649-b2fd-2d2598f8f9df tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:54.618581 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f05d6213-a2ac-4649-b2fd-2d2598f8f9df tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1687 microversion: 2.1 time: 0.245009 Oct 29 03:24:54.640569 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2725/5676] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:54 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1687 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:54.816854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-22305b88-8acc-4bfa-a682-4b5ad4594dca tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:24:54.817843 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-22305b88-8acc-4bfa-a682-4b5ad4594dca tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:24:54.818472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-22305b88-8acc-4bfa-a682-4b5ad4594dca tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:24:54.819032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-22305b88-8acc-4bfa-a682-4b5ad4594dca tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:24:54.819607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-22305b88-8acc-4bfa-a682-4b5ad4594dca tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:24:54.829317 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22305b88-8acc-4bfa-a682-4b5ad4594dca tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:54.830033 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22305b88-8acc-4bfa-a682-4b5ad4594dca tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:54.830635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22305b88-8acc-4bfa-a682-4b5ad4594dca tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:54.831360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22305b88-8acc-4bfa-a682-4b5ad4594dca tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:54.831972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22305b88-8acc-4bfa-a682-4b5ad4594dca tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:54.832597 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22305b88-8acc-4bfa-a682-4b5ad4594dca tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:54.852066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-22305b88-8acc-4bfa-a682-4b5ad4594dca tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Getting quotas for project af30f7beecad4c448ff0706230ecb8d9. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:24:54.860192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-22305b88-8acc-4bfa-a682-4b5ad4594dca tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Getting quotas for user 50ec777bf8ea4a9eb7d9d6cf995ba4ef and project af30f7beecad4c448ff0706230ecb8d9. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:24:54.875280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-22305b88-8acc-4bfa-a682-4b5ad4594dca tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:24:54.878028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-22305b88-8acc-4bfa-a682-4b5ad4594dca tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: e12275ef-76da-4635-a932-4135fb47c20a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:24:54.937903 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-22305b88-8acc-4bfa-a682-4b5ad4594dca tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.642530 Oct 29 03:24:54.950814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4a35c9ea-7641-4b32-8e31-a5470ab3f9a6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:54.951925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4a35c9ea-7641-4b32-8e31-a5470ab3f9a6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: e12275ef-76da-4635-a932-4135fb47c20a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:54.965319 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2952/5677] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:24:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:24:55.086951 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4a35c9ea-7641-4b32-8e31-a5470ab3f9a6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:55.096177 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4a35c9ea-7641-4b32-8e31-a5470ab3f9a6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a" status: 200 len: 1208 microversion: 2.1 time: 0.149789 Oct 29 03:24:55.096817 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2726/5678] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:54 2022] GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a => generated 1208 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:55.646671 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4e193855-9851-44f4-86cd-05f741858ba3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:55.647301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4e193855-9851-44f4-86cd-05f741858ba3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:55.662856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e193855-9851-44f4-86cd-05f741858ba3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:55.663360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e193855-9851-44f4-86cd-05f741858ba3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:55.663806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e193855-9851-44f4-86cd-05f741858ba3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:55.675812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e193855-9851-44f4-86cd-05f741858ba3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:55.676744 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e193855-9851-44f4-86cd-05f741858ba3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:55.684320 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e193855-9851-44f4-86cd-05f741858ba3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:56.127782 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1b082d01-ee94-4e36-81f9-8587a87821d7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:56.128399 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1b082d01-ee94-4e36-81f9-8587a87821d7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: e12275ef-76da-4635-a932-4135fb47c20a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:56.154574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b082d01-ee94-4e36-81f9-8587a87821d7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:56.158241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b082d01-ee94-4e36-81f9-8587a87821d7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:56.162077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b082d01-ee94-4e36-81f9-8587a87821d7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:56.163438 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b082d01-ee94-4e36-81f9-8587a87821d7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:56.176800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b082d01-ee94-4e36-81f9-8587a87821d7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:56.178167 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b082d01-ee94-4e36-81f9-8587a87821d7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:56.318636 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1b082d01-ee94-4e36-81f9-8587a87821d7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:56.333762 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1b082d01-ee94-4e36-81f9-8587a87821d7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a" status: 200 len: 1204 microversion: 2.1 time: 0.213650 Oct 29 03:24:56.336676 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2727/5679] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:56 2022] GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a => generated 1204 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:56.498990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4e193855-9851-44f4-86cd-05f741858ba3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:56.521154 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4e193855-9851-44f4-86cd-05f741858ba3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1687 microversion: 2.1 time: 0.876757 Oct 29 03:24:56.521768 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2953/5680] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:55 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1687 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:57.359787 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b594017e-fc46-453b-8cb8-69c94ac58405 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:57.360658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b594017e-fc46-453b-8cb8-69c94ac58405 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: e12275ef-76da-4635-a932-4135fb47c20a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:57.391096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b594017e-fc46-453b-8cb8-69c94ac58405 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:57.391610 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b594017e-fc46-453b-8cb8-69c94ac58405 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:57.392047 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b594017e-fc46-453b-8cb8-69c94ac58405 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:57.392798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b594017e-fc46-453b-8cb8-69c94ac58405 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:57.393251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b594017e-fc46-453b-8cb8-69c94ac58405 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:57.393672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b594017e-fc46-453b-8cb8-69c94ac58405 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:57.553380 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4d31a108-f5e8-46be-9732-92808ee0bc4d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:57.554169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4d31a108-f5e8-46be-9732-92808ee0bc4d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:57.569045 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d31a108-f5e8-46be-9732-92808ee0bc4d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:57.570575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d31a108-f5e8-46be-9732-92808ee0bc4d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:57.573088 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d31a108-f5e8-46be-9732-92808ee0bc4d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:57.575293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d31a108-f5e8-46be-9732-92808ee0bc4d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:57.585168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d31a108-f5e8-46be-9732-92808ee0bc4d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:57.587623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d31a108-f5e8-46be-9732-92808ee0bc4d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:58.007806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b594017e-fc46-453b-8cb8-69c94ac58405 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:58.011013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4d31a108-f5e8-46be-9732-92808ee0bc4d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:58.018494 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:58.018871 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b594017e-fc46-453b-8cb8-69c94ac58405 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a" status: 200 len: 1266 microversion: 2.1 time: 0.664310 Oct 29 03:24:58.021901 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2728/5681] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:57 2022] GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a => generated 1266 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:58.036746 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4d31a108-f5e8-46be-9732-92808ee0bc4d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1687 microversion: 2.1 time: 0.483249 Oct 29 03:24:58.049131 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2954/5682] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:57 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1687 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:58.866271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-a4495f9a-5f18-47fa-a0f0-49aa76a2e0bd req-4086fd39-2aee-40b6-9b62-f299f1252de0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c079f7ae-3459-468a-a699-b54f5df31e41", "name": "network-vif-deleted", "tag": "48355ce5-2082-4f79-98bc-fdccde7f4f8f"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:24:58.892967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a4495f9a-5f18-47fa-a0f0-49aa76a2e0bd req-4086fd39-2aee-40b6-9b62-f299f1252de0 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:58.893719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a4495f9a-5f18-47fa-a0f0-49aa76a2e0bd req-4086fd39-2aee-40b6-9b62-f299f1252de0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:58.894338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-a4495f9a-5f18-47fa-a0f0-49aa76a2e0bd req-4086fd39-2aee-40b6-9b62-f299f1252de0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:58.917189 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-a4495f9a-5f18-47fa-a0f0-49aa76a2e0bd req-4086fd39-2aee-40b6-9b62-f299f1252de0 service nova] Creating event network-vif-deleted:48355ce5-2082-4f79-98bc-fdccde7f4f8f for instance c079f7ae-3459-468a-a699-b54f5df31e41 on n-h1-862967-2 Oct 29 03:24:58.929445 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-a4495f9a-5f18-47fa-a0f0-49aa76a2e0bd req-4086fd39-2aee-40b6-9b62-f299f1252de0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068481 Oct 29 03:24:58.932724 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2729/5683] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:24:59.052336 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1743114a-f3e2-446e-92c0-0765cbb8de9a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:59.054562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1743114a-f3e2-446e-92c0-0765cbb8de9a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: e12275ef-76da-4635-a932-4135fb47c20a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:59.065964 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7cc05f2d-9185-4e20-adf4-a904cd76bb23 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:24:59.066977 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7cc05f2d-9185-4e20-adf4-a904cd76bb23 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:24:59.093260 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cc05f2d-9185-4e20-adf4-a904cd76bb23 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:59.100558 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cc05f2d-9185-4e20-adf4-a904cd76bb23 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:59.102421 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cc05f2d-9185-4e20-adf4-a904cd76bb23 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:59.104557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cc05f2d-9185-4e20-adf4-a904cd76bb23 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:59.105049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1743114a-f3e2-446e-92c0-0765cbb8de9a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:59.108308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cc05f2d-9185-4e20-adf4-a904cd76bb23 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:59.108749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1743114a-f3e2-446e-92c0-0765cbb8de9a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:59.109429 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1743114a-f3e2-446e-92c0-0765cbb8de9a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:59.111299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1743114a-f3e2-446e-92c0-0765cbb8de9a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:59.112077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cc05f2d-9185-4e20-adf4-a904cd76bb23 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:59.114404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1743114a-f3e2-446e-92c0-0765cbb8de9a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:59.115938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1743114a-f3e2-446e-92c0-0765cbb8de9a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:59.274566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cc05f2d-9185-4e20-adf4-a904cd76bb23 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:24:59.276939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cc05f2d-9185-4e20-adf4-a904cd76bb23 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:24:59.282079 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cc05f2d-9185-4e20-adf4-a904cd76bb23 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:24:59.284804 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-7cc05f2d-9185-4e20-adf4-a904cd76bb23 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lazy-loading 'fault' on Instance uuid c079f7ae-3459-468a-a699-b54f5df31e41 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:24:59.535615 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7cc05f2d-9185-4e20-adf4-a904cd76bb23 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:59.554360 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7cc05f2d-9185-4e20-adf4-a904cd76bb23 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 200 len: 1355 microversion: 2.1 time: 0.494428 Oct 29 03:24:59.556903 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2730/5684] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:59 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 1355 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:24:59.678585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1743114a-f3e2-446e-92c0-0765cbb8de9a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:24:59.695394 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1743114a-f3e2-446e-92c0-0765cbb8de9a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a" status: 200 len: 1308 microversion: 2.1 time: 0.647390 Oct 29 03:24:59.698930 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2955/5685] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:24:59 2022] GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a => generated 1308 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:00.582524 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5d5b9b8d-4460-4e68-b11f-9b624d6bf45b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:00.583215 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5d5b9b8d-4460-4e68-b11f-9b624d6bf45b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: c079f7ae-3459-468a-a699-b54f5df31e41] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:00.602687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d5b9b8d-4460-4e68-b11f-9b624d6bf45b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:00.603780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d5b9b8d-4460-4e68-b11f-9b624d6bf45b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:00.605545 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d5b9b8d-4460-4e68-b11f-9b624d6bf45b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:00.608230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d5b9b8d-4460-4e68-b11f-9b624d6bf45b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:00.611871 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d5b9b8d-4460-4e68-b11f-9b624d6bf45b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:00.612481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d5b9b8d-4460-4e68-b11f-9b624d6bf45b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:00.719662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f9a6bee9-a8c0-49fd-b3f6-7b2eafa5713c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:00.720277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f9a6bee9-a8c0-49fd-b3f6-7b2eafa5713c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: e12275ef-76da-4635-a932-4135fb47c20a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:00.742225 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9a6bee9-a8c0-49fd-b3f6-7b2eafa5713c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:00.746669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9a6bee9-a8c0-49fd-b3f6-7b2eafa5713c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:00.747305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9a6bee9-a8c0-49fd-b3f6-7b2eafa5713c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:00.755880 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9a6bee9-a8c0-49fd-b3f6-7b2eafa5713c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:00.759203 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9a6bee9-a8c0-49fd-b3f6-7b2eafa5713c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:00.759837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f9a6bee9-a8c0-49fd-b3f6-7b2eafa5713c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:01.327847 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-5d5b9b8d-4460-4e68-b11f-9b624d6bf45b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] HTTP exception thrown: Instance c079f7ae-3459-468a-a699-b54f5df31e41 could not be found. Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5d5b9b8d-4460-4e68-b11f-9b624d6bf45b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Request method failure captured: Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 HTTP/1.1 Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJvFDgv39YEHxHfIGPphS_gbBVnKLoR2NMVFu2W7_hYkDRDJ01RHk3ODd2efOl__KQE-71QHOfy9i5K9cE39s3-f5uUaGST3mGa6UP6ZiaoXfrXgr9ANswBW4fhoyYxt5VjIwP2IaqtzixgmpqXZparOwp6ERMwaDHZ09cH_NGeZj5o Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: c898299eb0444aa1a1983fb127153c65 Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1800856932 Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c898299eb0444aa1a1983fb127153c65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c898299eb0444aa1a1983fb127153c65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c898299eb0444aa1a1983fb127153c65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c898299eb0444aa1a1983fb127153c65"}]}] Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1800856932 Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: c898299eb0444aa1a1983fb127153c65 Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1800856932 Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestNetworkAdvancedServerOps-1800856932-project Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 789295d938084ee3b7d618690fee5bfa Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1800856932-project Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance c079f7ae-3459-468a-a699-b54f5df31e41 could not be found. Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'c079f7ae-3459-468a-a699-b54f5df31e41'} Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c079f7ae-3459-468a-a699-b54f5df31e41 could not be found. Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c079f7ae-3459-468a-a699-b54f5df31e41 could not be found. Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:25:01.336140 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:25:01.340198 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:25:01.340198 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:25:01.340198 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:25:01.340198 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:25:01.340198 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:25:01.340198 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:25:01.340198 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c079f7ae-3459-468a-a699-b54f5df31e41 could not be found. Oct 29 03:25:01.340198 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:25:01.346285 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5d5b9b8d-4460-4e68-b11f-9b624d6bf45b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Returning 404 to user: Instance c079f7ae-3459-468a-a699-b54f5df31e41 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:25:01.352035 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5d5b9b8d-4460-4e68-b11f-9b624d6bf45b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41" status: 404 len: 111 microversion: 2.1 time: 0.773771 Oct 29 03:25:01.360408 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2731/5686] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:00 2022] GET /compute/v2.1/servers/c079f7ae-3459-468a-a699-b54f5df31e41 => generated 111 bytes in 783 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:25:01.459284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-1083fde2-18dd-4bc6-b1d6-56e5c455d745 req-4c4fc142-5a8f-4967-a16a-362ec429f639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e12275ef-76da-4635-a932-4135fb47c20a", "tag": "e524f18b-fd27-46c8-ae11-5a0de07855e3"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:25:01.492780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-1083fde2-18dd-4bc6-b1d6-56e5c455d745 req-4c4fc142-5a8f-4967-a16a-362ec429f639 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:01.501278 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-1083fde2-18dd-4bc6-b1d6-56e5c455d745 req-4c4fc142-5a8f-4967-a16a-362ec429f639 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:01.501914 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-1083fde2-18dd-4bc6-b1d6-56e5c455d745 req-4c4fc142-5a8f-4967-a16a-362ec429f639 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:01.536867 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-1083fde2-18dd-4bc6-b1d6-56e5c455d745 req-4c4fc142-5a8f-4967-a16a-362ec429f639 service nova] Creating event network-changed:e524f18b-fd27-46c8-ae11-5a0de07855e3 for instance e12275ef-76da-4635-a932-4135fb47c20a on n-h2-862967-2 Oct 29 03:25:01.545471 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-1083fde2-18dd-4bc6-b1d6-56e5c455d745 req-4c4fc142-5a8f-4967-a16a-362ec429f639 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097104 Oct 29 03:25:01.547246 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2732/5687] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 29 03:25:01.655555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f9a6bee9-a8c0-49fd-b3f6-7b2eafa5713c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:01.663605 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f9a6bee9-a8c0-49fd-b3f6-7b2eafa5713c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a" status: 200 len: 1308 microversion: 2.1 time: 0.947830 Oct 29 03:25:01.667915 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2956/5688] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:00 2022] GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a => generated 1308 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:02.702186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-917bf6d0-18e9-411a-be2c-5df77c0e21b6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:02.703462 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-917bf6d0-18e9-411a-be2c-5df77c0e21b6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: e12275ef-76da-4635-a932-4135fb47c20a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:02.711478 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-917bf6d0-18e9-411a-be2c-5df77c0e21b6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:02.712173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-917bf6d0-18e9-411a-be2c-5df77c0e21b6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:02.712806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-917bf6d0-18e9-411a-be2c-5df77c0e21b6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:02.715285 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-917bf6d0-18e9-411a-be2c-5df77c0e21b6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:02.715916 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-917bf6d0-18e9-411a-be2c-5df77c0e21b6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:02.716630 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-917bf6d0-18e9-411a-be2c-5df77c0e21b6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:03.019617 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-917bf6d0-18e9-411a-be2c-5df77c0e21b6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:03.032077 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-917bf6d0-18e9-411a-be2c-5df77c0e21b6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a" status: 200 len: 1308 microversion: 2.1 time: 0.334481 Oct 29 03:25:03.033924 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2733/5689] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:02 2022] GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a => generated 1308 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:25:04.055573 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ffc00ebc-0d7d-4cf9-ae49-a6be61d85aad tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:04.056369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ffc00ebc-0d7d-4cf9-ae49-a6be61d85aad tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: e12275ef-76da-4635-a932-4135fb47c20a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:04.072250 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffc00ebc-0d7d-4cf9-ae49-a6be61d85aad tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:04.072828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffc00ebc-0d7d-4cf9-ae49-a6be61d85aad tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:04.073270 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffc00ebc-0d7d-4cf9-ae49-a6be61d85aad tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:04.074010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffc00ebc-0d7d-4cf9-ae49-a6be61d85aad tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:04.074469 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffc00ebc-0d7d-4cf9-ae49-a6be61d85aad tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:04.079948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffc00ebc-0d7d-4cf9-ae49-a6be61d85aad tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:04.665524 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ffc00ebc-0d7d-4cf9-ae49-a6be61d85aad tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:04.673834 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ffc00ebc-0d7d-4cf9-ae49-a6be61d85aad tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a" status: 200 len: 1308 microversion: 2.1 time: 0.622238 Oct 29 03:25:04.682598 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2957/5690] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:04 2022] GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a => generated 1308 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:05.720085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0a631a5c-e9d4-4ab4-b822-fd9dcb1f114e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:05.723092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0a631a5c-e9d4-4ab4-b822-fd9dcb1f114e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: e12275ef-76da-4635-a932-4135fb47c20a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:05.762119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:25:05.777095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a631a5c-e9d4-4ab4-b822-fd9dcb1f114e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:05.778884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a631a5c-e9d4-4ab4-b822-fd9dcb1f114e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:05.781296 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a631a5c-e9d4-4ab4-b822-fd9dcb1f114e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:05.782413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a631a5c-e9d4-4ab4-b822-fd9dcb1f114e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:05.785708 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a631a5c-e9d4-4ab4-b822-fd9dcb1f114e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:05.788157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a631a5c-e9d4-4ab4-b822-fd9dcb1f114e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:06.108582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0a631a5c-e9d4-4ab4-b822-fd9dcb1f114e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:06.118319 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0a631a5c-e9d4-4ab4-b822-fd9dcb1f114e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a" status: 200 len: 1308 microversion: 2.1 time: 0.412827 Oct 29 03:25:06.122276 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2734/5691] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:05 2022] GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a => generated 1308 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:07.146119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:25:07.146889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:25:07.152129 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4cdf484c-daf8-42c7-8f51-df1f21afdf88 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:07.152788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4cdf484c-daf8-42c7-8f51-df1f21afdf88 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: e12275ef-76da-4635-a932-4135fb47c20a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:07.167834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4cdf484c-daf8-42c7-8f51-df1f21afdf88 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:07.168334 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4cdf484c-daf8-42c7-8f51-df1f21afdf88 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:07.168802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4cdf484c-daf8-42c7-8f51-df1f21afdf88 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:07.174835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4cdf484c-daf8-42c7-8f51-df1f21afdf88 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:07.175335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4cdf484c-daf8-42c7-8f51-df1f21afdf88 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:07.175769 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4cdf484c-daf8-42c7-8f51-df1f21afdf88 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:07.609926 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4cdf484c-daf8-42c7-8f51-df1f21afdf88 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:07.619579 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4cdf484c-daf8-42c7-8f51-df1f21afdf88 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a" status: 200 len: 1308 microversion: 2.1 time: 0.474694 Oct 29 03:25:07.620757 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2958/5692] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:07 2022] GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a => generated 1308 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:07.812319 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-6bbc04a4-59c8-485e-8138-6e2dbe567008 req-f7b0e1ae-113a-443a-953f-be4d00c5fb91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e12275ef-76da-4635-a932-4135fb47c20a", "name": "network-vif-plugged", "status": "completed", "tag": "e524f18b-fd27-46c8-ae11-5a0de07855e3"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:25:07.829962 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:25:07.844347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6bbc04a4-59c8-485e-8138-6e2dbe567008 req-f7b0e1ae-113a-443a-953f-be4d00c5fb91 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:07.848741 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6bbc04a4-59c8-485e-8138-6e2dbe567008 req-f7b0e1ae-113a-443a-953f-be4d00c5fb91 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:07.849204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6bbc04a4-59c8-485e-8138-6e2dbe567008 req-f7b0e1ae-113a-443a-953f-be4d00c5fb91 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:07.869204 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-6bbc04a4-59c8-485e-8138-6e2dbe567008 req-f7b0e1ae-113a-443a-953f-be4d00c5fb91 service nova] Creating event network-vif-plugged:e524f18b-fd27-46c8-ae11-5a0de07855e3 for instance e12275ef-76da-4635-a932-4135fb47c20a on n-h2-862967-2 Oct 29 03:25:07.876004 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-6bbc04a4-59c8-485e-8138-6e2dbe567008 req-f7b0e1ae-113a-443a-953f-be4d00c5fb91 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068199 Oct 29 03:25:07.877344 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2735/5693] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:25:08.644897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-06addf8a-43d2-429e-abd0-3b973f1dd13a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:08.646380 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-06addf8a-43d2-429e-abd0-3b973f1dd13a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: e12275ef-76da-4635-a932-4135fb47c20a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:08.655319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06addf8a-43d2-429e-abd0-3b973f1dd13a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:08.658383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06addf8a-43d2-429e-abd0-3b973f1dd13a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:08.659231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06addf8a-43d2-429e-abd0-3b973f1dd13a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:08.663954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06addf8a-43d2-429e-abd0-3b973f1dd13a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:08.664847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06addf8a-43d2-429e-abd0-3b973f1dd13a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:08.666537 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06addf8a-43d2-429e-abd0-3b973f1dd13a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:08.899297 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8a23bcf7-e063-438b-acbf-6a27167a99d2 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '.version_select at 0x7ff052afc9d0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:08.903075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-06addf8a-43d2-429e-abd0-3b973f1dd13a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:08.949385 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-06addf8a-43d2-429e-abd0-3b973f1dd13a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a" status: 200 len: 1308 microversion: 2.1 time: 0.302977 Oct 29 03:25:08.949385 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2959/5694] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:08 2022] GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a => generated 1308 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:08.967110 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8a23bcf7-e063-438b-acbf-6a27167a99d2 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-451399934" status: 202 len: 0 microversion: 2.1 time: 0.072949 Oct 29 03:25:08.972830 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2736/5695] 10.222.0.46 () {58 vars in 1281 bytes} [Sat Oct 29 03:25:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-451399934 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:25:09.009040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c6f10ac0-3692-4b65-b44e-c3dfae98fb44 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Action: 'create', calling method: .version_select at 0x7ff053a7a040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1868872300", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXUkodCTQmKqFUxaMWIT0ybl0Fmu47q5TuJcddocZSxAh947CpeTbnVyKR4c0zIdPacBRsIQhpnaND4SBR7o2IrBdalw3Eh5AtsCD3WXBI+MouLjDVge51Z9tUrgeYUUA=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:25:09.040737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-c6f10ac0-3692-4b65-b44e-c3dfae98fb44 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Getting quotas for project c898299eb0444aa1a1983fb127153c65. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:25:09.048311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-c6f10ac0-3692-4b65-b44e-c3dfae98fb44 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Getting quotas for user 789295d938084ee3b7d618690fee5bfa and project c898299eb0444aa1a1983fb127153c65. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:25:09.146392 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c6f10ac0-3692-4b65-b44e-c3dfae98fb44 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.142002 Oct 29 03:25:09.148932 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2960/5696] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:25:09 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:25:09.973065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b8bf3518-5f20-4f73-9414-6069067a6fb1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:09.974408 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b8bf3518-5f20-4f73-9414-6069067a6fb1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: e12275ef-76da-4635-a932-4135fb47c20a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:09.980912 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8bf3518-5f20-4f73-9414-6069067a6fb1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:09.981396 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8bf3518-5f20-4f73-9414-6069067a6fb1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:09.982004 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8bf3518-5f20-4f73-9414-6069067a6fb1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:09.983060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8bf3518-5f20-4f73-9414-6069067a6fb1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:09.983923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8bf3518-5f20-4f73-9414-6069067a6fb1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:09.984499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8bf3518-5f20-4f73-9414-6069067a6fb1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:10.194567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b8bf3518-5f20-4f73-9414-6069067a6fb1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:10.203096 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b8bf3518-5f20-4f73-9414-6069067a6fb1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a" status: 200 len: 1488 microversion: 2.1 time: 0.235550 Oct 29 03:25:10.204170 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2737/5697] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:09 2022] GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a => generated 1488 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:10.399864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-467ce7f0-db8d-48b2-be8a-decad69b5c6f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-691035177", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "ca8e0bef-c1ec-47bd-9591-43a816db6a16"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:25:10.470237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-467ce7f0-db8d-48b2-be8a-decad69b5c6f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] validate_networks() for [('ca8e0bef-c1ec-47bd-9591-43a816db6a16', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:25:10.966067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-467ce7f0-db8d-48b2-be8a-decad69b5c6f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:25:10.967291 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-467ce7f0-db8d-48b2-be8a-decad69b5c6f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:25:10.968760 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-467ce7f0-db8d-48b2-be8a-decad69b5c6f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:25:10.970241 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-467ce7f0-db8d-48b2-be8a-decad69b5c6f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:25:11.001391 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-467ce7f0-db8d-48b2-be8a-decad69b5c6f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:25:11.027581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-467ce7f0-db8d-48b2-be8a-decad69b5c6f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:11.028348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-467ce7f0-db8d-48b2-be8a-decad69b5c6f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:11.029080 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-467ce7f0-db8d-48b2-be8a-decad69b5c6f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:11.030489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-467ce7f0-db8d-48b2-be8a-decad69b5c6f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:11.031701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-467ce7f0-db8d-48b2-be8a-decad69b5c6f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:11.033343 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-467ce7f0-db8d-48b2-be8a-decad69b5c6f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:11.082575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-467ce7f0-db8d-48b2-be8a-decad69b5c6f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Getting quotas for project af30f7beecad4c448ff0706230ecb8d9. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:25:11.089380 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-467ce7f0-db8d-48b2-be8a-decad69b5c6f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Getting quotas for user 50ec777bf8ea4a9eb7d9d6cf995ba4ef and project af30f7beecad4c448ff0706230ecb8d9. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:25:11.103447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-467ce7f0-db8d-48b2-be8a-decad69b5c6f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:25:11.106189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-467ce7f0-db8d-48b2-be8a-decad69b5c6f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 73c8d6a3-376b-4cca-83cf-f4ee73114d9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:25:11.138659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:25:11.163867 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-467ce7f0-db8d-48b2-be8a-decad69b5c6f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.772438 Oct 29 03:25:11.165095 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2961/5698] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:25:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:25:11.176937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-65f5c2f2-fff7-4a2d-ad89-180dec77ff4d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:11.178108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-65f5c2f2-fff7-4a2d-ad89-180dec77ff4d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 73c8d6a3-376b-4cca-83cf-f4ee73114d9d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:11.283520 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-65f5c2f2-fff7-4a2d-ad89-180dec77ff4d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:11.295059 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-65f5c2f2-fff7-4a2d-ad89-180dec77ff4d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d" status: 200 len: 1208 microversion: 2.1 time: 0.122945 Oct 29 03:25:11.297174 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2738/5699] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:11 2022] GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d => generated 1208 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:25:12.321044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4c05aee6-38cf-4a86-98c1-7a98a1cc58d2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:12.322455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4c05aee6-38cf-4a86-98c1-7a98a1cc58d2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 73c8d6a3-376b-4cca-83cf-f4ee73114d9d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:12.329821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c05aee6-38cf-4a86-98c1-7a98a1cc58d2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:12.330575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c05aee6-38cf-4a86-98c1-7a98a1cc58d2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:12.331191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c05aee6-38cf-4a86-98c1-7a98a1cc58d2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:12.332175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c05aee6-38cf-4a86-98c1-7a98a1cc58d2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:12.332823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c05aee6-38cf-4a86-98c1-7a98a1cc58d2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:12.333402 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c05aee6-38cf-4a86-98c1-7a98a1cc58d2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:12.482658 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4c05aee6-38cf-4a86-98c1-7a98a1cc58d2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:12.491223 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4c05aee6-38cf-4a86-98c1-7a98a1cc58d2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d" status: 200 len: 1260 microversion: 2.1 time: 0.176576 Oct 29 03:25:12.493577 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2962/5700] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:12 2022] GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:13.515645 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-92ee88f9-05c6-41f9-a2db-6f8d8a9ac856 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:13.516980 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-92ee88f9-05c6-41f9-a2db-6f8d8a9ac856 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 73c8d6a3-376b-4cca-83cf-f4ee73114d9d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:13.533886 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92ee88f9-05c6-41f9-a2db-6f8d8a9ac856 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:13.534973 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92ee88f9-05c6-41f9-a2db-6f8d8a9ac856 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:13.535587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92ee88f9-05c6-41f9-a2db-6f8d8a9ac856 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:13.536972 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92ee88f9-05c6-41f9-a2db-6f8d8a9ac856 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:13.537667 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92ee88f9-05c6-41f9-a2db-6f8d8a9ac856 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:13.538982 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-92ee88f9-05c6-41f9-a2db-6f8d8a9ac856 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:13.671065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-92ee88f9-05c6-41f9-a2db-6f8d8a9ac856 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:13.685215 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-92ee88f9-05c6-41f9-a2db-6f8d8a9ac856 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d" status: 200 len: 1266 microversion: 2.1 time: 0.172955 Oct 29 03:25:13.688791 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2739/5701] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:13 2022] GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:14.712245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0a997c0b-a550-4e78-8424-523c268ec6ce tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:14.713116 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0a997c0b-a550-4e78-8424-523c268ec6ce tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 73c8d6a3-376b-4cca-83cf-f4ee73114d9d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:14.725397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0a997c0b-a550-4e78-8424-523c268ec6ce tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:14.726225 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0a997c0b-a550-4e78-8424-523c268ec6ce tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:14.727284 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0a997c0b-a550-4e78-8424-523c268ec6ce tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:14.728334 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0a997c0b-a550-4e78-8424-523c268ec6ce tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:14.729226 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0a997c0b-a550-4e78-8424-523c268ec6ce tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:14.729767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0a997c0b-a550-4e78-8424-523c268ec6ce tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:14.938209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0a997c0b-a550-4e78-8424-523c268ec6ce tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:14.947722 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0a997c0b-a550-4e78-8424-523c268ec6ce tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d" status: 200 len: 1308 microversion: 2.1 time: 0.240164 Oct 29 03:25:14.948384 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2963/5702] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:14 2022] GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d => generated 1308 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:15.971444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d0d9b207-7fa2-4c94-b44b-3bb28a6636df tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:15.973105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d0d9b207-7fa2-4c94-b44b-3bb28a6636df tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 73c8d6a3-376b-4cca-83cf-f4ee73114d9d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:15.993136 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0d9b207-7fa2-4c94-b44b-3bb28a6636df tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:15.994002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0d9b207-7fa2-4c94-b44b-3bb28a6636df tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:15.994660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0d9b207-7fa2-4c94-b44b-3bb28a6636df tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:15.996084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0d9b207-7fa2-4c94-b44b-3bb28a6636df tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:15.996772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0d9b207-7fa2-4c94-b44b-3bb28a6636df tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:15.997420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0d9b207-7fa2-4c94-b44b-3bb28a6636df tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:16.213193 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-fe6416cd-43cc-4421-b6e0-ca1b38c890ce req-5d9c1609-b68f-42bc-9aa4-61915ad4c2ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73c8d6a3-376b-4cca-83cf-f4ee73114d9d", "tag": "390b7fc4-21b2-4ed8-9390-7aa7a36241e8"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:25:16.247384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-fe6416cd-43cc-4421-b6e0-ca1b38c890ce req-5d9c1609-b68f-42bc-9aa4-61915ad4c2ac service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:16.248077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-fe6416cd-43cc-4421-b6e0-ca1b38c890ce req-5d9c1609-b68f-42bc-9aa4-61915ad4c2ac service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:16.248629 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-fe6416cd-43cc-4421-b6e0-ca1b38c890ce req-5d9c1609-b68f-42bc-9aa4-61915ad4c2ac service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:16.264967 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-fe6416cd-43cc-4421-b6e0-ca1b38c890ce req-5d9c1609-b68f-42bc-9aa4-61915ad4c2ac service nova] Creating event network-changed:390b7fc4-21b2-4ed8-9390-7aa7a36241e8 for instance 73c8d6a3-376b-4cca-83cf-f4ee73114d9d on n-h1-862967-2 Oct 29 03:25:16.278514 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-fe6416cd-43cc-4421-b6e0-ca1b38c890ce req-5d9c1609-b68f-42bc-9aa4-61915ad4c2ac service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078893 Oct 29 03:25:16.281532 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2964/5703] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:25:16.467105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d0d9b207-7fa2-4c94-b44b-3bb28a6636df tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:16.478913 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d0d9b207-7fa2-4c94-b44b-3bb28a6636df tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d" status: 200 len: 1308 microversion: 2.1 time: 0.511388 Oct 29 03:25:16.491952 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2740/5704] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:15 2022] GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d => generated 1308 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:17.505485 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-337595fd-fcb7-4338-9171-feeb32d97f37 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:17.506142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-337595fd-fcb7-4338-9171-feeb32d97f37 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 73c8d6a3-376b-4cca-83cf-f4ee73114d9d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:17.536168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-337595fd-fcb7-4338-9171-feeb32d97f37 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:17.536707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-337595fd-fcb7-4338-9171-feeb32d97f37 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:17.543356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-337595fd-fcb7-4338-9171-feeb32d97f37 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:17.553910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-337595fd-fcb7-4338-9171-feeb32d97f37 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:17.554447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-337595fd-fcb7-4338-9171-feeb32d97f37 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:17.554897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-337595fd-fcb7-4338-9171-feeb32d97f37 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:17.952464 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-337595fd-fcb7-4338-9171-feeb32d97f37 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:17.967082 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-337595fd-fcb7-4338-9171-feeb32d97f37 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d" status: 200 len: 1308 microversion: 2.1 time: 0.469026 Oct 29 03:25:17.968050 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2965/5705] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:17 2022] GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d => generated 1308 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:18.992966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f435d582-7c4c-4cb5-85be-cc1a68c8f42e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:18.994189 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f435d582-7c4c-4cb5-85be-cc1a68c8f42e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 73c8d6a3-376b-4cca-83cf-f4ee73114d9d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:19.008934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f435d582-7c4c-4cb5-85be-cc1a68c8f42e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:19.011602 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f435d582-7c4c-4cb5-85be-cc1a68c8f42e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:19.015745 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f435d582-7c4c-4cb5-85be-cc1a68c8f42e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:19.019033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f435d582-7c4c-4cb5-85be-cc1a68c8f42e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:19.020561 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f435d582-7c4c-4cb5-85be-cc1a68c8f42e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:19.027893 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f435d582-7c4c-4cb5-85be-cc1a68c8f42e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:19.118862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-705d1e5f-58d0-4441-9779-5155ea4eab0b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-69744060", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "5f389c1e-8c26-428e-a3e2-9092a1cf8099"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1868872300", "security_groups": [{"name": "tempest-secgroup-smoke-1924449985"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:25:19.349140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-705d1e5f-58d0-4441-9779-5155ea4eab0b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] validate_networks() for [('5f389c1e-8c26-428e-a3e2-9092a1cf8099', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:25:19.592613 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f435d582-7c4c-4cb5-85be-cc1a68c8f42e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:19.618160 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f435d582-7c4c-4cb5-85be-cc1a68c8f42e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d" status: 200 len: 1308 microversion: 2.1 time: 0.629383 Oct 29 03:25:19.632704 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2741/5706] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:18 2022] GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d => generated 1308 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:19.885355 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-705d1e5f-58d0-4441-9779-5155ea4eab0b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:25:19.885956 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-705d1e5f-58d0-4441-9779-5155ea4eab0b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:25:19.886448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-705d1e5f-58d0-4441-9779-5155ea4eab0b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:25:19.887127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-705d1e5f-58d0-4441-9779-5155ea4eab0b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:25:19.887559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-705d1e5f-58d0-4441-9779-5155ea4eab0b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:25:19.903081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-705d1e5f-58d0-4441-9779-5155ea4eab0b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:19.903571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-705d1e5f-58d0-4441-9779-5155ea4eab0b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:19.906748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-705d1e5f-58d0-4441-9779-5155ea4eab0b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:19.907956 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-705d1e5f-58d0-4441-9779-5155ea4eab0b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:19.908424 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-705d1e5f-58d0-4441-9779-5155ea4eab0b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:19.909171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-705d1e5f-58d0-4441-9779-5155ea4eab0b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:19.952990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-705d1e5f-58d0-4441-9779-5155ea4eab0b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Getting quotas for project c898299eb0444aa1a1983fb127153c65. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:25:19.960560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-705d1e5f-58d0-4441-9779-5155ea4eab0b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Getting quotas for user 789295d938084ee3b7d618690fee5bfa and project c898299eb0444aa1a1983fb127153c65. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:25:19.977170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-705d1e5f-58d0-4441-9779-5155ea4eab0b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:25:19.980220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-705d1e5f-58d0-4441-9779-5155ea4eab0b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:25:20.044503 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-705d1e5f-58d0-4441-9779-5155ea4eab0b tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.929439 Oct 29 03:25:20.045978 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2966/5707] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:25:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:25:20.057035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8d27e7f3-a192-4eeb-816a-5761f97677a1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:20.058288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8d27e7f3-a192-4eeb-816a-5761f97677a1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:20.155318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8d27e7f3-a192-4eeb-816a-5761f97677a1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:20.165031 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8d27e7f3-a192-4eeb-816a-5761f97677a1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d" status: 200 len: 1265 microversion: 2.1 time: 0.111681 Oct 29 03:25:20.165957 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2742/5708] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:20 2022] GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d => generated 1265 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:20.642001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2f458c27-a0a5-450e-aad0-3141891a2b0b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:20.642752 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2f458c27-a0a5-450e-aad0-3141891a2b0b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 73c8d6a3-376b-4cca-83cf-f4ee73114d9d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:20.655734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f458c27-a0a5-450e-aad0-3141891a2b0b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:20.663567 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f458c27-a0a5-450e-aad0-3141891a2b0b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:20.664452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f458c27-a0a5-450e-aad0-3141891a2b0b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:20.665662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f458c27-a0a5-450e-aad0-3141891a2b0b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:20.666564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f458c27-a0a5-450e-aad0-3141891a2b0b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:20.667152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f458c27-a0a5-450e-aad0-3141891a2b0b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:20.891910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2f458c27-a0a5-450e-aad0-3141891a2b0b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:20.902993 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2f458c27-a0a5-450e-aad0-3141891a2b0b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d" status: 200 len: 1308 microversion: 2.1 time: 0.265778 Oct 29 03:25:20.904692 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2967/5709] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:20 2022] GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d => generated 1308 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:21.198020 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c2a33946-11e5-412c-a824-974bd822850c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:21.202146 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c2a33946-11e5-412c-a824-974bd822850c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:21.221978 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2a33946-11e5-412c-a824-974bd822850c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:21.225689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2a33946-11e5-412c-a824-974bd822850c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:21.230808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2a33946-11e5-412c-a824-974bd822850c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:21.232880 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2a33946-11e5-412c-a824-974bd822850c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:21.235685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2a33946-11e5-412c-a824-974bd822850c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:21.236445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2a33946-11e5-412c-a824-974bd822850c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:21.333485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c2a33946-11e5-412c-a824-974bd822850c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:21.350170 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c2a33946-11e5-412c-a824-974bd822850c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d" status: 200 len: 1317 microversion: 2.1 time: 0.166626 Oct 29 03:25:21.352834 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2743/5710] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:21 2022] GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:21.928354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ea36660e-0675-4985-a296-e33afe8ccf02 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:21.928988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ea36660e-0675-4985-a296-e33afe8ccf02 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 73c8d6a3-376b-4cca-83cf-f4ee73114d9d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:21.938489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea36660e-0675-4985-a296-e33afe8ccf02 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:21.939462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea36660e-0675-4985-a296-e33afe8ccf02 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:21.940218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea36660e-0675-4985-a296-e33afe8ccf02 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:21.941169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea36660e-0675-4985-a296-e33afe8ccf02 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:21.941769 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea36660e-0675-4985-a296-e33afe8ccf02 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:21.944890 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea36660e-0675-4985-a296-e33afe8ccf02 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:22.199525 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ea36660e-0675-4985-a296-e33afe8ccf02 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:22.222856 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ea36660e-0675-4985-a296-e33afe8ccf02 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d" status: 200 len: 1308 microversion: 2.1 time: 0.298740 Oct 29 03:25:22.233144 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2968/5711] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:21 2022] GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d => generated 1308 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:22.375147 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-67f242b0-bea9-48d6-90f5-fd68ecbe7694 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:22.376377 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-67f242b0-bea9-48d6-90f5-fd68ecbe7694 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:22.396849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67f242b0-bea9-48d6-90f5-fd68ecbe7694 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:22.404291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67f242b0-bea9-48d6-90f5-fd68ecbe7694 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:22.405061 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67f242b0-bea9-48d6-90f5-fd68ecbe7694 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:22.406111 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67f242b0-bea9-48d6-90f5-fd68ecbe7694 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:22.406789 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67f242b0-bea9-48d6-90f5-fd68ecbe7694 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:22.407439 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-67f242b0-bea9-48d6-90f5-fd68ecbe7694 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:22.533700 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-67f242b0-bea9-48d6-90f5-fd68ecbe7694 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:22.542821 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-67f242b0-bea9-48d6-90f5-fd68ecbe7694 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d" status: 200 len: 1323 microversion: 2.1 time: 0.172440 Oct 29 03:25:22.553199 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2744/5712] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:22 2022] GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d => generated 1323 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:22.686029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-ebbf381a-70d3-47dc-980c-744eea15107b req-715a5eed-eb4a-4009-b3ac-0d398b6a8430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73c8d6a3-376b-4cca-83cf-f4ee73114d9d", "name": "network-vif-plugged", "status": "completed", "tag": "390b7fc4-21b2-4ed8-9390-7aa7a36241e8"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:25:22.705510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ebbf381a-70d3-47dc-980c-744eea15107b req-715a5eed-eb4a-4009-b3ac-0d398b6a8430 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:22.706194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ebbf381a-70d3-47dc-980c-744eea15107b req-715a5eed-eb4a-4009-b3ac-0d398b6a8430 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:22.706812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ebbf381a-70d3-47dc-980c-744eea15107b req-715a5eed-eb4a-4009-b3ac-0d398b6a8430 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:22.735261 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-ebbf381a-70d3-47dc-980c-744eea15107b req-715a5eed-eb4a-4009-b3ac-0d398b6a8430 service nova] Creating event network-vif-plugged:390b7fc4-21b2-4ed8-9390-7aa7a36241e8 for instance 73c8d6a3-376b-4cca-83cf-f4ee73114d9d on n-h1-862967-2 Oct 29 03:25:22.742417 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-ebbf381a-70d3-47dc-980c-744eea15107b req-715a5eed-eb4a-4009-b3ac-0d398b6a8430 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060246 Oct 29 03:25:22.746187 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2969/5713] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:25:23.247229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dfe0981b-ae09-4e9a-871b-ba7b99878586 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:23.248020 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dfe0981b-ae09-4e9a-871b-ba7b99878586 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 73c8d6a3-376b-4cca-83cf-f4ee73114d9d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:23.254774 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dfe0981b-ae09-4e9a-871b-ba7b99878586 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:23.255523 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dfe0981b-ae09-4e9a-871b-ba7b99878586 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:23.256016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dfe0981b-ae09-4e9a-871b-ba7b99878586 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:23.256962 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dfe0981b-ae09-4e9a-871b-ba7b99878586 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:23.257454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dfe0981b-ae09-4e9a-871b-ba7b99878586 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:23.258242 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dfe0981b-ae09-4e9a-871b-ba7b99878586 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:23.262505 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:25:23.513070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dfe0981b-ae09-4e9a-871b-ba7b99878586 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:23.520119 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dfe0981b-ae09-4e9a-871b-ba7b99878586 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d" status: 200 len: 1308 microversion: 2.1 time: 0.276891 Oct 29 03:25:23.523667 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2745/5714] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:23 2022] GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d => generated 1308 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:23.577385 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-069acfd5-9ea2-452b-a5e5-ff1ecfd59606 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:23.578099 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-069acfd5-9ea2-452b-a5e5-ff1ecfd59606 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:23.592795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-069acfd5-9ea2-452b-a5e5-ff1ecfd59606 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:23.593383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-069acfd5-9ea2-452b-a5e5-ff1ecfd59606 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:23.594266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-069acfd5-9ea2-452b-a5e5-ff1ecfd59606 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:23.595166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-069acfd5-9ea2-452b-a5e5-ff1ecfd59606 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:23.596961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-069acfd5-9ea2-452b-a5e5-ff1ecfd59606 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:23.598845 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-069acfd5-9ea2-452b-a5e5-ff1ecfd59606 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:23.781730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-62b79688-75b1-470d-82c6-1242b68b5bbc req-81e527d7-fc85-42b3-82e8-dd124e6360f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b02e08ec-9966-4d79-9c25-ce3f1822e38d", "tag": "1032b4cc-e4e3-4992-8f76-9e8bc7f25df6"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:25:23.807804 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-62b79688-75b1-470d-82c6-1242b68b5bbc req-81e527d7-fc85-42b3-82e8-dd124e6360f3 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:23.810328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-62b79688-75b1-470d-82c6-1242b68b5bbc req-81e527d7-fc85-42b3-82e8-dd124e6360f3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:23.811716 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-62b79688-75b1-470d-82c6-1242b68b5bbc req-81e527d7-fc85-42b3-82e8-dd124e6360f3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:23.841286 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-62b79688-75b1-470d-82c6-1242b68b5bbc req-81e527d7-fc85-42b3-82e8-dd124e6360f3 service nova] Creating event network-changed:1032b4cc-e4e3-4992-8f76-9e8bc7f25df6 for instance b02e08ec-9966-4d79-9c25-ce3f1822e38d on n-h1-862967-2 Oct 29 03:25:23.849698 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-62b79688-75b1-470d-82c6-1242b68b5bbc req-81e527d7-fc85-42b3-82e8-dd124e6360f3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073454 Oct 29 03:25:23.850897 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2746/5715] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:25:23.852215 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-069acfd5-9ea2-452b-a5e5-ff1ecfd59606 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:23.870980 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-069acfd5-9ea2-452b-a5e5-ff1ecfd59606 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d" status: 200 len: 1391 microversion: 2.1 time: 0.292698 Oct 29 03:25:23.887319 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2970/5716] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:23 2022] GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d => generated 1391 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:24.550280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1b0df3f1-d241-4808-85cb-b7e792fa9d7b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:24.551748 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1b0df3f1-d241-4808-85cb-b7e792fa9d7b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 73c8d6a3-376b-4cca-83cf-f4ee73114d9d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:24.558392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b0df3f1-d241-4808-85cb-b7e792fa9d7b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:24.559076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b0df3f1-d241-4808-85cb-b7e792fa9d7b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:24.559799 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b0df3f1-d241-4808-85cb-b7e792fa9d7b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:24.560819 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b0df3f1-d241-4808-85cb-b7e792fa9d7b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:24.561438 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b0df3f1-d241-4808-85cb-b7e792fa9d7b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:24.562190 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b0df3f1-d241-4808-85cb-b7e792fa9d7b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:24.708772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1b0df3f1-d241-4808-85cb-b7e792fa9d7b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:24.717793 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1b0df3f1-d241-4808-85cb-b7e792fa9d7b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d" status: 200 len: 1487 microversion: 2.1 time: 0.172711 Oct 29 03:25:24.718766 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2747/5717] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:24 2022] GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d => generated 1487 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:24.743366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2aa9e749-0806-45c2-aaf4-324767fe4ec9 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:24.744249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2aa9e749-0806-45c2-aaf4-324767fe4ec9 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: e12275ef-76da-4635-a932-4135fb47c20a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:24.752731 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2aa9e749-0806-45c2-aaf4-324767fe4ec9 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:24.753504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2aa9e749-0806-45c2-aaf4-324767fe4ec9 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:24.754328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2aa9e749-0806-45c2-aaf4-324767fe4ec9 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:24.755265 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2aa9e749-0806-45c2-aaf4-324767fe4ec9 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:24.755937 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2aa9e749-0806-45c2-aaf4-324767fe4ec9 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:24.756723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2aa9e749-0806-45c2-aaf4-324767fe4ec9 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:24.900362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e1927242-1324-4923-b0e0-90c3bf0caf81 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:24.907189 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e1927242-1324-4923-b0e0-90c3bf0caf81 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:24.923038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1927242-1324-4923-b0e0-90c3bf0caf81 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:24.923482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1927242-1324-4923-b0e0-90c3bf0caf81 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:24.924122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1927242-1324-4923-b0e0-90c3bf0caf81 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:24.925026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1927242-1324-4923-b0e0-90c3bf0caf81 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:24.925615 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1927242-1324-4923-b0e0-90c3bf0caf81 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:24.927265 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1927242-1324-4923-b0e0-90c3bf0caf81 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:24.943710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2aa9e749-0806-45c2-aaf4-324767fe4ec9 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:24.965148 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2aa9e749-0806-45c2-aaf4-324767fe4ec9 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a" status: 200 len: 1488 microversion: 2.1 time: 0.223272 Oct 29 03:25:24.965776 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2971/5718] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:24 2022] GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a => generated 1488 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:24.987578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-48bea4f0-36e6-4a36-b001-8baf3ab4ba87 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:24.988205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-48bea4f0-36e6-4a36-b001-8baf3ab4ba87 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 73c8d6a3-376b-4cca-83cf-f4ee73114d9d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:24.997518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-48bea4f0-36e6-4a36-b001-8baf3ab4ba87 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:24.998304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-48bea4f0-36e6-4a36-b001-8baf3ab4ba87 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:24.998972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-48bea4f0-36e6-4a36-b001-8baf3ab4ba87 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:24.999718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-48bea4f0-36e6-4a36-b001-8baf3ab4ba87 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:25.000374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-48bea4f0-36e6-4a36-b001-8baf3ab4ba87 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:25.000983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-48bea4f0-36e6-4a36-b001-8baf3ab4ba87 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:25.109074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e1927242-1324-4923-b0e0-90c3bf0caf81 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:25.119415 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e1927242-1324-4923-b0e0-90c3bf0caf81 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d" status: 200 len: 1391 microversion: 2.1 time: 0.223733 Oct 29 03:25:25.120685 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2748/5719] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:24 2022] GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d => generated 1391 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:25:25.198524 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-48bea4f0-36e6-4a36-b001-8baf3ab4ba87 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:25.207017 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-48bea4f0-36e6-4a36-b001-8baf3ab4ba87 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d" status: 200 len: 1487 microversion: 2.1 time: 0.223498 Oct 29 03:25:25.207882 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2972/5720] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:24 2022] GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d => generated 1487 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:25.231635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a4540baa-02d8-43c7-ac55-1e2af4bf149f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:25.232870 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a4540baa-02d8-43c7-ac55-1e2af4bf149f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 73c8d6a3-376b-4cca-83cf-f4ee73114d9d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:25.241776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a4540baa-02d8-43c7-ac55-1e2af4bf149f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:25.242950 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a4540baa-02d8-43c7-ac55-1e2af4bf149f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:25.243646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a4540baa-02d8-43c7-ac55-1e2af4bf149f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:25.244638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a4540baa-02d8-43c7-ac55-1e2af4bf149f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:25.245523 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a4540baa-02d8-43c7-ac55-1e2af4bf149f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:25.246189 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a4540baa-02d8-43c7-ac55-1e2af4bf149f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:25.289148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a4540baa-02d8-43c7-ac55-1e2af4bf149f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 73c8d6a3-376b-4cca-83cf-f4ee73114d9d] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:25:25.376902 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a4540baa-02d8-43c7-ac55-1e2af4bf149f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "DELETE /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d" status: 204 len: 0 microversion: 2.1 time: 0.150604 Oct 29 03:25:25.377443 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2749/5721] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:25:25 2022] DELETE /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 03:25:25.386483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bcb259dd-9620-40ab-aa50-68408bd052c6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:25.387111 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bcb259dd-9620-40ab-aa50-68408bd052c6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 73c8d6a3-376b-4cca-83cf-f4ee73114d9d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:25.393709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bcb259dd-9620-40ab-aa50-68408bd052c6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:25.394403 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bcb259dd-9620-40ab-aa50-68408bd052c6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:25.394840 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bcb259dd-9620-40ab-aa50-68408bd052c6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:25.396043 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bcb259dd-9620-40ab-aa50-68408bd052c6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:25.396787 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bcb259dd-9620-40ab-aa50-68408bd052c6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:25.397455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bcb259dd-9620-40ab-aa50-68408bd052c6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:25.571125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bcb259dd-9620-40ab-aa50-68408bd052c6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:25.581617 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bcb259dd-9620-40ab-aa50-68408bd052c6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d" status: 200 len: 1493 microversion: 2.1 time: 0.199564 Oct 29 03:25:25.582226 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2973/5722] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:25 2022] GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d => generated 1493 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:26.156230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3874e1b0-3734-4443-b2e6-b05111171f72 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:26.157726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3874e1b0-3734-4443-b2e6-b05111171f72 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:26.164397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3874e1b0-3734-4443-b2e6-b05111171f72 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:26.165076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3874e1b0-3734-4443-b2e6-b05111171f72 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:26.165636 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3874e1b0-3734-4443-b2e6-b05111171f72 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:26.166334 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3874e1b0-3734-4443-b2e6-b05111171f72 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:26.166780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3874e1b0-3734-4443-b2e6-b05111171f72 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:26.167197 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3874e1b0-3734-4443-b2e6-b05111171f72 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:26.309282 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3874e1b0-3734-4443-b2e6-b05111171f72 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:26.318052 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3874e1b0-3734-4443-b2e6-b05111171f72 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d" status: 200 len: 1391 microversion: 2.1 time: 0.166425 Oct 29 03:25:26.318767 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2750/5723] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:26 2022] GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:26.606414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-281ff36d-1155-4c37-9cc7-4de5547ded67 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:26.607779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-281ff36d-1155-4c37-9cc7-4de5547ded67 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 73c8d6a3-376b-4cca-83cf-f4ee73114d9d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:26.628030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-281ff36d-1155-4c37-9cc7-4de5547ded67 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:26.629433 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-281ff36d-1155-4c37-9cc7-4de5547ded67 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:26.633112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-281ff36d-1155-4c37-9cc7-4de5547ded67 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:26.634674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-281ff36d-1155-4c37-9cc7-4de5547ded67 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:26.637186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-281ff36d-1155-4c37-9cc7-4de5547ded67 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:26.637856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-281ff36d-1155-4c37-9cc7-4de5547ded67 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:26.834745 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-281ff36d-1155-4c37-9cc7-4de5547ded67 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:26.846938 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-281ff36d-1155-4c37-9cc7-4de5547ded67 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d" status: 200 len: 1493 microversion: 2.1 time: 0.244794 Oct 29 03:25:26.847781 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2974/5724] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:26 2022] GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d => generated 1493 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:27.342307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b0d5cc4a-55cc-42ce-8f22-99b62e09e01c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:27.343892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b0d5cc4a-55cc-42ce-8f22-99b62e09e01c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:27.352403 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b0d5cc4a-55cc-42ce-8f22-99b62e09e01c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:27.353091 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b0d5cc4a-55cc-42ce-8f22-99b62e09e01c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:27.354579 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b0d5cc4a-55cc-42ce-8f22-99b62e09e01c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:27.355829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b0d5cc4a-55cc-42ce-8f22-99b62e09e01c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:27.356428 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b0d5cc4a-55cc-42ce-8f22-99b62e09e01c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:27.357038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b0d5cc4a-55cc-42ce-8f22-99b62e09e01c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:27.727869 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b0d5cc4a-55cc-42ce-8f22-99b62e09e01c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:27.736638 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b0d5cc4a-55cc-42ce-8f22-99b62e09e01c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d" status: 200 len: 1391 microversion: 2.1 time: 0.399072 Oct 29 03:25:27.737535 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2751/5725] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:27 2022] GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d => generated 1391 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:27.870658 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c366955a-fc4f-4d81-b66c-9f5e9ff690e1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:27.872274 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c366955a-fc4f-4d81-b66c-9f5e9ff690e1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 73c8d6a3-376b-4cca-83cf-f4ee73114d9d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:27.878567 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c366955a-fc4f-4d81-b66c-9f5e9ff690e1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:27.879184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c366955a-fc4f-4d81-b66c-9f5e9ff690e1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:27.879719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c366955a-fc4f-4d81-b66c-9f5e9ff690e1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:27.880516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c366955a-fc4f-4d81-b66c-9f5e9ff690e1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:27.881096 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c366955a-fc4f-4d81-b66c-9f5e9ff690e1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:27.881617 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c366955a-fc4f-4d81-b66c-9f5e9ff690e1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:27.884493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=100 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:25:28.090810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-e0a45028-dda3-4c74-9f0a-7cfd645b841a req-c603ebba-331f-4593-a428-357b88521d20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73c8d6a3-376b-4cca-83cf-f4ee73114d9d", "name": "network-vif-deleted", "tag": "390b7fc4-21b2-4ed8-9390-7aa7a36241e8"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:25:28.116453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e0a45028-dda3-4c74-9f0a-7cfd645b841a req-c603ebba-331f-4593-a428-357b88521d20 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:28.116967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e0a45028-dda3-4c74-9f0a-7cfd645b841a req-c603ebba-331f-4593-a428-357b88521d20 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:28.117080 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c366955a-fc4f-4d81-b66c-9f5e9ff690e1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:28.117404 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e0a45028-dda3-4c74-9f0a-7cfd645b841a req-c603ebba-331f-4593-a428-357b88521d20 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:28.139548 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c366955a-fc4f-4d81-b66c-9f5e9ff690e1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d" status: 200 len: 1493 microversion: 2.1 time: 0.271306 Oct 29 03:25:28.158441 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-e0a45028-dda3-4c74-9f0a-7cfd645b841a req-c603ebba-331f-4593-a428-357b88521d20 service nova] Creating event network-vif-deleted:390b7fc4-21b2-4ed8-9390-7aa7a36241e8 for instance 73c8d6a3-376b-4cca-83cf-f4ee73114d9d on n-h1-862967-2 Oct 29 03:25:28.161986 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2975/5726] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:27 2022] GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d => generated 1493 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:28.172229 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-e0a45028-dda3-4c74-9f0a-7cfd645b841a req-c603ebba-331f-4593-a428-357b88521d20 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085046 Oct 29 03:25:28.173209 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2752/5727] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:25:28.606017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-55fa4006-9127-4540-8c58-d4f4f1cceda7 req-7c02a68e-0173-433a-b933-d5bfbbeffe6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b02e08ec-9966-4d79-9c25-ce3f1822e38d", "name": "network-vif-plugged", "status": "completed", "tag": "1032b4cc-e4e3-4992-8f76-9e8bc7f25df6"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:25:28.617945 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-55fa4006-9127-4540-8c58-d4f4f1cceda7 req-7c02a68e-0173-433a-b933-d5bfbbeffe6f service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:28.618743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-55fa4006-9127-4540-8c58-d4f4f1cceda7 req-7c02a68e-0173-433a-b933-d5bfbbeffe6f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:28.619358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-55fa4006-9127-4540-8c58-d4f4f1cceda7 req-7c02a68e-0173-433a-b933-d5bfbbeffe6f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:28.631451 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-55fa4006-9127-4540-8c58-d4f4f1cceda7 req-7c02a68e-0173-433a-b933-d5bfbbeffe6f service nova] Creating event network-vif-plugged:1032b4cc-e4e3-4992-8f76-9e8bc7f25df6 for instance b02e08ec-9966-4d79-9c25-ce3f1822e38d on n-h1-862967-2 Oct 29 03:25:28.637203 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-55fa4006-9127-4540-8c58-d4f4f1cceda7 req-7c02a68e-0173-433a-b933-d5bfbbeffe6f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035059 Oct 29 03:25:28.638549 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2976/5728] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:25:28.762604 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fd0d4500-9bb8-4307-89b5-ed68d966c0bd tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:28.763311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fd0d4500-9bb8-4307-89b5-ed68d966c0bd tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:28.779169 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd0d4500-9bb8-4307-89b5-ed68d966c0bd tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:28.779659 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd0d4500-9bb8-4307-89b5-ed68d966c0bd tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:28.780319 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd0d4500-9bb8-4307-89b5-ed68d966c0bd tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:28.781510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd0d4500-9bb8-4307-89b5-ed68d966c0bd tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:28.781996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd0d4500-9bb8-4307-89b5-ed68d966c0bd tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:28.782419 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fd0d4500-9bb8-4307-89b5-ed68d966c0bd tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:28.950528 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fd0d4500-9bb8-4307-89b5-ed68d966c0bd tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:28.958605 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fd0d4500-9bb8-4307-89b5-ed68d966c0bd tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d" status: 200 len: 1391 microversion: 2.1 time: 0.201858 Oct 29 03:25:28.959196 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2753/5729] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:28 2022] GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d => generated 1391 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:29.173306 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b5a8bc49-ea01-4657-8a38-dce9e47b269b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:29.173854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b5a8bc49-ea01-4657-8a38-dce9e47b269b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 73c8d6a3-376b-4cca-83cf-f4ee73114d9d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:29.180398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5a8bc49-ea01-4657-8a38-dce9e47b269b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:29.180928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5a8bc49-ea01-4657-8a38-dce9e47b269b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:29.181360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5a8bc49-ea01-4657-8a38-dce9e47b269b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:29.182048 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5a8bc49-ea01-4657-8a38-dce9e47b269b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:29.182495 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5a8bc49-ea01-4657-8a38-dce9e47b269b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:29.182916 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5a8bc49-ea01-4657-8a38-dce9e47b269b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:29.199430 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-b5a8bc49-ea01-4657-8a38-dce9e47b269b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] HTTP exception thrown: Instance 73c8d6a3-376b-4cca-83cf-f4ee73114d9d could not be found. Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b5a8bc49-ea01-4657-8a38-dce9e47b269b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Request method failure captured: Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d HTTP/1.1 Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJzN_0W3F2Tvd5_DwYEYaE7yArMUzQkw0yVRFyD806tbuPfgIN9hrPP-pm4QkI5-axnSQL2lFY8Zz_29U2X0iME7rTgOu74wHL71o9B_5IukGwbcOdtvhyWYdmcAPvnUhuYS1WrbTu-q-KzFqGL1fD3An-d36JB4OLVV1PNh19tG-1E Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/af30f7beecad4c448ff0706230ecb8d9"}]}] Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersTestJSON-1972911719 Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersTestJSON-1972911719-project Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 50ec777bf8ea4a9eb7d9d6cf995ba4ef Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersTestJSON-1972911719-project Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 73c8d6a3-376b-4cca-83cf-f4ee73114d9d could not be found. Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '73c8d6a3-376b-4cca-83cf-f4ee73114d9d'} Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73c8d6a3-376b-4cca-83cf-f4ee73114d9d could not be found. Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73c8d6a3-376b-4cca-83cf-f4ee73114d9d could not be found. Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:25:29.201144 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:25:29.205447 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:25:29.205447 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:25:29.205447 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:25:29.205447 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:25:29.205447 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:25:29.205447 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73c8d6a3-376b-4cca-83cf-f4ee73114d9d could not be found. Oct 29 03:25:29.205447 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:25:29.205447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b5a8bc49-ea01-4657-8a38-dce9e47b269b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Returning 404 to user: Instance 73c8d6a3-376b-4cca-83cf-f4ee73114d9d could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:25:29.205447 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b5a8bc49-ea01-4657-8a38-dce9e47b269b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d" status: 404 len: 111 microversion: 2.1 time: 0.034689 Oct 29 03:25:29.205447 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2977/5730] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:29 2022] GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:25:29.211558 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2f97b7d4-6fc8-47c9-99d8-9807fc35a910 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:29.212051 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2f97b7d4-6fc8-47c9-99d8-9807fc35a910 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: e12275ef-76da-4635-a932-4135fb47c20a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:29.218216 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f97b7d4-6fc8-47c9-99d8-9807fc35a910 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:29.218693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f97b7d4-6fc8-47c9-99d8-9807fc35a910 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:29.219122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f97b7d4-6fc8-47c9-99d8-9807fc35a910 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:29.219811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f97b7d4-6fc8-47c9-99d8-9807fc35a910 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:29.220256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f97b7d4-6fc8-47c9-99d8-9807fc35a910 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:29.220788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f97b7d4-6fc8-47c9-99d8-9807fc35a910 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:29.247424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2f97b7d4-6fc8-47c9-99d8-9807fc35a910 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: e12275ef-76da-4635-a932-4135fb47c20a] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:25:29.335011 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2f97b7d4-6fc8-47c9-99d8-9807fc35a910 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a" status: 204 len: 0 microversion: 2.1 time: 0.126989 Oct 29 03:25:29.335615 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2754/5731] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:25:29 2022] DELETE /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:25:29.344125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b874e321-3e3a-4a62-8be5-0c1b73c043c8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:29.344773 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b874e321-3e3a-4a62-8be5-0c1b73c043c8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: e12275ef-76da-4635-a932-4135fb47c20a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:29.350963 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b874e321-3e3a-4a62-8be5-0c1b73c043c8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:29.351448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b874e321-3e3a-4a62-8be5-0c1b73c043c8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:29.351881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b874e321-3e3a-4a62-8be5-0c1b73c043c8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:29.352608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b874e321-3e3a-4a62-8be5-0c1b73c043c8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:29.353063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b874e321-3e3a-4a62-8be5-0c1b73c043c8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:29.353483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b874e321-3e3a-4a62-8be5-0c1b73c043c8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:29.493270 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b874e321-3e3a-4a62-8be5-0c1b73c043c8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:29.501359 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b874e321-3e3a-4a62-8be5-0c1b73c043c8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a" status: 200 len: 1494 microversion: 2.1 time: 0.161354 Oct 29 03:25:29.502020 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2978/5732] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:29 2022] GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a => generated 1494 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:25:29.982763 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3d1c9ef1-f21b-4aec-a47a-b593523279d3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:29.983660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3d1c9ef1-f21b-4aec-a47a-b593523279d3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:29.991016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d1c9ef1-f21b-4aec-a47a-b593523279d3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:29.991728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d1c9ef1-f21b-4aec-a47a-b593523279d3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:29.992233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d1c9ef1-f21b-4aec-a47a-b593523279d3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:29.993048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d1c9ef1-f21b-4aec-a47a-b593523279d3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:29.993582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d1c9ef1-f21b-4aec-a47a-b593523279d3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:29.994098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3d1c9ef1-f21b-4aec-a47a-b593523279d3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:30.160848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:25:30.169110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3d1c9ef1-f21b-4aec-a47a-b593523279d3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:30.178268 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3d1c9ef1-f21b-4aec-a47a-b593523279d3 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d" status: 200 len: 1563 microversion: 2.1 time: 0.200257 Oct 29 03:25:30.178865 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2755/5733] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:29 2022] GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d => generated 1563 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:25:30.201105 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3355621d-7692-4b4e-9dfd-f2f7c7daf02a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:30.201840 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3355621d-7692-4b4e-9dfd-f2f7c7daf02a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:30.204144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:25:30.205036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=16 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:25:30.212231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3355621d-7692-4b4e-9dfd-f2f7c7daf02a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:30.212843 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3355621d-7692-4b4e-9dfd-f2f7c7daf02a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:30.213290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3355621d-7692-4b4e-9dfd-f2f7c7daf02a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:30.214009 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3355621d-7692-4b4e-9dfd-f2f7c7daf02a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:30.214473 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3355621d-7692-4b4e-9dfd-f2f7c7daf02a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:30.214907 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3355621d-7692-4b4e-9dfd-f2f7c7daf02a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:30.372124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3355621d-7692-4b4e-9dfd-f2f7c7daf02a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:30.391072 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3355621d-7692-4b4e-9dfd-f2f7c7daf02a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d" status: 200 len: 1563 microversion: 2.1 time: 0.193790 Oct 29 03:25:30.392511 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2979/5734] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:30 2022] GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d => generated 1563 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:30.526968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-08a2707c-92b0-40bb-a7db-c4b1df9c5c8e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:30.527778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-08a2707c-92b0-40bb-a7db-c4b1df9c5c8e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: e12275ef-76da-4635-a932-4135fb47c20a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:30.535987 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08a2707c-92b0-40bb-a7db-c4b1df9c5c8e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:30.537206 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08a2707c-92b0-40bb-a7db-c4b1df9c5c8e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:30.537998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08a2707c-92b0-40bb-a7db-c4b1df9c5c8e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:30.538900 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08a2707c-92b0-40bb-a7db-c4b1df9c5c8e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:30.539571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08a2707c-92b0-40bb-a7db-c4b1df9c5c8e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:30.540200 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08a2707c-92b0-40bb-a7db-c4b1df9c5c8e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:30.915709 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-08a2707c-92b0-40bb-a7db-c4b1df9c5c8e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:30.931760 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-08a2707c-92b0-40bb-a7db-c4b1df9c5c8e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a" status: 200 len: 1494 microversion: 2.1 time: 0.410180 Oct 29 03:25:30.932722 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2756/5735] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:30 2022] GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a => generated 1494 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:31.623319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-9659f176-ae3d-4234-a5a5-1f84d955a181 req-737e5abf-a053-468d-8171-77b4682025d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e12275ef-76da-4635-a932-4135fb47c20a", "name": "network-vif-deleted", "tag": "e524f18b-fd27-46c8-ae11-5a0de07855e3"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:25:31.644350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9659f176-ae3d-4234-a5a5-1f84d955a181 req-737e5abf-a053-468d-8171-77b4682025d6 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:31.649246 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9659f176-ae3d-4234-a5a5-1f84d955a181 req-737e5abf-a053-468d-8171-77b4682025d6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:31.649952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9659f176-ae3d-4234-a5a5-1f84d955a181 req-737e5abf-a053-468d-8171-77b4682025d6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:31.683089 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-9659f176-ae3d-4234-a5a5-1f84d955a181 req-737e5abf-a053-468d-8171-77b4682025d6 service nova] Creating event network-vif-deleted:e524f18b-fd27-46c8-ae11-5a0de07855e3 for instance e12275ef-76da-4635-a932-4135fb47c20a on n-h2-862967-2 Oct 29 03:25:31.688667 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-9659f176-ae3d-4234-a5a5-1f84d955a181 req-737e5abf-a053-468d-8171-77b4682025d6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070485 Oct 29 03:25:31.689840 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2980/5736] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:25:31.955839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-39e7cad2-eda9-40c1-a7af-f304998f48b4 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:31.957629 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-39e7cad2-eda9-40c1-a7af-f304998f48b4 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: e12275ef-76da-4635-a932-4135fb47c20a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:31.973450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39e7cad2-eda9-40c1-a7af-f304998f48b4 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:31.974305 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39e7cad2-eda9-40c1-a7af-f304998f48b4 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:31.974955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39e7cad2-eda9-40c1-a7af-f304998f48b4 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:31.975875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39e7cad2-eda9-40c1-a7af-f304998f48b4 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:31.977014 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39e7cad2-eda9-40c1-a7af-f304998f48b4 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:31.977658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39e7cad2-eda9-40c1-a7af-f304998f48b4 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:32.026605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39e7cad2-eda9-40c1-a7af-f304998f48b4 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:32.027162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39e7cad2-eda9-40c1-a7af-f304998f48b4 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:32.027688 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39e7cad2-eda9-40c1-a7af-f304998f48b4 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:32.028402 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-39e7cad2-eda9-40c1-a7af-f304998f48b4 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lazy-loading 'fault' on Instance uuid e12275ef-76da-4635-a932-4135fb47c20a {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:25:32.108965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-39e7cad2-eda9-40c1-a7af-f304998f48b4 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:32.120958 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-39e7cad2-eda9-40c1-a7af-f304998f48b4 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a" status: 200 len: 1298 microversion: 2.1 time: 0.168947 Oct 29 03:25:32.137629 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2757/5737] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:31 2022] GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a => generated 1298 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:32.950657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-47626745-68bb-4316-b640-37564a0fbc81 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:32.951360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-47626745-68bb-4316-b640-37564a0fbc81 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:32.968436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47626745-68bb-4316-b640-37564a0fbc81 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:32.968966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47626745-68bb-4316-b640-37564a0fbc81 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:32.969405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47626745-68bb-4316-b640-37564a0fbc81 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:32.970130 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47626745-68bb-4316-b640-37564a0fbc81 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:32.970774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47626745-68bb-4316-b640-37564a0fbc81 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:32.971207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47626745-68bb-4316-b640-37564a0fbc81 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:33.146964 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b95af485-60b9-4523-ad15-a77ba6d433b1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:33.147633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b95af485-60b9-4523-ad15-a77ba6d433b1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: e12275ef-76da-4635-a932-4135fb47c20a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:33.164083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b95af485-60b9-4523-ad15-a77ba6d433b1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:33.164599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b95af485-60b9-4523-ad15-a77ba6d433b1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:33.165044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b95af485-60b9-4523-ad15-a77ba6d433b1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:33.165762 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b95af485-60b9-4523-ad15-a77ba6d433b1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:33.166218 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b95af485-60b9-4523-ad15-a77ba6d433b1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:33.166646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b95af485-60b9-4523-ad15-a77ba6d433b1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:33.189952 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-b95af485-60b9-4523-ad15-a77ba6d433b1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] HTTP exception thrown: Instance e12275ef-76da-4635-a932-4135fb47c20a could not be found. Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b95af485-60b9-4523-ad15-a77ba6d433b1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Request method failure captured: Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a HTTP/1.1 Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJzN_0W3F2Tvd5_DwYEYaE7yArMUzQkw0yVRFyD806tbuPfgIN9hrPP-pm4QkI5-axnSQL2lFY8Zz_29U2X0iME7rTgOu74wHL71o9B_5IukGwbcOdtvhyWYdmcAPvnUhuYS1WrbTu-q-KzFqGL1fD3An-d36JB4OLVV1PNh19tG-1E Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/af30f7beecad4c448ff0706230ecb8d9"}]}] Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersTestJSON-1972911719 Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersTestJSON-1972911719-project Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 50ec777bf8ea4a9eb7d9d6cf995ba4ef Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersTestJSON-1972911719-project Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance e12275ef-76da-4635-a932-4135fb47c20a could not be found. Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'e12275ef-76da-4635-a932-4135fb47c20a'} Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e12275ef-76da-4635-a932-4135fb47c20a could not be found. Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e12275ef-76da-4635-a932-4135fb47c20a could not be found. Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:25:33.191662 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:25:33.195970 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:25:33.195970 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:25:33.195970 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:25:33.195970 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:25:33.195970 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:25:33.195970 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e12275ef-76da-4635-a932-4135fb47c20a could not be found. Oct 29 03:25:33.195970 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:25:33.195970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b95af485-60b9-4523-ad15-a77ba6d433b1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Returning 404 to user: Instance e12275ef-76da-4635-a932-4135fb47c20a could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:25:33.195970 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b95af485-60b9-4523-ad15-a77ba6d433b1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a" status: 404 len: 111 microversion: 2.1 time: 0.050456 Oct 29 03:25:33.195970 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2758/5738] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:33 2022] GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:25:33.305316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-686b8890-3f64-480d-9559-b9313f98d191 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-265075101", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "ca8e0bef-c1ec-47bd-9591-43a816db6a16"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:25:33.380161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-686b8890-3f64-480d-9559-b9313f98d191 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] validate_networks() for [('ca8e0bef-c1ec-47bd-9591-43a816db6a16', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:25:33.393508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-47626745-68bb-4316-b640-37564a0fbc81 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:33.403194 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-47626745-68bb-4316-b640-37564a0fbc81 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d" status: 200 len: 1563 microversion: 2.1 time: 0.457618 Oct 29 03:25:33.407868 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2981/5739] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:32 2022] GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d => generated 1563 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:33.747779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-d8713c05-2fed-46a6-9460-bc638f64a42f req-b8c2626d-839d-473d-bb51-b4284e788c1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b02e08ec-9966-4d79-9c25-ce3f1822e38d", "tag": "1032b4cc-e4e3-4992-8f76-9e8bc7f25df6"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:25:33.774951 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d8713c05-2fed-46a6-9460-bc638f64a42f req-b8c2626d-839d-473d-bb51-b4284e788c1a service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:33.775428 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d8713c05-2fed-46a6-9460-bc638f64a42f req-b8c2626d-839d-473d-bb51-b4284e788c1a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:33.775859 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d8713c05-2fed-46a6-9460-bc638f64a42f req-b8c2626d-839d-473d-bb51-b4284e788c1a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:33.793335 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-d8713c05-2fed-46a6-9460-bc638f64a42f req-b8c2626d-839d-473d-bb51-b4284e788c1a service nova] Creating event network-changed:1032b4cc-e4e3-4992-8f76-9e8bc7f25df6 for instance b02e08ec-9966-4d79-9c25-ce3f1822e38d on n-h1-862967-2 Oct 29 03:25:33.800849 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-d8713c05-2fed-46a6-9460-bc638f64a42f req-b8c2626d-839d-473d-bb51-b4284e788c1a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057279 Oct 29 03:25:33.801886 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2982/5740] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:25:33.973790 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-686b8890-3f64-480d-9559-b9313f98d191 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:25:33.974693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-686b8890-3f64-480d-9559-b9313f98d191 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:25:33.975384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-686b8890-3f64-480d-9559-b9313f98d191 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:25:33.975948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-686b8890-3f64-480d-9559-b9313f98d191 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:25:33.976729 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-686b8890-3f64-480d-9559-b9313f98d191 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:25:33.990436 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-686b8890-3f64-480d-9559-b9313f98d191 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:33.991192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-686b8890-3f64-480d-9559-b9313f98d191 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:33.991801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-686b8890-3f64-480d-9559-b9313f98d191 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:33.992826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-686b8890-3f64-480d-9559-b9313f98d191 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:33.993420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-686b8890-3f64-480d-9559-b9313f98d191 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:33.993980 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-686b8890-3f64-480d-9559-b9313f98d191 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:34.017004 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-686b8890-3f64-480d-9559-b9313f98d191 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Getting quotas for project af30f7beecad4c448ff0706230ecb8d9. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:25:34.023585 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-686b8890-3f64-480d-9559-b9313f98d191 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Getting quotas for user 50ec777bf8ea4a9eb7d9d6cf995ba4ef and project af30f7beecad4c448ff0706230ecb8d9. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:25:34.042430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-686b8890-3f64-480d-9559-b9313f98d191 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:25:34.045850 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-686b8890-3f64-480d-9559-b9313f98d191 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:25:34.118069 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-686b8890-3f64-480d-9559-b9313f98d191 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.817098 Oct 29 03:25:34.119342 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2759/5741] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:25:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:25:34.132022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2e0a3bb0-4efd-4ad5-a218-14fc9abfc2b8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:34.133582 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2e0a3bb0-4efd-4ad5-a218-14fc9abfc2b8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:34.247026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2e0a3bb0-4efd-4ad5-a218-14fc9abfc2b8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:34.261200 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2e0a3bb0-4efd-4ad5-a218-14fc9abfc2b8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a" status: 200 len: 1208 microversion: 2.1 time: 0.133388 Oct 29 03:25:34.263482 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2983/5742] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:34 2022] GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a => generated 1208 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:35.287305 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d599a4c9-0b32-4248-8aa6-db6ba02dfe94 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:35.287838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d599a4c9-0b32-4248-8aa6-db6ba02dfe94 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:35.295182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d599a4c9-0b32-4248-8aa6-db6ba02dfe94 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:35.295697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d599a4c9-0b32-4248-8aa6-db6ba02dfe94 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:35.296197 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d599a4c9-0b32-4248-8aa6-db6ba02dfe94 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:35.296930 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d599a4c9-0b32-4248-8aa6-db6ba02dfe94 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:35.297392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d599a4c9-0b32-4248-8aa6-db6ba02dfe94 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:35.297822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d599a4c9-0b32-4248-8aa6-db6ba02dfe94 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:35.366644 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d599a4c9-0b32-4248-8aa6-db6ba02dfe94 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:35.370625 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:25:35.377522 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d599a4c9-0b32-4248-8aa6-db6ba02dfe94 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a" status: 200 len: 1260 microversion: 2.1 time: 0.095507 Oct 29 03:25:35.378253 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2760/5743] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:35 2022] GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a => generated 1260 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:36.403144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9de43459-2768-4778-8ded-5772984987f1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:36.403990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9de43459-2768-4778-8ded-5772984987f1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:36.420119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9de43459-2768-4778-8ded-5772984987f1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:36.425988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9de43459-2768-4778-8ded-5772984987f1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:36.427818 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9de43459-2768-4778-8ded-5772984987f1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:36.434550 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9de43459-2768-4778-8ded-5772984987f1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:36.435210 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9de43459-2768-4778-8ded-5772984987f1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:36.435817 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9de43459-2768-4778-8ded-5772984987f1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:36.669801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9de43459-2768-4778-8ded-5772984987f1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:36.677986 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9de43459-2768-4778-8ded-5772984987f1 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a" status: 200 len: 1308 microversion: 2.1 time: 0.280574 Oct 29 03:25:36.678782 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2984/5744] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:36 2022] GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a => generated 1308 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:37.162849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-fb689a16-94a6-4575-84a7-1fa6322085e1 req-edc25a55-e165-4b87-af7e-c1e112d48264 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a", "tag": "10c39c92-b5e4-4e7e-8af2-a2231132e147"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:25:37.179991 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-fb689a16-94a6-4575-84a7-1fa6322085e1 req-edc25a55-e165-4b87-af7e-c1e112d48264 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:37.180965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-fb689a16-94a6-4575-84a7-1fa6322085e1 req-edc25a55-e165-4b87-af7e-c1e112d48264 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:37.181610 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-fb689a16-94a6-4575-84a7-1fa6322085e1 req-edc25a55-e165-4b87-af7e-c1e112d48264 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:37.213315 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-fb689a16-94a6-4575-84a7-1fa6322085e1 req-edc25a55-e165-4b87-af7e-c1e112d48264 service nova] Creating event network-changed:10c39c92-b5e4-4e7e-8af2-a2231132e147 for instance 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a on n-h2-862967-2 Oct 29 03:25:37.218484 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-fb689a16-94a6-4575-84a7-1fa6322085e1 req-edc25a55-e165-4b87-af7e-c1e112d48264 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066316 Oct 29 03:25:37.219278 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2761/5745] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:25:37.538665 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ad9f0b95-cc81-41fa-86c8-13602c34b369 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:37.539418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ad9f0b95-cc81-41fa-86c8-13602c34b369 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] [instance: 00aa17f2-3f29-4036-b14a-9b3809bfbd7a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:37.547067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad9f0b95-cc81-41fa-86c8-13602c34b369 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:37.547555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad9f0b95-cc81-41fa-86c8-13602c34b369 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:37.547987 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad9f0b95-cc81-41fa-86c8-13602c34b369 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:37.548714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad9f0b95-cc81-41fa-86c8-13602c34b369 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:37.549170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad9f0b95-cc81-41fa-86c8-13602c34b369 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:37.549591 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad9f0b95-cc81-41fa-86c8-13602c34b369 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:37.578920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ad9f0b95-cc81-41fa-86c8-13602c34b369 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] [instance: 00aa17f2-3f29-4036-b14a-9b3809bfbd7a] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:25:37.708642 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b607c28c-e31b-4a2c-8a14-56dbb02882c6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:37.710234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b607c28c-e31b-4a2c-8a14-56dbb02882c6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:37.710910 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ad9f0b95-cc81-41fa-86c8-13602c34b369 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] 10.222.0.46 "DELETE /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a" status: 204 len: 0 microversion: 2.1 time: 0.175542 Oct 29 03:25:37.712271 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2985/5746] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:25:37 2022] DELETE /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:25:37.724823 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b607c28c-e31b-4a2c-8a14-56dbb02882c6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:37.725597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b607c28c-e31b-4a2c-8a14-56dbb02882c6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:37.726237 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b607c28c-e31b-4a2c-8a14-56dbb02882c6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:37.727238 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b607c28c-e31b-4a2c-8a14-56dbb02882c6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:37.727439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-be0cbfb1-da52-430d-9788-38ac0487d1c3 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:37.727776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b607c28c-e31b-4a2c-8a14-56dbb02882c6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:37.728250 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b607c28c-e31b-4a2c-8a14-56dbb02882c6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:37.729057 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-be0cbfb1-da52-430d-9788-38ac0487d1c3 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] [instance: 00aa17f2-3f29-4036-b14a-9b3809bfbd7a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:37.736411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be0cbfb1-da52-430d-9788-38ac0487d1c3 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:37.737063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be0cbfb1-da52-430d-9788-38ac0487d1c3 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:37.737795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be0cbfb1-da52-430d-9788-38ac0487d1c3 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:37.739231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be0cbfb1-da52-430d-9788-38ac0487d1c3 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:37.739813 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be0cbfb1-da52-430d-9788-38ac0487d1c3 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:37.740658 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be0cbfb1-da52-430d-9788-38ac0487d1c3 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:37.927199 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-be0cbfb1-da52-430d-9788-38ac0487d1c3 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134cc5f6a6e44f09c3754b564383dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee68afb8421144efa7b6fdccd5106655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:37.936433 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-be0cbfb1-da52-430d-9788-38ac0487d1c3 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] 10.222.0.46 "GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a" status: 200 len: 1734 microversion: 2.1 time: 0.216805 Oct 29 03:25:37.937134 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2986/5747] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:37 2022] GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a => generated 1734 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:37.937837 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b607c28c-e31b-4a2c-8a14-56dbb02882c6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:37.946297 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b607c28c-e31b-4a2c-8a14-56dbb02882c6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a" status: 200 len: 1308 microversion: 2.1 time: 0.243902 Oct 29 03:25:37.956817 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2762/5748] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:37 2022] GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a => generated 1308 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:38.969800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d04f5ef0-6f3b-42ac-b4c0-ce6775048ffa tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:38.970562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d04f5ef0-6f3b-42ac-b4c0-ce6775048ffa tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:38.973938 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:25:38.980050 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d04f5ef0-6f3b-42ac-b4c0-ce6775048ffa tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:38.981179 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d04f5ef0-6f3b-42ac-b4c0-ce6775048ffa tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:38.981859 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d04f5ef0-6f3b-42ac-b4c0-ce6775048ffa tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:38.982975 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d04f5ef0-6f3b-42ac-b4c0-ce6775048ffa tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:38.983715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d04f5ef0-6f3b-42ac-b4c0-ce6775048ffa tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:38.984367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d04f5ef0-6f3b-42ac-b4c0-ce6775048ffa tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:39.117937 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-85c827b8-52da-471f-89fd-94c8f071c52e tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:39.119181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-85c827b8-52da-471f-89fd-94c8f071c52e tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] [instance: 00aa17f2-3f29-4036-b14a-9b3809bfbd7a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:39.126509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-85c827b8-52da-471f-89fd-94c8f071c52e tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:39.127022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-85c827b8-52da-471f-89fd-94c8f071c52e tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:39.127446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-85c827b8-52da-471f-89fd-94c8f071c52e tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:39.128166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-85c827b8-52da-471f-89fd-94c8f071c52e tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:39.128649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-85c827b8-52da-471f-89fd-94c8f071c52e tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:39.129080 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-85c827b8-52da-471f-89fd-94c8f071c52e tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:39.150645 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d04f5ef0-6f3b-42ac-b4c0-ce6775048ffa tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:39.159674 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d04f5ef0-6f3b-42ac-b4c0-ce6775048ffa tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a" status: 200 len: 1308 microversion: 2.1 time: 0.193688 Oct 29 03:25:39.173654 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2763/5749] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:38 2022] GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a => generated 1308 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:25:39.289032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-85c827b8-52da-471f-89fd-94c8f071c52e tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134cc5f6a6e44f09c3754b564383dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee68afb8421144efa7b6fdccd5106655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:39.302269 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-85c827b8-52da-471f-89fd-94c8f071c52e tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] 10.222.0.46 "GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a" status: 200 len: 1734 microversion: 2.1 time: 0.346639 Oct 29 03:25:39.303442 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2987/5750] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:38 2022] GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a => generated 1734 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:40.184693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5d14bc3e-6c86-4be9-8580-6841c9b13ea7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:40.189280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5d14bc3e-6c86-4be9-8580-6841c9b13ea7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:40.195890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d14bc3e-6c86-4be9-8580-6841c9b13ea7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:40.196414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d14bc3e-6c86-4be9-8580-6841c9b13ea7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:40.198376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d14bc3e-6c86-4be9-8580-6841c9b13ea7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:40.199511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d14bc3e-6c86-4be9-8580-6841c9b13ea7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:40.199987 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d14bc3e-6c86-4be9-8580-6841c9b13ea7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:40.201076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d14bc3e-6c86-4be9-8580-6841c9b13ea7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:40.327295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-42f576fb-3ac4-4bc2-91df-62037fcafb22 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:40.328938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-42f576fb-3ac4-4bc2-91df-62037fcafb22 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] [instance: 00aa17f2-3f29-4036-b14a-9b3809bfbd7a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:40.337872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-42f576fb-3ac4-4bc2-91df-62037fcafb22 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:40.338922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-42f576fb-3ac4-4bc2-91df-62037fcafb22 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:40.339637 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-42f576fb-3ac4-4bc2-91df-62037fcafb22 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:40.340617 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-42f576fb-3ac4-4bc2-91df-62037fcafb22 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:40.341356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-42f576fb-3ac4-4bc2-91df-62037fcafb22 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:40.342062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-42f576fb-3ac4-4bc2-91df-62037fcafb22 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:40.390844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5d14bc3e-6c86-4be9-8580-6841c9b13ea7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:40.399712 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5d14bc3e-6c86-4be9-8580-6841c9b13ea7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a" status: 200 len: 1308 microversion: 2.1 time: 0.219516 Oct 29 03:25:40.400329 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2764/5751] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:40 2022] GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a => generated 1308 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:40.657541 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-42f576fb-3ac4-4bc2-91df-62037fcafb22 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134cc5f6a6e44f09c3754b564383dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee68afb8421144efa7b6fdccd5106655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:40.695341 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-42f576fb-3ac4-4bc2-91df-62037fcafb22 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] 10.222.0.46 "GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a" status: 200 len: 1734 microversion: 2.1 time: 0.373186 Oct 29 03:25:40.704197 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2988/5752] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:40 2022] GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a => generated 1734 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:41.138421 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-4e89710c-d744-4fbf-84f3-a44594b6cf03 req-a3c0eabe-397f-4147-8dc6-c9b6fd0dc1b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00aa17f2-3f29-4036-b14a-9b3809bfbd7a", "name": "network-vif-deleted", "tag": "64a13004-89c8-4e77-8bd1-ef0532745375"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:25:41.162782 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4e89710c-d744-4fbf-84f3-a44594b6cf03 req-a3c0eabe-397f-4147-8dc6-c9b6fd0dc1b2 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:41.163712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4e89710c-d744-4fbf-84f3-a44594b6cf03 req-a3c0eabe-397f-4147-8dc6-c9b6fd0dc1b2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:41.164916 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4e89710c-d744-4fbf-84f3-a44594b6cf03 req-a3c0eabe-397f-4147-8dc6-c9b6fd0dc1b2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:41.190806 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-4e89710c-d744-4fbf-84f3-a44594b6cf03 req-a3c0eabe-397f-4147-8dc6-c9b6fd0dc1b2 service nova] Creating event network-vif-deleted:64a13004-89c8-4e77-8bd1-ef0532745375 for instance 00aa17f2-3f29-4036-b14a-9b3809bfbd7a on n-h2-862967-2 Oct 29 03:25:41.197265 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-4e89710c-d744-4fbf-84f3-a44594b6cf03 req-a3c0eabe-397f-4147-8dc6-c9b6fd0dc1b2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066074 Oct 29 03:25:41.203132 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2765/5753] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:25:41.425577 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4cdeca5b-b2db-4657-8c2e-946250ac0fb8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:41.430973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4cdeca5b-b2db-4657-8c2e-946250ac0fb8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:41.446737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4cdeca5b-b2db-4657-8c2e-946250ac0fb8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:41.447635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4cdeca5b-b2db-4657-8c2e-946250ac0fb8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:41.448302 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4cdeca5b-b2db-4657-8c2e-946250ac0fb8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:41.449247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4cdeca5b-b2db-4657-8c2e-946250ac0fb8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:41.450071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4cdeca5b-b2db-4657-8c2e-946250ac0fb8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:41.450727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4cdeca5b-b2db-4657-8c2e-946250ac0fb8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:41.635316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4cdeca5b-b2db-4657-8c2e-946250ac0fb8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:41.645550 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4cdeca5b-b2db-4657-8c2e-946250ac0fb8 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a" status: 200 len: 1308 microversion: 2.1 time: 0.224307 Oct 29 03:25:41.646754 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2989/5754] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:41 2022] GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a => generated 1308 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:41.724111 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d4a5108f-deae-4dbe-903f-c26e256beab6 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:41.725317 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d4a5108f-deae-4dbe-903f-c26e256beab6 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] [instance: 00aa17f2-3f29-4036-b14a-9b3809bfbd7a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:41.737995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d4a5108f-deae-4dbe-903f-c26e256beab6 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:41.738756 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d4a5108f-deae-4dbe-903f-c26e256beab6 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:41.739482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d4a5108f-deae-4dbe-903f-c26e256beab6 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:41.740395 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d4a5108f-deae-4dbe-903f-c26e256beab6 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:41.741113 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d4a5108f-deae-4dbe-903f-c26e256beab6 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:41.741754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d4a5108f-deae-4dbe-903f-c26e256beab6 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:41.788516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d4a5108f-deae-4dbe-903f-c26e256beab6 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:41.789671 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d4a5108f-deae-4dbe-903f-c26e256beab6 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:41.790323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d4a5108f-deae-4dbe-903f-c26e256beab6 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:41.790996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-d4a5108f-deae-4dbe-903f-c26e256beab6 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lazy-loading 'fault' on Instance uuid 00aa17f2-3f29-4036-b14a-9b3809bfbd7a {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:25:41.945372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d4a5108f-deae-4dbe-903f-c26e256beab6 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6134cc5f6a6e44f09c3754b564383dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee68afb8421144efa7b6fdccd5106655', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:41.953603 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d4a5108f-deae-4dbe-903f-c26e256beab6 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] 10.222.0.46 "GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a" status: 200 len: 1389 microversion: 2.1 time: 0.235665 Oct 29 03:25:41.955899 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2766/5755] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:41 2022] GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a => generated 1389 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:42.673298 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-13df1e01-6d71-4d42-9b9c-6b1815ec7d14 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:42.673924 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-13df1e01-6d71-4d42-9b9c-6b1815ec7d14 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:42.677411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:25:42.682943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13df1e01-6d71-4d42-9b9c-6b1815ec7d14 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:42.683306 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13df1e01-6d71-4d42-9b9c-6b1815ec7d14 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:42.683730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13df1e01-6d71-4d42-9b9c-6b1815ec7d14 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:42.684450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13df1e01-6d71-4d42-9b9c-6b1815ec7d14 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:42.685257 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13df1e01-6d71-4d42-9b9c-6b1815ec7d14 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:42.686005 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13df1e01-6d71-4d42-9b9c-6b1815ec7d14 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:42.850045 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-13df1e01-6d71-4d42-9b9c-6b1815ec7d14 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:42.860553 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-13df1e01-6d71-4d42-9b9c-6b1815ec7d14 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a" status: 200 len: 1308 microversion: 2.1 time: 0.191046 Oct 29 03:25:42.861511 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2990/5756] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:42 2022] GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a => generated 1308 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:42.984405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f0a5795c-ee92-44ed-aaef-3170db2fda2c tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:42.985714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f0a5795c-ee92-44ed-aaef-3170db2fda2c tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] [instance: 00aa17f2-3f29-4036-b14a-9b3809bfbd7a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:42.999944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f0a5795c-ee92-44ed-aaef-3170db2fda2c tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:43.000862 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f0a5795c-ee92-44ed-aaef-3170db2fda2c tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:43.001543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f0a5795c-ee92-44ed-aaef-3170db2fda2c tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:43.002499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f0a5795c-ee92-44ed-aaef-3170db2fda2c tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:43.003172 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f0a5795c-ee92-44ed-aaef-3170db2fda2c tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:43.003601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f0a5795c-ee92-44ed-aaef-3170db2fda2c tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:43.029687 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-f0a5795c-ee92-44ed-aaef-3170db2fda2c tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] HTTP exception thrown: Instance 00aa17f2-3f29-4036-b14a-9b3809bfbd7a could not be found. Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f0a5795c-ee92-44ed-aaef-3170db2fda2c tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Request method failure captured: Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a HTTP/1.1 Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJv6gTzs7cKp5wOKW4CaBJUbEIAQMmylkKv7p725odLqb4BHvi2NnRZ00saE4P8n0_c7dGEQ-FWyPdD5OVJTA4BPh-TbZEpgK_jBnLMk6X-5Th_Z_JJuiWNaM9qiGJabhHBz7eIDBWft_JTyRjoQQbOuRJWMs4injRGmIixGKPeoDGA Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: ee68afb8421144efa7b6fdccd5106655 Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestServerBasicOps-1761152287 Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ee68afb8421144efa7b6fdccd5106655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ee68afb8421144efa7b6fdccd5106655"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ee68afb8421144efa7b6fdccd5106655"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ee68afb8421144efa7b6fdccd5106655"}]}] Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestServerBasicOps-1761152287 Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: ee68afb8421144efa7b6fdccd5106655 Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestServerBasicOps-1761152287 Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestServerBasicOps-1761152287-project Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 6134cc5f6a6e44f09c3754b564383dba Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestServerBasicOps-1761152287-project Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 00aa17f2-3f29-4036-b14a-9b3809bfbd7a could not be found. Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '00aa17f2-3f29-4036-b14a-9b3809bfbd7a'} Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00aa17f2-3f29-4036-b14a-9b3809bfbd7a could not be found. Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00aa17f2-3f29-4036-b14a-9b3809bfbd7a could not be found. Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:25:43.031671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:25:43.036625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:25:43.036625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:25:43.036625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:25:43.036625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:25:43.036625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:25:43.036625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00aa17f2-3f29-4036-b14a-9b3809bfbd7a could not be found. Oct 29 03:25:43.036625 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:25:43.036625 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f0a5795c-ee92-44ed-aaef-3170db2fda2c tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Returning 404 to user: Instance 00aa17f2-3f29-4036-b14a-9b3809bfbd7a could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:25:43.036625 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f0a5795c-ee92-44ed-aaef-3170db2fda2c tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] 10.222.0.46 "GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a" status: 404 len: 111 microversion: 2.1 time: 0.060140 Oct 29 03:25:43.040686 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2767/5757] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:42 2022] GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:25:43.559815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-34caa386-8758-47a2-b51f-ffe9436aed80 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:43.560314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-34caa386-8758-47a2-b51f-ffe9436aed80 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] [instance: 00aa17f2-3f29-4036-b14a-9b3809bfbd7a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:43.575902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34caa386-8758-47a2-b51f-ffe9436aed80 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:43.579238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34caa386-8758-47a2-b51f-ffe9436aed80 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:43.580088 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34caa386-8758-47a2-b51f-ffe9436aed80 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:43.583327 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34caa386-8758-47a2-b51f-ffe9436aed80 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:43.588398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34caa386-8758-47a2-b51f-ffe9436aed80 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:43.591323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34caa386-8758-47a2-b51f-ffe9436aed80 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:43.622438 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-34caa386-8758-47a2-b51f-ffe9436aed80 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] HTTP exception thrown: Instance 00aa17f2-3f29-4036-b14a-9b3809bfbd7a could not be found. Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-34caa386-8758-47a2-b51f-ffe9436aed80 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Request method failure captured: Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a HTTP/1.1 Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJv6gTzs7cKp5wOKW4CaBJUbEIAQMmylkKv7p725odLqb4BHvi2NnRZ00saE4P8n0_c7dGEQ-FWyPdD5OVJTA4BPh-TbZEpgK_jBnLMk6X-5Th_Z_JJuiWNaM9qiGJabhHBz7eIDBWft_JTyRjoQQbOuRJWMs4injRGmIixGKPeoDGA Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: ee68afb8421144efa7b6fdccd5106655 Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-TestServerBasicOps-1761152287 Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ee68afb8421144efa7b6fdccd5106655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ee68afb8421144efa7b6fdccd5106655"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ee68afb8421144efa7b6fdccd5106655"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ee68afb8421144efa7b6fdccd5106655"}]}] Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-TestServerBasicOps-1761152287 Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: ee68afb8421144efa7b6fdccd5106655 Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-TestServerBasicOps-1761152287 Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-TestServerBasicOps-1761152287-project Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 6134cc5f6a6e44f09c3754b564383dba Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-TestServerBasicOps-1761152287-project Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 00aa17f2-3f29-4036-b14a-9b3809bfbd7a could not be found. Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '00aa17f2-3f29-4036-b14a-9b3809bfbd7a'} Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00aa17f2-3f29-4036-b14a-9b3809bfbd7a could not be found. Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:25:43.624965 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:25:43.629025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00aa17f2-3f29-4036-b14a-9b3809bfbd7a could not be found. Oct 29 03:25:43.629025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:25:43.629025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:25:43.629025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:25:43.629025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:25:43.629025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:25:43.629025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:25:43.629025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:25:43.629025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:25:43.629025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00aa17f2-3f29-4036-b14a-9b3809bfbd7a could not be found. Oct 29 03:25:43.629025 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:25:43.629025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-34caa386-8758-47a2-b51f-ffe9436aed80 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Returning 404 to user: Instance 00aa17f2-3f29-4036-b14a-9b3809bfbd7a could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:25:43.629025 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-34caa386-8758-47a2-b51f-ffe9436aed80 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] 10.222.0.46 "DELETE /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a" status: 404 len: 111 microversion: 2.1 time: 0.070840 Oct 29 03:25:43.629025 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2991/5758] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:25:43 2022] DELETE /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:25:43.636792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-23b61142-3b86-4125-88fa-43fe313e59f7 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:43.637486 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-23b61142-3b86-4125-88fa-43fe313e59f7 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] [instance: 00aa17f2-3f29-4036-b14a-9b3809bfbd7a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:43.648538 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23b61142-3b86-4125-88fa-43fe313e59f7 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:43.649108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23b61142-3b86-4125-88fa-43fe313e59f7 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:43.651289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23b61142-3b86-4125-88fa-43fe313e59f7 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:43.652078 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23b61142-3b86-4125-88fa-43fe313e59f7 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:43.655254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23b61142-3b86-4125-88fa-43fe313e59f7 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:43.655883 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23b61142-3b86-4125-88fa-43fe313e59f7 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:43.657382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-5582707c-5cd2-4fa5-a6ac-c050fb7276f4 req-f3d61493-3d62-4202-b42d-266a5f8fcfc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a", "name": "network-vif-plugged", "status": "completed", "tag": "10c39c92-b5e4-4e7e-8af2-a2231132e147"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:25:43.672867 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5582707c-5cd2-4fa5-a6ac-c050fb7276f4 req-f3d61493-3d62-4202-b42d-266a5f8fcfc0 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:43.673835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5582707c-5cd2-4fa5-a6ac-c050fb7276f4 req-f3d61493-3d62-4202-b42d-266a5f8fcfc0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:43.674379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5582707c-5cd2-4fa5-a6ac-c050fb7276f4 req-f3d61493-3d62-4202-b42d-266a5f8fcfc0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:43.688879 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-23b61142-3b86-4125-88fa-43fe313e59f7 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] HTTP exception thrown: Instance 00aa17f2-3f29-4036-b14a-9b3809bfbd7a could not be found. Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-23b61142-3b86-4125-88fa-43fe313e59f7 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Request method failure captured: Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a HTTP/1.1 Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJv6gTzs7cKp5wOKW4CaBJUbEIAQMmylkKv7p725odLqb4BHvi2NnRZ00saE4P8n0_c7dGEQ-FWyPdD5OVJTA4BPh-TbZEpgK_jBnLMk6X-5Th_Z_JJuiWNaM9qiGJabhHBz7eIDBWft_JTyRjoQQbOuRJWMs4injRGmIixGKPeoDGA Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: ee68afb8421144efa7b6fdccd5106655 Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestServerBasicOps-1761152287 Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ee68afb8421144efa7b6fdccd5106655"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ee68afb8421144efa7b6fdccd5106655"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ee68afb8421144efa7b6fdccd5106655"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ee68afb8421144efa7b6fdccd5106655"}]}] Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestServerBasicOps-1761152287 Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: ee68afb8421144efa7b6fdccd5106655 Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestServerBasicOps-1761152287 Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestServerBasicOps-1761152287-project Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 6134cc5f6a6e44f09c3754b564383dba Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestServerBasicOps-1761152287-project Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 00aa17f2-3f29-4036-b14a-9b3809bfbd7a could not be found. Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '00aa17f2-3f29-4036-b14a-9b3809bfbd7a'} Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00aa17f2-3f29-4036-b14a-9b3809bfbd7a could not be found. Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00aa17f2-3f29-4036-b14a-9b3809bfbd7a could not be found. Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:25:43.692542 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:25:43.697053 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:25:43.697053 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:25:43.697053 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:25:43.697053 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:25:43.697053 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:25:43.697053 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00aa17f2-3f29-4036-b14a-9b3809bfbd7a could not be found. Oct 29 03:25:43.697053 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:25:43.697053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-23b61142-3b86-4125-88fa-43fe313e59f7 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Returning 404 to user: Instance 00aa17f2-3f29-4036-b14a-9b3809bfbd7a could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:25:43.698178 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-23b61142-3b86-4125-88fa-43fe313e59f7 tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] 10.222.0.46 "GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a" status: 404 len: 111 microversion: 2.1 time: 0.065003 Oct 29 03:25:43.706669 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2768/5759] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:43 2022] GET /compute/v2.1/servers/00aa17f2-3f29-4036-b14a-9b3809bfbd7a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:25:43.722693 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-5582707c-5cd2-4fa5-a6ac-c050fb7276f4 req-f3d61493-3d62-4202-b42d-266a5f8fcfc0 service nova] Creating event network-vif-plugged:10c39c92-b5e4-4e7e-8af2-a2231132e147 for instance 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a on n-h2-862967-2 Oct 29 03:25:43.737336 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-5582707c-5cd2-4fa5-a6ac-c050fb7276f4 req-f3d61493-3d62-4202-b42d-266a5f8fcfc0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083703 Oct 29 03:25:43.738501 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2992/5760] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:25:43.884266 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cce76b2f-d4b1-459f-81fa-b46c50fca379 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:43.884976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cce76b2f-d4b1-459f-81fa-b46c50fca379 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:43.895276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cce76b2f-d4b1-459f-81fa-b46c50fca379 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:43.895806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cce76b2f-d4b1-459f-81fa-b46c50fca379 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:43.897252 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cce76b2f-d4b1-459f-81fa-b46c50fca379 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:43.898856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cce76b2f-d4b1-459f-81fa-b46c50fca379 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:43.899338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cce76b2f-d4b1-459f-81fa-b46c50fca379 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:43.899784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cce76b2f-d4b1-459f-81fa-b46c50fca379 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:44.008100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:25:44.015437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1be23168-b5ba-4585-a103-530307c0664c tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] Calling method '.version_select at 0x7ff052919dc0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:44.045869 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1be23168-b5ba-4585-a103-530307c0664c tempest-TestServerBasicOps-1761152287 tempest-TestServerBasicOps-1761152287-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1708734707" status: 202 len: 0 microversion: 2.1 time: 0.042493 Oct 29 03:25:44.046072 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:25:44.046931 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2993/5761] 10.222.0.46 () {58 vars in 1254 bytes} [Sat Oct 29 03:25:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1708734707 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:25:44.150336 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cce76b2f-d4b1-459f-81fa-b46c50fca379 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:44.159564 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cce76b2f-d4b1-459f-81fa-b46c50fca379 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a" status: 200 len: 1308 microversion: 2.1 time: 0.279217 Oct 29 03:25:44.160327 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2769/5762] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:43 2022] GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a => generated 1308 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:45.181036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:25:45.193513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5cf43150-145e-47d8-978c-f621e9692062 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:45.194839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5cf43150-145e-47d8-978c-f621e9692062 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:45.207703 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5cf43150-145e-47d8-978c-f621e9692062 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:45.208352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5cf43150-145e-47d8-978c-f621e9692062 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:45.208828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5cf43150-145e-47d8-978c-f621e9692062 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:45.209531 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5cf43150-145e-47d8-978c-f621e9692062 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:45.209982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5cf43150-145e-47d8-978c-f621e9692062 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:45.210404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5cf43150-145e-47d8-978c-f621e9692062 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:45.486700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5cf43150-145e-47d8-978c-f621e9692062 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:45.498275 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5cf43150-145e-47d8-978c-f621e9692062 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a" status: 200 len: 1487 microversion: 2.1 time: 0.318084 Oct 29 03:25:45.512724 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2994/5763] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:45 2022] GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a => generated 1487 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:45.529473 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fb9474ec-ebbd-4412-b67d-726b75dd72de tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:25:45.540478 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fb9474ec-ebbd-4412-b67d-726b75dd72de tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:45.548355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb9474ec-ebbd-4412-b67d-726b75dd72de tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:45.550097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb9474ec-ebbd-4412-b67d-726b75dd72de tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:45.550865 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb9474ec-ebbd-4412-b67d-726b75dd72de tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:45.551743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb9474ec-ebbd-4412-b67d-726b75dd72de tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:45.552348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb9474ec-ebbd-4412-b67d-726b75dd72de tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:45.553153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb9474ec-ebbd-4412-b67d-726b75dd72de tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:45.629980 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fb9474ec-ebbd-4412-b67d-726b75dd72de tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "PUT /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a" status: 200 len: 1082 microversion: 2.1 time: 0.107011 Oct 29 03:25:45.643988 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2770/5764] 10.222.0.46 () {60 vars in 1256 bytes} [Sat Oct 29 03:25:45 2022] PUT /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a => generated 1082 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:45.651173 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ae16568d-f29e-4daa-863e-08a4adea4c26 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:45.651994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ae16568d-f29e-4daa-863e-08a4adea4c26 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:45.659491 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae16568d-f29e-4daa-863e-08a4adea4c26 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:45.660294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae16568d-f29e-4daa-863e-08a4adea4c26 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:45.660775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae16568d-f29e-4daa-863e-08a4adea4c26 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:45.661554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae16568d-f29e-4daa-863e-08a4adea4c26 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:45.662019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae16568d-f29e-4daa-863e-08a4adea4c26 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:45.662451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ae16568d-f29e-4daa-863e-08a4adea4c26 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:45.956142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ae16568d-f29e-4daa-863e-08a4adea4c26 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:45.969718 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ae16568d-f29e-4daa-863e-08a4adea4c26 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a" status: 200 len: 1508 microversion: 2.1 time: 0.323148 Oct 29 03:25:45.969844 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2995/5765] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:45 2022] GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a => generated 1508 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:46.002881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e3275d0d-1251-4327-b3e7-5ea4109bc11b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:46.003664 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e3275d0d-1251-4327-b3e7-5ea4109bc11b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:46.022369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3275d0d-1251-4327-b3e7-5ea4109bc11b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:46.024512 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3275d0d-1251-4327-b3e7-5ea4109bc11b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:46.025646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3275d0d-1251-4327-b3e7-5ea4109bc11b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:46.028397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3275d0d-1251-4327-b3e7-5ea4109bc11b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:46.029110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3275d0d-1251-4327-b3e7-5ea4109bc11b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:46.029795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3275d0d-1251-4327-b3e7-5ea4109bc11b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:46.267372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e3275d0d-1251-4327-b3e7-5ea4109bc11b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:46.277206 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e3275d0d-1251-4327-b3e7-5ea4109bc11b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a" status: 200 len: 1508 microversion: 2.1 time: 0.284097 Oct 29 03:25:46.278372 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2771/5766] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:45 2022] GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a => generated 1508 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:46.303531 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a2b2ed91-c1d4-49c0-b2ed-a49f1b3acf8e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:46.304136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a2b2ed91-c1d4-49c0-b2ed-a49f1b3acf8e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:46.319992 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2b2ed91-c1d4-49c0-b2ed-a49f1b3acf8e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:46.320588 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2b2ed91-c1d4-49c0-b2ed-a49f1b3acf8e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:46.326085 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2b2ed91-c1d4-49c0-b2ed-a49f1b3acf8e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:46.326871 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2b2ed91-c1d4-49c0-b2ed-a49f1b3acf8e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:46.327426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2b2ed91-c1d4-49c0-b2ed-a49f1b3acf8e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:46.327863 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2b2ed91-c1d4-49c0-b2ed-a49f1b3acf8e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:46.340730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:25:46.385574 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a2b2ed91-c1d4-49c0-b2ed-a49f1b3acf8e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:25:46.570102 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a2b2ed91-c1d4-49c0-b2ed-a49f1b3acf8e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a" status: 204 len: 0 microversion: 2.1 time: 0.271580 Oct 29 03:25:46.571099 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2996/5767] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:25:46 2022] DELETE /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:25:46.580144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b12b14b0-708d-4c97-bee6-bb15e0e93746 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:46.581712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b12b14b0-708d-4c97-bee6-bb15e0e93746 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:46.590789 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b12b14b0-708d-4c97-bee6-bb15e0e93746 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:46.591633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b12b14b0-708d-4c97-bee6-bb15e0e93746 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:46.592284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b12b14b0-708d-4c97-bee6-bb15e0e93746 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:46.593285 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b12b14b0-708d-4c97-bee6-bb15e0e93746 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:46.593926 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b12b14b0-708d-4c97-bee6-bb15e0e93746 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:46.595107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b12b14b0-708d-4c97-bee6-bb15e0e93746 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:46.832445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b12b14b0-708d-4c97-bee6-bb15e0e93746 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:46.852089 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b12b14b0-708d-4c97-bee6-bb15e0e93746 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a" status: 200 len: 1514 microversion: 2.1 time: 0.276373 Oct 29 03:25:46.878859 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2772/5768] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:46 2022] GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a => generated 1514 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:47.896949 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c17cd006-0d53-4012-b008-b9e6db6384f2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:47.898649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c17cd006-0d53-4012-b008-b9e6db6384f2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:47.920616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c17cd006-0d53-4012-b008-b9e6db6384f2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:47.925725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c17cd006-0d53-4012-b008-b9e6db6384f2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:47.926249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c17cd006-0d53-4012-b008-b9e6db6384f2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:47.927068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c17cd006-0d53-4012-b008-b9e6db6384f2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:47.927758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c17cd006-0d53-4012-b008-b9e6db6384f2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:47.941020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c17cd006-0d53-4012-b008-b9e6db6384f2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:48.290791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c17cd006-0d53-4012-b008-b9e6db6384f2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:48.305241 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c17cd006-0d53-4012-b008-b9e6db6384f2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a" status: 200 len: 1514 microversion: 2.1 time: 0.430206 Oct 29 03:25:48.305844 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2997/5769] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:47 2022] GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a => generated 1514 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:48.780086 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-81758fe6-5e3b-43e0-8486-5b435b033979 req-35f58f6e-ef32-4967-af5f-c6c3f34bbee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a", "name": "network-vif-deleted", "tag": "10c39c92-b5e4-4e7e-8af2-a2231132e147"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:25:48.801890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-81758fe6-5e3b-43e0-8486-5b435b033979 req-35f58f6e-ef32-4967-af5f-c6c3f34bbee2 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:48.802375 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-81758fe6-5e3b-43e0-8486-5b435b033979 req-35f58f6e-ef32-4967-af5f-c6c3f34bbee2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:48.802948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-81758fe6-5e3b-43e0-8486-5b435b033979 req-35f58f6e-ef32-4967-af5f-c6c3f34bbee2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:48.840370 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-81758fe6-5e3b-43e0-8486-5b435b033979 req-35f58f6e-ef32-4967-af5f-c6c3f34bbee2 service nova] Creating event network-vif-deleted:10c39c92-b5e4-4e7e-8af2-a2231132e147 for instance 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a on n-h2-862967-2 Oct 29 03:25:48.852393 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-81758fe6-5e3b-43e0-8486-5b435b033979 req-35f58f6e-ef32-4967-af5f-c6c3f34bbee2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077418 Oct 29 03:25:48.853060 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2773/5770] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:25:49.327905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b0cd1fac-9cb1-4b2d-a66a-7aa491668e2b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:49.330923 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b0cd1fac-9cb1-4b2d-a66a-7aa491668e2b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:49.340126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0cd1fac-9cb1-4b2d-a66a-7aa491668e2b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:49.345297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0cd1fac-9cb1-4b2d-a66a-7aa491668e2b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:49.346231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0cd1fac-9cb1-4b2d-a66a-7aa491668e2b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:49.347802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0cd1fac-9cb1-4b2d-a66a-7aa491668e2b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:49.349569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0cd1fac-9cb1-4b2d-a66a-7aa491668e2b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:49.350292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0cd1fac-9cb1-4b2d-a66a-7aa491668e2b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:49.423202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0cd1fac-9cb1-4b2d-a66a-7aa491668e2b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:49.423711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0cd1fac-9cb1-4b2d-a66a-7aa491668e2b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:49.424150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0cd1fac-9cb1-4b2d-a66a-7aa491668e2b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:49.424847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-b0cd1fac-9cb1-4b2d-a66a-7aa491668e2b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lazy-loading 'fault' on Instance uuid 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:25:49.493635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b0cd1fac-9cb1-4b2d-a66a-7aa491668e2b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:49.502391 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b0cd1fac-9cb1-4b2d-a66a-7aa491668e2b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a" status: 200 len: 1319 microversion: 2.1 time: 0.178689 Oct 29 03:25:49.522421 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2998/5771] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:49 2022] GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:50.528259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fdeabd24-9b43-4974-b024-9f2b55cfc1a6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:50.530556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fdeabd24-9b43-4974-b024-9f2b55cfc1a6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:50.546837 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdeabd24-9b43-4974-b024-9f2b55cfc1a6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:50.547585 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdeabd24-9b43-4974-b024-9f2b55cfc1a6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:50.548302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdeabd24-9b43-4974-b024-9f2b55cfc1a6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:50.549285 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdeabd24-9b43-4974-b024-9f2b55cfc1a6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:50.549980 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdeabd24-9b43-4974-b024-9f2b55cfc1a6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:50.550566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdeabd24-9b43-4974-b024-9f2b55cfc1a6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:50.567716 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-fdeabd24-9b43-4974-b024-9f2b55cfc1a6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] HTTP exception thrown: Instance 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a could not be found. Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fdeabd24-9b43-4974-b024-9f2b55cfc1a6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Request method failure captured: Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a HTTP/1.1 Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJzN_0W3F2Tvd5_DwYEYaE7yArMUzQkw0yVRFyD806tbuPfgIN9hrPP-pm4QkI5-axnSQL2lFY8Zz_29U2X0iME7rTgOu74wHL71o9B_5IukGwbcOdtvhyWYdmcAPvnUhuYS1WrbTu-q-KzFqGL1fD3An-d36JB4OLVV1PNh19tG-1E Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/af30f7beecad4c448ff0706230ecb8d9"}]}] Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersTestJSON-1972911719 Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersTestJSON-1972911719-project Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 50ec777bf8ea4a9eb7d9d6cf995ba4ef Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersTestJSON-1972911719-project Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a could not be found. Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a'} Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a could not be found. Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a could not be found. Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:25:50.569915 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:25:50.573851 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:25:50.573851 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:25:50.573851 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:25:50.573851 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:25:50.573851 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:25:50.573851 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a could not be found. Oct 29 03:25:50.573851 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:25:50.575882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fdeabd24-9b43-4974-b024-9f2b55cfc1a6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Returning 404 to user: Instance 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:25:50.576927 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fdeabd24-9b43-4974-b024-9f2b55cfc1a6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a" status: 404 len: 111 microversion: 2.1 time: 0.054507 Oct 29 03:25:50.589571 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2774/5772] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:50 2022] GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:25:50.793253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-578bde5e-ba75-4aa9-b933-a93b9ee9fe1a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-272666058", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "ca8e0bef-c1ec-47bd-9591-43a816db6a16"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:25:50.913802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-578bde5e-ba75-4aa9-b933-a93b9ee9fe1a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] validate_networks() for [('ca8e0bef-c1ec-47bd-9591-43a816db6a16', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:25:52.001227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-578bde5e-ba75-4aa9-b933-a93b9ee9fe1a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:25:52.001766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-578bde5e-ba75-4aa9-b933-a93b9ee9fe1a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:25:52.002113 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-578bde5e-ba75-4aa9-b933-a93b9ee9fe1a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:25:52.002519 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-578bde5e-ba75-4aa9-b933-a93b9ee9fe1a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:25:52.002926 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-578bde5e-ba75-4aa9-b933-a93b9ee9fe1a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:25:52.017000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-578bde5e-ba75-4aa9-b933-a93b9ee9fe1a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:52.017490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-578bde5e-ba75-4aa9-b933-a93b9ee9fe1a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:52.017928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-578bde5e-ba75-4aa9-b933-a93b9ee9fe1a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:52.018653 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-578bde5e-ba75-4aa9-b933-a93b9ee9fe1a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:52.019182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-578bde5e-ba75-4aa9-b933-a93b9ee9fe1a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:52.019512 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-578bde5e-ba75-4aa9-b933-a93b9ee9fe1a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:52.072897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-578bde5e-ba75-4aa9-b933-a93b9ee9fe1a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Getting quotas for project af30f7beecad4c448ff0706230ecb8d9. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:25:52.080926 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-578bde5e-ba75-4aa9-b933-a93b9ee9fe1a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Getting quotas for user 50ec777bf8ea4a9eb7d9d6cf995ba4ef and project af30f7beecad4c448ff0706230ecb8d9. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:25:52.099192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-578bde5e-ba75-4aa9-b933-a93b9ee9fe1a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:25:52.104639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-578bde5e-ba75-4aa9-b933-a93b9ee9fe1a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:25:52.207435 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-578bde5e-ba75-4aa9-b933-a93b9ee9fe1a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.418090 Oct 29 03:25:52.208711 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 2999/5773] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:25:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:25:52.221543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6ad37c78-c69b-4256-a59b-d2975a8c8757 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:52.222084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6ad37c78-c69b-4256-a59b-d2975a8c8757 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:52.317448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6ad37c78-c69b-4256-a59b-d2975a8c8757 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:52.329525 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6ad37c78-c69b-4256-a59b-d2975a8c8757 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1208 microversion: 2.1 time: 0.113473 Oct 29 03:25:52.335679 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2775/5774] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:52 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1208 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:53.355688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-002367ff-8e37-4d66-87a4-0e7d2ddfa80b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:53.356420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-002367ff-8e37-4d66-87a4-0e7d2ddfa80b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:53.371079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-002367ff-8e37-4d66-87a4-0e7d2ddfa80b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:53.373941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-002367ff-8e37-4d66-87a4-0e7d2ddfa80b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:53.375002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-002367ff-8e37-4d66-87a4-0e7d2ddfa80b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:53.395415 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-002367ff-8e37-4d66-87a4-0e7d2ddfa80b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:53.397411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-002367ff-8e37-4d66-87a4-0e7d2ddfa80b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:53.398787 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-002367ff-8e37-4d66-87a4-0e7d2ddfa80b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:53.553354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-002367ff-8e37-4d66-87a4-0e7d2ddfa80b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:53.574372 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-002367ff-8e37-4d66-87a4-0e7d2ddfa80b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1260 microversion: 2.1 time: 0.221171 Oct 29 03:25:53.575128 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3000/5775] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:53 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1260 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:54.597556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cf9c50ea-630f-49e5-b9a9-671364bd2e95 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:54.598205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cf9c50ea-630f-49e5-b9a9-671364bd2e95 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:54.608925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf9c50ea-630f-49e5-b9a9-671364bd2e95 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:54.609301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf9c50ea-630f-49e5-b9a9-671364bd2e95 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:54.609742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf9c50ea-630f-49e5-b9a9-671364bd2e95 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:54.610457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf9c50ea-630f-49e5-b9a9-671364bd2e95 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:54.610905 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf9c50ea-630f-49e5-b9a9-671364bd2e95 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:54.611322 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf9c50ea-630f-49e5-b9a9-671364bd2e95 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:54.729500 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cf9c50ea-630f-49e5-b9a9-671364bd2e95 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:54.752908 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cf9c50ea-630f-49e5-b9a9-671364bd2e95 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1266 microversion: 2.1 time: 0.156785 Oct 29 03:25:54.758170 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2776/5776] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:54 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:55.778064 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bc8e27de-6ab0-4ed7-915a-abfeb6d64187 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:55.779454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bc8e27de-6ab0-4ed7-915a-abfeb6d64187 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:55.793327 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc8e27de-6ab0-4ed7-915a-abfeb6d64187 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:55.799134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc8e27de-6ab0-4ed7-915a-abfeb6d64187 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:55.799826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc8e27de-6ab0-4ed7-915a-abfeb6d64187 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:55.800835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc8e27de-6ab0-4ed7-915a-abfeb6d64187 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:55.801519 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc8e27de-6ab0-4ed7-915a-abfeb6d64187 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:55.802200 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc8e27de-6ab0-4ed7-915a-abfeb6d64187 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:56.571012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bc8e27de-6ab0-4ed7-915a-abfeb6d64187 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:56.596079 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bc8e27de-6ab0-4ed7-915a-abfeb6d64187 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1308 microversion: 2.1 time: 0.820345 Oct 29 03:25:56.597442 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3001/5777] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:55 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1308 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:57.101852 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-79bcde5e-a7b5-4a91-8d2c-74bac23ada21 req-cedc4f94-d08b-45b4-948e-23ceea7344ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dc904b6-8ece-4639-b5e7-486aa32ec98b", "tag": "916b5567-39e3-4b1d-b008-a6beab9b8167"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:25:57.115048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-79bcde5e-a7b5-4a91-8d2c-74bac23ada21 req-cedc4f94-d08b-45b4-948e-23ceea7344ae service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:57.115871 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-79bcde5e-a7b5-4a91-8d2c-74bac23ada21 req-cedc4f94-d08b-45b4-948e-23ceea7344ae service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:57.116372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-79bcde5e-a7b5-4a91-8d2c-74bac23ada21 req-cedc4f94-d08b-45b4-948e-23ceea7344ae service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:57.147405 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-79bcde5e-a7b5-4a91-8d2c-74bac23ada21 req-cedc4f94-d08b-45b4-948e-23ceea7344ae service nova] Creating event network-changed:916b5567-39e3-4b1d-b008-a6beab9b8167 for instance 9dc904b6-8ece-4639-b5e7-486aa32ec98b on n-h2-862967-2 Oct 29 03:25:57.178452 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-79bcde5e-a7b5-4a91-8d2c-74bac23ada21 req-cedc4f94-d08b-45b4-948e-23ceea7344ae service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081761 Oct 29 03:25:57.179622 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2777/5778] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:25:57.626298 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-71e0e382-396b-4f4c-9867-69191df71422 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:57.644231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-71e0e382-396b-4f4c-9867-69191df71422 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:57.663028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-71e0e382-396b-4f4c-9867-69191df71422 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:57.663028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-71e0e382-396b-4f4c-9867-69191df71422 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:57.663028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-71e0e382-396b-4f4c-9867-69191df71422 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:57.663028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-71e0e382-396b-4f4c-9867-69191df71422 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:57.663028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-71e0e382-396b-4f4c-9867-69191df71422 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:57.663028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-71e0e382-396b-4f4c-9867-69191df71422 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:57.802748 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4e601f3e-4a7d-4ff0-977c-dd25470b94bb tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:25:57.805771 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4e601f3e-4a7d-4ff0-977c-dd25470b94bb tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:57.818875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e601f3e-4a7d-4ff0-977c-dd25470b94bb tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:57.821224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e601f3e-4a7d-4ff0-977c-dd25470b94bb tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:57.824171 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e601f3e-4a7d-4ff0-977c-dd25470b94bb tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:57.827516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e601f3e-4a7d-4ff0-977c-dd25470b94bb tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:57.830091 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e601f3e-4a7d-4ff0-977c-dd25470b94bb tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:57.831772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e601f3e-4a7d-4ff0-977c-dd25470b94bb tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:57.866674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-71e0e382-396b-4f4c-9867-69191df71422 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:57.877203 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-71e0e382-396b-4f4c-9867-69191df71422 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1308 microversion: 2.1 time: 0.253834 Oct 29 03:25:57.885272 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3002/5779] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:57 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1308 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:25:57.938988 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4e601f3e-4a7d-4ff0-977c-dd25470b94bb tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "POST /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d/action" status: 200 len: 24572 microversion: 2.1 time: 0.141079 Oct 29 03:25:57.940181 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2778/5780] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:25:57 2022] POST /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d/action => generated 24572 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:25:58.904692 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2fcedea3-2555-419e-bf48-390d58b914c7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:25:58.914881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2fcedea3-2555-419e-bf48-390d58b914c7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:25:58.930907 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2fcedea3-2555-419e-bf48-390d58b914c7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:58.931634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2fcedea3-2555-419e-bf48-390d58b914c7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:58.932228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2fcedea3-2555-419e-bf48-390d58b914c7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:58.934296 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2fcedea3-2555-419e-bf48-390d58b914c7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:25:58.934936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2fcedea3-2555-419e-bf48-390d58b914c7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:25:58.936236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2fcedea3-2555-419e-bf48-390d58b914c7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:25:59.189093 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2fcedea3-2555-419e-bf48-390d58b914c7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:25:59.198510 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2fcedea3-2555-419e-bf48-390d58b914c7 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1308 microversion: 2.1 time: 0.297794 Oct 29 03:25:59.213339 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3003/5781] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:25:58 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1308 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:00.227488 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b7a79f0a-4762-4df1-941a-1bdea7d28c5e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:00.227488 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b7a79f0a-4762-4df1-941a-1bdea7d28c5e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:00.236560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7a79f0a-4762-4df1-941a-1bdea7d28c5e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:00.236560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7a79f0a-4762-4df1-941a-1bdea7d28c5e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:00.236560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7a79f0a-4762-4df1-941a-1bdea7d28c5e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:00.236560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7a79f0a-4762-4df1-941a-1bdea7d28c5e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:00.236560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7a79f0a-4762-4df1-941a-1bdea7d28c5e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:00.236560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7a79f0a-4762-4df1-941a-1bdea7d28c5e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:00.387135 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b7a79f0a-4762-4df1-941a-1bdea7d28c5e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:00.395856 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b7a79f0a-4762-4df1-941a-1bdea7d28c5e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1308 microversion: 2.1 time: 0.176172 Oct 29 03:26:00.397296 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2779/5782] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:00 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1308 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:01.419213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9a493fed-c49a-4ce0-99c8-f33cef8b589f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:01.419847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9a493fed-c49a-4ce0-99c8-f33cef8b589f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:01.426700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9a493fed-c49a-4ce0-99c8-f33cef8b589f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:01.427649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9a493fed-c49a-4ce0-99c8-f33cef8b589f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:01.427649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9a493fed-c49a-4ce0-99c8-f33cef8b589f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:01.428285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9a493fed-c49a-4ce0-99c8-f33cef8b589f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:01.428781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9a493fed-c49a-4ce0-99c8-f33cef8b589f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:01.429253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9a493fed-c49a-4ce0-99c8-f33cef8b589f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:01.595127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9a493fed-c49a-4ce0-99c8-f33cef8b589f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:01.605479 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9a493fed-c49a-4ce0-99c8-f33cef8b589f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1308 microversion: 2.1 time: 0.190018 Oct 29 03:26:01.607018 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3004/5783] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:01 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1308 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:02.631329 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-73928f74-050b-42da-a90c-b02cd434b06a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:02.631881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-73928f74-050b-42da-a90c-b02cd434b06a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:02.634906 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:02.647718 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73928f74-050b-42da-a90c-b02cd434b06a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:02.648216 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73928f74-050b-42da-a90c-b02cd434b06a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:02.648665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73928f74-050b-42da-a90c-b02cd434b06a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:02.649357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73928f74-050b-42da-a90c-b02cd434b06a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:02.649992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73928f74-050b-42da-a90c-b02cd434b06a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:02.650587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73928f74-050b-42da-a90c-b02cd434b06a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:02.794171 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-73928f74-050b-42da-a90c-b02cd434b06a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:02.801880 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-73928f74-050b-42da-a90c-b02cd434b06a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1308 microversion: 2.1 time: 0.174988 Oct 29 03:26:02.802982 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2780/5784] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:02 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1308 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:03.737300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-5593d9bc-cdfc-4775-9716-8e636280e7ba req-279a6e85-6fb8-4a01-9b40-3d9ebd26c240 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc904b6-8ece-4639-b5e7-486aa32ec98b", "name": "network-vif-plugged", "status": "completed", "tag": "916b5567-39e3-4b1d-b008-a6beab9b8167"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:03.756034 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:03.765101 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:03.770459 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5593d9bc-cdfc-4775-9716-8e636280e7ba req-279a6e85-6fb8-4a01-9b40-3d9ebd26c240 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:03.771191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5593d9bc-cdfc-4775-9716-8e636280e7ba req-279a6e85-6fb8-4a01-9b40-3d9ebd26c240 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:03.772514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5593d9bc-cdfc-4775-9716-8e636280e7ba req-279a6e85-6fb8-4a01-9b40-3d9ebd26c240 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:03.786803 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-5593d9bc-cdfc-4775-9716-8e636280e7ba req-279a6e85-6fb8-4a01-9b40-3d9ebd26c240 service nova] Creating event network-vif-plugged:916b5567-39e3-4b1d-b008-a6beab9b8167 for instance 9dc904b6-8ece-4639-b5e7-486aa32ec98b on n-h2-862967-2 Oct 29 03:26:03.795892 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-5593d9bc-cdfc-4775-9716-8e636280e7ba req-279a6e85-6fb8-4a01-9b40-3d9ebd26c240 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063936 Oct 29 03:26:03.796845 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3005/5785] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:26:03.828662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5b2897af-f4a3-4d62-9260-2430b087c444 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:03.829925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5b2897af-f4a3-4d62-9260-2430b087c444 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:03.837451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5b2897af-f4a3-4d62-9260-2430b087c444 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:03.838307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5b2897af-f4a3-4d62-9260-2430b087c444 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:03.839120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5b2897af-f4a3-4d62-9260-2430b087c444 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:03.840042 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5b2897af-f4a3-4d62-9260-2430b087c444 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:03.840740 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5b2897af-f4a3-4d62-9260-2430b087c444 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:03.841698 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5b2897af-f4a3-4d62-9260-2430b087c444 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:04.049006 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5b2897af-f4a3-4d62-9260-2430b087c444 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:04.056846 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5b2897af-f4a3-4d62-9260-2430b087c444 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1308 microversion: 2.1 time: 0.233893 Oct 29 03:26:04.061016 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2781/5786] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:03 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1308 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:05.085202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a7af2513-7801-4963-9be1-bbeceb64956f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:05.086021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a7af2513-7801-4963-9be1-bbeceb64956f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:05.096109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7af2513-7801-4963-9be1-bbeceb64956f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:05.096734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7af2513-7801-4963-9be1-bbeceb64956f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:05.097409 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7af2513-7801-4963-9be1-bbeceb64956f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:05.098837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7af2513-7801-4963-9be1-bbeceb64956f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:05.099510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7af2513-7801-4963-9be1-bbeceb64956f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:05.100149 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7af2513-7801-4963-9be1-bbeceb64956f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:05.266207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a7af2513-7801-4963-9be1-bbeceb64956f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:05.276557 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a7af2513-7801-4963-9be1-bbeceb64956f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1308 microversion: 2.1 time: 0.195459 Oct 29 03:26:05.277791 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3006/5787] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:05 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1308 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:06.303998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8a70ca6d-7970-48ea-81b8-327ae6884e17 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:06.304865 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8a70ca6d-7970-48ea-81b8-327ae6884e17 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:06.314275 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a70ca6d-7970-48ea-81b8-327ae6884e17 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:06.315085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a70ca6d-7970-48ea-81b8-327ae6884e17 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:06.315912 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a70ca6d-7970-48ea-81b8-327ae6884e17 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:06.316766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a70ca6d-7970-48ea-81b8-327ae6884e17 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:06.317381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a70ca6d-7970-48ea-81b8-327ae6884e17 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:06.318002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a70ca6d-7970-48ea-81b8-327ae6884e17 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:06.352155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:06.480510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8a70ca6d-7970-48ea-81b8-327ae6884e17 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:06.493039 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8a70ca6d-7970-48ea-81b8-327ae6884e17 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1488 microversion: 2.1 time: 0.193407 Oct 29 03:26:06.494021 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2782/5788] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:06 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1488 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:06.523687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-12bc4388-c646-4f11-8fd5-4bc5a041729c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2017382395"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:06.527295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-12bc4388-c646-4f11-8fd5-4bc5a041729c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:06.535982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12bc4388-c646-4f11-8fd5-4bc5a041729c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:06.536483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12bc4388-c646-4f11-8fd5-4bc5a041729c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:06.537239 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12bc4388-c646-4f11-8fd5-4bc5a041729c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:06.538776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12bc4388-c646-4f11-8fd5-4bc5a041729c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:06.539342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12bc4388-c646-4f11-8fd5-4bc5a041729c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:06.539776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-12bc4388-c646-4f11-8fd5-4bc5a041729c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:06.622882 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-12bc4388-c646-4f11-8fd5-4bc5a041729c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "PUT /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1074 microversion: 2.1 time: 0.104359 Oct 29 03:26:06.624032 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3007/5789] 10.222.0.46 () {60 vars in 1256 bytes} [Sat Oct 29 03:26:06 2022] PUT /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1074 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:06.643581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9514a8b2-5d7f-4d30-9f85-417dc03a2a18 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:06.644693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9514a8b2-5d7f-4d30-9f85-417dc03a2a18 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:06.652152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9514a8b2-5d7f-4d30-9f85-417dc03a2a18 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:06.652802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9514a8b2-5d7f-4d30-9f85-417dc03a2a18 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:06.653355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9514a8b2-5d7f-4d30-9f85-417dc03a2a18 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:06.654313 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9514a8b2-5d7f-4d30-9f85-417dc03a2a18 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:06.654948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9514a8b2-5d7f-4d30-9f85-417dc03a2a18 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:06.655528 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9514a8b2-5d7f-4d30-9f85-417dc03a2a18 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:06.811226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9514a8b2-5d7f-4d30-9f85-417dc03a2a18 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:06.820378 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9514a8b2-5d7f-4d30-9f85-417dc03a2a18 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1500 microversion: 2.1 time: 0.181394 Oct 29 03:26:06.821277 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2783/5790] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:06 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1500 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:26:06.842857 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4f7ccc6f-d42f-462d-a94f-e1d730c20f06 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:06.843851 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4f7ccc6f-d42f-462d-a94f-e1d730c20f06 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:06.850374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f7ccc6f-d42f-462d-a94f-e1d730c20f06 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:06.850852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f7ccc6f-d42f-462d-a94f-e1d730c20f06 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:06.851283 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f7ccc6f-d42f-462d-a94f-e1d730c20f06 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:06.851979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f7ccc6f-d42f-462d-a94f-e1d730c20f06 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:06.852674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f7ccc6f-d42f-462d-a94f-e1d730c20f06 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:06.853258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f7ccc6f-d42f-462d-a94f-e1d730c20f06 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:07.055397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4f7ccc6f-d42f-462d-a94f-e1d730c20f06 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:07.066650 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4f7ccc6f-d42f-462d-a94f-e1d730c20f06 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1500 microversion: 2.1 time: 0.227900 Oct 29 03:26:07.073605 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3008/5791] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:06 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1500 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:07.088990 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8b3a01e8-78ec-4b20-9333-f49541003ed6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:07.095482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b3a01e8-78ec-4b20-9333-f49541003ed6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:07.096163 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b3a01e8-78ec-4b20-9333-f49541003ed6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:07.096647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b3a01e8-78ec-4b20-9333-f49541003ed6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:07.119585 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8b3a01e8-78ec-4b20-9333-f49541003ed6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Going to try to stop instance {{(pid=127125) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 03:26:07.176560 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8b3a01e8-78ec-4b20-9333-f49541003ed6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "POST /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b/action" status: 202 len: 0 microversion: 2.1 time: 0.091091 Oct 29 03:26:07.177338 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2784/5792] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:26:07 2022] POST /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:26:07.186215 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9c6edf44-19c8-410f-a56b-0116f2d5a724 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:07.187781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9c6edf44-19c8-410f-a56b-0116f2d5a724 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:07.196659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c6edf44-19c8-410f-a56b-0116f2d5a724 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:07.197604 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c6edf44-19c8-410f-a56b-0116f2d5a724 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:07.198167 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c6edf44-19c8-410f-a56b-0116f2d5a724 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:07.199884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c6edf44-19c8-410f-a56b-0116f2d5a724 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:07.200678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c6edf44-19c8-410f-a56b-0116f2d5a724 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:07.201267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9c6edf44-19c8-410f-a56b-0116f2d5a724 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:07.376998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9c6edf44-19c8-410f-a56b-0116f2d5a724 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:07.386778 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9c6edf44-19c8-410f-a56b-0116f2d5a724 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1510 microversion: 2.1 time: 0.205239 Oct 29 03:26:07.387660 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3009/5793] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:07 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1510 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:08.414048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-25c2e34f-f7d1-4348-a39d-f643fcfcff05 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:08.415764 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-25c2e34f-f7d1-4348-a39d-f643fcfcff05 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:08.430586 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-25c2e34f-f7d1-4348-a39d-f643fcfcff05 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:08.431618 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-25c2e34f-f7d1-4348-a39d-f643fcfcff05 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:08.432166 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-25c2e34f-f7d1-4348-a39d-f643fcfcff05 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:08.432923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-25c2e34f-f7d1-4348-a39d-f643fcfcff05 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:08.433348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-25c2e34f-f7d1-4348-a39d-f643fcfcff05 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:08.433770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-25c2e34f-f7d1-4348-a39d-f643fcfcff05 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:08.640232 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-25c2e34f-f7d1-4348-a39d-f643fcfcff05 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:08.659474 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-25c2e34f-f7d1-4348-a39d-f643fcfcff05 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1510 microversion: 2.1 time: 0.251157 Oct 29 03:26:08.660369 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2785/5794] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:08 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1510 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:08.905004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7e17f8f7-bfe8-404f-8788-61808563d799 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:08.905684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7e17f8f7-bfe8-404f-8788-61808563d799 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:08.912382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e17f8f7-bfe8-404f-8788-61808563d799 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:08.912900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e17f8f7-bfe8-404f-8788-61808563d799 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:08.913371 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e17f8f7-bfe8-404f-8788-61808563d799 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:08.914140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e17f8f7-bfe8-404f-8788-61808563d799 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:08.914522 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e17f8f7-bfe8-404f-8788-61808563d799 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:08.914949 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e17f8f7-bfe8-404f-8788-61808563d799 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:09.107545 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7e17f8f7-bfe8-404f-8788-61808563d799 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:09.117031 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7e17f8f7-bfe8-404f-8788-61808563d799 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d" status: 200 len: 1681 microversion: 2.1 time: 0.216311 Oct 29 03:26:09.120573 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3010/5795] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:08 2022] GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d => generated 1681 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:26:09.234559 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5985fde5-61a5-4e6a-b888-5a1b537ae002 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:09.236859 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5985fde5-61a5-4e6a-b888-5a1b537ae002 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:09.240305 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=50 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:09.244630 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5985fde5-61a5-4e6a-b888-5a1b537ae002 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:09.245478 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5985fde5-61a5-4e6a-b888-5a1b537ae002 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:09.245941 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5985fde5-61a5-4e6a-b888-5a1b537ae002 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:09.246651 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5985fde5-61a5-4e6a-b888-5a1b537ae002 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:09.247262 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5985fde5-61a5-4e6a-b888-5a1b537ae002 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:09.247968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5985fde5-61a5-4e6a-b888-5a1b537ae002 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:09.306825 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5985fde5-61a5-4e6a-b888-5a1b537ae002 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "POST /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d/action" status: 200 len: 32638 microversion: 2.1 time: 0.076552 Oct 29 03:26:09.314053 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2786/5796] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:26:09 2022] POST /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d/action => generated 32638 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:26:09.489941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1b54d57c-1f1b-42de-98b8-6198fad0d116 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:09.490797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1b54d57c-1f1b-42de-98b8-6198fad0d116 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:09.502145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b54d57c-1f1b-42de-98b8-6198fad0d116 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:09.502845 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b54d57c-1f1b-42de-98b8-6198fad0d116 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:09.503454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b54d57c-1f1b-42de-98b8-6198fad0d116 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:09.504838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b54d57c-1f1b-42de-98b8-6198fad0d116 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:09.505981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b54d57c-1f1b-42de-98b8-6198fad0d116 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:09.506598 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b54d57c-1f1b-42de-98b8-6198fad0d116 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:09.534052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:09.684788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ec2f2884-791a-42fc-b1a0-f0679a5c5d6c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:09.685701 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ec2f2884-791a-42fc-b1a0-f0679a5c5d6c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:09.708958 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1b54d57c-1f1b-42de-98b8-6198fad0d116 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d" status: 200 len: 1832 microversion: 2.1 time: 0.223738 Oct 29 03:26:09.708958 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3011/5797] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:09 2022] GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d => generated 1832 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:09.711586 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec2f2884-791a-42fc-b1a0-f0679a5c5d6c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:09.712052 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec2f2884-791a-42fc-b1a0-f0679a5c5d6c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:09.713689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec2f2884-791a-42fc-b1a0-f0679a5c5d6c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:09.714440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec2f2884-791a-42fc-b1a0-f0679a5c5d6c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:09.714902 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec2f2884-791a-42fc-b1a0-f0679a5c5d6c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:09.715331 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec2f2884-791a-42fc-b1a0-f0679a5c5d6c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:09.741114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2794826a-78de-46ca-bd80-f13500720c2b tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:09.743918 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2794826a-78de-46ca-bd80-f13500720c2b tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:09.752388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2794826a-78de-46ca-bd80-f13500720c2b tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:09.753005 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2794826a-78de-46ca-bd80-f13500720c2b tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:09.753517 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2794826a-78de-46ca-bd80-f13500720c2b tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:09.754300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2794826a-78de-46ca-bd80-f13500720c2b tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:09.754823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2794826a-78de-46ca-bd80-f13500720c2b tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:09.755312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2794826a-78de-46ca-bd80-f13500720c2b tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:09.786191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-2794826a-78de-46ca-bd80-f13500720c2b tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lazy-loading 'flavor' on Instance uuid b02e08ec-9966-4d79-9c25-ce3f1822e38d {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:26:09.799719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2794826a-78de-46ca-bd80-f13500720c2b tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Going to try to live migrate instance to another host {{(pid=127124) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 29 03:26:09.907897 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ec2f2884-791a-42fc-b1a0-f0679a5c5d6c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:09.916268 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ec2f2884-791a-42fc-b1a0-f0679a5c5d6c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1510 microversion: 2.1 time: 0.237025 Oct 29 03:26:09.917104 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2787/5798] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:09 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1510 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:26:10.634784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-58021745-a110-43dd-9703-b4b7d4aee63d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1455847704", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "e661a52f-25d6-4fc8-9c8f-6d9409eee998"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:10.702743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-58021745-a110-43dd-9703-b4b7d4aee63d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] validate_networks() for [('e661a52f-25d6-4fc8-9c8f-6d9409eee998', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:26:11.150966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-58021745-a110-43dd-9703-b4b7d4aee63d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:26:11.151388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-58021745-a110-43dd-9703-b4b7d4aee63d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:26:11.151854 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-58021745-a110-43dd-9703-b4b7d4aee63d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:26:11.152257 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-58021745-a110-43dd-9703-b4b7d4aee63d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:26:11.152691 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-58021745-a110-43dd-9703-b4b7d4aee63d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:26:11.162192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58021745-a110-43dd-9703-b4b7d4aee63d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:11.162670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58021745-a110-43dd-9703-b4b7d4aee63d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:11.163096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58021745-a110-43dd-9703-b4b7d4aee63d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:11.163809 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58021745-a110-43dd-9703-b4b7d4aee63d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:11.164788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58021745-a110-43dd-9703-b4b7d4aee63d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:11.165383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-58021745-a110-43dd-9703-b4b7d4aee63d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:11.186053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-58021745-a110-43dd-9703-b4b7d4aee63d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Getting quotas for project 5fa34bf618bf4e2e94d55b9b1fff3003. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:26:11.199721 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-58021745-a110-43dd-9703-b4b7d4aee63d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Getting quotas for user 9f7fb41c95104b4bb9ad66ba2457f994 and project 5fa34bf618bf4e2e94d55b9b1fff3003. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:26:11.213832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-58021745-a110-43dd-9703-b4b7d4aee63d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:26:11.216132 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-58021745-a110-43dd-9703-b4b7d4aee63d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:26:11.274528 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-58021745-a110-43dd-9703-b4b7d4aee63d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643794 Oct 29 03:26:11.281461 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2788/5799] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:26:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 03:26:11.281461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6ed67ab3-06f2-4d59-9477-3120e29620dd tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:11.281461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6ed67ab3-06f2-4d59-9477-3120e29620dd tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:11.295813 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ed67ab3-06f2-4d59-9477-3120e29620dd tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:11.296313 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ed67ab3-06f2-4d59-9477-3120e29620dd tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:11.296783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ed67ab3-06f2-4d59-9477-3120e29620dd tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:11.298074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ed67ab3-06f2-4d59-9477-3120e29620dd tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:11.298538 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ed67ab3-06f2-4d59-9477-3120e29620dd tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:11.299038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ed67ab3-06f2-4d59-9477-3120e29620dd tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:11.431282 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2794826a-78de-46ca-bd80-f13500720c2b tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d/action" status: 202 len: 0 microversion: 2.1 time: 1.692790 Oct 29 03:26:11.432050 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3012/5800] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:26:09 2022] POST /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d/action => generated 0 bytes in 1696 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:26:11.437333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-59977ad0-7462-4c4a-a7fd-03b4dcae1e22 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:11.438233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-59977ad0-7462-4c4a-a7fd-03b4dcae1e22 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:11.493609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6ed67ab3-06f2-4d59-9477-3120e29620dd tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:11.504566 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6ed67ab3-06f2-4d59-9477-3120e29620dd tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1510 microversion: 2.1 time: 0.228107 Oct 29 03:26:11.512023 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2789/5801] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:11 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1510 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:11.514187 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-59977ad0-7462-4c4a-a7fd-03b4dcae1e22 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7fb41c95104b4bb9ad66ba2457f994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa34bf618bf4e2e94d55b9b1fff3003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:11.517061 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-759f0093-21fc-4a64-b5e3-bbab75d4ad65 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:11.517754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-759f0093-21fc-4a64-b5e3-bbab75d4ad65 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:11.525629 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-59977ad0-7462-4c4a-a7fd-03b4dcae1e22 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "GET /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd" status: 200 len: 1214 microversion: 2.1 time: 0.091999 Oct 29 03:26:11.526676 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3013/5802] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:11 2022] GET /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:11.544118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-759f0093-21fc-4a64-b5e3-bbab75d4ad65 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:11.544878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-759f0093-21fc-4a64-b5e3-bbab75d4ad65 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:11.545506 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-759f0093-21fc-4a64-b5e3-bbab75d4ad65 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:11.547129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-759f0093-21fc-4a64-b5e3-bbab75d4ad65 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:11.547782 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-759f0093-21fc-4a64-b5e3-bbab75d4ad65 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:11.548422 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-759f0093-21fc-4a64-b5e3-bbab75d4ad65 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:11.693186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-759f0093-21fc-4a64-b5e3-bbab75d4ad65 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:11.703283 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-759f0093-21fc-4a64-b5e3-bbab75d4ad65 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d" status: 200 len: 1691 microversion: 2.1 time: 0.190005 Oct 29 03:26:11.713092 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2790/5803] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:11 2022] GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d => generated 1691 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:12.529038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d378ccd5-4b1d-4f4c-92f2-5d2249c77da2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:12.540865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d378ccd5-4b1d-4f4c-92f2-5d2249c77da2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:12.549756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d378ccd5-4b1d-4f4c-92f2-5d2249c77da2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:12.550504 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1889903b-2aff-4742-a12b-71b48098db79 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:12.550682 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d378ccd5-4b1d-4f4c-92f2-5d2249c77da2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:12.551454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1889903b-2aff-4742-a12b-71b48098db79 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:12.552003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d378ccd5-4b1d-4f4c-92f2-5d2249c77da2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:12.552832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d378ccd5-4b1d-4f4c-92f2-5d2249c77da2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:12.555728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d378ccd5-4b1d-4f4c-92f2-5d2249c77da2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:12.556297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d378ccd5-4b1d-4f4c-92f2-5d2249c77da2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:12.559552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1889903b-2aff-4742-a12b-71b48098db79 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:12.560263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1889903b-2aff-4742-a12b-71b48098db79 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:12.560890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1889903b-2aff-4742-a12b-71b48098db79 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:12.561912 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1889903b-2aff-4742-a12b-71b48098db79 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:12.562535 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1889903b-2aff-4742-a12b-71b48098db79 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:12.563122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1889903b-2aff-4742-a12b-71b48098db79 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:12.641017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1889903b-2aff-4742-a12b-71b48098db79 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7fb41c95104b4bb9ad66ba2457f994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa34bf618bf4e2e94d55b9b1fff3003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:12.651409 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1889903b-2aff-4742-a12b-71b48098db79 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "GET /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd" status: 200 len: 1266 microversion: 2.1 time: 0.104526 Oct 29 03:26:12.652035 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2791/5804] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:12 2022] GET /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd => generated 1266 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:26:12.728808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cee4bd4f-0b7a-40de-9f80-468277b779bf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:12.730442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cee4bd4f-0b7a-40de-9f80-468277b779bf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:12.738033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cee4bd4f-0b7a-40de-9f80-468277b779bf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:12.738966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cee4bd4f-0b7a-40de-9f80-468277b779bf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:12.739628 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cee4bd4f-0b7a-40de-9f80-468277b779bf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:12.740695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cee4bd4f-0b7a-40de-9f80-468277b779bf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:12.742032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cee4bd4f-0b7a-40de-9f80-468277b779bf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:12.742758 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cee4bd4f-0b7a-40de-9f80-468277b779bf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:13.021149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cee4bd4f-0b7a-40de-9f80-468277b779bf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:13.037594 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cee4bd4f-0b7a-40de-9f80-468277b779bf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d" status: 200 len: 1691 microversion: 2.1 time: 0.313989 Oct 29 03:26:13.039144 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2792/5805] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:12 2022] GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d => generated 1691 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:26:13.104398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d378ccd5-4b1d-4f4c-92f2-5d2249c77da2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:13.116374 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d378ccd5-4b1d-4f4c-92f2-5d2249c77da2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1510 microversion: 2.1 time: 0.591567 Oct 29 03:26:13.134746 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3014/5806] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:12 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1510 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:13.199292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-417d8a47-dea8-432c-9954-c1aea23ba575 req-839ba07f-f25b-4388-bcb2-f91da0de1e7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b02e08ec-9966-4d79-9c25-ce3f1822e38d", "name": "network-vif-unplugged", "status": "completed", "tag": "1032b4cc-e4e3-4992-8f76-9e8bc7f25df6"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:13.213823 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-417d8a47-dea8-432c-9954-c1aea23ba575 req-839ba07f-f25b-4388-bcb2-f91da0de1e7d service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:13.215093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-417d8a47-dea8-432c-9954-c1aea23ba575 req-839ba07f-f25b-4388-bcb2-f91da0de1e7d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:13.215860 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-417d8a47-dea8-432c-9954-c1aea23ba575 req-839ba07f-f25b-4388-bcb2-f91da0de1e7d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:13.246233 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-417d8a47-dea8-432c-9954-c1aea23ba575 req-839ba07f-f25b-4388-bcb2-f91da0de1e7d service nova] Creating event network-vif-unplugged:1032b4cc-e4e3-4992-8f76-9e8bc7f25df6 for instance b02e08ec-9966-4d79-9c25-ce3f1822e38d on n-h1-862967-2 Oct 29 03:26:13.259229 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-417d8a47-dea8-432c-9954-c1aea23ba575 req-839ba07f-f25b-4388-bcb2-f91da0de1e7d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064176 Oct 29 03:26:13.262087 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2793/5807] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:26:13.675525 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9918fcd8-c2a8-43c6-bbf5-201db265ce87 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:13.676148 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9918fcd8-c2a8-43c6-bbf5-201db265ce87 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:13.679200 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:13.700830 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9918fcd8-c2a8-43c6-bbf5-201db265ce87 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:13.705003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9918fcd8-c2a8-43c6-bbf5-201db265ce87 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:13.705796 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9918fcd8-c2a8-43c6-bbf5-201db265ce87 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:13.706732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9918fcd8-c2a8-43c6-bbf5-201db265ce87 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:13.708169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9918fcd8-c2a8-43c6-bbf5-201db265ce87 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:13.710066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9918fcd8-c2a8-43c6-bbf5-201db265ce87 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:13.900456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9918fcd8-c2a8-43c6-bbf5-201db265ce87 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7fb41c95104b4bb9ad66ba2457f994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa34bf618bf4e2e94d55b9b1fff3003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:13.909294 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9918fcd8-c2a8-43c6-bbf5-201db265ce87 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "GET /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd" status: 200 len: 1314 microversion: 2.1 time: 0.237651 Oct 29 03:26:13.910942 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3015/5808] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:13 2022] GET /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:14.062133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7308b1f4-47a3-4cb1-a4fc-4c78253d38bc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:14.063522 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7308b1f4-47a3-4cb1-a4fc-4c78253d38bc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:14.078794 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7308b1f4-47a3-4cb1-a4fc-4c78253d38bc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:14.079893 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7308b1f4-47a3-4cb1-a4fc-4c78253d38bc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:14.082513 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7308b1f4-47a3-4cb1-a4fc-4c78253d38bc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:14.083645 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7308b1f4-47a3-4cb1-a4fc-4c78253d38bc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:14.084316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7308b1f4-47a3-4cb1-a4fc-4c78253d38bc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:14.085684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7308b1f4-47a3-4cb1-a4fc-4c78253d38bc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:14.140995 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a60735c3-bbdb-4f35-a273-d541b7530191 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:14.141929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a60735c3-bbdb-4f35-a273-d541b7530191 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:14.148361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a60735c3-bbdb-4f35-a273-d541b7530191 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:14.148893 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a60735c3-bbdb-4f35-a273-d541b7530191 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:14.149331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a60735c3-bbdb-4f35-a273-d541b7530191 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:14.150601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a60735c3-bbdb-4f35-a273-d541b7530191 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:14.151318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a60735c3-bbdb-4f35-a273-d541b7530191 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:14.151901 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a60735c3-bbdb-4f35-a273-d541b7530191 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:14.292324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a60735c3-bbdb-4f35-a273-d541b7530191 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:14.303441 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a60735c3-bbdb-4f35-a273-d541b7530191 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1510 microversion: 2.1 time: 0.166396 Oct 29 03:26:14.319247 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3016/5809] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:14 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:26:14.322841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7308b1f4-47a3-4cb1-a4fc-4c78253d38bc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:14.332661 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7308b1f4-47a3-4cb1-a4fc-4c78253d38bc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d" status: 200 len: 1691 microversion: 2.1 time: 0.274971 Oct 29 03:26:14.333499 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2794/5810] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:14 2022] GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d => generated 1691 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:14.422081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-c149e87b-2136-4d60-beed-65deac407854 req-326b7e0f-b397-4ffd-a727-a05a98e0ad89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd", "tag": "de33895e-e250-4142-af94-98dd37bcc70b"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:14.440539 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c149e87b-2136-4d60-beed-65deac407854 req-326b7e0f-b397-4ffd-a727-a05a98e0ad89 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:14.441180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c149e87b-2136-4d60-beed-65deac407854 req-326b7e0f-b397-4ffd-a727-a05a98e0ad89 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:14.442106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c149e87b-2136-4d60-beed-65deac407854 req-326b7e0f-b397-4ffd-a727-a05a98e0ad89 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:14.454530 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-c149e87b-2136-4d60-beed-65deac407854 req-326b7e0f-b397-4ffd-a727-a05a98e0ad89 service nova] Creating event network-changed:de33895e-e250-4142-af94-98dd37bcc70b for instance 1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd on n-h1-862967-2 Oct 29 03:26:14.460814 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-c149e87b-2136-4d60-beed-65deac407854 req-326b7e0f-b397-4ffd-a727-a05a98e0ad89 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047823 Oct 29 03:26:14.461754 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3017/5811] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:26:14.932946 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4bdbcc2e-d06a-401d-9673-c7100eef4b46 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:14.933473 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4bdbcc2e-d06a-401d-9673-c7100eef4b46 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:14.940206 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bdbcc2e-d06a-401d-9673-c7100eef4b46 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:14.940776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bdbcc2e-d06a-401d-9673-c7100eef4b46 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:14.941218 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bdbcc2e-d06a-401d-9673-c7100eef4b46 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:14.941932 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bdbcc2e-d06a-401d-9673-c7100eef4b46 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:14.942391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bdbcc2e-d06a-401d-9673-c7100eef4b46 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:14.942824 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bdbcc2e-d06a-401d-9673-c7100eef4b46 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:15.082837 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4bdbcc2e-d06a-401d-9673-c7100eef4b46 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7fb41c95104b4bb9ad66ba2457f994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa34bf618bf4e2e94d55b9b1fff3003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:15.091859 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4bdbcc2e-d06a-401d-9673-c7100eef4b46 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "GET /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd" status: 200 len: 1314 microversion: 2.1 time: 0.162966 Oct 29 03:26:15.092463 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2795/5812] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:14 2022] GET /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:15.291432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-949ce2be-da74-4e2b-afad-fc1bb92ae521 req-4e58444f-a562-4e69-8754-b69768051d43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b02e08ec-9966-4d79-9c25-ce3f1822e38d", "tag": "1032b4cc-e4e3-4992-8f76-9e8bc7f25df6"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:15.306882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-949ce2be-da74-4e2b-afad-fc1bb92ae521 req-4e58444f-a562-4e69-8754-b69768051d43 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:15.307710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-949ce2be-da74-4e2b-afad-fc1bb92ae521 req-4e58444f-a562-4e69-8754-b69768051d43 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:15.308329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-949ce2be-da74-4e2b-afad-fc1bb92ae521 req-4e58444f-a562-4e69-8754-b69768051d43 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:15.321660 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-949ce2be-da74-4e2b-afad-fc1bb92ae521 req-4e58444f-a562-4e69-8754-b69768051d43 service nova] Creating event network-changed:1032b4cc-e4e3-4992-8f76-9e8bc7f25df6 for instance b02e08ec-9966-4d79-9c25-ce3f1822e38d on n-h1-862967-2 Oct 29 03:26:15.327243 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-949ce2be-da74-4e2b-afad-fc1bb92ae521 req-4e58444f-a562-4e69-8754-b69768051d43 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040277 Oct 29 03:26:15.327509 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9ad88c8d-f01d-43f3-83ac-fdb9b98414bd tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:15.328137 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9ad88c8d-f01d-43f3-83ac-fdb9b98414bd tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:15.328257 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3018/5813] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:26:15.338289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ad88c8d-f01d-43f3-83ac-fdb9b98414bd tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:15.339021 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ad88c8d-f01d-43f3-83ac-fdb9b98414bd tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:15.339483 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ad88c8d-f01d-43f3-83ac-fdb9b98414bd tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:15.340191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ad88c8d-f01d-43f3-83ac-fdb9b98414bd tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:15.340664 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ad88c8d-f01d-43f3-83ac-fdb9b98414bd tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:15.341087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ad88c8d-f01d-43f3-83ac-fdb9b98414bd tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:15.356021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e0e8cba4-d9d2-4a20-a1ea-351f50d835c0 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:15.356768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e0e8cba4-d9d2-4a20-a1ea-351f50d835c0 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:15.375509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e0e8cba4-d9d2-4a20-a1ea-351f50d835c0 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:15.375509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e0e8cba4-d9d2-4a20-a1ea-351f50d835c0 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:15.377680 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e0e8cba4-d9d2-4a20-a1ea-351f50d835c0 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:15.379092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e0e8cba4-d9d2-4a20-a1ea-351f50d835c0 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:15.380236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e0e8cba4-d9d2-4a20-a1ea-351f50d835c0 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:15.380901 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e0e8cba4-d9d2-4a20-a1ea-351f50d835c0 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:15.520213 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9ad88c8d-f01d-43f3-83ac-fdb9b98414bd tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:15.531903 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9ad88c8d-f01d-43f3-83ac-fdb9b98414bd tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1510 microversion: 2.1 time: 0.208132 Oct 29 03:26:15.532445 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2796/5814] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:15 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1510 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:26:15.598364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e0e8cba4-d9d2-4a20-a1ea-351f50d835c0 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:15.609687 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e0e8cba4-d9d2-4a20-a1ea-351f50d835c0 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d" status: 200 len: 1691 microversion: 2.1 time: 0.257849 Oct 29 03:26:15.610922 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3019/5815] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:15 2022] GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d => generated 1691 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:26:16.115277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-13afc1c0-5a5d-4466-aa9e-7f7e4617beda tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:16.115936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-13afc1c0-5a5d-4466-aa9e-7f7e4617beda tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:16.128074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-13afc1c0-5a5d-4466-aa9e-7f7e4617beda tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:16.128603 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-13afc1c0-5a5d-4466-aa9e-7f7e4617beda tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:16.129049 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-13afc1c0-5a5d-4466-aa9e-7f7e4617beda tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:16.129773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-13afc1c0-5a5d-4466-aa9e-7f7e4617beda tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:16.130245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-13afc1c0-5a5d-4466-aa9e-7f7e4617beda tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:16.130661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-13afc1c0-5a5d-4466-aa9e-7f7e4617beda tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:16.555397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-14201b3b-49da-4c4e-869d-7557cc9fa988 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:16.556041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-14201b3b-49da-4c4e-869d-7557cc9fa988 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:16.563426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14201b3b-49da-4c4e-869d-7557cc9fa988 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:16.564620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14201b3b-49da-4c4e-869d-7557cc9fa988 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:16.565802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14201b3b-49da-4c4e-869d-7557cc9fa988 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:16.567072 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14201b3b-49da-4c4e-869d-7557cc9fa988 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:16.567738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14201b3b-49da-4c4e-869d-7557cc9fa988 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:16.568371 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14201b3b-49da-4c4e-869d-7557cc9fa988 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:16.689518 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-13afc1c0-5a5d-4466-aa9e-7f7e4617beda tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7fb41c95104b4bb9ad66ba2457f994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa34bf618bf4e2e94d55b9b1fff3003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:16.700013 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-13afc1c0-5a5d-4466-aa9e-7f7e4617beda tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "GET /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd" status: 200 len: 1314 microversion: 2.1 time: 0.588472 Oct 29 03:26:16.701490 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2797/5816] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:16 2022] GET /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd => generated 1314 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:16.708141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-395109a7-8415-4f8e-afa5-9ce417a9b615 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:16.710060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-395109a7-8415-4f8e-afa5-9ce417a9b615 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:16.720859 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-395109a7-8415-4f8e-afa5-9ce417a9b615 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:16.722343 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-395109a7-8415-4f8e-afa5-9ce417a9b615 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:16.723084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-395109a7-8415-4f8e-afa5-9ce417a9b615 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:16.724426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-395109a7-8415-4f8e-afa5-9ce417a9b615 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:16.725884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-395109a7-8415-4f8e-afa5-9ce417a9b615 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:16.726642 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-395109a7-8415-4f8e-afa5-9ce417a9b615 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:16.738747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-14201b3b-49da-4c4e-869d-7557cc9fa988 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:16.747856 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-14201b3b-49da-4c4e-869d-7557cc9fa988 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1510 microversion: 2.1 time: 0.196405 Oct 29 03:26:16.749505 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3020/5817] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:16 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1510 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:17.030772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-395109a7-8415-4f8e-afa5-9ce417a9b615 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:17.040910 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-395109a7-8415-4f8e-afa5-9ce417a9b615 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d" status: 200 len: 1691 microversion: 2.1 time: 0.337923 Oct 29 03:26:17.041710 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2798/5818] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:16 2022] GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d => generated 1691 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:17.728492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-149495a0-dff7-4d22-a8db-075e05cae10c tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:17.729310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-149495a0-dff7-4d22-a8db-075e05cae10c tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:17.736032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-149495a0-dff7-4d22-a8db-075e05cae10c tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:17.736634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-149495a0-dff7-4d22-a8db-075e05cae10c tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:17.737080 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-149495a0-dff7-4d22-a8db-075e05cae10c tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:17.738417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-149495a0-dff7-4d22-a8db-075e05cae10c tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:17.738862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-149495a0-dff7-4d22-a8db-075e05cae10c tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:17.739562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-149495a0-dff7-4d22-a8db-075e05cae10c tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:17.772078 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8d354c02-ecad-4574-a11f-98aa59ffc374 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:17.772733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8d354c02-ecad-4574-a11f-98aa59ffc374 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:17.779919 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d354c02-ecad-4574-a11f-98aa59ffc374 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:17.780710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d354c02-ecad-4574-a11f-98aa59ffc374 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:17.781296 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d354c02-ecad-4574-a11f-98aa59ffc374 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:17.782302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d354c02-ecad-4574-a11f-98aa59ffc374 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:17.782812 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d354c02-ecad-4574-a11f-98aa59ffc374 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:17.783257 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d354c02-ecad-4574-a11f-98aa59ffc374 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:17.887056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-149495a0-dff7-4d22-a8db-075e05cae10c tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7fb41c95104b4bb9ad66ba2457f994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa34bf618bf4e2e94d55b9b1fff3003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:17.895925 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-149495a0-dff7-4d22-a8db-075e05cae10c tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "GET /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd" status: 200 len: 1314 microversion: 2.1 time: 0.172549 Oct 29 03:26:17.896892 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3021/5819] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:17 2022] GET /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:17.944181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8d354c02-ecad-4574-a11f-98aa59ffc374 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:17.947799 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:17.952886 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8d354c02-ecad-4574-a11f-98aa59ffc374 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1510 microversion: 2.1 time: 0.185449 Oct 29 03:26:17.953653 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2799/5820] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:17 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1510 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:26:18.067593 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cc845c7e-4665-4ade-b98b-29e53e6bc5bf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:18.068217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cc845c7e-4665-4ade-b98b-29e53e6bc5bf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:18.075204 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc845c7e-4665-4ade-b98b-29e53e6bc5bf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:18.075759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc845c7e-4665-4ade-b98b-29e53e6bc5bf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:18.076263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc845c7e-4665-4ade-b98b-29e53e6bc5bf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:18.077063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc845c7e-4665-4ade-b98b-29e53e6bc5bf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:18.077519 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc845c7e-4665-4ade-b98b-29e53e6bc5bf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:18.077949 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc845c7e-4665-4ade-b98b-29e53e6bc5bf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:18.217575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cc845c7e-4665-4ade-b98b-29e53e6bc5bf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:18.225959 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cc845c7e-4665-4ade-b98b-29e53e6bc5bf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d" status: 200 len: 1691 microversion: 2.1 time: 0.163063 Oct 29 03:26:18.226585 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3022/5821] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:18 2022] GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:18.919680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e151bd32-299a-4719-be0b-0eeef488303f tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:18.920277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e151bd32-299a-4719-be0b-0eeef488303f tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:18.928037 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e151bd32-299a-4719-be0b-0eeef488303f tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:18.928680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e151bd32-299a-4719-be0b-0eeef488303f tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:18.929018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e151bd32-299a-4719-be0b-0eeef488303f tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:18.929725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e151bd32-299a-4719-be0b-0eeef488303f tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:18.930179 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e151bd32-299a-4719-be0b-0eeef488303f tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:18.930611 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e151bd32-299a-4719-be0b-0eeef488303f tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:18.975357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7b438ccd-6a1c-41cb-be8d-c5465f34df88 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:18.976587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7b438ccd-6a1c-41cb-be8d-c5465f34df88 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:18.984285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b438ccd-6a1c-41cb-be8d-c5465f34df88 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:18.984797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b438ccd-6a1c-41cb-be8d-c5465f34df88 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:18.985230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b438ccd-6a1c-41cb-be8d-c5465f34df88 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:18.985942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b438ccd-6a1c-41cb-be8d-c5465f34df88 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:18.986509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b438ccd-6a1c-41cb-be8d-c5465f34df88 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:18.986997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b438ccd-6a1c-41cb-be8d-c5465f34df88 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:19.128786 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7b438ccd-6a1c-41cb-be8d-c5465f34df88 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:19.137687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e151bd32-299a-4719-be0b-0eeef488303f tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7fb41c95104b4bb9ad66ba2457f994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa34bf618bf4e2e94d55b9b1fff3003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:19.138554 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7b438ccd-6a1c-41cb-be8d-c5465f34df88 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1510 microversion: 2.1 time: 0.166878 Oct 29 03:26:19.149093 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e151bd32-299a-4719-be0b-0eeef488303f tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "GET /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd" status: 200 len: 1314 microversion: 2.1 time: 0.233382 Oct 29 03:26:19.150028 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2800/5822] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:18 2022] GET /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:19.153311 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3023/5823] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:18 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1510 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:26:19.249940 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-816fa527-1f8f-40af-9572-4e8b2f71e5e0 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:19.250597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-816fa527-1f8f-40af-9572-4e8b2f71e5e0 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:19.256897 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-816fa527-1f8f-40af-9572-4e8b2f71e5e0 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:19.257389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-816fa527-1f8f-40af-9572-4e8b2f71e5e0 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:19.257827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-816fa527-1f8f-40af-9572-4e8b2f71e5e0 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:19.258573 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-816fa527-1f8f-40af-9572-4e8b2f71e5e0 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:19.259019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-816fa527-1f8f-40af-9572-4e8b2f71e5e0 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:19.259445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-816fa527-1f8f-40af-9572-4e8b2f71e5e0 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:19.464354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-816fa527-1f8f-40af-9572-4e8b2f71e5e0 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:19.472551 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-816fa527-1f8f-40af-9572-4e8b2f71e5e0 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d" status: 200 len: 1691 microversion: 2.1 time: 0.226586 Oct 29 03:26:19.473376 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2801/5824] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:19 2022] GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d => generated 1691 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:19.754011 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b8c57f7c-ca3a-4f41-ac09-6b76dab78ac0 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1635749203", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "945ce153-6775-49f3-9333-b05acb98af07"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:19.813405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-b8c57f7c-ca3a-4f41-ac09-6b76dab78ac0 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] validate_networks() for [('945ce153-6775-49f3-9333-b05acb98af07', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:26:20.163248 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-034ea4ac-0929-4c07-8334-2d4d1d674c58 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:20.163862 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-034ea4ac-0929-4c07-8334-2d4d1d674c58 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:20.171110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-034ea4ac-0929-4c07-8334-2d4d1d674c58 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:20.172326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-034ea4ac-0929-4c07-8334-2d4d1d674c58 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:20.172808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-034ea4ac-0929-4c07-8334-2d4d1d674c58 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:20.173516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-034ea4ac-0929-4c07-8334-2d4d1d674c58 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:20.173966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-034ea4ac-0929-4c07-8334-2d4d1d674c58 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:20.174389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-034ea4ac-0929-4c07-8334-2d4d1d674c58 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:20.308057 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-034ea4ac-0929-4c07-8334-2d4d1d674c58 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:20.316191 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-034ea4ac-0929-4c07-8334-2d4d1d674c58 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1510 microversion: 2.1 time: 0.157352 Oct 29 03:26:20.316784 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2802/5825] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:20 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:26:20.321266 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ea2ae6d3-8ce3-4a52-a63c-9a565959ea90 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:20.321886 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ea2ae6d3-8ce3-4a52-a63c-9a565959ea90 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:20.328237 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea2ae6d3-8ce3-4a52-a63c-9a565959ea90 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:20.328756 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea2ae6d3-8ce3-4a52-a63c-9a565959ea90 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:20.329198 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea2ae6d3-8ce3-4a52-a63c-9a565959ea90 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:20.329868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea2ae6d3-8ce3-4a52-a63c-9a565959ea90 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:20.330476 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea2ae6d3-8ce3-4a52-a63c-9a565959ea90 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:20.331043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea2ae6d3-8ce3-4a52-a63c-9a565959ea90 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:20.426963 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-b8c57f7c-ca3a-4f41-ac09-6b76dab78ac0 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:26:20.427694 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-b8c57f7c-ca3a-4f41-ac09-6b76dab78ac0 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:26:20.428281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-b8c57f7c-ca3a-4f41-ac09-6b76dab78ac0 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:26:20.428820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-b8c57f7c-ca3a-4f41-ac09-6b76dab78ac0 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:26:20.429450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-b8c57f7c-ca3a-4f41-ac09-6b76dab78ac0 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:26:20.439333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b8c57f7c-ca3a-4f41-ac09-6b76dab78ac0 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:20.439911 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b8c57f7c-ca3a-4f41-ac09-6b76dab78ac0 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:20.440541 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b8c57f7c-ca3a-4f41-ac09-6b76dab78ac0 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:20.441613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b8c57f7c-ca3a-4f41-ac09-6b76dab78ac0 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:20.442380 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b8c57f7c-ca3a-4f41-ac09-6b76dab78ac0 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:20.442960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b8c57f7c-ca3a-4f41-ac09-6b76dab78ac0 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:20.460691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-b8c57f7c-ca3a-4f41-ac09-6b76dab78ac0 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Getting quotas for project 6e202cdaad65452fa00963abd83004b9. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:26:20.466139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-b8c57f7c-ca3a-4f41-ac09-6b76dab78ac0 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Getting quotas for user 9c633d65d3754c0bb47a7cb8754a97cd and project 6e202cdaad65452fa00963abd83004b9. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:26:20.473003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ea2ae6d3-8ce3-4a52-a63c-9a565959ea90 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7fb41c95104b4bb9ad66ba2457f994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa34bf618bf4e2e94d55b9b1fff3003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:20.481462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b8c57f7c-ca3a-4f41-ac09-6b76dab78ac0 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:26:20.481737 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ea2ae6d3-8ce3-4a52-a63c-9a565959ea90 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "GET /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd" status: 200 len: 1314 microversion: 2.1 time: 0.163882 Oct 29 03:26:20.482417 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2803/5826] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:20 2022] GET /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:20.484162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b8c57f7c-ca3a-4f41-ac09-6b76dab78ac0 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: 09a0f147-9f3b-4180-a462-aebd0e6162ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:26:20.497602 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-32444fdd-c2e7-44a2-9a43-3ae9f2ed4499 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:20.498583 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-32444fdd-c2e7-44a2-9a43-3ae9f2ed4499 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:20.504939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32444fdd-c2e7-44a2-9a43-3ae9f2ed4499 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:20.505905 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32444fdd-c2e7-44a2-9a43-3ae9f2ed4499 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:20.506336 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32444fdd-c2e7-44a2-9a43-3ae9f2ed4499 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:20.507219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32444fdd-c2e7-44a2-9a43-3ae9f2ed4499 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:20.507699 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32444fdd-c2e7-44a2-9a43-3ae9f2ed4499 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:20.508162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32444fdd-c2e7-44a2-9a43-3ae9f2ed4499 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:20.535113 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b8c57f7c-ca3a-4f41-ac09-6b76dab78ac0 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.785066 Oct 29 03:26:20.535842 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3024/5827] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:26:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:26:20.547303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ec57e2aa-aa16-47ac-a5d9-fe30d2d3cf0b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:20.547928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ec57e2aa-aa16-47ac-a5d9-fe30d2d3cf0b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: 09a0f147-9f3b-4180-a462-aebd0e6162ac] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:20.638375 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ec57e2aa-aa16-47ac-a5d9-fe30d2d3cf0b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c633d65d3754c0bb47a7cb8754a97cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e202cdaad65452fa00963abd83004b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:20.648284 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ec57e2aa-aa16-47ac-a5d9-fe30d2d3cf0b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "GET /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac" status: 200 len: 1219 microversion: 2.1 time: 0.105132 Oct 29 03:26:20.648907 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3025/5828] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:20 2022] GET /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:26:20.660941 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-32444fdd-c2e7-44a2-9a43-3ae9f2ed4499 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:20.664423 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-32444fdd-c2e7-44a2-9a43-3ae9f2ed4499 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d" status: 200 len: 1691 microversion: 2.1 time: 0.171529 Oct 29 03:26:20.668871 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2804/5829] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:20 2022] GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d => generated 1691 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:20.855437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-3fca3bba-1f13-4454-b5e0-11471accc7c5 req-8760a6d8-ca23-47cb-a0a0-52cac1e69227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd", "name": "network-vif-plugged", "status": "completed", "tag": "de33895e-e250-4142-af94-98dd37bcc70b"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:20.866887 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3fca3bba-1f13-4454-b5e0-11471accc7c5 req-8760a6d8-ca23-47cb-a0a0-52cac1e69227 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:20.867883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3fca3bba-1f13-4454-b5e0-11471accc7c5 req-8760a6d8-ca23-47cb-a0a0-52cac1e69227 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:20.868390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3fca3bba-1f13-4454-b5e0-11471accc7c5 req-8760a6d8-ca23-47cb-a0a0-52cac1e69227 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:20.880408 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-3fca3bba-1f13-4454-b5e0-11471accc7c5 req-8760a6d8-ca23-47cb-a0a0-52cac1e69227 service nova] Creating event network-vif-plugged:de33895e-e250-4142-af94-98dd37bcc70b for instance 1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd on n-h1-862967-2 Oct 29 03:26:20.886192 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-3fca3bba-1f13-4454-b5e0-11471accc7c5 req-8760a6d8-ca23-47cb-a0a0-52cac1e69227 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034556 Oct 29 03:26:20.887174 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3026/5830] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:26:21.341169 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4bf5bbe2-d428-4009-ab34-c72cf1e6b723 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:21.341798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4bf5bbe2-d428-4009-ab34-c72cf1e6b723 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:21.344799 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:21.345599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:21.352921 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bf5bbe2-d428-4009-ab34-c72cf1e6b723 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:21.353403 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bf5bbe2-d428-4009-ab34-c72cf1e6b723 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:21.353841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bf5bbe2-d428-4009-ab34-c72cf1e6b723 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:21.354593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bf5bbe2-d428-4009-ab34-c72cf1e6b723 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:21.355031 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bf5bbe2-d428-4009-ab34-c72cf1e6b723 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:21.355449 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bf5bbe2-d428-4009-ab34-c72cf1e6b723 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:21.497344 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4bf5bbe2-d428-4009-ab34-c72cf1e6b723 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:21.505877 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4bf5bbe2-d428-4009-ab34-c72cf1e6b723 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1510 microversion: 2.1 time: 0.169775 Oct 29 03:26:21.506460 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1958fc08-18e6-4621-a16c-5a178d4b9501 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:21.506903 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2805/5831] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:21 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:21.507292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1958fc08-18e6-4621-a16c-5a178d4b9501 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:21.515516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1958fc08-18e6-4621-a16c-5a178d4b9501 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:21.516077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1958fc08-18e6-4621-a16c-5a178d4b9501 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:21.516540 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1958fc08-18e6-4621-a16c-5a178d4b9501 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:21.517242 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1958fc08-18e6-4621-a16c-5a178d4b9501 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:21.517698 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1958fc08-18e6-4621-a16c-5a178d4b9501 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:21.518123 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1958fc08-18e6-4621-a16c-5a178d4b9501 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:21.657590 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1958fc08-18e6-4621-a16c-5a178d4b9501 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7fb41c95104b4bb9ad66ba2457f994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa34bf618bf4e2e94d55b9b1fff3003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:21.666436 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1958fc08-18e6-4621-a16c-5a178d4b9501 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "GET /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd" status: 200 len: 1314 microversion: 2.1 time: 0.164850 Oct 29 03:26:21.667265 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3027/5832] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:21 2022] GET /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:21.671710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-912d062a-d96c-4cfe-b416-9cd0d3e9e651 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:21.672327 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-912d062a-d96c-4cfe-b416-9cd0d3e9e651 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: 09a0f147-9f3b-4180-a462-aebd0e6162ac] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:21.678551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-912d062a-d96c-4cfe-b416-9cd0d3e9e651 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:21.679028 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-912d062a-d96c-4cfe-b416-9cd0d3e9e651 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:21.679463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-912d062a-d96c-4cfe-b416-9cd0d3e9e651 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:21.680152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-912d062a-d96c-4cfe-b416-9cd0d3e9e651 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:21.682016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-912d062a-d96c-4cfe-b416-9cd0d3e9e651 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:21.682016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-912d062a-d96c-4cfe-b416-9cd0d3e9e651 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:21.687393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2461f32c-85ae-4c92-980e-63338c804fc4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:21.688013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2461f32c-85ae-4c92-980e-63338c804fc4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:21.694734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2461f32c-85ae-4c92-980e-63338c804fc4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:21.695242 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2461f32c-85ae-4c92-980e-63338c804fc4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:21.695714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2461f32c-85ae-4c92-980e-63338c804fc4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:21.696471 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2461f32c-85ae-4c92-980e-63338c804fc4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:21.697000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2461f32c-85ae-4c92-980e-63338c804fc4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:21.697432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2461f32c-85ae-4c92-980e-63338c804fc4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:21.752679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-912d062a-d96c-4cfe-b416-9cd0d3e9e651 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c633d65d3754c0bb47a7cb8754a97cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e202cdaad65452fa00963abd83004b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:21.761122 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-912d062a-d96c-4cfe-b416-9cd0d3e9e651 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "GET /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac" status: 200 len: 1271 microversion: 2.1 time: 0.093524 Oct 29 03:26:21.761815 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2806/5833] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:21 2022] GET /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:22.162412 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2461f32c-85ae-4c92-980e-63338c804fc4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:22.170236 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2461f32c-85ae-4c92-980e-63338c804fc4 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d" status: 200 len: 1681 microversion: 2.1 time: 0.486855 Oct 29 03:26:22.171009 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3028/5834] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:21 2022] GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d => generated 1681 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:26:22.192759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-230c1cbe-4ff6-4a58-8a92-7729f4be9565 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:22.193547 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-230c1cbe-4ff6-4a58-8a92-7729f4be9565 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:22.199931 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-230c1cbe-4ff6-4a58-8a92-7729f4be9565 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:22.201301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-230c1cbe-4ff6-4a58-8a92-7729f4be9565 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:22.201561 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-230c1cbe-4ff6-4a58-8a92-7729f4be9565 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:22.202325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-230c1cbe-4ff6-4a58-8a92-7729f4be9565 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:22.202780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-230c1cbe-4ff6-4a58-8a92-7729f4be9565 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:22.203204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-230c1cbe-4ff6-4a58-8a92-7729f4be9565 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:22.334418 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-230c1cbe-4ff6-4a58-8a92-7729f4be9565 tempest-TestNetworkAdvancedServerOps-675208153 tempest-TestNetworkAdvancedServerOps-675208153-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d" status: 200 len: 1832 microversion: 2.1 time: 0.145549 Oct 29 03:26:22.335011 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2807/5835] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:22 2022] GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d => generated 1832 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:22.357687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-89cd3944-03f1-458b-bb8e-d548d5a0e1fe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:22.358341 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-89cd3944-03f1-458b-bb8e-d548d5a0e1fe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:22.364504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89cd3944-03f1-458b-bb8e-d548d5a0e1fe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:22.365020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89cd3944-03f1-458b-bb8e-d548d5a0e1fe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:22.365451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89cd3944-03f1-458b-bb8e-d548d5a0e1fe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:22.366153 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89cd3944-03f1-458b-bb8e-d548d5a0e1fe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:22.366601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89cd3944-03f1-458b-bb8e-d548d5a0e1fe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:22.367038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89cd3944-03f1-458b-bb8e-d548d5a0e1fe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:22.532176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c9ba92e2-44a4-4ae3-a136-a6210796748b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:22.533710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c9ba92e2-44a4-4ae3-a136-a6210796748b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:22.541694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c9ba92e2-44a4-4ae3-a136-a6210796748b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:22.542426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c9ba92e2-44a4-4ae3-a136-a6210796748b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:22.543055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c9ba92e2-44a4-4ae3-a136-a6210796748b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:22.544146 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c9ba92e2-44a4-4ae3-a136-a6210796748b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:22.544630 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c9ba92e2-44a4-4ae3-a136-a6210796748b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:22.545414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c9ba92e2-44a4-4ae3-a136-a6210796748b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:22.601761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-89cd3944-03f1-458b-bb8e-d548d5a0e1fe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:22.610755 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-89cd3944-03f1-458b-bb8e-d548d5a0e1fe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d" status: 200 len: 1681 microversion: 2.1 time: 0.257072 Oct 29 03:26:22.614498 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3029/5836] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:22 2022] GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d => generated 1681 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:22.689295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f2bc949c-eccb-49a5-844c-2284aba17759 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:22.690100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f2bc949c-eccb-49a5-844c-2284aba17759 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:22.696212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2bc949c-eccb-49a5-844c-2284aba17759 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:22.696911 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2bc949c-eccb-49a5-844c-2284aba17759 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:22.697674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2bc949c-eccb-49a5-844c-2284aba17759 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:22.698516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2bc949c-eccb-49a5-844c-2284aba17759 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:22.699245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2bc949c-eccb-49a5-844c-2284aba17759 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:22.699835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2bc949c-eccb-49a5-844c-2284aba17759 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:22.768026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c9ba92e2-44a4-4ae3-a136-a6210796748b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:22.776256 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c9ba92e2-44a4-4ae3-a136-a6210796748b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1510 microversion: 2.1 time: 0.250878 Oct 29 03:26:22.776882 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2808/5837] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:22 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1510 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:22.786452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bf6eb86c-4d27-4c9c-b266-2d8aa5c8d85a tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:22.787165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bf6eb86c-4d27-4c9c-b266-2d8aa5c8d85a tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: 09a0f147-9f3b-4180-a462-aebd0e6162ac] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:22.795054 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf6eb86c-4d27-4c9c-b266-2d8aa5c8d85a tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:22.795473 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf6eb86c-4d27-4c9c-b266-2d8aa5c8d85a tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:22.796060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf6eb86c-4d27-4c9c-b266-2d8aa5c8d85a tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:22.796867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf6eb86c-4d27-4c9c-b266-2d8aa5c8d85a tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:22.797392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf6eb86c-4d27-4c9c-b266-2d8aa5c8d85a tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:22.797912 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf6eb86c-4d27-4c9c-b266-2d8aa5c8d85a tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:22.928726 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f2bc949c-eccb-49a5-844c-2284aba17759 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7fb41c95104b4bb9ad66ba2457f994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa34bf618bf4e2e94d55b9b1fff3003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:22.936873 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f2bc949c-eccb-49a5-844c-2284aba17759 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "GET /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd" status: 200 len: 1498 microversion: 2.1 time: 0.251658 Oct 29 03:26:22.937585 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3030/5838] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:22 2022] GET /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd => generated 1498 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:26:22.941469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bf6eb86c-4d27-4c9c-b266-2d8aa5c8d85a tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c633d65d3754c0bb47a7cb8754a97cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e202cdaad65452fa00963abd83004b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:22.950067 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bf6eb86c-4d27-4c9c-b266-2d8aa5c8d85a tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "GET /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac" status: 200 len: 1319 microversion: 2.1 time: 0.168812 Oct 29 03:26:22.950909 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2809/5839] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:22 2022] GET /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:23.320255 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-586d4c58-71ac-4060-9e4a-2f4eb93be3f2 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:23.320683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-586d4c58-71ac-4060-9e4a-2f4eb93be3f2 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:23.326740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-586d4c58-71ac-4060-9e4a-2f4eb93be3f2 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:23.327320 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-586d4c58-71ac-4060-9e4a-2f4eb93be3f2 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:23.327705 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-586d4c58-71ac-4060-9e4a-2f4eb93be3f2 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:23.328618 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-586d4c58-71ac-4060-9e4a-2f4eb93be3f2 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:23.330109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-586d4c58-71ac-4060-9e4a-2f4eb93be3f2 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:23.330802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-586d4c58-71ac-4060-9e4a-2f4eb93be3f2 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:23.337211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:23.360220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-586d4c58-71ac-4060-9e4a-2f4eb93be3f2 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:26:23.449840 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-586d4c58-71ac-4060-9e4a-2f4eb93be3f2 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd" status: 204 len: 0 microversion: 2.1 time: 0.133204 Oct 29 03:26:23.450524 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3031/5840] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:26:23 2022] DELETE /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:26:23.459532 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e5448938-e175-42b0-8fd5-dea5c1acf85a tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:23.460154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e5448938-e175-42b0-8fd5-dea5c1acf85a tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:23.466475 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5448938-e175-42b0-8fd5-dea5c1acf85a tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:23.466965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5448938-e175-42b0-8fd5-dea5c1acf85a tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:23.467554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5448938-e175-42b0-8fd5-dea5c1acf85a tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:23.468266 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5448938-e175-42b0-8fd5-dea5c1acf85a tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:23.468874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5448938-e175-42b0-8fd5-dea5c1acf85a tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:23.469525 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5448938-e175-42b0-8fd5-dea5c1acf85a tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:23.604102 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e5448938-e175-42b0-8fd5-dea5c1acf85a tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7fb41c95104b4bb9ad66ba2457f994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa34bf618bf4e2e94d55b9b1fff3003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:23.613517 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e5448938-e175-42b0-8fd5-dea5c1acf85a tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "GET /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd" status: 200 len: 1504 microversion: 2.1 time: 0.158019 Oct 29 03:26:23.617300 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2810/5841] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:23 2022] GET /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:23.620458 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-cf40a8e4-025e-45bb-9d93-85c45970430d req-e9ff3d38-dd1a-4974-9043-47d5d34d98e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09a0f147-9f3b-4180-a462-aebd0e6162ac", "tag": "5a1277ad-8bce-48a3-94a0-a02c81dcbad8"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:23.632003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-cf40a8e4-025e-45bb-9d93-85c45970430d req-e9ff3d38-dd1a-4974-9043-47d5d34d98e1 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:23.632686 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-cf40a8e4-025e-45bb-9d93-85c45970430d req-e9ff3d38-dd1a-4974-9043-47d5d34d98e1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:23.633199 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-cf40a8e4-025e-45bb-9d93-85c45970430d req-e9ff3d38-dd1a-4974-9043-47d5d34d98e1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:23.647757 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-cf40a8e4-025e-45bb-9d93-85c45970430d req-e9ff3d38-dd1a-4974-9043-47d5d34d98e1 service nova] Creating event network-changed:5a1277ad-8bce-48a3-94a0-a02c81dcbad8 for instance 09a0f147-9f3b-4180-a462-aebd0e6162ac on n-h2-862967-2 Oct 29 03:26:23.652844 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-cf40a8e4-025e-45bb-9d93-85c45970430d req-e9ff3d38-dd1a-4974-9043-47d5d34d98e1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037018 Oct 29 03:26:23.653811 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3032/5842] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:26:23.800184 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-147b2694-5a54-4b72-b720-8fecead0a0d3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:23.800827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-147b2694-5a54-4b72-b720-8fecead0a0d3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:23.807551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-147b2694-5a54-4b72-b720-8fecead0a0d3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:23.808041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-147b2694-5a54-4b72-b720-8fecead0a0d3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:23.808470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-147b2694-5a54-4b72-b720-8fecead0a0d3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:23.809208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-147b2694-5a54-4b72-b720-8fecead0a0d3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:23.809653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-147b2694-5a54-4b72-b720-8fecead0a0d3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:23.810074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-147b2694-5a54-4b72-b720-8fecead0a0d3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:23.942827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-147b2694-5a54-4b72-b720-8fecead0a0d3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:23.951138 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-147b2694-5a54-4b72-b720-8fecead0a0d3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1510 microversion: 2.1 time: 0.155478 Oct 29 03:26:23.951772 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2811/5843] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:23 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:23.974763 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-db7f7fb6-2560-4eda-a365-66eb89c358f8 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:23.975584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-db7f7fb6-2560-4eda-a365-66eb89c358f8 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: 09a0f147-9f3b-4180-a462-aebd0e6162ac] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:23.982753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db7f7fb6-2560-4eda-a365-66eb89c358f8 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:23.983374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db7f7fb6-2560-4eda-a365-66eb89c358f8 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:23.983838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db7f7fb6-2560-4eda-a365-66eb89c358f8 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:23.984554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db7f7fb6-2560-4eda-a365-66eb89c358f8 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:23.985043 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db7f7fb6-2560-4eda-a365-66eb89c358f8 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:23.985590 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db7f7fb6-2560-4eda-a365-66eb89c358f8 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:24.123674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-db7f7fb6-2560-4eda-a365-66eb89c358f8 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c633d65d3754c0bb47a7cb8754a97cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e202cdaad65452fa00963abd83004b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:24.131843 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-db7f7fb6-2560-4eda-a365-66eb89c358f8 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "GET /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac" status: 200 len: 1319 microversion: 2.1 time: 0.161999 Oct 29 03:26:24.132444 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3033/5844] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:23 2022] GET /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:24.643639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b4865f8e-6a5f-4a21-91fb-b2191a7e1456 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:24.644515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b4865f8e-6a5f-4a21-91fb-b2191a7e1456 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:24.656823 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4865f8e-6a5f-4a21-91fb-b2191a7e1456 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:24.657306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4865f8e-6a5f-4a21-91fb-b2191a7e1456 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:24.657734 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4865f8e-6a5f-4a21-91fb-b2191a7e1456 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:24.658431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4865f8e-6a5f-4a21-91fb-b2191a7e1456 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:24.658876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4865f8e-6a5f-4a21-91fb-b2191a7e1456 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:24.659290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4865f8e-6a5f-4a21-91fb-b2191a7e1456 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:24.757830 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bb9c845a-4845-4891-96a1-4a3c2640f8f5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:24.760805 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bb9c845a-4845-4891-96a1-4a3c2640f8f5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:24.769635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb9c845a-4845-4891-96a1-4a3c2640f8f5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:24.770149 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb9c845a-4845-4891-96a1-4a3c2640f8f5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:24.770595 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb9c845a-4845-4891-96a1-4a3c2640f8f5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:24.771312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb9c845a-4845-4891-96a1-4a3c2640f8f5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:24.772357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb9c845a-4845-4891-96a1-4a3c2640f8f5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:24.772829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bb9c845a-4845-4891-96a1-4a3c2640f8f5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:24.805075 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b4865f8e-6a5f-4a21-91fb-b2191a7e1456 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7fb41c95104b4bb9ad66ba2457f994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa34bf618bf4e2e94d55b9b1fff3003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:24.816836 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b4865f8e-6a5f-4a21-91fb-b2191a7e1456 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "GET /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd" status: 200 len: 1504 microversion: 2.1 time: 0.179508 Oct 29 03:26:24.817630 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2812/5845] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:24 2022] GET /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:24.962299 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bb9c845a-4845-4891-96a1-4a3c2640f8f5 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "POST /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d/action" status: 200 len: 38636 microversion: 2.1 time: 0.210497 Oct 29 03:26:24.963375 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3034/5846] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:26:24 2022] POST /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d/action => generated 38636 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:26:24.977184 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f4d1e95e-87a5-46b6-af34-848a511e91a0 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:24.978161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f4d1e95e-87a5-46b6-af34-848a511e91a0 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:24.985411 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4d1e95e-87a5-46b6-af34-848a511e91a0 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:24.986193 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4d1e95e-87a5-46b6-af34-848a511e91a0 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:24.986677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4d1e95e-87a5-46b6-af34-848a511e91a0 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:24.987418 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4d1e95e-87a5-46b6-af34-848a511e91a0 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:24.987846 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4d1e95e-87a5-46b6-af34-848a511e91a0 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:24.988562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4d1e95e-87a5-46b6-af34-848a511e91a0 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:25.155984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c1e29b6f-527a-4f90-bba2-3f42927f380b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:25.157038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c1e29b6f-527a-4f90-bba2-3f42927f380b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: 09a0f147-9f3b-4180-a462-aebd0e6162ac] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:25.164165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1e29b6f-527a-4f90-bba2-3f42927f380b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:25.164770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1e29b6f-527a-4f90-bba2-3f42927f380b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:25.165273 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1e29b6f-527a-4f90-bba2-3f42927f380b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:25.166047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1e29b6f-527a-4f90-bba2-3f42927f380b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:25.166724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1e29b6f-527a-4f90-bba2-3f42927f380b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:25.167215 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1e29b6f-527a-4f90-bba2-3f42927f380b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:25.255587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f4d1e95e-87a5-46b6-af34-848a511e91a0 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:25.265449 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f4d1e95e-87a5-46b6-af34-848a511e91a0 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1510 microversion: 2.1 time: 0.293249 Oct 29 03:26:25.266352 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2813/5847] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:24 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1510 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:25.391921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c1e29b6f-527a-4f90-bba2-3f42927f380b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c633d65d3754c0bb47a7cb8754a97cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e202cdaad65452fa00963abd83004b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:25.403948 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c1e29b6f-527a-4f90-bba2-3f42927f380b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "GET /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac" status: 200 len: 1319 microversion: 2.1 time: 0.251636 Oct 29 03:26:25.404868 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3035/5848] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:25 2022] GET /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:26:25.680436 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-904aacee-b9b9-412b-9eb1-bf181bc623d0 req-570a43cd-959b-463a-833d-ea807727fed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd", "name": "network-vif-deleted", "tag": "de33895e-e250-4142-af94-98dd37bcc70b"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:25.691694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-904aacee-b9b9-412b-9eb1-bf181bc623d0 req-570a43cd-959b-463a-833d-ea807727fed5 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:25.692174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-904aacee-b9b9-412b-9eb1-bf181bc623d0 req-570a43cd-959b-463a-833d-ea807727fed5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:25.692639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-904aacee-b9b9-412b-9eb1-bf181bc623d0 req-570a43cd-959b-463a-833d-ea807727fed5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:25.705577 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-904aacee-b9b9-412b-9eb1-bf181bc623d0 req-570a43cd-959b-463a-833d-ea807727fed5 service nova] Creating event network-vif-deleted:de33895e-e250-4142-af94-98dd37bcc70b for instance 1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd on n-h1-862967-2 Oct 29 03:26:25.711721 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-904aacee-b9b9-412b-9eb1-bf181bc623d0 req-570a43cd-959b-463a-833d-ea807727fed5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036288 Oct 29 03:26:25.712373 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2814/5849] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:26:25.844073 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-190f47f5-4eaa-4293-96e8-63ef3cdb4fc7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:25.845320 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-190f47f5-4eaa-4293-96e8-63ef3cdb4fc7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:25.853577 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-190f47f5-4eaa-4293-96e8-63ef3cdb4fc7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:25.854154 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-190f47f5-4eaa-4293-96e8-63ef3cdb4fc7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:25.854639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-190f47f5-4eaa-4293-96e8-63ef3cdb4fc7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:25.855650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-190f47f5-4eaa-4293-96e8-63ef3cdb4fc7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:25.856209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-190f47f5-4eaa-4293-96e8-63ef3cdb4fc7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:25.856729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-190f47f5-4eaa-4293-96e8-63ef3cdb4fc7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:25.892906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-190f47f5-4eaa-4293-96e8-63ef3cdb4fc7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:25.893675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-190f47f5-4eaa-4293-96e8-63ef3cdb4fc7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:25.894307 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-190f47f5-4eaa-4293-96e8-63ef3cdb4fc7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:25.894950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-190f47f5-4eaa-4293-96e8-63ef3cdb4fc7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lazy-loading 'fault' on Instance uuid 1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:26:25.938813 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-190f47f5-4eaa-4293-96e8-63ef3cdb4fc7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7fb41c95104b4bb9ad66ba2457f994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa34bf618bf4e2e94d55b9b1fff3003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:25.946421 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-190f47f5-4eaa-4293-96e8-63ef3cdb4fc7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "GET /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd" status: 200 len: 1304 microversion: 2.1 time: 0.106786 Oct 29 03:26:25.946998 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3036/5850] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:25 2022] GET /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:26.240880 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cd36f824-92f3-4d3a-9bb1-6b0e08c9f482 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:26.241499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cd36f824-92f3-4d3a-9bb1-6b0e08c9f482 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:26.248176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd36f824-92f3-4d3a-9bb1-6b0e08c9f482 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:26.248774 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd36f824-92f3-4d3a-9bb1-6b0e08c9f482 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:26.249252 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd36f824-92f3-4d3a-9bb1-6b0e08c9f482 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:26.250026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd36f824-92f3-4d3a-9bb1-6b0e08c9f482 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:26.250542 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd36f824-92f3-4d3a-9bb1-6b0e08c9f482 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:26.250982 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd36f824-92f3-4d3a-9bb1-6b0e08c9f482 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:26.281558 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cd36f824-92f3-4d3a-9bb1-6b0e08c9f482 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:26:26.289868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-55c65352-3182-4833-9464-0672881df5a3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:26.290828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-55c65352-3182-4833-9464-0672881df5a3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:26.300294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55c65352-3182-4833-9464-0672881df5a3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:26.301301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55c65352-3182-4833-9464-0672881df5a3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:26.301900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55c65352-3182-4833-9464-0672881df5a3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:26.302648 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55c65352-3182-4833-9464-0672881df5a3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:26.303259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55c65352-3182-4833-9464-0672881df5a3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:26.303845 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55c65352-3182-4833-9464-0672881df5a3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:26.338698 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:26.377423 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cd36f824-92f3-4d3a-9bb1-6b0e08c9f482 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d" status: 204 len: 0 microversion: 2.1 time: 0.140237 Oct 29 03:26:26.378371 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2815/5851] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:26:26 2022] DELETE /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:26:26.387808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-22e8747e-2e79-453e-964e-9e321a7c7a6c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:26.388768 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-22e8747e-2e79-453e-964e-9e321a7c7a6c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:26.395050 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22e8747e-2e79-453e-964e-9e321a7c7a6c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:26.395727 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22e8747e-2e79-453e-964e-9e321a7c7a6c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:26.397238 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22e8747e-2e79-453e-964e-9e321a7c7a6c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:26.401309 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22e8747e-2e79-453e-964e-9e321a7c7a6c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:26.401878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22e8747e-2e79-453e-964e-9e321a7c7a6c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:26.402367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22e8747e-2e79-453e-964e-9e321a7c7a6c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:26.455144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-55c65352-3182-4833-9464-0672881df5a3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:26.462876 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-55c65352-3182-4833-9464-0672881df5a3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1510 microversion: 2.1 time: 0.177184 Oct 29 03:26:26.477594 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3037/5852] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:26 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1510 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:26:26.484903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-661eab2b-acd6-4a2a-8e9f-683f65cde1ae tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:26.485527 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-661eab2b-acd6-4a2a-8e9f-683f65cde1ae tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: 09a0f147-9f3b-4180-a462-aebd0e6162ac] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:26.492187 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-661eab2b-acd6-4a2a-8e9f-683f65cde1ae tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:26.492707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-661eab2b-acd6-4a2a-8e9f-683f65cde1ae tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:26.493525 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-661eab2b-acd6-4a2a-8e9f-683f65cde1ae tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:26.494367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-661eab2b-acd6-4a2a-8e9f-683f65cde1ae tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:26.494822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-661eab2b-acd6-4a2a-8e9f-683f65cde1ae tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:26.495240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-661eab2b-acd6-4a2a-8e9f-683f65cde1ae tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:26.544691 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-22e8747e-2e79-453e-964e-9e321a7c7a6c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:26.552786 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-22e8747e-2e79-453e-964e-9e321a7c7a6c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d" status: 200 len: 1687 microversion: 2.1 time: 0.169203 Oct 29 03:26:26.553482 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2816/5853] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:26 2022] GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d => generated 1687 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:26:26.647127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-661eab2b-acd6-4a2a-8e9f-683f65cde1ae tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c633d65d3754c0bb47a7cb8754a97cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e202cdaad65452fa00963abd83004b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:26.657636 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-661eab2b-acd6-4a2a-8e9f-683f65cde1ae tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "GET /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac" status: 200 len: 1319 microversion: 2.1 time: 0.178542 Oct 29 03:26:26.658244 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3038/5854] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:26 2022] GET /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:26.970385 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-49251667-62d9-487d-8d20-c8efd1ca4107 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:26.971137 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-49251667-62d9-487d-8d20-c8efd1ca4107 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:26.978392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-49251667-62d9-487d-8d20-c8efd1ca4107 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:26.978882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-49251667-62d9-487d-8d20-c8efd1ca4107 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:26.979330 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-49251667-62d9-487d-8d20-c8efd1ca4107 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:26.980029 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-49251667-62d9-487d-8d20-c8efd1ca4107 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:26.980485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-49251667-62d9-487d-8d20-c8efd1ca4107 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:26.981098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-49251667-62d9-487d-8d20-c8efd1ca4107 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:26.995906 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-49251667-62d9-487d-8d20-c8efd1ca4107 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] HTTP exception thrown: Instance 1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd could not be found. Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-49251667-62d9-487d-8d20-c8efd1ca4107 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Request method failure captured: Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd HTTP/1.1 Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJ1QP56nLyiEE3pudxJ6OW1G0aktAjD8ODuaFjepBo-mvqn0ntDOXlKKA2mqIWE6utfhlANLVCTunHHUyN_PuyLw5XeutcSbdqtvpiuc5-24tgFWjkxNp0bWFGn6sHEgH_jEq-qjAn40FsSrYQthh3ONkOywUkAB52B6Uwb_vh9YLfw Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 5fa34bf618bf4e2e94d55b9b1fff3003 Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-VolumesActionsTest-990366347 Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5fa34bf618bf4e2e94d55b9b1fff3003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5fa34bf618bf4e2e94d55b9b1fff3003"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5fa34bf618bf4e2e94d55b9b1fff3003"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5fa34bf618bf4e2e94d55b9b1fff3003"}]}] Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-VolumesActionsTest-990366347 Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 5fa34bf618bf4e2e94d55b9b1fff3003 Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-VolumesActionsTest-990366347 Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-VolumesActionsTest-990366347-project Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 9f7fb41c95104b4bb9ad66ba2457f994 Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-VolumesActionsTest-990366347-project Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd could not be found. Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd'} Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd could not be found. Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd could not be found. Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:26.997737 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:27.003696 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:27.003696 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:27.003696 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:27.003696 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:26:27.003696 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:26:27.003696 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd could not be found. Oct 29 03:26:27.003696 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:27.003696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-49251667-62d9-487d-8d20-c8efd1ca4107 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Returning 404 to user: Instance 1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:26:27.003696 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-49251667-62d9-487d-8d20-c8efd1ca4107 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "GET /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd" status: 404 len: 111 microversion: 2.1 time: 0.033311 Oct 29 03:26:27.003696 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2817/5855] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:26 2022] GET /compute/v2.1/servers/1ce26f80-3f53-40b5-b3c3-8d261f1ea2dd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:26:27.059208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-224d65e3-418c-4800-a81b-a0fdc416050d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-830912043", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "e661a52f-25d6-4fc8-9c8f-6d9409eee998"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:27.124908 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-224d65e3-418c-4800-a81b-a0fdc416050d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] validate_networks() for [('e661a52f-25d6-4fc8-9c8f-6d9409eee998', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:26:27.486851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f5c2fff1-b21e-4afa-8c6d-ebf58969cc03 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:27.487514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f5c2fff1-b21e-4afa-8c6d-ebf58969cc03 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:27.493813 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5c2fff1-b21e-4afa-8c6d-ebf58969cc03 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:27.494292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5c2fff1-b21e-4afa-8c6d-ebf58969cc03 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:27.494753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5c2fff1-b21e-4afa-8c6d-ebf58969cc03 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:27.495514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5c2fff1-b21e-4afa-8c6d-ebf58969cc03 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:27.495969 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5c2fff1-b21e-4afa-8c6d-ebf58969cc03 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:27.496397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5c2fff1-b21e-4afa-8c6d-ebf58969cc03 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:27.647827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-224d65e3-418c-4800-a81b-a0fdc416050d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:26:27.648279 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-224d65e3-418c-4800-a81b-a0fdc416050d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:26:27.648870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-224d65e3-418c-4800-a81b-a0fdc416050d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:26:27.649305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-224d65e3-418c-4800-a81b-a0fdc416050d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:26:27.649898 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-224d65e3-418c-4800-a81b-a0fdc416050d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:26:27.658124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f5c2fff1-b21e-4afa-8c6d-ebf58969cc03 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:27.668356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-224d65e3-418c-4800-a81b-a0fdc416050d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:27.669835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-224d65e3-418c-4800-a81b-a0fdc416050d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:27.669975 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f5c2fff1-b21e-4afa-8c6d-ebf58969cc03 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1510 microversion: 2.1 time: 0.187857 Oct 29 03:26:27.670652 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2818/5856] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:27 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1510 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:27.670849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-224d65e3-418c-4800-a81b-a0fdc416050d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:27.672090 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-224d65e3-418c-4800-a81b-a0fdc416050d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:27.672517 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-224d65e3-418c-4800-a81b-a0fdc416050d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:27.673179 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-224d65e3-418c-4800-a81b-a0fdc416050d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:27.675519 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-f3bfc385-5f99-4d67-aacd-e5567f6cde65 req-e91e9750-0a17-41c9-af06-c89c9b3c6254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b02e08ec-9966-4d79-9c25-ce3f1822e38d", "name": "network-vif-deleted", "tag": "1032b4cc-e4e3-4992-8f76-9e8bc7f25df6"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:27.693071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f3bfc385-5f99-4d67-aacd-e5567f6cde65 req-e91e9750-0a17-41c9-af06-c89c9b3c6254 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:27.693813 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f3bfc385-5f99-4d67-aacd-e5567f6cde65 req-e91e9750-0a17-41c9-af06-c89c9b3c6254 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:27.694396 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f3bfc385-5f99-4d67-aacd-e5567f6cde65 req-e91e9750-0a17-41c9-af06-c89c9b3c6254 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:27.699700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-224d65e3-418c-4800-a81b-a0fdc416050d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Getting quotas for project 5fa34bf618bf4e2e94d55b9b1fff3003. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:26:27.706124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-224d65e3-418c-4800-a81b-a0fdc416050d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Getting quotas for user 9f7fb41c95104b4bb9ad66ba2457f994 and project 5fa34bf618bf4e2e94d55b9b1fff3003. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:26:27.707698 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-f3bfc385-5f99-4d67-aacd-e5567f6cde65 req-e91e9750-0a17-41c9-af06-c89c9b3c6254 service nova] Creating event network-vif-deleted:1032b4cc-e4e3-4992-8f76-9e8bc7f25df6 for instance b02e08ec-9966-4d79-9c25-ce3f1822e38d on n-h2-862967-2 Oct 29 03:26:27.712935 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-f3bfc385-5f99-4d67-aacd-e5567f6cde65 req-e91e9750-0a17-41c9-af06-c89c9b3c6254 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040949 Oct 29 03:26:27.718305 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2819/5857] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:26:27.724363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-505d9008-13b6-411e-b39e-71f52809cd2d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:27.725780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-505d9008-13b6-411e-b39e-71f52809cd2d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: b02e08ec-9966-4d79-9c25-ce3f1822e38d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:27.729868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-224d65e3-418c-4800-a81b-a0fdc416050d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:26:27.733916 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-224d65e3-418c-4800-a81b-a0fdc416050d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 9fef762d-0fbd-4850-8733-a53aeeb908b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:26:27.734438 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-505d9008-13b6-411e-b39e-71f52809cd2d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:27.735095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-505d9008-13b6-411e-b39e-71f52809cd2d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:27.735694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-505d9008-13b6-411e-b39e-71f52809cd2d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:27.736596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-505d9008-13b6-411e-b39e-71f52809cd2d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:27.737203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-505d9008-13b6-411e-b39e-71f52809cd2d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:27.737947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-505d9008-13b6-411e-b39e-71f52809cd2d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:27.764134 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-505d9008-13b6-411e-b39e-71f52809cd2d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] HTTP exception thrown: Instance b02e08ec-9966-4d79-9c25-ce3f1822e38d could not be found. Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-505d9008-13b6-411e-b39e-71f52809cd2d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Request method failure captured: Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d HTTP/1.1 Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJvFDgv39YEHxHfIGPphS_gbBVnKLoR2NMVFu2W7_hYkDRDJ01RHk3ODd2efOl__KQE-71QHOfy9i5K9cE39s3-f5uUaGST3mGa6UP6ZiaoXfrXgr9ANswBW4fhoyYxt5VjIwP2IaqtzixgmpqXZparOwp6ERMwaDHZ09cH_NGeZj5o Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: c898299eb0444aa1a1983fb127153c65 Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1800856932 Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c898299eb0444aa1a1983fb127153c65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c898299eb0444aa1a1983fb127153c65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c898299eb0444aa1a1983fb127153c65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c898299eb0444aa1a1983fb127153c65"}]}] Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1800856932 Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: c898299eb0444aa1a1983fb127153c65 Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1800856932 Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestNetworkAdvancedServerOps-1800856932-project Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 789295d938084ee3b7d618690fee5bfa Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1800856932-project Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance b02e08ec-9966-4d79-9c25-ce3f1822e38d could not be found. Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'b02e08ec-9966-4d79-9c25-ce3f1822e38d'} Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b02e08ec-9966-4d79-9c25-ce3f1822e38d could not be found. Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b02e08ec-9966-4d79-9c25-ce3f1822e38d could not be found. Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:27.768002 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:27.773178 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:27.773178 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:27.773178 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:27.773178 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:27.773178 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:26:27.773178 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:26:27.773178 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b02e08ec-9966-4d79-9c25-ce3f1822e38d could not be found. Oct 29 03:26:27.773178 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:27.773178 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-505d9008-13b6-411e-b39e-71f52809cd2d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Returning 404 to user: Instance b02e08ec-9966-4d79-9c25-ce3f1822e38d could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:26:27.773178 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-505d9008-13b6-411e-b39e-71f52809cd2d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d" status: 404 len: 111 microversion: 2.1 time: 0.050777 Oct 29 03:26:27.773178 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2820/5858] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:27 2022] GET /compute/v2.1/servers/b02e08ec-9966-4d79-9c25-ce3f1822e38d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:26:27.781289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ae37be78-1820-4b2d-8f66-14d40060df7b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:27.782112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ae37be78-1820-4b2d-8f66-14d40060df7b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: 09a0f147-9f3b-4180-a462-aebd0e6162ac] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:27.791316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae37be78-1820-4b2d-8f66-14d40060df7b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:27.792113 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae37be78-1820-4b2d-8f66-14d40060df7b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:27.792669 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae37be78-1820-4b2d-8f66-14d40060df7b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:27.793574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae37be78-1820-4b2d-8f66-14d40060df7b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:27.794268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae37be78-1820-4b2d-8f66-14d40060df7b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:27.794840 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae37be78-1820-4b2d-8f66-14d40060df7b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:27.803316 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-224d65e3-418c-4800-a81b-a0fdc416050d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.747965 Oct 29 03:26:27.810067 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3039/5859] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:26:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:26:27.815453 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-7a2839f8-a82b-4c57-a5a4-d8204c46fe72 req-9e759f4e-8cb0-4d97-97f5-f798faab0222 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b02e08ec-9966-4d79-9c25-ce3f1822e38d", "tag": "1032b4cc-e4e3-4992-8f76-9e8bc7f25df6"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:27.831404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7a2839f8-a82b-4c57-a5a4-d8204c46fe72 req-9e759f4e-8cb0-4d97-97f5-f798faab0222 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:27.831904 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7a2839f8-a82b-4c57-a5a4-d8204c46fe72 req-9e759f4e-8cb0-4d97-97f5-f798faab0222 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:27.832341 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7a2839f8-a82b-4c57-a5a4-d8204c46fe72 req-9e759f4e-8cb0-4d97-97f5-f798faab0222 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:27.844008 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-7a2839f8-a82b-4c57-a5a4-d8204c46fe72 req-9e759f4e-8cb0-4d97-97f5-f798faab0222 service nova] Creating event network-changed:1032b4cc-e4e3-4992-8f76-9e8bc7f25df6 for instance b02e08ec-9966-4d79-9c25-ce3f1822e38d on n-h2-862967-2 Oct 29 03:26:27.849349 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-7a2839f8-a82b-4c57-a5a4-d8204c46fe72 req-9e759f4e-8cb0-4d97-97f5-f798faab0222 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037732 Oct 29 03:26:27.850263 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3040/5860] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:26:27.855977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-382ebe20-eddb-4421-b5bf-878bb71d6205 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:27.856733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-382ebe20-eddb-4421-b5bf-878bb71d6205 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 9fef762d-0fbd-4850-8733-a53aeeb908b7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:27.967729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-382ebe20-eddb-4421-b5bf-878bb71d6205 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7fb41c95104b4bb9ad66ba2457f994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa34bf618bf4e2e94d55b9b1fff3003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:27.978622 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-382ebe20-eddb-4421-b5bf-878bb71d6205 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "GET /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7" status: 200 len: 1213 microversion: 2.1 time: 0.126987 Oct 29 03:26:27.979818 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3041/5861] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:27 2022] GET /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7 => generated 1213 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:28.042115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ae37be78-1820-4b2d-8f66-14d40060df7b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c633d65d3754c0bb47a7cb8754a97cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e202cdaad65452fa00963abd83004b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:28.055959 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ae37be78-1820-4b2d-8f66-14d40060df7b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "GET /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac" status: 200 len: 1319 microversion: 2.1 time: 0.281366 Oct 29 03:26:28.056901 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2821/5862] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:27 2022] GET /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:28.693601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ce7f01b1-e3aa-47ef-b48f-82f7a6bf41dd tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:28.694725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ce7f01b1-e3aa-47ef-b48f-82f7a6bf41dd tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:28.702496 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce7f01b1-e3aa-47ef-b48f-82f7a6bf41dd tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:28.703203 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce7f01b1-e3aa-47ef-b48f-82f7a6bf41dd tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:28.704424 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce7f01b1-e3aa-47ef-b48f-82f7a6bf41dd tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:28.705194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce7f01b1-e3aa-47ef-b48f-82f7a6bf41dd tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:28.705645 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce7f01b1-e3aa-47ef-b48f-82f7a6bf41dd tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:28.706074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ce7f01b1-e3aa-47ef-b48f-82f7a6bf41dd tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:28.847896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ce7f01b1-e3aa-47ef-b48f-82f7a6bf41dd tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:28.856211 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ce7f01b1-e3aa-47ef-b48f-82f7a6bf41dd tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1510 microversion: 2.1 time: 0.166472 Oct 29 03:26:28.856852 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3042/5863] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:28 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:29.005886 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7da63c77-1f71-4efd-9b81-e61fc8bd98d7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:29.006861 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7da63c77-1f71-4efd-9b81-e61fc8bd98d7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 9fef762d-0fbd-4850-8733-a53aeeb908b7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:29.014443 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7da63c77-1f71-4efd-9b81-e61fc8bd98d7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:29.014983 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7da63c77-1f71-4efd-9b81-e61fc8bd98d7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:29.015668 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7da63c77-1f71-4efd-9b81-e61fc8bd98d7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:29.016409 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7da63c77-1f71-4efd-9b81-e61fc8bd98d7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:29.017085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7da63c77-1f71-4efd-9b81-e61fc8bd98d7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:29.017472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7da63c77-1f71-4efd-9b81-e61fc8bd98d7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:29.083744 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7c3e160a-7986-498f-8971-d511d29358ae tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:29.084390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7c3e160a-7986-498f-8971-d511d29358ae tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: 09a0f147-9f3b-4180-a462-aebd0e6162ac] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:29.090769 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c3e160a-7986-498f-8971-d511d29358ae tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:29.091257 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c3e160a-7986-498f-8971-d511d29358ae tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:29.091691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c3e160a-7986-498f-8971-d511d29358ae tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:29.092499 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c3e160a-7986-498f-8971-d511d29358ae tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:29.092978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c3e160a-7986-498f-8971-d511d29358ae tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:29.093403 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c3e160a-7986-498f-8971-d511d29358ae tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:29.106884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7da63c77-1f71-4efd-9b81-e61fc8bd98d7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7fb41c95104b4bb9ad66ba2457f994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa34bf618bf4e2e94d55b9b1fff3003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:29.127116 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7da63c77-1f71-4efd-9b81-e61fc8bd98d7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "GET /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7" status: 200 len: 1265 microversion: 2.1 time: 0.124990 Oct 29 03:26:29.128573 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2822/5864] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:29 2022] GET /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7 => generated 1265 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:29.250587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7c3e160a-7986-498f-8971-d511d29358ae tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c633d65d3754c0bb47a7cb8754a97cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e202cdaad65452fa00963abd83004b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:29.260453 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7c3e160a-7986-498f-8971-d511d29358ae tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "GET /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac" status: 200 len: 1319 microversion: 2.1 time: 0.180818 Oct 29 03:26:29.261276 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3043/5865] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:29 2022] GET /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:29.879388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-c62abee4-6b0d-44e5-8a4c-f44a0509a41e req-c30997d4-b3c1-40fc-962a-a78e725ea0f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09a0f147-9f3b-4180-a462-aebd0e6162ac", "name": "network-vif-plugged", "status": "completed", "tag": "5a1277ad-8bce-48a3-94a0-a02c81dcbad8"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:29.884077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-80a770fb-ce4d-48a0-be07-3684a75cb08f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:29.885138 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-80a770fb-ce4d-48a0-be07-3684a75cb08f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:29.894081 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c62abee4-6b0d-44e5-8a4c-f44a0509a41e req-c30997d4-b3c1-40fc-962a-a78e725ea0f6 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:29.894972 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c62abee4-6b0d-44e5-8a4c-f44a0509a41e req-c30997d4-b3c1-40fc-962a-a78e725ea0f6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:29.895615 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c62abee4-6b0d-44e5-8a4c-f44a0509a41e req-c30997d4-b3c1-40fc-962a-a78e725ea0f6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:29.898581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80a770fb-ce4d-48a0-be07-3684a75cb08f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:29.899178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80a770fb-ce4d-48a0-be07-3684a75cb08f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:29.899625 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80a770fb-ce4d-48a0-be07-3684a75cb08f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:29.900611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80a770fb-ce4d-48a0-be07-3684a75cb08f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:29.901146 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80a770fb-ce4d-48a0-be07-3684a75cb08f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:29.902091 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-80a770fb-ce4d-48a0-be07-3684a75cb08f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:29.920832 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-c62abee4-6b0d-44e5-8a4c-f44a0509a41e req-c30997d4-b3c1-40fc-962a-a78e725ea0f6 service nova] Creating event network-vif-plugged:5a1277ad-8bce-48a3-94a0-a02c81dcbad8 for instance 09a0f147-9f3b-4180-a462-aebd0e6162ac on n-h2-862967-2 Oct 29 03:26:29.929464 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-c62abee4-6b0d-44e5-8a4c-f44a0509a41e req-c30997d4-b3c1-40fc-962a-a78e725ea0f6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053333 Oct 29 03:26:29.931484 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2823/5866] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:26:30.129964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-80a770fb-ce4d-48a0-be07-3684a75cb08f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:30.146215 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-80a770fb-ce4d-48a0-be07-3684a75cb08f tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1510 microversion: 2.1 time: 0.268353 Oct 29 03:26:30.147458 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3044/5867] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:29 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1510 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:30.165134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-37b90638-3966-4b6b-a8af-49414a913735 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:30.166812 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-37b90638-3966-4b6b-a8af-49414a913735 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 9fef762d-0fbd-4850-8733-a53aeeb908b7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:30.174756 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-37b90638-3966-4b6b-a8af-49414a913735 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:30.175605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-37b90638-3966-4b6b-a8af-49414a913735 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:30.176124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-37b90638-3966-4b6b-a8af-49414a913735 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:30.176920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-37b90638-3966-4b6b-a8af-49414a913735 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:30.177811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-37b90638-3966-4b6b-a8af-49414a913735 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:30.178354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-37b90638-3966-4b6b-a8af-49414a913735 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:30.283645 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-53c81832-c9f5-4ac0-bbe9-a9080cd8f229 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:30.284783 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-53c81832-c9f5-4ac0-bbe9-a9080cd8f229 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: 09a0f147-9f3b-4180-a462-aebd0e6162ac] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:30.288585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:30.294822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-53c81832-c9f5-4ac0-bbe9-a9080cd8f229 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:30.296017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-53c81832-c9f5-4ac0-bbe9-a9080cd8f229 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:30.296796 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-53c81832-c9f5-4ac0-bbe9-a9080cd8f229 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:30.297675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-53c81832-c9f5-4ac0-bbe9-a9080cd8f229 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:30.298279 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-53c81832-c9f5-4ac0-bbe9-a9080cd8f229 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:30.299147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-53c81832-c9f5-4ac0-bbe9-a9080cd8f229 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:30.446914 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-37b90638-3966-4b6b-a8af-49414a913735 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7fb41c95104b4bb9ad66ba2457f994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa34bf618bf4e2e94d55b9b1fff3003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:30.457229 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-37b90638-3966-4b6b-a8af-49414a913735 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "GET /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7" status: 200 len: 1313 microversion: 2.1 time: 0.297433 Oct 29 03:26:30.458032 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2824/5868] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:30 2022] GET /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7 => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:26:30.568027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-53c81832-c9f5-4ac0-bbe9-a9080cd8f229 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c633d65d3754c0bb47a7cb8754a97cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e202cdaad65452fa00963abd83004b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:30.577813 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-53c81832-c9f5-4ac0-bbe9-a9080cd8f229 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "GET /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac" status: 200 len: 1319 microversion: 2.1 time: 0.298208 Oct 29 03:26:30.579036 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3045/5869] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:30 2022] GET /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:26:31.172506 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-66593205-654d-41d5-ba8d-f9367cfbe10e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:31.173379 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-66593205-654d-41d5-ba8d-f9367cfbe10e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:31.183520 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-66593205-654d-41d5-ba8d-f9367cfbe10e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:31.187268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-66593205-654d-41d5-ba8d-f9367cfbe10e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:31.188933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-66593205-654d-41d5-ba8d-f9367cfbe10e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:31.189962 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-66593205-654d-41d5-ba8d-f9367cfbe10e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:31.194130 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-66593205-654d-41d5-ba8d-f9367cfbe10e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:31.195937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-66593205-654d-41d5-ba8d-f9367cfbe10e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:31.252451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-b73e5509-46ef-41e6-bba2-05103ed90255 req-02729cc9-5c15-47e8-b180-f0559fa64b36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fef762d-0fbd-4850-8733-a53aeeb908b7", "tag": "81a7bc22-ec11-4257-a31d-cb7f0ee3119d"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:31.276263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b73e5509-46ef-41e6-bba2-05103ed90255 req-02729cc9-5c15-47e8-b180-f0559fa64b36 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:31.277173 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b73e5509-46ef-41e6-bba2-05103ed90255 req-02729cc9-5c15-47e8-b180-f0559fa64b36 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:31.277757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b73e5509-46ef-41e6-bba2-05103ed90255 req-02729cc9-5c15-47e8-b180-f0559fa64b36 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:31.307091 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-b73e5509-46ef-41e6-bba2-05103ed90255 req-02729cc9-5c15-47e8-b180-f0559fa64b36 service nova] Creating event network-changed:81a7bc22-ec11-4257-a31d-cb7f0ee3119d for instance 9fef762d-0fbd-4850-8733-a53aeeb908b7 on n-h1-862967-2 Oct 29 03:26:31.313383 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-b73e5509-46ef-41e6-bba2-05103ed90255 req-02729cc9-5c15-47e8-b180-f0559fa64b36 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065838 Oct 29 03:26:31.321105 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3046/5870] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:26:31.482110 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9d4266ff-8b3c-4fb0-be17-87f66005a7e5 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:31.482867 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9d4266ff-8b3c-4fb0-be17-87f66005a7e5 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 9fef762d-0fbd-4850-8733-a53aeeb908b7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:31.508614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d4266ff-8b3c-4fb0-be17-87f66005a7e5 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:31.509404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d4266ff-8b3c-4fb0-be17-87f66005a7e5 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:31.509511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d4266ff-8b3c-4fb0-be17-87f66005a7e5 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:31.510287 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d4266ff-8b3c-4fb0-be17-87f66005a7e5 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:31.510740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d4266ff-8b3c-4fb0-be17-87f66005a7e5 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:31.511158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d4266ff-8b3c-4fb0-be17-87f66005a7e5 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:31.629087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-66593205-654d-41d5-ba8d-f9367cfbe10e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:31.640478 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-66593205-654d-41d5-ba8d-f9367cfbe10e tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1510 microversion: 2.1 time: 0.471000 Oct 29 03:26:31.642930 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2825/5871] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:31 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1510 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:31.661036 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f21fe2fc-368b-402c-aa2e-075b4e580983 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:31.662228 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f21fe2fc-368b-402c-aa2e-075b4e580983 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: 09a0f147-9f3b-4180-a462-aebd0e6162ac] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:31.685736 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:31.688785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f21fe2fc-368b-402c-aa2e-075b4e580983 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:31.689317 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f21fe2fc-368b-402c-aa2e-075b4e580983 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:31.690557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f21fe2fc-368b-402c-aa2e-075b4e580983 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:31.691475 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f21fe2fc-368b-402c-aa2e-075b4e580983 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:31.691939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f21fe2fc-368b-402c-aa2e-075b4e580983 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:31.692368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f21fe2fc-368b-402c-aa2e-075b4e580983 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:31.762370 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9d4266ff-8b3c-4fb0-be17-87f66005a7e5 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7fb41c95104b4bb9ad66ba2457f994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa34bf618bf4e2e94d55b9b1fff3003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:31.773556 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9d4266ff-8b3c-4fb0-be17-87f66005a7e5 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "GET /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7" status: 200 len: 1313 microversion: 2.1 time: 0.296006 Oct 29 03:26:31.784188 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3047/5872] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:31 2022] GET /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7 => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:26:32.005104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f21fe2fc-368b-402c-aa2e-075b4e580983 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c633d65d3754c0bb47a7cb8754a97cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e202cdaad65452fa00963abd83004b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:32.016356 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f21fe2fc-368b-402c-aa2e-075b4e580983 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "GET /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac" status: 200 len: 1508 microversion: 2.1 time: 0.372149 Oct 29 03:26:32.017618 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2826/5873] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:31 2022] GET /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac => generated 1508 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:32.579904 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8cad2e47-69fe-4b54-b023-b2c9bbbb613d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '.version_select at 0x7ff053a533a0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:32.608509 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8cad2e47-69fe-4b54-b023-b2c9bbbb613d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1868872300" status: 202 len: 0 microversion: 2.1 time: 0.033340 Oct 29 03:26:32.609667 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3048/5874] 10.222.0.46 () {58 vars in 1284 bytes} [Sat Oct 29 03:26:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1868872300 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:26:32.639631 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-05e37ccc-4406-4919-8c7c-c452f9ae82dc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Action: 'create', calling method: .version_select at 0x7ff053704160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-992895734", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5VePR3mcD+V3SPKr9ygn5QniNIUdEHF1nOLbbYHy5YsU5hRQdjQE3IvrygdWna58eDbQD2TwuQxLJlfKUmgfpud5qqquTadbRWKZM8zEz36oIEbGkVJQRXwK/1GdEM8g=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:32.657752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-05e37ccc-4406-4919-8c7c-c452f9ae82dc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Getting quotas for project c898299eb0444aa1a1983fb127153c65. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:26:32.663555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ceb7b205-3fd4-4644-98fb-9243234da18b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:32.663960 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-05e37ccc-4406-4919-8c7c-c452f9ae82dc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Getting quotas for user 789295d938084ee3b7d618690fee5bfa and project c898299eb0444aa1a1983fb127153c65. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:26:32.664172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ceb7b205-3fd4-4644-98fb-9243234da18b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:32.672119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ceb7b205-3fd4-4644-98fb-9243234da18b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:32.672814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ceb7b205-3fd4-4644-98fb-9243234da18b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:32.673245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ceb7b205-3fd4-4644-98fb-9243234da18b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:32.674104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ceb7b205-3fd4-4644-98fb-9243234da18b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:32.674597 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ceb7b205-3fd4-4644-98fb-9243234da18b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:32.675024 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ceb7b205-3fd4-4644-98fb-9243234da18b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:32.694048 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-05e37ccc-4406-4919-8c7c-c452f9ae82dc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.059340 Oct 29 03:26:32.694845 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2827/5875] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:26:32 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:26:32.797948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c8dfef4a-8b25-46a3-98a8-6543d9ef43da tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:32.798808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c8dfef4a-8b25-46a3-98a8-6543d9ef43da tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 9fef762d-0fbd-4850-8733-a53aeeb908b7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:32.805433 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8dfef4a-8b25-46a3-98a8-6543d9ef43da tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:32.806093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8dfef4a-8b25-46a3-98a8-6543d9ef43da tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:32.806705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8dfef4a-8b25-46a3-98a8-6543d9ef43da tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:32.807571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8dfef4a-8b25-46a3-98a8-6543d9ef43da tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:32.808178 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8dfef4a-8b25-46a3-98a8-6543d9ef43da tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:32.808775 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c8dfef4a-8b25-46a3-98a8-6543d9ef43da tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:32.842295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ceb7b205-3fd4-4644-98fb-9243234da18b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:32.857485 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ceb7b205-3fd4-4644-98fb-9243234da18b tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1487 microversion: 2.1 time: 0.197638 Oct 29 03:26:32.877501 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3049/5876] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:32 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1487 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:26:32.888245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-83611fb0-2419-4999-88d4-538154b697d3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-788714200"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:32.891283 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-83611fb0-2419-4999-88d4-538154b697d3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:32.898463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83611fb0-2419-4999-88d4-538154b697d3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:32.899237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83611fb0-2419-4999-88d4-538154b697d3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:32.899843 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83611fb0-2419-4999-88d4-538154b697d3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:32.901632 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83611fb0-2419-4999-88d4-538154b697d3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:32.902101 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83611fb0-2419-4999-88d4-538154b697d3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:32.902541 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83611fb0-2419-4999-88d4-538154b697d3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:32.939614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:32.977341 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-83611fb0-2419-4999-88d4-538154b697d3 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "PUT /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1059 microversion: 2.1 time: 0.094263 Oct 29 03:26:32.980581 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3050/5877] 10.222.0.46 () {60 vars in 1256 bytes} [Sat Oct 29 03:26:32 2022] PUT /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1059 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:26:32.996694 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c273037e-0a4e-461a-8365-d9c9832775fb tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:32.997726 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c273037e-0a4e-461a-8365-d9c9832775fb tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:33.006597 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c273037e-0a4e-461a-8365-d9c9832775fb tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:33.007089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c273037e-0a4e-461a-8365-d9c9832775fb tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:33.007524 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c273037e-0a4e-461a-8365-d9c9832775fb tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:33.008338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c273037e-0a4e-461a-8365-d9c9832775fb tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:33.008837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c273037e-0a4e-461a-8365-d9c9832775fb tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:33.009262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c273037e-0a4e-461a-8365-d9c9832775fb tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:33.155006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c273037e-0a4e-461a-8365-d9c9832775fb tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:33.166478 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c273037e-0a4e-461a-8365-d9c9832775fb tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1486 microversion: 2.1 time: 0.173653 Oct 29 03:26:33.167072 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3051/5878] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:32 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1486 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:26:33.188447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1176deea-93fd-4721-a2e3-bfd3d4da9701 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:33.189222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1176deea-93fd-4721-a2e3-bfd3d4da9701 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:33.195268 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1176deea-93fd-4721-a2e3-bfd3d4da9701 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:33.195754 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1176deea-93fd-4721-a2e3-bfd3d4da9701 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:33.196372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1176deea-93fd-4721-a2e3-bfd3d4da9701 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:33.197314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1176deea-93fd-4721-a2e3-bfd3d4da9701 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:33.197772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1176deea-93fd-4721-a2e3-bfd3d4da9701 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:33.198383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1176deea-93fd-4721-a2e3-bfd3d4da9701 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:33.347540 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1176deea-93fd-4721-a2e3-bfd3d4da9701 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:33.355901 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1176deea-93fd-4721-a2e3-bfd3d4da9701 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1486 microversion: 2.1 time: 0.171481 Oct 29 03:26:33.357310 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3052/5879] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:33 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1486 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:26:33.379772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1961208b-f89f-42fd-964c-b9f204b34e13 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:33.380746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1961208b-f89f-42fd-964c-b9f204b34e13 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:33.389903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1961208b-f89f-42fd-964c-b9f204b34e13 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:33.393118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1961208b-f89f-42fd-964c-b9f204b34e13 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:33.393780 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1961208b-f89f-42fd-964c-b9f204b34e13 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:33.395868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1961208b-f89f-42fd-964c-b9f204b34e13 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:33.397057 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1961208b-f89f-42fd-964c-b9f204b34e13 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:33.397939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1961208b-f89f-42fd-964c-b9f204b34e13 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:33.422481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c8dfef4a-8b25-46a3-98a8-6543d9ef43da tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7fb41c95104b4bb9ad66ba2457f994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa34bf618bf4e2e94d55b9b1fff3003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:33.434384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1961208b-f89f-42fd-964c-b9f204b34e13 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:26:33.438225 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c8dfef4a-8b25-46a3-98a8-6543d9ef43da tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "GET /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7" status: 200 len: 1313 microversion: 2.1 time: 0.642363 Oct 29 03:26:33.439909 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2828/5880] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:32 2022] GET /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7 => generated 1313 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:26:33.538356 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1961208b-f89f-42fd-964c-b9f204b34e13 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 204 len: 0 microversion: 2.1 time: 0.162197 Oct 29 03:26:33.543363 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3053/5881] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:26:33 2022] DELETE /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 03:26:33.548447 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7e4cd149-47b8-468a-9c0e-9e4d270042c6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:33.549313 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7e4cd149-47b8-468a-9c0e-9e4d270042c6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:33.556566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e4cd149-47b8-468a-9c0e-9e4d270042c6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:33.557059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e4cd149-47b8-468a-9c0e-9e4d270042c6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:33.557488 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e4cd149-47b8-468a-9c0e-9e4d270042c6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:33.558395 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e4cd149-47b8-468a-9c0e-9e4d270042c6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:33.560234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e4cd149-47b8-468a-9c0e-9e4d270042c6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:33.562181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7e4cd149-47b8-468a-9c0e-9e4d270042c6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:33.824345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7e4cd149-47b8-468a-9c0e-9e4d270042c6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:33.832712 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7e4cd149-47b8-468a-9c0e-9e4d270042c6 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1492 microversion: 2.1 time: 0.288451 Oct 29 03:26:33.833879 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2829/5882] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:33 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1492 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:34.462413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c0d2f6ba-415a-4d91-800d-ab14a8e0b75a tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:34.463383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c0d2f6ba-415a-4d91-800d-ab14a8e0b75a tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 9fef762d-0fbd-4850-8733-a53aeeb908b7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:34.471203 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0d2f6ba-415a-4d91-800d-ab14a8e0b75a tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:34.472051 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0d2f6ba-415a-4d91-800d-ab14a8e0b75a tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:34.472798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0d2f6ba-415a-4d91-800d-ab14a8e0b75a tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:34.473794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0d2f6ba-415a-4d91-800d-ab14a8e0b75a tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:34.474472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0d2f6ba-415a-4d91-800d-ab14a8e0b75a tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:34.475002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0d2f6ba-415a-4d91-800d-ab14a8e0b75a tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:34.656933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c0d2f6ba-415a-4d91-800d-ab14a8e0b75a tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7fb41c95104b4bb9ad66ba2457f994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa34bf618bf4e2e94d55b9b1fff3003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:34.673338 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c0d2f6ba-415a-4d91-800d-ab14a8e0b75a tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "GET /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7" status: 200 len: 1313 microversion: 2.1 time: 0.214478 Oct 29 03:26:34.675039 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3054/5883] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:34 2022] GET /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:34.858093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f82532e5-1a48-4909-a46b-8c71c00b9099 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:34.858802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f82532e5-1a48-4909-a46b-8c71c00b9099 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:34.867070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f82532e5-1a48-4909-a46b-8c71c00b9099 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:34.867923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f82532e5-1a48-4909-a46b-8c71c00b9099 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:34.868509 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f82532e5-1a48-4909-a46b-8c71c00b9099 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:34.869487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f82532e5-1a48-4909-a46b-8c71c00b9099 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:34.870312 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f82532e5-1a48-4909-a46b-8c71c00b9099 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:34.872823 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f82532e5-1a48-4909-a46b-8c71c00b9099 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:35.194429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f82532e5-1a48-4909-a46b-8c71c00b9099 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:35.221846 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f82532e5-1a48-4909-a46b-8c71c00b9099 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 200 len: 1492 microversion: 2.1 time: 0.370080 Oct 29 03:26:35.222609 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2830/5884] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:34 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 1492 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:35.388474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-06b33588-0e60-401e-8bce-2977fcbc4088 req-5ac3381f-fa63-47ca-a321-1f493b556e4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc904b6-8ece-4639-b5e7-486aa32ec98b", "name": "network-vif-deleted", "tag": "916b5567-39e3-4b1d-b008-a6beab9b8167"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:35.412707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-06b33588-0e60-401e-8bce-2977fcbc4088 req-5ac3381f-fa63-47ca-a321-1f493b556e4e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:35.413657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-06b33588-0e60-401e-8bce-2977fcbc4088 req-5ac3381f-fa63-47ca-a321-1f493b556e4e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:35.414314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-06b33588-0e60-401e-8bce-2977fcbc4088 req-5ac3381f-fa63-47ca-a321-1f493b556e4e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:35.434105 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-06b33588-0e60-401e-8bce-2977fcbc4088 req-5ac3381f-fa63-47ca-a321-1f493b556e4e service nova] Creating event network-vif-deleted:916b5567-39e3-4b1d-b008-a6beab9b8167 for instance 9dc904b6-8ece-4639-b5e7-486aa32ec98b on n-h2-862967-2 Oct 29 03:26:35.439564 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-06b33588-0e60-401e-8bce-2977fcbc4088 req-5ac3381f-fa63-47ca-a321-1f493b556e4e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054977 Oct 29 03:26:35.440847 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3055/5885] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:26:35.699023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6796ac37-623c-44ef-8d21-3663a9f860c7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:35.700337 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6796ac37-623c-44ef-8d21-3663a9f860c7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 9fef762d-0fbd-4850-8733-a53aeeb908b7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:35.712917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6796ac37-623c-44ef-8d21-3663a9f860c7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:35.713893 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6796ac37-623c-44ef-8d21-3663a9f860c7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:35.714605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6796ac37-623c-44ef-8d21-3663a9f860c7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:35.715385 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6796ac37-623c-44ef-8d21-3663a9f860c7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:35.715920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6796ac37-623c-44ef-8d21-3663a9f860c7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:35.716408 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6796ac37-623c-44ef-8d21-3663a9f860c7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:35.990440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6796ac37-623c-44ef-8d21-3663a9f860c7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7fb41c95104b4bb9ad66ba2457f994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa34bf618bf4e2e94d55b9b1fff3003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:36.000986 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6796ac37-623c-44ef-8d21-3663a9f860c7 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "GET /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7" status: 200 len: 1313 microversion: 2.1 time: 0.305799 Oct 29 03:26:36.017326 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2831/5886] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:35 2022] GET /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7 => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:36.249056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c7f98135-94e3-4bbd-aff3-f216ff586d71 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:36.249781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c7f98135-94e3-4bbd-aff3-f216ff586d71 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:36.256773 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c7f98135-94e3-4bbd-aff3-f216ff586d71 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:36.257514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c7f98135-94e3-4bbd-aff3-f216ff586d71 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:36.257957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c7f98135-94e3-4bbd-aff3-f216ff586d71 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:36.258643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c7f98135-94e3-4bbd-aff3-f216ff586d71 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:36.259088 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c7f98135-94e3-4bbd-aff3-f216ff586d71 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:36.259504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c7f98135-94e3-4bbd-aff3-f216ff586d71 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:36.275845 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-c7f98135-94e3-4bbd-aff3-f216ff586d71 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] HTTP exception thrown: Instance 9dc904b6-8ece-4639-b5e7-486aa32ec98b could not be found. Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c7f98135-94e3-4bbd-aff3-f216ff586d71 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Request method failure captured: Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b HTTP/1.1 Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJzN_0W3F2Tvd5_DwYEYaE7yArMUzQkw0yVRFyD806tbuPfgIN9hrPP-pm4QkI5-axnSQL2lFY8Zz_29U2X0iME7rTgOu74wHL71o9B_5IukGwbcOdtvhyWYdmcAPvnUhuYS1WrbTu-q-KzFqGL1fD3An-d36JB4OLVV1PNh19tG-1E Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/af30f7beecad4c448ff0706230ecb8d9"}]}] Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 50ec777bf8ea4a9eb7d9d6cf995ba4ef Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 9dc904b6-8ece-4639-b5e7-486aa32ec98b could not be found. Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '9dc904b6-8ece-4639-b5e7-486aa32ec98b'} Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dc904b6-8ece-4639-b5e7-486aa32ec98b could not be found. Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dc904b6-8ece-4639-b5e7-486aa32ec98b could not be found. Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:36.277579 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.281735 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.281735 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:36.281735 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:36.281735 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:26:36.281735 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:26:36.281735 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dc904b6-8ece-4639-b5e7-486aa32ec98b could not be found. Oct 29 03:26:36.281735 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.281735 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c7f98135-94e3-4bbd-aff3-f216ff586d71 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Returning 404 to user: Instance 9dc904b6-8ece-4639-b5e7-486aa32ec98b could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:26:36.281735 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c7f98135-94e3-4bbd-aff3-f216ff586d71 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 404 len: 111 microversion: 2.1 time: 0.035392 Oct 29 03:26:36.283936 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3056/5887] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:36 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:26:36.294172 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f3fdb29f-8067-4f58-bb27-83bf1accc5a9 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:36.294793 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f3fdb29f-8067-4f58-bb27-83bf1accc5a9 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:36.302654 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3fdb29f-8067-4f58-bb27-83bf1accc5a9 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:36.303254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3fdb29f-8067-4f58-bb27-83bf1accc5a9 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:36.304276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3fdb29f-8067-4f58-bb27-83bf1accc5a9 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:36.305037 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3fdb29f-8067-4f58-bb27-83bf1accc5a9 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:36.305494 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3fdb29f-8067-4f58-bb27-83bf1accc5a9 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:36.305921 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3fdb29f-8067-4f58-bb27-83bf1accc5a9 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:36.324922 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-f3fdb29f-8067-4f58-bb27-83bf1accc5a9 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] HTTP exception thrown: Instance 9dc904b6-8ece-4639-b5e7-486aa32ec98b could not be found. Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f3fdb29f-8067-4f58-bb27-83bf1accc5a9 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Request method failure captured: Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b HTTP/1.1 Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJzN_0W3F2Tvd5_DwYEYaE7yArMUzQkw0yVRFyD806tbuPfgIN9hrPP-pm4QkI5-axnSQL2lFY8Zz_29U2X0iME7rTgOu74wHL71o9B_5IukGwbcOdtvhyWYdmcAPvnUhuYS1WrbTu-q-KzFqGL1fD3An-d36JB4OLVV1PNh19tG-1E Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/af30f7beecad4c448ff0706230ecb8d9"}]}] Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 50ec777bf8ea4a9eb7d9d6cf995ba4ef Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 9dc904b6-8ece-4639-b5e7-486aa32ec98b could not be found. Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '9dc904b6-8ece-4639-b5e7-486aa32ec98b'} Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dc904b6-8ece-4639-b5e7-486aa32ec98b could not be found. Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:26:36.327008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dc904b6-8ece-4639-b5e7-486aa32ec98b could not be found. Oct 29 03:26:36.331292 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.331292 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:36.331292 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.331292 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.331292 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:36.331292 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:36.331292 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:26:36.331292 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:26:36.331292 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dc904b6-8ece-4639-b5e7-486aa32ec98b could not be found. Oct 29 03:26:36.331292 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.331292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f3fdb29f-8067-4f58-bb27-83bf1accc5a9 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Returning 404 to user: Instance 9dc904b6-8ece-4639-b5e7-486aa32ec98b could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:26:36.331292 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f3fdb29f-8067-4f58-bb27-83bf1accc5a9 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 404 len: 111 microversion: 2.1 time: 0.038884 Oct 29 03:26:36.331292 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2832/5888] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:26:36 2022] DELETE /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:26:36.337936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-362a44f3-9f5f-4192-a284-0f6d83019ae2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:36.338556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-362a44f3-9f5f-4192-a284-0f6d83019ae2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 9dc904b6-8ece-4639-b5e7-486aa32ec98b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:36.345655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-362a44f3-9f5f-4192-a284-0f6d83019ae2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:36.346153 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-362a44f3-9f5f-4192-a284-0f6d83019ae2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:36.346589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-362a44f3-9f5f-4192-a284-0f6d83019ae2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:36.347296 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-362a44f3-9f5f-4192-a284-0f6d83019ae2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:36.347749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-362a44f3-9f5f-4192-a284-0f6d83019ae2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:36.348169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-362a44f3-9f5f-4192-a284-0f6d83019ae2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:36.363208 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-362a44f3-9f5f-4192-a284-0f6d83019ae2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] HTTP exception thrown: Instance 9dc904b6-8ece-4639-b5e7-486aa32ec98b could not be found. Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-362a44f3-9f5f-4192-a284-0f6d83019ae2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Request method failure captured: Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b HTTP/1.1 Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJzN_0W3F2Tvd5_DwYEYaE7yArMUzQkw0yVRFyD806tbuPfgIN9hrPP-pm4QkI5-axnSQL2lFY8Zz_29U2X0iME7rTgOu74wHL71o9B_5IukGwbcOdtvhyWYdmcAPvnUhuYS1WrbTu-q-KzFqGL1fD3An-d36JB4OLVV1PNh19tG-1E Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/af30f7beecad4c448ff0706230ecb8d9"}]}] Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 50ec777bf8ea4a9eb7d9d6cf995ba4ef Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 9dc904b6-8ece-4639-b5e7-486aa32ec98b could not be found. Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '9dc904b6-8ece-4639-b5e7-486aa32ec98b'} Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dc904b6-8ece-4639-b5e7-486aa32ec98b could not be found. Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dc904b6-8ece-4639-b5e7-486aa32ec98b could not be found. Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:36.364822 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.369388 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.369388 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:36.369388 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:36.369388 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:26:36.369388 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:26:36.369388 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dc904b6-8ece-4639-b5e7-486aa32ec98b could not be found. Oct 29 03:26:36.369388 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.370424 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-362a44f3-9f5f-4192-a284-0f6d83019ae2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Returning 404 to user: Instance 9dc904b6-8ece-4639-b5e7-486aa32ec98b could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:26:36.372184 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-362a44f3-9f5f-4192-a284-0f6d83019ae2 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b" status: 404 len: 111 microversion: 2.1 time: 0.038657 Oct 29 03:26:36.376048 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3057/5889] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:36 2022] GET /compute/v2.1/servers/9dc904b6-8ece-4639-b5e7-486aa32ec98b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:26:36.382075 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7cc86e46-e481-4b41-bd4c-5485967eb2df tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:36.382903 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7cc86e46-e481-4b41-bd4c-5485967eb2df tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:36.389600 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cc86e46-e481-4b41-bd4c-5485967eb2df tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:36.390087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cc86e46-e481-4b41-bd4c-5485967eb2df tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:36.390544 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cc86e46-e481-4b41-bd4c-5485967eb2df tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:36.391262 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cc86e46-e481-4b41-bd4c-5485967eb2df tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:36.391737 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cc86e46-e481-4b41-bd4c-5485967eb2df tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:36.392163 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7cc86e46-e481-4b41-bd4c-5485967eb2df tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:36.408845 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-7cc86e46-e481-4b41-bd4c-5485967eb2df tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] HTTP exception thrown: Instance 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a could not be found. Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7cc86e46-e481-4b41-bd4c-5485967eb2df tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Request method failure captured: Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a HTTP/1.1 Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJzN_0W3F2Tvd5_DwYEYaE7yArMUzQkw0yVRFyD806tbuPfgIN9hrPP-pm4QkI5-axnSQL2lFY8Zz_29U2X0iME7rTgOu74wHL71o9B_5IukGwbcOdtvhyWYdmcAPvnUhuYS1WrbTu-q-KzFqGL1fD3An-d36JB4OLVV1PNh19tG-1E Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/af30f7beecad4c448ff0706230ecb8d9"}]}] Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 50ec777bf8ea4a9eb7d9d6cf995ba4ef Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a could not be found. Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a'} Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a could not be found. Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:26:36.410556 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a could not be found. Oct 29 03:26:36.415522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.415522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:36.415522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.415522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.415522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:36.415522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:36.415522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:26:36.415522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:26:36.415522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a could not be found. Oct 29 03:26:36.415522 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.415522 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7cc86e46-e481-4b41-bd4c-5485967eb2df tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Returning 404 to user: Instance 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:26:36.415522 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7cc86e46-e481-4b41-bd4c-5485967eb2df tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a" status: 404 len: 111 microversion: 2.1 time: 0.034961 Oct 29 03:26:36.415522 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2833/5890] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:26:36 2022] DELETE /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:26:36.420662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-abb0d10c-7245-4493-b1fb-085af6f28059 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:36.421287 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-abb0d10c-7245-4493-b1fb-085af6f28059 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:36.427817 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abb0d10c-7245-4493-b1fb-085af6f28059 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:36.428305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abb0d10c-7245-4493-b1fb-085af6f28059 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:36.428849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abb0d10c-7245-4493-b1fb-085af6f28059 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:36.429738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abb0d10c-7245-4493-b1fb-085af6f28059 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:36.430201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abb0d10c-7245-4493-b1fb-085af6f28059 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:36.430630 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abb0d10c-7245-4493-b1fb-085af6f28059 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:36.446290 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-abb0d10c-7245-4493-b1fb-085af6f28059 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] HTTP exception thrown: Instance 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a could not be found. Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-abb0d10c-7245-4493-b1fb-085af6f28059 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Request method failure captured: Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a HTTP/1.1 Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJzN_0W3F2Tvd5_DwYEYaE7yArMUzQkw0yVRFyD806tbuPfgIN9hrPP-pm4QkI5-axnSQL2lFY8Zz_29U2X0iME7rTgOu74wHL71o9B_5IukGwbcOdtvhyWYdmcAPvnUhuYS1WrbTu-q-KzFqGL1fD3An-d36JB4OLVV1PNh19tG-1E Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/af30f7beecad4c448ff0706230ecb8d9"}]}] Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 50ec777bf8ea4a9eb7d9d6cf995ba4ef Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a could not be found. Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a'} Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a could not be found. Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a could not be found. Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:36.448143 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.452043 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.452043 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:36.452043 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:36.452043 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:26:36.452043 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:26:36.452043 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a could not be found. Oct 29 03:26:36.452043 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.453703 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-abb0d10c-7245-4493-b1fb-085af6f28059 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Returning 404 to user: Instance 5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:26:36.454744 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-abb0d10c-7245-4493-b1fb-085af6f28059 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a" status: 404 len: 111 microversion: 2.1 time: 0.038080 Oct 29 03:26:36.458340 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3058/5891] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:36 2022] GET /compute/v2.1/servers/5082f1b4-f6ec-43f4-8cf9-1f8a85f6d11a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:26:36.463697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8989b189-8654-4c71-8040-e5235b01a24d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:36.464377 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8989b189-8654-4c71-8040-e5235b01a24d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 73c8d6a3-376b-4cca-83cf-f4ee73114d9d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:36.470588 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8989b189-8654-4c71-8040-e5235b01a24d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:36.471088 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8989b189-8654-4c71-8040-e5235b01a24d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:36.471520 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8989b189-8654-4c71-8040-e5235b01a24d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:36.472226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8989b189-8654-4c71-8040-e5235b01a24d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:36.472718 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8989b189-8654-4c71-8040-e5235b01a24d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:36.473142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8989b189-8654-4c71-8040-e5235b01a24d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:36.488638 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-8989b189-8654-4c71-8040-e5235b01a24d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] HTTP exception thrown: Instance 73c8d6a3-376b-4cca-83cf-f4ee73114d9d could not be found. Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8989b189-8654-4c71-8040-e5235b01a24d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Request method failure captured: Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d HTTP/1.1 Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJzN_0W3F2Tvd5_DwYEYaE7yArMUzQkw0yVRFyD806tbuPfgIN9hrPP-pm4QkI5-axnSQL2lFY8Zz_29U2X0iME7rTgOu74wHL71o9B_5IukGwbcOdtvhyWYdmcAPvnUhuYS1WrbTu-q-KzFqGL1fD3An-d36JB4OLVV1PNh19tG-1E Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/af30f7beecad4c448ff0706230ecb8d9"}]}] Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 50ec777bf8ea4a9eb7d9d6cf995ba4ef Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 73c8d6a3-376b-4cca-83cf-f4ee73114d9d could not be found. Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '73c8d6a3-376b-4cca-83cf-f4ee73114d9d'} Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73c8d6a3-376b-4cca-83cf-f4ee73114d9d could not be found. Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:26:36.490981 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73c8d6a3-376b-4cca-83cf-f4ee73114d9d could not be found. Oct 29 03:26:36.494826 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.494826 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:36.494826 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.494826 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.494826 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:36.494826 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:36.494826 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:26:36.494826 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:26:36.494826 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73c8d6a3-376b-4cca-83cf-f4ee73114d9d could not be found. Oct 29 03:26:36.494826 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.496778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8989b189-8654-4c71-8040-e5235b01a24d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Returning 404 to user: Instance 73c8d6a3-376b-4cca-83cf-f4ee73114d9d could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:26:36.498451 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8989b189-8654-4c71-8040-e5235b01a24d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "DELETE /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d" status: 404 len: 111 microversion: 2.1 time: 0.038434 Oct 29 03:26:36.499226 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2834/5892] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:26:36 2022] DELETE /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:26:36.511304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-329cf794-5857-49d4-8c77-2907f0d286ec tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:36.511304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-329cf794-5857-49d4-8c77-2907f0d286ec tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 73c8d6a3-376b-4cca-83cf-f4ee73114d9d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:36.519244 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-329cf794-5857-49d4-8c77-2907f0d286ec tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:36.519964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-329cf794-5857-49d4-8c77-2907f0d286ec tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:36.520666 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-329cf794-5857-49d4-8c77-2907f0d286ec tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:36.521523 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-329cf794-5857-49d4-8c77-2907f0d286ec tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:36.522361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-329cf794-5857-49d4-8c77-2907f0d286ec tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:36.522877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-329cf794-5857-49d4-8c77-2907f0d286ec tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:36.541969 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-329cf794-5857-49d4-8c77-2907f0d286ec tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] HTTP exception thrown: Instance 73c8d6a3-376b-4cca-83cf-f4ee73114d9d could not be found. Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-329cf794-5857-49d4-8c77-2907f0d286ec tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Request method failure captured: Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d HTTP/1.1 Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJzN_0W3F2Tvd5_DwYEYaE7yArMUzQkw0yVRFyD806tbuPfgIN9hrPP-pm4QkI5-axnSQL2lFY8Zz_29U2X0iME7rTgOu74wHL71o9B_5IukGwbcOdtvhyWYdmcAPvnUhuYS1WrbTu-q-KzFqGL1fD3An-d36JB4OLVV1PNh19tG-1E Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/af30f7beecad4c448ff0706230ecb8d9"}]}] Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 50ec777bf8ea4a9eb7d9d6cf995ba4ef Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 73c8d6a3-376b-4cca-83cf-f4ee73114d9d could not be found. Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '73c8d6a3-376b-4cca-83cf-f4ee73114d9d'} Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73c8d6a3-376b-4cca-83cf-f4ee73114d9d could not be found. Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73c8d6a3-376b-4cca-83cf-f4ee73114d9d could not be found. Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:36.543652 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.551364 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.551364 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:36.551364 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:36.551364 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:26:36.551364 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:26:36.551364 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73c8d6a3-376b-4cca-83cf-f4ee73114d9d could not be found. Oct 29 03:26:36.551364 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.551364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-329cf794-5857-49d4-8c77-2907f0d286ec tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Returning 404 to user: Instance 73c8d6a3-376b-4cca-83cf-f4ee73114d9d could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:26:36.551364 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-329cf794-5857-49d4-8c77-2907f0d286ec tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d" status: 404 len: 111 microversion: 2.1 time: 0.042651 Oct 29 03:26:36.551364 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3059/5893] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:36 2022] GET /compute/v2.1/servers/73c8d6a3-376b-4cca-83cf-f4ee73114d9d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:26:36.557829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d740fd80-c7eb-4c90-8e41-f0b7a9c1e782 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:36.558362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d740fd80-c7eb-4c90-8e41-f0b7a9c1e782 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: e12275ef-76da-4635-a932-4135fb47c20a] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:36.564512 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d740fd80-c7eb-4c90-8e41-f0b7a9c1e782 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:36.565031 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d740fd80-c7eb-4c90-8e41-f0b7a9c1e782 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:36.565995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d740fd80-c7eb-4c90-8e41-f0b7a9c1e782 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:36.568947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d740fd80-c7eb-4c90-8e41-f0b7a9c1e782 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:36.569629 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d740fd80-c7eb-4c90-8e41-f0b7a9c1e782 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:36.569864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d740fd80-c7eb-4c90-8e41-f0b7a9c1e782 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:36.585385 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-d740fd80-c7eb-4c90-8e41-f0b7a9c1e782 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] HTTP exception thrown: Instance e12275ef-76da-4635-a932-4135fb47c20a could not be found. Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d740fd80-c7eb-4c90-8e41-f0b7a9c1e782 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Request method failure captured: Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a HTTP/1.1 Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJzN_0W3F2Tvd5_DwYEYaE7yArMUzQkw0yVRFyD806tbuPfgIN9hrPP-pm4QkI5-axnSQL2lFY8Zz_29U2X0iME7rTgOu74wHL71o9B_5IukGwbcOdtvhyWYdmcAPvnUhuYS1WrbTu-q-KzFqGL1fD3An-d36JB4OLVV1PNh19tG-1E Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/af30f7beecad4c448ff0706230ecb8d9"}]}] Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 50ec777bf8ea4a9eb7d9d6cf995ba4ef Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance e12275ef-76da-4635-a932-4135fb47c20a could not be found. Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'e12275ef-76da-4635-a932-4135fb47c20a'} Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e12275ef-76da-4635-a932-4135fb47c20a could not be found. Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:26:36.587326 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e12275ef-76da-4635-a932-4135fb47c20a could not be found. Oct 29 03:26:36.591080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.591080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:36.591080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.591080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.591080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:36.591080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:36.591080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:26:36.591080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:26:36.591080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e12275ef-76da-4635-a932-4135fb47c20a could not be found. Oct 29 03:26:36.591080 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.591080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d740fd80-c7eb-4c90-8e41-f0b7a9c1e782 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Returning 404 to user: Instance e12275ef-76da-4635-a932-4135fb47c20a could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:26:36.591080 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d740fd80-c7eb-4c90-8e41-f0b7a9c1e782 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a" status: 404 len: 111 microversion: 2.1 time: 0.035122 Oct 29 03:26:36.592686 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2835/5894] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:26:36 2022] DELETE /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:26:36.598297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8901b0b2-83d3-4d0f-9504-e55b4065c6ef tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:36.598914 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8901b0b2-83d3-4d0f-9504-e55b4065c6ef tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: e12275ef-76da-4635-a932-4135fb47c20a] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:36.608575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8901b0b2-83d3-4d0f-9504-e55b4065c6ef tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:36.611399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8901b0b2-83d3-4d0f-9504-e55b4065c6ef tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:36.612197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8901b0b2-83d3-4d0f-9504-e55b4065c6ef tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:36.613052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8901b0b2-83d3-4d0f-9504-e55b4065c6ef tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:36.613565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8901b0b2-83d3-4d0f-9504-e55b4065c6ef tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:36.614034 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8901b0b2-83d3-4d0f-9504-e55b4065c6ef tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:36.631349 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-8901b0b2-83d3-4d0f-9504-e55b4065c6ef tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] HTTP exception thrown: Instance e12275ef-76da-4635-a932-4135fb47c20a could not be found. Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8901b0b2-83d3-4d0f-9504-e55b4065c6ef tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Request method failure captured: Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a HTTP/1.1 Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJzN_0W3F2Tvd5_DwYEYaE7yArMUzQkw0yVRFyD806tbuPfgIN9hrPP-pm4QkI5-axnSQL2lFY8Zz_29U2X0iME7rTgOu74wHL71o9B_5IukGwbcOdtvhyWYdmcAPvnUhuYS1WrbTu-q-KzFqGL1fD3An-d36JB4OLVV1PNh19tG-1E Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/af30f7beecad4c448ff0706230ecb8d9"}]}] Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 50ec777bf8ea4a9eb7d9d6cf995ba4ef Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance e12275ef-76da-4635-a932-4135fb47c20a could not be found. Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'e12275ef-76da-4635-a932-4135fb47c20a'} Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e12275ef-76da-4635-a932-4135fb47c20a could not be found. Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e12275ef-76da-4635-a932-4135fb47c20a could not be found. Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:36.633276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.637169 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.637169 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:36.637169 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:36.637169 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:26:36.637169 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:26:36.637169 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e12275ef-76da-4635-a932-4135fb47c20a could not be found. Oct 29 03:26:36.637169 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.637169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8901b0b2-83d3-4d0f-9504-e55b4065c6ef tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Returning 404 to user: Instance e12275ef-76da-4635-a932-4135fb47c20a could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:26:36.637169 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8901b0b2-83d3-4d0f-9504-e55b4065c6ef tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a" status: 404 len: 111 microversion: 2.1 time: 0.040811 Oct 29 03:26:36.639543 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3060/5895] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:36 2022] GET /compute/v2.1/servers/e12275ef-76da-4635-a932-4135fb47c20a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:26:36.645843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d6a92a20-789f-49f0-bcec-d68ac061a40d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:36.646643 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d6a92a20-789f-49f0-bcec-d68ac061a40d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: d1718402-c25a-437a-a916-4e828bde1d67] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:36.654490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6a92a20-789f-49f0-bcec-d68ac061a40d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:36.655387 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6a92a20-789f-49f0-bcec-d68ac061a40d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:36.656292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6a92a20-789f-49f0-bcec-d68ac061a40d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:36.657388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6a92a20-789f-49f0-bcec-d68ac061a40d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:36.658100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6a92a20-789f-49f0-bcec-d68ac061a40d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:36.658706 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6a92a20-789f-49f0-bcec-d68ac061a40d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:36.677762 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-d6a92a20-789f-49f0-bcec-d68ac061a40d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] HTTP exception thrown: Instance d1718402-c25a-437a-a916-4e828bde1d67 could not be found. Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d6a92a20-789f-49f0-bcec-d68ac061a40d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Request method failure captured: Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67 HTTP/1.1 Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJzN_0W3F2Tvd5_DwYEYaE7yArMUzQkw0yVRFyD806tbuPfgIN9hrPP-pm4QkI5-axnSQL2lFY8Zz_29U2X0iME7rTgOu74wHL71o9B_5IukGwbcOdtvhyWYdmcAPvnUhuYS1WrbTu-q-KzFqGL1fD3An-d36JB4OLVV1PNh19tG-1E Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/af30f7beecad4c448ff0706230ecb8d9"}]}] Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 50ec777bf8ea4a9eb7d9d6cf995ba4ef Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance d1718402-c25a-437a-a916-4e828bde1d67 could not be found. Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'd1718402-c25a-437a-a916-4e828bde1d67'} Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1718402-c25a-437a-a916-4e828bde1d67 could not be found. Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:26:36.680296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1718402-c25a-437a-a916-4e828bde1d67 could not be found. Oct 29 03:26:36.684137 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.684137 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:36.684137 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.684137 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.684137 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:36.684137 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:36.684137 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:26:36.684137 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:26:36.684137 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1718402-c25a-437a-a916-4e828bde1d67 could not be found. Oct 29 03:26:36.684137 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.686821 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d6a92a20-789f-49f0-bcec-d68ac061a40d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Returning 404 to user: Instance d1718402-c25a-437a-a916-4e828bde1d67 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:26:36.687957 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d6a92a20-789f-49f0-bcec-d68ac061a40d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67" status: 404 len: 111 microversion: 2.1 time: 0.046915 Oct 29 03:26:36.689169 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2836/5896] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:26:36 2022] DELETE /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:26:36.697613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d25f473c-67c3-400d-8af0-004123dc3f5d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:36.698576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d25f473c-67c3-400d-8af0-004123dc3f5d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: d1718402-c25a-437a-a916-4e828bde1d67] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:36.707140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d25f473c-67c3-400d-8af0-004123dc3f5d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:36.708027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d25f473c-67c3-400d-8af0-004123dc3f5d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:36.708847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d25f473c-67c3-400d-8af0-004123dc3f5d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:36.709783 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d25f473c-67c3-400d-8af0-004123dc3f5d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:36.711171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d25f473c-67c3-400d-8af0-004123dc3f5d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:36.711905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d25f473c-67c3-400d-8af0-004123dc3f5d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:36.757363 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-d25f473c-67c3-400d-8af0-004123dc3f5d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] HTTP exception thrown: Instance d1718402-c25a-437a-a916-4e828bde1d67 could not be found. Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d25f473c-67c3-400d-8af0-004123dc3f5d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Request method failure captured: Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67 HTTP/1.1 Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJzN_0W3F2Tvd5_DwYEYaE7yArMUzQkw0yVRFyD806tbuPfgIN9hrPP-pm4QkI5-axnSQL2lFY8Zz_29U2X0iME7rTgOu74wHL71o9B_5IukGwbcOdtvhyWYdmcAPvnUhuYS1WrbTu-q-KzFqGL1fD3An-d36JB4OLVV1PNh19tG-1E Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/af30f7beecad4c448ff0706230ecb8d9"}]}] Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 50ec777bf8ea4a9eb7d9d6cf995ba4ef Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance d1718402-c25a-437a-a916-4e828bde1d67 could not be found. Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'd1718402-c25a-437a-a916-4e828bde1d67'} Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1718402-c25a-437a-a916-4e828bde1d67 could not be found. Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1718402-c25a-437a-a916-4e828bde1d67 could not be found. Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:36.761655 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.766320 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.766320 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:36.766320 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:36.766320 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:26:36.766320 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:26:36.766320 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1718402-c25a-437a-a916-4e828bde1d67 could not be found. Oct 29 03:26:36.766320 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.766320 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d25f473c-67c3-400d-8af0-004123dc3f5d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Returning 404 to user: Instance d1718402-c25a-437a-a916-4e828bde1d67 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:26:36.766320 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d25f473c-67c3-400d-8af0-004123dc3f5d tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67" status: 404 len: 111 microversion: 2.1 time: 0.070221 Oct 29 03:26:36.766320 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3061/5897] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:36 2022] GET /compute/v2.1/servers/d1718402-c25a-437a-a916-4e828bde1d67 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:26:36.772809 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a74a2b52-18c5-422d-a3c6-093eaaada240 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:36.773320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a74a2b52-18c5-422d-a3c6-093eaaada240 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 925ba68c-9ad9-4da3-ab7c-9a2118eed63e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:36.780336 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a74a2b52-18c5-422d-a3c6-093eaaada240 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:36.780844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a74a2b52-18c5-422d-a3c6-093eaaada240 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:36.781141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a74a2b52-18c5-422d-a3c6-093eaaada240 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:36.781788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a74a2b52-18c5-422d-a3c6-093eaaada240 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:36.782243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a74a2b52-18c5-422d-a3c6-093eaaada240 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:36.782668 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a74a2b52-18c5-422d-a3c6-093eaaada240 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:36.801876 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-a74a2b52-18c5-422d-a3c6-093eaaada240 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] HTTP exception thrown: Instance 925ba68c-9ad9-4da3-ab7c-9a2118eed63e could not be found. Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a74a2b52-18c5-422d-a3c6-093eaaada240 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Request method failure captured: Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e HTTP/1.1 Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJzN_0W3F2Tvd5_DwYEYaE7yArMUzQkw0yVRFyD806tbuPfgIN9hrPP-pm4QkI5-axnSQL2lFY8Zz_29U2X0iME7rTgOu74wHL71o9B_5IukGwbcOdtvhyWYdmcAPvnUhuYS1WrbTu-q-KzFqGL1fD3An-d36JB4OLVV1PNh19tG-1E Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/af30f7beecad4c448ff0706230ecb8d9"}]}] Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 50ec777bf8ea4a9eb7d9d6cf995ba4ef Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 925ba68c-9ad9-4da3-ab7c-9a2118eed63e could not be found. Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '925ba68c-9ad9-4da3-ab7c-9a2118eed63e'} Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 925ba68c-9ad9-4da3-ab7c-9a2118eed63e could not be found. Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:26:36.803667 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 925ba68c-9ad9-4da3-ab7c-9a2118eed63e could not be found. Oct 29 03:26:36.807769 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.807769 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:36.807769 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.807769 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.807769 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:36.807769 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:36.807769 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:26:36.807769 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:26:36.807769 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 925ba68c-9ad9-4da3-ab7c-9a2118eed63e could not be found. Oct 29 03:26:36.807769 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.807769 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a74a2b52-18c5-422d-a3c6-093eaaada240 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Returning 404 to user: Instance 925ba68c-9ad9-4da3-ab7c-9a2118eed63e could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:26:36.807769 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a74a2b52-18c5-422d-a3c6-093eaaada240 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "DELETE /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e" status: 404 len: 111 microversion: 2.1 time: 0.038614 Oct 29 03:26:36.808490 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2837/5898] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:26:36 2022] DELETE /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:26:36.817045 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-becfa25d-621b-4b4e-8b09-607d849594ab tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:36.817844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-becfa25d-621b-4b4e-8b09-607d849594ab tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 925ba68c-9ad9-4da3-ab7c-9a2118eed63e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:36.833079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-becfa25d-621b-4b4e-8b09-607d849594ab tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:36.834560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-becfa25d-621b-4b4e-8b09-607d849594ab tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:36.835801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-becfa25d-621b-4b4e-8b09-607d849594ab tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:36.839308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-becfa25d-621b-4b4e-8b09-607d849594ab tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:36.839813 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-becfa25d-621b-4b4e-8b09-607d849594ab tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:36.840274 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-becfa25d-621b-4b4e-8b09-607d849594ab tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:36.882003 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-becfa25d-621b-4b4e-8b09-607d849594ab tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] HTTP exception thrown: Instance 925ba68c-9ad9-4da3-ab7c-9a2118eed63e could not be found. Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-becfa25d-621b-4b4e-8b09-607d849594ab tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Request method failure captured: Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e HTTP/1.1 Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJzN_0W3F2Tvd5_DwYEYaE7yArMUzQkw0yVRFyD806tbuPfgIN9hrPP-pm4QkI5-axnSQL2lFY8Zz_29U2X0iME7rTgOu74wHL71o9B_5IukGwbcOdtvhyWYdmcAPvnUhuYS1WrbTu-q-KzFqGL1fD3An-d36JB4OLVV1PNh19tG-1E Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/af30f7beecad4c448ff0706230ecb8d9"}]}] Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 50ec777bf8ea4a9eb7d9d6cf995ba4ef Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 925ba68c-9ad9-4da3-ab7c-9a2118eed63e could not be found. Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '925ba68c-9ad9-4da3-ab7c-9a2118eed63e'} Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 925ba68c-9ad9-4da3-ab7c-9a2118eed63e could not be found. Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 925ba68c-9ad9-4da3-ab7c-9a2118eed63e could not be found. Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:36.885168 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.890399 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.890399 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:36.890399 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:36.890399 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:26:36.890399 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:26:36.890399 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 925ba68c-9ad9-4da3-ab7c-9a2118eed63e could not be found. Oct 29 03:26:36.890399 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.893320 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-becfa25d-621b-4b4e-8b09-607d849594ab tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Returning 404 to user: Instance 925ba68c-9ad9-4da3-ab7c-9a2118eed63e could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:26:36.894544 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-becfa25d-621b-4b4e-8b09-607d849594ab tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e" status: 404 len: 111 microversion: 2.1 time: 0.082222 Oct 29 03:26:36.895619 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3062/5899] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:36 2022] GET /compute/v2.1/servers/925ba68c-9ad9-4da3-ab7c-9a2118eed63e => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:26:36.904029 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ba7a9542-555a-4d6b-92e4-dde5d3435a41 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:36.904575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ba7a9542-555a-4d6b-92e4-dde5d3435a41 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: caf24fbc-76ec-4028-ba07-62ce8514cfa6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:36.914328 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-ba7a9542-555a-4d6b-92e4-dde5d3435a41 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] HTTP exception thrown: Instance caf24fbc-76ec-4028-ba07-62ce8514cfa6 could not be found. Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ba7a9542-555a-4d6b-92e4-dde5d3435a41 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Request method failure captured: Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/caf24fbc-76ec-4028-ba07-62ce8514cfa6 HTTP/1.1 Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJzN_0W3F2Tvd5_DwYEYaE7yArMUzQkw0yVRFyD806tbuPfgIN9hrPP-pm4QkI5-axnSQL2lFY8Zz_29U2X0iME7rTgOu74wHL71o9B_5IukGwbcOdtvhyWYdmcAPvnUhuYS1WrbTu-q-KzFqGL1fD3An-d36JB4OLVV1PNh19tG-1E Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/af30f7beecad4c448ff0706230ecb8d9"}]}] Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 50ec777bf8ea4a9eb7d9d6cf995ba4ef Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance caf24fbc-76ec-4028-ba07-62ce8514cfa6 could not be found. Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'caf24fbc-76ec-4028-ba07-62ce8514cfa6'} Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caf24fbc-76ec-4028-ba07-62ce8514cfa6 could not be found. Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caf24fbc-76ec-4028-ba07-62ce8514cfa6 could not be found. Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:36.916671 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.921811 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.921811 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:36.921811 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:36.921811 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:26:36.921811 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:26:36.921811 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caf24fbc-76ec-4028-ba07-62ce8514cfa6 could not be found. Oct 29 03:26:36.921811 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.921811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ba7a9542-555a-4d6b-92e4-dde5d3435a41 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Returning 404 to user: Instance caf24fbc-76ec-4028-ba07-62ce8514cfa6 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:26:36.921811 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ba7a9542-555a-4d6b-92e4-dde5d3435a41 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "DELETE /compute/v2.1/servers/caf24fbc-76ec-4028-ba07-62ce8514cfa6" status: 404 len: 111 microversion: 2.1 time: 0.019585 Oct 29 03:26:36.927515 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2838/5900] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:26:36 2022] DELETE /compute/v2.1/servers/caf24fbc-76ec-4028-ba07-62ce8514cfa6 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:26:36.936212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d1edfcc9-8e4e-4f3b-be3b-8e0e8ef7a61a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:36.938150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d1edfcc9-8e4e-4f3b-be3b-8e0e8ef7a61a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: caf24fbc-76ec-4028-ba07-62ce8514cfa6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:36.951646 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-d1edfcc9-8e4e-4f3b-be3b-8e0e8ef7a61a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] HTTP exception thrown: Instance caf24fbc-76ec-4028-ba07-62ce8514cfa6 could not be found. Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d1edfcc9-8e4e-4f3b-be3b-8e0e8ef7a61a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Request method failure captured: Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/caf24fbc-76ec-4028-ba07-62ce8514cfa6 HTTP/1.1 Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJzN_0W3F2Tvd5_DwYEYaE7yArMUzQkw0yVRFyD806tbuPfgIN9hrPP-pm4QkI5-axnSQL2lFY8Zz_29U2X0iME7rTgOu74wHL71o9B_5IukGwbcOdtvhyWYdmcAPvnUhuYS1WrbTu-q-KzFqGL1fD3An-d36JB4OLVV1PNh19tG-1E Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/af30f7beecad4c448ff0706230ecb8d9"}]}] Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 50ec777bf8ea4a9eb7d9d6cf995ba4ef Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance caf24fbc-76ec-4028-ba07-62ce8514cfa6 could not be found. Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'caf24fbc-76ec-4028-ba07-62ce8514cfa6'} Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caf24fbc-76ec-4028-ba07-62ce8514cfa6 could not be found. Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caf24fbc-76ec-4028-ba07-62ce8514cfa6 could not be found. Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:36.959651 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:36.963857 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:36.963857 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:26:36.963857 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:26:36.963857 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caf24fbc-76ec-4028-ba07-62ce8514cfa6 could not be found. Oct 29 03:26:36.963857 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:36.963857 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d1edfcc9-8e4e-4f3b-be3b-8e0e8ef7a61a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Returning 404 to user: Instance caf24fbc-76ec-4028-ba07-62ce8514cfa6 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:26:36.963857 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d1edfcc9-8e4e-4f3b-be3b-8e0e8ef7a61a tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/caf24fbc-76ec-4028-ba07-62ce8514cfa6" status: 404 len: 111 microversion: 2.1 time: 0.032724 Oct 29 03:26:36.963857 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3063/5901] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:36 2022] GET /compute/v2.1/servers/caf24fbc-76ec-4028-ba07-62ce8514cfa6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:26:36.971526 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ca1ac7ba-e2e4-4c1b-871f-1ee436459921 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:36.973327 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ca1ac7ba-e2e4-4c1b-871f-1ee436459921 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 27b96381-fce8-4748-b7e8-01b474c7067c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:36.983071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ca1ac7ba-e2e4-4c1b-871f-1ee436459921 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:36.983971 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ca1ac7ba-e2e4-4c1b-871f-1ee436459921 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:36.984681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ca1ac7ba-e2e4-4c1b-871f-1ee436459921 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:36.985604 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ca1ac7ba-e2e4-4c1b-871f-1ee436459921 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:36.986044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ca1ac7ba-e2e4-4c1b-871f-1ee436459921 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:36.986615 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ca1ac7ba-e2e4-4c1b-871f-1ee436459921 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:37.017062 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ca1ac7ba-e2e4-4c1b-871f-1ee436459921 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 27b96381-fce8-4748-b7e8-01b474c7067c] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:26:37.026124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b22ff809-3be1-4e0e-a4fa-e7f4cf64b4c5 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:37.026769 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b22ff809-3be1-4e0e-a4fa-e7f4cf64b4c5 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 9fef762d-0fbd-4850-8733-a53aeeb908b7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:37.040014 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b22ff809-3be1-4e0e-a4fa-e7f4cf64b4c5 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:37.044555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b22ff809-3be1-4e0e-a4fa-e7f4cf64b4c5 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:37.045035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b22ff809-3be1-4e0e-a4fa-e7f4cf64b4c5 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:37.045834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b22ff809-3be1-4e0e-a4fa-e7f4cf64b4c5 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:37.046303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b22ff809-3be1-4e0e-a4fa-e7f4cf64b4c5 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:37.046737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b22ff809-3be1-4e0e-a4fa-e7f4cf64b4c5 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:37.075142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:37.171080 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ca1ac7ba-e2e4-4c1b-871f-1ee436459921 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "DELETE /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c" status: 204 len: 0 microversion: 2.1 time: 0.204414 Oct 29 03:26:37.172455 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2839/5902] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:26:36 2022] DELETE /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:26:37.181003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-007e5aa8-01b8-4726-a6ed-274c6723dca3 req-f5c9555b-92cb-4d48-9495-ce0b5c4c3d02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fef762d-0fbd-4850-8733-a53aeeb908b7", "name": "network-vif-plugged", "status": "completed", "tag": "81a7bc22-ec11-4257-a31d-cb7f0ee3119d"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:37.194353 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-007e5aa8-01b8-4726-a6ed-274c6723dca3 req-f5c9555b-92cb-4d48-9495-ce0b5c4c3d02 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:37.195149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-007e5aa8-01b8-4726-a6ed-274c6723dca3 req-f5c9555b-92cb-4d48-9495-ce0b5c4c3d02 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:37.195764 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-007e5aa8-01b8-4726-a6ed-274c6723dca3 req-f5c9555b-92cb-4d48-9495-ce0b5c4c3d02 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:37.214055 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-007e5aa8-01b8-4726-a6ed-274c6723dca3 req-f5c9555b-92cb-4d48-9495-ce0b5c4c3d02 service nova] Creating event network-vif-plugged:81a7bc22-ec11-4257-a31d-cb7f0ee3119d for instance 9fef762d-0fbd-4850-8733-a53aeeb908b7 on n-h1-862967-2 Oct 29 03:26:37.220215 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-007e5aa8-01b8-4726-a6ed-274c6723dca3 req-f5c9555b-92cb-4d48-9495-ce0b5c4c3d02 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046123 Oct 29 03:26:37.222163 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2840/5903] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:26:37.228231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6cfec44a-ae42-4e72-9e3a-df59ce377b96 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:37.229309 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6cfec44a-ae42-4e72-9e3a-df59ce377b96 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 27b96381-fce8-4748-b7e8-01b474c7067c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:37.238513 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6cfec44a-ae42-4e72-9e3a-df59ce377b96 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:37.239360 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6cfec44a-ae42-4e72-9e3a-df59ce377b96 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:37.239999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6cfec44a-ae42-4e72-9e3a-df59ce377b96 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:37.240996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6cfec44a-ae42-4e72-9e3a-df59ce377b96 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:37.241654 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6cfec44a-ae42-4e72-9e3a-df59ce377b96 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:37.242410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6cfec44a-ae42-4e72-9e3a-df59ce377b96 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:37.273583 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b22ff809-3be1-4e0e-a4fa-e7f4cf64b4c5 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7fb41c95104b4bb9ad66ba2457f994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa34bf618bf4e2e94d55b9b1fff3003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:37.295581 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b22ff809-3be1-4e0e-a4fa-e7f4cf64b4c5 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "GET /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7" status: 200 len: 1313 microversion: 2.1 time: 0.273917 Oct 29 03:26:37.296970 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3064/5904] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:37 2022] GET /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:37.590140 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6cfec44a-ae42-4e72-9e3a-df59ce377b96 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:37.608580 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6cfec44a-ae42-4e72-9e3a-df59ce377b96 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c" status: 200 len: 1476 microversion: 2.1 time: 0.384973 Oct 29 03:26:37.611229 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2841/5905] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:37 2022] GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c => generated 1476 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:38.322358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ccf245d2-7e5a-496c-9b17-ff4e72613794 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:38.324066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ccf245d2-7e5a-496c-9b17-ff4e72613794 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 9fef762d-0fbd-4850-8733-a53aeeb908b7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:38.327481 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:38.329188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=18 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:38.346211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ccf245d2-7e5a-496c-9b17-ff4e72613794 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:38.347757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ccf245d2-7e5a-496c-9b17-ff4e72613794 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:38.348306 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ccf245d2-7e5a-496c-9b17-ff4e72613794 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:38.349073 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ccf245d2-7e5a-496c-9b17-ff4e72613794 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:38.349532 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ccf245d2-7e5a-496c-9b17-ff4e72613794 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:38.349963 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ccf245d2-7e5a-496c-9b17-ff4e72613794 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:38.637412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6a2008bd-f563-4282-9f86-c8c9b7a68019 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:38.639446 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6a2008bd-f563-4282-9f86-c8c9b7a68019 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 27b96381-fce8-4748-b7e8-01b474c7067c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:38.661580 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a2008bd-f563-4282-9f86-c8c9b7a68019 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:38.662511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a2008bd-f563-4282-9f86-c8c9b7a68019 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:38.662956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a2008bd-f563-4282-9f86-c8c9b7a68019 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:38.665042 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a2008bd-f563-4282-9f86-c8c9b7a68019 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:38.665879 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a2008bd-f563-4282-9f86-c8c9b7a68019 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:38.665986 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a2008bd-f563-4282-9f86-c8c9b7a68019 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:38.751197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ccf245d2-7e5a-496c-9b17-ff4e72613794 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7fb41c95104b4bb9ad66ba2457f994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa34bf618bf4e2e94d55b9b1fff3003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:38.765280 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ccf245d2-7e5a-496c-9b17-ff4e72613794 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "GET /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7" status: 200 len: 1313 microversion: 2.1 time: 0.448527 Oct 29 03:26:38.765891 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3065/5906] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:38 2022] GET /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7 => generated 1313 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:39.220939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6a2008bd-f563-4282-9f86-c8c9b7a68019 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ec777bf8ea4a9eb7d9d6cf995ba4ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af30f7beecad4c448ff0706230ecb8d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:39.234000 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6a2008bd-f563-4282-9f86-c8c9b7a68019 tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c" status: 200 len: 1476 microversion: 2.1 time: 0.602933 Oct 29 03:26:39.261001 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2842/5907] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:38 2022] GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c => generated 1476 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:39.353288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-61c67654-cfe4-41c3-8e04-22634da2248c req-e969a381-66ba-42ae-ac2a-6fa226938c73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b96381-fce8-4748-b7e8-01b474c7067c", "name": "network-vif-deleted", "tag": "6084388e-a2b4-4f6a-9edf-b57ee1197683"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:39.367619 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-61c67654-cfe4-41c3-8e04-22634da2248c req-e969a381-66ba-42ae-ac2a-6fa226938c73 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:39.372041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-61c67654-cfe4-41c3-8e04-22634da2248c req-e969a381-66ba-42ae-ac2a-6fa226938c73 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:39.372805 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-61c67654-cfe4-41c3-8e04-22634da2248c req-e969a381-66ba-42ae-ac2a-6fa226938c73 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:39.409713 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-61c67654-cfe4-41c3-8e04-22634da2248c req-e969a381-66ba-42ae-ac2a-6fa226938c73 service nova] Creating event network-vif-deleted:6084388e-a2b4-4f6a-9edf-b57ee1197683 for instance 27b96381-fce8-4748-b7e8-01b474c7067c on n-h2-862967-2 Oct 29 03:26:39.429472 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-61c67654-cfe4-41c3-8e04-22634da2248c req-e969a381-66ba-42ae-ac2a-6fa226938c73 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075103 Oct 29 03:26:39.440202 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3066/5908] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:26:39.791847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f4505b67-9754-4b77-be25-287ac1c46d50 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:39.793599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f4505b67-9754-4b77-be25-287ac1c46d50 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 9fef762d-0fbd-4850-8733-a53aeeb908b7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:39.806553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4505b67-9754-4b77-be25-287ac1c46d50 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:39.807999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4505b67-9754-4b77-be25-287ac1c46d50 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:39.808644 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4505b67-9754-4b77-be25-287ac1c46d50 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:39.809539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4505b67-9754-4b77-be25-287ac1c46d50 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:39.810179 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4505b67-9754-4b77-be25-287ac1c46d50 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:39.811067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4505b67-9754-4b77-be25-287ac1c46d50 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:40.179204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f4505b67-9754-4b77-be25-287ac1c46d50 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7fb41c95104b4bb9ad66ba2457f994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa34bf618bf4e2e94d55b9b1fff3003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:40.205417 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f4505b67-9754-4b77-be25-287ac1c46d50 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "GET /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7" status: 200 len: 1497 microversion: 2.1 time: 0.419499 Oct 29 03:26:40.206899 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2843/5909] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:39 2022] GET /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7 => generated 1497 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:40.262148 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5b3ac424-3eda-4b5b-80fe-6a7b7374750c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:40.263028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5b3ac424-3eda-4b5b-80fe-6a7b7374750c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] [instance: 27b96381-fce8-4748-b7e8-01b474c7067c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:40.277066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b3ac424-3eda-4b5b-80fe-6a7b7374750c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:40.277585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b3ac424-3eda-4b5b-80fe-6a7b7374750c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:40.278965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b3ac424-3eda-4b5b-80fe-6a7b7374750c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:40.280414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b3ac424-3eda-4b5b-80fe-6a7b7374750c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:40.280901 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b3ac424-3eda-4b5b-80fe-6a7b7374750c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:40.281338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b3ac424-3eda-4b5b-80fe-6a7b7374750c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:40.304988 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-5b3ac424-3eda-4b5b-80fe-6a7b7374750c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] HTTP exception thrown: Instance 27b96381-fce8-4748-b7e8-01b474c7067c could not be found. Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5b3ac424-3eda-4b5b-80fe-6a7b7374750c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Request method failure captured: Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c HTTP/1.1 Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJzN_0W3F2Tvd5_DwYEYaE7yArMUzQkw0yVRFyD806tbuPfgIN9hrPP-pm4QkI5-axnSQL2lFY8Zz_29U2X0iME7rTgOu74wHL71o9B_5IukGwbcOdtvhyWYdmcAPvnUhuYS1WrbTu-q-KzFqGL1fD3An-d36JB4OLVV1PNh19tG-1E Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_af30f7beecad4c448ff0706230ecb8d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/af30f7beecad4c448ff0706230ecb8d9"}]}] Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersTestJSON-1972911719 Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: af30f7beecad4c448ff0706230ecb8d9 Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersTestJSON-1972911719 Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 50ec777bf8ea4a9eb7d9d6cf995ba4ef Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersTestJSON-1972911719-project Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 27b96381-fce8-4748-b7e8-01b474c7067c could not be found. Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '27b96381-fce8-4748-b7e8-01b474c7067c'} Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27b96381-fce8-4748-b7e8-01b474c7067c could not be found. Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27b96381-fce8-4748-b7e8-01b474c7067c could not be found. Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:40.307316 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:40.311319 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:40.311319 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:40.311319 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:40.311319 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:26:40.311319 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:26:40.311319 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27b96381-fce8-4748-b7e8-01b474c7067c could not be found. Oct 29 03:26:40.311319 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:26:40.315600 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5b3ac424-3eda-4b5b-80fe-6a7b7374750c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] Returning 404 to user: Instance 27b96381-fce8-4748-b7e8-01b474c7067c could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:26:40.316897 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5b3ac424-3eda-4b5b-80fe-6a7b7374750c tempest-ServersTestJSON-1972911719 tempest-ServersTestJSON-1972911719-project] 10.222.0.46 "GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c" status: 404 len: 111 microversion: 2.1 time: 0.060753 Oct 29 03:26:40.318023 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3067/5910] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:40 2022] GET /compute/v2.1/servers/27b96381-fce8-4748-b7e8-01b474c7067c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:26:40.923722 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a3f1bfa3-620c-42db-a081-2725936ccfac tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:40.924302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a3f1bfa3-620c-42db-a081-2725936ccfac tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 9fef762d-0fbd-4850-8733-a53aeeb908b7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:40.937250 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3f1bfa3-620c-42db-a081-2725936ccfac tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:40.937759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3f1bfa3-620c-42db-a081-2725936ccfac tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:40.938191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3f1bfa3-620c-42db-a081-2725936ccfac tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:40.938899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3f1bfa3-620c-42db-a081-2725936ccfac tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:40.939342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3f1bfa3-620c-42db-a081-2725936ccfac tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:40.939759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3f1bfa3-620c-42db-a081-2725936ccfac tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:41.008064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a3f1bfa3-620c-42db-a081-2725936ccfac tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 9fef762d-0fbd-4850-8733-a53aeeb908b7] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:26:41.190273 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a3f1bfa3-620c-42db-a081-2725936ccfac tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7" status: 204 len: 0 microversion: 2.1 time: 0.270255 Oct 29 03:26:41.196927 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2844/5911] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:26:40 2022] DELETE /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:26:41.199992 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b764ab29-6982-4d4f-b9b3-c8cf7c3e8cb2 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:41.200662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b764ab29-6982-4d4f-b9b3-c8cf7c3e8cb2 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 9fef762d-0fbd-4850-8733-a53aeeb908b7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:41.211291 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b764ab29-6982-4d4f-b9b3-c8cf7c3e8cb2 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:41.212696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b764ab29-6982-4d4f-b9b3-c8cf7c3e8cb2 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:41.213316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b764ab29-6982-4d4f-b9b3-c8cf7c3e8cb2 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:41.216933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b764ab29-6982-4d4f-b9b3-c8cf7c3e8cb2 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:41.217946 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b764ab29-6982-4d4f-b9b3-c8cf7c3e8cb2 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:41.220509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b764ab29-6982-4d4f-b9b3-c8cf7c3e8cb2 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:41.495748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b764ab29-6982-4d4f-b9b3-c8cf7c3e8cb2 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7fb41c95104b4bb9ad66ba2457f994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa34bf618bf4e2e94d55b9b1fff3003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:41.507097 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b764ab29-6982-4d4f-b9b3-c8cf7c3e8cb2 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "GET /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7" status: 200 len: 1503 microversion: 2.1 time: 0.311281 Oct 29 03:26:41.508222 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3068/5912] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:41 2022] GET /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7 => generated 1503 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:41.653722 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4b2db2e3-55b4-4c8c-971d-ba6a43bfaed7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2119745887", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "0fb4133a-a974-41de-8644-78ef2a5c5baf"}], "key_name": "tempest-TestNetworkAdvancedServerOps-992895734", "security_groups": [{"name": "tempest-secgroup-smoke-702631768"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:41.834106 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-4b2db2e3-55b4-4c8c-971d-ba6a43bfaed7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] validate_networks() for [('0fb4133a-a974-41de-8644-78ef2a5c5baf', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:26:42.314232 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-4b2db2e3-55b4-4c8c-971d-ba6a43bfaed7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:26:42.314797 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-4b2db2e3-55b4-4c8c-971d-ba6a43bfaed7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:26:42.315032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-4b2db2e3-55b4-4c8c-971d-ba6a43bfaed7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:26:42.315448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-4b2db2e3-55b4-4c8c-971d-ba6a43bfaed7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:26:42.315914 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-4b2db2e3-55b4-4c8c-971d-ba6a43bfaed7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:26:42.332365 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b2db2e3-55b4-4c8c-971d-ba6a43bfaed7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:42.333154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b2db2e3-55b4-4c8c-971d-ba6a43bfaed7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:42.333599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b2db2e3-55b4-4c8c-971d-ba6a43bfaed7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:42.334331 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b2db2e3-55b4-4c8c-971d-ba6a43bfaed7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:42.334794 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b2db2e3-55b4-4c8c-971d-ba6a43bfaed7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:42.335223 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b2db2e3-55b4-4c8c-971d-ba6a43bfaed7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:42.367646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-4b2db2e3-55b4-4c8c-971d-ba6a43bfaed7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Getting quotas for project c898299eb0444aa1a1983fb127153c65. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:26:42.374095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-4b2db2e3-55b4-4c8c-971d-ba6a43bfaed7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Getting quotas for user 789295d938084ee3b7d618690fee5bfa and project c898299eb0444aa1a1983fb127153c65. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:26:42.403736 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4b2db2e3-55b4-4c8c-971d-ba6a43bfaed7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:26:42.406790 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4b2db2e3-55b4-4c8c-971d-ba6a43bfaed7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:26:42.472473 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4b2db2e3-55b4-4c8c-971d-ba6a43bfaed7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.825924 Oct 29 03:26:42.480469 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2845/5913] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:26:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 03:26:42.486764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ba81e8d0-b73f-4941-9c43-23ab1f9402fa tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:42.487391 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ba81e8d0-b73f-4941-9c43-23ab1f9402fa tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:42.532691 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a9e22388-793f-4d3f-8e4e-4c57863b645d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:42.533333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a9e22388-793f-4d3f-8e4e-4c57863b645d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 9fef762d-0fbd-4850-8733-a53aeeb908b7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:42.546095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9e22388-793f-4d3f-8e4e-4c57863b645d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:42.546601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9e22388-793f-4d3f-8e4e-4c57863b645d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:42.547037 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9e22388-793f-4d3f-8e4e-4c57863b645d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:42.548595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9e22388-793f-4d3f-8e4e-4c57863b645d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:42.549061 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9e22388-793f-4d3f-8e4e-4c57863b645d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:42.549490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9e22388-793f-4d3f-8e4e-4c57863b645d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:42.671619 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ba81e8d0-b73f-4941-9c43-23ab1f9402fa tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:42.682370 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ba81e8d0-b73f-4941-9c43-23ab1f9402fa tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26" status: 200 len: 1266 microversion: 2.1 time: 0.200428 Oct 29 03:26:42.682979 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3069/5914] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:42 2022] GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:42.861686 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a9e22388-793f-4d3f-8e4e-4c57863b645d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7fb41c95104b4bb9ad66ba2457f994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa34bf618bf4e2e94d55b9b1fff3003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:42.875403 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a9e22388-793f-4d3f-8e4e-4c57863b645d tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "GET /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7" status: 200 len: 1503 microversion: 2.1 time: 0.345451 Oct 29 03:26:42.878115 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2846/5915] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:42 2022] GET /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7 => generated 1503 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:43.711497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ff304d7b-0527-4f73-ada7-d5ccbeb3f5f1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:43.712486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ff304d7b-0527-4f73-ada7-d5ccbeb3f5f1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:43.727659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff304d7b-0527-4f73-ada7-d5ccbeb3f5f1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:43.728609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff304d7b-0527-4f73-ada7-d5ccbeb3f5f1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:43.729289 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff304d7b-0527-4f73-ada7-d5ccbeb3f5f1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:43.730556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff304d7b-0527-4f73-ada7-d5ccbeb3f5f1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:43.731829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-da68ca8d-af87-46a5-96c2-62bc1c9109c1 req-1ac2cb71-0931-4217-9d6e-679f76c10155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fef762d-0fbd-4850-8733-a53aeeb908b7", "name": "network-vif-deleted", "tag": "81a7bc22-ec11-4257-a31d-cb7f0ee3119d"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:43.732982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff304d7b-0527-4f73-ada7-d5ccbeb3f5f1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:43.733749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff304d7b-0527-4f73-ada7-d5ccbeb3f5f1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:43.780309 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-da68ca8d-af87-46a5-96c2-62bc1c9109c1 req-1ac2cb71-0931-4217-9d6e-679f76c10155 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:43.783019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-da68ca8d-af87-46a5-96c2-62bc1c9109c1 req-1ac2cb71-0931-4217-9d6e-679f76c10155 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:43.784387 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-da68ca8d-af87-46a5-96c2-62bc1c9109c1 req-1ac2cb71-0931-4217-9d6e-679f76c10155 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:43.824487 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-da68ca8d-af87-46a5-96c2-62bc1c9109c1 req-1ac2cb71-0931-4217-9d6e-679f76c10155 service nova] Creating event network-vif-deleted:81a7bc22-ec11-4257-a31d-cb7f0ee3119d for instance 9fef762d-0fbd-4850-8733-a53aeeb908b7 on n-h1-862967-2 Oct 29 03:26:43.837664 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-da68ca8d-af87-46a5-96c2-62bc1c9109c1 req-1ac2cb71-0931-4217-9d6e-679f76c10155 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107355 Oct 29 03:26:43.844393 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2847/5916] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:26:43.888150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ff304d7b-0527-4f73-ada7-d5ccbeb3f5f1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:43.902564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9ea3ba48-077c-4eec-b18e-c9b40f0670a8 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:43.903897 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9ea3ba48-077c-4eec-b18e-c9b40f0670a8 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 9fef762d-0fbd-4850-8733-a53aeeb908b7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:43.916653 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ff304d7b-0527-4f73-ada7-d5ccbeb3f5f1 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26" status: 200 len: 1318 microversion: 2.1 time: 0.203572 Oct 29 03:26:43.918505 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3070/5917] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:43 2022] GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:43.920710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ea3ba48-077c-4eec-b18e-c9b40f0670a8 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:43.923979 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ea3ba48-077c-4eec-b18e-c9b40f0670a8 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:43.925935 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ea3ba48-077c-4eec-b18e-c9b40f0670a8 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:43.929454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ea3ba48-077c-4eec-b18e-c9b40f0670a8 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:43.929976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ea3ba48-077c-4eec-b18e-c9b40f0670a8 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:43.930576 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ea3ba48-077c-4eec-b18e-c9b40f0670a8 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:44.013812 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ea3ba48-077c-4eec-b18e-c9b40f0670a8 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:44.014621 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ea3ba48-077c-4eec-b18e-c9b40f0670a8 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:44.015280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9ea3ba48-077c-4eec-b18e-c9b40f0670a8 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:44.015926 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-9ea3ba48-077c-4eec-b18e-c9b40f0670a8 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lazy-loading 'fault' on Instance uuid 9fef762d-0fbd-4850-8733-a53aeeb908b7 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:26:44.104464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9ea3ba48-077c-4eec-b18e-c9b40f0670a8 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f7fb41c95104b4bb9ad66ba2457f994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa34bf618bf4e2e94d55b9b1fff3003', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:44.116150 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9ea3ba48-077c-4eec-b18e-c9b40f0670a8 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "GET /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7" status: 200 len: 1303 microversion: 2.1 time: 0.220041 Oct 29 03:26:44.147771 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2848/5918] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:43 2022] GET /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7 => generated 1303 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:44.941898 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5f73dad8-938f-4ada-b4f3-1f4bf8147367 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:44.942729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5f73dad8-938f-4ada-b4f3-1f4bf8147367 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:44.950555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f73dad8-938f-4ada-b4f3-1f4bf8147367 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:44.951027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f73dad8-938f-4ada-b4f3-1f4bf8147367 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:44.951477 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f73dad8-938f-4ada-b4f3-1f4bf8147367 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:44.952273 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f73dad8-938f-4ada-b4f3-1f4bf8147367 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:44.952941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f73dad8-938f-4ada-b4f3-1f4bf8147367 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:44.953387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f73dad8-938f-4ada-b4f3-1f4bf8147367 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:45.125472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5f73dad8-938f-4ada-b4f3-1f4bf8147367 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:45.148119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3932787b-dc86-47b6-8ed9-932ddd09d7f0 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:45.150506 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3932787b-dc86-47b6-8ed9-932ddd09d7f0 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] [instance: 9fef762d-0fbd-4850-8733-a53aeeb908b7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:45.154965 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5f73dad8-938f-4ada-b4f3-1f4bf8147367 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26" status: 200 len: 1324 microversion: 2.1 time: 0.216914 Oct 29 03:26:45.158714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3932787b-dc86-47b6-8ed9-932ddd09d7f0 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:45.159285 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3932787b-dc86-47b6-8ed9-932ddd09d7f0 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:45.159800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3932787b-dc86-47b6-8ed9-932ddd09d7f0 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:45.159941 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3071/5919] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:44 2022] GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 => generated 1324 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:45.160800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3932787b-dc86-47b6-8ed9-932ddd09d7f0 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:45.161325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3932787b-dc86-47b6-8ed9-932ddd09d7f0 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:45.162407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3932787b-dc86-47b6-8ed9-932ddd09d7f0 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:45.178707 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-3932787b-dc86-47b6-8ed9-932ddd09d7f0 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] HTTP exception thrown: Instance 9fef762d-0fbd-4850-8733-a53aeeb908b7 could not be found. Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3932787b-dc86-47b6-8ed9-932ddd09d7f0 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Request method failure captured: Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7 HTTP/1.1 Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJ1QP56nLyiEE3pudxJ6OW1G0aktAjD8ODuaFjepBo-mvqn0ntDOXlKKA2mqIWE6utfhlANLVCTunHHUyN_PuyLw5XeutcSbdqtvpiuc5-24tgFWjkxNp0bWFGn6sHEgH_jEq-qjAn40FsSrYQthh3ONkOywUkAB52B6Uwb_vh9YLfw Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 5fa34bf618bf4e2e94d55b9b1fff3003 Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-VolumesActionsTest-990366347 Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5fa34bf618bf4e2e94d55b9b1fff3003"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5fa34bf618bf4e2e94d55b9b1fff3003"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5fa34bf618bf4e2e94d55b9b1fff3003"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5fa34bf618bf4e2e94d55b9b1fff3003"}]}] Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-VolumesActionsTest-990366347 Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 5fa34bf618bf4e2e94d55b9b1fff3003 Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-VolumesActionsTest-990366347 Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-VolumesActionsTest-990366347-project Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 9f7fb41c95104b4bb9ad66ba2457f994 Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-VolumesActionsTest-990366347-project Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 9fef762d-0fbd-4850-8733-a53aeeb908b7 could not be found. Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '9fef762d-0fbd-4850-8733-a53aeeb908b7'} Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fef762d-0fbd-4850-8733-a53aeeb908b7 could not be found. Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fef762d-0fbd-4850-8733-a53aeeb908b7 could not be found. Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:26:45.180796 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:45.187428 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:26:45.187428 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:26:45.187428 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:26:45.187428 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:26:45.187428 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:26:45.187428 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fef762d-0fbd-4850-8733-a53aeeb908b7 could not be found. Oct 29 03:26:45.187428 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:26:45.189921 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3932787b-dc86-47b6-8ed9-932ddd09d7f0 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] Returning 404 to user: Instance 9fef762d-0fbd-4850-8733-a53aeeb908b7 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:26:45.191009 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3932787b-dc86-47b6-8ed9-932ddd09d7f0 tempest-VolumesActionsTest-990366347 tempest-VolumesActionsTest-990366347-project] 10.222.0.46 "GET /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7" status: 404 len: 111 microversion: 2.1 time: 0.050913 Oct 29 03:26:45.192148 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2849/5920] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:45 2022] GET /compute/v2.1/servers/9fef762d-0fbd-4850-8733-a53aeeb908b7 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:26:46.181469 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-93c2abff-6af7-4584-96c9-2a270f5313fb tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:46.182106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-93c2abff-6af7-4584-96c9-2a270f5313fb tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:46.198450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93c2abff-6af7-4584-96c9-2a270f5313fb tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:46.204110 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93c2abff-6af7-4584-96c9-2a270f5313fb tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:46.206103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93c2abff-6af7-4584-96c9-2a270f5313fb tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:46.206890 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93c2abff-6af7-4584-96c9-2a270f5313fb tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:46.207367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93c2abff-6af7-4584-96c9-2a270f5313fb tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:46.207799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93c2abff-6af7-4584-96c9-2a270f5313fb tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:47.371391 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-93c2abff-6af7-4584-96c9-2a270f5313fb tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:47.402838 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-93c2abff-6af7-4584-96c9-2a270f5313fb tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26" status: 200 len: 1391 microversion: 2.1 time: 1.225198 Oct 29 03:26:47.404098 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3072/5921] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:46 2022] GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 => generated 1391 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:48.122160 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-b167bbed-8ec1-4c2d-90a8-20942fca6dad req-33c53817-2ec8-4a3e-b76a-2ad509b467de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "892f3002-c947-42fb-84c6-c1e401492d26", "tag": "bc07623e-95e8-4f84-a6ac-5c3505851ea7"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:48.152654 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b167bbed-8ec1-4c2d-90a8-20942fca6dad req-33c53817-2ec8-4a3e-b76a-2ad509b467de service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:48.153071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b167bbed-8ec1-4c2d-90a8-20942fca6dad req-33c53817-2ec8-4a3e-b76a-2ad509b467de service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:48.153634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b167bbed-8ec1-4c2d-90a8-20942fca6dad req-33c53817-2ec8-4a3e-b76a-2ad509b467de service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:48.183528 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-b167bbed-8ec1-4c2d-90a8-20942fca6dad req-33c53817-2ec8-4a3e-b76a-2ad509b467de service nova] Creating event network-changed:bc07623e-95e8-4f84-a6ac-5c3505851ea7 for instance 892f3002-c947-42fb-84c6-c1e401492d26 on n-h2-862967-2 Oct 29 03:26:48.191079 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-b167bbed-8ec1-4c2d-90a8-20942fca6dad req-33c53817-2ec8-4a3e-b76a-2ad509b467de service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074674 Oct 29 03:26:48.192610 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2850/5922] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:26:48.427010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-144a317a-3474-44aa-8d6b-83ea2834a75f tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:48.428363 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-144a317a-3474-44aa-8d6b-83ea2834a75f tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:48.440267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-144a317a-3474-44aa-8d6b-83ea2834a75f tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:48.441097 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-144a317a-3474-44aa-8d6b-83ea2834a75f tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:48.441752 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-144a317a-3474-44aa-8d6b-83ea2834a75f tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:48.442870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-144a317a-3474-44aa-8d6b-83ea2834a75f tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:48.445841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-144a317a-3474-44aa-8d6b-83ea2834a75f tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:48.446528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-144a317a-3474-44aa-8d6b-83ea2834a75f tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:48.690831 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-144a317a-3474-44aa-8d6b-83ea2834a75f tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:48.696342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:48.707592 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-144a317a-3474-44aa-8d6b-83ea2834a75f tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26" status: 200 len: 1391 microversion: 2.1 time: 0.285193 Oct 29 03:26:48.708574 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3073/5923] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:48 2022] GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 => generated 1391 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:49.217638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ff961bba-cf2f-42f9-9eca-bb4658b57d42 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1738373798", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": "none"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:49.279249 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-ff961bba-cf2f-42f9-9eca-bb4658b57d42 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:26:49.280103 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-ff961bba-cf2f-42f9-9eca-bb4658b57d42 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:26:49.280261 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-ff961bba-cf2f-42f9-9eca-bb4658b57d42 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:26:49.281177 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-ff961bba-cf2f-42f9-9eca-bb4658b57d42 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:26:49.281177 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-ff961bba-cf2f-42f9-9eca-bb4658b57d42 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:26:49.293690 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff961bba-cf2f-42f9-9eca-bb4658b57d42 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:49.294183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff961bba-cf2f-42f9-9eca-bb4658b57d42 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:49.294617 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff961bba-cf2f-42f9-9eca-bb4658b57d42 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:49.295338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff961bba-cf2f-42f9-9eca-bb4658b57d42 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:49.295937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff961bba-cf2f-42f9-9eca-bb4658b57d42 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:49.296354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff961bba-cf2f-42f9-9eca-bb4658b57d42 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:49.318899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-ff961bba-cf2f-42f9-9eca-bb4658b57d42 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Getting quotas for project 3b6a279511bf4dfb92395f4311868ca7. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:26:49.324822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-ff961bba-cf2f-42f9-9eca-bb4658b57d42 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Getting quotas for user 51644ebe8c2747c7969d52bc28483f07 and project 3b6a279511bf4dfb92395f4311868ca7. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:26:49.337487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:49.338880 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ff961bba-cf2f-42f9-9eca-bb4658b57d42 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:26:49.341358 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ff961bba-cf2f-42f9-9eca-bb4658b57d42 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:26:49.396663 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ff961bba-cf2f-42f9-9eca-bb4658b57d42 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.346264 Oct 29 03:26:49.398295 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2851/5924] 10.222.0.46 () {62 vars in 1188 bytes} [Sat Oct 29 03:26:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 349 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 03:26:49.411544 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d45986e6-9e12-48ea-8b81-fddb21b7c089 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:49.412304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d45986e6-9e12-48ea-8b81-fddb21b7c089 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:49.520493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d45986e6-9e12-48ea-8b81-fddb21b7c089 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:49.536148 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d45986e6-9e12-48ea-8b81-fddb21b7c089 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:49.538305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d45986e6-9e12-48ea-8b81-fddb21b7c089 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:49.539692 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d45986e6-9e12-48ea-8b81-fddb21b7c089 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1278 microversion: 2.54 time: 0.134145 Oct 29 03:26:49.540871 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3074/5925] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:26:49 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1278 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:26:49.732594 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-39ba66a9-06d1-46e0-9a4c-7fb43155ca85 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:49.734735 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-39ba66a9-06d1-46e0-9a4c-7fb43155ca85 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:49.750433 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39ba66a9-06d1-46e0-9a4c-7fb43155ca85 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:49.754867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39ba66a9-06d1-46e0-9a4c-7fb43155ca85 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:49.755709 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39ba66a9-06d1-46e0-9a4c-7fb43155ca85 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:49.759874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39ba66a9-06d1-46e0-9a4c-7fb43155ca85 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:49.765254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39ba66a9-06d1-46e0-9a4c-7fb43155ca85 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:49.768925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-39ba66a9-06d1-46e0-9a4c-7fb43155ca85 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:50.055010 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-39ba66a9-06d1-46e0-9a4c-7fb43155ca85 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:50.072052 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-39ba66a9-06d1-46e0-9a4c-7fb43155ca85 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26" status: 200 len: 1391 microversion: 2.1 time: 0.344718 Oct 29 03:26:50.073702 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2852/5926] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:49 2022] GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 => generated 1391 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:50.567639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-07e294d2-1f11-406b-bf31-a58373e0d80a tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:50.569202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-07e294d2-1f11-406b-bf31-a58373e0d80a tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:50.584239 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07e294d2-1f11-406b-bf31-a58373e0d80a tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:50.585441 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07e294d2-1f11-406b-bf31-a58373e0d80a tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:50.587074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07e294d2-1f11-406b-bf31-a58373e0d80a tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:50.588489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07e294d2-1f11-406b-bf31-a58373e0d80a tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:50.589255 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07e294d2-1f11-406b-bf31-a58373e0d80a tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:50.590852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07e294d2-1f11-406b-bf31-a58373e0d80a tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:50.685472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-07e294d2-1f11-406b-bf31-a58373e0d80a tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:50.698972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-07e294d2-1f11-406b-bf31-a58373e0d80a tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:50.702213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-07e294d2-1f11-406b-bf31-a58373e0d80a tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:50.707103 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-07e294d2-1f11-406b-bf31-a58373e0d80a tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1274 microversion: 2.54 time: 0.143543 Oct 29 03:26:50.707901 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3075/5927] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:26:50 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1274 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:26:51.101091 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5e84f4c2-7e9e-4f28-876f-76700b8c931d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:51.103445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5e84f4c2-7e9e-4f28-876f-76700b8c931d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:51.121830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e84f4c2-7e9e-4f28-876f-76700b8c931d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:51.125003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e84f4c2-7e9e-4f28-876f-76700b8c931d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:51.125461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e84f4c2-7e9e-4f28-876f-76700b8c931d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:51.126333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e84f4c2-7e9e-4f28-876f-76700b8c931d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:51.126796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e84f4c2-7e9e-4f28-876f-76700b8c931d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:51.127227 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e84f4c2-7e9e-4f28-876f-76700b8c931d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:51.318110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5e84f4c2-7e9e-4f28-876f-76700b8c931d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:51.328157 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5e84f4c2-7e9e-4f28-876f-76700b8c931d tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26" status: 200 len: 1391 microversion: 2.1 time: 0.235096 Oct 29 03:26:51.342445 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2853/5928] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:51 2022] GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 => generated 1391 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:51.736075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-158b1295-a064-4ab1-974f-a33250c16cc5 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:51.737395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-158b1295-a064-4ab1-974f-a33250c16cc5 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:51.751502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-158b1295-a064-4ab1-974f-a33250c16cc5 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:51.752150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-158b1295-a064-4ab1-974f-a33250c16cc5 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:51.752633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-158b1295-a064-4ab1-974f-a33250c16cc5 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:51.754323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-158b1295-a064-4ab1-974f-a33250c16cc5 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:51.754799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-158b1295-a064-4ab1-974f-a33250c16cc5 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:51.755225 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-158b1295-a064-4ab1-974f-a33250c16cc5 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:51.849318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-158b1295-a064-4ab1-974f-a33250c16cc5 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:51.859569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-158b1295-a064-4ab1-974f-a33250c16cc5 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:51.861789 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-158b1295-a064-4ab1-974f-a33250c16cc5 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:51.863580 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-158b1295-a064-4ab1-974f-a33250c16cc5 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1336 microversion: 2.54 time: 0.132008 Oct 29 03:26:51.864810 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3076/5929] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:26:51 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1336 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:26:52.354135 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2362f354-531e-4039-a429-1e4678333dde tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:52.354689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2362f354-531e-4039-a429-1e4678333dde tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:52.374542 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2362f354-531e-4039-a429-1e4678333dde tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:52.375066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2362f354-531e-4039-a429-1e4678333dde tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:52.375553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2362f354-531e-4039-a429-1e4678333dde tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:52.376598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2362f354-531e-4039-a429-1e4678333dde tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:52.377510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2362f354-531e-4039-a429-1e4678333dde tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:52.378177 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2362f354-531e-4039-a429-1e4678333dde tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:52.636549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2362f354-531e-4039-a429-1e4678333dde tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:52.648030 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2362f354-531e-4039-a429-1e4678333dde tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26" status: 200 len: 1391 microversion: 2.1 time: 0.297745 Oct 29 03:26:52.648905 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2854/5930] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:52 2022] GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 => generated 1391 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:26:52.898500 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5b5f87d8-725a-49aa-9b3e-8f3c5a8e4579 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:52.899650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5b5f87d8-725a-49aa-9b3e-8f3c5a8e4579 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:52.907055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b5f87d8-725a-49aa-9b3e-8f3c5a8e4579 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:52.907608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b5f87d8-725a-49aa-9b3e-8f3c5a8e4579 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:52.908094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b5f87d8-725a-49aa-9b3e-8f3c5a8e4579 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:52.909133 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b5f87d8-725a-49aa-9b3e-8f3c5a8e4579 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:52.909668 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b5f87d8-725a-49aa-9b3e-8f3c5a8e4579 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:52.910090 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b5f87d8-725a-49aa-9b3e-8f3c5a8e4579 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:53.034989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5b5f87d8-725a-49aa-9b3e-8f3c5a8e4579 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:53.044761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5b5f87d8-725a-49aa-9b3e-8f3c5a8e4579 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:53.046776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5b5f87d8-725a-49aa-9b3e-8f3c5a8e4579 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:53.048181 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5b5f87d8-725a-49aa-9b3e-8f3c5a8e4579 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1336 microversion: 2.54 time: 0.157863 Oct 29 03:26:53.049214 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3077/5931] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:26:52 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1336 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:26:53.674949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7402e53f-f7fc-439b-8522-e6c3a4b2bd36 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:53.675709 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7402e53f-f7fc-439b-8522-e6c3a4b2bd36 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:53.684717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7402e53f-f7fc-439b-8522-e6c3a4b2bd36 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:53.685569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7402e53f-f7fc-439b-8522-e6c3a4b2bd36 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:53.686311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7402e53f-f7fc-439b-8522-e6c3a4b2bd36 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:53.687262 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7402e53f-f7fc-439b-8522-e6c3a4b2bd36 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:53.687928 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7402e53f-f7fc-439b-8522-e6c3a4b2bd36 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:53.688538 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7402e53f-f7fc-439b-8522-e6c3a4b2bd36 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:53.861997 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7402e53f-f7fc-439b-8522-e6c3a4b2bd36 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:53.872539 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7402e53f-f7fc-439b-8522-e6c3a4b2bd36 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26" status: 200 len: 1391 microversion: 2.1 time: 0.201983 Oct 29 03:26:53.873833 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2855/5932] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:53 2022] GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 => generated 1391 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:54.030719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-1d3b19c0-b624-4bf2-a842-69fffd303fd5 req-a8cc289a-ae4c-4710-a5b3-5fa322e6af31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "892f3002-c947-42fb-84c6-c1e401492d26", "name": "network-vif-plugged", "status": "completed", "tag": "bc07623e-95e8-4f84-a6ac-5c3505851ea7"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:54.047039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1d3b19c0-b624-4bf2-a842-69fffd303fd5 req-a8cc289a-ae4c-4710-a5b3-5fa322e6af31 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:54.048508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1d3b19c0-b624-4bf2-a842-69fffd303fd5 req-a8cc289a-ae4c-4710-a5b3-5fa322e6af31 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:54.048508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1d3b19c0-b624-4bf2-a842-69fffd303fd5 req-a8cc289a-ae4c-4710-a5b3-5fa322e6af31 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:54.078313 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-1d3b19c0-b624-4bf2-a842-69fffd303fd5 req-a8cc289a-ae4c-4710-a5b3-5fa322e6af31 service nova] Creating event network-vif-plugged:bc07623e-95e8-4f84-a6ac-5c3505851ea7 for instance 892f3002-c947-42fb-84c6-c1e401492d26 on n-h2-862967-2 Oct 29 03:26:54.078952 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-de82ee2f-eb5f-4f6d-9380-d01fd1cdfb03 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:54.079581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-de82ee2f-eb5f-4f6d-9380-d01fd1cdfb03 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:54.085950 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-1d3b19c0-b624-4bf2-a842-69fffd303fd5 req-a8cc289a-ae4c-4710-a5b3-5fa322e6af31 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059215 Oct 29 03:26:54.087299 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3078/5933] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:26:54.088673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-de82ee2f-eb5f-4f6d-9380-d01fd1cdfb03 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:54.089372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-de82ee2f-eb5f-4f6d-9380-d01fd1cdfb03 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:54.089989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-de82ee2f-eb5f-4f6d-9380-d01fd1cdfb03 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:54.091424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-de82ee2f-eb5f-4f6d-9380-d01fd1cdfb03 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:54.092460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-de82ee2f-eb5f-4f6d-9380-d01fd1cdfb03 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:54.093361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-de82ee2f-eb5f-4f6d-9380-d01fd1cdfb03 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:54.201363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-de82ee2f-eb5f-4f6d-9380-d01fd1cdfb03 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:54.212276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-de82ee2f-eb5f-4f6d-9380-d01fd1cdfb03 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:54.214346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-de82ee2f-eb5f-4f6d-9380-d01fd1cdfb03 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:54.215747 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-de82ee2f-eb5f-4f6d-9380-d01fd1cdfb03 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1357 microversion: 2.54 time: 0.140871 Oct 29 03:26:54.216815 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2856/5934] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:26:54 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1357 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:26:54.245074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f9b7114d-8a98-447d-8934-10e1dc11f7ec tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Action: 'create', calling method: .version_select at 0x7ff0533ebf70>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-196673249", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUz7hzDBpAj9TIks5DliEfkRtJFL342c2CKOkMvRPF7dUgfNPPuSkxL0VdOtmjGFGYa5FjYU6kXNJWROX6dW1/eMbFVk8an0yojWEzWoOxMeIHpM016kAytiynBe7FUGg=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:54.289452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-f9b7114d-8a98-447d-8934-10e1dc11f7ec tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Getting quotas for project 3b6a279511bf4dfb92395f4311868ca7. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:26:54.309224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-f9b7114d-8a98-447d-8934-10e1dc11f7ec tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Getting quotas for user 51644ebe8c2747c7969d52bc28483f07 and project 3b6a279511bf4dfb92395f4311868ca7. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:26:54.349139 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f9b7114d-8a98-447d-8934-10e1dc11f7ec tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.107431 Oct 29 03:26:54.352694 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3079/5935] 10.222.0.46 () {62 vars in 1200 bytes} [Sat Oct 29 03:26:54 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 113 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 29 03:26:54.361751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e691584d-f1ef-4fbb-a714-d1c230d9c1b4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-196673249", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:54.364680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e691584d-f1ef-4fbb-a714-d1c230d9c1b4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:54.378327 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e691584d-f1ef-4fbb-a714-d1c230d9c1b4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:54.383226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e691584d-f1ef-4fbb-a714-d1c230d9c1b4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:54.383875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e691584d-f1ef-4fbb-a714-d1c230d9c1b4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:54.384705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e691584d-f1ef-4fbb-a714-d1c230d9c1b4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:54.385244 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e691584d-f1ef-4fbb-a714-d1c230d9c1b4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:54.385661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e691584d-f1ef-4fbb-a714-d1c230d9c1b4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:54.540721 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:54.569820 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-e691584d-f1ef-4fbb-a714-d1c230d9c1b4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:26:54.571003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-e691584d-f1ef-4fbb-a714-d1c230d9c1b4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:26:54.571493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-e691584d-f1ef-4fbb-a714-d1c230d9c1b4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:26:54.571902 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-e691584d-f1ef-4fbb-a714-d1c230d9c1b4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:26:54.572318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-e691584d-f1ef-4fbb-a714-d1c230d9c1b4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:26:54.708514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e691584d-f1ef-4fbb-a714-d1c230d9c1b4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:54.722183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e691584d-f1ef-4fbb-a714-d1c230d9c1b4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:54.722678 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e691584d-f1ef-4fbb-a714-d1c230d9c1b4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:54.723117 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e691584d-f1ef-4fbb-a714-d1c230d9c1b4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:54.723889 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e691584d-f1ef-4fbb-a714-d1c230d9c1b4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:54.724346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e691584d-f1ef-4fbb-a714-d1c230d9c1b4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:54.724802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e691584d-f1ef-4fbb-a714-d1c230d9c1b4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:54.800517 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e691584d-f1ef-4fbb-a714-d1c230d9c1b4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "POST /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d/action" status: 202 len: 1139 microversion: 2.54 time: 0.442252 Oct 29 03:26:54.801843 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2857/5936] 10.222.0.46 () {62 vars in 1320 bytes} [Sat Oct 29 03:26:54 2022] POST /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d/action => generated 1139 bytes in 445 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 29 03:26:54.823272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9fab1c9c-2185-48bc-9046-eeaad97743e2 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:54.824023 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9fab1c9c-2185-48bc-9046-eeaad97743e2 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:54.841182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fab1c9c-2185-48bc-9046-eeaad97743e2 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:54.843024 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fab1c9c-2185-48bc-9046-eeaad97743e2 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:54.844081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fab1c9c-2185-48bc-9046-eeaad97743e2 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:54.845320 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fab1c9c-2185-48bc-9046-eeaad97743e2 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:54.846329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fab1c9c-2185-48bc-9046-eeaad97743e2 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:54.847208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fab1c9c-2185-48bc-9046-eeaad97743e2 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:54.896819 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dc5db158-c38d-4fb7-95fe-fd89507f3ef6 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:54.897662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dc5db158-c38d-4fb7-95fe-fd89507f3ef6 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:54.915645 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc5db158-c38d-4fb7-95fe-fd89507f3ef6 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:54.915645 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc5db158-c38d-4fb7-95fe-fd89507f3ef6 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:54.916783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc5db158-c38d-4fb7-95fe-fd89507f3ef6 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:54.917959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc5db158-c38d-4fb7-95fe-fd89507f3ef6 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:54.918501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc5db158-c38d-4fb7-95fe-fd89507f3ef6 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:54.919002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc5db158-c38d-4fb7-95fe-fd89507f3ef6 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:54.927024 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9fab1c9c-2185-48bc-9046-eeaad97743e2 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:54.937917 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9fab1c9c-2185-48bc-9046-eeaad97743e2 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:54.943140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9fab1c9c-2185-48bc-9046-eeaad97743e2 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:54.946405 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9fab1c9c-2185-48bc-9046-eeaad97743e2 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1408 microversion: 2.54 time: 0.127141 Oct 29 03:26:54.947505 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3080/5937] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:26:54 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1408 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:26:55.160213 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dc5db158-c38d-4fb7-95fe-fd89507f3ef6 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:55.190734 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dc5db158-c38d-4fb7-95fe-fd89507f3ef6 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26" status: 200 len: 1391 microversion: 2.1 time: 0.297678 Oct 29 03:26:55.193311 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2858/5938] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:54 2022] GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 => generated 1391 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:26:55.977772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3c9267ae-d436-4002-9d9c-16886c3c8ea0 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:55.978380 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3c9267ae-d436-4002-9d9c-16886c3c8ea0 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:55.990337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c9267ae-d436-4002-9d9c-16886c3c8ea0 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:55.990837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c9267ae-d436-4002-9d9c-16886c3c8ea0 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:55.991474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c9267ae-d436-4002-9d9c-16886c3c8ea0 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:55.992378 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c9267ae-d436-4002-9d9c-16886c3c8ea0 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:55.999375 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c9267ae-d436-4002-9d9c-16886c3c8ea0 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:56.000049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c9267ae-d436-4002-9d9c-16886c3c8ea0 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:56.106748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3c9267ae-d436-4002-9d9c-16886c3c8ea0 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:56.116175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3c9267ae-d436-4002-9d9c-16886c3c8ea0 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:56.120880 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3c9267ae-d436-4002-9d9c-16886c3c8ea0 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:56.122312 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3c9267ae-d436-4002-9d9c-16886c3c8ea0 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1408 microversion: 2.54 time: 0.148933 Oct 29 03:26:56.123380 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3081/5939] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:26:55 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:26:56.220848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1ef42b96-9860-4ba1-8675-489ce965f855 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:56.223557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1ef42b96-9860-4ba1-8675-489ce965f855 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:56.235740 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ef42b96-9860-4ba1-8675-489ce965f855 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:56.237585 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ef42b96-9860-4ba1-8675-489ce965f855 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:56.238968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ef42b96-9860-4ba1-8675-489ce965f855 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:56.239882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ef42b96-9860-4ba1-8675-489ce965f855 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:56.241452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ef42b96-9860-4ba1-8675-489ce965f855 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:56.242256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ef42b96-9860-4ba1-8675-489ce965f855 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:56.650019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1ef42b96-9860-4ba1-8675-489ce965f855 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:56.666545 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1ef42b96-9860-4ba1-8675-489ce965f855 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26" status: 200 len: 1563 microversion: 2.1 time: 0.454630 Oct 29 03:26:56.668578 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2859/5940] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:56 2022] GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 => generated 1563 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:56.697281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d1395334-bb67-47f9-859f-4637905d2314 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:56.698989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d1395334-bb67-47f9-859f-4637905d2314 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:56.721831 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1395334-bb67-47f9-859f-4637905d2314 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:56.722756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1395334-bb67-47f9-859f-4637905d2314 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:56.723382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1395334-bb67-47f9-859f-4637905d2314 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:56.724412 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1395334-bb67-47f9-859f-4637905d2314 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:56.725218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1395334-bb67-47f9-859f-4637905d2314 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:56.726092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d1395334-bb67-47f9-859f-4637905d2314 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:56.918072 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d1395334-bb67-47f9-859f-4637905d2314 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:56.926767 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d1395334-bb67-47f9-859f-4637905d2314 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26" status: 200 len: 1563 microversion: 2.1 time: 0.241140 Oct 29 03:26:56.932589 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3082/5941] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:26:56 2022] GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 => generated 1563 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:26:57.150295 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-375ebd58-c123-4d32-b88a-4159e389845f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:57.151045 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-375ebd58-c123-4d32-b88a-4159e389845f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:57.163161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-375ebd58-c123-4d32-b88a-4159e389845f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:57.164417 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-375ebd58-c123-4d32-b88a-4159e389845f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:57.167189 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-375ebd58-c123-4d32-b88a-4159e389845f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:57.168035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-375ebd58-c123-4d32-b88a-4159e389845f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:57.172115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-375ebd58-c123-4d32-b88a-4159e389845f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:57.175293 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-375ebd58-c123-4d32-b88a-4159e389845f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:57.322070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-375ebd58-c123-4d32-b88a-4159e389845f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:57.331201 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-375ebd58-c123-4d32-b88a-4159e389845f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:57.336251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-375ebd58-c123-4d32-b88a-4159e389845f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:57.340335 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-375ebd58-c123-4d32-b88a-4159e389845f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1408 microversion: 2.54 time: 0.194517 Oct 29 03:26:57.341240 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2860/5942] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:26:57 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1408 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:26:57.889797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8c0951fb-1a87-4981-8a6b-35d5364e4773 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8f7e718-e04b-4ef8-b97c-9baf324af79c", "device": "/dev/sdb"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:26:57.894233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8c0951fb-1a87-4981-8a6b-35d5364e4773 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: 09a0f147-9f3b-4180-a462-aebd0e6162ac] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:57.904098 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c0951fb-1a87-4981-8a6b-35d5364e4773 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:57.905209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c0951fb-1a87-4981-8a6b-35d5364e4773 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:57.905964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c0951fb-1a87-4981-8a6b-35d5364e4773 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:57.906962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c0951fb-1a87-4981-8a6b-35d5364e4773 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:57.908318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c0951fb-1a87-4981-8a6b-35d5364e4773 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:57.909039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8c0951fb-1a87-4981-8a6b-35d5364e4773 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:58.317970 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8c0951fb-1a87-4981-8a6b-35d5364e4773 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "POST /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.430042 Oct 29 03:26:58.318626 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3083/5943] 10.222.0.46 () {60 vars in 1323 bytes} [Sat Oct 29 03:26:57 2022] POST /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac/os-volume_attachments => generated 194 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:26:58.367100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6b09ffe0-7de6-45ce-8452-14328ea36f27 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:58.367732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6b09ffe0-7de6-45ce-8452-14328ea36f27 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:58.390924 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b09ffe0-7de6-45ce-8452-14328ea36f27 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:58.407639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b09ffe0-7de6-45ce-8452-14328ea36f27 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:58.408103 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b09ffe0-7de6-45ce-8452-14328ea36f27 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:58.410458 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b09ffe0-7de6-45ce-8452-14328ea36f27 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:58.410950 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b09ffe0-7de6-45ce-8452-14328ea36f27 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:58.411382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b09ffe0-7de6-45ce-8452-14328ea36f27 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:58.563070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6b09ffe0-7de6-45ce-8452-14328ea36f27 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:58.577880 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6b09ffe0-7de6-45ce-8452-14328ea36f27 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:58.580391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6b09ffe0-7de6-45ce-8452-14328ea36f27 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:58.582032 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6b09ffe0-7de6-45ce-8452-14328ea36f27 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1408 microversion: 2.54 time: 0.220327 Oct 29 03:26:58.582813 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2861/5944] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:26:58 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1408 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:26:59.618315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-295b87ea-875a-4be5-8298-8426197ad6a2 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:26:59.623138 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-295b87ea-875a-4be5-8298-8426197ad6a2 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:26:59.641942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:59.646174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-295b87ea-875a-4be5-8298-8426197ad6a2 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:59.647763 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-295b87ea-875a-4be5-8298-8426197ad6a2 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:59.649562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-295b87ea-875a-4be5-8298-8426197ad6a2 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:59.656687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-295b87ea-875a-4be5-8298-8426197ad6a2 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:26:59.659271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-295b87ea-875a-4be5-8298-8426197ad6a2 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:26:59.661907 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-295b87ea-875a-4be5-8298-8426197ad6a2 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:26:59.759775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-295b87ea-875a-4be5-8298-8426197ad6a2 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:59.770283 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-295b87ea-875a-4be5-8298-8426197ad6a2 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:59.771764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-295b87ea-875a-4be5-8298-8426197ad6a2 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:26:59.785888 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-295b87ea-875a-4be5-8298-8426197ad6a2 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1408 microversion: 2.54 time: 0.179133 Oct 29 03:26:59.796803 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3084/5945] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:26:59 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:00.106425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-79a70346-5077-4f10-8bb5-d35629953451 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:00.108590 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-79a70346-5077-4f10-8bb5-d35629953451 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:00.108972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-b18ea872-00c4-4cad-a3c5-c25203314d35 req-c056f1dd-e078-4920-a4a8-ab8f1ca65d6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "892f3002-c947-42fb-84c6-c1e401492d26", "tag": "bc07623e-95e8-4f84-a6ac-5c3505851ea7"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:00.121485 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b18ea872-00c4-4cad-a3c5-c25203314d35 req-c056f1dd-e078-4920-a4a8-ab8f1ca65d6a service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:00.123209 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:00.124038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b18ea872-00c4-4cad-a3c5-c25203314d35 req-c056f1dd-e078-4920-a4a8-ab8f1ca65d6a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:00.124589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b18ea872-00c4-4cad-a3c5-c25203314d35 req-c056f1dd-e078-4920-a4a8-ab8f1ca65d6a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:00.125652 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=16 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:00.140256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-79a70346-5077-4f10-8bb5-d35629953451 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:00.140942 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-79a70346-5077-4f10-8bb5-d35629953451 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:00.141511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-79a70346-5077-4f10-8bb5-d35629953451 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:00.142471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-79a70346-5077-4f10-8bb5-d35629953451 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:00.143157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-79a70346-5077-4f10-8bb5-d35629953451 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:00.143795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-79a70346-5077-4f10-8bb5-d35629953451 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:00.148662 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-b18ea872-00c4-4cad-a3c5-c25203314d35 req-c056f1dd-e078-4920-a4a8-ab8f1ca65d6a service nova] Creating event network-changed:bc07623e-95e8-4f84-a6ac-5c3505851ea7 for instance 892f3002-c947-42fb-84c6-c1e401492d26 on n-h2-862967-2 Oct 29 03:27:00.168283 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-b18ea872-00c4-4cad-a3c5-c25203314d35 req-c056f1dd-e078-4920-a4a8-ab8f1ca65d6a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063251 Oct 29 03:27:00.168951 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3085/5946] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:27:00.427259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-79a70346-5077-4f10-8bb5-d35629953451 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:00.442151 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-79a70346-5077-4f10-8bb5-d35629953451 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26" status: 200 len: 1563 microversion: 2.1 time: 0.340293 Oct 29 03:27:00.443392 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2862/5947] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:00 2022] GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 => generated 1563 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:00.816489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dbf69556-91de-44ec-b21d-e18cc054230b tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:00.817859 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dbf69556-91de-44ec-b21d-e18cc054230b tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:00.829817 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dbf69556-91de-44ec-b21d-e18cc054230b tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:00.832630 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dbf69556-91de-44ec-b21d-e18cc054230b tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:00.833316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dbf69556-91de-44ec-b21d-e18cc054230b tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:00.837314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dbf69556-91de-44ec-b21d-e18cc054230b tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:00.839171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dbf69556-91de-44ec-b21d-e18cc054230b tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:00.839651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dbf69556-91de-44ec-b21d-e18cc054230b tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:00.997659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dbf69556-91de-44ec-b21d-e18cc054230b tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:01.012421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dbf69556-91de-44ec-b21d-e18cc054230b tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:01.013975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dbf69556-91de-44ec-b21d-e18cc054230b tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:01.015221 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dbf69556-91de-44ec-b21d-e18cc054230b tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1408 microversion: 2.54 time: 0.204443 Oct 29 03:27:01.015789 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3086/5948] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:00 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:02.042158 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bc7ea67c-a335-4daa-b767-645f108e543d tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:02.042785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bc7ea67c-a335-4daa-b767-645f108e543d tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:02.051037 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc7ea67c-a335-4daa-b767-645f108e543d tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:02.051688 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc7ea67c-a335-4daa-b767-645f108e543d tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:02.052383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc7ea67c-a335-4daa-b767-645f108e543d tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:02.053557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc7ea67c-a335-4daa-b767-645f108e543d tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:02.054140 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc7ea67c-a335-4daa-b767-645f108e543d tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:02.054656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc7ea67c-a335-4daa-b767-645f108e543d tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:02.132733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bc7ea67c-a335-4daa-b767-645f108e543d tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:02.149372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bc7ea67c-a335-4daa-b767-645f108e543d tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:02.150853 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bc7ea67c-a335-4daa-b767-645f108e543d tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:02.152080 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bc7ea67c-a335-4daa-b767-645f108e543d tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1408 microversion: 2.54 time: 0.114042 Oct 29 03:27:02.152688 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2863/5949] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:02 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1408 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:03.178849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a6a909c9-cf55-40a9-873b-93135fa8e06f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:03.179825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a6a909c9-cf55-40a9-873b-93135fa8e06f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:03.187630 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6a909c9-cf55-40a9-873b-93135fa8e06f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:03.188473 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6a909c9-cf55-40a9-873b-93135fa8e06f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:03.189149 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6a909c9-cf55-40a9-873b-93135fa8e06f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:03.190086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6a909c9-cf55-40a9-873b-93135fa8e06f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:03.190755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6a909c9-cf55-40a9-873b-93135fa8e06f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:03.191382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6a909c9-cf55-40a9-873b-93135fa8e06f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:03.294693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a6a909c9-cf55-40a9-873b-93135fa8e06f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:03.304570 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a6a909c9-cf55-40a9-873b-93135fa8e06f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:03.306468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a6a909c9-cf55-40a9-873b-93135fa8e06f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:03.307910 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a6a909c9-cf55-40a9-873b-93135fa8e06f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1408 microversion: 2.54 time: 0.132986 Oct 29 03:27:03.333219 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3087/5950] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:03 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:04.338747 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ee4b24de-0a8a-4ba3-be6a-8fdd7f792d05 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:04.340175 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ee4b24de-0a8a-4ba3-be6a-8fdd7f792d05 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:04.347665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee4b24de-0a8a-4ba3-be6a-8fdd7f792d05 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:04.348057 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee4b24de-0a8a-4ba3-be6a-8fdd7f792d05 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:04.348487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee4b24de-0a8a-4ba3-be6a-8fdd7f792d05 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:04.349656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee4b24de-0a8a-4ba3-be6a-8fdd7f792d05 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:04.350273 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee4b24de-0a8a-4ba3-be6a-8fdd7f792d05 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:04.350697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee4b24de-0a8a-4ba3-be6a-8fdd7f792d05 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:04.441584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ee4b24de-0a8a-4ba3-be6a-8fdd7f792d05 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:04.450660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ee4b24de-0a8a-4ba3-be6a-8fdd7f792d05 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:04.453893 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ee4b24de-0a8a-4ba3-be6a-8fdd7f792d05 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:04.455315 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ee4b24de-0a8a-4ba3-be6a-8fdd7f792d05 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1408 microversion: 2.54 time: 0.120556 Oct 29 03:27:04.457263 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2864/5951] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:04 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1408 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:05.481010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-db656219-aaad-483a-868e-f0e1b3e63530 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:05.485554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-db656219-aaad-483a-868e-f0e1b3e63530 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:05.492979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=8 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:05.494755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db656219-aaad-483a-868e-f0e1b3e63530 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:05.495275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db656219-aaad-483a-868e-f0e1b3e63530 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:05.495903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db656219-aaad-483a-868e-f0e1b3e63530 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:05.496790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db656219-aaad-483a-868e-f0e1b3e63530 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:05.497448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db656219-aaad-483a-868e-f0e1b3e63530 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:05.498035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db656219-aaad-483a-868e-f0e1b3e63530 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:05.577218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-db656219-aaad-483a-868e-f0e1b3e63530 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:05.586365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-db656219-aaad-483a-868e-f0e1b3e63530 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:05.588139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-db656219-aaad-483a-868e-f0e1b3e63530 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:05.589540 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-db656219-aaad-483a-868e-f0e1b3e63530 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1408 microversion: 2.54 time: 0.112487 Oct 29 03:27:05.590185 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3088/5952] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:05 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1408 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:06.618165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-19955ea9-47a2-4872-a3fc-afa0b05d0c71 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:06.619392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-19955ea9-47a2-4872-a3fc-afa0b05d0c71 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:06.627019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19955ea9-47a2-4872-a3fc-afa0b05d0c71 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:06.627468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19955ea9-47a2-4872-a3fc-afa0b05d0c71 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:06.628071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19955ea9-47a2-4872-a3fc-afa0b05d0c71 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:06.629046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19955ea9-47a2-4872-a3fc-afa0b05d0c71 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:06.629650 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19955ea9-47a2-4872-a3fc-afa0b05d0c71 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:06.630259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19955ea9-47a2-4872-a3fc-afa0b05d0c71 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:06.708101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-19955ea9-47a2-4872-a3fc-afa0b05d0c71 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:06.717778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-19955ea9-47a2-4872-a3fc-afa0b05d0c71 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:06.719501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-19955ea9-47a2-4872-a3fc-afa0b05d0c71 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:06.721047 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-19955ea9-47a2-4872-a3fc-afa0b05d0c71 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1408 microversion: 2.54 time: 0.109600 Oct 29 03:27:06.737154 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2865/5953] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:06 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1408 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:07.747603 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3f312c93-aa50-4cdb-9dc5-51d01becc5c9 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:07.748336 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3f312c93-aa50-4cdb-9dc5-51d01becc5c9 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:07.758351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f312c93-aa50-4cdb-9dc5-51d01becc5c9 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:07.759140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f312c93-aa50-4cdb-9dc5-51d01becc5c9 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:07.759735 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f312c93-aa50-4cdb-9dc5-51d01becc5c9 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:07.760647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f312c93-aa50-4cdb-9dc5-51d01becc5c9 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:07.761099 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f312c93-aa50-4cdb-9dc5-51d01becc5c9 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:07.761525 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f312c93-aa50-4cdb-9dc5-51d01becc5c9 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:07.841316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3f312c93-aa50-4cdb-9dc5-51d01becc5c9 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:07.851395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3f312c93-aa50-4cdb-9dc5-51d01becc5c9 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:07.853216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3f312c93-aa50-4cdb-9dc5-51d01becc5c9 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:07.854696 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3f312c93-aa50-4cdb-9dc5-51d01becc5c9 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1408 microversion: 2.54 time: 0.110994 Oct 29 03:27:07.856579 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3089/5954] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:07 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1408 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:08.880963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-164adebc-c2e4-4716-a75c-f2032835c984 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:08.881552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-164adebc-c2e4-4716-a75c-f2032835c984 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:08.889034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-164adebc-c2e4-4716-a75c-f2032835c984 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:08.889516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-164adebc-c2e4-4716-a75c-f2032835c984 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:08.889949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-164adebc-c2e4-4716-a75c-f2032835c984 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:08.890657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-164adebc-c2e4-4716-a75c-f2032835c984 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:08.891109 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-164adebc-c2e4-4716-a75c-f2032835c984 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:08.891534 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-164adebc-c2e4-4716-a75c-f2032835c984 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:08.961514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-164adebc-c2e4-4716-a75c-f2032835c984 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:08.970172 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-164adebc-c2e4-4716-a75c-f2032835c984 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:08.971641 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-164adebc-c2e4-4716-a75c-f2032835c984 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:08.972862 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-164adebc-c2e4-4716-a75c-f2032835c984 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1408 microversion: 2.54 time: 0.095814 Oct 29 03:27:08.984549 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2866/5955] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:08 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1408 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:10.002853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-829a1812-5a43-44a1-a1a2-edd60870cfd5 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:10.003550 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-829a1812-5a43-44a1-a1a2-edd60870cfd5 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:10.010866 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-829a1812-5a43-44a1-a1a2-edd60870cfd5 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:10.011572 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-829a1812-5a43-44a1-a1a2-edd60870cfd5 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:10.012123 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-829a1812-5a43-44a1-a1a2-edd60870cfd5 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:10.012800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-829a1812-5a43-44a1-a1a2-edd60870cfd5 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:10.013553 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-829a1812-5a43-44a1-a1a2-edd60870cfd5 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:10.013964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-829a1812-5a43-44a1-a1a2-edd60870cfd5 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:10.098914 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-829a1812-5a43-44a1-a1a2-edd60870cfd5 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:10.108729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-829a1812-5a43-44a1-a1a2-edd60870cfd5 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:10.118798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-829a1812-5a43-44a1-a1a2-edd60870cfd5 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:10.118798 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-829a1812-5a43-44a1-a1a2-edd60870cfd5 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1408 microversion: 2.54 time: 0.122782 Oct 29 03:27:10.120698 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3090/5956] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:09 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1408 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:27:11.146649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-512f990a-af21-48e0-83b3-7ebd53b97d42 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:11.148485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-512f990a-af21-48e0-83b3-7ebd53b97d42 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:11.156385 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-512f990a-af21-48e0-83b3-7ebd53b97d42 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:11.156918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-512f990a-af21-48e0-83b3-7ebd53b97d42 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:11.157378 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-512f990a-af21-48e0-83b3-7ebd53b97d42 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:11.158085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-512f990a-af21-48e0-83b3-7ebd53b97d42 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:11.158810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-512f990a-af21-48e0-83b3-7ebd53b97d42 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:11.159241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-512f990a-af21-48e0-83b3-7ebd53b97d42 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:11.229789 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-512f990a-af21-48e0-83b3-7ebd53b97d42 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:11.238489 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-512f990a-af21-48e0-83b3-7ebd53b97d42 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:11.239931 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-512f990a-af21-48e0-83b3-7ebd53b97d42 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:11.241299 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-512f990a-af21-48e0-83b3-7ebd53b97d42 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1408 microversion: 2.54 time: 0.099278 Oct 29 03:27:11.241861 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2867/5957] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:11 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1408 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:12.267677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eae877b6-8926-4a15-a654-f90b37fb6d1f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:12.268458 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-eae877b6-8926-4a15-a654-f90b37fb6d1f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:12.276657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eae877b6-8926-4a15-a654-f90b37fb6d1f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:12.277250 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eae877b6-8926-4a15-a654-f90b37fb6d1f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:12.277782 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eae877b6-8926-4a15-a654-f90b37fb6d1f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:12.278556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eae877b6-8926-4a15-a654-f90b37fb6d1f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:12.279083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eae877b6-8926-4a15-a654-f90b37fb6d1f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:12.279671 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eae877b6-8926-4a15-a654-f90b37fb6d1f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:12.344969 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-eae877b6-8926-4a15-a654-f90b37fb6d1f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:12.353897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-eae877b6-8926-4a15-a654-f90b37fb6d1f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:12.355347 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-eae877b6-8926-4a15-a654-f90b37fb6d1f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:12.356729 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eae877b6-8926-4a15-a654-f90b37fb6d1f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1408 microversion: 2.54 time: 0.093282 Oct 29 03:27:12.357682 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3091/5958] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:12 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1408 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:13.385629 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1c01905e-bf70-4f63-b026-44d51f2ef692 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:13.386312 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1c01905e-bf70-4f63-b026-44d51f2ef692 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:13.395528 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c01905e-bf70-4f63-b026-44d51f2ef692 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:13.396448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c01905e-bf70-4f63-b026-44d51f2ef692 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:13.397202 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c01905e-bf70-4f63-b026-44d51f2ef692 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:13.398526 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c01905e-bf70-4f63-b026-44d51f2ef692 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:13.399436 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c01905e-bf70-4f63-b026-44d51f2ef692 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:13.400080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c01905e-bf70-4f63-b026-44d51f2ef692 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:13.483074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1c01905e-bf70-4f63-b026-44d51f2ef692 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:13.492843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1c01905e-bf70-4f63-b026-44d51f2ef692 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:13.494456 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1c01905e-bf70-4f63-b026-44d51f2ef692 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:13.495670 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1c01905e-bf70-4f63-b026-44d51f2ef692 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1408 microversion: 2.54 time: 0.116199 Oct 29 03:27:13.496885 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2868/5959] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:13 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1408 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:14.523823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8fc96362-2e5a-4a6b-b13e-c3322e282f5d tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:14.525249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8fc96362-2e5a-4a6b-b13e-c3322e282f5d tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:14.532865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fc96362-2e5a-4a6b-b13e-c3322e282f5d tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:14.533376 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fc96362-2e5a-4a6b-b13e-c3322e282f5d tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:14.535320 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fc96362-2e5a-4a6b-b13e-c3322e282f5d tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:14.536054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fc96362-2e5a-4a6b-b13e-c3322e282f5d tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:14.536542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fc96362-2e5a-4a6b-b13e-c3322e282f5d tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:14.536971 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fc96362-2e5a-4a6b-b13e-c3322e282f5d tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:14.552941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:14.609923 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8fc96362-2e5a-4a6b-b13e-c3322e282f5d tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:14.618806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8fc96362-2e5a-4a6b-b13e-c3322e282f5d tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:14.620686 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8fc96362-2e5a-4a6b-b13e-c3322e282f5d tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:14.622164 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8fc96362-2e5a-4a6b-b13e-c3322e282f5d tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1408 microversion: 2.54 time: 0.102701 Oct 29 03:27:14.622936 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3092/5960] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:14 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1408 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:15.647829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-037e67bd-5f30-4686-bc93-4811da5f2c72 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:15.648464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-037e67bd-5f30-4686-bc93-4811da5f2c72 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:15.657991 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-037e67bd-5f30-4686-bc93-4811da5f2c72 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:15.658496 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-037e67bd-5f30-4686-bc93-4811da5f2c72 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:15.658934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-037e67bd-5f30-4686-bc93-4811da5f2c72 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:15.659682 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-037e67bd-5f30-4686-bc93-4811da5f2c72 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:15.660144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-037e67bd-5f30-4686-bc93-4811da5f2c72 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:15.660681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-037e67bd-5f30-4686-bc93-4811da5f2c72 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:15.774780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-037e67bd-5f30-4686-bc93-4811da5f2c72 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:15.786949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-037e67bd-5f30-4686-bc93-4811da5f2c72 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:15.788403 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-037e67bd-5f30-4686-bc93-4811da5f2c72 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:15.795574 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-037e67bd-5f30-4686-bc93-4811da5f2c72 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1408 microversion: 2.54 time: 0.151886 Oct 29 03:27:15.796359 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2869/5961] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:15 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:16.831160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-53da2cc9-dfa7-4ea1-a4d9-2bf5dfabf405 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:16.831798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-53da2cc9-dfa7-4ea1-a4d9-2bf5dfabf405 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:16.842139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-53da2cc9-dfa7-4ea1-a4d9-2bf5dfabf405 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:16.844364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-53da2cc9-dfa7-4ea1-a4d9-2bf5dfabf405 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:16.845571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-53da2cc9-dfa7-4ea1-a4d9-2bf5dfabf405 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:16.846761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-53da2cc9-dfa7-4ea1-a4d9-2bf5dfabf405 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:16.847774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-53da2cc9-dfa7-4ea1-a4d9-2bf5dfabf405 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:16.848357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-53da2cc9-dfa7-4ea1-a4d9-2bf5dfabf405 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:16.964032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-53da2cc9-dfa7-4ea1-a4d9-2bf5dfabf405 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:16.975316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-53da2cc9-dfa7-4ea1-a4d9-2bf5dfabf405 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:16.976815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-53da2cc9-dfa7-4ea1-a4d9-2bf5dfabf405 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:16.978085 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-53da2cc9-dfa7-4ea1-a4d9-2bf5dfabf405 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1408 microversion: 2.54 time: 0.155931 Oct 29 03:27:16.978959 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3093/5962] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:16 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:18.023953 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-53bf93d0-a15f-4841-bf74-2aa8a49c50d3 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:18.025178 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-53bf93d0-a15f-4841-bf74-2aa8a49c50d3 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:18.032956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53bf93d0-a15f-4841-bf74-2aa8a49c50d3 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:18.033720 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53bf93d0-a15f-4841-bf74-2aa8a49c50d3 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:18.034309 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53bf93d0-a15f-4841-bf74-2aa8a49c50d3 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:18.035194 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53bf93d0-a15f-4841-bf74-2aa8a49c50d3 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:18.035807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53bf93d0-a15f-4841-bf74-2aa8a49c50d3 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:18.036515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53bf93d0-a15f-4841-bf74-2aa8a49c50d3 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:18.155275 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-53bf93d0-a15f-4841-bf74-2aa8a49c50d3 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:18.167028 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-53bf93d0-a15f-4841-bf74-2aa8a49c50d3 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:18.168757 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-53bf93d0-a15f-4841-bf74-2aa8a49c50d3 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:18.170247 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-53bf93d0-a15f-4841-bf74-2aa8a49c50d3 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1408 microversion: 2.54 time: 0.151299 Oct 29 03:27:18.184684 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2870/5963] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:18 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:19.196730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-10ca9c01-80db-49a3-96c3-1ff68040cab8 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:19.197442 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-10ca9c01-80db-49a3-96c3-1ff68040cab8 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:19.207762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10ca9c01-80db-49a3-96c3-1ff68040cab8 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:19.208245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10ca9c01-80db-49a3-96c3-1ff68040cab8 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:19.209078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10ca9c01-80db-49a3-96c3-1ff68040cab8 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:19.210052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10ca9c01-80db-49a3-96c3-1ff68040cab8 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:19.210574 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10ca9c01-80db-49a3-96c3-1ff68040cab8 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:19.211152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10ca9c01-80db-49a3-96c3-1ff68040cab8 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:19.634863 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-10ca9c01-80db-49a3-96c3-1ff68040cab8 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:19.652787 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-10ca9c01-80db-49a3-96c3-1ff68040cab8 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:19.658156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-10ca9c01-80db-49a3-96c3-1ff68040cab8 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:19.660794 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-10ca9c01-80db-49a3-96c3-1ff68040cab8 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1408 microversion: 2.54 time: 0.468080 Oct 29 03:27:19.662479 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3094/5964] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:19 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1408 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:20.698992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2f9824e6-5892-45bf-ba0f-d5a43f2d280f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:20.698992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2f9824e6-5892-45bf-ba0f-d5a43f2d280f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:20.711370 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:20.715088 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f9824e6-5892-45bf-ba0f-d5a43f2d280f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:20.715924 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f9824e6-5892-45bf-ba0f-d5a43f2d280f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:20.716412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f9824e6-5892-45bf-ba0f-d5a43f2d280f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:20.717955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f9824e6-5892-45bf-ba0f-d5a43f2d280f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:20.718423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f9824e6-5892-45bf-ba0f-d5a43f2d280f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:20.718918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f9824e6-5892-45bf-ba0f-d5a43f2d280f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:20.836138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2f9824e6-5892-45bf-ba0f-d5a43f2d280f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:20.847462 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2f9824e6-5892-45bf-ba0f-d5a43f2d280f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:20.849136 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2f9824e6-5892-45bf-ba0f-d5a43f2d280f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:20.851103 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2f9824e6-5892-45bf-ba0f-d5a43f2d280f tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1408 microversion: 2.54 time: 0.163327 Oct 29 03:27:20.851779 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2871/5965] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:20 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:20.908261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a47c0300-cc19-45c0-8561-cff41f84f613 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:20.914426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a47c0300-cc19-45c0-8561-cff41f84f613 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:20.922262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a47c0300-cc19-45c0-8561-cff41f84f613 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:20.923171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a47c0300-cc19-45c0-8561-cff41f84f613 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:20.923838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a47c0300-cc19-45c0-8561-cff41f84f613 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:20.924996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a47c0300-cc19-45c0-8561-cff41f84f613 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:20.925702 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a47c0300-cc19-45c0-8561-cff41f84f613 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:20.926947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a47c0300-cc19-45c0-8561-cff41f84f613 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:20.993953 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a47c0300-cc19-45c0-8561-cff41f84f613 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "POST /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26/action" status: 200 len: 24559 microversion: 2.1 time: 0.089784 Oct 29 03:27:20.994984 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3095/5966] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:27:20 2022] POST /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26/action => generated 24559 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:27:21.881600 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e29324df-a874-41af-8954-fb9cd64cb932 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:21.882234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e29324df-a874-41af-8954-fb9cd64cb932 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:21.895212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e29324df-a874-41af-8954-fb9cd64cb932 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:21.899846 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e29324df-a874-41af-8954-fb9cd64cb932 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:21.900682 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e29324df-a874-41af-8954-fb9cd64cb932 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:21.901602 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e29324df-a874-41af-8954-fb9cd64cb932 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:21.905115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e29324df-a874-41af-8954-fb9cd64cb932 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:21.906891 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e29324df-a874-41af-8954-fb9cd64cb932 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:21.918529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:22.099722 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e29324df-a874-41af-8954-fb9cd64cb932 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:22.120278 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e29324df-a874-41af-8954-fb9cd64cb932 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:22.122342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e29324df-a874-41af-8954-fb9cd64cb932 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:22.124613 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e29324df-a874-41af-8954-fb9cd64cb932 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1408 microversion: 2.54 time: 0.247100 Oct 29 03:27:22.127105 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2872/5967] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:21 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1408 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:23.161592 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b99c6e77-dbfd-467d-8d95-90debce82761 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:23.162296 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b99c6e77-dbfd-467d-8d95-90debce82761 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:23.173272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b99c6e77-dbfd-467d-8d95-90debce82761 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:23.173745 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b99c6e77-dbfd-467d-8d95-90debce82761 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:23.174387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b99c6e77-dbfd-467d-8d95-90debce82761 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:23.175302 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b99c6e77-dbfd-467d-8d95-90debce82761 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:23.175753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b99c6e77-dbfd-467d-8d95-90debce82761 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:23.176323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b99c6e77-dbfd-467d-8d95-90debce82761 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:23.312653 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b99c6e77-dbfd-467d-8d95-90debce82761 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:23.336647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b99c6e77-dbfd-467d-8d95-90debce82761 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:23.340044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b99c6e77-dbfd-467d-8d95-90debce82761 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:23.348104 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b99c6e77-dbfd-467d-8d95-90debce82761 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1408 microversion: 2.54 time: 0.192194 Oct 29 03:27:23.349628 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3096/5968] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:23 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1408 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:23.679607 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b45c15c6-c2cc-4679-b174-b3a9b2360f5f tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:23.681653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b45c15c6-c2cc-4679-b174-b3a9b2360f5f tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: 09a0f147-9f3b-4180-a462-aebd0e6162ac] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:23.689253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b45c15c6-c2cc-4679-b174-b3a9b2360f5f tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:23.690139 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b45c15c6-c2cc-4679-b174-b3a9b2360f5f tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:23.690890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b45c15c6-c2cc-4679-b174-b3a9b2360f5f tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:23.691782 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b45c15c6-c2cc-4679-b174-b3a9b2360f5f tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:23.692413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b45c15c6-c2cc-4679-b174-b3a9b2360f5f tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:23.693092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b45c15c6-c2cc-4679-b174-b3a9b2360f5f tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:23.807147 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-b45c15c6-c2cc-4679-b174-b3a9b2360f5f tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lazy-loading 'services' on Instance uuid 09a0f147-9f3b-4180-a462-aebd0e6162ac {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:27:23.953239 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b45c15c6-c2cc-4679-b174-b3a9b2360f5f tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "DELETE /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac/os-volume_attachments/b8f7e718-e04b-4ef8-b97c-9baf324af79c" status: 202 len: 0 microversion: 2.1 time: 0.277659 Oct 29 03:27:23.954365 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2873/5969] 10.222.0.46 () {58 vars in 1416 bytes} [Sat Oct 29 03:27:23 2022] DELETE /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac/os-volume_attachments/b8f7e718-e04b-4ef8-b97c-9baf324af79c => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:27:24.376035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5d871e6e-ccb1-47d7-a7a8-910fb522164c tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:24.376720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5d871e6e-ccb1-47d7-a7a8-910fb522164c tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:24.390595 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5d871e6e-ccb1-47d7-a7a8-910fb522164c tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:24.391110 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5d871e6e-ccb1-47d7-a7a8-910fb522164c tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:24.391557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5d871e6e-ccb1-47d7-a7a8-910fb522164c tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:24.393335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5d871e6e-ccb1-47d7-a7a8-910fb522164c tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:24.393808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5d871e6e-ccb1-47d7-a7a8-910fb522164c tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:24.394730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5d871e6e-ccb1-47d7-a7a8-910fb522164c tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:24.620235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5d871e6e-ccb1-47d7-a7a8-910fb522164c tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:24.633958 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5d871e6e-ccb1-47d7-a7a8-910fb522164c tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:24.635797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5d871e6e-ccb1-47d7-a7a8-910fb522164c tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:24.637514 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5d871e6e-ccb1-47d7-a7a8-910fb522164c tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1408 microversion: 2.54 time: 0.265560 Oct 29 03:27:24.639585 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3097/5970] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:24 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1408 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:24.961570 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6b2a9760-3b31-4000-a7bf-5ad5c34833c6 tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-303755477", "availability_zone": "foo_zone"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:24.965621 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.aggregate [None req-6b2a9760-3b31-4000-a7bf-5ad5c34833c6 tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] Generated uuid bcf78976-4686-427e-a326-b40f998669c2 for aggregate {{(pid=127125) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 29 03:27:24.996172 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6b2a9760-3b31-4000-a7bf-5ad5c34833c6 tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.183789 Oct 29 03:27:25.003241 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2874/5971] 10.222.0.46 () {60 vars in 1164 bytes} [Sat Oct 29 03:27:24 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:27:25.008483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bbc5cb48-4cd2-4e72-9d12-58c6e957d5e4 tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:25.043119 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bbc5cb48-4cd2-4e72-9d12-58c6e957d5e4 tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.038473 Oct 29 03:27:25.045109 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3098/5972] 10.222.0.46 () {60 vars in 1194 bytes} [Sat Oct 29 03:27:25 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:27:25.056944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-710ef9b8-d228-4cf0-b9dc-4b3da548031e tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:25.067235 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-710ef9b8-d228-4cf0-b9dc-4b3da548031e tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:25.067956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-710ef9b8-d228-4cf0-b9dc-4b3da548031e tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:25.068397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-710ef9b8-d228-4cf0-b9dc-4b3da548031e tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:25.069156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-710ef9b8-d228-4cf0-b9dc-4b3da548031e tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:25.069640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-710ef9b8-d228-4cf0-b9dc-4b3da548031e tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:25.073225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-710ef9b8-d228-4cf0-b9dc-4b3da548031e tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:25.126109 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-710ef9b8-d228-4cf0-b9dc-4b3da548031e tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] 10.222.0.46 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.073013 Oct 29 03:27:25.128351 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2875/5973] 10.222.0.46 () {58 vars in 1176 bytes} [Sat Oct 29 03:27:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:27:25.140814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3fec5ab7-b331-47d8-80c7-816068f707a5 tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:25.156772 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3fec5ab7-b331-47d8-80c7-816068f707a5 tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.020530 Oct 29 03:27:25.157438 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3099/5974] 10.222.0.46 () {58 vars in 1143 bytes} [Sat Oct 29 03:27:25 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:27:25.169856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-31bc8031-dc41-4daa-85fd-2a4aca92990b tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-862967-2"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:25.183490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-31bc8031-dc41-4daa-85fd-2a4aca92990b tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:25.183979 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-31bc8031-dc41-4daa-85fd-2a4aca92990b tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:25.184622 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-31bc8031-dc41-4daa-85fd-2a4aca92990b tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:25.475463 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-31bc8031-dc41-4daa-85fd-2a4aca92990b tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.309789 Oct 29 03:27:25.476401 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2876/5975] 10.222.0.46 () {60 vars in 1194 bytes} [Sat Oct 29 03:27:25 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:27:25.488457 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3b86b036-3910-4f80-b138-f4e8d4686d83 tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:25.497925 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3b86b036-3910-4f80-b138-f4e8d4686d83 tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.013338 Oct 29 03:27:25.502885 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3100/5976] 10.222.0.46 () {58 vars in 1152 bytes} [Sat Oct 29 03:27:25 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:27:25.511798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-30e87567-48bd-4ebb-bf26-ef53e17ba70c tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1421701973", "availability_zone": "foo_zone"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:25.578689 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-30e87567-48bd-4ebb-bf26-ef53e17ba70c tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] 10.222.0.46 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.071764 Oct 29 03:27:25.579947 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2877/5977] 10.222.0.46 () {60 vars in 1173 bytes} [Sat Oct 29 03:27:25 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:27:25.591581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d5aa55c9-8a6a-4bd6-af66-0f3924fce01b tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:25.627361 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d5aa55c9-8a6a-4bd6-af66-0f3924fce01b tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.039578 Oct 29 03:27:25.629189 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3101/5978] 10.222.0.46 () {60 vars in 1194 bytes} [Sat Oct 29 03:27:25 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:27:25.640318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-79201c87-bb8a-443c-8572-7c3d2078f130 tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:25.666875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4f42420f-d604-4689-b528-bb171252929c tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:25.667903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4f42420f-d604-4689-b528-bb171252929c tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:25.686548 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-79201c87-bb8a-443c-8572-7c3d2078f130 tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] 10.222.0.46 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.040154 Oct 29 03:27:25.686548 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2878/5979] 10.222.0.46 () {58 vars in 1152 bytes} [Sat Oct 29 03:27:25 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:27:25.687089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f42420f-d604-4689-b528-bb171252929c tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:25.687089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f42420f-d604-4689-b528-bb171252929c tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:25.687089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f42420f-d604-4689-b528-bb171252929c tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:25.687089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f42420f-d604-4689-b528-bb171252929c tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:25.687089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f42420f-d604-4689-b528-bb171252929c tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:25.687089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f42420f-d604-4689-b528-bb171252929c tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:25.692915 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cb1a802c-2d5a-4e06-9dd8-a6e4e338ce94 tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-862967-2"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:25.708238 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb1a802c-2d5a-4e06-9dd8-a6e4e338ce94 tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:25.708920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb1a802c-2d5a-4e06-9dd8-a6e4e338ce94 tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:25.709566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb1a802c-2d5a-4e06-9dd8-a6e4e338ce94 tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:25.782879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4f42420f-d604-4689-b528-bb171252929c tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:25.792975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4f42420f-d604-4689-b528-bb171252929c tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:25.794647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4f42420f-d604-4689-b528-bb171252929c tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:25.796070 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4f42420f-d604-4689-b528-bb171252929c tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1408 microversion: 2.54 time: 0.135205 Oct 29 03:27:25.797170 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3102/5980] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:25 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1408 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:25.917950 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cb1a802c-2d5a-4e06-9dd8-a6e4e338ce94 tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] 10.222.0.46 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.229022 Oct 29 03:27:25.918748 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2879/5981] 10.222.0.46 () {60 vars in 1194 bytes} [Sat Oct 29 03:27:25 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:27:25.930506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-64d0e3f4-aa36-466a-8563-346319bba958 tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:25.957633 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-64d0e3f4-aa36-466a-8563-346319bba958 tempest-TestAggregatesBasicOps-1822148137 tempest-TestAggregatesBasicOps-1822148137-project-admin] 10.222.0.46 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.030767 Oct 29 03:27:25.958878 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3103/5982] 10.222.0.46 () {58 vars in 1155 bytes} [Sat Oct 29 03:27:25 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 29 03:27:26.824244 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5ca07c78-944f-40b3-8f34-83bf37e19c37 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:26.825005 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5ca07c78-944f-40b3-8f34-83bf37e19c37 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:26.836330 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ca07c78-944f-40b3-8f34-83bf37e19c37 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:26.837181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ca07c78-944f-40b3-8f34-83bf37e19c37 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:26.837693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ca07c78-944f-40b3-8f34-83bf37e19c37 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:26.841429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ca07c78-944f-40b3-8f34-83bf37e19c37 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:26.842019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ca07c78-944f-40b3-8f34-83bf37e19c37 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:26.842575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ca07c78-944f-40b3-8f34-83bf37e19c37 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:26.937681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5ca07c78-944f-40b3-8f34-83bf37e19c37 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:26.947884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5ca07c78-944f-40b3-8f34-83bf37e19c37 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:26.949826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5ca07c78-944f-40b3-8f34-83bf37e19c37 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:26.951746 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5ca07c78-944f-40b3-8f34-83bf37e19c37 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1426 microversion: 2.54 time: 0.132438 Oct 29 03:27:26.953698 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2880/5983] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:26 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1426 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:27.433111 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-547d8d18-7ee3-47fb-8ce1-9257c1222dfe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:27.437223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-547d8d18-7ee3-47fb-8ce1-9257c1222dfe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:27.458152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-547d8d18-7ee3-47fb-8ce1-9257c1222dfe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:27.458559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-547d8d18-7ee3-47fb-8ce1-9257c1222dfe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:27.459004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-547d8d18-7ee3-47fb-8ce1-9257c1222dfe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:27.459738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-547d8d18-7ee3-47fb-8ce1-9257c1222dfe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:27.460201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-547d8d18-7ee3-47fb-8ce1-9257c1222dfe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:27.462676 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-547d8d18-7ee3-47fb-8ce1-9257c1222dfe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:27.619934 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-547d8d18-7ee3-47fb-8ce1-9257c1222dfe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:27:27.624792 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-547d8d18-7ee3-47fb-8ce1-9257c1222dfe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:27:27.625568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-547d8d18-7ee3-47fb-8ce1-9257c1222dfe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:27:27.626225 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-547d8d18-7ee3-47fb-8ce1-9257c1222dfe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:27:27.626803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-547d8d18-7ee3-47fb-8ce1-9257c1222dfe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:27:27.746728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-547d8d18-7ee3-47fb-8ce1-9257c1222dfe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:27.755021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-547d8d18-7ee3-47fb-8ce1-9257c1222dfe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:27.755766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-547d8d18-7ee3-47fb-8ce1-9257c1222dfe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:27.756358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-547d8d18-7ee3-47fb-8ce1-9257c1222dfe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:27.757258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-547d8d18-7ee3-47fb-8ce1-9257c1222dfe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:27.757871 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-547d8d18-7ee3-47fb-8ce1-9257c1222dfe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:27.758454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-547d8d18-7ee3-47fb-8ce1-9257c1222dfe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:27.791226 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-547d8d18-7ee3-47fb-8ce1-9257c1222dfe tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "POST /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26/action" status: 202 len: 1138 microversion: 2.1 time: 0.363184 Oct 29 03:27:27.792596 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3104/5984] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:27:27 2022] POST /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26/action => generated 1138 bytes in 365 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 29 03:27:27.816538 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0ce119bb-46c7-4933-869b-a3bd794bcd09 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:27.817438 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0ce119bb-46c7-4933-869b-a3bd794bcd09 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:27.843800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ce119bb-46c7-4933-869b-a3bd794bcd09 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:27.849272 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ce119bb-46c7-4933-869b-a3bd794bcd09 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:27.849747 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ce119bb-46c7-4933-869b-a3bd794bcd09 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:27.850566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ce119bb-46c7-4933-869b-a3bd794bcd09 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:27.852439 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ce119bb-46c7-4933-869b-a3bd794bcd09 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:27.872458 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ce119bb-46c7-4933-869b-a3bd794bcd09 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:27.981564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-35e216d4-ad10-48f3-8653-1e32f7f91456 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:27.993030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-35e216d4-ad10-48f3-8653-1e32f7f91456 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:28.008175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35e216d4-ad10-48f3-8653-1e32f7f91456 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:28.009034 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35e216d4-ad10-48f3-8653-1e32f7f91456 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:28.009721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35e216d4-ad10-48f3-8653-1e32f7f91456 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:28.010643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35e216d4-ad10-48f3-8653-1e32f7f91456 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:28.012083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35e216d4-ad10-48f3-8653-1e32f7f91456 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:28.012762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35e216d4-ad10-48f3-8653-1e32f7f91456 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:28.163743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-35e216d4-ad10-48f3-8653-1e32f7f91456 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:28.175212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-35e216d4-ad10-48f3-8653-1e32f7f91456 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:28.177150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-35e216d4-ad10-48f3-8653-1e32f7f91456 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:28.178687 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-35e216d4-ad10-48f3-8653-1e32f7f91456 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1414 microversion: 2.54 time: 0.202555 Oct 29 03:27:28.179885 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3105/5985] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:27 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1414 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:28.364579 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0ce119bb-46c7-4933-869b-a3bd794bcd09 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:28.379444 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0ce119bb-46c7-4933-869b-a3bd794bcd09 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26" status: 200 len: 1691 microversion: 2.1 time: 0.566694 Oct 29 03:27:28.383029 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2881/5986] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:27 2022] GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 => generated 1691 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:29.211170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-79f302e6-7aaa-4fe5-8f8f-07cbeb8627dd tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:29.212492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-79f302e6-7aaa-4fe5-8f8f-07cbeb8627dd tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:29.226824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79f302e6-7aaa-4fe5-8f8f-07cbeb8627dd tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:29.228168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79f302e6-7aaa-4fe5-8f8f-07cbeb8627dd tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:29.228965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79f302e6-7aaa-4fe5-8f8f-07cbeb8627dd tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:29.230044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79f302e6-7aaa-4fe5-8f8f-07cbeb8627dd tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:29.230754 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79f302e6-7aaa-4fe5-8f8f-07cbeb8627dd tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:29.231334 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79f302e6-7aaa-4fe5-8f8f-07cbeb8627dd tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:29.305860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-79f302e6-7aaa-4fe5-8f8f-07cbeb8627dd tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:29.314549 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-79f302e6-7aaa-4fe5-8f8f-07cbeb8627dd tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:29.315998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-79f302e6-7aaa-4fe5-8f8f-07cbeb8627dd tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:29.318331 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-79f302e6-7aaa-4fe5-8f8f-07cbeb8627dd tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1414 microversion: 2.54 time: 0.112230 Oct 29 03:27:29.319117 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3106/5987] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:29 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1414 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:29.410242 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1ba305d3-9f11-45b4-b1de-03c382951b6a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:29.412884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1ba305d3-9f11-45b4-b1de-03c382951b6a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:29.428596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ba305d3-9f11-45b4-b1de-03c382951b6a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:29.434596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ba305d3-9f11-45b4-b1de-03c382951b6a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:29.435326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ba305d3-9f11-45b4-b1de-03c382951b6a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:29.436318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ba305d3-9f11-45b4-b1de-03c382951b6a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:29.438295 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ba305d3-9f11-45b4-b1de-03c382951b6a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:29.439042 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ba305d3-9f11-45b4-b1de-03c382951b6a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:29.788277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1ba305d3-9f11-45b4-b1de-03c382951b6a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:29.799620 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1ba305d3-9f11-45b4-b1de-03c382951b6a tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26" status: 200 len: 1691 microversion: 2.1 time: 0.394392 Oct 29 03:27:29.818187 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2882/5988] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:29 2022] GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 => generated 1691 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:30.345107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eb9bc6e7-2409-4d02-a38c-4540a49a4a35 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:30.346331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-eb9bc6e7-2409-4d02-a38c-4540a49a4a35 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:30.352791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:30.354802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb9bc6e7-2409-4d02-a38c-4540a49a4a35 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:30.355493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb9bc6e7-2409-4d02-a38c-4540a49a4a35 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:30.356238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb9bc6e7-2409-4d02-a38c-4540a49a4a35 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:30.357291 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb9bc6e7-2409-4d02-a38c-4540a49a4a35 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:30.357931 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb9bc6e7-2409-4d02-a38c-4540a49a4a35 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:30.358510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb9bc6e7-2409-4d02-a38c-4540a49a4a35 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:30.462182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-eb9bc6e7-2409-4d02-a38c-4540a49a4a35 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:30.476085 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-eb9bc6e7-2409-4d02-a38c-4540a49a4a35 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:30.477844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-eb9bc6e7-2409-4d02-a38c-4540a49a4a35 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:30.479336 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eb9bc6e7-2409-4d02-a38c-4540a49a4a35 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1399 microversion: 2.54 time: 0.138383 Oct 29 03:27:30.480015 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3107/5989] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:30 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1399 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:30.516434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f64ace64-d412-47b2-b093-f92c7ca1f368 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '.version_select at 0x7ff053d6f8b0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:30.545374 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f64ace64-d412-47b2-b093-f92c7ca1f368 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-196673249" status: 204 len: 0 microversion: 2.54 time: 0.040277 Oct 29 03:27:30.546207 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2883/5990] 10.222.0.46 () {60 vars in 1316 bytes} [Sat Oct 29 03:27:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-196673249 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:27:30.572505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-be876826-2343-46f2-a82e-f023736f110b tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:30.573050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-be876826-2343-46f2-a82e-f023736f110b tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:30.581729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be876826-2343-46f2-a82e-f023736f110b tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:30.582223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be876826-2343-46f2-a82e-f023736f110b tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:30.582649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be876826-2343-46f2-a82e-f023736f110b tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:30.583360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be876826-2343-46f2-a82e-f023736f110b tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:30.583797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be876826-2343-46f2-a82e-f023736f110b tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:30.587823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be876826-2343-46f2-a82e-f023736f110b tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:30.622864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-be876826-2343-46f2-a82e-f023736f110b tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:27:30.712805 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-71389252-a18e-44d4-8d50-c64a0d733042 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:30.713318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-71389252-a18e-44d4-8d50-c64a0d733042 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: 09a0f147-9f3b-4180-a462-aebd0e6162ac] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:30.728200 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-71389252-a18e-44d4-8d50-c64a0d733042 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:30.728760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-71389252-a18e-44d4-8d50-c64a0d733042 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:30.729450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-71389252-a18e-44d4-8d50-c64a0d733042 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:30.730178 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-71389252-a18e-44d4-8d50-c64a0d733042 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:30.730633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-71389252-a18e-44d4-8d50-c64a0d733042 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:30.731146 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-71389252-a18e-44d4-8d50-c64a0d733042 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:30.784923 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-be876826-2343-46f2-a82e-f023736f110b tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 204 len: 0 microversion: 2.54 time: 0.221968 Oct 29 03:27:30.786378 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3108/5991] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Oct 29 03:27:30 2022] DELETE /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:27:30.795639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1c079c19-2616-44c5-b4e6-d64cce9e0c36 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:30.796649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1c079c19-2616-44c5-b4e6-d64cce9e0c36 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:30.804152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c079c19-2616-44c5-b4e6-d64cce9e0c36 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:30.804665 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c079c19-2616-44c5-b4e6-d64cce9e0c36 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:30.805139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c079c19-2616-44c5-b4e6-d64cce9e0c36 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:30.805845 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c079c19-2616-44c5-b4e6-d64cce9e0c36 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:30.806297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c079c19-2616-44c5-b4e6-d64cce9e0c36 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:30.806715 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c079c19-2616-44c5-b4e6-d64cce9e0c36 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:30.810097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-71389252-a18e-44d4-8d50-c64a0d733042 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: 09a0f147-9f3b-4180-a462-aebd0e6162ac] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:27:30.934081 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-71389252-a18e-44d4-8d50-c64a0d733042 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "DELETE /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac" status: 204 len: 0 microversion: 2.1 time: 0.224853 Oct 29 03:27:30.936992 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2884/5992] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:27:30 2022] DELETE /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:27:30.941724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1c079c19-2616-44c5-b4e6-d64cce9e0c36 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:30.945784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8cc16a43-410f-4b70-849f-c2bd841cc911 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:30.947131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8cc16a43-410f-4b70-849f-c2bd841cc911 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:30.954606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1c079c19-2616-44c5-b4e6-d64cce9e0c36 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:30.956874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8cc16a43-410f-4b70-849f-c2bd841cc911 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:30.957501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8cc16a43-410f-4b70-849f-c2bd841cc911 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:30.957676 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1c079c19-2616-44c5-b4e6-d64cce9e0c36 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:30.957943 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8cc16a43-410f-4b70-849f-c2bd841cc911 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:30.958863 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8cc16a43-410f-4b70-849f-c2bd841cc911 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:30.959193 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1c079c19-2616-44c5-b4e6-d64cce9e0c36 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1405 microversion: 2.54 time: 0.168844 Oct 29 03:27:30.959490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8cc16a43-410f-4b70-849f-c2bd841cc911 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:30.959923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8cc16a43-410f-4b70-849f-c2bd841cc911 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:30.960754 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3109/5993] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:30 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:27:30.965769 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-86f225f9-ecb1-47a2-9e65-2c05a668a70b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:30.968423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-86f225f9-ecb1-47a2-9e65-2c05a668a70b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: 09a0f147-9f3b-4180-a462-aebd0e6162ac] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:30.975732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86f225f9-ecb1-47a2-9e65-2c05a668a70b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:30.976456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86f225f9-ecb1-47a2-9e65-2c05a668a70b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:30.977599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86f225f9-ecb1-47a2-9e65-2c05a668a70b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:30.978833 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86f225f9-ecb1-47a2-9e65-2c05a668a70b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:30.979452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86f225f9-ecb1-47a2-9e65-2c05a668a70b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:30.980028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86f225f9-ecb1-47a2-9e65-2c05a668a70b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:31.142458 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8cc16a43-410f-4b70-849f-c2bd841cc911 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:31.150983 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8cc16a43-410f-4b70-849f-c2bd841cc911 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26" status: 200 len: 1691 microversion: 2.1 time: 0.212700 Oct 29 03:27:31.151549 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2885/5994] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:30 2022] GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 => generated 1691 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:31.225510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-86f225f9-ecb1-47a2-9e65-2c05a668a70b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c633d65d3754c0bb47a7cb8754a97cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e202cdaad65452fa00963abd83004b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:31.227862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:31.234927 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-86f225f9-ecb1-47a2-9e65-2c05a668a70b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "GET /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac" status: 200 len: 1514 microversion: 2.1 time: 0.272905 Oct 29 03:27:31.235530 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3110/5995] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:30 2022] GET /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac => generated 1514 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:31.987693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d631b304-3384-4ed4-8be3-2591911a3d29 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:31.988457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d631b304-3384-4ed4-8be3-2591911a3d29 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:31.995714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d631b304-3384-4ed4-8be3-2591911a3d29 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:31.996364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d631b304-3384-4ed4-8be3-2591911a3d29 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:31.996897 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d631b304-3384-4ed4-8be3-2591911a3d29 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:31.997860 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d631b304-3384-4ed4-8be3-2591911a3d29 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:31.998471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d631b304-3384-4ed4-8be3-2591911a3d29 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:31.999283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d631b304-3384-4ed4-8be3-2591911a3d29 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:32.066553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d631b304-3384-4ed4-8be3-2591911a3d29 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:32.081863 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d631b304-3384-4ed4-8be3-2591911a3d29 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:32.083996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d631b304-3384-4ed4-8be3-2591911a3d29 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51644ebe8c2747c7969d52bc28483f07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b6a279511bf4dfb92395f4311868ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:32.084712 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d631b304-3384-4ed4-8be3-2591911a3d29 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 200 len: 1405 microversion: 2.54 time: 0.101230 Oct 29 03:27:32.085369 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2886/5996] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:31 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 1405 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:32.174781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cd35f1b5-3edf-4c0b-a15e-9d2dfa334aaf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:32.175307 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cd35f1b5-3edf-4c0b-a15e-9d2dfa334aaf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:32.183650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd35f1b5-3edf-4c0b-a15e-9d2dfa334aaf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:32.184136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd35f1b5-3edf-4c0b-a15e-9d2dfa334aaf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:32.184600 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd35f1b5-3edf-4c0b-a15e-9d2dfa334aaf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:32.185316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd35f1b5-3edf-4c0b-a15e-9d2dfa334aaf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:32.185878 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd35f1b5-3edf-4c0b-a15e-9d2dfa334aaf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:32.186312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd35f1b5-3edf-4c0b-a15e-9d2dfa334aaf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:32.261291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5bdb82ef-c933-4f05-897b-ac73b036770d tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:32.262220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5bdb82ef-c933-4f05-897b-ac73b036770d tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: 09a0f147-9f3b-4180-a462-aebd0e6162ac] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:32.269885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5bdb82ef-c933-4f05-897b-ac73b036770d tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:32.270637 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5bdb82ef-c933-4f05-897b-ac73b036770d tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:32.271278 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5bdb82ef-c933-4f05-897b-ac73b036770d tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:32.272945 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5bdb82ef-c933-4f05-897b-ac73b036770d tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:32.273686 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5bdb82ef-c933-4f05-897b-ac73b036770d tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:32.274362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5bdb82ef-c933-4f05-897b-ac73b036770d tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:32.444900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cd35f1b5-3edf-4c0b-a15e-9d2dfa334aaf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:32.458494 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cd35f1b5-3edf-4c0b-a15e-9d2dfa334aaf tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26" status: 200 len: 1691 microversion: 2.1 time: 0.287550 Oct 29 03:27:32.459635 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3111/5997] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:32 2022] GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 => generated 1691 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:32.547174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5bdb82ef-c933-4f05-897b-ac73b036770d tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c633d65d3754c0bb47a7cb8754a97cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e202cdaad65452fa00963abd83004b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:32.556505 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5bdb82ef-c933-4f05-897b-ac73b036770d tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "GET /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac" status: 200 len: 1514 microversion: 2.1 time: 0.301002 Oct 29 03:27:32.570499 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2887/5998] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:32 2022] GET /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac => generated 1514 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:27:33.113865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d82b4860-21eb-4c46-b208-496866d2bbe4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:33.116610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d82b4860-21eb-4c46-b208-496866d2bbe4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] [instance: b7e2f0bc-0229-48cf-a838-52eb7397ec5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:33.132994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d82b4860-21eb-4c46-b208-496866d2bbe4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:33.133544 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d82b4860-21eb-4c46-b208-496866d2bbe4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:33.134109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d82b4860-21eb-4c46-b208-496866d2bbe4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:33.135079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d82b4860-21eb-4c46-b208-496866d2bbe4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:33.135719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d82b4860-21eb-4c46-b208-496866d2bbe4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:33.136154 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d82b4860-21eb-4c46-b208-496866d2bbe4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:33.158090 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-d82b4860-21eb-4c46-b208-496866d2bbe4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] HTTP exception thrown: Instance b7e2f0bc-0229-48cf-a838-52eb7397ec5d could not be found. Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d82b4860-21eb-4c46-b208-496866d2bbe4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Request method failure captured: Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d HTTP/1.1 Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJ14kIwe8FpcnI59AUvYAY3AuQIh7rkyf_8yEV5c8W65zYQjC7QSADG9eVjVQy3ielLQlQUvOj27awlQg_i5MlEIY65ym2BaRaILdfjB5DNoNiJOBgKIHm_c4y7MBc7zQeOn6bybecfZxKjxEveNsbydC1Qi6HX11quje33R5QLwK9E Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: X-Openstack-Nova-Api-Version: 2.54 Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 3b6a279511bf4dfb92395f4311868ca7 Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServerShowV254Test-579381375 Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3b6a279511bf4dfb92395f4311868ca7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3b6a279511bf4dfb92395f4311868ca7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3b6a279511bf4dfb92395f4311868ca7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3b6a279511bf4dfb92395f4311868ca7"}]}] Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServerShowV254Test-579381375 Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 3b6a279511bf4dfb92395f4311868ca7 Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServerShowV254Test-579381375 Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServerShowV254Test-579381375-project Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 51644ebe8c2747c7969d52bc28483f07 Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServerShowV254Test-579381375-project Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance b7e2f0bc-0229-48cf-a838-52eb7397ec5d could not be found. Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'b7e2f0bc-0229-48cf-a838-52eb7397ec5d'} Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7e2f0bc-0229-48cf-a838-52eb7397ec5d could not be found. Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7e2f0bc-0229-48cf-a838-52eb7397ec5d could not be found. Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:27:33.160291 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:27:33.165577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:27:33.165577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:27:33.165577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:27:33.165577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:27:33.165577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:27:33.165577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7e2f0bc-0229-48cf-a838-52eb7397ec5d could not be found. Oct 29 03:27:33.165577 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:27:33.165577 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d82b4860-21eb-4c46-b208-496866d2bbe4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] Returning 404 to user: Instance b7e2f0bc-0229-48cf-a838-52eb7397ec5d could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:27:33.165577 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d82b4860-21eb-4c46-b208-496866d2bbe4 tempest-ServerShowV254Test-579381375 tempest-ServerShowV254Test-579381375-project] 10.222.0.46 "GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d" status: 404 len: 111 microversion: 2.54 time: 0.054858 Oct 29 03:27:33.165577 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3112/5999] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:33 2022] GET /compute/v2.1/servers/b7e2f0bc-0229-48cf-a838-52eb7397ec5d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 29 03:27:33.485478 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-45b7f493-50b3-453d-96a5-128761fcef8c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:33.487239 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-45b7f493-50b3-453d-96a5-128761fcef8c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:33.500677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45b7f493-50b3-453d-96a5-128761fcef8c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:33.501217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45b7f493-50b3-453d-96a5-128761fcef8c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:33.501665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45b7f493-50b3-453d-96a5-128761fcef8c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:33.502401 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45b7f493-50b3-453d-96a5-128761fcef8c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:33.502863 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45b7f493-50b3-453d-96a5-128761fcef8c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:33.503291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45b7f493-50b3-453d-96a5-128761fcef8c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:33.585953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b2b2e805-e749-4b7d-96e0-0852a443b220 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:33.587398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b2b2e805-e749-4b7d-96e0-0852a443b220 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: 09a0f147-9f3b-4180-a462-aebd0e6162ac] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:33.631353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b2b2e805-e749-4b7d-96e0-0852a443b220 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:33.633145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b2b2e805-e749-4b7d-96e0-0852a443b220 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:33.633609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b2b2e805-e749-4b7d-96e0-0852a443b220 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:33.634436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b2b2e805-e749-4b7d-96e0-0852a443b220 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:33.634982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b2b2e805-e749-4b7d-96e0-0852a443b220 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:33.635641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b2b2e805-e749-4b7d-96e0-0852a443b220 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:33.746572 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b2b2e805-e749-4b7d-96e0-0852a443b220 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c633d65d3754c0bb47a7cb8754a97cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e202cdaad65452fa00963abd83004b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:33.756849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-45b7f493-50b3-453d-96a5-128761fcef8c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:33.769996 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b2b2e805-e749-4b7d-96e0-0852a443b220 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "GET /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac" status: 200 len: 1304 microversion: 2.1 time: 0.189973 Oct 29 03:27:33.776743 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3113/6000] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:33 2022] GET /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac => generated 1304 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:33.776919 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-45b7f493-50b3-453d-96a5-128761fcef8c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26" status: 200 len: 1691 microversion: 2.1 time: 0.291273 Oct 29 03:27:33.794555 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2888/6001] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:33 2022] GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 => generated 1691 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:33.986532 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-da3ac7e5-34c7-4c33-a0ee-39263b4c99f5 req-b5321b54-f293-4fc0-94da-b7aa6b1afd02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09a0f147-9f3b-4180-a462-aebd0e6162ac", "name": "network-vif-deleted", "tag": "5a1277ad-8bce-48a3-94a0-a02c81dcbad8"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:33.999513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-da3ac7e5-34c7-4c33-a0ee-39263b4c99f5 req-b5321b54-f293-4fc0-94da-b7aa6b1afd02 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:34.000089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-da3ac7e5-34c7-4c33-a0ee-39263b4c99f5 req-b5321b54-f293-4fc0-94da-b7aa6b1afd02 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:34.000627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-da3ac7e5-34c7-4c33-a0ee-39263b4c99f5 req-b5321b54-f293-4fc0-94da-b7aa6b1afd02 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:34.017459 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-da3ac7e5-34c7-4c33-a0ee-39263b4c99f5 req-b5321b54-f293-4fc0-94da-b7aa6b1afd02 service nova] Creating event network-vif-deleted:5a1277ad-8bce-48a3-94a0-a02c81dcbad8 for instance 09a0f147-9f3b-4180-a462-aebd0e6162ac on n-h2-862967-2 Oct 29 03:27:34.023796 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-da3ac7e5-34c7-4c33-a0ee-39263b4c99f5 req-b5321b54-f293-4fc0-94da-b7aa6b1afd02 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.251494 Oct 29 03:27:34.024566 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3114/6002] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:27:34.795394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a7701acf-d4e0-4a00-846e-2ff81bdd2ce1 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:34.796259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a7701acf-d4e0-4a00-846e-2ff81bdd2ce1 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: 09a0f147-9f3b-4180-a462-aebd0e6162ac] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:34.802620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4eef5e60-ffc8-473f-8274-33cf13347344 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:34.804314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4eef5e60-ffc8-473f-8274-33cf13347344 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:34.807842 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7701acf-d4e0-4a00-846e-2ff81bdd2ce1 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:34.809656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7701acf-d4e0-4a00-846e-2ff81bdd2ce1 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:34.815556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7701acf-d4e0-4a00-846e-2ff81bdd2ce1 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:34.817605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7701acf-d4e0-4a00-846e-2ff81bdd2ce1 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:34.819337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4eef5e60-ffc8-473f-8274-33cf13347344 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:34.819868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7701acf-d4e0-4a00-846e-2ff81bdd2ce1 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:34.820389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7701acf-d4e0-4a00-846e-2ff81bdd2ce1 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:34.820828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4eef5e60-ffc8-473f-8274-33cf13347344 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:34.821477 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4eef5e60-ffc8-473f-8274-33cf13347344 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:34.822367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4eef5e60-ffc8-473f-8274-33cf13347344 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:34.823004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4eef5e60-ffc8-473f-8274-33cf13347344 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:34.823587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4eef5e60-ffc8-473f-8274-33cf13347344 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:34.854538 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-a7701acf-d4e0-4a00-846e-2ff81bdd2ce1 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] HTTP exception thrown: Instance 09a0f147-9f3b-4180-a462-aebd0e6162ac could not be found. Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a7701acf-d4e0-4a00-846e-2ff81bdd2ce1 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Request method failure captured: Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac HTTP/1.1 Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJ0YdtPHy1UNOHS68OFudueMG8qwATSpEX796GFr6RtLN3qwTf8tbUmi7TI92d4w8mCxC-3-BdnSBF0ve_cYv-bciTlvllMfCAUmk6dRTi25ERuVG89N8bJJISyQhn9VpwS-bSL_uIXZmKpViVWMRv_5wRYLBfzVKSClQA0eHhu2KIU Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 6e202cdaad65452fa00963abd83004b9 Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1569231830 Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6e202cdaad65452fa00963abd83004b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6e202cdaad65452fa00963abd83004b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6e202cdaad65452fa00963abd83004b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6e202cdaad65452fa00963abd83004b9"}]}] Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-VolumesSnapshotTestJSON-1569231830 Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 6e202cdaad65452fa00963abd83004b9 Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1569231830 Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-VolumesSnapshotTestJSON-1569231830-project Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 9c633d65d3754c0bb47a7cb8754a97cd Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-VolumesSnapshotTestJSON-1569231830-project Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 09a0f147-9f3b-4180-a462-aebd0e6162ac could not be found. Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '09a0f147-9f3b-4180-a462-aebd0e6162ac'} Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09a0f147-9f3b-4180-a462-aebd0e6162ac could not be found. Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09a0f147-9f3b-4180-a462-aebd0e6162ac could not be found. Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:27:34.856475 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:27:34.861469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:27:34.861469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:27:34.861469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:27:34.861469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:27:34.861469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:27:34.861469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09a0f147-9f3b-4180-a462-aebd0e6162ac could not be found. Oct 29 03:27:34.861469 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:27:34.861469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a7701acf-d4e0-4a00-846e-2ff81bdd2ce1 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Returning 404 to user: Instance 09a0f147-9f3b-4180-a462-aebd0e6162ac could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:27:34.861469 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a7701acf-d4e0-4a00-846e-2ff81bdd2ce1 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "GET /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac" status: 404 len: 111 microversion: 2.1 time: 0.070192 Oct 29 03:27:34.862642 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2889/6003] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:34 2022] GET /compute/v2.1/servers/09a0f147-9f3b-4180-a462-aebd0e6162ac => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:27:35.059372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4eef5e60-ffc8-473f-8274-33cf13347344 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:35.072222 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4eef5e60-ffc8-473f-8274-33cf13347344 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26" status: 200 len: 1691 microversion: 2.1 time: 0.277668 Oct 29 03:27:35.086734 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3115/6004] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:34 2022] GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 => generated 1691 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:35.138352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:35.296070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8acf8ed5-a2a8-461f-b680-44a6d883911e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-202687871", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": "none"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:35.372107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-8acf8ed5-a2a8-461f-b680-44a6d883911e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:27:35.372581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-8acf8ed5-a2a8-461f-b680-44a6d883911e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:27:35.373149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-8acf8ed5-a2a8-461f-b680-44a6d883911e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:27:35.373563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-8acf8ed5-a2a8-461f-b680-44a6d883911e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:27:35.373980 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-8acf8ed5-a2a8-461f-b680-44a6d883911e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:27:35.383715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8acf8ed5-a2a8-461f-b680-44a6d883911e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:35.384498 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8acf8ed5-a2a8-461f-b680-44a6d883911e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:35.384956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8acf8ed5-a2a8-461f-b680-44a6d883911e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:35.385969 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8acf8ed5-a2a8-461f-b680-44a6d883911e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:35.386563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8acf8ed5-a2a8-461f-b680-44a6d883911e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:35.387239 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8acf8ed5-a2a8-461f-b680-44a6d883911e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:35.409204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-8acf8ed5-a2a8-461f-b680-44a6d883911e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Getting quotas for project 10deb4e4b325488eab463dda518c5e86. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:27:35.414501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-8acf8ed5-a2a8-461f-b680-44a6d883911e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Getting quotas for user bdfdc331a0714227893dbea983ff6b58 and project 10deb4e4b325488eab463dda518c5e86. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:27:35.428125 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8acf8ed5-a2a8-461f-b680-44a6d883911e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:27:35.430953 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8acf8ed5-a2a8-461f-b680-44a6d883911e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:27:35.482486 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8acf8ed5-a2a8-461f-b680-44a6d883911e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.345116 Oct 29 03:27:35.483384 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2890/6005] 10.222.0.46 () {62 vars in 1188 bytes} [Sat Oct 29 03:27:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 347 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 03:27:35.495324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-99f0666d-2d33-49e2-9b3f-a3fe3043a053 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:35.495947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-99f0666d-2d33-49e2-9b3f-a3fe3043a053 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:35.573482 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-99f0666d-2d33-49e2-9b3f-a3fe3043a053 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:35.581486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-99f0666d-2d33-49e2-9b3f-a3fe3043a053 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:35.584095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-99f0666d-2d33-49e2-9b3f-a3fe3043a053 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:35.585474 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-99f0666d-2d33-49e2-9b3f-a3fe3043a053 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1277 microversion: 2.57 time: 0.094823 Oct 29 03:27:35.586581 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3116/6006] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:35 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1277 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:27:36.102264 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4c745ef0-2650-4aa9-9c9d-d838f7a0a121 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:36.103607 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4c745ef0-2650-4aa9-9c9d-d838f7a0a121 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:36.116350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c745ef0-2650-4aa9-9c9d-d838f7a0a121 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:36.117746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c745ef0-2650-4aa9-9c9d-d838f7a0a121 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:36.119428 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c745ef0-2650-4aa9-9c9d-d838f7a0a121 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:36.120560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c745ef0-2650-4aa9-9c9d-d838f7a0a121 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:36.121852 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c745ef0-2650-4aa9-9c9d-d838f7a0a121 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:36.122491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c745ef0-2650-4aa9-9c9d-d838f7a0a121 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:36.311758 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4c745ef0-2650-4aa9-9c9d-d838f7a0a121 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:36.321301 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4c745ef0-2650-4aa9-9c9d-d838f7a0a121 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26" status: 200 len: 1691 microversion: 2.1 time: 0.226162 Oct 29 03:27:36.337163 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2891/6007] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:36 2022] GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 => generated 1691 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:36.615605 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a2615c99-26f7-45cc-b400-a384aaaea50f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:36.625794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a2615c99-26f7-45cc-b400-a384aaaea50f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:36.639379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2615c99-26f7-45cc-b400-a384aaaea50f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:36.639915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2615c99-26f7-45cc-b400-a384aaaea50f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:36.640646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2615c99-26f7-45cc-b400-a384aaaea50f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:36.641348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2615c99-26f7-45cc-b400-a384aaaea50f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:36.641959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2615c99-26f7-45cc-b400-a384aaaea50f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:36.642537 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2615c99-26f7-45cc-b400-a384aaaea50f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:36.726175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a2615c99-26f7-45cc-b400-a384aaaea50f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:36.735208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a2615c99-26f7-45cc-b400-a384aaaea50f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:36.736693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a2615c99-26f7-45cc-b400-a384aaaea50f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:36.737874 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a2615c99-26f7-45cc-b400-a384aaaea50f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1329 microversion: 2.57 time: 0.128357 Oct 29 03:27:36.738820 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3117/6008] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:36 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1329 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:27:37.346826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dc2b0fa8-dcd4-4589-8b46-e981264f0597 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:37.348020 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dc2b0fa8-dcd4-4589-8b46-e981264f0597 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:37.356227 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc2b0fa8-dcd4-4589-8b46-e981264f0597 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:37.357452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc2b0fa8-dcd4-4589-8b46-e981264f0597 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:37.357452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc2b0fa8-dcd4-4589-8b46-e981264f0597 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:37.358010 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc2b0fa8-dcd4-4589-8b46-e981264f0597 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:37.358461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc2b0fa8-dcd4-4589-8b46-e981264f0597 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:37.358886 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc2b0fa8-dcd4-4589-8b46-e981264f0597 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:37.505805 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dc2b0fa8-dcd4-4589-8b46-e981264f0597 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:37.514685 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dc2b0fa8-dcd4-4589-8b46-e981264f0597 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26" status: 200 len: 1691 microversion: 2.1 time: 0.171131 Oct 29 03:27:37.515566 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2892/6009] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:37 2022] GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:27:37.767180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-69f0f71f-e966-4aed-8484-1f5f4cd0d563 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:37.768325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-69f0f71f-e966-4aed-8484-1f5f4cd0d563 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:37.776711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69f0f71f-e966-4aed-8484-1f5f4cd0d563 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:37.777227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69f0f71f-e966-4aed-8484-1f5f4cd0d563 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:37.777647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69f0f71f-e966-4aed-8484-1f5f4cd0d563 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:37.778356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69f0f71f-e966-4aed-8484-1f5f4cd0d563 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:37.778930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69f0f71f-e966-4aed-8484-1f5f4cd0d563 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:37.779488 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69f0f71f-e966-4aed-8484-1f5f4cd0d563 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:37.853312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-69f0f71f-e966-4aed-8484-1f5f4cd0d563 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:37.865165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-69f0f71f-e966-4aed-8484-1f5f4cd0d563 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:37.866829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-69f0f71f-e966-4aed-8484-1f5f4cd0d563 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:37.868001 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-69f0f71f-e966-4aed-8484-1f5f4cd0d563 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1335 microversion: 2.57 time: 0.106466 Oct 29 03:27:37.868635 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3118/6010] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:37 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1335 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:38.425927 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5f5dcad8-afc4-4594-b5b1-042f196c8447 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Action: 'create', calling method: .version_select at 0x7ff05388b5e0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1440823378", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9mxD1XLTAHFb6xdgCyL0cGgEYyYHnDi39olZiKyLhsAYjK6ooA2J3rWLG+vhNEsa007IWaWW07Enz8IFUsMwZx3rA+/0V9ggvUKR++lJ+LXED7rxqQfPH2fRIvJBFFYQ=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:38.436410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:38.443463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-5f5dcad8-afc4-4594-b5b1-042f196c8447 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Getting quotas for project 486d1a0dedc047c4bbc2a7c59a1aa457. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:27:38.450932 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-5f5dcad8-afc4-4594-b5b1-042f196c8447 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Getting quotas for user 590d17fe6d43469f853b2465cde0a54a and project 486d1a0dedc047c4bbc2a7c59a1aa457. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:27:38.477702 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5f5dcad8-afc4-4594-b5b1-042f196c8447 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.224258 Oct 29 03:27:38.478318 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2893/6011] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:27:38 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:27:38.538805 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-589434bf-944c-42cc-94b7-1076d30d96b9 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:38.539428 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-589434bf-944c-42cc-94b7-1076d30d96b9 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:38.546022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-589434bf-944c-42cc-94b7-1076d30d96b9 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:38.546545 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-589434bf-944c-42cc-94b7-1076d30d96b9 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:38.546982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-589434bf-944c-42cc-94b7-1076d30d96b9 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:38.547888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-589434bf-944c-42cc-94b7-1076d30d96b9 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:38.548345 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-589434bf-944c-42cc-94b7-1076d30d96b9 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:38.548807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-589434bf-944c-42cc-94b7-1076d30d96b9 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:38.753412 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-589434bf-944c-42cc-94b7-1076d30d96b9 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:38.761082 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-589434bf-944c-42cc-94b7-1076d30d96b9 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26" status: 200 len: 1691 microversion: 2.1 time: 0.226278 Oct 29 03:27:38.766459 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3119/6012] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:38 2022] GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 => generated 1691 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:27:38.895349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d16bfa51-422a-4d42-87ca-f5d6a58932be tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:38.895991 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d16bfa51-422a-4d42-87ca-f5d6a58932be tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:38.906773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d16bfa51-422a-4d42-87ca-f5d6a58932be tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:38.907272 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d16bfa51-422a-4d42-87ca-f5d6a58932be tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:38.907717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d16bfa51-422a-4d42-87ca-f5d6a58932be tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:38.908457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d16bfa51-422a-4d42-87ca-f5d6a58932be tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:38.908912 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d16bfa51-422a-4d42-87ca-f5d6a58932be tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:38.909340 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d16bfa51-422a-4d42-87ca-f5d6a58932be tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:38.913958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:38.990782 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d16bfa51-422a-4d42-87ca-f5d6a58932be tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:38.999383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d16bfa51-422a-4d42-87ca-f5d6a58932be tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:39.000960 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d16bfa51-422a-4d42-87ca-f5d6a58932be tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:39.002193 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d16bfa51-422a-4d42-87ca-f5d6a58932be tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1335 microversion: 2.57 time: 0.111261 Oct 29 03:27:39.002842 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2894/6013] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:38 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1335 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:39.792103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0f60dbd4-fbfa-43ad-a6db-f44b86edea61 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:39.792928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0f60dbd4-fbfa-43ad-a6db-f44b86edea61 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:39.802836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f60dbd4-fbfa-43ad-a6db-f44b86edea61 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:39.803275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f60dbd4-fbfa-43ad-a6db-f44b86edea61 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:39.803882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f60dbd4-fbfa-43ad-a6db-f44b86edea61 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:39.804637 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f60dbd4-fbfa-43ad-a6db-f44b86edea61 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:39.805148 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f60dbd4-fbfa-43ad-a6db-f44b86edea61 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:39.805608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f60dbd4-fbfa-43ad-a6db-f44b86edea61 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:40.030924 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5ef832bb-d136-4118-84d1-a8fd5d48db95 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:40.031542 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5ef832bb-d136-4118-84d1-a8fd5d48db95 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:40.040164 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0f60dbd4-fbfa-43ad-a6db-f44b86edea61 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:40.040742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ef832bb-d136-4118-84d1-a8fd5d48db95 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:40.041235 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ef832bb-d136-4118-84d1-a8fd5d48db95 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:40.041677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ef832bb-d136-4118-84d1-a8fd5d48db95 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:40.042386 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ef832bb-d136-4118-84d1-a8fd5d48db95 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:40.042840 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ef832bb-d136-4118-84d1-a8fd5d48db95 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:40.043403 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ef832bb-d136-4118-84d1-a8fd5d48db95 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:40.053488 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0f60dbd4-fbfa-43ad-a6db-f44b86edea61 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26" status: 200 len: 1697 microversion: 2.1 time: 0.265234 Oct 29 03:27:40.055569 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3120/6014] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:39 2022] GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 => generated 1697 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:40.118730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5ef832bb-d136-4118-84d1-a8fd5d48db95 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:40.127658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5ef832bb-d136-4118-84d1-a8fd5d48db95 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:40.129141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5ef832bb-d136-4118-84d1-a8fd5d48db95 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:40.130328 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5ef832bb-d136-4118-84d1-a8fd5d48db95 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1356 microversion: 2.57 time: 0.104788 Oct 29 03:27:40.130951 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2895/6015] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:40 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1356 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:40.158823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c5b8b474-ed28-4608-b44b-39794ebb6d0c tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:40.162074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c5b8b474-ed28-4608-b44b-39794ebb6d0c tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:40.168924 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5b8b474-ed28-4608-b44b-39794ebb6d0c tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:40.169752 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5b8b474-ed28-4608-b44b-39794ebb6d0c tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:40.170284 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5b8b474-ed28-4608-b44b-39794ebb6d0c tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:40.171091 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5b8b474-ed28-4608-b44b-39794ebb6d0c tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:40.171612 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5b8b474-ed28-4608-b44b-39794ebb6d0c tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:40.172105 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5b8b474-ed28-4608-b44b-39794ebb6d0c tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:40.256705 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-c5b8b474-ed28-4608-b44b-39794ebb6d0c tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:27:40.257290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-c5b8b474-ed28-4608-b44b-39794ebb6d0c tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:27:40.257874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-c5b8b474-ed28-4608-b44b-39794ebb6d0c tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:27:40.258386 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-c5b8b474-ed28-4608-b44b-39794ebb6d0c tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:27:40.258900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-c5b8b474-ed28-4608-b44b-39794ebb6d0c tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:27:40.326657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c5b8b474-ed28-4608-b44b-39794ebb6d0c tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:40.333501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5b8b474-ed28-4608-b44b-39794ebb6d0c tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:40.334249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5b8b474-ed28-4608-b44b-39794ebb6d0c tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:40.334697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5b8b474-ed28-4608-b44b-39794ebb6d0c tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:40.335422 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5b8b474-ed28-4608-b44b-39794ebb6d0c tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:40.335906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5b8b474-ed28-4608-b44b-39794ebb6d0c tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:40.336315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c5b8b474-ed28-4608-b44b-39794ebb6d0c tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:40.371940 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c5b8b474-ed28-4608-b44b-39794ebb6d0c tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "POST /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7/action" status: 202 len: 1137 microversion: 2.57 time: 0.217365 Oct 29 03:27:40.373010 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3121/6016] 10.222.0.46 () {62 vars in 1320 bytes} [Sat Oct 29 03:27:40 2022] POST /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7/action => generated 1137 bytes in 219 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 29 03:27:40.394785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ff0bd679-db84-4870-ad17-426658b02252 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:40.395634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ff0bd679-db84-4870-ad17-426658b02252 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:40.403907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff0bd679-db84-4870-ad17-426658b02252 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:40.404665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff0bd679-db84-4870-ad17-426658b02252 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:40.405290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff0bd679-db84-4870-ad17-426658b02252 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:40.407680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff0bd679-db84-4870-ad17-426658b02252 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:40.408184 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff0bd679-db84-4870-ad17-426658b02252 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:40.408856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff0bd679-db84-4870-ad17-426658b02252 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:40.484987 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ff0bd679-db84-4870-ad17-426658b02252 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:40.494808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ff0bd679-db84-4870-ad17-426658b02252 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:40.504778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ff0bd679-db84-4870-ad17-426658b02252 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:40.510523 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ff0bd679-db84-4870-ad17-426658b02252 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1365 microversion: 2.57 time: 0.120326 Oct 29 03:27:40.511145 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2896/6017] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:40 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1365 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:41.088444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f3111c9e-2c33-45a8-900f-f875e13e21a7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:41.089697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f3111c9e-2c33-45a8-900f-f875e13e21a7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:41.102482 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3111c9e-2c33-45a8-900f-f875e13e21a7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:41.103289 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3111c9e-2c33-45a8-900f-f875e13e21a7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:41.103928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3111c9e-2c33-45a8-900f-f875e13e21a7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:41.104960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3111c9e-2c33-45a8-900f-f875e13e21a7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:41.105649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3111c9e-2c33-45a8-900f-f875e13e21a7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:41.106260 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3111c9e-2c33-45a8-900f-f875e13e21a7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:41.371342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f3111c9e-2c33-45a8-900f-f875e13e21a7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:41.380297 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f3111c9e-2c33-45a8-900f-f875e13e21a7 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26" status: 200 len: 1697 microversion: 2.1 time: 0.297668 Oct 29 03:27:41.381051 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3122/6018] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:41 2022] GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 => generated 1697 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:41.538373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8a17d300-2bd9-4e54-b95a-40a7962c2b33 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:41.539085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8a17d300-2bd9-4e54-b95a-40a7962c2b33 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:41.546903 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a17d300-2bd9-4e54-b95a-40a7962c2b33 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:41.547738 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a17d300-2bd9-4e54-b95a-40a7962c2b33 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:41.548358 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a17d300-2bd9-4e54-b95a-40a7962c2b33 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:41.549300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a17d300-2bd9-4e54-b95a-40a7962c2b33 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:41.549910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a17d300-2bd9-4e54-b95a-40a7962c2b33 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:41.550500 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a17d300-2bd9-4e54-b95a-40a7962c2b33 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:41.619679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8a17d300-2bd9-4e54-b95a-40a7962c2b33 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:41.630636 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8a17d300-2bd9-4e54-b95a-40a7962c2b33 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:41.633551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8a17d300-2bd9-4e54-b95a-40a7962c2b33 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:41.634919 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8a17d300-2bd9-4e54-b95a-40a7962c2b33 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1365 microversion: 2.57 time: 0.100880 Oct 29 03:27:41.652059 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2897/6019] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:41 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1365 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:27:41.892876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-995e8783-9d02-4769-a5a0-9a2adcc60e26 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-829082612", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "945ce153-6775-49f3-9333-b05acb98af07"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:41.969568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-995e8783-9d02-4769-a5a0-9a2adcc60e26 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] validate_networks() for [('945ce153-6775-49f3-9333-b05acb98af07', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:27:42.406878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bf91e2dd-c81a-4ab3-93ee-7efccdf03c9c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:42.408298 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bf91e2dd-c81a-4ab3-93ee-7efccdf03c9c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:42.416256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf91e2dd-c81a-4ab3-93ee-7efccdf03c9c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:42.418660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf91e2dd-c81a-4ab3-93ee-7efccdf03c9c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:42.419338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf91e2dd-c81a-4ab3-93ee-7efccdf03c9c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:42.420314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf91e2dd-c81a-4ab3-93ee-7efccdf03c9c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:42.421035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf91e2dd-c81a-4ab3-93ee-7efccdf03c9c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:42.421722 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf91e2dd-c81a-4ab3-93ee-7efccdf03c9c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:42.607735 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-995e8783-9d02-4769-a5a0-9a2adcc60e26 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:27:42.608242 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-995e8783-9d02-4769-a5a0-9a2adcc60e26 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:27:42.608791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-995e8783-9d02-4769-a5a0-9a2adcc60e26 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:27:42.610026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-995e8783-9d02-4769-a5a0-9a2adcc60e26 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:27:42.611199 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-995e8783-9d02-4769-a5a0-9a2adcc60e26 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:27:42.622619 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-995e8783-9d02-4769-a5a0-9a2adcc60e26 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:42.623611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-995e8783-9d02-4769-a5a0-9a2adcc60e26 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:42.624660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-995e8783-9d02-4769-a5a0-9a2adcc60e26 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:42.625679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-995e8783-9d02-4769-a5a0-9a2adcc60e26 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:42.626362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-995e8783-9d02-4769-a5a0-9a2adcc60e26 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:42.627033 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-995e8783-9d02-4769-a5a0-9a2adcc60e26 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:42.627432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bf91e2dd-c81a-4ab3-93ee-7efccdf03c9c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:42.639304 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bf91e2dd-c81a-4ab3-93ee-7efccdf03c9c tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26" status: 200 len: 1682 microversion: 2.1 time: 0.238641 Oct 29 03:27:42.664125 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2898/6020] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:42 2022] GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 => generated 1682 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:42.672957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-995e8783-9d02-4769-a5a0-9a2adcc60e26 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Getting quotas for project 6e202cdaad65452fa00963abd83004b9. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:27:42.675564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-57953a3c-43da-45cb-864e-619a146a18d2 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:42.677101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-57953a3c-43da-45cb-864e-619a146a18d2 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:42.685582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57953a3c-43da-45cb-864e-619a146a18d2 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:42.686385 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57953a3c-43da-45cb-864e-619a146a18d2 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:42.687010 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57953a3c-43da-45cb-864e-619a146a18d2 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:42.687943 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57953a3c-43da-45cb-864e-619a146a18d2 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:42.689941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-995e8783-9d02-4769-a5a0-9a2adcc60e26 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Getting quotas for user 9c633d65d3754c0bb47a7cb8754a97cd and project 6e202cdaad65452fa00963abd83004b9. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:27:42.691760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57953a3c-43da-45cb-864e-619a146a18d2 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:42.692410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57953a3c-43da-45cb-864e-619a146a18d2 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:42.777962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-995e8783-9d02-4769-a5a0-9a2adcc60e26 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:27:42.781102 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-995e8783-9d02-4769-a5a0-9a2adcc60e26 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: e504409e-fee0-4d16-abf8-c7190e74bb2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:27:42.827235 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-57953a3c-43da-45cb-864e-619a146a18d2 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:42.843001 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-57953a3c-43da-45cb-864e-619a146a18d2 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:42.844489 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-57953a3c-43da-45cb-864e-619a146a18d2 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:42.850710 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-57953a3c-43da-45cb-864e-619a146a18d2 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1365 microversion: 2.57 time: 0.184243 Oct 29 03:27:42.851663 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2899/6021] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:42 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:42.877080 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-995e8783-9d02-4769-a5a0-9a2adcc60e26 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.988792 Oct 29 03:27:42.879487 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3123/6022] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:27:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:27:42.892182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-03f75724-bbda-4fa8-af38-e3cf0a6651cb tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:42.892840 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-03f75724-bbda-4fa8-af38-e3cf0a6651cb tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: e504409e-fee0-4d16-abf8-c7190e74bb2e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:42.978442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-03f75724-bbda-4fa8-af38-e3cf0a6651cb tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c633d65d3754c0bb47a7cb8754a97cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e202cdaad65452fa00963abd83004b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:42.988719 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-03f75724-bbda-4fa8-af38-e3cf0a6651cb tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "GET /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e" status: 200 len: 1218 microversion: 2.1 time: 0.100201 Oct 29 03:27:42.989620 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2900/6023] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:42 2022] GET /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:43.890789 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-042f9b5c-506a-4a00-a3fc-f0b2dfb9d3ca tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:43.892090 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-042f9b5c-506a-4a00-a3fc-f0b2dfb9d3ca tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:43.903697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-042f9b5c-506a-4a00-a3fc-f0b2dfb9d3ca tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:43.904914 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-042f9b5c-506a-4a00-a3fc-f0b2dfb9d3ca tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:43.905905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-042f9b5c-506a-4a00-a3fc-f0b2dfb9d3ca tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:43.907187 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-042f9b5c-506a-4a00-a3fc-f0b2dfb9d3ca tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:43.907858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-042f9b5c-506a-4a00-a3fc-f0b2dfb9d3ca tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:43.908469 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-042f9b5c-506a-4a00-a3fc-f0b2dfb9d3ca tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:44.013002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-64f2cf67-be47-4535-8bac-faf723fc4c23 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:44.013002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-64f2cf67-be47-4535-8bac-faf723fc4c23 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: e504409e-fee0-4d16-abf8-c7190e74bb2e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:44.028196 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64f2cf67-be47-4535-8bac-faf723fc4c23 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:44.028854 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64f2cf67-be47-4535-8bac-faf723fc4c23 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:44.029543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64f2cf67-be47-4535-8bac-faf723fc4c23 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:44.030499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64f2cf67-be47-4535-8bac-faf723fc4c23 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:44.031152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64f2cf67-be47-4535-8bac-faf723fc4c23 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:44.031782 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64f2cf67-be47-4535-8bac-faf723fc4c23 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:44.038139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-042f9b5c-506a-4a00-a3fc-f0b2dfb9d3ca tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:44.049955 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-042f9b5c-506a-4a00-a3fc-f0b2dfb9d3ca tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:44.053749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-042f9b5c-506a-4a00-a3fc-f0b2dfb9d3ca tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:44.056628 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-042f9b5c-506a-4a00-a3fc-f0b2dfb9d3ca tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1365 microversion: 2.57 time: 0.180619 Oct 29 03:27:44.069140 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3124/6024] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:43 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:44.144555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-64f2cf67-be47-4535-8bac-faf723fc4c23 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c633d65d3754c0bb47a7cb8754a97cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e202cdaad65452fa00963abd83004b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:44.155466 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-64f2cf67-be47-4535-8bac-faf723fc4c23 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "GET /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e" status: 200 len: 1270 microversion: 2.1 time: 0.147211 Oct 29 03:27:44.172602 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2901/6025] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:44 2022] GET /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:27:44.567970 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-5265ce28-358d-4035-baa1-d144d985827c req-a8316509-6d66-428f-b8d9-46d59da563a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "892f3002-c947-42fb-84c6-c1e401492d26", "name": "network-vif-plugged", "status": "completed", "tag": "bc07623e-95e8-4f84-a6ac-5c3505851ea7"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:44.593934 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5265ce28-358d-4035-baa1-d144d985827c req-a8316509-6d66-428f-b8d9-46d59da563a8 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:44.595521 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5265ce28-358d-4035-baa1-d144d985827c req-a8316509-6d66-428f-b8d9-46d59da563a8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:44.596134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5265ce28-358d-4035-baa1-d144d985827c req-a8316509-6d66-428f-b8d9-46d59da563a8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:44.617038 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-5265ce28-358d-4035-baa1-d144d985827c req-a8316509-6d66-428f-b8d9-46d59da563a8 service nova] Creating event network-vif-plugged:bc07623e-95e8-4f84-a6ac-5c3505851ea7 for instance 892f3002-c947-42fb-84c6-c1e401492d26 on n-h2-862967-2 Oct 29 03:27:44.626796 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-5265ce28-358d-4035-baa1-d144d985827c req-a8316509-6d66-428f-b8d9-46d59da563a8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060329 Oct 29 03:27:44.627615 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3125/6026] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:27:45.100187 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5b622842-bc79-47f1-9ab7-06e0f3ed6146 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:45.102046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5b622842-bc79-47f1-9ab7-06e0f3ed6146 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:45.115777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5b622842-bc79-47f1-9ab7-06e0f3ed6146 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:45.116281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5b622842-bc79-47f1-9ab7-06e0f3ed6146 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:45.116752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5b622842-bc79-47f1-9ab7-06e0f3ed6146 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:45.117462 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5b622842-bc79-47f1-9ab7-06e0f3ed6146 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:45.117915 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5b622842-bc79-47f1-9ab7-06e0f3ed6146 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:45.118342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5b622842-bc79-47f1-9ab7-06e0f3ed6146 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:45.188873 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b1a4bab5-d7de-40ba-9e6e-5b71dea51f86 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:45.190520 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b1a4bab5-d7de-40ba-9e6e-5b71dea51f86 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: e504409e-fee0-4d16-abf8-c7190e74bb2e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:45.199636 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b1a4bab5-d7de-40ba-9e6e-5b71dea51f86 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:45.201560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b1a4bab5-d7de-40ba-9e6e-5b71dea51f86 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:45.202221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b1a4bab5-d7de-40ba-9e6e-5b71dea51f86 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:45.203640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b1a4bab5-d7de-40ba-9e6e-5b71dea51f86 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:45.204299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b1a4bab5-d7de-40ba-9e6e-5b71dea51f86 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:45.205489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b1a4bab5-d7de-40ba-9e6e-5b71dea51f86 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:45.258524 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5b622842-bc79-47f1-9ab7-06e0f3ed6146 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:45.269287 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5b622842-bc79-47f1-9ab7-06e0f3ed6146 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:45.276088 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5b622842-bc79-47f1-9ab7-06e0f3ed6146 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:45.277467 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5b622842-bc79-47f1-9ab7-06e0f3ed6146 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1365 microversion: 2.57 time: 0.185404 Oct 29 03:27:45.278095 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2902/6027] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:45 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:45.327966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b1a4bab5-d7de-40ba-9e6e-5b71dea51f86 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c633d65d3754c0bb47a7cb8754a97cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e202cdaad65452fa00963abd83004b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:45.346637 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b1a4bab5-d7de-40ba-9e6e-5b71dea51f86 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "GET /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e" status: 200 len: 1276 microversion: 2.1 time: 0.170304 Oct 29 03:27:45.352933 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3126/6028] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:45 2022] GET /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e => generated 1276 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:45.446627 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a957adf0-47e7-4472-b4fe-de3da7ecd984 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-725419749-access_point-1258598262", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "3cb232d8-bee8-49d8-b9cc-da8942d4e98a"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1440823378", "security_groups": [{"name": "tempest-secgroup_access--748731455"}, {"name": "tempest-secgroup_general--939894587"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:45.464648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:45.693554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-a957adf0-47e7-4472-b4fe-de3da7ecd984 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] validate_networks() for [('3cb232d8-bee8-49d8-b9cc-da8942d4e98a', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:27:46.189101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-a957adf0-47e7-4472-b4fe-de3da7ecd984 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:27:46.189636 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-a957adf0-47e7-4472-b4fe-de3da7ecd984 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:27:46.189988 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-a957adf0-47e7-4472-b4fe-de3da7ecd984 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:27:46.190500 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-a957adf0-47e7-4472-b4fe-de3da7ecd984 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:27:46.190922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-a957adf0-47e7-4472-b4fe-de3da7ecd984 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:27:46.216515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a957adf0-47e7-4472-b4fe-de3da7ecd984 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:46.217832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a957adf0-47e7-4472-b4fe-de3da7ecd984 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:46.218582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a957adf0-47e7-4472-b4fe-de3da7ecd984 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:46.221196 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a957adf0-47e7-4472-b4fe-de3da7ecd984 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:46.222361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a957adf0-47e7-4472-b4fe-de3da7ecd984 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:46.222972 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a957adf0-47e7-4472-b4fe-de3da7ecd984 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:46.246559 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-a957adf0-47e7-4472-b4fe-de3da7ecd984 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Getting quotas for project 486d1a0dedc047c4bbc2a7c59a1aa457. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:27:46.252933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-a957adf0-47e7-4472-b4fe-de3da7ecd984 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Getting quotas for user 590d17fe6d43469f853b2465cde0a54a and project 486d1a0dedc047c4bbc2a7c59a1aa457. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:27:46.267894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a957adf0-47e7-4472-b4fe-de3da7ecd984 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:27:46.270374 n-d-862967-2 devstack@n-api.service[127125]: WARNING nova.utils [None req-a957adf0-47e7-4472-b4fe-de3da7ecd984 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-725419749-access_point-1258598262 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-725419749-acc Oct 29 03:27:46.271565 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a957adf0-47e7-4472-b4fe-de3da7ecd984 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:27:46.306043 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-869d4a3a-bab7-4a17-b123-ffb075128a3f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:46.307612 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-869d4a3a-bab7-4a17-b123-ffb075128a3f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:46.319970 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-869d4a3a-bab7-4a17-b123-ffb075128a3f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:46.321299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-869d4a3a-bab7-4a17-b123-ffb075128a3f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:46.321734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-869d4a3a-bab7-4a17-b123-ffb075128a3f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:46.323221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-869d4a3a-bab7-4a17-b123-ffb075128a3f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:46.324030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-869d4a3a-bab7-4a17-b123-ffb075128a3f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:46.324758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-869d4a3a-bab7-4a17-b123-ffb075128a3f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:46.342046 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a957adf0-47e7-4472-b4fe-de3da7ecd984 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 0.899408 Oct 29 03:27:46.342729 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2903/6029] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:27:45 2022] POST /compute/v2.1/servers => generated 456 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:27:46.355128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b232a3e4-3695-42de-adcc-d98825e8baf1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:46.355753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b232a3e4-3695-42de-adcc-d98825e8baf1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:46.455670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b232a3e4-3695-42de-adcc-d98825e8baf1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590d17fe6d43469f853b2465cde0a54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d1a0dedc047c4bbc2a7c59a1aa457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:46.468855 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b232a3e4-3695-42de-adcc-d98825e8baf1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc" status: 200 len: 1294 microversion: 2.1 time: 0.118096 Oct 29 03:27:46.470337 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2904/6030] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:46 2022] GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc => generated 1294 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:27:46.487389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4d10fb8d-fbf1-40f6-af40-da3e61a50809 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:46.488018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4d10fb8d-fbf1-40f6-af40-da3e61a50809 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: e504409e-fee0-4d16-abf8-c7190e74bb2e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:46.496844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-869d4a3a-bab7-4a17-b123-ffb075128a3f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:46.506101 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-869d4a3a-bab7-4a17-b123-ffb075128a3f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:46.507586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-869d4a3a-bab7-4a17-b123-ffb075128a3f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:46.507998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d10fb8d-fbf1-40f6-af40-da3e61a50809 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:46.508621 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d10fb8d-fbf1-40f6-af40-da3e61a50809 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:46.508808 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-869d4a3a-bab7-4a17-b123-ffb075128a3f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1365 microversion: 2.57 time: 0.209467 Oct 29 03:27:46.516054 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3127/6031] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:46 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:27:46.522404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-e1826390-5f0c-46bf-b359-0fef86355d72 req-566e930f-9d31-434b-bc87-14c7c849ecba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e504409e-fee0-4d16-abf8-c7190e74bb2e", "tag": "be8f70dd-5c0e-4835-9e35-b1f65a98f08a"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:46.531139 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d10fb8d-fbf1-40f6-af40-da3e61a50809 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:46.532051 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d10fb8d-fbf1-40f6-af40-da3e61a50809 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:46.532575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d10fb8d-fbf1-40f6-af40-da3e61a50809 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:46.533001 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4d10fb8d-fbf1-40f6-af40-da3e61a50809 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:46.553059 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e1826390-5f0c-46bf-b359-0fef86355d72 req-566e930f-9d31-434b-bc87-14c7c849ecba service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:46.556681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e1826390-5f0c-46bf-b359-0fef86355d72 req-566e930f-9d31-434b-bc87-14c7c849ecba service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:46.557261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e1826390-5f0c-46bf-b359-0fef86355d72 req-566e930f-9d31-434b-bc87-14c7c849ecba service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:46.591179 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-e1826390-5f0c-46bf-b359-0fef86355d72 req-566e930f-9d31-434b-bc87-14c7c849ecba service nova] Creating event network-changed:be8f70dd-5c0e-4835-9e35-b1f65a98f08a for instance e504409e-fee0-4d16-abf8-c7190e74bb2e on n-h2-862967-2 Oct 29 03:27:46.603455 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-e1826390-5f0c-46bf-b359-0fef86355d72 req-566e930f-9d31-434b-bc87-14c7c849ecba service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085651 Oct 29 03:27:46.604459 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3128/6032] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:27:46.696625 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4d10fb8d-fbf1-40f6-af40-da3e61a50809 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c633d65d3754c0bb47a7cb8754a97cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e202cdaad65452fa00963abd83004b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:46.704800 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4d10fb8d-fbf1-40f6-af40-da3e61a50809 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "GET /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e" status: 200 len: 1318 microversion: 2.1 time: 0.232924 Oct 29 03:27:46.706020 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2905/6033] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:46 2022] GET /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:47.495452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-14d5cd76-5127-4980-858e-3bd50623ffe1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:47.496149 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-14d5cd76-5127-4980-858e-3bd50623ffe1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:47.503459 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14d5cd76-5127-4980-858e-3bd50623ffe1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:47.503940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14d5cd76-5127-4980-858e-3bd50623ffe1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:47.504413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14d5cd76-5127-4980-858e-3bd50623ffe1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:47.505162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14d5cd76-5127-4980-858e-3bd50623ffe1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:47.505615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14d5cd76-5127-4980-858e-3bd50623ffe1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:47.506043 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14d5cd76-5127-4980-858e-3bd50623ffe1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:47.541917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b552fcb7-80d2-4020-bbec-46e4619087ad tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:47.542532 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b552fcb7-80d2-4020-bbec-46e4619087ad tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:47.549853 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b552fcb7-80d2-4020-bbec-46e4619087ad tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:47.550682 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b552fcb7-80d2-4020-bbec-46e4619087ad tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:47.551084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b552fcb7-80d2-4020-bbec-46e4619087ad tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:47.551995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b552fcb7-80d2-4020-bbec-46e4619087ad tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:47.552438 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b552fcb7-80d2-4020-bbec-46e4619087ad tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:47.552910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b552fcb7-80d2-4020-bbec-46e4619087ad tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:47.576873 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-14d5cd76-5127-4980-858e-3bd50623ffe1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590d17fe6d43469f853b2465cde0a54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d1a0dedc047c4bbc2a7c59a1aa457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:47.579678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:47.587344 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-14d5cd76-5127-4980-858e-3bd50623ffe1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc" status: 200 len: 1346 microversion: 2.1 time: 0.097592 Oct 29 03:27:47.587950 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3129/6034] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:47 2022] GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc => generated 1346 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:47.623754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b552fcb7-80d2-4020-bbec-46e4619087ad tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:47.633557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b552fcb7-80d2-4020-bbec-46e4619087ad tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:47.635252 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b552fcb7-80d2-4020-bbec-46e4619087ad tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:47.636545 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b552fcb7-80d2-4020-bbec-46e4619087ad tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1365 microversion: 2.57 time: 0.099880 Oct 29 03:27:47.637292 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2906/6035] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:47 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1365 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:47.728404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-07183738-8231-48aa-89f2-f657b0cc2451 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:47.731114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-07183738-8231-48aa-89f2-f657b0cc2451 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: e504409e-fee0-4d16-abf8-c7190e74bb2e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:47.738333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07183738-8231-48aa-89f2-f657b0cc2451 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:47.738832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07183738-8231-48aa-89f2-f657b0cc2451 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:47.739270 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07183738-8231-48aa-89f2-f657b0cc2451 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:47.739983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07183738-8231-48aa-89f2-f657b0cc2451 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:47.740438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07183738-8231-48aa-89f2-f657b0cc2451 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:47.740891 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07183738-8231-48aa-89f2-f657b0cc2451 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:47.983194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-07183738-8231-48aa-89f2-f657b0cc2451 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c633d65d3754c0bb47a7cb8754a97cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e202cdaad65452fa00963abd83004b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:47.992394 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-07183738-8231-48aa-89f2-f657b0cc2451 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "GET /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e" status: 200 len: 1318 microversion: 2.1 time: 0.268929 Oct 29 03:27:47.993376 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3130/6036] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:47 2022] GET /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:48.611302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0151cc4f-99f9-4157-8191-40a0f301f110 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:48.611744 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0151cc4f-99f9-4157-8191-40a0f301f110 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:48.619697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0151cc4f-99f9-4157-8191-40a0f301f110 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:48.620621 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0151cc4f-99f9-4157-8191-40a0f301f110 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:48.621286 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0151cc4f-99f9-4157-8191-40a0f301f110 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:48.622022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0151cc4f-99f9-4157-8191-40a0f301f110 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:48.622762 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0151cc4f-99f9-4157-8191-40a0f301f110 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:48.623353 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0151cc4f-99f9-4157-8191-40a0f301f110 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:48.663598 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5fa55bc9-f4cb-4e05-95e7-450ba129554b tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:48.664139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5fa55bc9-f4cb-4e05-95e7-450ba129554b tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:48.672096 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fa55bc9-f4cb-4e05-95e7-450ba129554b tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:48.673021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fa55bc9-f4cb-4e05-95e7-450ba129554b tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:48.673481 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fa55bc9-f4cb-4e05-95e7-450ba129554b tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:48.674210 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fa55bc9-f4cb-4e05-95e7-450ba129554b tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:48.674670 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fa55bc9-f4cb-4e05-95e7-450ba129554b tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:48.675101 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fa55bc9-f4cb-4e05-95e7-450ba129554b tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:48.745838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5fa55bc9-f4cb-4e05-95e7-450ba129554b tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:48.756428 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5fa55bc9-f4cb-4e05-95e7-450ba129554b tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:48.758484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5fa55bc9-f4cb-4e05-95e7-450ba129554b tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:48.759867 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5fa55bc9-f4cb-4e05-95e7-450ba129554b tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1365 microversion: 2.57 time: 0.100821 Oct 29 03:27:48.761159 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3131/6037] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:48 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1365 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:27:48.921816 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0151cc4f-99f9-4157-8191-40a0f301f110 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590d17fe6d43469f853b2465cde0a54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d1a0dedc047c4bbc2a7c59a1aa457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:48.929959 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0151cc4f-99f9-4157-8191-40a0f301f110 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc" status: 200 len: 1470 microversion: 2.1 time: 0.322988 Oct 29 03:27:48.930797 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2907/6038] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:48 2022] GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc => generated 1470 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:49.018851 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3cea4f9c-bf4d-4456-a432-25ed93a43244 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:49.019487 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3cea4f9c-bf4d-4456-a432-25ed93a43244 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: e504409e-fee0-4d16-abf8-c7190e74bb2e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:49.025890 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3cea4f9c-bf4d-4456-a432-25ed93a43244 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:49.026373 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3cea4f9c-bf4d-4456-a432-25ed93a43244 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:49.026813 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3cea4f9c-bf4d-4456-a432-25ed93a43244 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:49.027510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3cea4f9c-bf4d-4456-a432-25ed93a43244 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:49.027970 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3cea4f9c-bf4d-4456-a432-25ed93a43244 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:49.028593 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3cea4f9c-bf4d-4456-a432-25ed93a43244 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:49.170585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3cea4f9c-bf4d-4456-a432-25ed93a43244 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c633d65d3754c0bb47a7cb8754a97cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e202cdaad65452fa00963abd83004b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:49.179882 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3cea4f9c-bf4d-4456-a432-25ed93a43244 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "GET /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e" status: 200 len: 1318 microversion: 2.1 time: 0.165152 Oct 29 03:27:49.180578 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3132/6039] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:49 2022] GET /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:49.413580 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-461d4d6d-1db8-4f68-ac47-3ace419c2785 req-53c50003-d0f5-4379-b801-ac03057cc3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc", "tag": "c72ceda4-4c04-4b08-9837-18c24e623eff"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:49.424956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-461d4d6d-1db8-4f68-ac47-3ace419c2785 req-53c50003-d0f5-4379-b801-ac03057cc3d9 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:49.426012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-461d4d6d-1db8-4f68-ac47-3ace419c2785 req-53c50003-d0f5-4379-b801-ac03057cc3d9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:49.426012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-461d4d6d-1db8-4f68-ac47-3ace419c2785 req-53c50003-d0f5-4379-b801-ac03057cc3d9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:49.437488 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-461d4d6d-1db8-4f68-ac47-3ace419c2785 req-53c50003-d0f5-4379-b801-ac03057cc3d9 service nova] Creating event network-changed:c72ceda4-4c04-4b08-9837-18c24e623eff for instance 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc on n-h1-862967-2 Oct 29 03:27:49.442921 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-461d4d6d-1db8-4f68-ac47-3ace419c2785 req-53c50003-d0f5-4379-b801-ac03057cc3d9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033588 Oct 29 03:27:49.443630 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2908/6040] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:27:49.787561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7006ed13-5155-4cf5-818c-8eb6950fdb3f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:49.788413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7006ed13-5155-4cf5-818c-8eb6950fdb3f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:49.796277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7006ed13-5155-4cf5-818c-8eb6950fdb3f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:49.796903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7006ed13-5155-4cf5-818c-8eb6950fdb3f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:49.797377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7006ed13-5155-4cf5-818c-8eb6950fdb3f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:49.798143 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7006ed13-5155-4cf5-818c-8eb6950fdb3f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:49.799230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7006ed13-5155-4cf5-818c-8eb6950fdb3f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:49.799904 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7006ed13-5155-4cf5-818c-8eb6950fdb3f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:49.884901 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7006ed13-5155-4cf5-818c-8eb6950fdb3f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:49.893826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7006ed13-5155-4cf5-818c-8eb6950fdb3f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:49.896019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7006ed13-5155-4cf5-818c-8eb6950fdb3f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:49.897366 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7006ed13-5155-4cf5-818c-8eb6950fdb3f tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1365 microversion: 2.57 time: 0.114363 Oct 29 03:27:49.898399 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3133/6041] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:49 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1365 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:49.954415 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f5900dfe-caf6-4fdf-b73a-ecc5904bfd9a tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:49.955159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f5900dfe-caf6-4fdf-b73a-ecc5904bfd9a tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:49.961684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5900dfe-caf6-4fdf-b73a-ecc5904bfd9a tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:49.962170 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5900dfe-caf6-4fdf-b73a-ecc5904bfd9a tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:49.962597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5900dfe-caf6-4fdf-b73a-ecc5904bfd9a tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:49.963324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5900dfe-caf6-4fdf-b73a-ecc5904bfd9a tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:49.963800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5900dfe-caf6-4fdf-b73a-ecc5904bfd9a tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:49.964218 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5900dfe-caf6-4fdf-b73a-ecc5904bfd9a tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:50.115529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f5900dfe-caf6-4fdf-b73a-ecc5904bfd9a tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590d17fe6d43469f853b2465cde0a54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d1a0dedc047c4bbc2a7c59a1aa457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:50.124514 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f5900dfe-caf6-4fdf-b73a-ecc5904bfd9a tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc" status: 200 len: 1470 microversion: 2.1 time: 0.174657 Oct 29 03:27:50.125135 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2909/6042] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:49 2022] GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc => generated 1470 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:50.204151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-27816260-c40a-4556-b3d3-1e30e3497276 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:50.204860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-27816260-c40a-4556-b3d3-1e30e3497276 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: e504409e-fee0-4d16-abf8-c7190e74bb2e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:50.211569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27816260-c40a-4556-b3d3-1e30e3497276 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:50.212061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27816260-c40a-4556-b3d3-1e30e3497276 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:50.212495 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27816260-c40a-4556-b3d3-1e30e3497276 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:50.213571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27816260-c40a-4556-b3d3-1e30e3497276 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:50.214335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27816260-c40a-4556-b3d3-1e30e3497276 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:50.214766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27816260-c40a-4556-b3d3-1e30e3497276 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:50.367509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-27816260-c40a-4556-b3d3-1e30e3497276 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c633d65d3754c0bb47a7cb8754a97cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e202cdaad65452fa00963abd83004b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:50.376793 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-27816260-c40a-4556-b3d3-1e30e3497276 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "GET /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e" status: 200 len: 1318 microversion: 2.1 time: 0.176721 Oct 29 03:27:50.377389 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3134/6043] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:50 2022] GET /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:50.924025 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cf707e4a-8b25-4b84-82a8-ce3210858aa1 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:50.924677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cf707e4a-8b25-4b84-82a8-ce3210858aa1 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:50.931175 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf707e4a-8b25-4b84-82a8-ce3210858aa1 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:50.931676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf707e4a-8b25-4b84-82a8-ce3210858aa1 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:50.932117 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf707e4a-8b25-4b84-82a8-ce3210858aa1 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:50.932876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf707e4a-8b25-4b84-82a8-ce3210858aa1 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:50.933362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf707e4a-8b25-4b84-82a8-ce3210858aa1 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:50.933794 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf707e4a-8b25-4b84-82a8-ce3210858aa1 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:51.026025 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cf707e4a-8b25-4b84-82a8-ce3210858aa1 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:51.035145 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cf707e4a-8b25-4b84-82a8-ce3210858aa1 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:51.036981 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cf707e4a-8b25-4b84-82a8-ce3210858aa1 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:51.038204 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cf707e4a-8b25-4b84-82a8-ce3210858aa1 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1365 microversion: 2.57 time: 0.118529 Oct 29 03:27:51.038819 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2910/6044] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:50 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1365 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:51.148989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5fdb4dd8-316c-4ca0-bf15-54437925cd27 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:51.149642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5fdb4dd8-316c-4ca0-bf15-54437925cd27 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:51.156995 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fdb4dd8-316c-4ca0-bf15-54437925cd27 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:51.157492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fdb4dd8-316c-4ca0-bf15-54437925cd27 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:51.157932 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fdb4dd8-316c-4ca0-bf15-54437925cd27 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:51.158647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fdb4dd8-316c-4ca0-bf15-54437925cd27 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:51.159107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fdb4dd8-316c-4ca0-bf15-54437925cd27 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:51.159536 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5fdb4dd8-316c-4ca0-bf15-54437925cd27 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:51.344038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5fdb4dd8-316c-4ca0-bf15-54437925cd27 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590d17fe6d43469f853b2465cde0a54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d1a0dedc047c4bbc2a7c59a1aa457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:51.352458 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5fdb4dd8-316c-4ca0-bf15-54437925cd27 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc" status: 200 len: 1470 microversion: 2.1 time: 0.208147 Oct 29 03:27:51.353092 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3135/6045] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:51 2022] GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc => generated 1470 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:51.400686 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8f4d5164-ad9e-470c-83e7-986de4a4d36b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:51.401429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8f4d5164-ad9e-470c-83e7-986de4a4d36b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: e504409e-fee0-4d16-abf8-c7190e74bb2e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:51.408360 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f4d5164-ad9e-470c-83e7-986de4a4d36b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:51.408981 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f4d5164-ad9e-470c-83e7-986de4a4d36b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:51.409475 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f4d5164-ad9e-470c-83e7-986de4a4d36b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:51.410200 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f4d5164-ad9e-470c-83e7-986de4a4d36b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:51.410652 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f4d5164-ad9e-470c-83e7-986de4a4d36b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:51.411075 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f4d5164-ad9e-470c-83e7-986de4a4d36b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:51.701237 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8f4d5164-ad9e-470c-83e7-986de4a4d36b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c633d65d3754c0bb47a7cb8754a97cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e202cdaad65452fa00963abd83004b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:51.709362 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8f4d5164-ad9e-470c-83e7-986de4a4d36b tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "GET /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e" status: 200 len: 1318 microversion: 2.1 time: 0.313733 Oct 29 03:27:51.709974 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2911/6046] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:51 2022] GET /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:52.064457 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8655f028-65cd-4d37-8b81-2a8edc2f7bb5 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:52.065154 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8655f028-65cd-4d37-8b81-2a8edc2f7bb5 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:52.071669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8655f028-65cd-4d37-8b81-2a8edc2f7bb5 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:52.072154 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8655f028-65cd-4d37-8b81-2a8edc2f7bb5 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:52.072688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8655f028-65cd-4d37-8b81-2a8edc2f7bb5 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:52.073388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8655f028-65cd-4d37-8b81-2a8edc2f7bb5 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:52.073839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8655f028-65cd-4d37-8b81-2a8edc2f7bb5 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:52.074268 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8655f028-65cd-4d37-8b81-2a8edc2f7bb5 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:52.143368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8655f028-65cd-4d37-8b81-2a8edc2f7bb5 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:52.152194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8655f028-65cd-4d37-8b81-2a8edc2f7bb5 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:52.153669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8655f028-65cd-4d37-8b81-2a8edc2f7bb5 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:52.154887 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8655f028-65cd-4d37-8b81-2a8edc2f7bb5 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1365 microversion: 2.57 time: 0.094561 Oct 29 03:27:52.155510 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3136/6047] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:52 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1365 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:52.326795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-8f79f79f-6adf-4675-bf1b-278fb05b2e85 req-a134015b-8dab-4960-a068-73f249633183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e504409e-fee0-4d16-abf8-c7190e74bb2e", "name": "network-vif-plugged", "status": "completed", "tag": "be8f70dd-5c0e-4835-9e35-b1f65a98f08a"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:52.337995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8f79f79f-6adf-4675-bf1b-278fb05b2e85 req-a134015b-8dab-4960-a068-73f249633183 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:52.338469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8f79f79f-6adf-4675-bf1b-278fb05b2e85 req-a134015b-8dab-4960-a068-73f249633183 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:52.338936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8f79f79f-6adf-4675-bf1b-278fb05b2e85 req-a134015b-8dab-4960-a068-73f249633183 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:52.350732 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-8f79f79f-6adf-4675-bf1b-278fb05b2e85 req-a134015b-8dab-4960-a068-73f249633183 service nova] Creating event network-vif-plugged:be8f70dd-5c0e-4835-9e35-b1f65a98f08a for instance e504409e-fee0-4d16-abf8-c7190e74bb2e on n-h2-862967-2 Oct 29 03:27:52.355679 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-8f79f79f-6adf-4675-bf1b-278fb05b2e85 req-a134015b-8dab-4960-a068-73f249633183 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032679 Oct 29 03:27:52.356276 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2912/6048] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:27:52.376283 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5a6c85e5-875c-45b3-b6e1-cb3e714813d3 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:52.376952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5a6c85e5-875c-45b3-b6e1-cb3e714813d3 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:52.383925 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a6c85e5-875c-45b3-b6e1-cb3e714813d3 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:52.384481 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a6c85e5-875c-45b3-b6e1-cb3e714813d3 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:52.385187 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a6c85e5-875c-45b3-b6e1-cb3e714813d3 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:52.386891 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a6c85e5-875c-45b3-b6e1-cb3e714813d3 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:52.387614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a6c85e5-875c-45b3-b6e1-cb3e714813d3 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:52.388556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a6c85e5-875c-45b3-b6e1-cb3e714813d3 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:52.588063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5a6c85e5-875c-45b3-b6e1-cb3e714813d3 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590d17fe6d43469f853b2465cde0a54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d1a0dedc047c4bbc2a7c59a1aa457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:52.596384 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5a6c85e5-875c-45b3-b6e1-cb3e714813d3 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc" status: 200 len: 1470 microversion: 2.1 time: 0.224371 Oct 29 03:27:52.597006 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3137/6049] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:52 2022] GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc => generated 1470 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:52.736039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f7f11f30-6ac3-424c-87d3-a9c1f41050a5 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:52.736800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f7f11f30-6ac3-424c-87d3-a9c1f41050a5 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: e504409e-fee0-4d16-abf8-c7190e74bb2e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:52.743716 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f7f11f30-6ac3-424c-87d3-a9c1f41050a5 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:52.744201 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f7f11f30-6ac3-424c-87d3-a9c1f41050a5 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:52.744663 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f7f11f30-6ac3-424c-87d3-a9c1f41050a5 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:52.745354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f7f11f30-6ac3-424c-87d3-a9c1f41050a5 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:52.745801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f7f11f30-6ac3-424c-87d3-a9c1f41050a5 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:52.746216 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f7f11f30-6ac3-424c-87d3-a9c1f41050a5 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:52.878914 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f7f11f30-6ac3-424c-87d3-a9c1f41050a5 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c633d65d3754c0bb47a7cb8754a97cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e202cdaad65452fa00963abd83004b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:52.887500 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f7f11f30-6ac3-424c-87d3-a9c1f41050a5 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "GET /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e" status: 200 len: 1318 microversion: 2.1 time: 0.155929 Oct 29 03:27:52.888096 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2913/6050] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:52 2022] GET /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:53.181777 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1454a587-59c6-435f-b47c-df8e9a93e8a2 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:53.182434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1454a587-59c6-435f-b47c-df8e9a93e8a2 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:53.184761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:53.185421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=8 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:53.192488 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1454a587-59c6-435f-b47c-df8e9a93e8a2 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:53.193166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1454a587-59c6-435f-b47c-df8e9a93e8a2 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:53.193617 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1454a587-59c6-435f-b47c-df8e9a93e8a2 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:53.194336 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1454a587-59c6-435f-b47c-df8e9a93e8a2 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:53.194804 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1454a587-59c6-435f-b47c-df8e9a93e8a2 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:53.195238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1454a587-59c6-435f-b47c-df8e9a93e8a2 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:53.270284 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1454a587-59c6-435f-b47c-df8e9a93e8a2 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:53.285554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1454a587-59c6-435f-b47c-df8e9a93e8a2 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:53.288301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1454a587-59c6-435f-b47c-df8e9a93e8a2 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:53.290480 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1454a587-59c6-435f-b47c-df8e9a93e8a2 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1365 microversion: 2.57 time: 0.113294 Oct 29 03:27:53.291485 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3138/6051] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:53 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1365 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:53.619726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5d958fef-e39e-4e3c-9198-5a0a1c377a64 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:53.620445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5d958fef-e39e-4e3c-9198-5a0a1c377a64 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:53.627759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d958fef-e39e-4e3c-9198-5a0a1c377a64 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:53.628248 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d958fef-e39e-4e3c-9198-5a0a1c377a64 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:53.628719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d958fef-e39e-4e3c-9198-5a0a1c377a64 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:53.629429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d958fef-e39e-4e3c-9198-5a0a1c377a64 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:53.629879 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d958fef-e39e-4e3c-9198-5a0a1c377a64 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:53.630329 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5d958fef-e39e-4e3c-9198-5a0a1c377a64 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:53.788140 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5d958fef-e39e-4e3c-9198-5a0a1c377a64 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590d17fe6d43469f853b2465cde0a54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d1a0dedc047c4bbc2a7c59a1aa457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:53.791827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:53.797624 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5d958fef-e39e-4e3c-9198-5a0a1c377a64 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc" status: 200 len: 1470 microversion: 2.1 time: 0.182208 Oct 29 03:27:53.798207 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2914/6052] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:53 2022] GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc => generated 1470 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:53.911689 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9a869aaf-58e4-4237-bbf7-7956b59dd9ce tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:53.912231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9a869aaf-58e4-4237-bbf7-7956b59dd9ce tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: e504409e-fee0-4d16-abf8-c7190e74bb2e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:53.919536 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9a869aaf-58e4-4237-bbf7-7956b59dd9ce tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:53.919536 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9a869aaf-58e4-4237-bbf7-7956b59dd9ce tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:53.919806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9a869aaf-58e4-4237-bbf7-7956b59dd9ce tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:53.920515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9a869aaf-58e4-4237-bbf7-7956b59dd9ce tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:53.921067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9a869aaf-58e4-4237-bbf7-7956b59dd9ce tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:53.921502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9a869aaf-58e4-4237-bbf7-7956b59dd9ce tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:54.058459 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9a869aaf-58e4-4237-bbf7-7956b59dd9ce tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c633d65d3754c0bb47a7cb8754a97cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e202cdaad65452fa00963abd83004b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:54.066604 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9a869aaf-58e4-4237-bbf7-7956b59dd9ce tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "GET /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e" status: 200 len: 1507 microversion: 2.1 time: 0.159019 Oct 29 03:27:54.067192 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3139/6053] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:53 2022] GET /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:54.089600 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e0891a66-85fc-42c8-b916-5544b7527f8f tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46a7a36d-0e15-4daa-99ed-9521f7a4856c", "device": "/dev/sdb"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:54.092186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e0891a66-85fc-42c8-b916-5544b7527f8f tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: e504409e-fee0-4d16-abf8-c7190e74bb2e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:54.098517 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0891a66-85fc-42c8-b916-5544b7527f8f tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:54.099033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0891a66-85fc-42c8-b916-5544b7527f8f tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:54.099465 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0891a66-85fc-42c8-b916-5544b7527f8f tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:54.100156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0891a66-85fc-42c8-b916-5544b7527f8f tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:54.100639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0891a66-85fc-42c8-b916-5544b7527f8f tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:54.101061 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0891a66-85fc-42c8-b916-5544b7527f8f tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:54.318816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ecd345a3-0abb-490b-8c15-88ccca1bab58 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:54.319598 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ecd345a3-0abb-490b-8c15-88ccca1bab58 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:54.327655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ecd345a3-0abb-490b-8c15-88ccca1bab58 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:54.328238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ecd345a3-0abb-490b-8c15-88ccca1bab58 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:54.328743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ecd345a3-0abb-490b-8c15-88ccca1bab58 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:54.329784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ecd345a3-0abb-490b-8c15-88ccca1bab58 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:54.330369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ecd345a3-0abb-490b-8c15-88ccca1bab58 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:54.330799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ecd345a3-0abb-490b-8c15-88ccca1bab58 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:54.343584 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e0891a66-85fc-42c8-b916-5544b7527f8f tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "POST /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257863 Oct 29 03:27:54.344499 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2915/6054] 10.222.0.46 () {60 vars in 1323 bytes} [Sat Oct 29 03:27:54 2022] POST /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:27:54.407295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ecd345a3-0abb-490b-8c15-88ccca1bab58 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:54.419541 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ecd345a3-0abb-490b-8c15-88ccca1bab58 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:54.421038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ecd345a3-0abb-490b-8c15-88ccca1bab58 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:54.422247 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ecd345a3-0abb-490b-8c15-88ccca1bab58 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1365 microversion: 2.57 time: 0.108565 Oct 29 03:27:54.422842 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3140/6055] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:54 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1365 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:54.823481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-36ac1002-5684-4bfe-b0f4-22028303385e tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:54.824080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-36ac1002-5684-4bfe-b0f4-22028303385e tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:54.831039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36ac1002-5684-4bfe-b0f4-22028303385e tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:54.831518 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36ac1002-5684-4bfe-b0f4-22028303385e tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:54.831944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36ac1002-5684-4bfe-b0f4-22028303385e tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:54.832679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36ac1002-5684-4bfe-b0f4-22028303385e tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:54.833124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36ac1002-5684-4bfe-b0f4-22028303385e tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:54.833542 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36ac1002-5684-4bfe-b0f4-22028303385e tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:54.977510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-36ac1002-5684-4bfe-b0f4-22028303385e tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590d17fe6d43469f853b2465cde0a54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d1a0dedc047c4bbc2a7c59a1aa457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:54.986519 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-36ac1002-5684-4bfe-b0f4-22028303385e tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc" status: 200 len: 1470 microversion: 2.1 time: 0.168303 Oct 29 03:27:54.987170 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2916/6056] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:54 2022] GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc => generated 1470 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:55.244488 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-ec9d541f-2c99-45bf-9720-b5f7b2e3cea0 req-a8d4ccaf-1d04-424d-8646-d66c313edd9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc", "name": "network-vif-plugged", "status": "completed", "tag": "c72ceda4-4c04-4b08-9837-18c24e623eff"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:55.255431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ec9d541f-2c99-45bf-9720-b5f7b2e3cea0 req-a8d4ccaf-1d04-424d-8646-d66c313edd9e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:55.256166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ec9d541f-2c99-45bf-9720-b5f7b2e3cea0 req-a8d4ccaf-1d04-424d-8646-d66c313edd9e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:55.256900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ec9d541f-2c99-45bf-9720-b5f7b2e3cea0 req-a8d4ccaf-1d04-424d-8646-d66c313edd9e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:55.269083 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-ec9d541f-2c99-45bf-9720-b5f7b2e3cea0 req-a8d4ccaf-1d04-424d-8646-d66c313edd9e service nova] Creating event network-vif-plugged:c72ceda4-4c04-4b08-9837-18c24e623eff for instance 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc on n-h1-862967-2 Oct 29 03:27:55.275381 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-ec9d541f-2c99-45bf-9720-b5f7b2e3cea0 req-a8d4ccaf-1d04-424d-8646-d66c313edd9e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034309 Oct 29 03:27:55.276304 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3141/6057] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:27:55.448622 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bd75c59e-bf48-4008-8086-4fb3bdce12bf tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:55.449519 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bd75c59e-bf48-4008-8086-4fb3bdce12bf tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:55.468118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd75c59e-bf48-4008-8086-4fb3bdce12bf tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:55.468888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd75c59e-bf48-4008-8086-4fb3bdce12bf tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:55.469508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd75c59e-bf48-4008-8086-4fb3bdce12bf tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:55.470215 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd75c59e-bf48-4008-8086-4fb3bdce12bf tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:55.470660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd75c59e-bf48-4008-8086-4fb3bdce12bf tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:55.471077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd75c59e-bf48-4008-8086-4fb3bdce12bf tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:55.553045 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bd75c59e-bf48-4008-8086-4fb3bdce12bf tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:55.564736 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bd75c59e-bf48-4008-8086-4fb3bdce12bf tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:55.566440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bd75c59e-bf48-4008-8086-4fb3bdce12bf tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:55.568150 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bd75c59e-bf48-4008-8086-4fb3bdce12bf tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1365 microversion: 2.57 time: 0.123519 Oct 29 03:27:55.568884 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2917/6058] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:55 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1365 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:56.010953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-73a96b03-a3be-4580-a234-f74671c305d6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:56.011880 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-73a96b03-a3be-4580-a234-f74671c305d6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:56.018981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73a96b03-a3be-4580-a234-f74671c305d6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:56.019555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73a96b03-a3be-4580-a234-f74671c305d6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:56.020062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73a96b03-a3be-4580-a234-f74671c305d6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:56.020876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73a96b03-a3be-4580-a234-f74671c305d6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:56.021402 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73a96b03-a3be-4580-a234-f74671c305d6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:56.022046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-73a96b03-a3be-4580-a234-f74671c305d6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:56.188898 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-73a96b03-a3be-4580-a234-f74671c305d6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590d17fe6d43469f853b2465cde0a54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d1a0dedc047c4bbc2a7c59a1aa457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:56.197417 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-73a96b03-a3be-4580-a234-f74671c305d6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc" status: 200 len: 1470 microversion: 2.1 time: 0.191580 Oct 29 03:27:56.198230 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3142/6059] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:56 2022] GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc => generated 1470 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:56.600025 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a8933335-9fad-4855-8c3c-109b5faa4bab tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:56.604878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a8933335-9fad-4855-8c3c-109b5faa4bab tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:56.608928 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:56.611621 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=20 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:56.615350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8933335-9fad-4855-8c3c-109b5faa4bab tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:56.615829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8933335-9fad-4855-8c3c-109b5faa4bab tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:56.616300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8933335-9fad-4855-8c3c-109b5faa4bab tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:56.617023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8933335-9fad-4855-8c3c-109b5faa4bab tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:56.617673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8933335-9fad-4855-8c3c-109b5faa4bab tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:56.618093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8933335-9fad-4855-8c3c-109b5faa4bab tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:56.686012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a8933335-9fad-4855-8c3c-109b5faa4bab tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:56.695083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a8933335-9fad-4855-8c3c-109b5faa4bab tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:56.696560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a8933335-9fad-4855-8c3c-109b5faa4bab tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:56.697769 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a8933335-9fad-4855-8c3c-109b5faa4bab tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1365 microversion: 2.57 time: 0.107619 Oct 29 03:27:56.698331 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2918/6060] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:56 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1365 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:57.221200 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6e684115-fdfb-4959-8cb7-5ec679bcbe7f tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:57.222123 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6e684115-fdfb-4959-8cb7-5ec679bcbe7f tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:57.232817 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e684115-fdfb-4959-8cb7-5ec679bcbe7f tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:57.233479 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e684115-fdfb-4959-8cb7-5ec679bcbe7f tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:57.234101 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e684115-fdfb-4959-8cb7-5ec679bcbe7f tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:57.234896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e684115-fdfb-4959-8cb7-5ec679bcbe7f tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:57.235477 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e684115-fdfb-4959-8cb7-5ec679bcbe7f tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:57.235973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e684115-fdfb-4959-8cb7-5ec679bcbe7f tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:57.418521 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6e684115-fdfb-4959-8cb7-5ec679bcbe7f tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590d17fe6d43469f853b2465cde0a54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d1a0dedc047c4bbc2a7c59a1aa457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:57.427849 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6e684115-fdfb-4959-8cb7-5ec679bcbe7f tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc" status: 200 len: 1643 microversion: 2.1 time: 0.211422 Oct 29 03:27:57.428443 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3143/6061] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:57 2022] GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc => generated 1643 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:27:57.449999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-62f16fb6-c1af-41a1-abde-1b63becb47c9 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:57.450900 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-62f16fb6-c1af-41a1-abde-1b63becb47c9 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:57.457110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62f16fb6-c1af-41a1-abde-1b63becb47c9 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:57.457795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62f16fb6-c1af-41a1-abde-1b63becb47c9 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:57.458414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62f16fb6-c1af-41a1-abde-1b63becb47c9 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:57.459276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62f16fb6-c1af-41a1-abde-1b63becb47c9 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:57.459900 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62f16fb6-c1af-41a1-abde-1b63becb47c9 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:57.460482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62f16fb6-c1af-41a1-abde-1b63becb47c9 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:57.646506 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-62f16fb6-c1af-41a1-abde-1b63becb47c9 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590d17fe6d43469f853b2465cde0a54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d1a0dedc047c4bbc2a7c59a1aa457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:57.646506 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-62f16fb6-c1af-41a1-abde-1b63becb47c9 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc" status: 200 len: 1643 microversion: 2.1 time: 0.198327 Oct 29 03:27:57.646506 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2919/6062] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:57 2022] GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc => generated 1643 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:27:57.666778 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5ae88d97-fa0a-4239-9434-c9537e5d7788 tempest-TestSecurityGroupsBasicOps-1275764971 tempest-TestSecurityGroupsBasicOps-1275764971-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:57.667394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5ae88d97-fa0a-4239-9434-c9537e5d7788 tempest-TestSecurityGroupsBasicOps-1275764971 tempest-TestSecurityGroupsBasicOps-1275764971-project-admin] [instance: 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:57.669499 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:57.674974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ae88d97-fa0a-4239-9434-c9537e5d7788 tempest-TestSecurityGroupsBasicOps-1275764971 tempest-TestSecurityGroupsBasicOps-1275764971-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:57.675463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ae88d97-fa0a-4239-9434-c9537e5d7788 tempest-TestSecurityGroupsBasicOps-1275764971 tempest-TestSecurityGroupsBasicOps-1275764971-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:57.675902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ae88d97-fa0a-4239-9434-c9537e5d7788 tempest-TestSecurityGroupsBasicOps-1275764971 tempest-TestSecurityGroupsBasicOps-1275764971-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:57.676634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ae88d97-fa0a-4239-9434-c9537e5d7788 tempest-TestSecurityGroupsBasicOps-1275764971 tempest-TestSecurityGroupsBasicOps-1275764971-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:57.677092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ae88d97-fa0a-4239-9434-c9537e5d7788 tempest-TestSecurityGroupsBasicOps-1275764971 tempest-TestSecurityGroupsBasicOps-1275764971-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:57.677519 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ae88d97-fa0a-4239-9434-c9537e5d7788 tempest-TestSecurityGroupsBasicOps-1275764971 tempest-TestSecurityGroupsBasicOps-1275764971-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:57.723507 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1ee8909f-10b1-4866-894f-8d1696e2f9c6 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:57.724166 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1ee8909f-10b1-4866-894f-8d1696e2f9c6 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:57.730324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ee8909f-10b1-4866-894f-8d1696e2f9c6 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:57.730872 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ee8909f-10b1-4866-894f-8d1696e2f9c6 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:57.731302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ee8909f-10b1-4866-894f-8d1696e2f9c6 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:57.732061 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ee8909f-10b1-4866-894f-8d1696e2f9c6 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:57.732515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ee8909f-10b1-4866-894f-8d1696e2f9c6 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:57.733016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ee8909f-10b1-4866-894f-8d1696e2f9c6 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:57.814071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1ee8909f-10b1-4866-894f-8d1696e2f9c6 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:57.826698 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1ee8909f-10b1-4866-894f-8d1696e2f9c6 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:57.828692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1ee8909f-10b1-4866-894f-8d1696e2f9c6 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:57.830191 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1ee8909f-10b1-4866-894f-8d1696e2f9c6 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1365 microversion: 2.57 time: 0.110852 Oct 29 03:27:57.831637 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2920/6063] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:57 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1365 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:27:57.942486 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5ae88d97-fa0a-4239-9434-c9537e5d7788 tempest-TestSecurityGroupsBasicOps-1275764971 tempest-TestSecurityGroupsBasicOps-1275764971-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc" status: 200 len: 1794 microversion: 2.1 time: 0.279423 Oct 29 03:27:57.943183 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3144/6064] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:27:57 2022] GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc => generated 1794 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:27:58.859182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-963a3e4a-3d44-4421-9aa1-036296b77ca3 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:27:58.860316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-963a3e4a-3d44-4421-9aa1-036296b77ca3 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:27:58.868273 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-963a3e4a-3d44-4421-9aa1-036296b77ca3 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:58.869034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-963a3e4a-3d44-4421-9aa1-036296b77ca3 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:58.869669 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-963a3e4a-3d44-4421-9aa1-036296b77ca3 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:58.870600 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-963a3e4a-3d44-4421-9aa1-036296b77ca3 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:58.871221 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-963a3e4a-3d44-4421-9aa1-036296b77ca3 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:58.872054 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-963a3e4a-3d44-4421-9aa1-036296b77ca3 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:58.964437 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-963a3e4a-3d44-4421-9aa1-036296b77ca3 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:58.978702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-963a3e4a-3d44-4421-9aa1-036296b77ca3 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:58.981905 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-963a3e4a-3d44-4421-9aa1-036296b77ca3 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:27:58.983696 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-963a3e4a-3d44-4421-9aa1-036296b77ca3 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1365 microversion: 2.57 time: 0.128898 Oct 29 03:27:58.985560 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2921/6065] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:27:58 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1365 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:27:59.743171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-98f742e6-2f93-44f9-b961-a0b14fe033a7 req-963f9521-6626-48d5-b244-3b78b9335d76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc", "tag": "c72ceda4-4c04-4b08-9837-18c24e623eff"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:27:59.764346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-98f742e6-2f93-44f9-b961-a0b14fe033a7 req-963f9521-6626-48d5-b244-3b78b9335d76 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:27:59.765492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-98f742e6-2f93-44f9-b961-a0b14fe033a7 req-963f9521-6626-48d5-b244-3b78b9335d76 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:27:59.766269 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-98f742e6-2f93-44f9-b961-a0b14fe033a7 req-963f9521-6626-48d5-b244-3b78b9335d76 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:27:59.786046 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-98f742e6-2f93-44f9-b961-a0b14fe033a7 req-963f9521-6626-48d5-b244-3b78b9335d76 service nova] Creating event network-changed:c72ceda4-4c04-4b08-9837-18c24e623eff for instance 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc on n-h1-862967-2 Oct 29 03:27:59.792336 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-98f742e6-2f93-44f9-b961-a0b14fe033a7 req-963f9521-6626-48d5-b244-3b78b9335d76 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052945 Oct 29 03:27:59.792754 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3145/6066] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:28:00.013345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-71adee2a-0c6d-4ac8-b557-6f8ca97d9b5b tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:00.014044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-71adee2a-0c6d-4ac8-b557-6f8ca97d9b5b tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:00.020983 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-71adee2a-0c6d-4ac8-b557-6f8ca97d9b5b tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:00.021746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-71adee2a-0c6d-4ac8-b557-6f8ca97d9b5b tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:00.022188 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-71adee2a-0c6d-4ac8-b557-6f8ca97d9b5b tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:00.023243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-71adee2a-0c6d-4ac8-b557-6f8ca97d9b5b tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:00.023700 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-71adee2a-0c6d-4ac8-b557-6f8ca97d9b5b tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:00.024135 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-71adee2a-0c6d-4ac8-b557-6f8ca97d9b5b tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:00.103730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-71adee2a-0c6d-4ac8-b557-6f8ca97d9b5b tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:00.114982 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-71adee2a-0c6d-4ac8-b557-6f8ca97d9b5b tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:00.116751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-71adee2a-0c6d-4ac8-b557-6f8ca97d9b5b tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:00.118453 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-71adee2a-0c6d-4ac8-b557-6f8ca97d9b5b tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1365 microversion: 2.57 time: 0.109272 Oct 29 03:28:00.132872 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2922/6067] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:28:00 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1365 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:28:01.147059 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d69b17a4-99d2-4917-8a9d-c8616f6765ad tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:01.148086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d69b17a4-99d2-4917-8a9d-c8616f6765ad tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:01.154997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d69b17a4-99d2-4917-8a9d-c8616f6765ad tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:01.155487 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d69b17a4-99d2-4917-8a9d-c8616f6765ad tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:01.155927 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d69b17a4-99d2-4917-8a9d-c8616f6765ad tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:01.156665 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d69b17a4-99d2-4917-8a9d-c8616f6765ad tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:01.157100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d69b17a4-99d2-4917-8a9d-c8616f6765ad tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:01.157569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d69b17a4-99d2-4917-8a9d-c8616f6765ad tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:01.227691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d69b17a4-99d2-4917-8a9d-c8616f6765ad tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:01.236336 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d69b17a4-99d2-4917-8a9d-c8616f6765ad tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:01.237830 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d69b17a4-99d2-4917-8a9d-c8616f6765ad tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:01.239017 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d69b17a4-99d2-4917-8a9d-c8616f6765ad tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1365 microversion: 2.57 time: 0.097275 Oct 29 03:28:01.239588 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3146/6068] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:28:01 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1365 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:28:02.265506 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-169655b3-8901-4cf5-b0b9-cdff8d0828ed tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:02.266098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-169655b3-8901-4cf5-b0b9-cdff8d0828ed tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:02.273856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-169655b3-8901-4cf5-b0b9-cdff8d0828ed tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:02.274354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-169655b3-8901-4cf5-b0b9-cdff8d0828ed tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:02.274764 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-169655b3-8901-4cf5-b0b9-cdff8d0828ed tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:02.275453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-169655b3-8901-4cf5-b0b9-cdff8d0828ed tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:02.275898 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-169655b3-8901-4cf5-b0b9-cdff8d0828ed tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:02.276315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-169655b3-8901-4cf5-b0b9-cdff8d0828ed tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:02.348487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-169655b3-8901-4cf5-b0b9-cdff8d0828ed tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:02.356941 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-169655b3-8901-4cf5-b0b9-cdff8d0828ed tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:02.358539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-169655b3-8901-4cf5-b0b9-cdff8d0828ed tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:02.359725 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-169655b3-8901-4cf5-b0b9-cdff8d0828ed tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1365 microversion: 2.57 time: 0.098686 Oct 29 03:28:02.360277 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2923/6069] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:28:02 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1365 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 03:28:03.388792 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fe654936-fa7c-483d-b2e5-3961a55ca5fc tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:03.389584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fe654936-fa7c-483d-b2e5-3961a55ca5fc tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:03.398842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fe654936-fa7c-483d-b2e5-3961a55ca5fc tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:03.399393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fe654936-fa7c-483d-b2e5-3961a55ca5fc tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:03.399852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fe654936-fa7c-483d-b2e5-3961a55ca5fc tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:03.400553 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fe654936-fa7c-483d-b2e5-3961a55ca5fc tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:03.401040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fe654936-fa7c-483d-b2e5-3961a55ca5fc tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:03.401461 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fe654936-fa7c-483d-b2e5-3961a55ca5fc tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:03.466094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fe654936-fa7c-483d-b2e5-3961a55ca5fc tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:03.468741 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=100 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:03.476358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fe654936-fa7c-483d-b2e5-3961a55ca5fc tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:03.477924 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fe654936-fa7c-483d-b2e5-3961a55ca5fc tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:03.480072 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fe654936-fa7c-483d-b2e5-3961a55ca5fc tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1365 microversion: 2.57 time: 0.095052 Oct 29 03:28:03.480072 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3147/6070] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:28:03 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1365 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:28:04.509015 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ad45161f-b436-4a5c-b999-641837cc6652 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:04.509609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ad45161f-b436-4a5c-b999-641837cc6652 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:04.517313 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad45161f-b436-4a5c-b999-641837cc6652 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:04.517804 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad45161f-b436-4a5c-b999-641837cc6652 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:04.518245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad45161f-b436-4a5c-b999-641837cc6652 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:04.518983 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad45161f-b436-4a5c-b999-641837cc6652 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:04.519443 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad45161f-b436-4a5c-b999-641837cc6652 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:04.519872 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad45161f-b436-4a5c-b999-641837cc6652 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:04.597875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ad45161f-b436-4a5c-b999-641837cc6652 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:04.608622 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ad45161f-b436-4a5c-b999-641837cc6652 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:04.610064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ad45161f-b436-4a5c-b999-641837cc6652 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:04.611717 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ad45161f-b436-4a5c-b999-641837cc6652 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1365 microversion: 2.57 time: 0.106642 Oct 29 03:28:04.611871 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2924/6071] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:28:04 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1365 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:28:05.638106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-06ea0911-6d1e-4784-9e07-c5a6ead89fa0 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:05.638712 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-06ea0911-6d1e-4784-9e07-c5a6ead89fa0 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:05.646094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06ea0911-6d1e-4784-9e07-c5a6ead89fa0 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:05.646583 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06ea0911-6d1e-4784-9e07-c5a6ead89fa0 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:05.647356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06ea0911-6d1e-4784-9e07-c5a6ead89fa0 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:05.648054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06ea0911-6d1e-4784-9e07-c5a6ead89fa0 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:05.648505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06ea0911-6d1e-4784-9e07-c5a6ead89fa0 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:05.648957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06ea0911-6d1e-4784-9e07-c5a6ead89fa0 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:05.712869 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-06ea0911-6d1e-4784-9e07-c5a6ead89fa0 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:05.721318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-06ea0911-6d1e-4784-9e07-c5a6ead89fa0 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:05.722757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-06ea0911-6d1e-4784-9e07-c5a6ead89fa0 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:05.723938 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-06ea0911-6d1e-4784-9e07-c5a6ead89fa0 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1365 microversion: 2.57 time: 0.089968 Oct 29 03:28:05.724503 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3148/6072] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:28:05 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1365 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:28:06.750024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9c2716f0-08a8-4394-9d93-faa5293c7296 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:06.751269 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9c2716f0-08a8-4394-9d93-faa5293c7296 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:06.759626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c2716f0-08a8-4394-9d93-faa5293c7296 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:06.759626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c2716f0-08a8-4394-9d93-faa5293c7296 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:06.759967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c2716f0-08a8-4394-9d93-faa5293c7296 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:06.760707 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c2716f0-08a8-4394-9d93-faa5293c7296 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:06.761217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c2716f0-08a8-4394-9d93-faa5293c7296 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:06.761569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c2716f0-08a8-4394-9d93-faa5293c7296 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:06.830183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9c2716f0-08a8-4394-9d93-faa5293c7296 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:06.841145 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9c2716f0-08a8-4394-9d93-faa5293c7296 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:06.843413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9c2716f0-08a8-4394-9d93-faa5293c7296 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:06.844695 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9c2716f0-08a8-4394-9d93-faa5293c7296 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1365 microversion: 2.57 time: 0.098768 Oct 29 03:28:06.845345 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2925/6073] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:28:06 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1365 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:28:06.921257 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-39e806be-7626-4817-b2dc-4af729786108 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:28:06.923586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-39e806be-7626-4817-b2dc-4af729786108 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:06.931212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39e806be-7626-4817-b2dc-4af729786108 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:06.931710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39e806be-7626-4817-b2dc-4af729786108 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:06.932157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39e806be-7626-4817-b2dc-4af729786108 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:06.932923 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39e806be-7626-4817-b2dc-4af729786108 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:06.933454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39e806be-7626-4817-b2dc-4af729786108 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:06.933816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-39e806be-7626-4817-b2dc-4af729786108 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:06.991107 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-39e806be-7626-4817-b2dc-4af729786108 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "POST /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26/action" status: 200 len: 24566 microversion: 2.1 time: 0.075236 Oct 29 03:28:06.991858 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3149/6074] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:28:06 2022] POST /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26/action => generated 24566 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 03:28:07.871637 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e5991bbf-544b-45bc-98b7-2795a6972681 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:07.872690 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e5991bbf-544b-45bc-98b7-2795a6972681 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:07.880393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5991bbf-544b-45bc-98b7-2795a6972681 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:07.880936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5991bbf-544b-45bc-98b7-2795a6972681 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:07.881370 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5991bbf-544b-45bc-98b7-2795a6972681 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:07.882154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5991bbf-544b-45bc-98b7-2795a6972681 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:07.882993 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5991bbf-544b-45bc-98b7-2795a6972681 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:07.883417 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e5991bbf-544b-45bc-98b7-2795a6972681 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:07.951599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e5991bbf-544b-45bc-98b7-2795a6972681 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:07.962839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e5991bbf-544b-45bc-98b7-2795a6972681 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:07.964305 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e5991bbf-544b-45bc-98b7-2795a6972681 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:07.965524 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e5991bbf-544b-45bc-98b7-2795a6972681 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1371 microversion: 2.57 time: 0.098145 Oct 29 03:28:07.966495 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2926/6075] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:28:07 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:28:08.999375 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-49d546fb-4a54-4a5e-9b60-1048323fd400 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:09.000081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-49d546fb-4a54-4a5e-9b60-1048323fd400 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:09.008395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-49d546fb-4a54-4a5e-9b60-1048323fd400 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:09.009379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-49d546fb-4a54-4a5e-9b60-1048323fd400 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:09.009749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-49d546fb-4a54-4a5e-9b60-1048323fd400 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:09.010485 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-49d546fb-4a54-4a5e-9b60-1048323fd400 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:09.010951 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-49d546fb-4a54-4a5e-9b60-1048323fd400 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:09.011378 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-49d546fb-4a54-4a5e-9b60-1048323fd400 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:09.085551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-49d546fb-4a54-4a5e-9b60-1048323fd400 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:09.094851 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-49d546fb-4a54-4a5e-9b60-1048323fd400 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:09.096594 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-49d546fb-4a54-4a5e-9b60-1048323fd400 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:09.097821 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-49d546fb-4a54-4a5e-9b60-1048323fd400 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1371 microversion: 2.57 time: 0.103562 Oct 29 03:28:09.098382 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3150/6076] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:28:08 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:28:10.124639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f5ac2f25-acf2-43a2-8df0-d3383bf1949a tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:10.125433 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f5ac2f25-acf2-43a2-8df0-d3383bf1949a tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:10.128408 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:10.137377 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5ac2f25-acf2-43a2-8df0-d3383bf1949a tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:10.138065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5ac2f25-acf2-43a2-8df0-d3383bf1949a tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:10.138711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5ac2f25-acf2-43a2-8df0-d3383bf1949a tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:10.139777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5ac2f25-acf2-43a2-8df0-d3383bf1949a tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:10.140282 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5ac2f25-acf2-43a2-8df0-d3383bf1949a tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:10.140742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5ac2f25-acf2-43a2-8df0-d3383bf1949a tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:10.210251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f5ac2f25-acf2-43a2-8df0-d3383bf1949a tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:10.219840 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f5ac2f25-acf2-43a2-8df0-d3383bf1949a tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:10.221376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f5ac2f25-acf2-43a2-8df0-d3383bf1949a tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:10.222616 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f5ac2f25-acf2-43a2-8df0-d3383bf1949a tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1356 microversion: 2.57 time: 0.102593 Oct 29 03:28:10.223888 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2927/6077] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:28:10 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:28:10.254842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b9100871-d4bb-4306-bb19-beb7ccfd8610 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:10.255455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b9100871-d4bb-4306-bb19-beb7ccfd8610 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:10.262519 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b9100871-d4bb-4306-bb19-beb7ccfd8610 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:10.263323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b9100871-d4bb-4306-bb19-beb7ccfd8610 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:10.263759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b9100871-d4bb-4306-bb19-beb7ccfd8610 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:10.264473 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b9100871-d4bb-4306-bb19-beb7ccfd8610 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:10.264953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b9100871-d4bb-4306-bb19-beb7ccfd8610 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:10.265376 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b9100871-d4bb-4306-bb19-beb7ccfd8610 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:10.295466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b9100871-d4bb-4306-bb19-beb7ccfd8610 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:28:10.383817 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b9100871-d4bb-4306-bb19-beb7ccfd8610 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 204 len: 0 microversion: 2.57 time: 0.130789 Oct 29 03:28:10.384426 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3151/6078] 10.222.0.46 () {60 vars in 1280 bytes} [Sat Oct 29 03:28:10 2022] DELETE /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 03:28:10.395125 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dc1f9da9-079f-41ae-a01d-6643b4458ec3 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:10.396057 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dc1f9da9-079f-41ae-a01d-6643b4458ec3 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:10.409388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc1f9da9-079f-41ae-a01d-6643b4458ec3 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:10.411829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc1f9da9-079f-41ae-a01d-6643b4458ec3 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:10.412474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc1f9da9-079f-41ae-a01d-6643b4458ec3 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:10.413432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc1f9da9-079f-41ae-a01d-6643b4458ec3 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:10.414073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc1f9da9-079f-41ae-a01d-6643b4458ec3 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:10.414651 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc1f9da9-079f-41ae-a01d-6643b4458ec3 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:10.518452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dc1f9da9-079f-41ae-a01d-6643b4458ec3 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:10.527933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dc1f9da9-079f-41ae-a01d-6643b4458ec3 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:10.538547 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dc1f9da9-079f-41ae-a01d-6643b4458ec3 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:10.540111 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dc1f9da9-079f-41ae-a01d-6643b4458ec3 tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1362 microversion: 2.57 time: 0.150190 Oct 29 03:28:10.540899 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2928/6079] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:28:10 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:28:11.568759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bdbef8c4-f0b5-49ff-a3eb-cda3cb6be24e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:11.569473 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bdbef8c4-f0b5-49ff-a3eb-cda3cb6be24e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:11.580509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdbef8c4-f0b5-49ff-a3eb-cda3cb6be24e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:11.581228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdbef8c4-f0b5-49ff-a3eb-cda3cb6be24e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:11.581792 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdbef8c4-f0b5-49ff-a3eb-cda3cb6be24e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:11.582831 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdbef8c4-f0b5-49ff-a3eb-cda3cb6be24e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:11.583282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdbef8c4-f0b5-49ff-a3eb-cda3cb6be24e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:11.583703 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdbef8c4-f0b5-49ff-a3eb-cda3cb6be24e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:11.654256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bdbef8c4-f0b5-49ff-a3eb-cda3cb6be24e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:11.663083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bdbef8c4-f0b5-49ff-a3eb-cda3cb6be24e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:11.664580 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bdbef8c4-f0b5-49ff-a3eb-cda3cb6be24e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bdfdc331a0714227893dbea983ff6b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10deb4e4b325488eab463dda518c5e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:11.665766 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bdbef8c4-f0b5-49ff-a3eb-cda3cb6be24e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 200 len: 1362 microversion: 2.57 time: 0.101443 Oct 29 03:28:11.666343 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3152/6080] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:28:11 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 1362 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 03:28:12.697073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a08a6d74-afd2-4144-9ea6-42310df0743e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:12.697682 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a08a6d74-afd2-4144-9ea6-42310df0743e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] [instance: f34e02ea-1032-40e5-baef-20c2e6b96da7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:12.704969 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a08a6d74-afd2-4144-9ea6-42310df0743e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:12.705467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a08a6d74-afd2-4144-9ea6-42310df0743e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:12.705907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a08a6d74-afd2-4144-9ea6-42310df0743e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:12.706623 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a08a6d74-afd2-4144-9ea6-42310df0743e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:12.707079 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a08a6d74-afd2-4144-9ea6-42310df0743e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:12.707506 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a08a6d74-afd2-4144-9ea6-42310df0743e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:12.722355 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-a08a6d74-afd2-4144-9ea6-42310df0743e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] HTTP exception thrown: Instance f34e02ea-1032-40e5-baef-20c2e6b96da7 could not be found. Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a08a6d74-afd2-4144-9ea6-42310df0743e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Request method failure captured: Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 HTTP/1.1 Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJ2m-NNBqd5haThpxWP351VLC1Ml96rlI3-vpRWUI4P4xgoOo6PQ0Y9fkyXkJSylHpFPrAlrRmalpLcUOK2AAaX09Bk09Bagzmzox3lCdwXoJYnXdhrLDMFHa3CQN5JCM6t0GeexY-k-cF1wkz0TmhpuyLkaRue_kUnt3Ab8zJ0cx54 Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: X-Openstack-Nova-Api-Version: 2.57 Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 10deb4e4b325488eab463dda518c5e86 Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerShowV257Test-650672043 Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/10deb4e4b325488eab463dda518c5e86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/10deb4e4b325488eab463dda518c5e86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_10deb4e4b325488eab463dda518c5e86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/10deb4e4b325488eab463dda518c5e86"}]}] Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerShowV257Test-650672043 Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 10deb4e4b325488eab463dda518c5e86 Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerShowV257Test-650672043 Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerShowV257Test-650672043-project Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: bdfdc331a0714227893dbea983ff6b58 Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerShowV257Test-650672043-project Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance f34e02ea-1032-40e5-baef-20c2e6b96da7 could not be found. Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'f34e02ea-1032-40e5-baef-20c2e6b96da7'} Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f34e02ea-1032-40e5-baef-20c2e6b96da7 could not be found. Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f34e02ea-1032-40e5-baef-20c2e6b96da7 could not be found. Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:28:12.724066 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:28:12.729458 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:28:12.729458 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:28:12.729458 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:28:12.729458 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:28:12.729458 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:28:12.729458 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f34e02ea-1032-40e5-baef-20c2e6b96da7 could not be found. Oct 29 03:28:12.729458 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:28:12.729458 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a08a6d74-afd2-4144-9ea6-42310df0743e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] Returning 404 to user: Instance f34e02ea-1032-40e5-baef-20c2e6b96da7 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:28:12.729458 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a08a6d74-afd2-4144-9ea6-42310df0743e tempest-ServerShowV257Test-650672043 tempest-ServerShowV257Test-650672043-project] 10.222.0.46 "GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7" status: 404 len: 111 microversion: 2.57 time: 0.032754 Oct 29 03:28:12.729458 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2929/6081] 10.222.0.46 () {60 vars in 1277 bytes} [Sat Oct 29 03:28:12 2022] GET /compute/v2.1/servers/f34e02ea-1032-40e5-baef-20c2e6b96da7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:28:14.343668 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4d0133aa-3c05-493e-bc43-8d25383f1a3e tempest-VolumesGetTestJSON-1424177406 tempest-VolumesGetTestJSON-1424177406-project] Action: 'create', calling method: .version_select at 0x7ff0586ef040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-693747108", "metadata": {"Type": "work"}}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:28:14.677504 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4d0133aa-3c05-493e-bc43-8d25383f1a3e tempest-VolumesGetTestJSON-1424177406 tempest-VolumesGetTestJSON-1424177406-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.462106 Oct 29 03:28:14.686372 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3153/6082] 10.222.0.46 () {60 vars in 1156 bytes} [Sat Oct 29 03:28:14 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 464 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 29 03:28:14.693886 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-caee4497-2785-4d53-abe7-0431a50d5d74 tempest-VolumesGetTestJSON-1424177406 tempest-VolumesGetTestJSON-1424177406-project] Calling method '.version_select at 0x7ff0588c8430>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:14.753619 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-caee4497-2785-4d53-abe7-0431a50d5d74 tempest-VolumesGetTestJSON-1424177406 tempest-VolumesGetTestJSON-1424177406-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/84906b66-975e-498e-85a5-6f68f3ffeb6d" status: 200 len: 352 microversion: 2.1 time: 0.063873 Oct 29 03:28:14.754604 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2930/6083] 10.222.0.46 () {58 vars in 1245 bytes} [Sat Oct 29 03:28:14 2022] GET /compute/v2.1/os-volumes/84906b66-975e-498e-85a5-6f68f3ffeb6d => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:28:15.770297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-68a7520f-91ee-4d42-ad13-6b7470e2f567 tempest-VolumesGetTestJSON-1424177406 tempest-VolumesGetTestJSON-1424177406-project] Calling method '.version_select at 0x7ff05345e1f0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:15.820853 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-68a7520f-91ee-4d42-ad13-6b7470e2f567 tempest-VolumesGetTestJSON-1424177406 tempest-VolumesGetTestJSON-1424177406-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/84906b66-975e-498e-85a5-6f68f3ffeb6d" status: 200 len: 353 microversion: 2.1 time: 0.055461 Oct 29 03:28:15.821438 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3154/6084] 10.222.0.46 () {58 vars in 1245 bytes} [Sat Oct 29 03:28:15 2022] GET /compute/v2.1/os-volumes/84906b66-975e-498e-85a5-6f68f3ffeb6d => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:28:15.836480 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-87205df8-369b-4b04-8f21-012b6080a804 tempest-VolumesGetTestJSON-1424177406 tempest-VolumesGetTestJSON-1424177406-project] Calling method '.version_select at 0x7ff05c22c670>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:15.887708 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-87205df8-369b-4b04-8f21-012b6080a804 tempest-VolumesGetTestJSON-1424177406 tempest-VolumesGetTestJSON-1424177406-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/84906b66-975e-498e-85a5-6f68f3ffeb6d" status: 200 len: 353 microversion: 2.1 time: 0.056712 Oct 29 03:28:15.888308 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2931/6085] 10.222.0.46 () {58 vars in 1245 bytes} [Sat Oct 29 03:28:15 2022] GET /compute/v2.1/os-volumes/84906b66-975e-498e-85a5-6f68f3ffeb6d => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:28:15.903143 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-10f756a2-187c-4231-b9a4-b3465fcc675a tempest-VolumesGetTestJSON-1424177406 tempest-VolumesGetTestJSON-1424177406-project] Calling method '.version_select at 0x7ff0580431f0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:15.967808 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-10f756a2-187c-4231-b9a4-b3465fcc675a tempest-VolumesGetTestJSON-1424177406 tempest-VolumesGetTestJSON-1424177406-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/84906b66-975e-498e-85a5-6f68f3ffeb6d" status: 202 len: 0 microversion: 2.1 time: 0.068632 Oct 29 03:28:15.968485 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3155/6086] 10.222.0.46 () {58 vars in 1248 bytes} [Sat Oct 29 03:28:15 2022] DELETE /compute/v2.1/os-volumes/84906b66-975e-498e-85a5-6f68f3ffeb6d => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:28:15.976692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-008f362f-b1c8-4db6-aff8-f79bbf918d8d tempest-VolumesGetTestJSON-1424177406 tempest-VolumesGetTestJSON-1424177406-project] Calling method '.version_select at 0x7ff0588c89d0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:16.033770 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-008f362f-b1c8-4db6-aff8-f79bbf918d8d tempest-VolumesGetTestJSON-1424177406 tempest-VolumesGetTestJSON-1424177406-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/84906b66-975e-498e-85a5-6f68f3ffeb6d" status: 200 len: 352 microversion: 2.1 time: 0.061055 Oct 29 03:28:16.034597 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2932/6087] 10.222.0.46 () {58 vars in 1245 bytes} [Sat Oct 29 03:28:15 2022] GET /compute/v2.1/os-volumes/84906b66-975e-498e-85a5-6f68f3ffeb6d => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:28:16.054766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-915e618e-7096-4fa7-b764-bec09814667e tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:16.055402 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-915e618e-7096-4fa7-b764-bec09814667e tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: e504409e-fee0-4d16-abf8-c7190e74bb2e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:16.063473 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-915e618e-7096-4fa7-b764-bec09814667e tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:16.064300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-915e618e-7096-4fa7-b764-bec09814667e tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:16.064962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-915e618e-7096-4fa7-b764-bec09814667e tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:16.065972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-915e618e-7096-4fa7-b764-bec09814667e tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:16.066610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-915e618e-7096-4fa7-b764-bec09814667e tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:16.067214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-915e618e-7096-4fa7-b764-bec09814667e tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:16.158930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-915e618e-7096-4fa7-b764-bec09814667e tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lazy-loading 'services' on Instance uuid e504409e-fee0-4d16-abf8-c7190e74bb2e {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:28:16.233466 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-915e618e-7096-4fa7-b764-bec09814667e tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e/os-volume_attachments/46a7a36d-0e15-4daa-99ed-9521f7a4856c" status: 202 len: 0 microversion: 2.1 time: 0.182158 Oct 29 03:28:16.234197 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3156/6088] 10.222.0.46 () {58 vars in 1416 bytes} [Sat Oct 29 03:28:16 2022] DELETE /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e/os-volume_attachments/46a7a36d-0e15-4daa-99ed-9521f7a4856c => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:28:17.049464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d46bd7e2-a0d4-4be7-b981-146c7e75dc1b tempest-VolumesGetTestJSON-1424177406 tempest-VolumesGetTestJSON-1424177406-project] Calling method '.version_select at 0x7ff0538dee50>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:17.110262 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d46bd7e2-a0d4-4be7-b981-146c7e75dc1b tempest-VolumesGetTestJSON-1424177406 tempest-VolumesGetTestJSON-1424177406-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/84906b66-975e-498e-85a5-6f68f3ffeb6d" status: 200 len: 352 microversion: 2.1 time: 0.065843 Oct 29 03:28:17.111089 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2933/6089] 10.222.0.46 () {58 vars in 1245 bytes} [Sat Oct 29 03:28:17 2022] GET /compute/v2.1/os-volumes/84906b66-975e-498e-85a5-6f68f3ffeb6d => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:28:18.127717 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4fa1db76-da3a-4319-8de1-462b260e531a tempest-VolumesGetTestJSON-1424177406 tempest-VolumesGetTestJSON-1424177406-project] Calling method '.version_select at 0x7ff05c0fba60>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:18.160689 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-4fa1db76-da3a-4319-8de1-462b260e531a tempest-VolumesGetTestJSON-1424177406 tempest-VolumesGetTestJSON-1424177406-project] HTTP exception thrown: Volume 84906b66-975e-498e-85a5-6f68f3ffeb6d could not be found. Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4fa1db76-da3a-4319-8de1-462b260e531a tempest-VolumesGetTestJSON-1424177406 tempest-VolumesGetTestJSON-1424177406-project] Request method failure captured: Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/os-volumes/84906b66-975e-498e-85a5-6f68f3ffeb6d HTTP/1.1 Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJ3OlUlT1AYG35k3Hjaoi6MyNq9F1X-9Tu-0n9q8--rRTEwsYpIGNMQXryp7nOZZ7rKyHPVjaS_ckP8kyauyD2ZbicePDFwGKqDQFZHjOkV-pbpTVWlanS_TOsVF3vVxNGukYpD7VO4A188-c8_3kRvVuCasaRSTSlZUHeFc0hLjNao Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 5cc0719b97dc43948caa9d765f1f7066 Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-VolumesGetTestJSON-1424177406 Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5cc0719b97dc43948caa9d765f1f7066"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5cc0719b97dc43948caa9d765f1f7066"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5cc0719b97dc43948caa9d765f1f7066"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5cc0719b97dc43948caa9d765f1f7066"}]}] Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-VolumesGetTestJSON-1424177406 Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 5cc0719b97dc43948caa9d765f1f7066 Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-VolumesGetTestJSON-1424177406 Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-VolumesGetTestJSON-1424177406-project Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: eed6b416430845eaaedc85cb96decea9 Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-VolumesGetTestJSON-1424177406-project Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: method: Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: exception: Volume 84906b66-975e-498e-85a5-6f68f3ffeb6d could not be found. Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '84906b66-975e-498e-85a5-6f68f3ffeb6d'} Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 84906b66-975e-498e-85a5-6f68f3ffeb6d could not be found. (HTTP 404) (Request-ID: req-77810ad3-f5fc-42d6-86d3-dfbca73a0bc3) Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 29 03:28:18.163026 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 84906b66-975e-498e-85a5-6f68f3ffeb6d could not be found. Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 84906b66-975e-498e-85a5-6f68f3ffeb6d could not be found. Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 84906b66-975e-498e-85a5-6f68f3ffeb6d could not be found. Oct 29 03:28:18.168222 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:28:18.173539 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4fa1db76-da3a-4319-8de1-462b260e531a tempest-VolumesGetTestJSON-1424177406 tempest-VolumesGetTestJSON-1424177406-project] Returning 404 to user: Volume 84906b66-975e-498e-85a5-6f68f3ffeb6d could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:28:18.174608 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4fa1db76-da3a-4319-8de1-462b260e531a tempest-VolumesGetTestJSON-1424177406 tempest-VolumesGetTestJSON-1424177406-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/84906b66-975e-498e-85a5-6f68f3ffeb6d" status: 404 len: 109 microversion: 2.1 time: 0.053252 Oct 29 03:28:18.179550 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3157/6090] 10.222.0.46 () {58 vars in 1245 bytes} [Sat Oct 29 03:28:18 2022] GET /compute/v2.1/os-volumes/84906b66-975e-498e-85a5-6f68f3ffeb6d => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:28:19.366662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-753664a9-1199-46a3-b90d-8a124fbd2d4f tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:19.369105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-753664a9-1199-46a3-b90d-8a124fbd2d4f tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:19.388320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-753664a9-1199-46a3-b90d-8a124fbd2d4f tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:19.390478 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-753664a9-1199-46a3-b90d-8a124fbd2d4f tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:19.393910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-753664a9-1199-46a3-b90d-8a124fbd2d4f tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:19.394754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-753664a9-1199-46a3-b90d-8a124fbd2d4f tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:19.395240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-753664a9-1199-46a3-b90d-8a124fbd2d4f tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:19.396398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-753664a9-1199-46a3-b90d-8a124fbd2d4f tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:19.425659 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-753664a9-1199-46a3-b90d-8a124fbd2d4f tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:28:19.431999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:19.603191 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-753664a9-1199-46a3-b90d-8a124fbd2d4f tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "DELETE /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26" status: 204 len: 0 microversion: 2.1 time: 0.247272 Oct 29 03:28:19.606114 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2934/6091] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:28:19 2022] DELETE /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:28:19.626597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7ffc3ec8-9ef8-4484-8a5a-5141e37352ee tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:19.627970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7ffc3ec8-9ef8-4484-8a5a-5141e37352ee tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:19.636276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-c833ba9f-7834-4992-9de0-29eabb7c0bb6 req-8c55728b-8bb9-45e8-bf37-8b8cd5bf46aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "892f3002-c947-42fb-84c6-c1e401492d26", "tag": "bc07623e-95e8-4f84-a6ac-5c3505851ea7"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:28:19.637507 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ffc3ec8-9ef8-4484-8a5a-5141e37352ee tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:19.638969 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ffc3ec8-9ef8-4484-8a5a-5141e37352ee tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:19.639691 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ffc3ec8-9ef8-4484-8a5a-5141e37352ee tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:19.640686 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ffc3ec8-9ef8-4484-8a5a-5141e37352ee tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:19.641321 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ffc3ec8-9ef8-4484-8a5a-5141e37352ee tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:19.641963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7ffc3ec8-9ef8-4484-8a5a-5141e37352ee tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:19.662397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c833ba9f-7834-4992-9de0-29eabb7c0bb6 req-8c55728b-8bb9-45e8-bf37-8b8cd5bf46aa service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:19.662885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c833ba9f-7834-4992-9de0-29eabb7c0bb6 req-8c55728b-8bb9-45e8-bf37-8b8cd5bf46aa service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:19.666857 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c833ba9f-7834-4992-9de0-29eabb7c0bb6 req-8c55728b-8bb9-45e8-bf37-8b8cd5bf46aa service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:19.679752 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-c833ba9f-7834-4992-9de0-29eabb7c0bb6 req-8c55728b-8bb9-45e8-bf37-8b8cd5bf46aa service nova] Creating event network-changed:bc07623e-95e8-4f84-a6ac-5c3505851ea7 for instance 892f3002-c947-42fb-84c6-c1e401492d26 on n-h2-862967-2 Oct 29 03:28:19.686205 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-c833ba9f-7834-4992-9de0-29eabb7c0bb6 req-8c55728b-8bb9-45e8-bf37-8b8cd5bf46aa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.327587 Oct 29 03:28:19.687937 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3158/6092] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:28:19.851772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7ffc3ec8-9ef8-4484-8a5a-5141e37352ee tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:19.859920 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7ffc3ec8-9ef8-4484-8a5a-5141e37352ee tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26" status: 200 len: 1688 microversion: 2.1 time: 0.249063 Oct 29 03:28:19.877068 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2935/6093] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:19 2022] GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 => generated 1688 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:20.889013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-194eb74e-217a-4b19-98cd-853ff6cca081 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:20.890616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-194eb74e-217a-4b19-98cd-853ff6cca081 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:20.908156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-194eb74e-217a-4b19-98cd-853ff6cca081 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:20.908836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-194eb74e-217a-4b19-98cd-853ff6cca081 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:20.909236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-194eb74e-217a-4b19-98cd-853ff6cca081 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:20.909957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-194eb74e-217a-4b19-98cd-853ff6cca081 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:20.910820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-194eb74e-217a-4b19-98cd-853ff6cca081 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:20.911302 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-194eb74e-217a-4b19-98cd-853ff6cca081 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:21.213923 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-194eb74e-217a-4b19-98cd-853ff6cca081 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:21.229112 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-194eb74e-217a-4b19-98cd-853ff6cca081 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26" status: 200 len: 1688 microversion: 2.1 time: 0.345352 Oct 29 03:28:21.240743 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3159/6094] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:20 2022] GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 => generated 1688 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:21.705660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-fa2539ba-85ec-4906-82f7-4390bcdeadbe req-fa40297b-5001-4ad5-b017-dcbf14455750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "892f3002-c947-42fb-84c6-c1e401492d26", "name": "network-vif-deleted", "tag": "bc07623e-95e8-4f84-a6ac-5c3505851ea7"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:28:21.718723 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-fa2539ba-85ec-4906-82f7-4390bcdeadbe req-fa40297b-5001-4ad5-b017-dcbf14455750 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:21.719878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-fa2539ba-85ec-4906-82f7-4390bcdeadbe req-fa40297b-5001-4ad5-b017-dcbf14455750 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:21.719878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-fa2539ba-85ec-4906-82f7-4390bcdeadbe req-fa40297b-5001-4ad5-b017-dcbf14455750 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:21.723687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-14e413a5-6b59-4154-b28a-121c46c5c020 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:21.724307 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-14e413a5-6b59-4154-b28a-121c46c5c020 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: e504409e-fee0-4d16-abf8-c7190e74bb2e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:21.730814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14e413a5-6b59-4154-b28a-121c46c5c020 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:21.731420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14e413a5-6b59-4154-b28a-121c46c5c020 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:21.731937 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14e413a5-6b59-4154-b28a-121c46c5c020 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:21.732823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14e413a5-6b59-4154-b28a-121c46c5c020 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:21.733363 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14e413a5-6b59-4154-b28a-121c46c5c020 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:21.733862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14e413a5-6b59-4154-b28a-121c46c5c020 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:21.735953 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-fa2539ba-85ec-4906-82f7-4390bcdeadbe req-fa40297b-5001-4ad5-b017-dcbf14455750 service nova] Creating event network-vif-deleted:bc07623e-95e8-4f84-a6ac-5c3505851ea7 for instance 892f3002-c947-42fb-84c6-c1e401492d26 on n-h2-862967-2 Oct 29 03:28:21.741830 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-fa2539ba-85ec-4906-82f7-4390bcdeadbe req-fa40297b-5001-4ad5-b017-dcbf14455750 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042060 Oct 29 03:28:21.747793 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2936/6095] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:28:21.761931 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-14e413a5-6b59-4154-b28a-121c46c5c020 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: e504409e-fee0-4d16-abf8-c7190e74bb2e] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:28:21.849601 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-14e413a5-6b59-4154-b28a-121c46c5c020 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e" status: 204 len: 0 microversion: 2.1 time: 0.129654 Oct 29 03:28:21.850343 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3160/6096] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:28:21 2022] DELETE /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:28:21.860183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a06ef5c7-7914-4445-9d09-592d8dc701b2 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:21.861080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a06ef5c7-7914-4445-9d09-592d8dc701b2 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: e504409e-fee0-4d16-abf8-c7190e74bb2e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:21.868110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a06ef5c7-7914-4445-9d09-592d8dc701b2 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:21.868660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a06ef5c7-7914-4445-9d09-592d8dc701b2 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:21.869199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a06ef5c7-7914-4445-9d09-592d8dc701b2 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:21.869977 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a06ef5c7-7914-4445-9d09-592d8dc701b2 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:21.870432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a06ef5c7-7914-4445-9d09-592d8dc701b2 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:21.870856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a06ef5c7-7914-4445-9d09-592d8dc701b2 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:22.023232 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a06ef5c7-7914-4445-9d09-592d8dc701b2 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c633d65d3754c0bb47a7cb8754a97cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e202cdaad65452fa00963abd83004b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:22.032356 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a06ef5c7-7914-4445-9d09-592d8dc701b2 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "GET /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e" status: 200 len: 1513 microversion: 2.1 time: 0.176089 Oct 29 03:28:22.033452 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2937/6097] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:21 2022] GET /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e => generated 1513 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:22.258026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-061b7a50-0cf9-4704-afbb-3a2de599fedc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:22.259262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-061b7a50-0cf9-4704-afbb-3a2de599fedc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:22.265885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-061b7a50-0cf9-4704-afbb-3a2de599fedc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:22.266401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-061b7a50-0cf9-4704-afbb-3a2de599fedc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:22.266838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-061b7a50-0cf9-4704-afbb-3a2de599fedc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:22.267668 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-061b7a50-0cf9-4704-afbb-3a2de599fedc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:22.268120 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-061b7a50-0cf9-4704-afbb-3a2de599fedc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:22.268552 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-061b7a50-0cf9-4704-afbb-3a2de599fedc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:22.308296 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-061b7a50-0cf9-4704-afbb-3a2de599fedc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:22.308834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-061b7a50-0cf9-4704-afbb-3a2de599fedc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:22.309280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-061b7a50-0cf9-4704-afbb-3a2de599fedc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:22.309748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-061b7a50-0cf9-4704-afbb-3a2de599fedc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lazy-loading 'fault' on Instance uuid 892f3002-c947-42fb-84c6-c1e401492d26 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:28:22.354709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-061b7a50-0cf9-4704-afbb-3a2de599fedc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '789295d938084ee3b7d618690fee5bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c898299eb0444aa1a1983fb127153c65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:22.362662 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-061b7a50-0cf9-4704-afbb-3a2de599fedc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26" status: 200 len: 1356 microversion: 2.1 time: 0.109173 Oct 29 03:28:22.363243 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3161/6098] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:22 2022] GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 => generated 1356 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:23.056372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a6476cb0-38d8-4b13-9482-d7497cf03076 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:23.057652 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a6476cb0-38d8-4b13-9482-d7497cf03076 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: e504409e-fee0-4d16-abf8-c7190e74bb2e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:23.065741 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6476cb0-38d8-4b13-9482-d7497cf03076 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:23.066062 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6476cb0-38d8-4b13-9482-d7497cf03076 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:23.066660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6476cb0-38d8-4b13-9482-d7497cf03076 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:23.067516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6476cb0-38d8-4b13-9482-d7497cf03076 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:23.068028 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6476cb0-38d8-4b13-9482-d7497cf03076 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:23.068538 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6476cb0-38d8-4b13-9482-d7497cf03076 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:23.210989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a6476cb0-38d8-4b13-9482-d7497cf03076 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c633d65d3754c0bb47a7cb8754a97cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e202cdaad65452fa00963abd83004b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:23.220100 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a6476cb0-38d8-4b13-9482-d7497cf03076 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "GET /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e" status: 200 len: 1513 microversion: 2.1 time: 0.167321 Oct 29 03:28:23.220230 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2938/6099] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:23 2022] GET /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:23.387960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b85381a2-9c7e-40c2-bbdc-74397fef7369 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:23.388621 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b85381a2-9c7e-40c2-bbdc-74397fef7369 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] [instance: 892f3002-c947-42fb-84c6-c1e401492d26] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:23.397120 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b85381a2-9c7e-40c2-bbdc-74397fef7369 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:23.398128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b85381a2-9c7e-40c2-bbdc-74397fef7369 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:23.398953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b85381a2-9c7e-40c2-bbdc-74397fef7369 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:23.399911 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b85381a2-9c7e-40c2-bbdc-74397fef7369 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:23.400575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b85381a2-9c7e-40c2-bbdc-74397fef7369 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:23.401268 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b85381a2-9c7e-40c2-bbdc-74397fef7369 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:23.418813 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-b85381a2-9c7e-40c2-bbdc-74397fef7369 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] HTTP exception thrown: Instance 892f3002-c947-42fb-84c6-c1e401492d26 could not be found. Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b85381a2-9c7e-40c2-bbdc-74397fef7369 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Request method failure captured: Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 HTTP/1.1 Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJvFDgv39YEHxHfIGPphS_gbBVnKLoR2NMVFu2W7_hYkDRDJ01RHk3ODd2efOl__KQE-71QHOfy9i5K9cE39s3-f5uUaGST3mGa6UP6ZiaoXfrXgr9ANswBW4fhoyYxt5VjIwP2IaqtzixgmpqXZparOwp6ERMwaDHZ09cH_NGeZj5o Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: c898299eb0444aa1a1983fb127153c65 Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1800856932 Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c898299eb0444aa1a1983fb127153c65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c898299eb0444aa1a1983fb127153c65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c898299eb0444aa1a1983fb127153c65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c898299eb0444aa1a1983fb127153c65"}]}] Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1800856932 Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: c898299eb0444aa1a1983fb127153c65 Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1800856932 Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-TestNetworkAdvancedServerOps-1800856932-project Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 789295d938084ee3b7d618690fee5bfa Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1800856932-project Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 892f3002-c947-42fb-84c6-c1e401492d26 could not be found. Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '892f3002-c947-42fb-84c6-c1e401492d26'} Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 892f3002-c947-42fb-84c6-c1e401492d26 could not be found. Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 892f3002-c947-42fb-84c6-c1e401492d26 could not be found. Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:28:23.420635 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:28:23.425174 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:28:23.425174 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:28:23.425174 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:28:23.425174 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:28:23.425174 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:28:23.425174 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:28:23.425174 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 892f3002-c947-42fb-84c6-c1e401492d26 could not be found. Oct 29 03:28:23.425174 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:28:23.425174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b85381a2-9c7e-40c2-bbdc-74397fef7369 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Returning 404 to user: Instance 892f3002-c947-42fb-84c6-c1e401492d26 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:28:23.425174 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b85381a2-9c7e-40c2-bbdc-74397fef7369 tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26" status: 404 len: 111 microversion: 2.1 time: 0.038613 Oct 29 03:28:23.426456 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3162/6100] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:23 2022] GET /compute/v2.1/servers/892f3002-c947-42fb-84c6-c1e401492d26 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:28:24.127483 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-7fb28d14-94b9-4d52-9fec-9ddf104ded16 req-3e82315a-2c05-43e7-b822-683aca532c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e504409e-fee0-4d16-abf8-c7190e74bb2e", "name": "network-vif-deleted", "tag": "be8f70dd-5c0e-4835-9e35-b1f65a98f08a"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:28:24.142309 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7fb28d14-94b9-4d52-9fec-9ddf104ded16 req-3e82315a-2c05-43e7-b822-683aca532c4a service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:24.147826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7fb28d14-94b9-4d52-9fec-9ddf104ded16 req-3e82315a-2c05-43e7-b822-683aca532c4a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:24.148393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7fb28d14-94b9-4d52-9fec-9ddf104ded16 req-3e82315a-2c05-43e7-b822-683aca532c4a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:24.167126 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-7fb28d14-94b9-4d52-9fec-9ddf104ded16 req-3e82315a-2c05-43e7-b822-683aca532c4a service nova] Creating event network-vif-deleted:be8f70dd-5c0e-4835-9e35-b1f65a98f08a for instance e504409e-fee0-4d16-abf8-c7190e74bb2e on n-h2-862967-2 Oct 29 03:28:24.172262 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-7fb28d14-94b9-4d52-9fec-9ddf104ded16 req-3e82315a-2c05-43e7-b822-683aca532c4a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049591 Oct 29 03:28:24.172926 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2939/6101] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:28:24.243837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4f4d83a4-772d-4b3b-9a0e-63b0ec11bb83 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:24.244568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4f4d83a4-772d-4b3b-9a0e-63b0ec11bb83 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: e504409e-fee0-4d16-abf8-c7190e74bb2e] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:24.252889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f4d83a4-772d-4b3b-9a0e-63b0ec11bb83 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:24.253691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f4d83a4-772d-4b3b-9a0e-63b0ec11bb83 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:24.254125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f4d83a4-772d-4b3b-9a0e-63b0ec11bb83 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:24.254826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f4d83a4-772d-4b3b-9a0e-63b0ec11bb83 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:24.255270 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f4d83a4-772d-4b3b-9a0e-63b0ec11bb83 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:24.255889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f4d83a4-772d-4b3b-9a0e-63b0ec11bb83 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:24.305446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f4d83a4-772d-4b3b-9a0e-63b0ec11bb83 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:24.305932 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f4d83a4-772d-4b3b-9a0e-63b0ec11bb83 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:24.306582 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f4d83a4-772d-4b3b-9a0e-63b0ec11bb83 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:24.307195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-4f4d83a4-772d-4b3b-9a0e-63b0ec11bb83 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lazy-loading 'fault' on Instance uuid e504409e-fee0-4d16-abf8-c7190e74bb2e {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:28:24.364100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4f4d83a4-772d-4b3b-9a0e-63b0ec11bb83 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c633d65d3754c0bb47a7cb8754a97cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e202cdaad65452fa00963abd83004b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:24.373322 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4f4d83a4-772d-4b3b-9a0e-63b0ec11bb83 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "GET /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e" status: 200 len: 1308 microversion: 2.1 time: 0.133702 Oct 29 03:28:24.374474 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3163/6102] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:24 2022] GET /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e => generated 1308 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:25.400406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6a34cfb5-f5b8-4af1-a5ee-f7dcee819722 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:25.401138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6a34cfb5-f5b8-4af1-a5ee-f7dcee819722 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] [instance: e504409e-fee0-4d16-abf8-c7190e74bb2e] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:25.414157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a34cfb5-f5b8-4af1-a5ee-f7dcee819722 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:25.416566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a34cfb5-f5b8-4af1-a5ee-f7dcee819722 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:25.417194 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a34cfb5-f5b8-4af1-a5ee-f7dcee819722 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:25.418181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a34cfb5-f5b8-4af1-a5ee-f7dcee819722 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:25.420022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a34cfb5-f5b8-4af1-a5ee-f7dcee819722 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:25.420422 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6a34cfb5-f5b8-4af1-a5ee-f7dcee819722 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:25.441604 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-6a34cfb5-f5b8-4af1-a5ee-f7dcee819722 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] HTTP exception thrown: Instance e504409e-fee0-4d16-abf8-c7190e74bb2e could not be found. Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6a34cfb5-f5b8-4af1-a5ee-f7dcee819722 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Request method failure captured: Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e HTTP/1.1 Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJ0YdtPHy1UNOHS68OFudueMG8qwATSpEX796GFr6RtLN3qwTf8tbUmi7TI92d4w8mCxC-3-BdnSBF0ve_cYv-bciTlvllMfCAUmk6dRTi25ERuVG89N8bJJISyQhn9VpwS-bSL_uIXZmKpViVWMRv_5wRYLBfzVKSClQA0eHhu2KIU Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 6e202cdaad65452fa00963abd83004b9 Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1569231830 Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6e202cdaad65452fa00963abd83004b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6e202cdaad65452fa00963abd83004b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6e202cdaad65452fa00963abd83004b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6e202cdaad65452fa00963abd83004b9"}]}] Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-VolumesSnapshotTestJSON-1569231830 Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 6e202cdaad65452fa00963abd83004b9 Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1569231830 Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-VolumesSnapshotTestJSON-1569231830-project Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 9c633d65d3754c0bb47a7cb8754a97cd Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-VolumesSnapshotTestJSON-1569231830-project Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance e504409e-fee0-4d16-abf8-c7190e74bb2e could not be found. Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'e504409e-fee0-4d16-abf8-c7190e74bb2e'} Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e504409e-fee0-4d16-abf8-c7190e74bb2e could not be found. Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e504409e-fee0-4d16-abf8-c7190e74bb2e could not be found. Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:28:25.443779 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:28:25.448653 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:28:25.448653 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:28:25.448653 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:28:25.448653 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:28:25.448653 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:28:25.448653 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e504409e-fee0-4d16-abf8-c7190e74bb2e could not be found. Oct 29 03:28:25.448653 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:28:25.450036 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6a34cfb5-f5b8-4af1-a5ee-f7dcee819722 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] Returning 404 to user: Instance e504409e-fee0-4d16-abf8-c7190e74bb2e could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:28:25.451401 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6a34cfb5-f5b8-4af1-a5ee-f7dcee819722 tempest-VolumesSnapshotTestJSON-1569231830 tempest-VolumesSnapshotTestJSON-1569231830-project] 10.222.0.46 "GET /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e" status: 404 len: 111 microversion: 2.1 time: 0.055966 Oct 29 03:28:25.452557 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2940/6103] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:25 2022] GET /compute/v2.1/servers/e504409e-fee0-4d16-abf8-c7190e74bb2e => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:28:27.757549 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cb313c75-3950-4a75-8993-74e988d01efc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] Calling method '.version_select at 0x7ff053411dc0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:27.773687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:27.787056 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cb313c75-3950-4a75-8993-74e988d01efc tempest-TestNetworkAdvancedServerOps-1800856932 tempest-TestNetworkAdvancedServerOps-1800856932-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-992895734" status: 202 len: 0 microversion: 2.1 time: 0.035517 Oct 29 03:28:27.794094 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3164/6104] 10.222.0.46 () {58 vars in 1281 bytes} [Sat Oct 29 03:28:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-992895734 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:28:33.000282 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a8b5f502-2c44-4653-9b15-316fb3b17e3c tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-710409843", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "73f4b8c4-a1d4-4447-ba74-a791591c0c1e"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:28:33.067201 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-a8b5f502-2c44-4653-9b15-316fb3b17e3c tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] validate_networks() for [('73f4b8c4-a1d4-4447-ba74-a791591c0c1e', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:28:33.470306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-a8b5f502-2c44-4653-9b15-316fb3b17e3c tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:28:33.472030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-a8b5f502-2c44-4653-9b15-316fb3b17e3c tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:28:33.473157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-a8b5f502-2c44-4653-9b15-316fb3b17e3c tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:28:33.473752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-a8b5f502-2c44-4653-9b15-316fb3b17e3c tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:28:33.474453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-a8b5f502-2c44-4653-9b15-316fb3b17e3c tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:28:33.487255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8b5f502-2c44-4653-9b15-316fb3b17e3c tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:33.487766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8b5f502-2c44-4653-9b15-316fb3b17e3c tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:33.488195 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8b5f502-2c44-4653-9b15-316fb3b17e3c tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:33.488938 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8b5f502-2c44-4653-9b15-316fb3b17e3c tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:33.489386 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8b5f502-2c44-4653-9b15-316fb3b17e3c tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:33.489801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8b5f502-2c44-4653-9b15-316fb3b17e3c tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:33.508210 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-a8b5f502-2c44-4653-9b15-316fb3b17e3c tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Getting quotas for project 86a4ae172ddf46479fead98bb089ed5e. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:28:33.514010 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-a8b5f502-2c44-4653-9b15-316fb3b17e3c tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Getting quotas for user 58b90eff633049058d022e89b16b56d6 and project 86a4ae172ddf46479fead98bb089ed5e. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:28:33.527756 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a8b5f502-2c44-4653-9b15-316fb3b17e3c tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:28:33.530165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a8b5f502-2c44-4653-9b15-316fb3b17e3c tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:28:33.582781 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a8b5f502-2c44-4653-9b15-316fb3b17e3c tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.896049 Oct 29 03:28:33.591631 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2941/6105] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:28:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:28:33.597007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1f2f4a69-9bcd-45c7-89d6-a84dc9f78c66 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:33.597641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1f2f4a69-9bcd-45c7-89d6-a84dc9f78c66 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:33.668652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1f2f4a69-9bcd-45c7-89d6-a84dc9f78c66 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b90eff633049058d022e89b16b56d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4ae172ddf46479fead98bb089ed5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:33.677812 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1f2f4a69-9bcd-45c7-89d6-a84dc9f78c66 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003" status: 200 len: 1214 microversion: 2.1 time: 0.085721 Oct 29 03:28:33.679033 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3165/6106] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:33 2022] GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:34.705063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f116d36d-243a-4027-80c1-f330421a536f tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:34.706317 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f116d36d-243a-4027-80c1-f330421a536f tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:34.714279 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f116d36d-243a-4027-80c1-f330421a536f tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:34.714976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f116d36d-243a-4027-80c1-f330421a536f tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:34.715582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f116d36d-243a-4027-80c1-f330421a536f tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:34.716453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f116d36d-243a-4027-80c1-f330421a536f tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:34.717123 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f116d36d-243a-4027-80c1-f330421a536f tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:34.717700 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f116d36d-243a-4027-80c1-f330421a536f tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:34.856064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f116d36d-243a-4027-80c1-f330421a536f tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b90eff633049058d022e89b16b56d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4ae172ddf46479fead98bb089ed5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:34.869759 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f116d36d-243a-4027-80c1-f330421a536f tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003" status: 200 len: 1274 microversion: 2.1 time: 0.170660 Oct 29 03:28:34.876936 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2942/6107] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:34 2022] GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003 => generated 1274 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:35.900660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f0817cae-fef5-4990-9871-d789e3da4b90 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:35.901971 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f0817cae-fef5-4990-9871-d789e3da4b90 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:35.911509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:35.914207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0817cae-fef5-4990-9871-d789e3da4b90 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:35.914991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0817cae-fef5-4990-9871-d789e3da4b90 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:35.915782 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0817cae-fef5-4990-9871-d789e3da4b90 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:35.916880 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0817cae-fef5-4990-9871-d789e3da4b90 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:35.917525 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0817cae-fef5-4990-9871-d789e3da4b90 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:35.918115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0817cae-fef5-4990-9871-d789e3da4b90 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:36.170489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f0817cae-fef5-4990-9871-d789e3da4b90 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b90eff633049058d022e89b16b56d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4ae172ddf46479fead98bb089ed5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:36.178691 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f0817cae-fef5-4990-9871-d789e3da4b90 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003" status: 200 len: 1314 microversion: 2.1 time: 0.282310 Oct 29 03:28:36.179285 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3166/6108] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:35 2022] GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:36.966223 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-30eb53fd-53da-4bf5-8e34-7b8267bc285d req-13aba3a5-61fd-4d74-91c6-97cc663e68c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "758962f5-9e7e-4f17-8658-4900a306e003", "tag": "703fc5d6-1b65-4872-a158-5afbe6b672e1"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:28:36.994431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-30eb53fd-53da-4bf5-8e34-7b8267bc285d req-13aba3a5-61fd-4d74-91c6-97cc663e68c1 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:36.995374 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-30eb53fd-53da-4bf5-8e34-7b8267bc285d req-13aba3a5-61fd-4d74-91c6-97cc663e68c1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:36.996253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-30eb53fd-53da-4bf5-8e34-7b8267bc285d req-13aba3a5-61fd-4d74-91c6-97cc663e68c1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:37.032375 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-30eb53fd-53da-4bf5-8e34-7b8267bc285d req-13aba3a5-61fd-4d74-91c6-97cc663e68c1 service nova] Creating event network-changed:703fc5d6-1b65-4872-a158-5afbe6b672e1 for instance 758962f5-9e7e-4f17-8658-4900a306e003 on n-h2-862967-2 Oct 29 03:28:37.041301 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-30eb53fd-53da-4bf5-8e34-7b8267bc285d req-13aba3a5-61fd-4d74-91c6-97cc663e68c1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081298 Oct 29 03:28:37.042346 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2943/6109] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:28:37.207140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a2a301a3-f6b1-44a3-a30e-e4da737f193c tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:37.207886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a2a301a3-f6b1-44a3-a30e-e4da737f193c tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:37.219594 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2a301a3-f6b1-44a3-a30e-e4da737f193c tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:37.221646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2a301a3-f6b1-44a3-a30e-e4da737f193c tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:37.222150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2a301a3-f6b1-44a3-a30e-e4da737f193c tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:37.223718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2a301a3-f6b1-44a3-a30e-e4da737f193c tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:37.225330 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2a301a3-f6b1-44a3-a30e-e4da737f193c tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:37.225772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2a301a3-f6b1-44a3-a30e-e4da737f193c tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:37.579107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a2a301a3-f6b1-44a3-a30e-e4da737f193c tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b90eff633049058d022e89b16b56d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4ae172ddf46479fead98bb089ed5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:37.598985 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a2a301a3-f6b1-44a3-a30e-e4da737f193c tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003" status: 200 len: 1314 microversion: 2.1 time: 0.397762 Oct 29 03:28:37.614252 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3167/6110] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:37 2022] GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:38.626490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-789e18ca-dced-433d-8a7f-c50341cecf7d tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:38.627802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-789e18ca-dced-433d-8a7f-c50341cecf7d tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:38.635431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-789e18ca-dced-433d-8a7f-c50341cecf7d tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:38.636151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-789e18ca-dced-433d-8a7f-c50341cecf7d tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:38.636896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-789e18ca-dced-433d-8a7f-c50341cecf7d tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:38.637750 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-789e18ca-dced-433d-8a7f-c50341cecf7d tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:38.638347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-789e18ca-dced-433d-8a7f-c50341cecf7d tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:38.638933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-789e18ca-dced-433d-8a7f-c50341cecf7d tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:38.885755 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-789e18ca-dced-433d-8a7f-c50341cecf7d tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b90eff633049058d022e89b16b56d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4ae172ddf46479fead98bb089ed5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:38.895766 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-789e18ca-dced-433d-8a7f-c50341cecf7d tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003" status: 200 len: 1314 microversion: 2.1 time: 0.274446 Oct 29 03:28:38.897568 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2944/6111] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:38 2022] GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:28:39.923834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c8a692cd-9ade-412f-bf0d-46b1efc19fc8 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:39.924425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c8a692cd-9ade-412f-bf0d-46b1efc19fc8 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:39.938451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c8a692cd-9ade-412f-bf0d-46b1efc19fc8 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:39.938968 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c8a692cd-9ade-412f-bf0d-46b1efc19fc8 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:39.939425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c8a692cd-9ade-412f-bf0d-46b1efc19fc8 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:39.942525 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c8a692cd-9ade-412f-bf0d-46b1efc19fc8 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:39.943021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c8a692cd-9ade-412f-bf0d-46b1efc19fc8 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:39.943472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c8a692cd-9ade-412f-bf0d-46b1efc19fc8 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:40.211600 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c8a692cd-9ade-412f-bf0d-46b1efc19fc8 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b90eff633049058d022e89b16b56d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4ae172ddf46479fead98bb089ed5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:40.223751 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c8a692cd-9ade-412f-bf0d-46b1efc19fc8 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003" status: 200 len: 1314 microversion: 2.1 time: 0.305863 Oct 29 03:28:40.224664 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3168/6112] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:39 2022] GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:41.249663 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ee6a7fc0-d253-4338-ae77-574f22c9a588 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:41.250286 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ee6a7fc0-d253-4338-ae77-574f22c9a588 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:41.253306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:41.267542 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee6a7fc0-d253-4338-ae77-574f22c9a588 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:41.268436 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee6a7fc0-d253-4338-ae77-574f22c9a588 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:41.271868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee6a7fc0-d253-4338-ae77-574f22c9a588 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:41.272920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee6a7fc0-d253-4338-ae77-574f22c9a588 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:41.273588 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee6a7fc0-d253-4338-ae77-574f22c9a588 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:41.274013 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee6a7fc0-d253-4338-ae77-574f22c9a588 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:41.675581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ee6a7fc0-d253-4338-ae77-574f22c9a588 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b90eff633049058d022e89b16b56d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4ae172ddf46479fead98bb089ed5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:41.683652 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ee6a7fc0-d253-4338-ae77-574f22c9a588 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003" status: 200 len: 1314 microversion: 2.1 time: 0.438040 Oct 29 03:28:41.684248 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2945/6113] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:41 2022] GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003 => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:42.713094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-66074d00-4e71-435d-8aba-ebc92a166ff0 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:42.714433 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-66074d00-4e71-435d-8aba-ebc92a166ff0 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:42.734829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66074d00-4e71-435d-8aba-ebc92a166ff0 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:42.735805 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66074d00-4e71-435d-8aba-ebc92a166ff0 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:42.736562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66074d00-4e71-435d-8aba-ebc92a166ff0 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:42.737771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66074d00-4e71-435d-8aba-ebc92a166ff0 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:42.739331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66074d00-4e71-435d-8aba-ebc92a166ff0 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:42.740830 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66074d00-4e71-435d-8aba-ebc92a166ff0 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:43.167439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-66074d00-4e71-435d-8aba-ebc92a166ff0 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b90eff633049058d022e89b16b56d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4ae172ddf46479fead98bb089ed5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:43.186112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-e50d06b1-a3d4-4bbd-8a3d-95e1d1891a8e req-dd5f36ed-6ba2-4cf1-bcff-7393e7f2e994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "758962f5-9e7e-4f17-8658-4900a306e003", "name": "network-vif-plugged", "status": "completed", "tag": "703fc5d6-1b65-4872-a158-5afbe6b672e1"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:28:43.198824 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-66074d00-4e71-435d-8aba-ebc92a166ff0 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003" status: 200 len: 1314 microversion: 2.1 time: 0.487792 Oct 29 03:28:43.199542 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3169/6114] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:42 2022] GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003 => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:43.216682 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e50d06b1-a3d4-4bbd-8a3d-95e1d1891a8e req-dd5f36ed-6ba2-4cf1-bcff-7393e7f2e994 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:43.217180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e50d06b1-a3d4-4bbd-8a3d-95e1d1891a8e req-dd5f36ed-6ba2-4cf1-bcff-7393e7f2e994 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:43.219098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e50d06b1-a3d4-4bbd-8a3d-95e1d1891a8e req-dd5f36ed-6ba2-4cf1-bcff-7393e7f2e994 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:43.233782 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-e50d06b1-a3d4-4bbd-8a3d-95e1d1891a8e req-dd5f36ed-6ba2-4cf1-bcff-7393e7f2e994 service nova] Creating event network-vif-plugged:703fc5d6-1b65-4872-a158-5afbe6b672e1 for instance 758962f5-9e7e-4f17-8658-4900a306e003 on n-h2-862967-2 Oct 29 03:28:43.251801 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-e50d06b1-a3d4-4bbd-8a3d-95e1d1891a8e req-dd5f36ed-6ba2-4cf1-bcff-7393e7f2e994 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070837 Oct 29 03:28:43.253045 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2946/6115] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:28:44.222545 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-53543b48-3367-46c9-a0de-4f994b2b2b66 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:44.223977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-53543b48-3367-46c9-a0de-4f994b2b2b66 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:44.226095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:44.237761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-53543b48-3367-46c9-a0de-4f994b2b2b66 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:44.239773 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-53543b48-3367-46c9-a0de-4f994b2b2b66 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:44.242066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-53543b48-3367-46c9-a0de-4f994b2b2b66 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:44.243041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-53543b48-3367-46c9-a0de-4f994b2b2b66 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:44.245859 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-53543b48-3367-46c9-a0de-4f994b2b2b66 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:44.246487 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-53543b48-3367-46c9-a0de-4f994b2b2b66 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:44.813924 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-53543b48-3367-46c9-a0de-4f994b2b2b66 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b90eff633049058d022e89b16b56d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4ae172ddf46479fead98bb089ed5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:44.831333 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-53543b48-3367-46c9-a0de-4f994b2b2b66 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003" status: 200 len: 1314 microversion: 2.1 time: 0.612638 Oct 29 03:28:44.844621 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3170/6116] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:44 2022] GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003 => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:45.214871 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:45.216142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:45.221837 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-85cdf9f8-2ea8-4a4d-beef-1929f2c84085 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-2127779001", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "b78d13d7-30ed-4444-86f8-0e0dfca9d6dd"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1440823378", "security_groups": []}, "os:scheduler_hints": {"different_host": ["289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc"]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:28:45.291318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-85cdf9f8-2ea8-4a4d-beef-1929f2c84085 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] validate_networks() for [('b78d13d7-30ed-4444-86f8-0e0dfca9d6dd', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:28:45.867674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cc5ec70c-d400-4055-8b4b-160d588d0dad tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:45.868957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cc5ec70c-d400-4055-8b4b-160d588d0dad tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:45.879931 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc5ec70c-d400-4055-8b4b-160d588d0dad tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:45.881568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc5ec70c-d400-4055-8b4b-160d588d0dad tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:45.882282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc5ec70c-d400-4055-8b4b-160d588d0dad tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:45.884386 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc5ec70c-d400-4055-8b4b-160d588d0dad tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:45.885245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc5ec70c-d400-4055-8b4b-160d588d0dad tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:45.885964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc5ec70c-d400-4055-8b4b-160d588d0dad tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:45.906321 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-85cdf9f8-2ea8-4a4d-beef-1929f2c84085 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:28:45.906760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-85cdf9f8-2ea8-4a4d-beef-1929f2c84085 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:28:45.907232 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-85cdf9f8-2ea8-4a4d-beef-1929f2c84085 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:28:45.907640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-85cdf9f8-2ea8-4a4d-beef-1929f2c84085 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:28:45.908762 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-85cdf9f8-2ea8-4a4d-beef-1929f2c84085 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:28:45.925571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85cdf9f8-2ea8-4a4d-beef-1929f2c84085 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:45.926076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85cdf9f8-2ea8-4a4d-beef-1929f2c84085 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:45.926515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85cdf9f8-2ea8-4a4d-beef-1929f2c84085 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:45.927263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85cdf9f8-2ea8-4a4d-beef-1929f2c84085 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:45.927711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85cdf9f8-2ea8-4a4d-beef-1929f2c84085 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:45.928133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85cdf9f8-2ea8-4a4d-beef-1929f2c84085 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:45.984726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-85cdf9f8-2ea8-4a4d-beef-1929f2c84085 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Getting quotas for project 486d1a0dedc047c4bbc2a7c59a1aa457. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:28:46.000054 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-85cdf9f8-2ea8-4a4d-beef-1929f2c84085 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Getting quotas for user 590d17fe6d43469f853b2465cde0a54a and project 486d1a0dedc047c4bbc2a7c59a1aa457. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:28:46.027440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-85cdf9f8-2ea8-4a4d-beef-1929f2c84085 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:28:46.030531 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-85cdf9f8-2ea8-4a4d-beef-1929f2c84085 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 81ccba80-285b-4987-9a23-dc0fef3b9b3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:28:46.107237 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-85cdf9f8-2ea8-4a4d-beef-1929f2c84085 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.893225 Oct 29 03:28:46.108591 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2947/6117] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:28:45 2022] POST /compute/v2.1/servers => generated 361 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 03:28:46.127362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5e42fbe4-d31d-4782-9a60-024ab2b289db tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:46.141936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5e42fbe4-d31d-4782-9a60-024ab2b289db tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 81ccba80-285b-4987-9a23-dc0fef3b9b3d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:46.279477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5e42fbe4-d31d-4782-9a60-024ab2b289db tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590d17fe6d43469f853b2465cde0a54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d1a0dedc047c4bbc2a7c59a1aa457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:46.286801 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5e42fbe4-d31d-4782-9a60-024ab2b289db tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d" status: 200 len: 1242 microversion: 2.1 time: 0.169465 Oct 29 03:28:46.287412 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2948/6118] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:46 2022] GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d => generated 1242 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:46.450886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cc5ec70c-d400-4055-8b4b-160d588d0dad tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b90eff633049058d022e89b16b56d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4ae172ddf46479fead98bb089ed5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:46.475618 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cc5ec70c-d400-4055-8b4b-160d588d0dad tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003" status: 200 len: 1502 microversion: 2.1 time: 0.614979 Oct 29 03:28:46.488560 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3171/6119] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:45 2022] GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003 => generated 1502 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:46.507229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-05e6ac89-b6ad-48c9-9855-05b0f85e5032 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:46.509274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-05e6ac89-b6ad-48c9-9855-05b0f85e5032 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:46.534345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05e6ac89-b6ad-48c9-9855-05b0f85e5032 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:46.538705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05e6ac89-b6ad-48c9-9855-05b0f85e5032 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:46.539742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05e6ac89-b6ad-48c9-9855-05b0f85e5032 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:46.541046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05e6ac89-b6ad-48c9-9855-05b0f85e5032 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:46.541803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05e6ac89-b6ad-48c9-9855-05b0f85e5032 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:46.543271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05e6ac89-b6ad-48c9-9855-05b0f85e5032 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:46.928202 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-05e6ac89-b6ad-48c9-9855-05b0f85e5032 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b90eff633049058d022e89b16b56d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4ae172ddf46479fead98bb089ed5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:46.939726 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-05e6ac89-b6ad-48c9-9855-05b0f85e5032 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003" status: 200 len: 1502 microversion: 2.1 time: 0.437508 Oct 29 03:28:46.950909 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2949/6120] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:46 2022] GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003 => generated 1502 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:46.962988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b77a1d51-9148-4339-870d-1404c46d4e76 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:28:46.963868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b77a1d51-9148-4339-870d-1404c46d4e76 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:46.970850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b77a1d51-9148-4339-870d-1404c46d4e76 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:46.971342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b77a1d51-9148-4339-870d-1404c46d4e76 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:46.971781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b77a1d51-9148-4339-870d-1404c46d4e76 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:46.972492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b77a1d51-9148-4339-870d-1404c46d4e76 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:46.972973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b77a1d51-9148-4339-870d-1404c46d4e76 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:46.973399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b77a1d51-9148-4339-870d-1404c46d4e76 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:47.028172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-b77a1d51-9148-4339-870d-1404c46d4e76 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lazy-loading 'flavor' on Instance uuid 758962f5-9e7e-4f17-8658-4900a306e003 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:28:47.185955 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b77a1d51-9148-4339-870d-1404c46d4e76 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "POST /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003/action" status: 202 len: 0 microversion: 2.1 time: 0.226877 Oct 29 03:28:47.187281 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3172/6121] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:28:46 2022] POST /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:28:47.196670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-aa27407c-7f71-4be4-bb73-0dadbd732f72 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:47.197732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-aa27407c-7f71-4be4-bb73-0dadbd732f72 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:47.211220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa27407c-7f71-4be4-bb73-0dadbd732f72 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:47.214067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa27407c-7f71-4be4-bb73-0dadbd732f72 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:47.214818 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa27407c-7f71-4be4-bb73-0dadbd732f72 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:47.216583 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa27407c-7f71-4be4-bb73-0dadbd732f72 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:47.223669 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa27407c-7f71-4be4-bb73-0dadbd732f72 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:47.224851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa27407c-7f71-4be4-bb73-0dadbd732f72 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:47.314154 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2b243b82-26b6-4cdb-9918-0ac942da6857 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:47.315213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2b243b82-26b6-4cdb-9918-0ac942da6857 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 81ccba80-285b-4987-9a23-dc0fef3b9b3d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:47.329814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2b243b82-26b6-4cdb-9918-0ac942da6857 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:47.330319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2b243b82-26b6-4cdb-9918-0ac942da6857 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:47.330753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2b243b82-26b6-4cdb-9918-0ac942da6857 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:47.335168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2b243b82-26b6-4cdb-9918-0ac942da6857 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:47.336290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2b243b82-26b6-4cdb-9918-0ac942da6857 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:47.339348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2b243b82-26b6-4cdb-9918-0ac942da6857 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:47.471480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2b243b82-26b6-4cdb-9918-0ac942da6857 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590d17fe6d43469f853b2465cde0a54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d1a0dedc047c4bbc2a7c59a1aa457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:47.485328 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2b243b82-26b6-4cdb-9918-0ac942da6857 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d" status: 200 len: 1294 microversion: 2.1 time: 0.177180 Oct 29 03:28:47.504119 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3173/6122] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:47 2022] GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d => generated 1294 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:28:47.660685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-aa27407c-7f71-4be4-bb73-0dadbd732f72 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b90eff633049058d022e89b16b56d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4ae172ddf46479fead98bb089ed5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:47.676725 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-aa27407c-7f71-4be4-bb73-0dadbd732f72 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003" status: 200 len: 1510 microversion: 2.1 time: 0.484485 Oct 29 03:28:47.678953 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2950/6123] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:47 2022] GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003 => generated 1510 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:48.519589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ca69bccb-c638-485b-ad67-e29756791e48 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:48.520873 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ca69bccb-c638-485b-ad67-e29756791e48 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 81ccba80-285b-4987-9a23-dc0fef3b9b3d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:48.528149 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca69bccb-c638-485b-ad67-e29756791e48 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:48.528995 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca69bccb-c638-485b-ad67-e29756791e48 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:48.529666 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca69bccb-c638-485b-ad67-e29756791e48 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:48.530627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca69bccb-c638-485b-ad67-e29756791e48 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:48.531364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca69bccb-c638-485b-ad67-e29756791e48 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:48.532013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ca69bccb-c638-485b-ad67-e29756791e48 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:48.607401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ca69bccb-c638-485b-ad67-e29756791e48 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590d17fe6d43469f853b2465cde0a54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d1a0dedc047c4bbc2a7c59a1aa457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:48.616461 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ca69bccb-c638-485b-ad67-e29756791e48 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d" status: 200 len: 1300 microversion: 2.1 time: 0.107121 Oct 29 03:28:48.617439 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3174/6124] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:48 2022] GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d => generated 1300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:48.707634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cc2ecdc9-51f4-4e11-8b09-58d5a8df8f64 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:48.709448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cc2ecdc9-51f4-4e11-8b09-58d5a8df8f64 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:48.718794 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc2ecdc9-51f4-4e11-8b09-58d5a8df8f64 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:48.720251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc2ecdc9-51f4-4e11-8b09-58d5a8df8f64 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:48.721225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc2ecdc9-51f4-4e11-8b09-58d5a8df8f64 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:48.722195 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc2ecdc9-51f4-4e11-8b09-58d5a8df8f64 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:48.723269 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc2ecdc9-51f4-4e11-8b09-58d5a8df8f64 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:48.724581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc2ecdc9-51f4-4e11-8b09-58d5a8df8f64 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:49.015104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cc2ecdc9-51f4-4e11-8b09-58d5a8df8f64 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b90eff633049058d022e89b16b56d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4ae172ddf46479fead98bb089ed5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:49.024885 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cc2ecdc9-51f4-4e11-8b09-58d5a8df8f64 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003" status: 200 len: 1493 microversion: 2.1 time: 0.324146 Oct 29 03:28:49.026522 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2951/6125] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:48 2022] GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003 => generated 1493 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:49.052147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-02749ca3-f81a-442f-b807-dc4a5767c2b6 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:28:49.052776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-02749ca3-f81a-442f-b807-dc4a5767c2b6 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:49.068134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02749ca3-f81a-442f-b807-dc4a5767c2b6 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:49.081132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02749ca3-f81a-442f-b807-dc4a5767c2b6 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:49.082160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02749ca3-f81a-442f-b807-dc4a5767c2b6 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:49.083065 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02749ca3-f81a-442f-b807-dc4a5767c2b6 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:49.084239 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02749ca3-f81a-442f-b807-dc4a5767c2b6 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:49.085238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02749ca3-f81a-442f-b807-dc4a5767c2b6 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:49.178120 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-02749ca3-f81a-442f-b807-dc4a5767c2b6 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "POST /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003/action" status: 202 len: 0 microversion: 2.1 time: 0.133233 Oct 29 03:28:49.178689 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3175/6126] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:28:49 2022] POST /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:28:49.186791 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4f8d5507-5f04-4474-9962-21cc1e9de444 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:49.187413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4f8d5507-5f04-4474-9962-21cc1e9de444 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:49.194996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f8d5507-5f04-4474-9962-21cc1e9de444 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:49.195484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f8d5507-5f04-4474-9962-21cc1e9de444 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:49.195917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f8d5507-5f04-4474-9962-21cc1e9de444 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:49.196652 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f8d5507-5f04-4474-9962-21cc1e9de444 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:49.197142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f8d5507-5f04-4474-9962-21cc1e9de444 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:49.197563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f8d5507-5f04-4474-9962-21cc1e9de444 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:49.644484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-09e416fb-ed5c-40a6-9cb3-3a19887d6c6f tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:49.645906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-09e416fb-ed5c-40a6-9cb3-3a19887d6c6f tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 81ccba80-285b-4987-9a23-dc0fef3b9b3d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:49.661775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09e416fb-ed5c-40a6-9cb3-3a19887d6c6f tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:49.673557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09e416fb-ed5c-40a6-9cb3-3a19887d6c6f tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:49.674196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09e416fb-ed5c-40a6-9cb3-3a19887d6c6f tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:49.675648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4f8d5507-5f04-4474-9962-21cc1e9de444 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b90eff633049058d022e89b16b56d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4ae172ddf46479fead98bb089ed5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:49.678453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:49.680099 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09e416fb-ed5c-40a6-9cb3-3a19887d6c6f tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:49.680932 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09e416fb-ed5c-40a6-9cb3-3a19887d6c6f tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:49.682031 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-09e416fb-ed5c-40a6-9cb3-3a19887d6c6f tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:49.691231 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4f8d5507-5f04-4474-9962-21cc1e9de444 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003" status: 200 len: 1499 microversion: 2.1 time: 0.508042 Oct 29 03:28:49.693713 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2952/6127] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:49 2022] GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003 => generated 1499 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:49.927256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-09e416fb-ed5c-40a6-9cb3-3a19887d6c6f tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590d17fe6d43469f853b2465cde0a54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d1a0dedc047c4bbc2a7c59a1aa457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:49.941946 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-09e416fb-ed5c-40a6-9cb3-3a19887d6c6f tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d" status: 200 len: 1300 microversion: 2.1 time: 0.303035 Oct 29 03:28:49.942975 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3176/6128] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:49 2022] GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d => generated 1300 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:50.598975 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-2c03593f-0c37-4c73-bae8-6401e30eb95d req-ecd3dd7d-1188-4b8d-980b-28379950f7dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81ccba80-285b-4987-9a23-dc0fef3b9b3d", "tag": "0a1e2c38-37c8-497c-9ee4-23aec7d50945"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:28:50.626835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2c03593f-0c37-4c73-bae8-6401e30eb95d req-ecd3dd7d-1188-4b8d-980b-28379950f7dd service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:50.628928 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2c03593f-0c37-4c73-bae8-6401e30eb95d req-ecd3dd7d-1188-4b8d-980b-28379950f7dd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:50.631059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2c03593f-0c37-4c73-bae8-6401e30eb95d req-ecd3dd7d-1188-4b8d-980b-28379950f7dd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:50.655289 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-2c03593f-0c37-4c73-bae8-6401e30eb95d req-ecd3dd7d-1188-4b8d-980b-28379950f7dd service nova] Creating event network-changed:0a1e2c38-37c8-497c-9ee4-23aec7d50945 for instance 81ccba80-285b-4987-9a23-dc0fef3b9b3d on n-h2-862967-2 Oct 29 03:28:50.662313 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-2c03593f-0c37-4c73-bae8-6401e30eb95d req-ecd3dd7d-1188-4b8d-980b-28379950f7dd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067829 Oct 29 03:28:50.663320 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2953/6129] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:28:50.718099 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-56e2023d-03cb-4f6c-9c9a-4c5b2cbe5572 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:50.718714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-56e2023d-03cb-4f6c-9c9a-4c5b2cbe5572 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:50.733395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56e2023d-03cb-4f6c-9c9a-4c5b2cbe5572 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:50.733896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56e2023d-03cb-4f6c-9c9a-4c5b2cbe5572 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:50.734347 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56e2023d-03cb-4f6c-9c9a-4c5b2cbe5572 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:50.735074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56e2023d-03cb-4f6c-9c9a-4c5b2cbe5572 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:50.735535 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56e2023d-03cb-4f6c-9c9a-4c5b2cbe5572 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:50.735993 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56e2023d-03cb-4f6c-9c9a-4c5b2cbe5572 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:50.968757 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b6a824e1-23cd-4ba0-8190-37400e1d804f tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:50.969566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b6a824e1-23cd-4ba0-8190-37400e1d804f tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 81ccba80-285b-4987-9a23-dc0fef3b9b3d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:50.977700 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6a824e1-23cd-4ba0-8190-37400e1d804f tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:50.978638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6a824e1-23cd-4ba0-8190-37400e1d804f tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:50.979371 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6a824e1-23cd-4ba0-8190-37400e1d804f tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:50.980336 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6a824e1-23cd-4ba0-8190-37400e1d804f tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:50.981013 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6a824e1-23cd-4ba0-8190-37400e1d804f tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:50.981638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6a824e1-23cd-4ba0-8190-37400e1d804f tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:51.015184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-56e2023d-03cb-4f6c-9c9a-4c5b2cbe5572 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b90eff633049058d022e89b16b56d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4ae172ddf46479fead98bb089ed5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:51.024476 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-56e2023d-03cb-4f6c-9c9a-4c5b2cbe5572 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003" status: 200 len: 1499 microversion: 2.1 time: 0.310627 Oct 29 03:28:51.031738 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3177/6130] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:50 2022] GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003 => generated 1499 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:28:51.192825 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b6a824e1-23cd-4ba0-8190-37400e1d804f tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590d17fe6d43469f853b2465cde0a54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d1a0dedc047c4bbc2a7c59a1aa457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:51.202392 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b6a824e1-23cd-4ba0-8190-37400e1d804f tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d" status: 200 len: 1300 microversion: 2.1 time: 0.238425 Oct 29 03:28:51.203311 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2954/6131] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:50 2022] GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d => generated 1300 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:28:52.055968 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e42731ac-ac97-407d-b826-3f8742521d33 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:52.064290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e42731ac-ac97-407d-b826-3f8742521d33 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:52.078451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e42731ac-ac97-407d-b826-3f8742521d33 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:52.078948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e42731ac-ac97-407d-b826-3f8742521d33 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:52.079383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e42731ac-ac97-407d-b826-3f8742521d33 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:52.080677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e42731ac-ac97-407d-b826-3f8742521d33 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:52.081313 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e42731ac-ac97-407d-b826-3f8742521d33 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:52.082504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e42731ac-ac97-407d-b826-3f8742521d33 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:52.226092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2397f219-3c80-44bb-a106-9a31fbf7b3f6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:52.227564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2397f219-3c80-44bb-a106-9a31fbf7b3f6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 81ccba80-285b-4987-9a23-dc0fef3b9b3d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:52.239020 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2397f219-3c80-44bb-a106-9a31fbf7b3f6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:52.239516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2397f219-3c80-44bb-a106-9a31fbf7b3f6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:52.240115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2397f219-3c80-44bb-a106-9a31fbf7b3f6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:52.241041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2397f219-3c80-44bb-a106-9a31fbf7b3f6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:52.241502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2397f219-3c80-44bb-a106-9a31fbf7b3f6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:52.242371 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2397f219-3c80-44bb-a106-9a31fbf7b3f6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:52.288555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e42731ac-ac97-407d-b826-3f8742521d33 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b90eff633049058d022e89b16b56d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4ae172ddf46479fead98bb089ed5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:52.300719 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e42731ac-ac97-407d-b826-3f8742521d33 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003" status: 200 len: 1502 microversion: 2.1 time: 0.249187 Oct 29 03:28:52.301963 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3178/6132] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:52 2022] GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003 => generated 1502 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:52.325929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7bf97e22-1f2e-4e56-9e2a-dfa19a213803 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:28:52.327072 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7bf97e22-1f2e-4e56-9e2a-dfa19a213803 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:52.336195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7bf97e22-1f2e-4e56-9e2a-dfa19a213803 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:52.337055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7bf97e22-1f2e-4e56-9e2a-dfa19a213803 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:52.337855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7bf97e22-1f2e-4e56-9e2a-dfa19a213803 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:52.338792 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7bf97e22-1f2e-4e56-9e2a-dfa19a213803 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:52.339518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7bf97e22-1f2e-4e56-9e2a-dfa19a213803 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:52.340170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7bf97e22-1f2e-4e56-9e2a-dfa19a213803 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:52.370876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-7bf97e22-1f2e-4e56-9e2a-dfa19a213803 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lazy-loading 'flavor' on Instance uuid 758962f5-9e7e-4f17-8658-4900a306e003 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:28:52.375264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:52.461880 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2397f219-3c80-44bb-a106-9a31fbf7b3f6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590d17fe6d43469f853b2465cde0a54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d1a0dedc047c4bbc2a7c59a1aa457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:52.474662 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7bf97e22-1f2e-4e56-9e2a-dfa19a213803 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "POST /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003/action" status: 202 len: 0 microversion: 2.1 time: 0.154119 Oct 29 03:28:52.476018 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3179/6133] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:28:52 2022] POST /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:28:52.480489 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2397f219-3c80-44bb-a106-9a31fbf7b3f6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d" status: 200 len: 1300 microversion: 2.1 time: 0.257659 Oct 29 03:28:52.489758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2e110ce7-2700-4273-b92e-b8a68a180c98 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:52.490525 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2e110ce7-2700-4273-b92e-b8a68a180c98 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:52.497667 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e110ce7-2700-4273-b92e-b8a68a180c98 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:52.498500 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e110ce7-2700-4273-b92e-b8a68a180c98 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:52.499496 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e110ce7-2700-4273-b92e-b8a68a180c98 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:52.500562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e110ce7-2700-4273-b92e-b8a68a180c98 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:52.501209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e110ce7-2700-4273-b92e-b8a68a180c98 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:52.501883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e110ce7-2700-4273-b92e-b8a68a180c98 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:52.512625 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2955/6134] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:52 2022] GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d => generated 1300 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:52.664636 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2e110ce7-2700-4273-b92e-b8a68a180c98 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b90eff633049058d022e89b16b56d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4ae172ddf46479fead98bb089ed5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:52.674773 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2e110ce7-2700-4273-b92e-b8a68a180c98 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003" status: 200 len: 1510 microversion: 2.1 time: 0.190902 Oct 29 03:28:52.676069 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3180/6135] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:52 2022] GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003 => generated 1510 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:28:53.505530 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-53d9345b-f03a-4cd7-9338-eb16a397319e tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:53.506538 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-53d9345b-f03a-4cd7-9338-eb16a397319e tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 81ccba80-285b-4987-9a23-dc0fef3b9b3d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:53.514475 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53d9345b-f03a-4cd7-9338-eb16a397319e tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:53.515109 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53d9345b-f03a-4cd7-9338-eb16a397319e tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:53.515642 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53d9345b-f03a-4cd7-9338-eb16a397319e tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:53.516857 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53d9345b-f03a-4cd7-9338-eb16a397319e tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:53.517414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53d9345b-f03a-4cd7-9338-eb16a397319e tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:53.517969 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53d9345b-f03a-4cd7-9338-eb16a397319e tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:53.693777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-53d9345b-f03a-4cd7-9338-eb16a397319e tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590d17fe6d43469f853b2465cde0a54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d1a0dedc047c4bbc2a7c59a1aa457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:53.702431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-23a0d821-1d30-40b8-aecf-664a4e8b27ba tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:53.703075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-23a0d821-1d30-40b8-aecf-664a4e8b27ba tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:53.705601 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-53d9345b-f03a-4cd7-9338-eb16a397319e tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d" status: 200 len: 1300 microversion: 2.1 time: 0.204302 Oct 29 03:28:53.707216 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2956/6136] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:53 2022] GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d => generated 1300 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:53.726526 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23a0d821-1d30-40b8-aecf-664a4e8b27ba tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:53.727040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23a0d821-1d30-40b8-aecf-664a4e8b27ba tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:53.727467 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23a0d821-1d30-40b8-aecf-664a4e8b27ba tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:53.728516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23a0d821-1d30-40b8-aecf-664a4e8b27ba tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:53.728993 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23a0d821-1d30-40b8-aecf-664a4e8b27ba tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:53.729618 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23a0d821-1d30-40b8-aecf-664a4e8b27ba tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:53.961861 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-23a0d821-1d30-40b8-aecf-664a4e8b27ba tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b90eff633049058d022e89b16b56d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4ae172ddf46479fead98bb089ed5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:53.989062 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-23a0d821-1d30-40b8-aecf-664a4e8b27ba tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003" status: 200 len: 1493 microversion: 2.1 time: 0.290517 Oct 29 03:28:53.989980 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3181/6137] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:53 2022] GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003 => generated 1493 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:28:54.016234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-64844a17-e43d-42e4-bbac-720125ce9745 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:28:54.017285 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-64844a17-e43d-42e4-bbac-720125ce9745 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:54.025164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64844a17-e43d-42e4-bbac-720125ce9745 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:54.026037 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64844a17-e43d-42e4-bbac-720125ce9745 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:54.027323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64844a17-e43d-42e4-bbac-720125ce9745 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:54.028240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64844a17-e43d-42e4-bbac-720125ce9745 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:54.028940 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64844a17-e43d-42e4-bbac-720125ce9745 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:54.030041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64844a17-e43d-42e4-bbac-720125ce9745 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:54.167734 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-64844a17-e43d-42e4-bbac-720125ce9745 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "POST /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003/action" status: 202 len: 0 microversion: 2.1 time: 0.152888 Oct 29 03:28:54.169268 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2957/6138] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:28:54 2022] POST /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:28:54.177600 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8387b78b-073e-4052-b21c-44e4a2b58f09 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:54.178453 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8387b78b-073e-4052-b21c-44e4a2b58f09 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:54.188105 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8387b78b-073e-4052-b21c-44e4a2b58f09 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:54.190282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8387b78b-073e-4052-b21c-44e4a2b58f09 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:54.190894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8387b78b-073e-4052-b21c-44e4a2b58f09 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:54.191953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8387b78b-073e-4052-b21c-44e4a2b58f09 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:54.194215 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8387b78b-073e-4052-b21c-44e4a2b58f09 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:54.194820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8387b78b-073e-4052-b21c-44e4a2b58f09 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:54.479542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8387b78b-073e-4052-b21c-44e4a2b58f09 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b90eff633049058d022e89b16b56d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4ae172ddf46479fead98bb089ed5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:54.492768 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8387b78b-073e-4052-b21c-44e4a2b58f09 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003" status: 200 len: 1499 microversion: 2.1 time: 0.319215 Oct 29 03:28:54.496373 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3182/6139] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:54 2022] GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003 => generated 1499 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:54.737050 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f4fcf0ea-0e08-46d9-9ee3-8cbc59aae3c6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:54.743726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f4fcf0ea-0e08-46d9-9ee3-8cbc59aae3c6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 81ccba80-285b-4987-9a23-dc0fef3b9b3d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:54.753743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4fcf0ea-0e08-46d9-9ee3-8cbc59aae3c6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:54.754479 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4fcf0ea-0e08-46d9-9ee3-8cbc59aae3c6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:54.755063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4fcf0ea-0e08-46d9-9ee3-8cbc59aae3c6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:54.755948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4fcf0ea-0e08-46d9-9ee3-8cbc59aae3c6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:54.757374 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4fcf0ea-0e08-46d9-9ee3-8cbc59aae3c6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:54.758042 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4fcf0ea-0e08-46d9-9ee3-8cbc59aae3c6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:54.966936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f4fcf0ea-0e08-46d9-9ee3-8cbc59aae3c6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590d17fe6d43469f853b2465cde0a54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d1a0dedc047c4bbc2a7c59a1aa457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:54.982589 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f4fcf0ea-0e08-46d9-9ee3-8cbc59aae3c6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d" status: 200 len: 1300 microversion: 2.1 time: 0.251056 Oct 29 03:28:54.983897 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2958/6140] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:54 2022] GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d => generated 1300 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:55.560940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-30d85b6c-382e-458f-b7f5-e1bf26e5ee95 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:55.561753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-30d85b6c-382e-458f-b7f5-e1bf26e5ee95 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:55.574932 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30d85b6c-382e-458f-b7f5-e1bf26e5ee95 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:55.576484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30d85b6c-382e-458f-b7f5-e1bf26e5ee95 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:55.577641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30d85b6c-382e-458f-b7f5-e1bf26e5ee95 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:55.578324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30d85b6c-382e-458f-b7f5-e1bf26e5ee95 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:55.578979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30d85b6c-382e-458f-b7f5-e1bf26e5ee95 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:55.579989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-30d85b6c-382e-458f-b7f5-e1bf26e5ee95 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:55.790930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-30d85b6c-382e-458f-b7f5-e1bf26e5ee95 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b90eff633049058d022e89b16b56d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4ae172ddf46479fead98bb089ed5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:55.805365 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-30d85b6c-382e-458f-b7f5-e1bf26e5ee95 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003" status: 200 len: 1499 microversion: 2.1 time: 0.251380 Oct 29 03:28:55.806310 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3183/6141] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:55 2022] GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003 => generated 1499 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:28:56.033729 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e7718b5f-97e3-4312-b9a5-b9dcad4a51f1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:56.045238 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e7718b5f-97e3-4312-b9a5-b9dcad4a51f1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 81ccba80-285b-4987-9a23-dc0fef3b9b3d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:56.052029 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:56.066836 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7718b5f-97e3-4312-b9a5-b9dcad4a51f1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:56.067603 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7718b5f-97e3-4312-b9a5-b9dcad4a51f1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:56.068231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7718b5f-97e3-4312-b9a5-b9dcad4a51f1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:56.069260 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7718b5f-97e3-4312-b9a5-b9dcad4a51f1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:56.069877 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7718b5f-97e3-4312-b9a5-b9dcad4a51f1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:56.070638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e7718b5f-97e3-4312-b9a5-b9dcad4a51f1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:56.218493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e7718b5f-97e3-4312-b9a5-b9dcad4a51f1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590d17fe6d43469f853b2465cde0a54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d1a0dedc047c4bbc2a7c59a1aa457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:56.227300 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e7718b5f-97e3-4312-b9a5-b9dcad4a51f1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d" status: 200 len: 1300 microversion: 2.1 time: 0.220601 Oct 29 03:28:56.228393 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2959/6142] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:56 2022] GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d => generated 1300 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:56.830126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-d7a9b1d4-70c9-4241-ac92-695682d6b41b req-59d39465-adc3-48b8-b5e1-4e907ce80a36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81ccba80-285b-4987-9a23-dc0fef3b9b3d", "name": "network-vif-plugged", "status": "completed", "tag": "0a1e2c38-37c8-497c-9ee4-23aec7d50945"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:28:56.839986 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-eec4c39c-f8ca-4483-918c-6b019c7b1aac tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:56.842976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d7a9b1d4-70c9-4241-ac92-695682d6b41b req-59d39465-adc3-48b8-b5e1-4e907ce80a36 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:56.843419 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-eec4c39c-f8ca-4483-918c-6b019c7b1aac tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:56.843843 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d7a9b1d4-70c9-4241-ac92-695682d6b41b req-59d39465-adc3-48b8-b5e1-4e907ce80a36 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:56.844448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d7a9b1d4-70c9-4241-ac92-695682d6b41b req-59d39465-adc3-48b8-b5e1-4e907ce80a36 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:56.850119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=8 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:56.858102 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-d7a9b1d4-70c9-4241-ac92-695682d6b41b req-59d39465-adc3-48b8-b5e1-4e907ce80a36 service nova] Creating event network-vif-plugged:0a1e2c38-37c8-497c-9ee4-23aec7d50945 for instance 81ccba80-285b-4987-9a23-dc0fef3b9b3d on n-h2-862967-2 Oct 29 03:28:56.858601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eec4c39c-f8ca-4483-918c-6b019c7b1aac tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:56.859512 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eec4c39c-f8ca-4483-918c-6b019c7b1aac tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:56.860447 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eec4c39c-f8ca-4483-918c-6b019c7b1aac tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:56.864193 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eec4c39c-f8ca-4483-918c-6b019c7b1aac tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:56.865319 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eec4c39c-f8ca-4483-918c-6b019c7b1aac tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:56.865963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eec4c39c-f8ca-4483-918c-6b019c7b1aac tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:56.866684 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-d7a9b1d4-70c9-4241-ac92-695682d6b41b req-59d39465-adc3-48b8-b5e1-4e907ce80a36 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039935 Oct 29 03:28:56.870056 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3184/6143] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:28:57.177615 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-eec4c39c-f8ca-4483-918c-6b019c7b1aac tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b90eff633049058d022e89b16b56d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4ae172ddf46479fead98bb089ed5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:57.187839 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-eec4c39c-f8ca-4483-918c-6b019c7b1aac tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003" status: 200 len: 1502 microversion: 2.1 time: 0.357693 Oct 29 03:28:57.188445 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2960/6144] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:56 2022] GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003 => generated 1502 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:57.211345 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6d03f39e-dc17-42fa-8c5f-502bc45b2ee5 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:57.211950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6d03f39e-dc17-42fa-8c5f-502bc45b2ee5 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:57.218818 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d03f39e-dc17-42fa-8c5f-502bc45b2ee5 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:57.219612 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d03f39e-dc17-42fa-8c5f-502bc45b2ee5 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:57.220480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d03f39e-dc17-42fa-8c5f-502bc45b2ee5 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:57.221092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d03f39e-dc17-42fa-8c5f-502bc45b2ee5 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:57.221703 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d03f39e-dc17-42fa-8c5f-502bc45b2ee5 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:57.222306 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d03f39e-dc17-42fa-8c5f-502bc45b2ee5 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:57.256348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bf22f4fc-100b-4958-a8ee-a8df93cdcb06 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:57.257326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bf22f4fc-100b-4958-a8ee-a8df93cdcb06 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 81ccba80-285b-4987-9a23-dc0fef3b9b3d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:57.267098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf22f4fc-100b-4958-a8ee-a8df93cdcb06 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:57.267835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf22f4fc-100b-4958-a8ee-a8df93cdcb06 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:57.268477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf22f4fc-100b-4958-a8ee-a8df93cdcb06 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:57.269580 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf22f4fc-100b-4958-a8ee-a8df93cdcb06 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:57.270196 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf22f4fc-100b-4958-a8ee-a8df93cdcb06 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:57.270805 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf22f4fc-100b-4958-a8ee-a8df93cdcb06 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:57.296777 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6d03f39e-dc17-42fa-8c5f-502bc45b2ee5 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:28:57.413573 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bf22f4fc-100b-4958-a8ee-a8df93cdcb06 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590d17fe6d43469f853b2465cde0a54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d1a0dedc047c4bbc2a7c59a1aa457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:57.424618 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bf22f4fc-100b-4958-a8ee-a8df93cdcb06 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d" status: 200 len: 1300 microversion: 2.1 time: 0.177257 Oct 29 03:28:57.426037 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2961/6145] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:57 2022] GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d => generated 1300 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:57.443930 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6d03f39e-dc17-42fa-8c5f-502bc45b2ee5 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "DELETE /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003" status: 204 len: 0 microversion: 2.1 time: 0.236779 Oct 29 03:28:57.444636 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3185/6146] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:28:57 2022] DELETE /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:28:57.453178 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-98459460-bb42-41aa-9e4f-a36311958896 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:57.453877 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-98459460-bb42-41aa-9e4f-a36311958896 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:57.460575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98459460-bb42-41aa-9e4f-a36311958896 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:57.461152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98459460-bb42-41aa-9e4f-a36311958896 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:57.461684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98459460-bb42-41aa-9e4f-a36311958896 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:57.462565 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98459460-bb42-41aa-9e4f-a36311958896 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:57.463027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98459460-bb42-41aa-9e4f-a36311958896 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:57.463451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98459460-bb42-41aa-9e4f-a36311958896 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:57.616153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-98459460-bb42-41aa-9e4f-a36311958896 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b90eff633049058d022e89b16b56d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4ae172ddf46479fead98bb089ed5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:57.624315 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-98459460-bb42-41aa-9e4f-a36311958896 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003" status: 200 len: 1508 microversion: 2.1 time: 0.174954 Oct 29 03:28:57.636918 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2962/6147] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:57 2022] GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003 => generated 1508 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:58.454659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-968cb95d-0531-4566-9e4a-b6f3616df1ac tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:58.455690 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-968cb95d-0531-4566-9e4a-b6f3616df1ac tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 81ccba80-285b-4987-9a23-dc0fef3b9b3d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:58.470001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:58.475211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-968cb95d-0531-4566-9e4a-b6f3616df1ac tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:58.480856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-968cb95d-0531-4566-9e4a-b6f3616df1ac tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:58.481444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-968cb95d-0531-4566-9e4a-b6f3616df1ac tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:58.486104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-968cb95d-0531-4566-9e4a-b6f3616df1ac tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:58.486768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-968cb95d-0531-4566-9e4a-b6f3616df1ac tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:58.491247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-968cb95d-0531-4566-9e4a-b6f3616df1ac tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:58.617282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-968cb95d-0531-4566-9e4a-b6f3616df1ac tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590d17fe6d43469f853b2465cde0a54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d1a0dedc047c4bbc2a7c59a1aa457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:58.630772 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-968cb95d-0531-4566-9e4a-b6f3616df1ac tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d" status: 200 len: 1300 microversion: 2.1 time: 0.186277 Oct 29 03:28:58.642706 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3186/6148] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:58 2022] GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d => generated 1300 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:58.651867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d90c2e4f-3010-4b2b-afb6-015eb342f88b tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:58.651867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d90c2e4f-3010-4b2b-afb6-015eb342f88b tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:58.656310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d90c2e4f-3010-4b2b-afb6-015eb342f88b tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:58.657100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d90c2e4f-3010-4b2b-afb6-015eb342f88b tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:58.657548 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d90c2e4f-3010-4b2b-afb6-015eb342f88b tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:58.658272 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d90c2e4f-3010-4b2b-afb6-015eb342f88b tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:58.658735 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d90c2e4f-3010-4b2b-afb6-015eb342f88b tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:58.659168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d90c2e4f-3010-4b2b-afb6-015eb342f88b tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:58.912933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d90c2e4f-3010-4b2b-afb6-015eb342f88b tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b90eff633049058d022e89b16b56d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4ae172ddf46479fead98bb089ed5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:58.922008 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d90c2e4f-3010-4b2b-afb6-015eb342f88b tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003" status: 200 len: 1508 microversion: 2.1 time: 0.278180 Oct 29 03:28:58.923211 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2963/6149] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:58 2022] GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003 => generated 1508 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:59.659490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0ccfcc89-a6d8-42ed-861d-8e7693e00186 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:59.660493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0ccfcc89-a6d8-42ed-861d-8e7693e00186 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 81ccba80-285b-4987-9a23-dc0fef3b9b3d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:59.668883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ccfcc89-a6d8-42ed-861d-8e7693e00186 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:59.669581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ccfcc89-a6d8-42ed-861d-8e7693e00186 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:59.670303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ccfcc89-a6d8-42ed-861d-8e7693e00186 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:59.671201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ccfcc89-a6d8-42ed-861d-8e7693e00186 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:59.672157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ccfcc89-a6d8-42ed-861d-8e7693e00186 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:59.672781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ccfcc89-a6d8-42ed-861d-8e7693e00186 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:59.775066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0ccfcc89-a6d8-42ed-861d-8e7693e00186 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590d17fe6d43469f853b2465cde0a54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d1a0dedc047c4bbc2a7c59a1aa457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:28:59.783661 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0ccfcc89-a6d8-42ed-861d-8e7693e00186 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d" status: 200 len: 1472 microversion: 2.1 time: 0.128152 Oct 29 03:28:59.784824 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3187/6150] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:59 2022] GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d => generated 1472 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:28:59.807612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-64dd3b3b-46ff-415d-8698-b11bc98b432a tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:59.808167 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-64dd3b3b-46ff-415d-8698-b11bc98b432a tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 81ccba80-285b-4987-9a23-dc0fef3b9b3d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:59.815684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64dd3b3b-46ff-415d-8698-b11bc98b432a tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:59.816205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64dd3b3b-46ff-415d-8698-b11bc98b432a tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:59.816687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64dd3b3b-46ff-415d-8698-b11bc98b432a tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:59.817760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64dd3b3b-46ff-415d-8698-b11bc98b432a tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:59.818410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64dd3b3b-46ff-415d-8698-b11bc98b432a tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:59.818854 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-64dd3b3b-46ff-415d-8698-b11bc98b432a tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:59.949043 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8f40110f-23bf-4e74-b0ef-7421cc4c12ed tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:28:59.950106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8f40110f-23bf-4e74-b0ef-7421cc4c12ed tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:28:59.959243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8f40110f-23bf-4e74-b0ef-7421cc4c12ed tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:59.959860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8f40110f-23bf-4e74-b0ef-7421cc4c12ed tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:59.960584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8f40110f-23bf-4e74-b0ef-7421cc4c12ed tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:28:59.963130 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8f40110f-23bf-4e74-b0ef-7421cc4c12ed tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:28:59.963501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8f40110f-23bf-4e74-b0ef-7421cc4c12ed tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:28:59.964115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8f40110f-23bf-4e74-b0ef-7421cc4c12ed tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:00.125244 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-64dd3b3b-46ff-415d-8698-b11bc98b432a tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590d17fe6d43469f853b2465cde0a54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d1a0dedc047c4bbc2a7c59a1aa457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:00.157631 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-64dd3b3b-46ff-415d-8698-b11bc98b432a tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d" status: 200 len: 1472 microversion: 2.1 time: 0.354326 Oct 29 03:29:00.158253 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2964/6151] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:59 2022] GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d => generated 1472 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:00.184593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ba64967f-70f0-449c-80bd-c4e9cee7ea0c tempest-TestSecurityGroupsBasicOps-1275764971 tempest-TestSecurityGroupsBasicOps-1275764971-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:00.185507 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ba64967f-70f0-449c-80bd-c4e9cee7ea0c tempest-TestSecurityGroupsBasicOps-1275764971 tempest-TestSecurityGroupsBasicOps-1275764971-project-admin] [instance: 81ccba80-285b-4987-9a23-dc0fef3b9b3d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:00.191861 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba64967f-70f0-449c-80bd-c4e9cee7ea0c tempest-TestSecurityGroupsBasicOps-1275764971 tempest-TestSecurityGroupsBasicOps-1275764971-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:00.192626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba64967f-70f0-449c-80bd-c4e9cee7ea0c tempest-TestSecurityGroupsBasicOps-1275764971 tempest-TestSecurityGroupsBasicOps-1275764971-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:00.193223 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba64967f-70f0-449c-80bd-c4e9cee7ea0c tempest-TestSecurityGroupsBasicOps-1275764971 tempest-TestSecurityGroupsBasicOps-1275764971-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:00.194096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba64967f-70f0-449c-80bd-c4e9cee7ea0c tempest-TestSecurityGroupsBasicOps-1275764971 tempest-TestSecurityGroupsBasicOps-1275764971-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:00.194717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba64967f-70f0-449c-80bd-c4e9cee7ea0c tempest-TestSecurityGroupsBasicOps-1275764971 tempest-TestSecurityGroupsBasicOps-1275764971-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:00.195308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba64967f-70f0-449c-80bd-c4e9cee7ea0c tempest-TestSecurityGroupsBasicOps-1275764971 tempest-TestSecurityGroupsBasicOps-1275764971-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:00.298323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8f40110f-23bf-4e74-b0ef-7421cc4c12ed tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b90eff633049058d022e89b16b56d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4ae172ddf46479fead98bb089ed5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:00.327986 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8f40110f-23bf-4e74-b0ef-7421cc4c12ed tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003" status: 200 len: 1508 microversion: 2.1 time: 0.384451 Oct 29 03:29:00.335478 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3188/6152] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:28:59 2022] GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003 => generated 1508 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:00.474092 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ba64967f-70f0-449c-80bd-c4e9cee7ea0c tempest-TestSecurityGroupsBasicOps-1275764971 tempest-TestSecurityGroupsBasicOps-1275764971-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d" status: 200 len: 1623 microversion: 2.1 time: 0.293626 Oct 29 03:29:00.489350 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2965/6153] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:00 2022] GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d => generated 1623 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:00.499268 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ea160846-cbfd-49cb-baed-44663882f3f5 tempest-TestSecurityGroupsBasicOps-1275764971 tempest-TestSecurityGroupsBasicOps-1275764971-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:00.500116 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ea160846-cbfd-49cb-baed-44663882f3f5 tempest-TestSecurityGroupsBasicOps-1275764971 tempest-TestSecurityGroupsBasicOps-1275764971-project-admin] [instance: 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:00.509912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea160846-cbfd-49cb-baed-44663882f3f5 tempest-TestSecurityGroupsBasicOps-1275764971 tempest-TestSecurityGroupsBasicOps-1275764971-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:00.510780 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea160846-cbfd-49cb-baed-44663882f3f5 tempest-TestSecurityGroupsBasicOps-1275764971 tempest-TestSecurityGroupsBasicOps-1275764971-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:00.511466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea160846-cbfd-49cb-baed-44663882f3f5 tempest-TestSecurityGroupsBasicOps-1275764971 tempest-TestSecurityGroupsBasicOps-1275764971-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:00.512468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea160846-cbfd-49cb-baed-44663882f3f5 tempest-TestSecurityGroupsBasicOps-1275764971 tempest-TestSecurityGroupsBasicOps-1275764971-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:00.513942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea160846-cbfd-49cb-baed-44663882f3f5 tempest-TestSecurityGroupsBasicOps-1275764971 tempest-TestSecurityGroupsBasicOps-1275764971-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:00.514902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ea160846-cbfd-49cb-baed-44663882f3f5 tempest-TestSecurityGroupsBasicOps-1275764971 tempest-TestSecurityGroupsBasicOps-1275764971-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:00.661999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-9e8d7995-c4cd-4f61-a214-6e45643fa866 req-564fa1de-c4c4-40d5-9680-052dc361b654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "758962f5-9e7e-4f17-8658-4900a306e003", "name": "network-vif-deleted", "tag": "703fc5d6-1b65-4872-a158-5afbe6b672e1"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:29:00.675766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9e8d7995-c4cd-4f61-a214-6e45643fa866 req-564fa1de-c4c4-40d5-9680-052dc361b654 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:00.676300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9e8d7995-c4cd-4f61-a214-6e45643fa866 req-564fa1de-c4c4-40d5-9680-052dc361b654 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:00.676753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9e8d7995-c4cd-4f61-a214-6e45643fa866 req-564fa1de-c4c4-40d5-9680-052dc361b654 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:00.690859 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-9e8d7995-c4cd-4f61-a214-6e45643fa866 req-564fa1de-c4c4-40d5-9680-052dc361b654 service nova] Creating event network-vif-deleted:703fc5d6-1b65-4872-a158-5afbe6b672e1 for instance 758962f5-9e7e-4f17-8658-4900a306e003 on n-h2-862967-2 Oct 29 03:29:00.697616 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-9e8d7995-c4cd-4f61-a214-6e45643fa866 req-564fa1de-c4c4-40d5-9680-052dc361b654 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039751 Oct 29 03:29:00.698559 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2966/6154] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:29:00.879303 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ea160846-cbfd-49cb-baed-44663882f3f5 tempest-TestSecurityGroupsBasicOps-1275764971 tempest-TestSecurityGroupsBasicOps-1275764971-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc" status: 200 len: 1913 microversion: 2.1 time: 0.384892 Oct 29 03:29:00.901097 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3189/6155] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:00 2022] GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc => generated 1913 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:00.977522 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9a4a6549-2b8b-40d7-a74e-f37172207081 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:00.979688 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9a4a6549-2b8b-40d7-a74e-f37172207081 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 81ccba80-285b-4987-9a23-dc0fef3b9b3d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:00.990543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a4a6549-2b8b-40d7-a74e-f37172207081 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:00.991584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a4a6549-2b8b-40d7-a74e-f37172207081 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:00.992953 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a4a6549-2b8b-40d7-a74e-f37172207081 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:00.993991 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a4a6549-2b8b-40d7-a74e-f37172207081 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:00.994721 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a4a6549-2b8b-40d7-a74e-f37172207081 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:00.995425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a4a6549-2b8b-40d7-a74e-f37172207081 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:01.028566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9a4a6549-2b8b-40d7-a74e-f37172207081 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 81ccba80-285b-4987-9a23-dc0fef3b9b3d] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:29:01.188668 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9a4a6549-2b8b-40d7-a74e-f37172207081 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "DELETE /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d" status: 204 len: 0 microversion: 2.1 time: 0.215352 Oct 29 03:29:01.193578 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2967/6156] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:29:00 2022] DELETE /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 03:29:01.205271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-97117914-6750-4c8f-bc12-6d49430877a3 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:01.206365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-97117914-6750-4c8f-bc12-6d49430877a3 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 81ccba80-285b-4987-9a23-dc0fef3b9b3d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:01.224184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-97117914-6750-4c8f-bc12-6d49430877a3 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:01.224721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-97117914-6750-4c8f-bc12-6d49430877a3 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:01.225406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-97117914-6750-4c8f-bc12-6d49430877a3 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:01.226351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-97117914-6750-4c8f-bc12-6d49430877a3 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:01.227030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-97117914-6750-4c8f-bc12-6d49430877a3 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:01.227721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-97117914-6750-4c8f-bc12-6d49430877a3 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:01.368058 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0ed34801-fdde-4d52-be64-dcf8ffcdefc3 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:01.368983 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0ed34801-fdde-4d52-be64-dcf8ffcdefc3 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:01.381762 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ed34801-fdde-4d52-be64-dcf8ffcdefc3 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:01.393291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ed34801-fdde-4d52-be64-dcf8ffcdefc3 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:01.394491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ed34801-fdde-4d52-be64-dcf8ffcdefc3 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:01.395670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ed34801-fdde-4d52-be64-dcf8ffcdefc3 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:01.396406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ed34801-fdde-4d52-be64-dcf8ffcdefc3 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:01.397118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ed34801-fdde-4d52-be64-dcf8ffcdefc3 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:01.401315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:29:01.447410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ed34801-fdde-4d52-be64-dcf8ffcdefc3 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:01.448783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ed34801-fdde-4d52-be64-dcf8ffcdefc3 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:01.449474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0ed34801-fdde-4d52-be64-dcf8ffcdefc3 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:01.450675 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-0ed34801-fdde-4d52-be64-dcf8ffcdefc3 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lazy-loading 'fault' on Instance uuid 758962f5-9e7e-4f17-8658-4900a306e003 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:29:01.534875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0ed34801-fdde-4d52-be64-dcf8ffcdefc3 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58b90eff633049058d022e89b16b56d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86a4ae172ddf46479fead98bb089ed5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:01.554914 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0ed34801-fdde-4d52-be64-dcf8ffcdefc3 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003" status: 200 len: 1304 microversion: 2.1 time: 0.192567 Oct 29 03:29:01.556484 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2968/6157] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:01 2022] GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003 => generated 1304 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:29:01.710751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-97117914-6750-4c8f-bc12-6d49430877a3 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590d17fe6d43469f853b2465cde0a54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d1a0dedc047c4bbc2a7c59a1aa457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:01.720918 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-97117914-6750-4c8f-bc12-6d49430877a3 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d" status: 200 len: 1478 microversion: 2.1 time: 0.521452 Oct 29 03:29:01.738741 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3190/6158] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:01 2022] GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d => generated 1478 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:02.579746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d083b863-d222-4be0-a081-f0b08e75fcf7 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:02.580729 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d083b863-d222-4be0-a081-f0b08e75fcf7 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] [instance: 758962f5-9e7e-4f17-8658-4900a306e003] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:02.597773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d083b863-d222-4be0-a081-f0b08e75fcf7 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:02.598263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d083b863-d222-4be0-a081-f0b08e75fcf7 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:02.598997 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d083b863-d222-4be0-a081-f0b08e75fcf7 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:02.599904 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d083b863-d222-4be0-a081-f0b08e75fcf7 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:02.600542 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d083b863-d222-4be0-a081-f0b08e75fcf7 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:02.608283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d083b863-d222-4be0-a081-f0b08e75fcf7 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:02.650033 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-d083b863-d222-4be0-a081-f0b08e75fcf7 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] HTTP exception thrown: Instance 758962f5-9e7e-4f17-8658-4900a306e003 could not be found. Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d083b863-d222-4be0-a081-f0b08e75fcf7 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Request method failure captured: Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003 HTTP/1.1 Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJ3fdQMW45X9SimVahj40cguy2vGFvVU65L8FdiUMssSIVKY0SDPdOldJOHgI-aaM3ANCvstJDFBwdHohs75CX-WmTidJZCqWlpj1Ts9-YxnYvaak2uIKHEx8cnvmLr1I-DuJgLVmZwn5awnsCzjG7g0o3Rb50W-tbSPaw5A434MLQk Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 86a4ae172ddf46479fead98bb089ed5e Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestServerAdvancedOps-1653518616 Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/86a4ae172ddf46479fead98bb089ed5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/86a4ae172ddf46479fead98bb089ed5e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_86a4ae172ddf46479fead98bb089ed5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/86a4ae172ddf46479fead98bb089ed5e"}]}] Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestServerAdvancedOps-1653518616 Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 86a4ae172ddf46479fead98bb089ed5e Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestServerAdvancedOps-1653518616 Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestServerAdvancedOps-1653518616-project Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 58b90eff633049058d022e89b16b56d6 Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestServerAdvancedOps-1653518616-project Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 758962f5-9e7e-4f17-8658-4900a306e003 could not be found. Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '758962f5-9e7e-4f17-8658-4900a306e003'} Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 758962f5-9e7e-4f17-8658-4900a306e003 could not be found. Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 758962f5-9e7e-4f17-8658-4900a306e003 could not be found. Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:29:02.662732 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:29:02.667937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:29:02.667937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:29:02.667937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:29:02.667937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:29:02.667937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:29:02.667937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 758962f5-9e7e-4f17-8658-4900a306e003 could not be found. Oct 29 03:29:02.667937 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:29:02.669344 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d083b863-d222-4be0-a081-f0b08e75fcf7 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] Returning 404 to user: Instance 758962f5-9e7e-4f17-8658-4900a306e003 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:29:02.670398 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d083b863-d222-4be0-a081-f0b08e75fcf7 tempest-TestServerAdvancedOps-1653518616 tempest-TestServerAdvancedOps-1653518616-project] 10.222.0.46 "GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003" status: 404 len: 111 microversion: 2.1 time: 0.095516 Oct 29 03:29:02.671525 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2969/6159] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:02 2022] GET /compute/v2.1/servers/758962f5-9e7e-4f17-8658-4900a306e003 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:29:02.746524 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a36095cc-bfb9-40fb-8bbb-2ff95b647b45 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:02.748506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a36095cc-bfb9-40fb-8bbb-2ff95b647b45 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 81ccba80-285b-4987-9a23-dc0fef3b9b3d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:02.757639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a36095cc-bfb9-40fb-8bbb-2ff95b647b45 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:02.758525 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a36095cc-bfb9-40fb-8bbb-2ff95b647b45 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:02.759493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a36095cc-bfb9-40fb-8bbb-2ff95b647b45 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:02.761100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a36095cc-bfb9-40fb-8bbb-2ff95b647b45 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:02.761813 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a36095cc-bfb9-40fb-8bbb-2ff95b647b45 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:02.762336 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a36095cc-bfb9-40fb-8bbb-2ff95b647b45 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:02.939783 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a36095cc-bfb9-40fb-8bbb-2ff95b647b45 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590d17fe6d43469f853b2465cde0a54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d1a0dedc047c4bbc2a7c59a1aa457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:02.956544 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a36095cc-bfb9-40fb-8bbb-2ff95b647b45 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d" status: 200 len: 1478 microversion: 2.1 time: 0.213933 Oct 29 03:29:02.961989 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3191/6160] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:02 2022] GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d => generated 1478 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:03.478265 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-6bfacd5c-e3b4-42b0-9e5b-5a408ea34f70 req-3c3121cd-14c7-4cbe-a169-7b346b7f954c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81ccba80-285b-4987-9a23-dc0fef3b9b3d", "name": "network-vif-deleted", "tag": "0a1e2c38-37c8-497c-9ee4-23aec7d50945"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:29:03.497566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6bfacd5c-e3b4-42b0-9e5b-5a408ea34f70 req-3c3121cd-14c7-4cbe-a169-7b346b7f954c service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:03.498434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6bfacd5c-e3b4-42b0-9e5b-5a408ea34f70 req-3c3121cd-14c7-4cbe-a169-7b346b7f954c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:03.499471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6bfacd5c-e3b4-42b0-9e5b-5a408ea34f70 req-3c3121cd-14c7-4cbe-a169-7b346b7f954c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:03.544670 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-6bfacd5c-e3b4-42b0-9e5b-5a408ea34f70 req-3c3121cd-14c7-4cbe-a169-7b346b7f954c service nova] Creating event network-vif-deleted:0a1e2c38-37c8-497c-9ee4-23aec7d50945 for instance 81ccba80-285b-4987-9a23-dc0fef3b9b3d on n-h2-862967-2 Oct 29 03:29:03.557475 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-6bfacd5c-e3b4-42b0-9e5b-5a408ea34f70 req-3c3121cd-14c7-4cbe-a169-7b346b7f954c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083462 Oct 29 03:29:03.559543 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2970/6161] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:29:03.989397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-802ecc8d-7df9-49aa-a188-e5c9b14231df tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:03.991140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-802ecc8d-7df9-49aa-a188-e5c9b14231df tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 81ccba80-285b-4987-9a23-dc0fef3b9b3d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:04.008297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-802ecc8d-7df9-49aa-a188-e5c9b14231df tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:04.009147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-802ecc8d-7df9-49aa-a188-e5c9b14231df tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:04.009750 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-802ecc8d-7df9-49aa-a188-e5c9b14231df tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:04.010641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-802ecc8d-7df9-49aa-a188-e5c9b14231df tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:04.011400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-802ecc8d-7df9-49aa-a188-e5c9b14231df tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:04.013778 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-802ecc8d-7df9-49aa-a188-e5c9b14231df tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:04.091529 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-802ecc8d-7df9-49aa-a188-e5c9b14231df tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:04.092300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-802ecc8d-7df9-49aa-a188-e5c9b14231df tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:04.092929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-802ecc8d-7df9-49aa-a188-e5c9b14231df tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:04.093590 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-802ecc8d-7df9-49aa-a188-e5c9b14231df tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lazy-loading 'fault' on Instance uuid 81ccba80-285b-4987-9a23-dc0fef3b9b3d {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:29:04.162842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-802ecc8d-7df9-49aa-a188-e5c9b14231df tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590d17fe6d43469f853b2465cde0a54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d1a0dedc047c4bbc2a7c59a1aa457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:04.175153 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-802ecc8d-7df9-49aa-a188-e5c9b14231df tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d" status: 200 len: 1332 microversion: 2.1 time: 0.186533 Oct 29 03:29:04.177193 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3192/6162] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:03 2022] GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d => generated 1332 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:05.202449 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2f836ece-83bb-449f-969e-721c6bb57ba6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:05.203137 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2f836ece-83bb-449f-969e-721c6bb57ba6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 81ccba80-285b-4987-9a23-dc0fef3b9b3d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:05.214895 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f836ece-83bb-449f-969e-721c6bb57ba6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:05.215901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f836ece-83bb-449f-969e-721c6bb57ba6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:05.216714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f836ece-83bb-449f-969e-721c6bb57ba6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:05.217819 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f836ece-83bb-449f-969e-721c6bb57ba6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:05.218393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f836ece-83bb-449f-969e-721c6bb57ba6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:05.219258 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2f836ece-83bb-449f-969e-721c6bb57ba6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:05.247935 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-2f836ece-83bb-449f-969e-721c6bb57ba6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] HTTP exception thrown: Instance 81ccba80-285b-4987-9a23-dc0fef3b9b3d could not be found. Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2f836ece-83bb-449f-969e-721c6bb57ba6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Request method failure captured: Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d HTTP/1.1 Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJ2pKRi0NIfqMtgfb0aJ-IAqOdhSWnB0x0DKLdOxNidEKja6HyYi18t5zu1NNGabUgsfQjHZ02TA3cXEI1THyXnzfRi4svLcIHyRJQibGvNnhiSKYD2hrdhYbOfZa68Dwv441YiYX-6ij5NDIi672uuI9ygwHfyc1fW66x7kYg9qFQk Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 486d1a0dedc047c4bbc2a7c59a1aa457 Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-725419749 Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/486d1a0dedc047c4bbc2a7c59a1aa457"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/486d1a0dedc047c4bbc2a7c59a1aa457"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_486d1a0dedc047c4bbc2a7c59a1aa457"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/486d1a0dedc047c4bbc2a7c59a1aa457"}]}] Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestSecurityGroupsBasicOps-725419749 Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 486d1a0dedc047c4bbc2a7c59a1aa457 Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-725419749 Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestSecurityGroupsBasicOps-725419749-project Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 590d17fe6d43469f853b2465cde0a54a Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestSecurityGroupsBasicOps-725419749-project Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 81ccba80-285b-4987-9a23-dc0fef3b9b3d could not be found. Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '81ccba80-285b-4987-9a23-dc0fef3b9b3d'} Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81ccba80-285b-4987-9a23-dc0fef3b9b3d could not be found. Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81ccba80-285b-4987-9a23-dc0fef3b9b3d could not be found. Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:29:05.250744 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:29:05.255930 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:29:05.255930 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:29:05.255930 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:29:05.255930 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:29:05.255930 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:29:05.255930 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81ccba80-285b-4987-9a23-dc0fef3b9b3d could not be found. Oct 29 03:29:05.255930 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:29:05.258591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2f836ece-83bb-449f-969e-721c6bb57ba6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Returning 404 to user: Instance 81ccba80-285b-4987-9a23-dc0fef3b9b3d could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:29:05.260101 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2f836ece-83bb-449f-969e-721c6bb57ba6 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d" status: 404 len: 111 microversion: 2.1 time: 0.064044 Oct 29 03:29:05.265302 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2971/6163] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:05 2022] GET /compute/v2.1/servers/81ccba80-285b-4987-9a23-dc0fef3b9b3d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:29:12.612897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4cfc1828-5f53-4d1f-b5f5-003ff1072fd1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:12.613592 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4cfc1828-5f53-4d1f-b5f5-003ff1072fd1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:12.629003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4cfc1828-5f53-4d1f-b5f5-003ff1072fd1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:12.629886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4cfc1828-5f53-4d1f-b5f5-003ff1072fd1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:12.631983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4cfc1828-5f53-4d1f-b5f5-003ff1072fd1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:12.634961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4cfc1828-5f53-4d1f-b5f5-003ff1072fd1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:12.636614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4cfc1828-5f53-4d1f-b5f5-003ff1072fd1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:12.638615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4cfc1828-5f53-4d1f-b5f5-003ff1072fd1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:12.650396 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-9e843245-5c1f-4e7f-90ec-d5708645821c req-aae071fc-a6d0-4e18-8e84-615a41a6d12a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc", "tag": "c72ceda4-4c04-4b08-9837-18c24e623eff"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:29:12.659698 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:29:12.691127 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9e843245-5c1f-4e7f-90ec-d5708645821c req-aae071fc-a6d0-4e18-8e84-615a41a6d12a service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:12.698845 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9e843245-5c1f-4e7f-90ec-d5708645821c req-aae071fc-a6d0-4e18-8e84-615a41a6d12a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:12.699699 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9e843245-5c1f-4e7f-90ec-d5708645821c req-aae071fc-a6d0-4e18-8e84-615a41a6d12a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:12.729032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:29:12.763331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4cfc1828-5f53-4d1f-b5f5-003ff1072fd1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:29:12.767231 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-9e843245-5c1f-4e7f-90ec-d5708645821c req-aae071fc-a6d0-4e18-8e84-615a41a6d12a service nova] Creating event network-changed:c72ceda4-4c04-4b08-9837-18c24e623eff for instance 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc on n-h1-862967-2 Oct 29 03:29:12.806747 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-9e843245-5c1f-4e7f-90ec-d5708645821c req-aae071fc-a6d0-4e18-8e84-615a41a6d12a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166136 Oct 29 03:29:12.808153 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2972/6164] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:29:12.958991 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4cfc1828-5f53-4d1f-b5f5-003ff1072fd1 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "DELETE /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc" status: 204 len: 0 microversion: 2.1 time: 0.350053 Oct 29 03:29:12.959907 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3193/6165] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:29:12 2022] DELETE /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:29:12.969464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fc84f47f-d9bc-441c-8b5e-19117a933252 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:12.970802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fc84f47f-d9bc-441c-8b5e-19117a933252 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:12.978535 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc84f47f-d9bc-441c-8b5e-19117a933252 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:12.980707 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc84f47f-d9bc-441c-8b5e-19117a933252 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:12.981440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc84f47f-d9bc-441c-8b5e-19117a933252 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:12.982470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc84f47f-d9bc-441c-8b5e-19117a933252 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:12.983369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc84f47f-d9bc-441c-8b5e-19117a933252 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:12.984017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc84f47f-d9bc-441c-8b5e-19117a933252 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:13.466888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fc84f47f-d9bc-441c-8b5e-19117a933252 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590d17fe6d43469f853b2465cde0a54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d1a0dedc047c4bbc2a7c59a1aa457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:13.479380 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fc84f47f-d9bc-441c-8b5e-19117a933252 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc" status: 200 len: 1768 microversion: 2.1 time: 0.514781 Oct 29 03:29:13.491531 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2973/6166] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:12 2022] GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc => generated 1768 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:14.511563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b74afba1-7eba-44a6-931f-127b68e3a320 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:14.513320 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b74afba1-7eba-44a6-931f-127b68e3a320 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:14.528838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b74afba1-7eba-44a6-931f-127b68e3a320 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:14.529881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b74afba1-7eba-44a6-931f-127b68e3a320 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:14.530503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b74afba1-7eba-44a6-931f-127b68e3a320 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:14.532831 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b74afba1-7eba-44a6-931f-127b68e3a320 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:14.534675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b74afba1-7eba-44a6-931f-127b68e3a320 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:14.541811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b74afba1-7eba-44a6-931f-127b68e3a320 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:14.946485 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b74afba1-7eba-44a6-931f-127b68e3a320 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590d17fe6d43469f853b2465cde0a54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d1a0dedc047c4bbc2a7c59a1aa457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:14.962664 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b74afba1-7eba-44a6-931f-127b68e3a320 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc" status: 200 len: 1768 microversion: 2.1 time: 0.456229 Oct 29 03:29:14.965870 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3194/6167] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:14 2022] GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc => generated 1768 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:15.997994 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-75fedd74-e15b-4aa2-bb0b-e9d560636e10 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:16.000725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-75fedd74-e15b-4aa2-bb0b-e9d560636e10 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:16.023444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75fedd74-e15b-4aa2-bb0b-e9d560636e10 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:16.024039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75fedd74-e15b-4aa2-bb0b-e9d560636e10 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:16.024552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75fedd74-e15b-4aa2-bb0b-e9d560636e10 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:16.029622 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75fedd74-e15b-4aa2-bb0b-e9d560636e10 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:16.030288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75fedd74-e15b-4aa2-bb0b-e9d560636e10 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:16.030925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-75fedd74-e15b-4aa2-bb0b-e9d560636e10 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:16.494979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-27f40303-5545-4129-9bd5-9b93e78fba08 req-3bd09a86-7255-44f9-9311-3f3d2c8d2df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc", "name": "network-vif-deleted", "tag": "c72ceda4-4c04-4b08-9837-18c24e623eff"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:29:16.522600 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-75fedd74-e15b-4aa2-bb0b-e9d560636e10 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590d17fe6d43469f853b2465cde0a54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '486d1a0dedc047c4bbc2a7c59a1aa457', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:16.534720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-27f40303-5545-4129-9bd5-9b93e78fba08 req-3bd09a86-7255-44f9-9311-3f3d2c8d2df7 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:16.538039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-27f40303-5545-4129-9bd5-9b93e78fba08 req-3bd09a86-7255-44f9-9311-3f3d2c8d2df7 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:16.540390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-27f40303-5545-4129-9bd5-9b93e78fba08 req-3bd09a86-7255-44f9-9311-3f3d2c8d2df7 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:16.542646 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-75fedd74-e15b-4aa2-bb0b-e9d560636e10 tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc" status: 200 len: 1531 microversion: 2.1 time: 0.551171 Oct 29 03:29:16.558927 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2974/6168] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:15 2022] GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc => generated 1531 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:16.566650 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-27f40303-5545-4129-9bd5-9b93e78fba08 req-3bd09a86-7255-44f9-9311-3f3d2c8d2df7 service nova] Creating event network-vif-deleted:c72ceda4-4c04-4b08-9837-18c24e623eff for instance 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc on n-h1-862967-2 Oct 29 03:29:16.577665 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-27f40303-5545-4129-9bd5-9b93e78fba08 req-3bd09a86-7255-44f9-9311-3f3d2c8d2df7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087484 Oct 29 03:29:16.578872 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3195/6169] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 29 03:29:17.572388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-350738c5-8f25-4ebd-88a6-9f919dd155bb tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:17.573055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-350738c5-8f25-4ebd-88a6-9f919dd155bb tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] [instance: 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:17.617008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-350738c5-8f25-4ebd-88a6-9f919dd155bb tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:17.618917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-350738c5-8f25-4ebd-88a6-9f919dd155bb tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:17.619616 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-350738c5-8f25-4ebd-88a6-9f919dd155bb tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:17.627646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-350738c5-8f25-4ebd-88a6-9f919dd155bb tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:17.628412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-350738c5-8f25-4ebd-88a6-9f919dd155bb tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:17.629083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-350738c5-8f25-4ebd-88a6-9f919dd155bb tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:17.713051 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-350738c5-8f25-4ebd-88a6-9f919dd155bb tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] HTTP exception thrown: Instance 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc could not be found. Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-350738c5-8f25-4ebd-88a6-9f919dd155bb tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Request method failure captured: Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc HTTP/1.1 Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJ2pKRi0NIfqMtgfb0aJ-IAqOdhSWnB0x0DKLdOxNidEKja6HyYi18t5zu1NNGabUgsfQjHZ02TA3cXEI1THyXnzfRi4svLcIHyRJQibGvNnhiSKYD2hrdhYbOfZa68Dwv441YiYX-6ij5NDIi672uuI9ygwHfyc1fW66x7kYg9qFQk Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 486d1a0dedc047c4bbc2a7c59a1aa457 Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-725419749 Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/486d1a0dedc047c4bbc2a7c59a1aa457"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/486d1a0dedc047c4bbc2a7c59a1aa457"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_486d1a0dedc047c4bbc2a7c59a1aa457"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/486d1a0dedc047c4bbc2a7c59a1aa457"}]}] Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestSecurityGroupsBasicOps-725419749 Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 486d1a0dedc047c4bbc2a7c59a1aa457 Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-725419749 Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestSecurityGroupsBasicOps-725419749-project Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 590d17fe6d43469f853b2465cde0a54a Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestSecurityGroupsBasicOps-725419749-project Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc could not be found. Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc'} Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc could not be found. Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc could not be found. Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:29:17.726443 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:29:17.731084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:29:17.731084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:29:17.731084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:29:17.731084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:29:17.731084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:29:17.731084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc could not be found. Oct 29 03:29:17.731084 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:29:17.734834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-350738c5-8f25-4ebd-88a6-9f919dd155bb tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Returning 404 to user: Instance 289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:29:17.738258 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-350738c5-8f25-4ebd-88a6-9f919dd155bb tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc" status: 404 len: 111 microversion: 2.1 time: 0.167683 Oct 29 03:29:17.743897 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2975/6170] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:17 2022] GET /compute/v2.1/servers/289dd147-dcf5-4e7d-a6e2-cfbd0a3d47dc => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:29:28.284874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-28c12b69-6c86-47d6-8bbe-c3e68c8f30ce tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] Calling method '.version_select at 0x7ff052d5fb80>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:28.295265 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:29:28.296058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:29:28.334625 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-28c12b69-6c86-47d6-8bbe-c3e68c8f30ce tempest-TestSecurityGroupsBasicOps-725419749 tempest-TestSecurityGroupsBasicOps-725419749-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1440823378" status: 202 len: 0 microversion: 2.1 time: 0.053719 Oct 29 03:29:28.336192 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3196/6171] 10.222.0.46 () {58 vars in 1278 bytes} [Sat Oct 29 03:29:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1440823378 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:29:35.646447 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1c811094-718a-4156-8fdf-eafede6097ba tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-844761280", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "01a627a3-ced4-4524-a57c-f2a4039964e2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "99eca644-5d6e-42bc-9cf9-7cf1c8e093be"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:29:35.701046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=7 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:29:35.704120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=29 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:29:35.797191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-1c811094-718a-4156-8fdf-eafede6097ba tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] validate_networks() for [('99eca644-5d6e-42bc-9cf9-7cf1c8e093be', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:29:36.781958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-1c811094-718a-4156-8fdf-eafede6097ba tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:29:36.783211 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-1c811094-718a-4156-8fdf-eafede6097ba tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:29:36.783949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-1c811094-718a-4156-8fdf-eafede6097ba tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:29:36.784909 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-1c811094-718a-4156-8fdf-eafede6097ba tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:29:36.785727 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-1c811094-718a-4156-8fdf-eafede6097ba tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:29:36.803821 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c811094-718a-4156-8fdf-eafede6097ba tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:36.807098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c811094-718a-4156-8fdf-eafede6097ba tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:36.808251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c811094-718a-4156-8fdf-eafede6097ba tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:36.810780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c811094-718a-4156-8fdf-eafede6097ba tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:36.811561 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c811094-718a-4156-8fdf-eafede6097ba tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:36.813314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1c811094-718a-4156-8fdf-eafede6097ba tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:36.856458 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-1c811094-718a-4156-8fdf-eafede6097ba tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Getting quotas for project 7c164fcbf0df4575b66149f2298496e3. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:29:36.865633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-1c811094-718a-4156-8fdf-eafede6097ba tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Getting quotas for user 187e7d6474db4b8e813ff31fcddb4034 and project 7c164fcbf0df4575b66149f2298496e3. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:29:36.990582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1c811094-718a-4156-8fdf-eafede6097ba tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:29:36.992897 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1c811094-718a-4156-8fdf-eafede6097ba tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='01a627a3-ced4-4524-a57c-f2a4039964e2',volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:29:37.208341 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1c811094-718a-4156-8fdf-eafede6097ba tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.566729 Oct 29 03:29:37.209453 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2976/6172] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:29:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:29:37.221557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cb4b6b55-b098-41a1-afe5-e10d3ad17bd1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:37.222398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cb4b6b55-b098-41a1-afe5-e10d3ad17bd1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:37.328315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cb4b6b55-b098-41a1-afe5-e10d3ad17bd1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:37.338477 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cb4b6b55-b098-41a1-afe5-e10d3ad17bd1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8" status: 200 len: 1056 microversion: 2.1 time: 0.121904 Oct 29 03:29:37.340787 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3197/6173] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:37 2022] GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8 => generated 1056 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:38.368489 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0c3e22be-7e78-4d3a-a0e0-341ca702b2a0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:38.369236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0c3e22be-7e78-4d3a-a0e0-341ca702b2a0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:38.399737 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c3e22be-7e78-4d3a-a0e0-341ca702b2a0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:38.404389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c3e22be-7e78-4d3a-a0e0-341ca702b2a0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:38.410924 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c3e22be-7e78-4d3a-a0e0-341ca702b2a0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:38.418119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c3e22be-7e78-4d3a-a0e0-341ca702b2a0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:38.422811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c3e22be-7e78-4d3a-a0e0-341ca702b2a0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:38.423894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c3e22be-7e78-4d3a-a0e0-341ca702b2a0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:38.681800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0c3e22be-7e78-4d3a-a0e0-341ca702b2a0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:38.692844 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0c3e22be-7e78-4d3a-a0e0-341ca702b2a0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8" status: 200 len: 1154 microversion: 2.1 time: 0.330704 Oct 29 03:29:38.697244 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2977/6174] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:38 2022] GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8 => generated 1154 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:39.722881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-62f21cf9-04df-4dc8-bbca-77847e49cc19 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:39.723503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-62f21cf9-04df-4dc8-bbca-77847e49cc19 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:39.739280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-62f21cf9-04df-4dc8-bbca-77847e49cc19 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:39.739815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-62f21cf9-04df-4dc8-bbca-77847e49cc19 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:39.740259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-62f21cf9-04df-4dc8-bbca-77847e49cc19 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:39.741022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-62f21cf9-04df-4dc8-bbca-77847e49cc19 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:39.744793 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-62f21cf9-04df-4dc8-bbca-77847e49cc19 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:39.745243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-62f21cf9-04df-4dc8-bbca-77847e49cc19 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:39.876494 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-62f21cf9-04df-4dc8-bbca-77847e49cc19 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:39.890191 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-62f21cf9-04df-4dc8-bbca-77847e49cc19 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8" status: 200 len: 1172 microversion: 2.1 time: 0.171568 Oct 29 03:29:39.891778 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3198/6175] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:39 2022] GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8 => generated 1172 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:40.920145 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-831c7339-0232-4b43-ba3d-0082f86c5418 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:40.920808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-831c7339-0232-4b43-ba3d-0082f86c5418 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:40.934124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-831c7339-0232-4b43-ba3d-0082f86c5418 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:40.936199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-831c7339-0232-4b43-ba3d-0082f86c5418 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:40.940366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-831c7339-0232-4b43-ba3d-0082f86c5418 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:40.941410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-831c7339-0232-4b43-ba3d-0082f86c5418 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:40.944637 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-831c7339-0232-4b43-ba3d-0082f86c5418 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:40.946157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-831c7339-0232-4b43-ba3d-0082f86c5418 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:41.340580 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-831c7339-0232-4b43-ba3d-0082f86c5418 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:41.352899 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-831c7339-0232-4b43-ba3d-0082f86c5418 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8" status: 200 len: 1214 microversion: 2.1 time: 0.438389 Oct 29 03:29:41.358037 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2978/6176] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:40 2022] GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8 => generated 1214 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:42.388578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eafb4008-17e7-4882-94fa-59afa972504c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:42.390193 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-eafb4008-17e7-4882-94fa-59afa972504c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:42.470417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eafb4008-17e7-4882-94fa-59afa972504c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:42.470913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eafb4008-17e7-4882-94fa-59afa972504c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:42.471354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eafb4008-17e7-4882-94fa-59afa972504c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:42.472336 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eafb4008-17e7-4882-94fa-59afa972504c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:42.472820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eafb4008-17e7-4882-94fa-59afa972504c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:42.473248 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eafb4008-17e7-4882-94fa-59afa972504c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:43.043043 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-eafb4008-17e7-4882-94fa-59afa972504c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:43.062481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-85a05081-c28c-45a9-ac31-ef9d199e5897 req-74e80e28-11ad-4d9b-b149-f8485d05c43a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32825117-a6dd-4ad7-99cb-e0de03690bd8", "tag": "7ff61026-1ba5-4b9f-b116-ad1f49ce7ead"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:29:43.089164 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eafb4008-17e7-4882-94fa-59afa972504c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8" status: 200 len: 1214 microversion: 2.1 time: 0.712786 Oct 29 03:29:43.094914 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3199/6177] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:42 2022] GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8 => generated 1214 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:43.111926 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-85a05081-c28c-45a9-ac31-ef9d199e5897 req-74e80e28-11ad-4d9b-b149-f8485d05c43a service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:43.117456 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-85a05081-c28c-45a9-ac31-ef9d199e5897 req-74e80e28-11ad-4d9b-b149-f8485d05c43a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:43.120097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-85a05081-c28c-45a9-ac31-ef9d199e5897 req-74e80e28-11ad-4d9b-b149-f8485d05c43a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:43.165096 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-85a05081-c28c-45a9-ac31-ef9d199e5897 req-74e80e28-11ad-4d9b-b149-f8485d05c43a service nova] Creating event network-changed:7ff61026-1ba5-4b9f-b116-ad1f49ce7ead for instance 32825117-a6dd-4ad7-99cb-e0de03690bd8 on n-h2-862967-2 Oct 29 03:29:43.176324 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-85a05081-c28c-45a9-ac31-ef9d199e5897 req-74e80e28-11ad-4d9b-b149-f8485d05c43a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142548 Oct 29 03:29:43.178267 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2979/6178] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:29:44.119837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-03ada703-a0d4-4672-8781-dd97078c2db8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:44.120458 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-03ada703-a0d4-4672-8781-dd97078c2db8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:44.134103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03ada703-a0d4-4672-8781-dd97078c2db8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:44.138536 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03ada703-a0d4-4672-8781-dd97078c2db8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:44.139287 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03ada703-a0d4-4672-8781-dd97078c2db8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:44.142989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03ada703-a0d4-4672-8781-dd97078c2db8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:44.144257 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03ada703-a0d4-4672-8781-dd97078c2db8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:44.144959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03ada703-a0d4-4672-8781-dd97078c2db8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:45.246696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-03ada703-a0d4-4672-8781-dd97078c2db8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:45.263143 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-03ada703-a0d4-4672-8781-dd97078c2db8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8" status: 200 len: 1214 microversion: 2.1 time: 1.147446 Oct 29 03:29:45.267705 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3200/6179] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:44 2022] GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8 => generated 1214 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:46.295593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-87926829-5b0f-439c-8658-1f0e53ff247a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:46.296626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-87926829-5b0f-439c-8658-1f0e53ff247a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:46.304684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-87926829-5b0f-439c-8658-1f0e53ff247a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:46.306128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-87926829-5b0f-439c-8658-1f0e53ff247a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:46.306806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-87926829-5b0f-439c-8658-1f0e53ff247a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:46.307876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-87926829-5b0f-439c-8658-1f0e53ff247a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:46.308763 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-87926829-5b0f-439c-8658-1f0e53ff247a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:46.309421 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-87926829-5b0f-439c-8658-1f0e53ff247a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:46.758175 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-87926829-5b0f-439c-8658-1f0e53ff247a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:46.782541 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-87926829-5b0f-439c-8658-1f0e53ff247a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8" status: 200 len: 1214 microversion: 2.1 time: 0.493660 Oct 29 03:29:46.783415 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2980/6180] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:46 2022] GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8 => generated 1214 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:47.808166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e1401c3d-9131-41fb-99a7-fa6ce9967164 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:47.808918 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e1401c3d-9131-41fb-99a7-fa6ce9967164 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:47.825580 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:29:47.829714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1401c3d-9131-41fb-99a7-fa6ce9967164 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:47.830928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1401c3d-9131-41fb-99a7-fa6ce9967164 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:47.834076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1401c3d-9131-41fb-99a7-fa6ce9967164 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:47.835453 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1401c3d-9131-41fb-99a7-fa6ce9967164 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:47.837410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1401c3d-9131-41fb-99a7-fa6ce9967164 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:47.838066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1401c3d-9131-41fb-99a7-fa6ce9967164 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:48.079512 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e1401c3d-9131-41fb-99a7-fa6ce9967164 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:48.094761 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e1401c3d-9131-41fb-99a7-fa6ce9967164 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8" status: 200 len: 1214 microversion: 2.1 time: 0.290900 Oct 29 03:29:48.110205 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3201/6181] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:47 2022] GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8 => generated 1214 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:49.121315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-519a1be5-5dbd-485f-9316-2f789fdd7b59 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:49.123396 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-519a1be5-5dbd-485f-9316-2f789fdd7b59 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:49.126715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:29:49.129391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:29:49.146714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-519a1be5-5dbd-485f-9316-2f789fdd7b59 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:49.153068 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-519a1be5-5dbd-485f-9316-2f789fdd7b59 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:49.153895 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-519a1be5-5dbd-485f-9316-2f789fdd7b59 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:49.154833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-519a1be5-5dbd-485f-9316-2f789fdd7b59 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:49.155702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-519a1be5-5dbd-485f-9316-2f789fdd7b59 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:49.156291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-519a1be5-5dbd-485f-9316-2f789fdd7b59 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:49.405144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-519a1be5-5dbd-485f-9316-2f789fdd7b59 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:49.415075 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-519a1be5-5dbd-485f-9316-2f789fdd7b59 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8" status: 200 len: 1202 microversion: 2.1 time: 0.299592 Oct 29 03:29:49.422529 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2981/6182] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:49 2022] GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8 => generated 1202 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:50.445970 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-507367f9-1cf3-42fa-8e7c-14ae9c488ca2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:50.447722 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-507367f9-1cf3-42fa-8e7c-14ae9c488ca2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:50.455678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-507367f9-1cf3-42fa-8e7c-14ae9c488ca2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:50.456615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-507367f9-1cf3-42fa-8e7c-14ae9c488ca2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:50.457513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-507367f9-1cf3-42fa-8e7c-14ae9c488ca2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:50.458637 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-507367f9-1cf3-42fa-8e7c-14ae9c488ca2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:50.459345 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-507367f9-1cf3-42fa-8e7c-14ae9c488ca2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:50.460454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-507367f9-1cf3-42fa-8e7c-14ae9c488ca2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:50.974675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-507367f9-1cf3-42fa-8e7c-14ae9c488ca2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:51.019825 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-507367f9-1cf3-42fa-8e7c-14ae9c488ca2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8" status: 200 len: 1202 microversion: 2.1 time: 0.578884 Oct 29 03:29:51.020869 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3202/6183] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:50 2022] GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8 => generated 1202 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:51.995847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8db6267f-7880-4af7-b190-5e93fdba6f76 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:51.997844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8db6267f-7880-4af7-b190-5e93fdba6f76 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:51.998323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8db6267f-7880-4af7-b190-5e93fdba6f76 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:51.999915 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8db6267f-7880-4af7-b190-5e93fdba6f76 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:52.000677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8db6267f-7880-4af7-b190-5e93fdba6f76 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:52.001339 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8db6267f-7880-4af7-b190-5e93fdba6f76 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:52.001764 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8db6267f-7880-4af7-b190-5e93fdba6f76 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:52.026839 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8db6267f-7880-4af7-b190-5e93fdba6f76 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.286119 Oct 29 03:29:52.027446 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2982/6184] 10.222.0.46 () {58 vars in 1185 bytes} [Sat Oct 29 03:29:51 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:29:52.043285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a721faa1-6160-43d5-a634-e439b9fd0d6f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:52.044027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a721faa1-6160-43d5-a634-e439b9fd0d6f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:52.051657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a721faa1-6160-43d5-a634-e439b9fd0d6f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:52.052501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a721faa1-6160-43d5-a634-e439b9fd0d6f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:52.053240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a721faa1-6160-43d5-a634-e439b9fd0d6f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:52.054127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a721faa1-6160-43d5-a634-e439b9fd0d6f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:52.054598 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a721faa1-6160-43d5-a634-e439b9fd0d6f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:52.055000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a721faa1-6160-43d5-a634-e439b9fd0d6f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:52.160460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5f06f832-025f-4d9a-acc7-0180256c3bbf tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-928140711", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "availability_zone": "nova:n-h2-862967-2", "networks": [{"uuid": "117bdedd-d341-4e45-94e5-7abbc1a76960"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:29:52.229302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-5f06f832-025f-4d9a-acc7-0180256c3bbf tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] validate_networks() for [('117bdedd-d341-4e45-94e5-7abbc1a76960', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:29:52.258304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a721faa1-6160-43d5-a634-e439b9fd0d6f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:52.266613 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a721faa1-6160-43d5-a634-e439b9fd0d6f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8" status: 200 len: 1202 microversion: 2.1 time: 0.227285 Oct 29 03:29:52.267419 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3203/6185] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:52 2022] GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8 => generated 1202 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:52.737814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-5f06f832-025f-4d9a-acc7-0180256c3bbf tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:29:52.738629 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-5f06f832-025f-4d9a-acc7-0180256c3bbf tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:29:52.739230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-5f06f832-025f-4d9a-acc7-0180256c3bbf tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:29:52.740167 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-5f06f832-025f-4d9a-acc7-0180256c3bbf tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:29:52.741044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-5f06f832-025f-4d9a-acc7-0180256c3bbf tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:29:52.754536 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f06f832-025f-4d9a-acc7-0180256c3bbf tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:52.755425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f06f832-025f-4d9a-acc7-0180256c3bbf tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:52.756236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f06f832-025f-4d9a-acc7-0180256c3bbf tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:52.757410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f06f832-025f-4d9a-acc7-0180256c3bbf tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:52.758165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f06f832-025f-4d9a-acc7-0180256c3bbf tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:52.758917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f06f832-025f-4d9a-acc7-0180256c3bbf tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:52.781713 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-5f06f832-025f-4d9a-acc7-0180256c3bbf tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Getting quotas for project 0d05826be2f349f6b912822f499d4c2a. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:29:52.787634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-5f06f832-025f-4d9a-acc7-0180256c3bbf tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Getting quotas for user f4fd5d7c439049209432c51dc55bb100 and project 0d05826be2f349f6b912822f499d4c2a. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:29:52.800116 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5f06f832-025f-4d9a-acc7-0180256c3bbf tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:29:52.802681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5f06f832-025f-4d9a-acc7-0180256c3bbf tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: c36e2181-6505-40fb-85d9-fe2dc9c027e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:29:52.860126 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5f06f832-025f-4d9a-acc7-0180256c3bbf tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.703370 Oct 29 03:29:52.861613 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2983/6186] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:29:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:29:52.873555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-71cea030-595a-472d-9d0f-94eb2a408e18 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:52.874263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-71cea030-595a-472d-9d0f-94eb2a408e18 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: c36e2181-6505-40fb-85d9-fe2dc9c027e9] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:52.944416 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-71cea030-595a-472d-9d0f-94eb2a408e18 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9" status: 200 len: 1328 microversion: 2.1 time: 0.076035 Oct 29 03:29:52.945071 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3204/6187] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:52 2022] GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9 => generated 1328 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:29:53.297619 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f8a0f0cc-d018-4c87-8627-1599cdd51b94 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:53.298393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f8a0f0cc-d018-4c87-8627-1599cdd51b94 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:53.312297 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f8a0f0cc-d018-4c87-8627-1599cdd51b94 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:53.313160 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f8a0f0cc-d018-4c87-8627-1599cdd51b94 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:53.314361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f8a0f0cc-d018-4c87-8627-1599cdd51b94 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:53.316101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f8a0f0cc-d018-4c87-8627-1599cdd51b94 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:53.317062 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f8a0f0cc-d018-4c87-8627-1599cdd51b94 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:53.318092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f8a0f0cc-d018-4c87-8627-1599cdd51b94 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:53.534889 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f8a0f0cc-d018-4c87-8627-1599cdd51b94 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:53.544820 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f8a0f0cc-d018-4c87-8627-1599cdd51b94 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8" status: 200 len: 1202 microversion: 2.1 time: 0.254183 Oct 29 03:29:53.546591 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2984/6188] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:53 2022] GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8 => generated 1202 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:53.978745 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-052afd14-dd12-47a5-98b5-c1f690591b72 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:53.983101 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-052afd14-dd12-47a5-98b5-c1f690591b72 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: c36e2181-6505-40fb-85d9-fe2dc9c027e9] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:54.014028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-052afd14-dd12-47a5-98b5-c1f690591b72 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:54.018023 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-052afd14-dd12-47a5-98b5-c1f690591b72 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:54.018822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-052afd14-dd12-47a5-98b5-c1f690591b72 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:54.019881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-052afd14-dd12-47a5-98b5-c1f690591b72 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:54.020698 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-052afd14-dd12-47a5-98b5-c1f690591b72 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:54.021363 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-052afd14-dd12-47a5-98b5-c1f690591b72 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:54.138724 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-052afd14-dd12-47a5-98b5-c1f690591b72 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9" status: 200 len: 1337 microversion: 2.1 time: 0.167611 Oct 29 03:29:54.139988 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3205/6189] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:53 2022] GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9 => generated 1337 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:54.571054 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ee7d46de-4742-490e-81f3-bb0d24608089 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:54.571940 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ee7d46de-4742-490e-81f3-bb0d24608089 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:54.581671 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee7d46de-4742-490e-81f3-bb0d24608089 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:54.582870 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee7d46de-4742-490e-81f3-bb0d24608089 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:54.583601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee7d46de-4742-490e-81f3-bb0d24608089 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:54.584496 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee7d46de-4742-490e-81f3-bb0d24608089 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:54.585290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee7d46de-4742-490e-81f3-bb0d24608089 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:54.585912 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee7d46de-4742-490e-81f3-bb0d24608089 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:54.816275 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ee7d46de-4742-490e-81f3-bb0d24608089 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:54.836853 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ee7d46de-4742-490e-81f3-bb0d24608089 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8" status: 200 len: 1202 microversion: 2.1 time: 0.269229 Oct 29 03:29:54.853220 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2985/6190] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:54 2022] GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8 => generated 1202 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:55.166849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ec79b471-86bc-4fd9-806d-b2f264b734d1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:55.171482 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ec79b471-86bc-4fd9-806d-b2f264b734d1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: c36e2181-6505-40fb-85d9-fe2dc9c027e9] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:55.190035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ec79b471-86bc-4fd9-806d-b2f264b734d1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:55.190562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ec79b471-86bc-4fd9-806d-b2f264b734d1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:55.190980 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ec79b471-86bc-4fd9-806d-b2f264b734d1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:55.191693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ec79b471-86bc-4fd9-806d-b2f264b734d1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:55.192187 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ec79b471-86bc-4fd9-806d-b2f264b734d1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:55.192639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ec79b471-86bc-4fd9-806d-b2f264b734d1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:55.402286 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ec79b471-86bc-4fd9-806d-b2f264b734d1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9" status: 200 len: 1421 microversion: 2.1 time: 0.243914 Oct 29 03:29:55.406548 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3206/6191] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:55 2022] GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9 => generated 1421 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:55.859605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9745b9fb-6dc3-4525-a9b5-2e4877047497 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:55.860215 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9745b9fb-6dc3-4525-a9b5-2e4877047497 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:55.874499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9745b9fb-6dc3-4525-a9b5-2e4877047497 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:55.874992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9745b9fb-6dc3-4525-a9b5-2e4877047497 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:55.875424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9745b9fb-6dc3-4525-a9b5-2e4877047497 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:55.876132 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9745b9fb-6dc3-4525-a9b5-2e4877047497 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:55.876609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9745b9fb-6dc3-4525-a9b5-2e4877047497 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:55.877033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9745b9fb-6dc3-4525-a9b5-2e4877047497 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:56.166965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9745b9fb-6dc3-4525-a9b5-2e4877047497 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:56.178861 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9745b9fb-6dc3-4525-a9b5-2e4877047497 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8" status: 200 len: 1202 microversion: 2.1 time: 0.320769 Oct 29 03:29:56.201249 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2986/6192] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:55 2022] GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8 => generated 1202 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:56.431645 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-582f1fbf-328e-4445-97bd-80632dfb4ad0 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:56.432259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-582f1fbf-328e-4445-97bd-80632dfb4ad0 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: c36e2181-6505-40fb-85d9-fe2dc9c027e9] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:56.445896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-582f1fbf-328e-4445-97bd-80632dfb4ad0 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:56.449474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-582f1fbf-328e-4445-97bd-80632dfb4ad0 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:56.450981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-582f1fbf-328e-4445-97bd-80632dfb4ad0 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:56.451843 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-582f1fbf-328e-4445-97bd-80632dfb4ad0 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:56.452408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-582f1fbf-328e-4445-97bd-80632dfb4ad0 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:56.453652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-582f1fbf-328e-4445-97bd-80632dfb4ad0 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:56.948308 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-582f1fbf-328e-4445-97bd-80632dfb4ad0 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9" status: 200 len: 1463 microversion: 2.1 time: 0.521100 Oct 29 03:29:56.952083 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3207/6193] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:56 2022] GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9 => generated 1463 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:57.211640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-44ebe959-c9ed-48fd-8317-3fadee86d171 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:57.212259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-44ebe959-c9ed-48fd-8317-3fadee86d171 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:57.230098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44ebe959-c9ed-48fd-8317-3fadee86d171 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:57.230598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44ebe959-c9ed-48fd-8317-3fadee86d171 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:57.231038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44ebe959-c9ed-48fd-8317-3fadee86d171 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:57.231896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44ebe959-c9ed-48fd-8317-3fadee86d171 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:57.232350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44ebe959-c9ed-48fd-8317-3fadee86d171 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:57.232973 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44ebe959-c9ed-48fd-8317-3fadee86d171 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:57.392880 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-44ebe959-c9ed-48fd-8317-3fadee86d171 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:57.402837 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-44ebe959-c9ed-48fd-8317-3fadee86d171 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8" status: 200 len: 1202 microversion: 2.1 time: 0.195113 Oct 29 03:29:57.404027 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2987/6194] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:57 2022] GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8 => generated 1202 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:57.416429 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-66104154-5597-4820-8417-6efede949022 req-fd564fe2-8fc1-48b0-8443-16ee9ab2d1bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c36e2181-6505-40fb-85d9-fe2dc9c027e9", "tag": "7318e0b2-f9dc-4104-b011-8a46d1486c11"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:29:57.440728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-66104154-5597-4820-8417-6efede949022 req-fd564fe2-8fc1-48b0-8443-16ee9ab2d1bd service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:57.443670 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-66104154-5597-4820-8417-6efede949022 req-fd564fe2-8fc1-48b0-8443-16ee9ab2d1bd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:57.444340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-66104154-5597-4820-8417-6efede949022 req-fd564fe2-8fc1-48b0-8443-16ee9ab2d1bd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:57.475281 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-66104154-5597-4820-8417-6efede949022 req-fd564fe2-8fc1-48b0-8443-16ee9ab2d1bd service nova] Creating event network-changed:7318e0b2-f9dc-4104-b011-8a46d1486c11 for instance c36e2181-6505-40fb-85d9-fe2dc9c027e9 on n-h2-862967-2 Oct 29 03:29:57.481813 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-66104154-5597-4820-8417-6efede949022 req-fd564fe2-8fc1-48b0-8443-16ee9ab2d1bd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080076 Oct 29 03:29:57.482433 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3208/6195] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:29:57.981770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b79a6f63-cc0a-4767-9b46-e5feb66d7b39 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:57.982667 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b79a6f63-cc0a-4767-9b46-e5feb66d7b39 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: c36e2181-6505-40fb-85d9-fe2dc9c027e9] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:57.991054 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b79a6f63-cc0a-4767-9b46-e5feb66d7b39 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:57.991985 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b79a6f63-cc0a-4767-9b46-e5feb66d7b39 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:57.992624 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b79a6f63-cc0a-4767-9b46-e5feb66d7b39 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:57.993665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b79a6f63-cc0a-4767-9b46-e5feb66d7b39 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:57.994290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b79a6f63-cc0a-4767-9b46-e5feb66d7b39 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:57.994876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b79a6f63-cc0a-4767-9b46-e5feb66d7b39 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:58.176954 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b79a6f63-cc0a-4767-9b46-e5feb66d7b39 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9" status: 200 len: 1463 microversion: 2.1 time: 0.203315 Oct 29 03:29:58.177709 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2988/6196] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:57 2022] GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9 => generated 1463 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:58.428314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8bf654b4-1f0e-4b23-a0be-a5ece413286a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:58.429052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8bf654b4-1f0e-4b23-a0be-a5ece413286a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:58.431038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:29:58.461319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bf654b4-1f0e-4b23-a0be-a5ece413286a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:58.462582 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bf654b4-1f0e-4b23-a0be-a5ece413286a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:58.463241 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bf654b4-1f0e-4b23-a0be-a5ece413286a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:58.464357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bf654b4-1f0e-4b23-a0be-a5ece413286a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:58.465017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bf654b4-1f0e-4b23-a0be-a5ece413286a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:58.465729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bf654b4-1f0e-4b23-a0be-a5ece413286a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:58.670826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8bf654b4-1f0e-4b23-a0be-a5ece413286a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:58.683066 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8bf654b4-1f0e-4b23-a0be-a5ece413286a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8" status: 200 len: 1202 microversion: 2.1 time: 0.259101 Oct 29 03:29:58.698929 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3209/6197] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:58 2022] GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8 => generated 1202 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:29:59.201621 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ed89e356-8d79-4d4e-88db-14e1442dbd17 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:59.202250 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ed89e356-8d79-4d4e-88db-14e1442dbd17 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: c36e2181-6505-40fb-85d9-fe2dc9c027e9] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:59.212948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed89e356-8d79-4d4e-88db-14e1442dbd17 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:59.213474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed89e356-8d79-4d4e-88db-14e1442dbd17 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:59.213930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed89e356-8d79-4d4e-88db-14e1442dbd17 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:59.214656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed89e356-8d79-4d4e-88db-14e1442dbd17 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:59.215115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed89e356-8d79-4d4e-88db-14e1442dbd17 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:59.215541 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed89e356-8d79-4d4e-88db-14e1442dbd17 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:59.351745 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-d1a66948-23e8-4d1b-b806-4441895ccdf1 req-17d448cb-b3c9-4d82-8637-8405ea93066c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32825117-a6dd-4ad7-99cb-e0de03690bd8", "name": "network-vif-plugged", "status": "completed", "tag": "7ff61026-1ba5-4b9f-b116-ad1f49ce7ead"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:29:59.381078 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d1a66948-23e8-4d1b-b806-4441895ccdf1 req-17d448cb-b3c9-4d82-8637-8405ea93066c service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:59.381838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d1a66948-23e8-4d1b-b806-4441895ccdf1 req-17d448cb-b3c9-4d82-8637-8405ea93066c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:59.382449 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d1a66948-23e8-4d1b-b806-4441895ccdf1 req-17d448cb-b3c9-4d82-8637-8405ea93066c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:59.396979 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-d1a66948-23e8-4d1b-b806-4441895ccdf1 req-17d448cb-b3c9-4d82-8637-8405ea93066c service nova] Creating event network-vif-plugged:7ff61026-1ba5-4b9f-b116-ad1f49ce7ead for instance 32825117-a6dd-4ad7-99cb-e0de03690bd8 on n-h2-862967-2 Oct 29 03:29:59.403664 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-d1a66948-23e8-4d1b-b806-4441895ccdf1 req-17d448cb-b3c9-4d82-8637-8405ea93066c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.375263 Oct 29 03:29:59.404697 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2989/6198] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:29:59.521966 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ed89e356-8d79-4d4e-88db-14e1442dbd17 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9" status: 200 len: 1463 microversion: 2.1 time: 0.325407 Oct 29 03:29:59.524945 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3210/6199] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:59 2022] GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9 => generated 1463 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:29:59.708363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9f51907e-54a2-4c90-afc8-bb90d900ca4d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:29:59.709766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9f51907e-54a2-4c90-afc8-bb90d900ca4d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:29:59.716006 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f51907e-54a2-4c90-afc8-bb90d900ca4d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:59.716496 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f51907e-54a2-4c90-afc8-bb90d900ca4d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:59.716957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f51907e-54a2-4c90-afc8-bb90d900ca4d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:59.717664 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f51907e-54a2-4c90-afc8-bb90d900ca4d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:29:59.718118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f51907e-54a2-4c90-afc8-bb90d900ca4d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:29:59.718703 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f51907e-54a2-4c90-afc8-bb90d900ca4d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:29:59.879970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9f51907e-54a2-4c90-afc8-bb90d900ca4d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:29:59.888915 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9f51907e-54a2-4c90-afc8-bb90d900ca4d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8" status: 200 len: 1202 microversion: 2.1 time: 0.185238 Oct 29 03:29:59.889731 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2990/6200] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:29:59 2022] GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8 => generated 1202 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:00.552986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-86e2dc62-06dc-447c-b130-f0a4cd905327 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:00.553916 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-86e2dc62-06dc-447c-b130-f0a4cd905327 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: c36e2181-6505-40fb-85d9-fe2dc9c027e9] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:00.565215 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86e2dc62-06dc-447c-b130-f0a4cd905327 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:00.566991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86e2dc62-06dc-447c-b130-f0a4cd905327 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:00.568289 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86e2dc62-06dc-447c-b130-f0a4cd905327 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:00.569617 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86e2dc62-06dc-447c-b130-f0a4cd905327 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:00.570648 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86e2dc62-06dc-447c-b130-f0a4cd905327 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:00.571622 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86e2dc62-06dc-447c-b130-f0a4cd905327 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:00.749283 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-86e2dc62-06dc-447c-b130-f0a4cd905327 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9" status: 200 len: 1463 microversion: 2.1 time: 0.202199 Oct 29 03:30:00.751352 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3211/6201] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:00 2022] GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9 => generated 1463 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:00.912112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5be4c8c1-3abb-4463-b1fb-873893377819 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:00.912811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5be4c8c1-3abb-4463-b1fb-873893377819 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:00.927120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5be4c8c1-3abb-4463-b1fb-873893377819 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:00.929412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5be4c8c1-3abb-4463-b1fb-873893377819 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:00.931463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5be4c8c1-3abb-4463-b1fb-873893377819 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:00.934096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5be4c8c1-3abb-4463-b1fb-873893377819 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:00.935450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5be4c8c1-3abb-4463-b1fb-873893377819 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:00.936135 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5be4c8c1-3abb-4463-b1fb-873893377819 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:01.222374 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5be4c8c1-3abb-4463-b1fb-873893377819 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:01.231757 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5be4c8c1-3abb-4463-b1fb-873893377819 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8" status: 200 len: 1389 microversion: 2.1 time: 0.323800 Oct 29 03:30:01.256860 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2991/6202] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:00 2022] GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8 => generated 1389 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:01.260151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0401abcf-1781-42b3-b360-784ea5d6010e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:01.260907 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0401abcf-1781-42b3-b360-784ea5d6010e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:01.280316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0401abcf-1781-42b3-b360-784ea5d6010e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:01.281066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0401abcf-1781-42b3-b360-784ea5d6010e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:01.281561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0401abcf-1781-42b3-b360-784ea5d6010e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:01.289340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0401abcf-1781-42b3-b360-784ea5d6010e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:01.290155 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0401abcf-1781-42b3-b360-784ea5d6010e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:01.290603 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0401abcf-1781-42b3-b360-784ea5d6010e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:01.624156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0401abcf-1781-42b3-b360-784ea5d6010e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:01.636334 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0401abcf-1781-42b3-b360-784ea5d6010e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8" status: 200 len: 1389 microversion: 2.1 time: 0.380427 Oct 29 03:30:01.638344 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3212/6203] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:01 2022] GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8 => generated 1389 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:01.667815 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ca352bf5-b2b7-470a-ada9-2aaed7213cac tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:01.671560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ca352bf5-b2b7-470a-ada9-2aaed7213cac tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:01.687975 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ca352bf5-b2b7-470a-ada9-2aaed7213cac tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:01.688469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ca352bf5-b2b7-470a-ada9-2aaed7213cac tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:01.688954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ca352bf5-b2b7-470a-ada9-2aaed7213cac tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:01.689647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ca352bf5-b2b7-470a-ada9-2aaed7213cac tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:01.690094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ca352bf5-b2b7-470a-ada9-2aaed7213cac tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:01.690509 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ca352bf5-b2b7-470a-ada9-2aaed7213cac tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:01.775353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4ba17003-28db-4ad4-a791-1c1a8cf2479b tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:01.776429 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4ba17003-28db-4ad4-a791-1c1a8cf2479b tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: c36e2181-6505-40fb-85d9-fe2dc9c027e9] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:01.789175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ba17003-28db-4ad4-a791-1c1a8cf2479b tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:01.789881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ba17003-28db-4ad4-a791-1c1a8cf2479b tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:01.790479 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ba17003-28db-4ad4-a791-1c1a8cf2479b tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:01.791341 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ba17003-28db-4ad4-a791-1c1a8cf2479b tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:01.791956 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ba17003-28db-4ad4-a791-1c1a8cf2479b tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:01.793225 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ba17003-28db-4ad4-a791-1c1a8cf2479b tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:01.963234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ca352bf5-b2b7-470a-ada9-2aaed7213cac tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:01.974532 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ca352bf5-b2b7-470a-ada9-2aaed7213cac tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8" status: 200 len: 1389 microversion: 2.1 time: 0.310815 Oct 29 03:30:01.975527 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2992/6204] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:01 2022] GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8 => generated 1389 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:02.001081 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-02ded817-7fe8-4043-95bb-1dc0e9e81d76 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:02.001770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-02ded817-7fe8-4043-95bb-1dc0e9e81d76 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:02.008779 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02ded817-7fe8-4043-95bb-1dc0e9e81d76 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:02.009703 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02ded817-7fe8-4043-95bb-1dc0e9e81d76 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:02.010444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02ded817-7fe8-4043-95bb-1dc0e9e81d76 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:02.011714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02ded817-7fe8-4043-95bb-1dc0e9e81d76 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:02.012450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02ded817-7fe8-4043-95bb-1dc0e9e81d76 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:02.013479 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02ded817-7fe8-4043-95bb-1dc0e9e81d76 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:02.072635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-02ded817-7fe8-4043-95bb-1dc0e9e81d76 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:30:02.159813 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4ba17003-28db-4ad4-a791-1c1a8cf2479b tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9" status: 200 len: 1463 microversion: 2.1 time: 0.388159 Oct 29 03:30:02.169305 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3213/6205] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:01 2022] GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9 => generated 1463 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:02.225609 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-02ded817-7fe8-4043-95bb-1dc0e9e81d76 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "DELETE /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8" status: 204 len: 0 microversion: 2.1 time: 0.228336 Oct 29 03:30:02.226837 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2993/6206] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:30:01 2022] DELETE /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:30:02.235537 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-aa7aa98b-ee26-4203-80c4-9cb62ab9a11f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:02.236298 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-aa7aa98b-ee26-4203-80c4-9cb62ab9a11f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:02.245432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aa7aa98b-ee26-4203-80c4-9cb62ab9a11f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:02.246366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aa7aa98b-ee26-4203-80c4-9cb62ab9a11f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:02.247039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aa7aa98b-ee26-4203-80c4-9cb62ab9a11f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:02.248073 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aa7aa98b-ee26-4203-80c4-9cb62ab9a11f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:02.248855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aa7aa98b-ee26-4203-80c4-9cb62ab9a11f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:02.249521 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aa7aa98b-ee26-4203-80c4-9cb62ab9a11f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:02.392861 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-aa7aa98b-ee26-4203-80c4-9cb62ab9a11f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:02.401086 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-aa7aa98b-ee26-4203-80c4-9cb62ab9a11f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8" status: 200 len: 1395 microversion: 2.1 time: 0.169411 Oct 29 03:30:02.401807 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3214/6207] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:02 2022] GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8 => generated 1395 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:03.074120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-c364295a-ffc6-4b29-9f7d-1ddd4ef3367f req-d88a9ee3-4344-402c-8568-18e0d7620e5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c36e2181-6505-40fb-85d9-fe2dc9c027e9", "name": "network-vif-plugged", "status": "completed", "tag": "7318e0b2-f9dc-4104-b011-8a46d1486c11"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:03.083303 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:03.084976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:03.095841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c364295a-ffc6-4b29-9f7d-1ddd4ef3367f req-d88a9ee3-4344-402c-8568-18e0d7620e5f service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:03.096321 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c364295a-ffc6-4b29-9f7d-1ddd4ef3367f req-d88a9ee3-4344-402c-8568-18e0d7620e5f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:03.096879 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c364295a-ffc6-4b29-9f7d-1ddd4ef3367f req-d88a9ee3-4344-402c-8568-18e0d7620e5f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:03.101089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:03.109216 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-c364295a-ffc6-4b29-9f7d-1ddd4ef3367f req-d88a9ee3-4344-402c-8568-18e0d7620e5f service nova] Creating event network-vif-plugged:7318e0b2-f9dc-4104-b011-8a46d1486c11 for instance c36e2181-6505-40fb-85d9-fe2dc9c027e9 on n-h2-862967-2 Oct 29 03:30:03.114950 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-c364295a-ffc6-4b29-9f7d-1ddd4ef3367f req-d88a9ee3-4344-402c-8568-18e0d7620e5f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047521 Oct 29 03:30:03.115828 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2994/6208] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:30:03.190197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-030f72d8-cda4-4864-b064-77384f09a368 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:03.190995 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-030f72d8-cda4-4864-b064-77384f09a368 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: c36e2181-6505-40fb-85d9-fe2dc9c027e9] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:03.194830 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:03.207580 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-030f72d8-cda4-4864-b064-77384f09a368 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:03.208077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-030f72d8-cda4-4864-b064-77384f09a368 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:03.208718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-030f72d8-cda4-4864-b064-77384f09a368 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:03.211914 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-030f72d8-cda4-4864-b064-77384f09a368 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:03.212419 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-030f72d8-cda4-4864-b064-77384f09a368 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:03.213922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-030f72d8-cda4-4864-b064-77384f09a368 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:03.363894 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-030f72d8-cda4-4864-b064-77384f09a368 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9" status: 200 len: 1463 microversion: 2.1 time: 0.177364 Oct 29 03:30:03.364918 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3215/6209] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:03 2022] GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9 => generated 1463 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:03.426748 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-24d6bea8-bb6e-43af-88a4-a7e531aea3ff tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:03.427468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-24d6bea8-bb6e-43af-88a4-a7e531aea3ff tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:03.435441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24d6bea8-bb6e-43af-88a4-a7e531aea3ff tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:03.435937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24d6bea8-bb6e-43af-88a4-a7e531aea3ff tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:03.436378 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24d6bea8-bb6e-43af-88a4-a7e531aea3ff tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:03.437121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24d6bea8-bb6e-43af-88a4-a7e531aea3ff tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:03.437565 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24d6bea8-bb6e-43af-88a4-a7e531aea3ff tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:03.438204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24d6bea8-bb6e-43af-88a4-a7e531aea3ff tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:03.583973 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-24d6bea8-bb6e-43af-88a4-a7e531aea3ff tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:03.592797 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-24d6bea8-bb6e-43af-88a4-a7e531aea3ff tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8" status: 200 len: 1395 microversion: 2.1 time: 0.171986 Oct 29 03:30:03.593399 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2995/6210] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:03 2022] GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8 => generated 1395 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:04.387544 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-68bda701-c562-462a-a1ab-0a6a87fe3ff7 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:04.388151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-68bda701-c562-462a-a1ab-0a6a87fe3ff7 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: c36e2181-6505-40fb-85d9-fe2dc9c027e9] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:04.395432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68bda701-c562-462a-a1ab-0a6a87fe3ff7 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:04.396171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68bda701-c562-462a-a1ab-0a6a87fe3ff7 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:04.396632 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68bda701-c562-462a-a1ab-0a6a87fe3ff7 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:04.397322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68bda701-c562-462a-a1ab-0a6a87fe3ff7 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:04.397953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68bda701-c562-462a-a1ab-0a6a87fe3ff7 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:04.398378 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68bda701-c562-462a-a1ab-0a6a87fe3ff7 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:04.403303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=100 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:04.617680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9bf4c390-e7c3-4d68-a922-b985b39f8b7b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:04.618309 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9bf4c390-e7c3-4d68-a922-b985b39f8b7b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:04.631225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9bf4c390-e7c3-4d68-a922-b985b39f8b7b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:04.631766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9bf4c390-e7c3-4d68-a922-b985b39f8b7b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:04.632211 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9bf4c390-e7c3-4d68-a922-b985b39f8b7b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:04.637776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9bf4c390-e7c3-4d68-a922-b985b39f8b7b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:04.639559 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9bf4c390-e7c3-4d68-a922-b985b39f8b7b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:04.640745 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9bf4c390-e7c3-4d68-a922-b985b39f8b7b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:04.682179 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-68bda701-c562-462a-a1ab-0a6a87fe3ff7 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9" status: 200 len: 1463 microversion: 2.1 time: 0.297831 Oct 29 03:30:04.683499 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3216/6211] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:04 2022] GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9 => generated 1463 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:04.691908 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-de0fff5f-c11c-498e-94d5-29d38c63e858 req-d1f0aff1-f026-4264-aeb0-a58489619409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32825117-a6dd-4ad7-99cb-e0de03690bd8", "name": "network-vif-deleted", "tag": "7ff61026-1ba5-4b9f-b116-ad1f49ce7ead"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:04.711026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-de0fff5f-c11c-498e-94d5-29d38c63e858 req-d1f0aff1-f026-4264-aeb0-a58489619409 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:04.711670 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-de0fff5f-c11c-498e-94d5-29d38c63e858 req-d1f0aff1-f026-4264-aeb0-a58489619409 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:04.712221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-de0fff5f-c11c-498e-94d5-29d38c63e858 req-d1f0aff1-f026-4264-aeb0-a58489619409 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:04.730699 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-de0fff5f-c11c-498e-94d5-29d38c63e858 req-d1f0aff1-f026-4264-aeb0-a58489619409 service nova] Creating event network-vif-deleted:7ff61026-1ba5-4b9f-b116-ad1f49ce7ead for instance 32825117-a6dd-4ad7-99cb-e0de03690bd8 on n-h2-862967-2 Oct 29 03:30:04.763816 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-de0fff5f-c11c-498e-94d5-29d38c63e858 req-d1f0aff1-f026-4264-aeb0-a58489619409 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052844 Oct 29 03:30:04.773328 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3217/6212] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:30:04.805692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9bf4c390-e7c3-4d68-a922-b985b39f8b7b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:04.815616 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9bf4c390-e7c3-4d68-a922-b985b39f8b7b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8" status: 200 len: 1353 microversion: 2.1 time: 0.203840 Oct 29 03:30:04.816468 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2996/6213] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:04 2022] GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8 => generated 1353 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:05.705463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d93fac89-5494-44d3-86fe-92e3e83b21f7 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:05.706939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d93fac89-5494-44d3-86fe-92e3e83b21f7 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: c36e2181-6505-40fb-85d9-fe2dc9c027e9] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:05.714599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d93fac89-5494-44d3-86fe-92e3e83b21f7 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:05.715364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d93fac89-5494-44d3-86fe-92e3e83b21f7 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:05.716698 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d93fac89-5494-44d3-86fe-92e3e83b21f7 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:05.717710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d93fac89-5494-44d3-86fe-92e3e83b21f7 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:05.718381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d93fac89-5494-44d3-86fe-92e3e83b21f7 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:05.718982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d93fac89-5494-44d3-86fe-92e3e83b21f7 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:05.838885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-786fa16b-9484-4b4e-aede-303d379d6448 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:05.840097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-786fa16b-9484-4b4e-aede-303d379d6448 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:05.847446 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:05.849845 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-786fa16b-9484-4b4e-aede-303d379d6448 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:05.850505 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-786fa16b-9484-4b4e-aede-303d379d6448 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:05.851652 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-786fa16b-9484-4b4e-aede-303d379d6448 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:05.852566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-786fa16b-9484-4b4e-aede-303d379d6448 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:05.853180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-786fa16b-9484-4b4e-aede-303d379d6448 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:05.853764 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-786fa16b-9484-4b4e-aede-303d379d6448 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:05.882843 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d93fac89-5494-44d3-86fe-92e3e83b21f7 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9" status: 200 len: 1648 microversion: 2.1 time: 0.181493 Oct 29 03:30:05.884422 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3218/6214] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:05 2022] GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9 => generated 1648 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:05.906656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e01806a8-3838-4e61-8241-137a94ce7808 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:05.909285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e01806a8-3838-4e61-8241-137a94ce7808 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: c36e2181-6505-40fb-85d9-fe2dc9c027e9] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:05.915825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e01806a8-3838-4e61-8241-137a94ce7808 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:05.916436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e01806a8-3838-4e61-8241-137a94ce7808 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:05.916982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e01806a8-3838-4e61-8241-137a94ce7808 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:05.917906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e01806a8-3838-4e61-8241-137a94ce7808 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:05.918430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e01806a8-3838-4e61-8241-137a94ce7808 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:05.918930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e01806a8-3838-4e61-8241-137a94ce7808 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:05.932465 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-786fa16b-9484-4b4e-aede-303d379d6448 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:05.941415 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-786fa16b-9484-4b4e-aede-303d379d6448 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8" status: 200 len: 1187 microversion: 2.1 time: 0.106434 Oct 29 03:30:05.953713 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2997/6215] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:05 2022] GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8 => generated 1187 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:30:06.086597 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e01806a8-3838-4e61-8241-137a94ce7808 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9" status: 200 len: 1648 microversion: 2.1 time: 0.184226 Oct 29 03:30:06.087497 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3219/6216] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:05 2022] GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9 => generated 1648 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:06.110192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ad0e80fc-2dd0-4de8-a524-710f87fa1f89 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:06.111093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ad0e80fc-2dd0-4de8-a524-710f87fa1f89 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: c36e2181-6505-40fb-85d9-fe2dc9c027e9] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:06.118357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad0e80fc-2dd0-4de8-a524-710f87fa1f89 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:06.119127 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad0e80fc-2dd0-4de8-a524-710f87fa1f89 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:06.119808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad0e80fc-2dd0-4de8-a524-710f87fa1f89 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:06.120944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad0e80fc-2dd0-4de8-a524-710f87fa1f89 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:06.121840 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad0e80fc-2dd0-4de8-a524-710f87fa1f89 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:06.122543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad0e80fc-2dd0-4de8-a524-710f87fa1f89 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:06.280173 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ad0e80fc-2dd0-4de8-a524-710f87fa1f89 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9" status: 200 len: 1648 microversion: 2.1 time: 0.174979 Oct 29 03:30:06.280806 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2998/6217] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:06 2022] GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9 => generated 1648 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:06.410423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3768ffb7-293b-4b1e-a127-1888a54a963f tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1583615337", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "availability_zone": "nova:n-h1-862967-2", "networks": [{"uuid": "117bdedd-d341-4e45-94e5-7abbc1a76960"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:06.476368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-3768ffb7-293b-4b1e-a127-1888a54a963f tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] validate_networks() for [('117bdedd-d341-4e45-94e5-7abbc1a76960', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:30:06.965758 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-acd092f1-6af3-4556-9fc9-56d48c7e9b3a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:06.966576 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-acd092f1-6af3-4556-9fc9-56d48c7e9b3a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:06.974237 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-acd092f1-6af3-4556-9fc9-56d48c7e9b3a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:06.975089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-acd092f1-6af3-4556-9fc9-56d48c7e9b3a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:06.975625 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-acd092f1-6af3-4556-9fc9-56d48c7e9b3a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:06.976441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-acd092f1-6af3-4556-9fc9-56d48c7e9b3a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:06.977058 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-acd092f1-6af3-4556-9fc9-56d48c7e9b3a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:06.977569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-acd092f1-6af3-4556-9fc9-56d48c7e9b3a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:07.035560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-3768ffb7-293b-4b1e-a127-1888a54a963f tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:30:07.036092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-3768ffb7-293b-4b1e-a127-1888a54a963f tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:30:07.036432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-3768ffb7-293b-4b1e-a127-1888a54a963f tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:30:07.036878 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-3768ffb7-293b-4b1e-a127-1888a54a963f tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:30:07.037302 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-3768ffb7-293b-4b1e-a127-1888a54a963f tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:30:07.047159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3768ffb7-293b-4b1e-a127-1888a54a963f tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:07.047639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3768ffb7-293b-4b1e-a127-1888a54a963f tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:07.048066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3768ffb7-293b-4b1e-a127-1888a54a963f tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:07.048653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-acd092f1-6af3-4556-9fc9-56d48c7e9b3a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:07.048795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3768ffb7-293b-4b1e-a127-1888a54a963f tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:07.049244 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3768ffb7-293b-4b1e-a127-1888a54a963f tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:07.049664 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3768ffb7-293b-4b1e-a127-1888a54a963f tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:07.057708 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-acd092f1-6af3-4556-9fc9-56d48c7e9b3a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8" status: 200 len: 1187 microversion: 2.1 time: 0.096003 Oct 29 03:30:07.058529 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 2999/6218] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:06 2022] GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8 => generated 1187 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:07.085676 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-3768ffb7-293b-4b1e-a127-1888a54a963f tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Getting quotas for project 0d05826be2f349f6b912822f499d4c2a. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:30:07.091463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-3768ffb7-293b-4b1e-a127-1888a54a963f tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Getting quotas for user f4fd5d7c439049209432c51dc55bb100 and project 0d05826be2f349f6b912822f499d4c2a. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:30:07.105266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3768ffb7-293b-4b1e-a127-1888a54a963f tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:30:07.107895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3768ffb7-293b-4b1e-a127-1888a54a963f tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: 9838384c-7cd9-43b0-83cb-e02bf792469b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:30:07.154298 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3768ffb7-293b-4b1e-a127-1888a54a963f tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.747916 Oct 29 03:30:07.155295 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3220/6219] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:30:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:30:07.166856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-84d5b342-9005-43e7-acc3-029f25eba135 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:07.168410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-84d5b342-9005-43e7-acc3-029f25eba135 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: 9838384c-7cd9-43b0-83cb-e02bf792469b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:07.233678 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-84d5b342-9005-43e7-acc3-029f25eba135 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b" status: 200 len: 1329 microversion: 2.1 time: 0.071120 Oct 29 03:30:07.247822 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3000/6220] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:07 2022] GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b => generated 1329 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:08.084710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e64dcf65-b7a5-4f06-998b-555ef7701ccb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:08.086033 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e64dcf65-b7a5-4f06-998b-555ef7701ccb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:08.093104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e64dcf65-b7a5-4f06-998b-555ef7701ccb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:08.093585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e64dcf65-b7a5-4f06-998b-555ef7701ccb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:08.094211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e64dcf65-b7a5-4f06-998b-555ef7701ccb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:08.095105 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e64dcf65-b7a5-4f06-998b-555ef7701ccb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:08.095735 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e64dcf65-b7a5-4f06-998b-555ef7701ccb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:08.096359 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e64dcf65-b7a5-4f06-998b-555ef7701ccb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:08.162060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e64dcf65-b7a5-4f06-998b-555ef7701ccb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:08.170160 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e64dcf65-b7a5-4f06-998b-555ef7701ccb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8" status: 200 len: 1187 microversion: 2.1 time: 0.090664 Oct 29 03:30:08.170716 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3221/6221] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:08 2022] GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8 => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:08.257378 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cdbe0fd3-4ddc-4050-a6fa-df82aec3b15c tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:08.259323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cdbe0fd3-4ddc-4050-a6fa-df82aec3b15c tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: 9838384c-7cd9-43b0-83cb-e02bf792469b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:08.267078 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdbe0fd3-4ddc-4050-a6fa-df82aec3b15c tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:08.267571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdbe0fd3-4ddc-4050-a6fa-df82aec3b15c tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:08.268062 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdbe0fd3-4ddc-4050-a6fa-df82aec3b15c tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:08.268894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdbe0fd3-4ddc-4050-a6fa-df82aec3b15c tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:08.269404 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdbe0fd3-4ddc-4050-a6fa-df82aec3b15c tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:08.269887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdbe0fd3-4ddc-4050-a6fa-df82aec3b15c tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:08.363812 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cdbe0fd3-4ddc-4050-a6fa-df82aec3b15c tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b" status: 200 len: 1416 microversion: 2.1 time: 0.110413 Oct 29 03:30:08.364480 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3001/6222] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:08 2022] GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b => generated 1416 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:09.194571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-076431f2-e80f-4bec-8489-234b22f56ac3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:09.196037 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-076431f2-e80f-4bec-8489-234b22f56ac3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:09.207792 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-076431f2-e80f-4bec-8489-234b22f56ac3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:09.211132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-076431f2-e80f-4bec-8489-234b22f56ac3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:09.213681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-076431f2-e80f-4bec-8489-234b22f56ac3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:09.216642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-076431f2-e80f-4bec-8489-234b22f56ac3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:09.217195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-076431f2-e80f-4bec-8489-234b22f56ac3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:09.217645 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-076431f2-e80f-4bec-8489-234b22f56ac3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:09.322933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-076431f2-e80f-4bec-8489-234b22f56ac3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:09.342158 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-076431f2-e80f-4bec-8489-234b22f56ac3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8" status: 200 len: 1187 microversion: 2.1 time: 0.151524 Oct 29 03:30:09.343113 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3222/6223] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:09 2022] GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8 => generated 1187 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:09.388226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0594788f-ee09-46e2-8168-7ccb6b87ca84 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:09.398583 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0594788f-ee09-46e2-8168-7ccb6b87ca84 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: 9838384c-7cd9-43b0-83cb-e02bf792469b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:09.415687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0594788f-ee09-46e2-8168-7ccb6b87ca84 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:09.416459 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0594788f-ee09-46e2-8168-7ccb6b87ca84 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:09.417092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0594788f-ee09-46e2-8168-7ccb6b87ca84 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:09.418128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0594788f-ee09-46e2-8168-7ccb6b87ca84 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:09.418748 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0594788f-ee09-46e2-8168-7ccb6b87ca84 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:09.419340 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0594788f-ee09-46e2-8168-7ccb6b87ca84 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:09.697020 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0594788f-ee09-46e2-8168-7ccb6b87ca84 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b" status: 200 len: 1464 microversion: 2.1 time: 0.312646 Oct 29 03:30:09.697614 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3002/6224] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:09 2022] GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b => generated 1464 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:10.018704 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-0c602e2d-c67a-4dce-9750-91ce4a2ccd06 req-fc3d8e6a-ca19-4b11-b081-d009e4b94863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9838384c-7cd9-43b0-83cb-e02bf792469b", "tag": "7d4de815-8012-499c-9667-133373676f10"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:10.041072 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-0c602e2d-c67a-4dce-9750-91ce4a2ccd06 req-fc3d8e6a-ca19-4b11-b081-d009e4b94863 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:10.041899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-0c602e2d-c67a-4dce-9750-91ce4a2ccd06 req-fc3d8e6a-ca19-4b11-b081-d009e4b94863 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:10.042555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-0c602e2d-c67a-4dce-9750-91ce4a2ccd06 req-fc3d8e6a-ca19-4b11-b081-d009e4b94863 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:10.058958 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-0c602e2d-c67a-4dce-9750-91ce4a2ccd06 req-fc3d8e6a-ca19-4b11-b081-d009e4b94863 service nova] Creating event network-changed:7d4de815-8012-499c-9667-133373676f10 for instance 9838384c-7cd9-43b0-83cb-e02bf792469b on n-h1-862967-2 Oct 29 03:30:10.065322 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-0c602e2d-c67a-4dce-9750-91ce4a2ccd06 req-fc3d8e6a-ca19-4b11-b081-d009e4b94863 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050681 Oct 29 03:30:10.066731 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3223/6225] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:30:10.367129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5ad2a313-dbcf-4842-8847-d55a4cdf9d5d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:10.367753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5ad2a313-dbcf-4842-8847-d55a4cdf9d5d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 32825117-a6dd-4ad7-99cb-e0de03690bd8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:10.379761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ad2a313-dbcf-4842-8847-d55a4cdf9d5d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:10.380257 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ad2a313-dbcf-4842-8847-d55a4cdf9d5d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:10.380728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ad2a313-dbcf-4842-8847-d55a4cdf9d5d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:10.381638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ad2a313-dbcf-4842-8847-d55a4cdf9d5d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:10.382266 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ad2a313-dbcf-4842-8847-d55a4cdf9d5d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:10.382849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5ad2a313-dbcf-4842-8847-d55a4cdf9d5d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:10.401112 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-5ad2a313-dbcf-4842-8847-d55a4cdf9d5d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] HTTP exception thrown: Instance 32825117-a6dd-4ad7-99cb-e0de03690bd8 could not be found. Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5ad2a313-dbcf-4842-8847-d55a4cdf9d5d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Request method failure captured: Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8 HTTP/1.1 Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJ4OGFERKLIttSSPB0-5-jXA-TX6OM8jt9EJzgHtp2De1EitDQkx8TOt6_WbUmBu_Y6n6LIcWJu35cEqto8LlaLBvd7Fx6PpdDw_gDp2R4doflmhUMo3Zw8gq8dju5JmvbgI04aG1xuqlCslUnwpoihX0XXo_veRrdoDDtMm482XfyM Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7c164fcbf0df4575b66149f2298496e3"}]}] Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestVolumeBootPattern-894604406 Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 187e7d6474db4b8e813ff31fcddb4034 Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 32825117-a6dd-4ad7-99cb-e0de03690bd8 could not be found. Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '32825117-a6dd-4ad7-99cb-e0de03690bd8'} Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32825117-a6dd-4ad7-99cb-e0de03690bd8 could not be found. Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32825117-a6dd-4ad7-99cb-e0de03690bd8 could not be found. Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:30:10.408495 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:30:10.415016 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:30:10.415016 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:30:10.415016 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:30:10.415016 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:30:10.415016 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:30:10.415016 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32825117-a6dd-4ad7-99cb-e0de03690bd8 could not be found. Oct 29 03:30:10.415016 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:30:10.416633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5ad2a313-dbcf-4842-8847-d55a4cdf9d5d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Returning 404 to user: Instance 32825117-a6dd-4ad7-99cb-e0de03690bd8 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:30:10.417664 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5ad2a313-dbcf-4842-8847-d55a4cdf9d5d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8" status: 404 len: 111 microversion: 2.1 time: 0.055076 Oct 29 03:30:10.418728 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3003/6226] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:10 2022] GET /compute/v2.1/servers/32825117-a6dd-4ad7-99cb-e0de03690bd8 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:30:10.722680 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0ec10649-7ee5-40a1-92e8-0c31b6ee0a81 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:10.724555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0ec10649-7ee5-40a1-92e8-0c31b6ee0a81 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: 9838384c-7cd9-43b0-83cb-e02bf792469b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:10.731641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ec10649-7ee5-40a1-92e8-0c31b6ee0a81 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:10.733160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ec10649-7ee5-40a1-92e8-0c31b6ee0a81 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:10.733949 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ec10649-7ee5-40a1-92e8-0c31b6ee0a81 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:10.734861 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ec10649-7ee5-40a1-92e8-0c31b6ee0a81 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:10.735494 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ec10649-7ee5-40a1-92e8-0c31b6ee0a81 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:10.736093 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ec10649-7ee5-40a1-92e8-0c31b6ee0a81 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:10.890117 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0ec10649-7ee5-40a1-92e8-0c31b6ee0a81 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b" status: 200 len: 1464 microversion: 2.1 time: 0.172829 Oct 29 03:30:10.890906 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3224/6227] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:10 2022] GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b => generated 1464 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:11.915494 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-320b934a-a282-40eb-9419-17a5349869f0 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:11.917463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-320b934a-a282-40eb-9419-17a5349869f0 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: 9838384c-7cd9-43b0-83cb-e02bf792469b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:11.925363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-320b934a-a282-40eb-9419-17a5349869f0 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:11.926054 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-320b934a-a282-40eb-9419-17a5349869f0 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:11.926687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-320b934a-a282-40eb-9419-17a5349869f0 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:11.927612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-320b934a-a282-40eb-9419-17a5349869f0 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:11.928258 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-320b934a-a282-40eb-9419-17a5349869f0 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:11.928909 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-320b934a-a282-40eb-9419-17a5349869f0 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:12.156728 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-320b934a-a282-40eb-9419-17a5349869f0 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b" status: 200 len: 1464 microversion: 2.1 time: 0.247053 Oct 29 03:30:12.172446 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3004/6228] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:11 2022] GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b => generated 1464 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:13.180055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-56871933-0925-470a-972e-4e37c7624152 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:13.180693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-56871933-0925-470a-972e-4e37c7624152 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: 9838384c-7cd9-43b0-83cb-e02bf792469b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:13.188041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56871933-0925-470a-972e-4e37c7624152 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:13.188637 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56871933-0925-470a-972e-4e37c7624152 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:13.189119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56871933-0925-470a-972e-4e37c7624152 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:13.190018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56871933-0925-470a-972e-4e37c7624152 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:13.190520 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56871933-0925-470a-972e-4e37c7624152 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:13.190945 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56871933-0925-470a-972e-4e37c7624152 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:13.340613 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-56871933-0925-470a-972e-4e37c7624152 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b" status: 200 len: 1464 microversion: 2.1 time: 0.164994 Oct 29 03:30:13.341312 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3225/6229] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:13 2022] GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b => generated 1464 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:14.370177 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9c0a60f3-e3e7-4eaf-a809-1a22e5dc25d1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:14.370875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9c0a60f3-e3e7-4eaf-a809-1a22e5dc25d1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: 9838384c-7cd9-43b0-83cb-e02bf792469b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:14.394531 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c0a60f3-e3e7-4eaf-a809-1a22e5dc25d1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:14.395173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c0a60f3-e3e7-4eaf-a809-1a22e5dc25d1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:14.395543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c0a60f3-e3e7-4eaf-a809-1a22e5dc25d1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:14.396504 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c0a60f3-e3e7-4eaf-a809-1a22e5dc25d1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:14.397219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c0a60f3-e3e7-4eaf-a809-1a22e5dc25d1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:14.397806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c0a60f3-e3e7-4eaf-a809-1a22e5dc25d1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:14.540882 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9c0a60f3-e3e7-4eaf-a809-1a22e5dc25d1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b" status: 200 len: 1464 microversion: 2.1 time: 0.175424 Oct 29 03:30:14.541455 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3005/6230] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:14 2022] GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b => generated 1464 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:15.566627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a970155b-c00a-4e3a-9eb2-92c84d90eda1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:15.567555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a970155b-c00a-4e3a-9eb2-92c84d90eda1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: 9838384c-7cd9-43b0-83cb-e02bf792469b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:15.574209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a970155b-c00a-4e3a-9eb2-92c84d90eda1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:15.574712 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a970155b-c00a-4e3a-9eb2-92c84d90eda1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:15.575156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a970155b-c00a-4e3a-9eb2-92c84d90eda1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:15.576068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a970155b-c00a-4e3a-9eb2-92c84d90eda1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:15.576736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a970155b-c00a-4e3a-9eb2-92c84d90eda1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:15.577358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a970155b-c00a-4e3a-9eb2-92c84d90eda1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:15.708791 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a970155b-c00a-4e3a-9eb2-92c84d90eda1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b" status: 200 len: 1464 microversion: 2.1 time: 0.147550 Oct 29 03:30:15.709351 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3226/6231] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:15 2022] GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b => generated 1464 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:15.850225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-358a0d4b-83ca-487c-8baf-3e79f1a5aaf6 req-f9aa6961-a4f0-4ce8-9f31-da840d44ebae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9838384c-7cd9-43b0-83cb-e02bf792469b", "name": "network-vif-plugged", "status": "completed", "tag": "7d4de815-8012-499c-9667-133373676f10"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:15.861248 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-358a0d4b-83ca-487c-8baf-3e79f1a5aaf6 req-f9aa6961-a4f0-4ce8-9f31-da840d44ebae service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:15.861843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-358a0d4b-83ca-487c-8baf-3e79f1a5aaf6 req-f9aa6961-a4f0-4ce8-9f31-da840d44ebae service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:15.862291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-358a0d4b-83ca-487c-8baf-3e79f1a5aaf6 req-f9aa6961-a4f0-4ce8-9f31-da840d44ebae service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:15.874038 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-358a0d4b-83ca-487c-8baf-3e79f1a5aaf6 req-f9aa6961-a4f0-4ce8-9f31-da840d44ebae service nova] Creating event network-vif-plugged:7d4de815-8012-499c-9667-133373676f10 for instance 9838384c-7cd9-43b0-83cb-e02bf792469b on n-h1-862967-2 Oct 29 03:30:15.879364 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-358a0d4b-83ca-487c-8baf-3e79f1a5aaf6 req-f9aa6961-a4f0-4ce8-9f31-da840d44ebae service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032999 Oct 29 03:30:15.880121 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3006/6232] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:30:16.721546 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c7314005-0580-49cf-9b38-7aaedb0ae499 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1787021191", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0ff10090-8479-4345-a87e-109f34328c66", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "99eca644-5d6e-42bc-9cf9-7cf1c8e093be"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:16.732061 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c598e326-2cdd-41fa-b5ce-877001b82a90 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:16.733125 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c598e326-2cdd-41fa-b5ce-877001b82a90 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: 9838384c-7cd9-43b0-83cb-e02bf792469b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:16.739848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c598e326-2cdd-41fa-b5ce-877001b82a90 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:16.740339 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c598e326-2cdd-41fa-b5ce-877001b82a90 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:16.740807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c598e326-2cdd-41fa-b5ce-877001b82a90 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:16.741530 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c598e326-2cdd-41fa-b5ce-877001b82a90 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:16.741978 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c598e326-2cdd-41fa-b5ce-877001b82a90 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:16.742409 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c598e326-2cdd-41fa-b5ce-877001b82a90 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:16.796589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-c7314005-0580-49cf-9b38-7aaedb0ae499 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] validate_networks() for [('99eca644-5d6e-42bc-9cf9-7cf1c8e093be', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:30:16.881277 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c598e326-2cdd-41fa-b5ce-877001b82a90 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b" status: 200 len: 1464 microversion: 2.1 time: 0.153215 Oct 29 03:30:16.885258 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3007/6233] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:16 2022] GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b => generated 1464 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:30:17.056623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:17.098921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:17.207478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-c7314005-0580-49cf-9b38-7aaedb0ae499 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:30:17.207906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-c7314005-0580-49cf-9b38-7aaedb0ae499 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:30:17.208465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-c7314005-0580-49cf-9b38-7aaedb0ae499 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:30:17.208977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-c7314005-0580-49cf-9b38-7aaedb0ae499 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:30:17.209398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-c7314005-0580-49cf-9b38-7aaedb0ae499 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:30:17.218602 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c7314005-0580-49cf-9b38-7aaedb0ae499 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:17.219110 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c7314005-0580-49cf-9b38-7aaedb0ae499 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:17.219556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c7314005-0580-49cf-9b38-7aaedb0ae499 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:17.220301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c7314005-0580-49cf-9b38-7aaedb0ae499 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:17.220782 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c7314005-0580-49cf-9b38-7aaedb0ae499 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:17.221231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c7314005-0580-49cf-9b38-7aaedb0ae499 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:17.240225 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-c7314005-0580-49cf-9b38-7aaedb0ae499 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Getting quotas for project 7c164fcbf0df4575b66149f2298496e3. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:30:17.246754 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-c7314005-0580-49cf-9b38-7aaedb0ae499 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Getting quotas for user 187e7d6474db4b8e813ff31fcddb4034 and project 7c164fcbf0df4575b66149f2298496e3. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:30:17.321467 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c7314005-0580-49cf-9b38-7aaedb0ae499 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:30:17.323619 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c7314005-0580-49cf-9b38-7aaedb0ae499 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5cd20ffd-4e93-4840-9121-0000956167e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0ff10090-8479-4345-a87e-109f34328c66',volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:30:17.463077 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c7314005-0580-49cf-9b38-7aaedb0ae499 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.745500 Oct 29 03:30:17.464049 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3227/6234] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:30:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:30:17.475601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-24fc7688-6733-40e2-aee8-1ffd0cea0c3d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:17.476282 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-24fc7688-6733-40e2-aee8-1ffd0cea0c3d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5cd20ffd-4e93-4840-9121-0000956167e5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:17.479585 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:17.535074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-24fc7688-6733-40e2-aee8-1ffd0cea0c3d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:17.543033 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-24fc7688-6733-40e2-aee8-1ffd0cea0c3d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5" status: 200 len: 1057 microversion: 2.1 time: 0.071570 Oct 29 03:30:17.543621 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3008/6235] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:17 2022] GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5 => generated 1057 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:17.906520 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f2578354-0316-4db3-9bc8-ec1ede0e7327 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:17.907168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f2578354-0316-4db3-9bc8-ec1ede0e7327 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: 9838384c-7cd9-43b0-83cb-e02bf792469b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:17.913906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2578354-0316-4db3-9bc8-ec1ede0e7327 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:17.914415 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2578354-0316-4db3-9bc8-ec1ede0e7327 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:17.915004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2578354-0316-4db3-9bc8-ec1ede0e7327 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:17.915727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2578354-0316-4db3-9bc8-ec1ede0e7327 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:17.916186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2578354-0316-4db3-9bc8-ec1ede0e7327 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:17.916649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2578354-0316-4db3-9bc8-ec1ede0e7327 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:18.067500 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f2578354-0316-4db3-9bc8-ec1ede0e7327 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b" status: 200 len: 1649 microversion: 2.1 time: 0.165844 Oct 29 03:30:18.068612 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3228/6236] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:17 2022] GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b => generated 1649 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:18.090687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-18911047-1134-4518-82c0-5a3b06811fd1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:18.091451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-18911047-1134-4518-82c0-5a3b06811fd1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: 9838384c-7cd9-43b0-83cb-e02bf792469b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:18.099565 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18911047-1134-4518-82c0-5a3b06811fd1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:18.100196 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18911047-1134-4518-82c0-5a3b06811fd1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:18.100848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18911047-1134-4518-82c0-5a3b06811fd1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:18.101930 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18911047-1134-4518-82c0-5a3b06811fd1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:18.103050 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18911047-1134-4518-82c0-5a3b06811fd1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:18.103773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18911047-1134-4518-82c0-5a3b06811fd1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:18.251227 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-18911047-1134-4518-82c0-5a3b06811fd1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b" status: 200 len: 1649 microversion: 2.1 time: 0.164310 Oct 29 03:30:18.252156 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3009/6237] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:18 2022] GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b => generated 1649 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:18.277795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-352e6e46-e178-4a5e-905d-b20361c7ce85 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:18.278440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-352e6e46-e178-4a5e-905d-b20361c7ce85 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: 9838384c-7cd9-43b0-83cb-e02bf792469b] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:18.285366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-352e6e46-e178-4a5e-905d-b20361c7ce85 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:18.285902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-352e6e46-e178-4a5e-905d-b20361c7ce85 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:18.286392 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-352e6e46-e178-4a5e-905d-b20361c7ce85 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:18.287089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-352e6e46-e178-4a5e-905d-b20361c7ce85 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:18.287519 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-352e6e46-e178-4a5e-905d-b20361c7ce85 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:18.287948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-352e6e46-e178-4a5e-905d-b20361c7ce85 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:18.443274 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-352e6e46-e178-4a5e-905d-b20361c7ce85 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b" status: 200 len: 1649 microversion: 2.1 time: 0.170316 Oct 29 03:30:18.443815 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3229/6238] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:18 2022] GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b => generated 1649 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:18.470045 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-03ed7779-3b80-462e-a128-2e6c59831a9e tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:18.470548 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-03ed7779-3b80-462e-a128-2e6c59831a9e tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: 9838384c-7cd9-43b0-83cb-e02bf792469b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:18.480454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03ed7779-3b80-462e-a128-2e6c59831a9e tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:18.481158 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03ed7779-3b80-462e-a128-2e6c59831a9e tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:18.481643 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03ed7779-3b80-462e-a128-2e6c59831a9e tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:18.482383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03ed7779-3b80-462e-a128-2e6c59831a9e tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:18.482834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03ed7779-3b80-462e-a128-2e6c59831a9e tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:18.483259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03ed7779-3b80-462e-a128-2e6c59831a9e tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:18.517488 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-03ed7779-3b80-462e-a128-2e6c59831a9e tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: 9838384c-7cd9-43b0-83cb-e02bf792469b] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:30:18.571080 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b993a18b-f2f7-4da7-8b79-c67500db0318 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:18.571732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b993a18b-f2f7-4da7-8b79-c67500db0318 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5cd20ffd-4e93-4840-9121-0000956167e5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:18.581884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b993a18b-f2f7-4da7-8b79-c67500db0318 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:18.583883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b993a18b-f2f7-4da7-8b79-c67500db0318 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:18.585210 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b993a18b-f2f7-4da7-8b79-c67500db0318 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:18.587303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b993a18b-f2f7-4da7-8b79-c67500db0318 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:18.588070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b993a18b-f2f7-4da7-8b79-c67500db0318 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:18.589315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b993a18b-f2f7-4da7-8b79-c67500db0318 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:18.650704 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-03ed7779-3b80-462e-a128-2e6c59831a9e tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "DELETE /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b" status: 204 len: 0 microversion: 2.1 time: 0.183801 Oct 29 03:30:18.652403 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3010/6239] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:30:18 2022] DELETE /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 03:30:18.672859 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1f0d2b64-7ef0-447e-b313-a0aa210e2c87 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:18.674016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1f0d2b64-7ef0-447e-b313-a0aa210e2c87 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: 9838384c-7cd9-43b0-83cb-e02bf792469b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:18.681553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f0d2b64-7ef0-447e-b313-a0aa210e2c87 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:18.682056 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f0d2b64-7ef0-447e-b313-a0aa210e2c87 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:18.682497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f0d2b64-7ef0-447e-b313-a0aa210e2c87 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:18.683226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f0d2b64-7ef0-447e-b313-a0aa210e2c87 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:18.684180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b993a18b-f2f7-4da7-8b79-c67500db0318 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:18.684651 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f0d2b64-7ef0-447e-b313-a0aa210e2c87 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:18.685108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1f0d2b64-7ef0-447e-b313-a0aa210e2c87 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:18.694076 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b993a18b-f2f7-4da7-8b79-c67500db0318 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5" status: 200 len: 1163 microversion: 2.1 time: 0.129842 Oct 29 03:30:18.695615 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3230/6240] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:18 2022] GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5 => generated 1163 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:18.856938 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1f0d2b64-7ef0-447e-b313-a0aa210e2c87 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b" status: 200 len: 1655 microversion: 2.1 time: 0.199276 Oct 29 03:30:18.869837 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3011/6241] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:18 2022] GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b => generated 1655 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:19.717954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bdbfef05-1d2e-467b-bc51-e49c163a8374 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:19.719246 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bdbfef05-1d2e-467b-bc51-e49c163a8374 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5cd20ffd-4e93-4840-9121-0000956167e5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:19.731639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdbfef05-1d2e-467b-bc51-e49c163a8374 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:19.733417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdbfef05-1d2e-467b-bc51-e49c163a8374 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:19.737474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdbfef05-1d2e-467b-bc51-e49c163a8374 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:19.738492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdbfef05-1d2e-467b-bc51-e49c163a8374 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:19.739156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdbfef05-1d2e-467b-bc51-e49c163a8374 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:19.739754 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdbfef05-1d2e-467b-bc51-e49c163a8374 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:19.883087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e000eac9-22c3-4fb3-a472-3982ed143766 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:19.884341 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e000eac9-22c3-4fb3-a472-3982ed143766 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: 9838384c-7cd9-43b0-83cb-e02bf792469b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:19.901401 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e000eac9-22c3-4fb3-a472-3982ed143766 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:19.903758 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e000eac9-22c3-4fb3-a472-3982ed143766 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:19.904892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e000eac9-22c3-4fb3-a472-3982ed143766 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:19.906978 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e000eac9-22c3-4fb3-a472-3982ed143766 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:19.909228 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e000eac9-22c3-4fb3-a472-3982ed143766 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:19.910025 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e000eac9-22c3-4fb3-a472-3982ed143766 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:20.042030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bdbfef05-1d2e-467b-bc51-e49c163a8374 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:20.053516 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bdbfef05-1d2e-467b-bc51-e49c163a8374 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5" status: 200 len: 1215 microversion: 2.1 time: 0.339325 Oct 29 03:30:20.059472 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3231/6242] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:19 2022] GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5 => generated 1215 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:20.441520 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e000eac9-22c3-4fb3-a472-3982ed143766 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b" status: 200 len: 1655 microversion: 2.1 time: 0.562325 Oct 29 03:30:20.442122 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3012/6243] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:19 2022] GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b => generated 1655 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:20.755979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-d1685803-17d8-43e7-b29e-c6462abb6199 req-c54f2450-7d00-4d83-9b3a-9c4429f2f0cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9838384c-7cd9-43b0-83cb-e02bf792469b", "name": "network-vif-deleted", "tag": "7d4de815-8012-499c-9667-133373676f10"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:20.770027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d1685803-17d8-43e7-b29e-c6462abb6199 req-c54f2450-7d00-4d83-9b3a-9c4429f2f0cd service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:20.770835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d1685803-17d8-43e7-b29e-c6462abb6199 req-c54f2450-7d00-4d83-9b3a-9c4429f2f0cd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:20.771466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d1685803-17d8-43e7-b29e-c6462abb6199 req-c54f2450-7d00-4d83-9b3a-9c4429f2f0cd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:20.796677 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-d1685803-17d8-43e7-b29e-c6462abb6199 req-c54f2450-7d00-4d83-9b3a-9c4429f2f0cd service nova] Creating event network-vif-deleted:7d4de815-8012-499c-9667-133373676f10 for instance 9838384c-7cd9-43b0-83cb-e02bf792469b on n-h1-862967-2 Oct 29 03:30:20.812494 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-d1685803-17d8-43e7-b29e-c6462abb6199 req-c54f2450-7d00-4d83-9b3a-9c4429f2f0cd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060911 Oct 29 03:30:20.821310 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3232/6244] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:30:20.838840 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-6705509d-7703-4781-aec7-f1273c9192bb req-fd811e2b-d466-4a8c-bd17-413fc817d551 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cd20ffd-4e93-4840-9121-0000956167e5", "tag": "d8c13600-e9ab-468e-983a-36aedd7b3053"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:20.865937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6705509d-7703-4781-aec7-f1273c9192bb req-fd811e2b-d466-4a8c-bd17-413fc817d551 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:20.873952 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6705509d-7703-4781-aec7-f1273c9192bb req-fd811e2b-d466-4a8c-bd17-413fc817d551 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:20.876439 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6705509d-7703-4781-aec7-f1273c9192bb req-fd811e2b-d466-4a8c-bd17-413fc817d551 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:20.885383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:20.902710 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-6705509d-7703-4781-aec7-f1273c9192bb req-fd811e2b-d466-4a8c-bd17-413fc817d551 service nova] Creating event network-changed:d8c13600-e9ab-468e-983a-36aedd7b3053 for instance 5cd20ffd-4e93-4840-9121-0000956167e5 on n-h2-862967-2 Oct 29 03:30:20.911199 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-6705509d-7703-4781-aec7-f1273c9192bb req-fd811e2b-d466-4a8c-bd17-413fc817d551 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076611 Oct 29 03:30:20.912211 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3013/6245] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:30:21.081115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ff414c81-c3f9-4074-b594-63d316030413 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:21.081840 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ff414c81-c3f9-4074-b594-63d316030413 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5cd20ffd-4e93-4840-9121-0000956167e5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:21.088645 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff414c81-c3f9-4074-b594-63d316030413 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:21.089143 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff414c81-c3f9-4074-b594-63d316030413 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:21.089577 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff414c81-c3f9-4074-b594-63d316030413 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:21.090495 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff414c81-c3f9-4074-b594-63d316030413 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:21.090954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff414c81-c3f9-4074-b594-63d316030413 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:21.091376 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff414c81-c3f9-4074-b594-63d316030413 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:21.420340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ff414c81-c3f9-4074-b594-63d316030413 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:21.432276 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ff414c81-c3f9-4074-b594-63d316030413 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5" status: 200 len: 1215 microversion: 2.1 time: 0.354968 Oct 29 03:30:21.434051 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3233/6246] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:21 2022] GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5 => generated 1215 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:21.468347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7c83f515-0460-434b-a6cb-d8f9b80117c1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:21.469322 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7c83f515-0460-434b-a6cb-d8f9b80117c1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: 9838384c-7cd9-43b0-83cb-e02bf792469b] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:21.483018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c83f515-0460-434b-a6cb-d8f9b80117c1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:21.483860 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c83f515-0460-434b-a6cb-d8f9b80117c1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:21.484291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c83f515-0460-434b-a6cb-d8f9b80117c1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:21.485261 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c83f515-0460-434b-a6cb-d8f9b80117c1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:21.485721 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c83f515-0460-434b-a6cb-d8f9b80117c1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:21.486150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c83f515-0460-434b-a6cb-d8f9b80117c1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:21.510423 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-7c83f515-0460-434b-a6cb-d8f9b80117c1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] HTTP exception thrown: Instance 9838384c-7cd9-43b0-83cb-e02bf792469b could not be found. Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7c83f515-0460-434b-a6cb-d8f9b80117c1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Request method failure captured: Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b HTTP/1.1 Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJ4v6J_CEbSdwxAV73HZRIMDsqeMnqveBewN90I83uq9Gjab2rgrsPLSpX4LtNh66J7nf0t8_2fZJSLmUFvJjlrEsA73XfLud-ejFqLaMuNy-vclgJqnPNS5soCUNPIIh8pL3glDbpD1zSQvZ5vU22blqUxw0D_bhvJ97_GLblzwrj0 Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 0d05826be2f349f6b912822f499d4c2a Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestServerMultinode-1342400253 Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: X-Role: admin,reader,member Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: admin,reader,member Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0d05826be2f349f6b912822f499d4c2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0d05826be2f349f6b912822f499d4c2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0d05826be2f349f6b912822f499d4c2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0d05826be2f349f6b912822f499d4c2a"}]}] Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestServerMultinode-1342400253 Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 0d05826be2f349f6b912822f499d4c2a Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestServerMultinode-1342400253 Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestServerMultinode-1342400253-project-admin Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: f4fd5d7c439049209432c51dc55bb100 Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestServerMultinode-1342400253-project-admin Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 9838384c-7cd9-43b0-83cb-e02bf792469b could not be found. Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '9838384c-7cd9-43b0-83cb-e02bf792469b'} Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9838384c-7cd9-43b0-83cb-e02bf792469b could not be found. Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9838384c-7cd9-43b0-83cb-e02bf792469b could not be found. Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:30:21.512450 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:30:21.519049 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:30:21.519049 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:30:21.519049 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:30:21.519049 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:30:21.519049 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:30:21.519049 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9838384c-7cd9-43b0-83cb-e02bf792469b could not be found. Oct 29 03:30:21.519049 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:30:21.520395 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7c83f515-0460-434b-a6cb-d8f9b80117c1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Returning 404 to user: Instance 9838384c-7cd9-43b0-83cb-e02bf792469b could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:30:21.521466 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7c83f515-0460-434b-a6cb-d8f9b80117c1 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b" status: 404 len: 111 microversion: 2.1 time: 0.057969 Oct 29 03:30:21.522779 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3014/6247] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:21 2022] GET /compute/v2.1/servers/9838384c-7cd9-43b0-83cb-e02bf792469b => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:30:21.537742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-026371e2-8aef-4dbe-8c17-bfdf65c4a72f tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:21.537742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-026371e2-8aef-4dbe-8c17-bfdf65c4a72f tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: c36e2181-6505-40fb-85d9-fe2dc9c027e9] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:21.541399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-026371e2-8aef-4dbe-8c17-bfdf65c4a72f tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:21.541893 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-026371e2-8aef-4dbe-8c17-bfdf65c4a72f tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:21.542324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-026371e2-8aef-4dbe-8c17-bfdf65c4a72f tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:21.543023 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-026371e2-8aef-4dbe-8c17-bfdf65c4a72f tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:21.543476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-026371e2-8aef-4dbe-8c17-bfdf65c4a72f tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:21.543895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-026371e2-8aef-4dbe-8c17-bfdf65c4a72f tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:21.575641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-026371e2-8aef-4dbe-8c17-bfdf65c4a72f tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: c36e2181-6505-40fb-85d9-fe2dc9c027e9] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:30:21.633657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:21.676846 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-026371e2-8aef-4dbe-8c17-bfdf65c4a72f tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "DELETE /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9" status: 204 len: 0 microversion: 2.1 time: 0.149382 Oct 29 03:30:21.681100 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3234/6248] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:30:21 2022] DELETE /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:30:21.686439 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5e43f965-79e4-4d97-be7f-7b8afdf05d96 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:21.687051 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5e43f965-79e4-4d97-be7f-7b8afdf05d96 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: c36e2181-6505-40fb-85d9-fe2dc9c027e9] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:21.694792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e43f965-79e4-4d97-be7f-7b8afdf05d96 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:21.695548 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e43f965-79e4-4d97-be7f-7b8afdf05d96 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:21.696158 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e43f965-79e4-4d97-be7f-7b8afdf05d96 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:21.697063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e43f965-79e4-4d97-be7f-7b8afdf05d96 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:21.697983 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e43f965-79e4-4d97-be7f-7b8afdf05d96 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:21.698650 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e43f965-79e4-4d97-be7f-7b8afdf05d96 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:22.231346 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5e43f965-79e4-4d97-be7f-7b8afdf05d96 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9" status: 200 len: 1654 microversion: 2.1 time: 0.548685 Oct 29 03:30:22.232558 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3015/6249] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:21 2022] GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9 => generated 1654 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:22.461258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ffd0e2a6-3b98-4f9f-b503-b985428b7196 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:22.462018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ffd0e2a6-3b98-4f9f-b503-b985428b7196 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5cd20ffd-4e93-4840-9121-0000956167e5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:22.469517 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffd0e2a6-3b98-4f9f-b503-b985428b7196 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:22.470087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffd0e2a6-3b98-4f9f-b503-b985428b7196 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:22.470563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffd0e2a6-3b98-4f9f-b503-b985428b7196 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:22.471647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffd0e2a6-3b98-4f9f-b503-b985428b7196 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:22.472163 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffd0e2a6-3b98-4f9f-b503-b985428b7196 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:22.472676 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffd0e2a6-3b98-4f9f-b503-b985428b7196 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:22.633069 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ffd0e2a6-3b98-4f9f-b503-b985428b7196 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:22.641944 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ffd0e2a6-3b98-4f9f-b503-b985428b7196 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5" status: 200 len: 1215 microversion: 2.1 time: 0.187154 Oct 29 03:30:22.642849 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3235/6250] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:22 2022] GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5 => generated 1215 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:23.261494 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a9ad5658-9aaa-4f23-998d-43928a9505a2 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:23.262743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a9ad5658-9aaa-4f23-998d-43928a9505a2 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: c36e2181-6505-40fb-85d9-fe2dc9c027e9] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:23.271533 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9ad5658-9aaa-4f23-998d-43928a9505a2 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:23.272843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9ad5658-9aaa-4f23-998d-43928a9505a2 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:23.273843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9ad5658-9aaa-4f23-998d-43928a9505a2 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:23.275399 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9ad5658-9aaa-4f23-998d-43928a9505a2 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:23.276730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9ad5658-9aaa-4f23-998d-43928a9505a2 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:23.277335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a9ad5658-9aaa-4f23-998d-43928a9505a2 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:23.600414 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a9ad5658-9aaa-4f23-998d-43928a9505a2 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9" status: 200 len: 1654 microversion: 2.1 time: 0.343400 Oct 29 03:30:23.601917 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3016/6251] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:23 2022] GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9 => generated 1654 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:23.606484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-b4f99531-bc4d-4010-93c2-4052b7b467e6 req-592364be-75bb-42d0-983c-c9c7a73a4d44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c36e2181-6505-40fb-85d9-fe2dc9c027e9", "name": "network-vif-deleted", "tag": "7318e0b2-f9dc-4104-b011-8a46d1486c11"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:23.621131 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b4f99531-bc4d-4010-93c2-4052b7b467e6 req-592364be-75bb-42d0-983c-c9c7a73a4d44 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:23.622737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b4f99531-bc4d-4010-93c2-4052b7b467e6 req-592364be-75bb-42d0-983c-c9c7a73a4d44 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:23.623555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b4f99531-bc4d-4010-93c2-4052b7b467e6 req-592364be-75bb-42d0-983c-c9c7a73a4d44 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:23.642657 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-b4f99531-bc4d-4010-93c2-4052b7b467e6 req-592364be-75bb-42d0-983c-c9c7a73a4d44 service nova] Creating event network-vif-deleted:7318e0b2-f9dc-4104-b011-8a46d1486c11 for instance c36e2181-6505-40fb-85d9-fe2dc9c027e9 on n-h2-862967-2 Oct 29 03:30:23.649312 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-b4f99531-bc4d-4010-93c2-4052b7b467e6 req-592364be-75bb-42d0-983c-c9c7a73a4d44 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048334 Oct 29 03:30:23.650886 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3236/6252] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:30:23.665062 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d635b690-c99e-4cf3-a44d-d4bfc4b6afe1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:23.665687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d635b690-c99e-4cf3-a44d-d4bfc4b6afe1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5cd20ffd-4e93-4840-9121-0000956167e5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:23.678107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d635b690-c99e-4cf3-a44d-d4bfc4b6afe1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:23.678987 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d635b690-c99e-4cf3-a44d-d4bfc4b6afe1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:23.681940 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d635b690-c99e-4cf3-a44d-d4bfc4b6afe1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:23.683777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d635b690-c99e-4cf3-a44d-d4bfc4b6afe1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:23.684275 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d635b690-c99e-4cf3-a44d-d4bfc4b6afe1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:23.685438 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d635b690-c99e-4cf3-a44d-d4bfc4b6afe1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:23.895955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d635b690-c99e-4cf3-a44d-d4bfc4b6afe1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:23.909161 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d635b690-c99e-4cf3-a44d-d4bfc4b6afe1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5" status: 200 len: 1215 microversion: 2.1 time: 0.247980 Oct 29 03:30:23.910819 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3017/6253] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:23 2022] GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5 => generated 1215 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:24.627606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bbbb917c-5a47-48a7-a4bb-8e85d58f94e2 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:24.628360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bbbb917c-5a47-48a7-a4bb-8e85d58f94e2 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] [instance: c36e2181-6505-40fb-85d9-fe2dc9c027e9] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:24.637605 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbbb917c-5a47-48a7-a4bb-8e85d58f94e2 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:24.638171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbbb917c-5a47-48a7-a4bb-8e85d58f94e2 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:24.638669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbbb917c-5a47-48a7-a4bb-8e85d58f94e2 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:24.639871 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbbb917c-5a47-48a7-a4bb-8e85d58f94e2 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:24.640336 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbbb917c-5a47-48a7-a4bb-8e85d58f94e2 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:24.640983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbbb917c-5a47-48a7-a4bb-8e85d58f94e2 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:24.655926 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-bbbb917c-5a47-48a7-a4bb-8e85d58f94e2 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] HTTP exception thrown: Instance c36e2181-6505-40fb-85d9-fe2dc9c027e9 could not be found. Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bbbb917c-5a47-48a7-a4bb-8e85d58f94e2 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Request method failure captured: Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9 HTTP/1.1 Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJ4v6J_CEbSdwxAV73HZRIMDsqeMnqveBewN90I83uq9Gjab2rgrsPLSpX4LtNh66J7nf0t8_2fZJSLmUFvJjlrEsA73XfLud-ejFqLaMuNy-vclgJqnPNS5soCUNPIIh8pL3glDbpD1zSQvZ5vU22blqUxw0D_bhvJ97_GLblzwrj0 Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 0d05826be2f349f6b912822f499d4c2a Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-TestServerMultinode-1342400253 Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: X-Role: admin,reader,member Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: admin,reader,member Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0d05826be2f349f6b912822f499d4c2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0d05826be2f349f6b912822f499d4c2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0d05826be2f349f6b912822f499d4c2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0d05826be2f349f6b912822f499d4c2a"}]}] Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-TestServerMultinode-1342400253 Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 0d05826be2f349f6b912822f499d4c2a Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-TestServerMultinode-1342400253 Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-TestServerMultinode-1342400253-project-admin Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: f4fd5d7c439049209432c51dc55bb100 Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-TestServerMultinode-1342400253-project-admin Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance c36e2181-6505-40fb-85d9-fe2dc9c027e9 could not be found. Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'c36e2181-6505-40fb-85d9-fe2dc9c027e9'} Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c36e2181-6505-40fb-85d9-fe2dc9c027e9 could not be found. Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c36e2181-6505-40fb-85d9-fe2dc9c027e9 could not be found. Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:30:24.658016 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:30:24.663059 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:30:24.663059 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:30:24.663059 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:30:24.663059 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:30:24.663059 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:30:24.663059 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c36e2181-6505-40fb-85d9-fe2dc9c027e9 could not be found. Oct 29 03:30:24.663059 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:30:24.664301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bbbb917c-5a47-48a7-a4bb-8e85d58f94e2 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] Returning 404 to user: Instance c36e2181-6505-40fb-85d9-fe2dc9c027e9 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:30:24.665284 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bbbb917c-5a47-48a7-a4bb-8e85d58f94e2 tempest-TestServerMultinode-1342400253 tempest-TestServerMultinode-1342400253-project-admin] 10.222.0.46 "GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9" status: 404 len: 111 microversion: 2.1 time: 0.042305 Oct 29 03:30:24.665864 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3237/6254] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:24 2022] GET /compute/v2.1/servers/c36e2181-6505-40fb-85d9-fe2dc9c027e9 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:30:24.936985 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a3a8884f-d972-420d-9d2a-a162eac38ccf tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:24.937709 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a3a8884f-d972-420d-9d2a-a162eac38ccf tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5cd20ffd-4e93-4840-9121-0000956167e5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:24.945992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3a8884f-d972-420d-9d2a-a162eac38ccf tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:24.947182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3a8884f-d972-420d-9d2a-a162eac38ccf tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:24.947830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3a8884f-d972-420d-9d2a-a162eac38ccf tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:24.948882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3a8884f-d972-420d-9d2a-a162eac38ccf tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:24.951363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3a8884f-d972-420d-9d2a-a162eac38ccf tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:24.952667 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3a8884f-d972-420d-9d2a-a162eac38ccf tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:25.158580 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a3a8884f-d972-420d-9d2a-a162eac38ccf tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:25.179401 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a3a8884f-d972-420d-9d2a-a162eac38ccf tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5" status: 200 len: 1203 microversion: 2.1 time: 0.246537 Oct 29 03:30:25.181373 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3018/6255] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:24 2022] GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5 => generated 1203 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:26.205697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-652124cc-0ac4-435d-80aa-76ebfd70e3a7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:26.206661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-652124cc-0ac4-435d-80aa-76ebfd70e3a7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5cd20ffd-4e93-4840-9121-0000956167e5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:26.214820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-652124cc-0ac4-435d-80aa-76ebfd70e3a7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:26.219104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-652124cc-0ac4-435d-80aa-76ebfd70e3a7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:26.220660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-652124cc-0ac4-435d-80aa-76ebfd70e3a7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:26.221940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-652124cc-0ac4-435d-80aa-76ebfd70e3a7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:26.222508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-652124cc-0ac4-435d-80aa-76ebfd70e3a7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:26.223019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-652124cc-0ac4-435d-80aa-76ebfd70e3a7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:26.482899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-652124cc-0ac4-435d-80aa-76ebfd70e3a7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:26.498264 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-652124cc-0ac4-435d-80aa-76ebfd70e3a7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5" status: 200 len: 1203 microversion: 2.1 time: 0.296798 Oct 29 03:30:26.502651 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3238/6256] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:26 2022] GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5 => generated 1203 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:27.523080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ec7d7f6a-b3eb-4061-a1e4-c874e605aada tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:27.524625 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ec7d7f6a-b3eb-4061-a1e4-c874e605aada tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5cd20ffd-4e93-4840-9121-0000956167e5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:27.539635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec7d7f6a-b3eb-4061-a1e4-c874e605aada tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:27.540584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec7d7f6a-b3eb-4061-a1e4-c874e605aada tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:27.541268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec7d7f6a-b3eb-4061-a1e4-c874e605aada tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:27.542228 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec7d7f6a-b3eb-4061-a1e4-c874e605aada tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:27.542908 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec7d7f6a-b3eb-4061-a1e4-c874e605aada tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:27.543555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ec7d7f6a-b3eb-4061-a1e4-c874e605aada tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:27.545313 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:27.841973 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ec7d7f6a-b3eb-4061-a1e4-c874e605aada tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:27.853914 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ec7d7f6a-b3eb-4061-a1e4-c874e605aada tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5" status: 200 len: 1203 microversion: 2.1 time: 0.335137 Oct 29 03:30:27.872367 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3019/6257] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:27 2022] GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5 => generated 1203 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:28.879405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9e2a4004-f7c3-474f-b430-838eb2bfd061 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:28.880030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9e2a4004-f7c3-474f-b430-838eb2bfd061 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5cd20ffd-4e93-4840-9121-0000956167e5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:28.883263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:28.884765 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:28.886375 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:28.898264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e2a4004-f7c3-474f-b430-838eb2bfd061 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:28.899198 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e2a4004-f7c3-474f-b430-838eb2bfd061 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:28.900247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e2a4004-f7c3-474f-b430-838eb2bfd061 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:28.901361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e2a4004-f7c3-474f-b430-838eb2bfd061 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:28.902238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e2a4004-f7c3-474f-b430-838eb2bfd061 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:28.902902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9e2a4004-f7c3-474f-b430-838eb2bfd061 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:29.146606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9e2a4004-f7c3-474f-b430-838eb2bfd061 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:29.155933 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9e2a4004-f7c3-474f-b430-838eb2bfd061 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5" status: 200 len: 1203 microversion: 2.1 time: 0.280123 Oct 29 03:30:29.167376 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3239/6258] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:28 2022] GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5 => generated 1203 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:30.181974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-29589731-b808-4140-a7db-a99ed7ea905e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:30.184730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-29589731-b808-4140-a7db-a99ed7ea905e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5cd20ffd-4e93-4840-9121-0000956167e5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:30.196942 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29589731-b808-4140-a7db-a99ed7ea905e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:30.197740 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29589731-b808-4140-a7db-a99ed7ea905e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:30.198348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29589731-b808-4140-a7db-a99ed7ea905e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:30.200022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29589731-b808-4140-a7db-a99ed7ea905e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:30.200689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29589731-b808-4140-a7db-a99ed7ea905e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:30.201530 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29589731-b808-4140-a7db-a99ed7ea905e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:30.399497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-29589731-b808-4140-a7db-a99ed7ea905e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:30.409732 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-29589731-b808-4140-a7db-a99ed7ea905e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5" status: 200 len: 1203 microversion: 2.1 time: 0.234170 Oct 29 03:30:30.411212 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3020/6259] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:30 2022] GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5 => generated 1203 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:30:31.434399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6ea56db2-c5ca-453d-a0e6-f3b140c345c5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:31.435178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6ea56db2-c5ca-453d-a0e6-f3b140c345c5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5cd20ffd-4e93-4840-9121-0000956167e5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:31.443027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ea56db2-c5ca-453d-a0e6-f3b140c345c5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:31.443282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ea56db2-c5ca-453d-a0e6-f3b140c345c5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:31.444092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ea56db2-c5ca-453d-a0e6-f3b140c345c5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:31.445092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ea56db2-c5ca-453d-a0e6-f3b140c345c5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:31.445714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ea56db2-c5ca-453d-a0e6-f3b140c345c5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:31.446297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ea56db2-c5ca-453d-a0e6-f3b140c345c5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:32.076418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6ea56db2-c5ca-453d-a0e6-f3b140c345c5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:32.082308 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6ea56db2-c5ca-453d-a0e6-f3b140c345c5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5" status: 200 len: 1203 microversion: 2.1 time: 0.651802 Oct 29 03:30:32.082906 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3240/6260] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:31 2022] GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5 => generated 1203 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:30:33.108286 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a00eef99-ee33-47cd-8bbe-119d36c09117 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:33.110340 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a00eef99-ee33-47cd-8bbe-119d36c09117 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5cd20ffd-4e93-4840-9121-0000956167e5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:33.121435 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a00eef99-ee33-47cd-8bbe-119d36c09117 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:33.122220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a00eef99-ee33-47cd-8bbe-119d36c09117 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:33.122948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a00eef99-ee33-47cd-8bbe-119d36c09117 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:33.124338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a00eef99-ee33-47cd-8bbe-119d36c09117 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:33.125046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a00eef99-ee33-47cd-8bbe-119d36c09117 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:33.125788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a00eef99-ee33-47cd-8bbe-119d36c09117 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:33.353136 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a00eef99-ee33-47cd-8bbe-119d36c09117 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:33.373085 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a00eef99-ee33-47cd-8bbe-119d36c09117 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5" status: 200 len: 1203 microversion: 2.1 time: 0.271434 Oct 29 03:30:33.375120 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3021/6261] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:33 2022] GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5 => generated 1203 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:34.166029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0ec9db9e-b2ce-4af8-8bc5-e78c41207152 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-9538729", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:34.402942 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-289fad71-8a8a-4773-93cd-f36343252c84 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:34.405438 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-289fad71-8a8a-4773-93cd-f36343252c84 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5cd20ffd-4e93-4840-9121-0000956167e5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:34.415196 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-289fad71-8a8a-4773-93cd-f36343252c84 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:34.415681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-289fad71-8a8a-4773-93cd-f36343252c84 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:34.416113 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-289fad71-8a8a-4773-93cd-f36343252c84 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:34.417084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-289fad71-8a8a-4773-93cd-f36343252c84 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:34.417710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-289fad71-8a8a-4773-93cd-f36343252c84 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:34.418283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-289fad71-8a8a-4773-93cd-f36343252c84 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:34.499810 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-0ec9db9e-b2ce-4af8-8bc5-e78c41207152 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] validate_networks() for None {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:30:34.579491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-289fad71-8a8a-4773-93cd-f36343252c84 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:34.589034 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-289fad71-8a8a-4773-93cd-f36343252c84 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5" status: 200 len: 1203 microversion: 2.1 time: 0.193555 Oct 29 03:30:34.589808 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3022/6262] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:34 2022] GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5 => generated 1203 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:34.828815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-0ec9db9e-b2ce-4af8-8bc5-e78c41207152 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:30:34.829279 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-0ec9db9e-b2ce-4af8-8bc5-e78c41207152 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:30:34.829781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-0ec9db9e-b2ce-4af8-8bc5-e78c41207152 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:30:34.830317 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-0ec9db9e-b2ce-4af8-8bc5-e78c41207152 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:30:34.830665 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-0ec9db9e-b2ce-4af8-8bc5-e78c41207152 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:30:34.841397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ec9db9e-b2ce-4af8-8bc5-e78c41207152 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:34.841916 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ec9db9e-b2ce-4af8-8bc5-e78c41207152 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:34.842424 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ec9db9e-b2ce-4af8-8bc5-e78c41207152 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:34.843222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ec9db9e-b2ce-4af8-8bc5-e78c41207152 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:34.843827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ec9db9e-b2ce-4af8-8bc5-e78c41207152 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:34.844261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ec9db9e-b2ce-4af8-8bc5-e78c41207152 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:34.864714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-0ec9db9e-b2ce-4af8-8bc5-e78c41207152 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Getting quotas for project 2e3c72f8f945410e8694b9969bb18cb7. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:30:34.870948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-0ec9db9e-b2ce-4af8-8bc5-e78c41207152 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Getting quotas for user a2e9fd5cce1e44b984a26af49deb90b3 and project 2e3c72f8f945410e8694b9969bb18cb7. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:30:34.884121 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0ec9db9e-b2ce-4af8-8bc5-e78c41207152 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:30:34.886658 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0ec9db9e-b2ce-4af8-8bc5-e78c41207152 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] [instance: 7e62b4e0-1c01-486d-8894-68911bfe65df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:30:34.936478 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0ec9db9e-b2ce-4af8-8bc5-e78c41207152 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.774359 Oct 29 03:30:34.937157 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3241/6263] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:30:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:30:34.949002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5f68d405-2c73-4b6d-9712-5515dde8d8a6 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:34.949883 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5f68d405-2c73-4b6d-9712-5515dde8d8a6 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] [instance: 7e62b4e0-1c01-486d-8894-68911bfe65df] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:35.008934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5f68d405-2c73-4b6d-9712-5515dde8d8a6 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9fd5cce1e44b984a26af49deb90b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3c72f8f945410e8694b9969bb18cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:35.016820 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5f68d405-2c73-4b6d-9712-5515dde8d8a6 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] 10.222.0.46 "GET /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df" status: 200 len: 1211 microversion: 2.1 time: 0.072157 Oct 29 03:30:35.017562 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3023/6264] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:34 2022] GET /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df => generated 1211 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:30:35.307641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-de05547d-abe8-4b8b-a15f-0ceab97cb8d8 req-a4e1e760-f203-4961-8ac8-c378fd9166dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cd20ffd-4e93-4840-9121-0000956167e5", "name": "network-vif-plugged", "status": "completed", "tag": "d8c13600-e9ab-468e-983a-36aedd7b3053"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:35.320076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-de05547d-abe8-4b8b-a15f-0ceab97cb8d8 req-a4e1e760-f203-4961-8ac8-c378fd9166dc service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:35.320862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-de05547d-abe8-4b8b-a15f-0ceab97cb8d8 req-a4e1e760-f203-4961-8ac8-c378fd9166dc service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:35.321423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-de05547d-abe8-4b8b-a15f-0ceab97cb8d8 req-a4e1e760-f203-4961-8ac8-c378fd9166dc service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:35.334072 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-de05547d-abe8-4b8b-a15f-0ceab97cb8d8 req-a4e1e760-f203-4961-8ac8-c378fd9166dc service nova] Creating event network-vif-plugged:d8c13600-e9ab-468e-983a-36aedd7b3053 for instance 5cd20ffd-4e93-4840-9121-0000956167e5 on n-h2-862967-2 Oct 29 03:30:35.339768 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-de05547d-abe8-4b8b-a15f-0ceab97cb8d8 req-a4e1e760-f203-4961-8ac8-c378fd9166dc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037256 Oct 29 03:30:35.340710 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3242/6265] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:30:35.615113 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-76e25a82-535e-4ecc-8779-96e64a647c71 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:35.615728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-76e25a82-535e-4ecc-8779-96e64a647c71 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5cd20ffd-4e93-4840-9121-0000956167e5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:35.623777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-76e25a82-535e-4ecc-8779-96e64a647c71 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:35.624401 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-76e25a82-535e-4ecc-8779-96e64a647c71 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:35.624679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-76e25a82-535e-4ecc-8779-96e64a647c71 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:35.625414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-76e25a82-535e-4ecc-8779-96e64a647c71 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:35.625840 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-76e25a82-535e-4ecc-8779-96e64a647c71 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:35.626284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-76e25a82-535e-4ecc-8779-96e64a647c71 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:35.766662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-76e25a82-535e-4ecc-8779-96e64a647c71 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:35.774712 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-76e25a82-535e-4ecc-8779-96e64a647c71 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5" status: 200 len: 1203 microversion: 2.1 time: 0.163763 Oct 29 03:30:35.775299 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3024/6266] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:35 2022] GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5 => generated 1203 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:36.040194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-34a959e9-0503-432d-9eed-9865d5c24469 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:36.040835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-34a959e9-0503-432d-9eed-9865d5c24469 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] [instance: 7e62b4e0-1c01-486d-8894-68911bfe65df] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:36.047289 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34a959e9-0503-432d-9eed-9865d5c24469 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:36.047768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34a959e9-0503-432d-9eed-9865d5c24469 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:36.048203 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34a959e9-0503-432d-9eed-9865d5c24469 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:36.048936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34a959e9-0503-432d-9eed-9865d5c24469 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:36.049467 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34a959e9-0503-432d-9eed-9865d5c24469 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:36.049890 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34a959e9-0503-432d-9eed-9865d5c24469 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:36.117022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-34a959e9-0503-432d-9eed-9865d5c24469 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9fd5cce1e44b984a26af49deb90b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3c72f8f945410e8694b9969bb18cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:36.125153 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-34a959e9-0503-432d-9eed-9865d5c24469 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] 10.222.0.46 "GET /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df" status: 200 len: 1263 microversion: 2.1 time: 0.089384 Oct 29 03:30:36.126024 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3243/6267] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:36 2022] GET /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df => generated 1263 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:36.798035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d8a184de-401a-41c8-bd63-89e5bcf878ed tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:36.798925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d8a184de-401a-41c8-bd63-89e5bcf878ed tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5cd20ffd-4e93-4840-9121-0000956167e5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:36.801177 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:30:36.801424 n-d-862967-2 devstack@n-api.service[127125]: Sat Oct 29 03:30:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5 (ip 10.222.0.46) !!! Oct 29 03:30:36.804202 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:36.817083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8a184de-401a-41c8-bd63-89e5bcf878ed tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:36.817569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8a184de-401a-41c8-bd63-89e5bcf878ed tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:36.818003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8a184de-401a-41c8-bd63-89e5bcf878ed tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:36.818708 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8a184de-401a-41c8-bd63-89e5bcf878ed tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:36.819160 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8a184de-401a-41c8-bd63-89e5bcf878ed tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:36.819578 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8a184de-401a-41c8-bd63-89e5bcf878ed tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:37.000968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d8a184de-401a-41c8-bd63-89e5bcf878ed tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:37.009929 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d8a184de-401a-41c8-bd63-89e5bcf878ed tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5" status: 200 len: 1389 microversion: 2.1 time: 0.215745 Oct 29 03:30:37.010917 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3025/6268] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:36 2022] GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5 => generated 1389 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:37.033689 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a17aad9e-5913-4772-9199-3ca11b44acb0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:37.034526 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a17aad9e-5913-4772-9199-3ca11b44acb0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5cd20ffd-4e93-4840-9121-0000956167e5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:37.041994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a17aad9e-5913-4772-9199-3ca11b44acb0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:37.042497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a17aad9e-5913-4772-9199-3ca11b44acb0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:37.042933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a17aad9e-5913-4772-9199-3ca11b44acb0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:37.043643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a17aad9e-5913-4772-9199-3ca11b44acb0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:37.044099 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a17aad9e-5913-4772-9199-3ca11b44acb0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:37.044574 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a17aad9e-5913-4772-9199-3ca11b44acb0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:37.151293 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b9212291-a3d8-4d26-9c55-22e5f091efdc tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:37.152199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b9212291-a3d8-4d26-9c55-22e5f091efdc tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] [instance: 7e62b4e0-1c01-486d-8894-68911bfe65df] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:37.161468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9212291-a3d8-4d26-9c55-22e5f091efdc tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:37.161967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9212291-a3d8-4d26-9c55-22e5f091efdc tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:37.162723 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9212291-a3d8-4d26-9c55-22e5f091efdc tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:37.164286 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9212291-a3d8-4d26-9c55-22e5f091efdc tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:37.165066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9212291-a3d8-4d26-9c55-22e5f091efdc tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:37.165694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b9212291-a3d8-4d26-9c55-22e5f091efdc tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:37.216921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a17aad9e-5913-4772-9199-3ca11b44acb0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:37.231494 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a17aad9e-5913-4772-9199-3ca11b44acb0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5" status: 200 len: 1389 microversion: 2.1 time: 0.201933 Oct 29 03:30:37.234490 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3244/6269] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:37 2022] GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5 => generated 1389 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:37.256319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c37e64be-5d0a-4f82-ba05-c399e9e78325 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:37.257451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c37e64be-5d0a-4f82-ba05-c399e9e78325 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5cd20ffd-4e93-4840-9121-0000956167e5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:37.264767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c37e64be-5d0a-4f82-ba05-c399e9e78325 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:37.265962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c37e64be-5d0a-4f82-ba05-c399e9e78325 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:37.266644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c37e64be-5d0a-4f82-ba05-c399e9e78325 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:37.267681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c37e64be-5d0a-4f82-ba05-c399e9e78325 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:37.268393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c37e64be-5d0a-4f82-ba05-c399e9e78325 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:37.269093 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c37e64be-5d0a-4f82-ba05-c399e9e78325 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:37.436770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c37e64be-5d0a-4f82-ba05-c399e9e78325 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:37.445616 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c37e64be-5d0a-4f82-ba05-c399e9e78325 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5" status: 200 len: 1389 microversion: 2.1 time: 0.193800 Oct 29 03:30:37.446223 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3245/6270] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:37 2022] GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5 => generated 1389 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:37.467982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0f27471a-9382-487e-81f7-bba95a632b58 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:37.468483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0f27471a-9382-487e-81f7-bba95a632b58 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5cd20ffd-4e93-4840-9121-0000956167e5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:37.475055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f27471a-9382-487e-81f7-bba95a632b58 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:37.475549 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f27471a-9382-487e-81f7-bba95a632b58 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:37.475985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f27471a-9382-487e-81f7-bba95a632b58 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:37.476747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f27471a-9382-487e-81f7-bba95a632b58 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:37.477261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f27471a-9382-487e-81f7-bba95a632b58 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:37.477643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f27471a-9382-487e-81f7-bba95a632b58 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:37.505271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0f27471a-9382-487e-81f7-bba95a632b58 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5cd20ffd-4e93-4840-9121-0000956167e5] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:30:37.588568 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0f27471a-9382-487e-81f7-bba95a632b58 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5" status: 204 len: 0 microversion: 2.1 time: 0.124198 Oct 29 03:30:37.589491 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3246/6271] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:30:37 2022] DELETE /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 03:30:37.600576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6bc6b607-e080-4654-8261-6019cce4a77f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:37.601523 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6bc6b607-e080-4654-8261-6019cce4a77f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5cd20ffd-4e93-4840-9121-0000956167e5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:37.608679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6bc6b607-e080-4654-8261-6019cce4a77f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:37.609300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6bc6b607-e080-4654-8261-6019cce4a77f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:37.609803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6bc6b607-e080-4654-8261-6019cce4a77f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:37.610522 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6bc6b607-e080-4654-8261-6019cce4a77f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:37.611034 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6bc6b607-e080-4654-8261-6019cce4a77f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:37.611400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6bc6b607-e080-4654-8261-6019cce4a77f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:37.758207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6bc6b607-e080-4654-8261-6019cce4a77f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:37.767221 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6bc6b607-e080-4654-8261-6019cce4a77f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5" status: 200 len: 1395 microversion: 2.1 time: 0.171326 Oct 29 03:30:37.767826 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3247/6272] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:37 2022] GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5 => generated 1395 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:37.804487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b9212291-a3d8-4d26-9c55-22e5f091efdc tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9fd5cce1e44b984a26af49deb90b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3c72f8f945410e8694b9969bb18cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:37.813409 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b9212291-a3d8-4d26-9c55-22e5f091efdc tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] 10.222.0.46 "GET /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df" status: 200 len: 1311 microversion: 2.1 time: 0.668199 Oct 29 03:30:37.814059 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3026/6273] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:37 2022] GET /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df => generated 1311 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:38.375552 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-30887ef7-64ac-426e-b96d-c532805de730 req-6f83b3c0-f934-4746-8ed6-0a77a1cb51f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e62b4e0-1c01-486d-8894-68911bfe65df", "tag": "33d4ebf7-a896-4e00-a28f-a3195b60800c"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:38.386718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-30887ef7-64ac-426e-b96d-c532805de730 req-6f83b3c0-f934-4746-8ed6-0a77a1cb51f8 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:38.387180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-30887ef7-64ac-426e-b96d-c532805de730 req-6f83b3c0-f934-4746-8ed6-0a77a1cb51f8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:38.388139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-30887ef7-64ac-426e-b96d-c532805de730 req-6f83b3c0-f934-4746-8ed6-0a77a1cb51f8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:38.400100 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-30887ef7-64ac-426e-b96d-c532805de730 req-6f83b3c0-f934-4746-8ed6-0a77a1cb51f8 service nova] Creating event network-changed:33d4ebf7-a896-4e00-a28f-a3195b60800c for instance 7e62b4e0-1c01-486d-8894-68911bfe65df on n-h1-862967-2 Oct 29 03:30:38.405132 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-30887ef7-64ac-426e-b96d-c532805de730 req-6f83b3c0-f934-4746-8ed6-0a77a1cb51f8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033480 Oct 29 03:30:38.405902 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3248/6274] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:30:38.791747 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c6f3a2db-f6da-4413-a53f-3a266b18ed75 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:38.792361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c6f3a2db-f6da-4413-a53f-3a266b18ed75 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5cd20ffd-4e93-4840-9121-0000956167e5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:38.799085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6f3a2db-f6da-4413-a53f-3a266b18ed75 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:38.799548 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6f3a2db-f6da-4413-a53f-3a266b18ed75 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:38.800223 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6f3a2db-f6da-4413-a53f-3a266b18ed75 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:38.800972 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6f3a2db-f6da-4413-a53f-3a266b18ed75 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:38.801437 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6f3a2db-f6da-4413-a53f-3a266b18ed75 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:38.801866 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6f3a2db-f6da-4413-a53f-3a266b18ed75 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:38.837957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a7f89894-aab8-4f98-8f76-061c7cf4e560 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:38.839098 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a7f89894-aab8-4f98-8f76-061c7cf4e560 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] [instance: 7e62b4e0-1c01-486d-8894-68911bfe65df] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:38.846542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7f89894-aab8-4f98-8f76-061c7cf4e560 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:38.846542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7f89894-aab8-4f98-8f76-061c7cf4e560 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:38.846945 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7f89894-aab8-4f98-8f76-061c7cf4e560 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:38.847338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7f89894-aab8-4f98-8f76-061c7cf4e560 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:38.847856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7f89894-aab8-4f98-8f76-061c7cf4e560 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:38.848291 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7f89894-aab8-4f98-8f76-061c7cf4e560 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:38.944325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c6f3a2db-f6da-4413-a53f-3a266b18ed75 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:38.952935 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c6f3a2db-f6da-4413-a53f-3a266b18ed75 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5" status: 200 len: 1395 microversion: 2.1 time: 0.165187 Oct 29 03:30:38.953595 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3027/6275] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:38 2022] GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5 => generated 1395 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:38.993185 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a7f89894-aab8-4f98-8f76-061c7cf4e560 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9fd5cce1e44b984a26af49deb90b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3c72f8f945410e8694b9969bb18cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:39.002767 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a7f89894-aab8-4f98-8f76-061c7cf4e560 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] 10.222.0.46 "GET /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df" status: 200 len: 1311 microversion: 2.1 time: 0.169557 Oct 29 03:30:39.003386 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3249/6276] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:38 2022] GET /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df => generated 1311 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:39.976713 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b538b186-9533-4a36-988a-e94c47ad4c70 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:39.977355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b538b186-9533-4a36-988a-e94c47ad4c70 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5cd20ffd-4e93-4840-9121-0000956167e5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:39.985303 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b538b186-9533-4a36-988a-e94c47ad4c70 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:39.985894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b538b186-9533-4a36-988a-e94c47ad4c70 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:39.986311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b538b186-9533-4a36-988a-e94c47ad4c70 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:39.987157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b538b186-9533-4a36-988a-e94c47ad4c70 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:39.987636 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b538b186-9533-4a36-988a-e94c47ad4c70 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:39.988038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b538b186-9533-4a36-988a-e94c47ad4c70 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:40.026152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1ea3a616-06c5-457f-adf8-e5c28d02ffd8 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:40.026979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1ea3a616-06c5-457f-adf8-e5c28d02ffd8 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] [instance: 7e62b4e0-1c01-486d-8894-68911bfe65df] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:40.034409 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ea3a616-06c5-457f-adf8-e5c28d02ffd8 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:40.035020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ea3a616-06c5-457f-adf8-e5c28d02ffd8 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:40.035518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ea3a616-06c5-457f-adf8-e5c28d02ffd8 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:40.036292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ea3a616-06c5-457f-adf8-e5c28d02ffd8 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:40.036834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ea3a616-06c5-457f-adf8-e5c28d02ffd8 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:40.037427 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ea3a616-06c5-457f-adf8-e5c28d02ffd8 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:40.082802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b538b186-9533-4a36-988a-e94c47ad4c70 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:40.092400 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b538b186-9533-4a36-988a-e94c47ad4c70 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5" status: 200 len: 1188 microversion: 2.1 time: 0.119794 Oct 29 03:30:40.100375 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3028/6277] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:39 2022] GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5 => generated 1188 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:40.186588 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1ea3a616-06c5-457f-adf8-e5c28d02ffd8 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9fd5cce1e44b984a26af49deb90b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3c72f8f945410e8694b9969bb18cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:40.194699 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1ea3a616-06c5-457f-adf8-e5c28d02ffd8 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] 10.222.0.46 "GET /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df" status: 200 len: 1311 microversion: 2.1 time: 0.172363 Oct 29 03:30:40.195293 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3250/6278] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:40 2022] GET /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df => generated 1311 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:30:40.422269 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-f801b73c-3f5b-4895-afa5-595b977a8444 req-ad0b9a9f-8f50-4c4b-8680-61fb11828235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cd20ffd-4e93-4840-9121-0000956167e5", "name": "network-vif-deleted", "tag": "d8c13600-e9ab-468e-983a-36aedd7b3053"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:40.433604 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f801b73c-3f5b-4895-afa5-595b977a8444 req-ad0b9a9f-8f50-4c4b-8680-61fb11828235 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:40.434178 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f801b73c-3f5b-4895-afa5-595b977a8444 req-ad0b9a9f-8f50-4c4b-8680-61fb11828235 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:40.434662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f801b73c-3f5b-4895-afa5-595b977a8444 req-ad0b9a9f-8f50-4c4b-8680-61fb11828235 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:40.447415 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-f801b73c-3f5b-4895-afa5-595b977a8444 req-ad0b9a9f-8f50-4c4b-8680-61fb11828235 service nova] Creating event network-vif-deleted:d8c13600-e9ab-468e-983a-36aedd7b3053 for instance 5cd20ffd-4e93-4840-9121-0000956167e5 on n-h2-862967-2 Oct 29 03:30:40.452859 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-f801b73c-3f5b-4895-afa5-595b977a8444 req-ad0b9a9f-8f50-4c4b-8680-61fb11828235 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034581 Oct 29 03:30:40.459351 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3029/6279] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:30:41.115701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0be33ca9-29c3-464d-9506-47da4a40b3d3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:41.116314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0be33ca9-29c3-464d-9506-47da4a40b3d3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5cd20ffd-4e93-4840-9121-0000956167e5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:41.123676 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0be33ca9-29c3-464d-9506-47da4a40b3d3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:41.124193 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0be33ca9-29c3-464d-9506-47da4a40b3d3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:41.124668 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0be33ca9-29c3-464d-9506-47da4a40b3d3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:41.125426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0be33ca9-29c3-464d-9506-47da4a40b3d3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:41.125966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0be33ca9-29c3-464d-9506-47da4a40b3d3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:41.126475 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0be33ca9-29c3-464d-9506-47da4a40b3d3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:41.192155 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0be33ca9-29c3-464d-9506-47da4a40b3d3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:41.200731 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0be33ca9-29c3-464d-9506-47da4a40b3d3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5" status: 200 len: 1188 microversion: 2.1 time: 0.088840 Oct 29 03:30:41.201355 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3251/6280] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:41 2022] GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5 => generated 1188 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:30:41.220038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4190240f-52b2-4e31-88b7-6e862f38fe78 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:41.220839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4190240f-52b2-4e31-88b7-6e862f38fe78 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] [instance: 7e62b4e0-1c01-486d-8894-68911bfe65df] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:41.227784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4190240f-52b2-4e31-88b7-6e862f38fe78 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:41.228281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4190240f-52b2-4e31-88b7-6e862f38fe78 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:41.228787 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4190240f-52b2-4e31-88b7-6e862f38fe78 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:41.229517 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4190240f-52b2-4e31-88b7-6e862f38fe78 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:41.229974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4190240f-52b2-4e31-88b7-6e862f38fe78 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:41.230413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4190240f-52b2-4e31-88b7-6e862f38fe78 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:41.392115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4190240f-52b2-4e31-88b7-6e862f38fe78 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9fd5cce1e44b984a26af49deb90b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3c72f8f945410e8694b9969bb18cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:41.400622 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4190240f-52b2-4e31-88b7-6e862f38fe78 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] 10.222.0.46 "GET /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df" status: 200 len: 1311 microversion: 2.1 time: 0.185914 Oct 29 03:30:41.401245 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3030/6281] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:41 2022] GET /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df => generated 1311 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:42.225443 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9f9b2619-7aeb-4742-9f12-1d3995157478 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:42.226480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9f9b2619-7aeb-4742-9f12-1d3995157478 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5cd20ffd-4e93-4840-9121-0000956167e5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:42.237399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f9b2619-7aeb-4742-9f12-1d3995157478 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:42.238245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f9b2619-7aeb-4742-9f12-1d3995157478 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:42.238994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f9b2619-7aeb-4742-9f12-1d3995157478 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:42.240451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f9b2619-7aeb-4742-9f12-1d3995157478 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:42.241260 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f9b2619-7aeb-4742-9f12-1d3995157478 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:42.241965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f9b2619-7aeb-4742-9f12-1d3995157478 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:42.319158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9f9b2619-7aeb-4742-9f12-1d3995157478 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:42.323178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:42.331053 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9f9b2619-7aeb-4742-9f12-1d3995157478 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5" status: 200 len: 1188 microversion: 2.1 time: 0.111022 Oct 29 03:30:42.331936 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3252/6282] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:42 2022] GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5 => generated 1188 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:42.426093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d5841f87-f023-48af-85a2-6571e0347b88 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:42.426767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d5841f87-f023-48af-85a2-6571e0347b88 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] [instance: 7e62b4e0-1c01-486d-8894-68911bfe65df] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:42.436577 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5841f87-f023-48af-85a2-6571e0347b88 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:42.437092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5841f87-f023-48af-85a2-6571e0347b88 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:42.437532 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5841f87-f023-48af-85a2-6571e0347b88 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:42.438266 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5841f87-f023-48af-85a2-6571e0347b88 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:42.438721 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5841f87-f023-48af-85a2-6571e0347b88 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:42.439402 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5841f87-f023-48af-85a2-6571e0347b88 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:42.743253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d5841f87-f023-48af-85a2-6571e0347b88 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9fd5cce1e44b984a26af49deb90b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3c72f8f945410e8694b9969bb18cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:42.751697 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d5841f87-f023-48af-85a2-6571e0347b88 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] 10.222.0.46 "GET /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df" status: 200 len: 1311 microversion: 2.1 time: 0.331247 Oct 29 03:30:42.752316 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3031/6283] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:42 2022] GET /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df => generated 1311 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:43.355182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4150b2d7-714b-4d9a-a393-7c91d4e997bc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:43.355748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4150b2d7-714b-4d9a-a393-7c91d4e997bc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5cd20ffd-4e93-4840-9121-0000956167e5] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:43.363702 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4150b2d7-714b-4d9a-a393-7c91d4e997bc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:43.364210 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4150b2d7-714b-4d9a-a393-7c91d4e997bc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:43.364725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4150b2d7-714b-4d9a-a393-7c91d4e997bc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:43.365465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4150b2d7-714b-4d9a-a393-7c91d4e997bc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:43.365926 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4150b2d7-714b-4d9a-a393-7c91d4e997bc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:43.366370 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4150b2d7-714b-4d9a-a393-7c91d4e997bc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:43.441994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4150b2d7-714b-4d9a-a393-7c91d4e997bc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:43.450443 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4150b2d7-714b-4d9a-a393-7c91d4e997bc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5" status: 200 len: 1188 microversion: 2.1 time: 0.099920 Oct 29 03:30:43.451021 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3253/6284] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:43 2022] GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5 => generated 1188 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:43.776694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ccb55252-a09f-419e-a811-40e6db710c93 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:43.777337 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ccb55252-a09f-419e-a811-40e6db710c93 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] [instance: 7e62b4e0-1c01-486d-8894-68911bfe65df] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:43.784801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ccb55252-a09f-419e-a811-40e6db710c93 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:43.785290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ccb55252-a09f-419e-a811-40e6db710c93 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:43.785714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ccb55252-a09f-419e-a811-40e6db710c93 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:43.786403 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ccb55252-a09f-419e-a811-40e6db710c93 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:43.786842 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ccb55252-a09f-419e-a811-40e6db710c93 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:43.787254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ccb55252-a09f-419e-a811-40e6db710c93 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:43.934760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ccb55252-a09f-419e-a811-40e6db710c93 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9fd5cce1e44b984a26af49deb90b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3c72f8f945410e8694b9969bb18cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:43.938317 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:43.943644 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ccb55252-a09f-419e-a811-40e6db710c93 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] 10.222.0.46 "GET /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df" status: 200 len: 1311 microversion: 2.1 time: 0.172208 Oct 29 03:30:43.944223 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3032/6285] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:43 2022] GET /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df => generated 1311 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:44.038124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-7d491007-8fc6-474d-8e4d-6a525134b39f req-35664e3b-0ceb-4e16-acf4-1c06df827824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e62b4e0-1c01-486d-8894-68911bfe65df", "name": "network-vif-plugged", "status": "completed", "tag": "33d4ebf7-a896-4e00-a28f-a3195b60800c"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:44.048857 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7d491007-8fc6-474d-8e4d-6a525134b39f req-35664e3b-0ceb-4e16-acf4-1c06df827824 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:44.049323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7d491007-8fc6-474d-8e4d-6a525134b39f req-35664e3b-0ceb-4e16-acf4-1c06df827824 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:44.049740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7d491007-8fc6-474d-8e4d-6a525134b39f req-35664e3b-0ceb-4e16-acf4-1c06df827824 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:44.061268 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-7d491007-8fc6-474d-8e4d-6a525134b39f req-35664e3b-0ceb-4e16-acf4-1c06df827824 service nova] Creating event network-vif-plugged:33d4ebf7-a896-4e00-a28f-a3195b60800c for instance 7e62b4e0-1c01-486d-8894-68911bfe65df on n-h1-862967-2 Oct 29 03:30:44.066219 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-7d491007-8fc6-474d-8e4d-6a525134b39f req-35664e3b-0ceb-4e16-acf4-1c06df827824 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032815 Oct 29 03:30:44.066826 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3254/6286] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:30:44.474442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-71386f24-738f-4f40-8113-9ee22b50910e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:44.475053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-71386f24-738f-4f40-8113-9ee22b50910e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5cd20ffd-4e93-4840-9121-0000956167e5] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:44.482164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-71386f24-738f-4f40-8113-9ee22b50910e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:44.482656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-71386f24-738f-4f40-8113-9ee22b50910e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:44.483091 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-71386f24-738f-4f40-8113-9ee22b50910e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:44.483790 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-71386f24-738f-4f40-8113-9ee22b50910e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:44.484221 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-71386f24-738f-4f40-8113-9ee22b50910e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:44.484698 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-71386f24-738f-4f40-8113-9ee22b50910e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:44.498938 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-71386f24-738f-4f40-8113-9ee22b50910e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] HTTP exception thrown: Instance 5cd20ffd-4e93-4840-9121-0000956167e5 could not be found. Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-71386f24-738f-4f40-8113-9ee22b50910e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Request method failure captured: Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5 HTTP/1.1 Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJ4OGFERKLIttSSPB0-5-jXA-TX6OM8jt9EJzgHtp2De1EitDQkx8TOt6_WbUmBu_Y6n6LIcWJu35cEqto8LlaLBvd7Fx6PpdDw_gDp2R4doflmhUMo3Zw8gq8dju5JmvbgI04aG1xuqlCslUnwpoihX0XXo_veRrdoDDtMm482XfyM Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7c164fcbf0df4575b66149f2298496e3"}]}] Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestVolumeBootPattern-894604406 Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 187e7d6474db4b8e813ff31fcddb4034 Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 5cd20ffd-4e93-4840-9121-0000956167e5 could not be found. Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '5cd20ffd-4e93-4840-9121-0000956167e5'} Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cd20ffd-4e93-4840-9121-0000956167e5 could not be found. Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cd20ffd-4e93-4840-9121-0000956167e5 could not be found. Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:30:44.500690 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:30:44.506292 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:30:44.506292 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:30:44.506292 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:30:44.506292 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:30:44.506292 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:30:44.506292 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cd20ffd-4e93-4840-9121-0000956167e5 could not be found. Oct 29 03:30:44.506292 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:30:44.506292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-71386f24-738f-4f40-8113-9ee22b50910e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Returning 404 to user: Instance 5cd20ffd-4e93-4840-9121-0000956167e5 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:30:44.506292 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-71386f24-738f-4f40-8113-9ee22b50910e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5" status: 404 len: 111 microversion: 2.1 time: 0.032155 Oct 29 03:30:44.506292 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3033/6287] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:44 2022] GET /compute/v2.1/servers/5cd20ffd-4e93-4840-9121-0000956167e5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:30:44.965228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:44.965889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:44.970680 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8e18111d-1c4a-4076-b08b-69db7a63e0e3 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:44.971398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8e18111d-1c4a-4076-b08b-69db7a63e0e3 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] [instance: 7e62b4e0-1c01-486d-8894-68911bfe65df] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:44.978566 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8e18111d-1c4a-4076-b08b-69db7a63e0e3 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:44.979052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8e18111d-1c4a-4076-b08b-69db7a63e0e3 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:44.979487 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8e18111d-1c4a-4076-b08b-69db7a63e0e3 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:44.980245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8e18111d-1c4a-4076-b08b-69db7a63e0e3 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:44.980728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8e18111d-1c4a-4076-b08b-69db7a63e0e3 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:44.981157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8e18111d-1c4a-4076-b08b-69db7a63e0e3 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:45.117719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8e18111d-1c4a-4076-b08b-69db7a63e0e3 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9fd5cce1e44b984a26af49deb90b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3c72f8f945410e8694b9969bb18cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:45.126315 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8e18111d-1c4a-4076-b08b-69db7a63e0e3 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] 10.222.0.46 "GET /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df" status: 200 len: 1311 microversion: 2.1 time: 0.162923 Oct 29 03:30:45.126876 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3255/6288] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:44 2022] GET /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df => generated 1311 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:46.149976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-aa3f532a-6e36-46ec-a5ac-d34770ab1f3a tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:30:46.150553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-aa3f532a-6e36-46ec-a5ac-d34770ab1f3a tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] [instance: 7e62b4e0-1c01-486d-8894-68911bfe65df] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:46.153337 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:46.159126 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa3f532a-6e36-46ec-a5ac-d34770ab1f3a tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:46.159606 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa3f532a-6e36-46ec-a5ac-d34770ab1f3a tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:46.160030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa3f532a-6e36-46ec-a5ac-d34770ab1f3a tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:46.160751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa3f532a-6e36-46ec-a5ac-d34770ab1f3a tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:46.161204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa3f532a-6e36-46ec-a5ac-d34770ab1f3a tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:46.161611 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa3f532a-6e36-46ec-a5ac-d34770ab1f3a tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:46.300694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-aa3f532a-6e36-46ec-a5ac-d34770ab1f3a tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9fd5cce1e44b984a26af49deb90b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3c72f8f945410e8694b9969bb18cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:30:46.312209 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-aa3f532a-6e36-46ec-a5ac-d34770ab1f3a tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] 10.222.0.46 "GET /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df" status: 200 len: 1461 microversion: 2.1 time: 0.165998 Oct 29 03:30:46.313136 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3034/6289] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:30:46 2022] GET /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df => generated 1461 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:30:46.335253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5f294ee0-7cab-423d-a1d0-3f22fc2f8075 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d09d8a6-e906-4686-a9cd-c18209dfaee7", "device": "/dev/sdb"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:30:46.337701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5f294ee0-7cab-423d-a1d0-3f22fc2f8075 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] [instance: 7e62b4e0-1c01-486d-8894-68911bfe65df] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:30:46.344878 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f294ee0-7cab-423d-a1d0-3f22fc2f8075 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:46.345367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f294ee0-7cab-423d-a1d0-3f22fc2f8075 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:46.345804 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f294ee0-7cab-423d-a1d0-3f22fc2f8075 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:46.346501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f294ee0-7cab-423d-a1d0-3f22fc2f8075 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:30:46.346952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f294ee0-7cab-423d-a1d0-3f22fc2f8075 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:30:46.347407 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f294ee0-7cab-423d-a1d0-3f22fc2f8075 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:30:46.614929 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5f294ee0-7cab-423d-a1d0-3f22fc2f8075 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] 10.222.0.46 "POST /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283464 Oct 29 03:30:46.620930 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3256/6290] 10.222.0.46 () {60 vars in 1323 bytes} [Sat Oct 29 03:30:46 2022] POST /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:31:06.783267 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e17b8afb-2416-41ba-bc0c-b859103947a2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1089647540", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "21037317-1976-4034-ad6a-09e42a2cf573", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "99eca644-5d6e-42bc-9cf9-7cf1c8e093be"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:31:06.806095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=19 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:06.807027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=8 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:06.884840 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-e17b8afb-2416-41ba-bc0c-b859103947a2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] validate_networks() for [('99eca644-5d6e-42bc-9cf9-7cf1c8e093be', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:31:07.283074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-e17b8afb-2416-41ba-bc0c-b859103947a2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:31:07.283506 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-e17b8afb-2416-41ba-bc0c-b859103947a2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:31:07.283985 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-e17b8afb-2416-41ba-bc0c-b859103947a2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:31:07.284400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-e17b8afb-2416-41ba-bc0c-b859103947a2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:31:07.284878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-e17b8afb-2416-41ba-bc0c-b859103947a2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:31:07.293995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e17b8afb-2416-41ba-bc0c-b859103947a2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:07.294708 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e17b8afb-2416-41ba-bc0c-b859103947a2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:07.295154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e17b8afb-2416-41ba-bc0c-b859103947a2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:07.295897 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e17b8afb-2416-41ba-bc0c-b859103947a2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:07.296405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e17b8afb-2416-41ba-bc0c-b859103947a2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:07.296862 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e17b8afb-2416-41ba-bc0c-b859103947a2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:07.314263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-e17b8afb-2416-41ba-bc0c-b859103947a2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Getting quotas for project 7c164fcbf0df4575b66149f2298496e3. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:31:07.320000 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-e17b8afb-2416-41ba-bc0c-b859103947a2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Getting quotas for user 187e7d6474db4b8e813ff31fcddb4034 and project 7c164fcbf0df4575b66149f2298496e3. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:31:07.333467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e17b8afb-2416-41ba-bc0c-b859103947a2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:31:07.335624 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e17b8afb-2416-41ba-bc0c-b859103947a2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='21037317-1976-4034-ad6a-09e42a2cf573',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:31:07.426141 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e17b8afb-2416-41ba-bc0c-b859103947a2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646808 Oct 29 03:31:07.427093 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3035/6291] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:31:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:31:07.437461 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:07.438582 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:07.442842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2d321a5a-774a-4183-bc30-6f5589f680df tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:07.443939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2d321a5a-774a-4183-bc30-6f5589f680df tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:07.508394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2d321a5a-774a-4183-bc30-6f5589f680df tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:07.516703 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2d321a5a-774a-4183-bc30-6f5589f680df tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1057 microversion: 2.1 time: 0.081857 Oct 29 03:31:07.517292 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3257/6292] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:07 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1057 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:31:08.540296 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-68fb09b6-01b4-4ac2-9e5d-7e6f444d2b36 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:08.540978 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-68fb09b6-01b4-4ac2-9e5d-7e6f444d2b36 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:08.548727 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68fb09b6-01b4-4ac2-9e5d-7e6f444d2b36 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:08.549222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68fb09b6-01b4-4ac2-9e5d-7e6f444d2b36 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:08.549650 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68fb09b6-01b4-4ac2-9e5d-7e6f444d2b36 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:08.550349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68fb09b6-01b4-4ac2-9e5d-7e6f444d2b36 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:08.550793 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68fb09b6-01b4-4ac2-9e5d-7e6f444d2b36 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:08.551434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68fb09b6-01b4-4ac2-9e5d-7e6f444d2b36 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:08.653812 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-68fb09b6-01b4-4ac2-9e5d-7e6f444d2b36 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:08.672046 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-68fb09b6-01b4-4ac2-9e5d-7e6f444d2b36 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1127 microversion: 2.1 time: 0.136459 Oct 29 03:31:08.673509 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3036/6293] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:08 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1127 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:09.695017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-47a9a36c-bb3e-4692-a53d-b4860f74bea9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:09.695613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-47a9a36c-bb3e-4692-a53d-b4860f74bea9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:09.706226 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47a9a36c-bb3e-4692-a53d-b4860f74bea9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:09.706961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47a9a36c-bb3e-4692-a53d-b4860f74bea9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:09.707592 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47a9a36c-bb3e-4692-a53d-b4860f74bea9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:09.708576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47a9a36c-bb3e-4692-a53d-b4860f74bea9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:09.709215 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47a9a36c-bb3e-4692-a53d-b4860f74bea9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:09.710001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47a9a36c-bb3e-4692-a53d-b4860f74bea9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:09.921292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-47a9a36c-bb3e-4692-a53d-b4860f74bea9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:09.934042 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-47a9a36c-bb3e-4692-a53d-b4860f74bea9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1169 microversion: 2.1 time: 0.242878 Oct 29 03:31:09.934725 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3258/6294] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:09 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1169 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:10.527744 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-c3f81e07-668e-471c-a4ae-acd9ec60b7cf req-537c89bd-3d75-4460-9149-7fcd9c6375f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72", "tag": "d5274505-5622-4613-a753-51d7dbf174d4"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:31:10.542093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c3f81e07-668e-471c-a4ae-acd9ec60b7cf req-537c89bd-3d75-4460-9149-7fcd9c6375f2 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:10.542564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c3f81e07-668e-471c-a4ae-acd9ec60b7cf req-537c89bd-3d75-4460-9149-7fcd9c6375f2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:10.543734 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c3f81e07-668e-471c-a4ae-acd9ec60b7cf req-537c89bd-3d75-4460-9149-7fcd9c6375f2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:10.571871 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-c3f81e07-668e-471c-a4ae-acd9ec60b7cf req-537c89bd-3d75-4460-9149-7fcd9c6375f2 service nova] Creating event network-changed:d5274505-5622-4613-a753-51d7dbf174d4 for instance 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 on n-h2-862967-2 Oct 29 03:31:10.580984 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-c3f81e07-668e-471c-a4ae-acd9ec60b7cf req-537c89bd-3d75-4460-9149-7fcd9c6375f2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056066 Oct 29 03:31:10.582288 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3037/6295] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:31:10.967760 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-69f92087-1059-473b-a84a-0f63dfd3535b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:10.968505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-69f92087-1059-473b-a84a-0f63dfd3535b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:10.975976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69f92087-1059-473b-a84a-0f63dfd3535b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:10.976779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69f92087-1059-473b-a84a-0f63dfd3535b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:10.977416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69f92087-1059-473b-a84a-0f63dfd3535b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:10.978516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69f92087-1059-473b-a84a-0f63dfd3535b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:10.979147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69f92087-1059-473b-a84a-0f63dfd3535b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:10.979737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69f92087-1059-473b-a84a-0f63dfd3535b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:11.158333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-69f92087-1059-473b-a84a-0f63dfd3535b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:11.168330 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-69f92087-1059-473b-a84a-0f63dfd3535b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1169 microversion: 2.1 time: 0.205435 Oct 29 03:31:11.169666 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3259/6296] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:10 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1169 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:12.196083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-35217dff-2e36-4896-b7c4-7b7e9e7cd40c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:12.197526 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-35217dff-2e36-4896-b7c4-7b7e9e7cd40c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:12.205502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35217dff-2e36-4896-b7c4-7b7e9e7cd40c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:12.205998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35217dff-2e36-4896-b7c4-7b7e9e7cd40c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:12.206434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35217dff-2e36-4896-b7c4-7b7e9e7cd40c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:12.207152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35217dff-2e36-4896-b7c4-7b7e9e7cd40c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:12.207610 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35217dff-2e36-4896-b7c4-7b7e9e7cd40c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:12.208039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-35217dff-2e36-4896-b7c4-7b7e9e7cd40c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:12.419963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-35217dff-2e36-4896-b7c4-7b7e9e7cd40c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:12.428651 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-35217dff-2e36-4896-b7c4-7b7e9e7cd40c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1169 microversion: 2.1 time: 0.240204 Oct 29 03:31:12.429440 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3038/6297] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:12 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1169 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:31:13.451554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-028e9ab2-aa43-4c04-950e-4660bbb740f6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:13.452148 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-028e9ab2-aa43-4c04-950e-4660bbb740f6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:13.460240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-028e9ab2-aa43-4c04-950e-4660bbb740f6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:13.461126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-028e9ab2-aa43-4c04-950e-4660bbb740f6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:13.461802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-028e9ab2-aa43-4c04-950e-4660bbb740f6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:13.463614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-028e9ab2-aa43-4c04-950e-4660bbb740f6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:13.464249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-028e9ab2-aa43-4c04-950e-4660bbb740f6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:13.464886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-028e9ab2-aa43-4c04-950e-4660bbb740f6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:13.660488 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-028e9ab2-aa43-4c04-950e-4660bbb740f6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:13.676429 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-028e9ab2-aa43-4c04-950e-4660bbb740f6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1169 microversion: 2.1 time: 0.228637 Oct 29 03:31:13.677814 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3260/6298] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:13 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1169 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:14.704172 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9a47bf97-12d1-47c2-8011-489822400234 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:14.710365 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9a47bf97-12d1-47c2-8011-489822400234 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:14.718982 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a47bf97-12d1-47c2-8011-489822400234 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:14.721810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a47bf97-12d1-47c2-8011-489822400234 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:14.721810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a47bf97-12d1-47c2-8011-489822400234 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:14.721810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a47bf97-12d1-47c2-8011-489822400234 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:14.721810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a47bf97-12d1-47c2-8011-489822400234 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:14.721810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a47bf97-12d1-47c2-8011-489822400234 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:14.909124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9a47bf97-12d1-47c2-8011-489822400234 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:14.918005 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9a47bf97-12d1-47c2-8011-489822400234 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1169 microversion: 2.1 time: 0.218434 Oct 29 03:31:14.918768 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3039/6299] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:14 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1169 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:15.959312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-201742a6-c986-4282-b3dd-8232ee3ab23a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:15.960719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-201742a6-c986-4282-b3dd-8232ee3ab23a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:15.969502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-201742a6-c986-4282-b3dd-8232ee3ab23a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:15.970361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-201742a6-c986-4282-b3dd-8232ee3ab23a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:15.970982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-201742a6-c986-4282-b3dd-8232ee3ab23a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:15.971871 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-201742a6-c986-4282-b3dd-8232ee3ab23a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:15.972319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-201742a6-c986-4282-b3dd-8232ee3ab23a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:15.973050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-201742a6-c986-4282-b3dd-8232ee3ab23a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:16.193219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-201742a6-c986-4282-b3dd-8232ee3ab23a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:16.201496 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-201742a6-c986-4282-b3dd-8232ee3ab23a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1169 microversion: 2.1 time: 0.260248 Oct 29 03:31:16.212935 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3261/6300] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:15 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1169 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:17.227361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1543e356-1815-4eea-bb5f-b4e97c1973af tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:17.227989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1543e356-1815-4eea-bb5f-b4e97c1973af tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:17.242956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1543e356-1815-4eea-bb5f-b4e97c1973af tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:17.243639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1543e356-1815-4eea-bb5f-b4e97c1973af tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:17.244283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1543e356-1815-4eea-bb5f-b4e97c1973af tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:17.245207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1543e356-1815-4eea-bb5f-b4e97c1973af tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:17.245832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1543e356-1815-4eea-bb5f-b4e97c1973af tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:17.247014 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1543e356-1815-4eea-bb5f-b4e97c1973af tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:17.305622 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:17.327626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:17.425654 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1543e356-1815-4eea-bb5f-b4e97c1973af tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:17.438799 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1543e356-1815-4eea-bb5f-b4e97c1973af tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1169 microversion: 2.1 time: 0.215167 Oct 29 03:31:17.440574 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3040/6301] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:17 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1169 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:18.467776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-51b06f29-fa60-4a70-90c8-492d7e1f9992 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:18.469101 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-51b06f29-fa60-4a70-90c8-492d7e1f9992 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:18.472086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:18.479957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51b06f29-fa60-4a70-90c8-492d7e1f9992 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:18.480662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51b06f29-fa60-4a70-90c8-492d7e1f9992 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:18.481337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51b06f29-fa60-4a70-90c8-492d7e1f9992 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:18.482161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51b06f29-fa60-4a70-90c8-492d7e1f9992 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:18.482766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51b06f29-fa60-4a70-90c8-492d7e1f9992 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:18.483157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51b06f29-fa60-4a70-90c8-492d7e1f9992 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:18.643887 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-51b06f29-fa60-4a70-90c8-492d7e1f9992 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:18.653288 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-51b06f29-fa60-4a70-90c8-492d7e1f9992 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1169 microversion: 2.1 time: 0.189523 Oct 29 03:31:18.654245 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3262/6302] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:18 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1169 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:19.677091 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-db52697e-ca62-4347-9916-c11e570edeb8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:19.677954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-db52697e-ca62-4347-9916-c11e570edeb8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:19.685496 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db52697e-ca62-4347-9916-c11e570edeb8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:19.686229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db52697e-ca62-4347-9916-c11e570edeb8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:19.686780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db52697e-ca62-4347-9916-c11e570edeb8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:19.687785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db52697e-ca62-4347-9916-c11e570edeb8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:19.688334 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db52697e-ca62-4347-9916-c11e570edeb8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:19.688894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-db52697e-ca62-4347-9916-c11e570edeb8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:19.863666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-db52697e-ca62-4347-9916-c11e570edeb8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:19.872775 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-db52697e-ca62-4347-9916-c11e570edeb8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1169 microversion: 2.1 time: 0.199756 Oct 29 03:31:19.873590 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3041/6303] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:19 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1169 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:20.897812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-64bb23e3-4279-4287-896d-f9f21d907228 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:20.898433 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-64bb23e3-4279-4287-896d-f9f21d907228 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:20.906200 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-64bb23e3-4279-4287-896d-f9f21d907228 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:20.906694 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-64bb23e3-4279-4287-896d-f9f21d907228 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:20.907127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-64bb23e3-4279-4287-896d-f9f21d907228 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:20.907837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-64bb23e3-4279-4287-896d-f9f21d907228 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:20.908286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-64bb23e3-4279-4287-896d-f9f21d907228 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:20.908736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-64bb23e3-4279-4287-896d-f9f21d907228 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:21.073537 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-64bb23e3-4279-4287-896d-f9f21d907228 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:21.083064 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-64bb23e3-4279-4287-896d-f9f21d907228 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1169 microversion: 2.1 time: 0.189250 Oct 29 03:31:21.083908 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3263/6304] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:20 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1169 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:22.111591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e1366262-737b-41c1-9458-348195622650 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:22.112280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e1366262-737b-41c1-9458-348195622650 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:22.122336 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1366262-737b-41c1-9458-348195622650 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:22.123323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1366262-737b-41c1-9458-348195622650 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:22.124027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1366262-737b-41c1-9458-348195622650 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:22.125725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1366262-737b-41c1-9458-348195622650 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:22.126645 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1366262-737b-41c1-9458-348195622650 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:22.127309 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1366262-737b-41c1-9458-348195622650 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:22.288550 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e1366262-737b-41c1-9458-348195622650 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:22.298303 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e1366262-737b-41c1-9458-348195622650 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1169 microversion: 2.1 time: 0.191444 Oct 29 03:31:22.298909 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3042/6305] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:22 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1169 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:23.321522 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-891252e2-bce1-4ebe-aa87-21b32aec14de tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:23.322297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-891252e2-bce1-4ebe-aa87-21b32aec14de tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:23.330705 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-891252e2-bce1-4ebe-aa87-21b32aec14de tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:23.331182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-891252e2-bce1-4ebe-aa87-21b32aec14de tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:23.331648 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-891252e2-bce1-4ebe-aa87-21b32aec14de tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:23.332360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-891252e2-bce1-4ebe-aa87-21b32aec14de tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:23.332850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-891252e2-bce1-4ebe-aa87-21b32aec14de tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:23.333264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-891252e2-bce1-4ebe-aa87-21b32aec14de tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:23.488401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-891252e2-bce1-4ebe-aa87-21b32aec14de tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:23.498262 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-891252e2-bce1-4ebe-aa87-21b32aec14de tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1215 microversion: 2.1 time: 0.181279 Oct 29 03:31:23.499329 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3264/6306] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:23 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1215 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:24.521304 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-70482e3d-ee48-4949-ae0c-e94d79a66aae tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:24.522092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-70482e3d-ee48-4949-ae0c-e94d79a66aae tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:24.529459 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70482e3d-ee48-4949-ae0c-e94d79a66aae tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:24.530076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70482e3d-ee48-4949-ae0c-e94d79a66aae tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:24.530507 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70482e3d-ee48-4949-ae0c-e94d79a66aae tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:24.531210 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70482e3d-ee48-4949-ae0c-e94d79a66aae tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:24.531654 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70482e3d-ee48-4949-ae0c-e94d79a66aae tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:24.532073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-70482e3d-ee48-4949-ae0c-e94d79a66aae tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:24.675701 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-70482e3d-ee48-4949-ae0c-e94d79a66aae tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:24.685017 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-70482e3d-ee48-4949-ae0c-e94d79a66aae tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1203 microversion: 2.1 time: 0.167870 Oct 29 03:31:24.685832 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3043/6307] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:24 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1203 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:25.710722 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-22625c15-05dd-4a61-8f01-42c00f0443b3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:25.711336 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-22625c15-05dd-4a61-8f01-42c00f0443b3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:25.717863 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22625c15-05dd-4a61-8f01-42c00f0443b3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:25.718348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22625c15-05dd-4a61-8f01-42c00f0443b3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:25.718786 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22625c15-05dd-4a61-8f01-42c00f0443b3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:25.719464 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22625c15-05dd-4a61-8f01-42c00f0443b3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:25.719937 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22625c15-05dd-4a61-8f01-42c00f0443b3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:25.720353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-22625c15-05dd-4a61-8f01-42c00f0443b3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:25.865147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-22625c15-05dd-4a61-8f01-42c00f0443b3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:25.873859 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-22625c15-05dd-4a61-8f01-42c00f0443b3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1203 microversion: 2.1 time: 0.169213 Oct 29 03:31:25.875149 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3265/6308] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:25 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1203 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:26.899340 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0eb83474-3749-446d-816a-e26b2d9fa477 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:26.900151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0eb83474-3749-446d-816a-e26b2d9fa477 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:26.908586 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0eb83474-3749-446d-816a-e26b2d9fa477 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:26.909109 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0eb83474-3749-446d-816a-e26b2d9fa477 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:26.909541 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0eb83474-3749-446d-816a-e26b2d9fa477 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:26.910291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0eb83474-3749-446d-816a-e26b2d9fa477 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:26.910737 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0eb83474-3749-446d-816a-e26b2d9fa477 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:26.911156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0eb83474-3749-446d-816a-e26b2d9fa477 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:27.051128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0eb83474-3749-446d-816a-e26b2d9fa477 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:27.061494 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0eb83474-3749-446d-816a-e26b2d9fa477 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1203 microversion: 2.1 time: 0.166976 Oct 29 03:31:27.062113 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3044/6309] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:26 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1203 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:28.085146 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-44d4e7ea-8099-4445-8f86-55de4c2c4ec7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:28.085733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-44d4e7ea-8099-4445-8f86-55de4c2c4ec7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:28.093404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-44d4e7ea-8099-4445-8f86-55de4c2c4ec7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:28.093894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-44d4e7ea-8099-4445-8f86-55de4c2c4ec7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:28.094313 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-44d4e7ea-8099-4445-8f86-55de4c2c4ec7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:28.095015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-44d4e7ea-8099-4445-8f86-55de4c2c4ec7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:28.095466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-44d4e7ea-8099-4445-8f86-55de4c2c4ec7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:28.095891 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-44d4e7ea-8099-4445-8f86-55de4c2c4ec7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:28.239568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-44d4e7ea-8099-4445-8f86-55de4c2c4ec7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:28.248254 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-44d4e7ea-8099-4445-8f86-55de4c2c4ec7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1203 microversion: 2.1 time: 0.166946 Oct 29 03:31:28.248909 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3266/6310] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:28 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1203 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:29.271694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-353bd4ef-ea9b-4547-8532-fe0f06a7a06a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:29.272333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-353bd4ef-ea9b-4547-8532-fe0f06a7a06a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:29.279813 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-353bd4ef-ea9b-4547-8532-fe0f06a7a06a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:29.280308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-353bd4ef-ea9b-4547-8532-fe0f06a7a06a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:29.280765 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-353bd4ef-ea9b-4547-8532-fe0f06a7a06a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:29.281538 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-353bd4ef-ea9b-4547-8532-fe0f06a7a06a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:29.282003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-353bd4ef-ea9b-4547-8532-fe0f06a7a06a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:29.282438 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-353bd4ef-ea9b-4547-8532-fe0f06a7a06a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:29.435180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-353bd4ef-ea9b-4547-8532-fe0f06a7a06a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:29.443304 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-353bd4ef-ea9b-4547-8532-fe0f06a7a06a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1203 microversion: 2.1 time: 0.175594 Oct 29 03:31:29.443899 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3045/6311] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:29 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1203 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:30.466118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9306c40d-27cd-4509-a636-e20bf58382db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:30.467471 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9306c40d-27cd-4509-a636-e20bf58382db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:30.475017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9306c40d-27cd-4509-a636-e20bf58382db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:30.475715 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9306c40d-27cd-4509-a636-e20bf58382db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:30.476352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9306c40d-27cd-4509-a636-e20bf58382db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:30.477087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9306c40d-27cd-4509-a636-e20bf58382db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:30.477550 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9306c40d-27cd-4509-a636-e20bf58382db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:30.477964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9306c40d-27cd-4509-a636-e20bf58382db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:30.631560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9306c40d-27cd-4509-a636-e20bf58382db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:30.640689 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9306c40d-27cd-4509-a636-e20bf58382db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1203 microversion: 2.1 time: 0.178178 Oct 29 03:31:30.641048 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3267/6312] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:30 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1203 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:31.663717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-715cbb81-02a0-4125-9285-1fb7ff5dd3c0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:31.664587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-715cbb81-02a0-4125-9285-1fb7ff5dd3c0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:31.673243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-715cbb81-02a0-4125-9285-1fb7ff5dd3c0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:31.673888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-715cbb81-02a0-4125-9285-1fb7ff5dd3c0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:31.674448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-715cbb81-02a0-4125-9285-1fb7ff5dd3c0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:31.675411 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-715cbb81-02a0-4125-9285-1fb7ff5dd3c0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:31.675883 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-715cbb81-02a0-4125-9285-1fb7ff5dd3c0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:31.677399 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-715cbb81-02a0-4125-9285-1fb7ff5dd3c0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:31.815664 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-715cbb81-02a0-4125-9285-1fb7ff5dd3c0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:31.823856 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-715cbb81-02a0-4125-9285-1fb7ff5dd3c0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1203 microversion: 2.1 time: 0.164236 Oct 29 03:31:31.824469 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3046/6313] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:31 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1203 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:32.847425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4da82629-33ba-4670-8e75-2df657ada2b8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:32.848046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4da82629-33ba-4670-8e75-2df657ada2b8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:32.855337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4da82629-33ba-4670-8e75-2df657ada2b8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:32.855820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4da82629-33ba-4670-8e75-2df657ada2b8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:32.856446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4da82629-33ba-4670-8e75-2df657ada2b8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:32.857070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4da82629-33ba-4670-8e75-2df657ada2b8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:32.857647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4da82629-33ba-4670-8e75-2df657ada2b8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:32.858072 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4da82629-33ba-4670-8e75-2df657ada2b8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:33.007033 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4da82629-33ba-4670-8e75-2df657ada2b8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:33.015774 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4da82629-33ba-4670-8e75-2df657ada2b8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1203 microversion: 2.1 time: 0.172440 Oct 29 03:31:33.016368 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3268/6314] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:32 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1203 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:33.640257 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-950bc51d-a6d0-44e3-8b22-e4c641ca9aeb req-9bddc398-061b-4e39-8cd8-d114b05766e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72", "name": "network-vif-plugged", "status": "completed", "tag": "d5274505-5622-4613-a753-51d7dbf174d4"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:31:33.652312 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-950bc51d-a6d0-44e3-8b22-e4c641ca9aeb req-9bddc398-061b-4e39-8cd8-d114b05766e8 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:33.652850 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-950bc51d-a6d0-44e3-8b22-e4c641ca9aeb req-9bddc398-061b-4e39-8cd8-d114b05766e8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:33.653364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-950bc51d-a6d0-44e3-8b22-e4c641ca9aeb req-9bddc398-061b-4e39-8cd8-d114b05766e8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:33.667905 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-950bc51d-a6d0-44e3-8b22-e4c641ca9aeb req-9bddc398-061b-4e39-8cd8-d114b05766e8 service nova] Creating event network-vif-plugged:d5274505-5622-4613-a753-51d7dbf174d4 for instance 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 on n-h2-862967-2 Oct 29 03:31:33.673745 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-950bc51d-a6d0-44e3-8b22-e4c641ca9aeb req-9bddc398-061b-4e39-8cd8-d114b05766e8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037896 Oct 29 03:31:33.674691 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3047/6315] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:31:34.039911 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f625d721-68f6-46da-9593-24e2cbfede08 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:34.040696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f625d721-68f6-46da-9593-24e2cbfede08 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:34.049632 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f625d721-68f6-46da-9593-24e2cbfede08 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:34.050128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f625d721-68f6-46da-9593-24e2cbfede08 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:34.050578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f625d721-68f6-46da-9593-24e2cbfede08 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:34.051313 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f625d721-68f6-46da-9593-24e2cbfede08 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:34.051814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f625d721-68f6-46da-9593-24e2cbfede08 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:34.052189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f625d721-68f6-46da-9593-24e2cbfede08 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:34.195873 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f625d721-68f6-46da-9593-24e2cbfede08 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:34.204803 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f625d721-68f6-46da-9593-24e2cbfede08 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1203 microversion: 2.1 time: 0.168856 Oct 29 03:31:34.205404 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3269/6316] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:34 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1203 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:35.230852 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c0832042-a99f-4179-944d-9246a8f4fdde tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:35.231630 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c0832042-a99f-4179-944d-9246a8f4fdde tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:35.238966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0832042-a99f-4179-944d-9246a8f4fdde tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:35.239440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0832042-a99f-4179-944d-9246a8f4fdde tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:35.239944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0832042-a99f-4179-944d-9246a8f4fdde tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:35.240625 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0832042-a99f-4179-944d-9246a8f4fdde tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:35.241080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0832042-a99f-4179-944d-9246a8f4fdde tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:35.241499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0832042-a99f-4179-944d-9246a8f4fdde tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:35.400724 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c0832042-a99f-4179-944d-9246a8f4fdde tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:35.408918 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c0832042-a99f-4179-944d-9246a8f4fdde tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1389 microversion: 2.1 time: 0.184714 Oct 29 03:31:35.409499 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3048/6317] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:35 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1389 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:35.432248 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-50dc4ce8-1684-4592-b7e8-e40ef36e5b2c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:35.433121 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-50dc4ce8-1684-4592-b7e8-e40ef36e5b2c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:35.440223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50dc4ce8-1684-4592-b7e8-e40ef36e5b2c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:35.440753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50dc4ce8-1684-4592-b7e8-e40ef36e5b2c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:35.441195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50dc4ce8-1684-4592-b7e8-e40ef36e5b2c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:35.441921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50dc4ce8-1684-4592-b7e8-e40ef36e5b2c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:35.442377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50dc4ce8-1684-4592-b7e8-e40ef36e5b2c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:35.442798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50dc4ce8-1684-4592-b7e8-e40ef36e5b2c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:35.583894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-50dc4ce8-1684-4592-b7e8-e40ef36e5b2c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:35.592893 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-50dc4ce8-1684-4592-b7e8-e40ef36e5b2c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1389 microversion: 2.1 time: 0.164609 Oct 29 03:31:35.593498 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3270/6318] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:35 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1389 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:31:35.615331 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2870fc50-6052-475e-ae6c-d1f7799ac7a6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:35.616101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2870fc50-6052-475e-ae6c-d1f7799ac7a6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:35.622536 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2870fc50-6052-475e-ae6c-d1f7799ac7a6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:35.623029 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2870fc50-6052-475e-ae6c-d1f7799ac7a6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:35.623463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2870fc50-6052-475e-ae6c-d1f7799ac7a6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:35.624253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2870fc50-6052-475e-ae6c-d1f7799ac7a6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:35.624777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2870fc50-6052-475e-ae6c-d1f7799ac7a6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:35.625208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2870fc50-6052-475e-ae6c-d1f7799ac7a6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:35.761496 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2870fc50-6052-475e-ae6c-d1f7799ac7a6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:35.769671 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2870fc50-6052-475e-ae6c-d1f7799ac7a6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1389 microversion: 2.1 time: 0.158406 Oct 29 03:31:35.770248 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3049/6319] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:35 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1389 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:35.856676 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8830ff24-48c0-415d-96e8-41e742b0e574 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:35.857179 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8830ff24-48c0-415d-96e8-41e742b0e574 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:35.863453 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8830ff24-48c0-415d-96e8-41e742b0e574 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:35.863946 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8830ff24-48c0-415d-96e8-41e742b0e574 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:35.864384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8830ff24-48c0-415d-96e8-41e742b0e574 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:35.865073 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8830ff24-48c0-415d-96e8-41e742b0e574 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:35.865559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8830ff24-48c0-415d-96e8-41e742b0e574 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:35.865979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8830ff24-48c0-415d-96e8-41e742b0e574 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:35.893042 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8830ff24-48c0-415d-96e8-41e742b0e574 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:31:35.984843 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8830ff24-48c0-415d-96e8-41e742b0e574 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 204 len: 0 microversion: 2.1 time: 0.131883 Oct 29 03:31:35.985920 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3271/6320] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:31:35 2022] DELETE /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:31:36.001043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-68e12363-d9f3-488b-ad5b-d029e34a6183 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:36.001799 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-68e12363-d9f3-488b-ad5b-d029e34a6183 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:36.009570 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68e12363-d9f3-488b-ad5b-d029e34a6183 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:36.011428 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68e12363-d9f3-488b-ad5b-d029e34a6183 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:36.011925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68e12363-d9f3-488b-ad5b-d029e34a6183 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:36.013030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68e12363-d9f3-488b-ad5b-d029e34a6183 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:36.013665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68e12363-d9f3-488b-ad5b-d029e34a6183 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:36.014224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-68e12363-d9f3-488b-ad5b-d029e34a6183 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:36.165927 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-68e12363-d9f3-488b-ad5b-d029e34a6183 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:36.175224 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-68e12363-d9f3-488b-ad5b-d029e34a6183 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1395 microversion: 2.1 time: 0.183159 Oct 29 03:31:36.176164 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3050/6321] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:35 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1395 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:37.206312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-660abc60-59dd-4be6-aee5-881d499079b0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:37.207706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-660abc60-59dd-4be6-aee5-881d499079b0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:37.213587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-660abc60-59dd-4be6-aee5-881d499079b0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:37.214079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-660abc60-59dd-4be6-aee5-881d499079b0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:37.214522 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-660abc60-59dd-4be6-aee5-881d499079b0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:37.215216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-660abc60-59dd-4be6-aee5-881d499079b0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:37.215670 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-660abc60-59dd-4be6-aee5-881d499079b0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:37.216092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-660abc60-59dd-4be6-aee5-881d499079b0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:37.371611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-660abc60-59dd-4be6-aee5-881d499079b0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:37.375394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:37.381877 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-660abc60-59dd-4be6-aee5-881d499079b0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1395 microversion: 2.1 time: 0.181670 Oct 29 03:31:37.382729 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3272/6322] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:37 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1395 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:31:37.913836 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-c99b1b28-b589-4634-8c1a-4ea5a1730b01 req-77c90fc0-9632-402b-9a5a-667f249a5409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72", "name": "network-vif-deleted", "tag": "d5274505-5622-4613-a753-51d7dbf174d4"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:31:37.923307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:37.929464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c99b1b28-b589-4634-8c1a-4ea5a1730b01 req-77c90fc0-9632-402b-9a5a-667f249a5409 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:37.930525 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c99b1b28-b589-4634-8c1a-4ea5a1730b01 req-77c90fc0-9632-402b-9a5a-667f249a5409 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:37.931193 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c99b1b28-b589-4634-8c1a-4ea5a1730b01 req-77c90fc0-9632-402b-9a5a-667f249a5409 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:37.954294 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=85 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:37.957177 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-c99b1b28-b589-4634-8c1a-4ea5a1730b01 req-77c90fc0-9632-402b-9a5a-667f249a5409 service nova] Creating event network-vif-deleted:d5274505-5622-4613-a753-51d7dbf174d4 for instance 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 on n-h2-862967-2 Oct 29 03:31:37.964332 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-c99b1b28-b589-4634-8c1a-4ea5a1730b01 req-77c90fc0-9632-402b-9a5a-667f249a5409 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054965 Oct 29 03:31:37.969840 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3051/6323] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:31:38.407766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0b4c13cb-e944-48a6-a279-fc6dd9ed7902 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:38.408388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0b4c13cb-e944-48a6-a279-fc6dd9ed7902 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:38.411752 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:38.427095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b4c13cb-e944-48a6-a279-fc6dd9ed7902 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:38.429395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b4c13cb-e944-48a6-a279-fc6dd9ed7902 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:38.430439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b4c13cb-e944-48a6-a279-fc6dd9ed7902 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:38.431562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b4c13cb-e944-48a6-a279-fc6dd9ed7902 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:38.432022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b4c13cb-e944-48a6-a279-fc6dd9ed7902 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:38.432445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0b4c13cb-e944-48a6-a279-fc6dd9ed7902 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:38.501889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0b4c13cb-e944-48a6-a279-fc6dd9ed7902 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:38.511400 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0b4c13cb-e944-48a6-a279-fc6dd9ed7902 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1188 microversion: 2.1 time: 0.108462 Oct 29 03:31:38.512011 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3273/6324] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:38 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1188 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:39.536383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e79f89ee-a0b7-43d4-81fc-b5c27e33279e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:39.537389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e79f89ee-a0b7-43d4-81fc-b5c27e33279e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:39.545291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e79f89ee-a0b7-43d4-81fc-b5c27e33279e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:39.545920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e79f89ee-a0b7-43d4-81fc-b5c27e33279e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:39.546532 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e79f89ee-a0b7-43d4-81fc-b5c27e33279e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:39.547476 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e79f89ee-a0b7-43d4-81fc-b5c27e33279e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:39.547945 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e79f89ee-a0b7-43d4-81fc-b5c27e33279e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:39.548367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e79f89ee-a0b7-43d4-81fc-b5c27e33279e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:39.632346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e79f89ee-a0b7-43d4-81fc-b5c27e33279e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:39.642224 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e79f89ee-a0b7-43d4-81fc-b5c27e33279e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1188 microversion: 2.1 time: 0.111235 Oct 29 03:31:39.642937 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3052/6325] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:39 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1188 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:40.666526 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eb52d933-3dc3-4011-8d87-56a28c6e0944 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:40.667353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-eb52d933-3dc3-4011-8d87-56a28c6e0944 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:40.676216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb52d933-3dc3-4011-8d87-56a28c6e0944 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:40.677213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb52d933-3dc3-4011-8d87-56a28c6e0944 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:40.677472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb52d933-3dc3-4011-8d87-56a28c6e0944 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:40.678393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb52d933-3dc3-4011-8d87-56a28c6e0944 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:40.679058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb52d933-3dc3-4011-8d87-56a28c6e0944 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:40.679654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb52d933-3dc3-4011-8d87-56a28c6e0944 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:40.748211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-eb52d933-3dc3-4011-8d87-56a28c6e0944 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:40.757350 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eb52d933-3dc3-4011-8d87-56a28c6e0944 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1188 microversion: 2.1 time: 0.096589 Oct 29 03:31:40.758179 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3274/6326] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:40 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1188 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:41.781199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5c93f89a-a535-4028-97e0-cea6d388afff tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:41.782198 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5c93f89a-a535-4028-97e0-cea6d388afff tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:41.790877 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c93f89a-a535-4028-97e0-cea6d388afff tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:41.791734 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c93f89a-a535-4028-97e0-cea6d388afff tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:41.792599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c93f89a-a535-4028-97e0-cea6d388afff tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:41.793407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c93f89a-a535-4028-97e0-cea6d388afff tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:41.793961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c93f89a-a535-4028-97e0-cea6d388afff tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:41.794599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c93f89a-a535-4028-97e0-cea6d388afff tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:41.866065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5c93f89a-a535-4028-97e0-cea6d388afff tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:31:41.877234 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5c93f89a-a535-4028-97e0-cea6d388afff tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 200 len: 1188 microversion: 2.1 time: 0.100058 Oct 29 03:31:41.878370 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3053/6327] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:41 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 1188 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:31:42.905647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-534f8d87-bc7b-468c-bf1f-b0a8a4fb9cfc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:42.906839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-534f8d87-bc7b-468c-bf1f-b0a8a4fb9cfc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:42.914960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-534f8d87-bc7b-468c-bf1f-b0a8a4fb9cfc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:42.915656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-534f8d87-bc7b-468c-bf1f-b0a8a4fb9cfc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:42.916204 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-534f8d87-bc7b-468c-bf1f-b0a8a4fb9cfc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:42.917061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-534f8d87-bc7b-468c-bf1f-b0a8a4fb9cfc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:42.917660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-534f8d87-bc7b-468c-bf1f-b0a8a4fb9cfc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:42.918303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-534f8d87-bc7b-468c-bf1f-b0a8a4fb9cfc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:42.934762 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-534f8d87-bc7b-468c-bf1f-b0a8a4fb9cfc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] HTTP exception thrown: Instance 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 could not be found. Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-534f8d87-bc7b-468c-bf1f-b0a8a4fb9cfc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Request method failure captured: Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 HTTP/1.1 Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJ4OGFERKLIttSSPB0-5-jXA-TX6OM8jt9EJzgHtp2De1EitDQkx8TOt6_WbUmBu_Y6n6LIcWJu35cEqto8LlaLBvd7Fx6PpdDw_gDp2R4doflmhUMo3Zw8gq8dju5JmvbgI04aG1xuqlCslUnwpoihX0XXo_veRrdoDDtMm482XfyM Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7c164fcbf0df4575b66149f2298496e3"}]}] Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-TestVolumeBootPattern-894604406 Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 187e7d6474db4b8e813ff31fcddb4034 Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 could not be found. Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72'} Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 could not be found. Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 could not be found. Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:31:42.936797 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:31:42.945695 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:31:42.945695 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:31:42.945695 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:31:42.945695 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:31:42.945695 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:31:42.945695 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 could not be found. Oct 29 03:31:42.945695 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:31:42.945695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-534f8d87-bc7b-468c-bf1f-b0a8a4fb9cfc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Returning 404 to user: Instance 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:31:42.945695 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-534f8d87-bc7b-468c-bf1f-b0a8a4fb9cfc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 404 len: 111 microversion: 2.1 time: 0.038710 Oct 29 03:31:42.945695 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3275/6328] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:42 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:31:45.110249 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1b804c2a-883c-47aa-87dc-2980f6f4334f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:45.111397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1b804c2a-883c-47aa-87dc-2980f6f4334f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:45.120403 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b804c2a-883c-47aa-87dc-2980f6f4334f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:45.121350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b804c2a-883c-47aa-87dc-2980f6f4334f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:45.122661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b804c2a-883c-47aa-87dc-2980f6f4334f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:45.124957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b804c2a-883c-47aa-87dc-2980f6f4334f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:45.126026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b804c2a-883c-47aa-87dc-2980f6f4334f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:45.127029 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b804c2a-883c-47aa-87dc-2980f6f4334f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:45.146094 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-1b804c2a-883c-47aa-87dc-2980f6f4334f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] HTTP exception thrown: Instance 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 could not be found. Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1b804c2a-883c-47aa-87dc-2980f6f4334f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Request method failure captured: Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 HTTP/1.1 Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJ4OGFERKLIttSSPB0-5-jXA-TX6OM8jt9EJzgHtp2De1EitDQkx8TOt6_WbUmBu_Y6n6LIcWJu35cEqto8LlaLBvd7Fx6PpdDw_gDp2R4doflmhUMo3Zw8gq8dju5JmvbgI04aG1xuqlCslUnwpoihX0XXo_veRrdoDDtMm482XfyM Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7c164fcbf0df4575b66149f2298496e3"}]}] Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestVolumeBootPattern-894604406 Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 187e7d6474db4b8e813ff31fcddb4034 Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 could not be found. Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72'} Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 could not be found. Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:31:45.147802 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:31:45.152460 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 could not be found. Oct 29 03:31:45.152460 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:31:45.152460 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:31:45.152460 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:31:45.152460 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:31:45.152460 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:31:45.152460 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:31:45.152460 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:31:45.152460 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:31:45.152460 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 could not be found. Oct 29 03:31:45.152460 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:31:45.152460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1b804c2a-883c-47aa-87dc-2980f6f4334f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Returning 404 to user: Instance 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:31:45.152460 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1b804c2a-883c-47aa-87dc-2980f6f4334f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 404 len: 111 microversion: 2.1 time: 0.043052 Oct 29 03:31:45.155849 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3054/6329] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:31:45 2022] DELETE /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:31:45.167996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7f00b237-5e61-4c81-9d9e-181125d0f0a1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:45.169134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7f00b237-5e61-4c81-9d9e-181125d0f0a1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:45.182335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f00b237-5e61-4c81-9d9e-181125d0f0a1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:45.183245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f00b237-5e61-4c81-9d9e-181125d0f0a1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:45.183465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f00b237-5e61-4c81-9d9e-181125d0f0a1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:45.184508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f00b237-5e61-4c81-9d9e-181125d0f0a1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:45.185046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f00b237-5e61-4c81-9d9e-181125d0f0a1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:45.185498 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f00b237-5e61-4c81-9d9e-181125d0f0a1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:45.206944 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-7f00b237-5e61-4c81-9d9e-181125d0f0a1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] HTTP exception thrown: Instance 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 could not be found. Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7f00b237-5e61-4c81-9d9e-181125d0f0a1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Request method failure captured: Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 HTTP/1.1 Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJ4OGFERKLIttSSPB0-5-jXA-TX6OM8jt9EJzgHtp2De1EitDQkx8TOt6_WbUmBu_Y6n6LIcWJu35cEqto8LlaLBvd7Fx6PpdDw_gDp2R4doflmhUMo3Zw8gq8dju5JmvbgI04aG1xuqlCslUnwpoihX0XXo_veRrdoDDtMm482XfyM Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7c164fcbf0df4575b66149f2298496e3"}]}] Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-TestVolumeBootPattern-894604406 Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 187e7d6474db4b8e813ff31fcddb4034 Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 could not be found. Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72'} Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 could not be found. Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 could not be found. Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:31:45.208765 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:31:45.214681 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:31:45.214681 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:31:45.214681 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:31:45.214681 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:31:45.214681 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:31:45.214681 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 could not be found. Oct 29 03:31:45.214681 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:31:45.214681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7f00b237-5e61-4c81-9d9e-181125d0f0a1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Returning 404 to user: Instance 5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:31:45.214681 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7f00b237-5e61-4c81-9d9e-181125d0f0a1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72" status: 404 len: 111 microversion: 2.1 time: 0.055022 Oct 29 03:31:45.214681 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3276/6330] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:31:45 2022] GET /compute/v2.1/servers/5dfdeb9e-7a0b-4a84-b5ad-ea8480336a72 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:31:54.629073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-081a470d-5a4c-4af2-ae18-7cf514d52ddf tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:31:54.629933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-081a470d-5a4c-4af2-ae18-7cf514d52ddf tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] [instance: 7e62b4e0-1c01-486d-8894-68911bfe65df] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:31:54.638684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-081a470d-5a4c-4af2-ae18-7cf514d52ddf tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:54.639186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-081a470d-5a4c-4af2-ae18-7cf514d52ddf tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:54.639626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-081a470d-5a4c-4af2-ae18-7cf514d52ddf tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:54.640321 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-081a470d-5a4c-4af2-ae18-7cf514d52ddf tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:31:54.641319 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-081a470d-5a4c-4af2-ae18-7cf514d52ddf tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:31:54.641744 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-081a470d-5a4c-4af2-ae18-7cf514d52ddf tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:31:54.732918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-081a470d-5a4c-4af2-ae18-7cf514d52ddf tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lazy-loading 'services' on Instance uuid 7e62b4e0-1c01-486d-8894-68911bfe65df {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:31:54.811146 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-081a470d-5a4c-4af2-ae18-7cf514d52ddf tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df/os-volume_attachments/7d09d8a6-e906-4686-a9cd-c18209dfaee7" status: 202 len: 0 microversion: 2.1 time: 0.186018 Oct 29 03:31:54.811837 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3055/6331] 10.222.0.46 () {58 vars in 1416 bytes} [Sat Oct 29 03:31:54 2022] DELETE /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df/os-volume_attachments/7d09d8a6-e906-4686-a9cd-c18209dfaee7 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:32:00.229157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-50b6f699-84c7-4759-b4bf-82bbd3a0c91c tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:00.229776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-50b6f699-84c7-4759-b4bf-82bbd3a0c91c tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] [instance: 7e62b4e0-1c01-486d-8894-68911bfe65df] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:00.231856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=7 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:32:00.232592 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=16 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:32:00.239058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50b6f699-84c7-4759-b4bf-82bbd3a0c91c tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:00.239871 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50b6f699-84c7-4759-b4bf-82bbd3a0c91c tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:00.240297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50b6f699-84c7-4759-b4bf-82bbd3a0c91c tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:00.241067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50b6f699-84c7-4759-b4bf-82bbd3a0c91c tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:00.241516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50b6f699-84c7-4759-b4bf-82bbd3a0c91c tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:00.241934 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50b6f699-84c7-4759-b4bf-82bbd3a0c91c tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:00.270395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-50b6f699-84c7-4759-b4bf-82bbd3a0c91c tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] [instance: 7e62b4e0-1c01-486d-8894-68911bfe65df] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:32:00.352867 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-50b6f699-84c7-4759-b4bf-82bbd3a0c91c tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df" status: 204 len: 0 microversion: 2.1 time: 0.127651 Oct 29 03:32:00.353406 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3277/6332] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:32:00 2022] DELETE /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:32:00.363087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-98953588-8214-4d3e-b39a-324c0f4d11cf tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:00.363794 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-98953588-8214-4d3e-b39a-324c0f4d11cf tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] [instance: 7e62b4e0-1c01-486d-8894-68911bfe65df] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:00.371415 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98953588-8214-4d3e-b39a-324c0f4d11cf tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:00.371912 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98953588-8214-4d3e-b39a-324c0f4d11cf tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:00.372346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98953588-8214-4d3e-b39a-324c0f4d11cf tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:00.373140 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98953588-8214-4d3e-b39a-324c0f4d11cf tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:00.373776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98953588-8214-4d3e-b39a-324c0f4d11cf tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:00.374207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98953588-8214-4d3e-b39a-324c0f4d11cf tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:00.519270 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-98953588-8214-4d3e-b39a-324c0f4d11cf tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9fd5cce1e44b984a26af49deb90b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3c72f8f945410e8694b9969bb18cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:00.527508 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-98953588-8214-4d3e-b39a-324c0f4d11cf tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] 10.222.0.46 "GET /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df" status: 200 len: 1467 microversion: 2.1 time: 0.168850 Oct 29 03:32:00.528114 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3056/6333] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:00 2022] GET /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df => generated 1467 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:01.552177 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b1ed0177-c12a-4e11-99ef-6b356aa850dc tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:01.553496 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b1ed0177-c12a-4e11-99ef-6b356aa850dc tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] [instance: 7e62b4e0-1c01-486d-8894-68911bfe65df] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:01.560764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b1ed0177-c12a-4e11-99ef-6b356aa850dc tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:01.561248 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b1ed0177-c12a-4e11-99ef-6b356aa850dc tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:01.561683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b1ed0177-c12a-4e11-99ef-6b356aa850dc tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:01.562392 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b1ed0177-c12a-4e11-99ef-6b356aa850dc tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:01.562843 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b1ed0177-c12a-4e11-99ef-6b356aa850dc tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:01.563266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b1ed0177-c12a-4e11-99ef-6b356aa850dc tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:01.705912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b1ed0177-c12a-4e11-99ef-6b356aa850dc tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9fd5cce1e44b984a26af49deb90b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3c72f8f945410e8694b9969bb18cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:01.715842 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b1ed0177-c12a-4e11-99ef-6b356aa850dc tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] 10.222.0.46 "GET /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df" status: 200 len: 1467 microversion: 2.1 time: 0.168211 Oct 29 03:32:01.716461 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3278/6334] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:01 2022] GET /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df => generated 1467 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:02.739993 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-408f00fb-dad9-4715-9d46-ef1995ba6a48 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:02.742072 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-408f00fb-dad9-4715-9d46-ef1995ba6a48 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] [instance: 7e62b4e0-1c01-486d-8894-68911bfe65df] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:02.758644 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-408f00fb-dad9-4715-9d46-ef1995ba6a48 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:02.759135 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-408f00fb-dad9-4715-9d46-ef1995ba6a48 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:02.760325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-408f00fb-dad9-4715-9d46-ef1995ba6a48 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:02.760767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-408f00fb-dad9-4715-9d46-ef1995ba6a48 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:02.761231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-408f00fb-dad9-4715-9d46-ef1995ba6a48 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:02.761652 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-408f00fb-dad9-4715-9d46-ef1995ba6a48 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:02.877246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-408f00fb-dad9-4715-9d46-ef1995ba6a48 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2e9fd5cce1e44b984a26af49deb90b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3c72f8f945410e8694b9969bb18cb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:02.885149 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-66613be5-b918-453d-a3d8-344fd32d73e9 req-fa22d3b1-8da2-4203-bb81-813f10f184c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e62b4e0-1c01-486d-8894-68911bfe65df", "name": "network-vif-deleted", "tag": "33d4ebf7-a896-4e00-a28f-a3195b60800c"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:32:02.888126 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-408f00fb-dad9-4715-9d46-ef1995ba6a48 tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] 10.222.0.46 "GET /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df" status: 200 len: 1425 microversion: 2.1 time: 0.152036 Oct 29 03:32:02.889506 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3057/6335] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:02 2022] GET /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df => generated 1425 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:02.909089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-66613be5-b918-453d-a3d8-344fd32d73e9 req-fa22d3b1-8da2-4203-bb81-813f10f184c0 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:02.909580 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-66613be5-b918-453d-a3d8-344fd32d73e9 req-fa22d3b1-8da2-4203-bb81-813f10f184c0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:02.910049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-66613be5-b918-453d-a3d8-344fd32d73e9 req-fa22d3b1-8da2-4203-bb81-813f10f184c0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:02.924382 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-66613be5-b918-453d-a3d8-344fd32d73e9 req-fa22d3b1-8da2-4203-bb81-813f10f184c0 service nova] Creating event network-vif-deleted:33d4ebf7-a896-4e00-a28f-a3195b60800c for instance 7e62b4e0-1c01-486d-8894-68911bfe65df on n-h1-862967-2 Oct 29 03:32:02.945541 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-66613be5-b918-453d-a3d8-344fd32d73e9 req-fa22d3b1-8da2-4203-bb81-813f10f184c0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073059 Oct 29 03:32:02.950161 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3279/6336] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:32:03.913498 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ae81bf40-0944-49c6-8bcc-91420d58c59e tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:03.914089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ae81bf40-0944-49c6-8bcc-91420d58c59e tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] [instance: 7e62b4e0-1c01-486d-8894-68911bfe65df] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:03.922133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae81bf40-0944-49c6-8bcc-91420d58c59e tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:03.922650 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae81bf40-0944-49c6-8bcc-91420d58c59e tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:03.923142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae81bf40-0944-49c6-8bcc-91420d58c59e tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:03.923908 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae81bf40-0944-49c6-8bcc-91420d58c59e tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:03.924377 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae81bf40-0944-49c6-8bcc-91420d58c59e tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:03.924899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae81bf40-0944-49c6-8bcc-91420d58c59e tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:03.942454 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-ae81bf40-0944-49c6-8bcc-91420d58c59e tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] HTTP exception thrown: Instance 7e62b4e0-1c01-486d-8894-68911bfe65df could not be found. Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ae81bf40-0944-49c6-8bcc-91420d58c59e tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Request method failure captured: Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df HTTP/1.1 Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJ5YbdDayzub2KUZCAZoUGzIN4qKD0NQ2kXNQkEJ0zGug9Yr4a1gGYVcJ0xYVhNyx4hcEup0MiS3MoLa2FizHiqSAqNFsu-jLSt9RLZc6eJdlg4hDOZvE986UtMB4UZ-j8isF6msMF8_YKAe6lQGYrLeT-NxQwMqrGWFQE6cMu0kSTM Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 2e3c72f8f945410e8694b9969bb18cb7 Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-VolumesBackupsTest-1923159057 Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e3c72f8f945410e8694b9969bb18cb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e3c72f8f945410e8694b9969bb18cb7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2e3c72f8f945410e8694b9969bb18cb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2e3c72f8f945410e8694b9969bb18cb7"}]}] Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-VolumesBackupsTest-1923159057 Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 2e3c72f8f945410e8694b9969bb18cb7 Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-VolumesBackupsTest-1923159057 Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-VolumesBackupsTest-1923159057-project Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: a2e9fd5cce1e44b984a26af49deb90b3 Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-VolumesBackupsTest-1923159057-project Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 7e62b4e0-1c01-486d-8894-68911bfe65df could not be found. Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '7e62b4e0-1c01-486d-8894-68911bfe65df'} Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e62b4e0-1c01-486d-8894-68911bfe65df could not be found. Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e62b4e0-1c01-486d-8894-68911bfe65df could not be found. Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:32:03.944150 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:32:03.949876 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:32:03.949876 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:32:03.949876 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:32:03.949876 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:32:03.949876 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:32:03.949876 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e62b4e0-1c01-486d-8894-68911bfe65df could not be found. Oct 29 03:32:03.949876 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:32:03.949876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ae81bf40-0944-49c6-8bcc-91420d58c59e tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] Returning 404 to user: Instance 7e62b4e0-1c01-486d-8894-68911bfe65df could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:32:03.949876 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ae81bf40-0944-49c6-8bcc-91420d58c59e tempest-VolumesBackupsTest-1923159057 tempest-VolumesBackupsTest-1923159057-project] 10.222.0.46 "GET /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df" status: 404 len: 111 microversion: 2.1 time: 0.036298 Oct 29 03:32:03.949876 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3058/6337] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:03 2022] GET /compute/v2.1/servers/7e62b4e0-1c01-486d-8894-68911bfe65df => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:32:07.304472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5b710f5a-6fcf-4186-a3e3-5e79d728b633 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1537128148", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "660b202c-fda7-4374-8461-955f20df8132", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "99eca644-5d6e-42bc-9cf9-7cf1c8e093be"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:32:07.374182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-5b710f5a-6fcf-4186-a3e3-5e79d728b633 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] validate_networks() for [('99eca644-5d6e-42bc-9cf9-7cf1c8e093be', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:32:07.772266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-5b710f5a-6fcf-4186-a3e3-5e79d728b633 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:32:07.772739 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-5b710f5a-6fcf-4186-a3e3-5e79d728b633 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:32:07.773207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-5b710f5a-6fcf-4186-a3e3-5e79d728b633 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:32:07.773639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-5b710f5a-6fcf-4186-a3e3-5e79d728b633 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:32:07.774132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-5b710f5a-6fcf-4186-a3e3-5e79d728b633 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:32:07.784585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b710f5a-6fcf-4186-a3e3-5e79d728b633 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:07.785084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b710f5a-6fcf-4186-a3e3-5e79d728b633 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:07.785515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b710f5a-6fcf-4186-a3e3-5e79d728b633 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:07.786236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b710f5a-6fcf-4186-a3e3-5e79d728b633 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:07.786681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b710f5a-6fcf-4186-a3e3-5e79d728b633 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:07.787100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5b710f5a-6fcf-4186-a3e3-5e79d728b633 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:07.805256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-5b710f5a-6fcf-4186-a3e3-5e79d728b633 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Getting quotas for project 7c164fcbf0df4575b66149f2298496e3. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:32:07.810722 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-5b710f5a-6fcf-4186-a3e3-5e79d728b633 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Getting quotas for user 187e7d6474db4b8e813ff31fcddb4034 and project 7c164fcbf0df4575b66149f2298496e3. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:32:07.878691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5b710f5a-6fcf-4186-a3e3-5e79d728b633 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:32:07.881339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5b710f5a-6fcf-4186-a3e3-5e79d728b633 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='660b202c-fda7-4374-8461-955f20df8132',volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:32:08.044177 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5b710f5a-6fcf-4186-a3e3-5e79d728b633 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.743330 Oct 29 03:32:08.044943 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3280/6338] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:32:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:32:08.056683 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a23d2383-3f01-49e5-8e7c-34ab48e92545 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:08.059136 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a23d2383-3f01-49e5-8e7c-34ab48e92545 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:08.128263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a23d2383-3f01-49e5-8e7c-34ab48e92545 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:08.137708 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a23d2383-3f01-49e5-8e7c-34ab48e92545 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927" status: 200 len: 1071 microversion: 2.1 time: 0.085240 Oct 29 03:32:08.138273 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3059/6339] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:08 2022] GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 => generated 1071 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:09.161362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-92ea92e2-61af-42dd-9f85-8746bd292e37 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:09.162189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-92ea92e2-61af-42dd-9f85-8746bd292e37 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:09.172508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92ea92e2-61af-42dd-9f85-8746bd292e37 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:09.173036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92ea92e2-61af-42dd-9f85-8746bd292e37 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:09.173804 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92ea92e2-61af-42dd-9f85-8746bd292e37 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:09.174607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92ea92e2-61af-42dd-9f85-8746bd292e37 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:09.175290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92ea92e2-61af-42dd-9f85-8746bd292e37 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:09.176214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92ea92e2-61af-42dd-9f85-8746bd292e37 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:09.254926 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-92ea92e2-61af-42dd-9f85-8746bd292e37 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:09.265303 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-92ea92e2-61af-42dd-9f85-8746bd292e37 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927" status: 200 len: 1187 microversion: 2.1 time: 0.107971 Oct 29 03:32:09.266436 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3281/6340] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:09 2022] GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 => generated 1187 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:10.289148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6ffa271e-0a40-4d8f-a8cd-4907483bedb2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:10.290737 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6ffa271e-0a40-4d8f-a8cd-4907483bedb2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:10.298042 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=20 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:32:10.300695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ffa271e-0a40-4d8f-a8cd-4907483bedb2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:10.301390 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ffa271e-0a40-4d8f-a8cd-4907483bedb2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:10.301822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ffa271e-0a40-4d8f-a8cd-4907483bedb2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:10.303233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ffa271e-0a40-4d8f-a8cd-4907483bedb2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:10.304112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ffa271e-0a40-4d8f-a8cd-4907483bedb2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:10.304797 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ffa271e-0a40-4d8f-a8cd-4907483bedb2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:10.309351 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=39,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:32:10.599192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6ffa271e-0a40-4d8f-a8cd-4907483bedb2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:10.613753 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6ffa271e-0a40-4d8f-a8cd-4907483bedb2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927" status: 200 len: 1229 microversion: 2.1 time: 0.328395 Oct 29 03:32:10.616166 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3060/6341] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:10 2022] GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 => generated 1229 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:10.827649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-68354272-596f-4064-8e54-2be6745672c3 req-cee46af7-6b97-4ada-a23a-6d45894e4ef8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ea9be11-5017-4959-a25b-76044d165927", "tag": "d3fe6ead-d562-4769-b5e5-22c49e7b6e86"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:32:10.879674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-68354272-596f-4064-8e54-2be6745672c3 req-cee46af7-6b97-4ada-a23a-6d45894e4ef8 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:10.880463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-68354272-596f-4064-8e54-2be6745672c3 req-cee46af7-6b97-4ada-a23a-6d45894e4ef8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:10.881156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-68354272-596f-4064-8e54-2be6745672c3 req-cee46af7-6b97-4ada-a23a-6d45894e4ef8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:10.897645 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-68354272-596f-4064-8e54-2be6745672c3 req-cee46af7-6b97-4ada-a23a-6d45894e4ef8 service nova] Creating event network-changed:d3fe6ead-d562-4769-b5e5-22c49e7b6e86 for instance 6ea9be11-5017-4959-a25b-76044d165927 on n-h2-862967-2 Oct 29 03:32:10.905486 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-68354272-596f-4064-8e54-2be6745672c3 req-cee46af7-6b97-4ada-a23a-6d45894e4ef8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091268 Oct 29 03:32:10.906636 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3282/6342] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:32:11.638813 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0a89009a-3536-48a4-83e9-db89ba6252df tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:11.640246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0a89009a-3536-48a4-83e9-db89ba6252df tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:11.648769 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a89009a-3536-48a4-83e9-db89ba6252df tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:11.649832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a89009a-3536-48a4-83e9-db89ba6252df tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:11.650489 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a89009a-3536-48a4-83e9-db89ba6252df tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:11.651587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a89009a-3536-48a4-83e9-db89ba6252df tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:11.652243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a89009a-3536-48a4-83e9-db89ba6252df tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:11.652913 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a89009a-3536-48a4-83e9-db89ba6252df tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:12.192770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0a89009a-3536-48a4-83e9-db89ba6252df tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:12.201791 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0a89009a-3536-48a4-83e9-db89ba6252df tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927" status: 200 len: 1229 microversion: 2.1 time: 0.568277 Oct 29 03:32:12.203075 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3061/6343] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:11 2022] GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 => generated 1229 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:13.226148 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a3077a0e-6f55-4f67-82e8-82272238847b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:13.227018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a3077a0e-6f55-4f67-82e8-82272238847b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:13.234738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a3077a0e-6f55-4f67-82e8-82272238847b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:13.235638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a3077a0e-6f55-4f67-82e8-82272238847b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:13.236340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a3077a0e-6f55-4f67-82e8-82272238847b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:13.237426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a3077a0e-6f55-4f67-82e8-82272238847b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:13.237873 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a3077a0e-6f55-4f67-82e8-82272238847b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:13.238320 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a3077a0e-6f55-4f67-82e8-82272238847b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:13.402912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a3077a0e-6f55-4f67-82e8-82272238847b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:13.412639 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a3077a0e-6f55-4f67-82e8-82272238847b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927" status: 200 len: 1229 microversion: 2.1 time: 0.191296 Oct 29 03:32:13.413253 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3283/6344] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:13 2022] GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 => generated 1229 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:14.435907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6c85e2d2-e335-4e9c-822e-9a19918c233c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:14.436500 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6c85e2d2-e335-4e9c-822e-9a19918c233c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:14.452702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c85e2d2-e335-4e9c-822e-9a19918c233c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:14.453199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c85e2d2-e335-4e9c-822e-9a19918c233c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:14.453634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c85e2d2-e335-4e9c-822e-9a19918c233c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:14.454349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c85e2d2-e335-4e9c-822e-9a19918c233c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:14.454792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c85e2d2-e335-4e9c-822e-9a19918c233c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:14.455328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c85e2d2-e335-4e9c-822e-9a19918c233c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:14.603567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6c85e2d2-e335-4e9c-822e-9a19918c233c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:14.614322 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6c85e2d2-e335-4e9c-822e-9a19918c233c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927" status: 200 len: 1229 microversion: 2.1 time: 0.182500 Oct 29 03:32:14.614896 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3062/6345] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:14 2022] GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 => generated 1229 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:15.637831 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5ead4b4d-94a0-4cbe-8fcd-9507662f44f0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:15.638542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5ead4b4d-94a0-4cbe-8fcd-9507662f44f0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:15.640994 n-d-862967-2 devstack@n-api.service[127124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:32:15.641221 n-d-862967-2 devstack@n-api.service[127124]: Sat Oct 29 03:32:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 (ip 10.222.0.46) !!! Oct 29 03:32:15.649246 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ead4b4d-94a0-4cbe-8fcd-9507662f44f0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:15.649768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ead4b4d-94a0-4cbe-8fcd-9507662f44f0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:15.650212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ead4b4d-94a0-4cbe-8fcd-9507662f44f0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:15.650933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ead4b4d-94a0-4cbe-8fcd-9507662f44f0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:15.651387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ead4b4d-94a0-4cbe-8fcd-9507662f44f0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:15.651805 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ead4b4d-94a0-4cbe-8fcd-9507662f44f0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:15.791299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5ead4b4d-94a0-4cbe-8fcd-9507662f44f0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:15.799296 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5ead4b4d-94a0-4cbe-8fcd-9507662f44f0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927" status: 200 len: 1217 microversion: 2.1 time: 0.165834 Oct 29 03:32:15.799871 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3284/6346] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:15 2022] GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 => generated 1217 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:16.823814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b3acd228-2cc9-4132-a854-aae2f2b45902 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:16.824451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b3acd228-2cc9-4132-a854-aae2f2b45902 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:16.832241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3acd228-2cc9-4132-a854-aae2f2b45902 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:16.832770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3acd228-2cc9-4132-a854-aae2f2b45902 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:16.833196 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3acd228-2cc9-4132-a854-aae2f2b45902 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:16.833924 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3acd228-2cc9-4132-a854-aae2f2b45902 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:16.834384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3acd228-2cc9-4132-a854-aae2f2b45902 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:16.834813 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3acd228-2cc9-4132-a854-aae2f2b45902 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:16.980540 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b3acd228-2cc9-4132-a854-aae2f2b45902 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:16.988455 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b3acd228-2cc9-4132-a854-aae2f2b45902 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927" status: 200 len: 1217 microversion: 2.1 time: 0.169069 Oct 29 03:32:16.989072 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3063/6347] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:16 2022] GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 => generated 1217 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:18.011574 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-da207fd0-c7e8-4daa-a798-87b4bd19b9ee tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:18.012317 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-da207fd0-c7e8-4daa-a798-87b4bd19b9ee tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:18.015090 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:32:18.015756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:32:18.022409 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da207fd0-c7e8-4daa-a798-87b4bd19b9ee tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:18.022917 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da207fd0-c7e8-4daa-a798-87b4bd19b9ee tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:18.023353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da207fd0-c7e8-4daa-a798-87b4bd19b9ee tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:18.024070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da207fd0-c7e8-4daa-a798-87b4bd19b9ee tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:18.024556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da207fd0-c7e8-4daa-a798-87b4bd19b9ee tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:18.024973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-da207fd0-c7e8-4daa-a798-87b4bd19b9ee tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:18.158776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-da207fd0-c7e8-4daa-a798-87b4bd19b9ee tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:18.166923 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-da207fd0-c7e8-4daa-a798-87b4bd19b9ee tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927" status: 200 len: 1217 microversion: 2.1 time: 0.159791 Oct 29 03:32:18.167520 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3285/6348] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:18 2022] GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 => generated 1217 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:19.193076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0fafefc6-c358-4fc8-8ce6-0ba476f4138f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:19.193679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0fafefc6-c358-4fc8-8ce6-0ba476f4138f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:19.196302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:32:19.203366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fafefc6-c358-4fc8-8ce6-0ba476f4138f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:19.203855 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fafefc6-c358-4fc8-8ce6-0ba476f4138f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:19.204445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fafefc6-c358-4fc8-8ce6-0ba476f4138f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:19.205181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fafefc6-c358-4fc8-8ce6-0ba476f4138f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:19.205635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fafefc6-c358-4fc8-8ce6-0ba476f4138f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:19.206159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0fafefc6-c358-4fc8-8ce6-0ba476f4138f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:19.354751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0fafefc6-c358-4fc8-8ce6-0ba476f4138f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:19.363739 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0fafefc6-c358-4fc8-8ce6-0ba476f4138f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927" status: 200 len: 1217 microversion: 2.1 time: 0.174980 Oct 29 03:32:19.364358 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3064/6349] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:19 2022] GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 => generated 1217 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:20.388094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fe7e3c33-4a47-49e7-8eb8-927dbc36845e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:20.388837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fe7e3c33-4a47-49e7-8eb8-927dbc36845e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:20.395833 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fe7e3c33-4a47-49e7-8eb8-927dbc36845e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:20.396341 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fe7e3c33-4a47-49e7-8eb8-927dbc36845e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:20.396832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fe7e3c33-4a47-49e7-8eb8-927dbc36845e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:20.397550 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fe7e3c33-4a47-49e7-8eb8-927dbc36845e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:20.397992 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fe7e3c33-4a47-49e7-8eb8-927dbc36845e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:20.398449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fe7e3c33-4a47-49e7-8eb8-927dbc36845e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:20.537600 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fe7e3c33-4a47-49e7-8eb8-927dbc36845e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:20.545555 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fe7e3c33-4a47-49e7-8eb8-927dbc36845e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927" status: 200 len: 1217 microversion: 2.1 time: 0.161996 Oct 29 03:32:20.546138 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3286/6350] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:20 2022] GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 => generated 1217 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:21.574440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-54733537-2cdc-4f8b-a394-011b0b5a6bfb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:21.575211 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-54733537-2cdc-4f8b-a394-011b0b5a6bfb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:21.582531 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-54733537-2cdc-4f8b-a394-011b0b5a6bfb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:21.583023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-54733537-2cdc-4f8b-a394-011b0b5a6bfb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:21.583475 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-54733537-2cdc-4f8b-a394-011b0b5a6bfb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:21.584182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-54733537-2cdc-4f8b-a394-011b0b5a6bfb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:21.584668 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-54733537-2cdc-4f8b-a394-011b0b5a6bfb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:21.585099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-54733537-2cdc-4f8b-a394-011b0b5a6bfb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:21.719361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-54733537-2cdc-4f8b-a394-011b0b5a6bfb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:21.727597 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-54733537-2cdc-4f8b-a394-011b0b5a6bfb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927" status: 200 len: 1217 microversion: 2.1 time: 0.157372 Oct 29 03:32:21.728179 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3065/6351] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:21 2022] GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:22.751120 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-72a45f35-1636-4742-923e-d9597e59763b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:22.751834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-72a45f35-1636-4742-923e-d9597e59763b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:22.759865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72a45f35-1636-4742-923e-d9597e59763b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:22.760393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72a45f35-1636-4742-923e-d9597e59763b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:22.760840 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72a45f35-1636-4742-923e-d9597e59763b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:22.761609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72a45f35-1636-4742-923e-d9597e59763b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:22.762145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72a45f35-1636-4742-923e-d9597e59763b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:22.762571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72a45f35-1636-4742-923e-d9597e59763b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:22.929644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-72a45f35-1636-4742-923e-d9597e59763b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:22.937833 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-72a45f35-1636-4742-923e-d9597e59763b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927" status: 200 len: 1217 microversion: 2.1 time: 0.190706 Oct 29 03:32:22.938428 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3287/6352] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:22 2022] GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 => generated 1217 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:23.960551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-02f01a7e-17ac-454d-9275-291eec4856db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:23.961184 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-02f01a7e-17ac-454d-9275-291eec4856db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:23.968853 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02f01a7e-17ac-454d-9275-291eec4856db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:23.969342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02f01a7e-17ac-454d-9275-291eec4856db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:23.969777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02f01a7e-17ac-454d-9275-291eec4856db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:23.970480 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02f01a7e-17ac-454d-9275-291eec4856db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:23.970926 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02f01a7e-17ac-454d-9275-291eec4856db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:23.971346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02f01a7e-17ac-454d-9275-291eec4856db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:24.114053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-02f01a7e-17ac-454d-9275-291eec4856db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:24.122216 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-02f01a7e-17ac-454d-9275-291eec4856db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927" status: 200 len: 1217 microversion: 2.1 time: 0.165552 Oct 29 03:32:24.122734 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3066/6353] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:23 2022] GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 => generated 1217 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:25.145901 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-02e2699b-0c4e-47c2-9d78-e88c6d985068 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:25.146509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-02e2699b-0c4e-47c2-9d78-e88c6d985068 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:25.153791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02e2699b-0c4e-47c2-9d78-e88c6d985068 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:25.154287 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02e2699b-0c4e-47c2-9d78-e88c6d985068 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:25.154724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02e2699b-0c4e-47c2-9d78-e88c6d985068 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:25.155466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02e2699b-0c4e-47c2-9d78-e88c6d985068 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:25.155922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02e2699b-0c4e-47c2-9d78-e88c6d985068 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:25.156348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-02e2699b-0c4e-47c2-9d78-e88c6d985068 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:25.293189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-02e2699b-0c4e-47c2-9d78-e88c6d985068 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:25.301638 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-02e2699b-0c4e-47c2-9d78-e88c6d985068 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927" status: 200 len: 1217 microversion: 2.1 time: 0.159783 Oct 29 03:32:25.302196 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3288/6354] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:25 2022] GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 => generated 1217 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:25.948339 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-b47e9c64-c50e-45f8-a20b-2b6ad838e999 req-7548c075-ad14-4f9e-b10d-4bf4cc7a0e2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ea9be11-5017-4959-a25b-76044d165927", "name": "network-vif-plugged", "status": "completed", "tag": "d3fe6ead-d562-4769-b5e5-22c49e7b6e86"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:32:25.970751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b47e9c64-c50e-45f8-a20b-2b6ad838e999 req-7548c075-ad14-4f9e-b10d-4bf4cc7a0e2c service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:25.971234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b47e9c64-c50e-45f8-a20b-2b6ad838e999 req-7548c075-ad14-4f9e-b10d-4bf4cc7a0e2c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:25.971662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b47e9c64-c50e-45f8-a20b-2b6ad838e999 req-7548c075-ad14-4f9e-b10d-4bf4cc7a0e2c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:25.988168 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-b47e9c64-c50e-45f8-a20b-2b6ad838e999 req-7548c075-ad14-4f9e-b10d-4bf4cc7a0e2c service nova] Creating event network-vif-plugged:d3fe6ead-d562-4769-b5e5-22c49e7b6e86 for instance 6ea9be11-5017-4959-a25b-76044d165927 on n-h2-862967-2 Oct 29 03:32:25.993818 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-b47e9c64-c50e-45f8-a20b-2b6ad838e999 req-7548c075-ad14-4f9e-b10d-4bf4cc7a0e2c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050602 Oct 29 03:32:25.995310 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3067/6355] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:32:26.325143 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f646dc4b-5785-472c-bf58-340f8f718140 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:26.325737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f646dc4b-5785-472c-bf58-340f8f718140 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:26.332922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f646dc4b-5785-472c-bf58-340f8f718140 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:26.333408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f646dc4b-5785-472c-bf58-340f8f718140 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:26.333861 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f646dc4b-5785-472c-bf58-340f8f718140 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:26.334526 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f646dc4b-5785-472c-bf58-340f8f718140 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:26.334973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f646dc4b-5785-472c-bf58-340f8f718140 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:26.335391 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f646dc4b-5785-472c-bf58-340f8f718140 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:26.484903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f646dc4b-5785-472c-bf58-340f8f718140 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:26.493154 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f646dc4b-5785-472c-bf58-340f8f718140 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927" status: 200 len: 1217 microversion: 2.1 time: 0.171951 Oct 29 03:32:26.493758 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3289/6356] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:26 2022] GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 => generated 1217 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:27.517596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ab402d89-4cb3-477d-8f55-cb5dc9279b06 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:27.518289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ab402d89-4cb3-477d-8f55-cb5dc9279b06 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:27.525438 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab402d89-4cb3-477d-8f55-cb5dc9279b06 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:27.525938 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab402d89-4cb3-477d-8f55-cb5dc9279b06 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:27.526410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab402d89-4cb3-477d-8f55-cb5dc9279b06 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:27.527123 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab402d89-4cb3-477d-8f55-cb5dc9279b06 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:27.527587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab402d89-4cb3-477d-8f55-cb5dc9279b06 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:27.528015 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ab402d89-4cb3-477d-8f55-cb5dc9279b06 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:27.667093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ab402d89-4cb3-477d-8f55-cb5dc9279b06 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:27.675756 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ab402d89-4cb3-477d-8f55-cb5dc9279b06 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927" status: 200 len: 1404 microversion: 2.1 time: 0.163762 Oct 29 03:32:27.676563 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3068/6357] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:27 2022] GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 => generated 1404 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:27.698530 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-852523fd-be4c-4b8f-9db8-bd6570a3047c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:27.699293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-852523fd-be4c-4b8f-9db8-bd6570a3047c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:27.706438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-852523fd-be4c-4b8f-9db8-bd6570a3047c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:27.706934 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-852523fd-be4c-4b8f-9db8-bd6570a3047c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:27.707382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-852523fd-be4c-4b8f-9db8-bd6570a3047c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:27.708100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-852523fd-be4c-4b8f-9db8-bd6570a3047c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:27.708579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-852523fd-be4c-4b8f-9db8-bd6570a3047c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:27.709012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-852523fd-be4c-4b8f-9db8-bd6570a3047c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:27.849275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-852523fd-be4c-4b8f-9db8-bd6570a3047c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:27.857634 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-852523fd-be4c-4b8f-9db8-bd6570a3047c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927" status: 200 len: 1404 microversion: 2.1 time: 0.163122 Oct 29 03:32:27.858224 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3290/6358] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:27 2022] GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 => generated 1404 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:27.880228 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9d733886-d071-4f0f-8860-1897ba665327 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-889119185"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:32:27.882634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9d733886-d071-4f0f-8860-1897ba665327 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:27.889366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d733886-d071-4f0f-8860-1897ba665327 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:27.889861 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d733886-d071-4f0f-8860-1897ba665327 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:27.890298 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d733886-d071-4f0f-8860-1897ba665327 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:27.891021 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d733886-d071-4f0f-8860-1897ba665327 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:27.891483 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d733886-d071-4f0f-8860-1897ba665327 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:27.891917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d733886-d071-4f0f-8860-1897ba665327 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:27.992701 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.compute.api [None req-9d733886-d071-4f0f-8860-1897ba665327 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Attempting to quiesce instance before volume snapshot. Oct 29 03:32:28.045924 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.compute.api [None req-9d733886-d071-4f0f-8860-1897ba665327 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 29 03:32:28.119365 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9d733886-d071-4f0f-8860-1897ba665327 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Creating snapshot from volume 660b202c-fda7-4374-8461-955f20df8132. {{(pid=127125) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 29 03:32:28.968151 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9d733886-d071-4f0f-8860-1897ba665327 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "POST /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927/action" status: 202 len: 0 microversion: 2.1 time: 1.091864 Oct 29 03:32:28.970438 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3069/6359] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:32:27 2022] POST /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927/action => generated 0 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 03:32:30.142290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8525a6b6-7161-4831-9f26-27b59b473e01 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1426668785", "imageRef": "8f55b50c-6904-4f65-a664-b0539e89ae65", "flavorRef": "452", "networks": [{"uuid": "99eca644-5d6e-42bc-9cf9-7cf1c8e093be"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:32:30.202999 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-8525a6b6-7161-4831-9f26-27b59b473e01 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] validate_networks() for [('99eca644-5d6e-42bc-9cf9-7cf1c8e093be', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:32:30.597925 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-8525a6b6-7161-4831-9f26-27b59b473e01 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:32:30.598661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-8525a6b6-7161-4831-9f26-27b59b473e01 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:32:30.599296 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-8525a6b6-7161-4831-9f26-27b59b473e01 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:32:30.600086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-8525a6b6-7161-4831-9f26-27b59b473e01 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:32:30.600663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-8525a6b6-7161-4831-9f26-27b59b473e01 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:32:30.603668 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:32:30.615706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8525a6b6-7161-4831-9f26-27b59b473e01 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:30.616414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8525a6b6-7161-4831-9f26-27b59b473e01 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:30.617185 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8525a6b6-7161-4831-9f26-27b59b473e01 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:30.618180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8525a6b6-7161-4831-9f26-27b59b473e01 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:30.618942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8525a6b6-7161-4831-9f26-27b59b473e01 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:30.619501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8525a6b6-7161-4831-9f26-27b59b473e01 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:30.629592 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:32:30.647932 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-8525a6b6-7161-4831-9f26-27b59b473e01 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Getting quotas for project 7c164fcbf0df4575b66149f2298496e3. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:32:30.655056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-8525a6b6-7161-4831-9f26-27b59b473e01 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Getting quotas for user 187e7d6474db4b8e813ff31fcddb4034 and project 7c164fcbf0df4575b66149f2298496e3. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:32:30.671528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8525a6b6-7161-4831-9f26-27b59b473e01 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:32:30.675177 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8525a6b6-7161-4831-9f26-27b59b473e01 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='770c9cab-0072-46a6-8cca-0a20a8a553bb',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:32:30.767022 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8525a6b6-7161-4831-9f26-27b59b473e01 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.628643 Oct 29 03:32:30.767735 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3291/6360] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:32:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:32:30.785732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-df10485a-98d3-49ea-a634-c8e88bc78421 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:30.786742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-df10485a-98d3-49ea-a634-c8e88bc78421 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:30.851741 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-df10485a-98d3-49ea-a634-c8e88bc78421 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:30.862299 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-df10485a-98d3-49ea-a634-c8e88bc78421 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1230 microversion: 2.1 time: 0.083789 Oct 29 03:32:30.863255 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3070/6361] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:30 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1230 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:31.893850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4bd987cb-8a5f-4e1c-988d-5bce639d83f0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:31.894922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4bd987cb-8a5f-4e1c-988d-5bce639d83f0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:31.907753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bd987cb-8a5f-4e1c-988d-5bce639d83f0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:31.908266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bd987cb-8a5f-4e1c-988d-5bce639d83f0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:31.908739 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bd987cb-8a5f-4e1c-988d-5bce639d83f0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:31.909509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bd987cb-8a5f-4e1c-988d-5bce639d83f0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:31.909995 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bd987cb-8a5f-4e1c-988d-5bce639d83f0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:31.910462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bd987cb-8a5f-4e1c-988d-5bce639d83f0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:31.995905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4bd987cb-8a5f-4e1c-988d-5bce639d83f0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:32.004242 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4bd987cb-8a5f-4e1c-988d-5bce639d83f0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1290 microversion: 2.1 time: 0.118019 Oct 29 03:32:32.020602 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3292/6362] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:31 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1290 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:33.038730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ed398984-16ce-4853-9777-2e1fcaffe376 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:33.041045 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ed398984-16ce-4853-9777-2e1fcaffe376 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:33.054016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed398984-16ce-4853-9777-2e1fcaffe376 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:33.054820 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed398984-16ce-4853-9777-2e1fcaffe376 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:33.055428 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed398984-16ce-4853-9777-2e1fcaffe376 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:33.056376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed398984-16ce-4853-9777-2e1fcaffe376 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:33.070497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed398984-16ce-4853-9777-2e1fcaffe376 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:33.080230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed398984-16ce-4853-9777-2e1fcaffe376 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:33.417576 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ed398984-16ce-4853-9777-2e1fcaffe376 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:33.427690 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ed398984-16ce-4853-9777-2e1fcaffe376 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1342 microversion: 2.1 time: 0.394427 Oct 29 03:32:33.439931 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3071/6363] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:33 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1342 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:33.796564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-4bd07dc8-dd24-402a-b9fe-7b2ae592fddb req-d0bdc4d6-db55-48fa-bc26-fcee2be89d3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "312aea0b-77af-41da-b808-808bb18f16a3", "tag": "667c3afb-561d-4d70-8c50-1a2bdf1c8092"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:32:33.807749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4bd07dc8-dd24-402a-b9fe-7b2ae592fddb req-d0bdc4d6-db55-48fa-bc26-fcee2be89d3c service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:33.808537 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4bd07dc8-dd24-402a-b9fe-7b2ae592fddb req-d0bdc4d6-db55-48fa-bc26-fcee2be89d3c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:33.809276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4bd07dc8-dd24-402a-b9fe-7b2ae592fddb req-d0bdc4d6-db55-48fa-bc26-fcee2be89d3c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:33.824587 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-4bd07dc8-dd24-402a-b9fe-7b2ae592fddb req-d0bdc4d6-db55-48fa-bc26-fcee2be89d3c service nova] Creating event network-changed:667c3afb-561d-4d70-8c50-1a2bdf1c8092 for instance 312aea0b-77af-41da-b808-808bb18f16a3 on n-h1-862967-2 Oct 29 03:32:33.830896 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-4bd07dc8-dd24-402a-b9fe-7b2ae592fddb req-d0bdc4d6-db55-48fa-bc26-fcee2be89d3c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038093 Oct 29 03:32:33.832086 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3293/6364] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:32:34.454634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dbf3351e-d646-4fd0-8d93-0bca7899856a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:34.455973 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dbf3351e-d646-4fd0-8d93-0bca7899856a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:34.477728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbf3351e-d646-4fd0-8d93-0bca7899856a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:34.480384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbf3351e-d646-4fd0-8d93-0bca7899856a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:34.480384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbf3351e-d646-4fd0-8d93-0bca7899856a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:34.480384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbf3351e-d646-4fd0-8d93-0bca7899856a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:34.480384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbf3351e-d646-4fd0-8d93-0bca7899856a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:34.484417 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dbf3351e-d646-4fd0-8d93-0bca7899856a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:34.719183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dbf3351e-d646-4fd0-8d93-0bca7899856a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:34.728054 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dbf3351e-d646-4fd0-8d93-0bca7899856a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1342 microversion: 2.1 time: 0.279950 Oct 29 03:32:34.729331 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3072/6365] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:34 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1342 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:35.755301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cd8c9d6d-1875-41ce-8761-3aa509d63880 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:35.756040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cd8c9d6d-1875-41ce-8761-3aa509d63880 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:35.774863 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd8c9d6d-1875-41ce-8761-3aa509d63880 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:35.775943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd8c9d6d-1875-41ce-8761-3aa509d63880 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:35.776884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd8c9d6d-1875-41ce-8761-3aa509d63880 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:35.777728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd8c9d6d-1875-41ce-8761-3aa509d63880 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:35.778282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd8c9d6d-1875-41ce-8761-3aa509d63880 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:35.778779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd8c9d6d-1875-41ce-8761-3aa509d63880 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:35.958925 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cd8c9d6d-1875-41ce-8761-3aa509d63880 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:35.969465 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cd8c9d6d-1875-41ce-8761-3aa509d63880 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1342 microversion: 2.1 time: 0.219258 Oct 29 03:32:35.970485 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3294/6366] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:35 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1342 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:36.996416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-74351484-d5fc-4c46-b765-ab3785d7259d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:36.997618 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-74351484-d5fc-4c46-b765-ab3785d7259d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:37.007422 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-74351484-d5fc-4c46-b765-ab3785d7259d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:37.008540 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-74351484-d5fc-4c46-b765-ab3785d7259d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:37.009338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-74351484-d5fc-4c46-b765-ab3785d7259d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:37.011328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-74351484-d5fc-4c46-b765-ab3785d7259d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:37.012202 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-74351484-d5fc-4c46-b765-ab3785d7259d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:37.013244 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-74351484-d5fc-4c46-b765-ab3785d7259d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:37.190230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-74351484-d5fc-4c46-b765-ab3785d7259d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:37.207070 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-74351484-d5fc-4c46-b765-ab3785d7259d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1342 microversion: 2.1 time: 0.217845 Oct 29 03:32:37.220614 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3073/6367] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:36 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1342 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:32:38.234139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e2ec9b51-d78b-4cc2-8981-3307977c46ea tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:38.235946 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e2ec9b51-d78b-4cc2-8981-3307977c46ea tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:38.244398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e2ec9b51-d78b-4cc2-8981-3307977c46ea tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:38.244916 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e2ec9b51-d78b-4cc2-8981-3307977c46ea tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:38.245352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e2ec9b51-d78b-4cc2-8981-3307977c46ea tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:38.246110 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e2ec9b51-d78b-4cc2-8981-3307977c46ea tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:38.246719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e2ec9b51-d78b-4cc2-8981-3307977c46ea tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:38.247152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e2ec9b51-d78b-4cc2-8981-3307977c46ea tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:38.426395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e2ec9b51-d78b-4cc2-8981-3307977c46ea tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:38.436007 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e2ec9b51-d78b-4cc2-8981-3307977c46ea tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1342 microversion: 2.1 time: 0.207688 Oct 29 03:32:38.437047 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3295/6368] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:38 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1342 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:39.464344 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cd461eb3-de26-4812-a606-a2f15e819e7c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:39.465774 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cd461eb3-de26-4812-a606-a2f15e819e7c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:39.473311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd461eb3-de26-4812-a606-a2f15e819e7c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:39.474335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd461eb3-de26-4812-a606-a2f15e819e7c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:39.475012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd461eb3-de26-4812-a606-a2f15e819e7c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:39.475962 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd461eb3-de26-4812-a606-a2f15e819e7c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:39.476493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd461eb3-de26-4812-a606-a2f15e819e7c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:39.476968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd461eb3-de26-4812-a606-a2f15e819e7c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:39.659520 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cd461eb3-de26-4812-a606-a2f15e819e7c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:39.669519 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cd461eb3-de26-4812-a606-a2f15e819e7c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1342 microversion: 2.1 time: 0.209545 Oct 29 03:32:39.670175 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3074/6369] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:39 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1342 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:40.699748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-47369e84-05fb-401c-9f10-854ac41fc11a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:40.700314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-47369e84-05fb-401c-9f10-854ac41fc11a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:40.703140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:32:40.703810 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:32:40.715851 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47369e84-05fb-401c-9f10-854ac41fc11a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:40.716483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47369e84-05fb-401c-9f10-854ac41fc11a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:40.717234 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47369e84-05fb-401c-9f10-854ac41fc11a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:40.718191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47369e84-05fb-401c-9f10-854ac41fc11a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:40.718891 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47369e84-05fb-401c-9f10-854ac41fc11a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:40.719580 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47369e84-05fb-401c-9f10-854ac41fc11a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:40.870568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-47369e84-05fb-401c-9f10-854ac41fc11a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:40.880709 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-47369e84-05fb-401c-9f10-854ac41fc11a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1342 microversion: 2.1 time: 0.184347 Oct 29 03:32:40.896543 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3296/6370] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:40 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1342 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:41.904097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3b7542a4-89d0-4023-98f7-be60371a3c9e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:41.905492 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3b7542a4-89d0-4023-98f7-be60371a3c9e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:41.908990 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:32:41.909752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=32 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:32:41.917004 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b7542a4-89d0-4023-98f7-be60371a3c9e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:41.917518 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b7542a4-89d0-4023-98f7-be60371a3c9e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:41.917964 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b7542a4-89d0-4023-98f7-be60371a3c9e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:41.918737 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b7542a4-89d0-4023-98f7-be60371a3c9e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:41.919204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b7542a4-89d0-4023-98f7-be60371a3c9e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:41.919644 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b7542a4-89d0-4023-98f7-be60371a3c9e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:41.936050 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:32:42.082171 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3b7542a4-89d0-4023-98f7-be60371a3c9e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:42.093250 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3b7542a4-89d0-4023-98f7-be60371a3c9e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1342 microversion: 2.1 time: 0.193677 Oct 29 03:32:42.096884 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3075/6371] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:41 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1342 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:43.116179 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c80a3081-46a0-4872-bc82-6f57c7852b85 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:43.116957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c80a3081-46a0-4872-bc82-6f57c7852b85 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:43.125130 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c80a3081-46a0-4872-bc82-6f57c7852b85 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:43.125625 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c80a3081-46a0-4872-bc82-6f57c7852b85 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:43.126076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c80a3081-46a0-4872-bc82-6f57c7852b85 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:43.126814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c80a3081-46a0-4872-bc82-6f57c7852b85 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:43.127266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c80a3081-46a0-4872-bc82-6f57c7852b85 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:43.127661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c80a3081-46a0-4872-bc82-6f57c7852b85 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:43.287178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c80a3081-46a0-4872-bc82-6f57c7852b85 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:43.296193 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c80a3081-46a0-4872-bc82-6f57c7852b85 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1342 microversion: 2.1 time: 0.184427 Oct 29 03:32:43.296964 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3297/6372] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:43 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1342 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:44.319613 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2d090ac9-0ba1-4ab8-a7fc-2f94284f8c0f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:44.321192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2d090ac9-0ba1-4ab8-a7fc-2f94284f8c0f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:44.328876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d090ac9-0ba1-4ab8-a7fc-2f94284f8c0f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:44.329586 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d090ac9-0ba1-4ab8-a7fc-2f94284f8c0f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:44.330018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d090ac9-0ba1-4ab8-a7fc-2f94284f8c0f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:44.330848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d090ac9-0ba1-4ab8-a7fc-2f94284f8c0f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:44.331384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d090ac9-0ba1-4ab8-a7fc-2f94284f8c0f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:44.331885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d090ac9-0ba1-4ab8-a7fc-2f94284f8c0f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:44.474461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2d090ac9-0ba1-4ab8-a7fc-2f94284f8c0f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:44.483488 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2d090ac9-0ba1-4ab8-a7fc-2f94284f8c0f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1342 microversion: 2.1 time: 0.167839 Oct 29 03:32:44.484074 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3076/6373] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:44 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1342 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:32:45.509849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1dfe0bf2-9a24-4a80-b9cd-4e941ab56ab2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:45.511712 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1dfe0bf2-9a24-4a80-b9cd-4e941ab56ab2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:45.520315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1dfe0bf2-9a24-4a80-b9cd-4e941ab56ab2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:45.520929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1dfe0bf2-9a24-4a80-b9cd-4e941ab56ab2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:45.521395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1dfe0bf2-9a24-4a80-b9cd-4e941ab56ab2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:45.522106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1dfe0bf2-9a24-4a80-b9cd-4e941ab56ab2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:45.522824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1dfe0bf2-9a24-4a80-b9cd-4e941ab56ab2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:45.523189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1dfe0bf2-9a24-4a80-b9cd-4e941ab56ab2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:45.727284 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1dfe0bf2-9a24-4a80-b9cd-4e941ab56ab2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:45.741465 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1dfe0bf2-9a24-4a80-b9cd-4e941ab56ab2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1342 microversion: 2.1 time: 0.238216 Oct 29 03:32:45.742903 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3298/6374] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:45 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1342 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:46.767707 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-03dc2463-2cba-4f34-a162-de2d15b4e7fd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:46.768383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-03dc2463-2cba-4f34-a162-de2d15b4e7fd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:46.776692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03dc2463-2cba-4f34-a162-de2d15b4e7fd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:46.777235 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03dc2463-2cba-4f34-a162-de2d15b4e7fd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:46.777678 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03dc2463-2cba-4f34-a162-de2d15b4e7fd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:46.778401 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03dc2463-2cba-4f34-a162-de2d15b4e7fd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:46.778864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03dc2463-2cba-4f34-a162-de2d15b4e7fd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:46.779287 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03dc2463-2cba-4f34-a162-de2d15b4e7fd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:46.932895 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-03dc2463-2cba-4f34-a162-de2d15b4e7fd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:46.942576 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-03dc2463-2cba-4f34-a162-de2d15b4e7fd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1342 microversion: 2.1 time: 0.178756 Oct 29 03:32:46.943402 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3077/6375] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:46 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1342 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:47.968050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7b6a931d-ffe6-4e35-9b02-ac9fe02ede59 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:47.969365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7b6a931d-ffe6-4e35-9b02-ac9fe02ede59 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:47.977100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b6a931d-ffe6-4e35-9b02-ac9fe02ede59 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:47.977588 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b6a931d-ffe6-4e35-9b02-ac9fe02ede59 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:47.978026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b6a931d-ffe6-4e35-9b02-ac9fe02ede59 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:47.978860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b6a931d-ffe6-4e35-9b02-ac9fe02ede59 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:47.979314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b6a931d-ffe6-4e35-9b02-ac9fe02ede59 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:47.979738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b6a931d-ffe6-4e35-9b02-ac9fe02ede59 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:48.130489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7b6a931d-ffe6-4e35-9b02-ac9fe02ede59 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:48.139251 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7b6a931d-ffe6-4e35-9b02-ac9fe02ede59 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1376 microversion: 2.1 time: 0.176156 Oct 29 03:32:48.139854 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3299/6376] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:47 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1376 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:49.163064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6411fc9b-2434-4e24-b383-6795daae5c62 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:49.163702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6411fc9b-2434-4e24-b383-6795daae5c62 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:49.171011 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6411fc9b-2434-4e24-b383-6795daae5c62 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:49.171514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6411fc9b-2434-4e24-b383-6795daae5c62 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:49.171959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6411fc9b-2434-4e24-b383-6795daae5c62 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:49.172734 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6411fc9b-2434-4e24-b383-6795daae5c62 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:49.173199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6411fc9b-2434-4e24-b383-6795daae5c62 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:49.173635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6411fc9b-2434-4e24-b383-6795daae5c62 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:49.317952 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6411fc9b-2434-4e24-b383-6795daae5c62 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:49.326600 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6411fc9b-2434-4e24-b383-6795daae5c62 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1376 microversion: 2.1 time: 0.167634 Oct 29 03:32:49.327316 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3078/6377] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:49 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1376 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:50.350505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eecf4c07-f1e9-4e51-a430-21ce79435133 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:50.351150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-eecf4c07-f1e9-4e51-a430-21ce79435133 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:50.358632 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eecf4c07-f1e9-4e51-a430-21ce79435133 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:50.359123 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eecf4c07-f1e9-4e51-a430-21ce79435133 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:50.359562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eecf4c07-f1e9-4e51-a430-21ce79435133 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:50.360263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eecf4c07-f1e9-4e51-a430-21ce79435133 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:50.360750 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eecf4c07-f1e9-4e51-a430-21ce79435133 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:50.361171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eecf4c07-f1e9-4e51-a430-21ce79435133 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:50.516426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-eecf4c07-f1e9-4e51-a430-21ce79435133 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:50.526023 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eecf4c07-f1e9-4e51-a430-21ce79435133 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1376 microversion: 2.1 time: 0.179445 Oct 29 03:32:50.526774 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3300/6378] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:50 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1376 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:51.550722 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0686bff3-e7d3-4b6c-8398-4a7fb7158267 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:51.551560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0686bff3-e7d3-4b6c-8398-4a7fb7158267 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:51.561685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0686bff3-e7d3-4b6c-8398-4a7fb7158267 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:51.562191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0686bff3-e7d3-4b6c-8398-4a7fb7158267 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:51.562643 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0686bff3-e7d3-4b6c-8398-4a7fb7158267 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:51.563367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0686bff3-e7d3-4b6c-8398-4a7fb7158267 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:51.563840 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0686bff3-e7d3-4b6c-8398-4a7fb7158267 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:51.564287 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0686bff3-e7d3-4b6c-8398-4a7fb7158267 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:51.718455 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0686bff3-e7d3-4b6c-8398-4a7fb7158267 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:51.727875 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0686bff3-e7d3-4b6c-8398-4a7fb7158267 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1376 microversion: 2.1 time: 0.181721 Oct 29 03:32:51.728516 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3079/6379] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:51 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1376 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:52.754930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1223bbed-2a6e-44b6-a1aa-c73e6c5029c8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:52.755750 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1223bbed-2a6e-44b6-a1aa-c73e6c5029c8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:52.765042 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1223bbed-2a6e-44b6-a1aa-c73e6c5029c8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:52.765679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1223bbed-2a6e-44b6-a1aa-c73e6c5029c8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:52.766127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1223bbed-2a6e-44b6-a1aa-c73e6c5029c8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:52.767163 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1223bbed-2a6e-44b6-a1aa-c73e6c5029c8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:52.767611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1223bbed-2a6e-44b6-a1aa-c73e6c5029c8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:52.768112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1223bbed-2a6e-44b6-a1aa-c73e6c5029c8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:52.938637 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1223bbed-2a6e-44b6-a1aa-c73e6c5029c8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:52.948333 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1223bbed-2a6e-44b6-a1aa-c73e6c5029c8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1376 microversion: 2.1 time: 0.197870 Oct 29 03:32:52.949052 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3301/6380] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:52 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1376 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:53.974489 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fcb326f2-1c87-4c6a-ae81-0691ee5d3d04 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:53.975801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fcb326f2-1c87-4c6a-ae81-0691ee5d3d04 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:53.983356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fcb326f2-1c87-4c6a-ae81-0691ee5d3d04 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:53.983867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fcb326f2-1c87-4c6a-ae81-0691ee5d3d04 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:53.984306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fcb326f2-1c87-4c6a-ae81-0691ee5d3d04 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:53.985121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fcb326f2-1c87-4c6a-ae81-0691ee5d3d04 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:53.985583 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fcb326f2-1c87-4c6a-ae81-0691ee5d3d04 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:53.986016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fcb326f2-1c87-4c6a-ae81-0691ee5d3d04 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:54.146727 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fcb326f2-1c87-4c6a-ae81-0691ee5d3d04 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:54.155276 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fcb326f2-1c87-4c6a-ae81-0691ee5d3d04 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1376 microversion: 2.1 time: 0.184979 Oct 29 03:32:54.155801 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3080/6381] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:53 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1376 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:55.179115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6aa20d85-0e3e-4900-8a0c-eda83961735c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:55.179724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6aa20d85-0e3e-4900-8a0c-eda83961735c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:55.187046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6aa20d85-0e3e-4900-8a0c-eda83961735c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:55.187915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6aa20d85-0e3e-4900-8a0c-eda83961735c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:55.188451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6aa20d85-0e3e-4900-8a0c-eda83961735c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:55.189357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6aa20d85-0e3e-4900-8a0c-eda83961735c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:55.189853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6aa20d85-0e3e-4900-8a0c-eda83961735c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:55.190381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6aa20d85-0e3e-4900-8a0c-eda83961735c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:55.339562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6aa20d85-0e3e-4900-8a0c-eda83961735c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:55.348391 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6aa20d85-0e3e-4900-8a0c-eda83961735c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1376 microversion: 2.1 time: 0.173238 Oct 29 03:32:55.349330 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3302/6382] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:55 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1376 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:56.377470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-62604323-3a61-4bc2-8a94-0ba989ecf315 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:56.378905 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-62604323-3a61-4bc2-8a94-0ba989ecf315 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:56.389495 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62604323-3a61-4bc2-8a94-0ba989ecf315 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:56.390300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62604323-3a61-4bc2-8a94-0ba989ecf315 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:56.391025 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62604323-3a61-4bc2-8a94-0ba989ecf315 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:56.391895 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62604323-3a61-4bc2-8a94-0ba989ecf315 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:56.392603 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62604323-3a61-4bc2-8a94-0ba989ecf315 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:56.393346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62604323-3a61-4bc2-8a94-0ba989ecf315 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:56.594913 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-62604323-3a61-4bc2-8a94-0ba989ecf315 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:56.604390 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-62604323-3a61-4bc2-8a94-0ba989ecf315 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1376 microversion: 2.1 time: 0.231046 Oct 29 03:32:56.608617 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3081/6383] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:56 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1376 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:56.648006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-9489b151-0b3b-4cc3-830e-c1c0d7252578 req-fe008952-3e55-4697-a98a-ca1975f9473d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "312aea0b-77af-41da-b808-808bb18f16a3", "name": "network-vif-plugged", "status": "completed", "tag": "667c3afb-561d-4d70-8c50-1a2bdf1c8092"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:32:56.661610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9489b151-0b3b-4cc3-830e-c1c0d7252578 req-fe008952-3e55-4697-a98a-ca1975f9473d service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:56.662247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9489b151-0b3b-4cc3-830e-c1c0d7252578 req-fe008952-3e55-4697-a98a-ca1975f9473d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:56.662771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9489b151-0b3b-4cc3-830e-c1c0d7252578 req-fe008952-3e55-4697-a98a-ca1975f9473d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:56.680874 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-9489b151-0b3b-4cc3-830e-c1c0d7252578 req-fe008952-3e55-4697-a98a-ca1975f9473d service nova] Creating event network-vif-plugged:667c3afb-561d-4d70-8c50-1a2bdf1c8092 for instance 312aea0b-77af-41da-b808-808bb18f16a3 on n-h1-862967-2 Oct 29 03:32:56.686821 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-9489b151-0b3b-4cc3-830e-c1c0d7252578 req-fe008952-3e55-4697-a98a-ca1975f9473d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042711 Oct 29 03:32:56.687619 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3303/6384] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:32:57.635602 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c63027fc-13c1-456d-9e75-35728d591442 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:57.636775 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c63027fc-13c1-456d-9e75-35728d591442 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:57.646092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c63027fc-13c1-456d-9e75-35728d591442 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:57.646933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c63027fc-13c1-456d-9e75-35728d591442 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:57.647468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c63027fc-13c1-456d-9e75-35728d591442 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:57.648261 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c63027fc-13c1-456d-9e75-35728d591442 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:57.648877 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c63027fc-13c1-456d-9e75-35728d591442 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:57.649500 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c63027fc-13c1-456d-9e75-35728d591442 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:57.810481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c63027fc-13c1-456d-9e75-35728d591442 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:57.820925 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c63027fc-13c1-456d-9e75-35728d591442 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1376 microversion: 2.1 time: 0.192727 Oct 29 03:32:57.821877 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3082/6385] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:57 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1376 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:32:58.850172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9b908b7d-2705-442c-b7d3-c7090bc4562b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:58.851119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9b908b7d-2705-442c-b7d3-c7090bc4562b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:58.857692 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b908b7d-2705-442c-b7d3-c7090bc4562b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:58.858184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b908b7d-2705-442c-b7d3-c7090bc4562b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:58.858738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b908b7d-2705-442c-b7d3-c7090bc4562b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:58.859503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b908b7d-2705-442c-b7d3-c7090bc4562b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:58.859965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b908b7d-2705-442c-b7d3-c7090bc4562b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:58.860387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b908b7d-2705-442c-b7d3-c7090bc4562b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:59.019374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9b908b7d-2705-442c-b7d3-c7090bc4562b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:59.028854 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9b908b7d-2705-442c-b7d3-c7090bc4562b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1562 microversion: 2.1 time: 0.184992 Oct 29 03:32:59.029496 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3304/6386] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:58 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1562 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:32:59.055451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7144ea4e-a425-4a1b-b0aa-01aead3dc5d2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:59.056337 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7144ea4e-a425-4a1b-b0aa-01aead3dc5d2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:59.066692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7144ea4e-a425-4a1b-b0aa-01aead3dc5d2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:59.067272 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7144ea4e-a425-4a1b-b0aa-01aead3dc5d2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:59.067883 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7144ea4e-a425-4a1b-b0aa-01aead3dc5d2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:59.068842 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7144ea4e-a425-4a1b-b0aa-01aead3dc5d2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:59.069353 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7144ea4e-a425-4a1b-b0aa-01aead3dc5d2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:59.069861 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7144ea4e-a425-4a1b-b0aa-01aead3dc5d2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:59.246257 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7144ea4e-a425-4a1b-b0aa-01aead3dc5d2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:59.254699 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7144ea4e-a425-4a1b-b0aa-01aead3dc5d2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1562 microversion: 2.1 time: 0.205897 Oct 29 03:32:59.255286 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3083/6387] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:59 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1562 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:32:59.349034 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0e8fa03a-f588-4cf5-98c0-194025311b09 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:59.350106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0e8fa03a-f588-4cf5-98c0-194025311b09 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:59.358301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0e8fa03a-f588-4cf5-98c0-194025311b09 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:59.359271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0e8fa03a-f588-4cf5-98c0-194025311b09 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:59.359709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0e8fa03a-f588-4cf5-98c0-194025311b09 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:59.362126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0e8fa03a-f588-4cf5-98c0-194025311b09 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:59.362126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0e8fa03a-f588-4cf5-98c0-194025311b09 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:59.362611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0e8fa03a-f588-4cf5-98c0-194025311b09 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:59.402474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0e8fa03a-f588-4cf5-98c0-194025311b09 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:32:59.532292 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0e8fa03a-f588-4cf5-98c0-194025311b09 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "DELETE /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 204 len: 0 microversion: 2.1 time: 0.188119 Oct 29 03:32:59.536738 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3305/6388] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:32:59 2022] DELETE /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:32:59.541620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-98f8beb6-5e1c-423b-9f98-b6338d830dcb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:32:59.542403 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-98f8beb6-5e1c-423b-9f98-b6338d830dcb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:32:59.549945 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98f8beb6-5e1c-423b-9f98-b6338d830dcb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:59.550493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98f8beb6-5e1c-423b-9f98-b6338d830dcb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:59.550917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98f8beb6-5e1c-423b-9f98-b6338d830dcb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:59.551630 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98f8beb6-5e1c-423b-9f98-b6338d830dcb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:32:59.552092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98f8beb6-5e1c-423b-9f98-b6338d830dcb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:32:59.552617 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-98f8beb6-5e1c-423b-9f98-b6338d830dcb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:32:59.731885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-98f8beb6-5e1c-423b-9f98-b6338d830dcb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:32:59.741230 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-98f8beb6-5e1c-423b-9f98-b6338d830dcb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1568 microversion: 2.1 time: 0.203669 Oct 29 03:32:59.742053 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3084/6389] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:32:59 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1568 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:33:00.767387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-13dd8955-fe47-4271-94f7-44b265cc5b8e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:00.768081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-13dd8955-fe47-4271-94f7-44b265cc5b8e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:00.770865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:33:00.777053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13dd8955-fe47-4271-94f7-44b265cc5b8e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:00.777651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13dd8955-fe47-4271-94f7-44b265cc5b8e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:00.778115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13dd8955-fe47-4271-94f7-44b265cc5b8e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:00.778828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13dd8955-fe47-4271-94f7-44b265cc5b8e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:00.779275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13dd8955-fe47-4271-94f7-44b265cc5b8e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:00.779697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13dd8955-fe47-4271-94f7-44b265cc5b8e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:00.783074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:33:00.925816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-13dd8955-fe47-4271-94f7-44b265cc5b8e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:00.934242 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-13dd8955-fe47-4271-94f7-44b265cc5b8e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1568 microversion: 2.1 time: 0.171225 Oct 29 03:33:00.934831 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3306/6390] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:00 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:01.669722 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-7a0b9559-be2b-4491-b17a-395bd01527f5 req-b47473b1-cedb-4003-b6e5-93a57cfd46ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "312aea0b-77af-41da-b808-808bb18f16a3", "name": "network-vif-deleted", "tag": "667c3afb-561d-4d70-8c50-1a2bdf1c8092"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:33:01.689289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7a0b9559-be2b-4491-b17a-395bd01527f5 req-b47473b1-cedb-4003-b6e5-93a57cfd46ed service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:01.693918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7a0b9559-be2b-4491-b17a-395bd01527f5 req-b47473b1-cedb-4003-b6e5-93a57cfd46ed service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:01.697922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7a0b9559-be2b-4491-b17a-395bd01527f5 req-b47473b1-cedb-4003-b6e5-93a57cfd46ed service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:01.712196 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-7a0b9559-be2b-4491-b17a-395bd01527f5 req-b47473b1-cedb-4003-b6e5-93a57cfd46ed service nova] Creating event network-vif-deleted:667c3afb-561d-4d70-8c50-1a2bdf1c8092 for instance 312aea0b-77af-41da-b808-808bb18f16a3 on n-h1-862967-2 Oct 29 03:33:01.717619 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-7a0b9559-be2b-4491-b17a-395bd01527f5 req-b47473b1-cedb-4003-b6e5-93a57cfd46ed service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053472 Oct 29 03:33:01.718942 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3085/6391] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:33:01.957255 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-23f2146c-29fe-4a3e-850f-60d19f7e661a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:01.957828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-23f2146c-29fe-4a3e-850f-60d19f7e661a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:01.965236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23f2146c-29fe-4a3e-850f-60d19f7e661a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:01.965819 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23f2146c-29fe-4a3e-850f-60d19f7e661a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:01.966294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23f2146c-29fe-4a3e-850f-60d19f7e661a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:01.967279 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23f2146c-29fe-4a3e-850f-60d19f7e661a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:01.967802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23f2146c-29fe-4a3e-850f-60d19f7e661a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:01.968292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23f2146c-29fe-4a3e-850f-60d19f7e661a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:02.034751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-23f2146c-29fe-4a3e-850f-60d19f7e661a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:02.047047 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-23f2146c-29fe-4a3e-850f-60d19f7e661a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1361 microversion: 2.1 time: 0.093465 Oct 29 03:33:02.048547 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3307/6392] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:01 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1361 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:03.079097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-af160c12-b1f9-4308-8c89-be745e124677 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:03.079822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-af160c12-b1f9-4308-8c89-be745e124677 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:03.086446 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af160c12-b1f9-4308-8c89-be745e124677 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:03.086956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af160c12-b1f9-4308-8c89-be745e124677 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:03.087833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af160c12-b1f9-4308-8c89-be745e124677 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:03.088579 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af160c12-b1f9-4308-8c89-be745e124677 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:03.089262 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af160c12-b1f9-4308-8c89-be745e124677 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:03.089740 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af160c12-b1f9-4308-8c89-be745e124677 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:03.163303 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-af160c12-b1f9-4308-8c89-be745e124677 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:03.180363 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-af160c12-b1f9-4308-8c89-be745e124677 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1361 microversion: 2.1 time: 0.112565 Oct 29 03:33:03.180994 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3086/6393] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:03 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1361 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:04.206106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e66c661f-de9e-47a9-a55e-8953c549f66a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:04.207040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e66c661f-de9e-47a9-a55e-8953c549f66a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:04.215959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e66c661f-de9e-47a9-a55e-8953c549f66a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:04.216880 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e66c661f-de9e-47a9-a55e-8953c549f66a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:04.217441 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e66c661f-de9e-47a9-a55e-8953c549f66a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:04.218321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e66c661f-de9e-47a9-a55e-8953c549f66a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:04.219271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e66c661f-de9e-47a9-a55e-8953c549f66a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:04.219696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e66c661f-de9e-47a9-a55e-8953c549f66a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:04.314889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e66c661f-de9e-47a9-a55e-8953c549f66a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:04.323414 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e66c661f-de9e-47a9-a55e-8953c549f66a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1361 microversion: 2.1 time: 0.121519 Oct 29 03:33:04.324181 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3308/6394] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:04 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1361 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:05.347263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b32e10e3-1e0d-4a9c-b563-23df5db5c3de tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:05.348010 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b32e10e3-1e0d-4a9c-b563-23df5db5c3de tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:05.355901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b32e10e3-1e0d-4a9c-b563-23df5db5c3de tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:05.356689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b32e10e3-1e0d-4a9c-b563-23df5db5c3de tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:05.357321 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b32e10e3-1e0d-4a9c-b563-23df5db5c3de tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:05.358217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b32e10e3-1e0d-4a9c-b563-23df5db5c3de tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:05.358866 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b32e10e3-1e0d-4a9c-b563-23df5db5c3de tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:05.359467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b32e10e3-1e0d-4a9c-b563-23df5db5c3de tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:05.451623 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b32e10e3-1e0d-4a9c-b563-23df5db5c3de tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:05.463575 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b32e10e3-1e0d-4a9c-b563-23df5db5c3de tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1361 microversion: 2.1 time: 0.120015 Oct 29 03:33:05.464476 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3087/6395] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:05 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1361 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:06.488873 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c40f1ea5-24e6-4049-80f9-ab02b7e50dd7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:06.489468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c40f1ea5-24e6-4049-80f9-ab02b7e50dd7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:06.498995 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c40f1ea5-24e6-4049-80f9-ab02b7e50dd7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:06.499966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c40f1ea5-24e6-4049-80f9-ab02b7e50dd7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:06.500400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c40f1ea5-24e6-4049-80f9-ab02b7e50dd7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:06.501167 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c40f1ea5-24e6-4049-80f9-ab02b7e50dd7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:06.501646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c40f1ea5-24e6-4049-80f9-ab02b7e50dd7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:06.502069 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c40f1ea5-24e6-4049-80f9-ab02b7e50dd7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:06.544001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c40f1ea5-24e6-4049-80f9-ab02b7e50dd7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:06.544779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c40f1ea5-24e6-4049-80f9-ab02b7e50dd7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:06.545475 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c40f1ea5-24e6-4049-80f9-ab02b7e50dd7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:06.546166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-c40f1ea5-24e6-4049-80f9-ab02b7e50dd7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lazy-loading 'fault' on Instance uuid 312aea0b-77af-41da-b808-808bb18f16a3 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:33:06.615242 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c40f1ea5-24e6-4049-80f9-ab02b7e50dd7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:06.628165 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c40f1ea5-24e6-4049-80f9-ab02b7e50dd7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 200 len: 1366 microversion: 2.1 time: 0.143505 Oct 29 03:33:06.629521 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3309/6396] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:06 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:07.652447 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-30d01813-34b0-4f8f-973b-2cbbe59049db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:07.653132 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-30d01813-34b0-4f8f-973b-2cbbe59049db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:07.662063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30d01813-34b0-4f8f-973b-2cbbe59049db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:07.662725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30d01813-34b0-4f8f-973b-2cbbe59049db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:07.663362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30d01813-34b0-4f8f-973b-2cbbe59049db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:07.663952 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30d01813-34b0-4f8f-973b-2cbbe59049db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:07.664426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30d01813-34b0-4f8f-973b-2cbbe59049db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:07.664910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-30d01813-34b0-4f8f-973b-2cbbe59049db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:07.680205 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-30d01813-34b0-4f8f-973b-2cbbe59049db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] HTTP exception thrown: Instance 312aea0b-77af-41da-b808-808bb18f16a3 could not be found. Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-30d01813-34b0-4f8f-973b-2cbbe59049db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Request method failure captured: Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 HTTP/1.1 Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJ4OGFERKLIttSSPB0-5-jXA-TX6OM8jt9EJzgHtp2De1EitDQkx8TOt6_WbUmBu_Y6n6LIcWJu35cEqto8LlaLBvd7Fx6PpdDw_gDp2R4doflmhUMo3Zw8gq8dju5JmvbgI04aG1xuqlCslUnwpoihX0XXo_veRrdoDDtMm482XfyM Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7c164fcbf0df4575b66149f2298496e3"}]}] Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestVolumeBootPattern-894604406 Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 187e7d6474db4b8e813ff31fcddb4034 Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 312aea0b-77af-41da-b808-808bb18f16a3 could not be found. Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '312aea0b-77af-41da-b808-808bb18f16a3'} Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 312aea0b-77af-41da-b808-808bb18f16a3 could not be found. Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 312aea0b-77af-41da-b808-808bb18f16a3 could not be found. Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:33:07.682467 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:33:07.688974 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:33:07.688974 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:33:07.688974 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:33:07.688974 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:33:07.688974 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:33:07.688974 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 312aea0b-77af-41da-b808-808bb18f16a3 could not be found. Oct 29 03:33:07.688974 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:33:07.688974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-30d01813-34b0-4f8f-973b-2cbbe59049db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Returning 404 to user: Instance 312aea0b-77af-41da-b808-808bb18f16a3 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:33:07.688974 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-30d01813-34b0-4f8f-973b-2cbbe59049db tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 404 len: 111 microversion: 2.1 time: 0.036007 Oct 29 03:33:07.688974 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3088/6397] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:07 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:33:12.002950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6afca581-cb6e-4a99-80d5-727cd0f0f134 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:12.003828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6afca581-cb6e-4a99-80d5-727cd0f0f134 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:12.012900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6afca581-cb6e-4a99-80d5-727cd0f0f134 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:12.013414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6afca581-cb6e-4a99-80d5-727cd0f0f134 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:12.013850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6afca581-cb6e-4a99-80d5-727cd0f0f134 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:12.014578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6afca581-cb6e-4a99-80d5-727cd0f0f134 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:12.015033 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6afca581-cb6e-4a99-80d5-727cd0f0f134 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:12.048742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6afca581-cb6e-4a99-80d5-727cd0f0f134 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:12.053495 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6afca581-cb6e-4a99-80d5-727cd0f0f134 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:33:12.142860 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6afca581-cb6e-4a99-80d5-727cd0f0f134 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927" status: 204 len: 0 microversion: 2.1 time: 0.143697 Oct 29 03:33:12.146831 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3310/6398] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:33:11 2022] DELETE /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:33:12.153034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1765351f-6958-4a8d-9013-a5de2fb60888 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:12.154247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1765351f-6958-4a8d-9013-a5de2fb60888 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:12.156995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=28 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:33:12.165398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1765351f-6958-4a8d-9013-a5de2fb60888 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:12.165898 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1765351f-6958-4a8d-9013-a5de2fb60888 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:12.166353 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1765351f-6958-4a8d-9013-a5de2fb60888 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:12.167243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1765351f-6958-4a8d-9013-a5de2fb60888 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:12.167724 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1765351f-6958-4a8d-9013-a5de2fb60888 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:12.168158 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1765351f-6958-4a8d-9013-a5de2fb60888 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:12.171129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=76 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:33:12.310409 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1765351f-6958-4a8d-9013-a5de2fb60888 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:12.318831 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1765351f-6958-4a8d-9013-a5de2fb60888 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927" status: 200 len: 1410 microversion: 2.1 time: 0.170687 Oct 29 03:33:12.319415 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3089/6399] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:12 2022] GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 => generated 1410 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:13.343351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e5ffa439-5761-42a8-ab40-9be39adf82dc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:13.344064 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e5ffa439-5761-42a8-ab40-9be39adf82dc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:13.352478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e5ffa439-5761-42a8-ab40-9be39adf82dc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:13.353325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e5ffa439-5761-42a8-ab40-9be39adf82dc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:13.353913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e5ffa439-5761-42a8-ab40-9be39adf82dc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:13.354943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e5ffa439-5761-42a8-ab40-9be39adf82dc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:13.355721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e5ffa439-5761-42a8-ab40-9be39adf82dc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:13.356444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e5ffa439-5761-42a8-ab40-9be39adf82dc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:13.500415 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e5ffa439-5761-42a8-ab40-9be39adf82dc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:13.509774 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e5ffa439-5761-42a8-ab40-9be39adf82dc tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927" status: 200 len: 1410 microversion: 2.1 time: 0.170890 Oct 29 03:33:13.510353 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3311/6400] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:13 2022] GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 => generated 1410 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:14.340066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-5127ae77-c875-4efa-8f94-374232f3b147 req-f437b50d-3db6-4671-b147-8e952b5101af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ea9be11-5017-4959-a25b-76044d165927", "name": "network-vif-deleted", "tag": "d3fe6ead-d562-4769-b5e5-22c49e7b6e86"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:33:14.352924 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-5127ae77-c875-4efa-8f94-374232f3b147 req-f437b50d-3db6-4671-b147-8e952b5101af service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:14.353422 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-5127ae77-c875-4efa-8f94-374232f3b147 req-f437b50d-3db6-4671-b147-8e952b5101af service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:14.353863 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-5127ae77-c875-4efa-8f94-374232f3b147 req-f437b50d-3db6-4671-b147-8e952b5101af service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:14.368433 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-5127ae77-c875-4efa-8f94-374232f3b147 req-f437b50d-3db6-4671-b147-8e952b5101af service nova] Creating event network-vif-deleted:d3fe6ead-d562-4769-b5e5-22c49e7b6e86 for instance 6ea9be11-5017-4959-a25b-76044d165927 on n-h2-862967-2 Oct 29 03:33:14.375143 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-5127ae77-c875-4efa-8f94-374232f3b147 req-f437b50d-3db6-4671-b147-8e952b5101af service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039194 Oct 29 03:33:14.376717 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3090/6401] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:33:14.533423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-17091a9d-9835-43c3-8fbf-19058c6d5573 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:14.534161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-17091a9d-9835-43c3-8fbf-19058c6d5573 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:14.542533 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17091a9d-9835-43c3-8fbf-19058c6d5573 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:14.542957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17091a9d-9835-43c3-8fbf-19058c6d5573 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:14.543386 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17091a9d-9835-43c3-8fbf-19058c6d5573 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:14.544144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17091a9d-9835-43c3-8fbf-19058c6d5573 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:14.544655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17091a9d-9835-43c3-8fbf-19058c6d5573 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:14.545253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17091a9d-9835-43c3-8fbf-19058c6d5573 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:14.640678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-17091a9d-9835-43c3-8fbf-19058c6d5573 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:14.649797 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-17091a9d-9835-43c3-8fbf-19058c6d5573 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927" status: 200 len: 1202 microversion: 2.1 time: 0.120391 Oct 29 03:33:14.664837 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3312/6402] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:14 2022] GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 => generated 1202 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:15.682833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-53e7114e-ff4b-493c-b431-0821e03bf67b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:15.684162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-53e7114e-ff4b-493c-b431-0821e03bf67b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:15.692705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53e7114e-ff4b-493c-b431-0821e03bf67b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:15.693508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53e7114e-ff4b-493c-b431-0821e03bf67b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:15.694136 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53e7114e-ff4b-493c-b431-0821e03bf67b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:15.694992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53e7114e-ff4b-493c-b431-0821e03bf67b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:15.695590 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53e7114e-ff4b-493c-b431-0821e03bf67b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:15.696157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-53e7114e-ff4b-493c-b431-0821e03bf67b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:15.772222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-53e7114e-ff4b-493c-b431-0821e03bf67b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:15.781222 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-53e7114e-ff4b-493c-b431-0821e03bf67b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927" status: 200 len: 1202 microversion: 2.1 time: 0.103854 Oct 29 03:33:15.782349 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3091/6403] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:15 2022] GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 => generated 1202 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:16.804305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-66041e17-13a9-4e17-8c66-dac1a7b10d6a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:16.805528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-66041e17-13a9-4e17-8c66-dac1a7b10d6a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:16.813514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66041e17-13a9-4e17-8c66-dac1a7b10d6a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:16.814002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66041e17-13a9-4e17-8c66-dac1a7b10d6a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:16.814435 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66041e17-13a9-4e17-8c66-dac1a7b10d6a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:16.815302 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66041e17-13a9-4e17-8c66-dac1a7b10d6a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:16.815755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66041e17-13a9-4e17-8c66-dac1a7b10d6a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:16.816175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66041e17-13a9-4e17-8c66-dac1a7b10d6a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:16.889034 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-66041e17-13a9-4e17-8c66-dac1a7b10d6a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:16.898193 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-66041e17-13a9-4e17-8c66-dac1a7b10d6a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927" status: 200 len: 1202 microversion: 2.1 time: 0.097775 Oct 29 03:33:16.898855 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3313/6404] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:16 2022] GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 => generated 1202 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:17.923217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1b1209c1-e598-49fc-a6e7-41b2d7c8d3f3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:17.924085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1b1209c1-e598-49fc-a6e7-41b2d7c8d3f3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:17.931709 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b1209c1-e598-49fc-a6e7-41b2d7c8d3f3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:17.932218 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b1209c1-e598-49fc-a6e7-41b2d7c8d3f3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:17.932775 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b1209c1-e598-49fc-a6e7-41b2d7c8d3f3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:17.933554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b1209c1-e598-49fc-a6e7-41b2d7c8d3f3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:17.934204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b1209c1-e598-49fc-a6e7-41b2d7c8d3f3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:17.934659 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b1209c1-e598-49fc-a6e7-41b2d7c8d3f3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:18.014213 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1b1209c1-e598-49fc-a6e7-41b2d7c8d3f3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:18.022655 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1b1209c1-e598-49fc-a6e7-41b2d7c8d3f3 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927" status: 200 len: 1202 microversion: 2.1 time: 0.105016 Oct 29 03:33:18.024555 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3092/6405] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:17 2022] GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 => generated 1202 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:19.045997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-76fc9c36-8c9c-4fb9-bc48-ba13a78ca883 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:19.046740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-76fc9c36-8c9c-4fb9-bc48-ba13a78ca883 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:19.053809 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76fc9c36-8c9c-4fb9-bc48-ba13a78ca883 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:19.054550 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76fc9c36-8c9c-4fb9-bc48-ba13a78ca883 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:19.055394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76fc9c36-8c9c-4fb9-bc48-ba13a78ca883 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:19.056496 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76fc9c36-8c9c-4fb9-bc48-ba13a78ca883 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:19.057183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76fc9c36-8c9c-4fb9-bc48-ba13a78ca883 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:19.058075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76fc9c36-8c9c-4fb9-bc48-ba13a78ca883 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:19.092186 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-76fc9c36-8c9c-4fb9-bc48-ba13a78ca883 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] HTTP exception thrown: Instance 6ea9be11-5017-4959-a25b-76044d165927 could not be found. Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-76fc9c36-8c9c-4fb9-bc48-ba13a78ca883 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Request method failure captured: Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 HTTP/1.1 Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJ4OGFERKLIttSSPB0-5-jXA-TX6OM8jt9EJzgHtp2De1EitDQkx8TOt6_WbUmBu_Y6n6LIcWJu35cEqto8LlaLBvd7Fx6PpdDw_gDp2R4doflmhUMo3Zw8gq8dju5JmvbgI04aG1xuqlCslUnwpoihX0XXo_veRrdoDDtMm482XfyM Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7c164fcbf0df4575b66149f2298496e3"}]}] Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-TestVolumeBootPattern-894604406 Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 187e7d6474db4b8e813ff31fcddb4034 Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 6ea9be11-5017-4959-a25b-76044d165927 could not be found. Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '6ea9be11-5017-4959-a25b-76044d165927'} Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ea9be11-5017-4959-a25b-76044d165927 could not be found. Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ea9be11-5017-4959-a25b-76044d165927 could not be found. Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:33:19.097673 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:33:19.104776 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:33:19.104776 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:33:19.104776 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:33:19.104776 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:33:19.104776 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:33:19.104776 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ea9be11-5017-4959-a25b-76044d165927 could not be found. Oct 29 03:33:19.104776 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:33:19.106799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-76fc9c36-8c9c-4fb9-bc48-ba13a78ca883 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Returning 404 to user: Instance 6ea9be11-5017-4959-a25b-76044d165927 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:33:19.108637 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-76fc9c36-8c9c-4fb9-bc48-ba13a78ca883 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927" status: 404 len: 111 microversion: 2.1 time: 0.066443 Oct 29 03:33:19.110492 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3314/6406] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:19 2022] GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:33:22.323082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8f0a9c03-24c2-4623-864d-c4d57163528e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:22.324156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8f0a9c03-24c2-4623-864d-c4d57163528e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:22.331782 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f0a9c03-24c2-4623-864d-c4d57163528e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:22.332292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f0a9c03-24c2-4623-864d-c4d57163528e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:22.332790 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f0a9c03-24c2-4623-864d-c4d57163528e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:22.333520 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f0a9c03-24c2-4623-864d-c4d57163528e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:22.333992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f0a9c03-24c2-4623-864d-c4d57163528e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:22.334434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f0a9c03-24c2-4623-864d-c4d57163528e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:22.352764 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-8f0a9c03-24c2-4623-864d-c4d57163528e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] HTTP exception thrown: Instance 312aea0b-77af-41da-b808-808bb18f16a3 could not be found. Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8f0a9c03-24c2-4623-864d-c4d57163528e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Request method failure captured: Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 HTTP/1.1 Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJ4OGFERKLIttSSPB0-5-jXA-TX6OM8jt9EJzgHtp2De1EitDQkx8TOt6_WbUmBu_Y6n6LIcWJu35cEqto8LlaLBvd7Fx6PpdDw_gDp2R4doflmhUMo3Zw8gq8dju5JmvbgI04aG1xuqlCslUnwpoihX0XXo_veRrdoDDtMm482XfyM Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7c164fcbf0df4575b66149f2298496e3"}]}] Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestVolumeBootPattern-894604406 Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 187e7d6474db4b8e813ff31fcddb4034 Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 312aea0b-77af-41da-b808-808bb18f16a3 could not be found. Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '312aea0b-77af-41da-b808-808bb18f16a3'} Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 312aea0b-77af-41da-b808-808bb18f16a3 could not be found. Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:33:22.354692 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:33:22.358046 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 312aea0b-77af-41da-b808-808bb18f16a3 could not be found. Oct 29 03:33:22.358046 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:33:22.358046 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:33:22.358046 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:33:22.358046 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:33:22.358046 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:33:22.358046 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:33:22.358046 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:33:22.358046 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:33:22.358046 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 312aea0b-77af-41da-b808-808bb18f16a3 could not be found. Oct 29 03:33:22.358046 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:33:22.358046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8f0a9c03-24c2-4623-864d-c4d57163528e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Returning 404 to user: Instance 312aea0b-77af-41da-b808-808bb18f16a3 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:33:22.358046 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8f0a9c03-24c2-4623-864d-c4d57163528e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "DELETE /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 404 len: 111 microversion: 2.1 time: 0.037162 Oct 29 03:33:22.358046 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3093/6407] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:33:22 2022] DELETE /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:33:22.365526 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-845d9ff1-3de9-48c5-b47e-73d828cb91f1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:22.366566 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-845d9ff1-3de9-48c5-b47e-73d828cb91f1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 312aea0b-77af-41da-b808-808bb18f16a3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:22.377150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-845d9ff1-3de9-48c5-b47e-73d828cb91f1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:22.377650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-845d9ff1-3de9-48c5-b47e-73d828cb91f1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:22.378094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-845d9ff1-3de9-48c5-b47e-73d828cb91f1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:22.378809 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-845d9ff1-3de9-48c5-b47e-73d828cb91f1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:22.379275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-845d9ff1-3de9-48c5-b47e-73d828cb91f1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:22.379703 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-845d9ff1-3de9-48c5-b47e-73d828cb91f1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:22.394889 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-845d9ff1-3de9-48c5-b47e-73d828cb91f1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] HTTP exception thrown: Instance 312aea0b-77af-41da-b808-808bb18f16a3 could not be found. Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-845d9ff1-3de9-48c5-b47e-73d828cb91f1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Request method failure captured: Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 HTTP/1.1 Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJ4OGFERKLIttSSPB0-5-jXA-TX6OM8jt9EJzgHtp2De1EitDQkx8TOt6_WbUmBu_Y6n6LIcWJu35cEqto8LlaLBvd7Fx6PpdDw_gDp2R4doflmhUMo3Zw8gq8dju5JmvbgI04aG1xuqlCslUnwpoihX0XXo_veRrdoDDtMm482XfyM Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7c164fcbf0df4575b66149f2298496e3"}]}] Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-TestVolumeBootPattern-894604406 Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 187e7d6474db4b8e813ff31fcddb4034 Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 312aea0b-77af-41da-b808-808bb18f16a3 could not be found. Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '312aea0b-77af-41da-b808-808bb18f16a3'} Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 312aea0b-77af-41da-b808-808bb18f16a3 could not be found. Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 312aea0b-77af-41da-b808-808bb18f16a3 could not be found. Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:33:22.396731 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:33:22.399811 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:33:22.399811 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:33:22.399811 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:33:22.399811 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:33:22.399811 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:33:22.399811 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 312aea0b-77af-41da-b808-808bb18f16a3 could not be found. Oct 29 03:33:22.399811 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:33:22.399811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-845d9ff1-3de9-48c5-b47e-73d828cb91f1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Returning 404 to user: Instance 312aea0b-77af-41da-b808-808bb18f16a3 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:33:22.399811 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-845d9ff1-3de9-48c5-b47e-73d828cb91f1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3" status: 404 len: 111 microversion: 2.1 time: 0.037061 Oct 29 03:33:22.399811 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3315/6408] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:22 2022] GET /compute/v2.1/servers/312aea0b-77af-41da-b808-808bb18f16a3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:33:22.839964 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-85dcf45a-52ad-4185-a98d-e49dc102e3fd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:22.840134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-85dcf45a-52ad-4185-a98d-e49dc102e3fd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:22.848799 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85dcf45a-52ad-4185-a98d-e49dc102e3fd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:22.848799 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85dcf45a-52ad-4185-a98d-e49dc102e3fd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:22.848799 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85dcf45a-52ad-4185-a98d-e49dc102e3fd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:22.849572 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85dcf45a-52ad-4185-a98d-e49dc102e3fd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:22.849572 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85dcf45a-52ad-4185-a98d-e49dc102e3fd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:22.849780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85dcf45a-52ad-4185-a98d-e49dc102e3fd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:22.870011 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-85dcf45a-52ad-4185-a98d-e49dc102e3fd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] HTTP exception thrown: Instance 6ea9be11-5017-4959-a25b-76044d165927 could not be found. Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-85dcf45a-52ad-4185-a98d-e49dc102e3fd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Request method failure captured: Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 HTTP/1.1 Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJ4OGFERKLIttSSPB0-5-jXA-TX6OM8jt9EJzgHtp2De1EitDQkx8TOt6_WbUmBu_Y6n6LIcWJu35cEqto8LlaLBvd7Fx6PpdDw_gDp2R4doflmhUMo3Zw8gq8dju5JmvbgI04aG1xuqlCslUnwpoihX0XXo_veRrdoDDtMm482XfyM Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7c164fcbf0df4575b66149f2298496e3"}]}] Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestVolumeBootPattern-894604406 Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 187e7d6474db4b8e813ff31fcddb4034 Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 6ea9be11-5017-4959-a25b-76044d165927 could not be found. Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '6ea9be11-5017-4959-a25b-76044d165927'} Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ea9be11-5017-4959-a25b-76044d165927 could not be found. Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:33:22.871797 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:33:22.875322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ea9be11-5017-4959-a25b-76044d165927 could not be found. Oct 29 03:33:22.875322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:33:22.875322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:33:22.875322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:33:22.875322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:33:22.875322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:33:22.875322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:33:22.875322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:33:22.875322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:33:22.875322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ea9be11-5017-4959-a25b-76044d165927 could not be found. Oct 29 03:33:22.875322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:33:22.875322 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-85dcf45a-52ad-4185-a98d-e49dc102e3fd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Returning 404 to user: Instance 6ea9be11-5017-4959-a25b-76044d165927 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:33:22.875322 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-85dcf45a-52ad-4185-a98d-e49dc102e3fd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927" status: 404 len: 111 microversion: 2.1 time: 0.038737 Oct 29 03:33:22.875322 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3094/6409] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:33:22 2022] DELETE /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:33:22.894851 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bdbe3bf3-be5d-4b2f-8ebf-1c7d3e4e17d4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:22.895552 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bdbe3bf3-be5d-4b2f-8ebf-1c7d3e4e17d4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6ea9be11-5017-4959-a25b-76044d165927] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:22.903209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdbe3bf3-be5d-4b2f-8ebf-1c7d3e4e17d4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:22.903707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdbe3bf3-be5d-4b2f-8ebf-1c7d3e4e17d4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:22.904224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdbe3bf3-be5d-4b2f-8ebf-1c7d3e4e17d4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:22.905136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdbe3bf3-be5d-4b2f-8ebf-1c7d3e4e17d4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:22.905782 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdbe3bf3-be5d-4b2f-8ebf-1c7d3e4e17d4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:22.906145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdbe3bf3-be5d-4b2f-8ebf-1c7d3e4e17d4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:22.920899 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-bdbe3bf3-be5d-4b2f-8ebf-1c7d3e4e17d4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] HTTP exception thrown: Instance 6ea9be11-5017-4959-a25b-76044d165927 could not be found. Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bdbe3bf3-be5d-4b2f-8ebf-1c7d3e4e17d4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Request method failure captured: Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 HTTP/1.1 Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJ4OGFERKLIttSSPB0-5-jXA-TX6OM8jt9EJzgHtp2De1EitDQkx8TOt6_WbUmBu_Y6n6LIcWJu35cEqto8LlaLBvd7Fx6PpdDw_gDp2R4doflmhUMo3Zw8gq8dju5JmvbgI04aG1xuqlCslUnwpoihX0XXo_veRrdoDDtMm482XfyM Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7c164fcbf0df4575b66149f2298496e3"}]}] Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-TestVolumeBootPattern-894604406 Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 187e7d6474db4b8e813ff31fcddb4034 Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 6ea9be11-5017-4959-a25b-76044d165927 could not be found. Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '6ea9be11-5017-4959-a25b-76044d165927'} Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ea9be11-5017-4959-a25b-76044d165927 could not be found. Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ea9be11-5017-4959-a25b-76044d165927 could not be found. Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:33:22.922505 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:33:22.931109 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:33:22.931109 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:33:22.931109 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:33:22.931109 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:33:22.931109 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:33:22.931109 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ea9be11-5017-4959-a25b-76044d165927 could not be found. Oct 29 03:33:22.931109 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:33:22.931109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bdbe3bf3-be5d-4b2f-8ebf-1c7d3e4e17d4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Returning 404 to user: Instance 6ea9be11-5017-4959-a25b-76044d165927 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:33:22.931109 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bdbe3bf3-be5d-4b2f-8ebf-1c7d3e4e17d4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927" status: 404 len: 111 microversion: 2.1 time: 0.033468 Oct 29 03:33:22.931109 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3316/6410] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:22 2022] GET /compute/v2.1/servers/6ea9be11-5017-4959-a25b-76044d165927 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:33:23.004440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-173f1b96-ca3b-4f66-8f38-e3de46444c05 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Action: 'create', calling method: .version_select at 0x7ff052b47670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1499884373", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9aX1+2q/Hk2Tu1BYm07e2lnklrBpZ2+VmYtHVJCJyKp219Nv4LIx3420VG+GgiZi7Vp4aT/AsAi+xS84KQ9Flco8ncTPJLX2SuprkKNAbMRIiI6Qv71y16+REb3BV89g=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:33:23.022273 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-173f1b96-ca3b-4f66-8f38-e3de46444c05 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Getting quotas for project 7c164fcbf0df4575b66149f2298496e3. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:33:23.031893 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-173f1b96-ca3b-4f66-8f38-e3de46444c05 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Getting quotas for user 187e7d6474db4b8e813ff31fcddb4034 and project 7c164fcbf0df4575b66149f2298496e3. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:33:23.066822 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-173f1b96-ca3b-4f66-8f38-e3de46444c05 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.066604 Oct 29 03:33:23.067428 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3095/6411] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:33:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:33:41.720088 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7933500c-1dd0-40b3-a2cc-34c50a43cb1a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-201183651", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1499884373", "security_groups": [{"name": "tempest-secgroup-smoke-1237209821"}], "block_device_mapping_v2": [{"uuid": "e1b976c2-1eb1-4b03-b4c4-dd61f7dc7b17", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "99eca644-5d6e-42bc-9cf9-7cf1c8e093be"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:33:41.732078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:33:41.732838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:33:41.861543 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-7933500c-1dd0-40b3-a2cc-34c50a43cb1a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] validate_networks() for [('99eca644-5d6e-42bc-9cf9-7cf1c8e093be', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:33:42.259939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-7933500c-1dd0-40b3-a2cc-34c50a43cb1a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:33:42.260366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-7933500c-1dd0-40b3-a2cc-34c50a43cb1a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:33:42.260888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-7933500c-1dd0-40b3-a2cc-34c50a43cb1a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:33:42.261357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-7933500c-1dd0-40b3-a2cc-34c50a43cb1a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:33:42.261788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-7933500c-1dd0-40b3-a2cc-34c50a43cb1a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:33:42.271684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7933500c-1dd0-40b3-a2cc-34c50a43cb1a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:42.272298 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7933500c-1dd0-40b3-a2cc-34c50a43cb1a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:42.273072 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7933500c-1dd0-40b3-a2cc-34c50a43cb1a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:42.273810 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7933500c-1dd0-40b3-a2cc-34c50a43cb1a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:42.274265 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7933500c-1dd0-40b3-a2cc-34c50a43cb1a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:42.274695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7933500c-1dd0-40b3-a2cc-34c50a43cb1a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:42.293949 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-7933500c-1dd0-40b3-a2cc-34c50a43cb1a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Getting quotas for project 7c164fcbf0df4575b66149f2298496e3. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:33:42.299958 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-7933500c-1dd0-40b3-a2cc-34c50a43cb1a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Getting quotas for user 187e7d6474db4b8e813ff31fcddb4034 and project 7c164fcbf0df4575b66149f2298496e3. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:33:42.364133 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7933500c-1dd0-40b3-a2cc-34c50a43cb1a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:33:42.366314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7933500c-1dd0-40b3-a2cc-34c50a43cb1a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e1b976c2-1eb1-4b03-b4c4-dd61f7dc7b17',volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:33:42.521589 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7933500c-1dd0-40b3-a2cc-34c50a43cb1a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.805571 Oct 29 03:33:42.522911 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3317/6412] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:33:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:33:42.534009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=23 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:33:42.534484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:33:42.535301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:33:42.540759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bec20e07-5356-46fc-8b0a-cec5e7516879 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:42.541407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bec20e07-5356-46fc-8b0a-cec5e7516879 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:42.615864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bec20e07-5356-46fc-8b0a-cec5e7516879 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:42.628486 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bec20e07-5356-46fc-8b0a-cec5e7516879 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277" status: 200 len: 1094 microversion: 2.1 time: 0.097002 Oct 29 03:33:42.630042 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3096/6413] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:42 2022] GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 => generated 1094 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:43.654342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cd9111eb-403a-4d44-a8f6-de55db15b4b7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:43.655268 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cd9111eb-403a-4d44-a8f6-de55db15b4b7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:43.668098 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd9111eb-403a-4d44-a8f6-de55db15b4b7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:43.668844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd9111eb-403a-4d44-a8f6-de55db15b4b7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:43.670484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd9111eb-403a-4d44-a8f6-de55db15b4b7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:43.671800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd9111eb-403a-4d44-a8f6-de55db15b4b7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:43.672384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd9111eb-403a-4d44-a8f6-de55db15b4b7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:43.673030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd9111eb-403a-4d44-a8f6-de55db15b4b7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:43.739241 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cd9111eb-403a-4d44-a8f6-de55db15b4b7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:43.748101 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cd9111eb-403a-4d44-a8f6-de55db15b4b7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277" status: 200 len: 1192 microversion: 2.1 time: 0.099899 Oct 29 03:33:43.749205 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3318/6414] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:43 2022] GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 => generated 1192 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:44.778207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-16d8cf3b-eb91-4b64-994f-0babf98824b5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:44.778772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-16d8cf3b-eb91-4b64-994f-0babf98824b5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:44.800769 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-16d8cf3b-eb91-4b64-994f-0babf98824b5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:44.801703 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-16d8cf3b-eb91-4b64-994f-0babf98824b5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:44.802590 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-16d8cf3b-eb91-4b64-994f-0babf98824b5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:44.803559 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-16d8cf3b-eb91-4b64-994f-0babf98824b5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:44.804279 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-16d8cf3b-eb91-4b64-994f-0babf98824b5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:44.805390 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-16d8cf3b-eb91-4b64-994f-0babf98824b5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:45.162010 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-16d8cf3b-eb91-4b64-994f-0babf98824b5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:45.189004 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-16d8cf3b-eb91-4b64-994f-0babf98824b5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277" status: 200 len: 1278 microversion: 2.1 time: 0.413456 Oct 29 03:33:45.190083 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3097/6415] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:44 2022] GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 => generated 1278 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:45.661184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-6aac6041-0d1b-4282-a20c-38a335a0ba80 req-5552fa84-51bf-486a-8987-dad4b7c2830e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a658824-4f09-4798-9159-20c340564277", "tag": "95a1ceb5-7743-4726-9410-a3b757744cc8"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:33:45.674240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-6aac6041-0d1b-4282-a20c-38a335a0ba80 req-5552fa84-51bf-486a-8987-dad4b7c2830e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:45.675009 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-6aac6041-0d1b-4282-a20c-38a335a0ba80 req-5552fa84-51bf-486a-8987-dad4b7c2830e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:45.675629 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-6aac6041-0d1b-4282-a20c-38a335a0ba80 req-5552fa84-51bf-486a-8987-dad4b7c2830e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:45.692410 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-6aac6041-0d1b-4282-a20c-38a335a0ba80 req-5552fa84-51bf-486a-8987-dad4b7c2830e service nova] Creating event network-changed:95a1ceb5-7743-4726-9410-a3b757744cc8 for instance 6a658824-4f09-4798-9159-20c340564277 on n-h2-862967-2 Oct 29 03:33:45.698139 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-6aac6041-0d1b-4282-a20c-38a335a0ba80 req-5552fa84-51bf-486a-8987-dad4b7c2830e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180178 Oct 29 03:33:45.699562 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3319/6416] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:33:46.217438 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-81a3f035-9b33-4e88-aef2-e9cd8ee1d8ac tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:46.218805 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-81a3f035-9b33-4e88-aef2-e9cd8ee1d8ac tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:46.226822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-81a3f035-9b33-4e88-aef2-e9cd8ee1d8ac tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:46.227677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-81a3f035-9b33-4e88-aef2-e9cd8ee1d8ac tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:46.228360 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-81a3f035-9b33-4e88-aef2-e9cd8ee1d8ac tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:46.229339 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-81a3f035-9b33-4e88-aef2-e9cd8ee1d8ac tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:46.230056 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-81a3f035-9b33-4e88-aef2-e9cd8ee1d8ac tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:46.230717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-81a3f035-9b33-4e88-aef2-e9cd8ee1d8ac tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:46.485986 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-81a3f035-9b33-4e88-aef2-e9cd8ee1d8ac tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:46.500489 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-81a3f035-9b33-4e88-aef2-e9cd8ee1d8ac tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277" status: 200 len: 1278 microversion: 2.1 time: 0.286474 Oct 29 03:33:46.509473 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3098/6417] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:46 2022] GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 => generated 1278 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:47.527718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9fa7114e-dd59-47de-a296-76b0ce03b29c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:47.528418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9fa7114e-dd59-47de-a296-76b0ce03b29c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:47.536373 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fa7114e-dd59-47de-a296-76b0ce03b29c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:47.536936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fa7114e-dd59-47de-a296-76b0ce03b29c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:47.537381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fa7114e-dd59-47de-a296-76b0ce03b29c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:47.538095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fa7114e-dd59-47de-a296-76b0ce03b29c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:47.538552 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fa7114e-dd59-47de-a296-76b0ce03b29c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:47.538978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fa7114e-dd59-47de-a296-76b0ce03b29c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:47.695075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9fa7114e-dd59-47de-a296-76b0ce03b29c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:47.703453 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9fa7114e-dd59-47de-a296-76b0ce03b29c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277" status: 200 len: 1278 microversion: 2.1 time: 0.180463 Oct 29 03:33:47.716746 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3320/6418] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:47 2022] GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 => generated 1278 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:48.727012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ee2e4a87-8cd8-4492-8eb8-3687dcc5c351 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:48.727783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ee2e4a87-8cd8-4492-8eb8-3687dcc5c351 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:48.736318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee2e4a87-8cd8-4492-8eb8-3687dcc5c351 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:48.736853 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee2e4a87-8cd8-4492-8eb8-3687dcc5c351 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:48.737327 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee2e4a87-8cd8-4492-8eb8-3687dcc5c351 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:48.738056 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee2e4a87-8cd8-4492-8eb8-3687dcc5c351 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:48.738518 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee2e4a87-8cd8-4492-8eb8-3687dcc5c351 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:48.738965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ee2e4a87-8cd8-4492-8eb8-3687dcc5c351 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:48.904833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ee2e4a87-8cd8-4492-8eb8-3687dcc5c351 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:48.913901 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ee2e4a87-8cd8-4492-8eb8-3687dcc5c351 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277" status: 200 len: 1278 microversion: 2.1 time: 0.190805 Oct 29 03:33:48.914500 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3099/6419] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:48 2022] GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 => generated 1278 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:49.937866 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2930f198-9165-4c80-864a-32595829f97e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:49.939407 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2930f198-9165-4c80-864a-32595829f97e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:49.947255 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2930f198-9165-4c80-864a-32595829f97e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:49.948400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2930f198-9165-4c80-864a-32595829f97e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:49.949243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2930f198-9165-4c80-864a-32595829f97e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:49.950236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2930f198-9165-4c80-864a-32595829f97e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:49.951339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2930f198-9165-4c80-864a-32595829f97e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:49.956722 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2930f198-9165-4c80-864a-32595829f97e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:50.103954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2930f198-9165-4c80-864a-32595829f97e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:50.112318 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2930f198-9165-4c80-864a-32595829f97e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277" status: 200 len: 1266 microversion: 2.1 time: 0.179275 Oct 29 03:33:50.113029 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3321/6420] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:49 2022] GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:51.136858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fb483d35-6455-426d-8c1d-5a65467e34f6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:51.137704 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fb483d35-6455-426d-8c1d-5a65467e34f6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:51.145589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb483d35-6455-426d-8c1d-5a65467e34f6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:51.146101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb483d35-6455-426d-8c1d-5a65467e34f6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:51.146543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb483d35-6455-426d-8c1d-5a65467e34f6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:51.147261 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb483d35-6455-426d-8c1d-5a65467e34f6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:51.147879 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb483d35-6455-426d-8c1d-5a65467e34f6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:51.148330 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fb483d35-6455-426d-8c1d-5a65467e34f6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:51.287249 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fb483d35-6455-426d-8c1d-5a65467e34f6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:51.296329 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fb483d35-6455-426d-8c1d-5a65467e34f6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277" status: 200 len: 1266 microversion: 2.1 time: 0.163846 Oct 29 03:33:51.296970 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3100/6421] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:51 2022] GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:52.325503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6f87cdbe-1865-4278-a074-3a5f4c2eede8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:52.326655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6f87cdbe-1865-4278-a074-3a5f4c2eede8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:52.331652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:33:52.332845 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:33:52.343798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f87cdbe-1865-4278-a074-3a5f4c2eede8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:52.344967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f87cdbe-1865-4278-a074-3a5f4c2eede8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:52.345322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f87cdbe-1865-4278-a074-3a5f4c2eede8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:52.346380 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f87cdbe-1865-4278-a074-3a5f4c2eede8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:52.347120 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f87cdbe-1865-4278-a074-3a5f4c2eede8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:52.347828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f87cdbe-1865-4278-a074-3a5f4c2eede8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:52.514690 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6f87cdbe-1865-4278-a074-3a5f4c2eede8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:52.524630 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6f87cdbe-1865-4278-a074-3a5f4c2eede8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277" status: 200 len: 1266 microversion: 2.1 time: 0.207761 Oct 29 03:33:52.525331 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3322/6422] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:52 2022] GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:53.548387 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-eca1ac03-80e7-4f5f-a680-47950dfdb497 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:53.549063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-eca1ac03-80e7-4f5f-a680-47950dfdb497 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:53.551803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:33:53.557580 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eca1ac03-80e7-4f5f-a680-47950dfdb497 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:53.558077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eca1ac03-80e7-4f5f-a680-47950dfdb497 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:53.558524 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eca1ac03-80e7-4f5f-a680-47950dfdb497 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:53.559252 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eca1ac03-80e7-4f5f-a680-47950dfdb497 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:53.559825 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eca1ac03-80e7-4f5f-a680-47950dfdb497 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:53.560265 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eca1ac03-80e7-4f5f-a680-47950dfdb497 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:53.716325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-eca1ac03-80e7-4f5f-a680-47950dfdb497 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:53.724154 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-eca1ac03-80e7-4f5f-a680-47950dfdb497 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277" status: 200 len: 1266 microversion: 2.1 time: 0.179817 Oct 29 03:33:53.724771 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3101/6423] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:53 2022] GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:54.748882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dbd194a6-4010-47b9-9f66-40f57ce69e43 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:54.749490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dbd194a6-4010-47b9-9f66-40f57ce69e43 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:54.757687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dbd194a6-4010-47b9-9f66-40f57ce69e43 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:54.758183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dbd194a6-4010-47b9-9f66-40f57ce69e43 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:54.758623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dbd194a6-4010-47b9-9f66-40f57ce69e43 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:54.759341 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dbd194a6-4010-47b9-9f66-40f57ce69e43 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:54.759798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dbd194a6-4010-47b9-9f66-40f57ce69e43 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:54.760224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dbd194a6-4010-47b9-9f66-40f57ce69e43 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:54.906959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dbd194a6-4010-47b9-9f66-40f57ce69e43 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:54.916257 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dbd194a6-4010-47b9-9f66-40f57ce69e43 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277" status: 200 len: 1266 microversion: 2.1 time: 0.172364 Oct 29 03:33:54.917029 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3323/6424] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:54 2022] GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:55.946391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7c69ca6d-f576-4bdd-b19d-85973ed115b4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:55.947110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7c69ca6d-f576-4bdd-b19d-85973ed115b4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:55.954854 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c69ca6d-f576-4bdd-b19d-85973ed115b4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:55.955406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c69ca6d-f576-4bdd-b19d-85973ed115b4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:55.955921 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c69ca6d-f576-4bdd-b19d-85973ed115b4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:55.956898 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c69ca6d-f576-4bdd-b19d-85973ed115b4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:55.957435 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c69ca6d-f576-4bdd-b19d-85973ed115b4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:55.957942 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c69ca6d-f576-4bdd-b19d-85973ed115b4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:56.106286 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7c69ca6d-f576-4bdd-b19d-85973ed115b4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:56.131520 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7c69ca6d-f576-4bdd-b19d-85973ed115b4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277" status: 200 len: 1266 microversion: 2.1 time: 0.190511 Oct 29 03:33:56.146563 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3102/6425] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:55 2022] GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:57.155082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4cc626ff-0dc2-49de-b986-60c462cae002 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:57.155942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4cc626ff-0dc2-49de-b986-60c462cae002 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:57.166809 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4cc626ff-0dc2-49de-b986-60c462cae002 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:57.167158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4cc626ff-0dc2-49de-b986-60c462cae002 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:57.167593 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4cc626ff-0dc2-49de-b986-60c462cae002 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:57.170221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4cc626ff-0dc2-49de-b986-60c462cae002 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:57.170221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4cc626ff-0dc2-49de-b986-60c462cae002 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:57.170221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4cc626ff-0dc2-49de-b986-60c462cae002 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:57.309085 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4cc626ff-0dc2-49de-b986-60c462cae002 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:57.317089 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4cc626ff-0dc2-49de-b986-60c462cae002 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277" status: 200 len: 1266 microversion: 2.1 time: 0.166500 Oct 29 03:33:57.317672 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3324/6426] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:57 2022] GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:58.339434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a39c3697-c74e-4289-97e3-76174ffdba47 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:58.340131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a39c3697-c74e-4289-97e3-76174ffdba47 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:58.342576 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:33:58.342576 n-d-862967-2 devstack@n-api.service[127125]: Sat Oct 29 03:33:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 (ip 10.222.0.46) !!! Oct 29 03:33:58.351144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a39c3697-c74e-4289-97e3-76174ffdba47 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:58.351650 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a39c3697-c74e-4289-97e3-76174ffdba47 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:58.352101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a39c3697-c74e-4289-97e3-76174ffdba47 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:58.352881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a39c3697-c74e-4289-97e3-76174ffdba47 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:58.353349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a39c3697-c74e-4289-97e3-76174ffdba47 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:58.353784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a39c3697-c74e-4289-97e3-76174ffdba47 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:58.507695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a39c3697-c74e-4289-97e3-76174ffdba47 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:58.515877 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a39c3697-c74e-4289-97e3-76174ffdba47 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277" status: 200 len: 1266 microversion: 2.1 time: 0.180358 Oct 29 03:33:58.521375 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3103/6427] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:58 2022] GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:33:59.538992 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-358e4821-48bf-41ff-a969-24fdc1fa3687 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:33:59.539788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-358e4821-48bf-41ff-a969-24fdc1fa3687 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:33:59.547965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-358e4821-48bf-41ff-a969-24fdc1fa3687 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:59.548454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-358e4821-48bf-41ff-a969-24fdc1fa3687 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:59.548927 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-358e4821-48bf-41ff-a969-24fdc1fa3687 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:59.549629 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-358e4821-48bf-41ff-a969-24fdc1fa3687 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:33:59.550077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-358e4821-48bf-41ff-a969-24fdc1fa3687 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:33:59.550509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-358e4821-48bf-41ff-a969-24fdc1fa3687 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:33:59.687193 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-358e4821-48bf-41ff-a969-24fdc1fa3687 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:33:59.695415 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-358e4821-48bf-41ff-a969-24fdc1fa3687 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277" status: 200 len: 1266 microversion: 2.1 time: 0.160516 Oct 29 03:33:59.696008 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3325/6428] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:33:59 2022] GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:00.258459 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-ee5938d4-f6eb-4a47-b527-b0217b545504 req-54dfd2bc-00e6-401f-9e3a-8810603d5101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a658824-4f09-4798-9159-20c340564277", "name": "network-vif-plugged", "status": "completed", "tag": "95a1ceb5-7743-4726-9410-a3b757744cc8"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:34:00.274091 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ee5938d4-f6eb-4a47-b527-b0217b545504 req-54dfd2bc-00e6-401f-9e3a-8810603d5101 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:00.274585 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ee5938d4-f6eb-4a47-b527-b0217b545504 req-54dfd2bc-00e6-401f-9e3a-8810603d5101 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:00.275196 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ee5938d4-f6eb-4a47-b527-b0217b545504 req-54dfd2bc-00e6-401f-9e3a-8810603d5101 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:00.287433 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-ee5938d4-f6eb-4a47-b527-b0217b545504 req-54dfd2bc-00e6-401f-9e3a-8810603d5101 service nova] Creating event network-vif-plugged:95a1ceb5-7743-4726-9410-a3b757744cc8 for instance 6a658824-4f09-4798-9159-20c340564277 on n-h2-862967-2 Oct 29 03:34:00.293311 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-ee5938d4-f6eb-4a47-b527-b0217b545504 req-54dfd2bc-00e6-401f-9e3a-8810603d5101 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039285 Oct 29 03:34:00.293923 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3104/6429] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:34:00.719096 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-53a8746f-165a-4e3f-abb9-32318fa065e0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:00.719758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-53a8746f-165a-4e3f-abb9-32318fa065e0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:00.726841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-53a8746f-165a-4e3f-abb9-32318fa065e0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:00.727325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-53a8746f-165a-4e3f-abb9-32318fa065e0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:00.727756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-53a8746f-165a-4e3f-abb9-32318fa065e0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:00.728445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-53a8746f-165a-4e3f-abb9-32318fa065e0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:00.728926 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-53a8746f-165a-4e3f-abb9-32318fa065e0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:00.729345 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-53a8746f-165a-4e3f-abb9-32318fa065e0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:00.865304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-53a8746f-165a-4e3f-abb9-32318fa065e0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:00.873737 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-53a8746f-165a-4e3f-abb9-32318fa065e0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277" status: 200 len: 1266 microversion: 2.1 time: 0.158794 Oct 29 03:34:00.874287 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3326/6430] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:00 2022] GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:01.898613 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-48b94e28-11a7-40a2-a53a-2b33c8d2540e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:01.899517 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-48b94e28-11a7-40a2-a53a-2b33c8d2540e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:01.907614 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48b94e28-11a7-40a2-a53a-2b33c8d2540e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:01.908195 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48b94e28-11a7-40a2-a53a-2b33c8d2540e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:01.908676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48b94e28-11a7-40a2-a53a-2b33c8d2540e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:01.909396 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48b94e28-11a7-40a2-a53a-2b33c8d2540e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:01.909881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48b94e28-11a7-40a2-a53a-2b33c8d2540e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:01.910311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48b94e28-11a7-40a2-a53a-2b33c8d2540e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:02.045182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-48b94e28-11a7-40a2-a53a-2b33c8d2540e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:02.058654 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-48b94e28-11a7-40a2-a53a-2b33c8d2540e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277" status: 200 len: 1453 microversion: 2.1 time: 0.165606 Oct 29 03:34:02.059255 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3105/6431] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:01 2022] GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:02.080516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-14cf7e6a-a752-42f1-9893-e338351d90d2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:34:02.081141 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-14cf7e6a-a752-42f1-9893-e338351d90d2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:34:02.088832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14cf7e6a-a752-42f1-9893-e338351d90d2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:02.089521 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14cf7e6a-a752-42f1-9893-e338351d90d2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:02.090062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14cf7e6a-a752-42f1-9893-e338351d90d2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:02.090851 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14cf7e6a-a752-42f1-9893-e338351d90d2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:02.091316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14cf7e6a-a752-42f1-9893-e338351d90d2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:02.091747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14cf7e6a-a752-42f1-9893-e338351d90d2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:02.228758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-14cf7e6a-a752-42f1-9893-e338351d90d2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:34:02.237648 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-14cf7e6a-a752-42f1-9893-e338351d90d2 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277" status: 200 len: 1453 microversion: 2.1 time: 0.160777 Oct 29 03:34:02.238278 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3327/6432] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:34:02 2022] GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:34:04.298596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-d3829ecf-1128-4dcd-8ffc-918745cdee0c req-ecf0d855-b963-4b9a-9bfb-1df2d66a8066 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a658824-4f09-4798-9159-20c340564277", "tag": "95a1ceb5-7743-4726-9410-a3b757744cc8"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:34:04.310856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d3829ecf-1128-4dcd-8ffc-918745cdee0c req-ecf0d855-b963-4b9a-9bfb-1df2d66a8066 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:34:04.311371 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d3829ecf-1128-4dcd-8ffc-918745cdee0c req-ecf0d855-b963-4b9a-9bfb-1df2d66a8066 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:34:04.311804 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d3829ecf-1128-4dcd-8ffc-918745cdee0c req-ecf0d855-b963-4b9a-9bfb-1df2d66a8066 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:34:04.324360 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-d3829ecf-1128-4dcd-8ffc-918745cdee0c req-ecf0d855-b963-4b9a-9bfb-1df2d66a8066 service nova] Creating event network-changed:95a1ceb5-7743-4726-9410-a3b757744cc8 for instance 6a658824-4f09-4798-9159-20c340564277 on n-h2-862967-2 Oct 29 03:34:04.329693 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-d3829ecf-1128-4dcd-8ffc-918745cdee0c req-ecf0d855-b963-4b9a-9bfb-1df2d66a8066 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034954 Oct 29 03:34:04.330350 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3106/6433] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:36:00.633070 n-d-862967-2 devstack@n-api.service[127124]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2206413f-602f-4f31-86b1-4a062554af7b] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 03:36:00.634155 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:00.634930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=58 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:00.636503 n-d-862967-2 devstack@n-api.service[127124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 29 03:36:00.637435 n-d-862967-2 devstack@n-api.service[127124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:36:00.637435 n-d-862967-2 devstack@n-api.service[127124]: Sat Oct 29 03:36:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 (ip 10.222.0.46) !!! Oct 29 03:36:00.869697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-86849035-7d75-43b7-8798-d735b8267c7e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:00.870270 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-86849035-7d75-43b7-8798-d735b8267c7e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:00.877109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86849035-7d75-43b7-8798-d735b8267c7e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:00.877608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86849035-7d75-43b7-8798-d735b8267c7e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:00.878042 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86849035-7d75-43b7-8798-d735b8267c7e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:00.878750 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86849035-7d75-43b7-8798-d735b8267c7e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:00.879191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86849035-7d75-43b7-8798-d735b8267c7e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:00.879618 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86849035-7d75-43b7-8798-d735b8267c7e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:00.911188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-86849035-7d75-43b7-8798-d735b8267c7e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:36:01.001536 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-86849035-7d75-43b7-8798-d735b8267c7e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277" status: 204 len: 0 microversion: 2.1 time: 0.370024 Oct 29 03:36:01.003339 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3328/6434] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:36:00 2022] DELETE /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:36:01.011162 n-d-862967-2 devstack@n-api.service[127125]: ERROR oslo.messaging._drivers.impl_rabbit [-] [db70aafa-b304-4ac0-be4f-1798e9789b82] AMQP server on 10.222.0.46:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 29 03:36:01.012795 n-d-862967-2 devstack@n-api.service[127125]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7606be4b-8fa9-49e5-a603-02528cbf3013] AMQP server on 10.222.0.46:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 29 03:36:01.013516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=24 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:01.014646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=52 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:01.015804 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:36:01.016226 n-d-862967-2 devstack@n-api.service[127125]: Sat Oct 29 03:36:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 (ip 10.222.0.46) !!! Oct 29 03:36:01.025515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7f5f2c74-d15a-401f-ab82-cd9ce922fcc5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:01.026499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7f5f2c74-d15a-401f-ab82-cd9ce922fcc5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:01.036093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f5f2c74-d15a-401f-ab82-cd9ce922fcc5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:01.036752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f5f2c74-d15a-401f-ab82-cd9ce922fcc5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:01.037305 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f5f2c74-d15a-401f-ab82-cd9ce922fcc5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:01.038105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f5f2c74-d15a-401f-ab82-cd9ce922fcc5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:01.038647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f5f2c74-d15a-401f-ab82-cd9ce922fcc5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:01.039196 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f5f2c74-d15a-401f-ab82-cd9ce922fcc5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:01.320356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7f5f2c74-d15a-401f-ab82-cd9ce922fcc5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:01.330376 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7f5f2c74-d15a-401f-ab82-cd9ce922fcc5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277" status: 200 len: 1578 microversion: 2.1 time: 0.322188 Oct 29 03:36:01.330795 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3107/6435] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:01 2022] GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 => generated 1578 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:02.354121 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-573b589b-e1f1-45c9-a1f8-327cb2ddee80 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:02.354826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-573b589b-e1f1-45c9-a1f8-327cb2ddee80 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:02.363695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-573b589b-e1f1-45c9-a1f8-327cb2ddee80 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:02.364440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-573b589b-e1f1-45c9-a1f8-327cb2ddee80 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:02.365063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-573b589b-e1f1-45c9-a1f8-327cb2ddee80 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:02.365949 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-573b589b-e1f1-45c9-a1f8-327cb2ddee80 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:02.366573 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-573b589b-e1f1-45c9-a1f8-327cb2ddee80 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:02.367174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-573b589b-e1f1-45c9-a1f8-327cb2ddee80 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:02.386125 n-d-862967-2 devstack@n-api.service[127124]: INFO oslo.messaging._drivers.impl_rabbit [-] [2206413f-602f-4f31-86b1-4a062554af7b] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 36004. Oct 29 03:36:02.650418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-573b589b-e1f1-45c9-a1f8-327cb2ddee80 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:02.658879 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-573b589b-e1f1-45c9-a1f8-327cb2ddee80 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277" status: 200 len: 1578 microversion: 2.1 time: 0.308864 Oct 29 03:36:02.669247 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3329/6436] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:02 2022] GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 => generated 1578 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:36:03.682548 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e824ab1a-db30-432b-ae79-0a8eec8a520f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:03.683537 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e824ab1a-db30-432b-ae79-0a8eec8a520f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:03.706344 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] [7606be4b-8fa9-49e5-a603-02528cbf3013] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 36028. Oct 29 03:36:03.708943 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e824ab1a-db30-432b-ae79-0a8eec8a520f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:03.709677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e824ab1a-db30-432b-ae79-0a8eec8a520f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:03.710343 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e824ab1a-db30-432b-ae79-0a8eec8a520f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:03.711545 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e824ab1a-db30-432b-ae79-0a8eec8a520f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:03.712209 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e824ab1a-db30-432b-ae79-0a8eec8a520f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:03.712883 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e824ab1a-db30-432b-ae79-0a8eec8a520f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:03.718273 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] [db70aafa-b304-4ac0-be4f-1798e9789b82] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 36026. Oct 29 03:36:03.772221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-cbdffceb-24cd-4966-8a7d-65f83c8f521b req-aea68991-ec4c-4553-a58a-1285d88ee1d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a658824-4f09-4798-9159-20c340564277", "name": "network-vif-deleted", "tag": "95a1ceb5-7743-4726-9410-a3b757744cc8"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:36:03.802053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-cbdffceb-24cd-4966-8a7d-65f83c8f521b req-aea68991-ec4c-4553-a58a-1285d88ee1d5 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:03.811998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-cbdffceb-24cd-4966-8a7d-65f83c8f521b req-aea68991-ec4c-4553-a58a-1285d88ee1d5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:03.812569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-cbdffceb-24cd-4966-8a7d-65f83c8f521b req-aea68991-ec4c-4553-a58a-1285d88ee1d5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:03.817761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e824ab1a-db30-432b-ae79-0a8eec8a520f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:03.830659 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e824ab1a-db30-432b-ae79-0a8eec8a520f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277" status: 200 len: 1510 microversion: 2.1 time: 0.152042 Oct 29 03:36:03.838141 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-cbdffceb-24cd-4966-8a7d-65f83c8f521b req-aea68991-ec4c-4553-a58a-1285d88ee1d5 service nova] Creating event network-vif-deleted:95a1ceb5-7743-4726-9410-a3b757744cc8 for instance 6a658824-4f09-4798-9159-20c340564277 on n-h2-862967-2 Oct 29 03:36:03.843888 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-cbdffceb-24cd-4966-8a7d-65f83c8f521b req-aea68991-ec4c-4553-a58a-1285d88ee1d5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079037 Oct 29 03:36:03.845198 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3330/6437] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:36:03.847576 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3108/6438] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:03 2022] GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:04.857740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4c79f06f-17e7-418a-add3-f7e6ab1fb284 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:04.858469 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4c79f06f-17e7-418a-add3-f7e6ab1fb284 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:04.872235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c79f06f-17e7-418a-add3-f7e6ab1fb284 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:04.872954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c79f06f-17e7-418a-add3-f7e6ab1fb284 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:04.873402 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c79f06f-17e7-418a-add3-f7e6ab1fb284 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:04.874120 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c79f06f-17e7-418a-add3-f7e6ab1fb284 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:04.874575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c79f06f-17e7-418a-add3-f7e6ab1fb284 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:04.875003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4c79f06f-17e7-418a-add3-f7e6ab1fb284 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:05.001260 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4c79f06f-17e7-418a-add3-f7e6ab1fb284 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:05.014155 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4c79f06f-17e7-418a-add3-f7e6ab1fb284 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277" status: 200 len: 1225 microversion: 2.1 time: 0.162247 Oct 29 03:36:05.016012 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3331/6439] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:04 2022] GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 => generated 1225 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:06.038923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f9f3d93e-7b13-41b1-a8ee-43e0bb41ebc6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:06.040217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f9f3d93e-7b13-41b1-a8ee-43e0bb41ebc6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:06.047954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9f3d93e-7b13-41b1-a8ee-43e0bb41ebc6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:06.048424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9f3d93e-7b13-41b1-a8ee-43e0bb41ebc6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:06.049099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9f3d93e-7b13-41b1-a8ee-43e0bb41ebc6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:06.050012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9f3d93e-7b13-41b1-a8ee-43e0bb41ebc6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:06.050448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9f3d93e-7b13-41b1-a8ee-43e0bb41ebc6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:06.051076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9f3d93e-7b13-41b1-a8ee-43e0bb41ebc6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:06.123171 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f9f3d93e-7b13-41b1-a8ee-43e0bb41ebc6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:06.133588 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f9f3d93e-7b13-41b1-a8ee-43e0bb41ebc6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277" status: 200 len: 1225 microversion: 2.1 time: 0.097676 Oct 29 03:36:06.134469 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3109/6440] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:06 2022] GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:07.162256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eb8e8d3b-8492-4f5d-a779-e12c4ccaae1f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:07.162872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-eb8e8d3b-8492-4f5d-a779-e12c4ccaae1f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:07.173341 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb8e8d3b-8492-4f5d-a779-e12c4ccaae1f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:07.173940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb8e8d3b-8492-4f5d-a779-e12c4ccaae1f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:07.174431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb8e8d3b-8492-4f5d-a779-e12c4ccaae1f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:07.175359 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb8e8d3b-8492-4f5d-a779-e12c4ccaae1f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:07.175958 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb8e8d3b-8492-4f5d-a779-e12c4ccaae1f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:07.176779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eb8e8d3b-8492-4f5d-a779-e12c4ccaae1f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:07.241063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-eb8e8d3b-8492-4f5d-a779-e12c4ccaae1f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:07.249333 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eb8e8d3b-8492-4f5d-a779-e12c4ccaae1f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277" status: 200 len: 1225 microversion: 2.1 time: 0.091977 Oct 29 03:36:07.249917 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3332/6441] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:07 2022] GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:08.271310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-52c46422-87ae-4465-a9e3-9ba7d5cc24cf tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:08.272688 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-52c46422-87ae-4465-a9e3-9ba7d5cc24cf tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:08.279253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52c46422-87ae-4465-a9e3-9ba7d5cc24cf tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:08.279834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52c46422-87ae-4465-a9e3-9ba7d5cc24cf tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:08.280332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52c46422-87ae-4465-a9e3-9ba7d5cc24cf tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:08.281177 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52c46422-87ae-4465-a9e3-9ba7d5cc24cf tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:08.281676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52c46422-87ae-4465-a9e3-9ba7d5cc24cf tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:08.282177 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-52c46422-87ae-4465-a9e3-9ba7d5cc24cf tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:08.367130 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-52c46422-87ae-4465-a9e3-9ba7d5cc24cf tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:08.375570 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-52c46422-87ae-4465-a9e3-9ba7d5cc24cf tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277" status: 200 len: 1225 microversion: 2.1 time: 0.108127 Oct 29 03:36:08.376171 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3110/6442] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:08 2022] GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:09.399022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b6ceaa93-8c88-4ef0-9841-1db13da56e7c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:09.399650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b6ceaa93-8c88-4ef0-9841-1db13da56e7c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:09.407092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b6ceaa93-8c88-4ef0-9841-1db13da56e7c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:09.407585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b6ceaa93-8c88-4ef0-9841-1db13da56e7c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:09.408024 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b6ceaa93-8c88-4ef0-9841-1db13da56e7c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:09.408768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b6ceaa93-8c88-4ef0-9841-1db13da56e7c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:09.409225 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b6ceaa93-8c88-4ef0-9841-1db13da56e7c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:09.409654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b6ceaa93-8c88-4ef0-9841-1db13da56e7c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:09.423566 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-b6ceaa93-8c88-4ef0-9841-1db13da56e7c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] HTTP exception thrown: Instance 6a658824-4f09-4798-9159-20c340564277 could not be found. Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b6ceaa93-8c88-4ef0-9841-1db13da56e7c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Request method failure captured: Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 HTTP/1.1 Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJ4OGFERKLIttSSPB0-5-jXA-TX6OM8jt9EJzgHtp2De1EitDQkx8TOt6_WbUmBu_Y6n6LIcWJu35cEqto8LlaLBvd7Fx6PpdDw_gDp2R4doflmhUMo3Zw8gq8dju5JmvbgI04aG1xuqlCslUnwpoihX0XXo_veRrdoDDtMm482XfyM Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7c164fcbf0df4575b66149f2298496e3"}]}] Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-TestVolumeBootPattern-894604406 Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 187e7d6474db4b8e813ff31fcddb4034 Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 6a658824-4f09-4798-9159-20c340564277 could not be found. Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '6a658824-4f09-4798-9159-20c340564277'} Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a658824-4f09-4798-9159-20c340564277 could not be found. Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a658824-4f09-4798-9159-20c340564277 could not be found. Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:36:09.425309 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:36:09.428885 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:36:09.428885 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:36:09.428885 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:36:09.428885 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:36:09.428885 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:36:09.428885 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a658824-4f09-4798-9159-20c340564277 could not be found. Oct 29 03:36:09.428885 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:36:09.428885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b6ceaa93-8c88-4ef0-9841-1db13da56e7c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Returning 404 to user: Instance 6a658824-4f09-4798-9159-20c340564277 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:36:09.428885 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b6ceaa93-8c88-4ef0-9841-1db13da56e7c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277" status: 404 len: 111 microversion: 2.1 time: 0.031880 Oct 29 03:36:09.428885 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3333/6443] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:09 2022] GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:36:09.532818 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-069b7280-14f3-4d66-b851-ca2a1058996a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-105307778", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1499884373", "security_groups": [{"name": "tempest-secgroup-smoke-1237209821"}], "block_device_mapping_v2": [{"uuid": "e1b976c2-1eb1-4b03-b4c4-dd61f7dc7b17", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "99eca644-5d6e-42bc-9cf9-7cf1c8e093be"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:36:09.657887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-069b7280-14f3-4d66-b851-ca2a1058996a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] validate_networks() for [('99eca644-5d6e-42bc-9cf9-7cf1c8e093be', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:36:10.153143 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-069b7280-14f3-4d66-b851-ca2a1058996a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:36:10.153665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-069b7280-14f3-4d66-b851-ca2a1058996a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:36:10.154212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-069b7280-14f3-4d66-b851-ca2a1058996a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:36:10.154714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-069b7280-14f3-4d66-b851-ca2a1058996a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:36:10.155206 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-069b7280-14f3-4d66-b851-ca2a1058996a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:36:10.164405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-069b7280-14f3-4d66-b851-ca2a1058996a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:10.165010 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-069b7280-14f3-4d66-b851-ca2a1058996a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:10.165460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-069b7280-14f3-4d66-b851-ca2a1058996a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:10.166188 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-069b7280-14f3-4d66-b851-ca2a1058996a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:10.166653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-069b7280-14f3-4d66-b851-ca2a1058996a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:10.167084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-069b7280-14f3-4d66-b851-ca2a1058996a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:10.184374 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-069b7280-14f3-4d66-b851-ca2a1058996a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Getting quotas for project 7c164fcbf0df4575b66149f2298496e3. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:36:10.189761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-069b7280-14f3-4d66-b851-ca2a1058996a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Getting quotas for user 187e7d6474db4b8e813ff31fcddb4034 and project 7c164fcbf0df4575b66149f2298496e3. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:36:10.250238 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-069b7280-14f3-4d66-b851-ca2a1058996a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:36:10.252760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-069b7280-14f3-4d66-b851-ca2a1058996a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6145fb3f-ced5-4bdd-a889-c4eabea5d975] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e1b976c2-1eb1-4b03-b4c4-dd61f7dc7b17',volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:36:10.394051 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-069b7280-14f3-4d66-b851-ca2a1058996a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.865133 Oct 29 03:36:10.404621 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3111/6444] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:36:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:36:10.406956 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d6e6594a-9bd6-48cf-bd63-d57dbd35c04d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:10.407676 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d6e6594a-9bd6-48cf-bd63-d57dbd35c04d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6145fb3f-ced5-4bdd-a889-c4eabea5d975] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:10.486101 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d6e6594a-9bd6-48cf-bd63-d57dbd35c04d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:10.525139 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d6e6594a-9bd6-48cf-bd63-d57dbd35c04d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975" status: 200 len: 1094 microversion: 2.1 time: 0.122000 Oct 29 03:36:10.534970 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3334/6445] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:10 2022] GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975 => generated 1094 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:11.558578 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-df2be9b2-8ae7-4b11-b939-b9d1c9fbb4c1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:11.559414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-df2be9b2-8ae7-4b11-b939-b9d1c9fbb4c1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6145fb3f-ced5-4bdd-a889-c4eabea5d975] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:11.566287 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df2be9b2-8ae7-4b11-b939-b9d1c9fbb4c1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:11.566807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df2be9b2-8ae7-4b11-b939-b9d1c9fbb4c1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:11.567241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df2be9b2-8ae7-4b11-b939-b9d1c9fbb4c1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:11.567961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df2be9b2-8ae7-4b11-b939-b9d1c9fbb4c1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:11.568428 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df2be9b2-8ae7-4b11-b939-b9d1c9fbb4c1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:11.568926 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df2be9b2-8ae7-4b11-b939-b9d1c9fbb4c1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:11.639064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-df2be9b2-8ae7-4b11-b939-b9d1c9fbb4c1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:11.647284 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-df2be9b2-8ae7-4b11-b939-b9d1c9fbb4c1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975" status: 200 len: 1192 microversion: 2.1 time: 0.093731 Oct 29 03:36:11.647855 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3112/6446] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:11 2022] GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975 => generated 1192 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:12.674390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e44d7c64-1053-4eed-a1ea-1ed03cff2eaa tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:12.676040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e44d7c64-1053-4eed-a1ea-1ed03cff2eaa tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6145fb3f-ced5-4bdd-a889-c4eabea5d975] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:12.699415 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e44d7c64-1053-4eed-a1ea-1ed03cff2eaa tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:12.701011 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e44d7c64-1053-4eed-a1ea-1ed03cff2eaa tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:12.707391 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e44d7c64-1053-4eed-a1ea-1ed03cff2eaa tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:12.710550 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e44d7c64-1053-4eed-a1ea-1ed03cff2eaa tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:12.712619 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e44d7c64-1053-4eed-a1ea-1ed03cff2eaa tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:12.716710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e44d7c64-1053-4eed-a1ea-1ed03cff2eaa tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:12.899304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e44d7c64-1053-4eed-a1ea-1ed03cff2eaa tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:12.907911 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e44d7c64-1053-4eed-a1ea-1ed03cff2eaa tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975" status: 200 len: 1278 microversion: 2.1 time: 0.240808 Oct 29 03:36:12.909199 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3335/6447] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:12 2022] GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975 => generated 1278 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:13.320315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-2c38a8d6-40d4-45ff-b73a-b4ab9f6c0a1c req-37e3c72f-b210-421e-918b-7fc09cdee5b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6145fb3f-ced5-4bdd-a889-c4eabea5d975", "tag": "23a3eed0-1845-4aa6-974b-3dc35c706c0d"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:36:13.338633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2c38a8d6-40d4-45ff-b73a-b4ab9f6c0a1c req-37e3c72f-b210-421e-918b-7fc09cdee5b6 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:13.339957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2c38a8d6-40d4-45ff-b73a-b4ab9f6c0a1c req-37e3c72f-b210-421e-918b-7fc09cdee5b6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:13.340794 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2c38a8d6-40d4-45ff-b73a-b4ab9f6c0a1c req-37e3c72f-b210-421e-918b-7fc09cdee5b6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:13.359971 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-2c38a8d6-40d4-45ff-b73a-b4ab9f6c0a1c req-37e3c72f-b210-421e-918b-7fc09cdee5b6 service nova] Creating event network-changed:23a3eed0-1845-4aa6-974b-3dc35c706c0d for instance 6145fb3f-ced5-4bdd-a889-c4eabea5d975 on n-h2-862967-2 Oct 29 03:36:13.368250 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-2c38a8d6-40d4-45ff-b73a-b4ab9f6c0a1c req-37e3c72f-b210-421e-918b-7fc09cdee5b6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053089 Oct 29 03:36:13.369210 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3113/6448] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:36:13.931603 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-676dacfd-af7c-405d-9e8f-9765c8b49485 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:13.933305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-676dacfd-af7c-405d-9e8f-9765c8b49485 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6145fb3f-ced5-4bdd-a889-c4eabea5d975] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:13.940631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-676dacfd-af7c-405d-9e8f-9765c8b49485 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:13.941394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-676dacfd-af7c-405d-9e8f-9765c8b49485 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:13.942056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-676dacfd-af7c-405d-9e8f-9765c8b49485 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:13.943182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-676dacfd-af7c-405d-9e8f-9765c8b49485 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:13.943820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-676dacfd-af7c-405d-9e8f-9765c8b49485 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:13.944430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-676dacfd-af7c-405d-9e8f-9765c8b49485 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:14.139485 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-676dacfd-af7c-405d-9e8f-9765c8b49485 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:14.148262 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-676dacfd-af7c-405d-9e8f-9765c8b49485 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975" status: 200 len: 1278 microversion: 2.1 time: 0.220476 Oct 29 03:36:14.149081 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3336/6449] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:13 2022] GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975 => generated 1278 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:15.173766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b11bc962-6d3e-4ff7-88b5-3714179fcdfd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:15.175030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b11bc962-6d3e-4ff7-88b5-3714179fcdfd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6145fb3f-ced5-4bdd-a889-c4eabea5d975] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:15.182776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b11bc962-6d3e-4ff7-88b5-3714179fcdfd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:15.183247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b11bc962-6d3e-4ff7-88b5-3714179fcdfd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:15.183938 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b11bc962-6d3e-4ff7-88b5-3714179fcdfd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:15.184701 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b11bc962-6d3e-4ff7-88b5-3714179fcdfd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:15.185139 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b11bc962-6d3e-4ff7-88b5-3714179fcdfd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:15.185961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b11bc962-6d3e-4ff7-88b5-3714179fcdfd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:15.605472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b11bc962-6d3e-4ff7-88b5-3714179fcdfd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:15.614454 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b11bc962-6d3e-4ff7-88b5-3714179fcdfd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975" status: 200 len: 1278 microversion: 2.1 time: 0.446709 Oct 29 03:36:15.615081 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3114/6450] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:15 2022] GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975 => generated 1278 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:16.638720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a98ac841-e5c4-46a1-b238-db24e892e1bb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:16.639995 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a98ac841-e5c4-46a1-b238-db24e892e1bb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6145fb3f-ced5-4bdd-a889-c4eabea5d975] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:16.648277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a98ac841-e5c4-46a1-b238-db24e892e1bb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:16.649137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a98ac841-e5c4-46a1-b238-db24e892e1bb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:16.649730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a98ac841-e5c4-46a1-b238-db24e892e1bb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:16.650657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a98ac841-e5c4-46a1-b238-db24e892e1bb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:16.651277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a98ac841-e5c4-46a1-b238-db24e892e1bb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:16.651932 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a98ac841-e5c4-46a1-b238-db24e892e1bb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:16.820723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a98ac841-e5c4-46a1-b238-db24e892e1bb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:16.830132 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a98ac841-e5c4-46a1-b238-db24e892e1bb tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975" status: 200 len: 1278 microversion: 2.1 time: 0.196004 Oct 29 03:36:16.841066 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3337/6451] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:16 2022] GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975 => generated 1278 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:17.858521 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c5d2890f-fae4-43c1-a67c-73e00fe3938a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:17.859515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c5d2890f-fae4-43c1-a67c-73e00fe3938a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6145fb3f-ced5-4bdd-a889-c4eabea5d975] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:17.871054 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5d2890f-fae4-43c1-a67c-73e00fe3938a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:17.871739 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5d2890f-fae4-43c1-a67c-73e00fe3938a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:17.872180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5d2890f-fae4-43c1-a67c-73e00fe3938a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:17.873179 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5d2890f-fae4-43c1-a67c-73e00fe3938a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:17.873643 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5d2890f-fae4-43c1-a67c-73e00fe3938a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:17.874077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c5d2890f-fae4-43c1-a67c-73e00fe3938a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:18.016834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c5d2890f-fae4-43c1-a67c-73e00fe3938a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:18.024696 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c5d2890f-fae4-43c1-a67c-73e00fe3938a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975" status: 200 len: 1266 microversion: 2.1 time: 0.173160 Oct 29 03:36:18.025274 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3115/6452] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:17 2022] GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:19.051667 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-11b7652c-01d9-4e45-b0b5-efcbe707b486 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:19.052587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-11b7652c-01d9-4e45-b0b5-efcbe707b486 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6145fb3f-ced5-4bdd-a889-c4eabea5d975] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:19.062303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11b7652c-01d9-4e45-b0b5-efcbe707b486 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:19.062793 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11b7652c-01d9-4e45-b0b5-efcbe707b486 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:19.063233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11b7652c-01d9-4e45-b0b5-efcbe707b486 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:19.063948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11b7652c-01d9-4e45-b0b5-efcbe707b486 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:19.064404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11b7652c-01d9-4e45-b0b5-efcbe707b486 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:19.064874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11b7652c-01d9-4e45-b0b5-efcbe707b486 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:19.220899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-11b7652c-01d9-4e45-b0b5-efcbe707b486 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:19.232452 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-11b7652c-01d9-4e45-b0b5-efcbe707b486 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975" status: 200 len: 1266 microversion: 2.1 time: 0.187244 Oct 29 03:36:19.234177 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3338/6453] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:19 2022] GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:20.259396 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-355e97da-a752-4ed1-b844-43fc6a508633 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:20.260423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-355e97da-a752-4ed1-b844-43fc6a508633 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6145fb3f-ced5-4bdd-a889-c4eabea5d975] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:20.263981 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:20.264681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:20.270801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-355e97da-a752-4ed1-b844-43fc6a508633 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:20.271301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-355e97da-a752-4ed1-b844-43fc6a508633 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:20.271746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-355e97da-a752-4ed1-b844-43fc6a508633 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:20.272465 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-355e97da-a752-4ed1-b844-43fc6a508633 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:20.272962 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-355e97da-a752-4ed1-b844-43fc6a508633 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:20.273399 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-355e97da-a752-4ed1-b844-43fc6a508633 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:20.406924 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-355e97da-a752-4ed1-b844-43fc6a508633 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:20.415215 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-355e97da-a752-4ed1-b844-43fc6a508633 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975" status: 200 len: 1266 microversion: 2.1 time: 0.162408 Oct 29 03:36:20.415802 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3116/6454] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:20 2022] GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:21.439103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b8fc3f53-1c34-4bc3-b68c-af45c8f635c4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:21.439714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b8fc3f53-1c34-4bc3-b68c-af45c8f635c4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6145fb3f-ced5-4bdd-a889-c4eabea5d975] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:21.442606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:21.448249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b8fc3f53-1c34-4bc3-b68c-af45c8f635c4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:21.449215 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b8fc3f53-1c34-4bc3-b68c-af45c8f635c4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:21.449358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b8fc3f53-1c34-4bc3-b68c-af45c8f635c4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:21.450078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b8fc3f53-1c34-4bc3-b68c-af45c8f635c4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:21.450611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b8fc3f53-1c34-4bc3-b68c-af45c8f635c4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:21.451039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b8fc3f53-1c34-4bc3-b68c-af45c8f635c4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:21.599193 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b8fc3f53-1c34-4bc3-b68c-af45c8f635c4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:21.607721 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b8fc3f53-1c34-4bc3-b68c-af45c8f635c4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975" status: 200 len: 1266 microversion: 2.1 time: 0.172604 Oct 29 03:36:21.608272 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3339/6455] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:21 2022] GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:22.634986 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4e340bb4-115d-4a56-9da6-b9e597b88b4c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:22.635589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4e340bb4-115d-4a56-9da6-b9e597b88b4c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6145fb3f-ced5-4bdd-a889-c4eabea5d975] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:22.643025 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e340bb4-115d-4a56-9da6-b9e597b88b4c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:22.643519 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e340bb4-115d-4a56-9da6-b9e597b88b4c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:22.643967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e340bb4-115d-4a56-9da6-b9e597b88b4c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:22.644700 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e340bb4-115d-4a56-9da6-b9e597b88b4c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:22.645161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e340bb4-115d-4a56-9da6-b9e597b88b4c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:22.645593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e340bb4-115d-4a56-9da6-b9e597b88b4c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:22.785773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4e340bb4-115d-4a56-9da6-b9e597b88b4c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:22.797994 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4e340bb4-115d-4a56-9da6-b9e597b88b4c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975" status: 200 len: 1266 microversion: 2.1 time: 0.166706 Oct 29 03:36:22.798856 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3117/6456] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:22 2022] GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:23.829147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2e3ecacc-5881-4e78-8fda-2e20911b0159 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:23.830206 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2e3ecacc-5881-4e78-8fda-2e20911b0159 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6145fb3f-ced5-4bdd-a889-c4eabea5d975] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:23.840979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e3ecacc-5881-4e78-8fda-2e20911b0159 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:23.841471 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e3ecacc-5881-4e78-8fda-2e20911b0159 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:23.841908 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e3ecacc-5881-4e78-8fda-2e20911b0159 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:23.842605 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e3ecacc-5881-4e78-8fda-2e20911b0159 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:23.843061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e3ecacc-5881-4e78-8fda-2e20911b0159 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:23.843489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e3ecacc-5881-4e78-8fda-2e20911b0159 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:23.983686 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2e3ecacc-5881-4e78-8fda-2e20911b0159 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:23.992221 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2e3ecacc-5881-4e78-8fda-2e20911b0159 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975" status: 200 len: 1266 microversion: 2.1 time: 0.169505 Oct 29 03:36:23.992867 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3340/6457] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:23 2022] GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:25.021984 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1553d2b6-250e-4ed5-8497-31ca2629a474 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:25.022615 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1553d2b6-250e-4ed5-8497-31ca2629a474 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6145fb3f-ced5-4bdd-a889-c4eabea5d975] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:25.030136 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1553d2b6-250e-4ed5-8497-31ca2629a474 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:25.030716 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1553d2b6-250e-4ed5-8497-31ca2629a474 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:25.031139 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1553d2b6-250e-4ed5-8497-31ca2629a474 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:25.032124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1553d2b6-250e-4ed5-8497-31ca2629a474 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:25.032653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1553d2b6-250e-4ed5-8497-31ca2629a474 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:25.033119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1553d2b6-250e-4ed5-8497-31ca2629a474 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:25.169994 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1553d2b6-250e-4ed5-8497-31ca2629a474 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:25.180367 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1553d2b6-250e-4ed5-8497-31ca2629a474 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975" status: 200 len: 1266 microversion: 2.1 time: 0.162287 Oct 29 03:36:25.180987 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3118/6458] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:25 2022] GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:26.203636 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-56401a52-95af-47c9-9b6a-e99cdbae15a1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:26.204238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-56401a52-95af-47c9-9b6a-e99cdbae15a1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6145fb3f-ced5-4bdd-a889-c4eabea5d975] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:26.211266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56401a52-95af-47c9-9b6a-e99cdbae15a1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:26.211759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56401a52-95af-47c9-9b6a-e99cdbae15a1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:26.212198 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56401a52-95af-47c9-9b6a-e99cdbae15a1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:26.212930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56401a52-95af-47c9-9b6a-e99cdbae15a1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:26.213384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56401a52-95af-47c9-9b6a-e99cdbae15a1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:26.213950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-56401a52-95af-47c9-9b6a-e99cdbae15a1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:26.351838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-56401a52-95af-47c9-9b6a-e99cdbae15a1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:26.359988 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-56401a52-95af-47c9-9b6a-e99cdbae15a1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975" status: 200 len: 1266 microversion: 2.1 time: 0.160338 Oct 29 03:36:26.360594 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3341/6459] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:26 2022] GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:27.144896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-0dffdecd-a9e8-41d4-90dc-847d343b99ad req-4fb269f1-2b5d-4d02-8110-d43a2842a5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6145fb3f-ced5-4bdd-a889-c4eabea5d975", "name": "network-vif-plugged", "status": "completed", "tag": "23a3eed0-1845-4aa6-974b-3dc35c706c0d"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:36:27.155237 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0dffdecd-a9e8-41d4-90dc-847d343b99ad req-4fb269f1-2b5d-4d02-8110-d43a2842a5a3 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:27.155717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0dffdecd-a9e8-41d4-90dc-847d343b99ad req-4fb269f1-2b5d-4d02-8110-d43a2842a5a3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:27.156150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0dffdecd-a9e8-41d4-90dc-847d343b99ad req-4fb269f1-2b5d-4d02-8110-d43a2842a5a3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:27.167111 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-0dffdecd-a9e8-41d4-90dc-847d343b99ad req-4fb269f1-2b5d-4d02-8110-d43a2842a5a3 service nova] Creating event network-vif-plugged:23a3eed0-1845-4aa6-974b-3dc35c706c0d for instance 6145fb3f-ced5-4bdd-a889-c4eabea5d975 on n-h2-862967-2 Oct 29 03:36:27.172269 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-0dffdecd-a9e8-41d4-90dc-847d343b99ad req-4fb269f1-2b5d-4d02-8110-d43a2842a5a3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219865 Oct 29 03:36:27.172900 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3119/6460] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:36:27.394860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4ef8e17f-40a9-46f4-a5a0-17ad746877d4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:27.395469 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4ef8e17f-40a9-46f4-a5a0-17ad746877d4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6145fb3f-ced5-4bdd-a889-c4eabea5d975] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:27.404703 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ef8e17f-40a9-46f4-a5a0-17ad746877d4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:27.405196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ef8e17f-40a9-46f4-a5a0-17ad746877d4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:27.405637 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ef8e17f-40a9-46f4-a5a0-17ad746877d4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:27.406330 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ef8e17f-40a9-46f4-a5a0-17ad746877d4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:27.406789 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ef8e17f-40a9-46f4-a5a0-17ad746877d4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:27.407219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ef8e17f-40a9-46f4-a5a0-17ad746877d4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:27.542521 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4ef8e17f-40a9-46f4-a5a0-17ad746877d4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:27.554470 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4ef8e17f-40a9-46f4-a5a0-17ad746877d4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975" status: 200 len: 1266 microversion: 2.1 time: 0.165601 Oct 29 03:36:27.555376 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3342/6461] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:27 2022] GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:28.592448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-af845e7d-da1a-424a-a2d2-dfcd0f674640 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:28.593703 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-af845e7d-da1a-424a-a2d2-dfcd0f674640 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6145fb3f-ced5-4bdd-a889-c4eabea5d975] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:28.604227 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af845e7d-da1a-424a-a2d2-dfcd0f674640 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:28.605271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af845e7d-da1a-424a-a2d2-dfcd0f674640 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:28.605780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af845e7d-da1a-424a-a2d2-dfcd0f674640 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:28.606436 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af845e7d-da1a-424a-a2d2-dfcd0f674640 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:28.606894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af845e7d-da1a-424a-a2d2-dfcd0f674640 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:28.607331 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af845e7d-da1a-424a-a2d2-dfcd0f674640 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:28.740445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-af845e7d-da1a-424a-a2d2-dfcd0f674640 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:28.748825 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-af845e7d-da1a-424a-a2d2-dfcd0f674640 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975" status: 200 len: 1452 microversion: 2.1 time: 0.164825 Oct 29 03:36:28.749414 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3120/6462] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:28 2022] GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975 => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:28.771224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6cc97d74-1f98-47b7-8648-c36de1525e22 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:36:28.771827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6cc97d74-1f98-47b7-8648-c36de1525e22 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6145fb3f-ced5-4bdd-a889-c4eabea5d975] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:36:28.778873 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cc97d74-1f98-47b7-8648-c36de1525e22 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:28.779354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cc97d74-1f98-47b7-8648-c36de1525e22 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:28.779782 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cc97d74-1f98-47b7-8648-c36de1525e22 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:28.780467 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cc97d74-1f98-47b7-8648-c36de1525e22 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:28.780986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cc97d74-1f98-47b7-8648-c36de1525e22 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:28.781408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cc97d74-1f98-47b7-8648-c36de1525e22 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:28.929624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6cc97d74-1f98-47b7-8648-c36de1525e22 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:36:28.938100 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6cc97d74-1f98-47b7-8648-c36de1525e22 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975" status: 200 len: 1452 microversion: 2.1 time: 0.170728 Oct 29 03:36:28.938656 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3343/6463] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:36:28 2022] GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975 => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:36:30.806093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-6af271c1-4aeb-4330-8534-001196361e5f req-d3525463-2435-42df-ac8f-f33c4804e555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6145fb3f-ced5-4bdd-a889-c4eabea5d975", "tag": "23a3eed0-1845-4aa6-974b-3dc35c706c0d"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:36:30.817063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6af271c1-4aeb-4330-8534-001196361e5f req-d3525463-2435-42df-ac8f-f33c4804e555 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:36:30.817548 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6af271c1-4aeb-4330-8534-001196361e5f req-d3525463-2435-42df-ac8f-f33c4804e555 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:36:30.817988 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6af271c1-4aeb-4330-8534-001196361e5f req-d3525463-2435-42df-ac8f-f33c4804e555 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:36:30.832571 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-6af271c1-4aeb-4330-8534-001196361e5f req-d3525463-2435-42df-ac8f-f33c4804e555 service nova] Creating event network-changed:23a3eed0-1845-4aa6-974b-3dc35c706c0d for instance 6145fb3f-ced5-4bdd-a889-c4eabea5d975 on n-h2-862967-2 Oct 29 03:36:30.837632 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-6af271c1-4aeb-4330-8534-001196361e5f req-d3525463-2435-42df-ac8f-f33c4804e555 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035430 Oct 29 03:36:30.838243 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3121/6464] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:38:12.153277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:38:12.154358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:38:12.159917 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e53968c0-ead4-4b94-a1bf-172c57855ddd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2111474314", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1499884373", "security_groups": [{"name": "tempest-secgroup-smoke-1237209821"}], "block_device_mapping_v2": [{"uuid": "97cbd9de-b9fb-4d9a-b273-8d1c93f23695", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "99eca644-5d6e-42bc-9cf9-7cf1c8e093be"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:38:12.281454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-e53968c0-ead4-4b94-a1bf-172c57855ddd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] validate_networks() for [('99eca644-5d6e-42bc-9cf9-7cf1c8e093be', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:38:12.725260 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e53968c0-ead4-4b94-a1bf-172c57855ddd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:38:12.725656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e53968c0-ead4-4b94-a1bf-172c57855ddd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:38:12.726162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e53968c0-ead4-4b94-a1bf-172c57855ddd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:38:12.726571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e53968c0-ead4-4b94-a1bf-172c57855ddd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:38:12.726982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-e53968c0-ead4-4b94-a1bf-172c57855ddd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:38:12.736370 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e53968c0-ead4-4b94-a1bf-172c57855ddd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:12.736899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e53968c0-ead4-4b94-a1bf-172c57855ddd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:12.737376 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e53968c0-ead4-4b94-a1bf-172c57855ddd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:12.738107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e53968c0-ead4-4b94-a1bf-172c57855ddd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:12.738560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e53968c0-ead4-4b94-a1bf-172c57855ddd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:12.738989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e53968c0-ead4-4b94-a1bf-172c57855ddd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:12.756746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-e53968c0-ead4-4b94-a1bf-172c57855ddd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Getting quotas for project 7c164fcbf0df4575b66149f2298496e3. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:38:12.761904 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-e53968c0-ead4-4b94-a1bf-172c57855ddd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Getting quotas for user 187e7d6474db4b8e813ff31fcddb4034 and project 7c164fcbf0df4575b66149f2298496e3. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:38:12.822806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e53968c0-ead4-4b94-a1bf-172c57855ddd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:38:12.825000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e53968c0-ead4-4b94-a1bf-172c57855ddd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5f0bec9f-5a2d-4364-b683-9468fc344d91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='97cbd9de-b9fb-4d9a-b273-8d1c93f23695',volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:38:12.962632 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e53968c0-ead4-4b94-a1bf-172c57855ddd tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.811316 Oct 29 03:38:12.963293 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3344/6465] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:38:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 03:38:12.972751 n-d-862967-2 devstack@n-api.service[127125]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7606be4b-8fa9-49e5-a603-02528cbf3013] AMQP server on 10.222.0.46:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 29 03:38:12.974353 n-d-862967-2 devstack@n-api.service[127125]: ERROR oslo.messaging._drivers.impl_rabbit [-] [db70aafa-b304-4ac0-be4f-1798e9789b82] AMQP server on 10.222.0.46:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 29 03:38:12.975386 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:38:12.976342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=74 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:38:12.982251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ee10ffc3-6f4c-4fc0-b5a9-8163dd7c9787 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:12.982991 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ee10ffc3-6f4c-4fc0-b5a9-8163dd7c9787 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5f0bec9f-5a2d-4364-b683-9468fc344d91] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:13.042263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ee10ffc3-6f4c-4fc0-b5a9-8163dd7c9787 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:13.049527 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ee10ffc3-6f4c-4fc0-b5a9-8163dd7c9787 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91" status: 200 len: 1095 microversion: 2.1 time: 0.078672 Oct 29 03:38:13.065024 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3122/6466] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:12 2022] GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91 => generated 1095 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:14.073939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1427d5a9-e12b-4caa-ba5e-43644810a2b4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:14.074824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1427d5a9-e12b-4caa-ba5e-43644810a2b4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5f0bec9f-5a2d-4364-b683-9468fc344d91] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:14.082176 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1427d5a9-e12b-4caa-ba5e-43644810a2b4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:14.083352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1427d5a9-e12b-4caa-ba5e-43644810a2b4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:14.083352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1427d5a9-e12b-4caa-ba5e-43644810a2b4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:14.083833 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1427d5a9-e12b-4caa-ba5e-43644810a2b4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:14.084311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1427d5a9-e12b-4caa-ba5e-43644810a2b4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:14.084780 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1427d5a9-e12b-4caa-ba5e-43644810a2b4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:14.149342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1427d5a9-e12b-4caa-ba5e-43644810a2b4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:14.157352 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1427d5a9-e12b-4caa-ba5e-43644810a2b4 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91" status: 200 len: 1145 microversion: 2.1 time: 0.088851 Oct 29 03:38:14.157926 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3345/6467] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:14 2022] GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91 => generated 1145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:15.180837 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3ec35fa3-e4b8-49b4-bfd8-ceb310d32bf9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:15.181509 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3ec35fa3-e4b8-49b4-bfd8-ceb310d32bf9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5f0bec9f-5a2d-4364-b683-9468fc344d91] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:15.193885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ec35fa3-e4b8-49b4-bfd8-ceb310d32bf9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:15.194388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ec35fa3-e4b8-49b4-bfd8-ceb310d32bf9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:15.194834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ec35fa3-e4b8-49b4-bfd8-ceb310d32bf9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:15.195556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ec35fa3-e4b8-49b4-bfd8-ceb310d32bf9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:15.196023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ec35fa3-e4b8-49b4-bfd8-ceb310d32bf9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:15.196452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ec35fa3-e4b8-49b4-bfd8-ceb310d32bf9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:15.214105 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] [db70aafa-b304-4ac0-be4f-1798e9789b82] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 36356. Oct 29 03:38:15.214860 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] [7606be4b-8fa9-49e5-a603-02528cbf3013] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 36354. Oct 29 03:38:15.278581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3ec35fa3-e4b8-49b4-bfd8-ceb310d32bf9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:15.287239 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3ec35fa3-e4b8-49b4-bfd8-ceb310d32bf9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91" status: 200 len: 1193 microversion: 2.1 time: 0.110564 Oct 29 03:38:15.288355 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3123/6468] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:15 2022] GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91 => generated 1193 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:16.310425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c468ffa5-7cac-4701-abd9-23d7ffe0ca0c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:16.311102 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c468ffa5-7cac-4701-abd9-23d7ffe0ca0c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5f0bec9f-5a2d-4364-b683-9468fc344d91] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:16.318699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c468ffa5-7cac-4701-abd9-23d7ffe0ca0c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:16.319812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c468ffa5-7cac-4701-abd9-23d7ffe0ca0c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:16.320493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c468ffa5-7cac-4701-abd9-23d7ffe0ca0c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:16.321325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c468ffa5-7cac-4701-abd9-23d7ffe0ca0c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:16.321873 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c468ffa5-7cac-4701-abd9-23d7ffe0ca0c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:16.322314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c468ffa5-7cac-4701-abd9-23d7ffe0ca0c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:16.498185 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c468ffa5-7cac-4701-abd9-23d7ffe0ca0c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:16.512808 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c468ffa5-7cac-4701-abd9-23d7ffe0ca0c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91" status: 200 len: 1279 microversion: 2.1 time: 0.206242 Oct 29 03:38:16.514364 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3346/6469] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:16 2022] GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91 => generated 1279 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:17.111468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-0de85ce2-89c2-466e-9327-1607d50015f9 req-53dd6b19-e1df-44c1-a074-6b3008f8aa54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f0bec9f-5a2d-4364-b683-9468fc344d91", "tag": "c0e8d58c-005c-4e41-8999-9a2a82491565"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:38:17.124940 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0de85ce2-89c2-466e-9327-1607d50015f9 req-53dd6b19-e1df-44c1-a074-6b3008f8aa54 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:17.126027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0de85ce2-89c2-466e-9327-1607d50015f9 req-53dd6b19-e1df-44c1-a074-6b3008f8aa54 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:17.126606 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0de85ce2-89c2-466e-9327-1607d50015f9 req-53dd6b19-e1df-44c1-a074-6b3008f8aa54 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:17.151037 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-0de85ce2-89c2-466e-9327-1607d50015f9 req-53dd6b19-e1df-44c1-a074-6b3008f8aa54 service nova] Creating event network-changed:c0e8d58c-005c-4e41-8999-9a2a82491565 for instance 5f0bec9f-5a2d-4364-b683-9468fc344d91 on n-h1-862967-2 Oct 29 03:38:17.157090 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-0de85ce2-89c2-466e-9327-1607d50015f9 req-53dd6b19-e1df-44c1-a074-6b3008f8aa54 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050605 Oct 29 03:38:17.157835 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3124/6470] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:38:17.537124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-55eceedc-4a12-4dfd-8774-ad769edbf303 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:17.537997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-55eceedc-4a12-4dfd-8774-ad769edbf303 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5f0bec9f-5a2d-4364-b683-9468fc344d91] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:17.545410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55eceedc-4a12-4dfd-8774-ad769edbf303 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:17.545902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55eceedc-4a12-4dfd-8774-ad769edbf303 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:17.546335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55eceedc-4a12-4dfd-8774-ad769edbf303 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:17.547081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55eceedc-4a12-4dfd-8774-ad769edbf303 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:17.547724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55eceedc-4a12-4dfd-8774-ad769edbf303 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:17.548158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-55eceedc-4a12-4dfd-8774-ad769edbf303 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:17.699713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-55eceedc-4a12-4dfd-8774-ad769edbf303 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:17.708270 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-55eceedc-4a12-4dfd-8774-ad769edbf303 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91" status: 200 len: 1279 microversion: 2.1 time: 0.175052 Oct 29 03:38:17.709022 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3347/6471] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:17 2022] GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91 => generated 1279 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:18.732233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-be94ec03-5d63-4410-9b8a-28327296e342 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:18.732987 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-be94ec03-5d63-4410-9b8a-28327296e342 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5f0bec9f-5a2d-4364-b683-9468fc344d91] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:18.740892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be94ec03-5d63-4410-9b8a-28327296e342 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:18.741393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be94ec03-5d63-4410-9b8a-28327296e342 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:18.741837 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be94ec03-5d63-4410-9b8a-28327296e342 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:18.742578 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be94ec03-5d63-4410-9b8a-28327296e342 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:18.743043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be94ec03-5d63-4410-9b8a-28327296e342 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:18.743475 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be94ec03-5d63-4410-9b8a-28327296e342 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:18.882448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-be94ec03-5d63-4410-9b8a-28327296e342 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:18.890723 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-be94ec03-5d63-4410-9b8a-28327296e342 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91" status: 200 len: 1279 microversion: 2.1 time: 0.162900 Oct 29 03:38:18.891345 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3125/6472] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:18 2022] GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91 => generated 1279 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:19.913668 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0f190c89-68da-411b-b998-2ee17170897a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:19.914295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0f190c89-68da-411b-b998-2ee17170897a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5f0bec9f-5a2d-4364-b683-9468fc344d91] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:19.921747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f190c89-68da-411b-b998-2ee17170897a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:19.922236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f190c89-68da-411b-b998-2ee17170897a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:19.922669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f190c89-68da-411b-b998-2ee17170897a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:19.923363 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f190c89-68da-411b-b998-2ee17170897a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:19.923815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f190c89-68da-411b-b998-2ee17170897a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:19.924239 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0f190c89-68da-411b-b998-2ee17170897a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:20.062802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0f190c89-68da-411b-b998-2ee17170897a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:20.071853 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0f190c89-68da-411b-b998-2ee17170897a tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91" status: 200 len: 1279 microversion: 2.1 time: 0.162137 Oct 29 03:38:20.072862 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3348/6473] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:19 2022] GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91 => generated 1279 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:21.095377 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-be90c1bd-91d6-4fab-a212-135ab3fb265f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:21.096011 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-be90c1bd-91d6-4fab-a212-135ab3fb265f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5f0bec9f-5a2d-4364-b683-9468fc344d91] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:21.103365 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be90c1bd-91d6-4fab-a212-135ab3fb265f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:21.103896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be90c1bd-91d6-4fab-a212-135ab3fb265f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:21.104346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be90c1bd-91d6-4fab-a212-135ab3fb265f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:21.105089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be90c1bd-91d6-4fab-a212-135ab3fb265f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:21.105558 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be90c1bd-91d6-4fab-a212-135ab3fb265f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:21.105996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be90c1bd-91d6-4fab-a212-135ab3fb265f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:21.246420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-be90c1bd-91d6-4fab-a212-135ab3fb265f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:21.255213 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-be90c1bd-91d6-4fab-a212-135ab3fb265f tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91" status: 200 len: 1267 microversion: 2.1 time: 0.163990 Oct 29 03:38:21.255930 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3126/6474] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:21 2022] GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:22.282922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-82aa37c5-1664-466d-be8c-cef07b6f2cde tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:22.283797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-82aa37c5-1664-466d-be8c-cef07b6f2cde tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5f0bec9f-5a2d-4364-b683-9468fc344d91] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:22.295398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82aa37c5-1664-466d-be8c-cef07b6f2cde tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:22.296193 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82aa37c5-1664-466d-be8c-cef07b6f2cde tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:22.297014 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82aa37c5-1664-466d-be8c-cef07b6f2cde tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:22.297743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82aa37c5-1664-466d-be8c-cef07b6f2cde tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:22.298191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82aa37c5-1664-466d-be8c-cef07b6f2cde tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:22.298616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82aa37c5-1664-466d-be8c-cef07b6f2cde tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:22.454582 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-82aa37c5-1664-466d-be8c-cef07b6f2cde tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:22.463973 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-82aa37c5-1664-466d-be8c-cef07b6f2cde tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91" status: 200 len: 1267 microversion: 2.1 time: 0.187901 Oct 29 03:38:22.464582 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3349/6475] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:22 2022] GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91 => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:23.489099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d55757de-1a3c-4a60-882d-b98e0bd2287b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:23.489703 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d55757de-1a3c-4a60-882d-b98e0bd2287b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5f0bec9f-5a2d-4364-b683-9468fc344d91] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:23.492659 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:38:23.498525 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d55757de-1a3c-4a60-882d-b98e0bd2287b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:23.499381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d55757de-1a3c-4a60-882d-b98e0bd2287b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:23.499834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d55757de-1a3c-4a60-882d-b98e0bd2287b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:23.500555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d55757de-1a3c-4a60-882d-b98e0bd2287b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:23.501103 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d55757de-1a3c-4a60-882d-b98e0bd2287b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:23.501540 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d55757de-1a3c-4a60-882d-b98e0bd2287b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:23.644494 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d55757de-1a3c-4a60-882d-b98e0bd2287b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:23.657550 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d55757de-1a3c-4a60-882d-b98e0bd2287b tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91" status: 200 len: 1267 microversion: 2.1 time: 0.172129 Oct 29 03:38:23.658180 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3127/6476] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:23 2022] GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:24.683432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-87363eb3-b2c9-4c33-8587-092deca1b355 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:24.684073 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-87363eb3-b2c9-4c33-8587-092deca1b355 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5f0bec9f-5a2d-4364-b683-9468fc344d91] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:24.686364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:38:24.687157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:38:24.693968 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87363eb3-b2c9-4c33-8587-092deca1b355 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:24.694477 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87363eb3-b2c9-4c33-8587-092deca1b355 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:24.694899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87363eb3-b2c9-4c33-8587-092deca1b355 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:24.695633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87363eb3-b2c9-4c33-8587-092deca1b355 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:24.696117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87363eb3-b2c9-4c33-8587-092deca1b355 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:24.696872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-87363eb3-b2c9-4c33-8587-092deca1b355 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:24.843064 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-87363eb3-b2c9-4c33-8587-092deca1b355 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:24.852010 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-87363eb3-b2c9-4c33-8587-092deca1b355 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91" status: 200 len: 1267 microversion: 2.1 time: 0.173019 Oct 29 03:38:24.852661 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3350/6477] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:24 2022] GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:25.877719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ac2deadb-d62f-4846-9ee4-e9b072503c90 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:25.878477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ac2deadb-d62f-4846-9ee4-e9b072503c90 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5f0bec9f-5a2d-4364-b683-9468fc344d91] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:25.886646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ac2deadb-d62f-4846-9ee4-e9b072503c90 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:25.887198 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ac2deadb-d62f-4846-9ee4-e9b072503c90 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:25.887715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ac2deadb-d62f-4846-9ee4-e9b072503c90 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:25.888513 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ac2deadb-d62f-4846-9ee4-e9b072503c90 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:25.889083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ac2deadb-d62f-4846-9ee4-e9b072503c90 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:25.889629 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ac2deadb-d62f-4846-9ee4-e9b072503c90 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:26.029223 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ac2deadb-d62f-4846-9ee4-e9b072503c90 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:26.040412 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ac2deadb-d62f-4846-9ee4-e9b072503c90 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91" status: 200 len: 1267 microversion: 2.1 time: 0.167439 Oct 29 03:38:26.041228 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3128/6478] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:25 2022] GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:27.065896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-108b85e0-9c53-4e4a-baec-bf6aa10dae70 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:27.066616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-108b85e0-9c53-4e4a-baec-bf6aa10dae70 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5f0bec9f-5a2d-4364-b683-9468fc344d91] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:27.074263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-108b85e0-9c53-4e4a-baec-bf6aa10dae70 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:27.074755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-108b85e0-9c53-4e4a-baec-bf6aa10dae70 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:27.075189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-108b85e0-9c53-4e4a-baec-bf6aa10dae70 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:27.075895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-108b85e0-9c53-4e4a-baec-bf6aa10dae70 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:27.076350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-108b85e0-9c53-4e4a-baec-bf6aa10dae70 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:27.076808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-108b85e0-9c53-4e4a-baec-bf6aa10dae70 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:27.211540 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-108b85e0-9c53-4e4a-baec-bf6aa10dae70 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:27.219554 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-108b85e0-9c53-4e4a-baec-bf6aa10dae70 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91" status: 200 len: 1267 microversion: 2.1 time: 0.159306 Oct 29 03:38:27.220147 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3351/6479] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:27 2022] GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:28.244875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bf9eec41-f853-427a-8bb8-18b232036492 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:28.245726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bf9eec41-f853-427a-8bb8-18b232036492 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5f0bec9f-5a2d-4364-b683-9468fc344d91] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:28.256977 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf9eec41-f853-427a-8bb8-18b232036492 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:28.257792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf9eec41-f853-427a-8bb8-18b232036492 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:28.258772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf9eec41-f853-427a-8bb8-18b232036492 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:28.260145 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf9eec41-f853-427a-8bb8-18b232036492 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:28.261059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf9eec41-f853-427a-8bb8-18b232036492 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:28.261827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf9eec41-f853-427a-8bb8-18b232036492 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:28.407068 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bf9eec41-f853-427a-8bb8-18b232036492 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:28.415552 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bf9eec41-f853-427a-8bb8-18b232036492 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91" status: 200 len: 1267 microversion: 2.1 time: 0.176461 Oct 29 03:38:28.416156 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3129/6480] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:28 2022] GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:29.442362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bd18c42b-d918-4708-86a6-e0e78698efaa tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:29.443106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bd18c42b-d918-4708-86a6-e0e78698efaa tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5f0bec9f-5a2d-4364-b683-9468fc344d91] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:29.452709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd18c42b-d918-4708-86a6-e0e78698efaa tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:29.453359 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd18c42b-d918-4708-86a6-e0e78698efaa tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:29.453949 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd18c42b-d918-4708-86a6-e0e78698efaa tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:29.454879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd18c42b-d918-4708-86a6-e0e78698efaa tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:29.455488 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd18c42b-d918-4708-86a6-e0e78698efaa tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:29.456061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bd18c42b-d918-4708-86a6-e0e78698efaa tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:29.599898 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bd18c42b-d918-4708-86a6-e0e78698efaa tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:29.611697 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bd18c42b-d918-4708-86a6-e0e78698efaa tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91" status: 200 len: 1267 microversion: 2.1 time: 0.175117 Oct 29 03:38:29.612500 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3352/6481] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:29 2022] GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:30.057236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-fb97c77d-d286-4e0f-ab7f-66b428dd28fe req-5545208a-d644-4213-8170-6d5c09a7c135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f0bec9f-5a2d-4364-b683-9468fc344d91", "name": "network-vif-plugged", "status": "completed", "tag": "c0e8d58c-005c-4e41-8999-9a2a82491565"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:38:30.068301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-fb97c77d-d286-4e0f-ab7f-66b428dd28fe req-5545208a-d644-4213-8170-6d5c09a7c135 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:30.068837 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-fb97c77d-d286-4e0f-ab7f-66b428dd28fe req-5545208a-d644-4213-8170-6d5c09a7c135 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:30.069347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-fb97c77d-d286-4e0f-ab7f-66b428dd28fe req-5545208a-d644-4213-8170-6d5c09a7c135 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:30.082836 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-fb97c77d-d286-4e0f-ab7f-66b428dd28fe req-5545208a-d644-4213-8170-6d5c09a7c135 service nova] Creating event network-vif-plugged:c0e8d58c-005c-4e41-8999-9a2a82491565 for instance 5f0bec9f-5a2d-4364-b683-9468fc344d91 on n-h1-862967-2 Oct 29 03:38:30.095939 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-fb97c77d-d286-4e0f-ab7f-66b428dd28fe req-5545208a-d644-4213-8170-6d5c09a7c135 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041932 Oct 29 03:38:30.096625 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3130/6482] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:38:30.638915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a6a1924a-8c5b-4aa5-8ac2-2ecdc78d214e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:30.639517 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a6a1924a-8c5b-4aa5-8ac2-2ecdc78d214e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5f0bec9f-5a2d-4364-b683-9468fc344d91] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:30.647039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6a1924a-8c5b-4aa5-8ac2-2ecdc78d214e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:30.647569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6a1924a-8c5b-4aa5-8ac2-2ecdc78d214e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:30.648032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6a1924a-8c5b-4aa5-8ac2-2ecdc78d214e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:30.648761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6a1924a-8c5b-4aa5-8ac2-2ecdc78d214e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:30.649218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6a1924a-8c5b-4aa5-8ac2-2ecdc78d214e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:30.649643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a6a1924a-8c5b-4aa5-8ac2-2ecdc78d214e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:30.784631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a6a1924a-8c5b-4aa5-8ac2-2ecdc78d214e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:30.793162 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a6a1924a-8c5b-4aa5-8ac2-2ecdc78d214e tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91" status: 200 len: 1267 microversion: 2.1 time: 0.158223 Oct 29 03:38:30.793720 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3353/6483] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:30 2022] GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:31.820249 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6c43fa28-cfa8-4cfd-a728-c4f31e62c15d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:31.821089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6c43fa28-cfa8-4cfd-a728-c4f31e62c15d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5f0bec9f-5a2d-4364-b683-9468fc344d91] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:31.828857 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c43fa28-cfa8-4cfd-a728-c4f31e62c15d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:31.829438 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c43fa28-cfa8-4cfd-a728-c4f31e62c15d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:31.829959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c43fa28-cfa8-4cfd-a728-c4f31e62c15d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:31.830774 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c43fa28-cfa8-4cfd-a728-c4f31e62c15d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:31.831319 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c43fa28-cfa8-4cfd-a728-c4f31e62c15d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:31.831858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c43fa28-cfa8-4cfd-a728-c4f31e62c15d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:31.970917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6c43fa28-cfa8-4cfd-a728-c4f31e62c15d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:31.979173 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6c43fa28-cfa8-4cfd-a728-c4f31e62c15d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91" status: 200 len: 1453 microversion: 2.1 time: 0.165562 Oct 29 03:38:31.979787 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3131/6484] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:31 2022] GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91 => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:32.001872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dae3ec32-adee-42da-be44-a87a38e09684 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:38:32.002516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dae3ec32-adee-42da-be44-a87a38e09684 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5f0bec9f-5a2d-4364-b683-9468fc344d91] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:38:32.009662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dae3ec32-adee-42da-be44-a87a38e09684 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:32.010152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dae3ec32-adee-42da-be44-a87a38e09684 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:32.010591 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dae3ec32-adee-42da-be44-a87a38e09684 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:32.011293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dae3ec32-adee-42da-be44-a87a38e09684 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:32.011750 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dae3ec32-adee-42da-be44-a87a38e09684 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:32.012176 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dae3ec32-adee-42da-be44-a87a38e09684 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:32.155961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dae3ec32-adee-42da-be44-a87a38e09684 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:38:32.166453 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dae3ec32-adee-42da-be44-a87a38e09684 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91" status: 200 len: 1453 microversion: 2.1 time: 0.168963 Oct 29 03:38:32.167071 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3354/6485] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:38:31 2022] GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91 => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:38:34.414267 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-c39da15c-1ed2-457c-b68f-98bb1bb75263 req-5006e691-92a1-4699-8c91-8ac7378366eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f0bec9f-5a2d-4364-b683-9468fc344d91", "tag": "c0e8d58c-005c-4e41-8999-9a2a82491565"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:38:34.424663 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c39da15c-1ed2-457c-b68f-98bb1bb75263 req-5006e691-92a1-4699-8c91-8ac7378366eb service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:38:34.424663 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c39da15c-1ed2-457c-b68f-98bb1bb75263 req-5006e691-92a1-4699-8c91-8ac7378366eb service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:38:34.425036 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c39da15c-1ed2-457c-b68f-98bb1bb75263 req-5006e691-92a1-4699-8c91-8ac7378366eb service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:38:34.436399 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-c39da15c-1ed2-457c-b68f-98bb1bb75263 req-5006e691-92a1-4699-8c91-8ac7378366eb service nova] Creating event network-changed:c0e8d58c-005c-4e41-8999-9a2a82491565 for instance 5f0bec9f-5a2d-4364-b683-9468fc344d91 on n-h1-862967-2 Oct 29 03:38:34.441792 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-c39da15c-1ed2-457c-b68f-98bb1bb75263 req-5006e691-92a1-4699-8c91-8ac7378366eb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111036 Oct 29 03:38:34.442695 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3132/6486] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:40:16.079547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:40:16.080309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=62 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:40:16.081170 n-d-862967-2 devstack@n-api.service[127124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:40:16.081327 n-d-862967-2 devstack@n-api.service[127124]: Sat Oct 29 03:40:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91 (ip 10.222.0.46) !!! Oct 29 03:40:16.086950 n-d-862967-2 devstack@n-api.service[127125]: ERROR oslo.messaging._drivers.impl_rabbit [-] [db70aafa-b304-4ac0-be4f-1798e9789b82] AMQP server on 10.222.0.46:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 29 03:40:16.088733 n-d-862967-2 devstack@n-api.service[127125]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7606be4b-8fa9-49e5-a603-02528cbf3013] AMQP server on 10.222.0.46:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 29 03:40:16.089355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=24 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:40:16.090165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=48 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:40:16.092410 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:40:16.092562 n-d-862967-2 devstack@n-api.service[127125]: Sat Oct 29 03:40:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.46) !!! Oct 29 03:40:16.093487 n-d-862967-2 devstack@n-api.service[127124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:40:16.093787 n-d-862967-2 devstack@n-api.service[127124]: Sat Oct 29 03:40:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91 (ip 10.222.0.46) !!! Oct 29 03:40:16.096881 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:40:16.097000 n-d-862967-2 devstack@n-api.service[127125]: Sat Oct 29 03:40:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.46) !!! Oct 29 03:40:16.109467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-1d824a75-dd87-4a68-bdb5-1d1219ae4640 req-3ee7fc53-3b62-4ca4-8ed8-6e1b0723ef94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f0bec9f-5a2d-4364-b683-9468fc344d91", "tag": "c0e8d58c-005c-4e41-8999-9a2a82491565"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:40:16.118773 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b0ce849b-cb82-4a23-9e12-5e9a1961b3ff tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:16.119271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b0ce849b-cb82-4a23-9e12-5e9a1961b3ff tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5f0bec9f-5a2d-4364-b683-9468fc344d91] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:16.136697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0ce849b-cb82-4a23-9e12-5e9a1961b3ff tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:16.137193 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0ce849b-cb82-4a23-9e12-5e9a1961b3ff tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:16.137640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0ce849b-cb82-4a23-9e12-5e9a1961b3ff tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:16.138355 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0ce849b-cb82-4a23-9e12-5e9a1961b3ff tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:16.138804 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0ce849b-cb82-4a23-9e12-5e9a1961b3ff tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:16.139223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b0ce849b-cb82-4a23-9e12-5e9a1961b3ff tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:16.139624 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-1d824a75-dd87-4a68-bdb5-1d1219ae4640 req-3ee7fc53-3b62-4ca4-8ed8-6e1b0723ef94 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:16.140124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-1d824a75-dd87-4a68-bdb5-1d1219ae4640 req-3ee7fc53-3b62-4ca4-8ed8-6e1b0723ef94 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:16.140588 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-1d824a75-dd87-4a68-bdb5-1d1219ae4640 req-3ee7fc53-3b62-4ca4-8ed8-6e1b0723ef94 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:16.151582 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-1d824a75-dd87-4a68-bdb5-1d1219ae4640 req-3ee7fc53-3b62-4ca4-8ed8-6e1b0723ef94 service nova] Creating event network-changed:c0e8d58c-005c-4e41-8999-9a2a82491565 for instance 5f0bec9f-5a2d-4364-b683-9468fc344d91 on n-h1-862967-2 Oct 29 03:40:16.157801 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-1d824a75-dd87-4a68-bdb5-1d1219ae4640 req-3ee7fc53-3b62-4ca4-8ed8-6e1b0723ef94 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073906 Oct 29 03:40:16.158735 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3133/6487] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:40:16.165912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b0ce849b-cb82-4a23-9e12-5e9a1961b3ff tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5f0bec9f-5a2d-4364-b683-9468fc344d91] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:40:16.253340 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b0ce849b-cb82-4a23-9e12-5e9a1961b3ff tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91" status: 204 len: 0 microversion: 2.1 time: 0.175826 Oct 29 03:40:16.254240 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3355/6488] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:40:16 2022] DELETE /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:40:16.263336 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0f763dc9-22b9-44d2-a516-6672b3c4614d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:16.264418 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0f763dc9-22b9-44d2-a516-6672b3c4614d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5f0bec9f-5a2d-4364-b683-9468fc344d91] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:16.271920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f763dc9-22b9-44d2-a516-6672b3c4614d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:16.273540 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f763dc9-22b9-44d2-a516-6672b3c4614d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:16.274236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f763dc9-22b9-44d2-a516-6672b3c4614d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:16.275306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f763dc9-22b9-44d2-a516-6672b3c4614d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:16.276002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f763dc9-22b9-44d2-a516-6672b3c4614d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:16.276696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f763dc9-22b9-44d2-a516-6672b3c4614d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:16.438493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0f763dc9-22b9-44d2-a516-6672b3c4614d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:16.446789 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0f763dc9-22b9-44d2-a516-6672b3c4614d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91" status: 200 len: 1578 microversion: 2.1 time: 0.187934 Oct 29 03:40:16.447390 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3134/6489] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:16 2022] GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91 => generated 1578 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:40:17.471816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8d3fc5ac-cad7-4744-b296-324d4afa1c8d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:17.472510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8d3fc5ac-cad7-4744-b296-324d4afa1c8d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5f0bec9f-5a2d-4364-b683-9468fc344d91] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:17.480578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d3fc5ac-cad7-4744-b296-324d4afa1c8d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:17.481084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d3fc5ac-cad7-4744-b296-324d4afa1c8d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:17.481523 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d3fc5ac-cad7-4744-b296-324d4afa1c8d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:17.482241 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d3fc5ac-cad7-4744-b296-324d4afa1c8d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:17.482697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d3fc5ac-cad7-4744-b296-324d4afa1c8d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:17.483126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d3fc5ac-cad7-4744-b296-324d4afa1c8d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:17.637870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8d3fc5ac-cad7-4744-b296-324d4afa1c8d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:17.647029 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8d3fc5ac-cad7-4744-b296-324d4afa1c8d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91" status: 200 len: 1578 microversion: 2.1 time: 0.180113 Oct 29 03:40:17.647645 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3356/6490] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:17 2022] GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91 => generated 1578 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:18.672262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c8746542-3105-415b-821f-d49f370b0cc9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:18.673344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c8746542-3105-415b-821f-d49f370b0cc9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5f0bec9f-5a2d-4364-b683-9468fc344d91] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:18.680722 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] [db70aafa-b304-4ac0-be4f-1798e9789b82] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 36468. Oct 29 03:40:18.681272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c8746542-3105-415b-821f-d49f370b0cc9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:18.681575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c8746542-3105-415b-821f-d49f370b0cc9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:18.682009 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c8746542-3105-415b-821f-d49f370b0cc9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:18.682809 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c8746542-3105-415b-821f-d49f370b0cc9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:18.688657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c8746542-3105-415b-821f-d49f370b0cc9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:18.689521 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c8746542-3105-415b-821f-d49f370b0cc9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:18.691598 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] [7606be4b-8fa9-49e5-a603-02528cbf3013] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 36470. Oct 29 03:40:18.763974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-209b8091-b278-456f-afa6-9cff90b584b5 req-3b4a9082-b723-4c77-a4e4-f9ba1a0ed12d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f0bec9f-5a2d-4364-b683-9468fc344d91", "name": "network-vif-deleted", "tag": "c0e8d58c-005c-4e41-8999-9a2a82491565"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:40:18.769766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c8746542-3105-415b-821f-d49f370b0cc9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:18.775491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-209b8091-b278-456f-afa6-9cff90b584b5 req-3b4a9082-b723-4c77-a4e4-f9ba1a0ed12d service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:18.776177 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-209b8091-b278-456f-afa6-9cff90b584b5 req-3b4a9082-b723-4c77-a4e4-f9ba1a0ed12d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:18.776650 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-209b8091-b278-456f-afa6-9cff90b584b5 req-3b4a9082-b723-4c77-a4e4-f9ba1a0ed12d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:18.778064 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c8746542-3105-415b-821f-d49f370b0cc9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91" status: 200 len: 1391 microversion: 2.1 time: 0.111322 Oct 29 03:40:18.778658 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3357/6491] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:18 2022] GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91 => generated 1391 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:18.788313 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-209b8091-b278-456f-afa6-9cff90b584b5 req-3b4a9082-b723-4c77-a4e4-f9ba1a0ed12d service nova] Creating event network-vif-deleted:c0e8d58c-005c-4e41-8999-9a2a82491565 for instance 5f0bec9f-5a2d-4364-b683-9468fc344d91 on n-h1-862967-2 Oct 29 03:40:18.793313 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-209b8091-b278-456f-afa6-9cff90b584b5 req-3b4a9082-b723-4c77-a4e4-f9ba1a0ed12d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130412 Oct 29 03:40:18.793927 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3135/6492] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:40:19.802146 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-280ccc95-b22c-4791-9ef4-e9f375f5adc7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:19.802707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-280ccc95-b22c-4791-9ef4-e9f375f5adc7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5f0bec9f-5a2d-4364-b683-9468fc344d91] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:19.810252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-280ccc95-b22c-4791-9ef4-e9f375f5adc7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:19.810743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-280ccc95-b22c-4791-9ef4-e9f375f5adc7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:19.811173 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-280ccc95-b22c-4791-9ef4-e9f375f5adc7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:19.811872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-280ccc95-b22c-4791-9ef4-e9f375f5adc7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:19.812323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-280ccc95-b22c-4791-9ef4-e9f375f5adc7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:19.813010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-280ccc95-b22c-4791-9ef4-e9f375f5adc7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:19.876807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-280ccc95-b22c-4791-9ef4-e9f375f5adc7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:19.884940 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-280ccc95-b22c-4791-9ef4-e9f375f5adc7 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91" status: 200 len: 1226 microversion: 2.1 time: 0.086940 Oct 29 03:40:19.885518 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3358/6493] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:19 2022] GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:20.908996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-233604bc-e789-4de2-bc4a-2def1b42a869 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:20.909756 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-233604bc-e789-4de2-bc4a-2def1b42a869 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5f0bec9f-5a2d-4364-b683-9468fc344d91] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:20.916430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-233604bc-e789-4de2-bc4a-2def1b42a869 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:20.917073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-233604bc-e789-4de2-bc4a-2def1b42a869 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:20.917553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-233604bc-e789-4de2-bc4a-2def1b42a869 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:20.918427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-233604bc-e789-4de2-bc4a-2def1b42a869 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:20.918945 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-233604bc-e789-4de2-bc4a-2def1b42a869 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:20.919433 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-233604bc-e789-4de2-bc4a-2def1b42a869 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:20.989362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-233604bc-e789-4de2-bc4a-2def1b42a869 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:20.998562 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-233604bc-e789-4de2-bc4a-2def1b42a869 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91" status: 200 len: 1226 microversion: 2.1 time: 0.094727 Oct 29 03:40:20.999144 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3136/6494] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:20 2022] GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:22.021639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fcd1ba09-bdc9-4836-a30d-cfc89cdc238d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:22.022265 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fcd1ba09-bdc9-4836-a30d-cfc89cdc238d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5f0bec9f-5a2d-4364-b683-9468fc344d91] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:22.029638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fcd1ba09-bdc9-4836-a30d-cfc89cdc238d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:22.030126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fcd1ba09-bdc9-4836-a30d-cfc89cdc238d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:22.030565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fcd1ba09-bdc9-4836-a30d-cfc89cdc238d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:22.031263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fcd1ba09-bdc9-4836-a30d-cfc89cdc238d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:22.031719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fcd1ba09-bdc9-4836-a30d-cfc89cdc238d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:22.032306 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fcd1ba09-bdc9-4836-a30d-cfc89cdc238d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:22.096577 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fcd1ba09-bdc9-4836-a30d-cfc89cdc238d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:22.105609 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fcd1ba09-bdc9-4836-a30d-cfc89cdc238d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91" status: 200 len: 1226 microversion: 2.1 time: 0.087397 Oct 29 03:40:22.114453 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3359/6495] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:22 2022] GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:23.129009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d0511a28-5f5e-4fc2-a65f-83a9990592ab tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:23.129611 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d0511a28-5f5e-4fc2-a65f-83a9990592ab tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5f0bec9f-5a2d-4364-b683-9468fc344d91] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:23.137208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0511a28-5f5e-4fc2-a65f-83a9990592ab tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:23.137704 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0511a28-5f5e-4fc2-a65f-83a9990592ab tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:23.138149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0511a28-5f5e-4fc2-a65f-83a9990592ab tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:23.138887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0511a28-5f5e-4fc2-a65f-83a9990592ab tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:23.139346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0511a28-5f5e-4fc2-a65f-83a9990592ab tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:23.139772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0511a28-5f5e-4fc2-a65f-83a9990592ab tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:23.174567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0511a28-5f5e-4fc2-a65f-83a9990592ab tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:23.175056 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0511a28-5f5e-4fc2-a65f-83a9990592ab tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:23.175495 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0511a28-5f5e-4fc2-a65f-83a9990592ab tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:23.175963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-d0511a28-5f5e-4fc2-a65f-83a9990592ab tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lazy-loading 'fault' on Instance uuid 5f0bec9f-5a2d-4364-b683-9468fc344d91 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:40:23.218333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d0511a28-5f5e-4fc2-a65f-83a9990592ab tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:23.226747 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d0511a28-5f5e-4fc2-a65f-83a9990592ab tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91" status: 200 len: 1231 microversion: 2.1 time: 0.101922 Oct 29 03:40:23.227336 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3137/6496] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:23 2022] GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91 => generated 1231 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:24.255661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a9d75a38-6049-41f2-b8b7-dd3dd8d69184 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:24.256342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a9d75a38-6049-41f2-b8b7-dd3dd8d69184 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 5f0bec9f-5a2d-4364-b683-9468fc344d91] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:24.264421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9d75a38-6049-41f2-b8b7-dd3dd8d69184 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:24.265024 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9d75a38-6049-41f2-b8b7-dd3dd8d69184 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:24.265540 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9d75a38-6049-41f2-b8b7-dd3dd8d69184 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:24.266351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9d75a38-6049-41f2-b8b7-dd3dd8d69184 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:24.266885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9d75a38-6049-41f2-b8b7-dd3dd8d69184 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:24.267382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9d75a38-6049-41f2-b8b7-dd3dd8d69184 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:24.286591 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-a9d75a38-6049-41f2-b8b7-dd3dd8d69184 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] HTTP exception thrown: Instance 5f0bec9f-5a2d-4364-b683-9468fc344d91 could not be found. Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a9d75a38-6049-41f2-b8b7-dd3dd8d69184 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Request method failure captured: Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91 HTTP/1.1 Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJ4OGFERKLIttSSPB0-5-jXA-TX6OM8jt9EJzgHtp2De1EitDQkx8TOt6_WbUmBu_Y6n6LIcWJu35cEqto8LlaLBvd7Fx6PpdDw_gDp2R4doflmhUMo3Zw8gq8dju5JmvbgI04aG1xuqlCslUnwpoihX0XXo_veRrdoDDtMm482XfyM Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7c164fcbf0df4575b66149f2298496e3"}]}] Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-TestVolumeBootPattern-894604406 Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 187e7d6474db4b8e813ff31fcddb4034 Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 5f0bec9f-5a2d-4364-b683-9468fc344d91 could not be found. Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '5f0bec9f-5a2d-4364-b683-9468fc344d91'} Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f0bec9f-5a2d-4364-b683-9468fc344d91 could not be found. Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f0bec9f-5a2d-4364-b683-9468fc344d91 could not be found. Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:40:24.288241 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:40:24.294122 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:40:24.294122 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:40:24.294122 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:40:24.294122 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:40:24.294122 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:40:24.294122 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f0bec9f-5a2d-4364-b683-9468fc344d91 could not be found. Oct 29 03:40:24.294122 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:40:24.294122 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a9d75a38-6049-41f2-b8b7-dd3dd8d69184 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Returning 404 to user: Instance 5f0bec9f-5a2d-4364-b683-9468fc344d91 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:40:24.294122 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a9d75a38-6049-41f2-b8b7-dd3dd8d69184 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91" status: 404 len: 111 microversion: 2.1 time: 0.040012 Oct 29 03:40:24.294122 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3360/6497] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:24 2022] GET /compute/v2.1/servers/5f0bec9f-5a2d-4364-b683-9468fc344d91 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:40:30.575556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ace1b09f-83ea-425a-ac35-4336b68db46d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:30.576246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ace1b09f-83ea-425a-ac35-4336b68db46d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6145fb3f-ced5-4bdd-a889-c4eabea5d975] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:30.577343 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-1ed7f3a0-aa77-432c-89c3-a3e550005a49 req-231b441b-e99d-479e-9150-4d4806adea70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6145fb3f-ced5-4bdd-a889-c4eabea5d975", "tag": "23a3eed0-1845-4aa6-974b-3dc35c706c0d"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:40:30.584090 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ace1b09f-83ea-425a-ac35-4336b68db46d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:30.584932 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ace1b09f-83ea-425a-ac35-4336b68db46d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:30.585681 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ace1b09f-83ea-425a-ac35-4336b68db46d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:30.586521 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ace1b09f-83ea-425a-ac35-4336b68db46d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:30.587163 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ace1b09f-83ea-425a-ac35-4336b68db46d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:30.587783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ace1b09f-83ea-425a-ac35-4336b68db46d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:30.589079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1ed7f3a0-aa77-432c-89c3-a3e550005a49 req-231b441b-e99d-479e-9150-4d4806adea70 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:30.589554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1ed7f3a0-aa77-432c-89c3-a3e550005a49 req-231b441b-e99d-479e-9150-4d4806adea70 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:30.589984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1ed7f3a0-aa77-432c-89c3-a3e550005a49 req-231b441b-e99d-479e-9150-4d4806adea70 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:30.602657 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-1ed7f3a0-aa77-432c-89c3-a3e550005a49 req-231b441b-e99d-479e-9150-4d4806adea70 service nova] Creating event network-changed:23a3eed0-1845-4aa6-974b-3dc35c706c0d for instance 6145fb3f-ced5-4bdd-a889-c4eabea5d975 on n-h2-862967-2 Oct 29 03:40:30.608467 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-1ed7f3a0-aa77-432c-89c3-a3e550005a49 req-231b441b-e99d-479e-9150-4d4806adea70 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034785 Oct 29 03:40:30.609308 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3361/6498] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:40:30.615351 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ace1b09f-83ea-425a-ac35-4336b68db46d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6145fb3f-ced5-4bdd-a889-c4eabea5d975] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:40:30.709898 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ace1b09f-83ea-425a-ac35-4336b68db46d tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975" status: 204 len: 0 microversion: 2.1 time: 0.138344 Oct 29 03:40:30.710760 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3138/6499] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:40:30 2022] DELETE /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:40:30.719597 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e4420566-4778-4332-b8a1-d71a41ebcbca tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:30.720389 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e4420566-4778-4332-b8a1-d71a41ebcbca tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6145fb3f-ced5-4bdd-a889-c4eabea5d975] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:30.726824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e4420566-4778-4332-b8a1-d71a41ebcbca tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:30.727413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e4420566-4778-4332-b8a1-d71a41ebcbca tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:30.727920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e4420566-4778-4332-b8a1-d71a41ebcbca tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:30.728717 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e4420566-4778-4332-b8a1-d71a41ebcbca tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:30.729244 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e4420566-4778-4332-b8a1-d71a41ebcbca tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:30.729738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e4420566-4778-4332-b8a1-d71a41ebcbca tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:30.872403 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e4420566-4778-4332-b8a1-d71a41ebcbca tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:30.880304 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e4420566-4778-4332-b8a1-d71a41ebcbca tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975" status: 200 len: 1576 microversion: 2.1 time: 0.164945 Oct 29 03:40:30.880963 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3362/6500] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:30 2022] GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:40:31.905852 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d0f8b76b-1bef-495c-a55b-b8bdf6b77c73 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:31.906733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d0f8b76b-1bef-495c-a55b-b8bdf6b77c73 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6145fb3f-ced5-4bdd-a889-c4eabea5d975] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:31.914507 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0f8b76b-1bef-495c-a55b-b8bdf6b77c73 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:31.915040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0f8b76b-1bef-495c-a55b-b8bdf6b77c73 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:31.915537 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0f8b76b-1bef-495c-a55b-b8bdf6b77c73 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:31.916499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0f8b76b-1bef-495c-a55b-b8bdf6b77c73 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:31.917047 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0f8b76b-1bef-495c-a55b-b8bdf6b77c73 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:31.917458 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d0f8b76b-1bef-495c-a55b-b8bdf6b77c73 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:32.080847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d0f8b76b-1bef-495c-a55b-b8bdf6b77c73 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:32.089194 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d0f8b76b-1bef-495c-a55b-b8bdf6b77c73 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975" status: 200 len: 1576 microversion: 2.1 time: 0.188675 Oct 29 03:40:32.089778 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3139/6501] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:31 2022] GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975 => generated 1576 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:32.694635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-9ba8e5e6-c93d-41d8-9dc4-428c972f0dd7 req-c4b913ee-36c7-48cf-a8f4-7b6588a036ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6145fb3f-ced5-4bdd-a889-c4eabea5d975", "name": "network-vif-deleted", "tag": "23a3eed0-1845-4aa6-974b-3dc35c706c0d"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:40:32.706675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9ba8e5e6-c93d-41d8-9dc4-428c972f0dd7 req-c4b913ee-36c7-48cf-a8f4-7b6588a036ae service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:32.707258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9ba8e5e6-c93d-41d8-9dc4-428c972f0dd7 req-c4b913ee-36c7-48cf-a8f4-7b6588a036ae service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:32.707785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9ba8e5e6-c93d-41d8-9dc4-428c972f0dd7 req-c4b913ee-36c7-48cf-a8f4-7b6588a036ae service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:32.721490 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-9ba8e5e6-c93d-41d8-9dc4-428c972f0dd7 req-c4b913ee-36c7-48cf-a8f4-7b6588a036ae service nova] Creating event network-vif-deleted:23a3eed0-1845-4aa6-974b-3dc35c706c0d for instance 6145fb3f-ced5-4bdd-a889-c4eabea5d975 on n-h2-862967-2 Oct 29 03:40:32.726757 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-9ba8e5e6-c93d-41d8-9dc4-428c972f0dd7 req-c4b913ee-36c7-48cf-a8f4-7b6588a036ae service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036347 Oct 29 03:40:32.727392 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3363/6502] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:40:33.112726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-18864c4c-6e52-4404-a86d-0d68d95d1ca6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:33.113357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-18864c4c-6e52-4404-a86d-0d68d95d1ca6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6145fb3f-ced5-4bdd-a889-c4eabea5d975] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:33.121108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18864c4c-6e52-4404-a86d-0d68d95d1ca6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:33.121896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18864c4c-6e52-4404-a86d-0d68d95d1ca6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:33.122347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18864c4c-6e52-4404-a86d-0d68d95d1ca6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:33.123056 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18864c4c-6e52-4404-a86d-0d68d95d1ca6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:33.123704 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18864c4c-6e52-4404-a86d-0d68d95d1ca6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:33.124144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-18864c4c-6e52-4404-a86d-0d68d95d1ca6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:33.188181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-18864c4c-6e52-4404-a86d-0d68d95d1ca6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:33.196232 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-18864c4c-6e52-4404-a86d-0d68d95d1ca6 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975" status: 200 len: 1225 microversion: 2.1 time: 0.087469 Oct 29 03:40:33.196823 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3140/6503] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:33 2022] GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:34.220541 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c9f2b4a2-027c-48f3-91d2-982825b57852 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:34.221282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c9f2b4a2-027c-48f3-91d2-982825b57852 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6145fb3f-ced5-4bdd-a889-c4eabea5d975] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:34.228921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9f2b4a2-027c-48f3-91d2-982825b57852 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:34.229409 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9f2b4a2-027c-48f3-91d2-982825b57852 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:34.229839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9f2b4a2-027c-48f3-91d2-982825b57852 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:34.230538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9f2b4a2-027c-48f3-91d2-982825b57852 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:34.230988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9f2b4a2-027c-48f3-91d2-982825b57852 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:34.231409 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c9f2b4a2-027c-48f3-91d2-982825b57852 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:34.303686 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c9f2b4a2-027c-48f3-91d2-982825b57852 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:34.313017 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c9f2b4a2-027c-48f3-91d2-982825b57852 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975" status: 200 len: 1225 microversion: 2.1 time: 0.097155 Oct 29 03:40:34.313797 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3364/6504] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:34 2022] GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:35.335645 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5f57828d-59ea-409a-b8d5-305ecb7104d9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:35.336212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5f57828d-59ea-409a-b8d5-305ecb7104d9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6145fb3f-ced5-4bdd-a889-c4eabea5d975] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:35.343046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f57828d-59ea-409a-b8d5-305ecb7104d9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:35.343544 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f57828d-59ea-409a-b8d5-305ecb7104d9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:35.343989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f57828d-59ea-409a-b8d5-305ecb7104d9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:35.344708 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f57828d-59ea-409a-b8d5-305ecb7104d9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:35.345273 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f57828d-59ea-409a-b8d5-305ecb7104d9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:35.345636 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5f57828d-59ea-409a-b8d5-305ecb7104d9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:35.407482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5f57828d-59ea-409a-b8d5-305ecb7104d9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:35.415733 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5f57828d-59ea-409a-b8d5-305ecb7104d9 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975" status: 200 len: 1225 microversion: 2.1 time: 0.084132 Oct 29 03:40:35.416310 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3141/6505] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:35 2022] GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:40:36.439739 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a80a1502-4f84-4a02-9ee1-2d45a68b5db1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:36.440249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a80a1502-4f84-4a02-9ee1-2d45a68b5db1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6145fb3f-ced5-4bdd-a889-c4eabea5d975] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:36.447696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a80a1502-4f84-4a02-9ee1-2d45a68b5db1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:36.448186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a80a1502-4f84-4a02-9ee1-2d45a68b5db1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:36.448619 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a80a1502-4f84-4a02-9ee1-2d45a68b5db1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:36.449348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a80a1502-4f84-4a02-9ee1-2d45a68b5db1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:36.449804 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a80a1502-4f84-4a02-9ee1-2d45a68b5db1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:36.450228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a80a1502-4f84-4a02-9ee1-2d45a68b5db1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:36.513676 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a80a1502-4f84-4a02-9ee1-2d45a68b5db1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '187e7d6474db4b8e813ff31fcddb4034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c164fcbf0df4575b66149f2298496e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:40:36.522840 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a80a1502-4f84-4a02-9ee1-2d45a68b5db1 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975" status: 200 len: 1225 microversion: 2.1 time: 0.087094 Oct 29 03:40:36.523434 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3365/6506] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:36 2022] GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:40:37.545996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bda0d351-03af-4fa8-880d-cbc817b8eff8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:37.546603 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bda0d351-03af-4fa8-880d-cbc817b8eff8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6145fb3f-ced5-4bdd-a889-c4eabea5d975] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:37.553995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bda0d351-03af-4fa8-880d-cbc817b8eff8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:37.554491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bda0d351-03af-4fa8-880d-cbc817b8eff8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:37.554933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bda0d351-03af-4fa8-880d-cbc817b8eff8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:37.555633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bda0d351-03af-4fa8-880d-cbc817b8eff8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:37.556097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bda0d351-03af-4fa8-880d-cbc817b8eff8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:37.556561 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bda0d351-03af-4fa8-880d-cbc817b8eff8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:37.570198 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-bda0d351-03af-4fa8-880d-cbc817b8eff8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] HTTP exception thrown: Instance 6145fb3f-ced5-4bdd-a889-c4eabea5d975 could not be found. Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bda0d351-03af-4fa8-880d-cbc817b8eff8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Request method failure captured: Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975 HTTP/1.1 Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJ4OGFERKLIttSSPB0-5-jXA-TX6OM8jt9EJzgHtp2De1EitDQkx8TOt6_WbUmBu_Y6n6LIcWJu35cEqto8LlaLBvd7Fx6PpdDw_gDp2R4doflmhUMo3Zw8gq8dju5JmvbgI04aG1xuqlCslUnwpoihX0XXo_veRrdoDDtMm482XfyM Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7c164fcbf0df4575b66149f2298496e3"}]}] Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestVolumeBootPattern-894604406 Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 187e7d6474db4b8e813ff31fcddb4034 Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 6145fb3f-ced5-4bdd-a889-c4eabea5d975 could not be found. Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '6145fb3f-ced5-4bdd-a889-c4eabea5d975'} Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6145fb3f-ced5-4bdd-a889-c4eabea5d975 could not be found. Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6145fb3f-ced5-4bdd-a889-c4eabea5d975 could not be found. Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:40:37.571853 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:40:37.575672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:40:37.575672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:40:37.575672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:40:37.575672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:40:37.575672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:40:37.575672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6145fb3f-ced5-4bdd-a889-c4eabea5d975 could not be found. Oct 29 03:40:37.575672 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:40:37.575672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bda0d351-03af-4fa8-880d-cbc817b8eff8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Returning 404 to user: Instance 6145fb3f-ced5-4bdd-a889-c4eabea5d975 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:40:37.575672 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bda0d351-03af-4fa8-880d-cbc817b8eff8 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975" status: 404 len: 111 microversion: 2.1 time: 0.031338 Oct 29 03:40:37.575672 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3142/6507] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:37 2022] GET /compute/v2.1/servers/6145fb3f-ced5-4bdd-a889-c4eabea5d975 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:40:38.056638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b5e44abf-1b8b-470a-b492-2caa68092a6c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:38.057158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b5e44abf-1b8b-470a-b492-2caa68092a6c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:38.064594 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5e44abf-1b8b-470a-b492-2caa68092a6c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:38.065328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5e44abf-1b8b-470a-b492-2caa68092a6c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:38.066189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5e44abf-1b8b-470a-b492-2caa68092a6c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:38.067234 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5e44abf-1b8b-470a-b492-2caa68092a6c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:38.067985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5e44abf-1b8b-470a-b492-2caa68092a6c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:38.068602 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5e44abf-1b8b-470a-b492-2caa68092a6c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:38.084342 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-b5e44abf-1b8b-470a-b492-2caa68092a6c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] HTTP exception thrown: Instance 6a658824-4f09-4798-9159-20c340564277 could not be found. Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b5e44abf-1b8b-470a-b492-2caa68092a6c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Request method failure captured: Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 HTTP/1.1 Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXJ4OGFERKLIttSSPB0-5-jXA-TX6OM8jt9EJzgHtp2De1EitDQkx8TOt6_WbUmBu_Y6n6LIcWJu35cEqto8LlaLBvd7Fx6PpdDw_gDp2R4doflmhUMo3Zw8gq8dju5JmvbgI04aG1xuqlCslUnwpoihX0XXo_veRrdoDDtMm482XfyM Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7c164fcbf0df4575b66149f2298496e3"}]}] Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-TestVolumeBootPattern-894604406 Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 187e7d6474db4b8e813ff31fcddb4034 Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 6a658824-4f09-4798-9159-20c340564277 could not be found. Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '6a658824-4f09-4798-9159-20c340564277'} Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a658824-4f09-4798-9159-20c340564277 could not be found. Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:40:38.086101 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:40:38.090628 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a658824-4f09-4798-9159-20c340564277 could not be found. Oct 29 03:40:38.090628 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:40:38.090628 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:40:38.090628 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:40:38.090628 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:40:38.090628 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:40:38.090628 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:40:38.090628 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:40:38.090628 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:40:38.090628 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a658824-4f09-4798-9159-20c340564277 could not be found. Oct 29 03:40:38.090628 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:40:38.090628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b5e44abf-1b8b-470a-b492-2caa68092a6c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Returning 404 to user: Instance 6a658824-4f09-4798-9159-20c340564277 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:40:38.090628 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b5e44abf-1b8b-470a-b492-2caa68092a6c tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277" status: 404 len: 111 microversion: 2.1 time: 0.037348 Oct 29 03:40:38.090628 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3366/6508] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:40:38 2022] DELETE /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:40:38.096612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-55329b01-92a2-406d-9752-1383ea5375c0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:38.097244 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-55329b01-92a2-406d-9752-1383ea5375c0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] [instance: 6a658824-4f09-4798-9159-20c340564277] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:40:38.103667 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55329b01-92a2-406d-9752-1383ea5375c0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:38.104205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55329b01-92a2-406d-9752-1383ea5375c0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:38.104719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55329b01-92a2-406d-9752-1383ea5375c0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:38.105400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55329b01-92a2-406d-9752-1383ea5375c0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:40:38.105872 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55329b01-92a2-406d-9752-1383ea5375c0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:40:38.106305 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55329b01-92a2-406d-9752-1383ea5375c0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:40:38.120296 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-55329b01-92a2-406d-9752-1383ea5375c0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] HTTP exception thrown: Instance 6a658824-4f09-4798-9159-20c340564277 could not be found. Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-55329b01-92a2-406d-9752-1383ea5375c0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Request method failure captured: Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 HTTP/1.1 Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXJ4OGFERKLIttSSPB0-5-jXA-TX6OM8jt9EJzgHtp2De1EitDQkx8TOt6_WbUmBu_Y6n6LIcWJu35cEqto8LlaLBvd7Fx6PpdDw_gDp2R4doflmhUMo3Zw8gq8dju5JmvbgI04aG1xuqlCslUnwpoihX0XXo_veRrdoDDtMm482XfyM Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7c164fcbf0df4575b66149f2298496e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7c164fcbf0df4575b66149f2298496e3"}]}] Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestVolumeBootPattern-894604406 Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 7c164fcbf0df4575b66149f2298496e3 Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestVolumeBootPattern-894604406 Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 187e7d6474db4b8e813ff31fcddb4034 Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestVolumeBootPattern-894604406-project Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 6a658824-4f09-4798-9159-20c340564277 could not be found. Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '6a658824-4f09-4798-9159-20c340564277'} Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a658824-4f09-4798-9159-20c340564277 could not be found. Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a658824-4f09-4798-9159-20c340564277 could not be found. Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:40:38.122214 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:40:38.125970 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:40:38.125970 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:40:38.125970 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:40:38.125970 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:40:38.125970 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:40:38.125970 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a658824-4f09-4798-9159-20c340564277 could not be found. Oct 29 03:40:38.125970 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:40:38.125970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-55329b01-92a2-406d-9752-1383ea5375c0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Returning 404 to user: Instance 6a658824-4f09-4798-9159-20c340564277 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:40:38.125970 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-55329b01-92a2-406d-9752-1383ea5375c0 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277" status: 404 len: 111 microversion: 2.1 time: 0.031083 Oct 29 03:40:38.125970 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3143/6509] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:40:38 2022] GET /compute/v2.1/servers/6a658824-4f09-4798-9159-20c340564277 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:40:41.575711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9e570972-c5f9-4f6c-88fe-ed14155b3fa5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] Calling method '.version_select at 0x7ff05975adc0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:40:41.620222 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9e570972-c5f9-4f6c-88fe-ed14155b3fa5 tempest-TestVolumeBootPattern-894604406 tempest-TestVolumeBootPattern-894604406-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1499884373" status: 202 len: 0 microversion: 2.1 time: 0.049717 Oct 29 03:40:41.621079 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3367/6510] 10.222.0.46 () {58 vars in 1263 bytes} [Sat Oct 29 03:40:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1499884373 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:41:00.238155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:41:00.238899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:41:00.354755 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a2759303-379d-45b4-be0c-88fafcc3f385 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1084480830", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:41:00.589535 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-a2759303-379d-45b4-be0c-88fafcc3f385 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] validate_networks() for None {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:41:00.785274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-a2759303-379d-45b4-be0c-88fafcc3f385 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:41:00.785704 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-a2759303-379d-45b4-be0c-88fafcc3f385 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:41:00.786183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-a2759303-379d-45b4-be0c-88fafcc3f385 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:41:00.786598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-a2759303-379d-45b4-be0c-88fafcc3f385 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:41:00.787036 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-a2759303-379d-45b4-be0c-88fafcc3f385 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:41:00.796637 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2759303-379d-45b4-be0c-88fafcc3f385 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:00.797150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2759303-379d-45b4-be0c-88fafcc3f385 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:00.797598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2759303-379d-45b4-be0c-88fafcc3f385 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:00.798344 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2759303-379d-45b4-be0c-88fafcc3f385 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:00.798804 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2759303-379d-45b4-be0c-88fafcc3f385 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:00.799207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a2759303-379d-45b4-be0c-88fafcc3f385 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:00.816421 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-a2759303-379d-45b4-be0c-88fafcc3f385 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Getting quotas for project e81cb8e4207247429775a9f964af46c6. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:41:00.821822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-a2759303-379d-45b4-be0c-88fafcc3f385 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Getting quotas for user dc963ffa02614cad8e569769c0ae1f31 and project e81cb8e4207247429775a9f964af46c6. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:41:00.834570 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a2759303-379d-45b4-be0c-88fafcc3f385 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:41:00.836881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a2759303-379d-45b4-be0c-88fafcc3f385 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] [instance: 221a2347-720a-46c5-a690-6dd9c4b971d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:41:00.894102 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a2759303-379d-45b4-be0c-88fafcc3f385 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660960 Oct 29 03:41:00.894791 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3144/6511] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:41:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:41:00.906003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:41:00.906864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:41:00.911142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2f1875fb-c408-496c-9560-95c8bdd1c261 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:00.911760 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2f1875fb-c408-496c-9560-95c8bdd1c261 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] [instance: 221a2347-720a-46c5-a690-6dd9c4b971d4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:00.971256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2f1875fb-c408-496c-9560-95c8bdd1c261 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc963ffa02614cad8e569769c0ae1f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e81cb8e4207247429775a9f964af46c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:00.983907 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2f1875fb-c408-496c-9560-95c8bdd1c261 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] 10.222.0.46 "GET /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4" status: 200 len: 1222 microversion: 2.1 time: 0.079700 Oct 29 03:41:00.984512 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3368/6512] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:00 2022] GET /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4 => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:02.011081 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7347e797-3596-45ec-9053-5f0dc5e63707 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:02.012423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7347e797-3596-45ec-9053-5f0dc5e63707 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] [instance: 221a2347-720a-46c5-a690-6dd9c4b971d4] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:02.019860 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7347e797-3596-45ec-9053-5f0dc5e63707 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:02.020371 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7347e797-3596-45ec-9053-5f0dc5e63707 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:02.021084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7347e797-3596-45ec-9053-5f0dc5e63707 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:02.021875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7347e797-3596-45ec-9053-5f0dc5e63707 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:02.022538 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7347e797-3596-45ec-9053-5f0dc5e63707 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:02.023109 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7347e797-3596-45ec-9053-5f0dc5e63707 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:02.096310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7347e797-3596-45ec-9053-5f0dc5e63707 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc963ffa02614cad8e569769c0ae1f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e81cb8e4207247429775a9f964af46c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:02.106590 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7347e797-3596-45ec-9053-5f0dc5e63707 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] 10.222.0.46 "GET /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4" status: 200 len: 1292 microversion: 2.1 time: 0.102081 Oct 29 03:41:02.107240 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3145/6513] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:02 2022] GET /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4 => generated 1292 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:03.131504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-36df700b-ebde-4d3c-8754-97a665837731 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:03.132896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-36df700b-ebde-4d3c-8754-97a665837731 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] [instance: 221a2347-720a-46c5-a690-6dd9c4b971d4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:03.140087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36df700b-ebde-4d3c-8754-97a665837731 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:03.140601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36df700b-ebde-4d3c-8754-97a665837731 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:03.141043 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36df700b-ebde-4d3c-8754-97a665837731 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:03.141760 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36df700b-ebde-4d3c-8754-97a665837731 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:03.142391 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36df700b-ebde-4d3c-8754-97a665837731 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:03.142820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36df700b-ebde-4d3c-8754-97a665837731 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:03.457111 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-36df700b-ebde-4d3c-8754-97a665837731 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc963ffa02614cad8e569769c0ae1f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e81cb8e4207247429775a9f964af46c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:03.465641 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-36df700b-ebde-4d3c-8754-97a665837731 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] 10.222.0.46 "GET /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4" status: 200 len: 1322 microversion: 2.1 time: 0.338019 Oct 29 03:41:03.466245 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3369/6514] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:03 2022] GET /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4 => generated 1322 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:03.832896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-5804d01a-7e77-4daf-8933-d66715cfd2fa req-3e7e96d0-c104-4afb-b869-ad564eea65c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "221a2347-720a-46c5-a690-6dd9c4b971d4", "tag": "2c028645-78f9-465c-b018-b08ee0904818"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:41:03.843974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-5804d01a-7e77-4daf-8933-d66715cfd2fa req-3e7e96d0-c104-4afb-b869-ad564eea65c5 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:03.844531 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-5804d01a-7e77-4daf-8933-d66715cfd2fa req-3e7e96d0-c104-4afb-b869-ad564eea65c5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:03.844985 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-5804d01a-7e77-4daf-8933-d66715cfd2fa req-3e7e96d0-c104-4afb-b869-ad564eea65c5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:03.858298 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-5804d01a-7e77-4daf-8933-d66715cfd2fa req-3e7e96d0-c104-4afb-b869-ad564eea65c5 service nova] Creating event network-changed:2c028645-78f9-465c-b018-b08ee0904818 for instance 221a2347-720a-46c5-a690-6dd9c4b971d4 on n-h2-862967-2 Oct 29 03:41:03.863530 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-5804d01a-7e77-4daf-8933-d66715cfd2fa req-3e7e96d0-c104-4afb-b869-ad564eea65c5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035072 Oct 29 03:41:03.864190 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3146/6515] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:41:04.494608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d77eeca0-acbe-433c-8297-ea4fe05b40eb tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:04.495610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d77eeca0-acbe-433c-8297-ea4fe05b40eb tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] [instance: 221a2347-720a-46c5-a690-6dd9c4b971d4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:04.508047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d77eeca0-acbe-433c-8297-ea4fe05b40eb tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:04.508555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d77eeca0-acbe-433c-8297-ea4fe05b40eb tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:04.509030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d77eeca0-acbe-433c-8297-ea4fe05b40eb tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:04.509729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d77eeca0-acbe-433c-8297-ea4fe05b40eb tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:04.510183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d77eeca0-acbe-433c-8297-ea4fe05b40eb tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:04.510606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d77eeca0-acbe-433c-8297-ea4fe05b40eb tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:04.656757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d77eeca0-acbe-433c-8297-ea4fe05b40eb tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc963ffa02614cad8e569769c0ae1f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e81cb8e4207247429775a9f964af46c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:04.665038 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d77eeca0-acbe-433c-8297-ea4fe05b40eb tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] 10.222.0.46 "GET /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4" status: 200 len: 1322 microversion: 2.1 time: 0.177329 Oct 29 03:41:04.665643 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3370/6516] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:04 2022] GET /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:05.689301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4c870a8f-0351-46da-b5ed-7fa0c1acbf0c tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:05.689946 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4c870a8f-0351-46da-b5ed-7fa0c1acbf0c tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] [instance: 221a2347-720a-46c5-a690-6dd9c4b971d4] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:05.696182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c870a8f-0351-46da-b5ed-7fa0c1acbf0c tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:05.696726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c870a8f-0351-46da-b5ed-7fa0c1acbf0c tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:05.697175 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c870a8f-0351-46da-b5ed-7fa0c1acbf0c tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:05.697863 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c870a8f-0351-46da-b5ed-7fa0c1acbf0c tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:05.698301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c870a8f-0351-46da-b5ed-7fa0c1acbf0c tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:05.698732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4c870a8f-0351-46da-b5ed-7fa0c1acbf0c tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:05.840075 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4c870a8f-0351-46da-b5ed-7fa0c1acbf0c tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc963ffa02614cad8e569769c0ae1f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e81cb8e4207247429775a9f964af46c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:05.848558 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4c870a8f-0351-46da-b5ed-7fa0c1acbf0c tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] 10.222.0.46 "GET /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4" status: 200 len: 1322 microversion: 2.1 time: 0.164543 Oct 29 03:41:05.849174 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3147/6517] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:05 2022] GET /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:06.872106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b4340abb-93a0-40bf-9525-1c4d670353a6 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:06.872709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b4340abb-93a0-40bf-9525-1c4d670353a6 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] [instance: 221a2347-720a-46c5-a690-6dd9c4b971d4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:06.880097 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4340abb-93a0-40bf-9525-1c4d670353a6 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:06.880608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4340abb-93a0-40bf-9525-1c4d670353a6 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:06.881031 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4340abb-93a0-40bf-9525-1c4d670353a6 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:06.881783 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4340abb-93a0-40bf-9525-1c4d670353a6 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:06.882233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4340abb-93a0-40bf-9525-1c4d670353a6 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:06.882654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4340abb-93a0-40bf-9525-1c4d670353a6 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:07.021028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b4340abb-93a0-40bf-9525-1c4d670353a6 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc963ffa02614cad8e569769c0ae1f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e81cb8e4207247429775a9f964af46c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:07.030303 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b4340abb-93a0-40bf-9525-1c4d670353a6 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] 10.222.0.46 "GET /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4" status: 200 len: 1322 microversion: 2.1 time: 0.162561 Oct 29 03:41:07.031072 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3371/6518] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:06 2022] GET /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:08.054297 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e835ab6b-d40d-42b6-b858-2e881edd9e35 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:08.054911 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e835ab6b-d40d-42b6-b858-2e881edd9e35 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] [instance: 221a2347-720a-46c5-a690-6dd9c4b971d4] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:08.062624 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e835ab6b-d40d-42b6-b858-2e881edd9e35 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:08.062999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e835ab6b-d40d-42b6-b858-2e881edd9e35 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:08.063437 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e835ab6b-d40d-42b6-b858-2e881edd9e35 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:08.064161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e835ab6b-d40d-42b6-b858-2e881edd9e35 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:08.064665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e835ab6b-d40d-42b6-b858-2e881edd9e35 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:08.065107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e835ab6b-d40d-42b6-b858-2e881edd9e35 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:08.203646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e835ab6b-d40d-42b6-b858-2e881edd9e35 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc963ffa02614cad8e569769c0ae1f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e81cb8e4207247429775a9f964af46c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:08.215881 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e835ab6b-d40d-42b6-b858-2e881edd9e35 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] 10.222.0.46 "GET /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4" status: 200 len: 1322 microversion: 2.1 time: 0.165454 Oct 29 03:41:08.216729 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3148/6519] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:08 2022] GET /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:08.452183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-cad7af6c-b2da-4773-9779-9dfae1be8f56 req-973cde33-1d61-42e3-a1b2-ff7e1983a6bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "221a2347-720a-46c5-a690-6dd9c4b971d4", "name": "network-vif-plugged", "status": "completed", "tag": "2c028645-78f9-465c-b018-b08ee0904818"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:41:08.463853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-cad7af6c-b2da-4773-9779-9dfae1be8f56 req-973cde33-1d61-42e3-a1b2-ff7e1983a6bc service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:08.464922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-cad7af6c-b2da-4773-9779-9dfae1be8f56 req-973cde33-1d61-42e3-a1b2-ff7e1983a6bc service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:08.465351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-cad7af6c-b2da-4773-9779-9dfae1be8f56 req-973cde33-1d61-42e3-a1b2-ff7e1983a6bc service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:08.477571 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-cad7af6c-b2da-4773-9779-9dfae1be8f56 req-973cde33-1d61-42e3-a1b2-ff7e1983a6bc service nova] Creating event network-vif-plugged:2c028645-78f9-465c-b018-b08ee0904818 for instance 221a2347-720a-46c5-a690-6dd9c4b971d4 on n-h2-862967-2 Oct 29 03:41:08.483079 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-cad7af6c-b2da-4773-9779-9dfae1be8f56 req-973cde33-1d61-42e3-a1b2-ff7e1983a6bc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034849 Oct 29 03:41:08.483913 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3372/6520] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:41:09.249653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fed3fb1a-b629-4248-a682-ca9a1f240e07 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:09.251097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fed3fb1a-b629-4248-a682-ca9a1f240e07 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] [instance: 221a2347-720a-46c5-a690-6dd9c4b971d4] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:09.262985 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fed3fb1a-b629-4248-a682-ca9a1f240e07 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:09.263474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fed3fb1a-b629-4248-a682-ca9a1f240e07 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:09.263928 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fed3fb1a-b629-4248-a682-ca9a1f240e07 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:09.264713 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fed3fb1a-b629-4248-a682-ca9a1f240e07 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:09.265236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fed3fb1a-b629-4248-a682-ca9a1f240e07 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:09.266133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fed3fb1a-b629-4248-a682-ca9a1f240e07 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:09.403381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fed3fb1a-b629-4248-a682-ca9a1f240e07 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc963ffa02614cad8e569769c0ae1f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e81cb8e4207247429775a9f964af46c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:09.411778 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fed3fb1a-b629-4248-a682-ca9a1f240e07 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] 10.222.0.46 "GET /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4" status: 200 len: 1322 microversion: 2.1 time: 0.169702 Oct 29 03:41:09.412330 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3149/6521] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:09 2022] GET /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:10.439915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7418d6ca-48c7-42e0-a347-395740df7760 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:10.441217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7418d6ca-48c7-42e0-a347-395740df7760 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] [instance: 221a2347-720a-46c5-a690-6dd9c4b971d4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:10.453262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7418d6ca-48c7-42e0-a347-395740df7760 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:10.454086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7418d6ca-48c7-42e0-a347-395740df7760 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:10.454850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7418d6ca-48c7-42e0-a347-395740df7760 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:10.455983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7418d6ca-48c7-42e0-a347-395740df7760 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:10.456815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7418d6ca-48c7-42e0-a347-395740df7760 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:10.457539 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7418d6ca-48c7-42e0-a347-395740df7760 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:10.608096 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7418d6ca-48c7-42e0-a347-395740df7760 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc963ffa02614cad8e569769c0ae1f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e81cb8e4207247429775a9f964af46c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:10.619883 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7418d6ca-48c7-42e0-a347-395740df7760 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] 10.222.0.46 "GET /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4" status: 200 len: 1472 microversion: 2.1 time: 0.187127 Oct 29 03:41:10.620475 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3373/6522] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:10 2022] GET /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4 => generated 1472 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:10.696239 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-860ce8da-2fbd-4ec1-b053-e6533ebe61dc tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Calling method '.version_select at 0x7ff052bf8ca0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:10.762829 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-860ce8da-2fbd-4ec1-b053-e6533ebe61dc tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/990985d57ed14d1fa10b716a88b0185f" status: 200 len: 371 microversion: 2.1 time: 0.121819 Oct 29 03:41:10.763404 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3150/6523] 10.222.0.46 () {58 vars in 1242 bytes} [Sat Oct 29 03:41:10 2022] GET /compute/v2.1/os-quota-sets/990985d57ed14d1fa10b716a88b0185f => generated 371 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:41:10.775688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-caa50a19-1da6-4e02-a254-315d0b6d639c tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-464255460", "id": 1121087676, "os-flavor-access:is_public": "True"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:41:10.795117 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-caa50a19-1da6-4e02-a254-315d0b6d639c tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.023134 Oct 29 03:41:10.795772 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3374/6524] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:41:10 2022] POST /compute/v2.1/flavors => generated 437 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:41:10.808373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-65b9beeb-6612-47b9-8d63-3962a0687bc9 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1121087676"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:41:10.810766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-65b9beeb-6612-47b9-8d63-3962a0687bc9 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] [instance: 221a2347-720a-46c5-a690-6dd9c4b971d4] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:10.813008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:41:10.818311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65b9beeb-6612-47b9-8d63-3962a0687bc9 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:10.818798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65b9beeb-6612-47b9-8d63-3962a0687bc9 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:10.819248 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65b9beeb-6612-47b9-8d63-3962a0687bc9 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:10.819946 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65b9beeb-6612-47b9-8d63-3962a0687bc9 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:10.820401 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65b9beeb-6612-47b9-8d63-3962a0687bc9 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:10.820854 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65b9beeb-6612-47b9-8d63-3962a0687bc9 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:10.966448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-65b9beeb-6612-47b9-8d63-3962a0687bc9 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f525401af2a241aeaeeea7f3deb2d0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990985d57ed14d1fa10b716a88b0185f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:10.972957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-65b9beeb-6612-47b9-8d63-3962a0687bc9 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] [instance: 221a2347-720a-46c5-a690-6dd9c4b971d4] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-464255460 {{(pid=127125) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 03:41:10.980104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65b9beeb-6612-47b9-8d63-3962a0687bc9 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:10.980623 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65b9beeb-6612-47b9-8d63-3962a0687bc9 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:10.981070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65b9beeb-6612-47b9-8d63-3962a0687bc9 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:10.981791 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65b9beeb-6612-47b9-8d63-3962a0687bc9 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:10.982247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65b9beeb-6612-47b9-8d63-3962a0687bc9 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:10.982675 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-65b9beeb-6612-47b9-8d63-3962a0687bc9 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:11.007294 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-65b9beeb-6612-47b9-8d63-3962a0687bc9 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Getting quotas for project e81cb8e4207247429775a9f964af46c6. Resources: {'cores', 'ram'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:41:11.013001 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-65b9beeb-6612-47b9-8d63-3962a0687bc9 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Getting quotas for user dc963ffa02614cad8e569769c0ae1f31 and project e81cb8e4207247429775a9f964af46c6. Resources: {'cores', 'ram'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:41:11.027671 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.compute.api [None req-65b9beeb-6612-47b9-8d63-3962a0687bc9 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] ram quota exceeded for 990985d57ed14d1fa10b716a88b0185f, tried to resize instance. Oct 29 03:41:11.028212 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-65b9beeb-6612-47b9-8d63-3962a0687bc9 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-65b9beeb-6612-47b9-8d63-3962a0687bc9 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Request method failure captured: Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4/action HTTP/1.1 Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 39 Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKDMhUwVEFq7QJ88fyJmsYUiQTduipFTumieB_y3EdADkgAeRpQwDuVwfBJsDUDhFkxvxKks79vNT8h1a2JWDWVsqe2Pxd_DO2Te0XOO6yOABObzUzIBVI9aX1Ivv08jcOIPw3242Ri8w-sUjDxUv1JCXug--ajuhaNP1a82b0okgu0 Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 990985d57ed14d1fa10b716a88b0185f Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-676438593 Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: X-Role: admin,reader,member Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: admin,reader,member Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/990985d57ed14d1fa10b716a88b0185f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/990985d57ed14d1fa10b716a88b0185f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_990985d57ed14d1fa10b716a88b0185f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/990985d57ed14d1fa10b716a88b0185f"}]}] Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersAdminNegativeTestJSON-676438593 Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 990985d57ed14d1fa10b716a88b0185f Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-676438593 Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersAdminNegativeTestJSON-676438593-project-admin Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: f525401af2a241aeaeeea7f3deb2d0b8 Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersAdminNegativeTestJSON-676438593-project-admin Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: {"resize": {"flavorRef": "1121087676"}} Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '221a2347-720a-46c5-a690-6dd9c4b971d4', 'body': {'resize': {'flavorRef': '1121087676'}}} Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:41:11.030360 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-65b9beeb-6612-47b9-8d63-3962a0687bc9 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-65b9beeb-6612-47b9-8d63-3962a0687bc9 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4/action" status: 403 len: 118 microversion: 2.1 time: 0.227413 Oct 29 03:41:11.035113 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3151/6525] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:41:10 2022] POST /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4/action => generated 118 bytes in 229 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:41:11.040773 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7ea958cb-ff61-43fe-9692-7e4c776282a9 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:11.043805 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:41:11.060710 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7ea958cb-ff61-43fe-9692-7e4c776282a9 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/1121087676" status: 202 len: 0 microversion: 2.1 time: 0.023500 Oct 29 03:41:11.061401 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3375/6526] 10.222.0.46 () {58 vars in 1161 bytes} [Sat Oct 29 03:41:11 2022] DELETE /compute/v2.1/flavors/1121087676 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:41:11.069723 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-871ae7c1-6417-4fca-a65b-462a958cf5e3 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:11.090038 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-871ae7c1-6417-4fca-a65b-462a958cf5e3 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024098 Oct 29 03:41:11.090621 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3152/6527] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 03:41:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:11.111586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-51903784-6d8a-45b4-99ae-636c0e100759 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Calling method '.version_select at 0x7ff0533de940>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:11.188880 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-51903784-6d8a-45b4-99ae-636c0e100759 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] 10.222.0.46 "GET /compute/v2.1/os-quota-sets/990985d57ed14d1fa10b716a88b0185f" status: 200 len: 371 microversion: 2.1 time: 0.081251 Oct 29 03:41:11.189476 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3376/6528] 10.222.0.46 () {58 vars in 1242 bytes} [Sat Oct 29 03:41:11 2022] GET /compute/v2.1/os-quota-sets/990985d57ed14d1fa10b716a88b0185f => generated 371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:41:11.201820 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-387a9b76-7047-4881-83ac-f5ddaeeaeaa8 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1005336009", "id": 341563440, "os-flavor-access:is_public": "True"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:41:11.222028 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-387a9b76-7047-4881-83ac-f5ddaeeaeaa8 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.024176 Oct 29 03:41:11.222610 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3153/6529] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:41:11 2022] POST /compute/v2.1/flavors => generated 434 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:41:11.234820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c4213791-81b5-488c-95fc-3dae9901bca6 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "341563440"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:41:11.237312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c4213791-81b5-488c-95fc-3dae9901bca6 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] [instance: 221a2347-720a-46c5-a690-6dd9c4b971d4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:11.243527 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c4213791-81b5-488c-95fc-3dae9901bca6 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:11.244075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c4213791-81b5-488c-95fc-3dae9901bca6 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:11.244535 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c4213791-81b5-488c-95fc-3dae9901bca6 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:11.245244 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c4213791-81b5-488c-95fc-3dae9901bca6 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:11.245700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c4213791-81b5-488c-95fc-3dae9901bca6 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:11.246462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c4213791-81b5-488c-95fc-3dae9901bca6 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:11.337579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c4213791-81b5-488c-95fc-3dae9901bca6 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f525401af2a241aeaeeea7f3deb2d0b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990985d57ed14d1fa10b716a88b0185f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:11.344346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c4213791-81b5-488c-95fc-3dae9901bca6 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] [instance: 221a2347-720a-46c5-a690-6dd9c4b971d4] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1005336009 {{(pid=127124) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 03:41:11.352028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c4213791-81b5-488c-95fc-3dae9901bca6 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:11.352727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c4213791-81b5-488c-95fc-3dae9901bca6 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:11.353158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c4213791-81b5-488c-95fc-3dae9901bca6 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:11.353901 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c4213791-81b5-488c-95fc-3dae9901bca6 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:11.354344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c4213791-81b5-488c-95fc-3dae9901bca6 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:11.354787 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c4213791-81b5-488c-95fc-3dae9901bca6 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:11.376068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-c4213791-81b5-488c-95fc-3dae9901bca6 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Getting quotas for project e81cb8e4207247429775a9f964af46c6. Resources: {'cores', 'ram'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:41:11.381403 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-c4213791-81b5-488c-95fc-3dae9901bca6 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Getting quotas for user dc963ffa02614cad8e569769c0ae1f31 and project e81cb8e4207247429775a9f964af46c6. Resources: {'cores', 'ram'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:41:11.394242 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.compute.api [None req-c4213791-81b5-488c-95fc-3dae9901bca6 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] cores quota exceeded for 990985d57ed14d1fa10b716a88b0185f, tried to resize instance. Oct 29 03:41:11.394762 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-c4213791-81b5-488c-95fc-3dae9901bca6 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c4213791-81b5-488c-95fc-3dae9901bca6 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Request method failure captured: Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4/action HTTP/1.1 Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 38 Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXKDMhUwVEFq7QJ88fyJmsYUiQTduipFTumieB_y3EdADkgAeRpQwDuVwfBJsDUDhFkxvxKks79vNT8h1a2JWDWVsqe2Pxd_DO2Te0XOO6yOABObzUzIBVI9aX1Ivv08jcOIPw3242Ri8w-sUjDxUv1JCXug--ajuhaNP1a82b0okgu0 Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 990985d57ed14d1fa10b716a88b0185f Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-676438593 Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: X-Role: admin,reader,member Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: admin,reader,member Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/990985d57ed14d1fa10b716a88b0185f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/990985d57ed14d1fa10b716a88b0185f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_990985d57ed14d1fa10b716a88b0185f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/990985d57ed14d1fa10b716a88b0185f"}]}] Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersAdminNegativeTestJSON-676438593 Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 990985d57ed14d1fa10b716a88b0185f Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-676438593 Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersAdminNegativeTestJSON-676438593-project-admin Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: f525401af2a241aeaeeea7f3deb2d0b8 Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersAdminNegativeTestJSON-676438593-project-admin Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: {"resize": {"flavorRef": "341563440"}} Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '221a2347-720a-46c5-a690-6dd9c4b971d4', 'body': {'resize': {'flavorRef': '341563440'}}} Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:41:11.397053 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c4213791-81b5-488c-95fc-3dae9901bca6 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:41:11.401397 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c4213791-81b5-488c-95fc-3dae9901bca6 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] 10.222.0.46 "POST /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4/action" status: 403 len: 113 microversion: 2.1 time: 0.167619 Oct 29 03:41:11.404569 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3377/6530] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:41:11 2022] POST /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4/action => generated 113 bytes in 172 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:41:11.411844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7f2d2cce-f1a8-4383-a71f-3d25bb05487c tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:11.435574 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7f2d2cce-f1a8-4383-a71f-3d25bb05487c tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] 10.222.0.46 "DELETE /compute/v2.1/flavors/341563440" status: 202 len: 0 microversion: 2.1 time: 0.031304 Oct 29 03:41:11.439073 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3154/6531] 10.222.0.46 () {58 vars in 1158 bytes} [Sat Oct 29 03:41:11 2022] DELETE /compute/v2.1/flavors/341563440 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:41:11.445104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2ff44b3c-5e6e-42a5-a79e-b189d6597c76 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:11.470084 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2ff44b3c-5e6e-42a5-a79e-b189d6597c76 tempest-ServersAdminNegativeTestJSON-676438593 tempest-ServersAdminNegativeTestJSON-676438593-project-admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028691 Oct 29 03:41:11.470580 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3378/6532] 10.222.0.46 () {58 vars in 1146 bytes} [Sat Oct 29 03:41:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:11.491497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3bcc735e-968e-4e87-9dc0-2cc6269c5c25 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:11.492010 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3bcc735e-968e-4e87-9dc0-2cc6269c5c25 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] [instance: 221a2347-720a-46c5-a690-6dd9c4b971d4] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:11.498947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bcc735e-968e-4e87-9dc0-2cc6269c5c25 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:11.499418 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bcc735e-968e-4e87-9dc0-2cc6269c5c25 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:11.499885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bcc735e-968e-4e87-9dc0-2cc6269c5c25 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:11.500598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bcc735e-968e-4e87-9dc0-2cc6269c5c25 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:11.501073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bcc735e-968e-4e87-9dc0-2cc6269c5c25 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:11.501505 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bcc735e-968e-4e87-9dc0-2cc6269c5c25 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:11.527289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3bcc735e-968e-4e87-9dc0-2cc6269c5c25 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] [instance: 221a2347-720a-46c5-a690-6dd9c4b971d4] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:41:11.613840 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3bcc735e-968e-4e87-9dc0-2cc6269c5c25 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] 10.222.0.46 "DELETE /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4" status: 204 len: 0 microversion: 2.1 time: 0.126097 Oct 29 03:41:11.614872 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3155/6533] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:41:11 2022] DELETE /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:41:11.623708 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b243435d-b691-40ce-8619-8263ea7b140f tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:11.624344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b243435d-b691-40ce-8619-8263ea7b140f tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] [instance: 221a2347-720a-46c5-a690-6dd9c4b971d4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:11.630615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b243435d-b691-40ce-8619-8263ea7b140f tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:11.631106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b243435d-b691-40ce-8619-8263ea7b140f tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:11.631552 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b243435d-b691-40ce-8619-8263ea7b140f tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:11.632255 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b243435d-b691-40ce-8619-8263ea7b140f tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:11.632756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b243435d-b691-40ce-8619-8263ea7b140f tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:11.633182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b243435d-b691-40ce-8619-8263ea7b140f tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:11.782666 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b243435d-b691-40ce-8619-8263ea7b140f tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc963ffa02614cad8e569769c0ae1f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e81cb8e4207247429775a9f964af46c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:11.794108 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b243435d-b691-40ce-8619-8263ea7b140f tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] 10.222.0.46 "GET /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4" status: 200 len: 1478 microversion: 2.1 time: 0.174968 Oct 29 03:41:11.794696 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3379/6534] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:11 2022] GET /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4 => generated 1478 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:12.820069 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1719f451-ff58-4d2e-851e-73b81d494482 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:12.820950 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1719f451-ff58-4d2e-851e-73b81d494482 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] [instance: 221a2347-720a-46c5-a690-6dd9c4b971d4] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:12.828712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1719f451-ff58-4d2e-851e-73b81d494482 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:12.829290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1719f451-ff58-4d2e-851e-73b81d494482 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:12.829746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1719f451-ff58-4d2e-851e-73b81d494482 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:12.830463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1719f451-ff58-4d2e-851e-73b81d494482 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:12.830927 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1719f451-ff58-4d2e-851e-73b81d494482 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:12.831343 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1719f451-ff58-4d2e-851e-73b81d494482 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:12.977723 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1719f451-ff58-4d2e-851e-73b81d494482 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc963ffa02614cad8e569769c0ae1f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e81cb8e4207247429775a9f964af46c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:12.986488 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1719f451-ff58-4d2e-851e-73b81d494482 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] 10.222.0.46 "GET /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4" status: 200 len: 1478 microversion: 2.1 time: 0.172211 Oct 29 03:41:12.987164 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3156/6535] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:12 2022] GET /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4 => generated 1478 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:13.377960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-0f74bde5-3d3c-454f-afcb-855b501e5a13 req-e2db2eeb-04ed-4782-a257-c939d1ce8c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "221a2347-720a-46c5-a690-6dd9c4b971d4", "name": "network-vif-deleted", "tag": "2c028645-78f9-465c-b018-b08ee0904818"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:41:13.393942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-0f74bde5-3d3c-454f-afcb-855b501e5a13 req-e2db2eeb-04ed-4782-a257-c939d1ce8c9d service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:13.393942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-0f74bde5-3d3c-454f-afcb-855b501e5a13 req-e2db2eeb-04ed-4782-a257-c939d1ce8c9d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:13.394346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-0f74bde5-3d3c-454f-afcb-855b501e5a13 req-e2db2eeb-04ed-4782-a257-c939d1ce8c9d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:13.408033 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-0f74bde5-3d3c-454f-afcb-855b501e5a13 req-e2db2eeb-04ed-4782-a257-c939d1ce8c9d service nova] Creating event network-vif-deleted:2c028645-78f9-465c-b018-b08ee0904818 for instance 221a2347-720a-46c5-a690-6dd9c4b971d4 on n-h2-862967-2 Oct 29 03:41:13.415593 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-0f74bde5-3d3c-454f-afcb-855b501e5a13 req-e2db2eeb-04ed-4782-a257-c939d1ce8c9d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041826 Oct 29 03:41:13.416706 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3380/6536] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:41:14.012063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0c74953f-8a69-41ff-8dac-acb3ae3b0203 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:14.013588 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0c74953f-8a69-41ff-8dac-acb3ae3b0203 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] [instance: 221a2347-720a-46c5-a690-6dd9c4b971d4] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:14.025183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c74953f-8a69-41ff-8dac-acb3ae3b0203 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:14.025807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c74953f-8a69-41ff-8dac-acb3ae3b0203 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:14.026323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c74953f-8a69-41ff-8dac-acb3ae3b0203 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:14.027129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c74953f-8a69-41ff-8dac-acb3ae3b0203 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:14.027668 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c74953f-8a69-41ff-8dac-acb3ae3b0203 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:14.028109 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c74953f-8a69-41ff-8dac-acb3ae3b0203 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:14.063448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c74953f-8a69-41ff-8dac-acb3ae3b0203 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:14.063951 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c74953f-8a69-41ff-8dac-acb3ae3b0203 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:14.064406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0c74953f-8a69-41ff-8dac-acb3ae3b0203 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:14.064905 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-0c74953f-8a69-41ff-8dac-acb3ae3b0203 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lazy-loading 'fault' on Instance uuid 221a2347-720a-46c5-a690-6dd9c4b971d4 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:41:14.108891 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0c74953f-8a69-41ff-8dac-acb3ae3b0203 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc963ffa02614cad8e569769c0ae1f31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e81cb8e4207247429775a9f964af46c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:14.116448 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0c74953f-8a69-41ff-8dac-acb3ae3b0203 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] 10.222.0.46 "GET /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4" status: 200 len: 1312 microversion: 2.1 time: 0.109131 Oct 29 03:41:14.117076 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3157/6537] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:14 2022] GET /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4 => generated 1312 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:15.142434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e643d795-9de8-43ee-adb1-fb55b9fe81a5 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:15.143136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e643d795-9de8-43ee-adb1-fb55b9fe81a5 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] [instance: 221a2347-720a-46c5-a690-6dd9c4b971d4] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:15.150333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e643d795-9de8-43ee-adb1-fb55b9fe81a5 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:15.150832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e643d795-9de8-43ee-adb1-fb55b9fe81a5 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:15.151277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e643d795-9de8-43ee-adb1-fb55b9fe81a5 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:15.151969 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e643d795-9de8-43ee-adb1-fb55b9fe81a5 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:15.152432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e643d795-9de8-43ee-adb1-fb55b9fe81a5 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:15.152886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e643d795-9de8-43ee-adb1-fb55b9fe81a5 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:15.167147 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-e643d795-9de8-43ee-adb1-fb55b9fe81a5 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] HTTP exception thrown: Instance 221a2347-720a-46c5-a690-6dd9c4b971d4 could not be found. Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e643d795-9de8-43ee-adb1-fb55b9fe81a5 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Request method failure captured: Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4 HTTP/1.1 Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXKDLtYZYXE-WzaaQWh6XEjIQyiNpEaO8Q7PTK74fAsaDHuFdD8oYn3Wk0Dz-xdEL1BewWL0XJCMOiG51Pn7wsN3J0ch3zFrqlXkSYO46hK4rTiXzG8pY3PJYGp63VKMvsfoZKsUtURNNDcj-9Ss6dzVNwJVN3yrHj0UIvXs4jfsEghc Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: e81cb8e4207247429775a9f964af46c6 Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1940888323 Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e81cb8e4207247429775a9f964af46c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/e81cb8e4207247429775a9f964af46c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_e81cb8e4207247429775a9f964af46c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/e81cb8e4207247429775a9f964af46c6"}]}] Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1940888323 Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: e81cb8e4207247429775a9f964af46c6 Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1940888323 Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersAdminNegativeTestJSON-1940888323-project Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: dc963ffa02614cad8e569769c0ae1f31 Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1940888323-project Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 221a2347-720a-46c5-a690-6dd9c4b971d4 could not be found. Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '221a2347-720a-46c5-a690-6dd9c4b971d4'} Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 221a2347-720a-46c5-a690-6dd9c4b971d4 could not be found. Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 221a2347-720a-46c5-a690-6dd9c4b971d4 could not be found. Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:41:15.168917 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:41:15.173258 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:41:15.173258 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:41:15.173258 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:41:15.173258 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:41:15.173258 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:41:15.173258 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:41:15.173258 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 221a2347-720a-46c5-a690-6dd9c4b971d4 could not be found. Oct 29 03:41:15.173258 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:41:15.173258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e643d795-9de8-43ee-adb1-fb55b9fe81a5 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] Returning 404 to user: Instance 221a2347-720a-46c5-a690-6dd9c4b971d4 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:41:15.173258 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e643d795-9de8-43ee-adb1-fb55b9fe81a5 tempest-ServersAdminNegativeTestJSON-1940888323 tempest-ServersAdminNegativeTestJSON-1940888323-project] 10.222.0.46 "GET /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4" status: 404 len: 111 microversion: 2.1 time: 0.033580 Oct 29 03:41:15.173258 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3381/6538] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:15 2022] GET /compute/v2.1/servers/221a2347-720a-46c5-a690-6dd9c4b971d4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:41:21.310289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=8 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:41:21.311202 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:41:21.441281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-78caabf6-52a3-4e5c-bb53-551a784c77f2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1276778213", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "554cdeab-8546-4368-9a6d-b27b3032711c"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:41:21.504650 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-78caabf6-52a3-4e5c-bb53-551a784c77f2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] validate_networks() for [('554cdeab-8546-4368-9a6d-b27b3032711c', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:41:22.178033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-78caabf6-52a3-4e5c-bb53-551a784c77f2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:41:22.178462 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-78caabf6-52a3-4e5c-bb53-551a784c77f2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:41:22.178924 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-78caabf6-52a3-4e5c-bb53-551a784c77f2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:41:22.179346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-78caabf6-52a3-4e5c-bb53-551a784c77f2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:41:22.179778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-78caabf6-52a3-4e5c-bb53-551a784c77f2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:41:22.189377 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78caabf6-52a3-4e5c-bb53-551a784c77f2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:22.189875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78caabf6-52a3-4e5c-bb53-551a784c77f2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:22.190342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78caabf6-52a3-4e5c-bb53-551a784c77f2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:22.191063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78caabf6-52a3-4e5c-bb53-551a784c77f2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:22.191528 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78caabf6-52a3-4e5c-bb53-551a784c77f2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:22.191969 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78caabf6-52a3-4e5c-bb53-551a784c77f2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:22.209292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-78caabf6-52a3-4e5c-bb53-551a784c77f2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Getting quotas for project a26e8e20285a4766baec24e6d9e74162. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:41:22.214861 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-78caabf6-52a3-4e5c-bb53-551a784c77f2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Getting quotas for user 8db1c69d934d482fb3ea475068b0b144 and project a26e8e20285a4766baec24e6d9e74162. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:41:22.228293 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-78caabf6-52a3-4e5c-bb53-551a784c77f2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:41:22.230670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-78caabf6-52a3-4e5c-bb53-551a784c77f2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:41:22.278734 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-78caabf6-52a3-4e5c-bb53-551a784c77f2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.973709 Oct 29 03:41:22.279619 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3158/6539] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:41:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:41:22.290930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7c297c54-1a18-493f-a999-8679536c9fe0 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:22.291608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7c297c54-1a18-493f-a999-8679536c9fe0 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:22.296314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:41:22.296996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:41:22.356095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7c297c54-1a18-493f-a999-8679536c9fe0 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:22.363587 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7c297c54-1a18-493f-a999-8679536c9fe0 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1215 microversion: 2.1 time: 0.076458 Oct 29 03:41:22.364554 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3382/6540] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:22 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1215 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:23.389836 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d18aa74c-66b8-4c8a-91ea-02719918a57b tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:23.392051 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d18aa74c-66b8-4c8a-91ea-02719918a57b tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:23.402226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d18aa74c-66b8-4c8a-91ea-02719918a57b tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:23.403492 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d18aa74c-66b8-4c8a-91ea-02719918a57b tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:23.404216 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d18aa74c-66b8-4c8a-91ea-02719918a57b tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:23.405619 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d18aa74c-66b8-4c8a-91ea-02719918a57b tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:23.406820 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d18aa74c-66b8-4c8a-91ea-02719918a57b tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:23.407527 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d18aa74c-66b8-4c8a-91ea-02719918a57b tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:23.484000 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d18aa74c-66b8-4c8a-91ea-02719918a57b tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:23.496359 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d18aa74c-66b8-4c8a-91ea-02719918a57b tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1285 microversion: 2.1 time: 0.112164 Oct 29 03:41:23.497228 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3159/6541] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:23 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:41:24.520928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8ddb5005-6401-4ef5-ae18-42d6dba75ba2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:24.521722 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8ddb5005-6401-4ef5-ae18-42d6dba75ba2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:24.530233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8ddb5005-6401-4ef5-ae18-42d6dba75ba2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:24.530732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8ddb5005-6401-4ef5-ae18-42d6dba75ba2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:24.531172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8ddb5005-6401-4ef5-ae18-42d6dba75ba2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:24.532208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8ddb5005-6401-4ef5-ae18-42d6dba75ba2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:24.533029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8ddb5005-6401-4ef5-ae18-42d6dba75ba2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:24.533469 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8ddb5005-6401-4ef5-ae18-42d6dba75ba2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:24.735177 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8ddb5005-6401-4ef5-ae18-42d6dba75ba2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:24.747131 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8ddb5005-6401-4ef5-ae18-42d6dba75ba2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1315 microversion: 2.1 time: 0.229952 Oct 29 03:41:24.747849 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3383/6542] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:24 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:24.840606 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-53c4499e-ed07-4efc-ad1b-17e8a714fed5 req-bc03d6da-96d7-42da-8725-b6337aff3c06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2fc8061-2d69-41ad-a38c-2b0c765701ad", "tag": "41666ced-81e2-48fd-a5e7-0552e588c42b"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:41:24.864245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-53c4499e-ed07-4efc-ad1b-17e8a714fed5 req-bc03d6da-96d7-42da-8725-b6337aff3c06 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:24.864777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-53c4499e-ed07-4efc-ad1b-17e8a714fed5 req-bc03d6da-96d7-42da-8725-b6337aff3c06 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:24.865416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-53c4499e-ed07-4efc-ad1b-17e8a714fed5 req-bc03d6da-96d7-42da-8725-b6337aff3c06 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:24.879290 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-53c4499e-ed07-4efc-ad1b-17e8a714fed5 req-bc03d6da-96d7-42da-8725-b6337aff3c06 service nova] Creating event network-changed:41666ced-81e2-48fd-a5e7-0552e588c42b for instance c2fc8061-2d69-41ad-a38c-2b0c765701ad on n-h2-862967-2 Oct 29 03:41:24.886145 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-53c4499e-ed07-4efc-ad1b-17e8a714fed5 req-bc03d6da-96d7-42da-8725-b6337aff3c06 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048968 Oct 29 03:41:24.886780 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3160/6543] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:41:25.774109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6c2136f7-b78a-485c-bf20-ad7635994361 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:25.774698 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6c2136f7-b78a-485c-bf20-ad7635994361 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:25.783751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c2136f7-b78a-485c-bf20-ad7635994361 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:25.784237 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c2136f7-b78a-485c-bf20-ad7635994361 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:25.784711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c2136f7-b78a-485c-bf20-ad7635994361 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:25.785406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c2136f7-b78a-485c-bf20-ad7635994361 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:25.785855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c2136f7-b78a-485c-bf20-ad7635994361 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:25.786277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c2136f7-b78a-485c-bf20-ad7635994361 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:25.929844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6c2136f7-b78a-485c-bf20-ad7635994361 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:25.942385 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6c2136f7-b78a-485c-bf20-ad7635994361 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1315 microversion: 2.1 time: 0.174435 Oct 29 03:41:25.943278 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3384/6544] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:25 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:26.971187 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cb88a474-c21d-41b8-9978-175719d17ca2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:26.971922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cb88a474-c21d-41b8-9978-175719d17ca2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:26.978554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb88a474-c21d-41b8-9978-175719d17ca2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:26.979058 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb88a474-c21d-41b8-9978-175719d17ca2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:26.979532 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb88a474-c21d-41b8-9978-175719d17ca2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:26.980256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb88a474-c21d-41b8-9978-175719d17ca2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:26.980754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb88a474-c21d-41b8-9978-175719d17ca2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:26.981194 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb88a474-c21d-41b8-9978-175719d17ca2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:27.120353 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cb88a474-c21d-41b8-9978-175719d17ca2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:27.128898 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cb88a474-c21d-41b8-9978-175719d17ca2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1315 microversion: 2.1 time: 0.163114 Oct 29 03:41:27.129492 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3161/6545] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:26 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:28.158509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1c8cb02c-56e8-463d-bb6d-c3c1520973ba tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:28.159631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1c8cb02c-56e8-463d-bb6d-c3c1520973ba tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:28.172053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c8cb02c-56e8-463d-bb6d-c3c1520973ba tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:28.172688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c8cb02c-56e8-463d-bb6d-c3c1520973ba tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:28.173123 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c8cb02c-56e8-463d-bb6d-c3c1520973ba tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:28.173833 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c8cb02c-56e8-463d-bb6d-c3c1520973ba tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:28.174279 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c8cb02c-56e8-463d-bb6d-c3c1520973ba tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:28.174719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1c8cb02c-56e8-463d-bb6d-c3c1520973ba tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:28.320221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1c8cb02c-56e8-463d-bb6d-c3c1520973ba tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:28.330115 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1c8cb02c-56e8-463d-bb6d-c3c1520973ba tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1315 microversion: 2.1 time: 0.180228 Oct 29 03:41:28.330588 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3385/6546] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:28 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:29.356233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6ec76bb9-e675-4449-909b-72ff08a59a66 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:29.357133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6ec76bb9-e675-4449-909b-72ff08a59a66 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:29.366630 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ec76bb9-e675-4449-909b-72ff08a59a66 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:29.367327 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ec76bb9-e675-4449-909b-72ff08a59a66 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:29.367913 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ec76bb9-e675-4449-909b-72ff08a59a66 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:29.368897 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ec76bb9-e675-4449-909b-72ff08a59a66 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:29.369518 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ec76bb9-e675-4449-909b-72ff08a59a66 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:29.370091 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ec76bb9-e675-4449-909b-72ff08a59a66 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:29.504878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6ec76bb9-e675-4449-909b-72ff08a59a66 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:29.512856 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6ec76bb9-e675-4449-909b-72ff08a59a66 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1315 microversion: 2.1 time: 0.161870 Oct 29 03:41:29.513438 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3162/6547] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:29 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:30.536373 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8efddc29-6324-498c-bf41-e2c5d7a27e3c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:30.537001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8efddc29-6324-498c-bf41-e2c5d7a27e3c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:30.544554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8efddc29-6324-498c-bf41-e2c5d7a27e3c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:30.545094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8efddc29-6324-498c-bf41-e2c5d7a27e3c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:30.545529 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8efddc29-6324-498c-bf41-e2c5d7a27e3c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:30.546230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8efddc29-6324-498c-bf41-e2c5d7a27e3c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:30.546682 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8efddc29-6324-498c-bf41-e2c5d7a27e3c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:30.547220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8efddc29-6324-498c-bf41-e2c5d7a27e3c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:30.642324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-0b93a90c-1a7f-4a2b-8c70-1a3610063e71 req-03b804f8-5d12-4480-b9e2-7fe0f783c544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2fc8061-2d69-41ad-a38c-2b0c765701ad", "name": "network-vif-plugged", "status": "completed", "tag": "41666ced-81e2-48fd-a5e7-0552e588c42b"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:41:30.651710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:41:30.654223 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0b93a90c-1a7f-4a2b-8c70-1a3610063e71 req-03b804f8-5d12-4480-b9e2-7fe0f783c544 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:30.654715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0b93a90c-1a7f-4a2b-8c70-1a3610063e71 req-03b804f8-5d12-4480-b9e2-7fe0f783c544 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:30.655151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-0b93a90c-1a7f-4a2b-8c70-1a3610063e71 req-03b804f8-5d12-4480-b9e2-7fe0f783c544 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:30.660179 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:41:30.668547 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-0b93a90c-1a7f-4a2b-8c70-1a3610063e71 req-03b804f8-5d12-4480-b9e2-7fe0f783c544 service nova] Creating event network-vif-plugged:41666ced-81e2-48fd-a5e7-0552e588c42b for instance c2fc8061-2d69-41ad-a38c-2b0c765701ad on n-h2-862967-2 Oct 29 03:41:30.675195 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-0b93a90c-1a7f-4a2b-8c70-1a3610063e71 req-03b804f8-5d12-4480-b9e2-7fe0f783c544 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106472 Oct 29 03:41:30.675867 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3163/6548] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:41:30.696288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8efddc29-6324-498c-bf41-e2c5d7a27e3c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:30.705293 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8efddc29-6324-498c-bf41-e2c5d7a27e3c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1315 microversion: 2.1 time: 0.173035 Oct 29 03:41:30.705891 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3386/6549] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:30 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:31.731611 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-22d086c7-2741-4ff0-b200-ad432ba5af9d tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:31.732301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-22d086c7-2741-4ff0-b200-ad432ba5af9d tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:31.742096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22d086c7-2741-4ff0-b200-ad432ba5af9d tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:31.742592 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22d086c7-2741-4ff0-b200-ad432ba5af9d tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:31.743040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22d086c7-2741-4ff0-b200-ad432ba5af9d tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:31.743744 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22d086c7-2741-4ff0-b200-ad432ba5af9d tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:31.744222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22d086c7-2741-4ff0-b200-ad432ba5af9d tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:31.744678 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-22d086c7-2741-4ff0-b200-ad432ba5af9d tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:31.897079 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-22d086c7-2741-4ff0-b200-ad432ba5af9d tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:31.905012 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-22d086c7-2741-4ff0-b200-ad432ba5af9d tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1315 microversion: 2.1 time: 0.179085 Oct 29 03:41:31.905947 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3164/6550] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:31 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:32.928699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-495bdace-c362-413b-870c-7334517d4170 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:32.929292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-495bdace-c362-413b-870c-7334517d4170 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:32.931887 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:41:32.932677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:41:32.938556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-495bdace-c362-413b-870c-7334517d4170 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:32.939028 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-495bdace-c362-413b-870c-7334517d4170 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:32.939487 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-495bdace-c362-413b-870c-7334517d4170 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:32.940188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-495bdace-c362-413b-870c-7334517d4170 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:32.940666 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-495bdace-c362-413b-870c-7334517d4170 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:32.941116 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-495bdace-c362-413b-870c-7334517d4170 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:32.944548 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=74 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:41:33.082841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-495bdace-c362-413b-870c-7334517d4170 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:33.091213 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-495bdace-c362-413b-870c-7334517d4170 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1501 microversion: 2.1 time: 0.166748 Oct 29 03:41:33.091801 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3387/6551] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:32 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1501 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:33.116937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7c52d36c-38cc-400a-9591-d1795c4a02fd tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:41:33.120514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7c52d36c-38cc-400a-9591-d1795c4a02fd tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:33.123887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:41:33.124727 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:41:33.135160 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c52d36c-38cc-400a-9591-d1795c4a02fd tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:33.135956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c52d36c-38cc-400a-9591-d1795c4a02fd tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:33.136760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c52d36c-38cc-400a-9591-d1795c4a02fd tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:33.137646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c52d36c-38cc-400a-9591-d1795c4a02fd tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:33.138117 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c52d36c-38cc-400a-9591-d1795c4a02fd tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:33.138532 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7c52d36c-38cc-400a-9591-d1795c4a02fd tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:33.215449 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7c52d36c-38cc-400a-9591-d1795c4a02fd tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:33.221051 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7c52d36c-38cc-400a-9591-d1795c4a02fd tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Old instance type m1.heat2, new instance type m1.heat {{(pid=127125) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 03:41:33.227718 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-7c52d36c-38cc-400a-9591-d1795c4a02fd tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:41:33.228143 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-7c52d36c-38cc-400a-9591-d1795c4a02fd tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:41:33.228648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-7c52d36c-38cc-400a-9591-d1795c4a02fd tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:41:33.229065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-7c52d36c-38cc-400a-9591-d1795c4a02fd tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:41:33.229479 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-7c52d36c-38cc-400a-9591-d1795c4a02fd tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:41:33.345255 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7c52d36c-38cc-400a-9591-d1795c4a02fd tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "POST /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad/action" status: 202 len: 0 microversion: 2.1 time: 0.234715 Oct 29 03:41:33.345914 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3165/6552] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:41:33 2022] POST /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:41:33.354599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5065bae8-d02d-4d73-9687-7e54867c7e75 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:33.355247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5065bae8-d02d-4d73-9687-7e54867c7e75 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:33.362284 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5065bae8-d02d-4d73-9687-7e54867c7e75 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:33.363125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5065bae8-d02d-4d73-9687-7e54867c7e75 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:33.363563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5065bae8-d02d-4d73-9687-7e54867c7e75 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:33.364274 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5065bae8-d02d-4d73-9687-7e54867c7e75 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:33.364765 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5065bae8-d02d-4d73-9687-7e54867c7e75 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:33.365195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5065bae8-d02d-4d73-9687-7e54867c7e75 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:33.504825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5065bae8-d02d-4d73-9687-7e54867c7e75 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:33.513101 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5065bae8-d02d-4d73-9687-7e54867c7e75 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1510 microversion: 2.1 time: 0.162651 Oct 29 03:41:33.513657 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3388/6553] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:33 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:34.538416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a1d81022-3d82-47d7-9790-16588d94f333 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:34.539064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a1d81022-3d82-47d7-9790-16588d94f333 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:34.546183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1d81022-3d82-47d7-9790-16588d94f333 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:34.546729 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1d81022-3d82-47d7-9790-16588d94f333 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:34.547177 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1d81022-3d82-47d7-9790-16588d94f333 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:34.547883 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1d81022-3d82-47d7-9790-16588d94f333 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:34.548345 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1d81022-3d82-47d7-9790-16588d94f333 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:34.548796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1d81022-3d82-47d7-9790-16588d94f333 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:34.687873 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a1d81022-3d82-47d7-9790-16588d94f333 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:34.696949 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a1d81022-3d82-47d7-9790-16588d94f333 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1510 microversion: 2.1 time: 0.163618 Oct 29 03:41:34.698133 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3166/6554] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:34 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:35.721316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d49c2f65-3203-4852-81b1-95a5eac4910f tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:35.721898 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d49c2f65-3203-4852-81b1-95a5eac4910f tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:35.729034 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d49c2f65-3203-4852-81b1-95a5eac4910f tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:35.729551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d49c2f65-3203-4852-81b1-95a5eac4910f tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:35.729988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d49c2f65-3203-4852-81b1-95a5eac4910f tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:35.730697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d49c2f65-3203-4852-81b1-95a5eac4910f tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:35.731151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d49c2f65-3203-4852-81b1-95a5eac4910f tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:35.731575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d49c2f65-3203-4852-81b1-95a5eac4910f tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:35.874613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d49c2f65-3203-4852-81b1-95a5eac4910f tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:35.882626 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d49c2f65-3203-4852-81b1-95a5eac4910f tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1515 microversion: 2.1 time: 0.165514 Oct 29 03:41:35.883215 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3389/6555] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:35 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:36.910684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-57adf648-f8b8-47bf-85e9-302e764ae4e2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:36.911737 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-57adf648-f8b8-47bf-85e9-302e764ae4e2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:36.923358 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57adf648-f8b8-47bf-85e9-302e764ae4e2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:36.923858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57adf648-f8b8-47bf-85e9-302e764ae4e2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:36.924310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57adf648-f8b8-47bf-85e9-302e764ae4e2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:36.925051 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57adf648-f8b8-47bf-85e9-302e764ae4e2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:36.925514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57adf648-f8b8-47bf-85e9-302e764ae4e2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:36.925949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57adf648-f8b8-47bf-85e9-302e764ae4e2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:37.060323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-57adf648-f8b8-47bf-85e9-302e764ae4e2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:37.069549 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-57adf648-f8b8-47bf-85e9-302e764ae4e2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1515 microversion: 2.1 time: 0.166043 Oct 29 03:41:37.070142 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3167/6556] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:36 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:38.098214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f3bcf568-37b9-480a-84ab-5f93b3a234cc tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:38.098912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f3bcf568-37b9-480a-84ab-5f93b3a234cc tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:38.106256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3bcf568-37b9-480a-84ab-5f93b3a234cc tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:38.106745 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3bcf568-37b9-480a-84ab-5f93b3a234cc tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:38.107185 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3bcf568-37b9-480a-84ab-5f93b3a234cc tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:38.107886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3bcf568-37b9-480a-84ab-5f93b3a234cc tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:38.108322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3bcf568-37b9-480a-84ab-5f93b3a234cc tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:38.108808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f3bcf568-37b9-480a-84ab-5f93b3a234cc tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:38.247285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f3bcf568-37b9-480a-84ab-5f93b3a234cc tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:38.256375 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f3bcf568-37b9-480a-84ab-5f93b3a234cc tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1515 microversion: 2.1 time: 0.165094 Oct 29 03:41:38.257014 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3390/6557] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:38 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:39.287478 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2e00a85d-e00c-4d74-8f94-d748cf1c5dfd tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:39.288174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2e00a85d-e00c-4d74-8f94-d748cf1c5dfd tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:39.296413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e00a85d-e00c-4d74-8f94-d748cf1c5dfd tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:39.296997 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e00a85d-e00c-4d74-8f94-d748cf1c5dfd tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:39.297497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e00a85d-e00c-4d74-8f94-d748cf1c5dfd tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:39.298288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e00a85d-e00c-4d74-8f94-d748cf1c5dfd tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:39.298807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e00a85d-e00c-4d74-8f94-d748cf1c5dfd tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:39.299294 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e00a85d-e00c-4d74-8f94-d748cf1c5dfd tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:39.451473 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2e00a85d-e00c-4d74-8f94-d748cf1c5dfd tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:39.460107 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2e00a85d-e00c-4d74-8f94-d748cf1c5dfd tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1515 microversion: 2.1 time: 0.178903 Oct 29 03:41:39.460730 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3168/6558] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:39 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:40.484099 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-043428bc-d375-4cb1-8c7f-60dfb653a55b tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:40.484995 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-043428bc-d375-4cb1-8c7f-60dfb653a55b tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:40.493780 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-043428bc-d375-4cb1-8c7f-60dfb653a55b tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:40.494284 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-043428bc-d375-4cb1-8c7f-60dfb653a55b tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:40.494748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-043428bc-d375-4cb1-8c7f-60dfb653a55b tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:40.495481 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-043428bc-d375-4cb1-8c7f-60dfb653a55b tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:40.496259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-043428bc-d375-4cb1-8c7f-60dfb653a55b tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:40.496719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-043428bc-d375-4cb1-8c7f-60dfb653a55b tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:40.635441 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-043428bc-d375-4cb1-8c7f-60dfb653a55b tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:40.644945 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-043428bc-d375-4cb1-8c7f-60dfb653a55b tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1515 microversion: 2.1 time: 0.165221 Oct 29 03:41:40.645619 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3391/6559] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:40 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:41.668568 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-96e4849d-7822-45b4-8b67-f5e93fe4f0ab tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:41.669256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-96e4849d-7822-45b4-8b67-f5e93fe4f0ab tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:41.676392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96e4849d-7822-45b4-8b67-f5e93fe4f0ab tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:41.676922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96e4849d-7822-45b4-8b67-f5e93fe4f0ab tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:41.677362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96e4849d-7822-45b4-8b67-f5e93fe4f0ab tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:41.678070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96e4849d-7822-45b4-8b67-f5e93fe4f0ab tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:41.678531 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96e4849d-7822-45b4-8b67-f5e93fe4f0ab tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:41.679089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-96e4849d-7822-45b4-8b67-f5e93fe4f0ab tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:41.814979 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-96e4849d-7822-45b4-8b67-f5e93fe4f0ab tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:41.822865 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-96e4849d-7822-45b4-8b67-f5e93fe4f0ab tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1515 microversion: 2.1 time: 0.158501 Oct 29 03:41:41.823542 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3169/6560] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:41 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:42.849583 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-787d7a51-4c6f-4066-ba38-2595fa48efaf tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:42.850264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-787d7a51-4c6f-4066-ba38-2595fa48efaf tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:42.860825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-787d7a51-4c6f-4066-ba38-2595fa48efaf tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:42.861543 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-787d7a51-4c6f-4066-ba38-2595fa48efaf tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:42.862130 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-787d7a51-4c6f-4066-ba38-2595fa48efaf tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:42.863198 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-787d7a51-4c6f-4066-ba38-2595fa48efaf tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:42.863868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-787d7a51-4c6f-4066-ba38-2595fa48efaf tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:42.864591 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-787d7a51-4c6f-4066-ba38-2595fa48efaf tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:43.001481 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-787d7a51-4c6f-4066-ba38-2595fa48efaf tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:43.009440 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-787d7a51-4c6f-4066-ba38-2595fa48efaf tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1515 microversion: 2.1 time: 0.166331 Oct 29 03:41:43.010024 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3392/6561] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:42 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:44.037114 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-57ed45d0-89ee-4665-8e37-643d369efde2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:44.038142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-57ed45d0-89ee-4665-8e37-643d369efde2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:44.047395 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57ed45d0-89ee-4665-8e37-643d369efde2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:44.047895 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57ed45d0-89ee-4665-8e37-643d369efde2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:44.048332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57ed45d0-89ee-4665-8e37-643d369efde2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:44.049069 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57ed45d0-89ee-4665-8e37-643d369efde2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:44.049519 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57ed45d0-89ee-4665-8e37-643d369efde2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:44.049949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-57ed45d0-89ee-4665-8e37-643d369efde2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:44.194207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-57ed45d0-89ee-4665-8e37-643d369efde2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:44.204474 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-57ed45d0-89ee-4665-8e37-643d369efde2 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1515 microversion: 2.1 time: 0.173594 Oct 29 03:41:44.205291 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3170/6562] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:44 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:45.233531 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-933b0bb9-2c13-496f-8d90-601dd9727fe5 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:45.234150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-933b0bb9-2c13-496f-8d90-601dd9727fe5 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:45.241798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-933b0bb9-2c13-496f-8d90-601dd9727fe5 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:45.242311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-933b0bb9-2c13-496f-8d90-601dd9727fe5 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:45.242762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-933b0bb9-2c13-496f-8d90-601dd9727fe5 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:45.243479 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-933b0bb9-2c13-496f-8d90-601dd9727fe5 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:45.243965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-933b0bb9-2c13-496f-8d90-601dd9727fe5 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:45.244412 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-933b0bb9-2c13-496f-8d90-601dd9727fe5 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:45.408697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-933b0bb9-2c13-496f-8d90-601dd9727fe5 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:45.417278 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-933b0bb9-2c13-496f-8d90-601dd9727fe5 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1515 microversion: 2.1 time: 0.189027 Oct 29 03:41:45.417858 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3393/6563] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:45 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:46.442153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3066643e-d411-473a-b7a7-223665bb10db tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:46.442742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3066643e-d411-473a-b7a7-223665bb10db tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:46.450342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3066643e-d411-473a-b7a7-223665bb10db tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:46.450918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3066643e-d411-473a-b7a7-223665bb10db tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:46.451495 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3066643e-d411-473a-b7a7-223665bb10db tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:46.452377 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3066643e-d411-473a-b7a7-223665bb10db tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:46.452908 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3066643e-d411-473a-b7a7-223665bb10db tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:46.453373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3066643e-d411-473a-b7a7-223665bb10db tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:46.614468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3066643e-d411-473a-b7a7-223665bb10db tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:46.624935 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3066643e-d411-473a-b7a7-223665bb10db tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1515 microversion: 2.1 time: 0.187042 Oct 29 03:41:46.625532 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3171/6564] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:46 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:47.651444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-18825925-1d8a-41c3-804a-5bed8a8980a0 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:47.652036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-18825925-1d8a-41c3-804a-5bed8a8980a0 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:47.662875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-18825925-1d8a-41c3-804a-5bed8a8980a0 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:47.663346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-18825925-1d8a-41c3-804a-5bed8a8980a0 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:47.663813 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-18825925-1d8a-41c3-804a-5bed8a8980a0 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:47.664514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-18825925-1d8a-41c3-804a-5bed8a8980a0 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:47.664992 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-18825925-1d8a-41c3-804a-5bed8a8980a0 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:47.665413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-18825925-1d8a-41c3-804a-5bed8a8980a0 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:47.806652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-18825925-1d8a-41c3-804a-5bed8a8980a0 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:47.816389 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-18825925-1d8a-41c3-804a-5bed8a8980a0 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1515 microversion: 2.1 time: 0.171500 Oct 29 03:41:47.817045 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3394/6565] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:47 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:48.839974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4bd4e5e7-d9cd-4c9b-9a6d-01fdf878f686 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:48.840643 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4bd4e5e7-d9cd-4c9b-9a6d-01fdf878f686 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:48.847639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bd4e5e7-d9cd-4c9b-9a6d-01fdf878f686 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:48.848152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bd4e5e7-d9cd-4c9b-9a6d-01fdf878f686 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:48.848631 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bd4e5e7-d9cd-4c9b-9a6d-01fdf878f686 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:48.849346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bd4e5e7-d9cd-4c9b-9a6d-01fdf878f686 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:48.849814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bd4e5e7-d9cd-4c9b-9a6d-01fdf878f686 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:48.850257 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4bd4e5e7-d9cd-4c9b-9a6d-01fdf878f686 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:48.991171 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4bd4e5e7-d9cd-4c9b-9a6d-01fdf878f686 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:48.999768 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4bd4e5e7-d9cd-4c9b-9a6d-01fdf878f686 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1515 microversion: 2.1 time: 0.163997 Oct 29 03:41:49.000359 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3172/6566] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:48 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:50.025075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e7cfd9f5-b1ff-4433-9aa3-95e1496ed011 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:50.025815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e7cfd9f5-b1ff-4433-9aa3-95e1496ed011 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:50.034063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7cfd9f5-b1ff-4433-9aa3-95e1496ed011 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:50.034562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7cfd9f5-b1ff-4433-9aa3-95e1496ed011 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:50.035002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7cfd9f5-b1ff-4433-9aa3-95e1496ed011 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:50.035710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7cfd9f5-b1ff-4433-9aa3-95e1496ed011 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:50.036173 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7cfd9f5-b1ff-4433-9aa3-95e1496ed011 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:50.036652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e7cfd9f5-b1ff-4433-9aa3-95e1496ed011 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:50.172145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e7cfd9f5-b1ff-4433-9aa3-95e1496ed011 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:50.184467 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e7cfd9f5-b1ff-4433-9aa3-95e1496ed011 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1515 microversion: 2.1 time: 0.164151 Oct 29 03:41:50.185402 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3395/6567] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:50 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:51.212925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-85f9cd1b-cbde-4b00-a28f-97977a33289c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:51.213907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-85f9cd1b-cbde-4b00-a28f-97977a33289c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:51.225362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85f9cd1b-cbde-4b00-a28f-97977a33289c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:51.226176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85f9cd1b-cbde-4b00-a28f-97977a33289c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:51.226956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85f9cd1b-cbde-4b00-a28f-97977a33289c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:51.228063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85f9cd1b-cbde-4b00-a28f-97977a33289c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:51.228887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85f9cd1b-cbde-4b00-a28f-97977a33289c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:51.229619 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85f9cd1b-cbde-4b00-a28f-97977a33289c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:51.378808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-85f9cd1b-cbde-4b00-a28f-97977a33289c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:51.390834 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-85f9cd1b-cbde-4b00-a28f-97977a33289c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1515 microversion: 2.1 time: 0.184426 Oct 29 03:41:51.391418 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3173/6568] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:51 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1515 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:52.416192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-704e6118-1774-4beb-9162-363fa660d309 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:52.416800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-704e6118-1774-4beb-9162-363fa660d309 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:52.424435 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-704e6118-1774-4beb-9162-363fa660d309 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:52.424952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-704e6118-1774-4beb-9162-363fa660d309 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:52.425395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-704e6118-1774-4beb-9162-363fa660d309 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:52.426098 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-704e6118-1774-4beb-9162-363fa660d309 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:52.426552 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-704e6118-1774-4beb-9162-363fa660d309 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:52.426975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-704e6118-1774-4beb-9162-363fa660d309 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:52.565929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-704e6118-1774-4beb-9162-363fa660d309 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:52.576627 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-704e6118-1774-4beb-9162-363fa660d309 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1515 microversion: 2.1 time: 0.165685 Oct 29 03:41:52.577362 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3396/6569] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:52 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:53.609080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-16d3c1d5-7b20-4249-9a59-c54f276453ee tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:53.610060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-16d3c1d5-7b20-4249-9a59-c54f276453ee tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:53.617138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-16d3c1d5-7b20-4249-9a59-c54f276453ee tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:53.617633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-16d3c1d5-7b20-4249-9a59-c54f276453ee tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:53.618076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-16d3c1d5-7b20-4249-9a59-c54f276453ee tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:53.618789 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-16d3c1d5-7b20-4249-9a59-c54f276453ee tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:53.619251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-16d3c1d5-7b20-4249-9a59-c54f276453ee tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:53.619683 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-16d3c1d5-7b20-4249-9a59-c54f276453ee tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:53.774719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-16d3c1d5-7b20-4249-9a59-c54f276453ee tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:53.787350 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-16d3c1d5-7b20-4249-9a59-c54f276453ee tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1515 microversion: 2.1 time: 0.184433 Oct 29 03:41:53.788248 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3174/6570] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:53 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1515 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:54.813179 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6af42e64-8ba9-4324-8774-6ff6413d1c6a tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:54.813800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6af42e64-8ba9-4324-8774-6ff6413d1c6a tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:54.820949 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6af42e64-8ba9-4324-8774-6ff6413d1c6a tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:54.821444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6af42e64-8ba9-4324-8774-6ff6413d1c6a tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:54.821879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6af42e64-8ba9-4324-8774-6ff6413d1c6a tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:54.822584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6af42e64-8ba9-4324-8774-6ff6413d1c6a tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:54.823039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6af42e64-8ba9-4324-8774-6ff6413d1c6a tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:54.823473 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6af42e64-8ba9-4324-8774-6ff6413d1c6a tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:54.956240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6af42e64-8ba9-4324-8774-6ff6413d1c6a tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:54.968173 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6af42e64-8ba9-4324-8774-6ff6413d1c6a tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1515 microversion: 2.1 time: 0.159743 Oct 29 03:41:54.969080 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3397/6571] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:54 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:55.993125 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5886982c-1e9c-4887-b024-e80c330729dc tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:55.993997 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5886982c-1e9c-4887-b024-e80c330729dc tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:56.002175 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5886982c-1e9c-4887-b024-e80c330729dc tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:56.002706 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5886982c-1e9c-4887-b024-e80c330729dc tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:56.003151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5886982c-1e9c-4887-b024-e80c330729dc tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:56.003860 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5886982c-1e9c-4887-b024-e80c330729dc tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:56.004457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5886982c-1e9c-4887-b024-e80c330729dc tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:56.004961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5886982c-1e9c-4887-b024-e80c330729dc tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:56.142634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5886982c-1e9c-4887-b024-e80c330729dc tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:56.150495 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5886982c-1e9c-4887-b024-e80c330729dc tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1515 microversion: 2.1 time: 0.161536 Oct 29 03:41:56.151089 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3175/6572] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:55 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:57.176380 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-98d0e7c3-ab18-47d6-8581-1c8a567131b9 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:57.177222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-98d0e7c3-ab18-47d6-8581-1c8a567131b9 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:57.180642 n-d-862967-2 devstack@n-api.service[127124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:41:57.180847 n-d-862967-2 devstack@n-api.service[127124]: Sat Oct 29 03:41:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad (ip 10.222.0.46) !!! Oct 29 03:41:57.188728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-98d0e7c3-ab18-47d6-8581-1c8a567131b9 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:57.189329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-98d0e7c3-ab18-47d6-8581-1c8a567131b9 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:57.189874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-98d0e7c3-ab18-47d6-8581-1c8a567131b9 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:57.190737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-98d0e7c3-ab18-47d6-8581-1c8a567131b9 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:57.191288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-98d0e7c3-ab18-47d6-8581-1c8a567131b9 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:57.191819 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-98d0e7c3-ab18-47d6-8581-1c8a567131b9 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:57.329906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-98d0e7c3-ab18-47d6-8581-1c8a567131b9 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:57.339123 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-98d0e7c3-ab18-47d6-8581-1c8a567131b9 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1515 microversion: 2.1 time: 0.167781 Oct 29 03:41:57.340017 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3398/6573] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:57 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:58.368058 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dad9f76c-2605-4116-85d3-2423c5ff35ee tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:58.368967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dad9f76c-2605-4116-85d3-2423c5ff35ee tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:58.378910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dad9f76c-2605-4116-85d3-2423c5ff35ee tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:58.379553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dad9f76c-2605-4116-85d3-2423c5ff35ee tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:58.380008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dad9f76c-2605-4116-85d3-2423c5ff35ee tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:58.380766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dad9f76c-2605-4116-85d3-2423c5ff35ee tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:58.381235 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dad9f76c-2605-4116-85d3-2423c5ff35ee tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:58.381670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dad9f76c-2605-4116-85d3-2423c5ff35ee tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:58.532797 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dad9f76c-2605-4116-85d3-2423c5ff35ee tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:58.540767 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dad9f76c-2605-4116-85d3-2423c5ff35ee tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1515 microversion: 2.1 time: 0.179387 Oct 29 03:41:58.541349 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3176/6574] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:58 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:41:59.567457 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-777722de-45cc-4609-a4c3-78b27a70c75d tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:41:59.568322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-777722de-45cc-4609-a4c3-78b27a70c75d tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:41:59.578564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-777722de-45cc-4609-a4c3-78b27a70c75d tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:59.579376 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-777722de-45cc-4609-a4c3-78b27a70c75d tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:59.579842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-777722de-45cc-4609-a4c3-78b27a70c75d tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:59.580570 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-777722de-45cc-4609-a4c3-78b27a70c75d tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:41:59.581020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-777722de-45cc-4609-a4c3-78b27a70c75d tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:41:59.581441 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-777722de-45cc-4609-a4c3-78b27a70c75d tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:41:59.721446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-777722de-45cc-4609-a4c3-78b27a70c75d tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:41:59.729664 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-777722de-45cc-4609-a4c3-78b27a70c75d tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1515 microversion: 2.1 time: 0.167852 Oct 29 03:41:59.730254 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3399/6575] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:41:59 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:00.756486 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-44ad53ad-587f-4794-ad8a-1627fec13c3a tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:00.757502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-44ad53ad-587f-4794-ad8a-1627fec13c3a tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:00.768374 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44ad53ad-587f-4794-ad8a-1627fec13c3a tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:00.769195 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44ad53ad-587f-4794-ad8a-1627fec13c3a tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:00.769881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44ad53ad-587f-4794-ad8a-1627fec13c3a tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:00.770992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44ad53ad-587f-4794-ad8a-1627fec13c3a tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:00.771708 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44ad53ad-587f-4794-ad8a-1627fec13c3a tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:00.772381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-44ad53ad-587f-4794-ad8a-1627fec13c3a tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:00.907330 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-44ad53ad-587f-4794-ad8a-1627fec13c3a tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:00.915236 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-44ad53ad-587f-4794-ad8a-1627fec13c3a tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1515 microversion: 2.1 time: 0.164991 Oct 29 03:42:00.915813 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3177/6576] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:00 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:01.945847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d2f4c62e-a833-4a50-9fd3-91199dd570d0 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:01.946841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d2f4c62e-a833-4a50-9fd3-91199dd570d0 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:01.959399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d2f4c62e-a833-4a50-9fd3-91199dd570d0 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:01.960225 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d2f4c62e-a833-4a50-9fd3-91199dd570d0 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:01.961047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d2f4c62e-a833-4a50-9fd3-91199dd570d0 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:01.962189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d2f4c62e-a833-4a50-9fd3-91199dd570d0 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:01.962936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d2f4c62e-a833-4a50-9fd3-91199dd570d0 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:01.963642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d2f4c62e-a833-4a50-9fd3-91199dd570d0 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:02.361929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d2f4c62e-a833-4a50-9fd3-91199dd570d0 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:02.369932 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d2f4c62e-a833-4a50-9fd3-91199dd570d0 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1515 microversion: 2.1 time: 0.431016 Oct 29 03:42:02.370897 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3400/6577] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:01 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1515 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:03.395674 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-43fb2f68-9652-4f02-9bb6-82d87220193d tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:03.396271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-43fb2f68-9652-4f02-9bb6-82d87220193d tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:03.399147 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=34 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:42:03.405202 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43fb2f68-9652-4f02-9bb6-82d87220193d tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:03.405725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43fb2f68-9652-4f02-9bb6-82d87220193d tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:03.406194 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43fb2f68-9652-4f02-9bb6-82d87220193d tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:03.406945 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43fb2f68-9652-4f02-9bb6-82d87220193d tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:03.407433 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43fb2f68-9652-4f02-9bb6-82d87220193d tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:03.408081 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43fb2f68-9652-4f02-9bb6-82d87220193d tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:03.411014 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:42:03.558829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-43fb2f68-9652-4f02-9bb6-82d87220193d tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:03.567928 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-43fb2f68-9652-4f02-9bb6-82d87220193d tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1515 microversion: 2.1 time: 0.177453 Oct 29 03:42:03.568512 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3178/6578] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:03 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:04.598322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-58c24def-aa7b-43de-927d-3c34eb26632c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:04.599517 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-58c24def-aa7b-43de-927d-3c34eb26632c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:04.603174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=28 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:42:04.612842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-58c24def-aa7b-43de-927d-3c34eb26632c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:04.613341 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-58c24def-aa7b-43de-927d-3c34eb26632c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:04.613778 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-58c24def-aa7b-43de-927d-3c34eb26632c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:04.614489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-58c24def-aa7b-43de-927d-3c34eb26632c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:04.614945 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-58c24def-aa7b-43de-927d-3c34eb26632c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:04.615371 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-58c24def-aa7b-43de-927d-3c34eb26632c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:04.618179 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=84 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:42:04.753339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-58c24def-aa7b-43de-927d-3c34eb26632c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:04.765442 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-58c24def-aa7b-43de-927d-3c34eb26632c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1515 microversion: 2.1 time: 0.174021 Oct 29 03:42:04.766326 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3401/6579] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:04 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:05.791787 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cb0b7e44-ffb3-4ee9-b309-d48f21872787 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:05.792434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cb0b7e44-ffb3-4ee9-b309-d48f21872787 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:05.802029 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb0b7e44-ffb3-4ee9-b309-d48f21872787 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:05.802673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb0b7e44-ffb3-4ee9-b309-d48f21872787 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:05.803261 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb0b7e44-ffb3-4ee9-b309-d48f21872787 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:05.804197 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb0b7e44-ffb3-4ee9-b309-d48f21872787 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:05.804882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb0b7e44-ffb3-4ee9-b309-d48f21872787 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:05.805462 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cb0b7e44-ffb3-4ee9-b309-d48f21872787 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:05.946657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cb0b7e44-ffb3-4ee9-b309-d48f21872787 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:05.955200 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cb0b7e44-ffb3-4ee9-b309-d48f21872787 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1515 microversion: 2.1 time: 0.168998 Oct 29 03:42:05.955816 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3179/6580] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:05 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:06.986470 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-17e3c6ea-bccc-402e-80d0-2a61b1a8e13c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:06.987152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-17e3c6ea-bccc-402e-80d0-2a61b1a8e13c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:06.994988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17e3c6ea-bccc-402e-80d0-2a61b1a8e13c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:06.995800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17e3c6ea-bccc-402e-80d0-2a61b1a8e13c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:06.996236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17e3c6ea-bccc-402e-80d0-2a61b1a8e13c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:06.996972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17e3c6ea-bccc-402e-80d0-2a61b1a8e13c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:06.997548 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17e3c6ea-bccc-402e-80d0-2a61b1a8e13c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:06.998053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-17e3c6ea-bccc-402e-80d0-2a61b1a8e13c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:07.138418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-17e3c6ea-bccc-402e-80d0-2a61b1a8e13c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:07.146661 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-17e3c6ea-bccc-402e-80d0-2a61b1a8e13c tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1515 microversion: 2.1 time: 0.164992 Oct 29 03:42:07.147279 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3402/6581] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:06 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:08.169755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-bdf392cd-ee38-4d7d-82b3-8154430f3c5d req-27636b07-532a-4826-9da8-462e8f0e8ffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2fc8061-2d69-41ad-a38c-2b0c765701ad", "name": "network-vif-unplugged", "status": "completed", "tag": "41666ced-81e2-48fd-a5e7-0552e588c42b"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:42:08.170354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1cb888d3-3bff-4051-b647-7b4a310d9422 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:08.170696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1cb888d3-3bff-4051-b647-7b4a310d9422 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:08.177832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cb888d3-3bff-4051-b647-7b4a310d9422 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:08.178338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cb888d3-3bff-4051-b647-7b4a310d9422 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:08.178798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cb888d3-3bff-4051-b647-7b4a310d9422 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:08.179502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cb888d3-3bff-4051-b647-7b4a310d9422 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:08.179968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cb888d3-3bff-4051-b647-7b4a310d9422 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:08.180392 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-bdf392cd-ee38-4d7d-82b3-8154430f3c5d req-27636b07-532a-4826-9da8-462e8f0e8ffe service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:08.180562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1cb888d3-3bff-4051-b647-7b4a310d9422 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:08.181205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-bdf392cd-ee38-4d7d-82b3-8154430f3c5d req-27636b07-532a-4826-9da8-462e8f0e8ffe service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:08.182066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-bdf392cd-ee38-4d7d-82b3-8154430f3c5d req-27636b07-532a-4826-9da8-462e8f0e8ffe service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:08.195281 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-bdf392cd-ee38-4d7d-82b3-8154430f3c5d req-27636b07-532a-4826-9da8-462e8f0e8ffe service nova] Creating event network-vif-unplugged:41666ced-81e2-48fd-a5e7-0552e588c42b for instance c2fc8061-2d69-41ad-a38c-2b0c765701ad on n-h1-862967-2 Oct 29 03:42:08.201408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [req-bdf392cd-ee38-4d7d-82b3-8154430f3c5d req-27636b07-532a-4826-9da8-462e8f0e8ffe service nova] Instance c2fc8061-2d69-41ad-a38c-2b0c765701ad is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:42:08.213218 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-bdf392cd-ee38-4d7d-82b3-8154430f3c5d req-27636b07-532a-4826-9da8-462e8f0e8ffe service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047107 Oct 29 03:42:08.214027 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3403/6582] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:42:08.414472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1cb888d3-3bff-4051-b647-7b4a310d9422 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:08.422984 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1cb888d3-3bff-4051-b647-7b4a310d9422 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1514 microversion: 2.1 time: 0.257057 Oct 29 03:42:08.423577 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3180/6583] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:08 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1514 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:09.447601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-347df838-331c-4d50-8a4d-85019bdc4eb3 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:09.448301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-347df838-331c-4d50-8a4d-85019bdc4eb3 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:09.455970 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-347df838-331c-4d50-8a4d-85019bdc4eb3 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:09.456453 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-347df838-331c-4d50-8a4d-85019bdc4eb3 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:09.456919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-347df838-331c-4d50-8a4d-85019bdc4eb3 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:09.457648 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-347df838-331c-4d50-8a4d-85019bdc4eb3 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:09.458104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-347df838-331c-4d50-8a4d-85019bdc4eb3 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:09.458532 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-347df838-331c-4d50-8a4d-85019bdc4eb3 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:09.600549 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-347df838-331c-4d50-8a4d-85019bdc4eb3 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:09.609224 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-347df838-331c-4d50-8a4d-85019bdc4eb3 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1512 microversion: 2.1 time: 0.166013 Oct 29 03:42:09.609824 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3404/6584] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:09 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:42:10.235889 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-aebed197-b753-452c-8450-4be3ace39fb6 req-6155f64c-e38b-4bed-bd0c-68ae435bfaf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2fc8061-2d69-41ad-a38c-2b0c765701ad", "tag": "41666ced-81e2-48fd-a5e7-0552e588c42b"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:42:10.247154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-aebed197-b753-452c-8450-4be3ace39fb6 req-6155f64c-e38b-4bed-bd0c-68ae435bfaf3 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:10.247664 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-aebed197-b753-452c-8450-4be3ace39fb6 req-6155f64c-e38b-4bed-bd0c-68ae435bfaf3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:10.248110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-aebed197-b753-452c-8450-4be3ace39fb6 req-6155f64c-e38b-4bed-bd0c-68ae435bfaf3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:10.263056 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-aebed197-b753-452c-8450-4be3ace39fb6 req-6155f64c-e38b-4bed-bd0c-68ae435bfaf3 service nova] Creating event network-changed:41666ced-81e2-48fd-a5e7-0552e588c42b for instance c2fc8061-2d69-41ad-a38c-2b0c765701ad on n-h1-862967-2 Oct 29 03:42:10.269153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [req-aebed197-b753-452c-8450-4be3ace39fb6 req-6155f64c-e38b-4bed-bd0c-68ae435bfaf3 service nova] Instance c2fc8061-2d69-41ad-a38c-2b0c765701ad is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:42:10.280686 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-aebed197-b753-452c-8450-4be3ace39fb6 req-6155f64c-e38b-4bed-bd0c-68ae435bfaf3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048485 Oct 29 03:42:10.281298 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3181/6585] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:42:10.638629 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a7e4e9c5-6f90-432f-8fb7-026faac6b65a tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:10.640253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a7e4e9c5-6f90-432f-8fb7-026faac6b65a tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:10.648409 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7e4e9c5-6f90-432f-8fb7-026faac6b65a tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:10.649338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7e4e9c5-6f90-432f-8fb7-026faac6b65a tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:10.650366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7e4e9c5-6f90-432f-8fb7-026faac6b65a tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:10.651318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7e4e9c5-6f90-432f-8fb7-026faac6b65a tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:10.651978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7e4e9c5-6f90-432f-8fb7-026faac6b65a tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:10.652660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7e4e9c5-6f90-432f-8fb7-026faac6b65a tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:10.875355 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a7e4e9c5-6f90-432f-8fb7-026faac6b65a tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:10.884796 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a7e4e9c5-6f90-432f-8fb7-026faac6b65a tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1512 microversion: 2.1 time: 0.254723 Oct 29 03:42:10.886020 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3405/6586] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:10 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1512 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:11.914249 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e3fb6da2-6bc8-4e5c-98af-7e6acbbe7c20 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:11.915075 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e3fb6da2-6bc8-4e5c-98af-7e6acbbe7c20 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:11.922882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3fb6da2-6bc8-4e5c-98af-7e6acbbe7c20 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:11.923468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3fb6da2-6bc8-4e5c-98af-7e6acbbe7c20 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:11.923993 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3fb6da2-6bc8-4e5c-98af-7e6acbbe7c20 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:11.924893 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3fb6da2-6bc8-4e5c-98af-7e6acbbe7c20 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:11.925438 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3fb6da2-6bc8-4e5c-98af-7e6acbbe7c20 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:11.925952 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3fb6da2-6bc8-4e5c-98af-7e6acbbe7c20 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:12.070475 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e3fb6da2-6bc8-4e5c-98af-7e6acbbe7c20 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:12.078762 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e3fb6da2-6bc8-4e5c-98af-7e6acbbe7c20 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1509 microversion: 2.1 time: 0.171822 Oct 29 03:42:12.079317 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3182/6587] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:11 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:12.101061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f5c5ce94-8d9c-4c32-a9e8-89b695dc82d3 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:12.101555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f5c5ce94-8d9c-4c32-a9e8-89b695dc82d3 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:12.108680 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5c5ce94-8d9c-4c32-a9e8-89b695dc82d3 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:12.109165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5c5ce94-8d9c-4c32-a9e8-89b695dc82d3 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:12.109597 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5c5ce94-8d9c-4c32-a9e8-89b695dc82d3 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:12.110288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5c5ce94-8d9c-4c32-a9e8-89b695dc82d3 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:12.110739 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5c5ce94-8d9c-4c32-a9e8-89b695dc82d3 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:12.111160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5c5ce94-8d9c-4c32-a9e8-89b695dc82d3 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:12.141902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f5c5ce94-8d9c-4c32-a9e8-89b695dc82d3 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:42:12.475838 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.compute.api [None req-f5c5ce94-8d9c-4c32-a9e8-89b695dc82d3 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Found an unconfirmed migration during delete, id: 16, status: finished Oct 29 03:42:13.995625 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f5c5ce94-8d9c-4c32-a9e8-89b695dc82d3 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 204 len: 0 microversion: 2.1 time: 1.897726 Oct 29 03:42:13.999625 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3406/6588] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:42:12 2022] DELETE /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 0 bytes in 1900 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:42:14.005134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-657b844c-520a-4522-8086-0b1421b8525e tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:14.005911 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-657b844c-520a-4522-8086-0b1421b8525e tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:14.016134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-657b844c-520a-4522-8086-0b1421b8525e tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:14.016716 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-657b844c-520a-4522-8086-0b1421b8525e tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:14.017151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-657b844c-520a-4522-8086-0b1421b8525e tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:14.017865 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-657b844c-520a-4522-8086-0b1421b8525e tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:14.018364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-657b844c-520a-4522-8086-0b1421b8525e tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:14.018794 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-657b844c-520a-4522-8086-0b1421b8525e tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:14.175610 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-657b844c-520a-4522-8086-0b1421b8525e tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:14.187054 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-657b844c-520a-4522-8086-0b1421b8525e tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1501 microversion: 2.1 time: 0.186094 Oct 29 03:42:14.187701 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3183/6589] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:13 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1501 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:42:15.016953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-a079872d-3d34-4deb-967d-e5f83562b977 req-7068359f-5b3a-4e28-8dce-c9679bb1396c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2fc8061-2d69-41ad-a38c-2b0c765701ad", "name": "network-vif-plugged", "status": "completed", "tag": "41666ced-81e2-48fd-a5e7-0552e588c42b"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:42:15.027419 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a079872d-3d34-4deb-967d-e5f83562b977 req-7068359f-5b3a-4e28-8dce-c9679bb1396c service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:15.027937 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a079872d-3d34-4deb-967d-e5f83562b977 req-7068359f-5b3a-4e28-8dce-c9679bb1396c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:15.028432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a079872d-3d34-4deb-967d-e5f83562b977 req-7068359f-5b3a-4e28-8dce-c9679bb1396c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:15.039000 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-a079872d-3d34-4deb-967d-e5f83562b977 req-7068359f-5b3a-4e28-8dce-c9679bb1396c service nova] Creating event network-vif-plugged:41666ced-81e2-48fd-a5e7-0552e588c42b for instance c2fc8061-2d69-41ad-a38c-2b0c765701ad on n-h1-862967-2 Oct 29 03:42:15.043899 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-a079872d-3d34-4deb-967d-e5f83562b977 req-7068359f-5b3a-4e28-8dce-c9679bb1396c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032214 Oct 29 03:42:15.044499 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3407/6590] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:42:15.215845 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-89761f66-99ff-445d-8beb-685d7e02a36b tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:15.216707 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-89761f66-99ff-445d-8beb-685d7e02a36b tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:15.226756 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89761f66-99ff-445d-8beb-685d7e02a36b tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:15.227407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89761f66-99ff-445d-8beb-685d7e02a36b tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:15.227996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89761f66-99ff-445d-8beb-685d7e02a36b tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:15.228974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89761f66-99ff-445d-8beb-685d7e02a36b tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:15.229589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89761f66-99ff-445d-8beb-685d7e02a36b tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:15.230163 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89761f66-99ff-445d-8beb-685d7e02a36b tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:15.376265 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-89761f66-99ff-445d-8beb-685d7e02a36b tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:15.384472 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-89761f66-99ff-445d-8beb-685d7e02a36b tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1501 microversion: 2.1 time: 0.174025 Oct 29 03:42:15.385090 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3184/6591] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:15 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1501 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:15.943066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-8b2992d5-4ee3-4f56-9ace-20dbe20e027d req-e455536e-0afa-49ed-a51e-a1f90e831098 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2fc8061-2d69-41ad-a38c-2b0c765701ad", "name": "network-vif-deleted", "tag": "41666ced-81e2-48fd-a5e7-0552e588c42b"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:42:15.953754 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8b2992d5-4ee3-4f56-9ace-20dbe20e027d req-e455536e-0afa-49ed-a51e-a1f90e831098 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:15.954232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8b2992d5-4ee3-4f56-9ace-20dbe20e027d req-e455536e-0afa-49ed-a51e-a1f90e831098 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:15.954681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8b2992d5-4ee3-4f56-9ace-20dbe20e027d req-e455536e-0afa-49ed-a51e-a1f90e831098 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:15.966631 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-8b2992d5-4ee3-4f56-9ace-20dbe20e027d req-e455536e-0afa-49ed-a51e-a1f90e831098 service nova] Creating event network-vif-deleted:41666ced-81e2-48fd-a5e7-0552e588c42b for instance c2fc8061-2d69-41ad-a38c-2b0c765701ad on n-h1-862967-2 Oct 29 03:42:15.972728 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-8b2992d5-4ee3-4f56-9ace-20dbe20e027d req-e455536e-0afa-49ed-a51e-a1f90e831098 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033586 Oct 29 03:42:15.973351 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3408/6592] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:42:16.410461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6b0a0540-00bc-4243-bb0c-93716ce2a4c5 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:16.411154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6b0a0540-00bc-4243-bb0c-93716ce2a4c5 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:16.418828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b0a0540-00bc-4243-bb0c-93716ce2a4c5 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:16.419332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b0a0540-00bc-4243-bb0c-93716ce2a4c5 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:16.419774 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b0a0540-00bc-4243-bb0c-93716ce2a4c5 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:16.420489 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b0a0540-00bc-4243-bb0c-93716ce2a4c5 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:16.420988 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b0a0540-00bc-4243-bb0c-93716ce2a4c5 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:16.421657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b0a0540-00bc-4243-bb0c-93716ce2a4c5 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:16.453870 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b0a0540-00bc-4243-bb0c-93716ce2a4c5 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:16.454360 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b0a0540-00bc-4243-bb0c-93716ce2a4c5 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:16.454799 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b0a0540-00bc-4243-bb0c-93716ce2a4c5 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:16.455255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-6b0a0540-00bc-4243-bb0c-93716ce2a4c5 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lazy-loading 'fault' on Instance uuid c2fc8061-2d69-41ad-a38c-2b0c765701ad {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:42:16.502277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6b0a0540-00bc-4243-bb0c-93716ce2a4c5 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db1c69d934d482fb3ea475068b0b144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a26e8e20285a4766baec24e6d9e74162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:16.510648 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6b0a0540-00bc-4243-bb0c-93716ce2a4c5 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 200 len: 1305 microversion: 2.1 time: 0.105851 Oct 29 03:42:16.511225 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3185/6593] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:16 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 1305 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:17.536827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-34879f3b-87c9-48be-b2bb-b87a29512ce8 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:17.537528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-34879f3b-87c9-48be-b2bb-b87a29512ce8 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:17.544308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34879f3b-87c9-48be-b2bb-b87a29512ce8 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:17.544818 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34879f3b-87c9-48be-b2bb-b87a29512ce8 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:17.545253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34879f3b-87c9-48be-b2bb-b87a29512ce8 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:17.545949 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34879f3b-87c9-48be-b2bb-b87a29512ce8 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:17.546399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34879f3b-87c9-48be-b2bb-b87a29512ce8 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:17.546820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-34879f3b-87c9-48be-b2bb-b87a29512ce8 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:17.560429 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-34879f3b-87c9-48be-b2bb-b87a29512ce8 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] HTTP exception thrown: Instance c2fc8061-2d69-41ad-a38c-2b0c765701ad could not be found. Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-34879f3b-87c9-48be-b2bb-b87a29512ce8 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Request method failure captured: Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad HTTP/1.1 Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXKDhdiA7vclGC2YUPZJcgANFVloevK1F2jPjQYKX2L6YXUu2BUUWtzd6uzNcXl4VH6Y9KK_90iJ7tmPlkuKemj9PwMtjCjoP8SeRdLcHl4QeqqxYNKQRST4tpLyq70WfEOJftqZAibGVga6FoZrdJfNYq0nyeqiMWcBeEqEWEJgC6Gg Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: a26e8e20285a4766baec24e6d9e74162 Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-DeleteServersTestJSON-779552968 Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a26e8e20285a4766baec24e6d9e74162"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a26e8e20285a4766baec24e6d9e74162"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a26e8e20285a4766baec24e6d9e74162"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a26e8e20285a4766baec24e6d9e74162"}]}] Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-DeleteServersTestJSON-779552968 Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: a26e8e20285a4766baec24e6d9e74162 Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-DeleteServersTestJSON-779552968 Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-DeleteServersTestJSON-779552968-project Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 8db1c69d934d482fb3ea475068b0b144 Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-DeleteServersTestJSON-779552968-project Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance c2fc8061-2d69-41ad-a38c-2b0c765701ad could not be found. Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'c2fc8061-2d69-41ad-a38c-2b0c765701ad'} Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2fc8061-2d69-41ad-a38c-2b0c765701ad could not be found. Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2fc8061-2d69-41ad-a38c-2b0c765701ad could not be found. Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:42:17.562256 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:42:17.567046 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:42:17.567046 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:42:17.567046 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:42:17.567046 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:42:17.567046 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:42:17.567046 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2fc8061-2d69-41ad-a38c-2b0c765701ad could not be found. Oct 29 03:42:17.567046 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:42:17.567046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-34879f3b-87c9-48be-b2bb-b87a29512ce8 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Returning 404 to user: Instance c2fc8061-2d69-41ad-a38c-2b0c765701ad could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:42:17.567046 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-34879f3b-87c9-48be-b2bb-b87a29512ce8 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 404 len: 111 microversion: 2.1 time: 0.032166 Oct 29 03:42:17.567046 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3409/6594] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:17 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:42:17.577357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bbd81c49-9d5c-493c-8272-61c8b1cb7cbe tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:17.577900 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bbd81c49-9d5c-493c-8272-61c8b1cb7cbe tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:17.585161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bbd81c49-9d5c-493c-8272-61c8b1cb7cbe tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:17.585655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bbd81c49-9d5c-493c-8272-61c8b1cb7cbe tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:17.586105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bbd81c49-9d5c-493c-8272-61c8b1cb7cbe tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:17.586819 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bbd81c49-9d5c-493c-8272-61c8b1cb7cbe tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:17.587283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bbd81c49-9d5c-493c-8272-61c8b1cb7cbe tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:17.587704 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bbd81c49-9d5c-493c-8272-61c8b1cb7cbe tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:17.601826 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-bbd81c49-9d5c-493c-8272-61c8b1cb7cbe tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] HTTP exception thrown: Instance c2fc8061-2d69-41ad-a38c-2b0c765701ad could not be found. Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bbd81c49-9d5c-493c-8272-61c8b1cb7cbe tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Request method failure captured: Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad HTTP/1.1 Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKDhdiA7vclGC2YUPZJcgANFVloevK1F2jPjQYKX2L6YXUu2BUUWtzd6uzNcXl4VH6Y9KK_90iJ7tmPlkuKemj9PwMtjCjoP8SeRdLcHl4QeqqxYNKQRST4tpLyq70WfEOJftqZAibGVga6FoZrdJfNYq0nyeqiMWcBeEqEWEJgC6Gg Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: a26e8e20285a4766baec24e6d9e74162 Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-DeleteServersTestJSON-779552968 Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a26e8e20285a4766baec24e6d9e74162"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a26e8e20285a4766baec24e6d9e74162"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a26e8e20285a4766baec24e6d9e74162"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a26e8e20285a4766baec24e6d9e74162"}]}] Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-DeleteServersTestJSON-779552968 Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: a26e8e20285a4766baec24e6d9e74162 Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-DeleteServersTestJSON-779552968 Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-DeleteServersTestJSON-779552968-project Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 8db1c69d934d482fb3ea475068b0b144 Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-DeleteServersTestJSON-779552968-project Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance c2fc8061-2d69-41ad-a38c-2b0c765701ad could not be found. Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'c2fc8061-2d69-41ad-a38c-2b0c765701ad'} Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2fc8061-2d69-41ad-a38c-2b0c765701ad could not be found. Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:42:17.603571 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:42:17.608060 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2fc8061-2d69-41ad-a38c-2b0c765701ad could not be found. Oct 29 03:42:17.608060 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:42:17.608060 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:42:17.608060 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:42:17.608060 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:42:17.608060 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:42:17.608060 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:42:17.608060 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:42:17.608060 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:42:17.608060 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2fc8061-2d69-41ad-a38c-2b0c765701ad could not be found. Oct 29 03:42:17.608060 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:42:17.608060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bbd81c49-9d5c-493c-8272-61c8b1cb7cbe tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Returning 404 to user: Instance c2fc8061-2d69-41ad-a38c-2b0c765701ad could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:42:17.608060 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bbd81c49-9d5c-493c-8272-61c8b1cb7cbe tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 404 len: 111 microversion: 2.1 time: 0.031656 Oct 29 03:42:17.608060 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3186/6595] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:42:17 2022] DELETE /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:42:17.614003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4a756805-5ffb-4cce-800b-c4869e3fdd95 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:17.614630 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4a756805-5ffb-4cce-800b-c4869e3fdd95 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] [instance: c2fc8061-2d69-41ad-a38c-2b0c765701ad] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:17.621400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a756805-5ffb-4cce-800b-c4869e3fdd95 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:17.621894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a756805-5ffb-4cce-800b-c4869e3fdd95 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:17.622306 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a756805-5ffb-4cce-800b-c4869e3fdd95 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:17.622990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a756805-5ffb-4cce-800b-c4869e3fdd95 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:17.623444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a756805-5ffb-4cce-800b-c4869e3fdd95 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:17.623862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a756805-5ffb-4cce-800b-c4869e3fdd95 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:17.637713 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-4a756805-5ffb-4cce-800b-c4869e3fdd95 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] HTTP exception thrown: Instance c2fc8061-2d69-41ad-a38c-2b0c765701ad could not be found. Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4a756805-5ffb-4cce-800b-c4869e3fdd95 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Request method failure captured: Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad HTTP/1.1 Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXKDhdiA7vclGC2YUPZJcgANFVloevK1F2jPjQYKX2L6YXUu2BUUWtzd6uzNcXl4VH6Y9KK_90iJ7tmPlkuKemj9PwMtjCjoP8SeRdLcHl4QeqqxYNKQRST4tpLyq70WfEOJftqZAibGVga6FoZrdJfNYq0nyeqiMWcBeEqEWEJgC6Gg Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: a26e8e20285a4766baec24e6d9e74162 Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-DeleteServersTestJSON-779552968 Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a26e8e20285a4766baec24e6d9e74162"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/a26e8e20285a4766baec24e6d9e74162"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_a26e8e20285a4766baec24e6d9e74162"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/a26e8e20285a4766baec24e6d9e74162"}]}] Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-DeleteServersTestJSON-779552968 Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: a26e8e20285a4766baec24e6d9e74162 Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-DeleteServersTestJSON-779552968 Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-DeleteServersTestJSON-779552968-project Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 8db1c69d934d482fb3ea475068b0b144 Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-DeleteServersTestJSON-779552968-project Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance c2fc8061-2d69-41ad-a38c-2b0c765701ad could not be found. Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'c2fc8061-2d69-41ad-a38c-2b0c765701ad'} Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2fc8061-2d69-41ad-a38c-2b0c765701ad could not be found. Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2fc8061-2d69-41ad-a38c-2b0c765701ad could not be found. Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:42:17.639386 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:42:17.646276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:42:17.646276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:42:17.646276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:42:17.646276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:42:17.646276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:42:17.646276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2fc8061-2d69-41ad-a38c-2b0c765701ad could not be found. Oct 29 03:42:17.646276 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:42:17.646276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4a756805-5ffb-4cce-800b-c4869e3fdd95 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] Returning 404 to user: Instance c2fc8061-2d69-41ad-a38c-2b0c765701ad could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:42:17.646276 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4a756805-5ffb-4cce-800b-c4869e3fdd95 tempest-DeleteServersTestJSON-779552968 tempest-DeleteServersTestJSON-779552968-project] 10.222.0.46 "GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad" status: 404 len: 111 microversion: 2.1 time: 0.030680 Oct 29 03:42:17.646276 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3410/6596] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:17 2022] GET /compute/v2.1/servers/c2fc8061-2d69-41ad-a38c-2b0c765701ad => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:42:26.380813 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f96cb0a4-ad95-4ba7-9ef1-c7b2e5e290b0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1464144124", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "53477a0b-eaa2-4b7b-902a-ef90d445d0a7"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:42:26.444124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-f96cb0a4-ad95-4ba7-9ef1-c7b2e5e290b0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] validate_networks() for [('53477a0b-eaa2-4b7b-902a-ef90d445d0a7', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:42:26.851882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-f96cb0a4-ad95-4ba7-9ef1-c7b2e5e290b0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:42:26.852810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-f96cb0a4-ad95-4ba7-9ef1-c7b2e5e290b0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:42:26.853534 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-f96cb0a4-ad95-4ba7-9ef1-c7b2e5e290b0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:42:26.854165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-f96cb0a4-ad95-4ba7-9ef1-c7b2e5e290b0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:42:26.854855 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-f96cb0a4-ad95-4ba7-9ef1-c7b2e5e290b0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:42:26.870888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f96cb0a4-ad95-4ba7-9ef1-c7b2e5e290b0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:26.871478 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f96cb0a4-ad95-4ba7-9ef1-c7b2e5e290b0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:26.872108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f96cb0a4-ad95-4ba7-9ef1-c7b2e5e290b0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:26.872936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f96cb0a4-ad95-4ba7-9ef1-c7b2e5e290b0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:26.873484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f96cb0a4-ad95-4ba7-9ef1-c7b2e5e290b0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:26.873982 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f96cb0a4-ad95-4ba7-9ef1-c7b2e5e290b0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:26.891199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-f96cb0a4-ad95-4ba7-9ef1-c7b2e5e290b0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Getting quotas for project d1b6c852ae654510a94cb97b848349f8. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:42:26.897555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-f96cb0a4-ad95-4ba7-9ef1-c7b2e5e290b0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Getting quotas for user 134b55be45114e7ca46bef2d50fbb71a and project d1b6c852ae654510a94cb97b848349f8. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:42:26.912485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f96cb0a4-ad95-4ba7-9ef1-c7b2e5e290b0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:42:26.916086 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f96cb0a4-ad95-4ba7-9ef1-c7b2e5e290b0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:42:26.973486 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f96cb0a4-ad95-4ba7-9ef1-c7b2e5e290b0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.718191 Oct 29 03:42:26.974484 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3187/6597] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:42:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:42:26.985508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3e4cd9e8-a63a-42e3-ac90-06e2464fb787 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:26.986133 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3e4cd9e8-a63a-42e3-ac90-06e2464fb787 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:27.078796 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3e4cd9e8-a63a-42e3-ac90-06e2464fb787 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:27.090719 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3e4cd9e8-a63a-42e3-ac90-06e2464fb787 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1218 microversion: 2.1 time: 0.109121 Oct 29 03:42:27.092762 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3411/6598] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:26 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:28.115346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fc040a04-3545-41d8-9e42-cb97bbca6a4b tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:28.115953 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fc040a04-3545-41d8-9e42-cb97bbca6a4b tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:28.409369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc040a04-3545-41d8-9e42-cb97bbca6a4b tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:28.409791 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc040a04-3545-41d8-9e42-cb97bbca6a4b tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:28.410254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc040a04-3545-41d8-9e42-cb97bbca6a4b tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:28.410986 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc040a04-3545-41d8-9e42-cb97bbca6a4b tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:28.411446 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc040a04-3545-41d8-9e42-cb97bbca6a4b tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:28.411884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fc040a04-3545-41d8-9e42-cb97bbca6a4b tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:28.494590 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fc040a04-3545-41d8-9e42-cb97bbca6a4b tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:28.509673 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fc040a04-3545-41d8-9e42-cb97bbca6a4b tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1276 microversion: 2.1 time: 0.398175 Oct 29 03:42:28.510663 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3188/6599] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:28 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1276 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:29.536194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ff16eeec-bbb7-43f0-a81e-c8e91e231b6e tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:29.537460 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ff16eeec-bbb7-43f0-a81e-c8e91e231b6e tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:29.540576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:42:29.548112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff16eeec-bbb7-43f0-a81e-c8e91e231b6e tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:29.548636 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff16eeec-bbb7-43f0-a81e-c8e91e231b6e tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:29.549269 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff16eeec-bbb7-43f0-a81e-c8e91e231b6e tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:29.549977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff16eeec-bbb7-43f0-a81e-c8e91e231b6e tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:29.550433 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff16eeec-bbb7-43f0-a81e-c8e91e231b6e tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:29.550862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff16eeec-bbb7-43f0-a81e-c8e91e231b6e tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:29.765067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ff16eeec-bbb7-43f0-a81e-c8e91e231b6e tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:29.773249 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ff16eeec-bbb7-43f0-a81e-c8e91e231b6e tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1318 microversion: 2.1 time: 0.241032 Oct 29 03:42:29.774090 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3412/6600] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:29 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:42:29.913039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-64c9b0a4-4dc0-4046-9859-e08163dd4019 req-a325894f-102a-4a83-a983-45e2987643a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de827c29-5157-4cf8-a76d-7acc467bb0fd", "tag": "cce9b983-6396-44af-a0c7-12ca39186568"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:42:29.942557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-64c9b0a4-4dc0-4046-9859-e08163dd4019 req-a325894f-102a-4a83-a983-45e2987643a1 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:29.943311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-64c9b0a4-4dc0-4046-9859-e08163dd4019 req-a325894f-102a-4a83-a983-45e2987643a1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:29.943986 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-64c9b0a4-4dc0-4046-9859-e08163dd4019 req-a325894f-102a-4a83-a983-45e2987643a1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:29.957934 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-64c9b0a4-4dc0-4046-9859-e08163dd4019 req-a325894f-102a-4a83-a983-45e2987643a1 service nova] Creating event network-changed:cce9b983-6396-44af-a0c7-12ca39186568 for instance de827c29-5157-4cf8-a76d-7acc467bb0fd on n-h2-862967-2 Oct 29 03:42:29.963956 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-64c9b0a4-4dc0-4046-9859-e08163dd4019 req-a325894f-102a-4a83-a983-45e2987643a1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058340 Oct 29 03:42:29.965226 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3189/6601] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:42:30.800555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0de0a096-8156-4bce-b2f0-a17493e089e4 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:30.801612 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0de0a096-8156-4bce-b2f0-a17493e089e4 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:30.810047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0de0a096-8156-4bce-b2f0-a17493e089e4 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:30.810538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0de0a096-8156-4bce-b2f0-a17493e089e4 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:30.811012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0de0a096-8156-4bce-b2f0-a17493e089e4 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:30.811722 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0de0a096-8156-4bce-b2f0-a17493e089e4 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:30.812172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0de0a096-8156-4bce-b2f0-a17493e089e4 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:30.812644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0de0a096-8156-4bce-b2f0-a17493e089e4 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:30.948212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0de0a096-8156-4bce-b2f0-a17493e089e4 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:30.956337 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0de0a096-8156-4bce-b2f0-a17493e089e4 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1318 microversion: 2.1 time: 0.162434 Oct 29 03:42:30.956936 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3413/6602] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:30 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:31.980843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ea624049-e284-474b-a683-34a08ed97ac8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:31.981554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ea624049-e284-474b-a683-34a08ed97ac8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:31.989106 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea624049-e284-474b-a683-34a08ed97ac8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:31.989598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea624049-e284-474b-a683-34a08ed97ac8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:31.990043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea624049-e284-474b-a683-34a08ed97ac8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:31.990751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea624049-e284-474b-a683-34a08ed97ac8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:31.991845 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea624049-e284-474b-a683-34a08ed97ac8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:31.992319 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea624049-e284-474b-a683-34a08ed97ac8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:32.129451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ea624049-e284-474b-a683-34a08ed97ac8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:32.138063 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ea624049-e284-474b-a683-34a08ed97ac8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1318 microversion: 2.1 time: 0.161769 Oct 29 03:42:32.138644 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3190/6603] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:31 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:33.161782 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-be3ec61a-a9bd-4e30-90e5-2b4d61cae9f0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:33.162405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-be3ec61a-a9bd-4e30-90e5-2b4d61cae9f0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:33.170060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be3ec61a-a9bd-4e30-90e5-2b4d61cae9f0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:33.170931 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be3ec61a-a9bd-4e30-90e5-2b4d61cae9f0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:33.171384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be3ec61a-a9bd-4e30-90e5-2b4d61cae9f0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:33.172140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be3ec61a-a9bd-4e30-90e5-2b4d61cae9f0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:33.172639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be3ec61a-a9bd-4e30-90e5-2b4d61cae9f0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:33.173145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be3ec61a-a9bd-4e30-90e5-2b4d61cae9f0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:33.315217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-be3ec61a-a9bd-4e30-90e5-2b4d61cae9f0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:33.323278 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-be3ec61a-a9bd-4e30-90e5-2b4d61cae9f0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1318 microversion: 2.1 time: 0.165524 Oct 29 03:42:33.323855 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3414/6604] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:33 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:34.347155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a7104522-d5a5-4bde-8056-12be7b043311 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:34.347723 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a7104522-d5a5-4bde-8056-12be7b043311 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:34.350556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:42:34.355962 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7104522-d5a5-4bde-8056-12be7b043311 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:34.356482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7104522-d5a5-4bde-8056-12be7b043311 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:34.356874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7104522-d5a5-4bde-8056-12be7b043311 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:34.357611 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7104522-d5a5-4bde-8056-12be7b043311 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:34.358072 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7104522-d5a5-4bde-8056-12be7b043311 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:34.358473 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a7104522-d5a5-4bde-8056-12be7b043311 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:34.362077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=66 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:42:34.504734 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a7104522-d5a5-4bde-8056-12be7b043311 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:34.512975 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a7104522-d5a5-4bde-8056-12be7b043311 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1318 microversion: 2.1 time: 0.169986 Oct 29 03:42:34.513576 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3191/6605] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:34 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:34.858556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-067887fb-c28f-4186-ac5c-872295eb6796 req-2b1cee94-2b13-462e-baf4-13346361c2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de827c29-5157-4cf8-a76d-7acc467bb0fd", "name": "network-vif-plugged", "status": "completed", "tag": "cce9b983-6396-44af-a0c7-12ca39186568"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:42:34.864425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:42:34.872020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-067887fb-c28f-4186-ac5c-872295eb6796 req-2b1cee94-2b13-462e-baf4-13346361c2e9 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:34.872741 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-067887fb-c28f-4186-ac5c-872295eb6796 req-2b1cee94-2b13-462e-baf4-13346361c2e9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:34.873292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-067887fb-c28f-4186-ac5c-872295eb6796 req-2b1cee94-2b13-462e-baf4-13346361c2e9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:34.887949 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-067887fb-c28f-4186-ac5c-872295eb6796 req-2b1cee94-2b13-462e-baf4-13346361c2e9 service nova] Creating event network-vif-plugged:cce9b983-6396-44af-a0c7-12ca39186568 for instance de827c29-5157-4cf8-a76d-7acc467bb0fd on n-h2-862967-2 Oct 29 03:42:34.893111 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-067887fb-c28f-4186-ac5c-872295eb6796 req-2b1cee94-2b13-462e-baf4-13346361c2e9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038423 Oct 29 03:42:34.893726 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3415/6606] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:42:35.537289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2d2a0580-fcfd-409e-8341-7989d6b3b5f7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:35.537938 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2d2a0580-fcfd-409e-8341-7989d6b3b5f7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:35.545586 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d2a0580-fcfd-409e-8341-7989d6b3b5f7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:35.546077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d2a0580-fcfd-409e-8341-7989d6b3b5f7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:35.546523 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d2a0580-fcfd-409e-8341-7989d6b3b5f7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:35.547237 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d2a0580-fcfd-409e-8341-7989d6b3b5f7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:35.547692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d2a0580-fcfd-409e-8341-7989d6b3b5f7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:35.548127 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d2a0580-fcfd-409e-8341-7989d6b3b5f7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:35.685566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2d2a0580-fcfd-409e-8341-7989d6b3b5f7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:35.694537 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2d2a0580-fcfd-409e-8341-7989d6b3b5f7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1318 microversion: 2.1 time: 0.161228 Oct 29 03:42:35.695084 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3192/6607] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:35 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:36.719641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ef6a1f76-de75-41f9-8004-d802de98fe2c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:36.720462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ef6a1f76-de75-41f9-8004-d802de98fe2c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:36.727161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef6a1f76-de75-41f9-8004-d802de98fe2c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:36.727654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef6a1f76-de75-41f9-8004-d802de98fe2c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:36.728092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef6a1f76-de75-41f9-8004-d802de98fe2c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:36.728862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef6a1f76-de75-41f9-8004-d802de98fe2c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:36.729316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef6a1f76-de75-41f9-8004-d802de98fe2c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:36.729746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ef6a1f76-de75-41f9-8004-d802de98fe2c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:36.873719 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ef6a1f76-de75-41f9-8004-d802de98fe2c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:36.881924 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ef6a1f76-de75-41f9-8004-d802de98fe2c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1508 microversion: 2.1 time: 0.167730 Oct 29 03:42:36.882507 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3416/6608] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:36 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:36.907222 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cbe4ea6d-e0da-4956-8f6d-51511f2270cd tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:36.908146 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cbe4ea6d-e0da-4956-8f6d-51511f2270cd tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:36.912015 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:42:36.913073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:42:36.919946 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbe4ea6d-e0da-4956-8f6d-51511f2270cd tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:36.920450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbe4ea6d-e0da-4956-8f6d-51511f2270cd tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:36.920981 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbe4ea6d-e0da-4956-8f6d-51511f2270cd tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:36.921672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbe4ea6d-e0da-4956-8f6d-51511f2270cd tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:36.922136 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbe4ea6d-e0da-4956-8f6d-51511f2270cd tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:36.922604 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cbe4ea6d-e0da-4956-8f6d-51511f2270cd tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:37.057159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cbe4ea6d-e0da-4956-8f6d-51511f2270cd tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:37.066371 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cbe4ea6d-e0da-4956-8f6d-51511f2270cd tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1508 microversion: 2.1 time: 0.164938 Oct 29 03:42:37.067168 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3193/6609] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:36 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:37.093334 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e49cdb2a-0dcb-4afe-baae-93e6353199ad tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:42:37.095760 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e49cdb2a-0dcb-4afe-baae-93e6353199ad tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:37.097747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:42:37.103358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e49cdb2a-0dcb-4afe-baae-93e6353199ad tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:37.103847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e49cdb2a-0dcb-4afe-baae-93e6353199ad tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:37.104282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e49cdb2a-0dcb-4afe-baae-93e6353199ad tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:37.105019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e49cdb2a-0dcb-4afe-baae-93e6353199ad tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:37.105459 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e49cdb2a-0dcb-4afe-baae-93e6353199ad tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:37.105945 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e49cdb2a-0dcb-4afe-baae-93e6353199ad tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:37.171630 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e49cdb2a-0dcb-4afe-baae-93e6353199ad tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "PUT /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1080 microversion: 2.1 time: 0.082134 Oct 29 03:42:37.172218 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3417/6610] 10.222.0.46 () {60 vars in 1256 bytes} [Sat Oct 29 03:42:37 2022] PUT /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1080 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:37.190928 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-149bf776-2640-46b8-852a-c76e55123474 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:37.191564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-149bf776-2640-46b8-852a-c76e55123474 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:37.197695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-149bf776-2640-46b8-852a-c76e55123474 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:37.198203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-149bf776-2640-46b8-852a-c76e55123474 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:37.198659 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-149bf776-2640-46b8-852a-c76e55123474 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:37.199481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-149bf776-2640-46b8-852a-c76e55123474 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:37.199958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-149bf776-2640-46b8-852a-c76e55123474 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:37.200405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-149bf776-2640-46b8-852a-c76e55123474 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:37.346627 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-149bf776-2640-46b8-852a-c76e55123474 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:37.354494 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-149bf776-2640-46b8-852a-c76e55123474 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1506 microversion: 2.1 time: 0.167590 Oct 29 03:42:37.355069 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3194/6611] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:37 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:37.377290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-41459687-b1ee-492f-aa87-c616407a0de0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:37.377914 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-41459687-b1ee-492f-aa87-c616407a0de0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:37.384174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41459687-b1ee-492f-aa87-c616407a0de0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:37.384695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41459687-b1ee-492f-aa87-c616407a0de0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:37.385136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41459687-b1ee-492f-aa87-c616407a0de0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:37.385848 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41459687-b1ee-492f-aa87-c616407a0de0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:37.386307 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41459687-b1ee-492f-aa87-c616407a0de0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:37.386738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41459687-b1ee-492f-aa87-c616407a0de0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:37.521955 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-41459687-b1ee-492f-aa87-c616407a0de0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:37.530238 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-41459687-b1ee-492f-aa87-c616407a0de0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1506 microversion: 2.1 time: 0.156931 Oct 29 03:42:37.530814 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3418/6612] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:37 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:37.552395 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9bc027a7-3b89-4bb9-9405-f97fda4670bf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:42:37.554753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9bc027a7-3b89-4bb9-9405-f97fda4670bf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:37.561078 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9bc027a7-3b89-4bb9-9405-f97fda4670bf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:37.561572 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9bc027a7-3b89-4bb9-9405-f97fda4670bf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:37.562016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9bc027a7-3b89-4bb9-9405-f97fda4670bf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:37.562717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9bc027a7-3b89-4bb9-9405-f97fda4670bf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:37.563179 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9bc027a7-3b89-4bb9-9405-f97fda4670bf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:37.563609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9bc027a7-3b89-4bb9-9405-f97fda4670bf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:37.598601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9bc027a7-3b89-4bb9-9405-f97fda4670bf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:37.605490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9bc027a7-3b89-4bb9-9405-f97fda4670bf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Old instance type m1.heat2, new instance type m1.heat {{(pid=127125) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 03:42:37.612340 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-9bc027a7-3b89-4bb9-9405-f97fda4670bf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:42:37.612810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-9bc027a7-3b89-4bb9-9405-f97fda4670bf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:42:37.613296 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-9bc027a7-3b89-4bb9-9405-f97fda4670bf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:42:37.613717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-9bc027a7-3b89-4bb9-9405-f97fda4670bf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:42:37.614136 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-9bc027a7-3b89-4bb9-9405-f97fda4670bf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:42:37.682131 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9bc027a7-3b89-4bb9-9405-f97fda4670bf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "POST /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd/action" status: 202 len: 0 microversion: 2.1 time: 0.133662 Oct 29 03:42:37.682743 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3195/6613] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:42:37 2022] POST /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:42:37.691161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1df29604-a9b1-49f0-83d9-57165d955f90 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:37.691882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1df29604-a9b1-49f0-83d9-57165d955f90 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:37.698252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1df29604-a9b1-49f0-83d9-57165d955f90 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:37.698791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1df29604-a9b1-49f0-83d9-57165d955f90 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:37.699202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1df29604-a9b1-49f0-83d9-57165d955f90 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:37.699981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1df29604-a9b1-49f0-83d9-57165d955f90 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:37.700677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1df29604-a9b1-49f0-83d9-57165d955f90 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:37.701020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1df29604-a9b1-49f0-83d9-57165d955f90 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:37.844113 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1df29604-a9b1-49f0-83d9-57165d955f90 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:37.852769 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1df29604-a9b1-49f0-83d9-57165d955f90 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1517 microversion: 2.1 time: 0.165469 Oct 29 03:42:37.853431 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3419/6614] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:37 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:38.877418 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7299e4a8-c4ea-4531-879e-a1296bb37b53 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:38.877944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7299e4a8-c4ea-4531-879e-a1296bb37b53 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:38.886004 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7299e4a8-c4ea-4531-879e-a1296bb37b53 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:38.886537 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7299e4a8-c4ea-4531-879e-a1296bb37b53 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:38.887010 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7299e4a8-c4ea-4531-879e-a1296bb37b53 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:38.887705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7299e4a8-c4ea-4531-879e-a1296bb37b53 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:38.888181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7299e4a8-c4ea-4531-879e-a1296bb37b53 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:38.888666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7299e4a8-c4ea-4531-879e-a1296bb37b53 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:39.028171 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7299e4a8-c4ea-4531-879e-a1296bb37b53 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:39.036565 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7299e4a8-c4ea-4531-879e-a1296bb37b53 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1517 microversion: 2.1 time: 0.164200 Oct 29 03:42:39.037154 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3196/6615] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:38 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:40.062560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1cb03993-4d2b-4c2e-ae54-a389874140c0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:40.063173 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1cb03993-4d2b-4c2e-ae54-a389874140c0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:40.070537 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cb03993-4d2b-4c2e-ae54-a389874140c0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:40.071056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cb03993-4d2b-4c2e-ae54-a389874140c0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:40.071506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cb03993-4d2b-4c2e-ae54-a389874140c0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:40.072231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cb03993-4d2b-4c2e-ae54-a389874140c0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:40.072732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cb03993-4d2b-4c2e-ae54-a389874140c0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:40.073172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1cb03993-4d2b-4c2e-ae54-a389874140c0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:40.217986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1cb03993-4d2b-4c2e-ae54-a389874140c0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:40.226533 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1cb03993-4d2b-4c2e-ae54-a389874140c0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1522 microversion: 2.1 time: 0.169273 Oct 29 03:42:40.227146 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3420/6616] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:40 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:41.255337 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8f895f6c-dfd2-46bc-b35b-9dc6962a6241 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:41.255923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8f895f6c-dfd2-46bc-b35b-9dc6962a6241 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:41.263369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f895f6c-dfd2-46bc-b35b-9dc6962a6241 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:41.263872 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f895f6c-dfd2-46bc-b35b-9dc6962a6241 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:41.264324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f895f6c-dfd2-46bc-b35b-9dc6962a6241 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:41.265071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f895f6c-dfd2-46bc-b35b-9dc6962a6241 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:41.265536 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f895f6c-dfd2-46bc-b35b-9dc6962a6241 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:41.265974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8f895f6c-dfd2-46bc-b35b-9dc6962a6241 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:41.400612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8f895f6c-dfd2-46bc-b35b-9dc6962a6241 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:41.408575 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8f895f6c-dfd2-46bc-b35b-9dc6962a6241 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1522 microversion: 2.1 time: 0.157341 Oct 29 03:42:41.409163 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3197/6617] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:41 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:42.434214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-10852c86-8141-4a8d-b191-6c598a31cd18 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:42.434920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-10852c86-8141-4a8d-b191-6c598a31cd18 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:42.442822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10852c86-8141-4a8d-b191-6c598a31cd18 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:42.443329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10852c86-8141-4a8d-b191-6c598a31cd18 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:42.443792 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10852c86-8141-4a8d-b191-6c598a31cd18 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:42.444555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10852c86-8141-4a8d-b191-6c598a31cd18 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:42.445142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10852c86-8141-4a8d-b191-6c598a31cd18 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:42.445668 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-10852c86-8141-4a8d-b191-6c598a31cd18 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:42.600697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-10852c86-8141-4a8d-b191-6c598a31cd18 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:42.609333 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-10852c86-8141-4a8d-b191-6c598a31cd18 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1522 microversion: 2.1 time: 0.180371 Oct 29 03:42:42.609883 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3421/6618] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:42 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:43.637760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4b6e88d2-7d9e-4401-9a25-251cded71bf3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:43.638400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4b6e88d2-7d9e-4401-9a25-251cded71bf3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:43.646732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b6e88d2-7d9e-4401-9a25-251cded71bf3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:43.647299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b6e88d2-7d9e-4401-9a25-251cded71bf3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:43.647801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b6e88d2-7d9e-4401-9a25-251cded71bf3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:43.648637 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b6e88d2-7d9e-4401-9a25-251cded71bf3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:43.649163 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b6e88d2-7d9e-4401-9a25-251cded71bf3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:43.649662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b6e88d2-7d9e-4401-9a25-251cded71bf3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:43.797110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4b6e88d2-7d9e-4401-9a25-251cded71bf3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:43.808454 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4b6e88d2-7d9e-4401-9a25-251cded71bf3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1522 microversion: 2.1 time: 0.176015 Oct 29 03:42:43.809079 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3198/6619] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:43 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:44.832356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d68fee20-1356-4b91-b13f-08a997347b57 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:44.833029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d68fee20-1356-4b91-b13f-08a997347b57 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:44.840554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d68fee20-1356-4b91-b13f-08a997347b57 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:44.841079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d68fee20-1356-4b91-b13f-08a997347b57 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:44.841511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d68fee20-1356-4b91-b13f-08a997347b57 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:44.842222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d68fee20-1356-4b91-b13f-08a997347b57 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:44.842674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d68fee20-1356-4b91-b13f-08a997347b57 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:44.843095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d68fee20-1356-4b91-b13f-08a997347b57 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:44.987477 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d68fee20-1356-4b91-b13f-08a997347b57 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:44.999973 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d68fee20-1356-4b91-b13f-08a997347b57 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1522 microversion: 2.1 time: 0.171394 Oct 29 03:42:45.001043 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3422/6620] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:44 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:46.028598 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f69f7867-452f-4b46-aebc-699f04ee562f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:46.029277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f69f7867-452f-4b46-aebc-699f04ee562f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:46.036514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f69f7867-452f-4b46-aebc-699f04ee562f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:46.037044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f69f7867-452f-4b46-aebc-699f04ee562f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:46.037487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f69f7867-452f-4b46-aebc-699f04ee562f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:46.038203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f69f7867-452f-4b46-aebc-699f04ee562f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:46.038666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f69f7867-452f-4b46-aebc-699f04ee562f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:46.039094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f69f7867-452f-4b46-aebc-699f04ee562f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:46.183229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f69f7867-452f-4b46-aebc-699f04ee562f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:46.191862 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f69f7867-452f-4b46-aebc-699f04ee562f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1522 microversion: 2.1 time: 0.167455 Oct 29 03:42:46.192446 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3199/6621] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:46 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:47.218696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-13142aaf-41fb-40d4-aa39-a4565e208907 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:47.219506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-13142aaf-41fb-40d4-aa39-a4565e208907 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:47.231089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13142aaf-41fb-40d4-aa39-a4565e208907 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:47.231767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13142aaf-41fb-40d4-aa39-a4565e208907 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:47.232198 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13142aaf-41fb-40d4-aa39-a4565e208907 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:47.232981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13142aaf-41fb-40d4-aa39-a4565e208907 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:47.233434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13142aaf-41fb-40d4-aa39-a4565e208907 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:47.233862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13142aaf-41fb-40d4-aa39-a4565e208907 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:47.368881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-13142aaf-41fb-40d4-aa39-a4565e208907 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:47.377806 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-13142aaf-41fb-40d4-aa39-a4565e208907 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1522 microversion: 2.1 time: 0.165958 Oct 29 03:42:47.378388 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3423/6622] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:47 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:48.402765 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-737800b1-804e-42e1-90a5-a37ee43362e7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:48.403388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-737800b1-804e-42e1-90a5-a37ee43362e7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:48.411424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-737800b1-804e-42e1-90a5-a37ee43362e7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:48.411922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-737800b1-804e-42e1-90a5-a37ee43362e7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:48.412374 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-737800b1-804e-42e1-90a5-a37ee43362e7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:48.413123 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-737800b1-804e-42e1-90a5-a37ee43362e7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:48.413584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-737800b1-804e-42e1-90a5-a37ee43362e7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:48.414050 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-737800b1-804e-42e1-90a5-a37ee43362e7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:48.555495 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-737800b1-804e-42e1-90a5-a37ee43362e7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:48.564146 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-737800b1-804e-42e1-90a5-a37ee43362e7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1522 microversion: 2.1 time: 0.165399 Oct 29 03:42:48.564778 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3200/6623] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:48 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:49.587929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b32fe3c6-5d7c-4165-a166-1223a7ec50fd tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:49.588579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b32fe3c6-5d7c-4165-a166-1223a7ec50fd tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:49.596475 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b32fe3c6-5d7c-4165-a166-1223a7ec50fd tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:49.597002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b32fe3c6-5d7c-4165-a166-1223a7ec50fd tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:49.597440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b32fe3c6-5d7c-4165-a166-1223a7ec50fd tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:49.598167 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b32fe3c6-5d7c-4165-a166-1223a7ec50fd tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:49.598625 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b32fe3c6-5d7c-4165-a166-1223a7ec50fd tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:49.599055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b32fe3c6-5d7c-4165-a166-1223a7ec50fd tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:49.747110 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b32fe3c6-5d7c-4165-a166-1223a7ec50fd tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:49.759013 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b32fe3c6-5d7c-4165-a166-1223a7ec50fd tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1522 microversion: 2.1 time: 0.174736 Oct 29 03:42:49.760493 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3424/6624] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:49 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:50.791568 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1a7cca50-a478-4362-96c0-be454f380335 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:50.792235 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1a7cca50-a478-4362-96c0-be454f380335 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:50.800133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a7cca50-a478-4362-96c0-be454f380335 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:50.800636 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a7cca50-a478-4362-96c0-be454f380335 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:50.801113 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a7cca50-a478-4362-96c0-be454f380335 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:50.801838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a7cca50-a478-4362-96c0-be454f380335 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:50.802298 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a7cca50-a478-4362-96c0-be454f380335 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:50.802731 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a7cca50-a478-4362-96c0-be454f380335 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:50.942100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1a7cca50-a478-4362-96c0-be454f380335 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:50.950270 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1a7cca50-a478-4362-96c0-be454f380335 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1522 microversion: 2.1 time: 0.162888 Oct 29 03:42:50.950951 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3201/6625] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:50 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:51.978180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-50dd8e02-e904-48fd-bfe5-6d41a6ed50ea tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:51.978811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-50dd8e02-e904-48fd-bfe5-6d41a6ed50ea tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:51.986633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50dd8e02-e904-48fd-bfe5-6d41a6ed50ea tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:51.986942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50dd8e02-e904-48fd-bfe5-6d41a6ed50ea tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:51.987372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50dd8e02-e904-48fd-bfe5-6d41a6ed50ea tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:51.988071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50dd8e02-e904-48fd-bfe5-6d41a6ed50ea tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:51.988546 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50dd8e02-e904-48fd-bfe5-6d41a6ed50ea tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:51.988976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50dd8e02-e904-48fd-bfe5-6d41a6ed50ea tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:52.120543 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-50dd8e02-e904-48fd-bfe5-6d41a6ed50ea tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:52.129124 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-50dd8e02-e904-48fd-bfe5-6d41a6ed50ea tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1522 microversion: 2.1 time: 0.154895 Oct 29 03:42:52.129833 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3425/6626] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:51 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:53.155034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a3dc451d-2e46-4364-b286-2b437bd89cfe tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:53.155659 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a3dc451d-2e46-4364-b286-2b437bd89cfe tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:53.163171 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3dc451d-2e46-4364-b286-2b437bd89cfe tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:53.163670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3dc451d-2e46-4364-b286-2b437bd89cfe tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:53.164116 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3dc451d-2e46-4364-b286-2b437bd89cfe tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:53.164856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3dc451d-2e46-4364-b286-2b437bd89cfe tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:53.165318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3dc451d-2e46-4364-b286-2b437bd89cfe tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:53.165757 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a3dc451d-2e46-4364-b286-2b437bd89cfe tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:53.297710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a3dc451d-2e46-4364-b286-2b437bd89cfe tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:53.305584 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a3dc451d-2e46-4364-b286-2b437bd89cfe tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1522 microversion: 2.1 time: 0.154626 Oct 29 03:42:53.306196 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3202/6627] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:53 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:54.328490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3c43bb07-e2f2-4b1f-ae50-1d4c180f3cd3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:54.329085 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3c43bb07-e2f2-4b1f-ae50-1d4c180f3cd3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:54.336167 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c43bb07-e2f2-4b1f-ae50-1d4c180f3cd3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:54.336700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c43bb07-e2f2-4b1f-ae50-1d4c180f3cd3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:54.337141 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c43bb07-e2f2-4b1f-ae50-1d4c180f3cd3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:54.337850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c43bb07-e2f2-4b1f-ae50-1d4c180f3cd3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:54.338311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c43bb07-e2f2-4b1f-ae50-1d4c180f3cd3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:54.338744 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3c43bb07-e2f2-4b1f-ae50-1d4c180f3cd3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:54.468789 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3c43bb07-e2f2-4b1f-ae50-1d4c180f3cd3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:54.476987 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3c43bb07-e2f2-4b1f-ae50-1d4c180f3cd3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1522 microversion: 2.1 time: 0.152533 Oct 29 03:42:54.477552 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3426/6628] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:54 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:55.502715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f9a8d952-842d-491c-bac3-39ad96c0ef50 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:55.503512 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f9a8d952-842d-491c-bac3-39ad96c0ef50 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:55.510796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9a8d952-842d-491c-bac3-39ad96c0ef50 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:55.511304 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9a8d952-842d-491c-bac3-39ad96c0ef50 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:55.511754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9a8d952-842d-491c-bac3-39ad96c0ef50 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:55.512593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9a8d952-842d-491c-bac3-39ad96c0ef50 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:55.513206 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9a8d952-842d-491c-bac3-39ad96c0ef50 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:55.513648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f9a8d952-842d-491c-bac3-39ad96c0ef50 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:55.654754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f9a8d952-842d-491c-bac3-39ad96c0ef50 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:55.663195 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f9a8d952-842d-491c-bac3-39ad96c0ef50 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1522 microversion: 2.1 time: 0.165260 Oct 29 03:42:55.663799 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3203/6629] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:55 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:56.687324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8b1cf494-9872-4bfc-88aa-2a69d7740e44 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:56.687924 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8b1cf494-9872-4bfc-88aa-2a69d7740e44 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:56.695382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b1cf494-9872-4bfc-88aa-2a69d7740e44 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:56.695866 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b1cf494-9872-4bfc-88aa-2a69d7740e44 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:56.696307 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b1cf494-9872-4bfc-88aa-2a69d7740e44 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:56.697051 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b1cf494-9872-4bfc-88aa-2a69d7740e44 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:56.697506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b1cf494-9872-4bfc-88aa-2a69d7740e44 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:56.697935 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8b1cf494-9872-4bfc-88aa-2a69d7740e44 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:56.845030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8b1cf494-9872-4bfc-88aa-2a69d7740e44 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:56.855686 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8b1cf494-9872-4bfc-88aa-2a69d7740e44 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1522 microversion: 2.1 time: 0.172671 Oct 29 03:42:56.856598 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3427/6630] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:56 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:57.882821 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1abed38d-8f6e-4085-b56b-1c7f2f067845 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:57.883470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1abed38d-8f6e-4085-b56b-1c7f2f067845 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:57.891018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1abed38d-8f6e-4085-b56b-1c7f2f067845 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:57.891541 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1abed38d-8f6e-4085-b56b-1c7f2f067845 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:57.891992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1abed38d-8f6e-4085-b56b-1c7f2f067845 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:57.892743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1abed38d-8f6e-4085-b56b-1c7f2f067845 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:57.893216 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1abed38d-8f6e-4085-b56b-1c7f2f067845 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:57.893688 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1abed38d-8f6e-4085-b56b-1c7f2f067845 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:58.026514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1abed38d-8f6e-4085-b56b-1c7f2f067845 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:58.034774 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1abed38d-8f6e-4085-b56b-1c7f2f067845 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1522 microversion: 2.1 time: 0.155947 Oct 29 03:42:58.035970 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3204/6631] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:57 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:42:59.058668 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f8a7f830-9907-414c-8a14-1d30ddbfaf20 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:42:59.059373 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f8a7f830-9907-414c-8a14-1d30ddbfaf20 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:42:59.067159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f8a7f830-9907-414c-8a14-1d30ddbfaf20 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:59.067676 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f8a7f830-9907-414c-8a14-1d30ddbfaf20 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:59.068108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f8a7f830-9907-414c-8a14-1d30ddbfaf20 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:59.068935 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f8a7f830-9907-414c-8a14-1d30ddbfaf20 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:42:59.069331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f8a7f830-9907-414c-8a14-1d30ddbfaf20 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:42:59.069790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f8a7f830-9907-414c-8a14-1d30ddbfaf20 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:42:59.088789 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:42:59.207081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f8a7f830-9907-414c-8a14-1d30ddbfaf20 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:42:59.215374 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f8a7f830-9907-414c-8a14-1d30ddbfaf20 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1522 microversion: 2.1 time: 0.160833 Oct 29 03:42:59.216094 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3428/6632] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:42:59 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:00.239269 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-674e96ab-a31b-4a7d-88f6-ec1185c43ffb tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:00.239876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-674e96ab-a31b-4a7d-88f6-ec1185c43ffb tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:00.248253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-674e96ab-a31b-4a7d-88f6-ec1185c43ffb tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:00.249657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-674e96ab-a31b-4a7d-88f6-ec1185c43ffb tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:00.250301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-674e96ab-a31b-4a7d-88f6-ec1185c43ffb tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:00.251019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-674e96ab-a31b-4a7d-88f6-ec1185c43ffb tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:00.251490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-674e96ab-a31b-4a7d-88f6-ec1185c43ffb tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:00.251935 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-674e96ab-a31b-4a7d-88f6-ec1185c43ffb tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:00.394340 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-674e96ab-a31b-4a7d-88f6-ec1185c43ffb tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:00.406009 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-674e96ab-a31b-4a7d-88f6-ec1185c43ffb tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1522 microversion: 2.1 time: 0.170572 Oct 29 03:43:00.406823 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3205/6633] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:00 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:01.434994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a8e23ff6-198a-490e-a75b-71afd007c60a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:01.435606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a8e23ff6-198a-490e-a75b-71afd007c60a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:01.443496 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8e23ff6-198a-490e-a75b-71afd007c60a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:01.444000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8e23ff6-198a-490e-a75b-71afd007c60a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:01.444456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8e23ff6-198a-490e-a75b-71afd007c60a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:01.445268 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8e23ff6-198a-490e-a75b-71afd007c60a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:01.445728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8e23ff6-198a-490e-a75b-71afd007c60a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:01.446368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a8e23ff6-198a-490e-a75b-71afd007c60a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:01.596956 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a8e23ff6-198a-490e-a75b-71afd007c60a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:01.608128 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a8e23ff6-198a-490e-a75b-71afd007c60a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1522 microversion: 2.1 time: 0.177486 Oct 29 03:43:01.608920 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3429/6634] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:01 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:02.632258 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c0d79737-3bca-44bd-abb5-8664fdd2fbfe tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:02.632941 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c0d79737-3bca-44bd-abb5-8664fdd2fbfe tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:02.640358 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0d79737-3bca-44bd-abb5-8664fdd2fbfe tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:02.640885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0d79737-3bca-44bd-abb5-8664fdd2fbfe tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:02.641336 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0d79737-3bca-44bd-abb5-8664fdd2fbfe tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:02.642048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0d79737-3bca-44bd-abb5-8664fdd2fbfe tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:02.642635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0d79737-3bca-44bd-abb5-8664fdd2fbfe tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:02.643073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0d79737-3bca-44bd-abb5-8664fdd2fbfe tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:02.658407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:43:02.783281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c0d79737-3bca-44bd-abb5-8664fdd2fbfe tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:02.791966 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c0d79737-3bca-44bd-abb5-8664fdd2fbfe tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1522 microversion: 2.1 time: 0.164125 Oct 29 03:43:02.792562 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3206/6635] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:02 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:03.819281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4b32df82-cfaf-49ca-b270-2c4f3110005f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:03.819936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4b32df82-cfaf-49ca-b270-2c4f3110005f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:03.827137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b32df82-cfaf-49ca-b270-2c4f3110005f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:03.827621 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b32df82-cfaf-49ca-b270-2c4f3110005f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:03.828076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b32df82-cfaf-49ca-b270-2c4f3110005f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:03.828795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b32df82-cfaf-49ca-b270-2c4f3110005f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:03.829248 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b32df82-cfaf-49ca-b270-2c4f3110005f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:03.829670 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4b32df82-cfaf-49ca-b270-2c4f3110005f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:03.987531 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4b32df82-cfaf-49ca-b270-2c4f3110005f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:03.996842 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4b32df82-cfaf-49ca-b270-2c4f3110005f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1522 microversion: 2.1 time: 0.182382 Oct 29 03:43:03.997443 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3430/6636] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:03 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:05.021425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cd24314f-ba99-4944-9ea9-2af246554df6 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:05.022067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cd24314f-ba99-4944-9ea9-2af246554df6 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:05.024892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=36 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:43:05.030530 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd24314f-ba99-4944-9ea9-2af246554df6 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:05.031030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd24314f-ba99-4944-9ea9-2af246554df6 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:05.031494 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd24314f-ba99-4944-9ea9-2af246554df6 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:05.032213 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd24314f-ba99-4944-9ea9-2af246554df6 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:05.032726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd24314f-ba99-4944-9ea9-2af246554df6 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:05.033169 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd24314f-ba99-4944-9ea9-2af246554df6 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:05.193810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cd24314f-ba99-4944-9ea9-2af246554df6 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:05.202286 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cd24314f-ba99-4944-9ea9-2af246554df6 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1522 microversion: 2.1 time: 0.184907 Oct 29 03:43:05.202895 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3207/6637] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:05 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:06.226078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a7dfac59-4b23-4436-afaa-e017a0a0f5f2 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:06.226716 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a7dfac59-4b23-4436-afaa-e017a0a0f5f2 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:06.229525 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=32 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:43:06.235417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7dfac59-4b23-4436-afaa-e017a0a0f5f2 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:06.235914 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7dfac59-4b23-4436-afaa-e017a0a0f5f2 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:06.236351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7dfac59-4b23-4436-afaa-e017a0a0f5f2 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:06.237053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7dfac59-4b23-4436-afaa-e017a0a0f5f2 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:06.237559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7dfac59-4b23-4436-afaa-e017a0a0f5f2 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:06.238106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a7dfac59-4b23-4436-afaa-e017a0a0f5f2 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:06.374550 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a7dfac59-4b23-4436-afaa-e017a0a0f5f2 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:06.382950 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a7dfac59-4b23-4436-afaa-e017a0a0f5f2 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1522 microversion: 2.1 time: 0.160990 Oct 29 03:43:06.383535 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3431/6638] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:06 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:07.076136 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-7f502c78-b084-42e5-b6ab-c003d5fec7ea req-cdc9d656-75b5-41b8-a296-595dd4729a63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de827c29-5157-4cf8-a76d-7acc467bb0fd", "name": "network-vif-unplugged", "status": "completed", "tag": "cce9b983-6396-44af-a0c7-12ca39186568"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:43:07.086297 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7f502c78-b084-42e5-b6ab-c003d5fec7ea req-cdc9d656-75b5-41b8-a296-595dd4729a63 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:07.086885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7f502c78-b084-42e5-b6ab-c003d5fec7ea req-cdc9d656-75b5-41b8-a296-595dd4729a63 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:07.087397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7f502c78-b084-42e5-b6ab-c003d5fec7ea req-cdc9d656-75b5-41b8-a296-595dd4729a63 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:07.102842 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-7f502c78-b084-42e5-b6ab-c003d5fec7ea req-cdc9d656-75b5-41b8-a296-595dd4729a63 service nova] Creating event network-vif-unplugged:cce9b983-6396-44af-a0c7-12ca39186568 for instance de827c29-5157-4cf8-a76d-7acc467bb0fd on n-h1-862967-2 Oct 29 03:43:07.108829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [req-7f502c78-b084-42e5-b6ab-c003d5fec7ea req-cdc9d656-75b5-41b8-a296-595dd4729a63 service nova] Instance de827c29-5157-4cf8-a76d-7acc467bb0fd is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:43:07.120560 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-7f502c78-b084-42e5-b6ab-c003d5fec7ea req-cdc9d656-75b5-41b8-a296-595dd4729a63 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049460 Oct 29 03:43:07.121557 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3208/6639] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:43:07.407123 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9a03a998-48a0-4235-b6a2-78730cbffa11 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:07.407741 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9a03a998-48a0-4235-b6a2-78730cbffa11 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:07.415171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9a03a998-48a0-4235-b6a2-78730cbffa11 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:07.415660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9a03a998-48a0-4235-b6a2-78730cbffa11 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:07.416304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9a03a998-48a0-4235-b6a2-78730cbffa11 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:07.417058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9a03a998-48a0-4235-b6a2-78730cbffa11 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:07.417524 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9a03a998-48a0-4235-b6a2-78730cbffa11 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:07.417958 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9a03a998-48a0-4235-b6a2-78730cbffa11 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:07.582106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9a03a998-48a0-4235-b6a2-78730cbffa11 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:07.591400 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9a03a998-48a0-4235-b6a2-78730cbffa11 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1521 microversion: 2.1 time: 0.188254 Oct 29 03:43:07.591975 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3432/6640] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:07 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:08.620295 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c032172e-0f6a-459b-b26b-80038caa64b9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:08.621270 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c032172e-0f6a-459b-b26b-80038caa64b9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:08.630236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c032172e-0f6a-459b-b26b-80038caa64b9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:08.630971 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c032172e-0f6a-459b-b26b-80038caa64b9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:08.631448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c032172e-0f6a-459b-b26b-80038caa64b9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:08.632174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c032172e-0f6a-459b-b26b-80038caa64b9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:08.632677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c032172e-0f6a-459b-b26b-80038caa64b9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:08.633119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c032172e-0f6a-459b-b26b-80038caa64b9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:08.789347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c032172e-0f6a-459b-b26b-80038caa64b9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:08.798330 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c032172e-0f6a-459b-b26b-80038caa64b9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1519 microversion: 2.1 time: 0.185292 Oct 29 03:43:08.798895 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3209/6641] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:08 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1519 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:09.138019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-11862000-5bee-4440-afe4-6efa46393c53 req-49fa3b98-058b-48f7-8869-2a874d744b22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de827c29-5157-4cf8-a76d-7acc467bb0fd", "tag": "cce9b983-6396-44af-a0c7-12ca39186568"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:43:09.149022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-11862000-5bee-4440-afe4-6efa46393c53 req-49fa3b98-058b-48f7-8869-2a874d744b22 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:09.149502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-11862000-5bee-4440-afe4-6efa46393c53 req-49fa3b98-058b-48f7-8869-2a874d744b22 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:09.149938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-11862000-5bee-4440-afe4-6efa46393c53 req-49fa3b98-058b-48f7-8869-2a874d744b22 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:09.165059 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-11862000-5bee-4440-afe4-6efa46393c53 req-49fa3b98-058b-48f7-8869-2a874d744b22 service nova] Creating event network-changed:cce9b983-6396-44af-a0c7-12ca39186568 for instance de827c29-5157-4cf8-a76d-7acc467bb0fd on n-h1-862967-2 Oct 29 03:43:09.170613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [req-11862000-5bee-4440-afe4-6efa46393c53 req-49fa3b98-058b-48f7-8869-2a874d744b22 service nova] Instance de827c29-5157-4cf8-a76d-7acc467bb0fd is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:43:09.182475 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-11862000-5bee-4440-afe4-6efa46393c53 req-49fa3b98-058b-48f7-8869-2a874d744b22 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048366 Oct 29 03:43:09.183345 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3433/6642] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:43:09.826213 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-47d68a14-7ca9-4e10-8e21-bfcb1d7a5351 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:09.827059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-47d68a14-7ca9-4e10-8e21-bfcb1d7a5351 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:09.836475 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47d68a14-7ca9-4e10-8e21-bfcb1d7a5351 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:09.837035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47d68a14-7ca9-4e10-8e21-bfcb1d7a5351 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:09.837466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47d68a14-7ca9-4e10-8e21-bfcb1d7a5351 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:09.838199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47d68a14-7ca9-4e10-8e21-bfcb1d7a5351 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:09.838667 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47d68a14-7ca9-4e10-8e21-bfcb1d7a5351 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:09.839108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-47d68a14-7ca9-4e10-8e21-bfcb1d7a5351 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:10.055987 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-47d68a14-7ca9-4e10-8e21-bfcb1d7a5351 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:10.065830 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-47d68a14-7ca9-4e10-8e21-bfcb1d7a5351 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1516 microversion: 2.1 time: 0.246533 Oct 29 03:43:10.066440 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3210/6643] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:09 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1516 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:10.091717 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9ee70dbe-aeb3-47eb-9cc3-28fc90098951 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:43:10.092603 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9ee70dbe-aeb3-47eb-9cc3-28fc90098951 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:10.100387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ee70dbe-aeb3-47eb-9cc3-28fc90098951 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:10.101118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ee70dbe-aeb3-47eb-9cc3-28fc90098951 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:10.101560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ee70dbe-aeb3-47eb-9cc3-28fc90098951 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:10.102410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ee70dbe-aeb3-47eb-9cc3-28fc90098951 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:10.103045 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ee70dbe-aeb3-47eb-9cc3-28fc90098951 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:10.103578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9ee70dbe-aeb3-47eb-9cc3-28fc90098951 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:10.176268 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9ee70dbe-aeb3-47eb-9cc3-28fc90098951 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "POST /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd/action" status: 204 len: 0 microversion: 2.1 time: 0.089875 Oct 29 03:43:10.177019 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3434/6644] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:43:10 2022] POST /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd/action => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:43:10.186656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-208bf8b0-2098-4e18-b67e-0c5578150555 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:10.187299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-208bf8b0-2098-4e18-b67e-0c5578150555 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:10.193714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-208bf8b0-2098-4e18-b67e-0c5578150555 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:10.194220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-208bf8b0-2098-4e18-b67e-0c5578150555 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:10.194929 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-208bf8b0-2098-4e18-b67e-0c5578150555 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:10.195693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-208bf8b0-2098-4e18-b67e-0c5578150555 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:10.196343 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-208bf8b0-2098-4e18-b67e-0c5578150555 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:10.196800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-208bf8b0-2098-4e18-b67e-0c5578150555 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:10.334315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-208bf8b0-2098-4e18-b67e-0c5578150555 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:10.342770 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-208bf8b0-2098-4e18-b67e-0c5578150555 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1516 microversion: 2.1 time: 0.160280 Oct 29 03:43:10.343357 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3211/6645] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:10 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:43:11.367857 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bf86b228-0969-46b8-8ed5-9ac93a27ba6b tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:11.369484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bf86b228-0969-46b8-8ed5-9ac93a27ba6b tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:11.380831 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf86b228-0969-46b8-8ed5-9ac93a27ba6b tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:11.381685 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf86b228-0969-46b8-8ed5-9ac93a27ba6b tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:11.382592 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf86b228-0969-46b8-8ed5-9ac93a27ba6b tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:11.384048 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf86b228-0969-46b8-8ed5-9ac93a27ba6b tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:11.386538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf86b228-0969-46b8-8ed5-9ac93a27ba6b tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:11.387433 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bf86b228-0969-46b8-8ed5-9ac93a27ba6b tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:11.544165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bf86b228-0969-46b8-8ed5-9ac93a27ba6b tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:11.553189 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bf86b228-0969-46b8-8ed5-9ac93a27ba6b tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1508 microversion: 2.1 time: 0.189790 Oct 29 03:43:11.553911 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3435/6646] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:11 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1508 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:11.577294 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-94838cf8-d586-45a5-9215-6b0d272e38ab tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:11.577754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-94838cf8-d586-45a5-9215-6b0d272e38ab tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:11.585067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-94838cf8-d586-45a5-9215-6b0d272e38ab tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:11.586191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-94838cf8-d586-45a5-9215-6b0d272e38ab tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:11.587185 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-94838cf8-d586-45a5-9215-6b0d272e38ab tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:11.588114 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-94838cf8-d586-45a5-9215-6b0d272e38ab tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:11.588831 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-94838cf8-d586-45a5-9215-6b0d272e38ab tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:11.589279 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-94838cf8-d586-45a5-9215-6b0d272e38ab tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:11.765795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-94838cf8-d586-45a5-9215-6b0d272e38ab tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:11.774112 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-94838cf8-d586-45a5-9215-6b0d272e38ab tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1508 microversion: 2.1 time: 0.201217 Oct 29 03:43:11.774707 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3212/6647] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:11 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1508 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:43:11.800802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-31972c09-241f-4eff-9989-f8ccc03386ac tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Action: 'create', calling method: .version_select at 0x7ff0528ee550>, body: {"keypair": {"name": "tempest-keypair-383709004", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYUYcpgKMCaIewGYv9SQJLfYKja8HDiKNzaJ3T9Gp3g6aN5SWyn+94/6dG2jfaNGXUHDqmMWiTAPO6+z5twbRDkpT7K40qyGk2NayGqE+YWEjhYwILK4xcW2h1w9UK8iQ=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:43:11.819212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-31972c09-241f-4eff-9989-f8ccc03386ac tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Getting quotas for project d1b6c852ae654510a94cb97b848349f8. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:43:11.825508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-31972c09-241f-4eff-9989-f8ccc03386ac tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Getting quotas for user 134b55be45114e7ca46bef2d50fbb71a and project d1b6c852ae654510a94cb97b848349f8. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:43:11.858034 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-31972c09-241f-4eff-9989-f8ccc03386ac tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.061084 Oct 29 03:43:11.858729 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3436/6648] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:43:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:43:13.124761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-88572f44-1370-4402-9c07-b7b157eb31be tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:13.125394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-88572f44-1370-4402-9c07-b7b157eb31be tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:13.132589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88572f44-1370-4402-9c07-b7b157eb31be tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:13.133101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88572f44-1370-4402-9c07-b7b157eb31be tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:13.133555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88572f44-1370-4402-9c07-b7b157eb31be tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:13.134305 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88572f44-1370-4402-9c07-b7b157eb31be tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:13.134770 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88572f44-1370-4402-9c07-b7b157eb31be tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:13.135203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88572f44-1370-4402-9c07-b7b157eb31be tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:13.285495 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-88572f44-1370-4402-9c07-b7b157eb31be tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:13.296790 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-88572f44-1370-4402-9c07-b7b157eb31be tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 200 len: 1508 microversion: 2.1 time: 0.176137 Oct 29 03:43:13.297381 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3213/6649] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:13 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:13.321276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-adea51b8-b314-4082-8b54-510abca490d0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:13.321814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-adea51b8-b314-4082-8b54-510abca490d0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:13.329338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-adea51b8-b314-4082-8b54-510abca490d0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:13.329835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-adea51b8-b314-4082-8b54-510abca490d0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:13.330277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-adea51b8-b314-4082-8b54-510abca490d0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:13.331039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-adea51b8-b314-4082-8b54-510abca490d0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:13.331486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-adea51b8-b314-4082-8b54-510abca490d0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:13.331895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-adea51b8-b314-4082-8b54-510abca490d0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:13.358307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-4830a87b-20bc-464f-986e-13fdbdd83b6f req-f61b7631-d185-42ee-8b4b-ed4dcf67b9ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de827c29-5157-4cf8-a76d-7acc467bb0fd", "name": "network-vif-plugged", "status": "completed", "tag": "cce9b983-6396-44af-a0c7-12ca39186568"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:43:13.359477 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-adea51b8-b314-4082-8b54-510abca490d0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:43:13.376458 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4830a87b-20bc-464f-986e-13fdbdd83b6f req-f61b7631-d185-42ee-8b4b-ed4dcf67b9ea service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:13.376999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4830a87b-20bc-464f-986e-13fdbdd83b6f req-f61b7631-d185-42ee-8b4b-ed4dcf67b9ea service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:13.377433 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4830a87b-20bc-464f-986e-13fdbdd83b6f req-f61b7631-d185-42ee-8b4b-ed4dcf67b9ea service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:13.394189 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-4830a87b-20bc-464f-986e-13fdbdd83b6f req-f61b7631-d185-42ee-8b4b-ed4dcf67b9ea service nova] Creating event network-vif-plugged:cce9b983-6396-44af-a0c7-12ca39186568 for instance de827c29-5157-4cf8-a76d-7acc467bb0fd on n-h1-862967-2 Oct 29 03:43:13.401074 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-4830a87b-20bc-464f-986e-13fdbdd83b6f req-f61b7631-d185-42ee-8b4b-ed4dcf67b9ea service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049702 Oct 29 03:43:13.401963 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3214/6650] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:43:13.448688 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-adea51b8-b314-4082-8b54-510abca490d0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "DELETE /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 204 len: 0 microversion: 2.1 time: 0.131789 Oct 29 03:43:13.450308 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3437/6651] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:43:13 2022] DELETE /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:43:13.509588 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ebcad035-3fa3-48af-a67a-c905a3f34e8c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2031608706", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "53477a0b-eaa2-4b7b-902a-ef90d445d0a7"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:43:13.568416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-ebcad035-3fa3-48af-a67a-c905a3f34e8c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] validate_networks() for [('53477a0b-eaa2-4b7b-902a-ef90d445d0a7', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:43:13.960331 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-ebcad035-3fa3-48af-a67a-c905a3f34e8c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:43:13.960814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-ebcad035-3fa3-48af-a67a-c905a3f34e8c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:43:13.961285 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-ebcad035-3fa3-48af-a67a-c905a3f34e8c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:43:13.961784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-ebcad035-3fa3-48af-a67a-c905a3f34e8c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:43:13.962185 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-ebcad035-3fa3-48af-a67a-c905a3f34e8c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:43:13.971726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ebcad035-3fa3-48af-a67a-c905a3f34e8c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:13.972203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ebcad035-3fa3-48af-a67a-c905a3f34e8c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:13.972708 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ebcad035-3fa3-48af-a67a-c905a3f34e8c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:13.973407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ebcad035-3fa3-48af-a67a-c905a3f34e8c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:13.973878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ebcad035-3fa3-48af-a67a-c905a3f34e8c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:13.974449 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ebcad035-3fa3-48af-a67a-c905a3f34e8c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:13.992886 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-ebcad035-3fa3-48af-a67a-c905a3f34e8c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Getting quotas for project d1b6c852ae654510a94cb97b848349f8. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:43:13.999078 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-ebcad035-3fa3-48af-a67a-c905a3f34e8c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Getting quotas for user 134b55be45114e7ca46bef2d50fbb71a and project d1b6c852ae654510a94cb97b848349f8. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:43:14.012561 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ebcad035-3fa3-48af-a67a-c905a3f34e8c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:43:14.015063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ebcad035-3fa3-48af-a67a-c905a3f34e8c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:43:14.062576 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ebcad035-3fa3-48af-a67a-c905a3f34e8c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557920 Oct 29 03:43:14.063464 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3215/6652] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:43:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:43:14.076665 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b00bab97-45d7-4b1d-9705-5902ddfe0721 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:14.077387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b00bab97-45d7-4b1d-9705-5902ddfe0721 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:14.134795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b00bab97-45d7-4b1d-9705-5902ddfe0721 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:14.143205 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b00bab97-45d7-4b1d-9705-5902ddfe0721 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1218 microversion: 2.1 time: 0.071366 Oct 29 03:43:14.144960 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3438/6653] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:14 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:15.172656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e6faa901-f86c-4240-83ec-0c6a92f14724 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:15.174033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e6faa901-f86c-4240-83ec-0c6a92f14724 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:15.188602 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6faa901-f86c-4240-83ec-0c6a92f14724 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:15.189464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6faa901-f86c-4240-83ec-0c6a92f14724 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:15.190213 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6faa901-f86c-4240-83ec-0c6a92f14724 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:15.190994 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6faa901-f86c-4240-83ec-0c6a92f14724 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:15.191502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6faa901-f86c-4240-83ec-0c6a92f14724 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:15.192219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6faa901-f86c-4240-83ec-0c6a92f14724 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:15.297942 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e6faa901-f86c-4240-83ec-0c6a92f14724 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:15.311282 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e6faa901-f86c-4240-83ec-0c6a92f14724 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1270 microversion: 2.1 time: 0.144241 Oct 29 03:43:15.312260 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3216/6654] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:15 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1270 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:15.820121 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-b7c29d62-3c3a-4113-851b-d543d38be930 req-21b637a7-931a-4f72-be1b-1d3f64910411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de827c29-5157-4cf8-a76d-7acc467bb0fd", "name": "network-vif-deleted", "tag": "cce9b983-6396-44af-a0c7-12ca39186568"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:43:15.833796 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b7c29d62-3c3a-4113-851b-d543d38be930 req-21b637a7-931a-4f72-be1b-1d3f64910411 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:15.834290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b7c29d62-3c3a-4113-851b-d543d38be930 req-21b637a7-931a-4f72-be1b-1d3f64910411 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:15.834756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b7c29d62-3c3a-4113-851b-d543d38be930 req-21b637a7-931a-4f72-be1b-1d3f64910411 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:15.847261 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-b7c29d62-3c3a-4113-851b-d543d38be930 req-21b637a7-931a-4f72-be1b-1d3f64910411 service nova] Creating event network-vif-deleted:cce9b983-6396-44af-a0c7-12ca39186568 for instance de827c29-5157-4cf8-a76d-7acc467bb0fd on n-h1-862967-2 Oct 29 03:43:15.853241 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-b7c29d62-3c3a-4113-851b-d543d38be930 req-21b637a7-931a-4f72-be1b-1d3f64910411 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037094 Oct 29 03:43:15.853916 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3439/6655] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:43:16.341282 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-24ed4aac-20c5-4ce8-9e0f-40a86d8abddb tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:16.342822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-24ed4aac-20c5-4ce8-9e0f-40a86d8abddb tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:16.352936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24ed4aac-20c5-4ce8-9e0f-40a86d8abddb tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:16.353871 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24ed4aac-20c5-4ce8-9e0f-40a86d8abddb tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:16.354563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24ed4aac-20c5-4ce8-9e0f-40a86d8abddb tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:16.355379 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24ed4aac-20c5-4ce8-9e0f-40a86d8abddb tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:16.355783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24ed4aac-20c5-4ce8-9e0f-40a86d8abddb tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:16.356251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24ed4aac-20c5-4ce8-9e0f-40a86d8abddb tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:16.533738 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-24ed4aac-20c5-4ce8-9e0f-40a86d8abddb tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:16.542607 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-24ed4aac-20c5-4ce8-9e0f-40a86d8abddb tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1318 microversion: 2.1 time: 0.206555 Oct 29 03:43:16.543428 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3217/6656] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:16 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:17.072238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-3bb1f3d6-f369-46d0-b3b3-3516772f6c6b req-cc3e464f-bc7e-479c-8000-2dda408949f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "720067fa-f82e-4c68-b9fc-23fee70773c7", "tag": "73915815-79cc-4fad-9b5e-bb46e4883648"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:43:17.085861 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3bb1f3d6-f369-46d0-b3b3-3516772f6c6b req-cc3e464f-bc7e-479c-8000-2dda408949f0 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:17.086947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3bb1f3d6-f369-46d0-b3b3-3516772f6c6b req-cc3e464f-bc7e-479c-8000-2dda408949f0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:17.087523 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3bb1f3d6-f369-46d0-b3b3-3516772f6c6b req-cc3e464f-bc7e-479c-8000-2dda408949f0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:17.102645 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-3bb1f3d6-f369-46d0-b3b3-3516772f6c6b req-cc3e464f-bc7e-479c-8000-2dda408949f0 service nova] Creating event network-changed:73915815-79cc-4fad-9b5e-bb46e4883648 for instance 720067fa-f82e-4c68-b9fc-23fee70773c7 on n-h2-862967-2 Oct 29 03:43:17.107647 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-3bb1f3d6-f369-46d0-b3b3-3516772f6c6b req-cc3e464f-bc7e-479c-8000-2dda408949f0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041955 Oct 29 03:43:17.108699 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3440/6657] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:43:17.567244 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3dd53bb8-5670-4b29-b822-744408b33f29 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:17.567842 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3dd53bb8-5670-4b29-b822-744408b33f29 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:17.575459 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3dd53bb8-5670-4b29-b822-744408b33f29 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:17.575995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3dd53bb8-5670-4b29-b822-744408b33f29 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:17.576447 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3dd53bb8-5670-4b29-b822-744408b33f29 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:17.577213 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3dd53bb8-5670-4b29-b822-744408b33f29 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:17.577679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3dd53bb8-5670-4b29-b822-744408b33f29 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:17.578107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3dd53bb8-5670-4b29-b822-744408b33f29 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:17.724064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3dd53bb8-5670-4b29-b822-744408b33f29 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:17.732405 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3dd53bb8-5670-4b29-b822-744408b33f29 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1318 microversion: 2.1 time: 0.169994 Oct 29 03:43:17.733025 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3218/6658] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:17 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:18.756438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-40f8c69a-e79d-4428-b043-541e26b3d41e tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:18.757290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-40f8c69a-e79d-4428-b043-541e26b3d41e tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:18.767145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40f8c69a-e79d-4428-b043-541e26b3d41e tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:18.767638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40f8c69a-e79d-4428-b043-541e26b3d41e tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:18.768076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40f8c69a-e79d-4428-b043-541e26b3d41e tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:18.768822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40f8c69a-e79d-4428-b043-541e26b3d41e tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:18.769279 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40f8c69a-e79d-4428-b043-541e26b3d41e tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:18.769704 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-40f8c69a-e79d-4428-b043-541e26b3d41e tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:18.909598 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-40f8c69a-e79d-4428-b043-541e26b3d41e tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:18.922668 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-40f8c69a-e79d-4428-b043-541e26b3d41e tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1318 microversion: 2.1 time: 0.170338 Oct 29 03:43:18.923605 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3441/6659] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:18 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:19.951314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4ad36ece-e3d1-46dc-872e-57bba8ecd8c8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:19.952154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4ad36ece-e3d1-46dc-872e-57bba8ecd8c8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:19.960789 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ad36ece-e3d1-46dc-872e-57bba8ecd8c8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:19.961446 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ad36ece-e3d1-46dc-872e-57bba8ecd8c8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:19.962045 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ad36ece-e3d1-46dc-872e-57bba8ecd8c8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:19.962978 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ad36ece-e3d1-46dc-872e-57bba8ecd8c8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:19.963586 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ad36ece-e3d1-46dc-872e-57bba8ecd8c8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:19.964165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4ad36ece-e3d1-46dc-872e-57bba8ecd8c8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:20.117436 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4ad36ece-e3d1-46dc-872e-57bba8ecd8c8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:20.126208 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4ad36ece-e3d1-46dc-872e-57bba8ecd8c8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1318 microversion: 2.1 time: 0.180806 Oct 29 03:43:20.126802 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3219/6660] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:19 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:21.150233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8ee046ed-bb68-41fd-8ae0-6dd0d9332b8a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:21.150827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8ee046ed-bb68-41fd-8ae0-6dd0d9332b8a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:21.158020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8ee046ed-bb68-41fd-8ae0-6dd0d9332b8a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:21.158507 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8ee046ed-bb68-41fd-8ae0-6dd0d9332b8a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:21.158941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8ee046ed-bb68-41fd-8ae0-6dd0d9332b8a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:21.159635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8ee046ed-bb68-41fd-8ae0-6dd0d9332b8a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:21.160084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8ee046ed-bb68-41fd-8ae0-6dd0d9332b8a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:21.160505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8ee046ed-bb68-41fd-8ae0-6dd0d9332b8a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:21.309282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8ee046ed-bb68-41fd-8ae0-6dd0d9332b8a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:21.317397 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8ee046ed-bb68-41fd-8ae0-6dd0d9332b8a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1318 microversion: 2.1 time: 0.171295 Oct 29 03:43:21.318220 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3442/6661] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:21 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:22.342792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-90f3ea41-3c36-4ee8-ae44-e9628716f35d tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:22.343420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-90f3ea41-3c36-4ee8-ae44-e9628716f35d tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:22.351482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90f3ea41-3c36-4ee8-ae44-e9628716f35d tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:22.352032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90f3ea41-3c36-4ee8-ae44-e9628716f35d tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:22.352564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90f3ea41-3c36-4ee8-ae44-e9628716f35d tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:22.353378 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90f3ea41-3c36-4ee8-ae44-e9628716f35d tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:22.353896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90f3ea41-3c36-4ee8-ae44-e9628716f35d tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:22.354389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90f3ea41-3c36-4ee8-ae44-e9628716f35d tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:22.488674 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-90f3ea41-3c36-4ee8-ae44-e9628716f35d tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:22.497541 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-90f3ea41-3c36-4ee8-ae44-e9628716f35d tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1318 microversion: 2.1 time: 0.159275 Oct 29 03:43:22.498061 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3220/6662] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:22 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:22.997054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-b0ae3d36-a861-4dfa-88c7-ba4f95ebffd7 req-2dad11f1-1736-441f-9102-18946047c8c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720067fa-f82e-4c68-b9fc-23fee70773c7", "name": "network-vif-plugged", "status": "completed", "tag": "73915815-79cc-4fad-9b5e-bb46e4883648"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:43:23.008351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b0ae3d36-a861-4dfa-88c7-ba4f95ebffd7 req-2dad11f1-1736-441f-9102-18946047c8c1 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:23.008833 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b0ae3d36-a861-4dfa-88c7-ba4f95ebffd7 req-2dad11f1-1736-441f-9102-18946047c8c1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:23.009266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b0ae3d36-a861-4dfa-88c7-ba4f95ebffd7 req-2dad11f1-1736-441f-9102-18946047c8c1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:23.020957 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-b0ae3d36-a861-4dfa-88c7-ba4f95ebffd7 req-2dad11f1-1736-441f-9102-18946047c8c1 service nova] Creating event network-vif-plugged:73915815-79cc-4fad-9b5e-bb46e4883648 for instance 720067fa-f82e-4c68-b9fc-23fee70773c7 on n-h2-862967-2 Oct 29 03:43:23.026346 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-b0ae3d36-a861-4dfa-88c7-ba4f95ebffd7 req-2dad11f1-1736-441f-9102-18946047c8c1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033702 Oct 29 03:43:23.027046 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3443/6663] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:43:23.522768 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-45baeada-51b2-4597-b797-a1d1d6aa61f2 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:23.523395 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-45baeada-51b2-4597-b797-a1d1d6aa61f2 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:23.531159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45baeada-51b2-4597-b797-a1d1d6aa61f2 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:23.531623 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45baeada-51b2-4597-b797-a1d1d6aa61f2 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:23.532113 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45baeada-51b2-4597-b797-a1d1d6aa61f2 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:23.532901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45baeada-51b2-4597-b797-a1d1d6aa61f2 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:23.533365 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45baeada-51b2-4597-b797-a1d1d6aa61f2 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:23.533815 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-45baeada-51b2-4597-b797-a1d1d6aa61f2 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:23.765043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-45baeada-51b2-4597-b797-a1d1d6aa61f2 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:23.777012 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-45baeada-51b2-4597-b797-a1d1d6aa61f2 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1318 microversion: 2.1 time: 0.258118 Oct 29 03:43:23.777953 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3221/6664] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:23 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:24.802859 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:43:24.807239 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6e580da6-123c-435e-b3b5-7a6dbd45cc91 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:24.808042 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6e580da6-123c-435e-b3b5-7a6dbd45cc91 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:24.815059 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e580da6-123c-435e-b3b5-7a6dbd45cc91 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:24.815547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e580da6-123c-435e-b3b5-7a6dbd45cc91 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:24.815989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e580da6-123c-435e-b3b5-7a6dbd45cc91 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:24.816767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e580da6-123c-435e-b3b5-7a6dbd45cc91 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:24.817228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e580da6-123c-435e-b3b5-7a6dbd45cc91 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:24.817658 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e580da6-123c-435e-b3b5-7a6dbd45cc91 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:24.993383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6e580da6-123c-435e-b3b5-7a6dbd45cc91 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:25.002336 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6e580da6-123c-435e-b3b5-7a6dbd45cc91 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1507 microversion: 2.1 time: 0.201487 Oct 29 03:43:25.002995 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3444/6665] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:24 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1507 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:25.027958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6af3c624-62ce-4365-991f-97961fac0195 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:25.028944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6af3c624-62ce-4365-991f-97961fac0195 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:25.030955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:43:25.031631 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:43:25.038350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6af3c624-62ce-4365-991f-97961fac0195 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:25.038839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6af3c624-62ce-4365-991f-97961fac0195 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:25.039278 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6af3c624-62ce-4365-991f-97961fac0195 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:25.039978 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6af3c624-62ce-4365-991f-97961fac0195 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:25.040437 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6af3c624-62ce-4365-991f-97961fac0195 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:25.040933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6af3c624-62ce-4365-991f-97961fac0195 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:25.191690 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6af3c624-62ce-4365-991f-97961fac0195 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:25.200144 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6af3c624-62ce-4365-991f-97961fac0195 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1507 microversion: 2.1 time: 0.176244 Oct 29 03:43:25.200756 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3222/6666] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:25 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:43:25.222528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1e873389-c196-4c34-975b-baab2e0acf38 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:43:25.224879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1e873389-c196-4c34-975b-baab2e0acf38 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:25.231427 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e873389-c196-4c34-975b-baab2e0acf38 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:25.231913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e873389-c196-4c34-975b-baab2e0acf38 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:25.232342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e873389-c196-4c34-975b-baab2e0acf38 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:25.233068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e873389-c196-4c34-975b-baab2e0acf38 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:25.233520 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e873389-c196-4c34-975b-baab2e0acf38 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:25.233957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e873389-c196-4c34-975b-baab2e0acf38 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:25.264236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1e873389-c196-4c34-975b-baab2e0acf38 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:25.270368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1e873389-c196-4c34-975b-baab2e0acf38 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Old instance type m1.heat2, new instance type m1.heat {{(pid=127124) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 03:43:25.277269 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-1e873389-c196-4c34-975b-baab2e0acf38 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:43:25.277680 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-1e873389-c196-4c34-975b-baab2e0acf38 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:43:25.278149 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-1e873389-c196-4c34-975b-baab2e0acf38 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:43:25.278587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-1e873389-c196-4c34-975b-baab2e0acf38 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:43:25.279015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-1e873389-c196-4c34-975b-baab2e0acf38 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:43:25.317545 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:43:25.350576 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1e873389-c196-4c34-975b-baab2e0acf38 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "POST /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7/action" status: 202 len: 0 microversion: 2.1 time: 0.132110 Oct 29 03:43:25.351266 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3445/6667] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:43:25 2022] POST /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:43:25.359844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f273e403-2bbb-4e8f-8096-c3d22123221c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:25.360511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f273e403-2bbb-4e8f-8096-c3d22123221c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:25.366864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f273e403-2bbb-4e8f-8096-c3d22123221c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:25.367442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f273e403-2bbb-4e8f-8096-c3d22123221c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:25.367896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f273e403-2bbb-4e8f-8096-c3d22123221c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:25.368697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f273e403-2bbb-4e8f-8096-c3d22123221c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:25.369154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f273e403-2bbb-4e8f-8096-c3d22123221c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:25.369952 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f273e403-2bbb-4e8f-8096-c3d22123221c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:25.537109 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f273e403-2bbb-4e8f-8096-c3d22123221c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:25.545668 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f273e403-2bbb-4e8f-8096-c3d22123221c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1514 microversion: 2.1 time: 0.189712 Oct 29 03:43:25.546434 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3223/6668] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:25 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1514 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:26.570227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ee8ef0ef-1bc6-4dc8-82fa-680524a5d6d4 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:26.570848 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ee8ef0ef-1bc6-4dc8-82fa-680524a5d6d4 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:26.578256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee8ef0ef-1bc6-4dc8-82fa-680524a5d6d4 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:26.578748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee8ef0ef-1bc6-4dc8-82fa-680524a5d6d4 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:26.579274 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee8ef0ef-1bc6-4dc8-82fa-680524a5d6d4 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:26.579910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee8ef0ef-1bc6-4dc8-82fa-680524a5d6d4 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:26.580358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee8ef0ef-1bc6-4dc8-82fa-680524a5d6d4 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:26.580838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee8ef0ef-1bc6-4dc8-82fa-680524a5d6d4 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:26.735646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ee8ef0ef-1bc6-4dc8-82fa-680524a5d6d4 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:26.744139 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ee8ef0ef-1bc6-4dc8-82fa-680524a5d6d4 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1514 microversion: 2.1 time: 0.178839 Oct 29 03:43:26.745235 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3446/6669] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:26 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:27.770055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c2d7090b-ca38-4c68-9b0a-ba40e9d2b21d tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:27.770693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c2d7090b-ca38-4c68-9b0a-ba40e9d2b21d tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:27.778925 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2d7090b-ca38-4c68-9b0a-ba40e9d2b21d tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:27.781106 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2d7090b-ca38-4c68-9b0a-ba40e9d2b21d tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:27.781106 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2d7090b-ca38-4c68-9b0a-ba40e9d2b21d tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:27.781491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2d7090b-ca38-4c68-9b0a-ba40e9d2b21d tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:27.781971 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2d7090b-ca38-4c68-9b0a-ba40e9d2b21d tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:27.782467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2d7090b-ca38-4c68-9b0a-ba40e9d2b21d tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:27.917980 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c2d7090b-ca38-4c68-9b0a-ba40e9d2b21d tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:27.920174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:43:27.927763 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c2d7090b-ca38-4c68-9b0a-ba40e9d2b21d tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1519 microversion: 2.1 time: 0.162910 Oct 29 03:43:27.928317 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3224/6670] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:27 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:43:28.955953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f2341779-1eb2-4364-95e1-44968136390b tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:28.957262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f2341779-1eb2-4364-95e1-44968136390b tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:28.968305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2341779-1eb2-4364-95e1-44968136390b tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:28.968820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2341779-1eb2-4364-95e1-44968136390b tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:28.969262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2341779-1eb2-4364-95e1-44968136390b tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:28.969964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2341779-1eb2-4364-95e1-44968136390b tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:28.970421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2341779-1eb2-4364-95e1-44968136390b tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:28.970848 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f2341779-1eb2-4364-95e1-44968136390b tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:29.198963 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f2341779-1eb2-4364-95e1-44968136390b tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:29.207394 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f2341779-1eb2-4364-95e1-44968136390b tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1519 microversion: 2.1 time: 0.258094 Oct 29 03:43:29.207979 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3447/6671] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:28 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1519 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:30.234407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1b78bf87-f487-4299-8ce5-ea24687788ad tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:30.235343 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1b78bf87-f487-4299-8ce5-ea24687788ad tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:30.246837 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b78bf87-f487-4299-8ce5-ea24687788ad tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:30.247749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b78bf87-f487-4299-8ce5-ea24687788ad tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:30.248226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b78bf87-f487-4299-8ce5-ea24687788ad tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:30.249785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b78bf87-f487-4299-8ce5-ea24687788ad tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:30.249785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b78bf87-f487-4299-8ce5-ea24687788ad tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:30.250025 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1b78bf87-f487-4299-8ce5-ea24687788ad tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:30.495603 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1b78bf87-f487-4299-8ce5-ea24687788ad tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:30.505083 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1b78bf87-f487-4299-8ce5-ea24687788ad tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1519 microversion: 2.1 time: 0.276965 Oct 29 03:43:30.505694 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3225/6672] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:30 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1519 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:31.529610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7b1ebda7-a0b6-43c1-acf8-7a8854126ffa tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:31.530226 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7b1ebda7-a0b6-43c1-acf8-7a8854126ffa tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:31.537492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b1ebda7-a0b6-43c1-acf8-7a8854126ffa tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:31.537985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b1ebda7-a0b6-43c1-acf8-7a8854126ffa tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:31.538423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b1ebda7-a0b6-43c1-acf8-7a8854126ffa tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:31.539134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b1ebda7-a0b6-43c1-acf8-7a8854126ffa tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:31.539575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b1ebda7-a0b6-43c1-acf8-7a8854126ffa tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:31.540007 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b1ebda7-a0b6-43c1-acf8-7a8854126ffa tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:31.676632 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7b1ebda7-a0b6-43c1-acf8-7a8854126ffa tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:31.685189 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7b1ebda7-a0b6-43c1-acf8-7a8854126ffa tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1519 microversion: 2.1 time: 0.159582 Oct 29 03:43:31.685808 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3448/6673] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:31 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:32.711472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ae138c1e-768e-421e-8d58-9f5528ed9aec tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:32.712458 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ae138c1e-768e-421e-8d58-9f5528ed9aec tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:32.721575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae138c1e-768e-421e-8d58-9f5528ed9aec tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:32.722086 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae138c1e-768e-421e-8d58-9f5528ed9aec tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:32.722539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae138c1e-768e-421e-8d58-9f5528ed9aec tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:32.723252 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae138c1e-768e-421e-8d58-9f5528ed9aec tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:32.723726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae138c1e-768e-421e-8d58-9f5528ed9aec tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:32.724170 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae138c1e-768e-421e-8d58-9f5528ed9aec tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:32.865917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ae138c1e-768e-421e-8d58-9f5528ed9aec tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:32.874323 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ae138c1e-768e-421e-8d58-9f5528ed9aec tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1519 microversion: 2.1 time: 0.169093 Oct 29 03:43:32.874892 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3226/6674] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:32 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:33.900568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6e93e0c0-6723-42e5-b0d4-b78837c34320 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:33.901502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6e93e0c0-6723-42e5-b0d4-b78837c34320 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:33.909736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e93e0c0-6723-42e5-b0d4-b78837c34320 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:33.910227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e93e0c0-6723-42e5-b0d4-b78837c34320 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:33.910667 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e93e0c0-6723-42e5-b0d4-b78837c34320 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:33.911370 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e93e0c0-6723-42e5-b0d4-b78837c34320 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:33.911833 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e93e0c0-6723-42e5-b0d4-b78837c34320 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:33.912259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6e93e0c0-6723-42e5-b0d4-b78837c34320 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:34.062513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6e93e0c0-6723-42e5-b0d4-b78837c34320 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:34.070880 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6e93e0c0-6723-42e5-b0d4-b78837c34320 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1519 microversion: 2.1 time: 0.175665 Oct 29 03:43:34.071490 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3449/6675] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:33 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:35.096375 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-991d6e56-2cd4-48c2-a9c0-8830034b41eb tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:35.096984 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-991d6e56-2cd4-48c2-a9c0-8830034b41eb tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:35.101067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:43:35.108479 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-991d6e56-2cd4-48c2-a9c0-8830034b41eb tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:35.109188 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-991d6e56-2cd4-48c2-a9c0-8830034b41eb tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:35.109861 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-991d6e56-2cd4-48c2-a9c0-8830034b41eb tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:35.110579 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-991d6e56-2cd4-48c2-a9c0-8830034b41eb tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:35.111042 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-991d6e56-2cd4-48c2-a9c0-8830034b41eb tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:35.111462 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-991d6e56-2cd4-48c2-a9c0-8830034b41eb tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:35.259801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-991d6e56-2cd4-48c2-a9c0-8830034b41eb tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:35.269876 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-991d6e56-2cd4-48c2-a9c0-8830034b41eb tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1519 microversion: 2.1 time: 0.179898 Oct 29 03:43:35.270458 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3227/6676] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:35 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1519 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:36.294184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-82cefa2b-54ce-4811-aa84-f4b65e4c53f3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:36.294742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-82cefa2b-54ce-4811-aa84-f4b65e4c53f3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:36.298162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:43:36.306775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82cefa2b-54ce-4811-aa84-f4b65e4c53f3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:36.307277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82cefa2b-54ce-4811-aa84-f4b65e4c53f3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:36.307718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82cefa2b-54ce-4811-aa84-f4b65e4c53f3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:36.308437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82cefa2b-54ce-4811-aa84-f4b65e4c53f3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:36.308925 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82cefa2b-54ce-4811-aa84-f4b65e4c53f3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:36.309352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82cefa2b-54ce-4811-aa84-f4b65e4c53f3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:36.447197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-82cefa2b-54ce-4811-aa84-f4b65e4c53f3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:36.455702 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-82cefa2b-54ce-4811-aa84-f4b65e4c53f3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1519 microversion: 2.1 time: 0.165584 Oct 29 03:43:36.456297 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3450/6677] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:36 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:37.482818 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f32b11df-f4ed-4d80-875b-da1901495a5f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:37.483400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f32b11df-f4ed-4d80-875b-da1901495a5f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:37.486833 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:43:37.487006 n-d-862967-2 devstack@n-api.service[127125]: Sat Oct 29 03:43:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 (ip 10.222.0.46) !!! Oct 29 03:43:37.500968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f32b11df-f4ed-4d80-875b-da1901495a5f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:37.501496 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f32b11df-f4ed-4d80-875b-da1901495a5f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:37.502164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f32b11df-f4ed-4d80-875b-da1901495a5f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:37.502914 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f32b11df-f4ed-4d80-875b-da1901495a5f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:37.503381 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f32b11df-f4ed-4d80-875b-da1901495a5f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:37.503825 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f32b11df-f4ed-4d80-875b-da1901495a5f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:37.641373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f32b11df-f4ed-4d80-875b-da1901495a5f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:37.651946 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f32b11df-f4ed-4d80-875b-da1901495a5f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1519 microversion: 2.1 time: 0.175078 Oct 29 03:43:37.652692 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3228/6678] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:37 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:38.675837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5a3f12a9-aecf-4a5c-80cd-751ebb2cb617 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:38.676455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5a3f12a9-aecf-4a5c-80cd-751ebb2cb617 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:38.685021 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a3f12a9-aecf-4a5c-80cd-751ebb2cb617 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:38.685675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a3f12a9-aecf-4a5c-80cd-751ebb2cb617 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:38.686118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a3f12a9-aecf-4a5c-80cd-751ebb2cb617 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:38.686847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a3f12a9-aecf-4a5c-80cd-751ebb2cb617 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:38.687339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a3f12a9-aecf-4a5c-80cd-751ebb2cb617 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:38.687767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a3f12a9-aecf-4a5c-80cd-751ebb2cb617 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:38.828152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5a3f12a9-aecf-4a5c-80cd-751ebb2cb617 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:38.836883 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5a3f12a9-aecf-4a5c-80cd-751ebb2cb617 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1519 microversion: 2.1 time: 0.165054 Oct 29 03:43:38.837486 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3451/6679] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:38 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:39.861375 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-927b1694-225c-4503-a651-ea9c7063be7a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:39.862099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-927b1694-225c-4503-a651-ea9c7063be7a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:39.869956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-927b1694-225c-4503-a651-ea9c7063be7a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:39.870459 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-927b1694-225c-4503-a651-ea9c7063be7a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:39.870912 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-927b1694-225c-4503-a651-ea9c7063be7a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:39.871635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-927b1694-225c-4503-a651-ea9c7063be7a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:39.872103 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-927b1694-225c-4503-a651-ea9c7063be7a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:39.872556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-927b1694-225c-4503-a651-ea9c7063be7a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:40.025040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-927b1694-225c-4503-a651-ea9c7063be7a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:40.033547 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-927b1694-225c-4503-a651-ea9c7063be7a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1519 microversion: 2.1 time: 0.176365 Oct 29 03:43:40.034107 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3229/6680] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:39 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:41.057447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d870f3ca-329c-4ce7-a7e4-bf2093163363 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:41.058180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d870f3ca-329c-4ce7-a7e4-bf2093163363 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:41.070460 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d870f3ca-329c-4ce7-a7e4-bf2093163363 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:41.071348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d870f3ca-329c-4ce7-a7e4-bf2093163363 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:41.072079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d870f3ca-329c-4ce7-a7e4-bf2093163363 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:41.073337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d870f3ca-329c-4ce7-a7e4-bf2093163363 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:41.074140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d870f3ca-329c-4ce7-a7e4-bf2093163363 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:41.074795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d870f3ca-329c-4ce7-a7e4-bf2093163363 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:41.216964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d870f3ca-329c-4ce7-a7e4-bf2093163363 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:41.225061 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d870f3ca-329c-4ce7-a7e4-bf2093163363 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1519 microversion: 2.1 time: 0.171735 Oct 29 03:43:41.225626 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3452/6681] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:41 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:42.249793 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f5a4a60d-3ab7-455c-8dac-378e99336fbf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:42.250389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f5a4a60d-3ab7-455c-8dac-378e99336fbf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:42.257888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5a4a60d-3ab7-455c-8dac-378e99336fbf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:42.258389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5a4a60d-3ab7-455c-8dac-378e99336fbf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:42.258830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5a4a60d-3ab7-455c-8dac-378e99336fbf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:42.259560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5a4a60d-3ab7-455c-8dac-378e99336fbf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:42.260023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5a4a60d-3ab7-455c-8dac-378e99336fbf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:42.260457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f5a4a60d-3ab7-455c-8dac-378e99336fbf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:42.407416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f5a4a60d-3ab7-455c-8dac-378e99336fbf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:42.415857 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f5a4a60d-3ab7-455c-8dac-378e99336fbf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1519 microversion: 2.1 time: 0.171579 Oct 29 03:43:42.416446 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3230/6682] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:42 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:43.440000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-649c4aac-ab67-45be-a865-777d383c3953 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:43.440661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-649c4aac-ab67-45be-a865-777d383c3953 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:43.448017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-649c4aac-ab67-45be-a865-777d383c3953 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:43.448513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-649c4aac-ab67-45be-a865-777d383c3953 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:43.448990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-649c4aac-ab67-45be-a865-777d383c3953 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:43.449709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-649c4aac-ab67-45be-a865-777d383c3953 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:43.450169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-649c4aac-ab67-45be-a865-777d383c3953 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:43.450607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-649c4aac-ab67-45be-a865-777d383c3953 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:43.584374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-649c4aac-ab67-45be-a865-777d383c3953 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:43.593268 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-649c4aac-ab67-45be-a865-777d383c3953 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1519 microversion: 2.1 time: 0.157571 Oct 29 03:43:43.594030 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3453/6683] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:43 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:44.622507 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-48e4889d-92ff-4bd3-9d5d-833fac2d1b61 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:44.623143 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-48e4889d-92ff-4bd3-9d5d-833fac2d1b61 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:44.630789 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48e4889d-92ff-4bd3-9d5d-833fac2d1b61 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:44.631545 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48e4889d-92ff-4bd3-9d5d-833fac2d1b61 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:44.632195 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48e4889d-92ff-4bd3-9d5d-833fac2d1b61 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:44.633295 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48e4889d-92ff-4bd3-9d5d-833fac2d1b61 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:44.633956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48e4889d-92ff-4bd3-9d5d-833fac2d1b61 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:44.635291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48e4889d-92ff-4bd3-9d5d-833fac2d1b61 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:44.771176 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-48e4889d-92ff-4bd3-9d5d-833fac2d1b61 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:44.779169 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-48e4889d-92ff-4bd3-9d5d-833fac2d1b61 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1519 microversion: 2.1 time: 0.162625 Oct 29 03:43:44.779771 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3231/6684] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:44 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:45.803140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f8285907-bcd8-449c-82a7-301d6b096dad tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:45.803766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f8285907-bcd8-449c-82a7-301d6b096dad tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:45.811366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f8285907-bcd8-449c-82a7-301d6b096dad tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:45.811892 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f8285907-bcd8-449c-82a7-301d6b096dad tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:45.812329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f8285907-bcd8-449c-82a7-301d6b096dad tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:45.813088 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f8285907-bcd8-449c-82a7-301d6b096dad tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:45.813767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f8285907-bcd8-449c-82a7-301d6b096dad tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:45.814330 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f8285907-bcd8-449c-82a7-301d6b096dad tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:45.980672 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f8285907-bcd8-449c-82a7-301d6b096dad tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:45.992490 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f8285907-bcd8-449c-82a7-301d6b096dad tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1519 microversion: 2.1 time: 0.193266 Oct 29 03:43:45.993204 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3454/6685] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:45 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1519 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:47.020382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d7a651f1-9202-4dd8-90ab-451966e748ff tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:47.021022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d7a651f1-9202-4dd8-90ab-451966e748ff tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:47.028308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d7a651f1-9202-4dd8-90ab-451966e748ff tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:47.028839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d7a651f1-9202-4dd8-90ab-451966e748ff tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:47.029286 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d7a651f1-9202-4dd8-90ab-451966e748ff tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:47.030025 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d7a651f1-9202-4dd8-90ab-451966e748ff tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:47.030482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d7a651f1-9202-4dd8-90ab-451966e748ff tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:47.030912 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d7a651f1-9202-4dd8-90ab-451966e748ff tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:47.184335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d7a651f1-9202-4dd8-90ab-451966e748ff tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:47.192767 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d7a651f1-9202-4dd8-90ab-451966e748ff tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1519 microversion: 2.1 time: 0.177025 Oct 29 03:43:47.193378 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3232/6686] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:47 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:48.217711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9cc9a3ab-62dc-4982-aca0-4270b21f19fd tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:48.218330 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9cc9a3ab-62dc-4982-aca0-4270b21f19fd tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:48.226183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9cc9a3ab-62dc-4982-aca0-4270b21f19fd tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:48.226684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9cc9a3ab-62dc-4982-aca0-4270b21f19fd tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:48.227125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9cc9a3ab-62dc-4982-aca0-4270b21f19fd tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:48.227831 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9cc9a3ab-62dc-4982-aca0-4270b21f19fd tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:48.228408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9cc9a3ab-62dc-4982-aca0-4270b21f19fd tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:48.228975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9cc9a3ab-62dc-4982-aca0-4270b21f19fd tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:48.378113 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9cc9a3ab-62dc-4982-aca0-4270b21f19fd tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:48.386372 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9cc9a3ab-62dc-4982-aca0-4270b21f19fd tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1519 microversion: 2.1 time: 0.172818 Oct 29 03:43:48.386931 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3455/6687] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:48 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:49.413782 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f2a2f8ab-399d-45d1-9047-e8369bf049e9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:49.414435 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f2a2f8ab-399d-45d1-9047-e8369bf049e9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:49.420921 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2a2f8ab-399d-45d1-9047-e8369bf049e9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:49.421422 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2a2f8ab-399d-45d1-9047-e8369bf049e9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:49.421869 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2a2f8ab-399d-45d1-9047-e8369bf049e9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:49.422584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2a2f8ab-399d-45d1-9047-e8369bf049e9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:49.423053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2a2f8ab-399d-45d1-9047-e8369bf049e9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:49.423493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2a2f8ab-399d-45d1-9047-e8369bf049e9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:49.574366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f2a2f8ab-399d-45d1-9047-e8369bf049e9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:49.583179 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f2a2f8ab-399d-45d1-9047-e8369bf049e9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1519 microversion: 2.1 time: 0.174999 Oct 29 03:43:49.583777 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3233/6688] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:49 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:50.611302 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d5962b98-0996-4613-8238-4304c59c5d18 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:50.612380 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d5962b98-0996-4613-8238-4304c59c5d18 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:50.620676 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5962b98-0996-4613-8238-4304c59c5d18 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:50.621162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5962b98-0996-4613-8238-4304c59c5d18 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:50.621593 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5962b98-0996-4613-8238-4304c59c5d18 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:50.622286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5962b98-0996-4613-8238-4304c59c5d18 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:50.622731 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5962b98-0996-4613-8238-4304c59c5d18 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:50.623150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d5962b98-0996-4613-8238-4304c59c5d18 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:50.762963 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d5962b98-0996-4613-8238-4304c59c5d18 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:50.771564 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d5962b98-0996-4613-8238-4304c59c5d18 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1519 microversion: 2.1 time: 0.166968 Oct 29 03:43:50.772122 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3456/6689] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:50 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:51.797151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7d0b7571-f344-46bd-8761-20eefdb9ffc4 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:51.797882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7d0b7571-f344-46bd-8761-20eefdb9ffc4 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:51.806236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7d0b7571-f344-46bd-8761-20eefdb9ffc4 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:51.806754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7d0b7571-f344-46bd-8761-20eefdb9ffc4 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:51.807202 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7d0b7571-f344-46bd-8761-20eefdb9ffc4 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:51.807919 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7d0b7571-f344-46bd-8761-20eefdb9ffc4 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:51.808393 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7d0b7571-f344-46bd-8761-20eefdb9ffc4 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:51.808865 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7d0b7571-f344-46bd-8761-20eefdb9ffc4 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:51.953743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7d0b7571-f344-46bd-8761-20eefdb9ffc4 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:51.962624 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7d0b7571-f344-46bd-8761-20eefdb9ffc4 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1519 microversion: 2.1 time: 0.171306 Oct 29 03:43:51.963177 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3234/6690] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:51 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:52.989948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b848ab30-f841-4fae-bfad-e8e2f881c547 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:52.991004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b848ab30-f841-4fae-bfad-e8e2f881c547 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:53.003068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b848ab30-f841-4fae-bfad-e8e2f881c547 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:53.003869 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b848ab30-f841-4fae-bfad-e8e2f881c547 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:53.004594 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b848ab30-f841-4fae-bfad-e8e2f881c547 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:53.005793 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b848ab30-f841-4fae-bfad-e8e2f881c547 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:53.006671 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b848ab30-f841-4fae-bfad-e8e2f881c547 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:53.007098 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b848ab30-f841-4fae-bfad-e8e2f881c547 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:53.165892 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b848ab30-f841-4fae-bfad-e8e2f881c547 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:53.174203 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b848ab30-f841-4fae-bfad-e8e2f881c547 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1519 microversion: 2.1 time: 0.191027 Oct 29 03:43:53.174787 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3457/6691] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:52 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1519 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:54.200192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3cbed7c8-371f-49c5-bfe3-914dc5b871f7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:54.201199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3cbed7c8-371f-49c5-bfe3-914dc5b871f7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:54.210490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3cbed7c8-371f-49c5-bfe3-914dc5b871f7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:54.210991 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3cbed7c8-371f-49c5-bfe3-914dc5b871f7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:54.211449 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3cbed7c8-371f-49c5-bfe3-914dc5b871f7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:54.212163 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3cbed7c8-371f-49c5-bfe3-914dc5b871f7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:54.212672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3cbed7c8-371f-49c5-bfe3-914dc5b871f7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:54.213118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3cbed7c8-371f-49c5-bfe3-914dc5b871f7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:54.355846 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3cbed7c8-371f-49c5-bfe3-914dc5b871f7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:54.367907 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3cbed7c8-371f-49c5-bfe3-914dc5b871f7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1519 microversion: 2.1 time: 0.172708 Oct 29 03:43:54.368769 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3235/6692] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:54 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:55.396546 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ab2fc24a-97d4-4f84-a7b3-e517b06df817 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:55.397094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ab2fc24a-97d4-4f84-a7b3-e517b06df817 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:55.404725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ab2fc24a-97d4-4f84-a7b3-e517b06df817 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:55.405225 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ab2fc24a-97d4-4f84-a7b3-e517b06df817 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:55.405671 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ab2fc24a-97d4-4f84-a7b3-e517b06df817 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:55.406368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ab2fc24a-97d4-4f84-a7b3-e517b06df817 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:55.406826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ab2fc24a-97d4-4f84-a7b3-e517b06df817 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:55.407265 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ab2fc24a-97d4-4f84-a7b3-e517b06df817 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:55.409959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:43:55.542538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ab2fc24a-97d4-4f84-a7b3-e517b06df817 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:55.550677 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ab2fc24a-97d4-4f84-a7b3-e517b06df817 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1519 microversion: 2.1 time: 0.158287 Oct 29 03:43:55.551278 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3458/6693] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:55 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:56.574240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0d7a29b1-5270-487e-b959-30cef755824c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:56.574848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0d7a29b1-5270-487e-b959-30cef755824c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:56.582567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0d7a29b1-5270-487e-b959-30cef755824c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:56.583057 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0d7a29b1-5270-487e-b959-30cef755824c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:56.583499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0d7a29b1-5270-487e-b959-30cef755824c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:56.584200 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0d7a29b1-5270-487e-b959-30cef755824c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:56.584696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0d7a29b1-5270-487e-b959-30cef755824c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:56.585127 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0d7a29b1-5270-487e-b959-30cef755824c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:56.727794 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0d7a29b1-5270-487e-b959-30cef755824c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:56.736176 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0d7a29b1-5270-487e-b959-30cef755824c tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1519 microversion: 2.1 time: 0.166159 Oct 29 03:43:56.736820 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3236/6694] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:56 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:57.762849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-95c7e784-c39c-4f0e-a30f-705caa9a1656 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:57.763621 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-95c7e784-c39c-4f0e-a30f-705caa9a1656 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:57.773333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95c7e784-c39c-4f0e-a30f-705caa9a1656 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:57.773827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95c7e784-c39c-4f0e-a30f-705caa9a1656 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:57.774244 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95c7e784-c39c-4f0e-a30f-705caa9a1656 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:57.774960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95c7e784-c39c-4f0e-a30f-705caa9a1656 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:57.775419 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95c7e784-c39c-4f0e-a30f-705caa9a1656 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:57.775885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95c7e784-c39c-4f0e-a30f-705caa9a1656 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:57.914042 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-95c7e784-c39c-4f0e-a30f-705caa9a1656 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:57.926025 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-95c7e784-c39c-4f0e-a30f-705caa9a1656 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1519 microversion: 2.1 time: 0.168243 Oct 29 03:43:57.926777 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3459/6695] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:57 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:58.951503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7bca0bfa-8f4e-4791-b512-1c0a6a21008a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:43:58.952215 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7bca0bfa-8f4e-4791-b512-1c0a6a21008a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:43:58.960284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7bca0bfa-8f4e-4791-b512-1c0a6a21008a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:58.960851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7bca0bfa-8f4e-4791-b512-1c0a6a21008a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:58.961325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7bca0bfa-8f4e-4791-b512-1c0a6a21008a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:58.962089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7bca0bfa-8f4e-4791-b512-1c0a6a21008a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:58.962576 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7bca0bfa-8f4e-4791-b512-1c0a6a21008a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:58.963059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7bca0bfa-8f4e-4791-b512-1c0a6a21008a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:58.965930 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=74 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:43:59.105591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7bca0bfa-8f4e-4791-b512-1c0a6a21008a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:43:59.113820 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7bca0bfa-8f4e-4791-b512-1c0a6a21008a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1519 microversion: 2.1 time: 0.166656 Oct 29 03:43:59.114445 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3237/6696] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:43:58 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:43:59.816714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-29a9a72b-2c43-4a94-b52f-2259274d7744 req-028ddd23-c02f-4e7b-979d-3824a76ad4ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720067fa-f82e-4c68-b9fc-23fee70773c7", "name": "network-vif-unplugged", "status": "completed", "tag": "73915815-79cc-4fad-9b5e-bb46e4883648"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:43:59.827239 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-29a9a72b-2c43-4a94-b52f-2259274d7744 req-028ddd23-c02f-4e7b-979d-3824a76ad4ba service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:43:59.827722 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-29a9a72b-2c43-4a94-b52f-2259274d7744 req-028ddd23-c02f-4e7b-979d-3824a76ad4ba service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:43:59.828151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-29a9a72b-2c43-4a94-b52f-2259274d7744 req-028ddd23-c02f-4e7b-979d-3824a76ad4ba service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:43:59.840407 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-29a9a72b-2c43-4a94-b52f-2259274d7744 req-028ddd23-c02f-4e7b-979d-3824a76ad4ba service nova] Creating event network-vif-unplugged:73915815-79cc-4fad-9b5e-bb46e4883648 for instance 720067fa-f82e-4c68-b9fc-23fee70773c7 on n-h1-862967-2 Oct 29 03:43:59.846568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [req-29a9a72b-2c43-4a94-b52f-2259274d7744 req-028ddd23-c02f-4e7b-979d-3824a76ad4ba service nova] Instance 720067fa-f82e-4c68-b9fc-23fee70773c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:43:59.857913 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-29a9a72b-2c43-4a94-b52f-2259274d7744 req-028ddd23-c02f-4e7b-979d-3824a76ad4ba service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046330 Oct 29 03:43:59.858555 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3460/6697] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:44:00.137888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6971cf84-cac1-470c-897d-52e56335f0e9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:00.138531 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6971cf84-cac1-470c-897d-52e56335f0e9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:00.145677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6971cf84-cac1-470c-897d-52e56335f0e9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:00.146180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6971cf84-cac1-470c-897d-52e56335f0e9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:00.147065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6971cf84-cac1-470c-897d-52e56335f0e9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:00.147347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6971cf84-cac1-470c-897d-52e56335f0e9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:00.147810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6971cf84-cac1-470c-897d-52e56335f0e9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:00.148252 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6971cf84-cac1-470c-897d-52e56335f0e9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:00.364908 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6971cf84-cac1-470c-897d-52e56335f0e9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:00.374164 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6971cf84-cac1-470c-897d-52e56335f0e9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1518 microversion: 2.1 time: 0.240614 Oct 29 03:44:00.374677 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3238/6698] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:00 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1518 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:44:01.404156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2e3144dd-6f2e-44ab-a4f3-0a40354b8276 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:01.404805 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2e3144dd-6f2e-44ab-a4f3-0a40354b8276 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:01.412685 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e3144dd-6f2e-44ab-a4f3-0a40354b8276 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:01.413215 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e3144dd-6f2e-44ab-a4f3-0a40354b8276 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:01.413668 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e3144dd-6f2e-44ab-a4f3-0a40354b8276 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:01.414401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e3144dd-6f2e-44ab-a4f3-0a40354b8276 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:01.414874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e3144dd-6f2e-44ab-a4f3-0a40354b8276 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:01.415321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e3144dd-6f2e-44ab-a4f3-0a40354b8276 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:01.560811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2e3144dd-6f2e-44ab-a4f3-0a40354b8276 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:01.572963 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2e3144dd-6f2e-44ab-a4f3-0a40354b8276 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1516 microversion: 2.1 time: 0.174105 Oct 29 03:44:01.573737 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3461/6699] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:01 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:44:01.886712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-f70a41ed-dcd3-45d5-bd59-e0f0271638d0 req-50868458-b3ca-4b1e-9b23-c33d7704cd65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "720067fa-f82e-4c68-b9fc-23fee70773c7", "tag": "73915815-79cc-4fad-9b5e-bb46e4883648"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:44:01.897629 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f70a41ed-dcd3-45d5-bd59-e0f0271638d0 req-50868458-b3ca-4b1e-9b23-c33d7704cd65 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:01.898118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f70a41ed-dcd3-45d5-bd59-e0f0271638d0 req-50868458-b3ca-4b1e-9b23-c33d7704cd65 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:01.898566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f70a41ed-dcd3-45d5-bd59-e0f0271638d0 req-50868458-b3ca-4b1e-9b23-c33d7704cd65 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:01.910995 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-f70a41ed-dcd3-45d5-bd59-e0f0271638d0 req-50868458-b3ca-4b1e-9b23-c33d7704cd65 service nova] Creating event network-changed:73915815-79cc-4fad-9b5e-bb46e4883648 for instance 720067fa-f82e-4c68-b9fc-23fee70773c7 on n-h1-862967-2 Oct 29 03:44:01.916720 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [req-f70a41ed-dcd3-45d5-bd59-e0f0271638d0 req-50868458-b3ca-4b1e-9b23-c33d7704cd65 service nova] Instance 720067fa-f82e-4c68-b9fc-23fee70773c7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:44:01.927861 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-f70a41ed-dcd3-45d5-bd59-e0f0271638d0 req-50868458-b3ca-4b1e-9b23-c33d7704cd65 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046761 Oct 29 03:44:01.928457 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3239/6700] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:44:02.597033 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2e3ac586-f90d-40f1-bb31-ad19ee97ac5f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:02.597624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2e3ac586-f90d-40f1-bb31-ad19ee97ac5f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:02.604310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e3ac586-f90d-40f1-bb31-ad19ee97ac5f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:02.605062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e3ac586-f90d-40f1-bb31-ad19ee97ac5f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:02.605497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e3ac586-f90d-40f1-bb31-ad19ee97ac5f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:02.606204 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e3ac586-f90d-40f1-bb31-ad19ee97ac5f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:02.606653 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e3ac586-f90d-40f1-bb31-ad19ee97ac5f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:02.607079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e3ac586-f90d-40f1-bb31-ad19ee97ac5f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:02.745613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2e3ac586-f90d-40f1-bb31-ad19ee97ac5f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:02.753813 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2e3ac586-f90d-40f1-bb31-ad19ee97ac5f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1513 microversion: 2.1 time: 0.160987 Oct 29 03:44:02.754375 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3462/6701] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:02 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:44:02.778062 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c947ff90-f1c0-4d18-b94e-576801b7981a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:44:02.778714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c947ff90-f1c0-4d18-b94e-576801b7981a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:02.785696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c947ff90-f1c0-4d18-b94e-576801b7981a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:02.786200 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c947ff90-f1c0-4d18-b94e-576801b7981a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:02.786656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c947ff90-f1c0-4d18-b94e-576801b7981a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:02.787394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c947ff90-f1c0-4d18-b94e-576801b7981a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:02.787846 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c947ff90-f1c0-4d18-b94e-576801b7981a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:02.788286 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c947ff90-f1c0-4d18-b94e-576801b7981a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:02.855900 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c947ff90-f1c0-4d18-b94e-576801b7981a tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "POST /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7/action" status: 204 len: 0 microversion: 2.1 time: 0.082289 Oct 29 03:44:02.856580 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3240/6702] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:44:02 2022] POST /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7/action => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:44:02.864970 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-13bf63e3-22b0-4974-9a70-134c56f02eff tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:02.865707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-13bf63e3-22b0-4974-9a70-134c56f02eff tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:02.872510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13bf63e3-22b0-4974-9a70-134c56f02eff tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:02.873153 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13bf63e3-22b0-4974-9a70-134c56f02eff tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:02.873675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13bf63e3-22b0-4974-9a70-134c56f02eff tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:02.874467 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13bf63e3-22b0-4974-9a70-134c56f02eff tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:02.875042 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13bf63e3-22b0-4974-9a70-134c56f02eff tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:02.875511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13bf63e3-22b0-4974-9a70-134c56f02eff tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:03.089170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-13bf63e3-22b0-4974-9a70-134c56f02eff tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:03.097372 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-13bf63e3-22b0-4974-9a70-134c56f02eff tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1513 microversion: 2.1 time: 0.236336 Oct 29 03:44:03.098162 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3463/6703] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:02 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1513 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:44:04.123052 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6f9b36b5-9261-4736-95cd-b51072788fdf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:04.124392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6f9b36b5-9261-4736-95cd-b51072788fdf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:04.130934 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f9b36b5-9261-4736-95cd-b51072788fdf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:04.131710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f9b36b5-9261-4736-95cd-b51072788fdf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:04.132165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f9b36b5-9261-4736-95cd-b51072788fdf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:04.132906 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f9b36b5-9261-4736-95cd-b51072788fdf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:04.133373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f9b36b5-9261-4736-95cd-b51072788fdf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:04.133794 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f9b36b5-9261-4736-95cd-b51072788fdf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:04.274374 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6f9b36b5-9261-4736-95cd-b51072788fdf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:04.282381 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6f9b36b5-9261-4736-95cd-b51072788fdf tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1505 microversion: 2.1 time: 0.164986 Oct 29 03:44:04.282963 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3241/6704] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:04 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:44:04.305132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9fefc111-ba51-4384-86b5-4975518919d0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:04.305796 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9fefc111-ba51-4384-86b5-4975518919d0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:04.313243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fefc111-ba51-4384-86b5-4975518919d0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:04.313731 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fefc111-ba51-4384-86b5-4975518919d0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:04.314178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fefc111-ba51-4384-86b5-4975518919d0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:04.314882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fefc111-ba51-4384-86b5-4975518919d0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:04.315340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fefc111-ba51-4384-86b5-4975518919d0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:04.315754 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fefc111-ba51-4384-86b5-4975518919d0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:04.455118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9fefc111-ba51-4384-86b5-4975518919d0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:04.463639 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9fefc111-ba51-4384-86b5-4975518919d0 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1505 microversion: 2.1 time: 0.162479 Oct 29 03:44:04.464237 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3464/6705] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:04 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:44:04.486333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1dea7a2d-33cb-4bcd-9175-d16feda4d123 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:04.486957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1dea7a2d-33cb-4bcd-9175-d16feda4d123 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:04.493138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1dea7a2d-33cb-4bcd-9175-d16feda4d123 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:04.493641 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1dea7a2d-33cb-4bcd-9175-d16feda4d123 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:04.494477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1dea7a2d-33cb-4bcd-9175-d16feda4d123 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:04.495186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1dea7a2d-33cb-4bcd-9175-d16feda4d123 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:04.495712 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1dea7a2d-33cb-4bcd-9175-d16feda4d123 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:04.496130 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1dea7a2d-33cb-4bcd-9175-d16feda4d123 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:04.641729 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1dea7a2d-33cb-4bcd-9175-d16feda4d123 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:04.652740 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1dea7a2d-33cb-4bcd-9175-d16feda4d123 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1505 microversion: 2.1 time: 0.170585 Oct 29 03:44:04.653249 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3242/6706] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:04 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1505 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:44:04.674895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-07f74c49-e886-487d-a1f5-9c09202cc40d tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:04.675387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-07f74c49-e886-487d-a1f5-9c09202cc40d tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:04.681680 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07f74c49-e886-487d-a1f5-9c09202cc40d tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:04.682159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07f74c49-e886-487d-a1f5-9c09202cc40d tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:04.682590 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07f74c49-e886-487d-a1f5-9c09202cc40d tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:04.683278 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07f74c49-e886-487d-a1f5-9c09202cc40d tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:04.683732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07f74c49-e886-487d-a1f5-9c09202cc40d tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:04.684144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07f74c49-e886-487d-a1f5-9c09202cc40d tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:04.709205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-07f74c49-e886-487d-a1f5-9c09202cc40d tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:44:04.792589 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-07f74c49-e886-487d-a1f5-9c09202cc40d tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "DELETE /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 204 len: 0 microversion: 2.1 time: 0.121117 Oct 29 03:44:04.793302 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3465/6707] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:44:04 2022] DELETE /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:44:04.807331 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4e7d5ffd-e8d5-458e-9053-578c13805cd7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:04.807849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4e7d5ffd-e8d5-458e-9053-578c13805cd7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:04.813980 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e7d5ffd-e8d5-458e-9053-578c13805cd7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:04.814469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e7d5ffd-e8d5-458e-9053-578c13805cd7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:04.814913 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e7d5ffd-e8d5-458e-9053-578c13805cd7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:04.815623 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e7d5ffd-e8d5-458e-9053-578c13805cd7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:04.816079 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e7d5ffd-e8d5-458e-9053-578c13805cd7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:04.816511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e7d5ffd-e8d5-458e-9053-578c13805cd7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:04.841378 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4e7d5ffd-e8d5-458e-9053-578c13805cd7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:44:04.886408 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.compute.api [None req-4e7d5ffd-e8d5-458e-9053-578c13805cd7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Instance is already in deleting state, ignoring this request Oct 29 03:44:04.887248 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4e7d5ffd-e8d5-458e-9053-578c13805cd7 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "DELETE /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 204 len: 0 microversion: 2.1 time: 0.084317 Oct 29 03:44:04.887818 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3243/6708] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:44:04 2022] DELETE /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 03:44:04.896703 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f1801aac-7fb5-46f8-a30d-ed2f7cc4c836 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:04.897388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f1801aac-7fb5-46f8-a30d-ed2f7cc4c836 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:04.903955 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f1801aac-7fb5-46f8-a30d-ed2f7cc4c836 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:04.904126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f1801aac-7fb5-46f8-a30d-ed2f7cc4c836 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:04.904571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f1801aac-7fb5-46f8-a30d-ed2f7cc4c836 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:04.905282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f1801aac-7fb5-46f8-a30d-ed2f7cc4c836 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:04.905735 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f1801aac-7fb5-46f8-a30d-ed2f7cc4c836 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:04.906156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f1801aac-7fb5-46f8-a30d-ed2f7cc4c836 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:05.041768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f1801aac-7fb5-46f8-a30d-ed2f7cc4c836 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:05.050428 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f1801aac-7fb5-46f8-a30d-ed2f7cc4c836 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1511 microversion: 2.1 time: 0.158098 Oct 29 03:44:05.051007 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3466/6709] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:04 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:44:05.687483 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-df7f72b5-d25e-46aa-895f-5c6b3577385e req-b0e0bbe5-26d0-469f-976f-4ed8971f907f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720067fa-f82e-4c68-b9fc-23fee70773c7", "name": "network-vif-plugged", "status": "completed", "tag": "73915815-79cc-4fad-9b5e-bb46e4883648"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:44:05.692745 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=34 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:44:05.699975 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-df7f72b5-d25e-46aa-895f-5c6b3577385e req-b0e0bbe5-26d0-469f-976f-4ed8971f907f service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:05.700469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-df7f72b5-d25e-46aa-895f-5c6b3577385e req-b0e0bbe5-26d0-469f-976f-4ed8971f907f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:05.701005 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-df7f72b5-d25e-46aa-895f-5c6b3577385e req-b0e0bbe5-26d0-469f-976f-4ed8971f907f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:05.711807 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-df7f72b5-d25e-46aa-895f-5c6b3577385e req-b0e0bbe5-26d0-469f-976f-4ed8971f907f service nova] Creating event network-vif-plugged:73915815-79cc-4fad-9b5e-bb46e4883648 for instance 720067fa-f82e-4c68-b9fc-23fee70773c7 on n-h1-862967-2 Oct 29 03:44:05.717436 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-df7f72b5-d25e-46aa-895f-5c6b3577385e req-b0e0bbe5-26d0-469f-976f-4ed8971f907f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089911 Oct 29 03:44:05.718150 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3244/6710] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:44:06.078139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d68fb7d3-ee2b-494c-ac01-98eca338280f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:06.078767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d68fb7d3-ee2b-494c-ac01-98eca338280f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:06.090461 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d68fb7d3-ee2b-494c-ac01-98eca338280f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:06.091326 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d68fb7d3-ee2b-494c-ac01-98eca338280f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:06.092033 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d68fb7d3-ee2b-494c-ac01-98eca338280f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:06.093201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d68fb7d3-ee2b-494c-ac01-98eca338280f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:06.093928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d68fb7d3-ee2b-494c-ac01-98eca338280f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:06.094547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d68fb7d3-ee2b-494c-ac01-98eca338280f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:06.233934 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d68fb7d3-ee2b-494c-ac01-98eca338280f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b55be45114e7ca46bef2d50fbb71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b6c852ae654510a94cb97b848349f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:06.246039 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d68fb7d3-ee2b-494c-ac01-98eca338280f tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 200 len: 1511 microversion: 2.1 time: 0.172424 Oct 29 03:44:06.246619 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3467/6711] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:06 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 1511 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:44:06.854164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-2cc2e5b4-adca-4d23-9f96-66059ff99139 req-c45de212-7d16-4cb4-829c-749dc625e498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "720067fa-f82e-4c68-b9fc-23fee70773c7", "name": "network-vif-deleted", "tag": "73915815-79cc-4fad-9b5e-bb46e4883648"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:44:06.872153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2cc2e5b4-adca-4d23-9f96-66059ff99139 req-c45de212-7d16-4cb4-829c-749dc625e498 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:06.872663 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2cc2e5b4-adca-4d23-9f96-66059ff99139 req-c45de212-7d16-4cb4-829c-749dc625e498 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:06.873109 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2cc2e5b4-adca-4d23-9f96-66059ff99139 req-c45de212-7d16-4cb4-829c-749dc625e498 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:06.885630 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-2cc2e5b4-adca-4d23-9f96-66059ff99139 req-c45de212-7d16-4cb4-829c-749dc625e498 service nova] Creating event network-vif-deleted:73915815-79cc-4fad-9b5e-bb46e4883648 for instance 720067fa-f82e-4c68-b9fc-23fee70773c7 on n-h1-862967-2 Oct 29 03:44:06.891084 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-2cc2e5b4-adca-4d23-9f96-66059ff99139 req-c45de212-7d16-4cb4-829c-749dc625e498 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097370 Oct 29 03:44:06.891792 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3245/6712] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:44:07.269786 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-05236a33-811e-4b42-8919-5eb4941e54f1 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:07.270431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-05236a33-811e-4b42-8919-5eb4941e54f1 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: 720067fa-f82e-4c68-b9fc-23fee70773c7] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:07.273382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:44:07.278744 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05236a33-811e-4b42-8919-5eb4941e54f1 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:07.279229 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05236a33-811e-4b42-8919-5eb4941e54f1 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:07.279667 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05236a33-811e-4b42-8919-5eb4941e54f1 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:07.280360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05236a33-811e-4b42-8919-5eb4941e54f1 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:07.280837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05236a33-811e-4b42-8919-5eb4941e54f1 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:07.281259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05236a33-811e-4b42-8919-5eb4941e54f1 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:07.298745 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-05236a33-811e-4b42-8919-5eb4941e54f1 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] HTTP exception thrown: Instance 720067fa-f82e-4c68-b9fc-23fee70773c7 could not be found. Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-05236a33-811e-4b42-8919-5eb4941e54f1 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Request method failure captured: Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 HTTP/1.1 Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXKEip-amA-lWiPdTUFkXeUCiJOzFxJVaqA6nZGO2nRh-Y93LOXaITkq16PElzDxfS4a_J5NHI4X0dU1suTMrnwRM30-xMRsurK-2dSfN3gLzaw2qcccdKXO1AzWkbA6mPS-MnEzFONPESbDYoW0BmHZhsYLJo-AqOp76WastkGqGc-0 Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: d1b6c852ae654510a94cb97b848349f8 Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1863607856 Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d1b6c852ae654510a94cb97b848349f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d1b6c852ae654510a94cb97b848349f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d1b6c852ae654510a94cb97b848349f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d1b6c852ae654510a94cb97b848349f8"}]}] Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServerDiskConfigTestJSON-1863607856 Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: d1b6c852ae654510a94cb97b848349f8 Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1863607856 Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServerDiskConfigTestJSON-1863607856-project Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 134b55be45114e7ca46bef2d50fbb71a Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServerDiskConfigTestJSON-1863607856-project Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 720067fa-f82e-4c68-b9fc-23fee70773c7 could not be found. Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '720067fa-f82e-4c68-b9fc-23fee70773c7'} Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 720067fa-f82e-4c68-b9fc-23fee70773c7 could not be found. Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 720067fa-f82e-4c68-b9fc-23fee70773c7 could not be found. Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:44:07.300473 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:44:07.305930 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:44:07.305930 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:44:07.305930 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:44:07.305930 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:44:07.305930 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:44:07.305930 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 720067fa-f82e-4c68-b9fc-23fee70773c7 could not be found. Oct 29 03:44:07.305930 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:44:07.305930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-05236a33-811e-4b42-8919-5eb4941e54f1 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Returning 404 to user: Instance 720067fa-f82e-4c68-b9fc-23fee70773c7 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:44:07.305930 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-05236a33-811e-4b42-8919-5eb4941e54f1 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7" status: 404 len: 111 microversion: 2.1 time: 0.036160 Oct 29 03:44:07.305930 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3468/6713] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:07 2022] GET /compute/v2.1/servers/720067fa-f82e-4c68-b9fc-23fee70773c7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:44:07.312786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8fac6291-d1dc-488b-a8cc-1b2c434669a3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '.version_select at 0x7ff053731ca0>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:07.339736 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8fac6291-d1dc-488b-a8cc-1b2c434669a3 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-383709004" status: 202 len: 0 microversion: 2.1 time: 0.031280 Oct 29 03:44:07.340330 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3246/6714] 10.222.0.46 () {58 vars in 1218 bytes} [Sat Oct 29 03:44:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-383709004 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:44:07.974356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2ab40d9e-1c64-4c80-b5d8-280aee88e7d9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:07.977203 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2ab40d9e-1c64-4c80-b5d8-280aee88e7d9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:07.983763 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2ab40d9e-1c64-4c80-b5d8-280aee88e7d9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:07.984247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2ab40d9e-1c64-4c80-b5d8-280aee88e7d9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:07.984710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2ab40d9e-1c64-4c80-b5d8-280aee88e7d9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:07.985401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2ab40d9e-1c64-4c80-b5d8-280aee88e7d9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:07.985849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2ab40d9e-1c64-4c80-b5d8-280aee88e7d9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:07.986264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2ab40d9e-1c64-4c80-b5d8-280aee88e7d9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:08.000924 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-2ab40d9e-1c64-4c80-b5d8-280aee88e7d9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] HTTP exception thrown: Instance de827c29-5157-4cf8-a76d-7acc467bb0fd could not be found. Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2ab40d9e-1c64-4c80-b5d8-280aee88e7d9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Request method failure captured: Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd HTTP/1.1 Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXKEip-amA-lWiPdTUFkXeUCiJOzFxJVaqA6nZGO2nRh-Y93LOXaITkq16PElzDxfS4a_J5NHI4X0dU1suTMrnwRM30-xMRsurK-2dSfN3gLzaw2qcccdKXO1AzWkbA6mPS-MnEzFONPESbDYoW0BmHZhsYLJo-AqOp76WastkGqGc-0 Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: d1b6c852ae654510a94cb97b848349f8 Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1863607856 Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d1b6c852ae654510a94cb97b848349f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d1b6c852ae654510a94cb97b848349f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d1b6c852ae654510a94cb97b848349f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d1b6c852ae654510a94cb97b848349f8"}]}] Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServerDiskConfigTestJSON-1863607856 Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: d1b6c852ae654510a94cb97b848349f8 Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1863607856 Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServerDiskConfigTestJSON-1863607856-project Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 134b55be45114e7ca46bef2d50fbb71a Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServerDiskConfigTestJSON-1863607856-project Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance de827c29-5157-4cf8-a76d-7acc467bb0fd could not be found. Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'de827c29-5157-4cf8-a76d-7acc467bb0fd'} Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de827c29-5157-4cf8-a76d-7acc467bb0fd could not be found. Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:44:08.002529 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:44:08.007017 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de827c29-5157-4cf8-a76d-7acc467bb0fd could not be found. Oct 29 03:44:08.007017 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:44:08.007017 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:44:08.007017 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:44:08.007017 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:44:08.007017 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:44:08.007017 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:44:08.007017 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:44:08.007017 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:44:08.007017 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de827c29-5157-4cf8-a76d-7acc467bb0fd could not be found. Oct 29 03:44:08.007017 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:44:08.007017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2ab40d9e-1c64-4c80-b5d8-280aee88e7d9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Returning 404 to user: Instance de827c29-5157-4cf8-a76d-7acc467bb0fd could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:44:08.007017 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2ab40d9e-1c64-4c80-b5d8-280aee88e7d9 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "DELETE /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 404 len: 111 microversion: 2.1 time: 0.036303 Oct 29 03:44:08.007017 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3469/6715] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:44:07 2022] DELETE /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:44:08.015446 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fdd79db2-9845-4d2b-84e5-abbb2b02d2a8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:08.016198 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fdd79db2-9845-4d2b-84e5-abbb2b02d2a8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] [instance: de827c29-5157-4cf8-a76d-7acc467bb0fd] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:08.023313 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdd79db2-9845-4d2b-84e5-abbb2b02d2a8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:08.023822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdd79db2-9845-4d2b-84e5-abbb2b02d2a8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:08.024288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdd79db2-9845-4d2b-84e5-abbb2b02d2a8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:08.025035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdd79db2-9845-4d2b-84e5-abbb2b02d2a8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:08.025519 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdd79db2-9845-4d2b-84e5-abbb2b02d2a8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:08.025949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdd79db2-9845-4d2b-84e5-abbb2b02d2a8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:08.043515 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-fdd79db2-9845-4d2b-84e5-abbb2b02d2a8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] HTTP exception thrown: Instance de827c29-5157-4cf8-a76d-7acc467bb0fd could not be found. Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fdd79db2-9845-4d2b-84e5-abbb2b02d2a8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Request method failure captured: Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd HTTP/1.1 Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKEip-amA-lWiPdTUFkXeUCiJOzFxJVaqA6nZGO2nRh-Y93LOXaITkq16PElzDxfS4a_J5NHI4X0dU1suTMrnwRM30-xMRsurK-2dSfN3gLzaw2qcccdKXO1AzWkbA6mPS-MnEzFONPESbDYoW0BmHZhsYLJo-AqOp76WastkGqGc-0 Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: d1b6c852ae654510a94cb97b848349f8 Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1863607856 Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d1b6c852ae654510a94cb97b848349f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d1b6c852ae654510a94cb97b848349f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d1b6c852ae654510a94cb97b848349f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d1b6c852ae654510a94cb97b848349f8"}]}] Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerDiskConfigTestJSON-1863607856 Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: d1b6c852ae654510a94cb97b848349f8 Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1863607856 Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerDiskConfigTestJSON-1863607856-project Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 134b55be45114e7ca46bef2d50fbb71a Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerDiskConfigTestJSON-1863607856-project Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance de827c29-5157-4cf8-a76d-7acc467bb0fd could not be found. Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'de827c29-5157-4cf8-a76d-7acc467bb0fd'} Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de827c29-5157-4cf8-a76d-7acc467bb0fd could not be found. Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de827c29-5157-4cf8-a76d-7acc467bb0fd could not be found. Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:44:08.045296 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:44:08.049422 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:44:08.049422 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:44:08.049422 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:44:08.049422 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:44:08.049422 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:44:08.049422 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de827c29-5157-4cf8-a76d-7acc467bb0fd could not be found. Oct 29 03:44:08.049422 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:44:08.049422 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fdd79db2-9845-4d2b-84e5-abbb2b02d2a8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] Returning 404 to user: Instance de827c29-5157-4cf8-a76d-7acc467bb0fd could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:44:08.049422 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fdd79db2-9845-4d2b-84e5-abbb2b02d2a8 tempest-ServerDiskConfigTestJSON-1863607856 tempest-ServerDiskConfigTestJSON-1863607856-project] 10.222.0.46 "GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd" status: 404 len: 111 microversion: 2.1 time: 0.037939 Oct 29 03:44:08.049422 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3247/6716] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:08 2022] GET /compute/v2.1/servers/de827c29-5157-4cf8-a76d-7acc467bb0fd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:44:17.124683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-12b57682-68a4-4879-b6af-f7c48006d401 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Action: 'create', calling method: .version_select at 0x7ff052b3bc10>, body: {"keypair": {"name": "tempest-keypair-685611708", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOzNabwCFONXKy52DuXibNqfMW/eWhrcN0JlOFnNUwywYtDTdT0Kn/sgMNh2HVn99XJfdAOXj9cT/ml8/uRs5zhPk5wZ8o2yUUfMJ01V0vvzdB/h34X19K6YpTuP8Esqw=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:44:17.143479 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-12b57682-68a4-4879-b6af-f7c48006d401 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Getting quotas for project 2e19c07467824bbfbc0715c6085c40e6. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:44:17.149824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-12b57682-68a4-4879-b6af-f7c48006d401 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Getting quotas for user fd4c00a472474521add76167023ab141 and project 2e19c07467824bbfbc0715c6085c40e6. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:44:17.177229 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-12b57682-68a4-4879-b6af-f7c48006d401 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.207165 Oct 29 03:44:17.178025 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3470/6717] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:44:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:44:18.767814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cf9f26c1-e0f4-4540-8c60-bf3431e72ad1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-265991889", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16b776c7-5074-4f3f-a183-66ccafda21d7"}], "security_groups": [{"name": "tempest-securitygroup--98886569"}], "key_name": "tempest-keypair-685611708", "user_data": "}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:44:18.777281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:44:18.778046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:44:18.882651 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-cf9f26c1-e0f4-4540-8c60-bf3431e72ad1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] validate_networks() for [('16b776c7-5074-4f3f-a183-66ccafda21d7', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:44:19.358583 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-cf9f26c1-e0f4-4540-8c60-bf3431e72ad1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:44:19.362085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-cf9f26c1-e0f4-4540-8c60-bf3431e72ad1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:44:19.362783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-cf9f26c1-e0f4-4540-8c60-bf3431e72ad1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:44:19.363366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-cf9f26c1-e0f4-4540-8c60-bf3431e72ad1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:44:19.363959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-cf9f26c1-e0f4-4540-8c60-bf3431e72ad1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:44:19.378224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf9f26c1-e0f4-4540-8c60-bf3431e72ad1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:19.378859 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf9f26c1-e0f4-4540-8c60-bf3431e72ad1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:19.379318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf9f26c1-e0f4-4540-8c60-bf3431e72ad1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:19.380062 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf9f26c1-e0f4-4540-8c60-bf3431e72ad1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:19.380563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf9f26c1-e0f4-4540-8c60-bf3431e72ad1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:19.380990 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cf9f26c1-e0f4-4540-8c60-bf3431e72ad1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:19.398014 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-cf9f26c1-e0f4-4540-8c60-bf3431e72ad1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Getting quotas for project 2e19c07467824bbfbc0715c6085c40e6. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:44:19.403430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-cf9f26c1-e0f4-4540-8c60-bf3431e72ad1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Getting quotas for user fd4c00a472474521add76167023ab141 and project 2e19c07467824bbfbc0715c6085c40e6. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:44:19.422201 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cf9f26c1-e0f4-4540-8c60-bf3431e72ad1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:44:19.424646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cf9f26c1-e0f4-4540-8c60-bf3431e72ad1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:44:19.475584 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cf9f26c1-e0f4-4540-8c60-bf3431e72ad1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.712706 Oct 29 03:44:19.476157 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3248/6718] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:44:18 2022] POST /compute/v2.1/servers => generated 407 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:44:19.485538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:44:19.490753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8fc95ca3-053d-48bd-bb75-67ac9bea6f9c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:19.491525 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8fc95ca3-053d-48bd-bb75-67ac9bea6f9c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:19.553888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8fc95ca3-053d-48bd-bb75-67ac9bea6f9c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:19.564686 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8fc95ca3-053d-48bd-bb75-67ac9bea6f9c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1237 microversion: 2.1 time: 0.080812 Oct 29 03:44:19.565469 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3471/6719] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:19 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1237 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:44:20.590708 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-74c25b16-701b-43bf-9f77-266f667a74de tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:20.591333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-74c25b16-701b-43bf-9f77-266f667a74de tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:20.598672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-74c25b16-701b-43bf-9f77-266f667a74de tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:20.599168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-74c25b16-701b-43bf-9f77-266f667a74de tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:20.599784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-74c25b16-701b-43bf-9f77-266f667a74de tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:20.600557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-74c25b16-701b-43bf-9f77-266f667a74de tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:20.601015 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-74c25b16-701b-43bf-9f77-266f667a74de tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:20.601463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-74c25b16-701b-43bf-9f77-266f667a74de tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:20.671758 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-74c25b16-701b-43bf-9f77-266f667a74de tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:20.680407 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-74c25b16-701b-43bf-9f77-266f667a74de tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1307 microversion: 2.1 time: 0.096765 Oct 29 03:44:20.681107 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3249/6720] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:20 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:44:21.703923 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-36625768-6c13-483e-b8ac-27f8a248f4f7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:21.704671 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-36625768-6c13-483e-b8ac-27f8a248f4f7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:21.716562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36625768-6c13-483e-b8ac-27f8a248f4f7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:21.717267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36625768-6c13-483e-b8ac-27f8a248f4f7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:21.717922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36625768-6c13-483e-b8ac-27f8a248f4f7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:21.718863 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36625768-6c13-483e-b8ac-27f8a248f4f7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:21.719326 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36625768-6c13-483e-b8ac-27f8a248f4f7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:21.719740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-36625768-6c13-483e-b8ac-27f8a248f4f7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:21.934123 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-36625768-6c13-483e-b8ac-27f8a248f4f7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:21.942452 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-36625768-6c13-483e-b8ac-27f8a248f4f7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1361 microversion: 2.1 time: 0.242556 Oct 29 03:44:21.942969 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3472/6721] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:21 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1361 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:44:22.402757 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-ad0f3509-0183-43a2-a40a-51cda661fda8 req-06401960-7ba2-4bab-a195-9acd5933ebe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c0ab293-18af-4f60-ba64-c3c892916738", "tag": "d834ccbc-b5bb-4b14-ae2c-3cdc48bfe6e4"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:44:22.412478 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ad0f3509-0183-43a2-a40a-51cda661fda8 req-06401960-7ba2-4bab-a195-9acd5933ebe3 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:22.413029 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ad0f3509-0183-43a2-a40a-51cda661fda8 req-06401960-7ba2-4bab-a195-9acd5933ebe3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:22.413464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ad0f3509-0183-43a2-a40a-51cda661fda8 req-06401960-7ba2-4bab-a195-9acd5933ebe3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:22.425032 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-ad0f3509-0183-43a2-a40a-51cda661fda8 req-06401960-7ba2-4bab-a195-9acd5933ebe3 service nova] Creating event network-changed:d834ccbc-b5bb-4b14-ae2c-3cdc48bfe6e4 for instance 7c0ab293-18af-4f60-ba64-c3c892916738 on n-h2-862967-2 Oct 29 03:44:22.430585 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-ad0f3509-0183-43a2-a40a-51cda661fda8 req-06401960-7ba2-4bab-a195-9acd5933ebe3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090147 Oct 29 03:44:22.431255 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3250/6722] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:44:22.966700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6d56bbcd-5e58-4b7a-955c-48d0328e2758 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:22.967293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6d56bbcd-5e58-4b7a-955c-48d0328e2758 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:22.974784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d56bbcd-5e58-4b7a-955c-48d0328e2758 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:22.975284 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d56bbcd-5e58-4b7a-955c-48d0328e2758 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:22.975710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d56bbcd-5e58-4b7a-955c-48d0328e2758 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:22.976412 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d56bbcd-5e58-4b7a-955c-48d0328e2758 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:22.976902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d56bbcd-5e58-4b7a-955c-48d0328e2758 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:22.977349 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d56bbcd-5e58-4b7a-955c-48d0328e2758 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:23.115745 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6d56bbcd-5e58-4b7a-955c-48d0328e2758 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:23.125608 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6d56bbcd-5e58-4b7a-955c-48d0328e2758 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1361 microversion: 2.1 time: 0.163275 Oct 29 03:44:23.126129 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3473/6723] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:22 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:44:24.150378 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6bd0c9d8-46c7-4567-a891-032a6e30b808 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:24.151112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6bd0c9d8-46c7-4567-a891-032a6e30b808 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:24.158356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bd0c9d8-46c7-4567-a891-032a6e30b808 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:24.158854 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bd0c9d8-46c7-4567-a891-032a6e30b808 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:24.159300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bd0c9d8-46c7-4567-a891-032a6e30b808 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:24.160002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bd0c9d8-46c7-4567-a891-032a6e30b808 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:24.160466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bd0c9d8-46c7-4567-a891-032a6e30b808 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:24.160935 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bd0c9d8-46c7-4567-a891-032a6e30b808 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:24.304571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6bd0c9d8-46c7-4567-a891-032a6e30b808 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:24.317310 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6bd0c9d8-46c7-4567-a891-032a6e30b808 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1361 microversion: 2.1 time: 0.172038 Oct 29 03:44:24.318166 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3251/6724] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:24 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:44:25.341261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1f0239cc-f171-4474-a125-7011f91611d6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:25.341843 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1f0239cc-f171-4474-a125-7011f91611d6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:25.351488 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1f0239cc-f171-4474-a125-7011f91611d6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:25.352179 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1f0239cc-f171-4474-a125-7011f91611d6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:25.352881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1f0239cc-f171-4474-a125-7011f91611d6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:25.353642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1f0239cc-f171-4474-a125-7011f91611d6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:25.354118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1f0239cc-f171-4474-a125-7011f91611d6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:25.354526 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1f0239cc-f171-4474-a125-7011f91611d6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:25.493556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1f0239cc-f171-4474-a125-7011f91611d6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:25.502458 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1f0239cc-f171-4474-a125-7011f91611d6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1361 microversion: 2.1 time: 0.165829 Oct 29 03:44:25.503159 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3474/6725] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:25 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:44:26.525785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-25569471-c6d7-4b0a-87c3-0ad2195c3879 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:26.526372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-25569471-c6d7-4b0a-87c3-0ad2195c3879 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:26.533603 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-25569471-c6d7-4b0a-87c3-0ad2195c3879 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:26.534106 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-25569471-c6d7-4b0a-87c3-0ad2195c3879 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:26.534559 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-25569471-c6d7-4b0a-87c3-0ad2195c3879 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:26.535278 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-25569471-c6d7-4b0a-87c3-0ad2195c3879 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:26.535750 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-25569471-c6d7-4b0a-87c3-0ad2195c3879 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:26.536191 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-25569471-c6d7-4b0a-87c3-0ad2195c3879 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:26.677130 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-25569471-c6d7-4b0a-87c3-0ad2195c3879 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:26.685264 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-25569471-c6d7-4b0a-87c3-0ad2195c3879 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1361 microversion: 2.1 time: 0.163422 Oct 29 03:44:26.685897 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3252/6726] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:26 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:44:27.346910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-fca3ad90-1f5a-4802-8c6d-30fba69af553 req-b54819c4-0a9b-4af7-bfb6-911ae0731ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c0ab293-18af-4f60-ba64-c3c892916738", "name": "network-vif-plugged", "status": "completed", "tag": "d834ccbc-b5bb-4b14-ae2c-3cdc48bfe6e4"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:44:27.358000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-fca3ad90-1f5a-4802-8c6d-30fba69af553 req-b54819c4-0a9b-4af7-bfb6-911ae0731ce4 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:27.358466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-fca3ad90-1f5a-4802-8c6d-30fba69af553 req-b54819c4-0a9b-4af7-bfb6-911ae0731ce4 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:27.358902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-fca3ad90-1f5a-4802-8c6d-30fba69af553 req-b54819c4-0a9b-4af7-bfb6-911ae0731ce4 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:27.372162 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-fca3ad90-1f5a-4802-8c6d-30fba69af553 req-b54819c4-0a9b-4af7-bfb6-911ae0731ce4 service nova] Creating event network-vif-plugged:d834ccbc-b5bb-4b14-ae2c-3cdc48bfe6e4 for instance 7c0ab293-18af-4f60-ba64-c3c892916738 on n-h2-862967-2 Oct 29 03:44:27.378665 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-fca3ad90-1f5a-4802-8c6d-30fba69af553 req-b54819c4-0a9b-4af7-bfb6-911ae0731ce4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035491 Oct 29 03:44:27.379447 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3475/6727] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:44:27.710106 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-edbd06c0-f352-4816-9c92-a2ac6165b05c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:27.710691 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-edbd06c0-f352-4816-9c92-a2ac6165b05c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:27.718616 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-edbd06c0-f352-4816-9c92-a2ac6165b05c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:27.719140 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-edbd06c0-f352-4816-9c92-a2ac6165b05c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:27.719595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-edbd06c0-f352-4816-9c92-a2ac6165b05c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:27.720349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-edbd06c0-f352-4816-9c92-a2ac6165b05c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:27.720843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-edbd06c0-f352-4816-9c92-a2ac6165b05c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:27.721292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-edbd06c0-f352-4816-9c92-a2ac6165b05c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:27.861867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-edbd06c0-f352-4816-9c92-a2ac6165b05c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:27.870465 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-edbd06c0-f352-4816-9c92-a2ac6165b05c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1361 microversion: 2.1 time: 0.164673 Oct 29 03:44:27.871119 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3253/6728] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:27 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:44:28.903525 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1fd045eb-5a88-42d6-902b-89feb1a484b1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:28.904225 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1fd045eb-5a88-42d6-902b-89feb1a484b1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:28.911062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fd045eb-5a88-42d6-902b-89feb1a484b1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:28.911544 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fd045eb-5a88-42d6-902b-89feb1a484b1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:28.911980 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fd045eb-5a88-42d6-902b-89feb1a484b1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:28.912717 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fd045eb-5a88-42d6-902b-89feb1a484b1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:28.913168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fd045eb-5a88-42d6-902b-89feb1a484b1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:28.913594 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1fd045eb-5a88-42d6-902b-89feb1a484b1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:29.055195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1fd045eb-5a88-42d6-902b-89feb1a484b1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:44:29.064366 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1fd045eb-5a88-42d6-902b-89feb1a484b1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1548 microversion: 2.1 time: 0.166054 Oct 29 03:44:29.064897 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3476/6729] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:44:28 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:44:29.096138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b76cd554-daa7-47f8-a5be-615b692e6b9c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:44:29.096685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b76cd554-daa7-47f8-a5be-615b692e6b9c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:44:29.104129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b76cd554-daa7-47f8-a5be-615b692e6b9c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:29.104656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b76cd554-daa7-47f8-a5be-615b692e6b9c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:29.105106 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b76cd554-daa7-47f8-a5be-615b692e6b9c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:29.105819 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b76cd554-daa7-47f8-a5be-615b692e6b9c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:29.106283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b76cd554-daa7-47f8-a5be-615b692e6b9c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:29.106724 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b76cd554-daa7-47f8-a5be-615b692e6b9c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:29.186944 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b76cd554-daa7-47f8-a5be-615b692e6b9c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094834 Oct 29 03:44:29.187530 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3254/6730] 10.222.0.46 () {58 vars in 1275 bytes} [Sat Oct 29 03:44:29 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:44:30.151211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-120685a0-ea09-4d8b-bffc-21a6a89b2842 req-9110b212-f44c-41d0-9aef-fc56db00825d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c0ab293-18af-4f60-ba64-c3c892916738", "tag": "d834ccbc-b5bb-4b14-ae2c-3cdc48bfe6e4"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:44:30.156177 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:44:30.163157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-120685a0-ea09-4d8b-bffc-21a6a89b2842 req-9110b212-f44c-41d0-9aef-fc56db00825d service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:44:30.163715 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-120685a0-ea09-4d8b-bffc-21a6a89b2842 req-9110b212-f44c-41d0-9aef-fc56db00825d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:44:30.164125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-120685a0-ea09-4d8b-bffc-21a6a89b2842 req-9110b212-f44c-41d0-9aef-fc56db00825d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:44:30.178908 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-120685a0-ea09-4d8b-bffc-21a6a89b2842 req-9110b212-f44c-41d0-9aef-fc56db00825d service nova] Creating event network-changed:d834ccbc-b5bb-4b14-ae2c-3cdc48bfe6e4 for instance 7c0ab293-18af-4f60-ba64-c3c892916738 on n-h2-862967-2 Oct 29 03:44:30.184401 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-120685a0-ea09-4d8b-bffc-21a6a89b2842 req-9110b212-f44c-41d0-9aef-fc56db00825d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037037 Oct 29 03:44:30.185098 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3477/6731] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:45:04.081418 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:04.082673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:04.084590 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:04.085278 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=32 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:04.089506 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1a6c3f29-9474-4b0b-a1c9-0e70964960c0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:04.090165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1a6c3f29-9474-4b0b-a1c9-0e70964960c0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:04.098185 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a6c3f29-9474-4b0b-a1c9-0e70964960c0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:04.098685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a6c3f29-9474-4b0b-a1c9-0e70964960c0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:04.099133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a6c3f29-9474-4b0b-a1c9-0e70964960c0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:04.099840 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a6c3f29-9474-4b0b-a1c9-0e70964960c0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:04.100308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a6c3f29-9474-4b0b-a1c9-0e70964960c0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:04.100783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a6c3f29-9474-4b0b-a1c9-0e70964960c0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:04.247489 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1a6c3f29-9474-4b0b-a1c9-0e70964960c0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:04.255817 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1a6c3f29-9474-4b0b-a1c9-0e70964960c0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1667 microversion: 2.1 time: 0.175338 Oct 29 03:45:04.256384 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3255/6732] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:04 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1667 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:04.284190 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-27ee5ee1-8be1-4711-a618-d6d8a8f934fa tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:04.284998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-27ee5ee1-8be1-4711-a618-d6d8a8f934fa tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:04.288119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:04.289220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=28 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:04.301332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27ee5ee1-8be1-4711-a618-d6d8a8f934fa tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:04.302119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27ee5ee1-8be1-4711-a618-d6d8a8f934fa tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:04.302574 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27ee5ee1-8be1-4711-a618-d6d8a8f934fa tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:04.303290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27ee5ee1-8be1-4711-a618-d6d8a8f934fa tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:04.303751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27ee5ee1-8be1-4711-a618-d6d8a8f934fa tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:04.304180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-27ee5ee1-8be1-4711-a618-d6d8a8f934fa tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:04.452145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-27ee5ee1-8be1-4711-a618-d6d8a8f934fa tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:04.464322 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-27ee5ee1-8be1-4711-a618-d6d8a8f934fa tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1667 microversion: 2.1 time: 0.187338 Oct 29 03:45:04.465235 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3478/6733] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:04 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1667 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:04.498351 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c80d797a-d314-48d8-9231-18730386d55e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:04.499168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c80d797a-d314-48d8-9231-18730386d55e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:04.507846 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c80d797a-d314-48d8-9231-18730386d55e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:04.508197 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c80d797a-d314-48d8-9231-18730386d55e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:04.508722 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c80d797a-d314-48d8-9231-18730386d55e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:04.509568 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c80d797a-d314-48d8-9231-18730386d55e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:04.510289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c80d797a-d314-48d8-9231-18730386d55e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:04.510820 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c80d797a-d314-48d8-9231-18730386d55e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:04.658837 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c80d797a-d314-48d8-9231-18730386d55e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:04.667270 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c80d797a-d314-48d8-9231-18730386d55e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1667 microversion: 2.1 time: 0.175771 Oct 29 03:45:04.667864 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3256/6734] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:04 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1667 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:04.697448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-72a4754f-c081-4d65-b5e1-a7652c21ee1d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:45:04.699883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-72a4754f-c081-4d65-b5e1-a7652c21ee1d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:04.706240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72a4754f-c081-4d65-b5e1-a7652c21ee1d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:04.706728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72a4754f-c081-4d65-b5e1-a7652c21ee1d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:04.707161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72a4754f-c081-4d65-b5e1-a7652c21ee1d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:04.707853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72a4754f-c081-4d65-b5e1-a7652c21ee1d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:04.708311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72a4754f-c081-4d65-b5e1-a7652c21ee1d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:04.708762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72a4754f-c081-4d65-b5e1-a7652c21ee1d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:04.751884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-72a4754f-c081-4d65-b5e1-a7652c21ee1d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:04.757675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-72a4754f-c081-4d65-b5e1-a7652c21ee1d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Old instance type m1.heat2, new instance type m1.heat {{(pid=127124) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 03:45:04.764770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-72a4754f-c081-4d65-b5e1-a7652c21ee1d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:45:04.765194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-72a4754f-c081-4d65-b5e1-a7652c21ee1d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:45:04.765672 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-72a4754f-c081-4d65-b5e1-a7652c21ee1d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:45:04.766081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-72a4754f-c081-4d65-b5e1-a7652c21ee1d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:45:04.766492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-72a4754f-c081-4d65-b5e1-a7652c21ee1d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:45:04.833336 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-72a4754f-c081-4d65-b5e1-a7652c21ee1d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "POST /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738/action" status: 202 len: 0 microversion: 2.1 time: 0.139933 Oct 29 03:45:04.834166 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3479/6735] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:45:04 2022] POST /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:45:04.842287 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8b3d7161-44da-482f-88fb-2f7bf7cb198a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:04.843073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8b3d7161-44da-482f-88fb-2f7bf7cb198a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:04.852467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b3d7161-44da-482f-88fb-2f7bf7cb198a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:04.853069 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b3d7161-44da-482f-88fb-2f7bf7cb198a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:04.853546 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b3d7161-44da-482f-88fb-2f7bf7cb198a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:04.854272 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b3d7161-44da-482f-88fb-2f7bf7cb198a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:04.854738 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b3d7161-44da-482f-88fb-2f7bf7cb198a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:04.855172 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b3d7161-44da-482f-88fb-2f7bf7cb198a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:05.039398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8b3d7161-44da-482f-88fb-2f7bf7cb198a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:05.049955 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8b3d7161-44da-482f-88fb-2f7bf7cb198a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1676 microversion: 2.1 time: 0.211536 Oct 29 03:45:05.050542 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3257/6736] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:04 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1676 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:06.076596 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1f888d50-d95e-43e3-9e2b-314fca422f8c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:06.077219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1f888d50-d95e-43e3-9e2b-314fca422f8c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:06.088224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1f888d50-d95e-43e3-9e2b-314fca422f8c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:06.088764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1f888d50-d95e-43e3-9e2b-314fca422f8c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:06.089351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1f888d50-d95e-43e3-9e2b-314fca422f8c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:06.090490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1f888d50-d95e-43e3-9e2b-314fca422f8c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:06.091050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1f888d50-d95e-43e3-9e2b-314fca422f8c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:06.091712 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1f888d50-d95e-43e3-9e2b-314fca422f8c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:06.227205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1f888d50-d95e-43e3-9e2b-314fca422f8c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:06.236672 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1f888d50-d95e-43e3-9e2b-314fca422f8c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1676 microversion: 2.1 time: 0.165278 Oct 29 03:45:06.237257 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3480/6737] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:06 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:07.265311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cec7647e-b6de-48a5-ac72-21ee5cd7e2a9 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:07.266347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cec7647e-b6de-48a5-ac72-21ee5cd7e2a9 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:07.273873 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cec7647e-b6de-48a5-ac72-21ee5cd7e2a9 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:07.274375 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cec7647e-b6de-48a5-ac72-21ee5cd7e2a9 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:07.274825 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cec7647e-b6de-48a5-ac72-21ee5cd7e2a9 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:07.275535 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cec7647e-b6de-48a5-ac72-21ee5cd7e2a9 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:07.276003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cec7647e-b6de-48a5-ac72-21ee5cd7e2a9 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:07.276466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cec7647e-b6de-48a5-ac72-21ee5cd7e2a9 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:07.421852 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cec7647e-b6de-48a5-ac72-21ee5cd7e2a9 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:07.430939 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cec7647e-b6de-48a5-ac72-21ee5cd7e2a9 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1681 microversion: 2.1 time: 0.172160 Oct 29 03:45:07.431439 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3258/6738] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:07 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:08.459304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-396629b3-885f-4bec-ae67-104baf48af50 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:08.460162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-396629b3-885f-4bec-ae67-104baf48af50 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:08.471205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-396629b3-885f-4bec-ae67-104baf48af50 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:08.471698 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-396629b3-885f-4bec-ae67-104baf48af50 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:08.472136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-396629b3-885f-4bec-ae67-104baf48af50 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:08.472888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-396629b3-885f-4bec-ae67-104baf48af50 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:08.473356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-396629b3-885f-4bec-ae67-104baf48af50 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:08.473772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-396629b3-885f-4bec-ae67-104baf48af50 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:08.613598 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-396629b3-885f-4bec-ae67-104baf48af50 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:08.625486 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-396629b3-885f-4bec-ae67-104baf48af50 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1681 microversion: 2.1 time: 0.172629 Oct 29 03:45:08.626323 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3481/6739] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:08 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:09.651646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-21b73957-e8a6-445f-aadd-aa2dbfd396bb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:09.652452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-21b73957-e8a6-445f-aadd-aa2dbfd396bb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:09.661986 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-21b73957-e8a6-445f-aadd-aa2dbfd396bb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:09.662652 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-21b73957-e8a6-445f-aadd-aa2dbfd396bb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:09.663293 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-21b73957-e8a6-445f-aadd-aa2dbfd396bb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:09.664386 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-21b73957-e8a6-445f-aadd-aa2dbfd396bb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:09.665051 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-21b73957-e8a6-445f-aadd-aa2dbfd396bb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:09.665648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-21b73957-e8a6-445f-aadd-aa2dbfd396bb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:09.806228 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-21b73957-e8a6-445f-aadd-aa2dbfd396bb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:09.816781 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-21b73957-e8a6-445f-aadd-aa2dbfd396bb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1681 microversion: 2.1 time: 0.170491 Oct 29 03:45:09.817354 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3259/6740] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:09 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:10.843682 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-07e282b0-0db1-4941-87bc-dac4ebb7766b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:10.844429 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-07e282b0-0db1-4941-87bc-dac4ebb7766b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:10.852034 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07e282b0-0db1-4941-87bc-dac4ebb7766b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:10.852557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07e282b0-0db1-4941-87bc-dac4ebb7766b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:10.852996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07e282b0-0db1-4941-87bc-dac4ebb7766b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:10.853697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07e282b0-0db1-4941-87bc-dac4ebb7766b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:10.854157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07e282b0-0db1-4941-87bc-dac4ebb7766b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:10.854592 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07e282b0-0db1-4941-87bc-dac4ebb7766b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:11.004557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-07e282b0-0db1-4941-87bc-dac4ebb7766b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:11.012919 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-07e282b0-0db1-4941-87bc-dac4ebb7766b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1681 microversion: 2.1 time: 0.174143 Oct 29 03:45:11.013506 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3482/6741] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:10 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:12.037656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7d20809c-eb35-4770-9f38-0e085ea65f47 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:12.038263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7d20809c-eb35-4770-9f38-0e085ea65f47 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:12.045630 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7d20809c-eb35-4770-9f38-0e085ea65f47 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:12.046134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7d20809c-eb35-4770-9f38-0e085ea65f47 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:12.046591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7d20809c-eb35-4770-9f38-0e085ea65f47 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:12.047303 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7d20809c-eb35-4770-9f38-0e085ea65f47 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:12.047775 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7d20809c-eb35-4770-9f38-0e085ea65f47 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:12.048215 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7d20809c-eb35-4770-9f38-0e085ea65f47 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:12.189682 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7d20809c-eb35-4770-9f38-0e085ea65f47 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:12.197910 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7d20809c-eb35-4770-9f38-0e085ea65f47 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1681 microversion: 2.1 time: 0.164285 Oct 29 03:45:12.198473 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3260/6742] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:12 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:13.231875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ad212e33-dc2c-42d1-b716-f75675c703cc tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:13.232859 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ad212e33-dc2c-42d1-b716-f75675c703cc tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:13.241166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad212e33-dc2c-42d1-b716-f75675c703cc tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:13.241661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad212e33-dc2c-42d1-b716-f75675c703cc tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:13.242104 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad212e33-dc2c-42d1-b716-f75675c703cc tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:13.242808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad212e33-dc2c-42d1-b716-f75675c703cc tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:13.243267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad212e33-dc2c-42d1-b716-f75675c703cc tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:13.244025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ad212e33-dc2c-42d1-b716-f75675c703cc tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:13.405085 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ad212e33-dc2c-42d1-b716-f75675c703cc tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:13.418111 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ad212e33-dc2c-42d1-b716-f75675c703cc tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1681 microversion: 2.1 time: 0.191631 Oct 29 03:45:13.419089 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3483/6743] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:13 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1681 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:14.444313 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2a33ceb0-25b2-46ac-9524-c551c9565657 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:14.444886 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2a33ceb0-25b2-46ac-9524-c551c9565657 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:14.452206 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a33ceb0-25b2-46ac-9524-c551c9565657 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:14.452739 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a33ceb0-25b2-46ac-9524-c551c9565657 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:14.453186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a33ceb0-25b2-46ac-9524-c551c9565657 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:14.453890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a33ceb0-25b2-46ac-9524-c551c9565657 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:14.454352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a33ceb0-25b2-46ac-9524-c551c9565657 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:14.454789 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a33ceb0-25b2-46ac-9524-c551c9565657 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:14.600373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2a33ceb0-25b2-46ac-9524-c551c9565657 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:14.612098 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2a33ceb0-25b2-46ac-9524-c551c9565657 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1681 microversion: 2.1 time: 0.172454 Oct 29 03:45:14.612946 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3261/6744] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:14 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:15.643387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cc24c4e3-72bc-4315-815d-cd9acf778aef tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:15.643978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cc24c4e3-72bc-4315-815d-cd9acf778aef tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:15.653748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc24c4e3-72bc-4315-815d-cd9acf778aef tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:15.654368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc24c4e3-72bc-4315-815d-cd9acf778aef tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:15.654816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc24c4e3-72bc-4315-815d-cd9acf778aef tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:15.655788 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc24c4e3-72bc-4315-815d-cd9acf778aef tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:15.656251 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc24c4e3-72bc-4315-815d-cd9acf778aef tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:15.656798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc24c4e3-72bc-4315-815d-cd9acf778aef tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:15.805608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cc24c4e3-72bc-4315-815d-cd9acf778aef tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:15.815523 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cc24c4e3-72bc-4315-815d-cd9acf778aef tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1681 microversion: 2.1 time: 0.177980 Oct 29 03:45:15.816115 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3484/6745] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:15 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:16.838685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1a122832-6c15-4b1d-a5cf-75f696ebb3c0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:16.839574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1a122832-6c15-4b1d-a5cf-75f696ebb3c0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:16.847279 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a122832-6c15-4b1d-a5cf-75f696ebb3c0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:16.847802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a122832-6c15-4b1d-a5cf-75f696ebb3c0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:16.848250 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a122832-6c15-4b1d-a5cf-75f696ebb3c0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:16.848993 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a122832-6c15-4b1d-a5cf-75f696ebb3c0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:16.849454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a122832-6c15-4b1d-a5cf-75f696ebb3c0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:16.849890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a122832-6c15-4b1d-a5cf-75f696ebb3c0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:16.990292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1a122832-6c15-4b1d-a5cf-75f696ebb3c0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:16.999110 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1a122832-6c15-4b1d-a5cf-75f696ebb3c0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1681 microversion: 2.1 time: 0.164499 Oct 29 03:45:16.999728 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3262/6746] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:16 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:18.031271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f33f6d84-52b2-423b-ade0-1b032486bbc0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:18.032055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f33f6d84-52b2-423b-ade0-1b032486bbc0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:18.039756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f33f6d84-52b2-423b-ade0-1b032486bbc0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:18.040244 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f33f6d84-52b2-423b-ade0-1b032486bbc0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:18.040720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f33f6d84-52b2-423b-ade0-1b032486bbc0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:18.041417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f33f6d84-52b2-423b-ade0-1b032486bbc0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:18.041868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f33f6d84-52b2-423b-ade0-1b032486bbc0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:18.042316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f33f6d84-52b2-423b-ade0-1b032486bbc0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:18.187640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f33f6d84-52b2-423b-ade0-1b032486bbc0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:18.195702 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f33f6d84-52b2-423b-ade0-1b032486bbc0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1681 microversion: 2.1 time: 0.169784 Oct 29 03:45:18.196302 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3485/6747] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:18 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:19.220693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-74465c6f-a4ca-4104-b527-77980b05f99a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:19.222024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-74465c6f-a4ca-4104-b527-77980b05f99a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:19.229750 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-74465c6f-a4ca-4104-b527-77980b05f99a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:19.230257 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-74465c6f-a4ca-4104-b527-77980b05f99a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:19.230707 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-74465c6f-a4ca-4104-b527-77980b05f99a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:19.231530 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-74465c6f-a4ca-4104-b527-77980b05f99a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:19.231999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-74465c6f-a4ca-4104-b527-77980b05f99a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:19.232593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-74465c6f-a4ca-4104-b527-77980b05f99a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:19.337723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-e06dcb82-0ed4-4e87-a69a-34a183ffa92e req-07794855-90fe-4e1d-8ccc-1c585c8b452d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c0ab293-18af-4f60-ba64-c3c892916738", "name": "network-vif-unplugged", "status": "completed", "tag": "d834ccbc-b5bb-4b14-ae2c-3cdc48bfe6e4"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:45:19.349211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e06dcb82-0ed4-4e87-a69a-34a183ffa92e req-07794855-90fe-4e1d-8ccc-1c585c8b452d service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:19.349683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e06dcb82-0ed4-4e87-a69a-34a183ffa92e req-07794855-90fe-4e1d-8ccc-1c585c8b452d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:19.350128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e06dcb82-0ed4-4e87-a69a-34a183ffa92e req-07794855-90fe-4e1d-8ccc-1c585c8b452d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:19.369693 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-e06dcb82-0ed4-4e87-a69a-34a183ffa92e req-07794855-90fe-4e1d-8ccc-1c585c8b452d service nova] Creating event network-vif-unplugged:d834ccbc-b5bb-4b14-ae2c-3cdc48bfe6e4 for instance 7c0ab293-18af-4f60-ba64-c3c892916738 on n-h1-862967-2 Oct 29 03:45:19.375544 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [req-e06dcb82-0ed4-4e87-a69a-34a183ffa92e req-07794855-90fe-4e1d-8ccc-1c585c8b452d service nova] Instance 7c0ab293-18af-4f60-ba64-c3c892916738 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:45:19.387644 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-e06dcb82-0ed4-4e87-a69a-34a183ffa92e req-07794855-90fe-4e1d-8ccc-1c585c8b452d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053195 Oct 29 03:45:19.388977 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3486/6748] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:45:19.533141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-74465c6f-a4ca-4104-b527-77980b05f99a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:19.541381 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-74465c6f-a4ca-4104-b527-77980b05f99a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1680 microversion: 2.1 time: 0.325334 Oct 29 03:45:19.541985 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3263/6749] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:19 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1680 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:20.567076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b763b0a5-bbc3-48c6-97ba-ad2cfdaa8ce1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:20.567797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b763b0a5-bbc3-48c6-97ba-ad2cfdaa8ce1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:20.575376 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b763b0a5-bbc3-48c6-97ba-ad2cfdaa8ce1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:20.575875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b763b0a5-bbc3-48c6-97ba-ad2cfdaa8ce1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:20.576295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b763b0a5-bbc3-48c6-97ba-ad2cfdaa8ce1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:20.577070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b763b0a5-bbc3-48c6-97ba-ad2cfdaa8ce1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:20.577533 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b763b0a5-bbc3-48c6-97ba-ad2cfdaa8ce1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:20.577968 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b763b0a5-bbc3-48c6-97ba-ad2cfdaa8ce1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:20.711119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b763b0a5-bbc3-48c6-97ba-ad2cfdaa8ce1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:20.719566 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b763b0a5-bbc3-48c6-97ba-ad2cfdaa8ce1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1680 microversion: 2.1 time: 0.157278 Oct 29 03:45:20.720170 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3487/6750] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:20 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:21.441008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-106b26ec-85b6-41ee-8bf4-414dc362450c req-3a1e4a9b-c567-4311-b9e0-aa96f1bbd11e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c0ab293-18af-4f60-ba64-c3c892916738", "tag": "d834ccbc-b5bb-4b14-ae2c-3cdc48bfe6e4"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:45:21.457256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-106b26ec-85b6-41ee-8bf4-414dc362450c req-3a1e4a9b-c567-4311-b9e0-aa96f1bbd11e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:21.457750 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-106b26ec-85b6-41ee-8bf4-414dc362450c req-3a1e4a9b-c567-4311-b9e0-aa96f1bbd11e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:21.458301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-106b26ec-85b6-41ee-8bf4-414dc362450c req-3a1e4a9b-c567-4311-b9e0-aa96f1bbd11e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:21.471094 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-106b26ec-85b6-41ee-8bf4-414dc362450c req-3a1e4a9b-c567-4311-b9e0-aa96f1bbd11e service nova] Creating event network-changed:d834ccbc-b5bb-4b14-ae2c-3cdc48bfe6e4 for instance 7c0ab293-18af-4f60-ba64-c3c892916738 on n-h1-862967-2 Oct 29 03:45:21.476810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [req-106b26ec-85b6-41ee-8bf4-414dc362450c req-3a1e4a9b-c567-4311-b9e0-aa96f1bbd11e service nova] Instance 7c0ab293-18af-4f60-ba64-c3c892916738 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:45:21.488188 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-106b26ec-85b6-41ee-8bf4-414dc362450c req-3a1e4a9b-c567-4311-b9e0-aa96f1bbd11e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053549 Oct 29 03:45:21.488832 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3264/6751] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:45:21.742804 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d778926d-bf75-47f9-af71-3e00074c49ad tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:21.743391 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d778926d-bf75-47f9-af71-3e00074c49ad tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:21.750907 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d778926d-bf75-47f9-af71-3e00074c49ad tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:21.751404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d778926d-bf75-47f9-af71-3e00074c49ad tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:21.751842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d778926d-bf75-47f9-af71-3e00074c49ad tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:21.752660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d778926d-bf75-47f9-af71-3e00074c49ad tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:21.753121 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d778926d-bf75-47f9-af71-3e00074c49ad tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:21.753607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d778926d-bf75-47f9-af71-3e00074c49ad tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:21.962862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d778926d-bf75-47f9-af71-3e00074c49ad tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:21.970968 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d778926d-bf75-47f9-af71-3e00074c49ad tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1678 microversion: 2.1 time: 0.232157 Oct 29 03:45:21.971591 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3488/6752] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:21 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1678 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:23.001990 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5754b548-0eb2-406e-89b1-028f914968f7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:23.003163 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5754b548-0eb2-406e-89b1-028f914968f7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:23.014365 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5754b548-0eb2-406e-89b1-028f914968f7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:23.015218 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5754b548-0eb2-406e-89b1-028f914968f7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:23.015946 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5754b548-0eb2-406e-89b1-028f914968f7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:23.017214 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5754b548-0eb2-406e-89b1-028f914968f7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:23.018001 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5754b548-0eb2-406e-89b1-028f914968f7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:23.018708 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5754b548-0eb2-406e-89b1-028f914968f7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:23.161582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5754b548-0eb2-406e-89b1-028f914968f7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:23.174664 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5754b548-0eb2-406e-89b1-028f914968f7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1675 microversion: 2.1 time: 0.181443 Oct 29 03:45:23.175464 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3265/6753] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:22 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1675 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:23.198407 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3b4c24ac-8048-49fa-beef-474e069ea56d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:45:23.199010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3b4c24ac-8048-49fa-beef-474e069ea56d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:23.206371 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b4c24ac-8048-49fa-beef-474e069ea56d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:23.206860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b4c24ac-8048-49fa-beef-474e069ea56d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:23.207393 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b4c24ac-8048-49fa-beef-474e069ea56d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:23.208130 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b4c24ac-8048-49fa-beef-474e069ea56d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:23.208591 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b4c24ac-8048-49fa-beef-474e069ea56d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:23.209044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b4c24ac-8048-49fa-beef-474e069ea56d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:23.275004 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3b4c24ac-8048-49fa-beef-474e069ea56d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "POST /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738/action" status: 204 len: 0 microversion: 2.1 time: 0.079892 Oct 29 03:45:23.275734 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3489/6754] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:45:23 2022] POST /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:45:23.285338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0a4eda1b-7c06-4595-a647-bc302a099cf5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:23.286137 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0a4eda1b-7c06-4595-a647-bc302a099cf5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:23.292693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a4eda1b-7c06-4595-a647-bc302a099cf5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:23.293335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a4eda1b-7c06-4595-a647-bc302a099cf5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:23.293787 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a4eda1b-7c06-4595-a647-bc302a099cf5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:23.294660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a4eda1b-7c06-4595-a647-bc302a099cf5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:23.295302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a4eda1b-7c06-4595-a647-bc302a099cf5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:23.295746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a4eda1b-7c06-4595-a647-bc302a099cf5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:23.429485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0a4eda1b-7c06-4595-a647-bc302a099cf5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:23.437996 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0a4eda1b-7c06-4595-a647-bc302a099cf5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1675 microversion: 2.1 time: 0.156683 Oct 29 03:45:23.438818 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3266/6755] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:23 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:24.461487 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4a4ec80e-6732-4e58-ac67-dbe7f887fa5c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:24.462166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4a4ec80e-6732-4e58-ac67-dbe7f887fa5c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:24.469734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a4ec80e-6732-4e58-ac67-dbe7f887fa5c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:24.470201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a4ec80e-6732-4e58-ac67-dbe7f887fa5c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:24.470635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a4ec80e-6732-4e58-ac67-dbe7f887fa5c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:24.471339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a4ec80e-6732-4e58-ac67-dbe7f887fa5c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:24.471774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a4ec80e-6732-4e58-ac67-dbe7f887fa5c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:24.472202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a4ec80e-6732-4e58-ac67-dbe7f887fa5c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:24.626214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4a4ec80e-6732-4e58-ac67-dbe7f887fa5c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:24.635496 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4a4ec80e-6732-4e58-ac67-dbe7f887fa5c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1675 microversion: 2.1 time: 0.178330 Oct 29 03:45:24.636112 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3490/6756] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:24 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1675 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:25.659977 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-86cd1262-68da-493f-9cc4-f7977c1b4018 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:25.660698 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-86cd1262-68da-493f-9cc4-f7977c1b4018 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:25.671180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86cd1262-68da-493f-9cc4-f7977c1b4018 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:25.671670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86cd1262-68da-493f-9cc4-f7977c1b4018 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:25.672115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86cd1262-68da-493f-9cc4-f7977c1b4018 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:25.672901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86cd1262-68da-493f-9cc4-f7977c1b4018 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:25.673351 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86cd1262-68da-493f-9cc4-f7977c1b4018 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:25.673793 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86cd1262-68da-493f-9cc4-f7977c1b4018 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:25.810268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-86cd1262-68da-493f-9cc4-f7977c1b4018 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:25.818525 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-86cd1262-68da-493f-9cc4-f7977c1b4018 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1667 microversion: 2.1 time: 0.162746 Oct 29 03:45:25.819115 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3267/6757] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:25 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1667 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:25.841272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-181ddca2-86af-413a-9da2-d689d95734cc tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:25.841885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-181ddca2-86af-413a-9da2-d689d95734cc tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:25.848810 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-181ddca2-86af-413a-9da2-d689d95734cc tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:25.849296 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-181ddca2-86af-413a-9da2-d689d95734cc tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:25.849730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-181ddca2-86af-413a-9da2-d689d95734cc tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:25.850426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-181ddca2-86af-413a-9da2-d689d95734cc tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:25.850909 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-181ddca2-86af-413a-9da2-d689d95734cc tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:25.851289 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-181ddca2-86af-413a-9da2-d689d95734cc tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:25.913533 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-77edffed-4e65-4306-a53f-5b7abccfc283 req-08ecb75f-a255-46b1-b36d-d8e3714f5494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c0ab293-18af-4f60-ba64-c3c892916738", "name": "network-vif-plugged", "status": "completed", "tag": "d834ccbc-b5bb-4b14-ae2c-3cdc48bfe6e4"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:45:25.923431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-77edffed-4e65-4306-a53f-5b7abccfc283 req-08ecb75f-a255-46b1-b36d-d8e3714f5494 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:25.923954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-77edffed-4e65-4306-a53f-5b7abccfc283 req-08ecb75f-a255-46b1-b36d-d8e3714f5494 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:25.924420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-77edffed-4e65-4306-a53f-5b7abccfc283 req-08ecb75f-a255-46b1-b36d-d8e3714f5494 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:25.936602 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-77edffed-4e65-4306-a53f-5b7abccfc283 req-08ecb75f-a255-46b1-b36d-d8e3714f5494 service nova] Creating event network-vif-plugged:d834ccbc-b5bb-4b14-ae2c-3cdc48bfe6e4 for instance 7c0ab293-18af-4f60-ba64-c3c892916738 on n-h1-862967-2 Oct 29 03:45:25.944185 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-77edffed-4e65-4306-a53f-5b7abccfc283 req-08ecb75f-a255-46b1-b36d-d8e3714f5494 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033960 Oct 29 03:45:25.944926 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3268/6758] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:45:25.986808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-181ddca2-86af-413a-9da2-d689d95734cc tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:25.995795 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-181ddca2-86af-413a-9da2-d689d95734cc tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1667 microversion: 2.1 time: 0.158504 Oct 29 03:45:25.996410 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3491/6759] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:25 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1667 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:26.019328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8be6d39f-b66e-4f39-8e3a-f4fa339daf18 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:26.020188 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8be6d39f-b66e-4f39-8e3a-f4fa339daf18 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:26.026811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8be6d39f-b66e-4f39-8e3a-f4fa339daf18 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:26.027316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8be6d39f-b66e-4f39-8e3a-f4fa339daf18 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:26.027779 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8be6d39f-b66e-4f39-8e3a-f4fa339daf18 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:26.028499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8be6d39f-b66e-4f39-8e3a-f4fa339daf18 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:26.028987 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8be6d39f-b66e-4f39-8e3a-f4fa339daf18 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:26.029431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8be6d39f-b66e-4f39-8e3a-f4fa339daf18 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:26.169905 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8be6d39f-b66e-4f39-8e3a-f4fa339daf18 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:26.178602 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8be6d39f-b66e-4f39-8e3a-f4fa339daf18 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1667 microversion: 2.1 time: 0.163689 Oct 29 03:45:26.179177 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3269/6760] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:26 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1667 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:26.201730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-67ea4b7d-53c0-46c2-be7d-59e8bb25705a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:26.202233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-67ea4b7d-53c0-46c2-be7d-59e8bb25705a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:26.212197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67ea4b7d-53c0-46c2-be7d-59e8bb25705a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:26.212727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67ea4b7d-53c0-46c2-be7d-59e8bb25705a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:26.213143 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67ea4b7d-53c0-46c2-be7d-59e8bb25705a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:26.213843 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67ea4b7d-53c0-46c2-be7d-59e8bb25705a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:26.214304 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67ea4b7d-53c0-46c2-be7d-59e8bb25705a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:26.214734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-67ea4b7d-53c0-46c2-be7d-59e8bb25705a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:26.231738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:26.244801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-67ea4b7d-53c0-46c2-be7d-59e8bb25705a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:45:26.331862 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-67ea4b7d-53c0-46c2-be7d-59e8bb25705a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 204 len: 0 microversion: 2.1 time: 0.133721 Oct 29 03:45:26.332573 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3492/6761] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:45:26 2022] DELETE /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:45:26.342501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-caba7c0f-cc1c-4227-885b-60af3f5ed347 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:26.343391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-caba7c0f-cc1c-4227-885b-60af3f5ed347 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:26.350682 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-caba7c0f-cc1c-4227-885b-60af3f5ed347 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:26.351249 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-caba7c0f-cc1c-4227-885b-60af3f5ed347 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:26.351646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-caba7c0f-cc1c-4227-885b-60af3f5ed347 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:26.352380 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-caba7c0f-cc1c-4227-885b-60af3f5ed347 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:26.352882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-caba7c0f-cc1c-4227-885b-60af3f5ed347 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:26.353322 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-caba7c0f-cc1c-4227-885b-60af3f5ed347 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:26.489750 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-caba7c0f-cc1c-4227-885b-60af3f5ed347 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:26.502071 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-caba7c0f-cc1c-4227-885b-60af3f5ed347 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1673 microversion: 2.1 time: 0.164648 Oct 29 03:45:26.502887 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3270/6762] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:26 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:27.526938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ee20cc83-90bf-4c35-b7ff-1564c2e32880 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:27.527644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ee20cc83-90bf-4c35-b7ff-1564c2e32880 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:27.537668 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee20cc83-90bf-4c35-b7ff-1564c2e32880 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:27.538117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee20cc83-90bf-4c35-b7ff-1564c2e32880 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:27.538592 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee20cc83-90bf-4c35-b7ff-1564c2e32880 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:27.539372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee20cc83-90bf-4c35-b7ff-1564c2e32880 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:27.539826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee20cc83-90bf-4c35-b7ff-1564c2e32880 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:27.540252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ee20cc83-90bf-4c35-b7ff-1564c2e32880 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:27.681258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ee20cc83-90bf-4c35-b7ff-1564c2e32880 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:27.689389 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ee20cc83-90bf-4c35-b7ff-1564c2e32880 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1673 microversion: 2.1 time: 0.166986 Oct 29 03:45:27.689979 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3493/6763] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:27 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:28.691647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-6b9d644c-ca38-44fa-ac43-96f9fd261485 req-586ee022-a104-47a3-84a0-678ad6aa1c81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c0ab293-18af-4f60-ba64-c3c892916738", "name": "network-vif-deleted", "tag": "d834ccbc-b5bb-4b14-ae2c-3cdc48bfe6e4"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:45:28.707963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6b9d644c-ca38-44fa-ac43-96f9fd261485 req-586ee022-a104-47a3-84a0-678ad6aa1c81 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:28.708875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6b9d644c-ca38-44fa-ac43-96f9fd261485 req-586ee022-a104-47a3-84a0-678ad6aa1c81 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:28.709870 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-6b9d644c-ca38-44fa-ac43-96f9fd261485 req-586ee022-a104-47a3-84a0-678ad6aa1c81 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:28.714867 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2853c485-4f45-4e67-a253-0b89df1aa730 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:28.715654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2853c485-4f45-4e67-a253-0b89df1aa730 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:28.724963 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2853c485-4f45-4e67-a253-0b89df1aa730 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:28.725579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2853c485-4f45-4e67-a253-0b89df1aa730 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:28.726300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2853c485-4f45-4e67-a253-0b89df1aa730 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:28.726615 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-6b9d644c-ca38-44fa-ac43-96f9fd261485 req-586ee022-a104-47a3-84a0-678ad6aa1c81 service nova] Creating event network-vif-deleted:d834ccbc-b5bb-4b14-ae2c-3cdc48bfe6e4 for instance 7c0ab293-18af-4f60-ba64-c3c892916738 on n-h1-862967-2 Oct 29 03:45:28.727505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2853c485-4f45-4e67-a253-0b89df1aa730 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:28.728040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2853c485-4f45-4e67-a253-0b89df1aa730 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:28.728546 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2853c485-4f45-4e67-a253-0b89df1aa730 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:28.731961 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-6b9d644c-ca38-44fa-ac43-96f9fd261485 req-586ee022-a104-47a3-84a0-678ad6aa1c81 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044402 Oct 29 03:45:28.733773 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3271/6764] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:45:28.810213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2853c485-4f45-4e67-a253-0b89df1aa730 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:28.818389 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2853c485-4f45-4e67-a253-0b89df1aa730 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 200 len: 1322 microversion: 2.1 time: 0.108634 Oct 29 03:45:28.825235 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3494/6765] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:28 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 1322 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:29.848921 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bb85d047-349d-408d-aa11-d8c2bb7cae12 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:29.850018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bb85d047-349d-408d-aa11-d8c2bb7cae12 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:29.860016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb85d047-349d-408d-aa11-d8c2bb7cae12 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:29.860773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb85d047-349d-408d-aa11-d8c2bb7cae12 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:29.861437 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb85d047-349d-408d-aa11-d8c2bb7cae12 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:29.862437 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb85d047-349d-408d-aa11-d8c2bb7cae12 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:29.863104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb85d047-349d-408d-aa11-d8c2bb7cae12 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:29.863827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb85d047-349d-408d-aa11-d8c2bb7cae12 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:29.880066 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-bb85d047-349d-408d-aa11-d8c2bb7cae12 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] HTTP exception thrown: Instance 7c0ab293-18af-4f60-ba64-c3c892916738 could not be found. Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bb85d047-349d-408d-aa11-d8c2bb7cae12 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Request method failure captured: Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 HTTP/1.1 Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKGQJeWMxfWMeM3O6gGoGSgLaotgRmZdXAA5ksXNn18BC3kYiORlqcPrpkO6hwWROtId_i3BPG3tHcLNXgo1DRLTViLVFJkr5ippTm7TWTVVrTinupx_GraljlTHrjKYi9B__lcWVv-kBGfZZl6RvbkghUGxnbsTm6q2TyI0UqnddMU Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2e19c07467824bbfbc0715c6085c40e6"}]}] Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerActionsTestJSON-539616512 Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: fd4c00a472474521add76167023ab141 Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 7c0ab293-18af-4f60-ba64-c3c892916738 could not be found. Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '7c0ab293-18af-4f60-ba64-c3c892916738'} Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c0ab293-18af-4f60-ba64-c3c892916738 could not be found. Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c0ab293-18af-4f60-ba64-c3c892916738 could not be found. Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:45:29.881780 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:45:29.885936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:45:29.885936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:45:29.885936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:45:29.885936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:45:29.885936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:45:29.885936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c0ab293-18af-4f60-ba64-c3c892916738 could not be found. Oct 29 03:45:29.885936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:45:29.885936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bb85d047-349d-408d-aa11-d8c2bb7cae12 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Returning 404 to user: Instance 7c0ab293-18af-4f60-ba64-c3c892916738 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:45:29.885936 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bb85d047-349d-408d-aa11-d8c2bb7cae12 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 404 len: 111 microversion: 2.1 time: 0.043045 Oct 29 03:45:29.885936 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3272/6766] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:29 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:45:29.895476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-13651738-3197-4b77-a47e-36c5eea8a4a3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:29.896101 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-13651738-3197-4b77-a47e-36c5eea8a4a3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:29.905062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13651738-3197-4b77-a47e-36c5eea8a4a3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:29.905498 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13651738-3197-4b77-a47e-36c5eea8a4a3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:29.905943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13651738-3197-4b77-a47e-36c5eea8a4a3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:29.906652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13651738-3197-4b77-a47e-36c5eea8a4a3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:29.907118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13651738-3197-4b77-a47e-36c5eea8a4a3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:29.907553 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13651738-3197-4b77-a47e-36c5eea8a4a3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:29.921548 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-13651738-3197-4b77-a47e-36c5eea8a4a3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] HTTP exception thrown: Instance 7c0ab293-18af-4f60-ba64-c3c892916738 could not be found. Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-13651738-3197-4b77-a47e-36c5eea8a4a3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Request method failure captured: Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 HTTP/1.1 Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXKGQJeWMxfWMeM3O6gGoGSgLaotgRmZdXAA5ksXNn18BC3kYiORlqcPrpkO6hwWROtId_i3BPG3tHcLNXgo1DRLTViLVFJkr5ippTm7TWTVVrTinupx_GraljlTHrjKYi9B__lcWVv-kBGfZZl6RvbkghUGxnbsTm6q2TyI0UqnddMU Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2e19c07467824bbfbc0715c6085c40e6"}]}] Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServerActionsTestJSON-539616512 Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: fd4c00a472474521add76167023ab141 Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 7c0ab293-18af-4f60-ba64-c3c892916738 could not be found. Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '7c0ab293-18af-4f60-ba64-c3c892916738'} Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c0ab293-18af-4f60-ba64-c3c892916738 could not be found. Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c0ab293-18af-4f60-ba64-c3c892916738 could not be found. Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:45:29.923264 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:45:29.927748 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:45:29.927748 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:45:29.927748 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:45:29.927748 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:45:29.927748 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:45:29.927748 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c0ab293-18af-4f60-ba64-c3c892916738 could not be found. Oct 29 03:45:29.927748 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:45:29.927748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-13651738-3197-4b77-a47e-36c5eea8a4a3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Returning 404 to user: Instance 7c0ab293-18af-4f60-ba64-c3c892916738 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:45:29.927748 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-13651738-3197-4b77-a47e-36c5eea8a4a3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 404 len: 111 microversion: 2.1 time: 0.033244 Oct 29 03:45:29.927748 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3495/6767] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:29 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:45:29.979128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3c3e4268-6469-4910-aab8-c31424f39eff tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1813389623", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "16b776c7-5074-4f3f-a183-66ccafda21d7"}], "security_groups": [{"name": "tempest-securitygroup--98886569"}], "key_name": "tempest-keypair-685611708", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:45:30.101518 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-3c3e4268-6469-4910-aab8-c31424f39eff tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] validate_networks() for [('16b776c7-5074-4f3f-a183-66ccafda21d7', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:45:30.513571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-3c3e4268-6469-4910-aab8-c31424f39eff tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:45:30.514030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-3c3e4268-6469-4910-aab8-c31424f39eff tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:45:30.514627 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-3c3e4268-6469-4910-aab8-c31424f39eff tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:45:30.515118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-3c3e4268-6469-4910-aab8-c31424f39eff tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:45:30.515624 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-3c3e4268-6469-4910-aab8-c31424f39eff tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:45:30.527254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3c3e4268-6469-4910-aab8-c31424f39eff tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:30.527748 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3c3e4268-6469-4910-aab8-c31424f39eff tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:30.528195 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3c3e4268-6469-4910-aab8-c31424f39eff tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:30.528975 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3c3e4268-6469-4910-aab8-c31424f39eff tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:30.529439 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3c3e4268-6469-4910-aab8-c31424f39eff tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:30.529873 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3c3e4268-6469-4910-aab8-c31424f39eff tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:30.549511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-3c3e4268-6469-4910-aab8-c31424f39eff tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Getting quotas for project 2e19c07467824bbfbc0715c6085c40e6. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:45:30.554956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-3c3e4268-6469-4910-aab8-c31424f39eff tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Getting quotas for user fd4c00a472474521add76167023ab141 and project 2e19c07467824bbfbc0715c6085c40e6. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:45:30.567747 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3c3e4268-6469-4910-aab8-c31424f39eff tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:45:30.570201 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3c3e4268-6469-4910-aab8-c31424f39eff tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:45:30.620994 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3c3e4268-6469-4910-aab8-c31424f39eff tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.645743 Oct 29 03:45:30.621666 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3273/6768] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:45:29 2022] POST /compute/v2.1/servers => generated 404 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:45:30.634939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f9844f1b-98d8-480d-b30e-55fdd589785a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:30.635761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f9844f1b-98d8-480d-b30e-55fdd589785a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:30.695819 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f9844f1b-98d8-480d-b30e-55fdd589785a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:30.705327 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f9844f1b-98d8-480d-b30e-55fdd589785a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1238 microversion: 2.1 time: 0.075926 Oct 29 03:45:30.706261 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3496/6769] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:30 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1238 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:31.732539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-93b85ebd-a0c6-4fa4-b211-3459fd992302 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:31.733130 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-93b85ebd-a0c6-4fa4-b211-3459fd992302 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:31.740964 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93b85ebd-a0c6-4fa4-b211-3459fd992302 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:31.741485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93b85ebd-a0c6-4fa4-b211-3459fd992302 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:31.741964 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93b85ebd-a0c6-4fa4-b211-3459fd992302 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:31.742739 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93b85ebd-a0c6-4fa4-b211-3459fd992302 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:31.743236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93b85ebd-a0c6-4fa4-b211-3459fd992302 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:31.744081 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93b85ebd-a0c6-4fa4-b211-3459fd992302 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:31.763818 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=100 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:31.815932 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-93b85ebd-a0c6-4fa4-b211-3459fd992302 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:31.824406 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-93b85ebd-a0c6-4fa4-b211-3459fd992302 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1290 microversion: 2.1 time: 0.098343 Oct 29 03:45:31.825144 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3274/6770] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:31 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1290 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:32.849400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3dce3caa-c7ad-4bd6-9e5e-254c00880936 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:32.850020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3dce3caa-c7ad-4bd6-9e5e-254c00880936 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:32.861385 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3dce3caa-c7ad-4bd6-9e5e-254c00880936 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:32.861884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3dce3caa-c7ad-4bd6-9e5e-254c00880936 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:32.862334 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3dce3caa-c7ad-4bd6-9e5e-254c00880936 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:32.863052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3dce3caa-c7ad-4bd6-9e5e-254c00880936 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:32.863600 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3dce3caa-c7ad-4bd6-9e5e-254c00880936 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:32.863998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3dce3caa-c7ad-4bd6-9e5e-254c00880936 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:32.999172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3dce3caa-c7ad-4bd6-9e5e-254c00880936 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:33.007347 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3dce3caa-c7ad-4bd6-9e5e-254c00880936 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1362 microversion: 2.1 time: 0.162071 Oct 29 03:45:33.007937 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3497/6771] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:32 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:33.316266 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-cbb82da1-a51d-45ba-8c36-8f6e6168b2a2 req-a6417092-8bd6-4c3c-9126-6d144c993ecd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79cc9059-3092-4668-89c8-d719e8251192", "tag": "f12be743-578d-4346-ba16-b284a7226ef8"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:45:33.327960 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-cbb82da1-a51d-45ba-8c36-8f6e6168b2a2 req-a6417092-8bd6-4c3c-9126-6d144c993ecd service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:33.328619 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-cbb82da1-a51d-45ba-8c36-8f6e6168b2a2 req-a6417092-8bd6-4c3c-9126-6d144c993ecd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:33.329161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-cbb82da1-a51d-45ba-8c36-8f6e6168b2a2 req-a6417092-8bd6-4c3c-9126-6d144c993ecd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:33.341241 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-cbb82da1-a51d-45ba-8c36-8f6e6168b2a2 req-a6417092-8bd6-4c3c-9126-6d144c993ecd service nova] Creating event network-changed:f12be743-578d-4346-ba16-b284a7226ef8 for instance 79cc9059-3092-4668-89c8-d719e8251192 on n-h1-862967-2 Oct 29 03:45:33.346342 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-cbb82da1-a51d-45ba-8c36-8f6e6168b2a2 req-a6417092-8bd6-4c3c-9126-6d144c993ecd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033770 Oct 29 03:45:33.346969 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3275/6772] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:45:34.031448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2903e410-d174-4656-b172-4eb8a7bb299d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:34.032075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2903e410-d174-4656-b172-4eb8a7bb299d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:34.040686 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2903e410-d174-4656-b172-4eb8a7bb299d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:34.041211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2903e410-d174-4656-b172-4eb8a7bb299d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:34.041696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2903e410-d174-4656-b172-4eb8a7bb299d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:34.042867 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2903e410-d174-4656-b172-4eb8a7bb299d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:34.043583 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2903e410-d174-4656-b172-4eb8a7bb299d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:34.044020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2903e410-d174-4656-b172-4eb8a7bb299d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:34.190060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2903e410-d174-4656-b172-4eb8a7bb299d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:34.202526 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2903e410-d174-4656-b172-4eb8a7bb299d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1362 microversion: 2.1 time: 0.174841 Oct 29 03:45:34.203401 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3498/6773] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:34 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:35.229491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-810055e7-ae27-40de-9c53-14788a214d93 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:35.230197 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-810055e7-ae27-40de-9c53-14788a214d93 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:35.232217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:35.237704 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-810055e7-ae27-40de-9c53-14788a214d93 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:35.238203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-810055e7-ae27-40de-9c53-14788a214d93 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:35.238657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-810055e7-ae27-40de-9c53-14788a214d93 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:35.239364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-810055e7-ae27-40de-9c53-14788a214d93 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:35.239859 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-810055e7-ae27-40de-9c53-14788a214d93 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:35.240259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-810055e7-ae27-40de-9c53-14788a214d93 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:35.453023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-810055e7-ae27-40de-9c53-14788a214d93 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:35.461394 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-810055e7-ae27-40de-9c53-14788a214d93 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1362 microversion: 2.1 time: 0.237470 Oct 29 03:45:35.462137 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3276/6774] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:35 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:36.488670 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cbe71915-cc40-4a9e-a53f-58dd6443927f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:36.489333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cbe71915-cc40-4a9e-a53f-58dd6443927f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:36.492734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:36.498607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cbe71915-cc40-4a9e-a53f-58dd6443927f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:36.499093 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cbe71915-cc40-4a9e-a53f-58dd6443927f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:36.499528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cbe71915-cc40-4a9e-a53f-58dd6443927f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:36.500238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cbe71915-cc40-4a9e-a53f-58dd6443927f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:36.500730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cbe71915-cc40-4a9e-a53f-58dd6443927f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:36.501160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cbe71915-cc40-4a9e-a53f-58dd6443927f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:36.636861 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cbe71915-cc40-4a9e-a53f-58dd6443927f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:36.644791 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cbe71915-cc40-4a9e-a53f-58dd6443927f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1362 microversion: 2.1 time: 0.160347 Oct 29 03:45:36.645380 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3499/6775] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:36 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:37.671805 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-34a0d6eb-5638-4fa4-b4a2-6f32cc4a0093 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:37.672643 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-34a0d6eb-5638-4fa4-b4a2-6f32cc4a0093 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:37.682616 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34a0d6eb-5638-4fa4-b4a2-6f32cc4a0093 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:37.683343 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34a0d6eb-5638-4fa4-b4a2-6f32cc4a0093 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:37.684053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34a0d6eb-5638-4fa4-b4a2-6f32cc4a0093 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:37.685080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34a0d6eb-5638-4fa4-b4a2-6f32cc4a0093 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:37.685780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34a0d6eb-5638-4fa4-b4a2-6f32cc4a0093 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:37.686426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34a0d6eb-5638-4fa4-b4a2-6f32cc4a0093 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:37.824346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-34a0d6eb-5638-4fa4-b4a2-6f32cc4a0093 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:37.832559 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-34a0d6eb-5638-4fa4-b4a2-6f32cc4a0093 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1362 microversion: 2.1 time: 0.166603 Oct 29 03:45:37.833191 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3277/6776] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:37 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:37.967678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-fb384149-5447-43f5-8fdc-a300b8b7d689 req-f379baef-2592-4ec4-9339-95ffe73e2dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79cc9059-3092-4668-89c8-d719e8251192", "name": "network-vif-plugged", "status": "completed", "tag": "f12be743-578d-4346-ba16-b284a7226ef8"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:45:37.979928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-fb384149-5447-43f5-8fdc-a300b8b7d689 req-f379baef-2592-4ec4-9339-95ffe73e2dd0 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:37.980563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-fb384149-5447-43f5-8fdc-a300b8b7d689 req-f379baef-2592-4ec4-9339-95ffe73e2dd0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:37.981456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-fb384149-5447-43f5-8fdc-a300b8b7d689 req-f379baef-2592-4ec4-9339-95ffe73e2dd0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:37.993949 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-fb384149-5447-43f5-8fdc-a300b8b7d689 req-f379baef-2592-4ec4-9339-95ffe73e2dd0 service nova] Creating event network-vif-plugged:f12be743-578d-4346-ba16-b284a7226ef8 for instance 79cc9059-3092-4668-89c8-d719e8251192 on n-h1-862967-2 Oct 29 03:45:37.999100 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-fb384149-5447-43f5-8fdc-a300b8b7d689 req-f379baef-2592-4ec4-9339-95ffe73e2dd0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035234 Oct 29 03:45:38.000089 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3500/6777] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:45:38.860661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-63a7ed9a-15ee-4136-b546-dce2d8171886 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:38.861880 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-63a7ed9a-15ee-4136-b546-dce2d8171886 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:38.871605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63a7ed9a-15ee-4136-b546-dce2d8171886 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:38.872115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63a7ed9a-15ee-4136-b546-dce2d8171886 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:38.872604 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63a7ed9a-15ee-4136-b546-dce2d8171886 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:38.873323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63a7ed9a-15ee-4136-b546-dce2d8171886 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:38.873798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63a7ed9a-15ee-4136-b546-dce2d8171886 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:38.874247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-63a7ed9a-15ee-4136-b546-dce2d8171886 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:39.018020 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-63a7ed9a-15ee-4136-b546-dce2d8171886 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:39.029045 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-63a7ed9a-15ee-4136-b546-dce2d8171886 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1362 microversion: 2.1 time: 0.174912 Oct 29 03:45:39.029954 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3278/6778] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:38 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:40.054891 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5062c214-4e83-44e8-b246-33f098896c6e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:40.055587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5062c214-4e83-44e8-b246-33f098896c6e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:40.062611 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5062c214-4e83-44e8-b246-33f098896c6e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:40.063102 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5062c214-4e83-44e8-b246-33f098896c6e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:40.063659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5062c214-4e83-44e8-b246-33f098896c6e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:40.064371 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5062c214-4e83-44e8-b246-33f098896c6e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:40.064892 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5062c214-4e83-44e8-b246-33f098896c6e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:40.065320 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5062c214-4e83-44e8-b246-33f098896c6e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:40.213654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5062c214-4e83-44e8-b246-33f098896c6e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:45:40.224959 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5062c214-4e83-44e8-b246-33f098896c6e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1550 microversion: 2.1 time: 0.175291 Oct 29 03:45:40.225548 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3501/6779] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:45:40 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1550 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:45:40.251500 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bb84f819-404c-4a26-9f1e-fc43fd33ef23 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:45:40.252015 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bb84f819-404c-4a26-9f1e-fc43fd33ef23 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:45:40.262159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb84f819-404c-4a26-9f1e-fc43fd33ef23 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:40.262887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb84f819-404c-4a26-9f1e-fc43fd33ef23 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:40.263514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb84f819-404c-4a26-9f1e-fc43fd33ef23 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:40.264573 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb84f819-404c-4a26-9f1e-fc43fd33ef23 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:40.265226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb84f819-404c-4a26-9f1e-fc43fd33ef23 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:40.265811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb84f819-404c-4a26-9f1e-fc43fd33ef23 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:40.348482 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bb84f819-404c-4a26-9f1e-fc43fd33ef23 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103125 Oct 29 03:45:40.349366 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3279/6780] 10.222.0.46 () {58 vars in 1275 bytes} [Sat Oct 29 03:45:40 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:45:41.339097 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-ba760e4b-cfbd-4847-8790-58fc2ebb8d20 req-91b22274-e21c-450e-9a3c-782f73f84415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79cc9059-3092-4668-89c8-d719e8251192", "tag": "f12be743-578d-4346-ba16-b284a7226ef8"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:45:41.344097 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:41.351321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ba760e4b-cfbd-4847-8790-58fc2ebb8d20 req-91b22274-e21c-450e-9a3c-782f73f84415 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:45:41.351796 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ba760e4b-cfbd-4847-8790-58fc2ebb8d20 req-91b22274-e21c-450e-9a3c-782f73f84415 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:45:41.352235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ba760e4b-cfbd-4847-8790-58fc2ebb8d20 req-91b22274-e21c-450e-9a3c-782f73f84415 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:45:41.363792 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-ba760e4b-cfbd-4847-8790-58fc2ebb8d20 req-91b22274-e21c-450e-9a3c-782f73f84415 service nova] Creating event network-changed:f12be743-578d-4346-ba16-b284a7226ef8 for instance 79cc9059-3092-4668-89c8-d719e8251192 on n-h1-862967-2 Oct 29 03:45:41.369190 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-ba760e4b-cfbd-4847-8790-58fc2ebb8d20 req-91b22274-e21c-450e-9a3c-782f73f84415 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033757 Oct 29 03:45:41.369800 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3502/6781] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:46:14.461472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:46:14.462353 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:46:14.464467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=7 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:46:14.465132 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=26 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:46:14.469282 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-76bf1b04-c15b-48a4-9b46-d6a0ac97df91 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:46:14.478661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-76bf1b04-c15b-48a4-9b46-d6a0ac97df91 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:14.479166 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-76bf1b04-c15b-48a4-9b46-d6a0ac97df91 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:14.479661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-76bf1b04-c15b-48a4-9b46-d6a0ac97df91 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:14.509690 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-76bf1b04-c15b-48a4-9b46-d6a0ac97df91 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Going to try to stop instance {{(pid=127125) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 03:46:14.558183 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-76bf1b04-c15b-48a4-9b46-d6a0ac97df91 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "POST /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192/action" status: 202 len: 0 microversion: 2.1 time: 0.097173 Oct 29 03:46:14.560731 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3280/6782] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:46:14 2022] POST /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:46:14.565929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=7 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:46:14.566835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:46:14.571579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8bb68d70-5a82-49a5-83fc-f53542d52370 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:14.572483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8bb68d70-5a82-49a5-83fc-f53542d52370 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:14.580835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bb68d70-5a82-49a5-83fc-f53542d52370 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:14.581364 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bb68d70-5a82-49a5-83fc-f53542d52370 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:14.581790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bb68d70-5a82-49a5-83fc-f53542d52370 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:14.582548 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bb68d70-5a82-49a5-83fc-f53542d52370 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:14.583004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bb68d70-5a82-49a5-83fc-f53542d52370 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:14.583435 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8bb68d70-5a82-49a5-83fc-f53542d52370 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:14.728660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8bb68d70-5a82-49a5-83fc-f53542d52370 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:14.738879 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8bb68d70-5a82-49a5-83fc-f53542d52370 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1679 microversion: 2.1 time: 0.175395 Oct 29 03:46:14.739448 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3503/6783] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:14 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:15.764627 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2767650f-7cfc-4ab0-b33a-423042d349f7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:15.765368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2767650f-7cfc-4ab0-b33a-423042d349f7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:15.772331 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2767650f-7cfc-4ab0-b33a-423042d349f7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:15.772876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2767650f-7cfc-4ab0-b33a-423042d349f7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:15.773331 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2767650f-7cfc-4ab0-b33a-423042d349f7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:15.774052 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2767650f-7cfc-4ab0-b33a-423042d349f7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:15.774516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2767650f-7cfc-4ab0-b33a-423042d349f7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:15.774966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2767650f-7cfc-4ab0-b33a-423042d349f7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:15.923961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2767650f-7cfc-4ab0-b33a-423042d349f7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:15.936317 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2767650f-7cfc-4ab0-b33a-423042d349f7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1679 microversion: 2.1 time: 0.176717 Oct 29 03:46:15.937162 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3281/6784] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:15 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:16.965845 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ffe0028f-df61-4d67-89f8-479350d62fad tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:16.966760 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ffe0028f-df61-4d67-89f8-479350d62fad tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:16.978291 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffe0028f-df61-4d67-89f8-479350d62fad tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:16.978998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffe0028f-df61-4d67-89f8-479350d62fad tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:16.979644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffe0028f-df61-4d67-89f8-479350d62fad tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:16.980797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffe0028f-df61-4d67-89f8-479350d62fad tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:16.981546 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffe0028f-df61-4d67-89f8-479350d62fad tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:16.982256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffe0028f-df61-4d67-89f8-479350d62fad tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:17.131031 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ffe0028f-df61-4d67-89f8-479350d62fad tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:17.139531 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ffe0028f-df61-4d67-89f8-479350d62fad tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1679 microversion: 2.1 time: 0.180259 Oct 29 03:46:17.140130 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3504/6785] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:16 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:18.165519 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-33bb662c-45a8-436d-ab18-f04cedc26b9f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:18.166259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-33bb662c-45a8-436d-ab18-f04cedc26b9f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:18.174512 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33bb662c-45a8-436d-ab18-f04cedc26b9f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:18.175100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33bb662c-45a8-436d-ab18-f04cedc26b9f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:18.175620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33bb662c-45a8-436d-ab18-f04cedc26b9f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:18.176452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33bb662c-45a8-436d-ab18-f04cedc26b9f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:18.177038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33bb662c-45a8-436d-ab18-f04cedc26b9f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:18.177558 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33bb662c-45a8-436d-ab18-f04cedc26b9f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:18.321412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-33bb662c-45a8-436d-ab18-f04cedc26b9f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:18.334263 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-33bb662c-45a8-436d-ab18-f04cedc26b9f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1679 microversion: 2.1 time: 0.173818 Oct 29 03:46:18.334750 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3282/6786] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:18 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:19.359013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cc00b8bd-4ee1-433f-8223-f67cfece2f12 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:19.359726 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cc00b8bd-4ee1-433f-8223-f67cfece2f12 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:19.367229 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc00b8bd-4ee1-433f-8223-f67cfece2f12 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:19.367875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc00b8bd-4ee1-433f-8223-f67cfece2f12 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:19.368822 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc00b8bd-4ee1-433f-8223-f67cfece2f12 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:19.369546 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc00b8bd-4ee1-433f-8223-f67cfece2f12 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:19.370009 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc00b8bd-4ee1-433f-8223-f67cfece2f12 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:19.370438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cc00b8bd-4ee1-433f-8223-f67cfece2f12 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:19.529882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cc00b8bd-4ee1-433f-8223-f67cfece2f12 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:19.538680 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cc00b8bd-4ee1-433f-8223-f67cfece2f12 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1679 microversion: 2.1 time: 0.183892 Oct 29 03:46:19.539263 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3505/6787] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:19 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:20.567858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-77bc9e31-7192-4c22-9b64-34a6723a3304 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:20.568951 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-77bc9e31-7192-4c22-9b64-34a6723a3304 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:20.579103 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77bc9e31-7192-4c22-9b64-34a6723a3304 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:20.579877 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77bc9e31-7192-4c22-9b64-34a6723a3304 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:20.580731 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77bc9e31-7192-4c22-9b64-34a6723a3304 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:20.581895 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77bc9e31-7192-4c22-9b64-34a6723a3304 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:20.582667 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77bc9e31-7192-4c22-9b64-34a6723a3304 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:20.583396 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77bc9e31-7192-4c22-9b64-34a6723a3304 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:20.719416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-77bc9e31-7192-4c22-9b64-34a6723a3304 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:20.732404 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-77bc9e31-7192-4c22-9b64-34a6723a3304 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1679 microversion: 2.1 time: 0.171911 Oct 29 03:46:20.733178 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3283/6788] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:20 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:21.759226 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1961b523-a40b-4292-ab13-55719252d504 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:21.759981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1961b523-a40b-4292-ab13-55719252d504 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:21.768904 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1961b523-a40b-4292-ab13-55719252d504 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:21.769523 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1961b523-a40b-4292-ab13-55719252d504 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:21.770076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1961b523-a40b-4292-ab13-55719252d504 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:21.770984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1961b523-a40b-4292-ab13-55719252d504 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:21.771560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1961b523-a40b-4292-ab13-55719252d504 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:21.772100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1961b523-a40b-4292-ab13-55719252d504 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:21.918606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1961b523-a40b-4292-ab13-55719252d504 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:21.926825 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1961b523-a40b-4292-ab13-55719252d504 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1679 microversion: 2.1 time: 0.172798 Oct 29 03:46:21.927410 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3506/6789] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:21 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:22.953496 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-73dad9b0-1645-4588-b387-21a27f0f6ff5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:22.954387 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-73dad9b0-1645-4588-b387-21a27f0f6ff5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:22.963453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73dad9b0-1645-4588-b387-21a27f0f6ff5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:22.963952 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73dad9b0-1645-4588-b387-21a27f0f6ff5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:22.964394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73dad9b0-1645-4588-b387-21a27f0f6ff5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:22.965143 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73dad9b0-1645-4588-b387-21a27f0f6ff5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:22.965634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73dad9b0-1645-4588-b387-21a27f0f6ff5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:22.966041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73dad9b0-1645-4588-b387-21a27f0f6ff5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:23.100165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-73dad9b0-1645-4588-b387-21a27f0f6ff5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:23.108243 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-73dad9b0-1645-4588-b387-21a27f0f6ff5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1679 microversion: 2.1 time: 0.160404 Oct 29 03:46:23.108853 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3284/6790] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:22 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:24.133384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-69b5919f-ce37-4c8c-91f9-6cb2306d7aa6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:24.134000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-69b5919f-ce37-4c8c-91f9-6cb2306d7aa6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:24.141279 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69b5919f-ce37-4c8c-91f9-6cb2306d7aa6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:24.141783 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69b5919f-ce37-4c8c-91f9-6cb2306d7aa6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:24.142226 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69b5919f-ce37-4c8c-91f9-6cb2306d7aa6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:24.142964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69b5919f-ce37-4c8c-91f9-6cb2306d7aa6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:24.143445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69b5919f-ce37-4c8c-91f9-6cb2306d7aa6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:24.143877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-69b5919f-ce37-4c8c-91f9-6cb2306d7aa6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:24.279230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-69b5919f-ce37-4c8c-91f9-6cb2306d7aa6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:24.288096 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-69b5919f-ce37-4c8c-91f9-6cb2306d7aa6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1679 microversion: 2.1 time: 0.159360 Oct 29 03:46:24.288768 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3507/6791] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:24 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:25.316358 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0146f3b1-1487-4d68-af7e-6b202564a00f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:25.317619 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0146f3b1-1487-4d68-af7e-6b202564a00f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:25.329318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0146f3b1-1487-4d68-af7e-6b202564a00f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:25.330148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0146f3b1-1487-4d68-af7e-6b202564a00f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:25.330891 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0146f3b1-1487-4d68-af7e-6b202564a00f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:25.332091 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0146f3b1-1487-4d68-af7e-6b202564a00f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:25.332883 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0146f3b1-1487-4d68-af7e-6b202564a00f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:25.333578 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0146f3b1-1487-4d68-af7e-6b202564a00f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:25.471858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0146f3b1-1487-4d68-af7e-6b202564a00f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:25.482024 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0146f3b1-1487-4d68-af7e-6b202564a00f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1679 microversion: 2.1 time: 0.172229 Oct 29 03:46:25.482578 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3285/6792] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:25 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:26.510892 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f5b5245e-3b0f-4a19-82e5-bae2e6d187e7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:26.511595 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f5b5245e-3b0f-4a19-82e5-bae2e6d187e7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:26.519896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5b5245e-3b0f-4a19-82e5-bae2e6d187e7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:26.520443 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5b5245e-3b0f-4a19-82e5-bae2e6d187e7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:26.520918 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5b5245e-3b0f-4a19-82e5-bae2e6d187e7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:26.521632 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5b5245e-3b0f-4a19-82e5-bae2e6d187e7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:26.522094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5b5245e-3b0f-4a19-82e5-bae2e6d187e7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:26.522526 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5b5245e-3b0f-4a19-82e5-bae2e6d187e7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:26.658526 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f5b5245e-3b0f-4a19-82e5-bae2e6d187e7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:26.666464 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f5b5245e-3b0f-4a19-82e5-bae2e6d187e7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1679 microversion: 2.1 time: 0.162237 Oct 29 03:46:26.670267 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3508/6793] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:26 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:27.690565 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-07a53d51-133c-40b2-875a-34c15fbaaadf tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:27.691219 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-07a53d51-133c-40b2-875a-34c15fbaaadf tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:27.698989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07a53d51-133c-40b2-875a-34c15fbaaadf tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:27.699517 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07a53d51-133c-40b2-875a-34c15fbaaadf tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:27.699970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07a53d51-133c-40b2-875a-34c15fbaaadf tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:27.700730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07a53d51-133c-40b2-875a-34c15fbaaadf tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:27.701230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07a53d51-133c-40b2-875a-34c15fbaaadf tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:27.701675 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07a53d51-133c-40b2-875a-34c15fbaaadf tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:27.852018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-07a53d51-133c-40b2-875a-34c15fbaaadf tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:27.860563 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-07a53d51-133c-40b2-875a-34c15fbaaadf tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1679 microversion: 2.1 time: 0.173978 Oct 29 03:46:27.861179 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3286/6794] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:27 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:28.887079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-51b9b597-f70a-4e0e-896e-cc126f76b025 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:28.887700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-51b9b597-f70a-4e0e-896e-cc126f76b025 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:28.895161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51b9b597-f70a-4e0e-896e-cc126f76b025 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:28.895647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51b9b597-f70a-4e0e-896e-cc126f76b025 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:28.896097 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51b9b597-f70a-4e0e-896e-cc126f76b025 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:28.896834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51b9b597-f70a-4e0e-896e-cc126f76b025 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:28.897295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51b9b597-f70a-4e0e-896e-cc126f76b025 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:28.897724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51b9b597-f70a-4e0e-896e-cc126f76b025 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:29.044189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-51b9b597-f70a-4e0e-896e-cc126f76b025 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:29.056066 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-51b9b597-f70a-4e0e-896e-cc126f76b025 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1679 microversion: 2.1 time: 0.173040 Oct 29 03:46:29.056656 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3509/6795] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:28 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:30.079687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d05434cf-a0b8-4dd6-bb87-edb7cb4eb625 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:30.080311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d05434cf-a0b8-4dd6-bb87-edb7cb4eb625 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:30.087427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d05434cf-a0b8-4dd6-bb87-edb7cb4eb625 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:30.087930 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d05434cf-a0b8-4dd6-bb87-edb7cb4eb625 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:30.088374 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d05434cf-a0b8-4dd6-bb87-edb7cb4eb625 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:30.089107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d05434cf-a0b8-4dd6-bb87-edb7cb4eb625 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:30.089569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d05434cf-a0b8-4dd6-bb87-edb7cb4eb625 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:30.090002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d05434cf-a0b8-4dd6-bb87-edb7cb4eb625 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:30.223507 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d05434cf-a0b8-4dd6-bb87-edb7cb4eb625 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:30.231912 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d05434cf-a0b8-4dd6-bb87-edb7cb4eb625 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1656 microversion: 2.1 time: 0.156305 Oct 29 03:46:30.232504 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3287/6796] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:30 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1656 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:30.255318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5ed1d437-70e3-43e7-a75d-ea0a62decd45 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:46:30.257653 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5ed1d437-70e3-43e7-a75d-ea0a62decd45 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:30.264929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ed1d437-70e3-43e7-a75d-ea0a62decd45 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:30.265421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ed1d437-70e3-43e7-a75d-ea0a62decd45 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:30.265866 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ed1d437-70e3-43e7-a75d-ea0a62decd45 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:30.266577 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ed1d437-70e3-43e7-a75d-ea0a62decd45 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:30.267039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ed1d437-70e3-43e7-a75d-ea0a62decd45 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:30.267470 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ed1d437-70e3-43e7-a75d-ea0a62decd45 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:30.299357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5ed1d437-70e3-43e7-a75d-ea0a62decd45 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:30.305288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5ed1d437-70e3-43e7-a75d-ea0a62decd45 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Old instance type m1.heat2, new instance type m1.heat {{(pid=127124) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 03:46:30.312220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-5ed1d437-70e3-43e7-a75d-ea0a62decd45 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:46:30.312644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-5ed1d437-70e3-43e7-a75d-ea0a62decd45 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:46:30.313141 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-5ed1d437-70e3-43e7-a75d-ea0a62decd45 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:46:30.313548 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-5ed1d437-70e3-43e7-a75d-ea0a62decd45 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:46:30.313958 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-5ed1d437-70e3-43e7-a75d-ea0a62decd45 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:46:30.379294 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5ed1d437-70e3-43e7-a75d-ea0a62decd45 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "POST /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192/action" status: 202 len: 0 microversion: 2.1 time: 0.127894 Oct 29 03:46:30.379831 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3510/6797] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:46:30 2022] POST /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:46:30.388360 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bf112544-a0be-4c7b-8e33-ea5c00ae8ec2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:30.389096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bf112544-a0be-4c7b-8e33-ea5c00ae8ec2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:30.395631 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf112544-a0be-4c7b-8e33-ea5c00ae8ec2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:30.396555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf112544-a0be-4c7b-8e33-ea5c00ae8ec2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:30.396555 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf112544-a0be-4c7b-8e33-ea5c00ae8ec2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:30.397370 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf112544-a0be-4c7b-8e33-ea5c00ae8ec2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:30.397779 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf112544-a0be-4c7b-8e33-ea5c00ae8ec2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:30.398224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf112544-a0be-4c7b-8e33-ea5c00ae8ec2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:30.571933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bf112544-a0be-4c7b-8e33-ea5c00ae8ec2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:30.580142 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bf112544-a0be-4c7b-8e33-ea5c00ae8ec2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1679 microversion: 2.1 time: 0.195860 Oct 29 03:46:30.581075 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3288/6798] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:30 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1679 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:31.604677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-76140a25-7f7f-409d-992d-3878bb72e4e6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:31.605318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-76140a25-7f7f-409d-992d-3878bb72e4e6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:31.613030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76140a25-7f7f-409d-992d-3878bb72e4e6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:31.613527 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76140a25-7f7f-409d-992d-3878bb72e4e6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:31.613965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76140a25-7f7f-409d-992d-3878bb72e4e6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:31.614677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76140a25-7f7f-409d-992d-3878bb72e4e6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:31.615129 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76140a25-7f7f-409d-992d-3878bb72e4e6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:31.615910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76140a25-7f7f-409d-992d-3878bb72e4e6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:31.761266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-76140a25-7f7f-409d-992d-3878bb72e4e6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:31.769488 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-76140a25-7f7f-409d-992d-3878bb72e4e6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1679 microversion: 2.1 time: 0.169818 Oct 29 03:46:31.770315 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3511/6799] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:31 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:32.793958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-32c8c060-7172-47cb-ada4-2abeaefb6b5e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:32.794553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-32c8c060-7172-47cb-ada4-2abeaefb6b5e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:32.802194 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32c8c060-7172-47cb-ada4-2abeaefb6b5e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:32.802715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32c8c060-7172-47cb-ada4-2abeaefb6b5e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:32.803174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32c8c060-7172-47cb-ada4-2abeaefb6b5e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:32.803892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32c8c060-7172-47cb-ada4-2abeaefb6b5e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:32.804357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32c8c060-7172-47cb-ada4-2abeaefb6b5e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:32.804908 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32c8c060-7172-47cb-ada4-2abeaefb6b5e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:32.940424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-32c8c060-7172-47cb-ada4-2abeaefb6b5e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:32.949023 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-32c8c060-7172-47cb-ada4-2abeaefb6b5e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1684 microversion: 2.1 time: 0.159115 Oct 29 03:46:32.949948 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3289/6800] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:32 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:33.976992 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-497880bd-1cd2-429b-9186-3aa0b61a4145 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:33.977846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-497880bd-1cd2-429b-9186-3aa0b61a4145 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:33.985163 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-497880bd-1cd2-429b-9186-3aa0b61a4145 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:33.985681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-497880bd-1cd2-429b-9186-3aa0b61a4145 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:33.986146 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-497880bd-1cd2-429b-9186-3aa0b61a4145 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:33.986884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-497880bd-1cd2-429b-9186-3aa0b61a4145 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:33.987368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-497880bd-1cd2-429b-9186-3aa0b61a4145 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:33.987824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-497880bd-1cd2-429b-9186-3aa0b61a4145 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:34.124083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-497880bd-1cd2-429b-9186-3aa0b61a4145 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:34.132898 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-497880bd-1cd2-429b-9186-3aa0b61a4145 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1684 microversion: 2.1 time: 0.163071 Oct 29 03:46:34.133522 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3512/6801] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:33 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:35.157217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4677b3b1-0704-4dbc-ba19-2e2323ad90bd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:35.157977 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4677b3b1-0704-4dbc-ba19-2e2323ad90bd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:35.165328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4677b3b1-0704-4dbc-ba19-2e2323ad90bd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:35.165828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4677b3b1-0704-4dbc-ba19-2e2323ad90bd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:35.166275 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4677b3b1-0704-4dbc-ba19-2e2323ad90bd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:35.166996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4677b3b1-0704-4dbc-ba19-2e2323ad90bd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:35.167454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4677b3b1-0704-4dbc-ba19-2e2323ad90bd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:35.168040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4677b3b1-0704-4dbc-ba19-2e2323ad90bd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:35.301028 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4677b3b1-0704-4dbc-ba19-2e2323ad90bd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:35.308953 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4677b3b1-0704-4dbc-ba19-2e2323ad90bd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1683 microversion: 2.1 time: 0.156055 Oct 29 03:46:35.309695 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3290/6802] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:35 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:35.350724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-9c41634b-9131-4b54-a3f6-d507db53b18b req-f4a3a628-726d-42c5-819c-fd9754008d8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79cc9059-3092-4668-89c8-d719e8251192", "name": "network-vif-unplugged", "status": "completed", "tag": "f12be743-578d-4346-ba16-b284a7226ef8"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:46:35.361392 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9c41634b-9131-4b54-a3f6-d507db53b18b req-f4a3a628-726d-42c5-819c-fd9754008d8d service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:35.361881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9c41634b-9131-4b54-a3f6-d507db53b18b req-f4a3a628-726d-42c5-819c-fd9754008d8d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:35.362314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9c41634b-9131-4b54-a3f6-d507db53b18b req-f4a3a628-726d-42c5-819c-fd9754008d8d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:35.376061 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-9c41634b-9131-4b54-a3f6-d507db53b18b req-f4a3a628-726d-42c5-819c-fd9754008d8d service nova] Creating event network-vif-unplugged:f12be743-578d-4346-ba16-b284a7226ef8 for instance 79cc9059-3092-4668-89c8-d719e8251192 on n-h2-862967-2 Oct 29 03:46:35.381722 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [req-9c41634b-9131-4b54-a3f6-d507db53b18b req-f4a3a628-726d-42c5-819c-fd9754008d8d service nova] Instance 79cc9059-3092-4668-89c8-d719e8251192 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:46:35.393368 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-9c41634b-9131-4b54-a3f6-d507db53b18b req-f4a3a628-726d-42c5-819c-fd9754008d8d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046560 Oct 29 03:46:35.394146 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3513/6803] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:46:36.333754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e0b83699-9667-41d8-9a7a-0f2e7a9a5f23 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:36.334362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e0b83699-9667-41d8-9a7a-0f2e7a9a5f23 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:36.341923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0b83699-9667-41d8-9a7a-0f2e7a9a5f23 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:36.342432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0b83699-9667-41d8-9a7a-0f2e7a9a5f23 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:36.342882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0b83699-9667-41d8-9a7a-0f2e7a9a5f23 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:36.343578 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0b83699-9667-41d8-9a7a-0f2e7a9a5f23 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:36.344266 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0b83699-9667-41d8-9a7a-0f2e7a9a5f23 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:36.344740 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0b83699-9667-41d8-9a7a-0f2e7a9a5f23 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:36.486015 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e0b83699-9667-41d8-9a7a-0f2e7a9a5f23 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:36.494618 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e0b83699-9667-41d8-9a7a-0f2e7a9a5f23 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1683 microversion: 2.1 time: 0.165128 Oct 29 03:46:36.495208 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3291/6804] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:36 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:37.426450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-4308a4c2-5c8d-496d-8678-26a4af52767a req-facc5988-f917-4cc4-b9e0-5ce550fe05bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79cc9059-3092-4668-89c8-d719e8251192", "tag": "f12be743-578d-4346-ba16-b284a7226ef8"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:46:37.438750 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4308a4c2-5c8d-496d-8678-26a4af52767a req-facc5988-f917-4cc4-b9e0-5ce550fe05bd service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:37.439338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4308a4c2-5c8d-496d-8678-26a4af52767a req-facc5988-f917-4cc4-b9e0-5ce550fe05bd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:37.439874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4308a4c2-5c8d-496d-8678-26a4af52767a req-facc5988-f917-4cc4-b9e0-5ce550fe05bd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:37.453358 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-4308a4c2-5c8d-496d-8678-26a4af52767a req-facc5988-f917-4cc4-b9e0-5ce550fe05bd service nova] Creating event network-changed:f12be743-578d-4346-ba16-b284a7226ef8 for instance 79cc9059-3092-4668-89c8-d719e8251192 on n-h2-862967-2 Oct 29 03:46:37.458865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [req-4308a4c2-5c8d-496d-8678-26a4af52767a req-facc5988-f917-4cc4-b9e0-5ce550fe05bd service nova] Instance 79cc9059-3092-4668-89c8-d719e8251192 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:46:37.469672 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-4308a4c2-5c8d-496d-8678-26a4af52767a req-facc5988-f917-4cc4-b9e0-5ce550fe05bd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049574 Oct 29 03:46:37.470269 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3514/6805] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:46:37.520069 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c14ff0ed-561f-498f-9227-b3644234e98b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:37.521387 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c14ff0ed-561f-498f-9227-b3644234e98b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:37.529400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c14ff0ed-561f-498f-9227-b3644234e98b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:37.530019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c14ff0ed-561f-498f-9227-b3644234e98b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:37.530569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c14ff0ed-561f-498f-9227-b3644234e98b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:37.531539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c14ff0ed-561f-498f-9227-b3644234e98b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:37.532074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c14ff0ed-561f-498f-9227-b3644234e98b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:37.532587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c14ff0ed-561f-498f-9227-b3644234e98b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:37.792128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c14ff0ed-561f-498f-9227-b3644234e98b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:37.802034 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c14ff0ed-561f-498f-9227-b3644234e98b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1681 microversion: 2.1 time: 0.286404 Oct 29 03:46:37.802901 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3292/6806] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:37 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1681 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:38.833960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0263ecae-4994-414e-b482-34b549e040a0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:38.835118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0263ecae-4994-414e-b482-34b549e040a0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:38.842606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0263ecae-4994-414e-b482-34b549e040a0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:38.843094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0263ecae-4994-414e-b482-34b549e040a0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:38.843557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0263ecae-4994-414e-b482-34b549e040a0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:38.844234 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0263ecae-4994-414e-b482-34b549e040a0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:38.844728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0263ecae-4994-414e-b482-34b549e040a0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:38.845158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0263ecae-4994-414e-b482-34b549e040a0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:38.982974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0263ecae-4994-414e-b482-34b549e040a0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:38.991483 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0263ecae-4994-414e-b482-34b549e040a0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1677 microversion: 2.1 time: 0.166282 Oct 29 03:46:38.992102 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3515/6807] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:38 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:39.014899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f740cf5c-e6e0-47ca-9990-32d174475755 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:46:39.015418 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f740cf5c-e6e0-47ca-9990-32d174475755 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:39.022756 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f740cf5c-e6e0-47ca-9990-32d174475755 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:39.023264 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f740cf5c-e6e0-47ca-9990-32d174475755 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:39.023748 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f740cf5c-e6e0-47ca-9990-32d174475755 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:39.024471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f740cf5c-e6e0-47ca-9990-32d174475755 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:39.024979 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f740cf5c-e6e0-47ca-9990-32d174475755 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:39.025427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f740cf5c-e6e0-47ca-9990-32d174475755 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:39.092564 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f740cf5c-e6e0-47ca-9990-32d174475755 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "POST /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192/action" status: 204 len: 0 microversion: 2.1 time: 0.081427 Oct 29 03:46:39.093200 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3293/6808] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:46:39 2022] POST /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192/action => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:46:39.104382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-db8180fa-29c3-473f-bebc-71f0be5d2086 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:39.105037 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-db8180fa-29c3-473f-bebc-71f0be5d2086 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:39.111207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db8180fa-29c3-473f-bebc-71f0be5d2086 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:39.111701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db8180fa-29c3-473f-bebc-71f0be5d2086 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:39.112150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db8180fa-29c3-473f-bebc-71f0be5d2086 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:39.112879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db8180fa-29c3-473f-bebc-71f0be5d2086 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:39.113351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db8180fa-29c3-473f-bebc-71f0be5d2086 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:39.113770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-db8180fa-29c3-473f-bebc-71f0be5d2086 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:39.252214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-db8180fa-29c3-473f-bebc-71f0be5d2086 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:39.260606 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-db8180fa-29c3-473f-bebc-71f0be5d2086 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1677 microversion: 2.1 time: 0.161385 Oct 29 03:46:39.261204 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3516/6809] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:39 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:40.010098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-e02c12c8-5df8-4466-9e1c-cc545653631b req-3a400d20-2dc3-4ebf-a1a3-c84e2f2ea7c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79cc9059-3092-4668-89c8-d719e8251192", "name": "network-vif-plugged", "status": "completed", "tag": "f12be743-578d-4346-ba16-b284a7226ef8"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:46:40.023865 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e02c12c8-5df8-4466-9e1c-cc545653631b req-3a400d20-2dc3-4ebf-a1a3-c84e2f2ea7c9 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:40.025430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e02c12c8-5df8-4466-9e1c-cc545653631b req-3a400d20-2dc3-4ebf-a1a3-c84e2f2ea7c9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:40.026654 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e02c12c8-5df8-4466-9e1c-cc545653631b req-3a400d20-2dc3-4ebf-a1a3-c84e2f2ea7c9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:40.040354 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-e02c12c8-5df8-4466-9e1c-cc545653631b req-3a400d20-2dc3-4ebf-a1a3-c84e2f2ea7c9 service nova] Creating event network-vif-plugged:f12be743-578d-4346-ba16-b284a7226ef8 for instance 79cc9059-3092-4668-89c8-d719e8251192 on n-h2-862967-2 Oct 29 03:46:40.043205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:46:40.048650 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [req-e02c12c8-5df8-4466-9e1c-cc545653631b req-3a400d20-2dc3-4ebf-a1a3-c84e2f2ea7c9 service nova] Instance 79cc9059-3092-4668-89c8-d719e8251192 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:46:40.062031 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-e02c12c8-5df8-4466-9e1c-cc545653631b req-3a400d20-2dc3-4ebf-a1a3-c84e2f2ea7c9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055848 Oct 29 03:46:40.063335 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3294/6810] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:46:40.287684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e9c799fa-6018-4295-ac35-d2cb9163a69d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:40.288575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e9c799fa-6018-4295-ac35-d2cb9163a69d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:40.299066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9c799fa-6018-4295-ac35-d2cb9163a69d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:40.299815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9c799fa-6018-4295-ac35-d2cb9163a69d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:40.300481 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9c799fa-6018-4295-ac35-d2cb9163a69d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:40.301583 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9c799fa-6018-4295-ac35-d2cb9163a69d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:40.302271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9c799fa-6018-4295-ac35-d2cb9163a69d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:40.302923 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9c799fa-6018-4295-ac35-d2cb9163a69d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:40.457093 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e9c799fa-6018-4295-ac35-d2cb9163a69d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:40.465274 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e9c799fa-6018-4295-ac35-d2cb9163a69d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1677 microversion: 2.1 time: 0.183605 Oct 29 03:46:40.465930 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3517/6811] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:40 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1677 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:41.490239 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dd001f68-9140-4730-9d36-fa75fb39c16e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:41.490955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dd001f68-9140-4730-9d36-fa75fb39c16e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:41.498101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd001f68-9140-4730-9d36-fa75fb39c16e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:41.498609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd001f68-9140-4730-9d36-fa75fb39c16e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:41.499033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd001f68-9140-4730-9d36-fa75fb39c16e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:41.499748 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd001f68-9140-4730-9d36-fa75fb39c16e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:41.500215 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd001f68-9140-4730-9d36-fa75fb39c16e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:41.500688 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd001f68-9140-4730-9d36-fa75fb39c16e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:41.645599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dd001f68-9140-4730-9d36-fa75fb39c16e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:41.654945 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dd001f68-9140-4730-9d36-fa75fb39c16e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1656 microversion: 2.1 time: 0.170150 Oct 29 03:46:41.655509 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3295/6812] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:41 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1656 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:41.679854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-04a7c845-0ebc-44a3-98a5-b6cade966ad3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:41.680887 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-04a7c845-0ebc-44a3-98a5-b6cade966ad3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:41.688181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-04a7c845-0ebc-44a3-98a5-b6cade966ad3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:41.688936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-04a7c845-0ebc-44a3-98a5-b6cade966ad3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:41.689385 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-04a7c845-0ebc-44a3-98a5-b6cade966ad3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:41.690090 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-04a7c845-0ebc-44a3-98a5-b6cade966ad3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:41.690553 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-04a7c845-0ebc-44a3-98a5-b6cade966ad3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:41.691095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-04a7c845-0ebc-44a3-98a5-b6cade966ad3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:41.843446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-04a7c845-0ebc-44a3-98a5-b6cade966ad3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:41.848638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:46:41.855675 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-04a7c845-0ebc-44a3-98a5-b6cade966ad3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1656 microversion: 2.1 time: 0.181680 Oct 29 03:46:41.856408 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3518/6813] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:41 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1656 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:41.879467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6ad838ab-07a9-4ac0-8cf9-cff42b2820b1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:46:41.886467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ad838ab-07a9-4ac0-8cf9-cff42b2820b1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:41.887217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ad838ab-07a9-4ac0-8cf9-cff42b2820b1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:41.887663 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ad838ab-07a9-4ac0-8cf9-cff42b2820b1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:41.910239 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6ad838ab-07a9-4ac0-8cf9-cff42b2820b1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Going to try to start instance {{(pid=127125) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 29 03:46:41.958627 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6ad838ab-07a9-4ac0-8cf9-cff42b2820b1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "POST /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192/action" status: 202 len: 0 microversion: 2.1 time: 0.083355 Oct 29 03:46:41.959238 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3296/6814] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:46:41 2022] POST /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:46:41.968330 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bbf7cd35-530d-4ddd-b1d5-f20d7a55693c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:41.969022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bbf7cd35-530d-4ddd-b1d5-f20d7a55693c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:41.975685 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbf7cd35-530d-4ddd-b1d5-f20d7a55693c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:41.976149 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbf7cd35-530d-4ddd-b1d5-f20d7a55693c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:41.976633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbf7cd35-530d-4ddd-b1d5-f20d7a55693c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:41.977489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbf7cd35-530d-4ddd-b1d5-f20d7a55693c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:41.977956 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbf7cd35-530d-4ddd-b1d5-f20d7a55693c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:41.978385 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bbf7cd35-530d-4ddd-b1d5-f20d7a55693c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:42.186013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bbf7cd35-530d-4ddd-b1d5-f20d7a55693c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:42.195555 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bbf7cd35-530d-4ddd-b1d5-f20d7a55693c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1665 microversion: 2.1 time: 0.231429 Oct 29 03:46:42.196397 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3519/6815] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:41 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1665 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:43.221037 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-233371a5-fe86-412a-8ca3-856b5fd6c1f5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:43.221640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-233371a5-fe86-412a-8ca3-856b5fd6c1f5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:43.228658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-233371a5-fe86-412a-8ca3-856b5fd6c1f5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:43.229164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-233371a5-fe86-412a-8ca3-856b5fd6c1f5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:43.229612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-233371a5-fe86-412a-8ca3-856b5fd6c1f5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:43.230326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-233371a5-fe86-412a-8ca3-856b5fd6c1f5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:43.230797 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-233371a5-fe86-412a-8ca3-856b5fd6c1f5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:43.231240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-233371a5-fe86-412a-8ca3-856b5fd6c1f5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:43.373418 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-233371a5-fe86-412a-8ca3-856b5fd6c1f5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:43.384999 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-233371a5-fe86-412a-8ca3-856b5fd6c1f5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1669 microversion: 2.1 time: 0.169324 Oct 29 03:46:43.385584 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3297/6816] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:43 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1669 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:43.408439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d9d6a2ed-1bcc-44e2-be71-a54f3c491055 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:43.409013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d9d6a2ed-1bcc-44e2-be71-a54f3c491055 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:43.416765 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d9d6a2ed-1bcc-44e2-be71-a54f3c491055 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:43.417258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d9d6a2ed-1bcc-44e2-be71-a54f3c491055 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:43.417699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d9d6a2ed-1bcc-44e2-be71-a54f3c491055 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:43.418404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d9d6a2ed-1bcc-44e2-be71-a54f3c491055 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:43.418925 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d9d6a2ed-1bcc-44e2-be71-a54f3c491055 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:43.419360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d9d6a2ed-1bcc-44e2-be71-a54f3c491055 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:43.445639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d9d6a2ed-1bcc-44e2-be71-a54f3c491055 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:46:43.527843 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d9d6a2ed-1bcc-44e2-be71-a54f3c491055 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "DELETE /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 204 len: 0 microversion: 2.1 time: 0.123232 Oct 29 03:46:43.528772 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3520/6817] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:46:43 2022] DELETE /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:46:43.537436 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-08ceeb68-83d8-4067-a3fc-9425db26a605 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:43.538121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-08ceeb68-83d8-4067-a3fc-9425db26a605 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:43.544450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08ceeb68-83d8-4067-a3fc-9425db26a605 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:43.544985 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08ceeb68-83d8-4067-a3fc-9425db26a605 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:43.545434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08ceeb68-83d8-4067-a3fc-9425db26a605 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:43.546175 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08ceeb68-83d8-4067-a3fc-9425db26a605 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:43.546641 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08ceeb68-83d8-4067-a3fc-9425db26a605 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:43.547082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08ceeb68-83d8-4067-a3fc-9425db26a605 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:43.682808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-08ceeb68-83d8-4067-a3fc-9425db26a605 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:43.691059 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-08ceeb68-83d8-4067-a3fc-9425db26a605 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1675 microversion: 2.1 time: 0.157813 Oct 29 03:46:43.691655 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3298/6818] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:43 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:46:44.716976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fde13774-dfc2-4a4c-a1bc-53571201fbee tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:44.717681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fde13774-dfc2-4a4c-a1bc-53571201fbee tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:44.720477 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:46:44.727224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fde13774-dfc2-4a4c-a1bc-53571201fbee tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:44.727717 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fde13774-dfc2-4a4c-a1bc-53571201fbee tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:44.728160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fde13774-dfc2-4a4c-a1bc-53571201fbee tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:44.728909 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fde13774-dfc2-4a4c-a1bc-53571201fbee tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:44.729366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fde13774-dfc2-4a4c-a1bc-53571201fbee tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:44.729793 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fde13774-dfc2-4a4c-a1bc-53571201fbee tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:44.933242 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fde13774-dfc2-4a4c-a1bc-53571201fbee tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:44.941648 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fde13774-dfc2-4a4c-a1bc-53571201fbee tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1675 microversion: 2.1 time: 0.229186 Oct 29 03:46:44.942400 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3521/6819] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:44 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1675 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:45.965145 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d6a49074-11dc-4ceb-bc6f-65d7e5d7fb56 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:45.965825 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d6a49074-11dc-4ceb-bc6f-65d7e5d7fb56 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:45.968892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=39 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:46:45.975442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6a49074-11dc-4ceb-bc6f-65d7e5d7fb56 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:45.976046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6a49074-11dc-4ceb-bc6f-65d7e5d7fb56 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:45.976698 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6a49074-11dc-4ceb-bc6f-65d7e5d7fb56 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:45.977625 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6a49074-11dc-4ceb-bc6f-65d7e5d7fb56 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:45.978150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6a49074-11dc-4ceb-bc6f-65d7e5d7fb56 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:45.978622 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d6a49074-11dc-4ceb-bc6f-65d7e5d7fb56 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:45.994644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-ca358387-23b1-4fb7-b68c-3f13b154d648 req-46c60131-f4c5-4ffc-b552-170ce65de6a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79cc9059-3092-4668-89c8-d719e8251192", "name": "network-vif-deleted", "tag": "f12be743-578d-4346-ba16-b284a7226ef8"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:46:46.012222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ca358387-23b1-4fb7-b68c-3f13b154d648 req-46c60131-f4c5-4ffc-b552-170ce65de6a9 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:46.013174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ca358387-23b1-4fb7-b68c-3f13b154d648 req-46c60131-f4c5-4ffc-b552-170ce65de6a9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:46.013831 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ca358387-23b1-4fb7-b68c-3f13b154d648 req-46c60131-f4c5-4ffc-b552-170ce65de6a9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:46.032744 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-ca358387-23b1-4fb7-b68c-3f13b154d648 req-46c60131-f4c5-4ffc-b552-170ce65de6a9 service nova] Creating event network-vif-deleted:f12be743-578d-4346-ba16-b284a7226ef8 for instance 79cc9059-3092-4668-89c8-d719e8251192 on n-h2-862967-2 Oct 29 03:46:46.038582 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-ca358387-23b1-4fb7-b68c-3f13b154d648 req-46c60131-f4c5-4ffc-b552-170ce65de6a9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048403 Oct 29 03:46:46.040104 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3522/6820] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:46:46.052318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d6a49074-11dc-4ceb-bc6f-65d7e5d7fb56 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:46.062090 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d6a49074-11dc-4ceb-bc6f-65d7e5d7fb56 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 200 len: 1609 microversion: 2.1 time: 0.101076 Oct 29 03:46:46.062973 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3299/6821] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:45 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 1609 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:47.089838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9dbfb400-de55-4d60-abff-4b057ca0f6e4 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:47.090537 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9dbfb400-de55-4d60-abff-4b057ca0f6e4 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:47.098101 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9dbfb400-de55-4d60-abff-4b057ca0f6e4 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:47.098578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9dbfb400-de55-4d60-abff-4b057ca0f6e4 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:47.099011 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9dbfb400-de55-4d60-abff-4b057ca0f6e4 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:47.099712 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9dbfb400-de55-4d60-abff-4b057ca0f6e4 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:47.100165 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9dbfb400-de55-4d60-abff-4b057ca0f6e4 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:47.100627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9dbfb400-de55-4d60-abff-4b057ca0f6e4 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:47.114779 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-9dbfb400-de55-4d60-abff-4b057ca0f6e4 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] HTTP exception thrown: Instance 79cc9059-3092-4668-89c8-d719e8251192 could not be found. Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9dbfb400-de55-4d60-abff-4b057ca0f6e4 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Request method failure captured: Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 HTTP/1.1 Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXKGQJeWMxfWMeM3O6gGoGSgLaotgRmZdXAA5ksXNn18BC3kYiORlqcPrpkO6hwWROtId_i3BPG3tHcLNXgo1DRLTViLVFJkr5ippTm7TWTVVrTinupx_GraljlTHrjKYi9B__lcWVv-kBGfZZl6RvbkghUGxnbsTm6q2TyI0UqnddMU Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2e19c07467824bbfbc0715c6085c40e6"}]}] Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServerActionsTestJSON-539616512 Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: fd4c00a472474521add76167023ab141 Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 79cc9059-3092-4668-89c8-d719e8251192 could not be found. Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '79cc9059-3092-4668-89c8-d719e8251192'} Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79cc9059-3092-4668-89c8-d719e8251192 could not be found. Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79cc9059-3092-4668-89c8-d719e8251192 could not be found. Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:46:47.116417 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:46:47.121372 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:46:47.121372 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:46:47.121372 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:46:47.121372 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:46:47.121372 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:46:47.121372 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79cc9059-3092-4668-89c8-d719e8251192 could not be found. Oct 29 03:46:47.121372 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:46:47.121372 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9dbfb400-de55-4d60-abff-4b057ca0f6e4 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Returning 404 to user: Instance 79cc9059-3092-4668-89c8-d719e8251192 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:46:47.121372 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9dbfb400-de55-4d60-abff-4b057ca0f6e4 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 404 len: 111 microversion: 2.1 time: 0.033271 Oct 29 03:46:47.121372 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3523/6822] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:47 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:46:47.133095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b380f27d-2ee1-4db4-a87b-f75f1d7072fa tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:47.133833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b380f27d-2ee1-4db4-a87b-f75f1d7072fa tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:47.142557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b380f27d-2ee1-4db4-a87b-f75f1d7072fa tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:47.143067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b380f27d-2ee1-4db4-a87b-f75f1d7072fa tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:47.143525 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b380f27d-2ee1-4db4-a87b-f75f1d7072fa tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:47.144250 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b380f27d-2ee1-4db4-a87b-f75f1d7072fa tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:47.144768 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b380f27d-2ee1-4db4-a87b-f75f1d7072fa tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:47.145212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b380f27d-2ee1-4db4-a87b-f75f1d7072fa tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:47.162440 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-b380f27d-2ee1-4db4-a87b-f75f1d7072fa tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] HTTP exception thrown: Instance 79cc9059-3092-4668-89c8-d719e8251192 could not be found. Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b380f27d-2ee1-4db4-a87b-f75f1d7072fa tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Request method failure captured: Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 HTTP/1.1 Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKGQJeWMxfWMeM3O6gGoGSgLaotgRmZdXAA5ksXNn18BC3kYiORlqcPrpkO6hwWROtId_i3BPG3tHcLNXgo1DRLTViLVFJkr5ippTm7TWTVVrTinupx_GraljlTHrjKYi9B__lcWVv-kBGfZZl6RvbkghUGxnbsTm6q2TyI0UqnddMU Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2e19c07467824bbfbc0715c6085c40e6"}]}] Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerActionsTestJSON-539616512 Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: fd4c00a472474521add76167023ab141 Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 79cc9059-3092-4668-89c8-d719e8251192 could not be found. Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '79cc9059-3092-4668-89c8-d719e8251192'} Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79cc9059-3092-4668-89c8-d719e8251192 could not be found. Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79cc9059-3092-4668-89c8-d719e8251192 could not be found. Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:46:47.164145 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:46:47.168621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:46:47.168621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:46:47.168621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:46:47.168621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:46:47.168621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:46:47.168621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79cc9059-3092-4668-89c8-d719e8251192 could not be found. Oct 29 03:46:47.168621 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:46:47.168621 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b380f27d-2ee1-4db4-a87b-f75f1d7072fa tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Returning 404 to user: Instance 79cc9059-3092-4668-89c8-d719e8251192 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:46:47.168621 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b380f27d-2ee1-4db4-a87b-f75f1d7072fa tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 404 len: 111 microversion: 2.1 time: 0.036570 Oct 29 03:46:47.172740 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3300/6823] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:47 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:46:47.217861 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1b82dc53-7eb6-423e-beb2-7f1dee10764e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1704420237", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "16b776c7-5074-4f3f-a183-66ccafda21d7"}], "security_groups": [{"name": "tempest-securitygroup--98886569"}], "key_name": "tempest-keypair-685611708", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:46:47.328105 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-1b82dc53-7eb6-423e-beb2-7f1dee10764e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] validate_networks() for [('16b776c7-5074-4f3f-a183-66ccafda21d7', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:46:47.860555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-1b82dc53-7eb6-423e-beb2-7f1dee10764e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:46:47.860991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-1b82dc53-7eb6-423e-beb2-7f1dee10764e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:46:47.861455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-1b82dc53-7eb6-423e-beb2-7f1dee10764e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:46:47.861828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-1b82dc53-7eb6-423e-beb2-7f1dee10764e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:46:47.863171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-1b82dc53-7eb6-423e-beb2-7f1dee10764e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:46:47.873572 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b82dc53-7eb6-423e-beb2-7f1dee10764e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:47.874066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b82dc53-7eb6-423e-beb2-7f1dee10764e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:47.874509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b82dc53-7eb6-423e-beb2-7f1dee10764e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:47.875244 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b82dc53-7eb6-423e-beb2-7f1dee10764e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:47.875838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b82dc53-7eb6-423e-beb2-7f1dee10764e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:47.876275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1b82dc53-7eb6-423e-beb2-7f1dee10764e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:47.896462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-1b82dc53-7eb6-423e-beb2-7f1dee10764e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Getting quotas for project 2e19c07467824bbfbc0715c6085c40e6. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:46:47.902426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-1b82dc53-7eb6-423e-beb2-7f1dee10764e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Getting quotas for user fd4c00a472474521add76167023ab141 and project 2e19c07467824bbfbc0715c6085c40e6. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:46:47.915307 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1b82dc53-7eb6-423e-beb2-7f1dee10764e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:46:47.917701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1b82dc53-7eb6-423e-beb2-7f1dee10764e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:46:47.971417 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1b82dc53-7eb6-423e-beb2-7f1dee10764e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.756911 Oct 29 03:46:47.972486 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3524/6824] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:46:47 2022] POST /compute/v2.1/servers => generated 404 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:46:47.986238 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-15bc1f81-5194-4416-9311-85ed80012088 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:47.986885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-15bc1f81-5194-4416-9311-85ed80012088 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:48.048101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-15bc1f81-5194-4416-9311-85ed80012088 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:48.055584 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-15bc1f81-5194-4416-9311-85ed80012088 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1238 microversion: 2.1 time: 0.073404 Oct 29 03:46:48.056244 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3301/6825] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:47 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1238 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:49.081726 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cd5e983f-8333-410f-b892-a74a5da43f83 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:49.082704 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cd5e983f-8333-410f-b892-a74a5da43f83 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:49.093137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd5e983f-8333-410f-b892-a74a5da43f83 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:49.093732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd5e983f-8333-410f-b892-a74a5da43f83 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:49.094182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd5e983f-8333-410f-b892-a74a5da43f83 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:49.094901 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd5e983f-8333-410f-b892-a74a5da43f83 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:49.095362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd5e983f-8333-410f-b892-a74a5da43f83 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:49.095796 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cd5e983f-8333-410f-b892-a74a5da43f83 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:49.163493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cd5e983f-8333-410f-b892-a74a5da43f83 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:49.172438 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cd5e983f-8333-410f-b892-a74a5da43f83 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1290 microversion: 2.1 time: 0.095913 Oct 29 03:46:49.173109 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3525/6826] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:49 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1290 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:50.196647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ecd4a7ef-a774-4455-aa2a-07f327d3d850 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:50.197280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ecd4a7ef-a774-4455-aa2a-07f327d3d850 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:50.203297 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecd4a7ef-a774-4455-aa2a-07f327d3d850 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:50.203783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecd4a7ef-a774-4455-aa2a-07f327d3d850 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:50.204230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecd4a7ef-a774-4455-aa2a-07f327d3d850 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:50.204966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecd4a7ef-a774-4455-aa2a-07f327d3d850 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:50.205426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecd4a7ef-a774-4455-aa2a-07f327d3d850 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:50.205868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ecd4a7ef-a774-4455-aa2a-07f327d3d850 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:50.402403 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ecd4a7ef-a774-4455-aa2a-07f327d3d850 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:50.412100 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ecd4a7ef-a774-4455-aa2a-07f327d3d850 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1362 microversion: 2.1 time: 0.219642 Oct 29 03:46:50.413894 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3302/6827] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:50 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:50.733142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-1b5b4c7f-58eb-41a4-bd01-29905f050ec9 req-6dfb6985-42c2-4c74-9689-78d351b37bea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b035159d-9129-455b-98b5-ff1d2c90a6ec", "tag": "1e64b63b-ccb8-4000-9d39-fcb06149a0ea"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:46:50.744837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1b5b4c7f-58eb-41a4-bd01-29905f050ec9 req-6dfb6985-42c2-4c74-9689-78d351b37bea service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:50.745951 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1b5b4c7f-58eb-41a4-bd01-29905f050ec9 req-6dfb6985-42c2-4c74-9689-78d351b37bea service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:50.745951 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1b5b4c7f-58eb-41a4-bd01-29905f050ec9 req-6dfb6985-42c2-4c74-9689-78d351b37bea service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:50.759559 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-1b5b4c7f-58eb-41a4-bd01-29905f050ec9 req-6dfb6985-42c2-4c74-9689-78d351b37bea service nova] Creating event network-changed:1e64b63b-ccb8-4000-9d39-fcb06149a0ea for instance b035159d-9129-455b-98b5-ff1d2c90a6ec on n-h1-862967-2 Oct 29 03:46:50.765066 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-1b5b4c7f-58eb-41a4-bd01-29905f050ec9 req-6dfb6985-42c2-4c74-9689-78d351b37bea service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035916 Oct 29 03:46:50.765791 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3526/6828] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:46:51.436827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bf0dc230-581c-42e9-b64c-da6232f7ef3a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:51.437468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bf0dc230-581c-42e9-b64c-da6232f7ef3a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:51.445324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf0dc230-581c-42e9-b64c-da6232f7ef3a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:51.445761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf0dc230-581c-42e9-b64c-da6232f7ef3a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:51.446187 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf0dc230-581c-42e9-b64c-da6232f7ef3a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:51.446944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf0dc230-581c-42e9-b64c-da6232f7ef3a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:51.447420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf0dc230-581c-42e9-b64c-da6232f7ef3a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:51.447890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bf0dc230-581c-42e9-b64c-da6232f7ef3a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:51.947348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bf0dc230-581c-42e9-b64c-da6232f7ef3a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:51.955696 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bf0dc230-581c-42e9-b64c-da6232f7ef3a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1362 microversion: 2.1 time: 0.522993 Oct 29 03:46:51.956248 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3303/6829] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:51 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1362 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:52.981178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2c67283f-8f45-4fc8-905c-f143533e4362 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:52.981877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2c67283f-8f45-4fc8-905c-f143533e4362 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:52.989578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c67283f-8f45-4fc8-905c-f143533e4362 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:52.990073 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c67283f-8f45-4fc8-905c-f143533e4362 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:52.990516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c67283f-8f45-4fc8-905c-f143533e4362 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:52.991291 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c67283f-8f45-4fc8-905c-f143533e4362 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:52.991790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c67283f-8f45-4fc8-905c-f143533e4362 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:52.992217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c67283f-8f45-4fc8-905c-f143533e4362 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:53.125175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2c67283f-8f45-4fc8-905c-f143533e4362 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:53.133289 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2c67283f-8f45-4fc8-905c-f143533e4362 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1362 microversion: 2.1 time: 0.156520 Oct 29 03:46:53.133869 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3527/6830] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:52 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:54.157492 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-10f5ab21-0bbf-43f5-aff2-f41c31674e4e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:54.158123 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-10f5ab21-0bbf-43f5-aff2-f41c31674e4e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:54.165151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-10f5ab21-0bbf-43f5-aff2-f41c31674e4e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:54.165636 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-10f5ab21-0bbf-43f5-aff2-f41c31674e4e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:54.166084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-10f5ab21-0bbf-43f5-aff2-f41c31674e4e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:54.166772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-10f5ab21-0bbf-43f5-aff2-f41c31674e4e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:54.167256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-10f5ab21-0bbf-43f5-aff2-f41c31674e4e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:54.167713 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-10f5ab21-0bbf-43f5-aff2-f41c31674e4e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:54.303063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-10f5ab21-0bbf-43f5-aff2-f41c31674e4e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:54.311741 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-10f5ab21-0bbf-43f5-aff2-f41c31674e4e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1362 microversion: 2.1 time: 0.158064 Oct 29 03:46:54.312351 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3304/6831] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:54 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:55.335934 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2719cdbd-88f7-4337-91bb-3994d7c8b6ab tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:55.336485 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2719cdbd-88f7-4337-91bb-3994d7c8b6ab tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:55.343433 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2719cdbd-88f7-4337-91bb-3994d7c8b6ab tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:55.343925 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2719cdbd-88f7-4337-91bb-3994d7c8b6ab tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:55.344365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2719cdbd-88f7-4337-91bb-3994d7c8b6ab tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:55.345107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2719cdbd-88f7-4337-91bb-3994d7c8b6ab tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:55.345594 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2719cdbd-88f7-4337-91bb-3994d7c8b6ab tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:55.346023 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2719cdbd-88f7-4337-91bb-3994d7c8b6ab tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:55.483012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2719cdbd-88f7-4337-91bb-3994d7c8b6ab tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:55.491444 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2719cdbd-88f7-4337-91bb-3994d7c8b6ab tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1362 microversion: 2.1 time: 0.159776 Oct 29 03:46:55.492041 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3528/6832] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:55 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:56.347578 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-ad7ce76a-f1bd-4dd6-852d-b8a4bc7f22b2 req-5788573c-216e-488f-a02e-37d484fa1660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b035159d-9129-455b-98b5-ff1d2c90a6ec", "name": "network-vif-plugged", "status": "completed", "tag": "1e64b63b-ccb8-4000-9d39-fcb06149a0ea"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:46:56.358696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ad7ce76a-f1bd-4dd6-852d-b8a4bc7f22b2 req-5788573c-216e-488f-a02e-37d484fa1660 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:56.359148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ad7ce76a-f1bd-4dd6-852d-b8a4bc7f22b2 req-5788573c-216e-488f-a02e-37d484fa1660 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:56.359622 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ad7ce76a-f1bd-4dd6-852d-b8a4bc7f22b2 req-5788573c-216e-488f-a02e-37d484fa1660 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:56.371458 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-ad7ce76a-f1bd-4dd6-852d-b8a4bc7f22b2 req-5788573c-216e-488f-a02e-37d484fa1660 service nova] Creating event network-vif-plugged:1e64b63b-ccb8-4000-9d39-fcb06149a0ea for instance b035159d-9129-455b-98b5-ff1d2c90a6ec on n-h1-862967-2 Oct 29 03:46:56.376511 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-ad7ce76a-f1bd-4dd6-852d-b8a4bc7f22b2 req-5788573c-216e-488f-a02e-37d484fa1660 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032698 Oct 29 03:46:56.377146 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3305/6833] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:46:56.515434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6b93f5eb-933e-48ae-9f40-a2ef68fdbed1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:56.516047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6b93f5eb-933e-48ae-9f40-a2ef68fdbed1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:56.523684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b93f5eb-933e-48ae-9f40-a2ef68fdbed1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:56.524157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b93f5eb-933e-48ae-9f40-a2ef68fdbed1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:56.524655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b93f5eb-933e-48ae-9f40-a2ef68fdbed1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:56.525375 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b93f5eb-933e-48ae-9f40-a2ef68fdbed1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:56.525808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b93f5eb-933e-48ae-9f40-a2ef68fdbed1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:56.526230 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b93f5eb-933e-48ae-9f40-a2ef68fdbed1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:56.656296 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6b93f5eb-933e-48ae-9f40-a2ef68fdbed1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:56.664666 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6b93f5eb-933e-48ae-9f40-a2ef68fdbed1 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1362 microversion: 2.1 time: 0.153125 Oct 29 03:46:56.665219 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3529/6834] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:56 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:57.697158 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-148e699f-132c-4375-a519-8092f2f13186 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:57.697900 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-148e699f-132c-4375-a519-8092f2f13186 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:57.704326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-148e699f-132c-4375-a519-8092f2f13186 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:57.704850 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-148e699f-132c-4375-a519-8092f2f13186 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:57.705300 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-148e699f-132c-4375-a519-8092f2f13186 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:57.706006 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-148e699f-132c-4375-a519-8092f2f13186 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:57.706493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-148e699f-132c-4375-a519-8092f2f13186 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:57.706927 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-148e699f-132c-4375-a519-8092f2f13186 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:57.845109 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-148e699f-132c-4375-a519-8092f2f13186 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:57.856778 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-148e699f-132c-4375-a519-8092f2f13186 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1362 microversion: 2.1 time: 0.164971 Oct 29 03:46:57.857368 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3306/6835] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:57 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:58.881552 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-618d48ac-929f-41fb-a081-6112aa27c549 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:58.882169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-618d48ac-929f-41fb-a081-6112aa27c549 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:58.885131 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:46:58.885798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:46:58.891857 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-618d48ac-929f-41fb-a081-6112aa27c549 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:58.892347 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-618d48ac-929f-41fb-a081-6112aa27c549 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:58.892809 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-618d48ac-929f-41fb-a081-6112aa27c549 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:58.893502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-618d48ac-929f-41fb-a081-6112aa27c549 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:58.893966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-618d48ac-929f-41fb-a081-6112aa27c549 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:58.894429 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-618d48ac-929f-41fb-a081-6112aa27c549 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:59.031305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-618d48ac-929f-41fb-a081-6112aa27c549 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:46:59.043058 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-618d48ac-929f-41fb-a081-6112aa27c549 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1550 microversion: 2.1 time: 0.165275 Oct 29 03:46:59.043782 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3530/6836] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:46:58 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1550 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:46:59.066640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bd3dbc73-6d53-4545-83e3-323b52bc8e1b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:46:59.067151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bd3dbc73-6d53-4545-83e3-323b52bc8e1b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:46:59.069134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:46:59.076078 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd3dbc73-6d53-4545-83e3-323b52bc8e1b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:59.076661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd3dbc73-6d53-4545-83e3-323b52bc8e1b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:59.077127 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd3dbc73-6d53-4545-83e3-323b52bc8e1b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:59.077815 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd3dbc73-6d53-4545-83e3-323b52bc8e1b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:46:59.078302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd3dbc73-6d53-4545-83e3-323b52bc8e1b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:46:59.078747 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bd3dbc73-6d53-4545-83e3-323b52bc8e1b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:46:59.163123 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bd3dbc73-6d53-4545-83e3-323b52bc8e1b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100571 Oct 29 03:46:59.163741 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3307/6837] 10.222.0.46 () {58 vars in 1275 bytes} [Sat Oct 29 03:46:59 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:47:00.130130 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-be4dd849-ce52-4068-88d9-6a1e47b9ec32 req-ea8a218b-fd15-46a1-b3b9-504bd1cec4d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b035159d-9129-455b-98b5-ff1d2c90a6ec", "tag": "1e64b63b-ccb8-4000-9d39-fcb06149a0ea"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:47:00.142451 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-be4dd849-ce52-4068-88d9-6a1e47b9ec32 req-ea8a218b-fd15-46a1-b3b9-504bd1cec4d6 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:00.142970 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-be4dd849-ce52-4068-88d9-6a1e47b9ec32 req-ea8a218b-fd15-46a1-b3b9-504bd1cec4d6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:00.143397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-be4dd849-ce52-4068-88d9-6a1e47b9ec32 req-ea8a218b-fd15-46a1-b3b9-504bd1cec4d6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:00.154418 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-be4dd849-ce52-4068-88d9-6a1e47b9ec32 req-ea8a218b-fd15-46a1-b3b9-504bd1cec4d6 service nova] Creating event network-changed:1e64b63b-ccb8-4000-9d39-fcb06149a0ea for instance b035159d-9129-455b-98b5-ff1d2c90a6ec on n-h1-862967-2 Oct 29 03:47:00.159691 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-be4dd849-ce52-4068-88d9-6a1e47b9ec32 req-ea8a218b-fd15-46a1-b3b9-504bd1cec4d6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033600 Oct 29 03:47:00.160747 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3531/6838] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:47:40.930278 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:47:40.930933 n-d-862967-2 devstack@n-api.service[127125]: Sat Oct 29 03:47:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec/action (ip 10.222.0.46) !!! Oct 29 03:47:40.934310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=19 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:47:40.935146 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:47:40.941477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-34226110-0010-4e61-b2c1-e14392df0c5d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:47:40.943415 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-34226110-0010-4e61-b2c1-e14392df0c5d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:40.954982 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34226110-0010-4e61-b2c1-e14392df0c5d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:40.955479 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34226110-0010-4e61-b2c1-e14392df0c5d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:40.955970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34226110-0010-4e61-b2c1-e14392df0c5d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:40.956697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34226110-0010-4e61-b2c1-e14392df0c5d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:40.957169 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34226110-0010-4e61-b2c1-e14392df0c5d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:40.957600 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34226110-0010-4e61-b2c1-e14392df0c5d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:40.990711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-34226110-0010-4e61-b2c1-e14392df0c5d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:40.997288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-34226110-0010-4e61-b2c1-e14392df0c5d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Old instance type m1.heat2, new instance type m1.heat {{(pid=127125) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 03:47:41.004294 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-34226110-0010-4e61-b2c1-e14392df0c5d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:47:41.004781 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-34226110-0010-4e61-b2c1-e14392df0c5d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:47:41.005273 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-34226110-0010-4e61-b2c1-e14392df0c5d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:47:41.005686 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-34226110-0010-4e61-b2c1-e14392df0c5d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:47:41.006087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-34226110-0010-4e61-b2c1-e14392df0c5d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:47:41.081789 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-34226110-0010-4e61-b2c1-e14392df0c5d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "POST /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec/action" status: 202 len: 0 microversion: 2.1 time: 0.152885 Oct 29 03:47:41.082429 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3308/6839] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:47:40 2022] POST /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:47:41.089812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:47:41.091151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:47:41.096384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d252ea10-7aef-4bdc-940b-94e10cadd05a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:41.097082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d252ea10-7aef-4bdc-940b-94e10cadd05a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:41.105789 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d252ea10-7aef-4bdc-940b-94e10cadd05a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:41.106261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d252ea10-7aef-4bdc-940b-94e10cadd05a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:41.106696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d252ea10-7aef-4bdc-940b-94e10cadd05a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:41.107412 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d252ea10-7aef-4bdc-940b-94e10cadd05a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:41.107969 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d252ea10-7aef-4bdc-940b-94e10cadd05a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:41.108540 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d252ea10-7aef-4bdc-940b-94e10cadd05a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:41.265520 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d252ea10-7aef-4bdc-940b-94e10cadd05a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:41.274054 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d252ea10-7aef-4bdc-940b-94e10cadd05a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1678 microversion: 2.1 time: 0.186838 Oct 29 03:47:41.274711 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3532/6840] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:41 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1678 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:42.302663 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cc909ddd-bbb1-46d2-a521-44fb2a0d661f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:42.303452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cc909ddd-bbb1-46d2-a521-44fb2a0d661f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:42.312102 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc909ddd-bbb1-46d2-a521-44fb2a0d661f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:42.312779 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc909ddd-bbb1-46d2-a521-44fb2a0d661f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:42.313463 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc909ddd-bbb1-46d2-a521-44fb2a0d661f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:42.314585 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc909ddd-bbb1-46d2-a521-44fb2a0d661f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:42.315225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc909ddd-bbb1-46d2-a521-44fb2a0d661f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:42.315838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc909ddd-bbb1-46d2-a521-44fb2a0d661f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:42.467044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cc909ddd-bbb1-46d2-a521-44fb2a0d661f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:42.475900 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cc909ddd-bbb1-46d2-a521-44fb2a0d661f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1678 microversion: 2.1 time: 0.179540 Oct 29 03:47:42.476483 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3309/6841] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:42 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1678 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:43.503836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-05c0b251-9901-4d13-beab-b7caa399e38c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:43.504740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-05c0b251-9901-4d13-beab-b7caa399e38c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:43.513048 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05c0b251-9901-4d13-beab-b7caa399e38c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:43.513545 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05c0b251-9901-4d13-beab-b7caa399e38c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:43.513980 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05c0b251-9901-4d13-beab-b7caa399e38c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:43.514676 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05c0b251-9901-4d13-beab-b7caa399e38c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:43.515128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05c0b251-9901-4d13-beab-b7caa399e38c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:43.515553 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05c0b251-9901-4d13-beab-b7caa399e38c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:43.649832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-05c0b251-9901-4d13-beab-b7caa399e38c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:43.661681 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-05c0b251-9901-4d13-beab-b7caa399e38c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1683 microversion: 2.1 time: 0.163962 Oct 29 03:47:43.662554 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3533/6842] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:43 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:44.687259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b8d9d922-42ac-4a44-8234-c910a527ddf2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:44.688116 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b8d9d922-42ac-4a44-8234-c910a527ddf2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:44.698964 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8d9d922-42ac-4a44-8234-c910a527ddf2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:44.699780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8d9d922-42ac-4a44-8234-c910a527ddf2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:44.700504 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8d9d922-42ac-4a44-8234-c910a527ddf2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:44.701737 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8d9d922-42ac-4a44-8234-c910a527ddf2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:44.702356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8d9d922-42ac-4a44-8234-c910a527ddf2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:44.702995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b8d9d922-42ac-4a44-8234-c910a527ddf2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:44.847783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b8d9d922-42ac-4a44-8234-c910a527ddf2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:44.856764 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b8d9d922-42ac-4a44-8234-c910a527ddf2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1683 microversion: 2.1 time: 0.174232 Oct 29 03:47:44.857350 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3310/6843] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:44 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:45.884207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0926e99f-a980-4ad0-a1a6-489a27e65f29 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:45.884865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0926e99f-a980-4ad0-a1a6-489a27e65f29 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:45.892022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0926e99f-a980-4ad0-a1a6-489a27e65f29 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:45.892508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0926e99f-a980-4ad0-a1a6-489a27e65f29 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:45.892972 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0926e99f-a980-4ad0-a1a6-489a27e65f29 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:45.893666 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0926e99f-a980-4ad0-a1a6-489a27e65f29 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:45.894116 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0926e99f-a980-4ad0-a1a6-489a27e65f29 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:45.894542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0926e99f-a980-4ad0-a1a6-489a27e65f29 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:46.040997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0926e99f-a980-4ad0-a1a6-489a27e65f29 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:46.052596 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0926e99f-a980-4ad0-a1a6-489a27e65f29 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1683 microversion: 2.1 time: 0.173662 Oct 29 03:47:46.053340 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3534/6844] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:45 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:47.081689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2efc588e-29f5-475e-8c3a-09cc56ebc344 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:47.083602 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2efc588e-29f5-475e-8c3a-09cc56ebc344 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:47.093755 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2efc588e-29f5-475e-8c3a-09cc56ebc344 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:47.094263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2efc588e-29f5-475e-8c3a-09cc56ebc344 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:47.094708 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2efc588e-29f5-475e-8c3a-09cc56ebc344 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:47.095435 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2efc588e-29f5-475e-8c3a-09cc56ebc344 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:47.095895 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2efc588e-29f5-475e-8c3a-09cc56ebc344 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:47.096311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2efc588e-29f5-475e-8c3a-09cc56ebc344 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:47.237394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2efc588e-29f5-475e-8c3a-09cc56ebc344 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:47.246680 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2efc588e-29f5-475e-8c3a-09cc56ebc344 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1683 microversion: 2.1 time: 0.171603 Oct 29 03:47:47.247277 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3311/6845] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:47 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:48.271575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6f7f29cd-c18d-441c-91f3-cfc2fad0e784 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:48.272201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6f7f29cd-c18d-441c-91f3-cfc2fad0e784 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:48.279622 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f7f29cd-c18d-441c-91f3-cfc2fad0e784 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:48.280105 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f7f29cd-c18d-441c-91f3-cfc2fad0e784 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:48.280561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f7f29cd-c18d-441c-91f3-cfc2fad0e784 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:48.281265 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f7f29cd-c18d-441c-91f3-cfc2fad0e784 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:48.281716 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f7f29cd-c18d-441c-91f3-cfc2fad0e784 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:48.282149 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f7f29cd-c18d-441c-91f3-cfc2fad0e784 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:48.425882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6f7f29cd-c18d-441c-91f3-cfc2fad0e784 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:48.435945 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6f7f29cd-c18d-441c-91f3-cfc2fad0e784 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1683 microversion: 2.1 time: 0.168389 Oct 29 03:47:48.436545 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3535/6846] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:48 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:49.460179 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f929400d-6fac-4002-80b6-d1edfa74f388 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:49.461275 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f929400d-6fac-4002-80b6-d1edfa74f388 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:49.467689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f929400d-6fac-4002-80b6-d1edfa74f388 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:49.468185 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f929400d-6fac-4002-80b6-d1edfa74f388 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:49.468657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f929400d-6fac-4002-80b6-d1edfa74f388 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:49.469366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f929400d-6fac-4002-80b6-d1edfa74f388 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:49.469818 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f929400d-6fac-4002-80b6-d1edfa74f388 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:49.470277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f929400d-6fac-4002-80b6-d1edfa74f388 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:49.612547 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f929400d-6fac-4002-80b6-d1edfa74f388 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:49.621034 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f929400d-6fac-4002-80b6-d1edfa74f388 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1683 microversion: 2.1 time: 0.165221 Oct 29 03:47:49.621626 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3312/6847] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:49 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:47:50.645043 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cdb85a40-a5d8-4b0a-af1c-513a8aee3f30 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:50.645743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cdb85a40-a5d8-4b0a-af1c-513a8aee3f30 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:50.653195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cdb85a40-a5d8-4b0a-af1c-513a8aee3f30 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:50.653709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cdb85a40-a5d8-4b0a-af1c-513a8aee3f30 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:50.654118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cdb85a40-a5d8-4b0a-af1c-513a8aee3f30 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:50.654829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cdb85a40-a5d8-4b0a-af1c-513a8aee3f30 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:50.655279 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cdb85a40-a5d8-4b0a-af1c-513a8aee3f30 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:50.655703 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cdb85a40-a5d8-4b0a-af1c-513a8aee3f30 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:50.793505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cdb85a40-a5d8-4b0a-af1c-513a8aee3f30 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:50.802222 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cdb85a40-a5d8-4b0a-af1c-513a8aee3f30 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1683 microversion: 2.1 time: 0.161479 Oct 29 03:47:50.802861 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3536/6848] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:50 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:51.827676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-31d2ae59-a89b-4db7-973d-59e78f5acf27 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:51.828212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-31d2ae59-a89b-4db7-973d-59e78f5acf27 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:51.835400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-31d2ae59-a89b-4db7-973d-59e78f5acf27 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:51.835905 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-31d2ae59-a89b-4db7-973d-59e78f5acf27 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:51.836357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-31d2ae59-a89b-4db7-973d-59e78f5acf27 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:51.837094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-31d2ae59-a89b-4db7-973d-59e78f5acf27 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:51.837563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-31d2ae59-a89b-4db7-973d-59e78f5acf27 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:51.838007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-31d2ae59-a89b-4db7-973d-59e78f5acf27 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:51.970529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-31d2ae59-a89b-4db7-973d-59e78f5acf27 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:51.978790 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-31d2ae59-a89b-4db7-973d-59e78f5acf27 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1683 microversion: 2.1 time: 0.155213 Oct 29 03:47:51.979375 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3313/6849] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:51 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:53.003400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cbd72859-a964-42cd-9102-765db2c6d633 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:53.004053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cbd72859-a964-42cd-9102-765db2c6d633 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:53.011795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cbd72859-a964-42cd-9102-765db2c6d633 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:53.012299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cbd72859-a964-42cd-9102-765db2c6d633 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:53.012761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cbd72859-a964-42cd-9102-765db2c6d633 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:53.013457 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cbd72859-a964-42cd-9102-765db2c6d633 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:53.013908 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cbd72859-a964-42cd-9102-765db2c6d633 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:53.014336 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cbd72859-a964-42cd-9102-765db2c6d633 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:53.149289 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cbd72859-a964-42cd-9102-765db2c6d633 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:53.157324 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cbd72859-a964-42cd-9102-765db2c6d633 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1683 microversion: 2.1 time: 0.159016 Oct 29 03:47:53.157912 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3537/6850] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:52 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:54.181995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-13057d19-1a8f-4279-8814-80091d2211b0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:54.182687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-13057d19-1a8f-4279-8814-80091d2211b0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:54.190018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-13057d19-1a8f-4279-8814-80091d2211b0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:54.190518 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-13057d19-1a8f-4279-8814-80091d2211b0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:54.190976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-13057d19-1a8f-4279-8814-80091d2211b0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:54.191702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-13057d19-1a8f-4279-8814-80091d2211b0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:54.192173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-13057d19-1a8f-4279-8814-80091d2211b0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:54.192657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-13057d19-1a8f-4279-8814-80091d2211b0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:54.331749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-13057d19-1a8f-4279-8814-80091d2211b0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:54.340068 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-13057d19-1a8f-4279-8814-80091d2211b0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1683 microversion: 2.1 time: 0.162260 Oct 29 03:47:54.340681 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3314/6851] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:54 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:55.363966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-35215f6e-cb30-48b2-9711-afaeaa198cf0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:55.364662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-35215f6e-cb30-48b2-9711-afaeaa198cf0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:55.373677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35215f6e-cb30-48b2-9711-afaeaa198cf0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:55.374166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35215f6e-cb30-48b2-9711-afaeaa198cf0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:55.374607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35215f6e-cb30-48b2-9711-afaeaa198cf0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:55.375352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35215f6e-cb30-48b2-9711-afaeaa198cf0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:55.385926 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35215f6e-cb30-48b2-9711-afaeaa198cf0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:55.386405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35215f6e-cb30-48b2-9711-afaeaa198cf0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:55.586823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-35215f6e-cb30-48b2-9711-afaeaa198cf0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:55.595427 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-35215f6e-cb30-48b2-9711-afaeaa198cf0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1682 microversion: 2.1 time: 0.235743 Oct 29 03:47:55.596360 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3538/6852] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:55 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1682 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:55.871248 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-d7b6fd56-4a3a-40f4-b1bb-2fc7ca93eb04 req-3bf706e2-3672-4dba-87a6-5f8eb6a10199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b035159d-9129-455b-98b5-ff1d2c90a6ec", "name": "network-vif-unplugged", "status": "completed", "tag": "1e64b63b-ccb8-4000-9d39-fcb06149a0ea"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:47:55.882207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d7b6fd56-4a3a-40f4-b1bb-2fc7ca93eb04 req-3bf706e2-3672-4dba-87a6-5f8eb6a10199 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:55.882828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d7b6fd56-4a3a-40f4-b1bb-2fc7ca93eb04 req-3bf706e2-3672-4dba-87a6-5f8eb6a10199 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:55.883353 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d7b6fd56-4a3a-40f4-b1bb-2fc7ca93eb04 req-3bf706e2-3672-4dba-87a6-5f8eb6a10199 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:55.896428 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-d7b6fd56-4a3a-40f4-b1bb-2fc7ca93eb04 req-3bf706e2-3672-4dba-87a6-5f8eb6a10199 service nova] Creating event network-vif-unplugged:1e64b63b-ccb8-4000-9d39-fcb06149a0ea for instance b035159d-9129-455b-98b5-ff1d2c90a6ec on n-h2-862967-2 Oct 29 03:47:55.902224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [req-d7b6fd56-4a3a-40f4-b1bb-2fc7ca93eb04 req-3bf706e2-3672-4dba-87a6-5f8eb6a10199 service nova] Instance b035159d-9129-455b-98b5-ff1d2c90a6ec is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:47:55.913345 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-d7b6fd56-4a3a-40f4-b1bb-2fc7ca93eb04 req-3bf706e2-3672-4dba-87a6-5f8eb6a10199 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048931 Oct 29 03:47:55.914128 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3315/6853] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:47:56.620106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2c000e22-27b0-49df-9347-2751e70348c8 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:56.620742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2c000e22-27b0-49df-9347-2751e70348c8 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:56.630381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c000e22-27b0-49df-9347-2751e70348c8 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:56.631004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c000e22-27b0-49df-9347-2751e70348c8 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:56.631477 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c000e22-27b0-49df-9347-2751e70348c8 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:56.632326 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c000e22-27b0-49df-9347-2751e70348c8 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:56.632835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c000e22-27b0-49df-9347-2751e70348c8 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:56.633843 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c000e22-27b0-49df-9347-2751e70348c8 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:56.886049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2c000e22-27b0-49df-9347-2751e70348c8 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:56.894182 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2c000e22-27b0-49df-9347-2751e70348c8 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1682 microversion: 2.1 time: 0.278612 Oct 29 03:47:56.894774 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3539/6854] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:56 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1682 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:57.919647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8a9dac6e-f451-46e2-b026-201afa11ce3c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:57.920388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8a9dac6e-f451-46e2-b026-201afa11ce3c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:57.927547 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a9dac6e-f451-46e2-b026-201afa11ce3c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:57.928084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a9dac6e-f451-46e2-b026-201afa11ce3c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:57.928551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a9dac6e-f451-46e2-b026-201afa11ce3c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:57.929119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-1b06ad17-5117-4b80-8452-b66cc0d2b8a5 req-751d504d-d61e-4740-a000-ec6089bebf11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b035159d-9129-455b-98b5-ff1d2c90a6ec", "tag": "1e64b63b-ccb8-4000-9d39-fcb06149a0ea"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:47:57.929607 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a9dac6e-f451-46e2-b026-201afa11ce3c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:57.929974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a9dac6e-f451-46e2-b026-201afa11ce3c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:57.930453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a9dac6e-f451-46e2-b026-201afa11ce3c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:57.939022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1b06ad17-5117-4b80-8452-b66cc0d2b8a5 req-751d504d-d61e-4740-a000-ec6089bebf11 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:57.939419 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1b06ad17-5117-4b80-8452-b66cc0d2b8a5 req-751d504d-d61e-4740-a000-ec6089bebf11 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:57.939848 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1b06ad17-5117-4b80-8452-b66cc0d2b8a5 req-751d504d-d61e-4740-a000-ec6089bebf11 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:57.952322 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-1b06ad17-5117-4b80-8452-b66cc0d2b8a5 req-751d504d-d61e-4740-a000-ec6089bebf11 service nova] Creating event network-changed:1e64b63b-ccb8-4000-9d39-fcb06149a0ea for instance b035159d-9129-455b-98b5-ff1d2c90a6ec on n-h2-862967-2 Oct 29 03:47:57.958180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [req-1b06ad17-5117-4b80-8452-b66cc0d2b8a5 req-751d504d-d61e-4740-a000-ec6089bebf11 service nova] Instance b035159d-9129-455b-98b5-ff1d2c90a6ec is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:47:57.970720 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-1b06ad17-5117-4b80-8452-b66cc0d2b8a5 req-751d504d-d61e-4740-a000-ec6089bebf11 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046124 Oct 29 03:47:57.971375 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3540/6855] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:47:58.120761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8a9dac6e-f451-46e2-b026-201afa11ce3c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:58.130545 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8a9dac6e-f451-46e2-b026-201afa11ce3c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1680 microversion: 2.1 time: 0.216119 Oct 29 03:47:58.131331 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3316/6856] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:57 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1680 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:59.157220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c8e4376d-e0c7-4830-8939-848433baa270 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:59.157936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c8e4376d-e0c7-4830-8939-848433baa270 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:59.165162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c8e4376d-e0c7-4830-8939-848433baa270 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:59.165650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c8e4376d-e0c7-4830-8939-848433baa270 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:59.166090 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c8e4376d-e0c7-4830-8939-848433baa270 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:59.166787 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c8e4376d-e0c7-4830-8939-848433baa270 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:59.167240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c8e4376d-e0c7-4830-8939-848433baa270 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:59.167662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c8e4376d-e0c7-4830-8939-848433baa270 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:59.319686 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c8e4376d-e0c7-4830-8939-848433baa270 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:59.327768 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c8e4376d-e0c7-4830-8939-848433baa270 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1677 microversion: 2.1 time: 0.175921 Oct 29 03:47:59.328350 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3541/6857] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:59 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:47:59.350430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4354b58d-6131-4ccb-8cf7-ae679b037512 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:47:59.351015 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4354b58d-6131-4ccb-8cf7-ae679b037512 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:59.357897 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4354b58d-6131-4ccb-8cf7-ae679b037512 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:59.358409 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4354b58d-6131-4ccb-8cf7-ae679b037512 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:59.358862 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4354b58d-6131-4ccb-8cf7-ae679b037512 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:59.359571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4354b58d-6131-4ccb-8cf7-ae679b037512 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:59.360051 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4354b58d-6131-4ccb-8cf7-ae679b037512 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:59.360493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4354b58d-6131-4ccb-8cf7-ae679b037512 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:59.399235 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4354b58d-6131-4ccb-8cf7-ae679b037512 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:59.399739 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4354b58d-6131-4ccb-8cf7-ae679b037512 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:59.400320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4354b58d-6131-4ccb-8cf7-ae679b037512 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:59.401107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4354b58d-6131-4ccb-8cf7-ae679b037512 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:59.401580 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4354b58d-6131-4ccb-8cf7-ae679b037512 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:59.402020 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4354b58d-6131-4ccb-8cf7-ae679b037512 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:59.422742 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-4354b58d-6131-4ccb-8cf7-ae679b037512 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Getting quotas for project 2e19c07467824bbfbc0715c6085c40e6. Resources: {'cores', 'ram'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:47:59.427829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-4354b58d-6131-4ccb-8cf7-ae679b037512 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Getting quotas for user fd4c00a472474521add76167023ab141 and project 2e19c07467824bbfbc0715c6085c40e6. Resources: {'cores', 'ram'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:47:59.533704 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4354b58d-6131-4ccb-8cf7-ae679b037512 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "POST /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec/action" status: 202 len: 0 microversion: 2.1 time: 0.186909 Oct 29 03:47:59.534266 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3317/6858] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:47:59 2022] POST /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:47:59.543240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c29eea91-0468-43f1-918b-c77c7685212a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:47:59.543892 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c29eea91-0468-43f1-918b-c77c7685212a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:47:59.550360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c29eea91-0468-43f1-918b-c77c7685212a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:59.550834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c29eea91-0468-43f1-918b-c77c7685212a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:59.551355 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c29eea91-0468-43f1-918b-c77c7685212a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:59.551993 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c29eea91-0468-43f1-918b-c77c7685212a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:47:59.552449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c29eea91-0468-43f1-918b-c77c7685212a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:47:59.553100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c29eea91-0468-43f1-918b-c77c7685212a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:47:59.752546 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c29eea91-0468-43f1-918b-c77c7685212a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:47:59.760757 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c29eea91-0468-43f1-918b-c77c7685212a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1676 microversion: 2.1 time: 0.221792 Oct 29 03:47:59.761593 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3542/6859] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:47:59 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1676 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:00.786701 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6fd20623-13f2-4147-a5cc-bfdea928e374 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:00.787705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6fd20623-13f2-4147-a5cc-bfdea928e374 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:00.797646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6fd20623-13f2-4147-a5cc-bfdea928e374 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:00.798362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6fd20623-13f2-4147-a5cc-bfdea928e374 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:00.798903 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6fd20623-13f2-4147-a5cc-bfdea928e374 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:00.799766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6fd20623-13f2-4147-a5cc-bfdea928e374 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:00.800371 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6fd20623-13f2-4147-a5cc-bfdea928e374 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:00.801055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6fd20623-13f2-4147-a5cc-bfdea928e374 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:00.946805 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6fd20623-13f2-4147-a5cc-bfdea928e374 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:00.959828 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6fd20623-13f2-4147-a5cc-bfdea928e374 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1676 microversion: 2.1 time: 0.178272 Oct 29 03:48:00.960773 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3318/6860] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:00 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:01.995886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4da08053-247a-468d-b7b6-f89cd04fc0ac tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:01.996721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4da08053-247a-468d-b7b6-f89cd04fc0ac tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:02.005413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4da08053-247a-468d-b7b6-f89cd04fc0ac tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:02.005911 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4da08053-247a-468d-b7b6-f89cd04fc0ac tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:02.006410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4da08053-247a-468d-b7b6-f89cd04fc0ac tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:02.007396 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4da08053-247a-468d-b7b6-f89cd04fc0ac tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:02.007837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4da08053-247a-468d-b7b6-f89cd04fc0ac tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:02.008463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4da08053-247a-468d-b7b6-f89cd04fc0ac tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:02.152073 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4da08053-247a-468d-b7b6-f89cd04fc0ac tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:02.160580 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4da08053-247a-468d-b7b6-f89cd04fc0ac tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1676 microversion: 2.1 time: 0.169212 Oct 29 03:48:02.161232 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3543/6861] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:01 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:03.183540 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-91fcff59-9039-4928-8e7d-ff070c3f9f2f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:03.184294 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-91fcff59-9039-4928-8e7d-ff070c3f9f2f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:03.191926 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91fcff59-9039-4928-8e7d-ff070c3f9f2f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:03.192436 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91fcff59-9039-4928-8e7d-ff070c3f9f2f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:03.192923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91fcff59-9039-4928-8e7d-ff070c3f9f2f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:03.193660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91fcff59-9039-4928-8e7d-ff070c3f9f2f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:03.194095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91fcff59-9039-4928-8e7d-ff070c3f9f2f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:03.194755 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-91fcff59-9039-4928-8e7d-ff070c3f9f2f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:03.454996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-91fcff59-9039-4928-8e7d-ff070c3f9f2f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:03.463521 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-91fcff59-9039-4928-8e7d-ff070c3f9f2f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1676 microversion: 2.1 time: 0.283851 Oct 29 03:48:03.464150 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3319/6862] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:03 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1676 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:04.093383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-6ef4d2c2-f765-4084-b82d-020651c3a498 req-e60def0e-78bc-4e4b-9258-68a2f82d1db0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b035159d-9129-455b-98b5-ff1d2c90a6ec", "tag": "1e64b63b-ccb8-4000-9d39-fcb06149a0ea"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:48:04.104131 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-6ef4d2c2-f765-4084-b82d-020651c3a498 req-e60def0e-78bc-4e4b-9258-68a2f82d1db0 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:04.104640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-6ef4d2c2-f765-4084-b82d-020651c3a498 req-e60def0e-78bc-4e4b-9258-68a2f82d1db0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:04.105127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-6ef4d2c2-f765-4084-b82d-020651c3a498 req-e60def0e-78bc-4e4b-9258-68a2f82d1db0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:04.117832 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-6ef4d2c2-f765-4084-b82d-020651c3a498 req-e60def0e-78bc-4e4b-9258-68a2f82d1db0 service nova] Creating event network-changed:1e64b63b-ccb8-4000-9d39-fcb06149a0ea for instance b035159d-9129-455b-98b5-ff1d2c90a6ec on n-h1-862967-2 Oct 29 03:48:04.123353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [req-6ef4d2c2-f765-4084-b82d-020651c3a498 req-e60def0e-78bc-4e4b-9258-68a2f82d1db0 service nova] Instance b035159d-9129-455b-98b5-ff1d2c90a6ec is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:48:04.134796 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-6ef4d2c2-f765-4084-b82d-020651c3a498 req-e60def0e-78bc-4e4b-9258-68a2f82d1db0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045507 Oct 29 03:48:04.135465 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3544/6863] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:48:04.487647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f68db644-cf5e-44fd-8ea5-96759a480ddd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:04.488418 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f68db644-cf5e-44fd-8ea5-96759a480ddd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:04.497152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f68db644-cf5e-44fd-8ea5-96759a480ddd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:04.497836 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f68db644-cf5e-44fd-8ea5-96759a480ddd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:04.498394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f68db644-cf5e-44fd-8ea5-96759a480ddd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:04.499334 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f68db644-cf5e-44fd-8ea5-96759a480ddd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:04.499905 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f68db644-cf5e-44fd-8ea5-96759a480ddd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:04.500454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f68db644-cf5e-44fd-8ea5-96759a480ddd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:04.530977 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:48:04.720810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f68db644-cf5e-44fd-8ea5-96759a480ddd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:04.729304 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f68db644-cf5e-44fd-8ea5-96759a480ddd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1676 microversion: 2.1 time: 0.245677 Oct 29 03:48:04.730069 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3320/6864] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:04 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1676 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:05.754985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d93a8c0b-a37c-4ba3-8a3d-4b7a325fe758 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:05.755680 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d93a8c0b-a37c-4ba3-8a3d-4b7a325fe758 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:05.762495 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d93a8c0b-a37c-4ba3-8a3d-4b7a325fe758 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:05.762988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d93a8c0b-a37c-4ba3-8a3d-4b7a325fe758 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:05.763427 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d93a8c0b-a37c-4ba3-8a3d-4b7a325fe758 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:05.764124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d93a8c0b-a37c-4ba3-8a3d-4b7a325fe758 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:05.764577 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d93a8c0b-a37c-4ba3-8a3d-4b7a325fe758 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:05.765033 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d93a8c0b-a37c-4ba3-8a3d-4b7a325fe758 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:05.906638 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d93a8c0b-a37c-4ba3-8a3d-4b7a325fe758 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:05.915077 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d93a8c0b-a37c-4ba3-8a3d-4b7a325fe758 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1676 microversion: 2.1 time: 0.165426 Oct 29 03:48:05.915675 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3545/6865] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:05 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:06.939137 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2b8428c2-4c8d-4c95-b490-0ba2ef4cec2d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:06.940312 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2b8428c2-4c8d-4c95-b490-0ba2ef4cec2d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:06.949316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b8428c2-4c8d-4c95-b490-0ba2ef4cec2d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:06.949814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b8428c2-4c8d-4c95-b490-0ba2ef4cec2d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:06.950291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b8428c2-4c8d-4c95-b490-0ba2ef4cec2d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:06.951033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b8428c2-4c8d-4c95-b490-0ba2ef4cec2d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:06.951516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b8428c2-4c8d-4c95-b490-0ba2ef4cec2d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:06.951980 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b8428c2-4c8d-4c95-b490-0ba2ef4cec2d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:07.094921 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2b8428c2-4c8d-4c95-b490-0ba2ef4cec2d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:07.105646 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2b8428c2-4c8d-4c95-b490-0ba2ef4cec2d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1669 microversion: 2.1 time: 0.170512 Oct 29 03:48:07.106228 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3321/6866] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:06 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1669 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:07.128833 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7b02e624-931c-4e8a-88c3-5a753efd04d9 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:07.129383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7b02e624-931c-4e8a-88c3-5a753efd04d9 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:07.136815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b02e624-931c-4e8a-88c3-5a753efd04d9 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:07.137308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b02e624-931c-4e8a-88c3-5a753efd04d9 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:07.137751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b02e624-931c-4e8a-88c3-5a753efd04d9 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:07.138452 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b02e624-931c-4e8a-88c3-5a753efd04d9 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:07.138913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b02e624-931c-4e8a-88c3-5a753efd04d9 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:07.139343 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7b02e624-931c-4e8a-88c3-5a753efd04d9 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:07.289491 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7b02e624-931c-4e8a-88c3-5a753efd04d9 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:07.298967 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7b02e624-931c-4e8a-88c3-5a753efd04d9 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1669 microversion: 2.1 time: 0.174203 Oct 29 03:48:07.299581 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3546/6867] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:07 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1669 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:07.322279 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-56d87362-b5dc-4ea5-ac94-0e7c3f9336b0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:07.322917 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-56d87362-b5dc-4ea5-ac94-0e7c3f9336b0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:07.329749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-56d87362-b5dc-4ea5-ac94-0e7c3f9336b0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:07.330297 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-56d87362-b5dc-4ea5-ac94-0e7c3f9336b0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:07.330717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-56d87362-b5dc-4ea5-ac94-0e7c3f9336b0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:07.331469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-56d87362-b5dc-4ea5-ac94-0e7c3f9336b0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:07.331936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-56d87362-b5dc-4ea5-ac94-0e7c3f9336b0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:07.332383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-56d87362-b5dc-4ea5-ac94-0e7c3f9336b0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:07.491447 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-56d87362-b5dc-4ea5-ac94-0e7c3f9336b0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:07.499929 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-56d87362-b5dc-4ea5-ac94-0e7c3f9336b0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1669 microversion: 2.1 time: 0.181692 Oct 29 03:48:07.500501 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3322/6868] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:07 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1669 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:07.522958 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e4e6d4cb-22a8-4412-a94c-b63462e8da32 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:07.523455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e4e6d4cb-22a8-4412-a94c-b63462e8da32 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:07.530768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e4e6d4cb-22a8-4412-a94c-b63462e8da32 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:07.531446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e4e6d4cb-22a8-4412-a94c-b63462e8da32 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:07.532012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e4e6d4cb-22a8-4412-a94c-b63462e8da32 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:07.533049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e4e6d4cb-22a8-4412-a94c-b63462e8da32 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:07.533599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e4e6d4cb-22a8-4412-a94c-b63462e8da32 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:07.534216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e4e6d4cb-22a8-4412-a94c-b63462e8da32 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:07.568920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e4e6d4cb-22a8-4412-a94c-b63462e8da32 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:48:07.619464 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:48:07.653415 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e4e6d4cb-22a8-4412-a94c-b63462e8da32 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 204 len: 0 microversion: 2.1 time: 0.134210 Oct 29 03:48:07.654145 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3547/6869] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:48:07 2022] DELETE /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:48:07.664902 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2c7f4a0a-a157-4a1f-8ccf-5bf57f772dcf tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:07.665537 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2c7f4a0a-a157-4a1f-8ccf-5bf57f772dcf tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:07.672641 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2c7f4a0a-a157-4a1f-8ccf-5bf57f772dcf tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:07.673140 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2c7f4a0a-a157-4a1f-8ccf-5bf57f772dcf tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:07.673586 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2c7f4a0a-a157-4a1f-8ccf-5bf57f772dcf tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:07.674294 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2c7f4a0a-a157-4a1f-8ccf-5bf57f772dcf tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:07.674755 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2c7f4a0a-a157-4a1f-8ccf-5bf57f772dcf tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:07.675192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2c7f4a0a-a157-4a1f-8ccf-5bf57f772dcf tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:07.817027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2c7f4a0a-a157-4a1f-8ccf-5bf57f772dcf tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:07.825754 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2c7f4a0a-a157-4a1f-8ccf-5bf57f772dcf tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1675 microversion: 2.1 time: 0.166960 Oct 29 03:48:07.826333 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3323/6870] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:07 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:48:08.624852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-9596b1a8-620c-4aa7-b56d-bcdf28b5f7e4 req-d1134d2e-f42a-4ed9-ade2-ac19c3c4d637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b035159d-9129-455b-98b5-ff1d2c90a6ec", "name": "network-vif-plugged", "status": "completed", "tag": "1e64b63b-ccb8-4000-9d39-fcb06149a0ea"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:48:08.636297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9596b1a8-620c-4aa7-b56d-bcdf28b5f7e4 req-d1134d2e-f42a-4ed9-ade2-ac19c3c4d637 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:08.636854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9596b1a8-620c-4aa7-b56d-bcdf28b5f7e4 req-d1134d2e-f42a-4ed9-ade2-ac19c3c4d637 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:08.637287 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-9596b1a8-620c-4aa7-b56d-bcdf28b5f7e4 req-d1134d2e-f42a-4ed9-ade2-ac19c3c4d637 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:08.649995 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-9596b1a8-620c-4aa7-b56d-bcdf28b5f7e4 req-d1134d2e-f42a-4ed9-ade2-ac19c3c4d637 service nova] Creating event network-vif-plugged:1e64b63b-ccb8-4000-9d39-fcb06149a0ea for instance b035159d-9129-455b-98b5-ff1d2c90a6ec on n-h1-862967-2 Oct 29 03:48:08.655221 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-9596b1a8-620c-4aa7-b56d-bcdf28b5f7e4 req-d1134d2e-f42a-4ed9-ade2-ac19c3c4d637 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034653 Oct 29 03:48:08.655842 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3548/6871] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:48:08.849637 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e3a85044-c9d9-4d79-b062-29bd50e3c869 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:08.850298 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e3a85044-c9d9-4d79-b062-29bd50e3c869 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:08.857845 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3a85044-c9d9-4d79-b062-29bd50e3c869 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:08.858383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3a85044-c9d9-4d79-b062-29bd50e3c869 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:08.858839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3a85044-c9d9-4d79-b062-29bd50e3c869 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:08.859565 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3a85044-c9d9-4d79-b062-29bd50e3c869 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:08.860056 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3a85044-c9d9-4d79-b062-29bd50e3c869 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:08.860503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3a85044-c9d9-4d79-b062-29bd50e3c869 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:08.999737 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e3a85044-c9d9-4d79-b062-29bd50e3c869 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:09.009015 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e3a85044-c9d9-4d79-b062-29bd50e3c869 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1675 microversion: 2.1 time: 0.163526 Oct 29 03:48:09.009911 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3324/6872] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:08 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:09.926866 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-021dbbe5-9c88-42fc-bfc3-c26b8e9f355d req-4b03d8df-d639-4f81-8fdc-fde8aafdf8e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b035159d-9129-455b-98b5-ff1d2c90a6ec", "name": "network-vif-deleted", "tag": "1e64b63b-ccb8-4000-9d39-fcb06149a0ea"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:48:09.937397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-021dbbe5-9c88-42fc-bfc3-c26b8e9f355d req-4b03d8df-d639-4f81-8fdc-fde8aafdf8e3 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:09.937894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-021dbbe5-9c88-42fc-bfc3-c26b8e9f355d req-4b03d8df-d639-4f81-8fdc-fde8aafdf8e3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:09.938357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-021dbbe5-9c88-42fc-bfc3-c26b8e9f355d req-4b03d8df-d639-4f81-8fdc-fde8aafdf8e3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:09.950947 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-021dbbe5-9c88-42fc-bfc3-c26b8e9f355d req-4b03d8df-d639-4f81-8fdc-fde8aafdf8e3 service nova] Creating event network-vif-deleted:1e64b63b-ccb8-4000-9d39-fcb06149a0ea for instance b035159d-9129-455b-98b5-ff1d2c90a6ec on n-h1-862967-2 Oct 29 03:48:09.956015 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-021dbbe5-9c88-42fc-bfc3-c26b8e9f355d req-4b03d8df-d639-4f81-8fdc-fde8aafdf8e3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034087 Oct 29 03:48:09.957154 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3549/6873] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:48:10.033307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-43610ba6-7ff0-4c1f-8914-398300ec320e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:10.034647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-43610ba6-7ff0-4c1f-8914-398300ec320e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:10.040970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:48:10.044691 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43610ba6-7ff0-4c1f-8914-398300ec320e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:10.045197 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43610ba6-7ff0-4c1f-8914-398300ec320e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:10.046444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43610ba6-7ff0-4c1f-8914-398300ec320e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:10.047640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43610ba6-7ff0-4c1f-8914-398300ec320e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:10.048124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43610ba6-7ff0-4c1f-8914-398300ec320e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:10.048591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43610ba6-7ff0-4c1f-8914-398300ec320e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:10.091920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43610ba6-7ff0-4c1f-8914-398300ec320e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:10.092418 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43610ba6-7ff0-4c1f-8914-398300ec320e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:10.092890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-43610ba6-7ff0-4c1f-8914-398300ec320e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:10.093384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-43610ba6-7ff0-4c1f-8914-398300ec320e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lazy-loading 'fault' on Instance uuid b035159d-9129-455b-98b5-ff1d2c90a6ec {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:48:10.138815 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-43610ba6-7ff0-4c1f-8914-398300ec320e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:10.146825 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-43610ba6-7ff0-4c1f-8914-398300ec320e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 200 len: 1328 microversion: 2.1 time: 0.117545 Oct 29 03:48:10.147416 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3325/6874] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:10 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 1328 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:11.172920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ba1c1939-cf1a-455c-a481-4d3723fc6e4f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:11.173646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ba1c1939-cf1a-455c-a481-4d3723fc6e4f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:11.175803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:48:11.181662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba1c1939-cf1a-455c-a481-4d3723fc6e4f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:11.182153 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba1c1939-cf1a-455c-a481-4d3723fc6e4f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:11.182884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba1c1939-cf1a-455c-a481-4d3723fc6e4f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:11.183637 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba1c1939-cf1a-455c-a481-4d3723fc6e4f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:11.184096 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba1c1939-cf1a-455c-a481-4d3723fc6e4f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:11.184540 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ba1c1939-cf1a-455c-a481-4d3723fc6e4f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:11.200260 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-ba1c1939-cf1a-455c-a481-4d3723fc6e4f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] HTTP exception thrown: Instance b035159d-9129-455b-98b5-ff1d2c90a6ec could not be found. Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ba1c1939-cf1a-455c-a481-4d3723fc6e4f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Request method failure captured: Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec HTTP/1.1 Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXKGQJeWMxfWMeM3O6gGoGSgLaotgRmZdXAA5ksXNn18BC3kYiORlqcPrpkO6hwWROtId_i3BPG3tHcLNXgo1DRLTViLVFJkr5ippTm7TWTVVrTinupx_GraljlTHrjKYi9B__lcWVv-kBGfZZl6RvbkghUGxnbsTm6q2TyI0UqnddMU Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2e19c07467824bbfbc0715c6085c40e6"}]}] Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServerActionsTestJSON-539616512 Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: fd4c00a472474521add76167023ab141 Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance b035159d-9129-455b-98b5-ff1d2c90a6ec could not be found. Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'b035159d-9129-455b-98b5-ff1d2c90a6ec'} Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b035159d-9129-455b-98b5-ff1d2c90a6ec could not be found. Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b035159d-9129-455b-98b5-ff1d2c90a6ec could not be found. Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:48:11.202018 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:48:11.206842 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:48:11.206842 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:48:11.206842 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:48:11.206842 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:48:11.206842 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:48:11.206842 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b035159d-9129-455b-98b5-ff1d2c90a6ec could not be found. Oct 29 03:48:11.206842 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:48:11.206842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ba1c1939-cf1a-455c-a481-4d3723fc6e4f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Returning 404 to user: Instance b035159d-9129-455b-98b5-ff1d2c90a6ec could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:48:11.206842 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ba1c1939-cf1a-455c-a481-4d3723fc6e4f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 404 len: 111 microversion: 2.1 time: 0.035872 Oct 29 03:48:11.206842 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3550/6875] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:11 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:48:11.223831 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a8a0cfc4-8640-412b-b1ba-c2ff6dc66e6a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:11.224438 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a8a0cfc4-8640-412b-b1ba-c2ff6dc66e6a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:11.227245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:48:11.233998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8a0cfc4-8640-412b-b1ba-c2ff6dc66e6a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:11.234650 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8a0cfc4-8640-412b-b1ba-c2ff6dc66e6a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:11.235109 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8a0cfc4-8640-412b-b1ba-c2ff6dc66e6a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:11.235837 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8a0cfc4-8640-412b-b1ba-c2ff6dc66e6a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:11.236306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8a0cfc4-8640-412b-b1ba-c2ff6dc66e6a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:11.236802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a8a0cfc4-8640-412b-b1ba-c2ff6dc66e6a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:11.252373 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-a8a0cfc4-8640-412b-b1ba-c2ff6dc66e6a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] HTTP exception thrown: Instance b035159d-9129-455b-98b5-ff1d2c90a6ec could not be found. Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a8a0cfc4-8640-412b-b1ba-c2ff6dc66e6a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Request method failure captured: Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec HTTP/1.1 Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKGQJeWMxfWMeM3O6gGoGSgLaotgRmZdXAA5ksXNn18BC3kYiORlqcPrpkO6hwWROtId_i3BPG3tHcLNXgo1DRLTViLVFJkr5ippTm7TWTVVrTinupx_GraljlTHrjKYi9B__lcWVv-kBGfZZl6RvbkghUGxnbsTm6q2TyI0UqnddMU Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2e19c07467824bbfbc0715c6085c40e6"}]}] Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerActionsTestJSON-539616512 Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: fd4c00a472474521add76167023ab141 Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance b035159d-9129-455b-98b5-ff1d2c90a6ec could not be found. Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'b035159d-9129-455b-98b5-ff1d2c90a6ec'} Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b035159d-9129-455b-98b5-ff1d2c90a6ec could not be found. Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b035159d-9129-455b-98b5-ff1d2c90a6ec could not be found. Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:48:11.254092 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:48:11.259037 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:48:11.259037 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:48:11.259037 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:48:11.259037 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:48:11.259037 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:48:11.259037 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b035159d-9129-455b-98b5-ff1d2c90a6ec could not be found. Oct 29 03:48:11.259037 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:48:11.259037 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a8a0cfc4-8640-412b-b1ba-c2ff6dc66e6a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Returning 404 to user: Instance b035159d-9129-455b-98b5-ff1d2c90a6ec could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:48:11.259037 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a8a0cfc4-8640-412b-b1ba-c2ff6dc66e6a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 404 len: 111 microversion: 2.1 time: 0.035869 Oct 29 03:48:11.259037 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3326/6876] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:11 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:48:11.316126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2d734399-c9a0-45a0-9e09-f8c903267b98 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-710782615", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "16b776c7-5074-4f3f-a183-66ccafda21d7"}], "security_groups": [{"name": "tempest-securitygroup--98886569"}], "key_name": "tempest-keypair-685611708", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:48:11.439102 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-2d734399-c9a0-45a0-9e09-f8c903267b98 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] validate_networks() for [('16b776c7-5074-4f3f-a183-66ccafda21d7', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:48:12.101356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-2d734399-c9a0-45a0-9e09-f8c903267b98 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:48:12.101819 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-2d734399-c9a0-45a0-9e09-f8c903267b98 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:48:12.102285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-2d734399-c9a0-45a0-9e09-f8c903267b98 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:48:12.102692 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-2d734399-c9a0-45a0-9e09-f8c903267b98 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:48:12.103105 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-2d734399-c9a0-45a0-9e09-f8c903267b98 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:48:12.112905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2d734399-c9a0-45a0-9e09-f8c903267b98 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:12.113395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2d734399-c9a0-45a0-9e09-f8c903267b98 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:12.113834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2d734399-c9a0-45a0-9e09-f8c903267b98 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:12.114568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2d734399-c9a0-45a0-9e09-f8c903267b98 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:12.115030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2d734399-c9a0-45a0-9e09-f8c903267b98 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:12.115476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2d734399-c9a0-45a0-9e09-f8c903267b98 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:12.134349 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-2d734399-c9a0-45a0-9e09-f8c903267b98 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Getting quotas for project 2e19c07467824bbfbc0715c6085c40e6. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:48:12.140121 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-2d734399-c9a0-45a0-9e09-f8c903267b98 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Getting quotas for user fd4c00a472474521add76167023ab141 and project 2e19c07467824bbfbc0715c6085c40e6. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:48:12.153545 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2d734399-c9a0-45a0-9e09-f8c903267b98 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:48:12.155878 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2d734399-c9a0-45a0-9e09-f8c903267b98 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:48:12.207150 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2d734399-c9a0-45a0-9e09-f8c903267b98 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.895086 Oct 29 03:48:12.207863 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3551/6877] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:48:11 2022] POST /compute/v2.1/servers => generated 404 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 03:48:12.219896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fb6dcf6e-36a0-4dda-8270-3b3d64089488 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:12.220547 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fb6dcf6e-36a0-4dda-8270-3b3d64089488 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:12.280981 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fb6dcf6e-36a0-4dda-8270-3b3d64089488 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:12.299264 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fb6dcf6e-36a0-4dda-8270-3b3d64089488 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1237 microversion: 2.1 time: 0.083405 Oct 29 03:48:12.299872 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3327/6878] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:12 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:13.326081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8456540b-d527-449f-951f-b0cfabb55dea tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:13.326618 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8456540b-d527-449f-951f-b0cfabb55dea tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:13.333853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8456540b-d527-449f-951f-b0cfabb55dea tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:13.334664 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8456540b-d527-449f-951f-b0cfabb55dea tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:13.335195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8456540b-d527-449f-951f-b0cfabb55dea tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:13.336058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8456540b-d527-449f-951f-b0cfabb55dea tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:13.336644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8456540b-d527-449f-951f-b0cfabb55dea tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:13.337145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8456540b-d527-449f-951f-b0cfabb55dea tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:13.420190 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8456540b-d527-449f-951f-b0cfabb55dea tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:13.428762 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8456540b-d527-449f-951f-b0cfabb55dea tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1307 microversion: 2.1 time: 0.108543 Oct 29 03:48:13.429496 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3552/6879] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:13 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1307 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:14.453903 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2a4172e0-02fd-43b1-b17a-cd08e1267397 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:14.454683 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2a4172e0-02fd-43b1-b17a-cd08e1267397 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:14.462302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a4172e0-02fd-43b1-b17a-cd08e1267397 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:14.462915 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a4172e0-02fd-43b1-b17a-cd08e1267397 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:14.463474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a4172e0-02fd-43b1-b17a-cd08e1267397 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:14.464771 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a4172e0-02fd-43b1-b17a-cd08e1267397 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:14.465410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a4172e0-02fd-43b1-b17a-cd08e1267397 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:14.466153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a4172e0-02fd-43b1-b17a-cd08e1267397 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:14.611454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2a4172e0-02fd-43b1-b17a-cd08e1267397 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:14.620861 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2a4172e0-02fd-43b1-b17a-cd08e1267397 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1361 microversion: 2.1 time: 0.170991 Oct 29 03:48:14.621468 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3328/6880] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:14 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:14.747830 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-e5660132-ac37-4884-b6e3-f161fe178cd8 req-03e86bb1-2ac3-465b-954f-390ccead0199 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48d6b81f-1325-4b73-a0b3-cfa3ca179d70", "tag": "2c4ddbcd-1564-4790-a283-65f9bf20292e"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:48:14.761002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e5660132-ac37-4884-b6e3-f161fe178cd8 req-03e86bb1-2ac3-465b-954f-390ccead0199 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:14.761524 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e5660132-ac37-4884-b6e3-f161fe178cd8 req-03e86bb1-2ac3-465b-954f-390ccead0199 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:14.762126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e5660132-ac37-4884-b6e3-f161fe178cd8 req-03e86bb1-2ac3-465b-954f-390ccead0199 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:14.778382 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-e5660132-ac37-4884-b6e3-f161fe178cd8 req-03e86bb1-2ac3-465b-954f-390ccead0199 service nova] Creating event network-changed:2c4ddbcd-1564-4790-a283-65f9bf20292e for instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 on n-h2-862967-2 Oct 29 03:48:14.783247 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-e5660132-ac37-4884-b6e3-f161fe178cd8 req-03e86bb1-2ac3-465b-954f-390ccead0199 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040957 Oct 29 03:48:14.783875 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3553/6881] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:48:15.646699 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d1bdd3e2-47ad-4015-ae3e-d34950f8b642 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:15.647456 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d1bdd3e2-47ad-4015-ae3e-d34950f8b642 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:15.655491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1bdd3e2-47ad-4015-ae3e-d34950f8b642 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:15.655989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1bdd3e2-47ad-4015-ae3e-d34950f8b642 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:15.656410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1bdd3e2-47ad-4015-ae3e-d34950f8b642 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:15.657167 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1bdd3e2-47ad-4015-ae3e-d34950f8b642 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:15.657624 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1bdd3e2-47ad-4015-ae3e-d34950f8b642 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:15.658063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d1bdd3e2-47ad-4015-ae3e-d34950f8b642 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:15.800599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d1bdd3e2-47ad-4015-ae3e-d34950f8b642 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:15.811585 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d1bdd3e2-47ad-4015-ae3e-d34950f8b642 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1361 microversion: 2.1 time: 0.169555 Oct 29 03:48:15.812178 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3329/6882] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:15 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:16.843854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4a5f0d1f-189f-40e3-b610-829a17fd32ad tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:16.845253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4a5f0d1f-189f-40e3-b610-829a17fd32ad tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:16.855231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a5f0d1f-189f-40e3-b610-829a17fd32ad tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:16.855795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a5f0d1f-189f-40e3-b610-829a17fd32ad tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:16.856245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a5f0d1f-189f-40e3-b610-829a17fd32ad tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:16.856984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a5f0d1f-189f-40e3-b610-829a17fd32ad tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:16.857438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a5f0d1f-189f-40e3-b610-829a17fd32ad tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:16.857850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4a5f0d1f-189f-40e3-b610-829a17fd32ad tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:16.999683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4a5f0d1f-189f-40e3-b610-829a17fd32ad tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:17.008979 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4a5f0d1f-189f-40e3-b610-829a17fd32ad tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1361 microversion: 2.1 time: 0.174271 Oct 29 03:48:17.009593 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3554/6883] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:16 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:18.033438 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ff5fa292-4f2a-442a-88a2-e90731d374a2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:18.034195 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ff5fa292-4f2a-442a-88a2-e90731d374a2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:18.041710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff5fa292-4f2a-442a-88a2-e90731d374a2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:18.042233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff5fa292-4f2a-442a-88a2-e90731d374a2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:18.042714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff5fa292-4f2a-442a-88a2-e90731d374a2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:18.043417 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff5fa292-4f2a-442a-88a2-e90731d374a2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:18.043887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff5fa292-4f2a-442a-88a2-e90731d374a2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:18.044330 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ff5fa292-4f2a-442a-88a2-e90731d374a2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:18.209835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ff5fa292-4f2a-442a-88a2-e90731d374a2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:18.219401 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ff5fa292-4f2a-442a-88a2-e90731d374a2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1361 microversion: 2.1 time: 0.190140 Oct 29 03:48:18.219997 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3330/6884] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:18 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1361 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:19.248003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-313c18fd-b2eb-440c-a776-797f9a7d947a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:19.248713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-313c18fd-b2eb-440c-a776-797f9a7d947a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:19.258093 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-313c18fd-b2eb-440c-a776-797f9a7d947a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:19.258616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-313c18fd-b2eb-440c-a776-797f9a7d947a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:19.259108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-313c18fd-b2eb-440c-a776-797f9a7d947a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:19.259906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-313c18fd-b2eb-440c-a776-797f9a7d947a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:19.260439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-313c18fd-b2eb-440c-a776-797f9a7d947a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:19.260898 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-313c18fd-b2eb-440c-a776-797f9a7d947a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:19.407877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-313c18fd-b2eb-440c-a776-797f9a7d947a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:19.416197 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-313c18fd-b2eb-440c-a776-797f9a7d947a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1361 microversion: 2.1 time: 0.172518 Oct 29 03:48:19.416860 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3555/6885] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:19 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:20.442962 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6f6157e7-742f-40bc-9502-4b2e6adf3063 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:20.444034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6f6157e7-742f-40bc-9502-4b2e6adf3063 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:20.451646 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f6157e7-742f-40bc-9502-4b2e6adf3063 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:20.452382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f6157e7-742f-40bc-9502-4b2e6adf3063 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:20.453260 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f6157e7-742f-40bc-9502-4b2e6adf3063 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:20.454284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f6157e7-742f-40bc-9502-4b2e6adf3063 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:20.454755 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f6157e7-742f-40bc-9502-4b2e6adf3063 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:20.455197 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f6157e7-742f-40bc-9502-4b2e6adf3063 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:20.584767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-c6abcd3c-0ba5-49a2-9361-1674625b22d6 req-611e3882-e515-4b67-b561-c38b89ce256e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d6b81f-1325-4b73-a0b3-cfa3ca179d70", "name": "network-vif-plugged", "status": "completed", "tag": "2c4ddbcd-1564-4790-a283-65f9bf20292e"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:48:20.597964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c6abcd3c-0ba5-49a2-9361-1674625b22d6 req-611e3882-e515-4b67-b561-c38b89ce256e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:20.601782 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6f6157e7-742f-40bc-9502-4b2e6adf3063 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:20.604501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c6abcd3c-0ba5-49a2-9361-1674625b22d6 req-611e3882-e515-4b67-b561-c38b89ce256e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:20.605175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c6abcd3c-0ba5-49a2-9361-1674625b22d6 req-611e3882-e515-4b67-b561-c38b89ce256e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:20.610982 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6f6157e7-742f-40bc-9502-4b2e6adf3063 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1361 microversion: 2.1 time: 0.174301 Oct 29 03:48:20.612042 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3331/6886] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:20 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:20.618523 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-c6abcd3c-0ba5-49a2-9361-1674625b22d6 req-611e3882-e515-4b67-b561-c38b89ce256e service nova] Creating event network-vif-plugged:2c4ddbcd-1564-4790-a283-65f9bf20292e for instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 on n-h2-862967-2 Oct 29 03:48:20.623887 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-c6abcd3c-0ba5-49a2-9361-1674625b22d6 req-611e3882-e515-4b67-b561-c38b89ce256e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044213 Oct 29 03:48:20.624549 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3556/6887] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:48:21.640279 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a6548054-d168-488d-861f-d1397d808f78 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:21.641122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a6548054-d168-488d-861f-d1397d808f78 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:21.652185 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6548054-d168-488d-861f-d1397d808f78 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:21.652747 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6548054-d168-488d-861f-d1397d808f78 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:21.653201 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6548054-d168-488d-861f-d1397d808f78 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:21.653937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6548054-d168-488d-861f-d1397d808f78 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:21.654405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6548054-d168-488d-861f-d1397d808f78 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:21.654831 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a6548054-d168-488d-861f-d1397d808f78 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:21.797027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a6548054-d168-488d-861f-d1397d808f78 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:21.807036 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a6548054-d168-488d-861f-d1397d808f78 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1361 microversion: 2.1 time: 0.173042 Oct 29 03:48:21.807606 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3332/6888] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:21 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:22.833832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:48:22.834938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:48:22.841641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4ed3c483-2bce-4050-a2d4-4e3f4eb73f2d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:22.842805 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4ed3c483-2bce-4050-a2d4-4e3f4eb73f2d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:22.854538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ed3c483-2bce-4050-a2d4-4e3f4eb73f2d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:22.855282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ed3c483-2bce-4050-a2d4-4e3f4eb73f2d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:22.855721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ed3c483-2bce-4050-a2d4-4e3f4eb73f2d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:22.856424 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ed3c483-2bce-4050-a2d4-4e3f4eb73f2d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:22.856913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ed3c483-2bce-4050-a2d4-4e3f4eb73f2d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:22.857343 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ed3c483-2bce-4050-a2d4-4e3f4eb73f2d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:23.003144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4ed3c483-2bce-4050-a2d4-4e3f4eb73f2d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:23.011881 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4ed3c483-2bce-4050-a2d4-4e3f4eb73f2d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1549 microversion: 2.1 time: 0.181399 Oct 29 03:48:23.012472 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3557/6889] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:22 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1549 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:23.035071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-030e3985-6e77-4e8c-82a3-c699097f3d82 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:23.035621 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-030e3985-6e77-4e8c-82a3-c699097f3d82 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:23.037484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:48:23.044146 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-030e3985-6e77-4e8c-82a3-c699097f3d82 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:23.044682 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-030e3985-6e77-4e8c-82a3-c699097f3d82 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:23.045133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-030e3985-6e77-4e8c-82a3-c699097f3d82 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:23.045854 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-030e3985-6e77-4e8c-82a3-c699097f3d82 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:23.046326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-030e3985-6e77-4e8c-82a3-c699097f3d82 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:23.046749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-030e3985-6e77-4e8c-82a3-c699097f3d82 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:23.130437 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-030e3985-6e77-4e8c-82a3-c699097f3d82 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099022 Oct 29 03:48:23.131245 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3333/6890] 10.222.0.46 () {58 vars in 1275 bytes} [Sat Oct 29 03:48:23 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:48:24.091714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-02497cf5-4c07-4086-9efd-ef975da10985 req-2e111c77-fd1f-4943-ac9b-406538535c7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48d6b81f-1325-4b73-a0b3-cfa3ca179d70", "tag": "2c4ddbcd-1564-4790-a283-65f9bf20292e"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:48:24.102274 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-02497cf5-4c07-4086-9efd-ef975da10985 req-2e111c77-fd1f-4943-ac9b-406538535c7f service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:24.102837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-02497cf5-4c07-4086-9efd-ef975da10985 req-2e111c77-fd1f-4943-ac9b-406538535c7f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:24.103278 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-02497cf5-4c07-4086-9efd-ef975da10985 req-2e111c77-fd1f-4943-ac9b-406538535c7f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:24.114977 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-02497cf5-4c07-4086-9efd-ef975da10985 req-2e111c77-fd1f-4943-ac9b-406538535c7f service nova] Creating event network-changed:2c4ddbcd-1564-4790-a283-65f9bf20292e for instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 on n-h2-862967-2 Oct 29 03:48:24.120699 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-02497cf5-4c07-4086-9efd-ef975da10985 req-2e111c77-fd1f-4943-ac9b-406538535c7f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033494 Oct 29 03:48:24.121442 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3558/6891] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:48:58.362850 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=17 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:48:58.363793 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=70 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:48:58.368479 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3b6ea512-f7c4-49f8-a1fa-360fb99d81bb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:48:58.369144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3b6ea512-f7c4-49f8-a1fa-360fb99d81bb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:58.376419 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b6ea512-f7c4-49f8-a1fa-360fb99d81bb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:58.376984 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b6ea512-f7c4-49f8-a1fa-360fb99d81bb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:58.377439 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b6ea512-f7c4-49f8-a1fa-360fb99d81bb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:58.378160 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b6ea512-f7c4-49f8-a1fa-360fb99d81bb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:58.378643 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b6ea512-f7c4-49f8-a1fa-360fb99d81bb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:58.379084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3b6ea512-f7c4-49f8-a1fa-360fb99d81bb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:58.583758 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3b6ea512-f7c4-49f8-a1fa-360fb99d81bb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:48:58.592159 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3b6ea512-f7c4-49f8-a1fa-360fb99d81bb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1668 microversion: 2.1 time: 0.232699 Oct 29 03:48:58.592740 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3334/6892] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:48:58 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1668 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:48:58.614478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:48:58.615284 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=39,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:48:58.620930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-14a9dc31-6d24-409d-a449-0c9cb06e830d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6aae47f3-94c9-488b-b3ed-50523cfed743"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:48:58.623399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-14a9dc31-6d24-409d-a449-0c9cb06e830d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:48:58.631945 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14a9dc31-6d24-409d-a449-0c9cb06e830d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:58.632423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14a9dc31-6d24-409d-a449-0c9cb06e830d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:58.632877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14a9dc31-6d24-409d-a449-0c9cb06e830d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:58.633564 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14a9dc31-6d24-409d-a449-0c9cb06e830d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:48:58.634010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14a9dc31-6d24-409d-a449-0c9cb06e830d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:48:58.634429 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-14a9dc31-6d24-409d-a449-0c9cb06e830d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:48:59.117804 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-14a9dc31-6d24-409d-a449-0c9cb06e830d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "POST /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.504959 Oct 29 03:48:59.118452 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3559/6893] 10.222.0.46 () {60 vars in 1323 bytes} [Sat Oct 29 03:48:58 2022] POST /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70/os-volume_attachments => generated 194 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:49:09.898558 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9931e0a3-cdf7-452a-b041-839596f0cdca tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:49:09.901128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9931e0a3-cdf7-452a-b041-839596f0cdca tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:09.904031 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:49:09.904734 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:49:09.910881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9931e0a3-cdf7-452a-b041-839596f0cdca tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:09.911414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9931e0a3-cdf7-452a-b041-839596f0cdca tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:09.911871 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9931e0a3-cdf7-452a-b041-839596f0cdca tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:09.912622 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9931e0a3-cdf7-452a-b041-839596f0cdca tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:09.913086 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9931e0a3-cdf7-452a-b041-839596f0cdca tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:09.913640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9931e0a3-cdf7-452a-b041-839596f0cdca tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:09.944957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9931e0a3-cdf7-452a-b041-839596f0cdca tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:09.950966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9931e0a3-cdf7-452a-b041-839596f0cdca tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Old instance type m1.heat2, new instance type m1.heat {{(pid=127125) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 03:49:09.958635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-9931e0a3-cdf7-452a-b041-839596f0cdca tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:49:09.959055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-9931e0a3-cdf7-452a-b041-839596f0cdca tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:49:09.959536 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-9931e0a3-cdf7-452a-b041-839596f0cdca tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:49:09.959948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-9931e0a3-cdf7-452a-b041-839596f0cdca tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:49:09.960363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-9931e0a3-cdf7-452a-b041-839596f0cdca tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:49:10.030384 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9931e0a3-cdf7-452a-b041-839596f0cdca tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "POST /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70/action" status: 202 len: 0 microversion: 2.1 time: 0.135753 Oct 29 03:49:10.031225 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3335/6894] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:49:09 2022] POST /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:49:10.037414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:49:10.038344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:49:10.042305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0577dd2a-6619-4321-8b3e-4b19cd28692a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:10.043042 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0577dd2a-6619-4321-8b3e-4b19cd28692a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:10.050463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0577dd2a-6619-4321-8b3e-4b19cd28692a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:10.050958 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0577dd2a-6619-4321-8b3e-4b19cd28692a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:10.051414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0577dd2a-6619-4321-8b3e-4b19cd28692a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:10.052109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0577dd2a-6619-4321-8b3e-4b19cd28692a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:10.052594 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0577dd2a-6619-4321-8b3e-4b19cd28692a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:10.053094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0577dd2a-6619-4321-8b3e-4b19cd28692a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:10.192547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0577dd2a-6619-4321-8b3e-4b19cd28692a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:10.201046 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0577dd2a-6619-4321-8b3e-4b19cd28692a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1723 microversion: 2.1 time: 0.165571 Oct 29 03:49:10.201649 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3560/6895] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:10 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:11.228940 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-83c70313-a1f0-4eb7-a5f8-4423c962daa3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:11.229551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-83c70313-a1f0-4eb7-a5f8-4423c962daa3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:11.237183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83c70313-a1f0-4eb7-a5f8-4423c962daa3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:11.237674 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83c70313-a1f0-4eb7-a5f8-4423c962daa3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:11.238116 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83c70313-a1f0-4eb7-a5f8-4423c962daa3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:11.238827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83c70313-a1f0-4eb7-a5f8-4423c962daa3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:11.239291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83c70313-a1f0-4eb7-a5f8-4423c962daa3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:11.239736 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-83c70313-a1f0-4eb7-a5f8-4423c962daa3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:11.392237 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-83c70313-a1f0-4eb7-a5f8-4423c962daa3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:11.401038 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-83c70313-a1f0-4eb7-a5f8-4423c962daa3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1723 microversion: 2.1 time: 0.178591 Oct 29 03:49:11.401604 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3336/6896] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:11 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:12.425315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4bafdc53-498e-4f7a-a351-2edc5d9fa38e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:12.425933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4bafdc53-498e-4f7a-a351-2edc5d9fa38e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:12.433935 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bafdc53-498e-4f7a-a351-2edc5d9fa38e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:12.434432 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bafdc53-498e-4f7a-a351-2edc5d9fa38e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:12.434870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bafdc53-498e-4f7a-a351-2edc5d9fa38e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:12.435585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bafdc53-498e-4f7a-a351-2edc5d9fa38e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:12.436031 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bafdc53-498e-4f7a-a351-2edc5d9fa38e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:12.436457 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4bafdc53-498e-4f7a-a351-2edc5d9fa38e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:12.581128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4bafdc53-498e-4f7a-a351-2edc5d9fa38e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:12.590214 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4bafdc53-498e-4f7a-a351-2edc5d9fa38e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1728 microversion: 2.1 time: 0.169011 Oct 29 03:49:12.590816 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3561/6897] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:12 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:13.619046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e6b82876-3c35-4dc8-a415-e758fb859009 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:13.620086 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e6b82876-3c35-4dc8-a415-e758fb859009 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:13.631785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6b82876-3c35-4dc8-a415-e758fb859009 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:13.632754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6b82876-3c35-4dc8-a415-e758fb859009 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:13.633215 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6b82876-3c35-4dc8-a415-e758fb859009 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:13.633940 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6b82876-3c35-4dc8-a415-e758fb859009 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:13.634409 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6b82876-3c35-4dc8-a415-e758fb859009 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:13.634857 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e6b82876-3c35-4dc8-a415-e758fb859009 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:13.780873 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e6b82876-3c35-4dc8-a415-e758fb859009 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:13.789771 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e6b82876-3c35-4dc8-a415-e758fb859009 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1728 microversion: 2.1 time: 0.177827 Oct 29 03:49:13.790373 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3337/6898] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:13 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:14.817938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a973c7ea-ed8c-42f5-a5fc-7de31c352e11 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:14.818937 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a973c7ea-ed8c-42f5-a5fc-7de31c352e11 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:14.830586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a973c7ea-ed8c-42f5-a5fc-7de31c352e11 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:14.831384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a973c7ea-ed8c-42f5-a5fc-7de31c352e11 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:14.832113 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a973c7ea-ed8c-42f5-a5fc-7de31c352e11 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:14.833346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a973c7ea-ed8c-42f5-a5fc-7de31c352e11 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:14.834099 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a973c7ea-ed8c-42f5-a5fc-7de31c352e11 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:14.834807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a973c7ea-ed8c-42f5-a5fc-7de31c352e11 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:14.967829 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a973c7ea-ed8c-42f5-a5fc-7de31c352e11 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:14.976618 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a973c7ea-ed8c-42f5-a5fc-7de31c352e11 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1728 microversion: 2.1 time: 0.165332 Oct 29 03:49:14.977199 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3562/6899] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:14 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:16.077533 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3ba59558-f2b3-4a03-9517-4b4d5ea7b6de tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:16.077533 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3ba59558-f2b3-4a03-9517-4b4d5ea7b6de tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:16.084342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ba59558-f2b3-4a03-9517-4b4d5ea7b6de tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:16.084892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ba59558-f2b3-4a03-9517-4b4d5ea7b6de tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:16.085368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ba59558-f2b3-4a03-9517-4b4d5ea7b6de tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:16.086090 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ba59558-f2b3-4a03-9517-4b4d5ea7b6de tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:16.086562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ba59558-f2b3-4a03-9517-4b4d5ea7b6de tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:16.087006 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ba59558-f2b3-4a03-9517-4b4d5ea7b6de tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:16.230820 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3ba59558-f2b3-4a03-9517-4b4d5ea7b6de tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:16.244096 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3ba59558-f2b3-4a03-9517-4b4d5ea7b6de tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1728 microversion: 2.1 time: 0.236247 Oct 29 03:49:16.244693 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3338/6900] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:16 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1728 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:17.280070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-28f43f66-521b-4f4b-85c2-0505ef599b10 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:17.280862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-28f43f66-521b-4f4b-85c2-0505ef599b10 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:17.288297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-28f43f66-521b-4f4b-85c2-0505ef599b10 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:17.289454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-28f43f66-521b-4f4b-85c2-0505ef599b10 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:17.289961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-28f43f66-521b-4f4b-85c2-0505ef599b10 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:17.290582 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-28f43f66-521b-4f4b-85c2-0505ef599b10 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:17.291256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-28f43f66-521b-4f4b-85c2-0505ef599b10 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:17.291683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-28f43f66-521b-4f4b-85c2-0505ef599b10 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:17.443694 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-28f43f66-521b-4f4b-85c2-0505ef599b10 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:17.452733 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-28f43f66-521b-4f4b-85c2-0505ef599b10 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1728 microversion: 2.1 time: 0.176628 Oct 29 03:49:17.453330 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3563/6901] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:17 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:18.483387 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-be9d4a4e-fb73-4587-9676-82b4f9c8138a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:18.485347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-be9d4a4e-fb73-4587-9676-82b4f9c8138a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:18.497924 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be9d4a4e-fb73-4587-9676-82b4f9c8138a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:18.498447 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be9d4a4e-fb73-4587-9676-82b4f9c8138a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:18.498927 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be9d4a4e-fb73-4587-9676-82b4f9c8138a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:18.499649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be9d4a4e-fb73-4587-9676-82b4f9c8138a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:18.500117 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be9d4a4e-fb73-4587-9676-82b4f9c8138a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:18.500644 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be9d4a4e-fb73-4587-9676-82b4f9c8138a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:18.635382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-be9d4a4e-fb73-4587-9676-82b4f9c8138a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:18.644497 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-be9d4a4e-fb73-4587-9676-82b4f9c8138a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1728 microversion: 2.1 time: 0.169818 Oct 29 03:49:18.645138 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3339/6902] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:18 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:19.671840 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0461fdc7-5e42-423b-bae4-95a7295838f6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:19.672948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0461fdc7-5e42-423b-bae4-95a7295838f6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:19.684395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0461fdc7-5e42-423b-bae4-95a7295838f6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:19.684925 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0461fdc7-5e42-423b-bae4-95a7295838f6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:19.685363 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0461fdc7-5e42-423b-bae4-95a7295838f6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:19.686057 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0461fdc7-5e42-423b-bae4-95a7295838f6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:19.686507 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0461fdc7-5e42-423b-bae4-95a7295838f6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:19.686936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0461fdc7-5e42-423b-bae4-95a7295838f6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:19.824075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0461fdc7-5e42-423b-bae4-95a7295838f6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:19.833177 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0461fdc7-5e42-423b-bae4-95a7295838f6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1728 microversion: 2.1 time: 0.168005 Oct 29 03:49:19.833765 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3564/6903] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:19 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:20.861522 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-acf4c52d-9041-4928-9340-6f5025e26bca tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:20.862629 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-acf4c52d-9041-4928-9340-6f5025e26bca tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:20.872826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-acf4c52d-9041-4928-9340-6f5025e26bca tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:20.873556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-acf4c52d-9041-4928-9340-6f5025e26bca tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:20.874227 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-acf4c52d-9041-4928-9340-6f5025e26bca tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:20.875227 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-acf4c52d-9041-4928-9340-6f5025e26bca tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:20.875903 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-acf4c52d-9041-4928-9340-6f5025e26bca tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:20.876677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-acf4c52d-9041-4928-9340-6f5025e26bca tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:21.020270 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-acf4c52d-9041-4928-9340-6f5025e26bca tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:21.033669 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-acf4c52d-9041-4928-9340-6f5025e26bca tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1728 microversion: 2.1 time: 0.178409 Oct 29 03:49:21.034381 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3340/6904] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:20 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:22.061523 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a2a2824b-a069-4ab2-9046-037bdf2af94f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:22.062340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a2a2824b-a069-4ab2-9046-037bdf2af94f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:22.078439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2a2824b-a069-4ab2-9046-037bdf2af94f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:22.079008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2a2824b-a069-4ab2-9046-037bdf2af94f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:22.079450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2a2824b-a069-4ab2-9046-037bdf2af94f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:22.080176 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2a2824b-a069-4ab2-9046-037bdf2af94f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:22.080650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2a2824b-a069-4ab2-9046-037bdf2af94f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:22.081086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a2a2824b-a069-4ab2-9046-037bdf2af94f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:22.215130 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a2a2824b-a069-4ab2-9046-037bdf2af94f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:22.223772 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a2a2824b-a069-4ab2-9046-037bdf2af94f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1728 microversion: 2.1 time: 0.166346 Oct 29 03:49:22.224350 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3565/6905] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:22 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:23.259151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f1fb2789-c022-42dd-9dbe-a37684d0ac4e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:23.259767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f1fb2789-c022-42dd-9dbe-a37684d0ac4e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:23.268281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1fb2789-c022-42dd-9dbe-a37684d0ac4e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:23.268809 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1fb2789-c022-42dd-9dbe-a37684d0ac4e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:23.269258 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1fb2789-c022-42dd-9dbe-a37684d0ac4e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:23.269998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1fb2789-c022-42dd-9dbe-a37684d0ac4e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:23.270514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1fb2789-c022-42dd-9dbe-a37684d0ac4e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:23.270955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f1fb2789-c022-42dd-9dbe-a37684d0ac4e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:23.417092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f1fb2789-c022-42dd-9dbe-a37684d0ac4e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:23.429121 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f1fb2789-c022-42dd-9dbe-a37684d0ac4e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1728 microversion: 2.1 time: 0.176446 Oct 29 03:49:23.429825 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3341/6906] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:23 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:24.455651 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-95e8d488-5273-46b5-87fd-79cd9152cfdf tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:24.456368 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-95e8d488-5273-46b5-87fd-79cd9152cfdf tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:24.465753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95e8d488-5273-46b5-87fd-79cd9152cfdf tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:24.466465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95e8d488-5273-46b5-87fd-79cd9152cfdf tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:24.466881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95e8d488-5273-46b5-87fd-79cd9152cfdf tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:24.467623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95e8d488-5273-46b5-87fd-79cd9152cfdf tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:24.468080 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95e8d488-5273-46b5-87fd-79cd9152cfdf tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:24.468513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95e8d488-5273-46b5-87fd-79cd9152cfdf tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:24.617758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-95e8d488-5273-46b5-87fd-79cd9152cfdf tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:24.626643 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-95e8d488-5273-46b5-87fd-79cd9152cfdf tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1728 microversion: 2.1 time: 0.176347 Oct 29 03:49:24.628172 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3566/6907] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:24 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:25.652099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-49aea063-25e6-443e-b7b2-7c7d77edbc2f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:25.652782 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-49aea063-25e6-443e-b7b2-7c7d77edbc2f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:25.660410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-49aea063-25e6-443e-b7b2-7c7d77edbc2f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:25.660953 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-49aea063-25e6-443e-b7b2-7c7d77edbc2f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:25.661400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-49aea063-25e6-443e-b7b2-7c7d77edbc2f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:25.662101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-49aea063-25e6-443e-b7b2-7c7d77edbc2f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:25.662563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-49aea063-25e6-443e-b7b2-7c7d77edbc2f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:25.662993 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-49aea063-25e6-443e-b7b2-7c7d77edbc2f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:25.810694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-49aea063-25e6-443e-b7b2-7c7d77edbc2f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:25.819276 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-49aea063-25e6-443e-b7b2-7c7d77edbc2f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1728 microversion: 2.1 time: 0.171468 Oct 29 03:49:25.819832 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3342/6908] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:25 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:26.847018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7aa7d8d8-4cc0-46f3-81b7-2fab444cf718 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:26.847854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7aa7d8d8-4cc0-46f3-81b7-2fab444cf718 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:26.859151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7aa7d8d8-4cc0-46f3-81b7-2fab444cf718 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:26.859635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7aa7d8d8-4cc0-46f3-81b7-2fab444cf718 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:26.860065 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7aa7d8d8-4cc0-46f3-81b7-2fab444cf718 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:26.860821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7aa7d8d8-4cc0-46f3-81b7-2fab444cf718 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:26.861329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7aa7d8d8-4cc0-46f3-81b7-2fab444cf718 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:26.861670 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7aa7d8d8-4cc0-46f3-81b7-2fab444cf718 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:27.003647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7aa7d8d8-4cc0-46f3-81b7-2fab444cf718 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:27.013476 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7aa7d8d8-4cc0-46f3-81b7-2fab444cf718 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1728 microversion: 2.1 time: 0.173228 Oct 29 03:49:27.014089 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3567/6909] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:26 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:28.040910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-241b818b-1426-431b-bec2-258831ac8215 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:28.041715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-241b818b-1426-431b-bec2-258831ac8215 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:28.050654 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-241b818b-1426-431b-bec2-258831ac8215 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:28.051288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-241b818b-1426-431b-bec2-258831ac8215 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:28.051851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-241b818b-1426-431b-bec2-258831ac8215 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:28.052799 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-241b818b-1426-431b-bec2-258831ac8215 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:28.053388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-241b818b-1426-431b-bec2-258831ac8215 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:28.053940 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-241b818b-1426-431b-bec2-258831ac8215 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:28.192469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-241b818b-1426-431b-bec2-258831ac8215 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:28.201552 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-241b818b-1426-431b-bec2-258831ac8215 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1728 microversion: 2.1 time: 0.165978 Oct 29 03:49:28.202141 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3343/6910] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:28 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:29.228107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-868ab866-8aa7-47f7-af14-0a53ef1c57a7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:29.228904 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-868ab866-8aa7-47f7-af14-0a53ef1c57a7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:29.237655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-868ab866-8aa7-47f7-af14-0a53ef1c57a7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:29.238136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-868ab866-8aa7-47f7-af14-0a53ef1c57a7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:29.238577 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-868ab866-8aa7-47f7-af14-0a53ef1c57a7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:29.239283 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-868ab866-8aa7-47f7-af14-0a53ef1c57a7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:29.239750 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-868ab866-8aa7-47f7-af14-0a53ef1c57a7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:29.240170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-868ab866-8aa7-47f7-af14-0a53ef1c57a7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:29.383177 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-868ab866-8aa7-47f7-af14-0a53ef1c57a7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:29.392001 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-868ab866-8aa7-47f7-af14-0a53ef1c57a7 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1728 microversion: 2.1 time: 0.169473 Oct 29 03:49:29.392616 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3568/6911] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:29 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:30.418126 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-24a265a1-f009-4fb1-b580-3170261f352f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:30.418767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-24a265a1-f009-4fb1-b580-3170261f352f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:30.426343 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24a265a1-f009-4fb1-b580-3170261f352f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:30.426856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24a265a1-f009-4fb1-b580-3170261f352f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:30.427306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24a265a1-f009-4fb1-b580-3170261f352f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:30.428037 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24a265a1-f009-4fb1-b580-3170261f352f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:30.428504 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24a265a1-f009-4fb1-b580-3170261f352f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:30.428990 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-24a265a1-f009-4fb1-b580-3170261f352f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:30.585017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-24a265a1-f009-4fb1-b580-3170261f352f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:30.593915 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-24a265a1-f009-4fb1-b580-3170261f352f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1728 microversion: 2.1 time: 0.179841 Oct 29 03:49:30.594731 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3344/6912] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:30 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:31.618984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e4a2c97a-1bd9-4fca-bdf6-e8b73c1468d9 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:31.619571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e4a2c97a-1bd9-4fca-bdf6-e8b73c1468d9 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:31.626916 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e4a2c97a-1bd9-4fca-bdf6-e8b73c1468d9 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:31.627501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e4a2c97a-1bd9-4fca-bdf6-e8b73c1468d9 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:31.628015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e4a2c97a-1bd9-4fca-bdf6-e8b73c1468d9 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:31.628749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e4a2c97a-1bd9-4fca-bdf6-e8b73c1468d9 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:31.629205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e4a2c97a-1bd9-4fca-bdf6-e8b73c1468d9 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:31.629630 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e4a2c97a-1bd9-4fca-bdf6-e8b73c1468d9 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:31.764755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e4a2c97a-1bd9-4fca-bdf6-e8b73c1468d9 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:31.773576 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e4a2c97a-1bd9-4fca-bdf6-e8b73c1468d9 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1727 microversion: 2.1 time: 0.159294 Oct 29 03:49:31.774188 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3569/6913] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:31 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:31.879844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-d32599b5-e4b3-40e7-8a70-080b6d2a3a56 req-cf9e9c02-f804-408c-931d-614f37819377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d6b81f-1325-4b73-a0b3-cfa3ca179d70", "name": "network-vif-unplugged", "status": "completed", "tag": "2c4ddbcd-1564-4790-a283-65f9bf20292e"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:49:31.889834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d32599b5-e4b3-40e7-8a70-080b6d2a3a56 req-cf9e9c02-f804-408c-931d-614f37819377 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:31.890519 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d32599b5-e4b3-40e7-8a70-080b6d2a3a56 req-cf9e9c02-f804-408c-931d-614f37819377 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:31.891168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d32599b5-e4b3-40e7-8a70-080b6d2a3a56 req-cf9e9c02-f804-408c-931d-614f37819377 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:31.903752 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-d32599b5-e4b3-40e7-8a70-080b6d2a3a56 req-cf9e9c02-f804-408c-931d-614f37819377 service nova] Creating event network-vif-unplugged:2c4ddbcd-1564-4790-a283-65f9bf20292e for instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 on n-h1-862967-2 Oct 29 03:49:31.909586 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [req-d32599b5-e4b3-40e7-8a70-080b6d2a3a56 req-cf9e9c02-f804-408c-931d-614f37819377 service nova] Instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:49:31.921941 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-d32599b5-e4b3-40e7-8a70-080b6d2a3a56 req-cf9e9c02-f804-408c-931d-614f37819377 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102769 Oct 29 03:49:31.923039 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3345/6914] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:49:32.798665 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4e11942a-d47a-4fb7-9793-9d51c787acae tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:32.799238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4e11942a-d47a-4fb7-9793-9d51c787acae tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:32.806306 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e11942a-d47a-4fb7-9793-9d51c787acae tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:32.806802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e11942a-d47a-4fb7-9793-9d51c787acae tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:32.807268 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e11942a-d47a-4fb7-9793-9d51c787acae tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:32.807986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e11942a-d47a-4fb7-9793-9d51c787acae tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:32.808401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e11942a-d47a-4fb7-9793-9d51c787acae tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:32.808874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e11942a-d47a-4fb7-9793-9d51c787acae tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:32.945257 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4e11942a-d47a-4fb7-9793-9d51c787acae tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:32.954277 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4e11942a-d47a-4fb7-9793-9d51c787acae tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1727 microversion: 2.1 time: 0.159967 Oct 29 03:49:32.954870 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3570/6915] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:32 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:33.943153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-b2b5a1df-bd9b-46f7-816a-dd6bfc19a6cf req-ca652820-b728-43e1-a597-e6471d790eae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48d6b81f-1325-4b73-a0b3-cfa3ca179d70", "tag": "2c4ddbcd-1564-4790-a283-65f9bf20292e"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:49:33.954411 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b2b5a1df-bd9b-46f7-816a-dd6bfc19a6cf req-ca652820-b728-43e1-a597-e6471d790eae service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:33.954908 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b2b5a1df-bd9b-46f7-816a-dd6bfc19a6cf req-ca652820-b728-43e1-a597-e6471d790eae service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:33.955360 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b2b5a1df-bd9b-46f7-816a-dd6bfc19a6cf req-ca652820-b728-43e1-a597-e6471d790eae service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:33.967754 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-b2b5a1df-bd9b-46f7-816a-dd6bfc19a6cf req-ca652820-b728-43e1-a597-e6471d790eae service nova] Creating event network-changed:2c4ddbcd-1564-4790-a283-65f9bf20292e for instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 on n-h1-862967-2 Oct 29 03:49:33.973562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [req-b2b5a1df-bd9b-46f7-816a-dd6bfc19a6cf req-ca652820-b728-43e1-a597-e6471d790eae service nova] Instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:49:33.978323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c3f38691-111d-4f25-bfb7-d7285f1af7a6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:33.979054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c3f38691-111d-4f25-bfb7-d7285f1af7a6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:33.984695 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-b2b5a1df-bd9b-46f7-816a-dd6bfc19a6cf req-ca652820-b728-43e1-a597-e6471d790eae service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045693 Oct 29 03:49:33.985489 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3346/6916] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:49:33.989839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3f38691-111d-4f25-bfb7-d7285f1af7a6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:33.990408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3f38691-111d-4f25-bfb7-d7285f1af7a6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:33.990947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3f38691-111d-4f25-bfb7-d7285f1af7a6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:33.991763 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3f38691-111d-4f25-bfb7-d7285f1af7a6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:33.992688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3f38691-111d-4f25-bfb7-d7285f1af7a6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:33.993227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c3f38691-111d-4f25-bfb7-d7285f1af7a6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:34.229078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c3f38691-111d-4f25-bfb7-d7285f1af7a6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:34.240197 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c3f38691-111d-4f25-bfb7-d7285f1af7a6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1725 microversion: 2.1 time: 0.265417 Oct 29 03:49:34.241854 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3571/6917] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:33 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1725 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:35.266662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-031b55f8-4cbc-418d-90bd-459e5c21fc73 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:35.267382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-031b55f8-4cbc-418d-90bd-459e5c21fc73 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:35.273936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-031b55f8-4cbc-418d-90bd-459e5c21fc73 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:35.274447 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-031b55f8-4cbc-418d-90bd-459e5c21fc73 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:35.274889 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-031b55f8-4cbc-418d-90bd-459e5c21fc73 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:35.275606 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-031b55f8-4cbc-418d-90bd-459e5c21fc73 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:35.276088 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-031b55f8-4cbc-418d-90bd-459e5c21fc73 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:35.276515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-031b55f8-4cbc-418d-90bd-459e5c21fc73 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:35.415564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-031b55f8-4cbc-418d-90bd-459e5c21fc73 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:35.424623 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-031b55f8-4cbc-418d-90bd-459e5c21fc73 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1725 microversion: 2.1 time: 0.163162 Oct 29 03:49:35.425188 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3347/6918] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:35 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:36.449483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-587cd84d-2124-404a-8239-5d757f6ba569 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:36.450128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-587cd84d-2124-404a-8239-5d757f6ba569 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:36.457815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-587cd84d-2124-404a-8239-5d757f6ba569 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:36.458310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-587cd84d-2124-404a-8239-5d757f6ba569 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:36.458749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-587cd84d-2124-404a-8239-5d757f6ba569 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:36.459459 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-587cd84d-2124-404a-8239-5d757f6ba569 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:36.459910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-587cd84d-2124-404a-8239-5d757f6ba569 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:36.460333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-587cd84d-2124-404a-8239-5d757f6ba569 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:36.597538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-587cd84d-2124-404a-8239-5d757f6ba569 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:36.606193 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-587cd84d-2124-404a-8239-5d757f6ba569 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1725 microversion: 2.1 time: 0.160987 Oct 29 03:49:36.607014 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3572/6919] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:36 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:37.631372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8de8314c-8334-43da-8ac1-c22c1bf4a2c4 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:37.632032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8de8314c-8334-43da-8ac1-c22c1bf4a2c4 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:37.639366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8de8314c-8334-43da-8ac1-c22c1bf4a2c4 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:37.639866 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8de8314c-8334-43da-8ac1-c22c1bf4a2c4 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:37.640312 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8de8314c-8334-43da-8ac1-c22c1bf4a2c4 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:37.641052 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8de8314c-8334-43da-8ac1-c22c1bf4a2c4 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:37.641513 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8de8314c-8334-43da-8ac1-c22c1bf4a2c4 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:37.641949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8de8314c-8334-43da-8ac1-c22c1bf4a2c4 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:37.784948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8de8314c-8334-43da-8ac1-c22c1bf4a2c4 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:37.793387 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8de8314c-8334-43da-8ac1-c22c1bf4a2c4 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1725 microversion: 2.1 time: 0.166114 Oct 29 03:49:37.794162 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3348/6920] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:37 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:38.819051 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e2b78db1-0d5d-4b32-93e9-8c7fa92e51c5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:38.819654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e2b78db1-0d5d-4b32-93e9-8c7fa92e51c5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:38.827143 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e2b78db1-0d5d-4b32-93e9-8c7fa92e51c5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:38.827628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e2b78db1-0d5d-4b32-93e9-8c7fa92e51c5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:38.828061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e2b78db1-0d5d-4b32-93e9-8c7fa92e51c5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:38.828801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e2b78db1-0d5d-4b32-93e9-8c7fa92e51c5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:38.829259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e2b78db1-0d5d-4b32-93e9-8c7fa92e51c5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:38.829687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e2b78db1-0d5d-4b32-93e9-8c7fa92e51c5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:38.986400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e2b78db1-0d5d-4b32-93e9-8c7fa92e51c5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:38.995896 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e2b78db1-0d5d-4b32-93e9-8c7fa92e51c5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1725 microversion: 2.1 time: 0.180958 Oct 29 03:49:38.996484 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3573/6921] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:38 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:40.021002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5a23b77b-b0e0-4bff-9e3b-181cabd63f6f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:40.021611 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5a23b77b-b0e0-4bff-9e3b-181cabd63f6f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:40.024554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=33 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:49:40.030284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a23b77b-b0e0-4bff-9e3b-181cabd63f6f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:40.030804 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a23b77b-b0e0-4bff-9e3b-181cabd63f6f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:40.031268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a23b77b-b0e0-4bff-9e3b-181cabd63f6f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:40.032001 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a23b77b-b0e0-4bff-9e3b-181cabd63f6f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:40.032477 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a23b77b-b0e0-4bff-9e3b-181cabd63f6f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:40.032938 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a23b77b-b0e0-4bff-9e3b-181cabd63f6f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:40.036111 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:49:40.492995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5a23b77b-b0e0-4bff-9e3b-181cabd63f6f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:40.501897 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5a23b77b-b0e0-4bff-9e3b-181cabd63f6f tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1725 microversion: 2.1 time: 0.484921 Oct 29 03:49:40.502609 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3349/6922] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:40 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1725 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:41.528570 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fff98fc4-cbfc-4557-b5f1-275fdae9f9b5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:41.529154 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fff98fc4-cbfc-4557-b5f1-275fdae9f9b5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:41.532777 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=29 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:49:41.538942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fff98fc4-cbfc-4557-b5f1-275fdae9f9b5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:41.539502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fff98fc4-cbfc-4557-b5f1-275fdae9f9b5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:41.540073 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fff98fc4-cbfc-4557-b5f1-275fdae9f9b5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:41.540968 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fff98fc4-cbfc-4557-b5f1-275fdae9f9b5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:41.541572 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fff98fc4-cbfc-4557-b5f1-275fdae9f9b5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:41.542050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fff98fc4-cbfc-4557-b5f1-275fdae9f9b5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:41.545144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=85 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:49:41.677408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fff98fc4-cbfc-4557-b5f1-275fdae9f9b5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:41.686216 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fff98fc4-cbfc-4557-b5f1-275fdae9f9b5 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1725 microversion: 2.1 time: 0.164199 Oct 29 03:49:41.686795 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3574/6923] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:41 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:42.710494 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9a69141b-1c58-440c-89c4-896ec0bea640 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:42.711150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9a69141b-1c58-440c-89c4-896ec0bea640 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:42.718569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a69141b-1c58-440c-89c4-896ec0bea640 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:42.719348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a69141b-1c58-440c-89c4-896ec0bea640 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:42.719798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a69141b-1c58-440c-89c4-896ec0bea640 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:42.720511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a69141b-1c58-440c-89c4-896ec0bea640 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:42.720977 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a69141b-1c58-440c-89c4-896ec0bea640 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:42.721443 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a69141b-1c58-440c-89c4-896ec0bea640 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:42.853113 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9a69141b-1c58-440c-89c4-896ec0bea640 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:42.861553 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9a69141b-1c58-440c-89c4-896ec0bea640 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1725 microversion: 2.1 time: 0.155276 Oct 29 03:49:42.862217 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3350/6924] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:42 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:43.886491 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0276ac9b-abe2-463e-b3bb-47194e1f20b2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:43.887116 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0276ac9b-abe2-463e-b3bb-47194e1f20b2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:43.894610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0276ac9b-abe2-463e-b3bb-47194e1f20b2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:43.895115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0276ac9b-abe2-463e-b3bb-47194e1f20b2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:43.895558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0276ac9b-abe2-463e-b3bb-47194e1f20b2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:43.896266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0276ac9b-abe2-463e-b3bb-47194e1f20b2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:43.896765 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0276ac9b-abe2-463e-b3bb-47194e1f20b2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:43.897196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0276ac9b-abe2-463e-b3bb-47194e1f20b2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:44.038691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0276ac9b-abe2-463e-b3bb-47194e1f20b2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:44.048020 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0276ac9b-abe2-463e-b3bb-47194e1f20b2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1725 microversion: 2.1 time: 0.165472 Oct 29 03:49:44.048707 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3575/6925] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:43 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:45.072515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ae164d5e-51c1-4b43-b3cf-099bdfee9680 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:45.073321 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ae164d5e-51c1-4b43-b3cf-099bdfee9680 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:45.081354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae164d5e-51c1-4b43-b3cf-099bdfee9680 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:45.081861 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae164d5e-51c1-4b43-b3cf-099bdfee9680 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:45.082311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae164d5e-51c1-4b43-b3cf-099bdfee9680 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:45.083117 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae164d5e-51c1-4b43-b3cf-099bdfee9680 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:45.083623 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae164d5e-51c1-4b43-b3cf-099bdfee9680 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:45.084060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae164d5e-51c1-4b43-b3cf-099bdfee9680 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:45.249584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ae164d5e-51c1-4b43-b3cf-099bdfee9680 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:45.259005 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ae164d5e-51c1-4b43-b3cf-099bdfee9680 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1725 microversion: 2.1 time: 0.190635 Oct 29 03:49:45.259617 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3351/6926] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:45 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:46.290022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ddf940ba-2a0a-47ec-ae9f-caae1dd72bee tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:46.290595 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ddf940ba-2a0a-47ec-ae9f-caae1dd72bee tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:46.298186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ddf940ba-2a0a-47ec-ae9f-caae1dd72bee tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:46.298685 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ddf940ba-2a0a-47ec-ae9f-caae1dd72bee tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:46.299136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ddf940ba-2a0a-47ec-ae9f-caae1dd72bee tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:46.299847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ddf940ba-2a0a-47ec-ae9f-caae1dd72bee tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:46.300352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ddf940ba-2a0a-47ec-ae9f-caae1dd72bee tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:46.300816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ddf940ba-2a0a-47ec-ae9f-caae1dd72bee tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:46.438207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ddf940ba-2a0a-47ec-ae9f-caae1dd72bee tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:46.446743 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ddf940ba-2a0a-47ec-ae9f-caae1dd72bee tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1722 microversion: 2.1 time: 0.160822 Oct 29 03:49:46.447326 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3576/6927] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:46 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:46.473888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a35bc322-3fee-4a00-ad74-06810d15e469 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:49:46.474509 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a35bc322-3fee-4a00-ad74-06810d15e469 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:46.481864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a35bc322-3fee-4a00-ad74-06810d15e469 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:46.482371 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a35bc322-3fee-4a00-ad74-06810d15e469 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:46.482819 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a35bc322-3fee-4a00-ad74-06810d15e469 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:46.483533 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a35bc322-3fee-4a00-ad74-06810d15e469 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:46.484001 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a35bc322-3fee-4a00-ad74-06810d15e469 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:46.484436 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a35bc322-3fee-4a00-ad74-06810d15e469 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:46.524372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a35bc322-3fee-4a00-ad74-06810d15e469 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:46.524894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a35bc322-3fee-4a00-ad74-06810d15e469 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:46.525341 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a35bc322-3fee-4a00-ad74-06810d15e469 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:46.526071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a35bc322-3fee-4a00-ad74-06810d15e469 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:46.526584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a35bc322-3fee-4a00-ad74-06810d15e469 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:46.527017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a35bc322-3fee-4a00-ad74-06810d15e469 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:46.549846 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-a35bc322-3fee-4a00-ad74-06810d15e469 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Getting quotas for project 2e19c07467824bbfbc0715c6085c40e6. Resources: {'cores', 'ram'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:49:46.555330 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-a35bc322-3fee-4a00-ad74-06810d15e469 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Getting quotas for user fd4c00a472474521add76167023ab141 and project 2e19c07467824bbfbc0715c6085c40e6. Resources: {'cores', 'ram'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:49:46.664269 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a35bc322-3fee-4a00-ad74-06810d15e469 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "POST /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70/action" status: 202 len: 0 microversion: 2.1 time: 0.193738 Oct 29 03:49:46.665072 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3352/6928] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:49:46 2022] POST /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:49:46.673614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-774ab5ca-e28a-401e-a6dc-83d81db6eecd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:46.674276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-774ab5ca-e28a-401e-a6dc-83d81db6eecd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:46.680517 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-774ab5ca-e28a-401e-a6dc-83d81db6eecd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:46.681045 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-774ab5ca-e28a-401e-a6dc-83d81db6eecd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:46.681482 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-774ab5ca-e28a-401e-a6dc-83d81db6eecd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:46.682182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-774ab5ca-e28a-401e-a6dc-83d81db6eecd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:46.682636 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-774ab5ca-e28a-401e-a6dc-83d81db6eecd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:46.683062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-774ab5ca-e28a-401e-a6dc-83d81db6eecd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:46.825144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-774ab5ca-e28a-401e-a6dc-83d81db6eecd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:46.834198 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-774ab5ca-e28a-401e-a6dc-83d81db6eecd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1721 microversion: 2.1 time: 0.164481 Oct 29 03:49:46.834842 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3577/6929] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:46 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:47.094204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-d61f4d54-9f46-445b-8df5-88891aba27aa req-841dce57-993e-4b49-aa3b-b72a167741e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d6b81f-1325-4b73-a0b3-cfa3ca179d70", "name": "network-vif-plugged", "status": "completed", "tag": "2c4ddbcd-1564-4790-a283-65f9bf20292e"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:49:47.106971 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d61f4d54-9f46-445b-8df5-88891aba27aa req-841dce57-993e-4b49-aa3b-b72a167741e7 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:47.107660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d61f4d54-9f46-445b-8df5-88891aba27aa req-841dce57-993e-4b49-aa3b-b72a167741e7 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:47.108106 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-d61f4d54-9f46-445b-8df5-88891aba27aa req-841dce57-993e-4b49-aa3b-b72a167741e7 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:47.121075 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-d61f4d54-9f46-445b-8df5-88891aba27aa req-841dce57-993e-4b49-aa3b-b72a167741e7 service nova] Creating event network-vif-plugged:2c4ddbcd-1564-4790-a283-65f9bf20292e for instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 on n-h1-862967-2 Oct 29 03:49:47.127331 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [req-d61f4d54-9f46-445b-8df5-88891aba27aa req-841dce57-993e-4b49-aa3b-b72a167741e7 service nova] Instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:49:47.139067 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-d61f4d54-9f46-445b-8df5-88891aba27aa req-841dce57-993e-4b49-aa3b-b72a167741e7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121247 Oct 29 03:49:47.139764 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3353/6930] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:49:47.861210 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7076dd9a-9211-476e-aebb-0d16133fbd40 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:47.862234 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7076dd9a-9211-476e-aebb-0d16133fbd40 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:47.870120 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7076dd9a-9211-476e-aebb-0d16133fbd40 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:47.870617 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7076dd9a-9211-476e-aebb-0d16133fbd40 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:47.871069 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7076dd9a-9211-476e-aebb-0d16133fbd40 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:47.871776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7076dd9a-9211-476e-aebb-0d16133fbd40 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:47.872236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7076dd9a-9211-476e-aebb-0d16133fbd40 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:47.872701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7076dd9a-9211-476e-aebb-0d16133fbd40 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:48.018592 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7076dd9a-9211-476e-aebb-0d16133fbd40 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:48.027638 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7076dd9a-9211-476e-aebb-0d16133fbd40 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1721 microversion: 2.1 time: 0.172991 Oct 29 03:49:48.028218 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3578/6931] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:47 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:49.055621 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-19c1450c-a8e8-46e1-8bbc-47eec8b568c8 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:49.056360 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-19c1450c-a8e8-46e1-8bbc-47eec8b568c8 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:49.063773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19c1450c-a8e8-46e1-8bbc-47eec8b568c8 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:49.064683 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19c1450c-a8e8-46e1-8bbc-47eec8b568c8 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:49.065160 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19c1450c-a8e8-46e1-8bbc-47eec8b568c8 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:49.066028 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19c1450c-a8e8-46e1-8bbc-47eec8b568c8 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:49.066396 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19c1450c-a8e8-46e1-8bbc-47eec8b568c8 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:49.067020 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-19c1450c-a8e8-46e1-8bbc-47eec8b568c8 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:49.216331 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-19c1450c-a8e8-46e1-8bbc-47eec8b568c8 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:49.225319 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-19c1450c-a8e8-46e1-8bbc-47eec8b568c8 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1721 microversion: 2.1 time: 0.175202 Oct 29 03:49:49.225907 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3354/6932] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:49 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:50.249447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4f40d7bc-ac7b-491a-9130-9e642a329fd6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:50.250185 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4f40d7bc-ac7b-491a-9130-9e642a329fd6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:50.257594 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f40d7bc-ac7b-491a-9130-9e642a329fd6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:50.258092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f40d7bc-ac7b-491a-9130-9e642a329fd6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:50.258532 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f40d7bc-ac7b-491a-9130-9e642a329fd6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:50.259239 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f40d7bc-ac7b-491a-9130-9e642a329fd6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:50.259701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f40d7bc-ac7b-491a-9130-9e642a329fd6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:50.260259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4f40d7bc-ac7b-491a-9130-9e642a329fd6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:50.396422 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4f40d7bc-ac7b-491a-9130-9e642a329fd6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:50.405123 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4f40d7bc-ac7b-491a-9130-9e642a329fd6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1721 microversion: 2.1 time: 0.159697 Oct 29 03:49:50.405704 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3579/6933] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:50 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:51.430713 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6ed5f42a-e7df-4c82-a20d-eaada23f12e0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:51.432007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6ed5f42a-e7df-4c82-a20d-eaada23f12e0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:51.441702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ed5f42a-e7df-4c82-a20d-eaada23f12e0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:51.442171 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ed5f42a-e7df-4c82-a20d-eaada23f12e0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:51.442778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ed5f42a-e7df-4c82-a20d-eaada23f12e0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:51.443501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ed5f42a-e7df-4c82-a20d-eaada23f12e0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:51.443962 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ed5f42a-e7df-4c82-a20d-eaada23f12e0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:51.444405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6ed5f42a-e7df-4c82-a20d-eaada23f12e0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:51.601302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6ed5f42a-e7df-4c82-a20d-eaada23f12e0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:51.610918 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6ed5f42a-e7df-4c82-a20d-eaada23f12e0 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1721 microversion: 2.1 time: 0.185372 Oct 29 03:49:51.611519 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3355/6934] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:51 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:52.215727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-3e30dfcd-296f-4f09-a2ad-50f8eee3e439 req-0850947b-67fe-443c-b9fe-0725c674dfee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d6b81f-1325-4b73-a0b3-cfa3ca179d70", "name": "network-vif-unplugged", "status": "completed", "tag": "2c4ddbcd-1564-4790-a283-65f9bf20292e"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:49:52.227027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3e30dfcd-296f-4f09-a2ad-50f8eee3e439 req-0850947b-67fe-443c-b9fe-0725c674dfee service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:52.227520 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3e30dfcd-296f-4f09-a2ad-50f8eee3e439 req-0850947b-67fe-443c-b9fe-0725c674dfee service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:52.227977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3e30dfcd-296f-4f09-a2ad-50f8eee3e439 req-0850947b-67fe-443c-b9fe-0725c674dfee service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:52.241075 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-3e30dfcd-296f-4f09-a2ad-50f8eee3e439 req-0850947b-67fe-443c-b9fe-0725c674dfee service nova] Creating event network-vif-unplugged:2c4ddbcd-1564-4790-a283-65f9bf20292e for instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 on n-h2-862967-2 Oct 29 03:49:52.247251 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [req-3e30dfcd-296f-4f09-a2ad-50f8eee3e439 req-0850947b-67fe-443c-b9fe-0725c674dfee service nova] Instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:49:52.259056 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-3e30dfcd-296f-4f09-a2ad-50f8eee3e439 req-0850947b-67fe-443c-b9fe-0725c674dfee service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109583 Oct 29 03:49:52.259860 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3580/6935] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:49:52.635717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-97db7848-c947-47e0-8ed6-2948f8b2e69b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:52.636692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-97db7848-c947-47e0-8ed6-2948f8b2e69b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:52.643748 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-97db7848-c947-47e0-8ed6-2948f8b2e69b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:52.644252 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-97db7848-c947-47e0-8ed6-2948f8b2e69b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:52.644749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-97db7848-c947-47e0-8ed6-2948f8b2e69b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:52.645467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-97db7848-c947-47e0-8ed6-2948f8b2e69b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:52.645930 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-97db7848-c947-47e0-8ed6-2948f8b2e69b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:52.646391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-97db7848-c947-47e0-8ed6-2948f8b2e69b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:52.783328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-97db7848-c947-47e0-8ed6-2948f8b2e69b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:52.793271 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-97db7848-c947-47e0-8ed6-2948f8b2e69b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1721 microversion: 2.1 time: 0.161574 Oct 29 03:49:52.793867 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3356/6936] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:52 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:49:53.819255 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fc8fdc3b-a8f8-427c-a9db-a47b36d2a212 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:53.819967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fc8fdc3b-a8f8-427c-a9db-a47b36d2a212 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:53.827129 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc8fdc3b-a8f8-427c-a9db-a47b36d2a212 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:53.827661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc8fdc3b-a8f8-427c-a9db-a47b36d2a212 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:53.828588 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc8fdc3b-a8f8-427c-a9db-a47b36d2a212 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:53.829146 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc8fdc3b-a8f8-427c-a9db-a47b36d2a212 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:53.829609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc8fdc3b-a8f8-427c-a9db-a47b36d2a212 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:53.830040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fc8fdc3b-a8f8-427c-a9db-a47b36d2a212 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:53.972046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fc8fdc3b-a8f8-427c-a9db-a47b36d2a212 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:53.981378 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fc8fdc3b-a8f8-427c-a9db-a47b36d2a212 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1721 microversion: 2.1 time: 0.167379 Oct 29 03:49:53.982048 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3581/6937] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:53 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:54.276312 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-14c62f12-a4f8-4ab2-94e4-860fe3765ddd req-58e31f68-fb63-471d-b20c-8081a299512b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48d6b81f-1325-4b73-a0b3-cfa3ca179d70", "tag": "2c4ddbcd-1564-4790-a283-65f9bf20292e"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:49:54.287140 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-14c62f12-a4f8-4ab2-94e4-860fe3765ddd req-58e31f68-fb63-471d-b20c-8081a299512b service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:54.287644 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-14c62f12-a4f8-4ab2-94e4-860fe3765ddd req-58e31f68-fb63-471d-b20c-8081a299512b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:54.288081 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-14c62f12-a4f8-4ab2-94e4-860fe3765ddd req-58e31f68-fb63-471d-b20c-8081a299512b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:54.300461 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-14c62f12-a4f8-4ab2-94e4-860fe3765ddd req-58e31f68-fb63-471d-b20c-8081a299512b service nova] Creating event network-changed:2c4ddbcd-1564-4790-a283-65f9bf20292e for instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 on n-h2-862967-2 Oct 29 03:49:54.306080 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [req-14c62f12-a4f8-4ab2-94e4-860fe3765ddd req-58e31f68-fb63-471d-b20c-8081a299512b service nova] Instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 03:49:54.317557 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-14c62f12-a4f8-4ab2-94e4-860fe3765ddd req-58e31f68-fb63-471d-b20c-8081a299512b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044989 Oct 29 03:49:54.318168 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3357/6938] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:49:55.006513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2e49b6e9-6c95-4593-8a07-2c72c2798a47 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:55.007124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2e49b6e9-6c95-4593-8a07-2c72c2798a47 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:55.014439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e49b6e9-6c95-4593-8a07-2c72c2798a47 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:55.014931 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e49b6e9-6c95-4593-8a07-2c72c2798a47 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:55.015369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e49b6e9-6c95-4593-8a07-2c72c2798a47 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:55.016078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e49b6e9-6c95-4593-8a07-2c72c2798a47 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:55.016503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e49b6e9-6c95-4593-8a07-2c72c2798a47 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:55.016982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2e49b6e9-6c95-4593-8a07-2c72c2798a47 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:55.163052 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2e49b6e9-6c95-4593-8a07-2c72c2798a47 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:55.172089 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2e49b6e9-6c95-4593-8a07-2c72c2798a47 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1721 microversion: 2.1 time: 0.169742 Oct 29 03:49:55.172851 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3582/6939] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:55 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:56.198172 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-104a363a-2ff5-43dc-b378-50d1d54d7787 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:56.199066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-104a363a-2ff5-43dc-b378-50d1d54d7787 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:56.207040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-104a363a-2ff5-43dc-b378-50d1d54d7787 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:56.207369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-104a363a-2ff5-43dc-b378-50d1d54d7787 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:56.207926 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-104a363a-2ff5-43dc-b378-50d1d54d7787 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:56.209004 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-104a363a-2ff5-43dc-b378-50d1d54d7787 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:56.209635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-104a363a-2ff5-43dc-b378-50d1d54d7787 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:56.210250 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-104a363a-2ff5-43dc-b378-50d1d54d7787 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:56.369108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-104a363a-2ff5-43dc-b378-50d1d54d7787 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:56.381925 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-104a363a-2ff5-43dc-b378-50d1d54d7787 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1721 microversion: 2.1 time: 0.189593 Oct 29 03:49:56.382981 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3358/6940] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:56 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:57.406650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0ea8f007-4498-4f45-9dcc-0cf477e8e238 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:57.407427 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0ea8f007-4498-4f45-9dcc-0cf477e8e238 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:57.414908 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ea8f007-4498-4f45-9dcc-0cf477e8e238 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:57.415484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ea8f007-4498-4f45-9dcc-0cf477e8e238 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:57.415932 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ea8f007-4498-4f45-9dcc-0cf477e8e238 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:57.416713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ea8f007-4498-4f45-9dcc-0cf477e8e238 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:57.417175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ea8f007-4498-4f45-9dcc-0cf477e8e238 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:57.417609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0ea8f007-4498-4f45-9dcc-0cf477e8e238 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:57.552870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0ea8f007-4498-4f45-9dcc-0cf477e8e238 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:57.561774 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0ea8f007-4498-4f45-9dcc-0cf477e8e238 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1721 microversion: 2.1 time: 0.159372 Oct 29 03:49:57.562351 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3583/6941] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:57 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:58.586958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5caf55bf-2f01-4dcc-94d6-8d4fa377d289 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:58.587553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5caf55bf-2f01-4dcc-94d6-8d4fa377d289 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:58.589607 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:49:58.596040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5caf55bf-2f01-4dcc-94d6-8d4fa377d289 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:58.596543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5caf55bf-2f01-4dcc-94d6-8d4fa377d289 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:58.597073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5caf55bf-2f01-4dcc-94d6-8d4fa377d289 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:58.598010 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5caf55bf-2f01-4dcc-94d6-8d4fa377d289 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:58.598478 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5caf55bf-2f01-4dcc-94d6-8d4fa377d289 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:58.598939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5caf55bf-2f01-4dcc-94d6-8d4fa377d289 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:58.736875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5caf55bf-2f01-4dcc-94d6-8d4fa377d289 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:58.746004 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5caf55bf-2f01-4dcc-94d6-8d4fa377d289 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1721 microversion: 2.1 time: 0.163106 Oct 29 03:49:58.746612 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3359/6942] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:58 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:49:59.771641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4e949db1-cf33-464e-a2ac-579019c13062 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:49:59.772253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4e949db1-cf33-464e-a2ac-579019c13062 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:49:59.779906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e949db1-cf33-464e-a2ac-579019c13062 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:59.780396 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e949db1-cf33-464e-a2ac-579019c13062 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:59.780862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e949db1-cf33-464e-a2ac-579019c13062 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:59.781558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e949db1-cf33-464e-a2ac-579019c13062 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:49:59.782013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e949db1-cf33-464e-a2ac-579019c13062 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:49:59.782434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4e949db1-cf33-464e-a2ac-579019c13062 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:49:59.914221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4e949db1-cf33-464e-a2ac-579019c13062 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:49:59.922721 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4e949db1-cf33-464e-a2ac-579019c13062 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1721 microversion: 2.1 time: 0.155156 Oct 29 03:49:59.923300 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3584/6943] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:49:59 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:00.947243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4795d587-9faf-4cda-b7a3-81899941275d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:00.947954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4795d587-9faf-4cda-b7a3-81899941275d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:00.955423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4795d587-9faf-4cda-b7a3-81899941275d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:00.955923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4795d587-9faf-4cda-b7a3-81899941275d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:00.956365 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4795d587-9faf-4cda-b7a3-81899941275d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:00.957105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4795d587-9faf-4cda-b7a3-81899941275d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:00.957569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4795d587-9faf-4cda-b7a3-81899941275d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:00.958003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4795d587-9faf-4cda-b7a3-81899941275d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:01.099299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4795d587-9faf-4cda-b7a3-81899941275d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:01.108080 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4795d587-9faf-4cda-b7a3-81899941275d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1721 microversion: 2.1 time: 0.165017 Oct 29 03:50:01.108732 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3360/6944] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:00 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:02.132942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-83f95ef9-a493-40a5-b1ed-ed9425f71d1e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:02.133576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-83f95ef9-a493-40a5-b1ed-ed9425f71d1e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:02.140961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83f95ef9-a493-40a5-b1ed-ed9425f71d1e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:02.141454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83f95ef9-a493-40a5-b1ed-ed9425f71d1e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:02.141898 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83f95ef9-a493-40a5-b1ed-ed9425f71d1e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:02.142599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83f95ef9-a493-40a5-b1ed-ed9425f71d1e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:02.143060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83f95ef9-a493-40a5-b1ed-ed9425f71d1e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:02.143491 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83f95ef9-a493-40a5-b1ed-ed9425f71d1e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:02.281536 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-83f95ef9-a493-40a5-b1ed-ed9425f71d1e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:02.290307 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-83f95ef9-a493-40a5-b1ed-ed9425f71d1e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1721 microversion: 2.1 time: 0.161738 Oct 29 03:50:02.290893 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3585/6945] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:02 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:03.314487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bdaf4465-f293-4a0e-8c22-fb56d49226df tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:03.315082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bdaf4465-f293-4a0e-8c22-fb56d49226df tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:03.322479 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bdaf4465-f293-4a0e-8c22-fb56d49226df tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:03.322895 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bdaf4465-f293-4a0e-8c22-fb56d49226df tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:03.323338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bdaf4465-f293-4a0e-8c22-fb56d49226df tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:03.324044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bdaf4465-f293-4a0e-8c22-fb56d49226df tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:03.324510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bdaf4465-f293-4a0e-8c22-fb56d49226df tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:03.324970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bdaf4465-f293-4a0e-8c22-fb56d49226df tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:03.457303 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bdaf4465-f293-4a0e-8c22-fb56d49226df tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:03.465748 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bdaf4465-f293-4a0e-8c22-fb56d49226df tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1721 microversion: 2.1 time: 0.155304 Oct 29 03:50:03.466315 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3361/6946] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:03 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:04.494895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5e05a67f-8cb3-4831-8bb2-6ce6552afe22 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:04.495499 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5e05a67f-8cb3-4831-8bb2-6ce6552afe22 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:04.502953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e05a67f-8cb3-4831-8bb2-6ce6552afe22 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:04.503441 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e05a67f-8cb3-4831-8bb2-6ce6552afe22 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:04.503870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e05a67f-8cb3-4831-8bb2-6ce6552afe22 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:04.504673 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e05a67f-8cb3-4831-8bb2-6ce6552afe22 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:04.505125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e05a67f-8cb3-4831-8bb2-6ce6552afe22 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:04.505552 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5e05a67f-8cb3-4831-8bb2-6ce6552afe22 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:04.641184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5e05a67f-8cb3-4831-8bb2-6ce6552afe22 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:04.650410 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5e05a67f-8cb3-4831-8bb2-6ce6552afe22 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1721 microversion: 2.1 time: 0.159945 Oct 29 03:50:04.651135 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3586/6947] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:04 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:05.677341 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c51d2917-bc9d-46ee-befb-38b02ec9088b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:05.677957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c51d2917-bc9d-46ee-befb-38b02ec9088b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:05.685134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c51d2917-bc9d-46ee-befb-38b02ec9088b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:05.685631 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c51d2917-bc9d-46ee-befb-38b02ec9088b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:05.686070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c51d2917-bc9d-46ee-befb-38b02ec9088b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:05.686788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c51d2917-bc9d-46ee-befb-38b02ec9088b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:05.687252 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c51d2917-bc9d-46ee-befb-38b02ec9088b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:05.687692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c51d2917-bc9d-46ee-befb-38b02ec9088b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:05.824572 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c51d2917-bc9d-46ee-befb-38b02ec9088b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:05.833368 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c51d2917-bc9d-46ee-befb-38b02ec9088b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1714 microversion: 2.1 time: 0.161978 Oct 29 03:50:05.834008 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3362/6948] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:05 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1714 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:05.858930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-90d02417-18b0-4243-997d-bbba097df39c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:05.859708 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-90d02417-18b0-4243-997d-bbba097df39c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:05.867513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-90d02417-18b0-4243-997d-bbba097df39c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:05.868040 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-90d02417-18b0-4243-997d-bbba097df39c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:05.868487 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-90d02417-18b0-4243-997d-bbba097df39c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:05.869233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-90d02417-18b0-4243-997d-bbba097df39c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:05.869698 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-90d02417-18b0-4243-997d-bbba097df39c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:05.870135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-90d02417-18b0-4243-997d-bbba097df39c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:06.012948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-90d02417-18b0-4243-997d-bbba097df39c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:06.021982 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-90d02417-18b0-4243-997d-bbba097df39c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1714 microversion: 2.1 time: 0.169066 Oct 29 03:50:06.022574 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3587/6949] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:05 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1714 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:06.046541 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-48c5c792-0f30-4a94-a9f7-549833d25c4c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:06.047241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-48c5c792-0f30-4a94-a9f7-549833d25c4c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:06.053823 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48c5c792-0f30-4a94-a9f7-549833d25c4c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:06.054368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48c5c792-0f30-4a94-a9f7-549833d25c4c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:06.054815 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48c5c792-0f30-4a94-a9f7-549833d25c4c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:06.055528 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48c5c792-0f30-4a94-a9f7-549833d25c4c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:06.055992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48c5c792-0f30-4a94-a9f7-549833d25c4c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:06.056454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-48c5c792-0f30-4a94-a9f7-549833d25c4c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:06.071879 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:50:06.189785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-48c5c792-0f30-4a94-a9f7-549833d25c4c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:06.202450 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-48c5c792-0f30-4a94-a9f7-549833d25c4c tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1714 microversion: 2.1 time: 0.159922 Oct 29 03:50:06.203118 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3363/6950] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:06 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1714 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:06.227315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fe225b87-1a2b-4184-a4df-ffa6fb90a389 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:06.227815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fe225b87-1a2b-4184-a4df-ffa6fb90a389 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:06.233949 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fe225b87-1a2b-4184-a4df-ffa6fb90a389 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:06.234444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fe225b87-1a2b-4184-a4df-ffa6fb90a389 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:06.234881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fe225b87-1a2b-4184-a4df-ffa6fb90a389 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:06.235577 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fe225b87-1a2b-4184-a4df-ffa6fb90a389 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:06.236030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fe225b87-1a2b-4184-a4df-ffa6fb90a389 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:06.236455 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fe225b87-1a2b-4184-a4df-ffa6fb90a389 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:06.261821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fe225b87-1a2b-4184-a4df-ffa6fb90a389 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:50:06.347633 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fe225b87-1a2b-4184-a4df-ffa6fb90a389 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "DELETE /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 204 len: 0 microversion: 2.1 time: 0.123978 Oct 29 03:50:06.348264 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3588/6951] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:50:06 2022] DELETE /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:50:06.357856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3837c052-f05b-4f37-b753-100224968232 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:06.358909 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3837c052-f05b-4f37-b753-100224968232 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:06.365506 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3837c052-f05b-4f37-b753-100224968232 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:06.366016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3837c052-f05b-4f37-b753-100224968232 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:06.366472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3837c052-f05b-4f37-b753-100224968232 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:06.367550 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3837c052-f05b-4f37-b753-100224968232 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:06.368022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3837c052-f05b-4f37-b753-100224968232 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:06.368468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3837c052-f05b-4f37-b753-100224968232 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:06.507932 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3837c052-f05b-4f37-b753-100224968232 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:06.516850 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3837c052-f05b-4f37-b753-100224968232 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1720 microversion: 2.1 time: 0.163438 Oct 29 03:50:06.517477 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3364/6952] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:06 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:07.093901 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-df7de0bb-ac38-4118-9418-a4d0cc11824b req-7abd20b1-cda8-49b0-ae69-79c0c030eaf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d6b81f-1325-4b73-a0b3-cfa3ca179d70", "name": "network-vif-plugged", "status": "completed", "tag": "2c4ddbcd-1564-4790-a283-65f9bf20292e"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:50:07.106325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-df7de0bb-ac38-4118-9418-a4d0cc11824b req-7abd20b1-cda8-49b0-ae69-79c0c030eaf0 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:07.106817 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-df7de0bb-ac38-4118-9418-a4d0cc11824b req-7abd20b1-cda8-49b0-ae69-79c0c030eaf0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:07.107253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-df7de0bb-ac38-4118-9418-a4d0cc11824b req-7abd20b1-cda8-49b0-ae69-79c0c030eaf0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:07.118626 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-df7de0bb-ac38-4118-9418-a4d0cc11824b req-7abd20b1-cda8-49b0-ae69-79c0c030eaf0 service nova] Creating event network-vif-plugged:2c4ddbcd-1564-4790-a283-65f9bf20292e for instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 on n-h2-862967-2 Oct 29 03:50:07.123706 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-df7de0bb-ac38-4118-9418-a4d0cc11824b req-7abd20b1-cda8-49b0-ae69-79c0c030eaf0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033915 Oct 29 03:50:07.124580 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3589/6953] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:50:07.541722 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cadd58ed-f83c-48bd-a6cc-f7b730c0d40b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:07.542487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cadd58ed-f83c-48bd-a6cc-f7b730c0d40b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:07.549575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cadd58ed-f83c-48bd-a6cc-f7b730c0d40b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:07.550072 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cadd58ed-f83c-48bd-a6cc-f7b730c0d40b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:07.550539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cadd58ed-f83c-48bd-a6cc-f7b730c0d40b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:07.551246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cadd58ed-f83c-48bd-a6cc-f7b730c0d40b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:07.551710 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cadd58ed-f83c-48bd-a6cc-f7b730c0d40b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:07.552144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cadd58ed-f83c-48bd-a6cc-f7b730c0d40b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:07.688551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cadd58ed-f83c-48bd-a6cc-f7b730c0d40b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:07.697555 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cadd58ed-f83c-48bd-a6cc-f7b730c0d40b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1720 microversion: 2.1 time: 0.159968 Oct 29 03:50:07.698154 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3365/6954] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:07 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:08.723014 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-462463a1-630a-4f1f-9a67-59b316e95a4e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:08.723953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-462463a1-630a-4f1f-9a67-59b316e95a4e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:08.733003 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-462463a1-630a-4f1f-9a67-59b316e95a4e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:08.734748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-462463a1-630a-4f1f-9a67-59b316e95a4e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:08.734748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-462463a1-630a-4f1f-9a67-59b316e95a4e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:08.735146 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-462463a1-630a-4f1f-9a67-59b316e95a4e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:08.735615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-462463a1-630a-4f1f-9a67-59b316e95a4e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:08.736105 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-462463a1-630a-4f1f-9a67-59b316e95a4e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:08.742512 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:50:08.811817 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-462463a1-630a-4f1f-9a67-59b316e95a4e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:08.820711 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-462463a1-630a-4f1f-9a67-59b316e95a4e tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1654 microversion: 2.1 time: 0.102911 Oct 29 03:50:08.821628 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3590/6955] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:08 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1654 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:09.062935 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-ffdbc292-9557-49c3-8496-dbef769e365c req-22f56869-0e98-4451-9e8c-838c03248842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48d6b81f-1325-4b73-a0b3-cfa3ca179d70", "name": "network-vif-deleted", "tag": "2c4ddbcd-1564-4790-a283-65f9bf20292e"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:50:09.081942 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ffdbc292-9557-49c3-8496-dbef769e365c req-22f56869-0e98-4451-9e8c-838c03248842 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:09.082350 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ffdbc292-9557-49c3-8496-dbef769e365c req-22f56869-0e98-4451-9e8c-838c03248842 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:09.082795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ffdbc292-9557-49c3-8496-dbef769e365c req-22f56869-0e98-4451-9e8c-838c03248842 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:09.096955 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-ffdbc292-9557-49c3-8496-dbef769e365c req-22f56869-0e98-4451-9e8c-838c03248842 service nova] Creating event network-vif-deleted:2c4ddbcd-1564-4790-a283-65f9bf20292e for instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 on n-h2-862967-2 Oct 29 03:50:09.103940 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-ffdbc292-9557-49c3-8496-dbef769e365c req-22f56869-0e98-4451-9e8c-838c03248842 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050093 Oct 29 03:50:09.104820 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3366/6956] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:50:09.854082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9f18bdcb-f07c-426d-9a9b-ae4a2fb8e24a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:09.854713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9f18bdcb-f07c-426d-9a9b-ae4a2fb8e24a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:09.862405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f18bdcb-f07c-426d-9a9b-ae4a2fb8e24a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:09.862912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f18bdcb-f07c-426d-9a9b-ae4a2fb8e24a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:09.863402 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f18bdcb-f07c-426d-9a9b-ae4a2fb8e24a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:09.864142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f18bdcb-f07c-426d-9a9b-ae4a2fb8e24a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:09.864630 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f18bdcb-f07c-426d-9a9b-ae4a2fb8e24a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:09.865081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f18bdcb-f07c-426d-9a9b-ae4a2fb8e24a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:09.940362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9f18bdcb-f07c-426d-9a9b-ae4a2fb8e24a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:09.949683 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9f18bdcb-f07c-426d-9a9b-ae4a2fb8e24a tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1368 microversion: 2.1 time: 0.108109 Oct 29 03:50:09.950290 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3591/6957] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:09 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1368 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:10.977023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d5768808-c74c-4140-9116-2b6d3493b2a2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:10.977842 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d5768808-c74c-4140-9116-2b6d3493b2a2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:10.979798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:50:10.986363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5768808-c74c-4140-9116-2b6d3493b2a2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:10.986916 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5768808-c74c-4140-9116-2b6d3493b2a2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:10.987310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5768808-c74c-4140-9116-2b6d3493b2a2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:10.988026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5768808-c74c-4140-9116-2b6d3493b2a2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:10.988647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5768808-c74c-4140-9116-2b6d3493b2a2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:10.989172 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5768808-c74c-4140-9116-2b6d3493b2a2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:11.061999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d5768808-c74c-4140-9116-2b6d3493b2a2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:11.071446 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d5768808-c74c-4140-9116-2b6d3493b2a2 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1368 microversion: 2.1 time: 0.100498 Oct 29 03:50:11.072051 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3367/6958] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:10 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:12.095182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2f6a3ac3-5bb5-42dc-8ef6-e8bfa9c7625b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:12.095784 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2f6a3ac3-5bb5-42dc-8ef6-e8bfa9c7625b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:12.098708 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:50:12.104943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f6a3ac3-5bb5-42dc-8ef6-e8bfa9c7625b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:12.105465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f6a3ac3-5bb5-42dc-8ef6-e8bfa9c7625b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:12.105904 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f6a3ac3-5bb5-42dc-8ef6-e8bfa9c7625b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:12.106624 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f6a3ac3-5bb5-42dc-8ef6-e8bfa9c7625b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:12.107081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f6a3ac3-5bb5-42dc-8ef6-e8bfa9c7625b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:12.107509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2f6a3ac3-5bb5-42dc-8ef6-e8bfa9c7625b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:12.173572 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2f6a3ac3-5bb5-42dc-8ef6-e8bfa9c7625b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:12.182773 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2f6a3ac3-5bb5-42dc-8ef6-e8bfa9c7625b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1368 microversion: 2.1 time: 0.091670 Oct 29 03:50:12.183740 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3592/6959] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:12 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:13.206527 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-153c61c4-eb78-4a79-83ad-9ed7a16051fe tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:13.207339 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-153c61c4-eb78-4a79-83ad-9ed7a16051fe tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:13.216254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-153c61c4-eb78-4a79-83ad-9ed7a16051fe tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:13.216931 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-153c61c4-eb78-4a79-83ad-9ed7a16051fe tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:13.217481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-153c61c4-eb78-4a79-83ad-9ed7a16051fe tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:13.218307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-153c61c4-eb78-4a79-83ad-9ed7a16051fe tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:13.218867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-153c61c4-eb78-4a79-83ad-9ed7a16051fe tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:13.219517 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-153c61c4-eb78-4a79-83ad-9ed7a16051fe tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:13.293683 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-153c61c4-eb78-4a79-83ad-9ed7a16051fe tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4c00a472474521add76167023ab141', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e19c07467824bbfbc0715c6085c40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:13.302921 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-153c61c4-eb78-4a79-83ad-9ed7a16051fe tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 200 len: 1368 microversion: 2.1 time: 0.100392 Oct 29 03:50:13.303523 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3368/6960] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:13 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:14.331208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cbc3e51c-080c-4488-9fae-0789a157027d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:14.331787 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cbc3e51c-080c-4488-9fae-0789a157027d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:14.340107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cbc3e51c-080c-4488-9fae-0789a157027d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:14.340602 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cbc3e51c-080c-4488-9fae-0789a157027d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:14.341112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cbc3e51c-080c-4488-9fae-0789a157027d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:14.341891 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cbc3e51c-080c-4488-9fae-0789a157027d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:14.342345 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cbc3e51c-080c-4488-9fae-0789a157027d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:14.342773 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cbc3e51c-080c-4488-9fae-0789a157027d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:14.357854 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-cbc3e51c-080c-4488-9fae-0789a157027d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] HTTP exception thrown: Instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 could not be found. Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cbc3e51c-080c-4488-9fae-0789a157027d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Request method failure captured: Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 HTTP/1.1 Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXKGQJeWMxfWMeM3O6gGoGSgLaotgRmZdXAA5ksXNn18BC3kYiORlqcPrpkO6hwWROtId_i3BPG3tHcLNXgo1DRLTViLVFJkr5ippTm7TWTVVrTinupx_GraljlTHrjKYi9B__lcWVv-kBGfZZl6RvbkghUGxnbsTm6q2TyI0UqnddMU Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2e19c07467824bbfbc0715c6085c40e6"}]}] Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServerActionsTestJSON-539616512 Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: fd4c00a472474521add76167023ab141 Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 could not be found. Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '48d6b81f-1325-4b73-a0b3-cfa3ca179d70'} Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 could not be found. Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 could not be found. Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:14.359532 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:14.364055 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:14.364055 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:14.364055 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:14.364055 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:50:14.364055 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:50:14.364055 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 could not be found. Oct 29 03:50:14.364055 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:14.364055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cbc3e51c-080c-4488-9fae-0789a157027d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Returning 404 to user: Instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:50:14.364055 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cbc3e51c-080c-4488-9fae-0789a157027d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 404 len: 111 microversion: 2.1 time: 0.035582 Oct 29 03:50:14.364055 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3593/6961] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:14 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:50:14.489355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-07d64887-abdb-45e9-b38b-bb02d7b525d3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:14.491810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-07d64887-abdb-45e9-b38b-bb02d7b525d3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:14.499805 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07d64887-abdb-45e9-b38b-bb02d7b525d3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:14.500382 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07d64887-abdb-45e9-b38b-bb02d7b525d3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:14.501077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07d64887-abdb-45e9-b38b-bb02d7b525d3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:14.501557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07d64887-abdb-45e9-b38b-bb02d7b525d3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:14.502022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07d64887-abdb-45e9-b38b-bb02d7b525d3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:14.502451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-07d64887-abdb-45e9-b38b-bb02d7b525d3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:14.515808 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-07d64887-abdb-45e9-b38b-bb02d7b525d3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] HTTP exception thrown: Instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 could not be found. Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-07d64887-abdb-45e9-b38b-bb02d7b525d3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Request method failure captured: Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70/os-volume_attachments HTTP/1.1 Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKGQJeWMxfWMeM3O6gGoGSgLaotgRmZdXAA5ksXNn18BC3kYiORlqcPrpkO6hwWROtId_i3BPG3tHcLNXgo1DRLTViLVFJkr5ippTm7TWTVVrTinupx_GraljlTHrjKYi9B__lcWVv-kBGfZZl6RvbkghUGxnbsTm6q2TyI0UqnddMU Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2e19c07467824bbfbc0715c6085c40e6"}]}] Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerActionsTestJSON-539616512 Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: fd4c00a472474521add76167023ab141 Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 could not be found. Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'server_id': '48d6b81f-1325-4b73-a0b3-cfa3ca179d70'} Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 could not be found. Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:50:14.517613 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:50:14.523834 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 could not be found. Oct 29 03:50:14.523834 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:14.523834 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:14.523834 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:14.523834 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:14.523834 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:14.523834 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:14.523834 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:50:14.523834 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:50:14.523834 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 could not be found. Oct 29 03:50:14.523834 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:14.523834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-07d64887-abdb-45e9-b38b-bb02d7b525d3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Returning 404 to user: Instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:50:14.523834 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-07d64887-abdb-45e9-b38b-bb02d7b525d3 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034144 Oct 29 03:50:14.523834 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3369/6962] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:50:14 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:50:17.863728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3f4a1538-e3f9-4e25-b13f-054802c5594d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:17.864799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3f4a1538-e3f9-4e25-b13f-054802c5594d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:17.872075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f4a1538-e3f9-4e25-b13f-054802c5594d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:17.872602 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f4a1538-e3f9-4e25-b13f-054802c5594d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:17.873058 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f4a1538-e3f9-4e25-b13f-054802c5594d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:17.873768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f4a1538-e3f9-4e25-b13f-054802c5594d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:17.874232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f4a1538-e3f9-4e25-b13f-054802c5594d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:17.874661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3f4a1538-e3f9-4e25-b13f-054802c5594d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:17.889824 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-3f4a1538-e3f9-4e25-b13f-054802c5594d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] HTTP exception thrown: Instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 could not be found. Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3f4a1538-e3f9-4e25-b13f-054802c5594d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Request method failure captured: Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 HTTP/1.1 Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXKGQJeWMxfWMeM3O6gGoGSgLaotgRmZdXAA5ksXNn18BC3kYiORlqcPrpkO6hwWROtId_i3BPG3tHcLNXgo1DRLTViLVFJkr5ippTm7TWTVVrTinupx_GraljlTHrjKYi9B__lcWVv-kBGfZZl6RvbkghUGxnbsTm6q2TyI0UqnddMU Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2e19c07467824bbfbc0715c6085c40e6"}]}] Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServerActionsTestJSON-539616512 Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: fd4c00a472474521add76167023ab141 Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 could not be found. Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '48d6b81f-1325-4b73-a0b3-cfa3ca179d70'} Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 could not be found. Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:50:17.891608 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:50:17.895735 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 could not be found. Oct 29 03:50:17.895735 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:17.895735 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:17.895735 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:17.895735 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:17.895735 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:17.895735 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:17.895735 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:50:17.895735 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:50:17.895735 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 could not be found. Oct 29 03:50:17.895735 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:17.895735 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3f4a1538-e3f9-4e25-b13f-054802c5594d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Returning 404 to user: Instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:50:17.895735 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3f4a1538-e3f9-4e25-b13f-054802c5594d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "DELETE /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 404 len: 111 microversion: 2.1 time: 0.033589 Oct 29 03:50:17.895735 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3594/6963] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:50:17 2022] DELETE /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:50:17.902356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dc3da6dc-ec01-4920-8879-5be4d40f710b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:17.903001 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dc3da6dc-ec01-4920-8879-5be4d40f710b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 48d6b81f-1325-4b73-a0b3-cfa3ca179d70] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:17.910487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc3da6dc-ec01-4920-8879-5be4d40f710b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:17.911007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc3da6dc-ec01-4920-8879-5be4d40f710b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:17.911453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc3da6dc-ec01-4920-8879-5be4d40f710b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:17.912187 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc3da6dc-ec01-4920-8879-5be4d40f710b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:17.912701 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc3da6dc-ec01-4920-8879-5be4d40f710b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:17.913166 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dc3da6dc-ec01-4920-8879-5be4d40f710b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:17.928141 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-dc3da6dc-ec01-4920-8879-5be4d40f710b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] HTTP exception thrown: Instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 could not be found. Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dc3da6dc-ec01-4920-8879-5be4d40f710b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Request method failure captured: Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 HTTP/1.1 Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKGQJeWMxfWMeM3O6gGoGSgLaotgRmZdXAA5ksXNn18BC3kYiORlqcPrpkO6hwWROtId_i3BPG3tHcLNXgo1DRLTViLVFJkr5ippTm7TWTVVrTinupx_GraljlTHrjKYi9B__lcWVv-kBGfZZl6RvbkghUGxnbsTm6q2TyI0UqnddMU Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2e19c07467824bbfbc0715c6085c40e6"}]}] Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerActionsTestJSON-539616512 Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: fd4c00a472474521add76167023ab141 Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 could not be found. Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '48d6b81f-1325-4b73-a0b3-cfa3ca179d70'} Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 could not be found. Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 could not be found. Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:17.929775 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:17.934030 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:17.934030 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:17.934030 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:17.934030 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:50:17.934030 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:50:17.934030 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 could not be found. Oct 29 03:50:17.934030 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:17.934030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dc3da6dc-ec01-4920-8879-5be4d40f710b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Returning 404 to user: Instance 48d6b81f-1325-4b73-a0b3-cfa3ca179d70 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:50:17.934030 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dc3da6dc-ec01-4920-8879-5be4d40f710b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70" status: 404 len: 111 microversion: 2.1 time: 0.032921 Oct 29 03:50:17.935243 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3370/6964] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:17 2022] GET /compute/v2.1/servers/48d6b81f-1325-4b73-a0b3-cfa3ca179d70 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:50:17.940479 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b5bec438-5a16-4a19-baaf-f985033f2ecb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:17.941029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b5bec438-5a16-4a19-baaf-f985033f2ecb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:17.947235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5bec438-5a16-4a19-baaf-f985033f2ecb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:17.947721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5bec438-5a16-4a19-baaf-f985033f2ecb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:17.948157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5bec438-5a16-4a19-baaf-f985033f2ecb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:17.948890 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5bec438-5a16-4a19-baaf-f985033f2ecb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:17.949374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5bec438-5a16-4a19-baaf-f985033f2ecb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:17.949796 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b5bec438-5a16-4a19-baaf-f985033f2ecb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:17.964089 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-b5bec438-5a16-4a19-baaf-f985033f2ecb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] HTTP exception thrown: Instance b035159d-9129-455b-98b5-ff1d2c90a6ec could not be found. Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b5bec438-5a16-4a19-baaf-f985033f2ecb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Request method failure captured: Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec HTTP/1.1 Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXKGQJeWMxfWMeM3O6gGoGSgLaotgRmZdXAA5ksXNn18BC3kYiORlqcPrpkO6hwWROtId_i3BPG3tHcLNXgo1DRLTViLVFJkr5ippTm7TWTVVrTinupx_GraljlTHrjKYi9B__lcWVv-kBGfZZl6RvbkghUGxnbsTm6q2TyI0UqnddMU Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2e19c07467824bbfbc0715c6085c40e6"}]}] Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServerActionsTestJSON-539616512 Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: fd4c00a472474521add76167023ab141 Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance b035159d-9129-455b-98b5-ff1d2c90a6ec could not be found. Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'b035159d-9129-455b-98b5-ff1d2c90a6ec'} Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b035159d-9129-455b-98b5-ff1d2c90a6ec could not be found. Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:50:17.965751 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:50:17.969749 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b035159d-9129-455b-98b5-ff1d2c90a6ec could not be found. Oct 29 03:50:17.969749 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:17.969749 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:17.969749 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:17.969749 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:17.969749 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:17.969749 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:17.969749 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:50:17.969749 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:50:17.969749 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b035159d-9129-455b-98b5-ff1d2c90a6ec could not be found. Oct 29 03:50:17.969749 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:17.969749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b5bec438-5a16-4a19-baaf-f985033f2ecb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Returning 404 to user: Instance b035159d-9129-455b-98b5-ff1d2c90a6ec could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:50:17.969749 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b5bec438-5a16-4a19-baaf-f985033f2ecb tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 404 len: 111 microversion: 2.1 time: 0.030755 Oct 29 03:50:17.969749 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3595/6965] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:50:17 2022] DELETE /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:50:17.976634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b7c5e491-0e18-4f7b-8d8f-0fcf898345e6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:17.977236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b7c5e491-0e18-4f7b-8d8f-0fcf898345e6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: b035159d-9129-455b-98b5-ff1d2c90a6ec] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:17.983533 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7c5e491-0e18-4f7b-8d8f-0fcf898345e6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:17.984029 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7c5e491-0e18-4f7b-8d8f-0fcf898345e6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:17.984448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7c5e491-0e18-4f7b-8d8f-0fcf898345e6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:17.985426 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7c5e491-0e18-4f7b-8d8f-0fcf898345e6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:17.985898 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7c5e491-0e18-4f7b-8d8f-0fcf898345e6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:17.986333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7c5e491-0e18-4f7b-8d8f-0fcf898345e6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:18.001352 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-b7c5e491-0e18-4f7b-8d8f-0fcf898345e6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] HTTP exception thrown: Instance b035159d-9129-455b-98b5-ff1d2c90a6ec could not be found. Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b7c5e491-0e18-4f7b-8d8f-0fcf898345e6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Request method failure captured: Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec HTTP/1.1 Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKGQJeWMxfWMeM3O6gGoGSgLaotgRmZdXAA5ksXNn18BC3kYiORlqcPrpkO6hwWROtId_i3BPG3tHcLNXgo1DRLTViLVFJkr5ippTm7TWTVVrTinupx_GraljlTHrjKYi9B__lcWVv-kBGfZZl6RvbkghUGxnbsTm6q2TyI0UqnddMU Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2e19c07467824bbfbc0715c6085c40e6"}]}] Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerActionsTestJSON-539616512 Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: fd4c00a472474521add76167023ab141 Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance b035159d-9129-455b-98b5-ff1d2c90a6ec could not be found. Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'b035159d-9129-455b-98b5-ff1d2c90a6ec'} Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b035159d-9129-455b-98b5-ff1d2c90a6ec could not be found. Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b035159d-9129-455b-98b5-ff1d2c90a6ec could not be found. Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:18.002962 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:18.010918 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:18.010918 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:18.010918 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:18.010918 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:50:18.010918 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:50:18.010918 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b035159d-9129-455b-98b5-ff1d2c90a6ec could not be found. Oct 29 03:50:18.010918 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:18.010918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b7c5e491-0e18-4f7b-8d8f-0fcf898345e6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Returning 404 to user: Instance b035159d-9129-455b-98b5-ff1d2c90a6ec could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:50:18.010918 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b7c5e491-0e18-4f7b-8d8f-0fcf898345e6 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec" status: 404 len: 111 microversion: 2.1 time: 0.031952 Oct 29 03:50:18.010918 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3371/6966] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:17 2022] GET /compute/v2.1/servers/b035159d-9129-455b-98b5-ff1d2c90a6ec => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:50:18.015401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-23a706a5-7739-4d3a-973d-8987a955606b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:18.015910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-23a706a5-7739-4d3a-973d-8987a955606b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:18.025936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23a706a5-7739-4d3a-973d-8987a955606b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:18.026475 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23a706a5-7739-4d3a-973d-8987a955606b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:18.026923 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23a706a5-7739-4d3a-973d-8987a955606b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:18.027664 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23a706a5-7739-4d3a-973d-8987a955606b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:18.028141 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23a706a5-7739-4d3a-973d-8987a955606b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:18.028729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-23a706a5-7739-4d3a-973d-8987a955606b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:18.044930 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-23a706a5-7739-4d3a-973d-8987a955606b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] HTTP exception thrown: Instance 79cc9059-3092-4668-89c8-d719e8251192 could not be found. Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-23a706a5-7739-4d3a-973d-8987a955606b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Request method failure captured: Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 HTTP/1.1 Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXKGQJeWMxfWMeM3O6gGoGSgLaotgRmZdXAA5ksXNn18BC3kYiORlqcPrpkO6hwWROtId_i3BPG3tHcLNXgo1DRLTViLVFJkr5ippTm7TWTVVrTinupx_GraljlTHrjKYi9B__lcWVv-kBGfZZl6RvbkghUGxnbsTm6q2TyI0UqnddMU Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2e19c07467824bbfbc0715c6085c40e6"}]}] Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServerActionsTestJSON-539616512 Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: fd4c00a472474521add76167023ab141 Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 79cc9059-3092-4668-89c8-d719e8251192 could not be found. Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '79cc9059-3092-4668-89c8-d719e8251192'} Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79cc9059-3092-4668-89c8-d719e8251192 could not be found. Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:50:18.046849 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:50:18.052749 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79cc9059-3092-4668-89c8-d719e8251192 could not be found. Oct 29 03:50:18.052749 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:18.052749 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:18.052749 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:18.052749 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:18.052749 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:18.052749 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:18.052749 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:50:18.052749 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:50:18.052749 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79cc9059-3092-4668-89c8-d719e8251192 could not be found. Oct 29 03:50:18.052749 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:18.052749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-23a706a5-7739-4d3a-973d-8987a955606b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Returning 404 to user: Instance 79cc9059-3092-4668-89c8-d719e8251192 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:50:18.052749 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-23a706a5-7739-4d3a-973d-8987a955606b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "DELETE /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 404 len: 111 microversion: 2.1 time: 0.037031 Oct 29 03:50:18.052749 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3596/6967] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:50:18 2022] DELETE /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:50:18.058843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0faf2619-cc7c-4d4d-9a6b-e41be7e62966 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:18.059594 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0faf2619-cc7c-4d4d-9a6b-e41be7e62966 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 79cc9059-3092-4668-89c8-d719e8251192] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:18.068066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0faf2619-cc7c-4d4d-9a6b-e41be7e62966 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:18.068714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0faf2619-cc7c-4d4d-9a6b-e41be7e62966 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:18.069166 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0faf2619-cc7c-4d4d-9a6b-e41be7e62966 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:18.069941 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0faf2619-cc7c-4d4d-9a6b-e41be7e62966 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:18.070763 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0faf2619-cc7c-4d4d-9a6b-e41be7e62966 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:18.071221 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0faf2619-cc7c-4d4d-9a6b-e41be7e62966 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:18.087341 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-0faf2619-cc7c-4d4d-9a6b-e41be7e62966 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] HTTP exception thrown: Instance 79cc9059-3092-4668-89c8-d719e8251192 could not be found. Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0faf2619-cc7c-4d4d-9a6b-e41be7e62966 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Request method failure captured: Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 HTTP/1.1 Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKGQJeWMxfWMeM3O6gGoGSgLaotgRmZdXAA5ksXNn18BC3kYiORlqcPrpkO6hwWROtId_i3BPG3tHcLNXgo1DRLTViLVFJkr5ippTm7TWTVVrTinupx_GraljlTHrjKYi9B__lcWVv-kBGfZZl6RvbkghUGxnbsTm6q2TyI0UqnddMU Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2e19c07467824bbfbc0715c6085c40e6"}]}] Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerActionsTestJSON-539616512 Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: fd4c00a472474521add76167023ab141 Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 79cc9059-3092-4668-89c8-d719e8251192 could not be found. Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '79cc9059-3092-4668-89c8-d719e8251192'} Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79cc9059-3092-4668-89c8-d719e8251192 could not be found. Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79cc9059-3092-4668-89c8-d719e8251192 could not be found. Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:18.088894 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:18.094370 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:18.094370 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:18.094370 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:18.094370 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:50:18.094370 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:50:18.094370 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79cc9059-3092-4668-89c8-d719e8251192 could not be found. Oct 29 03:50:18.094370 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:18.094370 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0faf2619-cc7c-4d4d-9a6b-e41be7e62966 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Returning 404 to user: Instance 79cc9059-3092-4668-89c8-d719e8251192 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:50:18.094370 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0faf2619-cc7c-4d4d-9a6b-e41be7e62966 tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192" status: 404 len: 111 microversion: 2.1 time: 0.035786 Oct 29 03:50:18.094370 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3372/6968] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:18 2022] GET /compute/v2.1/servers/79cc9059-3092-4668-89c8-d719e8251192 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:50:18.099571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bc7026e6-820b-4191-a05f-b81544e3e57b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:18.100078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bc7026e6-820b-4191-a05f-b81544e3e57b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:18.107828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc7026e6-820b-4191-a05f-b81544e3e57b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:18.108323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc7026e6-820b-4191-a05f-b81544e3e57b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:18.108782 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc7026e6-820b-4191-a05f-b81544e3e57b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:18.109585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc7026e6-820b-4191-a05f-b81544e3e57b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:18.109973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc7026e6-820b-4191-a05f-b81544e3e57b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:18.110493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bc7026e6-820b-4191-a05f-b81544e3e57b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:18.125961 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-bc7026e6-820b-4191-a05f-b81544e3e57b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] HTTP exception thrown: Instance 7c0ab293-18af-4f60-ba64-c3c892916738 could not be found. Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bc7026e6-820b-4191-a05f-b81544e3e57b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Request method failure captured: Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: request: DELETE /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 HTTP/1.1 Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXKGQJeWMxfWMeM3O6gGoGSgLaotgRmZdXAA5ksXNn18BC3kYiORlqcPrpkO6hwWROtId_i3BPG3tHcLNXgo1DRLTViLVFJkr5ippTm7TWTVVrTinupx_GraljlTHrjKYi9B__lcWVv-kBGfZZl6RvbkghUGxnbsTm6q2TyI0UqnddMU Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2e19c07467824bbfbc0715c6085c40e6"}]}] Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServerActionsTestJSON-539616512 Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: fd4c00a472474521add76167023ab141 Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 7c0ab293-18af-4f60-ba64-c3c892916738 could not be found. Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '7c0ab293-18af-4f60-ba64-c3c892916738'} Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c0ab293-18af-4f60-ba64-c3c892916738 could not be found. Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:50:18.127570 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:50:18.131910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c0ab293-18af-4f60-ba64-c3c892916738 could not be found. Oct 29 03:50:18.131910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:18.131910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:18.131910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:18.131910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:18.131910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:18.131910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:18.131910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:50:18.131910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:50:18.131910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c0ab293-18af-4f60-ba64-c3c892916738 could not be found. Oct 29 03:50:18.131910 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:18.131910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bc7026e6-820b-4191-a05f-b81544e3e57b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Returning 404 to user: Instance 7c0ab293-18af-4f60-ba64-c3c892916738 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:50:18.131910 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bc7026e6-820b-4191-a05f-b81544e3e57b tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 404 len: 111 microversion: 2.1 time: 0.033642 Oct 29 03:50:18.131910 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3597/6969] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:50:18 2022] DELETE /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:50:18.138002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-deb0237f-4bf6-4d7a-90ec-657b345695cd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:18.138623 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-deb0237f-4bf6-4d7a-90ec-657b345695cd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [instance: 7c0ab293-18af-4f60-ba64-c3c892916738] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:18.145603 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-deb0237f-4bf6-4d7a-90ec-657b345695cd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:18.146111 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-deb0237f-4bf6-4d7a-90ec-657b345695cd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:18.146605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-deb0237f-4bf6-4d7a-90ec-657b345695cd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:18.147292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-deb0237f-4bf6-4d7a-90ec-657b345695cd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:18.147756 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-deb0237f-4bf6-4d7a-90ec-657b345695cd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:18.148196 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-deb0237f-4bf6-4d7a-90ec-657b345695cd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:18.163191 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-deb0237f-4bf6-4d7a-90ec-657b345695cd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] HTTP exception thrown: Instance 7c0ab293-18af-4f60-ba64-c3c892916738 could not be found. Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-deb0237f-4bf6-4d7a-90ec-657b345695cd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Request method failure captured: Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 HTTP/1.1 Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKGQJeWMxfWMeM3O6gGoGSgLaotgRmZdXAA5ksXNn18BC3kYiORlqcPrpkO6hwWROtId_i3BPG3tHcLNXgo1DRLTViLVFJkr5ippTm7TWTVVrTinupx_GraljlTHrjKYi9B__lcWVv-kBGfZZl6RvbkghUGxnbsTm6q2TyI0UqnddMU Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2e19c07467824bbfbc0715c6085c40e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2e19c07467824bbfbc0715c6085c40e6"}]}] Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServerActionsTestJSON-539616512 Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 2e19c07467824bbfbc0715c6085c40e6 Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServerActionsTestJSON-539616512 Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: fd4c00a472474521add76167023ab141 Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServerActionsTestJSON-539616512-project Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 7c0ab293-18af-4f60-ba64-c3c892916738 could not be found. Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '7c0ab293-18af-4f60-ba64-c3c892916738'} Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c0ab293-18af-4f60-ba64-c3c892916738 could not be found. Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c0ab293-18af-4f60-ba64-c3c892916738 could not be found. Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:18.164829 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:18.169552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:18.169552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:18.169552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:18.169552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:50:18.169552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:50:18.169552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c0ab293-18af-4f60-ba64-c3c892916738 could not be found. Oct 29 03:50:18.169552 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:18.169552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-deb0237f-4bf6-4d7a-90ec-657b345695cd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Returning 404 to user: Instance 7c0ab293-18af-4f60-ba64-c3c892916738 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:50:18.169552 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-deb0237f-4bf6-4d7a-90ec-657b345695cd tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738" status: 404 len: 111 microversion: 2.1 time: 0.032336 Oct 29 03:50:18.169552 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3373/6970] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:18 2022] GET /compute/v2.1/servers/7c0ab293-18af-4f60-ba64-c3c892916738 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:50:18.176036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d8a9b03b-c239-42c8-ac0a-f221c449ac6d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] Calling method '.version_select at 0x7ff052d7e3a0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:18.180873 n-d-862967-2 devstack@n-api.service[127124]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d8a9b03b-c239-42c8-ac0a-f221c449ac6d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [92d32a5a-9cb6-49ec-97f8-cd828255472f] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 03:50:19.190778 n-d-862967-2 devstack@n-api.service[127124]: INFO oslo.messaging._drivers.impl_rabbit [None req-d8a9b03b-c239-42c8-ac0a-f221c449ac6d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] [92d32a5a-9cb6-49ec-97f8-cd828255472f] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 38334. Oct 29 03:50:19.216071 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d8a9b03b-c239-42c8-ac0a-f221c449ac6d tempest-ServerActionsTestJSON-539616512 tempest-ServerActionsTestJSON-539616512-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-685611708" status: 202 len: 0 microversion: 2.1 time: 1.044085 Oct 29 03:50:19.216924 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3598/6971] 10.222.0.46 () {58 vars in 1218 bytes} [Sat Oct 29 03:50:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-685611708 => generated 0 bytes in 1046 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:50:28.790557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=13 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:50:28.791675 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=39 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:50:28.909521 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d23b82e1-95aa-41c8-8777-a07c00624966 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-795505727", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "c746a7f4-9313-4a81-9b4a-bf6c584eedc8"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:50:28.968007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-d23b82e1-95aa-41c8-8777-a07c00624966 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] validate_networks() for [('c746a7f4-9313-4a81-9b4a-bf6c584eedc8', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:50:29.489789 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-d23b82e1-95aa-41c8-8777-a07c00624966 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:50:29.490355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-d23b82e1-95aa-41c8-8777-a07c00624966 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:50:29.490851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-d23b82e1-95aa-41c8-8777-a07c00624966 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:50:29.491332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-d23b82e1-95aa-41c8-8777-a07c00624966 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:50:29.491700 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-d23b82e1-95aa-41c8-8777-a07c00624966 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:50:29.502310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d23b82e1-95aa-41c8-8777-a07c00624966 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:29.502814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d23b82e1-95aa-41c8-8777-a07c00624966 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:29.503329 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d23b82e1-95aa-41c8-8777-a07c00624966 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:29.504268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d23b82e1-95aa-41c8-8777-a07c00624966 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:29.505202 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d23b82e1-95aa-41c8-8777-a07c00624966 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:29.505923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d23b82e1-95aa-41c8-8777-a07c00624966 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:29.524728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-d23b82e1-95aa-41c8-8777-a07c00624966 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Getting quotas for project b3a875599de043e3ae3b78cbc446ec25. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:50:29.531070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-d23b82e1-95aa-41c8-8777-a07c00624966 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Getting quotas for user 8371cdbc486d4f50bbdac5f0452a769a and project b3a875599de043e3ae3b78cbc446ec25. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:50:29.545899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d23b82e1-95aa-41c8-8777-a07c00624966 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:50:29.548635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d23b82e1-95aa-41c8-8777-a07c00624966 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:50:29.604660 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d23b82e1-95aa-41c8-8777-a07c00624966 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.819121 Oct 29 03:50:29.605336 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3374/6972] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:50:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:50:29.617466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f8c79a3d-df85-4357-89de-15cc5c507b15 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:29.618064 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f8c79a3d-df85-4357-89de-15cc5c507b15 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:29.621136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=27 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:50:29.621818 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:50:29.988640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f8c79a3d-df85-4357-89de-15cc5c507b15 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:29.996800 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f8c79a3d-df85-4357-89de-15cc5c507b15 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac" status: 200 len: 1216 microversion: 2.1 time: 0.383850 Oct 29 03:50:29.997704 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3599/6973] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:29 2022] GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac => generated 1216 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:31.022905 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-14521f4c-103f-430b-be38-e76d98270f9e tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:31.023502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-14521f4c-103f-430b-be38-e76d98270f9e tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:31.031398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14521f4c-103f-430b-be38-e76d98270f9e tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:31.031865 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14521f4c-103f-430b-be38-e76d98270f9e tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:31.032322 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14521f4c-103f-430b-be38-e76d98270f9e tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:31.033126 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14521f4c-103f-430b-be38-e76d98270f9e tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:31.033596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14521f4c-103f-430b-be38-e76d98270f9e tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:31.034034 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-14521f4c-103f-430b-be38-e76d98270f9e tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:31.102904 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-14521f4c-103f-430b-be38-e76d98270f9e tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:31.113519 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-14521f4c-103f-430b-be38-e76d98270f9e tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac" status: 200 len: 1220 microversion: 2.1 time: 0.095694 Oct 29 03:50:31.114300 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3375/6974] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:31 2022] GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:32.138618 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f34e7645-4ef6-45a3-b3c7-0ae5d602bd36 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:32.148280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f34e7645-4ef6-45a3-b3c7-0ae5d602bd36 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:32.160612 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f34e7645-4ef6-45a3-b3c7-0ae5d602bd36 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:32.161736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f34e7645-4ef6-45a3-b3c7-0ae5d602bd36 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:32.162266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f34e7645-4ef6-45a3-b3c7-0ae5d602bd36 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:32.163289 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f34e7645-4ef6-45a3-b3c7-0ae5d602bd36 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:32.164020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f34e7645-4ef6-45a3-b3c7-0ae5d602bd36 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:32.165297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f34e7645-4ef6-45a3-b3c7-0ae5d602bd36 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:32.250120 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f34e7645-4ef6-45a3-b3c7-0ae5d602bd36 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:32.258853 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f34e7645-4ef6-45a3-b3c7-0ae5d602bd36 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac" status: 200 len: 1274 microversion: 2.1 time: 0.125072 Oct 29 03:50:32.259440 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3600/6975] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:32 2022] GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac => generated 1274 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:33.284115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4b642831-671f-4e5b-aac6-dd0680da3894 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:33.285050 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4b642831-671f-4e5b-aac6-dd0680da3894 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:33.292441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b642831-671f-4e5b-aac6-dd0680da3894 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:33.293102 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b642831-671f-4e5b-aac6-dd0680da3894 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:33.293625 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b642831-671f-4e5b-aac6-dd0680da3894 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:33.294420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b642831-671f-4e5b-aac6-dd0680da3894 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:33.294961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b642831-671f-4e5b-aac6-dd0680da3894 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:33.295493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4b642831-671f-4e5b-aac6-dd0680da3894 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:33.370936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-8cef12a9-c8ff-4f19-8cf7-81a95bb81a82 req-f0ab4799-76fd-49f9-b397-5ea3aeb00828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "996f7fc2-3efc-4ac3-9922-a2ea6eedbaac", "tag": "38545084-4cb1-434f-9fa0-8af0e5172145"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:50:33.399171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8cef12a9-c8ff-4f19-8cf7-81a95bb81a82 req-f0ab4799-76fd-49f9-b397-5ea3aeb00828 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:33.399694 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8cef12a9-c8ff-4f19-8cf7-81a95bb81a82 req-f0ab4799-76fd-49f9-b397-5ea3aeb00828 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:33.400141 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8cef12a9-c8ff-4f19-8cf7-81a95bb81a82 req-f0ab4799-76fd-49f9-b397-5ea3aeb00828 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:33.424425 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-8cef12a9-c8ff-4f19-8cf7-81a95bb81a82 req-f0ab4799-76fd-49f9-b397-5ea3aeb00828 service nova] Creating event network-changed:38545084-4cb1-434f-9fa0-8af0e5172145 for instance 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac on n-h2-862967-2 Oct 29 03:50:33.433870 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-8cef12a9-c8ff-4f19-8cf7-81a95bb81a82 req-f0ab4799-76fd-49f9-b397-5ea3aeb00828 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067392 Oct 29 03:50:33.435190 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3601/6976] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:50:33.476180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4b642831-671f-4e5b-aac6-dd0680da3894 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:33.486451 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4b642831-671f-4e5b-aac6-dd0680da3894 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac" status: 200 len: 1316 microversion: 2.1 time: 0.208089 Oct 29 03:50:33.487281 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3376/6977] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:33 2022] GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac => generated 1316 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:34.516312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-78e66997-efc5-4fe6-be7b-c840caf72307 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:34.517474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-78e66997-efc5-4fe6-be7b-c840caf72307 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:34.527293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78e66997-efc5-4fe6-be7b-c840caf72307 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:34.528056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78e66997-efc5-4fe6-be7b-c840caf72307 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:34.528684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78e66997-efc5-4fe6-be7b-c840caf72307 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:34.529756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78e66997-efc5-4fe6-be7b-c840caf72307 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:34.530213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78e66997-efc5-4fe6-be7b-c840caf72307 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:34.530753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78e66997-efc5-4fe6-be7b-c840caf72307 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:34.751694 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-78e66997-efc5-4fe6-be7b-c840caf72307 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:34.760189 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-78e66997-efc5-4fe6-be7b-c840caf72307 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac" status: 200 len: 1316 microversion: 2.1 time: 0.251614 Oct 29 03:50:34.760850 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3602/6978] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:34 2022] GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac => generated 1316 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:35.783696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-af1722da-098b-4cd1-942b-1f9996366c0e tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:35.784328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-af1722da-098b-4cd1-942b-1f9996366c0e tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:35.791851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af1722da-098b-4cd1-942b-1f9996366c0e tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:35.792359 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af1722da-098b-4cd1-942b-1f9996366c0e tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:35.792841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af1722da-098b-4cd1-942b-1f9996366c0e tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:35.793590 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af1722da-098b-4cd1-942b-1f9996366c0e tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:35.794064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af1722da-098b-4cd1-942b-1f9996366c0e tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:35.794498 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af1722da-098b-4cd1-942b-1f9996366c0e tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:35.931905 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-af1722da-098b-4cd1-942b-1f9996366c0e tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:35.940342 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-af1722da-098b-4cd1-942b-1f9996366c0e tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac" status: 200 len: 1316 microversion: 2.1 time: 0.160633 Oct 29 03:50:35.941006 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3377/6979] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:35 2022] GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:36.963758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-052508df-2aff-4f70-8fc5-c50ff48461d6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:36.964339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-052508df-2aff-4f70-8fc5-c50ff48461d6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:36.972053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-052508df-2aff-4f70-8fc5-c50ff48461d6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:36.972555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-052508df-2aff-4f70-8fc5-c50ff48461d6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:36.973010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-052508df-2aff-4f70-8fc5-c50ff48461d6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:36.973733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-052508df-2aff-4f70-8fc5-c50ff48461d6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:36.974186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-052508df-2aff-4f70-8fc5-c50ff48461d6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:36.974615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-052508df-2aff-4f70-8fc5-c50ff48461d6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:37.118643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-052508df-2aff-4f70-8fc5-c50ff48461d6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:37.126654 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-052508df-2aff-4f70-8fc5-c50ff48461d6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac" status: 200 len: 1316 microversion: 2.1 time: 0.166943 Oct 29 03:50:37.127290 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3603/6980] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:36 2022] GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:37.220148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-b5b672b3-071c-4f3e-afaf-31a512b828f7 req-0f9ed878-ba26-4a64-bacb-bfcc63a522d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "996f7fc2-3efc-4ac3-9922-a2ea6eedbaac", "name": "network-vif-plugged", "status": "completed", "tag": "38545084-4cb1-434f-9fa0-8af0e5172145"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:50:37.233885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b5b672b3-071c-4f3e-afaf-31a512b828f7 req-0f9ed878-ba26-4a64-bacb-bfcc63a522d3 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:37.234663 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b5b672b3-071c-4f3e-afaf-31a512b828f7 req-0f9ed878-ba26-4a64-bacb-bfcc63a522d3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:37.235119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b5b672b3-071c-4f3e-afaf-31a512b828f7 req-0f9ed878-ba26-4a64-bacb-bfcc63a522d3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:37.247722 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-b5b672b3-071c-4f3e-afaf-31a512b828f7 req-0f9ed878-ba26-4a64-bacb-bfcc63a522d3 service nova] Creating event network-vif-plugged:38545084-4cb1-434f-9fa0-8af0e5172145 for instance 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac on n-h2-862967-2 Oct 29 03:50:37.253164 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-b5b672b3-071c-4f3e-afaf-31a512b828f7 req-0f9ed878-ba26-4a64-bacb-bfcc63a522d3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036584 Oct 29 03:50:37.253794 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3378/6981] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:50:38.150467 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e597f41f-867b-4319-9980-2b9cf1258336 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:38.151044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e597f41f-867b-4319-9980-2b9cf1258336 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:38.158505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e597f41f-867b-4319-9980-2b9cf1258336 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:38.158999 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e597f41f-867b-4319-9980-2b9cf1258336 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:38.159436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e597f41f-867b-4319-9980-2b9cf1258336 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:38.160151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e597f41f-867b-4319-9980-2b9cf1258336 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:38.160681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e597f41f-867b-4319-9980-2b9cf1258336 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:38.161109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e597f41f-867b-4319-9980-2b9cf1258336 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:38.295427 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e597f41f-867b-4319-9980-2b9cf1258336 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:38.305381 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e597f41f-867b-4319-9980-2b9cf1258336 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac" status: 200 len: 1316 microversion: 2.1 time: 0.158843 Oct 29 03:50:38.305977 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3604/6982] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:38 2022] GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:39.332171 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-343d3520-db3e-4e4c-9fde-261aa72a59c0 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:39.332943 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-343d3520-db3e-4e4c-9fde-261aa72a59c0 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:39.340471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-343d3520-db3e-4e4c-9fde-261aa72a59c0 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:39.340981 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-343d3520-db3e-4e4c-9fde-261aa72a59c0 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:39.341432 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-343d3520-db3e-4e4c-9fde-261aa72a59c0 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:39.342142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-343d3520-db3e-4e4c-9fde-261aa72a59c0 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:39.342611 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-343d3520-db3e-4e4c-9fde-261aa72a59c0 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:39.343047 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-343d3520-db3e-4e4c-9fde-261aa72a59c0 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:39.495239 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-343d3520-db3e-4e4c-9fde-261aa72a59c0 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:39.503647 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-343d3520-db3e-4e4c-9fde-261aa72a59c0 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac" status: 200 len: 1505 microversion: 2.1 time: 0.177553 Oct 29 03:50:39.504230 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3379/6983] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:39 2022] GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac => generated 1505 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:39.568796 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2689d0ba-de96-4556-ba8e-3ece4bf5033c tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1172976048", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "c746a7f4-9313-4a81-9b4a-bf6c584eedc8"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:50:39.631633 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-2689d0ba-de96-4556-ba8e-3ece4bf5033c tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] validate_networks() for [('c746a7f4-9313-4a81-9b4a-bf6c584eedc8', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:50:39.993948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:50:40.019240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-2689d0ba-de96-4556-ba8e-3ece4bf5033c tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:50:40.019689 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-2689d0ba-de96-4556-ba8e-3ece4bf5033c tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:50:40.020159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-2689d0ba-de96-4556-ba8e-3ece4bf5033c tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:50:40.020617 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-2689d0ba-de96-4556-ba8e-3ece4bf5033c tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:50:40.021169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-2689d0ba-de96-4556-ba8e-3ece4bf5033c tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:50:40.030178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2689d0ba-de96-4556-ba8e-3ece4bf5033c tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:40.030659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2689d0ba-de96-4556-ba8e-3ece4bf5033c tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:40.031124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2689d0ba-de96-4556-ba8e-3ece4bf5033c tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:40.031848 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2689d0ba-de96-4556-ba8e-3ece4bf5033c tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:40.032325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2689d0ba-de96-4556-ba8e-3ece4bf5033c tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:40.032745 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2689d0ba-de96-4556-ba8e-3ece4bf5033c tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:40.050415 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-2689d0ba-de96-4556-ba8e-3ece4bf5033c tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Getting quotas for project b3a875599de043e3ae3b78cbc446ec25. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:50:40.055569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-2689d0ba-de96-4556-ba8e-3ece4bf5033c tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Getting quotas for user 8371cdbc486d4f50bbdac5f0452a769a and project b3a875599de043e3ae3b78cbc446ec25. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:50:40.068698 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2689d0ba-de96-4556-ba8e-3ece4bf5033c tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:50:40.071075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2689d0ba-de96-4556-ba8e-3ece4bf5033c tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 325b545a-2424-4dd9-8756-7d1986da7a5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:50:40.116311 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2689d0ba-de96-4556-ba8e-3ece4bf5033c tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.551331 Oct 29 03:50:40.117239 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3605/6984] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:50:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:50:40.128791 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b4d32ec7-151a-4646-ac6b-34e3236804c2 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:40.129414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b4d32ec7-151a-4646-ac6b-34e3236804c2 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 325b545a-2424-4dd9-8756-7d1986da7a5d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:40.131851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:50:40.133599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:50:40.193159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b4d32ec7-151a-4646-ac6b-34e3236804c2 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:40.200224 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b4d32ec7-151a-4646-ac6b-34e3236804c2 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d" status: 200 len: 1217 microversion: 2.1 time: 0.075465 Oct 29 03:50:40.200866 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3380/6985] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:40 2022] GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d => generated 1217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:41.224276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eaec56df-7bab-49da-b1b9-9268d1459f1d tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:41.225845 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-eaec56df-7bab-49da-b1b9-9268d1459f1d tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 325b545a-2424-4dd9-8756-7d1986da7a5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:41.232066 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaec56df-7bab-49da-b1b9-9268d1459f1d tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:41.232607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaec56df-7bab-49da-b1b9-9268d1459f1d tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:41.233117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaec56df-7bab-49da-b1b9-9268d1459f1d tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:41.233833 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaec56df-7bab-49da-b1b9-9268d1459f1d tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:41.234292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaec56df-7bab-49da-b1b9-9268d1459f1d tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:41.234911 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eaec56df-7bab-49da-b1b9-9268d1459f1d tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:41.307354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-eaec56df-7bab-49da-b1b9-9268d1459f1d tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:41.315800 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eaec56df-7bab-49da-b1b9-9268d1459f1d tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d" status: 200 len: 1277 microversion: 2.1 time: 0.096223 Oct 29 03:50:41.316569 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3606/6986] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:41 2022] GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d => generated 1277 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:42.340299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e3977b7f-7958-4542-88e7-b1ca8da5ca04 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:42.341035 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e3977b7f-7958-4542-88e7-b1ca8da5ca04 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 325b545a-2424-4dd9-8756-7d1986da7a5d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:42.349756 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3977b7f-7958-4542-88e7-b1ca8da5ca04 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:42.350338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3977b7f-7958-4542-88e7-b1ca8da5ca04 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:42.350830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3977b7f-7958-4542-88e7-b1ca8da5ca04 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:42.351556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3977b7f-7958-4542-88e7-b1ca8da5ca04 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:42.352032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3977b7f-7958-4542-88e7-b1ca8da5ca04 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:42.352466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e3977b7f-7958-4542-88e7-b1ca8da5ca04 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:42.590730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e3977b7f-7958-4542-88e7-b1ca8da5ca04 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:42.598996 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e3977b7f-7958-4542-88e7-b1ca8da5ca04 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d" status: 200 len: 1317 microversion: 2.1 time: 0.263107 Oct 29 03:50:42.599590 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3381/6987] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:42 2022] GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d => generated 1317 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:42.753322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-31f35565-cc22-4ada-bbd3-1ec7610caedd req-44651bd6-3ac3-4686-a6d6-9d60df744b93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "325b545a-2424-4dd9-8756-7d1986da7a5d", "tag": "3762cfdb-c11f-4173-a2fd-66431279a4df"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:50:42.767264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-31f35565-cc22-4ada-bbd3-1ec7610caedd req-44651bd6-3ac3-4686-a6d6-9d60df744b93 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:42.767740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-31f35565-cc22-4ada-bbd3-1ec7610caedd req-44651bd6-3ac3-4686-a6d6-9d60df744b93 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:42.768167 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-31f35565-cc22-4ada-bbd3-1ec7610caedd req-44651bd6-3ac3-4686-a6d6-9d60df744b93 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:42.782407 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-31f35565-cc22-4ada-bbd3-1ec7610caedd req-44651bd6-3ac3-4686-a6d6-9d60df744b93 service nova] Creating event network-changed:3762cfdb-c11f-4173-a2fd-66431279a4df for instance 325b545a-2424-4dd9-8756-7d1986da7a5d on n-h1-862967-2 Oct 29 03:50:42.788145 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-31f35565-cc22-4ada-bbd3-1ec7610caedd req-44651bd6-3ac3-4686-a6d6-9d60df744b93 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038499 Oct 29 03:50:42.789616 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3607/6988] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:50:43.626849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ba37cf7a-e71f-4019-b237-3c4355f8c6b1 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:43.627844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ba37cf7a-e71f-4019-b237-3c4355f8c6b1 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 325b545a-2424-4dd9-8756-7d1986da7a5d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:43.635519 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba37cf7a-e71f-4019-b237-3c4355f8c6b1 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:43.636026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba37cf7a-e71f-4019-b237-3c4355f8c6b1 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:43.636468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba37cf7a-e71f-4019-b237-3c4355f8c6b1 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:43.637215 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba37cf7a-e71f-4019-b237-3c4355f8c6b1 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:43.637679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba37cf7a-e71f-4019-b237-3c4355f8c6b1 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:43.638114 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba37cf7a-e71f-4019-b237-3c4355f8c6b1 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:43.774778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ba37cf7a-e71f-4019-b237-3c4355f8c6b1 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:43.782554 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ba37cf7a-e71f-4019-b237-3c4355f8c6b1 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d" status: 200 len: 1317 microversion: 2.1 time: 0.162419 Oct 29 03:50:43.783138 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3382/6989] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:43 2022] GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:44.809041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-57841285-11b8-4b8e-97e1-be3b0fae1e1b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:44.810204 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-57841285-11b8-4b8e-97e1-be3b0fae1e1b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 325b545a-2424-4dd9-8756-7d1986da7a5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:44.820957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-57841285-11b8-4b8e-97e1-be3b0fae1e1b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:44.821770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-57841285-11b8-4b8e-97e1-be3b0fae1e1b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:44.822496 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-57841285-11b8-4b8e-97e1-be3b0fae1e1b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:44.823650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-57841285-11b8-4b8e-97e1-be3b0fae1e1b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:44.824410 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-57841285-11b8-4b8e-97e1-be3b0fae1e1b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:44.825169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-57841285-11b8-4b8e-97e1-be3b0fae1e1b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:44.974488 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-57841285-11b8-4b8e-97e1-be3b0fae1e1b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:44.983785 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-57841285-11b8-4b8e-97e1-be3b0fae1e1b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d" status: 200 len: 1317 microversion: 2.1 time: 0.181766 Oct 29 03:50:44.984613 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3608/6990] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:44 2022] GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:46.008327 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ba368294-40bc-40b4-9f2b-7d78a5662e44 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:46.008929 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ba368294-40bc-40b4-9f2b-7d78a5662e44 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 325b545a-2424-4dd9-8756-7d1986da7a5d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:46.016891 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba368294-40bc-40b4-9f2b-7d78a5662e44 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:46.017414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba368294-40bc-40b4-9f2b-7d78a5662e44 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:46.017869 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba368294-40bc-40b4-9f2b-7d78a5662e44 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:46.018594 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba368294-40bc-40b4-9f2b-7d78a5662e44 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:46.019065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba368294-40bc-40b4-9f2b-7d78a5662e44 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:46.019502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba368294-40bc-40b4-9f2b-7d78a5662e44 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:46.162730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ba368294-40bc-40b4-9f2b-7d78a5662e44 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:46.171055 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ba368294-40bc-40b4-9f2b-7d78a5662e44 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d" status: 200 len: 1317 microversion: 2.1 time: 0.167065 Oct 29 03:50:46.171650 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3383/6991] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:46 2022] GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:47.197920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-41c778dd-7754-4197-a0e7-91713256b58b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:47.198534 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-41c778dd-7754-4197-a0e7-91713256b58b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 325b545a-2424-4dd9-8756-7d1986da7a5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:47.205832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41c778dd-7754-4197-a0e7-91713256b58b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:47.206320 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41c778dd-7754-4197-a0e7-91713256b58b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:47.206765 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41c778dd-7754-4197-a0e7-91713256b58b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:47.207460 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41c778dd-7754-4197-a0e7-91713256b58b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:47.207912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41c778dd-7754-4197-a0e7-91713256b58b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:47.208342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41c778dd-7754-4197-a0e7-91713256b58b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:47.345652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-41c778dd-7754-4197-a0e7-91713256b58b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:47.354117 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-41c778dd-7754-4197-a0e7-91713256b58b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d" status: 200 len: 1317 microversion: 2.1 time: 0.160890 Oct 29 03:50:47.354783 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3609/6992] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:47 2022] GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:48.387806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b1ad0f80-9c4b-49f9-bc0f-3a5c22843927 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:48.388752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b1ad0f80-9c4b-49f9-bc0f-3a5c22843927 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 325b545a-2424-4dd9-8756-7d1986da7a5d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:48.399529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1ad0f80-9c4b-49f9-bc0f-3a5c22843927 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:48.400037 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1ad0f80-9c4b-49f9-bc0f-3a5c22843927 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:48.400513 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1ad0f80-9c4b-49f9-bc0f-3a5c22843927 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:48.401242 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1ad0f80-9c4b-49f9-bc0f-3a5c22843927 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:48.401713 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1ad0f80-9c4b-49f9-bc0f-3a5c22843927 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:48.402151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1ad0f80-9c4b-49f9-bc0f-3a5c22843927 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:48.542708 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b1ad0f80-9c4b-49f9-bc0f-3a5c22843927 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:48.554044 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b1ad0f80-9c4b-49f9-bc0f-3a5c22843927 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d" status: 200 len: 1317 microversion: 2.1 time: 0.172682 Oct 29 03:50:48.554650 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3384/6993] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:48 2022] GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:49.438032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-bb377fc9-3710-4548-bbd0-957736d93e20 req-414f9ca6-6c72-49e3-862c-6e9ffa199ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "325b545a-2424-4dd9-8756-7d1986da7a5d", "name": "network-vif-plugged", "status": "completed", "tag": "3762cfdb-c11f-4173-a2fd-66431279a4df"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:50:49.450506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-bb377fc9-3710-4548-bbd0-957736d93e20 req-414f9ca6-6c72-49e3-862c-6e9ffa199ae3 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:49.451178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-bb377fc9-3710-4548-bbd0-957736d93e20 req-414f9ca6-6c72-49e3-862c-6e9ffa199ae3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:49.451378 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-bb377fc9-3710-4548-bbd0-957736d93e20 req-414f9ca6-6c72-49e3-862c-6e9ffa199ae3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:49.463968 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-bb377fc9-3710-4548-bbd0-957736d93e20 req-414f9ca6-6c72-49e3-862c-6e9ffa199ae3 service nova] Creating event network-vif-plugged:3762cfdb-c11f-4173-a2fd-66431279a4df for instance 325b545a-2424-4dd9-8756-7d1986da7a5d on n-h1-862967-2 Oct 29 03:50:49.469564 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-bb377fc9-3710-4548-bbd0-957736d93e20 req-414f9ca6-6c72-49e3-862c-6e9ffa199ae3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035311 Oct 29 03:50:49.470197 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3610/6994] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:50:49.577514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9afc2f72-b3cd-4ab8-9cf0-17fc0f01ee8b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:49.578990 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9afc2f72-b3cd-4ab8-9cf0-17fc0f01ee8b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 325b545a-2424-4dd9-8756-7d1986da7a5d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:49.585986 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9afc2f72-b3cd-4ab8-9cf0-17fc0f01ee8b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:49.586715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9afc2f72-b3cd-4ab8-9cf0-17fc0f01ee8b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:49.586948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9afc2f72-b3cd-4ab8-9cf0-17fc0f01ee8b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:49.587696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9afc2f72-b3cd-4ab8-9cf0-17fc0f01ee8b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:49.588192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9afc2f72-b3cd-4ab8-9cf0-17fc0f01ee8b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:49.588672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9afc2f72-b3cd-4ab8-9cf0-17fc0f01ee8b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:49.736457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9afc2f72-b3cd-4ab8-9cf0-17fc0f01ee8b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:49.745083 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9afc2f72-b3cd-4ab8-9cf0-17fc0f01ee8b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d" status: 200 len: 1317 microversion: 2.1 time: 0.171734 Oct 29 03:50:49.745669 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3385/6995] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:49 2022] GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:50.766621 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:50:50.767515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:50:50.774648 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e89e2f6a-e7b5-4c56-878b-463a6fb859bb tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:50.775354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e89e2f6a-e7b5-4c56-878b-463a6fb859bb tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 325b545a-2424-4dd9-8756-7d1986da7a5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:50.782338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e89e2f6a-e7b5-4c56-878b-463a6fb859bb tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:50.782836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e89e2f6a-e7b5-4c56-878b-463a6fb859bb tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:50.783274 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e89e2f6a-e7b5-4c56-878b-463a6fb859bb tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:50.783976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e89e2f6a-e7b5-4c56-878b-463a6fb859bb tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:50.784416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e89e2f6a-e7b5-4c56-878b-463a6fb859bb tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:50.784884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e89e2f6a-e7b5-4c56-878b-463a6fb859bb tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:50.929815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e89e2f6a-e7b5-4c56-878b-463a6fb859bb tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:50.938365 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e89e2f6a-e7b5-4c56-878b-463a6fb859bb tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d" status: 200 len: 1317 microversion: 2.1 time: 0.173211 Oct 29 03:50:50.938945 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3611/6996] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:50 2022] GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:51.962923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-55cbec8e-a475-423e-87aa-222a483a90ef tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:51.963503 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-55cbec8e-a475-423e-87aa-222a483a90ef tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 325b545a-2424-4dd9-8756-7d1986da7a5d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:51.965497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:50:51.972635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55cbec8e-a475-423e-87aa-222a483a90ef tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:51.973104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55cbec8e-a475-423e-87aa-222a483a90ef tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:51.973549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55cbec8e-a475-423e-87aa-222a483a90ef tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:51.974400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55cbec8e-a475-423e-87aa-222a483a90ef tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:51.974866 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55cbec8e-a475-423e-87aa-222a483a90ef tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:51.975294 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-55cbec8e-a475-423e-87aa-222a483a90ef tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:52.120834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-55cbec8e-a475-423e-87aa-222a483a90ef tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:52.129000 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-55cbec8e-a475-423e-87aa-222a483a90ef tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d" status: 200 len: 1507 microversion: 2.1 time: 0.170684 Oct 29 03:50:52.130615 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3386/6997] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:51 2022] GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:52.151724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e524436e-d518-4376-b9d0-7d514dc12c35 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:52.152322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e524436e-d518-4376-b9d0-7d514dc12c35 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 325b545a-2424-4dd9-8756-7d1986da7a5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:52.158820 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e524436e-d518-4376-b9d0-7d514dc12c35 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:52.159324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e524436e-d518-4376-b9d0-7d514dc12c35 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:52.159762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e524436e-d518-4376-b9d0-7d514dc12c35 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:52.160458 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e524436e-d518-4376-b9d0-7d514dc12c35 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:52.160965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e524436e-d518-4376-b9d0-7d514dc12c35 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:52.161388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e524436e-d518-4376-b9d0-7d514dc12c35 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:52.186849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e524436e-d518-4376-b9d0-7d514dc12c35 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 325b545a-2424-4dd9-8756-7d1986da7a5d] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:50:52.267345 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e524436e-d518-4376-b9d0-7d514dc12c35 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "DELETE /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d" status: 204 len: 0 microversion: 2.1 time: 0.119301 Oct 29 03:50:52.269153 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3612/6998] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:50:52 2022] DELETE /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:50:52.278032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fdc06498-2623-408e-86c4-cdd499d781a6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:52.278658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fdc06498-2623-408e-86c4-cdd499d781a6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 325b545a-2424-4dd9-8756-7d1986da7a5d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:52.284776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdc06498-2623-408e-86c4-cdd499d781a6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:52.285272 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdc06498-2623-408e-86c4-cdd499d781a6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:52.285720 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdc06498-2623-408e-86c4-cdd499d781a6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:52.286428 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdc06498-2623-408e-86c4-cdd499d781a6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:52.286874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdc06498-2623-408e-86c4-cdd499d781a6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:52.287305 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fdc06498-2623-408e-86c4-cdd499d781a6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:52.424769 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fdc06498-2623-408e-86c4-cdd499d781a6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:52.436315 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fdc06498-2623-408e-86c4-cdd499d781a6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d" status: 200 len: 1513 microversion: 2.1 time: 0.163220 Oct 29 03:50:52.437148 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3387/6999] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:52 2022] GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:53.464662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-508664fd-c605-4fe6-9cae-fdeb5b03f3c5 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:53.465263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-508664fd-c605-4fe6-9cae-fdeb5b03f3c5 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 325b545a-2424-4dd9-8756-7d1986da7a5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:53.472313 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-508664fd-c605-4fe6-9cae-fdeb5b03f3c5 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:53.472836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-508664fd-c605-4fe6-9cae-fdeb5b03f3c5 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:53.473271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-508664fd-c605-4fe6-9cae-fdeb5b03f3c5 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:53.473975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-508664fd-c605-4fe6-9cae-fdeb5b03f3c5 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:53.474421 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-508664fd-c605-4fe6-9cae-fdeb5b03f3c5 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:53.474844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-508664fd-c605-4fe6-9cae-fdeb5b03f3c5 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:53.614246 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-508664fd-c605-4fe6-9cae-fdeb5b03f3c5 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:53.623835 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-508664fd-c605-4fe6-9cae-fdeb5b03f3c5 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d" status: 200 len: 1513 microversion: 2.1 time: 0.164952 Oct 29 03:50:53.624439 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3613/7000] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:53 2022] GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:54.149654 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-49a61a3e-6b7a-44ae-badd-d40f89130700 req-b3e8db61-ae33-4855-a056-dd5fceacd53a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "325b545a-2424-4dd9-8756-7d1986da7a5d", "name": "network-vif-deleted", "tag": "3762cfdb-c11f-4173-a2fd-66431279a4df"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:50:54.161166 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-49a61a3e-6b7a-44ae-badd-d40f89130700 req-b3e8db61-ae33-4855-a056-dd5fceacd53a service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:54.161666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-49a61a3e-6b7a-44ae-badd-d40f89130700 req-b3e8db61-ae33-4855-a056-dd5fceacd53a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:54.162111 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-49a61a3e-6b7a-44ae-badd-d40f89130700 req-b3e8db61-ae33-4855-a056-dd5fceacd53a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:54.174750 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-49a61a3e-6b7a-44ae-badd-d40f89130700 req-b3e8db61-ae33-4855-a056-dd5fceacd53a service nova] Creating event network-vif-deleted:3762cfdb-c11f-4173-a2fd-66431279a4df for instance 325b545a-2424-4dd9-8756-7d1986da7a5d on n-h1-862967-2 Oct 29 03:50:54.180750 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-49a61a3e-6b7a-44ae-badd-d40f89130700 req-b3e8db61-ae33-4855-a056-dd5fceacd53a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035914 Oct 29 03:50:54.182063 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3388/7001] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:50:54.647336 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-abf24457-612d-4fe7-8c3f-76388e04d0d2 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:54.648072 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-abf24457-612d-4fe7-8c3f-76388e04d0d2 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 325b545a-2424-4dd9-8756-7d1986da7a5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:54.655556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abf24457-612d-4fe7-8c3f-76388e04d0d2 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:54.656131 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abf24457-612d-4fe7-8c3f-76388e04d0d2 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:54.656610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abf24457-612d-4fe7-8c3f-76388e04d0d2 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:54.657312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abf24457-612d-4fe7-8c3f-76388e04d0d2 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:54.657771 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abf24457-612d-4fe7-8c3f-76388e04d0d2 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:54.658194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abf24457-612d-4fe7-8c3f-76388e04d0d2 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:54.690852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abf24457-612d-4fe7-8c3f-76388e04d0d2 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:54.691407 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abf24457-612d-4fe7-8c3f-76388e04d0d2 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:54.691793 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abf24457-612d-4fe7-8c3f-76388e04d0d2 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:54.692221 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-abf24457-612d-4fe7-8c3f-76388e04d0d2 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lazy-loading 'fault' on Instance uuid 325b545a-2424-4dd9-8756-7d1986da7a5d {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:50:54.734808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-abf24457-612d-4fe7-8c3f-76388e04d0d2 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:54.743291 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-abf24457-612d-4fe7-8c3f-76388e04d0d2 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d" status: 200 len: 1307 microversion: 2.1 time: 0.099886 Oct 29 03:50:54.743881 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3614/7002] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:54 2022] GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d => generated 1307 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:55.774560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f3b8a0f2-646d-4e14-954f-cba5f04183a6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:55.775974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f3b8a0f2-646d-4e14-954f-cba5f04183a6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 325b545a-2424-4dd9-8756-7d1986da7a5d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:55.783108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3b8a0f2-646d-4e14-954f-cba5f04183a6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:55.783604 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3b8a0f2-646d-4e14-954f-cba5f04183a6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:55.784290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3b8a0f2-646d-4e14-954f-cba5f04183a6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:55.785054 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3b8a0f2-646d-4e14-954f-cba5f04183a6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:55.785518 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3b8a0f2-646d-4e14-954f-cba5f04183a6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:55.785962 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f3b8a0f2-646d-4e14-954f-cba5f04183a6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:55.802144 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-f3b8a0f2-646d-4e14-954f-cba5f04183a6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] HTTP exception thrown: Instance 325b545a-2424-4dd9-8756-7d1986da7a5d could not be found. Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f3b8a0f2-646d-4e14-954f-cba5f04183a6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Request method failure captured: Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d HTTP/1.1 Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKMEi_WncjbZEtGMPWK1yKRwoV95zow8hsZPrz1L9hWwS2b6PWPxhSC6JTXtirh_C1PCxzHFccQtM0qZx2F89-OLmJGhRx9vnFF55s1sLS_RUhQJpxuqQrAr8Kiy4U15faJ-4fkZHxsMPUQW4uFBvr2BwXwn5mZy5D8qZcSd0NqEt3E Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: b3a875599de043e3ae3b78cbc446ec25 Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersNegativeTestJSON-797711122 Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3a875599de043e3ae3b78cbc446ec25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3a875599de043e3ae3b78cbc446ec25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b3a875599de043e3ae3b78cbc446ec25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b3a875599de043e3ae3b78cbc446ec25"}]}] Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersNegativeTestJSON-797711122 Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: b3a875599de043e3ae3b78cbc446ec25 Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-797711122 Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersNegativeTestJSON-797711122-project Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 8371cdbc486d4f50bbdac5f0452a769a Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersNegativeTestJSON-797711122-project Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 325b545a-2424-4dd9-8756-7d1986da7a5d could not be found. Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '325b545a-2424-4dd9-8756-7d1986da7a5d'} Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 325b545a-2424-4dd9-8756-7d1986da7a5d could not be found. Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 325b545a-2424-4dd9-8756-7d1986da7a5d could not be found. Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:55.803896 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:55.809675 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:55.809675 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:55.809675 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:55.809675 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:50:55.809675 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:50:55.809675 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 325b545a-2424-4dd9-8756-7d1986da7a5d could not be found. Oct 29 03:50:55.809675 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:55.809675 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f3b8a0f2-646d-4e14-954f-cba5f04183a6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Returning 404 to user: Instance 325b545a-2424-4dd9-8756-7d1986da7a5d could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:50:55.809675 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f3b8a0f2-646d-4e14-954f-cba5f04183a6 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d" status: 404 len: 111 microversion: 2.1 time: 0.039032 Oct 29 03:50:55.810974 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3389/7003] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:55 2022] GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:50:55.815923 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-54524401-3ebc-4402-ad1a-3bbc887dcf01 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:55.816549 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-54524401-3ebc-4402-ad1a-3bbc887dcf01 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:55.824112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-54524401-3ebc-4402-ad1a-3bbc887dcf01 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:55.824648 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-54524401-3ebc-4402-ad1a-3bbc887dcf01 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:55.825103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-54524401-3ebc-4402-ad1a-3bbc887dcf01 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:55.825875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-54524401-3ebc-4402-ad1a-3bbc887dcf01 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:55.826352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-54524401-3ebc-4402-ad1a-3bbc887dcf01 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:55.826799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-54524401-3ebc-4402-ad1a-3bbc887dcf01 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:55.969728 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-54524401-3ebc-4402-ad1a-3bbc887dcf01 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:55.978306 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-54524401-3ebc-4402-ad1a-3bbc887dcf01 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac" status: 200 len: 1505 microversion: 2.1 time: 0.166725 Oct 29 03:50:55.979040 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3615/7004] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:55 2022] GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:56.002827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d54da22a-a1a1-4098-8d50-8412696774e5 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:50:56.005406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d54da22a-a1a1-4098-8d50-8412696774e5 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 9baab839-af53-4594-8adb-9a27e2ff16c1] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:56.011533 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-d54da22a-a1a1-4098-8d50-8412696774e5 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] HTTP exception thrown: Instance 9baab839-af53-4594-8adb-9a27e2ff16c1 could not be found. Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d54da22a-a1a1-4098-8d50-8412696774e5 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Request method failure captured: Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers/9baab839-af53-4594-8adb-9a27e2ff16c1/action HTTP/1.1 Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 32 Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKMEi_WncjbZEtGMPWK1yKRwoV95zow8hsZPrz1L9hWwS2b6PWPxhSC6JTXtirh_C1PCxzHFccQtM0qZx2F89-OLmJGhRx9vnFF55s1sLS_RUhQJpxuqQrAr8Kiy4U15faJ-4fkZHxsMPUQW4uFBvr2BwXwn5mZy5D8qZcSd0NqEt3E Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: b3a875599de043e3ae3b78cbc446ec25 Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersNegativeTestJSON-797711122 Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3a875599de043e3ae3b78cbc446ec25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3a875599de043e3ae3b78cbc446ec25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b3a875599de043e3ae3b78cbc446ec25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b3a875599de043e3ae3b78cbc446ec25"}]}] Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersNegativeTestJSON-797711122 Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: b3a875599de043e3ae3b78cbc446ec25 Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-797711122 Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersNegativeTestJSON-797711122-project Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 8371cdbc486d4f50bbdac5f0452a769a Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersNegativeTestJSON-797711122-project Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: {"resize": {"flavorRef": "452"}} Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 9baab839-af53-4594-8adb-9a27e2ff16c1 could not be found. Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '9baab839-af53-4594-8adb-9a27e2ff16c1', 'body': {'resize': {'flavorRef': '452'}}} Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9baab839-af53-4594-8adb-9a27e2ff16c1 could not be found. Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:50:56.013233 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:50:56.017479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9baab839-af53-4594-8adb-9a27e2ff16c1 could not be found. Oct 29 03:50:56.017479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:56.017479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:56.017479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:56.017479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:56.017479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:56.017479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:56.017479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:50:56.017479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:50:56.017479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9baab839-af53-4594-8adb-9a27e2ff16c1 could not be found. Oct 29 03:50:56.017479 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:56.017479 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d54da22a-a1a1-4098-8d50-8412696774e5 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Returning 404 to user: Instance 9baab839-af53-4594-8adb-9a27e2ff16c1 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:50:56.017479 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d54da22a-a1a1-4098-8d50-8412696774e5 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "POST /compute/v2.1/servers/9baab839-af53-4594-8adb-9a27e2ff16c1/action" status: 404 len: 111 microversion: 2.1 time: 0.016939 Oct 29 03:50:56.017479 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3390/7005] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:50:55 2022] POST /compute/v2.1/servers/9baab839-af53-4594-8adb-9a27e2ff16c1/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 03:50:56.024916 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4676065b-44c3-42a2-8c01-4043562275de tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:56.025543 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4676065b-44c3-42a2-8c01-4043562275de tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:56.032056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4676065b-44c3-42a2-8c01-4043562275de tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:56.032571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4676065b-44c3-42a2-8c01-4043562275de tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:56.033065 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4676065b-44c3-42a2-8c01-4043562275de tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:56.033772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4676065b-44c3-42a2-8c01-4043562275de tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:56.034236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4676065b-44c3-42a2-8c01-4043562275de tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:56.034671 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4676065b-44c3-42a2-8c01-4043562275de tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:56.171594 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4676065b-44c3-42a2-8c01-4043562275de tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:56.179956 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4676065b-44c3-42a2-8c01-4043562275de tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac" status: 200 len: 1505 microversion: 2.1 time: 0.159166 Oct 29 03:50:56.180606 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3616/7006] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:56 2022] GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:56.203875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2d4d041b-6b06-4921-9827-3e8e72a86791 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:56.204666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2d4d041b-6b06-4921-9827-3e8e72a86791 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:56.211898 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d4d041b-6b06-4921-9827-3e8e72a86791 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:56.212446 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d4d041b-6b06-4921-9827-3e8e72a86791 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:56.213038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d4d041b-6b06-4921-9827-3e8e72a86791 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:56.213827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d4d041b-6b06-4921-9827-3e8e72a86791 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:56.214327 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d4d041b-6b06-4921-9827-3e8e72a86791 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:56.214839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2d4d041b-6b06-4921-9827-3e8e72a86791 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:56.351599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2d4d041b-6b06-4921-9827-3e8e72a86791 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:56.360088 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2d4d041b-6b06-4921-9827-3e8e72a86791 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac" status: 200 len: 1505 microversion: 2.1 time: 0.160141 Oct 29 03:50:56.360974 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3391/7007] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:56 2022] GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:56.383639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b053de8d-efe7-4628-b27e-556858b8a138 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "86ce749c-0d60-441d-9550-d2aa9c639c7f"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:50:56.386278 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b053de8d-efe7-4628-b27e-556858b8a138 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:56.392997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b053de8d-efe7-4628-b27e-556858b8a138 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:56.393489 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b053de8d-efe7-4628-b27e-556858b8a138 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:56.393978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b053de8d-efe7-4628-b27e-556858b8a138 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:56.394846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b053de8d-efe7-4628-b27e-556858b8a138 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:56.395272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b053de8d-efe7-4628-b27e-556858b8a138 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:56.395699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b053de8d-efe7-4628-b27e-556858b8a138 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:56.400853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:50:56.428663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b053de8d-efe7-4628-b27e-556858b8a138 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:56.434273 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-b053de8d-efe7-4628-b27e-556858b8a138 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] HTTP exception thrown: Flavor 86ce749c-0d60-441d-9550-d2aa9c639c7f could not be found. Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b053de8d-efe7-4628-b27e-556858b8a138 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Request method failure captured: Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: request: POST /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac/action HTTP/1.1 Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 65 Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXKMEi_WncjbZEtGMPWK1yKRwoV95zow8hsZPrz1L9hWwS2b6PWPxhSC6JTXtirh_C1PCxzHFccQtM0qZx2F89-OLmJGhRx9vnFF55s1sLS_RUhQJpxuqQrAr8Kiy4U15faJ-4fkZHxsMPUQW4uFBvr2BwXwn5mZy5D8qZcSd0NqEt3E Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: b3a875599de043e3ae3b78cbc446ec25 Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersNegativeTestJSON-797711122 Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3a875599de043e3ae3b78cbc446ec25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3a875599de043e3ae3b78cbc446ec25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b3a875599de043e3ae3b78cbc446ec25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b3a875599de043e3ae3b78cbc446ec25"}]}] Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersNegativeTestJSON-797711122 Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: b3a875599de043e3ae3b78cbc446ec25 Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-797711122 Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersNegativeTestJSON-797711122-project Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 8371cdbc486d4f50bbdac5f0452a769a Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersNegativeTestJSON-797711122-project Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: {"resize": {"flavorRef": "86ce749c-0d60-441d-9550-d2aa9c639c7f"}} Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: exception: Flavor 86ce749c-0d60-441d-9550-d2aa9c639c7f could not be found. Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '996f7fc2-3efc-4ac3-9922-a2ea6eedbaac', 'body': {'resize': {'flavorRef': '86ce749c-0d60-441d-9550-d2aa9c639c7f'}}} Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:50:56.436239 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 86ce749c-0d60-441d-9550-d2aa9c639c7f could not be found. Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 86ce749c-0d60-441d-9550-d2aa9c639c7f could not be found. Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 86ce749c-0d60-441d-9550-d2aa9c639c7f could not be found. Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b053de8d-efe7-4628-b27e-556858b8a138 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Returning 400 to user: Flavor 86ce749c-0d60-441d-9550-d2aa9c639c7f could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b053de8d-efe7-4628-b27e-556858b8a138 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "POST /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac/action" status: 400 len: 107 microversion: 2.1 time: 0.058405 Oct 29 03:50:56.440533 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3617/7008] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:50:56 2022] POST /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac/action => generated 107 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 03:50:56.446635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8615bd7e-740e-4250-a6c0-c2894bf6d70e tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:56.447358 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8615bd7e-740e-4250-a6c0-c2894bf6d70e tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:56.453496 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8615bd7e-740e-4250-a6c0-c2894bf6d70e tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:56.453998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8615bd7e-740e-4250-a6c0-c2894bf6d70e tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:56.454441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8615bd7e-740e-4250-a6c0-c2894bf6d70e tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:56.455143 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8615bd7e-740e-4250-a6c0-c2894bf6d70e tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:56.455605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8615bd7e-740e-4250-a6c0-c2894bf6d70e tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:56.456038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8615bd7e-740e-4250-a6c0-c2894bf6d70e tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:56.592388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8615bd7e-740e-4250-a6c0-c2894bf6d70e tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:56.604844 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8615bd7e-740e-4250-a6c0-c2894bf6d70e tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac" status: 200 len: 1505 microversion: 2.1 time: 0.162118 Oct 29 03:50:56.605615 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3392/7009] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:56 2022] GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:56.632921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cfeee1eb-e7af-4527-b494-cca968f6ceef tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:56.633545 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cfeee1eb-e7af-4527-b494-cca968f6ceef tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:56.640186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cfeee1eb-e7af-4527-b494-cca968f6ceef tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:56.640715 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cfeee1eb-e7af-4527-b494-cca968f6ceef tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:56.641157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cfeee1eb-e7af-4527-b494-cca968f6ceef tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:56.641861 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cfeee1eb-e7af-4527-b494-cca968f6ceef tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:56.642317 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cfeee1eb-e7af-4527-b494-cca968f6ceef tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:56.642744 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cfeee1eb-e7af-4527-b494-cca968f6ceef tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:56.780652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cfeee1eb-e7af-4527-b494-cca968f6ceef tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:56.789601 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cfeee1eb-e7af-4527-b494-cca968f6ceef tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac" status: 200 len: 1505 microversion: 2.1 time: 0.160628 Oct 29 03:50:56.790355 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3618/7010] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:56 2022] GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:56.812827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-45bc5b07-7af7-41b6-bf6b-fe717526ea61 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-45bc5b07-7af7-41b6-bf6b-fe717526ea61 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Request method failure captured: Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: request: POST /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac/action HTTP/1.1 Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 29 Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKMEi_WncjbZEtGMPWK1yKRwoV95zow8hsZPrz1L9hWwS2b6PWPxhSC6JTXtirh_C1PCxzHFccQtM0qZx2F89-OLmJGhRx9vnFF55s1sLS_RUhQJpxuqQrAr8Kiy4U15faJ-4fkZHxsMPUQW4uFBvr2BwXwn5mZy5D8qZcSd0NqEt3E Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: b3a875599de043e3ae3b78cbc446ec25 Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersNegativeTestJSON-797711122 Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3a875599de043e3ae3b78cbc446ec25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3a875599de043e3ae3b78cbc446ec25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b3a875599de043e3ae3b78cbc446ec25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b3a875599de043e3ae3b78cbc446ec25"}]}] Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersNegativeTestJSON-797711122 Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: b3a875599de043e3ae3b78cbc446ec25 Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-797711122 Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersNegativeTestJSON-797711122-project Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 8371cdbc486d4f50bbdac5f0452a769a Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersNegativeTestJSON-797711122-project Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: {"resize": {"flavorRef": ""}} Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '996f7fc2-3efc-4ac3-9922-a2ea6eedbaac', 'body': {'resize': {'flavorRef': ''}}} Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise error Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi '' Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:56.816474 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:56.821405 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:56.821405 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:56.821405 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:56.821405 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:56.821405 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 29 03:50:56.821405 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 29 03:50:56.821405 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 29 03:50:56.821405 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:56.821405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-45bc5b07-7af7-41b6-bf6b-fe717526ea61 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:50:56.821405 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-45bc5b07-7af7-41b6-bf6b-fe717526ea61 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "POST /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac/action" status: 400 len: 113 microversion: 2.1 time: 0.009264 Oct 29 03:50:56.821405 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3393/7011] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:50:56 2022] POST /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 03:50:56.826563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9372915a-cb66-4fc3-8956-bdc6b1e09b3c tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:56.827178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9372915a-cb66-4fc3-8956-bdc6b1e09b3c tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:56.834352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9372915a-cb66-4fc3-8956-bdc6b1e09b3c tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:56.834840 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9372915a-cb66-4fc3-8956-bdc6b1e09b3c tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:56.835278 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9372915a-cb66-4fc3-8956-bdc6b1e09b3c tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:56.835976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9372915a-cb66-4fc3-8956-bdc6b1e09b3c tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:56.836417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9372915a-cb66-4fc3-8956-bdc6b1e09b3c tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:56.836872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9372915a-cb66-4fc3-8956-bdc6b1e09b3c tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:56.977562 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9372915a-cb66-4fc3-8956-bdc6b1e09b3c tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:56.985658 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9372915a-cb66-4fc3-8956-bdc6b1e09b3c tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac" status: 200 len: 1505 microversion: 2.1 time: 0.162913 Oct 29 03:50:56.986242 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3619/7012] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:56 2022] GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:57.019008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a1627f6d-71ee-4344-8d81-7ebcf2280519 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:57.019518 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a1627f6d-71ee-4344-8d81-7ebcf2280519 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 325b545a-2424-4dd9-8756-7d1986da7a5d] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:57.026953 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1627f6d-71ee-4344-8d81-7ebcf2280519 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:57.027451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1627f6d-71ee-4344-8d81-7ebcf2280519 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:57.027894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1627f6d-71ee-4344-8d81-7ebcf2280519 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:57.028705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1627f6d-71ee-4344-8d81-7ebcf2280519 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:57.029148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1627f6d-71ee-4344-8d81-7ebcf2280519 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:57.029603 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a1627f6d-71ee-4344-8d81-7ebcf2280519 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:57.044974 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-a1627f6d-71ee-4344-8d81-7ebcf2280519 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] HTTP exception thrown: Instance 325b545a-2424-4dd9-8756-7d1986da7a5d could not be found. Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a1627f6d-71ee-4344-8d81-7ebcf2280519 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Request method failure captured: Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d HTTP/1.1 Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKMEi_WncjbZEtGMPWK1yKRwoV95zow8hsZPrz1L9hWwS2b6PWPxhSC6JTXtirh_C1PCxzHFccQtM0qZx2F89-OLmJGhRx9vnFF55s1sLS_RUhQJpxuqQrAr8Kiy4U15faJ-4fkZHxsMPUQW4uFBvr2BwXwn5mZy5D8qZcSd0NqEt3E Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: b3a875599de043e3ae3b78cbc446ec25 Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersNegativeTestJSON-797711122 Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3a875599de043e3ae3b78cbc446ec25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3a875599de043e3ae3b78cbc446ec25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b3a875599de043e3ae3b78cbc446ec25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b3a875599de043e3ae3b78cbc446ec25"}]}] Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersNegativeTestJSON-797711122 Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: b3a875599de043e3ae3b78cbc446ec25 Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-797711122 Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersNegativeTestJSON-797711122-project Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 8371cdbc486d4f50bbdac5f0452a769a Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersNegativeTestJSON-797711122-project Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 325b545a-2424-4dd9-8756-7d1986da7a5d could not be found. Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '325b545a-2424-4dd9-8756-7d1986da7a5d'} Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 325b545a-2424-4dd9-8756-7d1986da7a5d could not be found. Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:50:57.046584 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:50:57.051141 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 325b545a-2424-4dd9-8756-7d1986da7a5d could not be found. Oct 29 03:50:57.051141 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:57.051141 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:57.051141 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:57.051141 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:57.051141 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:57.051141 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:57.051141 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:50:57.051141 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:50:57.051141 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 325b545a-2424-4dd9-8756-7d1986da7a5d could not be found. Oct 29 03:50:57.051141 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:57.051141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a1627f6d-71ee-4344-8d81-7ebcf2280519 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Returning 404 to user: Instance 325b545a-2424-4dd9-8756-7d1986da7a5d could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:50:57.051141 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a1627f6d-71ee-4344-8d81-7ebcf2280519 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "DELETE /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d" status: 404 len: 111 microversion: 2.1 time: 0.033812 Oct 29 03:50:57.051141 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3394/7013] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:50:57 2022] DELETE /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:50:57.056942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cb02d18b-3598-4654-b5ac-2859e998685d tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:57.057563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cb02d18b-3598-4654-b5ac-2859e998685d tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 325b545a-2424-4dd9-8756-7d1986da7a5d] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:57.064346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cb02d18b-3598-4654-b5ac-2859e998685d tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:57.064870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cb02d18b-3598-4654-b5ac-2859e998685d tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:57.065318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cb02d18b-3598-4654-b5ac-2859e998685d tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:57.066026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cb02d18b-3598-4654-b5ac-2859e998685d tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:57.066481 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cb02d18b-3598-4654-b5ac-2859e998685d tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:57.066938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cb02d18b-3598-4654-b5ac-2859e998685d tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:57.081507 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-cb02d18b-3598-4654-b5ac-2859e998685d tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] HTTP exception thrown: Instance 325b545a-2424-4dd9-8756-7d1986da7a5d could not be found. Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cb02d18b-3598-4654-b5ac-2859e998685d tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Request method failure captured: Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d HTTP/1.1 Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXKMEi_WncjbZEtGMPWK1yKRwoV95zow8hsZPrz1L9hWwS2b6PWPxhSC6JTXtirh_C1PCxzHFccQtM0qZx2F89-OLmJGhRx9vnFF55s1sLS_RUhQJpxuqQrAr8Kiy4U15faJ-4fkZHxsMPUQW4uFBvr2BwXwn5mZy5D8qZcSd0NqEt3E Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: b3a875599de043e3ae3b78cbc446ec25 Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-ServersNegativeTestJSON-797711122 Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3a875599de043e3ae3b78cbc446ec25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3a875599de043e3ae3b78cbc446ec25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b3a875599de043e3ae3b78cbc446ec25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b3a875599de043e3ae3b78cbc446ec25"}]}] Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-ServersNegativeTestJSON-797711122 Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: b3a875599de043e3ae3b78cbc446ec25 Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-ServersNegativeTestJSON-797711122 Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-ServersNegativeTestJSON-797711122-project Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 8371cdbc486d4f50bbdac5f0452a769a Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-ServersNegativeTestJSON-797711122-project Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 325b545a-2424-4dd9-8756-7d1986da7a5d could not be found. Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '325b545a-2424-4dd9-8756-7d1986da7a5d'} Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 325b545a-2424-4dd9-8756-7d1986da7a5d could not be found. Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 325b545a-2424-4dd9-8756-7d1986da7a5d could not be found. Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:57.083253 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:57.088099 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:57.088099 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:57.088099 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:57.088099 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:50:57.088099 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:50:57.088099 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 325b545a-2424-4dd9-8756-7d1986da7a5d could not be found. Oct 29 03:50:57.088099 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 03:50:57.088099 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cb02d18b-3598-4654-b5ac-2859e998685d tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Returning 404 to user: Instance 325b545a-2424-4dd9-8756-7d1986da7a5d could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:50:57.088099 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cb02d18b-3598-4654-b5ac-2859e998685d tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d" status: 404 len: 111 microversion: 2.1 time: 0.031715 Oct 29 03:50:57.088099 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3620/7014] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:57 2022] GET /compute/v2.1/servers/325b545a-2424-4dd9-8756-7d1986da7a5d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:50:57.093482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b5798d57-e945-4bdb-a7c3-08a190c71665 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:57.094015 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b5798d57-e945-4bdb-a7c3-08a190c71665 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:57.099979 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5798d57-e945-4bdb-a7c3-08a190c71665 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:57.100472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5798d57-e945-4bdb-a7c3-08a190c71665 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:57.101499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5798d57-e945-4bdb-a7c3-08a190c71665 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:57.101700 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5798d57-e945-4bdb-a7c3-08a190c71665 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:57.102151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5798d57-e945-4bdb-a7c3-08a190c71665 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:57.102580 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5798d57-e945-4bdb-a7c3-08a190c71665 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:57.128044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b5798d57-e945-4bdb-a7c3-08a190c71665 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:50:57.162690 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:50:57.211942 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b5798d57-e945-4bdb-a7c3-08a190c71665 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "DELETE /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac" status: 204 len: 0 microversion: 2.1 time: 0.122042 Oct 29 03:50:57.212498 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3395/7015] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:50:57 2022] DELETE /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:50:57.221002 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-35909572-45e8-477f-9a82-2fb8c41a000b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:57.221648 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-35909572-45e8-477f-9a82-2fb8c41a000b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:57.228084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35909572-45e8-477f-9a82-2fb8c41a000b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:57.228598 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35909572-45e8-477f-9a82-2fb8c41a000b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:57.229036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35909572-45e8-477f-9a82-2fb8c41a000b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:57.229735 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35909572-45e8-477f-9a82-2fb8c41a000b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:57.230189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35909572-45e8-477f-9a82-2fb8c41a000b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:57.230608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-35909572-45e8-477f-9a82-2fb8c41a000b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:57.367563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-35909572-45e8-477f-9a82-2fb8c41a000b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:57.376016 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-35909572-45e8-477f-9a82-2fb8c41a000b tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac" status: 200 len: 1511 microversion: 2.1 time: 0.159117 Oct 29 03:50:57.376730 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3621/7016] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:57 2022] GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:50:58.400635 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-334bcf53-37d8-49a9-8275-44183c66b889 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:58.401353 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-334bcf53-37d8-49a9-8275-44183c66b889 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:58.408888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-334bcf53-37d8-49a9-8275-44183c66b889 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:58.409390 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-334bcf53-37d8-49a9-8275-44183c66b889 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:58.409843 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-334bcf53-37d8-49a9-8275-44183c66b889 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:58.410575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-334bcf53-37d8-49a9-8275-44183c66b889 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:58.411040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-334bcf53-37d8-49a9-8275-44183c66b889 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:58.411484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-334bcf53-37d8-49a9-8275-44183c66b889 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:58.555718 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-334bcf53-37d8-49a9-8275-44183c66b889 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8371cdbc486d4f50bbdac5f0452a769a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3a875599de043e3ae3b78cbc446ec25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:50:58.567601 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-334bcf53-37d8-49a9-8275-44183c66b889 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac" status: 200 len: 1511 microversion: 2.1 time: 0.171388 Oct 29 03:50:58.568564 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3396/7017] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:58 2022] GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:50:59.089077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-3250ea91-3daf-49e1-bfad-e831cc95245a req-3ec6c7f9-9c4d-4d5f-847f-010aafc98c95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "996f7fc2-3efc-4ac3-9922-a2ea6eedbaac", "name": "network-vif-deleted", "tag": "38545084-4cb1-434f-9fa0-8af0e5172145"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:50:59.100088 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3250ea91-3daf-49e1-bfad-e831cc95245a req-3ec6c7f9-9c4d-4d5f-847f-010aafc98c95 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:59.100724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3250ea91-3daf-49e1-bfad-e831cc95245a req-3ec6c7f9-9c4d-4d5f-847f-010aafc98c95 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:59.101207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3250ea91-3daf-49e1-bfad-e831cc95245a req-3ec6c7f9-9c4d-4d5f-847f-010aafc98c95 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:59.123149 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-3250ea91-3daf-49e1-bfad-e831cc95245a req-3ec6c7f9-9c4d-4d5f-847f-010aafc98c95 service nova] Creating event network-vif-deleted:38545084-4cb1-434f-9fa0-8af0e5172145 for instance 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac on n-h2-862967-2 Oct 29 03:50:59.128155 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-3250ea91-3daf-49e1-bfad-e831cc95245a req-3ec6c7f9-9c4d-4d5f-847f-010aafc98c95 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043171 Oct 29 03:50:59.128811 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3622/7018] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:50:59.592412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8462c383-56e6-4ded-a7c1-b0053cfd6ed4 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:50:59.593268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8462c383-56e6-4ded-a7c1-b0053cfd6ed4 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] [instance: 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:50:59.596653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:50:59.602329 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8462c383-56e6-4ded-a7c1-b0053cfd6ed4 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:59.603046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8462c383-56e6-4ded-a7c1-b0053cfd6ed4 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:59.603510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8462c383-56e6-4ded-a7c1-b0053cfd6ed4 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:59.604239 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8462c383-56e6-4ded-a7c1-b0053cfd6ed4 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:50:59.604746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8462c383-56e6-4ded-a7c1-b0053cfd6ed4 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:50:59.605213 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8462c383-56e6-4ded-a7c1-b0053cfd6ed4 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:50:59.622060 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-8462c383-56e6-4ded-a7c1-b0053cfd6ed4 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] HTTP exception thrown: Instance 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac could not be found. Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8462c383-56e6-4ded-a7c1-b0053cfd6ed4 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Request method failure captured: Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac HTTP/1.1 Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKMEi_WncjbZEtGMPWK1yKRwoV95zow8hsZPrz1L9hWwS2b6PWPxhSC6JTXtirh_C1PCxzHFccQtM0qZx2F89-OLmJGhRx9vnFF55s1sLS_RUhQJpxuqQrAr8Kiy4U15faJ-4fkZHxsMPUQW4uFBvr2BwXwn5mZy5D8qZcSd0NqEt3E Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: b3a875599de043e3ae3b78cbc446ec25 Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-ServersNegativeTestJSON-797711122 Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3a875599de043e3ae3b78cbc446ec25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3a875599de043e3ae3b78cbc446ec25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b3a875599de043e3ae3b78cbc446ec25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b3a875599de043e3ae3b78cbc446ec25"}]}] Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-ServersNegativeTestJSON-797711122 Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: b3a875599de043e3ae3b78cbc446ec25 Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-ServersNegativeTestJSON-797711122 Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-ServersNegativeTestJSON-797711122-project Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 8371cdbc486d4f50bbdac5f0452a769a Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-ServersNegativeTestJSON-797711122-project Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac could not be found. Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '996f7fc2-3efc-4ac3-9922-a2ea6eedbaac'} Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac could not be found. Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac could not be found. Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:50:59.624079 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:59.628574 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:50:59.628574 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:50:59.628574 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:50:59.628574 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:50:59.628574 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:50:59.628574 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac could not be found. Oct 29 03:50:59.628574 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:50:59.628574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8462c383-56e6-4ded-a7c1-b0053cfd6ed4 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] Returning 404 to user: Instance 996f7fc2-3efc-4ac3-9922-a2ea6eedbaac could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:50:59.628574 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8462c383-56e6-4ded-a7c1-b0053cfd6ed4 tempest-ServersNegativeTestJSON-797711122 tempest-ServersNegativeTestJSON-797711122-project] 10.222.0.46 "GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac" status: 404 len: 111 microversion: 2.1 time: 0.037509 Oct 29 03:50:59.628574 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3397/7019] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:50:59 2022] GET /compute/v2.1/servers/996f7fc2-3efc-4ac3-9922-a2ea6eedbaac => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:51:31.905349 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:51:31.906166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=24 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:51:32.106527 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b9d3cc10-315e-4dc0-bdcf-5cbd70458e91 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Action: 'create', calling method: .version_select at 0x7ff053d45e50>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1757488106", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEq4ZLyoK155KJGanOgqhdIXb3RvTePHrfsoD2DNMAKF/DxY1BC7zMwKQ1/v9bb5W6jg6JIIiCWtBHCNLk4RTPTJ/7ips0SvXqgVcpp4rexYCs0JAATE0fTneqZs9rxvkw=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:51:32.123180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-b9d3cc10-315e-4dc0-bdcf-5cbd70458e91 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Getting quotas for project 54f8b7538d0348ce8de7f4823f6477c7. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:51:32.129360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-b9d3cc10-315e-4dc0-bdcf-5cbd70458e91 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Getting quotas for user bd4b9442e97a4ca99b6213b36305bfe9 and project 54f8b7538d0348ce8de7f4823f6477c7. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:51:32.161330 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b9d3cc10-315e-4dc0-bdcf-5cbd70458e91 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.258487 Oct 29 03:51:32.162202 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3623/7020] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:51:31 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:51:32.217141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c6a0fce9-dd37-421b-a2b1-d8b092ae48dc tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-295424671", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1757488106", "networks": [{"uuid": "4f8ff8b5-1930-4940-b79a-4ea11b91b0d2"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:51:32.227431 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:51:32.237069 n-d-862967-2 devstack@n-api.service[127125]: Sat Oct 29 03:51:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.46) !!! Oct 29 03:51:32.237069 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:51:32.237069 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:51:32.285213 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-c6a0fce9-dd37-421b-a2b1-d8b092ae48dc tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] validate_networks() for [('4f8ff8b5-1930-4940-b79a-4ea11b91b0d2', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:51:32.709094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-c6a0fce9-dd37-421b-a2b1-d8b092ae48dc tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:51:32.709666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-c6a0fce9-dd37-421b-a2b1-d8b092ae48dc tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:51:32.710198 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-c6a0fce9-dd37-421b-a2b1-d8b092ae48dc tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:51:32.710619 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-c6a0fce9-dd37-421b-a2b1-d8b092ae48dc tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:51:32.711066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-c6a0fce9-dd37-421b-a2b1-d8b092ae48dc tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:51:32.720892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6a0fce9-dd37-421b-a2b1-d8b092ae48dc tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:32.721387 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6a0fce9-dd37-421b-a2b1-d8b092ae48dc tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:32.721834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6a0fce9-dd37-421b-a2b1-d8b092ae48dc tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:32.722574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6a0fce9-dd37-421b-a2b1-d8b092ae48dc tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:32.723038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6a0fce9-dd37-421b-a2b1-d8b092ae48dc tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:32.723474 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6a0fce9-dd37-421b-a2b1-d8b092ae48dc tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:32.741984 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-c6a0fce9-dd37-421b-a2b1-d8b092ae48dc tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Getting quotas for project 54f8b7538d0348ce8de7f4823f6477c7. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:51:32.747591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-c6a0fce9-dd37-421b-a2b1-d8b092ae48dc tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Getting quotas for user bd4b9442e97a4ca99b6213b36305bfe9 and project 54f8b7538d0348ce8de7f4823f6477c7. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:51:32.760838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c6a0fce9-dd37-421b-a2b1-d8b092ae48dc tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:51:32.763408 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c6a0fce9-dd37-421b-a2b1-d8b092ae48dc tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: a5bf6398-e052-4c9e-ab35-9854a825649f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:51:32.812709 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c6a0fce9-dd37-421b-a2b1-d8b092ae48dc tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599926 Oct 29 03:51:32.813375 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3398/7021] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:51:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:51:32.825214 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-83ee4d58-e1ab-44a6-9d6d-7b6a8a4dcaf2 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:32.825989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-83ee4d58-e1ab-44a6-9d6d-7b6a8a4dcaf2 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: a5bf6398-e052-4c9e-ab35-9854a825649f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:32.885713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-83ee4d58-e1ab-44a6-9d6d-7b6a8a4dcaf2 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:51:32.892999 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-83ee4d58-e1ab-44a6-9d6d-7b6a8a4dcaf2 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f" status: 200 len: 1262 microversion: 2.1 time: 0.072006 Oct 29 03:51:32.893659 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3624/7022] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:51:32 2022] GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f => generated 1262 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:51:33.918074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8820b8eb-d2c8-45ff-98f7-f64580cc4c62 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:33.918700 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8820b8eb-d2c8-45ff-98f7-f64580cc4c62 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: a5bf6398-e052-4c9e-ab35-9854a825649f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:33.926261 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8820b8eb-d2c8-45ff-98f7-f64580cc4c62 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:33.927110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8820b8eb-d2c8-45ff-98f7-f64580cc4c62 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:33.927726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8820b8eb-d2c8-45ff-98f7-f64580cc4c62 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:33.928650 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8820b8eb-d2c8-45ff-98f7-f64580cc4c62 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:33.929397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8820b8eb-d2c8-45ff-98f7-f64580cc4c62 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:33.930005 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8820b8eb-d2c8-45ff-98f7-f64580cc4c62 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:34.011376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8820b8eb-d2c8-45ff-98f7-f64580cc4c62 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:51:34.022247 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8820b8eb-d2c8-45ff-98f7-f64580cc4c62 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f" status: 200 len: 1322 microversion: 2.1 time: 0.109268 Oct 29 03:51:34.022924 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3399/7023] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:51:33 2022] GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f => generated 1322 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:51:35.048291 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7218cee0-1571-4cc4-9b6a-8592717c552e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:35.049602 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7218cee0-1571-4cc4-9b6a-8592717c552e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: a5bf6398-e052-4c9e-ab35-9854a825649f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:35.060248 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7218cee0-1571-4cc4-9b6a-8592717c552e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:35.061047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7218cee0-1571-4cc4-9b6a-8592717c552e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:35.061600 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7218cee0-1571-4cc4-9b6a-8592717c552e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:35.062201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7218cee0-1571-4cc4-9b6a-8592717c552e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:35.065865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7218cee0-1571-4cc4-9b6a-8592717c552e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:35.066335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7218cee0-1571-4cc4-9b6a-8592717c552e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:35.344295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7218cee0-1571-4cc4-9b6a-8592717c552e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:51:35.353658 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7218cee0-1571-4cc4-9b6a-8592717c552e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f" status: 200 len: 1362 microversion: 2.1 time: 0.309501 Oct 29 03:51:35.354693 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3625/7024] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:51:35 2022] GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f => generated 1362 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:51:35.572104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-9e5dd78c-dd80-4621-a19d-d1dda8b2ff59 req-572f9328-0069-4515-859c-9c6b2f6b4e91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5bf6398-e052-4c9e-ab35-9854a825649f", "tag": "7b452d9b-c1c4-4464-bf3b-2f94539fb313"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:51:35.598524 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9e5dd78c-dd80-4621-a19d-d1dda8b2ff59 req-572f9328-0069-4515-859c-9c6b2f6b4e91 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:35.600714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9e5dd78c-dd80-4621-a19d-d1dda8b2ff59 req-572f9328-0069-4515-859c-9c6b2f6b4e91 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:35.600714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9e5dd78c-dd80-4621-a19d-d1dda8b2ff59 req-572f9328-0069-4515-859c-9c6b2f6b4e91 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:35.617998 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-9e5dd78c-dd80-4621-a19d-d1dda8b2ff59 req-572f9328-0069-4515-859c-9c6b2f6b4e91 service nova] Creating event network-changed:7b452d9b-c1c4-4464-bf3b-2f94539fb313 for instance a5bf6398-e052-4c9e-ab35-9854a825649f on n-h2-862967-2 Oct 29 03:51:35.625471 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-9e5dd78c-dd80-4621-a19d-d1dda8b2ff59 req-572f9328-0069-4515-859c-9c6b2f6b4e91 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057714 Oct 29 03:51:35.628232 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3400/7025] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:51:36.380163 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7575d66f-23b5-4ba0-a57c-f98ae3345449 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:36.380809 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7575d66f-23b5-4ba0-a57c-f98ae3345449 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: a5bf6398-e052-4c9e-ab35-9854a825649f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:36.388169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7575d66f-23b5-4ba0-a57c-f98ae3345449 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:36.388779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7575d66f-23b5-4ba0-a57c-f98ae3345449 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:36.389239 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7575d66f-23b5-4ba0-a57c-f98ae3345449 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:36.389956 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7575d66f-23b5-4ba0-a57c-f98ae3345449 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:36.390422 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7575d66f-23b5-4ba0-a57c-f98ae3345449 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:36.390846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7575d66f-23b5-4ba0-a57c-f98ae3345449 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:36.538669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7575d66f-23b5-4ba0-a57c-f98ae3345449 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:51:36.546982 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7575d66f-23b5-4ba0-a57c-f98ae3345449 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f" status: 200 len: 1362 microversion: 2.1 time: 0.171164 Oct 29 03:51:36.547577 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3626/7026] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:51:36 2022] GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:51:37.572984 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d9c8e738-ef45-4626-8113-8067a7ca2f6c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:37.573721 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d9c8e738-ef45-4626-8113-8067a7ca2f6c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: a5bf6398-e052-4c9e-ab35-9854a825649f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:37.580783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d9c8e738-ef45-4626-8113-8067a7ca2f6c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:37.581298 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d9c8e738-ef45-4626-8113-8067a7ca2f6c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:37.581758 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d9c8e738-ef45-4626-8113-8067a7ca2f6c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:37.582522 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d9c8e738-ef45-4626-8113-8067a7ca2f6c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:37.583003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d9c8e738-ef45-4626-8113-8067a7ca2f6c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:37.583444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d9c8e738-ef45-4626-8113-8067a7ca2f6c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:37.727815 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d9c8e738-ef45-4626-8113-8067a7ca2f6c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:51:37.736286 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d9c8e738-ef45-4626-8113-8067a7ca2f6c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f" status: 200 len: 1362 microversion: 2.1 time: 0.168862 Oct 29 03:51:37.737003 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3401/7027] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:51:37 2022] GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:51:38.759816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b4286b60-ef75-420d-89b2-4113b817d8ba tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:38.760423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b4286b60-ef75-420d-89b2-4113b817d8ba tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: a5bf6398-e052-4c9e-ab35-9854a825649f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:38.767888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4286b60-ef75-420d-89b2-4113b817d8ba tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:38.768386 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4286b60-ef75-420d-89b2-4113b817d8ba tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:38.768857 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4286b60-ef75-420d-89b2-4113b817d8ba tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:38.769569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4286b60-ef75-420d-89b2-4113b817d8ba tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:38.770047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4286b60-ef75-420d-89b2-4113b817d8ba tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:38.770491 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b4286b60-ef75-420d-89b2-4113b817d8ba tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:38.908485 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b4286b60-ef75-420d-89b2-4113b817d8ba tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:51:38.916784 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b4286b60-ef75-420d-89b2-4113b817d8ba tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f" status: 200 len: 1362 microversion: 2.1 time: 0.161084 Oct 29 03:51:38.917337 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3627/7028] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:51:38 2022] GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:51:39.477324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-663c57ff-488d-4793-af29-2e5408fe8715 req-a601d588-32b4-476c-beb0-7a25362b7625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5bf6398-e052-4c9e-ab35-9854a825649f", "name": "network-vif-plugged", "status": "completed", "tag": "7b452d9b-c1c4-4464-bf3b-2f94539fb313"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:51:39.488384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-663c57ff-488d-4793-af29-2e5408fe8715 req-a601d588-32b4-476c-beb0-7a25362b7625 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:39.488909 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-663c57ff-488d-4793-af29-2e5408fe8715 req-a601d588-32b4-476c-beb0-7a25362b7625 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:39.489356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-663c57ff-488d-4793-af29-2e5408fe8715 req-a601d588-32b4-476c-beb0-7a25362b7625 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:39.504966 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-663c57ff-488d-4793-af29-2e5408fe8715 req-a601d588-32b4-476c-beb0-7a25362b7625 service nova] Creating event network-vif-plugged:7b452d9b-c1c4-4464-bf3b-2f94539fb313 for instance a5bf6398-e052-4c9e-ab35-9854a825649f on n-h2-862967-2 Oct 29 03:51:39.510168 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-663c57ff-488d-4793-af29-2e5408fe8715 req-a601d588-32b4-476c-beb0-7a25362b7625 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037295 Oct 29 03:51:39.510799 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3402/7029] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:51:39.939914 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9b2cd03f-dbc7-4d1f-83ae-169fbb348d1c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:39.940450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9b2cd03f-dbc7-4d1f-83ae-169fbb348d1c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: a5bf6398-e052-4c9e-ab35-9854a825649f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:39.947700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b2cd03f-dbc7-4d1f-83ae-169fbb348d1c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:39.948188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b2cd03f-dbc7-4d1f-83ae-169fbb348d1c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:39.948655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b2cd03f-dbc7-4d1f-83ae-169fbb348d1c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:39.949357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b2cd03f-dbc7-4d1f-83ae-169fbb348d1c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:39.949809 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b2cd03f-dbc7-4d1f-83ae-169fbb348d1c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:39.950228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b2cd03f-dbc7-4d1f-83ae-169fbb348d1c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:40.090786 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9b2cd03f-dbc7-4d1f-83ae-169fbb348d1c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:51:40.098914 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9b2cd03f-dbc7-4d1f-83ae-169fbb348d1c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f" status: 200 len: 1362 microversion: 2.1 time: 0.163085 Oct 29 03:51:40.099502 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3628/7030] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:51:39 2022] GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:51:41.124342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-49bbffc2-298f-491b-92f5-fc45dc4c2ab6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:41.125084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-49bbffc2-298f-491b-92f5-fc45dc4c2ab6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: a5bf6398-e052-4c9e-ab35-9854a825649f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:41.131847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-49bbffc2-298f-491b-92f5-fc45dc4c2ab6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:41.132354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-49bbffc2-298f-491b-92f5-fc45dc4c2ab6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:41.132847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-49bbffc2-298f-491b-92f5-fc45dc4c2ab6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:41.133564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-49bbffc2-298f-491b-92f5-fc45dc4c2ab6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:41.134032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-49bbffc2-298f-491b-92f5-fc45dc4c2ab6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:41.134504 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-49bbffc2-298f-491b-92f5-fc45dc4c2ab6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:41.278352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-49bbffc2-298f-491b-92f5-fc45dc4c2ab6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:51:41.287368 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-49bbffc2-298f-491b-92f5-fc45dc4c2ab6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f" status: 200 len: 1555 microversion: 2.1 time: 0.168331 Oct 29 03:51:41.287933 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3403/7031] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:51:41 2022] GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:51:41.313706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-37d4683b-66df-41bd-8353-853222fb6cae tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:41.314321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-37d4683b-66df-41bd-8353-853222fb6cae tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: a5bf6398-e052-4c9e-ab35-9854a825649f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:41.321505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37d4683b-66df-41bd-8353-853222fb6cae tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:41.322047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37d4683b-66df-41bd-8353-853222fb6cae tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:41.322492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37d4683b-66df-41bd-8353-853222fb6cae tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:41.323207 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37d4683b-66df-41bd-8353-853222fb6cae tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:41.323667 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37d4683b-66df-41bd-8353-853222fb6cae tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:41.324096 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37d4683b-66df-41bd-8353-853222fb6cae tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:41.460124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-37d4683b-66df-41bd-8353-853222fb6cae tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:51:41.468484 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-37d4683b-66df-41bd-8353-853222fb6cae tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f" status: 200 len: 1555 microversion: 2.1 time: 0.158790 Oct 29 03:51:41.469217 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3629/7032] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:51:41 2022] GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:51:43.132217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-25e5d435-b704-4ef9-b177-f64b2a08a882 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06af7508-11b8-43c6-bffc-1be7c46ebb52"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:51:43.134898 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-25e5d435-b704-4ef9-b177-f64b2a08a882 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: a5bf6398-e052-4c9e-ab35-9854a825649f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:43.139481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:51:43.140288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:51:43.145334 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-25e5d435-b704-4ef9-b177-f64b2a08a882 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:43.145844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-25e5d435-b704-4ef9-b177-f64b2a08a882 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:43.146338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-25e5d435-b704-4ef9-b177-f64b2a08a882 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:43.147922 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-25e5d435-b704-4ef9-b177-f64b2a08a882 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:43.148391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-25e5d435-b704-4ef9-b177-f64b2a08a882 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:43.148864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-25e5d435-b704-4ef9-b177-f64b2a08a882 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:43.414794 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-25e5d435-b704-4ef9-b177-f64b2a08a882 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "POST /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286798 Oct 29 03:51:43.415439 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3404/7033] 10.222.0.46 () {60 vars in 1323 bytes} [Sat Oct 29 03:51:43 2022] POST /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:51:54.259579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a5a5e6be-7d62-4819-836e-40e3b3dd0aa4 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:54.260192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a5a5e6be-7d62-4819-836e-40e3b3dd0aa4 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: a5bf6398-e052-4c9e-ab35-9854a825649f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:54.262897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:51:54.263632 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:51:54.264340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=30 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:51:54.270599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a5a5e6be-7d62-4819-836e-40e3b3dd0aa4 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:54.271083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a5a5e6be-7d62-4819-836e-40e3b3dd0aa4 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:54.271524 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a5a5e6be-7d62-4819-836e-40e3b3dd0aa4 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:54.272222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a5a5e6be-7d62-4819-836e-40e3b3dd0aa4 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:54.272705 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a5a5e6be-7d62-4819-836e-40e3b3dd0aa4 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:54.273128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a5a5e6be-7d62-4819-836e-40e3b3dd0aa4 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:54.356704 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-a5a5e6be-7d62-4819-836e-40e3b3dd0aa4 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lazy-loading 'services' on Instance uuid a5bf6398-e052-4c9e-ab35-9854a825649f {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:51:54.433160 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a5a5e6be-7d62-4819-836e-40e3b3dd0aa4 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f/os-volume_attachments/06af7508-11b8-43c6-bffc-1be7c46ebb52" status: 202 len: 0 microversion: 2.1 time: 0.177478 Oct 29 03:51:54.433776 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3630/7034] 10.222.0.46 () {58 vars in 1416 bytes} [Sat Oct 29 03:51:54 2022] DELETE /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f/os-volume_attachments/06af7508-11b8-43c6-bffc-1be7c46ebb52 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:51:54.440326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:51:54.441431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:51:54.446271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d8311cc3-86c8-421f-be55-e5ccea6902a6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:54.448807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d8311cc3-86c8-421f-be55-e5ccea6902a6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: a5bf6398-e052-4c9e-ab35-9854a825649f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:54.457469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8311cc3-86c8-421f-be55-e5ccea6902a6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:54.458083 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8311cc3-86c8-421f-be55-e5ccea6902a6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:54.458537 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8311cc3-86c8-421f-be55-e5ccea6902a6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:54.459260 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8311cc3-86c8-421f-be55-e5ccea6902a6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:54.459725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8311cc3-86c8-421f-be55-e5ccea6902a6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:54.460161 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8311cc3-86c8-421f-be55-e5ccea6902a6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:54.495139 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d8311cc3-86c8-421f-be55-e5ccea6902a6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056601 Oct 29 03:51:54.495710 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3405/7035] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:51:54 2022] GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:51:55.511206 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-92136050-f25b-4299-8a6e-6e91ecdabf1a tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:55.514449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-92136050-f25b-4299-8a6e-6e91ecdabf1a tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: a5bf6398-e052-4c9e-ab35-9854a825649f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:55.521337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92136050-f25b-4299-8a6e-6e91ecdabf1a tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:55.522125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92136050-f25b-4299-8a6e-6e91ecdabf1a tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:55.522852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92136050-f25b-4299-8a6e-6e91ecdabf1a tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:55.523806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92136050-f25b-4299-8a6e-6e91ecdabf1a tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:55.524679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92136050-f25b-4299-8a6e-6e91ecdabf1a tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:55.525315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-92136050-f25b-4299-8a6e-6e91ecdabf1a tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:55.559153 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-92136050-f25b-4299-8a6e-6e91ecdabf1a tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054895 Oct 29 03:51:55.560135 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3631/7036] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:51:55 2022] GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:51:56.573570 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-00cbfa3e-bbb8-49db-8af5-9924b5ed741b tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:56.575923 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-00cbfa3e-bbb8-49db-8af5-9924b5ed741b tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: a5bf6398-e052-4c9e-ab35-9854a825649f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:56.583524 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00cbfa3e-bbb8-49db-8af5-9924b5ed741b tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:56.584060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00cbfa3e-bbb8-49db-8af5-9924b5ed741b tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:56.584506 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00cbfa3e-bbb8-49db-8af5-9924b5ed741b tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:56.585259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00cbfa3e-bbb8-49db-8af5-9924b5ed741b tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:56.585745 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00cbfa3e-bbb8-49db-8af5-9924b5ed741b tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:56.586196 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-00cbfa3e-bbb8-49db-8af5-9924b5ed741b tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:56.620222 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-00cbfa3e-bbb8-49db-8af5-9924b5ed741b tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051581 Oct 29 03:51:56.621143 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3406/7037] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:51:56 2022] GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:51:57.633461 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-59088c87-8fa1-4644-a40a-c56b164fe2fd tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:57.635732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-59088c87-8fa1-4644-a40a-c56b164fe2fd tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: a5bf6398-e052-4c9e-ab35-9854a825649f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:57.643076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59088c87-8fa1-4644-a40a-c56b164fe2fd tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:57.643577 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59088c87-8fa1-4644-a40a-c56b164fe2fd tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:57.644014 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59088c87-8fa1-4644-a40a-c56b164fe2fd tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:57.644765 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59088c87-8fa1-4644-a40a-c56b164fe2fd tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:57.645223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59088c87-8fa1-4644-a40a-c56b164fe2fd tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:57.645652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59088c87-8fa1-4644-a40a-c56b164fe2fd tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:57.677079 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-59088c87-8fa1-4644-a40a-c56b164fe2fd tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047740 Oct 29 03:51:57.677669 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3632/7038] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:51:57 2022] GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:51:58.690181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6d89fac9-3972-473b-8479-00827b815cdf tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:58.692582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6d89fac9-3972-473b-8479-00827b815cdf tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: a5bf6398-e052-4c9e-ab35-9854a825649f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:58.700028 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d89fac9-3972-473b-8479-00827b815cdf tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:58.700565 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d89fac9-3972-473b-8479-00827b815cdf tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:58.701146 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d89fac9-3972-473b-8479-00827b815cdf tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:58.701874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d89fac9-3972-473b-8479-00827b815cdf tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:58.702321 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d89fac9-3972-473b-8479-00827b815cdf tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:58.702787 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d89fac9-3972-473b-8479-00827b815cdf tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:58.734175 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6d89fac9-3972-473b-8479-00827b815cdf tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048013 Oct 29 03:51:58.734771 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3407/7039] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:51:58 2022] GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:51:59.748419 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c0fc068a-fe85-446c-9906-e588c098285e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:59.750669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c0fc068a-fe85-446c-9906-e588c098285e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: a5bf6398-e052-4c9e-ab35-9854a825649f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:59.758027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0fc068a-fe85-446c-9906-e588c098285e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:59.758518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0fc068a-fe85-446c-9906-e588c098285e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:59.758960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0fc068a-fe85-446c-9906-e588c098285e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:59.759663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0fc068a-fe85-446c-9906-e588c098285e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:59.760100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0fc068a-fe85-446c-9906-e588c098285e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:59.760551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0fc068a-fe85-446c-9906-e588c098285e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:59.790768 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c0fc068a-fe85-446c-9906-e588c098285e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046831 Oct 29 03:51:59.791335 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3633/7040] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:51:59 2022] GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:51:59.802886 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-40d8f351-5047-437e-966c-1407e1459684 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:51:59.803414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-40d8f351-5047-437e-966c-1407e1459684 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: a5bf6398-e052-4c9e-ab35-9854a825649f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:51:59.811030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40d8f351-5047-437e-966c-1407e1459684 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:59.811539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40d8f351-5047-437e-966c-1407e1459684 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:59.811975 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40d8f351-5047-437e-966c-1407e1459684 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:59.812718 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40d8f351-5047-437e-966c-1407e1459684 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:51:59.813185 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40d8f351-5047-437e-966c-1407e1459684 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:51:59.813617 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-40d8f351-5047-437e-966c-1407e1459684 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:51:59.894490 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-40d8f351-5047-437e-966c-1407e1459684 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] HTTP exception thrown: Instance a5bf6398-e052-4c9e-ab35-9854a825649f is not attached to volume 06af7508-11b8-43c6-bffc-1be7c46ebb52 Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-40d8f351-5047-437e-966c-1407e1459684 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Request method failure captured: Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f/os-volume_attachments/06af7508-11b8-43c6-bffc-1be7c46ebb52 HTTP/1.1 Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKM-KW2ImsqsWPxxdQ4iU2bJWCF75CcDjn_98DpXJGWok9dAQaJ31I1uwJv5AlJghXyVeWsHA8LbUOOTj7pmpaFj3qQZ33fXoC-Ws_o9WdjyZykOImssXxUskcQkml55G71kAjMKT1iZ2DTEl73APBqgd-SfAs4N7rHndU7JsWSavWg Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 54f8b7538d0348ce8de7f4823f6477c7 Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestEncryptedCinderVolumes-883383401 Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/54f8b7538d0348ce8de7f4823f6477c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/54f8b7538d0348ce8de7f4823f6477c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_54f8b7538d0348ce8de7f4823f6477c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/54f8b7538d0348ce8de7f4823f6477c7"}]}] Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestEncryptedCinderVolumes-883383401 Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 54f8b7538d0348ce8de7f4823f6477c7 Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-883383401 Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestEncryptedCinderVolumes-883383401-project Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: bd4b9442e97a4ca99b6213b36305bfe9 Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestEncryptedCinderVolumes-883383401-project Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance a5bf6398-e052-4c9e-ab35-9854a825649f is not attached to volume 06af7508-11b8-43c6-bffc-1be7c46ebb52 Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'server_id': 'a5bf6398-e052-4c9e-ab35-9854a825649f', 'id': '06af7508-11b8-43c6-bffc-1be7c46ebb52'} Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 06af7508-11b8-43c6-bffc-1be7c46ebb52. Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5bf6398-e052-4c9e-ab35-9854a825649f is not attached to volume 06af7508-11b8-43c6-bffc-1be7c46ebb52 Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:51:59.903936 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:51:59.909071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:51:59.909071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:51:59.909071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5bf6398-e052-4c9e-ab35-9854a825649f is not attached to volume 06af7508-11b8-43c6-bffc-1be7c46ebb52 Oct 29 03:51:59.909071 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:51:59.909071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-40d8f351-5047-437e-966c-1407e1459684 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Returning 404 to user: Instance a5bf6398-e052-4c9e-ab35-9854a825649f is not attached to volume 06af7508-11b8-43c6-bffc-1be7c46ebb52 {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:51:59.909071 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-40d8f351-5047-437e-966c-1407e1459684 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f/os-volume_attachments/06af7508-11b8-43c6-bffc-1be7c46ebb52" status: 404 len: 154 microversion: 2.1 time: 0.106791 Oct 29 03:51:59.909071 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3408/7041] 10.222.0.46 () {58 vars in 1416 bytes} [Sat Oct 29 03:51:59 2022] DELETE /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f/os-volume_attachments/06af7508-11b8-43c6-bffc-1be7c46ebb52 => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:52:03.314984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5ec46b26-9fbd-4649-bf9b-427d533a9c28 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:03.315736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5ec46b26-9fbd-4649-bf9b-427d533a9c28 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: a5bf6398-e052-4c9e-ab35-9854a825649f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:03.322937 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ec46b26-9fbd-4649-bf9b-427d533a9c28 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:03.323470 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ec46b26-9fbd-4649-bf9b-427d533a9c28 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:03.323913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ec46b26-9fbd-4649-bf9b-427d533a9c28 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:03.324663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ec46b26-9fbd-4649-bf9b-427d533a9c28 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:03.325235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ec46b26-9fbd-4649-bf9b-427d533a9c28 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:03.325539 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5ec46b26-9fbd-4649-bf9b-427d533a9c28 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:03.357683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5ec46b26-9fbd-4649-bf9b-427d533a9c28 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: a5bf6398-e052-4c9e-ab35-9854a825649f] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:52:03.448298 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5ec46b26-9fbd-4649-bf9b-427d533a9c28 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f" status: 204 len: 0 microversion: 2.1 time: 0.136536 Oct 29 03:52:03.449221 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3634/7042] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:52:03 2022] DELETE /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:52:03.457997 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-025c9357-689a-4925-937d-9a35b22dd817 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:03.458625 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-025c9357-689a-4925-937d-9a35b22dd817 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: a5bf6398-e052-4c9e-ab35-9854a825649f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:03.469794 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-025c9357-689a-4925-937d-9a35b22dd817 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:03.470534 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-025c9357-689a-4925-937d-9a35b22dd817 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:03.470937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-025c9357-689a-4925-937d-9a35b22dd817 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:03.470937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-025c9357-689a-4925-937d-9a35b22dd817 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:03.472143 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-025c9357-689a-4925-937d-9a35b22dd817 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:03.472599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-025c9357-689a-4925-937d-9a35b22dd817 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:03.618140 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-025c9357-689a-4925-937d-9a35b22dd817 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:03.628492 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-025c9357-689a-4925-937d-9a35b22dd817 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f" status: 200 len: 1561 microversion: 2.1 time: 0.174655 Oct 29 03:52:03.629188 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3409/7043] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:03 2022] GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f => generated 1561 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:52:04.657082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8fb2f255-5262-4e80-a17f-b5f732718859 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:04.658099 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8fb2f255-5262-4e80-a17f-b5f732718859 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: a5bf6398-e052-4c9e-ab35-9854a825649f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:04.668465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fb2f255-5262-4e80-a17f-b5f732718859 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:04.668982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fb2f255-5262-4e80-a17f-b5f732718859 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:04.669413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fb2f255-5262-4e80-a17f-b5f732718859 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:04.670103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fb2f255-5262-4e80-a17f-b5f732718859 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:04.670548 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fb2f255-5262-4e80-a17f-b5f732718859 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:04.670970 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8fb2f255-5262-4e80-a17f-b5f732718859 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:04.809465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8fb2f255-5262-4e80-a17f-b5f732718859 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:04.822751 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8fb2f255-5262-4e80-a17f-b5f732718859 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f" status: 200 len: 1561 microversion: 2.1 time: 0.172940 Oct 29 03:52:04.823470 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3635/7044] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:04 2022] GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:05.716012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-9736d9d0-1c59-4c20-b5fd-a00fd21a9aa2 req-57c4c98e-e52b-4af6-94f9-15419e83c514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5bf6398-e052-4c9e-ab35-9854a825649f", "name": "network-vif-deleted", "tag": "7b452d9b-c1c4-4464-bf3b-2f94539fb313"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:52:05.726695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9736d9d0-1c59-4c20-b5fd-a00fd21a9aa2 req-57c4c98e-e52b-4af6-94f9-15419e83c514 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:05.727189 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9736d9d0-1c59-4c20-b5fd-a00fd21a9aa2 req-57c4c98e-e52b-4af6-94f9-15419e83c514 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:05.727631 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9736d9d0-1c59-4c20-b5fd-a00fd21a9aa2 req-57c4c98e-e52b-4af6-94f9-15419e83c514 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:05.739493 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-9736d9d0-1c59-4c20-b5fd-a00fd21a9aa2 req-57c4c98e-e52b-4af6-94f9-15419e83c514 service nova] Creating event network-vif-deleted:7b452d9b-c1c4-4464-bf3b-2f94539fb313 for instance a5bf6398-e052-4c9e-ab35-9854a825649f on n-h2-862967-2 Oct 29 03:52:05.745151 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-9736d9d0-1c59-4c20-b5fd-a00fd21a9aa2 req-57c4c98e-e52b-4af6-94f9-15419e83c514 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032844 Oct 29 03:52:05.745739 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3410/7045] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:52:05.855391 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9d992ce8-f028-44a2-bb16-79b35927d538 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:05.855995 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9d992ce8-f028-44a2-bb16-79b35927d538 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: a5bf6398-e052-4c9e-ab35-9854a825649f] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:05.864802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d992ce8-f028-44a2-bb16-79b35927d538 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:05.865373 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d992ce8-f028-44a2-bb16-79b35927d538 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:05.865810 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d992ce8-f028-44a2-bb16-79b35927d538 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:05.866809 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d992ce8-f028-44a2-bb16-79b35927d538 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:05.867270 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d992ce8-f028-44a2-bb16-79b35927d538 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:05.867694 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d992ce8-f028-44a2-bb16-79b35927d538 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:05.902616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d992ce8-f028-44a2-bb16-79b35927d538 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:05.903107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d992ce8-f028-44a2-bb16-79b35927d538 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:05.903601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d992ce8-f028-44a2-bb16-79b35927d538 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:05.903978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-9d992ce8-f028-44a2-bb16-79b35927d538 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lazy-loading 'fault' on Instance uuid a5bf6398-e052-4c9e-ab35-9854a825649f {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:52:05.944321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9d992ce8-f028-44a2-bb16-79b35927d538 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:05.952376 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9d992ce8-f028-44a2-bb16-79b35927d538 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f" status: 200 len: 1352 microversion: 2.1 time: 0.101584 Oct 29 03:52:05.952917 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3636/7046] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:05 2022] GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f => generated 1352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:06.981723 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ae601347-b1d5-4463-942f-c89ac80d5935 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:06.982316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ae601347-b1d5-4463-942f-c89ac80d5935 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: a5bf6398-e052-4c9e-ab35-9854a825649f] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:06.989324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae601347-b1d5-4463-942f-c89ac80d5935 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:06.989825 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae601347-b1d5-4463-942f-c89ac80d5935 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:06.990314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae601347-b1d5-4463-942f-c89ac80d5935 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:06.991006 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae601347-b1d5-4463-942f-c89ac80d5935 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:06.991468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae601347-b1d5-4463-942f-c89ac80d5935 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:06.992243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ae601347-b1d5-4463-942f-c89ac80d5935 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:07.006297 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-ae601347-b1d5-4463-942f-c89ac80d5935 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] HTTP exception thrown: Instance a5bf6398-e052-4c9e-ab35-9854a825649f could not be found. Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ae601347-b1d5-4463-942f-c89ac80d5935 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Request method failure captured: Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f HTTP/1.1 Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKM-KW2ImsqsWPxxdQ4iU2bJWCF75CcDjn_98DpXJGWok9dAQaJ31I1uwJv5AlJghXyVeWsHA8LbUOOTj7pmpaFj3qQZ33fXoC-Ws_o9WdjyZykOImssXxUskcQkml55G71kAjMKT1iZ2DTEl73APBqgd-SfAs4N7rHndU7JsWSavWg Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 54f8b7538d0348ce8de7f4823f6477c7 Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestEncryptedCinderVolumes-883383401 Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/54f8b7538d0348ce8de7f4823f6477c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/54f8b7538d0348ce8de7f4823f6477c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_54f8b7538d0348ce8de7f4823f6477c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/54f8b7538d0348ce8de7f4823f6477c7"}]}] Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestEncryptedCinderVolumes-883383401 Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 54f8b7538d0348ce8de7f4823f6477c7 Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-883383401 Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestEncryptedCinderVolumes-883383401-project Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: bd4b9442e97a4ca99b6213b36305bfe9 Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestEncryptedCinderVolumes-883383401-project Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance a5bf6398-e052-4c9e-ab35-9854a825649f could not be found. Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'a5bf6398-e052-4c9e-ab35-9854a825649f'} Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5bf6398-e052-4c9e-ab35-9854a825649f could not be found. Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5bf6398-e052-4c9e-ab35-9854a825649f could not be found. Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:52:07.008008 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:52:07.012943 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:52:07.012943 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:52:07.012943 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:52:07.012943 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:52:07.012943 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:52:07.012943 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5bf6398-e052-4c9e-ab35-9854a825649f could not be found. Oct 29 03:52:07.012943 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:52:07.012943 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ae601347-b1d5-4463-942f-c89ac80d5935 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Returning 404 to user: Instance a5bf6398-e052-4c9e-ab35-9854a825649f could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:52:07.012943 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ae601347-b1d5-4463-942f-c89ac80d5935 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f" status: 404 len: 111 microversion: 2.1 time: 0.035807 Oct 29 03:52:07.012943 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3411/7047] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:06 2022] GET /compute/v2.1/servers/a5bf6398-e052-4c9e-ab35-9854a825649f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:52:07.018738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fc703f6b-d08a-4274-9b19-2d8efe114cf8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '.version_select at 0x7ff05827c4c0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:07.042820 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fc703f6b-d08a-4274-9b19-2d8efe114cf8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1757488106" status: 202 len: 0 microversion: 2.1 time: 0.028091 Oct 29 03:52:07.043411 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3637/7048] 10.222.0.46 () {58 vars in 1278 bytes} [Sat Oct 29 03:52:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1757488106 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 03:52:07.063240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b06b87ff-d897-43f7-81df-05e3b5d1d3e9 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Action: 'create', calling method: .version_select at 0x7ff053ea3940>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-575079825", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOe82eE1ENPRdgWdBncLNBmeJWI/Se/ebqn6f8x3qv1sIQtx5mZsIOb443cQ6n9tE3CjYa7ux/Y5ljo4k0294EGP1It843t80/4VPvrdHO2XrrA5UwB2MzbfbrJ8mUqxRQ=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:52:07.079621 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-b06b87ff-d897-43f7-81df-05e3b5d1d3e9 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Getting quotas for project 54f8b7538d0348ce8de7f4823f6477c7. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:52:07.085574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-b06b87ff-d897-43f7-81df-05e3b5d1d3e9 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Getting quotas for user bd4b9442e97a4ca99b6213b36305bfe9 and project 54f8b7538d0348ce8de7f4823f6477c7. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:52:07.117485 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b06b87ff-d897-43f7-81df-05e3b5d1d3e9 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.058177 Oct 29 03:52:07.118105 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3412/7049] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:52:07 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:52:07.169947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ced1e666-8ff7-464b-b85a-a71c54bd9c10 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-138987394", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-575079825", "networks": [{"uuid": "4f8ff8b5-1930-4940-b79a-4ea11b91b0d2"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:52:07.222802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-ced1e666-8ff7-464b-b85a-a71c54bd9c10 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] validate_networks() for [('4f8ff8b5-1930-4940-b79a-4ea11b91b0d2', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:52:07.723933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-ced1e666-8ff7-464b-b85a-a71c54bd9c10 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:52:07.724543 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-ced1e666-8ff7-464b-b85a-a71c54bd9c10 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:52:07.725072 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-ced1e666-8ff7-464b-b85a-a71c54bd9c10 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:52:07.725445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-ced1e666-8ff7-464b-b85a-a71c54bd9c10 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:52:07.725936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-ced1e666-8ff7-464b-b85a-a71c54bd9c10 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:52:07.736981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ced1e666-8ff7-464b-b85a-a71c54bd9c10 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:07.737459 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ced1e666-8ff7-464b-b85a-a71c54bd9c10 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:07.737889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ced1e666-8ff7-464b-b85a-a71c54bd9c10 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:07.738648 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ced1e666-8ff7-464b-b85a-a71c54bd9c10 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:07.739098 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ced1e666-8ff7-464b-b85a-a71c54bd9c10 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:07.739517 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ced1e666-8ff7-464b-b85a-a71c54bd9c10 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:07.757310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-ced1e666-8ff7-464b-b85a-a71c54bd9c10 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Getting quotas for project 54f8b7538d0348ce8de7f4823f6477c7. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:52:07.762996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-ced1e666-8ff7-464b-b85a-a71c54bd9c10 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Getting quotas for user bd4b9442e97a4ca99b6213b36305bfe9 and project 54f8b7538d0348ce8de7f4823f6477c7. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:52:07.775618 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ced1e666-8ff7-464b-b85a-a71c54bd9c10 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:52:07.778161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ced1e666-8ff7-464b-b85a-a71c54bd9c10 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 80c41d7d-e72d-4496-aa08-7d38a2600219] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:52:07.829420 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ced1e666-8ff7-464b-b85a-a71c54bd9c10 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663543 Oct 29 03:52:07.830461 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3638/7050] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:52:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:52:07.847882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f67a71f4-4083-42d5-8ada-078842816b96 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:07.848810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f67a71f4-4083-42d5-8ada-078842816b96 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 80c41d7d-e72d-4496-aa08-7d38a2600219] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:07.906779 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f67a71f4-4083-42d5-8ada-078842816b96 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:07.914167 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f67a71f4-4083-42d5-8ada-078842816b96 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219" status: 200 len: 1261 microversion: 2.1 time: 0.072371 Oct 29 03:52:07.914754 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3413/7051] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:07 2022] GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219 => generated 1261 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:08.938772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1d5f3c36-339b-4bc1-be34-3aad915c477f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:08.940041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1d5f3c36-339b-4bc1-be34-3aad915c477f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 80c41d7d-e72d-4496-aa08-7d38a2600219] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:08.947925 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d5f3c36-339b-4bc1-be34-3aad915c477f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:08.948411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d5f3c36-339b-4bc1-be34-3aad915c477f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:08.949096 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d5f3c36-339b-4bc1-be34-3aad915c477f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:08.949994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d5f3c36-339b-4bc1-be34-3aad915c477f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:08.950630 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d5f3c36-339b-4bc1-be34-3aad915c477f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:08.951224 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1d5f3c36-339b-4bc1-be34-3aad915c477f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:09.031025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1d5f3c36-339b-4bc1-be34-3aad915c477f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:09.038900 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1d5f3c36-339b-4bc1-be34-3aad915c477f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219" status: 200 len: 1331 microversion: 2.1 time: 0.105177 Oct 29 03:52:09.039523 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3639/7052] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:08 2022] GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219 => generated 1331 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:10.063065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3ac15ad8-ed0d-404e-9de0-e26f9195d983 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:10.063612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3ac15ad8-ed0d-404e-9de0-e26f9195d983 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 80c41d7d-e72d-4496-aa08-7d38a2600219] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:10.071652 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ac15ad8-ed0d-404e-9de0-e26f9195d983 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:10.072220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ac15ad8-ed0d-404e-9de0-e26f9195d983 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:10.072966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ac15ad8-ed0d-404e-9de0-e26f9195d983 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:10.073817 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ac15ad8-ed0d-404e-9de0-e26f9195d983 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:10.074551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ac15ad8-ed0d-404e-9de0-e26f9195d983 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:10.075204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ac15ad8-ed0d-404e-9de0-e26f9195d983 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:10.220450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3ac15ad8-ed0d-404e-9de0-e26f9195d983 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:10.228672 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3ac15ad8-ed0d-404e-9de0-e26f9195d983 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219" status: 200 len: 1361 microversion: 2.1 time: 0.170044 Oct 29 03:52:10.229276 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3414/7053] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:10 2022] GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:10.288817 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-5b7c9e54-c2b9-48db-899f-c70c22d93ac6 req-3cbe6238-2cb0-420c-927a-29df2c2942ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80c41d7d-e72d-4496-aa08-7d38a2600219", "tag": "232d61ac-3995-49fd-8a90-41efbc43f8a0"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:52:10.299797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5b7c9e54-c2b9-48db-899f-c70c22d93ac6 req-3cbe6238-2cb0-420c-927a-29df2c2942ac service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:10.300275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5b7c9e54-c2b9-48db-899f-c70c22d93ac6 req-3cbe6238-2cb0-420c-927a-29df2c2942ac service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:10.300758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5b7c9e54-c2b9-48db-899f-c70c22d93ac6 req-3cbe6238-2cb0-420c-927a-29df2c2942ac service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:10.312886 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-5b7c9e54-c2b9-48db-899f-c70c22d93ac6 req-3cbe6238-2cb0-420c-927a-29df2c2942ac service nova] Creating event network-changed:232d61ac-3995-49fd-8a90-41efbc43f8a0 for instance 80c41d7d-e72d-4496-aa08-7d38a2600219 on n-h2-862967-2 Oct 29 03:52:10.317994 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-5b7c9e54-c2b9-48db-899f-c70c22d93ac6 req-3cbe6238-2cb0-420c-927a-29df2c2942ac service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033025 Oct 29 03:52:10.318551 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3640/7054] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:52:11.256483 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-363ebd89-0dd1-40a0-adac-5b2183d11115 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:11.257626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-363ebd89-0dd1-40a0-adac-5b2183d11115 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 80c41d7d-e72d-4496-aa08-7d38a2600219] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:11.269310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-363ebd89-0dd1-40a0-adac-5b2183d11115 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:11.270113 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-363ebd89-0dd1-40a0-adac-5b2183d11115 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:11.270894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-363ebd89-0dd1-40a0-adac-5b2183d11115 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:11.272068 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-363ebd89-0dd1-40a0-adac-5b2183d11115 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:11.273002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-363ebd89-0dd1-40a0-adac-5b2183d11115 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:11.273751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-363ebd89-0dd1-40a0-adac-5b2183d11115 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:11.425017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-363ebd89-0dd1-40a0-adac-5b2183d11115 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:11.437337 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-363ebd89-0dd1-40a0-adac-5b2183d11115 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219" status: 200 len: 1361 microversion: 2.1 time: 0.187363 Oct 29 03:52:11.438100 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3415/7055] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:11 2022] GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219 => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:12.465756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e382f864-ea55-46b2-90d0-cc68bfae790f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:12.466454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e382f864-ea55-46b2-90d0-cc68bfae790f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 80c41d7d-e72d-4496-aa08-7d38a2600219] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:12.473431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e382f864-ea55-46b2-90d0-cc68bfae790f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:12.473919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e382f864-ea55-46b2-90d0-cc68bfae790f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:12.474358 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e382f864-ea55-46b2-90d0-cc68bfae790f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:12.475093 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e382f864-ea55-46b2-90d0-cc68bfae790f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:12.475554 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e382f864-ea55-46b2-90d0-cc68bfae790f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:12.476018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e382f864-ea55-46b2-90d0-cc68bfae790f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:12.611990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e382f864-ea55-46b2-90d0-cc68bfae790f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:12.620559 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e382f864-ea55-46b2-90d0-cc68bfae790f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219" status: 200 len: 1361 microversion: 2.1 time: 0.162206 Oct 29 03:52:12.621177 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3641/7056] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:12 2022] GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:13.647150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9cb615e2-4de7-4415-a5dd-058e4fd397a6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:13.647803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9cb615e2-4de7-4415-a5dd-058e4fd397a6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 80c41d7d-e72d-4496-aa08-7d38a2600219] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:13.654335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cb615e2-4de7-4415-a5dd-058e4fd397a6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:13.654830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cb615e2-4de7-4415-a5dd-058e4fd397a6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:13.655282 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cb615e2-4de7-4415-a5dd-058e4fd397a6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:13.655993 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cb615e2-4de7-4415-a5dd-058e4fd397a6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:13.656453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cb615e2-4de7-4415-a5dd-058e4fd397a6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:13.656936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cb615e2-4de7-4415-a5dd-058e4fd397a6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:13.801607 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9cb615e2-4de7-4415-a5dd-058e4fd397a6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:13.810009 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9cb615e2-4de7-4415-a5dd-058e4fd397a6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219" status: 200 len: 1361 microversion: 2.1 time: 0.169520 Oct 29 03:52:13.810559 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3416/7057] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:13 2022] GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:14.839578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-389b0478-5126-4c76-946b-b1b70408ac72 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:14.840245 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-389b0478-5126-4c76-946b-b1b70408ac72 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 80c41d7d-e72d-4496-aa08-7d38a2600219] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:14.848701 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-389b0478-5126-4c76-946b-b1b70408ac72 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:14.849184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-389b0478-5126-4c76-946b-b1b70408ac72 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:14.849615 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-389b0478-5126-4c76-946b-b1b70408ac72 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:14.850337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-389b0478-5126-4c76-946b-b1b70408ac72 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:14.850786 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-389b0478-5126-4c76-946b-b1b70408ac72 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:14.851209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-389b0478-5126-4c76-946b-b1b70408ac72 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:14.993977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-389b0478-5126-4c76-946b-b1b70408ac72 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:15.002794 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-389b0478-5126-4c76-946b-b1b70408ac72 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219" status: 200 len: 1361 microversion: 2.1 time: 0.172402 Oct 29 03:52:15.003386 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3642/7058] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:14 2022] GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219 => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:15.612982 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-b41fa21c-daf1-4075-a7d1-cb3927f0fd8e req-301ed3c2-2441-4c81-aa41-efa0f27d491c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80c41d7d-e72d-4496-aa08-7d38a2600219", "name": "network-vif-plugged", "status": "completed", "tag": "232d61ac-3995-49fd-8a90-41efbc43f8a0"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:52:15.624357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b41fa21c-daf1-4075-a7d1-cb3927f0fd8e req-301ed3c2-2441-4c81-aa41-efa0f27d491c service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:15.624875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b41fa21c-daf1-4075-a7d1-cb3927f0fd8e req-301ed3c2-2441-4c81-aa41-efa0f27d491c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:15.625311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b41fa21c-daf1-4075-a7d1-cb3927f0fd8e req-301ed3c2-2441-4c81-aa41-efa0f27d491c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:15.636735 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-b41fa21c-daf1-4075-a7d1-cb3927f0fd8e req-301ed3c2-2441-4c81-aa41-efa0f27d491c service nova] Creating event network-vif-plugged:232d61ac-3995-49fd-8a90-41efbc43f8a0 for instance 80c41d7d-e72d-4496-aa08-7d38a2600219 on n-h2-862967-2 Oct 29 03:52:15.642139 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-b41fa21c-daf1-4075-a7d1-cb3927f0fd8e req-301ed3c2-2441-4c81-aa41-efa0f27d491c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033597 Oct 29 03:52:15.642766 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3417/7059] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:52:16.026252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-76f1d4f1-7f02-4eec-a55c-7b6bd2f3ee66 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:16.026843 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-76f1d4f1-7f02-4eec-a55c-7b6bd2f3ee66 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 80c41d7d-e72d-4496-aa08-7d38a2600219] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:16.034406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76f1d4f1-7f02-4eec-a55c-7b6bd2f3ee66 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:16.034921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76f1d4f1-7f02-4eec-a55c-7b6bd2f3ee66 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:16.035361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76f1d4f1-7f02-4eec-a55c-7b6bd2f3ee66 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:16.036083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76f1d4f1-7f02-4eec-a55c-7b6bd2f3ee66 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:16.036548 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76f1d4f1-7f02-4eec-a55c-7b6bd2f3ee66 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:16.037067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76f1d4f1-7f02-4eec-a55c-7b6bd2f3ee66 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:16.178169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-76f1d4f1-7f02-4eec-a55c-7b6bd2f3ee66 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:16.186615 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-76f1d4f1-7f02-4eec-a55c-7b6bd2f3ee66 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219" status: 200 len: 1361 microversion: 2.1 time: 0.164551 Oct 29 03:52:16.187171 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3643/7060] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:16 2022] GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:17.212324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6eb20070-5ded-4d8d-bc90-9b5e3b70642e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:17.213099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6eb20070-5ded-4d8d-bc90-9b5e3b70642e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 80c41d7d-e72d-4496-aa08-7d38a2600219] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:17.221954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6eb20070-5ded-4d8d-bc90-9b5e3b70642e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:17.222455 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6eb20070-5ded-4d8d-bc90-9b5e3b70642e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:17.222898 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6eb20070-5ded-4d8d-bc90-9b5e3b70642e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:17.223620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6eb20070-5ded-4d8d-bc90-9b5e3b70642e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:17.224058 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6eb20070-5ded-4d8d-bc90-9b5e3b70642e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:17.224495 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6eb20070-5ded-4d8d-bc90-9b5e3b70642e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:17.366952 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6eb20070-5ded-4d8d-bc90-9b5e3b70642e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:17.375213 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6eb20070-5ded-4d8d-bc90-9b5e3b70642e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219" status: 200 len: 1553 microversion: 2.1 time: 0.168334 Oct 29 03:52:17.375818 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3418/7061] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:17 2022] GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219 => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:17.399346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-95e34916-f210-468f-8f36-21f59d13a554 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:17.399941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-95e34916-f210-468f-8f36-21f59d13a554 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 80c41d7d-e72d-4496-aa08-7d38a2600219] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:17.407407 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95e34916-f210-468f-8f36-21f59d13a554 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:17.407964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95e34916-f210-468f-8f36-21f59d13a554 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:17.408395 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95e34916-f210-468f-8f36-21f59d13a554 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:17.409135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95e34916-f210-468f-8f36-21f59d13a554 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:17.409599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95e34916-f210-468f-8f36-21f59d13a554 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:17.410022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95e34916-f210-468f-8f36-21f59d13a554 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:17.547112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-95e34916-f210-468f-8f36-21f59d13a554 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:17.555336 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-95e34916-f210-468f-8f36-21f59d13a554 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219" status: 200 len: 1553 microversion: 2.1 time: 0.159978 Oct 29 03:52:17.555972 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3644/7062] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:17 2022] GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:19.122292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-29765ecb-7343-4535-a68c-91f91d448dcd tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f26e1206-f451-479a-81c0-983face7d742"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:52:19.124697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-29765ecb-7343-4535-a68c-91f91d448dcd tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 80c41d7d-e72d-4496-aa08-7d38a2600219] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:19.126889 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:52:19.132668 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29765ecb-7343-4535-a68c-91f91d448dcd tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:19.133163 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29765ecb-7343-4535-a68c-91f91d448dcd tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:19.133611 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29765ecb-7343-4535-a68c-91f91d448dcd tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:19.134326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29765ecb-7343-4535-a68c-91f91d448dcd tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:19.134783 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29765ecb-7343-4535-a68c-91f91d448dcd tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:19.135217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-29765ecb-7343-4535-a68c-91f91d448dcd tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:19.394996 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-29765ecb-7343-4535-a68c-91f91d448dcd tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "POST /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276798 Oct 29 03:52:19.395701 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3419/7063] 10.222.0.46 () {60 vars in 1323 bytes} [Sat Oct 29 03:52:19 2022] POST /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:52:30.175951 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f5134d8f-e47f-409e-a299-a7a956d061c5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:30.176855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f5134d8f-e47f-409e-a299-a7a956d061c5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 80c41d7d-e72d-4496-aa08-7d38a2600219] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:30.179780 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:52:30.180626 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:52:30.182683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:52:30.183370 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:52:30.191355 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5134d8f-e47f-409e-a299-a7a956d061c5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:30.191828 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5134d8f-e47f-409e-a299-a7a956d061c5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:30.192256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5134d8f-e47f-409e-a299-a7a956d061c5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:30.192971 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5134d8f-e47f-409e-a299-a7a956d061c5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:30.193420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5134d8f-e47f-409e-a299-a7a956d061c5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:30.193844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5134d8f-e47f-409e-a299-a7a956d061c5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:30.279742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-f5134d8f-e47f-409e-a299-a7a956d061c5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lazy-loading 'services' on Instance uuid 80c41d7d-e72d-4496-aa08-7d38a2600219 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:52:30.371636 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f5134d8f-e47f-409e-a299-a7a956d061c5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "DELETE /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219/os-volume_attachments/f26e1206-f451-479a-81c0-983face7d742" status: 202 len: 0 microversion: 2.1 time: 0.202536 Oct 29 03:52:30.372433 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3645/7064] 10.222.0.46 () {58 vars in 1416 bytes} [Sat Oct 29 03:52:30 2022] DELETE /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219/os-volume_attachments/f26e1206-f451-479a-81c0-983face7d742 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:52:30.378965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:52:30.379829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:52:30.384197 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e23606b0-6f29-4d4c-b16a-3cac9d465ccb tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:30.386689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e23606b0-6f29-4d4c-b16a-3cac9d465ccb tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 80c41d7d-e72d-4496-aa08-7d38a2600219] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:30.394805 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e23606b0-6f29-4d4c-b16a-3cac9d465ccb tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:30.395356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e23606b0-6f29-4d4c-b16a-3cac9d465ccb tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:30.395826 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e23606b0-6f29-4d4c-b16a-3cac9d465ccb tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:30.396566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e23606b0-6f29-4d4c-b16a-3cac9d465ccb tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:30.397044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e23606b0-6f29-4d4c-b16a-3cac9d465ccb tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:30.397489 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e23606b0-6f29-4d4c-b16a-3cac9d465ccb tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:30.430611 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e23606b0-6f29-4d4c-b16a-3cac9d465ccb tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053607 Oct 29 03:52:30.431196 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3420/7065] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:52:30 2022] GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:52:31.445356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e1124d27-c34b-4d41-b13d-11421a3f7bb6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:31.447770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e1124d27-c34b-4d41-b13d-11421a3f7bb6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 80c41d7d-e72d-4496-aa08-7d38a2600219] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:31.454839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1124d27-c34b-4d41-b13d-11421a3f7bb6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:31.455346 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1124d27-c34b-4d41-b13d-11421a3f7bb6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:31.455773 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1124d27-c34b-4d41-b13d-11421a3f7bb6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:31.456486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1124d27-c34b-4d41-b13d-11421a3f7bb6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:31.456974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1124d27-c34b-4d41-b13d-11421a3f7bb6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:31.457403 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e1124d27-c34b-4d41-b13d-11421a3f7bb6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:31.488400 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e1124d27-c34b-4d41-b13d-11421a3f7bb6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048470 Oct 29 03:52:31.489410 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3646/7066] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:52:31 2022] GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:52:32.503482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3c306b97-6cfa-45ce-ae17-0ca467127f95 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:32.505727 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3c306b97-6cfa-45ce-ae17-0ca467127f95 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 80c41d7d-e72d-4496-aa08-7d38a2600219] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:32.513066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3c306b97-6cfa-45ce-ae17-0ca467127f95 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:32.513564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3c306b97-6cfa-45ce-ae17-0ca467127f95 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:32.514007 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3c306b97-6cfa-45ce-ae17-0ca467127f95 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:32.514718 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3c306b97-6cfa-45ce-ae17-0ca467127f95 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:32.515180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3c306b97-6cfa-45ce-ae17-0ca467127f95 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:32.515596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3c306b97-6cfa-45ce-ae17-0ca467127f95 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:32.547192 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3c306b97-6cfa-45ce-ae17-0ca467127f95 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048333 Oct 29 03:52:32.547773 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3421/7067] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:52:32 2022] GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:52:33.560656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-41f6dd9c-5013-48c3-8b04-fd9488510394 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:33.563494 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-41f6dd9c-5013-48c3-8b04-fd9488510394 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 80c41d7d-e72d-4496-aa08-7d38a2600219] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:33.570152 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41f6dd9c-5013-48c3-8b04-fd9488510394 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:33.570640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41f6dd9c-5013-48c3-8b04-fd9488510394 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:33.571071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41f6dd9c-5013-48c3-8b04-fd9488510394 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:33.571745 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41f6dd9c-5013-48c3-8b04-fd9488510394 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:33.572206 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41f6dd9c-5013-48c3-8b04-fd9488510394 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:33.572652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41f6dd9c-5013-48c3-8b04-fd9488510394 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:33.604008 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-41f6dd9c-5013-48c3-8b04-fd9488510394 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048154 Oct 29 03:52:33.604624 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3647/7068] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:52:33 2022] GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:52:34.617378 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c0fdbf2e-fa0d-43ac-8dd7-3c1707c6d5a5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:34.619604 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c0fdbf2e-fa0d-43ac-8dd7-3c1707c6d5a5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 80c41d7d-e72d-4496-aa08-7d38a2600219] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:34.627225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0fdbf2e-fa0d-43ac-8dd7-3c1707c6d5a5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:34.627730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0fdbf2e-fa0d-43ac-8dd7-3c1707c6d5a5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:34.628179 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0fdbf2e-fa0d-43ac-8dd7-3c1707c6d5a5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:34.628933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0fdbf2e-fa0d-43ac-8dd7-3c1707c6d5a5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:34.629399 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0fdbf2e-fa0d-43ac-8dd7-3c1707c6d5a5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:34.629833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0fdbf2e-fa0d-43ac-8dd7-3c1707c6d5a5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:34.662031 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c0fdbf2e-fa0d-43ac-8dd7-3c1707c6d5a5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048946 Oct 29 03:52:34.662871 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3422/7069] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:52:34 2022] GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:52:35.679422 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a119c12a-a072-47a9-afb7-bf88cb7e4af8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:35.683147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a119c12a-a072-47a9-afb7-bf88cb7e4af8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 80c41d7d-e72d-4496-aa08-7d38a2600219] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:35.693582 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a119c12a-a072-47a9-afb7-bf88cb7e4af8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:35.694086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a119c12a-a072-47a9-afb7-bf88cb7e4af8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:35.694524 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a119c12a-a072-47a9-afb7-bf88cb7e4af8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:35.695252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a119c12a-a072-47a9-afb7-bf88cb7e4af8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:35.695709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a119c12a-a072-47a9-afb7-bf88cb7e4af8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:35.696134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a119c12a-a072-47a9-afb7-bf88cb7e4af8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:35.726900 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a119c12a-a072-47a9-afb7-bf88cb7e4af8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054436 Oct 29 03:52:35.727473 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3648/7070] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:52:35 2022] GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:52:35.738786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5cc01ed0-f5a7-4582-b9bf-598312f795e5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:35.739323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5cc01ed0-f5a7-4582-b9bf-598312f795e5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 80c41d7d-e72d-4496-aa08-7d38a2600219] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:35.747373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5cc01ed0-f5a7-4582-b9bf-598312f795e5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:35.747871 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5cc01ed0-f5a7-4582-b9bf-598312f795e5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:35.748320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5cc01ed0-f5a7-4582-b9bf-598312f795e5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:35.749066 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5cc01ed0-f5a7-4582-b9bf-598312f795e5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:35.749524 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5cc01ed0-f5a7-4582-b9bf-598312f795e5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:35.749967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5cc01ed0-f5a7-4582-b9bf-598312f795e5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:35.831222 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-5cc01ed0-f5a7-4582-b9bf-598312f795e5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] HTTP exception thrown: Instance 80c41d7d-e72d-4496-aa08-7d38a2600219 is not attached to volume f26e1206-f451-479a-81c0-983face7d742 Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5cc01ed0-f5a7-4582-b9bf-598312f795e5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Request method failure captured: Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219/os-volume_attachments/f26e1206-f451-479a-81c0-983face7d742 HTTP/1.1 Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKM-KW2ImsqsWPxxdQ4iU2bJWCF75CcDjn_98DpXJGWok9dAQaJ31I1uwJv5AlJghXyVeWsHA8LbUOOTj7pmpaFj3qQZ33fXoC-Ws_o9WdjyZykOImssXxUskcQkml55G71kAjMKT1iZ2DTEl73APBqgd-SfAs4N7rHndU7JsWSavWg Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 54f8b7538d0348ce8de7f4823f6477c7 Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestEncryptedCinderVolumes-883383401 Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/54f8b7538d0348ce8de7f4823f6477c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/54f8b7538d0348ce8de7f4823f6477c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_54f8b7538d0348ce8de7f4823f6477c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/54f8b7538d0348ce8de7f4823f6477c7"}]}] Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestEncryptedCinderVolumes-883383401 Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 54f8b7538d0348ce8de7f4823f6477c7 Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-883383401 Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestEncryptedCinderVolumes-883383401-project Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: bd4b9442e97a4ca99b6213b36305bfe9 Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestEncryptedCinderVolumes-883383401-project Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 80c41d7d-e72d-4496-aa08-7d38a2600219 is not attached to volume f26e1206-f451-479a-81c0-983face7d742 Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'server_id': '80c41d7d-e72d-4496-aa08-7d38a2600219', 'id': 'f26e1206-f451-479a-81c0-983face7d742'} Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f26e1206-f451-479a-81c0-983face7d742. Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80c41d7d-e72d-4496-aa08-7d38a2600219 is not attached to volume f26e1206-f451-479a-81c0-983face7d742 Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:52:35.833077 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:52:35.837945 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:52:35.837945 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:52:35.837945 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80c41d7d-e72d-4496-aa08-7d38a2600219 is not attached to volume f26e1206-f451-479a-81c0-983face7d742 Oct 29 03:52:35.837945 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:52:35.837945 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5cc01ed0-f5a7-4582-b9bf-598312f795e5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Returning 404 to user: Instance 80c41d7d-e72d-4496-aa08-7d38a2600219 is not attached to volume f26e1206-f451-479a-81c0-983face7d742 {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:52:35.837945 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5cc01ed0-f5a7-4582-b9bf-598312f795e5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "DELETE /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219/os-volume_attachments/f26e1206-f451-479a-81c0-983face7d742" status: 404 len: 154 microversion: 2.1 time: 0.099918 Oct 29 03:52:35.837945 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3423/7071] 10.222.0.46 () {58 vars in 1416 bytes} [Sat Oct 29 03:52:35 2022] DELETE /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219/os-volume_attachments/f26e1206-f451-479a-81c0-983face7d742 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:52:39.204309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-11457d30-f38e-4abb-9fa4-47bce8349c96 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:39.204888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-11457d30-f38e-4abb-9fa4-47bce8349c96 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 80c41d7d-e72d-4496-aa08-7d38a2600219] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:39.211810 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11457d30-f38e-4abb-9fa4-47bce8349c96 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:39.212302 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11457d30-f38e-4abb-9fa4-47bce8349c96 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:39.212775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11457d30-f38e-4abb-9fa4-47bce8349c96 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:39.213473 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11457d30-f38e-4abb-9fa4-47bce8349c96 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:39.213928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11457d30-f38e-4abb-9fa4-47bce8349c96 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:39.214361 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11457d30-f38e-4abb-9fa4-47bce8349c96 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:39.242567 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-11457d30-f38e-4abb-9fa4-47bce8349c96 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 80c41d7d-e72d-4496-aa08-7d38a2600219] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:52:39.328080 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-11457d30-f38e-4abb-9fa4-47bce8349c96 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "DELETE /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219" status: 204 len: 0 microversion: 2.1 time: 0.127494 Oct 29 03:52:39.331798 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3649/7072] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:52:39 2022] DELETE /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:52:39.337633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-657d3492-45f2-4968-90f8-88e1313c5e1f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:39.338263 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-657d3492-45f2-4968-90f8-88e1313c5e1f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 80c41d7d-e72d-4496-aa08-7d38a2600219] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:39.346148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-657d3492-45f2-4968-90f8-88e1313c5e1f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:39.346640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-657d3492-45f2-4968-90f8-88e1313c5e1f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:39.347088 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-657d3492-45f2-4968-90f8-88e1313c5e1f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:39.347791 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-657d3492-45f2-4968-90f8-88e1313c5e1f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:39.348250 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-657d3492-45f2-4968-90f8-88e1313c5e1f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:39.348728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-657d3492-45f2-4968-90f8-88e1313c5e1f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:39.488581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-657d3492-45f2-4968-90f8-88e1313c5e1f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:39.497190 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-657d3492-45f2-4968-90f8-88e1313c5e1f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219" status: 200 len: 1559 microversion: 2.1 time: 0.163932 Oct 29 03:52:39.497838 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3424/7073] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:39 2022] GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:40.526501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-47354826-d6ab-46f3-beb3-73faf293cba6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:40.527589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-47354826-d6ab-46f3-beb3-73faf293cba6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 80c41d7d-e72d-4496-aa08-7d38a2600219] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:40.539415 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47354826-d6ab-46f3-beb3-73faf293cba6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:40.540227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47354826-d6ab-46f3-beb3-73faf293cba6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:40.541011 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47354826-d6ab-46f3-beb3-73faf293cba6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:40.542181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47354826-d6ab-46f3-beb3-73faf293cba6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:40.542930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47354826-d6ab-46f3-beb3-73faf293cba6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:40.543644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-47354826-d6ab-46f3-beb3-73faf293cba6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:40.699870 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-47354826-d6ab-46f3-beb3-73faf293cba6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:40.708517 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-47354826-d6ab-46f3-beb3-73faf293cba6 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219" status: 200 len: 1559 microversion: 2.1 time: 0.189534 Oct 29 03:52:40.709211 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3650/7074] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:40 2022] GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219 => generated 1559 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:41.347119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-f4a3712a-87b0-43cc-bb52-689bcca7bb26 req-4f01aca9-5476-43e2-99a9-d23bec5892b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80c41d7d-e72d-4496-aa08-7d38a2600219", "name": "network-vif-deleted", "tag": "232d61ac-3995-49fd-8a90-41efbc43f8a0"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:52:41.357812 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f4a3712a-87b0-43cc-bb52-689bcca7bb26 req-4f01aca9-5476-43e2-99a9-d23bec5892b4 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:41.358304 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f4a3712a-87b0-43cc-bb52-689bcca7bb26 req-4f01aca9-5476-43e2-99a9-d23bec5892b4 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:41.358759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f4a3712a-87b0-43cc-bb52-689bcca7bb26 req-4f01aca9-5476-43e2-99a9-d23bec5892b4 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:41.371124 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-f4a3712a-87b0-43cc-bb52-689bcca7bb26 req-4f01aca9-5476-43e2-99a9-d23bec5892b4 service nova] Creating event network-vif-deleted:232d61ac-3995-49fd-8a90-41efbc43f8a0 for instance 80c41d7d-e72d-4496-aa08-7d38a2600219 on n-h2-862967-2 Oct 29 03:52:41.376428 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-f4a3712a-87b0-43cc-bb52-689bcca7bb26 req-4f01aca9-5476-43e2-99a9-d23bec5892b4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033118 Oct 29 03:52:41.377063 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3425/7075] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:52:41.732762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b3056e28-96bd-49a6-965f-5cd98d390b66 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:41.733662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b3056e28-96bd-49a6-965f-5cd98d390b66 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 80c41d7d-e72d-4496-aa08-7d38a2600219] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:41.743569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3056e28-96bd-49a6-965f-5cd98d390b66 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:41.744223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3056e28-96bd-49a6-965f-5cd98d390b66 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:41.744805 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3056e28-96bd-49a6-965f-5cd98d390b66 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:41.745525 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3056e28-96bd-49a6-965f-5cd98d390b66 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:41.745948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3056e28-96bd-49a6-965f-5cd98d390b66 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:41.746369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3056e28-96bd-49a6-965f-5cd98d390b66 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:41.785896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3056e28-96bd-49a6-965f-5cd98d390b66 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:41.786736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3056e28-96bd-49a6-965f-5cd98d390b66 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:41.787172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3056e28-96bd-49a6-965f-5cd98d390b66 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:41.787617 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-b3056e28-96bd-49a6-965f-5cd98d390b66 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lazy-loading 'fault' on Instance uuid 80c41d7d-e72d-4496-aa08-7d38a2600219 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:52:41.833744 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b3056e28-96bd-49a6-965f-5cd98d390b66 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:41.847630 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b3056e28-96bd-49a6-965f-5cd98d390b66 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219" status: 200 len: 1351 microversion: 2.1 time: 0.119834 Oct 29 03:52:41.848723 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3651/7076] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:41 2022] GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219 => generated 1351 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:42.878801 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b6db66f2-7187-4f98-a22d-6aff484caef8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:42.879976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b6db66f2-7187-4f98-a22d-6aff484caef8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 80c41d7d-e72d-4496-aa08-7d38a2600219] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:42.891069 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6db66f2-7187-4f98-a22d-6aff484caef8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:42.892002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6db66f2-7187-4f98-a22d-6aff484caef8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:42.892472 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6db66f2-7187-4f98-a22d-6aff484caef8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:42.893215 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6db66f2-7187-4f98-a22d-6aff484caef8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:42.893687 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6db66f2-7187-4f98-a22d-6aff484caef8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:42.894160 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6db66f2-7187-4f98-a22d-6aff484caef8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:42.908302 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-b6db66f2-7187-4f98-a22d-6aff484caef8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] HTTP exception thrown: Instance 80c41d7d-e72d-4496-aa08-7d38a2600219 could not be found. Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b6db66f2-7187-4f98-a22d-6aff484caef8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Request method failure captured: Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219 HTTP/1.1 Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKM-KW2ImsqsWPxxdQ4iU2bJWCF75CcDjn_98DpXJGWok9dAQaJ31I1uwJv5AlJghXyVeWsHA8LbUOOTj7pmpaFj3qQZ33fXoC-Ws_o9WdjyZykOImssXxUskcQkml55G71kAjMKT1iZ2DTEl73APBqgd-SfAs4N7rHndU7JsWSavWg Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 54f8b7538d0348ce8de7f4823f6477c7 Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestEncryptedCinderVolumes-883383401 Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/54f8b7538d0348ce8de7f4823f6477c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/54f8b7538d0348ce8de7f4823f6477c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_54f8b7538d0348ce8de7f4823f6477c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/54f8b7538d0348ce8de7f4823f6477c7"}]}] Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestEncryptedCinderVolumes-883383401 Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 54f8b7538d0348ce8de7f4823f6477c7 Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-883383401 Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestEncryptedCinderVolumes-883383401-project Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: bd4b9442e97a4ca99b6213b36305bfe9 Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestEncryptedCinderVolumes-883383401-project Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 80c41d7d-e72d-4496-aa08-7d38a2600219 could not be found. Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '80c41d7d-e72d-4496-aa08-7d38a2600219'} Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80c41d7d-e72d-4496-aa08-7d38a2600219 could not be found. Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80c41d7d-e72d-4496-aa08-7d38a2600219 could not be found. Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:52:42.910027 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:52:42.918334 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:52:42.918334 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:52:42.918334 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:52:42.918334 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:52:42.918334 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:52:42.918334 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80c41d7d-e72d-4496-aa08-7d38a2600219 could not be found. Oct 29 03:52:42.918334 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:52:42.918334 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b6db66f2-7187-4f98-a22d-6aff484caef8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Returning 404 to user: Instance 80c41d7d-e72d-4496-aa08-7d38a2600219 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:52:42.918334 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b6db66f2-7187-4f98-a22d-6aff484caef8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219" status: 404 len: 111 microversion: 2.1 time: 0.041668 Oct 29 03:52:42.918334 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3426/7077] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:42 2022] GET /compute/v2.1/servers/80c41d7d-e72d-4496-aa08-7d38a2600219 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:52:42.920597 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-506338d9-51dc-47dd-9f75-60b56fe82371 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '.version_select at 0x7ff053fc1160>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:42.944064 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-506338d9-51dc-47dd-9f75-60b56fe82371 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-575079825" status: 202 len: 0 microversion: 2.1 time: 0.027408 Oct 29 03:52:42.944703 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3652/7078] 10.222.0.46 () {58 vars in 1275 bytes} [Sat Oct 29 03:52:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-575079825 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:52:42.961601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a2390b26-a813-4911-bf39-2c66f5e4ffc9 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Action: 'create', calling method: .version_select at 0x7ff053a6ba60>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2039058768", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4yDobu5feZ3P1J//EsJsDrI/nRiipwkc04ihmzOrGzsqmEjhzFXcf54kUbL5WGYNT4hz9AGOAKxI/wwvqsUJJ7CKTaBWk9OYr3/MD+YvZ4rsSMT04zm+HYQhqmC08hLQ=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:52:42.976728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-a2390b26-a813-4911-bf39-2c66f5e4ffc9 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Getting quotas for project 54f8b7538d0348ce8de7f4823f6477c7. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:52:42.982041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-a2390b26-a813-4911-bf39-2c66f5e4ffc9 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Getting quotas for user bd4b9442e97a4ca99b6213b36305bfe9 and project 54f8b7538d0348ce8de7f4823f6477c7. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:52:43.009613 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a2390b26-a813-4911-bf39-2c66f5e4ffc9 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.053059 Oct 29 03:52:43.010217 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3427/7079] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:52:42 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:52:43.064982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-daa38097-7958-4f3d-bc98-c7620b090a99 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1401606407", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2039058768", "networks": [{"uuid": "4f8ff8b5-1930-4940-b79a-4ea11b91b0d2"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:52:43.122380 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-daa38097-7958-4f3d-bc98-c7620b090a99 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] validate_networks() for [('4f8ff8b5-1930-4940-b79a-4ea11b91b0d2', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:52:43.523657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-daa38097-7958-4f3d-bc98-c7620b090a99 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:52:43.524077 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-daa38097-7958-4f3d-bc98-c7620b090a99 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:52:43.524549 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-daa38097-7958-4f3d-bc98-c7620b090a99 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:52:43.524985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-daa38097-7958-4f3d-bc98-c7620b090a99 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:52:43.525401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-daa38097-7958-4f3d-bc98-c7620b090a99 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:52:43.534772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-daa38097-7958-4f3d-bc98-c7620b090a99 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:43.535278 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-daa38097-7958-4f3d-bc98-c7620b090a99 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:43.535721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-daa38097-7958-4f3d-bc98-c7620b090a99 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:43.536464 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-daa38097-7958-4f3d-bc98-c7620b090a99 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:43.536930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-daa38097-7958-4f3d-bc98-c7620b090a99 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:43.537373 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-daa38097-7958-4f3d-bc98-c7620b090a99 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:43.555321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-daa38097-7958-4f3d-bc98-c7620b090a99 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Getting quotas for project 54f8b7538d0348ce8de7f4823f6477c7. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:52:43.560800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-daa38097-7958-4f3d-bc98-c7620b090a99 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Getting quotas for user bd4b9442e97a4ca99b6213b36305bfe9 and project 54f8b7538d0348ce8de7f4823f6477c7. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:52:43.573560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-daa38097-7958-4f3d-bc98-c7620b090a99 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:52:43.575917 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-daa38097-7958-4f3d-bc98-c7620b090a99 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 87638fd4-820f-460b-a711-6e81d4250a21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:52:43.625756 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-daa38097-7958-4f3d-bc98-c7620b090a99 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564829 Oct 29 03:52:43.626502 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3653/7080] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:52:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:52:43.638194 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-86a7da30-94ea-4ce2-a8e6-57869e785eee tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:43.638910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-86a7da30-94ea-4ce2-a8e6-57869e785eee tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 87638fd4-820f-460b-a711-6e81d4250a21] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:43.695565 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-86a7da30-94ea-4ce2-a8e6-57869e785eee tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:43.705386 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-86a7da30-94ea-4ce2-a8e6-57869e785eee tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21" status: 200 len: 1263 microversion: 2.1 time: 0.071343 Oct 29 03:52:43.706038 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3428/7081] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:43 2022] GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21 => generated 1263 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:44.730661 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c0c66d25-1872-481a-95f0-1de98263c475 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:44.731926 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c0c66d25-1872-481a-95f0-1de98263c475 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 87638fd4-820f-460b-a711-6e81d4250a21] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:44.739613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0c66d25-1872-481a-95f0-1de98263c475 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:44.740109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0c66d25-1872-481a-95f0-1de98263c475 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:44.740571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0c66d25-1872-481a-95f0-1de98263c475 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:44.741308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0c66d25-1872-481a-95f0-1de98263c475 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:44.742118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0c66d25-1872-481a-95f0-1de98263c475 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:44.742543 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c0c66d25-1872-481a-95f0-1de98263c475 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:44.824024 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c0c66d25-1872-481a-95f0-1de98263c475 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:44.832641 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c0c66d25-1872-481a-95f0-1de98263c475 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21" status: 200 len: 1333 microversion: 2.1 time: 0.107422 Oct 29 03:52:44.833319 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3654/7082] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:44 2022] GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21 => generated 1333 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:52:45.855820 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-abf23b7f-0097-4858-8725-3aedd0092bc2 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:45.856449 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-abf23b7f-0097-4858-8725-3aedd0092bc2 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 87638fd4-820f-460b-a711-6e81d4250a21] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:45.864155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-abf23b7f-0097-4858-8725-3aedd0092bc2 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:45.864694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-abf23b7f-0097-4858-8725-3aedd0092bc2 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:45.865179 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-abf23b7f-0097-4858-8725-3aedd0092bc2 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:45.865949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-abf23b7f-0097-4858-8725-3aedd0092bc2 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:45.866761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-abf23b7f-0097-4858-8725-3aedd0092bc2 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:45.867195 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-abf23b7f-0097-4858-8725-3aedd0092bc2 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:46.013447 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-abf23b7f-0097-4858-8725-3aedd0092bc2 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:46.022432 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-abf23b7f-0097-4858-8725-3aedd0092bc2 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21" status: 200 len: 1363 microversion: 2.1 time: 0.170735 Oct 29 03:52:46.023205 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3429/7083] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:45 2022] GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:46.341915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-b11d3045-91f0-44a8-a4fa-06b9b6c957b8 req-b3c0ab70-973a-4fbf-8ab9-9d217d165396 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87638fd4-820f-460b-a711-6e81d4250a21", "tag": "7fbf1305-e7dc-4be4-a30d-8f4506e89eb5"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:52:46.353767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b11d3045-91f0-44a8-a4fa-06b9b6c957b8 req-b3c0ab70-973a-4fbf-8ab9-9d217d165396 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:46.354493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b11d3045-91f0-44a8-a4fa-06b9b6c957b8 req-b3c0ab70-973a-4fbf-8ab9-9d217d165396 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:46.355122 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b11d3045-91f0-44a8-a4fa-06b9b6c957b8 req-b3c0ab70-973a-4fbf-8ab9-9d217d165396 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:46.367132 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-b11d3045-91f0-44a8-a4fa-06b9b6c957b8 req-b3c0ab70-973a-4fbf-8ab9-9d217d165396 service nova] Creating event network-changed:7fbf1305-e7dc-4be4-a30d-8f4506e89eb5 for instance 87638fd4-820f-460b-a711-6e81d4250a21 on n-h2-862967-2 Oct 29 03:52:46.372358 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-b11d3045-91f0-44a8-a4fa-06b9b6c957b8 req-b3c0ab70-973a-4fbf-8ab9-9d217d165396 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034431 Oct 29 03:52:46.373092 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3655/7084] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:52:47.051524 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-02cda734-67be-4a90-b04a-d6bc849872e5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:47.052514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-02cda734-67be-4a90-b04a-d6bc849872e5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 87638fd4-820f-460b-a711-6e81d4250a21] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:47.064335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02cda734-67be-4a90-b04a-d6bc849872e5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:47.064871 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02cda734-67be-4a90-b04a-d6bc849872e5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:47.065318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02cda734-67be-4a90-b04a-d6bc849872e5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:47.066044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02cda734-67be-4a90-b04a-d6bc849872e5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:47.066668 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02cda734-67be-4a90-b04a-d6bc849872e5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:47.067119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-02cda734-67be-4a90-b04a-d6bc849872e5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:47.205901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-02cda734-67be-4a90-b04a-d6bc849872e5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:47.213851 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-02cda734-67be-4a90-b04a-d6bc849872e5 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21" status: 200 len: 1363 microversion: 2.1 time: 0.169076 Oct 29 03:52:47.214442 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3430/7085] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:47 2022] GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:48.240347 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ebdff9e4-0da8-4e37-9459-0c7804fd5f69 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:48.241068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ebdff9e4-0da8-4e37-9459-0c7804fd5f69 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 87638fd4-820f-460b-a711-6e81d4250a21] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:48.248192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebdff9e4-0da8-4e37-9459-0c7804fd5f69 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:48.248708 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebdff9e4-0da8-4e37-9459-0c7804fd5f69 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:48.249142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebdff9e4-0da8-4e37-9459-0c7804fd5f69 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:48.249827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebdff9e4-0da8-4e37-9459-0c7804fd5f69 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:48.250276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebdff9e4-0da8-4e37-9459-0c7804fd5f69 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:48.250692 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ebdff9e4-0da8-4e37-9459-0c7804fd5f69 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:48.395147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ebdff9e4-0da8-4e37-9459-0c7804fd5f69 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:48.403474 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ebdff9e4-0da8-4e37-9459-0c7804fd5f69 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21" status: 200 len: 1363 microversion: 2.1 time: 0.169188 Oct 29 03:52:48.404056 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3656/7086] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:48 2022] GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:49.431579 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-aca7e485-b80a-45a3-bf90-daa2ff21cc89 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:49.432456 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-aca7e485-b80a-45a3-bf90-daa2ff21cc89 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 87638fd4-820f-460b-a711-6e81d4250a21] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:49.442154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aca7e485-b80a-45a3-bf90-daa2ff21cc89 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:49.442638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aca7e485-b80a-45a3-bf90-daa2ff21cc89 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:49.443105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aca7e485-b80a-45a3-bf90-daa2ff21cc89 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:49.443814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aca7e485-b80a-45a3-bf90-daa2ff21cc89 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:49.444285 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aca7e485-b80a-45a3-bf90-daa2ff21cc89 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:49.444766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aca7e485-b80a-45a3-bf90-daa2ff21cc89 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:49.582249 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-aca7e485-b80a-45a3-bf90-daa2ff21cc89 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:49.594612 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-aca7e485-b80a-45a3-bf90-daa2ff21cc89 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21" status: 200 len: 1363 microversion: 2.1 time: 0.169632 Oct 29 03:52:49.595490 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3431/7087] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:49 2022] GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:50.624473 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-65993e10-d343-4e19-a2e3-e4832d428063 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:50.625394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-65993e10-d343-4e19-a2e3-e4832d428063 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 87638fd4-820f-460b-a711-6e81d4250a21] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:50.633584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-65993e10-d343-4e19-a2e3-e4832d428063 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:50.634056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-65993e10-d343-4e19-a2e3-e4832d428063 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:50.634491 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-65993e10-d343-4e19-a2e3-e4832d428063 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:50.635180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-65993e10-d343-4e19-a2e3-e4832d428063 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:50.635790 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-65993e10-d343-4e19-a2e3-e4832d428063 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:50.636222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-65993e10-d343-4e19-a2e3-e4832d428063 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:50.776356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-65993e10-d343-4e19-a2e3-e4832d428063 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:50.785033 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-65993e10-d343-4e19-a2e3-e4832d428063 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21" status: 200 len: 1363 microversion: 2.1 time: 0.164577 Oct 29 03:52:50.785610 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3657/7088] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:50 2022] GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:51.807772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8095166e-e7e5-473b-934d-a1f380fe2966 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:51.808542 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8095166e-e7e5-473b-934d-a1f380fe2966 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 87638fd4-820f-460b-a711-6e81d4250a21] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:51.815627 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8095166e-e7e5-473b-934d-a1f380fe2966 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:51.816117 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8095166e-e7e5-473b-934d-a1f380fe2966 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:51.816658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8095166e-e7e5-473b-934d-a1f380fe2966 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:51.817698 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8095166e-e7e5-473b-934d-a1f380fe2966 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:51.817836 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8095166e-e7e5-473b-934d-a1f380fe2966 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:51.818251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8095166e-e7e5-473b-934d-a1f380fe2966 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:51.895456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-a12675d1-ea50-4af0-8b38-1415d03676ad req-3cc36978-5d98-4221-acdd-7b683aa50609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87638fd4-820f-460b-a711-6e81d4250a21", "name": "network-vif-plugged", "status": "completed", "tag": "7fbf1305-e7dc-4be4-a30d-8f4506e89eb5"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:52:51.906649 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a12675d1-ea50-4af0-8b38-1415d03676ad req-3cc36978-5d98-4221-acdd-7b683aa50609 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:51.907119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a12675d1-ea50-4af0-8b38-1415d03676ad req-3cc36978-5d98-4221-acdd-7b683aa50609 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:51.907924 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a12675d1-ea50-4af0-8b38-1415d03676ad req-3cc36978-5d98-4221-acdd-7b683aa50609 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:51.925312 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-a12675d1-ea50-4af0-8b38-1415d03676ad req-3cc36978-5d98-4221-acdd-7b683aa50609 service nova] Creating event network-vif-plugged:7fbf1305-e7dc-4be4-a30d-8f4506e89eb5 for instance 87638fd4-820f-460b-a711-6e81d4250a21 on n-h2-862967-2 Oct 29 03:52:51.930831 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-a12675d1-ea50-4af0-8b38-1415d03676ad req-3cc36978-5d98-4221-acdd-7b683aa50609 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039656 Oct 29 03:52:51.931848 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3658/7089] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:52:51.970686 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8095166e-e7e5-473b-934d-a1f380fe2966 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:51.979638 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8095166e-e7e5-473b-934d-a1f380fe2966 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21" status: 200 len: 1363 microversion: 2.1 time: 0.175793 Oct 29 03:52:51.980365 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3432/7090] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:51 2022] GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:53.007147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-95ab0a01-48d5-4943-95ba-245e9ab94c17 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:53.007858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-95ab0a01-48d5-4943-95ba-245e9ab94c17 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 87638fd4-820f-460b-a711-6e81d4250a21] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:53.014964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95ab0a01-48d5-4943-95ba-245e9ab94c17 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:53.015449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95ab0a01-48d5-4943-95ba-245e9ab94c17 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:53.015882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95ab0a01-48d5-4943-95ba-245e9ab94c17 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:53.016759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95ab0a01-48d5-4943-95ba-245e9ab94c17 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:53.017236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95ab0a01-48d5-4943-95ba-245e9ab94c17 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:53.017667 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-95ab0a01-48d5-4943-95ba-245e9ab94c17 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:53.157684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-95ab0a01-48d5-4943-95ba-245e9ab94c17 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:53.166318 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-95ab0a01-48d5-4943-95ba-245e9ab94c17 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21" status: 200 len: 1363 microversion: 2.1 time: 0.164946 Oct 29 03:52:53.167253 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3659/7091] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:52 2022] GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:54.194434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0dce92b3-29b3-4204-95dc-1563618e230e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:54.195032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0dce92b3-29b3-4204-95dc-1563618e230e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 87638fd4-820f-460b-a711-6e81d4250a21] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:54.198105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:52:54.203932 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0dce92b3-29b3-4204-95dc-1563618e230e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:54.204439 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0dce92b3-29b3-4204-95dc-1563618e230e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:54.204912 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0dce92b3-29b3-4204-95dc-1563618e230e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:54.205664 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0dce92b3-29b3-4204-95dc-1563618e230e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:54.206175 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0dce92b3-29b3-4204-95dc-1563618e230e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:54.206615 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0dce92b3-29b3-4204-95dc-1563618e230e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:54.345657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0dce92b3-29b3-4204-95dc-1563618e230e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:54.354259 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0dce92b3-29b3-4204-95dc-1563618e230e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21" status: 200 len: 1556 microversion: 2.1 time: 0.163848 Oct 29 03:52:54.354854 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3433/7092] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:54 2022] GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21 => generated 1556 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:54.377222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-aee0d985-5702-42ee-8cbc-85c5056d6769 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:52:54.378145 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-aee0d985-5702-42ee-8cbc-85c5056d6769 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 87638fd4-820f-460b-a711-6e81d4250a21] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:54.380147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:52:54.380860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:52:54.388154 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aee0d985-5702-42ee-8cbc-85c5056d6769 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:54.388671 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aee0d985-5702-42ee-8cbc-85c5056d6769 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:54.389111 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aee0d985-5702-42ee-8cbc-85c5056d6769 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:54.389816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aee0d985-5702-42ee-8cbc-85c5056d6769 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:54.390271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aee0d985-5702-42ee-8cbc-85c5056d6769 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:54.390695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-aee0d985-5702-42ee-8cbc-85c5056d6769 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:54.524980 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-aee0d985-5702-42ee-8cbc-85c5056d6769 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:52:54.536686 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-aee0d985-5702-42ee-8cbc-85c5056d6769 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21" status: 200 len: 1556 microversion: 2.1 time: 0.163431 Oct 29 03:52:54.537250 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3660/7093] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:52:54 2022] GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21 => generated 1556 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:52:56.069665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-effe05e1-955d-40f5-9de0-0e5e348599d0 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "197fca2d-4cb3-4fc5-8551-df107a32b3c9"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:52:56.072274 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-effe05e1-955d-40f5-9de0-0e5e348599d0 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 87638fd4-820f-460b-a711-6e81d4250a21] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:52:56.079921 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-effe05e1-955d-40f5-9de0-0e5e348599d0 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:56.081759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-effe05e1-955d-40f5-9de0-0e5e348599d0 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:56.082275 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-effe05e1-955d-40f5-9de0-0e5e348599d0 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:56.083082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-effe05e1-955d-40f5-9de0-0e5e348599d0 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:52:56.083606 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-effe05e1-955d-40f5-9de0-0e5e348599d0 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:52:56.084132 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-effe05e1-955d-40f5-9de0-0e5e348599d0 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:52:56.337642 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-effe05e1-955d-40f5-9de0-0e5e348599d0 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "POST /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272036 Oct 29 03:52:56.344142 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3434/7094] 10.222.0.46 () {60 vars in 1323 bytes} [Sat Oct 29 03:52:56 2022] POST /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:53:07.136203 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5f814aa3-8328-4c3f-be46-12543f320285 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:07.136785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5f814aa3-8328-4c3f-be46-12543f320285 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 87638fd4-820f-460b-a711-6e81d4250a21] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:07.139163 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:53:07.139982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:53:07.147183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f814aa3-8328-4c3f-be46-12543f320285 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:07.147717 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f814aa3-8328-4c3f-be46-12543f320285 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:07.148185 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f814aa3-8328-4c3f-be46-12543f320285 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:07.148920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f814aa3-8328-4c3f-be46-12543f320285 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:07.149369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f814aa3-8328-4c3f-be46-12543f320285 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:07.149793 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5f814aa3-8328-4c3f-be46-12543f320285 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:07.233942 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-5f814aa3-8328-4c3f-be46-12543f320285 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lazy-loading 'services' on Instance uuid 87638fd4-820f-460b-a711-6e81d4250a21 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:53:07.314365 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5f814aa3-8328-4c3f-be46-12543f320285 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "DELETE /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21/os-volume_attachments/197fca2d-4cb3-4fc5-8551-df107a32b3c9" status: 202 len: 0 microversion: 2.1 time: 0.181853 Oct 29 03:53:07.315290 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3661/7095] 10.222.0.46 () {58 vars in 1416 bytes} [Sat Oct 29 03:53:07 2022] DELETE /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21/os-volume_attachments/197fca2d-4cb3-4fc5-8551-df107a32b3c9 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:53:07.322575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:53:07.323398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:53:07.327896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-87ab2ecf-94b4-4f4c-a3bd-cc5875db754e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:07.330380 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-87ab2ecf-94b4-4f4c-a3bd-cc5875db754e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 87638fd4-820f-460b-a711-6e81d4250a21] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:07.339976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-87ab2ecf-94b4-4f4c-a3bd-cc5875db754e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:07.340677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-87ab2ecf-94b4-4f4c-a3bd-cc5875db754e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:07.341262 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-87ab2ecf-94b4-4f4c-a3bd-cc5875db754e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:07.342413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-87ab2ecf-94b4-4f4c-a3bd-cc5875db754e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:07.343131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-87ab2ecf-94b4-4f4c-a3bd-cc5875db754e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:07.343569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-87ab2ecf-94b4-4f4c-a3bd-cc5875db754e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:07.378859 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-87ab2ecf-94b4-4f4c-a3bd-cc5875db754e tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058224 Oct 29 03:53:07.379475 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3435/7096] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:53:07 2022] GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:53:08.393362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1eca71dc-4ddd-435d-ad3e-41b470dcd20b tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:08.395660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1eca71dc-4ddd-435d-ad3e-41b470dcd20b tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 87638fd4-820f-460b-a711-6e81d4250a21] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:08.403142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1eca71dc-4ddd-435d-ad3e-41b470dcd20b tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:08.403628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1eca71dc-4ddd-435d-ad3e-41b470dcd20b tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:08.404083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1eca71dc-4ddd-435d-ad3e-41b470dcd20b tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:08.404815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1eca71dc-4ddd-435d-ad3e-41b470dcd20b tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:08.405266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1eca71dc-4ddd-435d-ad3e-41b470dcd20b tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:08.405688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1eca71dc-4ddd-435d-ad3e-41b470dcd20b tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:08.436870 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1eca71dc-4ddd-435d-ad3e-41b470dcd20b tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047911 Oct 29 03:53:08.437451 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3662/7097] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:53:08 2022] GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:53:09.449994 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b3c75909-5a30-48db-98fd-f564154e2503 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:09.452250 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b3c75909-5a30-48db-98fd-f564154e2503 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 87638fd4-820f-460b-a711-6e81d4250a21] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:09.459633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3c75909-5a30-48db-98fd-f564154e2503 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:09.460151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3c75909-5a30-48db-98fd-f564154e2503 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:09.460628 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3c75909-5a30-48db-98fd-f564154e2503 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:09.461348 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3c75909-5a30-48db-98fd-f564154e2503 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:09.461814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3c75909-5a30-48db-98fd-f564154e2503 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:09.462251 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3c75909-5a30-48db-98fd-f564154e2503 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:09.493954 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b3c75909-5a30-48db-98fd-f564154e2503 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048163 Oct 29 03:53:09.494502 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3436/7098] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:53:09 2022] GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:53:10.506967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-51f0abaa-6dba-41da-a839-81b7a096fb3f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:10.509284 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-51f0abaa-6dba-41da-a839-81b7a096fb3f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 87638fd4-820f-460b-a711-6e81d4250a21] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:10.516745 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51f0abaa-6dba-41da-a839-81b7a096fb3f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:10.517235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51f0abaa-6dba-41da-a839-81b7a096fb3f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:10.517671 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51f0abaa-6dba-41da-a839-81b7a096fb3f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:10.518383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51f0abaa-6dba-41da-a839-81b7a096fb3f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:10.518836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51f0abaa-6dba-41da-a839-81b7a096fb3f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:10.519260 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-51f0abaa-6dba-41da-a839-81b7a096fb3f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:10.550499 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-51f0abaa-6dba-41da-a839-81b7a096fb3f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047647 Oct 29 03:53:10.551093 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3663/7099] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:53:10 2022] GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:53:11.564290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c6b5abe2-e69e-4c97-a5e7-939cfee6b705 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:11.566874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c6b5abe2-e69e-4c97-a5e7-939cfee6b705 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 87638fd4-820f-460b-a711-6e81d4250a21] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:11.574396 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6b5abe2-e69e-4c97-a5e7-939cfee6b705 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:11.574892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6b5abe2-e69e-4c97-a5e7-939cfee6b705 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:11.575337 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6b5abe2-e69e-4c97-a5e7-939cfee6b705 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:11.576050 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6b5abe2-e69e-4c97-a5e7-939cfee6b705 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:11.576534 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6b5abe2-e69e-4c97-a5e7-939cfee6b705 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:11.576992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6b5abe2-e69e-4c97-a5e7-939cfee6b705 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:11.609910 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c6b5abe2-e69e-4c97-a5e7-939cfee6b705 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050391 Oct 29 03:53:11.610487 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3437/7100] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:53:11 2022] GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:53:12.627325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-38fdebd2-879d-48ee-a507-de886dab78ea tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:12.630853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-38fdebd2-879d-48ee-a507-de886dab78ea tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 87638fd4-820f-460b-a711-6e81d4250a21] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:12.642208 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38fdebd2-879d-48ee-a507-de886dab78ea tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:12.642980 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38fdebd2-879d-48ee-a507-de886dab78ea tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:12.643667 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38fdebd2-879d-48ee-a507-de886dab78ea tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:12.644847 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38fdebd2-879d-48ee-a507-de886dab78ea tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:12.645538 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38fdebd2-879d-48ee-a507-de886dab78ea tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:12.646192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38fdebd2-879d-48ee-a507-de886dab78ea tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:12.686885 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-38fdebd2-879d-48ee-a507-de886dab78ea tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066382 Oct 29 03:53:12.687451 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3664/7101] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:53:12 2022] GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:53:12.698664 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6839e4db-652a-4aa3-b1b0-be5673e97209 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:12.699265 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6839e4db-652a-4aa3-b1b0-be5673e97209 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 87638fd4-820f-460b-a711-6e81d4250a21] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:12.707192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6839e4db-652a-4aa3-b1b0-be5673e97209 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:12.707689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6839e4db-652a-4aa3-b1b0-be5673e97209 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:12.708132 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6839e4db-652a-4aa3-b1b0-be5673e97209 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:12.708873 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6839e4db-652a-4aa3-b1b0-be5673e97209 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:12.709331 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6839e4db-652a-4aa3-b1b0-be5673e97209 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:12.709761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6839e4db-652a-4aa3-b1b0-be5673e97209 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:12.990223 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-6839e4db-652a-4aa3-b1b0-be5673e97209 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] HTTP exception thrown: Instance 87638fd4-820f-460b-a711-6e81d4250a21 is not attached to volume 197fca2d-4cb3-4fc5-8551-df107a32b3c9 Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6839e4db-652a-4aa3-b1b0-be5673e97209 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Request method failure captured: Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21/os-volume_attachments/197fca2d-4cb3-4fc5-8551-df107a32b3c9 HTTP/1.1 Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKM-KW2ImsqsWPxxdQ4iU2bJWCF75CcDjn_98DpXJGWok9dAQaJ31I1uwJv5AlJghXyVeWsHA8LbUOOTj7pmpaFj3qQZ33fXoC-Ws_o9WdjyZykOImssXxUskcQkml55G71kAjMKT1iZ2DTEl73APBqgd-SfAs4N7rHndU7JsWSavWg Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 54f8b7538d0348ce8de7f4823f6477c7 Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestEncryptedCinderVolumes-883383401 Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/54f8b7538d0348ce8de7f4823f6477c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/54f8b7538d0348ce8de7f4823f6477c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_54f8b7538d0348ce8de7f4823f6477c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/54f8b7538d0348ce8de7f4823f6477c7"}]}] Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestEncryptedCinderVolumes-883383401 Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 54f8b7538d0348ce8de7f4823f6477c7 Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-883383401 Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestEncryptedCinderVolumes-883383401-project Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: bd4b9442e97a4ca99b6213b36305bfe9 Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestEncryptedCinderVolumes-883383401-project Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 87638fd4-820f-460b-a711-6e81d4250a21 is not attached to volume 197fca2d-4cb3-4fc5-8551-df107a32b3c9 Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'server_id': '87638fd4-820f-460b-a711-6e81d4250a21', 'id': '197fca2d-4cb3-4fc5-8551-df107a32b3c9'} Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 197fca2d-4cb3-4fc5-8551-df107a32b3c9. Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87638fd4-820f-460b-a711-6e81d4250a21 is not attached to volume 197fca2d-4cb3-4fc5-8551-df107a32b3c9 Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:53:12.992322 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:53:12.996457 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:53:12.996457 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:53:12.996457 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87638fd4-820f-460b-a711-6e81d4250a21 is not attached to volume 197fca2d-4cb3-4fc5-8551-df107a32b3c9 Oct 29 03:53:12.996457 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:53:12.996457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6839e4db-652a-4aa3-b1b0-be5673e97209 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Returning 404 to user: Instance 87638fd4-820f-460b-a711-6e81d4250a21 is not attached to volume 197fca2d-4cb3-4fc5-8551-df107a32b3c9 {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:53:12.996457 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6839e4db-652a-4aa3-b1b0-be5673e97209 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "DELETE /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21/os-volume_attachments/197fca2d-4cb3-4fc5-8551-df107a32b3c9" status: 404 len: 154 microversion: 2.1 time: 0.299365 Oct 29 03:53:12.996457 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3438/7102] 10.222.0.46 () {58 vars in 1416 bytes} [Sat Oct 29 03:53:12 2022] DELETE /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21/os-volume_attachments/197fca2d-4cb3-4fc5-8551-df107a32b3c9 => generated 154 bytes in 300 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:53:16.361382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fe616e02-326d-4004-94f4-9952598ba91f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:16.361916 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fe616e02-326d-4004-94f4-9952598ba91f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 87638fd4-820f-460b-a711-6e81d4250a21] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:16.369461 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fe616e02-326d-4004-94f4-9952598ba91f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:16.369941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fe616e02-326d-4004-94f4-9952598ba91f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:16.370387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fe616e02-326d-4004-94f4-9952598ba91f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:16.371079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fe616e02-326d-4004-94f4-9952598ba91f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:16.371531 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fe616e02-326d-4004-94f4-9952598ba91f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:16.371955 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fe616e02-326d-4004-94f4-9952598ba91f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:16.398041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fe616e02-326d-4004-94f4-9952598ba91f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 87638fd4-820f-460b-a711-6e81d4250a21] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:53:16.485454 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fe616e02-326d-4004-94f4-9952598ba91f tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "DELETE /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21" status: 204 len: 0 microversion: 2.1 time: 0.127788 Oct 29 03:53:16.486026 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3665/7103] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:53:16 2022] DELETE /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:53:16.495599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5a7bcfb4-4baf-47d4-be80-d92763f707c8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:16.496677 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5a7bcfb4-4baf-47d4-be80-d92763f707c8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 87638fd4-820f-460b-a711-6e81d4250a21] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:16.508043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a7bcfb4-4baf-47d4-be80-d92763f707c8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:16.508579 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a7bcfb4-4baf-47d4-be80-d92763f707c8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:16.509038 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a7bcfb4-4baf-47d4-be80-d92763f707c8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:16.509759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a7bcfb4-4baf-47d4-be80-d92763f707c8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:16.510224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a7bcfb4-4baf-47d4-be80-d92763f707c8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:16.510654 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a7bcfb4-4baf-47d4-be80-d92763f707c8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:16.651198 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5a7bcfb4-4baf-47d4-be80-d92763f707c8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:16.660097 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5a7bcfb4-4baf-47d4-be80-d92763f707c8 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21" status: 200 len: 1562 microversion: 2.1 time: 0.169348 Oct 29 03:53:16.660850 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3439/7104] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:16 2022] GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21 => generated 1562 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:53:17.688715 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-38a1c194-7be8-4f65-a01f-811285b13db2 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:17.689841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-38a1c194-7be8-4f65-a01f-811285b13db2 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 87638fd4-820f-460b-a711-6e81d4250a21] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:17.699523 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38a1c194-7be8-4f65-a01f-811285b13db2 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:17.700020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38a1c194-7be8-4f65-a01f-811285b13db2 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:17.700458 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38a1c194-7be8-4f65-a01f-811285b13db2 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:17.701192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38a1c194-7be8-4f65-a01f-811285b13db2 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:17.701652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38a1c194-7be8-4f65-a01f-811285b13db2 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:17.702073 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38a1c194-7be8-4f65-a01f-811285b13db2 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:17.853799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-38a1c194-7be8-4f65-a01f-811285b13db2 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:17.862026 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-38a1c194-7be8-4f65-a01f-811285b13db2 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21" status: 200 len: 1562 microversion: 2.1 time: 0.180601 Oct 29 03:53:17.862605 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3666/7105] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:17 2022] GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21 => generated 1562 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:18.482682 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-e8cabd82-6364-4c42-a8f6-f14732af72e3 req-6e085a99-0c69-4274-a5d6-6eb3341b9ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87638fd4-820f-460b-a711-6e81d4250a21", "name": "network-vif-deleted", "tag": "7fbf1305-e7dc-4be4-a30d-8f4506e89eb5"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:53:18.495510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e8cabd82-6364-4c42-a8f6-f14732af72e3 req-6e085a99-0c69-4274-a5d6-6eb3341b9ee1 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:18.496009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e8cabd82-6364-4c42-a8f6-f14732af72e3 req-6e085a99-0c69-4274-a5d6-6eb3341b9ee1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:18.496457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e8cabd82-6364-4c42-a8f6-f14732af72e3 req-6e085a99-0c69-4274-a5d6-6eb3341b9ee1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:18.509254 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-e8cabd82-6364-4c42-a8f6-f14732af72e3 req-6e085a99-0c69-4274-a5d6-6eb3341b9ee1 service nova] Creating event network-vif-deleted:7fbf1305-e7dc-4be4-a30d-8f4506e89eb5 for instance 87638fd4-820f-460b-a711-6e81d4250a21 on n-h2-862967-2 Oct 29 03:53:18.515344 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-e8cabd82-6364-4c42-a8f6-f14732af72e3 req-6e085a99-0c69-4274-a5d6-6eb3341b9ee1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036579 Oct 29 03:53:18.516215 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3440/7106] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:53:18.885979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-311af66b-4ecc-47af-a9fc-579f7cdd349c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:18.886631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-311af66b-4ecc-47af-a9fc-579f7cdd349c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 87638fd4-820f-460b-a711-6e81d4250a21] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:18.894679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-311af66b-4ecc-47af-a9fc-579f7cdd349c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:18.895080 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-311af66b-4ecc-47af-a9fc-579f7cdd349c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:18.895522 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-311af66b-4ecc-47af-a9fc-579f7cdd349c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:18.896444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-311af66b-4ecc-47af-a9fc-579f7cdd349c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:18.897142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-311af66b-4ecc-47af-a9fc-579f7cdd349c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:18.897572 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-311af66b-4ecc-47af-a9fc-579f7cdd349c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:18.934484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-311af66b-4ecc-47af-a9fc-579f7cdd349c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:18.934977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-311af66b-4ecc-47af-a9fc-579f7cdd349c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:18.935423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-311af66b-4ecc-47af-a9fc-579f7cdd349c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:18.935889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-311af66b-4ecc-47af-a9fc-579f7cdd349c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lazy-loading 'fault' on Instance uuid 87638fd4-820f-460b-a711-6e81d4250a21 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:53:18.982035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-311af66b-4ecc-47af-a9fc-579f7cdd349c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd4b9442e97a4ca99b6213b36305bfe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f8b7538d0348ce8de7f4823f6477c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:18.991224 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-311af66b-4ecc-47af-a9fc-579f7cdd349c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21" status: 200 len: 1353 microversion: 2.1 time: 0.109167 Oct 29 03:53:18.992250 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3667/7107] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:18 2022] GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21 => generated 1353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:20.026543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-59bd9a60-3a1b-4d68-8a88-cef9ffaa509c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:20.027676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-59bd9a60-3a1b-4d68-8a88-cef9ffaa509c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] [instance: 87638fd4-820f-460b-a711-6e81d4250a21] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:20.038597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59bd9a60-3a1b-4d68-8a88-cef9ffaa509c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:20.039330 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59bd9a60-3a1b-4d68-8a88-cef9ffaa509c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:20.039784 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59bd9a60-3a1b-4d68-8a88-cef9ffaa509c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:20.040496 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59bd9a60-3a1b-4d68-8a88-cef9ffaa509c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:20.040990 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59bd9a60-3a1b-4d68-8a88-cef9ffaa509c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:20.041430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59bd9a60-3a1b-4d68-8a88-cef9ffaa509c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:20.055006 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-59bd9a60-3a1b-4d68-8a88-cef9ffaa509c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] HTTP exception thrown: Instance 87638fd4-820f-460b-a711-6e81d4250a21 could not be found. Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-59bd9a60-3a1b-4d68-8a88-cef9ffaa509c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Request method failure captured: Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21 HTTP/1.1 Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKM-KW2ImsqsWPxxdQ4iU2bJWCF75CcDjn_98DpXJGWok9dAQaJ31I1uwJv5AlJghXyVeWsHA8LbUOOTj7pmpaFj3qQZ33fXoC-Ws_o9WdjyZykOImssXxUskcQkml55G71kAjMKT1iZ2DTEl73APBqgd-SfAs4N7rHndU7JsWSavWg Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 54f8b7538d0348ce8de7f4823f6477c7 Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestEncryptedCinderVolumes-883383401 Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/54f8b7538d0348ce8de7f4823f6477c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/54f8b7538d0348ce8de7f4823f6477c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_54f8b7538d0348ce8de7f4823f6477c7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/54f8b7538d0348ce8de7f4823f6477c7"}]}] Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestEncryptedCinderVolumes-883383401 Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 54f8b7538d0348ce8de7f4823f6477c7 Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-883383401 Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestEncryptedCinderVolumes-883383401-project Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: bd4b9442e97a4ca99b6213b36305bfe9 Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestEncryptedCinderVolumes-883383401-project Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 87638fd4-820f-460b-a711-6e81d4250a21 could not be found. Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '87638fd4-820f-460b-a711-6e81d4250a21'} Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87638fd4-820f-460b-a711-6e81d4250a21 could not be found. Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87638fd4-820f-460b-a711-6e81d4250a21 could not be found. Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:53:20.056887 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:53:20.062082 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:53:20.062082 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:53:20.062082 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:53:20.062082 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:53:20.062082 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:53:20.062082 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87638fd4-820f-460b-a711-6e81d4250a21 could not be found. Oct 29 03:53:20.062082 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:53:20.062082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-59bd9a60-3a1b-4d68-8a88-cef9ffaa509c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Returning 404 to user: Instance 87638fd4-820f-460b-a711-6e81d4250a21 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:53:20.062082 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-59bd9a60-3a1b-4d68-8a88-cef9ffaa509c tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21" status: 404 len: 111 microversion: 2.1 time: 0.040440 Oct 29 03:53:20.062082 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3441/7108] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:20 2022] GET /compute/v2.1/servers/87638fd4-820f-460b-a711-6e81d4250a21 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:53:20.067865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cea118b6-de2c-46fb-88f2-b43e87242092 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] Calling method '.version_select at 0x7ff0533ee1f0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:20.095868 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cea118b6-de2c-46fb-88f2-b43e87242092 tempest-TestEncryptedCinderVolumes-883383401 tempest-TestEncryptedCinderVolumes-883383401-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2039058768" status: 202 len: 0 microversion: 2.1 time: 0.031822 Oct 29 03:53:20.096479 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3668/7109] 10.222.0.46 () {58 vars in 1278 bytes} [Sat Oct 29 03:53:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2039058768 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:53:47.483307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-011ce974-d2a5-4a1c-b474-a9efded76bcb tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Action: 'create', calling method: .version_select at 0x7ff053816310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-586248713", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOy0yyR2a0pVewekaOExqgEdgnfWv13yCOhLO8LVOKHMIiNOJDR5cGsNt52OYteDl1pW9EKDtDR2ycF4zEect3lbYjLn/uCS/UhUC/Zf+9rFWT9Pb1DRv8/nNZftDvFcg=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:53:47.489835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=14 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:53:47.490508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=34 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:53:47.503026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-011ce974-d2a5-4a1c-b474-a9efded76bcb tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Getting quotas for project 4b9d21bdd55942b9b4df5eb5cb6b7b1f. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:53:47.509256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-011ce974-d2a5-4a1c-b474-a9efded76bcb tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Getting quotas for user 3cd4d68a896348d1966819f53bc97717 and project 4b9d21bdd55942b9b4df5eb5cb6b7b1f. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:53:47.537815 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-011ce974-d2a5-4a1c-b474-a9efded76bcb tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.058184 Oct 29 03:53:47.538647 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3442/7110] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:53:47 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:53:47.589125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:53:47.589894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:53:47.594584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9cd493b6-2efa-455f-bd46-23547867c1fe tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1098614732", "imageRef": "ecba861e-7ab4-4f4a-9493-cd0ff990e7e6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-586248713", "networks": [{"uuid": "cdd124e6-b2da-4e5e-a304-c6e38e494125"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:53:47.652203 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-9cd493b6-2efa-455f-bd46-23547867c1fe tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] validate_networks() for [('cdd124e6-b2da-4e5e-a304-c6e38e494125', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:53:48.037022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-9cd493b6-2efa-455f-bd46-23547867c1fe tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:53:48.037516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-9cd493b6-2efa-455f-bd46-23547867c1fe tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:53:48.038054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-9cd493b6-2efa-455f-bd46-23547867c1fe tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:53:48.038662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-9cd493b6-2efa-455f-bd46-23547867c1fe tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:53:48.039328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-9cd493b6-2efa-455f-bd46-23547867c1fe tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:53:48.053738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9cd493b6-2efa-455f-bd46-23547867c1fe tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:48.054417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9cd493b6-2efa-455f-bd46-23547867c1fe tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:48.055132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9cd493b6-2efa-455f-bd46-23547867c1fe tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:48.055983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9cd493b6-2efa-455f-bd46-23547867c1fe tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:48.056446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9cd493b6-2efa-455f-bd46-23547867c1fe tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:48.056907 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9cd493b6-2efa-455f-bd46-23547867c1fe tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:48.076775 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-9cd493b6-2efa-455f-bd46-23547867c1fe tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Getting quotas for project 4b9d21bdd55942b9b4df5eb5cb6b7b1f. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:53:48.082158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-9cd493b6-2efa-455f-bd46-23547867c1fe tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Getting quotas for user 3cd4d68a896348d1966819f53bc97717 and project 4b9d21bdd55942b9b4df5eb5cb6b7b1f. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:53:48.095996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9cd493b6-2efa-455f-bd46-23547867c1fe tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:53:48.098269 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9cd493b6-2efa-455f-bd46-23547867c1fe tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ecba861e-7ab4-4f4a-9493-cd0ff990e7e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:53:48.148456 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9cd493b6-2efa-455f-bd46-23547867c1fe tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.561813 Oct 29 03:53:48.149123 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3669/7111] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:53:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:53:48.160497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bacefdac-69ef-4ab0-b026-4ac433e65fd1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:48.161157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bacefdac-69ef-4ab0-b026-4ac433e65fd1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:48.218109 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bacefdac-69ef-4ab0-b026-4ac433e65fd1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:48.225140 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bacefdac-69ef-4ab0-b026-4ac433e65fd1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835" status: 200 len: 1258 microversion: 2.1 time: 0.068661 Oct 29 03:53:48.225766 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3443/7112] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:48 2022] GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:49.250250 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c1d1ebd2-16d9-4a6b-a9da-a9b97fd02480 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:49.250824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c1d1ebd2-16d9-4a6b-a9da-a9b97fd02480 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:49.258061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1d1ebd2-16d9-4a6b-a9da-a9b97fd02480 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:49.258744 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1d1ebd2-16d9-4a6b-a9da-a9b97fd02480 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:49.259454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1d1ebd2-16d9-4a6b-a9da-a9b97fd02480 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:49.260547 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1d1ebd2-16d9-4a6b-a9da-a9b97fd02480 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:49.261106 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1d1ebd2-16d9-4a6b-a9da-a9b97fd02480 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:49.261543 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c1d1ebd2-16d9-4a6b-a9da-a9b97fd02480 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:49.341732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c1d1ebd2-16d9-4a6b-a9da-a9b97fd02480 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:49.349626 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c1d1ebd2-16d9-4a6b-a9da-a9b97fd02480 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835" status: 200 len: 1310 microversion: 2.1 time: 0.104688 Oct 29 03:53:49.350668 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3670/7113] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:49 2022] GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835 => generated 1310 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:50.374954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-af6e9021-96ff-4fa5-9739-eb50c0ca41ed tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:50.375608 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-af6e9021-96ff-4fa5-9739-eb50c0ca41ed tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:50.382621 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af6e9021-96ff-4fa5-9739-eb50c0ca41ed tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:50.383370 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af6e9021-96ff-4fa5-9739-eb50c0ca41ed tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:50.383907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af6e9021-96ff-4fa5-9739-eb50c0ca41ed tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:50.385538 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af6e9021-96ff-4fa5-9739-eb50c0ca41ed tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:50.386130 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af6e9021-96ff-4fa5-9739-eb50c0ca41ed tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:50.386651 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-af6e9021-96ff-4fa5-9739-eb50c0ca41ed tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:50.537124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-af6e9021-96ff-4fa5-9739-eb50c0ca41ed tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:50.546711 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-af6e9021-96ff-4fa5-9739-eb50c0ca41ed tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835" status: 200 len: 1358 microversion: 2.1 time: 0.176876 Oct 29 03:53:50.547311 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3444/7114] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:50 2022] GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:51.570108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c554a15f-1a2f-4eab-a4da-8a53fa333005 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:51.570873 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c554a15f-1a2f-4eab-a4da-8a53fa333005 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:51.579436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c554a15f-1a2f-4eab-a4da-8a53fa333005 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:51.580610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c554a15f-1a2f-4eab-a4da-8a53fa333005 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:51.581074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c554a15f-1a2f-4eab-a4da-8a53fa333005 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:51.581936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c554a15f-1a2f-4eab-a4da-8a53fa333005 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:51.582411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c554a15f-1a2f-4eab-a4da-8a53fa333005 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:51.582848 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c554a15f-1a2f-4eab-a4da-8a53fa333005 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:51.756110 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c554a15f-1a2f-4eab-a4da-8a53fa333005 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:51.764949 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c554a15f-1a2f-4eab-a4da-8a53fa333005 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835" status: 200 len: 1358 microversion: 2.1 time: 0.198914 Oct 29 03:53:51.766456 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3671/7115] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:51 2022] GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:52.789860 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e1a352e5-da9c-4815-a089-550f909a90f0 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:52.790693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e1a352e5-da9c-4815-a089-550f909a90f0 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:52.798281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1a352e5-da9c-4815-a089-550f909a90f0 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:52.798762 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1a352e5-da9c-4815-a089-550f909a90f0 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:52.799414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1a352e5-da9c-4815-a089-550f909a90f0 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:52.800185 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1a352e5-da9c-4815-a089-550f909a90f0 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:52.800725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1a352e5-da9c-4815-a089-550f909a90f0 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:52.801166 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e1a352e5-da9c-4815-a089-550f909a90f0 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:52.945913 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e1a352e5-da9c-4815-a089-550f909a90f0 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:52.956636 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e1a352e5-da9c-4815-a089-550f909a90f0 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835" status: 200 len: 1358 microversion: 2.1 time: 0.170717 Oct 29 03:53:52.957373 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3445/7116] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:52 2022] GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:53.980841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-21296260-aff4-4036-8a6a-79928bcd2238 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:53.981461 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-21296260-aff4-4036-8a6a-79928bcd2238 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:53.989453 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-21296260-aff4-4036-8a6a-79928bcd2238 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:53.989969 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-21296260-aff4-4036-8a6a-79928bcd2238 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:53.990415 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-21296260-aff4-4036-8a6a-79928bcd2238 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:53.991155 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-21296260-aff4-4036-8a6a-79928bcd2238 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:53.991999 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-21296260-aff4-4036-8a6a-79928bcd2238 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:53.992514 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-21296260-aff4-4036-8a6a-79928bcd2238 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:54.170656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-21296260-aff4-4036-8a6a-79928bcd2238 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:54.180127 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-21296260-aff4-4036-8a6a-79928bcd2238 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835" status: 200 len: 1358 microversion: 2.1 time: 0.203783 Oct 29 03:53:54.181675 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3672/7117] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:53 2022] GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:55.216780 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5afd20b3-082c-4c58-b50d-b57f27d89f90 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:55.218683 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5afd20b3-082c-4c58-b50d-b57f27d89f90 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:55.234454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5afd20b3-082c-4c58-b50d-b57f27d89f90 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:55.252881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5afd20b3-082c-4c58-b50d-b57f27d89f90 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:55.254146 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5afd20b3-082c-4c58-b50d-b57f27d89f90 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:55.256282 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5afd20b3-082c-4c58-b50d-b57f27d89f90 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:55.257284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5afd20b3-082c-4c58-b50d-b57f27d89f90 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:55.258092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5afd20b3-082c-4c58-b50d-b57f27d89f90 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:55.452143 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5afd20b3-082c-4c58-b50d-b57f27d89f90 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:55.465153 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5afd20b3-082c-4c58-b50d-b57f27d89f90 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835" status: 200 len: 1358 microversion: 2.1 time: 0.262069 Oct 29 03:53:55.466421 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3446/7118] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:55 2022] GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835 => generated 1358 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:56.489341 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ffdea5bc-4a85-4790-a603-3923a1683fee tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:56.490030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ffdea5bc-4a85-4790-a603-3923a1683fee tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:56.498454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffdea5bc-4a85-4790-a603-3923a1683fee tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:56.498997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffdea5bc-4a85-4790-a603-3923a1683fee tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:56.499456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffdea5bc-4a85-4790-a603-3923a1683fee tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:56.500236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffdea5bc-4a85-4790-a603-3923a1683fee tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:56.500726 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffdea5bc-4a85-4790-a603-3923a1683fee tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:56.501205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffdea5bc-4a85-4790-a603-3923a1683fee tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:56.669324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ffdea5bc-4a85-4790-a603-3923a1683fee tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:56.678379 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ffdea5bc-4a85-4790-a603-3923a1683fee tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835" status: 200 len: 1358 microversion: 2.1 time: 0.193078 Oct 29 03:53:56.679004 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3673/7119] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:56 2022] GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:57.703364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6c6e2f13-4e0e-4fac-90e1-5e2ae71f6c47 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:57.704360 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6c6e2f13-4e0e-4fac-90e1-5e2ae71f6c47 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:57.717678 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c6e2f13-4e0e-4fac-90e1-5e2ae71f6c47 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:57.718661 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c6e2f13-4e0e-4fac-90e1-5e2ae71f6c47 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:57.719326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c6e2f13-4e0e-4fac-90e1-5e2ae71f6c47 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:57.720118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c6e2f13-4e0e-4fac-90e1-5e2ae71f6c47 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:57.720785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c6e2f13-4e0e-4fac-90e1-5e2ae71f6c47 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:57.721253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6c6e2f13-4e0e-4fac-90e1-5e2ae71f6c47 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:57.983181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-b61c1a73-1f25-48b0-be45-c8fa65196016 req-75238634-72c1-4f52-a637-750479175ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e72289b-743f-48d7-aa17-6e71e0915835", "tag": "828e156c-7684-4325-9870-3c975c469ee5"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:53:57.998884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b61c1a73-1f25-48b0-be45-c8fa65196016 req-75238634-72c1-4f52-a637-750479175ae4 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:57.999367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b61c1a73-1f25-48b0-be45-c8fa65196016 req-75238634-72c1-4f52-a637-750479175ae4 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:57.999795 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-b61c1a73-1f25-48b0-be45-c8fa65196016 req-75238634-72c1-4f52-a637-750479175ae4 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:58.012266 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-b61c1a73-1f25-48b0-be45-c8fa65196016 req-75238634-72c1-4f52-a637-750479175ae4 service nova] Creating event network-changed:828e156c-7684-4325-9870-3c975c469ee5 for instance 4e72289b-743f-48d7-aa17-6e71e0915835 on n-h2-862967-2 Oct 29 03:53:58.017893 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-b61c1a73-1f25-48b0-be45-c8fa65196016 req-75238634-72c1-4f52-a637-750479175ae4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040380 Oct 29 03:53:58.018510 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3674/7120] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:53:58.081857 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6c6e2f13-4e0e-4fac-90e1-5e2ae71f6c47 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:58.091868 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6c6e2f13-4e0e-4fac-90e1-5e2ae71f6c47 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835" status: 200 len: 1358 microversion: 2.1 time: 0.393492 Oct 29 03:53:58.093100 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3447/7121] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:57 2022] GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835 => generated 1358 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:53:59.113337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:53:59.114282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:53:59.120561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-290c3741-9c3f-46da-bd9f-7b65d1a80a6c tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:53:59.121598 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-290c3741-9c3f-46da-bd9f-7b65d1a80a6c tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:53:59.132590 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-290c3741-9c3f-46da-bd9f-7b65d1a80a6c tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:59.133400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-290c3741-9c3f-46da-bd9f-7b65d1a80a6c tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:59.133844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-290c3741-9c3f-46da-bd9f-7b65d1a80a6c tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:59.134558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-290c3741-9c3f-46da-bd9f-7b65d1a80a6c tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:53:59.135019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-290c3741-9c3f-46da-bd9f-7b65d1a80a6c tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:53:59.135450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-290c3741-9c3f-46da-bd9f-7b65d1a80a6c tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:53:59.459191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-290c3741-9c3f-46da-bd9f-7b65d1a80a6c tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:53:59.468078 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-290c3741-9c3f-46da-bd9f-7b65d1a80a6c tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835" status: 200 len: 1358 microversion: 2.1 time: 0.356030 Oct 29 03:53:59.468670 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3675/7122] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:53:59 2022] GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835 => generated 1358 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:00.493855 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d2736f0a-3d34-4914-bd75-765c2d38b19c tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:00.494492 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d2736f0a-3d34-4914-bd75-765c2d38b19c tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:00.496404 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:54:00.503195 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d2736f0a-3d34-4914-bd75-765c2d38b19c tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:00.503689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d2736f0a-3d34-4914-bd75-765c2d38b19c tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:00.504123 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d2736f0a-3d34-4914-bd75-765c2d38b19c tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:00.504858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d2736f0a-3d34-4914-bd75-765c2d38b19c tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:00.505318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d2736f0a-3d34-4914-bd75-765c2d38b19c tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:00.505747 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d2736f0a-3d34-4914-bd75-765c2d38b19c tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:00.637684 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d2736f0a-3d34-4914-bd75-765c2d38b19c tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:00.645400 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d2736f0a-3d34-4914-bd75-765c2d38b19c tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835" status: 200 len: 1358 microversion: 2.1 time: 0.157866 Oct 29 03:54:00.645976 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3448/7123] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:00 2022] GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:01.671365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9d9aa207-4b80-4eff-aecb-6562854e0207 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:01.672135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9d9aa207-4b80-4eff-aecb-6562854e0207 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:01.681622 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d9aa207-4b80-4eff-aecb-6562854e0207 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:01.682116 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d9aa207-4b80-4eff-aecb-6562854e0207 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:01.682553 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d9aa207-4b80-4eff-aecb-6562854e0207 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:01.683261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d9aa207-4b80-4eff-aecb-6562854e0207 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:01.683714 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d9aa207-4b80-4eff-aecb-6562854e0207 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:01.684148 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9d9aa207-4b80-4eff-aecb-6562854e0207 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:01.815445 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9d9aa207-4b80-4eff-aecb-6562854e0207 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:01.825650 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9d9aa207-4b80-4eff-aecb-6562854e0207 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835" status: 200 len: 1358 microversion: 2.1 time: 0.159632 Oct 29 03:54:01.826449 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3676/7124] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:01 2022] GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:02.260918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-4938b981-a26c-43d9-9333-5617ba55a7a0 req-9500e65f-720a-428b-9b8b-aeb865b70f89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e72289b-743f-48d7-aa17-6e71e0915835", "name": "network-vif-plugged", "status": "completed", "tag": "828e156c-7684-4325-9870-3c975c469ee5"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:54:02.271633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4938b981-a26c-43d9-9333-5617ba55a7a0 req-9500e65f-720a-428b-9b8b-aeb865b70f89 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:02.272254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4938b981-a26c-43d9-9333-5617ba55a7a0 req-9500e65f-720a-428b-9b8b-aeb865b70f89 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:02.272748 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4938b981-a26c-43d9-9333-5617ba55a7a0 req-9500e65f-720a-428b-9b8b-aeb865b70f89 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:02.284098 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-4938b981-a26c-43d9-9333-5617ba55a7a0 req-9500e65f-720a-428b-9b8b-aeb865b70f89 service nova] Creating event network-vif-plugged:828e156c-7684-4325-9870-3c975c469ee5 for instance 4e72289b-743f-48d7-aa17-6e71e0915835 on n-h2-862967-2 Oct 29 03:54:02.289283 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-4938b981-a26c-43d9-9333-5617ba55a7a0 req-9500e65f-720a-428b-9b8b-aeb865b70f89 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032204 Oct 29 03:54:02.290165 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3449/7125] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:54:02.854816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-abe63e7d-728c-4e60-9886-b7fe681a56e7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:02.855441 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-abe63e7d-728c-4e60-9886-b7fe681a56e7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:02.862585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abe63e7d-728c-4e60-9886-b7fe681a56e7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:02.863076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abe63e7d-728c-4e60-9886-b7fe681a56e7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:02.863507 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abe63e7d-728c-4e60-9886-b7fe681a56e7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:02.864202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abe63e7d-728c-4e60-9886-b7fe681a56e7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:02.864691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abe63e7d-728c-4e60-9886-b7fe681a56e7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:02.865135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-abe63e7d-728c-4e60-9886-b7fe681a56e7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:03.005691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-abe63e7d-728c-4e60-9886-b7fe681a56e7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:03.013759 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-abe63e7d-728c-4e60-9886-b7fe681a56e7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835" status: 200 len: 1358 microversion: 2.1 time: 0.164807 Oct 29 03:54:03.014344 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3677/7126] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:02 2022] GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:04.042235 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b3db3995-e7b3-4368-86d5-f6315af3e5f0 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:04.042956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b3db3995-e7b3-4368-86d5-f6315af3e5f0 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:04.049623 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3db3995-e7b3-4368-86d5-f6315af3e5f0 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:04.050114 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3db3995-e7b3-4368-86d5-f6315af3e5f0 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:04.050569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3db3995-e7b3-4368-86d5-f6315af3e5f0 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:04.051283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3db3995-e7b3-4368-86d5-f6315af3e5f0 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:04.051752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3db3995-e7b3-4368-86d5-f6315af3e5f0 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:04.052189 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b3db3995-e7b3-4368-86d5-f6315af3e5f0 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:04.194814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b3db3995-e7b3-4368-86d5-f6315af3e5f0 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:04.202959 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b3db3995-e7b3-4368-86d5-f6315af3e5f0 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835" status: 200 len: 1548 microversion: 2.1 time: 0.168056 Oct 29 03:54:04.203513 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3450/7127] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:04 2022] GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835 => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:04.227874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-45de3c67-82d6-4851-93fa-afb1620457f4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:04.228486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-45de3c67-82d6-4851-93fa-afb1620457f4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:04.235783 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45de3c67-82d6-4851-93fa-afb1620457f4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:04.236266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45de3c67-82d6-4851-93fa-afb1620457f4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:04.236806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45de3c67-82d6-4851-93fa-afb1620457f4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:04.237478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45de3c67-82d6-4851-93fa-afb1620457f4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:04.237925 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45de3c67-82d6-4851-93fa-afb1620457f4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:04.238353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45de3c67-82d6-4851-93fa-afb1620457f4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:04.380849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-45de3c67-82d6-4851-93fa-afb1620457f4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:04.392773 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-45de3c67-82d6-4851-93fa-afb1620457f4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835" status: 200 len: 1548 microversion: 2.1 time: 0.170523 Oct 29 03:54:04.393557 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3678/7128] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:04 2022] GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835 => generated 1548 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:04.417343 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bc879923-3641-4e54-a1ed-dec2e47d05d7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:04.422127 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bc879923-3641-4e54-a1ed-dec2e47d05d7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:04.422901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bc879923-3641-4e54-a1ed-dec2e47d05d7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Searching by: {'deleted': False, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f'} {{(pid=127125) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:54:04.428963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc879923-3641-4e54-a1ed-dec2e47d05d7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:04.429467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc879923-3641-4e54-a1ed-dec2e47d05d7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:04.429907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc879923-3641-4e54-a1ed-dec2e47d05d7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:04.430737 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc879923-3641-4e54-a1ed-dec2e47d05d7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:04.431206 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc879923-3641-4e54-a1ed-dec2e47d05d7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:04.431633 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bc879923-3641-4e54-a1ed-dec2e47d05d7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:04.456873 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.multi_cell_list [None req-bc879923-3641-4e54-a1ed-dec2e47d05d7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127125) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:54:04.484818 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bc879923-3641-4e54-a1ed-dec2e47d05d7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.071716 Oct 29 03:54:04.486098 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3451/7129] 10.222.0.46 () {58 vars in 1125 bytes} [Sat Oct 29 03:54:04 2022] GET /compute/v2.1/servers => generated 343 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:54:04.498816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-58643337-c451-4b40-be3b-ebd4069de5d4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:04.499439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-58643337-c451-4b40-be3b-ebd4069de5d4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:04.505669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-58643337-c451-4b40-be3b-ebd4069de5d4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:04.506159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-58643337-c451-4b40-be3b-ebd4069de5d4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:04.506599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-58643337-c451-4b40-be3b-ebd4069de5d4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:04.507310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-58643337-c451-4b40-be3b-ebd4069de5d4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:04.507770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-58643337-c451-4b40-be3b-ebd4069de5d4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:04.508196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-58643337-c451-4b40-be3b-ebd4069de5d4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:04.648729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-58643337-c451-4b40-be3b-ebd4069de5d4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:04.657200 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-58643337-c451-4b40-be3b-ebd4069de5d4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835" status: 200 len: 1548 microversion: 2.1 time: 0.162522 Oct 29 03:54:04.657788 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3679/7130] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:04 2022] GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835 => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:06.264389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-33a020d8-421c-4acf-8237-60a9fe39926c tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b1b0a04-823f-4138-96c5-77b40bc5ee68"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:54:06.266830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-33a020d8-421c-4acf-8237-60a9fe39926c tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:06.274199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33a020d8-421c-4acf-8237-60a9fe39926c tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:06.274716 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33a020d8-421c-4acf-8237-60a9fe39926c tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:06.275164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33a020d8-421c-4acf-8237-60a9fe39926c tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:06.275907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33a020d8-421c-4acf-8237-60a9fe39926c tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:06.276352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33a020d8-421c-4acf-8237-60a9fe39926c tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:06.276835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33a020d8-421c-4acf-8237-60a9fe39926c tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:06.529878 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-33a020d8-421c-4acf-8237-60a9fe39926c tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "POST /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269033 Oct 29 03:54:06.530515 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3452/7131] 10.222.0.46 () {60 vars in 1323 bytes} [Sat Oct 29 03:54:06 2022] POST /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:54:19.700150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-37f6ab28-9f2c-47d9-bcfe-ce2b2d8ce2b3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:19.700769 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-37f6ab28-9f2c-47d9-bcfe-ce2b2d8ce2b3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:19.704219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:54:19.704903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=58 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:54:19.711569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37f6ab28-9f2c-47d9-bcfe-ce2b2d8ce2b3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:19.712089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37f6ab28-9f2c-47d9-bcfe-ce2b2d8ce2b3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:19.712508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37f6ab28-9f2c-47d9-bcfe-ce2b2d8ce2b3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:19.713329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37f6ab28-9f2c-47d9-bcfe-ce2b2d8ce2b3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:19.713785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37f6ab28-9f2c-47d9-bcfe-ce2b2d8ce2b3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:19.714223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-37f6ab28-9f2c-47d9-bcfe-ce2b2d8ce2b3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:19.846912 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-37f6ab28-9f2c-47d9-bcfe-ce2b2d8ce2b3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:19.860376 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-37f6ab28-9f2c-47d9-bcfe-ce2b2d8ce2b3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835" status: 200 len: 1594 microversion: 2.1 time: 0.164101 Oct 29 03:54:19.861350 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3680/7132] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:19 2022] GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835 => generated 1594 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:54:21.970619 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-3b7c42a4-5380-418b-9a9e-ebb1374128cd req-d0021c06-0685-41f0-8ac6-b243eb688bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e72289b-743f-48d7-aa17-6e71e0915835", "tag": "828e156c-7684-4325-9870-3c975c469ee5"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:54:21.980935 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:54:21.982012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:54:21.989090 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:54:21.995223 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3b7c42a4-5380-418b-9a9e-ebb1374128cd req-d0021c06-0685-41f0-8ac6-b243eb688bf7 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:21.995603 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3b7c42a4-5380-418b-9a9e-ebb1374128cd req-d0021c06-0685-41f0-8ac6-b243eb688bf7 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:21.996207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3b7c42a4-5380-418b-9a9e-ebb1374128cd req-d0021c06-0685-41f0-8ac6-b243eb688bf7 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:22.013248 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-3b7c42a4-5380-418b-9a9e-ebb1374128cd req-d0021c06-0685-41f0-8ac6-b243eb688bf7 service nova] Creating event network-changed:828e156c-7684-4325-9870-3c975c469ee5 for instance 4e72289b-743f-48d7-aa17-6e71e0915835 on n-h2-862967-2 Oct 29 03:54:22.019112 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-3b7c42a4-5380-418b-9a9e-ebb1374128cd req-d0021c06-0685-41f0-8ac6-b243eb688bf7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053675 Oct 29 03:54:22.020564 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3453/7133] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:54:23.153823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-82018cd5-81f0-4c6c-85f2-9b93ad329f97 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-704965909"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:54:23.154442 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-82018cd5-81f0-4c6c-85f2-9b93ad329f97 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:23.162115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82018cd5-81f0-4c6c-85f2-9b93ad329f97 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:23.162967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82018cd5-81f0-4c6c-85f2-9b93ad329f97 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:23.163586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82018cd5-81f0-4c6c-85f2-9b93ad329f97 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:23.164877 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82018cd5-81f0-4c6c-85f2-9b93ad329f97 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:23.165367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82018cd5-81f0-4c6c-85f2-9b93ad329f97 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:23.165812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-82018cd5-81f0-4c6c-85f2-9b93ad329f97 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:23.304111 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.network.security_group_api [None req-82018cd5-81f0-4c6c-85f2-9b93ad329f97 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Adding security group dd7cc73c-e1de-402b-879d-72558f1b849a to port 828e156c-7684-4325-9870-3c975c469ee5 Oct 29 03:54:23.668381 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-82018cd5-81f0-4c6c-85f2-9b93ad329f97 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "POST /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835/action" status: 202 len: 0 microversion: 2.1 time: 0.519025 Oct 29 03:54:23.669111 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3681/7134] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:54:23 2022] POST /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835/action => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:54:23.679551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9a772667-a65d-44a6-989f-d4990c61697a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:54:23.680658 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9a772667-a65d-44a6-989f-d4990c61697a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:54:23.688075 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a772667-a65d-44a6-989f-d4990c61697a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:23.688719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a772667-a65d-44a6-989f-d4990c61697a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:23.689882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a772667-a65d-44a6-989f-d4990c61697a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:23.690824 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a772667-a65d-44a6-989f-d4990c61697a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:23.691437 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a772667-a65d-44a6-989f-d4990c61697a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:23.692560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9a772667-a65d-44a6-989f-d4990c61697a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:23.847909 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9a772667-a65d-44a6-989f-d4990c61697a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:54:23.856972 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9a772667-a65d-44a6-989f-d4990c61697a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835" status: 200 len: 1758 microversion: 2.1 time: 0.183004 Oct 29 03:54:23.857909 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3454/7135] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:54:23 2022] GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835 => generated 1758 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:54:24.036325 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-f4c41f60-8e8d-4d2b-bd86-21453542b796 req-b4b05739-eeca-4d90-8724-5d95506adfc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e72289b-743f-48d7-aa17-6e71e0915835", "tag": "828e156c-7684-4325-9870-3c975c469ee5"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:54:24.046494 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f4c41f60-8e8d-4d2b-bd86-21453542b796 req-b4b05739-eeca-4d90-8724-5d95506adfc3 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:54:24.047006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f4c41f60-8e8d-4d2b-bd86-21453542b796 req-b4b05739-eeca-4d90-8724-5d95506adfc3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:54:24.047653 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f4c41f60-8e8d-4d2b-bd86-21453542b796 req-b4b05739-eeca-4d90-8724-5d95506adfc3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:54:24.059952 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-f4c41f60-8e8d-4d2b-bd86-21453542b796 req-b4b05739-eeca-4d90-8724-5d95506adfc3 service nova] Creating event network-changed:828e156c-7684-4325-9870-3c975c469ee5 for instance 4e72289b-743f-48d7-aa17-6e71e0915835 on n-h2-862967-2 Oct 29 03:54:24.065735 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-f4c41f60-8e8d-4d2b-bd86-21453542b796 req-b4b05739-eeca-4d90-8724-5d95506adfc3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033287 Oct 29 03:54:24.066625 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3682/7136] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:56:01.133306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:56:01.134072 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=8 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:56:01.135112 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:56:01.135251 n-d-862967-2 devstack@n-api.service[127125]: Sat Oct 29 03:56:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835/action (ip 10.222.0.46) !!! Oct 29 03:56:01.140994 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-edea2606-2ca8-4ba6-a276-c3131f8c1f03 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:56:01.143250 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-edea2606-2ca8-4ba6-a276-c3131f8c1f03 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:01.151177 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-edea2606-2ca8-4ba6-a276-c3131f8c1f03 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:01.151675 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-edea2606-2ca8-4ba6-a276-c3131f8c1f03 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:01.152122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-edea2606-2ca8-4ba6-a276-c3131f8c1f03 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:01.152855 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-edea2606-2ca8-4ba6-a276-c3131f8c1f03 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:01.153318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-edea2606-2ca8-4ba6-a276-c3131f8c1f03 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:01.153751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-edea2606-2ca8-4ba6-a276-c3131f8c1f03 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:01.231419 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-edea2606-2ca8-4ba6-a276-c3131f8c1f03 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "POST /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835/action" status: 202 len: 0 microversion: 2.1 time: 0.099877 Oct 29 03:56:01.232301 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3455/7137] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:56:01 2022] POST /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:56:01.239412 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:56:01.240158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=12 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:56:01.242125 n-d-862967-2 devstack@n-api.service[127124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:56:01.242274 n-d-862967-2 devstack@n-api.service[127124]: Sat Oct 29 03:56:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835 (ip 10.222.0.46) !!! Oct 29 03:56:01.247034 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-32e41e81-7b42-4346-a008-5299da0cec99 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:01.247729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-32e41e81-7b42-4346-a008-5299da0cec99 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:01.256709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32e41e81-7b42-4346-a008-5299da0cec99 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:01.257134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32e41e81-7b42-4346-a008-5299da0cec99 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:01.257487 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32e41e81-7b42-4346-a008-5299da0cec99 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:01.258195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32e41e81-7b42-4346-a008-5299da0cec99 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:01.258640 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32e41e81-7b42-4346-a008-5299da0cec99 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:01.259060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-32e41e81-7b42-4346-a008-5299da0cec99 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:01.501876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-32e41e81-7b42-4346-a008-5299da0cec99 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:56:01.510691 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-32e41e81-7b42-4346-a008-5299da0cec99 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835" status: 200 len: 1760 microversion: 2.1 time: 0.273422 Oct 29 03:56:01.511490 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3683/7138] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:56:01 2022] GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835 => generated 1760 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:56:02.541835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8a8ea17b-949d-44af-a65f-0ce8bb4a7850 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:56:02.542898 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8a8ea17b-949d-44af-a65f-0ce8bb4a7850 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:56:02.552933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a8ea17b-949d-44af-a65f-0ce8bb4a7850 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:02.553638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a8ea17b-949d-44af-a65f-0ce8bb4a7850 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:02.554310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a8ea17b-949d-44af-a65f-0ce8bb4a7850 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:02.555028 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a8ea17b-949d-44af-a65f-0ce8bb4a7850 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:56:02.555481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a8ea17b-949d-44af-a65f-0ce8bb4a7850 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:56:02.555936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8a8ea17b-949d-44af-a65f-0ce8bb4a7850 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:56:02.709849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8a8ea17b-949d-44af-a65f-0ce8bb4a7850 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:56:02.718251 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8a8ea17b-949d-44af-a65f-0ce8bb4a7850 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835" status: 200 len: 1758 microversion: 2.1 time: 0.185406 Oct 29 03:56:02.718835 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3456/7139] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:56:02 2022] GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835 => generated 1758 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:16.178937 n-d-862967-2 devstack@n-api.service[127124]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a4c67498-176b-466c-9f6d-56e0bcdaf058] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 03:57:16.179963 n-d-862967-2 devstack@n-api.service[127124]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2206413f-602f-4f31-86b1-4a062554af7b] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 03:57:16.180675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:57:16.181715 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:57:16.187581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-041b940b-8499-45b0-a310-63201f50ac0b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-704965909"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:57:16.188119 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-041b940b-8499-45b0-a310-63201f50ac0b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:16.194804 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-041b940b-8499-45b0-a310-63201f50ac0b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:16.195288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-041b940b-8499-45b0-a310-63201f50ac0b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:16.195720 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-041b940b-8499-45b0-a310-63201f50ac0b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:16.196423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-041b940b-8499-45b0-a310-63201f50ac0b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:16.196913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-041b940b-8499-45b0-a310-63201f50ac0b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:16.197337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-041b940b-8499-45b0-a310-63201f50ac0b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:16.340916 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.network.security_group_api [None req-041b940b-8499-45b0-a310-63201f50ac0b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Removing security group dd7cc73c-e1de-402b-879d-72558f1b849a from port 828e156c-7684-4325-9870-3c975c469ee5 Oct 29 03:57:16.670210 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-041b940b-8499-45b0-a310-63201f50ac0b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "POST /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835/action" status: 202 len: 0 microversion: 2.1 time: 0.494366 Oct 29 03:57:16.671333 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3684/7140] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:57:16 2022] POST /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:57:16.681088 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:57:16.682517 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:57:16.762262 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-3b72caf7-1abb-48fc-bd03-e2c39849b8a7 req-b1c4fc04-21d3-4449-9efc-6cb05f242a73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e72289b-743f-48d7-aa17-6e71e0915835", "tag": "828e156c-7684-4325-9870-3c975c469ee5"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:57:16.773858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3b72caf7-1abb-48fc-bd03-e2c39849b8a7 req-b1c4fc04-21d3-4449-9efc-6cb05f242a73 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:16.774419 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3b72caf7-1abb-48fc-bd03-e2c39849b8a7 req-b1c4fc04-21d3-4449-9efc-6cb05f242a73 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:16.774932 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3b72caf7-1abb-48fc-bd03-e2c39849b8a7 req-b1c4fc04-21d3-4449-9efc-6cb05f242a73 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:16.786934 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-3b72caf7-1abb-48fc-bd03-e2c39849b8a7 req-b1c4fc04-21d3-4449-9efc-6cb05f242a73 service nova] Creating event network-changed:828e156c-7684-4325-9870-3c975c469ee5 for instance 4e72289b-743f-48d7-aa17-6e71e0915835 on n-h2-862967-2 Oct 29 03:57:16.792505 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-3b72caf7-1abb-48fc-bd03-e2c39849b8a7 req-b1c4fc04-21d3-4449-9efc-6cb05f242a73 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117881 Oct 29 03:57:16.793402 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3457/7141] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:57:18.372308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5a89bb27-f7b7-4869-a47b-c8105f797eef tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:18.372933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5a89bb27-f7b7-4869-a47b-c8105f797eef tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:18.387084 n-d-862967-2 devstack@n-api.service[127124]: INFO oslo.messaging._drivers.impl_rabbit [-] [a4c67498-176b-466c-9f6d-56e0bcdaf058] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 39674. Oct 29 03:57:18.395829 n-d-862967-2 devstack@n-api.service[127124]: INFO oslo.messaging._drivers.impl_rabbit [-] [2206413f-602f-4f31-86b1-4a062554af7b] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 39676. Oct 29 03:57:18.397683 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a89bb27-f7b7-4869-a47b-c8105f797eef tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:18.398167 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a89bb27-f7b7-4869-a47b-c8105f797eef tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:18.398800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a89bb27-f7b7-4869-a47b-c8105f797eef tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:18.399504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a89bb27-f7b7-4869-a47b-c8105f797eef tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:18.399953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a89bb27-f7b7-4869-a47b-c8105f797eef tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:18.400376 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5a89bb27-f7b7-4869-a47b-c8105f797eef tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:18.488969 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-5a89bb27-f7b7-4869-a47b-c8105f797eef tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lazy-loading 'services' on Instance uuid 4e72289b-743f-48d7-aa17-6e71e0915835 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:57:18.563406 n-d-862967-2 devstack@n-api.service[127124]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5a89bb27-f7b7-4869-a47b-c8105f797eef tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [ba182dd5-1346-4c3f-bf7c-4cfd99451de4] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 03:57:18.808880 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-08704d62-c5c4-4313-b7e6-8d38591130b8 req-78ffd828-1efc-475e-a3d9-41da657ee900 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e72289b-743f-48d7-aa17-6e71e0915835", "tag": "828e156c-7684-4325-9870-3c975c469ee5"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:57:18.819081 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-08704d62-c5c4-4313-b7e6-8d38591130b8 req-78ffd828-1efc-475e-a3d9-41da657ee900 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:18.819649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-08704d62-c5c4-4313-b7e6-8d38591130b8 req-78ffd828-1efc-475e-a3d9-41da657ee900 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:18.820182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-08704d62-c5c4-4313-b7e6-8d38591130b8 req-78ffd828-1efc-475e-a3d9-41da657ee900 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:18.831651 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-08704d62-c5c4-4313-b7e6-8d38591130b8 req-78ffd828-1efc-475e-a3d9-41da657ee900 service nova] Creating event network-changed:828e156c-7684-4325-9870-3c975c469ee5 for instance 4e72289b-743f-48d7-aa17-6e71e0915835 on n-h2-862967-2 Oct 29 03:57:18.837169 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-08704d62-c5c4-4313-b7e6-8d38591130b8 req-78ffd828-1efc-475e-a3d9-41da657ee900 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033317 Oct 29 03:57:18.838163 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3458/7142] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:57:19.572057 n-d-862967-2 devstack@n-api.service[127124]: INFO oslo.messaging._drivers.impl_rabbit [None req-5a89bb27-f7b7-4869-a47b-c8105f797eef tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [ba182dd5-1346-4c3f-bf7c-4cfd99451de4] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 39684. Oct 29 03:57:19.575898 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5a89bb27-f7b7-4869-a47b-c8105f797eef tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835/os-volume_attachments/3b1b0a04-823f-4138-96c5-77b40bc5ee68" status: 202 len: 0 microversion: 2.1 time: 1.208597 Oct 29 03:57:19.576508 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3685/7143] 10.222.0.46 () {58 vars in 1416 bytes} [Sat Oct 29 03:57:18 2022] DELETE /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835/os-volume_attachments/3b1b0a04-823f-4138-96c5-77b40bc5ee68 => generated 0 bytes in 1210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:57:19.585838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cd3c3a8d-b386-41e8-a7ad-840fc45693f3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:19.588482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cd3c3a8d-b386-41e8-a7ad-840fc45693f3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:19.596221 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd3c3a8d-b386-41e8-a7ad-840fc45693f3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:19.596832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd3c3a8d-b386-41e8-a7ad-840fc45693f3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:19.597398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd3c3a8d-b386-41e8-a7ad-840fc45693f3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:19.598164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd3c3a8d-b386-41e8-a7ad-840fc45693f3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:19.598630 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd3c3a8d-b386-41e8-a7ad-840fc45693f3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:19.599106 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cd3c3a8d-b386-41e8-a7ad-840fc45693f3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:19.632133 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cd3c3a8d-b386-41e8-a7ad-840fc45693f3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050746 Oct 29 03:57:19.632904 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3459/7144] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:57:19 2022] GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:57:20.646170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5cb24a7a-47a9-4efb-a3f3-8917daf2687b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:20.648779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5cb24a7a-47a9-4efb-a3f3-8917daf2687b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:20.658541 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5cb24a7a-47a9-4efb-a3f3-8917daf2687b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:20.659035 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5cb24a7a-47a9-4efb-a3f3-8917daf2687b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:20.659473 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5cb24a7a-47a9-4efb-a3f3-8917daf2687b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:20.660178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5cb24a7a-47a9-4efb-a3f3-8917daf2687b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:20.660662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5cb24a7a-47a9-4efb-a3f3-8917daf2687b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:20.661096 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5cb24a7a-47a9-4efb-a3f3-8917daf2687b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:20.691920 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5cb24a7a-47a9-4efb-a3f3-8917daf2687b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051104 Oct 29 03:57:20.692500 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3686/7145] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:57:20 2022] GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:57:21.704946 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-72f19f6a-813a-4cf1-8fb5-a7ae451142d0 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:21.707195 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-72f19f6a-813a-4cf1-8fb5-a7ae451142d0 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:21.714805 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-72f19f6a-813a-4cf1-8fb5-a7ae451142d0 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:21.715310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-72f19f6a-813a-4cf1-8fb5-a7ae451142d0 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:21.715734 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-72f19f6a-813a-4cf1-8fb5-a7ae451142d0 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:21.716485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-72f19f6a-813a-4cf1-8fb5-a7ae451142d0 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:21.716996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-72f19f6a-813a-4cf1-8fb5-a7ae451142d0 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:21.717437 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-72f19f6a-813a-4cf1-8fb5-a7ae451142d0 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:21.749312 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-72f19f6a-813a-4cf1-8fb5-a7ae451142d0 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048537 Oct 29 03:57:21.749888 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3460/7146] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:57:21 2022] GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:57:22.762698 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-70944856-86db-4864-809b-5e45fa388b18 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:22.765013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-70944856-86db-4864-809b-5e45fa388b18 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:22.772366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70944856-86db-4864-809b-5e45fa388b18 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:22.772879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70944856-86db-4864-809b-5e45fa388b18 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:22.773316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70944856-86db-4864-809b-5e45fa388b18 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:22.774019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70944856-86db-4864-809b-5e45fa388b18 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:22.774468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70944856-86db-4864-809b-5e45fa388b18 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:22.774891 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-70944856-86db-4864-809b-5e45fa388b18 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:22.804310 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-70944856-86db-4864-809b-5e45fa388b18 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045786 Oct 29 03:57:22.804910 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3687/7147] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:57:22 2022] GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:57:23.817401 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-32838929-4f90-4ea9-ac5b-10839bcbb669 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:23.819511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-32838929-4f90-4ea9-ac5b-10839bcbb669 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:23.826845 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32838929-4f90-4ea9-ac5b-10839bcbb669 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:23.827553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32838929-4f90-4ea9-ac5b-10839bcbb669 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:23.828002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32838929-4f90-4ea9-ac5b-10839bcbb669 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:23.828754 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32838929-4f90-4ea9-ac5b-10839bcbb669 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:23.829224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32838929-4f90-4ea9-ac5b-10839bcbb669 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:23.829654 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-32838929-4f90-4ea9-ac5b-10839bcbb669 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:23.863433 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-32838929-4f90-4ea9-ac5b-10839bcbb669 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050171 Oct 29 03:57:23.869214 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3461/7148] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:57:23 2022] GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:57:24.881768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d6f7dc01-0f4a-4ff4-b8f4-7acb444b68f2 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:24.885387 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d6f7dc01-0f4a-4ff4-b8f4-7acb444b68f2 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:24.898068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6f7dc01-0f4a-4ff4-b8f4-7acb444b68f2 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:24.899223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6f7dc01-0f4a-4ff4-b8f4-7acb444b68f2 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:24.899945 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6f7dc01-0f4a-4ff4-b8f4-7acb444b68f2 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:24.901117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6f7dc01-0f4a-4ff4-b8f4-7acb444b68f2 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:24.901908 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6f7dc01-0f4a-4ff4-b8f4-7acb444b68f2 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:24.902613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6f7dc01-0f4a-4ff4-b8f4-7acb444b68f2 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:24.936021 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d6f7dc01-0f4a-4ff4-b8f4-7acb444b68f2 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060911 Oct 29 03:57:24.936737 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3688/7149] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:57:24 2022] GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:57:24.947632 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e8e7df4a-e96e-4c79-b0ce-5b1ad70de3ed tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:24.948142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e8e7df4a-e96e-4c79-b0ce-5b1ad70de3ed tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:24.955376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e8e7df4a-e96e-4c79-b0ce-5b1ad70de3ed tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:24.955883 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e8e7df4a-e96e-4c79-b0ce-5b1ad70de3ed tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:24.956337 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e8e7df4a-e96e-4c79-b0ce-5b1ad70de3ed tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:24.957079 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e8e7df4a-e96e-4c79-b0ce-5b1ad70de3ed tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:24.957619 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e8e7df4a-e96e-4c79-b0ce-5b1ad70de3ed tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:24.958064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e8e7df4a-e96e-4c79-b0ce-5b1ad70de3ed tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:25.051906 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-e8e7df4a-e96e-4c79-b0ce-5b1ad70de3ed tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] HTTP exception thrown: Instance 4e72289b-743f-48d7-aa17-6e71e0915835 is not attached to volume 3b1b0a04-823f-4138-96c5-77b40bc5ee68 Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e8e7df4a-e96e-4c79-b0ce-5b1ad70de3ed tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Request method failure captured: Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835/os-volume_attachments/3b1b0a04-823f-4138-96c5-77b40bc5ee68 HTTP/1.1 Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKO8VyBEm616rDxZZ2HhsdSaiwOLbniQZiu9YFajJDuQ-ReBuYHfCBZLbm2Cr42exVh-abUfter3x_eUZ61FrQMUlR0B7fsP_gWClDmEO6eBBgyO-yLq0_TRBqjSA4xbtaMCj1Bxw7NRJzplORDK6VtaxRXLQEU0Qt0W-P6WQ5oq4-o Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 4b9d21bdd55942b9b4df5eb5cb6b7b1f Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestMinimumBasicScenario-378113244 Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4b9d21bdd55942b9b4df5eb5cb6b7b1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4b9d21bdd55942b9b4df5eb5cb6b7b1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4b9d21bdd55942b9b4df5eb5cb6b7b1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4b9d21bdd55942b9b4df5eb5cb6b7b1f"}]}] Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestMinimumBasicScenario-378113244 Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 4b9d21bdd55942b9b4df5eb5cb6b7b1f Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestMinimumBasicScenario-378113244 Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestMinimumBasicScenario-378113244-project Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 3cd4d68a896348d1966819f53bc97717 Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestMinimumBasicScenario-378113244-project Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 4e72289b-743f-48d7-aa17-6e71e0915835 is not attached to volume 3b1b0a04-823f-4138-96c5-77b40bc5ee68 Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'server_id': '4e72289b-743f-48d7-aa17-6e71e0915835', 'id': '3b1b0a04-823f-4138-96c5-77b40bc5ee68'} Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3b1b0a04-823f-4138-96c5-77b40bc5ee68. Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e72289b-743f-48d7-aa17-6e71e0915835 is not attached to volume 3b1b0a04-823f-4138-96c5-77b40bc5ee68 Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:57:25.053585 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:57:25.057830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:57:25.057830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:57:25.057830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e72289b-743f-48d7-aa17-6e71e0915835 is not attached to volume 3b1b0a04-823f-4138-96c5-77b40bc5ee68 Oct 29 03:57:25.057830 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:57:25.057830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e8e7df4a-e96e-4c79-b0ce-5b1ad70de3ed tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Returning 404 to user: Instance 4e72289b-743f-48d7-aa17-6e71e0915835 is not attached to volume 3b1b0a04-823f-4138-96c5-77b40bc5ee68 {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:57:25.057830 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e8e7df4a-e96e-4c79-b0ce-5b1ad70de3ed tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835/os-volume_attachments/3b1b0a04-823f-4138-96c5-77b40bc5ee68" status: 404 len: 154 microversion: 2.1 time: 0.111552 Oct 29 03:57:25.057830 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3462/7150] 10.222.0.46 () {58 vars in 1416 bytes} [Sat Oct 29 03:57:24 2022] DELETE /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835/os-volume_attachments/3b1b0a04-823f-4138-96c5-77b40bc5ee68 => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:57:28.335426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-134d3c50-f8ea-4cf3-a7be-ad6743a96b39 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:28.336510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-134d3c50-f8ea-4cf3-a7be-ad6743a96b39 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:28.343758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-134d3c50-f8ea-4cf3-a7be-ad6743a96b39 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:28.344246 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-134d3c50-f8ea-4cf3-a7be-ad6743a96b39 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:28.344705 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-134d3c50-f8ea-4cf3-a7be-ad6743a96b39 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:28.345404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-134d3c50-f8ea-4cf3-a7be-ad6743a96b39 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:28.345849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-134d3c50-f8ea-4cf3-a7be-ad6743a96b39 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:28.346256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-134d3c50-f8ea-4cf3-a7be-ad6743a96b39 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:28.376034 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-134d3c50-f8ea-4cf3-a7be-ad6743a96b39 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:57:28.462211 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-134d3c50-f8ea-4cf3-a7be-ad6743a96b39 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835" status: 204 len: 0 microversion: 2.1 time: 0.130613 Oct 29 03:57:28.467290 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3689/7151] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:57:28 2022] DELETE /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:57:28.474049 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7fc40c60-0ccf-4f1e-8be8-e080f6fe59ca tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:28.475935 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7fc40c60-0ccf-4f1e-8be8-e080f6fe59ca tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:28.484932 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fc40c60-0ccf-4f1e-8be8-e080f6fe59ca tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:28.485899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fc40c60-0ccf-4f1e-8be8-e080f6fe59ca tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:28.486355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fc40c60-0ccf-4f1e-8be8-e080f6fe59ca tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:28.487062 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fc40c60-0ccf-4f1e-8be8-e080f6fe59ca tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:28.487523 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fc40c60-0ccf-4f1e-8be8-e080f6fe59ca tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:28.487954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7fc40c60-0ccf-4f1e-8be8-e080f6fe59ca tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:28.621841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7fc40c60-0ccf-4f1e-8be8-e080f6fe59ca tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:28.630184 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7fc40c60-0ccf-4f1e-8be8-e080f6fe59ca tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835" status: 200 len: 1554 microversion: 2.1 time: 0.161431 Oct 29 03:57:28.630773 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3463/7152] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:28 2022] GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:29.655815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-810bf5ee-1904-48aa-8cae-a7583c030ae3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:29.656467 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-810bf5ee-1904-48aa-8cae-a7583c030ae3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:29.664700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-810bf5ee-1904-48aa-8cae-a7583c030ae3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:29.665178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-810bf5ee-1904-48aa-8cae-a7583c030ae3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:29.665614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-810bf5ee-1904-48aa-8cae-a7583c030ae3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:29.666307 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-810bf5ee-1904-48aa-8cae-a7583c030ae3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:29.666759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-810bf5ee-1904-48aa-8cae-a7583c030ae3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:29.667186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-810bf5ee-1904-48aa-8cae-a7583c030ae3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:29.804945 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-810bf5ee-1904-48aa-8cae-a7583c030ae3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:29.812843 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-810bf5ee-1904-48aa-8cae-a7583c030ae3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835" status: 200 len: 1554 microversion: 2.1 time: 0.162387 Oct 29 03:57:29.813456 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3690/7153] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:29 2022] GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:30.574186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-c95fb18c-86cd-4720-b39e-375fc29c7a3e req-f6da01fb-b18a-45e2-8abc-8d72e64e91cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e72289b-743f-48d7-aa17-6e71e0915835", "name": "network-vif-deleted", "tag": "828e156c-7684-4325-9870-3c975c469ee5"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:57:30.585075 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c95fb18c-86cd-4720-b39e-375fc29c7a3e req-f6da01fb-b18a-45e2-8abc-8d72e64e91cd service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:30.585499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c95fb18c-86cd-4720-b39e-375fc29c7a3e req-f6da01fb-b18a-45e2-8abc-8d72e64e91cd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:30.585944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c95fb18c-86cd-4720-b39e-375fc29c7a3e req-f6da01fb-b18a-45e2-8abc-8d72e64e91cd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:30.597736 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-c95fb18c-86cd-4720-b39e-375fc29c7a3e req-f6da01fb-b18a-45e2-8abc-8d72e64e91cd service nova] Creating event network-vif-deleted:828e156c-7684-4325-9870-3c975c469ee5 for instance 4e72289b-743f-48d7-aa17-6e71e0915835 on n-h2-862967-2 Oct 29 03:57:30.603223 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-c95fb18c-86cd-4720-b39e-375fc29c7a3e req-f6da01fb-b18a-45e2-8abc-8d72e64e91cd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032781 Oct 29 03:57:30.603841 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3464/7154] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:57:30.844448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-20963cfc-49f6-4641-a6e9-7b888475d6ba tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:30.845197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-20963cfc-49f6-4641-a6e9-7b888475d6ba tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:30.852516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20963cfc-49f6-4641-a6e9-7b888475d6ba tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:30.853109 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20963cfc-49f6-4641-a6e9-7b888475d6ba tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:30.853512 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20963cfc-49f6-4641-a6e9-7b888475d6ba tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:30.854155 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20963cfc-49f6-4641-a6e9-7b888475d6ba tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:30.854657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20963cfc-49f6-4641-a6e9-7b888475d6ba tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:30.855015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20963cfc-49f6-4641-a6e9-7b888475d6ba tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:30.888121 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20963cfc-49f6-4641-a6e9-7b888475d6ba tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:30.888628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20963cfc-49f6-4641-a6e9-7b888475d6ba tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:30.889096 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-20963cfc-49f6-4641-a6e9-7b888475d6ba tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:30.889492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-20963cfc-49f6-4641-a6e9-7b888475d6ba tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lazy-loading 'fault' on Instance uuid 4e72289b-743f-48d7-aa17-6e71e0915835 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:57:30.931026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-20963cfc-49f6-4641-a6e9-7b888475d6ba tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:30.939308 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-20963cfc-49f6-4641-a6e9-7b888475d6ba tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835" status: 200 len: 1348 microversion: 2.1 time: 0.100362 Oct 29 03:57:30.939901 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3691/7155] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:30 2022] GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835 => generated 1348 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:31.969970 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-90c43e53-a6de-41f5-9522-67f4770a686a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:31.970992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-90c43e53-a6de-41f5-9522-67f4770a686a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 4e72289b-743f-48d7-aa17-6e71e0915835] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:31.981641 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90c43e53-a6de-41f5-9522-67f4770a686a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:31.982446 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90c43e53-a6de-41f5-9522-67f4770a686a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:31.983207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90c43e53-a6de-41f5-9522-67f4770a686a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:31.984351 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90c43e53-a6de-41f5-9522-67f4770a686a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:31.984845 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90c43e53-a6de-41f5-9522-67f4770a686a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:31.985290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-90c43e53-a6de-41f5-9522-67f4770a686a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:31.999306 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-90c43e53-a6de-41f5-9522-67f4770a686a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] HTTP exception thrown: Instance 4e72289b-743f-48d7-aa17-6e71e0915835 could not be found. Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-90c43e53-a6de-41f5-9522-67f4770a686a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Request method failure captured: Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835 HTTP/1.1 Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKO8VyBEm616rDxZZ2HhsdSaiwOLbniQZiu9YFajJDuQ-ReBuYHfCBZLbm2Cr42exVh-abUfter3x_eUZ61FrQMUlR0B7fsP_gWClDmEO6eBBgyO-yLq0_TRBqjSA4xbtaMCj1Bxw7NRJzplORDK6VtaxRXLQEU0Qt0W-P6WQ5oq4-o Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 4b9d21bdd55942b9b4df5eb5cb6b7b1f Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestMinimumBasicScenario-378113244 Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4b9d21bdd55942b9b4df5eb5cb6b7b1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4b9d21bdd55942b9b4df5eb5cb6b7b1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4b9d21bdd55942b9b4df5eb5cb6b7b1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4b9d21bdd55942b9b4df5eb5cb6b7b1f"}]}] Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestMinimumBasicScenario-378113244 Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 4b9d21bdd55942b9b4df5eb5cb6b7b1f Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestMinimumBasicScenario-378113244 Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestMinimumBasicScenario-378113244-project Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 3cd4d68a896348d1966819f53bc97717 Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestMinimumBasicScenario-378113244-project Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 4e72289b-743f-48d7-aa17-6e71e0915835 could not be found. Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '4e72289b-743f-48d7-aa17-6e71e0915835'} Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e72289b-743f-48d7-aa17-6e71e0915835 could not be found. Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e72289b-743f-48d7-aa17-6e71e0915835 could not be found. Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:57:32.000999 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:57:32.005665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:57:32.005665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:57:32.005665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:57:32.005665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:57:32.005665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:57:32.005665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e72289b-743f-48d7-aa17-6e71e0915835 could not be found. Oct 29 03:57:32.005665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:57:32.005665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-90c43e53-a6de-41f5-9522-67f4770a686a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Returning 404 to user: Instance 4e72289b-743f-48d7-aa17-6e71e0915835 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:57:32.005665 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-90c43e53-a6de-41f5-9522-67f4770a686a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835" status: 404 len: 111 microversion: 2.1 time: 0.041265 Oct 29 03:57:32.005665 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3465/7156] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:31 2022] GET /compute/v2.1/servers/4e72289b-743f-48d7-aa17-6e71e0915835 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:57:32.011569 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8ae54f1f-8b15-42f3-81bd-699a6c922076 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '.version_select at 0x7ff0581868b0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:32.034085 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8ae54f1f-8b15-42f3-81bd-699a6c922076 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-586248713" status: 202 len: 0 microversion: 2.1 time: 0.026398 Oct 29 03:57:32.034860 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3692/7157] 10.222.0.46 () {58 vars in 1269 bytes} [Sat Oct 29 03:57:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-586248713 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:57:41.351081 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9f11a467-ff83-4fb5-a20e-a305e299b26a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Action: 'create', calling method: .version_select at 0x7ff05388bd30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1555389727", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwPgnPy53HfXZbX02rvl7OA+kYXUUjkQ95h39wlSNiCh7wyrci3wJXOQp0+kL+ENd7my/kd0iT8Qj5jp4iFgrIuWnFCQm0HGpg8IN9Zpr4CnriCy9wdTi0SHPv8vj9j7Q=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:57:41.361296 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:57:41.361505 n-d-862967-2 devstack@n-api.service[127125]: Sat Oct 29 03:57:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.46) !!! Oct 29 03:57:41.379825 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-9f11a467-ff83-4fb5-a20e-a305e299b26a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Getting quotas for project 4b9d21bdd55942b9b4df5eb5cb6b7b1f. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:57:41.385257 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-9f11a467-ff83-4fb5-a20e-a305e299b26a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Getting quotas for user 3cd4d68a896348d1966819f53bc97717 and project 4b9d21bdd55942b9b4df5eb5cb6b7b1f. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:57:41.421102 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9f11a467-ff83-4fb5-a20e-a305e299b26a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.075924 Oct 29 03:57:41.421725 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3466/7158] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:57:41 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:57:41.475479 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:57:41.480871 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-52fae50a-b1fa-4ed4-9210-8297842a964d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1411107426", "imageRef": "413e3ea1-4210-482b-b1d8-e6693a28faec", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1555389727", "networks": [{"uuid": "cdd124e6-b2da-4e5e-a304-c6e38e494125"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:57:41.537866 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-52fae50a-b1fa-4ed4-9210-8297842a964d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] validate_networks() for [('cdd124e6-b2da-4e5e-a304-c6e38e494125', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:57:42.010078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-52fae50a-b1fa-4ed4-9210-8297842a964d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:57:42.010504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-52fae50a-b1fa-4ed4-9210-8297842a964d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:57:42.010980 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-52fae50a-b1fa-4ed4-9210-8297842a964d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:57:42.011386 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-52fae50a-b1fa-4ed4-9210-8297842a964d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:57:42.011797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-52fae50a-b1fa-4ed4-9210-8297842a964d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:57:42.020976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-52fae50a-b1fa-4ed4-9210-8297842a964d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:42.021456 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-52fae50a-b1fa-4ed4-9210-8297842a964d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:42.021888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-52fae50a-b1fa-4ed4-9210-8297842a964d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:42.022614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-52fae50a-b1fa-4ed4-9210-8297842a964d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:42.023064 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-52fae50a-b1fa-4ed4-9210-8297842a964d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:42.023483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-52fae50a-b1fa-4ed4-9210-8297842a964d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:42.045233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-52fae50a-b1fa-4ed4-9210-8297842a964d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Getting quotas for project 4b9d21bdd55942b9b4df5eb5cb6b7b1f. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:57:42.051380 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-52fae50a-b1fa-4ed4-9210-8297842a964d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Getting quotas for user 3cd4d68a896348d1966819f53bc97717 and project 4b9d21bdd55942b9b4df5eb5cb6b7b1f. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:57:42.064464 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-52fae50a-b1fa-4ed4-9210-8297842a964d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:57:42.066905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-52fae50a-b1fa-4ed4-9210-8297842a964d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='413e3ea1-4210-482b-b1d8-e6693a28faec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:57:42.127546 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-52fae50a-b1fa-4ed4-9210-8297842a964d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653859 Oct 29 03:57:42.128215 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3693/7159] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:57:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:57:42.136276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=38 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:57:42.140610 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f753ce82-6768-4a0c-89e5-b5278b7262fb tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:42.141538 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f753ce82-6768-4a0c-89e5-b5278b7262fb tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:42.199951 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f753ce82-6768-4a0c-89e5-b5278b7262fb tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:42.207202 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f753ce82-6768-4a0c-89e5-b5278b7262fb tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1259 microversion: 2.1 time: 0.071617 Oct 29 03:57:42.208164 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3467/7160] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:42 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:43.232537 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6a882b01-b30f-4010-91a8-9ce9eacfbc43 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:43.233274 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6a882b01-b30f-4010-91a8-9ce9eacfbc43 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:43.240471 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a882b01-b30f-4010-91a8-9ce9eacfbc43 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:43.241400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a882b01-b30f-4010-91a8-9ce9eacfbc43 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:43.241856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a882b01-b30f-4010-91a8-9ce9eacfbc43 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:43.242619 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a882b01-b30f-4010-91a8-9ce9eacfbc43 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:43.243082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a882b01-b30f-4010-91a8-9ce9eacfbc43 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:43.243502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6a882b01-b30f-4010-91a8-9ce9eacfbc43 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:43.317928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6a882b01-b30f-4010-91a8-9ce9eacfbc43 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:43.328638 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6a882b01-b30f-4010-91a8-9ce9eacfbc43 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1311 microversion: 2.1 time: 0.100812 Oct 29 03:57:43.329945 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3694/7161] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:43 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:44.366421 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6bfee14d-fe63-42db-a5ec-5ac85db71bf5 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:44.372006 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6bfee14d-fe63-42db-a5ec-5ac85db71bf5 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:44.383420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bfee14d-fe63-42db-a5ec-5ac85db71bf5 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:44.384085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bfee14d-fe63-42db-a5ec-5ac85db71bf5 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:44.384563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bfee14d-fe63-42db-a5ec-5ac85db71bf5 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:44.385298 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bfee14d-fe63-42db-a5ec-5ac85db71bf5 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:44.385975 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bfee14d-fe63-42db-a5ec-5ac85db71bf5 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:44.386507 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6bfee14d-fe63-42db-a5ec-5ac85db71bf5 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:44.542620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6bfee14d-fe63-42db-a5ec-5ac85db71bf5 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:44.551544 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6bfee14d-fe63-42db-a5ec-5ac85db71bf5 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1359 microversion: 2.1 time: 0.189466 Oct 29 03:57:44.552966 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3468/7162] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:44 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:45.575693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f0caa651-85db-433d-8b4e-06bf6b6f3f9e tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:45.576301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f0caa651-85db-433d-8b4e-06bf6b6f3f9e tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:45.583457 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0caa651-85db-433d-8b4e-06bf6b6f3f9e tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:45.583951 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0caa651-85db-433d-8b4e-06bf6b6f3f9e tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:45.584379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0caa651-85db-433d-8b4e-06bf6b6f3f9e tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:45.585178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0caa651-85db-433d-8b4e-06bf6b6f3f9e tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:45.585668 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0caa651-85db-433d-8b4e-06bf6b6f3f9e tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:45.586112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0caa651-85db-433d-8b4e-06bf6b6f3f9e tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:45.730088 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f0caa651-85db-433d-8b4e-06bf6b6f3f9e tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:45.739915 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f0caa651-85db-433d-8b4e-06bf6b6f3f9e tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1359 microversion: 2.1 time: 0.168132 Oct 29 03:57:45.741930 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3695/7163] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:45 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:46.763850 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-822ea1eb-5e5f-4df4-85f4-11c51b47bcd4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:46.764494 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-822ea1eb-5e5f-4df4-85f4-11c51b47bcd4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:46.767441 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:57:46.777071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-822ea1eb-5e5f-4df4-85f4-11c51b47bcd4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:46.777620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-822ea1eb-5e5f-4df4-85f4-11c51b47bcd4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:46.778149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-822ea1eb-5e5f-4df4-85f4-11c51b47bcd4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:46.779162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-822ea1eb-5e5f-4df4-85f4-11c51b47bcd4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:46.779693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-822ea1eb-5e5f-4df4-85f4-11c51b47bcd4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:46.780450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-822ea1eb-5e5f-4df4-85f4-11c51b47bcd4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:46.931429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-822ea1eb-5e5f-4df4-85f4-11c51b47bcd4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:46.941226 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-822ea1eb-5e5f-4df4-85f4-11c51b47bcd4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1359 microversion: 2.1 time: 0.181286 Oct 29 03:57:46.950978 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3469/7164] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:46 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:47.968183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bdbf8ea8-79aa-4b89-94fe-173840229d9a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:47.969023 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bdbf8ea8-79aa-4b89-94fe-173840229d9a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:47.975921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:57:47.977490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdbf8ea8-79aa-4b89-94fe-173840229d9a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:47.978353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdbf8ea8-79aa-4b89-94fe-173840229d9a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:47.978939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdbf8ea8-79aa-4b89-94fe-173840229d9a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:47.979762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdbf8ea8-79aa-4b89-94fe-173840229d9a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:47.980316 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdbf8ea8-79aa-4b89-94fe-173840229d9a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:47.980772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdbf8ea8-79aa-4b89-94fe-173840229d9a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:48.129754 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bdbf8ea8-79aa-4b89-94fe-173840229d9a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:48.139596 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bdbf8ea8-79aa-4b89-94fe-173840229d9a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1359 microversion: 2.1 time: 0.176962 Oct 29 03:57:48.140464 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3696/7165] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:47 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:49.165041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9f875a86-8608-4c40-9b00-907f1002c59b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:49.165852 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9f875a86-8608-4c40-9b00-907f1002c59b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:49.173091 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f875a86-8608-4c40-9b00-907f1002c59b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:49.173600 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f875a86-8608-4c40-9b00-907f1002c59b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:49.174063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f875a86-8608-4c40-9b00-907f1002c59b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:49.174795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f875a86-8608-4c40-9b00-907f1002c59b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:49.175283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f875a86-8608-4c40-9b00-907f1002c59b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:49.175707 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f875a86-8608-4c40-9b00-907f1002c59b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:49.321457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9f875a86-8608-4c40-9b00-907f1002c59b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:49.331930 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9f875a86-8608-4c40-9b00-907f1002c59b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1359 microversion: 2.1 time: 0.171210 Oct 29 03:57:49.345125 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3470/7166] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:49 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:50.359909 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cf73713b-a9a6-4e97-a917-cfd3196b9b1a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:50.360623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cf73713b-a9a6-4e97-a917-cfd3196b9b1a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:50.367999 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf73713b-a9a6-4e97-a917-cfd3196b9b1a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:50.368606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf73713b-a9a6-4e97-a917-cfd3196b9b1a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:50.369118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf73713b-a9a6-4e97-a917-cfd3196b9b1a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:50.369933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf73713b-a9a6-4e97-a917-cfd3196b9b1a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:50.370314 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf73713b-a9a6-4e97-a917-cfd3196b9b1a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:50.370742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf73713b-a9a6-4e97-a917-cfd3196b9b1a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:50.516610 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cf73713b-a9a6-4e97-a917-cfd3196b9b1a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:50.525019 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cf73713b-a9a6-4e97-a917-cfd3196b9b1a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1359 microversion: 2.1 time: 0.171354 Oct 29 03:57:50.525819 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3697/7167] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:50 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:51.552113 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a4a745cb-1fd6-4437-a58d-5ee89d9e0731 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:51.559796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a4a745cb-1fd6-4437-a58d-5ee89d9e0731 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:51.568501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a4a745cb-1fd6-4437-a58d-5ee89d9e0731 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:51.569039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a4a745cb-1fd6-4437-a58d-5ee89d9e0731 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:51.569489 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a4a745cb-1fd6-4437-a58d-5ee89d9e0731 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:51.570391 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a4a745cb-1fd6-4437-a58d-5ee89d9e0731 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:51.571010 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a4a745cb-1fd6-4437-a58d-5ee89d9e0731 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:51.571453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a4a745cb-1fd6-4437-a58d-5ee89d9e0731 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:51.713817 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a4a745cb-1fd6-4437-a58d-5ee89d9e0731 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:51.722606 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a4a745cb-1fd6-4437-a58d-5ee89d9e0731 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1359 microversion: 2.1 time: 0.175647 Oct 29 03:57:51.723126 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3471/7168] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:51 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:51.851444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-8e7a40fe-8173-4a3a-b8bf-0fcfe4643496 req-c7d402e6-d590-4345-a9b1-ff8a6e1032ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c3dd1ae-9314-4850-af07-71782c6efdee", "tag": "a73e9c7c-f36c-40c6-8442-ed9e97d2605a"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:57:51.866351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8e7a40fe-8173-4a3a-b8bf-0fcfe4643496 req-c7d402e6-d590-4345-a9b1-ff8a6e1032ec service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:51.866754 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8e7a40fe-8173-4a3a-b8bf-0fcfe4643496 req-c7d402e6-d590-4345-a9b1-ff8a6e1032ec service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:51.867294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8e7a40fe-8173-4a3a-b8bf-0fcfe4643496 req-c7d402e6-d590-4345-a9b1-ff8a6e1032ec service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:51.881466 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-8e7a40fe-8173-4a3a-b8bf-0fcfe4643496 req-c7d402e6-d590-4345-a9b1-ff8a6e1032ec service nova] Creating event network-changed:a73e9c7c-f36c-40c6-8442-ed9e97d2605a for instance 7c3dd1ae-9314-4850-af07-71782c6efdee on n-h2-862967-2 Oct 29 03:57:51.886649 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-8e7a40fe-8173-4a3a-b8bf-0fcfe4643496 req-c7d402e6-d590-4345-a9b1-ff8a6e1032ec service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039061 Oct 29 03:57:51.887284 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3698/7169] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:57:52.749316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7f876dba-2fd3-4a9f-8fc9-8fdc24e3f3cc tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:52.750146 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7f876dba-2fd3-4a9f-8fc9-8fdc24e3f3cc tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:52.752734 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:57:52.761575 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f876dba-2fd3-4a9f-8fc9-8fdc24e3f3cc tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:52.762256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f876dba-2fd3-4a9f-8fc9-8fdc24e3f3cc tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:52.762888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f876dba-2fd3-4a9f-8fc9-8fdc24e3f3cc tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:52.763869 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f876dba-2fd3-4a9f-8fc9-8fdc24e3f3cc tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:52.764693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f876dba-2fd3-4a9f-8fc9-8fdc24e3f3cc tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:52.765140 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f876dba-2fd3-4a9f-8fc9-8fdc24e3f3cc tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:52.906838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7f876dba-2fd3-4a9f-8fc9-8fdc24e3f3cc tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:52.914997 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7f876dba-2fd3-4a9f-8fc9-8fdc24e3f3cc tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1359 microversion: 2.1 time: 0.171218 Oct 29 03:57:52.915580 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3472/7170] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:52 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:53.938675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:57:53.939676 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:57:53.947215 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-de6a86b0-d721-4535-95a9-dd2ad981e6b1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:53.948189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-de6a86b0-d721-4535-95a9-dd2ad981e6b1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:53.958019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-de6a86b0-d721-4535-95a9-dd2ad981e6b1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:53.958692 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-de6a86b0-d721-4535-95a9-dd2ad981e6b1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:53.959340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-de6a86b0-d721-4535-95a9-dd2ad981e6b1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:53.960287 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-de6a86b0-d721-4535-95a9-dd2ad981e6b1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:53.960989 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-de6a86b0-d721-4535-95a9-dd2ad981e6b1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:53.961588 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-de6a86b0-d721-4535-95a9-dd2ad981e6b1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:54.102137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-de6a86b0-d721-4535-95a9-dd2ad981e6b1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:54.112517 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-de6a86b0-d721-4535-95a9-dd2ad981e6b1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1359 microversion: 2.1 time: 0.175639 Oct 29 03:57:54.113098 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3699/7171] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:53 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:55.140461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-09225db4-bd49-4328-a7a5-4de404b51948 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:55.141145 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-09225db4-bd49-4328-a7a5-4de404b51948 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:55.149649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09225db4-bd49-4328-a7a5-4de404b51948 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:55.150355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09225db4-bd49-4328-a7a5-4de404b51948 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:55.150973 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09225db4-bd49-4328-a7a5-4de404b51948 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:55.152019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09225db4-bd49-4328-a7a5-4de404b51948 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:55.152762 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09225db4-bd49-4328-a7a5-4de404b51948 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:55.153307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09225db4-bd49-4328-a7a5-4de404b51948 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:55.312992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-09225db4-bd49-4328-a7a5-4de404b51948 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:55.321237 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-09225db4-bd49-4328-a7a5-4de404b51948 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1359 microversion: 2.1 time: 0.187382 Oct 29 03:57:55.321910 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3473/7172] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:55 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:55.495209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-c39eaf6d-bd81-4dba-bb4c-057047e0d0f4 req-a5d5b516-8d38-471e-9f4e-8ff3985c9922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c3dd1ae-9314-4850-af07-71782c6efdee", "name": "network-vif-plugged", "status": "completed", "tag": "a73e9c7c-f36c-40c6-8442-ed9e97d2605a"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:57:55.505463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c39eaf6d-bd81-4dba-bb4c-057047e0d0f4 req-a5d5b516-8d38-471e-9f4e-8ff3985c9922 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:55.505936 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c39eaf6d-bd81-4dba-bb4c-057047e0d0f4 req-a5d5b516-8d38-471e-9f4e-8ff3985c9922 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:55.506365 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-c39eaf6d-bd81-4dba-bb4c-057047e0d0f4 req-a5d5b516-8d38-471e-9f4e-8ff3985c9922 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:55.518291 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-c39eaf6d-bd81-4dba-bb4c-057047e0d0f4 req-a5d5b516-8d38-471e-9f4e-8ff3985c9922 service nova] Creating event network-vif-plugged:a73e9c7c-f36c-40c6-8442-ed9e97d2605a for instance 7c3dd1ae-9314-4850-af07-71782c6efdee on n-h2-862967-2 Oct 29 03:57:55.523827 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-c39eaf6d-bd81-4dba-bb4c-057047e0d0f4 req-a5d5b516-8d38-471e-9f4e-8ff3985c9922 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124984 Oct 29 03:57:55.524446 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3700/7173] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:57:56.349146 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fe54715c-6756-43a6-b4b9-5a50bc819d2b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:56.349841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fe54715c-6756-43a6-b4b9-5a50bc819d2b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:56.359958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fe54715c-6756-43a6-b4b9-5a50bc819d2b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:56.360457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fe54715c-6756-43a6-b4b9-5a50bc819d2b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:56.360940 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fe54715c-6756-43a6-b4b9-5a50bc819d2b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:56.361653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fe54715c-6756-43a6-b4b9-5a50bc819d2b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:56.362115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fe54715c-6756-43a6-b4b9-5a50bc819d2b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:56.362550 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fe54715c-6756-43a6-b4b9-5a50bc819d2b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:56.499383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fe54715c-6756-43a6-b4b9-5a50bc819d2b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:56.511686 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fe54715c-6756-43a6-b4b9-5a50bc819d2b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1359 microversion: 2.1 time: 0.168907 Oct 29 03:57:56.512508 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3474/7174] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:56 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:57.539721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c850190b-7a9b-4761-bb72-471186c805c3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:57.540754 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c850190b-7a9b-4761-bb72-471186c805c3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:57.549999 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c850190b-7a9b-4761-bb72-471186c805c3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:57.550802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c850190b-7a9b-4761-bb72-471186c805c3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:57.551424 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c850190b-7a9b-4761-bb72-471186c805c3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:57.552413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c850190b-7a9b-4761-bb72-471186c805c3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:57.553100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c850190b-7a9b-4761-bb72-471186c805c3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:57.553711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c850190b-7a9b-4761-bb72-471186c805c3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:57.692488 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c850190b-7a9b-4761-bb72-471186c805c3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:57.701047 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c850190b-7a9b-4761-bb72-471186c805c3 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1549 microversion: 2.1 time: 0.168718 Oct 29 03:57:57.701641 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3701/7175] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:57 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1549 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:57.723461 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-82d4cf71-9f4d-4102-b0ef-8a8f708266c4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:57.724086 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-82d4cf71-9f4d-4102-b0ef-8a8f708266c4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:57.732705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-82d4cf71-9f4d-4102-b0ef-8a8f708266c4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:57.733553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-82d4cf71-9f4d-4102-b0ef-8a8f708266c4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:57.734003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-82d4cf71-9f4d-4102-b0ef-8a8f708266c4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:57.734717 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-82d4cf71-9f4d-4102-b0ef-8a8f708266c4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:57.735186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-82d4cf71-9f4d-4102-b0ef-8a8f708266c4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:57.735620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-82d4cf71-9f4d-4102-b0ef-8a8f708266c4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:57.872000 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-82d4cf71-9f4d-4102-b0ef-8a8f708266c4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:57.883707 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-82d4cf71-9f4d-4102-b0ef-8a8f708266c4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1549 microversion: 2.1 time: 0.164189 Oct 29 03:57:57.884294 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3475/7176] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:57 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:57.905934 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-84f156d4-1853-41cc-9183-8c8b5b09dd52 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:57.910733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-84f156d4-1853-41cc-9183-8c8b5b09dd52 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:57.911509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-84f156d4-1853-41cc-9183-8c8b5b09dd52 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Searching by: {'deleted': False, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f'} {{(pid=127124) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 29 03:57:57.917234 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-84f156d4-1853-41cc-9183-8c8b5b09dd52 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:57.917716 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-84f156d4-1853-41cc-9183-8c8b5b09dd52 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:57.918155 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-84f156d4-1853-41cc-9183-8c8b5b09dd52 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:57.918882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-84f156d4-1853-41cc-9183-8c8b5b09dd52 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:57.919334 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-84f156d4-1853-41cc-9183-8c8b5b09dd52 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:57.919768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-84f156d4-1853-41cc-9183-8c8b5b09dd52 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:57.953029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.multi_cell_list [None req-84f156d4-1853-41cc-9183-8c8b5b09dd52 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127124) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 29 03:57:57.979779 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-84f156d4-1853-41cc-9183-8c8b5b09dd52 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.077730 Oct 29 03:57:57.980365 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3702/7177] 10.222.0.46 () {58 vars in 1125 bytes} [Sat Oct 29 03:57:57 2022] GET /compute/v2.1/servers => generated 343 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:57:57.993966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8ca6631c-d0b5-4fef-935e-5027abda92f4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:57:57.994588 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8ca6631c-d0b5-4fef-935e-5027abda92f4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:58.000872 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ca6631c-d0b5-4fef-935e-5027abda92f4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:58.001386 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ca6631c-d0b5-4fef-935e-5027abda92f4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:58.001804 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ca6631c-d0b5-4fef-935e-5027abda92f4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:58.002499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ca6631c-d0b5-4fef-935e-5027abda92f4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:58.002967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ca6631c-d0b5-4fef-935e-5027abda92f4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:58.003408 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8ca6631c-d0b5-4fef-935e-5027abda92f4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:58.133352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8ca6631c-d0b5-4fef-935e-5027abda92f4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:57:58.141622 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8ca6631c-d0b5-4fef-935e-5027abda92f4 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1549 microversion: 2.1 time: 0.151944 Oct 29 03:57:58.142204 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3476/7178] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:57:57 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:57:59.719529 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-78633173-9e60-4c48-8efd-27c70658b421 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d23ae643-86eb-4767-9994-b6727d2301f9"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:57:59.721963 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-78633173-9e60-4c48-8efd-27c70658b421 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:57:59.729396 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78633173-9e60-4c48-8efd-27c70658b421 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:59.729886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78633173-9e60-4c48-8efd-27c70658b421 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:59.730326 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78633173-9e60-4c48-8efd-27c70658b421 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:59.731025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78633173-9e60-4c48-8efd-27c70658b421 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:57:59.731478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78633173-9e60-4c48-8efd-27c70658b421 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:57:59.731879 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78633173-9e60-4c48-8efd-27c70658b421 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:57:59.981474 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-78633173-9e60-4c48-8efd-27c70658b421 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "POST /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265743 Oct 29 03:57:59.987478 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3703/7179] 10.222.0.46 () {60 vars in 1323 bytes} [Sat Oct 29 03:57:59 2022] POST /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:58:10.848022 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-024c4a3a-d292-4464-8622-1644d73da41f tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:58:10.849107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-024c4a3a-d292-4464-8622-1644d73da41f tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:58:10.853679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=15 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:58:10.854451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=54 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:58:10.861373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-024c4a3a-d292-4464-8622-1644d73da41f tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:10.861968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-024c4a3a-d292-4464-8622-1644d73da41f tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:10.862410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-024c4a3a-d292-4464-8622-1644d73da41f tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:10.863150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-024c4a3a-d292-4464-8622-1644d73da41f tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:10.863619 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-024c4a3a-d292-4464-8622-1644d73da41f tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:10.864085 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-024c4a3a-d292-4464-8622-1644d73da41f tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:11.004755 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-024c4a3a-d292-4464-8622-1644d73da41f tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:58:11.013443 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-024c4a3a-d292-4464-8622-1644d73da41f tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1595 microversion: 2.1 time: 0.171712 Oct 29 03:58:11.014037 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3477/7180] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:58:10 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1595 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:58:12.961196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-4148bd40-3f15-4847-a37c-5f39e7b3e892 req-3dbfc1eb-0bf3-4107-8d7a-47e08cc89d0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c3dd1ae-9314-4850-af07-71782c6efdee", "tag": "a73e9c7c-f36c-40c6-8442-ed9e97d2605a"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:58:12.967691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:58:12.968510 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=15 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:58:12.969321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:58:12.975777 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4148bd40-3f15-4847-a37c-5f39e7b3e892 req-3dbfc1eb-0bf3-4107-8d7a-47e08cc89d0f service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:12.976405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4148bd40-3f15-4847-a37c-5f39e7b3e892 req-3dbfc1eb-0bf3-4107-8d7a-47e08cc89d0f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:12.976886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4148bd40-3f15-4847-a37c-5f39e7b3e892 req-3dbfc1eb-0bf3-4107-8d7a-47e08cc89d0f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:12.991343 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-4148bd40-3f15-4847-a37c-5f39e7b3e892 req-3dbfc1eb-0bf3-4107-8d7a-47e08cc89d0f service nova] Creating event network-changed:a73e9c7c-f36c-40c6-8442-ed9e97d2605a for instance 7c3dd1ae-9314-4850-af07-71782c6efdee on n-h2-862967-2 Oct 29 03:58:12.996835 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-4148bd40-3f15-4847-a37c-5f39e7b3e892 req-3dbfc1eb-0bf3-4107-8d7a-47e08cc89d0f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039855 Oct 29 03:58:12.997314 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3704/7181] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:58:13.967600 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c7fb0761-cddf-4c64-aba3-8a3d1e5e291e tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-952123391"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:58:13.968168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c7fb0761-cddf-4c64-aba3-8a3d1e5e291e tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:58:13.975410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7fb0761-cddf-4c64-aba3-8a3d1e5e291e tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:13.975921 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7fb0761-cddf-4c64-aba3-8a3d1e5e291e tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:13.976368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7fb0761-cddf-4c64-aba3-8a3d1e5e291e tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:13.977127 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7fb0761-cddf-4c64-aba3-8a3d1e5e291e tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:13.977594 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7fb0761-cddf-4c64-aba3-8a3d1e5e291e tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:13.978030 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c7fb0761-cddf-4c64-aba3-8a3d1e5e291e tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:14.115202 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.network.security_group_api [None req-c7fb0761-cddf-4c64-aba3-8a3d1e5e291e tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Adding security group ad41589a-642b-405f-bd50-fdb863a8fbef to port a73e9c7c-f36c-40c6-8442-ed9e97d2605a Oct 29 03:58:14.439259 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c7fb0761-cddf-4c64-aba3-8a3d1e5e291e tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "POST /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee/action" status: 202 len: 0 microversion: 2.1 time: 0.475529 Oct 29 03:58:14.440150 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3478/7182] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:58:13 2022] POST /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:58:14.455474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-11c4827e-091e-4e7d-86cd-4a5d5c6fb7f1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:58:14.456319 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-11c4827e-091e-4e7d-86cd-4a5d5c6fb7f1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:58:14.467340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11c4827e-091e-4e7d-86cd-4a5d5c6fb7f1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:14.468896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11c4827e-091e-4e7d-86cd-4a5d5c6fb7f1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:14.469534 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11c4827e-091e-4e7d-86cd-4a5d5c6fb7f1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:14.470435 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11c4827e-091e-4e7d-86cd-4a5d5c6fb7f1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:14.471765 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11c4827e-091e-4e7d-86cd-4a5d5c6fb7f1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:14.472558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11c4827e-091e-4e7d-86cd-4a5d5c6fb7f1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:14.526464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-54ba2678-0767-42b8-bc15-9da08722a49c req-c02cd866-4383-4f11-adfb-9c8076a1d163 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c3dd1ae-9314-4850-af07-71782c6efdee", "tag": "a73e9c7c-f36c-40c6-8442-ed9e97d2605a"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:58:14.536258 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-54ba2678-0767-42b8-bc15-9da08722a49c req-c02cd866-4383-4f11-adfb-9c8076a1d163 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:14.536774 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-54ba2678-0767-42b8-bc15-9da08722a49c req-c02cd866-4383-4f11-adfb-9c8076a1d163 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:14.537406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-54ba2678-0767-42b8-bc15-9da08722a49c req-c02cd866-4383-4f11-adfb-9c8076a1d163 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:14.552339 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-54ba2678-0767-42b8-bc15-9da08722a49c req-c02cd866-4383-4f11-adfb-9c8076a1d163 service nova] Creating event network-changed:a73e9c7c-f36c-40c6-8442-ed9e97d2605a for instance 7c3dd1ae-9314-4850-af07-71782c6efdee on n-h2-862967-2 Oct 29 03:58:14.557991 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-54ba2678-0767-42b8-bc15-9da08722a49c req-c02cd866-4383-4f11-adfb-9c8076a1d163 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108992 Oct 29 03:58:14.558991 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3479/7183] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:58:14.731426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-11c4827e-091e-4e7d-86cd-4a5d5c6fb7f1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:58:14.743028 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-11c4827e-091e-4e7d-86cd-4a5d5c6fb7f1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1760 microversion: 2.1 time: 0.298115 Oct 29 03:58:14.743814 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3705/7184] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:58:14 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1760 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:58:28.721944 n-d-862967-2 devstack@n-api.service[127125]: ERROR oslo.messaging._drivers.impl_rabbit [-] [db70aafa-b304-4ac0-be4f-1798e9789b82] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 03:58:28.722747 n-d-862967-2 devstack@n-api.service[127125]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7606be4b-8fa9-49e5-a603-02528cbf3013] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 03:58:28.728671 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-da5dab88-75cc-4221-a404-31d0251b30fb tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:58:28.731063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-da5dab88-75cc-4221-a404-31d0251b30fb tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:58:28.733188 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:58:28.733841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=12 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:58:28.740092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da5dab88-75cc-4221-a404-31d0251b30fb tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:28.740639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da5dab88-75cc-4221-a404-31d0251b30fb tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:28.741437 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da5dab88-75cc-4221-a404-31d0251b30fb tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:28.742155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da5dab88-75cc-4221-a404-31d0251b30fb tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:28.742620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da5dab88-75cc-4221-a404-31d0251b30fb tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:28.743058 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-da5dab88-75cc-4221-a404-31d0251b30fb tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:28.826430 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-da5dab88-75cc-4221-a404-31d0251b30fb tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "POST /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee/action" status: 202 len: 0 microversion: 2.1 time: 0.106721 Oct 29 03:58:28.827034 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3480/7185] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:58:28 2022] POST /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:58:28.835921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-085c8b4b-2bce-4577-b361-cc233e1f9fa8 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:58:28.838482 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-085c8b4b-2bce-4577-b361-cc233e1f9fa8 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:58:28.841159 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:58:28.841831 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=8 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:58:28.848669 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-085c8b4b-2bce-4577-b361-cc233e1f9fa8 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:28.849205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-085c8b4b-2bce-4577-b361-cc233e1f9fa8 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:28.849643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-085c8b4b-2bce-4577-b361-cc233e1f9fa8 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:28.851019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-085c8b4b-2bce-4577-b361-cc233e1f9fa8 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:28.851937 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-085c8b4b-2bce-4577-b361-cc233e1f9fa8 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:28.852386 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-085c8b4b-2bce-4577-b361-cc233e1f9fa8 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:29.095680 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-085c8b4b-2bce-4577-b361-cc233e1f9fa8 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:58:29.105075 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-085c8b4b-2bce-4577-b361-cc233e1f9fa8 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1752 microversion: 2.1 time: 0.273271 Oct 29 03:58:29.105618 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3706/7186] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:58:28 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1752 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:58:30.137180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-81fd4677-e762-4bf9-a821-7839f8989b14 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:58:30.137913 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-81fd4677-e762-4bf9-a821-7839f8989b14 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:58:30.146157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-81fd4677-e762-4bf9-a821-7839f8989b14 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:30.146673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-81fd4677-e762-4bf9-a821-7839f8989b14 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:30.147103 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-81fd4677-e762-4bf9-a821-7839f8989b14 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:30.147831 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-81fd4677-e762-4bf9-a821-7839f8989b14 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:30.148296 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-81fd4677-e762-4bf9-a821-7839f8989b14 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:30.148763 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-81fd4677-e762-4bf9-a821-7839f8989b14 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:30.156555 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] [7606be4b-8fa9-49e5-a603-02528cbf3013] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 39994. Oct 29 03:58:30.166992 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] [db70aafa-b304-4ac0-be4f-1798e9789b82] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 39992. Oct 29 03:58:30.295926 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-81fd4677-e762-4bf9-a821-7839f8989b14 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:58:30.304921 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-81fd4677-e762-4bf9-a821-7839f8989b14 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1757 microversion: 2.1 time: 0.176539 Oct 29 03:58:30.305521 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3481/7187] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:58:30 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:58:31.333443 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ddf888d5-d3f6-4398-a2a1-67f59bf1ddf7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:58:31.334383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ddf888d5-d3f6-4398-a2a1-67f59bf1ddf7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:58:31.344258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ddf888d5-d3f6-4398-a2a1-67f59bf1ddf7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:31.344785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ddf888d5-d3f6-4398-a2a1-67f59bf1ddf7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:31.345227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ddf888d5-d3f6-4398-a2a1-67f59bf1ddf7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:31.345940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ddf888d5-d3f6-4398-a2a1-67f59bf1ddf7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:31.346394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ddf888d5-d3f6-4398-a2a1-67f59bf1ddf7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:31.346825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ddf888d5-d3f6-4398-a2a1-67f59bf1ddf7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:31.504816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ddf888d5-d3f6-4398-a2a1-67f59bf1ddf7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:58:31.517602 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ddf888d5-d3f6-4398-a2a1-67f59bf1ddf7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1757 microversion: 2.1 time: 0.190721 Oct 29 03:58:31.518405 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3707/7188] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:58:31 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:58:32.545033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3c1bc5f2-4b26-406b-86e4-90a38a25c174 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:58:32.545659 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3c1bc5f2-4b26-406b-86e4-90a38a25c174 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:58:32.553236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3c1bc5f2-4b26-406b-86e4-90a38a25c174 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:32.553739 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3c1bc5f2-4b26-406b-86e4-90a38a25c174 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:32.554187 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3c1bc5f2-4b26-406b-86e4-90a38a25c174 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:32.554901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3c1bc5f2-4b26-406b-86e4-90a38a25c174 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:32.555367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3c1bc5f2-4b26-406b-86e4-90a38a25c174 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:32.555804 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3c1bc5f2-4b26-406b-86e4-90a38a25c174 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:32.713620 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3c1bc5f2-4b26-406b-86e4-90a38a25c174 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:58:32.723213 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3c1bc5f2-4b26-406b-86e4-90a38a25c174 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1757 microversion: 2.1 time: 0.184405 Oct 29 03:58:32.723760 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3482/7189] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:58:32 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:58:33.750128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2bde0c6f-1210-4ae1-aad1-54f14e643ae9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:58:33.750797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2bde0c6f-1210-4ae1-aad1-54f14e643ae9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:58:33.758528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2bde0c6f-1210-4ae1-aad1-54f14e643ae9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:33.759044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2bde0c6f-1210-4ae1-aad1-54f14e643ae9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:33.759506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2bde0c6f-1210-4ae1-aad1-54f14e643ae9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:33.760243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2bde0c6f-1210-4ae1-aad1-54f14e643ae9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:33.760768 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2bde0c6f-1210-4ae1-aad1-54f14e643ae9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:33.761217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2bde0c6f-1210-4ae1-aad1-54f14e643ae9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:33.910979 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2bde0c6f-1210-4ae1-aad1-54f14e643ae9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:58:33.922610 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2bde0c6f-1210-4ae1-aad1-54f14e643ae9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1757 microversion: 2.1 time: 0.177962 Oct 29 03:58:33.923196 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3708/7190] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:58:33 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:58:34.954766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-681a25f8-435f-4561-bef0-08620c8f551f tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:58:34.955385 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-681a25f8-435f-4561-bef0-08620c8f551f tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:58:34.963050 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-681a25f8-435f-4561-bef0-08620c8f551f tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:34.963544 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-681a25f8-435f-4561-bef0-08620c8f551f tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:34.963987 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-681a25f8-435f-4561-bef0-08620c8f551f tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:34.964733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-681a25f8-435f-4561-bef0-08620c8f551f tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:34.965192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-681a25f8-435f-4561-bef0-08620c8f551f tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:34.965628 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-681a25f8-435f-4561-bef0-08620c8f551f tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:35.127134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-681a25f8-435f-4561-bef0-08620c8f551f tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:58:35.135985 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-681a25f8-435f-4561-bef0-08620c8f551f tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1757 microversion: 2.1 time: 0.185208 Oct 29 03:58:35.136616 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3483/7191] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:58:34 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:58:36.163060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f729505f-7d84-4c4d-8df6-b3906ba221a9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:58:36.163948 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f729505f-7d84-4c4d-8df6-b3906ba221a9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:58:36.173512 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f729505f-7d84-4c4d-8df6-b3906ba221a9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:36.173999 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f729505f-7d84-4c4d-8df6-b3906ba221a9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:36.174439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f729505f-7d84-4c4d-8df6-b3906ba221a9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:36.175134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f729505f-7d84-4c4d-8df6-b3906ba221a9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:36.175587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f729505f-7d84-4c4d-8df6-b3906ba221a9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:36.176010 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f729505f-7d84-4c4d-8df6-b3906ba221a9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:36.324350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f729505f-7d84-4c4d-8df6-b3906ba221a9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:58:36.334490 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f729505f-7d84-4c4d-8df6-b3906ba221a9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1757 microversion: 2.1 time: 0.177194 Oct 29 03:58:36.335004 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3709/7192] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:58:36 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:58:37.362352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8d046bcd-067b-4392-9283-a6c09b6e909d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:58:37.363955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8d046bcd-067b-4392-9283-a6c09b6e909d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:58:37.375462 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d046bcd-067b-4392-9283-a6c09b6e909d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:37.375954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d046bcd-067b-4392-9283-a6c09b6e909d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:37.376675 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d046bcd-067b-4392-9283-a6c09b6e909d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:37.377120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d046bcd-067b-4392-9283-a6c09b6e909d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:37.377589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d046bcd-067b-4392-9283-a6c09b6e909d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:37.378017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8d046bcd-067b-4392-9283-a6c09b6e909d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:37.542140 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8d046bcd-067b-4392-9283-a6c09b6e909d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:58:37.550826 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8d046bcd-067b-4392-9283-a6c09b6e909d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1757 microversion: 2.1 time: 0.195195 Oct 29 03:58:37.551411 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3484/7193] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:58:37 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1757 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:58:38.633211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-03f8c2da-1977-4975-ae9c-5c5a8907c9d6 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:58:38.633839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-03f8c2da-1977-4975-ae9c-5c5a8907c9d6 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:58:38.640902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03f8c2da-1977-4975-ae9c-5c5a8907c9d6 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:38.641388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03f8c2da-1977-4975-ae9c-5c5a8907c9d6 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:38.641824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03f8c2da-1977-4975-ae9c-5c5a8907c9d6 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:38.642524 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03f8c2da-1977-4975-ae9c-5c5a8907c9d6 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:38.643357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03f8c2da-1977-4975-ae9c-5c5a8907c9d6 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:38.643516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-03f8c2da-1977-4975-ae9c-5c5a8907c9d6 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:38.804424 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-03f8c2da-1977-4975-ae9c-5c5a8907c9d6 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:58:38.813582 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-03f8c2da-1977-4975-ae9c-5c5a8907c9d6 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1757 microversion: 2.1 time: 0.241208 Oct 29 03:58:38.814168 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3710/7194] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:58:38 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1757 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:58:39.842959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5e44e742-14e9-44d5-8820-696ddde2d4b7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:58:39.844026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5e44e742-14e9-44d5-8820-696ddde2d4b7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:58:39.857298 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e44e742-14e9-44d5-8820-696ddde2d4b7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:39.858128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e44e742-14e9-44d5-8820-696ddde2d4b7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:39.858864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e44e742-14e9-44d5-8820-696ddde2d4b7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:39.859855 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e44e742-14e9-44d5-8820-696ddde2d4b7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:39.860315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e44e742-14e9-44d5-8820-696ddde2d4b7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:39.860776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5e44e742-14e9-44d5-8820-696ddde2d4b7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:40.014548 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5e44e742-14e9-44d5-8820-696ddde2d4b7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:58:40.023458 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5e44e742-14e9-44d5-8820-696ddde2d4b7 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1757 microversion: 2.1 time: 0.187591 Oct 29 03:58:40.024013 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3485/7195] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:58:39 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:58:41.051905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6b5ad127-bd11-40b3-8cce-eebc569b57d1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:58:41.053006 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6b5ad127-bd11-40b3-8cce-eebc569b57d1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:58:41.064138 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b5ad127-bd11-40b3-8cce-eebc569b57d1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:41.064642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b5ad127-bd11-40b3-8cce-eebc569b57d1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:41.065111 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b5ad127-bd11-40b3-8cce-eebc569b57d1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:41.065826 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b5ad127-bd11-40b3-8cce-eebc569b57d1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:58:41.066286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b5ad127-bd11-40b3-8cce-eebc569b57d1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:58:41.066725 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6b5ad127-bd11-40b3-8cce-eebc569b57d1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:58:41.214697 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6b5ad127-bd11-40b3-8cce-eebc569b57d1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:58:41.223231 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6b5ad127-bd11-40b3-8cce-eebc569b57d1 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1760 microversion: 2.1 time: 0.178161 Oct 29 03:58:41.223782 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3711/7196] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:58:41 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1760 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:59:13.395092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b1219396-3caa-4f59-8ad9-eb3d8dcf51e9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-952123391"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:59:13.396180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b1219396-3caa-4f59-8ad9-eb3d8dcf51e9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:59:13.399089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=12 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:59:13.400423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:59:13.407320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1219396-3caa-4f59-8ad9-eb3d8dcf51e9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:13.407815 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1219396-3caa-4f59-8ad9-eb3d8dcf51e9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:13.408257 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1219396-3caa-4f59-8ad9-eb3d8dcf51e9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:13.408999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1219396-3caa-4f59-8ad9-eb3d8dcf51e9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:13.409459 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1219396-3caa-4f59-8ad9-eb3d8dcf51e9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:13.409887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1219396-3caa-4f59-8ad9-eb3d8dcf51e9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:13.601136 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.network.security_group_api [None req-b1219396-3caa-4f59-8ad9-eb3d8dcf51e9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Removing security group ad41589a-642b-405f-bd50-fdb863a8fbef from port a73e9c7c-f36c-40c6-8442-ed9e97d2605a Oct 29 03:59:13.924823 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b1219396-3caa-4f59-8ad9-eb3d8dcf51e9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "POST /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee/action" status: 202 len: 0 microversion: 2.1 time: 0.537029 Oct 29 03:59:13.928708 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3486/7197] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 03:59:13 2022] POST /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee/action => generated 0 bytes in 539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:59:13.933689 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-d5722d49-8148-4dc0-bd59-ca379c1786e1 req-0150052b-5e15-4d84-8ffe-cb0b66061456 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c3dd1ae-9314-4850-af07-71782c6efdee", "tag": "a73e9c7c-f36c-40c6-8442-ed9e97d2605a"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:59:13.943377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=12 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:59:13.944025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=36 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:59:13.946134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d5722d49-8148-4dc0-bd59-ca379c1786e1 req-0150052b-5e15-4d84-8ffe-cb0b66061456 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:13.946622 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d5722d49-8148-4dc0-bd59-ca379c1786e1 req-0150052b-5e15-4d84-8ffe-cb0b66061456 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:13.947054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d5722d49-8148-4dc0-bd59-ca379c1786e1 req-0150052b-5e15-4d84-8ffe-cb0b66061456 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:13.963578 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-d5722d49-8148-4dc0-bd59-ca379c1786e1 req-0150052b-5e15-4d84-8ffe-cb0b66061456 service nova] Creating event network-changed:a73e9c7c-f36c-40c6-8442-ed9e97d2605a for instance 7c3dd1ae-9314-4850-af07-71782c6efdee on n-h2-862967-2 Oct 29 03:59:13.970012 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-d5722d49-8148-4dc0-bd59-ca379c1786e1 req-0150052b-5e15-4d84-8ffe-cb0b66061456 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040426 Oct 29 03:59:13.970989 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3712/7198] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:59:15.412130 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9b7d701a-65bf-4e16-9cb2-8d4d7f4a85bd tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:59:15.412880 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9b7d701a-65bf-4e16-9cb2-8d4d7f4a85bd tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:59:15.420036 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b7d701a-65bf-4e16-9cb2-8d4d7f4a85bd tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:15.420652 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b7d701a-65bf-4e16-9cb2-8d4d7f4a85bd tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:15.421151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b7d701a-65bf-4e16-9cb2-8d4d7f4a85bd tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:15.421938 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b7d701a-65bf-4e16-9cb2-8d4d7f4a85bd tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:15.422466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b7d701a-65bf-4e16-9cb2-8d4d7f4a85bd tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:15.422969 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9b7d701a-65bf-4e16-9cb2-8d4d7f4a85bd tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:15.507485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-9b7d701a-65bf-4e16-9cb2-8d4d7f4a85bd tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lazy-loading 'services' on Instance uuid 7c3dd1ae-9314-4850-af07-71782c6efdee {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:59:15.583253 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9b7d701a-65bf-4e16-9cb2-8d4d7f4a85bd tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee/os-volume_attachments/d23ae643-86eb-4767-9994-b6727d2301f9" status: 202 len: 0 microversion: 2.1 time: 0.175860 Oct 29 03:59:15.583900 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3487/7199] 10.222.0.46 () {58 vars in 1416 bytes} [Sat Oct 29 03:59:15 2022] DELETE /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee/os-volume_attachments/d23ae643-86eb-4767-9994-b6727d2301f9 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:59:15.601675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-79551f4f-f0d9-4b47-b3a6-b540e8e25439 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:59:15.604953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-79551f4f-f0d9-4b47-b3a6-b540e8e25439 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:59:15.613142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79551f4f-f0d9-4b47-b3a6-b540e8e25439 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:15.620330 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79551f4f-f0d9-4b47-b3a6-b540e8e25439 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:15.620858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79551f4f-f0d9-4b47-b3a6-b540e8e25439 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:15.621688 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79551f4f-f0d9-4b47-b3a6-b540e8e25439 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:15.622200 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79551f4f-f0d9-4b47-b3a6-b540e8e25439 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:15.622639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-79551f4f-f0d9-4b47-b3a6-b540e8e25439 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:15.656704 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-79551f4f-f0d9-4b47-b3a6-b540e8e25439 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066078 Oct 29 03:59:15.657522 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3713/7200] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:59:15 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 03:59:15.989370 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-f97061c5-6de4-466a-9682-239b1f10462e req-6e047ce7-d748-4445-bc3c-5da5f2276189 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c3dd1ae-9314-4850-af07-71782c6efdee", "tag": "a73e9c7c-f36c-40c6-8442-ed9e97d2605a"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:59:15.999989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f97061c5-6de4-466a-9682-239b1f10462e req-6e047ce7-d748-4445-bc3c-5da5f2276189 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:16.000476 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f97061c5-6de4-466a-9682-239b1f10462e req-6e047ce7-d748-4445-bc3c-5da5f2276189 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:16.000950 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-f97061c5-6de4-466a-9682-239b1f10462e req-6e047ce7-d748-4445-bc3c-5da5f2276189 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:16.012240 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-f97061c5-6de4-466a-9682-239b1f10462e req-6e047ce7-d748-4445-bc3c-5da5f2276189 service nova] Creating event network-changed:a73e9c7c-f36c-40c6-8442-ed9e97d2605a for instance 7c3dd1ae-9314-4850-af07-71782c6efdee on n-h2-862967-2 Oct 29 03:59:16.017570 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-f97061c5-6de4-466a-9682-239b1f10462e req-6e047ce7-d748-4445-bc3c-5da5f2276189 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032073 Oct 29 03:59:16.017999 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3488/7201] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:59:16.670117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d7013d3a-a875-4f31-9982-ed3dcacb4fb8 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:59:16.673132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d7013d3a-a875-4f31-9982-ed3dcacb4fb8 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:59:16.682087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7013d3a-a875-4f31-9982-ed3dcacb4fb8 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:16.682605 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7013d3a-a875-4f31-9982-ed3dcacb4fb8 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:16.683049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7013d3a-a875-4f31-9982-ed3dcacb4fb8 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:16.683816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7013d3a-a875-4f31-9982-ed3dcacb4fb8 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:16.684275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7013d3a-a875-4f31-9982-ed3dcacb4fb8 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:16.684727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d7013d3a-a875-4f31-9982-ed3dcacb4fb8 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:16.720713 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d7013d3a-a875-4f31-9982-ed3dcacb4fb8 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054814 Oct 29 03:59:16.721582 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3714/7202] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:59:16 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:59:17.738100 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ce599f35-c636-440b-a285-bf9b79f7737a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:59:17.741904 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ce599f35-c636-440b-a285-bf9b79f7737a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:59:17.749775 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce599f35-c636-440b-a285-bf9b79f7737a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:17.750280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce599f35-c636-440b-a285-bf9b79f7737a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:17.750731 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce599f35-c636-440b-a285-bf9b79f7737a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:17.751450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce599f35-c636-440b-a285-bf9b79f7737a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:17.751918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce599f35-c636-440b-a285-bf9b79f7737a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:17.752355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ce599f35-c636-440b-a285-bf9b79f7737a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:17.783411 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ce599f35-c636-440b-a285-bf9b79f7737a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053272 Oct 29 03:59:17.784249 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3489/7203] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:59:17 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:59:18.796401 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9fafb86a-79ba-44f9-a4d0-69e3550533ac tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:59:18.798642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9fafb86a-79ba-44f9-a4d0-69e3550533ac tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:59:18.805693 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fafb86a-79ba-44f9-a4d0-69e3550533ac tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:18.806178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fafb86a-79ba-44f9-a4d0-69e3550533ac tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:18.806609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fafb86a-79ba-44f9-a4d0-69e3550533ac tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:18.807305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fafb86a-79ba-44f9-a4d0-69e3550533ac tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:18.807781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fafb86a-79ba-44f9-a4d0-69e3550533ac tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:18.808186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fafb86a-79ba-44f9-a4d0-69e3550533ac tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:18.838764 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9fafb86a-79ba-44f9-a4d0-69e3550533ac tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046429 Oct 29 03:59:18.839342 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3715/7204] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:59:18 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:59:19.852563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9cecc613-8069-49a1-943d-e47f94a4fc52 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:59:19.854823 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9cecc613-8069-49a1-943d-e47f94a4fc52 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:59:19.862877 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cecc613-8069-49a1-943d-e47f94a4fc52 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:19.863392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cecc613-8069-49a1-943d-e47f94a4fc52 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:19.863842 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cecc613-8069-49a1-943d-e47f94a4fc52 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:19.864560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cecc613-8069-49a1-943d-e47f94a4fc52 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:19.865089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cecc613-8069-49a1-943d-e47f94a4fc52 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:19.865523 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9cecc613-8069-49a1-943d-e47f94a4fc52 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:19.897337 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9cecc613-8069-49a1-943d-e47f94a4fc52 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049005 Oct 29 03:59:19.897930 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3490/7205] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:59:19 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:59:20.916126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-89e00c06-bcd7-4129-8ab6-152c60feed2b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:59:20.919702 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-89e00c06-bcd7-4129-8ab6-152c60feed2b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:59:20.930962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89e00c06-bcd7-4129-8ab6-152c60feed2b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:20.931770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89e00c06-bcd7-4129-8ab6-152c60feed2b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:20.932497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89e00c06-bcd7-4129-8ab6-152c60feed2b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:20.933736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89e00c06-bcd7-4129-8ab6-152c60feed2b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:20.934497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89e00c06-bcd7-4129-8ab6-152c60feed2b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:20.935182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89e00c06-bcd7-4129-8ab6-152c60feed2b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:20.965342 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-89e00c06-bcd7-4129-8ab6-152c60feed2b tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057425 Oct 29 03:59:20.965919 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3716/7206] 10.222.0.46 () {58 vars in 1302 bytes} [Sat Oct 29 03:59:20 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 03:59:20.977240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6f5d3343-8a91-4d5d-a6bf-fb151c7176cf tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:59:20.977834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6f5d3343-8a91-4d5d-a6bf-fb151c7176cf tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:59:20.984949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f5d3343-8a91-4d5d-a6bf-fb151c7176cf tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:20.985457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f5d3343-8a91-4d5d-a6bf-fb151c7176cf tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:20.985919 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f5d3343-8a91-4d5d-a6bf-fb151c7176cf tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:20.986604 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f5d3343-8a91-4d5d-a6bf-fb151c7176cf tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:20.987089 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f5d3343-8a91-4d5d-a6bf-fb151c7176cf tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:20.987521 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6f5d3343-8a91-4d5d-a6bf-fb151c7176cf tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:21.069966 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-6f5d3343-8a91-4d5d-a6bf-fb151c7176cf tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] HTTP exception thrown: Instance 7c3dd1ae-9314-4850-af07-71782c6efdee is not attached to volume d23ae643-86eb-4767-9994-b6727d2301f9 Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6f5d3343-8a91-4d5d-a6bf-fb151c7176cf tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Request method failure captured: Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: request: DELETE /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee/os-volume_attachments/d23ae643-86eb-4767-9994-b6727d2301f9 HTTP/1.1 Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKO8VyBEm616rDxZZ2HhsdSaiwOLbniQZiu9YFajJDuQ-ReBuYHfCBZLbm2Cr42exVh-abUfter3x_eUZ61FrQMUlR0B7fsP_gWClDmEO6eBBgyO-yLq0_TRBqjSA4xbtaMCj1Bxw7NRJzplORDK6VtaxRXLQEU0Qt0W-P6WQ5oq4-o Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 4b9d21bdd55942b9b4df5eb5cb6b7b1f Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestMinimumBasicScenario-378113244 Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4b9d21bdd55942b9b4df5eb5cb6b7b1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4b9d21bdd55942b9b4df5eb5cb6b7b1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4b9d21bdd55942b9b4df5eb5cb6b7b1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4b9d21bdd55942b9b4df5eb5cb6b7b1f"}]}] Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestMinimumBasicScenario-378113244 Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 4b9d21bdd55942b9b4df5eb5cb6b7b1f Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestMinimumBasicScenario-378113244 Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestMinimumBasicScenario-378113244-project Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 3cd4d68a896348d1966819f53bc97717 Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestMinimumBasicScenario-378113244-project Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 7c3dd1ae-9314-4850-af07-71782c6efdee is not attached to volume d23ae643-86eb-4767-9994-b6727d2301f9 Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'server_id': '7c3dd1ae-9314-4850-af07-71782c6efdee', 'id': 'd23ae643-86eb-4767-9994-b6727d2301f9'} Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d23ae643-86eb-4767-9994-b6727d2301f9. Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c3dd1ae-9314-4850-af07-71782c6efdee is not attached to volume d23ae643-86eb-4767-9994-b6727d2301f9 Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:59:21.070676 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:59:21.075948 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:59:21.075948 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:59:21.075948 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c3dd1ae-9314-4850-af07-71782c6efdee is not attached to volume d23ae643-86eb-4767-9994-b6727d2301f9 Oct 29 03:59:21.075948 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:59:21.075948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6f5d3343-8a91-4d5d-a6bf-fb151c7176cf tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Returning 404 to user: Instance 7c3dd1ae-9314-4850-af07-71782c6efdee is not attached to volume d23ae643-86eb-4767-9994-b6727d2301f9 {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:59:21.075948 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6f5d3343-8a91-4d5d-a6bf-fb151c7176cf tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee/os-volume_attachments/d23ae643-86eb-4767-9994-b6727d2301f9" status: 404 len: 154 microversion: 2.1 time: 0.098641 Oct 29 03:59:21.075948 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3491/7207] 10.222.0.46 () {58 vars in 1416 bytes} [Sat Oct 29 03:59:20 2022] DELETE /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee/os-volume_attachments/d23ae643-86eb-4767-9994-b6727d2301f9 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:59:24.335566 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-788a6954-0517-4c2a-9d69-15f27cede82e tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:59:24.336153 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-788a6954-0517-4c2a-9d69-15f27cede82e tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:59:24.344881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-788a6954-0517-4c2a-9d69-15f27cede82e tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:24.345652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-788a6954-0517-4c2a-9d69-15f27cede82e tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:24.346300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-788a6954-0517-4c2a-9d69-15f27cede82e tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:24.347235 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-788a6954-0517-4c2a-9d69-15f27cede82e tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:24.347890 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-788a6954-0517-4c2a-9d69-15f27cede82e tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:24.348513 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-788a6954-0517-4c2a-9d69-15f27cede82e tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:24.375352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-788a6954-0517-4c2a-9d69-15f27cede82e tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 03:59:24.458757 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-788a6954-0517-4c2a-9d69-15f27cede82e tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 204 len: 0 microversion: 2.1 time: 0.126660 Oct 29 03:59:24.463148 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3717/7208] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 03:59:24 2022] DELETE /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 03:59:24.469924 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-97798cac-394a-4285-a7ef-a29d5e4ad529 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:59:24.470788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-97798cac-394a-4285-a7ef-a29d5e4ad529 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:59:24.474507 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 03:59:24.474675 n-d-862967-2 devstack@n-api.service[127125]: Sat Oct 29 03:59:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee (ip 10.222.0.46) !!! Oct 29 03:59:24.482375 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-97798cac-394a-4285-a7ef-a29d5e4ad529 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:24.482870 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-97798cac-394a-4285-a7ef-a29d5e4ad529 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:24.483314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-97798cac-394a-4285-a7ef-a29d5e4ad529 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:24.484049 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-97798cac-394a-4285-a7ef-a29d5e4ad529 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:24.484508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-97798cac-394a-4285-a7ef-a29d5e4ad529 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:24.484966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-97798cac-394a-4285-a7ef-a29d5e4ad529 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:24.625584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-97798cac-394a-4285-a7ef-a29d5e4ad529 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:59:24.636224 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-97798cac-394a-4285-a7ef-a29d5e4ad529 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1555 microversion: 2.1 time: 0.171284 Oct 29 03:59:24.636874 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3492/7209] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:59:24 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 03:59:25.662398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0526c9ac-b997-49a7-88c8-8243f85091fc tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:59:25.663032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0526c9ac-b997-49a7-88c8-8243f85091fc tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:59:25.670732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0526c9ac-b997-49a7-88c8-8243f85091fc tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:25.671215 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0526c9ac-b997-49a7-88c8-8243f85091fc tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:25.671643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0526c9ac-b997-49a7-88c8-8243f85091fc tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:25.672357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0526c9ac-b997-49a7-88c8-8243f85091fc tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:25.672836 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0526c9ac-b997-49a7-88c8-8243f85091fc tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:25.673261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0526c9ac-b997-49a7-88c8-8243f85091fc tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:25.862146 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0526c9ac-b997-49a7-88c8-8243f85091fc tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:59:25.870699 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0526c9ac-b997-49a7-88c8-8243f85091fc tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1555 microversion: 2.1 time: 0.213645 Oct 29 03:59:25.871269 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3718/7210] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:59:25 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1555 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:59:26.724966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-7304c2ce-75d1-4847-a8ac-de8cb876fb26 req-20b4ea22-5db1-4f3d-9507-2d3e17bb0244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c3dd1ae-9314-4850-af07-71782c6efdee", "name": "network-vif-deleted", "tag": "a73e9c7c-f36c-40c6-8442-ed9e97d2605a"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:59:26.738378 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7304c2ce-75d1-4847-a8ac-de8cb876fb26 req-20b4ea22-5db1-4f3d-9507-2d3e17bb0244 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:26.738875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7304c2ce-75d1-4847-a8ac-de8cb876fb26 req-20b4ea22-5db1-4f3d-9507-2d3e17bb0244 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:26.739320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-7304c2ce-75d1-4847-a8ac-de8cb876fb26 req-20b4ea22-5db1-4f3d-9507-2d3e17bb0244 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:26.752881 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-7304c2ce-75d1-4847-a8ac-de8cb876fb26 req-20b4ea22-5db1-4f3d-9507-2d3e17bb0244 service nova] Creating event network-vif-deleted:a73e9c7c-f36c-40c6-8442-ed9e97d2605a for instance 7c3dd1ae-9314-4850-af07-71782c6efdee on n-h2-862967-2 Oct 29 03:59:26.758500 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-7304c2ce-75d1-4847-a8ac-de8cb876fb26 req-20b4ea22-5db1-4f3d-9507-2d3e17bb0244 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037228 Oct 29 03:59:26.759469 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3493/7211] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:59:26.897921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4736e09a-ac43-4015-8a4c-2961ab18df9d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:59:26.899022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4736e09a-ac43-4015-8a4c-2961ab18df9d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:59:26.907540 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4736e09a-ac43-4015-8a4c-2961ab18df9d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:26.908157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4736e09a-ac43-4015-8a4c-2961ab18df9d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:26.908753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4736e09a-ac43-4015-8a4c-2961ab18df9d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:26.909652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4736e09a-ac43-4015-8a4c-2961ab18df9d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:26.910219 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4736e09a-ac43-4015-8a4c-2961ab18df9d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:26.910756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4736e09a-ac43-4015-8a4c-2961ab18df9d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:26.949050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4736e09a-ac43-4015-8a4c-2961ab18df9d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:26.949441 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4736e09a-ac43-4015-8a4c-2961ab18df9d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:26.949882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4736e09a-ac43-4015-8a4c-2961ab18df9d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:26.950334 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-4736e09a-ac43-4015-8a4c-2961ab18df9d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lazy-loading 'fault' on Instance uuid 7c3dd1ae-9314-4850-af07-71782c6efdee {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 03:59:26.998371 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4736e09a-ac43-4015-8a4c-2961ab18df9d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd4d68a896348d1966819f53bc97717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9d21bdd55942b9b4df5eb5cb6b7b1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:59:27.007150 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4736e09a-ac43-4015-8a4c-2961ab18df9d tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 200 len: 1349 microversion: 2.1 time: 0.115993 Oct 29 03:59:27.007761 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3719/7212] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:59:26 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 1349 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:59:28.037367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-41bd1fce-22ee-4a58-9284-67ae25d8379a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:59:28.037367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-41bd1fce-22ee-4a58-9284-67ae25d8379a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] [instance: 7c3dd1ae-9314-4850-af07-71782c6efdee] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:59:28.046640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41bd1fce-22ee-4a58-9284-67ae25d8379a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:28.047140 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41bd1fce-22ee-4a58-9284-67ae25d8379a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:28.047594 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41bd1fce-22ee-4a58-9284-67ae25d8379a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:28.048304 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41bd1fce-22ee-4a58-9284-67ae25d8379a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:28.048798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41bd1fce-22ee-4a58-9284-67ae25d8379a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:28.049233 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-41bd1fce-22ee-4a58-9284-67ae25d8379a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:28.064057 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-41bd1fce-22ee-4a58-9284-67ae25d8379a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] HTTP exception thrown: Instance 7c3dd1ae-9314-4850-af07-71782c6efdee could not be found. Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-41bd1fce-22ee-4a58-9284-67ae25d8379a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Request method failure captured: Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee HTTP/1.1 Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKO8VyBEm616rDxZZ2HhsdSaiwOLbniQZiu9YFajJDuQ-ReBuYHfCBZLbm2Cr42exVh-abUfter3x_eUZ61FrQMUlR0B7fsP_gWClDmEO6eBBgyO-yLq0_TRBqjSA4xbtaMCj1Bxw7NRJzplORDK6VtaxRXLQEU0Qt0W-P6WQ5oq4-o Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 4b9d21bdd55942b9b4df5eb5cb6b7b1f Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestMinimumBasicScenario-378113244 Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4b9d21bdd55942b9b4df5eb5cb6b7b1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4b9d21bdd55942b9b4df5eb5cb6b7b1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4b9d21bdd55942b9b4df5eb5cb6b7b1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4b9d21bdd55942b9b4df5eb5cb6b7b1f"}]}] Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestMinimumBasicScenario-378113244 Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 4b9d21bdd55942b9b4df5eb5cb6b7b1f Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestMinimumBasicScenario-378113244 Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestMinimumBasicScenario-378113244-project Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 3cd4d68a896348d1966819f53bc97717 Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestMinimumBasicScenario-378113244-project Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 7c3dd1ae-9314-4850-af07-71782c6efdee could not be found. Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '7c3dd1ae-9314-4850-af07-71782c6efdee'} Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c3dd1ae-9314-4850-af07-71782c6efdee could not be found. Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c3dd1ae-9314-4850-af07-71782c6efdee could not be found. Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 03:59:28.065815 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:59:28.070529 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 03:59:28.070529 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 03:59:28.070529 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 03:59:28.070529 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 03:59:28.070529 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 03:59:28.070529 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c3dd1ae-9314-4850-af07-71782c6efdee could not be found. Oct 29 03:59:28.070529 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 03:59:28.070529 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-41bd1fce-22ee-4a58-9284-67ae25d8379a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Returning 404 to user: Instance 7c3dd1ae-9314-4850-af07-71782c6efdee could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 03:59:28.070529 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-41bd1fce-22ee-4a58-9284-67ae25d8379a tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee" status: 404 len: 111 microversion: 2.1 time: 0.039083 Oct 29 03:59:28.070529 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3494/7213] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:59:28 2022] GET /compute/v2.1/servers/7c3dd1ae-9314-4850-af07-71782c6efdee => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 03:59:28.076960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fd28dba0-81e2-4241-8a19-a24189b032d9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] Calling method '.version_select at 0x7ff0534079d0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:59:28.100058 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fd28dba0-81e2-4241-8a19-a24189b032d9 tempest-TestMinimumBasicScenario-378113244 tempest-TestMinimumBasicScenario-378113244-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1555389727" status: 202 len: 0 microversion: 2.1 time: 0.027284 Oct 29 03:59:28.100700 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3720/7214] 10.222.0.46 () {58 vars in 1272 bytes} [Sat Oct 29 03:59:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1555389727 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 03:59:37.545761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8971b831-2853-4406-9882-015d7a2e1d6e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'create', calling method: .version_select at 0x7ff05388bc10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2045529691", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpQBqthCQVNt5nqiq86eiYR1gTX3ITi3B95x6lfJ3ImnpjLCVFjIv6BQw8dcu7dtuQuFbhvl6tmlo7D0eM52nMZp4B3MNVZWInCrH50KnNrwFNWSZZDEp2s5L4JMlOQNA=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:59:37.562229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-8971b831-2853-4406-9882-015d7a2e1d6e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Getting quotas for project 6db83678d78d49ff9768ba55d1a7d70d. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:59:37.567702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-8971b831-2853-4406-9882-015d7a2e1d6e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Getting quotas for user f75948d4d49e47f69900a9b8ece27999 and project 6db83678d78d49ff9768ba55d1a7d70d. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:59:37.595706 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8971b831-2853-4406-9882-015d7a2e1d6e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.236834 Oct 29 03:59:37.596333 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3495/7215] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 03:59:37 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:59:43.589110 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:59:43.589934 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:59:43.594951 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fa6b4d2f-6146-42cc-abe2-e9f227267ba6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1195656319", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "32934829-a4b1-4fdc-becd-0c3d27b86e00"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2045529691", "security_groups": [{"name": "tempest-secgroup-smoke-1527845070"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:59:43.721416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-fa6b4d2f-6146-42cc-abe2-e9f227267ba6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] validate_networks() for [('32934829-a4b1-4fdc-becd-0c3d27b86e00', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 03:59:44.111220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-fa6b4d2f-6146-42cc-abe2-e9f227267ba6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 03:59:44.111648 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-fa6b4d2f-6146-42cc-abe2-e9f227267ba6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 03:59:44.112125 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-fa6b4d2f-6146-42cc-abe2-e9f227267ba6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 03:59:44.112546 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-fa6b4d2f-6146-42cc-abe2-e9f227267ba6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 03:59:44.112988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-fa6b4d2f-6146-42cc-abe2-e9f227267ba6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 03:59:44.122807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fa6b4d2f-6146-42cc-abe2-e9f227267ba6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:44.123303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fa6b4d2f-6146-42cc-abe2-e9f227267ba6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:44.123742 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fa6b4d2f-6146-42cc-abe2-e9f227267ba6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:44.124734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fa6b4d2f-6146-42cc-abe2-e9f227267ba6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:44.125198 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fa6b4d2f-6146-42cc-abe2-e9f227267ba6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:44.125888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fa6b4d2f-6146-42cc-abe2-e9f227267ba6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:44.144963 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-fa6b4d2f-6146-42cc-abe2-e9f227267ba6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Getting quotas for project 6db83678d78d49ff9768ba55d1a7d70d. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 03:59:44.150307 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-fa6b4d2f-6146-42cc-abe2-e9f227267ba6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Getting quotas for user f75948d4d49e47f69900a9b8ece27999 and project 6db83678d78d49ff9768ba55d1a7d70d. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 03:59:44.164472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fa6b4d2f-6146-42cc-abe2-e9f227267ba6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 03:59:44.167089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fa6b4d2f-6146-42cc-abe2-e9f227267ba6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 03:59:44.217493 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fa6b4d2f-6146-42cc-abe2-e9f227267ba6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.630525 Oct 29 03:59:44.224966 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3721/7216] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 03:59:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 03:59:44.227190 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:59:44.233669 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e65cb408-ec03-467b-816c-8e019af3fbec tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:59:44.233960 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e65cb408-ec03-467b-816c-8e019af3fbec tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:59:44.237084 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:59:44.297842 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e65cb408-ec03-467b-816c-8e019af3fbec tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:59:44.305252 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e65cb408-ec03-467b-816c-8e019af3fbec tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8" status: 200 len: 1267 microversion: 2.1 time: 0.078970 Oct 29 03:59:44.320913 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3496/7217] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:59:44 2022] GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 => generated 1267 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:59:45.329897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-93224e99-f78f-4ec6-bb88-cc9dafc484df tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:59:45.331182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-93224e99-f78f-4ec6-bb88-cc9dafc484df tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:59:45.341994 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93224e99-f78f-4ec6-bb88-cc9dafc484df tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:45.342466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93224e99-f78f-4ec6-bb88-cc9dafc484df tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:45.342902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93224e99-f78f-4ec6-bb88-cc9dafc484df tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:45.343850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93224e99-f78f-4ec6-bb88-cc9dafc484df tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:45.344566 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93224e99-f78f-4ec6-bb88-cc9dafc484df tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:45.345020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-93224e99-f78f-4ec6-bb88-cc9dafc484df tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:45.466863 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-93224e99-f78f-4ec6-bb88-cc9dafc484df tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:59:45.477481 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-93224e99-f78f-4ec6-bb88-cc9dafc484df tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8" status: 200 len: 1319 microversion: 2.1 time: 0.153674 Oct 29 03:59:45.488028 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3722/7218] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:59:45 2022] GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:59:46.501937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b1270039-65df-4358-af09-a9335b6c4ce2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:59:46.502807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b1270039-65df-4358-af09-a9335b6c4ce2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:59:46.518014 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1270039-65df-4358-af09-a9335b6c4ce2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:46.518993 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1270039-65df-4358-af09-a9335b6c4ce2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:46.518993 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1270039-65df-4358-af09-a9335b6c4ce2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:46.519659 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1270039-65df-4358-af09-a9335b6c4ce2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:46.520125 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1270039-65df-4358-af09-a9335b6c4ce2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:46.520584 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1270039-65df-4358-af09-a9335b6c4ce2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:46.661151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b1270039-65df-4358-af09-a9335b6c4ce2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:59:46.670241 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b1270039-65df-4358-af09-a9335b6c4ce2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8" status: 200 len: 1393 microversion: 2.1 time: 0.172726 Oct 29 03:59:46.670776 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3497/7219] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:59:46 2022] GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:59:47.025766 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-23a00048-aae7-4930-9a43-e05b562db9b6 req-71eb27d0-f25e-4295-acf5-be5d066eba06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8", "tag": "a1c16bbf-0976-4831-b8e5-7773a4bbce7f"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:59:47.037251 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-23a00048-aae7-4930-9a43-e05b562db9b6 req-71eb27d0-f25e-4295-acf5-be5d066eba06 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:47.037970 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-23a00048-aae7-4930-9a43-e05b562db9b6 req-71eb27d0-f25e-4295-acf5-be5d066eba06 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:47.038400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-23a00048-aae7-4930-9a43-e05b562db9b6 req-71eb27d0-f25e-4295-acf5-be5d066eba06 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:47.050375 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-23a00048-aae7-4930-9a43-e05b562db9b6 req-71eb27d0-f25e-4295-acf5-be5d066eba06 service nova] Creating event network-changed:a1c16bbf-0976-4831-b8e5-7773a4bbce7f for instance e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 on n-h2-862967-2 Oct 29 03:59:47.055842 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-23a00048-aae7-4930-9a43-e05b562db9b6 req-71eb27d0-f25e-4295-acf5-be5d066eba06 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034151 Oct 29 03:59:47.056496 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3723/7220] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:59:47.698601 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f83b3107-a282-4086-8516-4d510ec7b9b2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:59:47.700510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f83b3107-a282-4086-8516-4d510ec7b9b2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:59:47.713289 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f83b3107-a282-4086-8516-4d510ec7b9b2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:47.714106 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f83b3107-a282-4086-8516-4d510ec7b9b2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:47.714876 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f83b3107-a282-4086-8516-4d510ec7b9b2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:47.716087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f83b3107-a282-4086-8516-4d510ec7b9b2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:47.717146 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f83b3107-a282-4086-8516-4d510ec7b9b2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:47.717911 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f83b3107-a282-4086-8516-4d510ec7b9b2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:47.864627 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f83b3107-a282-4086-8516-4d510ec7b9b2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:59:47.873104 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f83b3107-a282-4086-8516-4d510ec7b9b2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8" status: 200 len: 1393 microversion: 2.1 time: 0.181422 Oct 29 03:59:47.873664 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3498/7221] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:59:47 2022] GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 => generated 1393 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:59:48.900473 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4591e72f-7bd3-4fd0-a2f2-dc0223a931bc tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:59:48.901338 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4591e72f-7bd3-4fd0-a2f2-dc0223a931bc tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:59:48.909212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4591e72f-7bd3-4fd0-a2f2-dc0223a931bc tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:48.909781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4591e72f-7bd3-4fd0-a2f2-dc0223a931bc tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:48.910294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4591e72f-7bd3-4fd0-a2f2-dc0223a931bc tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:48.911103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4591e72f-7bd3-4fd0-a2f2-dc0223a931bc tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:48.911634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4591e72f-7bd3-4fd0-a2f2-dc0223a931bc tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:48.912134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4591e72f-7bd3-4fd0-a2f2-dc0223a931bc tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:49.343331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4591e72f-7bd3-4fd0-a2f2-dc0223a931bc tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:59:49.351709 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4591e72f-7bd3-4fd0-a2f2-dc0223a931bc tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8" status: 200 len: 1393 microversion: 2.1 time: 0.457412 Oct 29 03:59:49.352293 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3724/7222] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:59:48 2022] GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 => generated 1393 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:59:50.377739 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b1635be8-0fb5-431d-a32f-382dbad08ab8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:59:50.378427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b1635be8-0fb5-431d-a32f-382dbad08ab8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:59:50.387920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1635be8-0fb5-431d-a32f-382dbad08ab8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:50.388639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1635be8-0fb5-431d-a32f-382dbad08ab8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:50.389234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1635be8-0fb5-431d-a32f-382dbad08ab8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:50.390167 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1635be8-0fb5-431d-a32f-382dbad08ab8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:50.390901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1635be8-0fb5-431d-a32f-382dbad08ab8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:50.391362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1635be8-0fb5-431d-a32f-382dbad08ab8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:50.547883 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b1635be8-0fb5-431d-a32f-382dbad08ab8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:59:50.556474 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b1635be8-0fb5-431d-a32f-382dbad08ab8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8" status: 200 len: 1393 microversion: 2.1 time: 0.184172 Oct 29 03:59:50.557091 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3499/7223] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:59:50 2022] GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 => generated 1393 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:59:51.582700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-81acbce9-a923-4acc-bc6f-9742cc12dec2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:59:51.584856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-81acbce9-a923-4acc-bc6f-9742cc12dec2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:59:51.594426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81acbce9-a923-4acc-bc6f-9742cc12dec2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:51.595124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81acbce9-a923-4acc-bc6f-9742cc12dec2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:51.595731 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81acbce9-a923-4acc-bc6f-9742cc12dec2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:51.596885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81acbce9-a923-4acc-bc6f-9742cc12dec2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:51.597518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81acbce9-a923-4acc-bc6f-9742cc12dec2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:51.597998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-81acbce9-a923-4acc-bc6f-9742cc12dec2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:51.739082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-81acbce9-a923-4acc-bc6f-9742cc12dec2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:59:51.747534 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-81acbce9-a923-4acc-bc6f-9742cc12dec2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8" status: 200 len: 1393 microversion: 2.1 time: 0.170912 Oct 29 03:59:51.748172 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3725/7224] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:59:51 2022] GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 => generated 1393 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:59:52.773450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-59b15ada-e52f-4ca4-8bf5-2829b093dc93 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:59:52.774133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-59b15ada-e52f-4ca4-8bf5-2829b093dc93 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:59:52.782542 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59b15ada-e52f-4ca4-8bf5-2829b093dc93 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:52.783120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59b15ada-e52f-4ca4-8bf5-2829b093dc93 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:52.783639 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59b15ada-e52f-4ca4-8bf5-2829b093dc93 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:52.784469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59b15ada-e52f-4ca4-8bf5-2829b093dc93 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:52.785048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59b15ada-e52f-4ca4-8bf5-2829b093dc93 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:52.785568 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-59b15ada-e52f-4ca4-8bf5-2829b093dc93 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:52.939468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-59b15ada-e52f-4ca4-8bf5-2829b093dc93 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:59:52.950319 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-59b15ada-e52f-4ca4-8bf5-2829b093dc93 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8" status: 200 len: 1393 microversion: 2.1 time: 0.181307 Oct 29 03:59:52.951063 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3500/7225] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:59:52 2022] GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 => generated 1393 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:59:53.881267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-75f98243-0560-4e6b-a956-341401aadc90 req-7c3e8a52-fc80-496e-9130-7dff13c8664f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8", "name": "network-vif-plugged", "status": "completed", "tag": "a1c16bbf-0976-4831-b8e5-7773a4bbce7f"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:59:53.893484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-75f98243-0560-4e6b-a956-341401aadc90 req-7c3e8a52-fc80-496e-9130-7dff13c8664f service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:53.894905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-75f98243-0560-4e6b-a956-341401aadc90 req-7c3e8a52-fc80-496e-9130-7dff13c8664f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:53.895340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-75f98243-0560-4e6b-a956-341401aadc90 req-7c3e8a52-fc80-496e-9130-7dff13c8664f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:53.907494 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-75f98243-0560-4e6b-a956-341401aadc90 req-7c3e8a52-fc80-496e-9130-7dff13c8664f service nova] Creating event network-vif-plugged:a1c16bbf-0976-4831-b8e5-7773a4bbce7f for instance e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 on n-h2-862967-2 Oct 29 03:59:53.912898 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-75f98243-0560-4e6b-a956-341401aadc90 req-7c3e8a52-fc80-496e-9130-7dff13c8664f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036038 Oct 29 03:59:53.913777 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3726/7226] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:59:53.974229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d8f0d31e-d4cf-4582-8666-d03c069595db tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:59:53.974881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d8f0d31e-d4cf-4582-8666-d03c069595db tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:59:53.982042 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8f0d31e-d4cf-4582-8666-d03c069595db tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:53.982553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8f0d31e-d4cf-4582-8666-d03c069595db tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:53.983010 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8f0d31e-d4cf-4582-8666-d03c069595db tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:53.983727 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8f0d31e-d4cf-4582-8666-d03c069595db tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:53.984199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8f0d31e-d4cf-4582-8666-d03c069595db tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:53.984680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8f0d31e-d4cf-4582-8666-d03c069595db tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:54.119608 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d8f0d31e-d4cf-4582-8666-d03c069595db tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:59:54.128006 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d8f0d31e-d4cf-4582-8666-d03c069595db tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8" status: 200 len: 1393 microversion: 2.1 time: 0.157870 Oct 29 03:59:54.128642 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3501/7227] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:59:53 2022] GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:59:55.150707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:59:55.151617 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:59:55.158825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-064c4ad0-9a96-4891-b292-fc2b07b46e1a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:59:55.159537 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-064c4ad0-9a96-4891-b292-fc2b07b46e1a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:59:55.166841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-064c4ad0-9a96-4891-b292-fc2b07b46e1a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:55.167318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-064c4ad0-9a96-4891-b292-fc2b07b46e1a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:55.167756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-064c4ad0-9a96-4891-b292-fc2b07b46e1a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:55.168469 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-064c4ad0-9a96-4891-b292-fc2b07b46e1a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:55.168932 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-064c4ad0-9a96-4891-b292-fc2b07b46e1a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:55.169344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-064c4ad0-9a96-4891-b292-fc2b07b46e1a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:55.304779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-064c4ad0-9a96-4891-b292-fc2b07b46e1a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:59:55.313173 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-064c4ad0-9a96-4891-b292-fc2b07b46e1a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8" status: 200 len: 1564 microversion: 2.1 time: 0.164392 Oct 29 03:59:55.313771 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3727/7228] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:59:55 2022] GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 => generated 1564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:59:55.336236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4e6a6a7e-4e31-40cf-8194-14cd69f6516c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:59:55.336832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4e6a6a7e-4e31-40cf-8194-14cd69f6516c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:59:55.338668 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:59:55.345812 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e6a6a7e-4e31-40cf-8194-14cd69f6516c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:55.346374 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e6a6a7e-4e31-40cf-8194-14cd69f6516c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:55.346816 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e6a6a7e-4e31-40cf-8194-14cd69f6516c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:55.347530 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e6a6a7e-4e31-40cf-8194-14cd69f6516c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:55.347994 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e6a6a7e-4e31-40cf-8194-14cd69f6516c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:55.348425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4e6a6a7e-4e31-40cf-8194-14cd69f6516c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:55.484659 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4e6a6a7e-4e31-40cf-8194-14cd69f6516c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:59:55.493549 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4e6a6a7e-4e31-40cf-8194-14cd69f6516c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8" status: 200 len: 1564 microversion: 2.1 time: 0.161354 Oct 29 03:59:55.494103 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3502/7229] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:59:55 2022] GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 03:59:57.131704 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5678f6d3-68f7-4b83-907b-fb0f4b9e636c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 03:59:57.132328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5678f6d3-68f7-4b83-907b-fb0f4b9e636c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 03:59:57.139516 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5678f6d3-68f7-4b83-907b-fb0f4b9e636c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:57.139992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-fc08c259-d99f-411a-9e36-bf4aa085bdaa req-a60c879f-b68f-45e8-83c3-e10d3419f693 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8", "tag": "a1c16bbf-0976-4831-b8e5-7773a4bbce7f"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 03:59:57.140544 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5678f6d3-68f7-4b83-907b-fb0f4b9e636c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:57.140758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5678f6d3-68f7-4b83-907b-fb0f4b9e636c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:57.141459 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5678f6d3-68f7-4b83-907b-fb0f4b9e636c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:57.142081 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5678f6d3-68f7-4b83-907b-fb0f4b9e636c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:57.142498 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5678f6d3-68f7-4b83-907b-fb0f4b9e636c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:57.151288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-fc08c259-d99f-411a-9e36-bf4aa085bdaa req-a60c879f-b68f-45e8-83c3-e10d3419f693 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 03:59:57.151942 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-fc08c259-d99f-411a-9e36-bf4aa085bdaa req-a60c879f-b68f-45e8-83c3-e10d3419f693 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 03:59:57.152480 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-fc08c259-d99f-411a-9e36-bf4aa085bdaa req-a60c879f-b68f-45e8-83c3-e10d3419f693 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 03:59:57.165136 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-fc08c259-d99f-411a-9e36-bf4aa085bdaa req-a60c879f-b68f-45e8-83c3-e10d3419f693 service nova] Creating event network-changed:a1c16bbf-0976-4831-b8e5-7773a4bbce7f for instance e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 on n-h2-862967-2 Oct 29 03:59:57.170545 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-fc08c259-d99f-411a-9e36-bf4aa085bdaa req-a60c879f-b68f-45e8-83c3-e10d3419f693 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036984 Oct 29 03:59:57.171615 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3503/7230] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 03:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 03:59:57.366821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5678f6d3-68f7-4b83-907b-fb0f4b9e636c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 03:59:57.376127 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5678f6d3-68f7-4b83-907b-fb0f4b9e636c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8" status: 200 len: 1564 microversion: 2.1 time: 0.248439 Oct 29 03:59:57.376917 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3728/7231] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 03:59:57 2022] GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 => generated 1564 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 04:00:20.691240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=17 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:00:20.691997 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=38 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:00:20.696489 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-baa2eadf-118c-45c2-a43d-6afa4b3ef242 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:00:20.698939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-baa2eadf-118c-45c2-a43d-6afa4b3ef242 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:00:20.706248 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-baa2eadf-118c-45c2-a43d-6afa4b3ef242 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:20.706753 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-baa2eadf-118c-45c2-a43d-6afa4b3ef242 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:20.707218 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-baa2eadf-118c-45c2-a43d-6afa4b3ef242 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:20.707938 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-baa2eadf-118c-45c2-a43d-6afa4b3ef242 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:20.708447 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-baa2eadf-118c-45c2-a43d-6afa4b3ef242 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:20.708918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-baa2eadf-118c-45c2-a43d-6afa4b3ef242 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:20.765141 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-baa2eadf-118c-45c2-a43d-6afa4b3ef242 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8/action" status: 200 len: 24571 microversion: 2.1 time: 0.075732 Oct 29 04:00:20.765792 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3504/7232] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 04:00:20 2022] POST /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8/action => generated 24571 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 04:00:27.210644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d36840ab-b9e8-45d9-bffa-cfdfb1e0f35b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:00:27.211381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d36840ab-b9e8-45d9-bffa-cfdfb1e0f35b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:00:27.213599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:00:27.214398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=36 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:00:27.221705 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d36840ab-b9e8-45d9-bffa-cfdfb1e0f35b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:27.222291 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d36840ab-b9e8-45d9-bffa-cfdfb1e0f35b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:27.222809 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d36840ab-b9e8-45d9-bffa-cfdfb1e0f35b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:27.223848 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d36840ab-b9e8-45d9-bffa-cfdfb1e0f35b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:27.224394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d36840ab-b9e8-45d9-bffa-cfdfb1e0f35b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:27.224946 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d36840ab-b9e8-45d9-bffa-cfdfb1e0f35b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:27.304396 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d36840ab-b9e8-45d9-bffa-cfdfb1e0f35b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8/action" status: 202 len: 0 microversion: 2.1 time: 0.098845 Oct 29 04:00:27.305097 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3729/7233] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 04:00:27 2022] POST /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:00:27.314232 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-95f8041f-87d9-4c47-9e16-ec31925ace02 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:00:27.314939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-95f8041f-87d9-4c47-9e16-ec31925ace02 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:00:27.323428 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95f8041f-87d9-4c47-9e16-ec31925ace02 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:27.324346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95f8041f-87d9-4c47-9e16-ec31925ace02 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:27.325144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95f8041f-87d9-4c47-9e16-ec31925ace02 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:27.325886 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95f8041f-87d9-4c47-9e16-ec31925ace02 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:27.326364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95f8041f-87d9-4c47-9e16-ec31925ace02 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:27.326804 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-95f8041f-87d9-4c47-9e16-ec31925ace02 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:27.478987 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-95f8041f-87d9-4c47-9e16-ec31925ace02 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:00:27.487770 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-95f8041f-87d9-4c47-9e16-ec31925ace02 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8" status: 200 len: 1688 microversion: 2.1 time: 0.177876 Oct 29 04:00:27.489139 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3505/7234] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:00:27 2022] GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:00:28.514700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3ea82ca6-8ca6-40ae-a7de-7f7dad668541 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:00:28.515414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3ea82ca6-8ca6-40ae-a7de-7f7dad668541 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:00:28.523169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ea82ca6-8ca6-40ae-a7de-7f7dad668541 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:28.523738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ea82ca6-8ca6-40ae-a7de-7f7dad668541 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:28.524418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ea82ca6-8ca6-40ae-a7de-7f7dad668541 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:28.525549 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ea82ca6-8ca6-40ae-a7de-7f7dad668541 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:28.526243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ea82ca6-8ca6-40ae-a7de-7f7dad668541 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:28.526851 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3ea82ca6-8ca6-40ae-a7de-7f7dad668541 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:28.682366 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3ea82ca6-8ca6-40ae-a7de-7f7dad668541 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:00:28.691313 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3ea82ca6-8ca6-40ae-a7de-7f7dad668541 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8" status: 200 len: 1668 microversion: 2.1 time: 0.182059 Oct 29 04:00:28.691940 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3730/7235] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:00:28 2022] GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 => generated 1668 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:00:29.799856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8b7136a3-031d-497d-929b-f11fc510d8b9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:00:29.803431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8b7136a3-031d-497d-929b-f11fc510d8b9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:00:29.815361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b7136a3-031d-497d-929b-f11fc510d8b9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:29.815896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b7136a3-031d-497d-929b-f11fc510d8b9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:29.816342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b7136a3-031d-497d-929b-f11fc510d8b9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:29.817093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b7136a3-031d-497d-929b-f11fc510d8b9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:29.817554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b7136a3-031d-497d-929b-f11fc510d8b9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:29.817984 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8b7136a3-031d-497d-929b-f11fc510d8b9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:29.874460 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8b7136a3-031d-497d-929b-f11fc510d8b9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8/action" status: 200 len: 32643 microversion: 2.1 time: 0.081054 Oct 29 04:00:29.875101 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3506/7236] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 04:00:29 2022] POST /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8/action => generated 32643 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 04:00:29.887685 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-72fc1085-96e5-4693-8ccf-e8a37314268f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:00:29.888249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-72fc1085-96e5-4693-8ccf-e8a37314268f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:00:29.895520 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72fc1085-96e5-4693-8ccf-e8a37314268f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:29.896004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72fc1085-96e5-4693-8ccf-e8a37314268f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:29.896435 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72fc1085-96e5-4693-8ccf-e8a37314268f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:29.897172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72fc1085-96e5-4693-8ccf-e8a37314268f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:29.897625 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72fc1085-96e5-4693-8ccf-e8a37314268f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:29.898050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-72fc1085-96e5-4693-8ccf-e8a37314268f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:29.969993 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-72fc1085-96e5-4693-8ccf-e8a37314268f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8/action" status: 202 len: 0 microversion: 2.1 time: 0.086203 Oct 29 04:00:29.970632 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3731/7237] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 04:00:29 2022] POST /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:00:29.979829 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0f98f018-6912-4fa7-9556-a6481a57945f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:00:29.980596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0f98f018-6912-4fa7-9556-a6481a57945f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:00:29.988218 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f98f018-6912-4fa7-9556-a6481a57945f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:29.989081 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f98f018-6912-4fa7-9556-a6481a57945f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:29.989414 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f98f018-6912-4fa7-9556-a6481a57945f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:29.990102 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f98f018-6912-4fa7-9556-a6481a57945f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:29.990578 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f98f018-6912-4fa7-9556-a6481a57945f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:29.991333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0f98f018-6912-4fa7-9556-a6481a57945f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:30.132949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-0f98f018-6912-4fa7-9556-a6481a57945f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:00:30.142274 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0f98f018-6912-4fa7-9556-a6481a57945f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8" status: 200 len: 1675 microversion: 2.1 time: 0.166885 Oct 29 04:00:30.142864 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3507/7238] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:00:29 2022] GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:00:31.175032 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-05d3bded-808a-47ff-bc80-b611d66d125d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:00:31.176216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-05d3bded-808a-47ff-bc80-b611d66d125d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:00:31.189398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05d3bded-808a-47ff-bc80-b611d66d125d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:31.189883 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05d3bded-808a-47ff-bc80-b611d66d125d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:31.190312 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05d3bded-808a-47ff-bc80-b611d66d125d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:31.191009 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05d3bded-808a-47ff-bc80-b611d66d125d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:31.191581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05d3bded-808a-47ff-bc80-b611d66d125d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:31.192012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-05d3bded-808a-47ff-bc80-b611d66d125d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:31.338036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-05d3bded-808a-47ff-bc80-b611d66d125d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:00:31.348195 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-05d3bded-808a-47ff-bc80-b611d66d125d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8" status: 200 len: 1683 microversion: 2.1 time: 0.181690 Oct 29 04:00:31.348828 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3732/7239] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:00:31 2022] GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 => generated 1683 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:00:31.459488 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b1ab4b36-0cb1-460f-9c9a-d0086fb9f244 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:00:31.462290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b1ab4b36-0cb1-460f-9c9a-d0086fb9f244 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:00:31.469606 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1ab4b36-0cb1-460f-9c9a-d0086fb9f244 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:31.470113 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1ab4b36-0cb1-460f-9c9a-d0086fb9f244 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:31.470558 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1ab4b36-0cb1-460f-9c9a-d0086fb9f244 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:31.471265 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1ab4b36-0cb1-460f-9c9a-d0086fb9f244 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:31.471725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1ab4b36-0cb1-460f-9c9a-d0086fb9f244 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:31.472155 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b1ab4b36-0cb1-460f-9c9a-d0086fb9f244 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:31.528087 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b1ab4b36-0cb1-460f-9c9a-d0086fb9f244 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8/action" status: 200 len: 35916 microversion: 2.1 time: 0.071897 Oct 29 04:00:31.528897 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3508/7240] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 04:00:31 2022] POST /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8/action => generated 35916 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 04:00:32.955016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4d5c9c78-6b36-4f38-9440-6418379f3bdb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:00:32.955764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4d5c9c78-6b36-4f38-9440-6418379f3bdb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:00:32.958071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-2c2f1367-1ef7-4d69-b851-315c31559075 req-28380733-4d50-401a-9603-b79c7a5783b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8", "tag": "a1c16bbf-0976-4831-b8e5-7773a4bbce7f"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:00:32.962856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d5c9c78-6b36-4f38-9440-6418379f3bdb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:32.963593 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d5c9c78-6b36-4f38-9440-6418379f3bdb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:32.964039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d5c9c78-6b36-4f38-9440-6418379f3bdb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:32.964850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d5c9c78-6b36-4f38-9440-6418379f3bdb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:32.965723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d5c9c78-6b36-4f38-9440-6418379f3bdb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:32.966160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d5c9c78-6b36-4f38-9440-6418379f3bdb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:32.969207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2c2f1367-1ef7-4d69-b851-315c31559075 req-28380733-4d50-401a-9603-b79c7a5783b5 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:32.969696 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2c2f1367-1ef7-4d69-b851-315c31559075 req-28380733-4d50-401a-9603-b79c7a5783b5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:32.970400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-2c2f1367-1ef7-4d69-b851-315c31559075 req-28380733-4d50-401a-9603-b79c7a5783b5 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:32.982751 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-2c2f1367-1ef7-4d69-b851-315c31559075 req-28380733-4d50-401a-9603-b79c7a5783b5 service nova] Creating event network-changed:a1c16bbf-0976-4831-b8e5-7773a4bbce7f for instance e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 on n-h2-862967-2 Oct 29 04:00:32.996596 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-2c2f1367-1ef7-4d69-b851-315c31559075 req-28380733-4d50-401a-9603-b79c7a5783b5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043102 Oct 29 04:00:32.997866 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3509/7241] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:00:33.001758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4d5c9c78-6b36-4f38-9440-6418379f3bdb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 04:00:33.092306 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4d5c9c78-6b36-4f38-9440-6418379f3bdb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8" status: 204 len: 0 microversion: 2.1 time: 0.141146 Oct 29 04:00:33.097064 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3733/7242] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 04:00:32 2022] DELETE /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 04:00:33.104238 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-107ac1af-7a35-4e65-87be-d488b0de045f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:00:33.105258 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-107ac1af-7a35-4e65-87be-d488b0de045f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:00:33.112354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-107ac1af-7a35-4e65-87be-d488b0de045f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:33.112909 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-107ac1af-7a35-4e65-87be-d488b0de045f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:33.113362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-107ac1af-7a35-4e65-87be-d488b0de045f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:33.114094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-107ac1af-7a35-4e65-87be-d488b0de045f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:33.114562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-107ac1af-7a35-4e65-87be-d488b0de045f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:33.115014 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-107ac1af-7a35-4e65-87be-d488b0de045f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:33.253623 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-107ac1af-7a35-4e65-87be-d488b0de045f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:00:33.261629 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-107ac1af-7a35-4e65-87be-d488b0de045f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8" status: 200 len: 1689 microversion: 2.1 time: 0.163089 Oct 29 04:00:33.262257 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3510/7243] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:00:33 2022] GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 04:00:34.292092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b3bfb091-65c9-4d7d-b3fd-4f32d72dfa5c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:00:34.293295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b3bfb091-65c9-4d7d-b3fd-4f32d72dfa5c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:00:34.306457 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3bfb091-65c9-4d7d-b3fd-4f32d72dfa5c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:34.307472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3bfb091-65c9-4d7d-b3fd-4f32d72dfa5c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:34.308396 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3bfb091-65c9-4d7d-b3fd-4f32d72dfa5c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:34.309717 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3bfb091-65c9-4d7d-b3fd-4f32d72dfa5c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:34.310466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3bfb091-65c9-4d7d-b3fd-4f32d72dfa5c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:34.311192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3bfb091-65c9-4d7d-b3fd-4f32d72dfa5c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:34.536415 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b3bfb091-65c9-4d7d-b3fd-4f32d72dfa5c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:00:34.548152 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b3bfb091-65c9-4d7d-b3fd-4f32d72dfa5c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8" status: 200 len: 1689 microversion: 2.1 time: 0.263101 Oct 29 04:00:34.548912 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3734/7244] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:00:34 2022] GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 => generated 1689 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:00:35.169163 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-16922040-d9c1-4c87-94d8-8c397169d465 req-8ffdb72e-46f5-4a36-a1e7-4028f3cee081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8", "name": "network-vif-deleted", "tag": "a1c16bbf-0976-4831-b8e5-7773a4bbce7f"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:00:35.182828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-16922040-d9c1-4c87-94d8-8c397169d465 req-8ffdb72e-46f5-4a36-a1e7-4028f3cee081 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:35.183333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-16922040-d9c1-4c87-94d8-8c397169d465 req-8ffdb72e-46f5-4a36-a1e7-4028f3cee081 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:35.183796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-16922040-d9c1-4c87-94d8-8c397169d465 req-8ffdb72e-46f5-4a36-a1e7-4028f3cee081 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:35.196731 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-16922040-d9c1-4c87-94d8-8c397169d465 req-8ffdb72e-46f5-4a36-a1e7-4028f3cee081 service nova] Creating event network-vif-deleted:a1c16bbf-0976-4831-b8e5-7773a4bbce7f for instance e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 on n-h2-862967-2 Oct 29 04:00:35.202298 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-16922040-d9c1-4c87-94d8-8c397169d465 req-8ffdb72e-46f5-4a36-a1e7-4028f3cee081 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037018 Oct 29 04:00:35.202903 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3511/7245] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:00:35.572079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-600445a7-cb7c-48fd-93a3-e9576de50189 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:00:35.573709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-600445a7-cb7c-48fd-93a3-e9576de50189 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:00:35.582188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-600445a7-cb7c-48fd-93a3-e9576de50189 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:35.582707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-600445a7-cb7c-48fd-93a3-e9576de50189 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:35.583147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-600445a7-cb7c-48fd-93a3-e9576de50189 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:35.583876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-600445a7-cb7c-48fd-93a3-e9576de50189 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:35.584390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-600445a7-cb7c-48fd-93a3-e9576de50189 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:35.584783 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-600445a7-cb7c-48fd-93a3-e9576de50189 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:35.623399 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-600445a7-cb7c-48fd-93a3-e9576de50189 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:35.623884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-600445a7-cb7c-48fd-93a3-e9576de50189 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:35.624333 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-600445a7-cb7c-48fd-93a3-e9576de50189 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:35.624818 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-600445a7-cb7c-48fd-93a3-e9576de50189 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lazy-loading 'fault' on Instance uuid e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 04:00:35.669339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-600445a7-cb7c-48fd-93a3-e9576de50189 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:00:35.677951 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-600445a7-cb7c-48fd-93a3-e9576de50189 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8" status: 200 len: 1357 microversion: 2.1 time: 0.110151 Oct 29 04:00:35.678919 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3735/7246] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:00:35 2022] GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 => generated 1357 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:00:36.707480 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-74658752-eb5d-4c5d-acd2-63abc29b115a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:00:36.708192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-74658752-eb5d-4c5d-acd2-63abc29b115a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:00:36.715284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-74658752-eb5d-4c5d-acd2-63abc29b115a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:36.715788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-74658752-eb5d-4c5d-acd2-63abc29b115a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:36.716244 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-74658752-eb5d-4c5d-acd2-63abc29b115a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:36.716999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-74658752-eb5d-4c5d-acd2-63abc29b115a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:36.717468 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-74658752-eb5d-4c5d-acd2-63abc29b115a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:36.717937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-74658752-eb5d-4c5d-acd2-63abc29b115a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:36.732048 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-74658752-eb5d-4c5d-acd2-63abc29b115a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] HTTP exception thrown: Instance e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 could not be found. Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-74658752-eb5d-4c5d-acd2-63abc29b115a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Request method failure captured: Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 HTTP/1.1 Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKUo0_mrT7RmIg7xwBr8IFILx8owR6S_7fbkYMDM3yKtVViQvdfHhgImK2tLNoi-DKhagj3xbECEfbniUg9pO0t5aY8w58qiHmIe3llBDaRK81PNEp7hhgTWe4zv3Mc__1xDWYdZL84JZ9C1u9d6A3xFbzEWOXw9Pdm2mYWXRVUQcjw Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 6db83678d78d49ff9768ba55d1a7d70d Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2052576324 Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6db83678d78d49ff9768ba55d1a7d70d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6db83678d78d49ff9768ba55d1a7d70d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6db83678d78d49ff9768ba55d1a7d70d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6db83678d78d49ff9768ba55d1a7d70d"}]}] Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2052576324 Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 6db83678d78d49ff9768ba55d1a7d70d Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2052576324 Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestNetworkAdvancedServerOps-2052576324-project Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: f75948d4d49e47f69900a9b8ece27999 Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2052576324-project Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 could not be found. Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': 'e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8'} Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 could not be found. Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 could not be found. Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 04:00:36.733761 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:00:36.738960 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 04:00:36.738960 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:00:36.738960 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:00:36.738960 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:00:36.738960 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 04:00:36.738960 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 04:00:36.738960 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 could not be found. Oct 29 04:00:36.738960 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 04:00:36.738960 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-74658752-eb5d-4c5d-acd2-63abc29b115a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Returning 404 to user: Instance e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 04:00:36.738960 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-74658752-eb5d-4c5d-acd2-63abc29b115a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8" status: 404 len: 111 microversion: 2.1 time: 0.034983 Oct 29 04:00:36.738960 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3512/7247] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:00:36 2022] GET /compute/v2.1/servers/e435fd26-5fad-4ee7-8b25-fc0c0dc4dfc8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 04:00:39.861586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c72c5160-8f08-405c-a015-7aa826de05d1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '.version_select at 0x7ff052afb0d0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:00:39.884777 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c72c5160-8f08-405c-a015-7aa826de05d1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2045529691" status: 202 len: 0 microversion: 2.1 time: 0.027010 Oct 29 04:00:39.885370 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3736/7248] 10.222.0.46 () {58 vars in 1284 bytes} [Sat Oct 29 04:00:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2045529691 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:00:39.912014 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3e3f643b-fc11-4bcd-9088-ff90c3b7cb42 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'create', calling method: .version_select at 0x7ff052b92310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1001871511", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbsMzVBTOb7I7uusuhHQYqzbY2++kvCX/ReHg9j7bz0Tt4ErLfg+YY3n04iSPhOKPGLklwR3x8G3zpF4Dmhd7rUEQkQn5C9mEVc8tK/ijwWIqv5tSqZrSYYBy0exd8fGQ=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:00:39.929409 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-3e3f643b-fc11-4bcd-9088-ff90c3b7cb42 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Getting quotas for project 6db83678d78d49ff9768ba55d1a7d70d. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:00:39.934453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-3e3f643b-fc11-4bcd-9088-ff90c3b7cb42 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Getting quotas for user f75948d4d49e47f69900a9b8ece27999 and project 6db83678d78d49ff9768ba55d1a7d70d. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:00:39.959383 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3e3f643b-fc11-4bcd-9088-ff90c3b7cb42 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051370 Oct 29 04:00:39.959926 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3513/7249] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 04:00:39 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:00:45.860194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:00:45.867391 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3da76f5b-3d13-4649-99f7-568231528f84 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1892489793", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "45a70f81-1225-471e-a19f-5f71ff578683"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1001871511", "security_groups": [{"name": "tempest-secgroup-smoke-21512658"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:00:45.988709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-3da76f5b-3d13-4649-99f7-568231528f84 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] validate_networks() for [('45a70f81-1225-471e-a19f-5f71ff578683', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 04:00:46.395475 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-3da76f5b-3d13-4649-99f7-568231528f84 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 04:00:46.396164 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-3da76f5b-3d13-4649-99f7-568231528f84 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 04:00:46.396832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-3da76f5b-3d13-4649-99f7-568231528f84 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 04:00:46.397484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-3da76f5b-3d13-4649-99f7-568231528f84 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 04:00:46.398092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-3da76f5b-3d13-4649-99f7-568231528f84 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 04:00:46.415246 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3da76f5b-3d13-4649-99f7-568231528f84 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:46.415757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3da76f5b-3d13-4649-99f7-568231528f84 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:46.416201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3da76f5b-3d13-4649-99f7-568231528f84 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:46.417542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3da76f5b-3d13-4649-99f7-568231528f84 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:46.418004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3da76f5b-3d13-4649-99f7-568231528f84 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:46.418627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3da76f5b-3d13-4649-99f7-568231528f84 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:46.437578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-3da76f5b-3d13-4649-99f7-568231528f84 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Getting quotas for project 6db83678d78d49ff9768ba55d1a7d70d. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:00:46.443436 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-3da76f5b-3d13-4649-99f7-568231528f84 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Getting quotas for user f75948d4d49e47f69900a9b8ece27999 and project 6db83678d78d49ff9768ba55d1a7d70d. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:00:46.457073 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3da76f5b-3d13-4649-99f7-568231528f84 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 04:00:46.459509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3da76f5b-3d13-4649-99f7-568231528f84 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 04:00:46.511711 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3da76f5b-3d13-4649-99f7-568231528f84 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.653122 Oct 29 04:00:46.524668 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3737/7250] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 04:00:45 2022] POST /compute/v2.1/servers => generated 404 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 04:00:46.525550 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b43bbf83-c816-46a1-8800-f4a7e80f5811 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:00:46.526207 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b43bbf83-c816-46a1-8800-f4a7e80f5811 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:00:46.593012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b43bbf83-c816-46a1-8800-f4a7e80f5811 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:00:46.600399 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b43bbf83-c816-46a1-8800-f4a7e80f5811 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 200 len: 1267 microversion: 2.1 time: 0.080313 Oct 29 04:00:46.601048 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3514/7251] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:00:46 2022] GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 1267 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 04:00:47.626484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-39742a46-7cf4-47d9-b69d-593825e1cdab tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:00:47.627986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-39742a46-7cf4-47d9-b69d-593825e1cdab tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:00:47.705599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-39742a46-7cf4-47d9-b69d-593825e1cdab tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:00:47.712822 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-39742a46-7cf4-47d9-b69d-593825e1cdab tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 200 len: 1267 microversion: 2.1 time: 0.091782 Oct 29 04:00:47.713429 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3738/7252] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:00:47 2022] GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 1267 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:00:48.735436 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-28b96f6b-4ae2-4dab-9b23-8e90195d3c12 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:00:48.736303 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-28b96f6b-4ae2-4dab-9b23-8e90195d3c12 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:00:48.738999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=36 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:00:48.796624 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-28b96f6b-4ae2-4dab-9b23-8e90195d3c12 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:00:48.803574 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-28b96f6b-4ae2-4dab-9b23-8e90195d3c12 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 200 len: 1267 microversion: 2.1 time: 0.072137 Oct 29 04:00:48.804200 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3515/7253] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:00:48 2022] GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 1267 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:00:49.827765 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-88b60f08-95af-47a9-953c-d8d6a57294fd tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:00:49.828486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-88b60f08-95af-47a9-953c-d8d6a57294fd tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:00:49.885067 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-88b60f08-95af-47a9-953c-d8d6a57294fd tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:00:49.893232 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-88b60f08-95af-47a9-953c-d8d6a57294fd tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 200 len: 1267 microversion: 2.1 time: 0.069579 Oct 29 04:00:49.893899 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3739/7254] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:00:49 2022] GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 1267 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:00:50.918086 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-93082770-0c02-4f00-9996-baa8be47dbe4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:00:50.918715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-93082770-0c02-4f00-9996-baa8be47dbe4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:00:50.921624 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:00:50.927866 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93082770-0c02-4f00-9996-baa8be47dbe4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:50.928353 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93082770-0c02-4f00-9996-baa8be47dbe4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:50.928820 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93082770-0c02-4f00-9996-baa8be47dbe4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:50.929553 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93082770-0c02-4f00-9996-baa8be47dbe4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:50.930008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93082770-0c02-4f00-9996-baa8be47dbe4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:50.930430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-93082770-0c02-4f00-9996-baa8be47dbe4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:50.996320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-93082770-0c02-4f00-9996-baa8be47dbe4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:00:51.004939 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-93082770-0c02-4f00-9996-baa8be47dbe4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 200 len: 1271 microversion: 2.1 time: 0.090840 Oct 29 04:00:51.005530 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3516/7255] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:00:50 2022] GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:00:52.028083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0875cd3d-c3a8-491a-9059-4bbff2c157e9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:00:52.029343 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0875cd3d-c3a8-491a-9059-4bbff2c157e9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:00:52.036266 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0875cd3d-c3a8-491a-9059-4bbff2c157e9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:52.036858 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0875cd3d-c3a8-491a-9059-4bbff2c157e9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:52.037289 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0875cd3d-c3a8-491a-9059-4bbff2c157e9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:52.037991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0875cd3d-c3a8-491a-9059-4bbff2c157e9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:52.038438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0875cd3d-c3a8-491a-9059-4bbff2c157e9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:52.038838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0875cd3d-c3a8-491a-9059-4bbff2c157e9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:52.103984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0875cd3d-c3a8-491a-9059-4bbff2c157e9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:00:52.112153 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0875cd3d-c3a8-491a-9059-4bbff2c157e9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 200 len: 1325 microversion: 2.1 time: 0.088092 Oct 29 04:00:52.112799 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3740/7256] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:00:52 2022] GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 1325 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:00:53.076942 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-811418e9-f934-48dd-99e1-3c83a0e3c085 req-b6e951ef-9fd4-4b5d-80b7-2fe93d7bae7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7961c40d-e050-46b6-9453-f99b716f5096", "tag": "36db0316-4d4a-4ae9-ad05-abe32cdf5c14"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:00:53.090369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-811418e9-f934-48dd-99e1-3c83a0e3c085 req-b6e951ef-9fd4-4b5d-80b7-2fe93d7bae7b service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:53.090875 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-811418e9-f934-48dd-99e1-3c83a0e3c085 req-b6e951ef-9fd4-4b5d-80b7-2fe93d7bae7b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:53.091431 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-811418e9-f934-48dd-99e1-3c83a0e3c085 req-b6e951ef-9fd4-4b5d-80b7-2fe93d7bae7b service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:53.103896 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-811418e9-f934-48dd-99e1-3c83a0e3c085 req-b6e951ef-9fd4-4b5d-80b7-2fe93d7bae7b service nova] Creating event network-changed:36db0316-4d4a-4ae9-ad05-abe32cdf5c14 for instance 7961c40d-e050-46b6-9453-f99b716f5096 on n-h2-862967-2 Oct 29 04:00:53.109034 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-811418e9-f934-48dd-99e1-3c83a0e3c085 req-b6e951ef-9fd4-4b5d-80b7-2fe93d7bae7b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036998 Oct 29 04:00:53.109649 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3517/7257] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:00:53.137426 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a00ae41a-19d0-46ba-843d-973d3dbfbe76 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:00:53.138200 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a00ae41a-19d0-46ba-843d-973d3dbfbe76 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:00:53.145926 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a00ae41a-19d0-46ba-843d-973d3dbfbe76 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:53.146506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a00ae41a-19d0-46ba-843d-973d3dbfbe76 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:53.147004 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a00ae41a-19d0-46ba-843d-973d3dbfbe76 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:53.147770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a00ae41a-19d0-46ba-843d-973d3dbfbe76 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:53.148311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a00ae41a-19d0-46ba-843d-973d3dbfbe76 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:53.148825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a00ae41a-19d0-46ba-843d-973d3dbfbe76 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:53.295926 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a00ae41a-19d0-46ba-843d-973d3dbfbe76 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:00:53.304293 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a00ae41a-19d0-46ba-843d-973d3dbfbe76 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 200 len: 1391 microversion: 2.1 time: 0.170920 Oct 29 04:00:53.305163 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3741/7258] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:00:53 2022] GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:00:54.332055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-89e1f41f-15ec-4765-bbad-8e02b91acc89 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:00:54.333091 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-89e1f41f-15ec-4765-bbad-8e02b91acc89 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:00:54.342129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89e1f41f-15ec-4765-bbad-8e02b91acc89 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:54.342879 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89e1f41f-15ec-4765-bbad-8e02b91acc89 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:54.343746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89e1f41f-15ec-4765-bbad-8e02b91acc89 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:54.344802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89e1f41f-15ec-4765-bbad-8e02b91acc89 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:54.345469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89e1f41f-15ec-4765-bbad-8e02b91acc89 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:54.346111 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89e1f41f-15ec-4765-bbad-8e02b91acc89 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:54.558020 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-89e1f41f-15ec-4765-bbad-8e02b91acc89 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:00:54.566316 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-89e1f41f-15ec-4765-bbad-8e02b91acc89 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 200 len: 1391 microversion: 2.1 time: 0.241941 Oct 29 04:00:54.567266 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3518/7259] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:00:54 2022] GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 1391 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:00:55.590061 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0d3ee99e-1594-4bd7-ab4b-bbf86dd5e5c9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:00:55.590687 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0d3ee99e-1594-4bd7-ab4b-bbf86dd5e5c9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:00:55.598253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d3ee99e-1594-4bd7-ab4b-bbf86dd5e5c9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:55.598731 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d3ee99e-1594-4bd7-ab4b-bbf86dd5e5c9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:55.599220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d3ee99e-1594-4bd7-ab4b-bbf86dd5e5c9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:55.599926 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d3ee99e-1594-4bd7-ab4b-bbf86dd5e5c9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:55.600381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d3ee99e-1594-4bd7-ab4b-bbf86dd5e5c9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:55.600837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0d3ee99e-1594-4bd7-ab4b-bbf86dd5e5c9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:55.738620 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0d3ee99e-1594-4bd7-ab4b-bbf86dd5e5c9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:00:55.752514 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0d3ee99e-1594-4bd7-ab4b-bbf86dd5e5c9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 200 len: 1391 microversion: 2.1 time: 0.166386 Oct 29 04:00:55.753489 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3742/7260] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:00:55 2022] GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:00:56.781448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2ed368a1-3509-4243-b695-0cccb5f06670 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:00:56.782602 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2ed368a1-3509-4243-b695-0cccb5f06670 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:00:56.791304 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2ed368a1-3509-4243-b695-0cccb5f06670 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:56.791807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2ed368a1-3509-4243-b695-0cccb5f06670 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:56.792266 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2ed368a1-3509-4243-b695-0cccb5f06670 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:56.793023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2ed368a1-3509-4243-b695-0cccb5f06670 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:56.793497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2ed368a1-3509-4243-b695-0cccb5f06670 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:56.793939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2ed368a1-3509-4243-b695-0cccb5f06670 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:56.938764 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2ed368a1-3509-4243-b695-0cccb5f06670 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:00:56.946792 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2ed368a1-3509-4243-b695-0cccb5f06670 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 200 len: 1391 microversion: 2.1 time: 0.172076 Oct 29 04:00:56.947380 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3519/7261] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:00:56 2022] GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:00:57.974078 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-801923d6-49d6-496c-b476-d1d10560f490 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:00:57.974670 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-801923d6-49d6-496c-b476-d1d10560f490 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:00:57.976486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:00:57.978110 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:00:57.984422 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-801923d6-49d6-496c-b476-d1d10560f490 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:57.984959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-801923d6-49d6-496c-b476-d1d10560f490 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:57.985389 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-801923d6-49d6-496c-b476-d1d10560f490 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:57.986127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-801923d6-49d6-496c-b476-d1d10560f490 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:57.986585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-801923d6-49d6-496c-b476-d1d10560f490 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:57.987016 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-801923d6-49d6-496c-b476-d1d10560f490 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:58.141267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-801923d6-49d6-496c-b476-d1d10560f490 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:00:58.149890 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-801923d6-49d6-496c-b476-d1d10560f490 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 200 len: 1391 microversion: 2.1 time: 0.182489 Oct 29 04:00:58.150492 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3743/7262] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:00:57 2022] GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 1391 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:00:58.247299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-e6cec854-ea47-4a5f-ba1d-efcfa8688607 req-27d07504-7410-4c91-b136-cdce5ef4f226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7961c40d-e050-46b6-9453-f99b716f5096", "name": "network-vif-plugged", "status": "completed", "tag": "36db0316-4d4a-4ae9-ad05-abe32cdf5c14"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:00:58.258470 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e6cec854-ea47-4a5f-ba1d-efcfa8688607 req-27d07504-7410-4c91-b136-cdce5ef4f226 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:58.258988 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e6cec854-ea47-4a5f-ba1d-efcfa8688607 req-27d07504-7410-4c91-b136-cdce5ef4f226 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:58.259766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e6cec854-ea47-4a5f-ba1d-efcfa8688607 req-27d07504-7410-4c91-b136-cdce5ef4f226 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:58.270948 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-e6cec854-ea47-4a5f-ba1d-efcfa8688607 req-27d07504-7410-4c91-b136-cdce5ef4f226 service nova] Creating event network-vif-plugged:36db0316-4d4a-4ae9-ad05-abe32cdf5c14 for instance 7961c40d-e050-46b6-9453-f99b716f5096 on n-h2-862967-2 Oct 29 04:00:58.275968 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-e6cec854-ea47-4a5f-ba1d-efcfa8688607 req-27d07504-7410-4c91-b136-cdce5ef4f226 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032447 Oct 29 04:00:58.276778 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3520/7263] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:00:59.173613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0755ed0b-2c48-4f00-81a4-51ff4db44ffb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:00:59.174227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0755ed0b-2c48-4f00-81a4-51ff4db44ffb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:00:59.181641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0755ed0b-2c48-4f00-81a4-51ff4db44ffb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:59.182135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0755ed0b-2c48-4f00-81a4-51ff4db44ffb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:59.182572 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0755ed0b-2c48-4f00-81a4-51ff4db44ffb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:59.183275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0755ed0b-2c48-4f00-81a4-51ff4db44ffb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:00:59.183735 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0755ed0b-2c48-4f00-81a4-51ff4db44ffb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:00:59.184169 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0755ed0b-2c48-4f00-81a4-51ff4db44ffb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:00:59.324249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0755ed0b-2c48-4f00-81a4-51ff4db44ffb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:00:59.332975 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0755ed0b-2c48-4f00-81a4-51ff4db44ffb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 200 len: 1391 microversion: 2.1 time: 0.163190 Oct 29 04:00:59.333644 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3744/7264] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:00:59 2022] GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:00.356139 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=8 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:01:00.365246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-03fd1cba-fa4c-4b6a-a830-c886d8788ee9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:00.366798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-03fd1cba-fa4c-4b6a-a830-c886d8788ee9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:00.377916 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03fd1cba-fa4c-4b6a-a830-c886d8788ee9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:00.378747 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03fd1cba-fa4c-4b6a-a830-c886d8788ee9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:00.379494 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03fd1cba-fa4c-4b6a-a830-c886d8788ee9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:00.380720 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03fd1cba-fa4c-4b6a-a830-c886d8788ee9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:00.381603 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03fd1cba-fa4c-4b6a-a830-c886d8788ee9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:00.382043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-03fd1cba-fa4c-4b6a-a830-c886d8788ee9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:00.527245 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-03fd1cba-fa4c-4b6a-a830-c886d8788ee9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:00.546069 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-03fd1cba-fa4c-4b6a-a830-c886d8788ee9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 200 len: 1562 microversion: 2.1 time: 0.191613 Oct 29 04:01:00.546671 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3521/7265] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:00 2022] GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 1562 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:00.571699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ffccad9b-39aa-4daf-a14b-d52464fa55d8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:00.572327 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ffccad9b-39aa-4daf-a14b-d52464fa55d8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:00.574301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=10 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:01:00.580734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffccad9b-39aa-4daf-a14b-d52464fa55d8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:00.581229 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffccad9b-39aa-4daf-a14b-d52464fa55d8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:00.581681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffccad9b-39aa-4daf-a14b-d52464fa55d8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:00.582379 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffccad9b-39aa-4daf-a14b-d52464fa55d8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:00.582840 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffccad9b-39aa-4daf-a14b-d52464fa55d8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:00.583268 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ffccad9b-39aa-4daf-a14b-d52464fa55d8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:00.738029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ffccad9b-39aa-4daf-a14b-d52464fa55d8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:00.746700 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ffccad9b-39aa-4daf-a14b-d52464fa55d8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 200 len: 1562 microversion: 2.1 time: 0.179052 Oct 29 04:01:00.747293 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3745/7266] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:00 2022] GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 1562 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:02.693202 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-04a87b14-db26-47ae-9ba3-6856d889c9d4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:02.694187 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-04a87b14-db26-47ae-9ba3-6856d889c9d4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:02.695354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-5c666921-2aab-45c0-b839-42bd0c5692b4 req-73ca4140-b4b9-40b7-9391-71fa680875d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7961c40d-e050-46b6-9453-f99b716f5096", "tag": "36db0316-4d4a-4ae9-ad05-abe32cdf5c14"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:01:02.701602 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04a87b14-db26-47ae-9ba3-6856d889c9d4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:02.701997 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04a87b14-db26-47ae-9ba3-6856d889c9d4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:02.702447 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04a87b14-db26-47ae-9ba3-6856d889c9d4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:02.703163 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04a87b14-db26-47ae-9ba3-6856d889c9d4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:02.703630 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04a87b14-db26-47ae-9ba3-6856d889c9d4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:02.704076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-04a87b14-db26-47ae-9ba3-6856d889c9d4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:02.706617 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5c666921-2aab-45c0-b839-42bd0c5692b4 req-73ca4140-b4b9-40b7-9391-71fa680875d9 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:02.707176 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5c666921-2aab-45c0-b839-42bd0c5692b4 req-73ca4140-b4b9-40b7-9391-71fa680875d9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:02.708203 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5c666921-2aab-45c0-b839-42bd0c5692b4 req-73ca4140-b4b9-40b7-9391-71fa680875d9 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:02.719496 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-5c666921-2aab-45c0-b839-42bd0c5692b4 req-73ca4140-b4b9-40b7-9391-71fa680875d9 service nova] Creating event network-changed:36db0316-4d4a-4ae9-ad05-abe32cdf5c14 for instance 7961c40d-e050-46b6-9453-f99b716f5096 on n-h2-862967-2 Oct 29 04:01:02.724790 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-5c666921-2aab-45c0-b839-42bd0c5692b4 req-73ca4140-b4b9-40b7-9391-71fa680875d9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033920 Oct 29 04:01:02.725558 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3746/7267] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:01:02.926593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-04a87b14-db26-47ae-9ba3-6856d889c9d4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:02.935106 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-04a87b14-db26-47ae-9ba3-6856d889c9d4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 200 len: 1562 microversion: 2.1 time: 0.246749 Oct 29 04:01:02.935859 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3522/7268] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:02 2022] GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 1562 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:24.570918 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=7 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:01:24.571813 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=40 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:01:24.576976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-540af4dd-7a1d-43f3-9f55-a346961e9661 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:01:24.579873 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-540af4dd-7a1d-43f3-9f55-a346961e9661 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:24.588951 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-540af4dd-7a1d-43f3-9f55-a346961e9661 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:24.589425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-540af4dd-7a1d-43f3-9f55-a346961e9661 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:24.589857 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-540af4dd-7a1d-43f3-9f55-a346961e9661 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:24.590543 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-540af4dd-7a1d-43f3-9f55-a346961e9661 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:24.590995 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-540af4dd-7a1d-43f3-9f55-a346961e9661 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:24.591414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-540af4dd-7a1d-43f3-9f55-a346961e9661 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:24.647574 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-540af4dd-7a1d-43f3-9f55-a346961e9661 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096/action" status: 200 len: 24571 microversion: 2.1 time: 0.079443 Oct 29 04:01:24.648388 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3747/7269] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 04:01:24 2022] POST /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096/action => generated 24571 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 04:01:31.063026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f070174e-32bd-40c4-9144-d2d994236efe tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:01:31.065795 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f070174e-32bd-40c4-9144-d2d994236efe tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:31.069667 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=13 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:01:31.070967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=34 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:01:31.077019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f070174e-32bd-40c4-9144-d2d994236efe tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:31.077516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f070174e-32bd-40c4-9144-d2d994236efe tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:31.077957 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f070174e-32bd-40c4-9144-d2d994236efe tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:31.078674 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f070174e-32bd-40c4-9144-d2d994236efe tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:31.079133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f070174e-32bd-40c4-9144-d2d994236efe tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:31.079574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f070174e-32bd-40c4-9144-d2d994236efe tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:31.166478 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f070174e-32bd-40c4-9144-d2d994236efe tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096/action" status: 202 len: 0 microversion: 2.1 time: 0.107445 Oct 29 04:01:31.167271 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3523/7270] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 04:01:31 2022] POST /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:01:31.177220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c81373c4-1dc2-44b9-8ec0-6c5c6d7760e4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:31.177907 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c81373c4-1dc2-44b9-8ec0-6c5c6d7760e4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:31.185718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c81373c4-1dc2-44b9-8ec0-6c5c6d7760e4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:31.186192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c81373c4-1dc2-44b9-8ec0-6c5c6d7760e4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:31.186623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c81373c4-1dc2-44b9-8ec0-6c5c6d7760e4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:31.187721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c81373c4-1dc2-44b9-8ec0-6c5c6d7760e4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:31.188243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c81373c4-1dc2-44b9-8ec0-6c5c6d7760e4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:31.188730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c81373c4-1dc2-44b9-8ec0-6c5c6d7760e4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:31.333762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c81373c4-1dc2-44b9-8ec0-6c5c6d7760e4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:31.343905 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c81373c4-1dc2-44b9-8ec0-6c5c6d7760e4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 200 len: 1673 microversion: 2.1 time: 0.171271 Oct 29 04:01:31.344730 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3748/7271] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:31 2022] GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:32.376607 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cc6ae7bf-83c2-48b1-b5cf-792e435e053a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:32.377668 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cc6ae7bf-83c2-48b1-b5cf-792e435e053a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:32.387407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc6ae7bf-83c2-48b1-b5cf-792e435e053a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:32.387906 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc6ae7bf-83c2-48b1-b5cf-792e435e053a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:32.388356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc6ae7bf-83c2-48b1-b5cf-792e435e053a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:32.389094 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc6ae7bf-83c2-48b1-b5cf-792e435e053a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:32.389567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc6ae7bf-83c2-48b1-b5cf-792e435e053a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:32.390003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cc6ae7bf-83c2-48b1-b5cf-792e435e053a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:32.529518 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cc6ae7bf-83c2-48b1-b5cf-792e435e053a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:32.538148 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cc6ae7bf-83c2-48b1-b5cf-792e435e053a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 200 len: 1678 microversion: 2.1 time: 0.168983 Oct 29 04:01:32.538749 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3524/7272] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:32 2022] GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:33.567438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-733b1468-1807-4339-ad27-cc4d6558fa06 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:33.568371 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-733b1468-1807-4339-ad27-cc4d6558fa06 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:33.581255 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-733b1468-1807-4339-ad27-cc4d6558fa06 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:33.582036 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-733b1468-1807-4339-ad27-cc4d6558fa06 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:33.582810 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-733b1468-1807-4339-ad27-cc4d6558fa06 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:33.583957 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-733b1468-1807-4339-ad27-cc4d6558fa06 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:33.584800 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-733b1468-1807-4339-ad27-cc4d6558fa06 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:33.585529 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-733b1468-1807-4339-ad27-cc4d6558fa06 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:33.731163 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-733b1468-1807-4339-ad27-cc4d6558fa06 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:33.739141 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-733b1468-1807-4339-ad27-cc4d6558fa06 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 200 len: 1678 microversion: 2.1 time: 0.179256 Oct 29 04:01:33.739726 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3749/7273] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:33 2022] GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:34.767537 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b6aedc1a-15bf-415c-a28a-56fa63898f90 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:34.768632 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b6aedc1a-15bf-415c-a28a-56fa63898f90 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:34.780119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6aedc1a-15bf-415c-a28a-56fa63898f90 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:34.781009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6aedc1a-15bf-415c-a28a-56fa63898f90 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:34.781761 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6aedc1a-15bf-415c-a28a-56fa63898f90 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:34.782932 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6aedc1a-15bf-415c-a28a-56fa63898f90 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:34.783711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6aedc1a-15bf-415c-a28a-56fa63898f90 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:34.784450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b6aedc1a-15bf-415c-a28a-56fa63898f90 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:34.931075 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b6aedc1a-15bf-415c-a28a-56fa63898f90 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:34.939283 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b6aedc1a-15bf-415c-a28a-56fa63898f90 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 200 len: 1678 microversion: 2.1 time: 0.178295 Oct 29 04:01:34.939864 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3525/7274] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:34 2022] GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:35.963764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5520a500-cf09-483c-882c-d1ed25457872 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:35.964375 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5520a500-cf09-483c-882c-d1ed25457872 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:35.971816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5520a500-cf09-483c-882c-d1ed25457872 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:35.972305 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5520a500-cf09-483c-882c-d1ed25457872 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:35.972778 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5520a500-cf09-483c-882c-d1ed25457872 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:35.973479 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5520a500-cf09-483c-882c-d1ed25457872 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:35.973933 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5520a500-cf09-483c-882c-d1ed25457872 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:35.974363 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5520a500-cf09-483c-882c-d1ed25457872 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:36.119561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5520a500-cf09-483c-882c-d1ed25457872 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:36.128216 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5520a500-cf09-483c-882c-d1ed25457872 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 200 len: 1678 microversion: 2.1 time: 0.168970 Oct 29 04:01:36.128830 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3750/7275] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:35 2022] GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:37.156023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9e3197d9-4c60-46d9-801e-c15835155f33 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:37.157071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9e3197d9-4c60-46d9-801e-c15835155f33 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:37.167135 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e3197d9-4c60-46d9-801e-c15835155f33 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:37.167638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e3197d9-4c60-46d9-801e-c15835155f33 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:37.168090 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e3197d9-4c60-46d9-801e-c15835155f33 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:37.168849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e3197d9-4c60-46d9-801e-c15835155f33 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:37.169315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e3197d9-4c60-46d9-801e-c15835155f33 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:37.169760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9e3197d9-4c60-46d9-801e-c15835155f33 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:37.305290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9e3197d9-4c60-46d9-801e-c15835155f33 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:37.313361 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9e3197d9-4c60-46d9-801e-c15835155f33 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 200 len: 1678 microversion: 2.1 time: 0.164129 Oct 29 04:01:37.313975 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3526/7276] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:37 2022] GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:38.351440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-000df4e7-6748-4699-ba62-ea2b6bc6bbec tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:38.352231 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-000df4e7-6748-4699-ba62-ea2b6bc6bbec tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:38.359381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-000df4e7-6748-4699-ba62-ea2b6bc6bbec tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:38.359865 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-000df4e7-6748-4699-ba62-ea2b6bc6bbec tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:38.360298 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-000df4e7-6748-4699-ba62-ea2b6bc6bbec tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:38.361022 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-000df4e7-6748-4699-ba62-ea2b6bc6bbec tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:38.361471 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-000df4e7-6748-4699-ba62-ea2b6bc6bbec tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:38.361889 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-000df4e7-6748-4699-ba62-ea2b6bc6bbec tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:38.520242 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-000df4e7-6748-4699-ba62-ea2b6bc6bbec tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:38.532025 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-000df4e7-6748-4699-ba62-ea2b6bc6bbec tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 200 len: 1678 microversion: 2.1 time: 0.187318 Oct 29 04:01:38.532943 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3751/7277] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:38 2022] GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 1678 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:39.559427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-aebb8fa0-50fe-4df4-9c44-578a8f65cd48 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:39.560033 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-aebb8fa0-50fe-4df4-9c44-578a8f65cd48 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:39.567197 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aebb8fa0-50fe-4df4-9c44-578a8f65cd48 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:39.567704 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aebb8fa0-50fe-4df4-9c44-578a8f65cd48 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:39.568146 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aebb8fa0-50fe-4df4-9c44-578a8f65cd48 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:39.568905 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aebb8fa0-50fe-4df4-9c44-578a8f65cd48 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:39.569357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aebb8fa0-50fe-4df4-9c44-578a8f65cd48 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:39.569802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aebb8fa0-50fe-4df4-9c44-578a8f65cd48 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:39.712459 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-aebb8fa0-50fe-4df4-9c44-578a8f65cd48 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:39.720480 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-aebb8fa0-50fe-4df4-9c44-578a8f65cd48 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 200 len: 1678 microversion: 2.1 time: 0.165145 Oct 29 04:01:39.721067 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3527/7278] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:39 2022] GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:40.745242 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-726400db-ac01-456e-ad41-7ce880db7685 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:40.745841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-726400db-ac01-456e-ad41-7ce880db7685 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:40.753166 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-726400db-ac01-456e-ad41-7ce880db7685 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:40.753648 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-726400db-ac01-456e-ad41-7ce880db7685 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:40.754087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-726400db-ac01-456e-ad41-7ce880db7685 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:40.754780 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-726400db-ac01-456e-ad41-7ce880db7685 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:40.755228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-726400db-ac01-456e-ad41-7ce880db7685 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:40.755652 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-726400db-ac01-456e-ad41-7ce880db7685 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:40.890925 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-726400db-ac01-456e-ad41-7ce880db7685 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:40.899403 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-726400db-ac01-456e-ad41-7ce880db7685 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 200 len: 1678 microversion: 2.1 time: 0.158561 Oct 29 04:01:40.899979 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3752/7279] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:40 2022] GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:41.926182 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-640eebf0-a789-4b6f-b285-792fb396f7f2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:41.926809 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-640eebf0-a789-4b6f-b285-792fb396f7f2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:41.935301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-640eebf0-a789-4b6f-b285-792fb396f7f2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:41.935831 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-640eebf0-a789-4b6f-b285-792fb396f7f2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:41.936281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-640eebf0-a789-4b6f-b285-792fb396f7f2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:41.937008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-640eebf0-a789-4b6f-b285-792fb396f7f2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:41.937489 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-640eebf0-a789-4b6f-b285-792fb396f7f2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:41.937928 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-640eebf0-a789-4b6f-b285-792fb396f7f2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:42.080397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-640eebf0-a789-4b6f-b285-792fb396f7f2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:42.088506 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-640eebf0-a789-4b6f-b285-792fb396f7f2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 200 len: 1678 microversion: 2.1 time: 0.168472 Oct 29 04:01:42.089122 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3528/7280] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:41 2022] GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:01:43.113053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-07c52fd3-dd5d-44f4-bc5f-32553e6f737c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:01:43.113655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-07c52fd3-dd5d-44f4-bc5f-32553e6f737c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:01:43.122117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07c52fd3-dd5d-44f4-bc5f-32553e6f737c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:43.122658 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07c52fd3-dd5d-44f4-bc5f-32553e6f737c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:43.123189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07c52fd3-dd5d-44f4-bc5f-32553e6f737c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:43.123961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07c52fd3-dd5d-44f4-bc5f-32553e6f737c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:01:43.124418 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07c52fd3-dd5d-44f4-bc5f-32553e6f737c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:01:43.124894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-07c52fd3-dd5d-44f4-bc5f-32553e6f737c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:01:43.260990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-07c52fd3-dd5d-44f4-bc5f-32553e6f737c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:01:43.269130 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-07c52fd3-dd5d-44f4-bc5f-32553e6f737c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 200 len: 1681 microversion: 2.1 time: 0.160268 Oct 29 04:01:43.269714 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3753/7281] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:01:43 2022] GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:02:07.502768 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5de6c64a-b56a-4948-824c-059116f2bb6a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:02:07.505400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5de6c64a-b56a-4948-824c-059116f2bb6a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:07.508332 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=12 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:02:07.509159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:02:07.516174 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5de6c64a-b56a-4948-824c-059116f2bb6a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:07.516698 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5de6c64a-b56a-4948-824c-059116f2bb6a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:07.517145 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5de6c64a-b56a-4948-824c-059116f2bb6a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:07.517862 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5de6c64a-b56a-4948-824c-059116f2bb6a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:07.518324 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5de6c64a-b56a-4948-824c-059116f2bb6a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:07.518757 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5de6c64a-b56a-4948-824c-059116f2bb6a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:07.582735 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5de6c64a-b56a-4948-824c-059116f2bb6a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096/action" status: 200 len: 69160 microversion: 2.1 time: 0.084441 Oct 29 04:02:07.583452 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3529/7282] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 04:02:07 2022] POST /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096/action => generated 69160 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 04:02:14.928825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9077402a-6654-4074-9143-bf962ca011cb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:14.929463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9077402a-6654-4074-9143-bf962ca011cb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:14.933453 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=14 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:02:14.934299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=40 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:02:14.935930 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-44e4f609-fcf0-48f8-8a92-a22794d64032 req-39c318ea-f220-4834-b1b4-6c411cbbfa97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7961c40d-e050-46b6-9453-f99b716f5096", "tag": "36db0316-4d4a-4ae9-ad05-abe32cdf5c14"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:02:14.939801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9077402a-6654-4074-9143-bf962ca011cb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:14.940411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9077402a-6654-4074-9143-bf962ca011cb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:14.940860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9077402a-6654-4074-9143-bf962ca011cb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:14.941584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9077402a-6654-4074-9143-bf962ca011cb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:14.942033 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9077402a-6654-4074-9143-bf962ca011cb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:14.942718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9077402a-6654-4074-9143-bf962ca011cb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:14.955913 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-44e4f609-fcf0-48f8-8a92-a22794d64032 req-39c318ea-f220-4834-b1b4-6c411cbbfa97 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:14.956654 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-44e4f609-fcf0-48f8-8a92-a22794d64032 req-39c318ea-f220-4834-b1b4-6c411cbbfa97 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:14.957302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-44e4f609-fcf0-48f8-8a92-a22794d64032 req-39c318ea-f220-4834-b1b4-6c411cbbfa97 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:14.969996 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-44e4f609-fcf0-48f8-8a92-a22794d64032 req-39c318ea-f220-4834-b1b4-6c411cbbfa97 service nova] Creating event network-changed:36db0316-4d4a-4ae9-ad05-abe32cdf5c14 for instance 7961c40d-e050-46b6-9453-f99b716f5096 on n-h2-862967-2 Oct 29 04:02:14.972323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9077402a-6654-4074-9143-bf962ca011cb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 04:02:14.976328 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-44e4f609-fcf0-48f8-8a92-a22794d64032 req-39c318ea-f220-4834-b1b4-6c411cbbfa97 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048978 Oct 29 04:02:14.977499 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3530/7283] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:02:15.060128 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9077402a-6654-4074-9143-bf962ca011cb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 204 len: 0 microversion: 2.1 time: 0.134215 Oct 29 04:02:15.060128 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3754/7284] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 04:02:14 2022] DELETE /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 04:02:15.070134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6fdc3e81-5ed1-472c-b757-17b48c2c15ea tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:15.072964 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6fdc3e81-5ed1-472c-b757-17b48c2c15ea tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:15.080029 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6fdc3e81-5ed1-472c-b757-17b48c2c15ea tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:15.080556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6fdc3e81-5ed1-472c-b757-17b48c2c15ea tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:15.081152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6fdc3e81-5ed1-472c-b757-17b48c2c15ea tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:15.082134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6fdc3e81-5ed1-472c-b757-17b48c2c15ea tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:15.082606 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6fdc3e81-5ed1-472c-b757-17b48c2c15ea tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:15.083045 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6fdc3e81-5ed1-472c-b757-17b48c2c15ea tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:15.246009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6fdc3e81-5ed1-472c-b757-17b48c2c15ea tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:02:15.254522 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6fdc3e81-5ed1-472c-b757-17b48c2c15ea tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 200 len: 1687 microversion: 2.1 time: 0.189555 Oct 29 04:02:15.255141 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3531/7285] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:02:15 2022] GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 1687 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:02:16.281621 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7867addd-bb11-4dde-a59e-ff709c5a6f58 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:16.282323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7867addd-bb11-4dde-a59e-ff709c5a6f58 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:16.290309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7867addd-bb11-4dde-a59e-ff709c5a6f58 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:16.290802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7867addd-bb11-4dde-a59e-ff709c5a6f58 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:16.291241 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7867addd-bb11-4dde-a59e-ff709c5a6f58 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:16.291945 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7867addd-bb11-4dde-a59e-ff709c5a6f58 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:16.292394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7867addd-bb11-4dde-a59e-ff709c5a6f58 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:16.292856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7867addd-bb11-4dde-a59e-ff709c5a6f58 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:16.435698 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7867addd-bb11-4dde-a59e-ff709c5a6f58 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:02:16.443741 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7867addd-bb11-4dde-a59e-ff709c5a6f58 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 200 len: 1687 microversion: 2.1 time: 0.166429 Oct 29 04:02:16.444350 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3755/7286] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:02:16 2022] GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:02:17.054129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-fc1031d0-0b66-4faf-bc3e-2fc66c1bd077 req-b6a985d1-e895-404b-abff-d916b77dc793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7961c40d-e050-46b6-9453-f99b716f5096", "name": "network-vif-deleted", "tag": "36db0316-4d4a-4ae9-ad05-abe32cdf5c14"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:02:17.066018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-fc1031d0-0b66-4faf-bc3e-2fc66c1bd077 req-b6a985d1-e895-404b-abff-d916b77dc793 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:17.066510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-fc1031d0-0b66-4faf-bc3e-2fc66c1bd077 req-b6a985d1-e895-404b-abff-d916b77dc793 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:17.066963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-fc1031d0-0b66-4faf-bc3e-2fc66c1bd077 req-b6a985d1-e895-404b-abff-d916b77dc793 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:17.078460 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-fc1031d0-0b66-4faf-bc3e-2fc66c1bd077 req-b6a985d1-e895-404b-abff-d916b77dc793 service nova] Creating event network-vif-deleted:36db0316-4d4a-4ae9-ad05-abe32cdf5c14 for instance 7961c40d-e050-46b6-9453-f99b716f5096 on n-h2-862967-2 Oct 29 04:02:17.083440 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-fc1031d0-0b66-4faf-bc3e-2fc66c1bd077 req-b6a985d1-e895-404b-abff-d916b77dc793 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089426 Oct 29 04:02:17.084055 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3532/7287] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:02:17.467623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e9035845-cb53-4e3b-84df-c5defd408ac4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:17.468236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e9035845-cb53-4e3b-84df-c5defd408ac4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:17.476092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9035845-cb53-4e3b-84df-c5defd408ac4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:17.476643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9035845-cb53-4e3b-84df-c5defd408ac4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:17.477079 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9035845-cb53-4e3b-84df-c5defd408ac4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:17.477812 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9035845-cb53-4e3b-84df-c5defd408ac4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:17.478262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9035845-cb53-4e3b-84df-c5defd408ac4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:17.478759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9035845-cb53-4e3b-84df-c5defd408ac4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:17.522292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9035845-cb53-4e3b-84df-c5defd408ac4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:17.522903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9035845-cb53-4e3b-84df-c5defd408ac4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:17.523497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9035845-cb53-4e3b-84df-c5defd408ac4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:17.524087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-e9035845-cb53-4e3b-84df-c5defd408ac4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lazy-loading 'fault' on Instance uuid 7961c40d-e050-46b6-9453-f99b716f5096 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 04:02:17.567194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e9035845-cb53-4e3b-84df-c5defd408ac4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:02:17.574523 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e9035845-cb53-4e3b-84df-c5defd408ac4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 200 len: 1357 microversion: 2.1 time: 0.110915 Oct 29 04:02:17.575114 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3756/7288] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:02:17 2022] GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 1357 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:02:18.600373 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9c471932-4899-43f2-b760-74724f01884e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:18.601141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9c471932-4899-43f2-b760-74724f01884e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 7961c40d-e050-46b6-9453-f99b716f5096] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:18.608065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c471932-4899-43f2-b760-74724f01884e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:18.608562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c471932-4899-43f2-b760-74724f01884e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:18.609055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c471932-4899-43f2-b760-74724f01884e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:18.609764 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c471932-4899-43f2-b760-74724f01884e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:18.610241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c471932-4899-43f2-b760-74724f01884e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:18.610689 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c471932-4899-43f2-b760-74724f01884e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:18.625211 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-9c471932-4899-43f2-b760-74724f01884e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] HTTP exception thrown: Instance 7961c40d-e050-46b6-9453-f99b716f5096 could not be found. Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9c471932-4899-43f2-b760-74724f01884e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Request method failure captured: Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 HTTP/1.1 Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKUo0_mrT7RmIg7xwBr8IFILx8owR6S_7fbkYMDM3yKtVViQvdfHhgImK2tLNoi-DKhagj3xbECEfbniUg9pO0t5aY8w58qiHmIe3llBDaRK81PNEp7hhgTWe4zv3Mc__1xDWYdZL84JZ9C1u9d6A3xFbzEWOXw9Pdm2mYWXRVUQcjw Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 6db83678d78d49ff9768ba55d1a7d70d Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2052576324 Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6db83678d78d49ff9768ba55d1a7d70d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6db83678d78d49ff9768ba55d1a7d70d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6db83678d78d49ff9768ba55d1a7d70d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6db83678d78d49ff9768ba55d1a7d70d"}]}] Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2052576324 Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 6db83678d78d49ff9768ba55d1a7d70d Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2052576324 Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestNetworkAdvancedServerOps-2052576324-project Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: f75948d4d49e47f69900a9b8ece27999 Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2052576324-project Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 7961c40d-e050-46b6-9453-f99b716f5096 could not be found. Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '7961c40d-e050-46b6-9453-f99b716f5096'} Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7961c40d-e050-46b6-9453-f99b716f5096 could not be found. Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7961c40d-e050-46b6-9453-f99b716f5096 could not be found. Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 04:02:18.626998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:02:18.631954 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 04:02:18.631954 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:02:18.631954 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:02:18.631954 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:02:18.631954 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 04:02:18.631954 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 04:02:18.631954 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7961c40d-e050-46b6-9453-f99b716f5096 could not be found. Oct 29 04:02:18.631954 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 04:02:18.631954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9c471932-4899-43f2-b760-74724f01884e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Returning 404 to user: Instance 7961c40d-e050-46b6-9453-f99b716f5096 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 04:02:18.631954 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9c471932-4899-43f2-b760-74724f01884e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096" status: 404 len: 111 microversion: 2.1 time: 0.033830 Oct 29 04:02:18.631954 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3533/7289] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:02:18 2022] GET /compute/v2.1/servers/7961c40d-e050-46b6-9453-f99b716f5096 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 04:02:22.003381 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-62020f9e-a424-4400-bbed-89aca890452f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '.version_select at 0x7ff052afbee0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:22.030361 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-62020f9e-a424-4400-bbed-89aca890452f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1001871511" status: 202 len: 0 microversion: 2.1 time: 0.030988 Oct 29 04:02:22.030865 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3757/7290] 10.222.0.46 () {58 vars in 1284 bytes} [Sat Oct 29 04:02:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1001871511 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 04:02:22.058036 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-38a15bec-90a0-4fec-b3c8-875e15fa4b5e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'create', calling method: .version_select at 0x7ff053a9c040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2034526575", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOODZMOPu/rvFpaiIpNDwWgPSigrJ/S1GFWQkbGgwFSCFI6cnFuVwZe/zqKa0RPOYZPgdA/7kltAsstf4X8uL9PSbMmOACeQeJ/1yQ9kW6aiek45w0K7Y/Du5SNcUJnNMg=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:02:22.075806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-38a15bec-90a0-4fec-b3c8-875e15fa4b5e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Getting quotas for project 6db83678d78d49ff9768ba55d1a7d70d. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:02:22.081307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-38a15bec-90a0-4fec-b3c8-875e15fa4b5e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Getting quotas for user f75948d4d49e47f69900a9b8ece27999 and project 6db83678d78d49ff9768ba55d1a7d70d. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:02:22.108736 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-38a15bec-90a0-4fec-b3c8-875e15fa4b5e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055001 Oct 29 04:02:22.109474 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3534/7291] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 04:02:22 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:02:27.832579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7afb9d2d-1cdf-4b33-a621-0cc6bce17937 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1070703199", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "0f77ba43-8fb2-468c-b915-86682d2e3cf6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2034526575", "security_groups": [{"name": "tempest-secgroup-smoke-542783015"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:02:27.850448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:02:27.979263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-7afb9d2d-1cdf-4b33-a621-0cc6bce17937 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] validate_networks() for [('0f77ba43-8fb2-468c-b915-86682d2e3cf6', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 04:02:28.422281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-7afb9d2d-1cdf-4b33-a621-0cc6bce17937 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 04:02:28.422707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-7afb9d2d-1cdf-4b33-a621-0cc6bce17937 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 04:02:28.423183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-7afb9d2d-1cdf-4b33-a621-0cc6bce17937 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 04:02:28.423596 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-7afb9d2d-1cdf-4b33-a621-0cc6bce17937 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 04:02:28.424025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-7afb9d2d-1cdf-4b33-a621-0cc6bce17937 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 04:02:28.433206 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7afb9d2d-1cdf-4b33-a621-0cc6bce17937 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:28.433695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7afb9d2d-1cdf-4b33-a621-0cc6bce17937 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:28.434135 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7afb9d2d-1cdf-4b33-a621-0cc6bce17937 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:28.434872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7afb9d2d-1cdf-4b33-a621-0cc6bce17937 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:28.435331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7afb9d2d-1cdf-4b33-a621-0cc6bce17937 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:28.435759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7afb9d2d-1cdf-4b33-a621-0cc6bce17937 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:28.452926 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-7afb9d2d-1cdf-4b33-a621-0cc6bce17937 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Getting quotas for project 6db83678d78d49ff9768ba55d1a7d70d. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:02:28.458997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-7afb9d2d-1cdf-4b33-a621-0cc6bce17937 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Getting quotas for user f75948d4d49e47f69900a9b8ece27999 and project 6db83678d78d49ff9768ba55d1a7d70d. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:02:28.471644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7afb9d2d-1cdf-4b33-a621-0cc6bce17937 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 04:02:28.474096 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7afb9d2d-1cdf-4b33-a621-0cc6bce17937 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 04:02:28.524334 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7afb9d2d-1cdf-4b33-a621-0cc6bce17937 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.697721 Oct 29 04:02:28.531614 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3758/7292] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 04:02:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 04:02:28.536460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-54696a06-e4fe-4c43-848b-086e31e9513a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:28.537149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-54696a06-e4fe-4c43-848b-086e31e9513a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:28.597173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-54696a06-e4fe-4c43-848b-086e31e9513a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:02:28.604970 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-54696a06-e4fe-4c43-848b-086e31e9513a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1267 microversion: 2.1 time: 0.072461 Oct 29 04:02:28.605622 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3535/7293] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:02:28 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1267 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 04:02:29.629998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-13a994f5-8c18-4089-b3d4-10f6cc8f67f6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:29.632814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-13a994f5-8c18-4089-b3d4-10f6cc8f67f6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:29.642721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13a994f5-8c18-4089-b3d4-10f6cc8f67f6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:29.643526 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13a994f5-8c18-4089-b3d4-10f6cc8f67f6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:29.644194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13a994f5-8c18-4089-b3d4-10f6cc8f67f6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:29.645196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13a994f5-8c18-4089-b3d4-10f6cc8f67f6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:29.646874 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13a994f5-8c18-4089-b3d4-10f6cc8f67f6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:29.648232 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-13a994f5-8c18-4089-b3d4-10f6cc8f67f6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:29.736288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-13a994f5-8c18-4089-b3d4-10f6cc8f67f6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:02:29.749800 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-13a994f5-8c18-4089-b3d4-10f6cc8f67f6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1337 microversion: 2.1 time: 0.124555 Oct 29 04:02:29.750806 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3759/7294] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:02:29 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1337 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 04:02:30.774485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9431caaa-2f82-4658-8a84-62eda52d43c4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:30.775153 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9431caaa-2f82-4658-8a84-62eda52d43c4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:30.778406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=16 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:02:30.784113 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9431caaa-2f82-4658-8a84-62eda52d43c4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:30.784702 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9431caaa-2f82-4658-8a84-62eda52d43c4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:30.785158 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9431caaa-2f82-4658-8a84-62eda52d43c4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:30.785888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9431caaa-2f82-4658-8a84-62eda52d43c4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:30.786358 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9431caaa-2f82-4658-8a84-62eda52d43c4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:30.786798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9431caaa-2f82-4658-8a84-62eda52d43c4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:30.930625 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9431caaa-2f82-4658-8a84-62eda52d43c4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:02:30.938759 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9431caaa-2f82-4658-8a84-62eda52d43c4 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1392 microversion: 2.1 time: 0.168423 Oct 29 04:02:30.939878 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3536/7295] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:02:30 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:02:31.189565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-15fa34c7-dead-40ae-bd6a-da8d97939281 req-61714c83-5c2f-4093-a69a-8fa9754d83fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3de6c6d7-a88d-4c21-8974-f9ee5625f528", "tag": "2c21a374-5241-4954-9f98-b7c08a1a96b0"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:02:31.201759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-15fa34c7-dead-40ae-bd6a-da8d97939281 req-61714c83-5c2f-4093-a69a-8fa9754d83fa service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:31.202549 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-15fa34c7-dead-40ae-bd6a-da8d97939281 req-61714c83-5c2f-4093-a69a-8fa9754d83fa service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:31.203197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-15fa34c7-dead-40ae-bd6a-da8d97939281 req-61714c83-5c2f-4093-a69a-8fa9754d83fa service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:31.215450 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-15fa34c7-dead-40ae-bd6a-da8d97939281 req-61714c83-5c2f-4093-a69a-8fa9754d83fa service nova] Creating event network-changed:2c21a374-5241-4954-9f98-b7c08a1a96b0 for instance 3de6c6d7-a88d-4c21-8974-f9ee5625f528 on n-h2-862967-2 Oct 29 04:02:31.222487 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-15fa34c7-dead-40ae-bd6a-da8d97939281 req-61714c83-5c2f-4093-a69a-8fa9754d83fa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036498 Oct 29 04:02:31.223121 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3760/7296] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:02:31.963043 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1a86631b-ab00-416c-a72d-e450cb4bf93e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:31.963660 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1a86631b-ab00-416c-a72d-e450cb4bf93e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:31.971118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a86631b-ab00-416c-a72d-e450cb4bf93e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:31.971549 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a86631b-ab00-416c-a72d-e450cb4bf93e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:31.972221 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a86631b-ab00-416c-a72d-e450cb4bf93e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:31.973002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a86631b-ab00-416c-a72d-e450cb4bf93e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:31.973480 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a86631b-ab00-416c-a72d-e450cb4bf93e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:31.973920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a86631b-ab00-416c-a72d-e450cb4bf93e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:32.120001 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1a86631b-ab00-416c-a72d-e450cb4bf93e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:02:32.128553 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1a86631b-ab00-416c-a72d-e450cb4bf93e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1392 microversion: 2.1 time: 0.169606 Oct 29 04:02:32.129207 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3537/7297] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:02:31 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:02:33.153643 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f06eb0e2-2551-46e4-9df8-97968ccb735e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:33.154349 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f06eb0e2-2551-46e4-9df8-97968ccb735e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:33.161264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f06eb0e2-2551-46e4-9df8-97968ccb735e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:33.161780 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f06eb0e2-2551-46e4-9df8-97968ccb735e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:33.162222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f06eb0e2-2551-46e4-9df8-97968ccb735e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:33.162922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f06eb0e2-2551-46e4-9df8-97968ccb735e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:33.163377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f06eb0e2-2551-46e4-9df8-97968ccb735e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:33.163803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f06eb0e2-2551-46e4-9df8-97968ccb735e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:33.302147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f06eb0e2-2551-46e4-9df8-97968ccb735e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:02:33.313848 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f06eb0e2-2551-46e4-9df8-97968ccb735e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1392 microversion: 2.1 time: 0.165151 Oct 29 04:02:33.314628 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3761/7298] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:02:33 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:02:34.341719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-aa8127e4-aa99-408a-9c3d-08dc1ab2c600 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:34.342500 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-aa8127e4-aa99-408a-9c3d-08dc1ab2c600 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:34.352982 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa8127e4-aa99-408a-9c3d-08dc1ab2c600 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:34.353691 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa8127e4-aa99-408a-9c3d-08dc1ab2c600 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:34.354325 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa8127e4-aa99-408a-9c3d-08dc1ab2c600 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:34.355334 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa8127e4-aa99-408a-9c3d-08dc1ab2c600 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:34.355994 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa8127e4-aa99-408a-9c3d-08dc1ab2c600 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:34.356624 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa8127e4-aa99-408a-9c3d-08dc1ab2c600 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:34.499269 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-aa8127e4-aa99-408a-9c3d-08dc1ab2c600 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:02:34.508113 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-aa8127e4-aa99-408a-9c3d-08dc1ab2c600 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1392 microversion: 2.1 time: 0.172351 Oct 29 04:02:34.508787 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3538/7299] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:02:34 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:02:35.536565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fdb45a7b-446c-4834-81ba-60be768a0fbb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:35.537184 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fdb45a7b-446c-4834-81ba-60be768a0fbb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:35.544479 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fdb45a7b-446c-4834-81ba-60be768a0fbb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:35.545012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fdb45a7b-446c-4834-81ba-60be768a0fbb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:35.545420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fdb45a7b-446c-4834-81ba-60be768a0fbb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:35.546112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fdb45a7b-446c-4834-81ba-60be768a0fbb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:35.546560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fdb45a7b-446c-4834-81ba-60be768a0fbb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:35.546983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fdb45a7b-446c-4834-81ba-60be768a0fbb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:35.683177 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fdb45a7b-446c-4834-81ba-60be768a0fbb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:02:35.691382 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fdb45a7b-446c-4834-81ba-60be768a0fbb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1392 microversion: 2.1 time: 0.159038 Oct 29 04:02:35.691963 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3762/7300] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:02:35 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:02:36.714858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-be6f0f59-2e6a-4bb1-8af4-57bbfd1fd02f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:36.715772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-be6f0f59-2e6a-4bb1-8af4-57bbfd1fd02f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:36.723073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be6f0f59-2e6a-4bb1-8af4-57bbfd1fd02f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:36.723802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be6f0f59-2e6a-4bb1-8af4-57bbfd1fd02f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:36.724398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be6f0f59-2e6a-4bb1-8af4-57bbfd1fd02f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:36.725379 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be6f0f59-2e6a-4bb1-8af4-57bbfd1fd02f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:36.725851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be6f0f59-2e6a-4bb1-8af4-57bbfd1fd02f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:36.726392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-be6f0f59-2e6a-4bb1-8af4-57bbfd1fd02f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:36.799356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-4cf1ff58-1efc-41c3-9b69-3a15fc016eb8 req-cf24e0d6-3b40-47b4-a4a8-747bfee98d3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de6c6d7-a88d-4c21-8974-f9ee5625f528", "name": "network-vif-plugged", "status": "completed", "tag": "2c21a374-5241-4954-9f98-b7c08a1a96b0"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:02:36.813023 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4cf1ff58-1efc-41c3-9b69-3a15fc016eb8 req-cf24e0d6-3b40-47b4-a4a8-747bfee98d3f service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:36.813474 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4cf1ff58-1efc-41c3-9b69-3a15fc016eb8 req-cf24e0d6-3b40-47b4-a4a8-747bfee98d3f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:36.813915 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4cf1ff58-1efc-41c3-9b69-3a15fc016eb8 req-cf24e0d6-3b40-47b4-a4a8-747bfee98d3f service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:36.829732 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-4cf1ff58-1efc-41c3-9b69-3a15fc016eb8 req-cf24e0d6-3b40-47b4-a4a8-747bfee98d3f service nova] Creating event network-vif-plugged:2c21a374-5241-4954-9f98-b7c08a1a96b0 for instance 3de6c6d7-a88d-4c21-8974-f9ee5625f528 on n-h2-862967-2 Oct 29 04:02:36.836161 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-4cf1ff58-1efc-41c3-9b69-3a15fc016eb8 req-cf24e0d6-3b40-47b4-a4a8-747bfee98d3f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040925 Oct 29 04:02:36.837686 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3763/7301] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 04:02:36.876242 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-be6f0f59-2e6a-4bb1-8af4-57bbfd1fd02f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:02:36.885230 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-be6f0f59-2e6a-4bb1-8af4-57bbfd1fd02f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1392 microversion: 2.1 time: 0.174499 Oct 29 04:02:36.885923 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3539/7302] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:02:36 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:02:37.913890 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6ff71dea-1681-40ae-b77e-bcd5ba41370c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:37.914621 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6ff71dea-1681-40ae-b77e-bcd5ba41370c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:37.921278 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ff71dea-1681-40ae-b77e-bcd5ba41370c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:37.921761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ff71dea-1681-40ae-b77e-bcd5ba41370c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:37.922190 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ff71dea-1681-40ae-b77e-bcd5ba41370c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:37.922891 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ff71dea-1681-40ae-b77e-bcd5ba41370c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:37.923347 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ff71dea-1681-40ae-b77e-bcd5ba41370c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:37.923770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6ff71dea-1681-40ae-b77e-bcd5ba41370c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:38.063262 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6ff71dea-1681-40ae-b77e-bcd5ba41370c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:02:38.071337 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6ff71dea-1681-40ae-b77e-bcd5ba41370c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1392 microversion: 2.1 time: 0.164927 Oct 29 04:02:38.071940 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3764/7303] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:02:37 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:02:39.095944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b19f3be0-11b5-42b4-b49b-72216cfc4189 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:39.096609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b19f3be0-11b5-42b4-b49b-72216cfc4189 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:39.099439 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:02:39.100106 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:02:39.108655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b19f3be0-11b5-42b4-b49b-72216cfc4189 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:39.109465 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b19f3be0-11b5-42b4-b49b-72216cfc4189 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:39.110261 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b19f3be0-11b5-42b4-b49b-72216cfc4189 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:39.111434 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b19f3be0-11b5-42b4-b49b-72216cfc4189 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:39.112256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b19f3be0-11b5-42b4-b49b-72216cfc4189 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:39.112986 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b19f3be0-11b5-42b4-b49b-72216cfc4189 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:39.250868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b19f3be0-11b5-42b4-b49b-72216cfc4189 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:02:39.259137 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b19f3be0-11b5-42b4-b49b-72216cfc4189 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1565 microversion: 2.1 time: 0.167303 Oct 29 04:02:39.259724 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3540/7304] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:02:39 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:02:39.284692 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5015b812-0671-41be-93a4-6c9b999e029e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:39.285308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5015b812-0671-41be-93a4-6c9b999e029e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:39.287641 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:02:39.288299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:02:39.295155 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5015b812-0671-41be-93a4-6c9b999e029e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:39.295644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5015b812-0671-41be-93a4-6c9b999e029e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:39.296082 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5015b812-0671-41be-93a4-6c9b999e029e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:39.296813 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5015b812-0671-41be-93a4-6c9b999e029e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:39.297269 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5015b812-0671-41be-93a4-6c9b999e029e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:39.297695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5015b812-0671-41be-93a4-6c9b999e029e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:39.441176 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5015b812-0671-41be-93a4-6c9b999e029e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:02:39.451915 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5015b812-0671-41be-93a4-6c9b999e029e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1565 microversion: 2.1 time: 0.173278 Oct 29 04:02:39.452709 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3765/7305] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:02:39 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:02:41.656009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-33285dc9-7a08-423e-8918-e8e144182c58 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:02:41.656682 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-33285dc9-7a08-423e-8918-e8e144182c58 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:02:41.663990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-57471b54-dd80-4c48-9dae-a7724ca188cc req-3cd4308f-3deb-4aa9-b3a0-821188c90598 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3de6c6d7-a88d-4c21-8974-f9ee5625f528", "tag": "2c21a374-5241-4954-9f98-b7c08a1a96b0"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:02:41.676930 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33285dc9-7a08-423e-8918-e8e144182c58 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:41.677902 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33285dc9-7a08-423e-8918-e8e144182c58 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:41.678638 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33285dc9-7a08-423e-8918-e8e144182c58 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:41.679565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-57471b54-dd80-4c48-9dae-a7724ca188cc req-3cd4308f-3deb-4aa9-b3a0-821188c90598 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:41.679966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33285dc9-7a08-423e-8918-e8e144182c58 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:02:41.680397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-57471b54-dd80-4c48-9dae-a7724ca188cc req-3cd4308f-3deb-4aa9-b3a0-821188c90598 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:41.680949 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33285dc9-7a08-423e-8918-e8e144182c58 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:02:41.681071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-57471b54-dd80-4c48-9dae-a7724ca188cc req-3cd4308f-3deb-4aa9-b3a0-821188c90598 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:41.681734 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-33285dc9-7a08-423e-8918-e8e144182c58 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:02:41.696119 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-57471b54-dd80-4c48-9dae-a7724ca188cc req-3cd4308f-3deb-4aa9-b3a0-821188c90598 service nova] Creating event network-changed:2c21a374-5241-4954-9f98-b7c08a1a96b0 for instance 3de6c6d7-a88d-4c21-8974-f9ee5625f528 on n-h2-862967-2 Oct 29 04:02:41.702208 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-57471b54-dd80-4c48-9dae-a7724ca188cc req-3cd4308f-3deb-4aa9-b3a0-821188c90598 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042796 Oct 29 04:02:41.703808 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3766/7306] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:02:41.834814 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-33285dc9-7a08-423e-8918-e8e144182c58 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:02:41.842651 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-33285dc9-7a08-423e-8918-e8e144182c58 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1565 microversion: 2.1 time: 0.190660 Oct 29 04:02:41.843241 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3541/7307] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:02:41 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1565 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:03.146318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:03:03.147100 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=38 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:03:03.151386 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d6b3dfc0-1512-4a1a-998f-05c00edb331d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:03:03.153763 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d6b3dfc0-1512-4a1a-998f-05c00edb331d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:03.162030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6b3dfc0-1512-4a1a-998f-05c00edb331d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:03.162496 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6b3dfc0-1512-4a1a-998f-05c00edb331d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:03.162946 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6b3dfc0-1512-4a1a-998f-05c00edb331d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:03.163663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6b3dfc0-1512-4a1a-998f-05c00edb331d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:03.164131 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6b3dfc0-1512-4a1a-998f-05c00edb331d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:03.164596 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d6b3dfc0-1512-4a1a-998f-05c00edb331d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:03.216035 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d6b3dfc0-1512-4a1a-998f-05c00edb331d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528/action" status: 200 len: 24564 microversion: 2.1 time: 0.071669 Oct 29 04:03:03.216722 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3767/7308] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 04:03:03 2022] POST /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528/action => generated 24564 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 04:03:09.630581 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-77cc106f-9416-4347-8d11-3e0c03e25f17 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:03:09.633181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-77cc106f-9416-4347-8d11-3e0c03e25f17 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:09.635893 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:03:09.636666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=36 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:03:09.644032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77cc106f-9416-4347-8d11-3e0c03e25f17 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:09.644672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77cc106f-9416-4347-8d11-3e0c03e25f17 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:09.645208 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77cc106f-9416-4347-8d11-3e0c03e25f17 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:09.646135 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77cc106f-9416-4347-8d11-3e0c03e25f17 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:09.646686 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77cc106f-9416-4347-8d11-3e0c03e25f17 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:09.647264 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-77cc106f-9416-4347-8d11-3e0c03e25f17 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:09.752728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-77cc106f-9416-4347-8d11-3e0c03e25f17 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:09.758954 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-77cc106f-9416-4347-8d11-3e0c03e25f17 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Old instance type m1.heat2, new instance type m1.heat {{(pid=127125) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 29 04:03:09.765999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-77cc106f-9416-4347-8d11-3e0c03e25f17 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 04:03:09.766430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-77cc106f-9416-4347-8d11-3e0c03e25f17 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 04:03:09.766939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-77cc106f-9416-4347-8d11-3e0c03e25f17 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 04:03:09.767355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-77cc106f-9416-4347-8d11-3e0c03e25f17 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 04:03:09.767778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-77cc106f-9416-4347-8d11-3e0c03e25f17 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 04:03:09.843279 n-d-862967-2 devstack@n-api.service[127125]: ERROR oslo.messaging._drivers.impl_rabbit [None req-77cc106f-9416-4347-8d11-3e0c03e25f17 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [fde29612-e007-4943-97f0-67003e51b7be] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 04:03:10.851783 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [None req-77cc106f-9416-4347-8d11-3e0c03e25f17 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [fde29612-e007-4943-97f0-67003e51b7be] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 40682. Oct 29 04:03:10.856176 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-77cc106f-9416-4347-8d11-3e0c03e25f17 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528/action" status: 202 len: 0 microversion: 2.1 time: 1.230088 Oct 29 04:03:10.857033 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3542/7309] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 04:03:09 2022] POST /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528/action => generated 0 bytes in 1232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:03:10.866938 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-41d5a22e-0a9a-4f67-add0-a2ec52bd13f7 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:10.867636 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-41d5a22e-0a9a-4f67-add0-a2ec52bd13f7 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:10.875511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41d5a22e-0a9a-4f67-add0-a2ec52bd13f7 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:10.875997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41d5a22e-0a9a-4f67-add0-a2ec52bd13f7 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:10.876433 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41d5a22e-0a9a-4f67-add0-a2ec52bd13f7 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:10.877151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41d5a22e-0a9a-4f67-add0-a2ec52bd13f7 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:10.877609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41d5a22e-0a9a-4f67-add0-a2ec52bd13f7 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:10.878197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-41d5a22e-0a9a-4f67-add0-a2ec52bd13f7 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:11.057571 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-41d5a22e-0a9a-4f67-add0-a2ec52bd13f7 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:11.071603 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-41d5a22e-0a9a-4f67-add0-a2ec52bd13f7 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1692 microversion: 2.1 time: 0.209488 Oct 29 04:03:11.072234 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3768/7310] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:10 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1692 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:12.098693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8c530a82-3f83-48fa-bd89-1d263896b9c5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:12.099280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8c530a82-3f83-48fa-bd89-1d263896b9c5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:12.105941 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c530a82-3f83-48fa-bd89-1d263896b9c5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:12.106436 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c530a82-3f83-48fa-bd89-1d263896b9c5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:12.106878 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c530a82-3f83-48fa-bd89-1d263896b9c5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:12.107597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c530a82-3f83-48fa-bd89-1d263896b9c5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:12.108061 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c530a82-3f83-48fa-bd89-1d263896b9c5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:12.108496 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8c530a82-3f83-48fa-bd89-1d263896b9c5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:12.244997 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8c530a82-3f83-48fa-bd89-1d263896b9c5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:12.252861 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8c530a82-3f83-48fa-bd89-1d263896b9c5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1692 microversion: 2.1 time: 0.161496 Oct 29 04:03:12.253525 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3543/7311] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:12 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:13.277999 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7754bc0e-5330-4769-8a72-f9e6df88b116 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:13.278758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7754bc0e-5330-4769-8a72-f9e6df88b116 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:13.287068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7754bc0e-5330-4769-8a72-f9e6df88b116 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:13.287561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7754bc0e-5330-4769-8a72-f9e6df88b116 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:13.288005 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7754bc0e-5330-4769-8a72-f9e6df88b116 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:13.288756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7754bc0e-5330-4769-8a72-f9e6df88b116 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:13.289194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7754bc0e-5330-4769-8a72-f9e6df88b116 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:13.289648 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7754bc0e-5330-4769-8a72-f9e6df88b116 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:13.433531 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7754bc0e-5330-4769-8a72-f9e6df88b116 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:13.442161 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7754bc0e-5330-4769-8a72-f9e6df88b116 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1697 microversion: 2.1 time: 0.168126 Oct 29 04:03:13.442673 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3769/7312] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:13 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:14.468307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-50119e19-c709-40a4-9241-f630d80ac5e1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:14.468905 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-50119e19-c709-40a4-9241-f630d80ac5e1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:14.477386 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50119e19-c709-40a4-9241-f630d80ac5e1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:14.478028 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50119e19-c709-40a4-9241-f630d80ac5e1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:14.478597 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50119e19-c709-40a4-9241-f630d80ac5e1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:14.479713 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50119e19-c709-40a4-9241-f630d80ac5e1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:14.480366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50119e19-c709-40a4-9241-f630d80ac5e1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:14.480991 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-50119e19-c709-40a4-9241-f630d80ac5e1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:14.631654 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-50119e19-c709-40a4-9241-f630d80ac5e1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:14.644157 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-50119e19-c709-40a4-9241-f630d80ac5e1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1697 microversion: 2.1 time: 0.180533 Oct 29 04:03:14.644785 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3544/7313] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:14 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1697 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:15.667636 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a742222d-fcf0-4829-b2cf-8af099b08473 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:15.668243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a742222d-fcf0-4829-b2cf-8af099b08473 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:15.675634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a742222d-fcf0-4829-b2cf-8af099b08473 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:15.676126 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a742222d-fcf0-4829-b2cf-8af099b08473 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:15.676561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a742222d-fcf0-4829-b2cf-8af099b08473 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:15.677299 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a742222d-fcf0-4829-b2cf-8af099b08473 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:15.677756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a742222d-fcf0-4829-b2cf-8af099b08473 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:15.678188 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a742222d-fcf0-4829-b2cf-8af099b08473 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:15.822053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a742222d-fcf0-4829-b2cf-8af099b08473 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:15.830902 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a742222d-fcf0-4829-b2cf-8af099b08473 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1697 microversion: 2.1 time: 0.167200 Oct 29 04:03:15.831673 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3770/7314] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:15 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:16.858527 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-23e5df14-1bc4-47b0-ac6d-7e017ef2a8f3 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:16.859273 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-23e5df14-1bc4-47b0-ac6d-7e017ef2a8f3 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:16.868125 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23e5df14-1bc4-47b0-ac6d-7e017ef2a8f3 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:16.868653 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23e5df14-1bc4-47b0-ac6d-7e017ef2a8f3 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:16.869097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23e5df14-1bc4-47b0-ac6d-7e017ef2a8f3 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:16.869803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23e5df14-1bc4-47b0-ac6d-7e017ef2a8f3 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:16.870290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23e5df14-1bc4-47b0-ac6d-7e017ef2a8f3 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:16.870711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23e5df14-1bc4-47b0-ac6d-7e017ef2a8f3 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:17.010188 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-23e5df14-1bc4-47b0-ac6d-7e017ef2a8f3 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:17.019119 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-23e5df14-1bc4-47b0-ac6d-7e017ef2a8f3 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1697 microversion: 2.1 time: 0.166261 Oct 29 04:03:17.019699 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3545/7315] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:16 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:18.045480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-25e21319-b243-42f1-862f-3fb4e94cc52a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:18.046201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-25e21319-b243-42f1-862f-3fb4e94cc52a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:18.055842 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25e21319-b243-42f1-862f-3fb4e94cc52a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:18.056503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25e21319-b243-42f1-862f-3fb4e94cc52a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:18.057141 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25e21319-b243-42f1-862f-3fb4e94cc52a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:18.058089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25e21319-b243-42f1-862f-3fb4e94cc52a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:18.058709 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25e21319-b243-42f1-862f-3fb4e94cc52a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:18.059285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-25e21319-b243-42f1-862f-3fb4e94cc52a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:18.203548 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-25e21319-b243-42f1-862f-3fb4e94cc52a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:18.212786 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-25e21319-b243-42f1-862f-3fb4e94cc52a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1697 microversion: 2.1 time: 0.172786 Oct 29 04:03:18.213363 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3771/7316] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:18 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1697 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:19.247160 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d3f1771c-c468-44e4-829c-768502161bf1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:19.247992 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d3f1771c-c468-44e4-829c-768502161bf1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:19.257165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d3f1771c-c468-44e4-829c-768502161bf1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:19.257819 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d3f1771c-c468-44e4-829c-768502161bf1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:19.258413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d3f1771c-c468-44e4-829c-768502161bf1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:19.259498 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d3f1771c-c468-44e4-829c-768502161bf1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:19.260117 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d3f1771c-c468-44e4-829c-768502161bf1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:19.260735 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d3f1771c-c468-44e4-829c-768502161bf1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:19.400464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d3f1771c-c468-44e4-829c-768502161bf1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:19.408697 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d3f1771c-c468-44e4-829c-768502161bf1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1697 microversion: 2.1 time: 0.166690 Oct 29 04:03:19.409317 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3546/7317] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:19 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:20.436698 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b67604aa-4abb-4939-913e-4eedd6f1dd7b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:20.437657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b67604aa-4abb-4939-913e-4eedd6f1dd7b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:20.448850 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b67604aa-4abb-4939-913e-4eedd6f1dd7b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:20.449659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b67604aa-4abb-4939-913e-4eedd6f1dd7b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:20.450378 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b67604aa-4abb-4939-913e-4eedd6f1dd7b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:20.451521 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b67604aa-4abb-4939-913e-4eedd6f1dd7b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:20.452271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b67604aa-4abb-4939-913e-4eedd6f1dd7b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:20.453019 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b67604aa-4abb-4939-913e-4eedd6f1dd7b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:20.602462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b67604aa-4abb-4939-913e-4eedd6f1dd7b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:20.610423 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b67604aa-4abb-4939-913e-4eedd6f1dd7b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1697 microversion: 2.1 time: 0.180572 Oct 29 04:03:20.611002 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3772/7318] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:20 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1697 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:21.635629 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2e054f41-8f44-46e9-865c-9186c5c11cef tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:21.636371 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2e054f41-8f44-46e9-865c-9186c5c11cef tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:21.644764 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e054f41-8f44-46e9-865c-9186c5c11cef tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:21.645334 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e054f41-8f44-46e9-865c-9186c5c11cef tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:21.645828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e054f41-8f44-46e9-865c-9186c5c11cef tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:21.646614 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e054f41-8f44-46e9-865c-9186c5c11cef tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:21.647150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e054f41-8f44-46e9-865c-9186c5c11cef tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:21.647813 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2e054f41-8f44-46e9-865c-9186c5c11cef tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:21.795670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2e054f41-8f44-46e9-865c-9186c5c11cef tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:21.809480 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2e054f41-8f44-46e9-865c-9186c5c11cef tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1697 microversion: 2.1 time: 0.177535 Oct 29 04:03:21.809480 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3547/7319] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:21 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1697 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:22.839881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2fa0241a-e135-4d2c-be16-c7df3d7603fd tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:22.840824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2fa0241a-e135-4d2c-be16-c7df3d7603fd tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:22.852382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2fa0241a-e135-4d2c-be16-c7df3d7603fd tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:22.853244 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2fa0241a-e135-4d2c-be16-c7df3d7603fd tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:22.853975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2fa0241a-e135-4d2c-be16-c7df3d7603fd tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:22.855409 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2fa0241a-e135-4d2c-be16-c7df3d7603fd tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:22.856172 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2fa0241a-e135-4d2c-be16-c7df3d7603fd tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:22.856952 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2fa0241a-e135-4d2c-be16-c7df3d7603fd tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:23.000584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2fa0241a-e135-4d2c-be16-c7df3d7603fd tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:23.012695 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2fa0241a-e135-4d2c-be16-c7df3d7603fd tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1697 microversion: 2.1 time: 0.179192 Oct 29 04:03:23.013345 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3773/7320] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:22 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1697 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:24.038832 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9f8fc013-3e6c-41de-848c-791f7d8a3eb5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:24.039462 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9f8fc013-3e6c-41de-848c-791f7d8a3eb5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:24.046862 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f8fc013-3e6c-41de-848c-791f7d8a3eb5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:24.047341 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f8fc013-3e6c-41de-848c-791f7d8a3eb5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:24.047819 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f8fc013-3e6c-41de-848c-791f7d8a3eb5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:24.048565 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f8fc013-3e6c-41de-848c-791f7d8a3eb5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:24.049047 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f8fc013-3e6c-41de-848c-791f7d8a3eb5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:24.049558 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9f8fc013-3e6c-41de-848c-791f7d8a3eb5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:24.187694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9f8fc013-3e6c-41de-848c-791f7d8a3eb5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:24.199982 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9f8fc013-3e6c-41de-848c-791f7d8a3eb5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1697 microversion: 2.1 time: 0.164663 Oct 29 04:03:24.200741 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3548/7321] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:24 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:25.224587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-eed6502c-ba6f-49d7-b9c7-4d858c6db0fb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:25.225234 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-eed6502c-ba6f-49d7-b9c7-4d858c6db0fb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:25.233127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eed6502c-ba6f-49d7-b9c7-4d858c6db0fb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:25.233677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eed6502c-ba6f-49d7-b9c7-4d858c6db0fb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:25.234149 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eed6502c-ba6f-49d7-b9c7-4d858c6db0fb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:25.234950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eed6502c-ba6f-49d7-b9c7-4d858c6db0fb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:25.235440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eed6502c-ba6f-49d7-b9c7-4d858c6db0fb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:25.235880 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-eed6502c-ba6f-49d7-b9c7-4d858c6db0fb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:25.379345 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-eed6502c-ba6f-49d7-b9c7-4d858c6db0fb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:25.387895 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-eed6502c-ba6f-49d7-b9c7-4d858c6db0fb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1697 microversion: 2.1 time: 0.167350 Oct 29 04:03:25.388481 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3774/7322] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:25 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:26.411725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ba3c9522-c612-4951-ba96-8ddf6ad69310 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:26.412357 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ba3c9522-c612-4951-ba96-8ddf6ad69310 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:26.419692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba3c9522-c612-4951-ba96-8ddf6ad69310 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:26.420186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba3c9522-c612-4951-ba96-8ddf6ad69310 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:26.420675 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba3c9522-c612-4951-ba96-8ddf6ad69310 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:26.421377 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba3c9522-c612-4951-ba96-8ddf6ad69310 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:26.421838 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba3c9522-c612-4951-ba96-8ddf6ad69310 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:26.422271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ba3c9522-c612-4951-ba96-8ddf6ad69310 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:26.558327 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ba3c9522-c612-4951-ba96-8ddf6ad69310 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:26.566230 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ba3c9522-c612-4951-ba96-8ddf6ad69310 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1697 microversion: 2.1 time: 0.158506 Oct 29 04:03:26.566811 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3549/7323] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:26 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:27.590321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-43fe94d9-a3d6-4ae3-9ba9-dcd541c7933b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:27.590941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-43fe94d9-a3d6-4ae3-9ba9-dcd541c7933b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:27.599306 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-43fe94d9-a3d6-4ae3-9ba9-dcd541c7933b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:27.599727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-43fe94d9-a3d6-4ae3-9ba9-dcd541c7933b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:27.600161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-43fe94d9-a3d6-4ae3-9ba9-dcd541c7933b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:27.600894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-43fe94d9-a3d6-4ae3-9ba9-dcd541c7933b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:27.601344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-43fe94d9-a3d6-4ae3-9ba9-dcd541c7933b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:27.601774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-43fe94d9-a3d6-4ae3-9ba9-dcd541c7933b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:27.738391 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-43fe94d9-a3d6-4ae3-9ba9-dcd541c7933b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:27.747943 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-43fe94d9-a3d6-4ae3-9ba9-dcd541c7933b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1697 microversion: 2.1 time: 0.161640 Oct 29 04:03:27.748641 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3775/7324] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:27 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:28.773600 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-11f5a976-4176-4097-9b90-f7d40659769c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:28.774234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-11f5a976-4176-4097-9b90-f7d40659769c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:28.781617 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11f5a976-4176-4097-9b90-f7d40659769c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:28.782132 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11f5a976-4176-4097-9b90-f7d40659769c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:28.782579 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11f5a976-4176-4097-9b90-f7d40659769c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:28.783299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11f5a976-4176-4097-9b90-f7d40659769c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:28.783769 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11f5a976-4176-4097-9b90-f7d40659769c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:28.784200 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-11f5a976-4176-4097-9b90-f7d40659769c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:28.922818 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-11f5a976-4176-4097-9b90-f7d40659769c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:28.930803 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-11f5a976-4176-4097-9b90-f7d40659769c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1697 microversion: 2.1 time: 0.161720 Oct 29 04:03:28.931359 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3550/7325] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:28 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:29.954585 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-96860a21-f60a-49c8-945c-0182cd6e2a91 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:29.955206 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-96860a21-f60a-49c8-945c-0182cd6e2a91 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:29.962911 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-96860a21-f60a-49c8-945c-0182cd6e2a91 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:29.963408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-96860a21-f60a-49c8-945c-0182cd6e2a91 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:29.963926 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-96860a21-f60a-49c8-945c-0182cd6e2a91 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:29.964702 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-96860a21-f60a-49c8-945c-0182cd6e2a91 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:29.965157 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-96860a21-f60a-49c8-945c-0182cd6e2a91 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:29.965575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-96860a21-f60a-49c8-945c-0182cd6e2a91 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:30.116402 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-96860a21-f60a-49c8-945c-0182cd6e2a91 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:30.124399 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-96860a21-f60a-49c8-945c-0182cd6e2a91 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1696 microversion: 2.1 time: 0.173794 Oct 29 04:03:30.124958 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3776/7326] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:29 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1696 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:30.645973 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-aa02ccf6-d365-486f-b5be-b8522decead2 req-a4073477-3d1a-433f-ac87-a6524f4023de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de6c6d7-a88d-4c21-8974-f9ee5625f528", "name": "network-vif-unplugged", "status": "completed", "tag": "2c21a374-5241-4954-9f98-b7c08a1a96b0"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:03:30.655912 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-aa02ccf6-d365-486f-b5be-b8522decead2 req-a4073477-3d1a-433f-ac87-a6524f4023de service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:30.656303 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-aa02ccf6-d365-486f-b5be-b8522decead2 req-a4073477-3d1a-433f-ac87-a6524f4023de service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:30.656772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-aa02ccf6-d365-486f-b5be-b8522decead2 req-a4073477-3d1a-433f-ac87-a6524f4023de service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:30.669684 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-aa02ccf6-d365-486f-b5be-b8522decead2 req-a4073477-3d1a-433f-ac87-a6524f4023de service nova] Creating event network-vif-unplugged:2c21a374-5241-4954-9f98-b7c08a1a96b0 for instance 3de6c6d7-a88d-4c21-8974-f9ee5625f528 on n-h1-862967-2 Oct 29 04:03:30.675602 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [req-aa02ccf6-d365-486f-b5be-b8522decead2 req-a4073477-3d1a-433f-ac87-a6524f4023de service nova] Instance 3de6c6d7-a88d-4c21-8974-f9ee5625f528 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127125) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 04:03:30.686983 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-aa02ccf6-d365-486f-b5be-b8522decead2 req-a4073477-3d1a-433f-ac87-a6524f4023de service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.158095 Oct 29 04:03:30.687611 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3551/7327] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:03:31.148476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b841df67-b3a8-496b-973b-26c92aeec003 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:31.149098 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b841df67-b3a8-496b-973b-26c92aeec003 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:31.156469 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b841df67-b3a8-496b-973b-26c92aeec003 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:31.156995 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b841df67-b3a8-496b-973b-26c92aeec003 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:31.157442 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b841df67-b3a8-496b-973b-26c92aeec003 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:31.158156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b841df67-b3a8-496b-973b-26c92aeec003 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:31.158618 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b841df67-b3a8-496b-973b-26c92aeec003 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:31.159047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b841df67-b3a8-496b-973b-26c92aeec003 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:31.296227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b841df67-b3a8-496b-973b-26c92aeec003 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:31.306786 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b841df67-b3a8-496b-973b-26c92aeec003 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1696 microversion: 2.1 time: 0.162403 Oct 29 04:03:31.307707 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3777/7328] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:31 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:32.341048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-cdf6b808-49a7-48fc-b1a4-d360251102eb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:32.342052 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-cdf6b808-49a7-48fc-b1a4-d360251102eb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:32.351071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdf6b808-49a7-48fc-b1a4-d360251102eb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:32.351569 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdf6b808-49a7-48fc-b1a4-d360251102eb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:32.352020 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdf6b808-49a7-48fc-b1a4-d360251102eb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:32.352778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdf6b808-49a7-48fc-b1a4-d360251102eb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:32.353259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdf6b808-49a7-48fc-b1a4-d360251102eb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:32.353694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-cdf6b808-49a7-48fc-b1a4-d360251102eb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:32.493853 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-cdf6b808-49a7-48fc-b1a4-d360251102eb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:32.502216 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-cdf6b808-49a7-48fc-b1a4-d360251102eb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1694 microversion: 2.1 time: 0.170223 Oct 29 04:03:32.502769 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3552/7329] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:32 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1694 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:32.708904 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-3e94a872-b44e-4b76-98f9-5bfe0cab9560 req-f367b2dd-fc0a-4c8e-a13b-bdf561a824ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3de6c6d7-a88d-4c21-8974-f9ee5625f528", "tag": "2c21a374-5241-4954-9f98-b7c08a1a96b0"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:03:32.719699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3e94a872-b44e-4b76-98f9-5bfe0cab9560 req-f367b2dd-fc0a-4c8e-a13b-bdf561a824ab service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:32.720180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3e94a872-b44e-4b76-98f9-5bfe0cab9560 req-f367b2dd-fc0a-4c8e-a13b-bdf561a824ab service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:32.720646 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3e94a872-b44e-4b76-98f9-5bfe0cab9560 req-f367b2dd-fc0a-4c8e-a13b-bdf561a824ab service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:32.733025 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-3e94a872-b44e-4b76-98f9-5bfe0cab9560 req-f367b2dd-fc0a-4c8e-a13b-bdf561a824ab service nova] Creating event network-changed:2c21a374-5241-4954-9f98-b7c08a1a96b0 for instance 3de6c6d7-a88d-4c21-8974-f9ee5625f528 on n-h1-862967-2 Oct 29 04:03:32.739049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [req-3e94a872-b44e-4b76-98f9-5bfe0cab9560 req-f367b2dd-fc0a-4c8e-a13b-bdf561a824ab service nova] Instance 3de6c6d7-a88d-4c21-8974-f9ee5625f528 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-862967-2', 'n-h1-862967-2'} {{(pid=127124) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 29 04:03:32.751030 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-3e94a872-b44e-4b76-98f9-5bfe0cab9560 req-f367b2dd-fc0a-4c8e-a13b-bdf561a824ab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046695 Oct 29 04:03:32.751630 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3778/7330] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:03:33.526935 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6b9aa736-dca7-4f6b-91ff-a2f9ba7f491b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:33.527536 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6b9aa736-dca7-4f6b-91ff-a2f9ba7f491b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:33.534610 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b9aa736-dca7-4f6b-91ff-a2f9ba7f491b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:33.535107 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b9aa736-dca7-4f6b-91ff-a2f9ba7f491b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:33.535656 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b9aa736-dca7-4f6b-91ff-a2f9ba7f491b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:33.536376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b9aa736-dca7-4f6b-91ff-a2f9ba7f491b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:33.536896 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b9aa736-dca7-4f6b-91ff-a2f9ba7f491b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:33.537356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6b9aa736-dca7-4f6b-91ff-a2f9ba7f491b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:34.056806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6b9aa736-dca7-4f6b-91ff-a2f9ba7f491b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:34.065560 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6b9aa736-dca7-4f6b-91ff-a2f9ba7f491b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1691 microversion: 2.1 time: 0.543093 Oct 29 04:03:34.066191 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3553/7331] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:33 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1691 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:34.094362 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6805182e-f40b-4337-b04d-ef180430ca90 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:03:34.094999 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6805182e-f40b-4337-b04d-ef180430ca90 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:34.096984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=25 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:03:34.102726 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6805182e-f40b-4337-b04d-ef180430ca90 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:34.103217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6805182e-f40b-4337-b04d-ef180430ca90 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:34.103664 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6805182e-f40b-4337-b04d-ef180430ca90 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:34.104369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6805182e-f40b-4337-b04d-ef180430ca90 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:34.104859 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6805182e-f40b-4337-b04d-ef180430ca90 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:34.105271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6805182e-f40b-4337-b04d-ef180430ca90 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:34.108102 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=69 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:03:34.176312 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6805182e-f40b-4337-b04d-ef180430ca90 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528/action" status: 204 len: 0 microversion: 2.1 time: 0.086236 Oct 29 04:03:34.176857 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3779/7332] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 04:03:34 2022] POST /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528/action => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 04:03:34.186442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-fcc0a057-9652-4053-9c3d-cac9d397abd0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:34.187327 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-fcc0a057-9652-4053-9c3d-cac9d397abd0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:34.195793 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fcc0a057-9652-4053-9c3d-cac9d397abd0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:34.196424 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fcc0a057-9652-4053-9c3d-cac9d397abd0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:34.196910 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fcc0a057-9652-4053-9c3d-cac9d397abd0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:34.197647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fcc0a057-9652-4053-9c3d-cac9d397abd0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:34.198507 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fcc0a057-9652-4053-9c3d-cac9d397abd0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:34.198507 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-fcc0a057-9652-4053-9c3d-cac9d397abd0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:34.348162 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-fcc0a057-9652-4053-9c3d-cac9d397abd0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:34.359574 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-fcc0a057-9652-4053-9c3d-cac9d397abd0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1691 microversion: 2.1 time: 0.178304 Oct 29 04:03:34.363592 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3554/7333] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:34 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1691 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:34.383272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d3e1c2ac-f862-4380-bee8-6c327f208f08 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:34.383981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d3e1c2ac-f862-4380-bee8-6c327f208f08 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:34.390405 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3e1c2ac-f862-4380-bee8-6c327f208f08 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:34.390892 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3e1c2ac-f862-4380-bee8-6c327f208f08 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:34.391340 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3e1c2ac-f862-4380-bee8-6c327f208f08 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:34.392056 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3e1c2ac-f862-4380-bee8-6c327f208f08 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:34.392515 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3e1c2ac-f862-4380-bee8-6c327f208f08 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:34.392976 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d3e1c2ac-f862-4380-bee8-6c327f208f08 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:34.620894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d3e1c2ac-f862-4380-bee8-6c327f208f08 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:34.629016 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d3e1c2ac-f862-4380-bee8-6c327f208f08 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1691 microversion: 2.1 time: 0.250033 Oct 29 04:03:34.629571 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3780/7334] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:34 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1691 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:35.655699 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-85480e75-6949-4604-a0cc-e83b3ff98225 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:03:35.656457 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-85480e75-6949-4604-a0cc-e83b3ff98225 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:03:35.663591 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85480e75-6949-4604-a0cc-e83b3ff98225 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:35.664093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85480e75-6949-4604-a0cc-e83b3ff98225 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:35.664570 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85480e75-6949-4604-a0cc-e83b3ff98225 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:35.665283 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85480e75-6949-4604-a0cc-e83b3ff98225 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:35.665749 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85480e75-6949-4604-a0cc-e83b3ff98225 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:35.666190 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85480e75-6949-4604-a0cc-e83b3ff98225 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:35.803989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-85480e75-6949-4604-a0cc-e83b3ff98225 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:03:35.812076 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-85480e75-6949-4604-a0cc-e83b3ff98225 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1683 microversion: 2.1 time: 0.160406 Oct 29 04:03:35.812710 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3555/7335] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:03:35 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:03:36.505382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-89d07039-cc58-4c8d-a089-8eeb9739b431 req-9f681090-8204-48f4-aa8f-bbfbd47de619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de6c6d7-a88d-4c21-8974-f9ee5625f528", "name": "network-vif-plugged", "status": "completed", "tag": "2c21a374-5241-4954-9f98-b7c08a1a96b0"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:03:36.514885 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-89d07039-cc58-4c8d-a089-8eeb9739b431 req-9f681090-8204-48f4-aa8f-bbfbd47de619 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:03:36.515351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-89d07039-cc58-4c8d-a089-8eeb9739b431 req-9f681090-8204-48f4-aa8f-bbfbd47de619 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:03:36.515773 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-89d07039-cc58-4c8d-a089-8eeb9739b431 req-9f681090-8204-48f4-aa8f-bbfbd47de619 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:03:36.526819 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-89d07039-cc58-4c8d-a089-8eeb9739b431 req-9f681090-8204-48f4-aa8f-bbfbd47de619 service nova] Creating event network-vif-plugged:2c21a374-5241-4954-9f98-b7c08a1a96b0 for instance 3de6c6d7-a88d-4c21-8974-f9ee5625f528 on n-h1-862967-2 Oct 29 04:03:36.531936 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-89d07039-cc58-4c8d-a089-8eeb9739b431 req-9f681090-8204-48f4-aa8f-bbfbd47de619 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095925 Oct 29 04:03:36.532535 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3781/7336] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:04:02.054081 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-86970711-f16e-43f3-8326-8dae008fb262 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:04:02.057482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-86970711-f16e-43f3-8326-8dae008fb262 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:02.059728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=32 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:04:02.060416 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:04:02.066799 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86970711-f16e-43f3-8326-8dae008fb262 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:02.067321 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86970711-f16e-43f3-8326-8dae008fb262 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:02.067750 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86970711-f16e-43f3-8326-8dae008fb262 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:02.068471 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86970711-f16e-43f3-8326-8dae008fb262 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:02.068963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86970711-f16e-43f3-8326-8dae008fb262 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:02.069392 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-86970711-f16e-43f3-8326-8dae008fb262 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:02.126868 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-86970711-f16e-43f3-8326-8dae008fb262 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528/action" status: 200 len: 24559 microversion: 2.1 time: 0.079263 Oct 29 04:04:02.127528 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3556/7337] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 04:04:02 2022] POST /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528/action => generated 24559 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 04:04:09.365992 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=5 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:04:09.367182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:04:09.369378 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-ba280086-a4df-4d45-9d38-594e28bee40b req-4aa367e2-0005-41a7-b903-608083b0a50a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3de6c6d7-a88d-4c21-8974-f9ee5625f528", "tag": "2c21a374-5241-4954-9f98-b7c08a1a96b0"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:04:09.372049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7cf9870c-527d-4949-aa66-6cd8e6c30b76 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:09.372733 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7cf9870c-527d-4949-aa66-6cd8e6c30b76 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:09.381015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7cf9870c-527d-4949-aa66-6cd8e6c30b76 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:09.381251 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7cf9870c-527d-4949-aa66-6cd8e6c30b76 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:09.381370 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ba280086-a4df-4d45-9d38-594e28bee40b req-4aa367e2-0005-41a7-b903-608083b0a50a service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:09.381472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7cf9870c-527d-4949-aa66-6cd8e6c30b76 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:09.381743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ba280086-a4df-4d45-9d38-594e28bee40b req-4aa367e2-0005-41a7-b903-608083b0a50a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:09.382180 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7cf9870c-527d-4949-aa66-6cd8e6c30b76 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:09.382295 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-ba280086-a4df-4d45-9d38-594e28bee40b req-4aa367e2-0005-41a7-b903-608083b0a50a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:09.382634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7cf9870c-527d-4949-aa66-6cd8e6c30b76 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:09.383088 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7cf9870c-527d-4949-aa66-6cd8e6c30b76 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:09.395425 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-ba280086-a4df-4d45-9d38-594e28bee40b req-4aa367e2-0005-41a7-b903-608083b0a50a service nova] Creating event network-changed:2c21a374-5241-4954-9f98-b7c08a1a96b0 for instance 3de6c6d7-a88d-4c21-8974-f9ee5625f528 on n-h1-862967-2 Oct 29 04:04:09.401100 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-ba280086-a4df-4d45-9d38-594e28bee40b req-4aa367e2-0005-41a7-b903-608083b0a50a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036300 Oct 29 04:04:09.403935 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3557/7338] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:04:09.412992 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7cf9870c-527d-4949-aa66-6cd8e6c30b76 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 04:04:09.499679 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7cf9870c-527d-4949-aa66-6cd8e6c30b76 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 204 len: 0 microversion: 2.1 time: 0.136985 Oct 29 04:04:09.500824 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3782/7339] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 04:04:09 2022] DELETE /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 04:04:09.512397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dd6eb783-0afe-4c0e-b27e-f10a6e75eeb8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:09.513519 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dd6eb783-0afe-4c0e-b27e-f10a6e75eeb8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:09.520891 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd6eb783-0afe-4c0e-b27e-f10a6e75eeb8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:09.521453 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd6eb783-0afe-4c0e-b27e-f10a6e75eeb8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:09.521927 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd6eb783-0afe-4c0e-b27e-f10a6e75eeb8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:09.522846 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd6eb783-0afe-4c0e-b27e-f10a6e75eeb8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:09.523354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd6eb783-0afe-4c0e-b27e-f10a6e75eeb8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:09.524002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-dd6eb783-0afe-4c0e-b27e-f10a6e75eeb8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:09.685039 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dd6eb783-0afe-4c0e-b27e-f10a6e75eeb8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:09.693343 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dd6eb783-0afe-4c0e-b27e-f10a6e75eeb8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1689 microversion: 2.1 time: 0.187770 Oct 29 04:04:09.693956 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3558/7340] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:09 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1689 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:10.719370 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-59f0d8ed-6100-4d74-8bf3-c1826dfe4888 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:10.720085 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-59f0d8ed-6100-4d74-8bf3-c1826dfe4888 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:10.727331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59f0d8ed-6100-4d74-8bf3-c1826dfe4888 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:10.727803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59f0d8ed-6100-4d74-8bf3-c1826dfe4888 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:10.728268 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59f0d8ed-6100-4d74-8bf3-c1826dfe4888 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:10.729063 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59f0d8ed-6100-4d74-8bf3-c1826dfe4888 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:10.729466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59f0d8ed-6100-4d74-8bf3-c1826dfe4888 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:10.729887 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-59f0d8ed-6100-4d74-8bf3-c1826dfe4888 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:10.869628 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-59f0d8ed-6100-4d74-8bf3-c1826dfe4888 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:10.877784 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-59f0d8ed-6100-4d74-8bf3-c1826dfe4888 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1689 microversion: 2.1 time: 0.163198 Oct 29 04:04:10.878373 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3783/7341] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:10 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:11.784336 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-4ece012d-7597-42ff-aa26-f7833890e1ca req-a6688335-7606-4a03-be76-fe8b3d7701bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de6c6d7-a88d-4c21-8974-f9ee5625f528", "name": "network-vif-deleted", "tag": "2c21a374-5241-4954-9f98-b7c08a1a96b0"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:04:11.795301 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4ece012d-7597-42ff-aa26-f7833890e1ca req-a6688335-7606-4a03-be76-fe8b3d7701bd service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:11.795815 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4ece012d-7597-42ff-aa26-f7833890e1ca req-a6688335-7606-4a03-be76-fe8b3d7701bd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:11.796259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-4ece012d-7597-42ff-aa26-f7833890e1ca req-a6688335-7606-4a03-be76-fe8b3d7701bd service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:11.808329 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-4ece012d-7597-42ff-aa26-f7833890e1ca req-a6688335-7606-4a03-be76-fe8b3d7701bd service nova] Creating event network-vif-deleted:2c21a374-5241-4954-9f98-b7c08a1a96b0 for instance 3de6c6d7-a88d-4c21-8974-f9ee5625f528 on n-h1-862967-2 Oct 29 04:04:11.813678 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-4ece012d-7597-42ff-aa26-f7833890e1ca req-a6688335-7606-4a03-be76-fe8b3d7701bd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033147 Oct 29 04:04:11.814691 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3559/7342] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:04:11.903639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1ff04bb5-3ce9-496c-925b-00e7147096c6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:11.904292 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1ff04bb5-3ce9-496c-925b-00e7147096c6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:11.910730 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ff04bb5-3ce9-496c-925b-00e7147096c6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:11.911216 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ff04bb5-3ce9-496c-925b-00e7147096c6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:11.911684 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ff04bb5-3ce9-496c-925b-00e7147096c6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:11.912397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ff04bb5-3ce9-496c-925b-00e7147096c6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:11.912881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ff04bb5-3ce9-496c-925b-00e7147096c6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:11.913310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ff04bb5-3ce9-496c-925b-00e7147096c6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:11.945940 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ff04bb5-3ce9-496c-925b-00e7147096c6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:11.946431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ff04bb5-3ce9-496c-925b-00e7147096c6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:11.946881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1ff04bb5-3ce9-496c-925b-00e7147096c6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:11.947322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-1ff04bb5-3ce9-496c-925b-00e7147096c6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lazy-loading 'fault' on Instance uuid 3de6c6d7-a88d-4c21-8974-f9ee5625f528 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 04:04:11.988423 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1ff04bb5-3ce9-496c-925b-00e7147096c6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:11.997011 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1ff04bb5-3ce9-496c-925b-00e7147096c6 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 200 len: 1357 microversion: 2.1 time: 0.099649 Oct 29 04:04:11.998331 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3784/7343] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:11 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 1357 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:13.036061 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c2cfe4de-5f18-4b4e-b1b2-cc9cd2f0ee8f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:13.037316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c2cfe4de-5f18-4b4e-b1b2-cc9cd2f0ee8f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 3de6c6d7-a88d-4c21-8974-f9ee5625f528] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:13.048262 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2cfe4de-5f18-4b4e-b1b2-cc9cd2f0ee8f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:13.049458 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2cfe4de-5f18-4b4e-b1b2-cc9cd2f0ee8f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:13.049669 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2cfe4de-5f18-4b4e-b1b2-cc9cd2f0ee8f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:13.050412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2cfe4de-5f18-4b4e-b1b2-cc9cd2f0ee8f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:13.050881 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2cfe4de-5f18-4b4e-b1b2-cc9cd2f0ee8f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:13.051323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c2cfe4de-5f18-4b4e-b1b2-cc9cd2f0ee8f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:13.065786 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-c2cfe4de-5f18-4b4e-b1b2-cc9cd2f0ee8f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] HTTP exception thrown: Instance 3de6c6d7-a88d-4c21-8974-f9ee5625f528 could not be found. Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c2cfe4de-5f18-4b4e-b1b2-cc9cd2f0ee8f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Request method failure captured: Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 HTTP/1.1 Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKUo0_mrT7RmIg7xwBr8IFILx8owR6S_7fbkYMDM3yKtVViQvdfHhgImK2tLNoi-DKhagj3xbECEfbniUg9pO0t5aY8w58qiHmIe3llBDaRK81PNEp7hhgTWe4zv3Mc__1xDWYdZL84JZ9C1u9d6A3xFbzEWOXw9Pdm2mYWXRVUQcjw Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: 6db83678d78d49ff9768ba55d1a7d70d Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2052576324 Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6db83678d78d49ff9768ba55d1a7d70d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6db83678d78d49ff9768ba55d1a7d70d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6db83678d78d49ff9768ba55d1a7d70d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6db83678d78d49ff9768ba55d1a7d70d"}]}] Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2052576324 Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: 6db83678d78d49ff9768ba55d1a7d70d Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2052576324 Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestNetworkAdvancedServerOps-2052576324-project Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: f75948d4d49e47f69900a9b8ece27999 Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2052576324-project Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 3de6c6d7-a88d-4c21-8974-f9ee5625f528 could not be found. Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '3de6c6d7-a88d-4c21-8974-f9ee5625f528'} Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3de6c6d7-a88d-4c21-8974-f9ee5625f528 could not be found. Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3de6c6d7-a88d-4c21-8974-f9ee5625f528 could not be found. Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 04:04:13.067506 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:04:13.073210 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 04:04:13.073210 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:04:13.073210 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:04:13.073210 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:04:13.073210 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 04:04:13.073210 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 04:04:13.073210 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3de6c6d7-a88d-4c21-8974-f9ee5625f528 could not be found. Oct 29 04:04:13.073210 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 04:04:13.073210 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c2cfe4de-5f18-4b4e-b1b2-cc9cd2f0ee8f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Returning 404 to user: Instance 3de6c6d7-a88d-4c21-8974-f9ee5625f528 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 04:04:13.073210 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c2cfe4de-5f18-4b4e-b1b2-cc9cd2f0ee8f tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528" status: 404 len: 111 microversion: 2.1 time: 0.047554 Oct 29 04:04:13.073210 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3560/7344] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:13 2022] GET /compute/v2.1/servers/3de6c6d7-a88d-4c21-8974-f9ee5625f528 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 04:04:16.403801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dcaca258-3239-4210-a60d-6181426164f8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '.version_select at 0x7ff053c81820>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:16.437498 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dcaca258-3239-4210-a60d-6181426164f8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2034526575" status: 202 len: 0 microversion: 2.1 time: 0.037916 Oct 29 04:04:16.438112 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3785/7345] 10.222.0.46 () {58 vars in 1284 bytes} [Sat Oct 29 04:04:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2034526575 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:04:16.465791 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ba85b5c6-d736-4265-8904-20ccb082c33a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'create', calling method: .version_select at 0x7ff052b76d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1802147096", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzlqJiW48yoS8W+f+mB5zaZxeA7UBKndHGJyHxDZ2vizjU7qEdu6Rv7YknumNvSXA/W6lOsGaevofifdE7GNbFMuV3ufX01IdVz/hvGGC7dhZpvfNrulOo1MhoJz3LWvg=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:04:16.482437 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-ba85b5c6-d736-4265-8904-20ccb082c33a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Getting quotas for project 6db83678d78d49ff9768ba55d1a7d70d. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:04:16.489914 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-ba85b5c6-d736-4265-8904-20ccb082c33a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Getting quotas for user f75948d4d49e47f69900a9b8ece27999 and project 6db83678d78d49ff9768ba55d1a7d70d. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:04:16.518191 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ba85b5c6-d736-4265-8904-20ccb082c33a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.056251 Oct 29 04:04:16.518814 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3561/7346] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 04:04:16 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:04:22.534787 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:04:22.539500 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a9858976-5083-45df-b17c-33288a0e9c28 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-513295871", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "0f9f07b3-704a-418b-ab9c-6fff2dd95ec2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1802147096", "security_groups": [{"name": "tempest-secgroup-smoke-453664267"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:04:22.661428 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-a9858976-5083-45df-b17c-33288a0e9c28 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] validate_networks() for [('0f9f07b3-704a-418b-ab9c-6fff2dd95ec2', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 04:04:23.176261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-a9858976-5083-45df-b17c-33288a0e9c28 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 04:04:23.176871 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-a9858976-5083-45df-b17c-33288a0e9c28 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 04:04:23.177413 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-a9858976-5083-45df-b17c-33288a0e9c28 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 04:04:23.178105 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-a9858976-5083-45df-b17c-33288a0e9c28 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 04:04:23.178586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-a9858976-5083-45df-b17c-33288a0e9c28 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 04:04:23.188612 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9858976-5083-45df-b17c-33288a0e9c28 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:23.189351 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9858976-5083-45df-b17c-33288a0e9c28 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:23.190326 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9858976-5083-45df-b17c-33288a0e9c28 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:23.191200 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9858976-5083-45df-b17c-33288a0e9c28 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:23.191793 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9858976-5083-45df-b17c-33288a0e9c28 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:23.192229 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a9858976-5083-45df-b17c-33288a0e9c28 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:23.211415 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-a9858976-5083-45df-b17c-33288a0e9c28 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Getting quotas for project 6db83678d78d49ff9768ba55d1a7d70d. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:04:23.217044 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-a9858976-5083-45df-b17c-33288a0e9c28 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Getting quotas for user f75948d4d49e47f69900a9b8ece27999 and project 6db83678d78d49ff9768ba55d1a7d70d. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:04:23.238069 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a9858976-5083-45df-b17c-33288a0e9c28 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 04:04:23.242147 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a9858976-5083-45df-b17c-33288a0e9c28 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 04:04:23.302416 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a9858976-5083-45df-b17c-33288a0e9c28 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.769547 Oct 29 04:04:23.303443 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3786/7347] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 04:04:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 04:04:23.316323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ba901dcf-eb2f-432c-9f06-cd4c5235c80e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:23.317647 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ba901dcf-eb2f-432c-9f06-cd4c5235c80e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:23.321015 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=16 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:04:23.474672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ba901dcf-eb2f-432c-9f06-cd4c5235c80e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:23.482338 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ba901dcf-eb2f-432c-9f06-cd4c5235c80e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48" status: 200 len: 1266 microversion: 2.1 time: 0.170755 Oct 29 04:04:23.483277 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3562/7348] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:23 2022] GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:24.508112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2c2a32ec-2182-4650-9f5a-2cc94ea90581 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:24.508801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2c2a32ec-2182-4650-9f5a-2cc94ea90581 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:24.525748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c2a32ec-2182-4650-9f5a-2cc94ea90581 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:24.526437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c2a32ec-2182-4650-9f5a-2cc94ea90581 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:24.527238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c2a32ec-2182-4650-9f5a-2cc94ea90581 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:24.528083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c2a32ec-2182-4650-9f5a-2cc94ea90581 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:24.528662 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c2a32ec-2182-4650-9f5a-2cc94ea90581 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:24.529335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c2a32ec-2182-4650-9f5a-2cc94ea90581 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:24.637772 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2c2a32ec-2182-4650-9f5a-2cc94ea90581 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:24.647721 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2c2a32ec-2182-4650-9f5a-2cc94ea90581 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48" status: 200 len: 1326 microversion: 2.1 time: 0.144964 Oct 29 04:04:24.649363 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3787/7349] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:24 2022] GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 => generated 1326 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:25.676563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-78cea1f9-d167-446e-ba3f-f8a2bad9a352 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:25.677328 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-78cea1f9-d167-446e-ba3f-f8a2bad9a352 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:25.685169 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78cea1f9-d167-446e-ba3f-f8a2bad9a352 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:25.685999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78cea1f9-d167-446e-ba3f-f8a2bad9a352 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:25.686520 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78cea1f9-d167-446e-ba3f-f8a2bad9a352 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:25.687485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78cea1f9-d167-446e-ba3f-f8a2bad9a352 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:25.688051 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78cea1f9-d167-446e-ba3f-f8a2bad9a352 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:25.688499 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-78cea1f9-d167-446e-ba3f-f8a2bad9a352 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:25.855246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-78cea1f9-d167-446e-ba3f-f8a2bad9a352 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:25.870117 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-78cea1f9-d167-446e-ba3f-f8a2bad9a352 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48" status: 200 len: 1391 microversion: 2.1 time: 0.198496 Oct 29 04:04:25.882780 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3563/7350] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:25 2022] GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 => generated 1391 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:26.388047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-ec6f5d9d-3346-4b79-b19b-e9a55eb353c8 req-f64a4262-570c-4096-a928-1dfbc3c0438d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dd36a5c-853d-4f33-98cf-48e7274dbb48", "tag": "eddfbd2b-ea1e-4e09-b6f0-a49e1aa700db"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:04:26.399142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ec6f5d9d-3346-4b79-b19b-e9a55eb353c8 req-f64a4262-570c-4096-a928-1dfbc3c0438d service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:26.399627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ec6f5d9d-3346-4b79-b19b-e9a55eb353c8 req-f64a4262-570c-4096-a928-1dfbc3c0438d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:26.400060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ec6f5d9d-3346-4b79-b19b-e9a55eb353c8 req-f64a4262-570c-4096-a928-1dfbc3c0438d service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:26.412792 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-ec6f5d9d-3346-4b79-b19b-e9a55eb353c8 req-f64a4262-570c-4096-a928-1dfbc3c0438d service nova] Creating event network-changed:eddfbd2b-ea1e-4e09-b6f0-a49e1aa700db for instance 4dd36a5c-853d-4f33-98cf-48e7274dbb48 on n-h1-862967-2 Oct 29 04:04:26.419148 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-ec6f5d9d-3346-4b79-b19b-e9a55eb353c8 req-f64a4262-570c-4096-a928-1dfbc3c0438d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034396 Oct 29 04:04:26.420374 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3788/7351] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:04:26.894018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ad9d0456-e51a-48c0-98ed-b7c7da6350b8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:26.895402 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ad9d0456-e51a-48c0-98ed-b7c7da6350b8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:26.903380 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad9d0456-e51a-48c0-98ed-b7c7da6350b8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:26.903882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad9d0456-e51a-48c0-98ed-b7c7da6350b8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:26.904329 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad9d0456-e51a-48c0-98ed-b7c7da6350b8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:26.905120 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad9d0456-e51a-48c0-98ed-b7c7da6350b8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:26.905592 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad9d0456-e51a-48c0-98ed-b7c7da6350b8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:26.906028 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad9d0456-e51a-48c0-98ed-b7c7da6350b8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:27.046537 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ad9d0456-e51a-48c0-98ed-b7c7da6350b8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:27.054684 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ad9d0456-e51a-48c0-98ed-b7c7da6350b8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48" status: 200 len: 1391 microversion: 2.1 time: 0.164773 Oct 29 04:04:27.055273 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3564/7352] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:26 2022] GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:28.080347 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6986705e-21a5-419c-bfc9-c1dc265e1711 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:28.081114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6986705e-21a5-419c-bfc9-c1dc265e1711 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:28.087821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6986705e-21a5-419c-bfc9-c1dc265e1711 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:28.088307 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6986705e-21a5-419c-bfc9-c1dc265e1711 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:28.088781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6986705e-21a5-419c-bfc9-c1dc265e1711 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:28.089492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6986705e-21a5-419c-bfc9-c1dc265e1711 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:28.089914 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6986705e-21a5-419c-bfc9-c1dc265e1711 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:28.090374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6986705e-21a5-419c-bfc9-c1dc265e1711 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:28.378737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6986705e-21a5-419c-bfc9-c1dc265e1711 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:28.388004 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6986705e-21a5-419c-bfc9-c1dc265e1711 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48" status: 200 len: 1391 microversion: 2.1 time: 0.313267 Oct 29 04:04:28.388631 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3789/7353] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:28 2022] GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 => generated 1391 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:29.415139 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8dc43cd5-6b7f-4008-aa74-fad359747f02 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:29.416044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8dc43cd5-6b7f-4008-aa74-fad359747f02 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:29.426502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8dc43cd5-6b7f-4008-aa74-fad359747f02 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:29.427002 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8dc43cd5-6b7f-4008-aa74-fad359747f02 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:29.427456 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8dc43cd5-6b7f-4008-aa74-fad359747f02 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:29.428203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8dc43cd5-6b7f-4008-aa74-fad359747f02 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:29.428709 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8dc43cd5-6b7f-4008-aa74-fad359747f02 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:29.429146 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8dc43cd5-6b7f-4008-aa74-fad359747f02 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:29.569172 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8dc43cd5-6b7f-4008-aa74-fad359747f02 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:29.577932 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8dc43cd5-6b7f-4008-aa74-fad359747f02 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48" status: 200 len: 1391 microversion: 2.1 time: 0.169774 Oct 29 04:04:29.578560 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3565/7354] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:29 2022] GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:30.601922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7e843c6f-534d-475c-8e25-65d6e021cd4d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:30.602522 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7e843c6f-534d-475c-8e25-65d6e021cd4d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:30.609476 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e843c6f-534d-475c-8e25-65d6e021cd4d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:30.609962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e843c6f-534d-475c-8e25-65d6e021cd4d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:30.610397 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e843c6f-534d-475c-8e25-65d6e021cd4d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:30.611092 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e843c6f-534d-475c-8e25-65d6e021cd4d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:30.611601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e843c6f-534d-475c-8e25-65d6e021cd4d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:30.612025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e843c6f-534d-475c-8e25-65d6e021cd4d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:30.759000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7e843c6f-534d-475c-8e25-65d6e021cd4d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:30.767867 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7e843c6f-534d-475c-8e25-65d6e021cd4d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48" status: 200 len: 1391 microversion: 2.1 time: 0.169922 Oct 29 04:04:30.768476 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3790/7355] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:30 2022] GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:31.792767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8442b82e-5040-4b4f-ae80-b66ee77582a9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:31.793800 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8442b82e-5040-4b4f-ae80-b66ee77582a9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:31.802807 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8442b82e-5040-4b4f-ae80-b66ee77582a9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:31.803309 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8442b82e-5040-4b4f-ae80-b66ee77582a9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:31.803759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8442b82e-5040-4b4f-ae80-b66ee77582a9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:31.804467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8442b82e-5040-4b4f-ae80-b66ee77582a9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:31.804965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8442b82e-5040-4b4f-ae80-b66ee77582a9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:31.805410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8442b82e-5040-4b4f-ae80-b66ee77582a9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:31.948706 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8442b82e-5040-4b4f-ae80-b66ee77582a9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:31.956133 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8442b82e-5040-4b4f-ae80-b66ee77582a9 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48" status: 200 len: 1391 microversion: 2.1 time: 0.169199 Oct 29 04:04:31.956755 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3566/7356] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:31 2022] GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:32.706335 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-8a9e0ffc-5d4f-4130-8bd7-679d06b33317 req-8cec3faa-6474-4f99-b5c7-3a41b1d0b817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dd36a5c-853d-4f33-98cf-48e7274dbb48", "name": "network-vif-plugged", "status": "completed", "tag": "eddfbd2b-ea1e-4e09-b6f0-a49e1aa700db"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:04:32.717386 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8a9e0ffc-5d4f-4130-8bd7-679d06b33317 req-8cec3faa-6474-4f99-b5c7-3a41b1d0b817 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:32.717876 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8a9e0ffc-5d4f-4130-8bd7-679d06b33317 req-8cec3faa-6474-4f99-b5c7-3a41b1d0b817 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:32.718308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-8a9e0ffc-5d4f-4130-8bd7-679d06b33317 req-8cec3faa-6474-4f99-b5c7-3a41b1d0b817 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:32.730216 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-8a9e0ffc-5d4f-4130-8bd7-679d06b33317 req-8cec3faa-6474-4f99-b5c7-3a41b1d0b817 service nova] Creating event network-vif-plugged:eddfbd2b-ea1e-4e09-b6f0-a49e1aa700db for instance 4dd36a5c-853d-4f33-98cf-48e7274dbb48 on n-h1-862967-2 Oct 29 04:04:32.735554 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-8a9e0ffc-5d4f-4130-8bd7-679d06b33317 req-8cec3faa-6474-4f99-b5c7-3a41b1d0b817 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033085 Oct 29 04:04:32.737005 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3791/7357] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:04:32.983449 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bb8aecab-9eb1-449d-9a81-5373a0551437 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:32.984593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bb8aecab-9eb1-449d-9a81-5373a0551437 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:32.988855 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:04:32.998247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb8aecab-9eb1-449d-9a81-5373a0551437 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:32.999074 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb8aecab-9eb1-449d-9a81-5373a0551437 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:32.999806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb8aecab-9eb1-449d-9a81-5373a0551437 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:33.001023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb8aecab-9eb1-449d-9a81-5373a0551437 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:33.001806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb8aecab-9eb1-449d-9a81-5373a0551437 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:33.002486 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb8aecab-9eb1-449d-9a81-5373a0551437 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:33.142122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-bb8aecab-9eb1-449d-9a81-5373a0551437 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:33.153801 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bb8aecab-9eb1-449d-9a81-5373a0551437 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48" status: 200 len: 1391 microversion: 2.1 time: 0.176768 Oct 29 04:04:33.154494 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3567/7358] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:32 2022] GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 => generated 1391 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:34.175331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:04:34.176118 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:04:34.181167 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-be85f8a9-95a2-4b56-a3f8-6ba1431bc383 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:34.181869 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-be85f8a9-95a2-4b56-a3f8-6ba1431bc383 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:34.189060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be85f8a9-95a2-4b56-a3f8-6ba1431bc383 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:34.189536 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be85f8a9-95a2-4b56-a3f8-6ba1431bc383 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:34.189953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be85f8a9-95a2-4b56-a3f8-6ba1431bc383 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:34.190692 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be85f8a9-95a2-4b56-a3f8-6ba1431bc383 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:34.191146 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be85f8a9-95a2-4b56-a3f8-6ba1431bc383 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:34.191570 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-be85f8a9-95a2-4b56-a3f8-6ba1431bc383 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:34.326150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-be85f8a9-95a2-4b56-a3f8-6ba1431bc383 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:34.334586 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-be85f8a9-95a2-4b56-a3f8-6ba1431bc383 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48" status: 200 len: 1564 microversion: 2.1 time: 0.160254 Oct 29 04:04:34.335146 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3792/7359] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:34 2022] GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:34.361048 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-725e1a03-6edc-4859-bddc-31cda4cb3775 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:34.361704 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-725e1a03-6edc-4859-bddc-31cda4cb3775 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:34.363662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:04:34.370359 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-725e1a03-6edc-4859-bddc-31cda4cb3775 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:34.370857 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-725e1a03-6edc-4859-bddc-31cda4cb3775 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:34.371311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-725e1a03-6edc-4859-bddc-31cda4cb3775 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:34.372016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-725e1a03-6edc-4859-bddc-31cda4cb3775 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:34.372482 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-725e1a03-6edc-4859-bddc-31cda4cb3775 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:34.373023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-725e1a03-6edc-4859-bddc-31cda4cb3775 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:34.517455 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-725e1a03-6edc-4859-bddc-31cda4cb3775 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:34.529906 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-725e1a03-6edc-4859-bddc-31cda4cb3775 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48" status: 200 len: 1564 microversion: 2.1 time: 0.172432 Oct 29 04:04:34.530816 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3568/7360] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:34 2022] GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 => generated 1564 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:04:36.524163 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1e306ea3-316c-456f-9b12-afe9686b2b43 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:04:36.525921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1e306ea3-316c-456f-9b12-afe9686b2b43 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:04:36.527160 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-15fe4fa9-6774-4abd-b52e-0414cde33ded req-5261694c-f014-4c81-9421-c57263f75934 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dd36a5c-853d-4f33-98cf-48e7274dbb48", "tag": "eddfbd2b-ea1e-4e09-b6f0-a49e1aa700db"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:04:36.533282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e306ea3-316c-456f-9b12-afe9686b2b43 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:36.534309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e306ea3-316c-456f-9b12-afe9686b2b43 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:36.534765 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e306ea3-316c-456f-9b12-afe9686b2b43 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:36.535483 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e306ea3-316c-456f-9b12-afe9686b2b43 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:36.536110 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e306ea3-316c-456f-9b12-afe9686b2b43 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:36.536781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1e306ea3-316c-456f-9b12-afe9686b2b43 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:36.540469 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-15fe4fa9-6774-4abd-b52e-0414cde33ded req-5261694c-f014-4c81-9421-c57263f75934 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:04:36.541280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-15fe4fa9-6774-4abd-b52e-0414cde33ded req-5261694c-f014-4c81-9421-c57263f75934 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:04:36.541790 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-15fe4fa9-6774-4abd-b52e-0414cde33ded req-5261694c-f014-4c81-9421-c57263f75934 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:04:36.554038 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-15fe4fa9-6774-4abd-b52e-0414cde33ded req-5261694c-f014-4c81-9421-c57263f75934 service nova] Creating event network-changed:eddfbd2b-ea1e-4e09-b6f0-a49e1aa700db for instance 4dd36a5c-853d-4f33-98cf-48e7274dbb48 on n-h1-862967-2 Oct 29 04:04:36.559816 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-15fe4fa9-6774-4abd-b52e-0414cde33ded req-5261694c-f014-4c81-9421-c57263f75934 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037270 Oct 29 04:04:36.560887 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3569/7361] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:04:36.767175 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1e306ea3-316c-456f-9b12-afe9686b2b43 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:04:36.777180 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1e306ea3-316c-456f-9b12-afe9686b2b43 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48" status: 200 len: 1564 microversion: 2.1 time: 0.257172 Oct 29 04:04:36.788736 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3793/7362] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:04:36 2022] GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 => generated 1564 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:05:02.156140 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=5 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:05:02.156918 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=38 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:05:02.162156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bb02fdfe-efc4-4b1f-8e1c-a9800492093e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:05:02.164466 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bb02fdfe-efc4-4b1f-8e1c-a9800492093e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:05:02.172390 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb02fdfe-efc4-4b1f-8e1c-a9800492093e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:02.172912 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb02fdfe-efc4-4b1f-8e1c-a9800492093e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:02.173351 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb02fdfe-efc4-4b1f-8e1c-a9800492093e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:02.174057 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb02fdfe-efc4-4b1f-8e1c-a9800492093e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:02.174514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb02fdfe-efc4-4b1f-8e1c-a9800492093e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:02.174959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb02fdfe-efc4-4b1f-8e1c-a9800492093e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:02.232950 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bb02fdfe-efc4-4b1f-8e1c-a9800492093e tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48/action" status: 200 len: 24567 microversion: 2.1 time: 0.078447 Oct 29 04:05:02.233801 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3570/7363] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 04:05:02 2022] POST /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48/action => generated 24567 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 04:05:13.253659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c357f625-ae0c-4a51-aae8-28debdf7d7bf tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:05:13.256074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:05:13.257264 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=36 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:05:13.263894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c357f625-ae0c-4a51-aae8-28debdf7d7bf tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:13.264433 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c357f625-ae0c-4a51-aae8-28debdf7d7bf tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:13.264894 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c357f625-ae0c-4a51-aae8-28debdf7d7bf tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:13.289988 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c357f625-ae0c-4a51-aae8-28debdf7d7bf tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Going to try to stop instance {{(pid=127124) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 29 04:05:13.335293 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c357f625-ae0c-4a51-aae8-28debdf7d7bf tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48/action" status: 202 len: 0 microversion: 2.1 time: 0.085499 Oct 29 04:05:13.335930 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3794/7364] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 04:05:13 2022] POST /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:05:13.345412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-73d3680f-4f38-46e3-b870-63bda145b4ef tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:05:13.346408 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-73d3680f-4f38-46e3-b870-63bda145b4ef tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:05:13.349493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:05:13.350307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:05:13.355816 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73d3680f-4f38-46e3-b870-63bda145b4ef tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:13.356315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73d3680f-4f38-46e3-b870-63bda145b4ef tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:13.357205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73d3680f-4f38-46e3-b870-63bda145b4ef tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:13.357543 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73d3680f-4f38-46e3-b870-63bda145b4ef tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:13.358010 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73d3680f-4f38-46e3-b870-63bda145b4ef tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:13.358600 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-73d3680f-4f38-46e3-b870-63bda145b4ef tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:13.497556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-73d3680f-4f38-46e3-b870-63bda145b4ef tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:05:13.506075 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-73d3680f-4f38-46e3-b870-63bda145b4ef tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48" status: 200 len: 1693 microversion: 2.1 time: 0.165369 Oct 29 04:05:13.506627 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3571/7365] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:05:13 2022] GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:05:14.535929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9735af31-3dbe-40d6-b2a5-28901ed9b243 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:05:14.536776 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9735af31-3dbe-40d6-b2a5-28901ed9b243 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:05:14.544749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9735af31-3dbe-40d6-b2a5-28901ed9b243 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:14.545321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9735af31-3dbe-40d6-b2a5-28901ed9b243 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:14.545839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9735af31-3dbe-40d6-b2a5-28901ed9b243 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:14.546657 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9735af31-3dbe-40d6-b2a5-28901ed9b243 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:14.547195 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9735af31-3dbe-40d6-b2a5-28901ed9b243 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:14.547734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9735af31-3dbe-40d6-b2a5-28901ed9b243 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:14.686275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9735af31-3dbe-40d6-b2a5-28901ed9b243 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:05:14.694904 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9735af31-3dbe-40d6-b2a5-28901ed9b243 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48" status: 200 len: 1693 microversion: 2.1 time: 0.165839 Oct 29 04:05:14.695489 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3795/7366] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:05:14 2022] GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 => generated 1693 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:05:15.730361 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-05ec924f-a8d3-4265-bcdf-a4140f92f491 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:05:15.731004 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-05ec924f-a8d3-4265-bcdf-a4140f92f491 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:05:15.740295 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05ec924f-a8d3-4265-bcdf-a4140f92f491 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:15.740828 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05ec924f-a8d3-4265-bcdf-a4140f92f491 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:15.741276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05ec924f-a8d3-4265-bcdf-a4140f92f491 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:15.741990 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05ec924f-a8d3-4265-bcdf-a4140f92f491 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:15.742458 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05ec924f-a8d3-4265-bcdf-a4140f92f491 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:15.742894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-05ec924f-a8d3-4265-bcdf-a4140f92f491 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:15.887095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-05ec924f-a8d3-4265-bcdf-a4140f92f491 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:05:15.895873 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-05ec924f-a8d3-4265-bcdf-a4140f92f491 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48" status: 200 len: 1693 microversion: 2.1 time: 0.171429 Oct 29 04:05:15.896470 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3572/7367] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:05:15 2022] GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 => generated 1693 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:05:16.932747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-892b3697-e5ec-41e2-8f75-d2f5465f6ce5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:05:16.933678 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-892b3697-e5ec-41e2-8f75-d2f5465f6ce5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:05:16.949837 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-892b3697-e5ec-41e2-8f75-d2f5465f6ce5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:16.950326 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-892b3697-e5ec-41e2-8f75-d2f5465f6ce5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:16.950760 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-892b3697-e5ec-41e2-8f75-d2f5465f6ce5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:16.951478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-892b3697-e5ec-41e2-8f75-d2f5465f6ce5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:16.951934 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-892b3697-e5ec-41e2-8f75-d2f5465f6ce5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:16.952355 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-892b3697-e5ec-41e2-8f75-d2f5465f6ce5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:17.092993 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-892b3697-e5ec-41e2-8f75-d2f5465f6ce5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:05:17.101290 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-892b3697-e5ec-41e2-8f75-d2f5465f6ce5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48" status: 200 len: 1693 microversion: 2.1 time: 0.175710 Oct 29 04:05:17.101883 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3796/7368] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:05:16 2022] GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 => generated 1693 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:05:18.128682 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ed3931cb-2a93-41d9-9992-09ab32a2d273 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:05:18.129310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ed3931cb-2a93-41d9-9992-09ab32a2d273 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:05:18.136686 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed3931cb-2a93-41d9-9992-09ab32a2d273 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:18.137184 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed3931cb-2a93-41d9-9992-09ab32a2d273 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:18.137730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed3931cb-2a93-41d9-9992-09ab32a2d273 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:18.138443 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed3931cb-2a93-41d9-9992-09ab32a2d273 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:18.138901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed3931cb-2a93-41d9-9992-09ab32a2d273 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:18.139341 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ed3931cb-2a93-41d9-9992-09ab32a2d273 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:18.279972 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ed3931cb-2a93-41d9-9992-09ab32a2d273 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:05:18.288425 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ed3931cb-2a93-41d9-9992-09ab32a2d273 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48" status: 200 len: 1693 microversion: 2.1 time: 0.163884 Oct 29 04:05:18.289019 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3573/7369] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:05:18 2022] GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:05:19.325355 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-a97d02c7-30b6-41e6-9ccd-7c59ba838d89 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:05:19.326254 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-a97d02c7-30b6-41e6-9ccd-7c59ba838d89 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:05:19.333608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a97d02c7-30b6-41e6-9ccd-7c59ba838d89 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:19.334029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a97d02c7-30b6-41e6-9ccd-7c59ba838d89 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:19.334493 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a97d02c7-30b6-41e6-9ccd-7c59ba838d89 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:19.335253 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a97d02c7-30b6-41e6-9ccd-7c59ba838d89 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:19.335734 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a97d02c7-30b6-41e6-9ccd-7c59ba838d89 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:19.336156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-a97d02c7-30b6-41e6-9ccd-7c59ba838d89 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:19.479983 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-a97d02c7-30b6-41e6-9ccd-7c59ba838d89 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:05:19.488833 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-a97d02c7-30b6-41e6-9ccd-7c59ba838d89 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48" status: 200 len: 1693 microversion: 2.1 time: 0.169813 Oct 29 04:05:19.489442 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3797/7370] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:05:19 2022] GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 => generated 1693 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:05:20.517017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9c7b54a6-5704-4acc-bf5f-aeabb5691449 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:05:20.517974 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9c7b54a6-5704-4acc-bf5f-aeabb5691449 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:05:20.529668 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c7b54a6-5704-4acc-bf5f-aeabb5691449 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:20.530514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c7b54a6-5704-4acc-bf5f-aeabb5691449 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:20.530959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c7b54a6-5704-4acc-bf5f-aeabb5691449 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:20.531666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c7b54a6-5704-4acc-bf5f-aeabb5691449 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:20.532129 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c7b54a6-5704-4acc-bf5f-aeabb5691449 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:20.532556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9c7b54a6-5704-4acc-bf5f-aeabb5691449 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:20.681359 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9c7b54a6-5704-4acc-bf5f-aeabb5691449 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:05:20.691674 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9c7b54a6-5704-4acc-bf5f-aeabb5691449 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48" status: 200 len: 1693 microversion: 2.1 time: 0.181328 Oct 29 04:05:20.692263 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3574/7371] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:05:20 2022] GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 => generated 1693 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:05:21.723544 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f0c46f83-891c-4b92-9172-920e74f63607 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:05:21.724194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f0c46f83-891c-4b92-9172-920e74f63607 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:05:21.731454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0c46f83-891c-4b92-9172-920e74f63607 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:21.731961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0c46f83-891c-4b92-9172-920e74f63607 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:21.732386 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0c46f83-891c-4b92-9172-920e74f63607 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:21.733300 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0c46f83-891c-4b92-9172-920e74f63607 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:21.733767 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0c46f83-891c-4b92-9172-920e74f63607 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:21.734194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f0c46f83-891c-4b92-9172-920e74f63607 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:21.868909 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f0c46f83-891c-4b92-9172-920e74f63607 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:05:21.877066 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f0c46f83-891c-4b92-9172-920e74f63607 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48" status: 200 len: 1693 microversion: 2.1 time: 0.157539 Oct 29 04:05:21.877922 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3798/7372] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:05:21 2022] GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:05:22.905417 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6d827073-c887-4712-8226-5b5848f0bf3d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:05:22.906058 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6d827073-c887-4712-8226-5b5848f0bf3d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:05:22.913460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d827073-c887-4712-8226-5b5848f0bf3d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:22.913933 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d827073-c887-4712-8226-5b5848f0bf3d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:22.914489 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d827073-c887-4712-8226-5b5848f0bf3d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:22.915363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d827073-c887-4712-8226-5b5848f0bf3d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:22.915834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d827073-c887-4712-8226-5b5848f0bf3d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:22.916394 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6d827073-c887-4712-8226-5b5848f0bf3d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:23.074700 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6d827073-c887-4712-8226-5b5848f0bf3d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:05:23.083338 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6d827073-c887-4712-8226-5b5848f0bf3d tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48" status: 200 len: 1693 microversion: 2.1 time: 0.184696 Oct 29 04:05:23.083927 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3575/7373] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:05:22 2022] GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 => generated 1693 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:05:24.109112 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c4e2a788-abb8-40be-82dc-504051ca5810 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:05:24.109736 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c4e2a788-abb8-40be-82dc-504051ca5810 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:05:24.117740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c4e2a788-abb8-40be-82dc-504051ca5810 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:24.118263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c4e2a788-abb8-40be-82dc-504051ca5810 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:24.118679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c4e2a788-abb8-40be-82dc-504051ca5810 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:24.119374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c4e2a788-abb8-40be-82dc-504051ca5810 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:24.119830 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c4e2a788-abb8-40be-82dc-504051ca5810 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:24.120256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c4e2a788-abb8-40be-82dc-504051ca5810 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:24.260277 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c4e2a788-abb8-40be-82dc-504051ca5810 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:05:24.272579 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c4e2a788-abb8-40be-82dc-504051ca5810 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48" status: 200 len: 1670 microversion: 2.1 time: 0.167338 Oct 29 04:05:24.273497 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3799/7374] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:05:24 2022] GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 => generated 1670 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:05:25.380571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0d93bef8-2cd8-4787-8630-c6bdd225c9a7 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:05:25.383839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0d93bef8-2cd8-4787-8630-c6bdd225c9a7 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:05:25.393454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0d93bef8-2cd8-4787-8630-c6bdd225c9a7 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:25.393953 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0d93bef8-2cd8-4787-8630-c6bdd225c9a7 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:25.394406 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0d93bef8-2cd8-4787-8630-c6bdd225c9a7 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:25.395123 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0d93bef8-2cd8-4787-8630-c6bdd225c9a7 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:25.395590 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0d93bef8-2cd8-4787-8630-c6bdd225c9a7 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:25.396025 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0d93bef8-2cd8-4787-8630-c6bdd225c9a7 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:25.463308 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0d93bef8-2cd8-4787-8630-c6bdd225c9a7 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48/action" status: 200 len: 38360 microversion: 2.1 time: 0.089095 Oct 29 04:05:25.463985 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3576/7375] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 04:05:25 2022] POST /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48/action => generated 38360 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 04:05:25.476639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-42a501ab-7a58-4c2f-81ea-575c5796d511 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:05:25.484170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-42a501ab-7a58-4c2f-81ea-575c5796d511 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:25.484700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-42a501ab-7a58-4c2f-81ea-575c5796d511 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:25.485137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-42a501ab-7a58-4c2f-81ea-575c5796d511 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:25.508156 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-42a501ab-7a58-4c2f-81ea-575c5796d511 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Going to try to start instance {{(pid=127124) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 29 04:05:25.552142 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-42a501ab-7a58-4c2f-81ea-575c5796d511 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48/action" status: 202 len: 0 microversion: 2.1 time: 0.079495 Oct 29 04:05:25.552796 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3800/7376] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 04:05:25 2022] POST /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:05:25.561989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3acd0131-1efd-4064-9000-8d52b8f0a0c5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:05:25.562704 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3acd0131-1efd-4064-9000-8d52b8f0a0c5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:05:25.570143 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3acd0131-1efd-4064-9000-8d52b8f0a0c5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:25.570680 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3acd0131-1efd-4064-9000-8d52b8f0a0c5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:25.571122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3acd0131-1efd-4064-9000-8d52b8f0a0c5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:25.571833 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3acd0131-1efd-4064-9000-8d52b8f0a0c5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:25.572333 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3acd0131-1efd-4064-9000-8d52b8f0a0c5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:25.572834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3acd0131-1efd-4064-9000-8d52b8f0a0c5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:25.721593 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3acd0131-1efd-4064-9000-8d52b8f0a0c5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:05:25.730270 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3acd0131-1efd-4064-9000-8d52b8f0a0c5 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48" status: 200 len: 1679 microversion: 2.1 time: 0.172672 Oct 29 04:05:25.730840 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3577/7377] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:05:25 2022] GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:05:26.757038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b7adbcd9-8390-45f7-81dd-4ffdf0351112 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:05:26.757758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b7adbcd9-8390-45f7-81dd-4ffdf0351112 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:05:26.764091 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7adbcd9-8390-45f7-81dd-4ffdf0351112 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:26.764732 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7adbcd9-8390-45f7-81dd-4ffdf0351112 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:26.765054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7adbcd9-8390-45f7-81dd-4ffdf0351112 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:26.765764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7adbcd9-8390-45f7-81dd-4ffdf0351112 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:26.766220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7adbcd9-8390-45f7-81dd-4ffdf0351112 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:26.766647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b7adbcd9-8390-45f7-81dd-4ffdf0351112 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:26.903659 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b7adbcd9-8390-45f7-81dd-4ffdf0351112 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:05:26.911762 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b7adbcd9-8390-45f7-81dd-4ffdf0351112 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48" status: 200 len: 1679 microversion: 2.1 time: 0.160129 Oct 29 04:05:26.912337 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3801/7378] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:05:26 2022] GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:05:27.935837 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b5adad84-a0e5-4bc5-859f-f6e3b74dfd36 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:05:27.936405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b5adad84-a0e5-4bc5-859f-f6e3b74dfd36 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:05:27.944112 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5adad84-a0e5-4bc5-859f-f6e3b74dfd36 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:27.944637 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5adad84-a0e5-4bc5-859f-f6e3b74dfd36 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:27.945088 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5adad84-a0e5-4bc5-859f-f6e3b74dfd36 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:27.945806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5adad84-a0e5-4bc5-859f-f6e3b74dfd36 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:27.946292 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5adad84-a0e5-4bc5-859f-f6e3b74dfd36 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:27.946732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b5adad84-a0e5-4bc5-859f-f6e3b74dfd36 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:28.094751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b5adad84-a0e5-4bc5-859f-f6e3b74dfd36 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:05:28.103063 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b5adad84-a0e5-4bc5-859f-f6e3b74dfd36 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48" status: 200 len: 1683 microversion: 2.1 time: 0.171401 Oct 29 04:05:28.103663 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3578/7379] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:05:27 2022] GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:05:54.351107 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f5c2e5e8-103b-4411-8591-8c7497b28f30 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:05:54.353632 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f5c2e5e8-103b-4411-8591-8c7497b28f30 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:05:54.356223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=16 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:05:54.356901 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:05:54.363654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5c2e5e8-103b-4411-8591-8c7497b28f30 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:54.364143 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5c2e5e8-103b-4411-8591-8c7497b28f30 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:54.364655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5c2e5e8-103b-4411-8591-8c7497b28f30 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:54.365370 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5c2e5e8-103b-4411-8591-8c7497b28f30 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:05:54.365819 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5c2e5e8-103b-4411-8591-8c7497b28f30 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:05:54.366243 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f5c2e5e8-103b-4411-8591-8c7497b28f30 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:05:54.424716 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f5c2e5e8-103b-4411-8591-8c7497b28f30 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48/action" status: 200 len: 62923 microversion: 2.1 time: 0.079166 Oct 29 04:05:54.425383 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3802/7380] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 04:05:54 2022] POST /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48/action => generated 62923 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 04:06:01.526735 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d8ecc5fe-1e74-4006-a4c4-17c5fecd29fa tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:01.527961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d8ecc5fe-1e74-4006-a4c4-17c5fecd29fa tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:01.529866 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-1a474ed4-0954-4f38-bccb-b33ac037e6bb req-7decd3cf-47a6-4962-a1e5-aed19766f14e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dd36a5c-853d-4f33-98cf-48e7274dbb48", "tag": "eddfbd2b-ea1e-4e09-b6f0-a49e1aa700db"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:06:01.530692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=16 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:06:01.531407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=46 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:06:01.537564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8ecc5fe-1e74-4006-a4c4-17c5fecd29fa tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:01.538404 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8ecc5fe-1e74-4006-a4c4-17c5fecd29fa tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:01.538856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8ecc5fe-1e74-4006-a4c4-17c5fecd29fa tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:01.539679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8ecc5fe-1e74-4006-a4c4-17c5fecd29fa tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:01.540150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8ecc5fe-1e74-4006-a4c4-17c5fecd29fa tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:01.540614 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d8ecc5fe-1e74-4006-a4c4-17c5fecd29fa tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:01.544726 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1a474ed4-0954-4f38-bccb-b33ac037e6bb req-7decd3cf-47a6-4962-a1e5-aed19766f14e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:01.545274 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1a474ed4-0954-4f38-bccb-b33ac037e6bb req-7decd3cf-47a6-4962-a1e5-aed19766f14e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:01.545967 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-1a474ed4-0954-4f38-bccb-b33ac037e6bb req-7decd3cf-47a6-4962-a1e5-aed19766f14e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:01.557900 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-1a474ed4-0954-4f38-bccb-b33ac037e6bb req-7decd3cf-47a6-4962-a1e5-aed19766f14e service nova] Creating event network-changed:eddfbd2b-ea1e-4e09-b6f0-a49e1aa700db for instance 4dd36a5c-853d-4f33-98cf-48e7274dbb48 on n-h1-862967-2 Oct 29 04:06:01.563732 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-1a474ed4-0954-4f38-bccb-b33ac037e6bb req-7decd3cf-47a6-4962-a1e5-aed19766f14e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038624 Oct 29 04:06:01.564344 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3803/7381] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:06:01.574579 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d8ecc5fe-1e74-4006-a4c4-17c5fecd29fa tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 04:06:01.663145 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d8ecc5fe-1e74-4006-a4c4-17c5fecd29fa tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48" status: 204 len: 0 microversion: 2.1 time: 0.140291 Oct 29 04:06:01.664106 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3579/7382] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 04:06:01 2022] DELETE /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 04:06:01.675001 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d4328197-ba74-405f-934f-f030673dd0bb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:01.675937 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d4328197-ba74-405f-934f-f030673dd0bb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:01.688746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4328197-ba74-405f-934f-f030673dd0bb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:01.689545 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4328197-ba74-405f-934f-f030673dd0bb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:01.690583 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4328197-ba74-405f-934f-f030673dd0bb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:01.691729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4328197-ba74-405f-934f-f030673dd0bb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:01.692672 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4328197-ba74-405f-934f-f030673dd0bb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:01.693484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d4328197-ba74-405f-934f-f030673dd0bb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:01.863502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-d4328197-ba74-405f-934f-f030673dd0bb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:06:01.871768 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d4328197-ba74-405f-934f-f030673dd0bb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48" status: 200 len: 1689 microversion: 2.1 time: 0.202235 Oct 29 04:06:01.872359 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3804/7383] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:01 2022] GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 => generated 1689 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:06:02.899445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6680312f-505d-4fcb-ae97-8e9343534a96 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:02.900218 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6680312f-505d-4fcb-ae97-8e9343534a96 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:02.908556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6680312f-505d-4fcb-ae97-8e9343534a96 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:02.909137 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6680312f-505d-4fcb-ae97-8e9343534a96 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:02.909668 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6680312f-505d-4fcb-ae97-8e9343534a96 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:02.910533 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6680312f-505d-4fcb-ae97-8e9343534a96 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:02.911055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6680312f-505d-4fcb-ae97-8e9343534a96 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:02.911719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6680312f-505d-4fcb-ae97-8e9343534a96 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:03.062841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6680312f-505d-4fcb-ae97-8e9343534a96 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:06:03.073610 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6680312f-505d-4fcb-ae97-8e9343534a96 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48" status: 200 len: 1689 microversion: 2.1 time: 0.179502 Oct 29 04:06:03.074578 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3580/7384] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:02 2022] GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 => generated 1689 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:06:03.906759 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-d4d4d135-7cdd-470f-acf8-73c37a097066 req-a9dee235-37a1-40e8-9805-9c1148c50936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dd36a5c-853d-4f33-98cf-48e7274dbb48", "name": "network-vif-deleted", "tag": "eddfbd2b-ea1e-4e09-b6f0-a49e1aa700db"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:06:03.919130 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d4d4d135-7cdd-470f-acf8-73c37a097066 req-a9dee235-37a1-40e8-9805-9c1148c50936 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:03.920324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d4d4d135-7cdd-470f-acf8-73c37a097066 req-a9dee235-37a1-40e8-9805-9c1148c50936 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:03.920816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-d4d4d135-7cdd-470f-acf8-73c37a097066 req-a9dee235-37a1-40e8-9805-9c1148c50936 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:03.933916 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-d4d4d135-7cdd-470f-acf8-73c37a097066 req-a9dee235-37a1-40e8-9805-9c1148c50936 service nova] Creating event network-vif-deleted:eddfbd2b-ea1e-4e09-b6f0-a49e1aa700db for instance 4dd36a5c-853d-4f33-98cf-48e7274dbb48 on n-h1-862967-2 Oct 29 04:06:03.940014 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-d4d4d135-7cdd-470f-acf8-73c37a097066 req-a9dee235-37a1-40e8-9805-9c1148c50936 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037255 Oct 29 04:06:03.940679 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3805/7385] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:06:04.097657 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c0b989b8-7ab0-43bd-a35d-70524e7858cb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:04.098321 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c0b989b8-7ab0-43bd-a35d-70524e7858cb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:04.105504 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0b989b8-7ab0-43bd-a35d-70524e7858cb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:04.106008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0b989b8-7ab0-43bd-a35d-70524e7858cb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:04.106527 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0b989b8-7ab0-43bd-a35d-70524e7858cb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:04.107229 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0b989b8-7ab0-43bd-a35d-70524e7858cb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:04.107673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0b989b8-7ab0-43bd-a35d-70524e7858cb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:04.108108 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0b989b8-7ab0-43bd-a35d-70524e7858cb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:04.140429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0b989b8-7ab0-43bd-a35d-70524e7858cb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:04.140892 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0b989b8-7ab0-43bd-a35d-70524e7858cb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:04.141338 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c0b989b8-7ab0-43bd-a35d-70524e7858cb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:04.141793 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-c0b989b8-7ab0-43bd-a35d-70524e7858cb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lazy-loading 'fault' on Instance uuid 4dd36a5c-853d-4f33-98cf-48e7274dbb48 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 04:06:04.191044 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c0b989b8-7ab0-43bd-a35d-70524e7858cb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:06:04.200055 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c0b989b8-7ab0-43bd-a35d-70524e7858cb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48" status: 200 len: 1356 microversion: 2.1 time: 0.106202 Oct 29 04:06:04.209561 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3581/7386] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:04 2022] GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 => generated 1356 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:06:05.230048 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d8eb7d65-9d66-4cd3-a0c4-87abe8b91988 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:05.230802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d8eb7d65-9d66-4cd3-a0c4-87abe8b91988 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: 4dd36a5c-853d-4f33-98cf-48e7274dbb48] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:05.237895 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8eb7d65-9d66-4cd3-a0c4-87abe8b91988 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:05.238727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8eb7d65-9d66-4cd3-a0c4-87abe8b91988 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:05.239182 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8eb7d65-9d66-4cd3-a0c4-87abe8b91988 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:05.239917 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8eb7d65-9d66-4cd3-a0c4-87abe8b91988 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:05.240415 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8eb7d65-9d66-4cd3-a0c4-87abe8b91988 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:05.240860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8eb7d65-9d66-4cd3-a0c4-87abe8b91988 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:05.255541 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-d8eb7d65-9d66-4cd3-a0c4-87abe8b91988 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] HTTP exception thrown: Instance 4dd36a5c-853d-4f33-98cf-48e7274dbb48 could not be found. Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d8eb7d65-9d66-4cd3-a0c4-87abe8b91988 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Request method failure captured: Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 HTTP/1.1 Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXKUo0_mrT7RmIg7xwBr8IFILx8owR6S_7fbkYMDM3yKtVViQvdfHhgImK2tLNoi-DKhagj3xbECEfbniUg9pO0t5aY8w58qiHmIe3llBDaRK81PNEp7hhgTWe4zv3Mc__1xDWYdZL84JZ9C1u9d6A3xFbzEWOXw9Pdm2mYWXRVUQcjw Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 6db83678d78d49ff9768ba55d1a7d70d Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2052576324 Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6db83678d78d49ff9768ba55d1a7d70d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6db83678d78d49ff9768ba55d1a7d70d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6db83678d78d49ff9768ba55d1a7d70d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6db83678d78d49ff9768ba55d1a7d70d"}]}] Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2052576324 Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 6db83678d78d49ff9768ba55d1a7d70d Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2052576324 Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-TestNetworkAdvancedServerOps-2052576324-project Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: f75948d4d49e47f69900a9b8ece27999 Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2052576324-project Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance 4dd36a5c-853d-4f33-98cf-48e7274dbb48 could not be found. Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': '4dd36a5c-853d-4f33-98cf-48e7274dbb48'} Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dd36a5c-853d-4f33-98cf-48e7274dbb48 could not be found. Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dd36a5c-853d-4f33-98cf-48e7274dbb48 could not be found. Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 04:06:05.257349 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:06:05.262856 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 04:06:05.262856 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:06:05.262856 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:06:05.262856 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:06:05.262856 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 04:06:05.262856 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 04:06:05.262856 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dd36a5c-853d-4f33-98cf-48e7274dbb48 could not be found. Oct 29 04:06:05.262856 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 04:06:05.262856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d8eb7d65-9d66-4cd3-a0c4-87abe8b91988 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Returning 404 to user: Instance 4dd36a5c-853d-4f33-98cf-48e7274dbb48 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 04:06:05.262856 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d8eb7d65-9d66-4cd3-a0c4-87abe8b91988 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48" status: 404 len: 111 microversion: 2.1 time: 0.035916 Oct 29 04:06:05.262856 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3806/7387] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:05 2022] GET /compute/v2.1/servers/4dd36a5c-853d-4f33-98cf-48e7274dbb48 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 04:06:08.897395 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3e5f49b8-54c2-42aa-8dcd-bbcf83ca8b98 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '.version_select at 0x7ff052cae430>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:08.919704 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3e5f49b8-54c2-42aa-8dcd-bbcf83ca8b98 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1802147096" status: 202 len: 0 microversion: 2.1 time: 0.026068 Oct 29 04:06:08.921277 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3582/7388] 10.222.0.46 () {58 vars in 1284 bytes} [Sat Oct 29 04:06:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1802147096 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:06:08.953377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c32adfc1-7e1c-4caa-a99d-0d43b4b2d3b3 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'create', calling method: .version_select at 0x7ff05c1a9ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1639092763", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCw5Cgk3S17x3qoesdmO2K0GsiLsI/3DuvzALoYAVdIqrRulYsoVGf8Jg8nN7WzgIO5cMHnUXLfVBr889cIvmtU4KZml4iVFSODZgsa3Seic0CTppyRVto4HTCmZ9QtSSA=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:06:08.969985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-c32adfc1-7e1c-4caa-a99d-0d43b4b2d3b3 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Getting quotas for project 6db83678d78d49ff9768ba55d1a7d70d. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:06:08.976490 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-c32adfc1-7e1c-4caa-a99d-0d43b4b2d3b3 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Getting quotas for user f75948d4d49e47f69900a9b8ece27999 and project 6db83678d78d49ff9768ba55d1a7d70d. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:06:09.002101 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c32adfc1-7e1c-4caa-a99d-0d43b4b2d3b3 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052068 Oct 29 04:06:09.002709 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3807/7389] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 04:06:08 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:06:14.410976 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:06:14.416082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3bb0515e-cb01-42ae-bcd5-cd63dab9b8ac tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1088036781", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "networks": [{"uuid": "853a4c4e-3c81-4101-8025-b0fd05df328d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1639092763", "security_groups": [{"name": "tempest-secgroup-smoke-405743763"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:06:14.538824 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-3bb0515e-cb01-42ae-bcd5-cd63dab9b8ac tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] validate_networks() for [('853a4c4e-3c81-4101-8025-b0fd05df328d', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 04:06:14.954452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-3bb0515e-cb01-42ae-bcd5-cd63dab9b8ac tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 04:06:14.954787 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-3bb0515e-cb01-42ae-bcd5-cd63dab9b8ac tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 04:06:14.955269 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-3bb0515e-cb01-42ae-bcd5-cd63dab9b8ac tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 04:06:14.955685 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-3bb0515e-cb01-42ae-bcd5-cd63dab9b8ac tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 04:06:14.956105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-3bb0515e-cb01-42ae-bcd5-cd63dab9b8ac tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 04:06:14.967243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bb0515e-cb01-42ae-bcd5-cd63dab9b8ac tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:14.967772 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bb0515e-cb01-42ae-bcd5-cd63dab9b8ac tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:14.968302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bb0515e-cb01-42ae-bcd5-cd63dab9b8ac tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:14.969024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bb0515e-cb01-42ae-bcd5-cd63dab9b8ac tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:14.969493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bb0515e-cb01-42ae-bcd5-cd63dab9b8ac tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:14.969919 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3bb0515e-cb01-42ae-bcd5-cd63dab9b8ac tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:14.990290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-3bb0515e-cb01-42ae-bcd5-cd63dab9b8ac tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Getting quotas for project 6db83678d78d49ff9768ba55d1a7d70d. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:06:14.996110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-3bb0515e-cb01-42ae-bcd5-cd63dab9b8ac tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Getting quotas for user f75948d4d49e47f69900a9b8ece27999 and project 6db83678d78d49ff9768ba55d1a7d70d. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:06:15.013253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3bb0515e-cb01-42ae-bcd5-cd63dab9b8ac tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 04:06:15.015868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3bb0515e-cb01-42ae-bcd5-cd63dab9b8ac tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: b97ff846-c80c-4492-b14c-4a3c5914e4e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 04:06:15.073509 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3bb0515e-cb01-42ae-bcd5-cd63dab9b8ac tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.664679 Oct 29 04:06:15.074825 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3583/7390] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 04:06:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 04:06:15.086785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3192b220-4766-4b7a-bc80-2ca350a0bf88 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:15.087506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3192b220-4766-4b7a-bc80-2ca350a0bf88 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: b97ff846-c80c-4492-b14c-4a3c5914e4e3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:15.149247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3192b220-4766-4b7a-bc80-2ca350a0bf88 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:06:15.156775 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3192b220-4766-4b7a-bc80-2ca350a0bf88 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3" status: 200 len: 1267 microversion: 2.1 time: 0.074784 Oct 29 04:06:15.157507 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3808/7391] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:15 2022] GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3 => generated 1267 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:06:16.179981 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-89edbe83-6665-4826-8f38-b5bcb72bc8df tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:16.180610 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-89edbe83-6665-4826-8f38-b5bcb72bc8df tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: b97ff846-c80c-4492-b14c-4a3c5914e4e3] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:16.189128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89edbe83-6665-4826-8f38-b5bcb72bc8df tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:16.189935 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89edbe83-6665-4826-8f38-b5bcb72bc8df tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:16.190564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89edbe83-6665-4826-8f38-b5bcb72bc8df tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:16.191491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89edbe83-6665-4826-8f38-b5bcb72bc8df tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:16.192493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89edbe83-6665-4826-8f38-b5bcb72bc8df tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:16.193326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89edbe83-6665-4826-8f38-b5bcb72bc8df tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:16.276142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-89edbe83-6665-4826-8f38-b5bcb72bc8df tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:06:16.285087 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-89edbe83-6665-4826-8f38-b5bcb72bc8df tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3" status: 200 len: 1337 microversion: 2.1 time: 0.109615 Oct 29 04:06:16.287113 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3584/7392] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:16 2022] GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3 => generated 1337 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:06:17.310439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fdffb700-6a97-4eb2-96a4-22b3f66e155b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:17.311823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fdffb700-6a97-4eb2-96a4-22b3f66e155b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: b97ff846-c80c-4492-b14c-4a3c5914e4e3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:17.313518 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=16 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:06:17.320546 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fdffb700-6a97-4eb2-96a4-22b3f66e155b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:17.321437 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fdffb700-6a97-4eb2-96a4-22b3f66e155b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:17.321872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fdffb700-6a97-4eb2-96a4-22b3f66e155b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:17.322797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fdffb700-6a97-4eb2-96a4-22b3f66e155b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:17.323297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fdffb700-6a97-4eb2-96a4-22b3f66e155b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:17.323722 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fdffb700-6a97-4eb2-96a4-22b3f66e155b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:17.575691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fdffb700-6a97-4eb2-96a4-22b3f66e155b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:06:17.586074 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fdffb700-6a97-4eb2-96a4-22b3f66e155b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3" status: 200 len: 1392 microversion: 2.1 time: 0.278734 Oct 29 04:06:17.587309 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3809/7393] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:17 2022] GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3 => generated 1392 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:06:17.739165 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-94a5341f-275c-4717-befc-0bf9a8081e72 req-bf0ad476-d348-4f7a-918c-78478cfc994a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b97ff846-c80c-4492-b14c-4a3c5914e4e3", "tag": "2ab7a556-37ab-4845-8212-3af6cfbb7633"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:06:17.759282 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-94a5341f-275c-4717-befc-0bf9a8081e72 req-bf0ad476-d348-4f7a-918c-78478cfc994a service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:17.760344 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-94a5341f-275c-4717-befc-0bf9a8081e72 req-bf0ad476-d348-4f7a-918c-78478cfc994a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:17.761020 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-94a5341f-275c-4717-befc-0bf9a8081e72 req-bf0ad476-d348-4f7a-918c-78478cfc994a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:17.776178 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-94a5341f-275c-4717-befc-0bf9a8081e72 req-bf0ad476-d348-4f7a-918c-78478cfc994a service nova] Creating event network-changed:2ab7a556-37ab-4845-8212-3af6cfbb7633 for instance b97ff846-c80c-4492-b14c-4a3c5914e4e3 on n-h2-862967-2 Oct 29 04:06:17.786460 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-94a5341f-275c-4717-befc-0bf9a8081e72 req-bf0ad476-d348-4f7a-918c-78478cfc994a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053112 Oct 29 04:06:17.787774 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3585/7394] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:06:18.610718 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-cf6214fd-69bf-4c7e-a02f-70762aee4f7b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:18.611309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-cf6214fd-69bf-4c7e-a02f-70762aee4f7b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: b97ff846-c80c-4492-b14c-4a3c5914e4e3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:18.618618 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf6214fd-69bf-4c7e-a02f-70762aee4f7b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:18.619114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf6214fd-69bf-4c7e-a02f-70762aee4f7b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:18.619536 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf6214fd-69bf-4c7e-a02f-70762aee4f7b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:18.620233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf6214fd-69bf-4c7e-a02f-70762aee4f7b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:18.620724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf6214fd-69bf-4c7e-a02f-70762aee4f7b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:18.621150 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-cf6214fd-69bf-4c7e-a02f-70762aee4f7b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:18.770634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-cf6214fd-69bf-4c7e-a02f-70762aee4f7b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:06:18.778830 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-cf6214fd-69bf-4c7e-a02f-70762aee4f7b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3" status: 200 len: 1392 microversion: 2.1 time: 0.172282 Oct 29 04:06:18.779392 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3810/7395] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:18 2022] GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3 => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:06:19.802821 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-89e43fd9-eac6-4c11-9afe-d2964874deb0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:19.803560 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-89e43fd9-eac6-4c11-9afe-d2964874deb0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: b97ff846-c80c-4492-b14c-4a3c5914e4e3] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:19.810982 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89e43fd9-eac6-4c11-9afe-d2964874deb0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:19.811458 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89e43fd9-eac6-4c11-9afe-d2964874deb0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:19.811911 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89e43fd9-eac6-4c11-9afe-d2964874deb0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:19.812730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89e43fd9-eac6-4c11-9afe-d2964874deb0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:19.813204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89e43fd9-eac6-4c11-9afe-d2964874deb0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:19.813664 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89e43fd9-eac6-4c11-9afe-d2964874deb0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:19.953834 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-89e43fd9-eac6-4c11-9afe-d2964874deb0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:06:19.963633 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-89e43fd9-eac6-4c11-9afe-d2964874deb0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3" status: 200 len: 1392 microversion: 2.1 time: 0.165167 Oct 29 04:06:19.964234 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3586/7396] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:19 2022] GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:06:20.990584 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-18c022bd-c965-4b46-be19-7455ef8bf23a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:20.991748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-18c022bd-c965-4b46-be19-7455ef8bf23a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: b97ff846-c80c-4492-b14c-4a3c5914e4e3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:20.999478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-18c022bd-c965-4b46-be19-7455ef8bf23a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:20.999966 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-18c022bd-c965-4b46-be19-7455ef8bf23a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:21.000400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-18c022bd-c965-4b46-be19-7455ef8bf23a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:21.001132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-18c022bd-c965-4b46-be19-7455ef8bf23a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:21.001581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-18c022bd-c965-4b46-be19-7455ef8bf23a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:21.001997 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-18c022bd-c965-4b46-be19-7455ef8bf23a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:21.151617 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-18c022bd-c965-4b46-be19-7455ef8bf23a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:06:21.160066 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-18c022bd-c965-4b46-be19-7455ef8bf23a tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3" status: 200 len: 1392 microversion: 2.1 time: 0.176433 Oct 29 04:06:21.160676 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3811/7397] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:20 2022] GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3 => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:06:22.184987 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-e0839687-8ac0-49d2-a4fa-b3f94d828290 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:22.185802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-e0839687-8ac0-49d2-a4fa-b3f94d828290 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: b97ff846-c80c-4492-b14c-4a3c5914e4e3] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:22.193747 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0839687-8ac0-49d2-a4fa-b3f94d828290 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:22.194255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0839687-8ac0-49d2-a4fa-b3f94d828290 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:22.194725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0839687-8ac0-49d2-a4fa-b3f94d828290 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:22.196096 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0839687-8ac0-49d2-a4fa-b3f94d828290 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:22.196596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0839687-8ac0-49d2-a4fa-b3f94d828290 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:22.198490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-e0839687-8ac0-49d2-a4fa-b3f94d828290 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:22.336306 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-e0839687-8ac0-49d2-a4fa-b3f94d828290 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:06:22.344787 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-e0839687-8ac0-49d2-a4fa-b3f94d828290 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3" status: 200 len: 1392 microversion: 2.1 time: 0.165008 Oct 29 04:06:22.345334 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3587/7398] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:22 2022] GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:06:23.371023 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-fd02e818-654e-49a9-822e-524963b0fad3 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:23.371741 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-fd02e818-654e-49a9-822e-524963b0fad3 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: b97ff846-c80c-4492-b14c-4a3c5914e4e3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:23.380291 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd02e818-654e-49a9-822e-524963b0fad3 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:23.380901 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd02e818-654e-49a9-822e-524963b0fad3 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:23.381422 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd02e818-654e-49a9-822e-524963b0fad3 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:23.382260 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd02e818-654e-49a9-822e-524963b0fad3 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:23.382799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd02e818-654e-49a9-822e-524963b0fad3 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:23.383308 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-fd02e818-654e-49a9-822e-524963b0fad3 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:23.516803 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-fd02e818-654e-49a9-822e-524963b0fad3 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:06:23.524778 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-fd02e818-654e-49a9-822e-524963b0fad3 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3" status: 200 len: 1392 microversion: 2.1 time: 0.158880 Oct 29 04:06:23.525358 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3812/7399] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:23 2022] GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:06:24.067092 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-dfe489f9-b73d-475b-b89a-6a92ed75a49e req-83079c38-5375-4468-8112-55ab562ea6d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97ff846-c80c-4492-b14c-4a3c5914e4e3", "name": "network-vif-plugged", "status": "completed", "tag": "2ab7a556-37ab-4845-8212-3af6cfbb7633"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:06:24.078420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-dfe489f9-b73d-475b-b89a-6a92ed75a49e req-83079c38-5375-4468-8112-55ab562ea6d2 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:24.079199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-dfe489f9-b73d-475b-b89a-6a92ed75a49e req-83079c38-5375-4468-8112-55ab562ea6d2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:24.079655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-dfe489f9-b73d-475b-b89a-6a92ed75a49e req-83079c38-5375-4468-8112-55ab562ea6d2 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:24.092065 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-dfe489f9-b73d-475b-b89a-6a92ed75a49e req-83079c38-5375-4468-8112-55ab562ea6d2 service nova] Creating event network-vif-plugged:2ab7a556-37ab-4845-8212-3af6cfbb7633 for instance b97ff846-c80c-4492-b14c-4a3c5914e4e3 on n-h2-862967-2 Oct 29 04:06:24.097342 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-dfe489f9-b73d-475b-b89a-6a92ed75a49e req-83079c38-5375-4468-8112-55ab562ea6d2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035600 Oct 29 04:06:24.097954 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3588/7400] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:06:24.552065 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e43baff6-f884-419e-a5bf-6afb45f6fab0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:24.553202 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e43baff6-f884-419e-a5bf-6afb45f6fab0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: b97ff846-c80c-4492-b14c-4a3c5914e4e3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:24.557441 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:06:24.566586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e43baff6-f884-419e-a5bf-6afb45f6fab0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:24.567378 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e43baff6-f884-419e-a5bf-6afb45f6fab0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:24.568114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e43baff6-f884-419e-a5bf-6afb45f6fab0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:24.569287 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e43baff6-f884-419e-a5bf-6afb45f6fab0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:24.570034 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e43baff6-f884-419e-a5bf-6afb45f6fab0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:24.570875 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e43baff6-f884-419e-a5bf-6afb45f6fab0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:24.712024 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e43baff6-f884-419e-a5bf-6afb45f6fab0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:06:24.720385 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e43baff6-f884-419e-a5bf-6afb45f6fab0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3" status: 200 len: 1392 microversion: 2.1 time: 0.174881 Oct 29 04:06:24.721009 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3813/7401] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:24 2022] GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3 => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:06:25.748968 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:06:25.749779 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:06:25.755059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3a7fd6de-d6f4-4bb9-ae20-5bf2273a9472 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:25.755786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3a7fd6de-d6f4-4bb9-ae20-5bf2273a9472 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: b97ff846-c80c-4492-b14c-4a3c5914e4e3] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:25.762937 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a7fd6de-d6f4-4bb9-ae20-5bf2273a9472 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:25.763446 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a7fd6de-d6f4-4bb9-ae20-5bf2273a9472 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:25.763889 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a7fd6de-d6f4-4bb9-ae20-5bf2273a9472 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:25.764607 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a7fd6de-d6f4-4bb9-ae20-5bf2273a9472 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:25.765065 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a7fd6de-d6f4-4bb9-ae20-5bf2273a9472 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:25.765488 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a7fd6de-d6f4-4bb9-ae20-5bf2273a9472 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:25.905605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3a7fd6de-d6f4-4bb9-ae20-5bf2273a9472 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:06:25.913996 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3a7fd6de-d6f4-4bb9-ae20-5bf2273a9472 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3" status: 200 len: 1563 microversion: 2.1 time: 0.166071 Oct 29 04:06:25.914641 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3589/7402] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:25 2022] GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3 => generated 1563 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:06:25.939553 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9fc4a365-9932-4274-8b02-17ed3d697ef8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:25.940189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9fc4a365-9932-4274-8b02-17ed3d697ef8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: b97ff846-c80c-4492-b14c-4a3c5914e4e3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:25.942899 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:06:25.950178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fc4a365-9932-4274-8b02-17ed3d697ef8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:25.950671 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fc4a365-9932-4274-8b02-17ed3d697ef8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:25.951115 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fc4a365-9932-4274-8b02-17ed3d697ef8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:25.951839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fc4a365-9932-4274-8b02-17ed3d697ef8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:25.952275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fc4a365-9932-4274-8b02-17ed3d697ef8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:25.952749 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9fc4a365-9932-4274-8b02-17ed3d697ef8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:26.099699 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9fc4a365-9932-4274-8b02-17ed3d697ef8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:06:26.108065 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9fc4a365-9932-4274-8b02-17ed3d697ef8 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3" status: 200 len: 1563 microversion: 2.1 time: 0.175114 Oct 29 04:06:26.108690 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3814/7403] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:25 2022] GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3 => generated 1563 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:06:27.772075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-94182564-6d57-4ff4-8871-768bdb2cdb89 req-904954b8-1ca1-4318-9e7e-dba73ae6659e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b97ff846-c80c-4492-b14c-4a3c5914e4e3", "tag": "2ab7a556-37ab-4845-8212-3af6cfbb7633"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:06:27.773236 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-eb694bb5-82dd-401c-8d19-b5e4dc45dff1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:06:27.774041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-eb694bb5-82dd-401c-8d19-b5e4dc45dff1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: b97ff846-c80c-4492-b14c-4a3c5914e4e3] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:27.781389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb694bb5-82dd-401c-8d19-b5e4dc45dff1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:27.781958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb694bb5-82dd-401c-8d19-b5e4dc45dff1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:27.782413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb694bb5-82dd-401c-8d19-b5e4dc45dff1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:27.783138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb694bb5-82dd-401c-8d19-b5e4dc45dff1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:27.783606 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb694bb5-82dd-401c-8d19-b5e4dc45dff1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:27.784194 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-eb694bb5-82dd-401c-8d19-b5e4dc45dff1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:27.785778 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-94182564-6d57-4ff4-8871-768bdb2cdb89 req-904954b8-1ca1-4318-9e7e-dba73ae6659e service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:27.786606 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-94182564-6d57-4ff4-8871-768bdb2cdb89 req-904954b8-1ca1-4318-9e7e-dba73ae6659e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:27.787117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-94182564-6d57-4ff4-8871-768bdb2cdb89 req-904954b8-1ca1-4318-9e7e-dba73ae6659e service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:27.800490 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-94182564-6d57-4ff4-8871-768bdb2cdb89 req-904954b8-1ca1-4318-9e7e-dba73ae6659e service nova] Creating event network-changed:2ab7a556-37ab-4845-8212-3af6cfbb7633 for instance b97ff846-c80c-4492-b14c-4a3c5914e4e3 on n-h2-862967-2 Oct 29 04:06:27.806870 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-94182564-6d57-4ff4-8871-768bdb2cdb89 req-904954b8-1ca1-4318-9e7e-dba73ae6659e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038346 Oct 29 04:06:27.808140 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3815/7404] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:06:27.937497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-eb694bb5-82dd-401c-8d19-b5e4dc45dff1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:06:27.949126 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-eb694bb5-82dd-401c-8d19-b5e4dc45dff1 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3" status: 200 len: 1563 microversion: 2.1 time: 0.181026 Oct 29 04:06:27.950566 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3590/7405] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:06:27 2022] GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3 => generated 1563 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:06:49.233707 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=5 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:06:49.234542 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=38 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:06:49.239816 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d18fa6da-5ce4-4f90-aea1-26e0cbd320b7 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:06:49.242153 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d18fa6da-5ce4-4f90-aea1-26e0cbd320b7 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: b97ff846-c80c-4492-b14c-4a3c5914e4e3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:06:49.249217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d18fa6da-5ce4-4f90-aea1-26e0cbd320b7 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:49.249700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d18fa6da-5ce4-4f90-aea1-26e0cbd320b7 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:49.250133 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d18fa6da-5ce4-4f90-aea1-26e0cbd320b7 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:49.250917 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d18fa6da-5ce4-4f90-aea1-26e0cbd320b7 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:06:49.251406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d18fa6da-5ce4-4f90-aea1-26e0cbd320b7 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:06:49.251830 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d18fa6da-5ce4-4f90-aea1-26e0cbd320b7 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:06:49.305632 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d18fa6da-5ce4-4f90-aea1-26e0cbd320b7 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3/action" status: 200 len: 24568 microversion: 2.1 time: 0.073267 Oct 29 04:06:49.306496 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3816/7406] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 04:06:49 2022] POST /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3/action => generated 24568 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 04:07:00.350151 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0cf659a4-b9a9-46bf-b51e-cbc990ad21eb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:07:00.350760 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0cf659a4-b9a9-46bf-b51e-cbc990ad21eb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: b97ff846-c80c-4492-b14c-4a3c5914e4e3] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:00.352885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:07:00.353592 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=36 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:07:00.360347 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0cf659a4-b9a9-46bf-b51e-cbc990ad21eb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:00.360872 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0cf659a4-b9a9-46bf-b51e-cbc990ad21eb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:00.361327 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0cf659a4-b9a9-46bf-b51e-cbc990ad21eb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:00.362037 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0cf659a4-b9a9-46bf-b51e-cbc990ad21eb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:00.362514 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0cf659a4-b9a9-46bf-b51e-cbc990ad21eb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:00.363315 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0cf659a4-b9a9-46bf-b51e-cbc990ad21eb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:00.389212 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-0cf659a4-b9a9-46bf-b51e-cbc990ad21eb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lazy-loading 'flavor' on Instance uuid b97ff846-c80c-4492-b14c-4a3c5914e4e3 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 04:07:00.469193 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0cf659a4-b9a9-46bf-b51e-cbc990ad21eb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3/action" status: 202 len: 0 microversion: 2.1 time: 0.125368 Oct 29 04:07:00.470027 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3591/7407] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 04:07:00 2022] POST /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:07:00.479609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e5ba18f8-d76c-435b-be54-01424b519181 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:00.480332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e5ba18f8-d76c-435b-be54-01424b519181 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: b97ff846-c80c-4492-b14c-4a3c5914e4e3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:00.484045 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:07:00.484716 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=4 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:07:00.494283 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e5ba18f8-d76c-435b-be54-01424b519181 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:00.494770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e5ba18f8-d76c-435b-be54-01424b519181 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:00.495198 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e5ba18f8-d76c-435b-be54-01424b519181 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:00.495902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e5ba18f8-d76c-435b-be54-01424b519181 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:00.496356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e5ba18f8-d76c-435b-be54-01424b519181 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:00.496797 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e5ba18f8-d76c-435b-be54-01424b519181 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:00.649046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e5ba18f8-d76c-435b-be54-01424b519181 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:00.660633 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e5ba18f8-d76c-435b-be54-01424b519181 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3" status: 200 len: 1689 microversion: 2.1 time: 0.185821 Oct 29 04:07:00.661675 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3817/7408] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:00 2022] GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3 => generated 1689 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:01.690803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-411ce300-9b8f-4659-a155-f92f051d364c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:01.691576 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-411ce300-9b8f-4659-a155-f92f051d364c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: b97ff846-c80c-4492-b14c-4a3c5914e4e3] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:01.698356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-411ce300-9b8f-4659-a155-f92f051d364c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:01.698856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-411ce300-9b8f-4659-a155-f92f051d364c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:01.699307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-411ce300-9b8f-4659-a155-f92f051d364c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:01.700016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-411ce300-9b8f-4659-a155-f92f051d364c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:01.700481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-411ce300-9b8f-4659-a155-f92f051d364c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:01.700961 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-411ce300-9b8f-4659-a155-f92f051d364c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:01.840899 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-411ce300-9b8f-4659-a155-f92f051d364c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:01.848913 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-411ce300-9b8f-4659-a155-f92f051d364c tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3" status: 200 len: 1672 microversion: 2.1 time: 0.163934 Oct 29 04:07:01.849496 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3592/7409] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:01 2022] GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3 => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:02.967978 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-78119e28-d68c-4163-af19-e94bc3cf828b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:07:02.971444 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-78119e28-d68c-4163-af19-e94bc3cf828b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: b97ff846-c80c-4492-b14c-4a3c5914e4e3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:02.979956 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78119e28-d68c-4163-af19-e94bc3cf828b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:02.980608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78119e28-d68c-4163-af19-e94bc3cf828b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:02.980913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78119e28-d68c-4163-af19-e94bc3cf828b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:02.981613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78119e28-d68c-4163-af19-e94bc3cf828b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:02.982060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78119e28-d68c-4163-af19-e94bc3cf828b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:02.982484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-78119e28-d68c-4163-af19-e94bc3cf828b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:03.035819 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-78119e28-d68c-4163-af19-e94bc3cf828b tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3/action" status: 200 len: 38400 microversion: 2.1 time: 0.074329 Oct 29 04:07:03.036556 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3818/7410] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 04:07:02 2022] POST /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3/action => generated 38400 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 04:07:03.051253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-0a27d010-654d-44df-9789-f786730ef904 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:07:03.051894 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-0a27d010-654d-44df-9789-f786730ef904 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: b97ff846-c80c-4492-b14c-4a3c5914e4e3] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:03.059986 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a27d010-654d-44df-9789-f786730ef904 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:03.060460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a27d010-654d-44df-9789-f786730ef904 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:03.060951 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a27d010-654d-44df-9789-f786730ef904 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:03.061667 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a27d010-654d-44df-9789-f786730ef904 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:03.062137 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a27d010-654d-44df-9789-f786730ef904 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:03.062572 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-0a27d010-654d-44df-9789-f786730ef904 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:03.144359 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-0a27d010-654d-44df-9789-f786730ef904 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3/action" status: 202 len: 0 microversion: 2.1 time: 0.098950 Oct 29 04:07:03.145063 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3593/7411] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 04:07:03 2022] POST /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:07:03.155971 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ac009092-92e2-467d-b682-68a8cc089e92 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:03.156839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ac009092-92e2-467d-b682-68a8cc089e92 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: b97ff846-c80c-4492-b14c-4a3c5914e4e3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:03.165170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ac009092-92e2-467d-b682-68a8cc089e92 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:03.166017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ac009092-92e2-467d-b682-68a8cc089e92 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:03.167089 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ac009092-92e2-467d-b682-68a8cc089e92 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:03.167834 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ac009092-92e2-467d-b682-68a8cc089e92 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:03.168288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ac009092-92e2-467d-b682-68a8cc089e92 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:03.168747 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ac009092-92e2-467d-b682-68a8cc089e92 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:03.387517 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ac009092-92e2-467d-b682-68a8cc089e92 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:03.396041 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ac009092-92e2-467d-b682-68a8cc089e92 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3" status: 200 len: 1678 microversion: 2.1 time: 0.244297 Oct 29 04:07:03.396716 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3819/7412] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:03 2022] GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3 => generated 1678 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:04.426853 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f55831e9-f1fb-4664-b912-429375197d59 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:04.427898 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f55831e9-f1fb-4664-b912-429375197d59 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: b97ff846-c80c-4492-b14c-4a3c5914e4e3] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:04.434991 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f55831e9-f1fb-4664-b912-429375197d59 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:04.435488 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f55831e9-f1fb-4664-b912-429375197d59 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:04.435939 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f55831e9-f1fb-4664-b912-429375197d59 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:04.436724 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f55831e9-f1fb-4664-b912-429375197d59 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:04.437194 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f55831e9-f1fb-4664-b912-429375197d59 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:04.437640 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f55831e9-f1fb-4664-b912-429375197d59 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:04.583650 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f55831e9-f1fb-4664-b912-429375197d59 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:04.592028 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f55831e9-f1fb-4664-b912-429375197d59 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3" status: 200 len: 1678 microversion: 2.1 time: 0.174005 Oct 29 04:07:04.592644 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3594/7413] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:04 2022] GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3 => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:05.621428 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f39a1521-1df4-4f94-8091-d8e0052958eb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:05.622103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f39a1521-1df4-4f94-8091-d8e0052958eb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: b97ff846-c80c-4492-b14c-4a3c5914e4e3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:05.634959 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f39a1521-1df4-4f94-8091-d8e0052958eb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:05.635530 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f39a1521-1df4-4f94-8091-d8e0052958eb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:05.636041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f39a1521-1df4-4f94-8091-d8e0052958eb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:05.636939 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f39a1521-1df4-4f94-8091-d8e0052958eb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:05.637481 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f39a1521-1df4-4f94-8091-d8e0052958eb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:05.637977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f39a1521-1df4-4f94-8091-d8e0052958eb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:05.779576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f39a1521-1df4-4f94-8091-d8e0052958eb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:05.792113 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f39a1521-1df4-4f94-8091-d8e0052958eb tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3" status: 200 len: 1681 microversion: 2.1 time: 0.175750 Oct 29 04:07:05.793016 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3820/7414] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:05 2022] GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3 => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:05.894706 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2a357132-05f9-4dcd-aa92-0f21f71f26cf tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:07:05.896999 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2a357132-05f9-4dcd-aa92-0f21f71f26cf tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: b97ff846-c80c-4492-b14c-4a3c5914e4e3] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:05.904189 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a357132-05f9-4dcd-aa92-0f21f71f26cf tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:05.904716 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a357132-05f9-4dcd-aa92-0f21f71f26cf tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:05.905175 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a357132-05f9-4dcd-aa92-0f21f71f26cf tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:05.905885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a357132-05f9-4dcd-aa92-0f21f71f26cf tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:05.906349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a357132-05f9-4dcd-aa92-0f21f71f26cf tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:05.906785 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2a357132-05f9-4dcd-aa92-0f21f71f26cf tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:05.949273 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2a357132-05f9-4dcd-aa92-0f21f71f26cf tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "POST /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3/action" status: 200 len: 38400 microversion: 2.1 time: 0.058496 Oct 29 04:07:05.949975 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3595/7415] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 04:07:05 2022] POST /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3/action => generated 38400 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 04:07:06.957807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0819e528-6c3a-4609-81e6-256c185c1bbc tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:06.958400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0819e528-6c3a-4609-81e6-256c185c1bbc tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: b97ff846-c80c-4492-b14c-4a3c5914e4e3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:06.959246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-c26c26de-383e-4bfe-9a84-57dbe6527021 req-6938e59d-fae0-4ac0-8b84-e12d8c0e2221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b97ff846-c80c-4492-b14c-4a3c5914e4e3", "tag": "2ab7a556-37ab-4845-8212-3af6cfbb7633"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:07:06.965601 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0819e528-6c3a-4609-81e6-256c185c1bbc tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:06.966143 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0819e528-6c3a-4609-81e6-256c185c1bbc tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:06.966549 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0819e528-6c3a-4609-81e6-256c185c1bbc tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:06.967341 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0819e528-6c3a-4609-81e6-256c185c1bbc tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:06.968059 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0819e528-6c3a-4609-81e6-256c185c1bbc tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:06.968446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0819e528-6c3a-4609-81e6-256c185c1bbc tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:06.970562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c26c26de-383e-4bfe-9a84-57dbe6527021 req-6938e59d-fae0-4ac0-8b84-e12d8c0e2221 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:06.971331 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c26c26de-383e-4bfe-9a84-57dbe6527021 req-6938e59d-fae0-4ac0-8b84-e12d8c0e2221 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:06.971775 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c26c26de-383e-4bfe-9a84-57dbe6527021 req-6938e59d-fae0-4ac0-8b84-e12d8c0e2221 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:06.985327 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-c26c26de-383e-4bfe-9a84-57dbe6527021 req-6938e59d-fae0-4ac0-8b84-e12d8c0e2221 service nova] Creating event network-changed:2ab7a556-37ab-4845-8212-3af6cfbb7633 for instance b97ff846-c80c-4492-b14c-4a3c5914e4e3 on n-h2-862967-2 Oct 29 04:07:06.991378 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-c26c26de-383e-4bfe-9a84-57dbe6527021 req-6938e59d-fae0-4ac0-8b84-e12d8c0e2221 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036166 Oct 29 04:07:06.992317 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3596/7416] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:07:06.996629 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0819e528-6c3a-4609-81e6-256c185c1bbc tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: b97ff846-c80c-4492-b14c-4a3c5914e4e3] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 04:07:07.092109 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0819e528-6c3a-4609-81e6-256c185c1bbc tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3" status: 204 len: 0 microversion: 2.1 time: 0.138204 Oct 29 04:07:07.096803 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3821/7417] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 04:07:06 2022] DELETE /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 04:07:07.102389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4565d51f-80fa-4ff4-82bd-5f82cee001dc tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:07.103128 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4565d51f-80fa-4ff4-82bd-5f82cee001dc tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: b97ff846-c80c-4492-b14c-4a3c5914e4e3] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:07.111170 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4565d51f-80fa-4ff4-82bd-5f82cee001dc tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:07.111673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4565d51f-80fa-4ff4-82bd-5f82cee001dc tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:07.112118 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4565d51f-80fa-4ff4-82bd-5f82cee001dc tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:07.113171 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4565d51f-80fa-4ff4-82bd-5f82cee001dc tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:07.113634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4565d51f-80fa-4ff4-82bd-5f82cee001dc tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:07.114061 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4565d51f-80fa-4ff4-82bd-5f82cee001dc tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:07.253715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4565d51f-80fa-4ff4-82bd-5f82cee001dc tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:07.262096 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4565d51f-80fa-4ff4-82bd-5f82cee001dc tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3" status: 200 len: 1687 microversion: 2.1 time: 0.164120 Oct 29 04:07:07.262769 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3597/7418] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:07 2022] GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 04:07:08.291349 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9b0073c3-6a3e-44ed-809a-8b6c43737682 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:08.292054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9b0073c3-6a3e-44ed-809a-8b6c43737682 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: b97ff846-c80c-4492-b14c-4a3c5914e4e3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:08.299420 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b0073c3-6a3e-44ed-809a-8b6c43737682 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:08.299921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b0073c3-6a3e-44ed-809a-8b6c43737682 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:08.300363 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b0073c3-6a3e-44ed-809a-8b6c43737682 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:08.301110 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b0073c3-6a3e-44ed-809a-8b6c43737682 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:08.301565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b0073c3-6a3e-44ed-809a-8b6c43737682 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:08.301991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9b0073c3-6a3e-44ed-809a-8b6c43737682 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:08.823463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9b0073c3-6a3e-44ed-809a-8b6c43737682 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75948d4d49e47f69900a9b8ece27999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db83678d78d49ff9768ba55d1a7d70d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:08.831986 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9b0073c3-6a3e-44ed-809a-8b6c43737682 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3" status: 200 len: 1687 microversion: 2.1 time: 0.546591 Oct 29 04:07:08.832841 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3822/7419] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:08 2022] GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3 => generated 1687 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:09.040204 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-833f272c-d676-4f92-9b21-d70c203d9844 req-50a119ab-7c59-4bda-94f4-af7c6c28b502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97ff846-c80c-4492-b14c-4a3c5914e4e3", "name": "network-vif-deleted", "tag": "2ab7a556-37ab-4845-8212-3af6cfbb7633"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:07:09.052210 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-833f272c-d676-4f92-9b21-d70c203d9844 req-50a119ab-7c59-4bda-94f4-af7c6c28b502 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:09.052723 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-833f272c-d676-4f92-9b21-d70c203d9844 req-50a119ab-7c59-4bda-94f4-af7c6c28b502 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:09.053164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-833f272c-d676-4f92-9b21-d70c203d9844 req-50a119ab-7c59-4bda-94f4-af7c6c28b502 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:09.065432 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-833f272c-d676-4f92-9b21-d70c203d9844 req-50a119ab-7c59-4bda-94f4-af7c6c28b502 service nova] Creating event network-vif-deleted:2ab7a556-37ab-4845-8212-3af6cfbb7633 for instance b97ff846-c80c-4492-b14c-4a3c5914e4e3 on n-h2-862967-2 Oct 29 04:07:09.072231 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-833f272c-d676-4f92-9b21-d70c203d9844 req-50a119ab-7c59-4bda-94f4-af7c6c28b502 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034830 Oct 29 04:07:09.072231 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3598/7420] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:07:09.857446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4d14a525-f101-4d81-85f2-18710952dbc0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:09.858069 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4d14a525-f101-4d81-85f2-18710952dbc0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] [instance: b97ff846-c80c-4492-b14c-4a3c5914e4e3] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:09.865868 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d14a525-f101-4d81-85f2-18710952dbc0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:09.866370 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d14a525-f101-4d81-85f2-18710952dbc0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:09.866810 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d14a525-f101-4d81-85f2-18710952dbc0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:09.867614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d14a525-f101-4d81-85f2-18710952dbc0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:09.868142 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d14a525-f101-4d81-85f2-18710952dbc0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:09.868655 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4d14a525-f101-4d81-85f2-18710952dbc0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:09.883533 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-4d14a525-f101-4d81-85f2-18710952dbc0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] HTTP exception thrown: Instance b97ff846-c80c-4492-b14c-4a3c5914e4e3 could not be found. Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4d14a525-f101-4d81-85f2-18710952dbc0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Request method failure captured: Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3 HTTP/1.1 Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXKUo0_mrT7RmIg7xwBr8IFILx8owR6S_7fbkYMDM3yKtVViQvdfHhgImK2tLNoi-DKhagj3xbECEfbniUg9pO0t5aY8w58qiHmIe3llBDaRK81PNEp7hhgTWe4zv3Mc__1xDWYdZL84JZ9C1u9d6A3xFbzEWOXw9Pdm2mYWXRVUQcjw Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: 6db83678d78d49ff9768ba55d1a7d70d Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2052576324 Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6db83678d78d49ff9768ba55d1a7d70d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6db83678d78d49ff9768ba55d1a7d70d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6db83678d78d49ff9768ba55d1a7d70d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6db83678d78d49ff9768ba55d1a7d70d"}]}] Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2052576324 Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: 6db83678d78d49ff9768ba55d1a7d70d Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2052576324 Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-TestNetworkAdvancedServerOps-2052576324-project Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: f75948d4d49e47f69900a9b8ece27999 Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2052576324-project Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance b97ff846-c80c-4492-b14c-4a3c5914e4e3 could not be found. Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'b97ff846-c80c-4492-b14c-4a3c5914e4e3'} Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b97ff846-c80c-4492-b14c-4a3c5914e4e3 could not be found. Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b97ff846-c80c-4492-b14c-4a3c5914e4e3 could not be found. Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 04:07:09.885249 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:07:09.890872 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 04:07:09.890872 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:07:09.890872 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:07:09.890872 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:07:09.890872 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 04:07:09.890872 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 04:07:09.890872 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b97ff846-c80c-4492-b14c-4a3c5914e4e3 could not be found. Oct 29 04:07:09.890872 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 04:07:09.890872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4d14a525-f101-4d81-85f2-18710952dbc0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Returning 404 to user: Instance b97ff846-c80c-4492-b14c-4a3c5914e4e3 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 04:07:09.890872 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4d14a525-f101-4d81-85f2-18710952dbc0 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3" status: 404 len: 111 microversion: 2.1 time: 0.033378 Oct 29 04:07:09.890872 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3823/7421] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:09 2022] GET /compute/v2.1/servers/b97ff846-c80c-4492-b14c-4a3c5914e4e3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 04:07:13.017454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c5450047-35ff-4144-b94e-90e95eae80b2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] Calling method '.version_select at 0x7ff052cae430>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:13.040839 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c5450047-35ff-4144-b94e-90e95eae80b2 tempest-TestNetworkAdvancedServerOps-2052576324 tempest-TestNetworkAdvancedServerOps-2052576324-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1639092763" status: 202 len: 0 microversion: 2.1 time: 0.027650 Oct 29 04:07:13.041726 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3599/7422] 10.222.0.46 () {58 vars in 1284 bytes} [Sat Oct 29 04:07:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1639092763 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 04:07:24.526904 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:07:24.527672 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:07:24.713528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3d92e077-79fb-42e3-a06e-e875c4180525 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Action: 'create', calling method: .version_select at 0x7ff058015550>, body: {"keypair": {"name": "tempest-TestShelveInstance-1747420352", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+Pse79xrpk/O96/HuDkf8SUiO5s8UnD6MAhrlqElLKGAVPntrwzZtLM2otnJjCj3tNZ9HkeXhCPSbPk7gz6hCQ58BUt4n649LEKXE3cKSvTLCfybXqz2u61BHEwHBPLw=="}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:07:24.730794 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-3d92e077-79fb-42e3-a06e-e875c4180525 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Getting quotas for project c3a5c84478c2481abf7a96ae93ac7b33. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:07:24.736729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-3d92e077-79fb-42e3-a06e-e875c4180525 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Getting quotas for user 0f8cb5d4d2434b4f8525404cc7dae04f and project c3a5c84478c2481abf7a96ae93ac7b33. Resources: {'key_pairs'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:07:24.763640 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3d92e077-79fb-42e3-a06e-e875c4180525 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.242495 Oct 29 04:07:24.764246 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3824/7423] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 04:07:24 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:07:25.831225 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:07:25.836076 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:07:25.840735 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2094500e-5524-4c27-9a38-2e4e45146abb tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1098921845", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1747420352", "security_groups": [{"name": "tempest-secgroup-smoke-980649817"}], "networks": [{"uuid": "fab45b69-e357-490d-973b-8b941050d849"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:07:25.960412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-2094500e-5524-4c27-9a38-2e4e45146abb tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] validate_networks() for [('fab45b69-e357-490d-973b-8b941050d849', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 04:07:26.356632 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-2094500e-5524-4c27-9a38-2e4e45146abb tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 04:07:26.357067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-2094500e-5524-4c27-9a38-2e4e45146abb tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 04:07:26.357551 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-2094500e-5524-4c27-9a38-2e4e45146abb tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 04:07:26.357967 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-2094500e-5524-4c27-9a38-2e4e45146abb tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 04:07:26.358385 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-2094500e-5524-4c27-9a38-2e4e45146abb tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 04:07:26.368195 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2094500e-5524-4c27-9a38-2e4e45146abb tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:26.368708 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2094500e-5524-4c27-9a38-2e4e45146abb tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:26.369156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2094500e-5524-4c27-9a38-2e4e45146abb tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:26.369888 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2094500e-5524-4c27-9a38-2e4e45146abb tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:26.370349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2094500e-5524-4c27-9a38-2e4e45146abb tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:26.370782 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2094500e-5524-4c27-9a38-2e4e45146abb tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:26.389160 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-2094500e-5524-4c27-9a38-2e4e45146abb tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Getting quotas for project c3a5c84478c2481abf7a96ae93ac7b33. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:07:26.394990 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-2094500e-5524-4c27-9a38-2e4e45146abb tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Getting quotas for user 0f8cb5d4d2434b4f8525404cc7dae04f and project c3a5c84478c2481abf7a96ae93ac7b33. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:07:26.408989 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2094500e-5524-4c27-9a38-2e4e45146abb tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 04:07:26.412199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2094500e-5524-4c27-9a38-2e4e45146abb tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 04:07:26.462510 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2094500e-5524-4c27-9a38-2e4e45146abb tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.632824 Oct 29 04:07:26.463192 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3600/7424] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 04:07:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 04:07:26.476127 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-80cc05f8-4f69-403c-b468-c9c8bbf3accd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:26.477429 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-80cc05f8-4f69-403c-b468-c9c8bbf3accd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:26.533015 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-80cc05f8-4f69-403c-b468-c9c8bbf3accd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:26.540665 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-80cc05f8-4f69-403c-b468-c9c8bbf3accd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1247 microversion: 2.1 time: 0.069921 Oct 29 04:07:26.541311 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3825/7425] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:26 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1247 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:27.563727 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6fb37e12-288e-404e-af73-c40138801d29 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:27.564276 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6fb37e12-288e-404e-af73-c40138801d29 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:27.575570 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6fb37e12-288e-404e-af73-c40138801d29 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:27.576180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6fb37e12-288e-404e-af73-c40138801d29 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:27.576512 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6fb37e12-288e-404e-af73-c40138801d29 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:27.577290 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6fb37e12-288e-404e-af73-c40138801d29 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:27.577738 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6fb37e12-288e-404e-af73-c40138801d29 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:27.578170 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6fb37e12-288e-404e-af73-c40138801d29 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:27.644771 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6fb37e12-288e-404e-af73-c40138801d29 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:27.654761 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6fb37e12-288e-404e-af73-c40138801d29 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1299 microversion: 2.1 time: 0.094798 Oct 29 04:07:27.668600 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3601/7426] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:27 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:28.679409 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c15443c3-c782-4308-a306-f851d64cea6d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:28.680162 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c15443c3-c782-4308-a306-f851d64cea6d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:28.687824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c15443c3-c782-4308-a306-f851d64cea6d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:28.688400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c15443c3-c782-4308-a306-f851d64cea6d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:28.689000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c15443c3-c782-4308-a306-f851d64cea6d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:28.689752 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c15443c3-c782-4308-a306-f851d64cea6d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:28.690295 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c15443c3-c782-4308-a306-f851d64cea6d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:28.691116 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c15443c3-c782-4308-a306-f851d64cea6d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:28.851872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c15443c3-c782-4308-a306-f851d64cea6d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:28.860349 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c15443c3-c782-4308-a306-f851d64cea6d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1372 microversion: 2.1 time: 0.185277 Oct 29 04:07:28.871037 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3826/7427] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:28 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1372 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:29.566541 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-179623ef-1116-4762-a137-614886d2aba0 req-32e5c1f8-ab5b-42b0-897a-0914c9cd8a25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53065a98-f823-40cc-a461-c0e5a4b4b59c", "tag": "180eded5-f280-42cb-91e7-a6e1ba8d28bc"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:07:29.578676 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-179623ef-1116-4762-a137-614886d2aba0 req-32e5c1f8-ab5b-42b0-897a-0914c9cd8a25 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:29.579180 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-179623ef-1116-4762-a137-614886d2aba0 req-32e5c1f8-ab5b-42b0-897a-0914c9cd8a25 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:29.579623 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-179623ef-1116-4762-a137-614886d2aba0 req-32e5c1f8-ab5b-42b0-897a-0914c9cd8a25 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:29.592092 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-179623ef-1116-4762-a137-614886d2aba0 req-32e5c1f8-ab5b-42b0-897a-0914c9cd8a25 service nova] Creating event network-changed:180eded5-f280-42cb-91e7-a6e1ba8d28bc for instance 53065a98-f823-40cc-a461-c0e5a4b4b59c on n-h2-862967-2 Oct 29 04:07:29.597828 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-179623ef-1116-4762-a137-614886d2aba0 req-32e5c1f8-ab5b-42b0-897a-0914c9cd8a25 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035939 Oct 29 04:07:29.598603 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3602/7428] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:07:29.887356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ec611857-766a-4d7d-9c5d-42072dd88cae tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:29.887987 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ec611857-766a-4d7d-9c5d-42072dd88cae tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:29.895743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ec611857-766a-4d7d-9c5d-42072dd88cae tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:29.896217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ec611857-766a-4d7d-9c5d-42072dd88cae tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:29.897808 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ec611857-766a-4d7d-9c5d-42072dd88cae tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:29.898548 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ec611857-766a-4d7d-9c5d-42072dd88cae tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:29.899323 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ec611857-766a-4d7d-9c5d-42072dd88cae tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:29.899893 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ec611857-766a-4d7d-9c5d-42072dd88cae tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:30.046565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ec611857-766a-4d7d-9c5d-42072dd88cae tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:30.054833 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ec611857-766a-4d7d-9c5d-42072dd88cae tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1372 microversion: 2.1 time: 0.171654 Oct 29 04:07:30.055351 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3827/7429] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:29 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:31.082064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-aa826a90-a070-46bb-b8b6-5db181a70407 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:31.082885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-aa826a90-a070-46bb-b8b6-5db181a70407 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:31.093626 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa826a90-a070-46bb-b8b6-5db181a70407 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:31.094340 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa826a90-a070-46bb-b8b6-5db181a70407 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:31.094825 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa826a90-a070-46bb-b8b6-5db181a70407 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:31.095868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa826a90-a070-46bb-b8b6-5db181a70407 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:31.096436 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa826a90-a070-46bb-b8b6-5db181a70407 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:31.097177 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-aa826a90-a070-46bb-b8b6-5db181a70407 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:31.251190 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-aa826a90-a070-46bb-b8b6-5db181a70407 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:31.259364 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-aa826a90-a070-46bb-b8b6-5db181a70407 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1372 microversion: 2.1 time: 0.184972 Oct 29 04:07:31.259954 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3603/7430] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:31 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1372 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:32.282679 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-5cb34521-2e9a-4870-88d3-f64bf6dcceaa tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:32.283303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-5cb34521-2e9a-4870-88d3-f64bf6dcceaa tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:32.290482 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5cb34521-2e9a-4870-88d3-f64bf6dcceaa tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:32.290975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5cb34521-2e9a-4870-88d3-f64bf6dcceaa tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:32.291412 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5cb34521-2e9a-4870-88d3-f64bf6dcceaa tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:32.292120 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5cb34521-2e9a-4870-88d3-f64bf6dcceaa tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:32.292704 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5cb34521-2e9a-4870-88d3-f64bf6dcceaa tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:32.293161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-5cb34521-2e9a-4870-88d3-f64bf6dcceaa tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:32.440696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-5cb34521-2e9a-4870-88d3-f64bf6dcceaa tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:32.450915 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-5cb34521-2e9a-4870-88d3-f64bf6dcceaa tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1372 microversion: 2.1 time: 0.171025 Oct 29 04:07:32.450915 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3828/7431] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:32 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:33.476927 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5a65a06e-48c2-4f56-819c-15cb1ecd426c tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:33.477533 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5a65a06e-48c2-4f56-819c-15cb1ecd426c tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:33.485070 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a65a06e-48c2-4f56-819c-15cb1ecd426c tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:33.485672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a65a06e-48c2-4f56-819c-15cb1ecd426c tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:33.486352 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a65a06e-48c2-4f56-819c-15cb1ecd426c tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:33.487781 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a65a06e-48c2-4f56-819c-15cb1ecd426c tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:33.488451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a65a06e-48c2-4f56-819c-15cb1ecd426c tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:33.489110 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5a65a06e-48c2-4f56-819c-15cb1ecd426c tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:33.641402 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5a65a06e-48c2-4f56-819c-15cb1ecd426c tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:33.650037 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5a65a06e-48c2-4f56-819c-15cb1ecd426c tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1372 microversion: 2.1 time: 0.178444 Oct 29 04:07:33.650613 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3604/7432] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:33 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1372 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:34.432785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-76bddf7b-e19e-436b-b2a0-55fa434755cd req-f24bef8e-a048-427c-8745-4e6c785b0be8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53065a98-f823-40cc-a461-c0e5a4b4b59c", "name": "network-vif-plugged", "status": "completed", "tag": "180eded5-f280-42cb-91e7-a6e1ba8d28bc"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:07:34.444818 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-76bddf7b-e19e-436b-b2a0-55fa434755cd req-f24bef8e-a048-427c-8745-4e6c785b0be8 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:34.445311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-76bddf7b-e19e-436b-b2a0-55fa434755cd req-f24bef8e-a048-427c-8745-4e6c785b0be8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:34.446378 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-76bddf7b-e19e-436b-b2a0-55fa434755cd req-f24bef8e-a048-427c-8745-4e6c785b0be8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:34.458622 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-76bddf7b-e19e-436b-b2a0-55fa434755cd req-f24bef8e-a048-427c-8745-4e6c785b0be8 service nova] Creating event network-vif-plugged:180eded5-f280-42cb-91e7-a6e1ba8d28bc for instance 53065a98-f823-40cc-a461-c0e5a4b4b59c on n-h2-862967-2 Oct 29 04:07:34.463859 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-76bddf7b-e19e-436b-b2a0-55fa434755cd req-f24bef8e-a048-427c-8745-4e6c785b0be8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035543 Oct 29 04:07:34.464815 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3829/7433] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:07:34.674464 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-7f9f8af7-b13a-4164-ab30-ca88f44e50bd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:34.675144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-7f9f8af7-b13a-4164-ab30-ca88f44e50bd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:34.683125 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f9f8af7-b13a-4164-ab30-ca88f44e50bd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:34.683688 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f9f8af7-b13a-4164-ab30-ca88f44e50bd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:34.684163 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f9f8af7-b13a-4164-ab30-ca88f44e50bd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:34.684990 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f9f8af7-b13a-4164-ab30-ca88f44e50bd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:34.685440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f9f8af7-b13a-4164-ab30-ca88f44e50bd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:34.685872 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-7f9f8af7-b13a-4164-ab30-ca88f44e50bd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:34.831336 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-7f9f8af7-b13a-4164-ab30-ca88f44e50bd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:34.839994 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-7f9f8af7-b13a-4164-ab30-ca88f44e50bd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1372 microversion: 2.1 time: 0.169798 Oct 29 04:07:34.840821 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3605/7434] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:34 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:35.865985 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-e9b8b0fd-8c53-429f-aa05-0dbaae0c10bc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:35.867568 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-e9b8b0fd-8c53-429f-aa05-0dbaae0c10bc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:35.874438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9b8b0fd-8c53-429f-aa05-0dbaae0c10bc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:35.874941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9b8b0fd-8c53-429f-aa05-0dbaae0c10bc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:35.875408 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9b8b0fd-8c53-429f-aa05-0dbaae0c10bc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:35.876097 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9b8b0fd-8c53-429f-aa05-0dbaae0c10bc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:35.876580 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9b8b0fd-8c53-429f-aa05-0dbaae0c10bc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:35.877012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-e9b8b0fd-8c53-429f-aa05-0dbaae0c10bc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:36.016465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-e9b8b0fd-8c53-429f-aa05-0dbaae0c10bc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:36.024691 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-e9b8b0fd-8c53-429f-aa05-0dbaae0c10bc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1556 microversion: 2.1 time: 0.164872 Oct 29 04:07:36.025273 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3830/7435] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:35 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:36.047895 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-23937fdc-64e5-483b-b028-e373a93d6806 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:07:36.048501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-23937fdc-64e5-483b-b028-e373a93d6806 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:07:36.056366 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23937fdc-64e5-483b-b028-e373a93d6806 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:36.056965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23937fdc-64e5-483b-b028-e373a93d6806 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:36.057355 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23937fdc-64e5-483b-b028-e373a93d6806 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:36.058087 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23937fdc-64e5-483b-b028-e373a93d6806 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:36.058563 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23937fdc-64e5-483b-b028-e373a93d6806 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:36.059026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-23937fdc-64e5-483b-b028-e373a93d6806 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:36.201526 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-23937fdc-64e5-483b-b028-e373a93d6806 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:07:36.220493 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-23937fdc-64e5-483b-b028-e373a93d6806 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1556 microversion: 2.1 time: 0.173330 Oct 29 04:07:36.220493 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3606/7436] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:07:36 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1556 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:07:38.288240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:07:38.359441 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-bdf547ef-b273-4aef-a12a-0f71bdc6957b req-d442a9a7-cb1a-40b9-a090-1f5a8c6a1b80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53065a98-f823-40cc-a461-c0e5a4b4b59c", "tag": "180eded5-f280-42cb-91e7-a6e1ba8d28bc"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:07:38.369996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-bdf547ef-b273-4aef-a12a-0f71bdc6957b req-d442a9a7-cb1a-40b9-a090-1f5a8c6a1b80 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:07:38.370486 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-bdf547ef-b273-4aef-a12a-0f71bdc6957b req-d442a9a7-cb1a-40b9-a090-1f5a8c6a1b80 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:07:38.370919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-bdf547ef-b273-4aef-a12a-0f71bdc6957b req-d442a9a7-cb1a-40b9-a090-1f5a8c6a1b80 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:07:38.383258 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-bdf547ef-b273-4aef-a12a-0f71bdc6957b req-d442a9a7-cb1a-40b9-a090-1f5a8c6a1b80 service nova] Creating event network-changed:180eded5-f280-42cb-91e7-a6e1ba8d28bc for instance 53065a98-f823-40cc-a461-c0e5a4b4b59c on n-h2-862967-2 Oct 29 04:07:38.388456 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-bdf547ef-b273-4aef-a12a-0f71bdc6957b req-d442a9a7-cb1a-40b9-a090-1f5a8c6a1b80 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101442 Oct 29 04:07:38.389433 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3831/7437] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:09:32.491376 n-d-862967-2 devstack@n-api.service[127125]: ERROR oslo.messaging._drivers.impl_rabbit [-] [db70aafa-b304-4ac0-be4f-1798e9789b82] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 04:09:32.492640 n-d-862967-2 devstack@n-api.service[127125]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7606be4b-8fa9-49e5-a603-02528cbf3013] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 04:09:32.493016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:09:32.493794 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:09:32.494599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:09:32.495294 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=34 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:09:32.500856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-bb00ef31-390a-4022-a114-0262fa0c5fa8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:09:32.501413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-bb00ef31-390a-4022-a114-0262fa0c5fa8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:32.510249 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb00ef31-390a-4022-a114-0262fa0c5fa8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:32.510752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb00ef31-390a-4022-a114-0262fa0c5fa8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:32.511200 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb00ef31-390a-4022-a114-0262fa0c5fa8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:32.511915 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb00ef31-390a-4022-a114-0262fa0c5fa8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:32.512378 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb00ef31-390a-4022-a114-0262fa0c5fa8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:32.512850 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-bb00ef31-390a-4022-a114-0262fa0c5fa8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:32.536501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-bb00ef31-390a-4022-a114-0262fa0c5fa8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lazy-loading 'flavor' on Instance uuid 53065a98-f823-40cc-a461-c0e5a4b4b59c {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 04:09:32.898749 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-bb00ef31-390a-4022-a114-0262fa0c5fa8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "POST /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c/action" status: 202 len: 0 microversion: 2.1 time: 0.410788 Oct 29 04:09:32.899382 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3607/7438] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 04:09:32 2022] POST /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c/action => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:09:32.906281 n-d-862967-2 devstack@n-api.service[127124]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a4c67498-176b-466c-9f6d-56e0bcdaf058] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 04:09:32.907327 n-d-862967-2 devstack@n-api.service[127124]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2206413f-602f-4f31-86b1-4a062554af7b] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 04:09:32.907896 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:09:32.908666 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=28 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:09:32.910593 n-d-862967-2 devstack@n-api.service[127124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 29 04:09:32.910932 n-d-862967-2 devstack@n-api.service[127124]: Sat Oct 29 04:09:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c (ip 10.222.0.46) !!! Oct 29 04:09:32.916731 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-120dbac0-c416-49ec-aeeb-2b4fb0f4a22a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:32.917465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-120dbac0-c416-49ec-aeeb-2b4fb0f4a22a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:32.926329 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-120dbac0-c416-49ec-aeeb-2b4fb0f4a22a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:32.926807 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-120dbac0-c416-49ec-aeeb-2b4fb0f4a22a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:32.927236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-120dbac0-c416-49ec-aeeb-2b4fb0f4a22a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:32.927925 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-120dbac0-c416-49ec-aeeb-2b4fb0f4a22a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:32.928377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-120dbac0-c416-49ec-aeeb-2b4fb0f4a22a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:32.928824 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-120dbac0-c416-49ec-aeeb-2b4fb0f4a22a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:33.128740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-120dbac0-c416-49ec-aeeb-2b4fb0f4a22a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:33.136744 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-120dbac0-c416-49ec-aeeb-2b4fb0f4a22a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1681 microversion: 2.1 time: 0.232382 Oct 29 04:09:33.137349 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3832/7439] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:32 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1681 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:34.163707 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2178f80b-c706-4339-833c-708b82459cf3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:34.164425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2178f80b-c706-4339-833c-708b82459cf3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:34.172977 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] [7606be4b-8fa9-49e5-a603-02528cbf3013] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 41410. Oct 29 04:09:34.173966 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] [db70aafa-b304-4ac0-be4f-1798e9789b82] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 41408. Oct 29 04:09:34.175837 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2178f80b-c706-4339-833c-708b82459cf3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:34.176323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2178f80b-c706-4339-833c-708b82459cf3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:34.176792 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2178f80b-c706-4339-833c-708b82459cf3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:34.177500 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2178f80b-c706-4339-833c-708b82459cf3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:34.177964 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2178f80b-c706-4339-833c-708b82459cf3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:34.178383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2178f80b-c706-4339-833c-708b82459cf3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:34.315497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2178f80b-c706-4339-833c-708b82459cf3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:34.324186 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2178f80b-c706-4339-833c-708b82459cf3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1681 microversion: 2.1 time: 0.166647 Oct 29 04:09:34.324810 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3608/7440] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:34 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:35.351612 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7da954a8-5f62-4eb1-80aa-33e1539068c4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:35.352616 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7da954a8-5f62-4eb1-80aa-33e1539068c4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:35.367069 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7da954a8-5f62-4eb1-80aa-33e1539068c4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:35.367551 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7da954a8-5f62-4eb1-80aa-33e1539068c4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:35.367991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7da954a8-5f62-4eb1-80aa-33e1539068c4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:35.368724 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7da954a8-5f62-4eb1-80aa-33e1539068c4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:35.369178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7da954a8-5f62-4eb1-80aa-33e1539068c4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:35.369605 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7da954a8-5f62-4eb1-80aa-33e1539068c4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:35.376332 n-d-862967-2 devstack@n-api.service[127124]: INFO oslo.messaging._drivers.impl_rabbit [-] [2206413f-602f-4f31-86b1-4a062554af7b] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 41416. Oct 29 04:09:35.388560 n-d-862967-2 devstack@n-api.service[127124]: INFO oslo.messaging._drivers.impl_rabbit [-] [a4c67498-176b-466c-9f6d-56e0bcdaf058] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 41414. Oct 29 04:09:35.519854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7da954a8-5f62-4eb1-80aa-33e1539068c4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:35.528119 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7da954a8-5f62-4eb1-80aa-33e1539068c4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1681 microversion: 2.1 time: 0.183240 Oct 29 04:09:35.528999 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3833/7441] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:35 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:36.559711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-8e654a97-a627-4bd2-8e1a-d98932b71ba4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:36.560778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-8e654a97-a627-4bd2-8e1a-d98932b71ba4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:36.571429 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8e654a97-a627-4bd2-8e1a-d98932b71ba4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:36.571913 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8e654a97-a627-4bd2-8e1a-d98932b71ba4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:36.572365 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8e654a97-a627-4bd2-8e1a-d98932b71ba4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:36.573106 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8e654a97-a627-4bd2-8e1a-d98932b71ba4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:36.573582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8e654a97-a627-4bd2-8e1a-d98932b71ba4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:36.574025 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-8e654a97-a627-4bd2-8e1a-d98932b71ba4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:36.713040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-8e654a97-a627-4bd2-8e1a-d98932b71ba4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:36.721420 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-8e654a97-a627-4bd2-8e1a-d98932b71ba4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1681 microversion: 2.1 time: 0.168466 Oct 29 04:09:36.722020 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3609/7442] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:36 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:37.747905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-89a87f41-7854-4635-81e3-e2d513eab310 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:37.748558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-89a87f41-7854-4635-81e3-e2d513eab310 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:37.755666 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89a87f41-7854-4635-81e3-e2d513eab310 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:37.756158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89a87f41-7854-4635-81e3-e2d513eab310 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:37.756631 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89a87f41-7854-4635-81e3-e2d513eab310 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:37.757331 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89a87f41-7854-4635-81e3-e2d513eab310 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:37.757786 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89a87f41-7854-4635-81e3-e2d513eab310 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:37.758215 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-89a87f41-7854-4635-81e3-e2d513eab310 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:37.901468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-89a87f41-7854-4635-81e3-e2d513eab310 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:37.913547 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-89a87f41-7854-4635-81e3-e2d513eab310 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1681 microversion: 2.1 time: 0.169295 Oct 29 04:09:37.914149 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3834/7443] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:37 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:38.949539 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c66c2034-4911-4cc7-9b80-c1d2c0d52302 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:38.950501 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c66c2034-4911-4cc7-9b80-c1d2c0d52302 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:38.962538 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c66c2034-4911-4cc7-9b80-c1d2c0d52302 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:38.963067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c66c2034-4911-4cc7-9b80-c1d2c0d52302 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:38.963531 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c66c2034-4911-4cc7-9b80-c1d2c0d52302 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:38.964307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c66c2034-4911-4cc7-9b80-c1d2c0d52302 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:38.964806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c66c2034-4911-4cc7-9b80-c1d2c0d52302 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:38.965257 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c66c2034-4911-4cc7-9b80-c1d2c0d52302 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:39.103444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c66c2034-4911-4cc7-9b80-c1d2c0d52302 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:39.112330 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c66c2034-4911-4cc7-9b80-c1d2c0d52302 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1681 microversion: 2.1 time: 0.169703 Oct 29 04:09:39.112930 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3610/7444] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:38 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:40.139086 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-738371bb-8a3b-44f5-b24a-4c88d98ef35b tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:40.139823 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-738371bb-8a3b-44f5-b24a-4c88d98ef35b tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:40.147087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-738371bb-8a3b-44f5-b24a-4c88d98ef35b tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:40.147573 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-738371bb-8a3b-44f5-b24a-4c88d98ef35b tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:40.148008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-738371bb-8a3b-44f5-b24a-4c88d98ef35b tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:40.148748 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-738371bb-8a3b-44f5-b24a-4c88d98ef35b tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:40.149204 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-738371bb-8a3b-44f5-b24a-4c88d98ef35b tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:40.149629 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-738371bb-8a3b-44f5-b24a-4c88d98ef35b tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:40.299965 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-738371bb-8a3b-44f5-b24a-4c88d98ef35b tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:40.312437 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-738371bb-8a3b-44f5-b24a-4c88d98ef35b tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1681 microversion: 2.1 time: 0.177213 Oct 29 04:09:40.313293 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3835/7445] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:40 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:41.343947 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b7186b93-bd09-4655-bd55-a89b64960092 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:41.344882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b7186b93-bd09-4655-bd55-a89b64960092 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:41.356697 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7186b93-bd09-4655-bd55-a89b64960092 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:41.357523 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7186b93-bd09-4655-bd55-a89b64960092 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:41.358277 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7186b93-bd09-4655-bd55-a89b64960092 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:41.359436 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7186b93-bd09-4655-bd55-a89b64960092 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:41.360271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7186b93-bd09-4655-bd55-a89b64960092 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:41.361081 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b7186b93-bd09-4655-bd55-a89b64960092 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:41.510988 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b7186b93-bd09-4655-bd55-a89b64960092 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:41.523170 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b7186b93-bd09-4655-bd55-a89b64960092 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1681 microversion: 2.1 time: 0.185865 Oct 29 04:09:41.523946 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3611/7446] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:41 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:42.552960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-bdf36c0a-2b05-4d59-8664-1a21c7422cb7 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:42.554033 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-bdf36c0a-2b05-4d59-8664-1a21c7422cb7 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:42.565654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdf36c0a-2b05-4d59-8664-1a21c7422cb7 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:42.566465 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdf36c0a-2b05-4d59-8664-1a21c7422cb7 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:42.567197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdf36c0a-2b05-4d59-8664-1a21c7422cb7 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:42.568337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdf36c0a-2b05-4d59-8664-1a21c7422cb7 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:42.569139 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdf36c0a-2b05-4d59-8664-1a21c7422cb7 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:42.569848 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-bdf36c0a-2b05-4d59-8664-1a21c7422cb7 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:42.720170 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-bdf36c0a-2b05-4d59-8664-1a21c7422cb7 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:42.728475 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-bdf36c0a-2b05-4d59-8664-1a21c7422cb7 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1681 microversion: 2.1 time: 0.182078 Oct 29 04:09:42.729090 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3836/7447] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:42 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:43.753010 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d5941eab-f420-4587-addc-55bb90fb886f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:43.753675 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d5941eab-f420-4587-addc-55bb90fb886f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:43.761173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5941eab-f420-4587-addc-55bb90fb886f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:43.761672 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5941eab-f420-4587-addc-55bb90fb886f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:43.762097 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5941eab-f420-4587-addc-55bb90fb886f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:43.762822 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5941eab-f420-4587-addc-55bb90fb886f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:43.763291 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5941eab-f420-4587-addc-55bb90fb886f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:43.763726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d5941eab-f420-4587-addc-55bb90fb886f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:43.912006 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d5941eab-f420-4587-addc-55bb90fb886f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:43.921185 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d5941eab-f420-4587-addc-55bb90fb886f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1702 microversion: 2.1 time: 0.172272 Oct 29 04:09:43.921745 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3612/7448] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:43 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1702 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:44.949111 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-38c598e7-62c5-409d-8236-56d26ac5a4e2 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:44.949990 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-38c598e7-62c5-409d-8236-56d26ac5a4e2 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:44.962046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38c598e7-62c5-409d-8236-56d26ac5a4e2 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:44.962854 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38c598e7-62c5-409d-8236-56d26ac5a4e2 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:44.963579 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38c598e7-62c5-409d-8236-56d26ac5a4e2 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:44.964682 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38c598e7-62c5-409d-8236-56d26ac5a4e2 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:44.965050 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38c598e7-62c5-409d-8236-56d26ac5a4e2 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:44.965478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-38c598e7-62c5-409d-8236-56d26ac5a4e2 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:45.109856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-38c598e7-62c5-409d-8236-56d26ac5a4e2 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:45.122039 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-38c598e7-62c5-409d-8236-56d26ac5a4e2 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1702 microversion: 2.1 time: 0.179543 Oct 29 04:09:45.123213 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3837/7449] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:44 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1702 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:46.145765 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-518783b0-08c2-40aa-8108-fa787c0b9f57 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:46.146319 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-518783b0-08c2-40aa-8108-fa787c0b9f57 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:46.153621 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-518783b0-08c2-40aa-8108-fa787c0b9f57 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:46.154379 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-518783b0-08c2-40aa-8108-fa787c0b9f57 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:46.155016 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-518783b0-08c2-40aa-8108-fa787c0b9f57 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:46.156063 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-518783b0-08c2-40aa-8108-fa787c0b9f57 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:46.157319 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-518783b0-08c2-40aa-8108-fa787c0b9f57 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:46.157993 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-518783b0-08c2-40aa-8108-fa787c0b9f57 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:46.310946 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-518783b0-08c2-40aa-8108-fa787c0b9f57 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:46.319337 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-518783b0-08c2-40aa-8108-fa787c0b9f57 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1697 microversion: 2.1 time: 0.177733 Oct 29 04:09:46.333016 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3613/7450] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:46 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1697 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:47.252071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-ccc42b51-a99c-4486-8556-0ba0f492b182 req-fdf4656f-f64c-4289-8915-eb7cc660e3ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53065a98-f823-40cc-a461-c0e5a4b4b59c", "name": "network-vif-plugged", "status": "completed", "tag": "180eded5-f280-42cb-91e7-a6e1ba8d28bc"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:09:47.262897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ccc42b51-a99c-4486-8556-0ba0f492b182 req-fdf4656f-f64c-4289-8915-eb7cc660e3ad service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:47.263695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ccc42b51-a99c-4486-8556-0ba0f492b182 req-fdf4656f-f64c-4289-8915-eb7cc660e3ad service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:47.264310 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ccc42b51-a99c-4486-8556-0ba0f492b182 req-fdf4656f-f64c-4289-8915-eb7cc660e3ad service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:47.277090 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-ccc42b51-a99c-4486-8556-0ba0f492b182 req-fdf4656f-f64c-4289-8915-eb7cc660e3ad service nova] Creating event network-vif-plugged:180eded5-f280-42cb-91e7-a6e1ba8d28bc for instance 53065a98-f823-40cc-a461-c0e5a4b4b59c on n-h2-862967-2 Oct 29 04:09:47.282801 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-ccc42b51-a99c-4486-8556-0ba0f492b182 req-fdf4656f-f64c-4289-8915-eb7cc660e3ad service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126515 Oct 29 04:09:47.283778 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3838/7451] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:09:47.343559 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-406d2e8b-79e4-421b-8395-eca43c574d11 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:47.344398 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-406d2e8b-79e4-421b-8395-eca43c574d11 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:47.351746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-406d2e8b-79e4-421b-8395-eca43c574d11 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:47.352253 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-406d2e8b-79e4-421b-8395-eca43c574d11 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:47.352728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-406d2e8b-79e4-421b-8395-eca43c574d11 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:47.353450 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-406d2e8b-79e4-421b-8395-eca43c574d11 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:47.354136 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-406d2e8b-79e4-421b-8395-eca43c574d11 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:47.354930 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-406d2e8b-79e4-421b-8395-eca43c574d11 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:47.515786 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-406d2e8b-79e4-421b-8395-eca43c574d11 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:47.528036 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-406d2e8b-79e4-421b-8395-eca43c574d11 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1697 microversion: 2.1 time: 0.187929 Oct 29 04:09:47.530154 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3614/7452] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:47 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1697 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:48.558285 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-50c2ca45-6550-4642-be8c-31316f3890d4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:48.560038 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-50c2ca45-6550-4642-be8c-31316f3890d4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:48.568261 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50c2ca45-6550-4642-be8c-31316f3890d4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:48.569212 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50c2ca45-6550-4642-be8c-31316f3890d4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:48.572258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50c2ca45-6550-4642-be8c-31316f3890d4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:48.573389 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50c2ca45-6550-4642-be8c-31316f3890d4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:48.574070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50c2ca45-6550-4642-be8c-31316f3890d4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:48.574704 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-50c2ca45-6550-4642-be8c-31316f3890d4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:48.719973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-50c2ca45-6550-4642-be8c-31316f3890d4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:48.728008 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-50c2ca45-6550-4642-be8c-31316f3890d4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1697 microversion: 2.1 time: 0.177928 Oct 29 04:09:48.728872 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3839/7453] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:48 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1697 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:49.752978 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b563fbed-84bf-47fb-b15f-c5ac40e869f2 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:49.753619 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b563fbed-84bf-47fb-b15f-c5ac40e869f2 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:49.760816 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b563fbed-84bf-47fb-b15f-c5ac40e869f2 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:49.761571 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b563fbed-84bf-47fb-b15f-c5ac40e869f2 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:49.762024 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b563fbed-84bf-47fb-b15f-c5ac40e869f2 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:49.762740 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b563fbed-84bf-47fb-b15f-c5ac40e869f2 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:49.763210 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b563fbed-84bf-47fb-b15f-c5ac40e869f2 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:49.763652 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b563fbed-84bf-47fb-b15f-c5ac40e869f2 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:49.920847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b563fbed-84bf-47fb-b15f-c5ac40e869f2 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:49.929602 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b563fbed-84bf-47fb-b15f-c5ac40e869f2 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1697 microversion: 2.1 time: 0.180917 Oct 29 04:09:49.930413 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3615/7454] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:49 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1697 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:50.953694 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-217fe620-5955-4ff3-80f3-f33b73fbbb0c tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:50.954298 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-217fe620-5955-4ff3-80f3-f33b73fbbb0c tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:50.961676 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-217fe620-5955-4ff3-80f3-f33b73fbbb0c tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:50.962183 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-217fe620-5955-4ff3-80f3-f33b73fbbb0c tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:50.962905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-217fe620-5955-4ff3-80f3-f33b73fbbb0c tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:50.963273 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-217fe620-5955-4ff3-80f3-f33b73fbbb0c tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:50.965132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-217fe620-5955-4ff3-80f3-f33b73fbbb0c tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:50.965132 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-217fe620-5955-4ff3-80f3-f33b73fbbb0c tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:51.111702 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-217fe620-5955-4ff3-80f3-f33b73fbbb0c tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:51.122798 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-217fe620-5955-4ff3-80f3-f33b73fbbb0c tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1697 microversion: 2.1 time: 0.172570 Oct 29 04:09:51.124023 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3840/7455] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:50 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1697 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:52.152722 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-238b6442-7e09-4c1f-b702-bae01692dc80 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:52.154068 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-238b6442-7e09-4c1f-b702-bae01692dc80 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:52.161931 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-238b6442-7e09-4c1f-b702-bae01692dc80 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:52.162428 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-238b6442-7e09-4c1f-b702-bae01692dc80 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:52.165839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-238b6442-7e09-4c1f-b702-bae01692dc80 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:52.167368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-238b6442-7e09-4c1f-b702-bae01692dc80 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:52.169071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-238b6442-7e09-4c1f-b702-bae01692dc80 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:52.169729 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-238b6442-7e09-4c1f-b702-bae01692dc80 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:52.317912 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-238b6442-7e09-4c1f-b702-bae01692dc80 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:52.328620 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-238b6442-7e09-4c1f-b702-bae01692dc80 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1697 microversion: 2.1 time: 0.185169 Oct 29 04:09:52.339866 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3616/7456] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:52 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1697 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:53.353608 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8d978808-8bcd-409e-bb27-633ab19714c5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:53.354535 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8d978808-8bcd-409e-bb27-633ab19714c5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:53.363250 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d978808-8bcd-409e-bb27-633ab19714c5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:53.363746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d978808-8bcd-409e-bb27-633ab19714c5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:53.364196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d978808-8bcd-409e-bb27-633ab19714c5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:53.364909 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d978808-8bcd-409e-bb27-633ab19714c5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:53.365422 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d978808-8bcd-409e-bb27-633ab19714c5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:53.365852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d978808-8bcd-409e-bb27-633ab19714c5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:53.552384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8d978808-8bcd-409e-bb27-633ab19714c5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:53.562519 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8d978808-8bcd-409e-bb27-633ab19714c5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1697 microversion: 2.1 time: 0.213002 Oct 29 04:09:53.563374 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3841/7457] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:53 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1697 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:54.590629 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c308702c-ef59-46e2-bb53-bc0f95e2d2a3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:54.591396 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c308702c-ef59-46e2-bb53-bc0f95e2d2a3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:54.601839 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c308702c-ef59-46e2-bb53-bc0f95e2d2a3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:54.602609 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c308702c-ef59-46e2-bb53-bc0f95e2d2a3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:54.603217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c308702c-ef59-46e2-bb53-bc0f95e2d2a3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:54.604280 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c308702c-ef59-46e2-bb53-bc0f95e2d2a3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:54.604793 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c308702c-ef59-46e2-bb53-bc0f95e2d2a3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:54.605203 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c308702c-ef59-46e2-bb53-bc0f95e2d2a3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:54.747150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c308702c-ef59-46e2-bb53-bc0f95e2d2a3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:54.755207 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c308702c-ef59-46e2-bb53-bc0f95e2d2a3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1697 microversion: 2.1 time: 0.170802 Oct 29 04:09:54.755790 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3617/7458] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:54 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:55.778626 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b3f787e3-6c9b-4659-8f3b-c576164059e0 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:55.779256 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b3f787e3-6c9b-4659-8f3b-c576164059e0 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:55.787103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3f787e3-6c9b-4659-8f3b-c576164059e0 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:55.787597 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3f787e3-6c9b-4659-8f3b-c576164059e0 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:55.788030 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3f787e3-6c9b-4659-8f3b-c576164059e0 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:55.788783 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3f787e3-6c9b-4659-8f3b-c576164059e0 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:55.789272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3f787e3-6c9b-4659-8f3b-c576164059e0 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:55.790096 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b3f787e3-6c9b-4659-8f3b-c576164059e0 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:55.932013 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b3f787e3-6c9b-4659-8f3b-c576164059e0 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:55.940309 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b3f787e3-6c9b-4659-8f3b-c576164059e0 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1679 microversion: 2.1 time: 0.165767 Oct 29 04:09:55.940958 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3842/7459] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:55 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:56.965264 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9bd19dc9-759c-48fa-9d1b-ddb39be95acf tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:56.965903 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9bd19dc9-759c-48fa-9d1b-ddb39be95acf tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:56.973550 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9bd19dc9-759c-48fa-9d1b-ddb39be95acf tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:56.974040 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9bd19dc9-759c-48fa-9d1b-ddb39be95acf tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:56.974486 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9bd19dc9-759c-48fa-9d1b-ddb39be95acf tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:56.975583 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9bd19dc9-759c-48fa-9d1b-ddb39be95acf tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:56.976055 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9bd19dc9-759c-48fa-9d1b-ddb39be95acf tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:56.976496 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9bd19dc9-759c-48fa-9d1b-ddb39be95acf tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:57.123500 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9bd19dc9-759c-48fa-9d1b-ddb39be95acf tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:57.137179 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9bd19dc9-759c-48fa-9d1b-ddb39be95acf tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1682 microversion: 2.1 time: 0.176112 Oct 29 04:09:57.137972 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3618/7460] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:56 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:57.162181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-86250436-01cc-4d00-9b56-3b16a7bc9099 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:09:57.162827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-86250436-01cc-4d00-9b56-3b16a7bc9099 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:57.170158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86250436-01cc-4d00-9b56-3b16a7bc9099 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:57.170681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86250436-01cc-4d00-9b56-3b16a7bc9099 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:57.171101 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86250436-01cc-4d00-9b56-3b16a7bc9099 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:57.171825 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86250436-01cc-4d00-9b56-3b16a7bc9099 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:57.172282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86250436-01cc-4d00-9b56-3b16a7bc9099 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:57.172852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-86250436-01cc-4d00-9b56-3b16a7bc9099 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:57.277575 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-86250436-01cc-4d00-9b56-3b16a7bc9099 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127124) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 29 04:09:57.354189 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-86250436-01cc-4d00-9b56-3b16a7bc9099 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "POST /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c/action" status: 202 len: 0 microversion: 2.1 time: 0.195780 Oct 29 04:09:57.354921 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3843/7461] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 04:09:57 2022] POST /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 04:09:57.363649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b4134567-7df2-4627-ba46-90f9f06de606 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:57.364246 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b4134567-7df2-4627-ba46-90f9f06de606 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:57.370285 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4134567-7df2-4627-ba46-90f9f06de606 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:57.370980 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4134567-7df2-4627-ba46-90f9f06de606 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:57.371587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4134567-7df2-4627-ba46-90f9f06de606 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:57.372595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4134567-7df2-4627-ba46-90f9f06de606 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:57.373224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4134567-7df2-4627-ba46-90f9f06de606 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:57.373823 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b4134567-7df2-4627-ba46-90f9f06de606 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:57.515604 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b4134567-7df2-4627-ba46-90f9f06de606 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:57.524464 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b4134567-7df2-4627-ba46-90f9f06de606 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1630 microversion: 2.1 time: 0.165102 Oct 29 04:09:57.525074 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3619/7462] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:57 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1630 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:58.551404 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-68be4834-7b3a-4184-a2ce-eb374aeed412 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:58.552029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-68be4834-7b3a-4184-a2ce-eb374aeed412 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:58.559320 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68be4834-7b3a-4184-a2ce-eb374aeed412 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:58.559805 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68be4834-7b3a-4184-a2ce-eb374aeed412 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:58.560240 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68be4834-7b3a-4184-a2ce-eb374aeed412 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:58.560974 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68be4834-7b3a-4184-a2ce-eb374aeed412 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:58.561427 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68be4834-7b3a-4184-a2ce-eb374aeed412 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:58.561849 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-68be4834-7b3a-4184-a2ce-eb374aeed412 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:58.709954 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-68be4834-7b3a-4184-a2ce-eb374aeed412 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:58.719623 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-68be4834-7b3a-4184-a2ce-eb374aeed412 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1688 microversion: 2.1 time: 0.173736 Oct 29 04:09:58.720230 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3844/7463] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:58 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:09:59.190808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-e709b25d-46da-4268-8be5-9dc364eef13f req-51c52c87-8be2-4961-bb88-1113c4c6c926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53065a98-f823-40cc-a461-c0e5a4b4b59c", "name": "network-vif-unplugged", "status": "completed", "tag": "180eded5-f280-42cb-91e7-a6e1ba8d28bc"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:09:59.203131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e709b25d-46da-4268-8be5-9dc364eef13f req-51c52c87-8be2-4961-bb88-1113c4c6c926 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:59.203909 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e709b25d-46da-4268-8be5-9dc364eef13f req-51c52c87-8be2-4961-bb88-1113c4c6c926 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:59.204637 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e709b25d-46da-4268-8be5-9dc364eef13f req-51c52c87-8be2-4961-bb88-1113c4c6c926 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:59.217050 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-e709b25d-46da-4268-8be5-9dc364eef13f req-51c52c87-8be2-4961-bb88-1113c4c6c926 service nova] Creating event network-vif-unplugged:180eded5-f280-42cb-91e7-a6e1ba8d28bc for instance 53065a98-f823-40cc-a461-c0e5a4b4b59c on n-h2-862967-2 Oct 29 04:09:59.222825 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-e709b25d-46da-4268-8be5-9dc364eef13f req-51c52c87-8be2-4961-bb88-1113c4c6c926 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036017 Oct 29 04:09:59.223717 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3620/7464] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 04:09:59.743746 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2590e38e-b6a4-4249-a470-b801c3a83023 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:09:59.745012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2590e38e-b6a4-4249-a470-b801c3a83023 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:09:59.752449 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2590e38e-b6a4-4249-a470-b801c3a83023 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:59.753239 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2590e38e-b6a4-4249-a470-b801c3a83023 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:59.753677 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2590e38e-b6a4-4249-a470-b801c3a83023 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:59.754382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2590e38e-b6a4-4249-a470-b801c3a83023 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:09:59.755171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2590e38e-b6a4-4249-a470-b801c3a83023 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:09:59.755752 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2590e38e-b6a4-4249-a470-b801c3a83023 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:09:59.913422 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2590e38e-b6a4-4249-a470-b801c3a83023 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:09:59.922829 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2590e38e-b6a4-4249-a470-b801c3a83023 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1688 microversion: 2.1 time: 0.182993 Oct 29 04:09:59.924073 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3845/7465] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:09:59 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1688 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 04:10:00.949254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9bb73628-0cc2-42e4-a58d-62e402945d13 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:10:00.950866 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9bb73628-0cc2-42e4-a58d-62e402945d13 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:10:00.958014 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9bb73628-0cc2-42e4-a58d-62e402945d13 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:00.958858 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9bb73628-0cc2-42e4-a58d-62e402945d13 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:00.959308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9bb73628-0cc2-42e4-a58d-62e402945d13 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:00.960014 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9bb73628-0cc2-42e4-a58d-62e402945d13 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:00.960759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9bb73628-0cc2-42e4-a58d-62e402945d13 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:00.961211 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9bb73628-0cc2-42e4-a58d-62e402945d13 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:01.113585 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9bb73628-0cc2-42e4-a58d-62e402945d13 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:10:01.122477 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9bb73628-0cc2-42e4-a58d-62e402945d13 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1688 microversion: 2.1 time: 0.178572 Oct 29 04:10:01.123254 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3621/7466] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:10:00 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:10:02.149440 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6c6872ab-2026-4b5d-81ef-b6488637acbc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:10:02.150160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6c6872ab-2026-4b5d-81ef-b6488637acbc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:10:02.162431 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c6872ab-2026-4b5d-81ef-b6488637acbc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:02.162921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c6872ab-2026-4b5d-81ef-b6488637acbc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:02.163349 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c6872ab-2026-4b5d-81ef-b6488637acbc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:02.164074 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c6872ab-2026-4b5d-81ef-b6488637acbc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:02.164574 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c6872ab-2026-4b5d-81ef-b6488637acbc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:02.165033 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6c6872ab-2026-4b5d-81ef-b6488637acbc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:02.310535 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6c6872ab-2026-4b5d-81ef-b6488637acbc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:10:02.319241 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6c6872ab-2026-4b5d-81ef-b6488637acbc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1688 microversion: 2.1 time: 0.173779 Oct 29 04:10:02.320055 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3846/7467] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:10:02 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:10:03.343302 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f4945297-3229-41e0-8923-5a571e64972f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:10:03.343882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f4945297-3229-41e0-8923-5a571e64972f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:10:03.346737 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=31 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:10:03.352515 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4945297-3229-41e0-8923-5a571e64972f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:03.353046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4945297-3229-41e0-8923-5a571e64972f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:03.353502 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4945297-3229-41e0-8923-5a571e64972f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:03.354230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4945297-3229-41e0-8923-5a571e64972f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:03.354694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4945297-3229-41e0-8923-5a571e64972f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:03.355232 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f4945297-3229-41e0-8923-5a571e64972f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:03.358659 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:10:03.504810 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f4945297-3229-41e0-8923-5a571e64972f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:10:03.513346 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f4945297-3229-41e0-8923-5a571e64972f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1688 microversion: 2.1 time: 0.174076 Oct 29 04:10:03.514208 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3622/7468] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:10:03 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:10:04.538025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-76f771bc-4dd9-4f90-aa69-2b1fba5bdb65 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:10:04.538970 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-76f771bc-4dd9-4f90-aa69-2b1fba5bdb65 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:10:04.542342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:10:04.549026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76f771bc-4dd9-4f90-aa69-2b1fba5bdb65 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:04.549561 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76f771bc-4dd9-4f90-aa69-2b1fba5bdb65 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:04.549998 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76f771bc-4dd9-4f90-aa69-2b1fba5bdb65 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:04.550710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76f771bc-4dd9-4f90-aa69-2b1fba5bdb65 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:04.551160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76f771bc-4dd9-4f90-aa69-2b1fba5bdb65 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:04.551583 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-76f771bc-4dd9-4f90-aa69-2b1fba5bdb65 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:04.554928 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:10:04.727888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-76f771bc-4dd9-4f90-aa69-2b1fba5bdb65 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:10:04.737638 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-76f771bc-4dd9-4f90-aa69-2b1fba5bdb65 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1688 microversion: 2.1 time: 0.204237 Oct 29 04:10:04.738267 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3847/7469] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:10:04 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1688 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:10:05.763495 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2550e313-c737-4bdf-bf85-cb71b5356abe tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:10:05.764516 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2550e313-c737-4bdf-bf85-cb71b5356abe tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:10:05.771864 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2550e313-c737-4bdf-bf85-cb71b5356abe tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:05.772512 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2550e313-c737-4bdf-bf85-cb71b5356abe tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:05.773133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2550e313-c737-4bdf-bf85-cb71b5356abe tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:05.774046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2550e313-c737-4bdf-bf85-cb71b5356abe tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:05.774659 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2550e313-c737-4bdf-bf85-cb71b5356abe tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:05.775498 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2550e313-c737-4bdf-bf85-cb71b5356abe tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:05.936231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2550e313-c737-4bdf-bf85-cb71b5356abe tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:10:05.945940 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2550e313-c737-4bdf-bf85-cb71b5356abe tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1688 microversion: 2.1 time: 0.187749 Oct 29 04:10:05.946876 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3623/7470] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:10:05 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1688 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:10:06.971297 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f891637c-1862-41f4-b697-19aead1d5a13 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:10:06.972041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f891637c-1862-41f4-b697-19aead1d5a13 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:10:06.978281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f891637c-1862-41f4-b697-19aead1d5a13 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:06.978770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f891637c-1862-41f4-b697-19aead1d5a13 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:06.979210 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f891637c-1862-41f4-b697-19aead1d5a13 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:06.979904 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f891637c-1862-41f4-b697-19aead1d5a13 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:06.980355 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f891637c-1862-41f4-b697-19aead1d5a13 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:06.980798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f891637c-1862-41f4-b697-19aead1d5a13 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:07.120502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f891637c-1862-41f4-b697-19aead1d5a13 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:10:07.133051 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f891637c-1862-41f4-b697-19aead1d5a13 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1688 microversion: 2.1 time: 0.166118 Oct 29 04:10:07.133856 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3848/7471] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:10:06 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:10:08.161119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-85ec4b12-a091-4eca-922a-30fb32839fb5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:10:08.161739 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-85ec4b12-a091-4eca-922a-30fb32839fb5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:10:08.169367 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85ec4b12-a091-4eca-922a-30fb32839fb5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:08.169866 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85ec4b12-a091-4eca-922a-30fb32839fb5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:08.170311 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85ec4b12-a091-4eca-922a-30fb32839fb5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:08.171018 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85ec4b12-a091-4eca-922a-30fb32839fb5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:08.171487 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85ec4b12-a091-4eca-922a-30fb32839fb5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:08.171898 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-85ec4b12-a091-4eca-922a-30fb32839fb5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:08.314422 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-85ec4b12-a091-4eca-922a-30fb32839fb5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:10:08.323217 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-85ec4b12-a091-4eca-922a-30fb32839fb5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1688 microversion: 2.1 time: 0.165728 Oct 29 04:10:08.323824 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3624/7472] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:10:08 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:10:09.350700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6cc095ee-f75c-494f-8074-1319fbd50d3a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:10:09.351294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6cc095ee-f75c-494f-8074-1319fbd50d3a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:10:09.358867 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cc095ee-f75c-494f-8074-1319fbd50d3a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:09.359353 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cc095ee-f75c-494f-8074-1319fbd50d3a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:09.359786 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cc095ee-f75c-494f-8074-1319fbd50d3a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:09.360484 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cc095ee-f75c-494f-8074-1319fbd50d3a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:09.360973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cc095ee-f75c-494f-8074-1319fbd50d3a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:09.361762 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6cc095ee-f75c-494f-8074-1319fbd50d3a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:09.504048 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6cc095ee-f75c-494f-8074-1319fbd50d3a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:10:09.512712 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6cc095ee-f75c-494f-8074-1319fbd50d3a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1688 microversion: 2.1 time: 0.167764 Oct 29 04:10:09.513302 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3849/7473] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:10:09 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:10:10.540484 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-34ed130d-8774-4fee-9dce-186ee315f250 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:10:10.541395 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-34ed130d-8774-4fee-9dce-186ee315f250 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:10:10.550837 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34ed130d-8774-4fee-9dce-186ee315f250 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:10.551500 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34ed130d-8774-4fee-9dce-186ee315f250 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:10.552091 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34ed130d-8774-4fee-9dce-186ee315f250 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:10.553099 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34ed130d-8774-4fee-9dce-186ee315f250 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:10.553748 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34ed130d-8774-4fee-9dce-186ee315f250 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:10.554323 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34ed130d-8774-4fee-9dce-186ee315f250 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:10.696806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-34ed130d-8774-4fee-9dce-186ee315f250 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:10:10.704863 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-34ed130d-8774-4fee-9dce-186ee315f250 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1675 microversion: 2.1 time: 0.170351 Oct 29 04:10:10.705490 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3625/7474] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:10:10 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:10:13.317613 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-856a467c-1457-424f-a207-e918fa42a6da req-f27b660a-fc82-45b7-82f5-78fa013600e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53065a98-f823-40cc-a461-c0e5a4b4b59c", "name": "network-vif-plugged", "status": "completed", "tag": "180eded5-f280-42cb-91e7-a6e1ba8d28bc"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:10:13.328210 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-856a467c-1457-424f-a207-e918fa42a6da req-f27b660a-fc82-45b7-82f5-78fa013600e7 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:10:13.328727 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-856a467c-1457-424f-a207-e918fa42a6da req-f27b660a-fc82-45b7-82f5-78fa013600e7 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:10:13.329153 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-856a467c-1457-424f-a207-e918fa42a6da req-f27b660a-fc82-45b7-82f5-78fa013600e7 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:10:13.341188 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-856a467c-1457-424f-a207-e918fa42a6da req-f27b660a-fc82-45b7-82f5-78fa013600e7 service nova] Creating event network-vif-plugged:180eded5-f280-42cb-91e7-a6e1ba8d28bc for instance 53065a98-f823-40cc-a461-c0e5a4b4b59c on n-h2-862967-2 Oct 29 04:10:13.346286 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-856a467c-1457-424f-a207-e918fa42a6da req-f27b660a-fc82-45b7-82f5-78fa013600e7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032465 Oct 29 04:10:13.347233 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3850/7475] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:11:22.253412 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=7 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:11:22.254688 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=23 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:11:22.256070 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 04:11:22.256379 n-d-862967-2 devstack@n-api.service[127125]: Sat Oct 29 04:11:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c (ip 10.222.0.46) !!! Oct 29 04:11:22.257394 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=7 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:11:22.258870 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 04:11:22.258870 n-d-862967-2 devstack@n-api.service[127125]: Sat Oct 29 04:11:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c (ip 10.222.0.46) !!! Oct 29 04:11:22.259201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=19 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:11:22.260916 n-d-862967-2 devstack@n-api.service[127124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 04:11:22.262909 n-d-862967-2 devstack@n-api.service[127124]: Sat Oct 29 04:11:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.46) !!! Oct 29 04:11:22.273364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-36cf3915-7d78-4475-8836-4c6aac3f96cd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:11:22.274012 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-36cf3915-7d78-4475-8836-4c6aac3f96cd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:11:22.277133 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-fb6f7d0b-db06-4c10-ba1b-90c09cfb5fef req-8cc2b52c-601c-458b-bfef-b1334619d59c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53065a98-f823-40cc-a461-c0e5a4b4b59c", "tag": "180eded5-f280-42cb-91e7-a6e1ba8d28bc"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:11:22.284983 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36cf3915-7d78-4475-8836-4c6aac3f96cd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:22.285478 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36cf3915-7d78-4475-8836-4c6aac3f96cd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:22.286142 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36cf3915-7d78-4475-8836-4c6aac3f96cd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:22.287056 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36cf3915-7d78-4475-8836-4c6aac3f96cd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:22.287513 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36cf3915-7d78-4475-8836-4c6aac3f96cd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:22.288122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-36cf3915-7d78-4475-8836-4c6aac3f96cd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:22.291391 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-fb6f7d0b-db06-4c10-ba1b-90c09cfb5fef req-8cc2b52c-601c-458b-bfef-b1334619d59c service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:22.291943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-fb6f7d0b-db06-4c10-ba1b-90c09cfb5fef req-8cc2b52c-601c-458b-bfef-b1334619d59c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:22.292468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-fb6f7d0b-db06-4c10-ba1b-90c09cfb5fef req-8cc2b52c-601c-458b-bfef-b1334619d59c service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:22.304258 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-fb6f7d0b-db06-4c10-ba1b-90c09cfb5fef req-8cc2b52c-601c-458b-bfef-b1334619d59c service nova] Creating event network-changed:180eded5-f280-42cb-91e7-a6e1ba8d28bc for instance 53065a98-f823-40cc-a461-c0e5a4b4b59c on n-h2-862967-2 Oct 29 04:11:22.309702 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-fb6f7d0b-db06-4c10-ba1b-90c09cfb5fef req-8cc2b52c-601c-458b-bfef-b1334619d59c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056208 Oct 29 04:11:22.310523 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3851/7476] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:11:22.322493 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-36cf3915-7d78-4475-8836-4c6aac3f96cd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 04:11:22.413773 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-36cf3915-7d78-4475-8836-4c6aac3f96cd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "DELETE /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 204 len: 0 microversion: 2.1 time: 0.162207 Oct 29 04:11:22.414503 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3626/7477] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 04:11:22 2022] DELETE /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 04:11:22.424567 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6f0c42b8-5966-4776-9e59-dae6882fca69 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:11:22.425574 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6f0c42b8-5966-4776-9e59-dae6882fca69 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:11:22.433137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f0c42b8-5966-4776-9e59-dae6882fca69 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:22.433634 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f0c42b8-5966-4776-9e59-dae6882fca69 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:22.434068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f0c42b8-5966-4776-9e59-dae6882fca69 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:22.434778 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f0c42b8-5966-4776-9e59-dae6882fca69 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:22.435233 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f0c42b8-5966-4776-9e59-dae6882fca69 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:22.435656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6f0c42b8-5966-4776-9e59-dae6882fca69 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:22.574517 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6f0c42b8-5966-4776-9e59-dae6882fca69 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:11:22.582938 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6f0c42b8-5966-4776-9e59-dae6882fca69 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1681 microversion: 2.1 time: 0.162666 Oct 29 04:11:22.583583 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3852/7478] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:11:22 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 04:11:23.608091 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-62602d07-3c50-4df7-a9b5-a9661241512f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:11:23.609025 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-62602d07-3c50-4df7-a9b5-a9661241512f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:11:23.617115 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62602d07-3c50-4df7-a9b5-a9661241512f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:23.617622 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62602d07-3c50-4df7-a9b5-a9661241512f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:23.618075 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62602d07-3c50-4df7-a9b5-a9661241512f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:23.618920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62602d07-3c50-4df7-a9b5-a9661241512f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:23.619293 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62602d07-3c50-4df7-a9b5-a9661241512f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:23.619733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-62602d07-3c50-4df7-a9b5-a9661241512f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:23.860020 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-62602d07-3c50-4df7-a9b5-a9661241512f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:11:23.871045 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-62602d07-3c50-4df7-a9b5-a9661241512f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 200 len: 1681 microversion: 2.1 time: 0.265722 Oct 29 04:11:23.871045 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3627/7479] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:11:23 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 1681 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:11:24.325576 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-ea98188e-e079-48c3-847e-19fca4de1280 req-dd6e6c18-93a8-408d-ba18-d07c352510aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53065a98-f823-40cc-a461-c0e5a4b4b59c", "name": "network-vif-deleted", "tag": "180eded5-f280-42cb-91e7-a6e1ba8d28bc"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:11:24.336144 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ea98188e-e079-48c3-847e-19fca4de1280 req-dd6e6c18-93a8-408d-ba18-d07c352510aa service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:24.336664 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ea98188e-e079-48c3-847e-19fca4de1280 req-dd6e6c18-93a8-408d-ba18-d07c352510aa service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:24.337241 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-ea98188e-e079-48c3-847e-19fca4de1280 req-dd6e6c18-93a8-408d-ba18-d07c352510aa service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:24.348727 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-ea98188e-e079-48c3-847e-19fca4de1280 req-dd6e6c18-93a8-408d-ba18-d07c352510aa service nova] Creating event network-vif-deleted:180eded5-f280-42cb-91e7-a6e1ba8d28bc for instance 53065a98-f823-40cc-a461-c0e5a4b4b59c on n-h2-862967-2 Oct 29 04:11:24.354281 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-ea98188e-e079-48c3-847e-19fca4de1280 req-dd6e6c18-93a8-408d-ba18-d07c352510aa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032573 Oct 29 04:11:24.354882 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3853/7480] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:11:24.898103 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ad183e1e-9010-4c6c-9f46-02c334541bdc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:11:24.898928 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ad183e1e-9010-4c6c-9f46-02c334541bdc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 53065a98-f823-40cc-a461-c0e5a4b4b59c] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:11:24.908674 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad183e1e-9010-4c6c-9f46-02c334541bdc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:24.909371 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad183e1e-9010-4c6c-9f46-02c334541bdc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:24.909953 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad183e1e-9010-4c6c-9f46-02c334541bdc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:24.910996 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad183e1e-9010-4c6c-9f46-02c334541bdc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:24.911445 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad183e1e-9010-4c6c-9f46-02c334541bdc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:24.911919 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ad183e1e-9010-4c6c-9f46-02c334541bdc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:24.925695 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-ad183e1e-9010-4c6c-9f46-02c334541bdc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] HTTP exception thrown: Instance 53065a98-f823-40cc-a461-c0e5a4b4b59c could not be found. Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ad183e1e-9010-4c6c-9f46-02c334541bdc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Request method failure captured: Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c HTTP/1.1 Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKb3spua6Zl3pzivcNm2X67kROSna5XQJ3GRzMgkAOd-uIM9E9oVmSMXgizpz8hGuW-w_EsC1iwPvCeCyuqlojUIAWQXrM36bpZrjhN5ECkES_5-iZEWweQRpJaGCs28pa9yEhKy0btoFRQVt2zeT9O8lPP2szEuTLaagFA-LWojew8 Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: c3a5c84478c2481abf7a96ae93ac7b33 Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestShelveInstance-785700432 Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c3a5c84478c2481abf7a96ae93ac7b33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c3a5c84478c2481abf7a96ae93ac7b33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c3a5c84478c2481abf7a96ae93ac7b33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c3a5c84478c2481abf7a96ae93ac7b33"}]}] Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestShelveInstance-785700432 Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: c3a5c84478c2481abf7a96ae93ac7b33 Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestShelveInstance-785700432 Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestShelveInstance-785700432-project Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 0f8cb5d4d2434b4f8525404cc7dae04f Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestShelveInstance-785700432-project Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 53065a98-f823-40cc-a461-c0e5a4b4b59c could not be found. Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '53065a98-f823-40cc-a461-c0e5a4b4b59c'} Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53065a98-f823-40cc-a461-c0e5a4b4b59c could not be found. Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53065a98-f823-40cc-a461-c0e5a4b4b59c could not be found. Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:11:24.927372 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 04:11:24.932998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:11:24.932998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:11:24.932998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:11:24.932998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 04:11:24.932998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 04:11:24.932998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53065a98-f823-40cc-a461-c0e5a4b4b59c could not be found. Oct 29 04:11:24.932998 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 04:11:24.932998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ad183e1e-9010-4c6c-9f46-02c334541bdc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Returning 404 to user: Instance 53065a98-f823-40cc-a461-c0e5a4b4b59c could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 04:11:24.932998 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ad183e1e-9010-4c6c-9f46-02c334541bdc tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c" status: 404 len: 111 microversion: 2.1 time: 0.036505 Oct 29 04:11:24.932998 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3628/7481] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:11:24 2022] GET /compute/v2.1/servers/53065a98-f823-40cc-a461-c0e5a4b4b59c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 04:11:25.110717 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b96d45b9-7de1-4799-9fe2-5f7d2e23ee4d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '.version_select at 0x7ff0529330d0>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:11:25.152462 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b96d45b9-7de1-4799-9fe2-5f7d2e23ee4d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1747420352" status: 202 len: 0 microversion: 2.1 time: 0.045793 Oct 29 04:11:25.153046 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3854/7482] 10.222.0.46 () {58 vars in 1254 bytes} [Sat Oct 29 04:11:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1747420352 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:11:25.176121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1dd2ad34-ddea-47e4-98dc-3e8edcf9db01 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Action: 'create', calling method: .version_select at 0x7ff052c4dd30>, body: {"keypair": {"name": "tempest-TestShelveInstance-1890995705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJs0EYcHOmTV5usev+Cc+QV3eHa5RvkBrwoA5WC7zUtGTTFDlbR6iacEUq1uZbLgUHHgh9KWzCIZzltUYKt1sCdPksq/NM5lAMCkhFwXC+ZR9kfOAOTRVW/lfN5wjtOhfw=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:11:25.191671 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-1dd2ad34-ddea-47e4-98dc-3e8edcf9db01 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Getting quotas for project c3a5c84478c2481abf7a96ae93ac7b33. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:11:25.197230 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-1dd2ad34-ddea-47e4-98dc-3e8edcf9db01 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Getting quotas for user 0f8cb5d4d2434b4f8525404cc7dae04f and project c3a5c84478c2481abf7a96ae93ac7b33. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:11:25.225603 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1dd2ad34-ddea-47e4-98dc-3e8edcf9db01 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.053710 Oct 29 04:11:25.226197 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3629/7483] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 04:11:25 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 04:11:42.606523 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=10 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:11:42.607255 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:11:42.611708 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d154dfe5-a1b9-4774-bae9-0743eef05efd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2105652192", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1890995705", "security_groups": [{"name": "tempest-secgroup-smoke-1237105621"}], "networks": [{"uuid": "fab45b69-e357-490d-973b-8b941050d849"}], "block_device_mapping_v2": [{"uuid": "138bd974-0243-4e01-a04a-a0d3f6239f9d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:11:42.735137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-d154dfe5-a1b9-4774-bae9-0743eef05efd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] validate_networks() for [('fab45b69-e357-490d-973b-8b941050d849', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 04:11:43.141642 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-d154dfe5-a1b9-4774-bae9-0743eef05efd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 04:11:43.144627 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-d154dfe5-a1b9-4774-bae9-0743eef05efd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 04:11:43.145161 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-d154dfe5-a1b9-4774-bae9-0743eef05efd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 04:11:43.145580 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-d154dfe5-a1b9-4774-bae9-0743eef05efd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 04:11:43.146000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-d154dfe5-a1b9-4774-bae9-0743eef05efd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 04:11:43.155577 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d154dfe5-a1b9-4774-bae9-0743eef05efd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:43.156095 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d154dfe5-a1b9-4774-bae9-0743eef05efd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:43.156556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d154dfe5-a1b9-4774-bae9-0743eef05efd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:43.157282 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d154dfe5-a1b9-4774-bae9-0743eef05efd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:43.157731 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d154dfe5-a1b9-4774-bae9-0743eef05efd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:43.158153 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d154dfe5-a1b9-4774-bae9-0743eef05efd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:43.177799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-d154dfe5-a1b9-4774-bae9-0743eef05efd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Getting quotas for project c3a5c84478c2481abf7a96ae93ac7b33. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:11:43.183695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-d154dfe5-a1b9-4774-bae9-0743eef05efd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Getting quotas for user 0f8cb5d4d2434b4f8525404cc7dae04f and project c3a5c84478c2481abf7a96ae93ac7b33. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:11:43.244740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d154dfe5-a1b9-4774-bae9-0743eef05efd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 04:11:43.247160 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d154dfe5-a1b9-4774-bae9-0743eef05efd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='138bd974-0243-4e01-a04a-a0d3f6239f9d',volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 04:11:43.388464 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d154dfe5-a1b9-4774-bae9-0743eef05efd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.783466 Oct 29 04:11:43.389150 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3855/7484] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 04:11:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 04:11:43.399806 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:11:43.400827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=4 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:11:43.401693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:11:43.406134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2b453755-df05-4cdd-8520-5d5796d1002d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:11:43.406803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2b453755-df05-4cdd-8520-5d5796d1002d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:11:43.466942 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2b453755-df05-4cdd-8520-5d5796d1002d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:11:43.474122 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2b453755-df05-4cdd-8520-5d5796d1002d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1089 microversion: 2.1 time: 0.077450 Oct 29 04:11:43.474614 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3630/7485] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:11:43 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1089 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:11:44.498507 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8a441898-7e5b-414a-8f32-303fe1995d4d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:11:44.499265 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8a441898-7e5b-414a-8f32-303fe1995d4d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:11:44.510920 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8a441898-7e5b-414a-8f32-303fe1995d4d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:44.511506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8a441898-7e5b-414a-8f32-303fe1995d4d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:44.512053 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8a441898-7e5b-414a-8f32-303fe1995d4d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:44.512977 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8a441898-7e5b-414a-8f32-303fe1995d4d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:44.513527 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8a441898-7e5b-414a-8f32-303fe1995d4d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:44.514072 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8a441898-7e5b-414a-8f32-303fe1995d4d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:44.609146 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8a441898-7e5b-414a-8f32-303fe1995d4d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:11:44.618142 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8a441898-7e5b-414a-8f32-303fe1995d4d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1205 microversion: 2.1 time: 0.124351 Oct 29 04:11:44.618856 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3856/7486] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:11:44 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1205 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:11:45.647734 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5418cdab-7d21-4c52-900e-f96a9b47ae7c tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:11:45.648354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5418cdab-7d21-4c52-900e-f96a9b47ae7c tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:11:45.655964 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5418cdab-7d21-4c52-900e-f96a9b47ae7c tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:45.656454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5418cdab-7d21-4c52-900e-f96a9b47ae7c tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:45.657150 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5418cdab-7d21-4c52-900e-f96a9b47ae7c tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:45.658091 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5418cdab-7d21-4c52-900e-f96a9b47ae7c tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:45.658574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5418cdab-7d21-4c52-900e-f96a9b47ae7c tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:45.659042 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5418cdab-7d21-4c52-900e-f96a9b47ae7c tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:45.802193 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5418cdab-7d21-4c52-900e-f96a9b47ae7c tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:11:45.811375 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5418cdab-7d21-4c52-900e-f96a9b47ae7c tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1273 microversion: 2.1 time: 0.167902 Oct 29 04:11:45.812594 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3631/7487] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:11:45 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1273 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:11:45.921259 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-4190c55c-74a6-4ff3-af6b-714c96dce375 req-7fd1502b-9e48-4730-8905-9876f20acf31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "662038ab-8bfa-49e3-9e21-cdb1a2236c88", "tag": "e53ca1bb-750e-48e9-bcd7-5985560ac50d"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:11:45.936398 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4190c55c-74a6-4ff3-af6b-714c96dce375 req-7fd1502b-9e48-4730-8905-9876f20acf31 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:45.937060 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4190c55c-74a6-4ff3-af6b-714c96dce375 req-7fd1502b-9e48-4730-8905-9876f20acf31 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:45.937614 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-4190c55c-74a6-4ff3-af6b-714c96dce375 req-7fd1502b-9e48-4730-8905-9876f20acf31 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:45.950414 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-4190c55c-74a6-4ff3-af6b-714c96dce375 req-7fd1502b-9e48-4730-8905-9876f20acf31 service nova] Creating event network-changed:e53ca1bb-750e-48e9-bcd7-5985560ac50d for instance 662038ab-8bfa-49e3-9e21-cdb1a2236c88 on n-h2-862967-2 Oct 29 04:11:45.957009 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-4190c55c-74a6-4ff3-af6b-714c96dce375 req-7fd1502b-9e48-4730-8905-9876f20acf31 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050665 Oct 29 04:11:45.957765 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3857/7488] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:11:46.835199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-df765977-edf1-41d4-853e-cdf53e23b2ba tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:11:46.835911 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-df765977-edf1-41d4-853e-cdf53e23b2ba tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:11:46.844397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df765977-edf1-41d4-853e-cdf53e23b2ba tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:46.844943 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df765977-edf1-41d4-853e-cdf53e23b2ba tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:46.845389 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df765977-edf1-41d4-853e-cdf53e23b2ba tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:46.846485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df765977-edf1-41d4-853e-cdf53e23b2ba tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:46.846965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df765977-edf1-41d4-853e-cdf53e23b2ba tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:46.847400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-df765977-edf1-41d4-853e-cdf53e23b2ba tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:46.992073 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-df765977-edf1-41d4-853e-cdf53e23b2ba tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:11:47.000682 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-df765977-edf1-41d4-853e-cdf53e23b2ba tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1273 microversion: 2.1 time: 0.169654 Oct 29 04:11:47.001274 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3632/7489] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:11:46 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1273 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:11:48.025488 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ff403e47-a945-4c51-8af6-0dd2a71878c9 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:11:48.026197 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ff403e47-a945-4c51-8af6-0dd2a71878c9 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:11:48.033354 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff403e47-a945-4c51-8af6-0dd2a71878c9 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:48.033844 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff403e47-a945-4c51-8af6-0dd2a71878c9 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:48.034284 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff403e47-a945-4c51-8af6-0dd2a71878c9 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:48.034992 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff403e47-a945-4c51-8af6-0dd2a71878c9 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:48.035447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff403e47-a945-4c51-8af6-0dd2a71878c9 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:48.035869 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ff403e47-a945-4c51-8af6-0dd2a71878c9 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:48.175322 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ff403e47-a945-4c51-8af6-0dd2a71878c9 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:11:48.183422 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ff403e47-a945-4c51-8af6-0dd2a71878c9 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1273 microversion: 2.1 time: 0.163172 Oct 29 04:11:48.184039 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3858/7490] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:11:48 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1273 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:11:49.207220 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-739bb459-9c48-4414-bc02-8d9ce50f28e0 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:11:49.207945 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-739bb459-9c48-4414-bc02-8d9ce50f28e0 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:11:49.215619 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-739bb459-9c48-4414-bc02-8d9ce50f28e0 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:49.216119 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-739bb459-9c48-4414-bc02-8d9ce50f28e0 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:49.216561 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-739bb459-9c48-4414-bc02-8d9ce50f28e0 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:49.217317 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-739bb459-9c48-4414-bc02-8d9ce50f28e0 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:49.217776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-739bb459-9c48-4414-bc02-8d9ce50f28e0 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:49.218215 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-739bb459-9c48-4414-bc02-8d9ce50f28e0 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:49.355673 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-739bb459-9c48-4414-bc02-8d9ce50f28e0 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:11:49.364131 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-739bb459-9c48-4414-bc02-8d9ce50f28e0 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1273 microversion: 2.1 time: 0.160966 Oct 29 04:11:49.364845 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3633/7491] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:11:49 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1273 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:11:50.392487 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-28c5aec3-b62b-42c2-9940-e515859a9efd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:11:50.393466 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-28c5aec3-b62b-42c2-9940-e515859a9efd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:11:50.405062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-28c5aec3-b62b-42c2-9940-e515859a9efd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:50.405881 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-28c5aec3-b62b-42c2-9940-e515859a9efd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:50.406605 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-28c5aec3-b62b-42c2-9940-e515859a9efd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:50.407758 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-28c5aec3-b62b-42c2-9940-e515859a9efd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:50.408511 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-28c5aec3-b62b-42c2-9940-e515859a9efd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:50.409280 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-28c5aec3-b62b-42c2-9940-e515859a9efd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:50.541711 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-28c5aec3-b62b-42c2-9940-e515859a9efd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:11:50.549696 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-28c5aec3-b62b-42c2-9940-e515859a9efd tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1261 microversion: 2.1 time: 0.163841 Oct 29 04:11:50.550279 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3859/7492] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:11:50 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:11:51.579595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f09d9026-6738-4cfc-bc49-0f16372a0bf6 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:11:51.580637 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f09d9026-6738-4cfc-bc49-0f16372a0bf6 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:11:51.589777 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f09d9026-6738-4cfc-bc49-0f16372a0bf6 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:51.590267 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f09d9026-6738-4cfc-bc49-0f16372a0bf6 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:51.590714 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f09d9026-6738-4cfc-bc49-0f16372a0bf6 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:51.591423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f09d9026-6738-4cfc-bc49-0f16372a0bf6 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:51.591890 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f09d9026-6738-4cfc-bc49-0f16372a0bf6 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:51.592330 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f09d9026-6738-4cfc-bc49-0f16372a0bf6 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:51.744725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f09d9026-6738-4cfc-bc49-0f16372a0bf6 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:11:51.753836 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f09d9026-6738-4cfc-bc49-0f16372a0bf6 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1261 microversion: 2.1 time: 0.181202 Oct 29 04:11:51.754608 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3634/7493] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:11:51 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1261 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:11:52.781454 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f6d87ca9-ef77-4563-aef5-499039bd6b5a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:11:52.782311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f6d87ca9-ef77-4563-aef5-499039bd6b5a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:11:52.791793 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f6d87ca9-ef77-4563-aef5-499039bd6b5a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:52.792275 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f6d87ca9-ef77-4563-aef5-499039bd6b5a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:52.792745 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f6d87ca9-ef77-4563-aef5-499039bd6b5a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:52.793439 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f6d87ca9-ef77-4563-aef5-499039bd6b5a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:52.793886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f6d87ca9-ef77-4563-aef5-499039bd6b5a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:52.794309 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f6d87ca9-ef77-4563-aef5-499039bd6b5a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:52.930315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f6d87ca9-ef77-4563-aef5-499039bd6b5a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:11:52.938509 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f6d87ca9-ef77-4563-aef5-499039bd6b5a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1261 microversion: 2.1 time: 0.163462 Oct 29 04:11:52.939070 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3860/7494] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:11:52 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:11:53.965796 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-6abcae45-2d7f-4e99-8383-5fdc2e0a3b24 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:11:53.966842 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-6abcae45-2d7f-4e99-8383-5fdc2e0a3b24 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:11:53.971240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:11:53.979121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6abcae45-2d7f-4e99-8383-5fdc2e0a3b24 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:53.979632 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6abcae45-2d7f-4e99-8383-5fdc2e0a3b24 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:53.980102 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6abcae45-2d7f-4e99-8383-5fdc2e0a3b24 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:53.980872 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6abcae45-2d7f-4e99-8383-5fdc2e0a3b24 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:53.981316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6abcae45-2d7f-4e99-8383-5fdc2e0a3b24 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:53.981773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-6abcae45-2d7f-4e99-8383-5fdc2e0a3b24 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:54.135285 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-6abcae45-2d7f-4e99-8383-5fdc2e0a3b24 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:11:54.143617 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-6abcae45-2d7f-4e99-8383-5fdc2e0a3b24 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1261 microversion: 2.1 time: 0.184531 Oct 29 04:11:54.144192 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3635/7495] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:11:53 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1261 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:11:55.171211 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-dde385fc-7c1a-4c4c-ab5a-093f077dbf1d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:11:55.171961 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-dde385fc-7c1a-4c4c-ab5a-093f077dbf1d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:11:55.175099 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:11:55.176101 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:11:55.184839 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dde385fc-7c1a-4c4c-ab5a-093f077dbf1d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:55.185328 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dde385fc-7c1a-4c4c-ab5a-093f077dbf1d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:55.185764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dde385fc-7c1a-4c4c-ab5a-093f077dbf1d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:55.186464 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dde385fc-7c1a-4c4c-ab5a-093f077dbf1d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:55.186919 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dde385fc-7c1a-4c4c-ab5a-093f077dbf1d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:55.187337 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-dde385fc-7c1a-4c4c-ab5a-093f077dbf1d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:55.321057 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-dde385fc-7c1a-4c4c-ab5a-093f077dbf1d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:11:55.329241 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-dde385fc-7c1a-4c4c-ab5a-093f077dbf1d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1261 microversion: 2.1 time: 0.164932 Oct 29 04:11:55.329849 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3861/7496] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:11:55 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:11:56.354752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2b29a3d1-a6f4-4c2e-a876-a76a68c90533 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:11:56.355363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2b29a3d1-a6f4-4c2e-a876-a76a68c90533 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:11:56.363670 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b29a3d1-a6f4-4c2e-a876-a76a68c90533 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:56.364184 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b29a3d1-a6f4-4c2e-a876-a76a68c90533 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:56.364659 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b29a3d1-a6f4-4c2e-a876-a76a68c90533 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:56.365397 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b29a3d1-a6f4-4c2e-a876-a76a68c90533 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:56.365863 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b29a3d1-a6f4-4c2e-a876-a76a68c90533 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:56.366308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2b29a3d1-a6f4-4c2e-a876-a76a68c90533 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:56.508316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2b29a3d1-a6f4-4c2e-a876-a76a68c90533 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:11:56.516714 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2b29a3d1-a6f4-4c2e-a876-a76a68c90533 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1261 microversion: 2.1 time: 0.166938 Oct 29 04:11:56.517294 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3636/7497] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:11:56 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:11:57.542223 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3b429ec5-8736-4ef7-baa6-3e02557e0ae0 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:11:57.543178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3b429ec5-8736-4ef7-baa6-3e02557e0ae0 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:11:57.552557 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b429ec5-8736-4ef7-baa6-3e02557e0ae0 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:57.553220 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b429ec5-8736-4ef7-baa6-3e02557e0ae0 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:57.553806 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b429ec5-8736-4ef7-baa6-3e02557e0ae0 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:57.554755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b429ec5-8736-4ef7-baa6-3e02557e0ae0 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:57.555349 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b429ec5-8736-4ef7-baa6-3e02557e0ae0 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:57.556113 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3b429ec5-8736-4ef7-baa6-3e02557e0ae0 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:57.703555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3b429ec5-8736-4ef7-baa6-3e02557e0ae0 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:11:57.715500 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3b429ec5-8736-4ef7-baa6-3e02557e0ae0 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1261 microversion: 2.1 time: 0.178475 Oct 29 04:11:57.716377 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3862/7498] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:11:57 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1261 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:11:58.741508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-052bb92b-02f0-4012-acff-b1d92a6117ae tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:11:58.742146 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-052bb92b-02f0-4012-acff-b1d92a6117ae tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:11:58.749930 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-052bb92b-02f0-4012-acff-b1d92a6117ae tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:58.750425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-052bb92b-02f0-4012-acff-b1d92a6117ae tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:58.750885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-052bb92b-02f0-4012-acff-b1d92a6117ae tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:58.751580 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-052bb92b-02f0-4012-acff-b1d92a6117ae tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:58.752071 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-052bb92b-02f0-4012-acff-b1d92a6117ae tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:58.752497 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-052bb92b-02f0-4012-acff-b1d92a6117ae tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:58.900556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-052bb92b-02f0-4012-acff-b1d92a6117ae tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:11:58.909415 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-052bb92b-02f0-4012-acff-b1d92a6117ae tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1261 microversion: 2.1 time: 0.171864 Oct 29 04:11:58.909970 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3637/7499] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:11:58 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:11:59.909609 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-a7620ad9-3338-48b3-affc-889bff8fc1f7 req-672eb21c-3009-4802-a047-d448144b18c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662038ab-8bfa-49e3-9e21-cdb1a2236c88", "name": "network-vif-plugged", "status": "completed", "tag": "e53ca1bb-750e-48e9-bcd7-5985560ac50d"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:11:59.921114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a7620ad9-3338-48b3-affc-889bff8fc1f7 req-672eb21c-3009-4802-a047-d448144b18c8 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:59.921596 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a7620ad9-3338-48b3-affc-889bff8fc1f7 req-672eb21c-3009-4802-a047-d448144b18c8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:59.922084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a7620ad9-3338-48b3-affc-889bff8fc1f7 req-672eb21c-3009-4802-a047-d448144b18c8 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:59.934223 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-a7620ad9-3338-48b3-affc-889bff8fc1f7 req-672eb21c-3009-4802-a047-d448144b18c8 service nova] Creating event network-vif-plugged:e53ca1bb-750e-48e9-bcd7-5985560ac50d for instance 662038ab-8bfa-49e3-9e21-cdb1a2236c88 on n-h2-862967-2 Oct 29 04:11:59.939629 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-a7620ad9-3338-48b3-affc-889bff8fc1f7 req-672eb21c-3009-4802-a047-d448144b18c8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033765 Oct 29 04:11:59.940567 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3863/7500] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:11:59.940720 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-4f60ce02-65de-4f1d-baa2-3ea834348ef4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:11:59.941199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-4f60ce02-65de-4f1d-baa2-3ea834348ef4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:11:59.948058 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f60ce02-65de-4f1d-baa2-3ea834348ef4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:59.948567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f60ce02-65de-4f1d-baa2-3ea834348ef4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:59.949021 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f60ce02-65de-4f1d-baa2-3ea834348ef4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:11:59.949930 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f60ce02-65de-4f1d-baa2-3ea834348ef4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:11:59.950565 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f60ce02-65de-4f1d-baa2-3ea834348ef4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:11:59.951009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-4f60ce02-65de-4f1d-baa2-3ea834348ef4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:12:00.090648 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-4f60ce02-65de-4f1d-baa2-3ea834348ef4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:12:00.099077 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-4f60ce02-65de-4f1d-baa2-3ea834348ef4 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1261 microversion: 2.1 time: 0.162383 Oct 29 04:12:00.099714 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3638/7501] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:11:59 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 04:12:01.125158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-032c0bc6-74f9-42be-88c2-da1250434212 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:12:01.125921 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-032c0bc6-74f9-42be-88c2-da1250434212 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:12:01.132369 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-032c0bc6-74f9-42be-88c2-da1250434212 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:12:01.132913 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-032c0bc6-74f9-42be-88c2-da1250434212 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:12:01.133348 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-032c0bc6-74f9-42be-88c2-da1250434212 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:12:01.134048 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-032c0bc6-74f9-42be-88c2-da1250434212 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:12:01.134502 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-032c0bc6-74f9-42be-88c2-da1250434212 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:12:01.134926 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-032c0bc6-74f9-42be-88c2-da1250434212 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:12:01.276047 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-032c0bc6-74f9-42be-88c2-da1250434212 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:12:01.284572 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-032c0bc6-74f9-42be-88c2-da1250434212 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1261 microversion: 2.1 time: 0.165020 Oct 29 04:12:01.285186 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3864/7502] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:12:01 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:12:02.311520 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-ea6bfc38-efd2-4440-b156-89acd57e7c5a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:12:02.312567 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-ea6bfc38-efd2-4440-b156-89acd57e7c5a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:12:02.324141 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea6bfc38-efd2-4440-b156-89acd57e7c5a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:12:02.325186 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea6bfc38-efd2-4440-b156-89acd57e7c5a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:12:02.325642 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea6bfc38-efd2-4440-b156-89acd57e7c5a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:12:02.326356 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea6bfc38-efd2-4440-b156-89acd57e7c5a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:12:02.326824 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea6bfc38-efd2-4440-b156-89acd57e7c5a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:12:02.327256 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-ea6bfc38-efd2-4440-b156-89acd57e7c5a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:12:02.467226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-ea6bfc38-efd2-4440-b156-89acd57e7c5a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:12:02.479625 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-ea6bfc38-efd2-4440-b156-89acd57e7c5a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1445 microversion: 2.1 time: 0.174459 Oct 29 04:12:02.480339 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3639/7503] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:12:02 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1445 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:12:02.502884 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1efd3c77-f023-422e-85e1-7ec81111a43e tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:12:02.503497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1efd3c77-f023-422e-85e1-7ec81111a43e tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:12:02.510504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1efd3c77-f023-422e-85e1-7ec81111a43e tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:12:02.510986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1efd3c77-f023-422e-85e1-7ec81111a43e tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:12:02.511416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1efd3c77-f023-422e-85e1-7ec81111a43e tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:12:02.512108 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1efd3c77-f023-422e-85e1-7ec81111a43e tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:12:02.512586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1efd3c77-f023-422e-85e1-7ec81111a43e tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:12:02.513029 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1efd3c77-f023-422e-85e1-7ec81111a43e tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:12:02.656324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-1efd3c77-f023-422e-85e1-7ec81111a43e tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:12:02.668407 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1efd3c77-f023-422e-85e1-7ec81111a43e tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1445 microversion: 2.1 time: 0.169118 Oct 29 04:12:02.669404 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3865/7504] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:12:02 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1445 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:12:04.301157 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-9121413f-07ea-4b84-9f5b-adcc3d27cdd5 req-ad49f411-2e94-4621-b7c4-9bf859f57ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "662038ab-8bfa-49e3-9e21-cdb1a2236c88", "tag": "e53ca1bb-750e-48e9-bcd7-5985560ac50d"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:12:04.310948 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9121413f-07ea-4b84-9f5b-adcc3d27cdd5 req-ad49f411-2e94-4621-b7c4-9bf859f57ac0 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:12:04.311442 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9121413f-07ea-4b84-9f5b-adcc3d27cdd5 req-ad49f411-2e94-4621-b7c4-9bf859f57ac0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:12:04.311887 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-9121413f-07ea-4b84-9f5b-adcc3d27cdd5 req-ad49f411-2e94-4621-b7c4-9bf859f57ac0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:12:04.327507 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-9121413f-07ea-4b84-9f5b-adcc3d27cdd5 req-ad49f411-2e94-4621-b7c4-9bf859f57ac0 service nova] Creating event network-changed:e53ca1bb-750e-48e9-bcd7-5985560ac50d for instance 662038ab-8bfa-49e3-9e21-cdb1a2236c88 on n-h2-862967-2 Oct 29 04:12:04.332712 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-9121413f-07ea-4b84-9f5b-adcc3d27cdd5 req-ad49f411-2e94-4621-b7c4-9bf859f57ac0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035300 Oct 29 04:12:04.333331 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3640/7505] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:13:59.449214 n-d-862967-2 devstack@n-api.service[127124]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a4c67498-176b-466c-9f6d-56e0bcdaf058] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 04:13:59.451019 n-d-862967-2 devstack@n-api.service[127124]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2206413f-602f-4f31-86b1-4a062554af7b] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 04:13:59.451922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:13:59.453138 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=54 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:13:59.534900 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2c5910f3-8ff1-4121-96a4-597ec3656e83 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:13:59.535438 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2c5910f3-8ff1-4121-96a4-597ec3656e83 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:59.541729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c5910f3-8ff1-4121-96a4-597ec3656e83 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:59.542213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c5910f3-8ff1-4121-96a4-597ec3656e83 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:59.542644 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c5910f3-8ff1-4121-96a4-597ec3656e83 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:59.543342 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c5910f3-8ff1-4121-96a4-597ec3656e83 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:59.543785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c5910f3-8ff1-4121-96a4-597ec3656e83 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:59.544203 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2c5910f3-8ff1-4121-96a4-597ec3656e83 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:59.567565 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.objects.instance [None req-2c5910f3-8ff1-4121-96a4-597ec3656e83 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lazy-loading 'flavor' on Instance uuid 662038ab-8bfa-49e3-9e21-cdb1a2236c88 {{(pid=127124) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 04:13:59.647952 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2c5910f3-8ff1-4121-96a4-597ec3656e83 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "POST /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88/action" status: 202 len: 0 microversion: 2.1 time: 0.202040 Oct 29 04:13:59.648562 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3866/7506] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 04:13:59 2022] POST /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:13:59.655326 n-d-862967-2 devstack@n-api.service[127125]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7606be4b-8fa9-49e5-a603-02528cbf3013] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 04:13:59.656179 n-d-862967-2 devstack@n-api.service[127125]: ERROR oslo.messaging._drivers.impl_rabbit [-] [db70aafa-b304-4ac0-be4f-1798e9789b82] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 04:13:59.656804 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=24 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:13:59.657527 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=56 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:13:59.664666 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-88bfd484-ecb7-4a5c-bbc8-5bddc6ded109 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:13:59.665410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-88bfd484-ecb7-4a5c-bbc8-5bddc6ded109 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:13:59.673388 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88bfd484-ecb7-4a5c-bbc8-5bddc6ded109 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:59.673885 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88bfd484-ecb7-4a5c-bbc8-5bddc6ded109 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:59.674329 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88bfd484-ecb7-4a5c-bbc8-5bddc6ded109 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:59.675046 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88bfd484-ecb7-4a5c-bbc8-5bddc6ded109 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:13:59.675510 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88bfd484-ecb7-4a5c-bbc8-5bddc6ded109 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:13:59.676079 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-88bfd484-ecb7-4a5c-bbc8-5bddc6ded109 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:13:59.828479 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-88bfd484-ecb7-4a5c-bbc8-5bddc6ded109 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:13:59.837209 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-88bfd484-ecb7-4a5c-bbc8-5bddc6ded109 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1569 microversion: 2.1 time: 0.183853 Oct 29 04:13:59.837789 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3641/7507] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:13:59 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:14:00.874665 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-4ad7477d-8f38-401a-a481-127d4adec662 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:14:00.875480 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-4ad7477d-8f38-401a-a481-127d4adec662 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:00.884902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ad7477d-8f38-401a-a481-127d4adec662 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:00.885443 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ad7477d-8f38-401a-a481-127d4adec662 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:00.885923 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ad7477d-8f38-401a-a481-127d4adec662 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:00.886691 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ad7477d-8f38-401a-a481-127d4adec662 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:00.887194 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ad7477d-8f38-401a-a481-127d4adec662 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:00.887675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-4ad7477d-8f38-401a-a481-127d4adec662 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:00.893404 n-d-862967-2 devstack@n-api.service[127124]: INFO oslo.messaging._drivers.impl_rabbit [-] [a4c67498-176b-466c-9f6d-56e0bcdaf058] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 41932. Oct 29 04:14:00.894270 n-d-862967-2 devstack@n-api.service[127124]: INFO oslo.messaging._drivers.impl_rabbit [-] [2206413f-602f-4f31-86b1-4a062554af7b] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 41934. Oct 29 04:14:01.025087 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-4ad7477d-8f38-401a-a481-127d4adec662 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:14:01.033780 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-4ad7477d-8f38-401a-a481-127d4adec662 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1569 microversion: 2.1 time: 0.166433 Oct 29 04:14:01.034358 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3867/7508] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:14:00 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:14:02.062199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-9d41d7cc-9fca-49e6-b912-1d431cf41515 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:14:02.063694 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-9d41d7cc-9fca-49e6-b912-1d431cf41515 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:02.077636 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d41d7cc-9fca-49e6-b912-1d431cf41515 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:02.078562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d41d7cc-9fca-49e6-b912-1d431cf41515 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:02.078562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d41d7cc-9fca-49e6-b912-1d431cf41515 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:02.079335 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d41d7cc-9fca-49e6-b912-1d431cf41515 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:02.079799 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d41d7cc-9fca-49e6-b912-1d431cf41515 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:02.080264 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-9d41d7cc-9fca-49e6-b912-1d431cf41515 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:02.097644 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] [db70aafa-b304-4ac0-be4f-1798e9789b82] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 41940. Oct 29 04:14:02.098378 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] [7606be4b-8fa9-49e5-a603-02528cbf3013] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 41938. Oct 29 04:14:02.229759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-9d41d7cc-9fca-49e6-b912-1d431cf41515 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:14:02.238591 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-9d41d7cc-9fca-49e6-b912-1d431cf41515 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1569 microversion: 2.1 time: 0.183613 Oct 29 04:14:02.239183 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3642/7509] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:14:02 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:14:03.269143 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2b67a4a5-427c-49e3-ace3-0b19a5dce55f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:14:03.270129 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2b67a4a5-427c-49e3-ace3-0b19a5dce55f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:03.281780 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2b67a4a5-427c-49e3-ace3-0b19a5dce55f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:03.282582 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2b67a4a5-427c-49e3-ace3-0b19a5dce55f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:03.283311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2b67a4a5-427c-49e3-ace3-0b19a5dce55f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:03.284459 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2b67a4a5-427c-49e3-ace3-0b19a5dce55f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:03.285269 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2b67a4a5-427c-49e3-ace3-0b19a5dce55f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:03.285982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2b67a4a5-427c-49e3-ace3-0b19a5dce55f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:03.436791 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-2b67a4a5-427c-49e3-ace3-0b19a5dce55f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:14:03.445307 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2b67a4a5-427c-49e3-ace3-0b19a5dce55f tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1569 microversion: 2.1 time: 0.182899 Oct 29 04:14:03.445893 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3868/7510] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:14:03 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:14:04.471599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1bf9624d-2cf4-4f5e-b2dc-b308903cfc62 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:14:04.472314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1bf9624d-2cf4-4f5e-b2dc-b308903cfc62 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:04.481218 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1bf9624d-2cf4-4f5e-b2dc-b308903cfc62 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:04.481850 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1bf9624d-2cf4-4f5e-b2dc-b308903cfc62 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:04.482405 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1bf9624d-2cf4-4f5e-b2dc-b308903cfc62 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:04.483284 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1bf9624d-2cf4-4f5e-b2dc-b308903cfc62 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:04.483862 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1bf9624d-2cf4-4f5e-b2dc-b308903cfc62 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:04.484400 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1bf9624d-2cf4-4f5e-b2dc-b308903cfc62 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:04.627534 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1bf9624d-2cf4-4f5e-b2dc-b308903cfc62 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:14:04.635919 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1bf9624d-2cf4-4f5e-b2dc-b308903cfc62 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1569 microversion: 2.1 time: 0.169511 Oct 29 04:14:04.636552 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3643/7511] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:14:04 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:14:05.669469 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-baa673e1-7c19-4409-b4c6-4963a439f33d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:14:05.670203 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-baa673e1-7c19-4409-b4c6-4963a439f33d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:05.678229 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-baa673e1-7c19-4409-b4c6-4963a439f33d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:05.678779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-baa673e1-7c19-4409-b4c6-4963a439f33d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:05.679271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-baa673e1-7c19-4409-b4c6-4963a439f33d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:05.680062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-baa673e1-7c19-4409-b4c6-4963a439f33d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:05.680573 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-baa673e1-7c19-4409-b4c6-4963a439f33d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:05.681083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-baa673e1-7c19-4409-b4c6-4963a439f33d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:05.822374 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-baa673e1-7c19-4409-b4c6-4963a439f33d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:14:05.830527 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-baa673e1-7c19-4409-b4c6-4963a439f33d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1569 microversion: 2.1 time: 0.167567 Oct 29 04:14:05.831115 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3869/7512] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:14:05 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:14:06.858572 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1bb59f80-7fa9-4415-9986-722d16d24dc8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:14:06.859596 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1bb59f80-7fa9-4415-9986-722d16d24dc8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:06.871520 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1bb59f80-7fa9-4415-9986-722d16d24dc8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:06.872053 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1bb59f80-7fa9-4415-9986-722d16d24dc8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:06.872495 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1bb59f80-7fa9-4415-9986-722d16d24dc8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:06.873237 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1bb59f80-7fa9-4415-9986-722d16d24dc8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:06.873695 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1bb59f80-7fa9-4415-9986-722d16d24dc8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:06.874131 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1bb59f80-7fa9-4415-9986-722d16d24dc8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:07.027369 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1bb59f80-7fa9-4415-9986-722d16d24dc8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:14:07.039608 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1bb59f80-7fa9-4415-9986-722d16d24dc8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1569 microversion: 2.1 time: 0.187600 Oct 29 04:14:07.040407 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3644/7513] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:14:06 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:14:08.064729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-ed73db4f-3375-4339-bb97-8a8becec53ce tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:14:08.065356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-ed73db4f-3375-4339-bb97-8a8becec53ce tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:08.072963 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed73db4f-3375-4339-bb97-8a8becec53ce tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:08.073463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed73db4f-3375-4339-bb97-8a8becec53ce tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:08.073903 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed73db4f-3375-4339-bb97-8a8becec53ce tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:08.074592 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed73db4f-3375-4339-bb97-8a8becec53ce tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:08.075070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed73db4f-3375-4339-bb97-8a8becec53ce tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:08.075506 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-ed73db4f-3375-4339-bb97-8a8becec53ce tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:08.216083 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-ed73db4f-3375-4339-bb97-8a8becec53ce tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:14:08.224278 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-ed73db4f-3375-4339-bb97-8a8becec53ce tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1569 microversion: 2.1 time: 0.163592 Oct 29 04:14:08.224883 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3870/7514] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:14:08 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:14:09.251064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3a117716-1192-42b3-ad16-29a78a8c2892 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:14:09.252116 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3a117716-1192-42b3-ad16-29a78a8c2892 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:09.263192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a117716-1192-42b3-ad16-29a78a8c2892 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:09.263679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a117716-1192-42b3-ad16-29a78a8c2892 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:09.264121 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a117716-1192-42b3-ad16-29a78a8c2892 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:09.264856 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a117716-1192-42b3-ad16-29a78a8c2892 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:09.265317 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a117716-1192-42b3-ad16-29a78a8c2892 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:09.265743 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3a117716-1192-42b3-ad16-29a78a8c2892 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:09.413972 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3a117716-1192-42b3-ad16-29a78a8c2892 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:14:09.423966 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3a117716-1192-42b3-ad16-29a78a8c2892 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1569 microversion: 2.1 time: 0.178998 Oct 29 04:14:09.424659 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3645/7515] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:14:09 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:14:10.448617 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-963ed631-285a-4a18-a129-8c86358dc9d8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:14:10.449241 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-963ed631-285a-4a18-a129-8c86358dc9d8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:10.456801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-963ed631-285a-4a18-a129-8c86358dc9d8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:10.457298 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-963ed631-285a-4a18-a129-8c86358dc9d8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:10.457740 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-963ed631-285a-4a18-a129-8c86358dc9d8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:10.458498 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-963ed631-285a-4a18-a129-8c86358dc9d8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:10.458956 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-963ed631-285a-4a18-a129-8c86358dc9d8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:10.459385 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-963ed631-285a-4a18-a129-8c86358dc9d8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:10.692482 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-963ed631-285a-4a18-a129-8c86358dc9d8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:14:10.701180 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-963ed631-285a-4a18-a129-8c86358dc9d8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1569 microversion: 2.1 time: 0.256758 Oct 29 04:14:10.701709 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3871/7516] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:14:10 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1569 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:14:11.730009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-362fad12-a901-481b-baee-d85901553bb7 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:14:11.731059 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-362fad12-a901-481b-baee-d85901553bb7 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:11.739444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-362fad12-a901-481b-baee-d85901553bb7 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:11.739945 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-362fad12-a901-481b-baee-d85901553bb7 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:11.740395 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-362fad12-a901-481b-baee-d85901553bb7 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:11.741149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-362fad12-a901-481b-baee-d85901553bb7 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:11.741613 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-362fad12-a901-481b-baee-d85901553bb7 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:11.742050 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-362fad12-a901-481b-baee-d85901553bb7 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:11.882612 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-362fad12-a901-481b-baee-d85901553bb7 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:14:11.894881 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-362fad12-a901-481b-baee-d85901553bb7 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1569 microversion: 2.1 time: 0.171294 Oct 29 04:14:11.895436 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3646/7517] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:14:11 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:14:12.921406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-83e46fa5-1358-41c8-a57f-af3564530782 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:14:12.922026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-83e46fa5-1358-41c8-a57f-af3564530782 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:12.930293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83e46fa5-1358-41c8-a57f-af3564530782 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:12.930293 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83e46fa5-1358-41c8-a57f-af3564530782 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:12.930607 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83e46fa5-1358-41c8-a57f-af3564530782 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:12.931339 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83e46fa5-1358-41c8-a57f-af3564530782 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:12.931798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83e46fa5-1358-41c8-a57f-af3564530782 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:12.932228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-83e46fa5-1358-41c8-a57f-af3564530782 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:13.077344 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-83e46fa5-1358-41c8-a57f-af3564530782 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:14:13.086142 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-83e46fa5-1358-41c8-a57f-af3564530782 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1569 microversion: 2.1 time: 0.168758 Oct 29 04:14:13.091370 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3872/7518] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:14:12 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:14:14.111173 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-a0dfe35f-66c4-4b48-89ec-09d59b0202b5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:14:14.111862 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-a0dfe35f-66c4-4b48-89ec-09d59b0202b5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:14.119819 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a0dfe35f-66c4-4b48-89ec-09d59b0202b5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:14.120451 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a0dfe35f-66c4-4b48-89ec-09d59b0202b5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:14.121036 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a0dfe35f-66c4-4b48-89ec-09d59b0202b5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:14.121820 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a0dfe35f-66c4-4b48-89ec-09d59b0202b5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:14.122321 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a0dfe35f-66c4-4b48-89ec-09d59b0202b5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:14.122980 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-a0dfe35f-66c4-4b48-89ec-09d59b0202b5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:14.272304 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-a0dfe35f-66c4-4b48-89ec-09d59b0202b5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:14:14.280740 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-a0dfe35f-66c4-4b48-89ec-09d59b0202b5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1570 microversion: 2.1 time: 0.174140 Oct 29 04:14:14.281327 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3647/7519] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:14:14 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:14:14.303403 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-1035e437-5681-4aec-8f16-40bc0ff41ec1 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:14:14.304151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1035e437-5681-4aec-8f16-40bc0ff41ec1 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:14.311382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1035e437-5681-4aec-8f16-40bc0ff41ec1 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:14.311864 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1035e437-5681-4aec-8f16-40bc0ff41ec1 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:14.312294 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1035e437-5681-4aec-8f16-40bc0ff41ec1 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:14.313014 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1035e437-5681-4aec-8f16-40bc0ff41ec1 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:14.313462 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1035e437-5681-4aec-8f16-40bc0ff41ec1 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:14.313880 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-1035e437-5681-4aec-8f16-40bc0ff41ec1 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:14.347586 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-1035e437-5681-4aec-8f16-40bc0ff41ec1 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127124) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 29 04:14:14.419047 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-1035e437-5681-4aec-8f16-40bc0ff41ec1 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "POST /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88/action" status: 202 len: 0 microversion: 2.1 time: 0.119489 Oct 29 04:14:14.419915 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3873/7520] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 04:14:14 2022] POST /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:14:14.428365 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c706c752-0a24-4555-a6dd-37cb7ea1d2e3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:14:14.429628 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c706c752-0a24-4555-a6dd-37cb7ea1d2e3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:14.436868 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c706c752-0a24-4555-a6dd-37cb7ea1d2e3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:14.437446 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c706c752-0a24-4555-a6dd-37cb7ea1d2e3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:14.437956 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c706c752-0a24-4555-a6dd-37cb7ea1d2e3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:14.438941 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c706c752-0a24-4555-a6dd-37cb7ea1d2e3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:14.439422 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c706c752-0a24-4555-a6dd-37cb7ea1d2e3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:14.439851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c706c752-0a24-4555-a6dd-37cb7ea1d2e3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:14.573840 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-c706c752-0a24-4555-a6dd-37cb7ea1d2e3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:14:14.582180 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c706c752-0a24-4555-a6dd-37cb7ea1d2e3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1518 microversion: 2.1 time: 0.157929 Oct 29 04:14:14.582859 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3648/7521] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:14:14 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:14:15.606843 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f31da72d-aa5a-4bc6-aeb0-285939d63bb5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:14:15.607572 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f31da72d-aa5a-4bc6-aeb0-285939d63bb5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:15.614929 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f31da72d-aa5a-4bc6-aeb0-285939d63bb5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:15.615411 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f31da72d-aa5a-4bc6-aeb0-285939d63bb5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:15.615851 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f31da72d-aa5a-4bc6-aeb0-285939d63bb5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:15.616563 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f31da72d-aa5a-4bc6-aeb0-285939d63bb5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:15.617084 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f31da72d-aa5a-4bc6-aeb0-285939d63bb5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:15.617501 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f31da72d-aa5a-4bc6-aeb0-285939d63bb5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:15.761301 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f31da72d-aa5a-4bc6-aeb0-285939d63bb5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:14:15.769598 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f31da72d-aa5a-4bc6-aeb0-285939d63bb5 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1520 microversion: 2.1 time: 0.167709 Oct 29 04:14:15.770180 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3874/7522] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:14:15 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:14:16.707562 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-8964b9ec-9cf3-4ed6-bab7-686bac96430d req-f334abb6-074e-4f23-ae26-b86f95dee9db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662038ab-8bfa-49e3-9e21-cdb1a2236c88", "name": "network-vif-unplugged", "status": "completed", "tag": "e53ca1bb-750e-48e9-bcd7-5985560ac50d"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:14:16.721759 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8964b9ec-9cf3-4ed6-bab7-686bac96430d req-f334abb6-074e-4f23-ae26-b86f95dee9db service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:16.722346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8964b9ec-9cf3-4ed6-bab7-686bac96430d req-f334abb6-074e-4f23-ae26-b86f95dee9db service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:16.722849 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-8964b9ec-9cf3-4ed6-bab7-686bac96430d req-f334abb6-074e-4f23-ae26-b86f95dee9db service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:16.738124 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.compute.server_external_events [req-8964b9ec-9cf3-4ed6-bab7-686bac96430d req-f334abb6-074e-4f23-ae26-b86f95dee9db service nova] Unable to find a host for instance 662038ab-8bfa-49e3-9e21-cdb1a2236c88. Dropping event network-vif-unplugged {{(pid=127125) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 29 04:14:16.739123 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-8964b9ec-9cf3-4ed6-bab7-686bac96430d req-f334abb6-074e-4f23-ae26-b86f95dee9db service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035601 Oct 29 04:14:16.739815 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3649/7523] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 29 04:14:16.794054 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-b791f6d5-99a3-4476-80b2-fd1cf5dec038 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:14:16.794799 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-b791f6d5-99a3-4476-80b2-fd1cf5dec038 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:16.809027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b791f6d5-99a3-4476-80b2-fd1cf5dec038 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:16.809520 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b791f6d5-99a3-4476-80b2-fd1cf5dec038 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:16.809949 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b791f6d5-99a3-4476-80b2-fd1cf5dec038 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:16.810672 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b791f6d5-99a3-4476-80b2-fd1cf5dec038 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:16.811134 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b791f6d5-99a3-4476-80b2-fd1cf5dec038 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:16.811573 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-b791f6d5-99a3-4476-80b2-fd1cf5dec038 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:16.947713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-b791f6d5-99a3-4476-80b2-fd1cf5dec038 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:14:16.956247 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-b791f6d5-99a3-4476-80b2-fd1cf5dec038 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1520 microversion: 2.1 time: 0.167284 Oct 29 04:14:16.956894 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3875/7524] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:14:16 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:14:17.981181 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-884ab7d4-8b9b-4528-9850-cbccf0a101c6 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:14:17.981778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-884ab7d4-8b9b-4528-9850-cbccf0a101c6 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:17.989955 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-884ab7d4-8b9b-4528-9850-cbccf0a101c6 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:17.990459 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-884ab7d4-8b9b-4528-9850-cbccf0a101c6 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:17.990902 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-884ab7d4-8b9b-4528-9850-cbccf0a101c6 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:17.991627 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-884ab7d4-8b9b-4528-9850-cbccf0a101c6 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:17.992098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-884ab7d4-8b9b-4528-9850-cbccf0a101c6 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:17.992634 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-884ab7d4-8b9b-4528-9850-cbccf0a101c6 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:18.133226 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-884ab7d4-8b9b-4528-9850-cbccf0a101c6 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:14:18.141301 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-884ab7d4-8b9b-4528-9850-cbccf0a101c6 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1520 microversion: 2.1 time: 0.165773 Oct 29 04:14:18.142080 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3650/7525] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:14:17 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:14:19.165737 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-58274224-720a-4058-bccd-479b83b40b2e tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:14:19.166396 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-58274224-720a-4058-bccd-479b83b40b2e tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:19.173785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-58274224-720a-4058-bccd-479b83b40b2e tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:19.174286 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-58274224-720a-4058-bccd-479b83b40b2e tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:19.174710 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-58274224-720a-4058-bccd-479b83b40b2e tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:19.175448 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-58274224-720a-4058-bccd-479b83b40b2e tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:19.175906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-58274224-720a-4058-bccd-479b83b40b2e tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:19.176343 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-58274224-720a-4058-bccd-479b83b40b2e tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:19.315450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-58274224-720a-4058-bccd-479b83b40b2e tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:14:19.323923 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-58274224-720a-4058-bccd-479b83b40b2e tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1520 microversion: 2.1 time: 0.162253 Oct 29 04:14:19.324488 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3876/7526] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:14:19 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:14:20.347744 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-461801be-4751-4c8c-953b-1d24f586db02 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:14:20.348349 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-461801be-4751-4c8c-953b-1d24f586db02 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:20.355404 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-461801be-4751-4c8c-953b-1d24f586db02 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:20.355901 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-461801be-4751-4c8c-953b-1d24f586db02 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:20.356346 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-461801be-4751-4c8c-953b-1d24f586db02 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:20.357093 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-461801be-4751-4c8c-953b-1d24f586db02 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:20.357566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-461801be-4751-4c8c-953b-1d24f586db02 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:20.357959 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-461801be-4751-4c8c-953b-1d24f586db02 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:20.496259 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-461801be-4751-4c8c-953b-1d24f586db02 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:14:20.504274 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-461801be-4751-4c8c-953b-1d24f586db02 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1576 microversion: 2.1 time: 0.160544 Oct 29 04:14:20.504848 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3651/7527] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:14:20 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:14:21.528811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8a8b1392-2cbf-4f15-a7b2-83f39772f210 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:14:21.529425 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8a8b1392-2cbf-4f15-a7b2-83f39772f210 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:21.537623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8a8b1392-2cbf-4f15-a7b2-83f39772f210 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:21.538117 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8a8b1392-2cbf-4f15-a7b2-83f39772f210 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:21.538558 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8a8b1392-2cbf-4f15-a7b2-83f39772f210 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:21.539252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8a8b1392-2cbf-4f15-a7b2-83f39772f210 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:21.539695 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8a8b1392-2cbf-4f15-a7b2-83f39772f210 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:21.540128 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8a8b1392-2cbf-4f15-a7b2-83f39772f210 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:21.681668 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8a8b1392-2cbf-4f15-a7b2-83f39772f210 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:14:21.692129 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8a8b1392-2cbf-4f15-a7b2-83f39772f210 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1576 microversion: 2.1 time: 0.168176 Oct 29 04:14:21.692758 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3877/7528] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:14:21 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:14:22.722960 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2bb2650c-0ebe-4270-8077-8e8f5a0dc144 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:14:22.723975 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2bb2650c-0ebe-4270-8077-8e8f5a0dc144 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:22.733837 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2bb2650c-0ebe-4270-8077-8e8f5a0dc144 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:22.734802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2bb2650c-0ebe-4270-8077-8e8f5a0dc144 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:22.735605 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2bb2650c-0ebe-4270-8077-8e8f5a0dc144 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:22.736312 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2bb2650c-0ebe-4270-8077-8e8f5a0dc144 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:22.736803 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2bb2650c-0ebe-4270-8077-8e8f5a0dc144 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:22.737234 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2bb2650c-0ebe-4270-8077-8e8f5a0dc144 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:22.879718 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2bb2650c-0ebe-4270-8077-8e8f5a0dc144 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:14:22.892006 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2bb2650c-0ebe-4270-8077-8e8f5a0dc144 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1576 microversion: 2.1 time: 0.177703 Oct 29 04:14:22.892618 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3652/7529] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:14:22 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:14:23.919706 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-027cb49f-82ed-4170-95e6-ced92880f95d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:14:23.920755 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-027cb49f-82ed-4170-95e6-ced92880f95d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:23.931910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-027cb49f-82ed-4170-95e6-ced92880f95d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:23.932757 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-027cb49f-82ed-4170-95e6-ced92880f95d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:23.933478 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-027cb49f-82ed-4170-95e6-ced92880f95d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:23.934623 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-027cb49f-82ed-4170-95e6-ced92880f95d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:23.935384 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-027cb49f-82ed-4170-95e6-ced92880f95d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:23.936080 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-027cb49f-82ed-4170-95e6-ced92880f95d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:24.075270 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-027cb49f-82ed-4170-95e6-ced92880f95d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:14:24.086437 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-027cb49f-82ed-4170-95e6-ced92880f95d tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1576 microversion: 2.1 time: 0.173154 Oct 29 04:14:24.087264 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3878/7530] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:14:23 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:14:25.115240 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1ab75f73-6c23-4011-a093-18d53104215a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:14:25.116032 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1ab75f73-6c23-4011-a093-18d53104215a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:25.125958 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ab75f73-6c23-4011-a093-18d53104215a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:25.126655 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ab75f73-6c23-4011-a093-18d53104215a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:25.127308 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ab75f73-6c23-4011-a093-18d53104215a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:25.128267 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ab75f73-6c23-4011-a093-18d53104215a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:25.128936 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ab75f73-6c23-4011-a093-18d53104215a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:25.129531 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1ab75f73-6c23-4011-a093-18d53104215a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:25.287500 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1ab75f73-6c23-4011-a093-18d53104215a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:14:25.295634 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1ab75f73-6c23-4011-a093-18d53104215a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1576 microversion: 2.1 time: 0.186278 Oct 29 04:14:25.296229 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3653/7531] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:14:25 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1576 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:14:26.323996 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-8d417042-7efd-4059-a1fc-3b05de8e6e9b tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:14:26.325270 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-8d417042-7efd-4059-a1fc-3b05de8e6e9b tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:26.334367 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d417042-7efd-4059-a1fc-3b05de8e6e9b tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:26.334860 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d417042-7efd-4059-a1fc-3b05de8e6e9b tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:26.335284 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d417042-7efd-4059-a1fc-3b05de8e6e9b tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:26.335981 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d417042-7efd-4059-a1fc-3b05de8e6e9b tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:26.336430 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d417042-7efd-4059-a1fc-3b05de8e6e9b tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:26.336888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-8d417042-7efd-4059-a1fc-3b05de8e6e9b tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:26.355932 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:14:26.482943 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-8d417042-7efd-4059-a1fc-3b05de8e6e9b tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:14:26.491847 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-8d417042-7efd-4059-a1fc-3b05de8e6e9b tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1576 microversion: 2.1 time: 0.174944 Oct 29 04:14:26.492429 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3879/7532] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:14:26 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:14:27.515802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-209cb818-abc2-4052-b157-7638433e31ce tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:14:27.516420 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-209cb818-abc2-4052-b157-7638433e31ce tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:27.524231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-209cb818-abc2-4052-b157-7638433e31ce tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:27.524764 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-209cb818-abc2-4052-b157-7638433e31ce tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:27.525258 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-209cb818-abc2-4052-b157-7638433e31ce tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:27.526454 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-209cb818-abc2-4052-b157-7638433e31ce tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:27.526946 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-209cb818-abc2-4052-b157-7638433e31ce tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:27.527423 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-209cb818-abc2-4052-b157-7638433e31ce tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:27.665557 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-209cb818-abc2-4052-b157-7638433e31ce tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:14:27.677661 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-209cb818-abc2-4052-b157-7638433e31ce tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1576 microversion: 2.1 time: 0.165819 Oct 29 04:14:27.678508 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3654/7533] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:14:27 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:14:28.707196 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9098712e-a065-4518-8f94-9073aff0666a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:14:28.707802 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9098712e-a065-4518-8f94-9073aff0666a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:28.714975 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9098712e-a065-4518-8f94-9073aff0666a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:28.715464 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9098712e-a065-4518-8f94-9073aff0666a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:28.715944 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9098712e-a065-4518-8f94-9073aff0666a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:28.716700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9098712e-a065-4518-8f94-9073aff0666a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:28.717201 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9098712e-a065-4518-8f94-9073aff0666a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:28.717815 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9098712e-a065-4518-8f94-9073aff0666a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:28.853774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9098712e-a065-4518-8f94-9073aff0666a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:14:28.862355 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9098712e-a065-4518-8f94-9073aff0666a tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1576 microversion: 2.1 time: 0.159302 Oct 29 04:14:28.862957 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3880/7534] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:14:28 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:14:29.889314 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-5c47cde0-2a53-4722-8a4e-63198a442af3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:14:29.890288 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-5c47cde0-2a53-4722-8a4e-63198a442af3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:29.894448 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=29 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:14:29.903134 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c47cde0-2a53-4722-8a4e-63198a442af3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:29.903891 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c47cde0-2a53-4722-8a4e-63198a442af3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:29.904577 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c47cde0-2a53-4722-8a4e-63198a442af3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:29.905699 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c47cde0-2a53-4722-8a4e-63198a442af3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:29.906413 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c47cde0-2a53-4722-8a4e-63198a442af3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:29.907082 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-5c47cde0-2a53-4722-8a4e-63198a442af3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:29.911316 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=81 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:14:30.052479 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-5c47cde0-2a53-4722-8a4e-63198a442af3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:14:30.061063 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-5c47cde0-2a53-4722-8a4e-63198a442af3 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1576 microversion: 2.1 time: 0.177881 Oct 29 04:14:30.061676 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3655/7535] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:14:29 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:14:30.833012 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-3fe56024-21cb-4d01-9341-ce1c4c61b848 req-51847dbb-d2d8-4acd-b5ec-03c29a670512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662038ab-8bfa-49e3-9e21-cdb1a2236c88", "name": "network-vif-plugged", "status": "completed", "tag": "e53ca1bb-750e-48e9-bcd7-5985560ac50d"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:14:30.839094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:14:30.844852 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3fe56024-21cb-4d01-9341-ce1c4c61b848 req-51847dbb-d2d8-4acd-b5ec-03c29a670512 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:30.845324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3fe56024-21cb-4d01-9341-ce1c4c61b848 req-51847dbb-d2d8-4acd-b5ec-03c29a670512 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:30.845738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-3fe56024-21cb-4d01-9341-ce1c4c61b848 req-51847dbb-d2d8-4acd-b5ec-03c29a670512 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:30.861178 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-3fe56024-21cb-4d01-9341-ce1c4c61b848 req-51847dbb-d2d8-4acd-b5ec-03c29a670512 service nova] Creating event network-vif-plugged:e53ca1bb-750e-48e9-bcd7-5985560ac50d for instance 662038ab-8bfa-49e3-9e21-cdb1a2236c88 on n-h2-862967-2 Oct 29 04:14:30.866403 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-3fe56024-21cb-4d01-9341-ce1c4c61b848 req-51847dbb-d2d8-4acd-b5ec-03c29a670512 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039619 Oct 29 04:14:30.867233 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3881/7536] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:14:31.085427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2289093d-011f-4734-a047-ced6fc7ccfd7 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:14:31.086064 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2289093d-011f-4734-a047-ced6fc7ccfd7 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:31.093631 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2289093d-011f-4734-a047-ced6fc7ccfd7 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:31.094139 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2289093d-011f-4734-a047-ced6fc7ccfd7 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:31.094589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2289093d-011f-4734-a047-ced6fc7ccfd7 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:31.095395 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2289093d-011f-4734-a047-ced6fc7ccfd7 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:31.095866 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2289093d-011f-4734-a047-ced6fc7ccfd7 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:31.096307 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2289093d-011f-4734-a047-ced6fc7ccfd7 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:31.237320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-2289093d-011f-4734-a047-ced6fc7ccfd7 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:14:31.250729 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2289093d-011f-4734-a047-ced6fc7ccfd7 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1576 microversion: 2.1 time: 0.169010 Oct 29 04:14:31.251662 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3656/7537] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:14:31 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:14:32.281463 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9f2aa60f-6951-4576-b6f2-84cd8a114760 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:14:32.282447 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9f2aa60f-6951-4576-b6f2-84cd8a114760 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:14:32.292158 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f2aa60f-6951-4576-b6f2-84cd8a114760 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:32.292910 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f2aa60f-6951-4576-b6f2-84cd8a114760 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:32.293536 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f2aa60f-6951-4576-b6f2-84cd8a114760 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:32.294528 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f2aa60f-6951-4576-b6f2-84cd8a114760 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:14:32.295186 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f2aa60f-6951-4576-b6f2-84cd8a114760 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:14:32.295796 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f2aa60f-6951-4576-b6f2-84cd8a114760 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:14:32.521739 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9f2aa60f-6951-4576-b6f2-84cd8a114760 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:14:32.530084 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9f2aa60f-6951-4576-b6f2-84cd8a114760 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1563 microversion: 2.1 time: 0.256366 Oct 29 04:14:32.530668 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3882/7538] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:14:32 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1563 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:15:49.224485 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:15:49.225874 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=11 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:15:49.226965 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 04:15:49.227115 n-d-862967-2 devstack@n-api.service[127125]: Sat Oct 29 04:15:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 (ip 10.222.0.46) !!! Oct 29 04:15:49.228856 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 04:15:49.228856 n-d-862967-2 devstack@n-api.service[127125]: Sat Oct 29 04:15:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 (ip 10.222.0.46) !!! Oct 29 04:15:49.229929 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 04:15:49.229929 n-d-862967-2 devstack@n-api.service[127125]: Sat Oct 29 04:15:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 (ip 10.222.0.46) !!! Oct 29 04:15:49.235247 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:15:49.235766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-08a6c2c7-3208-4edf-ace0-d676c033c79b tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:15:49.235963 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-08a6c2c7-3208-4edf-ace0-d676c033c79b tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:15:49.236347 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=16 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:15:49.238396 n-d-862967-2 devstack@n-api.service[127124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 04:15:49.238396 n-d-862967-2 devstack@n-api.service[127124]: Sat Oct 29 04:15:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.46) !!! Oct 29 04:15:49.245105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08a6c2c7-3208-4edf-ace0-d676c033c79b tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:49.245625 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08a6c2c7-3208-4edf-ace0-d676c033c79b tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:49.246262 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08a6c2c7-3208-4edf-ace0-d676c033c79b tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:49.247041 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08a6c2c7-3208-4edf-ace0-d676c033c79b tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:49.247508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08a6c2c7-3208-4edf-ace0-d676c033c79b tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:49.247938 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-08a6c2c7-3208-4edf-ace0-d676c033c79b tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:49.282217 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-08a6c2c7-3208-4edf-ace0-d676c033c79b tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 04:15:49.313267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-e68cba38-60d9-4e36-bd77-b515068bd477 req-636d4883-e9d1-49da-be60-6eb1d525fcd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "662038ab-8bfa-49e3-9e21-cdb1a2236c88", "tag": "e53ca1bb-750e-48e9-bcd7-5985560ac50d"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:15:49.323906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e68cba38-60d9-4e36-bd77-b515068bd477 req-636d4883-e9d1-49da-be60-6eb1d525fcd6 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:49.324415 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e68cba38-60d9-4e36-bd77-b515068bd477 req-636d4883-e9d1-49da-be60-6eb1d525fcd6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:49.324856 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-e68cba38-60d9-4e36-bd77-b515068bd477 req-636d4883-e9d1-49da-be60-6eb1d525fcd6 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:49.337584 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-e68cba38-60d9-4e36-bd77-b515068bd477 req-636d4883-e9d1-49da-be60-6eb1d525fcd6 service nova] Creating event network-changed:e53ca1bb-750e-48e9-bcd7-5985560ac50d for instance 662038ab-8bfa-49e3-9e21-cdb1a2236c88 on n-h2-862967-2 Oct 29 04:15:49.343344 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-e68cba38-60d9-4e36-bd77-b515068bd477 req-636d4883-e9d1-49da-be60-6eb1d525fcd6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118675 Oct 29 04:15:49.344230 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3883/7539] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:15:49.366641 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-08a6c2c7-3208-4edf-ace0-d676c033c79b tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "DELETE /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 204 len: 0 microversion: 2.1 time: 0.144337 Oct 29 04:15:49.368569 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3657/7540] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 04:15:49 2022] DELETE /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 04:15:49.376886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7be65e2e-d0da-4b3f-9fae-95ceea89eb22 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:15:49.377830 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7be65e2e-d0da-4b3f-9fae-95ceea89eb22 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:15:49.385520 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7be65e2e-d0da-4b3f-9fae-95ceea89eb22 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:49.386033 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7be65e2e-d0da-4b3f-9fae-95ceea89eb22 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:49.386468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7be65e2e-d0da-4b3f-9fae-95ceea89eb22 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:49.387639 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7be65e2e-d0da-4b3f-9fae-95ceea89eb22 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:49.388103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7be65e2e-d0da-4b3f-9fae-95ceea89eb22 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:49.388559 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7be65e2e-d0da-4b3f-9fae-95ceea89eb22 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:49.530867 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7be65e2e-d0da-4b3f-9fae-95ceea89eb22 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:15:49.539576 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7be65e2e-d0da-4b3f-9fae-95ceea89eb22 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1569 microversion: 2.1 time: 0.167176 Oct 29 04:15:49.540196 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3884/7541] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:15:49 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:15:50.564235 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-baa4b688-3b56-47a5-a378-b985bd167079 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:15:50.565175 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-baa4b688-3b56-47a5-a378-b985bd167079 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:15:50.573654 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-baa4b688-3b56-47a5-a378-b985bd167079 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:50.574978 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-baa4b688-3b56-47a5-a378-b985bd167079 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:50.574978 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-baa4b688-3b56-47a5-a378-b985bd167079 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:50.575299 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-baa4b688-3b56-47a5-a378-b985bd167079 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:50.575788 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-baa4b688-3b56-47a5-a378-b985bd167079 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:50.576193 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-baa4b688-3b56-47a5-a378-b985bd167079 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:50.768904 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-baa4b688-3b56-47a5-a378-b985bd167079 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:15:50.777437 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-baa4b688-3b56-47a5-a378-b985bd167079 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1569 microversion: 2.1 time: 0.217804 Oct 29 04:15:50.777996 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3658/7542] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:15:50 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1569 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:15:51.461923 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-cdb3a19d-7ca1-4905-966f-b96336aec956 req-68af9fa4-0b41-4181-901d-d696aae3ae80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662038ab-8bfa-49e3-9e21-cdb1a2236c88", "name": "network-vif-deleted", "tag": "e53ca1bb-750e-48e9-bcd7-5985560ac50d"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:15:51.471950 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-cdb3a19d-7ca1-4905-966f-b96336aec956 req-68af9fa4-0b41-4181-901d-d696aae3ae80 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:51.472472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-cdb3a19d-7ca1-4905-966f-b96336aec956 req-68af9fa4-0b41-4181-901d-d696aae3ae80 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:51.472930 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-cdb3a19d-7ca1-4905-966f-b96336aec956 req-68af9fa4-0b41-4181-901d-d696aae3ae80 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:51.484196 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-cdb3a19d-7ca1-4905-966f-b96336aec956 req-68af9fa4-0b41-4181-901d-d696aae3ae80 service nova] Creating event network-vif-deleted:e53ca1bb-750e-48e9-bcd7-5985560ac50d for instance 662038ab-8bfa-49e3-9e21-cdb1a2236c88 on n-h2-862967-2 Oct 29 04:15:51.490305 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-cdb3a19d-7ca1-4905-966f-b96336aec956 req-68af9fa4-0b41-4181-901d-d696aae3ae80 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103675 Oct 29 04:15:51.490928 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3885/7543] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:15:51.808295 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3aa96de0-a94a-4e78-bf00-bf901a5afc75 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:15:51.810266 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3aa96de0-a94a-4e78-bf00-bf901a5afc75 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:15:51.818293 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3aa96de0-a94a-4e78-bf00-bf901a5afc75 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:51.818851 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3aa96de0-a94a-4e78-bf00-bf901a5afc75 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:51.819491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3aa96de0-a94a-4e78-bf00-bf901a5afc75 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:51.820224 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3aa96de0-a94a-4e78-bf00-bf901a5afc75 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:51.820920 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3aa96de0-a94a-4e78-bf00-bf901a5afc75 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:51.821363 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3aa96de0-a94a-4e78-bf00-bf901a5afc75 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:51.890720 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3aa96de0-a94a-4e78-bf00-bf901a5afc75 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:15:51.898966 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3aa96de0-a94a-4e78-bf00-bf901a5afc75 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1220 microversion: 2.1 time: 0.095226 Oct 29 04:15:51.899575 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3659/7544] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:15:51 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:15:52.924357 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-66a507fb-a6ef-476f-a6db-dfd856364538 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:15:52.925088 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-66a507fb-a6ef-476f-a6db-dfd856364538 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:15:52.932136 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66a507fb-a6ef-476f-a6db-dfd856364538 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:52.932656 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66a507fb-a6ef-476f-a6db-dfd856364538 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:52.933138 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66a507fb-a6ef-476f-a6db-dfd856364538 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:52.933835 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66a507fb-a6ef-476f-a6db-dfd856364538 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:52.934284 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66a507fb-a6ef-476f-a6db-dfd856364538 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:52.934713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-66a507fb-a6ef-476f-a6db-dfd856364538 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:52.999840 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-66a507fb-a6ef-476f-a6db-dfd856364538 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:15:53.008138 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-66a507fb-a6ef-476f-a6db-dfd856364538 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1220 microversion: 2.1 time: 0.089049 Oct 29 04:15:53.008750 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3886/7545] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:15:52 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:15:54.031521 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d29f28cc-7e20-48c3-8ddd-73491baae226 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:15:54.032130 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-d29f28cc-7e20-48c3-8ddd-73491baae226 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:15:54.040599 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d29f28cc-7e20-48c3-8ddd-73491baae226 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:54.041101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d29f28cc-7e20-48c3-8ddd-73491baae226 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:54.041542 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d29f28cc-7e20-48c3-8ddd-73491baae226 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:54.042247 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d29f28cc-7e20-48c3-8ddd-73491baae226 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:54.042709 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d29f28cc-7e20-48c3-8ddd-73491baae226 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:54.043138 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-d29f28cc-7e20-48c3-8ddd-73491baae226 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:54.116202 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-d29f28cc-7e20-48c3-8ddd-73491baae226 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:15:54.124780 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d29f28cc-7e20-48c3-8ddd-73491baae226 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1220 microversion: 2.1 time: 0.097243 Oct 29 04:15:54.125354 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3660/7546] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:15:54 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:15:55.150591 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7ce8e8dc-e272-4698-8a4c-e2fe1c8dcf84 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:15:55.151174 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7ce8e8dc-e272-4698-8a4c-e2fe1c8dcf84 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:15:55.158781 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ce8e8dc-e272-4698-8a4c-e2fe1c8dcf84 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:55.159269 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ce8e8dc-e272-4698-8a4c-e2fe1c8dcf84 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:55.159700 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ce8e8dc-e272-4698-8a4c-e2fe1c8dcf84 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:55.160414 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ce8e8dc-e272-4698-8a4c-e2fe1c8dcf84 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:55.160886 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ce8e8dc-e272-4698-8a4c-e2fe1c8dcf84 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:55.161388 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7ce8e8dc-e272-4698-8a4c-e2fe1c8dcf84 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:55.226777 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7ce8e8dc-e272-4698-8a4c-e2fe1c8dcf84 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f8cb5d4d2434b4f8525404cc7dae04f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a5c84478c2481abf7a96ae93ac7b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:15:55.235382 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7ce8e8dc-e272-4698-8a4c-e2fe1c8dcf84 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 200 len: 1220 microversion: 2.1 time: 0.088575 Oct 29 04:15:55.235941 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3887/7547] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:15:55 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:15:56.259741 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-620fe027-60c9-437b-ba67-e9d1cb15c065 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:15:56.260318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-620fe027-60c9-437b-ba67-e9d1cb15c065 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] [instance: 662038ab-8bfa-49e3-9e21-cdb1a2236c88] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:15:56.268192 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-620fe027-60c9-437b-ba67-e9d1cb15c065 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:56.268778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-620fe027-60c9-437b-ba67-e9d1cb15c065 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:56.269206 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-620fe027-60c9-437b-ba67-e9d1cb15c065 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:56.269953 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-620fe027-60c9-437b-ba67-e9d1cb15c065 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:15:56.270460 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-620fe027-60c9-437b-ba67-e9d1cb15c065 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:15:56.270884 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-620fe027-60c9-437b-ba67-e9d1cb15c065 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:15:56.287758 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.wsgi [None req-620fe027-60c9-437b-ba67-e9d1cb15c065 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] HTTP exception thrown: Instance 662038ab-8bfa-49e3-9e21-cdb1a2236c88 could not be found. Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-620fe027-60c9-437b-ba67-e9d1cb15c065 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Request method failure captured: Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: request: GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 HTTP/1.1 Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: Accept: application/json Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: Accept-Encoding: identity Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: Connection: close Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: Content-Length: 0 Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: Content-Type: application/json Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: Host: 10.222.0.46 Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: Openstack-System-Scope: None Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: User-Agent: python-urllib3/1.26.12 Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: X-Auth-Token: gAAAAABjXKb3spua6Zl3pzivcNm2X67kROSna5XQJ3GRzMgkAOd-uIM9E9oVmSMXgizpz8hGuW-w_EsC1iwPvCeCyuqlojUIAWQXrM36bpZrjhN5ECkES_5-iZEWweQRpJaGCs28pa9yEhKy0btoFRQVt2zeT9O8lPP2szEuTLaagFA-LWojew8 Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Id: None Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: X-Domain-Name: None Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: X-Identity-Status: Confirmed Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: X-Is-Admin-Project: True Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Id: default Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Domain-Name: Default Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Id: c3a5c84478c2481abf7a96ae93ac7b33 Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: X-Project-Name: tempest-TestShelveInstance-785700432 Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: X-Role: reader,member Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: X-Roles: reader,member Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c3a5c84478c2481abf7a96ae93ac7b33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c3a5c84478c2481abf7a96ae93ac7b33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c3a5c84478c2481abf7a96ae93ac7b33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c3a5c84478c2481abf7a96ae93ac7b33"}]}] Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant: tempest-TestShelveInstance-785700432 Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Id: c3a5c84478c2481abf7a96ae93ac7b33 Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: X-Tenant-Name: tempest-TestShelveInstance-785700432 Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: X-User: tempest-TestShelveInstance-785700432-project Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Id: default Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: X-User-Domain-Name: Default Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: X-User-Id: 0f8cb5d4d2434b4f8525404cc7dae04f Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: X-User-Name: tempest-TestShelveInstance-785700432-project Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: method: > Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: exception: Instance 662038ab-8bfa-49e3-9e21-cdb1a2236c88 could not be found. Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: action_args: {'id': '662038ab-8bfa-49e3-9e21-cdb1a2236c88'} Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 662038ab-8bfa-49e3-9e21-cdb1a2236c88 could not be found. Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 662038ab-8bfa-49e3-9e21-cdb1a2236c88 could not be found. Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:15:56.289665 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 04:15:56.294863 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:15:56.294863 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:15:56.294863 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:15:56.294863 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 04:15:56.294863 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 04:15:56.294863 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 662038ab-8bfa-49e3-9e21-cdb1a2236c88 could not be found. Oct 29 04:15:56.294863 n-d-862967-2 devstack@n-api.service[127125]: ERROR nova.api.openstack.wsgi Oct 29 04:15:56.294863 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-620fe027-60c9-437b-ba67-e9d1cb15c065 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Returning 404 to user: Instance 662038ab-8bfa-49e3-9e21-cdb1a2236c88 could not be found. {{(pid=127125) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 04:15:56.294863 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-620fe027-60c9-437b-ba67-e9d1cb15c065 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88" status: 404 len: 111 microversion: 2.1 time: 0.035873 Oct 29 04:15:56.295678 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3661/7548] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:15:56 2022] GET /compute/v2.1/servers/662038ab-8bfa-49e3-9e21-cdb1a2236c88 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 04:15:56.477181 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-24194f52-8124-4feb-a38c-6f1617cb60b8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] Calling method '.version_select at 0x7ff052a29040>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:15:56.506354 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-24194f52-8124-4feb-a38c-6f1617cb60b8 tempest-TestShelveInstance-785700432 tempest-TestShelveInstance-785700432-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1890995705" status: 202 len: 0 microversion: 2.1 time: 0.033368 Oct 29 04:15:56.507135 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3888/7549] 10.222.0.46 () {58 vars in 1254 bytes} [Sat Oct 29 04:15:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1890995705 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 04:16:14.519343 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:16:14.521052 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:16:14.758995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-d4fd9c81-6951-4078-a9d6-ee51db756dfa tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Action: 'create', calling method: .version_select at 0x7ff052bc9670>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-648059116", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzvIsHHb7Hf/eFb8CC5Z+TxkaJSCUZI8F14tjJyWKB426dQZT8R0I61bfFjSbYWtRbPGFy7oYkwdDENFLGUx2kSc12X+kgBCPkKuGN95PrvToc+QlOLtlDZZJ3agl4diA=="}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:16:14.775614 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-d4fd9c81-6951-4078-a9d6-ee51db756dfa tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Getting quotas for project cae48898f922487a9f15a51ab991bc7b. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:16:14.781733 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-d4fd9c81-6951-4078-a9d6-ee51db756dfa tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Getting quotas for user 6608bdbfb8db45949ddd9872c03295f9 and project cae48898f922487a9f15a51ab991bc7b. Resources: {'key_pairs'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:16:14.812999 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-d4fd9c81-6951-4078-a9d6-ee51db756dfa tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.299164 Oct 29 04:16:14.813536 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3662/7550] 10.222.0.46 () {60 vars in 1159 bytes} [Sat Oct 29 04:16:14 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:16:15.856133 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=22 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:16:15.857018 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:16:15.862897 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-563bfa37-377b-4e96-94ea-87f587cbe872 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-2140378034", "imageRef": "cd315600-df67-41c1-95d3-95a5145fc39a", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-648059116", "security_groups": [{"name": "tempest-secgroup-smoke-1790263780"}], "networks": [{"uuid": "e69a7153-06cb-4180-b3e5-6c804ba5adf3"}]}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:16:15.979497 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.network.neutron [None req-563bfa37-377b-4e96-94ea-87f587cbe872 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] validate_networks() for [('e69a7153-06cb-4180-b3e5-6c804ba5adf3', None, None, None, None, None)] {{(pid=127124) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 04:16:16.469556 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-563bfa37-377b-4e96-94ea-87f587cbe872 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Flavor limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 04:16:16.470114 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-563bfa37-377b-4e96-94ea-87f587cbe872 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Image limits 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 04:16:16.470692 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-563bfa37-377b-4e96-94ea-87f587cbe872 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Flavor pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 04:16:16.471187 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-563bfa37-377b-4e96-94ea-87f587cbe872 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Image pref 0:0:0 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 04:16:16.472113 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.virt.hardware [None req-563bfa37-377b-4e96-94ea-87f587cbe872 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127124) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 04:16:16.483722 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-563bfa37-377b-4e96-94ea-87f587cbe872 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:16:16.484313 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-563bfa37-377b-4e96-94ea-87f587cbe872 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:16:16.485168 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-563bfa37-377b-4e96-94ea-87f587cbe872 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:16:16.485947 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-563bfa37-377b-4e96-94ea-87f587cbe872 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:16:16.486402 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-563bfa37-377b-4e96-94ea-87f587cbe872 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:16:16.486830 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-563bfa37-377b-4e96-94ea-87f587cbe872 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:16:16.508905 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-563bfa37-377b-4e96-94ea-87f587cbe872 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Getting quotas for project cae48898f922487a9f15a51ab991bc7b. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:16:16.514192 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.quota [None req-563bfa37-377b-4e96-94ea-87f587cbe872 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Getting quotas for user 6608bdbfb8db45949ddd9872c03295f9 and project cae48898f922487a9f15a51ab991bc7b. Resources: {'cores', 'ram', 'instances'} {{(pid=127124) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:16:16.526991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-563bfa37-377b-4e96-94ea-87f587cbe872 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Going to run 1 instances... {{(pid=127124) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 04:16:16.529560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-563bfa37-377b-4e96-94ea-87f587cbe872 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: d58c87d7-9a68-4768-9885-b085480b9230] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd315600-df67-41c1-95d3-95a5145fc39a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127124) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 04:16:16.578721 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-563bfa37-377b-4e96-94ea-87f587cbe872 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.724521 Oct 29 04:16:16.579602 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3889/7551] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 04:16:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 04:16:16.592594 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-dee3c735-b57d-4c67-ad22-8d2193fb9c1b tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:16:16.593943 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-dee3c735-b57d-4c67-ad22-8d2193fb9c1b tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: d58c87d7-9a68-4768-9885-b085480b9230] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:16:16.657776 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-dee3c735-b57d-4c67-ad22-8d2193fb9c1b tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:16:16.666280 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-dee3c735-b57d-4c67-ad22-8d2193fb9c1b tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230" status: 200 len: 1248 microversion: 2.1 time: 0.078748 Oct 29 04:16:16.667216 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3663/7552] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:16:16 2022] GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230 => generated 1248 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 04:16:17.697267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-583af783-d6b7-4576-9ff1-24e6a794d5af tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:16:17.697774 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-583af783-d6b7-4576-9ff1-24e6a794d5af tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: d58c87d7-9a68-4768-9885-b085480b9230] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:16:17.706075 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-583af783-d6b7-4576-9ff1-24e6a794d5af tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:16:17.706935 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-583af783-d6b7-4576-9ff1-24e6a794d5af tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:16:17.707702 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-583af783-d6b7-4576-9ff1-24e6a794d5af tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:16:17.708495 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-583af783-d6b7-4576-9ff1-24e6a794d5af tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:16:17.709360 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-583af783-d6b7-4576-9ff1-24e6a794d5af tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:16:17.710046 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-583af783-d6b7-4576-9ff1-24e6a794d5af tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:16:17.794479 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-583af783-d6b7-4576-9ff1-24e6a794d5af tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:16:17.803780 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-583af783-d6b7-4576-9ff1-24e6a794d5af tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230" status: 200 len: 1300 microversion: 2.1 time: 0.113313 Oct 29 04:16:17.804453 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3890/7553] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:16:17 2022] GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230 => generated 1300 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:16:18.827715 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-34f6c3aa-547e-492f-8848-f4052b0c5a61 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:16:18.829746 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-34f6c3aa-547e-492f-8848-f4052b0c5a61 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: d58c87d7-9a68-4768-9885-b085480b9230] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:16:18.841844 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34f6c3aa-547e-492f-8848-f4052b0c5a61 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:16:18.842721 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34f6c3aa-547e-492f-8848-f4052b0c5a61 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:16:18.843732 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34f6c3aa-547e-492f-8848-f4052b0c5a61 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:16:18.844827 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34f6c3aa-547e-492f-8848-f4052b0c5a61 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:16:18.845433 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34f6c3aa-547e-492f-8848-f4052b0c5a61 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:16:18.848036 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-34f6c3aa-547e-492f-8848-f4052b0c5a61 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:16:19.046791 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-34f6c3aa-547e-492f-8848-f4052b0c5a61 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:16:19.055609 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-34f6c3aa-547e-492f-8848-f4052b0c5a61 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230" status: 200 len: 1374 microversion: 2.1 time: 0.232246 Oct 29 04:16:19.056547 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3664/7554] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:16:18 2022] GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230 => generated 1374 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:16:19.378531 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-f5177a2a-faba-4282-b918-d0b4caba46e3 req-f39329c6-4d88-4190-8d53-e4e6ef8b028a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d58c87d7-9a68-4768-9885-b085480b9230", "tag": "123de2cf-d4bf-4ac5-921c-f224fa099bfe"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:16:19.392578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f5177a2a-faba-4282-b918-d0b4caba46e3 req-f39329c6-4d88-4190-8d53-e4e6ef8b028a service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:16:19.393071 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f5177a2a-faba-4282-b918-d0b4caba46e3 req-f39329c6-4d88-4190-8d53-e4e6ef8b028a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:16:19.393982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-f5177a2a-faba-4282-b918-d0b4caba46e3 req-f39329c6-4d88-4190-8d53-e4e6ef8b028a service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:16:19.407232 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-f5177a2a-faba-4282-b918-d0b4caba46e3 req-f39329c6-4d88-4190-8d53-e4e6ef8b028a service nova] Creating event network-changed:123de2cf-d4bf-4ac5-921c-f224fa099bfe for instance d58c87d7-9a68-4768-9885-b085480b9230 on n-h2-862967-2 Oct 29 04:16:19.412547 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-f5177a2a-faba-4282-b918-d0b4caba46e3 req-f39329c6-4d88-4190-8d53-e4e6ef8b028a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037916 Oct 29 04:16:19.413550 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3891/7555] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:16:20.081209 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3ea56fc2-3af1-42b1-b656-6a8c25b7f072 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:16:20.081897 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3ea56fc2-3af1-42b1-b656-6a8c25b7f072 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: d58c87d7-9a68-4768-9885-b085480b9230] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:16:20.089152 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ea56fc2-3af1-42b1-b656-6a8c25b7f072 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:16:20.089735 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ea56fc2-3af1-42b1-b656-6a8c25b7f072 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:16:20.090243 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ea56fc2-3af1-42b1-b656-6a8c25b7f072 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:16:20.091148 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ea56fc2-3af1-42b1-b656-6a8c25b7f072 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:16:20.091711 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ea56fc2-3af1-42b1-b656-6a8c25b7f072 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:16:20.092210 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3ea56fc2-3af1-42b1-b656-6a8c25b7f072 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:16:20.230095 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3ea56fc2-3af1-42b1-b656-6a8c25b7f072 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:16:20.238707 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3ea56fc2-3af1-42b1-b656-6a8c25b7f072 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230" status: 200 len: 1374 microversion: 2.1 time: 0.161779 Oct 29 04:16:20.239381 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3665/7556] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:16:20 2022] GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:16:21.263205 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-45a2c856-9a04-46f3-b636-e3d98e8fbbae tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:16:21.263908 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-45a2c856-9a04-46f3-b636-e3d98e8fbbae tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: d58c87d7-9a68-4768-9885-b085480b9230] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:16:21.271536 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45a2c856-9a04-46f3-b636-e3d98e8fbbae tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:16:21.272020 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45a2c856-9a04-46f3-b636-e3d98e8fbbae tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:16:21.272450 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45a2c856-9a04-46f3-b636-e3d98e8fbbae tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:16:21.273281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45a2c856-9a04-46f3-b636-e3d98e8fbbae tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:16:21.273729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45a2c856-9a04-46f3-b636-e3d98e8fbbae tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:16:21.274151 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-45a2c856-9a04-46f3-b636-e3d98e8fbbae tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:16:21.415810 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-45a2c856-9a04-46f3-b636-e3d98e8fbbae tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:16:21.423832 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-45a2c856-9a04-46f3-b636-e3d98e8fbbae tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230" status: 200 len: 1374 microversion: 2.1 time: 0.165100 Oct 29 04:16:21.424409 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3892/7557] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:16:21 2022] GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230 => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:16:22.448195 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1d660724-5663-4136-a62c-aa921bde38f0 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:16:22.448853 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1d660724-5663-4136-a62c-aa921bde38f0 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: d58c87d7-9a68-4768-9885-b085480b9230] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:16:22.456199 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d660724-5663-4136-a62c-aa921bde38f0 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:16:22.456729 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d660724-5663-4136-a62c-aa921bde38f0 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:16:22.457183 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d660724-5663-4136-a62c-aa921bde38f0 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:16:22.457891 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d660724-5663-4136-a62c-aa921bde38f0 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:16:22.458364 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d660724-5663-4136-a62c-aa921bde38f0 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:16:22.458799 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1d660724-5663-4136-a62c-aa921bde38f0 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:16:22.604104 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1d660724-5663-4136-a62c-aa921bde38f0 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:16:22.616679 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1d660724-5663-4136-a62c-aa921bde38f0 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230" status: 200 len: 1374 microversion: 2.1 time: 0.172608 Oct 29 04:16:22.617512 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3666/7558] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:16:22 2022] GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230 => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:16:23.644986 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-313a75ae-a67e-486e-91f6-01e40446fff2 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:16:23.645560 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-313a75ae-a67e-486e-91f6-01e40446fff2 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: d58c87d7-9a68-4768-9885-b085480b9230] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:16:23.653017 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-313a75ae-a67e-486e-91f6-01e40446fff2 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:16:23.653605 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-313a75ae-a67e-486e-91f6-01e40446fff2 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:16:23.654049 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-313a75ae-a67e-486e-91f6-01e40446fff2 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:16:23.654770 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-313a75ae-a67e-486e-91f6-01e40446fff2 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:16:23.655228 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-313a75ae-a67e-486e-91f6-01e40446fff2 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:16:23.655660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-313a75ae-a67e-486e-91f6-01e40446fff2 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:16:23.798726 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-313a75ae-a67e-486e-91f6-01e40446fff2 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:16:23.806885 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-313a75ae-a67e-486e-91f6-01e40446fff2 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230" status: 200 len: 1374 microversion: 2.1 time: 0.166195 Oct 29 04:16:23.807696 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3893/7559] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:16:23 2022] GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230 => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:16:24.831117 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-668ae4b9-74ed-473a-9c9a-b176dd639da9 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:16:24.831819 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-668ae4b9-74ed-473a-9c9a-b176dd639da9 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: d58c87d7-9a68-4768-9885-b085480b9230] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:16:24.839231 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-668ae4b9-74ed-473a-9c9a-b176dd639da9 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:16:24.839725 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-668ae4b9-74ed-473a-9c9a-b176dd639da9 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:16:24.840164 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-668ae4b9-74ed-473a-9c9a-b176dd639da9 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:16:24.841188 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-668ae4b9-74ed-473a-9c9a-b176dd639da9 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:16:24.841410 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-668ae4b9-74ed-473a-9c9a-b176dd639da9 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:16:24.841850 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-668ae4b9-74ed-473a-9c9a-b176dd639da9 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:16:24.982587 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-668ae4b9-74ed-473a-9c9a-b176dd639da9 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:16:24.991025 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-668ae4b9-74ed-473a-9c9a-b176dd639da9 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230" status: 200 len: 1374 microversion: 2.1 time: 0.164511 Oct 29 04:16:24.991611 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3667/7560] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:16:24 2022] GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230 => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:16:25.448922 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-cf43879d-d5ce-454d-a7ce-b81575932138 req-cb5fee41-c21c-4942-b462-e498f4a75e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d58c87d7-9a68-4768-9885-b085480b9230", "name": "network-vif-plugged", "status": "completed", "tag": "123de2cf-d4bf-4ac5-921c-f224fa099bfe"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:16:25.458743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-cf43879d-d5ce-454d-a7ce-b81575932138 req-cb5fee41-c21c-4942-b462-e498f4a75e47 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:16:25.459218 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-cf43879d-d5ce-454d-a7ce-b81575932138 req-cb5fee41-c21c-4942-b462-e498f4a75e47 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:16:25.459647 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-cf43879d-d5ce-454d-a7ce-b81575932138 req-cb5fee41-c21c-4942-b462-e498f4a75e47 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:16:25.470568 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-cf43879d-d5ce-454d-a7ce-b81575932138 req-cb5fee41-c21c-4942-b462-e498f4a75e47 service nova] Creating event network-vif-plugged:123de2cf-d4bf-4ac5-921c-f224fa099bfe for instance d58c87d7-9a68-4768-9885-b085480b9230 on n-h2-862967-2 Oct 29 04:16:25.477188 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-cf43879d-d5ce-454d-a7ce-b81575932138 req-cb5fee41-c21c-4942-b462-e498f4a75e47 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094885 Oct 29 04:16:25.478118 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3894/7561] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:16:26.019459 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-b38e93fb-65a4-4887-896a-eb2113a3f5c4 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:16:26.020278 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-b38e93fb-65a4-4887-896a-eb2113a3f5c4 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: d58c87d7-9a68-4768-9885-b085480b9230] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:16:26.030255 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b38e93fb-65a4-4887-896a-eb2113a3f5c4 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:16:26.030816 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b38e93fb-65a4-4887-896a-eb2113a3f5c4 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:16:26.031270 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b38e93fb-65a4-4887-896a-eb2113a3f5c4 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:16:26.032017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b38e93fb-65a4-4887-896a-eb2113a3f5c4 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:16:26.032488 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b38e93fb-65a4-4887-896a-eb2113a3f5c4 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:16:26.032964 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-b38e93fb-65a4-4887-896a-eb2113a3f5c4 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:16:26.197091 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-b38e93fb-65a4-4887-896a-eb2113a3f5c4 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:16:26.205212 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-b38e93fb-65a4-4887-896a-eb2113a3f5c4 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230" status: 200 len: 1374 microversion: 2.1 time: 0.192376 Oct 29 04:16:26.205805 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3668/7562] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:16:26 2022] GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230 => generated 1374 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:16:27.228352 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-634cf15c-e263-46c3-b3db-b3729e8c08c2 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:16:27.229055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-634cf15c-e263-46c3-b3db-b3729e8c08c2 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: d58c87d7-9a68-4768-9885-b085480b9230] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:16:27.232008 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:16:27.232721 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=6 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:16:27.239546 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-634cf15c-e263-46c3-b3db-b3729e8c08c2 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:16:27.240041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-634cf15c-e263-46c3-b3db-b3729e8c08c2 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:16:27.240477 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-634cf15c-e263-46c3-b3db-b3729e8c08c2 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:16:27.241198 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-634cf15c-e263-46c3-b3db-b3729e8c08c2 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:16:27.241650 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-634cf15c-e263-46c3-b3db-b3729e8c08c2 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:16:27.242070 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-634cf15c-e263-46c3-b3db-b3729e8c08c2 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:16:27.401580 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-634cf15c-e263-46c3-b3db-b3729e8c08c2 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:16:27.409708 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-634cf15c-e263-46c3-b3db-b3729e8c08c2 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230" status: 200 len: 1559 microversion: 2.1 time: 0.185735 Oct 29 04:16:27.410348 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3895/7563] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:16:27 2022] GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:16:27.432003 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-20db67ae-71cc-435c-993c-fc877020724e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:16:27.432728 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-20db67ae-71cc-435c-993c-fc877020724e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: d58c87d7-9a68-4768-9885-b085480b9230] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:16:27.434594 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:16:27.441205 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20db67ae-71cc-435c-993c-fc877020724e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:16:27.441705 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20db67ae-71cc-435c-993c-fc877020724e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:16:27.442133 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20db67ae-71cc-435c-993c-fc877020724e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:16:27.443209 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20db67ae-71cc-435c-993c-fc877020724e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:16:27.443671 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20db67ae-71cc-435c-993c-fc877020724e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:16:27.444105 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-20db67ae-71cc-435c-993c-fc877020724e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:16:27.601873 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-20db67ae-71cc-435c-993c-fc877020724e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:16:27.610530 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-20db67ae-71cc-435c-993c-fc877020724e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230" status: 200 len: 1559 microversion: 2.1 time: 0.182647 Oct 29 04:16:27.611140 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3669/7564] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:16:27 2022] GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 04:16:29.638383 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-5526b4d2-57d3-4603-81f3-d86a9b9ede4d req-0bab1c42-8050-405f-8285-4fc9757bd208 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d58c87d7-9a68-4768-9885-b085480b9230", "tag": "123de2cf-d4bf-4ac5-921c-f224fa099bfe"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:16:29.648838 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5526b4d2-57d3-4603-81f3-d86a9b9ede4d req-0bab1c42-8050-405f-8285-4fc9757bd208 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:16:29.649327 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5526b4d2-57d3-4603-81f3-d86a9b9ede4d req-0bab1c42-8050-405f-8285-4fc9757bd208 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:16:29.649751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-5526b4d2-57d3-4603-81f3-d86a9b9ede4d req-0bab1c42-8050-405f-8285-4fc9757bd208 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:16:29.661292 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-5526b4d2-57d3-4603-81f3-d86a9b9ede4d req-0bab1c42-8050-405f-8285-4fc9757bd208 service nova] Creating event network-changed:123de2cf-d4bf-4ac5-921c-f224fa099bfe for instance d58c87d7-9a68-4768-9885-b085480b9230 on n-h2-862967-2 Oct 29 04:16:29.666444 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-5526b4d2-57d3-4603-81f3-d86a9b9ede4d req-0bab1c42-8050-405f-8285-4fc9757bd208 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031926 Oct 29 04:16:29.667050 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3896/7565] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:18:24.192153 n-d-862967-2 devstack@n-api.service[127125]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7606be4b-8fa9-49e5-a603-02528cbf3013] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 04:18:24.193288 n-d-862967-2 devstack@n-api.service[127125]: ERROR oslo.messaging._drivers.impl_rabbit [-] [db70aafa-b304-4ac0-be4f-1798e9789b82] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 04:18:24.194383 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:18:24.195282 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=36 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:18:24.201971 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-2c7f38e8-d51a-41f2-b82d-e58995ff1fa1 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1730852832"}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:18:24.205028 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-2c7f38e8-d51a-41f2-b82d-e58995ff1fa1 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: d58c87d7-9a68-4768-9885-b085480b9230] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:18:24.215341 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2c7f38e8-d51a-41f2-b82d-e58995ff1fa1 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:24.215830 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2c7f38e8-d51a-41f2-b82d-e58995ff1fa1 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:24.216264 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2c7f38e8-d51a-41f2-b82d-e58995ff1fa1 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:24.216987 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2c7f38e8-d51a-41f2-b82d-e58995ff1fa1 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:24.217443 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2c7f38e8-d51a-41f2-b82d-e58995ff1fa1 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:24.217872 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-2c7f38e8-d51a-41f2-b82d-e58995ff1fa1 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:24.431299 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-2c7f38e8-d51a-41f2-b82d-e58995ff1fa1 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "POST /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230/action" status: 202 len: 0 microversion: 2.1 time: 0.241527 Oct 29 04:18:24.432221 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3670/7566] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 04:18:24 2022] POST /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 04:18:30.071853 n-d-862967-2 devstack@n-api.service[127124]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a4c67498-176b-466c-9f6d-56e0bcdaf058] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 04:18:30.073996 n-d-862967-2 devstack@n-api.service[127124]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2206413f-602f-4f31-86b1-4a062554af7b] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 29 04:18:30.074855 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:18:30.079271 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=32 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:18:30.089827 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-36a4d2a3-71b0-4b9a-8876-a76bc4769ae9 req-ee76b04c-4bca-4b96-99f7-e1c58ccce744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d58c87d7-9a68-4768-9885-b085480b9230", "name": "network-vif-plugged", "status": "completed", "tag": "123de2cf-d4bf-4ac5-921c-f224fa099bfe"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:18:30.110599 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-36a4d2a3-71b0-4b9a-8876-a76bc4769ae9 req-ee76b04c-4bca-4b96-99f7-e1c58ccce744 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:30.111530 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-36a4d2a3-71b0-4b9a-8876-a76bc4769ae9 req-ee76b04c-4bca-4b96-99f7-e1c58ccce744 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:30.112140 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-36a4d2a3-71b0-4b9a-8876-a76bc4769ae9 req-ee76b04c-4bca-4b96-99f7-e1c58ccce744 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:30.125178 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-36a4d2a3-71b0-4b9a-8876-a76bc4769ae9 req-ee76b04c-4bca-4b96-99f7-e1c58ccce744 service nova] Creating event network-vif-plugged:123de2cf-d4bf-4ac5-921c-f224fa099bfe for instance d58c87d7-9a68-4768-9885-b085480b9230 on n-h2-862967-2 Oct 29 04:18:30.133071 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-36a4d2a3-71b0-4b9a-8876-a76bc4769ae9 req-ee76b04c-4bca-4b96-99f7-e1c58ccce744 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063408 Oct 29 04:18:30.134564 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3897/7567] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:18:38.015377 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:18:38.016175 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:18:38.021533 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-c6bcc7dc-19ce-4eaf-b679-7ad4449eb7aa tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1644649328", "imageRef": "e818f975-80aa-4c8f-830c-3227319fa380", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-648059116", "security_groups": [{"name": "tempest-secgroup-smoke-1790263780"}], "networks": [{"uuid": "e69a7153-06cb-4180-b3e5-6c804ba5adf3"}]}} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:18:38.047060 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] [db70aafa-b304-4ac0-be4f-1798e9789b82] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 42432. Oct 29 04:18:38.047847 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] [7606be4b-8fa9-49e5-a603-02528cbf3013] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 42430. Oct 29 04:18:38.142368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.network.neutron [None req-c6bcc7dc-19ce-4eaf-b679-7ad4449eb7aa tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] validate_networks() for [('e69a7153-06cb-4180-b3e5-6c804ba5adf3', None, None, None, None, None)] {{(pid=127125) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 29 04:18:38.931331 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-c6bcc7dc-19ce-4eaf-b679-7ad4449eb7aa tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Flavor limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 04:18:38.931767 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-c6bcc7dc-19ce-4eaf-b679-7ad4449eb7aa tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Image limits 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 04:18:38.932254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-c6bcc7dc-19ce-4eaf-b679-7ad4449eb7aa tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Flavor pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 04:18:38.932693 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-c6bcc7dc-19ce-4eaf-b679-7ad4449eb7aa tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Image pref 0:0:0 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 04:18:38.933122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.virt.hardware [None req-c6bcc7dc-19ce-4eaf-b679-7ad4449eb7aa tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127125) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 04:18:38.942863 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6bcc7dc-19ce-4eaf-b679-7ad4449eb7aa tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:38.943362 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6bcc7dc-19ce-4eaf-b679-7ad4449eb7aa tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:38.943811 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6bcc7dc-19ce-4eaf-b679-7ad4449eb7aa tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:38.944564 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6bcc7dc-19ce-4eaf-b679-7ad4449eb7aa tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:38.945026 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6bcc7dc-19ce-4eaf-b679-7ad4449eb7aa tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:38.945490 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-c6bcc7dc-19ce-4eaf-b679-7ad4449eb7aa tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:38.963595 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-c6bcc7dc-19ce-4eaf-b679-7ad4449eb7aa tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Getting quotas for project cae48898f922487a9f15a51ab991bc7b. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 29 04:18:38.969403 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.quota [None req-c6bcc7dc-19ce-4eaf-b679-7ad4449eb7aa tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Getting quotas for user 6608bdbfb8db45949ddd9872c03295f9 and project cae48898f922487a9f15a51ab991bc7b. Resources: {'cores', 'ram', 'instances'} {{(pid=127125) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 29 04:18:38.982566 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c6bcc7dc-19ce-4eaf-b679-7ad4449eb7aa tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Going to run 1 instances... {{(pid=127125) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 29 04:18:38.985520 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-c6bcc7dc-19ce-4eaf-b679-7ad4449eb7aa tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: a99d8141-6e22-4a07-9765-67d6588f51c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e818f975-80aa-4c8f-830c-3227319fa380',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127125) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 29 04:18:39.035444 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-c6bcc7dc-19ce-4eaf-b679-7ad4449eb7aa tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.022382 Oct 29 04:18:39.036158 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3671/7568] 10.222.0.46 () {60 vars in 1147 bytes} [Sat Oct 29 04:18:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 1024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 04:18:39.051991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f8b707b9-88a2-4ee4-9ab1-b97aed03c19b tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:18:39.052953 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f8b707b9-88a2-4ee4-9ab1-b97aed03c19b tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: a99d8141-6e22-4a07-9765-67d6588f51c6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:18:39.071276 n-d-862967-2 devstack@n-api.service[127124]: INFO oslo.messaging._drivers.impl_rabbit [-] [a4c67498-176b-466c-9f6d-56e0bcdaf058] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 42446. Oct 29 04:18:39.073481 n-d-862967-2 devstack@n-api.service[127124]: INFO oslo.messaging._drivers.impl_rabbit [-] [2206413f-602f-4f31-86b1-4a062554af7b] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 42448. Oct 29 04:18:39.121356 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f8b707b9-88a2-4ee4-9ab1-b97aed03c19b tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:18:39.128508 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f8b707b9-88a2-4ee4-9ab1-b97aed03c19b tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6" status: 200 len: 1248 microversion: 2.1 time: 0.084778 Oct 29 04:18:39.129115 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3898/7569] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:18:39 2022] GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6 => generated 1248 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:18:40.154521 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-89292ffa-0994-4208-9964-2cf465171735 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:18:40.155310 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-89292ffa-0994-4208-9964-2cf465171735 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: a99d8141-6e22-4a07-9765-67d6588f51c6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:18:40.163730 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89292ffa-0994-4208-9964-2cf465171735 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:40.164266 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89292ffa-0994-4208-9964-2cf465171735 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:40.165533 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89292ffa-0994-4208-9964-2cf465171735 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:40.166320 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89292ffa-0994-4208-9964-2cf465171735 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:40.166798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89292ffa-0994-4208-9964-2cf465171735 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:40.167238 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-89292ffa-0994-4208-9964-2cf465171735 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:40.239156 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-89292ffa-0994-4208-9964-2cf465171735 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:18:40.248179 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-89292ffa-0994-4208-9964-2cf465171735 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6" status: 200 len: 1300 microversion: 2.1 time: 0.099898 Oct 29 04:18:40.251454 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3672/7570] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:18:40 2022] GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6 => generated 1300 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:18:41.273760 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f919ad6c-ffa0-4afe-b4cb-2446704b6e3e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:18:41.275014 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f919ad6c-ffa0-4afe-b4cb-2446704b6e3e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: a99d8141-6e22-4a07-9765-67d6588f51c6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:18:41.280729 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:18:41.285713 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f919ad6c-ffa0-4afe-b4cb-2446704b6e3e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:41.286217 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f919ad6c-ffa0-4afe-b4cb-2446704b6e3e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:41.286654 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f919ad6c-ffa0-4afe-b4cb-2446704b6e3e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:41.287508 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f919ad6c-ffa0-4afe-b4cb-2446704b6e3e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:41.287964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f919ad6c-ffa0-4afe-b4cb-2446704b6e3e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:41.288417 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f919ad6c-ffa0-4afe-b4cb-2446704b6e3e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:41.437332 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f919ad6c-ffa0-4afe-b4cb-2446704b6e3e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:18:41.445911 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f919ad6c-ffa0-4afe-b4cb-2446704b6e3e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6" status: 200 len: 1374 microversion: 2.1 time: 0.176823 Oct 29 04:18:41.458092 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3899/7571] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:18:41 2022] GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6 => generated 1374 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:18:42.060836 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-c8ecad2d-a35c-449a-8ba1-7d702195f9b1 req-637ffa9d-3902-4fd9-95f6-758ebb0fb135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d58c87d7-9a68-4768-9885-b085480b9230", "name": "network-vif-unplugged", "status": "completed", "tag": "123de2cf-d4bf-4ac5-921c-f224fa099bfe"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:18:42.079452 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c8ecad2d-a35c-449a-8ba1-7d702195f9b1 req-637ffa9d-3902-4fd9-95f6-758ebb0fb135 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:42.080266 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c8ecad2d-a35c-449a-8ba1-7d702195f9b1 req-637ffa9d-3902-4fd9-95f6-758ebb0fb135 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:42.080945 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-c8ecad2d-a35c-449a-8ba1-7d702195f9b1 req-637ffa9d-3902-4fd9-95f6-758ebb0fb135 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:42.097199 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-c8ecad2d-a35c-449a-8ba1-7d702195f9b1 req-637ffa9d-3902-4fd9-95f6-758ebb0fb135 service nova] Creating event network-vif-unplugged:123de2cf-d4bf-4ac5-921c-f224fa099bfe for instance d58c87d7-9a68-4768-9885-b085480b9230 on n-h2-862967-2 Oct 29 04:18:42.104315 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-c8ecad2d-a35c-449a-8ba1-7d702195f9b1 req-637ffa9d-3902-4fd9-95f6-758ebb0fb135 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047426 Oct 29 04:18:42.105836 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3673/7572] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:18:42.474057 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-11c033b1-f983-4d6e-8b75-2b72260a538d tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:18:42.474696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-11c033b1-f983-4d6e-8b75-2b72260a538d tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: a99d8141-6e22-4a07-9765-67d6588f51c6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:18:42.483103 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11c033b1-f983-4d6e-8b75-2b72260a538d tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:42.483598 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11c033b1-f983-4d6e-8b75-2b72260a538d tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:42.484674 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11c033b1-f983-4d6e-8b75-2b72260a538d tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:42.485380 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11c033b1-f983-4d6e-8b75-2b72260a538d tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:42.486191 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11c033b1-f983-4d6e-8b75-2b72260a538d tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:42.486964 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-11c033b1-f983-4d6e-8b75-2b72260a538d tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:42.636708 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-11c033b1-f983-4d6e-8b75-2b72260a538d tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:18:42.646025 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-11c033b1-f983-4d6e-8b75-2b72260a538d tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6" status: 200 len: 1374 microversion: 2.1 time: 0.178118 Oct 29 04:18:42.646866 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3900/7573] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:18:42 2022] GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6 => generated 1374 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:18:43.670802 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-634b7232-1db3-460d-8595-cfc48d613e66 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:18:43.672340 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-634b7232-1db3-460d-8595-cfc48d613e66 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: a99d8141-6e22-4a07-9765-67d6588f51c6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:18:43.681444 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-634b7232-1db3-460d-8595-cfc48d613e66 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:43.682436 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-634b7232-1db3-460d-8595-cfc48d613e66 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:43.683101 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-634b7232-1db3-460d-8595-cfc48d613e66 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:43.684359 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-634b7232-1db3-460d-8595-cfc48d613e66 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:43.685154 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-634b7232-1db3-460d-8595-cfc48d613e66 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:43.685791 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-634b7232-1db3-460d-8595-cfc48d613e66 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:43.835009 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-634b7232-1db3-460d-8595-cfc48d613e66 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:18:43.850892 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-634b7232-1db3-460d-8595-cfc48d613e66 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6" status: 200 len: 1374 microversion: 2.1 time: 0.184186 Oct 29 04:18:43.852232 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3674/7574] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:18:43 2022] GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6 => generated 1374 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:18:44.876039 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-9f0e0c1a-4712-4a75-bd88-867ce4ae8aa6 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:18:44.876841 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-9f0e0c1a-4712-4a75-bd88-867ce4ae8aa6 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: a99d8141-6e22-4a07-9765-67d6588f51c6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:18:44.884578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f0e0c1a-4712-4a75-bd88-867ce4ae8aa6 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:44.885137 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f0e0c1a-4712-4a75-bd88-867ce4ae8aa6 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:44.885587 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f0e0c1a-4712-4a75-bd88-867ce4ae8aa6 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:44.886303 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f0e0c1a-4712-4a75-bd88-867ce4ae8aa6 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:44.886761 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f0e0c1a-4712-4a75-bd88-867ce4ae8aa6 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:44.887178 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-9f0e0c1a-4712-4a75-bd88-867ce4ae8aa6 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:45.050892 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-9f0e0c1a-4712-4a75-bd88-867ce4ae8aa6 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:18:45.068363 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-9f0e0c1a-4712-4a75-bd88-867ce4ae8aa6 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6" status: 200 len: 1374 microversion: 2.1 time: 0.196281 Oct 29 04:18:45.069181 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3901/7575] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:18:44 2022] GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6 => generated 1374 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:18:46.092430 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-09913815-6896-415f-9be2-a2139fe5eba4 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:18:46.093998 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-09913815-6896-415f-9be2-a2139fe5eba4 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: a99d8141-6e22-4a07-9765-67d6588f51c6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:18:46.103491 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09913815-6896-415f-9be2-a2139fe5eba4 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:46.104008 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09913815-6896-415f-9be2-a2139fe5eba4 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:46.104467 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09913815-6896-415f-9be2-a2139fe5eba4 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:46.105241 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09913815-6896-415f-9be2-a2139fe5eba4 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:46.105719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09913815-6896-415f-9be2-a2139fe5eba4 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:46.106163 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-09913815-6896-415f-9be2-a2139fe5eba4 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:46.262019 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-09913815-6896-415f-9be2-a2139fe5eba4 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:18:46.278692 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-09913815-6896-415f-9be2-a2139fe5eba4 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6" status: 200 len: 1374 microversion: 2.1 time: 0.190313 Oct 29 04:18:46.284743 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3675/7576] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:18:46 2022] GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6 => generated 1374 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:18:47.302311 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-c6fd38df-92ac-4984-84ae-cd34ee68ab01 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:18:47.302934 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-c6fd38df-92ac-4984-84ae-cd34ee68ab01 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: a99d8141-6e22-4a07-9765-67d6588f51c6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:18:47.311146 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6fd38df-92ac-4984-84ae-cd34ee68ab01 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:47.311635 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6fd38df-92ac-4984-84ae-cd34ee68ab01 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:47.312072 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6fd38df-92ac-4984-84ae-cd34ee68ab01 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:47.312960 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6fd38df-92ac-4984-84ae-cd34ee68ab01 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:47.313492 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6fd38df-92ac-4984-84ae-cd34ee68ab01 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:47.313873 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-c6fd38df-92ac-4984-84ae-cd34ee68ab01 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:47.467801 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-c6fd38df-92ac-4984-84ae-cd34ee68ab01 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:18:47.478754 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-c6fd38df-92ac-4984-84ae-cd34ee68ab01 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6" status: 200 len: 1374 microversion: 2.1 time: 0.180352 Oct 29 04:18:47.479438 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3902/7577] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:18:47 2022] GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6 => generated 1374 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:18:48.503941 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-031c3a5f-6de8-49f2-bd76-f8d74be04ab3 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:18:48.504731 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-031c3a5f-6de8-49f2-bd76-f8d74be04ab3 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: a99d8141-6e22-4a07-9765-67d6588f51c6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:18:48.511882 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-031c3a5f-6de8-49f2-bd76-f8d74be04ab3 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:48.512376 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-031c3a5f-6de8-49f2-bd76-f8d74be04ab3 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:48.512848 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-031c3a5f-6de8-49f2-bd76-f8d74be04ab3 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:48.513552 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-031c3a5f-6de8-49f2-bd76-f8d74be04ab3 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:48.514010 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-031c3a5f-6de8-49f2-bd76-f8d74be04ab3 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:48.514440 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-031c3a5f-6de8-49f2-bd76-f8d74be04ab3 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:48.661342 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-031c3a5f-6de8-49f2-bd76-f8d74be04ab3 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:18:48.669632 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-031c3a5f-6de8-49f2-bd76-f8d74be04ab3 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6" status: 200 len: 1374 microversion: 2.1 time: 0.169741 Oct 29 04:18:48.677223 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3676/7578] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:18:48 2022] GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6 => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:18:49.693472 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7e64da1e-c0b6-414b-a51a-f2e5c21e019c tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:18:49.694124 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7e64da1e-c0b6-414b-a51a-f2e5c21e019c tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: a99d8141-6e22-4a07-9765-67d6588f51c6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:18:49.696862 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell0:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:18:49.702578 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e64da1e-c0b6-414b-a51a-f2e5c21e019c tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:49.703094 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e64da1e-c0b6-414b-a51a-f2e5c21e019c tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:49.703529 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e64da1e-c0b6-414b-a51a-f2e5c21e019c tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:49.704263 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e64da1e-c0b6-414b-a51a-f2e5c21e019c tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:49.704744 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e64da1e-c0b6-414b-a51a-f2e5c21e019c tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:49.705171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7e64da1e-c0b6-414b-a51a-f2e5c21e019c tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:49.842171 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7e64da1e-c0b6-414b-a51a-f2e5c21e019c tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:18:49.850635 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7e64da1e-c0b6-414b-a51a-f2e5c21e019c tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6" status: 200 len: 1374 microversion: 2.1 time: 0.161222 Oct 29 04:18:49.851231 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3903/7579] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:18:49 2022] GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:18:50.124130 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-e2e3e56c-a854-4e58-a0ce-7c465ab92e02 req-86507eff-504f-45d0-ae06-eabd61319d75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a99d8141-6e22-4a07-9765-67d6588f51c6", "tag": "e0c2cbdf-b688-4d81-90bc-60f1d9820c8e"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:18:50.132808 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=2 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:18:50.133582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell0:SELECT=6 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:18:50.137144 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e2e3e56c-a854-4e58-a0ce-7c465ab92e02 req-86507eff-504f-45d0-ae06-eabd61319d75 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:50.137860 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e2e3e56c-a854-4e58-a0ce-7c465ab92e02 req-86507eff-504f-45d0-ae06-eabd61319d75 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:50.138270 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-e2e3e56c-a854-4e58-a0ce-7c465ab92e02 req-86507eff-504f-45d0-ae06-eabd61319d75 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:50.151169 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-e2e3e56c-a854-4e58-a0ce-7c465ab92e02 req-86507eff-504f-45d0-ae06-eabd61319d75 service nova] Creating event network-changed:e0c2cbdf-b688-4d81-90bc-60f1d9820c8e for instance a99d8141-6e22-4a07-9765-67d6588f51c6 on n-h1-862967-2 Oct 29 04:18:50.156383 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-e2e3e56c-a854-4e58-a0ce-7c465ab92e02 req-86507eff-504f-45d0-ae06-eabd61319d75 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041616 Oct 29 04:18:50.157035 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3677/7580] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:18:50.875254 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-f93c4183-93c0-43ce-abf6-b93afe507722 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:18:50.875848 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-f93c4183-93c0-43ce-abf6-b93afe507722 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: a99d8141-6e22-4a07-9765-67d6588f51c6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:18:50.883290 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f93c4183-93c0-43ce-abf6-b93afe507722 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:50.883779 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f93c4183-93c0-43ce-abf6-b93afe507722 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:50.884215 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f93c4183-93c0-43ce-abf6-b93afe507722 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:50.884956 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f93c4183-93c0-43ce-abf6-b93afe507722 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:50.885416 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f93c4183-93c0-43ce-abf6-b93afe507722 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:50.885846 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-f93c4183-93c0-43ce-abf6-b93afe507722 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:51.047471 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-f93c4183-93c0-43ce-abf6-b93afe507722 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:18:51.058545 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-f93c4183-93c0-43ce-abf6-b93afe507722 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6" status: 200 len: 1374 microversion: 2.1 time: 0.187274 Oct 29 04:18:51.059139 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3904/7581] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:18:50 2022] GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6 => generated 1374 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:18:52.083313 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-71276b5e-7b48-47e6-8fe0-954580fb0742 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:18:52.084023 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-71276b5e-7b48-47e6-8fe0-954580fb0742 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: a99d8141-6e22-4a07-9765-67d6588f51c6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:18:52.090931 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-71276b5e-7b48-47e6-8fe0-954580fb0742 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:52.091433 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-71276b5e-7b48-47e6-8fe0-954580fb0742 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:52.091889 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-71276b5e-7b48-47e6-8fe0-954580fb0742 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:52.092721 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-71276b5e-7b48-47e6-8fe0-954580fb0742 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:52.093189 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-71276b5e-7b48-47e6-8fe0-954580fb0742 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:52.093722 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-71276b5e-7b48-47e6-8fe0-954580fb0742 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:52.236435 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-71276b5e-7b48-47e6-8fe0-954580fb0742 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:18:52.244376 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-71276b5e-7b48-47e6-8fe0-954580fb0742 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6" status: 200 len: 1374 microversion: 2.1 time: 0.166425 Oct 29 04:18:52.244976 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3678/7582] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:18:52 2022] GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6 => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:18:53.271321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-0a2d65b2-1abe-4624-be8d-79855e702ddc tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:18:53.272189 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-0a2d65b2-1abe-4624-be8d-79855e702ddc tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: a99d8141-6e22-4a07-9765-67d6588f51c6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:18:53.280907 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0a2d65b2-1abe-4624-be8d-79855e702ddc tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:53.281390 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0a2d65b2-1abe-4624-be8d-79855e702ddc tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:53.282555 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0a2d65b2-1abe-4624-be8d-79855e702ddc tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:53.283236 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0a2d65b2-1abe-4624-be8d-79855e702ddc tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:53.283902 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0a2d65b2-1abe-4624-be8d-79855e702ddc tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:53.284324 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-0a2d65b2-1abe-4624-be8d-79855e702ddc tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:53.441505 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-0a2d65b2-1abe-4624-be8d-79855e702ddc tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:18:53.449446 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-0a2d65b2-1abe-4624-be8d-79855e702ddc tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6" status: 200 len: 1374 microversion: 2.1 time: 0.184973 Oct 29 04:18:53.450025 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3905/7583] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:18:53 2022] GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6 => generated 1374 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:18:54.473481 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-462b5187-1178-48b4-b44b-aa3a123da5a7 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:18:54.474662 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-462b5187-1178-48b4-b44b-aa3a123da5a7 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: a99d8141-6e22-4a07-9765-67d6588f51c6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:18:54.482701 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-462b5187-1178-48b4-b44b-aa3a123da5a7 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:54.483511 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-462b5187-1178-48b4-b44b-aa3a123da5a7 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:54.484709 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-462b5187-1178-48b4-b44b-aa3a123da5a7 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:54.485707 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-462b5187-1178-48b4-b44b-aa3a123da5a7 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:54.486196 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-462b5187-1178-48b4-b44b-aa3a123da5a7 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:54.486637 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-462b5187-1178-48b4-b44b-aa3a123da5a7 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:54.727650 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-462b5187-1178-48b4-b44b-aa3a123da5a7 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:18:54.737005 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-462b5187-1178-48b4-b44b-aa3a123da5a7 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6" status: 200 len: 1374 microversion: 2.1 time: 0.267651 Oct 29 04:18:54.737647 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3679/7584] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:18:54 2022] GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6 => generated 1374 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:18:55.764753 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-6d129718-b887-42b8-a479-a799fbeff8bf tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:18:55.765377 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-6d129718-b887-42b8-a479-a799fbeff8bf tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: a99d8141-6e22-4a07-9765-67d6588f51c6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:18:55.772756 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d129718-b887-42b8-a479-a799fbeff8bf tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:55.773242 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d129718-b887-42b8-a479-a799fbeff8bf tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:55.773681 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d129718-b887-42b8-a479-a799fbeff8bf tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:55.774375 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d129718-b887-42b8-a479-a799fbeff8bf tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:55.774853 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d129718-b887-42b8-a479-a799fbeff8bf tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:55.775281 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-6d129718-b887-42b8-a479-a799fbeff8bf tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:55.919062 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-6d129718-b887-42b8-a479-a799fbeff8bf tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:18:55.927405 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-6d129718-b887-42b8-a479-a799fbeff8bf tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6" status: 200 len: 1374 microversion: 2.1 time: 0.166774 Oct 29 04:18:55.927973 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3906/7585] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:18:55 2022] GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6 => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:18:56.118541 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-b83f9401-1b8a-4adc-94e6-21a6fb95e80f req-ce3a975f-7a1d-4ba2-a074-77d1f2da4acc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99d8141-6e22-4a07-9765-67d6588f51c6", "name": "network-vif-plugged", "status": "completed", "tag": "e0c2cbdf-b688-4d81-90bc-60f1d9820c8e"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:18:56.136158 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b83f9401-1b8a-4adc-94e6-21a6fb95e80f req-ce3a975f-7a1d-4ba2-a074-77d1f2da4acc service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:56.137057 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b83f9401-1b8a-4adc-94e6-21a6fb95e80f req-ce3a975f-7a1d-4ba2-a074-77d1f2da4acc service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:56.137690 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-b83f9401-1b8a-4adc-94e6-21a6fb95e80f req-ce3a975f-7a1d-4ba2-a074-77d1f2da4acc service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:56.149369 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-b83f9401-1b8a-4adc-94e6-21a6fb95e80f req-ce3a975f-7a1d-4ba2-a074-77d1f2da4acc service nova] Creating event network-vif-plugged:e0c2cbdf-b688-4d81-90bc-60f1d9820c8e for instance a99d8141-6e22-4a07-9765-67d6588f51c6 on n-h1-862967-2 Oct 29 04:18:56.154835 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-b83f9401-1b8a-4adc-94e6-21a6fb95e80f req-ce3a975f-7a1d-4ba2-a074-77d1f2da4acc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044615 Oct 29 04:18:56.155448 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3680/7586] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:18:56.956080 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7246fdb0-fb47-4e29-81f2-45855867bbbb tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:18:56.957101 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7246fdb0-fb47-4e29-81f2-45855867bbbb tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: a99d8141-6e22-4a07-9765-67d6588f51c6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:18:56.966752 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7246fdb0-fb47-4e29-81f2-45855867bbbb tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:56.967258 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7246fdb0-fb47-4e29-81f2-45855867bbbb tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:56.967696 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7246fdb0-fb47-4e29-81f2-45855867bbbb tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:56.968406 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7246fdb0-fb47-4e29-81f2-45855867bbbb tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:56.968906 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7246fdb0-fb47-4e29-81f2-45855867bbbb tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:56.969318 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7246fdb0-fb47-4e29-81f2-45855867bbbb tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:57.115872 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7246fdb0-fb47-4e29-81f2-45855867bbbb tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:18:57.125140 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7246fdb0-fb47-4e29-81f2-45855867bbbb tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6" status: 200 len: 1374 microversion: 2.1 time: 0.176151 Oct 29 04:18:57.125769 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3907/7587] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:18:56 2022] GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6 => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:18:58.150679 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f2a1f964-3cee-4dc1-85f0-0e09bbae60e0 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:18:58.151427 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f2a1f964-3cee-4dc1-85f0-0e09bbae60e0 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: a99d8141-6e22-4a07-9765-67d6588f51c6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:18:58.158228 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2a1f964-3cee-4dc1-85f0-0e09bbae60e0 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:58.158726 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2a1f964-3cee-4dc1-85f0-0e09bbae60e0 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:58.159168 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2a1f964-3cee-4dc1-85f0-0e09bbae60e0 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:58.159867 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2a1f964-3cee-4dc1-85f0-0e09bbae60e0 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:58.160326 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2a1f964-3cee-4dc1-85f0-0e09bbae60e0 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:58.160787 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f2a1f964-3cee-4dc1-85f0-0e09bbae60e0 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:58.308210 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f2a1f964-3cee-4dc1-85f0-0e09bbae60e0 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:18:58.320187 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f2a1f964-3cee-4dc1-85f0-0e09bbae60e0 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6" status: 200 len: 1558 microversion: 2.1 time: 0.174387 Oct 29 04:18:58.321068 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3681/7588] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:18:58 2022] GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:18:58.346664 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7f6a4e67-1853-496c-80b1-19495d9a60bd tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:18:58.347589 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7f6a4e67-1853-496c-80b1-19495d9a60bd tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: a99d8141-6e22-4a07-9765-67d6588f51c6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:18:58.358982 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f6a4e67-1853-496c-80b1-19495d9a60bd tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:58.360154 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f6a4e67-1853-496c-80b1-19495d9a60bd tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:58.360909 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f6a4e67-1853-496c-80b1-19495d9a60bd tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:58.362064 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f6a4e67-1853-496c-80b1-19495d9a60bd tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:18:58.362821 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f6a4e67-1853-496c-80b1-19495d9a60bd tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:18:58.363504 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7f6a4e67-1853-496c-80b1-19495d9a60bd tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:18:58.509355 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-7f6a4e67-1853-496c-80b1-19495d9a60bd tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:18:58.517884 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7f6a4e67-1853-496c-80b1-19495d9a60bd tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6" status: 200 len: 1558 microversion: 2.1 time: 0.178064 Oct 29 04:18:58.518473 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3908/7589] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:18:58 2022] GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6 => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:19:00.168603 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-1205f1ee-b0ad-41a5-bde8-2cf48a2f5a38 req-7cb34ab7-b023-405f-8481-83cf2a8a18ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a99d8141-6e22-4a07-9765-67d6588f51c6", "tag": "e0c2cbdf-b688-4d81-90bc-60f1d9820c8e"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:19:00.178798 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-1205f1ee-b0ad-41a5-bde8-2cf48a2f5a38 req-7cb34ab7-b023-405f-8481-83cf2a8a18ad service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:19:00.179281 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-1205f1ee-b0ad-41a5-bde8-2cf48a2f5a38 req-7cb34ab7-b023-405f-8481-83cf2a8a18ad service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:19:00.179719 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-1205f1ee-b0ad-41a5-bde8-2cf48a2f5a38 req-7cb34ab7-b023-405f-8481-83cf2a8a18ad service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:19:00.190820 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-1205f1ee-b0ad-41a5-bde8-2cf48a2f5a38 req-7cb34ab7-b023-405f-8481-83cf2a8a18ad service nova] Creating event network-changed:e0c2cbdf-b688-4d81-90bc-60f1d9820c8e for instance a99d8141-6e22-4a07-9765-67d6588f51c6 on n-h1-862967-2 Oct 29 04:19:00.196134 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-1205f1ee-b0ad-41a5-bde8-2cf48a2f5a38 req-7cb34ab7-b023-405f-8481-83cf2a8a18ad service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031296 Oct 29 04:19:00.196791 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3682/7590] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:20:27.389798 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=26 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:20:27.390675 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=60 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:20:27.391923 n-d-862967-2 devstack@n-api.service[127124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 04:20:27.392137 n-d-862967-2 devstack@n-api.service[127124]: Sat Oct 29 04:20:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6/action (ip 10.222.0.46) !!! Oct 29 04:20:27.393344 n-d-862967-2 devstack@n-api.service[127124]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 04:20:27.393524 n-d-862967-2 devstack@n-api.service[127124]: Sat Oct 29 04:20:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6/action (ip 10.222.0.46) !!! Oct 29 04:20:27.399887 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-2816f108-cac5-460c-8120-e4d7d74976f9 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1480525195"}} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:20:27.402288 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-2816f108-cac5-460c-8120-e4d7d74976f9 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: a99d8141-6e22-4a07-9765-67d6588f51c6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:20:27.412350 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2816f108-cac5-460c-8120-e4d7d74976f9 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:27.412882 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2816f108-cac5-460c-8120-e4d7d74976f9 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:27.413315 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2816f108-cac5-460c-8120-e4d7d74976f9 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:27.414027 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2816f108-cac5-460c-8120-e4d7d74976f9 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:27.414446 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2816f108-cac5-460c-8120-e4d7d74976f9 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:27.414888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-2816f108-cac5-460c-8120-e4d7d74976f9 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:27.870793 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-2816f108-cac5-460c-8120-e4d7d74976f9 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "POST /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6/action" status: 202 len: 0 microversion: 2.1 time: 0.484233 Oct 29 04:20:27.871449 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3909/7591] 10.222.0.46 () {60 vars in 1278 bytes} [Sat Oct 29 04:20:27 2022] POST /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 29 04:20:34.482944 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:20:34.484504 n-d-862967-2 devstack@n-api.service[127125]: DEBUG dbcounter [-] [127125] Writing DB stats nova_cell1:SELECT=52 {{(pid=127125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:20:34.485883 n-d-862967-2 devstack@n-api.service[127125]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 04:20:34.486163 n-d-862967-2 devstack@n-api.service[127125]: Sat Oct 29 04:20:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.46) !!! Oct 29 04:20:34.494574 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-03cbd994-2b78-4536-8e36-91921a4fdf7e req-9459b061-4758-4071-903e-e7b7d72aa3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99d8141-6e22-4a07-9765-67d6588f51c6", "name": "network-vif-plugged", "status": "completed", "tag": "e0c2cbdf-b688-4d81-90bc-60f1d9820c8e"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:20:34.506789 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-03cbd994-2b78-4536-8e36-91921a4fdf7e req-9459b061-4758-4071-903e-e7b7d72aa3b1 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:34.507709 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-03cbd994-2b78-4536-8e36-91921a4fdf7e req-9459b061-4758-4071-903e-e7b7d72aa3b1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:34.508368 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-03cbd994-2b78-4536-8e36-91921a4fdf7e req-9459b061-4758-4071-903e-e7b7d72aa3b1 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:34.546402 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-03cbd994-2b78-4536-8e36-91921a4fdf7e req-9459b061-4758-4071-903e-e7b7d72aa3b1 service nova] Creating event network-vif-plugged:e0c2cbdf-b688-4d81-90bc-60f1d9820c8e for instance a99d8141-6e22-4a07-9765-67d6588f51c6 on n-h1-862967-2 Oct 29 04:20:34.563473 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-03cbd994-2b78-4536-8e36-91921a4fdf7e req-9459b061-4758-4071-903e-e7b7d72aa3b1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079795 Oct 29 04:20:34.563473 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3683/7592] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:20:42.606251 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-d8d0c39c-8269-431a-97c7-d6d888857214 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:20:42.606991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d8d0c39c-8269-431a-97c7-d6d888857214 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: a99d8141-6e22-4a07-9765-67d6588f51c6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:20:42.609773 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-3d287b1b-1c42-4a49-b9c2-917cc1f28fd9 req-41b75725-df27-4840-83dc-82f58d4a6711 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a99d8141-6e22-4a07-9765-67d6588f51c6", "tag": "e0c2cbdf-b688-4d81-90bc-60f1d9820c8e"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:20:42.613402 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_api:SELECT=2 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:20:42.614227 n-d-862967-2 devstack@n-api.service[127124]: DEBUG dbcounter [-] [127124] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127124) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:20:42.616023 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8d0c39c-8269-431a-97c7-d6d888857214 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:42.616785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8d0c39c-8269-431a-97c7-d6d888857214 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:42.617434 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8d0c39c-8269-431a-97c7-d6d888857214 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:42.618375 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8d0c39c-8269-431a-97c7-d6d888857214 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:42.619025 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8d0c39c-8269-431a-97c7-d6d888857214 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:42.619660 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-d8d0c39c-8269-431a-97c7-d6d888857214 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:42.620665 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3d287b1b-1c42-4a49-b9c2-917cc1f28fd9 req-41b75725-df27-4840-83dc-82f58d4a6711 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:42.621159 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3d287b1b-1c42-4a49-b9c2-917cc1f28fd9 req-41b75725-df27-4840-83dc-82f58d4a6711 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:42.621613 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-3d287b1b-1c42-4a49-b9c2-917cc1f28fd9 req-41b75725-df27-4840-83dc-82f58d4a6711 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:42.633981 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-3d287b1b-1c42-4a49-b9c2-917cc1f28fd9 req-41b75725-df27-4840-83dc-82f58d4a6711 service nova] Creating event network-changed:e0c2cbdf-b688-4d81-90bc-60f1d9820c8e for instance a99d8141-6e22-4a07-9765-67d6588f51c6 on n-h1-862967-2 Oct 29 04:20:42.639111 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-3d287b1b-1c42-4a49-b9c2-917cc1f28fd9 req-41b75725-df27-4840-83dc-82f58d4a6711 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034839 Oct 29 04:20:42.639967 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3684/7593] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:20:42.654412 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-d8d0c39c-8269-431a-97c7-d6d888857214 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: a99d8141-6e22-4a07-9765-67d6588f51c6] Going to try to terminate instance {{(pid=127124) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 04:20:42.739644 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-d8d0c39c-8269-431a-97c7-d6d888857214 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6" status: 204 len: 0 microversion: 2.1 time: 0.137677 Oct 29 04:20:42.740503 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3910/7594] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 04:20:42 2022] DELETE /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 04:20:42.751201 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-f09ede17-50c0-476c-92ac-1097a549cb58 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:20:42.751907 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-f09ede17-50c0-476c-92ac-1097a549cb58 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: a99d8141-6e22-4a07-9765-67d6588f51c6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:20:42.758421 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f09ede17-50c0-476c-92ac-1097a549cb58 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:42.759286 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f09ede17-50c0-476c-92ac-1097a549cb58 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:42.759965 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f09ede17-50c0-476c-92ac-1097a549cb58 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:42.760692 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f09ede17-50c0-476c-92ac-1097a549cb58 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:42.761318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f09ede17-50c0-476c-92ac-1097a549cb58 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:42.761928 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-f09ede17-50c0-476c-92ac-1097a549cb58 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:42.932103 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-f09ede17-50c0-476c-92ac-1097a549cb58 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:20:42.940330 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-f09ede17-50c0-476c-92ac-1097a549cb58 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6" status: 200 len: 1682 microversion: 2.1 time: 0.193460 Oct 29 04:20:42.941804 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3685/7595] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:20:42 2022] GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6 => generated 1682 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:20:43.967723 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-3448974a-522d-4172-a1a4-556056e8d348 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:20:43.968503 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-3448974a-522d-4172-a1a4-556056e8d348 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: a99d8141-6e22-4a07-9765-67d6588f51c6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:20:43.976941 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3448974a-522d-4172-a1a4-556056e8d348 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:43.977500 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3448974a-522d-4172-a1a4-556056e8d348 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:43.978026 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3448974a-522d-4172-a1a4-556056e8d348 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:43.978811 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3448974a-522d-4172-a1a4-556056e8d348 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:43.979321 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3448974a-522d-4172-a1a4-556056e8d348 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:43.979764 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-3448974a-522d-4172-a1a4-556056e8d348 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:44.119209 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-3448974a-522d-4172-a1a4-556056e8d348 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:20:44.127562 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-3448974a-522d-4172-a1a4-556056e8d348 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6" status: 200 len: 1682 microversion: 2.1 time: 0.164749 Oct 29 04:20:44.128136 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3911/7596] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:20:43 2022] GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:20:44.453604 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [req-884c5c9b-18a7-4420-85e1-98baa2b99340 req-0b7b59da-da5e-4b71-a0d8-5b16ae3835c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99d8141-6e22-4a07-9765-67d6588f51c6", "name": "network-vif-unplugged", "status": "completed", "tag": "e0c2cbdf-b688-4d81-90bc-60f1d9820c8e"}]} {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:20:44.465835 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-884c5c9b-18a7-4420-85e1-98baa2b99340 req-0b7b59da-da5e-4b71-a0d8-5b16ae3835c3 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:44.466914 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-884c5c9b-18a7-4420-85e1-98baa2b99340 req-0b7b59da-da5e-4b71-a0d8-5b16ae3835c3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:44.467486 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [req-884c5c9b-18a7-4420-85e1-98baa2b99340 req-0b7b59da-da5e-4b71-a0d8-5b16ae3835c3 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:44.480597 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.compute.server_external_events [req-884c5c9b-18a7-4420-85e1-98baa2b99340 req-0b7b59da-da5e-4b71-a0d8-5b16ae3835c3 service nova] Creating event network-vif-unplugged:e0c2cbdf-b688-4d81-90bc-60f1d9820c8e for instance a99d8141-6e22-4a07-9765-67d6588f51c6 on n-h1-862967-2 Oct 29 04:20:44.486281 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [req-884c5c9b-18a7-4420-85e1-98baa2b99340 req-0b7b59da-da5e-4b71-a0d8-5b16ae3835c3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036834 Oct 29 04:20:44.487203 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3686/7597] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:20:45.029743 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-7fadc707-a78c-4b0b-94be-b5c621fef21c req-3c87174e-57ef-4b8b-89dc-77f1ea50e403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99d8141-6e22-4a07-9765-67d6588f51c6", "name": "network-vif-deleted", "tag": "e0c2cbdf-b688-4d81-90bc-60f1d9820c8e"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:20:45.040738 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7fadc707-a78c-4b0b-94be-b5c621fef21c req-3c87174e-57ef-4b8b-89dc-77f1ea50e403 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:45.041213 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7fadc707-a78c-4b0b-94be-b5c621fef21c req-3c87174e-57ef-4b8b-89dc-77f1ea50e403 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:45.041645 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-7fadc707-a78c-4b0b-94be-b5c621fef21c req-3c87174e-57ef-4b8b-89dc-77f1ea50e403 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:45.053547 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-7fadc707-a78c-4b0b-94be-b5c621fef21c req-3c87174e-57ef-4b8b-89dc-77f1ea50e403 service nova] Creating event network-vif-deleted:e0c2cbdf-b688-4d81-90bc-60f1d9820c8e for instance a99d8141-6e22-4a07-9765-67d6588f51c6 on n-h1-862967-2 Oct 29 04:20:45.059532 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-7fadc707-a78c-4b0b-94be-b5c621fef21c req-3c87174e-57ef-4b8b-89dc-77f1ea50e403 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033283 Oct 29 04:20:45.060408 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3912/7598] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:20:45.151995 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-54f00686-353f-4b2f-ab23-b658182007eb tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:20:45.152752 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-54f00686-353f-4b2f-ab23-b658182007eb tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: a99d8141-6e22-4a07-9765-67d6588f51c6] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:20:45.159556 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-54f00686-353f-4b2f-ab23-b658182007eb tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:45.160060 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-54f00686-353f-4b2f-ab23-b658182007eb tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:45.160508 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-54f00686-353f-4b2f-ab23-b658182007eb tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:45.161268 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-54f00686-353f-4b2f-ab23-b658182007eb tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:45.161751 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-54f00686-353f-4b2f-ab23-b658182007eb tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:45.162271 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-54f00686-353f-4b2f-ab23-b658182007eb tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:45.195778 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-54f00686-353f-4b2f-ab23-b658182007eb tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:45.196282 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-54f00686-353f-4b2f-ab23-b658182007eb tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:45.196840 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-54f00686-353f-4b2f-ab23-b658182007eb tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:45.197209 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-54f00686-353f-4b2f-ab23-b658182007eb tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lazy-loading 'fault' on Instance uuid a99d8141-6e22-4a07-9765-67d6588f51c6 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 04:20:45.241278 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-54f00686-353f-4b2f-ab23-b658182007eb tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:20:45.249470 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-54f00686-353f-4b2f-ab23-b658182007eb tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6" status: 200 len: 1338 microversion: 2.1 time: 0.102021 Oct 29 04:20:45.250070 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3687/7599] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:20:45 2022] GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6 => generated 1338 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:20:46.278831 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7c86d266-1b40-4c75-b045-2a725ff72745 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:20:46.279991 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-7c86d266-1b40-4c75-b045-2a725ff72745 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: a99d8141-6e22-4a07-9765-67d6588f51c6] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:20:46.289581 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c86d266-1b40-4c75-b045-2a725ff72745 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:46.290289 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c86d266-1b40-4c75-b045-2a725ff72745 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:46.290914 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c86d266-1b40-4c75-b045-2a725ff72745 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:46.292055 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c86d266-1b40-4c75-b045-2a725ff72745 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:46.292509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c86d266-1b40-4c75-b045-2a725ff72745 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:46.292962 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-7c86d266-1b40-4c75-b045-2a725ff72745 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:46.306625 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-7c86d266-1b40-4c75-b045-2a725ff72745 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] HTTP exception thrown: Instance a99d8141-6e22-4a07-9765-67d6588f51c6 could not be found. Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7c86d266-1b40-4c75-b045-2a725ff72745 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Request method failure captured: Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6 HTTP/1.1 Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXKkJpWZVjvMFTCJBLiuYVDrAZdmaj3GvtNyL5MR16c3GH8ojlaMVIHcZFLwhIHoIQoIgX74jlaNqPkfRhWVMzaUkchpIHrb1u5Xl_W6pNJfWKSdOW5UUlbqOLIwjnRclP90E3tSddYkkcqB-MwT8-KK51W-5t9OIxvATlkEadOZMLxA Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: cae48898f922487a9f15a51ab991bc7b Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-TestSnapshotPattern-396607495 Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cae48898f922487a9f15a51ab991bc7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cae48898f922487a9f15a51ab991bc7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_cae48898f922487a9f15a51ab991bc7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/cae48898f922487a9f15a51ab991bc7b"}]}] Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-TestSnapshotPattern-396607495 Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: cae48898f922487a9f15a51ab991bc7b Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-TestSnapshotPattern-396607495 Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-TestSnapshotPattern-396607495-project Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 6608bdbfb8db45949ddd9872c03295f9 Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-TestSnapshotPattern-396607495-project Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance a99d8141-6e22-4a07-9765-67d6588f51c6 could not be found. Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'a99d8141-6e22-4a07-9765-67d6588f51c6'} Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a99d8141-6e22-4a07-9765-67d6588f51c6 could not be found. Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a99d8141-6e22-4a07-9765-67d6588f51c6 could not be found. Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:20:46.308272 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 04:20:46.313973 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:20:46.313973 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:20:46.313973 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:20:46.313973 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 04:20:46.313973 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 04:20:46.313973 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a99d8141-6e22-4a07-9765-67d6588f51c6 could not be found. Oct 29 04:20:46.313973 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 04:20:46.313973 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-7c86d266-1b40-4c75-b045-2a725ff72745 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Returning 404 to user: Instance a99d8141-6e22-4a07-9765-67d6588f51c6 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 04:20:46.313973 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-7c86d266-1b40-4c75-b045-2a725ff72745 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6" status: 404 len: 111 microversion: 2.1 time: 0.038605 Oct 29 04:20:46.313973 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3913/7600] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:20:46 2022] GET /compute/v2.1/servers/a99d8141-6e22-4a07-9765-67d6588f51c6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 04:20:47.894720 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-38edd7e1-061c-48ce-ad2a-b68d293e2425 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:20:47.895273 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-38edd7e1-061c-48ce-ad2a-b68d293e2425 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: d58c87d7-9a68-4768-9885-b085480b9230] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:20:47.896468 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-a34ad4bd-4a28-4c99-8096-d7d2d632351c req-42ad9ad3-3dac-4e3f-b56c-431aa9fcd6fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d58c87d7-9a68-4768-9885-b085480b9230", "tag": "123de2cf-d4bf-4ac5-921c-f224fa099bfe"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:20:47.902149 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-38edd7e1-061c-48ce-ad2a-b68d293e2425 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:47.902649 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-38edd7e1-061c-48ce-ad2a-b68d293e2425 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:47.903354 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-38edd7e1-061c-48ce-ad2a-b68d293e2425 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:47.904067 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-38edd7e1-061c-48ce-ad2a-b68d293e2425 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:47.904966 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-38edd7e1-061c-48ce-ad2a-b68d293e2425 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:47.905407 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-38edd7e1-061c-48ce-ad2a-b68d293e2425 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:47.908785 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a34ad4bd-4a28-4c99-8096-d7d2d632351c req-42ad9ad3-3dac-4e3f-b56c-431aa9fcd6fe service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:47.909509 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a34ad4bd-4a28-4c99-8096-d7d2d632351c req-42ad9ad3-3dac-4e3f-b56c-431aa9fcd6fe service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:47.910267 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-a34ad4bd-4a28-4c99-8096-d7d2d632351c req-42ad9ad3-3dac-4e3f-b56c-431aa9fcd6fe service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:47.922742 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-a34ad4bd-4a28-4c99-8096-d7d2d632351c req-42ad9ad3-3dac-4e3f-b56c-431aa9fcd6fe service nova] Creating event network-changed:123de2cf-d4bf-4ac5-921c-f224fa099bfe for instance d58c87d7-9a68-4768-9885-b085480b9230 on n-h2-862967-2 Oct 29 04:20:47.928098 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-a34ad4bd-4a28-4c99-8096-d7d2d632351c req-42ad9ad3-3dac-4e3f-b56c-431aa9fcd6fe service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035666 Oct 29 04:20:47.929712 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3914/7601] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:20:47.935589 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-38edd7e1-061c-48ce-ad2a-b68d293e2425 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: d58c87d7-9a68-4768-9885-b085480b9230] Going to try to terminate instance {{(pid=127125) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 29 04:20:48.022508 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-38edd7e1-061c-48ce-ad2a-b68d293e2425 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230" status: 204 len: 0 microversion: 2.1 time: 0.131750 Oct 29 04:20:48.023566 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3688/7602] 10.222.0.46 () {58 vars in 1239 bytes} [Sat Oct 29 04:20:47 2022] DELETE /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 04:20:48.033668 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-540cd422-a3c2-4ab7-8ea3-69ad6f8e0923 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:20:48.034382 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-540cd422-a3c2-4ab7-8ea3-69ad6f8e0923 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: d58c87d7-9a68-4768-9885-b085480b9230] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:20:48.041068 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-540cd422-a3c2-4ab7-8ea3-69ad6f8e0923 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:48.041832 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-540cd422-a3c2-4ab7-8ea3-69ad6f8e0923 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:48.042276 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-540cd422-a3c2-4ab7-8ea3-69ad6f8e0923 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:48.043076 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-540cd422-a3c2-4ab7-8ea3-69ad6f8e0923 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:48.043539 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-540cd422-a3c2-4ab7-8ea3-69ad6f8e0923 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:48.043970 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-540cd422-a3c2-4ab7-8ea3-69ad6f8e0923 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:48.189984 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.policy [None req-540cd422-a3c2-4ab7-8ea3-69ad6f8e0923 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127124) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:20:48.198129 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-540cd422-a3c2-4ab7-8ea3-69ad6f8e0923 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230" status: 200 len: 1684 microversion: 2.1 time: 0.169288 Oct 29 04:20:48.198808 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3915/7603] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:20:48 2022] GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230 => generated 1684 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:20:49.227216 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-3e4a4af1-e46b-4c82-83e4-d53954c99c48 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:20:49.228340 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-3e4a4af1-e46b-4c82-83e4-d53954c99c48 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: d58c87d7-9a68-4768-9885-b085480b9230] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:20:49.236912 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e4a4af1-e46b-4c82-83e4-d53954c99c48 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:49.237408 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e4a4af1-e46b-4c82-83e4-d53954c99c48 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:49.237847 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e4a4af1-e46b-4c82-83e4-d53954c99c48 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:49.238554 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e4a4af1-e46b-4c82-83e4-d53954c99c48 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:49.239017 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e4a4af1-e46b-4c82-83e4-d53954c99c48 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:49.239425 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-3e4a4af1-e46b-4c82-83e4-d53954c99c48 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:49.440986 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-3e4a4af1-e46b-4c82-83e4-d53954c99c48 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:20:49.451530 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-3e4a4af1-e46b-4c82-83e4-d53954c99c48 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230" status: 200 len: 1684 microversion: 2.1 time: 0.231822 Oct 29 04:20:49.452149 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3689/7604] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:20:49 2022] GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230 => generated 1684 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:20:50.445663 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [req-64cc94d2-dd06-466a-b704-abc126528a76 req-65a94274-37a0-4db8-acf9-83e22c92f3d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d58c87d7-9a68-4768-9885-b085480b9230", "name": "network-vif-deleted", "tag": "123de2cf-d4bf-4ac5-921c-f224fa099bfe"}]} {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 04:20:50.456041 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-64cc94d2-dd06-466a-b704-abc126528a76 req-65a94274-37a0-4db8-acf9-83e22c92f3d0 service nova] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:50.456550 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-64cc94d2-dd06-466a-b704-abc126528a76 req-65a94274-37a0-4db8-acf9-83e22c92f3d0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:50.457000 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [req-64cc94d2-dd06-466a-b704-abc126528a76 req-65a94274-37a0-4db8-acf9-83e22c92f3d0 service nova] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:50.472956 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.compute.server_external_events [req-64cc94d2-dd06-466a-b704-abc126528a76 req-65a94274-37a0-4db8-acf9-83e22c92f3d0 service nova] Creating event network-vif-deleted:123de2cf-d4bf-4ac5-921c-f224fa099bfe for instance d58c87d7-9a68-4768-9885-b085480b9230 on n-h2-862967-2 Oct 29 04:20:50.478384 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-1a59d5f0-0243-485a-a26a-9e059527462e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:20:50.478876 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [req-64cc94d2-dd06-466a-b704-abc126528a76 req-65a94274-37a0-4db8-acf9-83e22c92f3d0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103716 Oct 29 04:20:50.479178 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.compute.api [None req-1a59d5f0-0243-485a-a26a-9e059527462e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: d58c87d7-9a68-4768-9885-b085480b9230] Fetching instance by UUID {{(pid=127125) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:20:50.480059 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3916/7605] 10.222.0.46 () {64 vars in 1317 bytes} [Sat Oct 29 04:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 04:20:50.506098 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a59d5f0-0243-485a-a26a-9e059527462e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:50.508122 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a59d5f0-0243-485a-a26a-9e059527462e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:50.509193 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a59d5f0-0243-485a-a26a-9e059527462e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:50.510841 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a59d5f0-0243-485a-a26a-9e059527462e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:50.511582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a59d5f0-0243-485a-a26a-9e059527462e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:50.512866 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a59d5f0-0243-485a-a26a-9e059527462e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:50.550318 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a59d5f0-0243-485a-a26a-9e059527462e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:50.550852 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a59d5f0-0243-485a-a26a-9e059527462e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:50.551582 n-d-862967-2 devstack@n-api.service[127125]: DEBUG oslo_concurrency.lockutils [None req-1a59d5f0-0243-485a-a26a-9e059527462e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127125) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:50.552254 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.objects.instance [None req-1a59d5f0-0243-485a-a26a-9e059527462e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lazy-loading 'fault' on Instance uuid d58c87d7-9a68-4768-9885-b085480b9230 {{(pid=127125) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 29 04:20:50.969228 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.policy [None req-1a59d5f0-0243-485a-a26a-9e059527462e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6608bdbfb8db45949ddd9872c03295f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cae48898f922487a9f15a51ab991bc7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127125) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 04:20:50.976798 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-1a59d5f0-0243-485a-a26a-9e059527462e tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230" status: 200 len: 1338 microversion: 2.1 time: 0.504301 Oct 29 04:20:50.977367 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3690/7606] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:20:50 2022] GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230 => generated 1338 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 04:20:52.004400 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-06ea183b-54c5-4e17-8e16-efbc9bc56468 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '>' {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:20:52.005238 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.compute.api [None req-06ea183b-54c5-4e17-8e16-efbc9bc56468 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] [instance: d58c87d7-9a68-4768-9885-b085480b9230] Fetching instance by UUID {{(pid=127124) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 29 04:20:52.013307 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06ea183b-54c5-4e17-8e16-efbc9bc56468 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:52.013888 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06ea183b-54c5-4e17-8e16-efbc9bc56468 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:52.014402 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06ea183b-54c5-4e17-8e16-efbc9bc56468 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:52.015222 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06ea183b-54c5-4e17-8e16-efbc9bc56468 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Acquiring lock "5270c754-82e2-4d8e-a02e-4533aa854f76" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 29 04:20:52.015751 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06ea183b-54c5-4e17-8e16-efbc9bc56468 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 29 04:20:52.016252 n-d-862967-2 devstack@n-api.service[127124]: DEBUG oslo_concurrency.lockutils [None req-06ea183b-54c5-4e17-8e16-efbc9bc56468 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Lock "5270c754-82e2-4d8e-a02e-4533aa854f76" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127124) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 29 04:20:52.032116 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.wsgi [None req-06ea183b-54c5-4e17-8e16-efbc9bc56468 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] HTTP exception thrown: Instance d58c87d7-9a68-4768-9885-b085480b9230 could not be found. Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-06ea183b-54c5-4e17-8e16-efbc9bc56468 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Request method failure captured: Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: request: GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230 HTTP/1.1 Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: Accept: application/json Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: Accept-Encoding: identity Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: Connection: close Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: Content-Length: 0 Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: Content-Type: application/json Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: Host: 10.222.0.46 Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: Openstack-System-Scope: None Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: User-Agent: python-urllib3/1.26.12 Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: X-Auth-Token: gAAAAABjXKkJpWZVjvMFTCJBLiuYVDrAZdmaj3GvtNyL5MR16c3GH8ojlaMVIHcZFLwhIHoIQoIgX74jlaNqPkfRhWVMzaUkchpIHrb1u5Xl_W6pNJfWKSdOW5UUlbqOLIwjnRclP90E3tSddYkkcqB-MwT8-KK51W-5t9OIxvATlkEadOZMLxA Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Id: None Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: X-Domain-Name: None Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: X-Identity-Status: Confirmed Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: X-Is-Admin-Project: True Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Id: default Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Domain-Name: Default Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Id: cae48898f922487a9f15a51ab991bc7b Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: X-Project-Name: tempest-TestSnapshotPattern-396607495 Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: X-Role: reader,member Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: X-Roles: reader,member Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cae48898f922487a9f15a51ab991bc7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cae48898f922487a9f15a51ab991bc7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_cae48898f922487a9f15a51ab991bc7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/cae48898f922487a9f15a51ab991bc7b"}]}] Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant: tempest-TestSnapshotPattern-396607495 Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Id: cae48898f922487a9f15a51ab991bc7b Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: X-Tenant-Name: tempest-TestSnapshotPattern-396607495 Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: X-User: tempest-TestSnapshotPattern-396607495-project Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Id: default Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: X-User-Domain-Name: Default Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: X-User-Id: 6608bdbfb8db45949ddd9872c03295f9 Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: X-User-Name: tempest-TestSnapshotPattern-396607495-project Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: method: > Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: exception: Instance d58c87d7-9a68-4768-9885-b085480b9230 could not be found. Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: action_args: {'id': 'd58c87d7-9a68-4768-9885-b085480b9230'} Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: {{(pid=127124) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d58c87d7-9a68-4768-9885-b085480b9230 could not be found. Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d58c87d7-9a68-4768-9885-b085480b9230 could not be found. Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 29 04:20:52.033814 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 04:20:52.039265 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 29 04:20:52.039265 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 29 04:20:52.039265 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 29 04:20:52.039265 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 29 04:20:52.039265 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 29 04:20:52.039265 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d58c87d7-9a68-4768-9885-b085480b9230 could not be found. Oct 29 04:20:52.039265 n-d-862967-2 devstack@n-api.service[127124]: ERROR nova.api.openstack.wsgi Oct 29 04:20:52.039265 n-d-862967-2 devstack@n-api.service[127124]: DEBUG nova.api.openstack.wsgi [None req-06ea183b-54c5-4e17-8e16-efbc9bc56468 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Returning 404 to user: Instance d58c87d7-9a68-4768-9885-b085480b9230 could not be found. {{(pid=127124) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 29 04:20:52.039265 n-d-862967-2 devstack@n-api.service[127124]: INFO nova.api.openstack.requestlog [None req-06ea183b-54c5-4e17-8e16-efbc9bc56468 tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230" status: 404 len: 111 microversion: 2.1 time: 0.037071 Oct 29 04:20:52.039265 n-d-862967-2 devstack@n-api.service[127124]: [pid: 127124|app: 0|req: 3917/7607] 10.222.0.46 () {58 vars in 1236 bytes} [Sat Oct 29 04:20:51 2022] GET /compute/v2.1/servers/d58c87d7-9a68-4768-9885-b085480b9230 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 04:20:52.208766 n-d-862967-2 devstack@n-api.service[127125]: DEBUG nova.api.openstack.wsgi [None req-843cfa2e-8429-42be-bbaa-47d7f7d7edad tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] Calling method '.version_select at 0x7ff053a48430>' {{(pid=127125) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 04:20:52.243563 n-d-862967-2 devstack@n-api.service[127125]: INFO nova.api.openstack.requestlog [None req-843cfa2e-8429-42be-bbaa-47d7f7d7edad tempest-TestSnapshotPattern-396607495 tempest-TestSnapshotPattern-396607495-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-648059116" status: 202 len: 0 microversion: 2.1 time: 0.038886 Oct 29 04:20:52.244160 n-d-862967-2 devstack@n-api.service[127125]: [pid: 127125|app: 0|req: 3691/7608] 10.222.0.46 () {58 vars in 1254 bytes} [Sat Oct 29 04:20:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-648059116 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)